| *** sgrasley_ has joined #airshipit | 00:30 | |
| *** sgrasley has quit IRC | 00:32 | |
| *** kukacz_ has quit IRC | 00:32 | |
| *** kukacz has joined #airshipit | 00:33 | |
| *** kaspars__ has quit IRC | 01:41 | |
| *** mbeierl has quit IRC | 01:47 | |
| *** sthussey has quit IRC | 02:11 | |
| *** kranthikirang has quit IRC | 02:51 | |
| *** kaspars__ has joined #airshipit | 03:01 | |
| openstackgerrit | Kaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site https://review.openstack.org/649195 | 03:15 |
|---|---|---|
| openstackgerrit | Kaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site https://review.openstack.org/649195 | 03:30 |
| *** jamesgu has quit IRC | 04:01 | |
| *** lemko has joined #airshipit | 04:59 | |
| *** kaspars__ has quit IRC | 06:51 | |
| *** lemko has quit IRC | 07:09 | |
| *** sgrasley_ has quit IRC | 07:27 | |
| *** Nishant_ has joined #airshipit | 07:39 | |
| *** happyhemant has joined #airshipit | 07:42 | |
| *** mbologna_ has quit IRC | 07:50 | |
| *** mbologna has joined #airshipit | 07:51 | |
| *** lemko has joined #airshipit | 08:10 | |
| openstackgerrit | Dmitrii Kabanov proposed openstack/airship-divingbell master: Add support of older versions of GO https://review.openstack.org/651733 | 09:21 |
| *** Nishant_ has quit IRC | 09:49 | |
| *** aaronsheffield has joined #airshipit | 12:55 | |
| *** kranthikirang has joined #airshipit | 13:41 | |
| *** ianychoi has quit IRC | 14:13 | |
| *** ianychoi has joined #airshipit | 14:14 | |
| *** kaspars__ has joined #airshipit | 14:26 | |
| openstackgerrit | Kaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site https://review.openstack.org/649195 | 14:41 |
| openstackgerrit | Rahul Khiyani proposed openstack/airship-promenade master: [DNM]Add pod/container security context https://review.openstack.org/639189 | 14:47 |
| openstackgerrit | Merged openstack/airship-promenade master: Revert "remove /etc/genesis post armada bootstrap" https://review.openstack.org/651646 | 14:54 |
| openstackgerrit | Ian Pittwood proposed openstack/airship-spyglass master: [WIP] Resolves Bandit 104 errors https://review.openstack.org/651807 | 14:59 |
| openstackgerrit | Rick Bartra proposed openstack/airship-drydock master: Add CIDR validation for MAAS https://review.openstack.org/648781 | 15:01 |
| *** sthussey has joined #airshipit | 15:05 | |
| openstackgerrit | Kaspars Skels proposed openstack/airship-treasuremap master: [WIP] Create pipeline for airsloop site https://review.openstack.org/649432 | 15:05 |
| openstackgerrit | Alexander Hughes proposed openstack/airship-pegleg master: [WIP] Ensure cryptostrings contain all char types https://review.openstack.org/651812 | 15:10 |
| kranthikirang | kaspars__: I am at the step to deploy nodes; MAAS commissioned the master nodes and in process to deploy them. I am seeing at console that all servers are trying to fetch following from MAAS API and retries; http://10.23.20.11:30000/api/v1.0/bootactions/nodes/mtn21c-node-02/files | 15:20 |
| kranthikirang | Kaspars__: When I look into maas-rack-0 I see following error: http://paste.openstack.org/show/749190/ | 15:22 |
| kranthikirang | Can you help over here? | 15:22 |
| kranthikirang | from drydock I see an error: http://paste.openstack.org/show/749191/ | 15:23 |
| openstackgerrit | Rick Bartra proposed openstack/airship-drydock master: Add CIDR validation for MAAS https://review.openstack.org/648781 | 15:23 |
| kaspars__ | Generally, when a new node is done deploying as a last step it will call back to MAAS to get bootactions (mainly promenade.join) which is then bootstrapping Kubernetes, etc | 15:24 |
| kaspars__ | MAAS is then calling to promenade to get the actual bootaction for promenade - can you also check promenade logs if you see any error there | 15:25 |
| kranthikirang | kaspars__: I see an error but not sure if that is relevant; http://paste.openstack.org/show/749192/ | 15:28 |
| openstackgerrit | Rahul Khiyani proposed openstack/airship-promenade master: [DNM]Add pod/container security context https://review.openstack.org/639189 | 15:29 |
| kranthikirang | kaspars_: looks like promenade didn't bootstrap totally in my setup? | 15:31 |
| kaspars__ | yes - that is exactly the error as you are running behind proxy | 15:31 |
| kaspars__ | so while generating initial bootaction promenade is pulling k8s binary " HTTPSConnectionPool(host='dl.k8s.io', port=443): Max retries exceeded with url: /v1.11.6/kubernetes-node-linux-amd64.tar.gz " | 15:31 |
| kaspars__ | so you will need to set proxy for promenade pod | 15:32 |
| kaspars__ | https://github.com/openstack/airship-treasuremap/blob/master/site/airship-seaworthy/software/charts/ucp/promenade/promenade.yaml#L21 | 15:32 |
| kaspars__ | here is commented out section that you can enable - you will need to update your chart though for this to take effect | 15:33 |
| kranthikirang | kaspars_: I thought Airship supports proxy; I did put the proxy in manifests; Do we have to explicitly pass proxy values to promenade? | 15:33 |
| kaspars__ | yes, you do - see the link I shared | 15:33 |
| kranthikirang | kaspars_: Ok; There is anyway I can upgrade the promenade help chart instead of rebuild everything? | 15:33 |
| kranthikirang | helm chart * | 15:33 |
| kranthikirang | or do I have to redo genesis ? | 15:35 |
| kaspars__ | there is a way to update YAMLs and use armada directly.. | 15:35 |
| kaspars__ | maybe we could create some troubleshooting/tips document sometime | 15:35 |
| kaspars__ | I think it's a little bit too much to get into | 15:35 |
| kranthikirang | that would be appropriate; there is no documentation on how to upgrade or redeploy with changes ..etc | 15:36 |
| kaspars__ | it's much more streamlined when the site is up - updating genesis directly is not exactly in path of normal operations | 15:36 |
| kaspars__ | but I agree - something we could work towards some document for troubleshooting/tips | 15:37 |
| kranthikirang | ok; What do you suggest me now? Update manifests and redeploy ? | 15:37 |
| kranthikirang | I though putting proxy in common-addresses.yaml would be sufficient; | 15:39 |
| kaspars__ | no, that mostly covers few aspects.. so definetely you may think of how more broader proxy support could be implemented | 15:40 |
| kranthikirang | https://review.openstack.org/#/c/649155/ - this is for promenade client while creating the bundle else it will fail; Please review it | 15:40 |
| kaspars__ | yes, that's a good example where proxy bits need to be injected | 15:41 |
| kaspars__ | I do think we should likely create a version of this script in airship-treasuremap/tools | 15:41 |
| kaspars__ | but not completely sure - this looks good to me | 15:41 |
| kranthikirang | kaspars__: Ok, please review it; Looks like I have missed updating proxy totally in promenade site specs; | 15:43 |
| kranthikirang | kaspars_: We should give a way to find NEWSITE_CHANGEME all places: I have missed this one | 15:43 |
| kaspars__ | https://github.com/openstack/airship-treasuremap/blob/master/site/airship-seaworthy/software/charts/ucp/promenade/promenade.yaml#L21 | 15:44 |
| kaspars__ | looks like it is there already, isn't it? | 15:44 |
| kranthikirang | yeah, exactly | 15:44 |
| kranthikirang | I will re-do and let you know | 15:44 |
| openstackgerrit | Scott Hussey proposed openstack/airship-promenade master: (apiserver) [WIP] support key rotation https://review.openstack.org/631935 | 15:48 |
| kranthikirang | kaspars_: any idea what would be no_proxy values? other than .cluster.local? | 15:48 |
| kaspars__ | "10.96.0.1,.cluster.local" - and maybe add some localhost, and 127.0.0.1 | 15:49 |
| kaspars__ | I think those should be sufficient | 15:49 |
| kranthikirang | I mean w.r.t ip addresses; don't think subnet will work for no_proxy 10.96.0.0/16 | 15:50 |
| kranthikirang | kaspars_: ok | 15:50 |
| openstackgerrit | Dimitrios Markou proposed openstack/airship-treasuremap master: [WIP] Create documentation for airsloop site https://review.openstack.org/651652 | 15:57 |
| openstackgerrit | Ian Pittwood proposed openstack/airship-spyglass master: [WIP] Resolve Bandit 605 error https://review.openstack.org/651823 | 15:57 |
| openstackgerrit | Ian Pittwood proposed openstack/airship-spyglass master: Remove flask YAML web editor from Spyglass https://review.openstack.org/650993 | 15:59 |
| openstackgerrit | Rick Bartra proposed openstack/airship-drydock master: Add CIDR validation for MAAS https://review.openstack.org/648781 | 16:00 |
| openstackgerrit | Alexander Hughes proposed openstack/airship-pegleg master: [WIP] Ensure cryptostrings contain all char types https://review.openstack.org/651812 | 16:04 |
| openstackgerrit | kranthi kiran guttikonda proposed openstack/airship-treasuremap master: promenade_api proxy input correction https://review.openstack.org/651826 | 16:05 |
| openstackgerrit | Alexander Hughes proposed openstack/airship-pegleg master: [WIP] Ensure cryptostrings contain all char types https://review.openstack.org/651812 | 16:16 |
| openstackgerrit | kranthi kiran guttikonda proposed openstack/airship-treasuremap master: promenade_api proxy input correction https://review.openstack.org/651826 | 16:17 |
| *** ianychoi has quit IRC | 16:20 | |
| openstackgerrit | Alexander Hughes proposed openstack/airship-pegleg master: [WIP] Ensure cryptostrings contain all char types https://review.openstack.org/651812 | 16:20 |
| openstackgerrit | Dmitrii Kabanov proposed openstack/airship-divingbell master: Add support of older versions of GO https://review.openstack.org/651733 | 16:27 |
| openstackgerrit | Ian Pittwood proposed openstack/airship-spyglass master: [WIP] Resolve Bandit 605 error https://review.openstack.org/651823 | 17:03 |
| openstackgerrit | Craig Anderson proposed openstack/airship-promenade master: Allow certgen independent of bundle creation https://review.openstack.org/637291 | 17:56 |
| *** kranthikirang has quit IRC | 18:02 | |
| *** bh526r has joined #airshipit | 18:06 | |
| openstackgerrit | Alexander Hughes proposed openstack/airship-pegleg master: Ensure cryptostrings contain all char types https://review.openstack.org/651812 | 18:18 |
| openstackgerrit | Craig Anderson proposed openstack/airship-divingbell master: Use common logger for consistent log output https://review.openstack.org/636816 | 18:18 |
| *** happyhemant has quit IRC | 18:21 | |
| openstackgerrit | Alexander Hughes proposed openstack/airship-pegleg master: Ensure cryptostrings contain all char types https://review.openstack.org/651812 | 18:23 |
| openstackgerrit | Alexander Hughes proposed openstack/airship-spyglass master: Various fixes to Spyglass to resolve tox errors https://review.openstack.org/648764 | 18:41 |
| openstackgerrit | Alexander Hughes proposed openstack/airship-spyglass master: Various fixes to Spyglass to resolve tox errors https://review.openstack.org/648764 | 18:57 |
| openstackgerrit | Kaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site https://review.openstack.org/649195 | 19:15 |
| openstackgerrit | Dmitrii Kabanov proposed openstack/airship-divingbell master: Add support of older versions of Helm https://review.openstack.org/651733 | 19:23 |
| openstackgerrit | Kaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site https://review.openstack.org/649195 | 19:38 |
| openstackgerrit | Merged openstack/airship-shipyard master: User context tracing through logging https://review.openstack.org/633873 | 19:41 |
| openstackgerrit | Kaspars Skels proposed openstack/airship-treasuremap master: Add Pegleg and Promenade scripts to tools/ https://review.openstack.org/651917 | 19:47 |
| openstackgerrit | Kaspars Skels proposed openstack/airship-treasuremap master: Add Pegleg, Promenade and Shipyard wrappers https://review.openstack.org/651917 | 19:53 |
| *** kranthikirang has joined #airshipit | 20:10 | |
| openstackgerrit | Kaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site https://review.openstack.org/649195 | 20:13 |
| kranthikirang | kaspars_: I see now following error: I guess this have to do with H/W profile for my HP gen9: | 20:14 |
| kranthikirang | Begin: Waiting for root file system ..Begin: Running /scripts/local-block. mdadm: CREATE group disk not found. mdadm: No devices listed in conf file were found | 20:15 |
| kranthikirang | I have following information in profile: | 20:16 |
| kranthikirang | ## storage | 20:16 |
| kranthikirang | # /dev/sda | 20:16 |
| kranthikirang | bootdisk: | 20:16 |
| kranthikirang | address: '0:1.0.0' | 20:16 |
| kranthikirang | dev_type: 'PERC H710P' | 20:16 |
| kranthikirang | bus_type: 'scsi' | 20:16 |
| kranthikirang | # /dev/sdb | 20:16 |
| kranthikirang | cephjournal1: | 20:16 |
| kranthikirang | address: '0:1.0.1' | 20:16 |
| kranthikirang | dev_type: 'PERC H710P' | 20:17 |
| kranthikirang | bus_type: 'scsi' | 20:17 |
| kranthikirang | # /dev/sdc | 20:17 |
| kranthikirang | #cephjournal2: | 20:17 |
| kranthikirang | # address: '0:1.0.4' | 20:17 |
| kranthikirang | # dev_type: 'PERC H710P' | 20:17 |
| kranthikirang | # bus_type: 'scsi' | 20:17 |
| kranthikirang | # /dev/sdc | 20:17 |
| kranthikirang | ephemeral: | 20:17 |
| kranthikirang | address: '0:1.0.4' | 20:17 |
| kranthikirang | dev_type: 'PERC H710P' | 20:17 |
| kranthikirang | bus_type: 'scsi' | 20:17 |
| openstackgerrit | Kaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site https://review.openstack.org/649195 | 20:17 |
| kranthikirang | I have used "lshw -c storage -c disk" command for "Physical id" which is address; not sure how to find dev_type? Any help? | 20:17 |
| openstackgerrit | Scott Hussey proposed openstack/airship-promenade master: (apiserver) [WIP] support key rotation https://review.openstack.org/631935 | 20:19 |
| kranthikirang | kaspars_: I have plan to use 1 SSD for ceph journal and 2 OSD(HDD)s per host; | 20:21 |
| openstackgerrit | Craig Anderson proposed openstack/airship-divingbell master: Use common logger for consistent log output https://review.openstack.org/636816 | 20:23 |
| kaspars__ | try running "sudo lshw -class disk" - I think it will give the info you need | 20:25 |
| kaspars__ | e.g. bus info: scsi@0:2.0.0 | 20:26 |
| kaspars__ | scsi is your type | 20:26 |
| kaspars__ | I think the type is the same also for SSD disks | 20:26 |
| kaspars__ | here in HW definitions - you basically write your aliases - you will later refer to them in the host profiles | 20:26 |
| kranthikirang | I thought scsi is a bus type | 20:27 |
| kaspars__ | it is.. | 20:27 |
| kranthikirang | so you mean bootdisk: | 20:27 |
| kranthikirang | address: '0:1.0.0' | 20:27 |
| kranthikirang | dev_type: 'scsi' | 20:27 |
| kranthikirang | bus_type: 'scsi' | 20:27 |
| kaspars__ | looks like dev_type matches "product" section | 20:28 |
| kaspars__ | I'm not really sure if dev_type is used really at the moment | 20:28 |
| kaspars__ | no - I would use the product section for dev_type - not exactly sure if it's used or not | 20:28 |
| kranthikirang | OK; | 20:28 |
| kranthikirang | then not sure why I am seeing this error | 20:28 |
| kranthikirang | Begin: Waiting for root file system ..Begin: Running /scripts/local-block. mdadm: CREATE group disk not found. mdadm: No devices listed in conf file were found | 20:28 |
| kranthikirang | in all 3 masters; deployment failed; | 20:29 |
| kranthikirang | and dropped into initramfs shell | 20:29 |
| kranthikirang | it shows product: LOGICAL VOLUME for all disks | 20:30 |
| kranthikirang | anyway if we are not using then less worried about that | 20:31 |
| kranthikirang | I am struck here, Any help would be really great | 20:31 |
| openstackgerrit | Dimitrios Markou proposed openstack/airship-treasuremap master: [WIP] Create documentation for airsloop site https://review.openstack.org/651652 | 20:59 |
| *** bh526r has quit IRC | 21:06 | |
| openstackgerrit | Evgeniy L proposed openstack/airship-treasuremap master: Change default number of l3 agents from 5 to 3 https://review.openstack.org/639179 | 21:19 |
| openstackgerrit | Evgeniy L proposed openstack/airship-treasuremap master: Update docs to include generated certs into collected dir https://review.openstack.org/639181 | 21:20 |
| openstackgerrit | Dimitrios Markou proposed openstack/airship-treasuremap master: [WIP] Create documentation for airsloop site https://review.openstack.org/651652 | 21:22 |
| openstackgerrit | Evgeniy L proposed openstack/airship-treasuremap master: Add metadata proxy shared secret for Nova and Neutron https://review.openstack.org/639183 | 21:23 |
| openstackgerrit | Evgeniy L proposed openstack/airship-treasuremap master: Do not rerun promjoin on every reboot https://review.openstack.org/642571 | 21:23 |
| openstackgerrit | Dimitrios Markou proposed openstack/airship-treasuremap master: [WIP] Create documentation for airsloop site https://review.openstack.org/651652 | 21:24 |
| *** lemko has quit IRC | 21:30 | |
| openstackgerrit | Scott Hussey proposed openstack/airship-promenade master: (apiserver) [WIP] support key rotation https://review.openstack.org/631935 | 21:39 |
| arunkant | roman_g: Hi, did you got to review some of comments/feedback in airship multi-distro spec : https://review.openstack.org/#/c/643106/5/specs/approved/airship_multi_linux_distros.rst .May be updated patch is needed. | 21:48 |
| openstackgerrit | Dmitrii Kabanov proposed openstack/airship-drydock master: Add possibility to check response code in auth test https://review.openstack.org/651933 | 22:17 |
| openstackgerrit | Kaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site https://review.openstack.org/649195 | 22:18 |
| openstackgerrit | Dmitrii Kabanov proposed openstack/airship-drydock master: Add possibility to check response code in auth test https://review.openstack.org/651935 | 22:21 |
| *** aaronsheffield has quit IRC | 23:14 | |
| *** kukacz has quit IRC | 23:21 | |
| *** roman_g has quit IRC | 23:21 | |
| *** nick_kar has quit IRC | 23:21 | |
| openstackgerrit | Sreejith Punnapuzha proposed openstack/airship-promenade master: [fix] etcd backup to use different filename https://review.openstack.org/648745 | 23:22 |
| *** kukacz has joined #airshipit | 23:27 | |
| *** roman_g has joined #airshipit | 23:27 | |
| *** nick_kar has joined #airshipit | 23:27 | |
| *** kranthikirang has quit IRC | 23:27 | |
| openstackgerrit | PRATEEK REDDY DODDA proposed openstack/airship-deckhand master: Implement Security Context for Deckhand https://review.openstack.org/639204 | 23:47 |
| openstackgerrit | PRATEEK REDDY DODDA proposed openstack/airship-armada master: Implement Security Context for Armada https://review.openstack.org/639207 | 23:53 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!