Tuesday, 2020-11-24

*** zenkuro has joined #openstack-kolla00:11
*** k_mouza has joined #openstack-kolla00:14
*** k_mouza has quit IRC00:19
*** brinzhang has joined #openstack-kolla00:38
*** zzzeek has quit IRC01:26
*** zzzeek has joined #openstack-kolla01:26
*** zzzeek has quit IRC01:31
*** zzzeek has joined #openstack-kolla01:32
*** openstackgerrit has joined #openstack-kolla01:32
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Add support for LetsEncrypt-managed certs  https://review.opendev.org/c/openstack/kolla-ansible/+/74134001:32
*** zzzeek has quit IRC01:50
*** zzzeek has joined #openstack-kolla01:51
*** zzzeek has quit IRC02:07
*** zzzeek has joined #openstack-kolla02:11
*** k_mouza has joined #openstack-kolla02:14
*** wuchunyang has joined #openstack-kolla02:15
*** k_mouza has quit IRC02:15
*** brinzhang has quit IRC02:16
*** zzzeek has quit IRC02:16
*** zzzeek has joined #openstack-kolla02:18
*** kevko_ has joined #openstack-kolla02:23
*** zzzeek has quit IRC02:30
*** zzzeek has joined #openstack-kolla02:31
*** kevko_ has quit IRC03:23
*** wuchunyang has quit IRC04:04
*** k_mouza has joined #openstack-kolla04:15
*** k_mouza has quit IRC04:16
*** k_mouza_ has joined #openstack-kolla04:16
*** zzzeek has quit IRC04:18
*** zzzeek has joined #openstack-kolla04:19
*** k_mouza_ has quit IRC04:21
*** k_mouza has joined #openstack-kolla04:34
*** zzzeek has quit IRC04:34
*** zzzeek has joined #openstack-kolla04:35
*** k_mouza has quit IRC04:38
*** zzzeek has quit IRC04:59
*** zzzeek has joined #openstack-kolla05:00
*** zzzeek has quit IRC05:10
*** zzzeek has joined #openstack-kolla05:11
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-kolla05:33
*** jovial[m] has quit IRC05:50
*** jovial[m] has joined #openstack-kolla06:13
*** shyamb has joined #openstack-kolla06:19
*** k_mouza has joined #openstack-kolla06:35
*** numans has quit IRC06:37
*** k_mouza has quit IRC06:39
hrwhttps://review.opendev.org/c/openstack/kolla/+/763771 mnasiadka yoctozepto osmanlicilegi06:43
*** numans has joined #openstack-kolla06:44
*** bsanjeewa has joined #openstack-kolla06:47
bsanjeewahello, I am having trouble with kayobe seed service configure in stable/victoria06:48
*** zzzeek has quit IRC06:49
*** cah_link has joined #openstack-kolla06:49
*** bsanjeewa_ has joined #openstack-kolla06:49
bsanjeewa_in dnf.log of bifrost_deply container I find this06:49
*** zzzeek has joined #openstack-kolla06:49
bsanjeewa_2020-11-23T19:07:05Z WARNING Errors during downloading metadata for repository 'centos-advanced-virtualization':06:49
bsanjeewa_  - Curl error (28): Timeout was reached for http://mirror-int.ord.rax.opendev.org/centos/8/virt/x86_64/advanced-virtualization/repodata/repomd.xml [Connection timed out after 30001 milliseconds]06:50
bsanjeewa_  - Curl error (28): Timeout was reached for http://mirror-int.ord.rax.opendev.org/centos/8/virt/x86_64/advanced-virtualization/repodata/repomd.xml [Connection timed out after 30000 milliseconds]06:50
*** bsanjeewa has quit IRC06:52
*** shyamb has quit IRC06:53
*** oyrogerg has joined #openstack-kolla07:03
*** bsanjeewa_ has quit IRC07:07
*** bsanjeewa has joined #openstack-kolla07:09
*** bsanjeewa_ has joined #openstack-kolla07:09
*** shyamb has joined #openstack-kolla07:31
bsanjeewait seems there are some unwanted repos defined in /etc/yum.repos.d/. How can I remove these07:38
*** rpittau|afk is now known as rpittau07:39
*** bsanjeewa has quit IRC07:42
*** bsanjeewa_ has quit IRC07:42
*** bsanjeewa has joined #openstack-kolla07:42
*** bsanjeewa_ has joined #openstack-kolla07:42
*** luksky has joined #openstack-kolla07:58
*** shyamb has quit IRC08:00
*** bengates has joined #openstack-kolla08:04
*** zenkuro has quit IRC08:06
*** zenkuro has joined #openstack-kolla08:06
*** jbadiapa has joined #openstack-kolla08:09
hrwhm.. I do not see 'cherrypick' option in gerrit08:09
hrwah. it is in menu now...08:10
openstackgerritMarcin Juszkiewicz proposed openstack/kolla stable/victoria: base: fix QEMU dependencies for Debian/aarch64  https://review.opendev.org/c/openstack/kolla/+/76390308:11
hrwreview so we can get victoria on aarch64 again08:14
hrwbsanjeewa: we have patch in progress which will remove CI repos08:14
hrwbsanjeewa: bifrost is the only image which has this problem so that's why it was not noticed earlier08:14
hrwbifrost--08:14
hrwbbl08:15
*** nikparasyr has joined #openstack-kolla08:34
*** k_mouza has joined #openstack-kolla08:36
*** k_mouza has quit IRC08:40
*** mgoddard has joined #openstack-kolla08:44
*** zzzeek has quit IRC08:50
mgoddardmorning08:53
*** zzzeek has joined #openstack-kolla08:54
*** dougsz has joined #openstack-kolla08:55
*** zenkuro has quit IRC08:57
*** zenkuro has joined #openstack-kolla08:57
*** gfidente has joined #openstack-kolla09:03
*** happyhemant has joined #openstack-kolla09:05
*** zzzeek has quit IRC09:09
*** zzzeek has joined #openstack-kolla09:09
openstackgerritMerged openstack/kolla master: bifrost: mark as UNBUILDABLE for aarch64  https://review.opendev.org/c/openstack/kolla/+/76377109:12
*** zzzeek has quit IRC09:18
*** zzzeek has joined #openstack-kolla09:19
*** ricolin has joined #openstack-kolla09:19
*** dougsz has quit IRC09:25
*** zzzeek has quit IRC09:26
*** zzzeek has joined #openstack-kolla09:28
openstackgerritMark Goddard proposed openstack/kolla master: swift: fix group membership in debuntu/binary  https://review.opendev.org/c/openstack/kolla/+/76394709:28
*** shyamb has joined #openstack-kolla09:32
*** e0ne has joined #openstack-kolla09:40
*** e0ne has quit IRC09:40
*** dougsz has joined #openstack-kolla09:40
*** bengates has quit IRC09:40
*** bengates has joined #openstack-kolla09:42
*** ricolin has quit IRC09:44
*** wuchunyang has joined #openstack-kolla09:49
*** k_mouza has joined #openstack-kolla09:50
*** shyamb has quit IRC09:52
*** k_mouza has quit IRC09:55
*** skramaja has joined #openstack-kolla09:55
openstackgerritMark Goddard proposed openstack/kolla-ansible master: DNM: swift binary ci job  https://review.opendev.org/c/openstack/kolla-ansible/+/76395009:56
*** shyamb has joined #openstack-kolla09:56
*** bsanjeewa has quit IRC09:57
*** bsanjeewa has joined #openstack-kolla09:57
*** wuchunyang has quit IRC09:59
*** zzzeek has quit IRC10:04
*** e0ne has joined #openstack-kolla10:04
*** zzzeek has joined #openstack-kolla10:06
*** mgoddard has quit IRC10:11
*** zzzeek has quit IRC10:21
*** zzzeek has joined #openstack-kolla10:22
*** mgoddard has joined #openstack-kolla10:24
*** bsanjeewa has quit IRC10:25
*** bsanjeewa_ has quit IRC10:25
*** bsanjeewa has joined #openstack-kolla10:25
*** bsanjeewa_ has joined #openstack-kolla10:26
*** zzzeek has quit IRC10:26
*** zzzeek has joined #openstack-kolla10:28
hrwuf. can now forget that bifrost exists ;D10:30
*** mgoddard has quit IRC10:35
*** k_mouza has joined #openstack-kolla10:37
openstackgerritMark Goddard proposed openstack/kayobe master: CI: add dummy1 port for seed upgrade and VM jobs  https://review.opendev.org/c/openstack/kayobe/+/76395910:45
openstackgerritMark Goddard proposed openstack/kayobe master: DNM: debug seed-upgrade job  https://review.opendev.org/c/openstack/kayobe/+/76377310:46
*** zzzeek has quit IRC10:47
*** zzzeek has joined #openstack-kolla10:47
*** mgoddard has joined #openstack-kolla10:49
*** dardelean has joined #openstack-kolla11:04
*** jonaspaulo has joined #openstack-kolla11:06
openstackgerritMark Goddard proposed openstack/kolla master: DNM: testing mirror revert  https://review.opendev.org/c/openstack/kolla/+/76335111:27
*** e0ne has quit IRC11:29
*** zzzeek has quit IRC11:31
*** zzzeek has joined #openstack-kolla11:32
*** dswebb has joined #openstack-kolla11:37
*** jonaspaulo has quit IRC11:40
dswebbHi all, is there any reason the cinder backends are configured in the cinder.conf.j2 instead of creating a separate j2 for the other services (eg cinder-volume.conf.j2)?11:45
dswebbI just noticed that the external_ceph config ends up in the global cinder.conf when it's really only needed in the cinder-volume.conf11:45
dswebbI just noticed that the external_ceph (and all the other preconfigured backends) config ends up in the global cinder.conf when it's really only needed in the cinder-volume.conf11:46
dswebbbah, sorry, too used to teams edit function11:46
*** wuchunyang has joined #openstack-kolla11:47
mgoddardhi dswebb. We generally only have one template, but make various sections conditional based on service_name11:51
mgoddarddswebb: does cinder-backup require the backend config?11:52
dswebbtbh, not sure since we aren't really using it.  that would be a good reason though11:53
mgoddarddswebb: I'm sure we would accept a change to limit the backend config to specific services. Least privilege and all that11:55
dswebbit kind of looks like cinder backup creates it's own connection to whatever backup storage you are using, just based on 2 seconds of looking at the template11:56
dswebbhttps://github.com/openstack/kolla-ansible/blob/master/ansible/roles/cinder/templates/cinder.conf.j2#L2811:56
*** bsanjeewa has quit IRC11:57
*** bsanjeewa_ has quit IRC11:57
mgoddarddswebb: yes, looks that way11:59
dswebbcool, I'll submit a change later this week then.  need to figure out the gerrit workflow12:00
mgoddarddswebb: great. Let me know if you need a hand getting set up12:02
dswebbwill do12:02
mgoddarddswebb: https://docs.openstack.org/kolla/latest/contributor/ and https://docs.openstack.org/contributors/ may help12:03
*** e0ne has joined #openstack-kolla12:04
*** Luzi has joined #openstack-kolla12:07
*** shyamb has quit IRC12:09
*** bsanjeewa has joined #openstack-kolla12:16
*** bsanjeewa_ has joined #openstack-kolla12:17
*** wuchunyang has quit IRC12:18
openstackgerritMerged openstack/kolla stable/victoria: base: fix QEMU dependencies for Debian/aarch64  https://review.opendev.org/c/openstack/kolla/+/76390312:28
*** k_mouza has quit IRC12:35
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Revert "CI: Temporarily disable rabbitmq internal tls"  https://review.opendev.org/c/openstack/kolla-ansible/+/76151912:41
*** k_mouza has joined #openstack-kolla12:47
*** k_mouza has quit IRC13:05
*** k_mouza has joined #openstack-kolla13:09
*** wuchunyang has joined #openstack-kolla13:18
*** k_mouza has quit IRC13:19
*** skramaja has quit IRC13:24
*** k_mouza has joined #openstack-kolla13:31
*** dave-mccowan has joined #openstack-kolla13:37
*** mgoddard has quit IRC13:46
*** mgoddard has joined #openstack-kolla13:53
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add missing octavia-driver-agent  https://review.opendev.org/c/openstack/kolla-ansible/+/76187213:55
*** kevko_ has joined #openstack-kolla13:55
*** Luzi has quit IRC13:55
*** k_mouza has quit IRC13:57
*** k_mouza has joined #openstack-kolla13:58
*** zzzeek has quit IRC14:07
*** zzzeek has joined #openstack-kolla14:09
*** gouthamr_ has quit IRC14:36
*** zzzeek has quit IRC14:39
*** zzzeek has joined #openstack-kolla14:45
*** e0ne has quit IRC14:57
*** numans has quit IRC14:58
*** bengates has quit IRC15:03
*** bengates has joined #openstack-kolla15:04
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add missing octavia-driver-agent  https://review.opendev.org/c/openstack/kolla-ansible/+/76187215:05
mgoddardmnasiadka, priteau, dougsz, jovial[m]: https://review.opendev.org/c/openstack/kayobe/+/76395915:10
mgoddardthen https://review.opendev.org/c/openstack/kayobe/+/763374/15:12
mgoddardand https://review.opendev.org/c/openstack/kayobe/+/763375/15:12
openstackgerritMark Goddard proposed openstack/kayobe master: Revert "Use OpenStack Victoria release"  https://review.opendev.org/c/openstack/kayobe/+/76337415:12
*** e0ne has joined #openstack-kolla15:24
openstackgerritMerged openstack/kolla master: CI: add templated Dockerfiles to build logs  https://review.opendev.org/c/openstack/kolla/+/76299715:28
openstackgerritMerged openstack/kolla-ansible stable/ussuri: kibana: Fix kibana 6.x migration  https://review.opendev.org/c/openstack/kolla-ansible/+/76018215:28
*** bengates has quit IRC15:35
*** bengates_ has joined #openstack-kolla15:35
openstackgerritMerged openstack/kolla-ansible master: Performance: Use import_tasks in the main plays  https://review.opendev.org/c/openstack/kolla-ansible/+/74428915:48
openstackgerritMerged openstack/kolla-ansible master: Do not set 'always' tag where unnecessary  https://review.opendev.org/c/openstack/kolla-ansible/+/75992815:50
openstackgerritMerged openstack/kolla-ansible master: Delete the default parameters of the gluster NFS driver  https://review.opendev.org/c/openstack/kolla-ansible/+/76374615:51
openstackgerritMerged openstack/kolla-ansible master: docs: add scaffolding for redirects  https://review.opendev.org/c/openstack/kolla-ansible/+/75251915:52
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Add support for LetsEncrypt-managed certs  https://review.opendev.org/c/openstack/kolla-ansible/+/74134016:05
*** LinPeiWen97 has quit IRC16:05
openstackgerritMark Goddard proposed openstack/kolla-ansible master: DNM: swift binary ci job  https://review.opendev.org/c/openstack/kolla-ansible/+/76395016:11
openstackgerritMark Goddard proposed openstack/kolla master: DNM: testing mirror revert  https://review.opendev.org/c/openstack/kolla/+/76335116:17
*** dardelean has quit IRC16:20
*** bengates_ has quit IRC16:21
*** bengates has joined #openstack-kolla16:23
*** wuchunyang has quit IRC16:25
*** nikparasyr has left #openstack-kolla16:28
*** bsanjeewa_ has quit IRC16:29
*** bsanjeewa has quit IRC16:29
*** bsanjeewa has joined #openstack-kolla16:37
bsanjeewahrw: Yes I removed all the .repo files in bifrost_deploy and copied all from the seed vm. Then the command succeeded16:40
bsanjeewaNow I have a new problem when running kayobe overcloud provision16:42
bsanjeewa"TASK [bifrost-cloud-config : Provide ironic_url for no-auth mode if there is no override] ***",16:42
bsanjeewaerror was: {{ api_protocol }}://{{ internal_ip }}:6385: {{ hostvars[ans_interface_host]['ansible_' + ans_network_interface]['ipv4']['address'] }}: 'ansible.vars.hostvars.HostVarsVars object' has no attribute 'ansible_eth0'\\n\\nThe error appears to be in '/bifrost-base-source/bifrost-9.0.1.dev20/playbooks/roles/bifrost-cloud-config/tasks/main.yml':16:42
bsanjeewaline 74, column 3, but may\\nbe elsewhere in the file depending on the exact syntax problem.\\n\\nThe offending line appears to be:\\n\\n\\n- name: \\\"Provide ironic_url for no-auth mode if there is no override\\\"\\n  ^ here\\n\"",16:42
-openstackstatus- NOTICE: The Gerrit service on review.opendev.org is being restarted quickly to troubleshoot an SMTP queuing backlog, downtime should be less than 5 minutes16:42
openstackgerritMerged openstack/kolla-ansible master: Fix stop containers task in Swift rolling restart  https://review.opendev.org/c/openstack/kolla-ansible/+/75524216:45
openstackgerritMerged openstack/kolla master: swift: fix group membership in debuntu/binary  https://review.opendev.org/c/openstack/kolla/+/76394716:45
*** shyamb has joined #openstack-kolla16:47
*** bengates has quit IRC16:47
*** bengates has joined #openstack-kolla16:48
*** shyam89 has joined #openstack-kolla16:50
mgoddardbsanjeewa: hi. have you set the interface for the overcloud provisioning network on the seed?16:50
*** shyamb has quit IRC16:51
*** bengates has quit IRC16:52
*** bsanjeewa_ has joined #openstack-kolla16:53
*** bsanjeewa has quit IRC16:53
*** bsanjeewa has joined #openstack-kolla16:54
*** bsanjeewa54 has joined #openstack-kolla16:54
bsanjeewa54mgoddard: my networks.yml looks like16:56
bsanjeewa54oob_oc_net_name: management16:56
bsanjeewa54cloud16:56
bsanjeewa54and inventory/group_bvars/seed/network-interfaces has only management_interface: eth016:57
bsanjeewa54this arrangement worked on stable/ussuri16:58
*** shyam89 has quit IRC16:59
*** timburke has quit IRC17:00
*** rpittau is now known as rpittau|afk17:01
bsanjeewa54mgoddard: Seems my multi line input has missed some parts. Please could you see https://storyboard.openstack.org/#!/story/200838817:09
*** e0ne has quit IRC17:11
mgoddardbsanjeewa54: have you checked the network interfaces on the seed?17:12
bsanjeewa54mgoddard: 3 NIC's 1: lo, 2: eth0, 3:docker017:13
bsanjeewa54mgoddard: I could follow installation guide until kayobe overcloud hardware inspect, then kayobe overcloud provision fails17:15
mgoddardbsanjeewa54: are you still using UEFI?17:15
bsanjeewa54yes17:17
mgoddardbsanjeewa54: could you add some of the Ansible output to the story?17:17
bsanjeewa54mgoddard: I have logged the output to a text file. with -vvvv switch. Should I paste the full output or is there a way to attach the file?17:19
mgoddardbsanjeewa54: you could link to paste.openstack.org17:21
bsanjeewa54mgoddard: Please see http://paste.openstack.org/show/800378/17:26
bsanjeewa54mgoddard: About the UEFI: had to add grub2-efi to kolla_bifrost_dib_packages in bifrost.yml to be able to boot17:27
mgoddardbsanjeewa54: I don't see an error in that paste17:29
*** dougsz has quit IRC17:34
*** happyhemant has quit IRC17:44
bsanjeewa54mgoddard: oops only a part is there. May be too long. Could you please try https://drive.google.com/file/d/1mBjOWTHP43ZYq6uDXtwpVg26dIMqRH1x/view?usp=sharing17:50
mgoddardbsanjeewa54: please add to the story as a comment. I need to go now18:02
*** jbadiapa has quit IRC18:05
*** mgoddard has quit IRC18:07
bsanjeewa54mgoddard: Thanks, I will. I missed to add to kolla_bifrost_dib_elements the values you mentioned earlier. Could that be the case?18:14
bsanjeewa54mgoddard: I will add those values and try again.18:16
*** gfidente is now known as gfidente|afk18:17
*** bsanjeewa_ has quit IRC18:27
*** bsanjeewa has quit IRC18:28
*** k_mouza has quit IRC18:29
r3ap3rQuick question, has anyone seen this before? Google isn't really telling me too much and I've tried few different search queries.19:17
r3ap3r`2020-11-22 00:48:05.357 55 INFO glance.api.v2.image_data [req-e53237ed-2baf-46ed-814d-2cd8f116f2c9 7211a08976a7402082d2806133643461 fefe09c1eeeb45cb84f1553cf2e23fd1 - default default] Unable to create trust: no such option collect_timing in group [keystone_authtoken] Use the existing user token.`19:17
r3ap3rI understand the `Unable to create trust` part most likely points to an authentication issue and the `Use the existing user token` makes me think that the token for the Glance API has changed but I have the same keyring that I have always been using. Maybe it is not referencing the keyring?19:21
*** imcsk8 has quit IRC19:22
*** imcsk8 has joined #openstack-kolla19:25
*** dougsz has joined #openstack-kolla19:31
*** cah_link has quit IRC19:35
*** dougsz has quit IRC19:36
*** bsanjeewa54 has quit IRC19:56
*** zenkuro has quit IRC20:03
*** kevko_ has quit IRC20:37
*** devfaz has joined #openstack-kolla20:44
*** devfaz_ has quit IRC20:45
*** kevko_ has joined #openstack-kolla21:02
*** k_mouza has joined #openstack-kolla21:30
*** k_mouza has quit IRC21:35
*** zzzeek has quit IRC21:38
*** zzzeek has joined #openstack-kolla21:40
*** hjensas has quit IRC21:58
*** hjensas has joined #openstack-kolla21:59
*** hjensas_ has joined #openstack-kolla22:16
*** hjensas has quit IRC22:17
*** hjensas__ has joined #openstack-kolla22:17
*** hjensas__ has quit IRC22:17
*** hjensas__ has joined #openstack-kolla22:18
*** hjensas_ has quit IRC22:21
*** kevko_ has quit IRC22:37
*** hjensas__ has quit IRC22:47
*** hjensas__ has joined #openstack-kolla22:48
*** hjensas__ has quit IRC22:50
*** hjensas__ has joined #openstack-kolla22:50
*** hjensas__ has quit IRC23:09
*** k_mouza has joined #openstack-kolla23:30
*** luksky has quit IRC23:33
*** k_mouza has quit IRC23:34
*** openstackgerrit has quit IRC23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!