| opendevreview | Merged openstack/kayobe master: Add Arista switch support for the Neutron ML2 genericswitch driver https://review.opendev.org/c/openstack/kayobe/+/802995 | 02:22 |
|---|---|---|
| kevko | hi \o/ | 06:00 |
| *** rpittau|afk is now known as rpittau | 07:23 | |
| yoctozepto | morning all; mgoddard: need to lift wip flag on https://review.opendev.org/c/openstack/kolla/+/798892 | 07:48 |
| mgoddard | morning | 07:50 |
| mgoddard | yoctozepto: done | 07:50 |
| mnasiadka | yoctozepto: nice | 07:53 |
| yoctozepto | :-) | 07:55 |
| opendevreview | Merged openstack/kolla stable/wallaby: monasca-thresh: Allow topology check and removal in storm https://review.opendev.org/c/openstack/kolla/+/804018 | 07:59 |
| opendevreview | Merged openstack/kolla stable/victoria: monasca-thresh: Allow topology check and removal in storm https://review.opendev.org/c/openstack/kolla/+/804019 | 08:04 |
| opendevreview | Merged openstack/kolla stable/ussuri: monasca-thresh: Allow topology check and removal in storm https://review.opendev.org/c/openstack/kolla/+/804020 | 08:04 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Validate if running CentOS OS is CentOS Stream https://review.opendev.org/c/openstack/kolla-ansible/+/804072 | 08:07 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: Fix freezed spice console in horizon https://review.opendev.org/c/openstack/kolla-ansible/+/803440 | 08:14 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: Fix freezed spice console in horizon https://review.opendev.org/c/openstack/kolla-ansible/+/803556 | 08:14 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: Fix freezed spice console in horizon https://review.opendev.org/c/openstack/kolla-ansible/+/803557 | 08:14 |
| opendevreview | Mark Goddard proposed openstack/kolla-ansible stable/wallaby: Add suppress_type_name to stop warnings with ES7 https://review.opendev.org/c/openstack/kolla-ansible/+/804157 | 08:22 |
| opendevreview | Mark Goddard proposed openstack/kolla-ansible stable/victoria: Add suppress_type_name to stop warnings with ES7 https://review.opendev.org/c/openstack/kolla-ansible/+/804158 | 08:22 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: Add missing elasticsearch cloudkitty storage and prometheus collector backend support. https://review.opendev.org/c/openstack/kolla-ansible/+/802879 | 08:23 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: Add missing elasticsearch cloudkitty storage and prometheus collector backend support. https://review.opendev.org/c/openstack/kolla-ansible/+/802880 | 08:23 |
| opendevreview | Merged openstack/kolla stable/victoria: Add support for CentOS 8 Stream https://review.opendev.org/c/openstack/kolla/+/792763 | 08:39 |
| opendevreview | Radosław Piliszek proposed openstack/kolla master: ironic-neutron-agent: enable for Debuntu binary https://review.opendev.org/c/openstack/kolla/+/799611 | 09:04 |
| yoctozepto | mgoddard: the config mirroring is very rough; I want to keep image-related settings close internally - may I just drop these settings from globals.yml? | 09:07 |
| yoctozepto | or just in their own section | 09:08 |
| yoctozepto | I will propose it | 09:08 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible master: Add ability to retry image pulling https://review.opendev.org/c/openstack/kolla-ansible/+/803828 | 09:10 |
| mgoddard | yoctozepto: other option: role default for service-images-pull. hard code in swift for now | 09:10 |
| mgoddard | yoctozepto: that would be similar to service_ks_register_delay | 09:11 |
| yoctozepto | role default sounds cool | 09:11 |
| yoctozepto | dumb swift | 09:11 |
| yoctozepto | :D | 09:11 |
| yoctozepto | (I mean our role, not the project itself, swift is nice :-) ) | 09:12 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible master: Add ability to retry image pulling https://review.opendev.org/c/openstack/kolla-ansible/+/803828 | 09:16 |
| yoctozepto | done all | 09:18 |
| yoctozepto | could someone approve this stack (all patches) for me and kevko? https://review.opendev.org/c/openstack/kolla/+/803617/7 | 09:19 |
| kevko | \o/ | 09:19 |
| yoctozepto | kevko selfishly liked his own patches ;d | 09:24 |
| kevko | :P :D | 09:25 |
| mnasiadka | yoctozepto: no reno? come on! | 09:37 |
| yoctozepto | mnasiadka: where? lol | 09:39 |
| yoctozepto | mnasiadka: the top one is internal | 09:39 |
| mnasiadka | yoctozepto: it's a behaviour change? | 09:39 |
| yoctozepto | mnasiadka: hmm, to what extent you mean? that we are not hiding possible bugs? :-) | 09:40 |
| yoctozepto | I can write a reno if you seriously think we need one though | 09:40 |
| mnasiadka | and the docs state every patch needs a reno, unless it's trivialfix, affecting only docs or CI :) | 09:41 |
| yoctozepto | just slap a -1 so that everyone can see how you love your renos :-) | 09:41 |
| mnasiadka | https://docs.openstack.org/kolla/latest/contributor/release-notes.html#introduction | 09:41 |
| mnasiadka | I'm just picky, we defined some ,,processes'', and we're not sticking to them :D | 09:41 |
| yoctozepto | it is trivialfix... | 09:41 |
| mnasiadka | and can trivially introduce a bug I guess :) | 09:42 |
| yoctozepto | well, I think I'm the one most bickering about lack of renos for really non-trivial fixes | 09:42 |
| yoctozepto | or at least user-facing ones | 09:42 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: monasca-thresh: Fix topology submission to storm https://review.opendev.org/c/openstack/kolla-ansible/+/804022 | 09:42 |
| yoctozepto | slap -1, fixing later | 09:42 |
| mnasiadka | well, I guess as a result of this patch, GID can change | 09:42 |
| yoctozepto | could use hinting on the contents of it | 09:42 |
| mnasiadka | or I'm reading it wrong :) | 09:42 |
| yoctozepto | mnasiadka: it will prevent building if gid *would* change otherwise | 09:43 |
| yoctozepto | so it is kinda of fixing a bug but it was not there yet | 09:43 |
| yoctozepto | a proactive fix | 09:43 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/wallaby failed: monasca-thresh: Fix topology submission to storm https://review.opendev.org/c/openstack/kolla-ansible/+/804021 | 09:43 |
| mnasiadka | proactive fixes tend to slap us in the face, but whatever :) | 09:43 |
| yoctozepto | oh noez, a failure in CI | 09:44 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: monasca-thresh: Fix topology submission to storm https://review.opendev.org/c/openstack/kolla-ansible/+/804023 | 09:44 |
| yoctozepto | mnasiadka: co nas nie zabije... :-) | 09:44 |
| yoctozepto | (to nam nerwy starga) | 09:44 |
| yoctozepto | and now back in English :-) | 09:44 |
| mnasiadka | yoctozepto: nie jestem fanem Nietzsche :) | 09:44 |
| kevko | reno ma raz zabije | 09:45 |
| yoctozepto | kevko: whatever you wanted to say, it does not make sense but is very funny :D | 09:45 |
| yoctozepto | mnasiadka: I didn't really know he said that | 09:45 |
| yoctozepto | interesting | 09:45 |
| mnasiadka | yoctozepto: Well, it's better that this quote is used more often than others, but still :) | 09:46 |
| kevko | :D | 09:46 |
| yoctozepto | mnasiadka: indeed :D | 09:47 |
| opendevreview | Merged openstack/kolla-ansible master: ironic: Follow up for ironic_enable_keystone_integration https://review.opendev.org/c/openstack/kolla-ansible/+/804049 | 09:50 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: baremetal: use docker_yum_gpgkey to fetch docker GPG key https://review.opendev.org/c/openstack/kolla-ansible/+/804015 | 09:51 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: baremetal: use docker_yum_gpgkey to fetch docker GPG key https://review.opendev.org/c/openstack/kolla-ansible/+/804014 | 09:53 |
| opendevreview | Mark Goddard proposed openstack/kolla-ansible stable/wallaby: ironic: Follow up for ironic_enable_keystone_integration https://review.opendev.org/c/openstack/kolla-ansible/+/804161 | 09:54 |
| opendevreview | Mark Goddard proposed openstack/kolla-ansible stable/victoria: ironic: Follow up for ironic_enable_keystone_integration https://review.opendev.org/c/openstack/kolla-ansible/+/804162 | 09:55 |
| opendevreview | Mark Goddard proposed openstack/kolla-ansible stable/ussuri: ironic: Follow up for ironic_enable_keystone_integration https://review.opendev.org/c/openstack/kolla-ansible/+/804163 | 09:55 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: baremetal: use docker_yum_gpgkey to fetch docker GPG key https://review.opendev.org/c/openstack/kolla-ansible/+/804013 | 09:59 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: Blazar: Fix support for external keystone in multiregion deploy https://review.opendev.org/c/openstack/kolla-ansible/+/803843 | 09:59 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: Blazar: Fix support for external keystone in multiregion deploy https://review.opendev.org/c/openstack/kolla-ansible/+/803841 | 09:59 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: Blazar: Fix support for external keystone in multiregion deploy https://review.opendev.org/c/openstack/kolla-ansible/+/803842 | 09:59 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: Elevated privileges required to set owner/group/mode by ansible https://review.opendev.org/c/openstack/kolla-ansible/+/803836 | 09:59 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: Elevated privileges required to set owner/group/mode by ansible https://review.opendev.org/c/openstack/kolla-ansible/+/803835 | 09:59 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: Elevated privileges required to set owner/group/mode by ansible https://review.opendev.org/c/openstack/kolla-ansible/+/803837 | 09:59 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: Fix nova deployment failure when rabbitmq is disabled https://review.opendev.org/c/openstack/kolla-ansible/+/803559 | 09:59 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: Fix nova deployment failure when rabbitmq is disabled https://review.opendev.org/c/openstack/kolla-ansible/+/803558 | 09:59 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: Fix nova deployment failure when rabbitmq is disabled https://review.opendev.org/c/openstack/kolla-ansible/+/803554 | 09:59 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: Make setup module arguments configurable https://review.opendev.org/c/openstack/kolla-ansible/+/802948 | 09:59 |
| yoctozepto | "merge it, baby" :-) | 10:00 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: Make setup module arguments configurable https://review.opendev.org/c/openstack/kolla-ansible/+/802949 | 10:02 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: Make setup module arguments configurable https://review.opendev.org/c/openstack/kolla-ansible/+/803010 | 10:02 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: manila: add glance section in manila-share.conf https://review.opendev.org/c/openstack/kolla-ansible/+/802785 | 10:02 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: manila: add glance section in manila-share.conf https://review.opendev.org/c/openstack/kolla-ansible/+/802783 | 10:42 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: manila: add glance section in manila-share.conf https://review.opendev.org/c/openstack/kolla-ansible/+/802784 | 10:47 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/wallaby failed: monasca-thresh: Fix topology submission to storm https://review.opendev.org/c/openstack/kolla-ansible/+/804021 | 11:11 |
| opendevreview | Merged openstack/kolla-ansible master: Support multiple inventories https://review.opendev.org/c/openstack/kolla-ansible/+/802863 | 11:24 |
| *** rpittau is now known as rpittau|afk | 11:28 | |
| opendevreview | Merged openstack/kolla-ansible master: Remove redundant Monasca Kafka client option https://review.opendev.org/c/openstack/kolla-ansible/+/788247 | 11:40 |
| opendevreview | Verification of a change to openstack/kolla-ansible master failed: fluentd: Fix check for external elasticsearch https://review.opendev.org/c/openstack/kolla-ansible/+/791321 | 11:43 |
| yoctozepto | mgoddard, mnasiadka: small but important patch: https://review.opendev.org/c/openstack/kolla-ansible/+/802796 | 11:49 |
| yoctozepto | (going over my own patches) | 11:49 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible master: [WIP] Try hide host systemd and dbus from libvirt https://review.opendev.org/c/openstack/kolla-ansible/+/794262 | 11:54 |
| yoctozepto | another one: https://review.opendev.org/c/openstack/kolla-ansible/+/787875 (rp_filter) | 11:56 |
| yoctozepto | parallax: hi, remember this bug: https://bugs.launchpad.net/kolla/+bug/1930545 - did you try the potential fix in https://review.opendev.org/c/openstack/kolla-ansible/+/794262 ? I would propose this as non-WIP to increase the insulation of kolla services from the host surface | 11:57 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: monasca-thresh: Fix topology submission to storm https://review.opendev.org/c/openstack/kolla-ansible/+/804021 | 12:13 |
| jingvar | Hi! | 12:25 |
| jingvar | I've faced with strange behavior, started hardware inspect, and it failed, because somehow nodes name in Ironic were renamed like vnetXX | 12:29 |
| jingvar | how can be changed node name after it's enroll by kaobe? or it could be an Irionc internal magic | 12:32 |
| mnasiadka | yoctozepto: parallax is on vacation, will be back 23rd ;) | 12:38 |
| yoctozepto | mnasiadka: ack, thanks | 12:41 |
| mgoddard | jingvar: on the seed node, baremetal node set <node> --name <name> | 12:43 |
| jingvar | I know how do this | 12:56 |
| jingvar | My question what can do this in instpection process | 12:57 |
| jingvar | the ouptut of kayobe overcloud hardware inspect -vvvv - doesn't consist "baremetal node set" or "vnet" | 13:02 |
| jingvar | I have an older backup of kayobe deployment and will check IPA and Ironic version (I think when you use master branch ...) | 13:04 |
| opendevreview | Merged openstack/kolla-ansible master: Remove deprecated Designate option https://review.opendev.org/c/openstack/kolla-ansible/+/802450 | 13:09 |
| opendevreview | Verification of a change to openstack/kolla-ansible master failed: fluentd: Fix check for external elasticsearch https://review.opendev.org/c/openstack/kolla-ansible/+/791321 | 13:11 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: Refactor and optimise image pulling https://review.opendev.org/c/openstack/kolla-ansible/+/804029 | 13:15 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: Refactor and optimise image pulling https://review.opendev.org/c/openstack/kolla-ansible/+/804028 | 13:19 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: Refactor and optimise image pulling https://review.opendev.org/c/openstack/kolla-ansible/+/804027 | 13:21 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: Extra var ironic_enable_keystone_integration added. https://review.opendev.org/c/openstack/kolla-ansible/+/804085 | 13:21 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: ironic: Follow up for ironic_enable_keystone_integration https://review.opendev.org/c/openstack/kolla-ansible/+/804162 | 13:25 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/wallaby failed: Extra var ironic_enable_keystone_integration added. https://review.opendev.org/c/openstack/kolla-ansible/+/804087 | 13:25 |
| jingvar | LLDP node by default - amazing! | 14:11 |
| jingvar | LLDP nodenaming | 14:11 |
| yoctozepto | :-) | 14:17 |
| jingvar | I don't now how much time a would spend on real hardware to solve it. We have dedictated infa team :) | 14:32 |
| opendevreview | Merged openstack/kolla-ansible master: fluentd: Fix check for external elasticsearch https://review.opendev.org/c/openstack/kolla-ansible/+/791321 | 14:33 |
| opendevreview | Pierre Riteau proposed openstack/kolla master: Fix naming of CentOS Stream in reno https://review.opendev.org/c/openstack/kolla/+/804251 | 14:36 |
| priteau | Is there a meeting today? | 15:00 |
| mgoddard | #startmeeting kolla | 15:01 |
| opendevmeet | Meeting started Wed Aug 11 15:01:09 2021 UTC and is due to finish in 60 minutes. The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:01 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:01 |
| opendevmeet | The meeting name has been set to 'kolla' | 15:01 |
| mgoddard | mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi bbezak parallax Fl1nt | 15:01 |
| mgoddard | ^ meeting | 15:01 |
| mgoddard | #topic rollcall | 15:01 |
| mgoddard | \o | 15:01 |
| osmanlicilegi | o/ | 15:02 |
| priteau | |o| | 15:03 |
| yoctozepto | o/ | 15:04 |
| mgoddard | #topic agenda | 15:05 |
| mgoddard | * Roll-call | 15:05 |
| mgoddard | * Agenda | 15:05 |
| mgoddard | * Announcements | 15:05 |
| mgoddard | ** TC & PTL election season looms http://lists.openstack.org/pipermail/openstack-discuss/2021-August/024093.html | 15:05 |
| mgoddard | * Review action items from the last meeting | 15:05 |
| mgoddard | * CI status | 15:05 |
| mgoddard | ** Discussion on general issues | 15:05 |
| mgoddard | * Release tasks | 15:06 |
| mgoddard | * Xena cycle planning | 15:06 |
| mgoddard | ** Xena feature prioritisation https://docs.google.com/spreadsheets/d/1BuVMwP8eLnOVJDX8f3Nb6hCrNcNpRQl57T2ENU9Xao8 | 15:06 |
| mgoddard | ** Clean up old priorities from the whiteboard to get fresher look at it | 15:06 |
| mgoddard | * Kolla operator pain points https://etherpad.opendev.org/p/pain-point-elimination | 15:06 |
| mgoddard | * Open discussion | 15:06 |
| mgoddard | ** Kolla Ansible Framework and its QA https://etherpad.opendev.org/p/kolla-ansible-framework | 15:06 |
| mgoddard | #topic announcements | 15:06 |
| mgoddard | #info TC & PTL election season looms | 15:06 |
| mgoddard | #link http://lists.openstack.org/pipermail/openstack-discuss/2021-August/024093.html | 15:06 |
| mgoddard | Nominations start on 17th August | 15:06 |
| mgoddard | I will not run again for PTL | 15:06 |
| priteau | You will always stay our BDFL mgoddard | 15:07 |
| mgoddard | is there no escape? :) | 15:07 |
| priteau | (in our hearts) | 15:07 |
| yoctozepto | <3 | 15:09 |
| mgoddard | small plug: I will be participating in tomorrow's opendev.live session on ironic | 15:09 |
| yoctozepto | yeah, I will be watching you | 15:09 |
| yoctozepto | psst: let's increase the tempo a bit; we are already 10 mins into the meeting and no meat still :-) | 15:10 |
| yoctozepto | (I also wonder where mnasiadka is :-) ) | 15:11 |
| mgoddard | #link https://www.youtube.com/channel/UCQ74G2gKXdpwZkXEsclzcrA | 15:11 |
| mgoddard | #topic Review action items from the last meeting | 15:11 |
| mgoddard | none | 15:11 |
| mgoddard | #topic CI status | 15:12 |
| yoctozepto | I updated it today for k and k-a | 15:12 |
| yoctozepto | not sure about kayobe | 15:12 |
| mgoddard | anything new? | 15:13 |
| yoctozepto | not really, I deleted some old stuff; zun seems to be failing on ubuntu | 15:13 |
| yoctozepto | but that's it | 15:13 |
| yoctozepto | I wanted to discuss general issues we have listed at the top in the whiteboard | 15:13 |
| yoctozepto | (this is the extra subtopic for CI status) | 15:13 |
| priteau | I think Kayobe is green at the moment | 15:14 |
| mgoddard | +1 | 15:14 |
| priteau | Are ussuri and train still red? | 15:14 |
| mgoddard | unsure, probably not | 15:14 |
| priteau | There's no open patches against them | 15:15 |
| mgoddard | last ussuri runs look ok | 15:15 |
| yoctozepto | no periodic jobs to check? | 15:15 |
| priteau | No periodic | 15:16 |
| mgoddard | no | 15:16 |
| mgoddard | go ahead yoctozepto | 15:16 |
| yoctozepto | ok | 15:16 |
| yoctozepto | I have collected 5 general issues | 15:17 |
| yoctozepto | i.e. mostly job-type-independent | 15:17 |
| yoctozepto | the first one is SIGPIPE rc=-13 error | 15:17 |
| yoctozepto | I have never got this outside of CI | 15:17 |
| yoctozepto | have you? | 15:17 |
| mgoddard | not that I remember | 15:18 |
| yoctozepto | (for the notes please see the whiteboard; I will not be repasting them in the chat) | 15:18 |
| yoctozepto | priteau and you? | 15:18 |
| yoctozepto | (nobody else to ask today) | 15:18 |
| mgoddard | osmanlicilegi is here | 15:18 |
| yoctozepto | sorry! missed due to the same colour as priteau in my client :-) | 15:19 |
| priteau | yoctozepto: I don't think I have ever seen this error | 15:19 |
| mgoddard | yoctozepto: do you have some proposal for it? | 15:19 |
| yoctozepto | yeah, I'm pretty sure it's something really weird going in the CI | 15:19 |
| yoctozepto | mgoddard: no, for this issue I'm just collecting others' feedback | 15:20 |
| yoctozepto | not much to work on | 15:20 |
| yoctozepto | ok, let's move onto the next issue | 15:20 |
| yoctozepto | failing pulls | 15:20 |
| yoctozepto | this has a fix | 15:20 |
| yoctozepto | it has been discussed | 15:20 |
| yoctozepto | so just go and merge :-) | 15:20 |
| osmanlicilegi | yoctozepto: I'm trying to catch up what I've missed for a while :/ | 15:20 |
| yoctozepto | I happens outside of CI so it's legit and fixing is nice for end-users as well | 15:20 |
| yoctozepto | osmanlicilegi: sure; the question was whether you have ever seen rc=-13 error from kolla-ansible when running it locally | 15:21 |
| yoctozepto | osmanlicilegi: so it's independent of the upstream knowledge :-) | 15:21 |
| yoctozepto | ^^^ it* happens | 15:21 |
| osmanlicilegi | never seen this but I'll recheck | 15:22 |
| yoctozepto | any thoughts on issue #2? if not, let's move on onto 3. | 15:22 |
| yoctozepto | osmanlicilegi: thanks, no sweat :-) | 15:22 |
| yoctozepto | so for issue #2 just merge the proposal | 15:22 |
| yoctozepto | and issue #3 is about weird attach behaviour | 15:23 |
| yoctozepto | this has not happened to me in prod but seems more legit than issue #1 | 15:23 |
| priteau | yoctozepto: retry is good. Never seen it with local registry but improved CI stability will be good | 15:23 |
| yoctozepto | though it's probably an upstream bug | 15:23 |
| mgoddard | did you manage to reproduce the attachment issue? | 15:24 |
| yoctozepto | mgoddard: locally not; but it seems to be luck-based so it could be that one-more-try could trigger it | 15:24 |
| yoctozepto | but one has to stop somewhere lol | 15:24 |
| yoctozepto | it's repeatable in CI though | 15:25 |
| yoctozepto | I have a proposal that can be rechecked to trigger it | 15:25 |
| yoctozepto | as it only runs the affected jobs | 15:25 |
| yoctozepto | well, at least I *had* | 15:25 |
| mgoddard | waiting longer didn't help? | 15:26 |
| yoctozepto | nope, it did not | 15:26 |
| yoctozepto | it seems like some process just does not complete | 15:26 |
| yoctozepto | no errors, no nothing | 15:26 |
| yoctozepto | the volume gets stuck | 15:26 |
| yoctozepto | only ever seen this on ubuntu | 15:26 |
| yoctozepto | and the cinder backend is irrelevant | 15:26 |
| yoctozepto | (always nice to be able to blame ceph but not this time, fellas) | 15:26 |
| mgoddard | raise with cinder? | 15:27 |
| yoctozepto | yeah, that is my proposal as well | 15:27 |
| yoctozepto | just enquiring first | 15:27 |
| yoctozepto | ok, thanks | 15:27 |
| yoctozepto | oh, I see I switched the order a bit | 15:28 |
| yoctozepto | so that was actually issue #4 | 15:28 |
| yoctozepto | the #3 is about logging mess | 15:28 |
| yoctozepto | I guess it's obvious we need a volunteer for better logs | 15:28 |
| yoctozepto | can we link to any related proposals? do any come to your minds? | 15:29 |
| mgoddard | there are a few patches proposed for logging | 15:30 |
| mgoddard | it depends which part of the mess you want to fix | 15:30 |
| yoctozepto | well, at least the one making it hard to find issues in the log files themselves | 15:31 |
| yoctozepto | please just add any links you deem valuable | 15:31 |
| yoctozepto | nothing else to discuss for this particular issue | 15:32 |
| yoctozepto | as for issue #5: | 15:32 |
| yoctozepto | do we agree to ignore this in CI? | 15:32 |
| yoctozepto | because otherwise we would have to nicely stop all the services in proper order | 15:32 |
| yoctozepto | and only then start them again | 15:33 |
| mgoddard | how many retries to we use? | 15:33 |
| yoctozepto | that's a good question; more precisely: how many retries does placement use in this config | 15:33 |
| yoctozepto | the issue is because keystone goes down during upgrade | 15:34 |
| yoctozepto | and haproxy also needs to pick it up back alive | 15:34 |
| yoctozepto | so a few retries should help | 15:34 |
| yoctozepto | perhaps it's not doing enough | 15:34 |
| yoctozepto | let's check | 15:34 |
| mgoddard | https://docs.openstack.org/placement/wallaby/configuration/config.html#keystone_authtoken.http_request_max_retries | 15:34 |
| yoctozepto | raise to 5 in CI? | 15:35 |
| yoctozepto | or 6 | 15:35 |
| mgoddard | could do | 15:35 |
| mgoddard | or maybe we just ignore it :) | 15:35 |
| yoctozepto | mgoddard: I'll try with that bump | 15:36 |
| yoctozepto | I have only ever seen placement and (rarer) neutron to hit this | 15:36 |
| yoctozepto | they are most talkative it seems | 15:36 |
| yoctozepto | for whatever reason | 15:36 |
| yoctozepto | could use bumping for all core services | 15:36 |
| yoctozepto | all right | 15:37 |
| yoctozepto | the plan is there | 15:37 |
| yoctozepto | thank you for the fruitful discussion | 15:37 |
| yoctozepto | precisely what I wanted :-) | 15:37 |
| mgoddard | thanks yoctozepto for bringing it up | 15:38 |
| yoctozepto | my pleasure! | 15:39 |
| mgoddard | #topic Release tasks | 15:39 |
| mgoddard | Finally, it is R-8 | 15:39 |
| yoctozepto | :O | 15:39 |
| mgoddard | so according to https://docs.openstack.org/kolla/latest/contributor/release-management.html | 15:39 |
| mgoddard | we must Switch binary images to current release | 15:39 |
| mgoddard | would anyone like to do it? | 15:39 |
| yoctozepto | "like" is a strong word :-) | 15:40 |
| priteau | I can give it a try if no one else is already on it | 15:41 |
| yoctozepto | I have other stuff to do as well but I guess it won't hurt me to bump; though I'm looking forward to broader participation :-) | 15:41 |
| yoctozepto | oh, priteau already volunteered, good! | 15:41 |
| mgoddard | #action priteau to Switch binary images to current release | 15:41 |
| mgoddard | thanks priteau | 15:41 |
| yoctozepto | thanks ++ | 15:41 |
| mgoddard | we need to think about cycle highlights soon | 15:42 |
| mgoddard | but it can wait | 15:42 |
| yoctozepto | yeah, next meeting | 15:42 |
| yoctozepto | let's add to the agenda though | 15:42 |
| yoctozepto | I will add then | 15:42 |
| mgoddard | #topic Clean up old priorities from the whiteboard to get fresher look at it | 15:42 |
| yoctozepto | mine again | 15:42 |
| yoctozepto | I suggest we simply clean all completed one | 15:42 |
| yoctozepto | ones* | 15:42 |
| yoctozepto | simple topic :-) | 15:42 |
| yoctozepto | just gathering your approval | 15:43 |
| mgoddard | makes sense | 15:44 |
| mgoddard | the list wasn't really updated for xena | 15:44 |
| yoctozepto | yup | 15:44 |
| yoctozepto | ok, so I can clean this up | 15:44 |
| yoctozepto | no problem | 15:44 |
| yoctozepto | you can action me on it | 15:45 |
| mgoddard | #action clean up whiteboard priorities | 15:45 |
| opendevreview | Pierre Riteau proposed openstack/kolla master: [release] Use UCA Xena https://review.opendev.org/c/openstack/kolla/+/804268 | 15:45 |
| mgoddard | CentOS Stream 9... | 15:45 |
| mgoddard | we should probably check in with RDO on that one | 15:45 |
| mgoddard | it's cutting it quite fine for a major upgrade | 15:46 |
| yoctozepto | argh, noez | 15:46 |
| yoctozepto | I forgot we are awaiting a landslide | 15:46 |
| mgoddard | #action mgoddard check in with RDO re CS9 | 15:47 |
| mgoddard | #topic Kolla operator pain points https://etherpad.opendev.org/p/pain-point-elimination | 15:47 |
| mgoddard | I don't see any new ones since last time | 15:48 |
| yoctozepto | me neither | 15:48 |
| mgoddard | #topic Kolla Ansible Framework and its QA https://etherpad.opendev.org/p/kolla-ansible-framework | 15:48 |
| yoctozepto | so, I have done a larger writeup | 15:48 |
| yoctozepto | that we should do some core-involving exercises to maintain better posture :-) | 15:49 |
| yoctozepto | my goal for today is to share this with you | 15:49 |
| yoctozepto | and ask you for collaboration | 15:49 |
| opendevreview | Pierre Riteau proposed openstack/kolla master: [release] Use RDO master Delorean packages https://review.opendev.org/c/openstack/kolla/+/804269 | 15:50 |
| yoctozepto | who would want to drive/discuss this with me? (even indepently of our general meetings not to eat up their time) | 15:50 |
| yoctozepto | I see only mgoddard is lurking in the etherpad so not many ppl to ask :-) | 15:50 |
| priteau | Sorry, was working on my action :P | 15:51 |
| yoctozepto | priteau: no problem | 15:51 |
| mgoddard | it makes sense to me to expand this model | 15:52 |
| mgoddard | it could easily be used for DB setup, check-containers.yml, etc. | 15:53 |
| mgoddard | config would be more work | 15:53 |
| mgoddard | but could start simple with config.json | 15:53 |
| yoctozepto | yeah, we have config-check in workings (on me) but config itself, especially config.json, is a nice candidate | 15:54 |
| yoctozepto | so, as you figured, the work is threefold: document, refactor, test | 15:54 |
| yoctozepto | but first obviously decide on the scope etc. | 15:55 |
| yoctozepto | put any relevant idea somewhere in that etherpad | 15:55 |
| yoctozepto | any time | 15:55 |
| priteau | So it's about moving more K-A code into a framework, so there is less duplication of code between roles? With ultimately services could just be defined as a dict of their config? | 15:55 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: Extra var ironic_enable_keystone_integration added. https://review.opendev.org/c/openstack/kolla-ansible/+/804087 | 15:55 |
| mnasiadka | yoctozepto: missing me? | 15:56 |
| yoctozepto | priteau: +/- yeah | 15:56 |
| yoctozepto | but for starters to clean up what we already have and decide on the next steps | 15:56 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: ironic: Follow up for ironic_enable_keystone_integration https://review.opendev.org/c/openstack/kolla-ansible/+/804161 | 15:57 |
| yoctozepto | which ultimately could work as you described | 15:57 |
| mgoddard | I suppose my question would be, how do we prioritise this against other work? | 15:57 |
| yoctozepto | tough nut; I can drive most of this because it feels important to me | 15:57 |
| yoctozepto | but need you for discussion and review of course | 15:58 |
| yoctozepto | bring your ideas, thoughts, comments | 15:58 |
| yoctozepto | mnasiadka: I'm always missing fellow cores :-) | 15:58 |
| yoctozepto | *you = you all | 15:58 |
| yoctozepto | all right, we are past time unfortunately :-( | 16:00 |
| mgoddard | indeed | 16:00 |
| mgoddard | thanks for driving discussions today yoctozepto | 16:01 |
| yoctozepto | mgoddard: you are welcome; thanks for chairing | 16:01 |
| mgoddard | #endmeeting | 16:01 |
| opendevmeet | Meeting ended Wed Aug 11 16:01:41 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:01 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/kolla/2021/kolla.2021-08-11-15.01.html | 16:01 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/kolla/2021/kolla.2021-08-11-15.01.txt | 16:01 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/kolla/2021/kolla.2021-08-11-15.01.log.html | 16:01 |
| priteau | Thank you both | 16:02 |
| yoctozepto | did not manage to share during the meeting but it made me happy today that Christian has done a drive-by on reviews ;d | 16:04 |
| opendevreview | Merged openstack/kayobe-config-dev master: Support specifying a Kayobe environment to use https://review.opendev.org/c/openstack/kayobe-config-dev/+/803916 | 16:58 |
| opendevreview | Merged openstack/kayobe-config-dev master: Support reading Kayobe environment name from file https://review.opendev.org/c/openstack/kayobe-config-dev/+/803918 | 16:58 |
| opendevreview | Pierre Riteau proposed openstack/kolla-ansible master: Use api-paste.ini from /etc/neutron https://review.opendev.org/c/openstack/kolla-ansible/+/804288 | 17:52 |
| opendevreview | Pierre Riteau proposed openstack/kolla master: [release] Use RDO master Delorean packages https://review.opendev.org/c/openstack/kolla/+/804269 | 17:53 |
| yoctozepto | mgoddard, mnasiadka, priteau: cores in respective projects are now able to toggle the wip status (the new one in gerrit itself) | 18:10 |
| yoctozepto | in respective kolla* projects | 18:11 |
| yoctozepto | (kayobe too) | 18:11 |
| yoctozepto | just tested on priteau's change | 18:11 |
| * yoctozepto off | 18:12 | |
| opendevreview | Pierre Riteau proposed openstack/kolla master: Create /etc/neutron/api-paste.ini https://review.opendev.org/c/openstack/kolla/+/804307 | 22:00 |
| opendevreview | Pierre Riteau proposed openstack/kolla-ansible master: Use api-paste.ini from /etc/neutron https://review.opendev.org/c/openstack/kolla-ansible/+/804288 | 22:00 |
| opendevreview | James Kirsch proposed openstack/kolla-ansible master: Support for keystone scoped authorization https://review.opendev.org/c/openstack/kolla-ansible/+/692179 | 23:25 |
| Srin | hello | 23:41 |
| Srin | I'm using kolla-ansible train and also ceph | 23:42 |
| Srin | my ceph is in disaster.. osd container keep failing to start | 23:43 |
| Srin | is there any way to recover my ceph cluster? | 23:45 |
| Srin | this is the log when I type 'docker logs ceph-osd-2' : https://pastebin.com/w2MHzZxz | 23:47 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!