| *** k_mouza has joined #openstack-kolla | 00:17 | |
| *** munimeha1 has quit IRC | 00:21 | |
| *** k_mouza has quit IRC | 00:22 | |
| *** threestrands has joined #openstack-kolla | 00:50 | |
| *** billp_ has quit IRC | 00:53 | |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Copy CA into containers. https://review.opendev.org/699888 | 01:18 |
|---|---|---|
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Use kolla_toolbox to execute REST methods https://review.opendev.org/700788 | 01:19 |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Generate self signed TLS certificates https://review.opendev.org/701323 | 01:19 |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: CI: Add TLS tests https://review.opendev.org/701414 | 01:19 |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for encrypting backend HAProxy traffic https://review.opendev.org/664516 | 01:19 |
| *** igordc has quit IRC | 01:23 | |
| *** hamzy has quit IRC | 01:56 | |
| *** hamzy has joined #openstack-kolla | 01:56 | |
| *** jrist has quit IRC | 01:57 | |
| *** weshay has joined #openstack-kolla | 01:57 | |
| *** rphillips has quit IRC | 01:57 | |
| *** weshay|ruck has quit IRC | 01:57 | |
| *** rphillips has joined #openstack-kolla | 01:58 | |
| *** zzzeek has quit IRC | 02:03 | |
| *** zzzeek has joined #openstack-kolla | 02:08 | |
| *** jrist has joined #openstack-kolla | 02:40 | |
| *** goldyfruit_ has quit IRC | 04:04 | |
| *** skramaja has joined #openstack-kolla | 04:17 | |
| *** k_mouza has joined #openstack-kolla | 04:18 | |
| *** k_mouza has quit IRC | 04:22 | |
| *** factor has joined #openstack-kolla | 04:24 | |
| openstackgerrit | Saravanan KR proposed openstack/kolla master: Add support to build netcontrold binary image https://review.opendev.org/704723 | 04:40 |
| osmanlicilegi | morning | 05:24 |
| *** sri_ has joined #openstack-kolla | 05:56 | |
| *** Tony31 has joined #openstack-kolla | 06:06 | |
| Tony31 | hi - is this the right place for Kayobe? | 06:06 |
| *** waleedm has joined #openstack-kolla | 06:11 | |
| sri_ | morning | 06:17 |
| *** k_mouza has joined #openstack-kolla | 06:18 | |
| Tony31 | hi sri | 06:18 |
| Tony31 | Can we try and trade help? :) | 06:19 |
| *** k_mouza has quit IRC | 06:23 | |
| sri_ | Tony31, this is right place for Kayobe, but I am not the right person ;( | 06:28 |
| Tony31 | ok thanks | 06:29 |
| Tony31 | i would like to discuss a possible documentation error (or if the documentation is fine, it could be my misunderstanding of it) | 06:29 |
| Tony31 | (will post anyway) | 06:29 |
| sri_ | Tony31, just give a 30 min folks will be here by the time | 06:29 |
| Tony31 | ok will do - thank you | 06:30 |
| sri_ | np | 06:32 |
| yoctozepto | morning | 06:34 |
| yoctozepto | we usually read logs, channel is always open for relevant questions :-) | 06:35 |
| Tony31 | hi yoctozepto - I'm trying to get started with Kayobe and I am stuggling. | 06:35 |
| Tony31 | I have installed kayobe in a venv with pip - kayobe commands are working fine. This page mentions config path and config files https://docs.openstack.org/kayobe/train/configuration/kayobe.html#configuring-kayobe | 06:36 |
| Tony31 | I dont have any config files or config path as yet and I am confused how to go about getting it. | 06:36 |
| Tony31 | On the same page it mentions "<kayobe repo>/ansible/group_vars/all/*" but in the kayobe repo, the paths described in the documentation I am unable to see them.. | 06:37 |
| Tony31 | is the documentation correct? | 06:37 |
| Tony31 | kayobe repo - https://opendev.org/openstack/kayobe/src/branch/stable/train/ansible | 06:37 |
| Tony31 | https://opendev.org/openstack/kayobe/src/branch/stable/train (without the ansible dir) | 06:37 |
| Tony31 | I may have figured it out... | 06:46 |
| *** pbing19 has joined #openstack-kolla | 06:48 | |
| yoctozepto | Tony31: cool :-) | 07:05 |
| Tony31 | :-s still going around in circles here 🙈 | 07:07 |
| yoctozepto | Tony31: what's the issue then? | 07:19 |
| Tony31 | so in the repo I can see `etc/kayobe` and I can configure that as the `KAYOBE_CONFIG_PATH`. - but I am confused how the previous section applies in this case since it's outside of the config path. The previous section mentions: | 07:19 |
| Tony31 | > Playbook group variables for the all group in <kayobe repo>/ansible/group_vars/all/* set global defaults. These files should not be modified. | 07:19 |
| *** luksky has joined #openstack-kolla | 07:20 | |
| *** cah_link has joined #openstack-kolla | 07:27 | |
| *** pbing19 has quit IRC | 07:45 | |
| *** pbing19 has joined #openstack-kolla | 07:45 | |
| mnasiadka | morning | 07:47 |
| mnasiadka | yoctozepto: can you reply in https://review.opendev.org/#/c/698303/6 - and let's get over with it? ;-) | 07:51 |
| patchbot | patch 698303 - kolla-ansible - External Ceph: add ceph_*_user variables - 6 patch sets | 07:51 |
| yoctozepto | 08:19:53 <Tony31> > Playbook group variables for the all group in <kayobe repo>/ansible/group_vars/all/* set global defaults. These files should not be modified. | 07:52 |
| yoctozepto | this is true, no touching :-) | 07:52 |
| Tony31 | but how would it be modified when it's in a git within opendev | 07:53 |
| Tony31 | i think there is a step or two missing, when following the installation using pip | 07:53 |
| yoctozepto | mnasiadka: both are grammatically correct | 07:53 |
| Tony31 | i've taken a few steps back and now gone forward with installation from source. this then clones the repo into the venv/src | 07:53 |
| yoctozepto | Tony31: well, "repo" might not be precise here, true | 07:54 |
| yoctozepto | it means wherever the source files are | 07:54 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: External Ceph: add ceph_*_user variables https://review.opendev.org/698303 | 07:54 |
| mnasiadka | yoctozepto: ok, so pushing ;) | 07:54 |
| Tony31 | yoctozepto yes I understand it, in the guide there arent any steps to clone the repo... except when using the installation from source. | 07:54 |
| Tony31 | Am I correct with understanding that in either case, we need to clone the repo into the venv /src ? | 07:56 |
| yoctozepto | mnasiadka: formatting only | 07:57 |
| yoctozepto | Tony31: yes, this: https://opendev.org/openstack/kayobe-config | 07:59 |
| yoctozepto | this is kayobe-config | 07:59 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: External Ceph: add ceph_*_user variables https://review.opendev.org/698303 | 07:59 |
| mnasiadka | yoctozepto: done :) | 07:59 |
| Tony31 | 🙈 I have not yet come across that link in the docs | 08:00 |
| Tony31 | I'll try and go forward as best I can | 08:00 |
| yoctozepto | mnasiadka: +2, hopefully it does not exceed the line length | 08:00 |
| mnasiadka | oh it does, let me fix | 08:01 |
| yoctozepto | Tony31: it's in the one you linked yourself | 08:01 |
| yoctozepto | 07:36:21 <Tony31> I have installed kayobe in a venv with pip - kayobe commands are working fine. This page mentions config path and config files https://docs.openstack.org/kayobe/train/configuration/kayobe.html#configuring-kayobe | 08:01 |
| yoctozepto | just under the heading | 08:01 |
| yoctozepto | hard to miss :-) | 08:01 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: External Ceph: add ceph_*_user variables https://review.opendev.org/698303 | 08:02 |
| Tony31 | 🙈 thanks | 08:03 |
| mnasiadka | ok, morning review series done, I can fetch coffee now ;) | 08:04 |
| *** sri_ has quit IRC | 08:06 | |
| *** sri_ has joined #openstack-kolla | 08:07 | |
| *** rpittau|afk is now known as rpittau | 08:08 | |
| *** bengates has joined #openstack-kolla | 08:08 | |
| *** Tony31 has quit IRC | 08:24 | |
| *** luksky has quit IRC | 08:28 | |
| *** gfidente has joined #openstack-kolla | 08:29 | |
| *** luksky has joined #openstack-kolla | 08:31 | |
| yoctozepto | mgoddard, mnasiadka: I noticed we actually have a mix-and-match when it comes to mod_wsgi or not - e.g. glance is running in eventlet | 08:44 |
| mnasiadka | yoctozepto: well, maybe we need some summary/analysis what is run how - and think about unification (if possible) | 08:47 |
| *** rgogunskiy has quit IRC | 08:49 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/stein: Fix Prometheus template generation https://review.opendev.org/704601 | 08:54 |
| yoctozepto | mnasiadka: yeah, true | 09:09 |
| yoctozepto | mnasiadka: whiteboard enriched | 09:11 |
| openstackgerrit | Merged openstack/kolla-ansible stable/train: Fix Prometheus template generation https://review.opendev.org/704600 | 09:11 |
| *** dougsz has joined #openstack-kolla | 09:14 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/stein: Add also_notifies to Infoblox backend for Designate https://review.opendev.org/704603 | 09:17 |
| openstackgerrit | Merged openstack/kolla-ansible stable/train: Add also_notifies to Infoblox backend for Designate https://review.opendev.org/704602 | 09:17 |
| openstackgerrit | Merged openstack/kolla-ansible stable/train: Allow ironic_ipxe to serve instance images https://review.opendev.org/704605 | 09:17 |
| mnasiadka | yoctozepto: splendid | 09:19 |
| *** luksky has quit IRC | 09:26 | |
| *** jbadiapa has joined #openstack-kolla | 09:27 | |
| *** tonythomas has joined #openstack-kolla | 09:29 | |
| mgoddard | morning | 09:30 |
| mgoddard | Tony31 gone already? | 09:30 |
| openstackgerrit | Merged openstack/kolla-ansible stable/train: External Ceph: copy also cinder keyring to nova services https://review.opendev.org/704606 | 09:36 |
| openstackgerrit | Merged openstack/kolla-ansible stable/stein: Enable Glance to use Cinder iSCSI backend https://review.opendev.org/704608 | 09:36 |
| openstackgerrit | Merged openstack/kolla-ansible stable/train: Enable Glance to use Cinder iSCSI backend https://review.opendev.org/704607 | 09:36 |
| openstackgerrit | Merged openstack/kolla master: Docs: extend release management with "static links to docs" step https://review.opendev.org/703675 | 09:36 |
| openstackgerrit | Merged openstack/kolla master: Add error message when merge fails https://review.opendev.org/704178 | 09:42 |
| openstackgerrit | Merged openstack/kolla master: Add cinderlib RPM to cinder-volume https://review.opendev.org/703075 | 09:42 |
| mgoddard | merge merge merge | 09:42 |
| mgoddard | mnasiadka: I think I've worked out that weird DNF issue | 09:46 |
| mgoddard | we weren't importing the right GPG key for rmq | 09:46 |
| mnasiadka | mgoddard: I would assume dnf can print out an error message though ;-) but good you found the issue :) | 09:46 |
| mgoddard | that would be nice | 09:47 |
| *** threestrands has quit IRC | 09:47 | |
| *** luksky has joined #openstack-kolla | 10:29 | |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/stein: Use {{ openstack_branch }} as version of kolla-ansible in ansible tests https://review.opendev.org/704771 | 10:29 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/rocky: Use {{ openstack_branch }} as version of kolla-ansible in ansible tests https://review.opendev.org/704772 | 10:30 |
| openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/rocky: Use stable/rocky as version of kolla-ansible in ansible tests https://review.opendev.org/704774 | 10:47 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Use listen port for Placement precheck https://review.opendev.org/704595 | 10:47 |
| yoctozepto | 10:46:13 <mgoddard> we weren't importing the right GPG key for rmq | 10:54 |
| yoctozepto | might be worth sharing with podman folks | 10:54 |
| mgoddard | yoctozepto: it's not quite that simple | 10:55 |
| mgoddard | of course :) | 10:55 |
| mgoddard | will explain in a commit message | 10:55 |
| yoctozepto | mgoddard: I see | 10:55 |
| *** pcaruana has quit IRC | 10:57 | |
| *** rgogunskiy has joined #openstack-kolla | 10:57 | |
| *** priteau has joined #openstack-kolla | 10:59 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: External Ceph: add ceph_*_user variables https://review.opendev.org/698303 | 11:07 |
| mnasiadka | mgoddard: updated ^^ ;) | 11:07 |
| mgoddard | thanks | 11:08 |
| mnasiadka | mgoddard: git a bit mislead by the filename, and then found out it's an include in nova.conf.j2 | 11:08 |
| yoctozepto | mnasiadka: yeah, I should have placed in some snippets directory | 11:10 |
| yoctozepto | it in* | 11:10 |
| osmanlicilegi | folks, unfortunately I won't be able to attend todays meeting. please let me know if there's something related with me cause I'll be out after 14:00 utc and will be back tomorrow. | 11:11 |
| *** rgogunskiy has quit IRC | 11:11 | |
| yoctozepto | osmanlicilegi: no problem :-) | 11:11 |
| osmanlicilegi | yoctozepto: you all know I'm having issues with the current datacenter. I need to have a quick site visit to equinix today. wishing good luck to myself :] | 11:14 |
| yoctozepto | :-( | 11:14 |
| yoctozepto | good luck | 11:14 |
| mnasiadka | data center drama | 11:17 |
| mnasiadka | yoctozepto: nova.conf.d sounds fine, but I think we are not doing that in any other place :) | 11:17 |
| mgoddard | it was a bit of a hack to workaround an ansible issue | 11:18 |
| mgoddard | I wonder if said issue is still present in 2.8 | 11:18 |
| *** pcaruana has joined #openstack-kolla | 11:40 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Update packages in images https://review.opendev.org/699414 | 11:42 |
| openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: base image fixes for RabbitMQ, fluentd & InfluxDB https://review.opendev.org/704782 | 11:42 |
| *** calbers has quit IRC | 11:49 | |
| *** calbers has joined #openstack-kolla | 11:50 | |
| *** rpittau is now known as rpittau|bbl | 11:53 | |
| openstackgerrit | Merged openstack/kolla master: CentOS 8: base and openstack-base images https://review.opendev.org/699413 | 11:55 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: OVN Support https://review.opendev.org/696841 | 11:55 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: OVN Support https://review.opendev.org/696841 | 12:00 |
| *** cah_link has quit IRC | 12:14 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: OVN Support https://review.opendev.org/696841 | 12:26 |
| *** rgogunskiy has joined #openstack-kolla | 12:29 | |
| *** kplant has joined #openstack-kolla | 12:32 | |
| *** gfidente has quit IRC | 12:56 | |
| *** gfidente has joined #openstack-kolla | 12:57 | |
| hrw | mgoddard: will skip meeting today | 12:57 |
| *** goldyfruit_ has joined #openstack-kolla | 13:01 | |
| *** pbing19 has quit IRC | 13:08 | |
| *** ktibi has joined #openstack-kolla | 13:13 | |
| *** pbing19 has joined #openstack-kolla | 13:14 | |
| yoctozepto | 12:18:33 <mgoddard> I wonder if said issue is still present in 2.8 | 13:21 |
| yoctozepto | could be gone now, worth checking | 13:21 |
| yoctozepto | though it's a nice split anyway ;-) | 13:21 |
| *** skramaja has quit IRC | 13:24 | |
| ktibi | Hi mgoddard, I see your review about centos8 for images. Any plans for centos8 in KayoB ? (for bifrost) | 13:29 |
| *** rpittau|bbl is now known as rpittau | 13:30 | |
| yoctozepto | ktibi: plans yes, realization pending | 13:31 |
| ktibi | ok thx ;) | 13:32 |
| *** rgogunskiy has quit IRC | 13:44 | |
| *** strigazi has quit IRC | 13:56 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/rocky: Fix multiple CI failures https://review.opendev.org/704774 | 13:56 |
| mgoddard | apparently docker legacy repo URLs are accessible again | 13:57 |
| mgoddard | https://yum.dockerproject.org/repo/main/centos/7/Packages/ | 13:57 |
| mgoddard | https://github.com/moby/moby/issues/40376#issuecomment-574927494 | 13:58 |
| *** strigazi has joined #openstack-kolla | 14:02 | |
| mnasiadka | doesn't mean we should use them :) | 14:09 |
| *** gfidente has quit IRC | 14:13 | |
| *** gfidente has joined #openstack-kolla | 14:13 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Remove shellinabox from ironic-conductor https://review.opendev.org/704813 | 14:19 |
| hrw | we moved from them so -1 for going back | 14:20 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: WIP: CentOS 8: Add deploy jobs in CI https://review.opendev.org/693544 | 14:20 |
| *** KeithMnemonic has joined #openstack-kolla | 14:20 | |
| *** TrevorV has joined #openstack-kolla | 14:21 | |
| *** zzzeek has quit IRC | 14:22 | |
| openstackgerrit | Merged openstack/kayobe stable/stein: Use {{ openstack_branch }} as version of kolla-ansible in ansible tests https://review.opendev.org/704771 | 14:23 |
| openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Use upstream Ceph/master https://review.opendev.org/704337 | 14:23 |
| *** zzzeek has joined #openstack-kolla | 14:23 | |
| openstackgerrit | Merged openstack/kolla-ansible master: External Ceph: add ceph_*_user variables https://review.opendev.org/698303 | 14:26 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: WIP: CentOS 8: Add deploy jobs in CI https://review.opendev.org/693544 | 14:28 |
| *** sri_ has quit IRC | 14:32 | |
| *** priteau has quit IRC | 14:50 | |
| *** priteau has joined #openstack-kolla | 14:51 | |
| mgoddard | mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi | 14:52 |
| mgoddard | ^ meeting in 8 minutes | 14:52 |
| *** Trevor_V has joined #openstack-kolla | 14:55 | |
| *** priteau has quit IRC | 14:56 | |
| *** Trevor__V has joined #openstack-kolla | 14:57 | |
| osmanlicilegi | hola! I'm here for half hour | 14:57 |
| *** iputra has joined #openstack-kolla | 14:58 | |
| *** TrevorV has quit IRC | 14:58 | |
| mgoddard | #startmeeting kolla | 15:00 |
| openstack | Meeting started Wed Jan 29 15:00:05 2020 UTC and is due to finish in 60 minutes. The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: kolla)" | 15:00 | |
| openstack | The meeting name has been set to 'kolla' | 15:00 |
| mgoddard | #topic rollcall | 15:00 |
| *** openstack changes topic to "rollcall (Meeting topic: kolla)" | 15:00 | |
| mgoddard | \o | 15:00 |
| osmanlicilegi | o/ | 15:00 |
| *** Trevor_V has quit IRC | 15:00 | |
| *** scottsol has joined #openstack-kolla | 15:01 | |
| mgoddard | mnasiadka, hrw, yoctozepto: around? | 15:03 |
| yoctozepto | o/ | 15:03 |
| mgoddard | #topic agenda | 15:04 |
| *** openstack changes topic to "agenda (Meeting topic: kolla)" | 15:04 | |
| mgoddard | * Roll-call | 15:05 |
| mgoddard | * Announcements | 15:05 |
| mgoddard | * Review action items from last meeting | 15:05 |
| mgoddard | * CI status | 15:05 |
| mgoddard | * Ussuri release planning | 15:05 |
| mgoddard | * HAProxy tag - dougsz | 15:05 |
| mgoddard | * Ussuri goal: https://governance.openstack.org/tc/goals/selected/ussuri/project-ptl-and-contrib-docs.html | 15:05 |
| mgoddard | * CI scenarios: https://etherpad.openstack.org/p/KollaAnsibleScenarios | 15:05 |
| mgoddard | #topic announcements | 15:05 |
| *** openstack changes topic to "announcements (Meeting topic: kolla)" | 15:05 | |
| mgoddard | Anyone have any? | 15:05 |
| * yoctozepto devstacking | 15:05 | |
| osmanlicilegi | nope | 15:06 |
| osmanlicilegi | congrats yoctozepto again for his devstack journey :) | 15:06 |
| mgoddard | #info yoctozepto now devstack core. All devstack queries to him | 15:06 |
| mgoddard | No action items last time | 15:06 |
| yoctozepto | :D | 15:06 |
| yoctozepto | thanks | 15:06 |
| mgoddard | #topic CI status | 15:06 |
| *** openstack changes topic to "CI status (Meeting topic: kolla)" | 15:06 | |
| mgoddard | Whiteboard says rocky kolla is broken | 15:07 |
| mgoddard | post-failure (fluentd) | 15:07 |
| *** priteau has joined #openstack-kolla | 15:07 | |
| yoctozepto | I *think* it is fixed now... | 15:07 |
| osmanlicilegi | should be fixed | 15:07 |
| mgoddard | looks ok | 15:07 |
| yoctozepto | indeed | 15:08 |
| mgoddard | kayobe rocky has an issue, fix proposed | 15:08 |
| mgoddard | #topic Ussuri release planning | 15:08 |
| *** openstack changes topic to "Ussuri release planning (Meeting topic: kolla)" | 15:08 | |
| yoctozepto | k-a clear as well | 15:08 |
| yoctozepto | ah, topic changed ;d | 15:08 |
| mgoddard | I've been spending some time with CentOS 8 recently | 15:08 |
| yoctozepto | yeah, gj with that :-) | 15:09 |
| mgoddard | made a status etherpad | 15:09 |
| mgoddard | #link https://etherpad.openstack.org/p/kolla-centos8 | 15:09 |
| yoctozepto | and coordinating on the ml | 15:09 |
| mgoddard | yeah, nice team work. would have been nice to add a [kolla] tag though | 15:10 |
| yoctozepto | yeah, but I also match on my fellow stackers :-) | 15:10 |
| mgoddard | with our current patches I think we should be able to get the majority of deploy jobs passing | 15:10 |
| yoctozepto | yeah, just need some reviews | 15:11 |
| osmanlicilegi | from my side, rabbitmq is ok, just waiting for tripleo-common patches. elk stack is on the way. | 15:11 |
| yoctozepto | might be able today | 15:11 |
| yoctozepto | hoping so | 15:11 |
| yoctozepto | tired of research stuff | 15:11 |
| mgoddard | what are the tripleo-common patches? | 15:11 |
| yoctozepto | (phd in progress) | 15:11 |
| yoctozepto | mgoddard: it's one of their repos | 15:11 |
| mgoddard | yeah I know | 15:12 |
| osmanlicilegi | patches for template-overrides. https://review.opendev.org/#/q/topic:bp/rabbitmq-version-upgrade+(status:open+OR+status:merged) | 15:12 |
| yoctozepto | where they override our templates aiar | 15:12 |
| mgoddard | is it for their template overrides/ | 15:12 |
| yoctozepto | afair* | 15:12 |
| *** TrevorV has joined #openstack-kolla | 15:12 | |
| yoctozepto | no need to ask any questions | 15:12 |
| * yoctozepto delivers answers before questions | 15:13 | |
| mgoddard | so related question, how strongly should we pin rmq versions? | 15:13 |
| mgoddard | 3.8.2 seems quite specific | 15:13 |
| yoctozepto | i'd go with 3.8.x | 15:13 |
| mgoddard | if there was a 3.8.3 would we really want to ignore it? | 15:13 |
| yoctozepto | but rmq is not stricly semver | 15:13 |
| osmanlicilegi | that's what I did at start, 3.8.* | 15:13 |
| yoctozepto | as they drop erlang support with minors | 15:13 |
| mgoddard | :) | 15:13 |
| yoctozepto | I'd go 3.8.x anyway | 15:14 |
| osmanlicilegi | if we all agree to go with 3.8.x, I'll do it | 15:14 |
| mgoddard | why did you add .2? | 15:14 |
| yoctozepto | do it! | 15:14 |
| yoctozepto | yes, why?! | 15:14 |
| yoctozepto | :D | 15:14 |
| osmanlicilegi | I thought someone will give -1 for 3.8.x :))) | 15:14 |
| yoctozepto | osmanlicilegi: who?! names! | 15:14 |
| osmanlicilegi | secret! :) | 15:15 |
| yoctozepto | we'll deal with 'em | 15:15 |
| yoctozepto | with one core | 15:15 |
| *** Trevor__V has quit IRC | 15:15 | |
| osmanlicilegi | btw I'm ok with 3.8.x, will be in ci tonight | 15:15 |
| mgoddard | cool | 15:15 |
| yoctozepto | +1 | 15:15 |
| osmanlicilegi | so another question related with elk stack | 15:15 |
| mgoddard | to complicate things, are you working on CentOS 8? | 15:16 |
| osmanlicilegi | I was planning to pin it to 6.8.6 | 15:16 |
| mgoddard | because we will drop c7 in master soon | 15:16 |
| yoctozepto | why exact again? ;d | 15:16 |
| osmanlicilegi | I will not pin it too :) | 15:16 |
| yoctozepto | haha, ok | 15:16 |
| osmanlicilegi | the question for rabbitmq is, ci fails on tripleo-build-containers-centos-7 job | 15:17 |
| yoctozepto | yeah, they need their patches | 15:17 |
| mnasiadka | I'm here if there were any questions to me, had an internet outage at home ;) | 15:17 |
| osmanlicilegi | and I think we cannot make tripleo-build-containers-centos-7 non-voting | 15:17 |
| mgoddard | hi mnasiadka | 15:18 |
| yoctozepto | mnasiadka: :O | 15:18 |
| yoctozepto | mnasiadka: no questions so far | 15:18 |
| yoctozepto | osmanlicilegi: we can't permanently | 15:18 |
| mnasiadka | osmanlicilegi: ask tripleo guys to work with you on a fix in their almighty template overrides? | 15:18 |
| yoctozepto | we disable it very rarely | 15:18 |
| yoctozepto | when things are really bad on ooo side | 15:18 |
| yoctozepto | so not now | 15:18 |
| *** pbing19 has quit IRC | 15:19 | |
| osmanlicilegi | mnasiadka: I often ask on #tripleo but no one replies. I'll keep trying | 15:19 |
| osmanlicilegi | anyway, got my notes for rmq and elk | 15:20 |
| mgoddard | osmanlicilegi: our ooo ambassador is cloudnull | 15:20 |
| cloudnull | o/ | 15:21 |
| mgoddard | I was about to type 'he's usually responsive' | 15:21 |
| * cloudnull regrets raising his hand | 15:21 | |
| cloudnull | :D | 15:21 |
| mgoddard | :) | 15:21 |
| * cloudnull reading back , | 15:22 | |
| cloudnull | something I can help with ? | 15:22 |
| osmanlicilegi | cloudnull: I'll need your help for https://review.opendev.org/#/q/topic:bp/rabbitmq-version-upgrade+(status:open+OR+status:merged) | 15:22 |
| mgoddard | osmanlicilegi: do you need to add Depends-On in your patch? | 15:22 |
| yoctozepto | (and make it 3.8.*) | 15:23 |
| mgoddard | then it will pull in the tripleo patch when running the tripleo job | 15:23 |
| osmanlicilegi | I'll send another update and will let you know | 15:23 |
| osmanlicilegi | mgoddard: seems I missed it, thx for reminding | 15:23 |
| mgoddard | cloudnull: I think you're off the hook for the moment. It was really a general question about how to contact tripleo | 15:23 |
| mgoddard | thanks for raising your hand :) | 15:24 |
| yoctozepto | cloudnull: thanks for being responsive! | 15:24 |
| mgoddard | any way to mention without ping in IRC/ | 15:25 |
| mgoddard | ? | 15:25 |
| yoctozepto | mgoddard: nope, unless you want c**loudnull | 15:25 |
| yoctozepto | (remove **) | 15:25 |
| yoctozepto | or something along these lines | 15:25 |
| mgoddard | yeah | 15:25 |
| yoctozepto | irc clients are pretty dumb | 15:26 |
| mgoddard | osmanlicilegi: you had an ELK question? | 15:26 |
| yoctozepto | you can set them to react to other keywords | 15:26 |
| yoctozepto | like infra does for config-core, infra-core, infra-root etc. | 15:26 |
| cloudnull | ++ if something comes up let me know, im always around and available to provide snark and sarcasm on most subjects :D | 15:26 |
| osmanlicilegi | mgoddard: got my answer about pinning :) | 15:26 |
| yoctozepto | I thought about kolla-core to call us and have it working :-) | 15:26 |
| yoctozepto | cloudnull: snark and sarcasm is what we feed on! | 15:26 |
| mgoddard | could be useful, could be annoying :) | 15:27 |
| yoctozepto | mgoddard: personal preference, each core configures it by himself | 15:27 |
| mgoddard | osmanlicilegi: so you are going with unpinned for ELK? | 15:27 |
| yoctozepto | yeah, back to ELK | 15:27 |
| osmanlicilegi | mgoddard: yes | 15:27 |
| yoctozepto | please keep unpinned | 15:27 |
| mgoddard | ok, makes sense | 15:27 |
| mgoddard | we don't usually pin things, it's just rabbit is a little 'sensitive' | 15:27 |
| mgoddard | while it's on topic, should we use bintray for rmq as well as erlang? | 15:28 |
| mgoddard | at the moment we get rmq from packagecloud and erlang from bintray | 15:28 |
| yoctozepto | mgoddard: or just we forgettin to unpin on time ;-) | 15:28 |
| yoctozepto | hmm, weird | 15:29 |
| mgoddard | https://www.rabbitmq.com/install-rpm.html | 15:29 |
| yoctozepto | rmq provides both compatible | 15:29 |
| osmanlicilegi | using bintray makes sense to me | 15:29 |
| yoctozepto | mhm | 15:29 |
| osmanlicilegi | one repo to rule 'em all | 15:30 |
| yoctozepto | epel? we already ruled it out | 15:30 |
| dougsz | osmanlicilegi: ELK unpinned means we will currently get 7.x ? | 15:30 |
| *** bjoernt has quit IRC | 15:30 | |
| yoctozepto | dougsz: good q | 15:30 |
| mnasiadka | yeah, rmq is also on GitHub - but I guess erlang is missing there :) | 15:30 |
| *** bjoernt has joined #openstack-kolla | 15:30 | |
| osmanlicilegi | dougsz: it will be oss-6.x | 15:30 |
| yoctozepto | ok | 15:31 |
| dougsz | osmanlicilegi: cool, I have a patch for 7.x if we need it (both kolla and kolla ansible) | 15:31 |
| yoctozepto | can we go 7.x directly? | 15:31 |
| dougsz | Upgrade issues | 15:31 |
| yoctozepto | and 6 is fine? | 15:31 |
| yoctozepto | (ah, I remember I already asked you) | 15:31 |
| osmanlicilegi | 6 is not painful | 15:31 |
| dougsz | We can, but it either involves going to 6 in between, or spinning up two clusters and ingesting the old one | 15:32 |
| mgoddard | 5->6 ok, 6->7 ok, 5->7 not ok | 15:32 |
| yoctozepto | ah ok | 15:32 |
| mgoddard | we have discussed providing both images | 15:32 |
| mgoddard | elasticsearch & elasticsearch7 | 15:32 |
| mgoddard | since monasca seems to want 7 | 15:33 |
| osmanlicilegi | we can upgrade to 7 on v cycle | 15:33 |
| mnasiadka | 6.8 is going to be eol in November 2020, so we can go from 5 to 6, and then from 6 to 7 in V | 15:33 |
| osmanlicilegi | good roadmap for elk | 15:33 |
| mgoddard | move on? | 15:33 |
| osmanlicilegi | yep | 15:34 |
| mgoddard | #topic HAProxy tag - dougsz | 15:34 |
| *** openstack changes topic to "HAProxy tag - dougsz (Meeting topic: kolla)" | 15:34 | |
| mgoddard | dougsz: | 15:34 |
| dougsz | So in Rocky something like: kolla-ansible reconfigure -t glance | 15:34 |
| dougsz | Was well scoped to Glance (and common services) | 15:35 |
| dougsz | In Stein, kolla-ansible reconfigure -t glance can now restart HAProxy, iff the HAProxy config is changed | 15:35 |
| dougsz | So an operation with limited scope, can now take out the whole deployment if things go badly | 15:36 |
| dougsz | It seems sensible to me that we retain the old behaviour | 15:36 |
| mgoddard | This changed in stein when we split haproxy config out | 15:37 |
| yoctozepto | hmm | 15:37 |
| yoctozepto | that looks bad indeed | 15:37 |
| mgoddard | Worth pointing out that this behaviour was intentional, and part of the reason for the change | 15:38 |
| *** Trevor_V has joined #openstack-kolla | 15:38 | |
| mgoddard | (although mostly it was to improve haproxy config sanity) | 15:38 |
| mnasiadka | yeah, but it would make sense to allow the user to specify if he wants to restart haproxy or not in the process | 15:38 |
| dougsz | The main reason being to break the HAProxy config file up? | 15:38 |
| yoctozepto | yeah, it makes sense to enable glance in haproxy when glance tag is called | 15:38 |
| dougsz | It does, but I think the most common operation in a running deployment is to tweak service config files | 15:39 |
| osmanlicilegi | maybe k-a should have an option like --restart-related-services | 15:39 |
| dougsz | which rarely requires reconfiguring haproxy | 15:39 |
| dougsz | So i would rather do kolla-ansible reconfigure -t glance,haproxy as an exception | 15:39 |
| mgoddard | what about scaling out? | 15:39 |
| kplant | osmanlicilegi: shouldn't 'reconfigure' imply that all impacted services will be restarted? | 15:39 |
| mgoddard | I think there are two schools of thought | 15:40 |
| dougsz | I think scaling out is likely to be less common than tweaking service config | 15:40 |
| mgoddard | 1. --tags glance should only touch glance, and I understand this limitation | 15:40 |
| yoctozepto | 1 is more expected I believe | 15:41 |
| mgoddard | 2. --tags glance should configure glance and the things it depends on | 15:41 |
| yoctozepto | 2 - is it only haproxy atm anyway? | 15:41 |
| mgoddard | and the common stuff | 15:41 |
| mgoddard | which has always been the case | 15:41 |
| *** TrevorV has quit IRC | 15:41 | |
| yoctozepto | ah yeah | 15:42 |
| yoctozepto | well, it would be fine if it needed only a reload | 15:42 |
| mgoddard | an option which might keep everyone happy is to add some new tags | 15:42 |
| mgoddard | glance-haproxy-config | 15:42 |
| mgoddard | so if you want haproxy config you do --tags glance,glance-haproxy-config | 15:42 |
| yoctozepto | let me look up current docs on tags | 15:43 |
| mgoddard | otherwise, just --tags glance | 15:43 |
| mgoddard | or even more simple, just remove those tags for the haproxy-config imports | 15:43 |
| mgoddard | --tags glance,haproxy | 15:43 |
| yoctozepto | nah, no new features around | 15:43 |
| *** waleedm has quit IRC | 15:44 | |
| yoctozepto | yeah, that makes sense | 15:44 |
| yoctozepto | and update docs accordingly | 15:44 |
| dougsz | That sounds reasonable. My vote is to not implicitly reconfigure HAProxy when a service is reconfigured via tags to reduce the change of taking out the deployment | 15:44 |
| mgoddard | but that would prevent just generating haproxy config for glance | 15:44 |
| yoctozepto | I like my tags limited | 15:44 |
| mgoddard | how so? | 15:45 |
| priteau | Is it maybe time to make deploy and reconfigure tasks behave differently? deploy = implicit reconfiguration of dependencies, reconfigure = touch only services listed in tags | 15:45 |
| dougsz | also sounds good ^ | 15:45 |
| osmanlicilegi | +1 | 15:46 |
| yoctozepto | -2, feels complicated | 15:46 |
| kplant | i think that might introduce an opportunity to break things down the line and be very difficult to diagnose. if you call a reconfigure --tags svc and the scoped changes to "svc" are successful BUT the cascaded changes, which were not made, later break the deployment down the line | 15:46 |
| yoctozepto | ^ | 15:47 |
| mgoddard | this is the argument against using tags at all | 15:47 |
| yoctozepto | for the haproxy case I think it's an overkill | 15:47 |
| yoctozepto | mgoddard: yeah, but it's easier to reason when you know all your paths and not need to analyse both deploy and reconfigure | 15:48 |
| yoctozepto | I'm reluctant | 15:48 |
| yoctozepto | though I would accept it if proposed and looking sane | 15:48 |
| yoctozepto | for the haproxy case - | 15:49 |
| mgoddard | ansible conditionals and tags don't mix too well | 15:49 |
| yoctozepto | can we just remove those tags from haproxy and be done? | 15:49 |
| mgoddard | we could | 15:50 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: doc: fix bullets in external_ceph.rst https://review.opendev.org/704832 | 15:51 |
| priteau | Another issue I noticed with the new HAProxy approach: you cannot customise your main haproxy.cfg template to refer to backends from haproxy/services.d, as haproxy is first started with just the single haproxy.cfg file | 15:51 |
| mgoddard | is there ever a case where you would only want to modify haproxy config for one service? | 15:51 |
| kplant | i recently had to change the balance algorithm for keystone only | 15:51 |
| yoctozepto | mgoddard: when you deploy it | 15:52 |
| yoctozepto | but you still end up restarting the dummy | 15:52 |
| mgoddard | I mean more at deployment time | 15:52 |
| mgoddard | e.g. if you want to roll out changes slowly, keystone, then glance | 15:52 |
| mnasiadka | I don't think it would be a problem, if we would have --tags haproxy to generate configs for all enabled services and restart haproxy | 15:52 |
| mnasiadka | although mgoddard has a case for doing it one by one :) | 15:53 |
| mgoddard | I'm just worried about removing that fine grained control | 15:53 |
| yoctozepto | it's far from finegrained | 15:53 |
| *** Satarel has quit IRC | 15:53 | |
| mgoddard | well it's more than just all haproxy | 15:53 |
| yoctozepto | if you end up restarting haproxy anyways | 15:54 |
| mnasiadka | whatever it is now, it seems we need to have an option to modify haproxy config for one service at a time (or choose not to) | 15:54 |
| yoctozepto | which is why it's problematic in the first place | 15:54 |
| yoctozepto | then it's pita more than benefit | 15:54 |
| mgoddard | why is that problematic? | 15:54 |
| * osmanlicilegi bbl | 15:54 | |
| yoctozepto | for dougsz ? | 15:54 |
| mgoddard | haproxy restart shouldn't be a problem | 15:54 |
| yoctozepto | taking down the deploy | 15:54 |
| yoctozepto | well, you drop connections to all the services | 15:55 |
| yoctozepto | and services and mariadb | 15:55 |
| mgoddard | and if you want to make fine-grained changes then its necessary | 15:55 |
| mnasiadka | well, if there would be an option for real graceful reload of haproxy - we should be fine then | 15:56 |
| yoctozepto | yeah | 15:56 |
| yoctozepto | maybe there is | 15:56 |
| mgoddard | I think it accepts SIGHUP | 15:56 |
| mnasiadka | yoctozepto: there is this socket transfer reload | 15:56 |
| yoctozepto | also, if we used a separate haproxy for mysql... | 15:56 |
| mgoddard | maybe we should look into HUP | 15:56 |
| mnasiadka | yoctozepto: well, maybe we don't need to use haproxy, I think there are more intelligent solutions for load balancing galera | 15:57 |
| mnasiadka | mgoddard: here is the whole story about haproxy reloads: https://www.haproxy.com/blog/truly-seamless-reloads-with-haproxy-no-more-hacks/ | 15:57 |
| mgoddard | ok | 15:58 |
| mgoddard | we have 2 mins | 15:58 |
| mgoddard | not sure we have consensus | 15:59 |
| mgoddard | but let's move on | 15:59 |
| dougsz | It looks like there is also a check mode which can validate the config - not sure if it will catch everything | 15:59 |
| mgoddard | well we have consensus to change current behaviour at least | 15:59 |
| mgoddard | #topic Ussuri goal: https://governance.openstack.org/tc/goals/selected/ussuri/project-ptl-and-contrib-docs.html | 15:59 |
| *** openstack changes topic to "Ussuri goal: https://governance.openstack.org/tc/goals/selected/ussuri/project-ptl-and-contrib-docs.html (Meeting topic: kolla)" | 15:59 | |
| mgoddard | Before we leave, there is a 2nd ussuri cross-project goal | 16:00 |
| mgoddard | per-project PTL and contributor docs | 16:00 |
| mgoddard | we have some, we could have more | 16:00 |
| mgoddard | Anyone want to take this on? | 16:00 |
| mnasiadka | maybe some fresh contributor could look up the docs and think about what can be improved? | 16:01 |
| mnasiadka | I don't have a problem in writing something there, but I need to have somebody with a fresh mindset tell us what's missing :) | 16:01 |
| mgoddard | it would be nice if we had docs for contributors, cores and PTL | 16:01 |
| mgoddard | osmanlicilegi is the most recent core, but he left | 16:02 |
| mnasiadka | if everybody could spent a couple of minutes and add to the Ideas section of the whiteboard what could be improved there - it's a start | 16:02 |
| mgoddard | (the meeting) | 16:02 |
| mgoddard | where have these ideas come from? | 16:03 |
| mnasiadka | from mine and yoctozepto's heads - blame us :) | 16:03 |
| *** pbing19 has joined #openstack-kolla | 16:03 | |
| mgoddard | we do not have ideas here. we do as we are told | 16:04 |
| mgoddard | I moved them below kayobe feature status | 16:04 |
| yoctozepto | mgoddard: :< | 16:04 |
| mgoddard | Seems like a good plan to line up things that are not yet priorities but could be in future | 16:04 |
| mgoddard | Or just other things we might want to do | 16:05 |
| *** iputra has quit IRC | 16:05 | |
| mgoddard | #action mnasiadka to herd cats for contributor guide goal | 16:06 |
| mgoddard | cryptic action | 16:06 |
| mnasiadka | oh crap, let it be | 16:06 |
| mgoddard | anyway, we're over time | 16:06 |
| mnasiadka | I'll chase osmanlicilegi | 16:06 |
| mgoddard | thanks all | 16:06 |
| yoctozepto | xD | 16:06 |
| mgoddard | #endmeeting | 16:06 |
| *** openstack changes topic to "Kolla IRC meetings on Wednesdays @ 15:00 UTC - see agenda @ https://goo.gl/OXB0DL | Whiteboard: https://etherpad.openstack.org/p/KollaWhiteBoard | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b" | 16:06 | |
| openstack | Meeting ended Wed Jan 29 16:06:30 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:06 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-01-29-15.00.html | 16:06 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-01-29-15.00.txt | 16:06 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-01-29-15.00.log.html | 16:06 |
| *** billp has joined #openstack-kolla | 16:07 | |
| mnasiadka | yoctozepto: did we follow up with tripleo to deprecate ODL image in Kolla (since they stopped supporting ODL deployments)? | 16:09 |
| yoctozepto | mnasiadka: not remember | 16:10 |
| yoctozepto | probably not | 16:10 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/rocky: Fix multiple CI failures https://review.opendev.org/704774 | 16:11 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: doc: fix bullets in external_ceph.rst https://review.opendev.org/704832 | 16:14 |
| yoctozepto | mgoddard: you were running kayobe with master k-a | 16:19 |
| yoctozepto | good lord | 16:19 |
| mgoddard | yoctozepto: only in 'unit tests' for ansible roles | 16:20 |
| yoctozepto | mgoddard: still scary | 16:20 |
| mgoddard | and then it was only minimally using k-a to generate passwords | 16:20 |
| yoctozepto | glad you have tests though ;p | 16:20 |
| *** numans has quit IRC | 16:28 | |
| *** ktibi has quit IRC | 16:29 | |
| *** ktibi has joined #openstack-kolla | 16:30 | |
| cosmicsound | ?resolve_outputs=False&resolve_outputs=False why would be the need for same values? | 16:32 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Deprecate Opendaylight https://review.opendev.org/704838 | 16:34 |
| mnasiadka | yoctozepto, mgoddard: ^^ | 16:34 |
| mgoddard | boom | 16:35 |
| yoctozepto | cosmicsound: huh? | 16:36 |
| yoctozepto | mnasiadka: +3 | 16:37 |
| *** bengates has quit IRC | 16:37 | |
| openstackgerrit | Merged openstack/kolla-ansible master: doc: fix bullets in external_ceph.rst https://review.opendev.org/704832 | 16:38 |
| mnasiadka | mgoddard: do we want to wait for removal in V? we build ODL Carbon, which is like 5 releases back compared to current release | 16:40 |
| yoctozepto | mnasiadka: odl deserves a fast drop indeed | 16:41 |
| yoctozepto | especially being n/a in c8 | 16:41 |
| *** luksky has quit IRC | 16:42 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Deprecate OpenDaylight https://review.opendev.org/704838 | 16:44 |
| mgoddard | mnasiadka: does it hurt us to do a slow drop? | 16:46 |
| mgoddard | if we ignore c8 | 16:47 |
| yoctozepto | mgoddard: apart from wasting resources and still getting occasional failures on ussuri :-) | 16:47 |
| yoctozepto | none | 16:47 |
| yoctozepto | :D | 16:47 |
| mgoddard | it's just polite | 16:47 |
| mgoddard | I guess I don't care too much | 16:47 |
| *** tumble has joined #openstack-kolla | 16:50 | |
| cosmicsound | yoctozepto , haproxy has that in its requests it seems | 16:52 |
| yoctozepto | cosmicsound: to where? | 16:53 |
| *** dking_desktop has joined #openstack-kolla | 16:53 | |
| cosmicsound | heat_api | 16:54 |
| cosmicsound | its related to debuging that missing magnum logs in kibana | 16:54 |
| cosmicsound | Jan 29 17:26:46 haproxy[45]: 172.22.100.10:33848 [29/Jan/2020:17:26:46.932] heat_api heat_api/sc 0/0/0/35/35 200 6836 - - ---- 188/1/0/1/0 0/0 "GET /v1/fa1b477c2f0c4bbfa6f82f45980fc317/stacks/kubernetes-4w4sxj4ye7ro/b233374c-a904-475d-8ea6-818dc7d10666?resolve_outputs=False&resolve_outputs=False HTTP/1.1" | 16:55 |
| cosmicsound | This is how it looks | 16:55 |
| yoctozepto | ah, heat | 16:56 |
| tumble | hello guys. I'm struggling with "ERROR neutron.agent.rpc RemoteError: Remote error: InvalidTargetVersion Invalid target version 1.5". Any idea what I could do solve this mismatch? I'm actually running a kolla-ansible cluster which is why I don't really get how I ended up with a version mismatch | 16:56 |
| yoctozepto | from magnum I presume? | 16:56 |
| *** ktibi has quit IRC | 16:57 | |
| *** ktibi has joined #openstack-kolla | 16:57 | |
| cosmicsound | yep | 16:59 |
| mnasiadka | mgoddard: as long as the repo will not disappear again we will be fine :) | 17:01 |
| *** ktibi has quit IRC | 17:04 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Allow SSH access to keystone_ssh container https://review.opendev.org/704848 | 17:06 |
| *** ktibi has joined #openstack-kolla | 17:06 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: WIP: CentOS 8: Add deploy jobs in CI https://review.opendev.org/693544 | 17:06 |
| yoctozepto | cosmicsound: then it's magnum doing it | 17:13 |
| *** rlljorge has joined #openstack-kolla | 17:16 | |
| rlljorge | Hello there, someone running train version with ceph, Can confirm if the cinder restore from snapshot backups are ok ? | 17:17 |
| *** rlljorge has left #openstack-kolla | 17:20 | |
| *** rlljorge has joined #openstack-kolla | 17:20 | |
| mgoddard | stable releases proposed: https://review.opendev.org/704849 | 17:20 |
| patchbot | patch 704849 - releases - Release kolla and kolla-ansible stable branches - 2 patch sets | 17:20 |
| *** vmixor has joined #openstack-kolla | 17:29 | |
| *** rpittau is now known as rpittau|afk | 17:33 | |
| *** gfidente is now known as gfidente|afk | 17:38 | |
| *** dougsz has quit IRC | 17:57 | |
| *** luksky has joined #openstack-kolla | 18:09 | |
| *** waleedm has joined #openstack-kolla | 18:09 | |
| *** tonythomas has quit IRC | 18:10 | |
| *** negronjl has quit IRC | 18:18 | |
| *** negronjl has joined #openstack-kolla | 18:21 | |
| hrw | re | 18:28 |
| hrw | went quickly through meeting notes | 18:28 |
| hrw | cloudnull: how tripleo looks with move to c8? you wait for the same stuff as we do iirc. so no way to get s/7/8 in tripleo job until c8 is ready for it, right? | 18:30 |
| hrw | osmanlicilegi, mgoddard, yoctozepto: we can grab rmq and erlang from RDO iirc. | 18:30 |
| cloudnull | hrw ++ we're ready to move, but c8 is just not ready yet. | 18:32 |
| cloudnull | so, when will then be now? | 18:32 |
| cloudnull | soon. | 18:32 |
| cloudnull | :D | 18:32 |
| *** priteau has quit IRC | 18:33 | |
| hrw | ;D | 18:33 |
| *** benj_ has quit IRC | 18:47 | |
| *** benj_ has joined #openstack-kolla | 18:47 | |
| *** vmixor has quit IRC | 18:50 | |
| *** jonaspaulo has quit IRC | 18:52 | |
| dking_desktop | Could anybody give me some tips on troubleshooting a baremetal introspection timeout. I'm not really seeing anything useful in ironic-inspector.log. I'm not entirely sure how introspection works, but I can see that using IPMI, when I start introspection, it is successfully able to reboot the server. | 18:55 |
| kplant | yeah, can you edit the image used for introspection and add a plaintext password for root? | 18:58 |
| kplant | that way you can actually pop into the server via ipmi and look around | 18:58 |
| kplant | and not just watch it boot | 18:58 |
| *** igordc has joined #openstack-kolla | 19:02 | |
| *** rlljorge has quit IRC | 19:14 | |
| *** oyrogerg has quit IRC | 19:14 | |
| *** pbing19 has quit IRC | 19:18 | |
| *** pbing19 has joined #openstack-kolla | 19:18 | |
| *** waleedm has quit IRC | 19:23 | |
| *** waleedm has joined #openstack-kolla | 19:23 | |
| *** gmann is now known as gmann_afk | 19:57 | |
| dking_desktop | kplant: Sorry, I didn't notice that there was a reply. Actually, the server still has an old OS on it, and I can reach it with KVM. I see that it rebooted, but it booted back into the old OS, and then nothing further. | 20:01 |
| kplant | right, what i mean is edit the image that's used for introspection | 20:01 |
| *** ktibi has quit IRC | 20:01 | |
| kplant | so after it PXEs you can log into that image | 20:01 |
| kplant | and poke around the logs on the baremetal machine | 20:01 |
| kplant | ironic calls for the node to pxe, it feeds it an image and waits for that image to collect introspection data and shoot it back to the ironic api | 20:02 |
| kplant | if it's not communicating back with ironic, you're not going to see anything on your conductor logs | 20:02 |
| dking_desktop | That's helpful. So, perhaps it never got it to boot the PXE image. That sounds likely, since I'm still trying to figure out the networking. | 20:03 |
| dking_desktop | I believe that the PXE image is served over a different network? | 20:04 |
| kplant | it would be whatever network ironic is using for provisioning | 20:04 |
| *** waleedm_ has joined #openstack-kolla | 20:07 | |
| *** waleedm has quit IRC | 20:07 | |
| dking_desktop | That makes sense. I'm going to look at that further. Thanks for the suggestion. | 20:09 |
| kplant | np. if you're not seeing the machine(s) pxe boot | 20:09 |
| *** waleedm__ has joined #openstack-kolla | 20:09 | |
| kplant | i would look at the network with tcpdump and see if you see the machine soliciting for BOOTP/DHCP | 20:09 |
| kplant | that would be the first step of pxe | 20:09 |
| kplant | bootp/dhcp -> tftp/http(s) spam | 20:09 |
| yoctozepto | and: is it configured to boot via pxe | 20:11 |
| *** waleedm_ has quit IRC | 20:12 | |
| yoctozepto | ipmi may fail to set boot method | 20:12 |
| yoctozepto | or set it to wrong cards | 20:12 |
| yoctozepto | cards=NICs | 20:12 |
| dking_desktop | kplant: Thanks. I'll look at that | 20:12 |
| dking_desktop | yoctozepto: It's set to boot_interface=pxe | 20:13 |
| dking_desktop | Well, it has that and no-bios | 20:13 |
| dking_desktop | I also attempted to set a port with the MAC address, as per the article. | 20:14 |
| dking_desktop | I'm thinking it's the provisioning network, as I don't think I set that up properly. | 20:15 |
| yoctozepto | it most likely needs to be the untagged network | 20:16 |
| yoctozepto | connected to host | 20:16 |
| kplant | ^ | 20:16 |
| kplant | and if your nics do support vlan tagging for pxe... still go with untagged | 20:16 |
| kplant | because it will be transparent to the OS and that's a nightmare | 20:16 |
| yoctozepto | xD | 20:16 |
| *** waleedm__ has quit IRC | 20:16 | |
| yoctozepto | kplant: yeah, I believe ironic would fail that | 20:17 |
| yoctozepto | one would need custom setup to support this switch from preboot to boot | 20:17 |
| yoctozepto | as boot suddenly wants untagged | 20:17 |
| kplant | yeah for sure | 20:18 |
| kplant | during pxe it would think the network was untagged and then... surprise | 20:18 |
| *** rlljorge has joined #openstack-kolla | 20:18 | |
| dking_desktop | Everything on the control node uses a VLAN. Only the BMC network is accessible outside of a VLAN. | 20:20 |
| kplant | the node that you're trying to use in ironic, the provisioning network should be native | 20:21 |
| dking_desktop | That might be an issue. | 20:24 |
| yoctozepto | yeah, it's always some vlan | 20:35 |
| yoctozepto | depending on terminology it might be native, default or untagged | 20:36 |
| *** kplant has quit IRC | 20:55 | |
| *** rlljorge has quit IRC | 21:07 | |
| *** pbing19 has quit IRC | 21:10 | |
| *** gmann_afk is now known as gmann | 21:17 | |
| *** dking_desktop has quit IRC | 21:41 | |
| *** gfidente|afk is now known as gfidente | 21:46 | |
| *** k_mouza has joined #openstack-kolla | 22:15 | |
| *** k_mouza has quit IRC | 22:19 | |
| *** Trevor_V has quit IRC | 22:31 | |
| *** ktibi has joined #openstack-kolla | 22:52 | |
| *** ktibi has quit IRC | 22:57 | |
| *** gfidente has quit IRC | 23:33 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!