*** k_mouza has joined #openstack-kolla | 00:17 | |
*** munimeha1 has quit IRC | 00:21 | |
*** k_mouza has quit IRC | 00:22 | |
*** threestrands has joined #openstack-kolla | 00:50 | |
*** billp_ has quit IRC | 00:53 | |
openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Copy CA into containers. https://review.opendev.org/699888 | 01:18 |
---|---|---|
openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Use kolla_toolbox to execute REST methods https://review.opendev.org/700788 | 01:19 |
openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Generate self signed TLS certificates https://review.opendev.org/701323 | 01:19 |
openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: CI: Add TLS tests https://review.opendev.org/701414 | 01:19 |
openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for encrypting backend HAProxy traffic https://review.opendev.org/664516 | 01:19 |
*** igordc has quit IRC | 01:23 | |
*** hamzy has quit IRC | 01:56 | |
*** hamzy has joined #openstack-kolla | 01:56 | |
*** jrist has quit IRC | 01:57 | |
*** weshay has joined #openstack-kolla | 01:57 | |
*** rphillips has quit IRC | 01:57 | |
*** weshay|ruck has quit IRC | 01:57 | |
*** rphillips has joined #openstack-kolla | 01:58 | |
*** zzzeek has quit IRC | 02:03 | |
*** zzzeek has joined #openstack-kolla | 02:08 | |
*** jrist has joined #openstack-kolla | 02:40 | |
*** goldyfruit_ has quit IRC | 04:04 | |
*** skramaja has joined #openstack-kolla | 04:17 | |
*** k_mouza has joined #openstack-kolla | 04:18 | |
*** k_mouza has quit IRC | 04:22 | |
*** factor has joined #openstack-kolla | 04:24 | |
openstackgerrit | Saravanan KR proposed openstack/kolla master: Add support to build netcontrold binary image https://review.opendev.org/704723 | 04:40 |
osmanlicilegi | morning | 05:24 |
*** sri_ has joined #openstack-kolla | 05:56 | |
*** Tony31 has joined #openstack-kolla | 06:06 | |
Tony31 | hi - is this the right place for Kayobe? | 06:06 |
*** waleedm has joined #openstack-kolla | 06:11 | |
sri_ | morning | 06:17 |
*** k_mouza has joined #openstack-kolla | 06:18 | |
Tony31 | hi sri | 06:18 |
Tony31 | Can we try and trade help? :) | 06:19 |
*** k_mouza has quit IRC | 06:23 | |
sri_ | Tony31, this is right place for Kayobe, but I am not the right person ;( | 06:28 |
Tony31 | ok thanks | 06:29 |
Tony31 | i would like to discuss a possible documentation error (or if the documentation is fine, it could be my misunderstanding of it) | 06:29 |
Tony31 | (will post anyway) | 06:29 |
sri_ | Tony31, just give a 30 min folks will be here by the time | 06:29 |
Tony31 | ok will do - thank you | 06:30 |
sri_ | np | 06:32 |
yoctozepto | morning | 06:34 |
yoctozepto | we usually read logs, channel is always open for relevant questions :-) | 06:35 |
Tony31 | hi yoctozepto - I'm trying to get started with Kayobe and I am stuggling. | 06:35 |
Tony31 | I have installed kayobe in a venv with pip - kayobe commands are working fine. This page mentions config path and config files https://docs.openstack.org/kayobe/train/configuration/kayobe.html#configuring-kayobe | 06:36 |
Tony31 | I dont have any config files or config path as yet and I am confused how to go about getting it. | 06:36 |
Tony31 | On the same page it mentions "<kayobe repo>/ansible/group_vars/all/*" but in the kayobe repo, the paths described in the documentation I am unable to see them.. | 06:37 |
Tony31 | is the documentation correct? | 06:37 |
Tony31 | kayobe repo - https://opendev.org/openstack/kayobe/src/branch/stable/train/ansible | 06:37 |
Tony31 | https://opendev.org/openstack/kayobe/src/branch/stable/train (without the ansible dir) | 06:37 |
Tony31 | I may have figured it out... | 06:46 |
*** pbing19 has joined #openstack-kolla | 06:48 | |
yoctozepto | Tony31: cool :-) | 07:05 |
Tony31 | :-s still going around in circles here 🙈 | 07:07 |
yoctozepto | Tony31: what's the issue then? | 07:19 |
Tony31 | so in the repo I can see `etc/kayobe` and I can configure that as the `KAYOBE_CONFIG_PATH`. - but I am confused how the previous section applies in this case since it's outside of the config path. The previous section mentions: | 07:19 |
Tony31 | > Playbook group variables for the all group in <kayobe repo>/ansible/group_vars/all/* set global defaults. These files should not be modified. | 07:19 |
*** luksky has joined #openstack-kolla | 07:20 | |
*** cah_link has joined #openstack-kolla | 07:27 | |
*** pbing19 has quit IRC | 07:45 | |
*** pbing19 has joined #openstack-kolla | 07:45 | |
mnasiadka | morning | 07:47 |
mnasiadka | yoctozepto: can you reply in https://review.opendev.org/#/c/698303/6 - and let's get over with it? ;-) | 07:51 |
patchbot | patch 698303 - kolla-ansible - External Ceph: add ceph_*_user variables - 6 patch sets | 07:51 |
yoctozepto | 08:19:53 <Tony31> > Playbook group variables for the all group in <kayobe repo>/ansible/group_vars/all/* set global defaults. These files should not be modified. | 07:52 |
yoctozepto | this is true, no touching :-) | 07:52 |
Tony31 | but how would it be modified when it's in a git within opendev | 07:53 |
Tony31 | i think there is a step or two missing, when following the installation using pip | 07:53 |
yoctozepto | mnasiadka: both are grammatically correct | 07:53 |
Tony31 | i've taken a few steps back and now gone forward with installation from source. this then clones the repo into the venv/src | 07:53 |
yoctozepto | Tony31: well, "repo" might not be precise here, true | 07:54 |
yoctozepto | it means wherever the source files are | 07:54 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: External Ceph: add ceph_*_user variables https://review.opendev.org/698303 | 07:54 |
mnasiadka | yoctozepto: ok, so pushing ;) | 07:54 |
Tony31 | yoctozepto yes I understand it, in the guide there arent any steps to clone the repo... except when using the installation from source. | 07:54 |
Tony31 | Am I correct with understanding that in either case, we need to clone the repo into the venv /src ? | 07:56 |
yoctozepto | mnasiadka: formatting only | 07:57 |
yoctozepto | Tony31: yes, this: https://opendev.org/openstack/kayobe-config | 07:59 |
yoctozepto | this is kayobe-config | 07:59 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: External Ceph: add ceph_*_user variables https://review.opendev.org/698303 | 07:59 |
mnasiadka | yoctozepto: done :) | 07:59 |
Tony31 | 🙈 I have not yet come across that link in the docs | 08:00 |
Tony31 | I'll try and go forward as best I can | 08:00 |
yoctozepto | mnasiadka: +2, hopefully it does not exceed the line length | 08:00 |
mnasiadka | oh it does, let me fix | 08:01 |
yoctozepto | Tony31: it's in the one you linked yourself | 08:01 |
yoctozepto | 07:36:21 <Tony31> I have installed kayobe in a venv with pip - kayobe commands are working fine. This page mentions config path and config files https://docs.openstack.org/kayobe/train/configuration/kayobe.html#configuring-kayobe | 08:01 |
yoctozepto | just under the heading | 08:01 |
yoctozepto | hard to miss :-) | 08:01 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: External Ceph: add ceph_*_user variables https://review.opendev.org/698303 | 08:02 |
Tony31 | 🙈 thanks | 08:03 |
mnasiadka | ok, morning review series done, I can fetch coffee now ;) | 08:04 |
*** sri_ has quit IRC | 08:06 | |
*** sri_ has joined #openstack-kolla | 08:07 | |
*** rpittau|afk is now known as rpittau | 08:08 | |
*** bengates has joined #openstack-kolla | 08:08 | |
*** Tony31 has quit IRC | 08:24 | |
*** luksky has quit IRC | 08:28 | |
*** gfidente has joined #openstack-kolla | 08:29 | |
*** luksky has joined #openstack-kolla | 08:31 | |
yoctozepto | mgoddard, mnasiadka: I noticed we actually have a mix-and-match when it comes to mod_wsgi or not - e.g. glance is running in eventlet | 08:44 |
mnasiadka | yoctozepto: well, maybe we need some summary/analysis what is run how - and think about unification (if possible) | 08:47 |
*** rgogunskiy has quit IRC | 08:49 | |
openstackgerrit | Merged openstack/kolla-ansible stable/stein: Fix Prometheus template generation https://review.opendev.org/704601 | 08:54 |
yoctozepto | mnasiadka: yeah, true | 09:09 |
yoctozepto | mnasiadka: whiteboard enriched | 09:11 |
openstackgerrit | Merged openstack/kolla-ansible stable/train: Fix Prometheus template generation https://review.opendev.org/704600 | 09:11 |
*** dougsz has joined #openstack-kolla | 09:14 | |
openstackgerrit | Merged openstack/kolla-ansible stable/stein: Add also_notifies to Infoblox backend for Designate https://review.opendev.org/704603 | 09:17 |
openstackgerrit | Merged openstack/kolla-ansible stable/train: Add also_notifies to Infoblox backend for Designate https://review.opendev.org/704602 | 09:17 |
openstackgerrit | Merged openstack/kolla-ansible stable/train: Allow ironic_ipxe to serve instance images https://review.opendev.org/704605 | 09:17 |
mnasiadka | yoctozepto: splendid | 09:19 |
*** luksky has quit IRC | 09:26 | |
*** jbadiapa has joined #openstack-kolla | 09:27 | |
*** tonythomas has joined #openstack-kolla | 09:29 | |
mgoddard | morning | 09:30 |
mgoddard | Tony31 gone already? | 09:30 |
openstackgerrit | Merged openstack/kolla-ansible stable/train: External Ceph: copy also cinder keyring to nova services https://review.opendev.org/704606 | 09:36 |
openstackgerrit | Merged openstack/kolla-ansible stable/stein: Enable Glance to use Cinder iSCSI backend https://review.opendev.org/704608 | 09:36 |
openstackgerrit | Merged openstack/kolla-ansible stable/train: Enable Glance to use Cinder iSCSI backend https://review.opendev.org/704607 | 09:36 |
openstackgerrit | Merged openstack/kolla master: Docs: extend release management with "static links to docs" step https://review.opendev.org/703675 | 09:36 |
openstackgerrit | Merged openstack/kolla master: Add error message when merge fails https://review.opendev.org/704178 | 09:42 |
openstackgerrit | Merged openstack/kolla master: Add cinderlib RPM to cinder-volume https://review.opendev.org/703075 | 09:42 |
mgoddard | merge merge merge | 09:42 |
mgoddard | mnasiadka: I think I've worked out that weird DNF issue | 09:46 |
mgoddard | we weren't importing the right GPG key for rmq | 09:46 |
mnasiadka | mgoddard: I would assume dnf can print out an error message though ;-) but good you found the issue :) | 09:46 |
mgoddard | that would be nice | 09:47 |
*** threestrands has quit IRC | 09:47 | |
*** luksky has joined #openstack-kolla | 10:29 | |
openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/stein: Use {{ openstack_branch }} as version of kolla-ansible in ansible tests https://review.opendev.org/704771 | 10:29 |
openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/rocky: Use {{ openstack_branch }} as version of kolla-ansible in ansible tests https://review.opendev.org/704772 | 10:30 |
openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/rocky: Use stable/rocky as version of kolla-ansible in ansible tests https://review.opendev.org/704774 | 10:47 |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Use listen port for Placement precheck https://review.opendev.org/704595 | 10:47 |
yoctozepto | 10:46:13 <mgoddard> we weren't importing the right GPG key for rmq | 10:54 |
yoctozepto | might be worth sharing with podman folks | 10:54 |
mgoddard | yoctozepto: it's not quite that simple | 10:55 |
mgoddard | of course :) | 10:55 |
mgoddard | will explain in a commit message | 10:55 |
yoctozepto | mgoddard: I see | 10:55 |
*** pcaruana has quit IRC | 10:57 | |
*** rgogunskiy has joined #openstack-kolla | 10:57 | |
*** priteau has joined #openstack-kolla | 10:59 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: External Ceph: add ceph_*_user variables https://review.opendev.org/698303 | 11:07 |
mnasiadka | mgoddard: updated ^^ ;) | 11:07 |
mgoddard | thanks | 11:08 |
mnasiadka | mgoddard: git a bit mislead by the filename, and then found out it's an include in nova.conf.j2 | 11:08 |
yoctozepto | mnasiadka: yeah, I should have placed in some snippets directory | 11:10 |
yoctozepto | it in* | 11:10 |
osmanlicilegi | folks, unfortunately I won't be able to attend todays meeting. please let me know if there's something related with me cause I'll be out after 14:00 utc and will be back tomorrow. | 11:11 |
*** rgogunskiy has quit IRC | 11:11 | |
yoctozepto | osmanlicilegi: no problem :-) | 11:11 |
osmanlicilegi | yoctozepto: you all know I'm having issues with the current datacenter. I need to have a quick site visit to equinix today. wishing good luck to myself :] | 11:14 |
yoctozepto | :-( | 11:14 |
yoctozepto | good luck | 11:14 |
mnasiadka | data center drama | 11:17 |
mnasiadka | yoctozepto: nova.conf.d sounds fine, but I think we are not doing that in any other place :) | 11:17 |
mgoddard | it was a bit of a hack to workaround an ansible issue | 11:18 |
mgoddard | I wonder if said issue is still present in 2.8 | 11:18 |
*** pcaruana has joined #openstack-kolla | 11:40 | |
openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Update packages in images https://review.opendev.org/699414 | 11:42 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: base image fixes for RabbitMQ, fluentd & InfluxDB https://review.opendev.org/704782 | 11:42 |
*** calbers has quit IRC | 11:49 | |
*** calbers has joined #openstack-kolla | 11:50 | |
*** rpittau is now known as rpittau|bbl | 11:53 | |
openstackgerrit | Merged openstack/kolla master: CentOS 8: base and openstack-base images https://review.opendev.org/699413 | 11:55 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: OVN Support https://review.opendev.org/696841 | 11:55 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: OVN Support https://review.opendev.org/696841 | 12:00 |
*** cah_link has quit IRC | 12:14 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: OVN Support https://review.opendev.org/696841 | 12:26 |
*** rgogunskiy has joined #openstack-kolla | 12:29 | |
*** kplant has joined #openstack-kolla | 12:32 | |
*** gfidente has quit IRC | 12:56 | |
*** gfidente has joined #openstack-kolla | 12:57 | |
hrw | mgoddard: will skip meeting today | 12:57 |
*** goldyfruit_ has joined #openstack-kolla | 13:01 | |
*** pbing19 has quit IRC | 13:08 | |
*** ktibi has joined #openstack-kolla | 13:13 | |
*** pbing19 has joined #openstack-kolla | 13:14 | |
yoctozepto | 12:18:33 <mgoddard> I wonder if said issue is still present in 2.8 | 13:21 |
yoctozepto | could be gone now, worth checking | 13:21 |
yoctozepto | though it's a nice split anyway ;-) | 13:21 |
*** skramaja has quit IRC | 13:24 | |
ktibi | Hi mgoddard, I see your review about centos8 for images. Any plans for centos8 in KayoB ? (for bifrost) | 13:29 |
*** rpittau|bbl is now known as rpittau | 13:30 | |
yoctozepto | ktibi: plans yes, realization pending | 13:31 |
ktibi | ok thx ;) | 13:32 |
*** rgogunskiy has quit IRC | 13:44 | |
*** strigazi has quit IRC | 13:56 | |
openstackgerrit | Mark Goddard proposed openstack/kayobe stable/rocky: Fix multiple CI failures https://review.opendev.org/704774 | 13:56 |
mgoddard | apparently docker legacy repo URLs are accessible again | 13:57 |
mgoddard | https://yum.dockerproject.org/repo/main/centos/7/Packages/ | 13:57 |
mgoddard | https://github.com/moby/moby/issues/40376#issuecomment-574927494 | 13:58 |
*** strigazi has joined #openstack-kolla | 14:02 | |
mnasiadka | doesn't mean we should use them :) | 14:09 |
*** gfidente has quit IRC | 14:13 | |
*** gfidente has joined #openstack-kolla | 14:13 | |
openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Remove shellinabox from ironic-conductor https://review.opendev.org/704813 | 14:19 |
hrw | we moved from them so -1 for going back | 14:20 |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: WIP: CentOS 8: Add deploy jobs in CI https://review.opendev.org/693544 | 14:20 |
*** KeithMnemonic has joined #openstack-kolla | 14:20 | |
*** TrevorV has joined #openstack-kolla | 14:21 | |
*** zzzeek has quit IRC | 14:22 | |
openstackgerrit | Merged openstack/kayobe stable/stein: Use {{ openstack_branch }} as version of kolla-ansible in ansible tests https://review.opendev.org/704771 | 14:23 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Use upstream Ceph/master https://review.opendev.org/704337 | 14:23 |
*** zzzeek has joined #openstack-kolla | 14:23 | |
openstackgerrit | Merged openstack/kolla-ansible master: External Ceph: add ceph_*_user variables https://review.opendev.org/698303 | 14:26 |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: WIP: CentOS 8: Add deploy jobs in CI https://review.opendev.org/693544 | 14:28 |
*** sri_ has quit IRC | 14:32 | |
*** priteau has quit IRC | 14:50 | |
*** priteau has joined #openstack-kolla | 14:51 | |
mgoddard | mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi | 14:52 |
mgoddard | ^ meeting in 8 minutes | 14:52 |
*** Trevor_V has joined #openstack-kolla | 14:55 | |
*** priteau has quit IRC | 14:56 | |
*** Trevor__V has joined #openstack-kolla | 14:57 | |
osmanlicilegi | hola! I'm here for half hour | 14:57 |
*** iputra has joined #openstack-kolla | 14:58 | |
*** TrevorV has quit IRC | 14:58 | |
mgoddard | #startmeeting kolla | 15:00 |
openstack | Meeting started Wed Jan 29 15:00:05 2020 UTC and is due to finish in 60 minutes. The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
*** openstack changes topic to " (Meeting topic: kolla)" | 15:00 | |
openstack | The meeting name has been set to 'kolla' | 15:00 |
mgoddard | #topic rollcall | 15:00 |
*** openstack changes topic to "rollcall (Meeting topic: kolla)" | 15:00 | |
mgoddard | \o | 15:00 |
osmanlicilegi | o/ | 15:00 |
*** Trevor_V has quit IRC | 15:00 | |
*** scottsol has joined #openstack-kolla | 15:01 | |
mgoddard | mnasiadka, hrw, yoctozepto: around? | 15:03 |
yoctozepto | o/ | 15:03 |
mgoddard | #topic agenda | 15:04 |
*** openstack changes topic to "agenda (Meeting topic: kolla)" | 15:04 | |
mgoddard | * Roll-call | 15:05 |
mgoddard | * Announcements | 15:05 |
mgoddard | * Review action items from last meeting | 15:05 |
mgoddard | * CI status | 15:05 |
mgoddard | * Ussuri release planning | 15:05 |
mgoddard | * HAProxy tag - dougsz | 15:05 |
mgoddard | * Ussuri goal: https://governance.openstack.org/tc/goals/selected/ussuri/project-ptl-and-contrib-docs.html | 15:05 |
mgoddard | * CI scenarios: https://etherpad.openstack.org/p/KollaAnsibleScenarios | 15:05 |
mgoddard | #topic announcements | 15:05 |
*** openstack changes topic to "announcements (Meeting topic: kolla)" | 15:05 | |
mgoddard | Anyone have any? | 15:05 |
* yoctozepto devstacking | 15:05 | |
osmanlicilegi | nope | 15:06 |
osmanlicilegi | congrats yoctozepto again for his devstack journey :) | 15:06 |
mgoddard | #info yoctozepto now devstack core. All devstack queries to him | 15:06 |
mgoddard | No action items last time | 15:06 |
yoctozepto | :D | 15:06 |
yoctozepto | thanks | 15:06 |
mgoddard | #topic CI status | 15:06 |
*** openstack changes topic to "CI status (Meeting topic: kolla)" | 15:06 | |
mgoddard | Whiteboard says rocky kolla is broken | 15:07 |
mgoddard | post-failure (fluentd) | 15:07 |
*** priteau has joined #openstack-kolla | 15:07 | |
yoctozepto | I *think* it is fixed now... | 15:07 |
osmanlicilegi | should be fixed | 15:07 |
mgoddard | looks ok | 15:07 |
yoctozepto | indeed | 15:08 |
mgoddard | kayobe rocky has an issue, fix proposed | 15:08 |
mgoddard | #topic Ussuri release planning | 15:08 |
*** openstack changes topic to "Ussuri release planning (Meeting topic: kolla)" | 15:08 | |
yoctozepto | k-a clear as well | 15:08 |
yoctozepto | ah, topic changed ;d | 15:08 |
mgoddard | I've been spending some time with CentOS 8 recently | 15:08 |
yoctozepto | yeah, gj with that :-) | 15:09 |
mgoddard | made a status etherpad | 15:09 |
mgoddard | #link https://etherpad.openstack.org/p/kolla-centos8 | 15:09 |
yoctozepto | and coordinating on the ml | 15:09 |
mgoddard | yeah, nice team work. would have been nice to add a [kolla] tag though | 15:10 |
yoctozepto | yeah, but I also match on my fellow stackers :-) | 15:10 |
mgoddard | with our current patches I think we should be able to get the majority of deploy jobs passing | 15:10 |
yoctozepto | yeah, just need some reviews | 15:11 |
osmanlicilegi | from my side, rabbitmq is ok, just waiting for tripleo-common patches. elk stack is on the way. | 15:11 |
yoctozepto | might be able today | 15:11 |
yoctozepto | hoping so | 15:11 |
yoctozepto | tired of research stuff | 15:11 |
mgoddard | what are the tripleo-common patches? | 15:11 |
yoctozepto | (phd in progress) | 15:11 |
yoctozepto | mgoddard: it's one of their repos | 15:11 |
mgoddard | yeah I know | 15:12 |
osmanlicilegi | patches for template-overrides. https://review.opendev.org/#/q/topic:bp/rabbitmq-version-upgrade+(status:open+OR+status:merged) | 15:12 |
yoctozepto | where they override our templates aiar | 15:12 |
mgoddard | is it for their template overrides/ | 15:12 |
yoctozepto | afair* | 15:12 |
*** TrevorV has joined #openstack-kolla | 15:12 | |
yoctozepto | no need to ask any questions | 15:12 |
* yoctozepto delivers answers before questions | 15:13 | |
mgoddard | so related question, how strongly should we pin rmq versions? | 15:13 |
mgoddard | 3.8.2 seems quite specific | 15:13 |
yoctozepto | i'd go with 3.8.x | 15:13 |
mgoddard | if there was a 3.8.3 would we really want to ignore it? | 15:13 |
yoctozepto | but rmq is not stricly semver | 15:13 |
osmanlicilegi | that's what I did at start, 3.8.* | 15:13 |
yoctozepto | as they drop erlang support with minors | 15:13 |
mgoddard | :) | 15:13 |
yoctozepto | I'd go 3.8.x anyway | 15:14 |
osmanlicilegi | if we all agree to go with 3.8.x, I'll do it | 15:14 |
mgoddard | why did you add .2? | 15:14 |
yoctozepto | do it! | 15:14 |
yoctozepto | yes, why?! | 15:14 |
yoctozepto | :D | 15:14 |
osmanlicilegi | I thought someone will give -1 for 3.8.x :))) | 15:14 |
yoctozepto | osmanlicilegi: who?! names! | 15:14 |
osmanlicilegi | secret! :) | 15:15 |
yoctozepto | we'll deal with 'em | 15:15 |
yoctozepto | with one core | 15:15 |
*** Trevor__V has quit IRC | 15:15 | |
osmanlicilegi | btw I'm ok with 3.8.x, will be in ci tonight | 15:15 |
mgoddard | cool | 15:15 |
yoctozepto | +1 | 15:15 |
osmanlicilegi | so another question related with elk stack | 15:15 |
mgoddard | to complicate things, are you working on CentOS 8? | 15:16 |
osmanlicilegi | I was planning to pin it to 6.8.6 | 15:16 |
mgoddard | because we will drop c7 in master soon | 15:16 |
yoctozepto | why exact again? ;d | 15:16 |
osmanlicilegi | I will not pin it too :) | 15:16 |
yoctozepto | haha, ok | 15:16 |
osmanlicilegi | the question for rabbitmq is, ci fails on tripleo-build-containers-centos-7 job | 15:17 |
yoctozepto | yeah, they need their patches | 15:17 |
mnasiadka | I'm here if there were any questions to me, had an internet outage at home ;) | 15:17 |
osmanlicilegi | and I think we cannot make tripleo-build-containers-centos-7 non-voting | 15:17 |
mgoddard | hi mnasiadka | 15:18 |
yoctozepto | mnasiadka: :O | 15:18 |
yoctozepto | mnasiadka: no questions so far | 15:18 |
yoctozepto | osmanlicilegi: we can't permanently | 15:18 |
mnasiadka | osmanlicilegi: ask tripleo guys to work with you on a fix in their almighty template overrides? | 15:18 |
yoctozepto | we disable it very rarely | 15:18 |
yoctozepto | when things are really bad on ooo side | 15:18 |
yoctozepto | so not now | 15:18 |
*** pbing19 has quit IRC | 15:19 | |
osmanlicilegi | mnasiadka: I often ask on #tripleo but no one replies. I'll keep trying | 15:19 |
osmanlicilegi | anyway, got my notes for rmq and elk | 15:20 |
mgoddard | osmanlicilegi: our ooo ambassador is cloudnull | 15:20 |
cloudnull | o/ | 15:21 |
mgoddard | I was about to type 'he's usually responsive' | 15:21 |
* cloudnull regrets raising his hand | 15:21 | |
cloudnull | :D | 15:21 |
mgoddard | :) | 15:21 |
* cloudnull reading back , | 15:22 | |
cloudnull | something I can help with ? | 15:22 |
osmanlicilegi | cloudnull: I'll need your help for https://review.opendev.org/#/q/topic:bp/rabbitmq-version-upgrade+(status:open+OR+status:merged) | 15:22 |
mgoddard | osmanlicilegi: do you need to add Depends-On in your patch? | 15:22 |
yoctozepto | (and make it 3.8.*) | 15:23 |
mgoddard | then it will pull in the tripleo patch when running the tripleo job | 15:23 |
osmanlicilegi | I'll send another update and will let you know | 15:23 |
osmanlicilegi | mgoddard: seems I missed it, thx for reminding | 15:23 |
mgoddard | cloudnull: I think you're off the hook for the moment. It was really a general question about how to contact tripleo | 15:23 |
mgoddard | thanks for raising your hand :) | 15:24 |
yoctozepto | cloudnull: thanks for being responsive! | 15:24 |
mgoddard | any way to mention without ping in IRC/ | 15:25 |
mgoddard | ? | 15:25 |
yoctozepto | mgoddard: nope, unless you want c**loudnull | 15:25 |
yoctozepto | (remove **) | 15:25 |
yoctozepto | or something along these lines | 15:25 |
mgoddard | yeah | 15:25 |
yoctozepto | irc clients are pretty dumb | 15:26 |
mgoddard | osmanlicilegi: you had an ELK question? | 15:26 |
yoctozepto | you can set them to react to other keywords | 15:26 |
yoctozepto | like infra does for config-core, infra-core, infra-root etc. | 15:26 |
cloudnull | ++ if something comes up let me know, im always around and available to provide snark and sarcasm on most subjects :D | 15:26 |
osmanlicilegi | mgoddard: got my answer about pinning :) | 15:26 |
yoctozepto | I thought about kolla-core to call us and have it working :-) | 15:26 |
yoctozepto | cloudnull: snark and sarcasm is what we feed on! | 15:26 |
mgoddard | could be useful, could be annoying :) | 15:27 |
yoctozepto | mgoddard: personal preference, each core configures it by himself | 15:27 |
mgoddard | osmanlicilegi: so you are going with unpinned for ELK? | 15:27 |
yoctozepto | yeah, back to ELK | 15:27 |
osmanlicilegi | mgoddard: yes | 15:27 |
yoctozepto | please keep unpinned | 15:27 |
mgoddard | ok, makes sense | 15:27 |
mgoddard | we don't usually pin things, it's just rabbit is a little 'sensitive' | 15:27 |
mgoddard | while it's on topic, should we use bintray for rmq as well as erlang? | 15:28 |
mgoddard | at the moment we get rmq from packagecloud and erlang from bintray | 15:28 |
yoctozepto | mgoddard: or just we forgettin to unpin on time ;-) | 15:28 |
yoctozepto | hmm, weird | 15:29 |
mgoddard | https://www.rabbitmq.com/install-rpm.html | 15:29 |
yoctozepto | rmq provides both compatible | 15:29 |
osmanlicilegi | using bintray makes sense to me | 15:29 |
yoctozepto | mhm | 15:29 |
osmanlicilegi | one repo to rule 'em all | 15:30 |
yoctozepto | epel? we already ruled it out | 15:30 |
dougsz | osmanlicilegi: ELK unpinned means we will currently get 7.x ? | 15:30 |
*** bjoernt has quit IRC | 15:30 | |
yoctozepto | dougsz: good q | 15:30 |
mnasiadka | yeah, rmq is also on GitHub - but I guess erlang is missing there :) | 15:30 |
*** bjoernt has joined #openstack-kolla | 15:30 | |
osmanlicilegi | dougsz: it will be oss-6.x | 15:30 |
yoctozepto | ok | 15:31 |
dougsz | osmanlicilegi: cool, I have a patch for 7.x if we need it (both kolla and kolla ansible) | 15:31 |
yoctozepto | can we go 7.x directly? | 15:31 |
dougsz | Upgrade issues | 15:31 |
yoctozepto | and 6 is fine? | 15:31 |
yoctozepto | (ah, I remember I already asked you) | 15:31 |
osmanlicilegi | 6 is not painful | 15:31 |
dougsz | We can, but it either involves going to 6 in between, or spinning up two clusters and ingesting the old one | 15:32 |
mgoddard | 5->6 ok, 6->7 ok, 5->7 not ok | 15:32 |
yoctozepto | ah ok | 15:32 |
mgoddard | we have discussed providing both images | 15:32 |
mgoddard | elasticsearch & elasticsearch7 | 15:32 |
mgoddard | since monasca seems to want 7 | 15:33 |
osmanlicilegi | we can upgrade to 7 on v cycle | 15:33 |
mnasiadka | 6.8 is going to be eol in November 2020, so we can go from 5 to 6, and then from 6 to 7 in V | 15:33 |
osmanlicilegi | good roadmap for elk | 15:33 |
mgoddard | move on? | 15:33 |
osmanlicilegi | yep | 15:34 |
mgoddard | #topic HAProxy tag - dougsz | 15:34 |
*** openstack changes topic to "HAProxy tag - dougsz (Meeting topic: kolla)" | 15:34 | |
mgoddard | dougsz: | 15:34 |
dougsz | So in Rocky something like: kolla-ansible reconfigure -t glance | 15:34 |
dougsz | Was well scoped to Glance (and common services) | 15:35 |
dougsz | In Stein, kolla-ansible reconfigure -t glance can now restart HAProxy, iff the HAProxy config is changed | 15:35 |
dougsz | So an operation with limited scope, can now take out the whole deployment if things go badly | 15:36 |
dougsz | It seems sensible to me that we retain the old behaviour | 15:36 |
mgoddard | This changed in stein when we split haproxy config out | 15:37 |
yoctozepto | hmm | 15:37 |
yoctozepto | that looks bad indeed | 15:37 |
mgoddard | Worth pointing out that this behaviour was intentional, and part of the reason for the change | 15:38 |
*** Trevor_V has joined #openstack-kolla | 15:38 | |
mgoddard | (although mostly it was to improve haproxy config sanity) | 15:38 |
mnasiadka | yeah, but it would make sense to allow the user to specify if he wants to restart haproxy or not in the process | 15:38 |
dougsz | The main reason being to break the HAProxy config file up? | 15:38 |
yoctozepto | yeah, it makes sense to enable glance in haproxy when glance tag is called | 15:38 |
dougsz | It does, but I think the most common operation in a running deployment is to tweak service config files | 15:39 |
osmanlicilegi | maybe k-a should have an option like --restart-related-services | 15:39 |
dougsz | which rarely requires reconfiguring haproxy | 15:39 |
dougsz | So i would rather do kolla-ansible reconfigure -t glance,haproxy as an exception | 15:39 |
mgoddard | what about scaling out? | 15:39 |
kplant | osmanlicilegi: shouldn't 'reconfigure' imply that all impacted services will be restarted? | 15:39 |
mgoddard | I think there are two schools of thought | 15:40 |
dougsz | I think scaling out is likely to be less common than tweaking service config | 15:40 |
mgoddard | 1. --tags glance should only touch glance, and I understand this limitation | 15:40 |
yoctozepto | 1 is more expected I believe | 15:41 |
mgoddard | 2. --tags glance should configure glance and the things it depends on | 15:41 |
yoctozepto | 2 - is it only haproxy atm anyway? | 15:41 |
mgoddard | and the common stuff | 15:41 |
mgoddard | which has always been the case | 15:41 |
*** TrevorV has quit IRC | 15:41 | |
yoctozepto | ah yeah | 15:42 |
yoctozepto | well, it would be fine if it needed only a reload | 15:42 |
mgoddard | an option which might keep everyone happy is to add some new tags | 15:42 |
mgoddard | glance-haproxy-config | 15:42 |
mgoddard | so if you want haproxy config you do --tags glance,glance-haproxy-config | 15:42 |
yoctozepto | let me look up current docs on tags | 15:43 |
mgoddard | otherwise, just --tags glance | 15:43 |
mgoddard | or even more simple, just remove those tags for the haproxy-config imports | 15:43 |
mgoddard | --tags glance,haproxy | 15:43 |
yoctozepto | nah, no new features around | 15:43 |
*** waleedm has quit IRC | 15:44 | |
yoctozepto | yeah, that makes sense | 15:44 |
yoctozepto | and update docs accordingly | 15:44 |
dougsz | That sounds reasonable. My vote is to not implicitly reconfigure HAProxy when a service is reconfigured via tags to reduce the change of taking out the deployment | 15:44 |
mgoddard | but that would prevent just generating haproxy config for glance | 15:44 |
yoctozepto | I like my tags limited | 15:44 |
mgoddard | how so? | 15:45 |
priteau | Is it maybe time to make deploy and reconfigure tasks behave differently? deploy = implicit reconfiguration of dependencies, reconfigure = touch only services listed in tags | 15:45 |
dougsz | also sounds good ^ | 15:45 |
osmanlicilegi | +1 | 15:46 |
yoctozepto | -2, feels complicated | 15:46 |
kplant | i think that might introduce an opportunity to break things down the line and be very difficult to diagnose. if you call a reconfigure --tags svc and the scoped changes to "svc" are successful BUT the cascaded changes, which were not made, later break the deployment down the line | 15:46 |
yoctozepto | ^ | 15:47 |
mgoddard | this is the argument against using tags at all | 15:47 |
yoctozepto | for the haproxy case I think it's an overkill | 15:47 |
yoctozepto | mgoddard: yeah, but it's easier to reason when you know all your paths and not need to analyse both deploy and reconfigure | 15:48 |
yoctozepto | I'm reluctant | 15:48 |
yoctozepto | though I would accept it if proposed and looking sane | 15:48 |
yoctozepto | for the haproxy case - | 15:49 |
mgoddard | ansible conditionals and tags don't mix too well | 15:49 |
yoctozepto | can we just remove those tags from haproxy and be done? | 15:49 |
mgoddard | we could | 15:50 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: doc: fix bullets in external_ceph.rst https://review.opendev.org/704832 | 15:51 |
priteau | Another issue I noticed with the new HAProxy approach: you cannot customise your main haproxy.cfg template to refer to backends from haproxy/services.d, as haproxy is first started with just the single haproxy.cfg file | 15:51 |
mgoddard | is there ever a case where you would only want to modify haproxy config for one service? | 15:51 |
kplant | i recently had to change the balance algorithm for keystone only | 15:51 |
yoctozepto | mgoddard: when you deploy it | 15:52 |
yoctozepto | but you still end up restarting the dummy | 15:52 |
mgoddard | I mean more at deployment time | 15:52 |
mgoddard | e.g. if you want to roll out changes slowly, keystone, then glance | 15:52 |
mnasiadka | I don't think it would be a problem, if we would have --tags haproxy to generate configs for all enabled services and restart haproxy | 15:52 |
mnasiadka | although mgoddard has a case for doing it one by one :) | 15:53 |
mgoddard | I'm just worried about removing that fine grained control | 15:53 |
yoctozepto | it's far from finegrained | 15:53 |
*** Satarel has quit IRC | 15:53 | |
mgoddard | well it's more than just all haproxy | 15:53 |
yoctozepto | if you end up restarting haproxy anyways | 15:54 |
mnasiadka | whatever it is now, it seems we need to have an option to modify haproxy config for one service at a time (or choose not to) | 15:54 |
yoctozepto | which is why it's problematic in the first place | 15:54 |
yoctozepto | then it's pita more than benefit | 15:54 |
mgoddard | why is that problematic? | 15:54 |
* osmanlicilegi bbl | 15:54 | |
yoctozepto | for dougsz ? | 15:54 |
mgoddard | haproxy restart shouldn't be a problem | 15:54 |
yoctozepto | taking down the deploy | 15:54 |
yoctozepto | well, you drop connections to all the services | 15:55 |
yoctozepto | and services and mariadb | 15:55 |
mgoddard | and if you want to make fine-grained changes then its necessary | 15:55 |
mnasiadka | well, if there would be an option for real graceful reload of haproxy - we should be fine then | 15:56 |
yoctozepto | yeah | 15:56 |
yoctozepto | maybe there is | 15:56 |
mgoddard | I think it accepts SIGHUP | 15:56 |
mnasiadka | yoctozepto: there is this socket transfer reload | 15:56 |
yoctozepto | also, if we used a separate haproxy for mysql... | 15:56 |
mgoddard | maybe we should look into HUP | 15:56 |
mnasiadka | yoctozepto: well, maybe we don't need to use haproxy, I think there are more intelligent solutions for load balancing galera | 15:57 |
mnasiadka | mgoddard: here is the whole story about haproxy reloads: https://www.haproxy.com/blog/truly-seamless-reloads-with-haproxy-no-more-hacks/ | 15:57 |
mgoddard | ok | 15:58 |
mgoddard | we have 2 mins | 15:58 |
mgoddard | not sure we have consensus | 15:59 |
mgoddard | but let's move on | 15:59 |
dougsz | It looks like there is also a check mode which can validate the config - not sure if it will catch everything | 15:59 |
mgoddard | well we have consensus to change current behaviour at least | 15:59 |
mgoddard | #topic Ussuri goal: https://governance.openstack.org/tc/goals/selected/ussuri/project-ptl-and-contrib-docs.html | 15:59 |
*** openstack changes topic to "Ussuri goal: https://governance.openstack.org/tc/goals/selected/ussuri/project-ptl-and-contrib-docs.html (Meeting topic: kolla)" | 15:59 | |
mgoddard | Before we leave, there is a 2nd ussuri cross-project goal | 16:00 |
mgoddard | per-project PTL and contributor docs | 16:00 |
mgoddard | we have some, we could have more | 16:00 |
mgoddard | Anyone want to take this on? | 16:00 |
mnasiadka | maybe some fresh contributor could look up the docs and think about what can be improved? | 16:01 |
mnasiadka | I don't have a problem in writing something there, but I need to have somebody with a fresh mindset tell us what's missing :) | 16:01 |
mgoddard | it would be nice if we had docs for contributors, cores and PTL | 16:01 |
mgoddard | osmanlicilegi is the most recent core, but he left | 16:02 |
mnasiadka | if everybody could spent a couple of minutes and add to the Ideas section of the whiteboard what could be improved there - it's a start | 16:02 |
mgoddard | (the meeting) | 16:02 |
mgoddard | where have these ideas come from? | 16:03 |
mnasiadka | from mine and yoctozepto's heads - blame us :) | 16:03 |
*** pbing19 has joined #openstack-kolla | 16:03 | |
mgoddard | we do not have ideas here. we do as we are told | 16:04 |
mgoddard | I moved them below kayobe feature status | 16:04 |
yoctozepto | mgoddard: :< | 16:04 |
mgoddard | Seems like a good plan to line up things that are not yet priorities but could be in future | 16:04 |
mgoddard | Or just other things we might want to do | 16:05 |
*** iputra has quit IRC | 16:05 | |
mgoddard | #action mnasiadka to herd cats for contributor guide goal | 16:06 |
mgoddard | cryptic action | 16:06 |
mnasiadka | oh crap, let it be | 16:06 |
mgoddard | anyway, we're over time | 16:06 |
mnasiadka | I'll chase osmanlicilegi | 16:06 |
mgoddard | thanks all | 16:06 |
yoctozepto | xD | 16:06 |
mgoddard | #endmeeting | 16:06 |
*** openstack changes topic to "Kolla IRC meetings on Wednesdays @ 15:00 UTC - see agenda @ https://goo.gl/OXB0DL | Whiteboard: https://etherpad.openstack.org/p/KollaWhiteBoard | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b" | 16:06 | |
openstack | Meeting ended Wed Jan 29 16:06:30 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:06 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-01-29-15.00.html | 16:06 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-01-29-15.00.txt | 16:06 |
openstack | Log: http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-01-29-15.00.log.html | 16:06 |
*** billp has joined #openstack-kolla | 16:07 | |
mnasiadka | yoctozepto: did we follow up with tripleo to deprecate ODL image in Kolla (since they stopped supporting ODL deployments)? | 16:09 |
yoctozepto | mnasiadka: not remember | 16:10 |
yoctozepto | probably not | 16:10 |
openstackgerrit | Mark Goddard proposed openstack/kayobe stable/rocky: Fix multiple CI failures https://review.opendev.org/704774 | 16:11 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: doc: fix bullets in external_ceph.rst https://review.opendev.org/704832 | 16:14 |
yoctozepto | mgoddard: you were running kayobe with master k-a | 16:19 |
yoctozepto | good lord | 16:19 |
mgoddard | yoctozepto: only in 'unit tests' for ansible roles | 16:20 |
yoctozepto | mgoddard: still scary | 16:20 |
mgoddard | and then it was only minimally using k-a to generate passwords | 16:20 |
yoctozepto | glad you have tests though ;p | 16:20 |
*** numans has quit IRC | 16:28 | |
*** ktibi has quit IRC | 16:29 | |
*** ktibi has joined #openstack-kolla | 16:30 | |
cosmicsound | ?resolve_outputs=False&resolve_outputs=False why would be the need for same values? | 16:32 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Deprecate Opendaylight https://review.opendev.org/704838 | 16:34 |
mnasiadka | yoctozepto, mgoddard: ^^ | 16:34 |
mgoddard | boom | 16:35 |
yoctozepto | cosmicsound: huh? | 16:36 |
yoctozepto | mnasiadka: +3 | 16:37 |
*** bengates has quit IRC | 16:37 | |
openstackgerrit | Merged openstack/kolla-ansible master: doc: fix bullets in external_ceph.rst https://review.opendev.org/704832 | 16:38 |
mnasiadka | mgoddard: do we want to wait for removal in V? we build ODL Carbon, which is like 5 releases back compared to current release | 16:40 |
yoctozepto | mnasiadka: odl deserves a fast drop indeed | 16:41 |
yoctozepto | especially being n/a in c8 | 16:41 |
*** luksky has quit IRC | 16:42 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Deprecate OpenDaylight https://review.opendev.org/704838 | 16:44 |
mgoddard | mnasiadka: does it hurt us to do a slow drop? | 16:46 |
mgoddard | if we ignore c8 | 16:47 |
yoctozepto | mgoddard: apart from wasting resources and still getting occasional failures on ussuri :-) | 16:47 |
yoctozepto | none | 16:47 |
yoctozepto | :D | 16:47 |
mgoddard | it's just polite | 16:47 |
mgoddard | I guess I don't care too much | 16:47 |
*** tumble has joined #openstack-kolla | 16:50 | |
cosmicsound | yoctozepto , haproxy has that in its requests it seems | 16:52 |
yoctozepto | cosmicsound: to where? | 16:53 |
*** dking_desktop has joined #openstack-kolla | 16:53 | |
cosmicsound | heat_api | 16:54 |
cosmicsound | its related to debuging that missing magnum logs in kibana | 16:54 |
cosmicsound | Jan 29 17:26:46 haproxy[45]: 172.22.100.10:33848 [29/Jan/2020:17:26:46.932] heat_api heat_api/sc 0/0/0/35/35 200 6836 - - ---- 188/1/0/1/0 0/0 "GET /v1/fa1b477c2f0c4bbfa6f82f45980fc317/stacks/kubernetes-4w4sxj4ye7ro/b233374c-a904-475d-8ea6-818dc7d10666?resolve_outputs=False&resolve_outputs=False HTTP/1.1" | 16:55 |
cosmicsound | This is how it looks | 16:55 |
yoctozepto | ah, heat | 16:56 |
tumble | hello guys. I'm struggling with "ERROR neutron.agent.rpc RemoteError: Remote error: InvalidTargetVersion Invalid target version 1.5". Any idea what I could do solve this mismatch? I'm actually running a kolla-ansible cluster which is why I don't really get how I ended up with a version mismatch | 16:56 |
yoctozepto | from magnum I presume? | 16:56 |
*** ktibi has quit IRC | 16:57 | |
*** ktibi has joined #openstack-kolla | 16:57 | |
cosmicsound | yep | 16:59 |
mnasiadka | mgoddard: as long as the repo will not disappear again we will be fine :) | 17:01 |
*** ktibi has quit IRC | 17:04 | |
openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Allow SSH access to keystone_ssh container https://review.opendev.org/704848 | 17:06 |
*** ktibi has joined #openstack-kolla | 17:06 | |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: WIP: CentOS 8: Add deploy jobs in CI https://review.opendev.org/693544 | 17:06 |
yoctozepto | cosmicsound: then it's magnum doing it | 17:13 |
*** rlljorge has joined #openstack-kolla | 17:16 | |
rlljorge | Hello there, someone running train version with ceph, Can confirm if the cinder restore from snapshot backups are ok ? | 17:17 |
*** rlljorge has left #openstack-kolla | 17:20 | |
*** rlljorge has joined #openstack-kolla | 17:20 | |
mgoddard | stable releases proposed: https://review.opendev.org/704849 | 17:20 |
patchbot | patch 704849 - releases - Release kolla and kolla-ansible stable branches - 2 patch sets | 17:20 |
*** vmixor has joined #openstack-kolla | 17:29 | |
*** rpittau is now known as rpittau|afk | 17:33 | |
*** gfidente is now known as gfidente|afk | 17:38 | |
*** dougsz has quit IRC | 17:57 | |
*** luksky has joined #openstack-kolla | 18:09 | |
*** waleedm has joined #openstack-kolla | 18:09 | |
*** tonythomas has quit IRC | 18:10 | |
*** negronjl has quit IRC | 18:18 | |
*** negronjl has joined #openstack-kolla | 18:21 | |
hrw | re | 18:28 |
hrw | went quickly through meeting notes | 18:28 |
hrw | cloudnull: how tripleo looks with move to c8? you wait for the same stuff as we do iirc. so no way to get s/7/8 in tripleo job until c8 is ready for it, right? | 18:30 |
hrw | osmanlicilegi, mgoddard, yoctozepto: we can grab rmq and erlang from RDO iirc. | 18:30 |
cloudnull | hrw ++ we're ready to move, but c8 is just not ready yet. | 18:32 |
cloudnull | so, when will then be now? | 18:32 |
cloudnull | soon. | 18:32 |
cloudnull | :D | 18:32 |
*** priteau has quit IRC | 18:33 | |
hrw | ;D | 18:33 |
*** benj_ has quit IRC | 18:47 | |
*** benj_ has joined #openstack-kolla | 18:47 | |
*** vmixor has quit IRC | 18:50 | |
*** jonaspaulo has quit IRC | 18:52 | |
dking_desktop | Could anybody give me some tips on troubleshooting a baremetal introspection timeout. I'm not really seeing anything useful in ironic-inspector.log. I'm not entirely sure how introspection works, but I can see that using IPMI, when I start introspection, it is successfully able to reboot the server. | 18:55 |
kplant | yeah, can you edit the image used for introspection and add a plaintext password for root? | 18:58 |
kplant | that way you can actually pop into the server via ipmi and look around | 18:58 |
kplant | and not just watch it boot | 18:58 |
*** igordc has joined #openstack-kolla | 19:02 | |
*** rlljorge has quit IRC | 19:14 | |
*** oyrogerg has quit IRC | 19:14 | |
*** pbing19 has quit IRC | 19:18 | |
*** pbing19 has joined #openstack-kolla | 19:18 | |
*** waleedm has quit IRC | 19:23 | |
*** waleedm has joined #openstack-kolla | 19:23 | |
*** gmann is now known as gmann_afk | 19:57 | |
dking_desktop | kplant: Sorry, I didn't notice that there was a reply. Actually, the server still has an old OS on it, and I can reach it with KVM. I see that it rebooted, but it booted back into the old OS, and then nothing further. | 20:01 |
kplant | right, what i mean is edit the image that's used for introspection | 20:01 |
*** ktibi has quit IRC | 20:01 | |
kplant | so after it PXEs you can log into that image | 20:01 |
kplant | and poke around the logs on the baremetal machine | 20:01 |
kplant | ironic calls for the node to pxe, it feeds it an image and waits for that image to collect introspection data and shoot it back to the ironic api | 20:02 |
kplant | if it's not communicating back with ironic, you're not going to see anything on your conductor logs | 20:02 |
dking_desktop | That's helpful. So, perhaps it never got it to boot the PXE image. That sounds likely, since I'm still trying to figure out the networking. | 20:03 |
dking_desktop | I believe that the PXE image is served over a different network? | 20:04 |
kplant | it would be whatever network ironic is using for provisioning | 20:04 |
*** waleedm_ has joined #openstack-kolla | 20:07 | |
*** waleedm has quit IRC | 20:07 | |
dking_desktop | That makes sense. I'm going to look at that further. Thanks for the suggestion. | 20:09 |
kplant | np. if you're not seeing the machine(s) pxe boot | 20:09 |
*** waleedm__ has joined #openstack-kolla | 20:09 | |
kplant | i would look at the network with tcpdump and see if you see the machine soliciting for BOOTP/DHCP | 20:09 |
kplant | that would be the first step of pxe | 20:09 |
kplant | bootp/dhcp -> tftp/http(s) spam | 20:09 |
yoctozepto | and: is it configured to boot via pxe | 20:11 |
*** waleedm_ has quit IRC | 20:12 | |
yoctozepto | ipmi may fail to set boot method | 20:12 |
yoctozepto | or set it to wrong cards | 20:12 |
yoctozepto | cards=NICs | 20:12 |
dking_desktop | kplant: Thanks. I'll look at that | 20:12 |
dking_desktop | yoctozepto: It's set to boot_interface=pxe | 20:13 |
dking_desktop | Well, it has that and no-bios | 20:13 |
dking_desktop | I also attempted to set a port with the MAC address, as per the article. | 20:14 |
dking_desktop | I'm thinking it's the provisioning network, as I don't think I set that up properly. | 20:15 |
yoctozepto | it most likely needs to be the untagged network | 20:16 |
yoctozepto | connected to host | 20:16 |
kplant | ^ | 20:16 |
kplant | and if your nics do support vlan tagging for pxe... still go with untagged | 20:16 |
kplant | because it will be transparent to the OS and that's a nightmare | 20:16 |
yoctozepto | xD | 20:16 |
*** waleedm__ has quit IRC | 20:16 | |
yoctozepto | kplant: yeah, I believe ironic would fail that | 20:17 |
yoctozepto | one would need custom setup to support this switch from preboot to boot | 20:17 |
yoctozepto | as boot suddenly wants untagged | 20:17 |
kplant | yeah for sure | 20:18 |
kplant | during pxe it would think the network was untagged and then... surprise | 20:18 |
*** rlljorge has joined #openstack-kolla | 20:18 | |
dking_desktop | Everything on the control node uses a VLAN. Only the BMC network is accessible outside of a VLAN. | 20:20 |
kplant | the node that you're trying to use in ironic, the provisioning network should be native | 20:21 |
dking_desktop | That might be an issue. | 20:24 |
yoctozepto | yeah, it's always some vlan | 20:35 |
yoctozepto | depending on terminology it might be native, default or untagged | 20:36 |
*** kplant has quit IRC | 20:55 | |
*** rlljorge has quit IRC | 21:07 | |
*** pbing19 has quit IRC | 21:10 | |
*** gmann_afk is now known as gmann | 21:17 | |
*** dking_desktop has quit IRC | 21:41 | |
*** gfidente|afk is now known as gfidente | 21:46 | |
*** k_mouza has joined #openstack-kolla | 22:15 | |
*** k_mouza has quit IRC | 22:19 | |
*** Trevor_V has quit IRC | 22:31 | |
*** ktibi has joined #openstack-kolla | 22:52 | |
*** ktibi has quit IRC | 22:57 | |
*** gfidente has quit IRC | 23:33 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!