*** jhebden has joined #tripleo | 00:02 | |
*** jcoufal has quit IRC | 00:03 | |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
---|---|---|
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 00:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 00:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 00:10 |
*** agopi__ is now known as agopi | 00:12 | |
*** jcoufal has joined #tripleo | 00:15 | |
*** spartakos has quit IRC | 00:19 | |
*** dtrainor has joined #tripleo | 00:22 | |
*** jcoufal has quit IRC | 00:24 | |
*** sai_p has quit IRC | 00:28 | |
*** tristanC has quit IRC | 00:33 | |
*** tristanC has joined #tripleo | 00:33 | |
*** rlandy|afk has quit IRC | 00:35 | |
*** codrcodz has joined #tripleo | 00:42 | |
*** codrcodz has quit IRC | 00:50 | |
*** jtomasek has joined #tripleo | 01:03 | |
*** jtomasek has quit IRC | 01:07 | |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 01:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 01:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 01:10 |
*** huynq has joined #tripleo | 01:14 | |
*** dtrainor has quit IRC | 01:18 | |
*** mrsoul has quit IRC | 01:20 | |
*** codrcodz has joined #tripleo | 01:22 | |
*** thrash is now known as thrash|g0ne | 01:30 | |
*** huynq has quit IRC | 01:50 | |
*** huynq has joined #tripleo | 01:56 | |
*** codrcodz has quit IRC | 02:01 | |
*** jtomasek has joined #tripleo | 02:02 | |
*** jtomasek has quit IRC | 02:07 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 02:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 02:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 02:10 |
*** lblanchard has quit IRC | 02:40 | |
*** ramishra has joined #tripleo | 02:45 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 03:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 03:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 03:10 |
*** udesale has joined #tripleo | 03:14 | |
*** shyamb has joined #tripleo | 03:45 | |
shyamb | Hi | 04:01 |
*** ykarel|away has joined #tripleo | 04:02 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 04:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 04:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 04:10 |
*** shyamb has quit IRC | 04:22 | |
*** shyamb has joined #tripleo | 04:22 | |
*** saneax has joined #tripleo | 04:35 | |
*** Petersingh has joined #tripleo | 04:42 | |
Tengu | hello there | 05:01 |
*** Petersingh is now known as Petersingh|afk | 05:05 | |
*** udesale has quit IRC | 05:09 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 05:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 05:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 05:10 |
*** shyamb has quit IRC | 05:11 | |
*** shyamb has joined #tripleo | 05:11 | |
*** udesale has joined #tripleo | 05:15 | |
*** iranzo has joined #tripleo | 05:23 | |
*** ykarel|away is now known as ykarel | 05:23 | |
*** shyamb has quit IRC | 05:26 | |
*** sai_p has joined #tripleo | 05:35 | |
*** Petersingh|afk is now known as Petersingh | 05:43 | |
*** jfrancoa has joined #tripleo | 05:48 | |
*** quiquell|off is now known as quiquell | 05:49 | |
*** iranzo has quit IRC | 05:49 | |
*** udesale has quit IRC | 05:53 | |
*** shyamb has joined #tripleo | 05:53 | |
*** mschuppert has joined #tripleo | 05:55 | |
shyamb | Hi | 05:56 |
shyamb | Tengu: Can I use two kvm servers to deploy overcloud on vms? | 05:57 |
shyamb | I meant some overcloud nodes will be on kvm0 and some nodes will be on kvm1, is it possible? | 05:57 |
Tengu | shyamb: as long as you have a working network between the two nodes and a working virtualbmc for the "fake IPMI", I don't see any cons. | 05:58 |
*** udesale has joined #tripleo | 05:58 | |
shyamb | hmm, ok | 05:58 |
shyamb | Tengu: Thanks | 05:59 |
shyamb | I need try it | 05:59 |
*** ksambor has joined #tripleo | 05:59 | |
shyamb | I doubt about PXE boot only | 05:59 |
*** agurenko has joined #tripleo | 06:04 | |
*** jtomasek has joined #tripleo | 06:05 | |
*** ratailor has joined #tripleo | 06:06 | |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 06:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 06:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 06:10 |
*** iurygregory has joined #tripleo | 06:15 | |
hjensas | shyamb: either ensure both kvm hosts are on the same L2 network and DHCP should be fine. | 06:20 |
*** dciabrin has joined #tripleo | 06:21 | |
shyamb | hjensas: ok, thanks | 06:21 |
hjensas | shyamb: If you cannot have them on the same L2 network you can deploy a dhcp-relay server on the kvm host not running the undercloud and deploy a routed-spine-and-leaf architecture. | 06:21 |
*** holser_ has joined #tripleo | 06:21 | |
shyamb | ok | 06:22 |
shyamb | will try first approach | 06:22 |
*** florianf|afk is now known as florianf | 06:26 | |
*** moshele has joined #tripleo | 06:30 | |
*** yprokule has joined #tripleo | 06:33 | |
*** cylopez has joined #tripleo | 06:34 | |
*** cylopez has left #tripleo | 06:35 | |
mschuppert | jaosorior: morning! could you +w https://review.openstack.org/594145 ? | 06:38 |
*** rcernin has quit IRC | 06:38 | |
*** moshele has quit IRC | 06:38 | |
*** rcernin has joined #tripleo | 06:38 | |
*** shyamb has quit IRC | 06:38 | |
*** pcaruana has joined #tripleo | 06:40 | |
*** shyamb has joined #tripleo | 06:44 | |
*** Petersingh is now known as Petersingh|afk | 06:56 | |
*** slaweq has joined #tripleo | 06:57 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 07:10 |
openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 07:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 07:10 |
*** rcernin has quit IRC | 07:10 | |
*** bogdando has joined #tripleo | 07:11 | |
*** Petersingh|afk is now known as Petersingh | 07:20 | |
*** aufi has joined #tripleo | 07:23 | |
*** skramaja has joined #tripleo | 07:23 | |
*** ykarel_ has joined #tripleo | 07:24 | |
*** ykarel has quit IRC | 07:26 | |
*** shardy has joined #tripleo | 07:26 | |
*** ykarel__ has joined #tripleo | 07:28 | |
*** ykarel_ has quit IRC | 07:30 | |
*** udesale has quit IRC | 07:30 | |
*** shyamb has quit IRC | 07:38 | |
*** Petersingh is now known as Petersingh|lunch | 07:38 | |
*** shyamb has joined #tripleo | 07:38 | |
*** ykarel_ has joined #tripleo | 07:41 | |
*** ykarel__ has quit IRC | 07:44 | |
*** tosky has joined #tripleo | 07:45 | |
*** ykarel__ has joined #tripleo | 07:46 | |
*** ykarel__ is now known as ykarel | 07:46 | |
*** ykarel has quit IRC | 07:47 | |
*** ykarel_ has quit IRC | 07:48 | |
*** yprokule has quit IRC | 07:51 | |
*** yprokule has joined #tripleo | 07:51 | |
*** udesale has joined #tripleo | 07:53 | |
*** jpena|off is now known as jpena | 07:53 | |
*** ykarel has joined #tripleo | 07:54 | |
*** pcaruana has quit IRC | 07:55 | |
*** amoralej|off is now known as amoralej | 07:55 | |
*** pcaruana has joined #tripleo | 07:57 | |
*** shyamb has quit IRC | 07:59 | |
*** rdopiera has joined #tripleo | 08:00 | |
*** chem has joined #tripleo | 08:02 | |
Tengu | jaosorior: standalone with podman+selinux: done. | 08:04 |
Tengu | jaosorior: I'm surprised, it was unexpectedly easy to do, compared to the undercloud :D | 08:04 |
Tengu | jaosorior: https://review.openstack.org/#/c/607557/ #enjoy :) | 08:10 |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 08:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 08:10 |
*** akrivoka has joined #tripleo | 08:10 | |
*** ykarel_ has joined #tripleo | 08:12 | |
jaosorior | Tengu: you're on fire man! | 08:13 |
*** derekh has joined #tripleo | 08:13 | |
Tengu | jaosorior: well, I'm still surprised. but apparently, it actualy DOES work as it should. I'll do the same for a standalone with ceph. | 08:14 |
Tengu | guess that one will be nastier. | 08:14 |
*** ykarel has quit IRC | 08:15 | |
Tengu | jaosorior: that said, some stuff for the nova containers aren't really nice I think - disabled labels + privileged is kind of... unsecure. | 08:16 |
Tengu | jaosorior: not sure if we can do better on that. | 08:16 |
Tengu | maybe using the "capabilities" instead of privileged? | 08:16 |
Tengu | enabling labels isn't an option due to the affected host directories (/etc and the like). | 08:16 |
jaosorior | Tengu: yeah, that would be the next step, replace privileged containers with capabilities profiles | 08:17 |
Tengu | jaosorior: I think docker has the same flags available right? | 08:18 |
*** ykarel__ has joined #tripleo | 08:20 | |
*** paramite|clone has joined #tripleo | 08:21 | |
*** ykarel_ has quit IRC | 08:23 | |
*** ykarel_ has joined #tripleo | 08:23 | |
*** sai_p has quit IRC | 08:24 | |
d0ugal | weshay, sshnaidm, marios|rover: Sorry, I wasn't well yesterday. Let me know if I can help with Mistral issues today! | 08:24 |
*** gfidente has joined #tripleo | 08:25 | |
*** ykarel__ has quit IRC | 08:26 | |
d0ugal | Reading the bug now anyway... | 08:26 |
gfidente | marios I am not sure how about yojfulness today but this is just the backport to rocky https://review.openstack.org/#/c/607652/ | 08:27 |
marios | d0ugal: ack thanks seems like its more on the ironic side so far thrash also checked it out | 08:27 |
gfidente | jistr go go go https://review.openstack.org/#/c/607588/ | 08:28 |
jistr | gfidente: yea thanks :) | 08:28 |
*** gkadam has joined #tripleo | 08:30 | |
*** gkadam has quit IRC | 08:31 | |
d0ugal | marios: okay, cool. I'll take a quick look anyway and comment if I have anything to add. | 08:37 |
*** Petersingh|lunch is now known as Petersingh | 08:40 | |
marios | thanks d0ugal | 08:42 |
sshnaidm | d0ugal, thanks, I think toure started the investigation, let's talk to him later when he's online | 08:43 |
*** panda|off is now known as panda | 08:44 | |
bogdando | owalsh: hi, around? PTAL https://review.openstack.org/#/c/607557 | 08:45 |
*** ykarel__ has joined #tripleo | 08:45 | |
*** udesale has quit IRC | 08:46 | |
*** shyamb has joined #tripleo | 08:46 | |
*** ykarel_ has quit IRC | 08:48 | |
*** ykarel_ has joined #tripleo | 08:49 | |
*** udesale has joined #tripleo | 08:49 | |
jaosorior | Tengu: AFAIK, for capabilities it's a bit different. We need to provide a separate capabilities list. | 08:49 |
jaosorior | which would be a json file | 08:50 |
*** ykarel__ has quit IRC | 08:51 | |
owalsh | bogdando: hey, /me looks | 09:01 |
*** ykarel_ has quit IRC | 09:07 | |
*** ykarel_ has joined #tripleo | 09:07 | |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 09:10 |
*** ykarel__ has joined #tripleo | 09:10 | |
*** ykarel_ has quit IRC | 09:13 | |
Tengu | owalsh bogdando jaosorior thanks for your feedback on that change :). | 09:17 |
Tengu | it's not yet finished, have a couple of issues with the "ceph" in standalone (for now I did a simple, without ceph deploy) | 09:18 |
*** ykarel has joined #tripleo | 09:18 | |
*** ykarel__ has quit IRC | 09:19 | |
*** salmankhan has joined #tripleo | 09:24 | |
akrivoka | how do I access overcloud nodes after a oooq run? stuff from https://docs.openstack.org/tripleo-quickstart/latest/accessing-overcloud.html doesn't work - I have no overcloud hosts listed in the ssh.config.ansible file and nova list returns empty | 09:25 |
*** shyamb has quit IRC | 09:29 | |
*** shyamb has joined #tripleo | 09:30 | |
*** ykarel has quit IRC | 09:32 | |
*** ykarel has joined #tripleo | 09:32 | |
*** paramite|clone has quit IRC | 09:35 | |
*** ykarel_ has joined #tripleo | 09:35 | |
*** ykarel has quit IRC | 09:38 | |
*** shyamb has quit IRC | 09:40 | |
*** ykarel_ is now known as ykarel | 09:43 | |
*** paramite has joined #tripleo | 09:54 | |
*** dtantsur|afk is now known as dtantsur | 09:55 | |
jistr | chem, matbu, jfrancoa: hmm we're not running all deploy steps in upgrade it seems? | 09:58 |
jistr | https://github.com/openstack/tripleo-heat-templates/blob/master/common/deploy-steps.j2#L636 | 09:58 |
jistr | intention or bug? | 09:58 |
jistr | looks like we have two uses of what '_max' in the variable names means | 09:59 |
*** moshele has joined #tripleo | 09:59 | |
jistr | deploy tasks use the _max variables as "last step", while update/upgrade tasks use the _max variables as "number of steps", and given that we start from 0 for the update tasks, this creates some confusion | 10:00 |
jistr | chem, matbu, jfrancoa: the deploy_steps_max usage in the link is likely incorrect but i'm not sure... will investigate it further and probably redo the update/upgrade steps conventions to match the deploy steps conventions | 10:01 |
jistr | so that we always iterate to _max in all tasks, and not somewhere to _max and in other places to _max-1 | 10:01 |
chem | jistr: I think it's the correct idiom | 10:01 |
chem | jistr: we have 5 steps max I believe | 10:01 |
chem | jistr: in puppet tripleo nothing comes at step >= 6 | 10:02 |
jistr | chem: ah i thought the range function would generate inclusive range on the top side https://github.com/openstack/tripleo-heat-templates/blob/master/common/deploy-steps.j2#L104 | 10:02 |
jistr | which confused me | 10:02 |
* jistr double checks jinja docs | 10:02 | |
chem | jistr: I remember having the same doubt a while ago but it was cleared somehow | 10:03 |
*** paramite has quit IRC | 10:03 | |
jistr | chem, matbu, jfrancoa: indeed range(1,6) generates numbers 1..5 | 10:03 |
*** paramite has joined #tripleo | 10:03 | |
jistr | so all's ok, sorry for the noise :) | 10:04 |
jistr | thanks chem | 10:04 |
*** udesale has quit IRC | 10:04 | |
chem | jistr: pretty sure I have an old abandonned patch where I had excatly the same doubt :) | 10:05 |
jistr | haha :) | 10:05 |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 10:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1793665 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1793665 in tripleo "Jobs fails on validate-tempest: Unexpected response code received" [Critical,Triaged] | 10:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 10:10 |
*** udesale has joined #tripleo | 10:13 | |
ykarel | akrivoka, is overcloud installed? i guess u have not passed --tags all during installation from oooq | 10:15 |
akrivoka | ykarel: how can I tell if the overcloud was installed? the oooq run finished successfully | 10:16 |
ykarel | akrivoka, check logs | 10:17 |
akrivoka | ykarel: this is the command I ran: bash quickstart.sh --clean --teardown all --no-clone --release master $VIRTHOST | 10:17 |
ykarel | akrivoka, ^^ no --tags all in this | 10:17 |
ykarel | so it will just install undercloud and will create all required scripts to install overcloud | 10:17 |
ykarel | akrivoka, so if u login to undercloud, u can see that /home/stack/overcloud-deploy.sh exists there | 10:18 |
ykarel | u can simply run that to install overcloud | 10:18 |
Tengu | :) I have the same kind of trick for my tripleo-lab | 10:18 |
akrivoka | ykarel: oh I see | 10:18 |
akrivoka | ykarel: thanks | 10:18 |
akrivoka | would be nice to have that info in docs, https://docs.openstack.org/tripleo-quickstart/latest/devmode.html currently points to a broken link... | 10:19 |
ykarel | akrivoka, u can propose a patch to fix that here: https://raw.githubusercontent.com/openstack/tripleo-quickstart/master/doc/source/devmode.rst | 10:21 |
ykarel | just need to adjust the text there | 10:22 |
jaosorior | bandini: so, this works then https://review.openstack.org/#/c/607343/3 ? | 10:25 |
bandini | jaosorior: so yes mschuppert and I tested that. I'll dig into the CI failures after lunch | 10:26 |
*** shyamb has joined #tripleo | 10:27 | |
*** skramaja_ has joined #tripleo | 10:35 | |
*** skramaja has quit IRC | 10:36 | |
*** kopecmartin|ruck is now known as kopecmartin|scho | 10:38 | |
*** slaweq_ has joined #tripleo | 10:38 | |
*** shyamb has quit IRC | 10:38 | |
*** shyamb has joined #tripleo | 10:38 | |
*** udesale has quit IRC | 10:39 | |
*** udesale has joined #tripleo | 10:40 | |
*** slaweq has quit IRC | 10:40 | |
*** paramite has quit IRC | 10:55 | |
*** slaweq__ has joined #tripleo | 10:56 | |
*** slaweq_ has quit IRC | 10:57 | |
*** pcaruana has quit IRC | 11:02 | |
*** pcaruana has joined #tripleo | 11:02 | |
*** jpena is now known as jpena|lunch | 11:03 | |
*** amoralej is now known as amoralej|lunch | 11:03 | |
*** janki has joined #tripleo | 11:06 | |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1793665 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 11:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1793665 in tripleo "multinode-oooq-container scenarios and Fs016/17/20 periodic jobs fails on validate-tempest: Unexpected response code received" [Critical,Triaged] | 11:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 11:10 |
janki | EmilienM, hey | 11:20 |
mandre | trown|outtypewww: good morning, when you have time can you uploadthe etcd image from the fedora registry to the tripleorocky namespace on the dockerhub? the same one we uploaded to tripleomaster should do | 11:21 |
*** paramite has joined #tripleo | 11:21 | |
mandre | trown|outtypewww: the missing image is the current issue for why our backports fail scenario009 -> http://logs.openstack.org/95/607195/1/check/tripleo-ci-centos-7-scenario009-multinode-oooq/3b9034f/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz | 11:23 |
*** aufi has quit IRC | 11:23 | |
*** Petersingh is now known as Petersingh|afk | 11:24 | |
*** pvc has joined #tripleo | 11:25 | |
pvc | hi guys | 11:25 |
pvc | anyone help me with overcloud. im using baremetal servers with vlan networking | 11:25 |
*** raildo has joined #tripleo | 11:41 | |
*** iranzo has joined #tripleo | 11:43 | |
*** shyamb has quit IRC | 11:44 | |
*** asbishop has joined #tripleo | 11:45 | |
*** shyam89 has joined #tripleo | 11:45 | |
*** dprince has joined #tripleo | 11:45 | |
*** slagle has quit IRC | 11:51 | |
pvc | hi mandre can you help me | 11:53 |
gfidente | love for a backport https://review.openstack.org/#/c/607840/ ? :D | 11:59 |
*** morazi has joined #tripleo | 11:59 | |
mandre | pvc: did you solve the problem with your node not getting an address? | 12:00 |
*** lblanchard has joined #tripleo | 12:02 | |
pvc | for now im using a bond-with-vlans | 12:04 |
*** rh-jelabarre has joined #tripleo | 12:04 | |
pvc | i will introspect my overcloud wait | 12:04 |
*** jpena|lunch is now known as jpena | 12:04 | |
pvc | it can get an ip address mandre but it cannot up the interface. But when i do ifup <interface name> it have an ip address | 12:04 |
*** jcoufal has joined #tripleo | 12:04 | |
mandre | pvc: I do not know what your problem is :( | 12:05 |
*** med_ has joined #tripleo | 12:08 | |
weshay | marios, hey.. re: https://bugs.launchpad.net/tripleo/+bug/1793665 | 12:10 |
openstack | Launchpad bug 1793665 in tripleo "multinode-oooq-container scenarios and Fs016/17/20 periodic jobs fails on validate-tempest: Unexpected response code received" [Critical,Triaged] | 12:10 |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 12:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1793665 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 12:10 |
weshay | marios, the tempest tests in those jobs are generally understood to be the bare min for coverage | 12:10 |
*** huynq has quit IRC | 12:10 | |
weshay | unlike something like fs20 | 12:10 |
weshay | marios, so let's look which tests are failing and run it by ptl's | 12:11 |
*** Petersingh|afk is now known as Petersingh | 12:11 | |
*** thrash|g0ne is now known as thrash | 12:11 | |
weshay | marios, fyi.. this snip does not offer any insight http://logs.openstack.org/81/602681/3/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/16ad793/job-output.txt.gz#_2018-10-04_06_46_01_156650 | 12:12 |
weshay | better to link to the tempest html | 12:12 |
honza | jtomasek: so many tiny patches! i love it | 12:12 |
*** trown|outtypewww is now known as trown | 12:13 | |
weshay | arxcruz, kopecmartin|scho I'm looking at tempest failures that do not have tempest.html or stackwiz | 12:13 |
weshay | http://logs.openstack.org/81/602681/3/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/16ad793/logs/undercloud/home/zuul/tempest.log.txt.gz | 12:13 |
marios|rover | weshay: ack will dig some more after this call | 12:13 |
arxcruz | weshay: https://tree.taiga.io/project/tripleo-ci-board/issue/77?kanban-status=2027734 | 12:13 |
weshay | arxcruz++ | 12:14 |
*** rfolco has joined #tripleo | 12:14 | |
trown | mandre: sure thing I will do that this morning... did you see my patch for the atomic install issue? We have passing CI on the OSA container patch with that! | 12:15 |
kopecmartin|scho | weshay, great, we should make sure, that it's expected to fail there .. maybe the failure is ignored because it may fail , i don't know | 12:15 |
trown | mandre: do you have an etherpad with all the patches on it? I would like to bug shardy to try to get everything merged up to the containerized patch... Then maybe we should try 3.11? | 12:16 |
mandre | trown: yeah that's awesome! time to merge all-the-things | 12:17 |
mandre | trown: https://etherpad.openstack.org/p/tripleo-openshift-patches for the list of patches | 12:17 |
pvc | hi mandre how can i successfully clean the overcloud failed deploy ? | 12:18 |
pvc | it seems it have caching on their side mandre | 12:18 |
*** rlandy has joined #tripleo | 12:18 | |
honza | arxcruz: what timezone are you in? | 12:19 |
arxcruz | honza: berlin | 12:19 |
mandre | pvc: "openstack stack delete overcloud --wait" should do it | 12:19 |
mandre | pvc: this will tear down the provisioned nodes and remove the stack | 12:20 |
pvc | stack already deleted | 12:20 |
pvc | but it seems its already have the prev config | 12:20 |
mandre | then you're good to go with a new deployment | 12:20 |
pvc | but ipxe not working and one node booting on tftp one booting for httpboot | 12:21 |
weshay | marios|rover, https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/2ffd88c/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-10-04_02_15_46 | 12:21 |
honza | arxcruz: i was wondering if you could help me figure out how to iterate on tempest tests for tripleo-ui --- my understanding is that all the tempest plugins are packaged in rdo, then packaged together into openstack-tempest-all, and then installed in the tempest docker image | 12:22 |
Tengu | o_O apparently gate kills jobs or something? a change is being re-queued for the 3rd time now :(. | 12:22 |
marios|rover | weshay: ack thanks. so other than that, also some infra issues on ovb jobs filed https://bugs.launchpad.net/tripleo/+bug/1796069 and me kopecmartin|scho have updated https://review.rdoproject.org/etherpad/p/ruckrover-sprint20 with those fyi | 12:22 |
openstack | Launchpad bug 1796069 in tripleo "OVB jobs are failing for "No valid host was found. , Code: 500" during the overcloud deployment" [High,Triaged] - Assigned to Marios Andreou (marios-b) | 12:22 |
arxcruz | honza: yes... | 12:22 |
honza | arxcruz: this image is then pulled on the undercloud in certain ci jobs, and tests are executed inside | 12:23 |
trown | shardy: if you have some free time today everything in https://etherpad.openstack.org/p/tripleo-openshift-patches with "READY" just needs 1x +2/+W ... If we get everything "READY" there merged we will have working OSA running from container | 12:23 |
weshay | marios|rover, ah k.. wanted to show you one thing | 12:23 |
arxcruz | honza: yup | 12:23 |
honza | arxcruz: it seems like a really long chain to get a test into ci | 12:23 |
*** ssbarnea_ has joined #tripleo | 12:23 | |
honza | arxcruz: i would like to submit the test and the code that is tested by that test at the same time, and have ci test my code for me | 12:23 |
honza | arxcruz: is such a thing possible? | 12:24 |
marios|rover | weshay: ? | 12:24 |
shardy | trown: ack will go through the list shortly | 12:24 |
jtomasek | honza: glad to hear that:) | 12:24 |
weshay | marios|rover, failed gate job http://logs.openstack.org/41/601241/16/gate/tripleo-ci-centos-7-containers-multinode/5a05846/job-output.txt.gz#_2018-10-03_21_37_01_709646 | 12:24 |
arxcruz | honza: so, you already have the package for this test ? | 12:24 |
weshay | http://logs.openstack.org/90/605090/10/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/6edb958/job-output.txt.gz#_2018-10-03_18_20_58_500872 | 12:24 |
marios|rover | weshay: ah then we have yet another thing | 12:25 |
weshay | marios|rover, kopecmartin|scho /me wondering if jobs running on qemu have a greater chance of failing | 12:25 |
jaosorior | weshay: isn't that warning unrelated? | 12:25 |
*** ssbarnea|bkp2 has quit IRC | 12:25 | |
weshay | jaosorior, it's not failing on that.. however the job times out | 12:25 |
weshay | :) | 12:25 |
honza | arxcruz: we have a project set up for tempest-tripleo-ui but no packaging at the moment (working on it already) | 12:25 |
jaosorior | although it is quite fishy that we can't modprobe the kvm_intel module | 12:25 |
*** amoralej|lunch is now known as amoralej | 12:26 | |
*** aufi has joined #tripleo | 12:26 | |
arxcruz | honza: and you want to have it running in our ci in some featureset right ? | 12:26 |
arxcruz | or you have your own job already set ? | 12:26 |
weshay | jaosorior, rfolco found that not all the hardware is capable | 12:27 |
weshay | jaosorior, it does inject the module when possible | 12:27 |
jaosorior | ok | 12:27 |
honza | arxcruz: there are some open patches to that effect; one in tripleo-ci to create a new job, one in oooq to create a new featureset | 12:28 |
*** ade_lee has quit IRC | 12:28 | |
rfolco | weshay, I am working on that role (set-libvirt-type) again to set a default (kvm) and then use default for ovb (multinode-baremetal) coz we cannot run that role on ovb (inventory is unknown) | 12:28 |
honza | arxcruz: here is the topic https://review.openstack.org/#/q/topic:selenium-ci+(status:open+OR+status:merged) | 12:29 |
arxcruz | honza: okay, so i think you have everything in place already :D | 12:29 |
rfolco | weshay, context: https://review.openstack.org/#/c/601584/ | 12:29 |
arxcruz | honza: chandankumar is the one who create the docker image, i'm not familiar to how to insert a new rpm into that image | 12:29 |
*** lblanchard has quit IRC | 12:30 | |
weshay | arxcruz, we have this failing the gate atm | 12:31 |
weshay | essentially upstream is down | 12:31 |
weshay | arxcruz, can you give me 10-15min on your best guess http://logs.openstack.org/81/602681/3/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/16ad793/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-10-04_06_45_04 | 12:31 |
weshay | jaosorior, marios|rover ^ | 12:31 |
marios|rover | weshay: thanks | 12:32 |
weshay | arxcruz, I'm looking as well | 12:32 |
jaosorior | qX_X | 12:32 |
honza | arxcruz: i see how it's done in the docker file in kolla; i'm just wondering if there is a way to inject the tests outside of the whole rpm toolchain, e.g. if i wanted to test a zuul change, like we do in the reproducer | 12:32 |
honza | arxcruz: thanks | 12:32 |
*** quiquell is now known as quiquell|lunch | 12:33 | |
weshay | ImportError: Class ceph cannot be found (['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/site-packages/oslo_utils/importutils.py", line 32, in import_class\n return getattr(sys.modules[mod_str], class_str)\n', "AttributeError: 'module' object has | 12:33 |
jtomasek | honza: maybe the tests could live in separate repository from the tempest ui package and the package would just be used to run them? | 12:35 |
marios|rover | weshay: isee what you mean one of them is failing for 2018-10-04 04:32:53 | {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops [31.405731s] ... FAILED http://logs.openstack.org/98/604298/20/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/9aad81f//logs/undercloud/home/zuul/tempest.log.txt.gz | 12:35 |
weshay | hrm.. it's not the ceph error | 12:36 |
marios|rover | weshay: cos you mentioned networking at some point on the call earlier | 12:36 |
*** social has joined #tripleo | 12:36 | |
marios|rover | weshay: my survey of four is 50/50 that network test and then the other 2018-10-04 04:41:18 | {0} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern [29.796705s] ... FAILED | 12:37 |
*** tosky__ has joined #tripleo | 12:37 | |
arxcruz | weshay: seeing a lot of this in nova compute: http://logs.openstack.org/81/602681/3/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/16ad793/logs/subnode-2/var/log/containers/nova/nova-compute.log.txt.gz#_2018-10-04_06_46_11_197 | 12:37 |
weshay | marios|rover, arxcruz http://logs.openstack.org/81/602681/3/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/16ad793/logs/subnode-2/var/log/extra/errors.txt.gz#_2018-10-04_06_36_10_504 | 12:37 |
*** tosky is now known as Guest8399 | 12:37 | |
*** tosky__ is now known as tosky | 12:37 | |
weshay | ya.. +1 arxcruz | 12:38 |
marios|rover | weshay: interesting. both of the tempest traces have that 2018-10-04 04:50:16 | Details: {u'message': u'No valid host was found. ', u'code': 500, u'created': u'2018-10-04T04:50:05Z'} | 12:38 |
marios|rover | so could be very relevant | 12:38 |
arxcruz | weshay: plus, is trying to create instance on RegionOne, instead of regionOne | 12:38 |
arxcruz | again, this come back to haunt us | 12:38 |
arxcruz | weshay: http://logs.openstack.org/81/602681/3/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/16ad793/logs/subnode-2/var/log/containers/nova/nova-compute.log.txt.gz#_2018-10-04_06_45_08_354 | 12:39 |
weshay | arxcruz, again? | 12:39 |
arxcruz | weshay: well, for me at least hehehe | 12:39 |
arxcruz | when i was working on rhos... we had problems | 12:39 |
*** Guest8399 has quit IRC | 12:39 | |
arxcruz | i don't know why regionOne instead of default RegionOne | 12:39 |
weshay | 2018-10-04 06:47:12.298 8 WARNING nova.scheduler.client.report [req-acf88fb6-a57f-42e6-a5fe-4ed401bf778e - - - - -] The placement API endpoint was not found.: EndpointNotFound: ['internal'] endpoint for placement service in RegionOne region not found | 12:40 |
honza | jtomasek: i was thinking of adding a mechanism into the tempest image whereby you could request that plugins are refreshed from git/gerrit before running tests | 12:40 |
weshay | arxcruz, hrm.. why is that just a warning.. if that ends up being fatal? | 12:40 |
weshay | 0-04 06:47:12.291 8 ERROR nova.compute.resource_tracker [req-acf88fb6-a57f-42e6-a5fe-4ed401bf778e - - - - -] Skipping removal of allocations for deleted instances: ['internal'] endpoint for placement service in RegionOne region not found: EndpointNotFound: ['internal'] endpoint for placement service in RegionOne region not found | 12:40 |
weshay | ah. .it's an error | 12:40 |
*** agopi has quit IRC | 12:41 | |
arxcruz | weshay: is not a warning | 12:41 |
arxcruz | yeah, it's an error | 12:41 |
weshay | arxcruz, is that the root cause? | 12:41 |
arxcruz | weshay: probably, there's no compute node on RegionOne | 12:41 |
*** agopi has joined #tripleo | 12:41 | |
honza | jtomasek: that way the job running for a patch in tripleo-ui could check the commit message for any depends-ons, and optionally check out a patch from tempest-tripleo-ui inside the container | 12:41 |
arxcruz | weshay: but checking tempest, is looking for regionOne | 12:41 |
arxcruz | so it might be something in nova side | 12:41 |
weshay | marios|rover, ok.. we should update the bug title | 12:41 |
weshay | arxcruz, is that fixed in tht or nova? | 12:41 |
jtomasek | honza: nice! | 12:41 |
weshay | we should be experts in this by now | 12:41 |
arxcruz | weshay: tht | 12:42 |
weshay | arxcruz, http://codesearch.openstack.org/?q=RegionOne&i=nope&files=&repos=tripleo-heat-templates | 12:42 |
weshay | http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/services/novajoin.yaml#n52 | 12:43 |
arxcruz | weshay: http://logs.openstack.org/81/602681/3/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/16ad793/logs/subnode-2/var/log/config-data/nova/etc/nova/nova.conf.txt.gz | 12:43 |
arxcruz | weshay: there are two regions set | 12:43 |
honza | jtomasek: we'll probably have to go through the whole spec/blueprint dance before starting though | 12:43 |
weshay | AHHHH | 12:44 |
weshay | arxcruz, one is RegionOne and the other is regionOne | 12:44 |
arxcruz | weshay: well, it's in different sections | 12:44 |
weshay | jaosorior, http://logs.openstack.org/81/602681/3/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/16ad793/logs/subnode-2/var/log/config-data/nova/etc/nova/nova.conf.txt.gz | 12:44 |
arxcruz | but it should be regionOne in both | 12:44 |
jaosorior | wtf | 12:45 |
*** agopi has quit IRC | 12:45 | |
arxcruz | since we don't have RegionOne | 12:45 |
marios|rover | weshay: arxcruz added comment #8 | 12:45 |
*** agopi has joined #tripleo | 12:45 | |
arxcruz | perhaps check other jobs that haven't failed if nova.conf has both [r|R]egionOne | 12:46 |
jaosorior | weshay: where is RegionOne set? | 12:46 |
*** kopecmartin|scho is now known as kopecmartin|ruck | 12:46 | |
*** agopi has quit IRC | 12:47 | |
jaosorior | we do have a parameter in t-h-t called KeystoneRegion, which should be setting that | 12:47 |
jaosorior | we default to 'regionOne' | 12:47 |
*** agopi has joined #tripleo | 12:47 | |
jaosorior | actually, zzzeek_ was working on multi-region support for TripleO and did find out we weren't setting the region for some services. zzzeek_ do you have a list handy of what we were missing? | 12:47 |
*** slagle has joined #tripleo | 12:47 | |
arxcruz | marios|rover: on #8 where? O.o | 12:48 |
*** agopi has quit IRC | 12:48 | |
weshay | jaosorior, arxcruz afaict.. we're consistent in tht http://codesearch.openstack.org/?q=regionone&i=fosho&files=&repos=tripleo-common,tripleo-heat-templates | 12:48 |
*** agopi has joined #tripleo | 12:48 | |
jaosorior | weshay: it's probably that we just missed setting it in some configuration... so we need to find those. | 12:49 |
weshay | jaosorior, what other repos? | 12:49 |
weshay | nova? | 12:49 |
jaosorior | not another repo, just missing from t-h-t | 12:49 |
marios|rover | arxcruz: https://bugs.launchpad.net/tripleo/+bug/1793665 comment 8 | 12:50 |
openstack | Launchpad bug 1793665 in tripleo "multinode-oooq-container scenarios and Fs016/17/20 periodic jobs fails on validate-tempest: Unexpected response code received" [Critical,Triaged] | 12:50 |
jaosorior | cause OpenStack's global default is Region one AFAIK | 12:50 |
marios|rover | arxcruz: i started looking initially at what tempest test failing/if it was the same but in tmeantime the nova error became the star added at the first paragraph | 12:50 |
arxcruz | k | 12:50 |
arxcruz | jaosorior: and WHY we set to regionOne? | 12:51 |
jaosorior | I don't have that answer | 12:51 |
* arxcruz put the meme y u set to regionOne | 12:51 | |
jaosorior | weshay, arxcruz: Do we have a bug for the region? | 12:52 |
weshay | jaosorior, arxcruz nova uses RegionOne, tht uses regionOne | 12:52 |
weshay | we have old ones for sure | 12:52 |
weshay | jaosorior, arxcruz I never followed this as closely as I should have, but why would we not just match what Nova defaults to? | 12:52 |
weshay | mwhahaha, ^ | 12:52 |
* weshay thinks he's going to yell at me for asking | 12:53 | |
jaosorior | weshay: this setting predates OSP7, who knows :D | 12:53 |
arxcruz | I had a patch before to change it to RegionOne, but it would break the upgrades job, at least that was the response in that time to not change it to RegionOne | 12:54 |
arxcruz | but it's been 2 years or more | 12:54 |
jaosorior | weshay, arxcruz: we were using the wrong hiera keys the value changes in puppet-novpa | 12:54 |
jaosorior | weshay, arxcruz: https://review.openstack.org/607952 | 12:54 |
jaosorior | arxcruz: changing it to RegionOne is a no-go. | 12:54 |
arxcruz | jaosorior: i'm already in peace with that decision :P | 12:54 |
jaosorior | that would surely break people | 12:54 |
*** agurenko has quit IRC | 12:55 | |
arxcruz | and that's why it's important to have tempest running in all jobs :) | 12:55 |
arxcruz | jaosorior: weshay ^ | 12:55 |
jaosorior | arxcruz: indeed | 12:55 |
jaosorior | anyway | 12:55 |
jaosorior | got a fix | 12:55 |
weshay | arxcruz, totally | 12:55 |
jaosorior | weshay, arxcruz: https://review.openstack.org/607952 do we have a bug that I can link it to? | 12:55 |
*** moshele has quit IRC | 12:56 | |
jaosorior | cause we'll need it in rocky too | 12:56 |
arxcruz | jaosorior: i guess https://bugs.launchpad.net/tripleo/+bug/1793665 | 12:56 |
openstack | Launchpad bug 1793665 in tripleo "multinode-oooq-container scenarios and Fs016/17/20 periodic jobs fails on validate-tempest: Unexpected response code received" [Critical,Triaged] | 12:56 |
weshay | jaosorior, Closes-Bug: ? | 12:56 |
jaosorior | arxcruz: thanks. Submitted. | 12:56 |
marios|rover | arxcruz: nice | 12:57 |
jaosorior | weshay: that's what I was asking for. | 12:57 |
weshay | :) | 12:57 |
jaosorior | didn't know what bug number to put | 12:57 |
marios|rover | arxcruz: weshay but, why are we only seeing it now? | 12:57 |
jaosorior | now I did. | 12:57 |
marios|rover | arxcruz: new tempest test? | 12:57 |
jaosorior | marios|rover: cause we were setting that value before. | 12:57 |
*** agurenko has joined #tripleo | 12:57 | |
jaosorior | but it changed in puppet-nova | 12:57 |
jaosorior | we were using os_region_name | 12:57 |
jaosorior | and it changed to be region_name | 12:57 |
marios|rover | jaosorior: ack thanks | 12:57 |
*** med_ has quit IRC | 12:57 | |
jaosorior | the deprecation was set for a release already (or not sure how many) | 12:57 |
jaosorior | and this time they finally deleted os_region_name | 12:57 |
jaosorior | the same will happen for the interface | 12:57 |
jaosorior | so I added it to the review | 12:58 |
jaosorior | ah, fuck, we don't have os_interface in rocky | 12:58 |
jaosorior | that'll have to be a separate patch | 12:58 |
*** ansmith has joined #tripleo | 13:00 | |
ykarel | jaosorior, looks like nova::placement::interface is not valid attribute, i can't see at | 13:01 |
ykarel | https://github.com/openstack/puppet-nova/blob/master/manifests/placement.pp | 13:01 |
jaosorior | ykarel: just fixed it. | 13:02 |
ykarel | jaosorior, ack | 13:02 |
jaosorior | ykarel, weshay, marios|rover, arxcruz: https://review.openstack.org/#/c/607952/ this only changes the region | 13:02 |
jaosorior | ykarel: this changes the interface https://review.openstack.org/#/c/607953/ | 13:02 |
weshay | arxcruz, any changes required to tempest to follow that? | 13:02 |
arxcruz | weshay: nope | 13:02 |
weshay | arxcruz++ | 13:02 |
jaosorior | marios|rover: can you revisit the patch? I had to update it after you scored it. | 13:03 |
*** quiquell|lunch is now known as quiquell | 13:05 | |
marios|rover | jaosorior: ack in call will check bit | 13:06 |
marios|rover | thanks jaosorior | 13:07 |
weshay | jaosorior, the next thing to understand is the WHYYY | 13:08 |
weshay | why did that error just raise itself | 13:08 |
weshay | what checks / gates did we miss there | 13:08 |
marios|rover | weshay: comment on that review from yatin | 13:08 |
* weshay looks | 13:08 | |
marios|rover | weshay: https://review.openstack.org/#/c/605069 | 13:08 |
marios|rover | merged 15 hours ago | 13:08 |
weshay | ah.. | 13:09 |
weshay | mwhahaha, we removed tripleo jobs there intentionally.. so that is ours I guess | 13:09 |
weshay | tripleo-puppet-ci-centos-7-undercloud-containers | 13:10 |
jaosorior | weshay: no worries, we'll test that shit out with standalone next time :D | 13:10 |
weshay | did not catch that error | 13:10 |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1793665 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 13:10 |
openstack | Launchpad bug 1793665 in tripleo "multinode-oooq-container scenarios and Fs016/17/20 periodic jobs fails on validate-tempest: Unexpected response code received" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 13:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 13:10 |
jaosorior | what does undercloud-containers do? | 13:10 |
jaosorior | does it run tempest? | 13:10 |
weshay | jaosorior, http://logs.openstack.org/69/605069/1/check/tripleo-puppet-ci-centos-7-undercloud-containers/2b6b18e/logs/tempest.html.gz | 13:11 |
jaosorior | dafuuuq | 13:11 |
jaosorior | and it didn't crash | 13:11 |
jaosorior | weeel I dunno | 13:11 |
ykarel | seems it's not running server create test | 13:11 |
ykarel | just api | 13:11 |
jaosorior | none of you are based in Brussels, right? | 13:12 |
weshay | let's update that.. has plenty of time to run | 13:12 |
weshay | arxcruz, ^ | 13:12 |
*** lblanchard has joined #tripleo | 13:14 | |
arxcruz | okay, which test you want to run? | 13:14 |
arxcruz | default scenario? | 13:14 |
arxcruz | jaosorior: i think, i'm the closest one to Brussels :P | 13:15 |
jaosorior | arxcruz: I'll head there today and will be there for the weekend. So if you're around, let me know :D | 13:15 |
arxcruz | jaosorior: haha, I wish! All those beers... | 13:16 |
jaosorior | haha indeed :D | 13:17 |
*** vinaykns has joined #tripleo | 13:17 | |
jaosorior | so yeah | 13:20 |
jaosorior | tomorrow I won't be around folks | 13:20 |
*** ratailor has quit IRC | 13:21 | |
*** slagle has quit IRC | 13:22 | |
*** shyam89 has quit IRC | 13:23 | |
*** ade_lee has joined #tripleo | 13:25 | |
*** holser_ has quit IRC | 13:34 | |
mwhahaha | so regionOne vs RegionOne predates me. i blame someone else | 13:34 |
*** ykarel_ has joined #tripleo | 13:36 | |
*** hjensas has quit IRC | 13:36 | |
*** slaweq__ is now known as slaweq | 13:36 | |
*** holser_ has joined #tripleo | 13:36 | |
rnoriega | mwhahaha, ping | 13:37 |
mwhahaha | rnoriega: sup? | 13:37 |
rnoriega | mwhahaha, hey buddy! quick question, have we deprecate the --use-heat when installing the undercloud? | 13:37 |
*** mjturek has joined #tripleo | 13:37 | |
*** ykarel has quit IRC | 13:38 | |
*** fultonj has quit IRC | 13:39 | |
*** slagle has joined #tripleo | 13:41 | |
shardy | rnoriega: it's deprecated because the heat/containers install is default now | 13:41 |
rnoriega | shardy, thanks! so it will fail if we use that argument | 13:42 |
mwhahaha | rnoriega: yea in master that is no longer a thing | 13:42 |
rnoriega | cool, good to know | 13:42 |
rnoriega | shardy, mwhahaha, is this up-to-date? https://docs.openstack.org/tripleo-docs/latest/install/installation/installing.html | 13:43 |
mwhahaha | rnoriega: yea except the deprecated note needs to go away | 13:43 |
rnoriega | mwhahaha, ack! thanks! | 13:43 |
*** agopi has quit IRC | 13:44 | |
redrobot | Hello #tripleo friends! I'm trying to set up a dev environment using tripleo quickstart, but I keep getting image errors about docker images not being available. | 13:45 |
redrobot | So I'm trying to understand the process of how those images get onto the overcloud nodes. | 13:45 |
redrobot | Can someone point me in the right direction? | 13:45 |
*** pcaruana has quit IRC | 13:50 | |
*** ykarel_ is now known as ykarel | 13:50 | |
*** fultonj has joined #tripleo | 13:51 | |
*** bfournie has joined #tripleo | 13:56 | |
jaosorior | mandre: do you know by any chance? ^^ | 13:56 |
rook | anyone ever ran into this ? | 13:57 |
rook | (undercloud) [stack@microbrow-19 heat]$ openstack tripleo container image prepare -e /home/stack/containers-prepare-parameter.yaml | 13:57 |
rook | Error while fetching server API version: ('Connection aborted.', error(13, 'Permission denied')) | 13:57 |
*** gkadam has joined #tripleo | 14:00 | |
slagle | Edge squad meeting time | 14:00 |
slagle | #startmeeting TripleO Edge Squad Meeting | 14:00 |
openstack | Meeting started Thu Oct 4 14:00:32 2018 UTC and is due to finish in 60 minutes. The chair is slagle. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
*** openstack changes topic to " (Meeting topic: TripleO Edge Squad Meeting)" | 14:00 | |
openstack | The meeting name has been set to 'tripleo_edge_squad_meeting' | 14:00 |
slagle | ping slagle, emilien, csatari, jaosorior, owalsh, fultonj, gfidente, hjensas, jtomasek,thrash, bogdando, dtantsur, rbrady | 14:00 |
slagle | #info remove or update your nick from the Meeting Template on the etherpad if you want (or don't want) to be ping'd for the start of the meeting | 14:00 |
dtantsur | o/ | 14:00 |
slagle | #link https://etherpad.openstack.org/p/tripleo-edge-squad-status | 14:00 |
gfidente | o/ | 14:00 |
jaosorior | o/ | 14:00 |
slagle | Anyone can use the #link, #action, #help, #idea, #agreed, and #info commands, not just the moderatorǃ | 14:00 |
fultonj | o/ | 14:01 |
slagle | #topic Agenda | 14:01 |
slagle | * Review past action items | 14:01 |
slagle | * One off items | 14:01 |
slagle | * Goals for the week | 14:01 |
*** openstack changes topic to "Agenda (Meeting topic: TripleO Edge Squad Meeting)" | 14:01 | |
slagle | #topic Review past action items | 14:02 |
*** openstack changes topic to "Review past action items (Meeting topic: TripleO Edge Squad Meeting)" | 14:02 | |
*** agopi has joined #tripleo | 14:02 | |
slagle | ACTION: all: review https://etherpad.openstack.org/p/tripleo-edge-mvp and discuss (slagle, 14:10:04) | 14:02 |
slagle | we said we'd review that etherpad from bogdando | 14:02 |
slagle | i see comments from a few folks | 14:03 |
slagle | i reviewed it, especially around Goal 4 since that was the ask | 14:03 |
fultonj | me too | 14:03 |
slagle | i found it a little difficult to understnad, but I left some comments there | 14:03 |
fultonj | bogdando: anything we should talk about now? | 14:04 |
slagle | bogdando: perhaps you could take a look and we can continue the discussion on the etherpad for now? | 14:04 |
cgoncalves | mwhahaha, EmilienM: hi. could you please approve https://review.openstack.org/#/c/587015/ ? thanks! | 14:04 |
zzzeek_ | jaosorior: i know nova is one, i'd have to run a test to find all the rest | 14:04 |
fultonj | #agreed continue disucssion in etherpad | 14:05 |
slagle | hehe :) | 14:05 |
slagle | ok, next up | 14:05 |
slagle | ACTION: fultonj to get feedback from tripleo CI group on https://blueprints.launchpad.net/tripleo/+spec/split-controlplane-ci (fultonj, 14:29:39) | 14:05 |
bogdando | slagle, fultonj: yes, pleae let's keep it for offline | 14:06 |
fultonj | that AI will be ongoing | 14:07 |
fultonj | planning to... | 14:07 |
fultonj | 1. prototype | 14:07 |
fultonj | 2. then get feedback on submission which uses standlone like https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L14 | 14:07 |
fultonj | still workkig on prototype | 14:07 |
slagle | ok sounds good | 14:08 |
slagle | how is that going? | 14:08 |
slagle | or is that the next action item we were going to discuss... | 14:08 |
fultonj | #info - following https://etherpad.openstack.org/p/tripleo-compute-standalone | 14:08 |
fultonj | #info - few days ago ran into http://paste.openstack.org/show/731116 | 14:08 |
fultonj | #info - Why is RoleNetIpMap missing new edge node 192.168.24.3? http://paste.openstack.org/show/731120 | 14:08 |
fultonj | #info - Stack knows about new node http://paste.openstack.org/show/731121 | 14:08 |
fultonj | #info - Reproducing in my env today and might ping for help if still stuck | 14:08 |
fultonj | #info - https://gitlab.com/fultonj/tripleo-standalone-edge | 14:08 |
fultonj | slagle: that's what i'm currently stuck on perhaps after meeting and after i reproduce i could get help dubbing? | 14:09 |
fultonj | debugging* | 14:09 |
* dtantsur thinks fultonj just invented twitter over irc | 14:09 | |
slagle | fultonj: sure, it probably didn't find an IP for the compute node | 14:10 |
*** hamzy has quit IRC | 14:10 | |
slagle | maybe a problem with DeployedServerPortMap or HostnameMap | 14:10 |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1793665 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 14:10 |
openstack | Launchpad bug 1793665 in tripleo "multinode-oooq-container scenarios and Fs016/17/20 periodic jobs fails on validate-tempest: Unexpected response code received" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 14:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 14:10 |
slagle | #action fultonj and slagle to continue debugging standalone edge deployment | 14:10 |
fultonj | thanks slagle | 14:11 |
owalsh | o/ | 14:11 |
*** yprokule has quit IRC | 14:11 | |
slagle | ACTION: fultonj try standalone for https://blueprints.launchpad.net/tripleo/+spec/split-controlplane-ci based on https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L14 (fultonj, 14:38:07) | 14:11 |
slagle | alright, we just discussed that | 14:12 |
slagle | so moving on | 14:12 |
slagle | #topic One Off | 14:12 |
*** openstack changes topic to "One Off (Meeting topic: TripleO Edge Squad Meeting)" | 14:12 | |
fultonj | #info - abishop not here but made progress on active/active cinder in standalone | 14:12 |
fultonj | and cinder AZs | 14:12 |
bogdando | #action https://etherpad.openstack.org/p/tripleo-edge-mvp is needs clarification for the special snowflakes, what do we understand as that when comparing it to the federated openstack services (perhaps) | 14:13 |
bogdando | dtantsur: ^^ | 14:13 |
bogdando | just captured the irc logs, not really invented those snowflakes :) | 14:13 |
dtantsur | not sure I get it, what's the question for me? | 14:13 |
slagle | bogdando: the only context i was able to capture from the etherpad was that it was implied that "using ansible" = "special snowflake" | 14:14 |
bogdando | dtantsur: yes please as I think when we were talking about architecture differences for undercloud vs overcloud, we used that term | 14:14 |
slagle | so i don't understand what is meant by special snowflake | 14:14 |
dtantsur | let's probably try use less metaphors and more specific wording? | 14:15 |
fultonj | dtantsur: +1 | 14:15 |
bogdando | agreeing on terms is already a goal 1 :D | 14:15 |
fultonj | w.r.t terms i think it helps to be consistent with edge working group | 14:16 |
*** jaosorior has quit IRC | 14:16 | |
slagle | fultonj: yes, so one of the things I was going to do try and do over the next week is gather all the links/references that we've been compiling into a single spot | 14:16 |
*** Petersingh has quit IRC | 14:16 | |
slagle | perhaps the sqaud etherpad for now | 14:16 |
*** Petersingh has joined #tripleo | 14:17 | |
*** Petersingh is now known as Petersingh|gone | 14:17 | |
dtantsur | I think what is meant under "special snowflake" here is actually a concern about growing the amount of logic specific to tripleo | 14:17 |
*** Petersingh|gone has quit IRC | 14:17 | |
slagle | b/c there was also some confusion around "Far Edge" in the etherpad. it's a thing that's been defined outside of TripleO, so we need to understand what is meant by it | 14:17 |
dtantsur | as opposed to tripleo relying more on other upstream openstack projects | 14:17 |
* dtantsur is the primary hater of the term "Far Edge" | 14:17 | |
fultonj | https://www.dropbox.com/s/255x1cao14taer3/MVP-Architecture_edge-computing_PTG.pptx?dl=0# | 14:17 |
dtantsur | how do I block IRC messages containing ^^^ | 14:18 |
dtantsur | ? | 14:18 |
slagle | dtantsur: understood :) but you'd have to convince the Edge WG to not use it | 14:18 |
fultonj | ^ i don't love the term but i'll use it because others do outside of tripleo in the dge working group | 14:18 |
bogdando | slagle, dtantsur: updated special snowflakes | 14:18 |
bogdando | https://etherpad.openstack.org/p/tripleo-edge-mvp | 14:18 |
dtantsur | slagle: maybe I'm just the grumpy old man here :) | 14:18 |
slagle | dtantsur: nah :). i hear where you're coming from | 14:19 |
dtantsur | I suspect the "Edge" terminology makes good marketing, so we may not be able to change it globally | 14:19 |
slagle | dtantsur: honestly it was driven by groups who are already actually deploying this stuff. and they found it useful to have these classifications | 14:19 |
*** iranzo has quit IRC | 14:19 | |
bogdando | slagle: did I wrote that right? | 14:20 |
dtantsur | then I guess we should just start our documentation with a glossary :) | 14:20 |
dtantsur | which is a good idea anyway | 14:20 |
bogdando | dtantsur: ^^ please take a look that etherpad for 11th time :) | 14:20 |
bogdando | line 24-27 | 14:20 |
dtantsur | bogdando: can we s/special snowflake/something non-metaphoric/g please? | 14:20 |
bogdando | go for it! | 14:20 |
dtantsur | I have a gut feeling it's not used exactly in this sense, but as a non-native speaking I cannot grasp it in full | 14:21 |
slagle | dtantsur: as for tripleo growing more logic that is not openstack, not sure i totally agree there. tripleo is part of openstack, as are all the other deployment projects | 14:21 |
bogdando | just please make sure it not gets too much of tripleo specific! :) | 14:21 |
dtantsur | slagle: right, it's not necessary a bad thing | 14:21 |
dtantsur | but it's maintenance cost, and if we can avoid it - let's avoid it | 14:21 |
bogdando | as every vendor these days seems like has a bunch of snowflakes for Edge thene | 14:21 |
bogdando | theme* | 14:22 |
slagle | dtantsur: openstack doesn't have a tenant facing API service for software config/deployment that is sufficient enough for openstack or edge deployment | 14:22 |
slagle | Heat is about it | 14:22 |
dtantsur | e.g. in metalsmith case, the metalsmith library is under ironic governance, so we share its maintenance | 14:22 |
dtantsur | we could write this code in tripleo-common, then we would have to maintain it | 14:22 |
slagle | and i don't plan on using Heat to deploy thousands of edge nodes :) | 14:22 |
dtantsur | lol, yeah | 14:22 |
*** iranzo has joined #tripleo | 14:23 | |
* dtantsur ponders an openstack software config service | 14:23 | |
slagle | i do think it's important that we drive things with existing or new consistent interfaces. for now, that means t-h-t | 14:23 |
slagle | so i look at ansible/config-download as a potential way to scale that to the edge | 14:24 |
dtantsur | anyway, for me personally the most interesting things is what (if anything) happens with bm provisioning and management | 14:25 |
*** agurenko_ has joined #tripleo | 14:26 | |
*** agurenko has quit IRC | 14:26 | |
slagle | #action slagle to work on documenting some terms and gathering links/references | 14:26 |
owalsh | bogdando: for distributed undercloud, what exactly is the goal? is it federation to make is possible (fast) to deploy to edge from centre, a local undercloud at each edge to tolerate network partitions, both, neither? | 14:26 |
dtantsur | my concerns were around replacing ironic as an operator facing API (or completely) with something specific to tripleo | 14:27 |
dtantsur | this is *probably* where the snowflakes speech came from | 14:27 |
dtantsur | owalsh: that's the question, and I don't think we have solved it yet | 14:27 |
*** tosky__ has joined #tripleo | 14:27 | |
slagle | dtantsur: for bm? i don't think there's any reason to do that. i'm not aware of anything going in that direction | 14:27 |
*** tosky has quit IRC | 14:28 | |
*** tosky__ is now known as tosky | 14:28 | |
owalsh | dtantsur: ack | 14:28 |
*** hjensas has joined #tripleo | 14:28 | |
owalsh | dtantsur: so both :-) | 14:28 |
*** aufi_ has joined #tripleo | 14:28 | |
dtantsur | slagle: the question is how deeply we change the bm management workflow on the central undercloud (the Edge layer if I'm not mixing things up again) | 14:29 |
*** aufi has quit IRC | 14:29 | |
*** bogdando has quit IRC | 14:29 | |
dtantsur | (it may not feel the right question for right now, but the resulting architecture of the undercloud may depend on it) | 14:29 |
*** saneax has quit IRC | 14:30 | |
slagle | well maybe the new workflow will be used for both | 14:32 |
slagle | or should be | 14:32 |
*** ykarel is now known as ykarel|afk | 14:32 | |
owalsh | +1 | 14:32 |
*** bogdando has joined #tripleo | 14:32 | |
slagle | anything else before we wrap up? | 14:33 |
slagle | #endmeeting | 14:33 |
*** openstack changes topic to "Welcome to Rocky | CI Status: YELLOWish? (seems to be stable, please be careful) - ovb is sad still | https://docs.openstack.org/tripleo-docs/latest/" | 14:34 | |
slagle | thanks! | 14:34 |
openstack | Meeting ended Thu Oct 4 14:33:59 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:34 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo_edge_squad_meeting/2018/tripleo_edge_squad_meeting.2018-10-04-14.00.html | 14:34 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo_edge_squad_meeting/2018/tripleo_edge_squad_meeting.2018-10-04-14.00.txt | 14:34 |
openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo_edge_squad_meeting/2018/tripleo_edge_squad_meeting.2018-10-04-14.00.log.html | 14:34 |
dtantsur | slagle: you mean, hiding all current ironic actions inside a mistral workflow? | 14:34 |
*** Vorrtex has joined #tripleo | 14:34 | |
dtantsur | this is probably what bogdando and I are concerned about | 14:34 |
*** mwhahaha changes topic to "Welcome to Rocky | CI Status: RED - master blocked DO NOT APPROVE/RECHECK - ovb is sad still | https://docs.openstack.org/tripleo-docs/latest/" | 14:35 | |
slagle | dtantsur: not at all | 14:36 |
*** skramaja_ has quit IRC | 14:36 | |
*** mwhahaha changes topic to "Welcome to Stein | CI Status: RED - master blocked DO NOT APPROVE/RECHECK - ovb is sad still | https://docs.openstack.org/tripleo-docs/latest/" | 14:36 | |
slagle | dtantsur: the interface can stand on its own, but we may need automation around that | 14:37 |
slagle | similar to what we've done for config-download imo | 14:37 |
slagle | we have commands to generate inventory, export config, apply config | 14:37 |
dtantsur | I'm quite looking forward to some whiteboarding in Berlin, if you'll be around | 14:37 |
slagle | but it's also all automated via a mistral workflow | 14:38 |
owalsh | are we considering workflows that orchestrate remote underclouds? | 14:38 |
slagle | because of the need for a HTTP based api | 14:38 |
dtantsur | right | 14:38 |
dtantsur | owalsh: this is how I understand it | 14:38 |
toure | slagle so you are looking for a workflow which would act as a helper function in a sense to provide all configurable inputs, if I understand you correctly ? | 14:39 |
owalsh | dtantsur: ack, so I was thinking that the lesson from cells in nova is to have one code paths to ensure it's maintained/tested | 14:39 |
dtantsur | owalsh: this is a part of my concern here. maybe if we do it, we need to use it even for non-edge case.. | 14:39 |
dtantsur | but this may mean more work to replicate certain ironic features | 14:39 |
dtantsur | dunno, I still have hard time fitting the whole picture in my head | 14:40 |
owalsh | dtantsur: yea, but it's definitely a better approach long term I think | 14:40 |
dtantsur | owalsh: another option is to have independent ironic's at each Far Edge, and just tell operators to log in there | 14:41 |
dtantsur | without any central management from the Edge (?) location | 14:41 |
owalsh | dtantsur: but maybe we need both, so that an edge can be managed in isolation... why I was wondering if the requirements are clear for distributed undercloud | 14:42 |
bogdando | dtantsur: I will highly likely be there | 14:42 |
*** shyamb has joined #tripleo | 14:43 | |
dtantsur | owalsh: sure, the ironic API at the Far Edge won't go anywhere. the question is about whether and how we expose bm management facilities from the central location | 14:43 |
dtantsur | actually, we have 3 options: 1. make ironic do aggregation for us (I'm looking into it, but may take time / be rejected), 2. provide tripleo workflows to do it, 3. do nothing. | 14:43 |
slagle | dtantsur: what about the distributed conductor model? | 14:44 |
bogdando | > why I was wondering if the requirements are clear for distributed undercloud | 14:44 |
bogdando | this ^^ | 14:44 |
dtantsur | slagle: you mean, my initial idea? it required stretching rabbit and db between Edge and Far Edge. otherwise it's pretty neat. | 14:44 |
owalsh | dtantsur: so really you need the equivalent of nova cell_v2 for ironic.... | 14:45 |
dtantsur | ideally, we need cells for the whole openstack :) | 14:45 |
*** hamzy has joined #tripleo | 14:45 | |
dtantsur | ironic may be easier, it does not need any centrally stored state (IMO) | 14:47 |
owalsh | dtantsur: TBH though, I think Far Edge == a cell tower, and Edge == a (relatively) local hub, so latency shouldn't be very high | 14:47 |
*** kopecmartin|ruck is now known as kopecmartin|scho | 14:47 | |
owalsh | it that specific use case at least | 14:47 |
slagle | dtantsur: rabbitmq to the far edge perhaps for the deployed compute nodes. i don't think the db would need to be stretched to the far edge | 14:47 |
slagle | and the uc's rabbitmq only to the edge | 14:47 |
dtantsur | slagle: if we use cells, we don't need rabbitmq to be stretched, do we? | 14:48 |
*** med_ has joined #tripleo | 14:48 | |
*** itlinux has quit IRC | 14:48 | |
slagle | perhaps not. i'm mainly thinking uc here. | 14:48 |
bogdando | owalsh: I think the latency is not an only thing to worry about, but isolation | 14:48 |
bogdando | and how long it takes being allowed operating isolated | 14:49 |
bogdando | and how do we want to sync states later | 14:49 |
dtantsur | slagle: okay, so we have an option to place the undercloud on Edge, while only having ironic-conductor (and whatever is needed for sw deployment) on Far Edge | 14:50 |
owalsh | bogdando: do we need to replicate state? | 14:50 |
dtantsur | slagle: it's line 112 in https://etherpad.openstack.org/p/tripleo-edge-squad-status | 14:50 |
*** jchhatbar has joined #tripleo | 14:50 | |
bogdando | owalsh: that's also the question | 14:51 |
bogdando | I'd say at least for monitoring status | 14:51 |
dtantsur | bogdando, owalsh, the problem is database.. I'm not sure how it will behave in case of split-brain | 14:51 |
bogdando | and there is also images and identity things | 14:51 |
bogdando | glance/ironic images I mean | 14:51 |
owalsh | dtantsur: but isn't Far Edge just the computes? | 14:51 |
slagle | dtantsur: yea i still don't see why conductor would be needed at the far edge | 14:51 |
bogdando | dtantsur: poorly | 14:51 |
dtantsur | owalsh: I'm talking about UC right now | 14:51 |
slagle | can't everything be done over http? | 14:52 |
bogdando | but may be ok if read only mode for db | 14:52 |
owalsh | dtantsur: so we would have a conductor at each FarEdge site? | 14:52 |
dtantsur | slagle: good that you ask, let's open a can of worms :) | 14:52 |
dtantsur | owalsh: it's just one of the options | 14:52 |
owalsh | dtantsur: API nodes are at the Edge site, and I'd expect it to be close enough to the Far Edge to not worry about it | 14:52 |
dtantsur | slagle: we need something to bootstrap iPXE OR switch to virtual media | 14:53 |
dtantsur | also solve DHCP, but it's also possible (we're working on DHCP via virtual media, for example) | 14:53 |
*** janki has quit IRC | 14:53 | |
dtantsur | currently DHCP, TFTP and iSCSI are problems from ironic perspective | 14:54 |
nhicher | sshnaidm: any news regarding mistral timeout ? | 14:54 |
*** med_ has quit IRC | 14:54 | |
hjensas | why does it have to be over http? As long as it is over IP it's fine? | 14:54 |
slagle | seems like that could be done with something smaller than conductor, that wouldn't require stretching uc rabbitmq | 14:54 |
*** thrash is now known as thrash|biab | 14:54 | |
slagle | so new device boots up at far edge, gets dhcp/ipxe bootstrap from "something", phones home to conductor. conductor does remote deployment | 14:55 |
owalsh | dtantsur: are we assuming the Far Edge nodes are not on the same network segment for DHCP etc...? | 14:55 |
slagle | the direct deployment or something? i thought ironic had a thing | 14:55 |
slagle | where it would tell IPA how to do the deployment, etc. entirely via http | 14:56 |
dtantsur | slagle, owalsh, line 97 https://etherpad.openstack.org/p/tripleo-edge-squad-status | 14:56 |
hjensas | I think "something" there is either virtual-media or dhcp-relay? TFTP servers can be at Edge as long as the provisioning network at far-edge knows how to route? | 14:56 |
dtantsur | hjensas: the same link above | 14:58 |
owalsh | dtantsur: ack, but is "Edge" really a central location? | 14:58 |
bogdando | owalsh, dtantsur: I thought a tipical for Far Edge is connections to Edge via WAN (no L2) | 14:59 |
*** toure is now known as toure|biab | 14:59 | |
dtantsur | owalsh: from our perspective - yes | 14:59 |
bogdando | typical* | 14:59 |
slagle | dtantsur: somethhing like that, yea. with many conductors | 14:59 |
owalsh | bogdando: that's what I'm asking, do we have L2 or not? | 14:59 |
slagle | and distributed glance storage | 14:59 |
dtantsur | owalsh, bogdando, my notes on the etherpad assume no L2 | 15:00 |
bogdando | good question, would be nice to assume we do not | 15:00 |
dtantsur | with L2 things are essentially the same as now | 15:00 |
* owalsh gotta run to another meeting, dtantsur thanks for the brain dump, I'll take a look later | 15:01 | |
slagle | toure|biab: hey, sorry, i didn't understand your earlier question | 15:07 |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1793665 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 15:10 |
openstack | Launchpad bug 1793665 in tripleo "multinode-oooq-container scenarios and Fs016/17/20 periodic jobs fails on validate-tempest: Unexpected response code received" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 15:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 15:10 |
*** holser_ has quit IRC | 15:11 | |
*** holser_ has joined #tripleo | 15:11 | |
*** quiquell is now known as quiquell|off | 15:18 | |
sshnaidm | nhicher, hi, I think toure|biab was on that yesterday, maybe he has updates today, let's ask him when he's onlin | 15:19 |
*** toure|biab is now known as toure | 15:19 | |
sshnaidm | nhicher, the problem as I understood was that heat engine started later than needed | 15:20 |
sshnaidm | let toure fix me if I'm wrong ^ | 15:20 |
sshnaidm | nhicher, and this is caused by slow storage... | 15:20 |
*** sshnaidm is now known as sshnaidm|afk | 15:20 | |
toure | sshnaidm nhicher that was the mistral engine logs | 15:20 |
toure | sshnaidm nhicher so the issue is stemming from slow storage, when heat looks to retrieve templates from swift there are timeouts hit | 15:21 |
toure | it looks as though heat retries and fails | 15:22 |
*** shyamb has quit IRC | 15:23 | |
*** iranzo has quit IRC | 15:25 | |
*** slagle has quit IRC | 15:25 | |
*** moguimar has quit IRC | 15:26 | |
nhicher | toure: I can reproduce for each run, but got +1 2 or 3 times, check https://review.rdoproject.org/r/#/c/16566 | 15:26 |
nhicher | toure: do you know how I can fix that issue ? | 15:27 |
toure | this job looks as though it completed | 15:28 |
nhicher | toure: check 'Toggle CI', a lot of failing jobs | 15:30 |
toure | nhicher am I missing something | 15:30 |
toure | ah | 15:30 |
rook | mandre: hey - got a second? | 15:30 |
rook | mandre: I tried restarting the mistral executor contianer | 15:31 |
rook | but still get the Permission Deined | 15:31 |
*** agopi is now known as agopi|long_lunch | 15:31 | |
*** dprince has quit IRC | 15:33 | |
*** hjensas has quit IRC | 15:35 | |
sshnaidm|afk | toure, maybe it's possible to increase the timeout anyhow? At least just for test | 15:36 |
*** sshnaidm|afk is now known as sshnaidm | 15:36 | |
*** udesale has quit IRC | 15:36 | |
mandre | rook: hmm that sucks... are you trying to pull images from a public registry? | 15:39 |
*** thrash|biab is now known as thrash | 15:39 | |
mandre | rook: if not, maybe you need to 'docker login' prior to running the prepare step? | 15:39 |
toure | so far I /win 21 | 15:40 |
toure | oops | 15:41 |
rook | mandre: local docker | 15:42 |
rook | hm | 15:42 |
rook | docker log? | 15:42 |
rook | login* | 15:42 |
*** hamzy_ has joined #tripleo | 15:42 | |
*** bogdando has quit IRC | 15:43 | |
mandre | rook: the image prepare step will pull container images from a remote registry and push them locally on the undercloud -- does the remote registry require auth? | 15:43 |
*** hamzy has quit IRC | 15:44 | |
mandre | rook: you can try to docker pull one of the image from the remote registry, see if it complains | 15:44 |
*** agurenko_ has quit IRC | 15:46 | |
*** hjensas has joined #tripleo | 15:46 | |
*** jchhatbar has quit IRC | 15:46 | |
*** dprince has joined #tripleo | 15:49 | |
*** ykarel|afk is now known as ykarel | 15:52 | |
*** jfrancoa has quit IRC | 15:55 | |
*** itlinux has joined #tripleo | 15:57 | |
*** jaganathan has joined #tripleo | 15:58 | |
weshay | marios|rover, kopecmartin|scho packstack also broke https://review.openstack.org/#/c/607983/ | 16:00 |
marios|rover | weshay: ack /me about to call it for today will follow up in the morning have a good one | 16:04 |
marios|rover | thanks weshay | 16:04 |
*** trown is now known as trown|lunch | 16:04 | |
*** jaganathan has quit IRC | 16:05 | |
bnemec | rook: https://review.openstack.org/#/c/531913/2/doc/source/install/containers_deployment/overcloud.rst | 16:07 |
bnemec | I don't know what happened to that note. I don't see it on master anymore. :-/ | 16:07 |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 16:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1793665 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1793665 in tripleo "multinode-oooq-container scenarios and Fs016/17/20 periodic jobs fails on validate-tempest: Unexpected response code received" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 16:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 16:10 |
*** hjensas has quit IRC | 16:10 | |
*** dtantsur is now known as dtantsur|afk | 16:10 | |
*** ykarel_ has joined #tripleo | 16:18 | |
itlinux | hi to all.. it's almost friday :) | 16:18 |
*** sai_p has joined #tripleo | 16:19 | |
*** ykarel_ is now known as ykarel|away | 16:20 | |
*** ykarel has quit IRC | 16:20 | |
*** slagle has joined #tripleo | 16:20 | |
sai_p | Hi, in tripleo overcloud deployment, I am trying to make sure puppet configuration for service A is done before it starts the puppet configuration for service B. Can anyone let me know how it can be achieved. | 16:22 |
*** hjensas has joined #tripleo | 16:27 | |
mwhahaha | sai_p: i guess it depends, but we do have steps in the deployment process and the containers process as well | 16:27 |
mwhahaha | sai_p: if you really want to ensure the configs are done at different times then they should probably be in different steps (like 4/5) | 16:27 |
*** aufi_ has quit IRC | 16:40 | |
Tengu | hmm, in fact the bot listing incoming changes is dead right? | 16:41 |
mwhahaha | it's in other channels | 16:42 |
mwhahaha | will have to ask | 16:42 |
Tengu | ok - not that urgent compared to the other things ;) | 16:42 |
*** holser_ has quit IRC | 16:45 | |
*** raterch has joined #tripleo | 16:49 | |
Tengu | ok folks, see you tomorrow. Good luck with that nasty boy of a CI | 16:49 |
raterch | I'm having an issue with deploy writing a containers-default-parameters.yaml to swift that doesn't match the one in my plan-environment.yaml. Any ideas? | 16:50 |
*** moshele has joined #tripleo | 16:53 | |
*** ykarel|away has quit IRC | 16:58 | |
*** salmankhan has quit IRC | 17:04 | |
*** shardy has quit IRC | 17:04 | |
*** derekh has quit IRC | 17:04 | |
*** trown|lunch is now known as trown | 17:04 | |
*** paramite has quit IRC | 17:04 | |
*** ksambor has quit IRC | 17:05 | |
*** morazi has quit IRC | 17:06 | |
*** morazi has joined #tripleo | 17:07 | |
*** gkadam has quit IRC | 17:08 | |
*** ramishra has quit IRC | 17:09 | |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 17:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1793665 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1793665 in tripleo "multinode-oooq-container scenarios and Fs016/17/20 periodic jobs fails on validate-tempest: Unexpected response code received" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 17:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 17:10 |
EmilienM | weshay, mwhahaha : I hope we can land this one this week: https://review.openstack.org/#/c/600517/ | 17:12 |
EmilienM | it would be a nice milestone | 17:12 |
weshay | EmilienM, https://review.openstack.org/#/c/607952/ and https://review.openstack.org/#/c/607904/ | 17:12 |
weshay | just need to land for sanity | 17:13 |
EmilienM | weshay: ok? nothing to do with my podman work, right? | 17:13 |
weshay | bfournie, ping re: https://review.openstack.org/#/c/584452/ | 17:13 |
weshay | EmilienM, just clearing up results | 17:13 |
EmilienM | weshay: click on my link please | 17:14 |
EmilienM | weshay: it's containerized undercloud job only | 17:14 |
EmilienM | so nothing to do with other jobs | 17:14 |
weshay | it's master | 17:14 |
weshay | so it does | 17:14 |
bfournie | weshay: hey | 17:14 |
weshay | bfournie, hey man.. so wondering if it's realistic at all to have ironic setup 3rd party jobs w/ tripleo ovb | 17:14 |
weshay | I see fujitsu, ibm, cisco | 17:15 |
weshay | it would be nice to have ovb in there as third party right? | 17:15 |
weshay | fujitsu's tests are taking 2+ hours | 17:16 |
bfournie | weshay: I'm deferring to dtantsur|afk re: update to trello card | 17:17 |
*** pcaruana has joined #tripleo | 17:17 | |
weshay | ah.. /me reads | 17:18 |
weshay | btw https://logs.rdoproject.org/52/584452/7/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/7bf44d0/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-04_16_24_50 | 17:18 |
bfournie | weshay: hmm, different error | 17:19 |
bfournie | weshay: no valid host is usually infrastructure | 17:19 |
weshay | ya.. but related to ironic I think | 17:19 |
weshay | or that | 17:19 |
bfournie | weshay: will look at some more logs | 17:19 |
*** jpena is now known as jpena|off | 17:21 | |
weshay | bfournie, who does CI in your DFG? | 17:23 |
trown | mandre: I pushed the etcd container to tripleorocky | 17:23 |
bfournie | weshay: mainly derek | 17:24 |
hjensas | weshay: So placement return no candidates - https://logs.rdoproject.org/52/584452/7/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/7bf44d0/logs/undercloud/var/log/containers/nova/nova-scheduler.log.txt.gz#_2018-10-04_16_23_01_619 | 17:24 |
weshay | nice choice | 17:24 |
bfournie | yeah | 17:24 |
bfournie | hjensas: ah | 17:25 |
weshay | hjensas, thanks | 17:25 |
hjensas | weshay: earlier on there is some Warnings about "endpoint for placement service in RegionOne region not found" as well. | 17:26 |
weshay | hjensas, ya.. we have a fix for that.. puppet broke us last night | 17:26 |
*** gfidente is now known as gfidente|afk | 17:28 | |
weshay | hjensas, bfournie Ib7717911aba3267f855ac6682b0144bfe92034fb | 17:28 |
weshay | sorry https://review.openstack.org/#/c/607952/ | 17:29 |
hjensas | weshay: ok, let's hope for a short re-check party on that one then. | 17:30 |
weshay | added as a dep | 17:30 |
*** akrivoka has quit IRC | 17:31 | |
bfournie | cool | 17:31 |
bfournie | relocating, bbiab | 17:32 |
*** bfournie has quit IRC | 17:32 | |
*** amoralej is now known as amoralej|off | 17:37 | |
*** vinaykns has quit IRC | 17:38 | |
*** morazi_ has joined #tripleo | 17:48 | |
*** morazi has quit IRC | 17:48 | |
fultonj | slagle: i've reproduced http://paste.openstack.org/show/731116 do you have any time today to help me debug? | 17:49 |
slagle | fultonj: sure | 17:50 |
slagle | fultonj: care to tmate? | 17:51 |
fultonj | yep | 17:51 |
weshay | hjensas, can you please vote on https://review.openstack.org/#/c/607904/ ? | 17:56 |
hjensas | weshay: done. | 17:57 |
weshay | thanks | 17:58 |
*** ykarel|away has joined #tripleo | 17:59 | |
rook | bnemec: interesting, that was missing | 18:00 |
rook | bnemec: thanks | 18:00 |
*** pcaruana has quit IRC | 18:01 | |
*** ykarel_ has joined #tripleo | 18:04 | |
*** holser_ has joined #tripleo | 18:05 | |
*** holser_ has quit IRC | 18:05 | |
*** dciabrin has quit IRC | 18:05 | |
weshay | mwhahaha, gate | 18:05 |
weshay | mwhahaha, need to remove any ci changes | 18:05 |
weshay | https://review.openstack.org/606925 | 18:05 |
*** holser_ has joined #tripleo | 18:06 | |
*** ykarel|away has quit IRC | 18:07 | |
*** rbrady is now known as rbrady-afk | 18:09 | |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 18:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1793665 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1793665 in tripleo "multinode-oooq-container scenarios and Fs016/17/20 periodic jobs fails on validate-tempest: Unexpected response code received" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 18:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 18:10 |
mwhahaha | weshay: yea i missed that on i guess | 18:22 |
weshay | mwhahaha, trying https://review.openstack.org/#/c/608051/ | 18:27 |
*** lblanchard has quit IRC | 18:30 | |
*** moshele has quit IRC | 18:36 | |
*** raterch has quit IRC | 18:39 | |
*** lblanchard has joined #tripleo | 18:40 | |
*** bfournie has joined #tripleo | 18:50 | |
rook | bnemec: yo - ovb question - if pxe is failing, what is your protocol to look into. mtu looks right. I applied the patches. any thing else? | 18:51 |
*** agopi|long_lunch is now known as agopi | 18:54 | |
*** jcoufal has quit IRC | 18:57 | |
mwhahaha | rook: check the console of the nodes to see what its doing? | 18:59 |
rook | mwhahaha going to switch to the noop driver. | 19:00 |
rook | give that a shot | 19:00 |
toure | sshnaidm nhicher so I poured through all the logs on that gate, just following the trail and it looks like my initial suspicion is correct, storage is killing this job, the proof was confirmed with errors from nova, it is not able to create any resources on disk | 19:00 |
weshay | toure++ | 19:01 |
weshay | thank you | 19:01 |
toure | sure thing | 19:01 |
nhicher | toure: thanks, so no way to fix, we only need better storage ? | 19:02 |
toure | yeah | 19:02 |
toure | unavailable resources is a tough one | 19:03 |
toure | sorry for the bad news, wish there was a work around | 19:03 |
weshay | nhicher, having fun yet? | 19:04 |
nhicher | weshay: =), thanks for your help toure | 19:06 |
toure | sure thing | 19:07 |
toure | any time | 19:07 |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 19:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1793665 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1793665 in tripleo "multinode-oooq-container scenarios and Fs016/17/20 periodic jobs fails on validate-tempest: Unexpected response code received" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 19:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 19:10 |
*** diw has joined #tripleo | 19:10 | |
*** ykarel__ has joined #tripleo | 19:13 | |
diw | Hi, I was wondering if someone could help me get staging-ovirt support in my undercloud. I'm on CentOS7 and I've copied /usr/share/python-tripleoclient/undercloud.conf.sample to ~/underclloud.conf with the only change adding "enabled_hardware_types = ipmi,redfish,ilo,idrac,staging-ovirt" but when my undercloud finishes installing running openstack baremetal driver list returns an empty list. | 19:14 |
*** ykarel__ has quit IRC | 19:14 | |
*** ykarel__ has joined #tripleo | 19:14 | |
*** ykarel_ has quit IRC | 19:15 | |
*** ykarel_ has joined #tripleo | 19:17 | |
diw | As far as I can see ironic-api is running correctly. | 19:17 |
*** mjturek has quit IRC | 19:17 | |
*** ykarel__ has quit IRC | 19:20 | |
*** ykarel__ has joined #tripleo | 19:21 | |
*** ykarel_ has quit IRC | 19:23 | |
*** ykarel__ has quit IRC | 19:26 | |
diw | I've just found an error in the conductor log - DriverNotFoundInEntrypoint: Could not find the following items in the 'ironic.hardware.types' entrypoint: staging-ovirt. Did I miss a step to ensure the staging drivers get added to the container? | 19:30 |
*** gfidente|afk has quit IRC | 19:43 | |
*** slagle has quit IRC | 19:43 | |
*** jcoufal has joined #tripleo | 19:48 | |
*** mjturek has joined #tripleo | 19:49 | |
*** mjturek has quit IRC | 20:00 | |
*** jcoufal_ has joined #tripleo | 20:03 | |
*** raterch has joined #tripleo | 20:04 | |
raterch | is there anyone in here who works on the tripleo mistral plans? | 20:04 |
*** jcoufal has quit IRC | 20:05 | |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1793665 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 20:10 |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1793665 in tripleo "multinode-oooq-container scenarios and Fs016/17/20 periodic jobs fails on validate-tempest: Unexpected response code received" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 20:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 20:10 |
*** raterch has quit IRC | 20:10 | |
*** mjturek has joined #tripleo | 20:11 | |
*** mjturek has quit IRC | 20:17 | |
*** mjturek has joined #tripleo | 20:19 | |
*** slagle has joined #tripleo | 20:19 | |
*** mjturek has quit IRC | 20:23 | |
*** med_ has joined #tripleo | 20:26 | |
EmilienM | fultonj: https://review.openstack.org/#/c/604357/3/environments/undercloud.yaml | 20:34 |
EmilienM | it broke podman integration FYI | 20:34 |
EmilienM | because when ceph-ansible isn't installed, /usr/share/ceph-ansible doesn't exist | 20:34 |
EmilienM | and in contrario to Docker, podman doesn't create missing dirs (by design/choice) | 20:35 |
fultonj | EmilienM: i see, what do you think we should do? | 20:35 |
EmilienM | fultonj: 3 options | 20:35 |
EmilienM | 1) add a dep to tripleoclient to deploy ceph-ansible | 20:36 |
EmilienM | 2) add a host prep task in mistral-executor serviec to install ceph-ansible | 20:36 |
EmilienM | 3) add a host prep task to create the directory in mistral-executor service | 20:36 |
EmilienM | but this : | 20:36 |
EmilienM | https://review.openstack.org/#/c/604357/3/environments/undercloud.yaml | 20:36 |
EmilienM | this is ugly | 20:36 |
EmilienM | you could have created enable_ceph in undercloud.conf | 20:37 |
*** morazi_ has quit IRC | 20:37 | |
EmilienM | so what option should we take? | 20:37 |
EmilienM | I thought we could have podman in gate this week | 20:37 |
EmilienM | but you ruined my dream :( | 20:38 |
weshay | wooot.. EmilienM mwhahaha https://review.openstack.org/#/c/607952/ merged | 20:38 |
EmilienM | weshay: good | 20:38 |
mwhahaha | k let me restore all my stuff | 20:38 |
EmilienM | fultonj: so what's the plan? | 20:38 |
weshay | EmilienM, mwhahaha should we +2 EmilienM's patch first | 20:38 |
EmilienM | weshay: no it'll fail in gate | 20:38 |
EmilienM | weshay: ceph guys broke us | 20:38 |
mwhahaha | which patch | 20:39 |
EmilienM | https://review.openstack.org/#/c/604357 | 20:39 |
EmilienM | mwhahaha: my podman stuff | 20:39 |
*** holser_ has quit IRC | 20:39 | |
mwhahaha | oh | 20:39 |
*** slagle has quit IRC | 20:39 | |
mwhahaha | yea i don't want that stuff :D | 20:39 |
fultonj | i like #1 or #2 | 20:39 |
weshay | https://review.openstack.org/#/c/600517/ | 20:39 |
EmilienM | fultonj: it makes deps bigger... | 20:39 |
*** jtomasek has quit IRC | 20:39 | |
weshay | podman-0.9.3.1-3.gita3c4ce6.el7.x86_64 | 20:40 |
fultonj | #3 seems like a quicker fix | 20:40 |
fultonj | #3 to stop bleeding, consider #1 | 20:40 |
fultonj | EmilienM: couldn't we do #3 to keep the dream alive :) | 20:41 |
*** ansmith has quit IRC | 20:41 | |
EmilienM | fultonj: sure and then we have customers calling because they have an empty ceph-ansible directory :D | 20:42 |
EmilienM | and missed to install that rpm | 20:42 |
EmilienM | nah i'll add it as a dependency | 20:42 |
EmilienM | it's all good | 20:42 |
*** tosky has quit IRC | 20:42 | |
EmilienM | one more :D | 20:42 |
mwhahaha | how much MB is added to the install because of ceph-ansible? | 20:42 |
fultonj | EmilienM: thanks | 20:42 |
mwhahaha | is it pretty small or does it pull in the world | 20:43 |
EmilienM | mwhahaha: let me see | 20:43 |
*** tosky has joined #tripleo | 20:43 | |
fultonj | 2M | 20:43 |
EmilienM | one sec | 20:43 |
*** med_ has quit IRC | 20:43 | |
*** rdopiera has quit IRC | 20:43 | |
*** hamzy_ has quit IRC | 20:44 | |
EmilienM | No package ceph-ansible available | 20:45 |
EmilienM | by default | 20:45 |
EmilienM | I bet we need a special repo? | 20:45 |
fultonj | centos storage sig | 20:45 |
fultonj | e.g. http://mirror.centos.org/centos/7/storage/x86_64/ceph-luminous/ | 20:45 |
EmilienM | so we need to fix RDO repo first | 20:46 |
EmilienM | to include that repo by default | 20:46 |
EmilienM | right now I'm a dumb user, I deploy repos from doc and I can't install ceph-ansible | 20:46 |
EmilienM | if I add ceph-ansible as a dep of tripleoclient | 20:46 |
EmilienM | we break the world | 20:47 |
EmilienM | because http://mirror.centos.org/centos/7/storage/x86_64/ceph-luminous/ repo isn't installed by dfault | 20:47 |
mwhahaha | let's just revert it and add it correctly | 20:47 |
EmilienM | yes | 20:47 |
fultonj | sudo -E tripleo-repos current-tripleo-dev ceph | 20:47 |
bandini | any takers for an easy pike backport ? https://review.openstack.org/#/c/601077/ | 20:47 |
EmilienM | fultonj: i'll let you guys figure | 20:47 |
EmilienM | but this chance isn't good | 20:47 |
*** mjturek has joined #tripleo | 20:48 | |
* EmilienM files a bug and revert | 20:48 | |
fultonj | https://docs.openstack.org/tripleo-docs/latest/install/installation/installation.html#installing-the-undercloud | 20:48 |
EmilienM | "If you intend to deploy Ceph in the overcloud, or configure the overcloud to use an external Ceph cluster, and are running Pike or newer, then install ceph-ansible on the undercloud:" | 20:48 |
EmilienM | what if I don't intend? | 20:49 |
EmilienM | I still need it | 20:49 |
fultonj | with that change, yes | 20:49 |
EmilienM | so if you want me to add it as a dependency | 20:49 |
EmilienM | you'll need to change the doc, the default RDO repos and quickstart | 20:49 |
mwhahaha | which do we ship ceph-ansible by default elsewhere? | 20:50 |
fultonj | right, so it takes a few steps to add it as a dep | 20:50 |
fultonj | ceph tools | 20:50 |
fultonj | though it's still cross shipped | 20:50 |
fultonj | as a dep downstream | 20:50 |
fultonj | i don't think we can add it as a dep quickly without some coordination and agreement | 20:51 |
fultonj | so i thought #3 for bleeding | 20:51 |
EmilienM | #3 is hiding the issue | 20:51 |
fultonj | temporarily | 20:51 |
EmilienM | but fine | 20:51 |
fultonj | but yes | 20:51 |
mwhahaha | it would be better to only include that mount if ceph is enabled or do some host prep step to install ceph-ansible that throws a warning if it fails | 20:51 |
fultonj | valid bug to be assigned to me or gfidente | 20:52 |
EmilienM | fultonj: i'm filling one | 20:53 |
fultonj | EmilienM: thanks | 20:53 |
EmilienM | fultonj: so you're proposing a patch? | 20:53 |
EmilienM | or me | 20:54 |
fultonj | for #3? | 20:54 |
fultonj | i can if you can show me where prep script is | 20:54 |
*** mjturek has quit IRC | 20:54 | |
*** lblanchard has quit IRC | 20:54 | |
*** trown is now known as trown|outtypewww | 20:54 | |
fultonj | unless you want to do it (you're probably faster but i can once i know where to put the check) | 20:54 |
mwhahaha | https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/mistral-engine.yaml#L124 | 20:55 |
EmilienM | fultonj: https://bugs.launchpad.net/tripleo/+bug/1796188 | 20:55 |
EmilienM | the bug | 20:55 |
openstack | Launchpad bug 1796188 in tripleo "Undercloud fails to deploy (with Podman) if ceph-ansible isn't installed" [High,Triaged] | 20:55 |
fultonj | EmilienM: i can file patch | 20:56 |
EmilienM | mwhahaha: thats not mistral executor | 20:57 |
fultonj | i'll add you to review +alex | 20:57 |
EmilienM | fultonj: thx for your help | 20:57 |
mwhahaha | oh thought it was engine | 20:57 |
fultonj | engine | 20:57 |
mwhahaha | eitherway, something like that | 20:57 |
fultonj | vs exec | 20:57 |
fultonj | it's exec | 20:57 |
EmilienM | we need exec | 20:57 |
mwhahaha | https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/mistral-executor.yaml#L140 | 20:57 |
fultonj | i rememver these files | 20:57 |
mwhahaha | fine since you can't s/enginer/executor | 20:57 |
EmilienM | fultonj: if you want to test it in your box, change undercloud.conf to have container_cli = podman | 20:58 |
EmilienM | and you'll see how that works | 20:58 |
fultonj | EmilienM: wow | 20:58 |
fultonj | no other patches needed ? | 20:58 |
EmilienM | fultonj: oh and disable selinux please, we have an ongoing bug that is being fixed | 20:59 |
EmilienM | fultonj: nope | 20:59 |
EmilienM | fultonj: I told you, we were ready to go in gate | 20:59 |
EmilienM | and my dreams are gone ! | 20:59 |
mwhahaha | weshay: can you pike the appropriate people to review https://review.openstack.org/#/c/604487/ | 20:59 |
weshay | mwhahaha, murderer | 21:00 |
*** mwhahaha changes topic to "Welcome to Stein | CI Status: YELLOWish? - ovb is sad still | https://docs.openstack.org/tripleo-docs/latest/" | 21:00 | |
*** dprince has quit IRC | 21:04 | |
*** thrash is now known as thrash|g0ne | 21:04 | |
diw | I've been doing some digging it looks like openstack-ironic-staging-drivers isn't included in the container, I'm guessing I need to rebuild the ironic-conductor container and use it locally? Or do you think the kolla folks would add it to the ironic-conductor spec? | 21:07 |
mwhahaha | that's a question for the kolla folks :D i couldn't see why not | 21:08 |
mwhahaha | if you need it in tripleo, you could always propose it to our overrides but it would likely be accepted in kolla | 21:08 |
diw | I was working off https://redhatstackblog.redhat.com/2018/07/10/virtualize-your-openstack-control-plane-with-red-hat-virtualization-and-red-hat-openstack-platform-13/ | 21:09 |
diw | I'm guessing the RHOSP official images must include it in the image? | 21:09 |
mwhahaha | no idea | 21:09 |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 21:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 21:10 |
diw | I'll see about proposing it to the kolla guys. | 21:10 |
mwhahaha | diw: oh no so i think that's for the undercloud which in Queens was not containerized | 21:11 |
mwhahaha | so the driver could just be installed on the undercloud | 21:11 |
mwhahaha | with Rocky+ it's containerized and we would need that driver installed in the ironic container | 21:11 |
mwhahaha | i wouldn't see why you couldn't land that in kolla | 21:11 |
*** agopi has quit IRC | 21:12 | |
*** itlinux has quit IRC | 21:14 | |
*** ade_lee has quit IRC | 21:14 | |
diw | I'll raise it with them in the morning. Thanks | 21:15 |
fultonj | EmilienM: https://review.openstack.org/#/c/608086/ | 21:16 |
* fultonj has to test | 21:17 | |
*** itlinux has joined #tripleo | 21:17 | |
EmilienM | fultonj: looking | 21:17 |
EmilienM | fultonj: looks good to me | 21:18 |
fultonj | ok, cool | 21:18 |
fultonj | EmilienM: is there an experimental job? | 21:18 |
EmilienM | no | 21:18 |
EmilienM | fultonj: I8942811c210f442d3cb630721c5105b725293d29 | 21:18 |
EmilienM | I'm about to run depends-on | 21:18 |
EmilienM | fultonj: https://review.openstack.org/#/c/600517/ | 21:19 |
fultonj | ok, cool | 21:19 |
EmilienM | mwhahaha: where is the gerrit bot? | 21:19 |
EmilienM | on pto or what | 21:19 |
mwhahaha | EmilienM: so i asked | 21:19 |
mwhahaha | it thinks it is here | 21:19 |
mwhahaha | but isn't | 21:19 |
mwhahaha | they need to patch up the bot | 21:19 |
EmilienM | lol | 21:19 |
mwhahaha | so it's off telling us all the things are merging, but isn't actually doing it | 21:20 |
mwhahaha | http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2018-10-04.log.html#t2018-10-04T16:43:49 | 21:20 |
*** toure is now known as toure|gone | 21:22 | |
mwhahaha | weshay: https://review.openstack.org/#/c/606046/ is the patch to enable the extra tests in the standalone | 21:23 |
*** diw has quit IRC | 21:25 | |
fultonj | EmilienM: in other news https://gitlab.com/fultonj/tripleo-standalone-edge | 21:29 |
fultonj | i was able to get it working for thanks for getting it started ^ | 21:30 |
fultonj | i have a script to export the info from heat to generate the environment file inputs based on slagle's work so no manual edits were required | 21:31 |
EmilienM | fultonj: wow nice | 21:35 |
EmilienM | https://gitlab.com/fultonj/tripleo-standalone-edge/blob/master/create-compute-stack-env.sh | 21:36 |
EmilienM | i see | 21:36 |
*** panda is now known as panda|off | 21:36 | |
*** vinaykns has joined #tripleo | 21:36 | |
fultonj | a little hacky but a start | 21:36 |
* fultonj has a hard stop now | 21:37 | |
fultonj | ttyl | 21:37 |
*** Vorrtex has quit IRC | 21:49 | |
*** weshay is now known as weshay_pto | 21:51 | |
*** itlinux has quit IRC | 22:05 | |
*** jcoufal_ has quit IRC | 22:07 | |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 22:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 22:10 |
*** social has quit IRC | 22:10 | |
*** med_ has joined #tripleo | 22:11 | |
mwhahaha | looks like rdo cloud is no bueno again | 22:12 |
mwhahaha | https://logs.rdoproject.org/27/607727/1/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/d2f2064/job-output.txt.gz#_2018-10-04_21_47_06_539608 | 22:12 |
*** social has joined #tripleo | 22:22 | |
*** itlinux has joined #tripleo | 22:23 | |
*** bdodd has quit IRC | 22:25 | |
*** itlinux has quit IRC | 22:25 | |
*** rcernin has joined #tripleo | 22:28 | |
*** vinaykns has quit IRC | 22:37 | |
*** social has quit IRC | 22:42 | |
*** bdodd has joined #tripleo | 22:42 | |
*** social has joined #tripleo | 22:44 | |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1795718 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 23:10 |
openstack | Launchpad bug 1795718 in tripleo "Exception: Error inspecting image: docker://docker.io/ server misbehaving" [Critical,Triaged] | 23:10 |
*** tosky has quit IRC | 23:17 | |
*** slagle has joined #tripleo | 23:35 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!