*** agopi_ is now known as agopi | 00:04 | |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
---|---|---|
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 00:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 00:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 00:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 00:10 |
openstackgerrit | Nguyen Van Trung proposed openstack/instack master: Don't quote {posargs} in tox.ini https://review.openstack.org/609189 | 01:08 |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 01:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 01:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 01:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 01:10 |
*** medberry has quit IRC | 01:14 | |
*** mrsoul has joined #tripleo | 01:19 | |
*** phuongnh has joined #tripleo | 01:20 | |
*** ayoung has joined #tripleo | 01:48 | |
*** huynq has joined #tripleo | 01:54 | |
*** huynq has quit IRC | 01:55 | |
*** huynq has joined #tripleo | 01:56 | |
*** huynq_ has joined #tripleo | 01:57 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 02:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 02:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 02:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 02:10 |
*** ykarel|away has joined #tripleo | 02:15 | |
*** rnoriega has quit IRC | 02:36 | |
*** lhinds has quit IRC | 02:37 | |
*** haleyb has quit IRC | 02:37 | |
*** psachin has joined #tripleo | 02:55 | |
*** skramaja has joined #tripleo | 03:02 | |
*** saneax has joined #tripleo | 03:08 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 03:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 03:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 03:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 03:10 |
*** ykarel|away is now known as ykarel | 03:50 | |
*** udesale has joined #tripleo | 03:55 | |
*** udesale has quit IRC | 03:55 | |
*** udesale has joined #tripleo | 03:56 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 04:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 04:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 04:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 04:10 |
*** ramishra has joined #tripleo | 04:23 | |
*** Petersingh has joined #tripleo | 04:34 | |
*** Petersingh is now known as Petersingh|afk | 04:43 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Set hierdata for swift server workers conditionally https://review.openstack.org/611568 | 04:53 |
Tengu | hello there :) | 04:58 |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 05:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 05:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 05:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 05:10 |
*** apetrich has quit IRC | 05:23 | |
*** Petersingh|afk is now known as Petersingh | 05:23 | |
*** agurenko has joined #tripleo | 05:23 | |
pvc_ | hi | 05:37 |
pvc_ | may i know where i can parse the paremeters for overcloud deploy on rocky? | 05:37 |
*** apetrich has joined #tripleo | 05:39 | |
openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates stable/queens: Add provision to specify java arguments to ODL https://review.openstack.org/612237 | 05:42 |
openstackgerrit | Janki Chhatbar proposed openstack/puppet-tripleo stable/queens: Add support for ODL-OVS IPv6 deployment https://review.openstack.org/612238 | 05:47 |
openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Fix variable name for workload_launch task. https://review.openstack.org/611245 | 05:49 |
openstackgerrit | Merged openstack/os-net-config master: Retry ovs-appctl command https://review.openstack.org/610714 | 05:49 |
*** ratailor has joined #tripleo | 05:50 | |
openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/rocky: Add ContainerImagePrepare to custom roles_data https://review.openstack.org/612239 | 05:51 |
*** ksambor has joined #tripleo | 05:51 | |
openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates stable/queens: Add config option for ODL IPv6 deployment https://review.openstack.org/612242 | 05:58 |
openstackgerrit | Janki Chhatbar proposed openstack/tripleo-common stable/queens: Make ODL healthcheck IPv6 compatible https://review.openstack.org/612243 | 06:01 |
openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Fix linters E102 Error https://review.openstack.org/612244 | 06:02 |
*** quiquell|off is now known as quiquell | 06:04 | |
quiquell | Good morning | 06:04 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-quickstart-extras master: WIP Set identity.region with tempestconf explicitly https://review.openstack.org/612245 | 06:06 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow https://review.openstack.org/606879 | 06:08 |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 06:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 06:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 06:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 06:10 |
*** iranzo has joined #tripleo | 06:12 | |
*** gvrangan has joined #tripleo | 06:12 | |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606881 | 06:14 |
*** mschuppert has joined #tripleo | 06:16 | |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates stable/rocky: Use different base virtual_router_id on openshift https://review.openstack.org/612249 | 06:20 |
*** pcaruana has joined #tripleo | 06:21 | |
*** iranzo has quit IRC | 06:21 | |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606879 | 06:26 |
*** psachin has quit IRC | 06:29 | |
*** janki has joined #tripleo | 06:30 | |
openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates stable/rocky: Use nova_api DB for [placement_database] -> connection https://review.openstack.org/611617 | 06:31 |
*** jfrancoa has joined #tripleo | 06:33 | |
*** iurygregory has joined #tripleo | 06:35 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Set hierdata for swift server workers conditionally https://review.openstack.org/611568 | 06:37 |
*** rdopiera has joined #tripleo | 06:41 | |
*** jbadiapa has joined #tripleo | 06:42 | |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606879 | 06:44 |
*** chkumar|off is now known as chandankumar | 06:45 | |
chandankumar | marios: we need to workflow this https://review.openstack.org/#/c/610596/ and https://review.openstack.org/#/c/610600/ in order to unblock standalone tempest work | 06:46 |
chandankumar | quiquell: Tengu marios \o/ | 06:47 |
Tengu | hey chandankumar :] | 06:48 |
chandankumar | Tengu: regarding full tempest on standalone swift badurl is poping on tripleo-quickstart side but the same tests are working against puppet-swift | 06:49 |
chandankumar | Tengu: tripleo-quickstart -> http://logs.openstack.org/46/606046/13/check/tripleo-ci-centos-7-standalone/09bc2d4/logs/tempest.html.gz and puppet-swift -> https://review.openstack.org/609943 | 06:50 |
chandankumar | let me rebase it | 06:50 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Enable full tempest api and scenario tests for basic services https://review.openstack.org/606046 | 06:51 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Enable full tempest api and scenario tests for basic services https://review.openstack.org/606046 | 06:51 |
jaosorior | how are the ovb jobs looking today? | 06:53 |
* Tengu in "oidaaa" mood today | 06:53 | |
jaosorior | oidaaa? | 06:54 |
Tengu | https://9gag.com/gag/aA3Y9Xd | 06:54 |
* chandankumar grabs the coffee | 06:54 | |
Tengu | now you figure the meaning ;) | 06:54 |
jaosorior | skramaja: cany ou revisit this https://review.openstack.org/#/c/607555/8 ? | 06:54 |
skramaja | ack jaosorior | 06:55 |
jaosorior | Tengu: lol | 06:55 |
Tengu | :) | 06:55 |
*** pcaruana has quit IRC | 06:58 | |
*** rcernin has quit IRC | 06:59 | |
*** ccamacho has joined #tripleo | 07:03 | |
*** rcernin has joined #tripleo | 07:05 | |
jaosorior | yolanda: around? | 07:06 |
pvc_ | Tengu | 07:06 |
pvc_ | hi | 07:06 |
pvc_ | anyone can help me on overcloud deploy on rocky | 07:06 |
jaosorior | skramaja: thanks for checking it out | 07:07 |
*** rcernin has quit IRC | 07:07 | |
*** rascasoft has joined #tripleo | 07:08 | |
quiquell | chandankumar: I supose your reviews about standalone + tempest at puppet projects make more sense than mines just activating it ? | 07:10 |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 07:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 07:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 07:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 07:10 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606879 | 07:11 |
*** jtomasek has joined #tripleo | 07:12 | |
*** pcaruana has joined #tripleo | 07:13 | |
pvc_ | hello guys anyone? | 07:14 |
*** hberaud has joined #tripleo | 07:15 | |
*** pvc has joined #tripleo | 07:17 | |
pvc | anyone guys | 07:17 |
*** f2 has joined #tripleo | 07:18 | |
*** f2 is now known as florianf | 07:18 | |
yolanda | hi jaosorior | 07:19 |
*** pvc_ has quit IRC | 07:19 | |
bandini | tested and working fix to start your monday afresh https://review.openstack.org/#/c/611551/ | 07:20 |
jaosorior | yolanda: hey, is the hardened image building tested anywhere in upstream CI? | 07:21 |
skramaja | sure jaosorior | 07:21 |
jaosorior | bandini: any idea why the ovb jobs failed? | 07:21 |
chandankumar | jaosorior: hello | 07:22 |
yolanda | jaosorior, we do a testing downstream for the changes | 07:22 |
chandankumar | jaosorior: Is it possible to use paunch to manage tempest container provided tempest is an application | 07:22 |
jaosorior | chandankumar: hello | 07:22 |
chandankumar | ? | 07:22 |
jaosorior | chandankumar: is should be possible yes, the only thing would be when it gets triggered, which I guess was the main reason it wasn't being managed by paunch | 07:23 |
yolanda | but there is no upstream test for it, i remember talking about that, but there was this problem of bandwith, too much tests | 07:23 |
yolanda | jaosorior, as the test would need to build the image + do a deploy | 07:23 |
chandankumar | jaosorior: I have not looked at paunch first and how to consume it there | 07:23 |
jaosorior | chandankumar: you would need to generate a yaml file that paunch will read to launch temptest | 07:24 |
jaosorior | chandankumar: paunch is nice cause it'll re-read the configuration file and if there are changes, it'll relaunch the container. But this is not needed for temptest | 07:24 |
pvc | anyone can help me in overcloud deploy on rocky? | 07:24 |
bandini | jaosorior: all three failures are different failures (1 timeout, 1 failed to build image, 1 pip install failure) | 07:24 |
jaosorior | chandankumar: tempest you just launch and that's it. so no need to restart it or look at the configuration in that sense, so why paunch? | 07:25 |
chandankumar | jaosorior: if we somehow integrate we integrate with openstack-ansible-os_tempest role which will generate the required the tempest artifact in yaml format and then re launch the container to run the tempest tests | 07:25 |
jaosorior | bandini: any idea whey the build image issue happened? | 07:25 |
chandankumar | jaosorior: yup restart not needed | 07:25 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Don't use mixed_upgrade special release files https://review.openstack.org/604032 | 07:25 |
chandankumar | jaosorior: I was speaking with alan, he asked me to take a look at paunch if somehow we can use paunch to manage tempest container also | 07:26 |
bandini | jaosorior: not sure yet https://logs.rdoproject.org/51/611551/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/9d52b25/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz#_2018-10-21_18_50_34 seems vbmc node either broke down or some general timeout | 07:26 |
chandankumar | instead of running stuff through shell script | 07:27 |
jaosorior | chandankumar: define manage, what do you need to do? | 07:27 |
*** Petersingh is now known as Petersingh|mtg | 07:28 | |
*** huynq has quit IRC | 07:29 | |
chandankumar | jaosorior: in tempest container side, we are creating a script https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/configure-tempest.sh.j2#L68 and then copy all the tempest related artifact to a dir and then mount it to container https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/run-tempest.sh.j2#L49 and then | 07:30 |
chandankumar | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/run-tempest.sh.j2#L84 then once tempest run is finished, we are copying the stuff to proper directory so that html report and stackviz report will get generated, can we manage the above stuff through paunch for tempest container? | 07:30 |
jaosorior | chandankumar: so with paunch (or any other tool) you'll still to generate the configuration and get it in the container somehow | 07:32 |
*** jpena|off is now known as jpena | 07:32 | |
jaosorior | chandankumar: with paunch you'll just specify it in yaml rather than the script | 07:32 |
*** Petersingh|mtg has quit IRC | 07:33 | |
*** udesale has quit IRC | 07:33 | |
*** Petersingh|mtg has joined #tripleo | 07:33 | |
chandankumar | jaosorior: specifying through yaml it will be much easier than script, I will take a look and propose a patch | 07:33 |
*** udesale has joined #tripleo | 07:33 | |
jaosorior | chandankumar: alright! then it seems appropriate :) | 07:33 |
chandankumar | jaosorior: any example please point me | 07:33 |
jaosorior | chandankumar: well, the paunch readme is a good reference https://github.com/openstack/paunch | 07:34 |
chandankumar | jaosorior: thanks :-) | 07:34 |
*** srini_ has quit IRC | 07:36 | |
*** cylopez has joined #tripleo | 07:38 | |
*** tosky has joined #tripleo | 07:42 | |
*** two_oes has joined #tripleo | 07:45 | |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606879 | 07:47 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Add release file for fedora 28 https://review.openstack.org/610468 | 07:50 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Add release file for fedora 28 https://review.openstack.org/610468 | 07:50 |
openstackgerrit | Udi Kalifon proposed openstack/tempest-tripleo-ui master: Selenium infra https://review.openstack.org/605424 | 07:52 |
chandankumar | arxcruz: feel free to take a look at this series of patches https://review.openstack.org/#/q/topic:tempest_standalone+status:open related to this task https://tree.taiga.io/project/tripleo-ci-board/us/168 | 07:53 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Add release file for fedora 28 https://review.openstack.org/610468 | 07:54 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-docs master: Remove tripleo.sh entry from developer docs. https://review.openstack.org/612274 | 07:55 |
*** bogdando has joined #tripleo | 07:57 | |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 08:00 |
Tengu | jaosorior: running for the very first time an overcloud deploy with podman. And selinux enabled. Bam. | 08:01 |
Tengu | and it will probably be a major failure. | 08:01 |
openstackgerrit | Harald Jensås proposed openstack/puppet-tripleo master: Fix Undercloud masquerading firewall rules https://review.openstack.org/609858 | 08:03 |
*** paramite has joined #tripleo | 08:06 | |
*** amoralej|off is now known as amoralej | 08:09 | |
*** shardy has joined #tripleo | 08:09 | |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 08:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 08:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 08:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 08:10 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-quickstart-extras master: WIP Set identity.region with tempestconf explicitly https://review.openstack.org/612245 | 08:12 |
*** panda has joined #tripleo | 08:13 | |
*** shardy has quit IRC | 08:16 | |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 08:18 |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Support for libvirt volume multipath https://review.openstack.org/611655 | 08:20 |
Tengu | oida… pxe seems to fail for some unknown reason. | 08:20 |
*** akrivoka has joined #tripleo | 08:20 | |
*** sshnaidm|off is now known as sshnaidm|ruck | 08:22 | |
*** paramite|clone has joined #tripleo | 08:24 | |
*** jaganathan has joined #tripleo | 08:25 | |
*** paramite has quit IRC | 08:26 | |
*** holser_ has joined #tripleo | 08:27 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Fix cinder_api_apache error during upgrade. https://review.openstack.org/612279 | 08:30 |
chem` | jistr: hi, FYI ^ | 08:30 |
*** chem` is now known as chem | 08:30 | |
*** shardy has joined #tripleo | 08:31 | |
*** Petersingh|mtg is now known as Petersingh|lunch | 08:31 | |
chem | jistr: we definitively need the standalone upgrade merge asap, I've tried to get a clean patch over the we, but this morning it can't merge and I'm adding that patch as a depends-on :) | 08:32 |
chem | quiquell: ^ | 08:32 |
jistr | chem: ack, thanks | 08:32 |
shardy | marios: Hey, good morning - FYI my revert-revert at https://review.openstack.org/#/c/611800/ passed undercloud upgrade CI | 08:32 |
shardy | so I am confused | 08:32 |
chem | jistr: not sure it's the right fix, didn't look too hard. | 08:32 |
jistr | chem: probably. I just wonder about naming the registered variable and the fact with the same name. | 08:33 |
jistr | chem: and we should check nova and ironic too | 08:33 |
chem | jistr: nova and ironic seems clean | 08:33 |
jistr | chem: cool, thanks | 08:34 |
ramishra | Anyone else seeing issues with quickstart after https://review.openstack.org/#/c/610475/ merged? . It seems to be failing for me as python 3.4 does not seem compatible with ansible 2.5.7 | 08:34 |
chem | jistr: quiquell: so I did the small refactor this week end, and changing get_dlrn_hash position in emit release (4loc change) induced 92 loc change in the test code \o/ | 08:34 |
chandankumar | ramishra: Hello | 08:34 |
ramishra | chandankumar: hi | 08:35 |
chandankumar | ramishra: All swift tests are passing against puppet-swift on standalone https://review.openstack.org/609943 but here when trigeer full tempest on standalone https://review.openstack.org/606046 it is failing | 08:35 |
chandankumar | ramishra: the same env is used at both place | 08:35 |
ramishra | chandankumar: https://review.openstack.org/#/c/612245/ may help | 08:36 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Remove old config/release files https://review.openstack.org/606944 | 08:36 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Remove old config/release files https://review.openstack.org/606944 | 08:36 |
chandankumar | ramishra: thanks :-) | 08:36 |
*** gfidente has joined #tripleo | 08:37 | |
marios | ack shardy will do i noted the same when i looked will you please first un -1 :) | 08:39 |
marios | shardy: well i mean i left a query did you change something there otherwise why is it green | 08:40 |
openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Add standalone upgrade to emit release. https://review.openstack.org/606996 | 08:40 |
openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/tripleo-ci master: New workflow for standalone upgrade. https://review.openstack.org/604706 | 08:40 |
marios | shardy: oh i see your second line (it was a few lines up ) so we don't know | 08:40 |
quiquell | chem: testing impact is too bad, we need jistr change to simplify it, maybe you can merge the too so further refactoring is less painful | 08:40 |
quiquell | chem, jistr: Also now that the script is growing, looks like it needs some refactoring to reduce function/complexity ratio | 08:41 |
jistr | quiquell, chem: i'm not sure about merging the two, combining refactoring with factual change can sometimes cause deep trouble | 08:41 |
shardy | marios: removed WIP but I didn't change anything, so it'd be nice to be sure this won't break again :) | 08:41 |
quiquell | jistr: I mean the review about refactoring unit tests, not emit_releases refactoring | 08:42 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: standalone support for quickstart on libvirt https://review.openstack.org/591540 | 08:42 |
jistr | quiquell, chem: we could flip their order, or i could do a rebase after chem's change merges to prevent too many rebases | 08:42 |
chem | quiquell: jistr's change won't help for this particular issue issue https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/emit_releases_file/test_release_name.py#L106 | 08:42 |
shardy | marios: I was hoping to get a CI failure as I couldn't see any reason for the failure in recent commits or my local testing | 08:42 |
* shardy wonders if something was using an old tripleo-common perhaps? | 08:43 | |
quiquell | chem: It will help in case you have to change something, so you will need less changes at unit tests, I think | 08:43 |
chem | jistr: quiquell and yes I though about changing the order of the commit, but the refactor in the testing code needs to go deeper | 08:43 |
*** hberaud has quit IRC | 08:43 | |
quiquell | chem, jistr: Ahhh ok if the refactoring is not finished yet, let's just not merge them, ack. | 08:43 |
chem | quiquell: nope, not in that case, see my comment in the jistr patch https://review.openstack.org/#/c/611842/2/scripts/emit_releases_file/test_release_name.py | 08:44 |
*** hberaud has joined #tripleo | 08:45 | |
shardy | If something was somehow missing https://review.openstack.org/#/c/605046/ then the inventory would be missing the necessary vars, but that merged 2 days before my t-h-t patch, so I don't have any explanation for what may have caused the error | 08:45 |
shardy | marios: ^^ | 08:45 |
quiquell | chem: I think with python mocks there were individual checking of side_effects instead of a list so you can ignore the order | 08:45 |
Tengu | weeee.... Hitting what looks like resource shortage on the undercloud: 2018-10-22 08:41:32Z [overcloud]: DELETE_FAILED Resource DELETE failed: DBConnectionError: resources.ComputeServiceChain.resources.ServiceChain: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: u'SELECT stack.action AS stack_action, stack.status AS stack_statu | 08:46 |
Tengu | I love that. moare! :D | 08:46 |
Tengu | or, in only one word: «oidaa…» with a very annoyed face :] | 08:47 |
chem | quiquell: well, I definitively think it should be possible, but each call has to return different values, and as I would need some time to figure out how to do it cleanly. | 08:47 |
chem | quiquell: in the end I think emit release should use some class and object and then thing would start to get easier | 08:48 |
marios | shardy: ack noted, i'll have a look in a bit and bring it to scrum this afternoon depending on what i find/not i see you've added a comment on the review for now thanks | 08:48 |
marios | shardy: agree i was sure it was related given the error we had | 08:48 |
chem | quiquell: but that's ... another job/revie | 08:48 |
shardy | marios: ack sounds good, let me know if I can do anything to help - I've got more patches that depend on that revert, but I'll hold off rebasing pending your feedback | 08:49 |
ramishra | Tengu: Is that on master and has https://review.openstack.org/#/c/586282/? | 08:49 |
quiquell | chem: Yep, is big enough for OOP, btw, chem, jistr thanks for the big effort to turn the emit releases into a proper thing, we didn't have time for it. | 08:50 |
Tengu | ramishra: hmm yeah, should be on master, up-to-date, custom built o t-h-t | 08:51 |
spsurya | cores please review https://review.openstack.org/#/c/608888/ | 08:51 |
Tengu | ramishra: yeah, can confirm, I've rebased, and I have that one in the log. | 08:52 |
marios | shardy: ack | 08:53 |
ramishra | Tengu: OK, therve https://bugs.launchpad.net/tripleo/+bug/1783995 is seen after the fix it seems ^^ | 08:53 |
openstack | Launchpad bug 1783995 in tripleo "overcloud upgrade converge failed on "Lost connection to MySQL server during query" " [High,Fix released] - Assigned to Thomas Herve (therve) | 08:53 |
therve | Tengu: do you have the full traceback? | 08:54 |
Tengu | therve: hm, nah, sorry - was pretty sure it was due to my env, not something more wide :/. | 08:54 |
therve | OK :) | 08:54 |
Tengu | after a second attempt at deleting the stack, it passed. | 08:54 |
Tengu | but as I'm pretty sure I'll need to re-delete the stack, I'll be able to provide some more info. | 08:55 |
Tengu | I'm working on the overcloud deploy with podman + selinux. | 08:55 |
Tengu | so yeah. I'll get many failures :). | 08:55 |
*** ykarel_ has joined #tripleo | 08:57 | |
*** ykarel has quit IRC | 09:00 | |
*** yprokule has joined #tripleo | 09:04 | |
*** ykarel_ is now known as ykarel | 09:08 | |
*** slaweq has joined #tripleo | 09:08 | |
*** salmankhan has joined #tripleo | 09:08 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: standalone support for quickstart on libvirt https://review.openstack.org/591540 | 09:09 |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 09:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 09:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 09:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 09:10 |
*** derekh has joined #tripleo | 09:11 | |
*** Petersingh|lunch is now known as Petersingh | 09:11 | |
*** ykarel is now known as ykarel|lunch | 09:14 | |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Revert "Use dnf and python3 on platforms where these are default" https://review.openstack.org/612289 | 09:15 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add patchset option to compare-reviews https://review.openstack.org/611558 | 09:16 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Install ansible with pip https://review.openstack.org/612290 | 09:16 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Install ansible with pip https://review.openstack.org/612290 | 09:17 |
Tengu | therve: ramishra so basically: OOMKiller is here - I'm still running the undercloud with "only" 16G of ram... duh. | 09:20 |
Tengu | adding 10G of swap.... pff. | 09:22 |
Tengu | what a monster. | 09:22 |
therve | Tengu: What's taking memory? | 09:22 |
Tengu | oh well, there was that whole thread about caping memory to 24G, remember? | 09:22 |
Tengu | don't remember if it was in infrared or oooq though. | 09:23 |
openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: OVN Metadata Agent: configure OVS Bridge https://review.openstack.org/612291 | 09:23 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Ensure correct tmp ownership for Gnocchi https://review.openstack.org/611827 | 09:23 |
Tengu | therve: I'd say: "don't try to deploy a 3-controllers + 3-ceph + 1-compute on that undercloud". | 09:24 |
openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: WIP: Enabling CI for OVS-DPDK deployment https://review.openstack.org/586969 | 09:24 |
Tengu | therve: minimals aren't sufficient. | 09:24 |
therve | Tengu: Well, because nobody looks at the issues | 09:24 |
therve | If we keep ignoring problems you'll need 32G next month | 09:25 |
Tengu | therve: I proposed some ways to do that, but apparently, nobody's interested, or doesn't care, or we just don't have time. | 09:25 |
Tengu | therve: I know. | 09:25 |
therve | I care and I looked at the problem for heat at least | 09:25 |
therve | That's why I'm asking what's taking memory | 09:25 |
Tengu | therve: the best way would still be imho "use container limitation, check what's exploding, investigate WHY" | 09:26 |
therve | Well you're talking in the abstract, and I'm asking about details | 09:27 |
Tengu | I don't have monitoring stuff in order to point what's taking the memory... | 09:27 |
Tengu | also proposed to get some real tool with common configuration, like collectd or something like that, something easy to deploy just so that we can actually gather information. | 09:28 |
therve | I mean, just a ps would be some info right now :) | 09:28 |
openstackgerrit | Saravanan KR proposed openstack/tripleo-quickstart master: WIP: Enable OVS-DPDK in CI on featureset034 https://review.openstack.org/537886 | 09:29 |
*** dtantsur|afk is now known as dtantsur | 09:30 | |
*** sambetts|afk is now known as sambetts | 09:30 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Enable _member_ role for undercloud install. https://review.openstack.org/611677 | 09:32 |
chandankumar | Tengu: ramishra https://review.openstack.org/606046 full tempest passed | 09:32 |
chandankumar | without regionone patch | 09:32 |
*** akrivoka has quit IRC | 09:32 | |
*** akrivoka has joined #tripleo | 09:32 | |
chandankumar | Tengu: ramishra http://logs.openstack.org/46/606046/15/check/tripleo-ci-centos-7-standalone/823272c/logs/tempest.html.gz | 09:32 |
chandankumar | arxcruz: ^^ | 09:33 |
chandankumar | total time is 2 hour and 25 mins people will kill me | 09:33 |
openstackgerrit | Udi Kalifon proposed openstack/tempest-tripleo-ui master: Selenium infra https://review.openstack.org/605424 | 09:33 |
ramishra | chandankumar: Dunno, If that's predictable, probably depends on the sequence of tests run? Region set does not seem correct to me in tempest though | 09:35 |
* chandankumar relooks at the patch region one | 09:35 | |
ramishra | chandankumar: may be you can recheck a few times to see if it's actually fixed or we need to set the region explicitly to correct one | 09:36 |
chandankumar | ramishra: sure | 09:36 |
*** zzzeek_ has quit IRC | 09:37 | |
chandankumar | ramishra: I think better fix if need for the same will should go to python-tempestconf | 09:38 |
chandankumar | ramishra: here https://github.com/openstack/python-tempestconf/blob/master/config_tempest/main.py#L366 | 09:39 |
ramishra | chandankumar: yeah that would be good | 09:39 |
*** dsneddon has quit IRC | 09:39 | |
chandankumar | ramishra: in future we are going to do rm-fr validate-tempest role in favour of openstak-ansible-tempest role | 09:39 |
*** zzzeek has joined #tripleo | 09:40 | |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 09:42 |
*** skramaja has quit IRC | 09:44 | |
*** bnemec has joined #tripleo | 09:45 | |
*** paramite|clone is now known as mmagr | 09:46 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo master: Make sure that the _member_ role is assigned to admin. https://review.openstack.org/611919 | 09:49 |
janki | ykarel|lunch, hi | 09:50 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-quickstart-extras master: WIP Set identity.region with tempestconf explicitly https://review.openstack.org/612245 | 09:52 |
*** bnemec has quit IRC | 09:53 | |
*** iurygregory is now known as iury|lunch | 09:56 | |
*** psachin has joined #tripleo | 09:57 | |
*** Petersingh is now known as Petersingh|afk | 10:00 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui stable/rocky: Fix tgz plan upload error on some OSes https://review.openstack.org/612297 | 10:02 |
*** ykarel|lunch is now known as ykarel | 10:02 | |
ykarel | janki, hi | 10:02 |
janki | ykarel, is this a known issue http://logs.openstack.org/42/612242/1/check/tripleo-ci-centos-7-undercloud-upgrades/f23634b/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz? | 10:03 |
ykarel | janki, seems an issue in queens, may be ramishra have some idea ^^ | 10:05 |
*** psachin has quit IRC | 10:06 | |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 10:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 10:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 10:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 10:10 |
ramishra | janki, ykarel: I think that was reported sometime back, https://bugs.launchpad.net/tripleo/+bug/1796639, happens once in a while it seems, yet to find the root cause | 10:11 |
openstack | Launchpad bug 1796639 in tripleo "[stable/queens] The tripleo-ci-centos-7-undercloud-upgrades is failing on queens for No such file or directory: '/etc/heat/policy.json" [High,Triaged] - Assigned to Marios Andreou (marios-b) | 10:11 |
*** phuongnh has quit IRC | 10:12 | |
*** shardy has quit IRC | 10:13 | |
*** rfolco|rover has joined #tripleo | 10:13 | |
*** shardy has joined #tripleo | 10:16 | |
arxcruz | chandankumar: correct if i am wrong, but the regionOne is set on tempest-deployer-input.conf right ? why explictly add in tempestconf ? | 10:20 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/rocky: Add Ironic inspector health checks https://review.openstack.org/612302 | 10:20 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/rocky: Add health check script for Sahara API https://review.openstack.org/612303 | 10:20 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/rocky: Activate remaining set of healthchecks https://review.openstack.org/612304 | 10:20 |
chandankumar | arxcruz: good question | 10:20 |
chandankumar | arxcruz: https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/post_deploy/standalone_post.sh#L21 | 10:20 |
chandankumar | it write the regionname in cloud.yaml | 10:20 |
chandankumar | since in tempestconf https://github.com/openstack/python-tempestconf/blob/master/config_tempest/main.py#L366 it does not overrides | 10:21 |
chandankumar | and only on overcloud tempest-deployer-input conf file is used, | 10:22 |
chandankumar | but if it is needed for standalone or for undercloud and clouds.yaml is used that needs to be setted properly | 10:22 |
*** akrivoka has quit IRC | 10:22 | |
*** akrivoka has joined #tripleo | 10:23 | |
chandankumar | arxcruz: but full tempest on standalone is working without regionone patch https://review.openstack.org/#/c/606046/ | 10:24 |
Tengu | chandankumar: hey, great job for tempest :) | 10:25 |
Tengu | (was on an mtg, didn't see earlier) | 10:25 |
chandankumar | Tengu: :-) | 10:26 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Fix novajoin nova vendordata hieradata keys https://review.openstack.org/612307 | 10:27 |
jaosorior | chandankumar: which regionone patch? | 10:27 |
chandankumar | jaosorior: https://review.openstack.org/#/c/612245/ | 10:28 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Install ansible with pip https://review.openstack.org/612290 | 10:28 |
openstackgerrit | Bogdan Dobrelya proposed openstack/paunch master: Use oslo_log for logging to stdout/file https://review.openstack.org/612308 | 10:29 |
arxcruz | chandankumar: ok | 10:29 |
chandankumar | arxcruz: I need your views on this https://review.openstack.org/#/c/605356/ | 10:30 |
chandankumar | it is going to be a bulk change | 10:30 |
*** akrivoka_ has joined #tripleo | 10:31 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add OS::TripleO::Services::Rhsm to OpenShift roles https://review.openstack.org/605999 | 10:31 |
openstackgerrit | Merged openstack/tripleo-docs master: Remove tripleo.sh entry from developer docs. https://review.openstack.org/612274 | 10:31 |
chandankumar | arxcruz: https://review.openstack.org/#/c/612245/ it is not needed, it needs to be fixed on tempestconf side | 10:31 |
*** akrivoka has quit IRC | 10:33 | |
openstackgerrit | Bogdan Dobrelya proposed openstack/paunch master: Use oslo_log for logging to stdout/file https://review.openstack.org/612308 | 10:34 |
*** iury|lunch is now known as iurygregory | 10:35 | |
openstackgerrit | Bogdan Dobrelya proposed openstack/paunch master: Use oslo_log for logging to stdout/file https://review.openstack.org/612308 | 10:40 |
openstackgerrit | Rafael Folco proposed openstack/tripleo-quickstart-extras master: Do not configure ara on undercloud by default https://review.openstack.org/611717 | 10:42 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Use Timesync service instead of Ntp https://review.openstack.org/606000 | 10:44 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: [Ocata/Pike] Pass DeployIdentifier in upgrade tasks. https://review.openstack.org/611834 | 10:44 |
openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Fix linters E102 Error https://review.openstack.org/612244 | 10:44 |
ykarel | ramishra, ack so policy.json is removed in queens, but job is still looking to it somehow | 10:47 |
ykarel | seems some race, or heat config is not correct | 10:49 |
*** jamesdenton has joined #tripleo | 10:52 | |
ramishra | ykarel: I see the request in the heat api logs but no error, so dunno what's exacty going on during the upgrade that results in that, may be something to do with policy caching or may be service is restarted when the listing is done | 10:55 |
ramishra | http://logs.openstack.org/42/612242/1/check/tripleo-ci-centos-7-undercloud-upgrades/f23634b/logs/undercloud/var/log/heat/heat_api.log.txt.gz#_2018-10-22_07_10_17_206 | 10:55 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates stable/rocky: Add OS::TripleO::Services::Rhsm to OpenShift roles https://review.openstack.org/612316 | 10:55 |
ykarel | ramishra, The policy file /etc/heat/policy.json could not be found. load_rules /usr/lib/python2.7/site-packages/oslo_policy/policy.py:550 | 10:56 |
ykarel | ramishra, isn't this the issue ^^ | 10:56 |
ykarel | why heat looking for it if policy in code is there in queens | 10:57 |
ykarel | or it's just warning | 10:57 |
ramishra | ykarel: that's later and that error is fine | 10:57 |
ykarel | okk | 10:57 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Make ODL healthcheck IPv6 compatible https://review.openstack.org/612243 | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Add healthcheck script for Nova metadata https://review.openstack.org/612323 | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Add healthcheck script for Horizon https://review.openstack.org/612324 | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Add fluentd health check https://review.openstack.org/612325 | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Add healthcheck script to mistral-event-engine image https://review.openstack.org/612326 | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Fix heat api cfn healthcheck https://review.openstack.org/612327 | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Add health check for OVN containers https://review.openstack.org/612328 | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Add health checks for Swift services https://review.openstack.org/612329 | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Update heat container healthchecks https://review.openstack.org/612330 | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: nova_metadata healthcheck script https://review.openstack.org/612331 | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Add Ironic inspector health checks https://review.openstack.org/612332 | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Add health check script for Sahara API https://review.openstack.org/612333 | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Activate remaining set of healthchecks https://review.openstack.org/612334 | 10:59 |
pvc | hi i just want to ask | 11:01 |
pvc | hi i manually run the | 11:01 |
pvc | ansible-playbook for overcloud deploy | 11:01 |
pvc | it successful but i dont have the rc file | 11:01 |
openstackgerrit | Merged openstack/tripleo-docs master: Add online data migration docs https://review.openstack.org/611578 | 11:02 |
openstackgerrit | Merged openstack/tripleo-docs master: Fix rendering of notes and code in major upgrade docs https://review.openstack.org/611579 | 11:02 |
*** Petersingh|afk is now known as Petersingh | 11:04 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Fix novajoin nova vendordata hieradata keys https://review.openstack.org/612307 | 11:06 |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 11:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 11:10 |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 11:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 11:10 |
*** owalsh has quit IRC | 11:13 | |
*** sanjayu_ has joined #tripleo | 11:14 | |
*** rh-jelabarre has joined #tripleo | 11:15 | |
*** saneax has quit IRC | 11:16 | |
openstackgerrit | Merged openstack/tripleo-upgrade master: Adjust templating for upgrade scripts. https://review.openstack.org/583917 | 11:22 |
openstackgerrit | Merged openstack/tripleo-ui master: Fix tgz plan upload error on some OSes https://review.openstack.org/611576 | 11:22 |
*** jpena is now known as jpena|lunch | 11:23 | |
*** sanjayu_ has quit IRC | 11:23 | |
*** sanjayu_ has joined #tripleo | 11:24 | |
*** gfidente has quit IRC | 11:25 | |
*** agurenko has quit IRC | 11:25 | |
*** agurenko has joined #tripleo | 11:26 | |
*** pcaruana has quit IRC | 11:26 | |
*** naturalblue has quit IRC | 11:27 | |
*** ansmith has quit IRC | 11:27 | |
*** naturalblue has joined #tripleo | 11:28 | |
*** udesale has quit IRC | 11:30 | |
openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Fix variable name for workload_launch task. https://review.openstack.org/611245 | 11:31 |
*** hjensas has joined #tripleo | 11:31 | |
*** sanjayu_ has quit IRC | 11:34 | |
*** sanjayu_ has joined #tripleo | 11:35 | |
*** sanjayu_ has quit IRC | 11:36 | |
*** sanjayu_ has joined #tripleo | 11:36 | |
*** dtantsur is now known as dtantsur|brb | 11:37 | |
jaosorior | mschuppert: around? | 11:39 |
*** sanjayu_ has quit IRC | 11:39 | |
*** sanjayu_ has joined #tripleo | 11:40 | |
*** owalsh has joined #tripleo | 11:41 | |
sshnaidm|ruck | mrunge, hi | 11:42 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Fix novajoin nova vendordata hieradata keys https://review.openstack.org/612307 | 11:42 |
*** amoralej is now known as amoralej|lunch | 11:44 | |
sshnaidm|ruck | mrunge, do you know something about https://bugs.launchpad.net/tripleo/+bug/1799210 ? | 11:44 |
openstack | Launchpad bug 1799210 in tripleo "Rocky and master promotion containers build job fails because sensu dependencies" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 11:44 |
*** sanjayu_ has quit IRC | 11:47 | |
chandankumar | mwhahaha: Hello | 11:47 |
*** sanjayu_ has joined #tripleo | 11:47 | |
chandankumar | mwhahaha: I need to talk about full tempest patch | 11:47 |
*** pcaruana has joined #tripleo | 11:48 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Export container_cli for update & upgrade tasks https://review.openstack.org/611089 | 11:48 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker https://review.openstack.org/604180 | 11:48 |
EmilienM | chandankumar: what's up? (alex is up in ~2h) | 11:49 |
chandankumar | EmilienM: https://review.openstack.org/#/c/606046/ full tempest taking 2hr 25 mins, I am thinking to add it in periodic pipeline where I can include neutron and cinder tempest plugin then time will might go to 3 hours | 11:51 |
chandankumar | EmilienM: what you say? | 11:51 |
chandankumar | we have horizon and keystone plugin also | 11:53 |
*** gfidente has joined #tripleo | 11:55 | |
EmilienM | chandankumar: so +1 to have all tests in periodic but not in the gate | 11:55 |
*** panda is now known as panda|lunch | 11:55 | |
ykarel | ramishra, hi | 11:55 |
chandankumar | EmilienM: full api + scenario is good, we can reuse the fs052 against tempest project | 11:55 |
ykarel | ramishra, in which environment u faced the ansible error for which revert is proposed | 11:56 |
ykarel | ramishra, i am trying to understand ansible 2.5.7[1] is not compatible with python 3.4 which is in CentOS7. python 3 in centos7? | 11:56 |
EmilienM | chandankumar: sure | 11:56 |
*** quiquell is now known as quiquell|lunch | 11:57 | |
ykarel | ramishra, from ansible latest version i see it support python3 from python3.5 onwards: https://pypi.org/project/ansible/, so trying to understand the failure scenario | 11:57 |
beagles | chem, if you get a chance today, can you have a look at https://review.openstack.org/#/c/605200/ ? Also if you can think of anybody else that should review please let me know or add to patch? | 11:58 |
chem | beagles: hey, I've just reviewed it | 11:59 |
ramishra | ykarel: I was trying a reproducer, I think scenario009, I assume it would not work for anything | 11:59 |
ykarel | ramishra, and u tried on which OS? | 11:59 |
ykarel | Centos7? | 11:59 |
chem | beagles: marios would have been a good candidate as he used to love openvswitch hack, but he's no longer with upgrade. So sad. | 12:00 |
ramishra | yes, https://github.com/openstack/tripleo-quickstart/blob/f2f6dcb209df33d063382f89a4a5c7620a3c91ac/quickstart.sh#L41 returns python3 as both 2 and 3 are there | 12:00 |
*** ratailor has quit IRC | 12:00 | |
beagles | chem, I know :( | 12:00 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 12:00 |
mrunge | sshnaidm|ruck, hey. there was no real recent change, other than bumping release for the sensu package. | 12:00 |
mrunge | sshnaidm|ruck, what architecture we are talking about here? | 12:00 |
sshnaidm|ruck | mrunge, the regular one | 12:01 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Install ansible with pip https://review.openstack.org/612290 | 12:01 |
openstackgerrit | Rafael Folco proposed openstack/tripleo-quickstart-extras master: Do not configure ara on undercloud by default https://review.openstack.org/611717 | 12:01 |
ramishra | ykarel: and we've a ansible requirement that's not compatible with python3.4.8 | 12:01 |
mrunge | sshnaidm|ruck, I just know, there are issues with deps on ppc | 12:01 |
mschuppert | jaosorior: I am now | 12:01 |
sshnaidm|ruck | mrunge, no, it's not ppc | 12:01 |
sshnaidm|ruck | mrunge, it's our promotion jobs for rocky and master | 12:01 |
sshnaidm|ruck | mrunge, and it fails everywhere.. | 12:01 |
beagles | chem, one suggestion that was made was to find a way to have the openvswitch package upgrade happen on reboot | 12:01 |
mrunge | sshnaidm|ruck, so how did it work before? | 12:01 |
sshnaidm|ruck | mrunge, it was building sensu container :) | 12:02 |
beagles | chem, I looked around for examples of how to do this on rh type distributions but haven't found it yet | 12:02 |
sshnaidm|ruck | mrunge, and now it doesn't | 12:02 |
beagles | chem, also we'd need to find a way to block openvswitch from being pulled into the update for the rest of the packages | 12:03 |
*** akrivoka_ has quit IRC | 12:03 | |
mrunge | sshnaidm|ruck, the only change since > 1 year was to bump release | 12:03 |
jaosorior | mschuppert: thanks for checking the patch, can you revisit it ? https://review.openstack.org/#/c/612307/ testing it right now | 12:03 |
*** akrivoka has joined #tripleo | 12:03 | |
sshnaidm|ruck | mrunge, then it is | 12:03 |
beagles | chem just putting that out there in case you or anyone else knows how to go about that | 12:03 |
mrunge | which brings me back to: how did it work before | 12:03 |
mschuppert | jaosorior: yes, give me a couple of mins | 12:03 |
sshnaidm|ruck | mrunge, define "how" | 12:04 |
mrunge | sshnaidm|ruck, that: https://github.com/centos-opstools/sensu/commit/e80bf9a6c567cc230e6e989698cfa2b85ffcba8f | 12:04 |
chem | beagles: hum that would be some king of systemd hack, I guess it's some work, and we would have to check that the rest of openstack (neutron) doesn't depends on the latest and greatest version of openvswitch | 12:04 |
mrunge | sshnaidm|ruck, explain, how that effects the gate | 12:04 |
mrunge | or how this breaks the gate | 12:04 |
beagles | chem ack | 12:04 |
sshnaidm|ruck | mrunge, 1 sec, on mtg | 12:04 |
ykarel | ramishra, but i can't find any ansible version working with python3.4 atleast from ansible release history, may be i am missing something, so seems there is some other issue not just version | 12:05 |
ykarel | with that patch | 12:05 |
*** cylopez has left #tripleo | 12:05 | |
*** sanjayu__ has joined #tripleo | 12:06 | |
chem | beagles: as for openvswitch not being pull during update, it should go into the N-1 concerned version. Is there a review about that as well ? | 12:06 |
marios | beagles: chem o/ ack i've been there a couple times already was great fun i plan a revisit soon | 12:06 |
*** lblanchard has joined #tripleo | 12:06 | |
*** dprince has joined #tripleo | 12:08 | |
sshnaidm|ruck | mrunge, sensu container fails to build in promotion job, which blocks all promotions for rocky and master | 12:08 |
*** kopecmartin has quit IRC | 12:08 | |
sshnaidm|ruck | mrunge, we can't promote anything in prod chain | 12:08 |
sshnaidm|ruck | mrunge, that's the problem | 12:08 |
*** morazi has joined #tripleo | 12:09 | |
mrunge | sshnaidm|ruck, looking at the change, it couldn't have built for a loooong time | 12:09 |
*** sanjayu_ has quit IRC | 12:09 | |
mrunge | meanwhile I've tagged the missing requirement | 12:09 |
mrunge | so the question is: why is it pressing *now* | 12:10 |
jaosorior | mschuppert: oh, apparently I am gonna need your help | 12:10 |
*** janki has quit IRC | 12:10 | |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 12:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 12:10 |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
chandankumar | honza: Hello | 12:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 12:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 12:10 |
jaosorior | mschuppert: so, I did that change that I pointed you to, but it seems that the vendordata plugin is still not called from nova | 12:10 |
chandankumar | honza: I just saw your email regarding tripleo-ui testing in TQE, I think I have a solution without much work | 12:11 |
ramishra | ykarel: I don't know. it's possible that there is no ansible version working with 3.4, not checked that, That's why the revert is appropriate | 12:11 |
*** kopecmartin has joined #tripleo | 12:11 | |
sshnaidm|ruck | mrunge, because *now* it fails, and before now it didn't | 12:12 |
ykarel | ramishra, ack. but iirc atleast in ci support for 3.4 is removed not sure why we are supporting it | 12:12 |
mschuppert | jaosorior: do you have an environment I can login? | 12:12 |
*** pcaruana has quit IRC | 12:12 | |
*** pcaruana has joined #tripleo | 12:12 | |
ramishra | I just forced it to select python2 and it worked fine, so don't know about other issues in that patch | 12:12 |
sshnaidm|ruck | mrunge, or didn't try to build | 12:13 |
beagles | chem: re: not pulling in openvswitch - no there isn't. I *think* the current patch mitigates this by always running the openvswitch upgrade logic before the package update. When I was doing it, I kept thinking that it would be better if we could block openvswitch from ever being include whenever we did a yum update/upgrade. | 12:13 |
sshnaidm|ruck | ykarel, did we try to build sensu base? I see last time it's year ago: https://hub.docker.com/r/tripleomaster/centos-binary-sensu-base/tags/ | 12:13 |
ramishra | ykarel: yeah, I don't know, 3.5 is the probably right thing to go, but I don't know when centos is going to have 3.5 | 12:13 |
mrunge | sshnaidm|ruck, hmmm. not trying to build would explain it. The next question would be: why did it not try... | 12:14 |
*** raildo has joined #tripleo | 12:14 | |
chem | beagles: it would be upgrade using an external process then ? | 12:14 |
sshnaidm|ruck | ykarel, mrunge no idea why it builds now.. maybe new req somewhere? | 12:15 |
beagles | chem, yeah it would have to be done in conjunction with an "upgrade on reboot" functionality or some other mechanism | 12:15 |
ykarel | sshnaidm|ruck, not sure, am trying to find logs in jobs, but can't find: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-centos-7-master-containers-build/08c08db/logs/ | 12:15 |
honza | chandankumar: ALL EARS | 12:15 |
ykarel | sshnaidm|ruck, iirc it used to be under kolla directory | 12:15 |
*** mjturek has joined #tripleo | 12:16 | |
honza | chandankumar: perfect time, because i literally decided over the weekend to just over-engineer this thing... | 12:16 |
mrunge | sshnaidm|ruck, I don't have any influence on things *requiring* sensu from the outside. This was the first time someone pinged me about this | 12:16 |
*** eck` is now known as eck`gone | 12:16 | |
beagles | chem, tbh I'm not sure how it would work it just seems that having to hack around the openvswitch upgrades is so problematic that coming up with a "more likely to work in all scenarios" would be nice | 12:17 |
chandankumar | honza: I am adding a support to install tempest plugin from git in TQE then you can simply overrides zuul job with particular fs set you want to test and you are done | 12:17 |
chem | beagles: hum, right, is that dependent/linked with neutron supporting rolling upgrade or it has nothing to do with it ? | 12:18 |
honza | chandankumar: perfect --- are there patches already that i can look at? | 12:18 |
chandankumar | honza: https://review.openstack.org/#/c/609934/5/.zuul.yaml something like that | 12:18 |
beagles | chem, unrelated | 12:18 |
chandankumar | honza: working on it | 12:18 |
chem | beagles: oki, I wondered if that would help | 12:18 |
*** lhinds has joined #tripleo | 12:18 | |
*** rnoriega has joined #tripleo | 12:19 | |
beagles | chem great feedback on the patch btw, thanks 10^6 | 12:19 |
beagles | chem++ | 12:20 |
chem | beagles: it's so anoying that such a critical componant cannot be upgraded "as usual" for one of its main consumer, I always had the feeling that it shoud be solved on the openvswitch side if possible. | 12:20 |
chem | beagles:yw | 12:20 |
chem | beagles: thanks for tackling this recurring piece of annoyance :) | 12:20 |
beagles | chem: :) | 12:20 |
naturalblue | Hi Everyone. | 12:21 |
ykarel | mrunge, so i think it's detected now because the last build in mirror centos was sensu-0.27.0-1.el7, the requires for which were im mirror.centos, but the new sensu builds(sensu-1.1.3-2.el7) requires are not in repo | 12:21 |
ykarel | sshnaidm|ruck, ^^ | 12:21 |
naturalblue | Since installing rocky based containerised undercloud the ironic_conductor container keeps restarting. I have tried rebuilding and fresh installing undercloud but the same thing keeps happening. | 12:22 |
*** lblanchard has quit IRC | 12:23 | |
*** jpena|lunch is now known as jpena | 12:23 | |
naturalblue | Because of this I cannot import any nodes for the overcloud. Everything was wworking fine when it was a pike undercloud setup (non-containerised). Couls there be a setting in my undercloud.conf that is causing it to build like this | 12:23 |
*** quiquell|lunch is now known as quiquell | 12:24 | |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Enable neutron-sriov-agent health check https://review.openstack.org/612369 | 12:24 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Enable Sahara API health check https://review.openstack.org/612370 | 12:24 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Enable health check for Ironic inspector services https://review.openstack.org/612371 | 12:24 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Enable ceilometer-agent-compute health check https://review.openstack.org/612372 | 12:24 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Enable fluentd health check https://review.openstack.org/612373 | 12:24 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Enable health check for OVN containers https://review.openstack.org/612374 | 12:24 |
*** jrist has joined #tripleo | 12:25 | |
mrunge | ykarel, strange :-/ | 12:25 |
honza | chandankumar: cool, let me know if you need me to review/test/etc | 12:25 |
*** zul has joined #tripleo | 12:27 | |
ykarel | mrunge, yes, so how can this be fixed, removed the latest sensue build or bump the deps to required version in mirror centos? | 12:29 |
fultonj | naturalblue: ironic is not my area of expertise, but if i had a contianer that was restarting I'd check the logs; /var/log/containers/ironic/ironic-conductor.log | 12:29 |
mrunge | ykarel, I just tagged the missing dependency | 12:30 |
fultonj | naturalblue: also https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/tips_tricks.html#debugging-with-paunch | 12:30 |
EmilienM | bogdando, mwhahaha : https://review.openstack.org/#/c/608319/ is again ready for review, and passing upgrade job this time. Thanks | 12:30 |
ykarel | mrunge, cool. rfolco|rover sshnaidm|ruck ^^, mrunge so those will be available today in mirrror centos, or need to wait till 9:00 UTC tomorrow? | 12:31 |
naturalblue | fultonj: I checked the docker logs for t and it doesn't have an issue. IF the conatiner is constantly restarting will I be able to connect to it to view the log? I'll have a look anyway and check out the link. thanks | 12:31 |
fultonj | naturalblue: the link shows you how to use paunch to get the exact command to start the container | 12:32 |
fultonj | naturalblue: from there you can start it yourself and see what error it hits when it tries to start | 12:32 |
sshnaidm|ruck | ykarel, why to wait..? | 12:32 |
mrunge | ykarel, I'm walking through the deps right now. | 12:32 |
ykarel | sshnaidm|ruck, afaik mirror sync happens at 9:00 UTC monday to thrusday | 12:32 |
mandre | shardy: o/ do you have time for a couple of code reviews? | 12:33 |
ykarel | sshnaidm|ruck, mirror.centos. and -release tagged pcakages | 12:33 |
sshnaidm|ruck | ykarel, I see.. let's take a risk :) | 12:33 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Install ansible with pip https://review.openstack.org/612290 | 12:33 |
sshnaidm|ruck | ykarel, maybe some of jobs will catch it today.. | 12:34 |
dprince | jaosorior: hi, I think I required a +1 from you here sir https://review.openstack.org/#/c/610015/ | 12:34 |
dprince | jaosorior: also, here https://review.openstack.org/#/c/609531/ | 12:34 |
jaosorior | dprince: done | 12:35 |
shardy | mandre: hey, sure! | 12:35 |
fultonj | naturalblue: it might be on a restart loop because its systemd unit file has restart always, you can flip that bit and then take over running it yourself w/ paunch. that should let you get insight into what it is failing on | 12:35 |
*** rlandy has joined #tripleo | 12:35 | |
naturalblue | fultonj: cool. i will have a look now. i stopped and started the container and connected to it but it kicked me out before i had a chance to view the log. i'll check paunch now | 12:35 |
*** jcoufal has joined #tripleo | 12:36 | |
mandre | shardy: I'm mostly interested in https://review.openstack.org/#/c/606001/ and the ones above | 12:36 |
*** thrash|g0ne is now known as thrash | 12:37 | |
shardy | mandre: ack will review the series now | 12:37 |
dprince | jaosorior: thanks! | 12:38 |
mandre | shardy: thanks a bunch | 12:38 |
EmilienM | can someone get https://review.openstack.org/#/c/611866/ please | 12:41 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Added support for installing tempest plugins from git https://review.openstack.org/612377 | 12:44 |
*** kopecmartin has quit IRC | 12:47 | |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/queens: Enable libvirt health check https://review.openstack.org/612379 | 12:47 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/queens: Enable neutron-sriov-agent health check https://review.openstack.org/612380 | 12:47 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/queens: Enable Sahara API health check https://review.openstack.org/612381 | 12:47 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/queens: Enable health check for Ironic inspector services https://review.openstack.org/612382 | 12:47 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/queens: Enable ceilometer-agent-compute health check https://review.openstack.org/612383 | 12:47 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/queens: Enable fluentd health check https://review.openstack.org/612384 | 12:47 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/queens: Enable health check for OVN containers https://review.openstack.org/612385 | 12:47 |
*** owalsh_ has joined #tripleo | 12:48 | |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: [DNM] testing tempest plugin installation from git https://review.openstack.org/612386 | 12:50 |
*** owalsh has quit IRC | 12:51 | |
*** ansmith has joined #tripleo | 12:52 | |
openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient stable/pike: [Pike Only] Change docker img rendering variable to docker_namespace. https://review.openstack.org/608648 | 12:52 |
*** jroll has quit IRC | 12:53 | |
*** jroll has joined #tripleo | 12:54 | |
*** kopecmartin has joined #tripleo | 12:55 | |
*** huynq_ has quit IRC | 12:55 | |
chandankumar | honza: https://review.openstack.org/#/q/topic:tempest_plugin_venv+(status:open+OR+status:merged) I hope this will do the job for you | 12:55 |
*** mcornea has joined #tripleo | 12:55 | |
*** panda|lunch is now known as panda | 12:56 | |
*** tzumainn has joined #tripleo | 12:57 | |
*** owalsh_ is now known as owalsh | 12:57 | |
naturalblue | fultonj: i have it stopped now so it is not trying to restart. just trying to work through the doc you gave me. still a bit green to all this container stuff | 12:57 |
honza | chandankumar: /me looks | 12:57 |
*** gvrangan has quit IRC | 12:58 | |
*** owalsh has quit IRC | 12:58 | |
fultonj | naturalblue: idenitfy the tripleo_stepN where the conductor contianer starts with `paunch list | grep conductor` | 12:59 |
fultonj | naturalblue: e.g. i had to do this recently to the mistral_executor contiainer and found N=4 | 12:59 |
fultonj | thus i ran... | 12:59 |
fultonj | paunch debug --file /var/lib/tripleo-config/docker-container-startup-config-step_4.json --container mistral_executor --action print-cmd | 12:59 |
fultonj | from that i had the command to run myself | 12:59 |
naturalblue | fultonj: i think i may have the issue. "Error starting thread.: DriverNotFoundInEntrypoint: Could not find the following items in the 'ironic.hardware.types' entrypoint: pxe_ipmitool, fake_pxe." | 13:00 |
naturalblue | i think i have a bad hardwaretype or a speelling mistake | 13:00 |
naturalblue | fultonj: i will try your commands to verify that this is indeed the error | 13:01 |
openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: undercloud_preflight: compare actual IPs without mask https://review.openstack.org/611937 | 13:02 |
fultonj | naturalblue: ok, those pretty much came directly from the debugging-with-paunch doc | 13:02 |
naturalblue | fultonj: cool. I appreciate the help. I will continue with the investigation (columbo style, i.e. kinda bumbling :) | 13:03 |
*** ykarel_ has joined #tripleo | 13:03 | |
*** dtantsur|brb is now known as dtantsur | 13:04 | |
*** ykarel has quit IRC | 13:06 | |
*** lblanchard has joined #tripleo | 13:06 | |
chem | marios: I've replied to all your question in emit release https://review.openstack.org/#/c/606996/9 when you have a chance don't forget to +2 it :) | 13:07 |
*** weshay_pto has quit IRC | 13:07 | |
*** eck`gone is now known as eck` | 13:08 | |
*** rpioso|afk is now known as rpioso | 13:09 | |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 13:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 13:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 13:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 13:10 |
honza | chandankumar: will this work with containerized tempest? | 13:11 |
chandankumar | honza: nope | 13:11 |
chandankumar | honza: for working with containerized tempest, we need to first create a rpm then add a pathc in kolla | 13:12 |
chandankumar | honza: for testing the stuff in ci, venv is the best way | 13:12 |
honza | chandankumar: interesting, this might make things a lot easier for me | 13:12 |
chandankumar | honza: it is also easier for debugging | 13:13 |
*** owalsh has joined #tripleo | 13:13 | |
naturalblue | can anyone tell me where is the ironic.conf file stored now. it is not in /etc/ironic. do i need to edit a specific container image? | 13:14 |
jaosorior | naturalblue: /var/lib/config-data/puppet-generated/ironic | 13:17 |
rfolco|rover | mrunge, assigning https://bugs.launchpad.net/tripleo/+bug/1799210 to you since you are working on the fix, agreed? | 13:17 |
openstack | Launchpad bug 1799210 in tripleo "Rocky and master promotion containers build job fails because sensu dependencies" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 13:17 |
naturalblue | jaosorior: thank you. it was takng ages grepping the filesystem to find it :) | 13:18 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-quickstart master: Add new featureset for running tripleo-ui tests https://review.openstack.org/607325 | 13:19 |
openstackgerrit | James Slagle proposed openstack/tripleo-common stable/rocky: Run NetworkDeployment as async task https://review.openstack.org/612387 | 13:19 |
chandankumar | mwhahaha: EmilienM: https://review.openstack.org/#/c/610596/ and https://review.openstack.org/610600 selinux change | 13:20 |
chandankumar | needs +w | 13:20 |
openstackgerrit | Dan Prince proposed openstack/tripleo-common master: Add tripleoclient container https://review.openstack.org/611598 | 13:21 |
*** ykarel_ is now known as ykarel | 13:23 | |
openstackgerrit | Rafael Folco proposed openstack/tripleo-quickstart master: Run scenario001-multinode-oooq-container job for config/* changes https://review.openstack.org/602425 | 13:26 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/rocky: check mode: docker_puppet_tasks https://review.openstack.org/612068 | 13:26 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/rocky: check mode: paunch configs https://review.openstack.org/612069 | 13:26 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/rocky: Name unnamed tasks https://review.openstack.org/612070 | 13:26 |
naturalblue | fultonj: jaosorior Thanks for all your help. I got it sorted from your advice. I indeed had put a bad driver into the hardware type in my undercloud.conf which got sent to the ironic.conf and then kept causing it to reboot. I appreciate the help. | 13:28 |
fultonj | cool | 13:28 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt tqe for the new fedora28 job https://review.openstack.org/612390 | 13:28 |
naturalblue | jaosorior: ^^ | 13:28 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: Adapt tqe for the new fedora28 job https://review.openstack.org/612390 | 13:28 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Install ansible with pip https://review.openstack.org/612290 | 13:29 |
honza | chandankumar: what do you think about the idea of checking out a zuul change? | 13:30 |
*** ade_lee has joined #tripleo | 13:32 | |
openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Set default unbound_cache_min_ttl to 0 in the base job https://review.openstack.org/608051 | 13:34 |
openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Set default unbound_cache_min_ttl to 0 in the base job https://review.openstack.org/608051 | 13:34 |
openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Set default unbound_cache_min_ttl to 0 in the base job https://review.openstack.org/608051 | 13:35 |
*** hjensas has quit IRC | 13:37 | |
*** agurenko_ has joined #tripleo | 13:38 | |
*** agurenko has quit IRC | 13:39 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Add reflection of RpcPort to health checks https://review.openstack.org/603387 | 13:41 |
openstackgerrit | Merged openstack/tripleo-ui master: Fix plan and logs export actions https://review.openstack.org/611540 | 13:41 |
*** dciabrin has joined #tripleo | 13:46 | |
*** ratailor has joined #tripleo | 13:48 | |
chem | whois rlandy | 13:48 |
chem | rlandy: hey :) | 13:48 |
rlandy | chem: hello | 13:48 |
*** agurenko_ is now known as agurenko | 13:48 | |
chem | rlandy: I was about to ask to if we could get over the -1 from weshay there https://review.openstack.org/#/c/604756/ | 13:49 |
*** agurenko is now known as agurenko_ | 13:50 | |
* rlandy looks | 13:51 | |
mwhahaha | we just ignore weshay anyway :D | 13:51 |
* mwhahaha notes he's not even here for the joke | 13:52 | |
rlandy | AttributeError: 'NoneType' object has no attribute 'startswith' | 13:52 |
rlandy | he objects to that error - now to find it | 13:53 |
EmilienM | he's on PTO | 13:53 |
EmilienM | as usual | 13:53 |
Tengu | absents are always wrong. | 13:53 |
chem | rlandy: This was a legit error in the templates. Unfortunately the error msg from ansible-lint wasn't very informative to find the root cause but it boiled down to that https://bugs.launchpad.net/tripleo/+bug/1797412 and that review https://review.openstack.org/#/c/609754/ | 13:54 |
openstack | Launchpad bug 1797412 in tripleo "Wrong syntax for import_role in the ansible part of the templates." [Critical,Fix released] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 13:54 |
chem | rlandy: that ansible lint actually found error :) (even with a super confusing error msg) | 13:55 |
*** Petersingh is now known as Petersingh|gone | 13:55 | |
*** Petersingh|gone has quit IRC | 13:55 | |
rlandy | chem: the depends-on change is not merged | 13:56 |
rlandy | https://review.openstack.org/#/c/604757/ | 13:56 |
chem | rlandy: I know, it needs merging as well :) | 13:56 |
rlandy | chem: well we should start there - I can w+1 the change | 13:57 |
rlandy | but w/o the deps, won't help | 13:57 |
rlandy | and wes +1'ed that | 13:57 |
rlandy | ok - let's get some cores on that change to start | 13:57 |
*** amoralej|lunch is now known as amoralej | 13:57 | |
*** vinaykns has joined #tripleo | 13:58 | |
chem | rlandy: ack, I'll push on that one thanks for looking . | 13:58 |
rlandy | marios: sshnaidm|ruck: we need some core reviews on https://review.openstack.org/#/c/604757/ | 13:58 |
rlandy | pls | 13:58 |
*** vinaykns has quit IRC | 13:58 | |
rlandy | chem: yeah - if we get that one through, I'll w+1 the other | 13:59 |
chem | rlandy: ack | 13:59 |
rlandy | my guess is that we may not do that before tomorrow - but there are always miracles | 13:59 |
*** hgibson has joined #tripleo | 14:00 | |
*** vinaykns has joined #tripleo | 14:01 | |
*** gfidente has quit IRC | 14:01 | |
hgibson | Has anyone ever tried to deploy tripleo on already deployed servers WITHOUT network isolation? | 14:02 |
hgibson | Deployment keeps failing and I can't figure out if it's a configuration issue or a bug | 14:02 |
*** agurenko has joined #tripleo | 14:03 | |
*** agurenko_ has quit IRC | 14:03 | |
*** agopi has quit IRC | 14:03 | |
chem | rlandy: by the way it would be cool to land https://review.openstack.org/#/c/606996/ it's preventing https://review.openstack.org/#/c/604706/ from merging and which was +2/+a at some point. | 14:05 |
chem | rlandy: this is about standalone upgrade | 14:05 |
rlandy | ok - will review | 14:06 |
rlandy | marios: ^^ nay reason you have a +1 here and not a +2? | 14:06 |
rlandy | any | 14:06 |
rlandy | quiquell: ^^ any objections? | 14:07 |
quiquell | rlandy: I am good for it, has already try to help there | 14:09 |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 14:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 14:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 14:10 |
*** SteelyDan is now known as dansmith | 14:11 | |
*** haleyb has joined #tripleo | 14:12 | |
*** ykarel is now known as ykarel|afk | 14:13 | |
quiquell | rlandy: Added my humble +1 there | 14:14 |
rlandy | thanks | 14:15 |
openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates master: Add parameters for cinder storage availability zones https://review.openstack.org/608075 | 14:17 |
rlandy | chem: do you have a test job where standalone_ansible_lint is set to true and we can see the output? | 14:18 |
chem | rlandy: yeap there https://review.openstack.org/#/c/604756/ you have http://logs.openstack.org/56/604756/4/check/tripleo-ci-centos-7-standalone/c6cb811/logs/undercloud/home/zuul/standalone_ansible_lint.log.txt.gz | 14:21 |
marios | rlandy: ack on https://review.openstack.org/#/c/604757 wrt https://review.openstack.org/#/c/606996/ i wanted one more pass before +2 but others can beat me to it | 14:23 |
*** ykarel_ has joined #tripleo | 14:29 | |
rlandy | marios: thanks | 14:30 |
rlandy | I also review slowly | 14:30 |
rlandy | like to check results | 14:30 |
*** two_oes has quit IRC | 14:30 | |
*** ykarel|afk has quit IRC | 14:32 | |
*** bugzy has joined #tripleo | 14:41 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add ctlplane interface routes https://review.openstack.org/604943 | 14:42 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - data + env (1/3) https://review.openstack.org/582180 | 14:42 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - network.j2 (2/3) https://review.openstack.org/582181 | 14:42 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Replace tripleo_common/utils/roles.py validate_role_yaml() https://review.openstack.org/608471 | 14:42 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - subnet fixed_ips (3/3) https://review.openstack.org/582301 | 14:42 |
Tengu | dtantsur: heya! small question: what might cause an overcloud provistioning node to fail with this message while pxe-booting: Nothing to boot: No such file or directory // No more network devices | 14:42 |
Tengu | dtantsur: "fun" fact, the introspection does work, meaning the pxe setup should be OK in ironic. | 14:42 |
dtantsur | Tengu: well, these use different DHCP. This may suggest something wrong around Neutron (it's not used by introspection). | 14:43 |
Tengu | dtantsur: oh. ok. | 14:44 |
Tengu | so neutron. let's check its logs then. | 14:44 |
*** bugzy_ has quit IRC | 14:45 | |
*** bugzy has quit IRC | 14:46 | |
Tengu | dtantsur: I might have a hint - have a denied in my audit.log. Might be linked. Thanks for the neutron thing, I'll investigate a bit more :) | 14:46 |
openstackgerrit | Carol Bouchard proposed openstack/tripleo-heat-templates master: CiscoNexus: Update and Remove deprecated vars https://review.openstack.org/606958 | 14:49 |
mrunge | rfolco|rover, honestly, I don't care | 14:50 |
rfolco|rover | mrunge, k I'll watch and make sure the issue is gone with the updated repo, thanks | 14:51 |
*** bugzy has joined #tripleo | 14:56 | |
*** quiquell is now known as quiquell|off | 14:57 | |
*** hjensas has joined #tripleo | 14:57 | |
*** ramishra has quit IRC | 14:59 | |
rlandy | chem: I voted on https://review.openstack.org/#/c/606996 but per my comment, this is not an area I am super familiar with. pinged other cores to give their input | 15:05 |
openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Fix type of --config-download-timeout https://review.openstack.org/612417 | 15:05 |
chem | rlandy: thanks | 15:06 |
*** ratailor has quit IRC | 15:07 | |
openstackgerrit | Merged openstack/puppet-pacemaker master: Add 'Development' in README https://review.openstack.org/588955 | 15:08 |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 15:10 |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 15:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 15:10 |
*** zaneb has quit IRC | 15:10 | |
*** pcaruana has quit IRC | 15:12 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/instack-undercloud stable/queens: Update stackrc to v3 auth values when --use-heat is false. https://review.openstack.org/611647 | 15:15 |
*** zaneb has joined #tripleo | 15:17 | |
*** agurenko has quit IRC | 15:17 | |
*** gfidente has joined #tripleo | 15:20 | |
*** Vorrtex has joined #tripleo | 15:23 | |
chandankumar | honza: when you send a code review on gerrit, that time zuul will clone the repo and and fetch that review and checkout to that review and then prepare the test environment | 15:27 |
mwhahaha | rfolco|rover, sshnaidm|ruck: what's up with this in the ovb jobs? https://logs.rdoproject.org/58/609858/5/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/22b7d84/job-output.txt.gz#_2018-10-22_13_54_47_902981 | 15:27 |
sshnaidm|ruck | mwhahaha, I didn't see such failure before, looking.. | 15:28 |
sshnaidm|ruck | mwhahaha, there are some other failures in ovb too | 15:29 |
mwhahaha | yea that's a new one for me too | 15:29 |
sshnaidm|ruck | seems like some disk failure | 15:30 |
sshnaidm|ruck | jobs on rdo cloud fail in more and more interesting ways.. | 15:31 |
mwhahaha | :D | 15:32 |
*** yprokule has quit IRC | 15:32 | |
*** mmagr has quit IRC | 15:41 | |
*** jfrancoa has quit IRC | 15:43 | |
*** itlinux has joined #tripleo | 15:46 | |
*** ksambor has quit IRC | 15:49 | |
*** bnemec has joined #tripleo | 15:51 | |
openstackgerrit | Rajini Karthik proposed openstack/puppet-tripleo master: Dell EMC SC: Add use_multipath_for_image_xfer https://review.openstack.org/611126 | 15:58 |
*** bnemec has quit IRC | 15:59 | |
openstackgerrit | Rajini Karthik proposed openstack/puppet-tripleo master: Dell EMC SC: Add use_multipath_for_image_xfer https://review.openstack.org/611126 | 15:59 |
openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/ocata: GATE CHECK for TripleO https://review.openstack.org/564291 | 16:00 |
openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 16:00 |
openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/604293 | 16:00 |
*** pvc_ has joined #tripleo | 16:00 | |
pvc_ | hi i just want to ask how can i add a new bridge for my floating ip in overcloud deploy. thank you so much | 16:00 |
pvc_ | also how can i customize to use just 2 nics once the servers go up thank you | 16:00 |
*** lblanchard has quit IRC | 16:04 | |
*** sanjayu_ has joined #tripleo | 16:06 | |
*** phuongnh has joined #tripleo | 16:07 | |
*** sanjayu__ has quit IRC | 16:08 | |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 16:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 16:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 16:10 |
*** phuongnh has quit IRC | 16:12 | |
*** vinaykns has quit IRC | 16:14 | |
openstackgerrit | Sam Betts proposed openstack/python-tripleoclient stable/rocky: Ensure that the --template-file option is passed to the kolla builder https://review.openstack.org/612437 | 16:16 |
openstackgerrit | Sam Betts proposed openstack/python-tripleoclient stable/queens: Ensure that the --template-file option is passed to the kolla builder https://review.openstack.org/612438 | 16:22 |
*** pvc_ has quit IRC | 16:22 | |
*** shardy has quit IRC | 16:24 | |
*** ykarel__ has joined #tripleo | 16:25 | |
*** sshnaidm|ruck is now known as sshnaidm|afk | 16:27 | |
*** ykarel_ has quit IRC | 16:28 | |
*** akrivoka has quit IRC | 16:34 | |
*** akrivoka has joined #tripleo | 16:34 | |
EmilienM | Tengu, bogdando, beagles : I finally spent time testing nsenter | 16:35 |
EmilienM | and I could tag a container from podman | 16:35 |
*** jcoufal has quit IRC | 16:35 | |
Tengu | EmilienM: ah, great! | 16:35 |
EmilienM | Tengu, bogdando, beagles (+ bandini): I had to use: --pid host --net=host --user=root | 16:36 |
EmilienM | and -v /run/netns:/run/netns:shared | 16:36 |
EmilienM | I couldn't do it with non-root user :( | 16:36 |
honza | chandankumar: i'm not sure i'm following you | 16:36 |
EmilienM | even with --cap-add | 16:36 |
chandankumar | Tengu: sshnaidm|afk: EmilienM please have this one https://review.openstack.org/#/c/612377/ usecase came from testing tripleo ui tempest plugin' | 16:36 |
bandini | EmilienM: ack noted, nice progress. Well it is not worse to what we have now | 16:38 |
EmilienM | yeah | 16:38 |
Tengu | EmilienM: hmm, probably due to the access to the container's DB | 16:38 |
rfolco|rover | sshnaidm|afk, mwhahaha not sure what can be done to i/o errors in rdo cloud | 16:38 |
Tengu | (for the root) | 16:38 |
EmilienM | Tengu: nsenter: reassociate to namespace 'ns/mnt' failed: Operation not permitted | 16:38 |
mwhahaha | rfolco|rover: need to raise them with the ops folks | 16:39 |
EmilienM | I got that when I run the container with mysql user for example | 16:39 |
*** holser_ has quit IRC | 16:40 | |
Tengu | EmilienM: ah, ok.. | 16:40 |
rfolco|rover | mwhahaha, ack | 16:40 |
beagles | EmilienM, confirmed same result | 16:40 |
*** kopecmartin is now known as kopecmartin|off | 16:41 | |
EmilienM | Tengu, beagles: in that case, I'm not sure we need the cap_add here | 16:41 |
EmilienM | since we run as root | 16:41 |
Tengu | EmilienM: would be nice to ensure that - I think the SYS_ADMIN might be needed though, as the action affects the container DB | 16:42 |
EmilienM | oh nevermind | 16:42 |
EmilienM | the capabilities are needed, got it | 16:42 |
Tengu | both? | 16:42 |
*** ykarel__ is now known as ykarel|away | 16:42 | |
EmilienM | yes | 16:42 |
Tengu | ok | 16:42 |
* beagles will try redeploying with modified templates to see if sidecars will come up okay then | 16:42 | |
EmilienM | even if the container is run in root | 16:42 |
EmilienM | nsenter: cannot open /proc/1/ns/net: Permission denied | 16:43 |
Tengu | that pretty nicely sums up indeed | 16:43 |
*** bogdando has quit IRC | 16:44 | |
*** zaneb has quit IRC | 16:45 | |
openstackgerrit | Carlos Goncalves proposed openstack/tripleo-heat-templates master: Move Octavia database configuration to OctaviaBase https://review.openstack.org/609347 | 16:45 |
*** zaneb has joined #tripleo | 16:46 | |
beagles | strangely /run/netns doesn't seem to be there on reboot | 16:48 |
beagles | wonder what caused it to be present by default before | 16:48 |
*** ykarel|away has quit IRC | 16:50 | |
*** jpena is now known as jpena|off | 16:55 | |
*** aufi has joined #tripleo | 16:56 | |
EmilienM | bandini: systemd networking? | 16:57 |
EmilienM | sorry beagles ^ | 16:57 |
beagles | EmilienM, oh probably I think the docker daemon probably pulled that up before | 16:58 |
beagles | EmilienM, will check after this deploy | 16:58 |
*** derekh has quit IRC | 17:00 | |
*** akrivoka has quit IRC | 17:03 | |
*** aufi has quit IRC | 17:05 | |
*** dtantsur is now known as dtantsur|afk | 17:06 | |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 17:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 17:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 17:10 |
openstackgerrit | Rajini Karthik proposed openstack/tripleo-heat-templates master: Added Dell EMC SC multipath support https://review.openstack.org/612451 | 17:11 |
Vorrtex | Hello! I'm not sure who to direct my question to, but I've been trying to get *just* the undercloud installed on an x86_64 VM and I got an error. Here is a gist of the error output: https://gist.github.com/tvardema/57472e2cea29bb80551c0571415fbb7c | 17:14 |
*** raildo has quit IRC | 17:14 | |
Vorrtex | I'm guessing the main issue is the line with "lookup plugin (vars) not found", but I'm not sure what that means exactly | 17:15 |
*** sambetts is now known as sambetts|afk | 17:18 | |
*** bnemec has joined #tripleo | 17:19 | |
*** sanjayu_ has quit IRC | 17:25 | |
*** sanjayu__ has joined #tripleo | 17:25 | |
*** dsneddon has joined #tripleo | 17:25 | |
*** pcaruana has joined #tripleo | 17:27 | |
*** dprince has quit IRC | 17:28 | |
*** salmankhan has quit IRC | 17:29 | |
Vorrtex | Any help with that error message would be greatly appreciated :) | 17:30 |
*** agopi has joined #tripleo | 17:32 | |
*** hjensas has quit IRC | 17:33 | |
mwhahaha | Vorrtex: what version? | 17:34 |
mwhahaha | Vorrtex: also what version of ansible is installed | 17:35 |
Vorrtex | mwhahaha you mean what version of openstack? | 17:35 |
mwhahaha | Vorrtex: yes | 17:36 |
Vorrtex | ansible 2.4.4.0 and openstack 3.14.2 | 17:36 |
mwhahaha | Vorrtex: that's not a version of openstack? Do you mean rocky or something? | 17:36 |
*** raildo has joined #tripleo | 17:37 | |
Vorrtex | Sorry, that's what "openstack --version" outputs, that's what I thought you wanted my bad. Gimme a second. | 17:37 |
Vorrtex | mwhahaha I was following this document: http://tripleo.org/install/installation/installation.html | 17:37 |
mwhahaha | Vorrtex: basically what did you install repository wise? I'm assuming you installed straight from centos and not from rdo | 17:37 |
Vorrtex | So I installed "current-tripleo-dev" | 17:37 |
mwhahaha | Vorrtex: if you did, you should have ansible 2.5+_ | 17:38 |
mwhahaha | so something isn't right with your config | 17:38 |
*** dsneddon has quit IRC | 17:38 | |
Vorrtex | mwhahaha I did follow that document to a T. Even wrote it in a setup script to make sure. Which config could be wrong? undercloud.conf? | 17:38 |
*** dsneddon has joined #tripleo | 17:39 | |
mwhahaha | Vorrtex: no it would have been in the tripleo-repos command. what was your invocation? | 17:39 |
mwhahaha | did you just run "tripleo-repos current-tripleo-dev" ? | 17:40 |
mwhahaha | it's like you installed pike or something which wouldn't have been current-tripleo-dev | 17:40 |
Vorrtex | mwhahaha "sudo -E tripleo-repos current-tripleo-dev" | 17:41 |
Vorrtex | that line specifically | 17:41 |
mwhahaha | Vorrtex: then you should have ansible 2.5.2 | 17:41 |
*** ccamacho has quit IRC | 17:41 | |
mwhahaha | Vorrtex: do a yum repolist for me | 17:41 |
Vorrtex | mwhahaha I can uninstall ansible and rerun if you think that'll help | 17:41 |
mwhahaha | Vorrtex: no your openstack command is also old, i have an install from last week and mine says 3.16.1 | 17:41 |
mwhahaha | Vorrtex: so it's like you have old content | 17:42 |
*** raildo has quit IRC | 17:43 | |
Vorrtex | mwhahaha I think I'll do a clean run then. Nuke the VM and start over, just to clean it up "completely" | 17:44 |
mwhahaha | Vorrtex: i would also recommend not running master and using like "tripleo-repos -b rocky current" for rocky | 17:46 |
mwhahaha | unless you're doing to be doing some development against master | 17:46 |
Vorrtex | mwhahaha the plan is to do some development. | 17:47 |
mwhahaha | k | 17:47 |
Vorrtex | Yeah. Thanks for the help so far mwhahaha hopefully I won't be back with troubleshooting issues, but only time will tell :( | 17:48 |
mwhahaha | yea you'll be back | 17:48 |
openstackgerrit | Victor Pickard proposed openstack/tripleo-heat-templates stable/queens: Change log directory for OpenDaylight https://review.openstack.org/612459 | 17:52 |
*** jcoufal has joined #tripleo | 17:55 | |
*** pcaruana has quit IRC | 17:57 | |
openstackgerrit | Bob Fournier proposed openstack/os-net-config stable/rocky: Retry ovs-appctl command https://review.openstack.org/612460 | 17:59 |
*** raildo has joined #tripleo | 18:01 | |
*** eck` is now known as eck`gone | 18:02 | |
*** dprince has joined #tripleo | 18:04 | |
*** amoralej is now known as amoralej|off | 18:09 | |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 18:10 |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 18:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 18:10 |
*** raildo has quit IRC | 18:11 | |
openstackgerrit | Victor Pickard proposed openstack/tripleo-heat-templates stable/rocky: Change log directory for OpenDaylight https://review.openstack.org/612468 | 18:14 |
*** agopi has quit IRC | 18:15 | |
*** gfidente[m] has left #tripleo | 18:17 | |
mwhahaha | ssbarnea, quiquell|off: what patches do we need for the fedora28 standalone job? | 18:17 |
*** apetrich has quit IRC | 18:17 | |
ssbarnea | mwhahaha: well... atm i am reworing py3 detection because last merge logic was... not flawless. | 18:18 |
ssbarnea | ....mainly breaks on centos-7 if someone is installing python3, as it detects it and attempts to use it. | 18:19 |
mwhahaha | interesting | 18:19 |
mwhahaha | ssbarnea: we shouldn't be automagically detecting that, shouldn't it pick it up from the OS release config? | 18:19 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Correct python3 detection logic https://review.openstack.org/612471 | 18:20 |
ssbarnea | mwhahaha: yes and no. mainly by the time you load the release config you already run python code. we need to detect correct python in quickstart.sh and reproducer (at least). | 18:21 |
ssbarnea | is part of the bootstraping | 18:21 |
mwhahaha | meh | 18:21 |
ssbarnea | mwhahaha check ^^ that is the first attempt to "select" correct python. | 18:22 |
*** hjensas has joined #tripleo | 18:22 | |
ssbarnea | it is ugly because there is no standard way to query the default python for each distro/version. | 18:23 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker https://review.openstack.org/604180 | 18:23 |
mwhahaha | ssbarnea: yea that'll probably work, though I would just like to make progress on the job config even if we don't have a reproducer so let's not spend a ton of time on this bit | 18:23 |
EmilienM | bandini, beagles: https://review.openstack.org/#/c/604180 FYI on running podman tag from within podman container | 18:24 |
ssbarnea | mwhahaha back to your original question, all changes related to f28 are at https://review.openstack.org/#/q/topic:standalone-f28+(status:open+OR+status:merged) | 18:25 |
mwhahaha | ssbarnea: yea but there's a bunch of old/new, what patches specifically do we must have to have a fedora28 job in check | 18:25 |
*** hjensas has quit IRC | 18:26 | |
ssbarnea | mwhahaha: this is supposed to be the most complete change that combines the others but may need to be updated: https://review.openstack.org/#/c/610119/ | 18:26 |
ssbarnea | i will soon close some of the old ones reviews but i need to double check them. | 18:27 |
mwhahaha | k | 18:27 |
ssbarnea | mwhahaha : if you can have a look at "Get DLRN hash" error, it would be of great help. http://logs.openstack.org/19/610119/5/check/tripleo-ci-fedora-28-standalone/0ebddb9/job-output.txt.gz | 18:27 |
mwhahaha | ssbarnea: will do | 18:28 |
ssbarnea | feel free to update the coresponding review | 18:28 |
mwhahaha | it's cause it's not current-tripleo | 18:28 |
mwhahaha | it's current | 18:28 |
mwhahaha | i'll find the spot | 18:28 |
mwhahaha | ssbarnea: might be that dlrn_hash_tag patch | 18:29 |
beagles | EmilienM, ack | 18:30 |
mwhahaha | which is weird cause it was working | 18:30 |
*** apetrich has joined #tripleo | 18:30 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: Add release file for fedora 28 https://review.openstack.org/610468 | 18:33 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: Remove old config/release files https://review.openstack.org/606944 | 18:33 |
mwhahaha | ssbarnea: -^ i reorder these i think that's why they were failing | 18:33 |
EmilienM | beagles: note, the -v /run/netns:/run/netns:shared seems to be not required | 18:33 |
EmilienM | I think | 18:33 |
EmilienM | beagles: for podman | 18:34 |
beagles | EmilienM, k | 18:34 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker https://review.openstack.org/604180 | 18:35 |
*** eck`gone is now known as eck` | 18:37 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: DNM: fedora28 mega-testing change https://review.openstack.org/610119 | 18:38 |
Vorrtex | mwhahaha I just got an error message: "An error occurred during configuration validation, please check your host configuration and try again. | 18:41 |
Vorrtex | Error message: Invalid local_interface specified. eth1 is not available." | 18:41 |
mwhahaha | Vorrtex: do you have an eth1? | 18:42 |
mwhahaha | that one is pretty straight forward | 18:42 |
*** hjensas has joined #tripleo | 18:42 | |
Vorrtex | mwhahaha ha ha no, my question isn't "what does this mean", its "which config should I look at? undercloud.conf"? | 18:42 |
mwhahaha | undercloud.conf | 18:42 |
mwhahaha | local_interface | 18:42 |
Vorrtex | okay. That whole file is commented out... | 18:42 |
mwhahaha | right you need to edit it | 18:42 |
mwhahaha | with your environment | 18:42 |
mwhahaha | interface/ips/ntp/dns/etc | 18:43 |
Vorrtex | mwhahaha got it. This doesn't seem "farther" in the process than I was before, so I'm curious why it needs editing this time around. | 18:43 |
mwhahaha | Vorrtex: because you don't have an eth1? | 18:44 |
Vorrtex | didn't have an eth1 before, either | 18:44 |
mwhahaha | did you forget to add the 2nd nic to your vm | 18:44 |
mwhahaha | Vorrtex: other possibility was because you were running an older version or something | 18:44 |
ade_lee | EmilienM, dprince got a quick container + tripleo related question .. trying to deploy my overcloud controllers with a custom container for barbican. | 18:45 |
ade_lee | so I created my new container and put it on my undercloud registry | 18:45 |
ade_lee | :q | 18:45 |
ade_lee | undercloud) [stack@undercloud ~]$ docker images |grep barbican | 18:45 |
ade_lee | 192.168.24.1:5000/tripleorocky/centos-binary-barbican-api thales 8471eb6b9d57 5 days ago 980 MB | 18:45 |
mwhahaha | ade_lee: docker iamges != registry | 18:46 |
ade_lee | so -- I then edited -- overcloud-yml/containers-env-file.yaml | 18:46 |
ade_lee | mwhahaha, ok -- how do I check its where I need it to be? | 18:46 |
dprince | ade_lee: you might need to push it to the registry with 'overcloud container image upload' first | 18:47 |
dprince | ade_lee: or, you can manually push it to the undercloud registry first | 18:47 |
*** rdopiera has quit IRC | 18:47 | |
ade_lee | dprince, ok -- let me try the overcloud container image upload .. looking for syntax .. | 18:48 |
dprince | ade_lee: you probably already ran the correct commands. But since you are adding Barbican you may need to add an extra --env to your 'overcloud container image prepare' command | 18:49 |
*** lblanchard has joined #tripleo | 18:49 | |
dprince | ade_lee: the extra heat environment for the barbican service would cause that container to be included in the stock list for example | 18:49 |
honza | chandankumar: could you point me to the code that actually does the git checkout of the zuul change in the tempest plugin repo? | 18:50 |
*** thrash has quit IRC | 18:51 | |
*** flaper87 has quit IRC | 18:51 | |
*** sl0w has quit IRC | 18:51 | |
ade_lee | dprince, well what I did was modify the file containers-env-file.yaml which is a result of openstack overcloud container image prepare and change the barbican entry to : | 18:51 |
*** thrash has joined #tripleo | 18:51 | |
ade_lee | DockerBarbicanApiImage: 192.168.24.1:8787/tripleorocky/centos-binary-barbican-api:thales | 18:51 |
*** flaper87 has joined #tripleo | 18:52 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker https://review.openstack.org/604180 | 18:52 |
ade_lee | but I guess I need to run overcloud container image upload --config-file ./containers-env-file.yaml ? | 18:52 |
ade_lee | dprince, ah - I think I see what you're saying -- ok - let me try that .. | 18:55 |
mwhahaha | ade_lee: you can just use docker push to push the container up to the registry if it's already loaded in docker on the undercloud | 19:01 |
mwhahaha | ade_lee: docker push 192.168.24.1:8787/tripleorocky/centos-binary-barbican-api | 19:02 |
ade_lee | mwhahaha, hmm ... I thought I already did that .. | 19:03 |
*** kopecmartin|off has quit IRC | 19:03 | |
mwhahaha | ade_lee: you can query the registry via curl to see if the tag is there | 19:03 |
ade_lee | mwhahaha, you mean curl -O 192.168.24.1:8787/tripleorocky/centos-binary-barbican-api:thales ? | 19:05 |
mwhahaha | no | 19:06 |
mwhahaha | ade_lee: curl 192.168.24.1:8787/v2/tripleorocky/centos-binary-barbican-api/tags/list | 19:08 |
ade_lee | mwhahaha, cool - its there | 19:08 |
*** jcoufal has quit IRC | 19:09 | |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 19:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 19:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 19:10 |
*** roger2 has joined #tripleo | 19:15 | |
*** jcoufal has joined #tripleo | 19:15 | |
*** vinaykns has joined #tripleo | 19:18 | |
roger2 | I'm confused about "boot_option:local". "openstack overcloud deploy --templates" fails for errors about it. eg. u'Node <uuid> has an incorrectly configured driver_info/deploy_ramdisk. Expected "<uuid>" but got "None".' I used node discovery instead of instackenv.json to set capabilities, which appeared as u'capabilities': u'cpu_hugepages:true,cpu_vt:true,boot_mode:bios'. Should I make an introspection rule to specify bootboot_option | 19:20 |
roger2 | s/bootboot/boot/ | 19:22 |
*** lblanchard has quit IRC | 19:23 | |
roger2 | My env: tripleo/queens/containerized/baremetal | 19:23 |
*** rlandy has quit IRC | 19:35 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Use python_requires to match ansible requirements https://review.openstack.org/612483 | 19:37 |
*** rlandy has joined #tripleo | 19:43 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add ctlplane interface routes https://review.openstack.org/604943 | 19:47 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - data + env (1/3) https://review.openstack.org/582180 | 19:47 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - network.j2 (2/3) https://review.openstack.org/582181 | 19:47 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Replace tripleo_common/utils/roles.py validate_role_yaml() https://review.openstack.org/608471 | 19:47 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - subnet fixed_ips (3/3) https://review.openstack.org/582301 | 19:47 |
*** agopi has joined #tripleo | 19:48 | |
*** agopi_ has joined #tripleo | 19:50 | |
*** agopi has quit IRC | 19:53 | |
*** morazi has quit IRC | 20:00 | |
*** sanjayu__ has quit IRC | 20:09 | |
*** saneax has joined #tripleo | 20:09 | |
*** jamesdenton has quit IRC | 20:09 | |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 20:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 20:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 20:10 |
*** agopi_ is now known as agopi | 20:12 | |
*** saneax has quit IRC | 20:24 | |
*** sanjayu_ has joined #tripleo | 20:24 | |
*** sai_p has joined #tripleo | 20:33 | |
sai_p | Hi, can someone review and give workflow for this change https://review.openstack.org/#/c/609585/ | 20:33 |
sai_p | thanks | 20:33 |
*** dprince has quit IRC | 20:36 | |
*** sanjayu_ has quit IRC | 20:38 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Run DLRN gate role only if to_build is true https://review.openstack.org/610728 | 20:38 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Add fedora28 support for quickstart https://review.openstack.org/591652 | 20:39 |
*** hgibson has quit IRC | 20:39 | |
*** saneax has joined #tripleo | 20:39 | |
*** saneax has quit IRC | 20:39 | |
*** saneax has joined #tripleo | 20:40 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Add fedora28 support for quickstart https://review.openstack.org/591652 | 20:43 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: DNM: fedora28 mega-testing change https://review.openstack.org/610119 | 20:43 |
*** zaneb has quit IRC | 20:45 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Introduce proper steps to external update/upgrade tasks https://review.openstack.org/611381 | 20:49 |
openstackgerrit | Merged openstack/tripleo-common master: write_config: force utf8 https://review.openstack.org/611866 | 20:49 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Let openshift-ansible configure the firewall https://review.openstack.org/606001 | 20:49 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Do not modify imagestreams https://review.openstack.org/609445 | 20:49 |
*** jcoufal has quit IRC | 20:52 | |
*** agopi has quit IRC | 20:52 | |
*** ansmith has quit IRC | 20:56 | |
ade_lee | mwhahaha, hey - so new when my controller is trying to get my barbican container - I get the following error -- stderr: Get https://192.168.24.1:8787/v1/_ping: http: server gave HTTP response to HTTPS client | 21:02 |
ade_lee | mwhahaha, any idea how to fix this -- provide some insecure option? | 21:02 |
*** lblanchard has joined #tripleo | 21:06 | |
*** kopecmartin has joined #tripleo | 21:07 | |
mwhahaha | ade_lee: that's normal because we don't have ssl on the docker registry | 21:08 |
mwhahaha | ade_lee: it just falls back to http | 21:08 |
ade_lee | mwhahaha, ok -- but its causing my deployment to fail | 21:08 |
mwhahaha | ade_lee: not likely | 21:08 |
mwhahaha | there's an error elsewhere | 21:08 |
ade_lee | mwhahaha, ok - looking | 21:08 |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 21:10 |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 21:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 21:10 |
ade_lee | mwhahaha, this is the output in /var/lib/mistral/overcloud/ansible.log -- http://paste.openstack.org/show/732638/ - sure looks like its failing because of that .. | 21:11 |
mwhahaha | nope | 21:11 |
mwhahaha | it always gives that note because we don't have https | 21:12 |
mwhahaha | ade_lee: if you docker pull 192.168.24.1:8787/tripleorocky/centos-binary-barbican-api:thales from the overcloud node does it work? | 21:12 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Set openshift_docker_insecure_registries https://review.openstack.org/609603 | 21:15 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Do not wipe disks on OpenShift gluster nodes https://review.openstack.org/605127 | 21:15 |
openstackgerrit | Merged openstack/tripleo-common stable/rocky: Skip deployments with no uuid https://review.openstack.org/612164 | 21:15 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: [Rocky ONLY] Fix haproxy cert inject for check mode https://review.openstack.org/611658 | 21:15 |
ade_lee | mwhahaha, does not appear to .. I get this .. | 21:16 |
ade_lee | [root@overcloud-controller-0 ~]# docker pull 192.168.24.1:8787/tripleorocky/centos-binary-barbican-api:thales | 21:16 |
ade_lee | Trying to pull repository 192.168.24.1:8787/tripleorocky/centos-binary-barbican-api ... | 21:16 |
ade_lee | Get https://192.168.24.1:8787/v1/_ping: http: server gave HTTP response to HTTPS client | 21:16 |
mwhahaha | if it doesn't say anything else it worked i think | 21:20 |
*** abishop has joined #tripleo | 21:21 | |
ade_lee | mwhahaha, well - I tried it on the undercloud and I got something like this .. | 21:21 |
ade_lee | (undercloud) [stack@undercloud tripleo-heat-templates]$ docker pull 192.168.24.1:8787/tripleorocky/centos-binary-barbican-api:thales | 21:21 |
ade_lee | Trying to pull repository 192.168.24.1:8787/tripleorocky/centos-binary-barbican-api ... | 21:21 |
ade_lee | thales: Pulling from 192.168.24.1:8787/tripleorocky/centos-binary-barbican-api | 21:21 |
ade_lee | Digest: sha256:3964f56acc3242a44eb0e1c526fde6a872dc97b34c0d565c25c09cde3233f315 | 21:21 |
ade_lee | Status: Image is up to date for 192.168.24.1:8787/tripleorocky/centos-binary-barbican-api:thales | 21:21 |
*** zaneb has joined #tripleo | 21:21 | |
mwhahaha | right that means it's already there | 21:21 |
ade_lee | mwhahaha, so that seems different | 21:21 |
ade_lee | mwhahaha, right - but when I do it a second time on the ocntroller - it fails | 21:22 |
ade_lee | that is -- | 21:22 |
ade_lee | it does not add that additional data | 21:22 |
mwhahaha | go check the docker logs | 21:22 |
ade_lee | mwhahaha, also the return code on the controller is 1, while on the undercloud =0 | 21:23 |
mwhahaha | in /var/log/messages | 21:23 |
mwhahaha | it should tell you | 21:23 |
ade_lee | Oct 22 21:14:37 overcloud-controller-0 dockerd-current: time="2018-10-22T21:14:37.174224472Z" level=warning msg="Error getting v2 registry: Get https://192.168.24.1:8787/v2/: http: server gave HTTP response to HTTPS client" | 21:23 |
ade_lee | Oct 22 21:14:37 overcloud-controller-0 dockerd-current: time="2018-10-22T21:14:37.174335231Z" level=error msg="Attempting next endpoint for pull after error: Get https://192.168.24.1:8787/v2/: http: server gave HTTP response to HTTPS client" | 21:23 |
ade_lee | Oct 22 21:14:37 overcloud-controller-0 dockerd-current: time="2018-10-22T21:14:37.175710570Z" level=error msg="Attempting next endpoint for pull after error: Get https://192.168.24.1:8787/v1/_ping: http: server gave HTTP response to HTTPS client" | 21:23 |
*** slaweq has quit IRC | 21:24 | |
ade_lee | mwhahaha, I dont see anythung else -- its like its not falling back .. | 21:24 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Skip hosts group in ceph-ansible inventory when all are blacklisted https://review.openstack.org/610736 | 21:24 |
openstackgerrit | Sam Doran proposed openstack/ansible-role-redhat-subscription master: Configure Satellite using Ansible instead of a script https://review.openstack.org/612508 | 21:26 |
*** zaneb has quit IRC | 21:27 | |
mwhahaha | ade_lee: tmate? | 21:27 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/rocky: write_config: force utf8 https://review.openstack.org/612509 | 21:27 |
ade_lee | mwhahaha, yup sure - give me a sec | 21:27 |
openstackgerrit | Sam Doran proposed openstack/ansible-role-redhat-subscription master: Configure Satellite using Ansible instead of a script https://review.openstack.org/612508 | 21:27 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Allow standalone to manage selinux https://review.openstack.org/610596 | 21:31 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Configure SELinux for standalone https://review.openstack.org/610600 | 21:31 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix cinder_api_apache error during upgrade. https://review.openstack.org/612279 | 21:31 |
openstackgerrit | Merged openstack/python-tripleoclient master: Switch Heat Launcher to use Podman instead of Docker when containerized https://review.openstack.org/606077 | 21:31 |
*** stevebaker has quit IRC | 21:31 | |
*** dmellado has quit IRC | 21:32 | |
*** gouthamr has quit IRC | 21:32 | |
ade_lee | mwhahaha, ssh qDT2TofF2476FQFr0TiDgePYo@ny2.tmate.io | 21:33 |
mwhahaha | k | 21:33 |
ade_lee | mwhahaha, as you can see we're on undercloud | 21:34 |
mwhahaha | ade_lee: which did it fail on? controller-0? | 21:34 |
roger2 | I was able to resolve warnings for 'Node <uuid> is not configured to use boot_option:local in capabilities. It will not be used for deployment with flavors that require boot_option:local.' by adding "boot_option:local" to the list of introspected capabilities. But I'm still getting errors like, 'errors': [u'Node <uuid> has an incorrectly configured driver_info/deploy_ramdisk. Expected "<uuid>" but got "None".' I'm not sure where to | 21:34 |
ade_lee | mwhahaha, all three | 21:34 |
mwhahaha | ade_lee: i have never seen this error before so gimme a bit | 21:36 |
ade_lee | mwhahaha, ack - no worries | 21:36 |
ade_lee | mwhahaha, you know more than I do - so I'm just watching and learning | 21:36 |
mwhahaha | ade_lee: oh i know what it is | 21:37 |
*** spsurya has quit IRC | 21:38 | |
ade_lee | mwhahaha, cool | 21:38 |
mwhahaha | ade_lee: so yea you didn't have your insecure registry set for the undercloud | 21:40 |
ade_lee | mwhahaha, yay - much better | 21:40 |
mwhahaha | ade_lee: so that param i added to the yaml does that | 21:40 |
mwhahaha | ade_lee: so if you redeploy with that, it'll be able to fetch it | 21:40 |
ade_lee | mwhahaha, cool - I figured I was missing something | 21:40 |
ade_lee | mwhahaha, yup redeploying now - thanks! | 21:40 |
mwhahaha | ade_lee: k let me know if you get stuck again | 21:41 |
*** rh-jelabarre has quit IRC | 21:41 | |
ade_lee | mwhahaha, will do | 21:41 |
*** gfidente has quit IRC | 21:45 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Create basic environment to enable Podman on the overcloud https://review.openstack.org/612522 | 21:46 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Create basic environment to enable Podman on the overcloud https://review.openstack.org/612522 | 21:49 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: WIP / fs010: enable Podman on the overcloud https://review.openstack.org/612526 | 21:50 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Lint all the generated playbook after standalone deployment. https://review.openstack.org/604757 | 21:50 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Create basic environment to enable Podman on the overcloud https://review.openstack.org/612522 | 21:56 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Allow the environment to enable Podman on the overcloud https://review.openstack.org/612522 | 21:57 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Allow the environment to enable Podman on the overcloud https://review.openstack.org/612522 | 21:57 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker https://review.openstack.org/604180 | 21:58 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: WIP / fs010: enable Podman on the overcloud https://review.openstack.org/612526 | 21:58 |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 22:10 |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 22:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 22:10 |
*** hgibson has joined #tripleo | 22:10 | |
*** bnemec has quit IRC | 22:18 | |
*** salmankhan has joined #tripleo | 22:28 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Merge new params - nic-config templates https://review.openstack.org/605807 | 22:29 |
openstackgerrit | Merged openstack/tripleo-docs master: Don't keep shrinking font when nesting admonitions https://review.openstack.org/611580 | 22:40 |
*** dsneddon_ has joined #tripleo | 22:41 | |
*** salmankhan has quit IRC | 22:43 | |
*** vinaykns has quit IRC | 22:46 | |
*** rcernin has joined #tripleo | 22:46 | |
*** agopi has joined #tripleo | 22:47 | |
*** mcornea has quit IRC | 22:48 | |
*** hgibson has quit IRC | 22:49 | |
*** tosky has quit IRC | 23:09 | |
*** abishop has quit IRC | 23:09 | |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 23:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 23:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 23:10 |
mwhahaha | building fedora 28 containers, always dangerous | 23:11 |
* mwhahaha wanders off so he doesn't have to watch the failures | 23:11 | |
*** saneax has quit IRC | 23:16 | |
*** saneax has joined #tripleo | 23:17 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add MTU to neutron networks and nic-config templates https://review.openstack.org/599593 | 23:18 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Use mtu of Tenant network to control neutron global_physnet_mtu https://review.openstack.org/612533 | 23:18 |
*** ansmith has joined #tripleo | 23:18 | |
rpioso | I can't get to tripleo.org. Is it down? | 23:19 |
*** dciabrin has quit IRC | 23:19 | |
*** zaneb has joined #tripleo | 23:23 | |
*** zaneb has quit IRC | 23:23 | |
*** zaneb has joined #tripleo | 23:24 | |
*** rcernin_ has joined #tripleo | 23:28 | |
*** rcernin has quit IRC | 23:30 | |
*** abishop has joined #tripleo | 23:31 | |
*** rpioso is now known as rpioso|afk | 23:32 | |
*** abishop has quit IRC | 23:39 | |
*** ssbarnea has quit IRC | 23:40 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Merge new params - nic-config templates https://review.openstack.org/605807 | 23:47 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!