| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 00:00 |
|---|---|---|
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/604293 | 00:00 |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 00:10 |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 00:10 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo master: Update puppet functions https://review.openstack.org/613173 | 00:14 |
| *** sanjayu_ has quit IRC | 00:20 | |
| *** trungnv has quit IRC | 00:35 | |
| *** sai_p_ has quit IRC | 00:36 | |
| *** bfournie has joined #tripleo | 00:51 | |
| *** phuongnh has joined #tripleo | 00:53 | |
| *** dtrainor has quit IRC | 01:04 | |
| *** dtrainor has joined #tripleo | 01:05 | |
| *** rlandy|bbl is now known as rlandy | 01:09 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 01:10 |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 01:10 |
| EmilienM | Tengu: sorry. Feel free to do so | 01:11 |
| *** mcornea has quit IRC | 01:11 | |
| *** mrsoul has quit IRC | 01:19 | |
| *** mschuppert has quit IRC | 01:20 | |
| *** dtrainor has quit IRC | 01:24 | |
| *** huynq has joined #tripleo | 02:02 | |
| *** partlycloudy has joined #tripleo | 02:03 | |
| *** partlycloudy has left #tripleo | 02:04 | |
| *** partlycloudy has joined #tripleo | 02:09 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 02:10 |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 02:10 |
| *** agopi has joined #tripleo | 02:13 | |
| *** apetrich has quit IRC | 02:16 | |
| *** lblanchard has quit IRC | 02:38 | |
| *** dtrainor has joined #tripleo | 02:42 | |
| itlinux | https://bugs.launchpad.net/tripleo/+bug/1766184 | 02:44 |
| openstack | Launchpad bug 1766184 in tripleo "Containerized Horizon: unable to connect" [High,Triaged] | 02:44 |
| itlinux | for people that may have issues with Horizon and have containers running and have install services that are not needed. | 02:45 |
| itlinux | hope that helps other. | 02:45 |
| itlinux | I will apply a patch for this. | 02:45 |
| *** psachin has joined #tripleo | 02:54 | |
| *** lblanchard has joined #tripleo | 02:55 | |
| *** tzumainn has quit IRC | 02:56 | |
| *** lblanchard has quit IRC | 03:00 | |
| openstackgerrit | Remo Mattei proposed openstack/tripleo-heat-templates master: Turning off extra UIs from Horizon fixes also SQLite issue https://review.openstack.org/613186 | 03:00 |
| *** partlycloudy has left #tripleo | 03:04 | |
| *** partlycloudy has joined #tripleo | 03:06 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 03:10 |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 03:10 |
| *** itlinux has quit IRC | 03:17 | |
| *** partlycloudy has left #tripleo | 03:22 | |
| *** ramishra has joined #tripleo | 03:37 | |
| *** vinaykns has quit IRC | 03:40 | |
| *** ykarel|away has joined #tripleo | 03:54 | |
| *** ykarel|away is now known as ykarel | 03:54 | |
| *** saneax has joined #tripleo | 03:58 | |
| *** jaganathan has quit IRC | 03:58 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 04:10 |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 04:10 |
| *** janki has joined #tripleo | 04:12 | |
| *** udesale has joined #tripleo | 04:27 | |
| *** ykarel has quit IRC | 04:30 | |
| jaosorior | good morning! | 04:35 |
| *** ykarel has joined #tripleo | 04:49 | |
| *** spsurya has joined #tripleo | 04:51 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Make containerized-undercloud-upgrades job non-voting https://review.openstack.org/612724 | 04:55 |
| *** ratailor has joined #tripleo | 04:58 | |
| *** shyamb has joined #tripleo | 05:01 | |
| openstackgerrit | Pranali Deore proposed openstack/tripleo-heat-templates master: Enable Glance Image Cache in OOO https://review.openstack.org/613195 | 05:09 |
| *** jaganathan has joined #tripleo | 05:09 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 05:10 |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 05:10 |
| *** yprokule has joined #tripleo | 05:11 | |
| *** pdeore has joined #tripleo | 05:15 | |
| *** shyamb has quit IRC | 05:17 | |
| *** jfrancoa has joined #tripleo | 05:27 | |
| *** rlandy has quit IRC | 05:31 | |
| janki | jaosorior, morning gift - reviews for https://review.openstack.org/#/c/612663/ plz :) | 05:40 |
| *** agurenko has joined #tripleo | 05:41 | |
| ykarel | chandankumar, can u check my comment in merged patch https://review.openstack.org/#/c/609741/3/config/general_config/featureset020.yml and get it fixed | 05:46 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/queens: [Queens only] Use rhel-registration tool in Rhsm to update repos before upgrade https://review.openstack.org/611879 | 05:48 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Add rocky specific parameters to custom NICs. https://review.openstack.org/605407 | 05:51 |
| jaosorior | janki: done | 05:54 |
| janki | jaosorior, thanks :) | 05:56 |
| *** agurenko has quit IRC | 05:57 | |
| *** agurenko has joined #tripleo | 05:58 | |
| *** shyamb has joined #tripleo | 06:01 | |
| *** jaganathan has quit IRC | 06:09 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 06:10 |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 06:10 |
| Tengu | hello there | 06:10 |
| bandini | meh gate is slammed | 06:10 |
| bandini | morning | 06:10 |
| *** ksambor has joined #tripleo | 06:11 | |
| Tengu | my brain's slammed | 06:12 |
| Tengu | viva insomnia | 06:12 |
| *** mschuppert has joined #tripleo | 06:17 | |
| *** gfidente has joined #tripleo | 06:26 | |
| *** jaganathan has joined #tripleo | 06:26 | |
| *** cylopez has joined #tripleo | 06:32 | |
| *** kopecmartin|off is now known as kopecmartin | 06:34 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Fixed test_black_regex in FS020 https://review.openstack.org/613214 | 06:34 |
| *** slaweq has joined #tripleo | 06:35 | |
| *** quiquell|off is now known as quiquell | 06:49 | |
| *** hberaud has quit IRC | 06:51 | |
| *** waleedm has joined #tripleo | 06:53 | |
| jfrancoa | jaosorior: buenos días! do you have any idea why is this error appearing in stable/queens (tripleo-common) CI jobs http://logs.openstack.org/29/611329/3/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/38cfc40/logs/subnode-2/var/log/containers/nova/nova-compute.log.txt.gz#_2018-10-24_18_09_10_044 ? It looks like some permission issue, but I can't see any late modification in the nova-compute docker service template... | 06:53 |
| *** rcernin has quit IRC | 07:00 | |
| *** apetrich has joined #tripleo | 07:00 | |
| *** pcaruana has joined #tripleo | 07:04 | |
| *** hberaud has joined #tripleo | 07:06 | |
| jfrancoa | mschuppert: : hey, can I forward the question to you about this error http://logs.openstack.org/29/611329/3/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/38cfc40/logs/subnode-2/var/log/containers/nova/nova-compute.log.txt.gz#_2018-10-24_18_09_10_044 ? I saw you submitted https://review.openstack.org/#/c/585762/ and it seems related | 07:06 |
| mschuppert | jfrancoa: hi, checking | 07:08 |
| jfrancoa | mschuppert: thanks | 07:09 |
| *** ccamacho has joined #tripleo | 07:09 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 07:10 |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 07:10 |
| *** jpena|off is now known as jpena | 07:15 | |
| *** hberaud has quit IRC | 07:16 | |
| Tengu | oh. rdo cloud is dead again? | 07:21 |
| Tengu | that's... annoying. Will need to add a mirroring of the overcloud image then -.-' | 07:21 |
| *** paramite has joined #tripleo | 07:23 | |
| *** hjensas has quit IRC | 07:24 | |
| *** yolanda has joined #tripleo | 07:24 | |
| ykarel | Tengu, what issue u are seeing related to RDO cloud? | 07:27 |
| ykarel | i see atleast services are up | 07:27 |
| *** hberaud has joined #tripleo | 07:27 | |
| Tengu | ykarel: apparently I can't download the overcloud-full image and its friend | 07:27 |
| ykarel | Tengu, url? | 07:27 |
| ykarel | images.rdoproject.org? | 07:27 |
| *** hjensas has joined #tripleo | 07:28 | |
| Tengu | hmmmm maybe that was a temporary glitch | 07:29 |
| Tengu | https://images.rdoproject.org/master/rdo_trunk/current-tripleo/ seems to work. | 07:29 |
| Tengu | will probably need to add some retry in my ansible -.-. | 07:29 |
| ykarel | ack | 07:30 |
| *** phuongnh has quit IRC | 07:36 | |
| openstackgerrit | inspurericzhang proposed openstack/puppet-pacemaker master: Update min tox version to 2.0 https://review.openstack.org/613224 | 07:37 |
| *** phuongnh has joined #tripleo | 07:38 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Use dnf and python3 on platforms where these are default https://review.openstack.org/612677 | 07:38 |
| openstackgerrit | inspurericzhang proposed openstack/puppet-tripleo master: Update min tox version to 2.0 https://review.openstack.org/613225 | 07:39 |
| jaosorior | jfrancoa: no idea :/ | 07:42 |
| openstackgerrit | inspurericzhang proposed openstack/puppet-crane master: Update min tox version to 2.0 https://review.openstack.org/613229 | 07:42 |
| mschuppert | jfrancoa: so far it seems the host_prep_task to create /var/lib/nova/instances was not run https://github.com/openstack/tripleo-heat-templates/blob/stable/queens/docker/services/nova-compute.yaml#L232 and therefor /var/lib/nova/instances was not there when the nova_statdir script ran to change the owner to the correct nova user inside the container at | 07:44 |
| mschuppert | http://logs.openstack.org/29/611329/3/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/38cfc40/logs/subnode-2/var/log/journal.txt.gz#_Oct_24_17_54_53 . but right now not sure why | 07:44 |
| *** agurenko has quit IRC | 07:45 | |
| jfrancoa | mschuppert: I'm thinking about opening a LP so far to track all, wdyt? | 07:47 |
| sshnaidm|ruck | jaosorior, rfolco|rover fyi: https://bugs.launchpad.net/tripleo/+bug/1799895 | 07:48 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 07:48 |
| mschuppert | jfrancoa: yes we can do that | 07:49 |
| *** agurenko has joined #tripleo | 07:50 | |
| *** chem_gone is now known as chem | 07:55 | |
| *** ratailor_ has joined #tripleo | 07:56 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Install ansible from RPMs https://review.openstack.org/612290 | 07:57 |
| *** ratailor has quit IRC | 07:57 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 07:58 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: Adapt tqe for the new fedora28 job https://review.openstack.org/612390 | 07:58 |
| *** ykarel is now known as ykarel|lunch | 07:59 | |
| *** shyamb has quit IRC | 08:00 | |
| *** jpich has joined #tripleo | 08:00 | |
| *** ccamacho has quit IRC | 08:00 | |
| *** ccamacho has joined #tripleo | 08:01 | |
| openstackgerrit | Pranali Deore proposed openstack/tripleo-heat-templates master: Enable Glance Image Cache in OOO https://review.openstack.org/613195 | 08:01 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: Adapt tqe for the new fedora28 job https://review.openstack.org/612390 | 08:02 |
| *** amoralej|off is now known as amoralej | 08:06 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-common master: Fix - config-download tarball upload OverflowError https://review.openstack.org/613155 | 08:06 |
| jaosorior | sshnaidm|ruck: do we know what step of the undercloud install is taking this long? | 08:07 |
| sshnaidm|ruck | jaosorior, looking now.. we just disabled ara for undercloud, so it's not easy to see now | 08:07 |
| sshnaidm|ruck | jaosorior, I suppose it's containers part, need to check what exactly | 08:08 |
| jaosorior | sshnaidm|ruck: yep, it's Run tripleo-container-image-prepare | 08:10 |
| jaosorior | that steps takes 1 hour | 08:10 |
| jaosorior | by itself | 08:10 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 08:10 |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 08:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 08:10 |
| jaosorior | sshnaidm|ruck: http://logs.openstack.org/87/610087/4/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/2e409e1/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-10-25_03_06_27 | 08:10 |
| sshnaidm|ruck | jaosorior, do we have logs of this step? | 08:11 |
| jaosorior | sshnaidm|ruck: http://logs.openstack.org/87/610087/4/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/2e409e1/logs/undercloud/var/lib/mistral/config-download-latest/tripleo-container-image-prepare.log.txt.gz | 08:11 |
| sshnaidm|ruck | jaosorior, hmm.. it's 4 minutes only there | 08:12 |
| jaosorior | that's weird | 08:13 |
| jaosorior | sshnaidm|ruck: aah! cause that's for the overcloud | 08:13 |
| jaosorior | sshnaidm|ruck: the undercloud one is the one that took this long | 08:13 |
| jaosorior | sshnaidm|ruck: no, we don't have logs for the undercloud run | 08:14 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Install ansible from RPMs https://review.openstack.org/612290 | 08:14 |
| sshnaidm|ruck | jaosorior, that's bad | 08:16 |
| jaosorior | it is :( | 08:16 |
| sshnaidm|ruck | Tengu, stevebaker can we add logs to undercloud tripleo-container-image-prepare task? | 08:17 |
| *** shyamb has joined #tripleo | 08:17 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 08:18 |
| Tengu | sshnaidm|ruck: well, why not? it's some python code, I guess we can add some logging | 08:19 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 08:19 |
| sshnaidm|ruck | Tengu, we have it in overcloud, but not in undercloud, maybe some switch should be turned on? | 08:19 |
| *** lvdombrkr has joined #tripleo | 08:19 | |
| Tengu | hmm. that sounds weird though. | 08:20 |
| sshnaidm|ruck | Tengu, or maybe we don't collect it in job.. need to discover its path then | 08:20 |
| lvdombrkr | hello folks, tripleo installation based on puppet? | 08:20 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Install ansible from RPMs https://review.openstack.org/612290 | 08:20 |
| Tengu | sshnaidm|ruck: can't really help you on that, I didn't participate to the modifications on that part | 08:20 |
| Tengu | lvdombrkr: hello, mix of ansible and puppet | 08:21 |
| lvdombrkr | Tengu: great, thanks | 08:21 |
| sshnaidm|ruck | Tengu, who can help except of stevebaker ? | 08:21 |
| Tengu | sshnaidm|ruck: I can try ;). | 08:22 |
| sshnaidm|ruck | https://bugs.launchpad.net/tripleo/+bug/1799902 | 08:22 |
| openstack | Launchpad bug 1799902 in tripleo "tripleo-container-image-prepare in undercloud doens't have logs" [Critical,Triaged] | 08:22 |
| Tengu | sshnaidm|ruck: so first things first: it's using oslo for the logging. | 08:23 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 08:23 |
| sshnaidm|ruck | Tengu, which file are you looking at? | 08:24 |
| Tengu | https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/image_uploader.py | 08:24 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Install ansible from RPMs https://review.openstack.org/612290 | 08:25 |
| Tengu | hmm, the image builder doesn't use oslo... https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/image_builder.py | 08:25 |
| Tengu | that might be a first step. | 08:25 |
| Tengu | handler = logging.StreamHandler(sys.stdout) | 08:25 |
| Tengu | bam. | 08:25 |
| Tengu | erfff | 08:27 |
| Tengu | and it's not even using the methods already existing for the subprocess wrapper -.- | 08:27 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606879 | 08:29 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606881 | 08:31 |
| Tengu | sshnaidm|ruck: hm, and in fact I suspect the log for the overcloud exists just because it's managed by mistral, and that one catches the log output. | 08:32 |
| *** ykarel|lunch is now known as ykarel | 08:34 | |
| *** lvdombrkr has quit IRC | 08:39 | |
| *** sri_ has quit IRC | 08:42 | |
| jfrancoa | mschuppert: just fyi https://bugs.launchpad.net/tripleo/+bug/1799903 | 08:45 |
| openstack | Launchpad bug 1799903 in tripleo "Instance creation fails with Permission denied: '/var/lib/nova/instances/<instance-id>" [High,New] | 08:45 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Reduce unit testing changes required for emit_releases_file https://review.openstack.org/611842 | 08:46 |
| jfrancoa | mschuppert: I've just realized this was merged on oct 19: https://review.openstack.org/#/c/589522/ | 08:48 |
| jfrancoa | mschuppert: that would explain why the task was not run | 08:48 |
| mschuppert | jfrancoa: ack, good spot. I'll add what I have. | 08:50 |
| jfrancoa | mschuppert: thanks a lot | 08:50 |
| jfrancoa | mschuppert: I'm also investigating if it's related to the scenarios (because other scenario jobs are passing) | 08:50 |
| quiquell | chem: aka sofer commented on https://review.openstack.org/#/c/611842/4 | 08:50 |
| chem | quiquell: hehe | 08:51 |
| quiquell | chem: tldr we need to emulate references at python using a list | 08:51 |
| quiquell | chem: That's why the fixture variables type does not add up | 08:51 |
| chem | quiquell: oki, I don't get it, it looks like yet another python strangeness to me, do you have a reference that I could read to understand this better ? | 08:53 |
| chem | quiquell: I trust you, but just for my personal enlightenment | 08:54 |
| *** ccamacho has quit IRC | 08:54 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Use dnf and python3 on platforms where these are default https://review.openstack.org/610491 | 08:55 |
| *** ccamacho has joined #tripleo | 08:55 | |
| *** bogdando has joined #tripleo | 09:01 | |
| *** salmankhan has joined #tripleo | 09:08 | |
| *** dtantsur|afk is now known as dtantsur | 09:09 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 09:10 |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 09:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 09:10 |
| quiquell | chem: Found it https://stackoverflow.com/questions/12116127/python-yield-generator-variable-scope | 09:10 |
| quiquell | chem: More or less assigning variable at inner factory function creates a new variable and it does not reuse the outer scope one | 09:11 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Removed important files affecting installation from irrelevant list https://review.openstack.org/613250 | 09:11 |
| quiquell | chem: python3 has keyword nonlocal | 09:12 |
| chem | quiquell: ah, yeah, remember now that nonlocal trick, and now I get why you need a pointer to an array here | 09:13 |
| chem | quiquell: thanks | 09:14 |
| quiquell | chem: yw, I will refactor the rest of stuff if you are ok with it | 09:15 |
| *** shyamb has quit IRC | 09:15 | |
| *** akrivoka has joined #tripleo | 09:16 | |
| *** tosky has joined #tripleo | 09:16 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Use dnf and python3 on platforms where these are default https://review.openstack.org/610491 | 09:16 |
| chem | quiquell: I'm definitively ok with it :) | 09:17 |
| *** shyamb has joined #tripleo | 09:17 | |
| *** jaganathan has quit IRC | 09:17 | |
| quiquell | chem: thanks | 09:18 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Recreate cinder LVM loopback device on startup https://review.openstack.org/612185 | 09:20 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix IHA with the new region_name key https://review.openstack.org/611551 | 09:20 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Remove horizon ui plugins we don't support https://review.openstack.org/611670 | 09:20 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Adopt use of ansible_pkg_mgr variable https://review.openstack.org/612753 | 09:20 |
| *** ratailor has joined #tripleo | 09:22 | |
| *** ratailor_ has quit IRC | 09:23 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Rework neutron/own agent wrapper tools for podman https://review.openstack.org/606975 | 09:24 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: DNM: Testing neutron/OVN rootwrap containers https://review.openstack.org/609947 | 09:24 |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-ha-utils master: Fix STONITH readme removing release from examples https://review.openstack.org/613253 | 09:24 |
| *** ccamacho has quit IRC | 09:27 | |
| chandankumar | arxcruz: any further comments on this https://review.openstack.org/612618 and https://review.openstack.org/606046 | 09:28 |
| Tengu | hmm | 09:29 |
| arxcruz | chandankumar: checking | 09:29 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/paunch master: Fix labels to take multiple values https://review.openstack.org/611298 | 09:29 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/paunch master: Add missing default-runtime support bits https://review.openstack.org/608632 | 09:29 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/paunch master: Speed up getting the container name https://review.openstack.org/611312 | 09:29 |
| Tengu | oh. yes. damn. we need a specific version of pacemaker for podman | 09:29 |
| Tengu | a rope, anyone? -.-' | 09:29 |
| arxcruz | chandankumar: for https://review.openstack.org/#/c/612618/ stackviz is working, nice! | 09:30 |
| chandankumar | jaosorior: sshnaidm|ruck https://review.openstack.org/612618 is good to go in order to complete full tempest on standalone | 09:32 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Fix type of --config-download-timeout https://review.openstack.org/612417 | 09:33 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix typo in standalone-tripleo environment https://review.openstack.org/612800 | 09:33 |
| arxcruz | chandankumar: reviewed | 09:34 |
| *** psachin has quit IRC | 09:35 | |
| *** panda|off has quit IRC | 09:35 | |
| chandankumar | arxcruz: thanks :-) | 09:36 |
| *** aedc has quit IRC | 09:37 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: use templating for nova cell database_connection https://review.openstack.org/611404 | 09:37 |
| bogdando | https://bugs.launchpad.net/tripleo/+bug/1799914 | 09:37 |
| openstack | Launchpad bug 1799914 in tripleo "for ansible driven t-h-t, imported deploy steps task ignore the variables set for it" [High,Triaged] | 09:37 |
| *** kopecmartin is now known as kopecmartin|afk | 09:38 | |
| *** panda has joined #tripleo | 09:38 | |
| *** derekh has joined #tripleo | 09:39 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 09:40 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606881 | 09:40 |
| *** psachin has joined #tripleo | 09:40 | |
| *** ratailor_ has joined #tripleo | 09:43 | |
| *** shyamb has quit IRC | 09:45 | |
| *** shyamb has joined #tripleo | 09:45 | |
| *** ratailor has quit IRC | 09:46 | |
| shyamb | Hi | 09:46 |
| shyamb | facing Websocket timeout issue on overcloud deployment | 09:47 |
| shyamb | at very early stage of mistral workflow execution | 09:47 |
| shyamb | Any steps to debug? | 09:47 |
| chandankumar | arxcruz: and this one also https://review.openstack.org/#/c/613214/ | 09:52 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Update standalone environment file https://review.openstack.org/605523 | 09:56 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Set identity.region with tempestconf explicitly https://review.openstack.org/612245 | 09:56 |
| openstackgerrit | Merged openstack/paunch master: Fix logging to stdout and file in classes/commands https://review.openstack.org/612308 | 09:57 |
| *** jbadiapa has quit IRC | 10:02 | |
| *** psachin has quit IRC | 10:03 | |
| *** jbadiapa has joined #tripleo | 10:04 | |
| *** psachin has joined #tripleo | 10:06 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 10:10 |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 10:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 10:10 |
| *** holser_ has joined #tripleo | 10:10 | |
| *** holser_ has joined #tripleo | 10:11 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates stable/rocky: Fix IHA with the new region_name key https://review.openstack.org/613258 | 10:12 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/queens: Revert "Don't run host_prep_tasks from {{role}}HostPrepDeployment" https://review.openstack.org/613259 | 10:18 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-common stable/queens: [Queens only] Fix the default for docker registry. https://review.openstack.org/611329 | 10:20 |
| *** shyamb has quit IRC | 10:21 | |
| *** shyamb has joined #tripleo | 10:22 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: Adapt tqe for the new fedora28 job https://review.openstack.org/612390 | 10:24 |
| *** psachin has quit IRC | 10:25 | |
| *** jaganathan has joined #tripleo | 10:25 | |
| ramishra | shyamb: What's your tripleoclient version? Sounds like you need https://git.openstack.org/cgit/openstack/python-tripleoclient/commit/?id=dae0133410348363e916d0a398a3132ebdd2688c | 10:27 |
| *** psachin has joined #tripleo | 10:28 | |
| d0ugal | shyamb: Did you manage to debug it? | 10:28 |
| shyamb | d0ugal: no | 10:30 |
| shyamb | thanks | 10:30 |
| d0ugal | shyamb: Can I help? Do you have a paste? Which workflow did it timeout on? | 10:30 |
| shyamb | yeah sure | 10:31 |
| shyamb | let me fetch it | 10:31 |
| d0ugal | k | 10:31 |
| d0ugal | I'll grab a coffee :) | 10:31 |
| shyamb | http://paste.openstack.org/show/733018/ | 10:32 |
| shyamb | this is the new issue, after I rebooted undercloud | 10:32 |
| shyamb | python-tripleoclient-9.2.1-13.el7ost.noarch | 10:32 |
| shyamb | this is the tripleo client that I am using | 10:32 |
| chem | marios: sshnaidm|ruck pep8 is starting to fail on some strange error "./instack_undercloud/undercloud.py:695:33: W605 invalid escape sequence" | 10:34 |
| chem | marios: sshnaidm|ruck is that known or should I raise a lp ? | 10:34 |
| sshnaidm|ruck | chem, not known, please mention in lp which jobs and where | 10:36 |
| chem | sshnaidm|ruck: ack | 10:36 |
| *** udesale has quit IRC | 10:36 | |
| d0ugal | shyamb: Looking. | 10:37 |
| d0ugal | shyamb: I think that might be a heat error actually. | 10:37 |
| d0ugal | shyamb: The last two lines are odd, I think that comes from either heatclient (which tripleoclient uses) and the error from Heat server | 10:38 |
| chem | sshnaidm|ruck: https://bugs.launchpad.net/tripleo/+bug/1799926 | 10:38 |
| openstack | Launchpad bug 1799926 in tripleo "pep8 is start to fails on undercloud.py:695:33: W605 invalid escape sequence" [Critical,Triaged] | 10:38 |
| sshnaidm|ruck | chem, thanks | 10:39 |
| d0ugal | shyamb: So I would start by checking the Heat logs - maybe there is an issue with the templates? | 10:39 |
| *** shyamb has quit IRC | 10:39 | |
| d0ugal | oh well :) | 10:39 |
| chem | sshnaidm|ruck: yw | 10:39 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN https://review.openstack.org/593056 | 10:41 |
| *** marios has quit IRC | 10:45 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 10:46 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Use dnf and python3 on platforms where these are default https://review.openstack.org/612677 | 10:51 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 10:51 |
| chem | sshnaidm|ruck: I have a fix | 10:54 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/instack-undercloud master: Fix pep8 stricter requirement about backslash (W605) https://review.openstack.org/613267 | 10:57 |
| *** psachin has quit IRC | 11:02 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 11:04 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Install ansible from RPMs https://review.openstack.org/612290 | 11:06 |
| *** ccamacho has joined #tripleo | 11:07 | |
| Tengu | jaosorior: hey :). When you have a minute, care to check that changeset? https://review.openstack.org/#/c/611801 - I had to add some more SELinux flags for some volumes. | 11:08 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 11:10 |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 11:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 11:10 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Install ansible from RPMs https://review.openstack.org/612290 | 11:11 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Install ansible from RPMs https://review.openstack.org/612290 | 11:13 |
| *** shyamb has joined #tripleo | 11:13 | |
| *** amoralej is now known as amoralej|lunch | 11:14 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Install ansible from RPMs https://review.openstack.org/612290 | 11:14 |
| shyamb | Hi | 11:15 |
| shyamb | d0ugal: You there? | 11:15 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606881 | 11:15 |
| *** phuongnh has quit IRC | 11:17 | |
| *** marios has joined #tripleo | 11:18 | |
| *** florianf is now known as florianf|pto | 11:19 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Use container_build_id for standalone containers https://review.openstack.org/613084 | 11:20 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 11:22 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28 https://review.openstack.org/610468 | 11:22 |
| jaosorior | Tengu: sure | 11:24 |
| Tengu | jaosorior: thanks :) | 11:24 |
| Tengu | hey guys, quick question: is there a way to *update* the content of the overcloud-full image? Like, the one on images.rdo has old packages, and I'd need to get the real "master" in this image.. | 11:25 |
| Tengu | while still avoiding having to build it from 0 -.-' | 11:25 |
| jaosorior | Tengu: if we're disabling selinux labeling from neutron_dhcp, why do you add the ,z option? | 11:26 |
| jaosorior | Tengu: you can use virt-customize (from libguestfs-tools) and update the image, then update it on glance | 11:26 |
| Tengu | jaosorior: well, right, but as it's mounted in other containers... the labeling might come back later. | 11:26 |
| Tengu | jaosorior: ok. so I have to inject the source-list as well, as they are absent :(. | 11:27 |
| jaosorior | Tengu: also, why do we need to disable it for the dhcp agent? | 11:27 |
| jaosorior | and the l3 agent | 11:27 |
| Tengu | apparently there some blocked accesses, but I got nothing in the audit.log :(. There are too many layers with podman, nsenter, network namespaces and the like :/ | 11:28 |
| jaosorior | dammit :/ | 11:28 |
| Tengu | as you say. | 11:28 |
| Tengu | I spent some hours on that one | 11:28 |
| jaosorior | Tengu: lets get a list of all the ones that are disabled and try to get folks to investigate those, probably folks working on neutron will have better knowledge about what's going on there., | 11:29 |
| Tengu | also, there are some non-trivial mounts such as the netns directory, as it's in /run, there are some restrictions with the :z | 11:29 |
| Tengu | jaosorior: not even sure they'll be of some help on that one, tbh... | 11:30 |
| Tengu | with all the layering we have, it's really, really difficult. | 11:30 |
| Tengu | more over, the question was never asked, as the separation/labelling was deactivated in docker daemon | 11:30 |
| Tengu | I'm already happy to have, for now, ONLY a couple of neutron containers with deactivated labels :). | 11:31 |
| *** dprince has joined #tripleo | 11:31 | |
| Tengu | jaosorior: oh and, for the "replace privileged by capabilities": it's not for now, apparently docker has some issues with that, so it won't work in both worlds, according to bogdando (he did some tests) | 11:32 |
| d0ugal | shyamb: Yup, I am here now. | 11:32 |
| d0ugal | shyamb: I think you may have dropped and missed my replies before... did you get any of them? | 11:33 |
| jaosorior | Tengu: got it, thanks for keeping me up to date | 11:33 |
| jaosorior | bogdando, Tengu: Out of interest, if you have more details about it, let me know. | 11:34 |
| *** jpena is now known as jpena|lunch | 11:34 | |
| *** rh-jelabarre has joined #tripleo | 11:34 | |
| shyamb | d0ugal: I think I missed it | 11:35 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Don't install setuptools/pip/virtualenv from RPMs https://review.openstack.org/612633 | 11:35 |
| shyamb | I have pasted the logs | 11:35 |
| shyamb | let me know your thoughts | 11:35 |
| *** slagle has joined #tripleo | 11:36 | |
| d0ugal | shyamb: I think that might be a heat error actually. | 11:36 |
| d0ugal | shyamb: The last two lines are odd, I think that comes from either heatclient (which tripleoclient uses) and the error from Heat server | 11:36 |
| d0ugal | shyamb: So I would start by checking the Heat logs - maybe there is an issue with the templates? | 11:36 |
| shyamb | ok | 11:36 |
| d0ugal | shyamb: ^ that is what I said | 11:36 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Add release file for fedora 28 https://review.openstack.org/610468 | 11:36 |
| shyamb | ok | 11:36 |
| shyamb | let me check heat logs | 11:37 |
| *** slagle has quit IRC | 11:38 | |
| *** pdeore has quit IRC | 11:40 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606881 | 11:41 |
| *** lblanchard has joined #tripleo | 11:41 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606881 | 11:43 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606881 | 11:44 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606881 | 11:45 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606879 | 11:48 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606879 | 11:48 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606881 | 11:48 |
| honza | chandankumar: hey, any updates? did you get a chance to work on this more? | 11:48 |
| *** mpasserini has joined #tripleo | 11:52 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Use container_build_id for standalone containers https://review.openstack.org/613084 | 11:53 |
| *** slagle has joined #tripleo | 11:53 | |
| mpasserini | Hi, if I look in here https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/nova-conductor.yaml#L137 I don't see a way to specify extra mountpoints for the docker containers using environment files.. so it's pretty much hardcoded in here, is this correct? | 11:54 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Don't install setuptools/pip/virtualenv from RPMs https://review.openstack.org/612633 | 11:54 |
| *** aedc has joined #tripleo | 11:54 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient stable/rocky: Fix type of --config-download-timeout https://review.openstack.org/613289 | 11:54 |
| larsks | mpasserini: that's correct. if you want to change that list, you would make a new copy of the nova-conductor.yaml and update your resource registry to use your copy instead of the stock one. | 11:56 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient stable/rocky: Fix type of --config-download-timeout https://review.openstack.org/613289 | 11:57 |
| mpasserini | larsks: ok thanks | 11:58 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: DNM: squash to test f28 job https://review.openstack.org/612290 | 12:00 |
| openstackgerrit | Honza Pokorny proposed openstack-infra/tripleo-ci master: Add selenium job https://review.openstack.org/607327 | 12:00 |
| *** mcornea has joined #tripleo | 12:00 | |
| *** ratailor_ has quit IRC | 12:01 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Install ansible from RPMs https://review.openstack.org/612290 | 12:02 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Ensure unique containers names in docker-puppet https://review.openstack.org/613295 | 12:02 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: DNM: squash changes to test f28 standalone job https://review.openstack.org/613297 | 12:03 |
| *** hkominos has joined #tripleo | 12:04 | |
| hkominos | morning all: Quick question. Is there any file which defines the usernames: passwords for the openstack containers ? I would like to be sudo in one container but I cant (But I can in others ) | 12:05 |
| *** quiquell is now known as quiquell|lunch | 12:05 | |
| larsks | hkominos: there is no sudo inside containers. They are generally expected to be immutable. If 'docker exec ...' doesn't get you root, that's pretty much it. | 12:07 |
| slagle | docker exec -u root....will usually get you root in a running container | 12:08 |
| *** adrianreza has quit IRC | 12:09 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 12:10 |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 12:10 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Log paunch configuration steps to a file https://review.openstack.org/612948 | 12:10 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Be explicit when passing vars into deploy steps https://review.openstack.org/613300 | 12:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 12:10 |
| larsks | Hah, I didn't even realize there was a -u option to docker exec. TIL. | 12:10 |
| hkominos | slangle: it worked! thx | 12:11 |
| hkominos | larsks: exactly the same for me . First time that I see -u | 12:11 |
| *** morazi has joined #tripleo | 12:11 | |
| *** amoralej|lunch is now known as amoralej | 12:11 | |
| bogdando | PTAL https://review.openstack.org/#/c/613300 | 12:12 |
| bogdando | it fails with undefined variables for me | 12:12 |
| bogdando | and I have no idea why. local ansible testing shows it should work for vars overrides for included/imported tasks | 12:13 |
| bogdando | may be I'm missing something cuz of the j2 magic we have in tht | 12:13 |
| bogdando | jistr_, slagle: ^^ | 12:13 |
| bogdando | and thus the bug for it https://bugs.launchpad.net/tripleo/+bug/1799914 . but still, local testing with dummy ansible playbooks shows it should be working fine | 12:14 |
| openstack | Launchpad bug 1799914 in tripleo "for ansible driven t-h-t, statically imported deploy steps task ignore variables set for it" [High,Incomplete] | 12:14 |
| bogdando | shardy: ^^ perchance please? | 12:14 |
| *** raildo has joined #tripleo | 12:14 | |
| *** jistr_ is now known as jistr | 12:14 | |
| *** zul has joined #tripleo | 12:19 | |
| slagle | bogdando: it's because the vars aren't actually passed in to the tasks | 12:20 |
| bogdando | um | 12:20 |
| bogdando | so the bug is valid? | 12:20 |
| slagle | bogdando: you also need to pass them in on the "Overcloud common deploy step tasks {{step}}" play | 12:20 |
| slagle | bogdando: see what I did here: https://review.openstack.org/#/c/589173/ | 12:21 |
| slagle | bogdando: you need to add those vars on every play where you want them available | 12:21 |
| bogdando | slagle: thanks! | 12:21 |
| bogdando | slagle: so we'll need https://review.openstack.org/#/c/613300/1 still, perhaps, just adapted to https://review.openstack.org/#/c/589173/ | 12:22 |
| slagle | i actually intended to put them on the common play with that patch to begin with | 12:22 |
| bogdando | want to handle that? | 12:22 |
| slagle | but i put them in the wrong place. they probably should be on both plays | 12:22 |
| bogdando | sigh :) | 12:23 |
| slagle | sure, i can push an update | 12:23 |
| bogdando | slagle: hm, I think I have followed fully that https://review.openstack.org/#/c/589173 for my https://review.openstack.org/#/c/612948/4 didn't I?.. | 12:24 |
| bogdando | but it still fails with undefined enable_puppet | 12:25 |
| bogdando | cuz I removed defaults fallback | 12:25 |
| bogdando | and that made the problem visible | 12:25 |
| bogdando | so prolly https://bugs.launchpad.net/tripleo/+bug/1785635 has yet been fully fixed | 12:26 |
| openstack | Launchpad bug 1785635 in tripleo "not all params honored in deploy-steps-tasks.yaml with config-download" [High,Fix released] - Assigned to James Slagle (james-slagle) | 12:26 |
| *** pcaruana has quit IRC | 12:26 | |
| *** tzumainn has joined #tripleo | 12:26 | |
| *** aedc has quit IRC | 12:27 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add common vars to common plays https://review.openstack.org/613306 | 12:27 |
| slagle | bogdando: give that a try ^ | 12:27 |
| *** rlandy has joined #tripleo | 12:27 | |
| bogdando | thanks, trying | 12:28 |
| *** ykarel is now known as ykarel|afk | 12:28 | |
| *** beagles is now known as beagles_mtg | 12:29 | |
| sshnaidm|ruck | slagle, bogdando do you know maybe something about? https://bugs.launchpad.net/tripleo/+bug/1799902 | 12:29 |
| openstack | Launchpad bug 1799902 in tripleo "tripleo-container-image-prepare in undercloud doens't have logs" [Critical,Triaged] | 12:29 |
| openstackgerrit | Pranali Deore proposed openstack/tripleo-heat-templates master: Enable Glance Image Cache in OOO https://review.openstack.org/613195 | 12:30 |
| *** janki has quit IRC | 12:31 | |
| sshnaidm|ruck | mwhahaha, EmilienM or maybe you can help with discovering the log: https://bugs.launchpad.net/tripleo/+bug/1799902 | 12:31 |
| openstack | Launchpad bug 1799902 in tripleo "tripleo-container-image-prepare in undercloud doens't have logs" [Critical,Triaged] | 12:31 |
| *** janki has joined #tripleo | 12:31 | |
| slagle | sshnaidm|ruck: related? https://review.openstack.org/#/c/603944 | 12:32 |
| *** ykarel|afk has quit IRC | 12:33 | |
| *** jpena|lunch is now known as jpena | 12:33 | |
| bogdando | slagle: hint: some may be made as a *var | 12:34 |
| bogdando | in yaml I mean | 12:34 |
| bogdando | to not repeat it | 12:34 |
| slagle | bogdando: that's a good idea | 12:35 |
| sshnaidm|ruck | slagle, cool, do you know where is this executed in undercloud? | 12:37 |
| *** pcaruana has joined #tripleo | 12:39 | |
| slagle | during undercloud install | 12:39 |
| *** artom has quit IRC | 12:41 | |
| *** gfidente has quit IRC | 12:42 | |
| sshnaidm|ruck | slagle, yeah, we with rfolco|rover looking for place to add "--log-file" in undercloud install | 12:42 |
| *** gfidente has joined #tripleo | 12:42 | |
| *** quiquell|lunch is now known as quiquell | 12:43 | |
| *** caboucha has joined #tripleo | 12:44 | |
| openstackgerrit | Udi Kalifon proposed openstack/tempest-tripleo-ui master: Selenium infra https://review.openstack.org/605424 | 12:44 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: DNM: squash to test standalone-f28 job https://review.openstack.org/613311 | 12:47 |
| *** mpasserini has left #tripleo | 12:48 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Activate remaining set of healthchecks https://review.openstack.org/612334 | 12:49 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/queens: Make ODL healthcheck IPv6 compatible https://review.openstack.org/612243 | 12:49 |
| openstackgerrit | Udi Kalifon proposed openstack/tempest-tripleo-ui master: Basic test for the deployment page elements https://review.openstack.org/613312 | 12:49 |
| bogdando | slagle: \o/ works like a charm | 12:50 |
| *** jcoufal has joined #tripleo | 12:50 | |
| *** ykarel has joined #tripleo | 12:50 | |
| fultonj | jtomasek: jistr and i were talking about plan mangement and have a question | 12:50 |
| bogdando | I can wait for update, or push it into the base patch for my little pile | 12:50 |
| bogdando | https://review.openstack.org/#/c/612948/4 | 12:50 |
| *** ansmith has joined #tripleo | 12:50 | |
| bogdando | just in case you wish to update it with dedup | 12:50 |
| jtomasek | fultonj: hi | 12:51 |
| fultonj | i have a mistral workflow i want run on new deployments and upgrades | 12:51 |
| fultonj | hi | 12:51 |
| *** shyamb has quit IRC | 12:51 | |
| fultonj | https://review.openstack.org/#/c/597221/8/workbooks/plan_management.yaml | 12:51 |
| fultonj | works on new deployments but not upgrades | 12:51 |
| fultonj | our logs indicate it didn't get run during `openstack overcloud external-upgrade run ...` | 12:52 |
| fultonj | jistr pointed out that it looks like it's in the wrong logic branch | 12:53 |
| fultonj | so i thought i might move it to line 254 | 12:53 |
| fultonj | https://github.com/openstack/tripleo-common/blob/master/workbooks/plan_management.yaml#L254 | 12:53 |
| jistr | or maybe we need to rewind a bit more still, as i wonder how things work nowadays at all | 12:54 |
| fultonj | then we becamse worried the UI might night trigger it either on upgrades | 12:54 |
| fultonj | might not* | 12:54 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: squash to test standalone-f28 https://review.openstack.org/613316 | 12:54 |
| jistr | i can see that on create we either clone git and upload, or we upload the default /usr/share/openstack-tripleo-heat-templates | 12:55 |
| jistr | https://github.com/openstack/tripleo-common/blob/7ff0d42c001e028f14b4d57a6471b3841830dbc5/workbooks/plan_management.yaml#L88-L107 | 12:55 |
| jistr | ^ right? | 12:55 |
| jtomasek | fultonj, jistr: so I may be confused on what is the update_plan workflow supposed to do. I thought it was supposed to be used to update existing deployment plan with modified/additional files | 12:55 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: DNM: squash changes to test f28 standalone job https://review.openstack.org/613297 | 12:55 |
| jtomasek | is that workflow also used as part of the upgrade? | 12:55 |
| fultonj | jtomasek: it should be part of upgrade, yes | 12:56 |
| *** janki has quit IRC | 12:56 | |
| jistr | but i only see the git part in the update_deployment_plan | 12:56 |
| jistr | https://github.com/openstack/tripleo-common/blob/7ff0d42c001e028f14b4d57a6471b3841830dbc5/workbooks/plan_management.yaml#L255-L268 | 12:56 |
| fultonj | oh wait, you were asking about update_plan sorry, better for jistr to anwer | 12:56 |
| *** bnemec has joined #tripleo | 12:56 | |
| jtomasek | jistr: right | 12:56 |
| jistr | which makes me think... do we upload the templates at all somewhere? | 12:57 |
| jtomasek | jistr: I think that workflow needs to get updated to align with create_deployment_plan | 12:57 |
| jistr | AFAIK this is not only about upgrade, it would also affect repeated runs of `overcloud deploy`, it also uses update_deployment_plan i think | 12:57 |
| jistr | jtomasek, fultonj: yea if i read it correctly now, the workflow probably doesn't refresh the templates at all => it's ourtright broken | 12:58 |
| jistr | *outright | 12:58 |
| jtomasek | jistr: I think that 'overcloud deploy' deletes the deployment plan and recreates it | 12:58 |
| jistr | cc yprokule ^^ | 12:58 |
| jtomasek | jistr: so that workflow is probably not used much, that's why it is outdated | 12:58 |
| jistr | jtomasek: hmm i thought every operation on existing stack used that workflow... checking now | 12:59 |
| jtomasek | jistr: I would incline to align that workflow to what create_deployment_plan does and maybe wrap that workflow with another one to do any required backups etc which seems to be used by upgrades IIUC | 12:59 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606881 | 13:00 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Use dnf and python3 on platforms where these are default https://review.openstack.org/610491 | 13:00 |
| *** aedc has joined #tripleo | 13:00 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606879 | 13:01 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Tracer bullet for f28 testbed https://review.openstack.org/606881 | 13:02 |
| jtomasek | jistr: we would like to introduce CLI commands which would use update_deployment_plan to do changes to deployment plan. That would be a first step in allowing CLI operations on existing deployment plan without constantly re-creating it. If you could help me identify when is this workflow currently called that would be very helpful | 13:04 |
| *** weshay has quit IRC | 13:05 | |
| *** rascasoft has quit IRC | 13:05 | |
| *** akrzos has quit IRC | 13:05 | |
| *** rascasoft has joined #tripleo | 13:05 | |
| *** akrzos has joined #tripleo | 13:06 | |
| fultonj | jtomasek jistr so there might be a bigger bug | 13:08 |
| fultonj | is there a smaller bug i can fix though to get this worfklow executed at the right time? | 13:08 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797525 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1797525 in tripleo "After the switch to podman & skopeo, undercloud deployment takes +60% longer" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 13:10 |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 13:10 |
| *** aedc has quit IRC | 13:11 | |
| fultonj | jistr jtomasek i had opened https://bugs.launchpad.net/tripleo/+bug/1799945 | 13:12 |
| openstack | Launchpad bug 1799945 in tripleo "Q > R ceph upgrade fails: SwiftFetchDirGetTempurl not set" [High,Triaged] - Assigned to John Fulton (jfulton-org) | 13:12 |
| *** agopi has quit IRC | 13:12 | |
| fultonj | perhaps it needs a content update, "just a symptom of..." ? | 13:13 |
| *** pliu has quit IRC | 13:15 | |
| *** rascasoft has quit IRC | 13:15 | |
| bogdando | slagle: looks nice https://paste.fedoraproject.org/paste/G1Ze8ywqyO5UOO-z-O9VUA eh? thanks for the quick fix! | 13:16 |
| chem | sshnaidm|ruck: oh boy, the pep8 fix is blocked by yet another idontwhatsgoingon error http://logs.openstack.org/67/613267/1/check/openstack-tox-lower-constraints/96dda80/job-output.txt.gz#_2018-10-25_11_54_43_167827 | 13:16 |
| bogdando | it let my testing for paunch logs to finish | 13:16 |
| *** artom has joined #tripleo | 13:16 | |
| *** artom has quit IRC | 13:16 | |
| *** artom has joined #tripleo | 13:17 | |
| *** rascasoft has joined #tripleo | 13:17 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Add common vars to common plays https://review.openstack.org/613306 | 13:21 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Be explicit when passing vars into deploy steps https://review.openstack.org/613300 | 13:21 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Log paunch configuration steps to a file https://review.openstack.org/612948 | 13:21 |
| *** huynq has quit IRC | 13:22 | |
| *** artom has quit IRC | 13:23 | |
| *** artom has joined #tripleo | 13:23 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-common master: Fix - config-download tarball upload OverflowError https://review.openstack.org/613155 | 13:27 |
| fultonj | jistr jtomasek so the plan is to align the update_deployment_plan workflow to what create_deployment_plan does? | 13:27 |
| jtomasek | fultonj: that would be my wish:) | 13:28 |
| *** ansmith has quit IRC | 13:28 | |
| *** ansmith_ has joined #tripleo | 13:28 | |
| *** jistr is now known as jistr|call | 13:29 | |
| jtomasek | fultonj: for upgrade we would create another workflow which uses update_deployment_plan as subworkflow (one of the tasks) | 13:29 |
| jistr|call | i've unwrapped the call stack | 13:29 |
| jistr|call | https://github.com/openstack/python-tripleoclient/blob/a7a5ae01c1d7680e887ea7f2724faf0127ab6b4f/tripleoclient/v1/overcloud_deploy.py#L888-L889 | 13:29 |
| jistr|call | https://github.com/openstack/python-tripleoclient/blob/a7a5ae01c1d7680e887ea7f2724faf0127ab6b4f/tripleoclient/v1/overcloud_deploy.py#L360-L361 | 13:29 |
| jistr|call | https://github.com/openstack/python-tripleoclient/blob/a7a5ae01c1d7680e887ea7f2724faf0127ab6b4f/tripleoclient/v1/overcloud_deploy.py#L378-L386 | 13:29 |
| jistr|call | https://github.com/openstack/python-tripleoclient/blob/a7a5ae01c1d7680e887ea7f2724faf0127ab6b4f/tripleoclient/workflows/plan_management.py#L227-L228 | 13:29 |
| jistr|call | https://github.com/openstack/python-tripleoclient/blob/a7a5ae01c1d7680e887ea7f2724faf0127ab6b4f/tripleoclient/workflows/plan_management.py#L41-L44 | 13:29 |
| jistr|call | # unwind and continue: | 13:29 |
| jistr|call | https://github.com/openstack/python-tripleoclient/blob/a7a5ae01c1d7680e887ea7f2724faf0127ab6b4f/tripleoclient/workflows/plan_management.py#L231-L233 | 13:29 |
| jistr|call | https://github.com/openstack/python-tripleoclient/blob/a7a5ae01c1d7680e887ea7f2724faf0127ab6b4f/tripleoclient/workflows/plan_management.py#L117 | 13:29 |
| jistr|call | from that is visible that: * we do update the templates, but it's directly from the client (not via Mistral), now i recall i think that was done for performance reasons | 13:30 |
| jistr|call | * we do use the update_deployment_plan workflow | 13:30 |
| jistr|call | fultonj, jtomasek: so maybe indeed we just need to move the parameter setting out of the git part of the workflow, to the common part | 13:30 |
| *** rnoriega has quit IRC | 13:31 | |
| *** rascasoft has quit IRC | 13:31 | |
| *** akrzos has quit IRC | 13:31 | |
| jtomasek | jistr|call: thanks! | 13:32 |
| *** akrzos has joined #tripleo | 13:32 | |
| *** d0ugal has quit IRC | 13:33 | |
| *** rascasoft has joined #tripleo | 13:33 | |
| *** d0ugal has joined #tripleo | 13:34 | |
| *** pcaruana has quit IRC | 13:37 | |
| *** rnoriega has joined #tripleo | 13:38 | |
| *** aedc has joined #tripleo | 13:38 | |
| *** agopi has joined #tripleo | 13:40 | |
| *** weshay has joined #tripleo | 13:40 | |
| EmilienM | chem: hey! can I take over https://review.openstack.org/#/c/613267/ to fix lower constraints? (btw thx a lot for the pep8 fix) | 13:41 |
| chem | EmilienM: be my guest I have no idea why it fail, ping sshnaidm|ruck about it earlier | 13:42 |
| fultonj | jistr|call: the common part, i.e. onto line 254 of https://github.com/openstack/tripleo-common/blob/master/workbooks/plan_management.yaml#L254 ? | 13:44 |
| jistr|call | fultonj: i'd put it between these two https://github.com/openstack/tripleo-common/blob/master/workbooks/plan_management.yaml#L319-L326 | 13:45 |
| fultonj | jistr|call: ok, thanks | 13:46 |
| EmilienM | chem: me neither | 13:47 |
| EmilienM | I'm looking at it :D | 13:47 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Add release file for fedora 28 https://review.openstack.org/610468 | 13:47 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: DNM: squash to test standalone-f28 job https://review.openstack.org/613311 | 13:47 |
| *** mjturek has joined #tripleo | 13:48 | |
| *** jcoufal has quit IRC | 13:48 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: DNM: squash changes to test f28 standalone job https://review.openstack.org/613297 | 13:49 |
| *** d0ugal has quit IRC | 13:49 | |
| *** weshay has quit IRC | 13:49 | |
| chem | EmilienM: ah, crap, though you knew about this (or somebody) ... well self._nat_source = self.config.get_nat_source() TypeError: 'NoneType' object is not callable looks like self.config is none :) | 13:50 |
| *** beagles_mtg is now known as beagles | 13:51 | |
| *** d0ugal has joined #tripleo | 13:51 | |
| *** jcoufal has joined #tripleo | 13:51 | |
| *** homegrown has left #tripleo | 13:51 | |
| *** rpittau has quit IRC | 13:52 | |
| EmilienM | chem: found it | 13:55 |
| *** vinaykns has joined #tripleo | 13:55 | |
| chem | EmilienM: ah, so what is it ? | 13:56 |
| *** jfrancoa has quit IRC | 13:56 | |
| * chem running tox -elower-constraints -vv | 13:57 | |
| mwhahaha | sshnaidm|ruck: they end up in install-undercloud.log | 13:57 |
| sshnaidm|ruck | mwhahaha, thanks | 13:57 |
| sshnaidm|ruck | rfolco|rover, ^^ | 13:58 |
| rfolco|rover | I saw the config... ContainerImagePrepareLogFile: ../install-undercloud.log | 13:58 |
| *** jfrancoa has joined #tripleo | 13:58 | |
| rfolco|rover | was wondering if the logs are really there | 13:59 |
| EmilienM | mwhahaha, sshnaidm|ruck : I'm working on the instack-undercloud gate issue on lower contraint failing job | 13:59 |
| *** mjturek has quit IRC | 13:59 | |
| mwhahaha | k | 13:59 |
| sshnaidm|ruck | EmilienM, cool | 13:59 |
| *** Vorrtex has joined #tripleo | 14:00 | |
| slagle | #startmeeting TripleO Edge Squad Meeting | 14:01 |
| openstack | Meeting started Thu Oct 25 14:01:43 2018 UTC and is due to finish in 60 minutes. The chair is slagle. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:01 |
| *** openstack changes topic to " (Meeting topic: TripleO Edge Squad Meeting)" | 14:01 | |
| slagle | ping slagle, emilien, csatari, jaosorior, owalsh, fultonj, gfidente, hjensas, jtomasek,thrash, bogdando, dtantsur, rbrady, d0ugal, toure | 14:01 |
| openstack | The meeting name has been set to 'tripleo_edge_squad_meeting' | 14:01 |
| d0ugal | o/ | 14:01 |
| fultonj | o/ | 14:01 |
| owalsh | o/ | 14:01 |
| bogdando | o/ | 14:01 |
| jaosorior | o/ | 14:01 |
| jtomasek | o/ | 14:02 |
| toure | o/ | 14:02 |
| hjensas | o/ | 14:02 |
| dtantsur | o/ | 14:02 |
| slagle | hello | 14:02 |
| slagle | #topic Agenda | 14:03 |
| slagle | * Review past action items | 14:03 |
| slagle | * One off items | 14:03 |
| *** openstack changes topic to "Agenda (Meeting topic: TripleO Edge Squad Meeting)" | 14:03 | |
| slagle | * Goals for the week | 14:03 |
| slagle | #topic Review past action items | 14:03 |
| *** openstack changes topic to "Review past action items (Meeting topic: TripleO Edge Squad Meeting)" | 14:04 | |
| slagle | ok, let's take a look at the past AI's | 14:04 |
| slagle | fultonj work on split-controlplane-ci | 14:04 |
| fultonj | my edge w/ ceph prototype stopped working; neutron issues still debugging; likely my env; will do the docs patch when working again; this affects my ci work too | 14:04 |
| slagle | ack | 14:05 |
| fultonj | #action fultonj make progress on split-controlplane-ci | 14:05 |
| slagle | dtantsur to discuss edge/far edge terminology concerns with WG | 14:05 |
| dtantsur | and I did! | 14:05 |
| slagle | thanks :) | 14:05 |
| dtantsur | the output is not clear so far | 14:05 |
| slagle | #link http://lists.openstack.org/pipermail/openstack-dev/2018-October/135840.html | 14:06 |
| chem | o/ | 14:06 |
| dtantsur | but there was a link so a glossary, where "Far Edge" does nto seem to appear | 14:06 |
| slagle | yea, good progress though | 14:06 |
| chem | oups | 14:06 |
| bogdando | for aligning terms (Goal 1 in https://etherpad.openstack.org/p/tripleo-edge-mvp), we may have a solution perhaps, which is use terms as of https://github.com/State-of-the-Edge/glossary and propose changes there :) | 14:06 |
| dtantsur | #link https://github.com/State-of-the-Edge/glossary | 14:06 |
| slagle | slagle to work on documenting some terms and gathering links/references | 14:07 |
| slagle | #link https://etherpad.openstack.org/p/tripleo-edge-terms | 14:07 |
| *** mjturek has joined #tripleo | 14:07 | |
| slagle | dtantsur: bogdando : i've included that there ^ | 14:07 |
| slagle | with some context | 14:07 |
| slagle | particularly, Access Edge ~= Far Edge | 14:08 |
| *** partlycloudy has joined #tripleo | 14:08 | |
| slagle | Aggregation Edge ~= Edge | 14:08 |
| slagle | afaict | 14:08 |
| dtantsur | so, no consistency already? :) | 14:08 |
| bogdando | why not Edge distance 0/1/2/n? :( | 14:08 |
| dtantsur | but "Access Edge" makes more sense to me than "Far" | 14:08 |
| *** ykarel is now known as ykarel|away | 14:08 | |
| *** lblanchard has quit IRC | 14:08 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud master: Pin openstacksdk and fix pep8 stricter requirement about backslash (W605) https://review.openstack.org/613267 | 14:08 |
| slagle | dtantsur: well, i'd be happy to say we adopt the Open Glossary | 14:08 |
| slagle | just wanted to lay it all out first | 14:09 |
| slagle | and that doesnt mean other groups would, but we could at least map other terms to what we choose to adopt and use | 14:09 |
| fultonj | +1 | 14:09 |
| bogdando | slagle: did you address all of the terms I mentioned at mvp etherpad? | 14:09 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud master: Include local_ip & undercloud_admin_host in docker_insecure_registries https://review.openstack.org/613166 | 14:09 |
| bogdando | would be nice to have a proposal to that https://github.com/State-of-the-Edge/glossary with all things set | 14:10 |
| fultonj | split control plane deploys controllers and remote computes+ceph they could be applied into the deloyments described in more than one way | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797525 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1797525 in tripleo "After the switch to podman & skopeo, undercloud deployment takes +60% longer" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 14:10 |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 14:10 |
| slagle | bogdando: it's a work in progress and living document | 14:10 |
| bogdando | thanks | 14:10 |
| slagle | bogdando: i'm just gathering terms atm, and grouping related things | 14:10 |
| slagle | then we can move towards agreement on what to use | 14:10 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Removes EXTRA_TAGS from toci_gate_test&quickstart.sh.j2 https://review.openstack.org/604768 | 14:11 |
| slagle | #action slagle to conintue on terms etherpad | 14:12 |
| bogdando | would be nice to add federated term | 14:12 |
| slagle | alright, the last 2 action items we already added | 14:12 |
| slagle | bogdando: ok done. and anyone can edit the etherpad | 14:12 |
| slagle | anything else for this topic? | 14:13 |
| slagle | #topic One Off | 14:13 |
| *** openstack changes topic to "One Off (Meeting topic: TripleO Edge Squad Meeting)" | 14:13 | |
| slagle | gfidente: you're up | 14:14 |
| gfidente | slagle ack thanks | 14:14 |
| gfidente | I wanted to know what you guys think about those services which should scale with every compute instance, in the edge zone | 14:14 |
| gfidente | like ceph-mon or cinder-volume | 14:14 |
| gfidente | shall we create "special" tripleo roles to cope with that? | 14:15 |
| gfidente | or rather let people organize those with custom roles as necessary | 14:15 |
| slagle | gfidente: are you talking about a specific role that includes compute+cinder-volume+ceph-mon? | 14:16 |
| gfidente | amend: those services which should *not* scale | 14:16 |
| gfidente | slagle for example yes | 14:16 |
| gfidente | slagle others might want compute+ceph ; compute+cinder ; compute-only | 14:16 |
| *** sri_ has joined #tripleo | 14:16 | |
| slagle | gfidente: sure, i don't see why not | 14:16 |
| gfidente | so I wasn't sure what would be the right approach here | 14:16 |
| gfidente | creating roles vs pushing on custom roles | 14:16 |
| slagle | i have no issue with adding role examples | 14:16 |
| gfidente | ack | 14:17 |
| slagle | gfidente: the other way to do would be to have a single role, that can be used with different environments | 14:17 |
| slagle | so environments for compute+ceph, compute+cinder, etc. where the environment mapped services to implementations or None | 14:17 |
| openstackgerrit | Michael Bayer proposed openstack/tripleo-heat-templates master: Implement Global Galera database https://review.openstack.org/609738 | 14:18 |
| gfidente | slagle we can't do it with environments only though, cause you might want ceph/cinder enabled both but on different roles | 14:18 |
| owalsh | yea, +1 for adding roles for the common cases | 14:19 |
| slagle | gfidente: ok, true. i had it in mind that each DCN deployment was a separate stack | 14:19 |
| *** waleedm has quit IRC | 14:19 | |
| slagle | with 1 role, but no specific reason we need to restrict it that way | 14:19 |
| gfidente | yep 1 all-in-one is probably the start | 14:20 |
| gfidente | we might also just use the regular compute nodes for additional scaleout | 14:20 |
| openstackgerrit | Mike Fedosin proposed openstack/tripleo-heat-templates master: WIP: Set container images for openshift 3.11 https://review.openstack.org/613165 | 14:20 |
| gfidente | *compute role | 14:20 |
| slagle | yep | 14:20 |
| slagle | so i would say add new roles | 14:20 |
| gfidente | ok so no more sample roles for now | 14:20 |
| gfidente | we want the AIO | 14:21 |
| gfidente | but not more for now | 14:21 |
| gfidente | did I get it right? | 14:21 |
| slagle | yes, for the initial work | 14:22 |
| slagle | i'd say...add new roles if you need them. but dont do it just to do it | 14:22 |
| slagle | b/c then we'll have a lot more roles to maintain | 14:22 |
| owalsh | inheritance would be really useful | 14:22 |
| slagle | it'll be nice if we can get the role inheritance thing one day. so we don't have to copy/paste services around | 14:23 |
| gfidente | ok | 14:23 |
| slagle | owalsh: :) | 14:23 |
| owalsh | snap | 14:23 |
| trown | mfedosin: have you been able to get 3.11 working in a local environment? ... wrt your WIP patch that sets the container images ^ | 14:23 |
| gfidente | thanks | 14:23 |
| slagle | alright any other items? | 14:24 |
| fultonj | #action fultonj docs patch for standalone edge example | 14:24 |
| mfedosin | trown, actually no | 14:24 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/queens: Revert "Don't run host_prep_tasks from {{role}}HostPrepDeployment" https://review.openstack.org/613259 | 14:25 |
| mfedosin | I'm going to use the reproducer script for that | 14:25 |
| trown | mfedosin: ok, me neither :P ... I get stuck before your patch would be relevant I think though... the kube-system pods hang in pending | 14:25 |
| slagle | alright folks, we'll wrap up. thanks for participating! | 14:25 |
| slagle | #endmeeting | 14:25 |
| *** openstack changes topic to "Welcome to Stein | CI Status: GREENish - don't mess this up | https://docs.openstack.org/tripleo-docs/latest/" | 14:25 | |
| openstack | Meeting ended Thu Oct 25 14:25:47 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:25 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo_edge_squad_meeting/2018/tripleo_edge_squad_meeting.2018-10-25-14.01.html | 14:25 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo_edge_squad_meeting/2018/tripleo_edge_squad_meeting.2018-10-25-14.01.txt | 14:25 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo_edge_squad_meeting/2018/tripleo_edge_squad_meeting.2018-10-25-14.01.log.html | 14:25 |
| trown | mfedosin: but I have been unable to figure out why | 14:25 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs010: switch undercloud to podman https://review.openstack.org/611597 | 14:26 |
| mfedosin | trown, yes, the same. I'm investigating | 14:26 |
| trown | mfedosin: I have had success with the reproducer script for getting that far | 14:26 |
| trown | mfedosin: awesome let me know if you find anything or need reviews on any patches | 14:27 |
| mfedosin | trown, I've added you as a reviewer | 14:28 |
| chem | sshnaidm|ruck: hey, I've got a lot of timeout on random scenario jobs on random review, is that something that is looked into by somebody ? | 14:29 |
| chem | sshnaidm|ruck: rechecking 30H gate stuff is no fun :) | 14:29 |
| *** saneax has quit IRC | 14:31 | |
| sshnaidm|ruck | chem, yeah, it's known issue https://bugs.launchpad.net/tripleo/+bug/1799895 | 14:32 |
| openstack | Launchpad bug 1797525 in tripleo "duplicate for #1799895 After the switch to podman & skopeo, undercloud deployment takes +60% longer" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 14:32 |
| sshnaidm|ruck | mwhahaha, are you sure it's duplicate? ^^ | 14:32 |
| *** gfidente has quit IRC | 14:32 | |
| sshnaidm|ruck | mwhahaha, it doesn't fail all jobs and seems like started to be worse in last 2 days | 14:33 |
| mwhahaha | sshnaidm|ruck: i didn't mark it as a duplicate | 14:33 |
| sshnaidm|ruck | hmm.. and how can I see who | 14:34 |
| *** partlycloudy has left #tripleo | 14:34 | |
| mwhahaha | sshnaidm|ruck: bogdando did | 14:34 |
| sshnaidm|ruck | bogdando, ^^ | 14:34 |
| bogdando | it looks like it is | 14:35 |
| bogdando | the 1 time for image prep is that I used to observe from time to time running job logs profiling | 14:36 |
| bandini | any takers for a simple backport? https://review.openstack.org/#/c/613258/ | 14:36 |
| bogdando | and podman slowness for concurrent operations is still here | 14:36 |
| bogdando | so... | 14:36 |
| bogdando | same issue | 14:36 |
| bogdando | sshnaidm|ruck: ^^ | 14:36 |
| bogdando | I may be wrong ofc! | 14:36 |
| sshnaidm|ruck | bogdando, do you know why it's not consistent in all jobs? maybe we merged something in last 2 days that broke it even more? | 14:36 |
| bogdando | do not have updates for recent days, we may want to do profiling for ansible tasks once again... | 14:37 |
| bogdando | but if you say that's prepare images, that's skopeo | 14:37 |
| bogdando | stevebaker: has more refactoring/fixes in place | 14:37 |
| bogdando | to help with not repating layers, and more | 14:37 |
| bogdando | to not re-fetching existing layers* | 14:38 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Standalone: Disable persisting VIPs on /etc/hosts https://review.openstack.org/613106 | 14:38 |
| *** trozet has joined #tripleo | 14:40 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: use templating for nova cell database_connection https://review.openstack.org/611404 | 14:40 |
| -openstackstatus- NOTICE: Zuul and Nodepool services are being restarted to migrate them to a new Zookeeper cluster. THis brings us an HA database running on newer servers. | 14:41 | |
| *** kopecmartin|afk is now known as kopecmartin | 14:46 | |
| *** gfidente has joined #tripleo | 14:46 | |
| *** ramishra has quit IRC | 14:46 | |
| chem | sshnaidm|ruck: thanks | 14:46 |
| *** jistr|call is now known as jistr | 14:50 | |
| *** holser_ has quit IRC | 14:55 | |
| *** yprokule has quit IRC | 14:55 | |
| *** akrivoka has quit IRC | 14:55 | |
| *** akrivoka has joined #tripleo | 14:56 | |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: undercloud_preflight: compare actual IPs without mask https://review.openstack.org/611937 | 14:57 |
| sshnaidm|ruck | bogdando, I think it's different reason, as I see in logs the yum update takes sometimes up to 10 minutes for container | 14:58 |
| sshnaidm|ruck | bogdando, let's separate bugs, but leave comment in last one that it could be related | 14:59 |
| sshnaidm|ruck | bogdando, or podman can affect yum update too? | 14:59 |
| jrist | mwhahaha, or EmilienM - can we get a +2 workflow https://review.openstack.org/611305 plz plz plz | 15:00 |
| bogdando | it can only affect undercloud job for now | 15:00 |
| bogdando | sshnaidm|ruck: ok, let's split | 15:00 |
| mwhahaha | jrist: you mean the change i already +2'd? :D | 15:00 |
| EmilienM | jrist: will look shortly | 15:00 |
| jrist | mwhahaha: no you did one of them already. thanks | 15:01 |
| jrist | mwhahaha: you did +2 the patch, but not the workflow | 15:01 |
| mwhahaha | jrist: well that's cause we need a second person | 15:01 |
| *** jtomasek has quit IRC | 15:01 | |
| jrist | ah, thanks | 15:01 |
| *** aedc has quit IRC | 15:02 | |
| *** holser_ has joined #tripleo | 15:03 | |
| *** jpena is now known as jpena|brb | 15:04 | |
| *** ccamacho has quit IRC | 15:05 | |
| jrist | mwhahaha, EmilienM btw I know you two are very busy :) I would have asked Juan first | 15:08 |
| jrist | jaosorior: wait are you here? | 15:08 |
| jrist | I thought he was out | 15:08 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 15:10 |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| jaosorior | jrist: still here for some minutes :D (6pm here) | 15:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 15:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 15:10 |
| *** hkominos has quit IRC | 15:11 | |
| jrist | jaosorior: ah cool can you look | 15:11 |
| jaosorior | jrist: I can check it out tomorrow. Still here cause I'm in a meeting :/ | 15:13 |
| chandankumar | honza: Hello | 15:15 |
| *** jpena|brb is now known as jpena | 15:15 | |
| chandankumar | honza: can we move https://review.openstack.org/#/c/612386/5/config/general_config/featureset027.yml@71 to 81 in the new fs and then all the depends on there | 15:16 |
| chandankumar | and try to trigger it with selenium | 15:16 |
| *** jfrancoa has quit IRC | 15:18 | |
| jrist | jaosorior: roger that, thanks! | 15:19 |
| jaosorior | jrist: oh, it was smaller than I thought. it looks fine. | 15:19 |
| jrist | one million gold stars for jaosorior | 15:20 |
| *** quiquell is now known as quiquell|off | 15:21 | |
| *** paramite has quit IRC | 15:22 | |
| chem | EmilienM: well I tried with openstacksdk==0.17.2 for the lower constraint and it fails but maybe I don't do it rigth | 15:26 |
| EmilienM | chem: did you run "tox -elower-constraints -vv" ? | 15:27 |
| chem | EmilienM: yeap | 15:27 |
| chem | EmilienM: it worked for you ? | 15:27 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/rocky: Skip hosts group in ceph-ansible inventory when all are blacklisted https://review.openstack.org/613357 | 15:27 |
| sshnaidm|ruck | bogdando, rfolco|rover I added a comment to https://bugs.launchpad.net/tripleo/+bug/1799902 , I'd like to know if it could be affected by podman? Can be packages installation slowed because of it anyhow? | 15:28 |
| openstack | Launchpad bug 1799902 in tripleo "tripleo-container-image-prepare in undercloud doens't have logs" [Critical,Invalid] - Assigned to Steve Baker (steve-stevebaker) | 15:28 |
| bogdando | sshnaidm|ruck: likely not | 15:28 |
| sshnaidm|ruck | bogdando, ok | 15:29 |
| bogdando | but I don't have data for runc vs libcontainerd performance | 15:29 |
| bogdando | podman uses runc | 15:29 |
| sshnaidm|ruck | damn, I mixed bugs.. meant https://bugs.launchpad.net/tripleo/+bug/1799895 | 15:29 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 15:29 |
| bogdando | docker uses the latter | 15:29 |
| chem | EmilienM: oki, after rm -rf .tox it worked better | 15:29 |
| sshnaidm|ruck | bogdando, packages install take a lot of time, that's the problem.. | 15:29 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Do not purge the Ironic Inspector dhcp-hostsdir https://review.openstack.org/613361 | 15:30 |
| bogdando | sshnaidm|ruck: ack | 15:30 |
| sshnaidm|ruck | bogdando, can we use libcontainerd somewhere to compare? | 15:30 |
| bogdando | we can revert podman in undercloud job and see how it performs for multiple runs | 15:30 |
| bogdando | as DNM | 15:30 |
| sshnaidm|ruck | bogdando, good idea | 15:30 |
| bogdando | sshnaidm|ruck: https://review.openstack.org/#/c/609963/ | 15:31 |
| EmilienM | chem: sorry in a call. Yes it worked for me. | 15:31 |
| EmilienM | chem: rm -rf helped, cool :) | 15:31 |
| chem | EmilienM: rm -rf solves everything! | 15:32 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Revert "Switch fs027 to deploy with podman" https://review.openstack.org/609963 | 15:32 |
| sshnaidm|ruck | bogdando, great, let's see.. | 15:32 |
| *** jaganathan has quit IRC | 15:32 | |
| -openstackstatus- NOTICE: The Zuul and Nodepool database transition is complete. Changes updated during the Zuul outage may need to be rechecked. | 15:32 | |
| *** mjturek has quit IRC | 15:34 | |
| sshnaidm|ruck | bogdando, is this dependency required? | 15:34 |
| *** weshay has joined #tripleo | 15:34 | |
| weshay | sshnaidm|ruck, hey | 15:34 |
| bogdando | for what job? we only has fs27 using podman so far | 15:34 |
| bogdando | revert is self containing | 15:34 |
| bogdando | I hope | 15:34 |
| sshnaidm|ruck | ok | 15:34 |
| dtrainor | I'm having issues with a downstream deployment of Queens (OSP13). The failure is vague and I'm not able to determine what's causing the failure. I have a sneaky suspicion this has to do with node tagging and Flavor matching but I can't prove that http://paste.openstack.org/show/733052/ | 15:35 |
| dtrainor | I am using the UI but I don't think that's related at this point, nothing out of the ordinary is being configured as part of the deployment - 1 controller, 2 computes | 15:35 |
| sshnaidm|ruck | weshay, just an update about timeouts, see last comment in https://bugs.launchpad.net/tripleo/+bug/1799895 we try now to run job without podman to see how much time it takes there | 15:35 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 15:35 |
| bogdando | sshnaidm|ruck: this may be too late https://review.openstack.org/#/c/609941/ now, as we have more fixes on top | 15:36 |
| bogdando | sshnaidm|ruck: like https://review.openstack.org/#/c/609586/ | 15:37 |
| *** ccamacho has joined #tripleo | 15:38 | |
| bogdando | this needs to be in revert chain to test it "clear" | 15:38 |
| *** agurenko has quit IRC | 15:38 | |
| bogdando | now I got what you were asking for as dependencies (but those are for skopeo, not podman ;) ) | 15:38 |
| hjensas | bogdando: mwhahaha: https://review.openstack.org/609858 <- passed featureset035 but not featureset001. I don't think the fs001 error is related: https://logs.rdoproject.org/58/609858/6/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/99e0467/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz#_2018-10-24_22_15_37) | 15:40 |
| *** mjturek has joined #tripleo | 15:40 | |
| mwhahaha | hjensas: yea rdo cloud has been flakey for too long, since 35 passed, i'll +A | 15:43 |
| hjensas | mwhahaha: thanks. | 15:44 |
| *** apetrich has quit IRC | 15:45 | |
| bogdando | sshnaidm|ruck: if that's only for the install time to have containers updated, that should be a dup of some older bug, tl;dr the longer we have no promotions, the more time it takes | 15:47 |
| sshnaidm|ruck | bogdando, well, that's right, but same task in different containers takes from 4 to 10 minutes, it's pretty weird | 15:50 |
| bogdando | hm, indeed | 15:51 |
| *** sshnaidm|ruck is now known as sshnaidm|bbl | 15:54 | |
| *** irclogbot_4 has joined #tripleo | 15:55 | |
| dtrainor | ok, I found my error. nova-scheduler is saying: 'control' does not match 'compute' . The introspected data for these nodes exceeds the requirements by the profiles, and i see the nodes properly assigned to their respective provides in 'profiles list'. | 15:57 |
| *** derekh has quit IRC | 15:58 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/604293 | 16:00 |
| Vorrtex | I have a potentially stupid question... I'm on a macbook but I am working on doing some changes in tripleo common... Are the tests runable without deploying the entirety of the undercloud? For more information, I'm trying to lock down exactly how the images are gathered for uploading to the local docker registry during undercloud deployment, so I can figure out how to add to that behavior. | 16:01 |
| *** vinaykns has quit IRC | 16:03 | |
| mwhahaha | Vorrtex: python unit tests would be runable, but not functional testing. You'd could just use a linux vm via vagrant or something | 16:04 |
| bogdando | sshnaidm|bbl, EmilienM, Tengu: we need podman 0.10.2 | 16:05 |
| bogdando | the magic happened there | 16:05 |
| bogdando | https://github.com/containers/libpod/issues/1656 | 16:06 |
| weshay | sshnaidm++ | 16:06 |
| *** itlinux has joined #tripleo | 16:06 | |
| Tengu | bogdando: \o/ | 16:07 |
| Tengu | bogdando: I have a docker(!) container allowing to build podman (yeah, I know). I can share it to you tomorrow if you want | 16:07 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 16:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 16:10 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations stable/rocky: Remove a debug task https://review.openstack.org/613367 | 16:11 |
| *** irclogbot_4 has quit IRC | 16:13 | |
| *** vinaykns has joined #tripleo | 16:14 | |
| Vorrtex | mwhahaha could it work if I were to use a docker container on my mac? or is VM the best bet? | 16:14 |
| *** ksambor has quit IRC | 16:15 | |
| *** ccamacho has quit IRC | 16:15 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Split run-v3 and move preparation in a separate playbook https://review.openstack.org/613368 | 16:16 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo master: Update functions to fix unit tests https://review.openstack.org/613173 | 16:16 |
| mwhahaha | Vorrtex: i mean the best way would be a VM to test the undercloud interaction. You can just launch a single vm for that. | 16:17 |
| mwhahaha | Vorrtex: If you're messing with the container uploading bit, it assumes that the container registry service is running so i guess you could just do a docker container of that but that would be more complicated | 16:17 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo master: Update functions to fix unit tests https://review.openstack.org/613173 | 16:18 |
| *** vinaykns has quit IRC | 16:21 | |
| Vorrtex | mwhahaha thanks, but I think that won't quite work for what I'm trying to do. My intention was to set a debug point in Pycharm and walk through the code to see where the images "come from" before being pushed to the local registry, and what those objects and such look like, so I could then make changes to the process. | 16:21 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN https://review.openstack.org/593056 | 16:22 |
| *** dtantsur is now known as dtantsur|afk | 16:22 | |
| Vorrtex | mwhahaha I'm having trouble putting the pieces together by simply looking at the code. | 16:23 |
| mwhahaha | Vorrtex: i mean you could try, if you're just messing with the tripleo-container-image-prepare bits, as long as you have a container registry available somewhere it might work | 16:23 |
| bogdando | Tengu: well baude shared his dev repo | 16:23 |
| bogdando | Tengu: https://copr.fedorainfracloud.org/coprs/baude/Upstream_CRIO_Family/ | 16:23 |
| Tengu | ah, cool | 16:23 |
| mwhahaha | Vorrtex: if you have specific questions stevebaker might be able to assist but he's in NZ so come back in like 4 hours | 16:24 |
| Tengu | bogdando: even easier then :) I'll check that tomorrow. | 16:24 |
| Vorrtex | mwhahaha ha ha ha thanks, I might have to do that. | 16:24 |
| Tengu | but first, I'll need to find out WHY some tasks are apparently not executed on the overcloud nodes. | 16:24 |
| Tengu | anyway. now, I'm off for real. | 16:25 |
| *** shardy has quit IRC | 16:25 | |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN https://review.openstack.org/593056 | 16:25 |
| *** mnaser has quit IRC | 16:26 | |
| *** mnaser has joined #tripleo | 16:26 | |
| *** jpich has quit IRC | 16:28 | |
| *** trown is now known as trown|lunch | 16:32 | |
| *** vinaykns has joined #tripleo | 16:33 | |
| *** salmankhan has quit IRC | 16:34 | |
| jidar | is there a recent blog post where somebody goes into testing deployments in a kvm environment? Following the install guide I sort of ran into a problem with vbmc connecting to my kvm host from my vm because of using a mactap interface | 16:35 |
| *** bogdando has quit IRC | 16:36 | |
| *** aedc has joined #tripleo | 16:36 | |
| *** amoralej is now known as amoralej|off | 16:37 | |
| *** panda is now known as panda|off | 16:38 | |
| *** mjturek has quit IRC | 16:40 | |
| *** gfidente has quit IRC | 16:42 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: Run Mistral workflow to make temporary Swift URLs on upgrade https://review.openstack.org/613373 | 16:44 |
| mwhahaha | EmilienM: soooo containerized undercloud lost all the clients being installed by default (cc: vinaykns) | 16:44 |
| mwhahaha | EmilienM: https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.pp#L262 | 16:45 |
| mwhahaha | vinaykns: so i still disagree with gnocchiclient being isntalled by default via an rpm dependency, but i do think we should have like a clients thing that installs all of them | 16:45 |
| mwhahaha | vinaykns: i would think that if telemetry is installed on the undercloud (ie. enabled) the client should be installed. If it's not that seems to be an issue with the gnocchi service | 16:46 |
| vinaykns | mwhahaha: Yeah if not as a rpm dependency but we should find somewhere else to have the clients installed | 16:47 |
| vinaykns | mwhahaha: We don't have that piece, even though the telemetry is enabled we miss that logic | 16:48 |
| *** mjturek has joined #tripleo | 16:50 | |
| mwhahaha | vinaykns: please file an LP and i'll try and figure something out later today | 16:50 |
| vinaykns | mwhahaha: sorry, how to file an LP..? | 16:51 |
| mwhahaha | vinaykns: https://bugs.launchpad.net/tripleo/ | 16:51 |
| mwhahaha | report a bug | 16:51 |
| vinaykns | mwhahaha: cool..sounds good.!! | 16:51 |
| *** shyamb has joined #tripleo | 16:58 | |
| *** jpena is now known as jpena|off | 16:58 | |
| chandankumar | mwhahaha: weshay sshnaidm|bbl https://review.openstack.org/#/c/613214/ needed for fs020 promotion | 17:02 |
| *** chandankumar is now known as chkumar|off | 17:02 | |
| weshay | ya.. was wondering if we had eyes on that | 17:02 |
| weshay | chkumar|off, thanks | 17:02 |
| *** ccamacho has joined #tripleo | 17:02 | |
| *** pcaruana has joined #tripleo | 17:03 | |
| *** abishop has joined #tripleo | 17:05 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-quickstart master: Add new featureset for running tripleo-ui tests https://review.openstack.org/607325 | 17:07 |
| vinaykns | mwhahaha: yep..done.! | 17:08 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 17:10 |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 17:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 17:10 |
| *** phuongnh has joined #tripleo | 17:13 | |
| trozet | hey guys, when you run the "openstack overcloud container image prepare" command, does it pull in some default services now? | 17:14 |
| trozet | for example if i run it with specifically with a -e pointing to a template with only a single service, it still populates all thse images for other services | 17:15 |
| *** sshnaidm|bbl is now known as sshnaidm|off | 17:15 | |
| *** apetrich has joined #tripleo | 17:17 | |
| *** phuongnh has quit IRC | 17:17 | |
| *** apetrich has quit IRC | 17:17 | |
| *** apetrich has joined #tripleo | 17:18 | |
| *** shyamb has quit IRC | 17:20 | |
| EmilienM | mwhahaha: i think clients should be deployed manually, from doc | 17:24 |
| mwhahaha | EmilienM: it's a regret and I'm not sure I completely agree | 17:24 |
| mwhahaha | EmilienM: I'll sync up with you after lunch | 17:24 |
| EmilienM | mwhahaha: sure, I'm back from lunch myself. anytime. | 17:25 |
| mwhahaha | s/regret/regression | 17:25 |
| weshay | or both | 17:25 |
| mwhahaha | Stupid auto correct | 17:25 |
| EmilienM | not really a regret | 17:25 |
| mwhahaha | It doesn't belong as an rpm dep but I do think k we should have a way to deploy all the clients on a host | 17:25 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Create default deployment plan https://review.openstack.org/611305 | 17:26 |
| *** mjturek has quit IRC | 17:36 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Allow enabling routed networks on undercloud update|upgrade https://review.openstack.org/601369 | 17:46 |
| *** holser_ has quit IRC | 17:47 | |
| *** zaneb has quit IRC | 17:53 | |
| *** trown|lunch is now known as trown | 17:54 | |
| *** betherly has joined #tripleo | 17:55 | |
| *** zzzeek_ has joined #tripleo | 17:59 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Fix wrapper containers for podman w/o sockets https://review.openstack.org/606095 | 17:59 |
| *** betherly has quit IRC | 17:59 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Rework neutron/own agent wrapper tools for podman https://review.openstack.org/606975 | 18:02 |
| *** zaneb has joined #tripleo | 18:07 | |
| *** apetrich has quit IRC | 18:07 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 18:10 |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 18:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 18:10 |
| *** salmankhan has joined #tripleo | 18:16 | |
| *** salmankhan has quit IRC | 18:20 | |
| *** apetrich has joined #tripleo | 18:20 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Add OpenStack clients service https://review.openstack.org/613394 | 18:24 |
| *** cylopez has quit IRC | 18:27 | |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: Use external-(upgrade|update) commands for Ceph. https://review.openstack.org/609730 | 18:27 |
| *** bnemec has quit IRC | 18:29 | |
| openstackgerrit | James Slagle proposed openstack/paunch master: Fix labels to take multiple values https://review.openstack.org/611298 | 18:42 |
| mwhahaha | slagle: you have failed | 18:42 |
| *** dsneddon__ has quit IRC | 18:43 | |
| openstackgerrit | James Slagle proposed openstack/paunch master: Fix labels to take multiple values https://review.openstack.org/611298 | 18:43 |
| *** dsneddon__ has joined #tripleo | 18:43 | |
| openstackgerrit | Alex Schultz proposed openstack/paunch master: Fix labels to take multiple values https://review.openstack.org/611298 | 18:44 |
| *** dtrainor has quit IRC | 18:45 | |
| *** dtrainor has joined #tripleo | 18:46 | |
| EmilienM | slagle: have you seen that kind of failure before? http://logs.openstack.org/80/604180/50/check/tripleo-ci-centos-7-containers-multinode/4750b24/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-24_23_17_58 | 18:51 |
| EmilienM | the trace in the middle of the task | 18:51 |
| *** itlinux has quit IRC | 18:52 | |
| *** abishop has quit IRC | 18:55 | |
| mwhahaha | yea it's async | 18:55 |
| mwhahaha | so the messing sometimes gets intermingled | 18:55 |
| EmilienM | it's a timeout I guess | 18:56 |
| roger2 | With baremetal will "openstack overcloud deploy --templates" just work? Or should I specify something? | 18:57 |
| slagle | EmilienM: i've not seen it | 18:58 |
| EmilienM | ok np | 18:59 |
| slagle | mistral logs probably hold the key | 18:59 |
| EmilienM | something takes more time but I don't see it in ara | 18:59 |
| * EmilienM looking mistral | 18:59 | |
| slagle | it's a timeout in the greenlet switch. duh. | 19:00 |
| slagle | undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-24_23_17_58 | 19:00 |
| slagle | http://logs.openstack.org/80/604180/50/check/tripleo-ci-centos-7-containers-multinode/4750b24/logs/undercloud/var/log/containers/mistral/executor.log.txt.gz#_2018-10-24_23_17_52_927 | 19:00 |
| EmilienM | indeed, doesn't look like related to my patch. Will look in logstash if it's hit anywhere else. | 19:02 |
| slagle | EmilienM: mistral timed out the task: http://logs.openstack.org/80/604180/50/check/tripleo-ci-centos-7-containers-multinode/4750b24/logs/undercloud/var/log/containers/mistral/engine.log.txt.gz#_2018-10-24_23_17_51_511 | 19:02 |
| slagle | EmilienM: since i fixed that other bug related to config_download timeout, i guess the timeout is actually being enforced | 19:02 |
| * EmilienM digs into logstash | 19:03 | |
| slagle | would need to double check if it is actually using the right value though | 19:03 |
| slagle | looks like it used 4723 seconds | 19:03 |
| *** itlinux has joined #tripleo | 19:03 | |
| roger2 | For baremetal overcload should I specify "openstack overcloud deploy --templates /usr/share/openstack-tripleo-heat-templates/environments/overcloud-baremetal.j2.yaml" ? | 19:04 |
| mwhahaha | roger2: no | 19:05 |
| mwhahaha | roger2: also what versiojn? | 19:05 |
| mwhahaha | cause we don't really support baremetal stuff any more (we don't test it at all) | 19:06 |
| roger2 | mwhahaha: i have manual-tripleo/queens/containerized/baremetal | 19:06 |
| mwhahaha | roger2: -e /usr/share/openstack-tripleo-heat-templates/environments/baremetal-services.yaml | 19:07 |
| mwhahaha | roger2: but you will have 0 upgrade/update support so it's not recommended to do that | 19:07 |
| mwhahaha | starting with queens everything is assumed to be containerized. Pike had some containerized/some not so there was a mix | 19:08 |
| slagle | EmilienM: looks like config_download started at 21:58: http://logs.openstack.org/80/604180/50/check/tripleo-ci-centos-7-containers-multinode/4750b24/logs/undercloud/var/log/containers/mistral/api.log.txt.gz#_2018-10-24_21_58_22_270 | 19:08 |
| roger2 | mwhahaha: oh. right. I forgot the -e. but more the question is how I should be deploying openstack on my servers. so how do I get openstack on the other nodes with tripleo? I feel confusion. | 19:08 |
| slagle | EmilienM: then timed out at 23:17. so the timeout did the right thing | 19:08 |
| EmilienM | yeah | 19:08 |
| mwhahaha | roger2: not sure what you mean by that, you'd install the undercloud and import your overcloud node information and do an overcloud deploy to apply the openstack deployment to that hardware. | 19:09 |
| mwhahaha | that's the tl;dr of the install docs really | 19:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Standardize path to prepare log file https://review.openstack.org/599273 | 19:10 |
| openstackgerrit | Merged openstack/tripleo-common master: Store prepare defaults in packaged yaml https://review.openstack.org/602104 | 19:10 |
| roger2 | mwhahaha: but you said baremetal unsupported. this is where I'm getting confused. | 19:10 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 19:10 |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 19:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 19:10 |
| EmilienM | slagle: but we don't see the task that time outed | 19:10 |
| mwhahaha | roger2: so I mean deploying the openstack software on baremetal (ie no containers) | 19:10 |
| EmilienM | the ansible task I mean | 19:10 |
| slagle | EmilienM: it's not an ansible task that timed out | 19:11 |
| mwhahaha | roger2: to openstack deploy on baremetal, that's just importing your node ipmi information on the undercloud and then doing a deployment | 19:11 |
| mwhahaha | roger2: https://docs.openstack.org/tripleo-docs/latest/install/basic_deployment/basic_deployment_cli.html#register-nodes this part | 19:11 |
| EmilienM | actually, http://logs.openstack.org/80/604180/50/check/tripleo-ci-centos-7-containers-multinode/4750b24/logs/undercloud/var/lib/mistral/config-download-latest/ansible.log.txt.gz#_2018-10-24_22_19_20_228 | 19:11 |
| slagle | EmilienM: the timeout is set on the mistral task, and mistral will kill it if the timeout is reached, regardless of what ansible is doing | 19:11 |
| *** ykarel|away has quit IRC | 19:11 | |
| roger2 | mwhahaha: oh. so I have my nodes introspected and available. so just do "openstack overcloud deploy --templates" and it should get me the 1 controller and 1 compute without specifying anything different then? | 19:12 |
| mwhahaha | roger2: yea but you'll likely need to specify the correct network configuration. without anything else it assumes a very specific nic config which you might not have | 19:12 |
| *** rlandy is now known as rlandy|brb | 19:13 | |
| roger2 | mwhahaha: in my undercloud.conf I did specify "local_interface = enp10s0f1" to match my physical servers. is that what you mean? | 19:13 |
| mwhahaha | roger2: no i mean, https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/network_isolation.html | 19:13 |
| EmilienM | slagle: I think I found it: it try to start containers at step2 and fails: http://logs.openstack.org/80/604180/50/check/tripleo-ci-centos-7-containers-multinode/4750b24/logs/subnode-2/var/log/journal.txt.gz#_Oct_24_22_56_47 | 19:14 |
| EmilienM | and never reply back or something I don't know yet | 19:14 |
| mwhahaha | roger2: without specifying that it uses a flat network and will use the first nic on the overcloud nodes for everything (i think) | 19:14 |
| * mwhahaha hasn't tried it | 19:14 | |
| *** holser_ has joined #tripleo | 19:15 | |
| roger2 | mwhahaha: ah, ok. thank you. I'll wade through the document then. | 19:15 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: ceilometer: --skip-metering-database is gone https://review.openstack.org/612776 | 19:15 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add provision to specify java arguments to ODL https://review.openstack.org/612237 | 19:15 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Remove old config/release files https://review.openstack.org/606944 | 19:15 |
| openstackgerrit | Merged openstack/python-tripleoclient master: check for existence of output env file for container image prepare https://review.openstack.org/609694 | 19:15 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: [Pike Only] Remove comment related to namespace variable. https://review.openstack.org/613013 | 19:15 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Improve standalone success messaging https://review.openstack.org/601656 | 19:15 |
| openstackgerrit | Merged openstack/tripleo-common master: Add debug to container image prepare https://review.openstack.org/604886 | 19:15 |
| slagle | EmilienM: yea. nice to know the mistral timeout is working now. although we need to fix the output to say what happened and not just traceback | 19:19 |
| EmilienM | slagle: it's an issue with my map merge in https://review.openstack.org/#/c/604180/50/docker/services/pacemaker/haproxy.yaml | 19:24 |
| EmilienM | slagle: see https://www.diffchecker.com/XYHk07KT | 19:24 |
| EmilienM | slagle: grep for map_merge | 19:24 |
| EmilienM | I screw something up | 19:24 |
| *** jcoufal_ has joined #tripleo | 19:26 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Fix cinder_api_apache error during upgrade. https://review.openstack.org/612637 | 19:27 |
| *** jcoufal has quit IRC | 19:27 | |
| *** rlandy|brb is now known as rlandy | 19:31 | |
| openstackgerrit | Michael Bayer proposed openstack/tripleo-heat-templates master: Implement Global Galera database https://review.openstack.org/609738 | 19:35 |
| *** dprince has quit IRC | 19:46 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud stable/queens: [queens-only] include local_ip & undercloud_admin_host in docker_insecure_registries https://review.openstack.org/613406 | 19:52 |
| openstackgerrit | Bob Fournier proposed openstack/tripleo-heat-templates master: Add comments clarifying use of deprecated_params for roles and IPs https://review.openstack.org/613109 | 19:52 |
| EmilienM | chem: it now fails on check requirements. I think it's time to kill instack-undercloud | 19:52 |
| EmilienM | chem: and submit on stable branches only. | 19:52 |
| *** akrivoka has quit IRC | 19:54 | |
| EmilienM | slagle: I found the root cause of the job failure, it's a typo. However we have a bug where we didn't fail when we generated Kolla containers config. Will take a look. | 19:58 |
| *** irclogbot_4 has joined #tripleo | 19:59 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker https://review.openstack.org/604180 | 20:03 |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 20:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 20:10 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo master: Update parser functions to 4.x api https://review.openstack.org/613411 | 20:17 |
| *** jcoufal_ has quit IRC | 20:19 | |
| *** jcoufal has joined #tripleo | 20:22 | |
| *** irclogbot_4 has quit IRC | 20:22 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Document nodepool-setup functionality is in pre playbooks https://review.openstack.org/613414 | 20:28 |
| sl0w | mwhahaha: so we're seeing errors with all-in-one now in docker-puppet stage.. | 20:30 |
| mwhahaha | sl0w: i blame someone else | 20:30 |
| mwhahaha | sl0w: like your code :D | 20:30 |
| mwhahaha | sl0w: logs? | 20:30 |
| sl0w | mwhahaha: haha | 20:30 |
| sl0w | mwhahaha: msg'd you tmate, just starting run | 20:32 |
| *** dprince has joined #tripleo | 20:33 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/rocky: Disable puppet-5 jobs https://review.openstack.org/613417 | 20:35 |
| EmilienM | mwhahaha: ^ | 20:35 |
| EmilienM | mwhahaha: the best I found | 20:35 |
| mwhahaha | EmilienM: k | 20:35 |
| mwhahaha | EmilienM: plz do queens/pike too | 20:35 |
| EmilienM | mwhahaha: yes sir | 20:35 |
| mwhahaha | sl0w: do you remember which step did it blow up on? | 20:36 |
| sl0w | mwhahaha: no I forget, should blow up shortly tho :) | 20:36 |
| mwhahaha | :D | 20:36 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/pike: Disable puppet-5 jobs https://review.openstack.org/613419 | 20:37 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/queens: Disable puppet-5 jobs https://review.openstack.org/613420 | 20:37 |
| trown | mwhahaha: it blows up on "Run docker-puppet tasks (generate config) during step 1" | 20:38 |
| *** ansmith_ has quit IRC | 20:39 | |
| mwhahaha | sl0w: let me poke at it | 20:39 |
| sl0w | mwhahaha: go for it | 20:39 |
| sl0w | mwhahaha: this is using current-tripleo for everything | 20:40 |
| mwhahaha | i haven't seent his vashed thing in some time | 20:41 |
| sl0w | mwhahaha: rsync issue? | 20:41 |
| sl0w | I wasn't 100% sure that was it.. but it sure looks like it | 20:41 |
| trown | sl0w: mwhahaha ... my test without epel on rocky hits the same thing btw | 20:42 |
| mwhahaha | ftype=0 | 20:42 |
| mwhahaha | no bueno | 20:42 |
| mwhahaha | how did you provision this system | 20:42 |
| sl0w | mwhahaha: pxe boot and yum update | 20:42 |
| mwhahaha | k you have a bad xfs file system | 20:42 |
| sl0w | mwhahaha: on original boot docker complained actually | 20:43 |
| mwhahaha | right | 20:43 |
| mwhahaha | cause you need ftype=1 | 20:43 |
| sl0w | where's that belong? :) | 20:43 |
| mwhahaha | when the fs gets formated | 20:43 |
| mwhahaha | it needs to be done on 7.4+ | 20:43 |
| mwhahaha | or you have to pass the correct option in | 20:44 |
| sl0w | hrrm | 20:44 |
| mwhahaha | https://bugzilla.redhat.com/show_bug.cgi?id=1564671 | 20:44 |
| openstack | bugzilla.redhat.com bug 1564671 in openstack-tripleo-heat-templates "Container configuration generation fails if the host file system is xfs that was created with ftype=0" [High,On_dev] - Assigned to emacchi | 20:44 |
| mwhahaha | is what you're hitting | 20:44 |
| mwhahaha | https://access.redhat.com/solutions/3459291 has the full context | 20:45 |
| mwhahaha | i don't know how you're getting ftype=0 because that hasn't been the default in some time | 20:45 |
| mwhahaha | so whatever you're using to provision is laying down a bad xfs file system | 20:45 |
| mwhahaha | 7.3 is actually when we switched | 20:46 |
| *** lblanchard has joined #tripleo | 20:46 | |
| hjensas | mwhahaha: is this the bug re puppet 5.5.7? http://logs.openstack.org/58/609858/6/gate/puppet-openstack-unit-5.5-centos-7/9d6c3ae/job-output.txt.gz#_2018-10-25_20_28_03_626316 | 20:47 |
| sl0w | mwhahaha: afaik it was a 7.5 centos image.. | 20:47 |
| mwhahaha | hjensas: yea | 20:47 |
| sl0w | mwhahaha: I can reprovision and check | 20:47 |
| mwhahaha | sl0w: so yea xfs needs to have ftype=1, or overlayfs doesn't work and you get these types of weird failures | 20:48 |
| sl0w | mwhahaha: gotcha | 20:49 |
| *** caboucha has quit IRC | 20:49 | |
| mwhahaha | EmilienM: we should add a host prep check for docker to stop the deploy if xfs ftype=0 | 20:52 |
| mwhahaha | EmilienM do you know if podman has the same issues? It uses overlays right? | 20:52 |
| *** holser_ has quit IRC | 20:53 | |
| *** jcoufal has quit IRC | 20:54 | |
| *** raildo has quit IRC | 20:55 | |
| sl0w | mwhahaha: well, thanks again for the amazing help :) | 20:55 |
| EmilienM | mwhahaha: yes it uses overlay | 20:55 |
| sl0w | mwhahaha: nice work on the all-in-one also! | 20:56 |
| EmilienM | mwhahaha: and yes for the task | 20:56 |
| sl0w | and everyone else too :) | 20:56 |
| EmilienM | mwhahaha: we have a validation iirc | 20:56 |
| *** betherly has joined #tripleo | 20:56 | |
| EmilienM | https://review.openstack.org/#/c/562282/ | 20:56 |
| mwhahaha | That was for upgrades I thought | 20:57 |
| mwhahaha | This is preisntall | 20:57 |
| mwhahaha | It only affects deployed server | 20:57 |
| mwhahaha | Or standalone | 20:57 |
| mwhahaha | It is a validation but we don't have that framework yet for the deploy | 20:58 |
| EmilienM | we have a spec :D | 21:00 |
| *** betherly has quit IRC | 21:01 | |
| mwhahaha | In the meantime... :D | 21:01 |
| mwhahaha | I'll propose something | 21:01 |
| EmilienM | mwhahaha: we can easily copy paste or import this task in THT | 21:03 |
| openstackgerrit | James Slagle proposed openstack/tripleo-docs master: config-download documentation enhancements https://review.openstack.org/613424 | 21:06 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 21:10 |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 21:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 21:10 |
| mwhahaha | EmilienM: or we can add it to the container-registry role | 21:12 |
| EmilienM | mwhahaha: yes also | 21:14 |
| *** trown is now known as trown|outtypewww | 21:15 | |
| *** irclogbot_3 has joined #tripleo | 21:16 | |
| *** betherly has joined #tripleo | 21:16 | |
| sl0w | mwhahaha: haha, we're installing centos 7.0 | 21:17 |
| sl0w | :) | 21:17 |
| mwhahaha | sl0w: well, there's yer problem | 21:17 |
| sl0w | indeedio | 21:17 |
| sl0w | the best we seem to have is 7.4 but trown said it was broken.. I'll check | 21:18 |
| mwhahaha | sl0w: 7.3+ is the requirement | 21:18 |
| sl0w | trown|outtypewww: ^ | 21:18 |
| mwhahaha | or be able to tune the fs creation for <7.3 i think you can make it ftype=1 but it wasn't the default until 7.3 | 21:19 |
| mwhahaha | so it's best if 7.3+ | 21:19 |
| sl0w | mwhahaha: great, thanks for the info! | 21:20 |
| *** betherly has quit IRC | 21:21 | |
| openstackgerrit | Alex Schultz proposed openstack/ansible-role-container-registry master: Add xfs ftype check during install https://review.openstack.org/613429 | 21:24 |
| mwhahaha | EmilienM, sl0w -^ fyi | 21:24 |
| ssbarnea|bkp2 | mwhahaha : if you can give a kick to https://review.openstack.org/#/c/610491/ .... | 21:24 |
| mwhahaha | ssbarnea|bkp2: done | 21:25 |
| sl0w | mwhahaha: nice! | 21:25 |
| ssbarnea|bkp2 | thanks, i will try to have another look before I fall asleep, hopefully to see those two merged by tomorrow. | 21:25 |
| mwhahaha | ssbarnea|bkp2: you can dream :D | 21:26 |
| openstackgerrit | James Slagle proposed openstack/tripleo-docs master: config-download documentation enhancements https://review.openstack.org/613424 | 21:27 |
| * jidar goes and gets several cups of coffee waiting on image build | 21:27 | |
| *** betherly has joined #tripleo | 21:37 | |
| *** dsneddon__ has quit IRC | 21:39 | |
| *** dsneddon__ has joined #tripleo | 21:40 | |
| *** betherly has quit IRC | 21:42 | |
| *** kopecmartin is now known as kopecmartin|off | 21:43 | |
| trozet | mwhahaha: still around? | 21:46 |
| *** aedc has quit IRC | 21:47 | |
| mwhahaha | trozet: I'm not at my computer but will be in a bit. What is up | 21:47 |
| trozet | mwhahaha: i think there is a bug in tripleo-common around openstack overcloud container image prepare | 21:47 |
| trozet | mwhahaha: the behavior seems different now, where if i include a -e file, it still prints all the docker images for the other service as well | 21:48 |
| mwhahaha | trozet: I think that's to be expected, check with stevebaker though | 21:49 |
| trozet | stevebaker, mwhahaha: ah ok, this wasnt the behavior in queens | 21:51 |
| stevebaker | trozet: you should be allowing prepare to happen during deploy or switch to "openstack tripleo container image prepare" as per the docs | 21:51 |
| trozet | stevebaker: this command is deprecated? I'm using rocky. I just want to push some container images to my local docker registry | 21:52 |
| trozet | and prep the heat docker image vars for deployment | 21:52 |
| stevebaker | trozet: its deprecated, yes | 21:52 |
| *** itlinux has quit IRC | 21:52 | |
| stevebaker | "openstack tripleo container image prepare" can do discover, prepare, upload in a single command, driven by yaml in a single heat parameter | 21:53 |
| stevebaker | trozet: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/container_image_prepare.html | 21:54 |
| trozet | stevebaker: ok thanks i'll read this. Can you filter for only the services that are included in your env files to push images for | 21:55 |
| trozet | stevebaker: i dont want to docker pull and push a bunch of images i dont need | 21:55 |
| trozet | stevebaker: maybe thats the "includes" part | 21:56 |
| stevebaker | trozet: yes you can pass -e files and roles data to filter services | 21:57 |
| stevebaker | trozet: plus use includes/excludes | 21:57 |
| trozet | stevebaker: does it use the same core tripleo-common code for preparing? | 21:57 |
| trozet | stevebaker: then i fear might be the same issue, but I'll try it and confirm | 21:57 |
| *** betherly has joined #tripleo | 21:58 | |
| stevebaker | trozet: yes, same core code. If its just a few specific images then I would recommend using includes patterns | 21:58 |
| *** morazi has quit IRC | 21:58 | |
| trozet | stevebaker: but should the behavior have changed betwen queens and rocky? it was convenient to just be able to use the existing env files to filter what services you wanted | 21:58 |
| stevebaker | trozet: that should still work, but don't use the old command | 21:59 |
| trozet | stevebaker: ok let me give it a shot | 22:00 |
| sl0w | mwhahaha: heh, so 7.4 is broken, 7.3 works.. yay! | 22:01 |
| sl0w | mwhahaha: verfied you are right, 7.3 sets fstype=1 | 22:01 |
| *** betherly has quit IRC | 22:02 | |
| *** Vorrtex has quit IRC | 22:03 | |
| trozet | stevebaker: | 22:04 |
| trozet | # openstack tripleo container image prepare -e /usr/share/openstack-tripleo-heat-templates/environments/services/neutron-opendaylight.yaml --output-env-file test-images.yaml | 22:04 |
| trozet | # | 22:04 |
| trozet | parameter_defaults: null | 22:04 |
| *** dprince has quit IRC | 22:06 | |
| trozet | stevebaker: i need to sign off for today. let me know what im doing wrong or if I should file a bug on this | 22:09 |
| stevebaker | trozet: you also need to pass a -e containers-prepare-parameter.yaml | 22:09 |
| tonyb | $topic says that CI is GREENish, what's the outlook on https://bugs.launchpad.net/tripleo/+bug/1798195 ? I seem to get hot by that often | 22:09 |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 22:09 |
| stevebaker | trozet: which you can generate with this command then customize: openstack tripleo container image prepare default --output-env-file containers-prepare-parameter.yaml | 22:09 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 22:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 22:10 |
| stevebaker | tonyb: maybe weshay knows | 22:10 |
| tonyb | stevebaker: DO I need to run openctsk tripleo conatiner prepare default? Or if I knwo that I want containers-prepare-parameter.yaml to look like can I just create it? | 22:10 |
| stevebaker | tonyb: no, its a convenience call to create a file with the current recommended defaults | 22:10 |
| trozet | stevebaker: ok so i generatd the default file like you said | 22:11 |
| trozet | stevebaker: then ran openstack tripleo container image prepare -e containers-prepare-parameter.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/services/neutron-opendaylight.yaml --output-env-file test-images.yaml | 22:11 |
| tonyb | stevebaker: Ahh cool, that saves a small amount of work ;P | 22:11 |
| trozet | stevebaker: that works...except it includes all the images, but does not include OpenDaylight images...inverse behavior | 22:12 |
| trozet | stevebaker: im guessing because neutron_dirver is null in the containers-prepare | 22:13 |
| trozet | stevebaker: yep that is why. so now how do i filter only the opendaylight images, i guess i have to use the pattern | 22:14 |
| trozet | stevebaker: this is kind of a step backwards compared to queens release | 22:15 |
| stevebaker | I do get DockerOpendaylightApiImage and DockerOpendaylightConfigImage, and a bunch of others | 22:15 |
| trozet | stevebaker: did you set your neutron_driver to 'opendaylight' | 22:15 |
| stevebaker | trozet: that command is only used for development/testing of your special prepare scenarios without having to do a full deployment. I'd recommend setting neutron_driver: ovn, and further using includes: [opendaylight] if you only want to transfer the opendaylight images | 22:18 |
| *** betherly has joined #tripleo | 22:18 | |
| trozet | stevebaker: yeah the includes works | 22:19 |
| trozet | stevebaker: but i dont think it is just for a special scenario | 22:19 |
| trozet | stevebaker: what if my openstack deployment doesnt include sensu? you still download and push that image anyway | 22:19 |
| trozet | stevebaker: i think many real deployments may not use all services offered | 22:20 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Allow enabling routed networks on undercloud update|upgrade https://review.openstack.org/601369 | 22:21 |
| *** mcornea has quit IRC | 22:21 | |
| stevebaker | trozet: overcloud deploy has the real actual environment and roles data fully resolved, which is why prepare-during-deploy does a better job of filtering for actual images required | 22:21 |
| trozet | stevebaker: oh i see what you mean | 22:22 |
| trozet | stevebaker: does htat also push to local registry? | 22:22 |
| stevebaker | trozet: if you set push_destination:true as per the docs https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/container_image_prepare.html#undercloud-registry | 22:23 |
| *** betherly has quit IRC | 22:23 | |
| trozet | stevebaker: so when it does it at deploy time, it takes into account which services are set to None in the compiled overcloud registry? | 22:23 |
| stevebaker | trozet: its mainly driven by roles data. To be honest, if it is in roles data but set to None in the env it will still copy the image, but this only results in a few extra transfers. There is a low priority bug to fix that. If you really want to optimise that then I'd recommend providing a custom roles data file which represents actual services deployed (bonus, your deployment will happen faster for other | 22:27 |
| stevebaker | reasons too) | 22:27 |
| weshay | stevebaker, tonyb rdo-cloud still has issues, but is much better than where it was yesterday | 22:28 |
| *** vinaykns has quit IRC | 22:29 | |
| weshay | still seeing a number of jobs failing on network related issues, but about 1/2 are passing now | 22:29 |
| tonyb | weshay: Thanks. Is it okay fro me to try my luck with a recheck? | 22:29 |
| weshay | tonyb, heck ya and put it all on red :) | 22:35 |
| *** dtrainor has quit IRC | 22:35 | |
| weshay | meh.. better use black | 22:35 |
| tonyb | weshay: :) | 22:35 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add a tag's contining subnet cidr to ctlplane network https://review.openstack.org/613442 | 22:40 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add a tag's contining subnet cidr to ctlplane network https://review.openstack.org/613442 | 22:43 |
| *** tosky has quit IRC | 22:45 | |
| *** betherly has joined #tripleo | 22:49 | |
| *** betherly has quit IRC | 22:53 | |
| openstackgerrit | Alex Schultz proposed openstack/paunch master: podman: stop the docker container during upgrade https://review.openstack.org/608319 | 23:01 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Stop using deprecated docker.yaml https://review.openstack.org/611805 | 23:07 |
| *** betherly has joined #tripleo | 23:09 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799786 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1799895 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 23:10 |
| openstack | Launchpad bug 1799895 in tripleo "CI: undercloud takes long time which causes job fail with timeout" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco) | 23:10 |
| mwhahaha | EmilienM: it's thursday and we didn't cut milestone 1 did we | 23:11 |
| *** betherly has quit IRC | 23:14 | |
| tonyb | mwhahaha: https://review.openstack.org/#/q/status:open+project:openstack/releases+branch:master+topic:tripleo/release ? | 23:22 |
| tonyb | mwhahaha: You're right that m1 isn't tagged but it's progressing IIUC | 23:22 |
| mwhahaha | ah sneaky | 23:23 |
| tonyb | <- could just review that topic ;P | 23:23 |
| mwhahaha | the problem is i doubt we've properly updated the metadata for the UI/puppet | 23:23 |
| *** rlandy has quit IRC | 23:23 | |
| tonyb | mwhahaha: Ahh that's beyond me | 23:23 |
| mwhahaha | yea i'll at least address the puppet one | 23:23 |
| tonyb | mwhahaha: but if there's something that can be addresses we can -W the impacted releases | 23:24 |
| tonyb | mwhahaha: I'm around for a while so ping me if needed. | 23:24 |
| mwhahaha | it'll fail ci w/o the puppet patch | 23:24 |
| mwhahaha | it won't land today | 23:24 |
| mwhahaha | we should have started sooner :/ | 23:24 |
| tonyb | mwhahaha: Well you're cycle-trailing so you have another 2 weeks don't you? | 23:25 |
| mwhahaha | i don't know how that's really worked | 23:25 |
| mwhahaha | we've always aligned with the regular milestones | 23:25 |
| * mwhahaha shrugs | 23:25 | |
| tonyb | mwhahaha: Okay. It doens't hurt | 23:25 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo master: Bump metadata for Stein milestone 1 https://review.openstack.org/613448 | 23:25 |
| tonyb | mwhahaha: So I can +W (after review) the 3 that don't have your -1? | 23:27 |
| mwhahaha | let me check those | 23:27 |
| tonyb | danke | 23:28 |
| mwhahaha | tonyb: yea adding the deliverable files should be fine | 23:30 |
| tonyb | mwhahaha: cool. | 23:30 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-ui master: Prepare Stein M1 versions https://review.openstack.org/613450 | 23:33 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates stable/rocky: Allow standalone to manage selinux https://review.openstack.org/613451 | 23:35 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates stable/rocky: Allow standalone to manage selinux https://review.openstack.org/613451 | 23:37 |
| *** agopi is now known as agopi|brb | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!