*** Schroeder20 has joined #oooq | 00:00 | |
Schroeder20 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 00:00 |
---|---|---|
*** panda|rover|bbl sets mode: +b *!*@186.178.74.90 | 00:00 | |
*** Schroeder20 was kicked by panda|rover|bbl (Schroeder20) | 00:00 | |
*** vinaykns has joined #oooq | 00:04 | |
*** qassim4 has joined #oooq | 00:05 | |
qassim4 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 00:05 |
qassim4 | I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 00:05 |
qassim4 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 00:05 |
*** panda|rover|bbl sets mode: +b *!*@14.190.11.226 | 00:05 | |
*** qassim4 was kicked by panda|rover|bbl (qassim4) | 00:05 | |
*** rlandy has quit IRC | 00:06 | |
*** EvilRoey14 has joined #oooq | 00:19 | |
EvilRoey14 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 00:19 |
*** panda|rover|bbl sets mode: +b *!*@123.20.175.40 | 00:19 | |
*** EvilRoey14 was kicked by panda|rover|bbl (EvilRoey14) | 00:19 | |
*** johtso has joined #oooq | 00:19 | |
johtso | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 00:19 |
*** panda|rover|bbl sets mode: +b *!*@14.240.34.30 | 00:19 | |
*** johtso was kicked by panda|rover|bbl (johtso) | 00:19 | |
hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 00:39 |
*** vans22 has joined #oooq | 00:51 | |
vans22 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 00:51 |
*** panda|rover|bbl sets mode: +b *!*@2800:bf0:9fff:fb10:9e74:1aff:fec8:bcdb | 00:51 | |
*** vans22 was kicked by panda|rover|bbl (vans22) | 00:51 | |
*** Gentle has joined #oooq | 00:53 | |
Gentle | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 00:53 |
*** panda|rover|bbl sets mode: +b *!*@42.180.233.97 | 00:53 | |
*** Gentle was kicked by panda|rover|bbl (Gentle) | 00:53 | |
*** EmilienM has quit IRC | 01:02 | |
*** EmilienM has joined #oooq | 01:02 | |
*** violet29 has joined #oooq | 01:08 | |
violet29 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 01:08 |
*** panda|rover|bbl sets mode: +b *!*@nor75-21-88-161-67-32.fbx.proxad.net | 01:08 | |
*** violet29 was kicked by panda|rover|bbl (violet29) | 01:08 | |
*** links has joined #oooq | 01:15 | |
*** johnpark_pj has joined #oooq | 02:05 | |
johnpark_pj | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 02:05 |
*** panda|rover|bbl sets mode: +b *!*@185.164.81.29 | 02:05 | |
*** johnpark_pj was kicked by panda|rover|bbl (johnpark_pj) | 02:05 | |
*** FrozenFox20 has joined #oooq | 02:34 | |
FrozenFox20 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 02:34 |
*** panda|rover|bbl sets mode: +b *!*@121.178.66.233 | 02:34 | |
*** FrozenFox20 was kicked by panda|rover|bbl (FrozenFox20) | 02:34 | |
*** links has quit IRC | 02:37 | |
hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 02:39 |
*** vinaykns has quit IRC | 02:45 | |
*** loeken15 has joined #oooq | 02:49 | |
loeken15 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 02:49 |
*** panda|rover|bbl sets mode: +b *!*@37.114.159.200 | 02:49 | |
*** loeken15 was kicked by panda|rover|bbl (loeken15) | 02:49 | |
*** links has joined #oooq | 02:53 | |
*** links has quit IRC | 03:07 | |
*** skramaja has joined #oooq | 03:10 | |
*** Asoka27 has joined #oooq | 03:13 | |
Asoka27 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 03:13 |
*** panda|rover|bbl sets mode: +b *!*@ZN150104.ppp.dion.ne.jp | 03:13 | |
*** Asoka27 was kicked by panda|rover|bbl (Asoka27) | 03:13 | |
*** links has joined #oooq | 03:21 | |
*** wook_ has joined #oooq | 03:28 | |
*** Guest88756 has joined #oooq | 03:28 | |
*** mfa29812 has joined #oooq | 03:28 | |
mfa29812 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 03:28 |
mfa29812 | I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 03:28 |
*** panda|rover|bbl sets mode: +b *!*@121.132.235.233 | 03:28 | |
*** mfa29812 was kicked by panda|rover|bbl (mfa29812) | 03:29 | |
*** wook_ has quit IRC | 03:33 | |
*** change has joined #oooq | 03:33 | |
change | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 03:33 |
*** panda|rover|bbl sets mode: +b *!*@211.248.133.198 | 03:33 | |
*** change was kicked by panda|rover|bbl (change) | 03:33 | |
*** dtrainor has quit IRC | 03:39 | |
*** udesale has joined #oooq | 03:46 | |
*** sjohnson22 has joined #oooq | 03:47 | |
sjohnson22 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 03:47 |
*** panda|rover|bbl sets mode: +b *!*@14.169.216.75 | 03:47 | |
*** sjohnson22 was kicked by panda|rover|bbl (sjohnson22) | 03:47 | |
*** yoink28 has joined #oooq | 03:55 | |
yoink28 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 03:55 |
*** panda|rover|bbl sets mode: +b *!*@186.6.104.248 | 03:55 | |
*** yoink28 was kicked by panda|rover|bbl (yoink28) | 03:55 | |
*** ykarel|away has joined #oooq | 04:23 | |
*** ykarel|away is now known as ykarel_ | 04:27 | |
*** ykarel_ is now known as ykarel|away | 04:28 | |
*** ykarel|away is now known as yatinkarel | 04:28 | |
*** yatinkarel is now known as ykarel | 04:28 | |
*** Waggie5 has joined #oooq | 04:31 | |
Waggie5 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 04:31 |
Waggie5 | I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 04:31 |
*** panda|rover|bbl sets mode: +b *!*@host-cotesma-172-207.smandes.com.ar | 04:31 | |
*** Waggie5 was kicked by panda|rover|bbl (Waggie5) | 04:31 | |
*** ykarel has quit IRC | 04:37 | |
*** ykarel has joined #oooq | 04:37 | |
*** jaganathan has joined #oooq | 04:39 | |
hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 04:39 |
*** PaulCapestany has joined #oooq | 05:01 | |
PaulCapestany | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 05:01 |
*** panda|rover|bbl sets mode: +b *!*@87.253.21.151 | 05:01 | |
*** PaulCapestany was kicked by panda|rover|bbl (PaulCapestany) | 05:01 | |
*** trown|outtypewww has quit IRC | 05:02 | |
marios | panda|rover|bbl: what did paulcaptestany ever do to you man | 05:11 |
marios | :) | 05:11 |
*** trown has joined #oooq | 05:12 | |
*** trown has quit IRC | 05:27 | |
*** trown|brb has joined #oooq | 05:29 | |
*** ratailor has joined #oooq | 05:31 | |
*** Skunky21 has joined #oooq | 05:37 | |
Skunky21 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 05:37 |
*** panda|rover|bbl sets mode: +b *!*@22.red-79-150-110.dynamicip.rima-tde.net | 05:37 | |
*** Skunky21 was kicked by panda|rover|bbl (Skunky21) | 05:37 | |
*** saneax has joined #oooq | 05:38 | |
*** quiquell|off has joined #oooq | 05:41 | |
*** holser_ has joined #oooq | 05:41 | |
*** saneax has quit IRC | 05:42 | |
*** nb28 has joined #oooq | 05:43 | |
nb28 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 05:43 |
nb28 | I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 05:43 |
nb28 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 05:43 |
*** panda|rover|bbl sets mode: +b *!*@138.0.89.214 | 05:43 | |
*** nb28 was kicked by panda|rover|bbl (nb28) | 05:43 | |
*** saneax has joined #oooq | 05:43 | |
*** quiquell|off is now known as quiquell | 05:48 | |
*** quiquell has quit IRC | 05:55 | |
*** quiquell has joined #oooq | 05:56 | |
*** dtrainor has joined #oooq | 06:04 | |
*** jfrancoa has joined #oooq | 06:05 | |
*** ccamacho has joined #oooq | 06:16 | |
*** holser_ has quit IRC | 06:17 | |
*** Ragnor17 has joined #oooq | 06:17 | |
Ragnor17 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 06:17 |
*** panda|rover|bbl sets mode: +b *!*@121.129.245.177 | 06:17 | |
*** Ragnor17 was kicked by panda|rover|bbl (Ragnor17) | 06:17 | |
*** udesale_ has joined #oooq | 06:19 | |
*** udesale has quit IRC | 06:23 | |
*** waleedm has joined #oooq | 06:32 | |
hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 06:40 |
*** gvrangan has joined #oooq | 06:40 | |
*** saneax has quit IRC | 06:42 | |
*** james41382 has joined #oooq | 06:54 | |
james41382 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 06:54 |
james41382 | I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 06:54 |
james41382 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 06:54 |
*** panda|rover|bbl sets mode: +b *!*@14.234.199.245 | 06:54 | |
*** james41382 has quit IRC | 06:54 | |
*** wraeth5 has joined #oooq | 06:58 | |
wraeth5 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 06:58 |
*** panda|rover|bbl sets mode: +b *!*@2800:bf0:9fff:fb91:4a7b:6bff:fe66:d17e | 06:58 | |
*** wraeth5 was kicked by panda|rover|bbl (wraeth5) | 06:58 | |
*** florianf has joined #oooq | 06:58 | |
*** florianf has quit IRC | 06:59 | |
*** florianf has joined #oooq | 06:59 | |
*** jtomasek has joined #oooq | 07:00 | |
*** jtomasek has quit IRC | 07:00 | |
*** jtomasek has joined #oooq | 07:01 | |
*** alyptik has joined #oooq | 07:03 | |
alyptik | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 07:03 |
alyptik | I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 07:03 |
alyptik | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 07:03 |
*** panda|rover|bbl sets mode: +b *!*@210-194-240-184.rev.home.ne.jp | 07:03 | |
*** alyptik was kicked by panda|rover|bbl (alyptik) | 07:03 | |
*** amoralej|off is now known as amoralej | 07:03 | |
quiquell | marios: Did you found any issue at https://review.openstack.org/#/c/584465/ ? | 07:06 |
*** jtomasek has quit IRC | 07:09 | |
*** jtomasek has joined #oooq | 07:09 | |
marios | quiquell: no just the commit message man and waiting for more qe/testing but lgtm/afaics | 07:15 |
*** barschmade has joined #oooq | 07:15 | |
barschmade | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 07:15 |
*** panda|rover|bbl sets mode: +b *!*@211.49.80.105 | 07:15 | |
*** barschmade was kicked by panda|rover|bbl (barschmade) | 07:15 | |
marios | quiquell: it would be +1 if i had nothing to say (even the commit) and then +2 once we are happy (is still early for the sprint) | 07:15 |
quiquell | marios: The testing patch, fail at infra issue, some provider issue, I am thinking about increasing coverage at CI Directly in this patch | 07:16 |
marios | quiquell: just being careful is all | 07:16 |
quiquell | marios: Sure, just checking what to change | 07:16 |
marios | quiquell: sorry please don't take it the wrong way :) as i told you yesterday i have decided to start using the -1 a bit more :) i mean as we all discussed | 07:16 |
marios | quiquell: ack | 07:16 |
quiquell | marios: sure sure, just checking, no problem | 07:18 |
quiquell | marios: Added the rest of the scenarios at zuul layout for changes at tripleo-ci playbook | 07:28 |
quiquell | https://review.openstack.org/#/c/584465/ | 07:28 |
quiquell | So we don't need the test review anymore for those changes | 07:29 |
*** tosky has joined #oooq | 07:33 | |
*** tesseract has joined #oooq | 07:35 | |
*** tesseract has quit IRC | 07:35 | |
*** tesseract has joined #oooq | 07:37 | |
*** tbarron has quit IRC | 07:46 | |
*** apetrich has joined #oooq | 07:46 | |
*** tbarron has joined #oooq | 07:47 | |
*** leifmadsen_ has quit IRC | 07:47 | |
*** udesale__ has joined #oooq | 07:49 | |
*** leifmadsen has joined #oooq | 07:50 | |
*** saneax has joined #oooq | 07:51 | |
*** udesale_ has quit IRC | 07:52 | |
*** jtomasek has quit IRC | 07:53 | |
*** jtomasek has joined #oooq | 07:53 | |
*** jtomasek has quit IRC | 07:59 | |
*** saneax has left #oooq | 08:02 | |
*** saneax has joined #oooq | 08:02 | |
*** jtomasek has joined #oooq | 08:07 | |
*** gvrangan has quit IRC | 08:22 | |
*** apetrich has quit IRC | 08:26 | |
*** apetrich has joined #oooq | 08:26 | |
*** berFt9 has joined #oooq | 08:34 | |
berFt9 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 08:34 |
*** panda|rover|bbl sets mode: +b *!*@182.76.40.50 | 08:34 | |
*** berFt9 was kicked by panda|rover|bbl (berFt9) | 08:34 | |
*** holser_ has joined #oooq | 08:37 | |
quiquell | marios: Stupid question, do we have a url shorter at openstack ? to add links to commits | 08:39 |
hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 08:40 |
*** gvrangan has joined #oooq | 08:41 | |
*** udesale__ has quit IRC | 08:46 | |
*** udesale has joined #oooq | 08:46 | |
*** jbadiapa has quit IRC | 08:47 | |
*** saneax has quit IRC | 08:48 | |
*** saneax has joined #oooq | 08:48 | |
*** kloeri4 has joined #oooq | 08:57 | |
kloeri4 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 08:57 |
*** panda|rover|bbl sets mode: +b *!*@h-174-75-169.A183.priv.bahnhof.se | 08:57 | |
*** kloeri4 was kicked by panda|rover|bbl (kloeri4) | 08:57 | |
*** TingPing5 has joined #oooq | 09:01 | |
TingPing5 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 09:01 |
TingPing5 | I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 09:01 |
TingPing5 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 09:01 |
*** panda|rover|bbl sets mode: +b *!*@42-144-28-19.rev.home.ne.jp | 09:01 | |
*** TingPing5 was kicked by panda|rover|bbl (TingPing5) | 09:01 | |
*** jtomasek has quit IRC | 09:02 | |
*** jtomasek has joined #oooq | 09:03 | |
*** jtomasek has quit IRC | 09:04 | |
*** jtomasek has joined #oooq | 09:04 | |
*** jtomasek has quit IRC | 09:05 | |
*** jtomasek has joined #oooq | 09:05 | |
*** jtomasek has quit IRC | 09:12 | |
Tengu | lol... that continues then. | 09:13 |
jfrancoa | quiquell: marios: maybe you can give me hand. I was investigating yesterday why the deployment fails in the legacy-tripleo-upgrades-containers-to-containers job, when the deploy job in stable/queens goes well | 09:26 |
jfrancoa | quiquell: marios: and I found that we are not passing the hostnamemap.yml env file in the upgrades job | 09:27 |
jfrancoa | quiquell: marios: UPGRADES FAILING JOB: https://logs.rdoproject.org/15/583515/6/openstack-check/legacy-tripleo-ci-centos-7-container-to-container-upgrades-master/69d1f86/logs/undercloud/home/zuul/overcloud-deploy.sh DEPLOY QUEENS PASS JOB: http://logs.openstack.org/73/587773/1/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/aba4685/logs/undercloud/home/zuul/overcloud-deploy.sh | 09:27 |
jfrancoa | quiquell: marios: any clue why isn't it include? I checked yesterday the tqe repo but I didn't find any late changes in overcloud-deploy that could impact into the job | 09:28 |
quiquell | jfrancoa: Checking | 09:29 |
quiquell | jfrancoa: You expect an extra "-e hostnamemap.yml" ? | 09:30 |
quiquell | at openstack overcloud deploy ? | 09:30 |
jfrancoa | quiquell: right. I believe that's the reason why the job fails | 09:31 |
jfrancoa | quiquell: I ran the same job in with reproducer-quickstart.sh, and the deploy included the hostnamemap.yml env and it passed | 09:32 |
quiquell | jfrancoa: This is not being executed http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/overcloud-deploy/tasks/pre-deploy.yml#n110 | 09:33 |
jfrancoa | quiquell: yes, that's what I observed. But couldn't find where do we define the overcloud_nodes variable... | 09:34 |
quiquell | says ok but not changed... | 09:34 |
quiquell | jfrancoa: I don't see the task with state "changed" | 09:34 |
quiquell | jfrancoa: And also is not skipped | 09:34 |
marios | jfrancoa: o/ not aware of any changes/issues with that ... i just went poking with git blame but cant see something recent (looking at the overcloud-deploy role which is adding the -e hostnamempa.yaml | 09:35 |
marios | jfrancoa: ( I mean like https://github.com/openstack/tripleo-quickstart-extras/blob/3b6d85d88a0be2ded3a4ec101d70ba679b44a47f/roles/overcloud-deploy/tasks/pre-deploy.yml#L113 | 09:35 |
quiquell | jfrancoa: The fact is set http://logs.openstack.org/73/587773/1/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/aba4685/logs/ara_oooq/result/b0e6b1e3-5fc1-4992-9e60-66aaa7220b50/ | 09:36 |
jfrancoa | quiquell: yes, but that's from the deploy job. not the upgrades | 09:38 |
quiquell | jfrancoa: The failing one is at RDO ? | 09:38 |
*** zoli is now known as zoli|lunch | 09:39 | |
quiquell | jfrancoa: We have a skipped there | 09:39 |
marios | quiquell: jfrancoa sorry didn't see quique reply before mine | 09:44 |
quiquell | jfrancoa: It's using this nodes_file /opt/stack/new/tripleo-quickstart/config/nodes/1ctlr.yml | 09:45 |
quiquell | Ans this one have this hostnamemap_override: "{{ hostvars[groups['overcloud'][0]].ansible_hostname }}" | 09:45 |
*** jaganathan has quit IRC | 09:46 | |
*** jaganathan has joined #oooq | 09:46 | |
jfrancoa | quiquell: yes the one that fails is from rdo | 09:47 |
jfrancoa | quiquell: aha..that's probably the key | 09:48 |
quiquell | jfrancoa: It access by indes, but it's ok we have only one | 09:48 |
jfrancoa | quiquell: because also, when I compared the ansible-command that runs multinode-overcloud. I saw that the upgrade ones takes the 1ctlr.yml file from --extra-vars @/opt/stack/new/tripleo-quickstart/config/nodes/1ctlr.yml and the deploy (PASSING one) from @/home/zuul/src/git.openstack.org/openstack//tripleo-quickstart/config/nodes/1ctlr.yml | 09:50 |
quiquell | jfrancoa: They are the same, the upstream have change a little to be more zuulv3 native | 09:51 |
jfrancoa | quiquell: why do we have some $HOME/src/git.openstack.org/ folder for some jobs? | 09:51 |
quiquell | jfrancoa: But they are the same | 09:51 |
quiquell | jfrancoa: That's where zuulv3 clone stuff, our /opt/stack/new... is legacy stuff that will disappear | 09:51 |
*** MikeoftheEast has joined #oooq | 09:52 | |
MikeoftheEast | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 09:52 |
*** panda|rover|bbl sets mode: +b *!*@171.5.34.183 | 09:52 | |
*** MikeoftheEast was kicked by panda|rover|bbl (MikeoftheEast) | 09:52 | |
jfrancoa | quiquell: ok, that makes sense | 09:52 |
jfrancoa | quiquell: oh, our friend MiguelDelEste! :-D | 09:52 |
chandankumar | arxcruz: can I add you as a QE here? https://trello.com/c/05m7lFPs/892-lp1784929tempest-importerror-no-module-named-muranoclient | 09:53 |
quiquell | jfrancoa: jfrancoa | 09:53 |
quiquell | twice :-) | 09:53 |
*** meti5 has joined #oooq | 09:53 | |
quiquell | found a difference | 09:53 |
meti5 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 09:53 |
*** panda|rover|bbl sets mode: +b *!*@81.171.81.102 | 09:53 | |
*** meti5 was kicked by panda|rover|bbl (meti5) | 09:53 | |
quiquell | ansible inventory is different | 09:53 |
quiquell | working: http://logs.openstack.org/73/587773/1/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/aba4685/logs/quickstart_files/hosts.txt.gz | 09:54 |
quiquell | non working: https://logs.rdoproject.org/15/583515/6/openstack-check/legacy-tripleo-ci-centos-7-container-to-container-upgrades-master/69d1f86/logs/quickstart_files/hosts.txt.gz | 09:54 |
quiquell | jfrancoa: overcloud group is not being generated | 09:54 |
jfrancoa | quiquell: that's what I was looking for. I didn't know that we were logging quickstart files there (something new to learn, thanks) | 09:55 |
chandankumar | arxcruz: I have assigned myself as QE on your cards | 09:55 |
jfrancoa | quiquell: I think it starts to smell to bug, should I open a LP? | 09:56 |
quiquell | jfrancoa: http://git.openstack.org/cgit/openstack/tripleo-quickstart/tree/roles/tripleo-inventory/templates/inventory.j2 | 09:56 |
*** saneax has quit IRC | 09:56 | |
quiquell | Ok, panda|rover|bbl is the rover, put him as owner | 09:57 |
quiquell | jfrancoa: Could be related to RDO infra | 09:57 |
quiquell | jfrancoa: subnode-2 having problems and we don't add it to inventory | 09:57 |
chandankumar | panda|rover|bbl: marios https://review.openstack.org/#/c/577780 please have a look at this | 09:58 |
jfrancoa | quiquell: great, thanks for the help | 09:58 |
*** By has joined #oooq | 10:03 | |
By | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 10:03 |
*** panda|rover|bbl sets mode: +b *!*@softbank221025214186.bbtec.net | 10:03 | |
*** By was kicked by panda|rover|bbl (By) | 10:03 | |
chandankumar | arxcruz: I am updating martin doc patch https://review.openstack.org/#/c/580981/5/config_tempest/main.py | 10:07 |
jfrancoa | quiquell: opened https://bugs.launchpad.net/tripleo/+bug/1785039 and assigned it to panda|rover|bbl , I included all the analysis in the LP description in case it's useful | 10:17 |
openstack | Launchpad bug 1785039 in tripleo "[Upgrades] legacy-tripleo-ci-centos-7-container-to-container-upgrades-master failing during deployment" [High,Triaged] - Assigned to Gabriele Cerami (gcerami) | 10:17 |
quiquell | jfrancoa: Cool thanks | 10:18 |
*** dtantsur|afk is now known as dtantsur | 10:32 | |
*** links has quit IRC | 10:34 | |
*** apetrich has quit IRC | 10:38 | |
*** apetrich has joined #oooq | 10:39 | |
hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 10:40 |
*** panda|rover|bbl is now known as panda|rover | 10:47 | |
panda|rover | sorry guys these are crazy days for me | 10:47 |
quiquell | panda|rover: Np, we are doing good | 10:50 |
panda|rover | next week should be better | 10:51 |
*** Azure16 has joined #oooq | 10:53 | |
Azure16 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 10:53 |
Azure16 | I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 10:53 |
Azure16 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 10:53 |
*** panda|rover sets mode: +b *!*@159.192.231.247 | 10:53 | |
*** Azure16 was kicked by panda|rover (Azure16) | 10:53 | |
quiquell | panda|rover: ^ poor bots | 10:53 |
panda|rover | quiquell: they have to die a painful death | 10:56 |
*** zoli|lunch is now known as zoli | 11:00 | |
*** APLU27 has joined #oooq | 11:13 | |
APLU27 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 11:13 |
*** panda|rover sets mode: +b *!*@84.94.235.137.forward.012.net.il | 11:13 | |
*** APLU27 was kicked by panda|rover (APLU27) | 11:13 | |
*** leachim616 has joined #oooq | 11:14 | |
leachim616 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 11:14 |
leachim616 | I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 11:14 |
*** panda|rover sets mode: +b *!*@paa54bc.chibnt01.ap.so-net.ne.jp | 11:14 | |
*** leachim616 was kicked by panda|rover (leachim616) | 11:14 | |
*** apetrich has quit IRC | 11:18 | |
arxcruz | chandankumar: ok | 11:26 |
*** udesale has quit IRC | 11:27 | |
*** gvrangan has quit IRC | 11:34 | |
*** gvrangan has joined #oooq | 11:42 | |
*** missnomer15 has joined #oooq | 11:44 | |
missnomer15 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 11:44 |
*** panda|rover sets mode: +b *!*@123.21.28.145 | 11:44 | |
*** missnomer15 was kicked by panda|rover (missnomer15) | 11:44 | |
quiquell | panda|rover: Check this https://review.openstack.org/#/c/584465/17/zuul.d/layout.yaml | 11:49 |
quiquell | panda|rover: Increase CI coverage for the tripleo-ci role | 11:49 |
quiquell | panda|rover: It's ok ? | 11:50 |
*** jtomasek_ has joined #oooq | 12:09 | |
*** jtomasek__ has joined #oooq | 12:11 | |
*** jtomasek__ has quit IRC | 12:12 | |
*** rfolco|off is now known as rfolco|ruck | 12:15 | |
*** jtomasek_ has quit IRC | 12:18 | |
panda|rover | rfolco|ruck: AAAAAA | 12:20 |
*** florianf has quit IRC | 12:23 | |
weshay | howdy | 12:28 |
rfolco|ruck | panda|rover, ? | 12:29 |
quiquell | weshay: Connecting | 12:30 |
*** rlandy has joined #oooq | 12:30 | |
weshay | https://trello.com/c/AerVRkBH/887-replace-bash-environment-variables-in-tociquickstartsh-with-ansible-variables-from-zuul-inventory-or-zuul-job-config-s17 | 12:33 |
*** atoth has joined #oooq | 12:35 | |
*** rlandy has quit IRC | 12:37 | |
*** rlandy has joined #oooq | 12:37 | |
*** ratailor has quit IRC | 12:39 | |
hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ (2 more messages) | 12:40 |
weshay | ssbarnea, https://review.openstack.org/#/c/584465/17 | 12:40 |
myoung | o/ | 12:51 |
*** udesale has joined #oooq | 12:51 | |
myoung | weshay, quiquell, did you already meet about https://trello.com/c/AerVRkBH/887-replace-bash-environment-variables-in-tociquickstartsh-with-ansible-variables-from-zuul-inventory-or-zuul-job-config-s17#comment-5b621427ed30b5058f7e4182 ? | 12:54 |
*** Goneri has joined #oooq | 12:58 | |
weshay | panda|rover, rlandy mtg | 13:02 |
*** Geeky_Bear has joined #oooq | 13:03 | |
Geeky_Bear | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 13:03 |
Geeky_Bear | I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 13:03 |
*** panda|rover sets mode: +b *!*@119santiagord22.codetel.net.do | 13:03 | |
*** Geeky_Bear was kicked by panda|rover (Geeky_Bear) | 13:03 | |
*** saneax has joined #oooq | 13:06 | |
*** jtomasek-tmp has joined #oooq | 13:12 | |
*** jaosorior has quit IRC | 13:20 | |
rfolco|ruck | chandankumar, tempest still failing on murano test, could you please take a look ? https://bugs.launchpad.net/tripleo/+bug/1784929 | 13:23 |
openstack | Launchpad bug 1784929 in tripleo "[tempest] ImportError: No module named muranoclient" [Critical,Fix committed] - Assigned to chandankumar (chandankumar-093047) | 13:23 |
rasca | myoung, hey, can you have a look at your internal msg? Need your help on an internal review | 13:30 |
*** gvrangan has quit IRC | 13:32 | |
marios | myoung: weshay panda|rover wrt https://trello.com/c/lrSUMaqw/885-translate-tripleosh-bootstrap-subnodes-into-a-series-of-tasks-s17 ... if we are keeping that rdo review then https://trello.com/c/lrSUMaqw/885-translate-tripleosh-bootstrap-subnodes-into-a-series-of-tasks-s17#comment-5b6034814fc57e9341a96ae9 is still true and describes how we can merge this card | 13:33 |
*** jaosorior has joined #oooq | 13:33 | |
marios | myoung: weshay panda|rover otherwise we need to revisit it, i.e. if we are going to use some other way than sagi path | 13:34 |
marios | patch | 13:34 |
*** skramaja has quit IRC | 13:35 | |
panda|rover | I'm too tired, I'm really losing rfolco|ruck on my task | 13:36 |
rfolco|ruck | hahaha | 13:36 |
rfolco|ruck | panda|rover, they don't understand these spicy jokes | 13:36 |
panda|rover | also I think there's a problem with the rfolco|ruck of my phone's camera | 13:36 |
panda|rover | too bad my ford rfolco|ruck car i breaking down | 13:36 |
weshay | panda|rover, ok.. so this other meeting is not happening | 13:39 |
weshay | panda|rover, shall we? | 13:39 |
panda|rover | weshay: coming | 13:41 |
weshay | bah sorry | 13:41 |
weshay | it is happening | 13:41 |
panda|rover | lol | 13:41 |
*** vinaykns has joined #oooq | 13:42 | |
*** quiquell is now known as quiquell|off | 13:43 | |
panda|rover | marios: sorry, you wanted to discuss something about your card ? | 13:44 |
marios | panda|rover: na just what i wrote here ^^ | 13:45 |
marios | panda|rover: but given the focus for 2 cards maybe not so urgent | 13:45 |
marios | panda|rover: the question still outstanding is | 13:45 |
marios | https://trello.com/c/lrSUMaqw/885-translate-tripleosh-bootstrap-subnodes-into-a-series-of-tasks-s17 ... if we are | 13:45 |
marios | keeping that rdo review then | 13:45 |
marios | https://trello.com/c/lrSUMaqw/885-translate-tripleosh-bootstrap-subnodes-into-a-series-of-tasks-s17#comment-5b6034814fc57e9341a96ae9 is | 13:45 |
marios | still true and describes how we can merge this card | 13:45 |
* marios joins the spammers | 13:45 | |
panda|rover | marios: yeah, this is my fault, we should have assigned people to just to cards from the start | 13:45 |
marios | 16:34 < marios> myoung: weshay panda|rover otherwise we need to revisit it, i.e. if we are going to use some other way than sagi path | 13:45 |
panda|rover | two cards* | 13:45 |
*** quiquell|off has quit IRC | 13:48 | |
panda|rover | marios: yeah, so the design with paul at this point is: make all your configurations on tripleo-ci, then in rdo-job just create jobs that inherit from tripleo-ci | 13:48 |
panda|rover | marios: in this way we don't have to replicate the playbooks, nothing will diverge | 13:48 |
panda|rover | marios: so yes, after the rdo cleanup card, we won't need that s17 card anymore, we'll have everything in one place | 13:49 |
panda|rover | marios: this is also one of the reasons why the rdo sf cleanup is so important | 13:49 |
myoung | panda|rover, weshay, rlandy - per discussion just now in scrum and guidance from panda|rover I've removed myself from https://trello.com/c/6xqcXtM7/859-translate-oooqcommonfunctionsshj2-piece-by-piece-to-ansible-tasks and moved it back to Backlog, and added myself to https://trello.com/c/TVsZ3Ut6/877-clean-up-rdo-sf-legacy-code-after-zuulv3-migration | 13:50 |
panda|rover | myoung: ok I'll confim that after speaking with weshay | 13:50 |
myoung | rlandy: I'm going thru reviews now, in about an hour when I have my head around this card and/or reviews would love to briefly chat to discuss. You're here today and tomorrow correct? | 13:50 |
myoung | panda|rover: ok...please confirm/advise. | 13:50 |
* myoung is a little dizzy | 13:50 | |
myoung | ;) | 13:50 |
rlandy | myoung: yes - I'm around today and tomorrow | 13:51 |
panda|rover | myoung: ping rlandy for any doubt, I know the design and will help all next week too | 13:51 |
marios | panda|rover: thanks | 13:52 |
myoung | panda|rover, rlandy, weshay: ack, just want to contribute to s17 and feeling like other than reviews I don't have much to show this far :?( | 13:53 |
myoung | ^^ s/this/thus | 13:53 |
*** ykarel is now known as ykarel|away | 13:58 | |
*** brault has quit IRC | 14:02 | |
panda|rover | myoung: do you want to chat ? | 14:02 |
myoung | panda|rover: did you confirm (above) with weshay and plan is as we talked about? | 14:03 |
myoung | panda|rover: if so then yes, but maybe in a few mins after I finish going thru existing comments and review to load context/background and build my "mind palace" (sherlock holmes reboot ref) | 14:04 |
rlandy | rfolco|ruck: ping re: playbooks | 14:04 |
panda|rover | myoung: no, I have suggestions on the all "other than reviews" thought | 14:04 |
rlandy | rfolco|ruck, https://review.openstack.org/#/c/587228/ | 14:04 |
myoung | panda|rover: oh sure. i can jump on BJ now | 14:04 |
* myoung loads it up | 14:04 | |
rfolco|ruck | rlandy, looking | 14:04 |
*** quiquell|off has joined #oooq | 14:05 | |
rlandy | rfolco|ruck: if the playbooks are defined in ansible, why does playbooks/tripleo-ci/templates/toci_gate_test.sh.j2 still add bash vars? what piece am I missing? | 14:05 |
chandankumar | rfolco|ruck: checking | 14:06 |
*** eir18 has joined #oooq | 14:06 | |
eir18 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 14:06 |
*** panda|rover sets mode: +b *!*@2.183.24.25 | 14:06 | |
*** eir18 has quit IRC | 14:06 | |
chandankumar | rfolco|ruck: job link | 14:07 |
*** ccamacho has quit IRC | 14:07 | |
*** ccamacho has joined #oooq | 14:07 | |
rfolco|ruck | chandankumar, https://review.rdoproject.org/zuul/builds.html?pipeline=openstack-periodic fs16-18, 27, 30 | 14:07 |
*** ccamacho has quit IRC | 14:08 | |
*** ccamacho has joined #oooq | 14:08 | |
rfolco|ruck | chandankumar, master... eg http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/4a7a2f4/logs/undercloud/home/zuul/tempest.log.txt.gz | 14:08 |
chandankumar | rfolco|ruck: in the container the package does not got updated which contains the fix | 14:09 |
*** AlexZ3 has joined #oooq | 14:10 | |
AlexZ3 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 14:10 |
AlexZ3 | I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 14:10 |
*** panda|rover sets mode: +b *!*@14.162.200.35 | 14:10 | |
*** AlexZ3 was kicked by panda|rover (AlexZ3) | 14:10 | |
rfolco|ruck | rlandy, this is a WIP that I could not finish in last sprint sue to gate breakage | 14:10 |
rlandy | rfolco|ruck: marios: ^^ ok - so that is where my confusion lies | 14:11 |
rfolco|ruck | rlandy, look.... PLAYBOOKS for example... | 14:11 |
rfolco|ruck | https://github.com/openstack-infra/tripleo-ci/blob/master/toci_quickstart.sh#L124 | 14:11 |
rfolco|ruck | it is still bash variable | 14:11 |
rlandy | rfolco|ruck: the issue is here ... | 14:12 |
rfolco|ruck | wait wrong file | 14:12 |
rlandy | https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/templates/toci_gate_test.sh.j2#L104 | 14:12 |
rlandy | ^^ that is what I want to override | 14:12 |
rlandy | currently, I changed it in: https://review.openstack.org/#/c/587228/5/playbooks/tripleo-ci/vars/environment_type/ovb.yaml | 14:13 |
rfolco|ruck | gorget previous link | 14:13 |
rfolco|ruck | this one https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/templates/toci_quickstart.sh.j2#L124 | 14:13 |
rlandy | which was the closet I could get | 14:13 |
rfolco|ruck | rlandy, you should change both IMO | 14:13 |
rlandy | so ... PLAYBOOKS will remain a bash variable for the moment | 14:13 |
rlandy | rfolco|ruck, I did | 14:13 |
rfolco|ruck | yes, then we just switch to ansible var | 14:13 |
rfolco|ruck | and cleanup bash vars | 14:14 |
rfolco|ruck | rlandy, thats why | 14:14 |
rlandy | I just have not added the override in the job definition | 14:14 |
rfolco|ruck | add a comment to the code or to the commit | 14:14 |
rlandy | which I can | 14:14 |
rfolco|ruck | a TODO or NOTE just for avoid confusion | 14:14 |
rlandy | will just be ignored for now | 14:14 |
rfolco|ruck | rlandy, sorry, my intent was to merge stuff quicker but quiquell|off and I broke gate so things are incomplete... | 14:15 |
rlandy | rfolco|ruck: nothing to apologize for | 14:16 |
rlandy | just clearing up what I should be doing | 14:16 |
rlandy | and explaining why I asked | 14:16 |
rfolco|ruck | :) | 14:16 |
rfolco|ruck | chandankumar, this container package update is part of your fix ? | 14:19 |
chandankumar | rfolco|ruck: yes, it will update the container | 14:20 |
*** ykarel|away has quit IRC | 14:32 | |
marios | rlandy: is it clearer now? see the description at https://trello.com/c/DdSHkgnE/884-replace-tocijobtype-variable-s17-undercloud-playbooks-environment-tags it points to https://review.openstack.org/#/c/582466 where playbooks is added into the per environment vars | 14:35 |
marios | weshay: panda|rover myoung as discussed earlier i filed a bug for that pike job at https://bugs.launchpad.net/tripleo/+bug/1785067 | 14:35 |
openstack | Launchpad bug 1785067 in tripleo "without bootstrap-subnodes pike deployment fails for missing os-collect-config" [High,Triaged] - Assigned to Marios Andreou (marios-b) | 14:35 |
marios | EmilienM: any ideas on that one? ^ | 14:35 |
panda|rover | marios: thanks | 14:36 |
EmilienM | marios: in a call, will look later | 14:37 |
marios | EmilienM: sure thanks | 14:37 |
*** waleedm has quit IRC | 14:39 | |
hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ (2 more messages) | 14:40 |
rfolco|ruck | panda|rover, what you think about delorean fail in multiple jobs? http://logs.openstack.org/24/582624/5/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/6359bee/job-output.txt.gz#_2018-08-02_10_34_53_962951 | 14:55 |
rfolco|ruck | new bug ? | 14:55 |
*** wsm has joined #oooq | 14:59 | |
wsm | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 14:59 |
wsm | I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 14:59 |
*** panda|rover sets mode: +b *!*@113.168.96.154 | 14:59 | |
*** wsm was kicked by panda|rover (wsm) | 14:59 | |
rlandy | marios:yep - discussed above with rfolco|ruck - the review is in but not used in toci_gate_test. I made the edit in both places | 15:00 |
panda|rover | rfolco|ruck: checking, it may be a legit error on the patch being tested | 15:00 |
rfolco|ruck | panda|rover, several jobs having the same issue, diff patches | 15:01 |
*** vinaykns has quit IRC | 15:01 | |
panda|rover | what is going on this week ? | 15:01 |
rfolco|ruck | the hell | 15:02 |
panda|rover | and we are not gathering any logs on the dlrn run ? :( | 15:04 |
panda|rover | h there they are | 15:04 |
*** ccamacho has quit IRC | 15:05 | |
panda|rover | rfolco|ruck: http://logs.openstack.org/24/582624/5/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/6359bee/logs/delorean_logs/fd/02/fd0215bfdc10ab871bcbaf58b034898a2306e7d3_dev/build.log.txt.gz | 15:05 |
rfolco|ruck | panda|rover, filing a bug ok? | 15:05 |
panda|rover | rfolco|ruck: wait | 15:07 |
panda|rover | rfolco|ruck: still think it's a legit failure | 15:08 |
* rfolco|ruck legit failure requires a bug | 15:08 | |
rfolco|ruck | thinks* | 15:08 |
rfolco|ruck | panda|rover, focus! you need focus! | 15:08 |
rfolco|ruck | panda|rover, why do you think its not a bug ? | 15:10 |
panda|rover | rfolco|ruck: found it | 15:11 |
panda|rover | it was just a typo in PS5 | 15:11 |
panda|rover | uhm | 15:11 |
panda|rover | anyway in PS6 it's gone | 15:11 |
*** vinaykns has joined #oooq | 15:12 | |
rfolco|ruck | panda|rover, I see the same failure on multiple patches | 15:12 |
rfolco|ruck | | 2018-08-02 11:37 || 26 min || Delorean FAIL. set fail. || 587802,2 || Logs || master || Logstash || check | | 15:12 |
rfolco|ruck | | 2018-08-02 11:27 || 32 min || Delorean FAIL. set fail. || 583321,8 || Logs || master || Logstash || check | | 15:12 |
rfolco|ruck | | 2018-08-02 11:22 || 24 min || Delorean FAIL. set fail. || 579170,7 || Logs || master || Logstash || check | | 15:12 |
panda|rover | rfolco|ruck: let's talk in #tripleo | 15:13 |
rasca | panda|rover, hey can you help clarify why if I define generate_overcloud_roles without setting overcloud_roles I get an error? Why it is mandatory if I want to use the generated role file? | 15:13 |
rasca | panda|rover, to be more specific the error is: AnsibleUndefinedVariable: 'overcloud_roles' is undefined | 15:13 |
rasca | panda|rover, but in the README it is written that generate_overcloud_roles takes precedence over overcloud_roles | 15:14 |
*** udesale has quit IRC | 15:15 | |
rlandy | yay - https://softwarefactory-project.io/r/#/c/13210/ merged | 15:19 |
panda|rover | rasca: to take precendence you need two element, if the first is missing, the second don't know what to take precedence on | 15:20 |
panda|rover | rasca: do you have any logs ? maybe the conditional for that task is not well formed | 15:21 |
rasca | panda|rover, I got just that error there, I'll investigate by myself in this case don't worry | 15:21 |
rasca | panda|rover, I was asking to understand just if I was missing something | 15:21 |
panda|rover | rasca: yeah probably the task taht makes generate override assumes that the basic variable exists. | 15:22 |
panda|rover | rasca: taht should be changed | 15:22 |
rasca | panda|rover, ack, will check and prepare a review thanks | 15:26 |
rlandy | rasca: https://softwarefactory-project.io/r/#/c/13210/ merged | 15:30 |
rlandy | ^^ officially part of rdo now | 15:30 |
rasca | rlandy++++++++++++++ | 15:31 |
rlandy | panda|rover: rfolco|ruck: weshay: there are a couple patch that could merge now - depending on how much risk we are willing to take ( one patch no risk). should I just transfer them all to myoung? or start bugging you guys for reviews to merge? | 15:32 |
rlandy | Also ... | 15:32 |
rlandy | panda|rover: rfolco|ruck: weshay: the fs053 is blocking my browbeat qual | 15:32 |
rlandy | should I work on the reproducer for that? | 15:32 |
rlandy | I can't merge my patches w/o confirmation I didn't break other OVB jobs | 15:33 |
panda|rover | rlandy: you mean fs035 ? | 15:34 |
rlandy | panda|rover: sorry - yes - fs035 - I am so used to typing fs053(browbeat) | 15:36 |
panda|rover | ah, ok the one failing introspection | 15:36 |
rlandy | panda|rover: I am stuck now | 15:36 |
rlandy | waiting to beg ruck/rover time for review and on browbeat qual | 15:36 |
rlandy | so I can help with reproducer for introspection | 15:37 |
rlandy | if you have not started yet | 15:37 |
panda|rover | rlandy: no, we are drowning right now | 15:37 |
panda|rover | rlandy: rcuk/rover review on what ? | 15:37 |
rlandy | panda|rover: so I should not help? | 15:37 |
rlandy | I know you are drowning | 15:37 |
rlandy | offering to help on the introspection investigation | 15:38 |
*** jfrancoa has quit IRC | 15:38 | |
rlandy | do you want me to work on that? | 15:38 |
panda|rover | rlandy: yes, please. "no" was referred to "have you started yet" | 15:38 |
rlandy | panda|rover: ack - on it | 15:38 |
*** dtrainor_ has joined #oooq | 15:41 | |
myoung | rlandy, marios, weshay, panda|rover: We just finished the Tempest squad's scrum. They have a few reviews on TQE that need attention from cores. They are tracked https://trello.com/c/Ble66eRY/431-list-of-upstream-reviews in the new list (for tempest). | 15:41 |
*** dtrainor has quit IRC | 15:41 | |
myoung | ^^ (aside: that card has some stale cruft I'll attend to, please just see the list dated for today) | 15:41 |
myoung | ^^ thx! | 15:41 |
panda|rover | myoung: reviewing | 15:42 |
rlandy | looking | 15:42 |
myoung | thx! | 15:43 |
*** wget19 has joined #oooq | 15:43 | |
rasca | hey folks, me and myoung are looking to this https://code.engineering.redhat.com/gerrit/#/c/145910/ which is *vital* to make the ha labs evolve in both rdophase2 and ospphase0 | 15:43 |
wget19 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 15:43 |
*** panda|rover sets mode: +b *!*@190.39.116.106 | 15:43 | |
*** wget19 was kicked by panda|rover (wget19) | 15:43 | |
myoung | rlandy: looking at your card/reviews for s17 now, have been with tempest folk in scrum | 15:43 |
* myoung reads the last hour of scrollback | 15:43 | |
rfolco|ruck | rlandy, I can make a new pass on your patches if they are +1 zuul, may I? | 15:43 |
rlandy | rfolco|ruck: please | 15:44 |
rasca | rlandy, weshay, myoung if you can give it an eye, it is less scary than it appears, it's just the naming convention that is changed and I've already tested these changes locally | 15:44 |
rlandy | rfolco|ruck: I am trading for ruck/rover time | 15:44 |
rlandy | working on introspection | 15:44 |
panda|rover | rlandy: the patches are in the card ? | 15:45 |
rfolco|ruck | rlandy, you rock! | 15:45 |
rfolco|ruck | and rover! | 15:45 |
panda|rover | rfolco|ruck: ruver | 15:45 |
*** kspencer23 has joined #oooq | 15:46 | |
kspencer23 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 15:46 |
*** panda|rover sets mode: +b *!*@p152169-ipngn200401sinnagasak.nagasaki.ocn.ne.jp | 15:46 | |
*** kspencer23 was kicked by panda|rover (kspencer23) | 15:46 | |
rfolco|ruck | :) | 15:47 |
myoung | rasca: ack, will have a look at https://code.engineering.redhat.com/gerrit/#/c/145910, what's the timeframe? are we stuck now or is this forward looking work? | 15:47 |
panda|rover | oh we are still missing the queens images ? | 15:48 |
rlandy | panda|rover: yep | 15:48 |
rlandy | the order is important | 15:48 |
rlandy | panda|rover: rfolco|ruck pointed out we should merged the nodeset, then the add tripleo-ci one then the job | 15:49 |
rlandy | the tripleo-ci one has IMPACT | 15:49 |
rlandy | maybe that should wait | 15:49 |
rasca | myoung, the time frame is ASAP, mostly for two reasons: 1) it will impact just ha-envs and so is totally non harmful 2) it will give me the base to convert baremetal undercloud jobs into virtual baremetal undercloud jobs | 15:49 |
rasca | (so we save hardware) | 15:49 |
* rlandy doesn;t want to cause more pain | 15:49 | |
rfolco|ruck | rlandy, we probably can get a revert patch ready for the 'tripleo-ci include: jobs' one. If something goes wrong, we just revert it quick. | 15:51 |
rlandy | rfolco|ruck: I think that patch should wait until CI calms down | 15:51 |
rlandy | otherwise you guys will have so many errors to deal with | 15:51 |
rfolco|ruck | CI never calms down | 15:51 |
rfolco|ruck | :) | 15:51 |
panda|rover | chandankumar: can you check if the failures in 577780 for featureset001 in pike and ocata are not caused by the patch ? | 15:51 |
rfolco|ruck | rlandy, agreed | 15:51 |
rlandy | I just want to leave it in mergeable shape | 15:52 |
panda|rover | chandankumar: in queens we have another problem unfortunately | 15:52 |
rlandy | ie: fix all comments you guys have | 15:52 |
rlandy | myoung: will meet with you in a bit - reviewing tempest changes as you asked atm | 15:52 |
chandankumar | panda|rover: checking | 15:53 |
rasca | panda|rover, so I think I found what is wrong here | 15:53 |
myoung | rlandy: no problem, i'm just diving into your stuff now, after a short break. been meetings/BJ thus far today for $allTheMinutes | 15:53 |
rasca | panda|rover, role generation happens on pre-deploy.yml, after create-scripts.yml, and in any case the problem is the overcloud_roles.yaml.j2 template which is just: {{ overcloud_roles | to_nice_yaml }} | 15:54 |
chandankumar | panda|rover: 2018-08-01 15:11:25.856371 | tripleo-ovb-centos-7 | fatal: [undercloud]: FAILED! => {"changed": true, "cmd": ["curl", "-sfL", "http://images.rdoproject.org/queens/rdo_trunk/a82e35575c4360bcb508cffc493abd4baa567711_bfcb4708/overcloud-full.tar.md5"], "delta": "0:00:00.266788", "end": "2018-08-01 15:11:25.837234", "msg": "non-zero return code", "rc": 22, "start": "2018-08-01 15:11:25.570446", | 15:55 |
chandankumar | "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | 15:55 |
chandankumar | 2018-08-01 15:11:25.887737 | tripleo-ovb-centos-7 | | 15:55 |
rasca | panda|rover, this means that you'll get an error when you don't define overcloud_roles because ansible process the template in any case despite the when condition is false | 15:55 |
chandankumar | panda|rover: it is not related to that patch | 15:55 |
rasca | panda|rover, so two solutions here: 1) workaround-ing the problem by declaring an empty overcloud_roles (but it sucks) | 15:55 |
rasca | panda|rover, 2) use {{ overcloud_roles | default('') | to_nice_yaml }} | 15:56 |
rasca | panda|rover, if we agree on 2) I'll prepare a review | 15:56 |
panda|rover | arxcruz: https://review.openstack.org/587844 what are the pike jobs that are running tempest there ? | 15:57 |
* myoung brb | 15:57 | |
rfolco|ruck | arxcruz, also want to know question above ^ | 15:57 |
rlandy | panda|rover: ^^ see my comment | 15:57 |
rlandy | only one | 15:57 |
rlandy | the multinode but arxcruz says he tested it in periodic | 15:58 |
rfolco|ruck | arxcruz, a link to a pike job in periodic please to +1 https://review.openstack.org/#/c/587844 | 15:58 |
panda|rover | rlandy: ah I see now thanks | 15:58 |
arxcruz | panda|rover: https://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset021-pike/dfe3ca1/logs/tempest.html.gz | 15:58 |
panda|rover | rfolco|ruck: look at rlandy's comment | 15:58 |
arxcruz | panda|rover: rfolco|ruck done on the comments | 15:58 |
rfolco|ruck | I just didn't find the log | 15:58 |
panda|rover | oh it's 21 | 15:59 |
panda|rover | ok | 15:59 |
arxcruz | panda|rover: rfolco|ruck: we have featureset021 running full tempest without skip list | 15:59 |
panda|rover | yep yep | 15:59 |
panda|rover | ok | 15:59 |
panda|rover | approving | 15:59 |
rfolco|ruck | the failure on test_implied_roles_create_check_show_delete is unrelated | 15:59 |
rfolco|ruck | correct ? | 15:59 |
arxcruz | sorry, i intent to point to this log and forgot to comment, didn't want to put on commit message because soon the logs might get deleted | 16:00 |
arxcruz | rfolco|ruck: this is still in the skip list, it's a bug and still opened | 16:00 |
rfolco|ruck | arxcruz, test: 'tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_implied_roles_create_check_show_delete' | 16:01 |
arxcruz | rfolco|ruck: yes, still on skip list | 16:01 |
rfolco|ruck | failed --> tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_implied_roles_create_check_show_delete | 16:01 |
arxcruz | rfolco|ruck: https://review.openstack.org/#/c/587844/1/roles/validate-tempest/vars/tempest_skip_pike.yml on line 17 | 16:01 |
rfolco|ruck | ignore me | 16:01 |
rfolco|ruck | lol | 16:01 |
panda|rover | rfolco|ruck: do you want kickban too ? | 16:02 |
rfolco|ruck | :( | 16:02 |
rfolco|ruck | panda|rover, With our IRC.. | 16:02 |
* rfolco|ruck wonders what are the magic words to get there.... I won't give it a try | 16:03 | |
arxcruz | shazam? | 16:04 |
arxcruz | :D | 16:04 |
* panda|rover has kicked arxcruz (exactly) | 16:04 | |
rfolco|ruck | lolz | 16:04 |
rfolco|ruck | ok focus panda|rover focus | 16:05 |
panda|rover | arxcruz: there's not much to verify that that patch is not breaking anything | 16:05 |
arxcruz | panda|rover: well, it's not breaking, mostly fs runs a small set of tempest so... | 16:06 |
panda|rover | is legacy-tripleo-ci-centos-7-containers-multinode-upgrades-pike-branch running any tempest ? | 16:06 |
panda|rover | arxcruz: or tripleo-ci-centos-7-containers-multinode-pike ? | 16:07 |
panda|rover | arxcruz: just want to be sure that we are not merging a skip list with errors in it. if no job are using or loading it, there's not much way to understand if the yaml is well formed for example | 16:08 |
arxcruz | panda|rover: I checked all the lp and bz opened for those tests, and all of them are in fix release, merged, fixed, etc status | 16:09 |
panda|rover | arxcruz: remember the indentation error on the other change ? That was almost impossible to detect by just looking at it | 16:09 |
rasca | panda|rover, I agreed with myself, https://review.openstack.org/588327 | 16:09 |
rasca | testing it right now | 16:09 |
panda|rover | rasca: sorry, I have just one brain. I asked for an upgrade to a dual brain, but it's not covereb by my insurance yet | 16:10 |
panda|rover | rasca: I agree with 2 | 16:11 |
panda|rover | arxcruz: don't know if you afree with me, no jobs ran on that patch execise the changes made in that patch. That's why is difficult to check it. Anyway approving | 16:13 |
arxcruz | panda|rover: thanks, i'll observe these jobs anyway for a while | 16:14 |
panda|rover | chandankumar: https://review.openstack.org/584368 I'm fraking out at the use of the {{ tag }} variable | 16:17 |
marios | ack myoung will check tomorrow ttyl | 16:17 |
chandankumar | panda|rover: earlier i used container_build_id which was not picked it leads to failure | 16:19 |
chandankumar | panda|rover: so switched to tag | 16:20 |
chandankumar | panda|rover: i donot know the best solution | 16:20 |
rasca | rlandy, please help! https://review.openstack.org/#/c/538952/ rebase conflict here, I know how to solve it but that table in the file (the featureset table) is a nightmare to manage via vim, do you know any other trick? | 16:20 |
panda|rover | We are not adding any test to really check that these job are behaving correctly right ? e.g. they are doing what they're supposed to do. | 16:21 |
*** vinaykns has quit IRC | 16:21 | |
rlandy | rasca: I know that is a rebase night mare - I will deal with it later today | 16:22 |
rlandy | I have done it a bunch of times before | 16:23 |
rasca | rlandy, I'm doing it no worries | 16:23 |
rasca | rlandy, https://review.openstack.org/538952 YES WE CAN | 16:25 |
myoung | marios: ack | 16:26 |
*** myoung is now known as myoung|foods | 16:26 | |
rlandy | panda|rover: rfolco|ruck: introspection reproducer is in progress - back in a few to look at results | 16:28 |
*** rlandy is now known as rlandy|brb | 16:28 | |
rfolco|ruck | rlandy|brb, thx | 16:29 |
*** amoralej is now known as amoralej|off | 16:31 | |
*** waleedm has joined #oooq | 16:32 | |
*** amoralej_ has quit IRC | 16:32 | |
weshay | panda|rover, omg.. that was an interesting mtg | 16:34 |
weshay | er.. morning | 16:34 |
panda|rover | rfolco|ruck: weshay I'm still not accustomed to the Irish Holidays. Monday is holiday here. I'm alone, at home. I'll probably work, but if I don't show up, you know why | 16:34 |
panda|rover | one excludes the other | 16:34 |
*** zoli is now known as zoli|gone | 16:35 | |
*** zoli|gone is now known as zoli | 16:35 | |
weshay | panda|rover, do we need to sync re: ua/pm for the cards | 16:35 |
panda|rover | weshay: it depends, we are cutting the work to just two cards. BASH variable sand RDO cleanup | 16:35 |
rfolco|ruck | panda|rover, ack | 16:35 |
weshay | panda|rover, is the board updated? /me looks | 16:36 |
panda|rover | I just wanted to confirm it with you | 16:36 |
weshay | panda|rover, ok.. let's jump on blue | 16:36 |
panda|rover | if yes, we need to ensure DOD is there, and test plan too | 16:36 |
*** TheMesquito9 has joined #oooq | 16:37 | |
TheMesquito9 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 16:37 |
*** panda|rover sets mode: +b *!*@94.126.3.155 | 16:37 | |
*** TheMesquito9 was kicked by panda|rover (TheMesquito9) | 16:37 | |
*** saneax has quit IRC | 16:38 | |
*** ibiza12 has joined #oooq | 16:39 | |
ibiza12 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 16:39 |
*** panda|rover sets mode: +b *!*@ntfkok024181.fkok.nt.ngn2.ppp.infoweb.ne.jp | 16:39 | |
*** ibiza12 was kicked by panda|rover (ibiza12) | 16:39 | |
hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ (2 more messages) | 16:40 |
*** tosky has quit IRC | 16:41 | |
*** dtantsur is now known as dtantsur|afk | 16:46 | |
*** Sitri26 has joined #oooq | 16:53 | |
Sitri26 | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 16:53 |
*** panda|rover sets mode: +b *!*@190-201-164-233.dyn.dsl.cantv.net | 16:53 | |
*** Sitri26 was kicked by panda|rover (Sitri26) | 16:53 | |
*** apetrich has joined #oooq | 16:54 | |
*** aphel has joined #oooq | 16:59 | |
aphel | With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ | 16:59 |
*** panda|rover sets mode: +b *!*@109.86.118.154 | 16:59 | |
*** aphel was kicked by panda|rover (aphel) | 16:59 | |
*** rlandy|brb is now known as rlandy | 17:02 | |
*** vinaykns has joined #oooq | 17:05 | |
*** apetrich has quit IRC | 17:07 | |
*** apetrich has joined #oooq | 17:08 | |
weshay | panda|rover, https://review.openstack.org/#/c/584508/24 | 17:10 |
*** waleedm has quit IRC | 17:19 | |
*** myoung|foods is now known as myoung | 17:24 | |
panda|rover | rlandy: to get the instrospection error you need to watch the console of the baremetal nodes ... | 17:35 |
rlandy | panda|rover: in progress now | 17:35 |
rlandy | watching the consoles | 17:35 |
panda|rover | rlandy: ok thanks. | 17:35 |
rlandy | panda|rover: no dice - introspection passed ... 4 node(s) successfully moved to the "available" state. | 17:41 |
panda|rover | rlandy: of course | 17:42 |
panda|rover | :( | 17:42 |
rlandy | panda|rover: deploying the overcloud now | 17:42 |
rlandy | I can stop it | 17:42 |
rlandy | weshay claims we can run introspection over again and it will fail | 17:42 |
rlandy | weshay: ^^, true? | 17:42 |
weshay | ya... go for it.. not sure if it will fail, but it's worth trying | 17:43 |
rlandy | k, killing deploy | 17:43 |
rlandy | oh if only it were that easy | 17:44 |
rlandy | die, you deploy, die | 17:44 |
myoung | could we make a fake job that just runs introspection in a loop n times? | 17:46 |
myoung | a hack, but just to force a reproduce? would also give us hard frequency/recurrence data without incurring full job time / iteration penalty+cost | 17:46 |
panda|rover | rlandy: ahah | 17:47 |
rlandy | panda|rover: I just went nuclear kill -9 | 17:48 |
panda|rover | rlandy: can you join weshay blue ? | 17:50 |
rlandy | yeah - one sec - rekicking | 17:50 |
agopi | rlandy, how can i trigger featureset 53 ? | 18:04 |
rfolco|ruck | rlandy, +1 in all patches except https://review.openstack.org/#/c/587828/, running post-run twice for all jobs | 18:05 |
rfolco|ruck | rlandy, lets merge 1) nodeset 2) fqdn (needs fixing) | 18:06 |
rfolco|ruck | then we make final pass on the other patches with Paul | 18:06 |
* myoung is looking at those now | 18:07 | |
*** holser_ has quit IRC | 18:08 | |
rlandy | https://review.rdoproject.org/r/#/c/15074/ | 18:31 |
rlandy | https://softwarefactory-project.io/r/#/c/13256/5/zuul/rdo.yaml | 18:32 |
rlandy | https://github.com/openstack/tripleo-common/blob/master/workbooks/baremetal.yaml#L50 | 18:33 |
rlandy | 2018-08-02 14:41:29 | + openstack overcloud node import instackenv.json | 18:33 |
rlandy | 2018-08-02 14:41:40 | Waiting for messages on queue 'tripleo' with no timeout. | 18:33 |
rlandy | 2018-08-02 14:46:31 | Exception registering nodes: | 18:33 |
rlandy | 2018-08-02 17:29:49 | + openstack overcloud node import instackenv.json | 18:34 |
rlandy | 2018-08-02 17:29:57 | Waiting for messages on queue 'tripleo' with no timeout. | 18:34 |
rlandy | 2018-08-02 17:30:32 | | 18:34 |
rlandy | 2018-08-02 17:30:32 | | 18:34 |
rlandy | 2018-08-02 17:30:32 | 4 node(s) successfully moved to the "manageable" state. | 18:34 |
hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, tripleo-ci- (2 more messages) | 18:40 |
rlandy | rfolco|ruck: thanks for your review - will correct in a bit - working on introspection error | 18:41 |
rfolco|ruck | rlandy, this means you fixed introspection or could not reproduce? | 18:42 |
rlandy | rfolco|ruck; could not reproduce - trying to narrow the debug down | 18:42 |
*** tcw has quit IRC | 18:53 | |
*** tcw has joined #oooq | 18:53 | |
myoung | rlandy: went thru reviews and have loaded context. have a few questions but can chat for a bit whenever you're free | 18:55 |
rlandy | myoung: need sometime on the introspection stuff | 18:56 |
rlandy | will ping you in a bit | 18:56 |
myoung | rlandy: no rush, ack | 18:57 |
*** tesseract has quit IRC | 19:06 | |
*** links has joined #oooq | 19:08 | |
rlandy | panda|rover: weshay: we don;t collect /var/log/ironic?? | 19:08 |
rlandy | or /var/log/ironic-inspector:( | 19:09 |
*** links has quit IRC | 19:09 | |
*** links has joined #oooq | 19:10 | |
*** waleedm has joined #oooq | 19:17 | |
rlandy | panda|rover: look familar? https://bugs.launchpad.net/nova/+bug/1291991 | 19:19 |
openstack | Launchpad bug 1291991 in Ironic "ipmi cmds run too fast, cause BMC to run out of resources" [High,Fix released] - Assigned to Devananda van der Veen (devananda) | 19:19 |
weshay | rlandy, we should | 19:21 |
weshay | rlandy, which log? | 19:22 |
rlandy | weshay: both - I'll put in patch when I am done here | 19:22 |
rlandy | just surprised | 19:22 |
weshay | rlandy, weird.. that bug is from 2014 | 19:22 |
weshay | rlandy, https://logs.rdoproject.org/21/583321/9/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/d029245/logs/undercloud/var/log/containers/ironic-inspector/ | 19:23 |
weshay | I do that from time to time.. forget about containers ;) | 19:23 |
weshay | https://logs.rdoproject.org/21/583321/9/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/d029245/logs/undercloud/var/log/containers/ironic/ironic-conductor.log.txt.gz | 19:24 |
rlandy | weshay: ah - makes sense - thank you | 19:25 |
rlandy | weshay: the bug is old | 19:25 |
rlandy | but it was never fixed | 19:25 |
rlandy | according to dna sneddon | 19:25 |
weshay | true | 19:25 |
rlandy | dan | 19:25 |
rlandy | I think we may have hit it again | 19:25 |
rlandy | and the sporadic nature matches | 19:25 |
* rlandy is checking the logs more | 19:26 | |
rlandy | Error: IPMI call failed: power status.: IPMIFailure: IPMI call failed: power status. | 19:27 |
rlandy | weshay: panda|rover: my take on this is that we never really fixed https://bugs.launchpad.net/nova/+bug/1291991 - and it shows up now - every so often - just enough to give us serious problems | 19:29 |
openstack | Launchpad bug 1291991 in Ironic "ipmi cmds run too fast, cause BMC to run out of resources" [High,Fix released] - Assigned to Devananda van der Veen (devananda) | 19:29 |
rlandy | I can narrow the when the call happens in the workflow | 19:29 |
weshay | rlandy, our jobs are failing almost 70% of the time though | 19:30 |
weshay | rlandy, http://cistatus.tripleo.org/ --> legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master | 19:30 |
rlandy | weshay: and the other 30%? | 19:32 |
rlandy | I wonder if we increase the size/resources of the bmc node if we would do better? | 19:33 |
*** atoth has quit IRC | 19:33 | |
weshay | rlandy, hrm | 19:34 |
weshay | can I show you something on blue? | 19:34 |
rlandy | sure | 19:34 |
*** atoth has joined #oooq | 19:36 | |
rlandy | weshay: https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/te-broker/create-env#L50 | 19:44 |
*** apetrich has quit IRC | 19:47 | |
weshay | rlandy, should we also restart the te_broker service? | 19:52 |
rlandy | idk | 19:53 |
rlandy | but the change will definitely need to go on the te-broker | 19:53 |
rlandy | I am putting in a gerrit change | 19:53 |
rlandy | because we will need that eventually | 19:53 |
rlandy | if you are feeling brave we can try it | 19:53 |
rlandy | weshay: https://review.openstack.org/#/c/588366/ | 19:56 |
rlandy | weshay: let me know if you are ready to try the change | 19:56 |
rlandy | I think we may need to restart | 19:56 |
rlandy | panda|rover: ^^ do you know? | 19:56 |
weshay | rlandy, http://paste.openstack.org/show/727175/ | 19:57 |
weshay | rlandy, meh.. fixed it | 19:58 |
*** dtrainor_ has quit IRC | 19:59 | |
rlandy | ok | 19:59 |
weshay | the log rotation | 19:59 |
rlandy | because I had no idea | 19:59 |
weshay | rlandy, btw.. shevta and aziza say hi | 19:59 |
rlandy | weshay: wow - that's been a while | 19:59 |
weshay | marios, ^ | 19:59 |
weshay | rlandy, chandankumar knows them | 19:59 |
*** zul has quit IRC | 20:01 | |
*** ledo_ has joined #oooq | 20:03 | |
*** waleedm has quit IRC | 20:06 | |
rlandy | weshay: thoughts on editing the te-broker now? need to meet with myoung in a bit | 20:07 |
*** ledo_ has quit IRC | 20:11 | |
*** ledo_ has joined #oooq | 20:11 | |
weshay | rlandy, let's do it | 20:14 |
weshay | + sed -i -e 's/bmc_flavor:.*/bmc_flavor: ci.m1.small/' env-13659-base.yaml | 20:14 |
rlandy | so it didn;t work? | 20:21 |
* rlandy logs on to te-broker | 20:21 | |
weshay | rlandy, the review did not | 20:21 |
rlandy | I don;t expect the gerrit review to work | 20:21 |
rlandy | we need that if the manual edit works | 20:22 |
rlandy | weshay: question I am asking is if we want to try the manual edit | 20:22 |
weshay | rlandy, ack.. yes let's edit manually | 20:23 |
rlandy | weshay: ok - you're still on te-broker? logging on now | 20:24 |
rlandy | actually checking flavor status | 20:25 |
weshay | rlandy, hrm | 20:25 |
rlandy | will go from 1 to 2 vcpus | 20:26 |
weshay | rlandy, http://paste.openstack.org/show/727177/ | 20:26 |
weshay | rlandy, k | 20:26 |
rlandy | Aug 02 20:07:14 te-broker.rdocloud start_workers.sh[6919]: keystoneauth1.exceptions.catalog.EndpointNotFound: Could not find requested endpoint in Service Catalog. | 20:26 |
rlandy | ^^ after the edit? | 20:26 |
weshay | no | 20:26 |
weshay | not sure.. | 20:26 |
weshay | is the edit done | 20:27 |
rlandy | not yet | 20:27 |
weshay | rlandy, let me restart | 20:27 |
weshay | prior to save? | 20:27 |
weshay | rlandy, tmux? | 20:27 |
rlandy | yeah - better | 20:27 |
weshay | k tmux a | 20:28 |
weshay | rlandy, you in? | 20:28 |
weshay | rlandy, w/ root | 20:29 |
rlandy | ok - in now | 20:29 |
weshay | don't see u | 20:29 |
weshay | rlandy, ^ | 20:30 |
rlandy | I am on | 20:30 |
rlandy | 0:root@te-broker:/opt/stack/tripleo-ci/scripts/te-broker* | 20:30 |
rlandy | tmux | 20:30 |
weshay | rlandy, type something | 20:30 |
rlandy | see me? | 20:31 |
weshay | no | 20:31 |
rlandy | let me bj screenshare | 20:31 |
rlandy | I see you | 20:31 |
rlandy | weshay: I haven't made the edit yet | 20:32 |
*** tcw1 has joined #oooq | 20:38 | |
*** tcw has quit IRC | 20:38 | |
weshay | rlandy, http://38.145.34.41/testenv-worker.log | 20:39 |
hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata, (2 more messages) | 20:40 |
weshay | rlandy, not sure why new jobs are not kicking | 20:40 |
rlandy | oops | 20:40 |
rlandy | maybe messed up? | 20:40 |
rlandy | https://review.rdoproject.org/zuul/stream.html?uuid=0c655c6ce4094a389cb2d44dd0cac355&logfile=console.log | 20:41 |
rlandy | ^^ working | 20:41 |
*** dtrainor has joined #oooq | 20:41 | |
agopi | can anyone please help me understand this error https://review.rdoproject.org/zuul/stream.html?uuid=4419ed952a3d492cb571ba92fcd3433c&logfile=console.log | 20:42 |
weshay | rlandy, it's working? | 20:42 |
weshay | rlandy, guess we'll see when it hits get_env | 20:43 |
rlandy | idk yet | 20:43 |
rlandy | RuntimeError: Found different numbers of baremetal and bmc ports. bmc: | 20:46 |
rlandy | weshay: ^^ | 20:46 |
weshay | ya | 20:46 |
rlandy | weshay: reverting, ok? | 20:47 |
*** links has quit IRC | 20:47 | |
weshay | rlandy, hrm.. you think it's the flavor? | 20:48 |
weshay | or restart | 20:48 |
rlandy | idk | 20:48 |
rlandy | I think its the flavor | 20:48 |
myoung | rlandy: want tosync tomorrow? i need to go shortly, left some questions/comments in gerrit and summarized here: https://trello.com/c/TVsZ3Ut6/877-clean-up-rdo-sf-legacy-code-after-zuulv3-migration#comment-5b634a3321e0d14c5f7781b8 | 20:48 |
rlandy | I kick this after restart | 20:48 |
rlandy | myoung: ack - will sync tomorrow | 20:48 |
myoung | rlandy: ok thx | 20:48 |
rlandy | weshay: ok to revert now? | 20:49 |
weshay | rlandy, I think it's working | 20:49 |
rlandy | what?? | 20:49 |
weshay | rlandy, 2018-08-02 20:48:52,647 - testenv-worker-6 - INFO - Received job : {"callback_name": "callback_90f033002b2f432e8ce2871e7695711c", "extra_nodes": "0", "envsize": "4", "timeout": "10200", "create_undercloud": "", "job_identifier": "588366: ovb-3ctlr_1comp-featureset001", "compute_envsize": "0", "net_iso": "multi-nic", "ssh_key": "", "ucinstance": "226e71f3-a281-4341-96a6-9853827e28bc"} | 20:49 |
rlandy | https://review.rdoproject.org/zuul/stream.html?uuid=65a7aa4c2af24f179b5f04b00860414a&logfile=console.log ok - this worked | 20:50 |
*** tosky has joined #oooq | 20:50 | |
weshay | https://review.rdoproject.org/zuul/stream.html?uuid=65a7aa4c2af24f179b5f04b00860414a&logfile=console.log | 20:50 |
weshay | rlandy, ya.. I think we're good | 20:51 |
* rlandy breathes again | 20:52 | |
rlandy | weshay: ok - let's see how we go ... the change will revert itself at 12 or whenever the resync happens | 20:52 |
weshay | rlandy++ | 20:53 |
hubbot | weshay: rlandy's karma is now 20 | 20:53 |
rlandy | weshay: you're too hasty - I could be wrong about this | 20:53 |
weshay | rlandy, oh ya. I know | 20:53 |
weshay | rlandy, just happy things are provisioning | 20:53 |
rlandy | yeah | 20:53 |
weshay | and it was a good idea / lead | 20:53 |
weshay | to pursue | 20:53 |
*** Goneri has quit IRC | 20:56 | |
*** waleedm has joined #oooq | 21:05 | |
*** ledo_ has quit IRC | 21:06 | |
*** waleedm has quit IRC | 21:07 | |
*** rfolco|ruck is now known as rfolco|off | 21:15 | |
rlandy | weshay: negative | 21:47 |
rlandy | failure | 21:47 |
rlandy | the change we made will revert itself | 21:47 |
rlandy | or we can | 21:47 |
weshay | rlandy, same error? | 21:57 |
rlandy | weshay: ack | 21:57 |
rlandy | unfortunately | 21:57 |
rlandy | I'll think more on the problem | 21:57 |
rlandy | weshay: want to revert our change? | 21:58 |
rlandy | or leave it? | 21:58 |
weshay | I guess revert it | 21:58 |
rlandy | ok | 21:59 |
rlandy | weshay: tmux is still open | 21:59 |
rlandy | working there | 21:59 |
rlandy | weshay; change made - restarting | 22:01 |
rlandy | ok - damage reverted | 22:02 |
*** holser_ has joined #oooq | 22:03 | |
*** vinaykns has quit IRC | 22:06 | |
weshay | rlandy, so the other lead | 22:07 |
weshay | is that fs20 is passing in master | 22:07 |
weshay | where fs001 is not | 22:07 |
*** Goneri has joined #oooq | 22:08 | |
*** Goneri has quit IRC | 22:13 | |
*** dtrainor has quit IRC | 22:23 | |
hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata, (2 more messages) | 22:40 |
*** jtomasek_ has joined #oooq | 22:45 | |
*** jtomasek-tmp has quit IRC | 22:46 | |
rlandy | hmmm ... will check that | 22:50 |
*** rlandy is now known as rlandy|bbl | 22:50 | |
*** tcw has joined #oooq | 22:51 | |
*** holser_ has quit IRC | 22:52 | |
weshay | rfolco|off, fyi https://bugs.launchpad.net/tripleo/+bug/1784847 | 22:53 |
openstack | Launchpad bug 1784847 in tripleo "exception introspecting nodes" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 22:53 |
*** tcw1 has quit IRC | 22:53 | |
*** dtrainor has joined #oooq | 22:54 | |
*** tosky has quit IRC | 22:59 | |
*** zul has joined #oooq | 23:26 | |
*** chuck_ has joined #oooq | 23:58 | |
*** zul has quit IRC | 23:58 | |
*** chuck_ has quit IRC | 23:58 | |
*** zul has joined #oooq | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!