Tuesday, 2018-08-07

hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @  (2 more messages)00:42
weshayade_lee, yup.. it's blocked from internal rh firewalls01:41
weshayade_lee, you installing tripleo or osp01:42
weshay?01:42
*** yolanda has quit IRC02:03
*** myoung|bbl is now known as myoung02:07
*** skramaja has joined #oooq02:36
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch, legacy-tripleo-ci- (2 more messages)02:42
*** saneax has joined #oooq03:41
*** udesale has joined #oooq03:48
*** ykarel has joined #oooq04:35
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb- (1 more message)04:42
*** ratailor has joined #oooq05:11
ykarelOkk Good so finally we are having promotion05:14
ykarelweshay++05:14
hubbotykarel: weshay's karma is now 805:14
*** jaosorior has quit IRC05:26
*** anande has joined #oooq05:37
*** anande has quit IRC05:38
*** anande has joined #oooq05:39
*** apetrich has joined #oooq06:01
*** jaosorior has joined #oooq06:05
*** holser_ has joined #oooq06:06
*** holser_ has quit IRC06:11
*** quiquell has joined #oooq06:21
*** jfrancoa has joined #oooq06:31
*** anande has quit IRC06:32
*** anande has joined #oooq06:40
*** yolanda has joined #oooq06:40
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb- (1 more message)06:42
quiquellmarios, ssbarnea: Did we have the scrum meeting yesterday ?06:51
*** saneax has quit IRC06:53
*** gkadam has joined #oooq07:04
*** amoralej|off is now known as amoralej07:08
mariosquiquell: /me shrugs donno mate07:18
quiquellmarios: ack07:19
*** anande has quit IRC07:31
*** anande has joined #oooq07:32
*** anande_ has joined #oooq07:34
*** anande has quit IRC07:37
*** tosky has joined #oooq07:42
*** ykarel is now known as ykarel|lunch07:43
*** holser_ has joined #oooq07:48
*** jaosorior has quit IRC07:49
*** saneax has joined #oooq07:52
*** apetrich has quit IRC07:56
*** anande_ has quit IRC08:01
*** jaosorior has joined #oooq08:02
*** kopecmartin has joined #oooq08:03
*** anande_ has joined #oooq08:13
*** bogdando has joined #oooq08:30
*** panda|rover-ish is now known as panda|rover08:33
panda|roverquiquell: no, we talked about OVB problems08:34
quiquellpanda|rover: ack08:34
*** ykarel|lunch is now known as ykarel08:35
ykarelmaster promoted !!!08:35
quiquellpanda|rover: Do we want to try to merge something for the sprint, or there are too much issues around ?08:36
*** ChanServ sets mode: +o arxcruz08:36
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-quickstart-extras-gate-newton-delorean-full-minimal, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch @  (1 more message)08:42
ssbarneaquiquell: nope, no meeting as far as I know. btw, if anyone needs help with a review just ping me here.08:50
*** chem has quit IRC08:58
panda|roverquiquell: we are in a good spot, shoot09:00
quiquellpanda|rover: Maybe we can try to land the folco's changes at least, my last day before PTO is friday09:01
quiquellpanda|rover: leftovers https://review.openstack.org/#/c/584465/09:01
quiquellpanda|rover: tags https://review.openstack.org/#/c/584508/09:02
quiquellthat are the two09:02
*** jaosorior has quit IRC09:02
quiquelldamn... yesterday they were passing today after rebasing they fail http://logs.openstack.org/65/584465/22/check/tripleo-ci-centos-7-undercloud-containers/b4def60/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-08-07_08_26_3909:04
quiquell:-(((09:04
quiquellLooks unrelated09:04
*** anande__ has joined #oooq09:06
*** anande_ has quit IRC09:07
*** anande__ has quit IRC09:08
quiquellpanda|rover: Do you have some bj time ?09:11
panda|roverquiquell: sure09:18
quiquellpanda|rover: Thanks, will be quick09:20
quiquellpanda|rover: Ups sorry, need some time, there are noise around now09:21
panda|roverquiquell: no rush, I'm listening to Junip.09:25
quiquellJunip ?09:26
panda|roverquiquell: https://en.wikipedia.org/wiki/Junip09:28
ssbarneasome +2/+W if possible on https://review.openstack.org/#/c/585487/ ?09:28
quiquellssbarnea: Did my best :-)09:29
quiquellpanda|rover: Going to your bj room now09:29
*** zoli is now known as zoli|lunch09:34
holser_Does anyone work on stable/queens CI jobs?09:36
*** chem has joined #oooq09:44
*** saneax has quit IRC09:48
*** saneax has joined #oooq09:48
*** jfrancoa has quit IRC10:00
*** jfrancoa has joined #oooq10:01
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb- (1 more message)10:42
*** jaosorior has joined #oooq10:46
*** zoli|lunch is now known as zoli10:53
*** holser_ has quit IRC11:01
*** udesale has quit IRC11:15
panda|roverquiquell: sorry, pressed the wrong button11:18
panda|roverbut anyway11:18
panda|rovergoing for lunch11:18
*** panda|rover is now known as panda|rover|lunc11:18
quiquellpanda|rover|lunc:  no problem, my last question was just if it make sense to merge this four reviews before going forward11:19
quiquellpanda|rover|lunc: And try to deliver them together, because the merge is another task on itself11:19
quiquellpanda|rover|lunc: And they are working fine by itself11:19
panda|rover|luncquiquell: yes, I think it's a good idea11:25
quiquellpanda|rover|lunc: Going to do the fixes you told me and merge them, and I will focus the rest of the week on that11:26
quiquellpanda|rover|lunc: Thanks soooo much11:26
ykarelpanda|rover|lunc, rfolco|ruck is the issue with fs016 queens promotion job being tracked somewhere?11:34
*** bogdando has quit IRC11:35
ykarelit's failing since 2nd https://review.rdoproject.org/zuul/builds.html?job_name=legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-queens11:38
*** apetrich has joined #oooq11:53
*** zul has joined #oooq11:54
*** jaosorior has quit IRC11:59
*** ratailor has quit IRC12:05
rfolco|ruckykarel, looking12:08
weshaypanda|rover|lunc, rfolco|ruck morning12:11
weshaypanda|rover|lunc, rfolco|ruck of course jenkins is acting up :)12:13
weshayhttps://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/a%20multijob%20perspective/job/rdo-promote-master-rdo_trunk/urltriggerPollLog/12:13
* weshay kicked build12:14
*** amoralej is now known as amoralej|lunch12:15
rfolco|ruckykarel, I am confused on what is the error... http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-queens/9ce7cd5/logs/undercloud/var/log/extra/errors.txt.gz12:15
*** panda|rover|lunc is now known as panda|rover12:16
weshayrfolco|ruck, panda|rover is this a pattern in ovb?12:18
weshay2018-08-07 08:58:55 |     ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 9a006986-5f85-499f-acf9-9201d6a8a78b aborted: Failure prepping block device., Code: 500"12:18
*** jaosorior has joined #oooq12:19
panda|roverweshay: first time I see this12:22
panda|roverrfolco|ruck: when do you want to switch ?12:22
ykarelrfolco|ruck, i think actual error is https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-queens/9ce7cd5/logs/subnode-2/var/log/extra/docker/containers/gnocchi_db_sync/stdout.log.txt.gz12:22
weshaypanda|rover, rfolco|ruck oh crud .. what happened upstream?12:24
weshay18 gate fails12:24
rfolco|ruckpanda|rover, today at the end of the day... ok for you ?12:24
panda|roverrfolco|ruck: fine12:26
*** jaosorior has quit IRC12:27
panda|roverweshay: I see delorean failures: Could not import extension openstackdocstheme (exception: No module named openstackdocstheme)12:29
quiquellpanda|rover: all-in-one https://review.openstack.org/#/c/589448/12:31
quiquellpanda|rover: Let's continue there12:31
panda|roverquiquell: hold on12:32
quiquellpanda|rover: we don't want to merge them ?12:33
quiquellpanda|rover: I mean make a review with them merged12:33
ykarelweshay, panda|rover openstackdocstheme not fixed after https://review.rdoproject.org/r/#/c/15215/?12:36
ykarelis it still occuring?12:36
quiquellpanda|rover: no problem, we have the other reviews too we can dicide12:37
*** holser_ has joined #oooq12:37
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb- (1 more message)12:42
*** jaosorior has joined #oooq12:42
panda|roverykarel: I'm seeing this only in jobs from yesterday, so maybe it's fixed12:48
*** sdoran_ has joined #oooq12:49
*** sdoran has quit IRC12:50
*** jschlueter has quit IRC12:50
*** pliu has quit IRC12:50
*** weshay has quit IRC12:50
*** sdoran_ is now known as sdoran12:50
*** marios has quit IRC12:51
ykarelpanda|rover, fs016?12:51
holser_https://logs.rdoproject.org/20/576520/6/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens/ed38887/job-output.txt.gz#_2018-08-07_09_48_12_65171212:51
panda|roverykarel: no, other fs as well12:52
ykarelpanda|rover, okk u were talking about that docstheme BR, got it12:52
*** bogdando has joined #oooq12:53
rfolco|ruckykarel, errors in errors.txt come first, 08:40:45... while gnocchi errors happen at 09:33:49, how do you know gnocchi is the root cause and not a side effect ?12:56
*** ccamacho has quit IRC12:58
*** jschlueter has joined #oooq12:59
ykarelholser_, this is side effect of false promotion, panda|rover i remember u said u will add the image on image server13:00
panda|roverykarel: I did13:00
ykarelpanda|rover, ohh but still issue is there13:00
panda|roverykarel: I copied a triepleo-ci-testing13:00
panda|roverinto queens13:01
panda|rovermmmh13:01
holser_panda|rover - I don't see proper hash in https://images.rdoproject.org/queens/rdo_trunk/13:01
ykarelhttps://images.rdoproject.org/queens/rdo_trunk/a82e35575c4360bcb508cffc493abd4baa567711_bfcb470813:01
ykarelwe need ^^13:01
panda|roveroh because they need that hash specifically13:01
panda|roverok, I'll crete that too13:01
holser_panda|rover thanks13:03
ykarelrfolco|ruck, so the issue appeared in overcloud deployment at step 5 which was after 9:23, so i said gnocchi seems to be the possible cause,13:05
ykarelnot the errors on undercloud13:05
*** skramaja has quit IRC13:08
rfolco|ruckykarel, so the errors seen in http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-queens/9ce7cd5/logs/undercloud/var/log/extra/errors.txt.gz13:10
rfolco|ruckare just noise ?13:10
ykarelrfolco|ruck, possibly as seeing their time13:11
rfolco|ruckykarel, ok just to understand how you identify in your head possible root causes, thx13:12
*** trown|outtypewww is now known as trown13:12
*** ade_lee has quit IRC13:13
*** weshay has joined #oooq13:19
weshayquiquell, did you get +2 on ci-config?13:19
quiquellweshay: Have not checked it13:20
quiquellweshay: Yep, it's there13:20
*** ykarel is now known as ykarel|away13:21
weshayrock on13:21
quiquellweshay: Thanks !!!13:21
quiquellweshay: Let's break stuff :-)13:21
quiquellweshay: What projects do I have +2 on at RDO ?13:21
ykarel|awayrfolco|ruck, when not find anything in errors.txt , checked journalctl on overcloud13:21
ykarel|awayrfolco|ruck, and there it was gnocchi_db_sync running at step 5, to move forward and confirm it's the actual cause, good to compare the last passing and 1st failing13:22
* ykarel|away need to leave13:26
*** ccamacho has joined #oooq13:28
rfolco|ruckykarel|away, thank you13:29
rfolco|rucktake care13:29
*** ykarel|away has quit IRC13:31
*** amoralej|lunch is now known as amoralej13:32
panda|roverholser_: try again13:36
*** holser_ has quit IRC13:37
weshaypanda|rover, rfolco|ruck queeens is failing on https://logs.rdoproject.org/24/567224/78/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens/6632f3c/job-output.txt.gz#_2018-08-07_09_31_41_60041713:37
*** holser__ has joined #oooq13:37
weshaypanda|rover, https://review.openstack.org/#/c/587880/13:37
weshayfak, it didn't help13:38
weshayhttps://logs.rdoproject.org/80/587880/1/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch/e40ceea/job-output.txt.gz#_2018-08-01_17_08_24_07567613:38
amoralejhi13:38
rfolco|ruckhmm for queens I filed this bug weshay https://bugs.launchpad.net/tripleo/+bug/1785820 <-- fs016 queens: Unable to initialize storage driver13:39
openstackLaunchpad bug 1785820 in tripleo "fs016 queens: Unable to initialize storage driver" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)13:39
amoraleji'm having problems with container preparation in oooq jobs in rdoinfo13:39
amoralej"http://mirror.centos.org/$contentdir/7/storage/x86_64/ceph-luminous/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found"13:39
amoralejhttp://logs.rdoproject.org/36/15236/4/check/legacy-rdoinfo-tripleo-master-testing-centos-7-multinode-1ctlr-featureset016/0dae859/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz13:39
amoralejare you having similar issue?13:39
rfolco|ruckamoralej, hmm looks like see bug above13:39
myoungo/13:40
rfolco|ruckoh master...13:40
myounggood morning13:40
rfolco|ruckamoralej, not sure though, that bug is for fs16 queens13:40
panda|roverweshay: we were missing the hash again, I only linked curent-tripleo13:41
weshaypanda|rover, the hash is there13:41
amoralejrfolco|ruck, which one?13:41
amoralejcan i check logs?13:41
weshaypanda|rover, I was missing error code 2213:41
weshayfor the retry13:41
weshayI thought it was negative13:41
rfolco|ruckamoralej, for queens fs016, the cause seems to be gnocchi... https://bugs.launchpad.net/tripleo/+bug/1785820 <-- fs016 queens: Unable to initialize storage driver13:42
openstackLaunchpad bug 1785820 in tripleo "fs016 queens: Unable to initialize storage driver" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)13:42
panda|roverweshay: we have a82e35575c4360bcb508cffc493abd4baa567711_bfcb4708 since 10 minutes13:42
weshayoh13:42
weshaylolz13:42
weshaypanda|rover, cloud outtage again?13:42
panda|roverweshay: because Ilinked current-tripleo, but not the hash, now a82e35575c4360bcb508cffc493abd4baa567711_bfcb4708 points to one of the previous tripleo-ci-testing images we had13:42
weshayodd it says 8-0313:43
weshayah k13:43
weshaypanda|rover, I think that is safe to merge13:44
*** quiquell is now known as quiquell|off13:47
*** quiquell|off has quit IRC13:51
myoungrfolco|ruck, panda|rover: please add any additional notes / items to https://etherpad.openstack.org/p/tripleo-ci-squad-meeting @L33 for weekly CI squad status13:52
myoungCI Squad: Please add any items we have for the community meeting (after #tripleo meeting starting shortly) --> https://etherpad.openstack.org/p/tripleo-ci-squad-meeting13:53
myoung^^ (if any)13:53
myoung(meeting room will be open during #tripleo meeting as well if folks are chatty or want an open hallway/door)13:57
*** vinaykns has joined #oooq14:02
*** vinaykns has left #oooq14:02
*** vinaykns has joined #oooq14:02
*** Tengu has joined #oooq14:08
Tenguhello! I think there's a small issue with the CI for the tripleo-ci-centos-7-containerized-undercloud-upgrades job - are you already aware of that?14:09
*** jrist has quit IRC14:15
weshayrfolco|ruck, panda|rover ^^ for Tengu14:16
vinayknsHello channel what does it mean by vip...currently my api endpoint ssl doesn't match with vip address.14:16
vinayknshow to resolve this issue.14:17
panda|roverTengu: what's the problem ?14:18
Tengupanda|rover: I get http://logs.openstack.org/85/586285/5/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/e4f1640/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#_2018-08-07_09_45_16  all the time, and apparently I'm not the only one with failures on that sole task14:18
Tengu-.- and the output is.... guh.14:19
panda|rovervinaykns: you may want to ask this on #tripleo after the meeting there. for What I undestand, VIP is the virtual IP that the HA endpoints are using to receive the request14:19
weshayrfolco|ruck, please inspect the queeens tripleo jobs14:24
weshay legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-queens14:24
weshayrfolco|ruck, looks like it timed out the last 4 runs14:24
weshayrfolco|ruck, that is the only failed job atm14:24
panda|roverTengu: it faisl during upgrade, you may ask to upgrade guys14:25
rfolco|ruckweshay, checking14:25
Tengupanda|rover: ok, will do after the meeting.14:25
weshaythanks14:25
panda|roverTengu: this is the error btw Error running /var/lib/heat-config/heat-config-script/8c3716ca-995a-4067-a3ae-e58f3fb7d054. [1]"14:26
Tenguyup, reading the script content.14:26
weshayarxcruz, shall I merge https://review.openstack.org/#/c/588458/114:27
*** gkadam_ has joined #oooq14:27
arxcruzweshay: yes sir14:28
*** jrist has joined #oooq14:28
*** gkadam has quit IRC14:29
weshayarxcruz, approved14:31
*** yolanda has quit IRC14:31
arxcruzweshay: thanks sir!14:33
weshaypanda|rover, you may want to adjust your pto request14:34
weshayyou are here14:34
weshay?14:34
panda|roverweshay: adjust ?14:35
*** yolanda has joined #oooq14:38
*** ykarel has joined #oooq14:38
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb- (1 more message)14:42
*** rasca is now known as rascasoft14:49
rfolco|ruckweshay, https://bugs.launchpad.net/tripleo/+bug/178582014:53
openstackLaunchpad bug 1785820 in tripleo "fs016 queens: Unable to initialize storage driver" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)14:53
*** ykarel has quit IRC14:57
*** jaosorior has quit IRC15:01
*** panda|rover is now known as panda|backin2h15:01
weshayrfolco|ruck, https://github.com/rdo-packages/gnocchi-distgit/blob/rpm-master/gnocchi.spec15:07
*** jfrancoa has quit IRC15:19
*** jfrancoa has joined #oooq15:21
*** saneax has quit IRC15:27
*** jfrancoa has quit IRC15:44
*** amoralej is now known as amoralej|off16:21
*** zoli is now known as zoli|gone16:24
*** zoli|gone is now known as zoli16:24
*** trown is now known as trown|lunch16:33
*** gkadam_ has quit IRC16:38
*** bogdando has quit IRC16:41
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-quickstart-extras-gate-newton-delorean-full-minimal, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch @  (1 more message)16:42
*** vinaykns has quit IRC16:42
*** holser__ has quit IRC16:52
*** tosky has quit IRC16:57
*** panda|backin2h is now known as panda|rover17:08
*** kopecmartin has quit IRC17:13
*** dtrainor has quit IRC17:16
*** dtrainor has joined #oooq17:19
*** vinaykns has joined #oooq17:29
*** trown|lunch is now known as trown17:42
*** saneax has joined #oooq18:11
*** apetrich has quit IRC18:35
weshayfak18:40
weshay2018-08-07 18:33:04,568 31668 ERROR    promoter Command '['ansible-playbook', '/home/centos/ci-config/ci-scripts/container-push/container-push.yml']' returned non-zero exit status 218:40
weshayTraceback (most recent call last):18:40
weshay  File "/home/centos/ci-config/ci-scripts/dlrnapi_promoter/dlrnapi_promoter.py", line 145, in tag_containers18:40
weshay    env=env, stderr=subprocess.STDOUT).split("\n")18:40
weshay  File "/usr/lib64/python2.7/subprocess.py", line 575, in check_output18:40
weshay    raise CalledProcessError(retcode, cmd, output=output)18:40
weshayhttp://38.145.34.55/master.log18:40
weshayrfolco|ruck, ^18:40
weshaypanda|rover, ^18:41
*** vinaykns has quit IRC18:41
rfolco|ruck:(18:42
*** chem has quit IRC18:42
rfolco|ruckweshay, perhaps sova installed isn't the latest ? https://github.com/rafaelfolco/sova/blob/master/tripleoci/config.py#L13918:42
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-quickstart-extras-gate-newton-delorean-full-minimal, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch @  (1 more message)18:42
weshayrfolco|ruck, https://github.com/rafaelfolco/sova/blob/gates/tripleoci/config.py#L13018:43
*** chem has joined #oooq18:43
rfolco|ruckah got it gates branch18:45
*** vinaykns has joined #oooq18:46
*** chem has quit IRC18:48
*** chem has joined #oooq18:48
rfolco|ruckweshay, sorry forgot to ping you about https://github.com/sshnaidm/sova/pull/4319:17
weshayrfolco|ruck, remove the comma on line 13119:18
rfolco|ruckweshay, it doesn't cause any issue IMO19:19
rfolco|ruckweshay, there are many cases like that - eg https://github.com/rafaelfolco/sova/blob/gates/tripleoci/config.py#L11319:20
*** ianw has left #oooq19:21
weshayrfolco|ruck, aight19:21
weshayur right19:21
weshaymerged19:21
weshaythanks19:21
*** apetrich has joined #oooq19:33
weshayrfolco|ruck, panda|rover ok.. master fully promoted19:49
rfolco|ruckweshay, did you fix error above ?19:49
weshayrfolco|ruck, yes.. by doing nothing :)19:49
weshayrfolco|ruck, rerun just worked19:50
rfolco|ruckweshay, ok, you have to teach me master19:50
rfolco|ruckinterplanetary alignment19:50
weshayrfolco|ruck, fs20 on rdo phase 2 https://thirdparty.logs.rdoproject.org/jenkins-periodic-master-rdo_trunk-featureset020-1ctlr_1comp_64gb-130/tempest.html19:50
weshaylet's get a bug on that for arxcruz and chandankumar19:50
weshayrfolco|ruck, meh.. pushing containers all over the place is hard19:51
rfolco|ruckreassign port test ?19:51
rfolco|ruckk19:51
weshayrfolco|ruck, aye19:51
rfolco|ruckweshay, promotion-blocker or not19:56
weshayrfolco|ruck, naw.. f.. phase 219:59
*** holser_ has joined #oooq19:59
weshayrfolco|ruck, we can just add that to a skip_list19:59
weshayif we really need to19:59
weshayrfolco|ruck, you know how to do that?20:00
rfolco|ruckweshay, skip_list ? yes. But never know the criteria - when you cheat, when you don't.20:00
rfolco|ruck...adding it to skip_list20:02
weshayrfolco|ruck, it's not cheating if we have a proper bug, however there are some tests that only have a few tempest tests that if you skipped would become meaningless20:07
weshayrfolco|ruck, understand20:07
weshay?20:07
rfolco|ruckweshay, yes20:09
weshayrfolco|ruck, k.. thanks20:09
*** zul has quit IRC20:13
myoungrfolco|ruck: still around?20:15
rfolco|rucko/20:15
myoungrfolco|ruck: can you chat BJ?  need max 3 min20:15
myoungrfolco|ruck: if you are busy with |ruck stuff i can catch you tomorrow as well20:16
myoungrfolco|ruck: not urgent20:16
rfolco|ruckmyoung, let me ope a bug and will be with you in a bit20:16
myoungrfolco|ruck: ack np20:16
rfolco|ruckmyoung, paste me bj # please20:23
myoungrfolco|ruck: lol now i need a min...back in 520:26
rfolco|ruckk :)20:27
*** holser_ has quit IRC20:31
*** vinaykns has quit IRC20:33
myoungrfolco|ruck: back20:37
rfolco|ruckmyoung, my room pls20:37
myoungnp, id?20:38
myoung#20:38
rfolco|ruckhttps://bluejeans.com/587845809720:38
-openstackstatus- NOTICE: Due to a bug, Zuul has been unable to report on cherry-picked changes over the last 24 hours. This has now been fixed; if you encounter a cherry-picked change missing its results (or was unable to merge), please recheck now.20:41
*** holser_ has joined #oooq20:41
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-quickstart-extras-gate-newton-delorean-full-minimal, tripleo-ci-centos-7-scenario009-multinode-oooq, tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades- (2 more messages)20:42
*** apetrich has quit IRC20:45
*** rfolco|ruck is now known as rfolco|off21:21
*** trown is now known as trown|outtypewww21:27
weshayrfolco|off, it's showing up now :) http://cistatus.tripleo.org/gates/21:28
weshaytripleo-ci-centos-7-containerized-undercloud-upgrades21:28
weshaygates at 81% :(21:28
*** holser_ has quit IRC21:38
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @  (1 more message)22:42
*** myoung has quit IRC23:14

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!