Friday, 2018-08-10

*** agopi has joined #oooq00:26
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, tripleo-ci-centos-7-scenario008-multinode-oooq-container @ https://review.openstack.org/560445,  (1 more message)00:43
*** jtomasek_ has quit IRC00:58
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-containerized-undercloud- (1 more message)02:43
*** skramaja has joined #oooq03:29
*** udesale has joined #oooq03:49
*** skramaja has quit IRC03:59
*** sanjayu_ has joined #oooq04:01
*** ykarel|away has joined #oooq04:03
*** skramaja has joined #oooq04:20
*** jaganathan has joined #oooq04:25
*** sanjayu__ has joined #oooq04:25
*** sanjayu_ has quit IRC04:28
*** ykarel|away is now known as ykarel04:39
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo- (1 more message)04:43
*** gkadam has joined #oooq05:12
*** ykarel_ has joined #oooq05:26
*** ykarel has quit IRC05:28
*** ykarel__ has joined #oooq05:28
*** ykarel_ has quit IRC05:31
*** jfrancoa has joined #oooq05:41
*** quiquell has joined #oooq05:42
*** ratailor has joined #oooq05:43
*** ratailor has quit IRC05:58
quiquellmarios: RDO is fine, we can +1w the TAGs change https://review.openstack.org/#/c/584508/06:02
*** kopecmartin has joined #oooq06:11
*** ratailor has joined #oooq06:16
*** ratailor has quit IRC06:20
*** ykarel_ has joined #oooq06:23
*** ratailor has joined #oooq06:24
*** ykarel__ has quit IRC06:26
*** jtomasek has joined #oooq06:32
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo- (1 more message)06:43
*** ccamacho has joined #oooq06:50
*** apetrich has joined #oooq06:55
*** ykarel__ has joined #oooq06:56
*** ykarel_ has quit IRC06:59
*** quiquell has quit IRC07:00
*** ykarel__ is now known as ykarel07:01
*** quiquell has joined #oooq07:01
*** amoralej|off is now known as amoralej07:02
*** holser_ has joined #oooq07:10
*** jaosorior has quit IRC07:15
*** ratailor has quit IRC07:25
quiquelljfrancoa: We are ansibilizing TOCI, can you +1w here https://review.openstack.org/#/c/584508/ ?07:29
*** ykarel is now known as ykarel|lunch07:43
*** udesale has quit IRC07:51
*** udesale has joined #oooq07:51
jfrancoaquiquell: done08:01
quiquelljfrancoa: Thanks, have being deeply check upstream and RDO08:06
jfrancoaquiquell: yes, we should avoid having the same problem with the tags from two weeks ago08:06
quiquelljfrancoa: I have testted it with this script https://review.openstack.org/#/c/588475/08:07
quiquelljfrancoa: Totally...08:07
jfrancoaquiquell: cool thing08:09
jfrancoathis script08:09
quiquellWe have a lot of jobs to check in our current sprint, this helps a lot08:09
quiquelland we don't want to end up in the hole of last week08:10
*** ratailor has joined #oooq08:17
*** chem has joined #oooq08:30
*** bogdando has joined #oooq08:36
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, tripleo-ci-centos-7-scenario008-multinode-oooq-container @ https://review.openstack.org/560445,  (1 more message)08:43
*** ykarel|lunch is now known as ykarel08:45
*** ssbarnea has quit IRC08:52
panda|ruck|offjfrancoa: you have the friday meeting today ?09:17
*** ssbarnea has joined #oooq09:32
*** jaosorior has joined #oooq09:48
jfrancoapanda|ruck|off: yes, I saw you added a topic to discus. So we'll have it10:05
panda|ruck|offjfrancoa: thanks10:05
ssbarneapanda|ruck|off: https://review.openstack.org/#/c/571180/ please :D10:14
ssbarneaalso can anyone answer my question regarding jenkins access? who do I need to ping to get an account there?10:16
*** tosky has joined #oooq10:19
*** ykarel_ has joined #oooq10:28
*** ykarel__ has joined #oooq10:30
*** ykarel has quit IRC10:30
quiquellpanda|ruck|off: Have a minute found some difference running emit releases at all fs, don't know if it's important10:30
panda|ruck|offquiquell: it is10:31
quiquellHave -1 it10:31
quiquellIt's in the comment10:31
quiquellpanda|ruck|off: Did you see it ?10:32
*** ykarel_ has quit IRC10:33
panda|ruck|offquiquell: you talking about 590339 ?10:33
*** panda|ruck|off is now known as panda|ruck10:33
quiquellpanda|ruck: Nope, about https://review.openstack.org/#/c/585649/10:34
panda|ruckssbarnea: sudo yourself.10:34
quiquellpanda|ruck: About periodic, send an email, we need to change emit_releases_script.py to support more than one name per release10:35
*** tosky has quit IRC10:35
*** tosky has joined #oooq10:36
panda|ruckquiquell: you need to solve the periodic part if you want the script enable for all featuresets10:36
*** udesale has quit IRC10:36
panda|ruckquiquell: if you merge this, all the periodic jobs will fail10:36
quiquellpanda|ruck: featureset run at periodic, are not part of the if statement ?10:38
panda|ruckquiquell: all the periodic job have promotion-testing-hash-* as release file10:39
quiquellpanda|ruck: That's covered with --periodic flag of emitter10:40
quiquellpanda|ruck: What's not covered is the master name for periodic10:40
quiquellpanda|ruck: But I am talking also about differences at playbook executions10:40
quiquellpanda|ruck: Don't know if they are important10:40
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, tripleo-ci-centos-7-scenario008-multinode-oooq-container @ https://review.openstack.org/560445,  (1 more message)10:43
*** udesale has joined #oooq10:47
panda|ruckquiquell: we need to check with upgrades10:49
panda|ruckquiquell: upgrades folks10:49
panda|ruckif get_build_command is not set overcloud_docker_registry_namespace is used instead10:49
panda|ruckI think there's an implicit assumption somewhere10:50
panda|rucklike "if get_build_command is defined we are running in rdocloud" or something like that10:50
quiquellpanda|ruck: Yep, agree talking with upgrade guys10:50
panda|ruckquiquell: ok, can you wear a fake beard for the next meeting ? please ?10:52
quiquellpanda|ruck: Sure, I have lost my seniority10:53
*** dtantsur|afk is now known as dtantsur11:01
quiquellpanda|ruck: the promotion-testing-hash-master11:06
quiquellpanda|ruck: Also has the counterpart of promotion-testing-hash-queens, pike, rocky, etc... ?11:06
panda|ruckquiquell: yes11:08
panda|ruckquiquell: but wehn upgrading, we are not starting from a promotion-hash11:08
panda|ruckquiquell: we upgrade from queens to promotion-master11:08
quiquellpanda|ruck: The we are covered, have a brain fart11:08
quiquellwith --periodic we already add the sufix promotiong-testing-hash- to the release11:09
quiquellso we point to the correct release file yaml11:09
quiquellso nothing need to be done, I misunderstood it11:09
panda|ruckquiquell: wait11:11
*** bogdando has quit IRC11:11
quiquellpanda|ruck: Tell me if this is it https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/emit_releases_file/test_release_file.py#L109-L13111:11
quiquellpanda|ruck: It's the unit test that covers promotion-testing-hash11:11
quiquellpanda|ruck: Also looks like we where already using it at periodics11:12
quiquellpanda|ruck: Some of the featuresets in the if statement run periodically11:12
*** dsneddon has quit IRC11:12
quiquellGoing to double check11:12
quiquell37,50,10,1111:13
panda|ruckquiquell: the problem is that we are adding an upgrade job to our pipeline11:13
panda|ruckquiquell: and that has not been done before11:13
panda|ruckin mixed upgrade, we have trigger branch, let's say master11:14
panda|ruckthe undercloud is installed as queens, the upgraded to master11:14
quiquellThat's not mixed upgrades11:15
quiquellmixed upgrades are ovecloud upgrades and overclouid fast forward upgrades11:15
panda|ruckyeah, because we are adding fs05011:15
quiquellThat's just a undercloud upgrade11:15
panda|ruckit's containerized undercloud upgrade11:15
quiquellok11:15
panda|ruckquiquell: but you don't start from the release file11:15
quiquellpanda|ruck: Let's demoing it and see the output11:16
panda|ruckso you don't have to add the promotion-hash crap11:16
quiquellpanda|ruck: so releases file for undercloud will be11:16
quiquellundercloud_install: master.yaml and undercloud_target: promotion-testing-hash-master.yaml ?11:17
quiquellThat's it ?11:17
quiquellor it will be11:18
quiquellundercloud_install: queens.yaml and undercloud_target: promotion-testing-hash-master.yaml ?11:18
*** holser_ has quit IRC11:18
panda|ruckquiquell: the second11:19
panda|ruckquiquell: master to master is an update, not an upgrade11:20
*** dsneddon has joined #oooq11:24
quiquellpanda|ruck: Ok, let me fix it11:25
panda|ruckquiquell: no rush, may mail was mainly to understand if we covered it.11:27
quiquellpanda|ruck: Want to leave a review before leaving on PTO, and answer the e-mail with it11:28
quiquellpanda|ruck: This is it ? https://review.openstack.org/59075011:40
*** udesale has quit IRC11:41
*** udesale has joined #oooq11:42
quiquellpanda|ruck: Going back to toci_jobtype, put a review to remove it from jobs, do you have a minute ?11:48
quiquellpanda|ruck: Without break reproducer11:48
panda|ruckquiquell: I have a meeting in 10 mintes11:49
quiquellpanda|ruck: Ok, I will summarize it at the cards, no problem11:49
*** ykarel_ has joined #oooq11:50
*** ykarel__ has quit IRC11:53
panda|ruckhow come everything we do in python does end up not having classes at all :(12:02
weshayrfolco|rover, you can drop if you want12:03
weshaywe're SO greeen12:03
*** jaosorior has quit IRC12:03
rfolco|roverweshay, tripleo-ci helping saving the planet12:04
weshay:)12:04
quiquellpanda|ruck: laziness ? after a lot of years doing OOP I have mixed feeling with it12:04
quiquellweshay: gm, pair or RDO reviews for the NODE_FAILURE and rdo-admin emails12:05
*** ratailor has quit IRC12:05
*** bogdando has joined #oooq12:08
quiquellOk leaving for PTO, see you in a few weeks12:20
*** quiquell has quit IRC12:20
panda|ruckjust like that12:21
panda|ruckhe's gone12:21
weshaychandankumar, fyi.. I have a staff mtg w/ Daniel becker that starts in 7 minutes, mind if we start our tempest mtg 30min late?12:23
chandankumarweshay: ok12:23
weshaychandankumar, thanks for waiting forme12:23
weshaypanda|ruck, crud12:23
* weshay makes plans to move to spain12:24
weshayUSA sucks12:24
weshayUSA sucks12:24
weshayUSA sucks12:24
panda|ruckweshay: spain is roasing at the moment12:24
panda|ruckroasting12:24
weshayrfolco|rover, panda|ruck take a moment to enjoy the green... nice work guys http://rhos-release.virt.bos.redhat.com:3030/rhosp12:25
*** ykarel_ is now known as ykarel12:27
rfolco|roverweshay, we beat panda's tapper game12:27
weshayhell ya we did.. see mom, all that time playing tapper paid off!!!12:28
*** amoralej is now known as amoralej|lunch12:28
*** udesale has quit IRC12:34
*** skramaja has quit IRC12:34
*** holser_ has joined #oooq12:35
panda|ruckrfolco|rover: nice to realize after two hours that my fire&forget git review command did not complete ... https://review.rdoproject.org/r/15376 has now a new PS ...12:38
rfolco|roverpanda|ruck, nice, will do a new pass on that one :)12:39
*** holser_ has quit IRC12:41
*** trown|outtypewww is now known as trown12:41
*** holser_ has joined #oooq12:41
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container- (1 more message)12:43
arxcruzpanda|ruck: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/649eef0/logs/tempest.html.gz is this failing constantly? if so it's a bug in the component12:58
*** amoralej|lunch is now known as amoralej13:23
*** holser_ has quit IRC13:35
*** holser_ has joined #oooq13:36
*** ykarel is now known as ykarel|away13:41
*** ratailor has joined #oooq13:45
panda|ruckweshay: why the email in your signature says <cclayton@redhat.com> ?13:57
weshayhrm13:57
weshaydon't know will look13:58
*** ykarel|away has quit IRC13:58
*** apetrich has quit IRC14:00
*** vinaykns has joined #oooq14:37
rfolco|roverpanda|ruck, do we have a bug for this ? 2018-08-10 09:23:18 | fatal: [centos-7-ovh-gra1-0001263037]: FAILED! => {"msg": "An unhandled exception occurred while running the lookup plugin 'file'. Error was a <class 'ansible.errors.AnsibleError'>, original message: could not locate file in lookup: ControllerApi/centos-7-ovh-gra1-0001263038/UpgradeInitDeployment"}14:42
myoungpanda|ruck, rfolco|rover, all, to echo what weshay said...NICE --> https://photos.app.goo.gl/o5QXKfqig1HMpMsr914:42
rfolco|roverpanda|ruck, http://logs.openstack.org/02/590202/2/check/tripleo-ci-centos-7-3nodes-multinode/0df27e1/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-08-10_09_23_1814:42
rfolco|roverI know alex fixed a similar bug recently... but this looks diff14:43
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container- (1 more message)14:43
*** ccamacho has quit IRC14:47
panda|ruckrfolco|rover: are you sure it was fixed ? looks like the same to me14:47
rfolco|roverpanda|ruck, this was the revert https://review.openstack.org/#/c/586714/14:47
panda|ruckrfolco|rover: randomly for some reason the order is messed up, and host is not included correctly, and files are missing14:48
rfolco|roverstable/queens14:48
rfolco|rovernow it seems to happen in master?14:49
panda|ruckrfolco|rover: I think it happens in 3nodes in general14:49
rfolco|rovermyoung, first time I see ci as neighbors grass, which always looks greener14:53
myounghaha14:53
weshayoh man..15:02
weshaythat was a morning15:02
*** tosky has quit IRC15:03
*** ratailor has quit IRC15:07
*** kopecmartin has quit IRC15:18
*** kopecmartin has joined #oooq15:24
chandankumararxcruz: can we move it done https://trello.com/c/05m7lFPs/892-lp1784929tempest-importerror-no-module-named-muranoclient ?15:40
chandankumarpanda|ruck: weshay needs +2 and +w https://review.openstack.org/#/c/577780 just a rebase15:41
*** sanjayu__ has quit IRC15:45
weshaychandankumar, https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-gate-master-delorean-quick-basic-6627/undercloud/var/log/containers/15:48
weshayoh wait.. that may be ok15:49
weshaythat does not deploy the overcloud15:49
*** vinaykns has quit IRC15:54
*** kopecmartin has quit IRC15:59
*** gkadam has quit IRC16:06
*** bogdando has quit IRC16:08
*** jfrancoa has quit IRC16:21
holser_Quick question16:27
holser_Why do we run tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates and tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades (non-voting)16:27
holser_same job but one is voting and another one is not voting16:27
holser_http://zuul.openstack.org 58723516:28
holser_it's just waste of resources16:28
holser_weshay ^^^16:34
weshayholser_, thanks holser_ but they are two diff jbos man16:35
weshayjobs16:35
holser_but same names :D16:35
weshayholser_, READ16:35
holser_updates/upgrades16:35
holser_ahh16:35
holser_my eyes are bleeding16:36
holser_Sorry.... late evening16:36
chemholser_: if you want to bleed try to guess how this file is going to be rendered https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2#L1..L216:37
chemholser_: this need a serious refactor16:37
holser_thanks chem16:38
chemholser_: anytime16:39
myoungchem: ya, helps to crossref w/ the generated .sh, otherwise you need a proper Sherlock mind castle16:39
chemhehe16:39
myoungMind Palace* rather16:40
chemmyoung: I feel like it's becoming too easy, I'm going to add a conditional for upgrade somewhere in there.16:40
*** holser_ has quit IRC16:43
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq- (1 more message)16:43
chemmyoung: and now it's even more mind blowing https://review.openstack.org/59091216:47
* myoung looks and peers at chem16:47
*** panda|ruck is now known as panda|ruck|off16:48
panda|ruck|offruck and morty16:48
chemI like that file16:48
*** dtantsur is now known as dtantsur|afk17:01
*** chem is now known as chem_gone17:01
*** chem_gone has quit IRC17:02
weshaypanda|ruck|off, ruck and morty.. we should change the names17:09
weshaylolz17:09
*** trown is now known as trown|lunch17:09
myoungpanda|ruck|off, weshay: is this infra?  still digging in just juggling --> https://review.openstack.org/#/c/59009017:11
*** jaganathan has quit IRC17:23
*** amoralej is now known as amoralej|off17:34
*** myoung is now known as myoung|lunch18:01
*** trown|lunch is now known as trown18:15
*** apetrich has joined #oooq18:29
*** rfolco|rover is now known as rfolco|rover|afk18:40
hubbotFAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq- (1 more message)18:43
*** apetrich has quit IRC18:46
*** gkadam has joined #oooq19:47
*** myoung|lunch is now known as myoung20:32
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @  (1 more message)20:43
*** trown is now known as trown|outtypewww21:01
*** gkadam has quit IRC22:34
hubbotFAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-containerized-undercloud-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @  (1 more message)22:43
*** myoung is now known as myoung|off23:04
*** dtrainor has quit IRC23:40

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!