Wednesday, 2019-07-31

« Tuesday, 2019-07-30 Index Thursday, 2019-08-01 »
*** aakarsh has joined #oooq00:01
*** aakarsh has quit IRC01:36
*** aakarsh has joined #oooq01:51
*** ykarel has joined #oooq02:37
*** dsneddon has quit IRC03:14
*** dsneddon has joined #oooq03:22
*** gkadam has joined #oooq03:40
*** apetrich has quit IRC04:20
*** udesale has joined #oooq04:20
*** udesale has quit IRC04:21
*** udesale has joined #oooq04:21
*** ratailor has joined #oooq04:27
*** skramaja has joined #oooq04:28
*** dsneddon has quit IRC04:30
*** dsneddon has joined #oooq04:32
*** ykarel has quit IRC04:35
*** dsneddon has quit IRC04:36
*** sanjayu_ has joined #oooq04:45
*** ykarel has joined #oooq04:52
*** dsneddon has joined #oooq04:57
*** ykarel has quit IRC05:05
*** marios|rover has joined #oooq05:10
*** marios has joined #oooq05:10
*** ykarel has joined #oooq05:13
*** ykarel is now known as ykarel|away05:13
*** bhagyashris has joined #oooq05:15
*** ykarel|away has quit IRC05:15
*** ykarel|away has joined #oooq05:16
*** jfrancoa has joined #oooq05:19
*** ykarel|away has quit IRC05:27
*** ksambor has joined #oooq05:30
*** jaosorior has quit IRC05:31
*** ratailor has quit IRC05:39
*** ratailor has joined #oooq05:48
*** raukadah is now known as chandankumar06:04
chandankumarmarios: \o/06:20
chandankumarmarios: https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-master/6517e8e/job-output.txt.gz#_2019-07-30_21_14_29_73806806:20
chandankumarrhel-8 standalone promotion job broken06:20
chandankumarmarios: https://review.opendev.org/#/c/673738/ -fix is here06:21
marios|roverchandankumar: ok will check in bit06:21
*** jaosorior has joined #oooq06:23
*** brault has joined #oooq06:25
*** sanjayu_ has quit IRC06:32
*** brault has quit IRC06:39
*** dsneddon has quit IRC07:00
*** Goneri has quit IRC07:01
*** amoralej|off is now known as amoralej07:07
*** ratailor has quit IRC07:07
*** ratailor has joined #oooq07:08
*** dsneddon has joined #oooq07:11
*** tosky has joined #oooq07:12
*** brault has joined #oooq07:19
*** ykarel|away has joined #oooq07:21
*** brault has quit IRC07:23
*** udesale has quit IRC07:24
*** udesale has joined #oooq07:24
*** ykarel|away is now known as ykarel07:25
*** apetrich has joined #oooq07:26
*** tesseract has joined #oooq07:27
*** jpena|off is now known as jpena07:37
*** jaosorior has quit IRC08:03
*** Goneri has joined #oooq08:08
*** bogdando has joined #oooq08:13
*** derekh has joined #oooq08:40
*** d0ugal has quit IRC08:41
*** d0ugal has joined #oooq08:45
*** ykarel is now known as ykarel|lunch08:46
*** d0ugal has quit IRC08:48
*** d0ugal has joined #oooq08:48
chandankumarmarios|rover: https://review.opendev.org/#/c/673709/3 needs +w on this already fixed by sagi late night08:55
marioschandankumar: i would have sworn i already reviewed this08:56
marioschandankumar:08:56
marios*=* 10:03:25 *=*=*= "[RHEL8] Fixed rdo_dlrn in release file" https://review.opendev.org/#/c/673738/08:56
mariossimilar to that one maybe08:57
arxcruzchandankumar, https://tree.taiga.io/project/tripleo-ci-board/task/1147?kanban-status=1447275 shall i move to done, delete, or what? since this is no longer required08:57
chandankumarmarios: yes, it sshnaidm|afk patch has more stuff08:57
chandankumararxcruz: yes move to done08:58
*** panda has quit IRC08:58
*** panda has joined #oooq08:59
arxcruzchandankumar, i'll work on https://tree.taiga.io/project/tripleo-ci-board/task/1204?kanban-status=144727508:59
chandankumararxcruz: aye sir09:00
*** jaosorior has joined #oooq09:00
arxcruzchandankumar, nevermind, you already did it09:00
chandankumararxcruz: it is not working09:01
chandankumarit might need some more work09:01
arxcruzchandankumar, so leave with me then, otherwise i'll do nothing this sprint09:01
chandankumararxcruz: https://tree.taiga.io/project/tripleo-ci-board/task/1203?kanban-status=144727409:02
arxcruzsshnaidm|afk, https://review.rdoproject.org/r/#/c/21332/ :D09:07
arxcruzsshnaidm|afk, just +2+w09:08
arxcruzthe job is working now, i did some mistakes with the ssh keys, now it's working :)09:08
*** dsneddon has quit IRC09:14
*** rfolco|ruck has joined #oooq09:17
*** kopecmartin|off is now known as kopecmartin09:23
*** sshnaidm|afk is now known as sshnaidm09:42
*** dsneddon has joined #oooq09:48
*** bhagyashris has quit IRC09:48
*** jaosorior has quit IRC09:50
*** ykarel|lunch is now known as ykarel09:55
*** dsneddon has quit IRC09:59
*** apetrich has quit IRC10:05
*** ratailor has quit IRC10:09
*** ratailor has joined #oooq10:10
*** dtantsur|afk is now known as dtantsur10:23
*** jaosorior has joined #oooq10:34
*** sanjayu_ has joined #oooq11:07
*** ratailor has quit IRC11:10
*** ratailor has joined #oooq11:11
*** jtomasek has joined #oooq11:19
*** jpena is now known as jpena|lunch11:31
*** udesale has quit IRC11:46
*** udesale has joined #oooq11:47
*** jaosorior has quit IRC11:48
*** sanjayu_ has quit IRC11:50
*** ratailor has quit IRC11:51
sshnaidmarxcruz, commented https://review.rdoproject.org/r/#/c/21332/11:53
sshnaidmarxcruz, is it all that left to merge? https://review.opendev.org/#/c/657955/411:54
weshaychandankumar can you please add the rhel-8 standalone to run 3rd party check against all the ci repos... tq, tqe, tripleo-ci11:54
weshayrfolco|ruck can you please remove fedora-28 from all the pipelines11:55
weshayupstream and 3rd party11:55
rfolco|ruckweshay, ok will do after calls11:55
weshaythanks11:55
rfolco|ruckweshay, what matters for prog call is master promotion right ?11:56
*** dsneddon has joined #oooq11:56
rfolco|ruckweshay, rocky is yellow now...11:56
weshayrfolco|ruck meh.. it's in ci.centos11:58
weshayrfolco|ruck it's failing because of the hardware12:00
weshay2019-07-29 13:22:26 |     ResourceInError: resources.Controller: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500"12:00
*** dsneddon has quit IRC12:01
weshayit will pass if we keep rerunning it..  and hit the right node12:01
rfolco|ruckweshay, k12:01
weshayrfolco|ruck /me updated https://etherpad.openstack.org/p/ruckroversprint1312:01
rfolco|ruckweshay, thx12:01
chandankumarweshay: will do that12:02
arxcruzsshnaidm, thanks for the comments, i'll work on that, no, that patch and dependences12:05
*** rlandy has joined #oooq12:11
rlandyhello team12:12
weshayrlandy is back12:15
weshayrlandy how was prague12:15
rlandyweshay: amazing!!12:16
rlandyCzech Republic is the coolest country12:16
marios|rovero/ rlandy12:16
weshaynice..  I'm glad you took the time to see it :)12:16
rlandymarios|rover: hey!12:17
* rlandy tries to remember what sprint we are on and what it is I do here12:19
* chandankumar reboots irc client12:27
*** chandankumar has quit IRC12:27
*** chandankumar has joined #oooq12:28
*** jtomasek has quit IRC12:29
rfolco|ruckweshay, crap gate is totally broken12:29
marios|roverrfolco|ruck: you need me to jump on something?12:29
rfolco|ruckmarios|rover, I'm comparing failures to file bug(s) now... will ping if need you12:30
rfolco|ruckthx marios|rover12:30
marios|roverrfolco|ruck: k12:30
*** jpena|lunch is now known as jpena12:31
chandankumarmarios|rover: rfolco|ruck I have taken care of rhel8 standalone12:31
chandankumarsshnaidm: patch will fix the promotion and once it is fixed, check job will be also get fixed12:31
sshnaidmchandankumar, which patch?12:32
*** amoralej is now known as amoralej|lunch12:33
chandankumarsshnaidm: https://review.opendev.org/#/c/673709/12:33
chandankumarsshnaidm: yesterday we have pushed new containers on the rdo registry12:33
chandankumarapart from that we have now new issue here https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing/7796e1e/job-output.txt.gz#_2019-07-31_12_11_16_14365512:34
chandankumarcommit c3b54d7568d9eb01bb237b15ccfb120fd5d1ffb8 / distro 6309d2f33d124a7fb6168988cb3df3f29116dd88 combination not found in RHEL12:35
weshaychandankumar ok.. that should resolve12:37
weshayon it's own12:37
weshayrlandy can you work w/ sshnaidm on ovb please12:37
weshayfor rhel812:38
sshnaidmweshay, ovb is working more or less, just started a mess with last repos today12:38
rlandyweshay: ack12:39
rlandysshnaidm: want to assign me something?12:39
weshayrfolco|ruck http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-undercloud-oooq&branch=stable%2Frocky12:39
chandankumarsshnaidm: https://review.opendev.org/#/c/673021/ anything more needed on os_tempest patch?12:39
rfolco|ruckweshay, no need to file bug anymore?12:40
rlandynice news on vexxhost12:40
rfolco|ruckweshay, back to green?12:40
weshaydouble check it.. but looks like it was a tht issue12:40
rfolco|ruckweshay, ok12:40
rfolco|ruckweshay, the other issue in gate is the ovh 401 http error (auth) - https://bugs.launchpad.net/tripleo/+bug/183738812:41
openstackLaunchpad bug 1837388 in tripleo " tripleo-ci jobs failing intermittently with "Image prepare failed: 401 Client Error: Unauthorized" " [High,Triaged] - Assigned to Marios Andreou (marios-b)12:41
sshnaidmrlandy, you can fix this one maybe: https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/ovb-jobs.yaml#L34212:41
sshnaidmrlandy, it won't work this way, to_build should be in oooq ansible level, not zuul job level12:42
sshnaidmrlandy, we can add it to featureset_overrides and then set it12:42
*** jaosorior has joined #oooq12:43
* sshnaidm found finally a case for featureset_override12:43
*** apetrich has joined #oooq12:43
*** apetrich has quit IRC12:44
rlandysshnaidm: k - looking12:45
*** apetrich has joined #oooq12:45
toskysshnaidm: oh, different from https://review.opendev.org/#/c/672256/5/.zuul.yaml ?12:45
sshnaidmtosky, sorry?12:48
chandankumarweshay: do we have to enable rhel-8 standalone against tripleo-common also, since we have got build test packages coverred https://review.opendev.org/673517 and https://review.opendev.org/67375712:48
chandankumar?12:48
weshaychandankumar is it running against the latest promoted hash? probably not12:49
rlandyis mojo unavailable for anyone else?12:49
weshaychandankumar let's hold on tripleo repos until things look tight on our ci repos12:49
chandankumarweshay: nope12:49
chandankumarweshay: promotion hash job is broken and currently container build is running on current promotion pipeline12:50
chandankumarweshay: ok12:50
toskysshnaidm: about a case for featureset_override, I already found one :)12:51
weshayrfolco|ruck /me closing https://bugs.launchpad.net/tripleo/+bug/183664412:52
openstackLaunchpad bug 1836644 in tripleo "rhel8 on rdo tempest container does not build" [Critical,Triaged]12:52
rfolco|ruckweshay, ok12:53
rlandysshnaidm: k - looks reasonable  enough - adding review for featureset_override12:53
* rlandy thinks we need a better solution that featuerset_override in general though12:54
weshayarxcruz can you check if this should remain open https://bugs.launchpad.net/tripleo/+bug/183561512:54
openstackLaunchpad bug 1835615 in tripleo "Promotion jobs are failing with could not connect to cluster" [Critical,Triaged]12:54
sshnaidmrlandy, yeah, better solution will be passing all zuul vars as external variables to nested ansible, so that we can define anything in job level12:55
sshnaidmrlandy, actually not a biggie12:55
weshaymarios|rover in your time.. can you please look into https://bugs.launchpad.net/tripleo/+bug/182378712:56
openstackLaunchpad bug 1823787 in tripleo "quickstart-extras validate-perf has invalid task attribute" [High,Triaged]12:56
marios|roverweshay: ok12:57
marios|roverits an oldun... we seeing it again or sthing weshay ?12:57
rlandysshnaidm: I had a solution for a file we would pass with these vars12:57
rlandyneed to dig it up12:57
weshaymarios|rover it's old and from the community12:58
chandankumarweshay: sshnaidm https://review.rdoproject.org/r/#/c/21660/12:59
sshnaidmchandankumar, +w13:00
chandankumarsshnaidm: Dhanyabad :-)13:00
sshnaidmrlandy, would be nice13:00
pandaanyone coming to the meeting ?13:01
rfolco|ruckping functional tests call13:01
rfolco|ruckmarios, sshnaidm, weshay, panda, rlandy, arxcruz, rfolco, chandankumar, zbr, kopecmartin13:02
rfolco|rucklast call13:02
sshnaidmchandankumar, I had to google it! :D13:02
rfolco|ruckhttps://bluejeans.com/587845809713:02
rfolco|ruckwe are departing now13:02
sshnaidmrfolco|ruck, wait for my duty free13:02
rfolco|ruckrlandy, joining us ?13:03
rfolco|ruckhttps://bluejeans.com/587845809713:03
marios|roverpanda: speak a bit slower13:05
rlandysshnaidm: https://review.opendev.org/#/c/636406/13:06
rlandyold review to add new file for job vars13:06
*** amoralej|lunch is now known as amoralej13:07
*** skramaja has quit IRC13:12
*** tesseract has quit IRC13:20
*** tesseract has joined #oooq13:24
*** aakarsh has quit IRC13:25
*** gkadam has quit IRC13:28
marios|roverzbr: (unrelated ) whats with the retro look. you need some james dean glasses to complete it.13:52
marios|roverzbr: you are sepia13:52
*** ykarel is now known as ykarel|afk13:53
*** dsneddon has joined #oooq13:57
rlandysshnaidm: https://review.rdoproject.org/r/21661 Move to_build to oooq ansible from zuul level var13:57
*** aakarsh has joined #oooq14:00
*** dsneddon has quit IRC14:01
sshnaidmrlandy, it's weird I don't see "to_build" here: http://logs.rdoproject.org/49/21649/5/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/9c92537/logs/zuul-variables.yaml14:01
*** aakarsh|2 has joined #oooq14:02
*** jfrancoa has quit IRC14:02
*** aakarsh has quit IRC14:05
chandankumarsshnaidm: Hello14:08
pandaweshay: 1-1 ?14:08
chandankumarsshnaidm: in the current promotion job https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-rhel-8-master-containers-build-push/6496483/logs/container_push.log.txt.gz14:08
chandankumartrunk.registry.rdoproject.org/tripleomaster/rhel-binary-cinder-api:c17d2177ce6a05e4290224d99126a0f39c601b4e_23df8773 push successfully!14:08
weshaypanda aye14:09
weshayjoining14:09
rlandysshnaidm: those are only zuul. vars14:09
chandankumarand then it is trying to pull the same https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-master/334f546/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2019-07-31_09_38_2614:09
chandankumarwhy it is failing14:09
chandankumarsorry got that14:09
sshnaidmrlandy, so maybe worth to dump all hostvars14:11
sshnaidmrlandy, like that:   https://review.opendev.org/673829 but we need to remove all ansible_ vars from there14:14
sshnaidmrlandy, and maybe another redundant14:14
chandankumarrlandy: sshnaidm please have a look at this one https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-master/334f546/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2019-07-31_09_38_2614:14
rlandysshnaidm: one problem at a time  :)14:14
chandankumarI am sure something wrong with release file14:14
rlandydoes the fs_override review look ok?14:15
*** amoralej is now known as amoralej|afk14:17
chandankumarsshnaidm: http://codesearch.openstack.org/?q=dlrn_hash_path_newest&i=nope&files=&repos= -> dlrn_hash_path_newest is used in {relase}.yaml not promotion hash file14:18
chandankumarbut in rhel-8 it is opposite14:18
chandankumari think it need to be changed to dlrn_hash_path14:19
rlandywill look in a sec14:19
sshnaidmchandankumar, yeah, seems like I messed up in this file14:21
chandankumarsshnaidm: https://review.opendev.org/#/c/673738/14:22
chandankumarsshnaidm: rlandy https://review.opendev.org/#/c/673757/ and https://review.opendev.org/#/c/673517/ what are the things, I should from here and move to build test packages role so that we can keep release file clean14:28
chandankumarweshay: rfolco|ruck tomorrow I will be leaving for blr in afternoon and might not be avaiable for evening meeting and On Friday, I will be attending Devconf.14:28
rfolco|ruckchandankumar, ack14:29
rlandysshnaidm: we can trigger the test here to check if you want ... https://review.rdoproject.org/r/#/c/21661/14:30
sshnaidmrlandy, cool, will include it14:32
rlandysshnaidm: anything else you want me to look at?14:33
sshnaidmrlandy, let's see how jobs go with all these changes and then we'll see14:33
rlandysshnaidm: ack - will watch - you can ping me when you log off with a list of jobs/reviews to watch14:34
sshnaidmrlandy, sure14:34
sshnaidmrlandy, take a look please https://review.opendev.org/67252814:35
rlandysshnaidm: looks ok - left one suggestion https://review.opendev.org/#/c/672528/14:45
*** aakarsh|3 has joined #oooq14:48
sshnaidmrlandy, done14:49
rfolco|ruckweshay, question14:50
rfolco|ruckhttps://github.com/openstack/tripleo-ci/blob/master/zuul.d/multinode-jobs.yaml#L80-L8614:50
*** aakarsh|2 has quit IRC14:50
rfolco|ruckyou asked me to gate stein and rocky, what about pike and queens?14:51
rfolco|ruckalso green from what I observed in zuul http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-containers-multinode-queens14:51
weshayrfolco|ruck ya.. so those should vote and gate on ci repos only14:53
weshayrfolco|ruck I think we can remove pike14:53
rfolco|ruckwe cannot control that.. templates14:53
rfolco|rucklet me check14:54
weshayrfolco|ruck they would have to be removed from the templates then.. or a new template added14:54
rfolco|ruckyeah currently running in check for tq tqe and oooci14:54
rfolco|ruckweshay, currently these are not used outside of ci realm14:55
rfolco|ruckwill keep using the same template and add a note14:55
weshayk.. rfolco|ruck highlight that fact in the commit message and the intent .. so that we can have reviewers double check as well14:55
rfolco|ruckok will do14:55
rfolco|ruckthx weshay14:55
*** vinaykns has joined #oooq14:58
*** ykarel|afk is now known as ykarel15:03
*** amoralej|afk is now known as amoralej15:06
marios|roverweshay: comment #2 @ https://bugs.launchpad.net/tripleo/+bug/182378715:14
openstackLaunchpad bug 1823787 in tripleo "quickstart-extras validate-perf has invalid task attribute" [High,Fix released]15:14
marios|roverweshay: (fix released)15:14
weshaymarios|rover rock.. thanks15:14
sshnaidmrlandy, well, while we don't have images I think we'll need to build them..15:20
rlandysshnaidm: we don;t have images yet?15:20
rlandyie: we dont have the image build job15:21
rlandyor it wont run in the test?15:21
rfolco|ruckweshay, done15:21
rfolco|ruckhttps://review.opendev.org/673842 Vote and gate on containers-multinode-branchful jobs15:21
rfolco|ruckhttps://review.rdoproject.org/r/21663 Make fs053 job vote again15:22
sshnaidmrlandy, we have image build job, it's on review, but still doesn't upload images15:22
sshnaidmrlandy, hmm.. actually we have path to images in release file.. why it doesn't work15:22
weshaythanks..15:22
marios|roversshnaidm: i updated that when you next get a chance please thanks https://review.rdoproject.org/r/#/c/21611/15:23
* rlandy is a bit out of the loop here15:23
marios|roversshnaidm: you don't need the import/export stuff... i was just not waiting long enough for the data to appear15:23
weshayrfolco|ruck can you make a note of the jobs and the reviews in https://bugs.launchpad.net/tripleo/+bug/182390115:24
openstackLaunchpad bug 1823901 in tripleo "move non-voting jobs back to voting where possible" [High,Triaged]15:24
weshayplease15:24
*** Goneri has quit IRC15:24
sshnaidmmarios|rover, thanks, will look15:25
sshnaidmrlandy, we have http://38.145.34.141/rcm-guest/images/redhat8/master/rdo_trunk/tripleo-ci-testing/overcloud-full.tar in release file: https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/RedHat-8/promotion-testing-hash-master.yml#L31-L3215:25
rlandynot resolving15:27
rlandyonly available on rdo-cloud?15:27
rlandysshnaidm: ^^15:27
weshayrfolco|ruck no action required, /me notes..  http://mirror.bhs1.ovh.openstack.org  is causing some containers to fail to be pulled15:28
sshnaidmrlandy, yep15:28
sshnaidmrlandy, but what we don't have, it's md5 files for these images.. https://github.com/openstack/tripleo-quickstart/blob/master/roles/fetch-images/tasks/fetch.yml#L7215:28
rlandynot sure how we verify that then15:28
sshnaidmrlandy, you can try to run curl from any host in tripleo-infra, like jumphost or hubbot15:29
sshnaidmThe requested URL /rcm-guest/images/redhat8/master/rdo_trunk/tripleo-ci-testing/ironic-python-agent.tar.md5 was not found on this server15:29
sshnaidmrlandy, no md5 ^^15:29
sshnaidmrlandy, so wee need either put there md5 for these files or to build images15:30
rlandysshnaidm: well  depends what you want to test atm15:30
sshnaidmrlandy, not sure who did upload these images there, weshay maybe?15:30
rlandyis it building images/usin images or the rest of the test15:30
sshnaidmrlandy, I'd like to test just ovb workflow asap15:31
rlandysshnaidm: I think marios|rover15:31
weshayovercloud images.. for rhel8.. maybe panda or marios|rover15:31
rlandysshnaidm: your fastest then is to build images15:31
weshayrlandy ?15:31
marios|roversshnaidm: rlandy https://tree.taiga.io/project/tripleo-ci-board/task/1167?kanban-status=153816615:31
rlandyunless we download calculated md515:31
rlandyand upload15:31
sshnaidmrlandy, well.. although I added rhel8 support to build role, I'm not sure it's working now..15:31
rlandymarios|rover: do you have md5 somewhere15:32
sshnaidmrlandy, yeah, better to calculate it15:32
marios|roverrlandy: i do not :/ and i no longer have the vm i think15:32
marios|roverrlandy: let me check (the vm with the built images i mean)15:32
weshaysshnaidm https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master%20&job_name=periodic-tripleo-rhel-8-buildimage-overcloud-full-master%0915:32
rlandythen we need to rebuild, calculate upload15:32
weshayya.. periodic has never worked15:32
weshaywho is looking at that?15:32
sshnaidmweshay, https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-rhel-8-buildimage-overcloud-full-master%0915:33
sshnaidmweshay, it works, just need a few patches to merge15:33
sshnaidmweshay, ah, w/o upload though15:33
weshayk..15:34
sshnaidmweshay, waiting for this to work: https://review.opendev.org/#/c/672750/15:34
marios|roverrlandy: sshnaidm i have the vm with the built images still around15:34
weshaysshnaidm and panda have the overcloud images tasks assigned on the board15:34
marios|rovercan't believe it wasn't wiped yet15:34
marios|roverrlandy: giving you details in pvt now (does it help you if you can work there?)15:35
marios|roversshnaidm: ^ ?15:35
rlandymarios|rover: cal you calculate and up load md5?15:35
sshnaidmmarios|rover, we just need to put there md5 files of each image15:35
sshnaidmmarios|rover, in the same directory, like ironic-python-agent.tar.md515:35
rlandymarios|rover,  so we can test at least one workflow15:35
marios|roversshnaidm: rlandy ok let me try it now gimme few15:35
rfolco|ruckweshay, isn't this one? 401 http error (OVH) strikes again on gate - https://bugs.launchpad.net/tripleo/+bug/183738815:36
openstackLaunchpad bug 1837388 in tripleo " tripleo-ci jobs failing intermittently with "Image prepare failed: 401 Client Error: Unauthorized" " [High,Triaged] - Assigned to Marios Andreou (marios-b)15:36
rfolco|ruckbrb15:36
marios|roversshnaidm: rlandy to be clear we mean of the .tar files not the individual files right?15:38
sshnaidmmarios|rover, yes15:38
marios|roversshnaidm: k, startng up rdo vm to update the rcm guest15:38
marios|rover(only access from rdo )15:38
sshnaidmrlandy, but I see it tries wrong link anyway: Get image expected checksum:   "http://images.rdoproject.org/master/rdo_trunk/65570a311e1303d8084d12ee82868e6d0f411e8a_41250740/overcloud-full.tar.md5"15:39
zbrrlandy: easy https://review.rdoproject.org/r/#/c/21648/15:42
rlandyperiodic is looking for the hash15:42
rlandyzbr: done15:43
zbrrlandy: thanks!15:43
rlandyimage.url15:44
sshnaidmrlandy, I thought it can be overwritten in release file15:46
rlandyit should be15:46
rlandylooking15:46
marios|roversshnaidm: rlandy which path are we using images/rhel8/master/rdo_trunk/tripleo-ci-testing/15:49
marios|roveror images/redhat815:49
rlandyoh here we go again15:49
sshnaidmmarios|rover, http://38.145.34.141/rcm-guest/images/redhat8/master/rdo_trunk/tripleo-ci-testing/overcloud-full.tar15:49
marios|roversshnaidm: k15:50
sshnaidmrlandy, weshay take a look at fix for promotion file: https://review.opendev.org/#/c/67373815:51
marios|roversshnaidm: rlandy k should be there now, just confirming15:54
rlandysshnaidm: let's try the job again once we have the md5s and see if it still looks for hash tag15:55
sshnaidmmarios|rover, got it , thanks!15:56
sshnaidmrlandy, it will use hash tag15:56
marios|roverhttp://paste.openstack.org/raw/755179/15:56
sshnaidmrlandy, need to understand why15:56
marios|roversshnaidm: rlandy to be clear 18:58 < marios|rover> http://paste.openstack.org/raw/755179/15:56
marios|roversshnaidm: rlandy it looks ok? ^15:56
sshnaidmmarios|rover, yeah, checked it with curl, all fine15:57
marios|roversshnaidm: rlandy if you need something else will have to be tomorrow - but will give rlandy info in pvt now in case you need it ( login to the vm with the built images)15:57
sshnaidmmarios|rover, ack, thanks15:57
*** dsneddon has joined #oooq15:58
*** Vorrtex has joined #oooq15:58
* marios|rover almost out16:00
sshnaidmrlandy, http://logs.rdoproject.org/49/21649/7/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/a4a3671/logs/undercloud/var/log/extra/dump_variables_vars.json.txt.gz16:00
sshnaidmrlandy, look for "images":16:00
rlandy "url": "http://images.rdoproject.org/master/rdo_trunk/tripleo-ci-testing/overcloud-full.tar"16:01
rlandylooks right16:01
*** dsneddon has quit IRC16:02
rlandysshnaidm: worth rebasing? https://review.rdoproject.org/r/#/c/21649/16:02
rlandyrepo fix: Depends-On: https://review.opendev.org/#/c/673738 to_build: Depends-On: https://review.opendev.org/#/c/673738/16:03
rlandysshnaidm: ^^ wrong16:03
sshnaidmrlandy, yeah, fixing..16:04
sshnaidmrlandy, but I can't add your patch with "periodic", there is already tripleo-ci patch in chain..16:07
sshnaidmrlandy, too much deps16:07
rlandysshnaidm: k - as long as the patches we need to test are there16:07
sshnaidmrlandy, need to wait this to merge: https://review.opendev.org/#/c/672528/16:08
sshnaidmrlandy, but let's try with check..16:08
rlandyk16:10
*** marios has quit IRC16:11
*** marios|rover has quit IRC16:11
chandankumarrlandy: sshnaidm https://review.opendev.org/#/c/673021/ os_tempest ansible 2.8 fix16:11
sshnaidmrfolco|ruck, btw https://review.rdoproject.org/zuul/builds?job_name=sova-tracking-jobs16:11
rlandychandankumar: ok if I w+ that?16:16
chandankumarrlandy: yes, thanks!16:16
rlandydone16:16
rlandylunch - biab16:16
chandankumarsshnaidm: https://review.rdoproject.org/r/#/c/21659/ docker fix for container build job16:16
*** dtantsur is now known as dtantsur|afk16:19
rfolco|rucksshnaidm, what does sova-tracking-jobs do?16:26
chandankumarsshnaidm: rlandy does rhel8 jobs will be automatically appear in cockpit or sova or we need to make some changes?16:27
sshnaidmchandankumar, need to add, see  https://review.rdoproject.org/zuul/builds?job_name=sova-tracking-jobs - it checks if there are jobs not in sova <- rfolco|ruck16:28
rfolco|rucksshnaidm, interesting16:29
zbrdo we have a document with github usernames from our team?16:30
*** Vorrtex has quit IRC16:30
sshnaidmzbr, no, why?16:33
chandankumartime to log out now see ya16:36
*** chandankumar is now known as raukadah16:36
zbrsshnaidm: i want to give ssh access to a machine to others from the team and I need to loop over their github accounts (to get the keys). Already did it for those on which i knew the accounts.16:36
zbrgithub is a great way to get someones public key.16:36
weshayrfolco|ruck tripleo-ci-centos-7-scenario009-multinode-oooq-container is currently marked non-voting but it's running in the gate16:38
weshayrfolco|ruck can you double check is non-voting every where and remove it from gate zuul defs16:38
weshayrfolco|ruck see the current gate queue16:39
weshayhttps://review.opendev.org/#/c/673254/16:39
rfolco|ruckweshay, ok you mean all jobs non voting should be check only16:39
weshayrfolco|ruck correct16:39
*** panda has quit IRC16:39
rfolco|ruckweshay, you want a manual check or a git hook ?16:40
rfolco|ruckwell.. not sure if even possible16:40
rfolco|rucklet me think more about it16:40
rfolco|ruckdoing manual this time16:40
*** ykarel is now known as ykarel|away16:40
*** panda has joined #oooq16:41
*** bogdando has quit IRC16:44
*** dsneddon has joined #oooq16:48
sshnaidmzbr, keys are there: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/tenant_vars/common.yml#L31-L5116:49
*** jtomasek has joined #oooq16:50
zbrsshnaidm: thanks. for personal usage I prefer github as is more dynamic. if someone's key is compromised, i don't need to update any code.  anyway I managed to identify gh accounts for everyone but marios.16:52
sshnaidmzbr, https://github.com/openstack/tripleo-quickstart/graphs/contributors16:53
sshnaidmzbr, you can see marios: https://github.com/marios16:53
sshnaidmzbr, the simplest as it could be)16:53
zbrnow I feel stupid. i did try only normal search.16:53
*** jpena is now known as jpena|off16:57
*** derekh has quit IRC16:57
rlandysshnaidm:  "http://images.rdoproject.org/master/rdo_trunk/65570a311e1303d8084d12ee82868e6d0f411e8a_41250740/overcloud-full.tar.md5"16:59
rlandystill16:59
rlandyweird16:59
sshnaidmrlandy, yeah, gotta run, will look tomorrow..17:00
*** sshnaidm is now known as sshnaidm|afk17:00
rlandysshnaidm: k - I'll check into it17:00
rlandy "/home/zuul/images-cache/latest-overcloud-full.tar"17:04
*** amoralej is now known as amoralej|off17:05
sshnaidm|afkweshay, take a look please, worth to do before vexxhost: https://tree.taiga.io/project/tripleo-ci-board/issue/1197?kanban-status=202773317:05
* sshnaidm|afk out17:05
weshaysshnaidm|afk k..17:06
rlandy2019-07-31 12:32:18.991104 | primary | Wednesday 31 July 2019  12:32:18 -0400 (0:00:00.047)       0:04:56.865 ********17:06
rlandy2019-07-31 12:32:19.091047 | primary | included: /home/zuul/src/opendev.org/openstack/tripleo-quickstart/roles/fetch-images/tasks/fetch.yml for undercloud => (item={'name': 'overcloud-full', 'url': 'http://images.rdoproject.org/master/rdo_trunk/65570a311e1303d8084d12ee82868e6d0f411e8a_41250740/overcloud-full.tar', 'type': 'tar'})17:06
*** ykarel|away has quit IRC17:06
rlandythere it is17:06
*** udesale has quit IRC17:27
*** aakarsh|3 has quit IRC17:31
*** gkadam has joined #oooq17:43
rlandysshnaidm|afk: here is the problem ... https://github.com/openstack/tripleo-ci/blob/5c20f182fb7d8dadde9a84ffe1c834cb17d73be4/toci-quickstart/config/testenv/ovb-rdocloud.yml#L1717:49
rlandygrumble - why is this defined here???17:51
rlandyand they are defined here ...18:01
rlandyhttps://github.com/openstack/tripleo-ci/blob/master/toci-quickstart/config/testenv/ovb.yml#L5918:01
rlandysigh ...18:02
rlandygoing to have to remove both18:02
rlandywhich may kill ovb elsewhere18:02
*** tesseract has quit IRC18:05
zbrweshay: rlandy: example of pre-adding empty molecule job: https://review.opendev.org/#/c/673859/18:06
*** aakarsh has joined #oooq18:11
rlandysshnaidm|afk: https://review.opendev.org/673891 DNM: Remove image path definitions from OVB settings file18:11
rlandyrechecking18:13
*** altlogbot_0 has quit IRC18:19
*** altlogbot_2 has joined #oooq18:19
*** gkadam has quit IRC18:23
zbrrlandy: weshay: what do you think about https://review.opendev.org/#/c/657607/ ? -- pure-python selinux proved to be quite stable,18:41
rlandywill look in a few18:42
weshayzbr that is cool18:42
*** jfrancoa has joined #oooq18:46
*** jtomasek has quit IRC18:51
*** jfrancoa has quit IRC19:11
*** pipr has joined #oooq19:20
jdennisthe gate check "tripleo-quickstart-extras-gate-master-delorean-full-featureset052" is consistently failing because it can't do a git fetch, "git fetch --tags --progress ssh://rdo-ci@review.opendev.org:29418/openstack/ansible-role-collect-logs.git refs/changes/62/671262/2", which results in this: "stderr: fatal: Couldn't find remote ref refs/changes/62/671262/2", any help with getting this resolved would be appreciated.19:24
rlandyjdennis: don;t worry about that test19:24
rlandyit should be removed imho19:24
rlandyweshay: rfolco|ruck: ^^ fyi19:25
weshaythat's from ci.centos I think19:25
* weshay looks19:25
rlandyyes it is19:26
rlandyit's never passed19:26
rlandybut /me gets off my soapbox about failing tests19:26
weshayrlandy ya.. maybe I'll try and get that running to some degree19:26
jdennisrlandy: but I think it's voting check isn't it?19:26
weshayjdennis it's 3rd party and not blocking you19:26
rlandyno  - only upstream votes19:27
weshaywe need real infra19:27
rlandyjdennis: ^^ won't impact your job19:27
rfolco|ruckweshay, rlandy panda: disable-fedora patches: https://review.rdoproject.org/r/#/q/topic:disable-fedora+(status:open+OR+status:merged)19:29
jdennisrlandy: does that mean this review has passed the checks? It's not obvious to me it has https://review.opendev.org/#/c/671262/219:29
weshayjdennis I have disabled that job for now.. until we have time to address it19:30
weshayjdennis the jobs that will vote and matter are here http://zuul.openstack.org/status19:31
weshayplug in 67126219:31
weshayinto the text box on the top left19:31
weshayjdennis atm.. you are failing on openstack-tox-linters FAILURE in 4m 53s19:31
weshayjdennis http://logs.openstack.org/62/671262/1/check/openstack-tox-linters/edd9d67/job-output.txt.gz#_2019-07-30_15_42_20_16866719:32
rfolco|ruckjdennis, it does not prevent your patch to merge... look at other patch that just merged https://review.opendev.org/#/c/673418/, also failed that test19:32
weshayjdennis I think we can land your patches once the linter is ok w/ it19:38
*** kopecmartin is now known as kopecmartin|off19:41
jdennisweshay: I already fixed the linter issue in the current patch set but I didn't see any gate check info on the review page, but I can see from the zuul status that's because it's still queued after 2:30 minutes, it would be nice if the review page showed what is queued as opposed to what is complete, but that's another story ...19:42
*** pipr has quit IRC19:42
weshayjdennis there is a grease monkey plugin that does that for you19:42
weshayI haven't used it in a while, but can look for it19:42
weshayjdennis https://gist.github.com/mpeterson/bb351543c4abcca8e7bb1205fcea4c7519:43
weshayit used to work decently19:43
jdennisweshay: thanks19:43
weshayrlandy I think we can review https://review.opendev.org/#/c/671567/19:44
weshayjdennis ah.. requirements.txt19:45
weshayjdennis the issue harry is raising here is.... mirrors.. all the various cloud providers setup mirrors.. this could be a problem19:46
weshayas this role may not get cached properly, but we'll see19:46
weshayjdennis you could get it into openstack.dev/x19:47
rlandysorry had to clean out drains outside so apt doesn't flood with rainstorm  ... looking19:48
weshayjdennis would like to see the ipa jobs working as well19:48
jdennisweshay: my understanding is the proper way to used a galaxy role is via ansible-galaxy install but oooq doesn't invoke this anywhere so I'm at a loss for the right way to get a galaxy role installed19:48
zbrrlandy: can you abandon https://review.opendev.org/#/c/635459/ ? is obsolete.19:49
weshayjdennis you are not wrong19:49
rlandyyep19:49
weshayhowever there are some reasons why we have it setup a such, and are not using galaxy19:49
rlandyweshay: you're ok with adding a personal repo? agre with harry's comment19:51
zbrjdennis: that remark about installing roles is true. galaxy install is not used, even if it should. few people started to add requirements.yml files to the roles but the effort was partial and lacked any testing.19:51
weshayrlandy not really..  but I'm wondering how well this will work tbh19:51
weshayjdennis I'm willing to help you guys out.. but ideally you guys should get that role mirrored into opendev.org/x19:52
*** jtomasek has joined #oooq19:53
weshayjdennis technically speaking... if we don't have.. and we being ( tripleo core ) not just this team.. don't have access to update the role... it's not allowed19:53
* weshay see's if I can find doc19:53
rlandyI marked it -1 - if I am blocking the world here, let me know19:53
weshayk19:54
jdennisweshay: we can do that for this one role I suspect but I'm worried this is the wrong direction to take, don't we want to leverage all the public roles in galaxy instead of building a silo?19:54
weshayrlandy 039 is 3rd party only isn't it?19:54
rlandyweshay: ack - only rdocloud19:54
*** pipr has joined #oooq19:54
weshayzbr perhaps you can comment on upstreams use of galaxy roles?19:55
rlandyhmm - ok - ovb is as far as undercoud install19:55
rlandygetting somewhere19:55
weshayzbr what does the infra team usually say about that19:55
weshayrlandy NICE19:55
zbrweshay: i think nothing. i did not see any discussions about galaxy. i doubt they would be against but there are some problems.19:56
zbronce you start using galaxy you cannot install from local disk, so it does not work with gerrit depends-on19:57
weshayya.. good point19:57
zbralso another issue: galaxy install also presents some testing challenges with virtualenv. as you cannot really contain the test environment (or not easily)19:58
*** ade_lee has joined #oooq19:58
zbrhere is one example I encountered today: https://review.opendev.org/#/c/673859/2/requirements.yml19:58
zbrgalaxy needs scm or it would choke, but was missing, a proof that there was no test regarding installation.19:59
zbrthis role depends not only on these two external roles, but also on modules that are included in dependencies.19:59
zbrif you check role meta it lists no dependencies....20:00
zbrshortly: a mess.20:00
weshayjdennis it's a large system..  can't really tell you we make all the rules20:00
zbrbut we should slowly go in right direction and fix that.20:00
weshayzbr it looks like infra is saying not to add projects to opendev.org/x atm20:00
* weshay checks in channel20:01
*** aakarsh has quit IRC20:01
*** pipr has quit IRC20:01
rlandyhmmm ... ok Not found image: docker://trunk.registry.rdoproject.org/tripleomaster/rhel-binary-swift-proxy-server:65570a311e1303d8084d12ee82868e6d0f411e8a_4125074020:03
*** pipr has joined #oooq20:03
*** redrobot has joined #oooq20:03
weshayjdennis sounds like the infra team is cool w/ new projects getting added20:04
rlandyhttps://console.registry.rdoproject.org/registry#/images/tripleomaster20:05
rlandyrfolco|ruck: ^^ should i expect rhel containers here?20:05
rfolco|ruckrlandy, yes, if nothing changed this week20:06
rlandyrfolco|ruck: help - dont see any20:06
rfolco|ruckrlandy, it takes a while to refresh20:06
rlandyoh - now I do20:07
rfolco|ruckI see20:07
rfolco|ruckhttps://console.registry.rdoproject.org/registry#/images/tripleomaster/rhel-binary-aodh-base20:07
rfolco|ruckyep20:07
rfolco|ruckslow20:07
rlandyno kidding20:07
jdennisweshay, zbr: do I understand then this change is blocked until we move the source for the role to opendev.org it's blocked?20:07
weshayrfolco|ruck anything going on w/ rdo-cloud20:07
weshayresults are coming back really crappy20:07
rfolco|ruckweshay, what are you seeing ?20:08
weshayrfolco|ruck red20:08
rfolco|rucklooking20:08
rlandyhow often do we push rhel?20:08
rlandy Exception: Not found image: docker://trunk.registry.rdoproject.org/tripleomaster/rhel-binary-swift-proxy-server:65570a311e1303d8084d12ee82868e6d0f411e8a_4125074020:08
weshayjdennis I'm trying to help here, let me confirm w/ some other cores20:08
rlandy20:08
rlandy5815d9478116cfa01509242232fd197aa5021c9f_dc0a2c9a20:08
rlandy20:08
rlandypushed image20:08
rlandy20:08
rlandysha256:593c747c867c84fcd7ecad4489d6fc3d16263b2dfaf151940f509e8fbe47aad920:08
rlandy20:08
rlandya day ago20:09
rlandy20:09
rlandyc17d2177ce6a05e4290224d99126a0f39c601b4e_23df877320:09
rlandy20:09
rlandypushed image20:09
rlandy20:09
rlandysha256:8d706cbe63df5ba5fe2ced470853d3c11c38877d4041ccde6f6193f2974c466420:09
rlandy20:09
rlandy7 hours ago20:09
rlandyexist20:09
zbras a personal node, the way we put each role in its own repository is a maintenance headache, making testing harder and especially consolidating coding practices (linting, testing, packaging).20:10
weshayjdennis I'll get back to you20:11
weshayrlandy I have to set out for a few.. bb in about an hour20:11
jdennisweshay: thank you, fwiw you might want to ping nkinder as well, he is my manager and the author of the role20:11
rlandyweshay: k - np20:12
rfolco|ruckweshay,2019-07-31 08:54:44 | rpc error: code = 2 desc = oci runtime error: exec failed: container_linux.go:235: starting container process caused "exec: \"{utest:\": executable file not found in $PATH"20:12
*** jrist has quit IRC20:12
rfolco|ruckseeing this in multiple jobs20:12
rfolco|ruckhttp://logs.rdoproject.org/05/669605/8/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/cd41f86/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz20:12
*** jrist has joined #oooq20:27
*** jrist has quit IRC20:28
*** jrist has joined #oooq20:30
*** jrist has quit IRC20:30
*** jtomasek has quit IRC20:41
rlandyrfolco|ruck: the error is correct ...20:49
rlandy tripleomaster/rhel-binary-swift-proxy-server  is missing the hash that other containers have20:49
rlandydo you know why?20:50
rlandyA new hash is pushed - why is tripleo-ci-testing still the old hash?20:53
weshayjdennis sorry I have updated my review..  as a temp workaround we could drop the ansible-keycloak role directly into tqe, we could build a rpm for rdo, or create a project on opendev.org that mirrors nkinders role21:26
rlandyweshay: ther error above is correct  docker://trunk.registry.rdoproject.org/tripleomaster/rhel-binary-swift-proxy-server is missing the hash 65570a311e1303d8084d12ee82868e6d0f411e8a_4125074021:34
rlandythe other containers have that hash ...21:35
rlandybut there is a new hash21:35
rlandyhttps://trunk.rdoproject.org/rhel8-master/tripleo-ci-testing/21:35
rlandydo we do the tagging manually?21:35
rlandythe undercloud install is failing on a legit error21:35
rlandythere is a new hash pushed 8 hours ago21:36
weshayrlandy no.. the tagging is done in the build21:38
rlandyweshay: do you see what I am talking about though?21:38
weshayrlandy not yet.. just brought up some lunch21:39
* weshay looks21:39
weshayrlandy OH21:39
weshayrlandy so there's a bug or something not merged w/ the ci-testing-hash job21:40
weshayit's not creating the updated link the rhel dlrn21:40
rlandyok21:40
rlandyso there are two problems21:40
rlandy1. no updated link21:40
rlandyand 2. not all containers have all the hashes21:40
rlandyeither way, the error is legit21:41
* weshay looks at the last build21:41
weshaytoo many tabs21:41
weshayrlandy http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-7-master-promote-consistent-to-tripleo-ci-testing/85730c3/job-output.txt.gz21:42
weshaysee rhel is getting skipped because the hash was not found21:42
* weshay checks the two dlrns21:42
rlandyyeah21:43
weshaythey look in sync to me21:43
rlandy2019-07-31 18:22:37.811308 | rdo-centos-7 | commit 348374f5d244990b3db6825c7d388339a3e0294f / distro 23df87739b135962420d319d6dce3fe46f9d752f combination not found in RHEL21:43
weshayhttps://trunk.rdoproject.org/rhel8-master/report.html21:43
weshayhttps://trunk.rdoproject.org/centos7-master/report.html21:44
rlandybut there is a new hash21:44
weshayrlandy it's there https://trunk.rdoproject.org/rhel8-master/34/83/348374f5d244990b3db6825c7d388339a3e0294f_23df877321:45
weshayrlandy we have a bug in that code21:45
weshayrlandy we should print out the url it's checking21:46
rlandyI am nit sure exactly what https://trunk.rdoproject.org/rhel8-master/34/83/348374f5d244990b3db6825c7d388339a3e0294f_23df8773 is proving21:47
rlandynot21:47
rlandyhttps://trunk.rdoproject.org/rhel8-master/tripleo-ci-testing/21:47
rlandyis what is being picked up21:47
rlandyand21:47
weshayrlandy we should see trunk.registry.rdoproject.org/tripleomaster/rhel-binary-swift-proxy-server:c17d2177ce6a05e4290224d99126a0f39c601b4e_23df8773 push successfully!21:47
weshay2019-07-31 17:59:462019-07-31 17:40:34python-tripleoclient21:48
rlandyhttps://console.registry.rdoproject.org/registry#/images/tripleomaster/rhel-binary-swift-proxy-server21:48
rlandyhas that hash21:48
weshay2019-07-31 18:28:582019-07-31 17:40:34python-tripleoclient21:48
rlandynot tagged tripleo-ci-testing21:49
weshayrlandy the build of that rpm.. to get into both systems took 30 min21:49
weshayso that's probably the bug21:49
weshaynot sure how long to wait21:49
weshayrlandy want to blue?21:49
rlandyweshay: k - let's blue so we can confirm exact error21:50
weshayrlandy eview.rdoproject.org/config/playbooks/tripleo-ci-base-promote-consistent-to-tripleo-ci-testing/run.yaml@master22:02
rlandyweshay: https://review.rdoproject.org/r/#/c/21649/22:05
*** vinaykns has quit IRC22:07
*** tosky has quit IRC22:13
rlandyweshay: sshnaidm|afk: pls see https://review.rdoproject.org/r/2166922:14
weshayrlandy nit on comment22:16
rlandyweshay: updated22:19
* rlandy needs to run out22:19
*** rlandy is now known as rlandy|bbl22:19
jdennisweshay: what is tqe? But isn't the real answer that oooq should run ansible-galaxy install? It seems to me we should leverage public roles from a trusted site instead of forking the role to meet some arbitrary requirement. I'd be happy to to try adding a patch for utilizing Ansible Galaxy roles, what do you think?22:19
weshayrlandy|bbl perfect.. thanks22:19
weshayjdennis arbitrary requirement we're talking about is upstream openstack policy22:20
weshayjdennis there are several issues here, and I don't think adding a patch that takes roles from ansible galaxy would fix.. although I would be willing to try... we've used ansible galaxy to some degree internally where we were not breaking upstream requirements22:21
weshayjdennis so I can explain more the WHY this is a concern for upstream22:22
jdennisweshay: I'm all ears22:22
weshaya similar situation can be seen w/ pypy.. right22:22
jdennisweshay: sure22:22
weshayso we take python modules.. into upstream openstack global requirements...  sometimes those break22:22
weshayupstream infra has the tooling to test, mirror and pin python dep requirements across the whole system...22:23
weshayso when it breaks they can respond quickly22:23
weshaylet's pretend for a moment that nkinder's role has been working for months.. np.. I'm sure it would22:23
weshayif it broke something in just our CI perhaps not in the molecule tests etc.. used in the repo.. we would be beholden to you both for a path while the openstack ci bleeds22:24
weshaythis is a third party job.. so it's not terrible22:24
weshayit would never prevent a merge..22:24
weshayjdennis I will contend that just because something is in galaxy, it doesn't speak to the quality or it being official.. at least not the last time I looked22:25
weshayI'm sure the role you and nkinder have is high quality and I would very much like to use it22:26
weshayjdennis it makes sense to me that having people on hand 24hr a day available to patch something that may need it to keep CI rolling is a good thing and a good policy.  However not being able to reuse published code is a HUGE disadvantage22:28
weshayjdennis I could pull the src of the role in our 3rd party system22:29
weshayso it doesn't affect upstream22:29
weshayand we can skin this cat that way..22:29
weshaybut we need to do it a slightly different way :)22:29
weshayand afaik it doesn't break policy22:29
weshayjdennis we could pull the code here https://github.com/rdo-infra/rdo-jobs/tree/master/roles22:30
weshayor simply w/ a playbook here https://github.com/rdo-infra/rdo-jobs/tree/master/playbooks22:31
weshayand in the job def22:31
weshayjdennis and we could call the additional playbook via zuul https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/ovb-jobs.yaml#L3822:31
weshayeven better would be if we could pull a "required-project" from a non opendev system.. I need to check on that though22:32
weshayhold on my son needs to be let in22:32
weshaybrb22:32
weshayjdennis.. this is a better way.. because if github goes down.. upstream is still safe and we don't need to clone that role.. for every job22:33
weshayyou are probably shaking your head atm.. and saying wtf22:34
jdennisweshay: yeah, basically it's an entire ecosystem22:34
weshayya.. we have very little control over how things work upstream.. and have to bend it to meet our needs.22:35
weshayit's all free hardware.. so there's that22:35
weshayjdennis anyhoo.. let me work on this a bit and I'll get back to you.. I think I can make this work w/o getting in trouble22:36
weshayall I need to do is get that role in the role path22:36
jdennisweshay: thank you, I appreciate the effort and I'll run this by nkinder and see where he stands on it22:36
weshayk.. sorry for the trouble22:37
jdennisweshay: no problem, it just feels like this is an unaddressed area that needs some attention, we'll get it worked out22:37
weshaytotally.. we've been trying to get ipa + tripleo working together for a long time in the upstream22:38
jdennisweshay: yup, we're well aware of the issues and feel some shared frustration22:39
weshayaye..22:39
jdennisweshay: your help is appreciated22:39
jdennisweshay: time for dinner for me, we'll connect later ...22:40
*** panda has quit IRC23:03
*** panda has joined #oooq23:04
« Tuesday, 2019-07-30 Index Thursday, 2019-08-01 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!