Monday, 2020-10-19

*** holser has quit IRC00:10
*** udesale has joined #oooq03:53
*** ratailor has joined #oooq03:56
*** skramaja has joined #oooq04:00
*** saneax has joined #oooq04:36
*** marios has joined #oooq05:08
*** jfrancoa has joined #oooq05:13
*** apetrich has joined #oooq06:00
*** jfrancoa has quit IRC06:15
*** jfrancoa has joined #oooq06:21
*** jfrancoa has quit IRC06:21
*** ksambor has joined #oooq06:23
*** frenzyfriday has joined #oooq06:23
*** amoralej|off is now known as amoralej06:38
*** holser has joined #oooq06:49
*** jtomasek has joined #oooq06:51
*** sshnaidm is now known as sshnaidm|afk07:00
*** udesale_ has joined #oooq07:16
*** udesale has quit IRC07:19
*** jpena|off is now known as jpena07:20
*** holser_ has joined #oooq07:27
*** holser has quit IRC07:28
*** tosky has joined #oooq07:29
zbrmorning!07:56
zbrafaik, i fixed molecule 3.1.x over the weekend and it should no longer need pinning down but let me know if if you still see a failure.07:56
*** holser_ has quit IRC07:57
bhagyashriszbr, molecule jobs are still failing on ci-config repo patches on rdo so i have posted same fix https://review.rdoproject.org/r/#/c/30358/ that post on upstream but two jobs are failing on that fix can you please help there to fix those jobs07:59
bhagyashriszbr, here the molecule jobs are failing https://logserver.rdoproject.org/96/30296/3/check/mol-promote_images/0ff58e9/job-output.txt08:01
bhagyashrispatch link: https://review.rdoproject.org/r/#/c/30296/ in the recent run it passed because of https://review.rdoproject.org/r/#/c/30358/08:01
bhagyashrisbut the on fix https://review.rdoproject.org/r/#/c/30358/ itself two jobs are failing and there i need help to fix those jobs08:02
*** udesale_ has quit IRC08:11
*** jbadiapa has joined #oooq08:15
arxcruzfrenzyfriday: willkommen :)08:23
*** yolanda has quit IRC08:24
*** yolanda has joined #oooq08:24
*** derekh has joined #oooq08:49
bhagyashriszbr, marios chandan_kumar can ypu please merge this https://review.rdoproject.org/r/#/c/30325/ this is last patch remaining from pipeline renaming task. Thank you :)09:00
*** udesale has joined #oooq09:03
zbrbhagyashris: obviously that yes, but i am not allowed to self-approve-merge it :D09:11
mariosbhagyashris: looking09:14
*** sshnaidm|afk is now known as sshnaidm09:37
marioszbr: chandan_kumar: is that tox molecule thing cleared now? https://review.opendev.org/#/c/755472/1509:44
mariosrechecked ^^^ ran on saturday and failed09:44
chandan_kumarmarios: yes, it got cleared09:45
marioschandan_kumar: ack thanks let's see09:45
*** dtantsur|afk is now known as dtantsur09:55
zbrbhagyashris: i need to skip scrum today, anything i need to update on jira?10:11
chandan_kumarsshnaidm: Hello10:12
sshnaidmchandan_kumar, hi10:12
sshnaidmchandan_kumar, you got an underscore :)10:12
chandan_kumarsshnaidm: sometime content provider jobs returns ipv6 address, is there a way we can handle that?10:13
sshnaidmchandan_kumar, yeah10:13
sshnaidmchandan_kumar, do you have an example?10:13
chandan_kumarsshnaidm: https://0dc6dce67e17cc56cbee-22a46b7f7ce23fe9b2117d76fd7c738d.ssl.cf5.rackcdn.com/758214/4/check/tripleo-ci-centos-8-undercloud-containers/5ae5853/logs/undercloud/home/zuul/containers-prepare-parameter.yaml10:14
chandan_kumarsshnaidm: https://review.opendev.org/#/c/758214/10:15
chandan_kumarsshnaidm: content provider job: https://f403944d55719e7cfe6c-df5c6a1955c44f25aa7b89c1bb1d5cd3.ssl.cf5.rackcdn.com/758214/4/check/tripleo-ci-centos-8-content-provider/28af7b4/job-output.txt10:16
bhagyashriszbr, nope all tickets are updated ..10:20
bhagyashriszbr, have received my msg10:21
bhagyashriszbr, molecule jobs are still failing on ci-config repo patches on rdo so i have posted same fix https://review.rdoproject.org/r/#/c/30358/ that post on upstream but two jobs are failing on that fix can you please help there to fix those jobs10:21
bhagyashriszbr, here the molecule jobs are failing https://logserver.rdoproject.org/96/30296/3/check/mol-promote_images/0ff58e9/job-output.txt10:21
bhagyashrispatch link: https://review.rdoproject.org/r/#/c/30296/ in the recent run it passed because of https://review.rdoproject.org/r/#/c/30358/10:21
zbrbhagyashris: i am looking now at them.10:21
bhagyashrisbut the on fix https://review.rdoproject.org/r/#/c/30358/ itself two jobs are failing and there i need help to fix those jobs10:21
bhagyashristhis one10:21
mariosbiab10:30
*** marios has quit IRC10:30
*** jfrancoa has joined #oooq11:18
*** ysandeep is now known as ysandeep|coffee11:23
*** marios has joined #oooq11:30
*** jpena is now known as jpena|lunch11:32
arxcruzweshay: are you around? we have a meeting now right ?11:35
zbrweshay: what is the official way to install ansible on centos?11:38
zbrbecause while it states that dnf install ansible in the docs (worked for me locally), it failed on rdo: https://review.rdoproject.org/zuul/build/92967e5f5dd744a09e7446e45e4e6f3f11:38
sshnaidmchandan_kumar, well, this is more complex than I thought.. let's discuss it in todays mtg11:47
chandan_kumarsshnaidm: yes11:47
weshayarxcruz, is Ananya here?11:47
arxcruzweshay: frenzyfriday11:47
weshayarxcruz, that mtg was just a reminder11:47
weshaysorry for the confusion11:48
arxcruzok11:48
frenzyfridayHey Wes, this is Ananya11:48
weshayOH11:49
weshayright..11:49
weshayfrenzyfriday, WELCOME Ananya :))11:50
weshayfrenzyfriday, ok.. cool we have a group mtg at 1pm UTC just invited you11:51
chandan_kumarfrenzyfriday: Welcome to Red Hat, Glad to have you in our team :-)11:58
*** chandan_kumar is now known as chandankumar11:58
frenzyfridayThank you :D11:58
*** amoralej is now known as amoralej|lunch12:01
*** rlandy has joined #oooq12:03
chandankumarsshnaidm: is this one a known issue async task did not complete within the requested time - 5700s ? https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d3a/752421/89/check/tripleo-ci-centos-8-content-provider-train/d3a1cf1/job-output.txt12:04
*** rlandy is now known as rlandy|rover12:05
sshnaidmchandankumar, yes12:05
*** rfolco has joined #oooq12:06
chandankumarweshay: bhagyashris's internet network went down due to cable cut12:08
sshnaidmchandankumar, there is an opened bug about it12:09
sshnaidmsoniya29 opened it ^12:09
*** ysandeep|coffee is now known as ysandeep12:11
ysandeepfrenzyfriday, Hi o/ Welcome Ananya :)12:12
ysandeepweshay, rlandy|rover hey https://code.engineering.redhat.com/gerrit/#/c/215284/ broke downstream jobs, i have replied on the email with details12:13
weshayya12:13
weshayysandeep, rlandy|rover you folks can revert all of that12:13
weshaywould be nice to know how that is failing12:14
ysandeepweshay, rlandy|rover need force merge https://code.engineering.redhat.com/gerrit/#/c/215369/12:14
ysandeepweshay, zuul is not looking for roles in sf-config repo.12:14
weshayysandeep, probably not that one12:14
weshaysec12:14
rlandy|roverysandeep: I can't override zuul12:14
rlandy|roverysandeep: nhicher can12:14
ysandeeprlandy|rover, weshay  Do you think its better to add the openvswitch role to tripleo-ci-internal-config repo and not use openstack/sf-config where we have base roles for SF's base jobs only.12:15
ysandeepalternative - https://code.engineering.redhat.com/gerrit/#/c/215369/12:15
weshayysandeep, revert the playbook that calls the role https://code.engineering.redhat.com/gerrit/#/c/215284/12:15
ysandeepweshay, yes i mean revert of ^^ , https://code.engineering.redhat.com/gerrit/#/c/215365/ sry wrong copy paste12:16
*** dmellado has joined #oooq12:16
rlandy|roverysandeep: weshay: we can't get any of this through12:17
rlandy|roverwe need to get the admins to force merge the reverts12:17
ysandeepweshay, rlandy|rover: ^^ please add your vote on ^^ , i will ping nhicher for force merge12:17
rlandy|roverysandeep: done12:17
ysandeeprlandy|rover: thanks!12:18
weshayfolks I'm onboarding frenzyfriday12:20
weshaynot available12:20
bhagyashrisfrenzyfriday, : Wel-Come to Red Hat! :)12:21
mariosanyone else having issues with git pull tripleo-ci repo?12:22
marioso/ frenzyfriday welcome aboard12:22
rlandy|roversoniya29: hi - did you get any info about fs039?12:26
*** jpena|lunch is now known as jpena12:27
*** rlandy|rover is now known as rlandy|rover|mtg12:30
zbrbhagyashris: rlandy|rover|mtg: ci-config does not need pinning down of molecule, https://review.rdoproject.org/r/#/c/30044/ fixes it.12:31
sshnaidmarxcruz, where was this script that cleaned keypairs?12:32
rlandy|rover|mtgabr: cool +212:32
arxcruzsshnaidm: checking12:32
bhagyashriszbr, ack12:33
soniya29rlandy|rover, nope..still debugging the tempest issues12:33
arxcruzsshnaidm: ci-scripts/infra-cleanup/cleanup-keys.sh12:33
rlandy|rover|mtgsoniya29: np - on it12:36
rfolcohttps://review.opendev.org/#/c/758214/12:37
arxcruzweshay: good news, I was able to add myself on the owners group for tripleoussuri and run the script with my username and password12:38
arxcruzand it worked, i stopped to not push to ussuri the tripleo-master12:38
weshayah nice12:38
marioshttps://review.opendev.org/#/c/755472/ https://review.opendev.org/#/c/753403/ add to your reviews12:39
marioshttps://projects.engineering.redhat.com/browse/TRIPLEOCI-20712:40
*** ratailor has quit IRC12:40
mariosfixed by that? rfolco: https://review.opendev.org/#/c/758214/4/roles/extras-common/defaults/main.yml12:42
mariosarxcruz: https://opendev.org/openstack/tripleo-ci/src/branch/master/playbooks/tripleo-ci/run-provider.yml12:46
mariosakahat: https://opendev.org/openstack/tripleo-ci/src/branch/master/playbooks/tripleo-ci/run-provider.yml12:46
mariossorry arxcruz was by mistake was meant for amol12:50
*** rlandy|rover|mtg is now known as rlandy|rover12:51
rlandy|roverarxcruz: hey12:51
rlandy|roverarxcruz: can you PM which creds you source for the vexxhost script cleanup?12:51
rlandy|roveroh the nodepool one12:53
chandankumarweshay: marios rfolco akahat https://review.opendev.org/#/c/758351/ timestamp review12:55
chandankumarweshay: marios rfolco akahat https://review.opendev.org/#/c/758460/112:56
chandankumarweshay: marios rfolco sshnaidm https://review.opendev.org/#/c/758807/1/roles/container-build/tasks/non_tripleo_containers.yml12:57
rfolcozuul graph freeze issue on https://review.opendev.org/#/c/757889/, tried to fix on https://review.opendev.org/#/c/758627/, no luck yet12:58
rfolcosshnaidm, marios chandankumar weshay akahat please any thoughts on that one ^ ?12:59
akahatchandankumar, rfolco ack.12:59
akahatfrenzyfriday, o/ Welcome!! :)13:00
rfolcoarxcruz, rfolco, zbr, sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, pojadhav, akahat, weshay, chandankumar13:00
rfolcoscrum time13:00
chandankumarhttps://review.opendev.org/#/c/752421/ please review13:04
marioshttps://review.opendev.org/753403 & depends-on: https://review.opendev.org/75547213:04
*** amoralej|lunch is now known as amoralej13:08
ysandeeprlandy|rover, weshay fyi.. jobs are okay now after revert merged - https://code.engineering.redhat.com/gerrit/#/c/215365/13:10
rlandy|roverthanks13:11
rlandy|roverarxcruz: sshnaidm: keypair delete script is running now13:14
sshnaidmrlandy|rover, we need to add it to cron13:15
rlandy|roverack13:15
*** Goneri has joined #oooq13:26
*** Goneri has quit IRC13:27
rlandy|roversoniya29: which tempest failures are you working on?13:29
rlandy|rovercentos7 ones?13:29
chandankumarrlandy|rover: soniya29 ipv6 issue - http://paste.openstack.org/show/799170/ and timestamp issue - http://paste.openstack.org/show/799171/ please copy stuff from pastebin to hackmd13:31
rlandy|roverack13:32
-openstackstatus- NOTICE: Open Infrastructure Summit platform issues are being worked on by OSF events and webdev teams, status updates will be available in the conference "lobby" page as well as the #openinfra-summit channel on Freenode (though it is presently not logged)13:33
*** jtomasek has quit IRC13:34
weshayhttp://promoter.rdoproject.org/config/CentOS-8/victoria.ini13:35
*** Goneri has joined #oooq13:36
rlandy|roverarxcruz: one more for you ...13:36
rlandy|roverhttps://logserver.rdoproject.org/openstack-periodic-integration-stable3-centos7/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-scenario010-standalone-train/cfd7bc0/job-output.txt13:36
rlandy|roveros_tempest : Gather variables for each operating system13:36
rlandy|rover No file was found when using first_found. Use errors='ignore' to allow this task to be skipped if no files are found13:37
rlandy|roverno changes on that13:37
arxcruzrlandy|rover: i just saw this13:37
arxcruzi'll check on os_tempest side13:37
*** Goneri has quit IRC13:37
rlandy|roverany thoughts?13:37
*** Goneri has joined #oooq13:37
rlandy|rovernot many changes there13:37
arxcruzrlandy|rover: I'm investigating with osa guys13:38
rlandy|roverthanks13:38
weshaysshnaidm, https://code.engineering.redhat.com/gerrit/#/c/215365/1/playbooks/base/pre.yaml13:44
ysandeeprlandy|rover, weshay sshnaidm https://softwarefactory-project.io/paste/show/1887/ its not looking for openvswitch in sf-config13:49
weshaysshnaidm, https://code.engineering.redhat.com/gerrit/#/c/215283/1/roles/openvswitch/vars/RedHat.yaml13:49
*** jtomasek has joined #oooq14:01
*** jtomasek has quit IRC14:02
*** frenzyfriday has quit IRC14:03
rlandy|roverarxcruz: https://bugs.launchpad.net/tripleo/+bug/190044314:03
openstackLaunchpad bug 1900443 in tripleo "centos-7 train jobs are failing to find variables for OS - os-tempest" [Critical,Triaged]14:03
arxcruzrlandy|rover: thanks, I found the root cause and i'm already submiting a patch14:03
rlandy|roverarxcruz++14:04
rlandy|roverthanks for helping out here!!!14:04
*** jtomasek has joined #oooq14:04
*** jtomasek has quit IRC14:05
arxcruzrlandy|rover: https://review.opendev.org/#/c/758823/14:05
*** jtomasek has joined #oooq14:05
rlandy|roverarxcruz: I only have +1 there14:06
arxcruzrlandy|rover: sadly me too, but i already ping the cores14:06
rlandy|roverthanks14:06
*** frenzyfriday has joined #oooq14:10
*** sshnaidm is now known as sshnaidm|afk14:12
soniya29rlandy|rover yupp14:22
rlandy|roversoniya29: sorry - to what question? ^^14:23
soniya29rlandy|rover, the tempest failures one14:23
rlandy|roversoniya29: arxcruz put in the fix14:23
mariosweshay: i added a note into https://etherpad.opendev.org/p/tripleo-ptg-wallaby re tool demo let me know if that is OK for now?14:26
mariosweshay: added into both Tue ci sessions14:26
mariosweshay: so we don't forget about it14:26
weshayk.. I have some work to do on it.. maybe today.. it relates to the work rlandy will be presenting for the dependency pipeline14:31
weshayysandeep, https://meet.google.com/mmr-tiks-bxm?authuser=1 you may want to join this call14:31
weshayif ur not checked out for the day14:31
ysandeepweshay, joining14:32
rlandy|roverwoohoo fs039 is baaaaack14:36
*** skramaja has quit IRC14:44
*** rf0lc0 has joined #oooq14:47
*** rfolco has quit IRC14:49
*** jtomasek has quit IRC14:51
*** jtomasek has joined #oooq14:52
zbri am back15:05
rlandy|roverwelcome back15:07
ysandeepweshay, thanks!15:18
*** ysandeep is now known as ysandeep|away15:18
*** udesale_ has joined #oooq15:20
*** udesale has quit IRC15:23
weshaysoniya29, please renick to |ruck or |rover15:28
soniya29weshay, sorry for that, i didnt see the nick15:28
*** soniya29 is now known as soniya29|ruck15:29
weshaysoniya29|ruck, thanks15:29
rlandy|roverweshay: ok if I restart the promoter? - master should be ready to promote now15:34
rlandy|roverperiodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-mastertestprojectmastercheck29969,112 hrs 37 mins 18 secs2020-10-19 12:27:22SUCCESS15:34
rlandy|roverperiodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-mastertestprojectmastercheck29969,112 hrs 51 mins 38 secs2020-10-19 12:27:02SUCCESS15:34
rlandy|rover^^ rerun of failed jobs15:35
weshayrlandy|rover, which one.. promoter.rdo?15:35
weshaysure15:35
rlandy|roverweshay: yep - rdo one - ok by me if you prefer to do it15:35
*** amoralej is now known as amoralej|off15:39
rlandy|roverweshay: hmmm ... says nothing newer than 10/16 - hashes match - maybe that's possible15:44
* rlandy|rover will restart again when train 8 is ready to promote15:44
*** saneax has quit IRC15:57
marios /exit16:01
*** marios has quit IRC16:01
soniya29|ruckweshay: rlandy|rover, so with discussion regarding fs20 queens's tempest failures, the failures are in the neutron's config16:02
rlandy|roversoniya29|ruck: cool - thanks16:02
soniya29|ruckweshay: rlandy|rover, slaweq and I are on it16:02
rlandy|roverhmm ... why are component jobs looking at rdo registry???16:09
rlandy|roverfor train16:09
*** frenzyfriday has quit IRC16:12
*** tosky has quit IRC16:12
*** rf0lc0 is now known as rfolco|brb16:20
*** jpena is now known as jpena|off16:41
*** udesale_ has quit IRC17:01
*** derekh has quit IRC17:02
*** rfolco|brb is now known as rfolco17:29
rlandy|roverweshay: ok - train centos8 can promote now - should address the component pipeline failures17:34
rlandy|roverrestarting promoter ok>17:34
rlandy|roverok?17:34
*** frenzyfriday has joined #oooq17:35
weshayrlandy|rover, ack17:40
rlandy|roverarxcruz: hey ... we got a -1 https://review.opendev.org/#/c/758823/17:50
*** frenzyfriday has quit IRC17:52
*** jmasud has quit IRC17:53
*** dtantsur is now known as dtantsur|afk18:03
rlandy|roverweshay: can you access https://review.rdoproject.org/zuul/status?18:15
rlandy|roverFetching info...18:16
* weshay looks18:16
weshaynope18:16
weshayrlandy|rover, ^18:16
rlandy|roverhttps://mail.google.com/mail/u/0/#label/outage/FMfcgxwKjBGqKXSjzxlnrbBGgWzXNrhS18:17
rlandy|roverrelated?18:17
rlandy|roverweshay: well I guess now is as good a time as any to work on rhos-13 :)18:18
*** apetrich has quit IRC18:19
*** saneax has joined #oooq18:42
*** saneax has quit IRC18:56
rlandy|roverweshay: wrt rhos-13 test ...19:28
rlandy|roverwhat do you want on the held node?19:28
rlandy|roverjust what is installed now? or you want to try the openvswitch change?19:29
*** holser has joined #oooq19:31
*** tosky has joined #oooq19:35
rlandy|roverhttp://git.app.eng.bos.redhat.com/git/openstack/sf-jobs.git/tree/roles19:36
rlandy|roverweshay: ^^ we need to move your role there19:36
* rlandy|rover puts in review19:36
weshayrlandy|rover, well.. let's hold a node and then confirm we can install the right openvswitch19:36
weshayk19:36
rlandy|roverok ... sec ... so19:36
rlandy|roverweshay: so run https://code.engineering.redhat.com/gerrit/#/c/213478/19/zuul.d/layout.yaml and hold that node19:37
weshayaye19:45
*** weshay has quit IRC20:07
*** holser has quit IRC20:10
*** frenzyfriday has joined #oooq20:21
*** frenzyfriday has quit IRC20:26
*** dsneddon has joined #oooq20:38
rlandy|roverweshay: https://code.engineering.redhat.com/gerrit/215418 Add openvswitch role20:48
*** jfrancoa has quit IRC21:07
arxcruzrlandy|rover: it seems to be because i added tripleo-centos-7-standalone job but it is not being executed21:11
arxcruzrlandy|rover: i’ll take a look tomorrow morning ok ?21:11
rlandy|roverarxcruz: great - thanks21:12
*** rfolco has quit IRC21:24
arxcruzrlandy|rover: and quick job that I can add there that runs centos-7 ?22:24
rlandy|roversure22:24
*** jmasud has joined #oooq22:26
*** chem has quit IRC22:32
*** chem has joined #oooq22:34
*** tosky has quit IRC23:16
*** jmasud has quit IRC23:28
*** rlandy|rover has quit IRC23:28
*** jmasud has joined #oooq23:34

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!