Thursday, 2021-02-11

*** tosky has quit IRC00:17
*** dmellado has quit IRC01:03
*** jmasud has joined #oooq01:04
*** dmellado has joined #oooq01:12
*** dmellado has quit IRC02:36
*** jmasud has quit IRC02:47
*** jmasud has joined #oooq02:49
*** jmasud has quit IRC03:00
*** dmellado has joined #oooq03:02
*** jmasud has joined #oooq04:07
*** ratailor has joined #oooq04:20
*** ykarel|away has joined #oooq04:40
*** ykarel|away is now known as ykarel04:41
*** ysandeep|away is now known as ysandeep|rover05:09
*** udesale has joined #oooq05:20
*** marios has joined #oooq06:05
*** jpodivin has joined #oooq07:13
*** slaweq has joined #oooq07:44
*** ykarel has quit IRC07:44
*** ykarel has joined #oooq07:46
*** ysandeep|rover is now known as ysandeep|lunch08:01
*** amoralej|off is now known as amoralej08:17
*** jmasud has quit IRC08:22
*** jbadiapa has joined #oooq08:26
*** jpena|off is now known as jpena08:29
jbadiapaysandeep|lunch, weshay|ruck: please, when you guys are back, could you check this patch https://review.opendev.org/c/openstack/tripleo-ansible/+/772228? it has +w but I dont know why it's not getting merged. thx08:34
mariosjbadiapa: it was marked as work in progress i just clicked a button to make it active maybe that was why08:35
mariosjbadiapa: seems like a new feature from the gerrit upgrade recently08:36
*** tosky has joined #oooq08:36
jbadiapamarios, thx, I dint realized about that08:38
mariosjbadiapa: can you sanity check that please https://review.opendev.org/c/openstack/tripleo-ansible/+/772228/2/tripleo_ansible/roles/backup_and_restore/defaults/main.yml#7208:41
* jbadiapa checking 08:42
*** ysandeep|lunch is now known as ysandeep|rover08:43
jbadiapathx marios, there were some extra lines to be removed08:47
mariosjbadiapa: cool thanks, i was going to re-workflow it but thought best to check first ;)08:47
mariosjbadiapa: fyi the stein one also is wip https://review.opendev.org/c/openstack/tripleo-ansible/+/772405 so go click 'mark as active'08:48
mariosjbadiapa: (train)08:49
jlarribamarios: done08:51
jbadiapamarios, thx08:51
mariosack jbadiapa jlarriba08:52
zbrmorning!09:03
zbrmarios: ensure-no-sbarnea was a good one! make a PR! ;)09:03
zbrif anyone is curious sanity checks originated from ansible core tests, so they still have some requirements that are not needed for external content, like license check09:04
marioszbr: ;)09:10
zbrout of curiosity, any of you using a NAS at home, which Branch/OS?09:24
zbrbrand not branch :D09:24
*** gchamoul has quit IRC09:32
*** ykarel is now known as ykarel|lunch09:33
*** gchamoul has joined #oooq09:42
*** derekh has joined #oooq09:45
arxcruz|ruckysandeep|rover: hey, have you seen this ? https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-multinode-1ctlr-featureset010-train/8fd0a3a/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz09:57
ysandeep|roverarxcruz|ruck, no, is it consistent?09:58
ysandeep|roveroh, it failed in last run only09:59
ysandeep|roverarxcruz|ruck, I am firing a testproject to see if its consistent09:59
*** dtantsur|afk is now known as dtantsur10:00
*** apetrich has joined #oooq10:03
*** jbadiapa has quit IRC10:04
arxcruz|ruckysandeep|rover: trigger periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-train as well together10:05
arxcruz|ruckif you haven't yet10:05
arxcruz|ruckysandeep|rover: it fails on deploy freeipa10:05
arxcruz|ruckbut there's no logs10:06
ysandeep|roverarxcruz|ruck, https://review.rdoproject.org/r/#/c/28446/24/.zuul.yaml10:06
arxcruz|ruckand it fails only today10:06
ysandeep|roverboth are triggered10:06
arxcruz|ruckuys++10:06
arxcruz|ruckysandeep|rover: ++10:06
ysandeep|roverarxcruz|ruck, :) fyi.. i just retrigger ussuri failed jobs here as well https://review.rdoproject.org/r/#/c/28458/36/.zuul.yaml , they failed only in last run10:12
*** udesale_ has joined #oooq10:28
*** udesale has quit IRC10:29
*** ykarel|lunch is now known as ykarel10:36
*** jbadiapa has joined #oooq10:49
*** jfrancoa has joined #oooq11:01
sshnaidmmarios, hi, are we ready to submit https://review.opendev.org/c/openstack/tripleo-ci/+/773629 ?11:25
mariossshnaidm: checking11:28
mariossshnaidm: ack done11:29
sshnaidmmarios, thanks11:29
*** jpodivin has quit IRC11:31
mariossshnaidm: can you revote there please https://review.opendev.org/c/openstack/tripleo-ci/+/774686 i rebased for conflict11:31
*** jfrancoa has quit IRC11:31
sshnaidmmarios, done11:34
mariosthx sshnaidm11:36
*** ratailor has quit IRC12:27
*** rlandy has joined #oooq12:29
*** jpena is now known as jpena|lunch12:33
*** jpodivin has joined #oooq12:34
*** jpodivin has quit IRC12:37
*** jpodivin has joined #oooq12:39
weshay|rucksshnaidm, hey12:46
weshay|ruckquick call re: interview12:47
ysandeep|roverweshay|ruck, rlandy i debug some 16.2 today12:48
ysandeep|rover1) tripleo line is hitting a below legit failure, Good news fix is already in baremetal component, https://opendev.org/openstack/ironic-python-agent-builder/commit/55375641217ce199b0cb211addae8648bc48aa7912:48
ysandeep|roverhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-tripleo/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-bm_envC-3ctlr_1comp-featureset001-tripleo-rhos-16.2/d73b00b/logs/undercloud/home/zuul/build.log12:48
ysandeep|rover~~~12:48
ysandeep|rover2021-02-10 22:47:32.612 | > Error: Unable to find a match: sdparm12:48
ysandeep|rover2021-02-10 22:47:32.612 | returncode: 112:48
ysandeep|rover~~~12:48
ysandeep|roverCould we please merge this https://code.engineering.redhat.com/gerrit/#/c/227361/ to drop ovb jobs from criteria.12:48
ysandeep|rover**some 16.2 failures* today12:49
* rlandy looks12:50
rlandyysandeep|rover: done12:52
ysandeep|roverrlandy, weshay|ruck fyi.. I also spoke with rabi about the keystone issue, We didn't find much in keystone logs.. more debug logs needed on failing tasks (if we can get a reproducer up with more verbose debug). But as per initial conversation with rabi this could probably some infra/network issue or ansible...12:53
ysandeep|roverI have added a Baremetal job in integration line - running in test patch currently - Going good in tempest tests now.12:54
ysandeep|rovertesting fs035 on real baremetal as well12:54
rlandyysandeep|rover: great - thanks12:55
mariosarxcruz|ruck: "the following guests are from outside your organization: arxcruz@redhat.com" wtf12:59
arxcruz|ruckmarios: it's acruz maybe?12:59
mariosarxcruz|ruck: it shows both but i remember you said both are you? or not?13:00
arxcruz|ruckmarios: as far as i know both are me13:00
arxcruz|ruck:)13:00
arxcruz|ruckarxcruz is an alias13:00
arxcruz|rucki don't like acruz13:00
arxcruz|ruckit means The cross in portuguese13:00
mariosarxcruz|ruck: didn't complain for the acruz one13:00
mariosarxcruz|ruck: sshnaidm: soniya29: sent invite for monday please check if time is ok otherwise we will find another13:00
bhagyashrisakahat, arxcruz|ruck marios pojadhav zbr weshay|ruck rlandy sshnaidm scrum?13:00
soniya29marios, sure13:01
marioszbr: wave back13:05
*** amoralej is now known as amoralej|lunch13:08
ysandeep|roverarxcruz|ruck, :) fyi.. periodic-tripleo-ci-centos-8-multinode-1ctlr-featureset010-train passed and periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-train also passed the previous failure at ipa deploy..13:13
arxcruz|ruckysandeep|rover: so it was just a random failure13:14
arxcruz|ruckgreat13:14
ysandeep|roveryes :)13:14
*** dmellado has quit IRC13:25
*** dmellado has joined #oooq13:25
*** jpena|lunch is now known as jpena13:26
ysandeep|roverrlandy, weshay|ruck Hurrah! Green run for fs001 for integration line on Baremetal env:-13:37
ysandeep|roverhttps://code.engineering.redhat.com/gerrit/#/c/215285/13:37
ysandeep|roverperiodic-tripleo-ci-rhel-8-bm_envD-3ctlr_1comp-featureset001-rhos-16.2 https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/a56111f5e78f4170b039466e61b564b1 : SUCCESS in 5h 06m 35s13:37
ysandeep|rovertesting with fs035 now13:37
ysandeep|roverarxcruz|ruck, fyi.. ops is starting scheduled maintenance13:40
arxcruz|ruckysandeep|rover: ack13:40
arxcruz|ruckysandeep|rover: wow, 5 hours...13:40
ysandeep|roverarxcruz|ruck, :( my testproject might never report back now13:41
weshay|ruckakahat, can you please rejoin13:47
akahatweshay|ruck, okay13:47
bhagyashrisakahat, rlandy https://meet.google.com/xnf-tvdh-pmk?authuser=013:47
bhagyashrisplz join13:47
bhagyashrisrlandy, can you plz join promoter sync meeting ^13:49
weshay|ruckrlandy, you want to join promoter sync or no?13:49
sshnaidmfyi - all tripleo infra vms are stopped now13:52
sshnaidmincluding promoters13:53
weshay|ruckakahat, bhagyashris https://github.com/rdo-infra/ci-config/tree/master/ci-scripts/container-push/roles/containers-promote13:57
*** amoralej|lunch is now known as amoralej13:59
bhagyashrisweshay|ruck, https://review.rdoproject.org/r/#/c/31818/14:01
bhagyashrisweshay|ruck, could you plz review sprint report in your free time thanks :) https://docs.google.com/document/d/1TS6-IJ-556rot7P7HnZzqoIrscHvpEzqbnnW9y16xDs/edit#14:11
weshay|ruckbhagyashris, looking at it now14:12
bhagyashrisweshay|ruck, thanks :)14:14
*** ysandeep|rover is now known as ysandeep|dinner14:20
weshay|ruckbhagyashris, ok... I think it's good.. after getting a little more context re: scenario-manager.. send to openstack-discuss w/ topic [tripleo][ci] and a seperate email to rh-openstack-dev14:23
bhagyashrisweshay|ruck, sure. thanks :)14:23
*** ykarel_ has joined #oooq14:26
*** ykarel has quit IRC14:29
weshay|ruckarxcruz|ruck, ysandeep|dinner any info on the post failures in the gate?14:32
arxcruz|ruckweshay|ruck: checking14:33
arxcruz|ruckdashboard seems to be offline14:33
weshay|ruckarxcruz|ruck, vex is offline14:34
weshay|ruckarxcruz|ruck, backup http://tripleo-cockpit.usersys.redhat.com/d/9DmvErfZz/cockpit?orgId=1&from=now-2d&to=now14:34
arxcruz|ruckweshay|ruck: looks like timeout in post, the job finishes, and ended on uploading swift logs14:37
arxcruz|ruckhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ebc/774696/1/gate/tripleo-ci-centos-7-containers-multinode/ebc4ab1/job-output.txt14:38
weshay|ruckarxcruz|ruck, aye.. so next step would be to join #openstack-infra and see if there is any insight.. zbr can be helpful there as well14:39
weshay|ruckarxcruz|ruck, I don't think we have any logs avail14:47
arxcruz|ruckweshay|ruck: we do have14:47
weshay|ruckarxcruz|ruck, oh.. link?14:48
arxcruz|ruckhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ebc/774696/1/gate/tripleo-ci-centos-7-containers-multinode/ebc4ab1/logs/undercloud/var/log/tempest/stestr_results.html14:48
arxcruz|rucki mean, the logs are there, why it fail, maybe some are not available, the joboutput says uploading to swift14:48
arxcruz|ruckmaybe timeout before it finishes14:48
weshay|ruckarxcruz|ruck, tripleo-buildimage-ironic-python-agent-centos-814:49
*** ykarel_ has quit IRC14:49
weshay|ruckarxcruz|ruck, 774696,114:49
arxcruz|ruckweshay|ruck: this pass14:50
arxcruz|ruckor am i wrong ?14:50
arxcruz|ruckthe failing one is tripleo-ci-centos-7-containers-multinode14:50
weshay|ruckarxcruz|ruck, jump on w/ me14:51
weshay|ruckarxcruz|ruck, meet.google.com/sho-wvkc-rwe14:51
*** dmellado has quit IRC14:53
*** dmellado has joined #oooq14:54
ysandeep|dinner!rhatwho sshnaidm15:03
openstackysandeep|dinner: Error: "rhatwho" is not a valid command.15:03
ysandeep|dinnerwrong channel15:04
*** ysandeep|dinner is now known as ysandeep|rover15:04
*** dmellado has quit IRC15:10
*** saneax has quit IRC15:11
*** dmellado has joined #oooq15:12
ysandeep|rovererrr... 16.2 line run got bugged by vexx maintenance.. because we are trying to download image from rdo ... Downloading 'http://images.rdoproject.org/cirros/cirros-0.4.0-x86_64-disk.img'15:22
* ysandeep|rover whill check about changing the source of cirros image 15:23
ysandeep|roverwill*15:23
weshay|ruckarxcruz|ruck, ping15:25
weshay|ruckysandeep|rover, arxcruz|ruck need you both for another minute15:25
ysandeep|roverweshay|ruck, sure15:25
weshay|ruckarxcruz|ruck, ysandeep|rover meet.google.com/cjo-zpyd-rfx15:26
arxcruz|ruckweshay|ruck: joiining15:28
weshay|ruckysandeep|rover, http://download.cirros-cloud.net/0.4.0/15:28
weshay|ruckarxcruz|ruck, https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c2a/774781/4/gate/tripleo-ci-centos-8-standalone/c2aff6c/job-output.txt15:36
weshay|ruck2021-02-11 14:41:18.683580 | primary | 2021-02-11 14:40:38.488 188775 INFO config_tempest.constants [-] Downloading 'http://images.rdoproject.org/cirros/cirros-0.4.0-x86_64-disk.img' and saving as 'etc/cirros-0.4.0-x86_64-disk.img'[00m15:36
*** jfrancoa has joined #oooq15:37
arxcruz|ruckhttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/77519115:39
arxcruz|ruckweshay|ruck: ysandeep|rover ^15:39
weshay|rucksshnaidm, https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/77519115:39
weshay|ruckrlandy, https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/77519115:42
*** jfrancoa has quit IRC15:47
mariosweshay|ruck: wdyt about https://review.opendev.org/c/openstack/tripleo-ci/+/774909/3/zuul.d/standalone-jobs.yaml#9615:48
mariosweshay|ruck: i am updating now in a patch ontop, or i can update that ^^^ if you are ok15:48
ysandeep|roverweshay|ruck, rlandy you okay if i merge this patch https://code.engineering.redhat.com/gerrit/#/c/215285/ tomorrow morning, after fs035 green run(running right now).. So that tomorrow jobs can trigger on same hash.15:49
-openstackstatus- NOTICE: Recent POST_FAILURE results from Zuul for builds started prior to 15:47 UTC were due to network connectivity issues reaching one of our log storage providers, and can be safely rechecked15:49
rlandyysandeep|rover: yep - +2'ed it15:50
ysandeep|roverrlandy, thanks!15:50
weshay|ruckmarios, you can update any of my patches any time15:51
mariosweshay|ruck: well, at least check you're not updating it at same time  ;) k doing15:52
mariosweshay|ruck: so you agree? I think move to deprecated will make our jobs much easier15:52
weshay|ruckmarios, aye aye.. I always clean and repull.. s15:52
weshay|ruckmarios++15:52
weshay|ruckyes15:52
mariosweshay|ruck: then we can just unwire it in all places without blocking15:52
mariosweshay|ruck: k15:52
arxcruz|ruckysandeep|rover: weshay|ruck https://review.opendev.org/c/osf/python-tempestconf/+/77519515:52
arxcruz|rucklet's see if this will work15:53
*** jpodivin has quit IRC15:54
*** jpodivin has joined #oooq16:01
*** jmasud has joined #oooq16:02
*** jpodivin has quit IRC16:02
*** jpodivin has joined #oooq16:02
*** ysandeep|rover is now known as ysandeep|out16:09
*** derekh has quit IRC16:10
*** derekh has joined #oooq16:11
weshay|rucksshnaidm, the cirros image should be on the nodepool node.. arx is working on python-tempestconf to do the following..  check the node, try url1, try url2 atm16:55
*** marios is now known as marios|out17:01
*** jpodivin has quit IRC17:04
*** jmasud has quit IRC17:25
rlandyneed to go dig car out of snow again - for the third time in 10 days ... biab17:30
rlandyweshay|ruck: ^^ fyi17:30
*** rlandy is now known as rlandy|biab17:30
*** jmasud has joined #oooq17:31
*** dtantsur is now known as dtantsur|afk17:45
*** udesale_ has quit IRC17:47
*** jpena is now known as jpena|off17:47
*** amoralej is now known as amoralej|off17:50
*** derekh has quit IRC17:57
*** jmasud has quit IRC18:09
*** marios|out has quit IRC18:20
*** apetrich has quit IRC18:30
*** rlandy|biab is now known as rlandy18:37
*** sshnaidm is now known as sshnaidm|afk19:19
weshay|ruckfak.. arx's patch does not work19:49
rlandyweshay|ruck: need help with anything queue-wise?19:53
weshay|ruckhttps://review.opendev.org/c/openstack/tripleo-ci/+/77526919:54
weshay|ruckarxcruz|ruck, ^19:54
weshay|ruckrlandy, vex is back.. please add keys as needed20:21
rlandywill do20:23
*** jmasud has joined #oooq20:59
*** jmasud has quit IRC21:00
*** jbadiapa has quit IRC22:03
*** rlandy has quit IRC23:05
*** slaweq has quit IRC23:09

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!