Thursday, 2021-12-09

*** rcastillo is now known as rcastillo|out00:18
*** rlandy|ruck|bbl is now known as rlandy|ruck02:19
*** rlandy|ruck is now known as rlandy|out02:23
*** dviroel is now known as dviroel|out02:53
*** bhagyashris_ is now known as bhagyashris03:02
*** pojadhav|out is now known as pojadhav|rover03:18
*** marios is now known as marios|ruck06:12
ysandeepfolks o/ please add in your review list: https://review.rdoproject.org/r/c/rdo-jobs/+/37137 07:37
marios|ruckmake me ysandeep 07:41
ysandeepsudo marios plz review ^^ :)07:43
marios|ruckok 07:43
ysandeep++ thanks marios|ruck chandankumar 07:44
*** ysandeep is now known as ysandeep|lunch08:08
bhagyashrisfolk kindly add in your review list: https://review.rdoproject.org/r/c/rdo-jobs/+/3698608:20
*** ysandeep|lunch is now known as ysandeep08:38
marios|ruckchandankumar: do we have a testproject for https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/821012 i don't see it in the comments 08:50
marios|ruckchandankumar: i see ananya one but did you have one with a green result ? 08:50
chandankumarmarios|ruck: I donot have testproject with that patch, but above patch is already merged and consumed here https://review.rdoproject.org/r/c/testproject/+/36998 and https://logserver.rdoproject.org/98/36998/3/check/periodic-tripleo-ci-centos-9-standalone-master/358ab52/ is passing08:58
marios|ruckchandankumar: k thanks i was mainly looking for something to point to for https://bugs.launchpad.net/tripleo/+bug/1953032/comments/8 08:58
chandankumarnote testproject is running08:59
marios|ruckchandankumar: i moved it fix-released for now move back if you disagree 08:59
chandankumarmarios|ruck: please move it to fixed released08:59
chandankumarfor now08:59
marios|ruckchandankumar: yah did see comment08:59
chandankumarsounds good as per the comment08:59
chandankumarmarios|ruck: thank you for tracking that :-)09:00
marios|ruckchandankumar: trying to clear out the cix board 09:00
*** pojadhav|rover is now known as pojadhav|lunch09:07
*** jpodivin_ is now known as jpodivin09:55
*** pojadhav|lunch is now known as pojadhav|rover10:03
*** ysandeep is now known as ysandeep|afk10:21
marios|ruckfood biab10:24
*** jpena|off is now known as jpena10:35
*** dviroel|out is now known as dviroel10:49
*** ysandeep|afk is now known as ysandeep10:56
chandankumarmarios|ruck: the packages in tripleo-ci-testing tag is old, I am re-running the component line to get latest packages https://review.rdoproject.org/r/c/testproject/+/3714111:00
chandankumarthen we will run all the promoted component jobs and then containeer build for cs011:00
chandankumar*cs911:00
marios|ruckchandankumar: thanks11:00
*** rlandy|out is now known as rlandy|ruck11:10
rlandy|ruckpojadhav|rover: hey 11:13
frenzy_fridayHey slaweq when you get some time, I need some help with https://bugs.launchpad.net/tripleo/+bug/195373811:13
pojadhav|roverrlandy|ruck, morning!11:14
rlandy|ruckpojadhav|rover: hello ... 11:14
rlandy|ruckpls testproject the jobs missing to promote ussuri and victoria11:14
rlandy|ruckperiodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-ussuri:11:14
rlandy|ruckperiodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-victoria11:14
rlandy|ruckperiodic-tripleo-ci-centos-8-standalone-upgrade-victoria11:15
pojadhav|roveryep11:15
rlandy|ruckpojadhav|rover: ^^ pls also check if there is a real issue with fs03511:15
pojadhav|roverrlandy|ruck, ack11:16
rlandy|ruckpojadhav|rover: will meet with you later re: what's left for sce01011:16
rlandy|ruckthanks11:16
rlandy|ruckpojadhav|rover: marios|ruck: anything else need attention in ruck rover land?11:16
rlandy|ruckpojadhav|rover: lastly pls check if downstream container builds work now11:17
pojadhav|roverrlandy|ruck, nothing new issue caught atleast till now from myside.11:17
rlandy|ruckchandankumar: hey - joining11:17
pojadhav|roverrlandy|ruck, ack11:17
rlandy|ruckpojadhav|rover: thank you!!11:18
marios|ruckrlandy|ruck: o/ 11:20
marios|ruckrlandy|ruck: talking with owalsh in tripleo now11:20
marios|ruckrlandy|ruck: nothing new to report trying to close out the cix11:20
rlandy|ruckok 11:20
marios|ruckrlandy|ruck: thanks for the fix on the pip thing i was not looking forward to that today ;)11:20
rlandy|ruckmarios|ruck: was an easy fix in the end11:22
rlandy|ruckmarios|ruck: upgrades also11:23
marios|ruckrlandy|ruck: yeah it was just a matter of finding the right 'easy fix' :D i tried all sorts in the afternoon ;)11:23
* bhagyashris brb11:28
rlandy|ruckdviroel: hey ... small change requested on https://review.rdoproject.org/r/c/config/+/37072/11:30
rlandy|ruckthen we can merge11:30
rlandy|ruckthe weekend line should stay11:30
dviroelrlandy|ruck: looking at it atm11:33
dviroelrlandy|ruck: chandankumar weekend line https://review.rdoproject.org/zuul/buildsets?project=openstack%2Ftripleo-ci&pipeline=openstack-periodic-weekend11:36
dviroelshould it be removed or not?11:37
dviroelcomments in the patch confused me11:37
rlandy|ruckdviroel: sorry - it's my comments that are confusing11:40
rlandy|ruckdviroel: the weekend line should stay11:42
*** pojadhav|rover is now known as pojadhav|rover|brb11:42
rlandy|ruckothers should go11:42
dviroelrlandy|ruck: ack, we may want to consider reduce the jobs that run in weekend line, not for saving resource (since its weekend), but just to have the ones that we care most11:44
dviroelchandankumar: ^11:44
chandankumardviroel: ok then keep weekend and periodic-ci-config-molecule-python 11:45
dviroelack ack11:46
rlandy|ruckysandeep: pojadhav|rover|brb: downstream container builds should be fixed now11:47
rlandy|ruckwe'll need to check that on the next run11:47
*** pojadhav|rover|brb is now known as pojadhav|rover11:51
pojadhav|roverrlandy|ruck, I will monitor on next run, will update you.11:52
pojadhav|roverrlandy|ruck, posted testrun victoria/ussuri failed jobs: https://review.rdoproject.org/r/c/testproject/+/36478/511:54
pojadhav|roverrlandy|ruck, checked failures for fs035 : both failed for tempest tests but different tests for different jobs.11:55
pojadhav|roverfs035-victoria : https://logserver.rdoproject.org/openstack-periodic-integration-stable2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-victoria/866b950/logs/undercloud/var/log/tempest/stestr_results.html.gz11:55
pojadhav|roverfs035-ussuri : https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-ussuri/c40409d/logs/undercloud/var/log/tempest/stestr_results.html.gz11:55
pojadhav|roverI will monitor testrun, lets see what it results.11:56
rlandy|ruckpojadhav|rover++ thank you!!!11:58
*** pojadhav|rover is now known as pojadhav|rover|brb12:02
* pojadhav|rover|brb need tea break....12:02
rlandy|ruckysandeep: https://bugs.launchpad.net/tripleo/+bug/195374212:09
ysandeeprlandy|ruck, ack12:10
rlandy|ruck^^ marked as promotion blocker as is it time someone looked at that12:10
rlandy|ruckfailing since Nov 2012:10
rlandy|ruckno response12:10
rlandy|ruckpojadhav|rover|brb: marios|ruck: ^^ just FYI 12:10
rlandy|ruckfailing our promotions to current-tripleo-rdo12:10
rlandy|rucknot on us to fix12:10
rlandy|ruck^^ sending to rdo team12:10
marios|ruckthanks rlandy|ruck 12:10
ysandeepchandankumar, hey could you please transfer ownership of hackmd https://hackmd.io/C-0qk815T_KULobojqVrGQ?both#Prdochain-DeliveryPipeline-UA-syncup to rh-openstack-ci12:21
ysandeepearlier to find in rh-openstack-ci workspace12:21
ysandeepeasier*12:22
*** pojadhav|rover|brb is now known as pojadhav|rover12:22
pojadhav|roverrlandy|ruck, ack12:23
rlandy|ruckpojadhav|rover: just fixing rdo log reporting secret - then we can give sc010 a try again12:24
pojadhav|roverrlandy|ruck, ack12:25
rlandy|ruckugh   - have to remember how to do this :)12:31
dviroelchandankumar: thanks for the tips and fixes, standalone + build_container_images:true is passing now12:48
dviroelchandankumar: ysandeep https://review.rdoproject.org/r/c/testproject/+/36976/9#message-4380f84140da6806aa4c81ec1fd75d92f0a8cf5212:48
dviroelysandeep: thanks for the help debugging it12:49
ysandeepdviroel, great!12:49
ysandeepdviroel, we can remove the node from hold, right?12:49
* ysandeep removing the node from hold 12:51
ysandeepdviroel, any objections?12:51
*** rcastillo|out is now known as rcastillo12:59
slaweqfrenzy_friday hi, sure, I will check it later today13:00
slaweqor tomorrow morning, is it very urgent?13:00
bhagyashrisakahat, pojadhav|rover 13:00
bhagyashrisScrum meeting13:01
bhagyashrisdviroel, ^13:01
frenzy_fridayslaweq, thanks!13:02
bhagyashrisreview list13:02
frenzy_fridayWIP SC012:13:03
frenzy_fridayjob def: https://review.rdoproject.org/r/c/rdo-jobs/+/3705913:03
frenzy_fridaytestP: https://review.rdoproject.org/r/c/testproject/+/3702713:03
frenzy_fridaycriteria: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3706213:03
akahatReviews: https://review.opendev.org/c/openstack/tripleo-ci/+/820852, https://review.opendev.org/c/openstack/tripleo-ci/+/808577, https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/800338, https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80874813:03
dviroelhttps://review.opendev.org/c/openstack/tripleo-quickstart/+/82112113:12
dasmo/13:13
rlandy|ruckhttps://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/29788413:15
rlandy|ruckhttps://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/29612313:16
rlandy|ruckhttps://issues.redhat.com/browse/RHOSZUUL-70013:17
*** ykarel is now known as ykarel|away13:21
marios|ruckhttps://review.opendev.org/c/openstack/tripleo-repos/+/818118/2/plugins/module_utils/tripleo_repos/main.py13:24
chandankumarysandeep: done13:32
ysandeepchandankumar++ thanks!13:32
marios|ruckhttps://review.opendev.org/c/openstack/releases/+/817623/313:37
marios|ruckhttps://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-stable4-centos713:40
sshnaidmwho is dealing with tempest, be aware of https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/81987613:46
sshnaidmbetter to be tested with c9 ^13:46
rlandy|ruckdasm: as you heard, we have some cloud management issues - coming your way soon13:53
rlandy|ruckysandeep: hey - can you review https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/297884/1/zuul.d/secrets.yaml13:56
rlandy|rucklet me know if it looks sane to you13:56
rlandy|ruckwill pm send you the command to create13:56
rlandy|ruckthen we merge and pray 13:56
ysandeeprlandy|ruck, ack13:57
rlandy|ruckthank you13:57
rlandy|ruckmarios|ruck: pojadhav|rover: dviroel: frenzy_friday: pls book a ruck/rover hand  off meeting on friday or monday14:03
rlandy|ruckso we switch over smoothly14:03
rlandy|ruckthank you14:03
marios|ruckrlandy|ruck: sure whos up next? 14:04
rlandy|ruckmarios|ruck: dviroel frenzy_friday 14:04
pojadhav|roverwill do hand off meeting tomorrow...14:04
marios|ruckack sending pojadhav|rover don't worry ;)14:04
pojadhav|rovermarios|ruck, thank you :)14:04
rlandy|rucklol14:04
rlandy|rucka little excited to get off the schedule???14:05
marios|ruck"would you like to hand off tomorrow or stay ruck rover until monday" 14:05
marios|ruck;)14:05
marios|ruckrlandy|ruck: pojadhav|rover: dviroel: frenzy_friday: sent - half hour before happy friday call - let meknow if it doesn't work for you we reschedule it14:06
dviroelmarios|ruck: works for me, tks14:06
chandankumarsshnaidm: testing tempest patch14:11
*** pojadhav|rover is now known as pojadhav|rover|brb14:18
rlandy|ruckpojadhav|rover|brb: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/297884 merged14:18
rlandy|rucktrying master sc010 job again14:18
chandankumarsshnaidm: https://review.rdoproject.org/r/c/testproject/+/36998 14:26
rlandy|ruckchandankumar++ marios|ruck++ c9 line looking much greener :)14:33
sshnaidmchandankumar, rlandy|ruck please vote in your time https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/81926614:36
marios|ruckrlandy|ruck: i think we're back to where we were on 16nov which is when we started paying the tech debt ... ~3 weeks ago seems much longer ... 14:37
rlandy|ruckmarios|ruck: I know - it feels like a long time14:37
rlandy|ruckbut really nice work getting us up and running again14:38
rlandy|ruckthank you14:38
marios|ruckrlandy|ruck: thanks good work from everyone lots of folks involved in all this stuff14:38
rlandy|ruckdviroel++ as wel14:39
rlandy|rucklooking forward to a green component line as well14:39
rlandy|rucksshnaidm: chandankumar and marios|ruck appoved - w+ing that https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/81926614:40
ysandeepsshnaidm, lgtm, one query on : https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/819266/9/tox.ini 14:41
rlandy|ruckbhagyashris: ysandeep: chandankumar: frenzy_friday: akahat: dviroel: pojadhav|rover|brb: marios|ruck: sshnaidm: was asked to send some highlights from thsi year for the CI team ...14:49
rlandy|ruckthis is what I have (off top of my head)14:50
rlandy|rucktripleo-health stood up14:50
rlandy|ruckfully automated promoter upstream and downstream14:50
rlandy|ruckwhat did I miss?14:50
rlandy|ruckanything you think worth highlighting to org?14:51
chandankumarMini CS9 integration Line14:51
rlandy|ruckack14:51
rlandy|ruck16.2 and 17 through dlrn first14:51
chandankumarrlandy|ruck:  from tempest side, scenario manager work14:52
rlandy|ruckchandankumar: pls help me out with a link14:52
chandankumarrlandy|ruck: https://docs.openstack.org/releasenotes/tempest/v27.0.0.html 14:53
rlandy|ruckthank you, sir14:53
* ysandeep in middle of something will reply in sometime 14:55
bhagyashrisrlandy|ruck, tempest skiplist14:59
ysandeepmay be worth checking bhagyashris sprint status emails to cross check we don't miss anything.14:59
marios|ruckrlandy|ruck: get-hash & yum-config modularization14:59
rlandy|ruckack14:59
bhagyashrisrlandy|ruck, ruck rover tooling 14:59
rlandy|ruckyep15:01
frenzy_fridayrlandy|ruck, Doug's yum config module?15:02
rlandy|ruckack bhagyashris just mentioned  get-hash & yum-config modularization15:02
bhagyashrisrlandy|ruck, rbac and fifps15:03
ysandeepmay be we can higlight Improvement in Ci to test new rbac/ fips network-data-v2 work (with new fs064 test custom overcloud networks) / whole-disk-default 15:03
pojadhav|rover|brbrlandy|ruck, soniya's patrole contribution15:04
*** pojadhav|rover|brb is now known as pojadhav|rover15:04
chandankumarrlandy|ruck: tripleo-operator-ansible packaging 15:05
chandankumarand it's consumption15:05
marios|ruckrlandy|ruck: we had a big push to make our ci more efficient early this year https://review.opendev.org/q/topic:tripleo-ci-reduce http://lists.openstack.org/pipermail/openstack-discuss/2021-April/021506.html 15:06
rlandy|ruckha ... periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-rbac-master (non-voting)openstack/tripleo-cimasteropenstack-periodic-integration-main2 hrs 52 mins 10 secs2021-12-08 01:16:11SUCCESS15:08
rlandy|ruckdviroel: ^^ wow - looky here15:09
dviroelyay15:09
bhagyashrisrlandy|ruck, here you will get the 2021 plan https://hackmd.io/8339lqSwSEeXxuk0LfxCwA that we discussed at the start of the year 15:12
rlandy|ruckbhagyashris: ah - we should have a 2022 plan15:13
rlandy|ruckbhagyashris: do we have a TC/UA/PM meeting for next sprint?15:13
bhagyashrisyou will get most of the stuff there15:13
bhagyashrisyup will do that15:13
rlandy|ruckour planning meeting should be ^^15:13
bhagyashrisyes i am planed to schedule for coming monday 15:13
bhagyashrisrlandy|ruck, ^ will send an invite tomorrow 15:14
rlandy|ruckbhagyashris: ack - we will not have muck sprint planning - so we should look to the new year with a similar plan15:14
rlandy|ruckthank you15:14
bhagyashrisyup15:14
* bhagyashris dinner 15:14
rlandy|ruckthank you all15:18
* rlandy|ruck sends list15:19
* pojadhav|rover dinner15:25
*** ysandeep is now known as ysandeep|out15:45
rlandy|ruckpojadhav|rover: ussuri and victoria fs035 josb both failed some tempest tests15:59
rlandy|ruckpls investigate and skiplist if suitable15:59
rlandy|ruckwe need to promote those lines asap16:00
pojadhav|roverrlandy|ruck: yep16:07
* dviroel_ lunch16:08
rlandy|rucktempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON 2 1 1 0 0 Detail 16:12
rlandy|rucktest_create_image_specify_multibyte_character_image_name[id-3b7c6fe4-dfe7-477c-9243-b06359db51e6]16:12
rlandy|ruckhttps://logserver.rdoproject.org/78/36478/5/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-ussuri/4995d8f/logs/undercloud/var/log/tempest/stestr_results.html.gz16:12
rlandy|rucktempest.scenario.test_network_v6.TestGettingAddress 8 7 1 0 0 Detail 16:13
rlandy|rucktest_dhcp6_stateless_from_os[compute,id-d7e1f858-187c-45a6-89c9-bdafde619a9f,network,slow]16:13
rlandy|ruckok - let's see16:13
rlandy|ruckpojadhav: ussuri looks like tempest.api.compute.images.*16:16
pojadhavrlandy|ruck, yeah.. but tests failed are different ones16:17
rlandy|ruckpojadhav: ok - me give that test project one more run16:18
rlandy|ruckthen I'll skiplist something on that list16:18
rlandy|ruckpojadhav: actually ussuri is running now16:19
pojadhavokay.. I observed before failed test : "tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON" and this run failed test : "tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name"16:19
pojadhavthough both are from tempest.api.compute.images.* but not the same one :(16:19
rlandy|ruckperiodic-tripleo-ci-centos-8-standalone-upgrade-ussurifailure (non-voting) failed16:19
*** pojadhav is now known as pojadhav|rover16:19
rlandy|ruckmaybe started befor emerge16:20
rlandy|ruckchecking that16:20
pojadhav|roverposted recheck on this : https://review.rdoproject.org/r/c/testproject/+/36478/516:21
marios|ruckneed somethign before i go ?  16:45
marios|ruckrlandy|ruck: :) ^^ 16:45
rlandy|ruckmarios|ruck: think we are ok16:46
marios|ruckalmost there pojadhav|rover ;)16:46
rlandy|ruckjust trying to get u/v promotion16:46
pojadhav|rovermarios|ruck, :D16:46
marios|ruckrlandy|ruck: we have a new issue there? I thought we were sorted... need me to check/vote somewhere? 16:47
rlandy|ruckmarios|ruck: fs035 maybe16:47
pojadhav|roverfeeling sleepy ;)16:47
rlandy|ruckalso upgrade failed16:47
rlandy|ruckrerunning it16:47
marios|ruck:/16:47
rlandy|ruckmarios|ruck: no worries will leave notes or fix it16:47
marios|ruckrlandy|ruck: k i will pickup in the morning then 16:47
rlandy|ruckack16:48
rlandy|ruckmarios|ruck: have a good night16:48
pojadhav|rovermarios|ruck, good night.. I will be around more 1/2 hr for helping rlandy|ruck.. :)16:49
marios|ruckthanks have a good one rlandy|ruck pojadhav|rover 16:49
rlandy|ruckpojadhav|rover: it's late for you as well16:49
rlandy|ruckcan leave you notes16:49
rlandy|ruckif we still have issues on u/v16:50
pojadhav|roverrlandy|ruck, ack.. see you tomrrow :)16:50
rlandy|ruckhave a good night16:50
pojadhav|roveryup.. same to you 16:51
* pojadhav|rover leaving for the day16:51
*** pojadhav|rover is now known as pojadhav|out16:51
*** jpena is now known as jpena|off16:57
*** marios|ruck is now known as marios|out16:59
* bhagyashris out17:09
* dviroel coffee18:08
rlandy|ruck"Error attempting to run untyped_volumes_online_data_migration", "Error attempting to run untyped_snapshots_online_data_migration", 18:27
rlandy|ruckugh18:27
rlandy|rucknow another ussuri upgrade issue18:28
dviroel(╯°□°)╯︵ ┻━┻18:28
*** sshnaidm is now known as sshnaidm|afk19:05
*** abregman_ is now known as abregman|afk20:24
*** rcastillo is now known as rcastillo|lunch20:36
*** dviroel is now known as dviroel|out21:13
*** rcastillo|lunch is now known as rcastillo21:17
*** rlandy|ruck is now known as rlandy|out23:30
*** rcastillo is now known as rcastillo|out23:58

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!