Monday, 2022-05-23

*** ysandeep|out is now known as ysandeep|rover06:25
ysandeep|roverfrenzy_friday, good morning.. new rr hackmd: https://hackmd.io/uiv6iiN5QR-Z3mfFyKWeqA 06:34
*** frenzy_friday is now known as frenzyfriday|ruck06:34
frenzyfriday|ruckysandeep|rover, thanks. Taking a look at the hackmd and cix status06:35
* ysandeep|rover started my day late today(due to heavy rainfall in my area) and catching up with the current state.06:35
jm1ysandeep|rover: added some notes to last weeks hackmd on friday about victoria. had issues with pypi back then06:36
ysandeep|roverjm1: thanks! 06:37
frenzyfriday|ruckjm1, thanks06:37
jm1frenzyfriday|ruck: hey hey :) Any aoc patches i should have a look at first?06:39
frenzyfriday|ruckjm1, keypair_info pls :D06:39
jm1frenzyfriday|ruck: yes, ma'am 💂06:40
ysandeep|roverlooks like we broke victoria upgrade jobs during ussuri eol06:44
ysandeep|roverhttps://d4425aae35dc8050b142-eecb7ff79b5c6e121d6c20fabad8af79.ssl.cf5.rackcdn.com/834594/1/gate/tripleo-ci-centos-8-standalone-upgrade-victoria/8af2b86/job-output.txt06:44
ysandeep|roverAn exception occurred during task execution. To see the full traceback, use -vvv. The error was: ansible.errors.AnsibleUndefinedVariable: 'dict object' has no attribute 'ussuri'06:44
ysandeep|roverhttps://github.com/openstack/tripleo-ci/commit/64ffe2ce9b1ebe9415e5254acf61b8696225d115  may be related.06:47
mariosysandeep|rover: o/ looking06:51
mariosysandeep|rover: looks like issue with missing content provider data 06:52
ysandeep|roveryeah https://zuul.openstack.org/status#834594 ussuri content-provider missing here 06:53
mariosysandeep|rover: i think error message (dict missing ussuri) is from there https://opendev.org/openstack/tripleo-quickstart-extras/src/commit/1928bb91790561131d6c9cbeeaca6f1599e516cb/roles/standalone/templates/standalone_config.yaml.j2#L27 06:55
mariosysandeep|rover: and see     registry_ip_address_branch: at https://d4425aae35dc8050b142-eecb7ff79b5c6e121d6c20fabad8af79.ssl.cf5.rackcdn.com/834594/1/gate/tripleo-ci-centos-8-standalone-upgrade-victoria/8af2b86/zuul-info/inventory.yaml06:55
mariosno ussuri in that dict06:55
ysandeep|rovermarios, thanks.. true https://zuul.openstack.org/status#834594 ussuri content-provider is indeed not running here06:56
ysandeep|rovermarios, https://review.opendev.org/c/openstack/tripleo-ci/+/835460/26/zuul.d/upgrades-jobs-templates.yaml#b15006:57
mariosysandeep|rover: yeah i was just looking at that06:57
mariosysandeep|rover: seems we missed it in review06:57
mariosysandeep|rover: so needs a partial revert06:57
mariosysandeep|rover: we kept the ussuri job in deprecated06:57
mariosysandeep|rover: so we should re-add to the dependency there 06:57
ysandeep|roveryeah we removed content-provider job without removing victoria upgrade jobs.06:57
mariosysandeep|rover: k so can you re-add for now 06:58
ysandeep|rovermarios, thanks for help, I will open a bug and send a fix 06:58
mariosysandeep|rover: i think we have to be careful when dealing with victoria we'll have the same issue help me remember to add something in tasks for next sprint plan?06:58
ysandeep|roveryeah for v->w upgrade 06:58
mariosysandeep|rover: right06:59
ysandeep|rovermarios, I will add a reminder for next sprint planning doc 06:59
mariosysandeep|rover: ack thanks06:59
* ysandeep|rover added a note here: https://hackmd.io/P5sTPMSBREe5kBS_4jDhIg#2022-05-31-tcuapm-planning-for-sprint-63 07:02
mariosysandeep|rover:++07:02
ysandeep|rovermarios++07:02
ysandeep|roverfrenzyfriday|ruck, hey o/ where is our reviewbot07:23
frenzyfriday|ruckysandeep|rover, hm.. maybe the server died, lemme check07:26
*** jpena|off is now known as jpena07:33
ysandeep|roverfrenzyfriday|ruck, let's meet and divide and conquer the work 07:40
frenzyfriday|ruckysandeep|rover, yep https://meet.google.com/zfw-xejb-tgp07:41
ysandeep|roverchandankumar, good afternoon - fs035 in psi seems to failing on ipv6 related issues - seems like we never had a successful run yet: https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-internal-master&skip=0 07:56
*** ysandeep|rover is now known as ysandeep|rover|lunch08:38
chandankumarysandeep|rover|lunch: \o looking08:40
frenzyfriday|ruckhey ysandeep|rover|lunch , this is what I found on the sc 10 kvm issue: https://trello.com/c/TP9yQsFM/2513-cixlp1973223tripleociproa-master-sc010-kvm-job-is-failing-on-octavia-related-tempest-test-octaviatempestplugintestsscenariov2tes10:05
frenzyfriday|ruckI'll update the same without the log links to the lp bug10:05
*** ysandeep|rover|lunch is now known as ysandeep|rover10:07
*** rlandy|out is now known as rlandy10:21
ysandeep|roverfrenzyfriday|ruck, thanks! let's wait for nova folks on that..10:23
rlandyysandeep|rover: frenzyfriday|ruck: hello ...10:24
rlandyI know there is a lot going on10:24
frenzyfriday|ruckrlandy, hello10:24
ysandeep|rovero/10:25
rlandyysandeep|rover: frenzyfriday|ruck: sync?10:25
ysandeep|roverhttps://meet.google.com/arc-yefc-rzd?authuser=0&hl=en10:25
rlandypojadhav: hello11:12
pojadhavrlandy, hi11:12
rlandypls see pvt11:12
pojadhavack11:12
rlandyreview time anyone?11:17
*** dviroel|out is now known as dviroel11:21
* ysandeep|rover skipping review time.. occupied with rr stuff11:28
bhagyashrisi can't hear you guys speker and mic problem 11:28
bhagyashrisspeaker*11:28
rlandyarxcruz: pls check https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4266811:48
rlandycopy-quay11:48
rlandybhagyashris: hi - can you join https://meet.google.com/vzm-nrah-qqf?authuser=012:06
bhagyashrisrlandy, yes12:12
* pojadhav brb12:18
*** ysandeep|rover is now known as ysandeep|rover|brb12:21
*** ysandeep|rover|brb is now known as ysandeep|rover12:37
ysandeep|roverjm1: hey o/ could you please join #openstack-pcci in internal, I want to ping you something downstream specific13:10
jm1ysandeep|rover: done13:12
dasmo/13:17
dasmI lost keys to my VPN to my VM instance with weechat, hence two of me. I'm gonna work on fixning that later this week. I appologize for any inconvenience until then.13:19
dasmIf I'm needed somewhere else (another channel), please bring that to my attention, and I'll join. Otherwise, I won't see it.13:19
frenzyfriday|ruckysandeep|rover, have you seen this error: module 'neutron.common.config' has no attribute 'register_common_config_options' ?13:26
ysandeep|roverfrenzyfriday|ruck: I have not seen that 13:27
frenzyfriday|ruckack. I see it in upgrade nw master . I'll create a bug if it is consistent13:28
chandankumarmarios: arxcruz dviroel quick merge https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/84296513:42
chandankumarthanks!13:42
marioschandankumar: ack13:46
frenzyfriday|ruckysandeep|rover, periodic-tripleo-ci-centos-9-undercloud-upgrade-common-master shows up as failed in the rr tool but I cant see it under promotion criteria and it says non voting on zuul. This is failing consistently. Should I create a bug?13:57
frenzyfriday|rucksame for periodic-tripleo-ci-centos-9-undercloud-upgrade-network-master13:58
ysandeep|roverfrenzyfriday|ruck, can you can the criteria file if someone added why they removed that job from criteria.. maybe a known bug13:58
ysandeep|rovercan you check* the13:59
bhagyashrischandankumar, pojadhav soniya29 rlandy dasm 14:01
bhagyashrisTripleo ci scrum time14:01
bhagyashrishttps://review.rdoproject.org/r/c/rdo-jobs/+/4079114:02
soniya29bhagyashris, i am in14:06
bhagyashrismarios, https://review.opendev.org/c/openstack/tripleo-ci/+/84297314:07
chandankumardviroel: may be you can approve these changes https://review.opendev.org/q/topic:revive-elastic-recheck thanks!14:25
dviroeli will take a look, yep14:26
ysandeep|rovermarios: could you please invite me in your call with Brendan - I am interested in details 14:40
mariosysandeep|rover: https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/features/distributed_compute_node.html#deploying-the-control-plane 14:43
mariosysandeep|rover: ok will do 14:43
ysandeep|rovermarios, nice.. so basically we will assume c8 wallaby is one edge site and c9 wallaby is another edge site.14:45
ysandeep|roverinteresting.. 14:45
rlandyrcastillo:' hey ... can you join https://meet.google.com/xnf-tvdh-pmk14:49
rlandylenovo issues14:49
dasmhmm.. srbac took longer than usual :)14:49
rlandyrcastillo: we're dropping - pls ping pojadhav when you are back14:52
frenzyfriday|ruckperiodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-tripleo-master has inconsistent failures in master. I am testprojecting it14:53
frenzyfriday|ruckchecking wallabies and victoria components after that14:53
rcastillorlandy: oops, was making coffee. Let me know if you need anything14:59
rlandyrcastillo: pls help pojadhav with lenovo ticket14:59
rlandyshe has a laptop situation15:00
pojadhavrcastillo, hello15:00
* dviroel ceph wallaby promoted https://images.rdoproject.org/ceph/daemon/wallaby/15:09
*** dviroel is now known as dviroel|lunch15:20
* frenzyfriday|ruck lunch15:25
chandankumardviroel|lunch: https://review.opendev.org/c/openstack/tripleo-ci/+/842900 when around!15:25
dasmhey cores. Baremetal legacy jobs have enough +2s. Can we get +W? https://review.rdoproject.org/r/c/rdo-jobs/+/4262115:28
ysandeep|roverdasm: here you go.. +w15:30
ysandeep|roveryou already had four +2s :D15:30
dasm\o/15:31
ysandeep|roverfrenzyfriday|ruck, logserver.rdoproject.org/ working fine for you? 15:38
ysandeep|roverloading very very slow for me15:38
ysandeep|roverfrenzyfriday|ruck, please try opening https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-wallaby/4956456/15:38
frenzyfriday|ruckyep, https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-wallaby/4956456/ is loading15:39
ysandeep|roverfrenzyfriday|ruck, loading fine or slow for you as well?15:43
*** marios is now known as marios|out15:44
rlandyarxcruz: is there something you want to raise?15:46
arxcruzrlandy we were supposed to talk, about use tempest-skiplist in downstream15:46
arxcruzand unificate tempest tests 15:46
rlandyoh15:46
rlandylet me add that15:47
ysandeep|roverrlandy, https://logserver.rdoproject.org/87/40787/4/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-wallaby/8ea3230 loading fine for you?15:51
rlandyysandeep|rover; yep -  I can open that15:54
rlandyI see the none failure there15:54
ysandeep|roverrlandy, yeah same failure in downstream: https://sf.hosted.upshift.rdu2.redhat.com/logs/47/43047/1/check-rdo/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-internal-wallaby/c43744a/logs/overcloud-novacompute-0/var/log/extra/errors.txt.gz 15:55
ysandeep|roverrlandy, let's promote c8 wallaby - jobs are failing with known issue15:55
ysandeep|roverrlandy, /me proposing criteria patch for c8 wallaby15:56
rlandyysandeep|rover: ok  .. will merge and revert15:56
arxcruzrlandy want to 1-1 now or you're busy ?16:02
rlandyysandeep|rover: frenzyfriday|ruck: what else do you want me to pick up?16:03
rlandyarxcruz: we can - will ping you in 516:03
arxcruzok16:03
ysandeep|roverrlandy, please keep an eye https://review.opendev.org/c/openstack/tripleo-ci/+/842915 , please see this merges16:05
rlandyysandeep|rover: k - will do16:08
rlandyysandeep|rover: is that it?16:08
ysandeep|roverrlandy, above will fix check, master we can't promote because of sc010-kvm .. c9 - is good, c8 - we are promoting now, victoria - we promoted, train - have legit bug.. so I guess that's it ..16:09
ysandeep|rover16.2 I will investigate tomorrow.. have few suggestion from yatin - need to try some revert of patches16:09
ysandeep|rover16.2/17 - tempest failure one16:10
rlandyysandeep|rover: ^^ not skipping16:10
rlandylet's get it fixed16:10
rlandyc9 is good? it will promote?16:10
rlandyysandeep|rover:16:10
ysandeep|roverc9 wallaby- I mean we promoted on 21st 16:11
rlandyok16:11
rlandyok - for today16:11
rlandyysandeep|rover: going into next meeting - pls ping with wallaby c8 patch16:12
rlandyarxcruz: joining16:12
ysandeep|roverfrenzyfriday|ruck, anyone luck from #neutron folks if neutron server not using memcache is okay?16:14
frenzyfriday|ruckysandeep|rover, nope. lemme ping again in the channel16:16
ysandeep|roverfrenzyfriday|ruck, ping with specific query.. you might get better result16:17
ysandeep|roverrlandy, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4308616:21
frenzyfriday|ruckrlandy, didnt get chance to look into downstream component failures yet. Looking into master and wallaby components (updated on hackmd)16:26
rlandyfrenzyfriday|ruck: thanks16:26
*** dviroel|lunch is now known as dviroel16:29
* ysandeep|rover leaving, see you tomorrow o/ 16:29
rlandyysandeep|rover: thanks16:29
rlandyhave a good night16:30
*** ysandeep|rover is now known as ysandeep|out16:30
ysandeep|outrlandy++ frenzyfriday++16:30
frenzyfriday|ruckysandeep|out, good night :)16:30
ysandeep|outfrenzyfriday|ruck, rlandy thanks, you too have a great rest of your day/evening :D16:31
rlandylunch brb16:44
dasmdviroel:  thanks for +W on podman-compose. I think we need to merge this: https://review.opendev.org/c/opendev/elastic-recheck/+/841426 because podman-compose relies on it17:09
*** jpena is now known as jpena|off17:10
dviroeldasm: done, both should go to gate now17:12
frenzyfriday|ruckupdated the last two patches to make train and wallabies pull from quay. If testproj https://review.rdoproject.org/r/c/testproject/+/42265 passes I'll add them to review list17:21
reviewbotI have added your review to the Review list17:21
frenzyfriday|ruckoh shoot XD Bot gone wrong17:21
frenzyfriday|ruckrlandy, I am leaving for the day17:23
frenzyfriday|ruckIf we are lucky https://review.rdoproject.org/r/c/testproject/+/43082 might pass - or at least we might get a consistent error17:24
rlandyfrenzyfriday|ruck: thanks17:28
* dviroel coffee17:31
dasmdviroel:  ack, thx17:32
*** rlandy is now known as rlandy|mtg18:14
dasmbrb18:24
dasmback19:03
*** rlandy|mtg is now known as rlandy19:11
rcastillolunch brb20:43
*** dviroel is now known as dviroel|out21:21
* dasm takes off!21:24
dasmo/21:24
rcastilloback21:46
*** rlandy is now known as rlandy|biab22:01
*** rlandy|biab is now known as rlandy23:18
*** rlandy is now known as rlandy|out23:50

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!