Monday, 2021-11-08

*** gouthamr_ is now known as gouthamr04:07
pojadhavakahat, soniya29|ruck : when you free.. we will have sync up on RR stuff.06:04
akahatpojadhav, okay.. soniya29|ruck when you are free?06:04
soniya29|ruckpojadhav, akahat, i am free now06:17
pojadhavsoniya29|ruck, pls join06:17
pojadhavsoniya29|ruck, https://meet.google.com/xnf-tvdh-pmk?authuser=006:18
*** ysandeep|pto is now known as ysandeep06:36
ysandeephello team o/ 06:36
*** akahat is now known as akahat|rover07:00
pojadhavysandeep, hello :)07:17
ysandeeppojadhav: o/ 07:22
*** pojadhav is now known as pojadhav|lunch07:47
*** sshnaidm|off is now known as sshnaidm08:04
*** pojadhav|lunch is now known as pojadhav08:19
jpodivinDo we have a guide to writing ones own featureset? 08:26
ysandeepjpodivin: I don't think we have any guide for that, but you can refer other featureset file as an example. 08:42
jpodivinysandeep: I see. Well, the thing is I'm not entirely sure how it all fits together. Take the 010. I thought specifying new roles would lead to getting them deployed, but it was still determined by the nodeset 08:46
jpodivinysandeep: short of just copy-pasting I would be going in blind. 08:47
ysandeepjpodivin: could you please share your patch08:48
ysandeepjpodivin: Also, I will see we can improve the docs around adding new featureset, but that may take sometime. Please feel free to ping us here or join weekly triple-ci meeting if you need help/discussion around your issues/blockers.08:51
jbadiapaysandeep, is tehre a way of checking the status of the third party jobs?08:51
jbadiaparecently, I've seen several issues regarding the RDO third party  jobs08:51
jbadiapaand I would like to check their status08:52
ysandeepjbadiapa: you can check status via zuul: for example: https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001 08:52
jpodivinysandeep: sure, consider this https://review.rdoproject.org/r/c/rdo-jobs/+/36416. The override was specified in the ancestor job, but this one actually executes it. The result is, unfortunately, still using 1ctrl https://logserver.rdoproject.org/17/36417/3/check/periodic-tripleo-ci-centos-8-containers-multinode-network-master-validation/21d9ea5/08:52
*** ykarel is now known as ykarel|lunch08:53
jbadiapaysandeep, thx08:54
ysandeepjbadiapa, If you are looking for periodic job status, you can also consult our grafana dashboard: http://dashboard-ci.tripleo.org/d/HkOLImOMk/upstream-and-rdo-promotions?orgId=1 , and zuul status for check jobs.08:55
ysandeepjpodivin: checking08:56
ysandeephmmm, i think because of https://logserver.rdoproject.org/17/36417/3/check/periodic-tripleo-ci-centos-8-containers-multinode-network-master-validation/21d9ea5/logs/undercloud/home/zuul/overcloud-topology-config.yaml.txt.gz08:59
* ysandeep checking what generates that08:59
jpodivinysandeep: thanks09:00
ysandeephttps://logserver.rdoproject.org/17/36417/3/check/periodic-tripleo-ci-centos-8-containers-multinode-network-master-validation/21d9ea5/zuul-info/inventory.yaml 09:04
ysandeep~~~09:04
ysandeepnodes: 1ctlr09:04
ysandeep~~~09:04
ysandeephttps://github.com/openstack/tripleo-quickstart/blob/master/config/nodes/1ctlr.yml#L15-L16 - compute: 0 is defined09:04
ysandeepwe should have used this node: https://github.com/openstack/tripleo-quickstart/blob/master/config/nodes/1ctlr_1comp.yml 09:04
jpodivinysandeep: you know, I think I have set it as such. 09:05
ysandeepjpodivin, we need this under vars:-09:07
ysandeep~~~09:07
ysandeep    vars:09:07
ysandeep      nodes: 1ctlr_1comp09:07
ysandeep~~~09:07
jpodivinysandeep: ok, I'm going to try that. 09:08
ysandeepjpodivin: ack, let's see how it goes.. please let me know if this doesn't work09:10
*** ysandeep is now known as ysandeep|afk09:18
jpodivinysandeep|afk: absolutely.09:29
chandankumarakahat|rover: ysandeep|afk https://review.rdoproject.org/r/c/config/+/36545 patch broke the pre podman login playbook, I am working on fixing it09:31
akahat|roverchandankumar, soniya29|ruck arxcruz ysandeep|afk please review when you are free: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/81697109:40
chandankumarmarios: \o, Can we get this review https://review.opendev.org/c/openstack/tripleo-quickstart/+/816648/1#message-6c5446ea7fa3ca652929feed723f18866e41221c in?09:43
marioschandankumar: yeah i am still using it but not sure if we will keep? I filed the bug so we can check/track it... i can remove the DNM and add a note to it though for now if we want to merge it until we get a better fix? 09:44
marioschandankumar: i'll update in a bit 09:44
chandankumarmarios: yes, sounds good to merge till we get a proper fix, thanks :-)09:44
marioschandankumar: you think we also need it for config/release/tripleo-ci/CentOS-9/master.yml as well as the promotion-testing-hash-master.yml ?09:50
marioschandankumar: i'd think so? 09:51
*** ysandeep|afk is now known as ysandeep09:51
ysandeepmarios, yes we need workaround for master.yml as well, component standalone jobs are also impacted09:51
mariosysandeep: thanks yeah i am editing commit message now for update09:52
mariosadded the master file too 09:52
chandankumarmarios: yes, we need to update both file09:52
mariosack ack 09:52
akahat|roverchandankumar, i've also faced issue with the tripleo_podman: "Destination directory /etc/containers does not exists" ... are we on same page?09:52
akahat|roverhttps://logserver.rdoproject.org/87/36487/6/check/periodic-tripleo-ci-centos-9-scenario010-standalone-master/173bc0d/job-output.txt09:52
chandankumarakahat|rover: it is coming on cs9 issue09:52
chandankumarI am trying to find out 09:52
chandankumarthe reason09:52
akahat|roverokay09:53
jpodivinysandeep: hi. I've tried the changes we were talking about. Sadly it appears to have triggered an exception during the overcloud deploy. 10:18
jpodivinysandeep:https://logserver.rdoproject.org/17/36417/3/check/periodic-tripleo-ci-centos-8-containers-multinode-network-master-validation/ba8a0dc/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz10:18
ysandeepjpodivin, ack will check.. good atleast nodes: 1ctlr_1comp is correctly set now and also number of nodes is correctly set: https://logserver.rdoproject.org/17/36417/3/check/periodic-tripleo-ci-centos-8-containers-multinode-network-master-validation/ba8a0dc/logs/undercloud/home/zuul/overcloud-topology-config.yaml.txt.gz 10:20
chandankumarykarel|lunch: can you hold the node for this review https://review.rdoproject.org/r/c/testproject/+/34926 and pub key is https://github.com/raukadah.keys10:21
chandankumar?10:21
*** ykarel|lunch is now known as ykarel10:21
ykarelchandankumar, ack looking10:21
jpodivinysandeep: yes that is true. I suppose something is wrong with the network topology. https://logserver.rdoproject.org/17/36417/3/check/periodic-tripleo-ci-centos-8-containers-multinode-network-master-validation/ba8a0dc/logs/undercloud/home/zuul/overcloud-deploy/overcloud/tripleo-overcloud-network-data.yaml.txt.gz is empty, but it's apparently the default 10:24
ykarelchandankumar, added to list10:24
chandankumarrechecking my patch10:25
ykarelchandankumar, also add attempts: 1 if not already set and trying to debug retry limit10:25
chandankumarunder job vars?10:25
ykareloutside of vars10:26
ykarelparallel to run:10:26
chandankumarykarel: cool, thanks!10:26
ykarelchandankumar, for that particular issue i think you need to add vars to redhat-9 too10:29
ykarelvars from https://github.com/openstack/tripleo-ansible/blob/master/tripleo_ansible/roles/tripleo_podman/vars/redhat.yml10:30
chandankumarykarel: this redhat.ayml is getting missed10:34
ykarelyes because redhat-9.yaml is available and thus get's selected10:38
chandankumarykarel: https://review.rdoproject.org/r/c/config/+/36592 let's give a try10:46
soniya29|ruckakahat|rover, ack10:46
ykarelchandankumar, that shouldn't work i think10:48
ykareladding to Install podman can work10:48
ykarelbut better to fix upstream itself10:49
chandankumarykarel: ok10:49
chandankumarykarel: now check10:49
*** pojadhav is now known as pojadhav|afk10:51
ykarelchandankumar, looks fine now, this is temporary, right?10:51
chandankumarykarel: yes10:52
ykareland will be fixed in tripleo-ansible itself 10:52
ykarelokk10:52
chandankumarykarel: will do revert10:52
chandankumarakahat|rover: can you open abug for above issue10:52
akahat|roverchandankumar, ack10:52
chandankumarakahat|rover: got introduced after this https://review.rdoproject.org/r/c/config/+/36545 and also add the tripleo_podman task execution logs output10:53
sshnaidmchandankumar, marios hi, don't we have centos-9 as supported in tripleo-repos yet? https://github.com/openstack/tripleo-repos/blob/master/plugins/module_utils/tripleo_repos/main.py#L9610:56
chandankumarsshnaidm: we missed it there https://github.com/openstack/tripleo-repos/commit/ad2e89e6134e544dc0edad0197a3cfeaf4fda85310:57
chandankumarwe added it for tripleo-get-hash10:57
chandankumarproposing a patch up10:58
*** rlandy is now known as rlandy|ruck11:00
akahat|roverchandankumar, https://bugs.launchpad.net/tripleo/+bug/195014811:00
rlandy|ruckchandankumar: review time?11:02
chandankumarrlandy|ruck: joining11:02
rlandy|ruckakahat|rover: soniya29|ruck: will sync with you in around 30 mins11:03
soniya29|ruckrlandy|ruck, sure11:04
rlandy|ruckarxcruz: hello ...11:05
rlandy|ruckwhat state is https://bugs.launchpad.net/tripleo/+bug/1946659 in?11:05
akahat|roverrlandy|ruck, ack11:05
rlandy|ruckleave it open to fix the last case?11:05
arxcruzrlandy|ruck: i'm working on that, i had a meeting with marios last friday, and we were able to identify what needs to be done, but it's not simple because how we mix jinja, shell and python 11:06
rlandy|ruckarxcruz: ok - so I leave it open?11:06
rlandy|ruckthanks for the update11:06
arxcruzrlandy|ruck: yes, i think i found a solution, i'm working on that right now 11:06
rlandy|ruckarxcruz: great11:07
dviroelmornings11:08
chandankumarakahat|rover: updated the bug https://bugs.launchpad.net/tripleo/+bug/195014811:10
arxcruzrlandy|ruck: marios https://review.opendev.org/c/openstack/tripleo-ci/+/81699111:20
arxcruzi'm not 100% sure if the jinja will work11:20
mariosarxcruz: ack adding to list will check in bit11:21
arxcruzmarios: let it finish first, i'm not sure if it will work properly 11:22
ysandeepjpodivin, I couldn't trace the cause of that error.. I will keep looking but may be harald or someone from df have better idea..11:32
mariosarxcruz: ack  had a quick look looks OK but not huge fan of the inserted jinja will comment in bit11:33
rlandy|ruckakahat|rover: soniya29|ruck: https://meet.google.com/fot-nfku-ygp11:33
rlandy|ruckysandeep: any response from #rhos-ops?11:37
rlandy|ruckre; dlrn downstream?11:38
ysandeeprlandy|ruck, dpawlik just fixed that11:38
* dviroel coffee11:39
*** lbragstad7 is now known as lbragstad11:41
marioschandankumar: \o/ 2021-11-08 10:57:52.689568 | primary |   "msg": "Destination directory /etc/containers does not exist"   - do we have a fix yet? 11:44
*** ysandeep is now known as ysandeep|brb11:45
chandankumarmarios: you can recheck now, just merged it https://review.rdoproject.org/r/c/config/+/36592 testing it now11:45
rlandy|ruckysandeep|brb: great - thanks11:46
marioschandankumar: thank you :)11:47
chandankumarmarios: please do recheck your patch11:49
dviroelinteresting https://review.opendev.org/c/openstack/tripleo-quickstart/+/816648/2#message-1deca7ab6716fcca1724f465a80a9c5be6670c0a11:49
rlandy|ruckchandankumar: marios: dviroel: akahat|rover: soniya29|ruck: frenzy_friday: arxcruz: pojadhav|afk: ysandeep|brb: https://miro.com/app/board/o9J_lm_Yoxo=/?invite_link_id=68229542719711:50
rlandy|ruckretro board11:50
rlandy|ruckmeet.google.com/rgg-pwfc-wdb11:50
rlandy|ruckretro first hour - planning second hour11:50
dviroelcool board11:51
rlandy|rucksshnaidm: ^^ we have retro first - you can join both or we can ping you to join when we get to planning11:51
sshnaidmrlandy|ruck, k11:51
mariosack rlandy|ruck 11:58
marioschandankumar: i did 11:58
*** ysandeep|brb is now known as ysandeep11:58
marioschandankumar: https://review.rdoproject.org/r/c/testproject/+/36267/24#message-915f953d9559a5c08c0886ddd797d9f88b228f9a11:58
chandankumarmarios: cool, thanks:-)11:58
rlandy|ruckakahat|rover: arxcruz: retro12:01
jbadiapaI created https://bugs.launchpad.net/tripleo/+bug/1950137 due to an issue with the qemu-nbd on the RDO third party job12:03
jbadiapadoes it ring a bell? 12:03
dviroelmarios: found you https://www.dropbox.com/sh/fydqjehy9h5y728/AAD1j0qWJEd1lQbu13whFCzTa/TripleO?dl=0&preview=TripleO2.jpg&subfolder_nav_tracking=112:24
jpodivinysandeep: thank you, I've checked the outputs and the existing jobs. Looks like this particular set of nodes is only used for ovb12:24
chandankumararxcruz, sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, dviroel,: Planning pad: https://hackmd.io/P5sTPMSBREe5kBS_4jDhIg?view#2021-11-04-Unified-Sprint-53-Planning Line no: 16013:00
frenzy_fridayack, thanks13:01
*** jpena|off is now known as jpena13:24
chandankumarmarios: dviroel rlandy|ruck Does 12:00 UTC wed works for stream pinning discussion?13:58
chandankumar30 mins meeting13:58
dviroelchandankumar: yes14:00
rlandy|ruckchandankumar: yes - thanks14:01
*** ykarel is now known as ykarel|away14:36
*** pojadhav|afk is now known as pojadhav14:50
chandankumarmarios: dviroel rlandy|ruck invite sent for centos pinning15:09
marioschandankumar: ack15:10
*** ysandeep is now known as ysandeep|dinner15:25
mariosrlandy|ruck: 3hours 34 mins on the phone :)15:34
marioshappy monday \o/ 15:34
marios:/15:34
rlandy|ruckmarios: yep - more to go15:34
chandankumarsee ya!15:34
rlandy|ruckmarios: you can join/drop as you want15:45
rlandy|ruckyou don't have to sit through all of it if you don;t want to15:45
mariosrlandy|ruck: ack will do in a bit i think15:45
mariosrlandy|ruck: but it is interesting/useful too 15:46
rlandy|ruckthe CI stuff is probably somewhat relevant :)15:46
rlandy|ruckakahat|rover: soniya29|ruck|afk: how are we looking on ussuri and victoria?15:46
*** ysandeep|dinner is now known as ysandeep15:56
dviroelmarios: ysandeep sshnaidm hi, when you have a time, please can you take a look on: https://code.engineering.redhat.com/gerrit/c/openstack/rrcockpit/+/28840616:15
dviroelit is already in the review hackmd too16:15
mariosdviroel: ack adding to my reviews list16:15
ysandeepdviroel, sure.. I can check first things tomorrow16:16
dviroel++16:18
soniya29|ruckrlandy|ruck, while going through victoria fs39 job is failing which is an promotion blocker also16:29
mariosrlandy|ruck: i may miss the next session and catch the recording 16:29
rlandy|ruckmarios: sure16:29
rlandy|ruckrun like the wind16:29
marioseven though i really wanted to see it (esp director-op... hmm conflicted about leaving :/)16:30
akahat|roverrlandy|ruck, ussuri promoted.16:30
rlandy|ruckakahat|rover: ack16:30
rlandy|ruckso victoria fe039 is a real issue?16:30
rlandy|ruckmarios: it's fine if you want to watch recording16:30
rlandy|ruckwe are running over16:31
rlandy|rucksoniya29|ruck: hmmm - two diff failures - in rerun right now16:32
akahat|roverrlandy|ruck, i've posted testporoject job let's see. 16:32
rlandy|ruckthanks16:33
soniya29|ruckrlandy|ruck, no, they are failing with same reason - "pip conflicting dependencies No key/value pairs"16:33
soniya29|ruckrlandy|ruck, akahat|rover leaving for the day :)16:35
rlandy|rucksoniya29|ruck: I'm looking at https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-victoria16:35
rlandy|rucksoniya29|ruck: k - have a good night16:35
rlandy|ruck2021-11-08 06:13:31.566727 | fa163e95-0ad9-3529-af79-000000000a93 |      FATAL | ensure apache is installed | undercloud | error={"changed": false, "msg": "Failed to download packages: Cannot download Packages/centos-logos-httpd-85.8-1.el8.noarch.rpm: All mirrors were tried", "results": []}16:36
rlandy|ruck2021-11-08 06:13:31.568382 | fa163e95-0ad9-3529-af79-000000000a93 |     16:36
rlandy|ruckno worries16:36
rlandy|ruckwill check it out16:36
soniya29|ruckrlandy|ruck, ack16:37
rlandy|ruckmarios: did you get a response on PSI resources?16:50
mariosrlandy|ruck: waiting for folks to get back this week & likely bring to our next scrum (may just ping folks tomorrow) 16:53
marios(as well)16:53
rlandy|ruckmarios: ack - I approved last week16:55
mariosrlandy|ruck: oh you mean that 16:56
mariosrlandy|ruck: yes16:56
mariosrlandy|ruck: it was approved16:56
mariosrlandy|ruck: we have the quota16:56
rlandy|ruckyes16:56
mariosrlandy|ruck: i meant ping folks about the deletion of storage cos we are running high in our quota there16:56
rlandy|ruckok good16:56
mariosrlandy|ruck: i ping you about that last week if you recall 16:56
rlandy|ruckmarios: sorry  - missed that ping16:57
mariosrlandy|ruck: i was holding cos some folks were out last week (holding on deleting stuffs)16:57
mariosrlandy|ruck: np16:57
rlandy|ruckack on  holding16:57
rlandy|ruckremember that16:57
*** marios is now known as marios|out17:03
*** ysandeep is now known as ysandeep|out17:04
* akahat|rover leaving for the day. :)17:14
rlandy|ruckakahat|rover: have a good night17:27
rlandy|ruck6.5 hours of meetings later17:31
*** jpena is now known as jpena|off17:38
rlandy|ruckvictoria is promoting yay20:01
dviroel\o/20:01
rlandy|ruckakahat|rover: ysandeep|out: pojadhav: so I think the 16.2 component promotion issue is related to extra file in http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/component-ci-testing/20:02
rlandy|ruckpining to get that deleted20:02
rlandy|ruck akahat|rover: ysandeep|out: pojadhav: 16.2 is working now - file got deleted20:39
*** dviroel is now known as dviroel|out21:11

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!