Thursday, 2021-09-16

*** ykarel_ is now known as ykarel03:57
*** ysandeep|away is now known as ysandeep05:09
*** bhagyashris|off is now known as bhagyashris05:34
*** amoralej|off is now known as amoralej07:01
*** jpena|off is now known as jpena07:28
*** ykarel__ is now known as ykarel08:03
*** ykarel is now known as ykarel|lunch08:20
ysandeepanbanerj|ruck, fyi.. https://bugs.launchpad.net/tripleo/+bug/1923194 is still an issue.. I tried to revert the skip and we still hit the issue intermittently.. Moved back the cix card as well.09:00
anbanerj|ruckysandeep, ack thanks09:01
mariosanbanerj|ruck: o/ hey let me know if you need help on something09:24
jbadiapaguys, have you seen the following error?09:26
jbadiapaThe task includes an option with an undefined variable. The error was: 'overcloud_image' is undefined09:26
*** ykarel|lunch is now known as ykarel09:27
jbadiapaI saw this commit https://github.com/openstack/tripleo-quickstart/commit/e401b6bc9ca88c7b4a91555066c68f3206746490#diff-42564c475b0a1383ae3387babe011b8bed75da4bfb59f38cc5b1b667cf433b0909:28
jbadiapaBut I didnt see where the overcloud_image is configured09:28
mariosjbadiapa: are you seeing that in one of the jobs? overcloud_image defined @ https://opendev.org/openstack/tripleo-quickstart-extras/src/commit/abccbfa1ce060412b68961beeb6177af743f0692/roles/extras-common/defaults/main.yml#L170 09:30
jbadiapanope, I saw it on my local environment09:30
jbadiapadamm, That's on my local too.09:32
jbadiapashould we include the extras-common to the meta of the conver-images? 09:35
ysandeepjbadiapa: Seeing error something like this http://pastebin.test.redhat.com/994458 ?09:35
jbadiapayeap, taht one09:35
jbadiapaysandeep^09:36
ysandeepI am also seeing in internal real baremetal jobs 09:36
ysandeepstarted yesterday for this job. 09:36
ysandeepjbadiapa, In the commit message it is mentioned "The var overcloud_image defaults to overcloud-full" .. But I don't see that var in default in tq, its only mentioned in tqe: https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/extras-common/defaults/main.yml#L170 09:47
ysandeepMay be we can add `overcloud_image` var in convert_image role defaults as an easy solution 09:49
jbadiapaysandepp, https://github.com/openstack/tripleo-quickstart/commit/e401b6bc9ca88c7b4a91555066c68f3206746490#diff-42564c475b0a1383ae3387babe011b8bed75da4bfb59f38cc5b1b667cf433b09 changed the overcloud-full to {{ overcloud-images }}09:50
jbadiapaon my env, I added the extras-common to the meta of the conver-images as a test. But I think this will make to reexecute the extras-common role.09:52
ysandeepjbadiapa, yeah I saw that I am wondering if we can set overcloud-images: overcloud-full in the convert-image tq role for the time being.09:52
ysandeepykarel, what do you think ^^ , Context: https://review.opendev.org/c/openstack/tripleo-quickstart/+/801703/5#message-2847a1c88bfbce1f91a18ff90ba233d2d9046546 09:52
jbadiapaysandeep, https://codesearch.opendev.org/?q=%7B%7B%20overcloud_image%20%7D%7D&i=nope&literal=nope&files=&excludeFiles=&repos= 09:55
ykarelysandeep, adding extras-common is fine as a dep09:55
jbadiaparoles/convert-image/tasks/main.yml , roles/libvirt/setup/undercloud/tasks/customize_overcloud.yml , roles/libvirt/setup/undercloud/tasks/main.yml 09:56
ykarelas that will pull required var, and that role don't execute anytask09:56
ysandeepykarel: Something like this: https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/container-build/meta/main.yaml#L17 ?10:01
ykarelyes10:01
ysandeepykarel: thanks!10:05
ysandeepjbadiapa: ^^ fyi.. do you want to propose a patch with what you tried locally / Otherwise I can. 10:07
ykarelysandeep, or may be good to add that var to "common" role defaults10:08
ykarelto avoid much dep on quickstart-extras roles10:08
ykarelso quickstart roles can be use independent of quickstart-extras10:09
jbadiapaI liked the ykarel option of adding it on the common role10:09
ysandeepI agree that would be better10:10
* ysandeep sometimes think may be it would be better if we can club tq and tqe in a single repo10:10
mariosysandeep: that has come up before a few times (merging the two i mean)10:12
ysandeepmarios: ahh, I am not the first one then :D yeah merging them make sense to me..10:14
jbadiapamarios, do you know why they are split in two ?10:14
ysandeepBut we can weigh pros and cons 10:14
mariosjbadiapa: mainly tqe is about the deployment roles and tq is about the 'infra'/setup 10:15
mariosjbadiapa: ysandeep: i think mainly the pushback now is because 'it would be a mess' but perhaps we can revisit it10:16
ysandeepykarel, jbadiapa: writing a bug and then will shoot a fix with default var in tq common role10:16
jbadiapaysandeep, ok, thx10:16
ykarelack10:17
jbadiapaysandeep, I tried to add the extras-common to the common role Bu I got a huge python error 10:35
jbadiapaysandeep, http://pastebin.test.redhat.com/99448710:35
ysandeepjbadiapa, ack 10:43
ysandeepykarel, jbadiapa fyi.. https://review.opendev.org/c/openstack/tripleo-quickstart/+/809367 10:43
ysandeepRunning a testproject in downstream to see how this goes.10:43
ysandeepjbadiapa: Is it possible for you to give https://review.opendev.org/c/openstack/tripleo-quickstart/+/809367/1/roles/common/defaults/main.yml a shot in your environment, if this fixes the issue? Till my testproject reports back.10:48
*** ysandeep is now known as ysandeep|brb10:52
jbadiapasure11:09
*** dviroel|out is now known as dviroel11:20
*** jpena is now known as jpena|lunch11:21
bhagyashrismarios, weshay|ruck ysandeep|brb plz add into yoour review list https://review.rdoproject.org/r/c/config/+/3543611:26
mariosbhagyashris: ack but looks like it needs rebase for merge conflict11:27
bhagyashrisonce above one get merge will hit the recheck on https://review.rdoproject.org/r/c/rdo-jobs/+/35433 and then will merge the rdo-jobs patch 11:27
mariosbhagyashris: https://review.rdoproject.org/r/c/config/+/35436 cannot merge "Merge Conflict"11:28
bhagyashrismarios, done11:29
mariosbhagyashris: thanks, commented do you want to check the ones in https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleoci.yaml#L269-L270 11:32
mariosbhagyashris: like stein/queen things there per your commit message about eol releases11:33
bhagyashrismarios, looking11:38
mariosbhagyashris: ack but few more still11:44
*** pojadhav is now known as pojadhav|afk11:46
bhagyashrismarios, yes i was doing in the follow up patch set Done thanks :)11:50
*** ysandeep|brb is now known as ysandeep11:52
ysandeepMy cleanup patch https://review.rdoproject.org/r/c/rdo-jobs/+/35392 need re-reviews too..  Added suggestion in last patchset.11:52
*** ykarel is now known as ykarel|afk11:54
mariosbhagyashris: ack 11:55
mariosysandeep: sure will re-check but was waiting for the parent patch (fs1-30) to be updated too... i can vote on yours but wont merge until parent does11:55
ysandeepmarios, thanks.. My patch is not dependent on fs01 one so I think ordering will not make a difference, But doing this in sequence make sense incase of any rebase issue..11:58
mariosysandeep: ah ok i thought it was the parent patch ack 12:00
*** jpena|lunch is now known as jpena12:21
*** amoralej is now known as amoralej|lunch12:26
* bhagyashris brb12:33
weshay|ruck0/12:35
dviroelmarios: o/ - do you want to take a look in this wire up patch (https://review.opendev.org/c/openstack/tripleo-quickstart/+/808408) ? just to get some initial thoughts on my workarounds there :P12:36
mariosdviroel: ack adding to my list12:37
dviroeltyvm12:38
weshay|ruckysandeep, ++ common is right place :)12:58
bhagyashrispojadhav|afk, hey scrum13:00
bhagyashrisysandeep, ^13:01
ysandeepsry lost track of time, joining13:01
bhagyashrisok13:01
weshay|ruckFYI.. master is promoting two often. expect gate failures.. 13:12
*** amoralej|lunch is now known as amoralej13:18
*** ykarel|afk is now known as ykarel13:20
bhagyashrishttps://etherpad.opendev.org/p/tripleo-yoga-topics13:21
*** slaweq__ is now known as slaweq13:23
* dviroel ☕13:35
*** frenzy_friday is now known as anbanerj|ruck13:35
* anbanerj|ruck had a power cut, is back13:36
weshay|ruckanbanerj|ruck, 0/ ping if you need anything13:43
weshay|ruckysandeep, move that mtg to 12:30 - 1PM UTC on tues13:44
ysandeepweshay|ruck: hey o/ i got a ping from bhagyashris , her laptop hanged.. she will try to reboot 13:44
weshay|ruckysandeep, aye np13:44
ysandeepweshay|ruck, prepone by half an hour right?13:45
weshay|ruckysandeep, yes.. and make the mtg 1/2 hour only13:45
ysandeepweshay|ruck: done13:46
weshay|ruckthanks.. ysandeep fyi.. if you click find a time.. you can see others schedules :)13:47
ysandeepweshay|ruck, ahh nice.. I was unaware about that feature.. thanks for sharing!13:48
weshay|ruck:)13:48
ysandeepI used to manually add everyone calendar and try to find a schedule.. gmeet++13:49
ysandeepgoogle_calendar++13:49
anbanerj|ruckweshay|ruck, marios , yep sure, thanks13:51
weshay|ruckOTTHER awesome integrations include... ( you may remember me from such films as... )13:52
weshay|ruckgoogle keep and google tasks13:52
weshay|ruckbottom right corner of your mail window click "<"13:52
ysandeepweshay|ruck: yeah you shared about keep/tasks in one of a previous meetings.13:53
*** ysandeep is now known as ysandeep|dinner14:26
erbotRequired files not ready after 537.3748323917389s for distgit-cbs-validate-centos8-stream 35567,1,bad14cb0a559472ba886acab6711bfef14:32
erbotRequired files not ready after 488.4702546596527s for distgit-cbs-validate-centos8-stream 35565,1,97a3c0030ec14d95b91faf560fa4ea9714:37
erbotRequired files not ready after 391.7371699810028s for distgit-cbs-validate-centos8-stream 35566,1,be357e688e764b2a834208c524c5ef4714:42
*** ykarel is now known as ykarel|away15:01
*** marios is now known as marios|out15:33
*** ysandeep|dinner is now known as ysandeep|out15:41
erbotRequired files not ready after 301.5229847431183s for distgit-cbs-validate-centos8-stream 35570,1,48c82c012ede48efbf1f104acd2ceec815:52
*** pojadhav|afk is now known as pojadhav16:24
*** jpena is now known as jpena|off16:28
*** pojadhav is now known as pojadhav|out16:36
*** ysandeep|out is now known as ysandeep16:39
*** amoralej is now known as amoralej|off17:04
weshay|ruckanbanerj|ruck, fyi https://zuul.opendev.org/t/openstack/build/d14a50ffd8fb4dfaa47ddc34e6f41b40 https://zuul.opendev.org/t/openstack/build/7fadd1da9a39485a943fdd85d357233017:15
weshay|rucklooks like a real problem17:15
anbanerj|ruckchecking if we have bugs17:16
weshay|ruckhttps://paste.opendev.org/show/809379/17:16
anbanerj|ruckweshay|ruck, https://bugs.launchpad.net/tripleo/+bug/1943856 I think there are similar bugs reported for other jobs, checking what was done to fix them17:26
weshay|ruckanbanerj|ruck, can you manually check those containers it's trying w/ skopeo or podman pull17:29
anbanerj|ruckyes, locally podman pull quay.ceph.io/ceph-ci/daemon:v4.0.19-stable-4.0-nautilus-centos-7-x86_64 worked, without any auth17:32
weshay|ruckk.. so if the image is there.. we may just have a networking issue in some cloud... 17:33
weshay|ruckso in the bug.. paste in your podman pull results..17:33
weshay|ruckthen check the zuul_info in each failing job.. and note the cloud-provider17:33
weshay|ruckand paste into the bug..17:34
weshay|ruckmaking sense so far?17:34
anbanerj|ruckcan we have a quick call?17:34
weshay|ruckya. start a call17:34
anbanerj|ruckweshay|ruck, https://meet.google.com/ode-pgvq-orw17:35
weshay|ruckanbanerj|ruck, https://registry.rdoproject.org:8443/oapi/v1/namespaces/ceph/imagestreamtags/17:37
weshay|ruck9991292e7 (Francesco Pantano        2021-07-22 09:39:23 +0200 31)       ceph_tag: v4.0.19-stable-4.0-nautilus-centos-7-x86_6417:42
weshay|ruckanbanerj|ruck, docker://trunk.registry.rdoproject.org/ceph/daemon:v4.0.19-stable-4.0-nautilus-centos-7-x86_6417:50
anbanerj|ruckweshay|ruck, updated https://bugs.launchpad.net/tripleo/+bug/1943856. The failed patches are already merged/rechecked18:15
ysandeepanbanerj++ 18:16
ysandeepanbanerj|ruck: wondering, was it purged somehow, or its a container with new tag?18:18
anbanerj|ruckysandeep, not sure if it was removed from trunk.registry.rdoproject.org Are there any logs to check?18:19
anbanerj|ruckI didnt find any recent patches changing daemon:v4.0.19-stable-4.0-nautilus-centos-7-x86_6418:19
ysandeepanbanerj|ruck: not that I know from top of my head, arxcruz|pto / bhagyashris may have this info.18:20
anbanerj|ruckok, I'll check with them tomorrow18:21
ysandeepI am not 100% sure now, But we had some logic to purge images which are not tagged with a certain tag: i think with current-tripleo... But this may be old knowledge now and things might have changed..18:25
*** ysandeep is now known as ysandeep|out18:27
* ysandeep|out out for the day, see you tomorrow o/18:28
* anbanerj|ruck leaves for the day18:35
*** dviroel is now known as dviroel|out21:00

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!