Monday, 2021-11-29

*** ysandeep|out is now known as ysandeep03:53
*** ysandeep is now known as ysandeep|ruck04:31
ysandeep|ruckbhagyashris: good morning, welcome back! 05:01
bhagyashrisysandeep|ruck, thank you :)05:06
ysandeep|ruckbhagyashris: We have moved our scrum call by 1 hour but we couldn't edit the earlier scrum mtg invite(i think its owned by you), rlandy have send another mtg invite for 07:30 pm, Could you please delete the one at 06:30 pm IST.05:13
bhagyashrisysandeep|ruck, sure 05:20
bhagyashrisysandeep|ruck, it's just changed for monday right?05:20
ysandeep|ruckbhagyashris, yes only for Monday05:21
bhagyashrisysandeep|ruck, done thanks :)05:24
*** ysandeep|ruck is now known as ysandeep|lunch07:55
*** jpena|off is now known as jpena08:32
*** ysandeep|lunch is now known as ysandeep08:57
*** amoralej|off is now known as amoralej10:28
*** ysandeep is now known as ysandeep|ruck11:08
*** dviroel|OUT is now known as dviroel11:13
*** rlandy is now known as rlandy|ruck11:22
rlandy|ruckarxcruz|rover: ysandeep|ruck: hey - let's ruck/rover sync11:24
ysandeep|ruckrlandy|ruck, ack i am available to chat11:24
rlandy|ruckysandeep|ruck: k - let's give arxcruz|rover a few11:25
rlandy|ruckysandeep|ruck: arxcruz|rover: https://meet.google.com/psg-hbaw-cdp?pli=1&authuser=011:27
rlandy|rucklet's start11:28
*** pojadhav is now known as pojadhav|brb11:28
ysandeep|ruckrlandy|ruck, https://review.rdoproject.org/r/c/rdo-jobs/+/3623611:34
rlandy|rucksoniya29: pls can you follow up on https://review.opendev.org/c/openinfra/python-tempestconf/+/81584211:37
rlandy|ruckysandeep|ruck has the parameters enabled on the THT side11:37
rlandy|ruckwe are ready to test this in tempest11:37
soniya29rlandy|ruck, on it11:37
rlandy|ruckkopecmartin has a -1 on that11:38
soniya29rlandy|ruck, patch needs a parameters updation along with unit test11:39
soniya29i am working on updating the patch with unit test11:40
ysandeep|ruckrlandy|ruck, https://zuul.openstack.org/builds?job_name=tripleo-buildimage-ironic-python-agent-centos-911:42
arxcruz|roverykarel: kopecmartin hey, we have a patch on tempest that we need to merge on wallaby branch, is that okay if i update rdoinfo to use 29.0 on wallaby? not sure the reason we pinned on wallaby 12:06
ykarelarxcruz|rover, i see there is already a patch to bump to 29.1.0 by kopecmartin https://review.rdoproject.org/r/c/rdoinfo/+/3667212:20
rlandy|ruckysandeep|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart/+/813553 https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81676012:23
*** pojadhav|brb is now known as pojadhav12:25
kopecmartinarxcruz|rover: it's ok to bump, wallaby can use the latest tempest without any problems for now12:28
rlandy|ruckjbadiapa: hello ... wrt https://bugs.launchpad.net/tripleo/+bug/195175212:29
ysandeep|rucksshnaidm, I discussed the c9 image build issue in check (and if we can mark it non-voting) with arxcruz|rover and rlandy|ruck in rr sync, rlandy|ruck is about to discuss c9 situation with marios and will let us know how to proceed there.12:29
rlandy|ruckcan you link your patch to enable uefi boot?12:29
sshnaidmysandeep|ruck, thanks12:30
rlandy|rucksshnaidm: why are c9 jobs blocking you?12:30
rlandy|rucknothing should be in check now12:30
mariosysandeep|ruck: sure, lets discuss in scrum? 12:31
sshnaidmrlandy|ruck, they vote here: https://review.opendev.org/c/openstack/tripleo-ci/+/81882012:31
mariosysandeep|ruck: or let me know what u need i don't have any context here outside your ping that mentions me just now 14:29 < ysandeep|ruck> sshnaidm, I discussed the c9 image build issue in check (and if we can mark it 12:31
sshnaidmtripleo-buildimage-ironic-python-agent-centos-9 tripleo-buildimage-overcloud-full-centos-9 tripleo-buildimage-overcloud-hardened-uefi-full-centos-9 - all they're voting12:32
mariossshnaidm: sure we can make them non voting until we fixup the repos, are they broken right now? 12:32
rlandy|ruckmarios: sshnaidm: ^^ those should not be voting 12:32
mariosrlandy|ruck: no objection12:32
sshnaidmmarios, yes,  tripleo-buildimage-ironic-python-agent-centos-9 is broken'12:32
mariossshnaidm: genisoimage? or somehting else? we havea bug? 12:32
sshnaidmmarios, yep12:33
rlandy|ruckhttps://zuul.openstack.org/builds?job_name=tripleo-buildimage-ironic-python-agent-centos-912:33
sshnaidmmarios, ysandeep|ruck pointed to https://bugzilla.redhat.com/show_bug.cgi?id=199971312:33
mariossshnaidm: cool \o/ i hit the same issue in my test just now (but using the 'proper' repos) https://logserver.rdoproject.org/17/36817/5/check/periodic-tripleo-centos-9-buildimage-ironic-python-agent-master/35a214f/build.log12:33
mariossshnaidm: i thought it may be something to do with the new repos but glad to see it is more general 12:34
mariosrlandy|ruck: sshnaidm: ysandeep|ruck: so then lets make that IPA job non voting only? but i have no objection to making them all especially since we're re-workgin repos12:34
* ysandeep|ruck checking now why we are hitting this, we should not be using genisoimage now: https://review.rdoproject.org/r/q/Icb5105cef08480e7ef880530672a0e65fae43efd 12:36
rlandy|ruckyep - but says fix is in12:36
rlandy|ruckok ...12:37
rlandy|ruckso sshnaidm: go ahead and make whatever is failing non-voting12:37
sshnaidmysandeep|ruck, probably it's still in DIB element12:37
sshnaidmmaybe need a patch for DIB as well12:38
ysandeep|rucksshnaidm, possible i think earlier ykarel and amoralej included genisoimage in the temporary repo, may be that temporary repo is no more present.12:39
amoralejyes12:39
amoralejwhere is it failing?12:39
amoralejgenisoimage shouldn't be used anymore in cs912:39
ysandeep|ruckamoralej, https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_793/818820/2/check/tripleo-buildimage-ironic-python-agent-centos-9/7931b8c/build.log12:40
rlandy|ruckamoralej: https://zuul.openstack.org/builds?job_name=tripleo-buildimage-ironic-python-agent-centos-912:40
amoralejah, ipa12:40
amoraleji think ironic moved to xorriso already12:40
amoralejso that should be removed12:41
rlandy|ruckack ... https://bugzilla.redhat.com/show_bug.cgi?id=199971312:41
rlandy|ruckper bug ysandeep|ruck pointed tp12:41
rlandy|ruckmerged for master and wallaby12:41
rlandy|ruckmarios: need to sync re: c9 before CIX call: https://meet.google.com/faf-xjde-xpj?pli=1&authuser=012:42
sshnaidmysandeep|ruck, I see it here still: https://github.com/openstack/ironic-python-agent-builder/blob/master/dib/ironic-python-agent-ramdisk/package-installs.yaml#L1512:42
mariosrlandy|ruck: sure12:43
ysandeep|rucksshnaidm, yeah, i see its using dib element from here ^^12:43
ysandeep|ruckELEMENTS="/home/zuul/src/opendev.org/openstack/tripleo-puppet-elements/elements:/home/zuul/src/opendev.org/openstack/tripleo-image-elements/elements:/home/zuul/src/opendev.org/openstack/heat-agents:/home/zuul/src/opendev.org/openstack/ironic-python-agent-builder/dib/"12:43
* ysandeep|ruck wondering do we move genisoimage to xorriso here https://github.com/openstack/ironic-python-agent-builder/blob/master/dib/ironic-python-agent-ramdisk/package-installs.yaml#L15 or just remove genisoimage. 12:44
rlandy|ruckmarios: https://review.rdoproject.org/r/q/Icb5105cef08480e7ef880530672a0e65fae43efd12:46
rlandy|ruckysandeep|ruck: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80996112:54
rlandy|ruckusfi default boot is only master12:54
rlandy|ruckuefi12:54
ysandeep|ruckrlandy|ruck, thanks! okay to +w https://review.opendev.org/c/openstack/tripleo-quickstart/+/813553 , lgtm..12:54
ysandeep|ruck?12:54
rlandy|ruckysandeep|ruck: yep - will raise at scrum as well12:54
ysandeep|ruckack, adding my vote only, you can +w after scrum12:55
rlandy|ruckysandeep|ruck: pinged harold about https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/job/tripleo-quickstart-gate-master-tripleo-ci-delorean-ruck-rover-test-featureset-minimal/11/console13:01
rlandy|ruckreal g=fix has failing introspection13:01
ysandeep|ruckrlandy|ruck, i wonder if old branches will work with https://review.opendev.org/c/openstack/tripleo-quickstart/+/818766/2/roles/libvirt/setup/overcloud/templates/baremetalvm.xml.j2 13:01
* ysandeep|ruck can't comment without testing 13:02
ysandeep|ruckohh i missed this message -- rlandy|ruck> introspect is still failing here - I thought its a working solution13:02
rlandy|ruckysandeep|ruck: yep - can't go with it yet13:06
rlandy|ruck Failed to set provision state for bare metal node e4bc09f9-2abf-43b6-910b-92e540bb56a8 to inspect: Client Error for url: https://192.168.24.2:13385/v1/nodes/e4bc09f9-2abf-43b6-910b-92e540bb56a8/states/provision, The requested action \"inspect\" can not be performed on node \"e4bc09f9-2abf-13:07
ysandeep|ruckrlandy|ruck, ack.. will try to check that tomorrow (if its still open by then)13:08
rlandy|ruckysandeep|ruck: it's fine - you have enough on your plate13:08
rlandy|ruckysandeep|ruck: just an fyi13:08
*** amoralej is now known as amoralej|lunch13:09
rlandy|ruckarxcruz|rover: https://review.opendev.org/c/opendev/elastic-recheck/+/80563813:13
rlandy|ruck^^ has a bunch of comments13:13
rlandy|ruckpls resolve so we can merge 13:13
rlandy|ruckmatbu: hi ... reviewed https://review.rdoproject.org/r/c/rdo-jobs/+/36850 again13:15
rlandy|ruckmatbu: ok on the naming13:15
*** pojadhav is now known as pojadhav|brb13:15
rlandy|ruckis there a testproject run on these jobs being green13:15
rlandy|rucksee marios -113:15
rlandy|ruckwe'd like to merge this for you13:16
arxcruz|roverrlandy|ruck: ysandeep|ruck ykarel kopecmartin https://review.rdoproject.org/r/c/rdoinfo/+/36672 i rebase your patch, should be fine now 13:22
arxcruz|roverrlandy|ruck: yes, i'll work on that 13:22
ysandeep|ruckarxcruz++ thank you!13:23
rlandy|ruckarxcruz|rover: thanks - tested anywhere?13:23
*** jpena is now known as jpena|off13:24
Tenguhello there! Do you happen to get the /dev/ptmx launchpad issue in your bookmarks?13:34
TenguI have some details.13:34
Tengutldr: it's worse than expected.13:35
rlandy|rucklooking13:36
rlandy|ruckTengu: c9?13:36
*** tosky is now known as Guest714213:37
*** tosky_ is now known as tosky13:37
rlandy|ruckTengu: https://bugs.launchpad.net/bugs/195017613:37
rlandy|ruckTengu: related https://bugzilla.redhat.com/show_bug.cgi?id=202120313:38
*** jpena|off is now known as jpena13:39
rlandy|ruckTengu: and welcome back!! officially13:42
Tengurlandy|ruck: :)13:43
Tengusoooo yeah. we need to report this issue to Containers.13:43
TenguI'll update the BZ with some more comments/context, since I have an env.13:45
Tengu:)13:45
*** pojadhav|brb is now known as pojadhav13:45
matburlandy|ruck: hey thank you, yep there is a testproject which runs those jobs13:54
*** ysandeep|ruck is now known as ysandeep|out13:58
* ysandeep|out out for the day13:59
*** amoralej|lunch is now known as amoralej14:07
mariosrlandy|ruck: https://review.opendev.org/c/openstack/tripleo-ci/+/819448 and https://review.opendev.org/c/openstack/tripleo-quickstart/+/819100 14:12
bhagyashrisreview list : https://review.opendev.org/c/openstack/tripleo-quickstart/+/819100 https://review.opendev.org/c/openstack/tripleo-ci/+/81944814:13
bhagyashrishttps://review.opendev.org/c/openstack/tripleo-ci/+/81876514:14
dviroelhttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/36911/14:20
soniya29rlandy|ruck, https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81565414:24
soniya29rlandy|ruck, https://review.opendev.org/c/openinfra/python-tempestconf/+/81584214:25
bhagyashrishttps://review.opendev.org/c/opendev/elastic-recheck/+/80563814:27
*** ykarel is now known as ykarel|away14:27
arxcruz|roverrlandy|ruck: i need to leave for 1 hour, brb14:46
rlandy|ruckok14:46
*** pojadhav is now known as pojadhav|afk14:46
*** dviroel is now known as dviroel|lunch15:00
rlandy|rucksshnaidm: https://review.opendev.org/c/openstack/tripleo-ci/+/819644 - not working15:33
rlandy|ruck+2'ed the non-voting patch15:34
sshnaidmrlandy|ruck, yeah, will continue to look15:34
sshnaidmSorins inheritance...15:35
rlandy|rucksshnaidm: sorry15:37
arxcruz|roverback16:04
rlandy|ruckarxcruz|rover: thanks - one gate failure16:10
rlandy|ruckhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_fc4/818726/1/gate/tripleo-ci-centos-8-containers-multinode/fc4af53/job-output.txt16:10
rlandy|ruckrechecking16:11
Tengurlandy|ruck: I'm testing https://review.opendev.org/c/openstack/tripleo-heat-templates/+/819646 on my lab right now - had some issues with cs9 and package building, but it seems to be all fine now... UC is deploying with patched code, I should get a status update shortly hopefully.16:12
Tengurlandy|ruck: and if it works as expected, I'll also propose a linter for it, probably in tools/yaml-validate.py - that will prevent future issues with trailing "/" in volumes. Apparently, it's creating other issues of "lesser" impact anyway.16:14
rlandy|ruckTengu: sounds good - thanks16:14
Tenguand LADA is back as expected, btw :)16:14
rlandy|ruckTengu: great - we missed it when it was down16:15
Tenguyeah, sorry -.-'16:15
TenguI didn't really think about potential impact of using git over http....16:15
Tenguuho! so far, so good, my /dev/ptmx is still an actual node after the UC deploy!16:16
Tengulet's see how it goes further. I saw mention of SELinux.16:16
rlandy|ruckarxcruz|rover: pls vote on https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/81951616:17
rlandy|rucksee rerun green on wallaby and master16:17
rlandy|ruckmarios: rechecked https://review.rdoproject.org/r/c/testproject/+/36140 - will see if wallaby fs035 fails again16:20
*** sshnaidm is now known as sshnaidm|afk16:22
Tenguwow.... it does seem to solve the issue for real.16:22
Tengujust like that. remove trailing /. profit.16:22
rlandy|ruckTengu++ nice16:23
Tengunodes are being provisioned.16:24
Tenguand I still have my /dev/ptmx as an actual node.16:24
*** dviroel|lunch is now known as dviroel16:26
TenguI'll wait until the OC deploy starts, but I'm confident.16:27
Tenguand NO SELinux denials so far.16:27
*** amoralej is now known as amoralej|off16:29
rlandy|ruckmarios: ok to merge https://review.opendev.org/c/openstack/tripleo-quickstart/+/819100?16:30
rlandy|ruckyou got a +2 from sshnaidm|afk and +1 from dviroel as well an my vote16:31
Tengugood. guess I'll stop my test here, I'll have to modify the lab in order to take the right OC images. For tomorrow.16:32
Tengurlandy|ruck: I've un-WIP the patch, so once CI is green with it, I guess we can merge it. I'll do a follow-up for the linter thing.16:32
Tenguand now : I'm off.16:33
mariosrlandy|ruck: yes thanks i think it is OK if we need something else I'll post another thanks for checking16:34
mariosrlandy|ruck: it has run a few times now and does what we want etc 16:35
arxcruz|roverrlandy|ruck: should i +w ?16:39
rlandy|rucksure16:39
*** marios is now known as marios|out16:50
rlandy|ruckmarios|out: w+'ed17:18
rlandy|ruckysandeep|out: arxcruz|rover: ^^ fyi17:18
rlandy|ruckif we see fallout17:18
arxcruz|roverok17:19
*** ysandeep|out is now known as ysandeep17:25
ysandeeprlandy|ruck, sry znc lost some messages because of buffer, ^^ fyi for ?17:26
ysandeepwow... 17 was promoted as well17:27
ysandeepToday all branches was promoted.. u/t had nothing new to promote.. but i don't want to jinx it. 17:28
ysandeepwere*17:28
ysandeeprlandy|ruck, thanks for following up with harald on baremetal line issue17:29
ysandeepYeah looks like that patch which harald pointed is causing the issue from symptoms17:29
*** jpena is now known as jpena|off17:31
rlandy|ruckysandeep: yep ++ on 1717:33
rlandy|ruckysandeep: sorry was chatting with harry17:33
ysandeeprlandy|ruck, nw :D 17:35
rlandy|ruckysandeep: so you had a reasonable objection about merging rbac tests in wallaby (and shortly 17)17:36
rlandy|ruckI am meeting with the working group tomorrow17:36
rlandy|ruckto discuss where to raise the bugs we find17:36
rlandy|ruckthen I think we will have a goal of adding wallaby and 1717:36
rlandy|ruckwhen we have a place to raise the failure to be addressed by DFGs17:37
rlandy|ruckysandeep: also ... https://review.opendev.org/c/openstack/tripleo-ci/+/81964417:38
ysandeeprlandy|ruck, My viewpoint was those tests should first pass on master atlest then we have a point of running them on wallaby. 17:38
rlandy|ruckno success on that 17:38
rlandy|ruckysandeep: ack - very reasonable objection17:38
rlandy|ruckysandeep: rechecking and W+ https://review.opendev.org/c/openstack/tripleo-ci/+/81964417:39
rlandy|ruckso patches can continue17:39
ysandeepand in my another point was.. rbac core team should work along side DFGs to make sure various tempest tests passes, IMHO.. its not reasonable to ask us to debug and report those failure when functionality is not 100% ready. 17:41
ade_leedviroel, hey 17:47
ade_leedviroel, back from turkey week -- you made any progress on the fips jobs?17:48
dviroelade_lee: hi17:49
rlandy|ruckade_lee: hello ... ysandeep pointed that we never git the standalone-ipa job passing on train17:49
rlandy|ruckwe have it on other releases17:49
rlandy|ruckade_lee: ^^ priority for your team?17:49
ade_leerlandy|ruck, yeah, I seem to remember that .. ok, I'll get that on our list of priorities17:50
rlandy|ruckade_lee: last we left it, I think there was a backport missing17:50
rlandy|ruckthe job runs in the component line17:50
rlandy|ruckbut was never in criteria17:50
rlandy|ruckhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f77/819100/6/gate/tripleo-ci-centos-8-content-provider-ussuri/f773c11/logs/undercloud/home/zuul/dlrn.log17:53
rlandy|ruckgate failure on no collections patch17:53
ade_leerlandy|ruck, was that last link for me?17:54
rlandy|ruckade_lee: no for marios actually17:54
rlandy|rucksorry - kind of talking to myself on public chat17:55
ade_leerlandy|ruck, just checking 17:55
dviroelrlandy|ruck: doesn't seems related to the patch itself17:55
rlandy|ruckdviroel: will recheck17:56
dviroelade_lee: we merged the fix for collecting logs, so now scenario002 has all the logs (barbican tempest failure - encrypted volume)17:56
ade_leedviroel, ack - I saw that 17:56
ade_leedviroel, I'm working on getting the fix in for rabbit17:57
dviroelade_lee: no updates for other jobs (scn004 and multinode-ipa)17:57
ade_leebasically we need a version of rabbit/erlang that supports fips and we need to specify a parameter to tell it to start in fips mode17:57
dviroelade_lee: ok, and then we have the scn004 that afaranha is working on, right?17:57
ade_leeI'm working on the patch to add the new rabbit temporarily and add the params17:58
*** ysandeep is now known as ysandeep|out17:58
ade_leeyeah - I gotta sync with him in a couple hours17:58
ade_leedviroel, gotta try to figure out why the skip isn't working for the barbican test failure17:59
rlandy|rucklunch brb18:01
dviroelade_lee: i can take a look in your tempest/plugins patch18:03
ade_leedviroel, thanks 18:03
dviroelade_lee: this change https://review.opendev.org/c/openstack/tempest/+/810809 is on top of a conflicting change (https://review.opendev.org/c/openstack/tempest/+/810808)18:36
dviroelade_lee: fips change already depends on this other one: https://review.opendev.org/c/openstack/tempest/+/81948618:37
dviroelade_lee: that change the same bits18:37
rlandy|ruckysandeep|out: we took a decision to try the jenkins jobs in the integration line19:00
*** eliadcohen_ is now known as eliadcohen19:58
afaranhadviroel, I was on PTO last week (and still need to figure out where the put the remaining 10 days of pto....)20:08
*** tosky is now known as Guest716720:17
*** tosky_ is now known as tosky20:17
*** dviroel is now known as dviroel|out20:32
*** rlandy|ruck is now known as rlandy|ruck|biab21:53
*** tosky_ is now known as tosky21:57
*** rlandy|ruck|biab is now known as rlandy|ruck23:28

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!