Tuesday, 2021-12-21

*** rlandy|ruck is now known as rlandy|out00:32
*** ykarel__ is now known as ykarel05:39
chkumar|rovermarios: \o Ian proposed this https://review.opendev.org/c/openstack/diskimage-builder/+/822382 for 9-stream changes06:47
marioschkumar|rover: thanks will check 07:06
*** amoralej|off is now known as amoralej08:02
*** jpena|off is now known as jpena08:35
sshnaidmfrenzy_friday, hi, where is sova-patterns file located now?08:36
frenzy_fridaysshnaidm: https://opendev.org/openstack/tripleo-ci-health-queries/src/branch/master/output/sova-pattern-generated.json this is the file that is used now. If you want to add a new one this is the place to add: https://opendev.org/openstack/tripleo-ci-health-queries/src/branch/master/src/data/queries.yml (add and then run tox - it will update the sova patterns and create a new file for elastic recheck)08:38
sshnaidmfrenzy_friday, and this is what collect-logs uses?08:41
frenzy_fridayyes, it uses sova-pattern-generated.json 08:41
sshnaidmfrenzy_friday, ack08:50
sshnaidmfrenzy_friday, did you see maybe where is this "conflicting dependencies" error comes? It seems like red herring08:50
* frenzy_friday checks08:51
chkumar|rovermarios: \o, we have seen two gate failure https://00f4181a05b0b2a9d61e-04499c28cd43dbd0610a4f6cd3b9b5ff.ssl.cf1.rackcdn.com/821884/1/gate/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates-wallaby/86b08e2/logs/undercloud/home/zuul/undercloud_install.log where error": "Not found image:  issue08:52
marioschkumar|rover: ack am digging at that 08:52
chkumar|roverplease have a look, when free, thanks :-)08:52
marioschkumar|rover: for now you can recheck it should pass with re-run as usual 08:52
frenzy_fridaysshnaidm, https://opendev.org/openstack/tripleo-ci-health-queries/src/branch/master/src/data/queries.yml#L741 - I think the pattern and regex mentioned here are matching against something else apart from the actual error scenarios. ANd the same is getting into the sova file here https://opendev.org/openstack/tripleo-ci-health-queries/src/branch/master/output/sova-pattern-generated.json#L140408:53
chkumar|rovermarios: thank you :-)08:53
sshnaidmfrenzy_friday, I think "regex"es as lists are not processed right08:54
sshnaidmfrenzy_friday, all of them match always, for example: https://e422948e3659485610a4-2fe81f106a8b79afa5f859bb7636b32b.ssl.cf2.rackcdn.com/818634/2/gate/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates-wallaby/5b38b3f/logs/_pip_conflicting_dependencies_refresh_FAIL__No_key_value_pairs_provided.log08:54
sshnaidmseems like a bug in regex lists processing in sova08:55
frenzy_fridaysshnaidm, yes, these 3 show up every time08:55
sshnaidmfrenzy_friday, I'll remove lists until we found the problem08:56
frenzy_fridaysshnaidm, ack08:57
sshnaidmfrenzy_friday, worth to check if lists of patterns even work08:59
frenzy_fridaysshnaidm, commented on your patche. I'll check what is messing up the lists in sova later.09:01
chkumar|roverpojadhav: regarding sc10 jobs please work with akahat|ruck to get it converted to trigger specific job https://review.rdoproject.org/r/c/rdo-jobs/+/3706309:26
pojadhavchkumar|rover, thank you for review.. yep will sync up with akahat|ruck.. :)09:26
akahat|ruckchkumar|rover, sure i'll co-ordinate with pojadhav :)09:27
chkumar|rovermarios: Ian has updated the patch, feel free to recheck the fs01 patch10:38
chkumar|rovercontext here: https://bugs.launchpad.net/tripleo/+bug/1954456/comments/1910:39
marioschkumar|rover: thanks#10:46
amoralejchkumar|rover, fyi, centos9-wallaby repo is now consistent10:56
amoralejwe are just missing adding the cron jobs to build next commits, but other than that, it's done10:56
amoralejrlandy_, ^10:56
chkumar|roveramoralej: thank you, I will start adding the wallaby job by EOD10:56
amoralejlet us know if you find issues10:57
chkumar|roversure :-)10:58
*** rlandy_ is now known as rlandy|ruck11:14
rlandy|ruckamoralej: that's great - thank you11:16
rlandy|ruckchkumar|rover: review time?11:18
chkumar|roveryes joining11:18
*** dviroel_ is now known as dviroel11:19
dviroelhttps://review.rdoproject.org/r/c/rdo-jobs/+/36490 is now in merge conflict11:42
akahat|ruckdviroel, thank you!! updated :)11:47
rlandy|ruckfrenzy_friday: hey https://review.rdoproject.org/r/c/testproject/+/37103 - are disappearing11:48
rlandy|ruckpls add trigger jobs11:48
pojadhavrlandy|ruck, will sync up with akahat|ruck for this ^^ for trigger jobs11:49
rlandy|ruckhttps://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-jobs.git;a=blob;f=zuul.d/scenario010-kvm-rdo.yaml;h=d7ddf0452ccf9c2d484aa98366edc90887a44512;hb=HEAD11:49
rlandy|ruckpojadhav: ^^11:49
pojadhavrlandy|ruck, for C9 should I add those sc10-kvm component jobs in the same file mentioned above..?11:50
frenzy_fridayrlandy|ruck, ack, checking11:54
frenzy_fridayhey chkumar|rover, when you get some time pls lemme know if this is the right way: https://review.rdoproject.org/r/c/config/+/37361/2/zuul.d/tripleo-rdo-base.yaml ?12:02
chkumar|roverfrenzy_friday: no no12:03
chkumar|roverfrenzy_friday: you can create a seperate job for testing12:03
chkumar|roverfrenzy_friday: commented on the patch12:05
rlandy|ruckpojadhav: frenzy_friday: you'll need c9 nodeset downstream to run those jobs12:06
rlandy|ruckand you'll need to create trigger jobs12:07
chkumar|roverpojadhav: rebase please https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3714712:17
pojadhavchkumar|rover, ack12:17
pojadhavchkumar|rover, done12:18
chkumar|roverpojadhav: do we have sc7 criteria patch?12:18
chkumar|roverdviroel: thank you for adding updates jobs to promotion criteria, please send a patch to add it to upstream also? In two patches one with definition and other job layout for running in toci12:20
rlandy|ruckfrenzy_friday; pojadhav: will add c9 nodeset downstream for you12:22
dviroelchkumar|rover: sure, let me try ;)12:25
rlandy|ruckfrenzy_friday; pojadhav: downstream is down atm - but will post something12:32
pojadhavrlandy|ruck, ack12:35
pojadhavrlandy|ruck, chkumar|rover : https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/37147 and https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3702412:35
pojadhavplease review  when free.. ^^12:36
pojadhavthose are pending criteria patches of sc02 and sc07 standalone components jobs..12:36
chkumar|roverfrenzy_friday: override this var https://review.rdoproject.org/r/gitweb?p=config.git;a=blob;f=zuul.d/tripleoci.yaml#l259 to quay.rdoproject.org in the testproject job definition12:36
frenzy_fridaychkumar|rover, ack12:38
*** pojadhav is now known as pojadhav|afk12:40
* pojadhav|afk stepping out for sometime12:40
dasmo/12:51
* akahat|ruck will be back in few hours.12:59
dviroelchkumar|rover: was you refering to scenario007-multinode-oooq-container or scenario000-multinode-oooq-container-updates? for C8, i see only scenario007-multinode-oooq-container running in toci13:03
chkumar|roverdviroel: periodic-tripleo-ci-centos-9-scenario000-multinode-oooq-container-updates-master13:04
chkumar|roverdviroel: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config_environments/rdo/CentOS-9/master.yaml#L3813:04
chkumar|roverlet me c8 pipeline13:05
chkumar|roverdviroel: can we add both the jobs in upstream check?13:06
chkumar|roverwe need to figure out where to run apart from toci13:07
frenzy_fridaychkumar|rover, where is push_registry variable used in container-login.yaml?13:08
dviroelchkumar|rover: yep, will add both and we can futher discuss in reviews13:09
chkumar|roverfrenzy_friday: it will be used here https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/build-containers/templates/tripleo-build.sh.j2#L6113:09
frenzy_fridaychkumar|rover: oh ok, so it is not used to trigger any conditional tasks in playbook?13:10
frenzy_fridayI am trying to figure out where I can put a condition to switch between container-login and container-login-quay.yaml13:11
chkumar|roverfrenzy_friday: yes, it is not used anywhere in playbook13:12
rlandy|ruckchkumar|rover:  - https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status - all the network trigger jobs created internal jobs13:14
rlandy|ruckchkumar|rover: https://code.engineering.redhat.com/gerrit/c/testproject/+/299390 - never kicked?13:14
frenzy_fridaychkumar|rover, one way is https://review.rdoproject.org/r/c/config/+/37361/5/playbooks/tripleo-rdo-base/container-login-quay.yaml#15 . But it doesnt look good.13:16
chkumar|roverrlandy|ruck: the jobs never kicked13:24
chkumar|roverfrenzy_friday: another solution is use set_fact in the container-login playbook13:25
frenzy_fridaychkumar|rover, ack, using set_fact13:26
* rlandy|ruck confused13:26
rlandy|ruckarxcruz, sshnaidm, rlandy, rlandy|ruck, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, anbanerj,  dviroel, rcastillo, dasm - community call ... please add topics: https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg13:28
chkumar|roverfrenzy_friday: https://paste.openstack.org/raw/811801/13:29
chkumar|roverrlandy|ruck: currently no job is running after recheck in downstream sf13:29
chkumar|roverrlandy|ruck: it may run in 30 to 60 mins13:29
rlandy|ruckah ok13:30
chkumar|roverfrenzy_friday: that's way I think we donot need to add a seperate playbook13:30
*** amoralej is now known as amoralej|lunch13:40
*** amoralej|lunch is now known as amoralej14:19
rlandy|ruckakahat|ruck: hey - pls see rhos-ops14:26
rlandy|ruckakahat|ruck: can you put in a patch to remove all -kvm jobs from integration and component lines?14:26
rlandy|ruckchkumar|rover: ^^14:26
rlandy|rucknote that the nodeset is being removed14:27
rlandy|ruckchkumar|rover: have a meeting  - can help in a bit14:29
akahat|ruckrlandy|ruck, okay. i'll put up the patch.14:31
rlandy|ruckakahat|ruck: pls coordinate with chkumar|rover  14:31
rlandy|ruckhe started14:31
chkumar|roverakahat|ruck:  please go ahead14:31
chkumar|roverI am looking at downstream14:31
rlandy|ruckakahat|ruck: merged the criteria patch14:31
rlandy|ruckakahat|ruck: so we need a patch to get -kvm jobs out of integration and component lines14:31
rlandy|ruckwith in the hour :)14:32
rlandy|ruckwhen nhicher will remove the nodeset label14:32
rlandy|ruckmarios: meeting?14:32
rlandy|ruckamoralej: chkumar|rover: are we keeping the EL9 meeting or skipping today?14:34
chkumar|roverrlandy|ruck: ok to skip for me14:34
rlandy|ruckok by me14:34
amoralejok by me too14:34
mariosrlandy|ruck: sorry joining 14:34
rlandy|rucknp14:34
akahat|ruckrlandy|ruck, chkumar|rover https://review.rdoproject.org/r/c/rdo-jobs/+/3738614:37
akahat|ruckhttps://review.rdoproject.org/r/q/topic:%22kvm%22+(status:open%20OR%20status:merged)14:43
chkumar|roverakahat|ruck:  what about from component line?14:44
akahat|ruckchkumar|rover, yeah.. you will get review in mins.14:45
chkumar|roverand here https://review.rdoproject.org/r/c/rdo-jobs/+/3738714:45
chkumar|roverakahat|ruck: merge conflict https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3738814:54
akahat|ruckchkumar|rover, yes. just saw it.14:54
* rlandy|ruck reads back14:58
rlandy|ruckchkumar|rover: akahat|ruck: thank - saw https://review.rdoproject.org/r/c/rdo-jobs/+/37386 was just w+'ed15:00
chkumar|roverakahat|ruck: rlandy|ruck merged both changes15:00
chkumar|roverleft with ci-config change only15:00
rlandy|ruckhttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3738815:01
rlandy|ruck^^ merge conflict15:01
rlandy|ruckakahat|ruck: ^^ still needed?15:01
rlandy|ruckakahat|ruck: chkumar|rover: thanks for taking care of that15:02
akahat|ruckrlandy|ruck, no i don't think we need that now.15:03
akahat|ruck:)15:03
akahat|ruckI'll abandon it.15:03
rlandy|ruckakahat|ruck: great - thanks15:04
akahat|ruckrlandy|ruck, good news we got success with ovb: https://review.rdoproject.org/r/c/testproject/+/3735015:05
akahat|ruckin first run we run standalone run successfully and in 2nd run we got ovb green run.15:05
rlandy|ruckakahat|ruck: good to know15:05
rlandy|ruckpls clean up those patches so we can merge15:05
rlandy|ruckakahat|ruck: thanks for doing that15:05
akahat|ruckack15:06
rlandy|ruckhttps://review.rdoproject.org/r/q/topic:%22kvm%22+(status:open%20OR%20status:merged)15:06
rlandy|ruckall merged15:06
rlandy|ruckchkumar|rover: got past openvswitch on downstream?15:07
rlandy|ruckcool15:07
*** dviroel is now known as dviroel|lunch15:09
chkumar|roverrlandy|ruck: proposing a patch15:10
rlandy|ruckrcastillo: hey - pls see pvt15:17
*** akahat|ruck is now known as akahat|dinner15:18
rcastillorlandy|ruck: ack15:20
*** akahat|dinner is now known as akahat|ruck15:45
mariosrlandy|ruck: is el9 call cancelled today? 15:45
rlandy|ruckmarios: nobody joined15:45
rlandy|ruckI think so15:45
rlandy|ruckalan and jon are out15:45
rlandy|ruckchkumar|rover is EoD15:46
mariosrlandy|ruck: ack15:46
mariosrlandy|ruck: i joined but was alone :) dropped15:46
rlandy|ruckmarios: did the same15:46
rlandy|ruckwas the only one15:46
rlandy|ruckdropped15:46
rlandy|rucklonely 15:46
marios:)15:46
*** pojadhav|afk is now known as pojadhav16:02
*** dviroel|lunch is now known as dviroel16:07
*** marios is now known as marios|out16:35
*** sshnaidm is now known as sshnaidm|afk17:34
*** jpena is now known as jpena|off17:44
amoralejchkumar|rover, we've found an issue in the puppet-stdlib version of wallaby with centos9 and ruby317:55
amoralejyou'll find if you try to test centos9-wallaby17:55
amoralejwe'll apply a fix tomorrow17:55
*** amoralej is now known as amoralej|off18:02
rlandy|ruckamoralej|off: thanks for heads up19:34
*** dviroel is now known as dviroel|afk19:53
rlandy|ruckchkumar|rover: akahat|ruck: fyi ... https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/view/phase-1-pipelines/job/rdo_trunk-promote-master-centos8-current-tripleo/ - weirdo jobs are broken - please ping amoralej|off 21:49

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!