Wednesday, 2021-03-31

*** jmasud has joined #oooq00:07
*** jmasud has quit IRC00:09
*** jmasud has joined #oooq00:13
*** jmasud has quit IRC01:19
*** jmasud has joined #oooq02:05
*** jmasud has quit IRC02:06
*** udesale has joined #oooq03:05
*** akahat has quit IRC03:08
*** kopecmartin has quit IRC03:09
*** kopecmartin has joined #oooq03:13
*** akahat has joined #oooq03:22
*** saneax has joined #oooq03:34
*** ykarel|away has joined #oooq04:20
*** skramaja has joined #oooq04:23
*** jmasud has joined #oooq04:31
*** ykarel|away is now known as ykarel04:39
*** ratailor has joined #oooq04:41
*** marios has joined #oooq05:03
*** zbr|rover4 has joined #oooq05:04
*** zbr|rover has quit IRC05:06
*** zbr|rover4 is now known as zbr|rover05:06
*** ysandeep|away is now known as ysandeep05:59
*** ksambor has quit IRC06:04
*** ksambor has joined #oooq06:08
*** slaweq has joined #oooq06:10
*** jmasud has quit IRC06:48
*** tosky has joined #oooq07:33
*** ysandeep is now known as ysandeep|lunch07:47
*** ykarel has quit IRC08:01
*** dpawlik0 is now known as dpawlik08:08
*** derekh has joined #oooq08:30
*** ykarel has joined #oooq08:43
*** ykarel is now known as ykarel|lunch08:43
*** ysandeep|lunch is now known as ysandeep09:07
*** derekh has quit IRC09:21
*** derekh has joined #oooq09:21
chkumar|ruckzbr|rover: https://review.opendev.org/c/openstack/tripleo-ci/+/78405709:43
chkumar|ruckysandeep: hello, can you update this https://code.engineering.redhat.com/gerrit/#/c/211643/39 with this test only octavia_tempest_plugin.tests.scenario.v2.test_traffic_ops.TrafficOperationsScenarioTest09:46
chkumar|ruckysandeep: not sure what is going on, need to hold the node there09:47
*** jmasud has joined #oooq09:51
chkumar|ruckysandeep: I got the issue09:52
chkumar|ruckysandeep: https://opendev.org/openstack/octavia-tempest-plugin/src/tag/1.3.0/octavia_tempest_plugin/tests/scenario/v2/test_traffic_ops.py there is no smoke test09:53
chkumar|ruckcgoncalves: Hello09:53
chkumar|ruckcgoncalves: Can we bump the octavia-tempest-plugin version from 1.3.0 to 1.6.0 in train?09:53
ysandeepchkumar|ruck, ack o/09:53
chkumar|ruckysandeep: it is also going to break rdoside for sure09:54
chkumar|ruckfor train09:54
ysandeepchkumar|ruck, yes train periodic jobs are failing https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-standalone-train/e9b5187/job-output.txt09:54
chkumar|ruckysandeep: let me put the test name there instead of smoke regex09:55
chkumar|ruckysandeep: and that test does not exists on train09:56
mariosreviews please https://review.opendev.org/q/topic:tripleo-ci-reduce-rocky09:57
zbr|roverchkumar|ruck: added comment on the review.09:57
ysandeepchkumar|ruck, ack , so for train & 16.2 we need to bump octavia-tempest-plugin version.. or not run smoke test at all..10:01
chkumar|ruckysandeep: yes correct,10:04
*** ykarel|lunch is now known as ykarel10:04
chkumar|ruckand also goes same for ussuri10:04
bhagyashrischkumar|ruck, arxcruz akahat please feel free to add agenda here https://hackmd.io/M1IjwgcPQLK_ttOLFUSPHQ#promoter-sync---2021-March-31-agenda for promoter sync meeeting10:05
ysandeepchkumar|ruck, ack thanks!, lets see what octavia squad / cgoncalves suggests.10:06
*** jmasud has quit IRC10:08
pojadhavysandeep, could please have a look at https://review.rdoproject.org/r/c/testproject/+/3291310:12
pojadhavzuul encountered job is not defined, though I have added it  https://review.rdoproject.org/r/c/rdo-jobs/+/32793/4/zuul.d/component-jobs.yaml10:13
soniya29arxcruz, kopecmartin, please edit/add the today's tempest agenda:- https://hackmd.io/fIOKlEBHQfeTZjZmrUaEYQ10:14
pojadhavysandeep, resolved !10:21
ysandeeppojadhav, what was the issue?10:21
pojadhavtypo10:21
pojadhav:)10:22
ysandeeppojadhav, ohh.. Depends-On : vs Depends-On: - i couldn't spot it either.. anyway.. added comment on testproject patch and its depends-On..10:25
*** derekh has quit IRC10:26
*** derekh has joined #oooq10:26
chkumar|ruckzbr|rover: please have a look at retry_limit case in upstream infra https://review.opendev.org/78218710:36
zbr|roverouch, that build history of that job looks not funny10:38
zbr|roverwithout clicking into it, i do have a guess: timing out on pre because is trying to compile cryptography with rust.10:38
zbr|roverhmm, in fact is not timeout, it would be we should see a timeout from zuul but i see nothing.10:42
zbr|roverhow can i debug the RETRY from zuul without any logs?10:42
zbr|roverbut i could try to bump total execution timeout to see if we get something better.10:42
zbr|roveris not that the base job has timeout: 360010:45
chkumar|ruckzbr|rover: may be recheck and watch the logs10:51
zbr|roverbut there are no logs, i can only look at succesful runs, and i see no reason to worry on any of them10:52
zbr|roverduration is far below the 3600 value10:52
zbr|roveri can only make a CR and watch the live console from zuul10:54
zbr|rovernot sure yet, but i think i spot where it gets stuck: https://zuul.opendev.org/t/openstack/stream/b3f23e90b8c448e39dd9aa17830f76e5?logfile=console.log11:22
zbr|roveralready 10m+ and no output on screen at all11:22
zbr|roverjoys of using ansible for running commands with long execution time,...11:23
zbr|roverwe need a bug for it, and i need to talk with cloudnull about it first11:25
zbr|rovergoing out for lunch, when i am back i will continue one that ^ issue.11:37
chkumar|ruckzbr|rover: aye11:38
zbr|roverfungi will help me narrow it down, now is not sure if is something infra or something specific to our job11:38
zbr|rovera broken c8 stream is on the plate too11:38
*** sshnaidm|off is now known as sshnaidm11:57
weshay|ruckzbr|rover, you on the call?12:19
weshay|ruckah.. I see chandan.. you two trade?12:19
chkumar|ruckweshay|ruck: yes12:20
weshay|ruckchkumar|ruck, thanks.. sorry.. I neglected to remove that quay status12:28
chkumar|ruckweshay|ruck: no problem12:28
weshay|ruckmarios, chkumar|ruck thanks for the feedback on repoclosure.. will rework that command today12:29
mariosweshay|ruck: ack thanks will check again on next reviews run12:29
chkumar|ruckweshay|ruck: please update this review https://review.rdoproject.org/r/c/config/+/32893 when free, thanks !12:29
weshay|ruckchkumar|ruck, k.. so we have the right name format now?12:32
chkumar|ruckweshay|ruck: yes,12:32
weshay|ruckakahat, skip? we just spoke last week12:32
chkumar|rucksshnaidm: https://review.rdoproject.org/r/c/config/+/3289312:32
akahatweshay|ruck, yes. np.12:33
weshay|ruckakahat, bhagyashris is https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32007 cherry picked into the servers?12:34
akahatweshay|ruck, i did not. bhagyashris you?12:34
chkumar|ruckweshay|ruck: https://review.opendev.org/c/openstack/tripleo-ci/+/784057 this also12:35
akahatweshay|ruck, looks like servers are not updated.12:36
* akahat updating promoter servers 12:37
bhagyashrisweshay|ruck, let me check12:41
bhagyashrisweshay|ruck, i checked and that change is not into servers12:43
bhagyashrisakahat, ^12:45
weshay|ruckfrenzy_friday, let's use rlandy's 1-1 to sync today about tripleo-health12:45
akahatbhagyashris, i'm currently updating servers12:45
weshay|ruckis that ok?12:45
frenzy_fridayweshay|ruck, yep sure12:46
bhagyashrisakahat, i see on c8 promoter servers are pulled the new code?12:47
akahatbhagyashris, yes. i've just updated12:47
bhagyashrisok ok12:47
*** jfrancoa has joined #oooq12:51
chkumar|rucksshnaidm: please merge this one https://review.rdoproject.org/r/c/config/+/3289312:53
soniya29arxcruz, kopecmartin, weshay|ruck, chkumar|ruck, akahat, tempest meeting?12:57
sshnaidmchkumar|ruck, done, although we need to try what Harald suggested, it should be deleted as part of the stack12:58
chkumar|rucksshnaidm: proposing a patch for the same13:00
soniya29akahat, ^^13:00
weshay|ruckarxcruz, this is the right git hash?   Arx Cruz506bd27890Add alternative image to be downloaded13:04
weshay|ruckcurrent-tripleo is at python-tempestconf-3.1.1-0.20210320005348.2b611fc.el8.src.rpm  2b611fc13:04
weshay|rucktripleo-ci-testing has the latest patch python-tempestconf-3.1.1-0.20210329050010.233fca2.el8.src.rpm233fca213:05
*** jfrancoa has quit IRC13:06
arxcruzweshay|ruck: yes, it is13:18
weshay|ruckarxcruz, ok.. so no promotion needed.. should be there13:18
arxcruzweshay|ruck: i´ll recheck the job13:19
arxcruzweshay|ruck: I was trusting ykarel words :)13:19
weshay|ruckarxcruz, good to know how to check it urself13:19
arxcruzyup, i´m aware how to check13:19
weshay|ruckk.. cool13:20
*** skramaja has quit IRC13:25
*** ratailor has quit IRC13:25
zbr|roveradded https://bugs.launchpad.net/tripleo/+bug/192209113:27
openstackLaunchpad bug 1922091 in tripleo "tripleo-ansible molecule jobs get stuck with no output" [High,Confirmed] - Assigned to Sorin Sbarnea (ssbarnea)13:27
bhagyashrischkumar|ruck, marios promoter sync13:31
mariosbhagyashris: o/ i have joined another call ping me if you need me to join you?13:33
bhagyashrismarios, yes we want to discuss regarding the container-push role that we discussed in the scrum13:34
mariosbhagyashris: ack ok will join you13:34
bhagyashrisbut if have another meeting then will shift this meeting tomorrow13:34
bhagyashrismarios, thanks :)13:34
mariosbhagyashris: no its ok am on prod chain call but i will drop coming...13:35
bhagyashrismarios, ack13:35
mariosweshay|ruck: sorry, dropped for ^^^13:36
mariosweshay|ruck: i wanted to start joining those again - in light of yesterday conversation regarding the container tools/podman version on tripleo13:36
ykarelweshay|ruck, there was recent promotion so it should be good now13:36
mariosweshay|ruck: next one...13:36
ykarelsorry was for arxcruz ^13:37
arxcruzykarel: :)13:37
ykareltriggered ci let's see13:37
mariosbhagyashris: am gonna drop if ok in a sec13:45
mariosbhagyashris: thanks for the ping13:45
kopecmartinzbr|rover: chkumar|ruck weshay|ruck when you have time, please have a look https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/78384313:56
*** chem has joined #oooq14:15
bhagyashrismarios, thanks marios14:21
chkumar|ruckcgoncalves: https://review.rdoproject.org/r/c/rdoinfo/+/32936 please have a look when free14:23
cgoncalveschkumar|ruck, we've just discussed that on our internal call now. gthiemonge will be following up with a comment shortly14:25
chkumar|ruckcgoncalves: thanks :-)14:26
pojadhavweshay|ruck, ysandeep, marios, bhagyashris, chkumar|ruck : pls review https://review.rdoproject.org/r/c/rdo-jobs/+/3279314:30
pojadhavweshay|ruck, sshnaidm : kindly review https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3289014:31
mariospojadhav: will do14:33
*** ykarel is now known as ykarel|away14:40
ysandeeppojadhav, ack14:41
*** saneax has quit IRC14:51
chkumar|ruckweshay|ruck: I will do follow up tomorrow on rest of stuff14:55
weshay|ruckk.. thanks14:55
chkumar|ruckweshay|ruck: https://review.opendev.org/c/openstack/tripleo-ci/+/784040 if sc10 passes merge it14:55
weshay|ruckdoh14:56
ysandeepchkumar|ruck, weshay|ruck ovb job in downstream are failing with https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-rhos-16.2/2bb3b76/job-output.txt15:01
ysandeepbuild-nodes-json.py: error: unrecognized arguments: --id 1713215:01
chkumar|ruckysandeep: can you open a bug let's dig it tomorrow15:03
ysandeepchkumar|ruck, ack o/ lets dig tommorow.. In downstream we use bugzilla for tracking.. wondering what will be right component for bugzilla15:04
weshay|ruckysandeep, me wonders.. https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/ovb-manage/tasks/ovb-create-stack.yml#L13715:14
ysandeepchkumar|ruck, weshay|ruck we are cloning from rdo http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-config.git/tree/playbooks/tripleo-rdo-base/pre-ovb-create.yaml#n415:14
weshay|ruckysandeep, is ovb internal running 2.0?15:14
weshay|ruckdidn't think it was15:15
weshay|ruckhttps://code.engineering.redhat.com/gerrit/#/c/233487/15:15
ysandeepweshay|ruck, internal is using 1.0 but we are cloning config repo from rdo.. and we changed default in config .. https://github.com/rdo-infra/review.rdoproject.org-config/commit/05140e2d3de240300b5885c68bf735314fb3222d#diff-9f7a287c92a93b37e9ba70786833a5c9119e081d214e232fdf7c8cee17d1a64515:15
ysandeephttp://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-config.git/tree/playbooks/tripleo-rdo-base/pre-ovb-create.yaml#n415:15
weshay|ruckysandeep, can we retry w/ this merged? https://code.engineering.redhat.com/gerrit/#/c/233487/115:18
ysandeepweshay|ruck, testproject went good yesterday.. retrying here https://code.engineering.redhat.com/gerrit/#/c/233488/15:19
*** jpodivin_ has quit IRC15:19
weshay|ruckysandeep, ya.. id not present in 1.015:20
weshay|ruckhttps://opendev.org/openstack/openstack-virtual-baremetal/src/branch/stable/1.0/openstack_virtual_baremetal/build_nodes_json.py15:20
weshay|ruckhttps://opendev.org/openstack/openstack-virtual-baremetal/src/branch/stable/2.0/openstack_virtual_baremetal/build_nodes_json.py#L7015:20
weshay|ruckysandeep, I think changing the override will fix this15:20
ysandeepweshay|ruck, yeah i agree.. +1 to merge https://code.engineering.redhat.com/gerrit/#/c/233487/115:21
weshay|ruckysandeep, and this merged https://review.rdoproject.org/r/c/config/+/3289315:21
weshay|ruckysandeep, keep working your script :) there will be leaks15:22
weshay|ruckneed to run it against all the clouds where we use ovb15:22
ysandeepweshay|ruck, yes on it.. made good progress today..15:23
weshay|ruckrock15:24
ysandeepweshay|ruck, fyi.. vexx had some failed heat_stack .. i worked with infra to clean them up.. http://pastebin.test.redhat.com/952037.. we got rid of them .. I think they also logged a ticket with vexx to reset some instances15:25
weshay|ruckah nice...15:25
weshay|ruckthank you15:26
*** ykarel|away has quit IRC15:37
*** jmasud has joined #oooq15:39
*** ysandeep is now known as ysandeep|away15:47
*** spotz has joined #oooq15:50
weshay|ruckfrenzy_friday, 2 min16:01
frenzy_fridayweshay|ruck, sure , np16:01
akahatweshay|ruck, I'm enabling manifest push on C8 master. Need to check some logs.16:07
weshay|ruckk16:07
mariosweshay|ruck: o/ grateful if you could push that along today if you get a chance please https://review.opendev.org/c/openstack/puppet-tripleo/+/78412316:41
weshay|ruckmarios, roger that16:41
mariosNEEDS REVIEWS please add to your review list thank you https://review.opendev.org/q/topic:tripleo-ci-reduce-rocky16:42
mariosweshay|ruck: thank you16:42
*** marios is now known as marios|out16:47
*** udesale has quit IRC16:54
*** marios|out has quit IRC16:59
*** derekh has quit IRC17:00
sshnaidmweshay|ruck, please take a look https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3272717:25
weshay|ruckoh.. I should have just indented the try on 18817:28
weshay|rucksshnaidm, let me patch on top of this17:28
weshay|rucksshnaidm, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3294817:34
sshnaidmweshay|ruck, what's wrong with my version?17:42
weshay|ruckthey do the same thing really..17:45
weshay|rucksshnaidm, I think your code has some flu on it17:45
sshnaidmweshay|ruck, it's vaccinated though17:46
weshay|rucksshnaidm, OH SNAP17:48
*** jmasud has quit IRC17:55
*** jmasud has joined #oooq18:39
* zbr|rover expects big announcement from RMS tomorrow19:58
zbr|roverthat is good, vaccination seems to be little bit more effective than our CI ;)20:06
weshay|ruckzbr|rover, NOT true20:15
weshay|ruckwe have a 96% effective rate20:15
weshay|ruckoverall20:15
weshay|ruckactually w/ no change in play20:16
weshay|ruckwe're mostly 100% effective20:16
weshay|ruck91% master ---> 97.6, 100, 100, 100, 95.320:16
weshay|ruckwe're better than pfizer20:16
zbr|roveri was referring to ability to intorduce a bug... not the pass rate ;)20:32
zbr|roverI guess that for vaccination the “pass the vaccination centre” rate is very close to 100%20:34
zbr|roverat least for zuul the queue is short, i cannot even join the queue for the vaccine yet.20:36
*** jmasud has quit IRC20:38
zbr|roverweshay|ruck: wdyt about adding a new cli option; gri —masse ?20:40
sshnaidmweshay|ruck, your solution is still wrong https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32948/2/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/zuulv3_job_builds.py#19621:25
sshnaidmweshay|ruck, why just not merge mine?21:25
*** jmasud has joined #oooq21:25
*** jmasud has quit IRC22:36
*** jmasud has joined #oooq22:55
*** jmasud has quit IRC23:21
*** jmasud has joined #oooq23:28
*** tosky has quit IRC23:30
*** jmasud has quit IRC23:45
*** jmasud has joined #oooq23:49

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!