| *** dviroel|biab is now known as dviroel|out | 00:20 | |
| *** ysandeep|out is now known as ysandeep | 02:48 | |
| *** ysandeep is now known as ysandeep|afk | 03:32 | |
| dasm | i think I'm done for tonight... heh | 04:20 |
|---|---|---|
| *** dasm is now known as dasm|off | 04:20 | |
| dasm|off | ... i'm really done now | 04:59 |
| marios | :) morning dasm|off | 05:23 |
| marios | or good night? | 05:23 |
| marios | arxcruz|rover: o/ fyi merging that https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45468 in case you see any weirdness in the promoter today | 05:53 |
| *** ysandeep|afk is now known as ysandeep | 06:01 | |
| marios | bhagyashris: o/ please lets hold that until we fix the mixed os job ? https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/430534/4#message-89a825002ddff09e3a7e1fa61b188d326b957eb4 | 06:07 |
| ysandeep | reviewbot: please add in review list: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/860921 | 06:12 |
| reviewbot | I have added your review to the Review list | 06:12 |
| ysandeep | bhagyashris, hey o/ do we have a testproject in downstream for https://review.opendev.org/c/openstack/tripleo-quickstart/+/859581/7#message-f9b9e805cfe2d891b9e8df2a6029b8b33d8c58bb | 06:14 |
| marios | pojadhav: o/ can you try and merge this? https://review.opendev.org/c/openstack/tripleo-ci/+/859382 | 06:19 |
| marios | pojadhav: sell sell ! ;) | 06:19 |
| pojadhav | marios, yes working on it now.. i am sorry | 06:21 |
| pojadhav | yesterday was not feeling well | 06:21 |
| pojadhav | so i out early | 06:21 |
| ysandeep | +wed ^^ :) | 06:22 |
| pojadhav | adding zed entries in tests.. will let you know once patch is ready. | 06:22 |
| chandankumar | ysandeep: marios when you get some time please review these patches https://review.opendev.org/q/topic:standalone-roles-testing & notes here: https://review.opendev.org/c/openstack/tripleo-ci/+/843836/45..46//COMMIT_MSG#31 | 06:23 |
| ysandeep | chandankumar, looking | 06:24 |
| marios | ykarel: please reconsider the commit message https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/860921/1#message-8234a97125910b67854f3f265525907d182a1749 it was not a mistake there was a master entry at the time | 06:26 |
| marios | chandankumar: ok | 06:26 |
| marios | chandankumar: i think that series needs you to join one of the review calls and give an overview ;) | 06:30 |
| marios | chandankumar: i have votes on some of them already and will revisit the rest maybe tomorrow review call we can discuss some more ^ | 06:31 |
| chandankumar | marios: yes, sure, I will share it tomorrow during review call. | 06:31 |
| marios | cool | 06:32 |
| ykarel | marios, yes right both changes were independent | 06:32 |
| marios | ykarel: thanks for checking | 06:32 |
| ykarel | bug ok can update commit message | 06:33 |
| ykarel | Done | 06:35 |
| marios | thx ykarel revoted | 06:39 |
| pojadhav | marios, I have one doubt about emit release changes for zed.. | 06:51 |
| pojadhav | marios, do we also need to test that ffu job against zed changes ? | 06:51 |
| pojadhav | marios, ysandeep : emit release code for zed release is ready with fixing review comment https://review.opendev.org/c/openstack/tripleo-ci/+/860586 | 06:54 |
| marios | pojadhav: we will add ffu job for zed but you don't need to worry about it for now | 06:57 |
| marios | pojadhav: thank you will revisit that | 06:57 |
| pojadhav | marios, ack | 06:57 |
| ysandeep | reviewbot, please add in review list: https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/860814 | 07:10 |
| reviewbot | I have added your review to the Review list | 07:10 |
| *** jpena|off is now known as jpena | 07:17 | |
| ysandeep | chandankumar, took a first pass at your patches, but can we discuss your patches over call(if you are available now/later today)/ in review time tomorrow | 07:18 |
| ysandeep | pojadhav, ack, thanks! | 07:21 |
| *** amoralej|off is now known as amoralej | 07:22 | |
| ysandeep | amoralej, hey o/ Could you please check if dlrn stuck for c8 train ? | 07:31 |
| ysandeep | https://trunk.rdoproject.org/centos8-train/report.html | 07:31 |
| ysandeep | last build on 2022-09-29 01:59:35 | 07:31 |
| ysandeep | I was tracing a patch: https://review.opendev.org/c/openstack/puppet-tripleo/+/858141 from 29th sept and found dlrn not building rpm since long | 07:31 |
| amoralej | lemme check | 07:32 |
| arxcruz|rover | jm1 we had promotions for all branches except train \o/ | 07:37 |
| ysandeep | marios amoralej, 16.2 z4 went blocker only on oct 5 and Oct 6-10 was promotion buffer, but if dlrn is stuck for more than 10 days.. I don't think devs patch reached on time for oct 5 deadline | 07:37 |
| jm1 | o/ good morning #oooq | 07:37 |
| jm1 | arxcruz|rover: great \o/ | 07:37 |
| ysandeep | arxcruz|rover, jm1 looks like dlrn is stuck for c8 train, see https://trunk.rdoproject.org/centos8-train/report.html | 07:37 |
| jm1 | my matrix irc bridge seems to be down again so i do not see any messages since (my) yesterday evening :/ | 07:38 |
| jm1 | ysandeep: stuck? how to solve that? | 07:42 |
| ysandeep | jm1, not on us, amoralej is checking. | 07:43 |
| chandankumar | ysandeep: sure, will ping you soon! | 07:43 |
| marios | ysandeep: o/ | 07:43 |
| ysandeep | imho.. We really need some kind of monitoring for dlrn stuck. | 07:43 |
| marios | jm1: this is why there was no new content then :/ didn't think to check dlrn yesterday ^^^ | 07:43 |
| jm1 | ysandeep: ah, ok cool :) | 07:43 |
| marios | ysandeep: thanks | 07:43 |
| jm1 | ysandeep: how did you notice that its stuck? | 07:44 |
| ysandeep | marios, jm1 One of the dev from Glance team pinged me to find why her patches is not, https://review.opendev.org/c/openstack/puppet-tripleo/+/858141 https://review.opendev.org/c/openstack/tripleo-heat-templates/+/858150 | 07:44 |
| ysandeep | is not in* downstream yet | 07:45 |
| marios | ysandeep: ack ... this has happened before we should come up with some kind of alert for it (we may already have some task on the backlog we discussed it before) | 07:45 |
| ysandeep | because 05th was blocker only date for z4, so now she need to raise blocker only | 07:46 |
| marios | ysandeep: perhaps we can consider it during community call if there is no other agenda | 07:46 |
| marios | jm1|ruck: fyi 08:53 < marios> arxcruz|rover: o/ fyi merging that https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45468 in case you see any weirdness in the promoter today | 07:46 |
| ysandeep | marios, ack we can, however its more on #rdo team than us to add monitoring for dlrn. | 07:47 |
| marios | jm1|ruck: though i had a look at master log seems OK/no explosions in logs http://promoter.rdoproject.org/promoter_logs/centos9_master.log just fyi | 07:47 |
| marios | ysandeep: yeah i see what you mean but same time it affects us/our pipeline like here ("why is there no new content for train?" and it seems that is ongoing for a few days and we didn't check/notice) | 07:48 |
| ysandeep | marios, Once amoralej confirm dlrn is stuck, perhaps we want to cascade this info to #rhos-delivery(jason joyce) - Incase he wants to extend the z4 blocker only date / also we should highlight in our program call status. | 07:48 |
| marios | coffee refill brb | 07:48 |
| amoralej | ysandeep, i'm restarting it | 07:48 |
| ysandeep | marios, yes agreed to your other point. | 07:48 |
| frenzyfriday | hey folks 0/ I might be off for some time today and tomorrow. Got covid :/ | 07:49 |
| *** frenzyfriday is now known as frenzyfriday|sick | 07:50 | |
| jm1 | frenzyfriday|sick: oh no! hope you feel better soon | 07:50 |
| ysandeep | frenzyfriday|sick, ooops, take care! | 07:50 |
| ysandeep | amoralej, thanks! | 07:51 |
| jm1 | ysandeep, marios, arxcruz|rover: added point to community call today for discussing dlrn monitoring (even when our conclusion is that its not our responsibility) | 07:56 |
| arxcruz|rover | frenzyfriday|sick take care! | 07:57 |
| amoralej | ysandeep, it's running it will take some time to recover the missing builds | 07:58 |
| marios | hope you feel better soon frenzyfriday|sick o/ | 08:01 |
| marios | thanks amoralej ysandeep | 08:01 |
| marios | ack jm1 thanks | 08:01 |
| ysandeep | amoralej, thanks I have pinged #rhos-delivery too, incase they want to adjust z4 blocker deadline accordingly. | 08:02 |
| amoralej | ok | 08:02 |
| ysandeep | amoralej, I recall some discussion around dlrn monitoring with #rdo, don't recall it was with javier or Alan, But incase you have any pointers on can we add some kind of monitoring for dlrn to avoid these kind of stuck. | 08:05 |
| *** kopecmartin|sick is now known as kopecmartin | 08:08 | |
| amoralej | ysandeep, i know there is some monitoring in place | 08:08 |
| jm1 | ysandeep: why has this not been merged although you workflowed it? https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/430747 | 08:11 |
| jm1 | reviewbot: add to review list https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/430746 | 08:11 |
| reviewbot | I have added your review to the Review list | 08:11 |
| ysandeep | jm1, I think yesterday downstream zuul was stuck | 08:11 |
| ysandeep | jm1, ahh, You have one failed job | 08:12 |
| jm1 | ysandeep: oh zuul wasnt ready yet, i get it :/ | 08:13 |
| ysandeep | jm1, posted recheck, if it fails then I think your sf-config patch needs to go in first. | 08:14 |
| ysandeep | also, once it merges(sf-config) - we need to wait for nodepool image builds | 08:15 |
| ysandeep | amoralej, ahh okay,I think we are i.e missing alerts/ monitoring for all possible cases then. | 08:17 |
| *** ysandeep is now known as ysandeep|lunch | 08:19 | |
| Tengu | hello there! stupid question: is it expected only RDO runs on this change? https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/860814 | 08:59 |
| Tengu | I'd expect to see some zuul.... | 08:59 |
| jm1 | ykarel: hello :) your dns_domain_ports patch has reached osp 17.1. is there a plan to put it into 17.0 as well? https://lada.lab4.eng.bos.redhat.com/?change_id_input=I25f75d7bd8864ea132246cea79e073232d664d76 | 09:20 |
| *** ysandeep|lunch is now known as ysandeep | 09:46 | |
| ysandeep | Tengu, patches on same file in the past have triggered zuul jobs, please see https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/852375/1#message-56e5ee62185c1528f5c84a02598fcf7e2cba8821 | 09:48 |
| ysandeep | Tengu, but it doesn't looks related to your patch only, I can see arxcruz|rover patch also faced same issue: https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/859401 | 09:49 |
| Tengu | ysandeep: meh... | 09:50 |
| ysandeep | no zuul jobs triggered on ^^ this as well | 09:50 |
| Tengu | humpf. | 09:51 |
| jm1 | ykarel: ah i found your unskip patch and your note about 17.0 blocker only. thank you for that! ignore my last question. | 09:52 |
| ykarel | jm1, Thanks, just back from lunch | 09:53 |
| ysandeep | Tengu, These check jobs should trigger: https://github.com/openstack/ansible-role-collect-logs/blob/master/zuul.d/layout.yaml#L41-L47 | 09:54 |
| Tengu | ysandeep: maybe it's ignored for some reasons? | 09:54 |
| ysandeep | arxcruz|rover, jm1|ruck ^^ could you please check further/ ping infra on why jobs didn't trigger on https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/860814 | 09:55 |
| Tengu | though... I think I've seen zuul running on that same file when I edited it in the past. I think. | 09:55 |
| ykarel | Tengu, ysandeep likely need to fix https://github.com/openstack/ansible-role-collect-logs/blob/master/zuul.d/layout.yaml#L98 | 09:59 |
| Tengu | ykarel: queue is wrong? | 09:59 |
| ykarel | i see current Zuul version: 7.0.1.dev33 69df8f5e, which don't accept that | 09:59 |
| ykarel | Tengu, it needs to be on project level now | 09:59 |
| Tengu | ah | 10:00 |
| ykarel | Tengu, see similar change https://review.opendev.org/c/openstack/telemetry-tempest-plugin/+/845520 | 10:00 |
| Tengu | I can propose a patch. | 10:00 |
| ykarel | Thanks | 10:00 |
| ysandeep | ykarel++ thanks! | 10:00 |
| jm1 | ykarel++ haha can we hire you as rr please ;) | 10:00 |
| Tengu | ysandeep, ykarel, jm1: https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/860932 | 10:02 |
| Tengu | and rebased my patch onto it. | 10:02 |
| ykarel | and jobs running https://zuul.openstack.org/status#860932 | 10:02 |
| Tengu | let's see. | 10:02 |
| Tengu | ykarel++ :) | 10:02 |
| arxcruz|rover | Tengu ysandeep +w already :) | 10:11 |
| arxcruz|rover | thanks, save me time to debug | 10:12 |
| arxcruz|rover | dpawlik ^ | 10:12 |
| Tengu | :) | 10:12 |
| Tengu | that was a fast approval, thanks arxcruz|rover | 10:12 |
| arxcruz|rover | Tengu i like to smash the +w button :P | 10:12 |
| Tengu | XD | 10:12 |
| Tengu | arxcruz|rover: care to check out on https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/860814 and smash any button? :] | 10:13 |
| Tengu | uho.... should get my lunch.... | 10:13 |
| arxcruz|rover | Tengu need to wait ykarel patch no? | 10:14 |
| * dpawlik reading back | 10:15 | |
| marios | pojadhav: any updates on https://issues.redhat.com/browse/TRIPLEOCI-1247 - you were going to post the rest of those jobs | 10:17 |
| pojadhav | marios, yes I am working on that ticket | 10:23 |
| pojadhav | will post a patch in some time | 10:24 |
| marios | pojadhav: thanks | 10:29 |
| marios | folks can we please get a review on https://review.opendev.org/c/openstack/tripleo-ci/+/860586 so we can unblock rest of zed work thank you! | 10:32 |
| marios | pojadhav: fyi ^^ | 10:32 |
| pojadhav | marios, thanks | 10:34 |
| pojadhav | marios, patch is up https://review.opendev.org/c/openstack/tripleo-ci/+/860940 against https://issues.redhat.com/secure/RapidBoard.jspa?rapidView=11751&view=detail&selectedIssue=TRIPLEOCI-1247 | 11:02 |
| marios | thank you pojadhav adding to my reviews (please add to review list?) | 11:03 |
| pojadhav | marios, sure will do | 11:03 |
| marios | reviewbot: please add to review list https://review.opendev.org/c/openstack/tripleo-ci/+/860940 | 11:03 |
| reviewbot | I have added your review to the Review list | 11:03 |
| marios | pojadhav: ^ :) | 11:03 |
| pojadhav | marios, thanks :) | 11:03 |
| *** dviroel|out is now known as dviroel | 11:06 | |
| dviroel | o/ | 11:06 |
| Tengu | thanks arxcruz|rover :) | 11:08 |
| Tengu | arxcruz|rover: my patch was stacked onto the zuul layout change, so it should all be good afaik | 11:08 |
| arxcruz|rover | Tengu ok, let me know if you need me to review again | 11:09 |
| Tengu | arxcruz|rover: it's in gate right now :) | 11:09 |
| Tengu | getting more data for debugging: my new kinky thing XD | 11:09 |
| marios | pojadhav: please check when you have time first pass some nits need fixing https://review.opendev.org/c/openstack/tripleo-ci/+/860940/1#message-ebf8a0c6232cbf65d02005af9d371b738c14ad13 | 11:15 |
| pojadhav | marios, checking | 11:16 |
| *** amoralej is now known as amoralej|lunch | 11:17 | |
| ysandeep | jm1, arxcruz|rover fyi.. I will trigger train - network/common/tripleo component jobs - So that those component promote soon. | 11:21 |
| arxcruz|rover | ysandeep ok | 11:22 |
| *** ysandeep is now known as ysandeep|afk | 11:42 | |
| *** pojadhav is now known as pojadhav|afk | 11:45 | |
| *** ysandeep|afk is now known as ysandeep | 12:16 | |
| dasm|off | 05:23:11 marios | :) morning dasm|off | 12:41 |
| dasm|off | marios: night, night :) | 12:41 |
| *** dasm|off is now known as dasm | 12:41 | |
| dasm | o/ | 12:41 |
| marios | :) well morning then | 12:41 |
| dasm | it's still night ;) morning is gonna be in next 1.5h :P | 12:42 |
| dasm | marios: morning :) | 12:42 |
| dasm | http://www.total-knowledge.com/~ilya/mips/ugt.html | 12:43 |
| dasm | ^^ | 12:43 |
| marios | :) | 12:45 |
| *** pojadhav|afk is now known as pojadhav | 12:45 | |
| marios | folks can we please get a review on https://review.opendev.org/c/openstack/tripleo-ci/+/860586 so we can unblock rest of zed work thank you! | 12:50 |
| *** amoralej|lunch is now known as amoralej | 12:52 | |
| pojadhav | arxcruz|rover, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, anbanerj, dviroel, rcastillo, dasm, jm1|ruck community call in 11 mins.... | 13:19 |
| pojadhav | hackmd for community call : https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg | 13:19 |
| ysandeep | marios, looking | 13:21 |
| marios | thanks ysandeep and chandankumar o/ (looks like chkumar merged it) | 13:21 |
| ysandeep | yeah, chandankumar++ +wed it already | 13:22 |
| pojadhav | folks, community call | 13:31 |
| pojadhav | jm1|ruck, ^^ | 13:32 |
| dviroel | ysandeep: maybe the alert RDOTrunkRepoTooOld | 13:56 |
| dviroel | ysandeep: expr: increase(dlrn_builds_total{instance=~"centos9-.*"}[1d]) < 1 | 13:57 |
| ysandeep | dviroel, yeah that seems like it | 14:22 |
| * jm1 eod now before we get ysandeep's train results :P (will check in my morning) | 14:30 | |
| jm1 | have a nice evening folks :) | 14:31 |
| marios | rcastillo: are we done for https://issues.redhat.com/browse/TRIPLEOCI-1241 (just commented - i couldn't find something?) | 14:34 |
| marios | jm1: o/ have a good one | 14:34 |
| ysandeep | jm1, I am still waiting for nodes from last 3 hours.. https://review.rdoproject.org/zuul/status#28537 | 14:35 |
| ysandeep | Have a great evening! I don't expect results anytime soon | 14:36 |
| *** ysandeep is now known as ysandeep|dinner | 14:37 | |
| dviroel | @team, fyi, tomorrow is a holiday here, so I will be offline | 14:42 |
| rcastillo | marios I was going to ask if we needed to update this spot yet https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/run-test/templates/oooq_common_functions.sh.j2#L24 | 15:05 |
| *** ysandeep|dinner is now known as ysandeep | 15:06 | |
| ysandeep | dviroel, ack, enjoy your PTO o/ | 15:07 |
| marios | rcastillo: right we'll do that but not here yet we have another card for the upgrade jobs so that will be dealt with there | 15:07 |
| rcastillo | marios: ok then. that was the only place I found. We can close it out | 15:07 |
| marios | rcastillo: ack thanks. this was primarily sanity check/if we can spot something. we'll only really find out once we get the branch ;) | 15:10 |
| *** dviroel is now known as dviroel|lunch | 15:11 | |
| *** marios is now known as marios|out | 16:00 | |
| *** ysandeep is now known as ysandeep|out | 16:10 | |
| *** dviroel|lunch is now known as dviroel | 16:24 | |
| *** amoralej is now known as amoralej|off | 17:10 | |
| *** jpena is now known as jpena|off | 17:25 | |
| *** dviroel is now known as dviroel|biab | 19:19 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!