Friday, 2022-06-24

opendevreviewIan Wienand proposed openstack/openstack-zuul-jobs master: [dnm] testing grafana  https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/84712800:03
opendevreviewIan Wienand proposed openstack/openstack-zuul-jobs master: [dnm] testing grafana  https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/84712800:33
*** rlandy|bbl is now known as rlandy01:33
opendevreviewIan Wienand proposed openstack/openstack-zuul-jobs master: [dnm] testing grafana  https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/84712801:40
*** rlandy is now known as rlandy|out01:40
*** ysandeep|out is now known as ysandeep01:59
opendevreviewIan Wienand proposed openstack/openstack-zuul-jobs master: [WIP] grafana : import and screenshot project-config graphs  https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/84712803:22
opendevreviewIan Wienand proposed openstack/openstack-zuul-jobs master: grafana : import and screenshot project-config graphs  https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/84712803:56
opendevreviewIan Wienand proposed openstack/project-config master: grafana: import graphs and take screenshots  https://review.opendev.org/c/openstack/project-config/+/84712903:56
*** akahat is now known as akahat|ruck04:39
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Add Prometheus monitoring metrics into logscraper  https://review.opendev.org/c/openstack/ci-log-processing/+/84696506:24
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Add Prometheus monitoring metrics into logscraper  https://review.opendev.org/c/openstack/ci-log-processing/+/84696506:31
opendevreviewMerged openstack/ci-log-processing master: Move options into config file  https://review.opendev.org/c/openstack/ci-log-processing/+/84549406:40
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Fix typos; add download dir into the diagram  https://review.opendev.org/c/openstack/ci-log-processing/+/84752706:48
opendevreviewMerged openstack/ci-log-processing master: Do not try to get new job results when none available  https://review.opendev.org/c/openstack/ci-log-processing/+/84526706:54
*** arxcruz|rover is now known as arxcruz06:55
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Move upload image job to post step  https://review.opendev.org/c/openstack/ci-log-processing/+/84752806:59
*** jpena|off is now known as jpena07:06
*** ysandeep is now known as ysandeep|afk07:11
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Push container image "latest" after merge  https://review.opendev.org/c/openstack/ci-log-processing/+/84752807:16
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Parse performance.json file and send to separate index  https://review.opendev.org/c/openstack/ci-log-processing/+/84046607:58
*** ysandeep|afk is now known as ysandeep09:00
*** rlandy|out is now known as rlandy10:21
*** ysandeep is now known as ysandeep|brb11:01
*** ysandeep|brb is now known as ysandeep11:18
*** dviroel|out is now known as dviroel11:19
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Add missing file_list config parameter  https://review.opendev.org/c/openstack/ci-log-processing/+/84757511:40
*** rlandy is now known as rlandy|dr_appt11:48
*** ysandeep is now known as ysandeep|afk12:12
*** rlandy|dr_appt is now known as rlandy12:51
*** ysandeep|afk is now known as ysandeep12:58
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Parse performance.json file and send to separate index  https://review.opendev.org/c/openstack/ci-log-processing/+/84046613:17
*** dasm|off is now known as dasm13:33
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Parse performance.json file and send to separate index  https://review.opendev.org/c/openstack/ci-log-processing/+/84046614:03
dpawlikdansmith: hey, I will let you know when we merge https://review.opendev.org/c/openstack/ci-log-processing/+/840466 and deploy the new version on production14:25
dpawlikProbably it will be on Monday14:25
*** ysandeep is now known as ysandeep|out15:00
elodillesclarkb fungi : fyi, i'm planning to run the usual EOL'd branch clean-up script. as i see gerrit & zuul are OK15:07
*** dviroel is now known as dviroel|lunch15:19
clarkbelodilles: yes, ntoe that this is the first run since the gerrit 3.5 upgrade. I don't anticipate problems but you might want to do one first and double check it is happy15:42
elodillesclarkb: ack, thanks, the script asks for confirmation before every branch delete, so it's easy to check after the 1st delete :)15:44
fungisounds good, thanks elodilles!15:48
elodillesit looks like working as expected: "Branch stable/victoria successfully deleted from openstack/os-apply-config!"15:49
fungiexcellent15:49
elodillesvs https://opendev.org/openstack/os-apply-config15:49
elodillesstable/victoria is not visible anymore \o/15:50
*** jpena is now known as jpena|off16:02
*** dviroel|lunch is now known as dviroel16:18
elodilleshere is the list of deleted EOL'd branches from today: https://paste.opendev.org/show/bAck9bp9XVCWUTngn6rS/17:39
fungiexcellent. i hope this results in a significant reduction in failing periodic pipeline jobs17:51
fungiotherwise i think we need to start looking harder at disabling a lot of those jobs which keep running every day and nobody's working on fixing17:52
elodillesit will reduce somewhat, but the most failing things are oslo's old stable branches, so until those are not EOL'd we will see quite some failures :/18:01
elodillesalso, *-powervm + murano repos are quite inactive. those could be disabled i think18:03
fungiif nobody in the oslo team has time to fix those failing stable periodic jobs, can we just stop running them for now?18:03
fungii get something like 120 e-mails from the stable periodic failures ml every day18:03
elodillesyepp, i know, i'm getting them too18:05
elodillesmore than half of them are coming from oslo18:06
elodilles8 is coming from murano18:07
elodilleswhich is a dead project basically18:07
elodilles8 is coming from *-powervm, which repos are also completely inactive ones18:08
elodillesactually oslo team was already thinking of EOLing their old stable branches: http://lists.openstack.org/pipermail/openstack-discuss/2021-October/thread.html#2518018:17
elodillesi don't know where it got stucked18:17
elodillesif those branches are EOL'd we'd get rid of the majority of the dailybuild failures18:18
fungioh, cool. yes that would be very nice18:22
elodillesfungi: i've sent out this mail, this might also help somewhat on the situation if noone objects: http://lists.openstack.org/pipermail/openstack-discuss/2022-June/029250.html18:30
fungithanks!18:30
fungiand yeah, whatever we can do to reduce unnecessary load on our test resources is much appreciated18:31
fungicontinually running jobs we know are broken and nobody cares to fix is a massive waste18:31
elodillesalso sent this mail towards oslo team: http://lists.openstack.org/pipermail/openstack-discuss/2022-June/029252.html18:40
elodillesfungi: though i'd say that periodic stable jobs should not be so resource greedy. i mean, they are mostly simple unit test jobs + docs jobs. either they fail or they run successfully they consume less node time than tempest and other tests18:41
elodillesfungi: though i understand any waste is still a waste18:42
elodillesanyway, hopefully these EOL proposals will help :)18:43
elodillesabout murano + powervm I think the best is to switch off the periodic stable jobs as soon as possible18:44
elodillesI can propose stable-only patches to remove periodic-stable template from their old, failing branches18:46
elodillesfungi: if i do this, then can you force-merge those patches? ^^^18:46
elodilles(i don't know when TC will force-retire them)18:48
fungielodilles: sure, i can bypass testing to merge configuration removing failing jobs19:14
fungisome of those jobs are quick, but some are devstack/tempest based jobs that run for an hour or twi19:14
fungis/twi/two/19:14
fungiand unit tests for nova are even upwards of an hour to complete these days19:15
elodillesfungi: ack, i'll push then those patches19:17
fungialso i wouldn't mind setting a limit on extended maintenance for this reason... stable/queens is close to five years old at this point19:18
fungibut certainly we can be more aggressive about removing jobs which stop working on extended maintenance branches19:19
fungiadding them back is a simple revert as soon as someone gets them working again19:19
fungiadd them to the experimental pipeline, make sure they succeed, revert the removal19:20
fungihaving them fail constantly is of no use to anyone19:20
elodillesfungi: the patches for *-powervm repos: https://review.opendev.org/q/topic:unmaintained-stable-periodic19:46
elodillesthese will eliminate: 8 mails / 15 failing jobs + some non-failing but unnecessarily running passing periodic jobs19:47
*** dviroel is now known as dviroel|out20:50
opendevreviewGage Hugo proposed openstack/project-config master: End project gating for openstack-helm deployments  https://review.opendev.org/c/openstack/project-config/+/84762121:45
opendevreviewGage Hugo proposed openstack/project-config master: Retire openstack-helm-deployments repo  https://review.opendev.org/c/openstack/project-config/+/84741421:46
opendevreviewGage Hugo proposed openstack/project-config master: Retire openstack-helm-deployments repo  https://review.opendev.org/c/openstack/project-config/+/84741421:47
opendevreviewGage Hugo proposed openstack/project-config master: End project gating for openstack-helm deployments  https://review.opendev.org/c/openstack/project-config/+/84762121:56
opendevreviewGage Hugo proposed openstack/project-config master: Retire openstack-helm-deployments repo  https://review.opendev.org/c/openstack/project-config/+/84741421:56
opendevreviewGage Hugo proposed openstack/project-config master: Retire openstack-helm-deployments repo  https://review.opendev.org/c/openstack/project-config/+/84741421:56

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!