Friday, 2021-11-05

*** rlandy|ruck|afk is now known as rlandy|ruck00:56
*** sshnaidm is now known as sshnaidm|off03:06
*** frenzyfriday|sick is now known as frenzy_friday04:25
*** beagles is now known as eagles08:58
*** lbragstad6 is now known as lbragstad09:12
*** amoralej|off is now known as amoralej09:37
*** jpena|off is now known as jpena10:36
*** dviroel|out is now known as dviroel|rover10:38
dviroel|rovermornings10:38
*** rlandy is now known as rlandy|ruck10:43
rlandy|ruckmarios: hello10:45
rlandy|ruckmarios: started the gchat with steve10:45
rlandy|ruckyou should be able to see the discussion there10:46
mariosrlandy|ruck: hi yeah i saw it and saw steve comments on the patch(es) and commented there10:46
rlandy|ruckmarios: he's also on PTO this coming week :)10:46
amoralejchandankumar, rlandy|ruck fyi we have centos-9-stream nodes working in upstream infra10:46
rlandy|ruckamoralej++ yay10:47
rlandy|ruckyay 10:47
rlandy|ruckyay10:47
rlandy|ruckamoralej: you rock10:47
marios:)10:47
rlandy|ruckthank you10:47
amoraleji'm currently testing in https://review.opendev.org/c/x/packstack/+/816796/10:47
amoralejbut apparently it's working fine10:47
rlandy|ruckbest news today!10:47
rlandy|ruck    nodeset:10:47
rlandy|ruck      nodes:10:47
rlandy|ruck        - name: centos9s10:47
rlandy|ruck          label: centos-9-stream10:47
rlandy|ruckI see 10:48
rlandy|ruckwe will need a new nodeset10:48
mariosyeh i was about to write the same10:48
rlandy|ruckamoralej: chandankumar is on vacation10:48
rlandy|rucksure he'll be happy to come back to this news10:48
amoralejah, it's local holiday in india today10:48
amoralejiirc10:48
rlandy|ruckyep10:48
amoralejgood10:48
rlandy|ruckthis is awesome!10:48
rlandy|ruckmarios: you adding the nodeset patch or should I?10:49
rlandy|ruckgoes in tripleo-ci10:49
mariosrlandy|ruck: sure i can do it10:49
rlandy|ruckk - thanks10:50
rlandy|ruckfrenzy_friday: hey - hope you are better - can you hear us today?11:06
rlandy|ruckhmmm - ovb is still hosed downstream11:08
rlandy|ruckmarios: are you still fighting ovb?11:16
rlandy|ruckanything we can help with?11:16
mariosrlandy|ruck: yeah ... not sure i am digging still but if i don't find something i'll file a bug for it11:17
rlandy|ruckmarios: ok - going to W+ https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81675911:17
rlandy|ruckwe should get rid of the earlier releases11:18
rlandy|ruckbut that is another battle11:18
mariosrlandy|ruck: ack 11:19
mariosrlandy|ruck: well we have a card for it i mean 'remove stale stuff' kind of thing but you know priorities11:19
mariosrlandy|ruck: regarding the earlier releases i mean 11:19
rlandy|ruckmarios: ack - that's our lives11:19
mariosrlandy|ruck: hmmm11:19
rlandy|ruckone day we'll clean up after ourselves11:19
mariosrlandy|ruck: didn't notice it maybe we can update that patch though11:19
mariosrlandy|ruck: i mean no need to keep adding it? 11:20
mariosrlandy|ruck: lets remove queens/stein from there? 11:20
rlandy|ruckmarios: sure - let me update11:20
rlandy|ruckand you can revote11:20
mariosrlandy|ruck: ack 11:20
rlandy|ruckhmmm - -1 on this https://review.opendev.org/c/openstack/tripleo-quickstart/+/81631311:27
rlandy|ruckdviroel|rover: hi - good morning11:32
dviroel|roverrlandy|ruck: morning11:33
rlandy|ruckdviroel|rover: think we are looking good on ruck/rover - just following up on broken OVB in downstream11:33
rlandy|ruck16.2 promoted yesterday11:34
rlandy|ruck17 on wed - so we have some time11:34
dviroel|roverrlandy|ruck: great, checking component line atm11:34
rlandy|ruckdviroel|rover: downstream cockpit still has results so ++ on that11:34
rlandy|ruckdviroel|rover++ for fixing that11:34
rlandy|ruckmajor thanks on that one11:35
dviroel|roverrlandy|ruck: will work on updating downstream ansible to work with both configurations11:35
rlandy|ruckdviroel|rover: sounds good11:35
rlandy|ruckdviroel|rover: review wise, you can check out our list ... https://hackmd.io/FGMoCiRfSNa8puA1BpTQ-Q11:36
rlandy|ruckunder November 5th11:36
dviroel|roverk11:36
dviroel|rover:)11:36
rlandy|ruckchecking on c9 zuul user patches11:36
rlandy|ruckmarios: fyi .. https://softwarefactory-project.io/r/c/config/+/23057 for zuul user on c911:37
rlandy|ruckhttps://softwarefactory-project.io/r/c/config/+/2306611:38
rlandy|ruckboth merged11:38
mariosrlandy|ruck: nice thanks11:38
rlandy|ruckhttps://review.rdoproject.org/r/c/config/+/3654511:38
rlandy|ruckstill has sagi's -1 on it11:38
rlandy|ruckcorrect?11:39
rlandy|ruckmarios: ^^11:39
rlandy|ruckhttps://review.opendev.org/c/openstack/tripleo-ansible/+/81644511:39
rlandy|ruckand has alex's -111:39
rlandy|ruckso holding there11:39
mariosyeah 11:39
mariosrlandy|ruck: i replied to alex comment lets see11:39
rlandy|ruckmarios: yeah - np11:40
mariosrlandy|ruck: for now we are working around that one with a hack so11:40
rlandy|ruckjust checking on reviews that can merge11:40
mariosack 11:40
frenzy_fridayrlandy|ruck, hey, yep little better today11:46
rlandy|ruckfrenzy_friday: good :)11:47
rlandy|ruckfrenzy_friday: all ok with tripleo health related reviews?11:47
rlandy|ruckanything else need to be followed up on?11:48
rlandy|ruckfrenzy_friday: from monday, let's push on adding more queries11:48
rlandy|ruckso we can use the tools 11:48
rlandy|ruckand test all options11:48
frenzy_fridayrlandy|ruck, not sure about the upstream-jobs-patch Other than that we can add queries11:49
rlandy|ruckfrenzy_friday: from daniel?11:51
rlandy|ruckdviroel|rover: hmmm ... interesting ... downstream cockpit data ... 12:57
rlandy|ruckbaremetal component12:57
rlandy|rucklists the time as 2021-11-05 12:10:0612:57
rlandy|ruckhas a log from 11 -0312:57
rlandy|ruckall the dates are listed as today12:58
rlandy|ruckthose OVB jobs have been failing for two days12:59
rlandy|ruckwe have a mismatch there13:00
dviroel|roverrlandy|ruck: same thing on upstream13:06
dviroel|roverrlandy|ruck: weird, let me check code and give you a feedback13:07
arxcruzmarios: i think this will solve the problem 13:09
arxcruzhttps://opendev.org/openstack/tripleo-ci/src/branch/master/roles/run-test/templates/oooq_common_functions.sh.j2#L1813:09
mariosarxcruz: looking13:09
mariosarxcruz: you mean, instead of passing the dict into emit_releases? work it out before sending? 13:09
mariosarxcruz: ok yeah worth investigating13:10
arxcruzmarios: yes, you can have the release, and this will return release - 113:10
mariosarxcruz: sure, if it is easier to do that than just passing the dict ... i mean just try it/post it and we can discuss on the review13:10
mariosarxcruz: fyi, when you post a review, you can run the job with a testproject depending on your review, and you can check releases.sh there https://6f1c1d48d52c3a505672-6109476be9a7a65d8252c7a651ade8fd.ssl.cf5.rackcdn.com/816319/1/check/tripleo-ci-centos-8-undercloud-upgrade/6afe241/logs/quickstart_files/index.html 13:13
mariosarxcruz: it is the result of emit_releases13:13
mariosarxcruz: so you can sanity check it is doing what you want13:13
arxcruzoh, nice 13:13
mariosarxcruz: also the emit_releases_file.log there 13:14
mariosarxcruz: but the result is the releases.sh13:14
arxcruzyup, i did not knew about it, good to now, noted 13:14
mariosack 13:14
arxcruzs/now/know13:15
rlandy|ruckdviroel|rover: thanks13:26
*** amoralej is now known as amoralej|lunch13:48
dviroel|roverrlandy|ruck: https://code.engineering.redhat.com/gerrit/c/openstack/rrcockpit/+/28840613:58
rlandy|ruckdviroel|rover: looks right to me14:03
rlandy|ruckdviroel|rover: we can have ysandeep|pto or sshnaidm|off look at it on monday and then we'll merge14:03
dviroel|roversure, agree14:04
rlandy|ruckor merge now and try it out :)14:04
rlandy|ruckif you feel like living dangerously14:04
rlandy|ruckeither way - ok by me14:04
dviroel|roverlets wait for more eyes on it, and merge on monday14:08
*** amoralej|lunch is now known as amoralej14:26
rlandy|ruckdviroel|rover: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-train&pipeline=openstack-periodic-integration-stable414:54
rlandy|ruckfs035 on train is looking good14:55
rlandy|ruckgoing to lcose out bug and card14:55
rlandy|ruckclose14:55
dviroel|roverawesome, +114:55
rlandy|ruckputting in patch to add back to criteria14:55
dviroel|roverok14:56
rlandy|ruckarxcruz: marios: dviroel|rover: fyi - merging https://review.rdoproject.org/r/c/rdo-jobs/+/3656215:00
rlandy|ruckrbac jobs will start to show up in master15:00
rlandy|ruckknow that they will fail to start15:00
mariosrlandy|ruck: ack 15:00
arxcruzok15:00
rlandy|ruckmarjed non-voting15:00
rlandy|ruckmarked15:00
dviroel|roverok15:01
* dviroel|rover lunch15:08
jpodivinHi everyone. I have a question regarding two featuresets: 040 and 011. Both of them are using scenario multinode.yml but I can't find it in the tht.15:08
jpodivinI'm wondering if it didn't get removed at some point, or maybe if I'm not looking for it in a wrong place.15:09
rlandy|ruckjpodivin: https://github.com/openstack/tripleo-heat-templates/blob/stable/train/ci/environments/scenario004-multinode-containers.yaml15:18
rlandy|ruckthose fs are old15:18
rlandy|ruckhttps://github.com/openstack/tripleo-heat-templates/blob/stable/train/ci/environments/multinode-containers.yaml15:19
rlandy|rucketc.15:19
rlandy|ruckis what we are using now15:19
jpodivinrlandy|ruck: I see, makes me wonder if there is a space to maybe update those featuresets. I could submit some patches changing them so they use multinode-containers (seems to be the closest equivalent). 15:20
jpodivinactually I have one already.15:20
rlandy|ruckhttps://docs.openstack.org/tripleo-quickstart/latest/feature-configuration.html15:25
rlandy|rucktells you what they used to do15:25
rlandy|ruck^^ you can see what 004 and 011 were meant to do15:26
rlandy|ruckstandalone took over there15:26
rlandy|ruckyou can15:26
rlandy|ruckif you need the same basic functionality15:26
rlandy|ruckhttps://review.opendev.org/c/openstack/tripleo-ci/+/81682115:27
rlandy|ruckmerging the c9 nodeste15:27
rlandy|rucknodeset15:27
rlandy|ruckthanks marios15:27
*** rcastillo|out is now known as rcastillo15:27
mariosrlandy|ruck: ack i rebased my build jobs change onto it too now we have the nodeset (but 3rd party isn't happy, maybe until the nodeset merges?) https://review.opendev.org/c/openstack/tripleo-ci/+/81510815:28
rlandy|ruckhttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3643415:38
rlandy|ruckdviroel|rover: ^^ revert to get fs035 train back 15:38
jpodivinrlandy|ruck: should I mark them as deprecate in the docs then? I'm not asking now because of validations CI specifically (we are going to stick with other fs), I'm asking in regards to oooq. 15:52
jpodivinimho, it would be one less trap for ooo novice. 15:53
rlandy|ruckjpodivin: yeah - we have a task somewhere to update all our docs etc.15:54
rlandy|ruckysandeep|pto started that 15:54
rlandy|ruckyou  know, priorities :)15:54
rlandy|ruckfeel free to put in a review15:54
jpodivinrlandy|ruck: all too well. :) 15:54
jpodivinOk, I'm on it. 15:54
rlandy|ruckysandeep|pto will likely be happy to see that - he will be back on monday to review15:54
*** marios is now known as marios|out16:16
jpodivinrlandy|ruck: done16:22
dviroel|roverrlandy|ruck: looking at code and the dashboards, the 'Time' column is actualy the timestamp which the data was added to influx db, thats why doesn't match with the job itself17:12
rlandy|ruckdviroel|rover: k - on meeting17:12
rlandy|ruckwill look in a bit17:12
dviroel|roverok17:12
*** jpena is now known as jpena|off17:22
rlandy|ruckdviroel|rover: k - out of meeting17:27
rlandy|ruckdviroel|rover: so that explains why that data is today17:27
rlandy|ruckwhat is confusing is why it's still reporting wednesday's results17:27
rlandy|ruckwhen we were looking at two days of failures17:30
dviroel|roverlet me check downstream results again17:34
dviroel|rovermaybe because the hash didn't change, those queries are based in the hash being tested17:36
rlandy|ruckussuri promoting :)17:37
rlandy|rucktestprojecting victoria17:37
dviroel|roverawesome, tks17:37
rlandy|ruckha - 17 looks right17:42
*** amoralej is now known as amoralej|off17:42
rlandy|ruckdviroel|rover: maybe it just is that the hash has not rev'ed17:42
rlandy|ruck17 has today's results17:42
rlandy|ruckie: you see the red line for OVB failures17:43
dviroel|roverthe code gets  all jobs from dlrn api, which includes duplicates, but only provides the latest run to influxdb. So even having multiples runs for the same hash,  is expected to show only the latest one on top.17:45
rlandy|ruckthe latest run was red - but ok17:47
rlandy|rucklet's go with it17:47
rlandy|ruckat leaat now I understand the date17:48
rlandy|ruckleast17:48
dviroel|roveryeah, we can improve this in the future17:49
dviroel|roverand avoid many duplicated items in the db17:50
dviroel|roverit is adding the same info every 30m17:50
rlandy|ruckdviroel|rover: yeah - thanks for looking into it18:02
rlandy|ruckdviroel|rover: need to run out for a bit ... 18:58
rlandy|ruckthink we are ok18:58
rlandy|ruck16.2 should promote shortly all jobs passed there18:58
dviroel|roverrlandy|ruck: ok, np18:58
rlandy|ruck17 just kicked 18:58
rlandy|ruckso downstream is looking better18:58
dviroel|rovergreat news for a friday18:59
rlandy|ruckbiab18:59
dviroel|roverk18:59
*** rlandy|ruck is now known as rlandy|ruck|brb18:59
*** rlandy|ruck|brb is now known as rlandy|ruck19:24
rlandy|ruckoh man - we have tox failures all over21:12
rlandy|ruck2021-11-05 20:44:07.405487 | ubuntu-focal | The conflict is caused by:21:12
rlandy|ruck2021-11-05 20:44:07.405497 | ubuntu-focal |     jsonschema 3.2.0 depends on setuptools21:12
rlandy|ruck2021-11-05 20:44:07.405516 | ubuntu-focal |     The user requested (constraint) setuptools===58.5.221:12
rlandy|ruckdviroel|rover: just fyi21:14
rlandy|ruckreported to infra21:14
rlandy|rucklaunchpad bugging21:15
rlandy|ruckhttps://bugs.launchpad.net/tripleo/+bug/195001621:23
dviroel|roveroh :(21:27
rlandy|ruckdviroel|rover: need to log off now21:27
rlandy|ruckade_lee is also commenting on the bug21:27
rlandy|ruckaltered infra21:27
rlandy|ruckupdate in requirements21:28
rlandy|rucksomebody will fix it :)21:28
dviroel|roverok, me too21:28
rlandy|ruckhave a good weekend21:28
rlandy|ruckand thanks for helping out past your shift21:28
dviroel|roveryou too, see you next monday21:29

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!