Monday, 2022-10-24

*** rlandy is now known as rlandy|out00:26
marioso/ 05:13
*** marios is now known as marios|ruck05:13
*** amoralej|off is now known as amoralej06:17
jpodivinmarios|ruck: Hi. Online already? 06:42
marios|ruck\o06:44
jm1o/06:49
jpodivinmarios|ruck: I hate to start with issues so early in the morning ... but there is something happening with build dependencies during my testproject runs07:10
jpodivinmarios|ruck: for the record, none of the patches tested change anything about the spec file or deps https://logserver.rdoproject.org/91/43591/16/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-baremetal-master/2c290de/logs/undercloud/home/zuul/DLRN/data/repos/component/validation/52/4a/524af4a0f16acfafa6a783d5a9b7dfc8eeb30506_dev/rpmbuild.log.txt.gz07:11
jpodivinbut it appears that libglib-2.0.so.0 doesn't have a viable provider on master ... which is strange because our last promotion is day old. 07:12
jpodivinone would expect this sort of issue to impact it as well.07:12
marios|ruckjpodivin: k did you file a bug yet? I will try and check in a bit07:13
marios|ruckjpodivin: also these logs are from 2107:14
jpodivinmarios|ruck: not yet, I wanted to check with you first if it isn't tracked already. 07:14
marios|ruckjpodivin: friday? maybe get some new ones07:14
jpodivinmarios|ruck: well, all jobs failed with pretty much the same issue.07:14
jpodivinhttps://review.rdoproject.org/r/c/testproject/+/4359107:14
jpodivinso it's not something one off. 07:15
marios|ruckjpodivin: k i haven't come across that yet in upstream/periodics07:16
marios|ruckjpodivin: so it may be validation specific07:16
jpodivinmarios|ruck: I know, prod line is clean. Even ours as I said ^^^ 07:16
marios|ruckjpodivin: also, 'all the same issue' sure but it could have been a transient issue on friday that hit all the jobs. would be worth re-running at least one07:16
jpodivinok, I'm hitting recheck. 07:17
marios|ruckjpodivin: once you file a bug please ping i'll add it to our list and it will go to cix07:17
marios|ruckjpodivin: well, perhaps we can track on the existing one... anyway we'll see07:17
marios|ruckjpodivin: i mean we have cix where we disabled validations is this part of that work? 07:17
jpodivinmarios|ruck: it is, technically, this is the patch I'm using to test my fix for that CIX07:18
jpodivinsince it doesn't do anything with dependencies it's almost certainly something else though07:18
marios|ruckjpodivin: k well we may need a new bug for that then 07:18
jpodivinas you've said, it could be transient. If it isn't then I'll file the bug07:20
jm1marios|ruck: downstream jobs are broken because they use quickstart even though quickstart only handles upstream release names. should we introduce downstream release names into quickstart or better follow rabi's suggestion and use upstream release names in downstream jobs? https://bugzilla.redhat.com/show_bug.cgi?id=2137166#c107:31
marios|ruckjm1: thanks i was digging at this earlier it hits all d/stream lines - mainly i want to understand why it started happening suddenly (like on saturday i believe)07:33
marios|ruckjm1: will update the bz/cix 07:33
marios|ruckah i see it was the version chooser patch?07:34
marios|ruckhttps://review.opendev.org/c/openstack/tripleo-quickstart/+/86158607:35
marios|ruckjm1: yeah i think just adding into https://github.com/openstack/tripleo-quickstart/blob/master/quickstart.sh#L148 is OK 07:36
marios|ruckjm1: don't see how that would affect something else07:36
marios|ruckjm1: are you posting that? Or let me know if you want me to post it 07:38
*** jpena|off is now known as jpena07:39
jm1marios|ruck: i will post a patch, no worry07:40
jm1marios|ruck: just wanted to get your opinion on that :)07:40
marios|ruckjm1: ack ... i think we *could* also consider the other choice but that would take much longer to update all the things... so in the meantime we'd either need to revert or the fix you'll post ina  minute07:40
arxcruzhey, i have dentist appointment this morning07:40
jm1marios|ruck: do we have a rhos component for tripleo ci in bz?08:01
marios|ruckjm1: no rhos is in product - for componet probably choose the generic 'tripleo' component? 08:03
* marios|ruck checks08:03
marios|ruckjm1: yeah we have a 'openstack-tripleo' maybe that one :)08:03
jm1marios|ruck: ack, thank you :)08:04
jpodivinplease add to review list https://review.opendev.org/c/openstack/validations-common/+/86198609:02
reviewbotI have added your review to the Review list09:02
jpodivinplease add to review list https://review.rdoproject.org/r/c/rdo-jobs/+/4477109:04
reviewbotI have added your review to the Review list09:04
marios|ruckjm1: can you check the patch please rhosp-17 -> 17.109:45
jm1marios|ruck: that is covered as well due to the regex .*09:47
marios|ruckjm1: checking agagin 09:47
marios|ruckjm1: k, i mean fair enough but lets make it 16.* and 17.* instaed of 16\.2 and 17.*09:48
jm1marios|ruck: ack will change later. lets wait for testproject to finish to see whether something else has to be changed as well09:50
marios|ruckjm1: k 09:50
jbadiapamarios|ruck: hi 10:05
jbadiapamarios|ruck: I was able to have kind of a standalone-ffu-job the test https://review.opendev.org/c/openstack/tripleo-ci/+/82971310:06
jbadiapamarios|ruck: still failing...10:06
jbadiapamarios|ruck: checking the standalone_upgrade.sh script.... I saw that the command used was "openstack tripleo upgrade"10:07
jbadiapamarios|ruck: was anyone modifying/developing that command? 10:08
marios|ruckjbadiapa: what do you mean about modifying/developing. that one is there https://opendev.org/openstack/python-tripleoclient/src/commit/12e788906c816f129a960aa70b96403c568a2388/setup.cfg#L41 10:19
jbadiapayes, well the last modification was a long time ago...10:21
jbadiapaI think the only place where it is used is the gate.10:21
marios|ruckjbadiapa: to be honest i have not looked at that in a long time . noting your ci review will try and have a closer look on next reveiws 10:23
marios|ruckjbadiapa: ah i see now what you were asking about   ... you mean this file https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/standalone-upgrade/templates/standalone.sh.j210:27
marios|ruckjbadiapa: so no to answer the question we are no longer running that in gates 10:27
marios|ruckwe removed the standalone-upgrade jobs10:27
jbadiapaI know....10:30
jbadiapabut were they doing an upgrade or an update? or it depended on the repos?  10:31
*** rlandy|out is now known as rlandy10:34
rlandymarios|ruck: hi - what can I help with?10:37
marios|ruckrlandy: hey just getting some food, we can do quick call in 20?10:38
marios|ruckrlandy: all stuff i know of is on the hackmd and nothing new for you i think though some updates on them 10:38
rlandymarios|ruck: k - pls ping when ready10:38
marios|ruckrlandy: main action is on d/stream still 10:39
rlandywill try help promote 17  and 17 on 8 if cert is fixed10:39
marios|ruckrlandy: k 20 mins should be good will ping10:39
marios|ruckrlandy: yeah should be clear there now i creatd https://trello.com/c/Bk784PV8 and via irc 'should be fixed' (rhos-ops)10:40
rlandyjm1: marios|ruck (when back): re: https://review.opendev.org/c/openstack/tripleo-quickstart/+/862466 - left comment10:45
rlandyjm1: ^^ can you update per all comments10:45
rlandyso we can fix this10:45
rlandyand promote 1710:45
frenzy_fridayreview time folks!11:18
rlandyfrenzy_friday: sorry - can join review time now if needed11:21
frenzy_fridayrlandy, yep. jpodivin, we are joining again11:22
rlandyk - joining now11:22
jm1rlandy, marios|ruck: testproject has passed, so i updated the patch. please vote to unblock downstream :) https://review.opendev.org/c/openstack/tripleo-quickstart/+/86246611:32
marios|ruckthanks jm1 11:36
rlandyjm1: thank - revoted11:36
marios|ruckjpodivin: we good now (looks like recheck cleared some of those jobs?)11:41
marios|ruckjpodivin: 'are we good now' with https://review.opendev.org/c/openstack/validations-common/+/861986 i mean 11:41
jpodivinmarios|ruck: that would depend ... one more bug has shown up in the logs https://bugs.launchpad.net/tripleo/+bug/199402911:42
jpodivinbut fix for that is already in review11:42
jpodivinalthough that only affects our pipeline in any case.11:43
marios|ruckjpodivin: but .. to be clear that should not block us right since we have disabled all validations11:43
marios|ruckjpodivin: like you are seeing this new issue only in your test11:43
jpodivinobviously yes.11:44
marios|ruckah yeah 14:43 < jpodivin> although that only affects our pipeline in any case.11:44
marios|ruckjpodivin: where is the fix for that one? 11:44
jpodivinmarios|ruck: https://review.opendev.org/c/openstack/validations-common/+/86248111:44
marios|ruckjpodivin: mainly my question is, do we need to block https://review.opendev.org/c/openstack/validations-common/+/861986 for ^^ 11:45
marios|ruckjpodivin: i don't see depends-on11:45
marios|ruckoh same repo 11:45
marios|ruck:/ 11:45
marios|ruckk so rebase? 11:45
marios|ruckor independent merges11:45
jpodivinmarios|ruck: independent I would say11:45
marios|rucklooks like independent11:45
marios|ruckk thx so lets go on the first one i think 11:45
jpodivinIt doesn't block the other one, and it's only relevant for our repo. 11:46
*** dviroel|out is now known as dviroel11:46
marios|ruckjpodivin: this must be the new issue https://logserver.rdoproject.org/91/43591/16/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-component-master-validation/1cac769/job-output.txt 11:47
marios|ruckjpodivin: i.e. in the latest run @ https://review.rdoproject.org/r/c/testproject/+/43591/16#message-d5d1aee03f6ca658231196bcafd67d3408f88b23 11:47
jpodivinyep11:47
jpodivinhttps://bugs.launchpad.net/tripleo/+bug/199402911:47
jpodivinThere ^ is a trace and everything .11:47
jpodivinbasically: while that validation did work on 17 it doesn't seem to work reliably in the pipeline.11:48
jpodivinSo it's easier to disable it in the catalog tests11:48
marios|ruckjpodivin: thanks added workflow for that first patch 11:49
jpodivinthank you11:49
*** amoralej is now known as amoralej|lunch12:00
* jm1 rebooting12:26
rlandyneed to go to complex office - brb12:38
*** rlandy is now known as rlandy|brb12:38
*** amoralej|lunch is now known as amoralej12:51
*** rlandy|brb is now known as rlandy12:51
rlandymarios: master and train rerun - https://review.rdoproject.org/r/c/testproject/+/45359 (just two jobs failing in each)12:58
jm1marios|ruck, rlandy: who could we ask for merging this quickstart patch? chandan and rabi are out this week :/ https://review.opendev.org/c/openstack/tripleo-quickstart/+/86246612:58
rlandyjm1: marios, dviroel and I all have w+ there12:59
rlandywe will w+ once zuul votes12:59
jm1rlandy: ah ok, great :D12:59
marios|ruckrlandy: k thanks13:00
marios|ruckjm1: yeah we are waiting for zuul to report13:01
rlandyarxcruz: dviroel: frenzy_friday: jm1: marios|ruck: rcastillo_: dasm|off: scrum in 2 mins13:28
rlandyall india is out13:28
rlandyso will be quick13:28
*** dasm|off is now known as dasm13:28
*** dasm is now known as dasm|rover13:28
dasm|rovero/13:28
rlandyarxcruz: dviroel: frenzy_friday: jm1: marios|ruck: rcastillo_: dasm|rover: will demo a new cool zuul management tool13:29
frenzy_friday++ !13:30
*** rcastillo_ is now known as rcastillo13:30
rlandydviroel: hi scrum time13:31
jm1gthiemonge: hello :) who could we ping for https://review.opendev.org/c/openstack/octavia/+/862230 and the other backport?13:35
gthiemongejm1: hi, I'm pinging the other Octavia cores13:36
dasm|rovermarios|ruck: thanks for commenting on https://bugs.launchpad.net/tripleo/+bug/1993730 wrt ovb image issues13:47
dasm|roverrlandy: fyi, when you were gone on Friday, I updated your patch for RR Alternative Criteria. It's working for this one place, which you changed.13:48
dasm|roverrlandy: i had to change one more function to provide "alt_criteria" for consumption in render_table13:49
marios|ruckdasm|rover: ack i updated all the things in cix blocked & will join that call 13:55
marios|ruckdasm|rover: i will try and join prod chain call after so ... maybe we can sync after this scrum? 13:55
marios|ruckdepending on how much time we have left before cix call 13:55
dasm|rovermarios|ruck: ok13:56
dasm|roverrlandy++ nice thing14:02
rlandydasm|rover: thanks - will check14:03
jm1gthiemonge: thank you :)14:11
rlandy2022-10-24 14:09:12,916 1290601 INFO     promoter Summary: Promoted 1 hashes this round14:22
rlandycurrent-tripleo/2022-10-24 10:17 14:22
rlandy17.1 on 8 promoter14:22
rlandypromoted14:23
rlandydasm|rover: marios|ruck: ^^ one more down14:23
marios|rucknice thanks rlandy 14:23
dasm|roversweet14:25
rlandydasm|rover: thanks for your updates on my patch15:13
rlandythink we are still missing a piece 15:13
rlandywill ping this afternoon with update15:13
dasm|roverrlandy: sure. 15:14
rlandydasm|rover: could have multiple alt criteria15:15
*** dviroel is now known as dviroel|lunch15:21
rlandyjm1: marios|ruck: dasm|rover: w+ing https://review.opendev.org/c/openstack/tripleo-quickstart/+/86246615:33
rlandyzuul voted15:33
marios|ruckrlandy: thnks15:35
dasm|rovernice15:43
rlandymaster should promo15:46
dasm|rover++15:47
marios|rucko/ rlandy dasm|rover 15:48
rlandymarios|ruck: have a good night15:48
dasm|rovermarios|ruck: take care, have a good one o/15:48
marios|ruckthanks hope you have a good day15:48
*** marios|ruck is now known as marios|out15:49
rlandydasm|rover, have time to talk about https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45783?16:00
dasm|roveryes16:02
dasm|roverrlandy: yes16:02
rlandydasm|rover: https://meet.google.com/hxb-hfxw-djk?pli=1&authuser=016:03
*** dviroel|lunch is now known as dviroel16:19
*** amoralej is now known as amoralej|off16:23
rlandydasm|rover: ok - I think I get it16:31
rlandyif there are two passing jobs, they wil both be added16:31
rlandychecking why limnters test fail16:31
dasm|roverrlandy: linter fails due to your change being implementnd just in one place, and not 3 others16:34
dasm|roverthat should be similar to the other16:35
rlandydasm|rover: can you log a bug for https://logserver.rdoproject.org/93/855493/3/openstack-check/tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035/3bb8893/logs/undercloud/var/log/tempest/stestr_results.html.gz16:42
rlandyfailing all fs035 check tests16:42
rlandypls add the list of failing16:42
rlandytempest.lib.exceptions.UnexpectedContentType: Unexpected content type provided16:42
rlandyDetails: 50016:42
rlandypls investigate the fix here16:43
arxcruzreviewbot please add https://review.opendev.org/c/openstack/tripleo-quickstart/+/855493 to review list 16:43
reviewbotI have added your review to the Review list16:43
rlandydasm|rover: https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035&skip=016:43
dasm|roverack16:44
rlandydasm|rover: ^^ killing all fs035 check - probably missing a var somewhere16:44
dasm|roverrlandy: isn't that the one that I fixed in the past? Which is/was missing rpms?16:52
* dasm|rover checking16:52
dasm|roverrlandy: https://trello.com/c/IryyjbGs/2344-cixlp1960355tripleociproa-tempest-tests-testoauth1tokensoauth1tokenstest-are-failing-on-tripleo-ci-centos-9-ovb-3ctlr1comp-featu16:52
dasm|roverrlandy: the one which is in Quality Degraded. 16:52
rlandydasm|rover: is that test in the skip list still?16:53
arxcruzrlandy https://trello.com/c/3p8i2YdZ/2639-cixlp1982874tripleociproa-testcreateobjectwithtransferencoding-is-failing-on-tripleo-jobs16:53
dasm|roveri maen: waitin on external16:53
rlandyif so - do we need to add check?16:53
dasm|roverrlandy: lemme check why tests are failing16:53
dasm|roverand if we have this skiplist16:53
frenzy_fridayrlandy, i think this is why we were not getting data after merging the victoria removal patch - https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45423/3/ci-scripts/infra-setup/roles/rrcockpit/files/grafana/upstream-and-rdo-promotions.dashboard.json#641  But it is grafana that keeps on changing this datasource to influxdb even if I set it back to telegraf. I will take a look again tomorrow16:54
dasm|roverhttps://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/validate-tempest/vars/tempest_skip.yml#L102116:56
dasm|roverarxcruz: if we're having failing job for tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035 can I add it here? https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/validate-tempest/vars/tempest_skip.yml#L102116:58
dasm|roverarxcruz: is it gonna work for check similar to periodic?16:58
arxcruzdasm|rover checking 16:59
dasm|roverarxcruz: failing tempest: https://logserver.rdoproject.org/93/855493/3/openstack-check/tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035/3bb8893/logs/undercloud/var/log/tempest/stestr_results.html.gz for the job: https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset03516:59
dasm|roverhttps://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/862509 cc arxcruz rlandy 17:02
arxcruzdasm|rover sec, i'm with rlandy on 1-1 17:03
dasm|roverk17:03
dasm|roverok, i see something similar in the code: https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/validate-tempest/vars/tempest_skip.yml#L94017:11
dasm|roverfor check job.17:11
arxcruzdasm|rover yes, you can add the job in the jobs list and it will be skipped 17:15
rlandydasm|rover: thanks17:15
rlandydasm|rover: merging17:15
rlandyfrenzy_friday: thanks for following that up17:16
rlandydasm|rover: few jobs failing in gate now17:22
rlandycan you check if it's a hitch or real issue?17:22
dasm|roversure, checking17:22
rlandydasm|rover: donwstream all promoted expect fs001 on 17 - rerun in progress now17:22
rlandylunch - brb17:22
dasm|rovernice, thx17:23
dasm|rover> ERROR: No matching distribution found for tomli>=2.0.1; python_version >= "3.7" and python_version < "3.11" (from tox)17:38
dasm|roveropenstack-tox-py3817:38
dasm|rover> ERROR: Cannot install openstackdocstheme>=2.2.1 because these package versions have conflicting dependencies.17:39
dasm|roveropenstack-tox-docs17:39
dasm|roverchecking if that's the case for all jobs17:39
dasm|roveropenstack-tox-py38 seems to be transient. Locally I was able to install tox on py3.817:45
dasm|roverchecking openstack-tox-docs17:45
dasm|roverno issues as well.17:46
dasm|roverseems like some hiccup. i'll recheck when it's gonna fail17:48
dasm|rovercs9 master: > last_promotion=2022-10-24 15:56:3917:51
dasm|rovercs9 wallaby: > last_promotion=2022-10-24 12:47:2617:52
dasm|rovercs8 train: > last_promotion=2022-10-24 16:34:5017:58
rlandydasm|rover: thanks for checking - going to have to recheck jm1'a patch18:01
dasm|roverrlandy: this https://code.engineering.redhat.com/gerrit/c/openstack/rrcockpit/+/432104 got merged but this is not updated: https://sf.hosted.upshift.rdu2.redhat.com/images/conf_ruck_rover.yaml18:03
dasm|roverrlandy: do we need to reload something? should it automagically be pulled in for downstream cockpit?18:03
rlandyon call with phil18:06
rlandydasm|rover: ^^18:06
dasm|roverk18:13
dasm|roverrhel9 osp17.1: > last_promotion=2022-10-21 19:01:4318:23
*** dviroel is now known as dviroel|biab18:56
rlandydasm|rover: need help with anything?19:01
rlandyhave another meeting in a 1519:02
dasm|rover18:03 <dasm|rover> rlandy: this https://code.engineering.redhat.com/gerrit/c/openstack/rrcockpit/+/432104 got merged but this is not updated: https://sf.hosted.upshift.rdu2.redhat.com/images/conf_ruck_rover.yaml19:02
dasm|rover18:03 <dasm|rover> rlandy: do we need to reload something? should it automagically be pulled in for downstream cockpit?19:03
dasm|rovernot sure if you know the answer, rlandy 19:03
dasm|roverif not, i need to do some digging19:03
* rlandy looks19:03
dasm|roverrlandy: overall, promotions are in good shape, except cs8 wallaby due to ovb issue19:03
dasm|roverchecking CIX board19:03
rlandydasm|rover: need to restart?19:03
dasm|roveratm19:03
dasm|roverrlandy: i tried ssh-ing to sf. address, but it denied me access19:04
dasm|roverlemme try again19:04
* rlandy checks 19:04
dasm|rovernope. neither my username nor nickname work19:04
rlandyhttps://code.engineering.redhat.com/gerrit/gitweb?p=tripleo-environments.git;a=summary19:05
rlandyhttps://code.engineering.redhat.com/gerrit/gitweb?p=openstack/rrcockpit.git;a=blob;f=files/telegraf_py3/conf_ruck_rover_internal.yaml;h=ec702c6328bb796d7ad6eefc537e612e5b3b37ba;hb=HEAD19:06
rlandydasm|rover: ^^ update is there19:06
dasm|roverrlandy: didn't i do that here? https://code.engineering.redhat.com/gerrit/c/openstack/rrcockpit/+/43210419:07
rlandyyep - you did19:07
dasm|roveryeah, i did: https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/rrcockpit.git;a=commit;h=5a247d0a32b9f238a603d3dc1199071ea12a2d8e19:07
rlandythat is the repo it gets merged into19:07
dasm|roverso, we're probably missing some restart/reboot/whatever19:08
rlandydasm|rover: I would guess https://sf.hosted.upshift.rdu2.redhat.com/images/ is amanual upload19:08
rlandydviroel|biab: ^^ you change this file before19:08
rlandydasm|rover: so now it's merged, I think you may need to manually update the images linke19:09
rlandylink19:09
rlandyI can access images server if you need me to do the update19:09
rlandydasm|rover: ^^19:09
dasm|roverrlandy: i can't ssh to this instance, my ssh key is denied19:09
dasm|roverplease go ahead19:09
*** dviroel|biab is now known as dviroel19:40
dviroelrlandy: which file?19:41
dviroeldownstream cockpit config?19:41
dviroels/cockpit/ruckrover condif19:42
dasm|roverdviroel: i asked about conf_ruck_rover.yml file at @sf.hosted but I made it work now.19:43
dasm|roverdviroel: i sshed (rlandy provided creds) and replaced it19:43
dasm|roverdviroel: https://sf.hosted.upshift.rdu2.redhat.com/images/conf_ruck_rover.yaml19:43
dviroeldasm|rover: ah, ok :)19:49
dasm|roverdviroel: yeah, sorry. I didn't ping you earlier it's been worked and fixed by now19:51
rlandysorry - meetings20:15
rlandydviroel: ack - as dasm|rover said  - fixed now20:16
dasm|roverhmm... we might be having some transient issues20:52
dasm|roverhttps://review.opendev.org/c/openstack/tripleo-heat-templates/+/853733/20:53
dasm|roverrechecking one more time20:53
rlandycurrent-tripleo/2022-10-24 16:18 17 promoted21:05
dasm|roverneat21:06
rlandydasm|rover: ^^ so that should be everything promoted minus c8 - which marios and I will decide on in the morning21:26
rlandydasm|rover: need to step away in a few - have shift at my volunteer jobs21:27
rlandypls watch jm1's patch through the gate 21:27
rlandydasm|rover: ^^ thanks - and thanks for the help with the rr patch21:27
dasm|roverrlandy: ack. have a good night. 21:28
dasm|roverjm1's patch failed. i rechecked it21:28
dasm|roverrlandy: wrt cs8 wallaby, Steve answered with another idea, but it's gonna be blocked for about a week21:29
*** rlandy is now known as rlandy|out21:42
* dasm|rover => offline22:13
*** dasm|rover is now known as dasm22:13
*** dasm is now known as dasm|off22:14
*** dviroel is now known as dviroel|out23:00

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!