Monday, 2020-11-16

*** jmasud has joined #oooq00:14
*** jmasud has quit IRC00:27
*** jmasud has joined #oooq00:28
*** Goneri has quit IRC00:48
*** jmasud has quit IRC02:00
*** skramaja has joined #oooq03:43
*** jmasud has joined #oooq04:42
*** marios has joined #oooq06:31
*** jfrancoa has joined #oooq06:32
*** ksambor has joined #oooq06:51
*** ksambor has quit IRC06:56
marios /nick marios|ruck07:13
*** marios is now known as marios|ruck07:14
*** amoralej|off is now known as amoralej07:23
*** jbadiapa has joined #oooq07:25
*** sshnaidm|off is now known as sshnaidm07:46
*** apetrich has joined #oooq08:02
*** ksambor has joined #oooq08:14
*** frenzy_friday has joined #oooq08:29
*** tosky has joined #oooq08:49
*** jpena|off is now known as jpena08:55
*** jmasud has quit IRC08:58
*** holser has joined #oooq09:06
*** holser has quit IRC09:13
*** holser has joined #oooq09:33
*** ksambor has quit IRC09:54
*** dtantsur|afk is now known as dtantsur10:30
*** rfolco has joined #oooq12:19
*** jpena is now known as jpena|lunch12:31
*** rlandy has joined #oooq12:33
*** rlandy is now known as rlandy|rover12:33
rlandy|rovermarios|ruck: hey ... how goes it today?12:33
rlandy|roverwant to sync before scrum?12:34
marios|ruckrlandy|rover: sure but gimme few mins finishing sthing12:34
rlandy|roversure12:35
marios|ruckrlandy|rover: check hackmd i updated with all the current things12:35
* rlandy|rover checks back12:36
marios|ruckrlandy|rover: o/12:47
marios|ruckrlandy|rover: k whenever you're ready12:47
marios|ruckrlandy|rover: joining scrum line12:47
rlandy|rovermarios|ruck: ack12:47
rlandy|roverjoined12:48
marios|ruckrlandy|rover: https://review.opendev.org/#/c/762829/12:56
marios|ruckhttps://review.opendev.org/#/c/762812/12:58
rfolcoarxcruz, rfolco, zbr, sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, pojadhav, akahat, weshay, chandankumar13:02
rfolcoscrum time13:02
*** amoralej is now known as amoralej|lunch13:17
marios|ruckrfolco: dropped for cix call in few mins thanks13:19
marios|ruckrfolco: let me know if need sthing13:19
rfolcomarios|ruck, ack thx13:21
*** weshay|ruck has joined #oooq13:22
weshay|ruck0/13:22
weshay|rucksorry.. chat.freenode gave me the boot13:22
*** Goneri has joined #oooq13:27
*** jpena|lunch is now known as jpena13:29
weshay|ruckmarios|ruck, rlandy|rover we getting a skiplist entry for13:31
weshay|ruckTest Group/Test caseCountPassFailErrorSkipView13:31
weshay|ruckbarbican_tempest_plugin.tests.scenario.test_volume_encryption.VolumeEncryptionTest13:31
weshay|ruckhttps://bugs.launchpad.net/tripleo/+bug/190422313:31
openstackLaunchpad bug 1904223 in tripleo "centos-8-scenario002-standalone failing tempest - SSH timed out" [Critical,Triaged]13:31
rlandy|roverweshay|ruck: we're on CIX atm - will look in a few13:32
rfolcosshnaidm, marios|ruck rlandy|rover arxcruz zbr: this is the first patch for improving tcib reports, please review https://review.opendev.org/#/c/75512413:38
rfolcoweshay|ruck, ^13:39
marios|ruck rlandy|rover: i will file a new bug for https://bugs.launchpad.net/tripleo/+bug/190421413:54
openstackLaunchpad bug 1904214 in tripleo "centos-7 train jobs are failing on dependency resolution: glibc-common = 2.17-307.el7.1 and python3-libs(x86-64) = 3.6.8-13.el7" [Critical,Triaged]13:54
rlandy|rovermarios|ruck: ack - thanks13:54
rlandy|roverzbr: https://review.opendev.org/#/c/762812/13:58
weshay|ruckrlandy|rover, want to chat w/ Attila in 5?14:03
*** amoralej|lunch is now known as amoralej14:08
weshay|ruckrlandy|rover, https://meet.google.com/pfd-yyqj-xbi?authuser=114:08
*** TrevorV has joined #oooq14:31
marios|ruckweshay|ruck: rlandy|rover: https://bugs.launchpad.net/tripleo/+bug/1904418 & https://bugs.launchpad.net/tripleo/+bug/1904214/comments/514:35
openstackLaunchpad bug 1904418 in tripleo "buildimage centos7 jobs are failing to fetch mirror info 404" [Critical,Triaged]14:35
openstackLaunchpad bug 1904214 in tripleo "centos-7 train jobs are failing on dependency resolution: glibc-common = 2.17-307.el7.1 and python3-libs(x86-64) = 3.6.8-13.el7" [Critical,Fix released]14:35
weshay|ruckmarios|ruck, thank you!!14:35
marios|ruckweshay|ruck: rlandy|rover: btw, it's literally 2 patches that are blocked fwiw14:36
marios|ruckhttps://zuul.openstack.org/builds?job_name=tripleo-buildimage-overcloud-full-centos-7&job_name=tripleo-buildimage-overcloud-hardened-full-centos-714:36
marios|ruckhttps://review.opendev.org/761892 https://review.opendev.org/75851014:36
marios|ruckdoesn't make it OK, just framing it14:36
marios|ruckweshay|ruck: rlandy|rover: ^^14:36
marios|ruckweshay|ruck: unless, as you said, it is *all* the jobs not just those14:37
marios|ruckrlandy|rover: if you have some time today can you try digging at that one a bit https://bugs.launchpad.net/tripleo/+bug/190422314:41
openstackLaunchpad bug 1904223 in tripleo "centos-8-scenario002-standalone failing tempest - SSH timed out" [Critical,Triaged]14:41
rlandy|rovermarios|ruck: ack - will take that14:41
marios|ruckrlandy|rover: thanks not sure who we need to harrass about it it needs some digging in logs to find more errors14:41
rlandy|rovermarios|ruck: np - will look into it after I get off the 16.2 call14:43
*** skramaja has quit IRC14:54
rlandy|rovermarios|ruck: sorry - off call - looking15:03
rlandy|rovermarios: promotion-blocker on https://bugs.launchpad.net/tripleo/+bug/1904418?15:04
openstackLaunchpad bug 1904418 in tripleo "buildimage centos7 jobs are failing to fetch mirror info 404" [Critical,Triaged]15:04
marios|ruckrlandy|rover: sure15:16
weshay|ruckmarios|ruck, rlandy|rover who has the skiptest work for https://bugs.launchpad.net/tripleo/+bug/190422315:28
openstackLaunchpad bug 1904223 in tripleo "centos-8-scenario002-standalone failing tempest - SSH timed out" [Critical,Triaged]15:28
weshay|rucksounds like rlandy|rover15:28
weshay|ruckrlandy|rover, get the skip in, then debug15:28
marios|ruckweshay|ruck: yeah i did not dig there yet and rlandy|rover was going to15:28
rlandy|roverweshay|ruck: ack - I am on it15:30
weshay|ruckthanks15:30
rlandy|roverwas reading through - will get the skip in15:31
weshay|ruckmarios|ruck, email sent to opendev-discuss15:31
marios|ruckthank you weshay|ruck15:33
rlandy|roverweshay|ruck: arxcruz: to clarify, I add the test to https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/validate-tempest/vars/tempest_skip.yml not the master or the train list?15:37
arxcruzrlandy|rover: you add the test and the release15:38
arxcruzif the test already exists, just add the release15:38
weshay|ruckarxcruz, see how it's confusing?15:39
arxcruz:S15:39
rlandy|roverarxcruz: pls check this for me: https://review.opendev.org/76286515:44
rlandy|roverweshay|ruck: who usually gets out barbican request for help? or just leave it for CIX now?15:54
rlandy|roverweshay|ruck: 16.2 is also looking good for promotion on our side - we may want to add that to this afternoon's list15:56
rlandy|roverweshay|ruck: marios|ruck: can we restart the promoter ... centos08 train promotion died http://promoter.rdoproject.org/logs/centos8_train.log16:01
weshay|ruckrlandy|rover, sure16:01
weshay|ruckdoing so now16:01
rlandy|roverweshay|ruck++ thanks16:02
marios|ruckrlandy|rover: ugh... thanks weshay|ruck16:03
weshay|ruckrlandy|rover, that's VERY GREEN16:03
rlandy|roverI know - seems suspicious16:08
rlandy|rovermarios|ruck: https://review.opendev.org/#/c/762547/ - re comment and -1 - are you on that or should I add the proposed change?16:13
marios|ruckrlandy|rover: checking16:14
marios|ruckrlandy|rover: i thought jfrancoa was going to but yeah I can post that... unless you want to go ahead16:14
rlandy|rovermarios|ruck: I'll do it for your review16:14
marios|ruckrlandy|rover: ok thanks16:14
weshay|ruckrlandy|rover, c8-train.. in container-push16:15
rlandy|roverthanks16:15
rlandy|rovermarios|ruck: also rebased https://review.opendev.org/#/c/762674/ - can we merge that if it passes testing?16:15
marios|ruckrlandy|rover: yeah but i would have liked the upgrades folks to approve/vote on that too ping odyssey4me holser jfrancoa please check https://review.opendev.org/#/c/762674/ when you have some time info on commit message & bug16:16
marios|ruckrlandy|rover: on that patch look at the time tripleo-ci-centos-8-containers-multinode-ussuri SUCCESS in 2h 06m 16s16:16
holsermarios|ruck you have my +116:17
rlandy|rovernice16:17
marios|ruckrlandy|rover: oh sorry16:17
marios|ruckrlandy|rover: wrong job :/16:17
marios|ruckrlandy|rover: standalone-upgrade-ussuri isn't running there cos it isn't "branchful" job (despite the name upgrades are special case) so it needs to be tested with ussuri branch16:18
marios|ruckthanks holser16:18
marios|ruckrlandy|rover: no i think there might be a problem16:19
marios|ruckrlandy|rover: we can't have when there... i have to rework it16:19
rlandy|rovermarios|ruck: ack -ok16:20
marios|ruckrlandy|rover: commented on the patch thanks16:20
marios|ruckrlandy|rover: updating it now16:22
rlandy|rovermarios|ruck: pls review https://review.opendev.org/762871 Update fs037 to containers-default-parameters after stein16:25
rlandy|roveriiuc only fs037 needs this update16:26
rlandy|roverthe other fs files should be fine as they are16:26
rlandy|roverhttps://github.com/openstack/tripleo-quickstart/commit/28c92c2e6dc35c2b09b66cd61bef8f46d096e2b5#diff-0f7ed3e99690b3fa545435a82d60a1699eb5272fd6cf071a2f255356f8b0b471 changes 4 fs files16:26
weshay|ruckrlandy|rover, marios|ruck infra folks are discussing the c7 mirror in openstack-infra.. so that's good news16:28
weshay|ruckzbr, thanks16:28
rlandy|roverzbr++16:29
marios|ruckthank you zbr16:29
*** jmasud has joined #oooq16:31
rlandy|roveroh I see - moved the when16:32
rlandy|rovermarios|ruck: ^^ ok - will vote behind zuul on this one16:33
marios|ruckrlandy|rover: checked the patch it is what jfrancoa suggests please jose sanity check that for us when you have time? https://review.opendev.org/#/c/762871/216:34
rlandy|rovermarios|ruck: thanks16:35
marios|ruckthank you rlandy|rover (you are pointing to tripleo i guess but answering in ooq, but its ok I understand what you meant)16:35
jfrancoamarios|ruck: sure, I was in meetings marathon :-D16:35
jfrancoamarios|ruck: I'll have a look16:35
marios|ruckthanks jfrancoa16:35
rlandy|roverjfrancoa: thanks - was unsure if the change was requires in all four feature sets or just fs03716:35
rlandy|rovermarios|ruck: yeah - sorry - channel switching16:36
rlandy|roversometimes it's worse - I answer internal questions in public and the reverse16:36
marios|ruckrlandy|rover: ack :)16:36
zbrwell, not really sorted. lots of confusions around16:41
zbrthe fix we put in place now may be shaky, at least this is what clark said. as it was like this ~2.8 years ago16:42
*** jmasud has quit IRC16:44
marios|ruckrlandy|rover: getting out of here ... need sthing?16:52
weshay|ruckwelll... this is an issue https://review.opendev.org/#/c/762658/16:55
* weshay|ruck notes.. undercloud-upgrade-victoria in gate, but not check16:55
weshay|ruckand standalone-upgrade16:56
rlandy|rovermarios|ruck: no ...16:57
rlandy|roverwill follow on the hackmd16:57
weshay|ruckhttps://bugs.launchpad.net/tripleo/+bug/190443517:00
openstackLaunchpad bug 1904435 in tripleo "upgrades jobs misconfigured in check / gate victoria " [High,Triaged]17:00
rlandy|roverweshay|ruck: marios|ruck is EID - I'll look at ^^17:03
rlandy|roverEOD17:03
*** amoralej is now known as amoralej|off17:03
marios|ruckthanks rlandy|rover o/17:04
*** marios|ruck is now known as marios|out17:04
weshay|ruckfrenzy_friday, you making progress or stuck?17:06
weshay|ruckmarios|out, <fungi> jpena: weshay|ruck: zbr: the mirror change has landed, it should hopefully be in place by the time the next rsync is attempted at 18:43 utc. you'll be able to see the logs at https://static.opendev.org/mirror/logs/rsync-mirrors/centos.log17:11
weshay|ruckfyi17:11
jpenanice, thanks17:11
jpenaI'll keep an eye on the logs17:11
weshay|ruckjpena++17:11
rlandy|rovermarios|out: weshay|ruck: wrt https://bugs.launchpad.net/tripleo/+bug/1904435 ... ut's because we have job definitions in check and not in gate ...17:16
openstackLaunchpad bug 1904435 in tripleo "upgrades jobs misconfigured in check / gate victoria " [High,Triaged]17:16
rlandy|roverhttps://github.com/openstack/tripleo-common/blob/stable/victoria/zuul.d/layout.yaml17:16
rlandy|roverso gate takes the template17:16
rlandy|roverone way around is to use template only17:16
weshay|ruckusing templates++17:16
rlandy|roverweshay|ruck: k - putting in patch17:17
frenzy_fridayweshay|ruck, yep making progress. I am moving to devstack installation on local to sort out the connectivity problem17:22
weshay|ruckfrenzy_friday, hrm k.. I'll poke at my own install17:26
weshay|ruckfrenzy_friday, see if I can help17:26
weshay|ruckI had a service that may fix this17:26
weshay|ruckrlandy|rover, lots of stuff but you folks have it all covered :) https://hackmd.io/R0kCgz_7SHSix_cNgoC9pg17:34
* weshay|ruck updated17:34
rlandy|roverweshay|ruck: ack - although I am having second thoughts about this templates review17:35
rlandy|roverif we remove all the triggering, we may have lost covergae17:35
rlandy|rovercoverage17:35
rlandy|roverunless we add ALL the file patterns to the templates17:35
rlandy|roverwhich becomes unmanageable17:35
rlandy|roverlunch - will check in afterwards17:36
weshay|ruckfrenzy_friday, this is where standalone may be better... because it one less layer of indirection17:43
weshay|ruckwould be the same as devstack17:43
weshay|ruckrlandy|rover, c8-train promoted17:45
rlandy|roveryay17:46
*** jmasud has joined #oooq17:47
weshay|ruckzbr, any idea how to handle https://opendev.org/openstack/ansible-role-collect-logs/src/branch/master/library/flatten_nested_dict.py#L117:49
weshay|ruckzbr, and Alfreado's comment here https://review.rdoproject.org/r/#/c/30911/17:49
weshay|ruckthis need to work on both python2 and python3 env17:50
*** marios|out has quit IRC17:56
*** jpena is now known as jpena|off18:10
*** amoralej|off is now known as amoralej18:24
rlandy|roverweshay|ruck: working on the zuul job up load the trigger file for attila18:25
weshay|ruckk18:25
rlandy|roverwill have  a review in a bit18:25
*** amoralej is now known as amoralej|off18:32
*** bogdando has quit IRC18:34
rlandy|roverweshay|ruck: rechecking https://review.opendev.org/#/c/761892/ to see if we have c7 working18:48
rlandy|roverweshay|ruck: https://code.engineering.redhat.com/gerrit/#/q/topic:trigger-job+(status:open+OR+status:merged)19:56
rlandy|roverpls ping when you have time to chta about ^^19:56
rlandy|roverchat19:56
weshay|ruckrlandy|rover, k.. 2 min19:57
weshay|ruckrlandy|rover, https://meet.google.com/ffv-dpia-dpx?authuser=119:58
rlandy|roverchat: ugh - sorry - call - will ping in a few19:59
*** dtantsur is now known as dtantsur|afk20:02
weshay|ruckrlandy|rover, http://mirror.centos.org/centos/7/20:26
weshay|ruckrlandy|rover, tripleo-image-elements20:30
weshay|ruckand tripleos20:30
weshay|ruckrlandy|rover, I don't see it in either20:33
* weshay|ruck wonders if it's in the nodepool image20:34
rlandy|roversorry was just helping nicholas20:40
rlandy|roversec - let me just update the downstream review20:44
*** TrevorV has quit IRC20:47
rlandy|roverweshay|ruck: periodic-tripleo-rhel-8-upload-job-trigger-16.2, right?20:57
weshay|ruckrlandy|rover, rhos20:59
weshay|ruckat the end21:00
weshay|ruckrlandy|rover, match the current jobs21:00
rlandy|roverok21:00
rlandy|roverweshay|ruck: updated https://code.engineering.redhat.com/gerrit/#/c/218111/21:01
rlandy|roverweshay|ruck: not sure where this rt came from - looking21:06
rlandy|roverin the mean time, can we retrigger queens, rocky, stein pipelines?21:06
weshay|ruckrlandy|rover, well.. let's clean the release files21:08
weshay|ruckand ya.. I can trigger those21:08
rlandy|roverweshay|ruck: ack ... will do21:08
rlandy|roverstill tracking the image build stuff21:09
rlandy|roverok - back to cleaning release files21:17
weshay|ruckk.. still on w/ Evilien21:18
weshay|ruckrlandy|rover, I'll kick queens first and work backwards21:20
rlandy|roverok21:21
weshay|ruckkicked21:21
rlandy|roverthanks21:31
rlandy|roverweshay|ruck: ok - in the cents-8 release files, there is no rt21:36
weshay|ruckya.. just c7 has rt21:36
weshay|ruckbuilt into c821:36
rlandy|roverso it's juts the 7 files to deal with21:36
weshay|ruckya21:36
rlandy|roverreview coming up21:36
weshay|ruckthanks21:36
rlandy|roverweshay|ruck: worth it to depends on for https://review.opendev.org/#/c/761892/?21:55
rlandy|roverwe will have lost the votes21:55
rlandy|roverbut it may pass w/o rt in repos21:55
* rlandy|rover tries test patch21:55
weshay|ruckrlandy|rover, we can do that21:59
weshay|ruckit's fine.. the history of +2 is there21:59
rlandy|roverok21:59
weshay|ruckadding a deps-on does not change the patch itself.. known to unblock21:59
weshay|ruckadd a note in the commit message21:59
rlandy|roverok21:59
weshay|ruckrlandy|rover, I don't think it's going to fix the image builds21:59
rlandy|roverwe will find out22:01
*** jmasud has joined #oooq22:11
rlandy|roverweshay|ruck: going to dentist ... back later22:28
weshay|ruckrlandy|rover, good luck22:28
*** rlandy|rover is now known as rlandy|rover|bbl22:28
rlandy|rover|bblI need it - first time since corona hit22:29
*** jmasud has quit IRC22:30
*** jbadiapa has quit IRC22:38
*** jmasud has joined #oooq22:45
*** jmasud has quit IRC22:48
*** tosky_ has joined #oooq22:52
*** tosky is now known as Guest4141922:55
*** tosky_ is now known as tosky22:55
*** Guest41419 has quit IRC22:55
*** jmasud has joined #oooq23:08
*** jmasud has quit IRC23:14
*** jmasud has joined #oooq23:31
*** jmasud has quit IRC23:58

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!