Tuesday, 2020-01-28

*** rlandy is now known as rlandy|afk00:24
*** ysandeep has quit IRC01:51
*** dsneddon has quit IRC03:28
*** jmasud has joined #oooq03:35
*** jmasud has quit IRC03:50
*** jmasud has joined #oooq03:54
*** skramaja has joined #oooq04:02
*** rlandy|afk has quit IRC04:48
*** ykarel|away is now known as ykarel04:49
*** udesale has joined #oooq05:25
*** raukadah is now known as chkumar|rover05:34
*** jfrancoa has joined #oooq05:39
*** marios has joined #oooq06:08
*** ratailor has joined #oooq06:16
*** jtomasek has joined #oooq06:35
*** saneax has joined #oooq06:47
sshnaidm|afkzbr, hi06:48
*** sshnaidm|afk is now known as sshnaidm06:48
sshnaidmzbr, thanks for linting fix in https://review.opendev.org/#/c/704279/ but that should be in separate patch06:48
chkumar|rovermarios, Good morning06:57
chkumar|rovermarios, did something got changed on manifest side06:57
chkumar|rovermarios, in some of the periodic jobs  http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-singlenode-featureset050-upgrades-master/0166626/logs/undercloud/home/zuul/undercloud_install.log we are seeing image not found during standalone deploy06:57
chkumar|roveron using skopeo it gives manifest unknown06:58
chkumar|roverplease have a look when free, thanks!06:58
chkumar|roversshnaidm, zbr it is good to go https://review.opendev.org/#/c/680573/06:59
chkumar|roverzbr, https://review.rdoproject.org/zuul/config-errors07:02
chkumar|rovercollect-logs repo access issue07:02
marioschkumar|rover: o/07:03
marioschkumar|rover: not aware of any changes yesterday07:03
chkumar|rovermarios, ok, re-runned these jobs in testproject07:03
sshnaidmchkumar|rover, https://review.opendev.org/#/c/704345/ is good to go07:04
marioschkumar|rover: we are still pushing manifest with _manifest until we merge that (or similar) but it didn't merge yet https://review.rdoproject.org/r/#/c/22979/07:05
chkumar|rovermarios, ok, thanks :-)07:10
*** jtomasek has quit IRC07:24
*** ykarel is now known as ykarel|lunch07:35
*** marios has quit IRC07:56
*** jtomasek has joined #oooq08:07
*** marios_ has joined #oooq08:09
*** holser has joined #oooq08:12
*** tosky has joined #oooq08:13
*** tesseract has joined #oooq08:16
*** amoralej|off is now known as amoralej08:20
*** ykarel|lunch is now known as ykarel08:31
*** bogdando has joined #oooq08:43
*** holser has quit IRC08:46
*** jpena|off is now known as jpena08:52
*** ccamacho has joined #oooq08:57
zbrsshnaidm: probably you could have saved some time wf https://review.opendev.org/#/c/704395/08:58
zbri really wonder how that happened08:58
zbrbecause the linters job should never had passed the gate08:59
sshnaidmzbr, so we don't need this? https://review.opendev.org/#/c/704502/209:00
zbrwe need it merged asap09:01
zbrahh, it was already included in the other for yesterday09:01
zbrbetter idea to check existing reviews before creating new one, it was more than 8h old09:01
zbrand the queue in this repo is not so big09:01
sshnaidmzbr, can we please make an order there and not duplicate fixes in all roles? Let's keep role patches alone and linters fixes separately, don't mix changes in one patch09:02
chkumar|rovermarios_, we got an upgrade bug https://bugs.launchpad.net/tripleo/+bug/1861083 whom can we forward?09:02
openstackLaunchpad bug 1861083 in tripleo "Master containerized undercloud upgrade job failed with tripleo_podman' role not found " [Critical,Triaged]09:02
sshnaidmzbr, all linter, tox, flake and everything that is not functional - in one whole patch09:03
sshnaidmzbr, and please abandon everything that is not of these09:03
zbrsshnaidm: so, do you know how it managed to get broken?09:04
marios_chkumar|rover: see pvt for roster09:04
sshnaidmzbr, what is broken?09:05
chkumar|rovermatbu, o/ Please have a look at this bug https://bugs.launchpad.net/tripleo/+bug/1861083 when free09:05
openstackLaunchpad bug 1861083 in tripleo "Master containerized undercloud upgrade job failed with tripleo_podman' role not found " [Critical,Triaged]09:05
zbrsshnaidm: i found two different broken linting issues on master on operator yesterday, broken, not improvements.09:06
sshnaidmzbr, what exactly?09:06
zbrnewlines on inventory files, and flake8 was also broken.09:06
zbrfor flake8 i have a theory, but for the other one, no idea.09:07
sshnaidmzbr, and what should fix inventory files?09:07
sshnaidmit's neither yaml, nor bash or py09:07
zbrsshnaidm: f***, I know why, it will happen again.09:08
*** marios_ is now known as marios09:08
zbrlook inside tox.ini at linters09:08
zbrinstead of calling "pre-commit run -a" it does a very silly thing09:08
zbra very good example of how to not to use linters in tox, fixing now.09:09
sshnaidmpython -m pre_commit run yamllint -a ?09:09
zbrwait, you will see my rewrite09:10
zbrand i know why i found it, apparently i am the only one that runs precommit locally.09:13
sshnaidmyou're only one that runs precommit09:14
matbuchkumar|rover: yep i will09:16
chkumar|rovermatbu, thanks :-)09:16
sshnaidmzbr, can you +2 https://review.opendev.org/#/c/70427909:28
zbrsshnaidm: right after you make the .yamllint a rel symlink to root one09:30
sshnaidmzbr, in followup09:30
zbrpromise? ;) okey.09:30
sshnaidmzbr, no lint more lint fixes!09:31
sshnaidmlint no more, 11 statement09:31
sshnaidmzbr, why wouldn't you include this yamllint in your linters patch?09:32
zbris unrelated, but i +2 yours, no need to worry.09:32
zbrsshnaidm: do i remember correctly that we are never supposed to have something in gate that is not identical in check?09:35
zbri think i found a way to avoid future bugs due to them getting out of sync09:35
sshnaidmzbr, all voting jobs should be in check and gate, ys09:38
sshnaidmnon-voting should be in check only09:39
*** dsneddon has joined #oooq09:47
*** dsneddon has quit IRC09:52
zbrsshnaidm: upstream has a check for these, which I was going to convert into a pre-commit hook during next weekend.10:05
*** jbadiapa has joined #oooq10:05
chkumar|roverbrb10:05
zbrif you are curious, i may need a hand on https://pypi.org/project/zuul-lint/ ;)10:05
zbrsoon we will now if we did a zuul nonsense before we create the PR10:06
sshnaidmomg, zuul-lint10:10
zbrsshnaidm: btw, you may find this script useful https://github.com/ssbarnea/harem/blob/master/bin/render-yaml10:12
zbri use it to test anchors, when needed.10:12
zbrmaybe i should have call it zoolander10:13
sshnaidminteresting10:14
zbrsshnaidm: re pep8 issue, should I keep a pep8 alias in tox for compatibility?10:17
sshnaidmzbr, take a look at #sf-ops please10:17
sshnaidmzbr, we're out of place in logs on rdo10:18
*** soniya29 has joined #oooq10:20
*** holser has joined #oooq10:25
*** holser has quit IRC10:26
*** holser has joined #oooq10:26
chkumar|roverarxcruz, sshnaidm marios https://review.rdoproject.org/r/#/c/24701/ what do you think about this10:42
chkumar|rover?10:42
marioschkumar|rover: you mean for fs20 split? i thought we didn't want standalone so we can use a multinode like fs10/fs1 is the main thing i can think of10:44
chkumar|rovermarios, fs020 is main, I was taking a look at this one, as both jobs are same as sometimes false positive results were coming so thought giving a try10:45
marioschkumar|rover: hmm so you mean as well as fs10/fs1 for *.api?10:46
marioschkumar|rover: in this case, not sure, since it would mean big increase in the runtime for it... we might have some pushback for that10:46
marioschkumar|rover: since standalone is meant to be faster test10:46
chkumar|rovermarios, yes same goes for fs10/fs01 for *.api10:47
chkumar|rovermarios, I was checking the time how much it got increased and decreased10:47
marioschkumar|rover: well not really i mean standalone is special case10:47
marioschkumar|rover: but i'm confused. is it *instead* of fs10/fs1 or both?10:48
chkumar|rovermarios, ok10:48
chkumar|rovermarios, we have two types of jobs, standalone and multinode, on multinode your work on splitting api & scenario tests are needed10:48
chkumar|rovermarios, for standalone same kind of job, I wanted to see if I split the tests whether it will be useful or not as it will run in periodic10:49
marioschkumar|rover: k so as well as no instead. ack i added some of the chat into review see what others think as well10:50
chkumar|rovermarios, great, thanks :-)10:50
arxcruzmarios: chkumar|rover i'm okay with that10:58
arxcruzlooks good10:58
mariosarxcruz: ack comment on the review we can have the async discussion there11:04
arxcruzok11:05
*** dtantsur|afk is now known as dtantsur11:07
zbrsshnaidm: EmilienM: we need to merge https://review.opendev.org/#/c/704512/5 on operator asap to prevent regression11:26
sshnaidmzbr, lemme check if it works11:29
mariospanda: can you check comment/question at https://review.rdoproject.org/r/#/c/24665/2/ci-scripts/dlrnapi_promoter/dlrnapi_promoter.py when you have time please11:32
mariospanda: going to update in a sec ^^ see if you agree better with v3 thanks11:45
chkumar|roversshnaidm, few of the jobs are hitting with 500 error on rdo-cloud periodic jobs, I think there might be capacity issue11:45
sshnaidmchkumar|rover, logs..?11:46
chkumar|roversshnaidm, http://logs.rdoproject.org/00/24700/1/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/8554e88/logs/undercloud/home/zuul/overcloud_deploy.log11:46
chkumar|roverrecent one11:46
sshnaidmchkumar|rover, http://logs.rdoproject.org/00/24700/1/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/8554e88/logs/undercloud/var/log/extra/errors.txt.txt11:49
sshnaidmchkumar|rover, I see there ironic timeouts11:49
sshnaidm ERROR ironic.conductor.utils [req-ced5d74c-6112-41af-b111-f0e541287006 - - - - -] Timeout reached while waiting for callback for node11:50
chkumar|roversshnaidm, is it ok?11:52
sshnaidmchkumar|rover, definitely not ok11:52
sshnaidmchkumar|rover, http://logs.rdoproject.org/00/24700/1/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/8554e88/logs/11:52
sshnaidmchkumar|rover, two of bmc failed to provision, no logs11:52
sshnaidmchkumar|rover, it can be because of network failures in the tenant, worth to talk to kforde11:52
*** soniya29 has quit IRC11:55
chkumar|roverbrb11:56
*** soniya29 has joined #oooq12:01
EmilienMzbr: done12:15
*** jpena is now known as jpena|lunch12:23
arxcruzchkumar|rover: marios are the fs020 tests split already merged? I can check but an answer would be faster :)12:33
arxcruzjust want to check some tests I'm doing12:33
chkumar|roverarxcruz, nope12:33
arxcruzchkumar|rover: cool, thanks12:33
mariosarxcruz: no12:33
arxcruzmarios: efcharistó12:34
mariosarxcruz: see https://tree.taiga.io/project/tripleo-ci-board/task/1383 for links to reviews12:34
mariosarxcruz: παρακαλώ12:34
arxcruzmarios: actually, i need to have it not merged so, i'm good :D12:34
mariosarxcruz: ack12:34
pandamarios: commented. also, did you hear what happened with ppc containers ? ci-centos job was down, so in the end there were no ppc containers available for the hash that promoted to master.12:40
chkumar|roverarxcruz, https://bugs.launchpad.net/tripleo/+bug/186110212:41
openstackLaunchpad bug 1861102 in tripleo "Multiple neutron tempest plugin tests failure with AttributeError: 'NoneType' object has no attribute 'open_session'" [High,Triaged]12:41
mariospanda: ack .. no i didn't hear about ppc containers. so it *was* just that there were no ppc tagged containers for the hash we were promoting as suspected... good i guess?12:41
pandammmh master promoted again and no ppc too12:42
mariospanda: or at least not yet proven to be 'our fault' :D12:42
pandamarios: yep12:42
mariospanda: ack on the comment i'll update that in a bit switched to other stuffs for now12:43
mariospanda: thanks for checking12:43
arxcruzchkumar|rover: is this already with the new ssh patch on tempest ?12:43
chkumar|roverarxcruz, nope12:44
pandamjturek: master promoted again, but no sign of ppc containers in rdo :(12:44
chkumar|roverarxcruz, that issue was poped up in master, so i am testing with neutron tempest plugin master in train https://review.rdoproject.org/r/#/c/24683/12:55
*** rlandy has joined #oooq12:59
*** dsneddon has joined #oooq13:00
chkumar|roverweshay|ruck, meeting time13:01
rlandychkumar|rover: how much more hardware do you want?13:01
rlandywe could spare the stein box if needed13:01
chkumar|roverrlandy, may be we can reuse the box and run the tests in group.13:02
rlandychkumar|rover: k - let me know13:02
rlandymarios: hey13:03
rlandymarios: so ... I reran https://review.rdoproject.org/r/#/c/24339/13:04
rlandynow we have more failures :(13:04
*** dsneddon has quit IRC13:04
rlandymarios: also - let me know when you have time to touch base about rhel containers13:05
chkumar|roverrlandy, https://sf.hosted.upshift.rdu2.redhat.com/logs/84/190384/14/check/tripleo-podman-integration-rhel-8-standalone-rhos-16/c1b132f/logs/undercloud/home/zuul/repo_setup.log13:05
*** ykarel is now known as ykarel|mtg13:06
chkumar|roverrlandy, Failed to download metadata for repo 'podman-override'13:06
chkumar|roverbaseurl is correct, but not sure why it is coming13:07
rlandychkumar|rover: looking13:10
chkumar|rovertoday rhel8 train will promote.13:10
*** amoralej is now known as amoralej|lunch13:12
*** jpena|lunch is now known as jpena13:20
*** dtantsur is now known as dtantsur|lunch13:20
mariosrlandy: o/ thanks, i didn't check that fs20 split yet /#/c/24339/ not sure i'll get to it... re containers, i switched to that a litle while ago and trying to progress.. i updated some nits in the manual steps13:20
*** udesale_ has joined #oooq13:22
sshnaidmzbr, seems like markdown linter requires ruby: https://39039997fcbb4b828585-e86ceb7af3919e0f43bac254438f726c.ssl.cf2.rackcdn.com/704423/4/check/openstack-tox-pep8/8221045/job-output.txt13:22
zbryep, i know. there is no actively maintained python based linter. fixable anyway.13:23
mariosrlandy: we can catch up on calls in bit and then after ?13:23
*** udesale has quit IRC13:25
*** ratailor has quit IRC13:25
*** skramaja has quit IRC13:27
arxcruzchkumar|rover: this is a very hard to track issue13:27
arxcruzchkumar|rover: but here's what I found13:27
arxcruzit's a concurrency issue13:27
arxcruzchkumar|rover: are you with me? if you want we can have a gmeet session, because it's hard to follow13:28
chkumar|roverarxcruz, you mean the bm failaues13:28
chkumar|rover?13:28
arxcruzchkumar|rover: the neutron tempest failure13:28
zbrweshay|ruck: wf https://review.opendev.org/#/c/704020/ *now* -- logs13:28
chkumar|roverarxcruz, ah there is a fix merged already https://review.opendev.org/#/c/701018/13:29
chkumar|roverarxcruz, I am testing it with current patch, if still not works, then we can update the concurrency,13:29
chkumar|rovercurrently in another meeting13:29
arxcruzchkumar|rover: (╯°□°)╯︵ ┻━┻13:30
arxcruzso many time on this :/13:30
arxcruzanyway, great, one less problem to worry about13:30
*** marios is now known as marios|call13:30
*** saneax has quit IRC13:31
rlandychkumar|rover: looks like one of two options - proxy or not compatible13:31
chkumar|roverjpena, https://sf.hosted.upshift.rdu2.redhat.com/logs/84/190384/14/check/tripleo-podman-integration-rhel-8-standalone-rhos-16/c1b132f/logs/undercloud/home/zuul/repo_setup.log please have a look13:31
rfolcohttps://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw?both13:32
rfolcoweshay|ruck, around?13:33
rfolcocommunity mtg13:33
weshay|ruckhey yes.. in mtg13:33
rfolcohttps://meet.google.com/bqx-xwht-wky?authuser=113:33
rfolcore: - (wes/folco) centos7/8 container name collision centos-binary-xxxx13:34
rlandychkumar|rover: have you asked jpena re: 'Failed to download metadata for repo'?13:36
chkumar|roverjpena, yes pinged above13:36
jpenaI'm checking13:36
chkumar|rovermatbu, got the idea where to fix the upgrade issue13:38
chkumar|roverlet me propose the patch thanks ykarel|mtg13:38
matbuchkumar|rover: im pushing somethin atm13:39
chkumar|rovermatbu, ok then13:39
chkumar|roverwill test it in ci13:39
rlandysshnaidm: we should touch base about training OVB ... some time today?13:39
sshnaidmrlandy, yeah, ping me when you're ready13:40
jpenachkumar|rover: the issue is caused by the SSL certificate in the log server, which is not recognized by the VM (it must be signed by an internal CA). We can either get the CA cert in the VM, or set "sslverify=no" in the podman-override repo file13:40
rlandychkumar|rover: jpena: when we create the .repo file? if so, let's just try it. easiest path13:44
chkumar|roversetting sslverify to no13:44
jpenarlandy: yes, I've tested it locally13:44
rlandyok - minor change of the patch13:45
rlandyputting in change13:45
*** Goneri has joined #oooq13:48
bogdandoola devops ppl13:48
bogdandodid you got perchance any experience with tweaking ssh connection transport over high latency?13:48
bogdandolike 500ms, to have it working seamlessly and having ansible never timed out13:48
chkumar|roverrlandy, sslverify support needs to be added to tq13:51
chkumar|roverproposing patch13:51
matbuchkumar|rover: what do you have in mind ?13:55
chkumar|rovermatbu, https://opendev.org/openstack/tripleo-upgrade/src/branch/master/tasks/common/undercloud_prerequisites.yaml#L813:55
chkumar|roveradding tripleo-ansible here13:55
matbuha yep13:55
matbuthis is what i have pushed13:55
chkumar|roverif present then13:55
marios|callblack review from zbr at         * https://review.opendev.org/#/c/703980/413:58
chkumar|rovermatbu, https://bugs.launchpad.net/tripleo/+bug/1861083 please add the bug link in commit message thanks :-)13:59
openstackLaunchpad bug 1861083 in tripleo "Master containerized undercloud upgrade job failed with tripleo_podman' role not found " [Critical,Triaged]13:59
matbuchkumar|rover: yep i will do13:59
chkumar|roverweshay|ruck, train might promote today, fingers crossed14:03
chkumar|roverfs020 is still running14:03
*** pojadhav is now known as pojadhav|afk14:06
*** marios|call is now known as marios14:07
chkumar|roverweshay|ruck, heading home, see ya in a bit14:07
*** ykarel|mtg is now known as ykarel14:09
*** soniya29 has quit IRC14:11
*** dtantsur|lunch is now known as dtantsur14:12
*** ykarel is now known as ykarel|away14:18
*** amoralej|lunch is now known as amoralej14:27
*** hamzy__ is now known as hamzy14:28
weshay|ruckchkumar|rover, you still w/ me?14:34
weshay|ruckah dam14:34
weshay|ruckzbr, how we doing w/ collect-logs? need reviews?14:37
weshay|ruckzbr, please join #sf-ops14:37
*** TrevorV has joined #oooq14:37
rlandymarios: http://pastebin.test.redhat.com/830996 .. that's as far as my container build went.14:48
mariosrlandy: ack, me not much further         * http://paste.openstack.org/raw/788871/14:48
mariosrlandy: lets sync in 10 mins?14:48
rlandyyep14:49
chkumar|roverweshay|ruck, I am back14:56
weshay|ruckchkumar|rover, hey... can we chat for 5?14:56
weshay|ruckruck rover stuff14:56
chkumar|roverweshay|ruck, yes14:56
weshay|ruckhttps://meet.google.com/yjs-egvk-cxp?authuser=114:57
*** jtomasek has quit IRC15:00
*** dsneddon has joined #oooq15:01
chkumar|roverweshay|ruck, https://code.engineering.redhat.com/gerrit/#/c/190384/15:05
*** dsneddon has quit IRC15:06
chkumar|roverweshay|ruck, http://pkgs.devel.redhat.com/cgit/rpms/podman/tree/podman.spec?h=stream-container-tools-1.0-rhel-8.1.015:06
chkumar|roverweshay|ruck, https://code.engineering.redhat.com/gerrit/#/c/190384/15:10
chkumar|roverrlandy, commented back on sslverify patch15:17
rlandychkumar|rover: ^^ added depends-on to that to include tq patch15:17
rlandyk - updating15:18
chkumar|roverrlandy, yup thanks :-)15:18
rlandychkumar|rover: hmmm ... actually I am not sure it should be 1 - we can see what impact it has on the other repos .. will see how the tests shake out15:20
chkumar|roverrlandy, ok15:20
rlandychkumar|rover: if the patch passes tests, great15:20
chkumar|roverworks for me15:27
chkumar|roverweshay|ruck, rlandy sshnaidm zbr please get this merged https://review.opendev.org/#/c/704564/ in your evening15:28
*** jjoyce has joined #oooq15:33
*** jjoyce has quit IRC15:34
*** jjoyce has joined #oooq15:36
*** jjoyce is now known as fuzzball8115:38
*** migi has joined #oooq15:41
*** Goneri has quit IRC15:47
*** jfrancoa has quit IRC15:51
chkumar|roverweshay|ruck, rlandy arxcruz ssbarnea sshnaidm rfolco need feedback on this review https://review.rdoproject.org/r/#/c/24701/15:54
sshnaidmchkumar|rover, I think it's worth to make list of running tests in this job, current running job and 020 job15:57
sshnaidmchkumar|rover, so we can compare them and see if we miss some tests anywhere15:57
sshnaidmchkumar|rover, without list of jobs I don't know which coverage it has15:57
chkumar|roversshnaidm, yes, good point, will add that.15:58
*** pojadhav|afk is now known as pojadhav16:00
chkumar|roverThanks folks, See ya tomorrow, Have a nice day ahead :-)16:02
*** chkumar|rover is now known as raukadah16:02
*** marios is now known as marios|call16:03
raukadahmigi, Will schedule a time tomorrow, sorry16:03
raukadahmigi, you are in which time zone?16:03
rlandyraukadah: think this may be working ... https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/64a145b7a3914fc08fefcd193243a9a1?logfile=console.log16:04
rlandyrepo-setup has not bailed yet16:05
*** jfrancoa has joined #oooq16:06
*** udesale_ has quit IRC16:22
*** marios|call is now known as marios16:37
*** marios is now known as marios|out16:44
sshnaidmrlandy, weshay|ruck so what about ovb sync for bootcamp, should we do it today or later?16:44
rlandyfine by me either way16:45
weshay|ruckjust holla16:45
rlandynow?16:45
weshay|ruckI have time now16:45
*** jpena is now known as jpena|brb16:45
*** rfolco is now known as rfolco|bbl16:46
*** soniya29 has joined #oooq16:47
weshay|rucksshnaidm, guestion to you ^16:48
sshnaidmweshay|ruck, rlandy yes, let's do it16:48
*** bogdando has quit IRC16:48
rlandyk16:48
weshay|ruckhttps://meet.google.com/seq-eimc-kpw?authuser=116:48
*** marios|out has quit IRC16:59
*** tesseract has quit IRC17:01
*** TrevorV has quit IRC17:12
*** soniya29 has quit IRC17:19
*** holser has quit IRC17:20
*** holser__ has joined #oooq17:20
weshay|ruckrlandy, weird.. my key is correct in this17:21
rlandyraukadah: podman job is at tempest17:21
rlandylooks good17:21
raukadahrlandy, awesome, It is going to fail17:21
rlandyit's fine17:21
raukadahi will file bug tomorrow17:21
rlandyunrelated problem17:21
rlandyraukadah: k - we can talk about roles tomorrow before we merge any duplicate stuff17:22
rlandyweshay|ruck: weird17:22
rlandycan you ssh to the bootcamp0 instance?17:22
rlandygetting ip17:22
*** jpena|brb is now known as jpena17:24
arxcruzraukadah: how log is the fs020 taking to run?17:26
*** TrevorV has joined #oooq17:26
raukadaharxcruz, you mean this review https://review.rdoproject.org/r/#/c/24683/ ? still waiting on zuul17:29
arxcruzraukadah: no, in general17:29
rlandywoohoo base container built17:30
raukadaharxcruz, https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-master 17895 secs17:31
rlandyweshay|ruck: ^^17:31
*** chem has quit IRC17:32
*** chem has joined #oooq17:33
weshay|ruckrlandy, nice17:36
rlandycoul duse some help on how to change the kolla-build.conf17:36
rlandycould use17:37
*** holser__ has quit IRC17:41
*** holser has joined #oooq17:42
weshay|ruckzbr, please turn gzip off in the upstream logs17:55
weshay|ruckzbr, https://5b52484e38164f93b6c2-9e0477d6144af66a12f4a85c337959e0.ssl.cf2.rackcdn.com/682410/15/gate/tripleo-ci-centos-7-containers-undercloud-minion/51bd12e/logs/undercloud/home/zuul/17:55
zbrweshay|ruck: the change is still in gate17:55
* weshay|ruck looks17:56
zbr70288317:56
weshay|ruckzbr, where is the when condition? https://review.opendev.org/#/c/704020/8/tasks/collect.yml17:57
raukadahweshay|ruck, do we want to include minions jobs in promotion pipeline?17:57
weshay|ruckshould be a subset of undercloud.. but it's always safer to have every gate job in promotion17:58
weshay|ruckso I would say yes17:58
raukadahweshay|ruck, will get job definition and patches up tomorrow17:59
weshay|ruckzbr, I think you need to update your patches18:00
*** derekh has quit IRC18:00
weshay|ruckzbr, please take another look as upstream logs are getting zipped18:00
weshay|ruckand now are not html browsable18:00
zbrweshay|ruck: is known, sshnaidm agreed a this being a temporary workaround to prevent rdo from colapsing18:02
zbrweshay|ruck: https://review.opendev.org/#/c/702883/2 part of it18:03
zbrweshay|ruck: making now the when...18:06
*** dtantsur is now known as dtantsur|afk18:07
sshnaidmzbr, hmm.. I still see something is gzipped: https://feabd393e4f0f9d5bf69-aab3be9bb5aeae7aa25cf74024d6596b.ssl.cf5.rackcdn.com/702883/2/check/tripleo-ci-centos-7-containers-multinode-rocky/740f6b7/logs/undercloud/home/zuul/18:10
sshnaidmzbr, like overcloud_prep_containers.log.txt.gz18:10
sshnaidmbut not all18:10
weshay|ruckrfolco|bbl, ugh18:10
weshay|ruckping me18:10
zbrhttps://review.opendev.org/#/c/704649/118:12
sshnaidmzbr,  |bool ?18:12
*** holser has quit IRC18:14
*** amoralej is now known as amoralej|off18:18
zbrsshnaidm: why? passed ansible-lint, not reason to worry.18:25
sshnaidmzbr, ansible-lint is too easy to pass :)18:25
zbrtrue18:25
migiraukadah: hey18:29
*** holser has joined #oooq18:30
*** jpena is now known as jpena|off18:32
*** holser has quit IRC18:40
*** dsneddon has joined #oooq18:58
migiraukadah: I am in GMT+119:00
weshay|ruckrfolco|bbl, nevermind.. found what I was looking for19:00
migiweshay|ruck: hey I'm at home but looks like it's scheduled for 2morrow ?19:02
*** TrevorV has quit IRC19:03
weshay|ruckmigi, sorry man.. I told you in the email.. tomorrow tommorrow19:04
weshay|ruckI love you tomorrow19:04
weshay|ruckyou're always19:04
weshay|rucka19:04
weshay|ruckda19:04
weshay|rucky19:04
weshay|ruckaway19:04
migiweshay|ruck: cool19:05
*** rfolco|bbl has quit IRC19:19
*** TrevorV has joined #oooq19:26
rlandyweshay|ruck: rhos-15 latest looks good20:16
weshay|ruckrlandy, it's still running20:16
weshay|ruckdid you cheat and ssh in?20:16
rlandyno - but sometimes it fails deploy earlier20:17
weshay|ruckaye20:17
rlandyI'm extrapolating - it could still fail20:17
*** rfolco has joined #oooq20:24
*** TrevorV has quit IRC20:57
rlandyweshay|ruck: have a few minutes to review instance creation scripts21:12
weshay|ruckrlandy, post them to gitlab internal21:13
rlandyk21:16
weshay|ruckrfolco, updated centos-8 container build user stories21:19
*** jbadiapa has quit IRC21:24
*** jfrancoa has quit IRC22:18
zbri hope you will look into merging https://review.opendev.org/#/c/704649/ asap, i go offline now.22:21
*** jmasud has quit IRC22:34
rlandyweshay|ruck: https://gitlab.cee.redhat.com/snippets/166622:44
*** rfolco has quit IRC22:46
*** rlandy is now known as rlandy|bbl23:32
weshay|ruckrlandy|bbl, thanks23:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!