Friday, 2019-05-10

*** apetrich has quit IRC01:57
*** ykarel|away has joined #oooq03:00
*** udesale has joined #oooq03:03
*** rlandy has quit IRC03:27
*** ykarel|away has quit IRC03:40
*** ykarel|away has joined #oooq03:57
*** ykarel_ has joined #oooq04:00
*** ykarel|away has quit IRC04:03
*** ykarel_ is now known as ykarel04:14
*** ratailor has joined #oooq04:24
*** raukadah is now known as chandankumar04:28
*** dsneddon has joined #oooq04:43
*** skramaja has joined #oooq05:14
*** ksambor has quit IRC05:36
*** marios has joined #oooq05:42
*** udesale has quit IRC05:44
*** udesale has joined #oooq05:45
*** quiquell|off is now known as quiquell05:49
*** dsneddon has quit IRC05:49
*** ksambor has joined #oooq05:51
*** dsneddon has joined #oooq06:15
*** kopecmartin|off is now known as kopecmartin06:26
*** dsneddon has quit IRC06:28
*** jfrancoa has joined #oooq06:58
*** dsneddon has joined #oooq06:58
*** jbadiapa has quit IRC06:59
*** dsneddon has quit IRC07:12
*** skramaja has quit IRC07:13
*** brault has joined #oooq07:19
*** tesseract has joined #oooq07:19
*** skramaja has joined #oooq07:25
*** skramaja_ has joined #oooq07:30
*** skramaja has quit IRC07:30
*** apetrich has joined #oooq07:30
*** amoralej|off is now known as amoralej07:33
*** marios has quit IRC07:37
*** bogdando has joined #oooq07:45
*** dsneddon has joined #oooq07:47
*** jaosorior has joined #oooq07:49
*** dsneddon has quit IRC07:52
*** holser_ has joined #oooq07:54
*** udesale has quit IRC07:57
*** jpena|off is now known as jpena07:57
*** udesale has joined #oooq07:58
*** ykarel is now known as ykarel|lunch08:00
*** udesale has quit IRC08:05
*** udesale has joined #oooq08:08
*** marios has joined #oooq08:14
*** holser_ has quit IRC08:16
*** holser_ has joined #oooq08:16
*** udesale has quit IRC08:22
*** dsneddon has joined #oooq08:25
*** dsneddon has quit IRC08:30
*** ykarel_ has joined #oooq08:40
*** bogdando has quit IRC08:41
*** ykarel|lunch has quit IRC08:43
*** ykarel__ has joined #oooq08:45
*** ykarel_ has quit IRC08:47
*** ykarel__ has quit IRC08:49
*** ykarel has joined #oooq08:52
*** ykarel_ has joined #oooq08:58
*** ykarel has quit IRC09:01
*** ykarel_ is now known as ykarel09:02
*** dmellado has quit IRC09:09
*** dmellado has joined #oooq09:11
*** dmellado has quit IRC09:11
*** dmellado has joined #oooq09:15
*** bogdando has joined #oooq09:15
*** dsneddon has joined #oooq09:26
*** udesale has joined #oooq09:27
*** dsneddon has quit IRC09:31
chandankumararxcruz: Hello09:36
chandankumararxcruz: we cannot run os_tempest for rocky standalone as we need to port lots of patches09:36
chandankumarlike python-tempestconf distro workspace support and a lot more09:36
chandankumarin toci if someway we tweak the script to not checkout branches for os_tempest09:37
chandankumarthen it will perfectly work09:37
*** dsneddon has joined #oooq10:00
*** ykarel has quit IRC10:11
*** sanjayu__ has quit IRC10:31
chandankumarmarios: Hello10:41
marioschandankumar: hi10:42
chandankumarmarios: Is it possible to restrict some project to clone master only in zuul workspace using toci script irrespective of branch override passed?10:42
chandankumarhttps://review.opendev.org/#/c/658321/ does not works10:43
marioschandankumar: hmm not something am aware of but do you mean on the job definition?10:45
marioschandankumar: there is something like override-checkout10:46
marioschandankumar: https://zuul-ci.org/docs/zuul/user/config.html#attr-job.override-checkout10:46
chandankumarmarios: yes branch_override -> it overrirde to OVERRIDE_ZUUL_BRANCH10:46
mariosmaybe something panda knows more about though if its zuul related10:46
* chandankumar looks at panda10:46
marioschandankumar: going afk for a bit in a sec10:46
marioschandankumar: you must only address him by "lord" or "sire" and never make eye contact10:47
chandankumaraye aye10:47
pandaI know nothing10:48
panda /nick jonsnow10:48
mariosbiab10:49
*** marios has quit IRC10:49
pandachandankumar: what you mean ?10:49
pandachandankumar: what you need ?10:49
pandachandankumar: override_checkout forces zuul to get a different branch than the one that triggered the job\10:49
chandankumarpanda: in stable rocky jobs, I want to clone os_tempest and dependencies from master10:50
*** holser_ is now known as holser|lunch10:50
pandachandankumar: is there a stable/rocky on os_tempest ?10:50
chandankumarpanda: yes10:50
pandachandankumar: then why ?10:50
chandankumarpanda: https://review.opendev.org/#/c/658321/10:50
chandankumarpanda: the stuff needed in os_tempest for running tempest in standalone is not there10:50
chandankumarit requires a series of backport which is not feasable10:51
pandachandankumar: ok, then override_checkout is really what you want to sue, but restricted to that project10:51
pandause*10:52
*** ykarel has joined #oooq10:52
chandankumarbasically for these projects https://opendev.org/openstack/tripleo-quickstart/src/branch/master/quickstart-extras-requirements.txt we need stuff from master10:53
pandachandankumar: are all the requirements pulled by zuul10:54
panda?10:54
chandankumarpanda: http://logs.openstack.org/21/658321/1/check/tripleo-ci-centos-7-standalone-upgrade/a6bd768/job-output.txt.gz#_2019-05-10_10_31_25_18990610:55
chandankumarpanda: yes10:55
pandachandankumar: phew!10:56
pandachandankumar: ok, then you might have chance10:56
chandankumarpanda: https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/run-test/templates/toci_gate_test.sh.j2#L16710:57
chandankumarwhat about adding a condition here to do git checkout master10:57
chandankumaror is it possible to set branch in required projects for a specific project?10:58
chandankumarpanda: somethign like this https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/base.yaml#L3410:59
pandachandankumar: yes exactly11:02
pandachandankumar: was looking exactly for this example11:02
*** dsneddon has quit IRC11:03
*** panda is now known as panda|lunch11:07
weshayrfolco|ruck please fix this as you have time https://bugs.launchpad.net/tripleo/+bug/182850911:07
openstackLaunchpad bug 1828509 in tripleo "More deps needed on Team and repository tags in tripleo-quickstart" [Undecided,New]11:07
weshayis marios here today?11:08
weshayquiquell ping chat in a few?11:09
chandankumarweshay: yes, He will be coming back soon11:09
weshayk11:09
quiquellweshay: yep, just ping me when you are free11:09
* chandankumar brb for an hour11:12
weshayquiquell /me joins11:12
quiquellweshay: going to your blue11:13
*** dsneddon has joined #oooq11:15
quiquell| 6a6d23d7-65e7-43ea-9307-71b2e17d2ead | upstream-cloudinit-centos-7               | active |11:16
quiquell| 88006cd1-d089-4bd3-b70a-8cbc7eb32f63 | upstream-cloudinit-fedora-28              | active |11:16
quiquell| c1f9afa1-2f96-4264-8e06-5c111a9966ba | bmc-template                              | active |11:17
*** jpena is now known as jpena|lunch11:30
weshayquiquell check the images for me please11:33
quiquellweshay: we need someone else tenant since I already have them11:35
weshaymatbu meet quiquell11:35
weshayquiquell give matbu the commands cli11:35
quiquellweshay: btw https://review.rdoproject.org/r/#/q/topic:quiquell-braindump11:36
quiquellmatbu: what's up11:36
quiquellmatbu: do a openstack image list and look for the images above11:37
*** marios has joined #oooq11:40
matbuquiquell: i dont have this one : upstream-cloudinit-fedora-2811:43
quiquellmatbu: do you have the others ?11:46
matbuquiquell: yep11:46
quiquellweshay: ^ looks like fedora-28 is missing11:47
marioshttps://review.opendev.org/#/c/655661/ weshay o/ good morning so lets merge it ? :)11:53
mariosjfrancoa: ^^11:53
weshaymarios ya.. but we need a bug on the tempest tests11:53
weshayI skipped11:53
mariosweshay: oh which ones?11:53
mariosweshay: damn didn't notice it11:53
marios:/11:53
mariosso we have a bug is this new /me checks11:53
weshaymatbu https://rdo-ci-fx2-01-s7-drac.mgmt.rdoci.lab.eng.rdu2.redhat.com/login.html11:54
weshaymarios look at my change11:54
mariosweshay: yah only just noticed the skips11:54
mariosweshay: we already have a bug for that we thought it was fixed cc chandankumar https://bugs.launchpad.net/tripleo/+bug/182786311:56
openstackLaunchpad bug 1827863 in tripleo "(stable/stein) standalone-upgrade job failing tempest post upgrade - test_server_security_groups" [Undecided,Triaged]11:56
*** Goneri has joined #oooq11:57
mariosweshay: quiquell rfolco|ruck panda|lunch  want to merge that? https://review.opendev.org/#/c/657779/11:59
quiquellmarios: Can be my last merge :-)11:59
mariosquiquell: you mean... today ...12:00
marios:/12:00
mariosquiquell: what12:00
mariosquiquell: did12:00
mariosquiquell: we12:00
mariosquiquell: EEVER12:00
mariosquiquell: do12:00
marios?12:00
quiquellmarios: is not you is me12:00
*** panda|lunch is now known as panda12:01
pandahoe many times did I hear that ?12:01
* marios hugs panda12:01
pandawe are too good for you, right12:01
marioswe gotta stick together man especially when SOME people are happy to leave us panda12:02
* marios deathgrip panda12:02
weshayouch12:05
quiquellmarios: +w12:05
mariosthank you lord quiquell enrique jose emanuelle frekeriko parpinotti llorente pastora12:07
marios(sorry if i missed any)12:07
pandayazevedo12:09
weshaymarios https://bugs.launchpad.net/tripleo/+bug/182855012:09
openstackLaunchpad bug 1828550 in tripleo "Rocky standalone failing in tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON" [High,Triaged]12:09
marios14:57 < marios> weshay: we already have a bug for that we thought it was fixed cc chandankumar https://bugs.launchpad.net/tripleo/+bug/182786312:11
openstackLaunchpad bug 1827863 in tripleo "(stable/stein) standalone-upgrade job failing tempest post upgrade - test_server_security_groups" [Undecided,Triaged]12:11
mariosweshay: we already have https://bugs.launchpad.net/tripleo/+bug/1827863 is that one different?12:11
mariosweshay: checking12:11
mariosweshay: ah rocky?12:11
weshaypanda is something up w/ your vi settings? https://code.engineering.redhat.com/gerrit/#/c/169073/4/rhos-release12:12
pandaweshay: no, there two ways to handle heredocs in bash, you either specify << EOF and then any indentation you provide will be ported to the file, or you can specify <<- EOF (with the minus) and all the tabs until EOF will be squashed. Unfortunately doesn't work with spaces, only with tabs. SO the two alternatives are: break script indentation, or add a bunch of tabs. That's what I'm askin in the comment.12:14
weshayquiquell matbu the images should be fixed now12:14
weshaymatbu please confirm w/ quiquell12:14
weshaypanda why did you change the way the repos are defined and use EOF?12:15
weshaypanda why not just define url12:15
weshayand continue the pattern as the other repos12:16
weshayare we not able to wget those from centos?12:16
* weshay checks12:16
pandaweshay: because the pattern before actually downloads a repo file taht is available12:16
pandaweshay: I didn't find any ready repo file for the opstools12:17
pandaI didn't check fo0r ceph12:17
*** dsneddon has quit IRC12:18
weshaypanda ya.. neither is there12:18
weshaypanda ok.. go see if jshlueter will merge12:18
weshaythanks for the explanation12:19
weshayanyone interested in building bridges w/ rhos-delivery folks?12:20
*** rlandy has joined #oooq12:23
mariosweshay: is that bug needed? I see you're pointing to stable/stein upgrade job in https://bugs.launchpad.net/tripleo/+bug/182855012:25
openstackLaunchpad bug 1828550 in tripleo "Rocky standalone failing in tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON" [High,Triaged]12:25
mariosweshay: are you saying we have the same bug in stable/rocky? do we have that job in rocky don't think so12:25
chandankumarweshay: marios rocky promotion depends on https://review.opendev.org/#/c/657964/312:26
mariosweshay: so should we delete that https://bugs.launchpad.net/tripleo/+bug/1828550 and keep https://bugs.launchpad.net/tripleo/+bug/1827863 which already has some info about the tempest conf info from tempest team12:26
openstackLaunchpad bug 1827863 in tripleo "(stable/stein) standalone-upgrade job failing tempest post upgrade - test_server_security_groups" [Undecided,Triaged]12:26
mariosweshay: ok so you want/need a separate bug against rocky12:27
mariosweshay: just making sure12:27
mariosweshay: it would be good to update https://bugs.launchpad.net/tripleo/+bug/1828550 to point to the rocky logs then12:27
openstackLaunchpad bug 1828550 in tripleo "Rocky standalone failing in tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON" [High,Triaged]12:27
mariosweshay: err but there are no rocky jobs me confused12:28
mariosweshay: ah standalone vs standalone-upgrade12:28
mariosweshay: this is the difference between the bugs12:28
mariosweshay: :/12:28
mariosweshay: ???12:29
mariosweshay: no but you still have pointer to the standalone-upgrade stein in the description http://logs.openstack.org/61/655661/6/check/tripleo-ci-centos-7-standalone-upgrade-stein/2f69b10/logs/tempest.html.gz12:29
mariosweshay: want to jump on the phone?12:29
mariosperhaps chandankumar is around too ?12:29
* marios brb 12:29
chandankumarmarios: I am here,12:30
jfrancoamarios: standalone-upgrade green! this is a wonderful Friday! :-D12:31
mariosjfrancoa: yeah but with skips https://review.opendev.org/#/c/655661/7/zuul.d/standalone-jobs.yaml12:31
mariosjfrancoa: so its a trick12:31
chandankumararxcruz: kopecmartin agenda here https://etherpad.openstack.org/p/tripleo-tempest-squad-meeting lno: 2712:31
*** jpena|lunch is now known as jpena12:31
marioschandankumar: any idea why it was still hitting the tempest issue yesterday at http://logs.openstack.org/61/655661/6/check/tripleo-ci-centos-7-standalone-upgrade-stein/2f69b10/logs/tempest.html.gz (the tempest issue being the one we discussed yesterday i.e. https://bugs.launchpad.net/tripleo/+bug/182786312:32
openstackLaunchpad bug 1827863 in tripleo "(stable/stein) standalone-upgrade job failing tempest post upgrade - test_server_security_groups" [Undecided,Triaged]12:32
marioschandankumar: do you think it would be green today ?12:32
marioschandankumar: we had promotion yesterday12:32
chandankumarmarios: for rocky na?12:33
mariosand today looks like12:33
chandankumarfor sten also?12:33
marioschandankumar: no this is stein12:33
jfrancoamarios: ohhh... I see..I didn't realize about that. shall we wait for the tempest package first before merging it? so we can merge it without tricks12:33
marioschandankumar: its stable-stein standalone-upgrade. so it fails after upgrade with the stein things12:33
chandankumarmarios: I see there there new python-tempestconf got used12:34
weshayjfrancoa meh.. imho better to get it gating..  I could have put that test in the rocky skip list, but I think it's only happening on upgrades12:34
mariosjfrancoa: yeah this is what we're currently negotiating :) it was merged actually we were/are waiting for promotion. that log ran yesterday afternoon our time so i'm not sure if it is because the fix didn't fix it, or because it was too early the fix wasn't there yet from promotion12:34
weshaychandankumar we don't see that failure on other rocky jobs do we?12:35
chandankumarweshay: on rocky periodic it is passing http://logs.rdoproject.org/openstack-periodic-24hr/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-rocky/88d456a/logs/tempest.html.gz12:36
pandaarxcruz: thanks, I couldn't say it better than you.12:37
weshayquiquell arxcruz I need you both on bluejeans for a minute12:38
arxcruzpanda: :)12:38
quiquellweshay: going12:38
chandankumarmarios: standalone rocky job http://logs.openstack.org/67/657067/16/check/tripleo-ci-centos-7-standalone-rocky/07b10f8/logs/tempest.html.gz is passing in check12:39
marioschandankumar: the bug in https://bugs.launchpad.net/tripleo/+bug/1827863 is specific to standalone-upgrade12:40
openstackLaunchpad bug 1827863 in tripleo "(stable/stein) standalone-upgrade job failing tempest post upgrade - test_server_security_groups" [Undecided,Triaged]12:40
marioschandankumar: not standalone12:40
weshayarxcruz you avail?12:40
marioschandankumar: and the problem is in fact that before upgrade the flavors volumes created by tempestconf are incompatible with the stein defaults12:40
marioschandankumar: as you wrote in comment 212:41
marioschandankumar: and see kopecmartin comments.12:41
marioschandankumar: but looks like it still hits these with https://review.rdoproject.org/r/#/c/20579/ 2.2.0?12:41
marioschandankumar: i should check the version in the logs there12:41
chandankumarmarios: it is using the new version of tempestconf12:42
marioschandankumar: but we had promotions for master/stein last 3 days in row afaics12:42
marioschandankumar: yeah will check the versions there in a few mins12:42
marioschandankumar: we might merge like that in the meantime weshay what do you think? merge gating with skips?12:42
mariosweshay: before we get another thing to break it12:43
mariosweshay: its only a matter of hours/days before it happens12:43
*** ratailor has quit IRC12:43
mariosits inevitable at least this way we can have a converation about the breakage12:43
chandankumarmarios: donpt we think we need to perform cleanup12:43
*** holser|lunch is now known as holser_12:44
mariosMay 09 18:59:56 Installed: python2-tempestconf-2.0.0-0.20180821043805.d7db90e.el7.noarch12:49
mariosMay 09 19:16:28 Updated: python2-tempestconf-2.2.0-0.20190508044059.e0d5dd6.el7.noarch12:49
marioschandankumar: ^^12:49
marioschandankumar: http://logs.openstack.org/61/655661/6/check/tripleo-ci-centos-7-standalone-upgrade-stein/2f69b10/logs/undercloud/var/log/yum.log.txt.gz12:49
chandankumarmarios: yes, seen that part, do we want add a word around to cleanup that flavor with zero disk?12:50
chandankumar*work12:51
marioschandankumar: so we need to delete the flavors created by tempest?12:51
marioschandankumar: cant we get tempest to do that?12:51
marioschandankumar: i would rather skip the tests until there is a proper fix in tempestconf rather than carry a hack. where would we put it in the stanndalone-upgrade role?12:52
chandankumarmarios: once thing we can do it is to run tempest clean up after tempest run finishes before upgrade12:52
marioschandankumar: but i think we should go ahead and merge with skips weshay what say you https://review.opendev.org/#/c/655661/712:52
marioschandankumar: ok that sounds good12:52
mariosweshay: we can have another patch on monday to unksip12:53
mariosweshay: monday is a long way away to leave a job like that12:53
weshayya.. removing the skip once it's fixed will be nice12:53
mariossure pretty job you got there. shame if something happened to it over the weekend when its all alone.12:53
weshaymarios easy rather12:53
mariosweshay: i can even post it12:54
mariosweshay: unskip and we can merge as soon as it is green12:54
mariosweshay: well have no choice, it'll be gated12:54
marios\o/12:54
chandankumarweshay: marios we can skip the test from fs override itself12:54
chandankumarinstead of putting in the master skip list12:55
*** vinaykns has joined #oooq12:55
chandankumarah it is already there12:55
weshaychandankumar ya.. we don't need to skip that for all the rocky jobs afaict12:55
chandankumarmarios: one question12:56
chandankumarthis job upgrades from rocky to stein12:56
chandankumarin rocky we have updated tempestconf-2.2.0 and same in stein also12:57
chandankumarso why lower version is getting installed there?12:57
marioschandankumar: it deploys rocky and then updates with stein. maybe the version of rocky it deploys is very old12:57
*** amoralej is now known as amoralej|lunch12:57
chandankumarin rocky we donot have promotion na?12:58
chandankumarrocky is blocked due to this https://review.opendev.org/#/c/657964/12:58
chandankumaronce rocky got promoted12:58
chandankumarwe donot even need to put it in skip list12:58
marioschandankumar: ah so the fix needs to go into the deploy tempestconf, not the updated one?12:59
marioschandankumar: k good to know then thanks12:59
marioschandankumar: maybe also tell launchpad about it if you get a chance12:59
weshaychandankumar arxcruz kopecmartin tempest planning in 1min12:59
mariosweshay: once we're ready we can https://review.opendev.org/65835313:00
chandankumarweshay: https://etherpad.openstack.org/p/tripleo-tempest-squad-meeting13:01
weshayarxcruz ok.. time to talk tempest13:02
chandankumarkopecmartin: https://code.engineering.redhat.com/gerrit/15920413:04
*** skramaja_ has quit IRC13:04
weshaykopecmartin Sai Sindhur Malleni <sai@redhat.com>13:06
*** quiquell is now known as quiquell|lunch13:09
chandankumarweshay: arxcruz https://review.opendev.org/#/c/658331/13:11
mariosweshay: so we can move this done chandankumar rfolco|ruck https://tree.taiga.io/project/tripleo-ci-board/task/989? well it needs a qe13:16
rfolco|ruckmarios, yep would be great if you find a qe to verify this13:18
rlandymarios: weshay: panda: pls review/vote ... https://review.opendev.org/#/c/658358/ - browbeat changes are not being included13:19
mariospanda: chandankumar rfolco|ruck rlandy weshay arxcruz kopecmartin i need a qe for this please https://tree.taiga.io/project/tripleo-ci-board/task/989 - it is about standalon-upgrade stein job and that it is green. qe should be pretty straightforward13:19
marioskindly form orderly line for applications13:19
mariosrlandy: make me13:20
rlandymarios: did you just fill in my application?13:20
mariosi did not. refreshing taiga13:21
rlandymarios: k- you win - I'll qe your work13:21
rlandypls vote on my change13:21
rlandyfair enough?13:21
marios16:20 < marios> rlandy: make me13:21
marios(i already had)13:21
rlandymarios: sorry - did not understand the 'make me'13:22
rlandyok - great13:22
rlandywill still do your qe13:22
mariosrlandy: thank you13:22
rlandymarios: can you run me through it quickly to speed things up?13:23
mariosrlandy: latest status on that is in comment https://bugs.launchpad.net/tripleo/+bug/1827863 comment #913:23
openstackLaunchpad bug 1827863 in tripleo "(stable/stein) standalone-upgrade job failing tempest post upgrade - test_server_security_groups" [Undecided,Triaged]13:23
rlandyoh ok - I see13:23
rlandylet me just kick off a new browbeat run with above review and I'll look13:23
mariosrlandy: adding you as qe in https://tree.taiga.io/project/tripleo-ci-board/task/989 cc lord rfolco|ruck13:24
rlandysure13:24
rfolco|ruckwrong alias :)13:25
rlandyarxcruz: you crack me up (response to quiquell|lunch's email)13:27
rlandymarios: k - on it13:27
arxcruz:)13:27
mariosrlandy: thanks i mean the job itself is still just merging now so it is not a firedrill don't change any other priorities you had for today. it can also be next week13:28
mariosrlandy: the really important thing is making that job vote ASAP13:28
mariosrlandy: and it is now in the hands of our lord and ruler zuul13:29
mariospraise be to zuul13:29
arxcruzmarios: zuul demands trial by combat13:29
rlandymarios: priority for today - run browbeat job, wait for next failure (hope it's not something I can't fix)- so I have time in between13:29
mariosarxcruz: :D13:30
mariosrlandy: cool thanks13:30
chandankumararxcruz: weshay https://review.opendev.org/#/c/527305/13:32
*** quiquell|lunch is now known as quiquell13:34
*** aakarsh has quit IRC13:40
rlandytaiga, why do you keep hanging my browser??13:41
rfolco|ruckrlandy, attention deficit13:43
*** taiga has joined #oooq13:43
rfolco|ruckhaha13:43
taigarlandy: because I hate you13:43
rlandyrfolco|ruck: taiga: the problem is I am also running short on memory so when you hang my browser, I also have to remember what I was doing to re-create it13:44
rlandythis is a problem13:44
mariosO M G13:44
mariosis this how skynet starts13:44
rlandybecause I am a peaces-loving person and I don't want taiga to hate me13:44
rlandypeace-loving13:44
rfolco|rucknow that email to pay for the service starts to link the points13:45
* marios notices red dot appeared on wall behind him13:45
rfolco|ruckif taiga.service != 'paid':13:46
rfolco|ruck        sleep(500)13:46
taigathe delay in response on the pages is wanted. It's there to give you time to relax13:46
rlandyor to boil my blood13:47
chandankumarweshay: arxcruz kopecmartin https://github.com/redhat-openstack/infrared/tree/master/plugins/collect-logs13:48
rlandymarios: question on https://review.opendev.org/#/c/655661/7/zuul.d/standalone-jobs.yaml ... line 9413:54
mariosrlandy: yup13:54
rlandymarios: hmmm ...I see this line used elsewhere ( in standalone scenarios) ...13:55
rlandywhat is the exact intent?13:56
rlandythat this job should run on master plus and branch after rocky?13:56
rlandyany13:56
*** taiga has quit IRC13:56
mariosrlandy: we'd have standalone-upgrade-stein running on changes to master yah . but not rocky13:56
mariosrlandy: its master and stein only13:56
rlandymarios: so going forward, this will resolve to master, stein, train ...13:57
mariosrlandy: ah i guess you meant "any branch after rocky" not and branch13:57
rlandy^^ correct?13:57
mariosrlandy: yeah i mean we can revisit by train13:57
rlandymarios: well, let's get it right now13:57
rlandyif we can13:57
rlandyif this job is stein and master only, let's be specific13:58
rlandywe miss stuff when we mass release change13:58
mariosrlandy: sure, but would you settle for a follow up patch . i mean there is no such thing as stable/train13:58
mariosrlandy: cos that is currently +2A and zuul is doing its thing13:58
rlandymarios: ack - I'll comment and approve then13:58
* rlandy does not mess when lord zuul is happy13:59
mariosrlandy: thanks, lets leave the task https://tree.taiga.io/project/tripleo-ci-board/task/989?kanban-status=1447276 in ready for review13:59
mariosrlandy: if you comment there i can followup patch what you need13:59
mariosrlandy: sound good?13:59
rlandyfinw13:59
mariosrlandy: thank you13:59
rlandyfine13:59
*** zbr has joined #oooq13:59
rlandyugh - bad typing day13:59
rfolco|ruckweshay, chandankumar give me one min14:00
mariosrlandy: making that job vote gate is time sensitive. something will soon break it so we need to make it voting while it is green14:00
rlandyack14:00
* rlandy just doing QE job and checking14:00
mariosweshay: rlandy: if https://review.opendev.org/655661 doesn't merge i'd be grateful for some recheck in US day today pretty please thank you14:00
rlandysure14:01
rfolco|ruckweshay, chandankumar pre-planning ? https://bluejeans.com/587845809714:02
chandankumarpanda: ^^14:03
rfolco|ruckpanda is with me14:03
rfolco|ruckthere14:03
*** aakarsh has joined #oooq14:04
rlandymarios: ok - when https://review.opendev.org/#/c/655661/ merges, will add a few links with passing and voting stein jobs to the card. Anything else required on the QE side?14:04
mariosrlandy: sounds good to me14:04
mariosrlandy: i think something like this branches: ^(?stable/stein|master)14:07
mariosrlandy: is what you mean? ^14:07
rlandymarios: no rush - I think we should discuss the right thing to do for all the jobs defined like this14:09
rlandymakes an update headache14:09
rlandybut yes, your definition looks correct if we don;t want it to run on train and up14:10
mariosrlandy: added here https://review.opendev.org/#/c/658353/2/zuul.d/standalone-jobs.yaml14:10
mariosrlandy: idea is we merge that once those tempest tests are green (waitin on rocky promote) so piggy backed that change into it14:11
mariosrlandy: oh zuul isn't happy with me14:11
marioschecking14:11
rlandymarios: yep https://review.opendev.org/#/c/658353/ - revert to 114:11
rlandylet's rethink this14:12
mariosrlandy: k14:12
rlandyand not mess with what needs to get done here14:12
rlandymarios: before you checkout, pls leave us a list of patches that need to merge. https://review.opendev.org/#/c/658353/ -  https://review.opendev.org/#/c/655661/ - anything else?14:13
mariosrlandy: no just https://review.opendev.org/#/c/655661/14:13
rlandyfine14:13
mariosrlandy: the other one https://review.opendev.org/#/c/658353/ comes later or next week. whenever it can merge cos we'll be gating once 661 merges14:14
*** dsneddon has joined #oooq14:15
*** amoralej|lunch is now known as amoralej14:17
chandankumarrfolco|ruck: weshay https://wiki.centos.org/About/Building_814:18
rlandypanda: hmmm ... I think your suggestion on https://review.opendev.org/#/c/658358/2/roles/run-test/templates/toci_gate_test.sh.j2 is actually needed. $TRIPLEO_ROOT includes openstack apparently14:18
rlandystill not picking up browbeat changes14:19
*** dsneddon has quit IRC14:20
pandarlandy: yes, I imagined there would be more exception to the names14:21
rlandypanda: fixing14:21
rlandy2019-05-09 21:46:01.782603 | primary | +(/home/zuul/src/opendev.org/openstack/tripleo-ci/toci_gate_test.sh:152): [[ -d /home/zuul/src/opendev.org/openstack/browbeat ]]14:22
rlandy^^ never gets corrected14:22
*** quiquell is now known as quiquell|off14:37
rlandypanda: trying https://review.opendev.org/#/c/658358/3/roles/run-test/templates/toci_gate_test.sh.j214:39
pandarlandy: good.14:40
rfolco|ruckrlandy, is there any networking routing config to allow my rdo instance to reach my beaker box ?14:41
rlandyrfolco|ruck: hmmm .. the rdo instance is public and your beaker box internal14:42
rlandyyou can try what we do internally - add a known key and ssh14:42
rlandymy guess is - it won't resolve14:42
rlandyyou would need access to a non-routable 10. network14:43
rfolco|ruckrlandy, it does not reach network 1014:43
rlandynon-addressable14:43
rlandycorrect14:43
rlandyor dns - which would have to resolve internally14:44
rlandyso unless you can install vpn-type config on that instance14:44
*** Vorrtex has joined #oooq14:44
pandarfolco|ruck: you can open a revere ssh tunnel with port forwarding.14:44
*** Goneri has quit IRC14:44
rlandyrevere? reverse14:45
rfolco|rucksevere14:45
rfolco|ruck:)14:45
rfolco|ruckshort hostname is a host somewhere in akamai14:46
rfolco|ruck$ ping rdo-ci-fx2-02-s514:46
rfolco|ruckPING rdo-ci-fx2-02-s5.rdocloud (23.202.231.167) 56(84) bytes of data.14:46
rfolco|ruck64 bytes from a23-202-231-167.deploy.static.akamaitechnologies.com (23.202.231.167): icmp_seq=1 ttl=48 time=64.9 ms14:46
rlandyrfolco|ruck: you'd do better to take an instance from the internal tenant on upshift14:47
weshayrfolco|ruck what are you trying to do?14:48
rfolco|ruckweshay, just using a rdo instance to reproduce the quickstart install-deps bug, and virthost is a beaker box14:48
rlandywhy do you need an rdo instance?14:49
rfolco|ruckweshay, rdo - beaker --> public 38 - internal 10 nets14:49
*** jaosorior has quit IRC14:49
weshayrfolco|ruck you are communicating nothing there14:49
weshaywhat are you trying to build, or setup14:49
weshay?14:49
rlandyrfolco|ruck: why can't you ssh directly to beaker box from your laptop?14:50
rfolco|ruckweshay, nm... will run from my laptop as rlandy says14:50
weshayrfolco|ruck jump on my blue14:51
rlandyrfolco|ruck: or of you need an instance, I promise internal upshift doesn't bite14:51
rfolco|ruckweshay, the intent was to reproduce exactly as the bug reported14:51
rfolco|ruckweshay, run deployer (quickstart) from a centos vm14:51
rfolco|ruckwith clean centos14:52
mariosrfolco|ruck: consider using the new script14:55
mariosrfolco|ruck: if you are using a fresh box14:55
mariosrfolco|ruck: ugh didn't merge yet https://review.opendev.org/#/c/657779/14:56
mariosrfolco|ruck: but you can get it     curl -o reproducer-fresh-box-setup.sh http://logs.openstack.org/79/657779/2/check/tripleo-ci-centos-7-containers-multinode/67d8eb6/logs/reproducer-quickstart/reproducer-fresh-box-setup.sh14:56
mariosrfolco|ruck: see readme http://logs.openstack.org/79/657779/3/check/tripleo-ci-centos-7-standalone/b81ab77/logs/README-reproducer.html14:56
rfolco|ruckmarios, ack15:04
*** ykarel is now known as ykarel|away15:11
*** holser_ has quit IRC15:13
*** holser_ has joined #oooq15:14
* marios shutdown sequence 15:15
rlandymarios: :( gate failure15:15
rlandymarios: will recheck15:16
mariosrlandy: ack :(15:16
mariosrlandy: thank you15:16
rlandymario: np - have a good weekend15:16
mariosyou too rlandy15:16
*** ykarel|away has quit IRC15:19
rfolco|ruckweshay, qs requirement is minimal install / basic functionality ?15:21
rfolco|ruckshould be*?15:22
rlandybrb15:24
*** rlandy is now known as rlandy|brb15:24
weshayrfolco|ruck I think centos/rhel the install options are minimal, then base, then custom, then full15:29
weshayit's just the set of rpms15:29
rfolco|rucknope15:29
weshayyou want something something that does not provide some of the missing rpms15:29
weshaynope what?15:30
rfolco|ruckdefault is minimal install15:30
weshayrfolco|ruck blue15:30
rfolco|ruckyou can choose compute node, infra server, dev server, etc15:30
weshaygot to advanced15:30
*** dsneddon has joined #oooq15:47
*** ykarel|away has joined #oooq15:49
*** brault has quit IRC15:52
*** rlandy|brb is now known as rlandy15:53
*** dsneddon has quit IRC16:00
*** dsneddon has joined #oooq16:01
chandankumararxcruz: weshay rfolco|ruck kopecmartin I will drop an email related tempest issues tomorrow so that tempest  team can take a look16:01
*** marios has quit IRC16:02
chandankumartime to logout, see ya next to next week16:02
chandankumarHappy weekend team!16:02
*** chandankumar is now known as raukadah16:02
*** udesale has quit IRC16:12
*** udesale has joined #oooq16:12
*** brault has joined #oooq16:15
*** bogdando has quit IRC16:20
*** brault has quit IRC16:20
rlandylol - I just got an to a fire drill ... I don;t work in an office16:39
*** jfrancoa has quit IRC16:40
weshaylolz16:40
*** udesale has quit IRC16:49
*** kopecmartin is now known as kopecmartin|off17:04
*** jpena is now known as jpena|off17:06
*** holser_ has quit IRC17:33
*** Goneri has joined #oooq17:50
rlandyweshay: hello there ... what's your take on this ... the baremetal baseos - when the images are fetched ( not built) repo setup fails ( which is why the dir are not on the overcloud) ...18:15
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/15/165815/46/check/periodic-tripleo-ci-centos-7-bm_envD-3ctlr_1comp-featureset001-master/0be0dc9/logs/undercloud/home/zuul/repo_setup.sh.1557439168.log.txt.gz#_2019-05-09_21_59_4918:16
rlandy rdo_dlrn= and tripleo_dlrn=18:16
rlandy are both empty18:16
rlandybut those urls do resolve18:16
rlandycurl --silent https://trunk.rdoproject.org/centos7-master/ec/cd/eccdf5f81d211684cc9717c0c7c2bc527127a0ea_c6b6b114/delorean.repo -S 2>>~/dlrn_repo_curl_errors.log | grep baseurl | cut -d= -f218:16
rlandyhttps://trunk.rdoproject.org/centos7/ec/cd/eccdf5f81d211684cc9717c0c7c2bc527127a0ea_c6b6b11418:16
rlandy^^ what am I missing??18:17
*** hamzy_ has quit IRC18:17
rlandyand it's here ... https://sf.hosted.upshift.rdu2.redhat.com/logs/15/165815/46/check/periodic-tripleo-ci-centos-7-bm_envD-3ctlr_1comp-featureset001-master/0be0dc9/logs/undercloud/etc/yum.repos.d/delorean-current.repo.txt.gz18:22
*** hamzy has joined #oooq18:24
rfolco|ruckweshay, https://review.opendev.org/#/c/658449/118:27
rfolco|ruckweshay, made a little improvement18:27
rfolco|ruckweshay, sudo -v check will warn user about sudoers.d :)18:28
rlandywhat, there was a puppy booth at RH summit?? weshay, I need to go next year, pls.18:40
*** amoralej is now known as amoralej|off19:00
*** ykarel|away has quit IRC19:04
*** dsneddon has quit IRC19:05
*** tesseract has quit IRC19:12
*** dsneddon has joined #oooq19:17
weshayhey19:19
rlandyweshay: hello19:21
weshayrfolco|ruck something is amiss http://logs.openstack.org/49/658449/1/check/tripleo-ci-centos-7-undercloud-containers/ed65f92/job-output.txt.gz#_2019-05-10_18_40_08_58496219:22
rfolco|ruckweshay, :(19:22
weshayrlandy /me looks19:22
rfolco|ruckweshay, will check19:22
weshaysorry I was gone, I go out to lunch w/ my dad on fridays19:23
rlandynp - dad is important19:23
rfolco|ruckweshay, just got successful deploy on zuul-runner \o/19:23
rfolco|ruckarxcruz, fyi ^19:23
weshaynice19:23
weshayrlandy I hate that curl | cut command19:24
rlandyweshay: it works though19:24
rlandyeven on the box itself (overcloud)19:24
rlandyI tested it19:24
rlandyin case dns was not resolving19:24
weshayrlandy ya.. I just did as well.. it's just flaky19:24
weshaythat only run w/ repo-setup role.. I wonder if we could do that w/ ansible to have a retry.. get the hash then pass off the variable19:25
weshaybecause this happens more than we'd like19:25
weshayrlandy so has that failed more than once in a row?19:25
rlandyweshay: yep - that's a reproducible failure on this job19:25
rlandysame error I showed you when we did the review19:26
rlandyand you can see the hash resolve fail19:26
rlandyyet19:26
rlandyyet19:26
rlandyit works great manually19:26
weshay curl --silent https://trunk.rdoproject.org/centos7-master/58/f8/58f81b1cad691520ce6f1968f156f7720041c280_0129a5fa/delorean.repo -S | grep baseurl | cut -d= -f219:27
weshayaye19:27
rlandyweshay: my only thought is that dns is setup after the repos19:27
weshayoh.. hrm19:27
rlandyso they don't resolve at first19:27
weshayrlandy it's silly not to setup dns first19:28
weshayany reason why we can't change that19:28
rlandyother than the fact that that setup is done in the overcloud deploy and we inject the repos to the image?19:28
rlandybut I may be pulling at straws here19:29
weshayI have to reframe back to baseos19:29
weshayI wonder if it would help me if I tried a regular qs w/ baseos19:30
rlandyand ... on the upside, marios's job is back in the gate19:30
weshayya19:30
rlandyweshay: well, let's consider the use case ,...19:30
rlandycurrently, in theory, bm only runs periodic19:30
rlandyback to this ...19:32
rlandyso ***if *** baremetal ONLY runs in periodic ...19:33
rlandyAND19:33
rlandyperiodic always build images , we are ok19:33
rlandythe problem is only when we GET the baseos images19:33
rlandyso ....19:33
rlandyif the job is not periodic, then we don't go baseos19:34
rlandyweshay: ^^ how about that?19:34
rlandybaseos ONLY on periodic19:34
weshayso.. blue w/ me for a sec.. it's difficult to get back into that context19:35
weshaymaybe because it's friday19:35
weshayactually let me look at the logs for a bit19:35
rlandyokie dokie19:36
weshayrlandy https://sf.hosted.upshift.rdu2.redhat.com/logs/15/165815/46/check/periodic-tripleo-ci-centos-7-bm_envD-3ctlr_1comp-featureset001-master/0be0dc9/job-output.txt.gz#_2019-05-09_22_02_02_00564119:36
weshayso repo setup had to have worked there19:37
rlandyon bj19:37
rlandyI think it failed19:37
rlandybut didn't fail the step19:38
rlandylook at the log19:38
*** ksambor has quit IRC19:50
weshayrlandy https://hairycode.org/tag/ansible/19:56
weshay rsync_opts: -e 'ssh -F "{{ base_dir }}"/khaleesi/ssh.config.ansible'19:57
*** ccamacho has quit IRC20:32
*** Vorrtex has quit IRC21:09
*** rfolco|ruck has quit IRC21:11
rlandyfinally!!!!21:20
rlandycopied browbeat21:20
rlandyweshay++21:20
rlandythank you21:20
weshayrlandy nice21:20
rlandyweshay: marios patch is in ... https://review.opendev.org/#/c/655661/22:05
*** rlandy has quit IRC23:06
*** sanjayu__ has joined #oooq23:09
*** vinaykns has quit IRC23:42
*** rfolco|ruck has joined #oooq23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!