Friday, 2020-01-10

*** chem has quit IRC00:09
*** chem has joined #oooq00:11
*** holser has joined #oooq00:14
*** holser has quit IRC00:35
*** ysandeep has joined #oooq01:03
*** zbr|rover has quit IRC01:11
*** zbr has joined #oooq01:19
*** zbr has quit IRC01:24
*** zbr has joined #oooq01:25
*** zbr_ has joined #oooq02:15
*** zbr has quit IRC02:16
*** zbr_ has quit IRC02:17
*** zbr has joined #oooq02:28
*** saneax has quit IRC02:29
*** rlandy has quit IRC02:55
*** apetrich has quit IRC03:12
*** ykarel|away has joined #oooq04:22
*** saneax has joined #oooq04:34
*** bhagyashris has joined #oooq04:44
*** surpatil has joined #oooq05:00
*** ratailor has joined #oooq05:06
*** bhagyashris has quit IRC05:07
*** skramaja has joined #oooq05:12
*** ykarel has joined #oooq05:18
*** bhagyashris has joined #oooq05:19
*** ykarel|away has quit IRC05:20
*** ykarel_ has joined #oooq05:35
*** ykarel has quit IRC05:38
*** ratailor_ has joined #oooq05:44
*** ratailor has quit IRC05:47
*** holser has joined #oooq05:47
*** holser has quit IRC06:11
*** marios has joined #oooq06:16
*** akahat has joined #oooq06:40
*** jfrancoa has joined #oooq06:49
*** ykarel_ is now known as ykarel07:03
*** soniya29 has joined #oooq07:10
*** bhagyashris has quit IRC07:17
*** bhagyashris has joined #oooq07:17
*** raukadah is now known as chandankumar07:32
*** holser has joined #oooq07:35
*** bogdando has joined #oooq07:42
*** ykarel is now known as ykarel|lunch07:57
*** jtomasek has joined #oooq08:09
*** tosky has joined #oooq08:12
*** tesseract has joined #oooq08:22
*** ratailor_ has quit IRC08:26
*** amoralej|off is now known as amoralej08:37
*** jbadiapa has joined #oooq08:43
*** ratailor has joined #oooq08:47
*** bogdando has quit IRC08:51
*** bogdando_ has joined #oooq08:51
*** bogdando_ is now known as bogdando08:53
*** jpena|off is now known as jpena08:54
*** marios has quit IRC09:00
*** marios has joined #oooq09:00
*** ykarel|lunch is now known as ykarel09:04
marioszbr: aware of any issue with periodics? like http://logs.rdoproject.org/39/24339/3/check/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-master/fef9a07/job-output.txt "TASK [build-test-packages : Map project name to DLRN project name] *************"09:13
marioszbr: are you rover? i thought you were sorry if not09:13
soniya29arxcruz, kopecmartin: Can you have a look over this patch:-https://review.opendev.org/#/c/699275/?09:19
chandankumarmarios, I am seeing the same error in another review09:19
*** zbr is now known as zbr|rover09:19
marioschandankumar: ack thanks09:19
zbr|rovermarios: o/ looking now.09:19
marioschandankumar: in all 3 of those https://review.rdoproject.org/r/2433909:20
marioszbr|rover: thanks looks like it's a real thing09:20
marioszbr|rover: but must be from this morning... the openstack-periodic-master from midnight this morning has green https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master09:20
chandankumarmarios, coming after this review https://review.opendev.org/#/c/701117/09:21
marioschandankumar: ack thanks zbr|rover fyi ^^^ you can blame that person ;)09:21
chandankumarnot this one09:22
marioschandankumar: but can we still blame zbr|rover anyway?09:22
marios:/09:22
chandankumarmarios, https://review.opendev.org/#/c/701116/09:22
chandankumarmarios, he is the culprit09:22
marioschandankumar: yeah but that was 2 days ago ^09:23
chandankumarmarios, https://review.opendev.org/#/c/701116/4/roles/build-test-packages/tasks/dlrn-build.yml09:23
marioschandankumar: don't see  aproblem with that though09:23
chandankumarmarios, http://logs.rdoproject.org/47/24447/1/check/periodic-tripleo-ci-centos-7-standalone-master/c821529/job-output.txt09:24
marioschandankumar: so you suspect the pipefail causes the rc1 there?09:25
chandankumarmarios, yes09:25
marioschandankumar: k well as long as we can blame zbr|rover i don't mind09:25
marios;)09:25
mariosrfolco: sshnaidm: i updated that thanks for checking https://review.rdoproject.org/r/#/c/24432/2/zuul.d/tripleoci.yaml please have a look when you get another chance thanks09:25
mariosreviews please for the job definition ^^^ if folks have reviews time09:26
zbr|rovermarios: nice spot! .... now i am afraid to use git blame on line:     export PROJECT_NAME=$(echo {{ artg_change.project }} | sed "s|openstack/||");09:26
marioszbr|rover: chandankumar: is the spotter09:27
zbr|roversomeone is clearly afraid of jinja2 filters09:27
kopecmartinzbr|rover: I added a molecule test for collect-logs and infrared, when you have a moment, can you have a look? https://review.opendev.org/#/c/682042/09:28
zbr|roveri will but i need to raise a patch for the bug ^ first.09:28
*** apetrich has joined #oooq09:28
*** derekh has joined #oooq09:35
arxcruzsoniya29: left comments09:42
soniya29arxcruz: I will check09:42
*** ratailor_ has joined #oooq09:44
*** ratailor has quit IRC09:46
*** soniya29 has quit IRC09:49
*** soniya29 has joined #oooq09:52
chandankumarsoniya29, surpatil arxcruz kopecmartin tempest meeting colliding with other meeting, can I move one hour earlier?09:53
soniya29arxcruz: How should I trigger fs20 job for stein?09:53
soniya29chandankumar, sure09:53
arxcruzchandankumar: no09:53
arxcruzchandankumar: lol, just kidding, i think it's okay09:53
zbr|rovermy impression was that build-test-packages had a molecule scenario,... probably in my dreams.09:53
zbr|roverhttps://review.opendev.org/#/c/701918/09:54
surpatilok09:54
arxcruzsoniya29: https://review.rdoproject.org/r/#/c/24321/8/zuul.d/projects.yaml an example09:54
chandankumarzbr|rover, long term goal is to retire that role and replace it with something else09:54
*** ysandeep has quit IRC09:56
*** apetrich has quit IRC10:04
*** dtantsur|afk is now known as dtantsur10:05
soniya29arxcruz: I think you mean this https://review.rdoproject.org/r/#/c/24454/?10:09
*** ykarel is now known as ykarel|afk10:11
*** apetrich has joined #oooq10:13
zbr|roverkopecmartin: nice work on collect, i just made a fix to it (html report was not working, not your fault but needed).10:15
kopecmartinzbr|rover: great, thanks10:17
zbr|roverkopecmartin: i do still have some questions, what the link between sove scenario and testing of use of role as infrared plugin?10:23
zbr|roveri would have expected adding a "infrared" scenario that run that test without even running the role itself10:24
zbr|roveram i wrong to say that your test is only testing that infrared can recognize the role, right? w/o using infrared to execute it.10:25
arxcruzsoniya29: something like that yes10:26
*** sanjayu_ has joined #oooq10:26
*** saneax has quit IRC10:26
soniya29arxcruz: okay10:27
kopecmartinzbr|rover: yes, that's correct, it tests that the role can be successfully installed using infrared as infrared plugin10:28
zbr|roverkopecmartin: let me help you doing the split. ok to update role now?10:28
kopecmartinzbr|rover: sure10:28
kopecmartini'm not sure what you meant by infrared scenario10:29
zbr|rovera new molecule scenario named infrared10:29
zbr|rovernow there is only one called sova, but there is nothing sova about your test.10:29
*** sanjayu_ has quit IRC10:30
kopecmartinoh, i see10:31
*** soniya29 has quit IRC10:32
*** ratailor__ has joined #oooq10:32
*** ratailor_ has quit IRC10:35
*** ykarel|afk is now known as ykarel10:35
kopecmartinzbr|rover: split playbook.yaml is one thing, do i also need to copy all other files molecule/sova/ to molecule/infrared?10:40
zbr|roverkopecmartin: almost done...10:41
zbr|rovermarios: done, updated. test it running `pytest -k infrared` (after installing pytest-molecule) and you will see.10:45
zbr|roveri also split the code in two: plugin installation in playbook.yml and verification in verify.yml file.10:46
marioszbr|rover: which bit?10:46
marios(maybe was for kopecmartin ?)10:47
zbr|rovermarios: ahh, right sorry.10:47
mariosnp10:47
zbr|rovermarios: but if you are curious, it would be a good idea to look at https://review.opendev.org/#/c/682042/10:48
marioszbr|rover: sure but not right now middle sthing10:48
kopecmartinzbr|rover: it looks much better now10:51
zbr|roverout for ~1h, GP appt11:00
*** soniya29 has joined #oooq11:15
*** akahat has quit IRC11:18
chandankumararxcruz, kopecmartin soniya29 surpatil added agenda here https://hackmd.io/fIOKlEBHQfeTZjZmrUaEYQ?both feel free to add/remove it11:27
*** bhagyashris has quit IRC11:39
zbr|roveri am back11:39
kopecmartinzbr|rover: i noticed, when i run 'tox -emolecule' multiple times, it fails, because the plugin is already installed, the infrared venv persists, where would be the best to implement a cleaning task? should i remove just the plugin or the entire infrared venv?11:41
chandankumarzbr|rover, which one is good fix https://review.opendev.org/#/c/701742/ or https://review.opendev.org/#/c/701921/ ?11:43
*** sshnaidm is now known as sshnaidm|off11:52
*** jpena is now known as jpena|lunch12:01
arxcruzchandankumar: weshay|ruck waiting you guys12:02
chandankumararxcruz, kopecmartin https://review.rdoproject.org/r/#/c/24103/12:08
*** ysandeep has joined #oooq12:09
chandankumararxcruz, kopecmartin https://review.rdoproject.org/r/#/c/24394/3/ci-scripts/infra-setup/roles/rrcockpit/files/mariadb/test_tempest_file_downloader.py12:11
chandankumararxcruz, http://logs.rdoproject.org/41/701341/4/openstack-check/tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-queens/e9e399e/logs/tempest.html.gz12:15
*** ykarel is now known as ykarel|afk12:20
pandamarios: fixed the promoter tests https://review.rdoproject.org/r/24455. Next PS fixes linters and unit12:21
mariospanda: nice :D12:22
chandankumararxcruz, kopecmartin https://bugs.launchpad.net/tempest/+bug/1713163/comments/512:22
openstackLaunchpad bug 1713163 in tempest "test_delete_saving_image fails because image hasn't transitioned to SAVING" [Medium,Confirmed]12:22
*** soniya29 has quit IRC12:30
zbr|roverkopecmartin: i would try to make the testing bit more idempotent and it it does not work i would include a cleanup task inside the playbook.12:32
zbr|roverin the end, you should *not* use disablement of idempotency.12:32
*** surpatil has quit IRC12:34
*** ykarel|afk is now known as ykarel12:36
*** ratailor__ has quit IRC12:41
*** ysandeep has quit IRC12:46
weshay|ruckzbr|rover, can you review this please https://review.opendev.org/#/c/701742/  https://review.opendev.org/#/c/701921/12:57
*** jpena|lunch is now known as jpena12:57
marioszbr|rover: this isn't just rhel8 https://bugs.launchpad.net/tripleo/+bug/185889013:01
openstackLaunchpad bug 1858890 in tripleo "rhel8 3rd party jobs failing on build-test-packages, virtenv activation PS1 unbound variable" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea)13:01
marioszbr|rover: e.g. there too https://review.rdoproject.org/r/#/c/24339/13:01
*** ykarel is now known as ykarel|afk13:03
marioszbr|rover: can we consider reverting the 306 rule https://bugs.launchpad.net/tripleo/+bug/1858890/comments/3 until the issue is resolved?13:06
openstackLaunchpad bug 1858890 in tripleo "rhel8 3rd party jobs failing on build-test-packages, virtenv activation PS1 unbound variable" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea)13:06
zbr|rovermarios: no need, i updated https://review.opendev.org/#/c/701742/13:07
marioszbr|rover: ok great... i was just looking at current master run. how is that green then?13:07
* marios confused 13:07
marioszbr|rover: all 3 jobs hit that in https://review.rdoproject.org/r/#/c/24339/13:07
zbr|rovermarios: look at the original sed line.13:08
* marios needs sugar going sweet hunting brb13:09
weshay|ruckarxcruz, oh fak13:09
weshay|ruckarxcruz, sorry I missed that13:09
*** ykarel|afk is now known as ykarel|away13:09
weshay|ruck$tired13:09
zbr|rover... and all this because we did not had tests.13:12
ykarel|awayweshay|ruck, zbr|rover is the issue with full tempest master jobs known?13:13
weshay|ruckwhich release?13:13
ykarel|awayweshay|ruck, msate13:14
weshay|ruckah master13:14
ykarel|awaymaster13:14
weshay|rucksorry.. reading is fundemental13:14
weshay|ruckykarel|away, master is blocked anyway13:14
ykarel|awayweshay|ruck, with what?13:15
weshay|ruckykarel|away, https://trello.com/c/KFDHW4lF/1286-cixlp1858662tripleociproa-cleaning-up-ovnmeta-namespace-fails-unexpected-exception-in-notifyloop13:15
ykarel|awayme looks13:16
ykarel|awayweshay|ruck, ack but ^^ should be unblocked with skip list patch merged, no?13:17
ykarel|awayhttps://review.opendev.org/70140313:17
marioszbr|rover: i see... so cos it was testproject is why it failed13:17
weshay|ruckykarel|away, hell no.. look at all the failing tests there13:18
weshay|ruckykarel|away, was a big one13:18
zbr|roveri wonder if fressi is on irc, i was to able to find him13:20
zbr|rovermarios: weshay|ruck chandankumar : re map-dlnr, i would workflow https://review.opendev.org/#/c/701742 right now, not avoid having it to wait.13:21
marioszbr|rover: ack i am testing it there https://review.rdoproject.org/r/#/c/24339/ just updated13:21
*** rlandy has joined #oooq13:22
arxcruzweshay|ruck: are we going to have our 1-1 now?13:30
weshay|ruckarxcruz, https://meet.google.com/snn-kgdw-vtq?authuser=113:31
ykarel|awayweshay|ruck, ack got it13:31
ykarel|awaybut current issue looks different13:31
ykarel|awayweshay|ruck, i checked last run https://trunk.rdoproject.org/api-centos-master-uc/api/civotes_detail.html?commit_hash=772f57613421a77c2ed1a81f0abe55add41e794e&distro_hash=6db41c91f55d845217379c471a1728e9fa340f8b13:31
weshay|ruckykarel|away, yes.. but I need the first issue fixed13:31
ykarel|awaycurrent one is AttributeError: 'NoneType' object has no attribute 'open_session'13:32
ykarel|awaypossibly looks related to tempest patch13:32
weshay|ruckarxcruz, audio issue?13:32
arxcruzweshay|ruck: yes, sec13:32
arxcruzweshay|ruck: restarting brb13:34
chandankumarweshay|ruck, rlandy marios https://review.opendev.org/#/c/701959/13:37
*** Goneri has joined #oooq13:39
chandankumarzbr|rover, https://review.opendev.org/#/c/701742/13:45
chandankumarzbr|rover, it is not working13:45
marioschandankumar: ack (sorry replied in rdo by mistake)13:46
chandankumarmarios, noproblem13:46
pandamarios: everything passing now on 2445513:48
marioszbr|rover: still fails :/ @ http://logs.rdoproject.org/39/24339/4/check/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-master/91fd840/job-output.txt (https://review.rdoproject.org/r/#/c/24339/13:49
zbr|rovermarios: not my fault that it does not find testproject there.13:50
zbr|roverhttp://logs.rdoproject.org/39/24339/4/check/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-master/91fd840/job-output.json13:51
zbr|rovertestproject is not found, so it fails, which should have being the expected outcome.13:52
marioszbr|rover: yes but not fail the job13:52
marioszbr|rover: so we should remove -e too?13:53
zbr|roverno, put a || true if you want but -e must be there.13:53
zbr|roverwe should be more careful on how we write bash code13:54
zbr|roverin fact -e is implicit on ansible, what causes the failure is the pipefail addition.13:54
zbr|roverbut that should also be a default.13:54
zbr|roverif we expect that to fail to find, we need to put a clear code there.13:55
mariospanda: thanks \o/ voted14:02
*** skramaja has quit IRC14:05
pandamarios: thanks, merging, reviewing the criteria again now.14:06
mariospanda: monday it is ;) weshay|ruck zbr|rover we want to move to the new code on monday for promoter please?14:06
*** amoralej is now known as amoralej|lunch14:08
zbr|roverpanda: glad to hear you do not want to do it today.14:10
pandazbr|rover: I disagree with marios, friday evening is absolutely the best time to put distruptive change into production14:10
mariospanda: damn you've convinced me14:11
mariosk lets go14:11
pandaI love the smell of napalm on monday mornings14:11
* marios logs in to promoter14:11
* marios brings cat into room 14:11
* marios goes to make coffee14:11
zbr|rovermarios: here is an alternative to mapping code that should not fail: https://review.opendev.org/#/c/701967/ -- new PR to avoid messing the old one.14:12
zbr|roverblock, in rescue print warning, at end assure we have a defined artg_rdo_packages array.14:13
marioszbr|rover: the block helps?14:13
marioszbr|rover: ah /me scrolls down for the rescue14:13
zbr|rovermainly avoiding the tests around project_name_mapped14:14
marioszbr|rover: hmm not sure about the catchall rescue though :/ what if anythign else has failed in there14:15
zbr|rovermarios: so mainly you want to fail role if tasks after "Append project name to package list" fail? --- looking now for solution to this.14:17
marioszbr|rover: well no i mean anything could fail in there is what i mean... maybe you just need to tweak the debug message14:18
marioszbr|rover: like git could fail14:18
*** dtantsur is now known as dtantsur|brb14:27
*** bogdando has quit IRC14:35
*** TrevorV has joined #oooq14:37
chandankumarrlandy, https://review.rdoproject.org/r/#/c/24456/ needs +w14:37
rlandychandankumar: done14:38
weshay|ruckarxcruz, re: our 1-1.. and component pipeline.. rfolco did a nice job here https://hackmd.io/5uYRmLaOTI2raTbHWsaiSQ?both14:41
chandankumarrlandy, thanks!14:41
rfolcoweshay|ruck, he is my first client14:41
rfolcoI showed him :)14:41
arxcruzweshay|ruck: yeah :D14:41
rfolcoarxcruz is a gold member of hackmd, he holds a rewards program and etc14:42
arxcruzlol14:43
pandamarios: weshay|ruck rereviewed divergences: https://review.rdoproject.org/r/24196, should be ready to go after tests pass.14:44
rlandychandankumar: so you wanted to know about the tls stuff?14:48
chandankumarrlandy, may be monday would be a good time, I need to get this fix https://review.rdoproject.org/r/2445314:49
rlandyok14:50
chandankumarrlandy, I will poke you after monday scrum14:50
* rlandy waits to be poked14:50
chandankumarhehe14:50
marioschandankumar: man i thought you were already ci core14:52
*** ykarel|away is now known as ykarel14:53
mariospanda: ack thanks14:54
mariospanda: and zuul just voted +114:55
chandankumarmarios, :-)14:55
marioschandankumar: looks like that works as temp for now fyi (deploying overcloud so passed that error) https://review.opendev.org/#/c/701968/14:59
chandankumarmarios, want to make it permanent and unblock ci?15:00
marioschandankumar: no we cannot it is required for linting apparently15:00
marioszbr|rover: chandankumar: is being blasphemous fyi ^^^15:00
marioschandankumar: but yeah seriously we might have to revert that pipefail rule 306 if we don't have a better way15:01
chandankumarmarios, I just wanted to see how new podman is behanving15:01
marioschandankumar: but zbr|rover proposed https://review.opendev.org/#/c/701967/115:01
chandankumarmarios, that patch is a big chunk, hard to revert15:01
marioschandankumar: yeah forgot zbr|rover propsed that should work too but didn't test it ^15:02
*** amoralej|lunch is now known as amoralej15:02
chandankumarmarios, zbr|rover can we consolidate on that, lots of code review floating15:02
chandankumari think 2 or 315:03
chandankumarmarios, zbr|rover may be perfect tmate time15:03
marioschandankumar: well you can ignore my one anyway ;)15:03
marioschandankumar: it is just so i can run the tesproject review15:03
ykarelweshay|ruck, i filed https://bugs.launchpad.net/tripleo/+bug/1859187 for the tests i mentioned earlier https://bugs.launchpad.net/tripleo/+bug/185918715:03
openstackLaunchpad bug 1859187 in tripleo "Some neutron-plugin-tests in full-tempest job failing with AttributeError: 'NoneType' object has no attribute 'open_session'" [Undecided,New]15:03
chandankumarthat's why 2 and including yours 315:03
ykarelwith possible cause and solution15:03
marioschandankumar: so don't include mine ;)15:04
marioszbr|rover: i see fressi replied to your review so he's around maybe you can abandon it and move the changes to his one?15:04
marioschandankumar: ^ there now you have one ;)15:04
chandankumarmarios, which one is good ?15:05
marioschandankumar: i think the original one15:05
marioschandankumar: but it needs updating from zbr|rover patch15:05
chandankumarplease update that then:-)15:05
weshay|ruckthanks ykarel15:06
mariosany more votes there please? https://review.rdoproject.org/r/#/c/24432/ weshay|ruck rfolco rlandy chandankumar zbr|rover when you get a chance please. we need to merge the dfinitions so we can start running these next week and see what breaks15:09
weshay|ruckk.. sec15:10
chandankumarmarios, where is nodes defined/15:11
chandankumar?15:11
marioschandankumar: in the rdo-jobs nodesets15:12
marioschandankumar: that what you mean? or somethign else? maybe comment ont he review its easier to be specific please15:12
marioschandankumar: ?15:15
rlandymarios: do you need to define    host-vars:15:15
rlandy      primary:15:15
rlandy        ansible_python_interpreter: /usr/bin/python315:15
rlandy      localhost:15:15
rlandy        ansible_python_interpreter: /usr/bin/python315:15
mariosrlandy: i had it on v1 but removed on comments15:15
rlandydoes centos-8 deal with that?15:15
*** jtomasek has quit IRC15:16
mariosrlandy: well the comments are not conclusive i have to say see https://review.rdoproject.org/r/#/c/24432/1..3/zuul.d/tripleoci.yaml15:16
chandankumarmarios, now check15:16
marioschandankumar: but i'm overriding the nodeset is that not enough?15:17
marioschandankumar:     nodeset: single-centos-8-node15:17
chandankumaroh sorry missed that15:17
rlandymarios: well if your jobs doesn;t start, you will need those lines15:17
marioschandankumar: np i thought that's what you meant with 17:11 < chandankumar> marios, where is nodes defined/15:18
rlandysupposedly tristan added something to the nodes to help with the situation15:18
mariosrlandy: ack yea i've had that problem in my life before ;)15:18
mariosrlandy: thanks, we can just add them15:18
mariosrlandy: i mean this shouldn't affect anything its just new job definitions that we are not wiring up15:18
pandamarios: weshay|ruck thanks, merging. We should be ready for monday.15:19
rlandymarios: ok - I'll w+ it15:20
mariospanda: i can think of NOTHING better I'd rather be looking forward to !15:20
marios;)15:20
mariosthanks rlandy15:20
rlandy if the job fails to start, we will know why15:20
mariosthanks chandankumar rlandy rfolco sshnaidm|off for reviews15:20
rlandymarios; that's a hard error to debug15:20
rlandyI've been in that hole before15:21
mariosrlandy: yeah i think the first time i spent a few days spinnign on that thing when we first began rhel8 stuffs15:21
rlandymarios: k - so now you can test project it15:21
rlandyor add to rdo-jobs15:21
rlandyand see if your job starts15:21
mariosrlandy: cool thanks15:22
weshay|ruckpanda, k.. cool.. hey do you have time for a quick sync on the component stuff I emailed you about?15:25
weshay|ruckdid you read / grok?15:25
mariosrlandy: https://review.rdoproject.org/r/#/c/24463/ (fyi ) lets see15:27
rlandymarios: you got something15:28
rlandyso that's good15:28
mariosrlandy: ack thanks train will fail for sure but curious to see how far master goes... :D but yeah it failed really early on that py3 thing so it should be ok15:29
rlandymarios: yeah  supposedly tristan fixed that15:29
rlandybless that man15:30
mariosrlandy: ;)15:30
pandaweshay|ruck: I updated the formatting a bit, but at first usperficial look, I didn't find how the promoter was involved in this. too much content missing. Has the idea to have a promotion as a collection of hashes returned ?15:34
weshay|ruckpanda, if you have 5min.. I can provide the context on the feedback I'm seeking15:37
* weshay|ruck trying to make sure we do this in a way that will have a no or a minimal impact on the promoter code15:38
weshay|ruckpanda, ?15:40
weshay|ruckpanda, this isn't urgent.. other than me trying to get you in context15:41
weshay|ruckto be able to think about it15:41
weshay|ruckyou'll have a few weeks to mull it over15:41
*** jpena is now known as jpena|brb15:45
weshay|ruckmarios++ 24463  will you marry me?15:46
mariosweshay|ruck: sorry taken :/15:46
weshay|ruckMUTHER FUCKER15:46
rfolcolol15:46
mariosweshay|ruck: but don't get too excited i mean not sure how far that will go esp not sure if that is right yet https://review.opendev.org/#/c/701937/15:46
weshay|ruckrfolco,  can you hook up marios w/ a job to do this 2020-01-10 15:45:15.131711 | primary | requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://trunk.rdoproject.org/centos8-master/tripleo-ci-testing/delorean.repo15:47
pandaweshay|ruck: ok, give me a link15:47
weshay|ruckhttps://meet.google.com/mmi-stwb-mxx15:47
rfolcobrb15:48
chandankumarmarios, zbr|rover still not working http://logs.rdoproject.org/53/24453/11/check/tripleo-podman-integration-rhel-8-scenario000-standalone/dd04d66/job-output.txt15:51
chandankumarmarios, zbr|rover "reason": "'msg' is not a valid attribute for a Task15:51
*** rfolco has quit IRC15:52
chandankumarmarios, I think get your temp patch merged, as then fix those stuff, what you think?15:53
marioschandankumar: 17:51 < chandankumar> marios, zbr|rover still not working15:53
marioschandankumar: is that with sorin patch you mean? ^15:53
chandankumarhttps://review.opendev.org/#/c/701742/15:54
chandankumarmarios, ^^15:54
chandankumarmarios, as I using wrong review?15:56
marioschandankumar: no i think that's right... zbr|rover had one out too i think they were going to merge them15:58
marioschandankumar: but ask zbr|rover15:58
chandankumarzbr|rover, you around? need help!15:58
chandankumarmarios, link please?15:58
zbr|rovermarios: what job is testing the dlrn role, i wonder if I can make it trigger directly on the change itself.15:58
chandankumarzbr|rover, I think there is no direct role, the failure is coming only when we put non openstack package project which has no mentions in rdoinfo16:00
*** ykarel is now known as ykarel|away16:01
chandankumarzbr|rover, can we get marios patch merged and fix later?16:01
zbr|rovernot sure which one but could make sense as time is ticking16:02
chandankumarzbr|rover, finding out16:06
chandankumarzbr|rover, https://review.opendev.org/#/c/701968/16:07
chandankumarmarios, ^^16:07
chandankumarzbr|rover, I think the problem lies in the script which passes the commit message16:08
chandankumarsince there is depends on there16:08
chandankumar*parses16:08
*** dtantsur|brb is now known as dtantsur16:08
marioschandankumar: but can we merge that? zbr|rover https://review.opendev.org/#/c/701968/ i though we needed the euo pipefail  for linting?16:08
zbr|roveri getting tired of "testing" the build-test-packages using zuul.16:08
marioschandankumar: zbr|rover: so if we merge that it will caseu lint fails?16:09
marioss/caseu/cause16:09
chandankumarfor example this review https://review.rdoproject.org/r/2444716:09
chandankumaruse noqa,16:09
zbr|roverfunny aspect is that while marios removed the line, linter did not complain, which is really weird.16:10
marioszbr|rover: i was just staring at that thinking 'doesn't linting run first and then fail' ?16:10
zbr|roverbased-on that i am ok to merge it, it should buy us time to write a proper fix16:10
zbr|rovermarios: what is the most basic job I can use to test this role?16:11
marioszbr|rover: not sure about that. chandankumar ok i will remove my -2 and updating the patch now https://review.opendev.org/#/c/70196816:13
*** jpena|brb is now known as jpena16:22
*** rlandy is now known as rlandy|brb16:29
weshay|ruckmarios, fyi.. just had a chat w/ panda.. I'll email you guys over the weekend re: go or no go for the promoter change.. pretty sure we're all go16:30
mariosweshay|ruck: ack16:30
weshay|ruckzbr|rover, fyi ^  monday morning.. ur time.. old promoter going down, new one will be stood up fyi.. I'll email u too16:31
weshay|ruckthanks marios panda zbr|rover16:31
chandankumarweshay|ruck, rlandy|brb https://review.opendev.org/#/c/701968 need to be merged to get ci back on foot16:31
weshay|ruckchandankumar, this patch is also in the mix https://review.opendev.org/#/c/701742/5/roles/build-test-packages/tasks/dlrn-build.yml16:32
weshay|ruckplease review16:32
weshay|ruckchandankumar, hard for me to tell from my local setup whether or not this is working https://review.rdoproject.org/r/#/c/24103/16:33
weshay|ruckchandankumar, should we merge and see the results from a larger data set in production?16:33
chandankumarweshay|ruck, yes, but waiting for arxcruz output16:35
chandankumaronce he acks, we will merge it16:35
weshay|ruckk..16:35
* marios gets ready for weekend mode16:39
* panda tries to imagine marios in weekend mode16:39
pandain its pod, deactivated, recharghing.16:40
mariospanda: can we just skip the weekend and get to monday can't wait to break err fix the promoter16:40
* chandankumar also vanishes16:40
pandamarios: like I said, I love the smell of napalm on monday mornigns16:40
arxcruzchandankumar: sorry, didn't have time to review it today, i'll do on monday and review properly16:40
chandankumarAll good night, have a superb weekend, looking forward to break more on monday16:40
mariospanda: none of that wireless charging mind 18:40 < panda> in its pod, deactivated, recharghing.16:40
*** chandankumar is now known as raukadah16:40
pandamarios: I'll use my time machine16:40
mariospanda: i have jump cables attached16:40
marios12v battery16:41
arxcruzmarios: you already live in paradise... every day seems like weekend for you16:41
pandamarios the angel16:41
marioshaha no arxcruz ;D16:41
raukadahmarios, is mozito still left in freeze?16:41
* marios adjusts wings16:41
mariosraukadah: sorry finished them over new years16:41
mariosraukadah: but that just means16:42
marioswe have to make some more16:42
*** marios is now known as marios|out16:42
raukadahmarios, good, good, bring some for me :-)16:42
raukadahsee ya! Have a nice weekend :-)16:42
pandawhere's folco ?16:43
weshay|ruckzbr|rover, fyi.. can you look into this please https://bugs.launchpad.net/tripleo/+bug/185921316:46
openstackLaunchpad bug 1859213 in tripleo "rocky promotion keeps failing on fs002 images not being present." [High,Triaged] - Assigned to Sorin Sbarnea (ssbarnea)16:46
*** brault has joined #oooq16:52
zbr|roverweshay|ruck: i am still dealing with build-test-packages16:52
weshay|ruckzbr|rover, ack.. in ur time :)16:52
weshay|ruckzbr|rover, the rocky thing is not a big deal to work around16:52
zbr|roverweshay|ruck: TBH, I read a bit RETIRED as of today. why to bother?16:54
weshay|ruck?16:54
weshay|ruckoh16:54
weshay|ruckzbr|rover, so.... let me double check if that means we can drop it16:54
zbr|roverbased on http://rhos-release.virt.bos.redhat.com:3030/rhosp16:54
zbr|roverbe careful who you ask,... most please will do anything to avoid answering with "yes, you can drop it"16:55
*** marios|out has quit IRC16:55
weshay|ruckzbr|rover, ya.. usually I prefer asking for forgiveness than permission16:57
*** rlandy|brb is now known as rlandy17:04
*** tesseract has quit IRC17:19
*** amoralej is now known as amoralej|off17:25
*** dtantsur is now known as dtantsur|afk17:30
*** saneax has joined #oooq17:31
raukadahweshay|ruck, EmilienM zbr|rover http://logs.rdoproject.org/53/24453/12/check/tripleo-podman-integration-rhel-8-scenario000-standalone/a769685/logs/undercloud/home/zuul/repo_setup.log.txt.gz17:36
raukadahit takes 30 mins works fine with keystone only stnadlone deployment from podman master17:36
weshay|ruckah.. very nice17:37
raukadahwe need different scenario to find breakge in podman17:37
raukadahit uses latest podman from master17:37
weshay|ruckhttp://logs.rdoproject.org/53/24453/12/check/tripleo-podman-integration-rhel-8-scenario000-standalone/a769685/logs/undercloud/etc/yum.repos.d/podman-override.repo.txt.gz17:37
raukadahpodman                        x86_641.7.1-1578674008.git6ed88e04.el8            podman-override17:38
raukadahhttp://logs.rdoproject.org/53/24453/12/check/tripleo-podman-integration-rhel-8-scenario000-standalone/a769685/logs/undercloud/var/log/extra/podman/podman_allinfo.log.txt.gz17:38
raukadahmore truth above17:38
zbr|roverraukadah: how did you make podman-override work?17:38
raukadahzbr|rover, I am a magician17:39
weshay|ruckraukadah, can we run a tempest keystone api against it next week?17:39
raukadahweshay|ruck, yes17:39
weshay|ruckraukadah++17:39
weshay|ruckthanks man17:39
weshay|ruckEmilienM, ping me to discuss the future of this kind of testing when you have a minute.. can be next week17:39
raukadahzbr|rover, https://review.rdoproject.org/r/2445317:40
raukadahweshay|ruck, I think we can reply to podman downstream thread, it would be useful for them and give more visibility17:41
weshay|ruckraukadah, hold on that ..  that may confuse their discussion17:41
raukadahyes sure :-)17:42
zbr|roverraukadah: do you know how to fix https://github.com/containers/libpod/pull/4815/files ?17:43
raukadahzbr|rover, not yet digged, but might fix on monday17:43
zbr|roverraukadah: is in our interest to move as much as possible to libpod. i am curious to see how the .repo file looks like, maybe that clarifies the issue.17:44
raukadahweshay|ruck, zbr|rover marios fix works for dlrn17:45
raukadahweshay|ruck, zbr|rover https://review.opendev.org/#/c/701959/ tested above in podman17:46
raukadahrlandy, weshay|ruck, https://review.opendev.org/#/c/701960/ this also for ceph-ansible integration17:47
weshay|ruckdang it..17:48
weshay|ruckI had no idea that is in master like that :(17:49
weshay|ruck$too_many_things17:49
raukadahweshay|ruck, link is there in commit message17:49
raukadahweshay|ruck, for ceph stuff https://review.rdoproject.org/r/24461 more context here17:49
weshay|ruckheh.. and I +2 it17:49
weshay|ruck:)17:49
weshay|rucklolz17:49
weshay|ruck#upstream_life17:50
raukadahweshay|ruck, better what a #ptllife :-)17:50
rlandywhat's with the rdo failures?17:51
ykarel|awayweshay|ruck, is rhel8 standalone failure known?17:51
ykarel|awayRETRY_LIMIT ones17:51
rlandy020-01-10 14:02:19.032894 | PLAY RECAP17:51
rlandy2020-01-10 14:02:19.032974 | primary | ok: 1 changed: 1 unreachable: 0 failed: 1 skipped: 3 rescued: 0 ignored: 017:51
rlandy2020-01-10 14:02:19.033021 |17:51
weshay|rucklet me double check17:52
raukadahrlandy, https://review.opendev.org/701968 one of the fixes17:52
weshay|ruck$too_many_things17:52
raukadahwe might hit container login resitry issue also17:53
raukadahi saw in check job17:53
rlandyraukadah: for the rdo failures?17:53
ykarel|awayweshay|ruck, i think https://review.rdoproject.org/r/#/c/24449/ caused the issue17:53
rlandyif so, we should run rdo jobs there17:53
raukadahrlandy, yes map dlrn project ask17:53
ykarel|awaycontaienr login one17:53
rlandyrhel17:53
weshay|ruckya.. see it 2020-01-09 21:32:39.750056 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/tripleo-rdo-base/container-login.yaml@master]17:53
* weshay|ruck looks at review17:54
rlandy2020-01-10 14:05:38.229343 |17:54
rlandy2020-01-10 14:05:38.229737 | TASK [ovb-manage : Recover idnum]17:54
rlandy2020-01-10 09:05:38.554917 | primary | cat: /home/zuul/workspace/ovb/idnum: No such file or directory17:54
raukadahrlandy, weshay|ruck ykarel|away registry_login_enabled to false17:54
ykarel|away^^ is workaround17:54
raukadahdone in podman job this morning17:54
ykarel|awaywe should fix17:54
rlandywe have multiple failures17:54
raukadahykarel|away, yes17:54
ykarel|awaypossibly "" is the issu17:55
weshay|ruckI had not seen that one ykarel|away thanks for making me aware17:55
raukadahweshay|ruck, are we maintaining rr etherpad this time?17:55
weshay|ruckraukadah, ya17:55
weshay|rucklinked in the cockpit17:55
weshay|ruckI would think this https://review.rdoproject.org/r/#/c/24449/2/zuul.d/tripleoci.yaml17:56
weshay|ruckwould only affect vexx jobs17:56
weshay|ruckI guess this is what did it though https://review.rdoproject.org/r/#/c/24449/2/playbooks/tripleo-rdo-base/container-login.yaml17:56
ykarel|awaysee "" around key17:58
ykarel|awayi think that's causing issue17:58
ykarel|awayack i see revert17:58
* ykarel|away out17:58
*** derekh has quit IRC18:01
*** ykarel|away has quit IRC18:02
weshay|ruckrlandy, fyi.. netowrking team is debugging env d atm.. thanks again for setting it up18:05
rlandyweshay|ruck: sure18:05
raukadahrlandy, can you hire me as a apprentice to learn bm and ovb stuff?18:06
rlandyweshay|ruck: I left my IPA progress notes on https://tree.taiga.io/project/tripleo-ci-board/task/1419?kanban-status=144727518:06
rlandyafaict, only the vm install works as is18:06
rlandyI don;t understand your comment to use https://github.com/freeipa/ansible-freeipa instead of this shell script?18:07
weshay|ruckrlandy, that's fine.. proceed w/ that18:07
weshay|ruckrlandy, there is some already written ansible to install ipa18:07
rlandyweshay|ruck: as I see it, the path forward is to create a role in tripleo-ci18:07
rlandyusing the script18:07
rlandyin j2 format18:07
weshay|ruckrlandy, we can chat if you want18:07
rlandyweshay|ruck: k18:07
weshay|ruckhttps://meet.google.com/vio-jkbe-eyn18:08
rlandyraukadah: you can be the test guinea pig foy my training notes on BM18:08
raukadahrlandy, looking forward for the notes :-)18:09
rlandyyeah - be careful what you ask for :)18:09
raukadahrlandy, I will try to be a good apprentice :-)18:10
raukadahrlandy, weshay|ruck https://review.opendev.org/#/c/701966/ one more +w on tripleo-docs, thanks to kopecmartin :-)18:14
*** rfolco has joined #oooq18:16
rlandyweshay|ruck: https://docs.google.com/document/d/1oTnB-x9V6OOOEWFPOxbzgCfy6_lL6oFlQVwKtffC1V4/edit#18:19
*** jpena is now known as jpena|off18:25
rlandydone18:25
raukadahrlandy, can you share the notes related to tls work? I might poke in weekends18:53
raukadahif it is in taiga, I will take a look18:53
rlandyraukadah: in the card ... following https://docs.google.com/document/d/1oTnB-x9V6OOOEWFPOxbzgCfy6_lL6oFlQVwKtffC1V4/edit#18:53
rlandyraukadah: only the vm install worked for me18:54
raukadahrlandy, cool, will poke on that!18:54
rlandyraukadah: I'm now testing out the ansible install role from https://github.com/freeipa/ansible-freeipa/blob/master/roles/ipaserver/tasks/install.yml18:54
rlandyraukadah: then we can make a choice on monday how to go forward18:54
rlandyyou can view my vms if you want18:55
raukadahlet me play with those, then we can talk on monday morning :-)18:55
rlandyraukadah: both container approaches failed for me18:56
rlandyso if you hit an error, don;t bang your head against the wall18:56
EmilienMweshay|ruck: I'm back, wanted to discuss?19:20
weshay|ruckEmilienM, sure19:20
weshay|ruckya sure ya betcha19:20
weshay|ruckI have a few minutes should be brief19:21
weshay|ruckhttps://meet.google.com/qsi-zmgq-yuh19:21
*** holser has quit IRC19:23
*** Goneri has quit IRC19:59
rfolcorlandy, did we disable overcloud and ipa image builds for centos ?20:42
*** jfrancoa has quit IRC20:43
rlandyrfolco: in what context?20:43
rfolcohttps://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master#20:43
rfolcothis context :)20:43
rlandydepends on the env and where it's run20:43
rlandyrfolco: again - depends on the job20:44
rlandyperiodic-tripleo-rhel-8-buildimage-ironic-python-agent-masteropenstack/tripleo-cimasteropenstack-periodic-mastermaster8562020-01-10T08:13:07SUCCESS20:44
rlandyperiodic-tripleo-rhel-8-buildimage-overcloud-full-masteropenstack/tripleo-cimasteropenstack-periodic-mastermaster10442020-01-10T08:13:08SUCCESS20:44
rlandyfor ovb we build images20:44
rfolconot rhel20:44
rlandyagain - which job?20:45
rfolcocentos7, overcloud images and ipa20:45
rfolcoI am failing to find them20:45
rlandyrfolco: image builds are done in fs00220:47
rlandyhttp://logs.rdoproject.org/openstack-periodic-latest-released/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-train-upload/9001299/job-output.txt20:47
rlandy2020-01-10 19:02:09.608741 | primary | 27b6bb11dc867ef62c5d3a03ec7f4e8b86cccf50_243bc231/20:47
rlandy2020-01-10 19:02:09.608817 | primary | 27b6bb11dc867ef62c5d3a03ec7f4e8b86cccf50_243bc231/ironic-python-agent.tar20:47
rlandy2020-01-10 19:02:13.711988 | primary | 27b6bb11dc867ef62c5d3a03ec7f4e8b86cccf50_243bc231/ironic-python-agent.tar.md520:47
rlandy2020-01-10 19:02:13.712389 | primary | 27b6bb11dc867ef62c5d3a03ec7f4e8b86cccf50_243bc231/overcloud-full.tar20:47
rfolcoperiodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload20:47
rlandy2020-01-10 19:02:24.415862 | primary | 27b6bb11dc867ef62c5d3a03ec7f4e8b86cccf50_243bc231/overcloud-full.tar.md520:47
rlandy2020-01-10 19:02:24.491982 | primary |20:47
rlandyhence I have this card20:47
rlandyhttps://tree.taiga.io/project/tripleo-ci-board/task/1346?kanban-status=144727520:48
rfolcorlandy, ok, what about ipa20:48
rlandyrfolco: in the paste above there are ipa and overcloud images20:49
rlandy2020-01-10 12:10:25.491529 | primary | + rsync --verbose --archive --delay-updates --relative b30acb02bbabbb2d08fc8c94ff90bc760e05f80c_82543a02 uploader@images.rdoproject.org:/var/www/html/images/centos7/master/rdo_trunk20:49
rlandy2020-01-10 12:10:25.578008 | primary | Warning: Permanently added 'images.rdoproject.org,38.145.33.168' (ECDSA) to the list of known hosts.20:49
rlandy2020-01-10 12:10:26.354166 | primary | building file list ... done20:49
rlandy2020-01-10 12:10:26.356349 | primary | b30acb02bbabbb2d08fc8c94ff90bc760e05f80c_82543a02/20:49
rlandy2020-01-10 12:10:26.356437 | primary | b30acb02bbabbb2d08fc8c94ff90bc760e05f80c_82543a02/ironic-python-agent.tar20:49
rfolcooh true20:49
rlandy2020-01-10 12:10:32.549056 | primary | b30acb02bbabbb2d08fc8c94ff90bc760e05f80c_82543a02/ironic-python-agent.tar.md520:49
rlandy2020-01-10 12:10:32.549476 | primary | b30acb02bbabbb2d08fc8c94ff90bc760e05f80c_82543a02/overcloud-full.tar20:50
rlandy2020-01-10 12:10:43.626135 | primary | b30acb02bbabbb2d08fc8c94ff90bc760e05f80c_82543a02/overcloud-full.tar.md520:50
rfolcorlandy, k thanks for the info. Memory is failing.20:50
rlandyweshay|ruck: the ipa role needs some work but may be usable20:51
rlandywill discuss on monday20:51
weshay|ruckah k.. that's something20:51
rlandyneed to set up our vars properly20:51
rlandywhich I gues is a reasonable expectation :)20:52
weshay|ruckheh20:52
zbr|roverweshay|ruck: hey! are you still here? can you have a brief look at https://review.opendev.org/#/c/701967/ ?21:02
weshay|ruckzbr|rover, aye21:02
weshay|ruckya.. was just looking at it tbh21:03
zbr|rovermainly running the build-test-packages in molecule was very easy. now i only need to split the review in two, one to add empty molecule job, 2nd with role changes.21:03
zbr|roverwe wasted a huge amount of time due to lack of testing21:05
*** rfolco has quit IRC21:06
weshay|ruckzbr|rover, ya.. we've wanted to kill this role for a while.. this one of those roles that we'll hopefully replace w/ the fedora packaging roles21:06
weshay|ruckzbr|rover, /me wonders if it would also be helpful to not skip the rpm creation21:06
weshay|ruckin another patch maybe I'll play w/ it on top of this21:07
weshay|ruckmaybe that's just skipping because there is no change to build21:08
weshay|ruckand it's not the changes you made.. I think that is correct21:08
weshay|ruckwas looking at https://a844f774000a68c97c3e-bac515511eb85ae193e5d3c2e4dbaa93.ssl.cf5.rackcdn.com/701967/10/check/openstack-tox-molecule/76baf71/tox/reports.html21:08
weshay|ruckzbr|rover++21:09
weshay|ruckthanks for the work21:09
weshay|ruckwill watch it through21:09
zbr|roverI am doing now the splitting to make it easy to review.21:09
weshay|ruckzbr|rover, k.. I'll probably merge it over the weekend if you can get it mergable21:10
zbr|roverthe split is done, look at https://review.opendev.org/#/c/702045/21:22
weshay|ruckzbr|rover, /me looks21:23
weshay|ruckzbr|rover, that looks good21:23
weshay|ruck:)21:23
weshay|ruckzbr|rover, have a good weekend man21:23
weshay|ruckthanks for the work! and staying late on a friday21:23
*** rlandy has quit IRC21:26
*** Goneri has joined #oooq21:28
*** TrevorV has quit IRC21:37
weshay|rucksshnaidm|off, go to sleep22:11
sshnaidm|off😴22:12
*** rfolco has joined #oooq23:25
*** jbadiapa has quit IRC23:35
*** rfolco has quit IRC23:40

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!