Friday, 2020-12-11

« Thursday, 2020-12-10 Index Saturday, 2020-12-12 »
*** Goneri has joined #oooq00:34
*** Goneri has quit IRC00:58
-openstackstatus- NOTICE: The Gerrit service on review.opendev.org is being restarted quickly to enable support for Git protocol v2, downtime should be less than 5 minutes02:52
*** rlandy has quit IRC03:13
*** ykarel has joined #oooq05:40
*** ratailor has joined #oooq05:41
*** udesale has joined #oooq05:54
*** jfrancoa has joined #oooq06:38
*** marios has joined #oooq06:39
*** marios is now known as marios|ruck06:40
*** marios|ruck is now known as marios|rover07:10
marios|roverchkumar|ruck: o/ hello and happy friday07:30
marios|roveri got you something special cos it's friday07:30
marios|roverchkumar|ruck: a brand new ussuri gate blocker!!07:30
marios|roverhttps://bugs.launchpad.net/tripleo/+bug/190776907:30
openstackLaunchpad bug 1907769 in tripleo "standalone-upgrade-ussuri can't start containers during deployment container-puppet step2" [Critical,Triaged]07:30
marios|rover\o/07:30
marios|roverwoo07:30
chkumar|ruckmarios|rover: ok, will take a look07:41
*** jbadiapa has joined #oooq07:42
chkumar|ruckmarios|rover: you arw working on ussuri upgrade bug?07:45
marios|roverchkumar|ruck: yeah i'll have a look in a bit there07:47
chkumar|ruckmarios|rover: thanks!07:53
*** zbr has quit IRC08:23
*** zbr has joined #oooq08:23
*** zbr has quit IRC08:26
*** zbr has joined #oooq08:26
*** tosky has joined #oooq08:47
*** jpena|off is now known as jpena08:56
*** slaweq has joined #oooq09:03
slaweqhi chkumar|ruck, any progress with https://review.rdoproject.org/r/#/c/31323/ ?09:03
slaweqI'm not sure if I should recheck it or not yet09:03
*** derekh has joined #oooq09:07
chkumar|ruckmarios|rover: slaweq https://bugs.launchpad.net/tripleo/+bug/190778809:35
openstackLaunchpad bug 1907788 in tripleo "ERROR error creating the default Deployment Plan overcloud Check the create_default_deployment_plan execution in Mistral with openstack workflow execution list" [High,Triaged]09:35
chkumar|ruckslaweq: seems to be error related to overcloud/docker/services/neutron-l3.yaml09:36
chkumar|ruckslaweq: https://opendev.org/openstack/tripleo-heat-templates/src/branch/stable/queens/docker/services/neutron-l3.yaml#L65 something is going wrong here09:38
marios|roverchkumar|ruck: \o/ fantastic thank you!09:39
marios|roverchkumar|ruck: high five! :D09:39
marios|roverchkumar|ruck: let's see how many we can file in total before end of day today09:39
chkumar|ruckmarios|rover: haha09:40
chkumar|ruckヘ( ^o^)ノ＼(^_^ )09:40
marios|rover:)09:40
chkumar|ruckslaweq: the patch which we merged in master recently did we backported to queens?09:41
* chkumar|ruck goes back and dig rlandy patch09:42
slaweqchkumar|ruck: which patch?09:44
chkumar|ruckslaweq: ah cherry-pick is here https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76409509:45
chkumar|ruckslaweq: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/766336/2/docker/services/neutron-l3.yaml09:46
chkumar|ruckslaweq: bad cherry-pick09:46
chkumar|rucki think if we fix above patch, it will work09:47
slaweqchkumar|ruck: yes, it's my patch https://review.opendev.org/c/openstack/tripleo-heat-templates/+/766336/2/docker/services/neutron-l3.yaml09:47
slaweqit's not merged yet09:47
slaweqbut it's in the "depends on" chain for that test patch09:47
slaweqthx a lot09:47
chkumar|ruckslaweq: happy to help :-)09:48
chkumar|ruckslaweq: once fixed, we can recheck the patch then it will work i think09:48
slaweqchkumar|ruck++ thx a lot09:49
slaweqchkumar|ruck: so I think You can close https://bugs.launchpad.net/tripleo/+bug/190778809:51
openstackLaunchpad bug 1907788 in tripleo "ERROR error creating the default Deployment Plan overcloud Check the create_default_deployment_plan execution in Mistral with openstack workflow execution list" [High,Triaged]09:51
slaweqas invalid, right?09:51
chkumar|ruckslaweq: yes, done09:52
chkumar|ruckmarios|rover: https://twitter.com/carlwgeorge/status/133726403931189657609:56
marios|rover:)09:58
marios|roverchkumar|ruck: digging at standalone-upgrade ussuri can't find sthing yet though09:58
*** dtantsur|afk is now known as dtantsur09:58
chkumar|ruckmarios|rover: is it something related to validation [Errno 2] No such file or directory: '/var/log/validations/fa10:05
chkumar|ruck163ed5-5107-07e9-7cb3-000000000008_deploy_steps_playbook_2020-12-11T04:41:53.9710:05
chkumar|ruck7709Z.json'10:05
chkumar|ruck?10:05
chkumar|ruckthere is nothing in errors.txt also10:08
marios|roverchkumar|ruck: yeah errors.txt is empty10:09
marios|roverchkumar|ruck: no the validations thing is not the root problem10:09
marios|roverchkumar|ruck: i use this green job for reference you can see the same there https://7eeddc8c208d72a47f96-284a4b285d9a15fafe54e6a481b891ab.ssl.cf1.rackcdn.com/757821/12/check/tripleo-ci-centos-8-standalone-upgrade-ussuri/e0fc8e9/logs/undercloud/home/zuul/standalone_deploy.log10:09
chkumar|ruckmarios|rover: yes, correct, no idea what is going wrong there10:19
chkumar|ruckmarios|rover: need to ping upgrade team10:19
marios|roverchkumar|ruck: no more like df10:21
marios|roverchkumar|ruck: it isn't even reaching upgrade10:21
marios|roverchkumar|ruck: happens during step2 puppet config of deploy10:21
chkumar|ruckyes you are correct10:21
marios|roverchkumar|ruck: hoping it is a forgotten cherrypick or sthing digging a bit victoria vs ussuri10:22
marios|roverchkumar|ruck: but can't find sthing in the logs, checked the container outputs too..10:22
marios|roverchkumar|ruck: few errors, but have the same in the 'green' log...10:22
chkumar|ruckslaweq: still hitting same error11:06
chkumar|ruckslaweq: somehting wrong at line 102 and 124 https://logserver.rdoproject.org/23/31323/5/check/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-queens/10fbe20/logs/undercloud/var/log/mistral/engine.log.gz11:07
*** udesale_ has joined #oooq11:15
*** udesale has quit IRC11:18
kopecmartinchkumar|ruck: hi, when you have a moment, please have a look at this https://review.opendev.org/c/osf/refstack-client/+/70885711:19
akahatchkumar|ruck, ping.. hey.. ussuri related issue known?11:20
akahathttps://6d454fee7aca3ec21c01-c455553d95560f1580667e93cc59b7bd.ssl.cf5.rackcdn.com/753372/2/check/tripleo-ci-centos-8-standalone-upgrade-ussuri/af40d10/logs/undercloud/home/zuul/repo_setup.log11:20
chkumar|ruckakahat: upgrade one?11:20
akahatyup.11:20
chkumar|ruckakahat: https://bugs.launchpad.net/tripleo/+bug/190776911:20
openstackLaunchpad bug 1907769 in tripleo "standalone-upgrade-ussuri can't start containers during deployment container-puppet step2" [Critical,Triaged]11:20
akahatchkumar|ruck, no.. not this one.. i think it's after deployment. check logs ^^11:22
akahatwell it do not found gating.repo, i remember are some changes around gating repo.11:22
akahatthat might be causing this job failure.11:22
chkumar|ruckakahat: please open a bug11:22
akahatchkumar|ruck, okay.. but before that could you please pass me the link to review where gating repo is changed.11:23
chkumar|ruckakahat: sure11:23
chkumar|ruckakahat: https://review.opendev.org/q/topic:%22release-aware-gate%22+(status:open%20OR%20status:merged)11:24
akahatchkumar|ruck, thanks :)11:24
chkumar|ruckslaweq: commented here https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76633611:27
slaweqchkumar|ruck: yes, thx11:28
chkumar|ruckslaweq: for example https://opendev.org/openstack/tripleo-heat-templates/src/branch/stable/queens/docker/services/glance-api.yaml#L20011:28
slaweqI will fix that now11:28
chkumar|ruckslaweq: i think11:31
chkumar|rucklist will start11:32
chkumar|ruckif:11:32
chkumar|ruck  -11:32
slaweqchkumar|ruck: I just changed it11:32
slaweqI hope it will be ok now :)11:32
chkumar|ruckslaweq: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/766336/4..5/docker/services/neutron-l3.yaml#122 I think you need 2 more just below if:11:34
marios|roverchkumar|ruck: add another +2 ? https://review.opendev.org/c/openstack/tripleo-ci/+/764761 you already had it on v1611:34
chkumar|ruck*2 more spaces11:35
slaweqchkumar|ruck: I did it in the same way as it was done in original patch https://review.opendev.org/c/openstack/tripleo-heat-templates/+/68335711:35
chkumar|ruckslaweq: yes, you are correct, not sure why queens is behaving like this11:36
chkumar|ruckmarios|rover: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/766336 please have a look11:36
slaweqmarios|rover: one qq to You11:37
slaweqmarios|rover: I saw recenty email about EOL of Rocky branch, so IIUC I don't need to bother with https://review.opendev.org/c/openstack/tripleo-heat-templates/+/766316 anymore, right?11:38
marios|roverslaweq: o/ well, yeah , but not yet. we will move to unmaintained first, then eol. we can merge things until it goes eol.11:38
marios|roverslaweq: may as well get it in you have the patch up...11:39
slaweqmarios|rover: ok, so I will need to fix it too :)11:39
marios|roverchkumar|ruck: will do11:40
*** udesale_ has quit IRC11:41
*** udesale has joined #oooq11:42
*** slaweq_ has joined #oooq11:46
*** jlopezgu has joined #oooq11:54
*** dtantsur is now known as dtantsur|brb11:56
chkumar|ruckmarios|rover: will be back in half an hour11:56
marios|roverchkumar|ruck: thx11:57
*** sshnaidm is now known as sshnaidm|off11:59
*** slaweq has quit IRC12:02
*** slaweq_ has quit IRC12:03
*** slaweq has joined #oooq12:06
*** udesale has quit IRC12:10
*** udesale has joined #oooq12:10
*** ykarel_ has joined #oooq12:14
*** ykarel has quit IRC12:16
*** slaweq has quit IRC12:20
*** ratailor has quit IRC12:21
*** kopecmartin has quit IRC12:22
* chkumar|ruck is back12:23
chkumar|ruckakahat: do we have the bug up?12:24
akahatchkumar|ruck, no. not yet.. still looking in to it.12:25
chkumar|ruckakahat: try curl the delorean repo12:26
chkumar|ruckwith the same address from which it failed12:26
*** kopecmartin has joined #oooq12:26
akahatchkumar|ruck, tried.. that is 40412:27
marios|roverchkumar|ruck: possible new centos7 issue eg https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_3fa/762660/4/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/3fafe84/job-output.txt 2020-12-11 11:13:36.415765 | primary | ERROR: Package 'pymod2pkg' requires a different Python: 2.7.5 not in '>=3.6'12:27
chkumar|ruckmarios|rover: looking12:27
*** dtantsur|brb is now known as dtantsur12:27
chkumar|ruckmarios|rover: might be a mirror issue arxcruz|2021 saw it earlier when he was rr12:28
chkumar|rucklet me find the bug12:28
marios|roverchkumar|ruck: thanks12:32
*** jpena is now known as jpena|lunch12:38
chkumar|ruckmarios|rover: https://hackmd.io/@rh-openstack-ci/Bkqh8WJbw refs from here12:50
marios|roverthx chkumar|ruck12:51
chkumar|ruckzbr: hello12:52
chkumar|ruckzbr: need one help12:52
chkumar|ruckzbr: we are hitting this issue https://logserver.rdoproject.org/65/31165/7/check/periodic-tripleo-ci-centos-8-standalone-centos8stream-master/81b4b25/job-output.txt12:52
chkumar|ruckzbr: An exception occurred during task execution. To see the full traceback, use -vvv. The error was: KeyError: 'getpwuid(): uid not found: 1000'12:52
chkumar|ruckzbr: need your eyes on this, thanks!12:52
zbrKeyError: 'getpwuid(): uid not found: 1000'12:57
marios|roverwe have a bug for that don't we12:58
marios|roverhttps://bugs.launchpad.net/tripleo/+bug/190747412:58
openstackLaunchpad bug 1907474 in tripleo "CentOS8-stream: tempest fails to load tests to be skipped: "The error was: KeyError: 'getpwuid(): uid not found: 1000'"" [High,Triaged] - Assigned to chandan kumar (chkumar246)12:58
zbri guess i should take one (bug) for the team.12:58
chkumar|ruckzbr: thank you :-)12:59
marios|roverzbr: there is enough for everyone!13:03
marios|roverbugs for you, for you and for YOU13:03
marios|rover!13:03
chkumar|ruckmarios|rover: we can keep the secret with us for today13:03
marios|roverkindly form an orderly queue13:03
zbrwhere does this list_skipped role comes from?13:03
chkumar|ruckzbr: https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles13:04
zbrwhat the heck, I am unable to find the place where getpwuid reallly comes from13:05
zbri see nothing weird in that role and the task calling it13:06
chkumar|ruckzbr: https://bugs.python.org/issue3146913:06
zbrlast time I checked nested blocks were not allowed in ansible13:07
chkumar|ruckhttps://github.com/ansible/ansible/issues/3829113:07
zbrand for some weird reason that role has a useless aditional block on it.13:07
zbrhttps://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/install_skiplist/tasks/main.yaml#L213:07
*** rlandy has joined #oooq13:07
zbrthat block makes no sense13:07
zbrahh, that was another role.13:09
rlandychkumar|ruck: hey13:13
chkumar|ruckrlandy: hello13:13
chkumar|ruckrlandy: zbr is looking into tempest issue13:13
zbrwhile I do not see any tests for this role I also do not see any piece of code that could produce this weird error13:13
rlandywe're still dying on the tempest skipkist :(13:13
rlandyzbr: hey - that's a stream only problem13:14
rlandyno idea why13:14
rlandychkumar|ruck: are we in the tempest container at that point?13:14
* rlandy thinks not yet13:14
chkumar|ruckrlandy: nope13:14
* zbr things to do a s/cento/PIS/ on CentOS Stream 13:14
zbrrlandy: unless task is run with delegate: localhost, it will be inside a container.13:16
marios|roverjesus... this was submitted on oct26.. just merged https://review.opendev.org/c/openstack/tripleo-common/+/75968313:16
rlandyzbr: it is delegate13:16
zbri do not see delegate on https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/list_skipped/tasks/main.yaml13:16
marios|roverbrb13:16
rlandyhttps://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/tasks/tempest.yml#L3213:16
rlandyzbr: ^^13:16
zbrrlandy: putting delgate at block level... not sure if that applies to all clild tasks.13:17
zbryou may had uncovered the issue.13:17
rlandythe issue?13:17
zbri would put a delegate_to at task level, i am curious.13:19
zbri suspect a lack of propagation of delegate_to13:19
zbris the only thing that may explain it13:19
rlandyzbr: so remove the block13:22
* rlandy tried13:23
rlandytries13:23
*** jpena|lunch is now known as jpena13:36
weshay|ruckchkumar|ruck, did you get "bug_tracking" to run?13:41
rlandyzbr: https://review.opendev.org/c/openstack/tripleo-ci/+/766261 - this can probably merge - review pls13:42
chkumar|ruckweshay|ruck: not yet,13:42
weshay|ruckchkumar|ruck, marios|rover got a minute to chat about train?13:57
marios|roverweshay|ruck: sure13:57
chkumar|ruckweshay|ruck: sure13:57
weshay|ruckhttps://meet.google.com/thp-bgok-tvo13:58
weshay|ruckchkumar|ruck, marios|rover https://bugs.launchpad.net/tripleo/+bug/190719313:59
openstackLaunchpad bug 1907193 in tripleo "package podman-1.6.4-23.module_el8.3.0+566+4759265c.x86_64 is filtered out by modular filtering" [High,Fix released] - Assigned to Alex Schultz (alex-schultz)13:59
*** ykarel_ is now known as ykarel14:01
weshay|ruckchkumar|ruck, marios|rover https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-ubi-8-push-train/b04ec97/logs/containers-build-errors.log14:04
*** Goneri has joined #oooq14:05
chkumar|ruckweshay|ruck: marios|rover https://review.opendev.org/c/openstack/tripleo-ci/+/76042614:06
marios|roverchkumar|ruck: ack14:07
*** frenzy_friday has quit IRC14:12
*** frenzy_friday has joined #oooq14:13
*** TrevorV has joined #oooq14:34
zbrchkumar|ruck: rlandy: fatal: [undercloud] ... on that error should have hinted us that it did not run with localhost.14:40
rlandy2020-12-11 14:32:38.417653 | primary | Friday 11 December 2020  14:32:38 +0000 (0:00:00.060)       0:46:40.360 *******14:41
rlandy2020-12-11 14:32:38.530167 | primary | fatal: [undercloud]: FAILED! => {14:41
rlandy2020-12-11 14:32:38.530262 | primary |     "reason": "'delegate_to' is not a valid attribute for a IncludeRole\n\nThe error appears to be in '/home/zuul/workspace/.quickstart/playbooks/tasks/tempest.yml': line 5, column 7, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n  block:\n    - name: Load tests to be skipped\n      ^ here\n"14:41
*** dsneddon has quit IRC14:41
rlandyok - I guess I got that wrong fixing14:41
weshay|ruckmarios|rover, chkumar|ruck https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/standalone/tasks/containers.yml#L243-L25914:41
*** dsneddon has joined #oooq14:42
marios|roverXanadu14:56
chkumar|ruckmarios|rover: weshay|ruck sorry, it was linked with container image prepare stuff15:14
*** dtantsur is now known as dtantsur|brb15:15
chkumar|ruckmarios|rover: weshay|ruck I am going to take the second route15:16
weshay|ruckchkumar|ruck, k.. email/ping w/ a patch when you have one :)15:31
weshay|ruckthank you15:31
marios|roverchkumar|ruck: weshay|ruck: gates are starting to go up... master/ussuri/train > 90%15:36
marios|roverand queue is down from this morning15:36
weshay|ruckya.. we're slowly getting there.. so it goes15:38
weshay|ruckrfolco, another failure test case, /me hasn't found the failing error yet.. https://7ca76a19696e7e72101a-6b55723cc038e535880ec3160bf3c4d9.ssl.cf1.rackcdn.com/760426/12/check/tripleo-build-containers-centos-7-buildah-train/ca2e020/logs/15:47
weshay|ruckah..15:47
weshay|ruckmaybe 2020-12-11 15:33:56 | Building octavia-housekeeping image with: sudo buildah bud --format docker --tls-verify=False --logfile /tmp/container-builds/3093e132-180b-4738-8d17-b621f8d0a714/docker/octavia/octavia-housekeeping/octavia-housekeeping-build.log -t 127.0.0.1:8787/tripleotrain/centos-binary-octavia-housekeeping:65a5efac78c28c704a8d9976bb7ce0f5d6a278a4_2b04e7b3 /tmp/container-builds/3093e132-180b-47Exception occured while15:47
weshay|ruckrunning the command15:47
rfolcohttps://7ca76a19696e7e72101a-6b55723cc038e535880ec3160bf3c4d9.ssl.cf1.rackcdn.com/760426/12/check/tripleo-build-containers-centos-7-buildah-train/ca2e020/logs/build.log15:49
rfolcoyes15:49
rfolcoweshay|ruck, this job still uses py27 in venv... not sure if this may cause issues15:51
rfolco2020-12-11 15:33:56 |   File "/home/zuul/workspace/venv_build/lib/python2.7/site-packages/tripleo_common/image/builder/buildah.py", line 247, in build_all15:51
rfolco2020-12-11 15:33:56 |     raise SystemError(error_msg)15:51
rfolcoweshay|ruck, an attempt to switch to py3 venv is https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/764232 and ykarel also has this one https://review.opendev.org/c/openstack/tripleo-ci/+/76412015:53
weshay|ruckshould be done in tripleo-repos15:54
rfolcoit is worth trying adding as depends-on15:54
rlandyzbr: shoot - didn't take ... 2020-12-11 15:51:45.034497 | primary | TASK [list_skipped : List skipped tests] ***************************************15:54
rlandy2020-12-11 15:51:45.034504 | primary | Friday 11 December 2020  15:51:45 +0000 (0:00:00.125)       0:54:09.396 *******15:54
rlandy2020-12-11 15:51:45.064836 | primary | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: KeyError: 'getpwuid(): uid not found: 1000'15:54
rlandy2020-12-11 15:51:45.064965 | primary | fatal: [undercloud]: FAILED! => {}15:54
rlandyugh - seriously15:55
zbrrlandy: where is panda now to make a comment regarding how much unit/functional testing we have on that particular role.15:56
zbra very simple role, with zero test coverage.15:56
zbri could probably write a unitest in few hours but I am not sure i can finish it today. and from monday I ruck.... or roll over.15:57
rlandyzbr: yeah - monday is fine ... something with stream changed this ...15:58
rlandyansibls didn't rev15:58
rlandyI'm going to try another few option15:58
rlandyoptions15:58
*** zbr3 has joined #oooq16:00
rlandyhttps://medium.com/opsops/ansible-2-5-delegate-to-and-include-role-20cd7e67008e16:00
rlandyzbr: ^^16:00
rlandybut we've used more than 2.5 for ages16:01
* rlandy doesn't know16:01
*** zbr has quit IRC16:01
*** zbr3 is now known as zbr16:01
rlandyhttps://medium.com/opsops/ansible-2-4-2-7-include-role-and-delegate-to-3484583febc716:02
rlandyI tried the suggestion there - didn't help16:02
chkumar|ruckmarios|rover: weshay|ruck I will email the patch tomorrow16:21
chkumar|ruckhave a nice weekend, see ya16:21
weshay|ruckchkumar|ruck, don't work weekends man.. refresh.. monday16:21
*** chkumar|ruck is now known as raukadah16:21
marios|roverthanks raukadah o/16:22
raukadahweshay|ruck: ya tomorrow == monday :-)16:22
marios|roverraukadah: thanks for being great ruck|rover partner as always16:22
raukadahmarios|rover: glad to be part as a partner in crime :-16:23
raukadah:-)16:23
raukadahhttps://blog.centos.org/2020/12/centos-stream-is-continuous-delivery/16:26
* zbr thinks more around continuous interruptus kind of experience16:31
rlandyweshay|ruck: hey .. I am looking for yesterday's train fix to python-paunch made it downstream ... to fix continer-toos line16:35
rlandytools16:35
rlandy[ ]python-paunch-5.3.3-2.20201115004856.7e49691.el8.src.rpm2020-11-14 19:50 71K16:35
rlandy[ ]python-paunch-5.3.3-2.20201115004856.7e49691.el8ost.src.rpm2020-11-14 19:56 71K16:35
rlandy^^ tripleo-ci-testing16:35
rlandywhich is the same as promoted-components16:36
marios|roverweshay|ruck: me plotting my escape in few16:37
marios|roverweshay|ruck: need something before i call it?16:37
marios|roverk thx bai16:43
*** marios|rover is now known as marios|out16:47
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?pipeline=openstack-component-tripleo16:48
rlandyhasn't run in two days16:48
*** jlopezgu has quit IRC16:52
rlandyoh cloud work16:56
rlandy[ ]python-paunch-5.3.3-2.20201210164845.7e49691.el8.src.rpm2020-12-10 11:50 71K16:57
rlandy[ ]python-paunch-5.3.3-2.20201210164845.7e49691.el8ost.src.rpm2020-12-10 11:57 72K16:57
rlandy^^ consistent16:57
*** dtantsur|brb is now known as dtantsur16:58
*** marios|out has quit IRC17:04
weshay|ruckheh.. my speaker was too low17:18
weshay|ruckso it goes17:18
weshay|ruckrlandy++17:23
*** jfrancoa has quit IRC17:26
*** udesale has quit IRC17:28
*** saneax has quit IRC17:32
rlandyugh _ I give up ... An exception occurred during task execution. To see the full traceback, use -vvv. The error was: KeyError: 'getpwuid(): uid not found: 1000'17:34
* rlandy changes hosts17:35
rlandyno idea how else to fix thsis17:35
weshay|ruckrlandy, the only other thing I can think of.. is to run skip-list locally17:43
weshay|ruckrlandy, and perhaps see what it needs from /etc/passwd17:43
*** derekh has quit IRC17:44
rlandyweshay|ruck: ack - that's what I mean about changing hosts17:44
rlandyI don't have any more bight ideas17:44
weshay|ruckhttps://opendev.org/openstack/openstack-tempest-skiplist/src/commit/4c1bfdf4d9f33d6ab6a076b6d6b2568cd07871f1/roles/install_skiplist/tasks/main.yaml#L9-L1317:45
weshay|ruckthat's the code that's failing right?17:45
rlandyhttps://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/list_skipped/tasks/main.yaml#L317:45
*** tosky has quit IRC17:46
rlandyweshay|ruck: so you're saying if I got rid of --user?17:46
weshay|ruckwell.. I think playing w/ this locally..  might shed some light on what to do17:47
weshay|ruckthat extra_arg does seem suspect thoguh17:47
weshay|ruckthough17:47
weshay|rucknaw.. it's fine https://docs.ansible.com/ansible/2.4/pip_module.html17:48
weshay|ruck- pip:17:48
weshay|ruck    name: bottle17:48
weshay|ruck    extra_args: --user17:48
rlandyhttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/766527/6/playbooks/tasks/tempest.yml17:48
*** dmellado has quit IRC17:48
rlandy^^ was going to run this directly on localhost17:49
rlandyso hosts:17:49
weshay|ruckbut.. I suspect if it just reused the virtenv.. it would work17:49
rlandylocalhost17:49
rlandybecause zbr is right17:49
rlandythe error is listed on undercloud17:49
rlandywhich mean it's not delegating17:49
*** dmellado has joined #oooq17:50
rlandywhy does the skiplist have to be on localhost17:50
rlandyweshay|ruck: ^^17:50
rlandywhat happens if we just installed it on the undercloud?17:51
weshay|ruckya.. I think it should be undercloud17:51
rlandynothing else in that role delegates to anyone17:52
* rlandy just tries to take that out17:52
rlandysee what happens17:52
weshay|ruckdelegation in ansible does lead to weird crap from times17:52
weshay|ruckand if it can be avoided we should17:52
rlandytotally17:52
rlandythis was triggered by something in stream17:52
rlandybut what exactly, not sure17:53
rlandyansible is the same version17:53
weshay|ruckrlandy, it's probably an ansible bug17:54
rlandyI would guess17:54
rlandybut why now?17:54
rlandylet's see what this run does17:54
weshay|ruckrlandy, centos stream17:54
weshay|ruckcentos-stream + ansible + delegate17:54
rlandythe curse of stream17:55
weshay|rucklolz17:55
weshay|ruckrlandy, it litteraly prints money for us17:55
weshay|ruckbrrrrr17:55
rlandyweshay|ruck: lol17:55
rlandybreadhat?17:55
* weshay|ruck makes a sandwich17:55
rlandysend some here17:55
weshay|ruckw/ MONEY as meat17:55
weshay|ruck20's are tasty17:56
rlandyand cheaper than kosher meat17:56
weshay|rucklolz17:56
weshay|rucktru17:56
rlandyhere we go again17:57
* rlandy brb17:57
weshay|ruckI bet that will work17:57
* rlandy hopes so17:57
*** jpena is now known as jpena|off18:00
*** jbadiapa has quit IRC18:03
*** dtantsur is now known as dtantsur|afk18:17
rlandyweshay|ruck++ https://review.rdoproject.org/zuul/stream/2e575b743276453fb5b62482496fab39?logfile=console.log19:01
rlandyweshay|ruck++19:01
rlandyweshay|ruck++19:02
rlandysaving my sanity19:02
weshay|ruckBAM19:02
weshay|ruck:)19:02
weshay|rucknice job!19:02
weshay|ruckrlandy, next week.. let's refocus on the lines we're not monitoring19:03
weshay|ruckI can drive most of that.. but will need ur insight..19:04
rlandyweshay|ruck: ack -19:04
rlandywaiting to see what happens with container-tools19:04
rlandyweshay|ruck: let's see if the tempest change killed te current stuff though19:07
weshay|ruckrlandy, doubt it.. that looked suspicously like a way to test it locally19:08
weshay|ruckwith out a proper hosts file19:08
weshay|ruckrfolco, any news?19:19
rlandycleaning up reviews19:19
rfolcoweshay|ruck, lets see my next run, hopefully w/ logs in the report19:19
weshay|ruckthanks man19:20
rfolcoweshay|ruck, last report almost made it, just had to overcome ./logs/container-builds vs ./container-builds, becuase the python script runs on workspace, and the report.html is generated on workspace/logs19:21
rfolcohttps://logserver.rdoproject.org/40/29840/6/check/periodic-tripleo-ci-build-containers-ubi-8-push/d8e93db/logs/report.html19:21
rlandyweshay|ruck: pls vote on https://review.opendev.org/c/openstack/tripleo-quickstart/+/76628619:22
rfolcoweshay|ruck, note: don't freak out, just building 15 containers to speed up testing19:23
weshay|ruckk19:23
rlandyrfolco: could you vote on https://review.opendev.org/c/openstack/tripleo-ci/+/766261?19:24
rlandyso I can w+19:24
rlandyhttps://review.rdoproject.org/r/#/c/31165/19:49
rlandydone19:49
rfolcoweshay|ruck, it works now, https://logserver.rdoproject.org/40/29840/6/check/periodic-tripleo-ci-build-containers-ubi-8-push/87d9d97/logs/report.html20:26
weshay|rucknice20:28
*** ykarel has quit IRC20:46
*** TrevorV has quit IRC20:59
*** rfolco has quit IRC21:05
*** tosky has joined #oooq21:05
*** rlandy has quit IRC21:05
*** frenzy_friday has quit IRC21:09
*** chem has quit IRC21:18
*** chem has joined #oooq21:20
*** Goneri has quit IRC22:22
« Thursday, 2020-12-10 Index Saturday, 2020-12-12 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!