| *** ysandeep|away is now known as ysandeep|rover | 00:11 | |
| *** dsneddon has quit IRC | 00:12 | |
| *** dsneddon has joined #oooq | 00:14 | |
| *** rlandy|bbl is now known as rlandy | 00:34 | |
| ysandeep|rover | rlandy, hey o/ i see you email on promoter, Just wondering if sahara api/engine not available - can we add them to list https://github.com/openstack/tripleo-ci/blob/master/roles/build-containers/vars/main.yaml#L22 | 00:42 |
|---|---|---|
| rlandy | ysandeep|rover: I think they should be in the exclude list | 00:43 |
| rlandy | corrcet | 00:43 |
| rlandy | I have no idea how the container build didn't die over that | 00:43 |
| rlandy | ysandeep|rover: we can experiment with adding a temp exclude file | 00:44 |
| rlandy | the ini file expects a path | 00:44 |
| ysandeep|rover | rlandy, I am not sure if build was suppose to fail or its just push from rdo -> dockerhub while promotion | 00:44 |
| ysandeep|rover | rlandy, >> we can experiment with adding a temp exclude file --> yes that will be good | 00:45 |
| rlandy | ysandeep|rover: EmilienM told me to me to exclude those containers from 17 | 00:45 |
| rlandy | let me send you the tmate to the promoter | 00:46 |
| ysandeep|rover | okay | 00:46 |
| ysandeep|rover | weshay_pto, around? | 01:27 |
| rlandy | ysandeep|rover: weshay_pto is out building a fence - ping him on google chat if you really need him | 01:30 |
| rlandy | anything I can help with? | 01:31 |
| ysandeep|rover | rlandy, thanks! nothing urgent | 01:31 |
| *** ysandeep|rover is now known as ysandeep|afk | 01:42 | |
| EmilienM | rlandy: need anything? | 01:48 |
| rlandy | EmilienM: I don't think so ... | 01:48 |
| rlandy | waiting for promotion to complete to clear a few gate errors | 01:49 |
| *** apetrich has quit IRC | 02:14 | |
| *** ysandeep|afk is now known as ysandeep|rover | 02:22 | |
| ysandeep|rover | rlandy, if you are still around, Could you please review and merge https://code.engineering.redhat.com/gerrit/#/c/201375/ | 02:25 |
| rlandy | ysandeep|rover: yep - looking | 02:25 |
| rlandy | ysandeep|rover: done | 02:26 |
| ysandeep|rover | rlandy, thanks! | 02:27 |
| *** Goneri has quit IRC | 02:29 | |
| rlandy | ysandeep|rover: ok - I'm out - see you later | 02:32 |
| *** rlandy has quit IRC | 02:32 | |
| *** rfolco has quit IRC | 02:59 | |
| *** dsneddon has quit IRC | 03:08 | |
| *** ysandeep|rover is now known as ysandeep|afk | 03:10 | |
| *** dsneddon has joined #oooq | 03:11 | |
| *** dsneddon has quit IRC | 03:17 | |
| *** dsneddon has joined #oooq | 03:22 | |
| *** dsneddon has quit IRC | 03:27 | |
| *** dsneddon has joined #oooq | 03:28 | |
| *** dsneddon has quit IRC | 03:34 | |
| *** pojadhav is now known as pojadhav|afk | 03:38 | |
| *** dsneddon has joined #oooq | 03:44 | |
| *** ykarel|away has joined #oooq | 03:47 | |
| *** skramaja has joined #oooq | 03:50 | |
| *** saneax has joined #oooq | 03:55 | |
| *** ratailor has joined #oooq | 04:20 | |
| *** dsneddon has quit IRC | 04:22 | |
| *** ykarel|away is now known as ykarel | 04:31 | |
| *** dsneddon has joined #oooq | 04:52 | |
| *** marios has joined #oooq | 04:53 | |
| *** saneax has quit IRC | 04:53 | |
| *** ysandeep|afk is now known as ysandeep | 04:57 | |
| *** saneax has joined #oooq | 04:57 | |
| *** sanjayu_ has joined #oooq | 05:01 | |
| *** saneax has quit IRC | 05:03 | |
| *** soniya29 has joined #oooq | 05:19 | |
| *** sanjayu__ has joined #oooq | 05:23 | |
| *** sanjayu_ has quit IRC | 05:26 | |
| *** udesale has joined #oooq | 05:29 | |
| *** pojadhav|afk is now known as pojadhav | 05:42 | |
| ysandeep | marios, could you please review https://review.opendev.org/#/c/740869/ , Master promotion is pending from 6 days before sahara-{api, engine} containers are not available, we are moving them to exclude list. | 05:47 |
| marios | ysandeep: ack will do | 05:47 |
| ysandeep | s/before/because* | 05:47 |
| ysandeep | marios, thanks! | 05:47 |
| ysandeep | chandankumar, thank you for your patch. | 05:56 |
| ysandeep | I spoke with ronelle this morning - she was wondering we can add a local excludes files with sahara-api/engine(containers_list_exclude_config: file:///tmp/promoter-staging/containers/build-containers-main.yaml), But we were not sure if we need tripleo-common local file too (i.e containers_list_base_url: file:///tmp/promoter-staging/containers/tripleo-common), Need to confirm with panda | 05:56 |
| ysandeep | chandankumar, But if we can get your patch to merge soon - I think that will be better approach. | 05:56 |
| chandankumar | ysandeep: file:///tmp/promoter-staging/containers/build-containers-main.yaml is used for stage job testing triggered using molecule, i think we can wait for upstream patch to get it merged, otherwise it will lead to multiple source of truth | 06:02 |
| ysandeep | chandankumar, ack, sry I mean we created a file like ^^ | 06:03 |
| ysandeep | ~~~ | 06:04 |
| ysandeep | [centos@promoter ~]$ cat /tmp/master-exclude-list.yaml | 06:04 |
| ysandeep | exclude_containers: | 06:04 |
| ysandeep | master: | 06:04 |
| ysandeep | - sahara-api | 06:04 |
| ysandeep | - sahara-engine | 06:04 |
| ysandeep | ~~~ | 06:04 |
| ysandeep | and added containers_list_exclude_config: file:///tmp/master-exclude-list.yaml to ci-config/ci-scripts/dlrnapi_promoter/config/CentOS-8/master.ini .. | 06:04 |
| ysandeep | chandankumar, but i agree to wait is the approach | 06:04 |
| chandankumar | ysandeep: oh, ok, it will work but what about https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/build-containers/vars/main.yaml#L13 other containers ? | 06:05 |
| chandankumar | if we keep the complete list there, then I think we can get the proomotion as a temp solution, once patch merges, we can remove it | 06:06 |
| *** dsneddon has quit IRC | 06:07 | |
| ysandeep | chandankumar, yes i think we should complete list should go there | 06:07 |
| ysandeep | i also raised same doubt with ronelle | 06:08 |
| ysandeep | <ysandeep|rover> rlandy yes, just wondering if we only have to write these two.. or added other we excluded too- https://github.com/openstack/tripleo-ci/blob/master/roles/build-containers/vars/main.yaml#L14-L22 | 06:08 |
| *** dsneddon has joined #oooq | 06:08 | |
| ysandeep | chandankumar, pm | 06:10 |
| chandankumar | ysandeep: yes | 06:10 |
| *** ccamacho has joined #oooq | 06:18 | |
| *** dsneddon has quit IRC | 06:18 | |
| *** dsneddon has joined #oooq | 06:25 | |
| *** ykarel_ has joined #oooq | 06:34 | |
| *** ykarel has quit IRC | 06:37 | |
| *** dsneddon has quit IRC | 06:37 | |
| *** dsneddon has joined #oooq | 06:57 | |
| *** amoralej|off is now known as amoralej | 07:06 | |
| *** ccamacho has quit IRC | 07:32 | |
| *** ysandeep is now known as ysandeep|brb | 07:34 | |
| *** tosky has joined #oooq | 07:37 | |
| bhagyashris|afk | chandankumar, marios add into your review list https://review.rdoproject.org/r/#/c/28234/ thank you :) | 07:44 |
| *** bhagyashris|afk is now known as bhagyashris | 07:44 | |
| marios | bhagyashris: ack | 07:44 |
| *** dtantsur|afk is now known as dtantsur | 07:56 | |
| *** ysandeep|brb is now known as ysandeep|rover | 08:10 | |
| marios | holser: o/ hi do you think matbu patches at https://review.opendev.org/#/c/709134/4 & depends-on https://review.opendev.org/#/c/709066/ might help with train update bug @ https://bugs.launchpad.net/tripleo/+bug/1887176 - I'm really not sure yet but it seems to be failing during mistral workflow and those patches are avoiding mistral right? | 08:12 |
| openstack | Launchpad bug 1887176 in tripleo "Centos8 train minor update failing ERROR configuring rabbit_init_tasks" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 08:12 |
| marios | holser: i was thinking of attempting to rebase those (they are in conflict) but they seem to be old so wasn't sure if they are abandoned | 08:13 |
| marios | holser: and there are -1 from the team there | 08:13 |
| akahat | arxcruz, chandankumar it is ready to merge: https://review.opendev.org/#/c/731501/ | 08:21 |
| chandankumar | ysandeep|rover: https://hackmd.io/3rAE3QawRXewcC8BIEvSAg?view let me know what do you think | 08:24 |
| *** sanjayu__ has quit IRC | 08:25 | |
| ysandeep|rover | chandankumar, thanks! checking | 08:25 |
| chandankumar | marios: I am blocking this review https://review.opendev.org/#/c/740869/1 reasons added here https://hackmd.io/3rAE3QawRXewcC8BIEvSAg?view | 08:26 |
| chandankumar | please remove the votes | 08:26 |
| marios | chandankumar: doing | 08:26 |
| *** sanjayu__ has joined #oooq | 08:27 | |
| *** sanjayu__ has quit IRC | 08:27 | |
| *** sanjayu__ has joined #oooq | 08:28 | |
| *** ykarel_ is now known as ykarel | 08:36 | |
| ysandeep|rover | chandankumar, looks good to me.. but just wondering what can be short term solution to unblock promotion till we fix promoter code.. Lets discuss in today's community meeting by then ronelle will be in too. | 08:39 |
| arxcruz | akahat: where's the job that is exercising this patch ? | 08:44 |
| *** derekh has joined #oooq | 08:48 | |
| *** pojadhav is now known as pojadhav|lunch | 08:48 | |
| ysandeep|rover | Hi folks, looking for reviews on new c8 train jobs -https://review.rdoproject.org/r/#/c/28340/ and https://review.rdoproject.org/r/#/c/28341/ , test runs are green | 08:49 |
| akahat | arxcruz, https://89f39d6d718501547319-7f8a4c585e620728c399ab8dbffa7ef2.ssl.cf1.rackcdn.com/731501/27/check/tripleo-ci-centos-8-scenario010-standalone/2271278/logs/undercloud/home/zuul/tempest/etc/tempest.conf | 08:51 |
| ysandeep|rover | marios, Have you hit this issue too during your update/upgrade c8 work - https://bugs.launchpad.net/tripleo/+bug/1887427 ? | 08:52 |
| openstack | Launchpad bug 1887427 in tripleo "TripleO CI jobs do not fail on package build errors" [Critical,Triaged] - Assigned to Ronelle Landy (rlandy) | 08:52 |
| *** bogdando has joined #oooq | 08:52 | |
| marios | ysandeep|rover: don't think i came across that one ... but it might be happening and i didn't notice... the job is apparently passing there? | 08:53 |
| ysandeep|rover | marios, this one failed at undercloud install.. but it should have failed earlier | 08:54 |
| ysandeep|rover | marios, yes even green run have same issue - https://f4678a4ab4c91ab11fd4-8eb14261f40a81c5485eeb11a7e72bf2.ssl.cf5.rackcdn.com/740873/1/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/641fe8c/logs/undercloud/home/zuul/dlrn.log | 08:58 |
| *** ccamacho has joined #oooq | 09:00 | |
| *** apetrich has joined #oooq | 09:00 | |
| marios | ysandeep|rover: thanks | 09:03 |
| ysandeep|rover | hmm even c7 update job have same logs - https://7e0affbd464b261bcc2a-f8803ca7587e43f6b66c9edae98e760b.ssl.cf5.rackcdn.com/739578/2/gate/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/cd5e1cc/logs/undercloud/home/zuul/dlrn.log , not sure if they are harmful at all, they were reported at info level logs | 09:05 |
| chandankumar | ysandeep|rover: yes, sure, let me see if I get the code ready | 09:08 |
| ysandeep|rover | chandankumar, ack | 09:09 |
| arxcruz | akahat: please check comments from cgoncalves | 09:20 |
| *** pojadhav|lunch is now known as pojadhav | 09:28 | |
| *** dtantsur is now known as dtantsur|bbl | 09:49 | |
| akahat | arxcruz, replied and updated. | 10:13 |
| *** dsneddon has quit IRC | 10:19 | |
| *** gouthamr has quit IRC | 10:22 | |
| *** gouthamr has joined #oooq | 10:23 | |
| *** dsneddon has joined #oooq | 10:23 | |
| ysandeep|rover | Hi folks, looking for reviews on new c8 train/ rhosp17 jobs -https://review.rdoproject.org/r/#/c/28340/ and https://review.rdoproject.org/r/#/c/28341/ , https://code.engineering.redhat.com/gerrit/#/c/201376/ - test runs are green | 10:32 |
| *** sanjayu__ has quit IRC | 10:33 | |
| *** dsneddon has quit IRC | 10:35 | |
| *** dsneddon has joined #oooq | 10:37 | |
| chandankumar | marios zbr ysandeep|rover akahat please have a look https://review.rdoproject.org/r/28521 when free | 10:42 |
| ysandeep|rover | chandankumar, ack | 10:43 |
| zbr | chandankumar: not sure how to say it but you managed to parse jinja2 and yaml with regex in a single patch.... that is a good candidate for my hall of fame | 10:46 |
| zbr | but it adds a new unittest, so not a chance to win the big prize | 10:47 |
| chandankumar | zbr: otherway around, I can remove jinja part and swith to yaml complelety but not sure how many release it will break | 10:47 |
| zbr | i am out of context, ok to meet to give me a little insight? | 10:48 |
| marios | ack chandankumar | 10:48 |
| *** ysandeep|rover is now known as ysandeep|afk | 10:53 | |
| *** dsneddon has quit IRC | 10:53 | |
| chandankumar | zbr: sure | 10:54 |
| chandankumar | zbr: let me pass the gmeet link | 10:54 |
| chandankumar | zbr: https://meet.google.com/wum-mudn-bry?pli=1&authuser=0 | 10:56 |
| *** dsneddon has joined #oooq | 10:56 | |
| chandankumar | zbr: voice breaking, let me recoonect | 11:00 |
| zbr | try w/o video | 11:00 |
| *** dsneddon has quit IRC | 11:06 | |
| *** dsneddon has joined #oooq | 11:07 | |
| *** dsneddon has quit IRC | 11:13 | |
| *** dsneddon has joined #oooq | 11:33 | |
| *** rlandy has joined #oooq | 11:43 | |
| *** dsneddon has quit IRC | 11:45 | |
| *** rlandy is now known as rlandy|ruck | 11:45 | |
| rlandy|ruck | zbr: ysandeep|afk: hey - how's it going? | 11:46 |
| rlandy|ruck | any luck with the promoter? | 11:46 |
| *** dsneddon has joined #oooq | 11:46 | |
| *** ysandeep|afk is now known as ysandeep | 11:47 | |
| ysandeep | rlandy|ruck, Hey o/ me and chandan initially tried using local excludes files but came to know we have other issues.. please check email chandan have summarized there.. | 11:48 |
| rlandy|ruck | ysandeep: did you ask zbr? | 11:48 |
| rlandy|ruck | or marios or anyone who worked on the promoter? | 11:48 |
| *** bogdando has quit IRC | 11:49 | |
| ysandeep | rlandy|ruck, zbr is also reviewing chandan's patch | 11:49 |
| *** bogdando has joined #oooq | 11:49 | |
| marios | rlandy|ruck: o/ | 11:49 |
| rlandy|ruck | marios: hey | 11:49 |
| zbr | rlandy|ruck: good, rebasing patches. | 11:52 |
| *** dsneddon has quit IRC | 11:53 | |
| rlandy|ruck | zbr: ok- so you'll make the change also directly on the promoter? | 11:53 |
| rlandy|ruck | it won;t pull the patch | 11:53 |
| zbr | ... i know. Still, i need chandan to finish it first. | 11:54 |
| *** dsneddon has joined #oooq | 11:54 | |
| ysandeep | rlandy|ruck, https://review.rdoproject.org/r/#/c/28521/ | 11:54 |
| rlandy|ruck | ok | 11:55 |
| chandankumar | zbr: jinja hack will work | 11:57 |
| marios | tripleo-tox-molecule failing in the gate? | 12:01 |
| marios | https://c3c4d9b326375e78bcd8-2bdda90a1128cbc54c09909a8150f07c.ssl.cf2.rackcdn.com/739939/2/gate/tripleo-tox-molecule/3975439/tox/molecule-1.log | 12:02 |
| ysandeep | marios, https://zuul.openstack.org/builds?job_name=tripleo-tox-molecule | 12:02 |
| ysandeep | build history is good | 12:03 |
| rlandy|ruck | marios: ack - I saw that | 12:03 |
| marios | ysandeep: yeah seems to be a fluke | 12:03 |
| marios | ysandeep: it happened in the gate on one of my patches that i'm watching | 12:03 |
| rlandy|ruck | marios: abandon restore | 12:03 |
| marios | ysandeep: i mean maybe env issue | 12:03 |
| marios | rlandy|ruck: thanks :/ | 12:03 |
| *** rfolco has joined #oooq | 12:03 | |
| zbr|ruck | anything with mirror failure needs a recheck first | 12:03 |
| marios | rlandy|ruck: but don't want to do that yet because it is part of a chain and there are more tests running will do once it reports thanks | 12:04 |
| rlandy|ruck | ysandeep: thanks for your comments on https://bugs.launchpad.net/tripleo/+bug/1887427 ... not sure what to do with this onw | 12:04 |
| openstack | Launchpad bug 1887427 in tripleo "TripleO CI jobs do not fail on package build errors" [Critical,Triaged] - Assigned to Ronelle Landy (rlandy) | 12:04 |
| rlandy|ruck | one | 12:04 |
| rlandy|ruck | Alex pointed it out yesterday | 12:04 |
| rlandy|ruck | and he's not usually wrong | 12:04 |
| rlandy|ruck | we should build a change to openstack/python-tripleoclient | 12:06 |
| rlandy|ruck | chandankumar: ^^ rught? | 12:06 |
| rlandy|ruck | right | 12:06 |
| ysandeep | rlandy|ruck, hmmm, but don't seems its failing on package build.. that is just a info level log | 12:07 |
| marios | rlandy|ruck: ysandeep: looks like it fails there (just happened i am looking through logs) i mean on package build for python-tripleoclient in this case https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_912/739459/8/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/912de69/logs/undercloud/home/zuul/dlrn.log | 12:07 |
| marios | rlandy|ruck: but it *did* fail the job here so maybe different from that bug | 12:07 |
| marios | ysandeep: ^ | 12:07 |
| rlandy|ruck | marios: it failed because it should have the patch | 12:07 |
| marios | rlandy|ruck: yeah its a depends-on there https://review.opendev.org/#/c/739459/ | 12:08 |
| rlandy|ruck | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_55c/730325/11/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/55cb03f/logs/undercloud/home/zuul/dlrn.log | 12:08 |
| rlandy|ruck | marios: ^^ what do you think? | 12:08 |
| marios | rlandy|ruck: not sure i mean ysandeep pointed me to the bug earlier but as he noted there is no 'error' there | 12:09 |
| chandankumar | rlandy|ruck: http://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_912/739459/8/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/912de69/logs/delorean_logs/component/tripleo/5c/51/5c51a1b0079352f9d2f82d3d1062d9e93a68cd40_dev/rpmbuild.log.txt.gz | 12:09 |
| chandankumar | rlandy|ruck: DEBUG: Bytecompiling .py files below /builddir/build/BUILDROOT/python-tripleoclient-12.3.2-0.20200714114621.5c51a1b.el8.x86_64/usr/lib/python3.6 using /usr/libexec/platform-python | 12:09 |
| chandankumar | DEBUG: *** Error compiling '/builddir/build/BUILDROOT/python-tripleoclient-12.3.2-0.20200714114621.5c51a1b.el8.x86_64/usr/lib/python3.6/site-packages/tripleoclient/utils.py'... | 12:09 |
| chandankumar | DEBUG: File "/usr/lib/python3.6/utils.py", line 1273 | 12:09 |
| chandankumar | DEBUG: ansible_config=ansible_config, | 12:09 |
| chandankumar | DEBUG: ^ | 12:10 |
| chandankumar | DEBUG: SyntaxError: invalid syntax | 12:10 |
| marios | rlandy|ruck: chandankumar: thanks looks like that one is actually a problem with the patches | 12:10 |
| rlandy|ruck | chandankumar: so the question is ... why did this job continue? | 12:10 |
| marios | chandankumar: rlandy|ruck: (I tried restoring some old patches from the upgrade squad somethign must have gone wrong there) | 12:10 |
| rlandy|ruck | marios: ^^ | 12:10 |
| marios | rlandy|ruck: no we are mixing logs | 12:10 |
| marios | rlandy|ruck: chandan is pointing to the ones i posted | 12:11 |
| marios | rlandy|ruck: which is not from the bug | 12:11 |
| marios | https://review.opendev.org/#/c/739459/ | 12:11 |
| *** dsneddon has quit IRC | 12:11 | |
| marios | rlandy|ruck: the ones chandankumar posted are from there ^^ | 12:11 |
| *** dsneddon has joined #oooq | 12:12 | |
| zbr | marios: i postes on infra, but they are not up yet. also logstash brings no results. i was good to recheck it. | 12:15 |
| rlandy|ruck | marios: k - so different problem on your patches? | 12:18 |
| marios | rlandy|ruck: yeah its a legit issue here fixing | 12:19 |
| rlandy|ruck | marios: yeah - in your case the job stopped | 12:20 |
| rlandy|ruck | which is correct | 12:20 |
| marios | rlandy|ruck: yes it failed the job at that point | 12:21 |
| rlandy|ruck | ok - so it is working | 12:21 |
| marios | rlandy|ruck: but was there an actual error in the bug case? | 12:21 |
| marios | rlandy|ruck: i didn't see one | 12:21 |
| *** udesale_ has joined #oooq | 12:22 | |
| marios | rlandy|ruck: i wonder if alex saw a different example? did you use the one he gave you for the bug? | 12:23 |
| *** derekh has quit IRC | 12:23 | |
| rlandy|ruck | marios: he claimed that the build failed and the job carried on ... | 12:23 |
| rlandy|ruck | 2020-07-13 23:25:24 | 2020-07-13 23:25:24,799 INFO:dlrn:137 packages not built correctly for component tripleo: not updating the consistent symlink | 12:24 |
| rlandy|ruck | ^^ that is confusing | 12:24 |
| *** udesale has quit IRC | 12:25 | |
| *** amoralej is now known as amoralej|lunch | 12:25 | |
| chandankumar | rlandy|ruck: it comes from dlrn stdout | 12:40 |
| chandankumar | zbr: https://review.rdoproject.org/r/#/c/28521/5/ci-scripts/dlrnapi_promoter/repo_client.py what do you think | 12:43 |
| chandankumar | it is working | 12:43 |
| chandankumar | I am adding tests also soon | 12:43 |
| panda | https://www.dumpaday.com/wp-content/uploads/2013/05/A-the-cat-behind-the-curtain-soon-meme.jpg | 12:46 |
| rlandy|ruck | sshnaidm: hi ... how is introspection looking on vexxhost? | 12:47 |
| *** dsneddon has quit IRC | 12:47 | |
| rlandy|ruck | should we keep https://bugs.launchpad.net/tripleo/+bug/1885314 open? | 12:47 |
| openstack | Launchpad bug 1885314 in tripleo "vexx: OVB master job running on vexxhost show some nodes failing introspection step" [Critical,In progress] - Assigned to Ronelle Landy (rlandy) | 12:47 |
| sshnaidm | sshnaidm, hi | 12:48 |
| sshnaidm | rlandy|ruck, hi | 12:48 |
| sshnaidm | rlandy|ruck, I didn't look at it recently | 12:49 |
| sshnaidm | rlandy|ruck, we have much bigger problem with vexxhost now | 12:49 |
| rlandy|ruck | sshnaidm: introspection was working a lot better for me downstream | 12:49 |
| rlandy|ruck | once we changes the ipxe image | 12:50 |
| sshnaidm | rlandy|ruck, I see some successful introspections in vexx | 12:50 |
| rlandy|ruck | sshnaidm: so maybe we close it and reopen once we can get to the point of introspection? | 12:50 |
| sshnaidm | rlandy|ruck, maybe worth to put it on hold for now, anyway it's not our biggest problem now | 12:50 |
| rlandy|ruck | sshnaidm: ack | 12:51 |
| rlandy|ruck | I'll explain that at next CIX | 12:51 |
| chandankumar | zbr: aroud? | 12:54 |
| chandankumar | zbr: https://review.rdoproject.org/r/#/c/28521/ please review | 12:54 |
| rlandy|ruck | bhagyashris: hey ... just checking up if you have thoughts on closing https://trello.com/c/SH18qURV/1479-cixlp1876893tripleociproa-error-error-removing-container-device-or-resource-busy | 12:56 |
| rlandy|ruck | so we have a centos8 train job that is workable? | 12:56 |
| *** holser has quit IRC | 12:58 | |
| *** dsneddon has joined #oooq | 12:58 | |
| bhagyashris | rlandy|ruck, not all c8 jobs are workable | 13:00 |
| *** rlandy|ruck is now known as rlandy|ruck|mtg | 13:00 | |
| ysandeep | Hi folks, looking for reviews on new c8 train/ rhosp17 jobs -https://review.rdoproject.org/r/#/c/28340/ and https://review.rdoproject.org/r/#/c/28341/ , https://code.engineering.redhat.com/gerrit/#/c/201376/ - test runs are green | 13:03 |
| *** ysandeep is now known as ysandeep|rover | 13:03 | |
| *** derekh has joined #oooq | 13:03 | |
| *** dsneddon has quit IRC | 13:08 | |
| *** dsneddon has joined #oooq | 13:10 | |
| *** Goneri has joined #oooq | 13:14 | |
| *** dsneddon has quit IRC | 13:16 | |
| *** ykarel is now known as ykarel|away | 13:16 | |
| *** amoralej|lunch is now known as amoralej | 13:18 | |
| *** dsneddon has joined #oooq | 13:23 | |
| *** skramaja has quit IRC | 13:24 | |
| *** TrevorV has joined #oooq | 13:27 | |
| rfolco | ping ci community call starting in 2 min | 13:28 |
| rfolco | arxcruz, rfolco, zbr, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankumar | 13:28 |
| *** dsneddon has quit IRC | 13:28 | |
| rfolco | at https://meet.google.com/bqx-xwht-wky | 13:28 |
| rfolco | https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw#2020-07-14-Community-call | 13:28 |
| *** dsneddon has joined #oooq | 13:33 | |
| *** dsneddon has quit IRC | 13:38 | |
| *** dsneddon has joined #oooq | 13:39 | |
| zbr | marios: not sure if you checked the thread on infra, apparently the 503 was an one-off from pypi, unrelated to us. | 13:43 |
| marios | zbr: thanks | 13:43 |
| marios | zbr: i did not | 13:43 |
| marios | (check) | 13:43 |
| *** dtantsur|bbl is now known as dtantsur | 13:45 | |
| zbr | just keeping you updated, also noted that we do not index these errors. | 13:46 |
| marios | thanks for digging there zbr | 13:54 |
| *** holser has joined #oooq | 13:55 | |
| rlandy|ruck|mtg | chandankumar: zbr: ysandeep|rover: do you want to meet to patch the promoter server? | 13:59 |
| *** dsneddon has quit IRC | 14:00 | |
| rlandy|ruck|mtg | is my tmate still available to you? | 14:00 |
| *** rlandy|ruck|mtg is now known as rlandy|ruck | 14:00 | |
| ysandeep|rover | rlandy|ruck|mtg, yes tmate is still working for me | 14:01 |
| chandankumar | rlandy|ruck: wait need to fix the test | 14:01 |
| rlandy|ruck | chandankumar: k -whenever you are ready | 14:01 |
| *** dsneddon has joined #oooq | 14:02 | |
| *** ykarel|away has quit IRC | 14:05 | |
| rfolco | zbr, I hit your closed bug https://github.com/ansible-community/molecule/issues/2570 | 14:08 |
| rfolco | zbr, no module named molecule | 14:08 |
| *** ratailor has quit IRC | 14:17 | |
| panda | zbr: rfolco I didn't, this passes now https://review.rdoproject.org/r/28429 | 14:19 |
| rfolco | panda, you didn't what | 14:20 |
| rfolco | I didn't what you didn't | 14:20 |
| rfolco | didn't you? | 14:20 |
| panda | I didn't | 14:21 |
| rlandy|ruck | ysandeep|rover: zbr: rdocloud stacks are clean again | 14:21 |
| rfolco | lol | 14:21 |
| rfolco | zbr, +2 on panda's patch ^, w+ it asap | 14:23 |
| rlandy|ruck | akahat: hey are you working on podman tests? | 14:26 |
| *** ykarel|away has joined #oooq | 14:26 | |
| akahat | rlandy|ruck, no. | 14:27 |
| ysandeep|rover | marios, rfolco, rlandy|ruck , sshnaidm, chandankumar - could you please add these patch in your reviews list (for your next turn ) - new c8 train/ rhosp17 jobs -https://review.rdoproject.org/r/#/c/28340/ and https://review.rdoproject.org/r/#/c/28341/ , https://code.engineering.redhat.com/gerrit/#/c/201376/ - test runs are green | 14:28 |
| marios | ysandeep|rover: ack | 14:29 |
| rlandy|ruck | rfolco: who is working on podman these days? | 14:29 |
| *** pojadhav is now known as pojadhav|brb | 14:34 | |
| rfolco | rlandy|ruck, I don't know | 14:39 |
| ysandeep|rover | sshnaidm, thanks for review .. I have updated https://code.engineering.redhat.com/gerrit/#/c/201376/ | 14:45 |
| *** ysandeep|rover is now known as ysandeep|food | 14:47 | |
| chandankumar | rlandy|ruck: Tengu | 14:48 |
| rlandy|ruck | ? | 14:49 |
| Tengu | hu? | 14:55 |
| Tengu | what did I do again? | 14:55 |
| panda | Tengu: confess | 14:55 |
| panda | Tengu: don't deny it. Nothing will happen to you. | 14:55 |
| Tengu | I'll have to kill you after that, panda | 14:55 |
| panda | Tengu: I'm protected by the WWF | 14:56 |
| *** dsneddon has quit IRC | 14:56 | |
| * Tengu doesn't care | 14:56 | |
| panda | Tengu: World Wrestliung FEderation. I will kick your butt. | 14:57 |
| * marios hands Tengu some bear traps - grabs popcorn | 14:57 | |
| *** dsneddon has joined #oooq | 14:57 | |
| Tengu | a daemon doesn't confess. period | 14:58 |
| Tengu | :] | 14:58 |
| chandankumar | Tengu: rlandy|ruck is looking for someone who can debug podman | 14:58 |
| chandankumar | *sorry working on podman | 14:58 |
| rlandy|ruck | chandankumar: ok ... | 14:58 |
| rlandy|ruck | chandankumar: is anyone actively working on those jobs? | 14:59 |
| weshay_pto | FYI.. component pipeline demo in the second half of the all-hands | 14:59 |
| * Tengu hides | 14:59 | |
| rlandy|ruck | chandankumar: also, can we change the version on those jobs? | 15:00 |
| weshay_pto | https://docs.google.com/presentation/d/1kmUsRwUzs02ZPAFfpq0uqpXCtXFDrhFeFDWmXooMvdY/edit?usp=sharing | 15:00 |
| rlandy|ruck | to test latest before it hits | 15:00 |
| chandankumar | rlandy|ruck: you mean podman one? | 15:00 |
| chandankumar | rlandy|ruck: pass me the job link | 15:00 |
| rlandy|ruck | chandankumar: I'm looking at containers/libpod jobs ... | 15:01 |
| chandankumar | rlandy|ruck: which version do we need there? | 15:01 |
| rlandy|ruck | https://review.rdoproject.org/zuul/builds?pipeline=openstack-regular | 15:01 |
| rlandy|ruck | the ones running ^^ | 15:02 |
| rlandy|ruck | chandankumar: according to Tengu, we should get a new 1.6.4 release soon | 15:02 |
| rlandy|ruck | chandankumar: possible to testproject with those jobs? | 15:03 |
| chandankumar | rlandy|ruck: we also need to rename libpod url to podan | 15:03 |
| chandankumar | rlandy|ruck: yes we can do a test project | 15:03 |
| chandankumar | Tengu: https://github.com/containers/podman/tree/v1.6 is good ?as 1.6.4 will come from this | 15:03 |
| Tengu | chandankumar: a new podman version is hitting rhel-8.2 right now, something like 1.6.4-15 | 15:04 |
| rlandy|ruck | https://github.com/rdo-infra/rdo-jobs/blob/master/playbooks/podman/install-podman-rpm.yaml | 15:04 |
| Tengu | chandankumar: and we'll need it in upstream in order to merge some patches in master, ussuri and train | 15:04 |
| rlandy|ruck | ^^ can we fix this to try the new version? | 15:04 |
| chandankumar | aye | 15:05 |
| Tengu | apparently the version is podman-1.6.4-15.module+el8.2.0+7290+954fb593 | 15:05 |
| chandankumar | rlandy|ruck: Tengu Let me take a look what can i do | 15:05 |
| rlandy|ruck | chandankumar: so ... https://github.com/rdo-infra/rdo-jobs/blob/master/playbooks/podman/pre.yaml builds the repo | 15:06 |
| rlandy|ruck | can't we up the version there | 15:06 |
| *** rlandy|ruck is now known as rlandy|ruck|mtg | 15:06 | |
| chandankumar | rlandy|ruck|mtg: https://github.com/rdo-infra/rdo-jobs/blob/master/playbooks/podman/run.yaml | 15:06 |
| *** dsneddon has quit IRC | 15:14 | |
| *** dsneddon has joined #oooq | 15:15 | |
| chandankumar | rlandy|ruck|mtg: trying here https://review.rdoproject.org/r/28523 | 15:17 |
| rlandy|ruck|mtg | chandankumar: thanks - updated and watching | 15:19 |
| rlandy|ruck|mtg | Patch Set 4: Starting check jobs. - getting there | 15:23 |
| rlandy|ruck|mtg | 2020-07-14 15:25:19.545511 | cloud-centos-8 | Please make sure you have the correct access rights | 15:26 |
| rlandy|ruck|mtg | 2020-07-14 15:25:19.545522 | cloud-centos-8 | and the repository exists. | 15:26 |
| rlandy|ruck|mtg | 2020-07-14 15:25:19.548180 | cloud-centos-8 | Error, empty output for info: 'NUMBER' | 15:26 |
| rlandy|ruck|mtg | 2020-07-14 15:25:19.550154 | cloud-centos-8 | make: *** No rule to make target 'package-install'. Stop. | 15:26 |
| rlandy|ruck|mtg | 2020-07-14 15:25:19.906837 | cloud-centos-8 | ERROR | 15:26 |
| rlandy|ruck|mtg | 2020-07-14 15:25:19.907088 | cloud-centos-8 | { | 15:26 |
| chandankumar | let me take a look | 15:28 |
| chandankumar | or i will take different route all together | 15:28 |
| *** ykarel|away has quit IRC | 15:30 | |
| *** dsneddon has quit IRC | 15:31 | |
| *** udesale_ has quit IRC | 15:35 | |
| *** ysandeep|food is now known as ysandeep | 15:38 | |
| chandankumar | zbr: rlandy|ruck|mtg feel free to take it away https://review.rdoproject.org/r/#/c/28521/ | 15:39 |
| chandankumar | hitting single test failure | 15:39 |
| *** ysandeep is now known as ysandeep|away | 15:43 | |
| rlandy|ruck|mtg | chandankumar: thanks ... zbr .. I assume you're on this change? | 15:44 |
| zbr | rlandy|ruck|mtg: yes I am ok, just waiting for CI results on it | 15:47 |
| zbr | code passed visual inspection | 15:48 |
| rlandy|ruck|mtg | nice | 15:48 |
| *** bogdando has quit IRC | 15:49 | |
| *** dsneddon has joined #oooq | 15:50 | |
| rlandy|ruck|mtg | zbr: train centos7 should promote today - ahead of the program call tomorrow | 15:52 |
| rlandy|ruck|mtg | will watch that | 15:52 |
| *** dsneddon has quit IRC | 15:55 | |
| *** dsneddon has joined #oooq | 15:58 | |
| chandankumar | rlandy|ruck|mtg: I wil get something working for podman tomorrow | 16:01 |
| *** marios is now known as marios|out | 16:01 | |
| chandankumar | as a stable solution without backporting anything i hope | 16:01 |
| weshay_pto | anyone need anything before I get back to work? | 16:01 |
| weshay_pto | email me as well.. | 16:01 |
| rlandy|ruck|mtg | chandankumar: k - I can start working on the get_hash changes for CR if you agree | 16:01 |
| chandankumar | rlandy|ruck|mtg: yes I agree | 16:02 |
| rlandy|ruck|mtg | k | 16:02 |
| *** rlandy|ruck|mtg is now known as rlandy|ruck | 16:02 | |
| weshay_pto | 0/ | 16:02 |
| rlandy|ruck | weshay_pto: later | 16:03 |
| rlandy|ruck | nice presentation :) | 16:03 |
| *** dsneddon has quit IRC | 16:05 | |
| *** sshnaidm is now known as sshnaidm|afk | 16:08 | |
| *** pojadhav|brb is now known as pojadhav | 16:11 | |
| *** dsneddon has joined #oooq | 16:17 | |
| chandankumar | rlandy|ruck: zbr fixed faling test https://review.rdoproject.org/r/28521 | 16:18 |
| chandankumar | feel free to take it now, /me logs out now | 16:18 |
| zbr | is late for me too, i will try to have a look once it reports the results | 16:19 |
| rlandy|ruck | zbr: if the test passes - should we cherry pick the change to the promoter server? | 16:20 |
| zbr | probably i will try to update it in full. not sure what panda recomends. | 16:21 |
| rlandy|ruck | zbr: what do you mean by "update it in full" | 16:22 |
| rlandy|ruck | re-enable pull? | 16:22 |
| zbr | doing a pull | 16:22 |
| zbr | not enabling, just manual pull | 16:22 |
| rlandy|ruck | understood | 16:22 |
| rlandy|ruck | ok - let me know before your EoD | 16:22 |
| rlandy|ruck | zbr: train is promoting now | 16:23 |
| rlandy|ruck | that is something | 16:23 |
| zbr | rlandy|ruck: https://media.makeameme.org/created/deploy-in-production-0e8c0e514f.jpg | 16:23 |
| rlandy|ruck | zbr: totally NO pressure | 16:23 |
| rlandy|ruck | zbr: sorry - I just mean ... let me know what I should do before your EoD | 16:24 |
| *** amoralej is now known as amoralej|off | 16:30 | |
| *** sshnaidm|afk is now known as sshnaidm | 16:48 | |
| rlandy|ruck | zbr: ysandeep|away: could you vote her pls ... https://review.opendev.org/#/c/740982/ | 16:55 |
| rlandy|ruck | so I don;t just self merge | 16:56 |
| *** derekh has quit IRC | 16:58 | |
| *** holser has quit IRC | 17:16 | |
| *** dtantsur is now known as dtantsur|afk | 17:31 | |
| *** marios|out has quit IRC | 17:35 | |
| *** dsneddon has quit IRC | 17:58 | |
| *** holser has joined #oooq | 19:18 | |
| *** soniya29 has quit IRC | 19:32 | |
| *** jmasud has quit IRC | 20:06 | |
| *** jmasud has joined #oooq | 20:07 | |
| *** dsneddon has joined #oooq | 21:11 | |
| *** TrevorV has quit IRC | 21:57 | |
| *** tosky has quit IRC | 22:50 | |
| *** holser has quit IRC | 23:10 | |
| *** saneax has joined #oooq | 23:27 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!
