| *** rfolco|rover has joined #oooq | 00:20 | |
| *** rfolco|rover has quit IRC | 00:25 | |
| *** ysandeep|away is now known as ysandeep | 00:28 | |
| *** Goneri has quit IRC | 01:11 | |
| *** amoralej|off has quit IRC | 01:48 | |
| *** radez has quit IRC | 01:52 | |
| *** jpena|off has quit IRC | 01:52 | |
| *** jmasud has joined #oooq | 02:45 | |
| *** ratailor has joined #oooq | 03:50 | |
| *** skramaja has joined #oooq | 03:54 | |
| *** jmasud has quit IRC | 03:56 | |
| *** ykarel|away is now known as ykarel | 03:58 | |
| *** radez has joined #oooq | 04:14 | |
| *** jmasud has joined #oooq | 04:40 | |
| *** udesale has joined #oooq | 05:30 | |
| *** marios has joined #oooq | 05:48 | |
| *** jfrancoa has joined #oooq | 05:50 | |
| *** jmasud has quit IRC | 05:50 | |
| *** jmasud has joined #oooq | 05:55 | |
| *** dpawlik has joined #oooq | 06:06 | |
| *** jmasud has quit IRC | 06:18 | |
| *** jmasud has joined #oooq | 06:19 | |
| chandankumar | sshnaidm|afk, I have fixed image build issue via https://review.opendev.org/#/c/727817/ if you see any other issue let me know | 06:46 |
|---|---|---|
| chandankumar | and tested here https://review.rdoproject.org/r/#/c/27431/ | 06:46 |
| sshnaidm|afk | chandankumar ++ | 06:47 |
| chandankumar | marios, Good morning, I tried to reproduce fs039 issue not able to reproduce here https://review.rdoproject.org/r/#/c/27431/ may be we can enable to_build flag in the job by default | 06:47 |
| marios | chandankumar: o/ morning | 06:48 |
| marios | chandankumar: can we run it a few times first please... its a race condition so it isn't consistent | 06:48 |
| chandankumar | marios, may be I can create multiple jobs from that and see how it goes | 06:49 |
| marios | chandankumar: so we don't have the root caus on the 'missing files' issue then? | 06:49 |
| marios | chandankumar: ack ok thanks for checking it | 06:49 |
| chandankumar | marios,yes, we donot able to find the root cause | 06:49 |
| marios | 09:49 < chandankumar> marios, may be I can create multiple jobs from that and see how it goes | 06:52 |
| marios | chandankumar: what jobs do you mean ^ | 06:52 |
| chandankumar | marios, from fs039 parent, I can create 4-5 fs039 jobs with different name and run them in a single patch to produce race condition | 06:53 |
| marios | chandankumar: ah i see what you mean | 06:53 |
| bhagyashris|ruck | marios, o/ morning ! | 06:58 |
| bhagyashris|ruck | marios, want to discuss regarding this issue https://bugs.launchpad.net/tripleo/+bug/1874418 | 07:00 |
| openstack | Launchpad bug 1874418 in tripleo "(inconsistent) periodic centos8 fs39 fails sometimes with Error, some other host (FA:16:3E:B5:60:2A) already uses address 10.0.0.1" [High,Triaged] | 07:00 |
| bhagyashris|ruck | i see ^ marked as promotion blocker and created card here https://trello.com/c/Ul38XCbz/1485-cixlp1874418tripleociproainconsistent-periodic-centos8-fs39-fails-sometimes-with-error-some-other-host-fa163eb5602a-already-uses | 07:01 |
| marios | bhagyashris|ruck: o/ morning | 07:01 |
| marios | bhagyashris|ruck: no it should not be marked as blocker checking | 07:01 |
| marios | bhagyashris|ruck: no it doesn't have the blocker flag. the reason it isn't a blocker is because it isn't in the promotion criteria (yet). | 07:02 |
| marios | bhagyashris|ruck: on the trello card i think i wrote that i.e. isn't blocker | 07:02 |
| bhagyashris|ruck | marios, i see this is not promotion blocker the job is commented from promotion criteria commented in promotion ceriteria list here you will see: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/CentOS-8/master.ini#L36 | 07:02 |
| marios | bhagyashris|ruck: right | 07:03 |
| bhagyashris|ruck | yeah i saw both the things | 07:03 |
| bhagyashris|ruck | 1 that bug is not marked as promotion blocker 2. your comment on card | 07:04 |
| bhagyashris|ruck | marios, i am not sure how the card is getting created on trello ... | 07:05 |
| marios | bhagyashris|ruck: i created that one... weshay|ruck asked me to create cards but they won't be blockers... probably belong in the 'prod chain degraded' column | 07:05 |
| bhagyashris|ruck | marios, my observation is I haven't seen this failure from 2020-05-04T10:06:50 here https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master&job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-master | 07:05 |
| bhagyashris|ruck | marios, ok | 07:06 |
| akahat | marios, o/ afternoon. | 07:11 |
| akahat | marios, this is good to go: https://review.opendev.org/#/c/726308/ | 07:12 |
| marios | akahat: o/ hi i already voted there you need to sell it to someone else ;D | 07:12 |
| akahat | marios, oh.. okay. | 07:13 |
| akahat | thanks :) | 07:13 |
| akahat | chandankumar, panda ^^ | 07:13 |
| marios | chandankumar: arxcruz: panda: sshnaidm|afk: please check easy review 10:12 < akahat> marios, this is good to go: https://review.opendev.org/#/c/726308/ | 07:14 |
| akahat | marios, fs039: hit the problem: https://review.rdoproject.org/r/#/c/27523/ | 07:17 |
| marios | akahat: ack :( | 07:18 |
| marios | akahat: i think chandankumar is also testing that in https://review.rdoproject.org/r/#/c/27431/ he will try and get a few more runs there | 07:19 |
| marios | akahat: yeah he has your Depends-On: https://review.opendev.org/#/c/725465/ | 07:20 |
| marios | akahat: maybe the to_build will make the difference on chandankumar test let's see | 07:20 |
| akahat | great.. let's see. :) | 07:22 |
| akahat | marios, chandankumar looks like we are not collecting /var/lib/ipa-client dir in the logs. | 07:24 |
| chandankumar | akahat, send a patch in collect-logs to collect that | 07:25 |
| marios | akahat: wrt https://review.opendev.org/#/c/726308/ did you also post rocky/stein? | 07:26 |
| marios | akahat: i left a comment there about it i.e. this job is currently gating in rocky and also need to remove from stein | 07:26 |
| *** holser has joined #oooq | 07:27 | |
| akahat | chandankumar, okay. | 07:27 |
| marios | akahat: worfklowing that one but please post the other branches too | 07:27 |
| akahat | marios, i think i did.. let me check. | 07:28 |
| marios | akahat: i checked the topic branch but didn't see them https://review.opendev.org/#/q/topic:disable_c7_009_oooq+(status:open+OR+status:merged) | 07:28 |
| marios | akahat: try to re-use that ^^^ | 07:28 |
| marios | akahat: usually if there is a cherrypick they show up in the gerrit interface | 07:28 |
| akahat | marios, no.. I didn't raise review req against rocky. I'll raise it. | 07:30 |
| marios | akahat: ack | 07:30 |
| *** tosky has joined #oooq | 07:31 | |
| chandankumar | marios, I made some progress on build downstream packages http://paste.openstack.org/show/793550/ | 07:32 |
| *** dtantsur|afk is now known as dtantsur | 07:32 | |
| chandankumar | marios, I will let you know when to review the build test packages changes, | 07:34 |
| chandankumar | till then let me do the r&d | 07:34 |
| marios | chandankumar: ack ok yeah i just tried a first pass but was hard to review i am not very familiar with that project so +1 and some questions for now :D | 07:34 |
| chandankumar | :-) | 07:35 |
| *** jmasud has quit IRC | 07:38 | |
| panda | z | 07:39 |
| *** jmasud has joined #oooq | 07:39 | |
| Tengu | y | 07:39 |
| chandankumar | :x | 07:40 |
| marios | ψ ? | 07:40 |
| Tengu | \o/ | 07:40 |
| Tengu | now, where's Aquaman?! We have his trident right? :] | 07:40 |
| panda | guys ... just wanted to point out how sleepy I was, no need to start a chain of nonsense :) | 07:41 |
| marios | ;) | 07:41 |
| Tengu | panda: chain of nonsense has its own sense | 07:41 |
| marios | nice panda nice... you start a chain of nonsense and then we are to blame | 07:41 |
| Tengu | :] | 07:41 |
| marios | some people just want to watch the world burn | 07:41 |
| * Tengu pours some more fuel | 07:42 | |
| Tengu | :] | 07:42 |
| chandankumar | ( . ) | 07:42 |
| chandankumar | ) ( ) | 07:42 |
| chandankumar | . ' . ' . ' . | 07:42 |
| chandankumar | ( , ) (. ) ( ', ) | 07:42 |
| chandankumar | .' ) ( . ) , ( , ) ( . | 07:42 |
| chandankumar | ). , ( . ( ) ( , ') .' ( , ) | 07:42 |
| chandankumar | (_,) . ), ) _) _,') (, ) '. ) ,. (' ) | 07:42 |
| chandankumar | sorry brought fire here | 07:42 |
| panda | that's it, quarantine finally got us all. | 07:45 |
| *** amoralej has joined #oooq | 07:45 | |
| * Tengu sings «I want to break free» | 07:47 | |
| * panda imagines Tengu dressed as a girl, vacuuming the floor of a busy house. | 07:50 | |
| Tengu | panda: you love seeing bad things right? :] | 07:51 |
| panda | That definitely woke me up, and I don't think I'll be able to sleep tonight | 07:52 |
| Tengu | panda: that said - Japan has their Ladybeard (former wrestler now "metal" singer in a Japan group) | 07:52 |
| *** ccamacho has joined #oooq | 07:55 | |
| *** jpena has joined #oooq | 07:57 | |
| ysandeep | marios, o/ my initial first try to add one scenario in internal component pipeline- https://code.engineering.redhat.com/gerrit/#/c/200373/ , please add to your review list. | 08:01 |
| *** ykarel is now known as ykarel|lunch | 08:11 | |
| ysandeep | chandankumar, https://code.engineering.redhat.com/gerrit/#/c/200373/ review please, whenever you have some free slot. | 08:12 |
| *** ysandeep is now known as ysandeep|lunch | 08:14 | |
| *** ccamacho has quit IRC | 08:20 | |
| chandankumar | akahat, marios https://review.rdoproject.org/r/27431 fs039 multiple jobs | 08:26 |
| *** ccamacho has joined #oooq | 08:34 | |
| *** dpawlik has quit IRC | 08:40 | |
| zbr | chandankumar: hi! ready to look into libpod? | 08:41 |
| chandankumar | zbr, sorry in another call | 08:42 |
| *** dpawlik has joined #oooq | 08:45 | |
| marios | ysandeep|lunch: ack will check | 08:46 |
| marios | thanks chandankumar | 08:46 |
| *** jmasud has quit IRC | 08:47 | |
| *** ysandeep|lunch is now known as ysandeep | 09:03 | |
| ysandeep | marios, thanks! | 09:03 |
| *** sshnaidm|afk is now known as sshnaidm | 09:11 | |
| *** ykarel|lunch is now known as ykarel | 09:31 | |
| chandankumar | zbr, we have libpod meeting scheduled also, do we want to talk there or right now? | 09:36 |
| zbr | not necessary to talk, but to start fixing the jobs. | 09:36 |
| zbr | what was your original change? i think we need to temporary make them nv, till we fix all issues. | 09:37 |
| zbr | i am aware of at least 3 issues. | 09:37 |
| zbr | the meeting will be more about strategy and future plans | 09:37 |
| chandankumar | zbr, https://review.rdoproject.org/r/27385 | 09:37 |
| chandankumar | it gets latest golang version | 09:38 |
| chandankumar | do you have issues listed somewhere? | 09:38 |
| chandankumar | apart from btrfs | 09:38 |
| zbr | no, only btrfs is listed on their tracker | 09:39 |
| chandankumar | zbr, I have not yet tried to reproduce locally | 09:40 |
| zbr | can you add "libpod" topic to your change so we can easily find them. | 09:40 |
| zbr | lets use this topic for all changes specific to libpod | 09:40 |
| zbr | mine is https://review.rdoproject.org/r/#/c/27527/ | 09:40 |
| zbr | and it fixes btrfs for centos-8, i checked logs. | 09:41 |
| zbr | ugly, but it works and libpod team has very low interest in packaging automation | 09:41 |
| chandankumar | the patch is merged now, so we cannot change the topic | 09:42 |
| chandankumar | jpena, Helo | 09:49 |
| chandankumar | jpena, Hello | 09:49 |
| chandankumar | jpena, I am hitting this issue currently http://paste.openstack.org/show/793568/ | 09:49 |
| chandankumar | on downstream build test packages changes | 09:50 |
| jpena | o/ | 09:50 |
| * jpena reads | 09:50 | |
| chandankumar | https://code.engineering.redhat.com/gerrit/gitweb?p=ospinfo.git;a=blob;f=osp-full.yml;h=cbb4c47d5709fa95d889a6f24debd1bdb4047ebe;hb=refs/heads/master | 09:50 |
| jpena | chandankumar: ok, it makes sense | 09:52 |
| chandankumar | here is the detailed failure http://paste.openstack.org/show/793569/ | 09:52 |
| jpena | rdopkg, when specifying a directory, uses "rdo-full.yml" as default file name to check for. In this case, we are using ospinfo, so we need to specify a different line | 09:53 |
| jpena | we should do "rdopkg findpkg -s puppet-tripleo -i ospinfo/osp-full.yml" | 09:53 |
| jpena | -i instead of -l, and we can specify the file | 09:53 |
| chandankumar | ok let me make the changes | 09:54 |
| jpena | I've tested it locally and it works for me | 09:54 |
| zbr | anyone that likes naming things? https://github.com/ansible-community/molecule/issues/2700 | 09:55 |
| *** ykarel is now known as ykarel|mtg | 10:02 | |
| chandankumar | jpena, http://paste.openstack.org/show/793572/ | 10:14 |
| chandankumar | jpena, -i is unrecognised argument | 10:15 |
| jpena | o_O | 10:16 |
| jpena | which rdopkg version is installed? I've tested 1.1.0 (from package) and 1.2.0 (from pip) and both work | 10:17 |
| jpena | https://github.com/openstack/tripleo-quickstart-extras/blob/ed21a5cb3b37604f2fa9094e4040d0dd55f1649c/roles/build-test-packages/tasks/main.yml#L116 | 10:18 |
| jpena | chandankumar: ^^ there it is | 10:18 |
| jpena | it's using an ancient version | 10:18 |
| chandankumar | fixing that | 10:19 |
| zbr | panda: problem, bug in unsupported molecule seems to prevent some changes, we no longer support py27 | 10:38 |
| panda | that's why I want to get rid of all centos7 stuff | 10:39 |
| panda | zbr:put all the old jobs in a box and don't touch it | 10:39 |
| zbr | yep, that is the best selling point for cloning the role | 10:40 |
| zbr | as I do not want to make any backports on molecule | 10:40 |
| *** derekh has joined #oooq | 10:43 | |
| chandankumar | jpena, http://paste.openstack.org/show/793576/ | 10:45 |
| chandankumar | jpena, is there a way we can pass ospinfo/osp.yml file to dlrn? | 10:52 |
| jpena | chandankumar: in the projects.ini file, set rdoinfo_file=osp.yml in the [rdoinfo_driver] section | 10:54 |
| chandankumar | jpena, done, let'see how it goes now | 10:59 |
| chandankumar | zbr, centos-8 podman job is back to normal | 11:12 |
| zbr | chandankumar: lets merge it | 11:13 |
| chandankumar | but btrfs issue on rhel-8 | 11:14 |
| chandankumar | may be we can enable the same for rhel-8 also | 11:14 |
| zbr | yeah, | 11:14 |
| zbr | chandankumar: can you take care of this? i am trying to help panda with internal promoter | 11:15 |
| chandankumar | zbr, sure | 11:15 |
| *** ykarel|mtg is now known as ykarel | 11:18 | |
| *** pojadhav is now known as pojadhav|afk | 11:19 | |
| chandankumar | jpena, https://review.opendev.org/#/c/727200/23/roles/build-test-packages/templates/projects.ini.j2 is correct na? | 11:19 |
| jpena | chandankumar: I think so... That split thing to get "osp" is interesting though, if it fails I'd test it locally | 11:21 |
| chandankumar | jpena, it failed with same error | 11:21 |
| jpena | chandankumar: hm wait | 11:22 |
| jpena | maybe I gave you a wrong option name | 11:22 |
| chandankumar | jpena, https://sf.hosted.upshift.rdu2.redhat.com/logs/84/200084/14/check/periodic-tripleo-ci-rhel-8-standalone-rhos-17/5b117a0/job-output.txt | 11:22 |
| jpena | yes, my fault | 11:22 |
| jpena | the option name should be "info_files", instead of "rdoinfo_file" | 11:22 |
| jpena | I read the code wrong | 11:22 |
| chandankumar | jpena, updated, let'see | 11:25 |
| *** pojadhav|afk is now known as pojadhav | 11:44 | |
| *** udesale has quit IRC | 11:44 | |
| *** rlandy has joined #oooq | 11:53 | |
| chandankumar | jpena, https://pagure.io/zuul-distro-jobs/issue/61 | 11:57 |
| *** udesale has joined #oooq | 11:58 | |
| weshay|ruck | zbr, chandankumar I have to drop for another.. will catch up w/ you guys on this later | 11:59 |
| chandankumar | jpena, https://github.com/containers/libpod/issues/6171 | 11:59 |
| chandankumar | jpena, new error https://sf.hosted.upshift.rdu2.redhat.com/logs/84/200084/14/check/periodic-tripleo-ci-rhel-8-standalone-rhos-17/a81e97a/job-output.txt | 12:02 |
| *** udesale_ has joined #oooq | 12:04 | |
| chandankumar | jpena, http://paste.openstack.org/show/793580/ | 12:06 |
| chandankumar | jpena, can I get the downstream project.ini file | 12:07 |
| jpena | chandankumar: oh, that's going to require some more changes (actually, we'll have to use the downstream driver instead of rdoinfo). | 12:07 |
| jpena | need to run for lunch now, I'll prepare a paste with the required details after | 12:07 |
| *** jpena is now known as jpena|lunch | 12:07 | |
| chandankumar | jpena|lunch, sure | 12:08 |
| chandankumar | zbr, https://review.rdoproject.org/r/#/c/27527/2 merge it | 12:08 |
| chandankumar | zbr, will deal with fedora 31 soon | 12:09 |
| *** amoralej is now known as amoralej|lunch | 12:11 | |
| zbr | weshay|ruck: panda ^ help use merge it, already fixed two libpod platforms. we will other fixes in follow-ups | 12:12 |
| panda | zbr: chandankumar but this is not pure ansible approace | 12:15 |
| panda | zbr: also, WHAT THE EL IS ELREPO ? | 12:16 |
| panda | also, because I'm racist, I can't stop thinking about a sombrero every time I read the name. | 12:16 |
| zbr | panda: a repo that will bring chupacabra in your home | 12:16 |
| panda | this is not un repo senor, this is EL REPO | 12:17 |
| zbr | i think i will start my own repo, "elchapo" | 12:17 |
| panda | wasn't there anything more official ? | 12:17 |
| *** rfolco|rover has joined #oooq | 12:20 | |
| chandankumar | zbr, weshay|ruck opened new issue https://github.com/containers/libpod/issues/6226 | 12:21 |
| chandankumar | zbr, donot merge | 12:21 |
| chandankumar | updating it for fedora | 12:21 |
| *** saneax has joined #oooq | 12:21 | |
| *** saneax has quit IRC | 12:22 | |
| *** saneax has joined #oooq | 12:23 | |
| *** sanjayu_ has quit IRC | 12:23 | |
| *** jbadiapa has joined #oooq | 12:25 | |
| *** Goneri has joined #oooq | 12:28 | |
| *** sanjayu_ has joined #oooq | 12:30 | |
| chandankumar | weshay|ruck, 1:1 time | 12:31 |
| *** saneax has quit IRC | 12:31 | |
| weshay|ruck | chandankumar, I'm in | 12:32 |
| *** saneax has joined #oooq | 12:32 | |
| *** derekh has quit IRC | 12:34 | |
| chandankumar | weshay|ruck, https://review.rdoproject.org/r/#/c/27545/ | 12:34 |
| *** sanjayu_ has quit IRC | 12:35 | |
| *** saneax has quit IRC | 12:35 | |
| *** saneax has joined #oooq | 12:35 | |
| *** ratailor has quit IRC | 12:36 | |
| marios | chandankumar: rlandy: i recall a card/possibly in jira about the image server for d/stream image build jobs - if you know what i mean can you give me a link please? | 12:40 |
| marios | chandankumar: rlandy: i.e. we were waiting for apevec to sort something for us to be able to push images | 12:41 |
| panda | marios: done | 12:41 |
| panda | marios: pvt | 12:41 |
| *** saneax has quit IRC | 12:41 | |
| marios | panda: thanks checking | 12:42 |
| chandankumar | weshay|ruck, https://github.com/containers/libpod/issues/6226 | 12:44 |
| rlandy | marios: yep - chandankumar sent us the link | 12:47 |
| rlandy | marios: how are things this morning? | 12:47 |
| marios | rlandy: ack didn't note it thanks added to card now | 12:47 |
| rlandy | I see we had some failures yesterday | 12:47 |
| rlandy | looks like the python-six thing again? | 12:48 |
| rlandy | not sure | 12:48 |
| marios | rlandy: been digging at the image build card ... theres a couple things we need to do there i am updating https://tree.taiga.io/project/tripleo-ci-board/task/1728?kanban-status=1447274 with notes/design | 12:48 |
| marios | rlandy: i saw some fails on e.g. compute promote to promoted components but then realised its cos the standalone job there hadn't even run yet (the pipeline hadn't) | 12:48 |
| marios | rlandy: pointer to fails you mean? | 12:49 |
| marios | rlandy: i was glad to see the standalone green finally after the repo priority fix | 12:49 |
| marios | rlandy: and all the pipelines running \o/ | 12:49 |
| marios | rlandy: we should hav started the conversation with that bit ^^^ | 12:49 |
| rlandy | marios: yep - some had not run yet | 12:49 |
| marios | rlandy: so, what fails you mean ? | 12:49 |
| rlandy | because they had failed on yesterday's run | 12:50 |
| rlandy | marios; we can catch up at scrum ( or afterwards) | 12:50 |
| marios | rlandy: ack yes | 12:50 |
| marios | rlandy: ysandeep: posted a patch see * https://code.engineering.redhat.com/gerrit/#/c/200373/2 | 12:51 |
| ysandeep | rlandy, o/ hey! | 12:52 |
| ysandeep | marios, uploaded a new patchset with your suggestions | 12:53 |
| marios | ysandeep: ack get the jobs running though do testproject | 12:53 |
| marios | ysandeep: will revisit the review | 12:53 |
| ysandeep | marios, yes testproject up too.. tested with one job - https://code.engineering.redhat.com/gerrit/#/c/200402/ | 12:54 |
| marios | ysandeep: ack great will check on next reviews run | 12:54 |
| *** ykarel is now known as ykarel|afk | 12:54 | |
| ysandeep | marios, thanks! | 12:54 |
| weshay|ruck | rfolco|rover, bhagyashris|ruck doing ok w/ ruck / rover work? need anything? | 12:58 |
| bhagyashris|ruck | weshay|ruck, yes if anything needs will ping you .. :) | 12:59 |
| *** amoralej|lunch is now known as amoral | 12:59 | |
| *** saneax has joined #oooq | 13:00 | |
| *** amoral is now known as amoralej | 13:00 | |
| weshay|ruck | sshnaidm, scrum | 13:02 |
| marios | arxcruz, rfolco, zbr, panda, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankumar | 13:02 |
| marios | scrum time | 13:02 |
| *** jpena|lunch is now known as jpena | 13:05 | |
| *** saneax has quit IRC | 13:07 | |
| jpena | chandankumar: so, we'd need to set the following options in projects.ini to use the downstream driver (and remove the rdoinfo_driver options, they're not needed anymore) -> http://paste.openstack.org/show/793583/ | 13:09 |
| *** derekh has joined #oooq | 13:12 | |
| marios | panda: criteria at https://code.engineering.redhat.com/gerrit/#/c/200262 | 13:30 |
| chandankumar | jpena, http://paste.openstack.org/show/793586/ | 13:31 |
| chandankumar | jpena, and here is https://review.opendev.org/#/c/727200/25/roles/build-test-packages/templates/projects.ini.j2 | 13:31 |
| jpena | chandankumar: that looks like a typo | 13:31 |
| panda | marios: ok, I will copy this on the promoter server. Until I complete the work on multiconfiguration, the promoter will not be able to get this file automatically. | 13:32 |
| jpena | there's a missing \n before pkginfo_driver | 13:32 |
| jpena | chandankumar: I think the initial {%- in "{%- if osp_release is defined -%}" is preventing the newline | 13:34 |
| chandankumar | jpena, do we need both pkginfo_driver ? | 13:36 |
| chandankumar | pkginfo_driver=dlrn.drivers.rdoinfo.RdoInfoDriver and downstream one also? | 13:37 |
| marios | panda: ack | 13:37 |
| jpena | chandankumar: no, it's either one (RdoInfoDriver for RDO, DownstreamInfoDriver for OSP) or the other | 13:37 |
| jpena | i just saw it was already in line 12 | 13:38 |
| chandankumar | I need to make it conditional | 13:38 |
| chandankumar | jpena, can you check now https://review.opendev.org/#/c/727200/26/roles/build-test-packages/templates/projects.ini.j2 | 13:41 |
| weshay|ruck | https://review.opendev.org/#/c/720434/ | 13:41 |
| chandankumar | jpena, remove %- | 13:42 |
| jpena | chandankumar: I think that should work | 13:42 |
| weshay|ruck | https://review.opendev.org/#/c/724256/ | 13:45 |
| chandankumar | panda, https://review.opendev.org/#/q/topic:octavia_ostempest+(status:open+OR+status:merged) | 13:47 |
| arxcruz | sshnaidm: so, i need to set the default to a variable right ? | 13:48 |
| arxcruz | sshnaidm: thanks for the help :) | 13:48 |
| sshnaidm | arxcruz, np | 13:48 |
| panda | arxcruz: you're creating a thred per job ? maybe you don't know if you're using channels ... | 13:52 |
| arxcruz | panda: i'm using go routine | 13:52 |
| arxcruz | using channels | 13:52 |
| panda | arxcruz: I'm curious how that scales to 1000 jobs :) | 13:52 |
| arxcruz | panda: https://twitter.com/arxcruz/status/1260556216889114624 | 13:53 |
| arxcruz | panda: we can try, but i don't think zuul keeps 1000 logs from the same job | 13:53 |
| panda | arxcruz: we have other jobs ... | 13:53 |
| panda | arxcruz: 100 per job and we are set :) | 13:54 |
| arxcruz | panda: we can try :) | 13:54 |
| arxcruz | panda: makes sense :D | 13:54 |
| arxcruz | panda: want to re-write the promoter in go? LOL | 13:55 |
| panda | arxcruz: I'm already doing it, but don't tell anyone | 13:55 |
| arxcruz | panda: may I get involved? | 13:56 |
| panda | arxcruz: I wanted to undestand if we can get better container push performance | 13:57 |
| arxcruz | panda: maybe with the goroutines you can ? | 13:57 |
| arxcruz | what i liked is that is very simple to do than in other languages | 13:57 |
| panda | arxcruz: it was designed with concurrency in mind, one it's main design principles | 13:58 |
| arxcruz | panda: yeah, still very impressive how easy and "it just works" it is | 13:58 |
| panda | arxcruz: I'll ping when I'll get a chance to work on that part :) | 13:59 |
| weshay|ruck | sshnaidm, https://trello.com/c/Ul38XCbz/1485-cixlp1874418tripleociproainconsistent-periodic-centos8-fs39-fails-sometimes-with-error-some-other-host-fa163eb5602a-already-uses | 14:00 |
| *** pojadhav is now known as pojadhav|afk | 14:01 | |
| marios | rlandy: chandankumar: so... merge the easy ones first? (renames osp17) https://code.engineering.redhat.com/gerrit/200389 https://code.engineering.redhat.com/gerrit/200390 then i'll remove the -master ones after | 14:02 |
| marios | otherwise zuul is very unhappy with the situation | 14:03 |
| marios | chandankumar: also, any idea about the missing logs issue was it previously working (i.e. https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-rhel-8-buildimage-overcloud-full-master/47f0d39/ ) | 14:03 |
| *** TrevorV has joined #oooq | 14:07 | |
| *** ykarel|afk is now known as ykarel | 14:07 | |
| rlandy | marios: I think you will have to | 14:12 |
| rlandy | because of the config situation | 14:12 |
| rlandy | looking at reviews | 14:13 |
| rlandy | marios: merging https://code.engineering.redhat.com/gerrit/#/c/200389 - ok? | 14:13 |
| *** jfrancoa has quit IRC | 14:15 | |
| *** jmasud has joined #oooq | 14:15 | |
| marios | rlandy: ack thanks | 14:16 |
| marios | rlandy: will post the removal one once these go in | 14:16 |
| rlandy | done | 14:17 |
| rlandy | marios: perfect | 14:17 |
| rlandy | will merge patch 2 when 1 goes through | 14:17 |
| marios | rlandy: thanks | 14:18 |
| rlandy | ysandeep: thanks for you patch - will review in my afternoon | 14:19 |
| rlandy | marios: ok - both w+'ed - 1 merged | 14:20 |
| ysandeep | rlandy, thank you :) if it is okay then will send multiple patch tomorrow | 14:20 |
| panda | marios: rlandy so is it ok if I launch some promoter runs for example tomorrow ? I wanted to wait for overcloud images, but I can tell the promoter to skip them for now. | 14:21 |
| panda | marios: rlandy it may mess up the containers ... I hope it won't but it can happen ... | 14:22 |
| marios | rlandy: chandankumar: ok then lets remove old ones https://code.engineering.redhat.com/gerrit/200425 Remove the rhel8 osp17 buildimage -master jobs we have -rhos-17 | 14:22 |
| marios | rlandy: hmm nope | 14:23 |
| marios | rlandy: something still running them | 14:23 |
| marios | panda: fine by me... but can you use a test namespace ? | 14:23 |
| marios | panda: in case for containers | 14:23 |
| marios | rlandy: chandankumar: fixing looks like ciinternal-jobs still has some reerences | 14:24 |
| panda | marios: I'll see what I can do. Is there a best moment in the day ? | 14:24 |
| marios | rlandy: chandankumar: i think ok now https://code.engineering.redhat.com/gerrit/#/c/200425/ | 14:26 |
| rlandy | looking | 14:26 |
| rlandy | marios: none of those are pushing images yet, right? | 14:27 |
| rlandy | ie: not the ones in the check queue | 14:27 |
| * rlandy asks after I 2'ed :) | 14:27 | |
| rlandy | ysandeep: ack - send away | 14:30 |
| marios | rlandy: right | 14:31 |
| *** jfrancoa has joined #oooq | 14:31 | |
| rlandy | marios: ok- going to start with ovb in rhos-17 - let's see if that goes anywhere | 14:34 |
| marios | rlandy: sounds good, i'll continue to dig @ build-image and we can sync latr/tomorrow as needed | 14:34 |
| rlandy | panda: that's fine | 14:38 |
| rlandy | panda: we'll take a bit of a hit if need be | 14:38 |
| rlandy | panda: last night I manually prompted tripleo-ci-testing to current-tripleo ... but I won;t do that tonight | 14:39 |
| rlandy | your test can do that | 14:39 |
| panda | rlandy: ok, thanks. | 14:39 |
| rlandy | panda: sending you access to the downstream registry | 14:39 |
| rlandy | in case you need to check something | 14:39 |
| chandankumar | marios, regarding image log issue, will take a look | 14:41 |
| marios | chandankumar: thanks | 14:44 |
| marios | chandankumar: so it used to work tho? | 14:44 |
| chandankumar | marios, yes | 14:44 |
| marios | chandankumar: ack so we inadvertently broke it | 14:45 |
| chandankumar | marios, Grab job artifacts logs are getting collected | 14:45 |
| chandankumar | marios, may be something happened due to image server creation on log server? | 14:46 |
| *** jfrancoa has quit IRC | 14:48 | |
| *** beagles_pto is now known as beagles | 14:51 | |
| rlandy | marios: merging https://code.engineering.redhat.com/gerrit/#/c/200425/ | 15:02 |
| chandankumar | jpena, rlandy DLRN is running | 15:03 |
| rlandy | marios: we should put the standalone-rhos-17 job back into check (running standalone changes) | 15:03 |
| chandankumar | but us faiked | 15:03 |
| rlandy | chandankumar? on which job? | 15:03 |
| chandankumar | /usr/bin/git clone git+ssh://pkgs.devel.redhat.com/rpms/puppet-tripleo ./data/puppet-tripleo_distro | 15:03 |
| chandankumar | it failed | 15:03 |
| rlandy | chandankumar: pls post link | 15:03 |
| rlandy | you may need to update python-six | 15:04 |
| chandankumar | rlandy, build test packages in rhos-17 | 15:04 |
| rlandy | oh | 15:04 |
| rlandy | that's different | 15:04 |
| rlandy | sorry - thought we were still talking image-builds | 15:04 |
| marios | rlandy: you mean for check queue in d/stream? for which repos? | 15:04 |
| rlandy | marios: ack | 15:05 |
| rlandy | I removed it while it was failing | 15:05 |
| marios | rlandy: ok sure sounds good to readd | 15:05 |
| marios | rlandy: does it run in internal-jobs i guess? | 15:05 |
| rlandy | marios: also cleaning up the tenant ... do you still need your VM there? | 15:05 |
| rlandy | marios: it should | 15:06 |
| marios | rlandy: I don't but panda was using it ^^ | 15:07 |
| rlandy | marios: ah fine - leaving it | 15:07 |
| jpena | chandankumar: does cloning an internal repo require specific credentials? | 15:08 |
| rlandy | weshay|ruck: you still using your vm? on internal? | 15:09 |
| * rlandy cleaning up | 15:09 | |
| rlandy | need the nodes for OVB | 15:09 |
| weshay|ruck | rlandy, no | 15:09 |
| rlandy | weshay|ruck: k - I left the one we are using for promotions | 15:09 |
| weshay|ruck | k | 15:09 |
| chandankumar | jpena, http://paste.openstack.org/show/793593/ | 15:11 |
| *** jfrancoa has joined #oooq | 15:12 | |
| chandankumar | let me try that locally | 15:12 |
| *** ykarel is now known as ykarel|away | 15:12 | |
| jpena | chandankumar: "Host key verification failed.". That'll have to be the first step, but then we'll see if it requires credentials | 15:12 |
| chandankumar | jpena, we need to remove +ssh part | 15:13 |
| chandankumar | then anonymous clone works | 15:13 |
| chandankumar | /usr/bin/git clone git://pkgs.devel.redhat.com/rpms/puppet-tripleo | 15:13 |
| chandankumar | jpena, is there a way we can work around that part? | 15:14 |
| *** skramaja has quit IRC | 15:16 | |
| * chandankumar will be away for an hour | 15:16 | |
| chandankumar | jpena, please add the instructions here, I will apply later | 15:16 |
| chandankumar | once back | 15:17 |
| ysandeep | sshnaidm++ | 15:27 |
| jpena | chandankumar: as a quick workaround, we could do sed -i 's/git+ssh/git/' ospinfo/packages.yml | 15:30 |
| *** jmasud has quit IRC | 15:31 | |
| *** ysandeep is now known as ysandeep|sleep | 15:31 | |
| jpena | chandankumar: for the downstream use case, I think it makes sense to use git+ssh (because rhpkg will push changes), but not for this case | 15:32 |
| *** jmasud has joined #oooq | 15:35 | |
| weshay|ruck | panda, turn rhel8 train off please http://38.102.83.109/?C=M;O=D | 15:35 |
| *** pojadhav|afk is now known as pojadhav | 15:40 | |
| panda | weshay|ruck: for good or temprary in the server ? | 15:42 |
| weshay|ruck | rfolco|rover, where are the train jobs running | 15:42 |
| weshay|ruck | panda, for good | 15:42 |
| panda | weshay|ruck: ok | 15:43 |
| rfolco|rover | vexhost ? | 15:43 |
| weshay|ruck | rfolco|rover, show me in zuul builds | 15:43 |
| rfolco|rover | shit | 15:46 |
| weshay|ruck | rfolco|rover, :) it's ok.. please put up a patch for it | 15:46 |
| rfolco|rover | weshay|ruck, I'll check what happened | 15:47 |
| rfolco|rover | weshay|ruck, missing 'r' maybe ? | 15:49 |
| rfolco|rover | https://review.rdoproject.org/r/#/c/26908/13/zuul.d/integration-pipeline-train-stein.yaml | 15:49 |
| rfolco|rover | openstack-periodic-24h: | 15:49 |
| rfolco|rover | yes | 15:50 |
| rfolco|rover | missing 'r' | 15:50 |
| rfolco|rover | https://review.rdoproject.org/r/#/c/26909/5/zuul.d/tripleo.yaml | 15:50 |
| rfolco|rover | ok, let me fix this | 15:50 |
| rfolco|rover | sorry | 15:50 |
| rfolco|rover | chandankumar, ^ | 15:50 |
| *** jmasud has quit IRC | 15:53 | |
| *** jmasud has joined #oooq | 15:53 | |
| *** jmasud has quit IRC | 15:54 | |
| rfolco|rover | weshay|ruck, chandankumar please merge this one https://review.rdoproject.org/r/#/c/27554/ | 15:56 |
| rfolco|rover | fixes 24hr pipeline name | 15:56 |
| *** jmasud has joined #oooq | 16:06 | |
| *** jfrancoa has quit IRC | 16:10 | |
| * marios heads out | 16:15 | |
| *** sshnaidm is now known as sshnaidm|afk | 16:21 | |
| *** marios has quit IRC | 16:26 | |
| *** dpawlik has quit IRC | 16:27 | |
| *** udesale has quit IRC | 16:28 | |
| *** udesale_ has quit IRC | 16:28 | |
| weshay|ruck | rlandy, rfolco|rover need acks on https://review.opendev.org/#/q/topic:ussuri-tempest-skiplist+(status:open+OR+status:merged) | 16:32 |
| weshay|ruck | rfolco|rover, merged train fix | 16:35 |
| rfolco|rover | thx | 16:37 |
| rlandy | weshay|ruck: same list as master for ussuri? | 16:38 |
| * rlandy biab - weekly trip to grocery store | 16:39 | |
| weshay|ruck | rlandy, it's the same code atm | 16:39 |
| *** rlandy is now known as rlandy|biab | 16:40 | |
| *** dtantsur is now known as dtantsur|afk | 16:44 | |
| *** derekh has quit IRC | 16:58 | |
| weshay|ruck | rfolco|rover, rlandy|biab https://review.opendev.org/728148 | 17:04 |
| *** jfrancoa has joined #oooq | 17:11 | |
| *** jpena is now known as jpena|off | 17:13 | |
| *** panda is now known as panda|out | 17:15 | |
| weshay|ruck | rfolco|rover, may I update https://review.rdoproject.org/r/#/c/27453/ w/ the proposed fix from hwprov? | 17:17 |
| weshay|ruck | https://review.opendev.org/#/c/727942/2 | 17:17 |
| rfolco|rover | weshay|ruck, https://review.opendev.org/#/c/728105/1 | 17:18 |
| rfolco|rover | weshay|ruck, this work is done my dear boss | 17:18 |
| rfolco|rover | all 5 runs completed | 17:18 |
| weshay|ruck | k.. will use that one | 17:18 |
| weshay|ruck | thanks | 17:18 |
| rfolco|rover | weshay|ruck, unless you want to run in testproject rdo | 17:19 |
| rfolco|rover | k | 17:19 |
| weshay|ruck | rfolco|rover, oh whoops | 17:20 |
| weshay|ruck | you already did this. .same repo | 17:20 |
| rfolco|rover | weshay|ruck, what I did was in upstream, w/ new patch | 17:21 |
| rfolco|rover | weshay|ruck, its a test patch on top of the fix https://review.opendev.org/#/c/727942/2 | 17:21 |
| rfolco|rover | weshay|ruck, do you need to test it on rdo, or what? | 17:21 |
| weshay|ruck | rfolco|rover, was your first patch on top of heralds? | 17:23 |
| weshay|ruck | 2020-05-14 15:15:24.463654 | primary | | 17:23 |
| weshay|ruck | 2020-05-14 15:15:24.463697 | primary | TASK [build-test-packages : Print out the change list] ************************* | 17:23 |
| weshay|ruck | 2020-05-14 15:15:24.463873 | primary | Thursday 14 May 2020 15:15:24 +0000 (0:00:00.063) 0:06:34.665 ********** | 17:23 |
| weshay|ruck | 2020-05-14 15:15:24.502921 | primary | ok: [undercloud] => { | 17:23 |
| weshay|ruck | 2020-05-14 15:15:24.502971 | primary | "artg_change_list": [ | 17:23 |
| weshay|ruck | 2020-05-14 15:15:24.503001 | primary | { | 17:23 |
| weshay|ruck | 2020-05-14 15:15:24.503027 | primary | "branch": "master", | 17:23 |
| weshay|ruck | 2020-05-14 15:15:24.503058 | primary | "host": "https://review.opendev.org", | 17:23 |
| weshay|ruck | 2020-05-14 15:15:24.503102 | primary | "project": "openstack/tripleo-heat-templates", | 17:23 |
| weshay|ruck | 2020-05-14 15:15:24.503129 | primary | "refspec": "refs/changes/05/728105/1" | 17:23 |
| weshay|ruck | 2020-05-14 15:15:24.503154 | primary | } | 17:23 |
| weshay|ruck | 2020-05-14 15:15:24.503178 | primary | ] | 17:24 |
| weshay|ruck | 2020-05-14 15:15:24.503202 | primary | } | 17:24 |
| weshay|ruck | checking to see if his change was integrated | 17:24 |
| rfolco|rover | well the patch is on top of the fix | 17:24 |
| rfolco|rover | parent is the fix | 17:24 |
| rfolco|rover | it should be | 17:24 |
| rfolco|rover | weshay|ruck, netmask is 32 | 17:27 |
| rfolco|rover | look https://09e003a6a650f320c43d-e30f275ad83ed88289c7399adb6c5ee6.ssl.cf1.rackcdn.com/728105/1/check/tripleo-ci-centos-8-undercloud-containers-5/77090d6/logs/undercloud/var/log/extra/network.txt | 17:27 |
| weshay|ruck | 2020-05-14T15:10:02Z DEBUG ---> Package openstack-tripleo-heat-templates.noarch 12.2.1-0.20200514021532.0f7cca3.el8 will be installed | 17:27 |
| *** yolanda has quit IRC | 17:28 | |
| weshay|ruck | https://review.opendev.org/gitweb?p=openstack/tripleo-heat-templates.git;a=commit;h=1ebf115f8580f0cd2aceccda6615e396df113c9d | 17:28 |
| rfolco|rover | weshay|ruck, looks good right | 17:28 |
| weshay|ruck | rfolco|rover, it's hard to tell because there are two tht patches.. kind of masks which change was picked up because dlrn only picks up the top patch | 17:34 |
| weshay|ruck | but from the network list looks like it's in.. | 17:35 |
| *** jfrancoa has quit IRC | 17:35 | |
| rfolco|rover | two patches ? | 17:35 |
| weshay|ruck | rfolco|rover, may update build-test-packages to list any child patches in the top log | 17:35 |
| weshay|ruck | rfolco|rover, yes.. | 17:35 |
| weshay|ruck | herald's patch and your patch | 17:35 |
| weshay|ruck | to test | 17:35 |
| weshay|ruck | are both built by build-test-packages | 17:35 |
| rfolco|rover | if it gets my patch, it gets herald's | 17:36 |
| rfolco|rover | simple like this :) | 17:36 |
| weshay|ruck | rfolco|rover, not that simple | 17:38 |
| weshay|ruck | :) | 17:38 |
| weshay|ruck | rfolco|rover, you assume too much :) | 17:39 |
| weshay|ruck | better to expose it | 17:39 |
| rfolco|rover | weshay|ruck, parent is heralds patch | 17:39 |
| rfolco|rover | tell me how my patch is applied without herald's | 17:39 |
| rfolco|rover | same repo, same tree/branch.... its not a depends-on, its a parent commit | 17:40 |
| weshay|ruck | rfolco|rover, https://review.opendev.org/gitweb?p=openstack%2Ftripleo-heat-templates.git;a=commitdiff;h=0f7cca3e1ba1516af4ea4a23099cb6ca728de2a4 | 17:40 |
| weshay|ruck | 2020-05-14T15:19:34Z DEBUG ---> Package openstack-tripleo-heat-templates.noarch 12.2.1-0.20200514021532.0f7cca3.el8 will be upgraded | 17:41 |
| weshay|ruck | 2020-05-14T15:19:34Z DEBUG ---> Package openstack-tripleo-heat-templates.noarch 12.2.1-0.20200514151744.544e17b.el8 will be an upgrade | 17:41 |
| weshay|ruck | 2020-05-14T15:19:34Z DEBUG --> Finished dependency resolution | 17:41 |
| weshay|ruck | rfolco|rover, prove to me via rpm info the patch is in | 17:41 |
| weshay|ruck | outside of what we see in /var/log/extra/network | 17:41 |
| weshay|ruck | maybe I'm not seeing it... yes I agree the patch is in and built, what I'm saying is that it's NOT obvious | 17:42 |
| rfolco|rover | weshay|ruck, I see | 17:42 |
| weshay|ruck | rfolco|rover, basically you clued me into an improvment | 17:43 |
| rfolco|rover | weshay|ruck, I'm glad my silly comments are useful :) | 17:44 |
| *** jmasud has quit IRC | 17:49 | |
| *** jmasud has joined #oooq | 18:02 | |
| weshay|ruck | rfolco|rover, do you have capacity to push https://registry.rdoproject.org:8443/oapi/v1/namespaces/tripleoussuri/imagestreamtags/ to docker.io w/ namespace u? | 18:02 |
| rfolco|rover | weshay|ruck, yes | 18:03 |
| weshay|ruck | cool thank you | 18:03 |
| rfolco|rover | np | 18:04 |
| *** jmasud has quit IRC | 18:16 | |
| *** amoralej is now known as amoralej|off | 18:19 | |
| *** jmasud has joined #oooq | 18:19 | |
| weshay|ruck | rlandy|biab, incoming possibly https://trello.com/c/6i8T3XSp/1501-cixftbfsosp-170 | 18:23 |
| *** rlandy|biab is now known as rlandy | 18:30 | |
| *** matbu has quit IRC | 18:30 | |
| rlandy | weshay|ruck: k - looking | 18:30 |
| rlandy | we will find out with today's container build | 18:31 |
| *** jmasud has quit IRC | 18:43 | |
| rlandy | ok image-build people - where is the error here?? | 18:43 |
| rlandy | ls is not a valid yum repo configuration file. | 18:43 |
| chandankumar | where we are using ls? | 18:44 |
| chandankumar | rlandy, weshay|ruck https://review.rdoproject.org/r/27545 please have a look when free | 18:44 |
| rlandy | chandankumar: looking | 18:44 |
| rlandy | chandankumar: I'm building images with ovb rhel rhos-17 | 18:45 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/36/200436/2/check/tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal/cdc0bfb/logs/undercloud/home/zuul/build.log.txt.gz | 18:45 |
| chandankumar | (ls /etc/yum.repos.d/delorean*) $(ls /etc/yum.repos.d/CentOS-Ceph-*) $(ls /etc/yum.repos.d/centos-*) from where it is coming? | 18:47 |
| chandankumar | rlandy, override it https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/build-images/defaults/main.yml#L14 | 18:47 |
| chandankumar | it will work | 18:47 |
| rlandy | chandankumar++ ah - thank you | 18:48 |
| chandankumar | rlandy, based on logs, somehow in job, older stuffs are coming | 18:48 |
| zbr | who invented the "24hr" term? AFAIK, the universal use is 24h" | 18:48 |
| zbr | we have 23 HR departments? ;) | 18:48 |
| zbr | note: I worked on i18n for a good number of years. | 18:49 |
| weshay|ruck | chandankumar, comments | 18:50 |
| *** dpawlik has joined #oooq | 18:51 | |
| chandankumar | weshay|ruck, done | 18:52 |
| chandankumar | weshay|ruck, for c8 train upstream check/gate jobs, are we going to run all job parallely with c7? | 18:53 |
| weshay|ruck | chandankumar, ya | 18:53 |
| weshay|ruck | chandankumar, we can remove some of the c7 jobs though | 18:53 |
| chandankumar | weshay|ruck, ok patch will come tomorrow | 18:53 |
| weshay|ruck | k | 18:53 |
| chandankumar | rlandy, please have a look at thsi https://review.rdoproject.org/r/#/c/27492/ something is missing there not sure | 18:54 |
| weshay|ruck | rfolco|rover, you have 5 min? | 18:55 |
| rlandy | chandankumar: do you get an error? | 18:55 |
| weshay|ruck | rlandy, chandankumar I'm poking at that now | 18:56 |
| weshay|ruck | need rfolco|rover | 18:56 |
| chandankumar | ok | 18:56 |
| rfolco|rover | yes here | 18:56 |
| rlandy | ci-scripts/dlrnapi_promoter/config/CentOS-8/train.ini? | 18:56 |
| weshay|ruck | rfolco|rover, https://meet.google.com/twf-qsfu-jot | 18:57 |
| weshay|ruck | chandankumar, chatting about those test failures now | 18:57 |
| rlandy | chandankumar: manifest_push: true? | 18:58 |
| rlandy | is that right? | 18:58 |
| weshay|ruck | https://review.rdoproject.org/r/#/c/27022/ | 19:00 |
| rlandy | chandankumar: the rest looks ok to me - I would remove [current-tripleo-rdo] if you are not using it yet | 19:00 |
| *** jmasud has joined #oooq | 19:01 | |
| weshay|ruck | https://logserver.rdoproject.org/92/27492/4/check/tox-py27/e1eb322/job-output.txt | 19:02 |
| weshay|ruck | rfolco|rover, chandankumar http://paste.openstack.org/show/793617/ | 19:11 |
| chandankumar | weshay|ruck, https://review.rdoproject.org/r/#/c/27528/ | 19:12 |
| chandankumar | weshay|ruck, https://review.rdoproject.org/zuul/stream/1256dd4c5b0f4e67bf067960b8fa8a57?logfile=console.log | 19:14 |
| chandankumar | weshay|ruck, it passed | 19:33 |
| weshay|ruck | chandankumar++ | 19:34 |
| weshay|ruck | chandankumar, I'll add the other upgrade jobs | 19:35 |
| *** dpawlik has quit IRC | 19:46 | |
| *** ccamacho has quit IRC | 20:23 | |
| rfolco|rover | weshay|ruck, script running, it may take hours... connection is much slower overseas... we'll see something soon at https://hub.docker.com/orgs/tripleou/repositories | 20:46 |
| weshay|ruck | rfolco|rover, it hasn't pushed anything | 20:47 |
| weshay|ruck | https://hub.docker.com/u/tripleou | 20:47 |
| rfolco|rover | first one in progress... | 20:48 |
| weshay|ruck | rfolco|rover, have you pulled all the containers or is that still going? | 20:48 |
| weshay|ruck | k | 20:48 |
| rfolco|rover | pulled all, retagged all, now push is in progress | 20:48 |
| rfolco|rover | sloooow | 20:48 |
| rfolco|rover | 150MB/800MB | 20:49 |
| rfolco|rover | if it takes too long, we move this script to promoter or some other server in trump land | 20:49 |
| rfolco|rover | 500/800... it will work, slow, but it will | 20:50 |
| rlandy | weshay|ruck: rfolco|rover: was there an issue with OVB and neutron_ovs_agent container? | 20:53 |
| weshay|ruck | rlandy, master? | 20:54 |
| weshay|ruck | https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset001&job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001 | 20:54 |
| weshay|ruck | looks about normal to me afaict | 20:54 |
| rlandy | weshay|ruck: I'm running on rhos-17 | 20:54 |
| rlandy | just checking | 20:54 |
| rlandy | thought I heard pands mention something about ovn | 20:55 |
| weshay|ruck | in scrum? | 20:55 |
| rlandy | weshay|ruck: yes | 20:55 |
| weshay|ruck | that is ovn for fs010 and fs010-ovn | 20:55 |
| weshay|ruck | sorry | 20:55 |
| rlandy | ok | 20:55 |
| weshay|ruck | scenario010 and scenario10-ovn | 20:56 |
| rlandy | TASK [tripleo_container_manage : Print the containers that failed to start] **** | 20:58 |
| rlandy | Thursday 14 May 2020 16:40:47 -0400 (0:00:00.164) 0:30:12.742 ********** | 20:58 |
| rlandy | fatal: [undercloud]: FAILED! => changed=false | 20:58 |
| rlandy | msg: '[''neutron_ovs_agent''] failed to start, check logs in /var/log/containers/stdouts/' | 20:58 |
| rlandy | but there is no such containet | 20:59 |
| rlandy | container | 20:59 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/36/200436/3/check/tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal/f2e5035/logs/undercloud/var/log/extra/podman/containers/ | 21:00 |
| rlandy | doesn't exist | 21:00 |
| *** Goneri has quit IRC | 21:04 | |
| rlandy | weshay|ruck: we're missing a container downstream | 21:08 |
| rlandy | https://logserver.rdoproject.org/30/727430/1/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/9b53826/logs/undercloud/var/log/extra/podman/containers/neutron_ovs_agent/ | 21:08 |
| rlandy | ^^ rdo | 21:08 |
| *** jmasud has quit IRC | 21:08 | |
| weshay|ruck | rlandy, fs001 failing or something? | 21:09 |
| weshay|ruck | ya. .duh | 21:09 |
| rlandy | weshay|ruck: yes ovb fs001 is failing | 21:09 |
| weshay|ruck | rlandy, k.. and is that dockerfile avail internally? | 21:09 |
| weshay|ruck | rlandy, I think neutron ovs may have been moved into neutron directly | 21:10 |
| weshay|ruck | rlandy, this one is worth checking w/ John S, or Theiry | 21:10 |
| rlandy | weshay|ruck: not from what I can tell | 21:10 |
| rlandy | ok | 21:10 |
| * weshay|ruck looks at log | 21:10 | |
| rlandy | containers/openstack-neutron-baseopenstack-neutron-base2 yearssummarylogtree | 21:10 |
| rlandy | containers/openstack-neutron-dhcp-agentopenstack-neutron-dhcp-agent2 yearssummarylogtree | 21:10 |
| rlandy | containers/openstack-neutron-l3-agentopenstack-neutron-l3-agent2 yearssummarylogtree | 21:10 |
| rlandy | containers/openstack-neutron-metadata-agentopenstack-neutron-metadata-agent2 yearssummarylogtree | 21:10 |
| rlandy | containers/openstack-neutron-metadata-agent-ovnopenstack-neutron-metadata-agent-ovn2 yearssummarylogtree | 21:10 |
| rlandy | containers/openstack-neutron-openvswitch-agentopenstack-neutron-openvswitch-agent2 yearssummarylogtree | 21:10 |
| rlandy | containers/openstack-neutron-serveropenstack-neutron-server2 yearssummarylogtree | 21:11 |
| rlandy | containers/openstack-neutron-server-opendaylightopenstack-neutron-server-opendaylight2 yearssummarylogtree | 21:11 |
| rlandy | containers/openstack-neutron-server-ovnopenstack-neutron-server-ovn2 yearssummarylogtree | 21:11 |
| rlandy | containers/openstack-neutron-sriov-agent | 21:11 |
| rlandy | only neutron containers downstream | 21:11 |
| weshay|ruck | rlandy, ecb011991c1e 192.168.24.1:8787/tripleomaster/centos-binary-neutron-openvswitch-agent:d1a79ae6de3c7f23f42a0832e580b695-updated-20200514172354 kolla_start 2 hours ago Up 2 hours ago neutron_ovs_agent 72.7kB (virtual 1.03GB) | 21:12 |
| rlandy | we have -binary-neutron-openvswitch-agent | 21:12 |
| weshay|ruck | rlandy, your deploy passed | 21:13 |
| weshay|ruck | weird | 21:13 |
| rlandy | no it didn't | 21:13 |
| weshay|ruck | 2020-05-14 19:45:50 | + openstack overcloud status | 21:13 |
| weshay|ruck | 2020-05-14 19:45:50 | + grep -Eq DEPLOY_SUCCESS | 21:13 |
| weshay|ruck | 2020-05-14 19:45:54 | /usr/lib64/python3.6/importlib/_bootstrap.py:219: ImportWarning: can't resolve package from __spec__ or __package__, falling back on __name__ and __path__ | 21:13 |
| weshay|ruck | 2020-05-14 19:45:54 | return f(*args, **kwds) | 21:13 |
| weshay|ruck | 2020-05-14 19:45:54 | + exit 0 | 21:13 |
| rlandy | it failed undercloud install | 21:13 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/36/200436/3/check/tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal/f2e5035/logs/undercloud/home/zuul/ | 21:14 |
| weshay|ruck | ah ya | 21:14 |
| rlandy | there is no deploy there | 21:14 |
| weshay|ruck | ok.. I'm looking at the upstream you pointed at | 21:14 |
| rlandy | right - I am just showing that in upstream there is such a container https://logserver.rdoproject.org/30/727430/1/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/9b53826/logs/undercloud/var/log/extra/podman/containers/ | 21:15 |
| weshay|ruck | https://sf.hosted.upshift.rdu2.redhat.com/logs/36/200436/3/check/tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal/f2e5035/logs/undercloud/var/log/extra/ovn.txt.gz | 21:16 |
| weshay|ruck | Error: no container with name or ID ovn_controller found: no such container | 21:16 |
| rlandy | yep | 21:16 |
| rlandy | 192.168.24.1:8787/tripleorhos-17/rhel-binary-neutron-openvswitch-agent d364bab04eaff44273702300a4c5522e-updated-20200514155553 f7f4ff170514 24 minutes ago 948 MB | 21:17 |
| rlandy | ^^ container there | 21:17 |
| weshay|ruck | rlandy, CIX and leave in CIX and we'll move on to something else | 21:18 |
| rlandy | weshay|ruck: looks like the container is there but not started | 21:18 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/36/200436/3/check/tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal/f2e5035/logs/undercloud/var/log/extra/podman/podman_allinfo.log.txt.gz | 21:18 |
| rlandy | one more time to reproduce and then I'll CIX | 21:18 |
| weshay|ruck | rlandy, k | 21:20 |
| chandankumar | weshay|ruck, rlandy if still around, please merge this two https://review.opendev.org/#/c/727739/1 and https://review.opendev.org/#/c/726752/10 | 21:49 |
| rlandy | looking | 21:49 |
| chandankumar | octavia tempest tests running with os_tempest passing | 21:49 |
| chandankumar | cgoncalves, ^^ | 21:49 |
| chandankumar | result posted in comments | 21:49 |
| chandankumar | see ya tomorrow | 21:50 |
| rlandy | ok | 21:51 |
| *** TrevorV has quit IRC | 22:01 | |
| *** jmasud has joined #oooq | 22:07 | |
| *** jbadiapa has quit IRC | 22:25 | |
| *** holser has quit IRC | 22:56 | |
| *** tosky has quit IRC | 23:05 | |
| *** jmasud has quit IRC | 23:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!