| *** dsneddon has joined #oooq | 00:18 | |
| *** dsneddon has quit IRC | 00:23 | |
| *** ykarel has joined #oooq | 02:01 | |
| *** dsneddon has joined #oooq | 02:19 | |
| *** dsneddon has quit IRC | 02:33 | |
| *** Goneri has joined #oooq | 03:08 | |
| *** dsneddon has joined #oooq | 03:29 | |
| *** dsneddon has quit IRC | 03:34 | |
| *** tcw has joined #oooq | 03:35 | |
| *** udesale has joined #oooq | 04:01 | |
| *** ykarel has quit IRC | 04:04 | |
| *** ykarel has joined #oooq | 04:22 | |
| *** dsneddon has joined #oooq | 04:30 | |
| *** dsneddon has quit IRC | 04:35 | |
| *** marios has joined #oooq | 05:21 | |
| *** marios_|ruck has joined #oooq | 05:21 | |
| *** ratailor has joined #oooq | 05:24 | |
| *** dsneddon has joined #oooq | 05:31 | |
| *** jbadiapa has joined #oooq | 05:35 | |
| *** dsneddon has quit IRC | 05:36 | |
| *** udesale has quit IRC | 05:42 | |
| *** udesale has joined #oooq | 05:42 | |
| *** quiquell has joined #oooq | 05:43 | |
| *** skramaja has joined #oooq | 05:44 | |
| *** ksambor has joined #oooq | 05:51 | |
| *** chkumar|pto is now known as chandankumar | 05:58 | |
| *** Goneri has quit IRC | 06:30 | |
| *** dsneddon has joined #oooq | 06:32 | |
| *** dsneddon has quit IRC | 06:37 | |
| *** apahim has joined #oooq | 06:46 | |
| *** ajo has quit IRC | 06:48 | |
| *** ajo has joined #oooq | 06:48 | |
| *** udesale has quit IRC | 07:00 | |
| *** udesale has joined #oooq | 07:00 | |
| *** jfrancoa has joined #oooq | 07:05 | |
| *** saneax has joined #oooq | 07:08 | |
| *** yolanda_ has quit IRC | 07:13 | |
| *** tesseract has joined #oooq | 07:13 | |
| *** dsneddon has joined #oooq | 07:15 | |
| *** yolanda_ has joined #oooq | 07:20 | |
| *** udesale has quit IRC | 07:20 | |
| *** udesale has joined #oooq | 07:21 | |
| ykarel | marios_|ruck, can you check my comment https://review.rdoproject.org/r/#/c/20720/ | 07:25 |
|---|---|---|
| ykarel | stein promotion is blocked due to it | 07:26 |
| ykarel | weshay, ^^ | 07:26 |
| *** udesale has quit IRC | 07:26 | |
| ykarel | missing successful jobs: [u'periodic-tripleo-ci-centos-7-standalone-upgrade-stein'] | 07:27 |
| *** udesale has joined #oooq | 07:27 | |
| marios_|ruck | ykarel: ack i didn't know that was added to criteria happened after I left. do you know what if fails at i mean is it a known issue or a new one. The job was green when it merged last week anyway | 07:27 |
| ykarel | marios_|ruck, i didn't checked in detail, job failed with some ansible variable undefined | 07:28 |
| ykarel | i can't see single pass in promotion pipeline | 07:28 |
| ykarel | may be testing was not complete | 07:28 |
| marios_|ruck | ykarel: there are 2 there https://trunk-primary.rdoproject.org/api-centos-stein/api/civotes_detail.html?ci_name=periodic-tripleo-ci-centos-7-standalone-upgrade-stein | 07:28 |
| ykarel | marios_|ruck, those were in check pipeline | 07:28 |
| marios_|ruck | ykarel: 2019-05-14 | 07:28 |
| ykarel | possible ran with promoted repo | 07:28 |
| marios_|ruck | ykarel: maybe those were the ones on the review | 07:29 |
| ykarel | yes | 07:29 |
| marios_|ruck | ykarel: but anyway yeah i mean it was failing on friday so i don't know why they added it to criteria | 07:29 |
| ykarel | yes no point on adding failing/not ready jobs to promotion criteria | 07:30 |
| marios_|ruck | ykarel: so i think we should remove that from there. i'll poke in a bit and file a bug if we need one. but i think we should revert that https://review.rdoproject.org/r/#/c/20833/ | 07:30 |
| ykarel | may be that job is voting upstream | 07:30 |
| marios_|ruck | ykarel: it is voting upstream yes | 07:30 |
| marios_|ruck | ykarel: standalone-upgrade-stein is pretty green | 07:30 |
| * marios_|ruck scared fetches link... | 07:30 | |
| marios_|ruck | http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-standalone-upgrade-stein | 07:31 |
| ykarel | not sure what's the workflow, i think before voting upstrea, we should get it green in promotion | 07:31 |
| marios_|ruck | ykarel: yah still pretty green i mean 2 fails on weekend but otherwise lgtm | 07:31 |
| marios_|ruck | ykarel: i've known it the other way around like voting upstream gate then promotion. | 07:31 |
| ykarel | so considering it's voting upstream, now instead of reverting promotion, it needs to be fixed in promotion pipeline | 07:32 |
| *** amoralej|off is now known as amoralej | 07:32 | |
| marios_|ruck | ykarel: well yes we do need to add it in criteria, and as i said on friday i knew we merged the periodic job and that it was green (but was rucking so didn't follow that ... and weshay posted the criteria patch ) | 07:33 |
| *** apahim has quit IRC | 07:33 | |
| *** apahim has joined #oooq | 07:33 | |
| marios_|ruck | ykarel: but it depends what the problem is | 07:33 |
| marios_|ruck | ykarel: we can't block promotion indefinitely if there is some delay/dependency etc | 07:34 |
| ykarel | marios_|ruck, yes until issue is clear know should block https://review.rdoproject.org/r/#/c/20833/ | 07:34 |
| ykarel | revert | 07:34 |
| ykarel | i commented | 07:34 |
| *** ykarel is now known as ykarel|lunch | 07:35 | |
| *** dtantsur|afk is now known as dtantsur | 07:35 | |
| * ykarel|lunch leaving for lunch | 07:35 | |
| *** tosky has joined #oooq | 07:35 | |
| *** jaosorior has joined #oooq | 07:44 | |
| *** bogdando has joined #oooq | 07:49 | |
| *** jpena|off is now known as jpena | 07:52 | |
| chandankumar | marios_|ruck: Hello | 08:06 |
| chandankumar | marios_|ruck: is it a known issue http://logs.openstack.org/36/660036/1/check/tripleo-ci-centos-7-undercloud-containers/6ac1252/job-output.txt.gz#_2019-05-20_07_24_07_424101 | 08:06 |
| chandankumar | ? | 08:06 |
| chandankumar | something wrong with warlock | 08:06 |
| marios_|ruck | chandankumar: nope new \o/ | 08:09 |
| marios_|ruck | chandankumar: thanks noting and will dig into for the bug | 08:09 |
| chandankumar | marios_|ruck: almost all jobs are failing | 08:09 |
| chandankumar | on rdo/upstream ci on https://review.opendev.org/#/c/660036/ | 08:10 |
| *** dsneddon has quit IRC | 08:14 | |
| marios_|ruck | fantastic... thanks for ping chandankumar | 08:19 |
| *** holser_ has joined #oooq | 08:20 | |
| *** ykarel|lunch is now known as ykarel | 08:31 | |
| *** derekh has joined #oooq | 08:37 | |
| chandankumar | marios_|ruck: https://github.com/bcwaldon/warlock/pull/42 | 08:40 |
| *** panda|rover|off is now known as panda|rover | 08:41 | |
| *** Vorrtex has joined #oooq | 08:44 | |
| marios_|ruck | chandankumar: nice adding to bug https://bugs.launchpad.net/tripleo/+bug/1829724 thanks | 08:46 |
| openstack | Launchpad bug 1829724 in tripleo "all ci jobs failing during install of warlock with TypeError: 'encoding' is an invalid keyword argument " [Critical,Triaged] | 08:46 |
| panda|rover | this morning all the jobs gathered at the gates | 08:47 |
| panda|rover | when the warlock saw them, he pushed his staff on the ground, shouting: "YOU SHALL NOT PASS" | 08:47 |
| marios_|ruck | panda|rover: chandankumar used the magical io spell on the warlock lets see | 08:51 |
| *** holser_ has quit IRC | 08:59 | |
| chandankumar | marios_|ruck: may we can pin it here https://opendev.org/openstack/requirements/src/branch/master/global-requirements.txt#L351 | 09:09 |
| chandankumar | marios_|ruck: warlock==1.3.1 | 09:10 |
| chandankumar | *may be | 09:10 |
| ykarel | i think it's need to be handled in quickstart side, as it's not using upper-constraints, | 09:16 |
| * ykarel looking logs to see where is the issue | 09:16 | |
| ykarel | hmm it's under quickstart | 09:16 |
| marios_|ruck | chandankumar: ykarel ack looking | 09:17 |
| marios_|ruck | chandankumar: added comment in https://github.com/bcwaldon/warlock/issues/41 pointing to your pull | 09:17 |
| chandankumar | ykarel: http://codesearch.openstack.org/?q=warlock&i=nope&files=.txt&repos= | 09:18 |
| chandankumar | ykarel: it is not defined under TQ | 09:18 |
| ykarel | chandankumar, it's pulled as an inderect dep | 09:18 |
| ykarel | so you need to add constraint in tq | 09:19 |
| *** jaosorior has quit IRC | 09:19 | |
| ykarel | chandankumar, to be more clear u need something like https://review.opendev.org/#/c/659191/ | 09:19 |
| chandankumar | ok checking | 09:20 |
| *** holser_ has joined #oooq | 09:21 | |
| marios_|ruck | chandankumar: are you posting requirements.txt or should i ? | 09:21 |
| *** holser_ has quit IRC | 09:21 | |
| *** holser_ has joined #oooq | 09:22 | |
| chandankumar | ykarel: marios_|ruck panda|rover https://review.opendev.org/#/c/660060/ | 09:23 |
| marios_|ruck | chandankumar: ack thanks | 09:23 |
| ykarel | ack let's see if jobs passes now | 09:23 |
| marios_|ruck | chandankumar: nit you pined to 3.0 | 09:24 |
| marios_|ruck | did you mean .1? | 09:24 |
| chandankumar | marios_|ruck: fixed | 09:24 |
| Tengu | or maybe you can just avoid the faulty version so that the next one will be taken? | 09:24 |
| marios_|ruck | chandankumar: thanks | 09:24 |
| Tengu | i.e. !=1.3.2 | 09:25 |
| marios_|ruck | Tengu: what are you telling us about it go tell gerrit! | 09:25 |
| chandankumar | Tengu: nice fixing that | 09:26 |
| Tengu | :) | 09:26 |
| *** fmount has joined #oooq | 09:27 | |
| panda|rover | Tengu: where is this behaviour documented ? | 09:27 |
| Tengu | panda|rover: used in other requirements.txt | 09:27 |
| Tengu | for instance https://review.opendev.org/#/c/660031/4/doc/requirements.txt | 09:28 |
| chandankumar | panda|rover: Tengu some more complex is here https://opendev.org/openstack/requirements/src/branch/master/global-requirements.txt#L39 | 09:28 |
| panda|rover | Tengu: ah I see it. | 09:29 |
| panda|rover | # Version Exclusion. Anything except version x | 09:29 |
| panda|rover | Tengu: we'll have to hope that 1.3.3 sill not have the same problem :) | 09:30 |
| Tengu | panda|rover: of course. but if it does, we might want to find a proper fix right? :) | 09:31 |
| Tengu | because pining to older version is bad | 09:31 |
| chandankumar | Tengu: https://github.com/bcwaldon/warlock/pull/42 | 09:31 |
| Tengu | so that's a proper fix :D | 09:32 |
| Tengu | well done | 09:32 |
| *** ccamacho has quit IRC | 09:33 | |
| *** ccamacho has joined #oooq | 09:34 | |
| *** Vorrtex has quit IRC | 09:45 | |
| chandankumar | marios_|ruck: panda|rover https://review.opendev.org/#/c/657589/ can we get this merged | 09:51 |
| chandankumar | marios_|ruck: now the warlock patch merged | 09:54 |
| chandankumar | let's have a new release then we can revert it till they create a new tag | 09:54 |
| marios_|ruck | chandankumar: looking at the review but which patch warlock pull request or pin | 09:54 |
| marios_|ruck | chandankumar: ack must be the pull anyway we still need the pin | 09:57 |
| marios_|ruck | chandankumar: to avoid tha bad version | 09:57 |
| ykarel | marios_|ruck, panda|rover is the master container build push known, failing since 17th May:- https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-centos-7-master-containers-build-push ? | 10:07 |
| panda|rover | ykarel: known taht fails | 10:08 |
| ykarel | panda|rover, okk so good it's already known, any fix already? | 10:09 |
| marios_|ruck | ykarel: panda|rover i didn't know about it we have a bug panda|rover ? me looks ar ogs | 10:11 |
| marios_|ruck | (at logs) | 10:11 |
| marios_|ruck | 2019-05-19 00:32:01.217190 | primary | "msg": "Failed to import docker-py - cannot import name __version__. Try `pip install docker-py`" | 10:12 |
| panda|rover | marios_|ruck: I remember something about removing docker py because it wasn't needed | 10:15 |
| marios_|ruck | panda|rover: ack gonna file a bug anyway cos that is obviously yet another promotion blocker | 10:15 |
| panda|rover | but I don't remember when and where | 10:15 |
| marios_|ruck | thanks ykarel | 10:15 |
| marios_|ruck | "thanks" | 10:15 |
| marios_|ruck | :D | 10:15 |
| marios_|ruck | ;) | 10:15 |
| panda|rover | marios_|ruck: we knew the build was failing | 10:15 |
| marios_|ruck | panda|rover: i had not noticed been a bit busy this morning ! | 10:16 |
| panda|rover | marios_|ruck: you knew, I remember you sayint this in the meeting ... | 10:16 |
| panda|rover | or am I dreaming ? | 10:16 |
| panda|rover | I can see the future! | 10:16 |
| marios_|ruck | panda|rover: well there is a note on the etherpad about "containers build failed" from 16th but it was another issue i think | 10:16 |
| panda|rover | /nick theeeyedpanda | 10:17 |
| chandankumar | so we have now tag available https://github.com/bcwaldon/warlock/tree/1.3.3 | 10:17 |
| panda|rover | chandankumar: so the pin is not even needed | 10:17 |
| chandankumar | panda|rover: I think so as new version will be get picked | 10:19 |
| *** ccamacho has quit IRC | 10:22 | |
| *** ccamacho has joined #oooq | 10:26 | |
| *** holser_ has quit IRC | 10:33 | |
| *** panda|rover is now known as panda|lunch | 10:52 | |
| *** panda|lunch is now known as panda|rover|eat | 10:53 | |
| *** ykarel is now known as ykarel|afk | 11:00 | |
| chandankumar | marios_|ruck: rdo mirrors are not yet synced | 11:01 |
| chandankumar | marios_|ruck: this will fix fs017 queens tempest issue https://review.opendev.org/#/c/660036/2 | 11:03 |
| *** yolanda_ has quit IRC | 11:04 | |
| *** yolanda_ has joined #oooq | 11:08 | |
| *** udesale has quit IRC | 11:16 | |
| *** jpena is now known as jpena|lunch | 11:25 | |
| *** kopecmartin has joined #oooq | 11:42 | |
| *** kopecmartin is now known as kopecmartin|off | 11:43 | |
| *** amoralej is now known as amoralej|lunch | 11:53 | |
| *** panda|rover|eat is now known as panda|rover | 11:57 | |
| rfolco | chandankumar, weshay hi, will get a coffee brb | 11:58 |
| chandankumar | rfolco: ack! | 12:02 |
| weshay | marios_|ruck jump on my blue in 5 please | 12:02 |
| *** d0ugal has quit IRC | 12:03 | |
| marios | weshay: ack | 12:03 |
| ykarel|afk | chandankumar, i can see jobs passing in rdo, | 12:05 |
| ykarel|afk | with warlock | 12:05 |
| *** ykarel|afk is now known as ykarel | 12:05 | |
| ykarel | so 1.3.3 is there | 12:05 |
| marios | ykarel: ovb jobs hitting it too | 12:06 |
| marios | ykarel: i think we have to pin in rdoinfo but not sure where yet | 12:06 |
| ykarel | marios, nope no need it in rdoinfo | 12:06 |
| marios | ykarel: joining call with weshay now but added link in updated description https://bugs.launchpad.net/tripleo/+bug/1829724 | 12:06 |
| openstack | Launchpad bug 1829724 in tripleo "all ci jobs failing during install of warlock with TypeError: 'encoding' is an invalid keyword argument " [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 12:06 |
| ykarel | marios, so now warlock 1.3.3 is released and seeing it passing both upstream and in rdo | 12:07 |
| ykarel | means mirrors contains 1.3.3 | 12:07 |
| marios | ykarel: ack cool | 12:07 |
| marios | ykarel: thx | 12:07 |
| weshay | marios howdy | 12:08 |
| marios | weshay: amin your bluejeans | 12:08 |
| *** d0ugal has joined #oooq | 12:08 | |
| ykarel | marios, the logs u posted in bug are old | 12:08 |
| ykarel | around 3 hours older | 12:08 |
| *** ratailor_ has joined #oooq | 12:13 | |
| *** ykarel_ has joined #oooq | 12:16 | |
| *** ratailor has quit IRC | 12:16 | |
| *** ykarel has quit IRC | 12:18 | |
| weshay | marios https://code.engineering.redhat.com/gerrit/#/c/170752/ | 12:21 |
| *** jpena|lunch is now known as jpena | 12:22 | |
| *** amoralej|lunch is now known as amoralej | 12:25 | |
| *** derekh has quit IRC | 12:25 | |
| *** rlandy has joined #oooq | 12:27 | |
| marios | weshay: =*= manual deploys sprint 9/10 RHEL8/OSP15 https://tree.taiga.io/project/tripleo-ci-board/task/1040 & sprint 9 manual rhel7 image build https://tree.taiga.io/project/tripleo-ci-board/task/1051 =*= | 12:27 |
| rlandy | panda|rover: sshnaidm: requesting another vote here pls ... https://review.opendev.org/#/c/658358/ | 12:34 |
| weshay | marios rlandy let's chat for 5 | 12:38 |
| marios_|ruck | weshay: ack | 12:38 |
| rlandy | joining | 12:38 |
| weshay | rlandy https://code.engineering.redhat.com/gerrit/#/c/170752/ | 12:39 |
| rlandy | marios_|ruck: weshay: https://review.opendev.org/#/c/659794/ | 12:41 |
| chandankumar | rfolco: Marios Andreou | 12:43 |
| weshay | rlandy https://review.opendev.org/#/c/659794/ marios_|ruck | 12:43 |
| rfolco | thanks chandankumar | 12:43 |
| *** ccamacho has quit IRC | 12:45 | |
| rlandy | jpena: marios_|ruck: weshay: can we merge https://code.engineering.redhat.com/gerrit/#/c/170752? | 12:47 |
| weshay | marios_|ruck https://review.opendev.org/#/c/659879/ | 12:47 |
| *** skramaja has quit IRC | 12:47 | |
| weshay | marios_|ruck https://review.opendev.org/#/c/65987 | 12:47 |
| rlandy | jpena: will the image build automatically from this change? | 12:47 |
| jpena | rlandy: yes | 12:48 |
| rlandy | jpena: thanks - merging | 12:48 |
| jpena | rlandy, marios let me check with nhicher | 12:48 |
| jpena | rlandy: nevermind, it's a bank holiday for him today. Let's merge | 12:50 |
| rlandy | ack - ok | 12:50 |
| rfolco | marios, quiquell, sshnaidm, weshay, panda, rlandy, arxcruz, mwhahaha, rfolco, chkumar, zbr, kopecmartin | 13:01 |
| rfolco | ping scrum | 13:01 |
| *** udesale has joined #oooq | 13:01 | |
| *** derekh has joined #oooq | 13:04 | |
| chandankumar | marios_|ruck: rlandy https://en.wikipedia.org/wiki/Henna_(film) | 13:05 |
| weshay | arxcruz please join | 13:07 |
| weshay | if available | 13:07 |
| weshay | and not dealing w/ a sick child | 13:07 |
| weshay | rfolco take quiquell off the ping list | 13:07 |
| chandankumar | panda|rover: marios_|ruck http://paste.openstack.org/show/751667/ regarding logs.rdoproject.org loggin issue | 13:10 |
| marios_|ruck | chandankumar: thanks | 13:10 |
| marios_|ruck | chandankumar: will check after call | 13:10 |
| marios_|ruck | chandankumar: noted for now at https://etherpad.openstack.org/p/ruckroversprint10 | 13:10 |
| *** Vorrtex has joined #oooq | 13:11 | |
| *** ratailor_ has quit IRC | 13:13 | |
| *** ykarel__ has joined #oooq | 13:17 | |
| *** ykarel_ has quit IRC | 13:19 | |
| rlandy | chandankumar: Did you get married? Did I miss that announcement? | 13:28 |
| chandankumar | rlandy: nope | 13:28 |
| chandankumar | rlandy: my friends get married, they have added me to the queue | 13:29 |
| rlandy | chandankumar: oh ok - so we also have henna parties which is why we know about that | 13:29 |
| sshnaidm | rlandy, where do you configure dns for internal SF jobs? and which ones should we use? | 13:32 |
| *** dtrainor has joined #oooq | 13:32 | |
| marios_|ruck | chandankumar: we have that https://bugs.launchpad.net/tripleo/+bug/1829736 | 13:33 |
| openstack | Launchpad bug 1829736 in tripleo "periodic-tripleo--master-containers-build is failing with "Failed to import docker-py - cannot import name __version__"" [Critical,Triaged] | 13:33 |
| rlandy | sshnaidm: I configure the dns settings in the hardware envs - getting | 13:33 |
| *** ykarel__ is now known as ykarel | 13:33 | |
| *** aakarsh has joined #oooq | 13:34 | |
| rlandy | sshnaidm: example ... http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/hardware_environments/hp_dl360_envD/network_configs/single_nic_vlans/env_settings.yml#n26 | 13:34 |
| marios_|ruck | chandankumar: sorry .,, logging not login ignore its not that 1829736 | 13:34 |
| rlandy | sshnaidm: also when you deploy the overcloud ... http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/hardware_environments/hp_dl360_envD/network_configs/single_nic_vlans/env_settings.yml#n77 | 13:35 |
| sshnaidm | rlandy, thanks | 13:35 |
| weshay | sshnaidm hey.. so the rocky standalone on rhel7, can we execute that on the containers that we are building for rocky in user story 944? | 13:39 |
| weshay | we'd have to manually push those containers to rdo if they are not already there | 13:39 |
| weshay | chandankumar rfolco ^ | 13:40 |
| sshnaidm | weshay, need to define it before.. | 13:41 |
| rlandy | weshay: marios_|ruck: editing https://review.opendev.org/#/c/659879/3/quickstart.sh to remove zuul-worker link | 13:43 |
| marios_|ruck | rlandy: ack | 13:45 |
| weshay | arxcruz when you have a sec.. please jjoin my blue and ping me | 13:47 |
| weshay | chandankumar rfolco note... that when you triage.. get tags properly set... noting we have a tempest tag now :) | 13:50 |
| weshay | officially | 13:50 |
| rfolco | weshay, ack | 13:51 |
| *** vinaykns has joined #oooq | 13:56 | |
| rlandy | marios_|ruck: the jobs is still running with zuul-worker, do you remember where the image build jobs are? | 14:10 |
| rlandy | maybe we can manually rekick? | 14:11 |
| marios_|ruck | rlandy: sec let me see if i can find | 14:12 |
| sshnaidm | chandankumar, doesn't tripleo-ci-centos-7-standalone-os-tempest run on periodics? | 14:12 |
| marios_|ruck | rlandy: this has expired but it was at https://sf.hosted.upshift.rdu2.redhat.com/nodepool-log/cloud-rhel-8-0000017135.log | 14:12 |
| marios_|ruck | rlandy: https://sf.hosted.upshift.rdu2.redhat.com/nodepool-log/ | 14:13 |
| rlandy | marios_|ruck: thanks ... maybe we are missing zuul_user? | 14:16 |
| rlandy | comparing with https://sf.hosted.upshift.rdu2.redhat.com/nodepool-log/upstream-centos-7-0000007505.log | 14:16 |
| marios_|ruck | rlandy: you mean @ https://code.engineering.redhat.com/gerrit/#/c/167540/27/zuul.d/standalone-jobs.yaml ? | 14:19 |
| *** holser_ has joined #oooq | 14:27 | |
| rlandy | marios_|ruck: yeah - it appears there is zuul-worker and zuul-user | 14:29 |
| marios_|ruck | rlandy: do we need to sync/call... ? updated the reviews at https://tree.taiga.io/project/tripleo-ci-board/task/988 | 14:30 |
| marios_|ruck | rlandy: do i ned to add zuul-worker into the job definition at https://code.engineering.redhat.com/gerrit/#/c/167540/27/zuul.d/standalone-jobs.yaml | 14:30 |
| rlandy | marios_|ruck: let's sync before you go | 14:32 |
| marios_|ruck | rlandy: ack - lets say in half hour? | 14:32 |
| rlandy | sure | 14:32 |
| marios_|ruck | rlandy: i'll send invite with bluejeans link | 14:32 |
| * rlandy reads logs more carefully | 14:32 | |
| arxcruz | weshay:ping | 14:33 |
| arxcruz | weshay: i am in your bj | 14:34 |
| *** apahim_ has joined #oooq | 14:35 | |
| *** apahim has quit IRC | 14:39 | |
| marios_|ruck | rlandy: are you ready to talk now or want to wait 20 mins. | 14:40 |
| marios_|ruck | rlandy: either works for me | 14:40 |
| rlandy | marios_|ruck: now is fine | 14:41 |
| marios_|ruck | ok joining | 14:41 |
| marios_|ruck | weshay: me and rlandy are syncing now fyi | 14:41 |
| weshay | chandankumar can you push this forward https://review.opendev.org/#/c/654942/ | 14:44 |
| chandankumar | weshay: yes, it is failing on centos jobs httlib2-python package not found | 14:46 |
| chandankumar | sshnaidm: nope | 14:46 |
| chandankumar | sshnaidm: it only runs in check and gate jobs | 14:46 |
| weshay | thanks | 14:47 |
| chandankumar | sshnaidm: we will be removing that job soon | 14:47 |
| sshnaidm | chandankumar, ack | 14:47 |
| chandankumar | marios_|ruck: weshay: sshnaidm https://review.opendev.org/#/c/660036/ we need this one for fs017 queens promotion | 14:48 |
| marios_|ruck | chandankumar: ack in call will try in a bit | 14:49 |
| sshnaidm | weshay, this is ready, btw: https://review.rdoproject.org/r/#/c/20548/ you can choose container_mode - either docker or podman, by default podman. | 14:56 |
| weshay | nice | 14:57 |
| chandankumar | weshay: https://review.opendev.org/#/c/643731 on dib change discussion is going on, if the yolanda satisfies with paul's comment, then i think it is good to go | 14:57 |
| weshay | chandankumar rock on | 14:57 |
| rlandy | jpena: marios_|ruck: iiuc, the image will rebuild daily https://sf.hosted.upshift.rdu2.redhat.com/nodepool-log/ .. can we manually trigger the build for cloud-rhel-8? | 14:59 |
| jpena | rlandy: oh, my fault. I thought the change would trigger it as a post job. I just started the build by hand | 15:00 |
| rlandy | jpena: oh great - thanks | 15:00 |
| chandankumar | sshnaidm: rlandy: https://review.rdoproject.org/r/#/c/20840/ please have a no expertize here | 15:02 |
| sshnaidm | chandankumar, it's not for us | 15:04 |
| *** ykarel is now known as ykarel|away | 15:05 | |
| jpena | rlandy: the updated image is ready | 15:09 |
| rlandy | jpena: thanks - retrying the job | 15:09 |
| weshay | panda|rover let me know if you have a minute | 15:13 |
| weshay | marios_|ruck did you shutdown sequence yet? | 15:14 |
| weshay | found the issue w/ the upgrade bug | 15:14 |
| *** tcw has quit IRC | 15:14 | |
| arxcruz | weshay: still want to talk with me ? | 15:15 |
| weshay | arxcruz ya.. panda|rover you can join too if ur avail | 15:15 |
| arxcruz | joining | 15:15 |
| weshay | will be quick | 15:15 |
| panda|rover | weshay: joining | 15:15 |
| * marios_|ruck shutdown sequence | 15:18 | |
| marios_|ruck | weshay: do you mean stein standalone upgrade hash? | 15:18 |
| weshay | ya | 15:21 |
| ykarel|away | chandankumar, just saw ur comment on CIX card fs020-queens | 15:23 |
| ykarel|away | chandankumar, i noticed fs020-queens passing in some runs https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens&pipeline=openstack-periodic-24hr | 15:24 |
| weshay | marios_|ruck http://logs.rdoproject.org/openstack-periodic-latest-released/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-upgrade-stein/0241888/logs/undercloud/var/log/extra/dump_variables_vars.json.txt.gz | 15:24 |
| ykarel|away | chandankumar, please consider ^^ before u go with https://review.opendev.org/#/c/658284/3 | 15:24 |
| weshay | dlrn_hash_tag_newest | 15:24 |
| arxcruz | heading to my german class, back in a few | 15:24 |
| weshay | is not defined | 15:24 |
| weshay | marios_|ruck it is defined http://logs.rdoproject.org/41/20241/5/check/periodic-tripleo-ci-centos-7-standalone-upgrade-stein/9486b82/logs/undercloud/var/log/extra/dump_variables_vars.json.txt.gz | 15:24 |
| weshay | is a passing version | 15:24 |
| chandankumar | ykarel|away: I have still not looked at fs020 | 15:28 |
| ykarel|away | chandankumar, ack, i saw ur update, so pinged | 15:29 |
| ykarel|away | to avoid extra efforts | 15:29 |
| *** dsneddon has joined #oooq | 15:29 | |
| *** quiquell has quit IRC | 15:31 | |
| weshay | marios_|ruck panda|rover fyi https://review.opendev.org/660150 | 15:31 |
| weshay | marios_|ruck I removed promotion_blocker from https://bugs.launchpad.net/tripleo/+bug/1829722 | 15:32 |
| openstack | Launchpad bug 1829722 in tripleo " periodic-tripleo-standalone-upgrade-stein fails upgrade repo-setup task: Check DLRN hash newest format " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 15:32 |
| marios_|ruck | weshay: thank you | 15:32 |
| weshay | rlandy I'm going to spin up some rhel-8 images and see what I can do w/ install-deps | 15:32 |
| *** apahim_ has quit IRC | 15:32 | |
| weshay | rlandy let's sync later today about it | 15:33 |
| rlandy | weshay: ack- getting further with rebuilt image | 15:33 |
| weshay | chandankumar marios_|ruck so starting tomorrow, start jumping into osp-15 osp-ci | 15:33 |
| weshay | rlandy have a link? | 15:33 |
| rlandy | weshay: removing some of the hacks to see if we get by w/o them | 15:33 |
| rlandy | weshay: https://sf.hosted.upshift.rdu2.redhat.com/logs/40/167540/27/check/tripleo-ci-rhel-8-standalone-rhos-15/a790345/job-output.txt.gz#_2019-05-20_11_19_42_295292 | 15:33 |
| weshay | marios_|ruck chandankumar perhaps rlandy and I have a standalone deployment for you to debug :) | 15:34 |
| rlandy | ^^ maybe our 'become true' is messing with the permissions | 15:34 |
| rlandy | try w/o those changes | 15:34 |
| * ykarel|away out | 15:35 | |
| chandankumar | rlandy: is it possible to push upshift on logs.rdoproject.org? | 15:37 |
| chandankumar | *upshift logs | 15:37 |
| rlandy | chandankumar: yeah - I was supposed to look into that - downstream sf logs to internal | 15:37 |
| rlandy | it's from the base job | 15:38 |
| rlandy | so I suppose we could override ir | 15:38 |
| rlandy | it | 15:38 |
| rlandy | looking | 15:38 |
| chandankumar | weshay: sure | 15:38 |
| *** apahim_ has joined #oooq | 15:39 | |
| rlandy | chandankumar: http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-config.git/tree/playbooks/base/post.yaml | 15:40 |
| *** ykarel|away has quit IRC | 15:40 | |
| rlandy | if we override those vars in child jobs, it should work, as long as there are no access issues | 15:41 |
| rlandy | zuul_log_url | 15:41 |
| chandankumar | rlandy: looking into that, will propose a patch | 15:41 |
| rlandy | and maybe site_logserver? | 15:41 |
| rlandy | chandankumar: you can try it on one of our standalone jobs | 15:41 |
| * marios_|ruck out | 15:42 | |
| *** marios has quit IRC | 15:42 | |
| *** marios_|ruck has quit IRC | 15:42 | |
| rlandy | chandankumar: you can use my test review here ... https://code.engineering.redhat.com/gerrit/#/c/170519/ | 15:43 |
| rlandy | make the edit in ... | 15:43 |
| *** apahim_ has quit IRC | 15:44 | |
| *** apahim_ has joined #oooq | 15:44 | |
| rlandy | vars in https://code.engineering.redhat.com/gerrit/#/c/170519/6/zuul.d/standalone-jobs.yaml | 15:44 |
| rlandy | and see where the logs go | 15:44 |
| sshnaidm | weshay, rocky job defined: https://code.engineering.redhat.com/gerrit/#/c/170793/ | 15:49 |
| weshay | rlandy are pushing on https://review.opendev.org/#/c/659874/ ? | 15:53 |
| weshay | sorry, are you | 15:53 |
| rlandy | weshay: I am keeping my own review - taking the pieces I think we still need | 15:54 |
| weshay | ah k | 15:54 |
| rlandy | weshay: give me a few - working through the permissions there | 15:55 |
| weshay | rock | 15:55 |
| * chandankumar logs out, will look on stuff tomorrow | 16:01 | |
| *** chandankumar is now known as raukadah | 16:01 | |
| * raukadah is confused, somthing got merged, fs020 queens is also passing | 16:02 | |
| raukadah | https://logs.rdoproject.org/32/20832/3/check/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens/6c660cb/logs/tempest.html.gz | 16:03 |
| *** ykarel|away has joined #oooq | 16:03 | |
| *** Vorrtex has quit IRC | 16:11 | |
| *** bogdando has quit IRC | 16:12 | |
| *** jfrancoa has quit IRC | 16:24 | |
| *** Vorrtex has joined #oooq | 16:34 | |
| weshay | rlandy 2019-05-20 12:35:49.726274 | primary | Aborting, target uses selinux but python bindings (libselinux-python) aren't installed! | 16:38 |
| weshay | rlandy we probably need to update our inventory as well? | 16:38 |
| rlandy | weshay: ack - just looking at that | 16:38 |
| rlandy | weshay: the issue is on localhost though | 16:38 |
| weshay | rlandy ya.. but it's not using zuul-inventory at that point of the job | 16:39 |
| rlandy | 2019-05-20 12:35:49.726198 | primary | fatal: [undercloud -> localhost]: | 16:39 |
| weshay | rlandy perhaps we need to update the tripleo-inventory role to add the python-interp if os_distro == rhel8 | 16:40 |
| rlandy | for standalone ... | 16:40 |
| *** udesale has quit IRC | 16:40 | |
| rlandy | https://github.com/openstack/tripleo-ci/blob/master/toci-quickstart/config/testenv/osinfra_hosts | 16:41 |
| rlandy | uses that, no? | 16:41 |
| rlandy | and this ... https://github.com/openstack/tripleo-ci/blob/master/toci-quickstart/config/testenv/multinode.yml | 16:41 |
| * rlandy checks | 16:41 | |
| rlandy | 2019-05-20 12:32:44.844843 | primary | +(./toci_quickstart.sh:101): main(): cp /home/zuul/src/opendev.org/openstack/tripleo-ci/toci-quickstart/config/testenv/osinfra_hosts /home/zuul/workspace/.quickstart/hosts | 16:43 |
| rlandy | weshay: add ansible_python_interpreter here: https://github.com/openstack/tripleo-ci/blob/master/toci-quickstart/config/testenv/osinfra_hosts#L3? | 16:44 |
| weshay | rlandy what's the var we use for python2 vs python3? | 16:49 |
| rlandy | python_cmd | 16:49 |
| rlandy | but that is in shell | 16:50 |
| * rlandy tries https://review.opendev.org/#/c/660151/6/toci-quickstart/config/testenv/osinfra_hosts to check | 16:50 | |
| rlandy | weshay: ^^ | 16:50 |
| rlandy | weshay: https://review.opendev.org/#/c/660151/ review in place of friday's one | 16:51 |
| weshay | rlandy k.. /me looks for the python2/3 var | 16:51 |
| sshnaidm | rlandy, weshay please review, required for ovb: https://review.opendev.org/#/c/660138/ | 16:51 |
| sshnaidm | rlandy, weshay for context: https://code.engineering.redhat.com/gerrit/#/c/170796/ | 16:52 |
| rlandy | k - will look | 16:52 |
| *** dtrainor has quit IRC | 16:54 | |
| *** dtrainor has joined #oooq | 16:54 | |
| weshay | rlandy I think you can change python3 to $(python_cmd) | 16:55 |
| rlandy | weshay: ha - didn;t work ... same error - | 16:56 |
| * rlandy will rethink | 16:56 | |
| rlandy | I think I have to define that before | 16:57 |
| weshay | rlandy can you add it to localhost as well | 16:58 |
| rlandy | weshay: ack - I did in inventory | 16:58 |
| rlandy | you mean in job def? | 16:58 |
| weshay | rlandy https://review.opendev.org/#/c/660151/6/toci-quickstart/config/testenv/osinfra_hosts | 16:59 |
| weshay | line 1 | 16:59 |
| *** ykarel|away has quit IRC | 16:59 | |
| rlandy | oh | 16:59 |
| rlandy | maybe | 16:59 |
| weshay | 2019-05-20 12:55:47.256582 | primary | fatal: [undercloud -> localhost]: FAILED! => { | 16:59 |
| rlandy | I think I need it earlier | 16:59 |
| weshay | it's delegating to localhost | 16:59 |
| rlandy | but let's try that | 16:59 |
| rlandy | right | 16:59 |
| rlandy | but delegating before it uses this template | 17:00 |
| *** sshnaidm is now known as sshnaidm|afk | 17:00 | |
| rlandy | weshay: added that | 17:01 |
| rlandy | but I think the change is needed earlier - let's see | 17:01 |
| weshay | I need to mark fs053 as non-voting in 3rd party | 17:03 |
| weshay | rlandy that broke it earlier | 17:04 |
| *** amoralej is now known as amoralej|off | 17:07 | |
| weshay | rlandy hrm. | 17:07 |
| *** jpena is now known as jpena|off | 17:07 | |
| *** dtantsur is now known as dtantsur|afk | 17:08 | |
| weshay | rlandy k.. have a thought | 17:08 |
| weshay | rlandy blue? | 17:08 |
| *** derekh has quit IRC | 17:11 | |
| *** ykarel|away has joined #oooq | 17:14 | |
| weshay | rlandy I think we should add the python interp here https://github.com/openstack/tripleo-quickstart/blob/master/roles/tripleo-inventory/tasks/inventory.yml#L110 | 17:14 |
| weshay | and not in hosts | 17:14 |
| weshay | rlandy actually, here https://github.com/openstack/tripleo-quickstart/blob/master/roles/tripleo-inventory/tasks/inventory.yml#L56 | 17:16 |
| weshay | rlandy I'm updating that review to remove it from hosts | 17:25 |
| rlandy | weshay: sorry - lunch - looking | 17:26 |
| weshay | rlandy let's blue.. when you are done eating :) | 17:27 |
| rlandy | weshay: yeah- joining | 17:27 |
| *** Vorrtex has quit IRC | 17:46 | |
| *** Vorrtex has joined #oooq | 17:46 | |
| *** tesseract has quit IRC | 17:51 | |
| *** ykarel|away has quit IRC | 18:04 | |
| weshay | rlandy https://code.engineering.redhat.com/gerrit/#/c/170752/1/nodepool/elements/virt-customize/rhel8-cloud.yaml | 18:23 |
| weshay | tasks: | 18:52 |
| weshay | - yum: | 18:52 |
| weshay | name: "{{ item }}" | 18:52 |
| weshay | state: present | 18:52 |
| weshay | loop: | 18:52 |
| weshay | - httpd | 18:52 |
| weshay | - memcached | 18:52 |
| weshay | tags: | 18:52 |
| weshay | - packages | 18:52 |
| weshay | - template: | 18:52 |
| weshay | src: templates/src.j2 | 18:52 |
| weshay | dest: /etc/foo.conf | 18:52 |
| weshay | tags: | 18:52 |
| weshay | - configuration | 18:52 |
| *** derekh has joined #oooq | 19:26 | |
| *** derekh has quit IRC | 19:26 | |
| weshay | https://yamllint.readthedocs.io/en/stable/rules.html#module-yamllint.rules.braces | 19:26 |
| weshay | rlandy dnf install https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm | 19:29 |
| weshay | dnf install https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm | 19:29 |
| rlandy | weshay: https://code.engineering.redhat.com/gerrit/#/c/167407/4/config/release/rhos-15.yml | 19:34 |
| rlandy | -P 15 -p passed_phase2 | 19:38 |
| *** tcw has joined #oooq | 19:40 | |
| weshay | rlandy http://paste.openstack.org/show/751677/ | 19:41 |
| weshay | rlandy https://koji.fedoraproject.org/koji/buildinfo?buildID=1253189 | 19:43 |
| weshay | https://apps.fedoraproject.org/packages/mock | 19:43 |
| weshay | rlandy ^ | 19:43 |
| weshay | rlandy ansible_distribution != 'Red HatEnterprise Linux' | 19:49 |
| *** dsneddon has quit IRC | 19:54 | |
| *** dsneddon has joined #oooq | 20:03 | |
| weshay | rlandy rhos-release 15-trunk -p passed_phase1 | 20:08 |
| weshay | rlandy https://yamllint.readthedocs.io/en/stable/rules.html#module-yamllint.rules.braces | 20:15 |
| *** vinaykns has quit IRC | 20:18 | |
| weshay | http://paste.openstack.org/show/751678/ | 20:24 |
| weshay | rlandy undercloud_rpm_dependencies | 20:29 |
| *** holser_ has quit IRC | 20:46 | |
| *** aakarsh has quit IRC | 21:11 | |
| *** apahim_ has quit IRC | 21:36 | |
| weshay | rlandy [stack@undercloud-0 ~]$ openstack tripleo container image prepare default --output-env-file /home/stack/containers-prepare-parameter.yaml --local-push-destination | 21:39 |
| weshay | rlandy container_insecure_registries=brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888 | 21:39 |
| *** aakarsh has joined #oooq | 22:02 | |
| weshay | rlandy it's working afaict | 22:07 |
| rlandy | weshay: so far | 22:07 |
| *** tosky has quit IRC | 22:15 | |
| weshay | rlandy dropped the call, ping if you need anything | 22:21 |
| rlandy | weshay: sure - just finishing box setup | 22:21 |
| rlandy | in case we need tempest debug | 22:21 |
| rlandy | weshay: no ad .. tempest failure | 22:35 |
| rlandy | not bad | 22:35 |
| weshay | rlandy NICE | 22:36 |
| rlandy | waiting logs | 22:36 |
| weshay | rlandy we need to add the cirros image to the rhel-8 image | 22:41 |
| rlandy | 2019-05-20 22:34:24 | 2019-05-20 22:34:24.518 98901 INFO tempest.lib.common.rest_client [req-4b08e917-3f46-4277-af81-d71ff6c7e7ee ] Request (main): 200 GET http://192.168.24.1:9292/v2/images 0.029s[00m | 22:41 |
| weshay | passing off to chandan | 22:41 |
| rlandy | yep - was juts looking at that | 22:41 |
| weshay | he's fixed this before | 22:41 |
| rlandy | let me check on rhos-14 | 22:42 |
| rlandy | tempest_container_namespace: openstack-tempest | 22:45 |
| rlandy | tempest_container_tag: "{{ container_build_id }}" | 22:45 |
| rlandy | ^^ has those two | 22:45 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/19/170519/6/check/tripleo-ci-rhel-7-standalone-rhos-14/d25ca1c/logs/undercloud/home/zuul/tempest.log.txt.gz | 22:48 |
| rlandy | comparing | 22:48 |
| weshay | rlandy the cirros image is meant to built into the image | 22:52 |
| weshay | for shiz | 22:52 |
| rlandy | weshay: ok - will see what chandan says | 22:52 |
| weshay | rlandy sent an email | 22:52 |
| rlandy | weshay: yep, saw that - those patches are not merge-ready yet | 22:53 |
| rlandy | they are DNM | 22:53 |
| rlandy | with some hacks | 22:53 |
| weshay | rlandy I know they can help push them | 22:53 |
| rlandy | weshay: ok - tomorrow will see what can be done with baremetal | 22:54 |
| rlandy | thanks for your help today | 22:54 |
| *** rlandy has quit IRC | 23:25 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!