| *** hamzy has joined #oooq | 00:19 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039 @ https://review.openstack.org/602248, (2 more messages) | 00:23 |
|---|---|---|
| *** saneax has joined #oooq | 01:27 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, (2 more messages) | 02:23 |
| *** trown|outtypewww has quit IRC | 02:31 | |
| *** trown has joined #oooq | 02:33 | |
| *** apetrich has quit IRC | 03:14 | |
| *** ykarel|away has joined #oooq | 03:15 | |
| *** ykarel|away is now known as ykarel | 03:23 | |
| *** ratailor has joined #oooq | 03:59 | |
| *** udesale has joined #oooq | 04:00 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb- (2 more messages) | 04:23 |
| *** saneax has quit IRC | 04:50 | |
| *** saneax has joined #oooq | 04:50 | |
| *** jfrancoa has joined #oooq | 05:23 | |
| *** ykarel_ has joined #oooq | 05:43 | |
| *** raukadah is now known as chandankumar | 05:45 | |
| *** ykarel has quit IRC | 05:45 | |
| *** jbadiapa has joined #oooq | 05:51 | |
| *** skramaja has joined #oooq | 05:56 | |
| *** ykarel_ is now known as ykarel | 06:07 | |
| *** jbadiapa has quit IRC | 06:17 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb- (2 more messages) | 06:23 |
| *** dsneddon has quit IRC | 06:24 | |
| *** jaosorior has joined #oooq | 06:33 | |
| *** ksambor has joined #oooq | 06:38 | |
| *** dsneddon has joined #oooq | 06:40 | |
| *** dsneddon has quit IRC | 06:45 | |
| *** tosky has joined #oooq | 07:29 | |
| *** sshnaidm|rover is now known as sshnaidm|afk | 07:35 | |
| *** matbu has quit IRC | 07:36 | |
| *** holser|run is now known as holser_ | 07:39 | |
| sshnaidm|afk | marios_|ruck, seems like 035 is passing in queens, so we'll have queens promotion \o/ | 07:40 |
| *** apetrich has joined #oooq | 07:40 | |
| marios_|ruck | sshnaidm|afk: is it i thought it wasn't /me looks again | 07:42 |
| marios_|ruck | sshnaidm|afk: ah you mean current run? | 07:43 |
| marios_|ruck | sshnaidm|afk: cos previous failed still https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens | 07:43 |
| marios_|ruck | sshnaidm|afk: but really its rocky we need promotion most urgently the others promoted this week | 07:44 |
| sshnaidm|afk | marios_|ruck, didn't finish yet https://review.rdoproject.org/zuul/status | 07:44 |
| marios_|ruck | sshnaidm|afk: ack cool | 07:44 |
| ykarel | marios_|ruck, the fs035 queens was merged last night | 07:44 |
| ykarel | so current run should pass | 07:44 |
| ykarel | queens fix was merged last night | 07:44 |
| sshnaidm|afk | marios_|ruck, rocky containers new job ran ok in test: https://review.rdoproject.org/r/#/c/19482/ | 07:44 |
| ykarel | sshnaidm|afk, that job used master ^^ | 07:44 |
| ykarel | container build one | 07:45 |
| marios_|ruck | ykarel: yeah thx | 07:45 |
| sshnaidm|afk | ykarel, master? | 07:45 |
| ykarel | sshnaidm|afk, yes, i commented there | 07:45 |
| sshnaidm|afk | ykarel, I see | 07:45 |
| ykarel | marios_|ruck, are u looking for Text file busy bug? | 07:45 |
| marios_|ruck | ykarel: i saw that just once | 07:46 |
| sshnaidm|afk | ok, will do in rocky branch | 07:46 |
| * sshnaidm|afk bbl | 07:46 | |
| ykarel | marios_|ruck, that was hitting in past as well:- https://bugs.launchpad.net/tripleo/+bug/1792375 | 07:46 |
| openstack | Launchpad bug 1792375 in tripleo "[master] multinode noop job failure giving IOError: [Errno 26] Text file busy: '/home/zuul/workspace/.quickstart/bin/python'" [Critical,Fix released] - Assigned to Sorin Sbarnea (ssbarnea) | 07:46 |
| marios_|ruck | ykarel: i added a note for now https://etherpad.openstack.org/p/ruckroversprint7 | 07:46 |
| marios_|ruck | ykarel: ack adding note there thanks | 07:46 |
| ykarel | marios_|ruck, hmm just wanted to avoid duplicate bug | 07:46 |
| marios_|ruck | ykarel: ack didn't file a bug.. i usually wait to see it 2x before filing :D | 07:47 |
| ykarel | yes good | 07:47 |
| marios_|ruck | ykarel: but noted on the pad for now lets see | 07:47 |
| ykarel | okk | 07:47 |
| ykarel | marios_|ruck, can you review https://review.openstack.org/#/c/644592/ | 07:51 |
| ykarel | fix for master phase1 | 07:51 |
| *** dsneddon has joined #oooq | 07:51 | |
| ykarel | jaosorior, ^^ | 07:51 |
| *** dsneddon has quit IRC | 07:55 | |
| marios_|ruck | ykarel: | 07:57 |
| marios_|ruck | ykarel: ack | 07:57 |
| *** ykarel is now known as ykarel|afk | 07:59 | |
| jaosorior | ykarel|afk: ack | 08:09 |
| *** ccamacho has joined #oooq | 08:11 | |
| *** ykarel|afk is now known as ykarel | 08:19 | |
| *** amoralej|off is now known as amoralej | 08:23 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb- (2 more messages) | 08:23 |
| ykarel | marios_|ruck, jaosorior Thanks | 08:28 |
| *** dsneddon has joined #oooq | 08:33 | |
| *** dsneddon has quit IRC | 08:38 | |
| *** bogdando has joined #oooq | 08:48 | |
| *** jtomasek has quit IRC | 08:49 | |
| *** jpena|off is now known as jpena | 08:53 | |
| *** dsneddon has joined #oooq | 09:05 | |
| marios_|ruck | sshnaidm|afk: so job is green but we need to fix stuff (the namespace is wrong) http://logs.rdoproject.org/82/19482/2/check/periodic-tripleo-centos-7-rocky-containers-build-push/88d8a53/conf/kolla-build.conf.txt.gz are you looking at it already or should i | 09:09 |
| *** jtomasek has joined #oooq | 09:10 | |
| marios_|ruck | sshnaidm|afk: ah no it is check there its ok but we still need to fix something in the upstream job for the namespace | 09:10 |
| *** jbadiapa has joined #oooq | 09:17 | |
| *** dsneddon has quit IRC | 09:19 | |
| *** dtantsur|afk is now known as dtantsur | 09:21 | |
| *** derekh has joined #oooq | 09:25 | |
| *** jaosorior has quit IRC | 09:36 | |
| *** ykarel is now known as ykarel|lunch | 09:43 | |
| *** ykarel|lunch has quit IRC | 09:48 | |
| *** matbu has joined #oooq | 09:49 | |
| *** dsneddon has joined #oooq | 09:54 | |
| *** jbadiapa has quit IRC | 09:56 | |
| *** dsneddon has quit IRC | 10:02 | |
| *** ykarel has joined #oooq | 10:08 | |
| *** ykarel is now known as ykarel|lunch | 10:09 | |
| marios_|ruck | DNM - testing periodic container push job for rocky https://review.openstack.org/644807 | 10:11 |
| marios_|ruck | sshnaidm|afk: ykarel|lunch ^ | 10:11 |
| marios_|ruck | sshnaidm|afk: ykarel|lunch and here sorry https://review.rdoproject.org/r/19531 Testing rocky containers build push job | 10:11 |
| marios_|ruck | testproject stable/rocky ^ | 10:12 |
| ykarel|lunch | marios_|ruck, ack | 10:15 |
| *** jbadiapa has joined #oooq | 10:16 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb- (2 more messages) | 10:23 |
| zbr | panda: how do I get the last promoted hash for current-triple for example? | 10:27 |
| panda | zbr: dlrnapi promotion-get | 10:28 |
| zbr | panda: without extra tools, cannot get using curl? | 10:29 |
| panda | zbr: yes, but I don't know the api path | 10:30 |
| zbr | panda: ok. thanks. i was curious. i will show you later why. | 10:30 |
| *** ykarel|lunch is now known as ykarel | 10:33 | |
| *** jaosorior has joined #oooq | 10:35 | |
| *** dsneddon has joined #oooq | 10:37 | |
| *** dsneddon has quit IRC | 10:41 | |
| *** sshnaidm|afk is now known as sshnaidm|rover | 10:45 | |
| sshnaidm|rover | marios_|ruck, http://logs.rdoproject.org/31/19531/1/check/periodic-tripleo-centos-7-rocky-containers-build-push/128b044/logs/build.log.txt.gz | 10:52 |
| weshay | zbr https://trunk.rdoproject.org/centos7-master/ look for previous-current-tripleo/ | 10:53 |
| *** ykarel is now known as ykarel|afk | 10:55 | |
| marios_|ruck | sshnaidm|rover: ack but config looks good namespace=tripleorocky" http://logs.rdoproject.org/31/19531/1/check/periodic-tripleo-centos-7-rocky-containers-build-push/128b044/conf/kolla-build.conf.txt.gz | 10:55 |
| marios_|ruck | sshnaidm|rover: lemme update and we can get a run hopefully | 10:55 |
| marios_|ruck | sshnaidm|rover: i mean another run without that comment after false | 10:56 |
| ykarel|afk | marios_|ruck, also you pushed against master | 10:57 |
| ykarel|afk | you need to push against stable/rocky | 10:57 |
| marios_|ruck | ykarel|afk: it shouldn't be pushing anywhere but what do you mean | 10:58 |
| ykarel|afk | marios_|ruck, https://review.rdoproject.org/r/#/c/19531/ | 10:58 |
| ykarel|afk | marios_|ruck, Branch master | 10:58 |
| marios_|ruck | ykarel|afk: ah ok thanks | 10:58 |
| sshnaidm|rover | marios_|ruck, the job should fail if it didn't build.. | 10:58 |
| marios_|ruck | ykarel|afk: yeah weird i thought it was rocky | 10:58 |
| ykarel|afk | marios_|ruck, you need to change .gitreview: defaultbranch=master | 10:58 |
| ykarel|afk | to stable/rocky | 10:58 |
| marios_|ruck | sshnaidm|rover: yes right (another issue) | 10:58 |
| *** yolanda has quit IRC | 10:59 | |
| marios_|ruck | ykarel|afk: ah thanks | 10:59 |
| * ykarel|afk leaving for a while | 10:59 | |
| *** yolanda has joined #oooq | 10:59 | |
| zbr | weshay: got the magic string from the repo file, thanks. Now the question is how to get the same string using the dlrnapi or curl. | 11:01 |
| weshay | zbr what are you trying to do? | 11:01 |
| zbr | weshay: already did manually, see https://images.rdoproject.org/stein/ | 11:02 |
| zbr | weshay: i am trying to make the tool easier to use, to make the hash optional and use latest when not specified. | 11:02 |
| weshay | ah ya.. when calling that script.. ya.. just use the previous link in dlrn.. cool man | 11:04 |
| weshay | we had a tool that kept a record of all the promotions across the pipelines, nobody used it afaik though | 11:04 |
| marios_|ruck | ykarel|afk: sshnaidm|rover is here for rocky https://review.rdoproject.org/r/#/c/19533/ | 11:06 |
| *** jtomasek has quit IRC | 11:14 | |
| *** dsneddon has joined #oooq | 11:15 | |
| sshnaidm|rover | marios_|ruck, http://logs.rdoproject.org/33/19533/1/check/periodic-tripleo-centos-7-rocky-containers-build-push/94b8808/logs/build.log.txt.gz | 11:15 |
| sshnaidm|rover | marios_|ruck, can we run it with depends on https://review.openstack.org/#/c/644823/ ? | 11:16 |
| sshnaidm|rover | marios_|ruck, let's see what is executed there | 11:16 |
| *** ykarel|afk is now known as ykarel | 11:17 | |
| marios_|ruck | sshnaidm|rover: sure. but i think this confirms what weshay suspected | 11:17 |
| sshnaidm|rover | marios_|ruck, ? | 11:17 |
| marios_|ruck | sshnaidm|rover: looks like there are things missing in container image build for stable/rocky like in tripleo-common | 11:17 |
| marios_|ruck | 2019-03-20 11:13:27 | openstack overcloud container image build: error: unrecognized arguments: --exclude opendaylight | 11:17 |
| ykarel | marios_|ruck, ack | 11:17 |
| sshnaidm|rover | marios_|ruck, what does it mean? We don't have opendaylight in rocky? | 11:18 |
| marios_|ruck | sshnaidm|rover: well i can't run itwith depends on https://review.openstack.org/#/c/644823/ | 11:18 |
| marios_|ruck | sshnaidm|rover: cos the current depends on is also tripleo-ci we have to chain them | 11:18 |
| marios_|ruck | sshnaidm|rover: i think it means there is no '--exclude' perhaps | 11:19 |
| marios_|ruck | lemme check | 11:19 |
| sshnaidm|rover | marios_|ruck, mm.. ok, will do a combined patch | 11:20 |
| *** dsneddon has quit IRC | 11:20 | |
| ykarel | so queens finally promoted, phase1 running | 11:21 |
| marios_|ruck | ykarel: cool | 11:21 |
| ykarel | marios_|ruck, arx patch merged, good to rerun rocky job again | 11:22 |
| ykarel | https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo_trunk-promote-rocky-current-tripleo/127/ | 11:22 |
| marios_|ruck | sshnaidm|rover: hmm so theer is an exclude but its different in rocky | 11:22 |
| marios_|ruck | sshnaidm|rover: like https://github.com/openstack/python-tripleoclient/blob/4b01ede2b632db7666246a685e7a9d8c017a0c17/tripleoclient/v1/container_image.py#L284 vs https://github.com/openstack/python-tripleoclient/blob/23e610c457363456c9d34335fcbc4887f570530d/tripleoclient/v1/container_image.py#L165 | 11:24 |
| *** jtomasek has joined #oooq | 11:24 | |
| *** ccamacho has quit IRC | 11:24 | |
| *** ccamacho has joined #oooq | 11:26 | |
| sshnaidm|rover | marios_|ruck, what is the difference? | 11:28 |
| *** udesale has quit IRC | 11:28 | |
| sshnaidm|rover | marios_|ruck, regex and name? | 11:29 |
| sshnaidm|rover | marios_|ruck, let's use name then, will work as regex too I suppose | 11:29 |
| *** udesale has joined #oooq | 11:29 | |
| sshnaidm|rover | marios_|ruck, otherwise we'll need to consider branch in command | 11:29 |
| sshnaidm|rover | marios_|ruck, you can depend on https://review.openstack.org/#/c/644831/ | 11:30 |
| marios_|ruck | sshnaidm|rover: sure but i'm just wondering what else is missing from there this is just the client side... the actual building happens in tripleo-common | 11:30 |
| marios_|ruck | sshnaidm|rover: added comment can you add the kolla build stuff too | 11:32 |
| marios_|ruck | sshnaidm|rover: and i'll update the depends-on | 11:32 |
| weshay | arxcruz \0/ https://review.openstack.org/#/c/644578/ | 11:32 |
| arxcruz | weshay: yay! Finally | 11:32 |
| arxcruz | weshay: kopecmartin chandankumar please take a look at https://tree.taiga.io/project/tripleo-ci-board/us/867?milestone=223049 | 11:34 |
| marios_|ruck | sshnaidm|rover: (done https://review.rdoproject.org/r/#/c/19533/ ) | 11:35 |
| *** chem has quit IRC | 11:36 | |
| *** chem has joined #oooq | 11:36 | |
| sshnaidm|rover | marios_|ruck, push=False was failing, isn't it? | 11:38 |
| marios_|ruck | sshnaidm|rover: no it was the comment it didn't like i thought? | 11:38 |
| sshnaidm|rover | marios_|ruck, oh, maybe | 11:39 |
| sshnaidm|rover | marios_|ruck, why False there..? | 11:40 |
| marios_|ruck | sshnaidm|rover: well do we want to push to tripleorocky namespace? maybe not yet thats all like lets see the job run first? | 11:41 |
| marios_|ruck | sshnaidm|rover: cos the current periodic job is already pushing right i mean the old containers build job | 11:41 |
| sshnaidm|rover | marios_|ruck, the old job fails and will fail, so nothing to lose here | 11:41 |
| marios_|ruck | sshnaidm|rover: ah ok fine then feel free to leave that out then | 11:42 |
| weshay | panda zbr should we push some containers to the docker.io tripleostein namespace as well? | 11:42 |
| sshnaidm|rover | marios_|ruck, where is tag set - tripleorocky? | 11:42 |
| weshay | zbr++ | 11:42 |
| hubbot1 | weshay: zbr's karma is now 3 | 11:43 |
| weshay | https://images.rdoproject.org/stein/rdo_trunk/current-tripleo/ | 11:43 |
| marios_|ruck | sshnaidm|rover: which tag? the one we use for containers? no it uses the delorean hash | 11:43 |
| sshnaidm|rover | marios_|ruck, sorry, I mean namspace | 11:43 |
| sshnaidm|rover | marios_|ruck, because I see in kolla conf namespace=tripleomaster | 11:43 |
| *** saneax has quit IRC | 11:43 | |
| marios_|ruck | sshnaidm|rover: where do you see that? http://logs.rdoproject.org/33/19533/1/check/periodic-tripleo-centos-7-rocky-containers-build-push/94b8808/conf/kolla-build.conf.txt.gz | 11:43 |
| marios_|ruck | namespace=tripleorocky | 11:44 |
| sshnaidm|rover | marios_|ruck, oh, found it, yeah | 11:44 |
| *** saneax has joined #oooq | 11:44 | |
| *** ratailor has quit IRC | 11:44 | |
| sshnaidm|rover | let's cross fingers | 11:44 |
| marios_|ruck | sshnaidm|rover: its from the review i posted today which fixes that | 11:44 |
| marios_|ruck | sshnaidm|rover: ack | 11:44 |
| marios_|ruck | brb | 11:44 |
| zbr | weshay: download img is kinda slow here, but i am upgrading it in ~week. | 11:44 |
| weshay | zbr ya.. for humans there is only one source | 11:45 |
| arxcruz | marios_|ruck: regarding https://bugs.launchpad.net/tripleo/+bug/1820585 | 11:46 |
| openstack | Launchpad bug 1820585 in tripleo "[queens] periodic centos-ovb-1ctlr_1comp-featureset021-queens fails tempest test_qos & test_force_detach_volume" [High,Triaged] - Assigned to Arx Cruz (arxcruz) | 11:46 |
| arxcruz | marios_|ruck: it's fs021 | 11:47 |
| arxcruz | was this failing before ? | 11:47 |
| sshnaidm|rover | weshay, marios_|ruck queens is promoted | 11:48 |
| marios_|ruck | arxcruz: not sure arxcruz i see a lot of fails at https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset021-queens | 11:48 |
| marios_|ruck | arxcruz: is this job just never meant to pass (i recall weshay saying something about this being the test for skiplist? ) | 11:49 |
| marios_|ruck | arxcruz: if the bug is invalid we can close it | 11:49 |
| weshay | sshnaidm|rover I saw :) | 11:49 |
| weshay | sshnaidm|rover rdo promotion for queens looks like it will be good too | 11:49 |
| sshnaidm|rover | weshay, yeah, and for master I hop | 11:51 |
| weshay | that would be nice | 11:51 |
| *** dsneddon has joined #oooq | 11:52 | |
| *** dsneddon has quit IRC | 11:57 | |
| zbr | weshay: added https://review.rdoproject.org/r/#/c/19541/ | 12:00 |
| zbr | i am curious why virt-customize seems take forever, already >20mins and counting, ssd. | 12:05 |
| chandankumar | kopecmartin: arxcruz I will be not around tomorrow due to holi / holiday in india | 12:06 |
| kopecmartin | chandankumar, ack, enjoy | 12:06 |
| *** skramaja has quit IRC | 12:07 | |
| *** skramaja_ has joined #oooq | 12:07 | |
| *** jbadiapa has quit IRC | 12:11 | |
| *** dsneddon has joined #oooq | 12:17 | |
| *** dsneddon has quit IRC | 12:21 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario001-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario002-standalone, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario008-multinode-oooq- (2 more messages) | 12:23 |
| sshnaidm|rover | marios_|ruck, do you know why is it configured so? https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-buildcontainers/templates/kolla-build.conf.j2#L10-L14 | 12:28 |
| sshnaidm|rover | marios_|ruck, pipeline, namespace, etc | 12:28 |
| *** jpena is now known as jpena|lunch | 12:29 | |
| *** rlandy has joined #oooq | 12:31 | |
| weshay | panda want to go early? | 12:34 |
| weshay | panda heh.. chatting w/ marios_|ruck first | 12:35 |
| *** fmount has quit IRC | 12:37 | |
| *** chem has quit IRC | 12:37 | |
| *** chem has joined #oooq | 12:37 | |
| rlandy | marios_|ruck: hi - is it possible to pass a variable to parameters_defaults that would impact a role passed in the overcloud deployment https://github.com/openstack/tripleo-heat-templates/blob/master/deployment/timesync/chrony-baremetal-ansible.yaml#L119? | 12:38 |
| panda | weshay: I'll use the 20 minutes for the lunch. | 12:38 |
| rlandy | I want to change this value: https://github.com/openstack/ansible-role-chrony/blob/master/tasks/config.yml#L14 | 12:39 |
| zbr | weshay: in the end virt-customize choked, and i am not sure what was wrong http://paste.openstack.org/show/748116/ -- but line 1140 looks weird. | 12:39 |
| zbr | but i believe is caused by empty var expansion, https://github.com/openstack/tripleo-quickstart/blob/0971264bbbb70c725ac201dc354df855a8e7d634/roles/repo-setup/templates/repo_setup.sh.j2#L86 | 12:43 |
| *** skramaja has joined #oooq | 12:47 | |
| *** skramaja_ has quit IRC | 12:48 | |
| *** fmount has joined #oooq | 12:48 | |
| *** dsneddon has joined #oooq | 12:48 | |
| *** dsneddon has quit IRC | 12:54 | |
| *** jaosorior has quit IRC | 12:56 | |
| marios_|ruck | rlandy: looking sorry was on phone | 13:05 |
| marios_|ruck | rlandy: you mean pass something into parameter defaults to be consumed by ansible role? only if it was wired up already i mean if the tht parameter was wired up and passed into the role vars? | 13:06 |
| rlandy | marios_|ruck: atm the values in the ansible role are not set anywhere - the role uses the defaults | 13:07 |
| weshay | panda ready when ever | 13:07 |
| panda | weshay: I'm already there. | 13:07 |
| rlandy | marios_|ruck: is there any way to pass a param to the overcloud deploy that would reach the ansible role? | 13:07 |
| rlandy | like a -e type value | 13:08 |
| marios_|ruck | rlandy: here this looks like an example see the same file you pasted https://github.com/openstack/tripleo-heat-templates/blob/0a841e3433886e19a70a228f5f1d7069ec42a969/deployment/timesync/chrony-baremetal-ansible.yaml#L128 | 13:08 |
| marios_|ruck | chrony_ntp_servers: {get_param: NtpServer} | 13:08 |
| marios_|ruck | rlandy: where NtpServer is from the tripleo heat templates parameters. | 13:08 |
| marios_|ruck | rlandy: that one seems to be consumed by the chrony role http://git.openstack.org/cgit/openstack/ansible-role-chrony/tree/defaults/main.yml | 13:09 |
| rlandy | marios_|ruck: yes - but I would have to change the role to accept a value setting from outside | 13:09 |
| marios_|ruck | rlandy: so where you have the include_role https://github.com/openstack/tripleo-heat-templates/blob/0a841e3433886e19a70a228f5f1d7069ec42a969/deployment/timesync/chrony-baremetal-ansible.yaml#L120 maybe add vars: there | 13:10 |
| rlandy | marios_|ruck: https://review.openstack.org/#/c/644562/1/deployment/timesync/chrony-baremetal-ansible.yaml | 13:10 |
| marios_|ruck | rlandy: you mean the chrony role doesn't accept the param you want to pass? not following | 13:10 |
| marios_|ruck | looking at review | 13:10 |
| marios_|ruck | rlandy: ack doesn't that work? | 13:11 |
| rlandy | It does - but I would prefer not to change the deployment template | 13:11 |
| rlandy | if that is the only way, ok - then I have it | 13:11 |
| marios_|ruck | rlandy: would it help to parameterize it? | 13:11 |
| marios_|ruck | rlandy: i mean make it more like chrony_service_state: {get_param: CHronyState} and yu'd have to set that in the paremeter defaults | 13:12 |
| marios_|ruck | ChronyState i mean | 13:12 |
| rlandy | marios_|ruck; in theory, setting the vars should not be needed | 13:12 |
| rlandy | the defaults should work fine | 13:12 |
| rlandy | but something is happening and they are not | 13:12 |
| rlandy | the review I showed was not intended to be merged - but to prove a point | 13:13 |
| *** agopi has quit IRC | 13:13 | |
| rlandy | marios_|ruck: what I am really changing - is setting the state from started to restart | 13:14 |
| rlandy | to force a restart | 13:14 |
| rlandy | which should not be necessary if the notify restart was not skipped | 13:15 |
| weshay | rfolco did you change the priority order of the taiga board? | 13:16 |
| rfolco | not me weshay | 13:16 |
| weshay | who did it? | 13:16 |
| * rfolco looks to panda | 13:16 | |
| weshay | panda says it wasn't him | 13:16 |
| rlandy | I think we are hitting something like https://stackoverflow.com/questions/44168529/ansible-service-module-not-starting-supervisor-with-state-restarted | 13:17 |
| marios_|ruck | rlandy: are you seing it being skipped ? (where by the way i mean where should i be looking sorry not fully following where you're working if not on that patch ) | 13:18 |
| rlandy | marios_|ruck: you see the restart being skipped in the logs | 13:19 |
| rlandy | just like the the description above | 13:19 |
| rlandy | I think it's an ansible thing | 13:19 |
| rfolco | weshay, I wish we had a taiga-blame to see who did | 13:19 |
| marios_|ruck | rlandy: could it be dependency of chrony not satisfied like in the stackoverflow you pointed to | 13:21 |
| marios_|ruck | rlandy: and is this for a bug ? | 13:21 |
| *** jbadiapa has joined #oooq | 13:21 | |
| *** jaosorior has joined #oooq | 13:21 | |
| marios_|ruck | rlandy: i don't have the context on what you're working on here | 13:21 |
| *** ccamacho has quit IRC | 13:23 | |
| rlandy | marios_|ruck: there was a bug logged fro OVB - but I don't think OVB really requires the restart - baremetal absolutely does because the default ntp servers are unavailable from internal | 13:23 |
| rlandy | getting | 13:23 |
| *** ccamacho has joined #oooq | 13:23 | |
| rlandy | https://bugs.launchpad.net/tripleo/+bug/1820580 | 13:23 |
| openstack | Launchpad bug 1820580 in tripleo "Chronyd sync fails in overcloud deployment" [Critical,Triaged] | 13:23 |
| marios_|ruck | rlandy: this patch was merged for that https://review.openstack.org/#/c/644378/ | 13:24 |
| rlandy | this paste captures it: http://paste.openstack.org/show/747980/ | 13:24 |
| rlandy | marios_|ruck: yeah - OVB gets by but it doesn't fix the skipped restart | 13:25 |
| *** dsneddon has joined #oooq | 13:25 | |
| marios_|ruck | rlandy: so maybe we need a new bug then | 13:26 |
| marios_|ruck | rlandy: i mean this bug we're discussing now is 'chronyd skips restart' | 13:26 |
| rlandy | marios_|ruck: correct - just absorbing the stackoverflow post so I can explain it properly | 13:27 |
| rlandy | or try the fix out | 13:27 |
| marios_|ruck | rlandy: ack | 13:27 |
| *** ccamacho has quit IRC | 13:28 | |
| *** ccamacho has joined #oooq | 13:28 | |
| *** dsneddon has quit IRC | 13:30 | |
| *** amoralej is now known as amoralej|lunch | 13:30 | |
| *** dsneddon has joined #oooq | 13:33 | |
| *** dsneddon has quit IRC | 13:38 | |
| *** jpena|lunch is now known as jpena | 13:39 | |
| *** agopi has joined #oooq | 13:41 | |
| marios_|ruck | weshay: sshnaidm|rover panda rfolco lets merge that please https://review.openstack.org/#/c/644799/ see result in http://logs.rdoproject.org/33/19533/1/check/periodic-tripleo-centos-7-rocky-containers-build-push/94b8808/conf/kolla-build.conf.txt.gz *(namespace=tripleorocky) | 13:47 |
| marios_|ruck | sshnaidm|rover: i see latest version still hitting that issue http://logs.rdoproject.org/33/19533/3/check/periodic-tripleo-centos-7-rocky-containers-build-push/b893982/logs/build.log.txt.gz | 13:48 |
| *** holser_ is now known as holser|run | 13:49 | |
| *** holser|run is now known as holser|away_2h_d | 13:49 | |
| *** holser|away_2h_d has quit IRC | 13:50 | |
| rlandy | zbr: you had a patch/card to bump ansible, right? | 13:52 |
| zbr | yes. one moment. | 13:53 |
| zbr | rlandy: https://review.openstack.org/#/c/619017/ and its dependencies. feel tree to takeover. | 13:54 |
| zbr | all my kudos if you lead it | 13:54 |
| *** ykarel is now known as ykarel|afk | 13:56 | |
| *** ykarel|afk is now known as ykarel | 14:08 | |
| ykarel | marios_|ruck, --exclude option is not there in tripleoclient stable/rocky | 14:08 |
| marios_|ruck | ykarel: yeah found it am gonna post some backports | 14:11 |
| ykarel | marios_|ruck, ack | 14:11 |
| ykarel | there may be multiple things missing | 14:12 |
| marios_|ruck | ykarel: sshnaidm|rover from a review of git blame looks like that is the main thing missing but we'll wee | 14:12 |
| marios_|ruck | see | 14:12 |
| marios_|ruck | :D | 14:12 |
| *** dsneddon has joined #oooq | 14:12 | |
| ykarel | marios_|ruck, also check tripleo common, i remember atleast a patch there was important | 14:12 |
| marios_|ruck | ykarel: yeah there is a tripleo-common side to that one in kolla builder | 14:12 |
| marios_|ruck | ykarel: ack | 14:12 |
| marios_|ruck | brb coffee | 14:12 |
| ykarel | marios_|ruck, https://review.openstack.org/#/c/616022/5 | 14:13 |
| ykarel | so check if ^^ is needed | 14:13 |
| marios_|ruck | ykarel: ack have it in my list | 14:13 |
| ykarel | ack | 14:13 |
| marios_|ruck | https://review.openstack.org/#/c/624530/1 Add excludes to kolla | 14:13 |
| chandankumar | arxcruz: weshay https://review.openstack.org/#/c/635478/ | 14:16 |
| chandankumar | needs +w on this! | 14:16 |
| sshnaidm|rover | weshay, marios_|ruck check it out too: https://review.openstack.org/#/c/644823/ | 14:17 |
| arxcruz | chandankumar: where's the taiga link ? | 14:17 |
| *** dsneddon has quit IRC | 14:17 | |
| chandankumar | arxcruz: it is from old bug | 14:17 |
| arxcruz | chandankumar: since marios_|ruck complain about it, i'll only review tq/tqe when i see taiga link | 14:17 |
| rlandy | zbr: I don't want to take over the ansible bump, I am debugging an issue and was just checking the version. to fix it, ansible in tripleo would have to bmp to 2.8 | 14:18 |
| arxcruz | you can blame marios_|ruck :P | 14:18 |
| chandankumar | arxcruz: for this one https://review.openstack.org/644571 taiga link added | 14:18 |
| arxcruz | chandankumar: great, i'll wait the jobs | 14:18 |
| rfolco | panda, please let me know what you find about making containers-build-push-base job "branchless" - see my comments at https://tree.taiga.io/project/tripleo-ci-board/task/869 | 14:22 |
| rfolco | zbr, this overlaps with your patch on config | 14:22 |
| marios_|ruck | arxcruz: :D | 14:22 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario001-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario002-standalone, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario008-multinode-oooq- (2 more messages) | 14:23 |
| zbr | rfolco: yeah. in fact I do not care what goes as long we get some containers for stein published. | 14:24 |
| rfolco | zbr, I can rebase on top of your patch, this is not the point. I am just proposing the base job to be branchless | 14:25 |
| *** skramaja has quit IRC | 14:26 | |
| *** ykarel is now known as ykarel|afk | 14:26 | |
| chandankumar | time to move in vacation mode see ya on friday! | 14:29 |
| *** chandankumar is now known as raukadah | 14:29 | |
| *** derekh has quit IRC | 14:31 | |
| marios_|ruck | weshay: "stop that traain, i wana get on" | 14:32 |
| weshay | lolz | 14:32 |
| sshnaidm|rover | rfolco, fyi https://review.rdoproject.org/r/#/c/19452/ | 14:34 |
| sshnaidm|rover | zbr, ^^ | 14:34 |
| zbr | rfolco: is your patch ready to review/merge? if so lets merge yours. | 14:35 |
| rfolco | sshnaidm|rover, I saw, this is merged... and this has branch_override: 'stable/rocky' | 14:35 |
| rfolco | do we really need this? | 14:35 |
| *** ykarel_ has joined #oooq | 14:35 | |
| rfolco | I thought we needed for the old way only, for undercloud installs | 14:35 |
| sshnaidm|rover | rfolco, if you want to use rocky, then we do | 14:35 |
| *** dsneddon has joined #oooq | 14:36 | |
| sshnaidm|rover | rfolco, this tells to zuul what to clone | 14:36 |
| *** amoralej|lunch is now known as amoralej | 14:36 | |
| rfolco | sshnaidm|rover, override-checkout is the zuul config... branch_override is a quickstart thing | 14:37 |
| *** ykarel|afk has quit IRC | 14:37 | |
| sshnaidm|rover | rfolco, right, so depends on if we use it in job | 14:38 |
| *** chem has quit IRC | 14:38 | |
| rfolco | sshnaidm|rover, this is my point, the new build containers push job does not install undercloud and does not need it | 14:38 |
| rfolco | you only need release: rocky | 14:38 |
| *** chem has joined #oooq | 14:38 | |
| sshnaidm|rover | rfolco, ok, great | 14:39 |
| rfolco | sshnaidm|rover, I am proposing a base without branch info, so we can just user release var in the child job... we do not need to duplicate that base job for every branch | 14:39 |
| *** dsneddon has quit IRC | 14:40 | |
| rfolco | sshnaidm|rover, this is what I am proposing https://review.rdoproject.org/r/#/c/19405/6/zuul.d/jobs.yaml -- see L492 | 14:41 |
| *** vinaykns has joined #oooq | 14:43 | |
| *** dsneddon has joined #oooq | 14:44 | |
| rlandy | marios_|ruck: sshnaidm|rover: weshay: bogdando: fyi ... https://bugs.launchpad.net/tripleo/+bug/1821018 | 14:45 |
| openstack | Launchpad bug 1821018 in tripleo "Restart chronyd execution is skipped on overcloud-novacompute-0" [Undecided,Triaged] | 14:45 |
| rlandy | left the bug w/o tags / importance as OVB is passing now | 14:45 |
| sshnaidm|rover | rfolco, cool, let's go with it | 14:47 |
| rfolco | sshnaidm|rover, great | 14:48 |
| sshnaidm|rover | rfolco, but better to split the patch to job definitions and job layout | 14:48 |
| sshnaidm|rover | rfolco, then we can merge job definition right now | 14:48 |
| rfolco | sshnaidm|rover, ack | 14:48 |
| sshnaidm|rover | without dependencies | 14:48 |
| panda | weshay: rlandy I think there might be a bug in tiaga currently, I can't move the user stories up or down, I see other weird things. I'll contact the support. | 14:49 |
| panda | rfolco: not rlandy ^ | 14:49 |
| *** dsneddon has quit IRC | 14:49 | |
| rfolco | haha | 14:49 |
| sshnaidm|rover | so next sprint in jira? | 14:50 |
| arxcruz | a bug in taiga? | 14:51 |
| arxcruz | hm... | 14:51 |
| *** dtantsur is now known as dtantsur|bbl | 14:51 | |
| weshay | arxcruz AH quiet you | 14:51 |
| *** jbadiapa has quit IRC | 14:51 | |
| rfolco | don't f* arxcruz | 14:52 |
| rfolco | lol | 14:52 |
| arxcruz | I said nothing | 14:52 |
| arxcruz | :-# | 14:52 |
| rfolco | :) | 14:52 |
| * panda next idea for improvement: Every time we find a bug in our tool, we change the tool. | 14:53 | |
| weshay | marios_|ruck do we have a bug on f28 http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-fedora-28-standalone-master/2919545/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 14:53 |
| arxcruz | panda: yup, and after a few cycles we move back | 14:53 |
| weshay | 2019-03-20 10:42:22 | RUNNING HANDLER [tripleo-image-serve : Image-Serve | reload httpd] ************* | 14:53 |
| panda | arxcruz: do you know what's the first rule of calvinball is ? | 14:54 |
| rfolco | arxcruz, I'll suggest RTC (Rational Team Concert) | 14:54 |
| arxcruz | i love rtc | 14:54 |
| weshay | \/kickban rfolco | 14:54 |
| rfolco | crap | 14:54 |
| rfolco | hahaha | 14:54 |
| arxcruz | panda: nope, i don't | 14:55 |
| panda | arxcruz: "you never use the same rule twice". | 14:55 |
| arxcruz | did we try storyboard ? | 14:56 |
| arxcruz | or never was an option | 14:56 |
| *** ykarel_ is now known as ykarel | 14:58 | |
| weshay | marios_|ruck I got it | 14:59 |
| marios_|ruck | weshay: which bit | 15:00 |
| weshay | httpd | 15:00 |
| *** dsneddon has joined #oooq | 15:00 | |
| marios_|ruck | ? not following weshay | 15:00 |
| weshay | marios_|ruck is this an selinux issue? | 15:02 |
| weshay | https://bugs.launchpad.net/tripleo/+bug/1821025 | 15:02 |
| openstack | Launchpad bug 1821025 in tripleo "tripleo-image-serve : Image-Serve | reload httpd, "Unable to start service httpd: Job for httpd.service " [Critical,Triaged] | 15:02 |
| weshay | http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-fedora-28-standalone-master/2919545/logs/undercloud/var/log/journal.txt.gz | 15:02 |
| weshay | search for "Mar 20 10:42:23 standalone.localdomain audit[12991]: " | 15:02 |
| marios_|ruck | weshay: new bug | 15:03 |
| marios_|ruck | weshay: looking | 15:03 |
| marios_|ruck | weshay: yeah i mean it looks like an selinux issue Mar 20 10:42:23 standalone.localdomain audit[12991]: AVC avc: denied { name_bind } for pid=12991 comm="httpd" src=8787 scontext=system_u:system_r:httpd_t:s0 tcontext=system_u:object_r:jboss_debug_port_t:s0 tclass=tcp_socket permissive=0 | 15:05 |
| marios_|ruck | weshay: but have we seen this many times or just once so far? | 15:05 |
| marios_|ruck | weshay: adding to etherpad for now (gonna try focus on the rocky stuff cherrypicks for a bit) | 15:05 |
| weshay | I've seen that a couple times, /me checks | 15:05 |
| marios_|ruck | weshay: will check more later | 15:05 |
| weshay | tries to use rdo kabana | 15:05 |
| weshay | marios_|ruck so I pulled three different jobs failing w/ that | 15:15 |
| rfolco | sshnaidm|rover, zbr panda: container build push base simplification --> https://review.rdoproject.org/r/#/c/19572/ and https://review.rdoproject.org/r/#/c/19573/ | 15:17 |
| rfolco | need this before changing layout for stein jobs | 15:17 |
| zbr | rfolco: LGTM but i wonder why you do this only for the -push job and not for the one without push. | 15:20 |
| rfolco | zbr, the one without push will be deprecated soon | 15:22 |
| rfolco | zbr, as soon as we get the push one stable for a while | 15:22 |
| zbr | rfolco: now you need to find two people to review and. merge these changes. i added my +1. | 15:23 |
| rfolco | zbr, this is hard. I'll keep poking them | 15:24 |
| *** altlogbot_1 has joined #oooq | 15:28 | |
| weshay | sshnaidm|rover you still with us? | 15:28 |
| sshnaidm|rover | weshay, yep | 15:29 |
| * weshay wondering if we can promote master w/ a fs039 error | 15:29 | |
| weshay | https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039 | 15:29 |
| * weshay looking at that | 15:29 | |
| weshay | this still looks like this job should be non-voting | 15:29 |
| *** altlogbot_1 has quit IRC | 15:30 | |
| weshay | sshnaidm|rover if fs20 passes or only has 1-2 failures I could consider promoting master again https://review.rdoproject.org/zuul/status | 15:30 |
| weshay | wdyt | 15:32 |
| weshay | there is a tht fix that we need to get to phase 1 | 15:32 |
| weshay | sshnaidm|rover it hit chrony | 15:33 |
| sshnaidm|rover | weshay, yeah | 15:33 |
| weshay | rlandy ^ | 15:33 |
| weshay | sshnaidm|rover marios and rlandy were looking at a patch for that from a diff angle | 15:33 |
| weshay | not dns, not ntp server settings | 15:34 |
| weshay | but.. the container restarting properly | 15:34 |
| weshay | probably can waive the failure on that | 15:34 |
| rlandy | weshay: marios_|ruck says no way to pass a parameter_default to a role if it has not already been parameterized | 15:34 |
| rlandy | pls see bug: https://bugs.launchpad.net/tripleo/+bug/1821018 | 15:35 |
| openstack | Launchpad bug 1821018 in tripleo "Restart chronyd execution is skipped on overcloud-novacompute-0" [Undecided,Triaged] | 15:35 |
| weshay | sshnaidm|rover rlandy so perhaps we need to reframe this up to alex? | 15:35 |
| rlandy | suspect ansible bug | 15:35 |
| weshay | ya | 15:35 |
| rlandy | weshay; this hack works ... | 15:35 |
| rlandy | https://review.openstack.org/#/c/644562/2/deployment/timesync/chrony-baremetal-ansible.yaml | 15:35 |
| rlandy | not ideal | 15:35 |
| sshnaidm|rover | weshay, I don't see my patch is applied | 15:35 |
| rlandy | it forces the state to restart | 15:35 |
| weshay | sshnaidm|rover really | 15:36 |
| sshnaidm|rover | weshay, it should have fixed it | 15:36 |
| weshay | thought that merged yesterday | 15:36 |
| rlandy | rebase? | 15:36 |
| weshay | ah 3hrs | 15:36 |
| weshay | sshnaidm|rover ya.. it would not have been applied | 15:37 |
| weshay | ok.. so I still may promote w/o a passing 39 | 15:37 |
| weshay | just looking for an opinion on that bit | 15:37 |
| rlandy | still no rocky promotion? | 15:37 |
| sshnaidm|rover | weshay, yeah | 15:37 |
| sshnaidm|rover | weshay, looking why it's not there.. | 15:37 |
| weshay | rlandy what are you waiting for in rocky? | 15:37 |
| weshay | it just merged | 15:37 |
| weshay | sshnaidm|rover 3hrs ago | 15:38 |
| sshnaidm|rover | weshay, ah, so bad timing | 15:38 |
| weshay | sshnaidm|rover aye | 15:38 |
| rlandy | weshay: to merge the change to make containers build report to dlrn | 15:38 |
| weshay | rlandy post the review please | 15:38 |
| *** chem has quit IRC | 15:38 | |
| rlandy | weshay; review.rdoproject.org/r/19030 | 15:40 |
| weshay | rlandy oh yes.. feel free to merge.. right? marios_|ruck sshnaidm|rover ^ | 15:41 |
| sshnaidm|rover | yeah, fine with me | 15:42 |
| weshay | ya.. going to promote | 15:42 |
| weshay | arxcruz what do I need to add to the skip, to avoid setupClass failures | 15:43 |
| weshay | http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/3dfa5da/logs/tempest.html.gz | 15:43 |
| rlandy | k - thanks | 15:43 |
| sshnaidm|rover | rlandy, need to rebase? | 15:44 |
| rlandy | sshnaidm|rover: ack - in process | 15:44 |
| marios_|ruck | weshay: looking | 15:44 |
| marios_|ruck | weshay: rlandy sshnaidm|rover so we discussed https://review.rdoproject.org/r/#/c/19030/ briefly yesterday. we said we'd wait for a rocky promotion since it was the only one that didn't happen, incase it broke the container job. however looks like that is not gonna happen today (rocky) so may as well merge it i think sshnaidm|rover ? | 15:46 |
| sshnaidm|rover | weshay, I'm merging https://review.rdoproject.org/r/#/c/19547/ and https://review.rdoproject.org/r/#/c/19559/ ok? | 15:46 |
| weshay | sshnaidm|rover aye | 15:46 |
| weshay | sshnaidm|rover marios_|ruck fyi https://review.rdoproject.org/r/19574 | 15:46 |
| marios_|ruck | weshay: ack | 15:46 |
| * marios_|ruck merge conflict hell | 15:46 | |
| weshay | ? | 15:47 |
| marios_|ruck | weshay: we need these in rocky for the build job https://review.openstack.org/#/c/624530 https://review.openstack.org/#/c/624532 https://review.openstack.org/#/c/616022 | 15:48 |
| marios_|ruck | weshay: is what i'm doing | 15:48 |
| weshay | ah k | 15:48 |
| sshnaidm|rover | marios_|ruck, weshay please, take a look at containers job: https://review.openstack.org/#/c/644823/ | 15:48 |
| sshnaidm|rover | marios_|ruck, weshay I'd merge it even before reporting to dlrn patch | 15:49 |
| sshnaidm|rover | because currently job finished as "passed" when it didn't build anything | 15:49 |
| sshnaidm|rover | rlandy, ^^ | 15:49 |
| weshay | you get a +2 | 15:49 |
| weshay | you get a +2 | 15:49 |
| weshay | EVERYONE GETS A +2 | 15:49 |
| marios_|ruck | sshnaidm|rover: ack can you also check this when you have time https://review.openstack.org/#/c/642662/ (remove tagging make it simpler since we don't use ) | 15:49 |
| marios_|ruck | sshnaidm|rover: and this related https://review.rdoproject.org/r/19484 | 15:50 |
| weshay | thanks for removing dead code! | 15:50 |
| weshay | marios++ | 15:50 |
| hubbot1 | weshay: marios's karma is now 9 | 15:50 |
| marios_|ruck | weshay: well was just waiting to see if we were gonna end up using it or not and if not remove so yeah lets nuke it | 15:50 |
| *** ykarel is now known as ykarel|away | 15:51 | |
| weshay | marios_|ruck sshnaidm|rover so we should have a green board by EOD minus rocky due to rework of containers \0/ | 15:53 |
| weshay | love it when a plan comes together | 15:53 |
| sshnaidm|rover | yay, eco board | 15:54 |
| weshay | lolz | 15:54 |
| trown | tripleo-ci on board with the green new deal | 15:55 |
| weshay | it's trown everybody :) howdy | 15:56 |
| trown | o/ | 15:57 |
| *** sshnaidm|rover is now known as sshnaidm|afk | 15:58 | |
| weshay | trown hey.. re: moving scen009 to voting.. | 15:59 |
| * trown ducks out | 15:59 | |
| weshay | for rocky I think we can do that | 15:59 |
| trown | nice chatting | 15:59 |
| trown | jk | 15:59 |
| weshay | bah | 15:59 |
| weshay | rocky just rocky | 15:59 |
| weshay | looks fine to me | 15:59 |
| trown | cool | 15:59 |
| weshay | but stein / master not so much | 16:00 |
| weshay | so.. do you want us to override in say.. tripleo-common, tht and python-tripleoclient? | 16:00 |
| weshay | for rocky.. and leave the base def.. non-voting | 16:00 |
| trown | are there bugs filed that are just not getting attention? | 16:00 |
| weshay | hrm.. not sure to be honest, but we're freeing up enough to investigate | 16:00 |
| weshay | eco board and all | 16:01 |
| trown | k, rocky sounds like a good start | 16:01 |
| weshay | trown k.. just need advice on which repos | 16:01 |
| trown | tht, tripleo-common and client seems good | 16:03 |
| *** rfolco has quit IRC | 16:14 | |
| *** rfolco has joined #oooq | 16:14 | |
| *** rfolco has quit IRC | 16:16 | |
| *** rfolco has joined #oooq | 16:17 | |
| *** jbadiapa has joined #oooq | 16:22 | |
| *** dtantsur|bbl is now known as dtantsur | 16:22 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario001-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario002-standalone, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario008-multinode-oooq- (2 more messages) | 16:23 |
| *** sshnaidm|afk is now known as sshnaidm|rover | 16:23 | |
| *** trown is now known as trown|lunch | 16:25 | |
| rfolco | zbr, I still don't see your tasks created for the user stories. Could you please create them so we can spot uncovered work in the board ? | 16:29 |
| zbr | rfolco: yeah, as I am still trying to understand what needs to be done. | 16:32 |
| zbr | did someone changed the order of the tasks on the board? | 16:32 |
| rfolco | zbr, panda is in contact with taiga support | 16:33 |
| zbr | 864 used to be the first on the top, but now it has two other parked tickets on top of it.... | 16:33 |
| rfolco | zbr, I know you have patches already, so it would be good to create the tasks for the user stories you are owning | 16:34 |
| rfolco | zbr, so we can check what is still uncovered and needs attention | 16:34 |
| zbr | rfolco: sorry i am totally confused, and HATE taiga. it doesnt even display story owner in the default view. | 16:35 |
| *** holser_ has joined #oooq | 16:36 | |
| rfolco | zbr, https://tree.taiga.io/project/tripleo-ci-board/us/843 --> no tasks | 16:36 |
| rfolco | zbr, us #851 you are the owner but there is no info, tasks, etc. | 16:39 |
| rfolco | Let me know if need any help in taiga | 16:39 |
| *** altlogbot_2 has joined #oooq | 16:39 | |
| zbr | rfolco: only if you have BFG... | 16:39 |
| rfolco | BFG? | 16:39 |
| *** chem has joined #oooq | 16:39 | |
| *** altlogbot_2 has quit IRC | 16:41 | |
| *** bogdando has quit IRC | 16:42 | |
| panda | I see DOOM references flying around | 16:46 |
| rfolco | fictional weapon found ? | 16:48 |
| *** yolanda has quit IRC | 16:49 | |
| zbr | nope, but found new bugs in taiga, markups messing around | 16:51 |
| zbr | take a look at https://tree.taiga.io/project/tripleo-ci-board/us/843?milestone=223049 description and the magic it produced... it is kinda recursive. | 16:52 |
| panda | http://quickstart.sh ? | 16:57 |
| zbr | panda: blame taiga, not me for this. | 16:57 |
| zbr | I only wrote ``quickstart.sh -R stein`` ... | 16:58 |
| panda | why the double backtick ? | 16:59 |
| zbr | ... rst times | 17:00 |
| zbr | i need a hint: why quickstart keeps forgetting my local changes, even when I run it with `quickstart.sh -n -X` --- | 17:02 |
| *** ykarel|away has quit IRC | 17:04 | |
| weshay | zbr what's ur full command? | 17:04 |
| zbr | ./quickstart.sh -R stein -n -X | 17:05 |
| zbr | with VIRTHOST=127.0.0.2 | 17:05 |
| weshay | zbr ya. .ur running clean | 17:05 |
| zbr | https://seashells.io/v/ej8whPUS | 17:05 |
| weshay | that's what clean does | 17:06 |
| marios_|ruck | weshay: fyi cherrypicks might not be necessary see my last comment at https://review.openstack.org/#/c/644915/1 | 17:07 |
| marios_|ruck | weshay: should have asked mwhahaha before merge hell :/ | 17:07 |
| zbr | weshay: not based on the doc: "discard the working directory on start" | 17:07 |
| marios_|ruck | weshay: but we'll see if it works ok (testing in https://review.rdoproject.org/r/#/c/19533/ ) | 17:07 |
| *** jbadiapa has quit IRC | 17:07 | |
| weshay | -X, --clean discard the working directory on start | 17:07 |
| zbr | based on doc I would expect to run qs.sh from my clone with "-X -n" | 17:08 |
| zbr | working directory != pwd. | 17:08 |
| *** ykarel has joined #oooq | 17:08 | |
| panda | zbr: converted the quote to single quote, and doens't complain particularly. Don't hate taiga because it doens't support RST ... hate it for good reasons. | 17:09 |
| marios_|ruck | sshnaidm|rover: weshay: the assumption is we don't need f28 builds for rocky (the --exclude is only used for f28) and depends if something else fails in https://review.rdoproject.org/r/#/c/19533/ | 17:09 |
| weshay | zbr ur change is in tq or tqe? | 17:10 |
| *** ykarel is now known as ykarel|pto | 17:10 | |
| zbr | tq, this is what I was trying to say. | 17:11 |
| weshay | k.. just run w/o -X | 17:11 |
| weshay | if the --help is not clear to you, put up a patch to make it more so | 17:11 |
| zbr | starte without it few minutes ago. | 17:11 |
| weshay | k.. just a tip.. if ur change is in tqe | 17:12 |
| weshay | update it+https://git.openstack.org/openstack/tripleo-quickstart-extras/#egg=tripleo-quickstart-extras | 17:12 |
| weshay | to point to the file uri | 17:12 |
| weshay | of your local checkout | 17:12 |
| weshay | in quickstart-extras-requirements.txt | 17:13 |
| zbr | weshay: more practical question, how do I get something uploaded at https://trunk.rdoproject.org/centos7-stein/current-tripleo-rdo/ ? | 17:14 |
| weshay | zbr that will come w/ a promotion | 17:14 |
| weshay | use tripleo-ci for now | 17:14 |
| zbr | i cannot, see http://git.openstack.org/cgit/openstack/tripleo-quickstart/tree/roles/repo-setup/tasks/get-dlrn-hash.yml#n36 ?? or not without patching it. | 17:15 |
| weshay | zbr because ur not using the tripleo-ci release file | 17:16 |
| weshay | ur just passing stein | 17:16 |
| weshay | which defaults to rdo | 17:16 |
| weshay | yesterday you were passing the correct version | 17:16 |
| *** udesale has quit IRC | 17:17 | |
| weshay | we could consider changing that default from rdo to tripleo | 17:18 |
| weshay | originally the majority of ci was in rdo | 17:18 |
| weshay | hasn't been the case for some time | 17:18 |
| weshay | ll config/release/master.yml master✔ thinkdoe ⌚ 11:12:58 | 17:18 |
| weshay | lrwxrwxrwx. 1 whayutin whayutin 16 Jun 29 2018 config/release/master.yml -> trunk/master.yml | 17:18 |
| weshay | zbr see what I mean? | 17:19 |
| *** trown|lunch is now known as trown | 17:20 | |
| zbr | weshay: kind but i am really tired of copying the files on each execution, somehow they do not endup in ~/.quickstart folder. you remember very well that you copied the file manually yesterday. | 17:20 |
| weshay | zbr let me try to help | 17:21 |
| weshay | zbr tmate me in | 17:21 |
| zbr | sure | 17:21 |
| *** altlogbot_2 has joined #oooq | 17:23 | |
| *** altlogbot_2 has quit IRC | 17:24 | |
| marios_|ruck | sshnaidm|rover: any idea why it hit retry limit (fails on something else here http://logs.rdoproject.org/33/19533/4/check/periodic-tripleo-centos-7-rocky-containers-build-push/998e7d7/job-output.txt.gz | 17:24 |
| *** altlogbot_2 has joined #oooq | 17:25 | |
| marios_|ruck | sshnaidm|rover: me almost out trying a recheck lets see | 17:26 |
| *** altlogbot_2 has quit IRC | 17:28 | |
| *** altlogbot_0 has joined #oooq | 17:29 | |
| *** ccamacho has quit IRC | 17:36 | |
| *** chem has quit IRC | 17:40 | |
| *** chem has joined #oooq | 17:43 | |
| *** ykarel|pto has quit IRC | 17:43 | |
| sshnaidm|rover | marios_|ruck, "msg": "The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'review.rdoproject.org/config'\n\nThe error appears to have been in '/tmp/tmp13o9ysrl/998e7d7843db431ea5409b781d9ba874/trusted/project_0/review.rdoproject.org/config/playbooks/tripleo-ci-periodic-base/post.yaml': line 10, column 7, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line | 17:47 |
| sshnaidm|rover | appears to be:\n\n name: set-zuul-log-path-fact\n - name: Report to DLRN\n ^ here\n" | 17:47 |
| sshnaidm|rover | marios_|ruck, retry limit means error in pre/post playbooks | 17:48 |
| *** dtantsur is now known as dtantsur|afk | 17:53 | |
| *** chem` has joined #oooq | 17:57 | |
| *** chem has quit IRC | 17:59 | |
| *** jpena is now known as jpena|off | 18:15 | |
| *** kopecmartin is now known as kopecmartin|off | 18:19 | |
| *** irclogbot_0 has quit IRC | 18:21 | |
| *** irclogbot_3 has joined #oooq | 18:23 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario001-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario002-standalone, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario008-multinode-oooq- (2 more messages) | 18:23 |
| *** irclogbot_3 has quit IRC | 18:27 | |
| *** irclogbot_1 has joined #oooq | 18:28 | |
| rlandy | marios_|ruck: it's the change pushed this morning | 18:37 |
| rlandy | marios_|ruck: missing required project config | 18:46 |
| *** saneax has quit IRC | 18:47 | |
| *** ksambor has quit IRC | 18:54 | |
| rfolco | rlandy, we access bm nodes too or undercloud vm only ? | 18:59 |
| rfolco | rlandy, I mean overcloud bm nodes | 18:59 |
| rlandy | both | 18:59 |
| rfolco | perhaps another user ? | 18:59 |
| rfolco | cannot access as root with the same key | 19:00 |
| rlandy | zuul | 19:00 |
| *** altlogbot_0 has quit IRC | 19:00 | |
| rfolco | rlandy, what I am doing wrong ? | 19:01 |
| rfolco | ssh -i ~/.ssh/id_rsa_rdoci-jenkins zuul@10.12.8.224 | 19:01 |
| rfolco | zuul@10.12.8.224's password: | 19:01 |
| *** altlogbot_3 has joined #oooq | 19:01 | |
| rfolco | assuming the overcloud bm nodes are the ips in the instack.json | 19:01 |
| rlandy | -i id_rsa_undercloud | 19:01 |
| rlandy | weshay; 1-1? | 19:02 |
| rfolco | rlandy, ah only from the undercloud ? is this undercloud key somewhere or generated ? | 19:02 |
| rlandy | by virt playbooks | 19:02 |
| rlandy | marios_|ruck; sshnaidm|rover: fix merged | 19:04 |
| weshay | rlandy ya | 19:04 |
| rlandy | in your bj | 19:05 |
| *** amoralej is now known as amoralej|off | 19:05 | |
| *** altlogbot_3 has quit IRC | 19:06 | |
| *** altlogbot_0 has joined #oooq | 19:06 | |
| *** irclogbot_1 has quit IRC | 19:16 | |
| *** irclogbot_2 has joined #oooq | 19:16 | |
| *** irclogbot_2 has quit IRC | 19:30 | |
| *** irclogbot_3 has joined #oooq | 19:30 | |
| *** quiquell has joined #oooq | 19:31 | |
| *** quiquell has left #oooq | 19:31 | |
| *** altlogbot_0 has quit IRC | 19:34 | |
| *** altlogbot_0 has joined #oooq | 19:35 | |
| *** aakarsh|2 has joined #oooq | 19:42 | |
| *** agopi has quit IRC | 19:44 | |
| *** rascasoft has quit IRC | 19:48 | |
| *** rascasoft has joined #oooq | 19:50 | |
| *** jfrancoa has quit IRC | 19:58 | |
| *** aakarsh|3 has joined #oooq | 20:03 | |
| *** aakarsh|2 has quit IRC | 20:05 | |
| *** chem` has quit IRC | 20:05 | |
| zbr | damn simple qs.sh fix https://review.openstack.org/#/c/644904/ | 20:19 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ (2 more messages) | 20:23 |
| zbr | google gives me a "504" when trying to download my data archive (takeout)... broken by design? ;) | 20:24 |
| rlandy | rfolco: pl see my comments on https://review.rdoproject.org/r/#/c/19572/ - I am out tomorrow so if I am wrong, I can remove my -1 before then. let me know | 20:37 |
| rfolco | rlandy, looking | 20:38 |
| rlandy | rfolco: ok - so this is the job I was expecting to see: https://review.rdoproject.org/r/#/c/19573/3/zuul.d/jobs.yaml | 20:39 |
| rlandy | ^^ that makes more sense to me | 20:40 |
| rfolco | rlandy, I just did in steps | 20:40 |
| rlandy | k - will amend my comments | 20:40 |
| rfolco | rlandy, split in small steps per sagi's suggestion... 1) add new base job with -master 2) reparent to new base, remove dups 3) add stein jobs | 20:41 |
| rfolco | final result is what you see in 19573 | 20:42 |
| rlandy | rfolco;updated my voted - as long as the two are merged together, I'm ok with it. | 20:43 |
| rfolco | rlandy, ok thanks for reviewing | 20:43 |
| *** irclogbot_3 has quit IRC | 20:45 | |
| *** holser_ has quit IRC | 20:46 | |
| *** irclogbot_2 has joined #oooq | 20:46 | |
| rfolco | rlandy, quick question about bm: aren't we wasting bm resources by using one baremetal box for the undercloud vm on each ? | 20:49 |
| rlandy | rfolco?? | 20:49 |
| rlandy | the undercloud vm is large | 20:49 |
| rlandy | if you try deploy two, you will run out of resources | 20:50 |
| rlandy | I have forgotten the clean up step | 20:50 |
| rlandy | and had that happen to me | 20:50 |
| rlandy | rfolco: comment on https://review.rdoproject.org/r/#/c/19405/ | 20:50 |
| rlandy | rfolco: rasca had some boxed where he could run multiple undercloud vms | 20:50 |
| rfolco | rlandy, OMG stein rocky job! I must be drunk | 20:51 |
| rfolco | rlandy, ok, so the vm size is the reason for not using the nodepool vm too? | 20:51 |
| rfolco | for undercloud I mean | 20:52 |
| rlandy | no - the networking is | 20:52 |
| rfolco | oh, I see, to reach bm overcloud nods | 20:52 |
| rfolco | rlandy, k k I got it. Do you mind If include a drawing so you review on Fri? | 20:52 |
| rlandy | the network is set up with one nic on the bm undercloud boxes to be able to pxe boot | 20:52 |
| rlandy | sure | 20:53 |
| rfolco | awesome | 20:53 |
| rlandy | panda loves diagrams | 20:53 |
| rfolco | rlandy, my rocky job failed.. did you get progress on master | 20:53 |
| *** altlogbot_0 has quit IRC | 20:53 | |
| *** trown is now known as trown|outtypewww | 20:53 | |
| *** altlogbot_1 has joined #oooq | 20:54 | |
| zbr | do we have one machine with ipv6 inet connectivy? i want to check something. | 20:56 |
| rlandy | rfolco: you are likely missing https://review.openstack.org/#/c/642924/ | 20:56 |
| rlandy | not merged yet | 20:56 |
| rlandy | did it fail overcloud deploy? | 20:56 |
| rfolco | yes | 20:56 |
| rlandy | that is why I have not added the jobs to the check pipeline | 20:57 |
| rlandy | rfolco, : see https://tree.taiga.io/project/tripleo-ci-board/task/882?kanban-status=1447275 | 20:57 |
| rlandy | note review still outstanding | 20:57 |
| rfolco | rlandy, https://sf.hosted.upshift.rdu2.redhat.com/logs/18/165718/1/check/periodic-tripleo-ci-centos-7-bm_envE-3ctlr_1comp-featureset001-rocky/0859d1d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-03-19_23_29_07 | 20:58 |
| rfolco | thanks for the pointers | 20:58 |
| rlandy | rfolco: yep - wring masquerade network | 20:58 |
| rlandy | wrong | 20:58 |
| rlandy | job is in gate atm- try again after | 20:59 |
| rlandy | weshay: rfolco: https://tree.taiga.io/project/tripleo-ci-board/task/885 - original user story missed fs 016 | 21:19 |
| rlandy | any reason not to add a stein job for that? | 21:19 |
| rfolco | rlandy, that list we built live in the meeting, so do not take it as written on the rock | 21:20 |
| rlandy | ok | 21:20 |
| rfolco | rlandy, please check if those make sense too | 21:21 |
| rlandy | multinode | 21:21 |
| rlandy | maybe we don;t use them? | 21:22 |
| rlandy | asking | 21:22 |
| rlandy | panda: ^^?? | 21:22 |
| rlandy | think those fs are no longer used | 21:31 |
| *** vinaykns has quit IRC | 21:40 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ (2 more messages) | 22:23 |
| *** arxcruz is now known as arxcruz|pto | 22:39 | |
| rlandy | rfolco: you still busy on the rock bm hardware? | 22:48 |
| rlandy | rocky | 22:48 |
| rlandy | I'd like to kick the job again and make sure it passes this time | 22:49 |
| rlandy | the dep reviews are in | 22:49 |
| *** rascasoft has quit IRC | 23:10 | |
| rlandy | rfolco: ping - rocky job restarting | 23:17 |
| rlandy | weshay: https://review.openstack.org/#/c/644562/3/deployment/timesync/chrony-baremetal-ansible.yaml | 23:19 |
| *** tosky has quit IRC | 23:31 | |
| rfolco | rlandy, sorry did not mean to ignore you, I am here but unable to look now. | 23:37 |
| *** rf0lc0 has joined #oooq | 23:47 | |
| *** rfolco has quit IRC | 23:49 | |
| *** rascasoft has joined #oooq | 23:51 | |
| *** rascasoft has quit IRC | 23:57 | |
| rlandy | not a problem | 23:58 |
| *** rlandy has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!