| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci- (1 more message) | 00:02 |
|---|---|---|
| *** ssbarnea|rover has quit IRC | 00:34 | |
| *** d0ugal has quit IRC | 01:56 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci- (1 more message) | 02:02 |
| *** d0ugal has joined #oooq | 02:11 | |
| *** rfolco has quit IRC | 02:30 | |
| *** apetrich has quit IRC | 03:15 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/rocky: tripleo-ci-centos-7-scenario008 (1 more message) | 04:02 |
| *** udesale has joined #oooq | 04:10 | |
| *** ykarel|away has joined #oooq | 04:24 | |
| *** agopi has quit IRC | 05:17 | |
| *** agopi has joined #oooq | 05:25 | |
| *** ratailor has joined #oooq | 05:51 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp- (1 more message) | 06:02 |
| *** ykarel|away is now known as ykarel | 06:11 | |
| *** agopi has quit IRC | 06:13 | |
| *** agopi has joined #oooq | 06:18 | |
| *** saneax has joined #oooq | 06:23 | |
| *** agopi has quit IRC | 06:25 | |
| *** jtomasek has quit IRC | 06:52 | |
| *** jtomasek has joined #oooq | 07:06 | |
| *** quiquell|off is now known as quiquell | 07:11 | |
| *** ssbarnea|rover has joined #oooq | 07:40 | |
| *** skramaja has joined #oooq | 07:45 | |
| *** jfrancoa has joined #oooq | 07:50 | |
| *** saneax has quit IRC | 07:51 | |
| *** saneax has joined #oooq | 07:52 | |
| *** amoralej|off is now known as amoralej | 08:02 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp- (1 more message) | 08:02 |
| *** apetrich has joined #oooq | 08:09 | |
| ssbarnea|rover | marios: morning! do you know if is possilbe to get ssh access to one nodepool node? | 08:42 |
| ssbarnea|rover | is want to run some commands on the workspace to debug the weird du issue. | 08:42 |
| marios_|ruck | ssbarnea|rover: o/ no sorry don't know | 08:42 |
| marios_|ruck | ssbarnea|rover: more container multiondes fails. every day is different but same job :) today ssh issues i added note on ether | 08:43 |
| quiquell | panda|off: ping me when you are up has an idea for the software fact ory | 08:43 |
| ssbarnea|rover | marios: all my attempts, is seems that timeout even with kill does not work. I plan to replace du with something else, like find. | 08:43 |
| *** kopecmartin|off is now known as kopecmartin | 08:45 | |
| *** tosky has joined #oooq | 08:53 | |
| ssbarnea|rover | what FS type do we have on our nodes? | 08:55 |
| * marios_|ruck boiab | 09:18 | |
| marios_|ruck | biab | 09:18 |
| *** ccamacho has joined #oooq | 09:20 | |
| *** ykarel is now known as ykarel|lunch | 10:00 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp- (1 more message) | 10:02 |
| *** jfrancoa has quit IRC | 10:04 | |
| *** jfrancoa has joined #oooq | 10:18 | |
| ssbarnea|rover | marios_|ruck: panda|off : how important is to get the total log folder sizes inside log-size.txt? would not be enough to get just top-x-big-files? it can do that ~10x faster. | 10:27 |
| marios_|ruck | ssbarnea|rover: o/ don'tknow haven't poked there before. can we increase the size limit? | 10:27 |
| marios_|ruck | oh isee | 10:27 |
| marios_|ruck | you just want to get the first ones | 10:27 |
| ssbarnea|rover | marios_|ruck: is about the stats: I can optimize the process but the report will look different, with only file-sizes, no folder-sizes | 10:28 |
| ssbarnea|rover | we already do top-200 | 10:28 |
| ssbarnea|rover | probably because half of them are folders. example: http://logs.openstack.org/81/624381/8/check/tripleo-ci-centos-7-containers-multinode/bf2929a/logs/log-size.txt | 10:29 |
| marios_|ruck | ssbarnea|rover: maybe just propose it so we can get a run with example to point to then you can justify saying 'x times faster' and we can discuss this on the review? | 10:29 |
| marios_|ruck | ssbarnea|rover: not sure who to ping about https://bugs.launchpad.net/tripleo/+bug/1808349 it blocks promotion (missing zaqar) gonna dig there a bit and ping some folks | 10:30 |
| openstack | Launchpad bug 1808349 in tripleo "periodic-...-1ctlr-featureset010-master periodic-...-multinode-1ctlr-featureset037-updates-master jobs failing "Not found image: ... tripleomaster/centos-binary-zaqar" " [Undecided,Triaged] - Assigned to Marios Andreou (marios-b) | 10:30 |
| ssbarnea|rover | it takes 2-3h to get results on a review. but I can build a mini demo | 10:30 |
| *** agopi has joined #oooq | 10:31 | |
| *** ykarel|lunch is now known as ykarel | 10:32 | |
| ssbarnea|rover | sorting 1M files is not easy task and I suspect some kind of choking being the cause of the problem once. If I use find to look only for files >100K this becomes blazing fast, at the expense of not knowing the whole total. | 10:32 |
| ssbarnea|rover | example: time find . -type f -print0 | xargs -0 du -Lhx --threshold=500K | sort -hr | tail -10 | cut -f2 | xargs -I{} du -sh {} | 10:33 |
| ssbarnea|rover | it looks long/complex but is like 1s instead of 15s on ssd based machine. | 10:33 |
| *** agopi has quit IRC | 10:36 | |
| ssbarnea|rover | nobody with an opinion here? files vs folders? how bad it would be to count only top files? | 10:42 |
| ssbarnea|rover | the idea is that toci_gate reports the total size of the logs folder at the end anyway. | 10:44 |
| *** rfolco has joined #oooq | 11:16 | |
| *** derekh has joined #oooq | 11:17 | |
| rfolco | quiquell, marios scen2 passed w/ barbican and telemetry... http://logs.openstack.org/09/618709/34/check/tripleo-ci-centos-7-scenario002-standalone/3da2791/logs/tempest.html.gz | 11:42 |
| rfolco | whats different on promotion scen2 ? | 11:42 |
| marios_|ruck | rfolco: don't know but would rather merge the scenarios then increase/unblock the tempest. seems barbican was the problematic one telemetry was ok. but still. unless it is blocking/required (like containers prep) then lets merge the scnarios first please | 11:44 |
| ykarel | rfolco, in ^^ telemetry tests didn | 11:45 |
| ykarel | didn't ran | 11:45 |
| ykarel | see it's skipped in standalone: http://logs.openstack.org/09/618709/34/check/tripleo-ci-centos-7-scenario002-standalone/3da2791/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-12-14_09_13_27 | 11:45 |
| rfolco | ykarel, oops | 11:46 |
| ssbarnea|rover | marios_|ruck: why we are doing cp on log files in collect log instead of mv? see https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/templates/oooq_common_functions.sh.j2#L108 | 11:46 |
| ykarel | u can see when u see detail: http://logs.openstack.org/09/618709/34/check/tripleo-ci-centos-7-scenario002-standalone/3da2791/logs/tempest.html.gz | 11:46 |
| ssbarnea|rover | just to slow down the process? mv is much faster. | 11:46 |
| rfolco | ykarel, marios_|ruck right, will update scen2 | 11:47 |
| rfolco | thanks | 11:47 |
| ssbarnea|rover | i understand that we need to put all files in same folder to perform rsync due to copy links option that we have. but i wonder why "cp" and not "mv". | 11:47 |
| ykarel | yes good to compare service, tests running in current scenarios and the multinode parts so anything is not missed | 11:47 |
| ykarel | current/standalone | 11:47 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp- (1 more message) | 12:02 |
| *** vinaykns has joined #oooq | 12:03 | |
| *** dciabrin has quit IRC | 12:04 | |
| *** udesale has quit IRC | 12:11 | |
| *** vinaykns has quit IRC | 12:19 | |
| *** vkapalav has joined #oooq | 12:24 | |
| *** ratailor has quit IRC | 12:34 | |
| *** skramaja has quit IRC | 12:39 | |
| *** ykarel has quit IRC | 13:00 | |
| *** ykarel has joined #oooq | 13:01 | |
| *** weshay_pto is now known as weshay | 13:07 | |
| *** trown|outtypewww is now known as trown | 13:11 | |
| marios_|ruck | weshay: ssbarnea|rover this is https://bugs.launchpad.net/tripleo/+bug/1808349 a problem | 13:12 |
| openstack | Launchpad bug 1808349 in tripleo "periodic-...-1ctlr-featureset010-master periodic-...-multinode-1ctlr-featureset037-updates-master jobs failing "Not found image: ... tripleomaster/centos-binary-zaqar" " [Undecided,Triaged] - Assigned to Marios Andreou (marios-b) | 13:12 |
| marios_|ruck | (continue here quieter) | 13:12 |
| marios_|ruck | ? | 13:12 |
| *** quiquell is now known as quiquell|lunch | 13:13 | |
| ssbarnea|rover | marios_|ruck: can subunit files be appended to? | 13:14 |
| ssbarnea|rover | if so it should be possible to concat foo.subunit.gz to bar.subunit.gz and still have a valid consolidated file, right? | 13:14 |
| marios | ssbarnea|rover: can i have some more context for that question please (aka wut( | 13:15 |
| ssbarnea|rover | as far as ai know subunit fileformat is streamable, same with gz, which means that concatenating two subunit reports should produce a valid file, as long both are compressed or uncompressed. | 13:16 |
| *** ykarel is now known as ykarel|afk | 13:29 | |
| *** weshay is now known as weshay1-1 | 13:34 | |
| *** rlandy has joined #oooq | 13:37 | |
| *** derekh has quit IRC | 13:47 | |
| rlandy | oh my gosh - panda|off ran away | 13:48 |
| rlandy | rfolco: should we sync on the release file | 13:48 |
| rfolco | rlandy, wanna bj? | 13:48 |
| rlandy | rfolco: sure | 13:49 |
| rfolco | rlandy, https://bluejeans.com/u/rfolco | 13:50 |
| *** amoralej is now known as amoralej|lunch | 13:54 | |
| *** ykarel|afk is now known as ykarel | 14:00 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp- (1 more message) | 14:02 |
| *** weshay1-1 is now known as weshay | 14:05 | |
| rlandy | panda|off: rfolco: https://review.openstack.org/#/c/625034/ and https://review.rdoproject.org/r/#/c/17718/ | 14:16 |
| rlandy | ^^ if you agree with those, let's test that with testproject | 14:16 |
| rlandy | then I will update the pipeline review | 14:16 |
| rlandy | quiquell|lunch: do you remember which testproject job we were using to test periodic jobs with check? | 14:17 |
| panda|off | rlandy: for 625034 there's a legit syntax error in the yaml, look at the linters job | 14:19 |
| * rlandy looks | 14:20 | |
| panda|off | rlandy: http://logs.openstack.org/34/625034/3/check/openstack-tox-linters/9bf8373/job-output.txt.gz#_2018-12-13_17_24_01_572951 | 14:20 |
| panda|off | mmhh maybe it's not that legit | 14:21 |
| rlandy | panda|off: ugh sorry - my latest commit did not go through | 14:21 |
| rlandy | resubmitting | 14:21 |
| panda|off | seems like the : in the url is confusing it ... | 14:21 |
| panda|off | ok | 14:21 |
| rlandy | panda|off: https://review.openstack.org/#/c/625034/ | 14:22 |
| rlandy | may pick up the same error | 14:22 |
| rlandy | let's see | 14:22 |
| *** derekh has joined #oooq | 14:24 | |
| panda|off | rlandy: I think it may, you may want to enclose all inside quotes | 14:26 |
| *** udesale has joined #oooq | 14:27 | |
| rlandy | panda|off: why - tox passed this time | 14:28 |
| panda|off | ok | 14:28 |
| *** saneax has quit IRC | 14:29 | |
| weshay | rfolco, ping me when you have 5-10 min today | 14:33 |
| rfolco | weshay, I am ok to chat now if you like | 14:33 |
| weshay | k.. will join my blue in one minute | 14:33 |
| rlandy | panda|off: ok - I see how to mock periodic - adding review | 14:41 |
| weshay | panda|off, do you have a moment? | 14:45 |
| marios_|ruck | weshay: https://trello.com/c/pWI6H6dJ/846-cixlp1808536tripleo-ciproamasterpromotion-blockerperiodic-tripleo-featureset035-master-fails-overcloud-deploy-for-error-could-no | 14:46 |
| marios_|ruck | weshay: ssbarnea|rover another thing standing in way of promotion | 14:46 |
| panda|off | weshay: yes | 14:46 |
| marios_|ruck | credit ykarel | 14:47 |
| marios_|ruck | (again) | 14:47 |
| marios_|ruck | ! | 14:47 |
| panda|off | weshay: on your bj ? | 14:47 |
| rlandy | panda|off: https://review.openstack.org/#/c/625271/ | 14:49 |
| weshay | panda|off, ya | 14:49 |
| weshay | if you are still avail | 14:49 |
| rlandy | panda|off: can you nick of you are actually panda|on | 14:50 |
| panda|off | oh yeah | 14:50 |
| *** panda|off is now known as panda | 14:50 | |
| rlandy | thank you | 14:50 |
| rlandy | confusing otherwise | 14:50 |
| * rlandy creates testrproject job | 14:51 | |
| *** amoralej|lunch is now known as amoralej | 14:53 | |
| rlandy | panda: https://review.rdoproject.org/zuul/stream/d8be60d47b0f48c08b22e2a576b61085?logfile=console.log | 14:58 |
| *** zul has joined #oooq | 15:04 | |
| rlandy | oh no ... | 15:07 |
| rlandy | failure - node | 15:08 |
| *** quiquell|lunch is now known as quiquell | 15:12 | |
| quiquell | rlandy: Let me find the review | 15:12 |
| quiquell | rlandy: https://review.rdoproject.org/r/#/c/16806/ | 15:14 |
| rlandy | quiquell: no worries | 15:14 |
| rlandy | quiquell: I made a new review - was pretty simple | 15:15 |
| quiquell | rlandy: yep, btw https://tree.taiga.io/project/tripleo-ci-board/task/512?kanban-status=1447274 | 15:15 |
| quiquell | rlandy: to use software factory stuff but without ditch docker-compose | 15:16 |
| rlandy | quiquell: looks like you weren't successful | 15:17 |
| rlandy | quiquell: I've been filling https://docs.google.com/document/d/1i1-_L2mx8_erETAVblchLnymC6-9h7A2x02begy99UQ/edit# out more | 15:17 |
| rlandy | just got the OVB left to add | 15:17 |
| rlandy | s we have our sprint deliverable | 15:17 |
| rlandy | for whatever it's worth | 15:18 |
| quiquell | rlandy: nope, but I think it's just a matter to spend more time on it, but it's a possibility | 15:18 |
| rlandy | quiquell: k - good to know | 15:18 |
| * rlandy finishes off f28 pipeline stuff | 15:18 | |
| quiquell | rlandy: next week we review it | 15:18 |
| rlandy | maybe will try it next sprint | 15:18 |
| quiquell | rlandy: yep, also we can make it selectable, like what base zuul to use | 15:19 |
| rlandy | quiquell: that would be an interesting option | 15:19 |
| rlandy | but whatever we offer, we support | 15:19 |
| quiquell | yep | 15:19 |
| rlandy | so - we may have to consider that burden | 15:19 |
| rlandy | if sf is really an option | 15:19 |
| rlandy | gets us out of the support business | 15:20 |
| rlandy | which is a good thing | 15:20 |
| rlandy | depends how much of a real option it is | 15:20 |
| quiquell | Yep, but for fast an furious people can choos upstream with a big disclaimer :-) | 15:20 |
| rlandy | quiquell: ack - usual upstream - use at your own risk | 15:20 |
| rlandy | YMMV | 15:20 |
| quiquell | Let's see if sf RPMs work that way, only ssh stuff and web was not working, don't kno why | 15:20 |
| rlandy | don't cry on channel | 15:20 |
| quiquell | hehe that's it | 15:20 |
| rlandy | keys? | 15:20 |
| quiquell | yep | 15:21 |
| quiquell | similar as weshay issue | 15:21 |
| rlandy | selinux | 15:21 |
| rlandy | that was his final issue | 15:21 |
| rlandy | quiquell: also using sf gives us more legitimacy | 15:21 |
| rlandy | it may be a very good thing | 15:22 |
| rlandy | if we can work it right | 15:22 |
| rlandy | big if | 15:22 |
| rlandy | ok f28 folks ... | 15:22 |
| rlandy | have we ever run anything using f28 nodes on RDO Cloud??? | 15:22 |
| rlandy | quiquell: panda: ssbarnea|rover: ^^? | 15:23 |
| rlandy | single-fedora-28-node | 15:23 |
| rlandy | is the nodeset I am using | 15:23 |
| quiquell | rlandy: reproducer has run f28 stuff | 15:23 |
| quiquell | hehe | 15:23 |
| quiquell | Don't know if that counts for RDO cloud | 15:23 |
| rlandy | quiquell: https://logs.rdoproject.org/55/17855/1/check/periodic-tripleo-ci-fedora-28-centos-7-containers-standalone-master/3b04d19/job-output.txt.gz#_2018-12-14_15_03_55_146850 | 15:24 |
| * rlandy and fedora are not starting out well | 15:25 | |
| quiquell | rlandy: they are missing something at thery zuul config, reproducer one works :-) | 15:25 |
| rlandy | Failed to find required executable iptables in paths: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin/ | 15:25 |
| rlandy | quiquell: only for fedora28? | 15:26 |
| rlandy | who owns that stuff> | 15:26 |
| quiquell | rlandy: | 15:26 |
| quiquell | The fedora image is differnt | 15:26 |
| quiquell | repro is using upstream one, this is using rdo one | 15:26 |
| rlandy | quiquell: ack - alex left a note as such | 15:26 |
| quiquell | rlandy: maybe their are missing somethin gin the diskimage stuff at nodepool | 15:26 |
| rlandy | quiquell; ok - what did you do to make reproducer work for f28? | 15:27 |
| quiquell | rlandy: nothing, just use upstream image | 15:27 |
| quiquell | rlandy: same as centos | 15:27 |
| rlandy | shoot | 15:27 |
| rlandy | we can't do that | 15:27 |
| * rlandy goes to #tripleo | 15:27 | |
| quiquell | rlandy: you can run the periodic in the reproducer | 15:27 |
| quiquell | rlandy: wait... I think they are missing installing stuff maybe | 15:27 |
| rlandy | quiquell: I need to get the pipeline to work | 15:27 |
| rlandy | quiquell: either way this should be on the node | 15:28 |
| quiquell | rlandy: let me compare executiosn | 15:28 |
| rlandy | so the node build is missing something | 15:28 |
| quiquell | something is different from upstreawn nodpool image and RDO nodepool iamge | 15:28 |
| rlandy | ack | 15:28 |
| * rlandy asks alex | 15:28 | |
| rlandy | he left a comment to that matter in the file | 15:29 |
| quiquell | rlandy: feels like the cook iptables at upstream | 15:29 |
| quiquell | what file ? | 15:29 |
| rlandy | https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/nodesets.yaml#L135 | 15:29 |
| quiquell | rlandy: there is no upstream-fedora-28 ? | 15:30 |
| rlandy | quiquell: exactly what I was looking for | 15:30 |
| quiquell | rlandy: let me check | 15:30 |
| quiquell | https://github.com/rdo-infra/review.rdoproject.org-config | 15:31 |
| rlandy | ? | 15:31 |
| quiquell | nope | 15:31 |
| rlandy | there is none trace there | 15:32 |
| * rlandy asks | 15:32 | |
| *** kopecmartin is now known as kopecmartin|off | 15:32 | |
| rlandy | weshay: hello there | 15:39 |
| weshay | rlandy, hey | 15:39 |
| rlandy | weshay: pls see the conversation on #tripleo | 15:40 |
| weshay | k | 15:40 |
| rlandy | who owns adding an upstream fedora 28 nodeset? | 15:40 |
| rlandy | weshay: ^^ | 15:40 |
| rlandy | idk where that lies | 15:40 |
| rlandy | ie: the image part | 15:40 |
| rlandy | the nodeset I can add | 15:40 |
| quiquell | rlandy: we can put a review in place and send it to them | 15:43 |
| quiquell | rlandy: them=rdo guys | 15:43 |
| rlandy | quiquell: lol - rdo guys as in sf? | 15:43 |
| rlandy | rdo admins | 15:44 |
| * rlandy thinks sf | 15:44 | |
| quiquell | #rdo | 15:44 |
| quiquell | #wai maybe #rhos-ops | 15:44 |
| rlandy | quiquell: starting on #rdo | 15:45 |
| quiquell | rlandy: upsstream nodepool config https://github.com/openstack-infra/project-config/blob/master/nodepool/nodepool.yaml | 15:45 |
| quiquell | rlandy: I think I am going to put a review in place, looks simple enough | 15:46 |
| rlandy | quiquell: we have the go ahead from jpena - add him to the review | 15:47 |
| weshay | rlandy, the upstream nodeset or rdo sf nodeset? | 15:52 |
| weshay | rlandy, typically Ian Mccloud works on the images | 15:52 |
| weshay | rlandy, sorry Ian Weinard | 15:52 |
| rlandy | weshay: well I guess we're taking a shot now :) | 15:53 |
| weshay | sorry? | 15:53 |
| weshay | bluejeans | 15:53 |
| rlandy | we're adding a build to https://softwarefactory-project.io/r/gitweb?p=config.git;a=blob;f=nodepool/rdo-cloud.yaml | 15:54 |
| weshay | rlandy, bring me up to speed https://bluejeans.com/u/whayutin/ | 15:54 |
| rlandy | ok | 15:54 |
| weshay | rlandy, I thought we want rdo-fedora-stable | 15:54 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp- (1 more message) | 16:02 |
| weshay | rlandy, Ian Wienand <iwienand@redhat.com> | 16:09 |
| rlandy | quiquell: thanks | 16:12 |
| quiquell | rlandy: Let's see if this work, diskimage is a pain in the ass | 16:14 |
| rlandy | that's one way of putting it :) | 16:14 |
| quiquell | rlandy: tried to do that and it's difficult to get the right elements and the right deps in the zuul-builder machine | 16:14 |
| quiquell | rlandy: maybe they need to change more stuff at their infra to build that | 16:15 |
| rlandy | quiquell: weshay said ianw is the usual diskimage guy - pinged him to check it out | 16:15 |
| rlandy | we may need to cycle this a few times | 16:15 |
| quiquell | rlandy: ahh that's cool and most needed | 16:15 |
| * rlandy is scared for rhel8 | 16:15 | |
| quiquell | rlandy: ack | 16:16 |
| quiquell | rlandy: will drop soon | 16:16 |
| rlandy | quiquell: thanks for your help - have a great weekend | 16:17 |
| quiquell | rlandy: np, after all the effort we are putting help in the pipeline is kind of pleasure :-) | 16:18 |
| *** jfrancoa has quit IRC | 16:21 | |
| *** quiquell is now known as quiquell|off | 16:23 | |
| * marios_|ruck gets ready to go have a weekend | 16:36 | |
| marios_|ruck | ssbarnea|rover: o/ ^ | 16:36 |
| ssbarnea|rover | marios_|ruck: o/ : | 16:37 |
| *** holser_ has joined #oooq | 16:41 | |
| marios_|ruck | ssbarnea|rover: nice looks like bandini picked up https://bugs.launchpad.net/tripleo/+bug/1808536 | 16:42 |
| openstack | Launchpad bug 1808536 in tripleo "periodic-tripleo-featureset035-master fails overcloud deploy for "error: Could not connect to cluster (is it running" " [Undecided,In progress] - Assigned to Michele Baldessari (michele) | 16:42 |
| *** ykarel is now known as ykarel|away | 16:55 | |
| *** tosky has quit IRC | 16:56 | |
| *** amoralej is now known as amoralej|off | 17:01 | |
| *** udesale has quit IRC | 17:07 | |
| *** sshnaidm|off has quit IRC | 17:10 | |
| *** sshnaidm|off has joined #oooq | 17:25 | |
| *** agopi has joined #oooq | 17:32 | |
| weshay | hey folks I have a bday lunch to attend, takes longer than I like | 17:34 |
| weshay | bbiab | 17:34 |
| *** derekh has quit IRC | 17:47 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7 (2 more messages) | 18:02 |
| *** ykarel|away has quit IRC | 18:02 | |
| *** trown is now known as trown|lunch | 18:03 | |
| *** holser_ has quit IRC | 18:06 | |
| *** vkapalav has quit IRC | 18:18 | |
| *** dsneddon has quit IRC | 18:39 | |
| *** chandan_kumar has quit IRC | 18:46 | |
| ssbarnea|rover | weshay: when you have time have a look at https://review.openstack.org/#/c/624381/13 and check if it looks ok. | 18:57 |
| *** dsneddon has joined #oooq | 19:05 | |
| *** dsneddon has quit IRC | 19:09 | |
| rlandy | weshay: just reinstalled the zuul stuff, with ... pipenv run ansible-playbook playbooks/start-ci-reproducer.yaml -e ansible_python_interpreter="/usr/bin/python3" -e upstream_gerrit_user=<username> | 19:21 |
| rlandy | had to run it twice to work | 19:21 |
| rlandy | first time times out | 19:21 |
| *** trown|lunch is now known as trown | 19:29 | |
| *** dsneddon has joined #oooq | 19:33 | |
| rlandy | ha - hello OVB | 19:42 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7 (3 more messages) | 20:02 |
| weshay | ugh back | 20:42 |
| weshay | ssbarnea|rover, are you thinking | 20:45 |
| weshay | du -L -ch $LOGS_DIR/* | tail -n +1 | sort -rh | head -n 200 &> $LOGS_DIR/log-size.txt || true | 20:45 |
| weshay | is causing a problem? | 20:45 |
| *** dtrainor has quit IRC | 20:45 | |
| *** rlandy has quit IRC | 21:12 | |
| *** chandan_kumar has joined #oooq | 21:13 | |
| *** weshay is now known as weshay_pto | 21:44 | |
| *** jtomasek has quit IRC | 21:49 | |
| *** holser_ has joined #oooq | 21:55 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022, tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph- (2 more messages) | 22:02 |
| *** dtrainor has joined #oooq | 22:12 | |
| *** trown is now known as trown|outtypewww | 22:16 | |
| *** rfolco has quit IRC | 22:22 | |
| *** holser_ has quit IRC | 22:28 | |
| *** holser_ has joined #oooq | 23:11 | |
| *** holser_ has quit IRC | 23:16 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!