| *** tosky has quit IRC | 00:06 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010 (4 more messages) | 00:14 |
|---|---|---|
| *** rascasoft has quit IRC | 01:07 | |
| *** rascasoft has joined #oooq | 01:14 | |
| *** dsneddon has quit IRC | 01:15 | |
| *** dsneddon has joined #oooq | 01:43 | |
| *** rascasoft has quit IRC | 01:46 | |
| *** dsneddon has quit IRC | 01:48 | |
| *** rascasoft has joined #oooq | 01:50 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, (4 more messages) | 02:14 |
| *** dsneddon has joined #oooq | 02:19 | |
| *** dsneddon has quit IRC | 02:24 | |
| *** dsneddon has joined #oooq | 02:55 | |
| *** dsneddon has quit IRC | 03:00 | |
| *** apetrich has quit IRC | 03:15 | |
| *** dsneddon_ has joined #oooq | 03:16 | |
| *** dsneddon_ has quit IRC | 03:21 | |
| *** udesale has joined #oooq | 03:24 | |
| *** dsneddon_ has joined #oooq | 03:32 | |
| *** skramaja has joined #oooq | 03:35 | |
| *** dsneddon_ has quit IRC | 03:37 | |
| *** ykarel_ is now known as ykarel | 04:00 | |
| *** ykarel has quit IRC | 04:07 | |
| *** dsneddon_ has joined #oooq | 04:08 | |
| *** dsneddon_ has quit IRC | 04:13 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010 (3 more messages) | 04:14 |
| *** ykarel has joined #oooq | 04:26 | |
| *** rlandy|bbl has quit IRC | 04:26 | |
| *** chem has quit IRC | 04:26 | |
| *** rascasoft has quit IRC | 04:29 | |
| *** dsneddon_ has joined #oooq | 04:48 | |
| *** rlandy|bbl has joined #oooq | 04:53 | |
| *** chem has joined #oooq | 04:53 | |
| *** ratailor has joined #oooq | 05:01 | |
| *** dsneddon_ has quit IRC | 05:02 | |
| *** dsneddon_ has joined #oooq | 05:10 | |
| *** rascasoft has joined #oooq | 05:13 | |
| *** dsneddon_ has quit IRC | 05:16 | |
| *** rascasoft has quit IRC | 05:26 | |
| *** rascasoft has joined #oooq | 05:39 | |
| *** rascasoft has quit IRC | 05:45 | |
| *** dsneddon_ has joined #oooq | 05:48 | |
| *** dsneddon_ has quit IRC | 05:53 | |
| *** zbr has joined #oooq | 06:13 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010 (3 more messages) | 06:14 |
| *** zbr|ssbarnea has quit IRC | 06:15 | |
| *** saneax has joined #oooq | 06:21 | |
| *** dsneddon_ has joined #oooq | 06:26 | |
| *** dsneddon_ has quit IRC | 06:31 | |
| *** rlandy|bbl has quit IRC | 06:40 | |
| *** jtomasek has joined #oooq | 06:44 | |
| *** jtomasek has quit IRC | 06:48 | |
| *** jtomasek has joined #oooq | 06:48 | |
| *** jjoyce has quit IRC | 06:54 | |
| *** jfrancoa has joined #oooq | 06:58 | |
| *** ykarel has quit IRC | 07:04 | |
| *** ykarel has joined #oooq | 07:05 | |
| *** jjoyce has joined #oooq | 07:07 | |
| *** dsneddon_ has joined #oooq | 07:07 | |
| *** kopecmartin|off is now known as kopecmartin | 07:07 | |
| *** quiquell|off is now known as quiquell | 07:08 | |
| quiquell | marios: o/ | 07:08 |
| *** dsneddon_ has quit IRC | 07:11 | |
| marios | o/ quiquell | 07:11 |
| *** gkadam__ has joined #oooq | 07:21 | |
| quiquell | marios: did it work the repush ? | 07:22 |
| marios | quiquell: need to recheck it should be ok now | 07:25 |
| marios | quiquell: (the test reveiw i mean recheck ) | 07:25 |
| marios | quiquell: changed it a bit | 07:25 |
| marios | quiquell: so it tags with hash first, then we use the hash to retrieve and tag with ci-testing | 07:25 |
| quiquell | marios: yep sound good plan | 07:26 |
| marios | quiquell: oh cool looks like it is green here but need to check logs https://review.rdoproject.org/r/#/c/19131/ | 07:27 |
| marios | quiquell: so review when you can please https://review.openstack.org/#/c/641348/ | 07:27 |
| marios | and we merge it today hopefuly | 07:27 |
| quiquell | It has already a +2 if it's ok will workflow it | 07:28 |
| marios | quiquell: cool thanks add the +2 lets give it a while for checking etc and we merge | 07:29 |
| marios | quiquell: http://logs.rdoproject.org/31/19131/1/check/periodic-tripleo-centos-7-master-containers-build-push/018adae/job-output.txt.gz | 07:29 |
| quiquell | so we have to check that we do two push | 07:29 |
| marios | quiquell: hmm sec 2019-03-06 23:09:23.998852 | primary | skipping: Conditional result was False 2019-03-06 23:09:23.925788 | TASK [Retrieve list of built images] | 07:29 |
| quiquell | let's ask DLRN | 07:29 |
| quiquell | a wai tI mean registry | 07:30 |
| marios | quiquell: yeah rdo registry | 07:30 |
| quiquell | Humm I thing there is a console or the like to do it in the browser | 07:30 |
| quiquell | Do you ahve the link ? | 07:30 |
| marios | quiquell: no don't but we'll find :) | 07:31 |
| quiquell | marios: is this ok ? http://logs.rdoproject.org/31/19131/1/check/periodic-tripleo-centos-7-master-containers-build-push/018adae/conf/kolla-build.conf.txt.gz | 07:31 |
| quiquell | tag=bc2a1fb5259e64596a8071a592dc8eb1b6990ae0_594d5b60 looks good | 07:32 |
| marios | quiquell: yeah looks ok | 07:32 |
| quiquell | humm wait | 07:32 |
| marios | but why did it skip | 07:32 |
| quiquell | namespace maybe wrong | 07:32 |
| quiquell | I think it has to be | 07:32 |
| quiquell | tripleomaster | 07:32 |
| marios | it doesn't like the condition here https://review.openstack.org/#/c/641348/10/playbooks/tripleo-buildcontainers/run.yaml@88 | 07:32 |
| marios | quiquell: yeah | 07:33 |
| marios | quiquell: for some reason https://review.openstack.org/#/c/641348/10/playbooks/tripleo-buildcontainers/templates/kolla-build.conf.j2 | 07:33 |
| marios | quiquell: the if periodic is not working here either | 07:33 |
| marios | quiquell: ah is it cos i didn't hack to make the test review periodic i think | 07:34 |
| marios | quiquell: like there is a depends on i need to add in https://review.rdoproject.org/r/#/c/19131/ | 07:34 |
| marios | quiquell: k sec will fix the test ^ and we rerun it | 07:34 |
| marios | quiquell: do you have one already or should i post one (i mean review in ci which makes it periodic) | 07:35 |
| quiquell | Is that | 07:35 |
| marios | quiquell: you usually have one :) | 07:35 |
| quiquell | hack for periodic | 07:35 |
| quiquell | But our hack si not going to work | 07:35 |
| quiquell | This is not using toci | 07:35 |
| quiquell | well... I think | 07:36 |
| marios | quiquell: https://review.openstack.org/#/c/629157/3/roles/common/vars/main.yaml | 07:36 |
| marios | quiquell: ok i have this i think will work ^ | 07:36 |
| quiquell | It will not | 07:36 |
| quiquell | We don't use "periodic" variable at tripleo-builddcontainer | 07:36 |
| quiquell | marios: toci is not used an this jobs | 07:37 |
| marios | quiquell: but periodic in zuul.job? | 07:37 |
| marios | job: periodic-tripleo-centos-7-master-containers-build-push | 07:37 |
| marios | http://logs.rdoproject.org/31/19131/1/check/periodic-tripleo-centos-7-master-containers-build-push/018adae/zuul-info/inventory.yaml | 07:37 |
| marios | or not? | 07:37 |
| quiquell | marios: The only thing you can do is hack directly in the review | 07:39 |
| quiquell | marios: the toci hack is not going to work | 07:39 |
| quiquell | marios: we don't use toci_gate_test at this job | 07:39 |
| marios | quiquell: yeah i se what you mean cos this file istn' used the roles/common/vars | 07:39 |
| quiquell | marios: yep | 07:39 |
| marios | has its own run and post here | 07:39 |
| marios | ok will do | 07:39 |
| *** dsneddon_ has joined #oooq | 07:39 | |
| marios | hack in review, see it run then change it | 07:39 |
| quiquell | marios: just put a review in top of the one you are testing changing the condition | 07:39 |
| quiquell | marios: so you don't change the review you want to merge | 07:40 |
| marios | quiquell: k will do | 07:40 |
| *** apetrich has joined #oooq | 07:40 | |
| quiquell | biab | 07:40 |
| marios | https://review.openstack.org/#/c/641348/10 commented for now iwth pointers so is clear | 07:40 |
| marios | k thanks | 07:40 |
| *** quiquell is now known as quiquell|brb | 07:40 | |
| marios | pipeline: check @ http://logs.rdoproject.org/31/19131/1/check/periodic-tripleo-centos-7-master-containers-build-push/018adae/zuul-info/inventory.yaml | 07:42 |
| *** dsneddon_ has quit IRC | 07:44 | |
| marios | quiquell|brb: posted https://review.openstack.org/#/c/641580/ | 07:49 |
| *** fmount has quit IRC | 07:51 | |
| quiquell|brb | marios: good! | 07:52 |
| quiquell|brb | marios: let's see now | 07:52 |
| quiquell|brb | better use zuul.job_name or the like, so you search periodic | 07:53 |
| quiquell|brb | but this is good | 07:53 |
| marios | quiquell|brb: well it keeps the original condition so i thought its closer | 07:53 |
| *** dtantsur|afk is now known as dtantsur | 07:55 | |
| quiquell|brb | marios: about namespace=master | 07:55 |
| quiquell|brb | is this ok ? | 07:55 |
| quiquell|brb | is not | 07:55 |
| quiquell|brb | namespace=tripleomaster ? | 07:55 |
| quiquell|brb | or this the thing append prefix tripleo before push ? | 07:56 |
| marios | quiquell|brb: yeah it will be when its periodic | 07:56 |
| marios | quiquell|brb: like https://review.openstack.org/#/c/641348/10/playbooks/tripleo-buildcontainers/templates/kolla-build.conf.j2 | 07:56 |
| *** fmount has joined #oooq | 07:56 | |
| marios | {% if 'periodic' in zuul.pipeline %} | 07:56 |
| marios | namespace=tripleomaster | 07:56 |
| marios | {% else %} | 07:56 |
| quiquell|brb | ahhh ok | 07:56 |
| quiquell|brb | damn.. | 07:57 |
| marios | quiquell|brb: but for now its ok | 07:57 |
| quiquell|brb | well not sure | 07:57 |
| quiquell|brb | a ok we will have continers at different namespace | 07:57 |
| marios | quiquell|brb: i mean for the test when we merge it will work OK. the main thing we want to test is the retag | 07:57 |
| quiquell|brb | wait | 07:57 |
| marios | the namespsace tripleomaster thing is done already i mean didn't change it | 07:57 |
| quiquell|brb | you need to append tripleo to branch | 07:57 |
| marios | (here) | 07:57 |
| quiquell|brb | not harcode tripleomaster | 07:57 |
| marios | quiquell|brb: k if there is problem with the namespace we'll fix up in a new patch after this one though | 07:58 |
| quiquell|brb | tripleo + {{ ci_branch | replace("/", "") }} | 07:58 |
| marios | quiquell|brb: thats when its check | 07:58 |
| marios | quiquell|brb: i think namespace ok cos this is not branched yet | 07:58 |
| marios | quiquell|brb: i mean periodic | 07:58 |
| marios | quiquell|brb: or check in fact | 07:58 |
| quiquell|brb | well stein will use this | 07:59 |
| marios | quiquell|brb: right we'll need to make changes in this once we are steining | 07:59 |
| quiquell|brb | ok go back in a few and we talk about it | 07:59 |
| marios | ;) | 07:59 |
| marios | quiquell|brb: still it should be ontop though | 07:59 |
| quiquell|brb | it's like cheap to make it right | 07:59 |
| marios | quiquell|brb: no | 07:59 |
| marios | quiquell|brb: is already complex review - we could do it same time but review on top | 08:00 |
| marios | quiquell|brb: and its different topic | 08:00 |
| marios | quiquell|brb: "deal with stein" vs "fix tags for periodics" | 08:00 |
| *** saneax has quit IRC | 08:00 | |
| jaosorior | hey folks! would sure be nice to merge this https://review.openstack.org/#/c/641276/ | 08:06 |
| quiquell|brb | jaosorior: +w | 08:07 |
| jaosorior | thanks quiquell|brb | 08:07 |
| *** quiquell|brb is now known as quiquell | 08:07 | |
| quiquell | marios: but we are replacing old with new and old was aware of branches | 08:12 |
| quiquell | marios: what's the issue with adding branch to the namespace for periodics ? | 08:12 |
| quiquell | let's wait for panda|ruck|off | 08:13 |
| quiquell | he will help us with that | 08:13 |
| quiquell | meanwhile we test with current stuff | 08:13 |
| *** ccamacho has joined #oooq | 08:13 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010 (3 more messages) | 08:14 |
| *** jpena|off is now known as jpena | 08:14 | |
| marios | quiquell: no issue with adding man just its a separate task that is all i'm saying | 08:16 |
| marios | quiquell: so it should be a new review | 08:16 |
| marios | on top | 08:16 |
| marios | not changing that one | 08:16 |
| quiquell | humm ack | 08:16 |
| quiquell | But let's not forget about it | 08:16 |
| marios | quiquell: absolutely not. i can even start it today once we are happy with this | 08:16 |
| marios | quiquell: Stein is coming | 08:16 |
| quiquell | perfect | 08:16 |
| marios | ! | 08:16 |
| quiquell | well and the other releases too | 08:17 |
| marios | yah but that is the most pressing because | 08:17 |
| quiquell | I mean I suppose we will change rocky to use those | 08:17 |
| quiquell | ok | 08:17 |
| marios | currently the upstream container build | 08:17 |
| marios | is really only testing master | 08:17 |
| marios | not saying that's ok but stein is the first one we'll need and definee | 08:17 |
| *** dsneddon_ has joined #oooq | 08:19 | |
| quiquell | humm bu if test review works with branch version why not to merge that ? | 08:21 |
| quiquell | so we are prepare in that front from the beginning | 08:21 |
| * quiquell see the marios eyes injected with blood | 08:22 | |
| marios | quiquell: nop :D srsly man don't want to change that review. another one on top fine | 08:23 |
| marios | but not there | 08:23 |
| quiquell | ok ok | 08:23 |
| *** dsneddon_ has quit IRC | 08:23 | |
| *** tosky has joined #oooq | 08:27 | |
| *** bogdando has joined #oooq | 08:31 | |
| quiquell | marios: can you +w this https://review.rdoproject.org/r/#/c/19067/ ? | 08:35 |
| quiquell | marios: they are just new files | 08:35 |
| marios | quiquell: sure let me chck gimme couple mins | 08:36 |
| quiquell | marios: nothing at RDO/Upstream is wired up to them just bm poc | 08:36 |
| marios | quiquell: it didn't pull in the change at http://logs.rdoproject.org/31/19131/1/check/periodic-tripleo-centos-7-master-containers-build-push/f399288/zuul-info/inventory.yaml | 08:49 |
| marios | quiquell: sorry i mean for the test review | 08:49 |
| marios | quiquell: gonna change it directly on the review sec | 08:49 |
| marios | 2019-03-07 08:43:23.786492 | TASK [Retrieve list of built images] | 08:49 |
| marios | 2019-03-07 08:43:23.857779 | primary | skipping: Conditional result was False | 08:49 |
| quiquell | Is the Depends-On of the test review ok ? | 08:49 |
| marios | quiquell: well they are now ontop of each other | 08:49 |
| marios | quiquell: i though if i include : https://review.openstack.org/641348 it would pull the parent | 08:50 |
| marios | but it didn't | 08:50 |
| marios | maybe i shoul djust depend on the parent it will pull the child? | 08:50 |
| quiquell | Depends-On is not ok | 08:50 |
| marios | i guess | 08:50 |
| quiquell | you have to put the DNM | 08:50 |
| marios | quiquell: yeah changing | 08:50 |
| quiquell | ack | 08:50 |
| *** sshnaidm has quit IRC | 08:51 | |
| *** sshnaidm has joined #oooq | 08:52 | |
| *** panda|ruck|off is now known as panda|ruck | 08:52 | |
| *** dsneddon_ has joined #oooq | 08:52 | |
| *** amoralej|off is now known as amoralej | 08:57 | |
| marios | quiquell: don't have +2 https://review.rdoproject.org/r/#/c/19067/ | 09:00 |
| *** saneax has joined #oooq | 09:00 | |
| *** fmount has quit IRC | 09:01 | |
| quiquell | marios: I have to settle I think I am suffering from pre-PTO anxiety | 09:02 |
| panda|ruck | quiquell: on https://review.rdoproject.org/r/19067 I was expecting a bit more documentation on what scenarios the test were testing | 09:02 |
| quiquell | panda|ruck: Agree I will ellaborate it more | 09:03 |
| marios | quiquell: when are you off then | 09:03 |
| panda|ruck | lol | 09:03 |
| quiquell | marios: my last day is today I am back 24th | 09:04 |
| ykarel | panda|ruck, for https://bugs.launchpad.net/tripleo/+bug/1818305 i have attemped a patch and seems working | 09:04 |
| openstack | Launchpad bug 1818305 in tripleo "overcloud-full image fails to build calling mkfs -t xfs, exec sudo failed" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 09:04 |
| panda|ruck | I usually suffer from pre PTO indifference. "Not my problem anymore" | 09:04 |
| marios | quiquell: no sorry you're pto was cancelled didn't panda|ruck tell you ? | 09:04 |
| panda|ruck | ykarel: .... | 09:04 |
| panda|ruck | ykarel: .......... | 09:04 |
| marios | panda|ruck: screw you gaaiz am going home | 09:05 |
| ykarel | panda|ruck, https://review.openstack.org/#/c/641576/ and now we need to see how to correctly fix it | 09:05 |
| *** dsneddon_ has quit IRC | 09:06 | |
| panda|ruck | ykarel: I can't believe xfsprogs are not there by default | 09:07 |
| quiquell | marios: since panda|ruck is my master I am going to follow his PTO mechanism | 09:07 |
| * quiquell ignoring marios in 1 2 3 ... | 09:08 | |
| panda|ruck | quiquell: use /IGNORE -all *marios* | 09:08 |
| quiquell | panda|ruck: marios > /dev/null 2>&1 | 09:08 |
| panda|ruck | ykarel: I don't understand, the base image has changed last time in January | 09:09 |
| panda|ruck | how it's possible that xfsprogs disappeared | 09:09 |
| ykarel | panda|ruck, hmm, earlier it was pulled by docker, but now since docker is removed it's not being pulled up | 09:10 |
| ykarel | xfsprogs was pulled as a dep for docker | 09:10 |
| ykarel | panda|ruck, https://review.rdoproject.org/r/#/q/topic:docker | 09:11 |
| quiquell | panda|ruck: small subset of ansible-lint at config project <- https://review.rdoproject.org/r/#/c/19129/ | 09:11 |
| quiquell | panda|ruck: to catch identastion problems at yamls | 09:11 |
| panda|ruck | oh dear https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/68c31f1/logs/undercloud/home/zuul/overcloud-full.log.txt.gz#_2019-03-07_00_11_53_451 | 09:11 |
| panda|ruck | ykarel: do you want to update the bug ? | 09:12 |
| ykarel | panda|ruck, you can update | 09:12 |
| panda|ruck | ykarel: I thought xfs was the default file system for RH based distributions .. | 09:12 |
| ykarel | me not aware about default file system | 09:13 |
| panda|ruck | ykarel: yes it is, but apprently that doesn't deserve having xfsprogs in the essential packages. | 09:22 |
| panda|ruck | ykarel: at least in the cloud image, probably because it's supposed that you don't try to create or recover files systems in a cloud image | 09:23 |
| panda|ruck | and you have to save space | 09:23 |
| panda|ruck | I should have checked the package presence before, it would have saved time | 09:23 |
| panda|ruck | it's not in the rpm list for the failing jobs | 09:24 |
| panda|ruck | I'm a disgrace for the humanity | 09:24 |
| panda|ruck | I have disohonoured my team | 09:24 |
| panda|ruck | seppuku time | 09:24 |
| ykarel | panda|ruck, yup i too detected by doing rpm diff | 09:26 |
| ykarel | in pass and fail | 09:26 |
| sshnaidm | zbr, what's the problem with https://review.openstack.org/#/c/639670/ ? | 09:27 |
| ykarel | panda|ruck, and the error was not clear before you enabled debug_trace | 09:27 |
| zbr | sshnaidm: runs atom in background forevever. I did now know why, that's only issue. If I would know why, i would have nothing against. (no body on commit, not linked ticket/bug). | 09:30 |
| zbr | sshnaidm: i would gladly +1 it if I knew. | 09:30 |
| sshnaidm | zbr, do you know what atop is? | 09:30 |
| zbr | yep, perf monitor | 09:31 |
| sshnaidm | zbr, do you know why we run monitors in jobs at all? | 09:31 |
| panda|ruck | ykarel: working on a patch for the product, and not for the CI. Not easy to understand where to put it in dib | 09:31 |
| ykarel | panda|ruck, i commented https://review.openstack.org/#/c/641576/ | 09:32 |
| panda|ruck | ykarel: dib has actually elements to install required packages | 09:33 |
| ykarel | panda|ruck, we need xfsprogs on host not in image being built | 09:34 |
| panda|ruck | ykarel: I don't know if dib should depend strictly on xfsprogs though, I see it's more general tool used also for debian distros, and another filesystem may be used instead of xfs even in RH based distros | 09:34 |
| *** derekh has joined #oooq | 09:35 | |
| *** holser_ has joined #oooq | 09:35 | |
| sshnaidm | zbr, do you know that we run dstat "forever"? | 09:35 |
| ykarel | panda|ruck, hmm to check proper fix we need to consider such things | 09:35 |
| ykarel | i mean where to put that dep | 09:36 |
| *** rascasoft has joined #oooq | 09:36 | |
| panda|ruck | ykarel: yep | 09:36 |
| ykarel | so for now i would say we should include where we use it, like tripleoclient | 09:36 |
| ykarel | panda|ruck, can you propose a patch to tripleoclient-distgit so we make some progress on jobs? | 09:37 |
| panda|ruck | ykarel: ya, the install package utility is called mainly with the run_in_target wrapper, so installs on the image | 09:39 |
| ykarel | yup | 09:39 |
| zbr | sshnaidm: i suspect why, still I do not see any ticket asking for the default 10s value to be made 180s, there is not history behind the proposed change. the way I see it, is an arbitrary value. I suspect that is for lowering the monitoring load but I would like to see a LP bug asking for this, explaining/motivating the change. Why? Just because I want to have to be able to reach original ticket. What if tomorrow someone else propose using | 09:39 |
| zbr | 60s ... i have no way to see why it was 180s in the first place. | 09:39 |
| zbr | sshnaidm: makes sense? i am not against using atop. | 09:39 |
| zbr | is only to document : LP, taiga or SB, any would be fine. | 09:39 |
| sshnaidm | zbr, not every work in CI is in tickets or bugs, the whole previous week we worked on decreasing logs size in infra and that's part of this | 09:40 |
| sshnaidm | zbr, and it's ok to ask why it's done before downvoting | 09:41 |
| zbr | sshnaidm: just pinpoint to the ticket with reducing log size, it would enough. | 09:41 |
| *** dsneddon_ has joined #oooq | 09:41 | |
| sshnaidm | zbr, no such ticket | 09:42 |
| zbr | sshnaidm: i can create one, less than a minute. | 09:43 |
| *** fmount has joined #oooq | 09:45 | |
| *** dsneddon_ has quit IRC | 09:46 | |
| quiquell | marios, panda|ruck: Is this ok now ? https://review.rdoproject.org/r/19067 | 09:53 |
| *** d0ugal has quit IRC | 09:54 | |
| ykarel | panda|ruck, apart from image build there seems other issue in ovb, are those known? | 09:54 |
| ykarel | i see failures even where image is not built:- https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001&branch=master | 09:55 |
| marios | quiquell: ack will check (not sure what's hapening with cont. build is taking like 1 hour waiting for it to report now https://review.rdoproject.org/zuul/stream/fd7f83a5dc7549d2bcedaf4859c15077?logfile=console.log | 09:55 |
| quiquell | marios: it means it working | 09:57 |
| quiquell | marios: maybe the repush is repushing | 09:57 |
| panda|ruck | ykarel: featureset001 builds image too | 09:57 |
| quiquell | marios: looks like first push not taking too much since it's alredy push and second one taking more becaus we haven't | 09:57 |
| quiquell | marios: could be it ? | 09:57 |
| ykarel | panda|ruck, no not always | 09:58 |
| *** d0ugal has joined #oooq | 09:58 | |
| ykarel | it depends on to_build | 09:58 |
| panda|ruck | ykarel: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/68c31f1/job-output.txt.gz#_2019-03-07_00_05_28_746159 | 09:58 |
| panda|ruck | ykarel: if it doesn't build, fro where does it take the image ? | 09:58 |
| ykarel | possible it takes the promoted image | 09:59 |
| panda|ruck | ykarel: featureset002 uploads only after it finishes | 09:59 |
| ykarel | i mean already promoted image | 09:59 |
| panda|ruck | mmmhh download and updates an existing image ? mmmhh, seems dangerous becasue you're not testing dib then. I'm not sure under which condition featureset DOESN'T build | 10:00 |
| panda|ruck | sshnaidm: do you remember in which conditions featureset001 doesn't build an image ? | 10:00 |
| panda|ruck | AAAAAAAAA we have the stein branch | 10:01 |
| panda|ruck | ykarel: so I have to backj port the change in rpm-stein too ? | 10:01 |
| ykarel | panda|ruck, stein-rdo, those are not exist yet | 10:01 |
| ykarel | currently master/stein same | 10:02 |
| panda|ruck | ok | 10:02 |
| sshnaidm | panda|ruck, we have list of repos for ovb jobs to build images: http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/playbooks/to-build-or-not-to-build.yml#n49 | 10:02 |
| panda|ruck | sshnaidm: oh, ok, but in periodic we always build | 10:03 |
| sshnaidm | panda|ruck, and we build in periodic | 10:03 |
| sshnaidm | yeah | 10:03 |
| panda|ruck | ykarel: ok yatin now I understand what you're saying,, ovb jobs are failing in cheks | 10:03 |
| ykarel | panda|ruck, yup | 10:03 |
| *** ccamacho has quit IRC | 10:06 | |
| marios | ykarel: is there somewhere we can see containers in https://registry.rdoproject.org/ (like hub.docker.com for example) | 10:07 |
| ykarel | marios, /me don't know, jpena ^^ | 10:08 |
| ykarel | i generally use skopeo to check image | 10:08 |
| marios | ykarel: i see wes has a screen shot in https://tree.taiga.io/project/tripleo-ci-board/task/823?kanban-status=1447277 but don't know where he got it from | 10:08 |
| marios | ykarel: k thanks man | 10:09 |
| marios | ykarel: do i need authentication though for skopeo to query rdo registry? | 10:10 |
| ykarel | marios, no | 10:10 |
| marios | ykarel: cos i don't have creds for that | 10:10 |
| marios | ykarel: k thankx trying | 10:11 |
| jpena | marios: there's https://console.registry.rdoproject.org | 10:11 |
| jpena | it has not been used a lot, because it doesn't seem to be very easy to use | 10:11 |
| jpena | and we were planning to get rid of it, because its deployment required some downstream patches for openshift-ansible | 10:11 |
| marios | jpena: cool ykarel thanks very much folks (seems to be hanging on registry.rdoproject.org jpena is it usually slow?) | 10:12 |
| jpena | marios: it has some kind of github integration, I think | 10:13 |
| marios | jpena: yeah seems to hang on the oauth back from github | 10:13 |
| marios | jpena: k thanks will try again | 10:13 |
| *** dsneddon_ has joined #oooq | 10:13 | |
| jpena | use console.registry, not registry. | 10:13 |
| marios | jpena: yeah started there but redirects to oauth etc ack | 10:14 |
| ykarel | jpena, it redirected to registry | 10:14 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, (3 more messages) | 10:14 |
| *** zbr|ssbarnea has joined #oooq | 10:16 | |
| *** zbr has quit IRC | 10:18 | |
| *** dsneddon_ has quit IRC | 10:20 | |
| marios | ykarel: FATA[0001] pinging docker registry returned: Get https://registry.rdoproject.org/v2/: x509: certificate is valid for *.apps.registry.rdoproject.org, apps.registry.rdoproject.org, not registry.rdoproject.org | 10:23 |
| ykarel | marios, you get ^^, when? | 10:24 |
| ykarel | skopeo? | 10:24 |
| marios | ykarel: any idea (like e.g. skopeo inspect docker://registry.rdoproject.org/tripleomaster but not sure of that url | 10:24 |
| marios | ykarel: yeah | 10:24 |
| ykarel | marios, example:- skopeo inspect docker://trunk.registry.rdoproject.org/tripleomaster/centos-binary-rabbitmq:tripleo-ci-testin | 10:24 |
| marios | ykarel: the console thing fails for me (authorization failed? ) | 10:24 |
| marios | ykarel: thx trying | 10:25 |
| ykarel | marios, for me console authorization successful, but thne:- {"metadata":{},"status":"Failure","message":"Timeout: request did not complete within 1m0s","reason":"Timeout","details":{},"code":504} | 10:25 |
| marios | ykarel: cool thanks skopeo does what i need | 10:26 |
| ykarel | ack | 10:27 |
| panda|ruck | quiquell: commented specifically on https://review.rdoproject.org/r/19067 with my doubts and what I understand of the tests. | 10:36 |
| *** ykarel is now known as ykarel|afk | 10:36 | |
| panda|ruck | quiquell: for https://review.rdoproject.org/r/19129 the linter itself is already detecting that "environment" for example is at the wrong indentation level ? | 10:38 |
| quiquell | panda|ruck: yep, tested breaking it | 10:39 |
| quiquell | panda|ruck: I can put a test review with that | 10:39 |
| panda|ruck | quiquell: no that's ok, I ust didn't know hte linter was so smart | 10:40 |
| quiquell | panda|ruck: ansible-lint is powerful tool and dangerous too | 10:40 |
| panda|ruck | actually understanding the indenation level for each possible task variable | 10:40 |
| panda|ruck | quiquell: with greap power, comes great danger. | 10:40 |
| quiquell | let me put a test review is not bad to have there | 10:40 |
| quiquell | exactly that | 10:40 |
| *** ykarel|afk is now known as ykarel | 10:43 | |
| quiquell | panda|ruck: https://review.rdoproject.org/r/#/c/19149/ | 10:44 |
| sshnaidm | arxcruz, chkumar|pto folks, do we copy tempest subunit file to testrepository.subunit.gz in logs? I remember that was a case once, but not sure now it is.. | 10:44 |
| sshnaidm | marios, zbr|ssbarnea any reviews about f28 that need attention? | 10:45 |
| zbr|ssbarnea | sshnaidm: working on it now, i will know and ping very soon. | 10:46 |
| sshnaidm | ack | 10:46 |
| marios | https://review.openstack.org/#/c/641348/ this sshnaidm | 10:46 |
| marios | sshnaidm: doing some final testing (we have test review in the commit message) | 10:47 |
| marios | sshnaidm: review if you have tim ethanks | 10:47 |
| sshnaidm | marios, sure | 10:48 |
| *** dsneddon_ has joined #oooq | 10:55 | |
| *** ykarel is now known as ykarel|afk | 10:56 | |
| *** zbr has joined #oooq | 10:56 | |
| *** udesale has quit IRC | 10:59 | |
| *** dsneddon_ has quit IRC | 10:59 | |
| *** udesale has joined #oooq | 10:59 | |
| *** zbr|ssbarnea has quit IRC | 10:59 | |
| arxcruz | sshnaidm: what you mean? the .testrepository ? | 11:05 |
| arxcruz | sshnaidm: we must otherwise it will not be on openstack health | 11:06 |
| arxcruz | sorry, i was at the doctor | 11:06 |
| sshnaidm | arxcruz, I mean file in root of logs which is uploaded to "openstack health" | 11:06 |
| arxcruz | sshnaidm: yes, we should | 11:07 |
| sshnaidm | arxcruz, but do we do it now? | 11:07 |
| arxcruz | it was copying for sure | 11:07 |
| arxcruz | sshnaidm: yes http://logs.openstack.org/76/640976/2/check/tripleo-ci-centos-7-standalone-os-tempest/5bd6db4/logs/ | 11:07 |
| arxcruz | sshnaidm: i remember you write a patch to subunit file set as failing in the beginning of the run | 11:08 |
| sshnaidm | arxcruz, yeah, so I hope it's not this one..\ | 11:08 |
| sshnaidm | arxcruz, actually this is that I fake | 11:08 |
| sshnaidm | arxcruz, it still has "pingtest" :) | 11:08 |
| arxcruz | sshnaidm: http://logs.openstack.org/59/641159/1/gate/tripleo-ci-centos-7-undercloud-containers/5155431/logs/ also have it | 11:09 |
| sshnaidm | arxcruz, this one looks fine | 11:10 |
| sshnaidm | arxcruz, but first one is faked | 11:10 |
| sshnaidm | arxcruz, maybe we don't copy it when using os_tempest | 11:11 |
| quiquell | panda|ruck: so failing as expected the linting https://review.rdoproject.org/r/#/c/19149/ | 11:11 |
| *** d0ugal has quit IRC | 11:11 | |
| arxcruz | sshnaidm: indeed, let me check | 11:11 |
| quiquell | panda|ruck: "304 Environment variables don't work as part of command" | 11:11 |
| quiquell | panda|ruck: powerful | 11:12 |
| arxcruz | sshnaidm: yes, it's copying to another directory | 11:15 |
| *** ykarel|afk is now known as ykarel | 11:15 | |
| panda|ruck | quiquell: cool | 11:15 |
| *** zbr|ssbarnea has joined #oooq | 11:17 | |
| *** dtantsur is now known as dtantsur|bbl | 11:19 | |
| *** zbr has quit IRC | 11:19 | |
| quiquell | panda|ruck: going to add you stuff as comments in the review | 11:22 |
| panda|ruck | quiquell: did I get everything right ? | 11:25 |
| panda|ruck | quiquell: taht was my understanding anyway | 11:25 |
| *** dsneddon_ has joined #oooq | 11:27 | |
| *** udesale has quit IRC | 11:28 | |
| *** d0ugal has joined #oooq | 11:29 | |
| quiquell | panda|ruck: yep totally | 11:30 |
| *** ccamacho has joined #oooq | 11:31 | |
| *** dsneddon_ has quit IRC | 11:32 | |
| marios | panda|ruck: quiquell weshay|rover please vote/revote when you have some time i think good to go i added pointers in the commit message comment thank you "! https://review.openstack.org/#/c/641348/11//COMMIT_MSG ** anyone with some time for a review thanks | 11:36 |
| *** ratailor has quit IRC | 11:37 | |
| marios | sshnaidm: ^ | 11:37 |
| marios | sshnaidm: if you have tim eplease revisit https://review.openstack.org/#/c/641348/11//COMMIT_MSG | 11:37 |
| panda|ruck | old macpanda had a server farm E I E I O | 11:38 |
| panda|ruck | and on this server farm it was a OVS E I E I O | 11:39 |
| panda|ruck | with a crash-crash here and a crash-crash there | 11:39 |
| quiquell | marios: go go go | 11:39 |
| panda|ruck | marios: looking | 11:39 |
| marios | thanks folks panda|ruck is the retag one | 11:39 |
| zbr|ssbarnea | marios: sshnaidm quiquell : i need some help with https://tree.taiga.io/project/tripleo-ci-board/task/831 -- especially first review that adds the f28 s1-4 jobs. | 11:44 |
| marios | zbr|ssbarnea: ack will check in bit | 11:45 |
| marios | zbr|ssbarnea: general review request or something specific blocking now | 11:45 |
| *** udesale has joined #oooq | 11:45 | |
| *** zbr has joined #oooq | 11:45 | |
| quiquell | marios: I am going to workflow it | 11:46 |
| quiquell | ack ? | 11:46 |
| *** zbr has quit IRC | 11:46 | |
| quiquell | or we wait to results from rebase ? | 11:46 |
| marios | quiquell: yeah i mean lets wait for zuul to report then we +A iot | 11:46 |
| quiquell | ack | 11:46 |
| *** zbr has joined #oooq | 11:47 | |
| arxcruz | sshnaidm: https://tree.taiga.io/project/tripleo-ci-board/task/832?kanban-status=1447275 added you as QE | 11:48 |
| *** zbr|ssbarnea has quit IRC | 11:48 | |
| sshnaidm | arxcruz, thanks | 11:49 |
| quiquell | panda|ruck: Added your descriptions as comments here https://review.rdoproject.org/r/19067 | 11:50 |
| *** holser_ is now known as holser|burger | 11:51 | |
| quiquell | zbr: commented https://review.rdoproject.org/r/#/c/19151/ | 11:52 |
| quiquell | sshnaidm: I see NODE_FAILURES at vexxhost from repro CI | 11:52 |
| *** amoralej is now known as amoralej|lunch | 11:56 | |
| zbr | quiquell: replied, do you know a way to trigger these jobs before we merge them? | 11:57 |
| quiquell | zbr: put another review in top of this and add those jobs to check pipeline | 11:58 |
| quiquell | zbr: this is untrusted repo so they will run | 11:58 |
| zbr | quiquell: i will do it, i wonder if we can find a trick to auto-include them when we touch their definition. to avoid the need to add testing CRs. | 12:00 |
| quiquell | zbr: you are tricking me :-) | 12:00 |
| *** jjoyce has quit IRC | 12:01 | |
| quiquell | zbr: looks like popluting projecs at RDO with job definitions is not very welcome remember | 12:01 |
| quiquell | zbr: for files section I mean | 12:01 |
| quiquell | zbr: just put a review on top or use testproject | 12:01 |
| *** skramaja has quit IRC | 12:02 | |
| *** skramaja has joined #oooq | 12:03 | |
| *** jjoyce has joined #oooq | 12:03 | |
| *** jjoyce has quit IRC | 12:03 | |
| *** dsneddon_ has joined #oooq | 12:04 | |
| *** jjoyce has joined #oooq | 12:04 | |
| *** rfolco is now known as rfolco|rucker | 12:08 | |
| *** dsneddon_ has quit IRC | 12:09 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010 (3 more messages) | 12:14 |
| marios | zbr|ssbarnea: general review request or something specific blocking now re task/831 | 12:15 |
| marios | sshnaidm: ok now i hate taiga too booooo | 12:28 |
| marios | veeery slow | 12:28 |
| marios | i mean why the hell are we using taiga anyway | 12:28 |
| marios | its slooooo | 12:28 |
| marios | etc | 12:28 |
| marios | cc arxcruz | 12:28 |
| sshnaidm | marios, it's taaaaaaaigaaaaa | 12:28 |
| sshnaidm | not taiga | 12:28 |
| quiquell | marios: undercloud-containres failint at retag http://logs.openstack.org/48/641348/13/check/tripleo-ci-centos-7-undercloud-containers/f96f4b9/ | 12:29 |
| marios | noooo | 12:29 |
| marios | quiquell: looking thanks | 12:29 |
| *** saneax has quit IRC | 12:30 | |
| *** gkadam__ has quit IRC | 12:32 | |
| *** gkadam__ has joined #oooq | 12:32 | |
| sshnaidm | https://www.atlassian.com/software/views/open-source-license-request | 12:32 |
| marios | quiquell: can't see the fail can you point? | 12:33 |
| marios | quiquell: i mean i see failed undercloud install log etc but can't see linting issue | 12:33 |
| marios | quiquell: do you mean related to the patch like there is linting nit? | 12:33 |
| arxcruz | marios: hm.... not sure if you're being sarcastic or not... | 12:33 |
| quiquell | marios: 200~http://logs.openstack.org/48/641348/13/check/tripleo-ci-centos-7-undercloud-containers/f96f4b9/job-output.txt.gz#_2019-03-07_12_18_07_372862 | 12:33 |
| quiquell | marios: linting ? | 12:34 |
| marios | 14:29 < quiquell> marios: undercloud-containres failint at retag | 12:34 |
| marios | quiquell: haha i read it too quickly failint | 12:34 |
| quiquell | well I makeup a new concept | 12:34 |
| quiquell | fail at linting | 12:34 |
| quiquell | failint | 12:34 |
| marios | quiquell: but i think is unrelated | 12:34 |
| * marios back to taiga tidy up for scrum biab | 12:35 | |
| zbr | marios: is f28, is next step after 831, weshay|rover added story so we can get things in line | 12:36 |
| marios | zbr: yeah i got that bit. i was asking if you were reqesting a general review of stuff there or something specific you are blocked on i guess we talk in 25 anyway | 12:37 |
| *** dsneddon_ has joined #oooq | 12:37 | |
| *** dsneddon_ has quit IRC | 12:42 | |
| quiquell | ykarel: do you know why this is wrong ? https://code.engineering.redhat.com/gerrit/#/c/164779/ | 12:44 |
| *** jpena is now known as jpena|lunch | 12:46 | |
| quiquell | ykarel: na will parent linters job | 12:47 |
| *** saneax has joined #oooq | 12:47 | |
| weshay|rover | panda|ruck well done w/ xfsprogs :) | 12:54 |
| weshay|rover | it's weird that xfs progs is installed on my standalone reproducer instance.. | 12:54 |
| weshay|rover | and it doesn't get installed in ovb | 12:55 |
| panda|ruck | weshay|rover: yatin arrived to the same conclusion before me diffing the rpm-lists | 12:56 |
| panda|ruck | weshay|rover: rfolco|rucker is here, we're going to switch now, I'll be rover. | 12:56 |
| weshay|rover | panda|ruck we must install it during the libvirt process in tq | 12:57 |
| rfolco|rucker | panda|ruck, o/ | 12:57 |
| *** rfolco|rucker is now known as rfolco|ruck | 12:57 | |
| weshay|rover | it's not in the yum.log of my singlenode.. just lists the update | 12:57 |
| *** panda|ruck is now known as panda|rover | 12:57 | |
| weshay|rover | panda|ruck anyway.. nice catch man | 12:57 |
| *** rlandy has joined #oooq | 13:01 | |
| weshay|rover | rlandy I moved the mtg up :( | 13:01 |
| *** udesale has quit IRC | 13:02 | |
| *** udesale has joined #oooq | 13:08 | |
| zbr | https://review.rdoproject.org/r/#/c/19151/ - should be safe to merge (adds f28 scen jobs) | 13:13 |
| *** dsneddon_ has joined #oooq | 13:14 | |
| *** ykarel_ has joined #oooq | 13:14 | |
| *** ykarel has quit IRC | 13:17 | |
| quiquell | rlandy: linting with tox at tripleo-ci-internal-config https://code.engineering.redhat.com/gerrit/#/c/164770/ | 13:18 |
| *** dsneddon_ has quit IRC | 13:19 | |
| *** amoralej|lunch is now known as amoralej | 13:21 | |
| *** ykarel_ is now known as ykarel | 13:21 | |
| *** fmount- has joined #oooq | 13:29 | |
| *** fmount has quit IRC | 13:29 | |
| marios | 14:33 < quiquell> marios: | 13:33 |
| marios | 200~http://logs.openstack.org/48/641348/13/check/tripleo-ci-centos-7-undercloud-containers/f96f4b9/job-output.tx | 13:33 |
| marios | t.gz#_2019-03-07_12_18_07_372862 | 13:33 |
| marios | panda|rover: ^^ | 13:33 |
| marios | panda|rover: this is the retag review | 13:33 |
| *** fmount- has quit IRC | 13:33 | |
| marios | panda|rover: and it also blocks promotions cos containers build | 13:33 |
| quiquell | rlandy: also this for jobs https://code.engineering.redhat.com/gerrit/#/c/164785/ | 13:33 |
| quiquell | marios: so good :-(, ok | 13:36 |
| panda|rover | marios: it's the know error | 13:37 |
| panda|rover | marios: guess this should wait for promotion at this point | 13:37 |
| *** fmount has joined #oooq | 13:38 | |
| marios | https://success.docker.com/article/images-tagging-vs-digests | 13:38 |
| marios | https://stackoverflow.com/questions/38072624/docker-different-digest-when-push-same-images-with-different-tags | 13:39 |
| marios | weshay|rover: panda|rover quiquell the thing i just spoke about ^ | 13:39 |
| panda|rover | marios: this is the bug for your failure https://bugs.launchpad.net/tripleo/+bug/1818538 | 13:46 |
| openstack | Launchpad bug 1818538 in tripleo "All OVB jobs in master periodic pipeline fail to install the undercloud while trying to create the ctlplane network with 503 service unavailable on neutron" [Critical,Fix released] - Assigned to Gabriele Cerami (gcerami) | 13:46 |
| *** holser|burger is now known as holser_ | 13:46 | |
| panda|rover | marios: checking if this needs promotion to get in checks | 13:47 |
| marios | examples here " http://pastebin.test.redhat.com/733190 regarding the tags vs digest fyi weshay|rover panda|rover quiquell (even though you dont care any more) | 13:47 |
| marios | panda|rover: thanks panda|rover | 13:47 |
| quiquell | marios: who are you | 13:47 |
| marios | quiquell: haha | 13:47 |
| rlandy | quiquell: looking at reviews for dlrn ... | 13:48 |
| quiquell | rlandy: want to sync ? I have also move a little thins at config and job projects | 13:48 |
| rlandy | ant harm in merging ... review.rdoproject.org/r/19030 - containers-builds report to DLRN | 13:48 |
| rlandy | review.rdoproject.org/r/#/c/19067 - DLRN trigger script | 13:48 |
| rlandy | quiquell: sure - let's close this out | 13:48 |
| marios | panda|rover: weshay|rover i mean, really it makes sense since we're doing something 'irregular' by wanting to tag the same image with >1 thing | 13:48 |
| rlandy | quiquell: joining my blue | 13:49 |
| *** ccamacho has quit IRC | 13:49 | |
| quiquell | rlandy: going there | 13:49 |
| *** jpena|lunch is now known as jpena | 13:50 | |
| *** dsneddon_ has joined #oooq | 13:52 | |
| *** dsneddon_ has quit IRC | 13:57 | |
| panda|rover | marios: yes, the bug needs to wait for a promotion | 13:57 |
| marios | panda|rover: so we have catch 22? | 13:57 |
| weshay|rover | zbr -1 on https://review.rdoproject.org/r/#/c/19151/ | 13:58 |
| marios | panda|rover: the bug needs promotion. the patch needs the bug | 13:58 |
| weshay|rover | marios ^ | 13:58 |
| marios | panda|rover: promotion needs the patch | 13:58 |
| marios | weshay|rover: ack thanks didn't review those yet | 13:58 |
| panda|rover | marios: usually at this point we force a promotion with what we already have | 13:59 |
| arxcruz | sshnaidm: hi, on artcl_exclude_list can I add wildcards ? | 14:02 |
| arxcruz | like /home/{{ undercloud_user }}/tempest/etc/cirros* ? | 14:02 |
| rlandy | quiquell: https://code.engineering.redhat.com/gerrit/#/c/164785 looks good - merge when you are ready | 14:07 |
| quiquell | rlandy: updated no projects.yaml changes there https://code.engineering.redhat.com/gerrit/#/c/164227/ | 14:07 |
| quiquell | rlandy: the linting at config https://code.engineering.redhat.com/gerrit/#/c/164770/ | 14:08 |
| rlandy | quiquell: https://code.engineering.redhat.com/gerrit/#/c/164227/ +2'ed - let's merge when jobs complete | 14:08 |
| rlandy | quiquell: https://code.engineering.redhat.com/gerrit/#/c/164770 looks good - feel free to merge | 14:09 |
| panda|rover | marios: I completely misunderstood the error in that failed job, try a recheck | 14:09 |
| panda|rover | marios: it should work, I think | 14:09 |
| quiquell | rlandy: for the check DLRN job mayb running at a runc nodset is good option to reduce resources utilization | 14:09 |
| rlandy | quiquell: ugh ... https://code.engineering.redhat.com/gerrit/#/c/164227 can't merge - need to rebase | 14:10 |
| *** dtantsur|bbl is now known as dtantsur | 14:10 | |
| quiquell | rlandy: rebaed | 14:10 |
| marios | panda|rover: well weshay|rover already did | 14:10 |
| quiquell | rlandy: I am forgetting even to write | 14:10 |
| * panda|rover shakes fist | 14:11 | |
| rlandy | cool - will merge when zuul is done | 14:11 |
| weshay|rover | marios it didn't retrigger though | 14:11 |
| marios | https://review.openstack.org/#/c/641348/13 panda|rover zuul reported again | 14:11 |
| marios | didn't it? | 14:11 |
| marios | looks like to me | 14:11 |
| marios | Patch Set 13: recheck | 14:11 |
| marios | 3:15 PM | 14:11 |
| rlandy | quiquell: yep - no reason why not | 14:11 |
| marios | Patch Set 13: Verified-1 | 14:11 |
| marios | 4:02 PM | 14:11 |
| marios | oh thats too soon | 14:12 |
| * marios confused | 14:12 | |
| marios | and cant see it in zuul queue | 14:13 |
| quiquell | rlandy: arg -1 on linters :-) | 14:13 |
| marios | panda|rover: weshay|rover gonna try another recheck then | 14:13 |
| weshay|rover | aye | 14:13 |
| rlandy | quiquell: lol - poetic justice | 14:13 |
| quiquell | rlandy: ok let me fix | 14:13 |
| quiquell | i know i know | 14:13 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010 (4 more messages) | 14:14 |
| panda|rover | marios: yes, jobs failing here http://logs.openstack.org/48/641348/13/check/tripleo-ci-centos-7-undercloud-containers/f96f4b9/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2019-03-07_12_05_06 are hitting an intermittent bug. We don't have even root cause for it right now. https://bugs.launchpad.net/tripleo/+bug/1815576 | 14:15 |
| openstack | Launchpad bug 1815576 in tripleo "Intermitent failures at tripleo-container-image-prepare at gates with MANIFEST_BLOB_UNKNOWN" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 14:15 |
| quiquell | rlandy: all good now https://code.engineering.redhat.com/gerrit/164227 | 14:15 |
| *** skramaja has quit IRC | 14:18 | |
| rlandy | quiquell: hmmm yamllint.................................................................Failed | 14:18 |
| rlandy | still | 14:18 |
| quiquell | rlandy: humm pre-commit using deltas not working fine | 14:19 |
| quiquell | damn it | 14:19 |
| rlandy | zuul.d/jobs.yaml:45:81: [error] line too long (89 > 80 characters) (line-length) | 14:19 |
| rlandy | pikcy picky | 14:19 |
| quiquell | ok fixed | 14:19 |
| quiquell | sorry | 14:19 |
| rlandy | we're going to regret this linter thing, aren't we? | 14:20 |
| quiquell | well a little of it is not that bad | 14:20 |
| quiquell | ansible-lint is powerful tool | 14:21 |
| quiquell | rlandy: we can +w now https://code.engineering.redhat.com/gerrit/#/c/164227/ | 14:22 |
| rlandy | quiquell: done | 14:22 |
| quiquell | cool | 14:22 |
| quiquell | so that's all | 14:23 |
| rlandy | quiquell: now - go! and enjoy | 14:23 |
| quiquell | \o/ !! | 14:23 |
| quiquell | first calendar then go | 14:23 |
| rlandy | congrats | 14:23 |
| quiquell | thanks | 14:23 |
| panda|rover | quiquell: wait! | 14:24 |
| panda|rover | quiquell: mmmhhh | 14:24 |
| panda|rover | quiquell: can you .... mmhhhh.. check ... | 14:24 |
| panda|rover | quiquell: ... something .... like .. | 14:24 |
| panda|rover | quiquell: mmmm, here somewhere ? | 14:24 |
| quiquell | panda|rover: send me a bottle with a message | 14:25 |
| quiquell | ok guys see you in a pair of weeks | 14:25 |
| *** quiquell has quit IRC | 14:26 | |
| arxcruz | sshnaidm: ? | 14:26 |
| arxcruz | sshnaidm: nevermind, it can be used | 14:27 |
| panda|rover | he actually did it, he logged off, not jsut a change in the nick. Completely disconnected | 14:27 |
| *** dsneddon_ has joined #oooq | 14:29 | |
| *** weshay|rover is now known as weshay | 14:31 | |
| *** dsneddon_ has quit IRC | 14:34 | |
| *** vinaykns has joined #oooq | 14:39 | |
| zbr | weshay|rover: not sure if I am going towards right direction, https://review.openstack.org/#/c/641685/1 | 14:40 |
| weshay | zbr that seems right to me, panda|rover can you peek at that ^ | 14:41 |
| weshay | zbr not sure what to do about ceph | 14:42 |
| * weshay asks in #tripleo | 14:42 | |
| zbr | weshay: cannot do anything about ceph, there is no fedora image published | 14:42 |
| panda|rover | uh-oh | 14:43 |
| panda|rover | ceph image is taken from ceph repo | 14:43 |
| panda|rover | they need to build an image for fedora | 14:44 |
| panda|rover | better ask ceph guys about it | 14:46 |
| panda|rover | fultonj: do you know if there's plan to build a ceph container for fedora ? | 14:47 |
| zbr | panda|rover: let me guess,... they are in a big rush doing it,... | 14:47 |
| panda|rover | zbr: I bet. But if they don't ... what's the impact ? jobs that don't test ceph will ignore taht is missing , or everything will complain anyway ? | 14:50 |
| panda|rover | ceph is the only container that we take from external registry ? | 14:50 |
| panda|rover | we have a bunch | 14:56 |
| panda|rover | I guess we'll not be building them in fedora at all, and just use the centos ones | 14:56 |
| panda|rover | or whatever the original repo us using | 14:57 |
| panda|rover | 208 - imagename: docker.io/ceph/daemon:v3.2.1-stable-3.2-luminous-centos-7-x86_64 | 14:57 |
| panda|rover | 209 image_source: ceph | 14:57 |
| panda|rover | the rest are from openshiftr | 14:57 |
| *** dsneddon_ has joined #oooq | 15:01 | |
| *** dsneddon_ has quit IRC | 15:05 | |
| chem | marios: hey, been a long time. I'm wondering what is the current status of the ovb jobs for master, as they seems broken badly with 3ctl : The 'hacluster_pwd' hiera key is undefined... | 15:09 |
| panda|rover | chem: https://bugs.launchpad.net/tripleo/+bug/1818994 | 15:12 |
| openstack | Launchpad bug 1818994 in tripleo "ovb jobs broken because pacemaker is unconfigured" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 15:12 |
| panda|rover | chem: proposed fix is in https://review.openstack.org/641660 | 15:12 |
| chem | panda|rover: thanks a lot | 15:13 |
| panda|rover | chem: for the future, ask ruck and rovers about failures, they have usually the latest informations as they're what they eat for breakfast | 15:14 |
| marios | o/ chem panda|rover and rfolco|ruck are watching the jobs this sprint but personally not aware of sthing there | 15:15 |
| marios | chem: do you miss me terribly? | 15:16 |
| chem | panda|rover: ruck and rovers ack, I definitively miss the reference here, but ruck and rover is who I will ping next time | 15:16 |
| marios | chem: yeah we rotate each sprint (3 weeks) | 15:16 |
| marios | chem: so it isn't tiring | 15:16 |
| marios | and use the irc nick so people know who to harrass first | 15:16 |
| marios | :D | 15:17 |
| chem | marios: terribly is definitively the word. | 15:17 |
| marios | but anyone is acceptable | 15:17 |
| marios | chem: so you miss me terribly or terribly miss me | 15:17 |
| marios | :D | 15:17 |
| chem | marios: that's sound the same to me, so both | 15:17 |
| panda|rover | marios: I would hardly miss you, and that's terrible. | 15:17 |
| marios | chem: sounds good ship it | 15:17 |
| marios | :( what did i ever do to you guys | 15:18 |
| chem | that's how your upgrade | 15:18 |
| panda|rover | chem: anyway, anyone that has |ruck or |rover in his/her/their nick | 15:18 |
| chem | ack, and thanks. | 15:19 |
| *** ykarel is now known as ykarel|away | 15:29 | |
| *** dsneddon_ has joined #oooq | 15:33 | |
| fultonj | panda|rover: there's a cent7-based ceph-nautilus container which runs on fedora29 in the ceph container CI. can you use that on fedora28? | 15:34 |
| panda|rover | fultonj: nope, all the wrong cominations there | 15:37 |
| panda|rover | fultonj: tbh I'm not entirely sure we need all the containers to have fedora28 when we are testing it | 15:37 |
| fultonj | 10:37 +panda|rover: fultonj: nope, all the wrong cominations there | 15:37 |
| fultonj | why all the wrong combintations? | 15:37 |
| fultonj | panda|rover: it depends on what the test is trying to achieve | 15:38 |
| panda|rover | we need to test fedora28, centos7 is not ok, fedora29 is not ok | 15:38 |
| panda|rover | fultonj: yes I was thinking | 15:38 |
| fultonj | panda|rover: that' misses the point | 15:38 |
| fultonj | if you do a standalone deployment and you want it to work with ceph and there's ceph containers running in this environment and they work, why doyou care waht's inside of them? | 15:38 |
| panda|rover | fultonj: it doesn't change much for us unsless ceph uses something to be built that we could potentially change in our reviews. | 15:39 |
| fultonj | i.e. "it doesn't change much for us unless ceph doesn't work" | 15:40 |
| fultonj | right? | 15:40 |
| arxcruz | sorry, rfolco|ruck weshay is tempest.api.network.test_ports.PortsIpV6TestJSON.test_update_port_with_two_security_groups_and_extra_attributes failing constantly? I am not being able to reproduce it, tests are passing | 15:40 |
| fultonj | unless "ceph uses something to be built that we could potentially change in our reviews" | 15:40 |
| fultonj | panda|rover: i'll get ceph containers working in the new environment that you build | 15:40 |
| fultonj | if they run on a f28 host w/ py3 and your other env constraints, then i don't see why you need to care about what's inside the working container | 15:41 |
| fultonj | cent7-based who cares | 15:41 |
| fultonj | works on f29, then that makes it more likely it will work on f28 | 15:42 |
| fultonj | it works on rhel8 beta | 15:42 |
| panda|rover | fultonj: perfect, ok. We'll probably ping you all to check that the fedora jobs are running correctly even if they're passing. When we'll reach that point that is. | 15:43 |
| marios | rlandy: ./reproducer-zuul-based-quickstart.sh: line 309: syntax error: unexpected end of file | 15:44 |
| rfolco|ruck | arxcruz, where do you see sec groups test passing ? | 15:44 |
| rfolco|ruck | arxcruz, show me pls | 15:44 |
| fultonj | panda|rover: thank you | 15:44 |
| fultonj | that sounds good | 15:44 |
| *** jfrancoa has quit IRC | 15:44 | |
| panda|rover | fultonj: thanks for the clarification | 15:45 |
| fultonj | panda|rover: https://review.openstack.org/#/c/562213/16/ci/environments/scenario001-standalone.yaml | 15:47 |
| *** dsneddon_ has quit IRC | 15:47 | |
| fultonj | panda|rover: docker.io/ceph/daemon:v4.0.0beta-nautilus | 15:47 |
| fultonj | with ceph-ansible 4 beta from http://cbs.centos.org/repos/storage7-ceph-nautilus-testing/x86_64/os/ | 15:48 |
| fultonj | should work | 15:48 |
| fultonj | if it doesn't then ping me | 15:48 |
| arxcruz | rfolco|ruck: on my local env | 15:48 |
| fultonj | panda|rover: also https://review.rdoproject.org/r/#/c/18721/ | 15:48 |
| arxcruz | rfolco|ruck: if you want i can gave you access | 15:49 |
| arxcruz | rfolco|ruck: tempest.api.compute.admin.test_quotas_negative.QuotasAdminNegativeTest.test_create_server_when_memory_quota_is_full is also passing | 15:49 |
| arxcruz | on my reproduced env | 15:49 |
| rfolco|ruck | arxcruz, dunno, perhaps it got new tempest container? | 15:50 |
| marios | sshnaidm: rlandy panda|rover weshay rfolco|ruck lets merge this nit? https://review.openstack.org/#/c/641701/ | 15:58 |
| marios | (issue 2 at https://tree.taiga.io/project/tripleo-ci-board/task/766 ) | 15:59 |
| marios | if anyone knows what fixed issue 1 (the fail early if virt) i'd be glad to include a pointer to the fix there in taiga too | 15:59 |
| marios | folks said in scrum in should be fixed | 15:59 |
| weshay | marios workflowed | 15:59 |
| weshay | thanks | 15:59 |
| marios | weshay: cool thx | 16:00 |
| *** dsneddon_ has joined #oooq | 16:00 | |
| marios | [Errno 2] No such file or directory: '/home/marios/.local/bin/ansible-config'\n\n"} | 16:00 |
| marios | urgh new one | 16:01 |
| *** kopecmartin is now known as kopecmartin|off | 16:01 | |
| *** udesale has quit IRC | 16:01 | |
| *** ratailor has joined #oooq | 16:02 | |
| weshay | zbr can you put https://review.rdoproject.org/r/#/c/19155/ as a depends on https://review.rdoproject.org/r/#/c/19155/ and retrigger? | 16:05 |
| weshay | or I can if you are gone | 16:05 |
| weshay | marios fyi ^ | 16:06 |
| weshay | marios can you give me a link to the job you are pulling the reproducer from | 16:06 |
| marios | weshay: sure its on the taiga see issue 2 https://tree.taiga.io/project/tripleo-ci-board/task/766 | 16:07 |
| marios | wget logs.openstack.org/98/604298/265/check/tripleo-ci-centos-7-scenario001-standalone/d34e9b1/logs/reproducer-zuul-based-quickstart.tar | 16:07 |
| marios | weshay: master gate check at https://review.openstack.org/#/c/604298/ | 16:07 |
| weshay | marios k.. and just so I'm testing the same thing | 16:08 |
| weshay | which os centos or fedora for the box you are triggering from | 16:08 |
| marios | weshay: this is a beaker centos box | 16:08 |
| marios | weshay: non virt | 16:08 |
| weshay | centos k | 16:08 |
| * weshay reloads my box | 16:09 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010 (4 more messages) | 16:14 |
| weshay | marios k.. reloaded and ready.. what was ur command to invoke | 16:21 |
| marios | weshay: its all in taiga | 16:23 |
| weshay | ah duh | 16:23 |
| weshay | thanks | 16:23 |
| marios | weshay: [marios@nec-em19 ~]$ ./reproducer-zuul-based-quickstart.sh --libvirt --workspace /home/marios/WORKSPACE --force-post-failure | 16:23 |
| weshay | aye | 16:23 |
| marios | weshay: yeah its under issue 2 trace | 16:23 |
| marios | weshay: for issue 3 i'm not sure if cos its a rerun | 16:23 |
| marios | weshay: dependency issues | 16:23 |
| marios | weshay: so have just asked for the box to be reprovisioned | 16:24 |
| marios | weshay: and i'll try it aagain tomorrow | 16:24 |
| *** hrybacki has joined #oooq | 16:26 | |
| hrybacki | o/ where is the latest set of docs for deploying w/ OOOQ against OVB (RDO Cloud)? I'm catching a 404 from the docs page: https://docs.openstack.org/tripleo-quickstart/latest/devmode-ovb.html | 16:26 |
| *** ratailor has quit IRC | 16:26 | |
| weshay | running now | 16:27 |
| weshay | hrybacki looking | 16:28 |
| weshay | hrybacki rdo cloud is fooked atm.. I'lll get the doc updated and send out an all clear | 16:29 |
| hrybacki | weshay: poop. Thanks for digging into that :) | 16:30 |
| weshay | marios once I add the "fi" in.. I'm in tq libvirt roles already | 16:30 |
| marios | weshay: ack yeah i only hit issue 3 after i manually fixed the nit from issue 2 so it definitely goes further | 16:31 |
| marios | weshay: maybe issue 3 is just from unclean system | 16:31 |
| marios | cos rerun | 16:31 |
| marios | hopefully | 16:31 |
| weshay | marios /me running w/ https://paste.fedoraproject.org/paste/~La8cYZg6QVjl-HPnjkTeQ | 16:31 |
| marios | weshay: ack | 16:32 |
| weshay | ssh GhuRSTUcYZfegkF6OEl5dHyd0@ny2.tmate.io | 16:42 |
| weshay | dan it | 16:42 |
| weshay | stupid buffer | 16:42 |
| weshay | TASK [ansible-role-tripleo-ci-reproducer : Stop up zuul and friends] **************************************************************************************** | 16:42 |
| weshay | task path: /home/weshayutin/WORKSPACE/roles/ansible-role-tripleo-ci-reproducer/tasks/start.yaml:10 | 16:42 |
| weshay | fatal: [localhost]: FAILED! => {"changed": false, "msg": "Error connecting: Error while fetching server API version: ('Connection aborted.', error(13, 'Permission denied'))"} | 16:42 |
| weshay | marios fyi I just hit ^ | 16:42 |
| marios | weshay: did you upload keys | 16:42 |
| marios | weshay: to gerrit | 16:42 |
| marios | weshay: and rdo gerrit | 16:42 |
| weshay | aye | 16:43 |
| * marios out | 16:47 | |
| marios | ttyl folks will try continue tomorrow weshay | 16:47 |
| marios | with clean centos | 16:48 |
| weshay | l8r | 16:48 |
| weshay | marios worked the second time | 16:52 |
| marios | weshay: cool thanks | 16:52 |
| * weshay thinks we need to put some effort into making this more resiliant to errors | 16:52 | |
| marios | weshay: also thanks for +A on the retag panda|rover says we need to manual promote for theat | 16:52 |
| marios | anyway | 16:52 |
| marios | me actually going now bai | 16:52 |
| weshay | l8r | 16:52 |
| weshay | rfolco|ruck ur job has started | 16:52 |
| weshay | can you screenshare your zuul? | 16:53 |
| rfolco|ruck | weshay, yep, bj ? | 16:53 |
| weshay | https://bluejeans.com/u/whayutin/ | 16:53 |
| weshay | rfolco|ruck ok.. too much for your laptop | 16:55 |
| weshay | I'll drop | 16:55 |
| *** dsneddon_ has quit IRC | 17:03 | |
| weshay | rlandy have you seen this error? | 17:09 |
| weshay | y | ERROR: Item: standalone_custom_env_files | 17:09 |
| weshay | 2019-03-07 17:00:43.187133 | primary | { | 17:09 |
| weshay | 2019-03-07 17:00:43.187179 | primary | "item": "standalone_custom_env_files", | 17:09 |
| weshay | 2019-03-07 17:00:43.187215 | primary | "msg": "ERROR: standalone_custom_env_files is not overridable." | 17:09 |
| weshay | 2019-03-07 17:00:43.187248 | primary | } | 17:09 |
| weshay | in LOOP [run-test : Check overridable settings] | 17:09 |
| *** bogdando has quit IRC | 17:09 | |
| rlandy | weshay: from featureset_ovveride | 17:09 |
| rlandy | override? | 17:09 |
| rlandy | yes | 17:10 |
| rlandy | if I picked a setting now allowed | 17:10 |
| * rlandy checks allowable settings | 17:10 | |
| rlandy | weshay: https://github.com/openstack-infra/tripleo-ci/blob/master/roles/run-test/tasks/main.yaml#L8 | 17:13 |
| rlandy | 'standalone_environment_files' | 17:13 |
| rlandy | ^^ looking for that? | 17:13 |
| * weshay looks | 17:13 | |
| weshay | rlandy aye thanks | 17:14 |
| weshay | rfolco|ruck https://tree.taiga.io/project/tripleo-ci-board/task/834?kanban-status=1447275 | 17:24 |
| *** saneax has quit IRC | 17:28 | |
| *** jpena is now known as jpena|away | 17:30 | |
| *** dtantsur is now known as dtantsur|afk | 17:34 | |
| *** dsneddon_ has joined #oooq | 17:40 | |
| *** ykarel|away has quit IRC | 17:43 | |
| *** dsneddon_ has quit IRC | 17:45 | |
| weshay | rlandy looks like someone forgot to update the allowed settings | 17:47 |
| weshay | https://s.nimbusweb.me/share/2637876/ax0pgvqx5mfy0vkag1r9 | 17:47 |
| weshay | https://review.openstack.org/#/c/641737/ | 17:47 |
| *** sshnaidm is now known as sshnaidm|off | 17:47 | |
| weshay | panda|rover rfolco|ruck https://review.openstack.org/#/c/641348/ is in the gate | 17:49 |
| *** gkadam__ has quit IRC | 17:53 | |
| zbr | weshay: i am back. i have question re https://logs.rdoproject.org/55/19155/3/check/periodic-tripleo-ci-fedora-28-scenario003-standalone-master/df537e3/job-output.txt.gz#_2019-03-07_17_15_25_444350 | 17:54 |
| zbr | isnt this a bug? | 17:54 |
| weshay | zbr hey | 17:57 |
| * weshay looks | 17:57 | |
| zbr | weshay: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/build-test-packages/tasks/dlrn-build.yml#L45 may help | 17:57 |
| weshay | not sure i'm in context yet | 17:57 |
| * weshay followign too many things | 17:57 | |
| weshay | refering to the fs override/ | 17:58 |
| weshay | ? | 17:58 |
| *** chem has quit IRC | 17:58 | |
| weshay | zbr we need to figure out how to run w/ fedora containers | 17:58 |
| * weshay looks at the instructions | 17:59 | |
| *** chem has joined #oooq | 17:59 | |
| weshay | zbr http://codesearch.openstack.org/?q=docker_prep_prefix%3A&i=nope&files=&repos= | 18:02 |
| weshay | that var is never used :)))) | 18:02 |
| *** irclogbot_0 has joined #oooq | 18:02 | |
| zbr | weshay: ouch... and tere are people still finding linting a waste of time | 18:02 |
| weshay | heh | 18:04 |
| zbr | weshay: now the question is if we can/need to use centos-binary- prefix or not. | 18:04 |
| *** derekh has quit IRC | 18:04 | |
| weshay | zbr we do | 18:04 |
| weshay | but /me needs to go look around | 18:04 |
| weshay | zbr ah.. codesearch lies | 18:05 |
| weshay | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2#L48 | 18:05 |
| weshay | zbr however this is only used in overcloud deployments | 18:06 |
| weshay | zbr here is part of the problem | 18:06 |
| weshay | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/standalone/templates/standalone-container-prep.sh.j2 | 18:06 |
| weshay | zbr you need to update that | 18:07 |
| weshay | w/ docker_prep_prefix | 18:07 |
| weshay | see that? | 18:07 |
| zbr | yes, i will look in to this as soon i deal with the duplicate. | 18:08 |
| weshay | duplciate? | 18:08 |
| weshay | duplicate? | 18:08 |
| zbr | the duplicate dic key, i don't know why it was not found by the linter | 18:08 |
| weshay | zbr which key? | 18:09 |
| *** zbr|ssbarnea has joined #oooq | 18:10 | |
| *** zbr has quit IRC | 18:13 | |
| *** dsneddon_ has joined #oooq | 18:14 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, (4 more messages) | 18:14 |
| weshay | rlandy do you have a box w/ an undercloud running? | 18:18 |
| * weshay needs to check options on a command | 18:18 | |
| rlandy | weshay, yes - bm | 18:18 |
| weshay | may I login? | 18:18 |
| rlandy | weshay, and am fixing periodic depends | 18:18 |
| rlandy | weshay: sure - my undercloud is your undercloud | 18:18 |
| weshay | as the ancients once said | 18:19 |
| *** dsneddon_ has quit IRC | 18:19 | |
| weshay | zbr|ssbarnea I am fucking blind | 18:20 |
| rlandy | weshay: reminder undercloud is on vm there | 18:20 |
| weshay | lolz | 18:20 |
| weshay | thanks | 18:20 |
| weshay | zbr|ssbarnea we still need to change a thing or two though | 18:20 |
| * weshay can't believe that | 18:21 | |
| weshay | linters++ | 18:21 |
| weshay | linters++ | 18:21 |
| weshay | linters++ | 18:21 |
| weshay | rlandy ? | 18:21 |
| weshay | ya.. I just need the undercloud | 18:22 |
| zbr|ssbarnea | i added the prefix on https://review.openstack.org/#/c/641685/2 but other than this I do not know yet. i need to go out and grab same beer.... | 18:24 |
| weshay | zbr|ssbarnea I know what else to change | 18:24 |
| weshay | I just need an undercloud | 18:24 |
| weshay | rlandy found one | 18:28 |
| weshay | nvrmind | 18:28 |
| rlandy | weshay:?? | 18:28 |
| rlandy | oh I found an undercloud | 18:28 |
| weshay | ya.. had one hiding thanks | 18:30 |
| weshay | zbr|ssbarnea if you want me to tmate you let me know | 18:30 |
| weshay | bah.. I need help | 18:42 |
| weshay | rlandy you have a minute? | 18:42 |
| rlandy | weshay: ack | 18:42 |
| weshay | rlandy k.. /me goes to blue | 18:42 |
| rlandy | joining | 18:42 |
| *** dsneddon_ has joined #oooq | 18:45 | |
| *** amoralej is now known as amoralej|off | 18:51 | |
| *** holser_ has quit IRC | 19:10 | |
| weshay | zbr|ssbarnea fyi.. I'm updating your review https://review.openstack.org/#/c/641685/2 | 19:11 |
| weshay | rlandy this is the magic https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/standalone/tasks/main.yml#L37-L68 | 19:20 |
| weshay | not sure why we have the sed in that case | 19:20 |
| weshay | I need to sick zbr|ssbarnea on this | 19:21 |
| weshay | lolz | 19:21 |
| weshay | I can see him laughing now | 19:21 |
| weshay | WHO WROTE THIS.. ..lolz | 19:21 |
| rlandy | looking | 19:21 |
| rlandy | yeah - we looked at this code | 19:24 |
| weshay | k.. I don't see the need for both the sed lines.. and this yaml merge dict | 19:24 |
| weshay | probably just need yaml merge dict | 19:24 |
| weshay | but anyway.. going to tool around w/ it.. alex wants to try default | 19:25 |
| weshay | and not what is in mojo | 19:25 |
| weshay | but doesn't know for sure either | 19:25 |
| weshay | :) | 19:25 |
| rlandy | I gt why he wants to try default | 19:28 |
| rlandy | although sed'ing is never stab;e | 19:28 |
| *** jpena|away is now known as jpena|off | 19:32 | |
| weshay | woot .. got it | 19:45 |
| rlandy | wow | 19:46 |
| rlandy | what approach? | 19:46 |
| weshay | hrm.. I really have to do both.. because this yaml merge only happens on container updates | 19:47 |
| weshay | which we should not assume | 19:47 |
| weshay | but I could convert set to this aswell | 19:47 |
| weshay | rlandy in tmate | 19:47 |
| rlandy | eek closed that rejoining | 19:48 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo- (4 more messages) | 20:14 |
| rfolco|ruck | weshay, no easy way to fix user group issue. Maybe a re-design on reproducer to make it run from a 3rd user (e.g. launcher). There is no way to update group permissions without logging out/in. | 20:21 |
| weshay | rfolco|ruck you have not made it clear what the issue is | 20:21 |
| weshay | rfolco|ruck ugh | 20:22 |
| weshay | yes yes there is | 20:22 |
| weshay | you just need to run the script twice | 20:22 |
| weshay | as the warning states | 20:22 |
| weshay | rlandy fixed that | 20:22 |
| weshay | rfolco|ruck if the warning is not clear.. please update the message | 20:22 |
| weshay | the script actually boots you out of the shell | 20:23 |
| weshay | which is why you have no command history when you run it a second time | 20:23 |
| weshay | rfolco|ruck make sense? | 20:23 |
| rfolco|ruck | weshay, but even running exec (which creates a new session), it kills my parent process where I started my repro script. | 20:23 |
| rfolco|ruck | re-running is not a fix | 20:24 |
| weshay | rfolco|ruck this line https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/create-zuul-based-reproducer/templates/reproducer-zuul-based-quickstart.sh.j2#L218 | 20:24 |
| rfolco|ruck | it is a hack | 20:24 |
| weshay | blue | 20:24 |
| rfolco|ruck | you never believe me | 20:24 |
| rfolco|ruck | ok | 20:24 |
| rlandy | weshay: fyi ... https://code.engineering.redhat.com/gerrit/164816 Add rocky periodic job | 20:38 |
| rlandy | using envE so we will testing new hardware | 20:38 |
| weshay | nice | 20:39 |
| *** vinaykns has quit IRC | 20:40 | |
| *** vinaykns has joined #oooq | 20:42 | |
| weshay | rlandy will want your opinion in a few on a change | 20:47 |
| rlandy | sec | 20:47 |
| rlandy | just trying to figure out why it can't find the job I just defined | 20:47 |
| rlandy | ugh - why did he define projects in a job repo???? | 20:49 |
| weshay | https://review.openstack.org/#/c/641685/ | 20:54 |
| weshay | rlandy need help? | 20:54 |
| rlandy | maybe | 21:02 |
| rlandy | weshay: stupid linters | 21:07 |
| weshay | heh | 21:08 |
| rlandy | quique moved stuff to new line sto avoid linter complaining about line length | 21:08 |
| rlandy | now all job names are messed up | 21:08 |
| rlandy | and he removed all testing of real jobs other than linters | 21:08 |
| rlandy | so nothing ever failed | 21:08 |
| rlandy | so now we have a probme | 21:08 |
| rlandy | problem | 21:08 |
| rlandy | we keep these over-achiever linters or we change our job naming convention | 21:09 |
| rlandy | idiotic | 21:09 |
| rlandy | weshay: ok - what review do you want help with? | 21:10 |
| rlandy | https://review.openstack.org/#/c/641685/ | 21:10 |
| weshay | rlandy sorry https://review.openstack.org/#/c/641797/1 | 21:11 |
| *** holser_ has joined #oooq | 21:15 | |
| weshay | rlandy basically wondering if the ansible yaml dict update is better than the sed | 21:16 |
| weshay | not sure if it is, but I like just doing it one way | 21:16 |
| weshay | instead of updating it two diff ways | 21:16 |
| rlandy | weshay: sorry - everything downstream is broken now | 21:16 |
| * rlandy looks | 21:16 | |
| * weshay is happy to help there if needed | 21:17 | |
| rlandy | weshay: yes - I think this is cleaner than the sed | 21:18 |
| weshay | k.. | 21:18 |
| rlandy | the sed is a mess | 21:20 |
| rlandy | weshay: do you want to talk about anything else? | 21:32 |
| weshay | that's all.. just was wondering if ansible > sed | 21:32 |
| rlandy | absolutely | 21:40 |
| *** rlandy has quit IRC | 21:53 | |
| *** rlandy has joined #oooq | 22:02 | |
| rlandy | sorry - computer crash | 22:07 |
| weshay | rlandy for periodic jobs in rdo | 22:08 |
| weshay | http://logs.rdoproject.org/75/19175/4/check/periodic-tripleo-ci-fedora-28-scenario001-standalone-master/ad0e9bf/logs/undercloud/home/zuul/containers-prepare-parameters.yaml.txt.gz | 22:08 |
| weshay | the registry should be rdo's registry I would think | 22:09 |
| rlandy | name_prefix: fedora-binary- | 22:09 |
| rlandy | ^^ that worked | 22:09 |
| weshay | yup :) | 22:09 |
| rlandy | weshay: yep - I think so | 22:09 |
| weshay | and tripleo-ci-testing | 22:09 |
| rlandy | that is what we were working with when we hit the fedoar/fedora28 issue | 22:09 |
| rlandy | and it was the rdo reg | 22:09 |
| weshay | rlandy well atm these jobs are trying to hit docker | 22:10 |
| weshay | docker.io | 22:10 |
| rlandy | hmm | 22:10 |
| weshay | I think we set that in the release file? | 22:10 |
| rlandy | openshift_asb_namespace: docker.io/ansibleplaybookbundle | 22:10 |
| rlandy | ^^ see that here | 22:10 |
| rlandy | yeah - it's defaulted | 22:11 |
| weshay | https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/Fedora-28/promotion-testing-hash-master.yml#L4 | 22:11 |
| rlandy | but should be overridden in release | 22:11 |
| weshay | we don't build openshift containers | 22:11 |
| weshay | so docker.io is actually right for that and ceph | 22:11 |
| weshay | 2019-03-07 21:50:04 | requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: http://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8081/registry-1.docker/v2/tripleomaster/fedora-binary-aodh-api/manifests/current-tripleo | 22:11 |
| rlandy | weshay: https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/Fedora-28/promotion-testing-hash-master.yml#L4 | 22:12 |
| weshay | is the error these are hitting | 22:12 |
| weshay | ya.. so I guess this job was not using that | 22:12 |
| * weshay looks | 22:12 | |
| rlandy | let's go back and look at role | 22:12 |
| weshay | --extra-vars @/home/zuul/workspace/.quickstart/config/release/tripleo-ci/Fedora-28/master.yml' | 22:12 |
| weshay | isn't that a toci_quickstart.sh issue? | 22:13 |
| weshay | it's periodic running in check | 22:13 |
| weshay | so /me is not sure | 22:13 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo- (4 more messages) | 22:14 |
| weshay | pipeline: check | 22:14 |
| rlandy | only if it's run in the periodic pipeline | 22:15 |
| weshay | I see | 22:15 |
| rlandy | weshay: you can fake out a periodic pipeline | 22:15 |
| weshay | or maybe it should work and it's just a mirror issue | 22:15 |
| rlandy | like we have done downstream to test | 22:15 |
| weshay | because maybe we do have fedora containers in docker.io | 22:15 |
| weshay | w/ current-tripleo | 22:15 |
| weshay | ? | 22:15 |
| rlandy | ack | 22:15 |
| * weshay does not know | 22:15 | |
| rlandy | I thin so | 22:15 |
| * weshay looks | 22:15 | |
| rlandy | let's check | 22:15 |
| weshay | rlandy don't see any | 22:17 |
| rlandy | weshay: with the squad tag? | 22:18 |
| weshay | that was always pushed to rdo | 22:18 |
| weshay | never to docker | 22:18 |
| rlandy | ok - so then we have never pushed to docker yet | 22:18 |
| rlandy | makes sense if that is only ever run periodic | 22:19 |
| rlandy | weshay: do you want to test pipeline? | 22:19 |
| rlandy | just set periodic to truw | 22:19 |
| rlandy | true | 22:19 |
| weshay | http://logs.openstack.org/97/641797/1/check/tripleo-ci-centos-7-undercloud-containers/bb62b8b/job-output.txt.gz#_2019-03-07_21_08_13_121115 | 22:19 |
| weshay | odd | 22:19 |
| rlandy | you set it to empty | 22:20 |
| weshay | oh | 22:20 |
| weshay | crap | 22:20 |
| *** dsneddon_ is now known as dsneddon | 22:20 | |
| weshay | sorin removed that | 22:20 |
| * weshay wonders where that lives | 22:20 | |
| weshay | I can't read today | 22:20 |
| weshay | I swear | 22:20 |
| weshay | I thought it was dupe | 22:20 |
| rlandy | it was in the log you showed me | 22:20 |
| weshay | ya | 22:20 |
| rlandy | computer had a nervous breakdown so I had to close all that | 22:21 |
| * rlandy looks for it | 22:21 | |
| rlandy | https://logs.rdoproject.org/75/19175/4/check/periodic-tripleo-ci-fedora-28-scenario001-standalone-master/ad0e9bf/logs/undercloud/home/zuul/containers-prepare-parameters.yaml.txt.gz | 22:22 |
| weshay | rlandy https://review.openstack.org/#/c/641797/1..3/roles/extras-common/defaults/main.yml | 22:22 |
| *** tosky has quit IRC | 22:22 | |
| weshay | restored | 22:22 |
| *** vinaykns has quit IRC | 22:22 | |
| rlandy | ack - better | 22:23 |
| weshay | takes a village | 22:24 |
| rlandy | weshay: k - think I got downstream back on its feet - rocky running now ... https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/9f89ee09a6b3491598f6080d49371263?logfile=console.log | 22:24 |
| rlandy | breathe, breathe | 22:24 |
| rlandy | on envE with dlrn | 22:24 |
| *** tosky has joined #oooq | 22:29 | |
| weshay | zbr|ssbarnea did you see what I did? | 22:30 |
| *** holser_ has quit IRC | 22:45 | |
| rlandy | weshay: dlrn reporting is working :) | 22:57 |
| rlandy | 2019-03-07 03:57:51,895 10411 DEBUG promoter periodic-tripleo-ci-centos-7-baremetal-3ctlr_1comp-featureset001-master at 2019-03-04T12:07:14, logs at https://logs.rdoproject.org/59/164359/1/check/periodic-tripleo-ci-centos-7-baremetal-3ctlr_1comp-featureset001-master/c45c114 | 22:57 |
| weshay | NICE | 22:57 |
| weshay | hrm.. that link is not working | 22:58 |
| rlandy | weshay: nah - old job but I found bm in reporting | 23:00 |
| rlandy | http://38.145.34.55/master.log | 23:01 |
| rlandy | you're log link is wrong | 23:03 |
| weshay | rlandy oh | 23:09 |
| weshay | ya.. you want centos/master | 23:09 |
| rlandy | yeah - realized that changed | 23:09 |
| weshay | http://38.145.34.55/centos7_master.log | 23:09 |
| *** rascasoft has quit IRC | 23:11 | |
| rlandy | false alarm - probably the old one | 23:12 |
| rlandy | should report to rocky soon | 23:12 |
| *** irclogbot_0 has quit IRC | 23:26 | |
| *** tosky has quit IRC | 23:34 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!