| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007 (1 more message) | 00:41 |
|---|---|---|
| *** dsneddon has quit IRC | 01:00 | |
| *** dsneddon has joined #oooq | 01:25 | |
| *** dsneddon has quit IRC | 01:32 | |
| *** dsneddon has joined #oooq | 02:00 | |
| *** dsneddon has quit IRC | 02:04 | |
| honza | chandankumar: hey, does this error look familiar to you? it's related to the tempest plugins installed via git feature you wrote... http://logs.openstack.org/56/612756/5/check/tripleo-ci-centos-7-undercloud-selenium/0989f0d/logs/undercloud/home/zuul/tempest.log.txt.gz#_2019-01-24_01_44_22 | 02:22 |
| *** dsneddon has joined #oooq | 02:35 | |
| *** ykarel|away has joined #oooq | 02:35 | |
| *** dsneddon has quit IRC | 02:40 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-quickstart-extras-gate-master-delorean-quick-basic @ (1 more message) | 02:41 |
| *** dsneddon has joined #oooq | 03:14 | |
| *** apetrich has quit IRC | 03:15 | |
| *** dsneddon has quit IRC | 03:18 | |
| *** udesale has joined #oooq | 03:49 | |
| *** rlandy|bbl is now known as rlandy | 03:53 | |
| *** dsneddon has joined #oooq | 03:54 | |
| *** dsneddon has quit IRC | 03:58 | |
| *** skramaja has joined #oooq | 04:13 | |
| *** dsneddon has joined #oooq | 04:33 | |
| *** dsneddon has quit IRC | 04:37 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-quickstart- (2 more messages) | 04:41 |
| *** ratailor has joined #oooq | 04:42 | |
| *** dsneddon has joined #oooq | 05:12 | |
| *** dsneddon has quit IRC | 05:17 | |
| *** udesale has quit IRC | 05:27 | |
| *** udesale has joined #oooq | 05:27 | |
| *** udesale has quit IRC | 05:29 | |
| *** udesale has joined #oooq | 05:29 | |
| *** udesale has quit IRC | 05:30 | |
| *** dsneddon has joined #oooq | 05:47 | |
| *** dsneddon has quit IRC | 05:52 | |
| *** quiquell|off is now known as quiquell | 06:01 | |
| *** udesale has joined #oooq | 06:09 | |
| quiquell | weshay: you may have issues with your ssh keys | 06:10 |
| quiquell | weshay: https://storyboard.openstack.org/#!/story/2004842 | 06:11 |
| quiquell | There is a bug in paramiko | 06:11 |
| *** jbadiapa has joined #oooq | 06:13 | |
| *** ykarel has joined #oooq | 06:20 | |
| *** dsneddon has joined #oooq | 06:21 | |
| *** ykarel|away has quit IRC | 06:22 | |
| *** saneax has joined #oooq | 06:22 | |
| *** ccamacho has quit IRC | 06:26 | |
| *** jfrancoa has joined #oooq | 06:34 | |
| *** dsneddon has quit IRC | 06:36 | |
| quiquell | marios: how goes se reproduction? | 06:39 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-quickstart- (2 more messages) | 06:41 |
| quiquell | sshnaidm|afk: better here | 06:44 |
| sshnaidm|afk | quiquell, ok, will send you credentials | 06:45 |
| quiquell | Ack | 06:46 |
| sshnaidm|afk | quiquell, sent by mail | 06:48 |
| sshnaidm|afk | quiquell, check that password is ok, I was changing it a few times | 06:48 |
| quiquell | Ack | 06:49 |
| marios | o/ quiquell i didn't try launching a job yet will get into that today | 06:50 |
| quiquell | Ack | 06:51 |
| sshnaidm|afk | quiquell, check this out please, it's for ovb: https://review.rdoproject.org/r/#/c/18422/ | 06:51 |
| sshnaidm|afk | quiquell, I copy tripleo jobs from config repo to zuul-config and don't clone rdo config repo at all | 06:52 |
| sshnaidm|afk | quiquell, and remove secrets completely (for now) | 06:52 |
| sshnaidm|afk | quiquell, later we need to encrypt secrets that we get from user - his tenant password etc | 06:52 |
| quiquell | sshnaidm|afk: ack much better approach | 06:53 |
| quiquell | Let's try to merge that today | 06:53 |
| quiquell | Want to fix the host ci first | 06:54 |
| *** dsneddon has joined #oooq | 07:06 | |
| *** ccamacho has joined #oooq | 07:12 | |
| *** apetrich has joined #oooq | 07:12 | |
| *** ykarel_ has joined #oooq | 07:12 | |
| *** ykarel has quit IRC | 07:15 | |
| *** kopecmartin|off is now known as kopecmartin | 07:19 | |
| *** dsneddon has quit IRC | 07:19 | |
| *** udesale has quit IRC | 07:22 | |
| *** quiquell is now known as quiquell|brb | 07:42 | |
| *** udesale has joined #oooq | 07:46 | |
| *** dsneddon has joined #oooq | 07:47 | |
| quiquell|brb | sshnaidm|afk: https://review.rdoproject.org/r/18500 | 07:51 |
| quiquell|brb | sshnaidm|afk: to fix the host issue | 07:51 |
| *** dsneddon has quit IRC | 07:51 | |
| *** ykarel_ is now known as ykarel | 07:55 | |
| *** quiquell|brb is now known as quiquell | 08:18 | |
| *** jfrancoa has quit IRC | 08:23 | |
| *** dsneddon has joined #oooq | 08:27 | |
| *** dsneddon has quit IRC | 08:32 | |
| *** ratailor_ has joined #oooq | 08:32 | |
| *** ratailor has quit IRC | 08:34 | |
| *** udesale has quit IRC | 08:37 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-quickstart- (2 more messages) | 08:41 |
| *** udesale has joined #oooq | 08:42 | |
| *** udesale has quit IRC | 08:42 | |
| *** jpena|off is now known as jpena | 08:42 | |
| *** skramaja_ has joined #oooq | 08:44 | |
| *** skramaja has quit IRC | 08:44 | |
| *** tosky has joined #oooq | 08:48 | |
| *** ykarel is now known as ykarel|lunch | 08:48 | |
| panda | mmhh, zuul added a promote pipeline | 08:50 |
| *** holser_ has joined #oooq | 08:51 | |
| *** jfrancoa has joined #oooq | 08:57 | |
| *** dsneddon has joined #oooq | 09:01 | |
| tosky | (asking again) among the logs of the standalone jobs (like tripleo-ci-centos-7-scenario003-standalone), where can I find the files which contain the generated configuration for each service? | 09:02 |
| ykarel|lunch | tosky, should be same: undercloud/var/logs/config-data/ | 09:04 |
| chandankumar | tosky: https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml | 09:04 |
| chandankumar | ykarel|lunch: correct | 09:04 |
| panda | marios: answered https://review.openstack.org/617617. If everyone's ok I think I'll +W it | 09:04 |
| *** ykarel|lunch is now known as ykarel| | 09:04 | |
| *** ykarel| is now known as ykarel | 09:05 | |
| marios | panda: ack thanks i am +2 there anyway | 09:05 |
| *** dsneddon has quit IRC | 09:07 | |
| tosky | thank you: browsing web pages late in the night does not help | 09:08 |
| *** ratailor_ has quit IRC | 09:14 | |
| panda | quiquell: do we have a way to inject vars to zuul for every run in the reproducer ? | 09:16 |
| panda | quiquell: https://review.openstack.org/632963 needs a variable to be injected to force post failure | 09:16 |
| *** ykarel is now known as ykarel|lunch | 09:16 | |
| quiquell | panda: if you want to inject at job level, using zuul_yaml you pass the whole job definition | 09:16 |
| panda | quiquell: do we want only job level or global level. I mean do we want all the jobs to have held nodes in the reproducer ? If not we need some instructions for the user | 09:17 |
| quiquell | panda: I suspect this will be like an option of the repro from jobs | 09:18 |
| panda | quiquell: the mechanism is there anyway, they just need to activate it | 09:18 |
| quiquell | panda: you are chanign the reproducer CI but not the launching job | 09:18 |
| panda | quiquell: ok | 09:18 |
| panda | quiquell: uh ? | 09:18 |
| *** ykarel_ has joined #oooq | 09:18 | |
| quiquell | panda: nathing, you don't have to change upstream | 09:19 |
| quiquell | panda: you can add an extra post at jobs definition within the reproducer | 09:19 |
| panda | quiquell: until I understand better how the whole thing works, I have no idea how to do that. | 09:20 |
| *** udesale has joined #oooq | 09:20 | |
| quiquell | panda: give me a min I explain | 09:20 |
| panda | quiquell: is there a post playbook that is run by default in our reproducer ? | 09:20 |
| quiquell | panda: can be generated in the reproducer playbook from jobs | 09:21 |
| *** ykarel|lunch has quit IRC | 09:21 | |
| quiquell | panda: we can put a post.yaml at test projects | 09:21 |
| quiquell | panda: and add at this as a post action at the generated zuul_yaml from rlandys reproducer playbook from jobs | 09:22 |
| quiquell | panda: so we don't have to change the upstream ci | 09:22 |
| quiquell | panda: want to blue ? | 09:27 |
| panda | quiquell: yep, still have no idea what you're talking about :( | 09:28 |
| quiquell | going to yours | 09:28 |
| *** derekh has joined #oooq | 09:29 | |
| *** sanjayu_ has joined #oooq | 09:36 | |
| *** saneax has quit IRC | 09:38 | |
| *** bogdando has joined #oooq | 09:41 | |
| *** dsneddon has joined #oooq | 09:43 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:53 | |
| marios | quiquell: panda * folks when you have 2 mins please vote here https://review.openstack.org/#/c/632972/ | 09:53 |
| quiquell | +2 | 09:55 |
| quiquell | marios: we don't have 003 at tht ? | 09:55 |
| sshnaidm | quiquell, are we merging? https://review.rdoproject.org/r/#/c/18422/ | 09:55 |
| marios | quiquell: we should have | 09:55 |
| marios | quiquell: we should be using the template which has 1/2/3/4 for check/gate voting | 09:55 |
| quiquell | sshnaidm: Yep, want to merge this first https://review.rdoproject.org/r/#/c/18500/ | 09:56 |
| marios | quiquell: actually noticed it trying to write a zuul.yaml for test1 :) | 09:56 |
| quiquell | sshnaidm: fixes host and add verifications so we really verify the review | 09:56 |
| *** dsneddon has quit IRC | 09:56 | |
| quiquell | sshnaidm: puting in top your review | 09:56 |
| marios | quiquell: also i had to use admin for the clone like git clone ssh://admin@localhost:29418/test2 and it worked | 09:56 |
| sshnaidm | quiquell, it doesn't seems to be related | 09:56 |
| *** ykarel_ is now known as ykarel | 09:58 | |
| quiquell | sshnaidm: add verification, but well we can verify it manually, this review runs ok the jobs and all ? | 09:58 |
| sshnaidm | quiquell, yeh | 09:59 |
| quiquell | sshnaidm: ok, let's merge | 09:59 |
| *** ssbarnea|rover has joined #oooq | 10:02 | |
| marios | thanks panda quiquell | 10:03 |
| *** ssbarnea|bkp2 has quit IRC | 10:04 | |
| quiquell | sshnaidm: it's not running gate jobs ? | 10:04 |
| panda | quiquell: https://review.rdoproject.org/r/18502 | 10:06 |
| panda | quiquell: I'll ping ronelle | 10:06 |
| quiquell | panda: going to merge that too | 10:07 |
| quiquell | panda: looks good | 10:07 |
| *** sanjayu_ has quit IRC | 10:07 | |
| *** ssbarnea|bkp2 has joined #oooq | 10:07 | |
| *** sanjayu_ has joined #oooq | 10:08 | |
| *** ssbarnea|rover has quit IRC | 10:10 | |
| quiquell | Damn It's like impossible to merge this https://review.openstack.org/#/c/623294/ | 10:12 |
| *** udesale has quit IRC | 10:12 | |
| quiquell | marios: Do you know someone that is up to workflow it I have already ask a lot of zuul maintainers | 10:13 |
| *** udesale has joined #oooq | 10:13 | |
| marios | quiquell: sorry mate don't know anyone there | 10:13 |
| marios | quiquell: woo i posted a change to local gerrit \o/ | 10:19 |
| * marios retires | 10:19 | |
| quiquell | \o/ !!! | 10:20 |
| quiquell | sshnaidm: has fail at gates https://review.rdoproject.org/r/#/c/18422/ | 10:21 |
| quiquell | sshnaidm: let me fix the host thing to really run at host | 10:21 |
| quiquell | sshnaidm: And we put that in top | 10:21 |
| sshnaidm | quiquell, ack | 10:22 |
| ykarel | panda, sshnaidm can u revisit https://review.rdoproject.org/r/#/c/18151/ | 10:30 |
| *** dsneddon has joined #oooq | 10:32 | |
| sshnaidm | ykarel, done | 10:33 |
| sshnaidm | quiquell, launcher doesn't listen on 8005 port | 10:33 |
| *** skramaja_ has quit IRC | 10:33 | |
| ykarel | sshnaidm, Thanks | 10:33 |
| quiquell | Then we can remove it | 10:33 |
| panda | sgrunt. I hate linters | 10:40 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, tripleo-quickstart- (2 more messages) | 10:41 |
| sshnaidm | quiquell, no, actually it does | 10:42 |
| *** dsneddon has quit IRC | 10:45 | |
| quiquell | sshnaidm: That port was part of the zuul quickstart | 10:46 |
| sshnaidm | quiquell, it's weird, working form within container, but not outside | 10:49 |
| sshnaidm | quiquell, and it requires a configuation.. I'd add it in different review | 10:51 |
| quiquell | sshnaidm: na it works locally I think I have just to increase the retries | 10:51 |
| quiquell | sshnaidm: Are we talking about "host" issue ? | 10:51 |
| sshnaidm | quiquell, no, I'm talking about nodepool webapp in your review: https://review.rdoproject.org/r/#/c/18500/6/templates/docker-compose.yaml.j2 | 10:51 |
| sshnaidm | quiquell, what's the problem with host? | 10:52 |
| quiquell | sshnaidm: have set it up at same review, to check that the review itself its working | 10:53 |
| quiquell | sshnaidm: what's the issue with it ? | 10:54 |
| quiquell | sshnaidm: basically the CI was broken :-( | 10:55 |
| quiquell | sshnaidm: this review try to fix that with fix and test of the fix | 10:55 |
| sshnaidm | quiquell, as I see logs it looks fine.. what is broken? | 10:55 |
| quiquell | sshnaidm: me + ansible + shell are not very friendly sometimes | 10:55 |
| quiquell | sshnaidm: I think it will work now | 10:56 |
| sshnaidm | I see error in executor: executor_1 | Received disconnect from 104.130.246.32 port 29418:12: Too many concurrent connections (64) - max. allowed: 64 | 10:56 |
| sshnaidm | but it's not a problem I think | 10:56 |
| quiquell | nooo | 10:56 |
| quiquell | The user issue again ? | 10:56 |
| quiquell | Forgot to ask infra | 10:56 |
| sshnaidm | stderr: 'Cloning into '/var/lib/zuul/merger-git/git.openstack.org/openstack/tripleo-upgrade'... | 10:57 |
| sshnaidm | merger0_1 | Received disconnect from 104.130.246.32 port 29418:12: Too many concurrent connections (64) - max. allowed: 64 | 10:57 |
| panda | ssbarnea|bkp2: I don't understand what's failing here http://logs.rdoproject.org/02/18502/2/check/tox-linters/f2f68c9/job-output.txt.gz | 10:57 |
| sshnaidm | and mergers too | 10:57 |
| ssbarnea|bkp2 | panda: looking now. | 10:57 |
| panda | ssbarnea|bkp2: nevermind | 10:57 |
| panda | ssbarnea|bkp2: Trim Trailing Whitespace | 10:57 |
| panda | ssbarnea|bkp2: how do I disable this check ? | 10:58 |
| panda | ssbarnea|bkp2: the trailing space is needed, or the message will not be correctly output | 10:58 |
| ssbarnea|bkp2 | panda: but you have point, UX kinda sucks here. Find workaround for the space issue. | 10:58 |
| ssbarnea|bkp2 | like {{ ' ' }} | 10:58 |
| ssbarnea|bkp2 | which also avoids accidental removal of thespace. not really bad approach. | 10:59 |
| quiquell | sshnaidm: centos-7 has pass | 10:59 |
| panda | ssbarnea|bkp2: why are we linting yaml ? | 11:00 |
| ssbarnea|bkp2 | panda: funny, last night i got into the trailing issue myself on something else unrelated to tripleo. | 11:00 |
| ssbarnea|bkp2 | panda: because we had breaking bugs like duplicate dictionary keys, one example. | 11:01 |
| panda | ssbarnea|bkp2: yes, but enforcing 80 columns and trailing spaces ? | 11:01 |
| panda | I can understand the syntax, but style ? | 11:01 |
| ssbarnea|bkp2 | trailing space is a common mistake while editing and easy to miss, can cause bugs too. i think that 80 column rule is not true. | 11:02 |
| ssbarnea|bkp2 | if I remember well we have a 999 for that or some other really big value. | 11:02 |
| quiquell | ssbarnea|bkp2: success, let's merge it | 11:03 |
| quiquell | sshnaidm: I mean | 11:03 |
| quiquell | sshnaidm: https://review.rdoproject.org/r/#/c/18500/ let's merge this | 11:03 |
| panda | ssbarnea|bkp2: the 80 column rule is why I have to split the string in the first place | 11:04 |
| panda | ssbarnea|bkp2: also, I ran linter locally and it autofixed the trail space | 11:04 |
| panda | ssbarnea|bkp2: I don't like much that program run to TEST my stuff is MODIFYING my stuff ... | 11:05 |
| quiquell | sshnaidm: I think docker-compose down was needed I removed it | 11:05 |
| quiquell | sshnaidm: maybe nodes don't get inmediatly tear down | 11:05 |
| quiquell | sshnaidm: and nodepool wait a little enough to fill in the 64 connections | 11:05 |
| panda | aaand it's still failing | 11:06 |
| ssbarnea|bkp2 | panda: you cannot blame me for using ">" instead of "|" :D | 11:06 |
| ssbarnea|bkp2 | i do still prefer to use 80 whever is possible, makes easy to review code. | 11:06 |
| panda | ssbarnea|bkp2: I have not idea what is happening to my review | 11:06 |
| panda | ssbarnea|bkp2: now the whitespace is trimmed, but the linter is not passing, and it's stashing, rolling back, re committing ?? WTH ? | 11:07 |
| ssbarnea|bkp2 | panda: you want me to fix it? less than aminute to do it, | 11:07 |
| panda | ssbarnea|bkp2: no, I want you to explain why a test program is altering my code. | 11:07 |
| ssbarnea|bkp2 | panda: to help you fix the code, you can disable the auto-trimming but it will still fail to pass the ling because you wave newlines at the end of line. | 11:08 |
| panda | ssbarnea|bkp2: and if I use the | instead of > the message split in two lines will have a \n in the middle | 11:08 |
| marios | quiquell: like this? http://pastebin.test.redhat.com/701490 | 11:09 |
| panda | ssbarnea|bkp2: the > is there to not add newlines, and consider the two lines as 1 | 11:09 |
| panda | ssbarnea|bkp2: I'm in my repo, the whitespace is gone, but linter still fails | 11:09 |
| ssbarnea|bkp2 | panda: ahh right. but if you > does a join with space, so you do not need space at the end of line. | 11:09 |
| ssbarnea|bkp2 | panda: let me play with it, i want to see what happens. | 11:09 |
| arxcruz|ruck | ssbarnea|bkp2: i'm not feeling well, i'll be a little bit away, but listening to the channel if someone says my name | 11:10 |
| arxcruz|ruck | i'm wfb today hehehe | 11:10 |
| sshnaidm | quiquell, yeah, let's add "down" in some post playbook | 11:10 |
| panda | ssbarnea|bkp2: It's complaining because the cchange is not committed | 11:11 |
| quiquell | sshnaidm: added it to the "host" review after gathering logs from docker-compose | 11:11 |
| quiquell | sshnaidm: but it's weird I was expecting nodepool to shutdown nodes :-/ | 11:11 |
| marios | sshnaidm: quiquell not sure what you guys are discussing but this morning, i did the docker-compose down but it failed like http://pastebin.test.redhat.com/701419 (mysql error) and had to delete the tripleo-ci-reproducer folder for clean run | 11:11 |
| panda | ssbarnea|bkp2: so I have this change, the pre-commit stashes it, looks at the old version, then says "ERROR" end unstashes it | 11:11 |
| quiquell | marios: docker-compose down -v | 11:12 |
| marios | sshnaidm: quiquell i mean it failed to come up after i ran the playbook to start it (with that sql error) until i cleaned the folder and rerun | 11:12 |
| sshnaidm | marios, yeah, happens sometimes | 11:12 |
| panda | ssbarnea|bkp2: and then says "your previous change is failing" | 11:12 |
| panda | sshnaidm: "well, thanks for nothing pre-commit" | 11:12 |
| sshnaidm | marios, usually need to remove docker volumes with "down -v" | 11:12 |
| sshnaidm | ssbarnea|bkp2, ^^ | 11:13 |
| ssbarnea|bkp2 | panda: i know the issue, it should use: python -m pre_commit run -a instead of the head line. | 11:13 |
| quiquell | marios: If we are able to merge the fecking zuul-jobs review we merge also a fix that do a down/start so you start afresh | 11:13 |
| panda | ssbarnea|bkp2: also, is there a way to make pre-commit NOT TOUCH my code ? | 11:14 |
| marios | quiquell: sshnaidm something wrong with this? http://pastebin.test.redhat.com/701490 (am i missing something) trying to launch a job | 11:15 |
| panda | ssbarnea|bkp2: not autofix | 11:15 |
| panda | ssbarnea|bkp2: I'd like to fix it, without having to revert changes | 11:16 |
| panda | ssbarnea|bkp2: and in my own way. | 11:16 |
| marios | quiquell: but i just remembered hmmm maybe its the keys in the centos image (it has my old key but i don't use that?) | 11:16 |
| sshnaidm | marios, should be fine | 11:16 |
| marios | sshnaidm: thanks | 11:16 |
| panda | ssbarnea|bkp2: do we have the same configuration in other repos ? | 11:16 |
| quiquell | sshnaidm: Did we update nodepool image ? | 11:17 |
| *** dsneddon has joined #oooq | 11:17 | |
| sshnaidm | quiquell, only fedora | 11:17 |
| ssbarnea|bkp2 | panda: in regards to whitespace auto-fixing yes. you just discovered it but it was confusing because of another line. let me make a patch for it and you will understand. | 11:17 |
| sshnaidm | quiquell, what's the problem? | 11:17 |
| quiquell | Argg stuff is pilling up again | 11:18 |
| quiquell | sshnaidm: If the cloudinit is working wit h the new nodepool let's roll that | 11:18 |
| quiquell | sshnaidm: so we don't care about keys | 11:18 |
| sshnaidm | quiquell, I'll build and test new containers today | 11:18 |
| quiquell | sshnaidm: ack, ok so first "host" then "zuul-config" | 11:19 |
| quiquell | sshnaidm: working host mode now at CI https://review.rdoproject.org/r/#/c/18500/ | 11:22 |
| quiquell | sshnaidm: with all the checks | 11:22 |
| sshnaidm | quiquell, so problem was with connectionws | 11:23 |
| quiquell | sshnaidm: yep | 11:23 |
| *** ssbarnea|rover has joined #oooq | 11:23 | |
| *** ssbarnea|bkp2 has quit IRC | 11:24 | |
| *** udesale has quit IRC | 11:25 | |
| *** dsneddon has quit IRC | 11:28 | |
| sshnaidm | quiquell, forgot how we built docker images.. do you have a Dockerfile? | 11:33 |
| quiquell | sshnaidm: with zuul is different | 11:33 |
| sshnaidm | quiquell, ah.. we took provided images | 11:34 |
| sshnaidm | we didn't build them actually | 11:34 |
| quiquell | sshnaidm: just use the nodepool_build stuff with the reproducer it will run pbrx for you | 11:34 |
| sshnaidm | quiquell, last time I tried it failed.. | 11:34 |
| quiquell | sshnaidm: so your zuul/nodepool-launcher will be the build one | 11:34 |
| quiquell | sshnaidm: try now | 11:35 |
| quiquell | Ohh they have workflow the zuul-jobs change !!! Can't believe it | 11:37 |
| ssbarnea|rover | marios: are you missing from rdo gerrit or is there something weird about your user, when I type "Mario" i get only Marius Cornea. I think you didn't setup a username. | 11:38 |
| ssbarnea|rover | (full name) | 11:38 |
| marios | ssbarnea|rover: checking | 11:38 |
| marios | ssbarnea|rover: should be username marios | 11:39 |
| ssbarnea|rover | marios: your full name is "User marios" better to put one that starts with "Mario...". as it will make auto-complete work (use upper case first later) | 11:39 |
| marios | ssbarnea|rover: maybe you need the 's' | 11:39 |
| ssbarnea|rover | marios: username is ok, is only about "full name" | 11:39 |
| sshnaidm | quiquell, congrats :) | 11:39 |
| sshnaidm | quiquell, zuul/nodepool-launcher | 11:39 |
| sshnaidm | By zuul • Updated 6 days ago | 11:39 |
| sshnaidm | quiquell, so official docker doesn't have my change yet | 11:40 |
| marios | ssbarnea|rover: maybe now ok? | 11:40 |
| quiquell | sshnaidm: that's super weird | 11:40 |
| quiquell | sshnaidm: they have new docker at everystuff that pass the gates | 11:41 |
| quiquell | sshnaidm: let me track that | 11:41 |
| sshnaidm | quiquell, seems like not | 11:41 |
| ssbarnea|rover | marios: done! fix confirmed. thanks. | 11:41 |
| marios | ssbarnea|rover: thanks | 11:44 |
| quiquell | sshnaidm: this is the job that pushes stuff | 11:45 |
| quiquell | openstackzuul-pbrx-push-container-images | 11:45 |
| quiquell | sshnaidm: let's try to rebuild it and push to our rdoci | 11:49 |
| quiquell | sshnaidm: tag it with the commit-id | 11:49 |
| quiquell | sshnaidm: let's use commit id instead of stable in the docker-compose | 11:49 |
| sshnaidm | quiquell, I think in docker-compose better to use "stable" or "latest" | 11:50 |
| sshnaidm | quiquell, why to have commit there? | 11:50 |
| quiquell | sshnaidm: to pin stuff and know what you are running directly from docker-compose.yaml and git repos | 11:51 |
| quiquell | sshnaidm: so we don't have to go to dockerhub to know wher stable or latest point too | 11:51 |
| quiquell | sshnaidm: also testing ci with a review | 11:51 |
| quiquell | sshnaidm: if we overwrite tags, ci is not the same at different runs | 11:52 |
| quiquell | sshnaidm: let's not overwrite tags, just new tag for images update with it's proper review | 11:52 |
| *** ssbarnea|bkp2 has joined #oooq | 11:52 | |
| quiquell | sshnaidm: so we see results in the review | 11:52 |
| quiquell | sshnaidm: it's ok ? | 11:52 |
| quiquell | sshnaidm: thanks for the linting at repro role | 11:53 |
| *** ssbarnea|rover has quit IRC | 11:54 | |
| quiquell | sshnaidm: I am rebasing your review with project config | 11:54 |
| *** dsneddon has joined #oooq | 12:02 | |
| quiquell | ssbarnea|bkp2, panda: Is this changing the code https://review.rdoproject.org/r/#/c/18507 ? | 12:03 |
| panda | quiquell: with this change there will be two checks for pre-commit that will automatically fix your code if you don't respect the linting | 12:04 |
| quiquell | ssbarnea|bkp2: We really want that ? | 12:04 |
| panda | I don't | 12:04 |
| panda | I would prefer to make it optional | 12:05 |
| quiquell | You run your tests before commit | 12:05 |
| quiquell | panda: I agree with you yaml is so delicate | 12:05 |
| panda | I'm even more delicate | 12:05 |
| ssbarnea|bkp2 | panda: quiquell : read my comment on https://review.rdoproject.org/r/#/c/18507/2/.pre-commit-config.yaml -- explains it. | 12:06 |
| quiquell | ssbarnea|bkp2: ahh ok, so they fix it for you so you check the fix before add it | 12:06 |
| quiquell | ssbarnea|bkp2: if it's like a suggestion system then it's ok | 12:06 |
| quiquell | panda: what do you think ? | 12:07 |
| ssbarnea|bkp2 | i am not aware of a way to make it optional but I can ask the author. not sure how you would expect to make it optional, via an environment variable? | 12:07 |
| panda | quiquell: it's not suggestion, they actually change your code | 12:07 |
| quiquell | panda: but they don't add it to the commit | 12:07 |
| panda | quiquell: and when you have 400 lines changed and you run the linter locally, it will stak up with your changes, and good luck in finding wha you fixed and what a script fixed for you | 12:08 |
| quiquell | panda: humm that's a good point | 12:08 |
| panda | ssbarnea|bkp2: you have trailing spaces in the commit message here https://review.openstack.org/595795 | 12:08 |
| quiquell | ssbarnea|bkp2, panda: Let's make it optional | 12:08 |
| ssbarnea|bkp2 | the change made by pre-commit will never reach git unless you manually submit the changed file. we are already using this change for 2-3 months on tq[e] repos, so i doubt is a real issue. | 12:08 |
| panda | ssbarnea|bkp2: can I launch the autofixer lint htere :) | 12:09 |
| panda | ? | 12:09 |
| panda | ssbarnea|bkp2: because noone runs tox -elinters locally | 12:09 |
| panda | when they do, it will change their code | 12:10 |
| panda | bottom line is: I'm launching a test command, and the result is my code has changed. | 12:10 |
| quiquell | yep don't like it either | 12:10 |
| quiquell | ssbarnea|bkp2: can you just set the bumping in that review ? | 12:11 |
| ssbarnea|bkp2 | panda: you should have a look at octario tester downstream, to see what that does to the tox.ini and requirements.txt files ;) | 12:11 |
| quiquell | ssbarnea|bkp2: and put the linting fixing at different one ? | 12:11 |
| panda | test should test, command should command, and reproducer should reproduce | 12:11 |
| quiquell | Let's reproduce !!! | 12:11 |
| ssbarnea|bkp2 | panda: maybe it was not clear: pre-commit will never return 0 when it does alter the code. | 12:13 |
| quiquell | panda, sshnaidm: To be able to stream job console logs from command line https://review.rdoproject.org/r/#/c/18475/, let's merge it | 12:13 |
| marios | ssbarnea|bkp2: arxcruz|ruck are there known issues with standalone (I see a tempest fail here http://logs.openstack.org/72/632972/2/check/tripleo-ci-centos-7-standalone/22a250a/logs/undercloud/home/zuul/tempest.log.txt.gz#_2019-01-24_11_22_54 ) | 12:15 |
| arxcruz|ruck | marios: this seems to be random | 12:15 |
| *** dsneddon has quit IRC | 12:15 | |
| ssbarnea|bkp2 | made a feature request: https://github.com/pre-commit/pre-commit/issues/922 | 12:17 |
| *** panda is now known as panda|lunch | 12:17 | |
| marios | arxcruz|ruck: k thanks i'll try a recheck then | 12:19 |
| quiquell | sshnaidm: merged https://review.rdoproject.org/r/#/c/18422/ | 12:20 |
| quiquell | panda|lunch, sshnaidm: Let's merge libvirt https://review.rdoproject.org/r/#/c/18446/ | 12:21 |
| quiquell | ssbarnea|bkp2: thanks workflowed | 12:31 |
| *** dsneddon has joined #oooq | 12:32 | |
| ssbarnea|bkp2 | more ansible bugs: https://github.com/ansible/ansible/issues/15614#issuecomment-457155727 -- docker and tls | 12:35 |
| *** quiquell is now known as quiquell|lunch | 12:36 | |
| *** ssbarnea|rover has joined #oooq | 12:37 | |
| ssbarnea|rover | something really weird is happening i get disconnected from irc, 3rd time in the last two hours. anyone else with similar issue? | 12:38 |
| *** ssbarnea|bkp2 has quit IRC | 12:39 | |
| *** jpena is now known as jpena|lunch | 12:40 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-quickstart-extras-gate- (2 more messages) | 12:41 |
| panda|lunch | ssbarnea|rover: half of my reviewing time is your patches .... | 12:45 |
| *** dsneddon has quit IRC | 12:45 | |
| panda|lunch | ssbarnea|rover: I need to cut you short ... | 12:45 |
| sshnaidm | quiquell|lunch, hmm.. and what the difference between all zuul/* containers | 12:52 |
| *** quiquell|lunch is now known as quiquell | 12:54 | |
| quiquell | sshnaidm: they are not gating with our reproducer so maybe we cannot update one of the components | 12:55 |
| quiquell | sshnaidm: even if they test it and they have the same repository | 12:55 |
| panda|lunch | dalvarez: https://review.openstack.org/611653 will work only for master. Scen007 is non-voting at the moment. Would it work to create the switch in THT that depends-on this change ? | 12:55 |
| *** panda|lunch is now known as panda | 12:55 | |
| quiquell | ssbarnea|rover: what's the linting issue here ? | 12:57 |
| sshnaidm | quiquell, I see it's different commit for every container.. I think it's better to have "latest" also, because you won't know which commit is latest | 12:57 |
| quiquell | ssbarnea|rover: it complains about ssh key | 12:57 |
| quiquell | sshnaidm: let's have latest too but pin docker-compose to commit-id | 12:58 |
| quiquell | sshnaidm: but not stable | 12:58 |
| quiquell | sshnaidm: stable is what docker-compose have and we can review it | 12:58 |
| sshnaidm | quiquell, let's discuss it when you're available.. | 12:58 |
| quiquell | sshnaidm: you change version from nodepool and you see results at review CI | 12:59 |
| quiquell | sshnaidm: yep not ready ready | 12:59 |
| *** quiquell is now known as quiquell|brb | 12:59 | |
| *** udesale has joined #oooq | 13:01 | |
| panda | mmmh, our scrum conflicts with the all-hands | 13:09 |
| marios | panda: yeah no scrum today | 13:09 |
| marios | panda: or we do it 1 hour later | 13:10 |
| panda | marios: well it's end of implementation week .. kind of important ... | 13:10 |
| panda | marios: also usually weshay weigh in when conflicts of this type arise | 13:10 |
| *** trown|outtypewww is now known as trown | 13:13 | |
| *** quiquell|brb is now known as quiquell | 13:15 | |
| quiquell | sshnaidm: I am ready | 13:15 |
| quiquell | ssbarnea|rover: Unable to find '/var/ssh/id_rsa.pub' in expected paths | 13:16 |
| quiquell | ssbarnea|rover: That does not sound very linting stuff | 13:17 |
| quiquell | ssbarnea|rover: what's the issue ? | 13:17 |
| sshnaidm | quiquell, https://bluejeans.com/u/sshnaidm/ | 13:17 |
| ssbarnea|rover | quiquell: you did not post any think to the error, how can I guess where it comes from? | 13:17 |
| quiquell | ssbarnea|rover: it's up | 13:17 |
| quiquell | ssbarnea|rover: let me copy again | 13:17 |
| quiquell | ssbarnea|rover: http://logs.rdoproject.org/46/18446/15/check/tox-linters/f827660/job-output.txt.gz | 13:18 |
| ssbarnea|rover | quiquell: i am almost sure this comes from a very differnt place unrelated to the linting task. look at https://logs.rdoproject.org/46/18446/15/check/tox-linters/f827660/job-output.txt.gz#_2019-01-24_12_52_58_318346 -- this has nothing to do with the tox execution. | 13:20 |
| ssbarnea|rover | it looks like output is mengled from another place | 13:20 |
| *** dsneddon has joined #oooq | 13:20 | |
| ssbarnea|rover | brb after lunch break | 13:23 |
| quiquell | ssbarnea|rover: ack | 13:24 |
| quiquell | ssbarnea|rover: nope just run tox -e linters and it's failing there | 13:25 |
| quiquell | ssbarnea|rover: that's weird | 13:25 |
| *** derekh has quit IRC | 13:26 | |
| weshay | I moved the tripleo-ci scrum | 13:27 |
| quiquell | ssbarnea|rover: looks like ansible-lint is trying to run some of the expansions | 13:28 |
| quiquell | ssbarnea|rover: like content: "{{ lookup('pipe', 'ssh-keygen -y -f /var/ssh/id_rsa') }}" | 13:28 |
| panda | chandankumar: is https://review.openstack.org/627500 ready for review ? | 13:29 |
| chandankumar | panda: waiting on osa patch https://review.openstack.org/#/c/631708/ | 13:29 |
| weshay | quiquell, aye.. I think it's my key as well. going to try w/ a fresh system later today | 13:29 |
| weshay | fresh system, user, key | 13:29 |
| weshay | the works | 13:29 |
| panda | chandankumar: ok, I'll -1W with your note then | 13:29 |
| chandankumar | panda: is kinda blocked as osa gate broken tempest scenario tests ssh timedout | 13:29 |
| quiquell | weshay: did you read about the paramiko bug ? | 13:29 |
| quiquell | weshay: I updated my laptop fedora and did get same issue as you | 13:30 |
| weshay | quiquell, sshnaidm we need to download, customize and upload nodepool images again | 13:30 |
| quiquell | weshay: new versions of openssh generate keys diferently | 13:30 |
| chandankumar | weshay: 1:1 | 13:30 |
| weshay | quiquell, I see the bug | 13:30 |
| weshay | chandankumar, aye | 13:30 |
| quiquell | weshay: ack | 13:30 |
| sshnaidm | weshay, nodepool images? | 13:30 |
| weshay | quiquell, we have an issue w/ compose logs too :) | 13:30 |
| weshay | sshnaidm, ya | 13:30 |
| quiquell | ssbarnea|rover: found the issue as you said was a legit linting issue, but ssh stuff distracted it | 13:30 |
| sshnaidm | weshay, what's wrong with them? | 13:30 |
| weshay | sshnaidm, ttyl | 13:30 |
| quiquell | weshay: what's the issue ? | 13:30 |
| sshnaidm | weshay, actually I'm building and uploading them right now, but I'd like to know :) | 13:31 |
| sshnaidm | weshay, ok | 13:31 |
| dalvarez | panda: yeah that should work :) | 13:32 |
| quiquell | sshnaidm, weshay: libvirt depends-on are merged so we can merge the repro review too https://review.rdoproject.org/r/#/c/18446/ | 13:33 |
| panda | any more reviews for https://review.openstack.org/618780 ? | 13:33 |
| quiquell | panda: o/ | 13:33 |
| panda | dalvarez: ok, so waiting for the tht patch :) | 13:33 |
| dalvarez | panda: you mean to make it again voting? | 13:34 |
| dalvarez | panda check my comment here replying weshay's https://review.openstack.org/#/c/611653/ | 13:35 |
| honza | chandankumar: could you clarify your comment on the featureset patch? do we need to update the plugin repo value? | 13:35 |
| panda | dalvarez: let's start from scratch. You say you need to merge change in the featureset before making a patch in THT that switches the environment for scenario007 right ? | 13:35 |
| panda | my name is ario. Scen Ario. | 13:35 |
| dalvarez | lol | 13:36 |
| panda | dalvarez: yep I read it, but what happens if you create the patch in THT that depends on the patch on the featureset ? | 13:36 |
| dalvarez | panda: this one? https://review.openstack.org/#/c/593056/ | 13:36 |
| *** rlandy has joined #oooq | 13:37 | |
| panda | dalvarez: mmhh, this is getting complicated ... | 13:38 |
| quiquell | panda: Don't we have to add priority to the next release repo ? | 13:38 |
| *** dsneddon has quit IRC | 13:39 | |
| panda | quiquell: no, the next release repo has always the latest versions, so unless we specify priorities for the other delorean repo, we should be good. | 13:41 |
| quiquell | panda: ck | 13:41 |
| quiquell | panda: +2 but commented some little naming issue, also where can I see the jobs running ? | 13:42 |
| panda | dalvarez: so what happens if we merge 611653 ? Should we wait anyway for the 593056 to be ready ? | 13:42 |
| *** jpena|lunch is now known as jpena | 13:43 | |
| rlandy | quiquell: I managed to run a generated job ... http://10.10.120.171:8080/c/test1/+/1001 | 13:44 |
| rlandy | with the launcher change | 13:44 |
| rlandy | yesterday | 13:44 |
| dalvarez | panda: yeah cause of this: https://review.openstack.org/#/c/611653/4/config/general_config/featureset030.yml@52 this env file is being added by https://review.openstack.org/#/c/593056/ | 13:44 |
| quiquell | rlandy: \o/ !!! | 13:44 |
| quiquell | It's a multinode one | 13:44 |
| dalvarez | panda: otherwise it would be one depending on each other so i thought that we have to merge 611653 while scen7 is nv | 13:44 |
| panda | quiquell: no jobs are activated by this patch, the latest run of the nextrelease job are on patchset 10, then I deactivated it and left the configuration for the future | 13:44 |
| dalvarez | panda: do i make sense? :P | 13:45 |
| quiquell | panda: ack | 13:45 |
| rlandy | quiquell: is it - where is the fun in standalone? | 13:45 |
| rlandy | no bridge | 13:45 |
| quiquell | rlandy: agree, let's just try ovb + libvirt | 13:45 |
| rlandy | no two nodes | 13:45 |
| rlandy | quiquell: I had an error with libvirt | 13:45 |
| quiquell | rlandy: I have update a lot of stuff at role | 13:46 |
| rlandy | local change - will try again | 13:46 |
| quiquell | rlandy: well is most about CI | 13:46 |
| rlandy | quiquell: is the libvirt change good to go? | 13:46 |
| panda | dalvarez: ok, mind if I put a -1W and a note top wait for that patch to be ready ? | 13:46 |
| quiquell | rlandy: btw zuul-jobs change merged we can merge libvirt | 13:46 |
| quiquell | rlandy: libvirt -> https://review.rdoproject.org/r/#/c/18446/ | 13:46 |
| dalvarez | panda: sure, even though it doesnt make much difference to merge it now as it's NV | 13:46 |
| marios | sshnaidm: quiquell: doing something else now but i was unable to launch anything (i get this stuff is it known gerrit.GerritWatcher - ERROR - Exception on ssh event stream like http://pastebin.test.redhat.com/701557 ) - we can talk on scrum later | 13:47 |
| quiquell | panda: going to merge the review, ok ? | 13:47 |
| rlandy | quiquell: I looked into the checking id ansible has access to the role .. easier to just check if the role is physically present - because we know where it is | 13:47 |
| panda | quiquell: \o/ | 13:47 |
| rlandy | got that | 13:47 |
| dalvarez | panda: worst case would be, if some other patch makes scen7 voting again, i'll have to make it nv in 611653 but it's fine by me | 13:47 |
| marios | sshnaidm: quiquell i very briefly see the jobs appear in the zuul status but they dissapear | 13:47 |
| sshnaidm | marios, I'm afraid you need to be in gerrit stream group | 13:47 |
| quiquell | marios: always forgot, you need permissions within RDO gerrit stream stuff | 13:47 |
| sshnaidm | marios, lemme find it.. | 13:47 |
| quiquell | sshnaidm: we need to fix that, it does not scale at all | 13:48 |
| panda | dalvarez: ok | 13:48 |
| sshnaidm | quiquell, let's add there all team | 13:48 |
| sshnaidm | quiquell, agree | 13:48 |
| quiquell | sshnaidm: btw also making RDO optional at repo, if RDO is down we cannot run upstream jobs | 13:48 |
| marios | sshnaidm: quiquell thanks (lets talk more on scrum then) | 13:48 |
| sshnaidm | quiquell, ack | 13:48 |
| quiquell | sshnaidm: sure | 13:48 |
| sshnaidm | marios, scrum is moved | 13:48 |
| marios | sshnaidm: yeah | 13:48 |
| marios | sshnaidm: so we have all hands firs | 13:48 |
| rlandy | quiquell: scrum clashes with a perf meeting I need to join - just fyi | 13:49 |
| quiquell | rlandy: do you want me to look at the libvirt stuff ? | 13:49 |
| rlandy | quiquell: it's fine ... one change | 13:49 |
| sshnaidm | marios, need to do such patch: https://review.rdoproject.org/r/#/c/17677/ | 13:50 |
| quiquell | rlandy: ack | 13:50 |
| panda | rlandy: scrum is postponed by 45 because ti clashes with all-hands | 13:50 |
| rlandy | panda: yep - and then I have another meeting | 13:50 |
| marios | sshnaidm: thanks | 13:50 |
| panda | oh | 13:51 |
| panda | the postponed meeting is clashing with the other. ok. | 13:51 |
| rlandy | panda: can you explain the 'force job failure' requirement? | 13:51 |
| rlandy | panda: ack | 13:51 |
| rlandy | https://review.openstack.org/#/c/631067/21/roles/create-zuul-based-reproducer/templates/reproducer-zuul-based-quickstart.sh.j2 | 13:52 |
| panda | rlandy: yes, it's for https://tree.taiga.io/project/tripleo-ci-board/task/569 | 13:52 |
| panda | rlandy: the only way to allow autohold at the moment is to fail the job. | 13:52 |
| *** zenpac has joined #oooq | 13:52 | |
| panda | rlandy: so if a user wants to hold the node, it needs to request it, and then force the jobn to fail even if it' successful | 13:52 |
| rlandy | panda; oh ... force_post_failure|bool|default(false) | 13:53 |
| rlandy | ok - can add that | 13:53 |
| panda | rlandy: and with the var force_post_failure: true we fail the last play in the post chain. last last last last last play, fails, and the node is held | 13:53 |
| sshnaidm | force_post_failure|default(false)|bool | 13:53 |
| rlandy | yeah - I see it - no problem | 13:54 |
| panda | sshnaidm: isn't it the same ? | 13:54 |
| panda | mmh no | 13:54 |
| sshnaidm | panda, if it's not defined, "bool" will fail | 13:54 |
| panda | yep | 13:54 |
| *** vkapalav has joined #oooq | 13:57 | |
| rlandy | sshnaidm: for ovb ... https://logs.rdoproject.org/67/631067/21/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/a4cebaf/logs/launcher-playbook.yaml | 13:57 |
| rlandy | ^^ other params needed? | 13:57 |
| rlandy | see zuul_yaml piece | 13:58 |
| quiquell | rlandy: what happend with tripleo-quickstar cloning at the end ? | 13:58 |
| *** derekh has joined #oooq | 13:58 | |
| rlandy | quiquell: decided to add it to https://review.rdoproject.org/r/#/c/18446/16/tasks/libvirt/main.yaml | 13:59 |
| rlandy | quiquell: under test locally now | 13:59 |
| rlandy | quiquell: because in ci - we know the location | 13:59 |
| rlandy | we can stat it | 13:59 |
| rlandy | quiquell: the alternative is to use the check option in ansible | 14:00 |
| rlandy | and just run something from the role and see if it fails | 14:00 |
| rlandy | or check the ansible roles path | 14:00 |
| rlandy | none of which are very clean | 14:00 |
| rlandy | we basically have two situations ... | 14:00 |
| rlandy | in ci or not | 14:01 |
| quiquell | well three | 14:01 |
| rlandy | if the ci location of tq is there forget it | 14:01 |
| rlandy | if not in ci | 14:01 |
| quiquell | in ci or not pre clone or pre clone | 14:01 |
| rlandy | two possibilities | 14:01 |
| rlandy | correct | 14:01 |
| rlandy | for that one | 14:01 |
| chandankumar | weshay: yes | 14:01 |
| rlandy | we can either check ansible path | 14:01 |
| chandankumar | weshay: it should be without .git | 14:01 |
| rlandy | or check clone path | 14:01 |
| chandankumar | sorry | 14:01 |
| rlandy | quiquell, | 14:01 |
| chandankumar | honza: yes | 14:01 |
| rlandy | that is what I am testing locally | 14:02 |
| chandankumar | honza: we need to update the plugin path without .git | 14:02 |
| rlandy | quiquell: the easy way out is to clone it in the launcher playbook | 14:02 |
| quiquell | rlandy: we can add an option to the clone path | 14:02 |
| rlandy | but would prefer not to | 14:02 |
| quiquell | rlandy: and direct that to "zuul.projects..." at zuul jobs | 14:02 |
| quiquell | rlandy: I think you can instruct ansible git moduel to do nothing if stuff is there | 14:03 |
| rlandy | git clone - yes | 14:03 |
| quiquell | rlandy: so no conditional needed | 14:03 |
| quiquell | rlandy: do you want to put that in place at different review ? or in the same libvirt review (I want to merge it already) | 14:03 |
| rlandy | quiquell: no - I'll add a separate review | 14:04 |
| rlandy | go ahead a merge that | 14:04 |
| quiquell | rlandy: cool cool | 14:04 |
| quiquell | rlandy: can you merge it ? https://review.rdoproject.org/r/#/c/18446/ I am the author | 14:04 |
| rlandy | yep | 14:04 |
| quiquell | rlandy: so extra param with tq clone path sound good ? | 14:04 |
| weshay | chandankumar, that seems to aggregate the tempest results to me | 14:04 |
| quiquell | rlandy: humm nah is dangerous, because zuul is pointing to special refspec, I don't know if git module can totally ignore stuff | 14:05 |
| chandankumar | weshay: yes agrregating at one place gives a better picture what tests are working or failing | 14:05 |
| chandankumar | for a period of time | 14:05 |
| rlandy | quiquell:I am going to check the path | 14:05 |
| rlandy | simple enough | 14:06 |
| chandankumar | weshay: kind of extending openstack-health | 14:06 |
| weshay | chandankumar, ya.. adding to an established upstream project seems more tenable to me than adding a new one | 14:06 |
| quiquell | rlandy: ack fair enough | 14:07 |
| weshay | adding openstack health to sf also sounds like a good idea | 14:07 |
| quiquell | rlandy: we cannoot use zuul.projects as default values | 14:07 |
| quiquell | rlandy: but something like "{{ install_path }}/tripleo-quickstart/ | 14:07 |
| quiquell | rlandy: we will set at jobs the dir to zuul.projects... | 14:07 |
| rlandy | quiquell: I'm going to check zuul clone location | 14:07 |
| weshay | rlandy, w/ | 14:07 |
| weshay | - hosts: localhost | 14:07 |
| weshay | vars: | 14:07 |
| weshay | nodepool_provider: openstack | 14:07 |
| weshay | cloud_name: rdo-cloud | 14:08 |
| weshay | review: https://review.openstack.org/631067 | 14:08 |
| rlandy | if not here check install path | 14:08 |
| rlandy | then clone | 14:08 |
| weshay | does that require a nodepool image in my tenant? | 14:08 |
| rlandy | yes | 14:08 |
| rlandy | weshay: ^^ | 14:08 |
| quiquell | review ? | 14:08 |
| quiquell | I think it's depends_on | 14:08 |
| weshay | rlandy, ok | 14:08 |
| quiquell | weshay: ^ | 14:08 |
| rlandy | nodepool_provider: openstack requires an image | 14:08 |
| weshay | quiquell, it's the script from the logs dude | 14:08 |
| rlandy | centos7 | 14:09 |
| weshay | ya k | 14:09 |
| quiquell | weshay: ack | 14:09 |
| quiquell | weshay: about launchpad found that there is a json datasource plugin at grafana | 14:09 |
| quiquell | weshay: so we don't need mariadb maybe just a kind of gateway to launchpad | 14:10 |
| weshay | quiquell, ok.. I'll open a parallel set of reviews | 14:10 |
| weshay | I looked at it.. not 100% sure yet | 14:10 |
| chandankumar | weshay: I will put the thoughts on a gdoc | 14:11 |
| rlandy | quiquell: https://review.rdoproject.org/r/#/c/18446/ is merging | 14:11 |
| rlandy | putting patch on top of that | 14:11 |
| quiquell | \o/ !!! at least !! | 14:11 |
| quiquell | habemus libvirt | 14:11 |
| weshay | chandankumar, k.. great.. add it to the tempest folder in google drive please | 14:12 |
| chandankumar | sure! | 14:12 |
| rlandy | https://review.openstack.org/#/c/631067/ is almost done | 14:12 |
| weshay | rlandy, nice | 14:12 |
| rlandy | leaving the review there for the doc | 14:12 |
| quiquell | rlandy: also this to stream job console logs at console (that's good feature for repro playbook) https://review.rdoproject.org/r/#/c/18475/ | 14:12 |
| rlandy | adding panda's var | 14:12 |
| rlandy | ok - let's let that go as well | 14:13 |
| rlandy | quiquell: you want a var added to the launcher playbook? | 14:14 |
| *** dsneddon has joined #oooq | 14:14 | |
| quiquell | rlandy: nope, the launch job will wait for the uuid and print the "You can follow logs with finger uuid@localhost..." before wait forever | 14:15 |
| quiquell | rlandy: the replo playbook review is testeable ? | 14:15 |
| rlandy | quiquell: so you just want it merged? | 14:15 |
| quiquell | s/replo/repro/ | 14:15 |
| quiquell | rlandy: yep | 14:15 |
| rlandy | quiquell: yes - it's testable | 14:15 |
| rlandy | pls try it out | 14:15 |
| quiquell | rlandy: I will wark that part in the launch_job stuf | 14:16 |
| rlandy | with the libvirt option | 14:16 |
| quiquell | rlandy: will do | 14:16 |
| rlandy | quiquell: two options ... | 14:16 |
| rlandy | wget the playbook dir from logs and follow instructions | 14:16 |
| rlandy | or | 14:16 |
| rlandy | use the bash script | 14:16 |
| rlandy | you will need the close review ... | 14:16 |
| rlandy | sec | 14:16 |
| rlandy | for libvirt | 14:17 |
| weshay | quiquell, so more details on the ssh-key issue.. who else hit that? and are we saying the workaround at the moment is that user keys need to be w/ a pem format | 14:17 |
| weshay | or that to use this.. we need users to generate a new key w/ -m pem format and add that to both gerrit systems? | 14:18 |
| quiquell | weshay: paul confirmed that, I think no one is using new openssh key gen for zuul keys | 14:18 |
| quiquell | weshay: if the user has the "OPENSSH" delimiter then new key is needed | 14:19 |
| weshay | interesting.. /me is not sure how keys are generated otherwise | 14:19 |
| *** ssbarnea|rover has quit IRC | 14:19 | |
| quiquell | weshay: all is here https://storyboard.openstack.org/#!/story/2004842 | 14:19 |
| ykarel | weshay, sshnaidm is the ovb job failure issue known:- Resource CREATE failed: IpAddressGenerationFailureClient: resources.baremetal_env.resources.bmc_port.resources.private_bmc_port: No more IP addresses available on network 1f6dd7c9-1c87-4310-a1c3-bd7c0346d6ad. | 14:20 |
| ykarel | most of the jobs https://review.rdoproject.org/zuul/status RETRY_LIMIT | 14:20 |
| weshay | quiquell, ya.. I'm reading it.. still have questions :) | 14:20 |
| quiquell | weshay: me too | 14:21 |
| weshay | ha k | 14:21 |
| quiquell | Looking for paul comment to paste it here | 14:21 |
| *** ssbarnea|rover has joined #oooq | 14:22 | |
| sshnaidm | ykarel, again.. | 14:23 |
| quiquell | weshay: 2019-01-23 13:13:59 pabelanger quiquell: yes, you will get parmiko issue on fedora with out -m PEM, since it is a newer version of SSH. Agree with tobiash we should document this and work upstream to properly fix RFC 4716 | 14:23 |
| sshnaidm | ssbarnea|rover, arxcruz|ruck can you please check why we don't have IP enough in 2d party CI, see comment of ykarel ^^ | 14:23 |
| ykarel | 3rd | 14:23 |
| sshnaidm | ykarel, already 3rd? | 14:24 |
| sshnaidm | ykarel, :D | 14:24 |
| ykarel | :) | 14:24 |
| quiquell | panda: I am going to workflow your review https://review.openstack.org/#/c/618780 | 14:25 |
| sshnaidm | sounds as 2nd hand CI | 14:25 |
| weshay | ykarel, is rdo-cloud going down again? | 14:26 |
| quiquell | 3rd hand too | 14:26 |
| panda | quiquell: NOOOOOooo... OK. | 14:26 |
| ssbarnea|rover | sshnaidm: looking now, i suppose you mean openstack-nodepool user on rdo cloud. | 14:26 |
| weshay | http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&panelId=207&fullscreen | 14:26 |
| weshay | ssbarnea|rover, arxcruz|ruck any updates regarding what ykarel is referring to? | 14:26 |
| quiquell | ssbarnea|rover: We have to redirect cockpit-ci.tripleo.org | 14:26 |
| ykarel | weshay, only ovb affecting, so don't think it's rdo-cloud | 14:26 |
| quiquell | sshnaidm: I mean | 14:26 |
| arxcruz|ruck | weshay: checking | 14:27 |
| sshnaidm | quiquell, oh, yeah, will do | 14:27 |
| weshay | ykarel, hrm.. I see jobs failing in 6min | 14:27 |
| sshnaidm | quiquell, after we're done with mvp.. | 14:27 |
| arxcruz|ruck | weshay: we have 20 heat stacks in create failed | 14:27 |
| *** dsneddon has quit IRC | 14:27 | |
| weshay | arxcruz|ruck, can you run the clean up? | 14:28 |
| sshnaidm | arxcruz|ruck, I see a lot of delete failed | 14:28 |
| quiquell | sshnaidm: ack | 14:28 |
| quiquell | ssbarnea|rover: can we call ansible-lint at pre-commit without colors in zuul ? | 14:28 |
| weshay | hrm.. this is not working http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&panelId=231&fullscreen&from=now-6h&to=now | 14:29 |
| ssbarnea|rover | quiquell: wait for zuul patch that will enable colors. | 14:29 |
| weshay | arxcruz|ruck, ssbarnea|rover ^ | 14:29 |
| sshnaidm | ssbarnea|rover, weshay did you we change script to remove create_failed already? | 14:29 |
| weshay | ya.. he did | 14:30 |
| ssbarnea|rover | good, question. not sure if merged. | 14:30 |
| quiquell | ssbarnea|rover: zuul patch ? is not something of the log server ? | 14:30 |
| weshay | ssbarnea|rover, I merged it I think | 14:30 |
| arxcruz|ruck | weshay: did the password change? I'm not being able to log in with the credentials on ruck notes document | 14:31 |
| weshay | arxcruz|ruck, ok.. join my tmate | 14:31 |
| weshay | pm | 14:31 |
| *** skramaja_ has joined #oooq | 14:31 | |
| *** skramaja_ has quit IRC | 14:32 | |
| weshay | ssbarnea|rover, sshnaidm https://review.rdoproject.org/r/#/c/18391/ | 14:32 |
| *** ccamacho has quit IRC | 14:32 | |
| weshay | arxcruz|ruck, you joining? | 14:33 |
| arxcruz|ruck | weshay: yes | 14:33 |
| sshnaidm | weshay, need to check if it was updated on te-broker | 14:33 |
| sshnaidm | weshay, well, it's not | 14:34 |
| sshnaidm | weshay, updating it... | 14:35 |
| ssbarnea|rover | weshay: i see considerable number of stacks to be removed when running with "-d -l", i suspect cron may not work or is using the old version of the script. is not deployed on merge? | 14:35 |
| *** ccamacho has joined #oooq | 14:35 | |
| weshay | arxcruz|ruck, k in | 14:37 |
| ssbarnea|rover | weshay: ok to run remove myself now? | 14:37 |
| rlandy | quiquell; trying this ... https://review.rdoproject.org/r/#/c/18511/1/tasks/libvirt/main.yaml | 14:38 |
| quiquell | rlandy: zuul.projects will fail | 14:38 |
| sshnaidm | ssbarnea|rover, it wasn't updated | 14:38 |
| quiquell | rlandy: maybe we can just check if zuul variable exist and do stuff | 14:38 |
| rlandy | quiquell: why will that fail? | 14:38 |
| quiquell | rlandy: Don't like to add zuul stuff there | 14:38 |
| quiquell | rlandy: user does not have the zuul variable defined | 14:39 |
| rlandy | quiquell: ok - can resolve it | 14:39 |
| quiquell | rlandy: so zuul.projects fails with undefined variable | 14:39 |
| rlandy | sec | 14:39 |
| quiquell | rlandy: since this is expanding | 14:39 |
| weshay | ssbarnea|rover, join my tmate | 14:39 |
| weshay | ssbarnea|rover, arxcruz|ruck ok.. let's see what happens w/ the script | 14:39 |
| ssbarnea|rover | weshay: i am already running it, is grinding.... | 14:40 |
| weshay | ssbarnea|rover, ok.. stop and join us | 14:40 |
| quiquell | rlandy: let's just put a new configurable parameter to the role like tq_git_path or tq_path | 14:41 |
| rlandy | quiquell: review updated | 14:41 |
| quiquell | rlandy: and in the jobs we set that to tq_path: "{{ ansible_user_dir }}/{{ zuul.projects["..."].src_dir }}" | 14:41 |
| ssbarnea|rover | weshay: which BJ id? tried yours, tried the meeting, i was the only one. | 14:41 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-quickstart-extras-gate- (2 more messages) | 14:41 |
| weshay | ssbarnea|rover, join the tmate I sent u | 14:41 |
| quiquell | rlandy: you have to take the path from zuul.projects[... | 14:42 |
| quiquell | rlandy: but let's just put zuul part at jobs | 14:42 |
| quiquell | rlandy: and pass it to the role | 14:42 |
| rlandy | quiquell: if we are running in ci - won't zuul_projects be defined? | 14:43 |
| rlandy | in stead of making a ton of other vars | 14:44 |
| weshay | ssbarnea|rover, you were typing something? | 14:44 |
| rlandy | if we are in ci - zuul vars would be there | 14:44 |
| quiquell | rlandy: prefir a var than reference zuul withing the role | 14:44 |
| quiquell | prefer | 14:44 |
| rlandy | so var is defined or not | 14:44 |
| ssbarnea|rover | weshay: check if file is the last version | 14:44 |
| quiquell | rlandy: tq_install_dir: "{{ ansible_user_dir }}/{{ zuul. ..." here https://github.com/rdo-infra/ansible-role-tripleo-ci-reproducer/blob/master/playbooks/tripleo-ci-reproducer/run.yaml#L34 | 14:45 |
| rlandy | so no if zuul.projects is defined? | 14:45 |
| rlandy | and define that where? | 14:45 |
| quiquell | rlandy: let's not reference zuul at places that are not CI | 14:45 |
| rlandy | tq_install_dir - that is in trripleo-ci common | 14:46 |
| weshay | ssbarnea|rover, arxcruz|ruck seems like it is | 14:46 |
| quiquell | rlandy: then in at default/main.yaml tq_install_dir: "{{ install_path }}/tripleo-quickstart" | 14:46 |
| rlandy | will that be available? | 14:46 |
| quiquell | rlandy: we are not using tripleo-ci for repro CI | 14:46 |
| arxcruz|ruck | weshay: it is what ? | 14:46 |
| rlandy | right | 14:46 |
| quiquell | rlandy: since we are not running tripleo | 14:46 |
| weshay | arxcruz|ruck, ssbarnea|rover script is at it's latest version | 14:46 |
| rlandy | where would you override that default> | 14:46 |
| rlandy | for ci? | 14:47 |
| quiquell | rlandy: and just stat tq_install_dir in the role libvirt part | 14:47 |
| ssbarnea|rover | weshay: i will make some changes to make it use timestamps | 14:47 |
| weshay | arxcruz|ruck, ssbarnea|rover ack.. thakns | 14:47 |
| rlandy | what if we are IN ci? | 14:47 |
| quiquell | rlandy: here https://github.com/rdo-infra/ansible-role-tripleo-ci-reproducer/blob/master/playbooks/tripleo-ci-reproducer/run.yaml#L34 | 14:47 |
| quiquell | at zuul run playbook | 14:47 |
| quiquell | rlandy: this is where the playbook get generated | 14:47 |
| quiquell | rlandy: well, in the launch_job review is in the template | 14:47 |
| quiquell | rlandy: but is same thing | 14:47 |
| ssbarnea|rover | weshay: but we still need to see why it was not running. | 14:48 |
| quiquell | rlandy: here we override with zuul stuff https://review.rdoproject.org/r/#/c/18279/42/playbooks/tripleo-ci-reproducer/templates/run.yaml.j2 | 14:48 |
| ssbarnea|rover | weshay: what was the IP of the machine with the script? | 14:48 |
| quiquell | rlandy: make sense ? | 14:48 |
| rlandy | quiquell: not really :) | 14:49 |
| quiquell | rlandy: nope ? | 14:49 |
| rlandy | stat tq_install_dir in the role libvirt part | 14:49 |
| rlandy | ^^ that is fine | 14:49 |
| rlandy | where you redefine tq_install_dir for ci | 14:49 |
| rlandy | that is not clear | 14:49 |
| rlandy | nodepoll_provider will be libvirt | 14:49 |
| rlandy | so we need to determine libvirt in ci | 14:50 |
| rlandy | not in reproducer outside | 14:50 |
| weshay | arxcruz|ruck, <ssbarnea|rover> i will try to debug it from here and also to clean it up a little, (no deprec warnings on production) | 14:50 |
| weshay | arxcruz|ruck, ok.. sorin is going to take point on this | 14:50 |
| weshay | arxcruz|ruck, ssbarnea|rover any questions about how this works atm? | 14:51 |
| weshay | arxcruz|ruck, it is interesting to me that that the cockpit is wrong | 14:51 |
| arxcruz|ruck | weshay: ssbarnea|rover no, i just used to do it on my local machine with https://gist.github.com/weshayutin/72890b1619efa5cd3b99223ef837f6d6 | 14:51 |
| weshay | arxcruz|ruck, shall we look into http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&panelId=231&fullscreen&from=now-6h&to=now ?? | 14:51 |
| quiquell | rlandy: wait we have the required-projects with tq only at libvirt jobs | 14:52 |
| quiquell | rlandy: it will fail there | 14:52 |
| arxcruz|ruck | weshay: sure | 14:52 |
| weshay | quiquell, rlandy sshnaidm panda we'll join the scrum here shortly | 14:52 |
| weshay | waiting on Eoghan to complete | 14:52 |
| quiquell | rlandy: we will have to put tq_install_dir: "{{ tq_install_dir }}" in that place and at libvirt jobs pass the correct value in vars | 14:52 |
| rlandy | weshay: joining perf meeting | 14:52 |
| weshay | ah crap | 14:53 |
| weshay | rlandy, ack.. thanks | 14:53 |
| weshay | I'm supposed to be there too oh well | 14:53 |
| quiquell | so when is the scrum ? | 14:53 |
| weshay | quiquell, waiting on Eoghan to complete | 14:53 |
| weshay | in the all-hands | 14:54 |
| quiquell | ack | 14:54 |
| rlandy | weshay: we can divide and conquer | 14:54 |
| weshay | :) | 14:54 |
| quiquell | libvirt merged yey!!! | 14:54 |
| panda | I can hear eoghan talking from here. And there's a 8Km distance. | 14:54 |
| weshay | arxcruz|ruck, so we need to fix the cockpit.. after the scrum I'll bluejeans w/ you | 14:54 |
| arxcruz|ruck | ok | 14:54 |
| *** dsneddon has joined #oooq | 14:57 | |
| quiquell | sshnaidm: What infra server would be the correct one to update images ? | 14:58 |
| quiquell | sshnaidm: or new one is needed ? | 14:58 |
| sshnaidm | quiquell, not sure I understand | 14:58 |
| ssbarnea|rover | weshay: what else runs on tebroker host, is ok to do a yum update on it? | 14:59 |
| weshay | marios, sshnaidm quiquell scrum | 14:59 |
| quiquell | sshnaidm: Ahh well periodic job could do | 14:59 |
| weshay | ssbarnea|rover, ya.. now only that script | 14:59 |
| weshay | we killed the tebroker | 14:59 |
| weshay | \0/ | 14:59 |
| sshnaidm | quiquell, yeah, definitely | 14:59 |
| weshay | marios, scrum | 15:00 |
| weshay | https://bluejeans.com/5878458097 | 15:00 |
| chandankumar | panda: weshay: I have updated the cards, need to go, will miss the standup | 15:03 |
| panda | chandankumar: and the standup will miss you! | 15:04 |
| honza | chandankumar: i'm not really sure why we should remove the '.git' from the end. 'git clone' will work fine with both. there is a typo in the place where you left your comment "opentack" which has now been fixed | 15:07 |
| *** dsneddon has quit IRC | 15:10 | |
| weshay | rlandy, sshnaidm panda https://review.rdoproject.org/r/#/c/17740 | 15:15 |
| marios | needs something like https://review.rdoproject.org/r/#/c/17677 | 15:17 |
| marios | weshay: ^ | 15:17 |
| marios | scheduler - trace looks like http://pastebin.test.redhat.com/701557 | 15:18 |
| rlandy | weshay: panda: https://review.rdoproject.org/r/#/c/17740/ w+ | 15:19 |
| panda | rlandy: brace yourself | 15:20 |
| * rlandy is little scared | 15:20 | |
| *** ykarel is now known as ykarel|away | 15:22 | |
| weshay | sshnaidm, for me OS_TENANT_ID=4baea7454bf4451aa56da82fc5baf6f6 | 15:22 |
| marios | sshnaidm: you already have mine right? | 15:23 |
| marios | sshnaidm: OS_TENANT_ID=7d1975fb14d8451f9f1983cac340cb99 | 15:25 |
| *** ykarel|away is now known as ykarel | 15:26 | |
| honza | chandankumar: i think i see why now... it's an ansible thing | 15:28 |
| weshay | https://review.rdoproject.org/r/18502 Short term solution. Needs flag activation by user (we can do it in the generated script as a start) | 15:31 |
| arxcruz|ruck | weshay: still have some failed stacks, I'll open a ticket with rdo guys ok ? | 15:31 |
| arxcruz|ruck | or shall I run the script again ? | 15:31 |
| weshay | review.rdoproject.org/r/#/c/18279 launch job from role | 15:33 |
| weshay | review.rdoproject.org/r/#/c/18475 stream console log | 15:33 |
| weshay | Remove the scenario standalones from tht zuul layout - just use template review.openstack.org/#/c/632972 | 15:34 |
| panda | quiquell: review.rdoproject.org/r/#/c/18279 needs rebase | 15:37 |
| panda | quiquell: sorry, gertty is telling me lies. well it's failing all the checks | 15:38 |
| quiquell | panda: will do, I am figuring out why pip cannot install stuff at CI | 15:38 |
| quiquell | panda: still you can review to find bad stuff | 15:38 |
| *** dsneddon has joined #oooq | 15:38 | |
| *** ykarel is now known as ykarel|away | 15:38 | |
| quiquell | panda: so there two issues with CI, at centos7-host cannot install from pip and fedora28 has no unbound installed | 15:39 |
| quiquell | panda: do we install unbound at tripleo-ci-base or the like ? | 15:39 |
| panda | quiquell: install no, just making some fine tuning | 15:41 |
| quiquell | panda: CI(CI) logs http://logs.rdoproject.org/79/18279/42/check/tripleo-ci-reproducer-centos-7-host/f101d82/tripleo-ci-reproducer/logs/01/1001/1/check/hello-reproducer/0f05539/job-output.txt.gz | 15:41 |
| marios | weshay: this too please https://review.rdoproject.org/r/#/c/18454/ | 15:41 |
| *** dsneddon has quit IRC | 15:43 | |
| panda | quiquell: pyyaml ? | 15:46 |
| weshay | arxcruz|ruck, maybe we'll chat tomorrow morning about the cockpit | 15:46 |
| sshnaidm | weshay, arxcruz|ruck panda rlandy chandankumar kopecmartin panda marios please do now with your tenant credentials: for IMAGE_ID in 6a6d23d7-65e7-43ea-9307-71b2e17d2ead 88006cd1-d089-4bd3-b70a-8cbc7eb32f63 d3d4991a-e9ca-4072-bf6a-618874af7f74 d40c59c9-8d6b-4f59-983f-8eff071590ac; do openstack image set --accept ${IMAGE_ID} ; done | 15:46 |
| panda | quiquell: seems to be a temporary network error | 15:46 |
| weshay | arxcruz|ruck, see if you can get that running locally | 15:46 |
| arxcruz|ruck | ok, i'll rest a little bit, i'm with fever and flu, but i'm always around | 15:47 |
| arxcruz|ruck | sshnaidm: done | 15:48 |
| sshnaidm | and when doing openstack image list you will see: upstream-infra-centos-7 upstream-infra-fedora-28 upstream-cloudinit-centos-7 upstream-cloudinit-fedora-28 | 15:48 |
| quiquell | sshnaidm: cloudinit are public now they don't need to be shared | 15:49 |
| sshnaidm | quiquell, oh, right | 15:49 |
| rlandy | weshay: https://docs.google.com/document/d/11jiGCjgIVSRrG3WL3KhWMaBjzj18tcw0ElPDxbq9qvQ/edit#heading=h.e9vmq3osgwqc | 15:49 |
| quiquell | sshnaidm: we just need to update nodepool-launcher docker | 15:49 |
| marios | sshnaidm: ack (looks like the ones i already imported thanks noted for double check though) | 15:49 |
| quiquell | sshnaidm: also nodepool config ? | 15:49 |
| sshnaidm | quiquell, it's updated to latest and commit id | 15:49 |
| sshnaidm | quiquell, yeah, nodepool config and docker compose config | 15:50 |
| quiquell | sshnaidm: so we need a review with commit-id ? at docker-compose ? | 15:50 |
| sshnaidm | quiquell, but better to test it before | 15:50 |
| quiquell | sshnaidm: aslo people need a keypair created is that right ? | 15:50 |
| sshnaidm | quiquell, yep | 15:50 |
| sshnaidm | quiquell, it requires a userdata to be passed, it's in nodepool config | 15:50 |
| quiquell | We can put all that in a review | 15:50 |
| quiquell | sshnaidm: ack, let's see that in the revie w | 15:51 |
| quiquell | Have to drop now | 15:51 |
| sshnaidm | quiquell, ok, will do | 15:51 |
| sshnaidm | quiquell, cu | 15:51 |
| *** quiquell is now known as quiquell|off | 15:51 | |
| marios | weshay: panda rlandy sshnaidm updated if you have time to review thanks https://review.rdoproject.org/r/#/c/18454/ | 15:52 |
| *** udesale has quit IRC | 15:53 | |
| *** udesale has joined #oooq | 15:54 | |
| rlandy | marios: https://review.rdoproject.org/r/#/c/18454/ lgtm - if you have testproject results, pls paste link ... | 15:58 |
| *** dsneddon has joined #oooq | 16:00 | |
| rlandy | sshnaidm: do those images replace openstack-infra-centos-7 and openstack-infra-fedora-28 ? | 16:01 |
| sshnaidm | rlandy, yep | 16:01 |
| sshnaidm | rlandy, but for using cloud-init need another patches, | 16:01 |
| rlandy | sshnaidm: so I should delete those old image from my tenant before accepting these? | 16:02 |
| sshnaidm | rlandy, you can try non-cloud-init images | 16:02 |
| sshnaidm | rlandy, no, you can keep them | 16:02 |
| sshnaidm | rlandy, it's different names and IDs | 16:02 |
| rlandy | sshnaidm: ah ok | 16:02 |
| rlandy | sshnaidm: keys are already included? | 16:02 |
| sshnaidm | rlandy, yep | 16:02 |
| rlandy | ok - trying | 16:02 |
| sshnaidm | weshay, panda need to include in sprint: https://tree.taiga.io/project/tripleo-ci-board/task/644 | 16:03 |
| rlandy | here we go now | 16:03 |
| sshnaidm | weshay, updated https://tree.taiga.io/project/tripleo-ci-board/us/608 with a few tasks, is it better now? | 16:03 |
| sshnaidm | rlandy, but need to set their names in nodepool config | 16:03 |
| rlandy | sshnaidm: k - I have the four new images | 16:05 |
| sshnaidm | rlandy, yep, use for now w/o "cloud-init" in name | 16:05 |
| rlandy | sshnaidm: for multinode and ovb? | 16:05 |
| rlandy | sshnaidm: how is this scalable? | 16:05 |
| rlandy | ie: with keys for a larger group | 16:06 |
| rlandy | and adding people to rdo | 16:06 |
| rlandy | maybe this was covered in meeting | 16:06 |
| *** bogdando has quit IRC | 16:07 | |
| sshnaidm | rlandy, for all | 16:08 |
| sshnaidm | rlandy, keys won't be required when we'll switch to cloud-init images | 16:08 |
| sshnaidm | rlandy, image with keys is temporary solution for a few days | 16:08 |
| rlandy | sshnaidm: lastly - are latest reviews updated to use these new images or I should update nodepool config regardless? | 16:13 |
| marios | rlandy: thanks, i don't have testproject results there (the jobs ran previously see jan 9 comment @ https://review.rdoproject.org/r/#/c/18079/ https://review.rdoproject.org/r/#/c/18093/ https://review.rdoproject.org/r/#/c/18156/ ) | 16:14 |
| sshnaidm | rlandy, you can check what is defaults for image names | 16:14 |
| sshnaidm | rlandy, image names should be upstream-infra-centos-7 upstream-infra-fedora-28 | 16:15 |
| rlandy | k - will check | 16:15 |
| sshnaidm | rlandy, https://github.com/rdo-infra/ansible-role-tripleo-ci-reproducer/blob/665c73c63562d5d272470a62b6645ef7dbff14dd/defaults/main.yaml#L8-L9 | 16:15 |
| sshnaidm | user these vars | 16:15 |
| rlandy | yep | 16:16 |
| marios | rlandy: posted links too (in https://review.rdoproject.org/r/#/c/18454/ ) thanks | 16:16 |
| marios | rlandy: no need to check those other reviews i just put the links directly in ^ | 16:16 |
| marios | rlandy: (assuming that is what you meant thanks) | 16:17 |
| rlandy | marios; I'm ok to merge those - run in periodic but are not in promotion criteria | 16:17 |
| marios | rlandy: right exactly we aren't wiring them up to affect promotion yet | 16:18 |
| marios | rlandy: we just want to get them running for now | 16:19 |
| panda | marios: now that I think about it, we have some jobs currently gating, that are not in the promotion pipeline | 16:19 |
| marios | rlandy: weshay said he will also check them (you already voted i'm mostly respoding to your request ) | 16:19 |
| panda | marios: this usually leads to disasters. | 16:19 |
| rlandy | marios: well I have +2 there - not everyone has | 16:19 |
| marios | panda: ahem https://docs.openstack.org/tripleo-docs/latest/contributor/ci_primer.html "once a job is voting in check and gate you should add it to the promotion jobs so that tripleo promotions" | 16:20 |
| sshnaidm | panda, how do I get to old userstory about reproducer? | 16:20 |
| weshay | panda, marios once I see them run once or twice.. I'll then add them to criteria | 16:20 |
| marios | rlandy: thanks | 16:20 |
| marios | weshay: ack | 16:21 |
| rlandy | weshay: marios: ok - w+ that review | 16:21 |
| panda | marios: ... that's the opposite of what we usually do. Add it to the promotion and when they're stable add it to the gate, so we are not breaking somehting that can potentially block all other patches ... | 16:21 |
| marios | panda: well its ok to lie in docs no? | 16:21 |
| marios | just don't tell anyone | 16:22 |
| rlandy | depends who reads them | 16:22 |
| marios | exactly | 16:22 |
| marios | who reads docs anyway | 16:22 |
| rlandy | in our case, nobody | 16:22 |
| rlandy | so you're golden | 16:22 |
| marios | ++ | 16:22 |
| marios | thanks | 16:22 |
| panda | marios: oh, yeah, misdirection and subterfuge ... I'm in. | 16:22 |
| rlandy | Change has been successfully merged into the git repository by Zuul CI | 16:22 |
| rlandy | marios: you're armed and dangerous now | 16:23 |
| * rlandy runs away | 16:23 | |
| marios | :) | 16:23 |
| panda | sshnaidm: you're looking for user stories ? | 16:23 |
| *** ccamacho has quit IRC | 16:23 | |
| panda | sshnaidm: they should be in backlog or in the epic | 16:23 |
| sshnaidm | panda, I think we archived the old US for reproducer, there is data that I need.. | 16:23 |
| panda | sshnaidm: do you remember how it was called ? | 16:25 |
| sshnaidm | panda, nm, will look in different place | 16:25 |
| marios | weshay: weeelp. so much for rocky :/ https://review.openstack.org/#/c/631492/3 (just exploring but scen 1-4 red didn't dig yet though) | 16:26 |
| panda | sshnaidm: Archived I see https://tree.taiga.io/project/tripleo-ci-board/us/528?no-milestone=1 https://tree.taiga.io/project/tripleo-ci-board/us/283?no-milestone=1 , the others archived are empty | 16:26 |
| marios | weshay: oh cool.. might be ok actually (well we just don't know yet)... it failed cos can't find the envs :) cos they aren't on rocky obv... No such file or directory: '/home/zuul/tripleo-heat-installer-templates/ci/environments/scenario001-standalone.yaml'> http://logs.openstack.org/92/631492/3/check/tripleo-ci-centos-7-scenario001-standalone/f97d74a/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2019-01-24_13_52_01 | 16:27 |
| weshay | marios, ya.. that's next sprint work .. or maybe even two sprints out | 16:28 |
| weshay | oh. ok.. | 16:28 |
| marios | weshay: (yeah just exploring/low volume work here https://tree.taiga.io/project/tripleo-ci-board/task/625) | 16:29 |
| marios | sshnaidm: you guys have the dust today? /me want to go running but there are health warnings | 16:29 |
| rlandy | anything else need to merge today? | 16:31 |
| rlandy | panda: marios: ^^?? | 16:31 |
| marios | rlandy: i'm ok thanks | 16:31 |
| weshay | ssbarnea|rover, I see 4 delete failed stacks left.. | 16:31 |
| rlandy | ok | 16:31 |
| weshay | is the the tool able to get those? | 16:31 |
| panda | rlandy: wait a sec, I'm randomly generate fake review for you to merge | 16:32 |
| rlandy | panda; -2 | 16:33 |
| panda | sshnaidm: #644 moved to #608 on UniSprint 4 | 16:34 |
| panda | sshnaidm: parked | 16:34 |
| sshnaidm | panda, it could be "done" | 16:35 |
| panda | sshnaidm: I'll let you do the honors | 16:35 |
| *** panda is now known as panda|off | 16:40 | |
| *** sanjayu_ has quit IRC | 16:41 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-quickstart-extras-gate- (2 more messages) | 16:41 |
| marios | ttyl bai | 16:42 |
| *** jfrancoa has quit IRC | 16:44 | |
| rlandy | weshay: did you make any progress with installing/running reproducer | 16:58 |
| weshay | sshnaidm, added https://tree.taiga.io/project/tripleo-ci-board/us/515?milestone=215191 to the sprint | 16:58 |
| sshnaidm | weshay, ok | 16:58 |
| weshay | rlandy, I tried a bit more but didn't get any further | 16:58 |
| weshay | about to setup again | 16:58 |
| weshay | sshnaidm, /me checks my tenant for image | 16:59 |
| sshnaidm | weshay, do the command I pasted above | 16:59 |
| * weshay looks | 16:59 | |
| sshnaidm | weshay, with "accept" | 16:59 |
| ssbarnea|rover | weshay: arxcruz|ruck : please test new cleanup https://review.rdoproject.org/r/#/c/18517/ | 16:59 |
| weshay | for IMAGE_ID in 6a6d23d7-65e7-43ea-9307-71b2e17d2ead 88006cd1-d089-4bd3-b70a-8cbc7eb32f63 d3d4991a-e9ca-4072-bf6a-618874af7f74 d40c59c9-8d6b-4f59-983f-8eff071590ac; do openstack image set --accept ${IMAGE_ID} ; done | 17:00 |
| weshay | k | 17:00 |
| *** agopi is now known as agopi|lunch | 17:02 | |
| weshay | sshnaidm, thanks | 17:03 |
| weshay | ssbarnea|rover, are you running it now? | 17:04 |
| weshay | ssbarnea|rover, arxcruz|ruck bluejeans if you can | 17:07 |
| arxcruz|ruck | weshay: just a sec | 17:07 |
| weshay | ssbarnea|rover, ? | 17:11 |
| *** holser_ is now known as holser|eod | 17:13 | |
| ssbarnea|rover | weshay: not running it now but I see on tmate that you are stillrunning it. | 17:16 |
| weshay | ha.. thanks | 17:16 |
| weshay | ssbarnea|rover, was explaining to arxcruz|ruck when you have stacks that do not end up getting deleted... | 17:17 |
| ssbarnea|rover | weshay: joined you bj | 17:17 |
| weshay | the next step is to open a ticket w/ ops and ping them in #rhos-ops internal | 17:17 |
| weshay | w/ the failed stack ids | 17:17 |
| weshay | ssbarnea|rover, it's important because they can at times hold an ip and neutron will try to reallocate the ip | 17:17 |
| *** kopecmartin is now known as kopecmartin|off | 17:18 | |
| weshay | ssbarnea|rover, we dropped | 17:18 |
| weshay | arxcruz|ruck, I didn't realize the script hadn't completed | 17:19 |
| weshay | I think it's on the last stack now | 17:19 |
| arxcruz|ruck | weshay: still those 4 stacks are not getting deleted | 17:19 |
| ssbarnea|rover | weshay: try the new one. i managed to grind lots of lines from it. | 17:19 |
| weshay | ssbarnea|rover, k k.. I think you need to add a yum/dnf install to the patch | 17:20 |
| ssbarnea|rover | true, it could be an issue with the cloud, not necessarily a bug in script. | 17:20 |
| weshay | ssbarnea|rover, arxcruz|ruck there are some stack failures that require an admin to fix a thing or two | 17:20 |
| weshay | then we can delete | 17:20 |
| ssbarnea|rover | add comments there. i will try to fix all comments. mainly I didn't bother because on mac i have to do "brew install coreutils" instead of "yum" :D | 17:21 |
| ssbarnea|rover | it can be also done in pure bash, without ts but there is an ugly ~10 line function that does replace ts. | 17:22 |
| ssbarnea|rover | weshay: do you want me to go deeper on those not yet deleted stacks? | 17:27 |
| *** ccamacho has joined #oooq | 17:28 | |
| weshay | ssbarnea|rover, in the script? I mean.. when you have resources that wont delete in a stack... | 17:30 |
| weshay | the idea is to pick the resources apart in order and delete them | 17:31 |
| weshay | or try to | 17:31 |
| weshay | can we go any deeper than that/ | 17:31 |
| weshay | ? | 17:31 |
| ssbarnea|rover | weshay: found bug in script, why not deleting them, fixing it.... | 17:36 |
| weshay | ssbarnea|rover, \0/ | 17:37 |
| weshay | arxcruz|ruck, ^ | 17:37 |
| arxcruz|ruck | ssbarnea|rover++ | 17:37 |
| hubbot1 | arxcruz|ruck: ssbarnea|rover's karma is now 4 | 17:37 |
| weshay | rlandy, any latest pastebin's w/ the script? | 17:38 |
| weshay | arxcruz|ruck, ssbarnea|rover stacks are clean.. thanks! | 17:44 |
| ssbarnea|rover | weshay: arxcruz|ruck : test/review https://review.rdoproject.org/r/18517 -- it contains the delete fix. i will be out for the next hour, need to do my swim. | 17:47 |
| weshay | ssbarnea|rover, k k | 17:47 |
| weshay | thanks | 17:47 |
| rlandy | weshay: sorry lunch - looking now | 17:56 |
| rlandy | weshay: you can run any reproducer luancher-playbook from https://review.openstack.org/#/c/631067/ | 17:57 |
| rlandy | https://paste.fedoraproject.org/paste/3kK8tkmKCipwDUa-NJPPGA | 17:57 |
| rlandy | was the original paste | 17:57 |
| weshay | cool.. I was looking at that review.. | 17:58 |
| weshay | thanks | 17:58 |
| *** trown is now known as trown|lunch | 17:59 | |
| rlandy | weshay: I'm trying to run now with new images | 17:59 |
| weshay | cool | 18:00 |
| * weshay is cleaning out my keys | 18:00 | |
| weshay | does this key strike joy into my life... no... toss | 18:00 |
| rlandy | weshay: you may need to burn donw your computer | 18:00 |
| weshay | does this key strike joy into my life... no... toss | 18:00 |
| weshay | does this key strike joy into my life... no... toss | 18:00 |
| weshay | :) | 18:00 |
| weshay | am I the only one left that uses.. shell.eng.rdu.redhat.com? | 18:01 |
| *** udesale has quit IRC | 18:01 | |
| rlandy | probably | 18:01 |
| rlandy | and the guy on the vax | 18:01 |
| rlandy | 'does this key strike joy into my life' - my friend was tell me about that podcast | 18:02 |
| rlandy | I'd wouldn't own anything left | 18:03 |
| weshay | lolz | 18:03 |
| rlandy | so I decided against it | 18:03 |
| *** agopi|lunch has joined #oooq | 18:08 | |
| *** agopi|lunch is now known as agopi | 18:08 | |
| *** derekh has quit IRC | 18:09 | |
| *** jpena is now known as jpena|off | 18:28 | |
| *** ccamacho has quit IRC | 18:38 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-quickstart-extras-gate- (2 more messages) | 18:42 |
| *** ykarel|away has quit IRC | 18:52 | |
| rlandy | sshnaidm: do you know if it is possible to edit the ansible roles path within a playbook | 18:52 |
| rlandy | like clone a new repo | 18:52 |
| rlandy | and use roles from there | 18:53 |
| weshay | rlandy, you could do it the other way and clone in the current role path | 18:53 |
| weshay | or softlink | 18:53 |
| rlandy | weshay: I cloned the whole repo in playbook_dir | 18:54 |
| rlandy | but path to roles in two dirs down in the repo | 18:54 |
| rlandy | playbook dir is in the role path | 18:54 |
| weshay | and it's not recongnized? | 18:55 |
| rlandy | I could copy the roles | 18:55 |
| rlandy | but seems the wring way | 18:55 |
| rlandy | wrong | 18:55 |
| rlandy | weshay: trying to clone tq for libvirt within the libvirt task | 18:56 |
| * rlandy could try that | 18:56 | |
| weshay | so imho.. clone everything you need upfront | 18:57 |
| weshay | not adhoc | 18:57 |
| weshay | put the roles in a single dir | 18:57 |
| weshay | you can export the role path as env var | 18:57 |
| rlandy | ha | 19:03 |
| rlandy | that worked though | 19:03 |
| weshay | down to one key | 19:07 |
| weshay | w/ -m | 19:07 |
| *** agopi_ has joined #oooq | 19:08 | |
| sshnaidm | rlandy, what do you mean? which roles? | 19:08 |
| rlandy | libvirt roles | 19:10 |
| rlandy | seems to work though | 19:10 |
| rlandy | if you are not in ci you have to clone tq | 19:10 |
| *** agopi has quit IRC | 19:11 | |
| rlandy | in the CI system, tq is just there | 19:14 |
| rlandy | it's when you run as a user, you have a problem | 19:15 |
| weshay | sshnaidm, the images I imported are not named openstack-infra-centos-7 and f28 | 19:18 |
| weshay | are we expected to copy the image? | 19:18 |
| weshay | or is there a pending review | 19:18 |
| * weshay looks | 19:18 | |
| rlandy | weshay: you need to make an edit to config - getting | 19:18 |
| sshnaidm | weshay, you can set names in parameters | 19:18 |
| weshay | rlandy, I see it | 19:19 |
| weshay | https://review.rdoproject.org/r/#/c/18515/1/defaults/main.yaml | 19:19 |
| rlandy | yep | 19:19 |
| weshay | sshnaidm, that's kind of an odd answer :) | 19:20 |
| *** agopi__ has joined #oooq | 19:23 | |
| sshnaidm | weshay, this review works partially, need to try "stable" containers.. | 19:23 |
| weshay | rlandy, sshnaidm have an issue w/ docker-compose logs | 19:24 |
| weshay | :( | 19:24 |
| rlandy | again??? | 19:24 |
| sshnaidm | weshay, logs? | 19:24 |
| rlandy | weshay: same error? | 19:24 |
| weshay | sshnaidm, I think ansible is f.. w/ docker-compose logs | 19:24 |
| weshay | ya | 19:24 |
| rlandy | oh dear | 19:24 |
| weshay | docker-compose logs --tail=10 -f thinkdoe ⌚ 12:24:01 | 19:24 |
| weshay | WARNING: The no_proxy variable is not set. Defaulting to a blank string. | 19:24 |
| weshay | Attaching to | 19:24 |
| sshnaidm | weshay, what does it mean? | 19:24 |
| weshay | it means I can't see the compose logs | 19:25 |
| rlandy | how long did you wait for response? | 19:25 |
| sshnaidm | weshay, it means container didn't start yet | 19:25 |
| weshay | sshnaidm, bluejeans please | 19:25 |
| *** agopi_ has quit IRC | 19:25 | |
| *** agopi__ is now known as agopi | 19:26 | |
| sshnaidm | weshay, do you hear me? | 19:27 |
| weshay | no | 19:28 |
| weshay | sshnaidm, don't worry about it.. | 19:28 |
| weshay | it's late for u | 19:28 |
| weshay | and it's thrsday | 19:28 |
| weshay | sshnaidm, I catch up w/ you sunday or monday | 19:28 |
| weshay | :) | 19:28 |
| weshay | have a good weekend | 19:28 |
| sshnaidm | weshay, better to open tmate.. | 19:28 |
| sshnaidm | weshay, ok, ask quiquell|off to see then | 19:29 |
| weshay | sshnaidm, ya.. but I should really confirm this on multiple systems | 19:29 |
| weshay | rlandy, I fixed the keys! | 19:30 |
| rlandy | weshay: you did??? | 19:30 |
| rlandy | how? | 19:30 |
| weshay | -m worked :) | 19:30 |
| rlandy | -m on which command? | 19:30 |
| weshay | quiquell++ | 19:30 |
| rlandy | logs | 19:30 |
| weshay | sshnaidm++ | 19:30 |
| hubbot1 | weshay: sshnaidm's karma is now 12 | 19:30 |
| rlandy | nice | 19:30 |
| weshay | localhost : ok=34 changed=7 unreachable=0 failed=0 | 19:31 |
| rlandy | good | 19:31 |
| weshay | I see gerrit | 19:31 |
| weshay | now I'm lost | 19:31 |
| weshay | lolz | 19:31 |
| weshay | meh | 19:31 |
| weshay | HOOOOO RAAAY | 19:31 |
| weshay | rlandy, where is launcher-playbook.yaml supposed to land? | 19:34 |
| rlandy | ugh ... fatal: [localhost]: FAILED! => {"changed": false, "msg": "The `libvirt` module is not importable. Check the requirements."} | 19:35 |
| rlandy | weshay: you pick the destination | 19:35 |
| rlandy | you can wget it anywher | 19:35 |
| sshnaidm | weshay, seems like CI for OVB master doesn't work, it doesn't use master branch.. will talk with infra next week | 19:35 |
| rlandy | it's just in the logs | 19:35 |
| *** sshnaidm is now known as sshnaidm|off | 19:36 | |
| rlandy | running libvirt is less than exciting | 19:36 |
| weshay | rlandy, ok.. I just ran your pasted playbook.. so now I'll try the script in ci logs | 19:36 |
| rlandy | k | 19:37 |
| *** tosky has quit IRC | 19:44 | |
| weshay | rlandy, hrm.. I may need a bit of a show and tell for 5 | 19:48 |
| rlandy | weshay: ok | 19:48 |
| rlandy | your blue? | 19:48 |
| weshay | ./reproducer-zuul-based-quickstart.sh -w /var/tmp/RECREATE | 19:48 |
| weshay | sure.. thank you | 19:48 |
| weshay | http://pastebin.test.redhat.com/701788 | 19:57 |
| weshay | rlandy, https://storyboard.openstack.org/#!/story/2004842 | 20:01 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053 @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode- (2 more messages) | 20:42 |
| *** ssbarnea|bkp2 has joined #oooq | 21:32 | |
| *** ssbarnea|rover has quit IRC | 21:33 | |
| *** trown|lunch is now known as trown|outtypewww | 21:48 | |
| *** agopi has quit IRC | 22:05 | |
| *** vkapalav has quit IRC | 22:12 | |
| *** ssbarnea|rover has joined #oooq | 22:14 | |
| *** ssbarnea|bkp2 has quit IRC | 22:16 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053 @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode- (2 more messages) | 22:42 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!