| *** lucasagomes has quit IRC | 00:06 | |
| *** sshnaidm|off has quit IRC | 00:06 | |
| *** rnoriega has quit IRC | 00:06 | |
| *** matbu has quit IRC | 00:06 | |
| *** lhinds has quit IRC | 00:06 | |
| *** tbarron has quit IRC | 00:06 | |
| *** bandini has quit IRC | 00:09 | |
| *** bandini has joined #oooq | 00:11 | |
| *** lucasagomes has joined #oooq | 00:15 | |
| *** sshnaidm|off has joined #oooq | 00:15 | |
| *** rnoriega has joined #oooq | 00:15 | |
| *** matbu has joined #oooq | 00:15 | |
| *** lhinds has joined #oooq | 00:15 | |
| *** tbarron has joined #oooq | 00:15 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000 (1 more message) | 00:31 |
|---|---|---|
| *** agopi has joined #oooq | 02:17 | |
| *** rlandy|bbl is now known as rlandy | 02:17 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000 (1 more message) | 02:31 |
| *** links has joined #oooq | 02:40 | |
| *** skramaja has joined #oooq | 03:09 | |
| *** skramaja_ has joined #oooq | 03:14 | |
| *** skramaja has quit IRC | 03:14 | |
| *** skramaja_ is now known as skramaja | 03:29 | |
| *** ykarel has joined #oooq | 03:52 | |
| *** udesale has joined #oooq | 04:07 | |
| *** jfrancoa has joined #oooq | 04:15 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, (1 more message) | 04:31 |
| *** jaganathan has joined #oooq | 04:37 | |
| *** saneax has joined #oooq | 04:37 | |
| *** saneax has quit IRC | 05:24 | |
| *** kopecmartin has joined #oooq | 05:29 | |
| *** quiquell|off is now known as quiquell | 05:31 | |
| *** saneax has joined #oooq | 05:32 | |
| *** ratailor has joined #oooq | 05:37 | |
| *** hubbot has quit IRC | 05:48 | |
| *** gchamoul has quit IRC | 05:48 | |
| *** zoli has quit IRC | 05:48 | |
| *** dmellado has quit IRC | 05:48 | |
| *** gvrangan has joined #oooq | 05:53 | |
| *** zoli has joined #oooq | 05:53 | |
| *** bogdando has joined #oooq | 05:53 | |
| quiquell | marios: Rechecked your change on reproducer about workspace | 05:57 |
| marios | quiquell: ah thanks | 05:57 |
| marios | quiquell: is that a new thing the timeout on scen 3 /do you know anything about it? | 05:58 |
| *** gchamoul has joined #oooq | 05:58 | |
| quiquell | chkumar|ruck: ^ any new issue with tiemouts ? | 06:00 |
| chkumar|ruck | quiquell: cockpit is not working for me | 06:05 |
| quiquell | chkumar|ruck: Let me check | 06:05 |
| quiquell | chkumar|ruck: Damn, has just go down now... | 06:05 |
| quiquell | chkumar|ruck: I think RDO is down | 06:09 |
| quiquell | chkumar|ruck: Cannot list the servers from my tenant | 06:09 |
| *** bogdando has quit IRC | 06:24 | |
| *** bogdando has joined #oooq | 06:26 | |
| *** bogdando has quit IRC | 06:26 | |
| *** bogdando has joined #oooq | 06:27 | |
| *** udesale_ has joined #oooq | 06:28 | |
| *** dmellado has joined #oooq | 06:29 | |
| *** udesale has quit IRC | 06:30 | |
| *** hubbot has joined #oooq | 06:30 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, (1 more message) | 06:31 |
| quiquell | chkumar|ruck: Is back | 06:32 |
| quiquell | chkumar|ruck: Have to do some more changes to the rrcockpit, will be in and out today | 06:39 |
| chkumar|ruck | quiquell: sure | 06:39 |
| *** rlandy has quit IRC | 06:45 | |
| *** brault has joined #oooq | 06:48 | |
| *** tesseract has joined #oooq | 07:02 | |
| *** sanjayu_ has joined #oooq | 07:04 | |
| *** jtomasek has joined #oooq | 07:05 | |
| *** saneax has quit IRC | 07:05 | |
| *** amoralej|off is now known as amoralej | 07:11 | |
| *** vinaykns has quit IRC | 07:12 | |
| amoralej | good morning | 07:13 |
| amoralej | may i get +W in https://review.openstack.org/#/c/582327/ ? | 07:13 |
| *** ccamacho has joined #oooq | 07:22 | |
| chkumar|ruck | quiquell: sshnaidm|off currently scenario 1, 2, and 4 are failing with this issue https://bugs.launchpad.net/tripleo/+bug/1782598 FYI | 07:25 |
| openstack | Launchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh) | 07:25 |
| chkumar|ruck | in gates | 07:25 |
| chkumar|ruck | https://review.openstack.org/#/c/581759/ review might the issue also | 07:26 |
| *** tosky has joined #oooq | 07:27 | |
| *** matbu has quit IRC | 07:29 | |
| *** hamzy_ has joined #oooq | 07:31 | |
| *** agopi_ has joined #oooq | 07:31 | |
| *** hamzy has quit IRC | 07:31 | |
| *** agopi has quit IRC | 07:32 | |
| *** udesale__ has joined #oooq | 07:33 | |
| *** udesale_ has quit IRC | 07:36 | |
| *** gkadam has joined #oooq | 07:37 | |
| *** matbu has joined #oooq | 07:41 | |
| *** holser_ has joined #oooq | 07:44 | |
| *** gvrangan has quit IRC | 07:47 | |
| *** hamzy_ has quit IRC | 07:50 | |
| *** chem has joined #oooq | 07:51 | |
| *** ykarel is now known as ykarel|lunch | 08:05 | |
| *** dsneddon has quit IRC | 08:06 | |
| *** dsneddon has joined #oooq | 08:08 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq-container, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000 (1 more message) | 08:32 |
| *** panda|off is now known as panda | 08:51 | |
| *** gvrangan has joined #oooq | 08:52 | |
| quiquell | chkumar|ruck: This is known ? http://logs.openstack.org/79/583179/4/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/2ed31e8/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-20_08_34_27 | 08:53 |
| quiquell | panda: Do you have time to make some sync at bj ? | 08:55 |
| chkumar|ruck | quiquell: yes | 08:56 |
| quiquell | chkumar|ruck: ack, thanks | 08:57 |
| chkumar|ruck | quiquell: https://bugs.launchpad.net/tripleo/+bug/1782598 | 08:57 |
| openstack | Launchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh) | 08:57 |
| chkumar|ruck | quiquell: the author is saying to revert the patch | 08:57 |
| quiquell | chkumar|ruck: What patch ? | 08:57 |
| chkumar|ruck | quiquell: panda https://review.openstack.org/#/c/581759/ has started causing it | 08:58 |
| chkumar|ruck | quiquell: will i revert it and check? | 08:58 |
| quiquell | chkumar|ruck: You can revert it, and do a test review with a Depends-On on the revert | 09:01 |
| quiquell | chkumar|ruck: to enxure su exercise the propert jobs | 09:01 |
| quiquell | ensure, proper | 09:01 |
| *** ykarel|lunch is now known as ykarel | 09:04 | |
| panda | chkumar|ruck: Martin said to revert it ? | 09:06 |
| panda | quiquell: yes | 09:06 |
| chkumar|ruck | panda: owlas told me to revert it and try it | 09:06 |
| chkumar|ruck | panda: quiquell https://review.openstack.org/#/c/584284/ | 09:06 |
| quiquell | chkumar|ruck: Good enough but put a DNM in the revert, it's just a test | 09:08 |
| quiquell | chkumar|ruck: You can use a reproducer too | 09:08 |
| quiquell | panda: https://bluejeans.com/7891065232 | 09:09 |
| *** jbadiapa has quit IRC | 09:28 | |
| *** links has quit IRC | 09:29 | |
| *** hamzy_ has joined #oooq | 09:31 | |
| *** jbadiapa has joined #oooq | 09:43 | |
| jfrancoa | quiquell: panda: one question when you have some time, why can't I see the newly added /tmp/ansible-mistral-action/ in the CI job logs? https://review.openstack.org/#/c/583896/ | 09:45 |
| *** sshnaidm|off has quit IRC | 09:50 | |
| quiquell | jfrancoa: Where are you looking ? | 09:58 |
| jfrancoa | quiquell: I checked in the multinode upgrades job, I expected finding under undercloud/ a /tmp directory | 09:59 |
| jfrancoa | quiquell: where the newly added folder would be stored | 09:59 |
| quiquell | jfrancoa: I see some issues here http://logs.openstack.org/96/583896/1/check/tripleo-ci-centos-7-undercloud-containers/cbad66d/logs/quickstart_collect_logs.log | 10:02 |
| quiquell | TASK [collect-logs : Gather the logs to /tmp] | 10:03 |
| quiquell | link has no referent: \"/etc/docker/certs.d/registry.access.redhat.com/redhat-ca.crt\"\nrsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1178) [sender=3.1.2]", "stderr_lines": ["symlink has no referent: \"/var/log/config-data/neutron/etc/neutron/plugin.ini\"", "symlink has no referent: \"/etc/docker/certs.d/redhat.io/redhat-ca.crt\"", "symlink has no referent: | 10:03 |
| quiquell | \"/etc/docker/certs.d/redhat.com/redhat-ca.crt\"", "symlink has no referent: \"/etc/docker/certs.d/registry.access.redhat.com/redhat-ca.crt\"", "rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1178) [sender=3.1.2]"], "stdout": "", "stdout_lines": []} | 10:03 |
| *** jbadiapa is now known as jbadiapa|away | 10:06 | |
| jfrancoa | quiquell: yes, but I don't think that's related to the new line I added. Other issue could be that this is causing the rsync process to fail and my directory doesn't get collected | 10:06 |
| jfrancoa | quiquell: will investigate, thanks | 10:07 |
| jfrancoa | quiquell: I'll try to run the role in my local environment | 10:07 |
| quiquell | jfrancoa: Put your line in the top of the list, to check if it rsynced first | 10:08 |
| quiquell | jfrancoa: Maybe there is something inside of it that rsync doesn't like | 10:08 |
| jfrancoa | quiquell: good tip ;-), I'll give it a try | 10:08 |
| panda | hmm | 10:08 |
| panda | I see we have other /tmp/ lines in the include path, but they are not honoured | 10:09 |
| quiquell | panda: That's the only /tmp/ in the list | 10:09 |
| jfrancoa | quiquell: panda thanks for the help, changed the order to narrow down the issue | 10:12 |
| panda | jfrancoa: thos files in tmp, are tehy file, sockets, links ? | 10:17 |
| jfrancoa | panda: I added the expression /tmp/ansible-mistral-action* , so it collects all the directories matching that expression. These directories include the ansible config files and commands used to run a playbook via mistral | 10:18 |
| jfrancoa | panda: the content of these directories is something like this: http://pastebin.test.redhat.com/621015 | 10:20 |
| quiquell | jfrancoa: Any of this is a symlink ? | 10:20 |
| panda | jfrancoa: that's why it's not working | 10:22 |
| panda | jfrancoa: if they are dir you have to put / at the end | 10:22 |
| panda | jfrancoa: because the full pattern would be ansible-*/** | 10:23 |
| quiquell | that's it... | 10:23 |
| panda | jfrancoa: iyou can either use this pattern, or just add / at the end, and the role will do it for you | 10:23 |
| panda | jfrancoa: if you're not sure about what to do, thos pattern are rsync filter patterns, you can take a look at the rsync documentation for help | 10:24 |
| chkumar|ruck | quiquell: Hello | 10:24 |
| panda | jfrancoa: they are put together in a single filter file | 10:24 |
| chkumar|ruck | quiquell: can you confirm 2f5a5f68-b9a2-4a8b-94f8-dc07b5fd72e5 | 10:25 |
| chkumar|ruck | 46c037ac-d8eb-4f64-82c5-3fb6636c2398 | 10:25 |
| chkumar|ruck | these two stacks got deleted | 10:25 |
| quiquell | chkumar|ruck: Have to leave for a few minutes, will check later on | 10:26 |
| *** quiquell is now known as quiquell|brb | 10:26 | |
| chkumar|ruck | quiquell|brb: if got deleted, just let kforde know on internal channel | 10:27 |
| chkumar|ruck | quiquell|brb: https://tickets.osci.io/rt/Ticket/Display.html?id=738 ticket link, thanks :-) | 10:29 |
| *** quiquell|brb is now known as quiquell | 10:29 | |
| jfrancoa | panda: ok, that makes sense, I missed the fact that all collected directories ended with /. I'll modify it. thank you | 10:29 |
| *** dtantsur|afk is now known as dtantsur | 10:31 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, (1 more message) | 10:32 |
| quiquell | chkumar|ruck: They are gone | 10:46 |
| bogdando | folks, https://review.openstack.org/#/c/465047/ is good to go! | 10:51 |
| bogdando | marios: ^^ | 10:51 |
| bogdando | PTAL | 10:51 |
| quiquell | chkumar|ruck: rrcockpit up again at http://38.145.34.131/d/IGPvpqOmz/cockpit?orgId=1 | 10:55 |
| chkumar|ruck | quiquell: thanks :-) | 10:59 |
| *** udesale__ has quit IRC | 11:19 | |
| *** links has joined #oooq | 11:32 | |
| quiquell | panda: Can you merge this ? https://review.rdoproject.org/r/#/c/14906/ | 11:33 |
| quiquell | for the rrcockpit | 11:33 |
| chkumar|ruck | myoung: weshay https://review.rdoproject.org/etherpad/p/tripleo-tempest-sprint17 | 11:36 |
| chkumar|ruck | please have a look | 11:36 |
| *** jbadiapa|away is now known as jbadiapa | 11:58 | |
| *** jaganathan has quit IRC | 12:01 | |
| *** trown|outtypewww is now known as trown | 12:04 | |
| weshay | chkumar|ruck, thanks | 12:14 |
| weshay | chkumar|ruck, so.. I think we could start and finish the integration of the tempest role into infrared in one sprint right? | 12:15 |
| weshay | martin and luigi would be interested parties there | 12:15 |
| chkumar|ruck | weshay: splitting will be done for sure, integration may take time based on the problems we have in that journey | 12:15 |
| weshay | hrm | 12:16 |
| quiquell | weshay: do you have some time to sync with panda about sprint stuff ? | 12:16 |
| quiquell | weshay: Good morning btw | 12:16 |
| weshay | morning.. quiquell ya | 12:17 |
| quiquell | panda: ^ | 12:17 |
| quiquell | panda: ready ? | 12:17 |
| chkumar|ruck | weshay: few updates https://bugs.launchpad.net/tripleo/+bug/1782598 blocked scenario1 and 2 jobs | 12:17 |
| openstack | Launchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh) | 12:17 |
| weshay | chkumar|ruck, how familiar are you w/ elastic-recheck | 12:18 |
| chkumar|ruck | we have reverted one patch https://review.openstack.org/#/c/584288/ and testing here https://review.openstack.org/#/c/584284/ | 12:19 |
| *** agopi_ has quit IRC | 12:22 | |
| *** dtantsur is now known as dtantsur|brb | 12:23 | |
| honza | weshay: undercloud seems to have installed without errors; now i'm trying to connect to it from the browser --- is there a step i'm missing? i'm getting timeouts... | 12:23 |
| weshay | honza, what are your debug steps? | 12:26 |
| weshay | panda, how can I help? | 12:27 |
| honza | weshay: i haven't really delved into it yet, my first step would be to check iptables | 12:27 |
| weshay | ya.. and the sec group | 12:29 |
| quiquell | weshay: new url for rrcockpit http://38.145.34.131/d/IGPvpqOmz/cockpit?orgId=1 | 12:29 |
| weshay | quiquell, nice | 12:31 |
| weshay | quiquell, I still don't get the CI stats, 89.1% fail 10.9% pass section | 12:31 |
| *** rlandy has joined #oooq | 12:31 | |
| panda | quiquell: sorry, was having lunch | 12:32 |
| panda | quiquell: ready now | 12:32 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq-container, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000 (1 more message) | 12:32 |
| quiquell | panda: ok | 12:33 |
| weshay | quiquell, ? | 12:33 |
| quiquell | weshay, panda: https://bluejeans.com/7891065232 | 12:33 |
| *** ratailor has quit IRC | 12:34 | |
| quiquell | weshay: about 90% failure I see a lot of NODE_FAILURE, maybe chkumar|ruck knows more | 12:35 |
| weshay | quiquell, getting called into dbecker's mtg | 12:35 |
| chkumar|ruck | weshay: quiquell currently rabbitmq is misbehaving on rdo cloud | 12:35 |
| weshay | quiquell, yes | 12:35 |
| weshay | quiquell, it's in the notes | 12:36 |
| rlandy | trown: hello - sorry to bother you from your new work - you added the nodepool-setup tasks. Where is that equivalent work done in CI? | 12:36 |
| weshay | quiquell, line 87 https://review.rdoproject.org/etherpad/p/ruckrover-sprint16 | 12:36 |
| quiquell | weshay: We are at bj | 12:36 |
| quiquell | https://bluejeans.com/7891065232 | 12:37 |
| weshay | quiquell, ya.. I'll be a few.. dbecker just pulled me into a diff mtg | 12:37 |
| quiquell | weshay: Ahh ok no hurries | 12:37 |
| weshay | sorry | 12:37 |
| Tengu | need a weshay.fork() | 12:37 |
| rlandy | ykarel: ^^ in particular, you added https://github.com/openstack/tripleo-quickstart-extras/blame/master/roles/nodepool-setup/tasks/clone-ci-repos.yml#L32 - do you know where that equivalent is in CI? | 12:37 |
| quiquell | weshay: Just ping us when you are ready | 12:38 |
| *** ccamacho has quit IRC | 12:39 | |
| ykarel | rlandy, reading back | 12:39 |
| ykarel | rlandy, you mean purpose of nodepool-setup role | 12:41 |
| rlandy | ykarel: I have something working in the reproducer | 12:42 |
| rlandy | but in CI, I can;t get it to pick up the change | 12:42 |
| rlandy | I am adding a new repo | 12:43 |
| rlandy | that should function like tqe | 12:43 |
| rlandy | I see that you added the line to pick up the local tqe | 12:43 |
| rlandy | I need to pick up the local copy of browbeat - the new repo in CI | 12:43 |
| rlandy | ykarel: https://review.openstack.org/#/c/581488/18/roles/nodepool-setup/tasks/clone-ci-repos.yml - I am using that in the reproducer | 12:44 |
| *** quiquell is now known as quiquell|lunch | 12:44 | |
| ykarel | rlandy, i just added \n :), rest was already there | 12:44 |
| rlandy | oh, ok | 12:44 |
| rlandy | nvm then | 12:44 |
| rlandy | I will wait for trown | 12:44 |
| rlandy | I need to know where he copied these steps from to make the nodepool-setup role | 12:45 |
| ykarel | rlandy, you mean that depends-on not working or soemething else | 12:45 |
| *** d0ugal has quit IRC | 12:45 | |
| ykarel | okk | 12:45 |
| rlandy | ykarel: no | 12:45 |
| rlandy | I am missing that one line somewhere | 12:45 |
| *** d0ugal has joined #oooq | 12:45 | |
| *** d0ugal has quit IRC | 12:45 | |
| *** d0ugal has joined #oooq | 12:45 | |
| *** sshnaidm|off has joined #oooq | 12:48 | |
| ykarel | rlandy, may be for now you can try https://github.com/openstack-infra/tripleo-ci/blob/f221ec482efdeeb6c455b492b93010b84e387561/toci_gate_test.sh#L226-L232 | 12:48 |
| ykarel | if it's just for testing | 12:48 |
| rlandy | yakrel: I have the reproducer for testing | 12:48 |
| rlandy | ykarel: ^^ | 12:49 |
| rlandy | I need this to work in CI | 12:49 |
| rlandy | I see how upgrades is done | 12:49 |
| rlandy | that is another option | 12:49 |
| rlandy | if we choose to go that way | 12:49 |
| ykarel | rlandy, ack | 12:49 |
| rlandy | ykarel: I was trying to follow the pattern from tqe exactly but toci_gate_test.sh is not a bad idea | 12:50 |
| *** chem has quit IRC | 12:55 | |
| *** d0ugal has quit IRC | 12:57 | |
| *** chem has joined #oooq | 12:58 | |
| *** kopecmartin has quit IRC | 13:00 | |
| weshay | quiquell|lunch, panda sorry ready now | 13:01 |
| quiquell|lunch | weshay: need a minute | 13:02 |
| weshay | k | 13:02 |
| *** quiquell|lunch is now known as quiquell | 13:05 | |
| quiquell | weshay, panda: ready | 13:05 |
| *** bogdando has quit IRC | 13:08 | |
| *** d0ugal has joined #oooq | 13:10 | |
| *** bogdando has joined #oooq | 13:10 | |
| *** ccamacho has joined #oooq | 13:10 | |
| *** gvrangan has quit IRC | 13:19 | |
| chkumar|ruck | weshay: quiquell I am heading home | 13:25 |
| chkumar|ruck | see ya tomorrow :-) | 13:25 |
| *** agopi has joined #oooq | 13:25 | |
| *** skramaja has quit IRC | 13:26 | |
| honza | weshay: iptables are wide open, and so is the security group (any port on tcp being accepted) | 13:28 |
| *** amoralej is now known as amoralej|lunch | 13:29 | |
| quiquell | chkumar|ruck: Enjoy the weekedn man | 13:29 |
| rlandy | agopi: rook: I have browbeat playbook running in my reproducer env. I see this error: https://paste.fedoraproject.org/paste/AnTQD-zxZ9UgSMFIk~NLcQ ... can I update https://github.com/openstack/browbeat/blob/master/ansible/install/roles/browbeat/tasks/main.yml#L35? | 13:31 |
| honza | jrist: were you just hanging out last night or are you also trying to set up an env in ovb? | 13:31 |
| rlandy | weshay: panda: did you guys sync re: paul's work? | 13:32 |
| panda | rlandy: no | 13:32 |
| rlandy | panda: I see you answered on #tripleo | 13:33 |
| * honza tries to see if there are reject logs somewhere | 13:33 | |
| panda | rlandy: if he's going to implement this now, I' scrap my te broker card | 13:33 |
| rlandy | we were discussing this yesterday | 13:33 |
| rlandy | panda: I think he thinks the work is somewhat parallel | 13:33 |
| rlandy | I have been heads down in this browbeat CI | 13:34 |
| rlandy | bit I need to look at this today and marios work | 13:34 |
| rlandy | but | 13:34 |
| weshay | panda, ya.. you need to get in sync w/ paul | 13:34 |
| weshay | quiquell, I need ur help w/ cockpit | 13:39 |
| weshay | http://38.145.34.131/d/IGPvpqOmz/cockpit?panelId=63&fullscreen&orgId=1&from=now-3h&to=now | 13:39 |
| agopi | rlandy, submit a patch, we can do the same ansible_user == "zuul" for the versions you want | 13:40 |
| jrist | honza: yes | 13:40 |
| jrist | honza: no I'm having trouble with vbmc/libvirt setups | 13:40 |
| quiquell | weshay: What happend | 13:40 |
| weshay | quiquell, where is that data coming from https://review.rdoproject.org/zuul/status.json | 13:40 |
| weshay | ? | 13:40 |
| rlandy | agopi: ack | 13:40 |
| quiquell | weshay: This is the status only use for zuul queue time | 13:40 |
| weshay | http://38.145.34.131/d/IGPvpqOmz/cockpit?panelId=63&fullscreen&orgId=1&from=now-3h&to=now | 13:41 |
| weshay | is what I'm concerned about | 13:41 |
| *** EmilienM is now known as EvilienM | 13:41 | |
| quiquell | Wes RDO zuulv3 api for builds https://softwarefactory-project.io/zuul/api/tenant/rdoproject.org/builds | 13:42 |
| quiquell | You can filter by pipelin, change, job_name | 13:42 |
| quiquell | https://softwarefactory-project.io/zuul/api/tenant/rdoproject.org/builds?pipeline=check | 13:43 |
| quiquell | weshay: It feels legit to me what the cockpit shows | 13:44 |
| weshay | quiquell, I see more success here atm https://review.rdoproject.org/zuul/status.html | 13:45 |
| weshay | maybe just a matter of time | 13:45 |
| weshay | afaict.. the rdo-cloud issues may be fixed | 13:45 |
| quiquell | weshay: That's a matter of time | 13:45 |
| quiquell | weshay: we refresh builds every 250s | 13:46 |
| weshay | k | 13:46 |
| weshay | thansk quiquell | 13:46 |
| quiquell | weshay: yw | 13:46 |
| quiquell | weshay: rrcockpit will be ci friendly soon, then we can start to add descriptions at all the jsons | 13:47 |
| quiquell | panels I mean | 13:47 |
| bogdando | weshay: hi. Do you know why we use QEMU in CI http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/overcloud-deploy/defaults/main.yml#n40 ? Isn't it damn slow? :) | 13:47 |
| quiquell | With description and source of truth | 13:47 |
| bogdando | I think it makes those post validations and tempest take way longer | 13:48 |
| arxcruz | weshay: hey, https://review.openstack.org/#/c/573220/ the dependencies are already merged for a few days, i already rebase, however the tempestconf package isn't updating to the version with the change required | 13:48 |
| bogdando | taking* | 13:48 |
| arxcruz | dunnon what else to do | 13:48 |
| weshay | bogdando, http://codesearch.openstack.org/?q=libvirt_args&i=nope&files=&repos= | 13:48 |
| *** ykarel is now known as ykarel|away | 13:49 | |
| bogdando | weshay: yes, but why not kvm? | 13:49 |
| weshay | bogdando, I think at one time it worked fine on rhel but not centos | 13:49 |
| weshay | probably can update that now | 13:49 |
| bogdando | let's try kvm | 13:49 |
| bogdando | yeah | 13:49 |
| weshay | bogdando++ | 13:49 |
| hubbot | weshay: bogdando's karma is now 2 | 13:49 |
| bogdando | and let's see CI jobs time halved lol | 13:50 |
| weshay | bogdando, that's not used upstream | 13:50 |
| bogdando | oh, my bad | 13:50 |
| bogdando | just got lost in those code search results :) | 13:50 |
| weshay | well.. actuall | 13:50 |
| weshay | y | 13:50 |
| * weshay looks | 13:50 | |
| bogdando | I think it's qemu, from the OC defaults | 13:50 |
| weshay | ya /me checks | 13:51 |
| weshay | http://logs.openstack.org/54/581054/6/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/724a59e/logs/undercloud/home/zuul/overcloud-deploy.sh | 13:51 |
| weshay | --libvirt-type qemu | 13:51 |
| weshay | bogdando++ | 13:52 |
| hubbot | weshay: bogdando's karma is now 3 | 13:52 |
| bogdando | thanks man, I have a karma day today :) | 13:52 |
| weshay | bogdando, you have a patch? or should I post | 13:53 |
| bogdando | please go for it | 13:53 |
| bogdando | you'd have better authority to push it through code reviews :D | 13:53 |
| rasca | rlandy, hey hi! I got some news about the rdocloud job, it succeeded, but it didn't execute the ha validation | 13:53 |
| rlandy | rasca: I might know why depending on what you have done | 13:54 |
| rlandy | I am digging through the same issues with browbeat | 13:54 |
| rlandy | once I have them sorted there | 13:54 |
| rlandy | we can apply the same to your work | 13:54 |
| rlandy | mostly I assume your ha work is in a new playbook | 13:55 |
| rlandy | and that playbook needs to be added to toci_gate_test.sh | 13:55 |
| rlandy | but there is more that needs to be done - liekly | 13:55 |
| rasca | rlandy, well... the playbook is not correct, it doesn't include what's in here: https://review.openstack.org/#/c/537669/7/playbooks/baremetal-full-deploy.yml | 13:56 |
| rlandy | rasca: ack - I know - in CI the playbooks are called individually | 13:57 |
| rlandy | from through full deploy | 13:57 |
| rlandy | your change is ok | 13:58 |
| rlandy | as you would still want to update that | 13:58 |
| rlandy | but CI won't pick it up | 13:58 |
| rlandy | you need a change like: | 13:58 |
| rlandy | https://review.openstack.org/#/c/583576/7/toci_gate_test.sh - line 132 | 13:58 |
| rlandy | but it's a bit complicated | 13:58 |
| marios | rlandy: o/ i updated the review for https://trello.com/c/GvjcnJB2/850-translate-tripleosh-bootstrap-subnodes-into-a-series-of-tasks#comment-5b51eacc36045184012b7ab6 and just added that comment to summarize | 13:59 |
| marios | rlandy: appears to be doing the right thing but that is from following console, have to wait for full logs to check subnode 2 | 14:00 |
| marios | rlandy: massively simplified now, no packages or repo setup | 14:00 |
| marios | rlandy: as explained in the trello comment | 14:00 |
| rasca | rlandy, ok, in any case I would like to remove playbooks/overcloud-validate-ha.yml from https://review.openstack.org/#/c/537669/ because it already exists in the repo https://github.com/openstack/tripleo-ha-utils/blob/master/playbooks/overcloud-validate-ha.yml and it has no meaning to have a duplicate, what do you think? | 14:01 |
| marios | rlandy: really though the bigge question is can we really get away with skipping the packages/conflicts and repo setup but again that needs fuller logs | 14:02 |
| marios | rlandy: which we wait for | 14:02 |
| *** quiquell is now known as quiquell|off | 14:03 | |
| * rlandy reads back | 14:05 | |
| rlandy | rasca: I'll be able to give you better advice/info once the browbeat thing runs in CI | 14:06 |
| rlandy | then we can do the same for your work | 14:06 |
| rlandy | you will likely hit a bunch of the same issues | 14:06 |
| rlandy | I have a review in test now | 14:06 |
| rlandy | if that works, we can discuss doing the same organization for you | 14:07 |
| rasca | rlandy, what do you mean exactly with "runs in CI", you mean the results of your patch running the gates? | 14:07 |
| rlandy | rasca: you will need it to kick on changes to your own repo | 14:07 |
| *** ratailor has joined #oooq | 14:07 | |
| rlandy | that is actually a tricky problem | 14:08 |
| rlandy | marios: k, looking at your card now - so I can touch base questions before you go | 14:09 |
| marios | rlandy: sure. really right now we're waiting for the run to complete to see if not doing all that --bootstra-subnode stuff didn't break | 14:10 |
| *** dtantsur|brb is now known as dtantsur | 14:15 | |
| *** ykarel|away has quit IRC | 14:17 | |
| bogdando | weshay, sshnaidm|off: floks, can we have https://review.openstack.org/#/c/465047 ? | 14:21 |
| bogdando | it passed CI jobs tested in jfrancoa patches | 14:21 |
| *** florianf has joined #oooq | 14:22 | |
| *** dtrainor has quit IRC | 14:22 | |
| marios | weshay: panda myoung ** please i'd really appreciate reviews for this https://review.openstack.org/#/c/578081/ | 14:23 |
| *** dtrainor has joined #oooq | 14:23 | |
| marios | trown: if you have time please easy review at https://review.openstack.org/#/c/578081/ thank you | 14:23 |
| myoung | marios: ack, will be looking at that in the next hour, can do it *next* if you like | 14:23 |
| myoung | marios: looking at it now | 14:23 |
| marios | myoung: absolutely no rush | 14:23 |
| * myoung puts rfolco review stack on pause | 14:24 | |
| marios | myoung: just my daily harrasment | 14:24 |
| myoung | marios: and it's appreciated. as the "nag" (TC) I grok it. much respect :) | 14:24 |
| marios | myoung: heh well i realise that folks are all obviously doing different things /timezones /meeting etc etc so i just send out nags on reviews tha are stuck and i keep doing it until something happens :) | 14:25 |
| marios | myoung: thanks for responding | 14:25 |
| marios | myoung: you are now subscribed to review fact | 14:25 |
| myoung | marios: i think you've actually done part of a doc'd LP...sec | 14:25 |
| * myoung searches the databanks | 14:25 | |
| myoung | https://bugs.launchpad.net/tripleo/+bug/1769538 | 14:27 |
| openstack | Launchpad bug 1769538 in tripleo "RFE (libvirt-reproducer): Add option to install prerequisite packages (rpm, pip) " [High,Triaged] | 14:27 |
| myoung | marios: (commenting in gerrit) but can add related bug tag to commit msg | 14:27 |
| marios | myoung: nice thanks :) I'll update the commit message if you add a review comment :) | 14:27 |
| myoung | DEAL | 14:27 |
| rlandy | marios: re: your comment - if we skip all the packages and thus repo setup - where is that work done, then? | 14:28 |
| *** jtomasek has quit IRC | 14:28 | |
| marios | rlandy: we are apparently including the repo-setup role later on | 14:29 |
| *** bogdando has quit IRC | 14:29 | |
| rlandy | marios: ack | 14:29 |
| rlandy | on the undercloud | 14:29 |
| rlandy | marios: apologies, I'm late to the game here | 14:29 |
| marios | rlandy: not at all i'm learning as i'm going along ! :) | 14:29 |
| marios | what are you apologising for rlandy srlsy!! | 14:30 |
| * marios recoffee | 14:30 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq-container, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000 (1 more message) | 14:32 |
| myoung | weshay, chkumar|ruck, panda, be right there | 14:32 |
| panda | myoung: chkumar|ruck we are going to be late | 14:32 |
| myoung | panda: ack and cool, fell down the review hole | 14:33 |
| myoung | marios: done. comments in bug. LGTM / fine as is, if you're wanting to might make sense to just check for and/or install the other stuff that causes reproducer to fail (e.g. fix entire RFE) - but we're late in sprint and would totally understand leaving that for another patch in the future | 14:34 |
| marios | myoung: would rather land and iterate since its been in review a while we can easily add stuff | 14:35 |
| myoung | marios: makes sense. agreed (already +1) just being chattuy | 14:35 |
| myoung | chatty* | 14:35 |
| chkumar|ruck | myoung: let me know when you are ready | 14:36 |
| *** amoralej|lunch is now known as amoralej | 14:36 | |
| myoung | im in the room, but no rush. I don't think we need a full hour, this is just pre-planning for a sprint where we already know the topics :) | 14:38 |
| marios | myoung: thanks done when you next get a chance https://review.openstack.org/#/c/578081/ | 14:38 |
| myoung | weshay, panda ^^ | 14:38 |
| weshay | myoung, coming | 14:38 |
| myoung | marios: ack, +1 thx for update | 14:39 |
| marios | ssbarnea: o/ can you please re-add your vote @ https://review.openstack.org/#/c/578081/ update is to the commit message and a comment based on myoung review thanks | 14:40 |
| marios | myoung: thnks very much for the review | 14:40 |
| *** ratailor has quit IRC | 14:45 | |
| *** holser_ has quit IRC | 14:46 | |
| *** holser_ has joined #oooq | 14:46 | |
| *** links has quit IRC | 14:52 | |
| rlandy | marios: so this review is not in play anymore? https://review.openstack.org/#/c/581026/ (might be abandoned)? You're just working with https://review.openstack.org/#/c/583195/? | 14:54 |
| rlandy | in your testing? | 14:54 |
| *** jfrancoa has quit IRC | 14:55 | |
| rlandy | ack - it seems from your last comment | 14:56 |
| marios | rlandy: right | 14:56 |
| marios | rlandy: we'll see if it works out we can abandon the stand-alone role | 14:57 |
| rlandy | yep, I see | 14:57 |
| *** tcw1 has joined #oooq | 14:58 | |
| myoung | weshay, panda https://trello.com/c/qAU83fCV/47-sprint-17-planning-tasks | 14:59 |
| *** tcw has quit IRC | 15:02 | |
| myoung | weshay, panda: https://review.rdoproject.org/etherpad/p/tripleo-ci-sprint17 | 15:02 |
| rlandy | marios: left a starter comment on https://review.openstack.org/#/c/583195 ... will leave other comments on the review | 15:06 |
| *** florianf has quit IRC | 15:22 | |
| agopi | myoung, weshay can either of you try to retry https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/browbeat-quickstart-pike-baremetal-mixed/93/ this build, i'm unable to and wanted to see it's not just me before opening up a ticket | 15:26 |
| agopi | rlandy, ^ | 15:28 |
| myoung | agopi: A problem occurred while processing the request. Please check our bug tracker to see if a similar problem has already been reported. If it is already reported, please vote and put a comment on it to let us gauge the impact of the problem. If you think this is a new issue, please file a new issue. When you file an issue, make sure to add the entire stack trace, along with the version of Jenkins and relevant plugins. The users list might | 15:30 |
| myoung | be also useful in understanding what has happened. | 15:30 |
| myoung | Stack trace | 15:30 |
| myoung | java.lang.NullPointerException | 15:30 |
| myoung | that's a IT ticket | 15:30 |
| myoung | agopi ^^ | 15:30 |
| agopi | thanks myoung | 15:30 |
| myoung | agopi: one.engineering.redhat.com | 15:30 |
| agopi | myoung++ | 15:30 |
| hubbot | agopi: myoung's karma is now 3 | 15:30 |
| myoung | agopi: sidebar shows 15 options, you need to expand to the bottom to show all (*17), general request, infra, central CI jenkins | 15:30 |
| myoung | not intuitive, but it's there | 15:31 |
| myoung | actually need to expand twice (each menu) | 15:31 |
| myoung | you'l see | 15:31 |
| myoung | agopi: join rhinternal IRC: #ci-ops-central if you need/want to escalate. give ticket max severity/priority | 15:31 |
| marios | rlandy: ack thanks | 15:32 |
| marios | rlandy: might get to it next week tho i mean reply /debug etc and still waiting for zuul run so i can poke at logs :) | 15:33 |
| agopi | ack myoung thanks | 15:33 |
| *** ykarel has joined #oooq | 15:41 | |
| *** ykarel is now known as ykarel|away | 15:46 | |
| *** trown is now known as trown|lunch | 15:51 | |
| *** agopi is now known as agopi|food | 15:52 | |
| *** sshnaidm|off has quit IRC | 15:53 | |
| *** udesale__ has joined #oooq | 16:00 | |
| *** udesale__ has quit IRC | 16:05 | |
| *** ykarel|away has quit IRC | 16:05 | |
| *** tesseract has quit IRC | 16:24 | |
| myoung | agopi|food: please add me to the IT ticket you create(d) as a watcher | 16:26 |
| *** holser_ has quit IRC | 16:26 | |
| *** gkadam has quit IRC | 16:29 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq-container, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000 (1 more message) | 16:32 |
| *** sshnaidm|off has joined #oooq | 16:38 | |
| *** myoung is now known as myoung|lunch | 16:52 | |
| *** myoung|lunch is now known as myoung | 16:53 | |
| rlandy | marios: test runs look good | 16:55 |
| *** jfrancoa has joined #oooq | 16:55 | |
| *** myoung is now known as myoung|lunch | 16:58 | |
| weshay | rlandy, did we loose the ability to run rdo-check? | 16:59 |
| *** jfrancoa has quit IRC | 17:02 | |
| *** amoralej is now known as amoralej|off | 17:07 | |
| weshay | quiquell|off, I don't think the dashboard is accurately reporting on rdo sf jobs | 17:09 |
| weshay | w/ the infra error | 17:09 |
| *** dtantsur is now known as dtantsur|afk | 17:11 | |
| *** trown|lunch is now known as trown | 17:12 | |
| rasca | rlandy, don't want to bother you but I've got a problem in testing my stuff | 17:15 |
| rasca | rlandy, I'm trying to execute a simple quickstart run, using a local oooq-extras with all of our patches | 17:16 |
| rasca | rlandy, but for some reason quickstart isn't able to find the playbook I want to use | 17:16 |
| rasca | rlandy, it seems that the pip install does not place the playbook from the extras repo into the $workdir/playbooks dir | 17:17 |
| rasca | rlandy, but requirements file is correct and I don't see any error | 17:17 |
| rasca | rlandy, any hints? | 17:17 |
| *** tcw1 has quit IRC | 17:18 | |
| weshay | quiquell|off, nvrmind | 17:22 |
| *** myoung|lunch is now known as myoung | 17:25 | |
| *** tcw has joined #oooq | 17:26 | |
| *** panda is now known as panda|off | 17:27 | |
| *** jtomasek has joined #oooq | 17:28 | |
| rlandy | rasca: I assume you are hitting a problem with requirements | 17:31 |
| rlandy | are you using the reproducer? | 17:31 |
| rasca | rlandy, yeah, and I *think* I might have figured it out | 17:31 |
| rlandy | or is this in CI? | 17:31 |
| rasca | rlandy, so, from what I'm understanding using this: | 17:32 |
| rlandy | the reprodcuer wipes out the requirements file | 17:32 |
| rasca | git+file:///home/rasca/workdir/rdocloud/workdir/tripleo-quickstart-extras/#egg=tripleo-quickstart-extras | 17:32 |
| rasca | instead of: | 17:32 |
| rasca | file:///home/rasca/workdir/rdocloud/workdir/tripleo-quickstart-extras/#egg=tripleo-quickstart-extras | 17:32 |
| rasca | makes a lot of difference | 17:32 |
| rasca | but I can assure that this worked in the past, or at least I was convinced it did :) | 17:32 |
| rlandy | rasca: this requirements thing is something of a nightmare as it operates differently in the reproducer and CI | 17:34 |
| rlandy | really I am just figuring this all myself | 17:34 |
| rasca | rlandy, I'm not using the reproducer btw | 17:34 |
| rlandy | what are you using? | 17:34 |
| rasca | rlandy, I'm doing a test using also the baremetal_undercloud role in ovb | 17:34 |
| rlandy | weshay: rdo-check ... is check-rdo | 17:36 |
| rlandy | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul/upstream.yaml#L15 | 17:36 |
| rasca | rlandy, this http://pastebin.test.redhat.com/621352 | 17:36 |
| rasca | rlandy, call it a small local reproducer | 17:38 |
| rlandy | quickstart.sh :( | 17:38 |
| rasca | rlandy, simply enough for my brain to understand it | 17:38 |
| rasca | rlandy, why you are sad about it' | 17:38 |
| rasca | ? | 17:38 |
| rlandy | weshay: ^^ we need to nuke that as well | 17:38 |
| rlandy | the same way of devmode | 17:38 |
| rasca | rlandy, /me spent my life understanding that script | 17:39 |
| rlandy | rasca: I know this is complicated and difficult | 17:39 |
| *** myoung is now known as myoung|bbl | 17:39 | |
| weshay | rasca, STOP COMPLAINING | 17:39 |
| weshay | DON'T MAKE ME PULL THIS CHANNEL OVER | 17:39 |
| rasca | weshay+++++++++++++++++++++++++++ | 17:40 |
| weshay | :) | 17:40 |
| weshay | we'll stop for icecream in a bit | 17:40 |
| rlandy | well daddy cleary just pulled rank here | 17:40 |
| weshay | lolz | 17:40 |
| rasca | dinner is waiting for | 17:40 |
| rlandy | rasca: ok - let me comment that up - and I'll explain | 17:40 |
| rlandy | go for dinner | 17:40 |
| rlandy | I'll leave it on channel | 17:41 |
| rasca | rlandy, but I always have time for explanations | 17:41 |
| rasca | rlandy, so I'm all ears | 17:41 |
| rlandy | https://review.rdoproject.org/zuul/stream.html?uuid=1878525dc46f4a7a828591a6519f999a&logfile=console.log | 17:42 |
| rlandy | I am just working this out on browbeat really | 17:42 |
| rlandy | but ... | 17:42 |
| rlandy | echo "git+https://git.openstack.org/openstack/tripleo-ha-utils/#egg=tripleo-ha-utils" >> $WORKSPACE/tripleo-quickstart/quickstart-extras-requirements.txt | 17:43 |
| rlandy | ^^ that will take MASTER | 17:43 |
| rlandy | not your local | 17:43 |
| rasca | rlandy, exactly | 17:43 |
| rasca | rlandy, I don't have pending reviews there | 17:44 |
| rlandy | "git+file | 17:44 |
| rasca | so I don't care | 17:44 |
| rasca | rlandy, and btw it is moving on right now | 17:44 |
| rasca | rlandy, so, tell you what... | 17:44 |
| rasca | rlandy, let's just this job run | 17:44 |
| rlandy | where is it failing now | 17:44 |
| rasca | rlandy, and see if it's successful | 17:44 |
| rlandy | ok - I ma here | 17:44 |
| rlandy | am | 17:44 |
| rasca | rlandy, no failures anymore | 17:44 |
| *** agopi|food is now known as agopi | 17:45 | |
| rlandy | wonderful | 17:45 |
| rasca | rlandy, it's working (it seems) | 17:45 |
| rasca | then on Monday | 17:45 |
| rasca | if you have time | 17:45 |
| rasca | we can analyze it together | 17:45 |
| rasca | and see what it would be in a reproducer fashion | 17:45 |
| rasca | so I'll understand also the reproducer thing at 100% | 17:45 |
| rasca | and will not hear weshay complainings | 17:46 |
| rasca | sounds like a plan? | 17:46 |
| rlandy | rasca: sure | 17:47 |
| rlandy | weshay: ok finally got the browbeat playbook kicking in CI ... https://review.rdoproject.org/zuul/stream.html?uuid=1878525dc46f4a7a828591a6519f999a&logfile=console.log | 17:47 |
| *** jtomasek has quit IRC | 17:47 | |
| rlandy | error on copy which I am looking to fix | 17:47 |
| rlandy | but I need to address paul's stuff now | 17:47 |
| rasca | have a great weekend rlandy ... and you too master weshay | 17:47 |
| rlandy | rasca: you too | 17:48 |
| *** jtomasek has joined #oooq | 17:49 | |
| agopi | ack myoung|bbl added | 17:50 |
| rlandy | agopi: ok - finally got browbeat playbook kicking in CI | 17:51 |
| agopi | rlandy++ | 17:51 |
| hubbot | agopi: rlandy's karma is now 15 | 17:51 |
| rlandy | some errors on my copy fix but at least we are picking up changes now | 17:51 |
| rlandy | https://review.rdoproject.org/zuul/stream.html?uuid=1878525dc46f4a7a828591a6519f999a&logfile=console.log | 17:52 |
| rlandy | might actually get somewhere | 17:52 |
| agopi | ooh yes just checked it, the logs would tell where exactly browbeat/ is located i guess and we can just use it? | 17:53 |
| *** jtomasek has quit IRC | 17:54 | |
| rlandy | agopi; I have a little more work to do there | 17:55 |
| rlandy | and one more change to the reproducer | 17:55 |
| agopi | okay let me know how i can help you. | 17:55 |
| rlandy | but I need to address another project atm | 17:55 |
| rlandy | will get back to this over the weekend | 17:55 |
| rlandy | or monday | 17:55 |
| agopi | ack rlandy, meanwhile if you have something for me to look at lmk, to make your life easier. | 17:56 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, tripleo-ci-centos-7-scenario003-multinode-oooq-container, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000 (1 more message) | 18:32 |
| agopi | myoung|bbl, i think i | 18:57 |
| agopi | ^i've a vague idea of what caused jenkins to outrage | 18:57 |
| agopi | ^regarding the retry, so if there's already a build that's pending, on the queue and is a retry of job x | 18:58 |
| rook | rlandy agopi is the setupstool still a sisue? | 18:58 |
| rook | issue** | 18:58 |
| agopi | we can't retry build y, if y is already a retry of x. | 18:58 |
| agopi | it's a retryception i'll explain better when you are back. | 18:58 |
| rlandy | rook: I have not gotten to put in a fix for that yet | 18:59 |
| rook | rlandy ack | 18:59 |
| rlandy | I have a job with the playbook triggering in CI | 18:59 |
| rlandy | but it's failing on the copy - which I fixed for the reproducer | 18:59 |
| rlandy | but the two envs are a bit diff | 19:00 |
| rlandy | I need to review code for another project now | 19:00 |
| rlandy | I will do some more runs over the weekend to work that out | 19:00 |
| rlandy | we're getting there though | 19:00 |
| rlandy | there was a lot of work to get CI and the reproducer to recognize a new repo :( | 19:00 |
| agopi | ack rlandy, let me know if there's anything i can do to make your life easier. | 19:01 |
| rlandy | agopi: ack when I get back to this work | 19:01 |
| rfolco | rlandy, got a min? | 19:26 |
| rfolco | real quick, its ok if you can't or don't know :) | 19:27 |
| rfolco | I am wondering how TAGS in https://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test.sh#L154 won't override L122 for a multinode upgrade job | 19:28 |
| rfolco | weshay, you know ^? | 19:28 |
| rfolco | nm featureset is always the last part of toci_jobtype | 19:36 |
| *** brault has quit IRC | 19:36 | |
| rlandy | rfolco: looking | 19:48 |
| rlandy | rfolco: it will override | 19:49 |
| rlandy | because it's redefining rather than adding | 19:49 |
| rfolco | hmm I think it does NOT override coz featureset is always at the end of the string | 19:50 |
| rfolco | multinode-1ctlr-featureset051 | 19:50 |
| rfolco | if featureset051 is upgrade, then tags will be multinode tags + upgrade ones | 19:51 |
| rfolco | rlandy, isn't ? | 19:51 |
| rlandy | is that what you see? | 19:51 |
| rlandy | I guess that is the way it's suppose to work | 19:51 |
| rlandy | what do you see? | 19:52 |
| rlandy | we can check the results on the job itself | 19:52 |
| rfolco | rlandy, I am just trying to convert tags into ansible vars | 19:52 |
| rlandy | imho, tags are evil | 19:52 |
| rfolco | so its more clear now | 19:52 |
| rlandy | rfolco: I would believe you that is it not overriding | 19:53 |
| rlandy | because that would see to be the intention | 19:53 |
| rlandy | to add | 19:53 |
| rfolco | I can set tags for upgrades in the job definition and then add for multinode etc | 19:53 |
| rfolco | correct | 19:53 |
| rlandy | adding would be what I assume the design wants | 19:53 |
| rlandy | so go for that | 19:53 |
| rfolco | will add first, no changes to the code... then modify TAGS | 19:54 |
| rfolco | rlandy, thx | 19:54 |
| * rlandy didn;t really help :) | 19:55 | |
| rfolco | rlandy, you did when you said "go check job log you newbie!" | 19:56 |
| rfolco | :) | 19:56 |
| rfolco | kidding of course, thanks for checking | 19:58 |
| * rlandy would never say something so rude | 20:00 | |
| *** brault has joined #oooq | 20:01 | |
| *** myoung|bbl is now known as myoung | 20:01 | |
| rfolco | indeed :) | 20:03 |
| *** brault has quit IRC | 20:06 | |
| myoung | chkumar|ruck: responded directly to your query re: libvirt reproducer, are you able to ssh? | 20:06 |
| chkumar|ruck | myoung: it worked, now failing at virt resize | 20:07 |
| chkumar|ruck | selinux was disabled on the host | 20:07 |
| chkumar|ruck | do i need to make it enforcing? | 20:07 |
| myoung | chkumar|ruck: got a log/error to look at? | 20:11 |
| myoung | how is it failing? | 20:11 |
| *** sanjayu_ has quit IRC | 20:18 | |
| *** holser_ has joined #oooq | 20:23 | |
| weshay | rfolco, sorry had to make a run to the recycling center | 20:28 |
| * weshay looks | 20:28 | |
| rfolco | weshay, rlandy helped me already thx | 20:28 |
| weshay | ok.. ya.. def wouldn't override | 20:29 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (1 more message) | 20:32 |
| *** brault has joined #oooq | 20:49 | |
| *** brault has quit IRC | 20:53 | |
| *** trown is now known as trown|outtypewww | 21:04 | |
| weshay | rfolco, https://review.openstack.org/#/c/584488/ | 21:05 |
| *** agopi is now known as agopi|brb | 21:08 | |
| *** agopi|brb has quit IRC | 21:12 | |
| rfolco | ack weshay | 21:14 |
| * rfolco exit 0 | 21:14 | |
| *** bandini has quit IRC | 21:19 | |
| myoung | rfolco: finished going thru the reviews, a few questions inline/gerrit, details https://trello.com/c/msxe5RBs/853-replace-tocijobtype-variable#comment-5b51eb9c13f750d590b816b8 | 21:20 |
| myoung | chkumar|ruck: before i evaporate until later/this weekend, are you still stuck w.r.t. libvirt reproducer on virt-resize? | 21:21 |
| *** bandini has joined #oooq | 21:21 | |
| rfolco | myoung, thx | 21:24 |
| rlandy | rook: are these version absolutely needed? https://github.com/openstack/browbeat/blob/master/ansible/install/roles/browbeat/tasks/main.yml#L42 | 21:42 |
| *** weshay is now known as weshay_PTO | 22:15 | |
| *** myoung has quit IRC | 22:29 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-container-to-container- (1 more message) | 22:32 |
| *** brault has joined #oooq | 22:49 | |
| *** brault has quit IRC | 22:54 | |
| *** agopi has joined #oooq | 23:03 | |
| *** rlandy has quit IRC | 23:43 | |
| *** chem has quit IRC | 23:44 | |
| *** tosky has quit IRC | 23:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!