| *** tosky has quit IRC | 00:27 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci- (1 more message) | 00:48 |
|---|---|---|
| ssbarnea|bkp2 | rlandy: https://review.openstack.org/#/c/574731/ | 00:55 |
| *** saneax has quit IRC | 02:10 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci- (1 more message) | 02:48 |
| *** saneax has joined #oooq | 03:11 | |
| *** vkapalav has quit IRC | 03:11 | |
| *** agopi|brb has joined #oooq | 03:15 | |
| *** udesale has joined #oooq | 03:52 | |
| *** gkadam has joined #oooq | 04:23 | |
| *** jaganathan has joined #oooq | 04:27 | |
| *** gkadam has quit IRC | 04:27 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-containers-multinode-queens, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario008-multinode-oooq- (1 more message) | 04:48 |
| *** chandankumar has joined #oooq | 04:59 | |
| *** chandankumar is now known as chkumar|ruck | 05:03 | |
| *** chem has quit IRC | 05:26 | |
| *** rlandy has quit IRC | 05:48 | |
| *** ratailor has joined #oooq | 05:50 | |
| *** apetrich has quit IRC | 05:52 | |
| *** apetrich has joined #oooq | 06:08 | |
| *** ratailor_ has joined #oooq | 06:13 | |
| *** ratailor has quit IRC | 06:15 | |
| *** ykarel has joined #oooq | 06:30 | |
| *** jfrancoa has joined #oooq | 06:33 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-containers-multinode-queens, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario008-multinode-oooq- (1 more message) | 06:48 |
| *** ykarel has quit IRC | 07:22 | |
| *** ykarel has joined #oooq | 07:42 | |
| *** apetrich has quit IRC | 07:47 | |
| *** quiquell is now known as quiquell|bbl | 08:10 | |
| *** sshnaidm|pto is now known as sshnaidm | 08:15 | |
| *** apetrich has joined #oooq | 08:33 | |
| *** tosky has joined #oooq | 08:38 | |
| *** gkadam has joined #oooq | 08:38 | |
| *** apetrich has quit IRC | 08:40 | |
| *** dtrainor_ has joined #oooq | 08:48 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-containers-multinode-queens, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario008-multinode-oooq- (1 more message) | 08:49 |
| *** amoralej|off is now known as amoralej | 08:49 | |
| *** dtrainor has quit IRC | 08:51 | |
| *** dtrainor__ has joined #oooq | 08:52 | |
| chkumar|ruck | sshnaidm, Hello | 08:54 |
| chkumar|ruck | sshnaidm, standalone deployment is supported from stein cycle onwards na? | 08:54 |
| *** dtrainor_ has quit IRC | 08:55 | |
| sshnaidm | chkumar|ruck, I think so, why? | 08:56 |
| chkumar|ruck | sshnaidm, we are running https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-standalone-rocky for rocky so asked | 08:57 |
| *** apetrich has joined #oooq | 08:59 | |
| *** d0ugal has quit IRC | 09:02 | |
| *** d0ugal has joined #oooq | 09:03 | |
| sshnaidm | chkumar|ruck, ack | 09:04 |
| sshnaidm | chkumar|ruck, do you know why it could happen? https://logs.rdoproject.org/33/614633/6/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-vexxhost/3134b57/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-11-15_06_15_13 | 09:04 |
| chkumar|ruck | sshnaidm, looking into that currently | 09:05 |
| sshnaidm | chkumar|ruck, also consider this change depends on some another: https://review.openstack.org/#/c/614633/ | 09:13 |
| chkumar|ruck | sshnaidm, my current vexhost deployment on RDO cloud failed during rdo cloud http://paste.openstack.org/show/734853/ | 09:14 |
| chkumar|ruck | *during overcloud deploy | 09:14 |
| sshnaidm | hmm | 09:21 |
| *** dtrainor_ has joined #oooq | 09:23 | |
| *** dtrainor__ has quit IRC | 09:25 | |
| *** sshnaidm is now known as sshnaidm|afk | 09:26 | |
| *** dtrainor__ has joined #oooq | 09:27 | |
| chkumar|ruck | sshnaidm|afk, if I check nova api logs there is working fine https://logs.rdoproject.org/33/614633/6/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-vexxhost/3134b57/logs/undercloud/var/log/containers/nova/nova-api.log.txt.gz#_2018-11-15_05_40_40_543 | 09:28 |
| chkumar|ruck | tosky, Hello | 09:28 |
| chkumar|ruck | tosky, https://logs.rdoproject.org/33/614633/6/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-vexxhost/3134b57/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-11-15_06_15_13 | 09:28 |
| chkumar|ruck | tosky, here while quering nova extensions it is giving 404 | 09:28 |
| chkumar|ruck | tosky, but in nova api log, it is fine | 09:29 |
| chkumar|ruck | tosky, do I need to look somewhere else also? | 09:29 |
| tosky | is the IP correct? I see also a weird traceback | 09:30 |
| *** dtrainor_ has quit IRC | 09:30 | |
| chkumar|ruck | tosky, it should use 10.0.0.5 instead of that 172 one | 09:33 |
| chkumar|ruck | let me check from this ip is coming | 09:34 |
| chkumar|ruck | tosky, sshnaidm|afk https://logs.rdoproject.org/33/614633/6/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-vexxhost/3134b57/job-output.txt.gz#_2018-11-15_04_14_28_674665 | 09:37 |
| chkumar|ruck | tosky, sshnaidm|afk baremetal-335_3 instances have those ip | 09:37 |
| chkumar|ruck | starting with 172.17.0 | 09:37 |
| chkumar|ruck | tosky, is it possible that when https://10.0.0.5:portnumber/v2.1/extensions called, it internally routed to one of the public ip? | 09:40 |
| chkumar|ruck | or may be running tempest from docker container is doing this? | 09:41 |
| tosky | I have no idea about that specific setup :) | 09:41 |
| chkumar|ruck | because of --net=host it is taking the host ip | 09:42 |
| *** derekh has joined #oooq | 09:50 | |
| *** dtrainor_ has joined #oooq | 09:53 | |
| *** dtrainor__ has quit IRC | 09:56 | |
| *** dtrainor__ has joined #oooq | 09:57 | |
| *** dtrainor_ has quit IRC | 10:00 | |
| *** sshnaidm|afk is now known as sshnaidm | 10:02 | |
| *** chem has joined #oooq | 10:06 | |
| chkumar|ruck | panda|rover|off, container build is passing now | 10:08 |
| chkumar|ruck | panda|rover|off, but not in openstack-periodic pipeline as it got kicked earlier | 10:09 |
| *** apetrich has quit IRC | 10:09 | |
| *** gkadam has quit IRC | 10:13 | |
| *** gkadam has joined #oooq | 10:14 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-containers-multinode-queens, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario008-multinode-oooq- (1 more message) | 10:49 |
| *** udesale has quit IRC | 10:52 | |
| ssbarnea|bkp2 | sshnaidm: can we workflow https://review.openstack.org/#/c/574731/ ? | 11:00 |
| sshnaidm | ssbarnea|bkp2, done | 11:01 |
| ssbarnea|bkp2 | sshnaidm: thanks. i randomly came across it but it was obvious. maybe we need to have some CR cleaning sessions once a week. | 11:02 |
| ssbarnea|bkp2 | abandoning or merging them | 11:03 |
| *** panda|rover|off is now known as panda|rover | 11:08 | |
| ssbarnea|bkp2 | sshnaidm: f28 related https://review.openstack.org/#/c/618027/ | 11:15 |
| *** ratailor_ has quit IRC | 11:45 | |
| *** saneax has quit IRC | 11:51 | |
| *** chem has quit IRC | 11:57 | |
| *** amoralej is now known as amoralej|lunch | 12:02 | |
| * marios afk for a bit back for scrum | 12:03 | |
| *** jtomasek has joined #oooq | 12:05 | |
| sshnaidm | ssbarnea|bkp2, please use "WIP" in commit message when you testing/debugging/trying something: https://review.openstack.org/#/c/613672/ | 12:09 |
| *** quiquell|bbl is now known as quiquell | 12:09 | |
| ssbarnea|bkp2 | sshnaidm: that one is not WIP, is ready for review, as far as I am concerned it can be merged like this. | 12:10 |
| sshnaidm | ssbarnea|bkp2, is it ready for merge? | 12:10 |
| ssbarnea|bkp2 | when I have WIP, I add -1 Workflow on it, even gerrit states near -1 W: "Work in progress". | 12:11 |
| ssbarnea|bkp2 | sshnaidm: i cannot force people to review, but the change is valid, passed zuul and only waiting for reviews. this does not make it a WIP, or maybe we should start using "RIP" prefix... for review-in-progress ;) | 12:12 |
| sshnaidm | ssbarnea|bkp2, do you have card about it? | 12:13 |
| ssbarnea|bkp2 | sshnaidm: *scroll* the description and you will see it. | 12:13 |
| sshnaidm | ssbarnea|bkp2, why do you need fedora:26 ? | 12:14 |
| ssbarnea|bkp2 | sshnaidm: this was added because we had some CI nodes running on fedora-26 and rlandy dicovered some builds in qs.sh that were happening only on fedora-26. | 12:15 |
| ssbarnea|bkp2 | i would be happy to remove fedora-26 once we have confirmation that we no longer have such nodes. | 12:15 |
| quiquell | ssbarnea|bkp2: Hello there, I usually add WIP and -1 as -1 sometimes disappear at rebases or new patchsets | 12:15 |
| quiquell | ssbarnea|bkp2: We have f26 at phase2 nodes, isn't it ? | 12:16 |
| *** chem has joined #oooq | 12:16 | |
| ssbarnea|bkp2 | please put comment on the review, i will be happy to address these. regarding f26 (and f27) i think rlandy can say. | 12:17 |
| ssbarnea|bkp2 | she upgraded at least one node from f26 to f27 but i don't know about overall status of this. | 12:17 |
| ssbarnea|bkp2 | if someone can tell me where to look it will look. | 12:17 |
| quiquell | ssbarnea|bkp2: I suppose we can finde the phase2 promotion jobs, maybe it's easier to update the missing nodes than think about suport f26 | 12:18 |
| sshnaidm | as I understand we get rid off phase2 at all | 12:19 |
| sshnaidm | ssbarnea|bkp2, well, you can't merge this patch when you clone molecule from github | 12:20 |
| sshnaidm | ssbarnea|bkp2, it's ok for local usage, but not for CI | 12:21 |
| ssbarnea|bkp2 | quiquell: i am afraid is not easy because we cannot upgrade to f28 because.... py3, and we cannot (easily) switch to centos-7 either, so we are partially stuck, i think. | 12:21 |
| *** saneax has joined #oooq | 12:22 | |
| quiquell | ssbarnea|bkp2: Maybe we can use f27 | 12:22 |
| quiquell | ssbarnea|bkp2: Suppose is similar to centos7 | 12:22 |
| ssbarnea|bkp2 | sshnaidm: i totally agree with you on git aspect. add it there and I will fix it. mainly i was waiting for a new release. | 12:22 |
| sshnaidm | ssbarnea|bkp2, that's why I asked if it's ready for merge, it is not. I think it's worth review it and try it, but it should be with W-1 or WIP | 12:23 |
| chkumar|ruck | sshnaidm, I am seeing the same issue on https://logs.rdoproject.org/66/610966/9/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053/1530b8d/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-11-15_11_12_21 | 12:23 |
| chkumar|ruck | let me retry the reproducer | 12:24 |
| *** saneax has quit IRC | 12:24 | |
| sshnaidm | chkumar|ruck, yes.. looks like mess with network isolation? | 12:24 |
| chkumar|ruck | sshnaidm, yes kind of | 12:25 |
| chkumar|ruck | sshnaidm, is docker doing something fishy there? | 12:25 |
| ssbarnea|bkp2 | sshnaidm: thanks for the comments, added -W on it and addressing them. | 12:28 |
| sshnaidm | chkumar|ruck, I don't know, it worked with dockers before.. please check when did it start to fail on vexxhost | 12:29 |
| *** saneax has joined #oooq | 12:30 | |
| *** chem has quit IRC | 12:33 | |
| sshnaidm | chkumar|ruck, maybe we can find the breaking patch.. | 12:37 |
| *** chem has joined #oooq | 12:38 | |
| quiquell | sshnaidm: Good TV series | 12:39 |
| ssbarnea|bkp2 | do we have a generic bug (LP) about timeouts? | 12:41 |
| chkumar|ruck | tripleo-ci-centos-7-scenario00(1-8)-multinode-oooq-container timed out recently | 12:42 |
| sshnaidm | quiquell, need to sync with you via bluej, do you have a time now? | 12:46 |
| ssbarnea|bkp2 | i found https://bugs.launchpad.net/tripleo/+bug/1781888 related to timeouts but that one mentiones upgrade jobs, my question was more generic because I want to add an elastic-recheck search for the generic timeouts. | 12:47 |
| openstack | Launchpad bug 1781888 in tripleo "[stable/queens]tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades job timing out on stable/queens noop jobs " [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 12:47 |
| sshnaidm | quiquell, well, we have a mtg soon, then after it | 12:47 |
| ssbarnea|bkp2 | should I repurpose existing bug or create new generic one? | 12:48 |
| ssbarnea|bkp2 | I need bug number for elastic-search | 12:48 |
| sshnaidm | ssbarnea|bkp2, why do we need elastic recheck for generic timeouts? | 12:48 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario008-multinode-oooq-container @ https://review.openstack.org/567224, (1 more message) | 12:49 |
| ssbarnea|bkp2 | sshnaidm: because wes asked me to lower the number of uncategorized failures from http://status.openstack.org/elastic-recheck/data/others.html | 12:49 |
| ssbarnea|bkp2 | and is important goal, with card on it. | 12:50 |
| sshnaidm | ssbarnea|bkp2, but what is a goal? | 12:51 |
| ssbarnea|bkp2 | sshnaidm: don't confuse the recheck in the repo name with "recheck" we do on gerrit ;) | 12:51 |
| quiquell | sshnaidm: Can do after it, tomorrow I will work at my afternoon | 12:51 |
| quiquell | sshnaidm: s/tomorrow/today/ | 12:51 |
| ssbarnea|bkp2 | excerpt from READNE: "Use ElasticSearch to classify OpenStack gate failures" | 12:51 |
| sshnaidm | ssbarnea|bkp2, I know what is elastic recheck | 12:52 |
| sshnaidm | ssbarnea|bkp2, and what is it helpful for? | 12:52 |
| sshnaidm | quiquell, cool | 12:52 |
| *** jtomasek has quit IRC | 12:53 | |
| sshnaidm | ssbarnea|bkp2, if it's for just counting timeouts in gates, we have it in cockpit graphs | 12:53 |
| *** rlandy has joined #oooq | 12:56 | |
| ykarel | chkumar|ruck, sshnaidm is the log collection broken i can't find overcloud logs in ovb jobs | 12:58 |
| ykarel | ? | 12:58 |
| panda|rover | ykarel: logs ? | 12:59 |
| *** ykarel has quit IRC | 12:59 | |
| *** ykarel has joined #oooq | 12:59 | |
| ykarel | panda|rover, u can check any of the ovb logs in last promotion run: https://trunk-primary.rdoproject.org/api-centos-rocky/api/civotes_detail.html?commit_hash=4af630f02a985625b587049d633bed4c7752d2d1&distro_hash=15dcc0dfac7994229f2a5e5a4d948227e1f84fdf | 13:00 |
| ykarel | i see some ssl error which results in 0 overcloud_nodes | 13:00 |
| ykarel | get_overcloud_nodes.py | 13:00 |
| ykarel | ssbarnea|bkp2, can u check/fix containers collection logs, seems broken by ur patch: https://review.openstack.org/#/c/610491/44/roles/collect-logs/tasks/collect.yml@239 | 13:00 |
| chkumar|ruck | ykarel, that's why I am thinking where is subnode2 logs gone in timedout job | 13:01 |
| ykarel | chkumar|ruck, in multinode job logs are there | 13:01 |
| ykarel | i am talking about ovb | 13:02 |
| ykarel | there may be some other issue | 13:02 |
| chkumar|ruck | ykarel, https://logs.rdoproject.org/66/610966/9/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053/1530b8d/logs/ | 13:02 |
| ykarel | this is ovb | 13:02 |
| chkumar|ruck | me too talking about ovb | 13:02 |
| ykarel | okk generally in ovb overcloud is not named as subnode-2 | 13:03 |
| ykarel | there is ovecloud-controller, overcloud-compute etc | 13:03 |
| ykarel | but that's configurable | 13:03 |
| ykarel | and in multinode it's subnode-2 subnode-3 | 13:03 |
| ykarel | so confused | 13:03 |
| chkumar|ruck | yes | 13:04 |
| ykarel | ssbarnea|bkp2, u can check logs in ur patch to see what went wrong | 13:05 |
| ykarel | look for: syntax error: unexpected end of file | 13:05 |
| ykarel | ex log: http://logs.openstack.org/91/610491/44/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/941fac4/logs/quickstart_collect_logs.log | 13:05 |
| *** apetrich has joined #oooq | 13:05 | |
| ssbarnea|bkp2 | ykarel: what to search for in that log? | 13:07 |
| ykarel | ssbarnea|bkp2, syntax error: unexpected end of file | 13:07 |
| ssbarnea|bkp2 | ykarel: ok good point. | 13:07 |
| ssbarnea|bkp2 | ykarel: if I would have to guess, ( ) need escaping. | 13:11 |
| ykarel | ssbarnea|bkp2, is \ before $ required? | 13:12 |
| ykarel | anyway good to check logs before merging the fix for it | 13:13 |
| *** chkumar|ruck is now known as chkumar|ruck|brb | 13:15 | |
| ssbarnea|bkp2 | ykarel: https://review.openstack.org/#/c/618163/ -- shoud fix it. | 13:17 |
| *** chkumar|ruck|brb is now known as chkumar|ruck | 13:18 | |
| ykarel | ssbarnea|bkp2, ack let's see the result | 13:25 |
| sshnaidm | ssbarnea|bkp2, you sigh very hard :) can you mute please? | 13:25 |
| weshay | chkumar|ruck, few minutes late | 13:27 |
| ykarel | ssbarnea|bkp2, following command runs: docker exec heat_api_cfn bash -c "$(command -v dnf || command -v yum) list installed" with ur last patch | 13:29 |
| ykarel | and with current: docker exec heat_api_cfn bash -c "$\(command -v dnf || command -v yum\) list installed" | 13:29 |
| ykarel | this what u want ^^ | 13:29 |
| ykarel | ? | 13:29 |
| weshay | panda|rover, can you run the rest of the mtg? | 13:31 |
| ssbarnea|bkp2 | ykarel: I think what we need to run is: bash -c "$(command -v dnf || command -v yum) list installed" | 13:32 |
| *** trown|outtypewww is now known as trown | 13:32 | |
| chkumar|ruck | weshay, ok | 13:32 |
| ssbarnea|bkp2 | this command would return installed packages. if you know how to test it faster with docker context it could speed us up. | 13:33 |
| panda|rover | weshay: yes | 13:33 |
| weshay | panda|rover, thank you | 13:33 |
| ykarel | ssbarnea|bkp2, that is currently running but failing, can u try locally running on a container | 13:34 |
| ykarel | ex log: http://logs.openstack.org/91/610491/44/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/941fac4/logs/undercloud/var/log/extra/docker/containers/heat_api_cfn/docker_info.log.txt.gz | 13:35 |
| *** udesale has joined #oooq | 13:37 | |
| ykarel | ssbarnea|bkp2, we need to run: bash -c "\$(command -v dnf || command -v yum) list installed" | 13:38 |
| ssbarnea|bkp2 | ykarel: so the right fix would be wirte \\\$ and no need to escape the () | 13:39 |
| ykarel | ssbarnea|bkp2, yes looks so, but i still can't get why syntax error: EOF is ther | 13:40 |
| *** apetrich has quit IRC | 13:44 | |
| ykarel | ssbarnea|bkp2, it would be more clear if we write the stderr also to file: https://review.openstack.org/#/c/610491/44/roles/collect-logs/tasks/collect.yml@244 | 13:45 |
| ykarel | as with loop it's not clear what error is with which command | 13:45 |
| weshay | chkumar|ruck, https://review.openstack.org/#/c/618092/1/roles/collect-logs/tasks/collect.yml | 13:48 |
| chkumar|ruck | weshay, https://github.com/openstack-infra/tripleo-ci/blob/475da5cdf82ed3db25d0ce2fca2140bdaffcea01/scripts/get_docker_logs.sh | 13:49 |
| weshay | chkumar|ruck, https://review.openstack.org/#/c/618092/1/roles/collect-logs/tasks/collect.yml | 13:51 |
| *** jfrancoa has quit IRC | 13:51 | |
| ykarel | chkumar|ruck, https://bugs.launchpad.net/tripleo/+bug/1803547 seems to be happening after weshay's patch: https://review.openstack.org/#/c/617845/ | 13:51 |
| openstack | Launchpad bug 1803547 in tripleo "tempest run failed with 'The specified regex doesn't match with anything ' on tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 13:51 |
| ykarel | as whitelist and blacklist for scenario001 seems same | 13:51 |
| ykarel | so no test | 13:51 |
| *** amoralej|lunch is now known as amoralej | 13:52 | |
| ykarel | so a real issue | 13:52 |
| ykarel | a/it's a | 13:52 |
| panda|rover | https://tree.taiga.io/project/tripleo-ci-board/us/109 https://review.openstack.org/607288 | 13:54 |
| *** agopi|brb is now known as agopi | 13:54 | |
| weshay | chkumar|ruck, https://cryptic-cliffs-32040.herokuapp.com/ | 13:55 |
| ykarel | panda|rover, did you get the missing logs in ovb? | 13:55 |
| ssbarnea|bkp2 | ykarel: clearly the failure to include stderr is a bug. | 13:55 |
| ssbarnea|bkp2 | ykarel: in fact i am going to rewrite the entire loop as it does not make sense to me. | 13:57 |
| weshay | chkumar|ruck, http://logs.openstack.org/13/617913/2/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/e232a20/logs/undercloud/home/zuul/skip_file.gz | 13:57 |
| ykarel | ssbarnea|bkp2, but remember to see if it's working before merging :) | 13:57 |
| chkumar|ruck | panda|rover, weshay see ya tomorrow | 14:02 |
| chkumar|ruck | bye | 14:02 |
| *** chkumar|ruck has quit IRC | 14:02 | |
| *** ykarel is now known as ykarel|away | 14:04 | |
| *** jfrancoa has joined #oooq | 14:04 | |
| quiquell | sshnaidm: Do you want to sync now ? | 14:08 |
| panda|rover | ykarel|away: sorry was in meeting | 14:08 |
| sshnaidm | quiquell, https://bluejeans.com/u/sshnaidm/ | 14:09 |
| ykarel|away | panda|rover, ack no issue | 14:09 |
| panda|rover | ykarel|away: yes collect logs is broken | 14:31 |
| panda|rover | ykarel|away: it's failing to get the overcloud nodes ips | 14:31 |
| panda|rover | keystoneauth1.exceptions.connection.SSLError: SSL exception connecting to https://192.168.24.2:13000/v3/auth/tokens: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:579) | 14:32 |
| quiquell | sshnaidm: All progress in the taiga task https://tree.taiga.io/project/tripleo-ci-board/task/348?kanban-status=1447275 | 14:32 |
| quiquell | sshnaidm: also the github link to it | 14:32 |
| *** ykarel|away has quit IRC | 14:34 | |
| sshnaidm | quiquell, ack | 14:35 |
| weshay | panda|rover, is there a taiga task for collect logs? | 14:37 |
| panda|rover | weshay: which part of collect logs ? | 14:37 |
| panda|rover | weshay: anyway, there is not task | 14:37 |
| weshay | panda|rover, re: the overcloud nodes | 14:38 |
| panda|rover | weshay: it's a bug we just discovered | 14:38 |
| *** vkapalav has joined #oooq | 14:40 | |
| panda|rover | oh ykarel is gone, I'll open the bug then | 14:42 |
| weshay | geez | 14:43 |
| panda|rover | weshay: https://bugs.launchpad.net/tripleo/+bug/1803561 | 14:45 |
| openstack | Launchpad bug 1803561 in tripleo "Collect logs in OVB job fails to fetch overcloud nodes and their logs" [High,Triaged] - Assigned to Gabriele Cerami (gcerami) | 14:45 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario008-multinode-oooq-container @ https://review.openstack.org/567224, (1 more message) | 14:49 |
| weshay | panda|rover, so we don't looks track https://tree.taiga.io/project/tripleo-ci-board/issue/380?kanban-status=2027733 | 14:49 |
| panda|rover | weshay: ok | 14:50 |
| weshay | panda|rover, it may be related to https://logs.rdoproject.org/33/614633/7/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-vexxhost/ffd8061/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-11-15_12_12_27 | 14:51 |
| weshay | nhicher, panda|rover are we able to put a hold on a vexxhost ovb deployment? | 14:51 |
| weshay | nhicher, so NONE of the nodes are cleaned up | 14:51 |
| weshay | nhicher, panda|rover or maybe we can run a reproducer live in that env | 14:51 |
| panda|rover | weshay: different problems, you pasted a network connection error, here the network works, but SSL exchange fails for the certificate. My first idea was to make the script ignore the certificate, be the script we have is using nova client, and if it worked so far, this may be a legit error. | 14:55 |
| panda|rover | tbh I don't know since when it started to fail | 14:56 |
| nhicher | weshay: we can hold only nodepool instances, so only undercloud | 14:57 |
| panda|rover | we would need to instruct the te broker to not remove overcloud nodes. | 14:58 |
| *** d0ugal has quit IRC | 14:58 | |
| weshay | panda|rover, nhicher to figure out wth is going .. I would suggest launching an ovb by hand using the vexx creds | 14:59 |
| weshay | nhicher, is that possible? | 15:01 |
| nhicher | weshay: I can set undercloud in hold state and add yours keys on it if you want | 15:03 |
| weshay | nhicher, k.. and after a job launches there... panda|rover would probably have to turn off the tebroker | 15:04 |
| weshay | nhicher, so he'll need access to that | 15:04 |
| nhicher | weshay: ok, panda|rover can you give me your ssh pub key ? | 15:04 |
| *** ykarel|away has joined #oooq | 15:05 | |
| *** jfrancoa has quit IRC | 15:24 | |
| *** jfrancoa has joined #oooq | 15:39 | |
| panda|rover | all the OVB logs we have available for the last periodic runs are missing the overcloud for the same error, I can track up 24 Oct | 15:41 |
| panda|rover | not easy to understand when this started | 15:41 |
| panda|rover | trying with log search | 15:42 |
| weshay | panda|rover, it's been going on for a while | 15:50 |
| weshay | suprised no one noticed | 15:50 |
| weshay | panda|rover, let's focus on the fixing it | 15:51 |
| weshay | not finding when it started | 15:51 |
| weshay | I don't think we have logs that old | 15:51 |
| rlandy | woohoo - filter worked | 15:54 |
| rlandy | weshay: ^^ | 15:54 |
| rlandy | zuul_legacy_vars | 15:54 |
| weshay | rlandy, oh nice | 15:57 |
| panda|rover | weshay: I'll put a workaround in our script, to disable SSL verification | 15:57 |
| weshay | panda|rover, cool | 15:57 |
| panda|rover | not sure if we even care to test SSL chain | 15:57 |
| weshay | not w/ that script | 15:57 |
| weshay | panda|rover, now that newton and ocata are dead | 15:58 |
| weshay | we could probably just use openstack commands | 15:58 |
| weshay | to get the list of the overcloud nodes | 15:58 |
| weshay | but I digress | 15:58 |
| *** d0ugal has joined #oooq | 16:00 | |
| quiquell | weshay, sshnaidm: will remove them from the cockpit | 16:04 |
| weshay | quiquell, what? | 16:04 |
| quiquell | weshay: ocata | 16:05 |
| sshnaidm | quiquell, yeah, it's a time | 16:06 |
| sshnaidm | quiquell, maybe pike too | 16:06 |
| quiquell | sshnaidm: ack | 16:07 |
| quiquell | The train is coming | 16:07 |
| panda|rover | weshay: https://review.openstack.org/618205 | 16:10 |
| weshay | panda|rover, k.. awesome.. think you need to run check-rdo on it | 16:11 |
| panda|rover | weshay: already did | 16:15 |
| panda|rover | if gertty says the truth at least | 16:15 |
| marios | weshay: rfolco o/ comments please on the design of the featureset_override, v18 @ https://review.openstack.org/#/c/616872/18/playbooks/tripleo-ci/run-v3.yaml and i updated the description in https://tree.taiga.io/project/tripleo-ci-board/task/363 to reflect our no longer needing a featureset and describing this featureset_override | 16:15 |
| marios | weshay: i restricted with the path as we said, and also decided to not even expose the standalone_custom_env_files instead using a new/dedicated override we can re-use specifically for the scenario jobs (i.e. to address your concern weshay about allowing this override.) anyway wdyt | 16:16 |
| weshay | hrm.. /me looks | 16:17 |
| marios | https://review.openstack.org/#/c/616872/18/zuul.d/standalone-jobs.yaml here you specify your featureset_override and we process it in the run-v3 i pointed at there ^ | 16:17 |
| *** gkadam has quit IRC | 16:18 | |
| weshay | hrm.. not sure if I grok this yet https://review.openstack.org/#/c/616872/18/playbooks/tripleo-ci/run-v3.yaml | 16:20 |
| marios | weshay: this is the interface we expose: https://review.openstack.org/#/c/616872/18/zuul.d/standalone-jobs.yaml | 16:20 |
| weshay | ya | 16:20 |
| weshay | and just the file name? | 16:20 |
| marios | weshay: so for standalone scenario jobs we have this standalone_scenario_environment allowed override | 16:20 |
| weshay | of the env | 16:21 |
| weshay | -/\1 | 16:21 |
| marios | weshay: i made it very specific, in line with the discussion, i.e. NOT general mechanism. specifically, for the scenario standalone override | 16:21 |
| marios | weshay: so then they have in featureset_override: "standalone_scenario_environment: 'ci/environments/scenario001-standalone.yaml'" and i use a replace to make that into the standalone standalone_custom_env_files: [/usr/share/openstack-tripleo etc | 16:22 |
| marios | weshay: makes sense? | 16:22 |
| weshay | k.. but why: "standalone_scenario_environment: 'ci/environments/scenario001-standalone.yaml | 16:23 |
| weshay | and not | 16:23 |
| weshay | "standalone_scenario_environment: 'scenario001-standalone.yaml | 16:23 |
| marios | weshay: right and then also assume ci/environments you mean? | 16:23 |
| weshay | I guess we want the option of taking from some other dir? | 16:23 |
| marios | weshay: right but since we want to be very specific i think it fits | 16:23 |
| marios | weshay: so we're saying the interface is to use this specific override for standalone scneario your env file lives here | 16:24 |
| weshay | I *think* so.. I think simplicity and being concise will help | 16:24 |
| weshay | it's not a major diff either way, but my focus is on usability | 16:24 |
| weshay | as I want this to go out to the world | 16:24 |
| marios | weshay: yeah so we are passing this in the job (ie the regex works) http://logs.openstack.org/72/616872/17/check/tripleo-ci-centos-7-scenario001-standalone/b2804dd/logs/reproducer-quickstart/featureset-override.yaml and then the command looks like http://logs.openstack.org/72/616872/17/check/tripleo-ci-centos-7-scenario001-standalone/b2804dd/logs/undercloud/home/zuul/standalone.sh.txt.gz | 16:25 |
| weshay | marios, maybe it's a new dir under ci/environments | 16:25 |
| weshay | to be clean | 16:25 |
| weshay | ci/environments/standalone/* | 16:25 |
| marios | weshay: sure but then its a comment at https://review.openstack.org/#/c/616592/ please? | 16:25 |
| weshay | aye | 16:25 |
| *** chandankumar has joined #oooq | 16:26 | |
| marios | weshay: so you are mostly /first impression +1 on the idea of NOT exposing standalone_custom_env_files and instead having a thing we will use specifically for these standalone scenario jobs (that thing being "standalone_scenario_environment" or whatever else you want to call it | 16:27 |
| *** d0ugal has quit IRC | 16:27 | |
| weshay | I'm +1 on it for sure.. just now focused on the minor details of the implementation | 16:28 |
| *** ykarel|away has quit IRC | 16:28 | |
| weshay | marios, on that note... | 16:28 |
| weshay | standalone_scenario_environment may be to wordy | 16:28 |
| marios | weshay: ack cool. i wasted a long time trying to make my regex match ' and " until i realised the to_nice_yaml here removes those https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/templates/featureset-override.j2#L1 .. so yeah details | 16:28 |
| weshay | and I htink we can deploy w/o scenarios | 16:28 |
| weshay | right | 16:28 |
| weshay | standalone_environment | 16:29 |
| marios | weshay: sure man add comment on the review? or even standalone_scenario_env | 16:29 |
| marios | whtaver | 16:29 |
| weshay | ya | 16:29 |
| marios | i'll update all that tomorrow, undo the layout changes to add all the jobs back and lets merge it already. though the job is currently broken http://logs.openstack.org/72/616872/17/check/tripleo-ci-centos-7-scenario001-standalone/b2804dd/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 16:29 |
| marios | weshay: key thing is to work all this stuff out for scen1. then copy/paste | 16:30 |
| *** chandankumar has quit IRC | 16:30 | |
| marios | weshay: i think requiring update for the directory is to omuch/not worth it | 16:35 |
| marios | weshay: i'll just update my review to at least assume /ci/environments and just use alex filename scenario001-standalone.yml as is | 16:35 |
| marios | weshay: k? | 16:35 |
| weshay | updated the review | 16:36 |
| *** agopi is now known as agopi|brb | 16:36 | |
| weshay | marios, ya.. that is fine | 16:36 |
| marios | weshay: thank you | 16:36 |
| weshay | marios, think about zuul triggers as you do this though | 16:36 |
| *** udesale has quit IRC | 16:36 | |
| *** d0ugal has joined #oooq | 16:39 | |
| *** agopi|brb has quit IRC | 16:40 | |
| *** quiquell has quit IRC | 16:46 | |
| *** jfrancoa has quit IRC | 16:46 | |
| marios | weshay: rfolco v19 interface like https://review.openstack.org/#/c/616872/19/zuul.d/standalone-jobs.yaml https://review.openstack.org/#/c/616872/19/playbooks/tripleo-ci/run-v3.yaml | 16:47 |
| marios | standalone_environment lgtm | 16:48 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario008-multinode-oooq-container @ https://review.openstack.org/567224, (1 more message) | 16:49 |
| weshay | marios, cool.. nit on the commit message | 16:50 |
| marios | rlandy: panda|rover can we catch up tomorrow :/ sorry it took longer than i expected | 16:50 |
| weshay | aight | 16:50 |
| rlandy | sure | 16:50 |
| weshay | l8r | 16:50 |
| marios | weshay: ack thanks. hopefully we can now focus on getting the job working cos it isn't currenlty but didn't investigate if its a known issue or something specific to scen1 standalone | 16:50 |
| weshay | ya.. see that is what I was thinking :) | 16:51 |
| marios | rlandy: hopefully i spend much less time on this tomorrow | 16:51 |
| weshay | I assume thtat will happen on all of them | 16:51 |
| weshay | aint nothing in this world for free | 16:51 |
| marios | sshnaidm: good call on the nomination | 16:59 |
| marios | imo/fwiw | 16:59 |
| *** d0ugal has quit IRC | 17:07 | |
| *** quiquell has joined #oooq | 17:18 | |
| *** agopi|brb has joined #oooq | 17:27 | |
| *** agopi|brb is now known as agopi | 17:28 | |
| weshay | marios, you still here? | 17:32 |
| weshay | marios, just figure it out w/ alex | 17:32 |
| *** sshnaidm is now known as sshnaidm|afk | 17:37 | |
| ssbarnea|bkp2 | marios: weshay : https://review.openstack.org/#/c/618021/ may look trivial but it fixes two duplicate key bugs and implements preventive measures. | 17:40 |
| marios | weshay: not realy at the gym.. v22/3 was updated whilst jumping around like a lunatic. i think i will refrain from more till the morning and you guys decide ;) | 17:41 |
| weshay | marios, np I will add a comment | 17:41 |
| weshay | figured it out | 17:41 |
| *** quiquell has quit IRC | 17:43 | |
| *** quiquell has joined #oooq | 17:43 | |
| *** chandankumar has joined #oooq | 17:44 | |
| *** quiquell is now known as quiquell|off | 17:48 | |
| *** trown is now known as trown|lunch | 17:48 | |
| *** saneax has quit IRC | 17:50 | |
| ssbarnea|bkp2 | https://review.openstack.org/#/c/618163/ bugfix on collect logs is ready for review https://review.openstack.org/#/c/618163/ | 17:55 |
| *** derekh is now known as derekh_afk | 18:01 | |
| panda|rover | ssbarnea|bkp2: \\\\\\\\\\! | 18:02 |
| panda|rover | ssbarnea|bkp2: anyway I think there' another change about to merge that is adding another command there | 18:02 |
| panda|rover | ssbarnea|bkp2: ${engine} version, and adding some spacing between the outputs in the log file | 18:03 |
| panda|rover | Tengu: what's the change id for that ^ ? | 18:03 |
| *** panda|rover is now known as panda|rover|off | 18:05 | |
| ssbarnea|bkp2 | panda|rover: well, we will find out. because I use "set +x" we should not longer need to do echo and separation. | 18:05 |
| ssbarnea|bkp2 | panda|rover|off: still, I wonder where is the resulting file collected because I was not able to spot it yet. somehow I don't. like the overly verbose ansible output -- really hard to read. i would personally do a: no_log: results.rc == 0 once I have the proof that the file is collected. | 18:07 |
| panda|rover|off | ssbarnea|bkp2: you don't see it, it's in the cloud | 18:08 |
| panda|rover|off | somewhere | 18:09 |
| panda|rover|off | ssbarnea|bkp2: http://logs.openstack.org/63/618163/2/check/tripleo-ci-centos-7-containers-multinode/9687fcf/logs/undercloud/var/log/extra/docker/docker_allinfo.log.txt.gz | 18:10 |
| panda|rover|off | ssbarnea|bkp2: no, that's not it | 18:11 |
| panda|rover|off | ssbarnea|bkp2: mmh maybe we're really not collecting it | 18:13 |
| ssbarnea|bkp2 | i know, everything is in the cloud... | 18:14 |
| chandankumar | Oh it is someone else computer :-0 | 18:14 |
| ssbarnea|bkp2 | when i will launch my own cloud, I will call it devnull, because is the most popular destination. | 18:16 |
| chandankumar | hehe | 18:16 |
| *** chandankumar has quit IRC | 18:17 | |
| ssbarnea|bkp2 | any core I persuade to workflow https://review.openstack.org/#/c/618021/ ? | 18:18 |
| panda|rover|off | ssbarnea|bkp2: tempest_log_file was already removed by another patch | 18:23 |
| ssbarnea|bkp2 | well, at the time I raised it it was still there. | 18:24 |
| ssbarnea|bkp2 | and I think you do remember having a similar discussions few weeks back, same kind of bug and based on suggestion I decided to split the fix in two, .... we all know that the preventive measure never managed to get merged. | 18:25 |
| panda|rover|off | ssbarnea|bkp2: what's with all those repos in pre-commit-config ? | 18:26 |
| ssbarnea|bkp2 | panda|rover|off: this is how pre-commit hooks work, is similar to how we have requirements, the difference is that pre-commit ones are *always* pinned (for consistency), | 18:28 |
| panda|rover|off | ssbarnea|bkp2: do every time I git commit, I download those repos ? | 18:29 |
| ssbarnea|bkp2 | while pre-commit is a python project, it does not install stuff using wheels, uses only git+revision as this being the only portable way to install stuff (some repos are using nodejs for example, not ours) | 18:30 |
| ssbarnea|bkp2 | nope, try it first and run twice and you will what happens. | 18:30 |
| panda|rover|off | ssbarnea|bkp2: IIRC it's not used by default ? | 18:31 |
| ssbarnea|bkp2 | first time you use a repo+hash it will install it in your user cache, after this it will reuse it (even across different projects) | 18:31 |
| panda|rover|off | oh now it is | 18:31 |
| panda|rover|off | I have to install pre-commit to run tox ? | 18:31 |
| ssbarnea|bkp2 | no need. | 18:32 |
| ssbarnea|bkp2 | tox will install pre-commit inside linters, and use it. | 18:32 |
| panda|rover|off | it's in test-req | 18:32 |
| panda|rover|off | mmmhh, so we are fetching a buch of random repos from github to run our linters ? :/ | 18:33 |
| ssbarnea|bkp2 | but you can install it if you want (and also activate the hook, again *optional*) | 18:33 |
| ssbarnea|bkp2 | these are not random repos, all of them are official project git locations. | 18:33 |
| ssbarnea|bkp2 | is not a 3rd party repo, is officiall repos for both bashare and yamllint. | 18:34 |
| panda|rover|off | ssbarnea|bkp2: why not add yamllint in test-requirements ? | 18:35 |
| ssbarnea|bkp2 | panda|rover|off: multiple reasosn: one of them being that you would have to write a LOT of boilerplace code to implement the ability to check only the touched files, and this would only be the start. | 18:36 |
| ssbarnea|bkp2 | think about pre-commit like a generic tox for linters, one that can run from inside tox. | 18:37 |
| *** amoralej is now known as amoralej|off | 18:37 | |
| ssbarnea|bkp2 | i have another change that is switching from internal ansible-linter to pre-commit ansible-linter making it 10x faster on each execution. | 18:38 |
| panda|rover|off | ssbarnea|bkp2: internal ? | 18:38 |
| panda|rover|off | ssbarnea|bkp2: you're tying a linters job in openstack to github.com availability and named repos, not using packages, just running unverified code on CI node ... | 18:39 |
| panda|rover|off | bashate should use openstack git | 18:41 |
| panda|rover|off | of all this, is the onlyt thing that I don't like ... it's triggering my SysAdmin sensors | 18:42 |
| ssbarnea|bkp2 | panda|rover|off: check http://codesearch.openstack.org/?q=github.com%2F&i=nope&files=.txt&repos= -- try to skip the openstack ones, you will find lots. | 18:44 |
| ssbarnea|bkp2 | but as the same time, i do understand your worries, i seen some ugly things in the past, especially around private repos.... | 18:44 |
| ssbarnea|bkp2 | i think is more about *what* we point to: a pypi package that is not pinned has same security as a git one. | 18:45 |
| ssbarnea|bkp2 | nice part about pre-commit is that you can put hashes, making close to impossible to hack. | 18:46 |
| panda|rover|off | ssbarnea|bkp2: I see lots of mentions in documentation | 18:47 |
| panda|rover|off | ssbarnea|bkp2: comments | 18:48 |
| panda|rover|off | ssbarnea|bkp2: release file for mitaka | 18:48 |
| ssbarnea|bkp2 | regarding using git.openstack.org instead of github.com - is questionable: i find github.com considerably faster than our infra, and I also like the idea of using M$ money to lower our git server loads. | 18:48 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario008-multinode-oooq-container @ https://review.openstack.org/567224, (1 more message) | 18:49 |
| panda|rover|off | ssbarnea|bkp2: I think it's bast practice at this point to use git.openstack when we can, even if it's slower | 18:50 |
| panda|rover|off | anyway, going home. I'm not blocking your review | 18:51 |
| ssbarnea|bkp2 | panda|rover|off: sure, i don't have anything against that. can fix it quickly, other remarks? personally I would prefer to merge it like this and fix it later as is already go the magic votes on it. | 18:51 |
| ssbarnea|bkp2 | but if you want I can also include the ansible-lint part in it and restart from zero :( | 18:52 |
| ssbarnea|bkp2 | just observed that the bashate one was already like this, was not part of this change. | 18:56 |
| *** trown|lunch is now known as trown | 18:56 | |
| weshay | panda|rover|off, updated your patch to https://review.openstack.org/#/c/614633/ | 19:53 |
| weshay | so we can test w/ vexx | 19:54 |
| *** sshnaidm|afk is now known as sshnaidm|off | 20:00 | |
| *** derekh_afk has quit IRC | 20:07 | |
| ssbarnea|bkp2 | weshay: any chance to convince you about https://review.openstack.org/#/c/618021/ ? -- i will take care of potential rebasing when it goes in. | 20:25 |
| weshay | ssbarnea|bkp2, did you see my comment? | 20:25 |
| ssbarnea|bkp2 | weshay: now I did, and the answer: http://codesearch.openstack.org/?q=https%3A%2F%2Fgithub.com%2Fpre-commit%2Fpre-commit-hooks&i=nope&files=&repos= | 20:27 |
| ssbarnea|bkp2 | mainly 4 projects, with me involved in some of the but not all. | 20:27 |
| ssbarnea|bkp2 | nice comment! btw. | 20:27 |
| weshay | :) | 20:29 |
| *** agopi has quit IRC | 20:37 | |
| *** agopi has joined #oooq | 20:38 | |
| weshay | ssbarnea|bkp2, think you can setup openstack mirroring for that repo? | 20:48 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario007-multinode-oooq- (1 more message) | 20:49 |
| ssbarnea|bkp2 | weshay: i have no idea, but i can look for it. | 21:08 |
| weshay | ssbarnea|bkp2, ya.. I think it's just a config file | 21:08 |
| weshay | ssbarnea|bkp2, using github is bad | 21:08 |
| ssbarnea|bkp2 | not sure why is bad, only case would trottleing form github but i didn't see that ever on openstack. still, I will look into it. if adoption explodes and we lack caching it may be needed. | 21:10 |
| ssbarnea|bkp2 | i am going offline now, if this merges i will be busy tomorrow, fixings others CRs. but it would worth the effort. | 21:11 |
| *** dtrainor__ has quit IRC | 21:26 | |
| weshay | ssbarnea|bkp2, go ask in infra if you want more details | 21:27 |
| weshay | but openstack tests failing when github is down or dos attacked happens | 21:27 |
| weshay | and that's bad | 21:27 |
| weshay | openstack tests failing because git.openstack is down.. is obvious | 21:27 |
| weshay | ssbarnea|bkp2, get it | 21:27 |
| weshay | ssbarnea|bkp2, aye. .thanks for the hands and eyes | 21:27 |
| *** d0ugal has joined #oooq | 21:46 | |
| *** d0ugal has quit IRC | 22:06 | |
| *** trown is now known as trown|outtypewww | 22:13 | |
| *** derekh has joined #oooq | 22:23 | |
| *** derekh is now known as derekh_afk | 22:38 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario002-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario007-multinode-oooq- (1 more message) | 22:49 |
| *** d0ugal has joined #oooq | 22:53 | |
| *** saneax has joined #oooq | 23:10 | |
| *** agopi is now known as agopi|brb | 23:19 | |
| *** agopi|brb has quit IRC | 23:24 | |
| *** vkapalav has quit IRC | 23:38 | |
| *** agopi|brb has joined #oooq | 23:49 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!