| *** salv-orlando has joined #openstack-infra | 00:02 | |
| *** [HeOS] has joined #openstack-infra | 00:02 | |
| *** LindaWang has quit IRC | 00:03 | |
| *** rbrndt has quit IRC | 00:03 | |
| *** HeOS has quit IRC | 00:03 | |
| *** xarses has quit IRC | 00:04 | |
| *** salv-orlando has quit IRC | 00:06 | |
| *** sdague has quit IRC | 00:14 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove legacy sushy job https://review.openstack.org/518261 | 00:20 |
|---|---|---|
| *** baoli has joined #openstack-infra | 00:22 | |
| *** baoli has quit IRC | 00:26 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Use nodejs-npm jobs https://review.openstack.org/517770 | 00:28 |
| *** thorst has joined #openstack-infra | 00:34 | |
| *** e0ne has quit IRC | 00:38 | |
| *** thorst has quit IRC | 00:39 | |
| *** david-lyle has joined #openstack-infra | 00:42 | |
| *** Apoorva_ has quit IRC | 00:57 | |
| *** Apoorva has joined #openstack-infra | 01:01 | |
| *** salv-orlando has joined #openstack-infra | 01:03 | |
| *** Apoorva has quit IRC | 01:03 | |
| *** rlandy has quit IRC | 01:04 | |
| *** kiennt26 has quit IRC | 01:06 | |
| *** salv-orlando has quit IRC | 01:07 | |
| *** xarses_ has quit IRC | 01:14 | |
| *** xarses has joined #openstack-infra | 01:15 | |
| *** gyee has quit IRC | 01:19 | |
| *** baoli has joined #openstack-infra | 01:23 | |
| *** Apoorva has joined #openstack-infra | 01:23 | |
| *** sree has joined #openstack-infra | 01:25 | |
| *** baoli has quit IRC | 01:28 | |
| *** sree has quit IRC | 01:30 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul-jobs master: [DNM] Revert "Revert "Move to dictionary list of projects zuul._projects"" https://review.openstack.org/518815 | 01:31 |
| openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: [DNM] testing _project swap https://review.openstack.org/518816 | 01:35 |
| *** xarses has quit IRC | 01:38 | |
| *** thorst has joined #openstack-infra | 01:40 | |
| *** xarses has joined #openstack-infra | 01:48 | |
| *** Apoorva has quit IRC | 01:49 | |
| *** thorst has quit IRC | 01:59 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: [DNM] testing _project swap https://review.openstack.org/518816 | 01:59 |
| *** thorst has joined #openstack-infra | 02:00 | |
| *** thorst has quit IRC | 02:01 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: [DNM] testing _project swap https://review.openstack.org/518816 | 02:03 |
| *** salv-orlando has joined #openstack-infra | 02:04 | |
| *** salv-orlando has quit IRC | 02:08 | |
| *** Douhet has quit IRC | 02:11 | |
| *** iyamahat has quit IRC | 02:12 | |
| *** Douhet has joined #openstack-infra | 02:12 | |
| *** sree has joined #openstack-infra | 02:13 | |
| *** bobh has joined #openstack-infra | 02:14 | |
| *** sree_ has joined #openstack-infra | 02:23 | |
| *** sree_ is now known as Guest78376 | 02:23 | |
| *** sree has quit IRC | 02:27 | |
| *** xinliang has quit IRC | 02:36 | |
| *** baoli has joined #openstack-infra | 02:39 | |
| *** Guest78376 has quit IRC | 02:41 | |
| *** sree has joined #openstack-infra | 02:42 | |
| *** ihrachys has quit IRC | 02:44 | |
| *** baoli has quit IRC | 02:44 | |
| *** sree has quit IRC | 02:46 | |
| *** cuongnv has joined #openstack-infra | 02:50 | |
| *** xinliang has joined #openstack-infra | 02:53 | |
| *** xinliang has quit IRC | 02:53 | |
| *** xinliang has joined #openstack-infra | 02:53 | |
| *** ramishra has joined #openstack-infra | 03:00 | |
| *** hamzy has quit IRC | 03:05 | |
| *** jamesdenton has joined #openstack-infra | 03:05 | |
| *** yamamoto has joined #openstack-infra | 03:05 | |
| *** bobh has quit IRC | 03:11 | |
| *** hamzy has joined #openstack-infra | 03:14 | |
| jlvillal | ianw, Not sure if there is an issue, but I've seen POST_FAILURE are on two recent jobs. | 03:22 |
| jlvillal | Hopefully the log server isn't full... | 03:22 |
| jlvillal | s/are on two/on two/ | 03:22 |
| ianw | jlvillal: hmm, not that, couple of tb free | 03:23 |
| jlvillal | ianw, Okay. I saw one here: https://review.openstack.org/#/c/518791/ & currently running job: http://logs.openstack.org/72/518772/2/check/build-openstack-releasenotes/c1b5ab9/ | 03:24 |
| jlvillal | I haven't dug into them. | 03:24 |
| jlvillal | Hopefully a random error | 03:24 |
| *** dhinesh has quit IRC | 03:25 | |
| ianw | WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! | 03:25 |
| jlvillal | ianw, The second one has a strange error about the SSH key changing. That is a releasenotes job. Odd | 03:25 |
| jlvillal | I'm going to not worry about it tonight. Time to stop working :) | 03:26 |
| ianw | hmm, istr discussing this yesterday, but with a much more complex job (octavia maybe?) | 03:26 |
| jlvillal | ianw, Thanks. Have a great day :) | 03:26 |
| johnsom | It was octavia | 03:26 |
| *** ramishra has quit IRC | 03:35 | |
| ianw | all i can possibly think for a releasenotes job is that bindep changed it somehow | 03:36 |
| ianw | we could probably put an assert around the md5sum of the hosts file in bindep... | 03:37 |
| *** udesale has joined #openstack-infra | 03:39 | |
| *** psachin has joined #openstack-infra | 03:52 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul-jobs master: bindep: check ssh host key around install https://review.openstack.org/518826 | 03:57 |
| *** kiennt26 has joined #openstack-infra | 03:58 | |
| *** larainema has quit IRC | 04:01 | |
| *** thorst has joined #openstack-infra | 04:02 | |
| *** salv-orlando has joined #openstack-infra | 04:04 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul-jobs master: bindep: check ssh host key around install https://review.openstack.org/518826 | 04:05 |
| *** nicolasbock has quit IRC | 04:05 | |
| *** salv-orlando has quit IRC | 04:09 | |
| *** ramishra has joined #openstack-infra | 04:17 | |
| *** dbecker has quit IRC | 04:24 | |
| mnaser | looks like doc build jobs are failing | 04:25 |
| mnaser | Add correct host key in /var/lib/zuul/builds/cf267241dfc043e0a8f5ad45f651fa07/work/.ssh/known_hosts to get rid of this message. | 04:25 |
| mnaser | RSA host key for 146.20.110.99 has changed and you have requested strict checking. | 04:25 |
| mnaser | jlvillal: i think thats related to your failure | 04:26 |
| mnaser | oh ianw is already on it with that change | 04:27 |
| ianw | ... i can't imagine why though. if you can recheck with a depends-on of that and we catch it, it would be a smoking gun. it may also be something on the other side i guess | 04:28 |
| mnaser | ianw: common pattern seems to be publishing jobs but i guess its anything that uses fetch-<foo>-output | 04:29 |
| *** ykarel has joined #openstack-infra | 04:31 | |
| mnaser | ianw: an even more basic job when it comes to bindep - http://logs.openstack.org/66/518666/2/gate/build-openstack-sphinx-docs/cf26724/ | 04:32 |
| openstackgerrit | Merged openstack-infra/project-config master: Update other nodepool config for gentoo https://review.openstack.org/518777 | 04:32 |
| openstackgerrit | Merged openstack-infra/project-config master: remove tripleo-upgrade-scenario jobs from upstream https://review.openstack.org/518804 | 04:32 |
| mnaser | only libffi-dev and libssl-dev | 04:32 |
| *** aeng has quit IRC | 04:33 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add npm-docs job https://review.openstack.org/518789 | 04:34 |
| mnaser | ianw: | 04:34 |
| mnaser | its the same ip address | 04:34 |
| mnaser | that failed both jobs! | 04:34 |
| mnaser | 146.20.110.99 failed both in http://logs.openstack.org/66/518666/2/gate/build-openstack-sphinx-docs/cf26724/job-output.txt.gz and http://logs.openstack.org/72/518772/2/check/build-openstack-releasenotes/c1b5ab9/job-output.txt.gz | 04:34 |
| ianw | hmmmm ... now THAT would explain things | 04:34 |
| mnaser | which tells me it might be an issue with the provider/zuul/nodepool | 04:35 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: fix the undercloud-oooq job's subunit failures https://review.openstack.org/517428 | 04:35 |
| mnaser | if i remember correctly, fungi said this happened once before when a VM wasn't properly deleted at a cloud provider | 04:35 |
| *** dbecker has joined #openstack-infra | 04:38 | |
| ianw | at least they thought they got different nodes -> http://paste.openstack.org/show/625992/ | 04:40 |
| mnaser | ianw: i think that would be a cloud provider issue where the vm didnt get properly deleted | 04:41 |
| *** baoli has joined #openstack-infra | 04:41 | |
| mnaser | ianw: to add that theory, that IP is pingable right now so.. I guess it wasn't properly deleted | 04:41 |
| ianw | mnaser: what's the ip | 04:41 |
| mnaser | 146.20.110.99 | 04:42 |
| mnaser | i assume you'll probably be able to ssh into that IP if you have access to nodepool workers | 04:42 |
| ianw | 04:44:43 up 443 days what the?! | 04:45 |
| *** baoli has quit IRC | 04:45 | |
| openstackgerrit | Jaesuk Ahn proposed openstack-infra/irc-meetings master: This PS changes the name of meeting chair to mattmceuen. mattmceuen is the current chair and PTL of openstack-helm. https://review.openstack.org/518831 | 04:48 |
| ianw | ok, we seem to have some issues with puppetmaster too | 04:48 |
| *** aeng has joined #openstack-infra | 04:49 | |
| openstackgerrit | Jaesuk Ahn proposed openstack-infra/irc-meetings master: Change the name of openstack-helm chair This PS changes the name of meeting chair to mattmceuen. mattmceuen is the current chair and PTL of openstack-helm. https://review.openstack.org/518831 | 04:52 |
| ianw | infra-root: 146.20.110.99 as identified above is clearly a zombie and had been up for over a year ... i've shut it down | 04:55 |
| ianw | infra-root: but i can't log into puppetmaster atm. i'm guessing the semi occasional issues with have with it's memory. however, this means i can not easily get the credentials to try getting onto its console etc. if someone has them, it would be easier | 04:56 |
| *** salv-orlando has joined #openstack-infra | 05:06 | |
| ianw | i'm on the phone to rackspace | 05:08 |
| *** salv-orlando has quit IRC | 05:10 | |
| *** aeng has quit IRC | 05:12 | |
| *** aeng has joined #openstack-infra | 05:12 | |
| ianw | #status log the zombie host @ 146.20.110.99 (443 days uptime!) has been shutdown. this was likely causing POST_FAILURES as jobs managed to get run on it | 05:19 |
| openstackstatus | ianw: finished logging | 05:19 |
| ianw | #status log puppetmaster.o.o was hung with oom errors on the console. rax support rebooted it for me | 05:23 |
| openstackstatus | ianw: finished logging | 05:23 |
| *** slaweq has joined #openstack-infra | 05:25 | |
| ianw | last thing in the logs was from Nov 9 16:30:56, it's now Fri Nov 10 05:24:54 | 05:25 |
| *** janki has joined #openstack-infra | 05:25 | |
| *** slaweq has quit IRC | 05:29 | |
| *** armaan has joined #openstack-infra | 05:30 | |
| *** ramishra has quit IRC | 05:38 | |
| *** ramishra has joined #openstack-infra | 05:38 | |
| *** baoli has joined #openstack-infra | 05:42 | |
| *** armax has quit IRC | 05:44 | |
| *** slaweq has joined #openstack-infra | 05:46 | |
| *** slaweq has quit IRC | 05:46 | |
| *** slaweq has joined #openstack-infra | 05:46 | |
| *** baoli has quit IRC | 05:47 | |
| *** iyamahat has joined #openstack-infra | 05:47 | |
| *** iyamahat_ has joined #openstack-infra | 05:48 | |
| *** pcrews has quit IRC | 05:49 | |
| *** iyamahat has quit IRC | 05:52 | |
| *** slaweq has quit IRC | 05:53 | |
| *** aeng has quit IRC | 05:55 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Use npm docs jobs https://review.openstack.org/518794 | 05:58 |
| *** sree has joined #openstack-infra | 06:00 | |
| *** salv-orlando has joined #openstack-infra | 06:07 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove legacy job for monasca https://review.openstack.org/518666 | 06:10 |
| *** salv-orlando has quit IRC | 06:11 | |
| *** aeng has joined #openstack-infra | 06:16 | |
| *** salv-orlando has joined #openstack-infra | 06:18 | |
| *** kjackal has quit IRC | 06:21 | |
| *** kjackal has joined #openstack-infra | 06:23 | |
| *** aeng has quit IRC | 06:26 | |
| *** namnh has joined #openstack-infra | 06:32 | |
| *** eharney has quit IRC | 06:33 | |
| *** baoli has joined #openstack-infra | 06:43 | |
| dirk | dmsimard|off: thanks for the info. It should be fixed in newer nodepool images as well | 06:46 |
| *** baoli has quit IRC | 06:47 | |
| *** jaosorior has joined #openstack-infra | 06:49 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove now obsolete npm jobs https://review.openstack.org/518847 | 06:54 |
| *** coolsvap has joined #openstack-infra | 06:59 | |
| *** liujiong has joined #openstack-infra | 07:06 | |
| *** jbadiapa has joined #openstack-infra | 07:07 | |
| *** spectr has joined #openstack-infra | 07:09 | |
| *** e0ne has joined #openstack-infra | 07:09 | |
| *** e0ne has quit IRC | 07:12 | |
| *** andreas_s has joined #openstack-infra | 07:14 | |
| *** mpjetta_ has joined #openstack-infra | 07:17 | |
| *** eumel8 has joined #openstack-infra | 07:20 | |
| *** mpjetta has quit IRC | 07:20 | |
| *** mpjetta_ is now known as mpjetta | 07:20 | |
| *** spectr has quit IRC | 07:20 | |
| *** spectr has joined #openstack-infra | 07:21 | |
| *** xinliang has quit IRC | 07:29 | |
| openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Add building of openSUSE Tumbleweed nodepool images https://review.openstack.org/504169 | 07:30 |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role https://review.openstack.org/515643 | 07:36 |
| *** xinliang has joined #openstack-infra | 07:43 | |
| *** baoli has joined #openstack-infra | 07:43 | |
| *** stapler117 has quit IRC | 07:44 | |
| *** janki has quit IRC | 07:44 | |
| *** janki has joined #openstack-infra | 07:44 | |
| *** ykarel is now known as ykarel|lunch | 07:45 | |
| *** baoli has quit IRC | 07:48 | |
| *** makowals has joined #openstack-infra | 07:48 | |
| *** mandre_ is now known as mandre | 07:50 | |
| *** zhurong has joined #openstack-infra | 07:50 | |
| *** armaan has quit IRC | 07:53 | |
| *** rcernin has quit IRC | 07:56 | |
| *** makowals has quit IRC | 07:57 | |
| *** makowals has joined #openstack-infra | 07:59 | |
| *** alexchadin has joined #openstack-infra | 07:59 | |
| *** zhurong has quit IRC | 08:01 | |
| openstackgerrit | Wei Zheng proposed openstack/diskimage-builder master: Do not use “-y” for package install https://review.openstack.org/518863 | 08:11 |
| *** ccamacho has joined #openstack-infra | 08:11 | |
| *** annp has joined #openstack-infra | 08:20 | |
| *** ralonsoh has joined #openstack-infra | 08:22 | |
| *** armaan has joined #openstack-infra | 08:31 | |
| *** iyamahat has joined #openstack-infra | 08:33 | |
| *** iyamahat_ has quit IRC | 08:34 | |
| *** martinkopec has joined #openstack-infra | 08:39 | |
| *** baoli has joined #openstack-infra | 08:44 | |
| *** jaosorior is now known as jaosorior_lunch | 08:45 | |
| *** jpena|off is now known as jpena | 08:45 | |
| *** alexchadin has quit IRC | 08:46 | |
| *** alexchadin has joined #openstack-infra | 08:47 | |
| *** baoli has quit IRC | 08:49 | |
| *** ykarel|lunch is now known as ykarel | 08:54 | |
| *** martinkopec has quit IRC | 09:00 | |
| *** hashar has joined #openstack-infra | 09:03 | |
| *** e0ne has joined #openstack-infra | 09:03 | |
| *** efoley has joined #openstack-infra | 09:04 | |
| *** jpich has joined #openstack-infra | 09:05 | |
| *** rcernin has joined #openstack-infra | 09:08 | |
| *** amoralej|off is now known as amoralej | 09:11 | |
| *** slaweq has joined #openstack-infra | 09:12 | |
| *** martinkopec has joined #openstack-infra | 09:16 | |
| *** makowals has quit IRC | 09:17 | |
| *** yamamoto has quit IRC | 09:23 | |
| *** kiennt26 has quit IRC | 09:25 | |
| *** jascott1 has quit IRC | 09:25 | |
| *** jascott1 has joined #openstack-infra | 09:26 | |
| *** namnh has quit IRC | 09:28 | |
| *** andreas_s has quit IRC | 09:30 | |
| *** jascott1 has quit IRC | 09:31 | |
| *** udesale__ has joined #openstack-infra | 09:31 | |
| *** udesale has quit IRC | 09:32 | |
| *** efoley has quit IRC | 09:33 | |
| *** efoley has joined #openstack-infra | 09:33 | |
| *** andreas_s has joined #openstack-infra | 09:35 | |
| *** yamamoto has joined #openstack-infra | 09:36 | |
| *** andreas_s has quit IRC | 09:37 | |
| *** lucas-afk is now known as lucasagomes | 09:39 | |
| *** efoley has quit IRC | 09:40 | |
| *** derekh has joined #openstack-infra | 09:42 | |
| ianw | ok, i've run an audit of the rax jenkins account for each reason and i don't see any more of these zombie nodes | 09:42 |
| *** iyamahat has quit IRC | 09:42 | |
| ianw | pabelanger: in rax ord there is a host with name "pypi.slave.openstack.org" which I don't think is necessary any more? | 09:43 |
| *** larainema has joined #openstack-infra | 09:45 | |
| *** baoli has joined #openstack-infra | 09:45 | |
| *** caphrim007_ has quit IRC | 09:47 | |
| ianw | (note under the ci user, not the infra one) | 09:48 |
| *** caphrim007 has joined #openstack-infra | 09:48 | |
| *** baoli has quit IRC | 09:50 | |
| *** electrofelix has joined #openstack-infra | 09:50 | |
| frickler | ianw: I just saw a check time out and fail to collect logs afterwards, could you take a look pls? http://logs.openstack.org/50/518750/2/check/legacy-tempest-dsvm-designate-pdns4/f332dcf/job-output.txt.gz#_2017-11-10_09_42_52_369641 | 09:51 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: CleanUp sushy legacy jobs https://review.openstack.org/518268 | 09:52 |
| *** makowals has joined #openstack-infra | 09:53 | |
| *** iyamahat has joined #openstack-infra | 09:56 | |
| AJaeger | frickler, yolanda, could either of you review https://review.openstack.org/518677 to fix i18n docs publishing, please? | 09:56 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove now obsolete npm jobs https://review.openstack.org/518847 | 09:56 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove obsolete osc-check config https://review.openstack.org/518514 | 10:00 |
| *** iyamahat has quit IRC | 10:00 | |
| yolanda | AJaeger, done | 10:00 |
| AJaeger | thanks, yolanda | 10:01 |
| *** sdague has joined #openstack-infra | 10:01 | |
| openstackgerrit | Merged openstack-infra/project-config master: Update i18n publishing jobs https://review.openstack.org/518677 | 10:02 |
| *** liujiong has quit IRC | 10:03 | |
| openstackgerrit | Rui Chen proposed openstack-infra/nodepool feature/zuulv3: Apply floating ip for node according to configuration https://review.openstack.org/518875 | 10:05 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove jobs for ironic-staging-drivers https://review.openstack.org/518686 | 10:07 |
| *** alexchadin has quit IRC | 10:11 | |
| *** andreas_s has joined #openstack-infra | 10:18 | |
| *** d0ugal has quit IRC | 10:19 | |
| *** dsariel has joined #openstack-infra | 10:20 | |
| *** daidv has quit IRC | 10:21 | |
| openstackgerrit | Chandan Kumar proposed openstack-infra/project-config master: Remove py27 job from magnum-tempest-plugin https://review.openstack.org/518876 | 10:25 |
| *** alexchadin has joined #openstack-infra | 10:28 | |
| amotoki | AJaeger: I have a question on zuul config on horizon npm jobs you dropped recently | 10:32 |
| amotoki | AJaeger: it breaks horizon npm-run-test job after the merge and it blocks horizon gate | 10:33 |
| andreykurilin | Hi! Is this a good place to discuss bug at zuul_v3 or there is anotherr chat? | 10:35 |
| amotoki | AJaeger: after switching xvfb command which setup :99 display for npm test | 10:36 |
| amotoki | AJaeger: it was done at http://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/playbooks/legacy/nodejs4-npm-run-test/run.yaml?id=4a484988151afe1de638c8a17db67e53e1912cf6#n105 | 10:36 |
| amotoki | AJaeger: I wonder which is the best place to add it in the new zuulv3 playbook. some advise would be appreciated | 10:36 |
| chandankumar | AJaeger: ianw please have a look on this https://review.openstack.org/#/c/518876/ | 10:37 |
| *** openstack has joined #openstack-infra | 21:53 | |
| *** ChanServ sets mode: +o openstack | 21:53 | |
| clarkb | and there it is | 21:53 |
| clarkb | #status log had to perform a hard reboot on eavesdrop.openstack.org. Console showed it had xen timeouts and was not responsive to ssh. Manually started meetbot after boot. | 21:53 |
| *** mat128 has quit IRC | 21:56 | |
| *** Apoorva has joined #openstack-infra | 21:56 | |
| *** trown is now known as trown|outtypewww | 21:56 | |
| *** rossella_s has quit IRC | 21:59 | |
| *** rossella_s has joined #openstack-infra | 22:00 | |
| *** rbrndt has quit IRC | 22:00 | |
| *** rossella_s has quit IRC | 22:00 | |
| *** Goneri has joined #openstack-infra | 22:01 | |
| *** rbrndt has joined #openstack-infra | 22:01 | |
| *** rbrndt has quit IRC | 22:01 | |
| *** thorst has quit IRC | 22:02 | |
| *** [HeOS] has joined #openstack-infra | 22:09 | |
| clarkb | fyi I am now running https://review.openstack.org/#/c/517831/ locally and confirmed that last release of git review does not work with git 2.15 and this change does work with 2.15 | 22:15 |
| clarkb | if we can get that reviewed (and merged) soon that would be great to fix this problem for those of us that have newer gi | 22:16 |
| clarkb | (but I know everyone is travelling so will be patient) | 22:16 |
| *** ccamacho has quit IRC | 22:22 | |
| *** sree has joined #openstack-infra | 22:36 | |
| *** sree has quit IRC | 22:40 | |
| *** rcernin has quit IRC | 22:44 | |
| *** hashar has quit IRC | 22:44 | |
| *** hashar has joined #openstack-infra | 22:49 | |
| *** hashar has quit IRC | 22:49 | |
| *** hashar has joined #openstack-infra | 22:49 | |
| *** smatzek has joined #openstack-infra | 22:51 | |
| *** gongysh has joined #openstack-infra | 22:51 | |
| *** gongysh has quit IRC | 22:52 | |
| *** smatzek has quit IRC | 22:59 | |
| jlvillal | Any idea why would get errors like this? fatal: [primary]: UNREACHABLE! => {"changed": false, "msg": "SSH Error: data could not be sent to remote host \"15.184.66.121\". Make sure this host can be reached over ssh", "unreachable": true} | 22:59 |
| jlvillal | http://logs.openstack.org/72/518772/2/gate/ironic-tempest-dsvm-ipa-partition-redfish-tinyipa/ced919e/job-output.txt.gz | 22:59 |
| jlvillal | And 2nd build: http://logs.openstack.org/72/518772/2/gate/ironic-dsvm-standalone/1b8779b/job-output.txt.gz#_2017-11-10_22_08_50_833709 | 22:59 |
| jlvillal | In one buildset two builds failed with errors like that. | 23:00 |
| *** hashar has quit IRC | 23:02 | |
| clarkb | interestingly just before that error it runs an ansible ping in the pre tasks which performs an ssh | 23:09 |
| clarkb | and that was successful | 23:09 |
| clarkb | I wonder if ping doesn't start a new ssh connection | 23:09 |
| clarkb | but running a new playbook (in this case transitioning from pre.yaml to run.yaml) may | 23:10 |
| *** xarses_ has quit IRC | 23:11 | |
| clarkb | hrm also that is infracloud so could just be network bandwidth limitations there | 23:13 |
| *** mmedvede has quit IRC | 23:14 | |
| *** salv-orlando has quit IRC | 23:15 | |
| clarkb | jlvillal: we should probably use logstash to look at that particular failuretype and see if it is limited to infracloud. If it is then likely cloud networking bw issues, if not then there may be a bug in the zuul executor ssh system (or could mean all the clouds have networking unreliability) | 23:15 |
| *** bobh has quit IRC | 23:15 | |
| *** gouthamr has joined #openstack-infra | 23:16 | |
| *** salv-orlando has joined #openstack-infra | 23:23 | |
| *** salv-orl_ has joined #openstack-infra | 23:23 | |
| *** salv-orlando has quit IRC | 23:27 | |
| *** mmedvede has joined #openstack-infra | 23:34 | |
| *** mmedvede has quit IRC | 23:37 | |
| *** hamzy_ has joined #openstack-infra | 23:38 | |
| *** leakypipes has quit IRC | 23:38 | |
| *** mmedvede has joined #openstack-infra | 23:45 | |
| *** ccamacho has joined #openstack-infra | 23:49 | |
| *** Sukhdev has joined #openstack-infra | 23:53 | |
| *** salv-orl_ has quit IRC | 23:54 | |
| *** salv-orlando has joined #openstack-infra | 23:55 | |
| *** salv-orlando has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!