| fungi | i don't suppose we have a way to pass -vvv to those ssh commands and capture stdout/stderr from them? | 00:01 |
|---|---|---|
| fungi | we could also try splatting the public keys it's using out to the log and comparing them to what's generated/installed | 00:01 |
| openstackgerrit | Duc Truong proposed openstack-infra/irc-meetings master: Change Senlin meeting time https://review.openstack.org/593939 | 00:02 |
| mordred | ianw: neat | 00:03 |
| *** gouthamr has joined #openstack-infra | 00:03 | |
| ianw | fungi: should i put a zuul hold on and see? | 00:04 |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings master: Update FC SIG Meeting https://review.openstack.org/595377 | 00:04 |
| mordred | ianw: might be the mos expedient way | 00:04 |
| *** longkb has joined #openstack-infra | 00:05 | |
| dtruong | tonyb: i added the link to dev ML announcement about the senlin meeting time change to the commit message for https://review.openstack.org/593939 | 00:06 |
| dtruong | is that enough to get the time change approved? | 00:06 |
| tonyb | dtruong: Yup I was just about to approve it | 00:06 |
| tonyb | dtruong: Thanks | 00:06 |
| ianw | openstack | git.openstack.org/openstack-infra/system-config | system-config-run-base | .* | 1 | ianw: sysconfig | 00:06 |
| dtruong | thank you! | 00:06 |
| ianw | let's see then | 00:06 |
| tonyb | dtruong: done. Thank you for handling the hard parts :) | 00:07 |
| mordred | ianw: \o/ | 00:08 |
| mordred | ianw: btw - I'm going to be in your *general* timezone for a while | 00:09 |
| mordred | ianw: although I'll be on vacation for most of it | 00:09 |
| *** felipemonteiro has joined #openstack-infra | 00:09 | |
| mordred | by general, I mean I'll be in Vietnam - so while not the same, certainly closer than usual | 00:10 |
| ianw | heh, cool but still not quite part of the exclusive south of the equator club :) | 00:13 |
| *** gyee has quit IRC | 00:13 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Change Senlin meeting time https://review.openstack.org/593939 | 00:15 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Update FC SIG Meeting https://review.openstack.org/595377 | 00:15 |
| ianw | ok i think 199.204.45.118 must be bridge and 99.204.45.192 it's friend | 00:15 |
| mordred | ianw: I'm almost never that cool :) | 00:16 |
| ianw | oh we're ipv6 | 00:18 |
| *** mriedem has joined #openstack-infra | 00:19 | |
| *** dingyichen has joined #openstack-infra | 00:20 | |
| mordred | heck yes. mnaser gives us the good ipv6's | 00:21 |
| *** mnencia has quit IRC | 00:22 | |
| mordred | ianw: id we only copy in the known hosts for the v4 address? | 00:22 |
| mnaser | :) | 00:22 |
| ianw | mordred: well, looking at 199.204.45.192, /home/zuul/.ssh/authorized_keys only has zuul-worker in there | 00:23 |
| ianw | zuul@199.204.45.118 (bridge) i don't see how it can log in | 00:23 |
| *** mnencia has joined #openstack-infra | 00:23 | |
| *** mmedvede_ has joined #openstack-infra | 00:24 | |
| *** mmedvede has quit IRC | 00:24 | |
| *** mmedvede_ is now known as mmedvede | 00:24 | |
| *** jamesdenton has joined #openstack-infra | 00:26 | |
| mordred | ianw: did we run the multinode base job on these? | 00:26 |
| ianw | mordred: i think so http://logs.openstack.org/52/595252/5/check/system-config-run-base/80ca23f/ara-report/ | 00:28 |
| mordred | ianw: oh - https://review.openstack.org/#/c/595252/5/playbooks/zuul/run-base-pre.yaml | 00:29 |
| mordred | so that's got the known_hosts and ssh key | 00:29 |
| mordred | ianw: https://review.openstack.org/#/c/595252/5/.zuul.yaml - that playbook isn't called from the job | 00:29 |
| mordred | ianw: I think we're missing a pre-run: playbooks/zuul/run-base-pre.yaml | 00:30 |
| *** jamesmcarthur has joined #openstack-infra | 00:31 | |
| ianw | ahh, yes starting to agree. i can try with that | 00:32 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: WIP: Add system-config-run-base job https://review.openstack.org/595252 | 00:33 |
| ianw | ok, added pre book, removed old nodes and fresh hold on for ^ | 00:34 |
| ianw | SSH Error: data could not be sent to remote host \"158.69.93.177\" ... hrm somthing still not happy | 00:39 |
| ianw | it is running base.yaml on (in-test) bridge.o.o so i think that's one step better | 00:40 |
| ianw | 158.69.93.172 is bridge now, 158.69.93.177 xenial | 00:42 |
| *** jamesmcarthur has quit IRC | 00:44 | |
| ianw | the xenial node has no .ssh/known_hosts ... i think that's a clue | 00:44 |
| ianw | run-base-pre.yaml hasn't run against the xenial node | 00:45 |
| *** felipemonteiro has quit IRC | 00:46 | |
| ianw | - hosts: bridge.openstack.org ... i think that wants to be "all"? | 00:48 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: WIP: Add system-config-run-base job https://review.openstack.org/595252 | 00:49 |
| *** agopi has joined #openstack-infra | 00:54 | |
| mordred | ianw: yeah. I think so | 00:56 |
| ianw | yay, it worked! http://logs.openstack.org/52/595252/7/check/system-config-run-base/8a38616/ara-report/ | 00:59 |
| ianw | got into the testinfra stage, anyway | 00:59 |
| mordred | woot! | 01:00 |
| mordred | that's superexciting | 01:00 |
| *** gcb_ has quit IRC | 01:00 | |
| ianw | ok have to read a bit on testinfra now to see what it's trying to do | 01:01 |
| fungi | ianw: sorry, stepped away for a bit (pretty late here). i agree holding the nodes makes more sense than trying to get the job to do it just to get past this hurdle | 01:05 |
| *** markvoelker has joined #openstack-infra | 01:06 | |
| fungi | and looks like you did and figured it out | 01:06 |
| *** harlowja has quit IRC | 01:06 | |
| fungi | right on! | 01:06 |
| ianw | fungi: heh, np. hurdle passed and it looks like the nodes are all chatty | 01:06 |
| ianw | looks like we'll have another Prime Minister by the end of the day | 01:09 |
| fungi | how many is that for this week? | 01:09 |
| fungi | though in seriousness, i'm jealous | 01:09 |
| *** masayukig has joined #openstack-infra | 01:27 | |
| *** noama has quit IRC | 01:36 | |
| *** markvoelker has quit IRC | 01:40 | |
| *** mriedem has quit IRC | 01:48 | |
| *** larainema has quit IRC | 01:54 | |
| *** hongbin has joined #openstack-infra | 01:57 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: WIP: Add system-config-run-base job https://review.openstack.org/595252 | 02:00 |
| *** jamesmcarthur has joined #openstack-infra | 02:01 | |
| *** ddurst- is now known as ddurst | 02:04 | |
| ianw | testinfra/test_base.py::test_exim_is_installed[ansible://bridge.openstack.org] PASSED [ 50%] | 02:15 |
| ianw | testinfra/test_base.py::test_exim_is_installed[ansible://xenial] PASSED [100%] | 02:15 |
| ianw | that's pretty cool | 02:15 |
| *** jamesmcarthur has quit IRC | 02:19 | |
| *** diablo_rojo has quit IRC | 02:20 | |
| *** bdodd_ has joined #openstack-infra | 02:23 | |
| *** dave-mccowan has quit IRC | 02:27 | |
| *** dansmith has joined #openstack-infra | 02:28 | |
| *** mandre has joined #openstack-infra | 02:28 | |
| *** shoogz has quit IRC | 02:29 | |
| *** hemna_ has quit IRC | 02:29 | |
| *** srwilkers has quit IRC | 02:29 | |
| *** mnasiadka has quit IRC | 02:29 | |
| *** viks_ has quit IRC | 02:29 | |
| *** bdodd has quit IRC | 02:29 | |
| *** yonglihe has quit IRC | 02:29 | |
| *** hughsaunders has quit IRC | 02:29 | |
| *** rpioso|afk has quit IRC | 02:29 | |
| *** mandre_off has quit IRC | 02:29 | |
| *** htimsnad has quit IRC | 02:29 | |
| *** katyafervent_awa has quit IRC | 02:29 | |
| *** darvon has quit IRC | 02:29 | |
| *** shoogz- has joined #openstack-infra | 02:30 | |
| *** hughsaunders has joined #openstack-infra | 02:30 | |
| corvus | ianw: doh! thanks! that's some teamwork :) | 02:34 |
| *** felipemonteiro has joined #openstack-infra | 02:35 | |
| *** antonym has joined #openstack-infra | 02:37 | |
| *** hemna_ has joined #openstack-infra | 02:37 | |
| *** diablo_rojo has joined #openstack-infra | 02:37 | |
| *** markvoelker has joined #openstack-infra | 02:37 | |
| *** shoogz- is now known as shoogz | 02:38 | |
| *** psachin has joined #openstack-infra | 02:46 | |
| *** masayukig has quit IRC | 03:09 | |
| *** markvoelker has quit IRC | 03:11 | |
| *** masayukig has joined #openstack-infra | 03:11 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement an Amazon EC2 driver https://review.openstack.org/535558 | 03:21 |
| *** hongbin_ has joined #openstack-infra | 03:21 | |
| *** hongbin has quit IRC | 03:24 | |
| *** nicolasbock has quit IRC | 03:44 | |
| *** felipemonteiro has quit IRC | 03:45 | |
| *** udesale has joined #openstack-infra | 03:47 | |
| *** larainema has joined #openstack-infra | 04:00 | |
| *** markvoelker has joined #openstack-infra | 04:08 | |
| AJaeger | config-core, https://review.openstack.org/#/c/592292/ is job removal after retirement and https://review.openstack.org/#/c/595004/3 is python3-first change that is ready - could you review both, please? | 04:09 |
| *** ykarel has joined #openstack-infra | 04:14 | |
| AJaeger | thanks, ianw ! | 04:14 |
| AJaeger | config-core, and one more, please: https://review.openstack.org/595327 - to fix translation jobs | 04:15 |
| *** felipemonteiro has joined #openstack-infra | 04:15 | |
| tonyb | ianw: 589007 ( | 04:20 |
| tonyb | Support puppet5 for bionic) merged and I did a recheck on https://review.openstack.org/#/c/588441/ | 04:20 |
| tonyb | which failed :( | 04:20 |
| openstackgerrit | Merged openstack-infra/project-config master: remove job settings for PowerVMStackers repositories https://review.openstack.org/595004 | 04:22 |
| tonyb | I *think* it's because in https://review.openstack.org/#/c/589007/3/install_puppet.sh@222 you don't assign a puppetpkg and then when we get to https://review.openstack.org/#/c/589007/3/install_puppet.sh@258 it isn't installed resulting in http://logs.openstack.org/41/588441/1/check/build-wheel-mirror-ubuntu-bionic/b3fd7ef/job-output.txt.gz#_2018-08-22_23_42_46_453880 | 04:22 |
| tonyb | ianw: does that seem right'ish? | 04:22 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Don't create "admin" group https://review.openstack.org/595454 | 04:31 |
| ianw | tonyb: ummm | 04:32 |
| *** viks_ has joined #openstack-infra | 04:35 | |
| ianw | tonyb: yeah, ok i agree, what a mess | 04:36 |
| ianw | http://logs.openstack.org/41/588441/1/check/build-wheel-mirror-ubuntu-trusty/ddc9a4c/job-output.txt.gz#_2018-08-22_23_39_42_515609 | 04:36 |
| ianw | so on trusty it pre-installs then, re-installs. | 04:36 |
| tonyb | ianw: Oh | 04:37 |
| ianw | want to just propose an update? i have one more round on the ansible based roles, just updating the variables per mordred's request, and i think they're done anyway | 04:37 |
| tonyb | ianw: I assume it's just puppet not puppet5 ? | 04:37 |
| ianw | i think so, i can't understand why i didn't find this when i ran it locally | 04:38 |
| * tonyb wil spin up a bionic vm to check | 04:39 | |
| ianw | i'm just dockering it now ... | 04:39 |
| ianw | (is that a verb?) | 04:39 |
| tonyb | ;P | 04:40 |
| tonyb | Sure | 04:40 |
| *** markvoelker has quit IRC | 04:41 | |
| tonyb | LOL it seems I built a bad VM I booted it and now it's doing '/usr/bin/python3 /usr/bin/unattended-upgrade' :( | 04:43 |
| ianw | ahh, ok no the one from puppetlabs is called puppet-agent | 04:43 |
| ianw | oh i see what's going on | 04:44 |
| tonyb | okay, I'll verify that and propose an update | 04:44 |
| *** ramishra has joined #openstack-infra | 04:44 | |
| ianw | ok, great, yeah "puppetpkg=puppet-agent" WFM | 04:44 |
| ianw | but if you can fully verify, because soon after that it stops in my container as no /bin/systemctl and so gets confused and tries the initrd path | 04:45 |
| ianw | init.d i mean | 04:45 |
| ianw | sorry, maybe i didn't loop back and test it properly after we made the change to puppetlabs | 04:46 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Don't create "admin" group https://review.openstack.org/595454 | 04:48 |
| tonyb | ianw: Looks good ot me: http://paste.openstack.org/show/728653/ | 04:52 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement an OpenShift resource provider https://review.openstack.org/570667 | 04:52 |
| ianw | cool, yep that got hte puppetlabs versoin | 04:53 |
| openstackgerrit | Tony Breeds proposed openstack-infra/system-config master: Install the puppetlabs puppet package https://review.openstack.org/595456 | 05:00 |
| tonyb | ianw: ^^ | 05:00 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Generate roles documentation https://review.openstack.org/593478 | 05:02 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: playbooks/roles/exim: remove "true" filter plugin https://review.openstack.org/593998 | 05:02 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: roles: Add README.rst and lint https://review.openstack.org/594800 | 05:02 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Move exim role to top-level https://review.openstack.org/590753 | 05:02 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add kerberos-client role https://review.openstack.org/593486 | 05:02 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add openafs-client role https://review.openstack.org/593487 | 05:02 |
| openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: Test OpenAFS client install https://review.openstack.org/589335 | 05:03 |
| openstackgerrit | Jarek Lukow proposed openstack-infra/zuul master: Add missing parentheses to title invocation https://review.openstack.org/595361 | 05:09 |
| *** ccamacho has quit IRC | 05:11 | |
| *** ccamacho has joined #openstack-infra | 05:12 | |
| *** holser_ has joined #openstack-infra | 05:13 | |
| *** felipemonteiro has quit IRC | 05:17 | |
| *** ykarel_ has joined #openstack-infra | 05:17 | |
| *** ccamacho has quit IRC | 05:19 | |
| *** hongbin_ has quit IRC | 05:19 | |
| *** ykarel has quit IRC | 05:21 | |
| *** dmellado has joined #openstack-infra | 05:27 | |
| *** noama has joined #openstack-infra | 05:32 | |
| *** markvoelker has joined #openstack-infra | 05:38 | |
| openstackgerrit | Merged openstack-infra/system-config master: Install the puppetlabs puppet package https://review.openstack.org/595456 | 05:39 |
| *** holser_ has quit IRC | 05:40 | |
| *** janki has joined #openstack-infra | 05:40 | |
| *** dpawlik has joined #openstack-infra | 06:06 | |
| *** ccamacho has joined #openstack-infra | 06:07 | |
| *** dpawlik has quit IRC | 06:10 | |
| *** markvoelker has quit IRC | 06:12 | |
| *** dpawlik has joined #openstack-infra | 06:13 | |
| *** jchhatbar has joined #openstack-infra | 06:31 | |
| *** janki has quit IRC | 06:31 | |
| *** pcaruana has joined #openstack-infra | 06:33 | |
| *** hashar has joined #openstack-infra | 06:44 | |
| *** zhangfei has joined #openstack-infra | 06:46 | |
| *** ramishra has quit IRC | 06:49 | |
| *** AJaeger has quit IRC | 06:58 | |
| *** apetrich has joined #openstack-infra | 06:58 | |
| *** rcernin has quit IRC | 06:59 | |
| *** ykarel_ is now known as ykarel|away | 07:02 | |
| *** AJaeger has joined #openstack-infra | 07:04 | |
| *** ginopc has joined #openstack-infra | 07:05 | |
| *** ykarel|away has quit IRC | 07:07 | |
| *** ramishra has joined #openstack-infra | 07:07 | |
| *** jtomasek has joined #openstack-infra | 07:08 | |
| *** jtomasek has quit IRC | 07:08 | |
| *** markvoelker has joined #openstack-infra | 07:09 | |
| *** jtomasek has joined #openstack-infra | 07:09 | |
| *** florianf has joined #openstack-infra | 07:13 | |
| *** e0ne has joined #openstack-infra | 07:13 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: WIP web: rewrite interface in react https://review.openstack.org/591604 | 07:15 |
| *** shardy_afk is now known as shardy | 07:18 | |
| tonyb | ianw: That fixed the bionic job but the centos one still fails, I *think* in install_modules.sh). I'll lok at it tomorrow. | 07:21 |
| *** jchhatba_ has joined #openstack-infra | 07:24 | |
| *** jchhatbar has quit IRC | 07:25 | |
| *** jpich has joined #openstack-infra | 07:29 | |
| *** tosky has joined #openstack-infra | 07:34 | |
| *** longkb has quit IRC | 07:36 | |
| *** jpena|off is now known as jpena | 07:36 | |
| *** ykarel|away has joined #openstack-infra | 07:36 | |
| *** ykarel|away is now known as ykarel | 07:36 | |
| *** longkb has joined #openstack-infra | 07:36 | |
| *** annp has quit IRC | 07:37 | |
| *** diablo_rojo has quit IRC | 07:38 | |
| *** alexchadin has joined #openstack-infra | 07:38 | |
| *** electrofelix has joined #openstack-infra | 07:40 | |
| *** markvoelker has quit IRC | 07:42 | |
| openstackgerrit | lei zhang proposed openstack-infra/system-config master: Disable the badge from openstackdocstheme 1.23 https://review.openstack.org/595519 | 07:43 |
| *** jchhatba_ has quit IRC | 07:46 | |
| *** jchhatba_ has joined #openstack-infra | 07:48 | |
| *** jchhatba_ has quit IRC | 07:50 | |
| *** jchhatba_ has joined #openstack-infra | 07:50 | |
| openstackgerrit | lei zhang proposed openstack-infra/grafyaml master: Disable the badge from openstackdocstheme 1.23 https://review.openstack.org/595522 | 07:55 |
| *** alexchadin has quit IRC | 07:55 | |
| openstackgerrit | lei zhang proposed openstack-infra/storyboard master: Disable the badge from openstackdocstheme 1.23 https://review.openstack.org/595524 | 07:59 |
| *** alexchadin has joined #openstack-infra | 08:01 | |
| *** owalsh has quit IRC | 08:03 | |
| *** dbecker_ has joined #openstack-infra | 08:07 | |
| *** dbecker has quit IRC | 08:07 | |
| *** jaosorior has quit IRC | 08:10 | |
| *** dtantsur|afk is now known as dtantsur | 08:33 | |
| *** markvoelker has joined #openstack-infra | 08:39 | |
| *** ykarel is now known as ykarel|lunch | 08:40 | |
| *** owalsh has joined #openstack-infra | 08:48 | |
| *** owalsh_ has joined #openstack-infra | 08:50 | |
| *** owalsh has quit IRC | 08:53 | |
| *** owalsh has joined #openstack-infra | 08:55 | |
| *** gcb_ has joined #openstack-infra | 08:55 | |
| *** owalsh_ has quit IRC | 08:56 | |
| openstackgerrit | Nguyen Hai proposed openstack-infra/project-config master: remove job settings for mistral repositories https://review.openstack.org/593264 | 09:02 |
| *** jaosorior has joined #openstack-infra | 09:08 | |
| *** ykarel|lunch is now known as ykarel | 09:10 | |
| *** dingyichen has quit IRC | 09:11 | |
| *** markvoelker has quit IRC | 09:13 | |
| *** gcb_ has quit IRC | 09:13 | |
| *** jchhatba_ has quit IRC | 09:14 | |
| *** jchhatba_ has joined #openstack-infra | 09:14 | |
| *** gcb_ has joined #openstack-infra | 09:19 | |
| *** sambetts_ has joined #openstack-infra | 09:23 | |
| AJaeger | config-core, https://review.openstack.org/#/c/593264/ is ready for merge (python3-first) | 09:26 |
| *** holser_ has joined #openstack-infra | 09:34 | |
| *** jchhatbar has joined #openstack-infra | 09:36 | |
| *** jchhatba_ has quit IRC | 09:39 | |
| *** ssbarnea has joined #openstack-infra | 09:49 | |
| *** jaosorior has quit IRC | 09:54 | |
| *** jchhatbar has quit IRC | 09:58 | |
| openstackgerrit | Slawek Kaplonski proposed openstack-infra/project-config master: Add openstack-python36 job to Neutron Grafana dashboard https://review.openstack.org/595573 | 10:04 |
| *** spiffxp has quit IRC | 10:09 | |
| *** markvoelker has joined #openstack-infra | 10:10 | |
| *** vipul has quit IRC | 10:10 | |
| *** chason has quit IRC | 10:39 | |
| *** chason has joined #openstack-infra | 10:40 | |
| *** alexchadin has quit IRC | 10:41 | |
| *** alexchadin has joined #openstack-infra | 10:41 | |
| *** alexchadin has quit IRC | 10:42 | |
| *** markvoelker has quit IRC | 10:43 | |
| *** dave-mccowan has joined #openstack-infra | 10:45 | |
| *** jchhatbar has joined #openstack-infra | 10:46 | |
| *** jpena is now known as jpena|lunch | 11:03 | |
| *** dbecker_ has quit IRC | 11:10 | |
| *** dbecker has joined #openstack-infra | 11:13 | |
| *** alexchadin has joined #openstack-infra | 11:13 | |
| *** holser_ has quit IRC | 11:15 | |
| *** alexchadin has quit IRC | 11:18 | |
| *** nicolasbock has joined #openstack-infra | 11:22 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Add netcat to redhat-common map-packages https://review.openstack.org/588601 | 11:26 |
| *** udesale has quit IRC | 11:31 | |
| *** mriedem has joined #openstack-infra | 11:33 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: roles: Add README.rst and lint https://review.openstack.org/594800 | 11:35 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Move exim role to top-level https://review.openstack.org/590753 | 11:35 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add kerberos-client role https://review.openstack.org/593486 | 11:35 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add openafs-client role https://review.openstack.org/593487 | 11:35 |
| *** rh-jelabarre has joined #openstack-infra | 11:35 | |
| *** zhangfei has quit IRC | 11:38 | |
| *** markvoelker has joined #openstack-infra | 11:40 | |
| *** longkb has quit IRC | 11:42 | |
| openstackgerrit | Merged openstack-infra/system-config master: Generate roles documentation https://review.openstack.org/593478 | 11:44 |
| openstackgerrit | Merged openstack-infra/system-config master: playbooks/roles/exim: remove "true" filter plugin https://review.openstack.org/593998 | 11:44 |
| *** jaosorior has joined #openstack-infra | 11:54 | |
| *** moguimar has joined #openstack-infra | 12:01 | |
| *** alexchadin has joined #openstack-infra | 12:02 | |
| *** jcoufal has joined #openstack-infra | 12:03 | |
| *** alexchadin has quit IRC | 12:07 | |
| *** boden has joined #openstack-infra | 12:09 | |
| *** jpena|lunch is now known as jpena | 12:09 | |
| *** alexchadin has joined #openstack-infra | 12:09 | |
| *** markvoelker has quit IRC | 12:14 | |
| *** trown|outtypewww is now known as trown | 12:15 | |
| *** pcaruana has quit IRC | 12:16 | |
| *** pcaruana has joined #openstack-infra | 12:16 | |
| *** ansmith has quit IRC | 12:20 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/system-config master: Add timezone role https://review.openstack.org/594542 | 12:23 |
| Shrews | ianw: corvus: ^^ fix for ianw's comment about ignoring errors. turns out the problem was with the cron service name | 12:23 |
| Shrews | ianw: thx for making me think about that some more | 12:24 |
| *** rosmaita has joined #openstack-infra | 12:27 | |
| *** holser_ has joined #openstack-infra | 12:28 | |
| *** rlandy has joined #openstack-infra | 12:31 | |
| *** rh-jelabarre has quit IRC | 12:32 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: remove job settings for monasca repositories https://review.openstack.org/595744 | 12:32 |
| *** dims_ is now known as dims | 12:37 | |
| *** kgiusti has joined #openstack-infra | 12:39 | |
| *** ssbarnea|ruck has quit IRC | 12:44 | |
| *** tpsilva has joined #openstack-infra | 12:45 | |
| *** ykarel has quit IRC | 12:51 | |
| *** ykarel has joined #openstack-infra | 12:51 | |
| *** udesale has joined #openstack-infra | 12:54 | |
| *** mdrabe has joined #openstack-infra | 12:59 | |
| *** dhill_ has quit IRC | 13:01 | |
| *** jaosorior has quit IRC | 13:09 | |
| *** lennyb has quit IRC | 13:10 | |
| openstackgerrit | Slawek Kaplonski proposed openstack-infra/project-config master: Neutron failure rate - include TIMED_OUT jobs on graphs https://review.openstack.org/595763 | 13:14 |
| openstackgerrit | Nguyen Hai proposed openstack-infra/project-config master: remove job settings for octavia repositories https://review.openstack.org/595783 | 13:23 |
| *** rh-jelabarre has joined #openstack-infra | 13:34 | |
| *** felipemonteiro has joined #openstack-infra | 13:35 | |
| *** alexchadin has quit IRC | 13:39 | |
| *** psachin has quit IRC | 13:40 | |
| *** dhill_ has joined #openstack-infra | 13:44 | |
| *** felipemonteiro has quit IRC | 13:46 | |
| *** eharney has joined #openstack-infra | 13:48 | |
| *** viks_ has quit IRC | 13:49 | |
| *** jchhatbar has quit IRC | 13:55 | |
| *** ianychoi has quit IRC | 13:59 | |
| *** ianychoi has joined #openstack-infra | 14:00 | |
| *** dpawlik has quit IRC | 14:05 | |
| *** r-daneel has joined #openstack-infra | 14:07 | |
| *** dhill_ has quit IRC | 14:08 | |
| *** dhill_ has joined #openstack-infra | 14:21 | |
| *** pbourke has quit IRC | 14:24 | |
| *** pbourke has joined #openstack-infra | 14:26 | |
| *** ccamacho has quit IRC | 14:35 | |
| *** r-daneel has quit IRC | 14:37 | |
| *** Bhujay has joined #openstack-infra | 14:39 | |
| AJaeger | config-core, could you review https://review.openstack.org/595327 to fix translations reporting and https://review.openstack.org/592292 to retire rst2bash completely, please? | 14:41 |
| *** Swami has joined #openstack-infra | 14:50 | |
| *** hongbin has joined #openstack-infra | 14:53 | |
| hongbin | hi infra team, a question, tempest jobs that we defined were triggered on master and stable/queens branch, but not triggered at stable/rocky branch, for example: https://review.openstack.org/#/c/595218/ | 14:56 |
| hongbin | any hint to debug this issue? | 14:57 |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/puppet-openstackci master: Add AFS mirror support https://review.openstack.org/529376 | 14:57 |
| *** rpittau has quit IRC | 14:57 | |
| *** jamesmcarthur has joined #openstack-infra | 14:57 | |
| hongbin | master: https://review.openstack.org/#/c/595203/ | 14:58 |
| hongbin | stable/rocky: https://review.openstack.org/#/c/595218/ | 14:58 |
| hongbin | stable/queens: https://review.openstack.org/#/c/595215/ | 14:59 |
| Shrews | hrm, i've seen the infra-puppet-apply-4-centos-7 job for system-config fail twice now with: "rm: cannot remove ‘/tmp/tmp.bRgWBTZoQT/remote_tmp’: Permission denied" | 14:59 |
| Shrews | seems random, so maybe a race | 14:59 |
| hongbin | The jobs zun-tempest-* were triggered in master and stable/queens, but not triggered in stable/rocky | 15:00 |
| *** hamzy has quit IRC | 15:10 | |
| *** dhill_ has quit IRC | 15:11 | |
| *** dhill_ has joined #openstack-infra | 15:13 | |
| *** eernst has joined #openstack-infra | 15:16 | |
| *** moguimar has quit IRC | 15:18 | |
| *** dklyle has quit IRC | 15:20 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck master: Add query for cold migration revert ssh bug 1788403 https://review.openstack.org/595818 | 15:22 |
| openstack | bug 1788403 in OpenStack Compute (nova) "test_server_connectivity_cold_migration_revert randomly fails ssh check" [Medium,Confirmed] https://launchpad.net/bugs/1788403 | 15:22 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Add write-inventory role https://review.openstack.org/595378 | 15:27 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Allow bridge playbook to run under zuul https://review.openstack.org/595363 | 15:29 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: WIP: Add system-config-run-base job https://review.openstack.org/595252 | 15:29 |
| *** njohnston has joined #openstack-infra | 15:31 | |
| *** ykarel is now known as ykarel|away | 15:32 | |
| njohnston | Hi! I have a request to add something to elastic-recheck, how can I figure out who is core on it so I know who to add to the review? https://review.openstack.org/593722 | 15:32 |
| corvus | hongbin: it doesn't look like the change to add the jobs to stable/rocky has merged yet | 15:34 |
| *** hamzy has joined #openstack-infra | 15:35 | |
| *** Bhujay has quit IRC | 15:35 | |
| corvus | AJaeger, dhellmann: did we discuss whether to move pipeline membership out of project-config? | 15:36 |
| *** pcaruana has quit IRC | 15:36 | |
| hongbin | corvus: you mean this change: https://review.openstack.org/#/c/595396/ ? | 15:36 |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/puppet-openstackci master: Add AFS mirror support https://review.openstack.org/529376 | 15:37 |
| corvus | hongbin: i mean 595218 | 15:37 |
| *** dklyle has joined #openstack-infra | 15:37 | |
| AJaeger | corvus: pipeline membership? | 15:38 |
| AJaeger | what do you mean with that | 15:38 |
| corvus | AJaeger: er, sorry, i meant shared change queue membership. eg "queue: integrated" | 15:38 |
| corvus | hongbin: oh, you're asking about jobs like zun-tempest-docker-sql. sorry, missed that. | 15:39 |
| AJaeger | corvus: I don't remember any discussion. dhellmann, do you? | 15:39 |
| Shrews | njohnston: you shouldn't need to add specific core folks. cores should already be subscribed to the notifications for the project | 15:41 |
| corvus | hongbin: there's no stable/rocky branch of devstack yet, so the job can't run. as soon as it's branched, it will start working on the rocky branches of the zun repo. | 15:41 |
| hongbin | corvus: i see, thanks | 15:42 |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Add query for cold migration revert ssh bug 1788403 https://review.openstack.org/595818 | 15:44 |
| openstack | bug 1788403 in OpenStack Compute (nova) "test_server_connectivity_cold_migration_revert randomly fails ssh check" [Medium,Confirmed] https://launchpad.net/bugs/1788403 | 15:44 |
| hongbin | corvus: would look forward to the devstack change soon because there are no tempest coverage for all projects right now | 15:45 |
| hongbin | i knew many projects have back-ported several patches to stable/rocky and the missing of coverage might be series | 15:48 |
| AJaeger | hongbin: having you here: are you going to go through the fuxi python3-first changes? Ignore those by Filipo, they are all conflicts to what dhellmann did earlier... | 15:48 |
| AJaeger | hongbin: devstack is a deliverable of QA team, best reach out to them | 15:48 |
| hongbin | AJaeger: i don't have +2 privilege on the fuxi repo, you might want to ping the kuryr-core for that | 15:49 |
| AJaeger | hongbin: ok | 15:49 |
| hongbin | AJaeger: ack for the devstack remark | 15:49 |
| openstackgerrit | Merged openstack/os-testr master: Fix load command in pdb/no-discover path https://review.openstack.org/534365 | 15:50 |
| *** sthussey has joined #openstack-infra | 15:50 | |
| *** e0ne has quit IRC | 15:51 | |
| *** dhill_ has quit IRC | 15:51 | |
| *** ykarel|away has quit IRC | 15:51 | |
| *** ssbarnea|ruck has joined #openstack-infra | 15:58 | |
| *** gyee has joined #openstack-infra | 15:59 | |
| *** sileht has left #openstack-infra | 16:02 | |
| *** diablo_rojo has joined #openstack-infra | 16:03 | |
| *** mriedem is now known as mriedem_sudsy | 16:04 | |
| *** ginopc has quit IRC | 16:08 | |
| *** icey has quit IRC | 16:09 | |
| *** icey has joined #openstack-infra | 16:10 | |
| *** dhill_ has joined #openstack-infra | 16:11 | |
| *** harlowja has joined #openstack-infra | 16:17 | |
| *** Bhujay has joined #openstack-infra | 16:19 | |
| *** jpena is now known as jpena|off | 16:25 | |
| corvus | Shrews, pabelanger: now this is interesting -- i pushed up a new patchset with all the hosts added to the job. i expected testinfra to fail on some of them, but not on xenial, since it passed earlier. but it failed on all hosts: http://logs.openstack.org/52/595252/9/check/system-config-run-base/2bbcf99/job-output.txt.gz#_2018-08-23_15_44_30_760160 | 16:25 |
| *** mriedem_sudsy is now known as mriedem | 16:26 | |
| corvus | oh, it's saying all those hosts are 'unreachable' | 16:26 |
| corvus | hrm. well, i held the nodes, so i'll go poke at it | 16:26 |
| *** SamYaple has joined #openstack-infra | 16:28 | |
| corvus | it's super convenient that these nodes now have my user and key installed on them :) | 16:29 |
| *** jamesmcarthur has quit IRC | 16:31 | |
| *** jamesmcarthur has joined #openstack-infra | 16:32 | |
| *** jpich has quit IRC | 16:32 | |
| corvus | ianw, pabelanger, Shrews: okay, i understand why it's not working -- the ~root/.ssh/authorized_keys file was correctly updated to only allow logins from bridge and puppetmaster. what i don't understand is why that worked in the previous run. | 16:34 |
| *** udesale has quit IRC | 16:40 | |
| dhellmann | AJaeger, corvus : I asked how pipeline membership worked and IIRC you said zuul picks the first one it finds. I interpreted that as meaning it was ok to move it. Let me know if I'm wrong. We may have to move some settings back if that's the case. | 16:40 |
| *** harlowja has quit IRC | 16:40 | |
| dhellmann | AJaeger , corvus : I'm going to be offline starting about ~now until Monday, fwiw | 16:41 |
| corvus | dhellmann, AJaeger: from a social pov, we may want to have them in project-config, since adding and removing a project from a shared change queue is an action with cross-project effects. | 16:41 |
| dhellmann | ok, that does make sense | 16:42 |
| corvus | dhellmann: project-config is first in line, so we can just add them back there and then clean up in-repo stragglers at leisure | 16:43 |
| dhellmann | how many of the different settings are actually cross-team and how many are just setting up a pipeline of their own? | 16:43 |
| corvus | dhellmann: i don't know but i agree that's a good question | 16:44 |
| dhellmann | I feel like I saw at least some that were just linking a set of repos all owned by the same team | 16:44 |
| dhellmann | and then of course there's the integrated gate | 16:44 |
| tosky | uhm, infra people, sahara job definitions were migrated to repositories, but I noticed one strange thing | 16:44 |
| tosky | if you check those 4 commits (master and 3 backports), the gate jobs for rocky are way less than the other branches: https://review.openstack.org/#/q/4ac73ea6ecb001e7973a563a04b25ab914f79f21 | 16:44 |
| corvus | dhellmann: maybe we only care about "integrated" (and if there are any like it) | 16:44 |
| dhellmann | corvus : that would certainly leave a smaller set of projects to manage | 16:44 |
| corvus | tosky: there's no rocky devstack branch, so there are no rocky devstack jobs | 16:45 |
| tosky | oh | 16:45 |
| tosky | now that I think about it, I may already have asked about this in the previous cycle | 16:45 |
| * dhellmann has to leave to catch his flight | 16:45 | |
| corvus | tosky: i think we've agreed that we need to re-examine the branching order in the release process. i imagine we'll talk about it at the ptg | 16:46 |
| corvus | dhellmann: bon voyage! | 16:46 |
| tosky | corvus: I totally agree that this specific point should be revisited, otherwise we have this free backporting season :) | 16:48 |
| *** Swami has quit IRC | 16:49 | |
| *** davidlenwell has joined #openstack-infra | 16:50 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid master: Updated PDO Config to Support SSL connections https://review.openstack.org/595832 | 16:52 |
| *** ramishra has quit IRC | 16:52 | |
| tosky | corvus: uhm, regarding the changes above: the same happened with the stable/pike branch | 16:59 |
| AJaeger | corvus: I think we did not remove them from project-config - I think dhellmann just copied and duplicated.... I'll double check when reviewing | 17:01 |
| AJaeger | corvus: just checked, the "queue: " lines are not deleted from project-config. | 17:02 |
| AJaeger | corvus: if we have those now duplicated - should we ask to remove them in-repo again? | 17:03 |
| corvus | AJaeger: let's decide if we want to do that only for cross-team shared queues, or all. then yes. :) | 17:04 |
| corvus | tosky: i'll look at the pike change | 17:04 |
| corvus | tosky: what job specifically should i look for? | 17:04 |
| tosky | it was approved by accident before the queens change, but this accident showed the issue | 17:05 |
| tosky | corvus: uh, no, sorry, sorry | 17:06 |
| tosky | I see the jobs now, I was sure they were not there | 17:06 |
| tosky | apologize | 17:06 |
| corvus | tosky: np, easy fix :) | 17:06 |
| *** shardy has quit IRC | 17:06 | |
| AJaeger | corvus: having queue lines in a central place will avoid nasty surprises if somebody changes them... | 17:07 |
| AJaeger | asking for integrated gate to stay in project-config is a good policy IMHO. | 17:07 |
| corvus | AJaeger: yeah, i think we should do that for integrated. i'm on the fence about others. | 17:08 |
| *** Bhujay has quit IRC | 17:08 | |
| AJaeger | corvus: same for me. Anybody else here to weight in? | 17:09 |
| *** njohnston has left #openstack-infra | 17:13 | |
| *** sambetts_ is now known as sambetts|afk | 17:15 | |
| *** hashar is now known as hasharAway | 17:22 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid master: Added configuration for MYSQL SSL connection https://review.openstack.org/595839 | 17:22 |
| *** jrist has quit IRC | 17:26 | |
| *** holser_ has quit IRC | 17:28 | |
| *** mriedem is now known as mriedem_away | 17:36 | |
| *** holser_ has joined #openstack-infra | 17:36 | |
| *** jrist has joined #openstack-infra | 17:41 | |
| *** dtantsur is now known as dtantsur|afk | 17:46 | |
| openstackgerrit | Wei Tie proposed openstack-dev/pbr master: Support subdirectory in the url https://review.openstack.org/590066 | 17:47 |
| *** electrofelix has quit IRC | 17:48 | |
| openstackgerrit | Alexander Chadin proposed openstack-infra/project-config master: Add publish-to-pypi job to watcher-tempest-plugin https://review.openstack.org/595846 | 17:51 |
| AJaeger | chandankumar: are you around? Please setup pypi for the tempest-plugin change | 17:52 |
| *** holser_ has quit IRC | 17:53 | |
| *** florianf has quit IRC | 17:53 | |
| *** sshnaidm is now known as sshnaidm|off | 17:54 | |
| *** tosky has quit IRC | 17:54 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid master: Updated PDO Config to Support SSL connections https://review.openstack.org/595832 | 17:56 |
| *** raissa has joined #openstack-infra | 17:57 | |
| smcginnis | This job appears to be stuck? http://zuul.openstack.org/stream.html?uuid=c85701f4f8ec47ba95243dfdc0ef5c09&logfile=console.log | 17:58 |
| *** trown is now known as trown|lunch | 17:59 | |
| pabelanger | looks to be | 18:06 |
| pabelanger | but unsure why | 18:06 |
| pabelanger | checking zuul logs on executor now | 18:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: WIP: Add system-config-run-base job https://review.openstack.org/595252 | 18:07 |
| radez | hey folks, I've just realized that when networking-ansible was created https://review.openstack.org/#/c/565370/ the storyboard config for it were created as https://storyboard.openstack.org/#!/project/openstack/network-ansible | 18:11 |
| *** sweston has quit IRC | 18:11 | |
| pabelanger | smcginnis: logs say ansible is running on the remote node | 18:11 |
| pabelanger | but not sure what it is doing | 18:11 |
| *** sweston has joined #openstack-infra | 18:11 | |
| radez | is there a way I can get the storyboard configs updated to match the project name? networking-ansible instead of network-ansible? | 18:11 |
| smcginnis | pabelanger: Huh, OK. I hope whatever it is finished soon before it gets popped. | 18:12 |
| pabelanger | smcginnis: stash.sh seems to be still running | 18:12 |
| radez | oh nevermind is it correct, I think I had it listed somewhere incorrectly. | 18:14 |
| *** mriedem_away is now known as mriedem | 18:17 | |
| *** jamesmcarthur has quit IRC | 18:19 | |
| Shrews | corvus: where is /home/zuul/inventory.yaml coming from for --ansible-inventory? | 18:19 |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid master: Added configuration for MYSQL SSL connection https://review.openstack.org/595839 | 18:21 |
| *** r-daneel has joined #openstack-infra | 18:24 | |
| *** noama has quit IRC | 18:27 | |
| *** e0ne has joined #openstack-infra | 18:28 | |
| *** jcoufal_ has joined #openstack-infra | 18:30 | |
| *** jcoufal has quit IRC | 18:32 | |
| *** r-daneel_ has joined #openstack-infra | 18:38 | |
| *** hemna_ has quit IRC | 18:39 | |
| AJaeger | config-core, for rocky release, we need https://review.openstack.org/#/c/595846/1 - could you review, please? | 18:39 |
| *** r-daneel has quit IRC | 18:40 | |
| *** r-daneel_ is now known as r-daneel | 18:40 | |
| *** gcb_ has quit IRC | 18:41 | |
| *** apetrich has quit IRC | 18:42 | |
| AJaeger | pabelanger, corvus ^ | 18:43 |
| *** efried is now known as efried_afk | 18:43 | |
| corvus | Shrews: doh, i forgot to change that. i moved it to /etc/ansible/hosts/inventory.yaml so that we would pick up the host_vars files | 18:43 |
| Shrews | corvus: and yet it ran? that log has me all confused | 18:44 |
| corvus | Shrews: i'll look at the log | 18:44 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: WIP: Add system-config-run-base job https://review.openstack.org/595252 | 18:44 |
| corvus | Shrews: it looks like testinfra "skipped" | 18:45 |
| corvus | Shrews: apparently providing an invalid inventory file causes it to succeed. "neat" | 18:45 |
| Shrews | corvus: http://logs.openstack.org/52/595252/10/check/system-config-run-base/44dfc77/job-output.txt.gz#_2018-08-23_18_27_31_686995 | 18:45 |
| Shrews | result ok | 18:46 |
| Shrews | nice | 18:46 |
| corvus | here's the skip: http://logs.openstack.org/52/595252/10/check/system-config-run-base/44dfc77/job-output.txt.gz#_2018-08-23_18_28_25_606492 | 18:46 |
| *** e0ne has quit IRC | 18:46 | |
| Shrews | oh, this is all interleaved | 18:47 |
| corvus | Shrews: the task you linked to is a little misleading, i think it's an include_role, so this "ok" at http://logs.openstack.org/52/595252/10/check/system-config-run-base/44dfc77/job-output.txt.gz#_2018-08-23_18_27_31_756166 basically means "i included the role". then the role itself follows and that's the interesting bit | 18:47 |
| corvus | either way, the result is the same. "ok" :) | 18:48 |
| Shrews | corvus: ah i see. | 18:49 |
| corvus | oh neat, that one ran in an all-ipv6 env | 18:50 |
| Shrews | corvus: we could pass that inventory in as an extra var to tox role, i think | 18:52 |
| *** pcaruana has joined #openstack-infra | 18:52 | |
| Shrews | corvus: oh, maybe not | 18:52 |
| Shrews | nm | 18:52 |
| openstackgerrit | Merged openstack-infra/project-config master: Add publish-to-pypi job to watcher-tempest-plugin https://review.openstack.org/595846 | 18:53 |
| fungi | radez: if you want to rename the openstack/network-ansible repo to openstack/networking-ansible we have a process for that. just list it at https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Upcoming_Project_Renames and submit a corresponding project-config change and we'll (eventually) schedule a maintenance to change it over | 18:54 |
| corvus | Shrews: i updated the path in ps11 and placed an autohold. i expect testinfra to fail on some nodes and succeed on others. i'll use the held node to iterate on a working test there. | 18:55 |
| radez | fungi: thx for the reply, it was my mistake, it was infact named networking-ansible from the beginning | 18:55 |
| corvus | ooh its running now: http://zuul.openstack.org/stream.html?uuid=239fb4e087ba4220be57b49b946c3895&logfile=console.log | 18:55 |
| pabelanger | Shrews: I think you could export ANSIBLE_INVENTORY=foo, and ansible-playbook does the right thing, if you didn't pass it via CLI | 18:56 |
| corvus | pabelanger: this is for testinfra | 18:56 |
| pabelanger | ah | 18:56 |
| Shrews | corvus: i don't think testinfra will run anywhere but on bridge | 18:56 |
| corvus | it's not an immedate problem -- the command line will work for now, but we might want to do what Shrews is suggesting if we want to support it elsewhere | 18:57 |
| corvus | Shrews: yeah, my only concern at the moment is that it work from the pseudo-bridge created in that test | 18:57 |
| fungi | radez: oh, cool no worries then! | 18:58 |
| AJaeger | config-core, could you review https://review.openstack.org/595327 to fix translations reporting and https://review.openstack.org/592292 to retire rst2bash completely, please? | 18:58 |
| *** trown|lunch is now known as trown | 19:01 | |
| Shrews | corvus: success! except for the distro specific pkg issues | 19:01 |
| corvus | Shrews: yes -- though, trusty looks like it may have failed to ssh? | 19:02 |
| corvus | and there was another post failure... we'll have to look into that too, probably on the executor, since i didn't see anything in the logs | 19:04 |
| corvus | (the ssh key removal failed, but that's supposed to fail gracefully and not cause a post-failure) | 19:04 |
| pabelanger | ah, does infra playbooks remove the per job ssh key? | 19:06 |
| corvus | pabelanger: yes post-ssh in the zuul base job does. | 19:08 |
| corvus | i can't tell at the moment whether we should expect it to still work at the end of the job. | 19:08 |
| *** pcaruana has quit IRC | 19:09 | |
| *** jrist has quit IRC | 19:10 | |
| corvus | i can't ssh into the held host, so there may still be something wrong | 19:11 |
| corvus | i guess i should recheck it and hold an ssh session open during the run | 19:12 |
| pabelanger | I see in logs we are restarting sshd on nodes, maybe something to do with that | 19:12 |
| pabelanger | +1 to keep ssh session open | 19:13 |
| pabelanger | but, exciting nonetheless | 19:13 |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/puppet-openstackci master: Add AFS mirror support https://review.openstack.org/529376 | 19:14 |
| *** gcb_ has joined #openstack-infra | 19:18 | |
| corvus | it does take it a while to put together the nodeset | 19:20 |
| Shrews | could reduce it for now | 19:20 |
| *** apetrich has joined #openstack-infra | 19:21 | |
| corvus | Shrews: it worked more reliably with only one node -- i think there may be races around ssh cached connections, etc. | 19:21 |
| corvus | so i think we're at the point where we want them all | 19:21 |
| corvus | it's running now, and i have 2 root shells open to pseudo-bridge at 158.69.87.79 . i'll grab lunch now and poke at it when i get back. | 19:22 |
| *** jrist has joined #openstack-infra | 19:23 | |
| edmondsw | gmann can you switch your -W to a +W on https://review.openstack.org/#/c/591563/ now that swift has branched? | 19:24 |
| *** eharney has quit IRC | 19:25 | |
| smcginnis | Would it be a significant amount of work to have different "integrated" queues in gate for different branches? | 19:36 |
| smcginnis | Just seems odd to have a stable/rocky patch keep getting restarted by issues with master patches ahead of it in the queue. | 19:36 |
| AJaeger | smcginnis: we have master only projects in the integrated queue AFAIK as well... | 19:40 |
| *** mdrabe has quit IRC | 19:41 | |
| smcginnis | I see a mix of master, stable/rocky, stable/queens, all at least shown as being in a row in the same queue. Maybe it's a display thing. | 19:43 |
| *** lewo has joined #openstack-infra | 19:43 | |
| pabelanger | smcginnis: one reason to keep them shared, is if a project is branchless, it will apply to all branches | 19:45 |
| AJaeger | smcginnis: I mean: We have projects like tempest with no stable branches. So, if tempest merges, you want it test with stable/rocky, master etc. | 19:45 |
| AJaeger | smcginnis: like pabelanger says | 19:45 |
| *** jamesmcarthur has joined #openstack-infra | 19:45 | |
| corvus | the real reason is upgrade testing | 19:45 |
| AJaeger | corvus: good point | 19:46 |
| corvus | or, i guess, the "main" reason :) | 19:46 |
| smcginnis | Ah, makes sense in those cases. | 19:47 |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/puppet-openstackci master: Add AFS mirror support https://review.openstack.org/529376 | 19:49 |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard-webclient master: Show Email Addresses when Searching https://review.openstack.org/589713 | 19:51 |
| *** jcoufal_ has quit IRC | 20:01 | |
| *** holser_ has joined #openstack-infra | 20:05 | |
| *** panda has quit IRC | 20:05 | |
| corvus | hrm, ssh works fine on those hosts, and testinfra worked as expected, and the job reported 'failure' as expected rather than 'post_failure' | 20:09 |
| corvus | but this time it wasn't ipv6 only, it was mixed v4/v6 | 20:09 |
| corvus | so i think we need to catch a run on limestone | 20:10 |
| *** eernst has quit IRC | 20:10 | |
| *** eernst has joined #openstack-infra | 20:12 | |
| *** jcoufal has joined #openstack-infra | 20:13 | |
| *** eernst has quit IRC | 20:14 | |
| *** eernst has joined #openstack-infra | 20:14 | |
| corvus | i wonder if the lack of an ipv4 address causes a syntax error in the sshd config file | 20:20 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: WIP: Add system-config-run-base job https://review.openstack.org/595252 | 20:29 |
| corvus | let's assume that's the case ^ | 20:29 |
| *** kgiusti has left #openstack-infra | 20:29 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql master: Fix pandas rolling calls in run_time graph https://review.openstack.org/595885 | 20:30 |
| *** holser_ has quit IRC | 20:47 | |
| *** hamzy has quit IRC | 20:48 | |
| jmorgan1 | /msg clarkb hey | 20:50 |
| Shrews | corvus: looks like that did it? | 20:54 |
| Shrews | centos is the only failure | 20:54 |
| Shrews | and remove-build-sshkey seemed to work without errors | 20:55 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql master: Clean up run_time graph style https://review.openstack.org/595889 | 20:55 |
| *** jmorgan1 has quit IRC | 20:55 | |
| Shrews | oh, but those were rax | 20:55 |
| *** jmorgan1 has joined #openstack-infra | 20:55 | |
| corvus | Shrews: that was on rax which has ipv4, so we probably won't know if the ipv6 issue is fixed until it hits limestone again... ya | 20:55 |
| corvus | Shrews: but i think i'll assume that was the issue for now, take those held nodes, make a working testinfra test, and push up a final version of the patch for actual merging | 20:56 |
| Shrews | ++ | 20:57 |
| *** jcoufal has quit IRC | 20:59 | |
| *** jamesmcarthur has quit IRC | 21:00 | |
| *** rosmaita has quit IRC | 21:00 | |
| *** trown is now known as trown|outtypewww | 21:03 | |
| fungi | jmorgan1: clarkb is out for the week. need anything infrastructure related? we've got a whole team in here | 21:05 |
| *** rh-jelabarre has quit IRC | 21:09 | |
| *** david-lyle has joined #openstack-infra | 21:15 | |
| ianw | infra-root : could i ask for some eyes on openafs & kerberos roles in -> https://review.openstack.org/#/c/593487 https://review.openstack.org/#/c/593486 . last discussion with tonyb still having some issues with wheel build jobs, and i'd like us to spend time debugging the ansible rather than installing puppet in jobs | 21:15 |
| *** jmorgan1 has quit IRC | 21:17 | |
| *** eernst has quit IRC | 21:17 | |
| *** eernst_ has joined #openstack-infra | 21:17 | |
| corvus | ianw: sure thing; i'll look right after i finish up the base-run job | 21:17 |
| *** dklyle has quit IRC | 21:17 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Add system-config-run-base job https://review.openstack.org/595252 | 21:22 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Don't create "admin" group https://review.openstack.org/595454 | 21:22 |
| *** owalsh_ has joined #openstack-infra | 21:22 | |
| *** owalsh has quit IRC | 21:25 | |
| *** dpawlik has joined #openstack-infra | 21:26 | |
| *** owalsh_ has quit IRC | 21:26 | |
| *** owalsh has joined #openstack-infra | 21:27 | |
| *** dpawlik has quit IRC | 21:30 | |
| corvus | Shrews, ianw: can you review https://review.openstack.org/595378 ? (cc SpamapS, odyssey4me -- that's the write inventory role) | 21:31 |
| *** panda has joined #openstack-infra | 21:34 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Add iptables role https://review.openstack.org/593973 | 21:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Transfer iptables rules to ansible https://review.openstack.org/594340 | 21:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: iptables: factor out snmp rules https://review.openstack.org/594437 | 21:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: iptables: add a README https://review.openstack.org/594438 | 21:40 |
| *** dpawlik has joined #openstack-infra | 21:40 | |
| corvus | rebased on the new run-base test ^ | 21:40 |
| *** mriedem is now known as mriedem_afk | 21:43 | |
| *** dpawlik has quit IRC | 21:45 | |
| *** rcernin has joined #openstack-infra | 21:46 | |
| openstackgerrit | Merged openstack-infra/system-config master: roles: Add README.rst and lint https://review.openstack.org/594800 | 21:56 |
| tonyb | ianw: Thanks. | 21:58 |
| corvus | testinfra has an 'iptables' object but no 'ip6tables' object. | 21:58 |
| *** eernst_ has quit IRC | 22:03 | |
| *** hrubi has joined #openstack-infra | 22:06 | |
| *** jamesmcarthur has joined #openstack-infra | 22:07 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: iptables: factor out snmp rules https://review.openstack.org/594437 | 22:07 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: iptables: add a README https://review.openstack.org/594438 | 22:07 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Add a testinfra test for iptables https://review.openstack.org/595900 | 22:07 |
| *** eernst has joined #openstack-infra | 22:07 | |
| *** jamesmcarthur has quit IRC | 22:08 | |
| *** jamesmcarthur has joined #openstack-infra | 22:08 | |
| *** r-daneel_ has joined #openstack-infra | 22:08 | |
| *** r-daneel has quit IRC | 22:10 | |
| *** r-daneel_ is now known as r-daneel | 22:10 | |
| *** boden has quit IRC | 22:15 | |
| pabelanger | looks like we could write a patch to iptables module to use iptable6 command too, or atleast allow the command to be updated. | 22:16 |
| pabelanger | ip6tables* | 22:18 |
| *** owalsh has quit IRC | 22:18 | |
| *** owalsh has joined #openstack-infra | 22:22 | |
| *** dhill_ has quit IRC | 22:32 | |
| *** jamesmcarthur has quit IRC | 22:33 | |
| *** eernst has quit IRC | 22:33 | |
| corvus | ianw, SpamapS: i agree that in general role variables should be prefixed. but do we really want to extend that to roles which are just wrappers around modules? take a look at the expected usage in https://review.openstack.org/#/c/595252/13/playbooks/zuul/run-base.yaml and let me know if you still want me to change it. | 22:36 |
| SpamapS | corvus: yeah, that's why I left it at +1. I'm not really sure it's something to be dogmatic about. | 22:37 |
| corvus | (and i'm happy to go with "lets just always do it". it's not hard to change that patch. i'm mostly asking because it felt right to have "exim_aliases" for the exim role, and it felt right not to have "write_inventory_dest" for the write-inventory role, so i sort of wanted to check that and see why) | 22:38 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Add write-inventory role https://review.openstack.org/595905 | 22:39 |
| corvus | SpamapS, ianw: https://review.openstack.org/595905 and https://review.openstack.org/595378 are alternates implementing both | 22:41 |
| *** ssbarnea|ruck has quit IRC | 22:41 | |
| corvus | 2018-08-23 22:12:17.891183 | ubuntu-xenial | *** Missing role documentation: playbooks/roles/iptables/README.rst | 22:42 |
| corvus | that's awesome! i didn't know that had been implemented :) | 22:43 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Add iptables role https://review.openstack.org/593973 | 22:44 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Transfer iptables rules to ansible https://review.openstack.org/594340 | 22:44 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: iptables: factor out snmp rules https://review.openstack.org/594437 | 22:44 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Add a testinfra test for iptables https://review.openstack.org/595900 | 22:44 |
| corvus | those should all pass now. i think the only thing up in the air is the write-inventory role. let's get them all merged tomorrow | 22:46 |
| *** jmorgan1 has joined #openstack-infra | 22:49 | |
| *** threestrands has joined #openstack-infra | 22:53 | |
| *** tpsilva has quit IRC | 22:54 | |
| *** raissa has quit IRC | 22:56 | |
| *** jamesmcarthur has joined #openstack-infra | 22:59 | |
| *** hamzy has joined #openstack-infra | 23:18 | |
| *** rlandy is now known as rlandy|brb | 23:24 | |
| *** jamesmcarthur has quit IRC | 23:24 | |
| ianw | corvus: yeah i put in a little script for the README.rst, but now thinking on it probably works better as an option to zuul-sphinx | 23:31 |
| *** dingyichen has joined #openstack-infra | 23:42 | |
| *** felipemonteiro has joined #openstack-infra | 23:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!