| *** thorst has quit IRC | 00:00 | |
| *** piet has quit IRC | 00:00 | |
| jhesketh | jeblair: if you're feeling keen on zuul reviews, the sql reporter has been hanging for a while (https://review.openstack.org/#/c/223333/). It'd be good to start collecting results for os-health | 00:00 |
|---|---|---|
| jhesketh | especially with a combined sprint coming up | 00:00 |
| *** thorst has joined #openstack-infra | 00:00 | |
| jeblair | jhesketh: yes, i think now that the cloner in post stuff is merged, that's next. i'm too eod to look at it now, but i'll put it at the top of the v2 list for tomorrow | 00:01 |
| jhesketh | jeblair: no worries :-) | 00:01 |
| jeblair | (it's the last remaining exception to the v2 freeze in my mind) | 00:02 |
| *** yamamoto has joined #openstack-infra | 00:02 | |
| *** markvoelker has quit IRC | 00:02 | |
| *** ddieterly has joined #openstack-infra | 00:04 | |
| *** thorst has quit IRC | 00:04 | |
| *** adrian_otto has quit IRC | 00:05 | |
| *** kien-ha has joined #openstack-infra | 00:08 | |
| *** rdx_matt has joined #openstack-infra | 00:08 | |
| *** larainema has joined #openstack-infra | 00:10 | |
| *** markvoelker has joined #openstack-infra | 00:11 | |
| *** rdx_matt has quit IRC | 00:12 | |
| clarkb | hrm git review is still broken even with the patch to bump the war | 00:14 |
| *** markvoelker has quit IRC | 00:14 | |
| *** markvoelker has joined #openstack-infra | 00:14 | |
| *** cardeois__ has joined #openstack-infra | 00:16 | |
| *** esberglu has joined #openstack-infra | 00:16 | |
| anteaya | :( | 00:18 |
| clarkb | you knwo I wonder if its because we don't bouncycastle in our tests | 00:19 |
| *** stewie925 has quit IRC | 00:19 | |
| *** cardeois_ has quit IRC | 00:20 | |
| anteaya | but we didn't bouncycastle before, did we? | 00:20 |
| *** cardeois__ has quit IRC | 00:20 | |
| *** daemontool has quit IRC | 00:21 | |
| clarkb | no but new ssh isn't willing to accept the older cipher advertised by the gerrit server | 00:21 |
| *** zeih has joined #openstack-infra | 00:21 | |
| anteaya | ah | 00:22 |
| openstackgerrit | Patrick East proposed openstack-infra/devstack-gate: Add support for sub-node specific local.conf's https://review.openstack.org/341222 | 00:22 |
| *** zeih has quit IRC | 00:26 | |
| *** IlyaG has joined #openstack-infra | 00:27 | |
| stevemar | clarkb: o/ | 00:27 |
| craige | o/ | 00:28 |
| stevemar | clarkb: we're trying to iron out the osc-lib and osc madness right now, no one should be hitting it uness they are running master osc | 00:28 |
| *** Sukhdev has quit IRC | 00:29 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Use random numbers for ZK test paths https://review.openstack.org/341223 | 00:29 |
| *** eeiden has quit IRC | 00:29 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: WIP: ZooKeeper API https://review.openstack.org/340658 | 00:29 |
| jhesketh | jeblair: regarding your comment for the last exception to v2, we should go over the list again and double check that. I think there are a few bug fixes we may still want | 00:29 |
| clarkb | stevemar: ya I am putting those into the "broken so ignore" | 00:30 |
| clarkb | pile | 00:30 |
| stevemar | clarkb: yeah, good call, it's almost fixed -- using the latest osc-lib should resolve it | 00:31 |
| stevemar | clarkb: the amount of people hitting that error (which is only discoverable when using master) is astounding | 00:31 |
| *** sarob has joined #openstack-infra | 00:31 | |
| *** ddieterly is now known as ddieterly[away] | 00:32 | |
| stevemar | clarkb: we (osc team) knew we had a chance of busting ourselves with an osc-lib release, but we didn't expect others to be dependent on master | 00:32 |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update DRY plugin to use convert xml function https://review.openstack.org/341240 | 00:33 |
| *** _oanson has joined #openstack-infra | 00:35 | |
| *** asettle has joined #openstack-infra | 00:36 | |
| *** ddieterly[away] has quit IRC | 00:36 | |
| *** esberglu has quit IRC | 00:37 | |
| *** pvaneck has quit IRC | 00:37 | |
| *** esberglu_ has joined #openstack-infra | 00:37 | |
| *** Swami has quit IRC | 00:37 | |
| *** sflanigan has quit IRC | 00:38 | |
| *** IlyaG has quit IRC | 00:39 | |
| *** asettle has quit IRC | 00:40 | |
| *** sflanigan has joined #openstack-infra | 00:41 | |
| *** kzaitsev_mb has quit IRC | 00:42 | |
| clarkb | DinaBelova: bauzas: hey I am running tests on xenial to see what breaks and Blazer breaks with AttributeError: 'module' object has no attribute 'PROTOCOL_SSLv3'. I believe that python has had its sslv3 stuff removed from it in xenial because it is insecure and should not be used. Blazar should either stop supporting sslv3 entirely or be prepared to handle it when python is missing it | 00:44 |
| clarkb | DinaBelova: bauzas I can file a bug if that helps too. Just trying to work through all these issues | 00:45 |
| clarkb | DinaBelova: bauzas also looks like blazar fails pep8 with legit fails | 00:47 |
| anteaya | hopefully there is someone named priteau who will also start to get more involved in Blazar soon | 00:47 |
| anteaya | he is associated with the scientific working group | 00:47 |
| anteaya | their group has a whole lot of commits on their github fork and want to submit things upstream | 00:48 |
| anteaya | as an fyi | 00:48 |
| *** amitgandhinz has joined #openstack-infra | 00:49 | |
| *** gouthamr has joined #openstack-infra | 00:50 | |
| *** tphummel has quit IRC | 00:52 | |
| *** mtanino has quit IRC | 00:53 | |
| *** thorst has joined #openstack-infra | 00:53 | |
| *** amitgandhinz has quit IRC | 00:54 | |
| *** ddieterly has joined #openstack-infra | 00:55 | |
| *** Julien-zte has joined #openstack-infra | 00:56 | |
| *** piet has joined #openstack-infra | 00:57 | |
| *** _oanson has quit IRC | 00:58 | |
| *** esberglu_ has quit IRC | 00:59 | |
| *** dimtruck is now known as zz_dimtruck | 00:59 | |
| *** sarob has quit IRC | 00:59 | |
| *** zz_dimtruck is now known as dimtruck | 01:01 | |
| *** esberglu has joined #openstack-infra | 01:05 | |
| *** zhurong has joined #openstack-infra | 01:06 | |
| *** ddieterly has quit IRC | 01:08 | |
| clarkb | dhellmann: zaro fungi and anyone else following along at home http://paste.openstack.org/show/531078/ is the list of fails that I think we need to care about | 01:08 |
| clarkb | a decent number of them already have fixes proposed I just need to test them and we can knock them off the list if that fixes stuff | 01:08 |
| clarkb | but its getting late here and I need to think about dinner | 01:08 |
| *** rdx_matt has joined #openstack-infra | 01:09 | |
| anteaya | clarkb: enjoy dinner | 01:09 |
| anteaya | thanks for your hard work here | 01:09 |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update clamav plugin to use convert xml https://review.openstack.org/341249 | 01:10 |
| *** Apoorva_ has joined #openstack-infra | 01:10 | |
| *** Apoorva has quit IRC | 01:11 | |
| *** gfreeman has quit IRC | 01:13 | |
| *** rdx_matt has quit IRC | 01:14 | |
| *** Apoorva has joined #openstack-infra | 01:14 | |
| *** shashank_hegde has quit IRC | 01:14 | |
| *** xarses has joined #openstack-infra | 01:14 | |
| clarkb | Nakato: mordred please let me know if you discover anything exciting about the wsgi and subprocess stdout reading. I have a hunch that will be a fun bug :) | 01:15 |
| clarkb | I hope to poke at it myself tomorrow from the pifpaf side | 01:15 |
| *** Apoorva_ has quit IRC | 01:16 | |
| *** piet has quit IRC | 01:17 | |
| *** csomerville has quit IRC | 01:17 | |
| *** gouthamr has quit IRC | 01:17 | |
| *** karthikp_ has quit IRC | 01:17 | |
| *** karthikp_ has joined #openstack-infra | 01:18 | |
| *** Apoorva has quit IRC | 01:19 | |
| clarkb | I fixed the glanceclient releasenotes issue so thats once fewer things to deal with | 01:21 |
| *** zeih has joined #openstack-infra | 01:22 | |
| clarkb | and I think I see how to fix a bunch of the others so will work on that in the morning | 01:22 |
| *** Daisy has joined #openstack-infra | 01:25 | |
| Nakato | clarkb: Where was that run? I can't seem to reproduce on a 16.04 VM | 01:25 |
| *** markvoelker has quit IRC | 01:25 | |
| *** karthikp_ has quit IRC | 01:25 | |
| *** baoli has joined #openstack-infra | 01:25 | |
| ianw | if i pip3 install a package in a virtualenv ... is there some trick to getting the entry point bin/ scripts? | 01:25 |
| clarkb | Nakato: on a 16.04 image built using the same method as nodepool (dib and the same elements) | 01:25 |
| clarkb | Nakato: its possible its an issue with my local test setup. It has only a single cpu | 01:26 |
| clarkb | Nakato: I can try to reproduce on a proper nodepool host tomorrow to at least narrow that down | 01:26 |
| *** zeih has quit IRC | 01:27 | |
| *** dimtruck is now known as zz_dimtruck | 01:27 | |
| clarkb | Nakato: the python-gnocchiclient and python-aodhclient py27 tests exhibit similar behavior with the pifpaf too | 01:28 |
| clarkb | s/too/tool/ | 01:28 |
| Nakato | clarkb: I'll keep poking at it as well. It may be a good reason for me to resurect a stashed change to all of test_wsgi that makes it a bit more robust and logs more. | 01:28 |
| clarkb | pifpaf starts a daemon and checks its stdout in a similar way to how pbr's wsgi tests work | 01:28 |
| *** clenimar_ has quit IRC | 01:29 | |
| ianw | ... ok it's going to ~/.local/bin and seemingly breaking out of the virtualenv ... | 01:30 |
| clarkb | ianw: huh | 01:32 |
| clarkb | ianw: possibly related to the new python3 virtualenv reaplcement maybe? | 01:32 |
| *** rkukura has quit IRC | 01:32 | |
| *** EricGonczer_ has quit IRC | 01:32 | |
| *** sarob has joined #openstack-infra | 01:33 | |
| *** sarob has quit IRC | 01:37 | |
| ianw | clarkb : hmm yeah, pyvenv seems to have done the job. wow it's easy to get bits confused | 01:38 |
| *** esberglu has quit IRC | 01:39 | |
| *** IlyaG has joined #openstack-infra | 01:40 | |
| *** clenimar_ has joined #openstack-infra | 01:41 | |
| *** kzaitsev_mb has joined #openstack-infra | 01:42 | |
| *** baoli has quit IRC | 01:42 | |
| *** ociuhandu has quit IRC | 01:43 | |
| openstackgerrit | Merged openstack-dev/pbr: Add Python 3.5 classifier and venv https://review.openstack.org/340813 | 01:43 |
| *** Daisy has quit IRC | 01:44 | |
| *** Daisy has joined #openstack-infra | 01:45 | |
| *** IlyaG has quit IRC | 01:45 | |
| clarkb | Nakato: re ^ we should make py35 voting in pbr | 01:46 |
| clarkb | Nakato: let me write that change really quickly so we don't forget | 01:46 |
| mordred | clarkb: ++ | 01:46 |
| *** flepied has quit IRC | 01:46 | |
| Nakato | clarkb: +1 | 01:47 |
| *** flepied has joined #openstack-infra | 01:47 | |
| mordred | clarkb: I am now online, but still not in a good place to get my hands on a xenial | 01:47 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Make pbr py35 jobs voting https://review.openstack.org/341254 | 01:48 |
| clarkb | mordred: Nakato ^ that should make it voting | 01:48 |
| clarkb | now its really time for dinner | 01:48 |
| *** esker has joined #openstack-infra | 01:49 | |
| *** Daisy has quit IRC | 01:49 | |
| Nakato | mordred: Where are the xenial dib elements? Never touched these bits. | 01:50 |
| *** amitgandhinz has joined #openstack-infra | 01:50 | |
| *** esberglu has joined #openstack-infra | 01:50 | |
| *** karthikp_ has joined #openstack-infra | 01:51 | |
| *** zz_dimtruck is now known as dimtruck | 01:51 | |
| Nakato | Oh, nevermind, found I think | 01:52 |
| mordred | Nakato: there shouldn't be xenial elements ... there's an ubuntu-minimal element that takes arguments | 01:52 |
| *** thorst has quit IRC | 01:53 | |
| *** yanyanhu has joined #openstack-infra | 01:53 | |
| *** ccamacho has joined #openstack-infra | 01:53 | |
| *** cody-somerville has joined #openstack-infra | 01:54 | |
| *** amitgandhinz has quit IRC | 01:54 | |
| *** jamesmcarthur has joined #openstack-infra | 01:55 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update WhiteSource plugin https://review.openstack.org/341256 | 01:55 |
| *** esberglu has quit IRC | 01:55 | |
| openstackgerrit | Merged openstack-dev/pbr: Fix argument order for assertEqual to (expected, observed) https://review.openstack.org/340654 | 01:56 |
| *** karthikp_ has quit IRC | 01:58 | |
| *** jamesmcarthur has quit IRC | 01:59 | |
| *** adrian_otto has joined #openstack-infra | 02:00 | |
| *** adrian_otto has quit IRC | 02:02 | |
| *** Daisy has joined #openstack-infra | 02:04 | |
| *** adrian_otto has joined #openstack-infra | 02:05 | |
| *** caowei has joined #openstack-infra | 02:06 | |
| *** rdx_matt has joined #openstack-infra | 02:10 | |
| *** akshai has joined #openstack-infra | 02:10 | |
| *** rdx_matt has quit IRC | 02:14 | |
| *** esberglu has joined #openstack-infra | 02:15 | |
| *** akshai has quit IRC | 02:16 | |
| *** adrian_otto has quit IRC | 02:18 | |
| *** adrian_otto has joined #openstack-infra | 02:20 | |
| *** ddieterly has joined #openstack-infra | 02:23 | |
| *** zeih has joined #openstack-infra | 02:23 | |
| *** shashank_hegde has joined #openstack-infra | 02:27 | |
| *** ddieterly has quit IRC | 02:28 | |
| *** zeih has quit IRC | 02:28 | |
| *** adrian_otto has quit IRC | 02:29 | |
| *** esberglu has quit IRC | 02:31 | |
| *** ddieterly has joined #openstack-infra | 02:32 | |
| *** shashank_hegde has quit IRC | 02:34 | |
| *** mdrabe_ has quit IRC | 02:34 | |
| *** migi has quit IRC | 02:36 | |
| *** ansiwen has quit IRC | 02:37 | |
| *** kien-ha has quit IRC | 02:37 | |
| *** migi has joined #openstack-infra | 02:37 | |
| *** ansiwen has joined #openstack-infra | 02:38 | |
| *** rossella_s has quit IRC | 02:40 | |
| *** rossella_s has joined #openstack-infra | 02:40 | |
| *** karthikp_ has joined #openstack-infra | 02:41 | |
| *** oanson has quit IRC | 02:41 | |
| *** IlyaG has joined #openstack-infra | 02:42 | |
| *** baoli has joined #openstack-infra | 02:42 | |
| *** oanson has joined #openstack-infra | 02:42 | |
| *** flepied has quit IRC | 02:42 | |
| *** flepied has joined #openstack-infra | 02:43 | |
| *** ddieterly is now known as ddieterly[away] | 02:44 | |
| *** ddieterly[away] has quit IRC | 02:45 | |
| *** amoralej|off has quit IRC | 02:46 | |
| *** mdbooth has quit IRC | 02:46 | |
| *** IlyaG has quit IRC | 02:47 | |
| *** amoralej has joined #openstack-infra | 02:47 | |
| *** mdbooth has joined #openstack-infra | 02:48 | |
| *** gyee has quit IRC | 02:49 | |
| *** amitgandhinz has joined #openstack-infra | 02:50 | |
| *** esker has quit IRC | 02:51 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on oslo.rootwrap https://review.openstack.org/341264 | 02:52 |
| *** migi has quit IRC | 02:52 | |
| *** thorst has joined #openstack-infra | 02:53 | |
| *** migi has joined #openstack-infra | 02:54 | |
| *** amitgandhinz has quit IRC | 02:56 | |
| *** karthikp_ has quit IRC | 02:57 | |
| *** kushal has joined #openstack-infra | 02:58 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on taskflow https://review.openstack.org/341269 | 02:58 |
| *** ajo has quit IRC | 03:00 | |
| *** itisha has quit IRC | 03:00 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on oslo.policy https://review.openstack.org/341270 | 03:00 |
| *** mriedem has quit IRC | 03:02 | |
| *** thorst has quit IRC | 03:02 | |
| *** coolsvap has joined #openstack-infra | 03:02 | |
| *** ajo has joined #openstack-infra | 03:03 | |
| *** caowei has quit IRC | 03:06 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on automaton https://review.openstack.org/341271 | 03:06 |
| *** coolsvap has quit IRC | 03:10 | |
| *** rdx_matt has joined #openstack-infra | 03:11 | |
| *** karthikp_ has joined #openstack-infra | 03:13 | |
| *** shashank_hegde has joined #openstack-infra | 03:14 | |
| *** rdx_matt has quit IRC | 03:15 | |
| *** treaki__ has joined #openstack-infra | 03:17 | |
| *** woodster_ has quit IRC | 03:19 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on oslo.messaging https://review.openstack.org/341272 | 03:19 |
| *** treaki_ has quit IRC | 03:21 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on debtcollector https://review.openstack.org/341274 | 03:22 |
| *** zeih has joined #openstack-infra | 03:24 | |
| *** Rockyg has quit IRC | 03:25 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on futurist https://review.openstack.org/341276 | 03:26 |
| *** zeih has quit IRC | 03:28 | |
| *** karthikp_ has quit IRC | 03:29 | |
| *** Daisy has quit IRC | 03:31 | |
| *** shashank_hegde has quit IRC | 03:32 | |
| *** Daisy has joined #openstack-infra | 03:32 | |
| *** Daisy has quit IRC | 03:33 | |
| *** Daisy_ has joined #openstack-infra | 03:33 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on oslo.concurrency https://review.openstack.org/341277 | 03:34 |
| *** kushal has quit IRC | 03:37 | |
| *** cody-somerville has quit IRC | 03:38 | |
| *** sree_ has joined #openstack-infra | 03:42 | |
| *** sree_ is now known as Guest16471 | 03:42 | |
| *** IlyaG has joined #openstack-infra | 03:43 | |
| *** kushal has joined #openstack-infra | 03:43 | |
| *** IlyaG has quit IRC | 03:47 | |
| *** Sukhdev has joined #openstack-infra | 03:48 | |
| *** flepied has quit IRC | 03:48 | |
| *** amitgandhinz has joined #openstack-infra | 03:53 | |
| *** flepied has joined #openstack-infra | 03:53 | |
| *** markvoelker has joined #openstack-infra | 03:55 | |
| *** amitgandhinz has quit IRC | 03:57 | |
| *** thorst has joined #openstack-infra | 04:00 | |
| *** yamamoto has quit IRC | 04:01 | |
| *** fawadkhaliq has joined #openstack-infra | 04:01 | |
| *** sarob has joined #openstack-infra | 04:01 | |
| *** sarob has quit IRC | 04:03 | |
| *** links has joined #openstack-infra | 04:03 | |
| *** Daisy_ has quit IRC | 04:03 | |
| *** Daisy has joined #openstack-infra | 04:04 | |
| *** cody-somerville has joined #openstack-infra | 04:04 | |
| *** EricGonczer_ has joined #openstack-infra | 04:05 | |
| *** thorst has quit IRC | 04:07 | |
| *** csomerville has joined #openstack-infra | 04:08 | |
| *** armax has quit IRC | 04:08 | |
| *** Daisy has quit IRC | 04:08 | |
| *** tonytan4ever has joined #openstack-infra | 04:09 | |
| *** armax has joined #openstack-infra | 04:09 | |
| *** armax has quit IRC | 04:09 | |
| *** cody-somerville has quit IRC | 04:10 | |
| *** rdx_matt has joined #openstack-infra | 04:11 | |
| *** rlandy has quit IRC | 04:12 | |
| *** rdx_matt has quit IRC | 04:16 | |
| *** ramishra has quit IRC | 04:16 | |
| *** akshai has joined #openstack-infra | 04:17 | |
| *** shashank_hegde has joined #openstack-infra | 04:19 | |
| *** baoli has quit IRC | 04:20 | |
| *** piet has joined #openstack-infra | 04:20 | |
| *** ramishra has joined #openstack-infra | 04:20 | |
| *** dronshaw has quit IRC | 04:21 | |
| *** maishsk_ has joined #openstack-infra | 04:21 | |
| *** EricGonczer_ has quit IRC | 04:22 | |
| *** maishsk has quit IRC | 04:22 | |
| *** maishsk_ is now known as maishsk | 04:22 | |
| *** sdake has joined #openstack-infra | 04:22 | |
| *** zeih has joined #openstack-infra | 04:25 | |
| *** julim has quit IRC | 04:26 | |
| *** yamamot__ has joined #openstack-infra | 04:29 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on oslo.context https://review.openstack.org/341285 | 04:29 |
| *** zeih has quit IRC | 04:30 | |
| *** javeriak has joined #openstack-infra | 04:31 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on oslo.log https://review.openstack.org/341288 | 04:33 |
| *** yamamot__ has quit IRC | 04:33 | |
| *** psachin has joined #openstack-infra | 04:34 | |
| *** maishsk has quit IRC | 04:34 | |
| *** fawadkhaliq has quit IRC | 04:37 | |
| *** yamamot__ has joined #openstack-infra | 04:37 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on oslo.reports https://review.openstack.org/341290 | 04:38 |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on oslo.serialization https://review.openstack.org/341292 | 04:40 |
| *** kien-ha has joined #openstack-infra | 04:41 | |
| *** yamamot__ has quit IRC | 04:42 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on oslotest https://review.openstack.org/341294 | 04:43 |
| *** IlyaG has joined #openstack-infra | 04:43 | |
| *** pt_15 has quit IRC | 04:46 | |
| *** shashank_hegde has quit IRC | 04:46 | |
| *** shashank_hegde has joined #openstack-infra | 04:47 | |
| *** piet has quit IRC | 04:47 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on oslo.versionedobjects https://review.openstack.org/341295 | 04:48 |
| *** Daisy has joined #openstack-infra | 04:48 | |
| *** IlyaG has quit IRC | 04:48 | |
| *** sdake has quit IRC | 04:50 | |
| *** mrmartin has joined #openstack-infra | 04:50 | |
| *** nadya has joined #openstack-infra | 04:51 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on stevedore https://review.openstack.org/341297 | 04:53 |
| *** amitgandhinz has joined #openstack-infra | 04:54 | |
| openstackgerrit | Renat Akhmerov proposed openstack-infra/project-config: Add new "mistral-lib" project https://review.openstack.org/340844 | 04:55 |
| *** shashank_hegde has quit IRC | 04:56 | |
| *** amitgandhinz has quit IRC | 04:58 | |
| kun_huang | when build an image from dib, where could I setup sshd_config? I need enable password authentication for some purpose | 04:59 |
| *** akshai has quit IRC | 05:01 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on oslo.log https://review.openstack.org/341288 | 05:04 |
| *** thorst has joined #openstack-infra | 05:04 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Enable py35 voting on oslo.messaging https://review.openstack.org/341272 | 05:08 |
| clarkb | kun_huang: I dont think our sshd config has support for that | 05:11 |
| clarkb | kun_huang: you could possibly use keys instead? | 05:11 |
| *** rdx_matt has joined #openstack-infra | 05:12 | |
| *** thorst has quit IRC | 05:13 | |
| *** asettle has joined #openstack-infra | 05:14 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update Gerrit Trigger to use convert xml https://review.openstack.org/332893 | 05:14 |
| *** elo has joined #openstack-infra | 05:15 | |
| kun_huang | clarkb: I'm building 1+N node (boot from same image), and copying the pub key of first node to other nodes (under root). | 05:17 |
| kun_huang | and I thought using password is much easier:) | 05:17 |
| *** rdx_matt has quit IRC | 05:17 | |
| mordred | kun_huang: you'll likely find it much harder to make password logins work if you're re-using any of our stuff :) | 05:18 |
| *** Srinu has joined #openstack-infra | 05:18 | |
| *** asettle has quit IRC | 05:18 | |
| Srinu | Hi | 05:19 |
| Srinu | when the nodepool image updated then it is not launching the nodepool vm and not booting properly | 05:19 |
| kun_huang | mordred: thx, thinking the key-pair way instead | 05:22 |
| *** javeriak has quit IRC | 05:23 | |
| mordred | kun_huang: are you booting bare metals or vms? | 05:23 |
| kun_huang | both, booting vm first | 05:23 |
| Srinu | mordred: hi | 05:24 |
| Srinu | mordred: when the nodepool image updated then it is launching the nodepool vm and not booting properly and it is getting stucked | 05:24 |
| mordred | Srinu: hey - not really sure, I've been travelling pretty constantly and not up to speed | 05:25 |
| *** amotoki has joined #openstack-infra | 05:26 | |
| *** zul has quit IRC | 05:27 | |
| *** hparekh has quit IRC | 05:29 | |
| clarkb | we dont have any image issues that would break booting as far as I know | 05:30 |
| *** savihou has joined #openstack-infra | 05:30 | |
| *** mrmartin has quit IRC | 05:31 | |
| *** fawadkhaliq has joined #openstack-infra | 05:32 | |
| *** fawadkhaliq has quit IRC | 05:32 | |
| *** yamamot__ has joined #openstack-infra | 05:32 | |
| *** fawadkhaliq has joined #openstack-infra | 05:32 | |
| *** Daisy has quit IRC | 05:33 | |
| *** fawadkhaliq has quit IRC | 05:33 | |
| *** fawadkhaliq has joined #openstack-infra | 05:33 | |
| *** fawadkhaliq has quit IRC | 05:36 | |
| *** fawadkhaliq has joined #openstack-infra | 05:36 | |
| *** sandanar_ has joined #openstack-infra | 05:40 | |
| *** sandanar has joined #openstack-infra | 05:40 | |
| *** zul has joined #openstack-infra | 05:42 | |
| *** isaacb has joined #openstack-infra | 05:42 | |
| *** hparekh has joined #openstack-infra | 05:43 | |
| *** jamielennox is now known as jamielennox|away | 05:43 | |
| *** IlyaG has joined #openstack-infra | 05:44 | |
| *** nadya has quit IRC | 05:45 | |
| *** sheeprine has quit IRC | 05:46 | |
| *** Nikolay_St has quit IRC | 05:46 | |
| *** pgadiya has joined #openstack-infra | 05:46 | |
| *** sheeprine has joined #openstack-infra | 05:49 | |
| *** IlyaG has quit IRC | 05:49 | |
| *** akshai has joined #openstack-infra | 05:50 | |
| *** amotoki has quit IRC | 05:51 | |
| *** akshai has quit IRC | 05:52 | |
| *** amotoki has joined #openstack-infra | 05:53 | |
| *** amitgandhinz has joined #openstack-infra | 05:54 | |
| *** rkukura has joined #openstack-infra | 05:55 | |
| *** jamielennox|away is now known as jamielennox | 05:56 | |
| *** shashank_hegde has joined #openstack-infra | 05:57 | |
| *** amotoki has quit IRC | 05:57 | |
| *** Goneri has joined #openstack-infra | 05:57 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Make py35 voting for reno https://review.openstack.org/341307 | 05:58 |
| *** amitgandhinz has quit IRC | 05:59 | |
| *** amotoki has joined #openstack-infra | 05:59 | |
| *** mrmartin has joined #openstack-infra | 05:59 | |
| *** sandanar__ has joined #openstack-infra | 06:00 | |
| *** sandanar_ has quit IRC | 06:01 | |
| *** sandanar has quit IRC | 06:01 | |
| *** sandanar_ has joined #openstack-infra | 06:02 | |
| *** sandanar__ has quit IRC | 06:02 | |
| *** sandanar has joined #openstack-infra | 06:02 | |
| openstackgerrit | Craige McWhirter proposed openstack-infra/infra-specs: Initial commit of the Pholio spec https://review.openstack.org/340641 | 06:02 |
| *** Goneri has quit IRC | 06:02 | |
| *** Goneri has joined #openstack-infra | 06:02 | |
| *** yolanda has quit IRC | 06:02 | |
| *** Ravikiran_K has joined #openstack-infra | 06:03 | |
| *** nadya has joined #openstack-infra | 06:04 | |
| *** sandanar_ has quit IRC | 06:07 | |
| *** sandanar has quit IRC | 06:07 | |
| *** rkukura has quit IRC | 06:07 | |
| *** sandanar has joined #openstack-infra | 06:07 | |
| *** sandanar_ has joined #openstack-infra | 06:07 | |
| *** rkukura has joined #openstack-infra | 06:07 | |
| *** Sukhdev has quit IRC | 06:07 | |
| *** makowals has quit IRC | 06:07 | |
| *** thorst has joined #openstack-infra | 06:10 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add puppet-ipsilon https://review.openstack.org/341192 | 06:10 |
| *** Daisy has joined #openstack-infra | 06:11 | |
| *** nadya has quit IRC | 06:12 | |
| *** javeriak has joined #openstack-infra | 06:13 | |
| *** rdx_matt has joined #openstack-infra | 06:13 | |
| *** rdx_matt has quit IRC | 06:14 | |
| *** rdx_matt has joined #openstack-infra | 06:14 | |
| openstackgerrit | Merged openstack-infra/project-config: Make pbr py35 jobs voting https://review.openstack.org/341254 | 06:14 |
| *** andymaier has joined #openstack-infra | 06:15 | |
| *** Daisy has quit IRC | 06:16 | |
| *** zeih has joined #openstack-infra | 06:17 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update Repo plugin to use convert_mapping_to_xml https://review.openstack.org/341311 | 06:18 |
| *** thorst has quit IRC | 06:18 | |
| *** rdx_matt has quit IRC | 06:20 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Temporarily pin puppet-ceph to stable/hammer https://review.openstack.org/340717 | 06:20 |
| *** rdx_matt has joined #openstack-infra | 06:21 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update Repo plugin to use convert_mapping_to_xml https://review.openstack.org/341311 | 06:22 |
| *** hrubi has quit IRC | 06:23 | |
| *** isaacb has quit IRC | 06:24 | |
| *** Thelo has joined #openstack-infra | 06:24 | |
| *** sarob has joined #openstack-infra | 06:24 | |
| *** hrubi has joined #openstack-infra | 06:24 | |
| *** ociuhandu has joined #openstack-infra | 06:27 | |
| *** kien-ha has quit IRC | 06:27 | |
| *** sarob has quit IRC | 06:28 | |
| *** Daisy has joined #openstack-infra | 06:30 | |
| *** andreas_s has joined #openstack-infra | 06:31 | |
| *** mrmartin has quit IRC | 06:31 | |
| *** baoli has joined #openstack-infra | 06:32 | |
| *** maishsk has joined #openstack-infra | 06:34 | |
| *** dimtruck is now known as zz_dimtruck | 06:35 | |
| *** elo has quit IRC | 06:35 | |
| *** Nikolay_St has joined #openstack-infra | 06:35 | |
| *** pcaruana has joined #openstack-infra | 06:35 | |
| *** elo has joined #openstack-infra | 06:35 | |
| *** baoli has quit IRC | 06:36 | |
| openstackgerrit | Merged openstack-infra/project-config: Add puppet-ipsilon https://review.openstack.org/341192 | 06:37 |
| *** rossella_s has quit IRC | 06:40 | |
| *** rossella_s has joined #openstack-infra | 06:41 | |
| *** makowals has joined #openstack-infra | 06:41 | |
| *** elo has quit IRC | 06:42 | |
| *** pgadiya has quit IRC | 06:43 | |
| *** pgadiya has joined #openstack-infra | 06:43 | |
| *** rwsu has quit IRC | 06:44 | |
| *** IlyaG has joined #openstack-infra | 06:45 | |
| *** rwsu has joined #openstack-infra | 06:45 | |
| *** DaiDV has joined #openstack-infra | 06:46 | |
| *** elo has joined #openstack-infra | 06:46 | |
| *** openstackgerrit has quit IRC | 06:48 | |
| *** amotoki has quit IRC | 06:48 | |
| *** openstackgerrit has joined #openstack-infra | 06:48 | |
| *** IlyaG has quit IRC | 06:49 | |
| *** sandanar_ has quit IRC | 06:51 | |
| *** sandanar_ has joined #openstack-infra | 06:51 | |
| *** rajinir has quit IRC | 06:55 | |
| *** amitgandhinz has joined #openstack-infra | 06:55 | |
| *** mrmartin has joined #openstack-infra | 06:55 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add Fedora 24 nodes https://review.openstack.org/340671 | 06:55 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add experimental Fedora 24 job https://review.openstack.org/340672 | 06:55 |
| *** sputnik13 has joined #openstack-infra | 06:56 | |
| *** zz_dimtruck is now known as dimtruck | 06:56 | |
| *** gongysh has joined #openstack-infra | 06:56 | |
| *** isaacb has joined #openstack-infra | 06:57 | |
| *** amitgandhinz has quit IRC | 06:59 | |
| *** sandanar has quit IRC | 07:00 | |
| openstackgerrit | Andreas Jaeger proposed openstack-dev/hacking: Fix releasenote building https://review.openstack.org/341319 | 07:00 |
| *** sandanar_ has quit IRC | 07:00 | |
| AJaeger | clarkb: this fixes hacking ^ - a generic problem | 07:01 |
| *** amotoki has joined #openstack-infra | 07:01 | |
| clarkb | AJaeger: ya several projwcts need that fix but I ran out of time to do it today | 07:02 |
| *** clenimar__ has joined #openstack-infra | 07:03 | |
| clarkb | did you see my paste with the list of fails? you can use that to track down which ones need it | 07:03 |
| AJaeger | clarkb: yes, I saw that paste and decided to fix it ;) Will fix all releasenote related fails on the paste. | 07:04 |
| *** dimtruck is now known as zz_dimtruck | 07:06 | |
| *** clenimar_ has quit IRC | 07:06 | |
| AJaeger | clarkb: virtualbmc has no releasenotes, remove that item from your list, and python-glanceclient has a fix by you - so no more changes from me for now... | 07:09 |
| clarkb | I should transition to etherpad so we can pull things off the list as they get fixed | 07:09 |
| *** tesseract- has joined #openstack-infra | 07:10 | |
| *** DaiDV has quit IRC | 07:11 | |
| *** jaosorior has joined #openstack-infra | 07:11 | |
| AJaeger | clarkb: yeah ;) | 07:11 |
| * AJaeger missed some entries, double checking your paste now | 07:11 | |
| *** rcernin has joined #openstack-infra | 07:13 | |
| *** sputnik13 has quit IRC | 07:14 | |
| strigazi | Hi clarkb, can you have a look at https://review.openstack.org/#/c/340965/ ? | 07:15 |
| *** thorst has joined #openstack-infra | 07:15 | |
| *** jed56 has joined #openstack-infra | 07:16 | |
| *** daemontool has joined #openstack-infra | 07:17 | |
| *** sputnik13 has joined #openstack-infra | 07:17 | |
| *** oanson has quit IRC | 07:18 | |
| *** oanson has joined #openstack-infra | 07:19 | |
| *** markvoelker has quit IRC | 07:19 | |
| *** vincentll has joined #openstack-infra | 07:20 | |
| *** shardy has joined #openstack-infra | 07:20 | |
| *** markvoelker has joined #openstack-infra | 07:21 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Temporarily pin puppet-ceph to stable/hammer https://review.openstack.org/340717 | 07:21 |
| *** thorst has quit IRC | 07:21 | |
| *** mikelk has joined #openstack-infra | 07:24 | |
| *** sputnik13 has quit IRC | 07:25 | |
| *** david-lyle has quit IRC | 07:27 | |
| openstackgerrit | Renat Akhmerov proposed openstack-infra/project-config: Add new "mistral-lib" project https://review.openstack.org/340844 | 07:28 |
| *** sandanar has joined #openstack-infra | 07:28 | |
| *** jlanoux has joined #openstack-infra | 07:28 | |
| *** arxcruz has joined #openstack-infra | 07:29 | |
| *** sputnik13 has joined #openstack-infra | 07:30 | |
| *** daemontool_ has joined #openstack-infra | 07:31 | |
| *** winggundamth has joined #openstack-infra | 07:32 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Make ovb testenv more user friendly https://review.openstack.org/337637 | 07:32 |
| *** david-lyle has joined #openstack-infra | 07:32 | |
| *** fawadkhaliq has quit IRC | 07:33 | |
| *** daemontool has quit IRC | 07:34 | |
| *** nmagnezi has joined #openstack-infra | 07:34 | |
| *** csomerville has quit IRC | 07:37 | |
| *** markvoelker has quit IRC | 07:39 | |
| *** Na3iL has joined #openstack-infra | 07:40 | |
| *** amotoki has quit IRC | 07:40 | |
| *** hashar has joined #openstack-infra | 07:42 | |
| *** ifarkas has joined #openstack-infra | 07:44 | |
| *** IlyaG has joined #openstack-infra | 07:46 | |
| *** dizquierdo has joined #openstack-infra | 07:46 | |
| *** tonytan4ever has quit IRC | 07:47 | |
| *** tonytan4ever has joined #openstack-infra | 07:47 | |
| *** asettle has joined #openstack-infra | 07:47 | |
| *** kzaitsev_mb has quit IRC | 07:48 | |
| *** amotoki has joined #openstack-infra | 07:50 | |
| *** tonytan_brb has joined #openstack-infra | 07:51 | |
| *** IlyaG has quit IRC | 07:51 | |
| *** asettle has quit IRC | 07:52 | |
| *** tonytan4ever has quit IRC | 07:54 | |
| *** amitgandhinz has joined #openstack-infra | 07:56 | |
| *** yamahata has quit IRC | 07:56 | |
| *** zeih has quit IRC | 07:56 | |
| *** zeih has joined #openstack-infra | 07:57 | |
| *** david-lyle has quit IRC | 07:58 | |
| *** dizquierdo has quit IRC | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** pcaruana has quit IRC | 08:00 | |
| *** amitgandhinz has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:01 | |
| *** dtardivel has joined #openstack-infra | 08:01 | |
| *** d0ugal has joined #openstack-infra | 08:01 | |
| *** tosky has joined #openstack-infra | 08:06 | |
| *** elo has quit IRC | 08:09 | |
| *** jpich has joined #openstack-infra | 08:10 | |
| *** asettle has joined #openstack-infra | 08:12 | |
| *** pcaruana has joined #openstack-infra | 08:14 | |
| *** jlanoux has quit IRC | 08:14 | |
| *** jlanoux has joined #openstack-infra | 08:15 | |
| *** swat30 has quit IRC | 08:15 | |
| *** nadya has joined #openstack-infra | 08:16 | |
| *** nadya has quit IRC | 08:16 | |
| *** nadya has joined #openstack-infra | 08:17 | |
| *** eezhova has joined #openstack-infra | 08:18 | |
| *** shashank_hegde has quit IRC | 08:18 | |
| *** thorst has joined #openstack-infra | 08:20 | |
| *** markvoelker has joined #openstack-infra | 08:20 | |
| *** jtomasek__ has joined #openstack-infra | 08:22 | |
| odyssey4me | AJaeger I'd appreciate another review for https://review.openstack.org/339770 if you have a moment. | 08:22 |
| *** hurgleburgler has joined #openstack-infra | 08:23 | |
| *** jordanP has joined #openstack-infra | 08:23 | |
| *** markvoelker has quit IRC | 08:25 | |
| *** zeih has quit IRC | 08:25 | |
| *** thorst has quit IRC | 08:27 | |
| *** hurgleburgler has quit IRC | 08:28 | |
| *** javeriak has quit IRC | 08:29 | |
| AJaeger | odyssey4me: those names are very long and might hit the 128 chars limit - I've +2A since it's experimental and let you figure it out ;) | 08:30 |
| *** zeih has joined #openstack-infra | 08:30 | |
| *** zeih_ has joined #openstack-infra | 08:32 | |
| *** derekh has joined #openstack-infra | 08:33 | |
| *** zeih has quit IRC | 08:33 | |
| openstackgerrit | Eli Qiao proposed openstack-infra/project-config: Zun: rename higgins to zun (2) https://review.openstack.org/329247 | 08:34 |
| *** Daisy_ has joined #openstack-infra | 08:36 | |
| *** _degorenko|afk is now known as degorenko | 08:36 | |
| *** dingyichen has quit IRC | 08:37 | |
| *** amotoki has quit IRC | 08:38 | |
| *** sorantis has joined #openstack-infra | 08:39 | |
| sirushti | AJaeger, Hi, Re: comment in https://review.openstack.org/#/c/339778/ , should the other patch mentioned be abandoned? It could just be WIP until we get this experimental job passing. | 08:39 |
| *** Daisy has quit IRC | 08:39 | |
| openstackgerrit | Merged openstack-infra/project-config: Implement optional scenario setting for Ansible jobs https://review.openstack.org/339770 | 08:40 |
| *** sshnaidm is now known as sshnaidm|afk | 08:43 | |
| *** Ravikiran_K has quit IRC | 08:46 | |
| *** IlyaG has joined #openstack-infra | 08:46 | |
| *** Ravikiran_K has joined #openstack-infra | 08:47 | |
| bauzas | clarkb: DinaBelova: anteaya: cool with me, Blazar is more or less in a defunct state, but I know the Scientific WG looks forwards to resurrect it, so I appreciate the idea to open a bug report either way | 08:48 |
| *** chlong has joined #openstack-infra | 08:48 | |
| *** chem has joined #openstack-infra | 08:49 | |
| *** IlyaG has quit IRC | 08:51 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Temporarily pin puppet-ceph to stable/hammer https://review.openstack.org/340717 | 08:52 |
| odyssey4me | thanks AJaeger - we are close to the limit, yes, but not quite there yet :) | 08:52 |
| *** binbincong has quit IRC | 08:52 | |
| *** dtantsur|afk is now known as dtantsur | 08:53 | |
| *** swat30 has joined #openstack-infra | 08:53 | |
| *** amitgandhinz has joined #openstack-infra | 08:56 | |
| *** zz_dimtruck is now known as dimtruck | 08:56 | |
| strigazi | AJaeger: Do you have a monent? | 08:59 |
| strigazi | For a feature in magnum we need a docker image. I suggested | 09:00 |
| strigazi | to have a team account in docker-hub. The team has concerns | 09:00 |
| strigazi | about the delay on the gate due to downloading time. They | 09:00 |
| strigazi | proposed to build docker images, export them as tarballs | 09:01 |
| strigazi | and host them on tarballs.openstack.org. What do you think? | 09:01 |
| *** amitgandhinz has quit IRC | 09:01 | |
| *** gongysh has quit IRC | 09:03 | |
| *** andymaier has quit IRC | 09:03 | |
| *** dimtruck is now known as zz_dimtruck | 09:06 | |
| openstackgerrit | Liam Young proposed openstack-infra/project-config: Add designate charms https://review.openstack.org/341372 | 09:08 |
| *** javeriak has joined #openstack-infra | 09:12 | |
| *** dizquierdo has joined #openstack-infra | 09:12 | |
| *** tonytan_brb has quit IRC | 09:13 | |
| *** Daisy_ has quit IRC | 09:13 | |
| *** markvoelker has joined #openstack-infra | 09:15 | |
| openstackgerrit | James Page proposed openstack-infra/project-config: Enable publishing for Charm documentation https://review.openstack.org/341378 | 09:15 |
| *** Daisy has joined #openstack-infra | 09:15 | |
| *** Daisy has quit IRC | 09:16 | |
| *** pcaruana has quit IRC | 09:18 | |
| AJaeger | strigazi: can't help with that now - better dsicuss with rest of team later today... | 09:19 |
| *** john-davidge has joined #openstack-infra | 09:19 | |
| *** asettle has quit IRC | 09:19 | |
| mugsie | looking for a final +2/+W on https://review.openstack.org/#/c/339580/ and https://review.openstack.org/#/c/340878/ , if anyone can spare some time? | 09:20 |
| *** markvoelker has quit IRC | 09:20 | |
| openstackgerrit | Liam Young proposed openstack-infra/project-config: Add designate charms https://review.openstack.org/341372 | 09:20 |
| *** john-dav_ has joined #openstack-infra | 09:20 | |
| *** andymaier has joined #openstack-infra | 09:21 | |
| *** binbincong has joined #openstack-infra | 09:22 | |
| *** Goneri has quit IRC | 09:22 | |
| *** john-dav_ is now known as john-davidge_ | 09:22 | |
| openstackgerrit | James Page proposed openstack-infra/project-config: Enable publishing for Charm documentation https://review.openstack.org/341378 | 09:24 |
| *** e0ne has joined #openstack-infra | 09:24 | |
| *** john-davidge has quit IRC | 09:24 | |
| *** thorst has joined #openstack-infra | 09:25 | |
| *** zz_dimtruck is now known as dimtruck | 09:26 | |
| openstackgerrit | Marton Kiss proposed openstack-infra/groups: Allow per group timezone setting https://review.openstack.org/341385 | 09:27 |
| *** Daisy has joined #openstack-infra | 09:30 | |
| *** amotoki has joined #openstack-infra | 09:30 | |
| *** ggnel_t has quit IRC | 09:31 | |
| *** pcaruana has joined #openstack-infra | 09:31 | |
| *** esker has joined #openstack-infra | 09:31 | |
| *** ggnel_t has joined #openstack-infra | 09:31 | |
| *** thorst has quit IRC | 09:32 | |
| *** Julien-zte has quit IRC | 09:32 | |
| *** makowals has quit IRC | 09:34 | |
| *** yonglihe has quit IRC | 09:34 | |
| *** amotoki has quit IRC | 09:34 | |
| *** dimtruck is now known as zz_dimtruck | 09:35 | |
| *** Daisy has quit IRC | 09:36 | |
| *** Goneri has joined #openstack-infra | 09:36 | |
| *** Daisy has joined #openstack-infra | 09:36 | |
| *** makowals has joined #openstack-infra | 09:38 | |
| *** makowals has quit IRC | 09:39 | |
| *** Daisy has quit IRC | 09:41 | |
| *** pt_15 has joined #openstack-infra | 09:42 | |
| *** Na3iL has quit IRC | 09:44 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:45 | |
| *** IlyaG has joined #openstack-infra | 09:47 | |
| *** Daisy has joined #openstack-infra | 09:47 | |
| *** pcaruana has quit IRC | 09:48 | |
| *** pcaruana has joined #openstack-infra | 09:48 | |
| *** akscram has quit IRC | 09:49 | |
| *** jaosorior has quit IRC | 09:49 | |
| *** pcaruana has quit IRC | 09:50 | |
| *** akscram has joined #openstack-infra | 09:50 | |
| *** jaosorior has joined #openstack-infra | 09:50 | |
| *** pcaruana has joined #openstack-infra | 09:50 | |
| *** Guest16471 has quit IRC | 09:50 | |
| *** berendt has joined #openstack-infra | 09:50 | |
| *** sree_ has joined #openstack-infra | 09:51 | |
| *** kzaitsev_mb has quit IRC | 09:51 | |
| *** sree_ is now known as Guest90083 | 09:51 | |
| *** pcaruana has quit IRC | 09:51 | |
| *** Daisy has quit IRC | 09:52 | |
| *** IlyaG has quit IRC | 09:52 | |
| *** e0ne has quit IRC | 09:53 | |
| *** andymaier has quit IRC | 09:55 | |
| *** Guest90083 has quit IRC | 09:56 | |
| *** esker has quit IRC | 09:56 | |
| *** pcaruana has joined #openstack-infra | 09:57 | |
| *** amitgandhinz has joined #openstack-infra | 09:57 | |
| *** esker has joined #openstack-infra | 09:57 | |
| *** e0ne has joined #openstack-infra | 10:01 | |
| *** amitgandhinz has quit IRC | 10:01 | |
| mordred | strigazi: hi! so ... I have a todo list item to write up a design for dealing with docker images in the gate | 10:04 |
| mordred | strigazi: we actually have some thoughts on how we can have a local docker hub that we can publish into and download from in jobs | 10:04 |
| mordred | but they need to be written down | 10:04 |
| strigazi | mordred: this would be amazing | 10:05 |
| *** xarses_ has joined #openstack-infra | 10:05 | |
| *** eezhova has quit IRC | 10:05 | |
| *** esker has quit IRC | 10:06 | |
| *** zhurong has quit IRC | 10:06 | |
| strigazi | also docker.openstack.org would be really cool | 10:07 |
| rcarrillocruz | mugsie: +A | 10:08 |
| *** xarses has quit IRC | 10:08 | |
| strigazi | mordred: If you need any input or help add me to the discussion | 10:09 |
| *** markvoelker has joined #openstack-infra | 10:09 | |
| *** asettle has joined #openstack-infra | 10:09 | |
| *** swat30 has quit IRC | 10:11 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:12 | |
| *** swat30 has joined #openstack-infra | 10:12 | |
| *** markvoelker has quit IRC | 10:13 | |
| *** tonytan4ever has joined #openstack-infra | 10:14 | |
| *** nmagnezi has quit IRC | 10:14 | |
| mordred | strigazi: will do! | 10:14 |
| *** Srinu has quit IRC | 10:14 | |
| *** daemontool_ has quit IRC | 10:16 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix designate-identity-v3-only tempest job https://review.openstack.org/340878 | 10:17 |
| *** esikachev has joined #openstack-infra | 10:19 | |
| *** tonytan4ever has quit IRC | 10:19 | |
| *** daemontool_ has joined #openstack-infra | 10:21 | |
| *** yamamot__ has quit IRC | 10:21 | |
| mugsie | rcarrillocruz: thanks! | 10:22 |
| *** yanyanhu has quit IRC | 10:22 | |
| rcarrillocruz | np | 10:22 |
| *** rdx_matt has quit IRC | 10:23 | |
| *** rdx_matt has joined #openstack-infra | 10:23 | |
| openstackgerrit | Merged openstack-infra/project-config: Add experimental grenade job for designate https://review.openstack.org/339580 | 10:23 |
| *** nadya has quit IRC | 10:24 | |
| *** e0ne has quit IRC | 10:24 | |
| openstackgerrit | Liam Young proposed openstack-infra/project-config: Add designate charms https://review.openstack.org/341372 | 10:25 |
| *** jed56 has quit IRC | 10:25 | |
| *** e0ne has joined #openstack-infra | 10:25 | |
| *** nmagnezi has joined #openstack-infra | 10:25 | |
| jamespage | please could I request a review of https://review.openstack.org/#/c/339485/ ? | 10:27 |
| *** nadya has joined #openstack-infra | 10:27 | |
| jamespage | thanks! | 10:27 |
| *** claudiub has joined #openstack-infra | 10:27 | |
| openstackgerrit | Jonathan Perret proposed openstack/python-jenkins: Do not force DeprecationWarning to be displayed https://review.openstack.org/341409 | 10:27 |
| *** arnewiebalck has joined #openstack-infra | 10:29 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a subscribe button to worklists https://review.openstack.org/324550 | 10:32 |
| *** savihou has quit IRC | 10:32 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Complex priorities UI in stories https://review.openstack.org/312666 | 10:32 |
| arnewiebalck | Hi, I’m failing to log into wiki.openstack.org: “The wiki.openstack.org page isn’t working”. Is new account creation still disabled? | 10:33 |
| *** savihou has joined #openstack-infra | 10:33 | |
| *** savihou has quit IRC | 10:36 | |
| *** savihou has joined #openstack-infra | 10:36 | |
| *** zeih_ has quit IRC | 10:36 | |
| *** maishsk has quit IRC | 10:37 | |
| *** saggi1 has joined #openstack-infra | 10:40 | |
| *** eezhova has joined #openstack-infra | 10:40 | |
| *** rossella_s has quit IRC | 10:40 | |
| *** esker has joined #openstack-infra | 10:41 | |
| *** rossella_s has joined #openstack-infra | 10:41 | |
| *** e0ne has quit IRC | 10:41 | |
| *** thorst has joined #openstack-infra | 10:41 | |
| AJaeger | jamespage: do you want charm-aodh to be part of Big Tent? | 10:42 |
| jamespage | AJaeger, yes, and there are a few other new charms as well (see gnuoy's designate charm reviews) | 10:42 |
| jamespage | AJaeger, I'll need to add them to the goverance projects.yaml right? | 10:42 |
| AJaeger | jamespage: then follow http://docs.openstack.org/infra/manual/creators.html#add-new-repository-to-the-governance-repository and create a new governance patch and link these - using needed-by/depends-on. | 10:43 |
| AJaeger | jamespage: You're the PTL, aren't you? Then I don't need to wait for PTL approval and can +2 directly ;) | 10:43 |
| jamespage | AJaeger, gotcha | 10:43 |
| jamespage | AJaeger, I am the PTL yes | 10:44 |
| AJaeger | jamespage: adding additional repos to governance is for the PTL a mere formality (house-keeping), no TC voting needed. Therefore now: First project-config patch merges, then governance for house-keeping - I just like to see everything up for review. | 10:44 |
| *** jaosorior is now known as jaosorior_brb | 10:45 | |
| jamespage | AJaeger, doing the governance change now | 10:45 |
| AJaeger | and then amend the project-config and add the NeededBy line - and then I'll review later today... | 10:45 |
| *** esker has quit IRC | 10:45 | |
| *** thorst has quit IRC | 10:46 | |
| AJaeger | sirushti: mark the other one as WIP, no need to abandon if this is just for a week or two... | 10:46 |
| jamespage | AJaeger, ok thanks for explaining how to link the two reviews together and hook everything up :-) | 10:46 |
| jamespage | gnuoy, ^^ you'll need todo the same with the designate charms | 10:46 |
| gnuoy | ack | 10:47 |
| *** thorst_ has joined #openstack-infra | 10:48 | |
| *** IlyaG has joined #openstack-infra | 10:48 | |
| openstackgerrit | James Page proposed openstack-infra/project-config: Add charm-aodh https://review.openstack.org/339485 | 10:50 |
| AJaeger | jamespage: on gnuoy's review for project-config, I need your +1 as PTL - as sign that charm project adopts it | 10:50 |
| jamespage | AJaeger, I guessed as much | 10:50 |
| jamespage | will do | 10:50 |
| AJaeger | jamespage: your aodh changes LGTM, thanks. | 10:51 |
| jamespage | ta | 10:52 |
| * AJaeger will be back later | 10:53 | |
| *** IlyaG has quit IRC | 10:53 | |
| *** zeih has joined #openstack-infra | 10:55 | |
| *** ccamacho is now known as ccamacho|lunch | 10:56 | |
| *** amitgandhinz has joined #openstack-infra | 10:58 | |
| *** kzaitsev_mb has quit IRC | 10:59 | |
| *** baoli has joined #openstack-infra | 10:59 | |
| *** rdx_matt_ has joined #openstack-infra | 11:00 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Fail fast if a testenv couldn't be created https://review.openstack.org/341428 | 11:01 |
| *** amitgandhinz has quit IRC | 11:03 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Use delorean-current for puppet modules https://review.openstack.org/341429 | 11:03 |
| *** markvoelker has joined #openstack-infra | 11:03 | |
| *** sambetts|afk is now known as sambetts|catinbo | 11:03 | |
| *** nadya has quit IRC | 11:03 | |
| *** sambetts|catinbo is now known as sambetts|cat | 11:03 | |
| *** rdx_matt has quit IRC | 11:04 | |
| *** maishsk has joined #openstack-infra | 11:04 | |
| openstackgerrit | Liam Young proposed openstack-infra/project-config: Add designate charms https://review.openstack.org/341372 | 11:05 |
| *** Na3iL has joined #openstack-infra | 11:06 | |
| *** baoli has quit IRC | 11:06 | |
| *** markvoelker has quit IRC | 11:07 | |
| *** zeih has quit IRC | 11:11 | |
| *** tosky has quit IRC | 11:11 | |
| *** lucasagomes is now known as lucas-hungry | 11:13 | |
| *** hashar has quit IRC | 11:16 | |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Fixed target path https://review.openstack.org/341436 | 11:19 |
| *** sree__ has joined #openstack-infra | 11:20 | |
| *** sree__ has quit IRC | 11:21 | |
| *** sree__ has joined #openstack-infra | 11:21 | |
| *** andymaier has joined #openstack-infra | 11:24 | |
| *** zz_dimtruck is now known as dimtruck | 11:26 | |
| *** hashar has joined #openstack-infra | 11:29 | |
| *** igorn has joined #openstack-infra | 11:30 | |
| *** weshay has joined #openstack-infra | 11:30 | |
| *** gordc has joined #openstack-infra | 11:31 | |
| *** flepied has quit IRC | 11:32 | |
| *** sorantis has quit IRC | 11:32 | |
| *** rossella_s has quit IRC | 11:33 | |
| *** flepied has joined #openstack-infra | 11:33 | |
| openstackgerrit | Nikita Zubkov proposed openstack-infra/project-config: Create fuel-nailgun-extension-cluster-upgrade project https://review.openstack.org/341443 | 11:36 |
| *** sorantis has joined #openstack-infra | 11:36 | |
| *** dimtruck is now known as zz_dimtruck | 11:36 | |
| *** ldnunes has joined #openstack-infra | 11:38 | |
| *** flepied has quit IRC | 11:40 | |
| *** Ravikiran_K has quit IRC | 11:46 | |
| *** nadya has joined #openstack-infra | 11:46 | |
| *** markusry has joined #openstack-infra | 11:47 | |
| *** john-davidge_ has quit IRC | 11:48 | |
| *** Daisy has joined #openstack-infra | 11:48 | |
| *** sdake has joined #openstack-infra | 11:48 | |
| *** john-davidge has joined #openstack-infra | 11:48 | |
| *** IlyaG has joined #openstack-infra | 11:49 | |
| *** yamamoto has joined #openstack-infra | 11:49 | |
| *** sree__ has quit IRC | 11:49 | |
| *** sdake_ has joined #openstack-infra | 11:50 | |
| *** tpsilva has joined #openstack-infra | 11:50 | |
| *** e0ne has joined #openstack-infra | 11:51 | |
| *** Daisy has quit IRC | 11:52 | |
| openstackgerrit | Merged openstack-infra/project-config: Add new project Fuel CCP Heat https://review.openstack.org/338938 | 11:53 |
| *** IlyaG has quit IRC | 11:53 | |
| *** sdake has quit IRC | 11:54 | |
| strigazi | Can someone approve https://review.openstack.org/#/c/340965/ ? | 11:56 |
| rcarrillocruz | mordred: heya, got hold of jlk last night by any chance? | 11:56 |
| openstackgerrit | Weiwei Gu proposed openstack-infra/tripleo-ci: Remove white space between print and () https://review.openstack.org/341482 | 11:57 |
| *** rfolco has joined #openstack-infra | 11:58 | |
| *** kzaitsev_mb has joined #openstack-infra | 11:59 | |
| *** ccamacho|lunch is now known as ccamacho | 11:59 | |
| *** savihou has quit IRC | 11:59 | |
| *** tonytan4ever has joined #openstack-infra | 12:00 | |
| *** savihou has joined #openstack-infra | 12:00 | |
| *** [1]Thelo has joined #openstack-infra | 12:00 | |
| *** flepied has joined #openstack-infra | 12:01 | |
| amrith | clarkb, yt? | 12:02 |
| *** Thelo has quit IRC | 12:02 | |
| *** [1]Thelo is now known as Thelo | 12:02 | |
| amrith | assume not; will send you email. | 12:02 |
| *** tonytan4ever has quit IRC | 12:05 | |
| *** rdx_matt_ has quit IRC | 12:05 | |
| *** rdx_matt has joined #openstack-infra | 12:05 | |
| *** zeih has joined #openstack-infra | 12:06 | |
| *** rfolco has quit IRC | 12:06 | |
| *** jaosorior_brb is now known as jaosorior | 12:06 | |
| *** rfolco has joined #openstack-infra | 12:07 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a subscribe button to worklists https://review.openstack.org/324550 | 12:07 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Complex priorities UI in stories https://review.openstack.org/312666 | 12:07 |
| *** gouthamr has joined #openstack-infra | 12:10 | |
| *** gouthamr has quit IRC | 12:10 | |
| *** maishsk has quit IRC | 12:10 | |
| *** zeih has quit IRC | 12:11 | |
| *** pradk has joined #openstack-infra | 12:11 | |
| *** sshnaidm|afk is now known as sshnaidm | 12:12 | |
| *** lucas-hungry is now known as lucasagomes | 12:13 | |
| *** maishsk has joined #openstack-infra | 12:17 | |
| *** esker has joined #openstack-infra | 12:17 | |
| *** _oanson has joined #openstack-infra | 12:17 | |
| *** tosky has joined #openstack-infra | 12:19 | |
| *** kgiusti has joined #openstack-infra | 12:19 | |
| *** saggi1 has quit IRC | 12:20 | |
| *** esker has quit IRC | 12:22 | |
| *** EricGonczer_ has joined #openstack-infra | 12:24 | |
| *** hashar has quit IRC | 12:24 | |
| *** pushkaraj has joined #openstack-infra | 12:25 | |
| *** hashar has joined #openstack-infra | 12:25 | |
| *** pushkaraj has quit IRC | 12:25 | |
| *** pt_15 has quit IRC | 12:26 | |
| *** pstack has joined #openstack-infra | 12:28 | |
| *** cbader has joined #openstack-infra | 12:29 | |
| *** notnownikki has joined #openstack-infra | 12:29 | |
| *** jed56 has joined #openstack-infra | 12:30 | |
| *** eezhova has quit IRC | 12:30 | |
| *** pt_15 has joined #openstack-infra | 12:32 | |
| *** clenimar__ has quit IRC | 12:32 | |
| *** pradk has quit IRC | 12:32 | |
| *** nadya has quit IRC | 12:34 | |
| openstackgerrit | Merged openstack-infra/storyboard: Add example commands for the Tags api https://review.openstack.org/338532 | 12:35 |
| *** markvoelker has joined #openstack-infra | 12:38 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Actually delete the ovb environment heat stack https://review.openstack.org/341495 | 12:39 |
| *** ociuhandu has quit IRC | 12:41 | |
| *** eezhova has joined #openstack-infra | 12:41 | |
| *** Na3iL has quit IRC | 12:41 | |
| *** gouthamr has joined #openstack-infra | 12:43 | |
| *** zhurong has joined #openstack-infra | 12:43 | |
| *** mrmartin has quit IRC | 12:46 | |
| *** sdake_ has quit IRC | 12:47 | |
| *** zeih has joined #openstack-infra | 12:48 | |
| *** daemontool_ has quit IRC | 12:49 | |
| *** sdake has joined #openstack-infra | 12:49 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Actually delete the ovb environment heat stack https://review.openstack.org/341495 | 12:49 |
| *** IlyaG has joined #openstack-infra | 12:50 | |
| *** ddieterly has joined #openstack-infra | 12:50 | |
| *** daemontool_ has joined #openstack-infra | 12:50 | |
| *** itisha has joined #openstack-infra | 12:51 | |
| *** eharney has quit IRC | 12:51 | |
| *** mrmartin has joined #openstack-infra | 12:52 | |
| *** kashyap has joined #openstack-infra | 12:52 | |
| *** jistr is now known as jistr|cowork | 12:53 | |
| *** Na3iL has joined #openstack-infra | 12:54 | |
| kashyap | Is this a known Zuul error? (I see this in the mutli-node Neutron jobs): | 12:54 |
| kashyap | 2016-07-13 11:50:31.933530 | [Zuul] standard output/error still open after child exited2016-07-13 11:50:31.933654 | [Zuul] Task exit code: 124 | 12:54 |
| kashyap | http://logs.openstack.org/16/341416/1/check/gate-grenade-dsvm-neutron-multinode/b5f943e/console.html#_2016-07-13_11_50_31_933530 | 12:54 |
| *** IlyaG has quit IRC | 12:55 | |
| *** savihou has quit IRC | 12:55 | |
| *** rlandy has joined #openstack-infra | 12:55 | |
| *** savihou has joined #openstack-infra | 12:56 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Fix projects entering pipeline without jobs https://review.openstack.org/334378 | 12:56 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Projects without jobs still enter pipeline https://review.openstack.org/302800 | 12:56 |
| *** bhavik has joined #openstack-infra | 12:57 | |
| *** rossella_s has joined #openstack-infra | 12:57 | |
| *** xyang1 has joined #openstack-infra | 12:58 | |
| *** sree__ has joined #openstack-infra | 12:58 | |
| *** woodster_ has joined #openstack-infra | 12:58 | |
| *** amitgandhinz has joined #openstack-infra | 12:59 | |
| *** EricGonczer_ has quit IRC | 13:02 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add check-requirements job to all openstack-ansible repo's https://review.openstack.org/341508 | 13:02 |
| *** test has joined #openstack-infra | 13:02 | |
| *** test has quit IRC | 13:02 | |
| *** zz_dimtruck is now known as dimtruck | 13:02 | |
| *** _oanson has quit IRC | 13:04 | |
| *** amitgandhinz has quit IRC | 13:05 | |
| *** pstack_ has joined #openstack-infra | 13:05 | |
| *** esker has joined #openstack-infra | 13:05 | |
| *** mdrabe has joined #openstack-infra | 13:06 | |
| *** pstack_ has quit IRC | 13:07 | |
| *** isaacb has quit IRC | 13:08 | |
| *** nadya has joined #openstack-infra | 13:09 | |
| *** treaki__ has quit IRC | 13:09 | |
| *** zhurong has quit IRC | 13:10 | |
| *** garyk has joined #openstack-infra | 13:10 | |
| *** isaacb has joined #openstack-infra | 13:10 | |
| *** links has quit IRC | 13:11 | |
| *** zhurong has joined #openstack-infra | 13:11 | |
| *** treaki__ has joined #openstack-infra | 13:12 | |
| *** baoli has joined #openstack-infra | 13:14 | |
| *** EricGonczer_ has joined #openstack-infra | 13:15 | |
| *** sdake has quit IRC | 13:16 | |
| *** treaki__ has quit IRC | 13:16 | |
| *** treaki__ has joined #openstack-infra | 13:16 | |
| *** esker has quit IRC | 13:17 | |
| *** esker has joined #openstack-infra | 13:17 | |
| *** ddieterly has quit IRC | 13:18 | |
| *** baoli_ has joined #openstack-infra | 13:19 | |
| *** yaume has joined #openstack-infra | 13:19 | |
| *** chlong has quit IRC | 13:20 | |
| *** pgadiya has quit IRC | 13:20 | |
| *** treaki__ has quit IRC | 13:20 | |
| *** treaki__ has joined #openstack-infra | 13:21 | |
| *** esker has quit IRC | 13:22 | |
| *** baoli has quit IRC | 13:22 | |
| *** piet has joined #openstack-infra | 13:24 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Update to use quintupleo https://review.openstack.org/336309 | 13:24 |
| fungi | kashyap: i think that may be expected on devstack-based jobs because there are child processes who don't properly disassociate and don't close file descriptors | 13:24 |
| *** treaki__ has quit IRC | 13:24 | |
| *** treaki__ has joined #openstack-infra | 13:25 | |
| fungi | kashyap: at least expected after the zuul 2.5 transition a month or so ago | 13:25 |
| *** bhavik has quit IRC | 13:25 | |
| *** julim has joined #openstack-infra | 13:26 | |
| *** esker has joined #openstack-infra | 13:26 | |
| kashyap | fungi: I see. Is there a bug that is using to track this? | 13:26 |
| fungi | kashyap: you might check a couple of logs from passing jobs and see if those also have that line | 13:26 |
| fungi | kashyap: i don't think there's a bug. if it's the issue i think it is, this has been endemic to devstack for many years | 13:27 |
| kashyap | fungi: Good point, I'll do once I file an RFE (following the recent discussion from the mailing list) in StoryBoard for Zuul (a separate) | 13:27 |
| kashyap | Aah | 13:27 |
| fungi | kashyap: are you grasping at straws trying to figure out why that job failed? | 13:27 |
| kashyap | fungi: No, not really that critical | 13:28 |
| fungi | the exit code 124 is carried through from grenade failing | 13:28 |
| kashyap | It can wait. Just thought I'd check here to educate myself | 13:28 |
| fungi | "ERROR: the main setup script run by this job failed - exit code: 124" | 13:28 |
| *** esker has quit IRC | 13:28 | |
| *** Jeffrey4l has joined #openstack-infra | 13:28 | |
| *** esker has joined #openstack-infra | 13:28 | |
| kashyap | Yeah, saw that much | 13:29 |
| *** treaki__ has quit IRC | 13:29 | |
| fungi | kashyap: but yeah, any time i've tried to execute devstack over an ssh session, ssh doesn't want to disconnect because of open file descriptors | 13:29 |
| kashyap | I see. | 13:29 |
| fungi | been a while since i've tried, but it was that way for years | 13:30 |
| kashyap | fungi: I mean, can you tell me how exactly you trigger that? | 13:30 |
| *** tonytan4ever has joined #openstack-infra | 13:30 | |
| fungi | kashyap: i recall seeing it consistently when doing http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/README.rst#n95 | 13:31 |
| * kashyap clicks | 13:31 | |
| *** julim has quit IRC | 13:32 | |
| *** EricGonc_ has joined #openstack-infra | 13:32 | |
| kashyap | Thanks, if I can manage to consistently reproduce it (as it requires some time to setup), probably will file a DevStack issue. | 13:33 |
| *** esker has quit IRC | 13:33 | |
| *** julim has joined #openstack-infra | 13:33 | |
| *** eharney has joined #openstack-infra | 13:33 | |
| fungi | kashyap: i don't recall whether i saw it on interactive ssh sessions or only scripted ssh sessions with no parent tty | 13:33 |
| *** esberglu has joined #openstack-infra | 13:34 | |
| *** julim has quit IRC | 13:34 | |
| kashyap | Yep, noted. | 13:34 |
| fungi | and teh actual symptom is just that when the running process terminates (or you log out of the shell) your ssh socket hangs and you have to manually disconnect it (~. or kill from another terminal or whatever) | 13:34 |
| *** julim has joined #openstack-infra | 13:34 | |
| *** tonytan4ever has quit IRC | 13:34 | |
| *** esker has joined #openstack-infra | 13:34 | |
| fungi | the error message you're seeing at the end of the log is, i think, bubbling up from ansible's error handling around that condition | 13:35 |
| fungi | since zuul-launcher is running jobs via ansible | 13:35 |
| *** EricGonczer_ has quit IRC | 13:35 | |
| *** ddieterly has joined #openstack-infra | 13:35 | |
| kashyap | fungi: Thanks for spelling out the symptom. I can simulate that. | 13:36 |
| *** tonytan4ever has joined #openstack-infra | 13:36 | |
| *** ociuhandu has joined #openstack-infra | 13:37 | |
| kashyap | fungi: On a separate topic about your 'idle pipeline' discussion from the mailing list, filed this request for tracking: -- https://storyboard.openstack.org/#!/story/2000671 | 13:37 |
| *** amitgandhinz has joined #openstack-infra | 13:39 | |
| *** ddieterly has quit IRC | 13:39 | |
| fungi | kashyap: awesome. hopefully that can be added once we're on zuul v3 (which should be early next cycle if all goes well) | 13:39 |
| kashyap | Cool. | 13:40 |
| *** nadya has quit IRC | 13:41 | |
| *** tonytan_brb has joined #openstack-infra | 13:41 | |
| *** yamamoto has quit IRC | 13:41 | |
| *** tonytan_brb is now known as tonytan4ever_ | 13:41 | |
| *** eharney_ has joined #openstack-infra | 13:41 | |
| fungi | unfortunately zuul v2.5 set the timeline back a little, but overall still worth it so that we could stop depending on jenkins (that's actually made things more efficient overall and also i think freed up some of our time previously devoted to its care and feeding as well) | 13:42 |
| *** tonytan4ever has quit IRC | 13:43 | |
| *** mriedem has joined #openstack-infra | 13:43 | |
| *** trown|outtypewww is now known as trown | 13:43 | |
| *** eharney has quit IRC | 13:43 | |
| *** amotoki has joined #openstack-infra | 13:43 | |
| *** tonytan4ever_ has quit IRC | 13:44 | |
| *** andymaier has quit IRC | 13:44 | |
| *** tonytan4ever has joined #openstack-infra | 13:45 | |
| *** yamamoto has joined #openstack-infra | 13:45 | |
| asselin__ | rcarrillocruz, how does puppet get run on the puppet/ansible master? | 13:48 |
| asselin__ | I see lots of remote_puppet*.yaml plays. update_puppet.yaml doesn't do it. | 13:49 |
| kashyap | fungi: Cool. Yeah, I think Infra must also be happy to get rid of a massive Java dep | 13:49 |
| * fungi eyes gerrit menacingly | 13:49 | |
| *** javeriak has quit IRC | 13:50 | |
| kashyap | Heh | 13:50 |
| clarkb | the java never really bugged me. The run out of thread stack space due to thread leaks is what bugged me | 13:50 |
| kashyap | Oh dear, right... | 13:50 |
| *** IlyaG has joined #openstack-infra | 13:50 | |
| strigazi | Can someone approve https://review.openstack.org/#/c/340965/ ? | 13:51 |
| *** eezhova has quit IRC | 13:51 | |
| *** amotoki has quit IRC | 13:51 | |
| *** garyk has quit IRC | 13:51 | |
| *** jlanoux has quit IRC | 13:51 | |
| *** eharney_ is now known as eharney | 13:52 | |
| fungi | typical google move: given a code review system written in python by a google engineer who just happens to be the author of, well, python... "this is neat, but you know what? to be enterprise-class we really should reimplement it all in java!" | 13:52 |
| *** berendt has quit IRC | 13:53 | |
| *** jcoufal has joined #openstack-infra | 13:53 | |
| *** PollyZ has joined #openstack-infra | 13:53 | |
| kashyap | fungi: You referring to Mondrian? It was written in Python by Guido? I think I vaguely recall reading about it long time ago | 13:54 |
| *** r-mibu has quit IRC | 13:54 | |
| AJaeger | clarkb, fungi, what do you think of https://review.openstack.org/341093 - a bindep update for python packages? | 13:54 |
| *** r-mibu has joined #openstack-infra | 13:54 | |
| *** berendt has joined #openstack-infra | 13:55 | |
| *** IlyaG has quit IRC | 13:55 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add check-requirements job to all openstack-ansible repo's https://review.openstack.org/341508 | 13:55 |
| *** javeriak has joined #openstack-infra | 13:56 | |
| *** zhurong has quit IRC | 13:57 | |
| fungi | kashyap: no, its successor "rietveld" | 13:57 |
| *** Jeffrey4l has quit IRC | 13:58 | |
| *** amotoki has joined #openstack-infra | 13:58 | |
| *** rbrndt has joined #openstack-infra | 13:58 | |
| *** pradk has joined #openstack-infra | 13:58 | |
| *** zhurong has joined #openstack-infra | 13:58 | |
| *** xarses_ has quit IRC | 13:59 | |
| fungi | kashyap: gerrit 1.x was a fork of that. gerrit 2.x was the java rewrite | 13:59 |
| *** hurgleburgler has joined #openstack-infra | 13:59 | |
| kashyap | Ah | 13:59 |
| fungi | kashyap: https://www.gerritcodereview.com/about.md | 13:59 |
| kashyap | Thanks for the history | 13:59 |
| *** AJaeger has quit IRC | 14:00 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Fix upload path for pkgdeb-publish-openstack-pkg-tools https://review.openstack.org/341549 | 14:00 |
| pabelanger | zigo: fungi: clarkb: ^ mind the quick review? That address a typo in the upload path for the debian packaging job for reprepro | 14:01 |
| zigo | pabelanger: I did exactly that same patch ! :) | 14:01 |
| fungi | zigo: is AJaeger's https://review.openstack.org/341093 what you were saying needed doing? | 14:02 |
| pabelanger | zigo: oh | 14:02 |
| pabelanger | review? | 14:02 |
| zigo | https://review.openstack.org/#/c/341436/ | 14:02 |
| pabelanger | I've abandoned mine | 14:03 |
| pabelanger | fungi: do you mind ^ 341436 | 14:03 |
| *** amotoki has quit IRC | 14:03 | |
| openstackgerrit | Merged openstack-infra/project-config: [magnum] Add ironic projects to PROJECTS env https://review.openstack.org/340965 | 14:04 |
| *** eezhova has joined #openstack-infra | 14:07 | |
| pabelanger | zigo: so, you'd like to have jessie-mitaka as the codename right? today it is just jessie | 14:07 |
| zigo | pabelanger: jessie-newton ! :) | 14:07 |
| zigo | pabelanger: There wont be much work on Mitaka anymore... | 14:07 |
| pabelanger | zigo: you need a newton branch then | 14:07 |
| zigo | Ok, I can do that now. | 14:08 |
| strigazi | clarkb: thanks | 14:08 |
| *** cardeois__ has joined #openstack-infra | 14:09 | |
| zigo | pabelanger: Done. | 14:09 |
| *** raildo has joined #openstack-infra | 14:09 | |
| *** yamahata has joined #openstack-infra | 14:09 | |
| *** cardeois__ is now known as cardeois | 14:10 | |
| *** alex_xu has quit IRC | 14:11 | |
| *** sdake has joined #openstack-infra | 14:11 | |
| *** alex_xu has joined #openstack-infra | 14:12 | |
| *** deadnull has joined #openstack-infra | 14:12 | |
| pabelanger | zigo: okay, once 341436 is merged, I'll confirm puppet has applied it. Then we can merge 340520 to confirm everything worked all together. If everything is fine, I'll delete reprepro from AFS and create the jessie-newton codename in reprepro | 14:12 |
| rcarrillocruz | asselin__: http://git.openstack.org/cgit/openstack-infra/system-config/tree/run_all.sh | 14:13 |
| rcarrillocruz | that script runs in a cron | 14:13 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Merge branch 'master' into v3_merge https://review.openstack.org/341559 | 14:13 |
| rcarrillocruz | which calls playbooks | 14:13 |
| rcarrillocruz | which do the puppet apply/hiera things | 14:13 |
| *** berendt has quit IRC | 14:13 | |
| rcarrillocruz | in general | 14:13 |
| rcarrillocruz | http://git.openstack.org/cgit/openstack-infra/system-config/tree/playbooks/remote_puppet_else.yaml | 14:13 |
| rcarrillocruz | there are some specialied plays for afs and other stuff that run before that | 14:14 |
| zigo | pabelanger: Awesome! :) | 14:14 |
| *** rossella_s has quit IRC | 14:14 | |
| zigo | pabelanger: Once that's done, I'll create the generic jobs to build another package using all of that. I'll pickup something with no build-depends. | 14:14 |
| zigo | pabelanger: Then there's the need to do that script to do automated backports from Sid. | 14:15 |
| asselin__ | so that 'else' one includes localhost? will give it a try | 14:15 |
| zigo | pabelanger: Currently, I push these into a separate repository, but it could be the same (single) repo. Your thoughts? | 14:15 |
| *** AJaeger has joined #openstack-infra | 14:15 | |
| openstackgerrit | Merged openstack-infra/project-config: Add Fedora 24 nodes https://review.openstack.org/340671 | 14:16 |
| rcarrillocruz | hosts: '!review.openstack.org:!git0*:!afs*:!baremetal*:!controller*:!compute*:!puppetmaster*:!disabled' | 14:16 |
| zigo | pabelanger: I approximately know how to build that script, but I have no idea how to do a periodic job. Where can I read about this? | 14:16 |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: WIP search for boards and worklists https://review.openstack.org/341562 | 14:16 |
| rcarrillocruz | colons are OR | 14:16 |
| pabelanger | zigo: lets start with the generic job first, it should be straightforward to build that up. I'd need to see how your automatic backports work | 14:17 |
| *** mikelk has quit IRC | 14:17 | |
| rcarrillocruz | http://docs.ansible.com/ansible/intro_patterns.html | 14:17 |
| asselin__ | rcarrillocruz, ok I see...it 'remotes' to itself | 14:17 |
| *** Ravikiran_K has joined #openstack-infra | 14:17 | |
| *** ggnel_t has quit IRC | 14:17 | |
| fungi | zigo: is AJaeger's https://review.openstack.org/341093 what you were saying needed doing? | 14:17 |
| pabelanger | zigo: periodic jobs work the same way other jobs do, we just trigger them from the tip of master every 24 hours. If you look in jenkins_jobs, you can see some periodic-foo jobs | 14:17 |
| zigo | pabelanger: The tooling to do the backport itself is already wired in openstack-pkg-tools, what needs to be written is something that compares whats in Sid, and what is already backported. I know how to write that though, that's easy (I will use madison-lite to extract versions of packages from repositories). | 14:18 |
| zigo | fungi: https://review.openstack.org/gitweb?p=openstack/keystone.git;a=commitdiff;h=aa404d0491964e0bbf7a6df235bc6a2e261f5eb3 | 14:20 |
| openstackgerrit | Merged openstack-infra/project-config: Fixed target path https://review.openstack.org/341436 | 14:20 |
| AJaeger | zigo, see my comment - I think we should keep the non-dev item. Do you think it's fine as is or is there an error in it? | 14:21 |
| zigo | fungi: python3-all-dev already contains a dependency on python3-all, and this means "all python3 versions available in the current system", meaning Py 3.4 in Trusty & Jessie, and 3.5 in Xenial & Stretch. | 14:21 |
| *** Guest19946 has quit IRC | 14:21 | |
| zigo | AJaeger: See what I just wrote ... :P | 14:22 |
| zigo | AJaeger: You don't need the non-dev ones, if you already have the -dev ones. | 14:22 |
| zigo | There's no hard error, it's just ugly to declare things twice. | 14:22 |
| AJaeger | zigo: see my comment in the review - bindep fallback documents the options, it might be nice to include those for reference. | 14:22 |
| *** jlanoux has joined #openstack-infra | 14:23 | |
| AJaeger | zigo: Ok, then let other reviews say whether we want both for documentation or not... | 14:23 |
| zigo | AJaeger: Your comments where? | 14:23 |
| AJaeger | zigo: in the review itself | 14:23 |
| *** berendt has joined #openstack-infra | 14:24 | |
| *** kashyap has left #openstack-infra | 14:24 | |
| zigo | AJaeger: I'm not sure I'm following which review you're reffering to. | 14:24 |
| *** ddieterly has joined #openstack-infra | 14:24 | |
| * zigo is lost ... | 14:24 | |
| fungi | zigo: https://review.openstack.org/341093 | 14:24 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Use $USER instead of jenkins in CI scripts https://review.openstack.org/339565 | 14:25 |
| *** dtantsur is now known as dtantsur|brb | 14:25 | |
| zigo | fungi: AJaeger: We only need python3-all-dev if a project is using C bindings, and will include Python.h. | 14:25 |
| *** mtanino has joined #openstack-infra | 14:25 | |
| fungi | i don't have a strong opinion on it either way. if projects want to pare back their individual other-requirements.txt files they can replace python3-all-dev with python3-all. i don't mind individual projects declaring more packages than they need, as long as the net result is that the (non-python) packages they do need to run their tests get installed | 14:25 |
| *** akshai has joined #openstack-infra | 14:26 | |
| *** markvoelker has quit IRC | 14:26 | |
| *** hashar is now known as hasharAway | 14:27 | |
| zigo | fungi: AJaeger: I'm also concerned that we're writting "ubuntu" here, and not "ubuntu and debian" ... | 14:27 |
| fungi | zigo: very good point. the way to do that is platform:dpkg | 14:27 |
| zigo | fungi: AJaeger: Can't we write something like: [platform:dpkg !platform:ubuntu-precise] | 14:28 |
| AJaeger | zigo: let me do that quickly... | 14:28 |
| *** nadya has joined #openstack-infra | 14:28 | |
| *** jamesmcarthur has joined #openstack-infra | 14:28 | |
| *** sree__ has quit IRC | 14:29 | |
| *** nadya has quit IRC | 14:30 | |
| zigo | fungi: AJaeger: BTW, Debian Stretch will be released with MariaDB as default, and upgrades from Jessie to Stretch will also do the switch. I believe Ubuntu will also follow (it's been their policy to keep such key package the same). | 14:30 |
| zigo | So we may want to be careful with these... | 14:30 |
| zigo | Do we have a way to say this *OR* that? | 14:30 |
| fungi | zigo: yep, i've been following that discussion | 14:30 |
| *** sdake has quit IRC | 14:31 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Bindep: Use python3-all https://review.openstack.org/341093 | 14:31 |
| fungi | zigo: probably easiest is to list the mariadb packages as platform:debian-stretch and then mysql packages as !platform:debian-stretch | 14:31 |
| AJaeger | updated the python3 change as suggested | 14:31 |
| *** nmagnezi has quit IRC | 14:31 | |
| *** sdake has joined #openstack-infra | 14:31 | |
| rcarrillocruz | mugsie , Kiall : are http://docs.openstack.org/developer/designate/devstack.html still accurate? | 14:31 |
| zigo | fungi: And how about Ubuntu 2018.04 ? :) | 14:32 |
| mugsie | rcarrillocruz: mostly | 14:32 |
| *** uberjay has quit IRC | 14:32 | |
| * rcarrillocruz vaguely recalls some changes on devstack to accomodate designate | 14:32 | |
| rcarrillocruz | k, i'lm running them now, thx | 14:32 |
| mugsie | we are currently doing a docs sprint right now to update our docs though | 14:32 |
| rcarrillocruz | ++ | 14:32 |
| clarkb | zigo: we arent even using 16.04 yet | 14:33 |
| fungi | zigo: add similar platform:ubuntu-whatever and !platform:ubuntu-whatever profiles | 14:33 |
| clarkb | one step at a time | 14:33 |
| fungi | but as clarkb points out, this is well into the future | 14:33 |
| fungi | zigo: unless there's a good virtual or meta package we can list instead | 14:33 |
| mugsie | rcarrillocruz: anything wrong, dump them into #openstack-dns - we are working for another few hours today on them | 14:33 |
| zigo | clarkb: I'm just trying to minimize our future work. | 14:33 |
| zigo | fungi: There is. Hang on, searching fo rit. | 14:33 |
| rcarrillocruz | will do | 14:33 |
| fungi | zigo: sometimes doing work too early can cause more work if your predictions end up not coming to pass | 14:34 |
| *** sorantis has quit IRC | 14:34 | |
| *** pcarver has left #openstack-infra | 14:34 | |
| zigo | There's *going to be* a default-mysql-server metapackage, which will default to mariadb. Best would be if we could use that *first*, and mysql-server if it's not available. | 14:35 |
| zigo | default-mysql-server | mysql-server | 14:35 |
| zigo | Something like that... | 14:35 |
| fungi | zigo: though also, debian (and ubuntu) didn't indicate they're dropping the mysql packages, just that packages declaring a dependency on a mysql-like db should prefer mariadb as teh default for the upcoming release | 14:35 |
| zigo | Right. | 14:35 |
| asselin__ | rcarrillocruz, which ssh keys does the ansible master use to ssh into the nodes to run the updates? | 14:35 |
| *** uberjay has joined #openstack-infra | 14:35 | |
| rcarrillocruz | the role run as root | 14:36 |
| rcarrillocruz | so it uses root keys | 14:36 |
| AJaeger | zigo: we cannot handle such "or's" | 14:36 |
| asselin__ | rcarrillocruz, and where do the root keys get setup? | 14:36 |
| rcarrillocruz | you have to manually creathem | 14:36 |
| AJaeger | I agree with fungi, let's wait until there are released distros... | 14:36 |
| rcarrillocruz | sudo su | 14:36 |
| fungi | zigo: so when the time comes, we can declare default-mysql-server with profiles for the distro versions that have it available, and negate the mysql packages for the same set of distro versions | 14:36 |
| rcarrillocruz | ssh-keygen | 14:36 |
| rcarrillocruz | etc | 14:36 |
| *** psachin has quit IRC | 14:37 | |
| *** karthikp_ has joined #openstack-infra | 14:37 | |
| fungi | AJaeger: we effectively can, just not expressed as an explicit logical or | 14:37 |
| fungi | AJaeger: we have to know in advance which packages to use on which platforms and then express that relationship instead | 14:38 |
| fungi | AJaeger: so we basically precompute the conditional | 14:38 |
| AJaeger | fungi: yes, that works. | 14:38 |
| asselin__ | rcarrillocruz, sorry if the questions sound silly, but i'm trying to bootstrap and re-use what's already there instead of recreate. | 14:38 |
| asselin__ | rcarrillocruz, so manually bootstrap a key for the root user. How does that get authorized on all the other nodes and for which os user? | 14:39 |
| *** mdrabe has quit IRC | 14:39 | |
| *** garyk has joined #openstack-infra | 14:39 | |
| pabelanger | infra-root: When you have a moment, I'd like to get some feedback on https://review.openstack.org/#/c/341121/. I'd like to improve the performance of our ansible wheel, and feel switching our strategy to free will be a good first step. Other thoughts include increasing our available memory and number of forks we have ansible do. | 14:39 |
| *** zz_zz_ja is now known as zz_zz_zz_ja | 14:39 | |
| *** slaweq has quit IRC | 14:39 | |
| *** tidwellr1 has joined #openstack-infra | 14:40 | |
| rcarrillocruz | i believe that's set up by puppet | 14:40 |
| pabelanger | this is related to puppetmaster.o.o | 14:40 |
| rcarrillocruz | all openstack_project nodes | 14:40 |
| *** slaweq has joined #openstack-infra | 14:40 | |
| rcarrillocruz | put on root user | 14:40 |
| *** isaacb has quit IRC | 14:40 | |
| *** karthikp_ has quit IRC | 14:40 | |
| rcarrillocruz | the pub key of the puppetmaster root user | 14:40 |
| *** yohoffman has joined #openstack-infra | 14:40 | |
| *** amotoki has joined #openstack-infra | 14:40 | |
| rcarrillocruz | sec | 14:40 |
| clarkb | pabelanger: ansible wheel is job that makes wheel mirrors? | 14:40 |
| pabelanger | clarkb: sorry, our 15mins loop where ansible runs | 14:41 |
| clarkb | or you mean the cron setup or? | 14:41 |
| clarkb | ya ok | 14:41 |
| AJaeger | So, clarkb, fungi, pabelanger : REgarding the python3-all, please review https://review.openstack.org/341093 and tell me whether this is good to go forward with the "duplicate" or not. | 14:41 |
| rcarrillocruz | asselin__: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/template.pp | 14:41 |
| rcarrillocruz | that's how it gets deployed the ssh keys on nodes | 14:41 |
| rcarrillocruz | so the puppetmaster can access them later on on root | 14:41 |
| pabelanger | clarkb: I've enabled it only for our git servers first, before doing it for all playbooks | 14:41 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Fix project group sidebar-search description https://review.openstack.org/341533 | 14:42 |
| asselin__ | got it thanks | 14:42 |
| rcarrillocruz | np | 14:43 |
| *** EricGonc_ has quit IRC | 14:43 | |
| rcarrillocruz | iirc you have still around in gozer template.pp | 14:43 |
| rcarrillocruz | can't recall if that installs keys on root tho | 14:43 |
| rcarrillocruz | worth checking | 14:43 |
| *** xarses_ has joined #openstack-infra | 14:44 | |
| pabelanger | zigo: okay, we can land 340520 I think, if you want to +a | 14:44 |
| *** EricGonczer_ has joined #openstack-infra | 14:44 | |
| *** markvoelker has joined #openstack-infra | 14:44 | |
| clarkb | pabelanger: only the middle line chamged will cause a difference | 14:44 |
| clarkb | the others are noops as its single hosts | 14:44 |
| zigo | pabelanger: Done. | 14:45 |
| zigo | Waiting for merge and post. | 14:45 |
| yohoffman | Hey infra team! Jenkins keeps failing on https://review.openstack.org/#/c/341152/ because "RuntimeError: Could not find firefox in your system PATH. Please specify the firefox binary location or install firefox". Is this something that needs to be fixed or do I just keep rechecking? | 14:45 |
| *** garyk has quit IRC | 14:45 | |
| pabelanger | clarkb: Agreed, I added serial to the other hosts to be consistent. Don't expect a change in performance for them | 14:45 |
| zigo | pabelanger: Though you did it on the debian/mitaka branch. | 14:45 |
| pabelanger | zigo: ya, we are testing that first | 14:45 |
| zigo | Ok. | 14:45 |
| pabelanger | because I need to add logic for newton | 14:45 |
| *** coolsvap has joined #openstack-infra | 14:46 | |
| tdurakov | hi folks, looks like there is spam account in gerrit, | 14:46 |
| tdurakov | https://review.openstack.org/#/q/orielly | 14:46 |
| rcarrillocruz | ? | 14:46 |
| rcarrillocruz | spam account? | 14:46 |
| dims | fungi : clarkb : jeblair : ^^ | 14:46 |
| AJaeger | yohoffman: which test is failing? | 14:46 |
| dims | rcarrillocruz : check the url(s) posted by that person in the reviews | 14:46 |
| rcarrillocruz | wow | 14:47 |
| rcarrillocruz | This review is > 4 weeks without comment, and failed Jenkins the last time it was checked. We are abandoning this for now. Feel free to reactivate the review by pressing the restore button and leaving a 'recheck' comment to get fresh test results. | 14:47 |
| rcarrillocruz | http://www.fixithere.net/sky-contact-number/ | 14:47 |
| AJaeger | yohoffman: http://logs.openstack.org/52/341152/1/check/gate-horizon-dsvm-integration/52954e4/console.html#_2016-07-13_13_43_42_683130 installs firefox | 14:47 |
| *** mdrabe has joined #openstack-infra | 14:47 | |
| tdurakov | rcarrillocruz: yes | 14:47 |
| yohoffman | AJaeger: All of the tests in gate-horizon-dsvm-integration are failing for this reason | 14:47 |
| *** jamesmcarthur has quit IRC | 14:48 | |
| *** deadnull has quit IRC | 14:49 | |
| yohoffman | AJaeger: I guess you see the issue | 14:49 |
| clarkb | rcarrillocruz: if you get the accounts id number you can ssh gerrit gerrit set-account --inactive $id | 14:49 |
| *** jamesmcarthur has joined #openstack-infra | 14:49 | |
| rcarrillocruz | i'll sort it | 14:49 |
| yohoffman | AJaeger: another dev posted in the horizon chat room recently having the same issue | 14:49 |
| clarkb | fullname may also work if its unique | 14:49 |
| dims | clarkb rcarrillocruz : someone is exploring before they let loose a bot i guess | 14:49 |
| fungi | tdurakov: dims: rcarrillocruz: yep, looks like they've copied someone else's comment and then added their spam url in each of those two reviews... maybe testing the waters | 14:50 |
| *** garyk has joined #openstack-infra | 14:50 | |
| fungi | and set-account can take account id, username, e-mail address or full name | 14:51 |
| jeblair | i think we should delete the comments | 14:51 |
| dims | jeblair : ++ | 14:51 |
| fungi | yep, agreed. that will require a bit of database hackery | 14:51 |
| *** IlyaG has joined #openstack-infra | 14:51 | |
| dims | tdurakov : thanks for spotting it | 14:51 |
| jeblair | rcarrillocruz: paste the account id in here when you find it pls | 14:51 |
| fungi | if this is the tip of a coming iceberg, we may want to script up queries to mass-delete comments from specific accounts | 14:52 |
| jeblair | i will work on writing a script to delete comments, but not run it yet | 14:52 |
| fungi | hah | 14:52 |
| jeblair | fungi: yeah, that's what i'm thinking | 14:52 |
| clarkb | we can also track and block connections depending on source diversity | 14:53 |
| rcarrillocruz | hmm | 14:54 |
| rcarrillocruz | not sure i can | 14:54 |
| *** adrian_otto has joined #openstack-infra | 14:54 | |
| rcarrillocruz | i'm trying to run a gsql on gerrit ssh interface and i don't have that capability | 14:54 |
| rcarrillocruz | fungi: ^ | 14:54 |
| nibalizer | yikes | 14:54 |
| jeblair | oh yeah, we need to add you to admins :) | 14:54 |
| rcarrillocruz | heh | 14:54 |
| *** jamesmcarthur has quit IRC | 14:55 | |
| *** jamesmca_ has joined #openstack-infra | 14:55 | |
| *** amitgandhinz has quit IRC | 14:55 | |
| *** armax has joined #openstack-infra | 14:55 | |
| *** adrian_otto has quit IRC | 14:56 | |
| *** IlyaG has quit IRC | 14:56 | |
| *** amitgandhinz has joined #openstack-infra | 14:56 | |
| jeblair | rcarrillocruz: you're in | 14:56 |
| rcarrillocruz | thx | 14:56 |
| *** _ari_ has joined #openstack-infra | 14:56 | |
| *** adrian_otto has joined #openstack-infra | 14:57 | |
| *** esker has quit IRC | 14:58 | |
| *** karthikp_ has joined #openstack-infra | 14:58 | |
| *** roxanaghe has joined #openstack-infra | 14:59 | |
| *** maishsk has quit IRC | 14:59 | |
| zigo | pabelanger: The package were published to the correct location at http://tarballs.openstack.org/packaging-deb/deb-openstack-pkg-tools/uploads/f048fe9087b4e6ff942bac56e3c531f651103d58/ | 15:00 |
| zigo | pabelanger: Can you remind me the deb repo URL your script manages? | 15:00 |
| fungi | note that the urls posted are not the same either. it looks like this spammer is posting spam on compromised (wordpress?) blog sites and then linking them | 15:00 |
| *** esker has joined #openstack-infra | 15:00 | |
| *** jistr|cowork is now known as jistr|mtg | 15:00 | |
| AJaeger | yohoffman: I'm not seeing it, could you link me to the line that shows it, please? | 15:00 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Deploy full net-iso environment https://review.openstack.org/341161 | 15:01 |
| *** jamesmca_ has quit IRC | 15:01 | |
| *** links has joined #openstack-infra | 15:01 | |
| yohoffman | AJaeger: I actually found what seems to be the source of the issue: http://logs.openstack.org/52/341152/1/check/gate-horizon-dsvm-integration/52954e4/console.html#_2016-07-13_14_06_56_149509 | 15:01 |
| AJaeger | yohoffman: Why is this done here: http://logs.openstack.org/52/341152/1/check/gate-horizon-dsvm-integration/52954e4/console.html#_2016-07-13_14_06_55_633502 | 15:02 |
| *** hurgleburgler has quit IRC | 15:02 | |
| *** roxanaghe has quit IRC | 15:02 | |
| rcarrillocruz | jeblair, fungi : http://paste.openstack.org/show/532050/ | 15:02 |
| AJaeger | I mean this: http://logs.openstack.org/52/341152/1/check/gate-horizon-dsvm-integration/52954e4/console.html#_2016-07-13_14_06_55_211151 | 15:02 |
| rcarrillocruz | 22723 | 15:02 |
| *** EricGonczer_ has quit IRC | 15:02 | |
| AJaeger | That'S the culprit... | 15:02 |
| *** roxanaghe has joined #openstack-infra | 15:02 | |
| jeblair | zaro: could gerrit be altered to set 'rel="nofollow"' on links in comments? | 15:02 |
| *** rbrndt has quit IRC | 15:02 | |
| rcarrillocruz | haha | 15:03 |
| AJaeger | yohoffman: I have to leave now - but plesae figure out who issues the purge... I do not see this done by infra scripts at all | 15:03 |
| *** cody-somerville has joined #openstack-infra | 15:03 | |
| rcarrillocruz | the email of that account is editor.buzzfeed@yahoo.com | 15:03 |
| jeblair | zaro: https://support.google.com/webmasters/answer/96569?hl=en | 15:03 |
| jeblair | rcarrillocruz: thanks | 15:03 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: reprepro-import URL now 4 level deep, not 3 https://review.openstack.org/341599 | 15:03 |
| rcarrillocruz | np | 15:03 |
| *** Apoorva has joined #openstack-infra | 15:03 | |
| yohoffman | AJaeger: What about this line - https://github.com/openstack/horizon/blob/master/tools/gate/integration/post_test_hook.sh#L11 | 15:03 |
| pabelanger | zigo: Yup, but we hit a bug. ^ | 15:03 |
| zigo | Ah ? | 15:04 |
| *** jamesmcarthur has joined #openstack-infra | 15:04 | |
| pabelanger | AJaeger: fungi: Mind a quick review / approve? ^ We should also updated that in the previous patch^ | 15:04 |
| *** yolanda has joined #openstack-infra | 15:04 | |
| pabelanger | zigo: we downloads everything, but not into the correct directory | 15:04 |
| zigo | Ok. | 15:05 |
| pabelanger | zigo: http://logs.openstack.org/f0/f048fe9087b4e6ff942bac56e3c531f651103d58/post/reprepro-import-debian-openstack-jessie/af863a0//console.html#_2016-07-13_14_58_03_091968 | 15:05 |
| yohoffman | AJaeger: So this is a horizon issue? | 15:05 |
| AJaeger | yohoffman: I would say. | 15:05 |
| *** rbrndt has joined #openstack-infra | 15:05 | |
| *** eharney_ has joined #openstack-infra | 15:05 | |
| *** eharney has quit IRC | 15:05 | |
| *** zhurong has quit IRC | 15:05 | |
| AJaeger | yohoffman: could you remove that line in horizon and see whether it passes? | 15:05 |
| yohoffman | AJaeger: I can try! | 15:06 |
| AJaeger | yohoffman: have to leave really now - will be back in 3 hours briefly... | 15:06 |
| rcarrillocruz | pabelanger: can't open gerrit now | 15:06 |
| yohoffman | AJaeger: thanks! | 15:06 |
| rcarrillocruz | re: that change review | 15:06 |
| rcarrillocruz | i will once it's back | 15:06 |
| *** eharney_ is now known as eharney | 15:06 | |
| vgridnev | AJaeger, yohoffman it will not pass, seems like integration tests don't have support of latest of firefox | 15:06 |
| *** psilvad has joined #openstack-infra | 15:06 | |
| *** dtantsur|brb is now known as dtantsur | 15:07 | |
| *** bethwhite has joined #openstack-infra | 15:07 | |
| rcarrillocruz | hmm | 15:07 |
| rcarrillocruz | are openstack dns sick | 15:08 |
| rcarrillocruz | ? | 15:08 |
| *** jamesmcarthur has quit IRC | 15:08 | |
| dhellmann | I was seeing issues with review.openstack.org and releases.openstack.org. it looks like review is back now | 15:08 |
| dhellmann | and now so is releases | 15:08 |
| *** mriedem1 has joined #openstack-infra | 15:08 | |
| rcarrillocruz | i'm seeing issues on git.openstack.org too | 15:08 |
| fungi | rcarrillocruz: jeblair: for reference, that account was created yesterday at 12:52:53 utc, the comments added a few minutes later at 12:55 and 13:06 | 15:08 |
| *** esker has quit IRC | 15:08 | |
| fungi | rcarrillocruz: dhellmann: dns resolution errors or something else? | 15:08 |
| yohoffman | vgridnev: did you try it..? | 15:09 |
| dhellmann | fungi: safari just says "cannot find the server" which I think is dns? | 15:09 |
| rcarrillocruz | fungi: i can't resolve openstack addresses... | 15:09 |
| vgridnev | yes | 15:09 |
| dhellmann | fungi : it's working for me again now, though | 15:09 |
| pabelanger | rcarrillocruz: no issues here | 15:09 |
| pabelanger | http://www.downforeveryoneorjustme.com/review.openstack.org | 15:09 |
| fungi | rcarrillocruz: try dig +trace | 15:09 |
| *** javeriak has quit IRC | 15:10 | |
| rcarrillocruz | lol | 15:10 |
| rcarrillocruz | i was about to paste it on paste.openstack.org, but that won't resolve either | 15:10 |
| *** mriedem has quit IRC | 15:10 | |
| jeblair | rcarrillocruz, fungi: i'm about halfway through the delete comments script; i'm going to grab some quick breakfast, then will resume in a few minutes. | 15:11 |
| *** mriedem has joined #openstack-infra | 15:11 | |
| fungi | i'm getting some timeouts querying dns1.stabletransit.com | 15:11 |
| rcarrillocruz | ++ | 15:11 |
| *** adrian_otto has quit IRC | 15:11 | |
| fungi | dns2.stabletransit.com seems to be fine though | 15:11 |
| fungi | dns1.stabletransit.com returns the a rr for review.openstack.org but times out when asked for an aaaa rr | 15:12 |
| *** arxcruz has quit IRC | 15:12 | |
| fungi | and now it's working again | 15:12 |
| fungi | i wonder if those are backed by a load-balanced pool and one (or more) servers in the pool is acting up | 15:13 |
| *** mriedem1 has quit IRC | 15:13 | |
| *** adrian_otto has joined #openstack-infra | 15:13 | |
| fungi | but yes, it looks like rackspace's authoritative dns hosting is at least intermittently screwy at the moment | 15:13 |
| rcarrillocruz | it is for me still | 15:13 |
| fungi | i don't see anything listed at https://status.rackspace.com/ though | 15:14 |
| *** Julien-zte has joined #openstack-infra | 15:14 | |
| rcarrillocruz | :/ | 15:14 |
| jeblair | fungi: maybe we should increase the review ttl? | 15:14 |
| *** vincentll has quit IRC | 15:15 | |
| fungi | that's doable. i don't think it lets us reduce the negative cache time so that may be our only option | 15:15 |
| fungi | logging in now | 15:15 |
| jeblair | (we're still at 300 from the move, i think?) | 15:15 |
| fungi | yeah | 15:15 |
| *** hasharAway is now known as hashar | 15:16 | |
| *** burgerk has joined #openstack-infra | 15:16 | |
| *** psilvad has quit IRC | 15:16 | |
| *** matthewbodkin has joined #openstack-infra | 15:16 | |
| rcarrillocruz | hmm, ok | 15:17 |
| rcarrillocruz | no i can load review at least | 15:17 |
| *** psilvad has joined #openstack-infra | 15:17 | |
| *** Ravikiran_K has quit IRC | 15:17 | |
| *** zeih has quit IRC | 15:18 | |
| rcarrillocruz | s/no/now | 15:18 |
| zigo | fungi: Can you +2 the patch from Paul? https://review.openstack.org/#/c/341599/ | 15:19 |
| zigo | Hopefully, it should be the last issue ... | 15:19 |
| fungi | ttl on review.o.o rrs is back up to an hour now | 15:19 |
| *** eezhova has quit IRC | 15:20 | |
| fungi | maybe that'll make this slightly less painful if it continues | 15:20 |
| rcarrillocruz | pabelanger , zigo : +2 | 15:20 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Allow comments to be edited by their owner https://review.openstack.org/333418 | 15:22 |
| *** savihou has quit IRC | 15:22 | |
| *** saggi1 has joined #openstack-infra | 15:22 | |
| *** Hal has joined #openstack-infra | 15:23 | |
| *** Hal is now known as Guest96631 | 15:23 | |
| fungi | looks like our spammer (an account using the same e-mail address anyway) is also posting links to their spam on other gerrits, so likely they're scanning the web looking for gerrit installs to exploit for link farming https://reviews.apache.org/r/6982/#review12201 | 15:23 |
| *** saggi1 has quit IRC | 15:24 | |
| rcarrillocruz | oh | 15:24 |
| rcarrillocruz | looks like we'll patch gerrit soon then | 15:24 |
| rcarrillocruz | has the vuln been reported? | 15:24 |
| fungi | what vuln? | 15:24 |
| *** saggi1 has joined #openstack-infra | 15:24 | |
| fungi | that gerrit lets people post comments on changes? | 15:24 |
| rcarrillocruz | the vulnerability the spammer is using | 15:25 |
| *** andreas_s has quit IRC | 15:25 | |
| fungi | the "vulnerability" the spammer is using is gerrit's review comment feature | 15:25 |
| rcarrillocruz | but in order to comment, they don't need to register an account, get logged in via openid etc | 15:26 |
| rcarrillocruz | ? | 15:26 |
| fungi | just because someone can exploit a feature in software doesn't mean there's necessarily a bug | 15:26 |
| karthikp_ | clarkb : Hi | 15:26 |
| *** ifarkas has quit IRC | 15:26 | |
| clarkb | karthikp_: hello | 15:26 |
| fungi | rcarrillocruz: yep, the openid in our case seems to be https://login.launchpad.net/+id/TrE7NbL | 15:26 |
| rcarrillocruz | yikes | 15:27 |
| rcarrillocruz | ic | 15:27 |
| karthikp_ | clarkb: I wanted to check with you if got a chance to go through Michal's comment on https://review.openstack.org/#/c/327619/ | 15:27 |
| karthikp_ | last comment^ | 15:27 |
| fungi | rcarrillocruz: spammer creates account somewhere, logs into gerrit, posts spam comments | 15:27 |
| fungi | rcarrillocruz: same as they've been doing on our wiki | 15:27 |
| rcarrillocruz | :S | 15:27 |
| *** jistr|mtg is now known as jistr | 15:27 | |
| *** pcaruana has quit IRC | 15:28 | |
| jeblair | the best thing we can to is to have gerrit set rel=nofollow on those links | 15:28 |
| jeblair | that makes them worthless to spammers | 15:28 |
| jeblair | or at least, worth less | 15:28 |
| fungi | fwiw, this spammer went so far as to create a full lp account not just a lp sso account. according to the lp api's openid reverse lookup, this is https://launchpad.net/~editor-buzzfeed | 15:29 |
| *** trown is now known as trown|lunchnlear | 15:29 | |
| fungi | however the account seems to already be deleted from lp itself | 15:29 |
| dmsimard | wow, what, there is spam in gerrit now ? | 15:29 |
| *** isaacb has joined #openstack-infra | 15:30 | |
| *** trown|lunchnlear is now known as trown|lunchlearn | 15:30 | |
| fungi | looks like it was deleted from lp per https://answers.launchpad.net/launchpad/+question/263139 | 15:30 |
| *** treaki has joined #openstack-infra | 15:30 | |
| *** sarob has joined #openstack-infra | 15:31 | |
| fungi | i've added a comment that they overlooked the sso account | 15:32 |
| *** rcernin has quit IRC | 15:33 | |
| rcarrillocruz | which reminds me | 15:33 |
| *** rajinir has joined #openstack-infra | 15:34 | |
| rcarrillocruz | there were talks about moving over to openstackid at some point for gerrit sso | 15:34 |
| rcarrillocruz | what happened with that? is that still planned? | 15:34 |
| fungi | yep, the trick is going to be matching up lo sso accounts to foundation accounts | 15:34 |
| fungi | er, matching up lp sso accounts to foundation accounts | 15:34 |
| fungi | not all of our gerrit users necessarily have accounts on www.openstack.org | 15:35 |
| *** mordred has quit IRC | 15:35 | |
| *** jamesmcarthur has joined #openstack-infra | 15:36 | |
| *** sarob has quit IRC | 15:36 | |
| fungi | the only ones who absolutely have to are ones who are uploading patches to projects enforcing the icla some time in the past 3 years, and even then their e-mail addresses may no longer have any overlap in the foundation member database | 15:36 |
| *** notnownikki has quit IRC | 15:38 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Update debian-openstack to use jessie-newton https://review.openstack.org/341624 | 15:39 |
| pabelanger | zigo: ^ | 15:39 |
| pabelanger | updates reprepro to jessie-newton | 15:39 |
| *** jtomasek__ has quit IRC | 15:39 | |
| fungi | what we _may_ end up needing to do is work with the foundation site admins to add dummy accounts for every user in gerrit we can't match up to an existing account, and send them a notification to do a mandatory password reset at www.o.o | 15:39 |
| zigo | Nice. | 15:39 |
| *** piet has quit IRC | 15:40 | |
| *** piet has joined #openstack-infra | 15:40 | |
| *** saggi1 has quit IRC | 15:40 | |
| anteaya | fungi: oh my | 15:41 |
| *** eeiden has joined #openstack-infra | 15:41 | |
| anteaya | fungi: can we put a higher priority on putting ipsilon on place? | 15:41 |
| *** jpich has quit IRC | 15:41 | |
| openstackgerrit | Jonathan Perret proposed openstack-infra/jenkins-job-builder: Fix documentation of --delete-old: affects only managed jobs. https://review.openstack.org/341627 | 15:41 |
| anteaya | would having ipsilon help us here? | 15:41 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Append branch to reprepro codename https://review.openstack.org/341628 | 15:42 |
| jeblair | anteaya: there is no authentication system that is immune to spammers | 15:42 |
| pabelanger | zigo: JJB change now ^ | 15:42 |
| fungi | anteaya: only insofar as it might have been slightly less attractive to spammers because the only places they could log into with it are our services | 15:42 |
| *** watanabe_isao has joined #openstack-infra | 15:42 | |
| *** adrian_otto has quit IRC | 15:43 | |
| karthikp_ | clarkb: the reason why we are planning to run without primary c-vol is because we want to test how a c-sch on primary and c-vol,c-bak(on subnode running previous stable) will work together | 15:43 |
| fungi | and they get more use out of creating accounts that can get them into a lot more diverse places | 15:43 |
| anteaya | jeblair: fungi okay thank you | 15:43 |
| *** Apoorva has quit IRC | 15:43 | |
| clarkb | karthikp_: ya its the same thing as nova compute with grenade but they dont do that setup | 15:44 |
| *** wcriswell_ has joined #openstack-infra | 15:44 | |
| *** adrian_otto has joined #openstack-infra | 15:44 | |
| *** xarses_ is now known as xarses | 15:44 | |
| clarkb | karthikp_: its easier when we dont have to have a flag for every little thing and can be consistent across the baord | 15:45 |
| clarkb | which is why I askes | 15:45 |
| *** david-lyle has joined #openstack-infra | 15:45 | |
| *** eezhova has joined #openstack-infra | 15:46 | |
| *** d0ugal has quit IRC | 15:46 | |
| *** mrmartin has quit IRC | 15:46 | |
| *** shardy has quit IRC | 15:47 | |
| zigo | fungi: https://review.openstack.org/#/c/341157/ <--- Need this for the CR bot to write in channel. | 15:48 |
| *** edtubill has joined #openstack-infra | 15:48 | |
| *** Nikolay_St has quit IRC | 15:49 | |
| *** shashank_hegde has joined #openstack-infra | 15:50 | |
| *** yamahata has quit IRC | 15:50 | |
| openstackgerrit | Merged openstack-infra/project-config: reprepro-import URL now 4 level deep, not 3 https://review.openstack.org/341599 | 15:50 |
| *** Sukhdev_ has joined #openstack-infra | 15:51 | |
| *** IlyaG has joined #openstack-infra | 15:51 | |
| *** hemnafk is now known as hemna | 15:51 | |
| *** tosky has quit IRC | 15:52 | |
| fungi | zigo: looks like pabelanger already approved it | 15:52 |
| zigo | Right! :) | 15:53 |
| zigo | A few seconds ago. | 15:53 |
| *** watanabe_isao has quit IRC | 15:54 | |
| *** david-lyle has quit IRC | 15:54 | |
| mmedvede | pinging zuul cores - please take a look at https://review.openstack.org/#/c/229582/ (needs another +2). There is need for it, as confirmed by https://review.openstack.org/#/c/341154/ | 15:55 |
| mmedvede | actually, it just needs +w | 15:55 |
| *** david-lyle_ has joined #openstack-infra | 15:55 | |
| jeblair | mmedvede: it's on my list | 15:56 |
| *** ddieterly is now known as ddieterly[away] | 15:56 | |
| *** cody-somerville has quit IRC | 15:57 | |
| mmedvede | jeblair: thank you | 15:57 |
| *** cody-somerville has joined #openstack-infra | 15:57 | |
| *** Rockyg has joined #openstack-infra | 15:57 | |
| *** watanabe_isao has joined #openstack-infra | 15:57 | |
| *** julim_ has joined #openstack-infra | 15:57 | |
| *** dimtruck is now known as zz_dimtruck | 15:58 | |
| openstackgerrit | Merged openstack-infra/project-config: Add debian/{mitaka,newton} to deb-ospkgtools IRC robot https://review.openstack.org/341157 | 15:58 |
| *** baoli_ has quit IRC | 15:59 | |
| *** amotoki has quit IRC | 15:59 | |
| *** julim has quit IRC | 16:00 | |
| *** eezhova has quit IRC | 16:00 | |
| *** rcernin has joined #openstack-infra | 16:00 | |
| *** sputnik13 has quit IRC | 16:01 | |
| *** davideagnello has quit IRC | 16:01 | |
| *** yohoffman_ has joined #openstack-infra | 16:02 | |
| *** ddieterly[away] is now known as ddieterly | 16:02 | |
| *** openstackgerrit has quit IRC | 16:03 | |
| *** yohoffman has quit IRC | 16:03 | |
| karthikp_ | clarkb: why we did it that way was because it is difficult for us to get deterministic results when we run multiple volume services(of different releaes)... is it okay we run stable mitaka or liberty of cvol on primary and not master?.... | 16:03 |
| *** openstackgerrit has joined #openstack-infra | 16:03 | |
| clarkb | karthikp_: pretty sure nova does, one of the things they are testing is that a mixed env works iirc | 16:04 |
| clarkb | since during an upgrade you roll through a cloud | 16:04 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Don't try to get stack details if the stack doesn't exist https://review.openstack.org/319337 | 16:05 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished https://review.openstack.org/297328 | 16:05 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Make stack deletion work on all branches https://review.openstack.org/317730 | 16:05 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job https://review.openstack.org/296765 | 16:05 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add a script to delete Gerrit spam comments https://review.openstack.org/341642 | 16:05 |
| jeblair | clarkb, fungi, rcarrillocruz: ^ | 16:05 |
| fungi | jeblair: thanks! reviewing now | 16:05 |
| jeblair | clarkb, fungi, rcarrillocruz: when you're done reviewing, we can run it | 16:05 |
| jeblair | clarkb, fungi, rcarrillocruz: i will pastebin the dry-run output now | 16:05 |
| *** tesseract- has quit IRC | 16:06 | |
| clarkb | I am doing breakfast with kids dont wait for me | 16:06 |
| jeblair | oh, one sec, i'm going to add a shebang | 16:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add a script to delete Gerrit spam comments https://review.openstack.org/341642 | 16:07 |
| fungi | jeblair: i have a feeling things like this are going to get a lot more complicated when gerrit finally finishes moving to notedb | 16:07 |
| *** isaacb has quit IRC | 16:07 | |
| jeblair | fungi: yeah... maybe that's a filter-branch? or maybe just ammend a commit to make it empty.... | 16:08 |
| *** mhickey has joined #openstack-infra | 16:08 | |
| *** tphummel has joined #openstack-infra | 16:08 | |
| fungi | hopefully. no idea how they're thinking of modelling comments in it | 16:09 |
| jeblair | http://paste.openstack.org/show/532085/ | 16:09 |
| fungi | if it's commit per comment then maybe easier | 16:09 |
| fungi | just revert the comment ;) | 16:09 |
| *** pilgrimstack has quit IRC | 16:10 | |
| rcarrillocruz | nice patch | 16:10 |
| rcarrillocruz | erm | 16:10 |
| rcarrillocruz | notedb? | 16:10 |
| rcarrillocruz | what's that | 16:10 |
| rcarrillocruz | a document based db? | 16:10 |
| fungi | rcarrillocruz: gerrit's git-based backend they're implementing | 16:10 |
| rcarrillocruz | oh | 16:10 |
| rcarrillocruz | o-k | 16:11 |
| *** dizquierdo has quit IRC | 16:11 | |
| fungi | rcarrillocruz: it's been a goal of theirs for a while to drop dependence on having a relational database and move everything they're currently storing in it into git somehow | 16:11 |
| pabelanger | zigo: okay, can you do a new commit for deb-openstack-pkg-tools so we can test the post pipeline again | 16:11 |
| zigo | pabelanger: Sure. | 16:11 |
| rcarrillocruz | neat! | 16:12 |
| fungi | jeblair: cool, so without --delete you get a dry run | 16:12 |
| *** shardy has joined #openstack-infra | 16:13 | |
| *** hurgleburgler has joined #openstack-infra | 16:13 | |
| zigo | pabelanger: I think I did a mistake when creating the debian/newton branch, it should have been using the debian/mitaka branch as a base, and instead of that, it only contains a single commit. | 16:13 |
| *** Apoorva has joined #openstack-infra | 16:13 | |
| *** david-lyle has joined #openstack-infra | 16:14 | |
| jeblair | fungi: yep, it felt better to me to have to do extra stuff to actually delete -- i like the "show me what you will delete, confirm, then delete" approach | 16:14 |
| pabelanger | zigo: okay, what are you planning on doing? | 16:14 |
| fungi | jeblair: the reparenting is fancy, i guess we don't have an easy way to test that without mocking up something on review-dev | 16:14 |
| zigo | pabelanger: What's the way to fix? Can a branch be deleted? | 16:14 |
| *** adrian_otto has quit IRC | 16:14 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Fail fast if a testenv couldn't be created https://review.openstack.org/341428 | 16:14 |
| pabelanger | Ya, we can delete the branch, let me login to gerrit | 16:15 |
| zigo | I know how I did the mistake btw... :P | 16:15 |
| jeblair | fungi: yeah -- also, this account made no patch comments | 16:15 |
| pabelanger | zigo: removed | 16:15 |
| *** adrian_otto has joined #openstack-infra | 16:16 | |
| zigo | Thanks. | 16:16 |
| *** Kaiyan has joined #openstack-infra | 16:16 | |
| jeblair | fungi: i at least did a dry run with another account to make sure the printing for those work. but yeah, only change message deletion will actually be tested with this one. | 16:16 |
| jeblair | fungi: though, with any "luck", that's likely to be all we'll need | 16:16 |
| jeblair | (i don't think patch comments are as useful for spammers as change messages) | 16:17 |
| jeblair | (but it's there just in case) | 16:17 |
| *** adrian_otto has quit IRC | 16:17 | |
| zaro | morning | 16:17 |
| Kaiyan | Hello! Can I get some review for https://review.openstack.org/#/c/341091/ please? This is to remove check-requirements in check job for monasca-agent because we couldn't make monasca-agent into openstack requirements right now. | 16:17 |
| zaro | jeblair, fungi: just got caught up on gerrit spammer discussion, will look into rel=nofollow later today. | 16:19 |
| jeblair | zaro: cool | 16:19 |
| *** coolsvap has quit IRC | 16:19 | |
| *** berendt has quit IRC | 16:19 | |
| prometheanfire | fungi: I've been looking at all the stuff I'd need to do to puppet to get minimum viable, and it looks like it's too much, would there be a way to get another puppet run for just basic things or something? | 16:19 |
| *** asettle has quit IRC | 16:20 | |
| jeblair | zaro, fungi, rcarrillocruz: i'm thinking once we land 341642 i should send a quick note to the repo-discuss list and summarize the problem and point people at that script | 16:20 |
| fungi | jeblair: absolutely | 16:20 |
| *** asettle has joined #openstack-infra | 16:20 | |
| *** hurgleburgler1 has joined #openstack-infra | 16:20 | |
| zigo | pabelanger: https://review.openstack.org/#/c/341657 <--- Done. | 16:20 |
| zigo | I need to go now. | 16:20 |
| rcarrillocruz | makes sense | 16:20 |
| zigo | (back home) | 16:21 |
| *** jlanoux has quit IRC | 16:21 | |
| fungi | jeblair: i'm good with it other than still trying to wrap my head around the reparenting logic, but should be done here momentarily | 16:21 |
| zigo | I'll be there later on tonight, hopefully. | 16:21 |
| *** bhavik has joined #openstack-infra | 16:21 | |
| *** sree has joined #openstack-infra | 16:21 | |
| jeblair | fungi: no rush -- that deserves special attention on account of being difficult to test | 16:21 |
| *** nadya has joined #openstack-infra | 16:21 | |
| fungi | jeblair: code comments also might help ;) | 16:22 |
| AJaeger | yohoffman_, vgridnev: Is there a bug for this or any further discussion? | 16:22 |
| AJaeger | yohoffman_, vgridnev: I mean the firefox issue | 16:22 |
| *** sandanar has quit IRC | 16:23 | |
| *** hurgleburgler has quit IRC | 16:23 | |
| *** yamahata has joined #openstack-infra | 16:23 | |
| *** hashar has quit IRC | 16:23 | |
| *** sdake has quit IRC | 16:24 | |
| *** hurgleburgler1 is now known as hurgleburgler | 16:25 | |
| *** asettle has quit IRC | 16:25 | |
| *** IlyaG has quit IRC | 16:25 | |
| yohoffman_ | AJaeger, vgridnev: Seems like there's a bug but in the horizon code we found | 16:26 |
| *** coolsvap has joined #openstack-infra | 16:26 | |
| *** javeriak has joined #openstack-infra | 16:26 | |
| *** Julien-zte has quit IRC | 16:27 | |
| *** zz_dimtruck is now known as dimtruck | 16:27 | |
| zaro | jeblair: sounds good. so am i to understand that we want 2 thing from this. rel=nofollow in all links and gerrit admin command to remove comments? | 16:28 |
| *** degorenko is now known as _degorenko|afk | 16:28 | |
| *** dtantsur is now known as dtantsur|afk | 16:28 | |
| fungi | jeblair: see inline comments about the reparenting | 16:28 |
| AJaeger | yohoffman_: note that the horizon-dsvm-integration job installs firefox here already: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/horizon.yaml#n14 . So, either this or the post-hook should be changed to not install firefox a second time. | 16:29 |
| fungi | i'm probably misreading it | 16:29 |
| jeblair | fungi: yeah, 'unparenting' :) | 16:29 |
| fungi | jeblair: okay, wfm | 16:29 |
| yohoffman_ | I assume they added this in because of some version issue but dont know for sure | 16:30 |
| fungi | just a misleading name there. i expected one of the potential parents to get chosen and set there instead or something | 16:30 |
| jeblair | fungi: got it, i'll fix terminology and add comments | 16:30 |
| pabelanger | zigo: thanks, monitoring | 16:31 |
| *** nadya has quit IRC | 16:31 | |
| *** piet has quit IRC | 16:33 | |
| *** lucasagomes is now known as lucas|afk | 16:33 | |
| *** coolsvap_ has joined #openstack-infra | 16:35 | |
| openstackgerrit | Kota Tsuyuzaki proposed openstack-infra/project-config: Add valgrind test to liberasurecode gerrit gate https://review.openstack.org/341665 | 16:35 |
| *** coolsvap has quit IRC | 16:37 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add a script to delete Gerrit spam comments https://review.openstack.org/341642 | 16:37 |
| jeblair | fungi: ^ | 16:37 |
| *** psilvad has quit IRC | 16:37 | |
| *** shashank_hegde has quit IRC | 16:38 | |
| *** derekh has quit IRC | 16:39 | |
| openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the User Tokens api https://review.openstack.org/339297 | 16:39 |
| fungi | jeblair: lgtm--thanks again! | 16:39 |
| *** jaosorior has quit IRC | 16:42 | |
| *** Kaiyan has quit IRC | 16:44 | |
| *** coolsvap_ has quit IRC | 16:45 | |
| *** edmondsw has quit IRC | 16:45 | |
| openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Update .gitignore to ignore all .egg things https://review.openstack.org/341670 | 16:46 |
| *** adrian_otto has joined #openstack-infra | 16:47 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Add Install Guide Jobs to Designate https://review.openstack.org/341671 | 16:49 |
| *** esikachev has quit IRC | 16:49 | |
| *** roxanagh_ has joined #openstack-infra | 16:50 | |
| *** gyee has joined #openstack-infra | 16:50 | |
| *** coolsvap has joined #openstack-infra | 16:52 | |
| *** jordanP has quit IRC | 16:52 | |
| *** piet has joined #openstack-infra | 16:53 | |
| *** roxanaghe has quit IRC | 16:54 | |
| openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Remove the delete_all funciton from the user_tokens api https://review.openstack.org/341676 | 16:54 |
| *** maishsk has joined #openstack-infra | 16:54 | |
| anteaya | rcarrillocruz: thank you | 16:56 |
| *** matthewbodkin has quit IRC | 16:56 | |
| *** sdake has joined #openstack-infra | 16:56 | |
| *** akshai has quit IRC | 16:57 | |
| *** yamamoto has quit IRC | 16:57 | |
| jlk | welp, somebody said my name, but it scrolled off my backlog. So ¯\_(ツ)_/¯ | 16:58 |
| clarkb | dhellmann: https://etherpad.openstack.org/p/newton-xenial is the current set of known fails that are worth worrying about | 16:58 |
| *** julim_ has quit IRC | 16:58 | |
| clarkb | dhellmann: a good chunk already have fixes proposed but a few toehrs needs more debugging so will work on that | 16:58 |
| clarkb | AJaeger: ^ is the etherpad btw | 16:59 |
| jeblair | jlk: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-07-13.log.html#t2016-07-13T11:56:57 | 16:59 |
| *** nadya has joined #openstack-infra | 16:59 | |
| *** julim has joined #openstack-infra | 16:59 | |
| rcarrillocruz | jlk: i believe it was mordred | 17:00 |
| rcarrillocruz | it's the same thing i pinged you about on ##ansible-shade | 17:00 |
| *** links has quit IRC | 17:01 | |
| jlk | kk | 17:01 |
| rcarrillocruz | re: last shade merge, if you could test it out before a release is made on pypi | 17:01 |
| clarkb | jd__: are you still around? pifpaf is failing on ubuntu xenial when running the gnocchi and aodh client tests | 17:02 |
| *** sree has quit IRC | 17:02 | |
| *** akshai has joined #openstack-infra | 17:02 | |
| clarkb | jd__: seems to have trouble reading from the subprocesses stdout? might be something you are interested in | 17:02 |
| clarkb | notmorgan: I am going to test your mysql patch for nodepool and if it works for me I can approve | 17:03 |
| *** sambetts|cat is now known as sambetts | 17:03 | |
| clarkb | hope to have that done before lunch | 17:03 |
| *** esker has joined #openstack-infra | 17:03 | |
| *** jamesmcarthur has quit IRC | 17:05 | |
| *** Sukhdev_ has quit IRC | 17:05 | |
| jd__ | clarkb: o/ | 17:05 |
| jd__ | clarkb: specifically on that ubuntu? weird | 17:05 |
| clarkb | jd__: ya | 17:05 |
| clarkb | jd__: let me get you a paste of the errors | 17:06 |
| clarkb | jd__: pbr is running into something similar too | 17:06 |
| *** sambetts is now known as sambetts|cat | 17:06 | |
| clarkb | jd__: http://paste.openstack.org/show/532095/ | 17:06 |
| *** esker has quit IRC | 17:06 | |
| *** chem has quit IRC | 17:06 | |
| *** PollyZ has quit IRC | 17:06 | |
| *** esker has joined #openstack-infra | 17:06 | |
| openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Worklists api https://review.openstack.org/340506 | 17:07 |
| jd__ | sounds like a buffering issue | 17:07 |
| *** baoli has joined #openstack-infra | 17:07 | |
| clarkb | ya I think the read is returning '' rather than blocking until data is available for whatever reason | 17:07 |
| *** gfreeman has joined #openstack-infra | 17:07 | |
| jd__ | clarkb: any chance you can try a pifpaf --debug? | 17:08 |
| jd__ | I'll try to spawn a node otherwise, somewhere | 17:08 |
| clarkb | jd__: I can't right this second the test box is currently busy running other tests but I can later today | 17:08 |
| jd__ | cool, let me know if you got anything interesting | 17:09 |
| dhellmann | clarkb : that's a pretty short list, nice | 17:09 |
| *** esker has quit IRC | 17:10 | |
| *** bnemec has quit IRC | 17:10 | |
| openstackgerrit | Merged openstack-infra/system-config: Add a script to delete Gerrit spam comments https://review.openstack.org/341642 | 17:11 |
| dhellmann | wow, now we're getting gerrit spam? | 17:11 |
| clarkb | dhellmann: ya its not too bad. Granted I haven't tried to run every combo of devstack + tempest job out there (we have experimental jobs that cover the "base" set) and this list is generated from projects that use python-jobs but it does give me a lot of confidence that stuff should mostly work | 17:11 |
| openstackgerrit | Alex Kavanagh proposed openstack-infra/project-config: Add charm-barbican, and related https://review.openstack.org/340945 | 17:12 |
| *** jamesmcarthur has joined #openstack-infra | 17:12 | |
| dhellmann | clarkb: yeah, I imagine we'll find an edge case or two, but I agree this gives me good confidence | 17:12 |
| *** esker has joined #openstack-infra | 17:12 | |
| *** maishsk has quit IRC | 17:12 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add trailing slash to reprepro-import URL https://review.openstack.org/341690 | 17:12 |
| pabelanger | rcarrillocruz: ^if you don't mind again | 17:12 |
| *** javeriak_ has joined #openstack-infra | 17:13 | |
| rcarrillocruz | pabelanger: yikes | 17:13 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements https://review.openstack.org/333670 | 17:13 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Add neutron-identity-v3-only-full-nv to Grafana for Neutron https://review.openstack.org/341691 | 17:13 |
| *** bnemec has joined #openstack-infra | 17:13 | |
| openstackgerrit | Khai Do proposed openstack/python-jenkins: Setup required packages with bindep https://review.openstack.org/341143 | 17:15 |
| *** javeriak has quit IRC | 17:15 | |
| *** esker has quit IRC | 17:16 | |
| pabelanger | rcarrillocruz: indeed | 17:16 |
| eantyshev | jeblair: Hello! Can I ask you to pay attention to this: https://review.openstack.org/238988 A few people use this patch in their CI setups | 17:17 |
| *** ddieterly is now known as ddieterly[away] | 17:17 | |
| *** Daisy has joined #openstack-infra | 17:17 | |
| openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Add example commands for the Users api https://review.openstack.org/338570 | 17:17 |
| pabelanger | fungi: zigo: should be our last outstanding packages to properly publish debian packages: https://review.openstack.org/#/c/341624/ https://review.openstack.org/#/c/341628/ | 17:18 |
| *** mikelk has joined #openstack-infra | 17:19 | |
| pabelanger | on landed, I'll reset http://mirror.dfw.rax.openstack.org/debian-openstack/ in AFS | 17:19 |
| pabelanger | to pick up the new codename dists | 17:20 |
| *** Daisy has quit IRC | 17:21 | |
| *** tosky has joined #openstack-infra | 17:21 | |
| *** rkukura has quit IRC | 17:22 | |
| odyssey4me | We have a user in #openstack-ansible which has some sort of issue and doing excessive joins/parts to such a degree that it's spam. http://i.imgur.com/a6ZEt32.jpg I don't seem to have the rights with chanserv to kick/ban the user. Can someone here help? | 17:22 |
| *** trown|lunchlearn is now known as trown | 17:23 | |
| *** PollyZ has joined #openstack-infra | 17:24 | |
| *** shardy has quit IRC | 17:24 | |
| *** inc0 has joined #openstack-infra | 17:24 | |
| *** maishsk has joined #openstack-infra | 17:24 | |
| *** Na3iL has quit IRC | 17:26 | |
| anteaya | odyssey4me: an infra-root hopefully should be able to help | 17:27 |
| *** mrmartin has joined #openstack-infra | 17:27 | |
| anteaya | sometimes it is their internet connection, I recall we had an issue with one user a few years ago and it turns out this happened when they closed their laptop, they weren't aware until we removed them from channel | 17:27 |
| *** PollyZ has quit IRC | 17:29 | |
| clarkb | odyssey4me: there is a large list of #openstack-ansible folks with permissions to do it /query chanserv access #openstack-ansible list | 17:29 |
| clarkb | odyssey4me: any chance one of them want to flex their irc op muscle? | 17:30 |
| clarkb | if not one of us can do it for you | 17:30 |
| *** cody-somerville has quit IRC | 17:30 | |
| clarkb | likely want to do a timed ban so that they can rejoin later when not so flappy | 17:30 |
| fungi | odyssey4me: it looks like mattt-, sigmavirus24, cloudnull, andymccr, hughsaunders and palendae should be able to. for some reason you only have +Aotv in the access list | 17:31 |
| *** berendt has joined #openstack-infra | 17:31 | |
| *** rdx_matt has quit IRC | 17:32 | |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: telemetry: enable integration test on panko https://review.openstack.org/341711 | 17:32 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: telemetry: add panko in telemetry integration job https://review.openstack.org/341712 | 17:32 |
| jeblair | fungi: shall i run the delete spam script now? | 17:33 |
| odyssey4me | fungi hmm, are you able to adjust my ACL accordingly? | 17:33 |
| odyssey4me | clarkb ^ | 17:33 |
| * anteaya is interested in how jeblair's delete spam script works | 17:34 | |
| jeblair | anteaya: the mechanics or the result? | 17:34 |
| anteaya | the result | 17:34 |
| jeblair | then i'll keep you posted :) | 17:34 |
| fungi | jeblair: i say go for it | 17:35 |
| anteaya | I did look at the patch mechanics, thanks for the comments, they help me | 17:35 |
| anteaya | jeblair: thank you | 17:35 |
| clarkb | odyssey4me: ya let me figure out how to ask chanserv nciely to do that | 17:35 |
| clarkb | fungi: ^ you don't have anyo opposition to that do you? | 17:35 |
| *** esker has joined #openstack-infra | 17:35 | |
| odyssey4me | thanks clarkb | 17:35 |
| odyssey4me | it'd be rather nice of something was automated to give PTL's in the governance repo ops in the appropriate IRC channels :p | 17:35 |
| clarkb | we do have a thing to do that but I think we decided to only manage the global ops with it | 17:36 |
| clarkb | jeblair: ^ do you recall why that was? | 17:36 |
| *** jamesmcarthur has quit IRC | 17:36 | |
| jeblair | clarkb: i think we wanted to be out of the business of managing individual channel ops, and let projects self-manage them | 17:37 |
| pleia2 | not sure why folks are asking me rather than mordred, but has the Q naming poll actually gone out yet? (I seem to only have the P one too) | 17:37 |
| fungi | odyssey4me: done. "Flags +efr were set on odyssey4me in #openstack-ansible." | 17:37 |
| clarkb | ah fungi si faster with reading chanserv help output than I am | 17:37 |
| odyssey4me | thanks fungi | 17:37 |
| odyssey4me | hahaha | 17:37 |
| *** PollyZ has joined #openstack-infra | 17:37 | |
| fungi | clarkb: that must be it, because i tried two different (wrong) commands before looking at the context help from chanserv | 17:38 |
| *** bhavik has quit IRC | 17:38 | |
| *** tosky has quit IRC | 17:38 | |
| jeblair | oh neat, autocommit is disabled by default now in python-mysqldb | 17:39 |
| fungi | huhwha? | 17:39 |
| anteaya | pleia2: I have not seen the Q poll myself | 17:39 |
| clarkb | is that the oracle one? | 17:39 |
| clarkb | I can enver keep all the mysql drivers straight | 17:39 |
| *** esker has quit IRC | 17:39 | |
| fungi | i guess after switching a lot of my stuff to pymysql i haven't noticed python-mysqldb behavior changes | 17:39 |
| jeblair | http://mysql-python.sourceforge.net/ | 17:40 |
| Shrews | jeblair: wait... mysql has transactions????? | 17:40 |
| jeblair | yeah, i chose python-mysqldb since it's system-installed | 17:40 |
| * Shrews throws out old mysql jokes | 17:40 | |
| jeblair | and i didn't feel like writing a puppet change :) | 17:40 |
| pleia2 | anteaya: thanks, at least we have another datapoint, the email to -dev the other day kinda left the status hanging | 17:40 |
| jeblair | Shrews: they're new! ;) | 17:40 |
| fungi | understandable | 17:40 |
| anteaya | clarkb: didn't your conversation last night in -neutron involve a discussion of missing tables? | 17:40 |
| clarkb | anteaya: yes but we don't use that driver anymore | 17:40 |
| clarkb | anteaya: I doubt it is related | 17:41 |
| anteaya | clarkb: currently I have storyboard jobs failing and it appears some tables disappeared | 17:41 |
| clarkb | (was also sqlite) | 17:41 |
| anteaya | http://logs.openstack.org/97/339297/2/check/gate-storyboard-python34-db/c165765/console.html | 17:41 |
| anteaya | oh | 17:41 |
| clarkb | oh I thought youwere implying it is related to new mysql-python | 17:41 |
| anteaya | pleia2: mordred? leaving status hanging? how out of character for him | 17:41 |
| *** trown is now known as trown|relocating | 17:41 | |
| anteaya | clarkb: ah sorry, got mixed up in the current conversation | 17:41 |
| clarkb | anteaya: ya was sqlite not mysql which is what failed in your log | 17:41 |
| anteaya | was trying to time my question and I chose poorly | 17:41 |
| anteaya | oh okay | 17:42 |
| anteaya | thank you | 17:42 |
| anteaya | what do I need to do | 17:42 |
| clarkb | you'd need to figure out why there is no db engine when that faikls | 17:42 |
| pleia2 | anteaya: hehe | 17:42 |
| anteaya | okey dokei | 17:42 |
| AJaeger | clarkb: thanks for the etherpad, let me comment | 17:42 |
| *** ddieterly[away] is now known as ddieterly | 17:43 | |
| *** PollyZ has quit IRC | 17:43 | |
| clarkb | jeblair: aiui pymysql aims to be api consistent when mysql-python so you should see that behavior in pymysql at some point too? | 17:43 |
| *** shashank_hegde has joined #openstack-infra | 17:43 | |
| *** karthikp_ has quit IRC | 17:44 | |
| AJaeger | clarkb: ah, you commented already on everything ;) Good! | 17:44 |
| *** maishsk has quit IRC | 17:44 | |
| *** maishsk_ has joined #openstack-infra | 17:44 | |
| *** rkukura has joined #openstack-infra | 17:44 | |
| clarkb | AJaeger: and grouped them by failure :) | 17:45 |
| *** karthikp_ has joined #openstack-infra | 17:45 | |
| *** esker has joined #openstack-infra | 17:45 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Commit transaction in delete-gerrit-spam https://review.openstack.org/341721 | 17:46 |
| jeblair | fungi, clarkb, Shrews: ^ | 17:46 |
| jeblair | i will run that now if it looks okay | 17:46 |
| *** dtardivel has quit IRC | 17:47 | |
| AJaeger | clarkb: indeed | 17:47 |
| fungi | jeblair: you have a typo | 17:47 |
| fungi | left a comment | 17:47 |
| Shrews | conut | 17:48 |
| Shrews | ah, yep | 17:48 |
| * fungi wants a cronut | 17:48 | |
| *** SumitNaiksatam has joined #openstack-infra | 17:48 | |
| Shrews | mmmm, cronuts.... | 17:48 |
| *** karthikp_ has quit IRC | 17:48 | |
| jeblair | fungi, clarkb, Shrews: also, what was i thinking in the middle section? we can just update those rows with "set parent_uuid=NULL where parent_uuid in (set of uuids)" | 17:48 |
| jeblair | rather than the iteration that's there... | 17:48 |
| fungi | jeblair: great point. no need to loop | 17:48 |
| fungi | i assume the set of uuids is unlikely to overrun whatever the max set size is for a mysql query string | 17:49 |
| *** maishsk_ has quit IRC | 17:49 | |
| Shrews | beats me. first time i've seen this code | 17:49 |
| Shrews | :) | 17:49 |
| fungi | Shrews: that probably makes you the fourth person to see it (besides its author) | 17:50 |
| *** rbrndt has quit IRC | 17:50 | |
| jeblair | i think its author may be seeing it for the first time | 17:50 |
| fungi | is it friday already? | 17:51 |
| *** PollyZ has joined #openstack-infra | 17:51 | |
| jeblair | it's always friday somewhere | 17:51 |
| *** sarob has joined #openstack-infra | 17:51 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Commit transaction in delete-gerrit-spam https://review.openstack.org/341721 | 17:52 |
| jeblair | fungi, clarkb, Shrews: ^ | 17:52 |
| *** PollyZ has quit IRC | 17:56 | |
| *** deadnull has joined #openstack-infra | 17:56 | |
| Shrews | jeblair: if you want all of that to be one large transaction (i have no idea how many rows that normally affects), then lgtm. otherwise, i bow to the opinion of those that know more about that code and db schema | 17:58 |
| *** yamamoto has joined #openstack-infra | 17:58 | |
| fungi | Shrews: it'll be one row per comment | 17:58 |
| fungi | depending on how enterprising the spammer might be, possibly a very large number | 17:58 |
| *** gordc has quit IRC | 17:59 | |
| jeblair | but for todays spammer, it's 2 | 17:59 |
| fungi | yeah, i assume they added those yesterday and are waiting to see if google or other search engines follow the link when recrawling review.o.o | 17:59 |
| Shrews | oh, it's deleting review comments. | 17:59 |
| jeblair | okay, i ran the script, it deleted the two rows, but the comments are still showing in the webui. i'm assuming we need a cache flush? | 18:00 |
| *** psilvad has joined #openstack-infra | 18:00 | |
| *** ddieterly is now known as ddieterly[away] | 18:00 | |
| fungi | jeblair: probably (hopefully it's not lucene) | 18:00 |
| jeblair | fungi: oh dear... comments are in lucene aren't they? but i would expect the result to be that you can still search on this text, but the comments won't actually display (once we flush the cache, hopefully?) | 18:01 |
| clarkb | jeblair: you can list all the caches to avoid stop.gerrit reset cache | 18:01 |
| fungi | yeah, force reloading it in my browser is definitely not clearing it | 18:01 |
| *** hashar has joined #openstack-infra | 18:01 | |
| jeblair | clarkb: yeah, i'm looking it up now | 18:01 |
| fungi | right, you can flush specific caches | 18:02 |
| jeblair | 'changes' looks the most promising | 18:02 |
| fungi | which given how it grinds to a halt while flushing all caches lately, might indicate we should be more selective ;) | 18:02 |
| *** yamamoto has quit IRC | 18:04 | |
| AJaeger | jeblair, could you review dhellmann's change https://review.openstack.org/#/c/341058/2/jenkins/jobs/release-jobs.yaml, please? I think this needs zuul-cloner - and runs in the post queue. Is it safe to test this now? | 18:04 |
| *** esker has quit IRC | 18:04 | |
| jeblair | fungi: there's a gerrit key you can ssh in as the superuser? | 18:04 |
| fungi | jeblair: there is! just a sec lemme get my notes | 18:05 |
| *** PollyZ has joined #openstack-infra | 18:05 | |
| *** esker has joined #openstack-infra | 18:05 | |
| Shrews | jeblair: ugh, 340597 might take me hours to comprehend | 18:05 |
| *** garyk has quit IRC | 18:05 | |
| fungi | jeblair: example http://paste.openstack.org/show/510692 | 18:05 |
| *** swat30 has quit IRC | 18:06 | |
| jeblair | Shrews: yeah, sorry. i had no idea where it was going when i started it, and it took a bit over a week to write. :( now that i understand it, i could probably redo it as a comprehensible series -- but before we do that, maybe it's worth trying to understand it in review comments (which might also suggest code comments). | 18:08 |
| *** swat30 has joined #openstack-infra | 18:08 | |
| AJaeger | pabelanger: https://review.openstack.org/#/c/340590/ depends-on a change that is abandoned | 18:08 |
| *** PollyZ has quit IRC | 18:09 | |
| *** pcaruana has joined #openstack-infra | 18:09 | |
| jeblair | fungi: got it thanks! | 18:10 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/system-config: Bump haproxy module version https://review.openstack.org/341737 | 18:10 |
| *** john-davidge has quit IRC | 18:10 | |
| *** Nikolay_St has joined #openstack-infra | 18:11 | |
| *** cody-somerville has joined #openstack-infra | 18:11 | |
| *** cody-somerville has joined #openstack-infra | 18:11 | |
| jeblair | fungi: "gerrit flush-caches --cache changes" returned quickly and seemed to have no effect | 18:11 |
| openstackgerrit | Merged openstack-infra/project-config: Add trailing slash to reprepro-import URL https://review.openstack.org/341690 | 18:12 |
| openstackgerrit | Merged openstack-infra/project-config: Add neutron-identity-v3-only-full-nv to Grafana for Neutron https://review.openstack.org/341691 | 18:12 |
| jeblair | fungi: i'm thinking of doing --all | 18:13 |
| *** dimtruck is now known as zz_dimtruck | 18:13 | |
| *** igorn has quit IRC | 18:13 | |
| *** hemanthm is now known as hemanthm|lunch | 18:14 | |
| jeblair | hrm | 18:14 |
| jeblair | (i haven't done --all yet) | 18:15 |
| jeblair | when i do an ssh query for the change, i don't get that back | 18:15 |
| *** ccamacho has quit IRC | 18:15 | |
| fungi | but i definitely still see it in the webui | 18:15 |
| fungi | even after another forced reload | 18:15 |
| fungi | i wonder if that's web_sessions or something | 18:16 |
| *** sambetts|cat is now known as sambetts | 18:16 | |
| *** sambetts is now known as sambetts|afk | 18:16 | |
| *** tidwellr1 has quit IRC | 18:18 | |
| *** mordred has joined #openstack-infra | 18:19 | |
| *** mrmartin has quit IRC | 18:19 | |
| *** EricGonczer_ has joined #openstack-infra | 18:20 | |
| *** hurgleburgler has quit IRC | 18:20 | |
| *** asettle has joined #openstack-infra | 18:21 | |
| fungi | yeah, loading 337598 in gertty that comment is gone, gone, goneski | 18:21 |
| fungi | so i think it's web caching | 18:21 |
| fungi | which hopefully is the web_sessions cache | 18:21 |
| AJaeger | ianw, berendt, could you review https://review.openstack.org/#/c/334883/ for gerrit-dash-creator, please? | 18:22 |
| anteaya | yay goneski comments | 18:23 |
| jeblair | fungi: i found the request that populates that, and it got a 204 | 18:23 |
| jeblair | fungi: flushing web_sessions logs everyone out | 18:24 |
| *** karthikp_ has joined #openstack-infra | 18:25 | |
| jeblair | fungi: on the plus side, the comment no longer appears. | 18:25 |
| *** asettle has quit IRC | 18:25 | |
| jeblair | (web_sessions is not included in '--all') | 18:25 |
| *** jamesmcarthur has joined #openstack-infra | 18:25 | |
| openstackgerrit | krozin proposed openstack-infra/project-config: Add openstack/mirantis-test-reporter project https://review.openstack.org/339549 | 18:26 |
| *** hurgleburgler has joined #openstack-infra | 18:26 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Disable locale stripping on centos https://review.openstack.org/341742 | 18:26 |
| fungi | oh, interesting | 18:27 |
| *** javeriak_ has quit IRC | 18:28 | |
| *** zz_dimtruck is now known as dimtruck | 18:28 | |
| openstackgerrit | krozin proposed openstack-infra/project-config: Add openstack/pipe-report project https://review.openstack.org/339549 | 18:28 |
| jeblair | i was going to add this command to the script so it's automatically run, but i'm not sure we've reached the minimally disruptive command. so i'm going to stop here, and we can add it after further experimenting. | 18:29 |
| *** rdx_matt has joined #openstack-infra | 18:29 | |
| fungi | i wonder if logging out and back in would have the same effect? in that case we may not need to flush anything besides changes since crawlers are presumably going to be using a separate session (are all anonymous sessions separate?) | 18:29 |
| clarkb | jeblair: so you had to fluish web sessions to get it cleared? | 18:30 |
| *** rdx_matt has quit IRC | 18:30 | |
| *** jamesmcarthur has quit IRC | 18:30 | |
| jeblair | clarkb: well, i did flush web_sessions and it did get cleared. i do not know if that was the only way for it to have happened. | 18:30 |
| clarkb | gotcha | 18:30 |
| jeblair | fungi: yeah, good question | 18:30 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Disable locale stripping on centos https://review.openstack.org/341742 | 18:30 |
| fungi | other possibilities are: new sessions don't see that comment, or the comment went away with time | 18:31 |
| fungi | greghaynes: did 341742 solve it? | 18:31 |
| fungi | greghaynes: oh, fun something new | 18:32 |
| *** rbrndt has joined #openstack-infra | 18:32 | |
| greghaynes | fungi: Nope, very similar but different bug that I am hitting when tryingo to build centos-minimal at all | 18:32 |
| greghaynes | fungi: btw, I have no idea how you all are able to build centos-minimal | 18:32 |
| fungi | yeah, that sounds gnarly | 18:32 |
| fungi | greghaynes: maybe we aren't? i haven't looked at the last upload times | 18:32 |
| fungi | greghaynes: are you trying from a trusty host system? maybe that's the difference | 18:33 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add tests for building *-minimal images https://review.openstack.org/181162 | 18:33 |
| greghaynes | fungi: ah, I am | 18:33 |
| greghaynes | fungi: what are you all running on? | 18:33 |
| fungi | same | 18:33 |
| greghaynes | hrm | 18:33 |
| fungi | we do have current centos-7 images, mere hours old | 18:34 |
| *** ccamacho has joined #openstack-infra | 18:34 | |
| greghaynes | very strange | 18:34 |
| clarkb | I thought I was going to test the nodepool mysql fix before lunch but the existing group based policy run is taking much longer than expected | 18:35 |
| fungi | greghaynes: could it be influenced by one of the other elements we're also including in our nodepool image config? | 18:35 |
| greghaynes | fungi: Yea, that seems like the mostly likely explanation, I wonder how early puppet runs in your image builds... | 18:35 |
| greghaynes | looks like after this | 18:36 |
| fungi | would looking at our successful image build logs help? | 18:36 |
| greghaynes | Ah, good idea | 18:37 |
| greghaynes | although I need a break, I just spent about 4hours debugging this | 18:37 |
| greghaynes | so, after lunch :) | 18:37 |
| fungi | greghaynes: http://nodepool.openstack.org/ has them when you're ready | 18:37 |
| *** Swami has joined #openstack-infra | 18:37 | |
| *** trown|relocating is now known as trown | 18:38 | |
| *** nadya has quit IRC | 18:38 | |
| openstackgerrit | Merged openstack-infra/system-config: Commit transaction in delete-gerrit-spam https://review.openstack.org/341721 | 18:39 |
| *** tonytan4ever has quit IRC | 18:40 | |
| *** Sukhdev has joined #openstack-infra | 18:42 | |
| *** edtubill has quit IRC | 18:43 | |
| *** kgiusti has left #openstack-infra | 18:43 | |
| dhellmann | AJaeger : that job runs when patches merge in openstack/releases. Does that mean I'm using the right git prep mechanism? | 18:45 |
| *** inc0 has quit IRC | 18:45 | |
| *** PollyZ has joined #openstack-infra | 18:45 | |
| *** adrian_otto has quit IRC | 18:47 | |
| AJaeger | dhellmann: yes, it's fine. I mixed that up. | 18:48 |
| AJaeger | dhellmann: commented already... | 18:48 |
| dhellmann | AJaeger : I see those now, thanks | 18:48 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: add job to apply tags when based on changes in openstack/releases https://review.openstack.org/341058 | 18:49 |
| clarkb | Shrews: your new zk test did not work for me on xenial. It timed out which I think means the connect in test_zk never succeeded | 18:49 |
| clarkb | Shrews: there is a zookeeper running | 18:49 |
| clarkb | Shrews: anything else I need to have this run? | 18:49 |
| *** akshai has quit IRC | 18:49 | |
| *** esker has quit IRC | 18:50 | |
| Shrews | clarkb: not sure. i test mine with a docker container running ZK | 18:50 |
| Shrews | NODEPOOL_ZK_HOST=127.0.0.1 tox -epy27 | 18:50 |
| *** PollyZ has quit IRC | 18:50 | |
| Shrews | i actually have tried the default zk stuff | 18:50 |
| clarkb | but thats not how jenkins is running it | 18:50 |
| clarkb | jenkins is just going to run tox -epy27 | 18:50 |
| Shrews | yep. it seems happy enough with it from what i can tell | 18:51 |
| *** gordc has joined #openstack-infra | 18:51 | |
| *** hrubi has quit IRC | 18:52 | |
| clarkb | Shrews: looking at the code this random port selection stuff isn't very good | 18:52 |
| clarkb | its has 30 second timeouts in a 60 second job which means it will only ever check one | 18:52 |
| *** PollyZ has joined #openstack-infra | 18:52 | |
| *** david-lyle has quit IRC | 18:53 | |
| esberglu | Anyone know a good way to extract the image id from nodepool image-list? Or an alternate way of getting that value? | 18:53 |
| clarkb | esberglu: its in the image-list | 18:53 |
| Shrews | clarkb: i blame jeblair! lol | 18:53 |
| *** esker has joined #openstack-infra | 18:53 | |
| *** mhickey has quit IRC | 18:54 | |
| esberglu | Yeah I mean how to *only* get that value. I’m trying to find a way to clean up stale nodepool images but don’t know how to get just the id to use for nodepool image-delete <id> | 18:54 |
| clarkb | Shrews: jeblair can we just start on port 0? | 18:54 |
| clarkb | esberglu: use cut | 18:54 |
| *** baoli has quit IRC | 18:54 | |
| clarkb | esberglu: nodepool image-list | cut -d'|' -f 2 or something | 18:55 |
| *** hrubi has joined #openstack-infra | 18:55 | |
| esberglu | Thanks | 18:55 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Configure a different port for httpd ipxe https://review.openstack.org/340339 | 18:56 |
| clarkb | oh I guess it does check every second within a 30 secound outer loop | 18:56 |
| clarkb | so we will try two ports I think | 18:56 |
| *** ociuhandu has quit IRC | 18:57 | |
| Shrews | clarkb: have you verified that your zk does, indeed, start on that port? | 18:57 |
| Shrews | wondering if it just takes a while to get going | 18:57 |
| *** edtubill has joined #openstack-infra | 18:57 | |
| *** esker has quit IRC | 18:58 | |
| *** rdx_matt has joined #openstack-infra | 18:58 | |
| *** sdake has quit IRC | 18:58 | |
| clarkb | Shrews: well now I am thinking that the zookeerper that is running isn't the nodepool process. As I now realize we build an entire config and start a new process completely from scratch here | 18:58 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Test zuul-cloner in post queue https://review.openstack.org/341751 | 18:58 |
| AJaeger | jeblair: is this change safe to test? ^ | 18:58 |
| clarkb | oh wait no I see the nodepool one, looks like it leaked? | 18:59 |
| *** gouthamr has quit IRC | 18:59 | |
| *** mordred has quit IRC | 18:59 | |
| *** gouthamr has joined #openstack-infra | 18:59 | |
| clarkb | ya the process is still running but the tmp dir with the config and logs is gone so I can't actually check those | 18:59 |
| *** elo has joined #openstack-infra | 18:59 | |
| clarkb | Shrews: I will retry it using the system default one once the test run is complete and see if it fails then | 18:59 |
| AJaeger | fungi, jeblair, Nakato : With Nakato's change for zuul-cloner now in the images (hope also uploaded), I'd like to test that we can really use zuul-cloner and constraints in post-queue. Please review 341751 and figure out whether that should work as a test case. | 19:00 |
| Shrews | clarkb: i don't like having to install zk on my own system (which is why i haven't tried the default path), but just use the NODEPOOL_ZK_HOST var to point to the one you already have running | 19:00 |
| *** yamamoto has joined #openstack-infra | 19:00 | |
| *** baoli has joined #openstack-infra | 19:01 | |
| jeblair | clarkb: the change to add zk testing did sit in review for 4 months :( | 19:01 |
| clarkb | jeblair: Shrews: ya I don't see a cleanup to stop the running zk processes | 19:01 |
| clarkb | so that explains the extra processes. I think I grok this now and it likely juist failed to come up because its on a single cpu test instance | 19:01 |
| *** mrmartin has joined #openstack-infra | 19:01 | |
| clarkb | so java is slow to start, we assume the port wasn't valid and try again then test times out | 19:02 |
| jeblair | clarkb: there is a shutdown cleanup... | 19:02 |
| clarkb | jeblair: it semes to only delete the data in zk not stop the process? | 19:02 |
| jeblair | "self.zookeeper_process.kill()" | 19:02 |
| clarkb | so init takes over and it hangs out | 19:02 |
| clarkb | jeblair: only if the port is found | 19:02 |
| clarkb | which it wasn't | 19:03 |
| *** trown is now known as trown|mtg | 19:03 | |
| jeblair | clarkb: ah | 19:03 |
| jeblair | clarkb: where are you running this? | 19:03 |
| clarkb | jeblair: on a VM on my desktop using a locally built copy of our ubuntu xenial iamge | 19:03 |
| Shrews | there is a p.kill() if the port is not found | 19:03 |
| Shrews | so i don't get that | 19:04 |
| clarkb | Shrews: that doesn't appaer to have been sufficient | 19:04 |
| clarkb | for making sure xenial works I can just have it use the system zk and we can sort out fixture reliability later | 19:05 |
| *** akshai has joined #openstack-infra | 19:05 | |
| *** rdx_matt has quit IRC | 19:05 | |
| clarkb | but I am guessing single cpu vm + java is the root of the sadness | 19:05 |
| jeblair | clarkb: there's also a p.wait(). was the test process interrupted during that? | 19:05 |
| clarkb | jeblair: maybe by the timeout fixture | 19:05 |
| *** yamamoto has quit IRC | 19:05 | |
| clarkb | since it uses sigalarm iirc | 19:05 |
| jeblair | clarkb: so you don't know what it was doing at the point of timeout? | 19:06 |
| clarkb | no | 19:06 |
| Shrews | clearly the fix is to just rewrite zk in c++ | 19:06 |
| jeblair | i love that | 19:06 |
| clarkb | there is no logging in there | 19:06 |
| clarkb | and the logs I do have were deleted | 19:06 |
| jeblair | clarkb: notmorgan has done some work to get logging from test timeouts in zuul | 19:07 |
| clarkb | oh we have logs, we don't have logs from that fixture | 19:07 |
| jeblair | anyway, i'm going to go get lunch so i can come back and write more not good code | 19:07 |
| clarkb | there is a lot of gear client can't connect because we don't setup a gear server in that test I don't think | 19:07 |
| notmorgan | jeblair: o/ | 19:07 |
| *** pilgrimstack has joined #openstack-infra | 19:08 | |
| asselin__ | rcarrillocruz, I'm now running the remote puppet play but it's not finding any modules. How is that set? I see this setting, but that doesn't include the openstack module. http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/puppet.conf.erb#n6 | 19:09 |
| clarkb | jeblair: Shrews notmorgan is there any reason we shouldn't just do what we do with the db fixtures? use a preexisting service and avoid starting something completely from scratch? | 19:09 |
| notmorgan | for.. zk? i'm catching up on backscroll | 19:09 |
| clarkb | seems like thats how local dev is being done anyways | 19:09 |
| jeblair | clarkb: this *is* what we would do with the db fixtures f we could | 19:09 |
| clarkb | yes for zk | 19:09 |
| jeblair | we actually talked about using drizzle at one point specifically because we could start it as a user process | 19:10 |
| jeblair | the fact that we can run the unit tests using zookeeper without requiring zookeeper running as a system process is *great* | 19:10 |
| *** esker has joined #openstack-infra | 19:10 | |
| clarkb | I like it in theory but it isn't working and if 30 seconds isn't sufficient to start it we are increasing the test run time for every test that uses this by that amount | 19:11 |
| clarkb | thats a really high overhead | 19:11 |
| notmorgan | so the lack of logs is sigalrm issue | 19:12 |
| notmorgan | at 30s | 19:12 |
| clarkb | notmorgan: 60s in this case but yes | 19:12 |
| notmorgan | and that is a deep issue involving subuniut, unittests, and output redirect | 19:12 |
| notmorgan | i've spent at least a week on it. | 19:12 |
| notmorgan | at the very least we can capture output in console for the test itself that failed, which helps us know what is going on | 19:12 |
| notmorgan | with a patch. | 19:13 |
| notmorgan | but getting it into subunit data is more difficult | 19:13 |
| jeblair | clarkb: it works for me, and it works in the gate. i guess we can discuss whether we want to design it for a 1-cpu vm -- but any testing that has hardcoded timeouts is going to have to have a performance floor | 19:13 |
| clarkb | yup I can accept that my instance isn't performant enough. But its also worth makign sure we don't introduce a significant overhead for (potentially) hudnreds of tests | 19:14 |
| *** edtubill has quit IRC | 19:14 | |
| *** xarses has quit IRC | 19:14 | |
| *** kzaitsev_mb has quit IRC | 19:14 | |
| notmorgan | is it really 60s+ slow? | 19:14 |
| *** esker has quit IRC | 19:15 | |
| *** xarses has joined #openstack-infra | 19:15 | |
| jeblair | the 30 secound bound on connection was meant to be exceptionally high | 19:15 |
| notmorgan | thst seems very/excessively slow for a fixture. | 19:15 |
| *** jed56 has quit IRC | 19:15 | |
| clarkb | notmorgan: on my local test instance the test times out presumably due to zk not coming up within the 30s test in the fixture | 19:15 |
| jeblair | like, it should start up and accept within seconds | 19:15 |
| *** mrmartin has quit IRC | 19:15 | |
| notmorgan | jeblair: ++ | 19:15 |
| clarkb | (I don't actually have logs directly confirming that) | 19:15 |
| notmorgan | clarkb: hold on | 19:15 |
| clarkb | (due to the sigalrm and the deletion of the tmp dir at fail of test) | 19:15 |
| jeblair | if running 4+ of these is a problem, we can also rework this to use a single zookeeper with a per-test prefix | 19:15 |
| jeblair | of course, that's not at play on clarkb's machine | 19:16 |
| *** hemanthm|lunch is now known as hemanthm | 19:16 | |
| notmorgan | can you apply something like https://review.openstack.org/#/c/328516/ to the fixture that is timeout | 19:16 |
| *** esker has joined #openstack-infra | 19:17 | |
| beisner | hi all - i'm getting cloudflare 522s on https://www.openstack.org/summit/barcelona-2016 - is there a known issue? | 19:17 |
| notmorgan | [use a fixture like that instead of the default] | 19:17 |
| notmorgan | it shiould at least give you output for the test and see if there is something more than just slow startup happening | 19:17 |
| *** edtubill has joined #openstack-infra | 19:17 | |
| notmorgan | which might be actually the case when not multi-core/cpu | 19:17 |
| notmorgan | [oddly] | 19:18 |
| *** mrmartin has joined #openstack-infra | 19:18 | |
| notmorgan | i mean, also, we can move on and not look at the 1-cpu vm. | 19:18 |
| clarkb | I do get logging fwiw but its from other portions of code | 19:18 |
| clarkb | let me copy pasta | 19:19 |
| notmorgan | ok | 19:19 |
| *** hashar is now known as hasharAway | 19:19 | |
| *** nadya has joined #openstack-infra | 19:19 | |
| rcarrillocruz | asselin__: what's the openstack module? | 19:19 |
| notmorgan | jeblair: a single zk with per-test prefix might make a lot more sense. | 19:19 |
| notmorgan | jeblair: since it should be lower overall overhead/startup/shutdown | 19:19 |
| asselin__ | rcarrillocruz, http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/ | 19:19 |
| Shrews | notmorgan: jeblair: each test is already chroot'd to it's own zk path | 19:20 |
| *** inc0 has joined #openstack-infra | 19:20 | |
| notmorgan | Shrews: right, be wary, i hear chroot is... not as reliable as it appears to be at face value | 19:20 |
| jeblair | clarkb: on my machine: Ran 1 test in 1.205s | 19:20 |
| notmorgan | Shrews: or i think harlowja implied that. | 19:20 |
| Shrews | notmorgan: i'd be interested in details on that | 19:21 |
| Shrews | b/c i've been using the heck out of it | 19:21 |
| fungi | beisner: jpmaxman might be aware of whatever the situation is regarding cloudflare 522 error responses for https://www.openstack.org/summit/barcelona-2016 though i'm not getting them so presumably it's just at some places in that cdn | 19:21 |
| *** pilgrimstack has quit IRC | 19:21 | |
| notmorgan | Shrews: harlowja is the person to confirm with :). i didn't do as much digging, but i think it comes down to not everything respects the chroot in the same way | 19:21 |
| beisner | hi fungi - appears to have just been a moment. she's back. thx. | 19:21 |
| harlowja | whats zookeeper | 19:22 |
| harlowja | lol | 19:22 |
| harlowja | is that java | 19:22 |
| notmorgan | Shrews: but hey if it works, yay | 19:22 |
| *** pilgrimstack has joined #openstack-infra | 19:22 | |
| notmorgan | harlowja: oh thats right... sory... uhm... j.a.v.a it's a thing with a weird license. | 19:22 |
| notmorgan | harlowja: ;) | 19:22 |
| *** sdake has joined #openstack-infra | 19:22 | |
| clarkb | http://paste.openstack.org/show/532119/ | 19:22 |
| clarkb | notmorgan: ^ | 19:22 |
| rcarrillocruz | asselin__: that's evaluated via the environement | 19:23 |
| notmorgan | clarkb: right | 19:23 |
| clarkb | line 201 in that traceback is the wait for it to start loop that is 30s long | 19:23 |
| notmorgan | clarkb: we're using soft fails then | 19:23 |
| notmorgan | which is good. | 19:23 |
| clarkb | so that implies we failed once, and reentered the loop to try again | 19:23 |
| fungi | harlowja: you know you want to help with zk debugging ;) | 19:23 |
| rcarrillocruz | if you check /etc/puppet/environments/production/environment.conf on any infra node | 19:23 |
| notmorgan | not siglarm | 19:23 |
| rcarrillocruz | it shows: | 19:23 |
| rcarrillocruz | rcarrillocruz@review:/etc/puppet/environments/production$ cat environment.conf | 19:23 |
| rcarrillocruz | manifest = /opt/system-config/production/manifests/site.pp | 19:23 |
| rcarrillocruz | modulepath = $basemodulepath:modules:/opt/system-config/production/modules | 19:23 |
| notmorgan | cool, no need to patch the fixture then | 19:23 |
| clarkb | but since the total test time timeout is == 2x that loop we effectively only try the one time | 19:23 |
| rcarrillocruz | the modulepath is what is used | 19:23 |
| notmorgan | right | 19:24 |
| clarkb | is what I think is happening | 19:24 |
| rcarrillocruz | and you can see system-config is defined there | 19:24 |
| clarkb | and theory is its slow becase 1 cpu + java | 19:24 |
| rcarrillocruz | so openstack_project module can be found | 19:24 |
| notmorgan | yah. that is my guess too =/ | 19:24 |
| asselin__ | rcarrillocruz, ok thanks for the insight. | 19:24 |
| harlowja | fungi ummm, sure | 19:24 |
| rcarrillocruz | asselin__: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/puppet/production_environment.conf | 19:24 |
| *** kgiusti has joined #openstack-infra | 19:24 | |
| rcarrillocruz | it's a file, not a template in infra case | 19:24 |
| clarkb | notmorgan: but the zk logs go away as soon as that test fails so I can't look at the zk side | 19:24 |
| harlowja | https://github.com/rgs1/zk_shell is your friend | 19:25 |
| rcarrillocruz | that gets deployed by puppetry code on nodes | 19:25 |
| *** mrmartin has quit IRC | 19:25 | |
| *** esker has quit IRC | 19:25 | |
| notmorgan | clarkb: ahhh. hm. hack out the "delete dir" ;) for this moment. | 19:25 |
| asselin__ | yeah...no reason not to use the same. will debug why it's not there. thanks | 19:25 |
| clarkb | notmorgan: next step is likely run with a really long test timeout, preserve the tmp dir and rerun | 19:25 |
| clarkb | notmorgan: ya still waiting for other tests to complete and will do that next | 19:25 |
| * notmorgan nods | 19:25 | |
| Shrews | harlowja: omg. that would have saved me so much scripting | 19:25 |
| harlowja | :-P | 19:25 |
| Shrews | (and will going forward) | 19:26 |
| AJaeger | harlowja: there're a lot of changes to make python3.5 voting all over oslo - could you or another core bless them, please? I'm reluctant to +2 them en mass without extra review from the project | 19:26 |
| notmorgan | Shrews: see we summon harlowja and poof. | 19:26 |
| harlowja | AJaeger yup yup | 19:26 |
| harlowja | Shrews ya, zk_shell uses kazoo internally and probably does what u just scripted, lol | 19:26 |
| Shrews | harlowja: notmorgan was warning my about chroot not working as expected. any insight there? seems to work fine for me so far | 19:27 |
| Shrews | s/my/me/ | 19:27 |
| *** dizquierdo has joined #openstack-infra | 19:27 | |
| rcarrillocruz | jeblair , Shrews , notmorgan , jhesketh : is there a list of pending tasks for zuul v3? maybe a kanban board in storyboard? | 19:27 |
| jeblair | clarkb: i think that even with 1cpu, it should not take 30 seconds to start. are you certain that the process is starting? or perhaps there's something different in xenial. | 19:27 |
| harlowja | welll chroot is sorta shitty chroot | 19:27 |
| rcarrillocruz | would like to help and look for things i can help with | 19:27 |
| harlowja | if that's ok with u, then it probably should be fine :-P | 19:27 |
| *** rbrndt has quit IRC | 19:27 | |
| clarkb | jeblair: I know the process started because it is still running | 19:27 |
| jeblair | rcarrillocruz: i would like that too, but i can't help at the moment | 19:28 |
| jeblair | rcarrillocruz: i will get back to you soon | 19:28 |
| rcarrillocruz | sure, thx | 19:28 |
| clarkb | jeblair: I do not know if xenial produces a functional zk beyond knowing that the other tests that use the system zk seem to have worked (eg tooz) | 19:28 |
| *** deadnull has quit IRC | 19:28 | |
| *** edtubill has quit IRC | 19:28 | |
| *** ddieterly[away] is now known as ddieterly | 19:29 | |
| *** rbrndt has joined #openstack-infra | 19:30 | |
| Shrews | fwiw, i'm fine if someone wants to tackle the "install system zk and kill per-test zk start" issue | 19:30 |
| jeblair | Shrews: i don't understand | 19:30 |
| clarkb | notmorgan: it does look like the zk thing is the only nodepool fail I run into after applying your mysql patch. Did you see my response to your and ianw's conversation on that change? | 19:30 |
| Shrews | jeblair: it was suggested we might want to use a single zk process | 19:31 |
| clarkb | Shrews: right I suggested it because its apparently how you are doing your dev anyways | 19:31 |
| *** dprince has joined #openstack-infra | 19:32 | |
| clarkb | (using the env var when running the unittests) | 19:32 |
| *** edtubill has joined #openstack-infra | 19:32 | |
| jeblair | Shrews: oh, i suggested that was a possibility, but i don't want to do it. i want the test runner to start it | 19:32 |
| jeblair | clarkb: that is how *Shrews* is doing *his* dev. it is not the only way. | 19:32 |
| *** tbachman has joined #openstack-infra | 19:34 | |
| jeblair | Shrews wants to use a running zookeeper, i do not. both approaches are fine and what we have now works for both, and works in the gate. | 19:34 |
| * tbachman looks for clarkb | 19:34 | |
| Shrews | my dev is lazy dev. probably best not to model anything after me | 19:34 |
| clarkb | tbachman: a bit busy at the moment but around | 19:34 |
| *** jamesmcarthur has joined #openstack-infra | 19:34 | |
| *** edmondsw has joined #openstack-infra | 19:34 | |
| tbachman | clarkb: hopefully quick. Are there any differences in the test instances with the new OS and the old (e.g. memory footprint, # cores) | 19:35 |
| tbachman | clarkb: this is in the context of the failing GBP tests | 19:35 |
| *** pcaruana has quit IRC | 19:35 | |
| *** jamesmcarthur has quit IRC | 19:36 | |
| *** jamesmcarthur has joined #openstack-infra | 19:36 | |
| clarkb | notmorgan: jeblair Shrews I have a run with test timeout set to 6000 and the loop to find a working port counting to 3000 and the tmpdir created directly so it won't be deleted | 19:36 |
| tbachman | just trying to rule out any change in the platform running the tests, other than OS | 19:36 |
| clarkb | now to just check that the port is free and should get found | 19:36 |
| clarkb | tbachman: yes I have explained many times in the neutron channel that I am using a single vcpu so the tests run serially | 19:37 |
| zigo | pabelanger: I was thinking, the repo you've created isn't signed. What's the plan here? | 19:37 |
| clarkb | tbachman: otherwise it should be almost an exact match, using images built by infra dib elements and 8GB of ram | 19:37 |
| tbachman | ah, sorry. Was actually more interested in memory. | 19:37 |
| *** Rockyg has quit IRC | 19:37 | |
| clarkb | tbachman: memory is the same 8GB | 19:37 |
| tbachman | clarkb: thx! | 19:37 |
| *** pilgrimstack has quit IRC | 19:37 | |
| zigo | pabelanger: The way to do it is just to sign the Release file. | 19:38 |
| jeblair | clarkb: i'm pretty sure this is a xenial problem | 19:38 |
| asselin__ | rcarrillocruz, so infra doesn't use puppet-puppet anymore...nice | 19:38 |
| zigo | For example http://ftp.fr.debian.org/debian/dists/sid/InRelease | 19:38 |
| zigo | http://ftp.fr.debian.org/debian/dists/sid/Release.gpg | 19:38 |
| rcarrillocruz | nope, that was created by yolanda , i believe that was ditched when the puppetmasterless move | 19:38 |
| zigo | The InRelease is the new way, the signature in Release.gpg makes it non-atomic. | 19:39 |
| asselin__ | rcarrillocruz, yeah, makes sense. Explains how much stuff has changed. | 19:39 |
| jeblair | clarkb: the log line that the test fixture looks for in the zookeeper log to decide that it is up and runnning has changed in the zookeeper version in xenial | 19:40 |
| fungi | pabelanger: zigo: also we should be able to have jobs use the signing node to pgp-sign files with our infra key now. all the bits are there, i just haven't written any jobs to use it yet | 19:40 |
| clarkb | jeblair: dose that mean its trying to start on the default zk port and failing due to system zk? | 19:41 |
| jeblair | clarkb: no, it literally just means that the log format has changed because it's a different version of zookeeper | 19:41 |
| clarkb | oh on the log not config side | 19:41 |
| fungi | pabelanger: zigo: hoping to have an example job (for detached tarball signatures) proposed before the end of this week | 19:41 |
| jeblair | clarkb: you will likely find that it starts in about a second, just like it does on my machine and in the gate | 19:41 |
| zigo | fungi: Cool ! | 19:41 |
| jeblair | clarkb: the 30 second timeout is, as i said earlier, *exceedingly* generous | 19:41 |
| clarkb | ya the process is definitely starting ebcause init reparents it | 19:42 |
| zigo | fungi: Do you have time to review the last 2 patches from Paul ? https://review.openstack.org/#/c/341624/ https://review.openstack.org/#/c/341628/ | 19:42 |
| *** qwang has joined #openstack-infra | 19:42 | |
| jeblair | clarkb: even on a very slow machine, it should be able to try 30 random ports before timeout | 19:42 |
| *** e0ne has quit IRC | 19:43 | |
| clarkb | 2016-07-13 19:43:05,115 - INFO [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:43781 happens around a second after log starts | 19:43 |
| fungi | AJaeger: any idea what's with the failure on 341751? | 19:44 |
| fungi | zigo: yep, taking a look now | 19:44 |
| clarkb | jeblair: would you be opposed to adjusting that generous window to say 15 seconds so that multiple retries can be attempted should there be a port conflict? | 19:44 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Fix zk startup detection https://review.openstack.org/341771 | 19:45 |
| jeblair | clarkb: ^ | 19:45 |
| fungi | pabelanger: do you need to do any after-the-fact cleanup once 341624 lands | 19:45 |
| fungi | ? | 19:45 |
| jeblair | clarkb: if there is a port conflict, it will still fail quickly | 19:45 |
| *** Apoorva has quit IRC | 19:45 | |
| jeblair | clarkb: it looks for a collision as well. so that should only take 1 second to find | 19:45 |
| jeblair | clarkb: hitting the 30 second timeout is truly pathological | 19:46 |
| clarkb | ok | 19:46 |
| jeblair | Shrews: https://review.openstack.org/341771 as well | 19:46 |
| AJaeger | fungi: "File Not Found" | 19:46 |
| AJaeger | fungi: So, something went wrong in CI IMHO | 19:47 |
| fungi | AJaeger: yeah, i noticed that too | 19:47 |
| clarkb | the other bit is to fix killing it when we do fail. Let me see if I can get that to work on this | 19:47 |
| AJaeger | fungi,I'm tired, please have patience with me. | 19:47 |
| fungi | AJaeger: hopefully, yes. i'll see if i can track it down in a bit, though a broken publisher can potentially cause that i think | 19:47 |
| AJaeger | fungi: that's on the job I changed, so something went wron. | 19:47 |
| *** edtubill has quit IRC | 19:48 | |
| *** ddieterly is now known as ddieterly[away] | 19:49 | |
| AJaeger | fungi: I don't understand why my change would not work in the job, let's see what happens... | 19:49 |
| AJaeger | fungi, if this is reproduceable, any help is welcome! | 19:50 |
| Shrews | jeblair: should we look for both? or is the new string alone sufficient? | 19:51 |
| jeblair | Shrews: new string is ok -- tested it locally | 19:52 |
| clarkb | ok I understand why we don't cleanup that process on timeout. The timeout is happening in the loop before we fall through the to direct kill | 19:52 |
| clarkb | so we need to make that a cleanup regardless which should fire when the test exits | 19:52 |
| *** ddieterly[away] is now known as ddieterly | 19:52 | |
| openstackgerrit | Merged openstack-infra/system-config: Update debian-openstack to use jessie-newton https://review.openstack.org/341624 | 19:52 |
| *** edtubill has joined #openstack-infra | 19:53 | |
| * clarkb tests this | 19:53 | |
| jeblair | clarkb: yeah, i think that will work | 19:53 |
| jeblair | clarkb: more or less just remove all the conditionality around "found_port" | 19:53 |
| clarkb | ya | 19:53 |
| *** inc0 has quit IRC | 19:53 | |
| clarkb | and turn it into a cleanup | 19:53 |
| jeblair | clarkb: you can use the one already there -- just add it before the loop, and put an "if self.zookeeper_process is not None" in it | 19:54 |
| *** sshnaidm is now known as sshnaidm|afk | 19:54 | |
| jeblair | we still need the in-loop kill though to handle the normal failure case | 19:56 |
| clarkb | ya | 19:56 |
| *** igorn has joined #openstack-infra | 19:56 | |
| clarkb | the only thing is that may race with multiple kills and if some other process gets that pid (very unlikely) could be not so good | 19:56 |
| *** sdake has quit IRC | 19:57 | |
| JayF | Very simple requirements update for ironic-lib (only used by ironic + ipa), no constraints changes, if someone has a chance to review I'd appreciate it: https://review.openstack.org/#/c/341743/ | 19:59 |
| *** dangers_away has quit IRC | 19:59 | |
| clarkb | JayF: requirements team has coalesced into its own thing now (which is great) you'll probably have better luck pinging them directly in #openstack-requirements | 20:00 |
| *** karthikp_ has quit IRC | 20:00 | |
| JayF | clarkb: will-do, ty | 20:00 |
| *** karthikp_ has joined #openstack-infra | 20:00 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Make ZK cleanup more resilient https://review.openstack.org/341784 | 20:00 |
| jeblair | clarkb, Shrews: ^ 2 fixes in that | 20:00 |
| *** rdx_matt has joined #openstack-infra | 20:01 | |
| *** rdx_matt has quit IRC | 20:01 | |
| *** yamamoto has joined #openstack-infra | 20:02 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Make ZK cleanup more resilient https://review.openstack.org/341784 | 20:02 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Perform a booting test for our images https://review.openstack.org/204639 | 20:03 |
| jeblair | clarkb, Shrews: update handles the possibility of the cleanup being called immediately after an in-loop kill | 20:03 |
| *** psilvad has quit IRC | 20:03 | |
| *** psilvad has joined #openstack-infra | 20:03 | |
| jeblair | now i'm really going to lunch | 20:03 |
| *** yohoffman_ has quit IRC | 20:03 | |
| clarkb | I am running the first one locally where it was failing to kill (but without its parent patch) | 20:03 |
| *** _ari_ has quit IRC | 20:03 | |
| jpmaxman | fungi mordred I was going to go ahead and submit a patch for the wiki settings file. I had a quick question if you have a moment... | 20:04 |
| *** garyk has joined #openstack-infra | 20:04 | |
| fungi | jpmaxman: i am at your disposal | 20:04 |
| jpmaxman | thanks! So, it looks like you pull the question answer for questy from a key value pair | 20:05 |
| jpmaxman | #<% @wg_captchaquestions.each do|key, val| -%> | 20:05 |
| jpmaxman | # "<%= key %>" => "<%= val %>", | 20:05 |
| jpmaxman | #<% end -%> | 20:05 |
| jpmaxman | I'm guessing you are going to want to do the same thing | 20:05 |
| jpmaxman | for the public private key | 20:06 |
| jpmaxman | $wgReCaptchaPublicKey | 20:06 |
| jpmaxman | $wgReCaptchaPrivateKey | 20:06 |
| jpmaxman | for recaptcha | 20:06 |
| clarkb | hrm that didn't work /me tries again | 20:06 |
| fungi | jpmaxman: ahh, yes we can embed that as a templated value in the config | 20:06 |
| fungi | jpmaxman: i'm happy to help iterate on what that looks like in puppet once you have a rough version proposed, and can also insert the needed keys into hiera | 20:07 |
| *** dangers_away has joined #openstack-infra | 20:07 | |
| *** yamamoto has quit IRC | 20:07 | |
| clarkb | it uses ruby's erb template language if you want docs for the syntax | 20:08 |
| anteaya | clarkb: the error I am seeing about no attribute 'engine' is limited to storyboard and there was a new migration merged in the last day or so, I'm thinking the new migration might be playing a role in the error | 20:08 |
| jpmaxman | yup makes sense, so I'm not familiar with hiera - can I just say something like: $wgReCaptchaPrivateKey = @wg_recaptchaprivatekey | 20:08 |
| jpmaxman | and then you can put those values in hiera? | 20:09 |
| openstackgerrit | Yaroslav Lobankov proposed openstack-infra/project-config: Add openstack/pipe-report project https://review.openstack.org/339549 | 20:09 |
| fungi | jpmaxman: clarkb: right. and in the recaptcha keys situation, we don't need to loop over an array. just template a couple of lines of config with some made up variable names which we'll plumb through from our system-config repo with corresponding keys in hiera | 20:09 |
| *** jamesmcarthur has quit IRC | 20:09 | |
| clarkb | jeblair: fwiw local testing of that patch isn't working, still see the zk get reparented to init (I wget'd the gerrit zip file, unzipped, and git applied it to avoid pulling in the fix for xenial) | 20:09 |
| AJaeger | fungi, in 341751 the specs-site job failed again to upload anything ;( | 20:10 |
| clarkb | jeblair: was it working for you? | 20:10 |
| AJaeger | fungi: And I missed to attach to telnet in time ;( | 20:10 |
| *** adrian_otto has joined #openstack-infra | 20:10 | |
| fungi | AJaeger: bummer. i'll see if i can hunt down which launcher was responsible and check logs for that job | 20:11 |
| jpmaxman | $wgReCaptchaPrivateKey = <%= @wg_recaptchaprivatekey %>; | 20:11 |
| jpmaxman | ? | 20:11 |
| AJaeger | thanks, fungi | 20:11 |
| *** sdake_ has joined #openstack-infra | 20:11 | |
| *** yolanda has quit IRC | 20:11 | |
| fungi | jpmaxman: that looks right, yes | 20:12 |
| *** nadya has quit IRC | 20:12 | |
| fungi | jpmaxman: for "we're just making up the variable name on the spot anyway" interpretations of "right" | 20:12 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Allow setting per-release mirrors for tests https://review.openstack.org/279691 | 20:12 |
| *** cody-somerville has quit IRC | 20:14 | |
| *** pstack has quit IRC | 20:15 | |
| *** gordc has quit IRC | 20:15 | |
| *** kgiusti has left #openstack-infra | 20:15 | |
| *** markusry has quit IRC | 20:15 | |
| AJaeger | fungi, this was the change I wanted to see in that caused the nova discussion: https://review.openstack.org/#/c/335808/ | 20:15 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Split pip out of pip-and-virtualenv https://review.openstack.org/311651 | 20:16 |
| *** trown|mtg is now known as trown | 20:16 | |
| *** tonytan4ever has joined #openstack-infra | 20:17 | |
| *** kzaitsev_mb has joined #openstack-infra | 20:17 | |
| jpmaxman | hah - ok - | 20:17 |
| *** edtubill has quit IRC | 20:18 | |
| jpmaxman | so hiera that's on your end right? I mean I can't put those values in.. | 20:18 |
| jpmaxman | it's fine if that's the case just trying to understand | 20:19 |
| fungi | jpmaxman: correct. that's so that we don't disclose sensitive credentials in public revision control | 20:19 |
| anteaya | jpmaxman: are you familiar with the tools http://paste.openstack.org/ and https://etherpad.openstack.org/ ? they often can be helpful when needing to share code snippets for discussion | 20:19 |
| *** trown is now known as trown|outtypewww | 20:21 | |
| AJaeger | project-config cores, we have quite a few open changes, please help with getting a few in. | 20:21 |
| * AJaeger waves good bye | 20:22 | |
| *** edtubill has joined #openstack-infra | 20:22 | |
| *** raildo has quit IRC | 20:22 | |
| anteaya | have a good evening AJaeger | 20:22 |
| fungi | AJaeger: have a good evening. i'll update 341751 with a comment based on what i manage to dig out of teh launcher logs | 20:22 |
| AJaeger | thanks, fungi and anteaya | 20:23 |
| *** garyk has quit IRC | 20:23 | |
| openstackgerrit | Chris Spencer proposed openstack-infra/project-config: add craton project https://review.openstack.org/332470 | 20:25 |
| openstackgerrit | Merged openstack-infra/project-config: Append branch to reprepro codename https://review.openstack.org/341628 | 20:27 |
| *** garyk has joined #openstack-infra | 20:27 | |
| *** cody-somerville has joined #openstack-infra | 20:28 | |
| *** piet has quit IRC | 20:28 | |
| *** rfolco has quit IRC | 20:28 | |
| *** rfolco has joined #openstack-infra | 20:29 | |
| *** rdx_matt has joined #openstack-infra | 20:29 | |
| pabelanger | zigo: fungi: back now, catching up | 20:30 |
| *** julim has quit IRC | 20:30 | |
| zigo | pabelanger: Your patches are merged! :) | 20:30 |
| *** xgerman has quit IRC | 20:30 | |
| *** mdrabe_ has joined #openstack-infra | 20:31 | |
| *** xgerman has joined #openstack-infra | 20:31 | |
| zigo | They just did. | 20:31 |
| zigo | pabelanger: Should I attempt another merge in deb-openstack-pkg-tools? | 20:31 |
| pabelanger | zigo: not yet, I need to do something to our AFS volume | 20:31 |
| pabelanger | 1 se | 20:31 |
| pabelanger | 1sec* | 20:31 |
| zigo | pabelanger: Ok, let me know. | 20:31 |
| pabelanger | zigo: 30mins likely | 20:32 |
| zigo | pabelanger: No worries, I'm preparing Newton b2 depends! :) | 20:32 |
| zigo | I've been doing so all week ... | 20:32 |
| *** mdrabe has quit IRC | 20:33 | |
| jpmaxman | anteaya - yes - I was going to pastebin, but it was only three lines so I felt it was borderline ;) | 20:34 |
| *** ddieterly is now known as ddieterly[away] | 20:35 | |
| *** clenimar__ has joined #openstack-infra | 20:35 | |
| jpmaxman | ok fungi - about ready - so I was leaving the questy code in the settings file just commented out, but I can also remove it if you feel it is cleaner? | 20:35 |
| fungi | jpmaxman: either is fine. if we need that we can always dig it back out of revision history | 20:36 |
| *** PollyZ_ has joined #openstack-infra | 20:36 | |
| *** rdx_matt has quit IRC | 20:36 | |
| jpmaxman | true - ok I'll remove it then | 20:37 |
| *** Apoorva has joined #openstack-infra | 20:37 | |
| *** PollyZ has quit IRC | 20:37 | |
| fungi | yeah, it might cause slightly less confusion when we go to try to clean out the corresponding questy keys/values from puppet | 20:37 |
| fungi | since it will (well, should!) error if we're referencing those variables in the config template and no longer defining them in the manifest | 20:38 |
| jpmaxman | got it ok | 20:38 |
| jpmaxman | sounds good | 20:38 |
| *** jamesmcarthur has joined #openstack-infra | 20:39 | |
| fungi | even if they're in comment lines, the erb template engine doesn't know it needs to ignore that templating | 20:39 |
| jpmaxman | yeah I figured it would insert the q & a they'd just all be commented out | 20:40 |
| jpmaxman | but I agree it is cleaner to remove them | 20:40 |
| clarkb | zaro: do you know if git-reviews test fixture's install of gerrit is going to install bouncy castle? I think it may not and that may be related to the fails on xenial | 20:40 |
| *** hasharAway is now known as hashar | 20:40 | |
| pabelanger | fungi: yes, I am preping for 341624 now | 20:40 |
| fungi | clarkb: check the open reviews for it, that may already be proposed? | 20:41 |
| *** daemontool_ has quit IRC | 20:41 | |
| *** clenimar__ has quit IRC | 20:42 | |
| zaro | clarkb: i do not believe it creates a site that requires bouncy castle therefore bc won't get downloaded | 20:42 |
| clarkb | fungi: ya I don't see anything | 20:42 |
| *** esker has joined #openstack-infra | 20:42 | |
| *** clenimar_ has joined #openstack-infra | 20:42 | |
| clarkb | zaro: is there an easy way to ahve the init install boucny castle too? | 20:42 |
| zaro | BC only gets downloaded/installed if settings in gerrit.config require it | 20:42 |
| *** david-lyle has joined #openstack-infra | 20:43 | |
| anteaya | jpmaxman: okay thanks, I just wanted to ensure you knew about the tools | 20:43 |
| fungi | i feel like we'd had changes proposed in the past to add/update bc in the git-review test deploy of gerrit, but that may have also been necessary only for an older gerrit release | 20:43 |
| openstackgerrit | Merged openstack-infra/system-config: Use strategy free for git servers https://review.openstack.org/341121 | 20:43 |
| fungi | probably before gerrit grew the ability to download bc itself at installation | 20:43 |
| clarkb | zaro: I see, if we seed a gerrit.conf that requires it then ti should automatically download them unless you pass the no downloads flag? | 20:44 |
| *** garyk has quit IRC | 20:44 | |
| zaro | clarkb: yes, but i'im not aware of no downloads flag. | 20:44 |
| clarkb | anyways I think what I can do is run the tests, then manually add bc to the fixtures dirs and rerun and see if that xies | 20:44 |
| clarkb | which should be an easy way to check | 20:44 |
| *** piet has joined #openstack-infra | 20:45 | |
| *** piet has quit IRC | 20:46 | |
| *** esker has quit IRC | 20:46 | |
| openstackgerrit | Jp Maxwell proposed openstack-infra/puppet-mediawiki: modified settings file to switch from questy captcha to recaptcha https://review.openstack.org/341800 | 20:46 |
| *** piet has joined #openstack-infra | 20:46 | |
| harlowja | anything u guys need from me :-P | 20:46 |
| harlowja | zookeeper or something | 20:47 |
| harlowja | all figured out? | 20:47 |
| harlowja | lol | 20:47 |
| zaro | clarkb: i think there's actually 3 of them. bcprov, bcpkix and bcpg | 20:47 |
| *** david-lyle has quit IRC | 20:47 | |
| clarkb | zaro: ah ok | 20:48 |
| clarkb | harlowja: all figured out except for the process doesn't go away when we in theory kill it | 20:48 |
| clarkb | I need to confirm that kill is actually running against it | 20:48 |
| pabelanger | strategy free just fired on puppetmaster.o.o, worked as expected! | 20:49 |
| *** david-lyle has joined #openstack-infra | 20:49 | |
| jpmaxman | anteaya thank you :) appreciate you pointing it out :D | 20:50 |
| *** garyk has joined #openstack-infra | 20:50 | |
| *** weshay has quit IRC | 20:51 | |
| *** cardeois has quit IRC | 20:51 | |
| zaro | clarkb: why would you need to force BC when the git-review tests do not use it? | 20:52 |
| *** cardeois_ has joined #openstack-infra | 20:52 | |
| zaro | or maybe why would it get download on xenial but not trusty? | 20:52 |
| clarkb | zaro: because on xenial there appears to be a mismatch between openssh's allowed ciphers and those the server supports | 20:52 |
| clarkb | zaro: I don't think it gets downlaoded on either (but need to double check) | 20:52 |
| clarkb | I think possibly it is bouncy castle that makes this work in our prodction gerrit because people with newer openssh (like me) haven't had it break for them | 20:53 |
| clarkb | zaro: the change for different war didn't fix the tests on xenial | 20:55 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Make strategy free default for all remote_puppet playbooks https://review.openstack.org/341804 | 20:55 |
| openstackgerrit | Chris Spencer proposed openstack-infra/project-config: add craton project https://review.openstack.org/332470 | 20:55 |
| pabelanger | zigo: okay, lets try a patch now | 20:56 |
| *** roxanagh_ has quit IRC | 20:56 | |
| zigo | pabelanger: doing it | 20:56 |
| *** esker has joined #openstack-infra | 20:56 | |
| *** e0ne has joined #openstack-infra | 20:57 | |
| clarkb | zigo: I will be double checking that as soon as I confirm that jeblair's zk fix fixes the main issue (that test run is going now) | 20:57 |
| *** julim has joined #openstack-infra | 20:58 | |
| zigo | clarkb: zk ? | 20:58 |
| zigo | zk fix? | 20:58 |
| *** ddieterly[away] is now known as ddieterly | 20:58 | |
| anteaya | jpmaxman: welcome, thanks for the work on the wiki | 20:58 |
| fungi | zigo: zookeeper | 20:58 |
| clarkb | zigo: zookeeper | 20:58 |
| zaro | clarkb: what's the failure? | 20:59 |
| clarkb | yup jeblair and notmorgan's fixes together run the tests to completion | 20:59 |
| *** ddieterly has quit IRC | 20:59 | |
| clarkb | zaro: ssh does not work | 20:59 |
| *** roxanaghe has joined #openstack-infra | 20:59 | |
| *** sarob has quit IRC | 21:00 | |
| fungi | zaro: assumption is that without bouncy castle linked, the mina-sshd used by gerrit doesn't support ecdsa key exchanges | 21:00 |
| zaro | clarkb: you mean the ssh server on gerrit? it doesn't start? or you can't connect? | 21:00 |
| clarkb | zaro: http://paste.openstack.org/show/532134/ | 21:00 |
| clarkb | zaro: it starts fine but the connections fail because the client and server can't negotiate a secure connection | 21:00 |
| *** ddieterly has joined #openstack-infra | 21:01 | |
| fungi | "server: diffie-hellman-group1-sha1" doesn't overlap with any of the client's supported kex algorithms | 21:02 |
| *** yaume has quit IRC | 21:02 | |
| *** david-lyle__ has joined #openstack-infra | 21:02 | |
| fungi | presumably mina-sshd just supports that one unless bc is available for it to use | 21:02 |
| clarkb | ya thats my hunch | 21:02 |
| zigo | pabelanger: Waiting for verify... | 21:02 |
| *** EricGonczer_ has quit IRC | 21:03 | |
| pabelanger | zigo: okay | 21:04 |
| pabelanger | AFS is ready | 21:04 |
| *** yamamoto has joined #openstack-infra | 21:04 | |
| pabelanger | hopefully I fixed all the typos this time | 21:04 |
| zaro | clarkb, fungi : i'm not knowledgable about the plumbing behind ssh but do you think updating mina ssh jar would help? | 21:05 |
| *** e0ne has quit IRC | 21:06 | |
| *** Jeffrey4l has joined #openstack-infra | 21:06 | |
| fungi | zaro: it might if they either made bc mandatory (preferable) or implemented those additional algorithms themselves (please no) | 21:07 |
| *** karthikp_ has quit IRC | 21:07 | |
| fungi | but regardless clarkb will presumably know shortly if manually adding all the bc libs makes a difference | 21:07 |
| zaro | i'm guessing you can probably verify by creating site with newer version of gerrit? | 21:08 |
| *** psilvad has quit IRC | 21:09 | |
| *** yamamoto has quit IRC | 21:09 | |
| clarkb | back to the zk thing | 21:09 |
| clarkb | jeblair: pretty sure this doesn't properly cleanup the second zk process. I did confirm the first one goes away properly and it is the second one we are leaking. I wonder if the subprocess module is doing gc of some sort so that when cleanup runs its not able to kill the process | 21:10 |
| clarkb | I am going to see if switching to os.kill makes it happier | 21:11 |
| jeblair | clarkb: 'this' == 341784,2 ? | 21:11 |
| clarkb | jeblair: yes | 21:11 |
| *** Kaiyan has joined #openstack-infra | 21:12 | |
| clarkb | jeblair: if I apply that without the log checking fix it still leaks the zk process | 21:12 |
| *** ddieterly is now known as ddieterly[away] | 21:12 | |
| clarkb | (I did it by getting the patch zip from gerrit, unpacking that zip, and git applying it) | 21:12 |
| *** yamahata has quit IRC | 21:12 | |
| *** jamesmcarthur has quit IRC | 21:13 | |
| *** EricGonczer_ has joined #openstack-infra | 21:13 | |
| jeblair | clarkb: hrm, i believe i tested that, but i'll retest | 21:13 |
| *** mikelk has quit IRC | 21:14 | |
| jeblair | clarkb: oh, yeah that doesn't work. | 21:14 |
| jeblair | clarkb: perhaps cleanups don't get called on timeouts? | 21:14 |
| zigo | pabelanger: Verify done, waiting for post job now. | 21:14 |
| clarkb | jeblair: I think they do because the tmpdir fixture's cleanup is being called and the tmpdir is being removed | 21:15 |
| clarkb | jeblair: but even my os.kill hack doesn't seem to work | 21:15 |
| jeblair | clarkb: hrm, the 'print' statement i just put in the cleanup didn't get called | 21:15 |
| pabelanger | jeblair: zuul2.5 issue, 335149,1 is at 8h41m in the gate, because our watchdog keeps killing the job and requeuing it. Would it take much work to add some sort of requeue limit? and just fail the job after X runs? | 21:15 |
| *** esker has quit IRC | 21:16 | |
| Kaiyan | Can I get some review for https://review.openstack.org/#/c/341091/ please? Andreas already +2d it :-) This review is to remove check-requirements ci job from monasca-agent because we can't get | 21:16 |
| reed | who maintains DIB these days? | 21:16 |
| Kaiyan | monasca agent into openstack requirement anytime soon | 21:16 |
| pabelanger | only seems to be gate-openstack-ansible-dsvm-commit job from what I see | 21:16 |
| jeblair | pabelanger: i think that's desirable -- it should be in zuul itself | 21:16 |
| jeblair | pabelanger: (not in the launcher) | 21:17 |
| pabelanger | jeblair: ya, that is what I am thinking too | 21:17 |
| clarkb | jeblair: might also be related to failing in the setUp of the fixture? | 21:17 |
| jeblair | we discussed wanting to do this with jenkins as well | 21:17 |
| *** Swami has quit IRC | 21:17 | |
| jeblair | clarkb: oh, interesting idea | 21:17 |
| *** ldnunes has quit IRC | 21:17 | |
| pabelanger | reed: ianw greghaynes are a few folks | 21:18 |
| reed | ianw, can you please have a look at when you have time? it makes building fedora and ubuntu quite painful without https://review.openstack.org/#/c/339065 | 21:18 |
| reed | thanks pabelanger | 21:19 |
| pabelanger | zigo: typo in import script | 21:19 |
| pabelanger | zigo: fixing | 21:19 |
| zigo | pabelanger: I'll run out of ideas of long description enhancements! :) | 21:19 |
| *** garyk has quit IRC | 21:20 | |
| *** ociuhandu has joined #openstack-infra | 21:20 | |
| *** thorst_ has quit IRC | 21:21 | |
| clarkb | jeblair: fixtures docs do suggest no longer overrideing setUp and suggest _setUp instead. I am going to see if that helps | 21:21 |
| clarkb | jeblair: https://pypi.python.org/pypi/fixtures says its harder to write leak free fixtures the old way and maybe somehow this is realted | 21:21 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Use ZUUL_REFNAME for reprepro-import https://review.openstack.org/341809 | 21:21 |
| openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Change apscheduler>=3.0.1,<3.1.0 to apscheduler>=3.2.0 https://review.openstack.org/341810 | 21:21 |
| *** dprince has quit IRC | 21:21 | |
| clarkb | hrm no that just fails in fixtures | 21:22 |
| openstackgerrit | Merged openstack/diskimage-builder: Don't create an ironic-agent image just to delete it https://review.openstack.org/339820 | 21:22 |
| pabelanger | fungi: anteaya: Do you mind helping on 341809^ working with zigo on deb packages | 21:22 |
| pabelanger | helping review* | 21:22 |
| clarkb | oh had to remove the super of course | 21:22 |
| *** thorst_ has joined #openstack-infra | 21:23 | |
| anteaya | pabelanger: I'll take a look, Adam may have just figured out the storyboard test failure I have been trying to fix, I have a few minutes | 21:23 |
| pabelanger | Thanks | 21:24 |
| pabelanger | TIL: ZUUL_BRANCH doesn't exist in post pipeline | 21:24 |
| pabelanger | which makes sense | 21:24 |
| zigo | anteaya: Cheers. | 21:24 |
| clarkb | pabelanger: ya should jsut be ZUUL_REF | 21:24 |
| zigo | How's going storyboard btw? Are we soon getting rid of Launchpad? :) | 21:24 |
| clarkb | pabelanger: if we triggered off of patch merged instead of ref updated then we could have the branch iirc | 21:25 |
| jeblair | clarkb: that seems to work for me, though the error is not as nice | 21:25 |
| anteaya | pabelanger: can you expand your commit message a bit? I have zero context for this patch so don't even know what goal you are aiming for or obstacle you are facing | 21:25 |
| clarkb | jeblair: ya I am double checking one last thing but I think this is the fix | 21:25 |
| jeblair | clarkb, pabelanger: we could have the branch, but not the commit | 21:25 |
| jeblair | clarkb, pabelanger: which is why we don't | 21:25 |
| *** watanabe_isao has quit IRC | 21:25 | |
| clarkb | jeblair: ah | 21:25 |
| clarkb | jeblair: ya I think this is the way to have it claen up properly. But we do get the double traceback | 21:26 |
| pabelanger | jeblair: thanks for the info | 21:26 |
| clarkb | and seems to be how fixtures the lib wants you to do things | 21:26 |
| *** adrian_otto1 has joined #openstack-infra | 21:26 | |
| jeblair | clarkb, pabelanger: (gerrit supplies no information about the merge commit it generates in a change-merged event, so we would, eg, build a tarball from the wrong commit) | 21:26 |
| clarkb | I will leave a comment on the change | 21:26 |
| pabelanger | anteaya: sure, updating | 21:26 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Use ZUUL_REFNAME for reprepro-import https://review.openstack.org/341809 | 21:26 |
| anteaya | pabelanger: thanks | 21:26 |
| pabelanger | clarkb: Hmm, let me check that | 21:26 |
| *** thorst__ has joined #openstack-infra | 21:26 | |
| pabelanger | Oh, ya so we have ZUUL_REF and ZUUL_REFNAME | 21:27 |
| pabelanger | both seem to be the value I want | 21:27 |
| clarkb | pabelanger: and you can determine branch from the ref | 21:27 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Make ZK cleanup more resilient https://review.openstack.org/341784 | 21:27 |
| clarkb | if you need to know branch. There is examples of that in the jobs that build documentation | 21:27 |
| jeblair | clarkb: ^ | 21:27 |
| clarkb | so that they can handle tags and post stuff | 21:27 |
| pabelanger | okay, let me update | 21:27 |
| *** thorst_ has quit IRC | 21:28 | |
| *** david-lyle__ has quit IRC | 21:28 | |
| clarkb | jeblair: +2 | 21:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Use ZUUL_REF to get branch info for reprepro-import https://review.openstack.org/341809 | 21:29 |
| fungi | AJaeger: if you happen to be around, i have explanations and comments in 341751 for you. there are several (unrelated) problems at work | 21:29 |
| pabelanger | clarkb: thanks | 21:29 |
| *** garyk has joined #openstack-infra | 21:29 | |
| *** adrian_otto has quit IRC | 21:29 | |
| fungi | AJaeger: fwiw i believe we determined that refname is preferred over ref for identifying branches | 21:30 |
| fungi | er, pabelanger ^ | 21:30 |
| fungi | (sorry AJaeger | 21:30 |
| fungi | ) | 21:30 |
| pabelanger | hehe | 21:30 |
| *** karthikp_ has joined #openstack-infra | 21:30 | |
| clarkb | jeblair: I think what is happening there is setUp() is responsible for making sure that cleanups get registered properly but because we override it and don't add that back in we lose out | 21:31 |
| *** rossella_s has joined #openstack-infra | 21:31 | |
| *** thorst__ has quit IRC | 21:31 | |
| jeblair | clarkb: makes sense | 21:31 |
| clarkb | jeblair: but by using _setUp() the default setUp() can handle it for us | 21:31 |
| pabelanger | clarkb: fungi: AJaeger: okay, just confirming before I update the patch again. We are using ZUUL_REFNAME to determine branch name these days? | 21:31 |
| fungi | pabelanger: `git grep ZUUL_REFNAME` in project-config says that is the case | 21:32 |
| clarkb | fungi: zaro I have confirmed that the golden site install for git review tests does not have bc in it, once this test run finishes I will manually add them in and rerun | 21:32 |
| *** baoli has quit IRC | 21:33 | |
| pabelanger | fungi: okay, clarkb looks like REFNAME, are you okay with that? | 21:33 |
| fungi | pabelanger: 33 of 51 hits reference zuul_refname rather than just zuul_ref | 21:33 |
| fungi | yep | 21:33 |
| pabelanger | fungi: ya, see that | 21:33 |
| clarkb | ya use refname | 21:33 |
| *** rdx_matt has joined #openstack-infra | 21:33 | |
| jeblair | pabelanger: values of ZUUL_REFNAME may include things like "stable/mitaka" "master" or "feature/zuulv3" | 21:33 |
| *** ddieterly[away] has quit IRC | 21:34 | |
| pabelanger | jeblair: okay, thats enough for what I am doing with the reprepro-import script | 21:34 |
| fungi | i think in this case it's limited to branch patterns found in deb packaging repos | 21:34 |
| fungi | unless i'm misremembering | 21:35 |
| *** asettle has joined #openstack-infra | 21:35 | |
| *** tonytan4ever has quit IRC | 21:35 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Use ZUUL_REFNAME to get branch info for reprepro-import https://review.openstack.org/341809 | 21:35 |
| jeblair | the job is filtered on those? if so, good -- if it needs to run on a wider range it may need some more checks | 21:35 |
| pabelanger | right, only deb packaging repos are using this right now | 21:35 |
| fungi | but worth keeping in mind that the above will be rendering -mitaka, -master and -zuulv3 in your suite names | 21:35 |
| pabelanger | jeblair: no filtering yet, since we only have 1 project ATM | 21:35 |
| rajinir | HOST_IP for the slave devstack VMs created by nodepool, how do we know what gets assigned | 21:35 |
| pabelanger | fungi: agreed | 21:36 |
| fungi | rajinir: there are files in /etc/nodepool | 21:36 |
| anteaya | pabelanger: sorry for the churn | 21:36 |
| *** claudiub has quit IRC | 21:36 | |
| pabelanger | anteaya: no problems | 21:36 |
| anteaya | pabelanger: does that patch get you your next step then? | 21:37 |
| pabelanger | anteaya: I hope that is everything for packaging builds now | 21:37 |
| anteaya | okey dokey | 21:37 |
| anteaya | pabelanger: you have my +2 | 21:37 |
| pabelanger | thanks | 21:37 |
| fungi | rajinir: http://paste.openstack.org/show/532139/ | 21:37 |
| pabelanger | fungi: clarkb: if you don't mind | 21:38 |
| anteaya | go find a bow and an axe and you're in business | 21:38 |
| *** rdx_matt has quit IRC | 21:39 | |
| rajinir | fungi: nodepool can request a specific IP to be assigned by devstack? | 21:40 |
| *** daemontool_ has joined #openstack-infra | 21:40 | |
| *** roxanaghe has quit IRC | 21:41 | |
| rajinir | fungi: The devstack script that runs on the slave vm is expecting HOST_IP and I'm wondering how to fix it | 21:41 |
| ianw | reed: sorry, this came in on pto for me, looking | 21:42 |
| fungi | rajinir: i'm not sure what you're asking. that's nodepool documenting the reachable ip address(es) of subnode(s) so that the primary node can use it when doing multi-node setup for things like devstack-gate | 21:42 |
| *** puiterwijk is now known as puiterwijk|otg | 21:43 | |
| reed | ianw, absolutely, thanks... I blame python3 for everything :) | 21:43 |
| rajinir | fungi: ok, thanks, let me checkout nodepool docs | 21:43 |
| *** eharney has quit IRC | 21:43 | |
| *** tbachman has left #openstack-infra | 21:43 | |
| clarkb | zaro: fungi looks like spamaps has reported this as an issue against ansible-gerrit on github so this is the fix | 21:43 |
| *** rcernin has quit IRC | 21:43 | |
| clarkb | zaro: fungi but also we don't have a war with the fixed bc urls so it failed even when I manually ran init and told it to give me a bc | 21:44 |
| fungi | rajinir: oh, i think i misread your reference to "slave vms" as meaning subnodes in a nodepool multi-node | 21:44 |
| zaro | clarkb: that got fixed and merged | 21:44 |
| fungi | rajinir: you're just asking how to find out the ip address of the node where devstack is being set up, right? | 21:44 |
| fungi | rajinir: are you using devstack-gate for this or something else? | 21:44 |
| clarkb | zaro: thats not the war you just added to git-review then | 21:45 |
| *** garyk has quit IRC | 21:45 | |
| *** Swami has joined #openstack-infra | 21:45 | |
| *** thiagop has quit IRC | 21:45 | |
| clarkb | zaro: because I hit the 302 fail thing which shouldn't happen with the new war iirc | 21:45 |
| zaro | yeah, i forgot it was just merged recently, https://review.openstack.org/#/c/311903/ | 21:45 |
| clarkb | zaro: ok let me retry using that war just to double check everything but then we need to figure out how to update git-review to do this with the batch command | 21:46 |
| *** ociuhandu has quit IRC | 21:46 | |
| *** edtubill has quit IRC | 21:46 | |
| rajinir | fungi: yes | 21:46 |
| rajinir | fungi: using devstack-gate | 21:47 |
| *** Goneri has quit IRC | 21:48 | |
| fungi | rajinir: i think d-g simply sets it in the localrc, if i understand your question | 21:49 |
| fungi | based on looking at the network interface state | 21:50 |
| clarkb | zaro: http://tarballs.openstack.org/ci/gerrit-2.4.4-14-gab7f4c1.war taht one look right to you? | 21:50 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Refresh nodepool-builder logging https://review.openstack.org/341819 | 21:50 |
| pabelanger | ianw: likely want to land ^ for nodepool-builder | 21:50 |
| pabelanger | clarkb: ^ | 21:50 |
| pabelanger | ianw: I just restarted nodepool-builder, fedora-24 building now | 21:51 |
| zaro | clarkb: i think it's this one, http://tarballs.openstack.org/ci/gerrit/gerrit-v2.11.4.13.cb9800e.war | 21:51 |
| clarkb | er ya 2.4 is wrong | 21:52 |
| clarkb | I was in the wrong dir when I sorted | 21:52 |
| ianw | pabelanger: oh cool, i didn't get to the logs yet, did it fail in the regular build? | 21:52 |
| *** ddieterly has joined #openstack-infra | 21:53 | |
| *** cardeois_ has quit IRC | 21:53 | |
| *** rossella_s has quit IRC | 21:53 | |
| *** garyk has joined #openstack-infra | 21:53 | |
| pabelanger | ianw: no, this is the first time it is building | 21:53 |
| pabelanger | had to wait to restart nodepool-builder because of uploads | 21:53 |
| *** cardeois_ has joined #openstack-infra | 21:53 | |
| *** rlandy has quit IRC | 21:54 | |
| *** garyk has quit IRC | 21:56 | |
| ianw | cool | 21:56 |
| *** jamesmcarthur has joined #openstack-infra | 21:56 | |
| *** roxanaghe has joined #openstack-infra | 21:57 | |
| clarkb | pabelanger: f24 logging change lgtm | 21:57 |
| clarkb | zaro: fungi no errors yet with the bc libs copied in | 21:58 |
| *** garyk has joined #openstack-infra | 21:58 | |
| clarkb | zaro: fungi so how do we want to get them in the test suite. I can't find any way to have init --batch grab them | 21:58 |
| *** mdrabe_ has quit IRC | 21:59 | |
| *** asettle has quit IRC | 21:59 | |
| clarkb | zaro: do you know how to make init --batch do that? The annoying thing is its default to download them in interactive mode but not batch mode | 21:59 |
| zaro | i see a | 22:00 |
| *** asettle has joined #openstack-infra | 22:01 | |
| *** jamesmcarthur has quit IRC | 22:01 | |
| zaro | i see a flag '--secure-storelib', might that help? | 22:01 |
| *** garyk has quit IRC | 22:01 | |
| clarkb | I think thats for the contact store | 22:01 |
| *** [1]Thelo has joined #openstack-infra | 22:01 | |
| *** garyk has joined #openstack-infra | 22:01 | |
| *** adrian_otto1 has quit IRC | 22:01 | |
| * clarkb is going to read the source | 22:01 | |
| *** adrian_otto has joined #openstack-infra | 22:02 | |
| zaro | clarkb: you can change the gerrit.config so that gerrit will download | 22:02 |
| *** esberglu has quit IRC | 22:03 | |
| rajinir | fungi: Its the devstack-gate that is complaining about HOST_IP. HOST_IP should be normally detected, don't know why it is complaining | 22:03 |
| *** akshai has quit IRC | 22:03 | |
| ianw | did gerrit just disappear my comment through a login session because i wasn't logged in when i made it ... | 22:03 |
| *** Thelo has quit IRC | 22:03 | |
| *** [1]Thelo is now known as Thelo | 22:03 | |
| zaro | clarkb: i don't remember which config actually makes it do that. | 22:03 |
| *** asettle has quit IRC | 22:03 | |
| *** mriedem has quit IRC | 22:03 | |
| *** jcoufal has quit IRC | 22:04 | |
| *** burgerk has quit IRC | 22:04 | |
| *** rdx_matt has joined #openstack-infra | 22:04 | |
| clarkb | ianw: yes it will do that, the trick is to go anonymous, copy your comment into buffer, login then paste abck | 22:04 |
| clarkb | ianw: alternatively cry or use gertty | 22:04 |
| fungi | rajinir: i'd need to dig into the setup_localrc() definition in devstack-vm-gate.sh to see where it gets HOST_IP normally | 22:05 |
| jlk | This might be a dumb question, but is there a model for hosting a project on openstack infra that doesn't do integrated releases (yes, I know there is), is mostly managed by a single company, doesn't really do PTL elections, but is related to (installing / upgrading) OpenStack? | 22:05 |
| *** yamamoto has joined #openstack-infra | 22:05 | |
| pleia2 | is the wiki still restricted to existing contributors? | 22:06 |
| *** karthikp_ has quit IRC | 22:06 | |
| *** thorst_ has joined #openstack-infra | 22:06 | |
| fungi | pleia2: yes, until 341800 lands | 22:07 |
| rajinir | fungi: ok. I have only specified the FIXED_RANGE and NETWORK_GATEWAY as minimum config. May be I'm missing something | 22:07 |
| fungi | pleia2: btw, reviews of 341800 would be awesome | 22:07 |
| pleia2 | fungi: thanks, on it | 22:07 |
| jroll | jlk: yeah, just don't put it in governance, and use independent release model | 22:07 |
| openstackgerrit | Merged openstack-infra/zuul: Call parameter_function prior to creating swift params https://review.openstack.org/229582 | 22:07 |
| jlk | jroll: is this kind of thing frowned upon? | 22:07 |
| *** karthikp_ has joined #openstack-infra | 22:08 | |
| jroll | jlk: if you want it in governance, you need to do the PTL thing, everything else is a-ok | 22:08 |
| openstackgerrit | Merged openstack-infra/project-config: Use ZUUL_REFNAME to get branch info for reprepro-import https://review.openstack.org/341809 | 22:08 |
| *** rdx_matt has quit IRC | 22:08 | |
| jroll | jlk: anyone can have an openstack/ repo, the "big tent" is the governance part. and no, it isn't frowned upon | 22:08 |
| *** flepied has quit IRC | 22:08 | |
| *** karthikp_ has quit IRC | 22:08 | |
| fungi | jlk: nah, we have lots of unofficial projects written by only one company with no formal governance. i would say that's close to 50% of what we host in fact (by project count anyway) | 22:08 |
| clarkb | zaro: fungi: I am thinking I might have git-review use other-requirements to install those bc packages and other deps then symlink them in kind of like we do with our deployment | 22:09 |
| *** karthikp_ has joined #openstack-infra | 22:09 | |
| jlk | jroll: fungi: thank you for that info | 22:09 |
| clarkb | zaro: fungi how does that sound? I am having no luck understanding this init command | 22:09 |
| jroll | jlk: not a problem :) | 22:09 |
| jeblair | jlk: generally speaking the theory is: the more like openstack that openstack-related projects behave and the closer to the openstack community they do it, the better for openstack | 22:09 |
| zaro | clarkb: i guess other option is probably just need to make test setup routine download jars for xenial? | 22:10 |
| betherly | hi all! having an issue logging into the openstack wiki for some reason. when i log in to edit it i get "The wiki.openstack.org page isn’t working". it was suggested that i didnt have enough ubuntu details put in but i have ensured they are all completed and it still has the same thing. any ideas? I have never edited the wiki before so it could be an | 22:10 |
| betherly | issue relating to 341800 but i know i had this error ages back and ignored it as the edit wasnt urgent | 22:10 |
| *** ddieterly is now known as ddieterly[away] | 22:10 | |
| clarkb | zaro: ya I could do that too | 22:10 |
| *** akshai has joined #openstack-infra | 22:10 | |
| clarkb | zaro: but it should do it for all of them | 22:10 |
| openstackgerrit | Merged openstack/diskimage-builder: Check sudoers file after editing https://review.openstack.org/338931 | 22:10 |
| *** thorst_ has quit IRC | 22:11 | |
| *** thorst__ has joined #openstack-infra | 22:11 | |
| pleia2 | betherly: have you edited the wiki before? | 22:11 |
| *** yamamoto has quit IRC | 22:11 | |
| pleia2 | betherly: or at least, were you ever able to log in? :) | 22:11 |
| betherly | pleia2: i've never been able to log in no :) | 22:11 |
| zaro | clarkb: maybe download once then copy to each site as it's created? | 22:12 |
| clarkb | zaro: oh it looks like maybe if we precreate the ssh keys then it requires the download | 22:12 |
| clarkb | zaro: I am goign to test that really quick bceause that would be a simple way to do it maybe | 22:12 |
| *** roxanaghe has quit IRC | 22:12 | |
| *** akshai has quit IRC | 22:12 | |
| pleia2 | betherly: ok yeah, so we had to disable new account creations a few months back since we were getting overwhelmed by spam, a fix is in flight to re-enable this but right now new folks can't edit :( | 22:13 |
| openstackgerrit | Merged openstack-infra/project-config: Adding a new JOB for networking-ovn project https://review.openstack.org/330926 | 22:13 |
| *** roxanaghe has joined #openstack-infra | 22:13 | |
| clarkb | zaro: also this Final Libraries libraries with Buck looks like dark magic | 22:14 |
| betherly | pleia2: awesome ok! thanks :) | 22:14 |
| *** thorst_ has joined #openstack-infra | 22:14 | |
| pabelanger | pleia2: betherly: I've been manually allowing registration on the wiki, up to 15mins, then puppet disables is again | 22:14 |
| *** gouthamr has quit IRC | 22:15 | |
| zaro | clarkb: i still have not figured out how buck really works | 22:15 |
| pleia2 | pabelanger: have you found any baddies sneak in during that time? | 22:15 |
| betherly | pabelanger: is that a lot of hassle to do? dont worry if so but would be awesome if its not difficult | 22:15 |
| clarkb | zaro: its like doig dynamic linking with the magical libraries symbol | 22:15 |
| *** thorst__ has quit IRC | 22:15 | |
| pabelanger | pleia2: not that I have seen. However I think puppet is currently disabled on wiki.o.o I'd have to check the state of the system | 22:16 |
| *** EricGonczer_ has quit IRC | 22:16 | |
| pleia2 | pabelanger: it's just the one line edit of the $wgGroupPermissions, yeah? | 22:16 |
| zigo | pabelanger: Your patch has been merged, should I try again? | 22:16 |
| pleia2 | I can manually revert after betherly signs up | 22:16 |
| pabelanger | zigo: just landing now. give it 15mins | 22:16 |
| zigo | ok | 22:16 |
| pleia2 | (just commenting it out) | 22:17 |
| pabelanger | pleia2: yes, that is it | 22:17 |
| pleia2 | thanks | 22:17 |
| pabelanger | yup, I comment it out, then re-enable it on a per user request | 22:17 |
| anteaya | pleia2: yes, spammers show up soon after enabling account creation according to fungi | 22:17 |
| clarkb | zaro: hahahahaha that totally does it, ciompletely undocumented behavior | 22:17 |
| pabelanger | not the best solution :( | 22:17 |
| clarkb | zaro: I will write a patch | 22:17 |
| pleia2 | pabelanger: nods | 22:17 |
| anteaya | pleia2: so just look at any new activity after you close it after betherly gets in | 22:18 |
| zaro | cool, i never realized that. i totally thought it was because settings in gerrit.config | 22:18 |
| *** thorst_ has quit IRC | 22:18 | |
| *** puiterwijk|otg is now known as puiterwijk | 22:19 | |
| *** EricGonczer_ has joined #openstack-infra | 22:19 | |
| pleia2 | anteaya: yep, I will | 22:19 |
| anteaya | cool | 22:20 |
| pleia2 | all done, all is well | 22:20 |
| anteaya | yay! | 22:20 |
| pabelanger | ianw: fedora-24 failed. rpmdb issue again | 22:21 |
| pabelanger | ianw: rebuild happening now | 22:21 |
| pabelanger | zigo: okay, we should be ready now for the patch | 22:22 |
| *** sarob has joined #openstack-infra | 22:24 | |
| betherly | thanks for opening that up for me! | 22:24 |
| betherly | hmm im being asked for the second letter in the question to edit the page but there is no question :/ lol! | 22:24 |
| anteaya | jpmaxman: ^^ | 22:24 |
| *** jamesmcarthur has joined #openstack-infra | 22:25 | |
| pleia2 | I think maybe it's that question itself | 22:25 |
| *** amitgandhinz has quit IRC | 22:25 | |
| pleia2 | but I don't know what changes have been made, so :) | 22:25 |
| fungi | clarkb: seems fine | 22:25 |
| betherly | ohhhhhh facepalm | 22:26 |
| betherly | pleia2: you were right. it was beth and spam proof | 22:26 |
| betherly | :'D | 22:26 |
| pleia2 | lol <3 | 22:26 |
| pleia2 | we're working on making this less horrible :) | 22:26 |
| *** amitgandhinz has joined #openstack-infra | 22:27 | |
| pabelanger | I approve of less horrible | 22:27 |
| openstackgerrit | Jim Rollenhagen proposed openstack-infra/project-config: Make python35 jobs voting on ironic projects https://review.openstack.org/341830 | 22:27 |
| fungi | pleia2: correct, that's what i've been doing--comment that line out, wait until the new user shows up at https://wiki.openstack.org/w/index.php?title=Special%3AListUsers&username=&group=&creationSort=1&desc=1&limit=50 and then uncomment it again | 22:27 |
| *** sarob has quit IRC | 22:28 | |
| *** EricGonczer_ has quit IRC | 22:29 | |
| pabelanger | zigo: actually, I can cheat. Let me enequeue the last patch again | 22:29 |
| pabelanger | if I remember | 22:29 |
| fungi | anteaya: that was (is) our old questy captcha, not the recaptcha one jpmaxman is adding in 341800 | 22:29 |
| zigo | :) | 22:29 |
| ianw | pabelanger: hmmm, i haven't seen that one in my local builds | 22:29 |
| anteaya | fungi: jpmaxman ah, sorry about that | 22:30 |
| jpmaxman | no worries, I didn't think it had been approved ;) | 22:30 |
| pabelanger | zigo: but, you can also get a patch going too | 22:30 |
| zigo | pabelanger: https://review.openstack.org/#/c/341825/ | 22:31 |
| pabelanger | ianw: same failure :( | 22:32 |
| ianw | pabelanger: Error: package npm-3.5.4-5.fc24.noarch requires nodejs(engine), but none of the providers can be installed <- just gotta do school run, will dig into in a bit | 22:32 |
| pabelanger | ianw: okay | 22:32 |
| *** jamesmcarthur has quit IRC | 22:33 | |
| pabelanger | ianw: https://bugzilla.redhat.com/show_bug.cgi?id=1351007 | 22:34 |
| openstack | bugzilla.redhat.com bug 1351007 in nodejs "nodejs should provides npm and obsolete npm-3.5.4-5.fc24.noarch" [Unspecified,New] - Assigned to nodejs-sig | 22:34 |
| *** pradk has quit IRC | 22:34 | |
| *** coolsvap_ has joined #openstack-infra | 22:34 | |
| jeblair | Shrews, SpamapS: in innodb, with a table with an existing uuid (hex string) column, should we make that column the PK and use it for joins, or should we add an autoincrement and use that instead? | 22:35 |
| pabelanger | ianw: I think that is pulled in by stackviz | 22:35 |
| openstackgerrit | Clark Boylan proposed openstack-infra/git-review: Install bc libs when running testsuite https://review.openstack.org/341833 | 22:35 |
| pabelanger | ianw: which we could temp disable if needed | 22:35 |
| pabelanger | yup, stackviz | 22:35 |
| *** tonytan4ever has joined #openstack-infra | 22:35 | |
| *** jamesmcarthur has joined #openstack-infra | 22:36 | |
| clarkb | fungi: zaro ^ something like that but now I am running into reindex issues :/ | 22:36 |
| SpamapS | jeblair: With less than 100,000 rows.. meh | 22:37 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Disable stackviz on fedora-24 https://review.openstack.org/341834 | 22:37 |
| *** garyk has quit IRC | 22:37 | |
| *** coolsvap has quit IRC | 22:38 | |
| jeblair | SpamapS: this is zuul builds... so we'll hit 100,000 in a week | 22:38 |
| pabelanger | clarkb: ianw: if everybody is fine with that, we should land that before tomorrows builds. nodepool-builder will need a reset too | 22:38 |
| SpamapS | jeblair: also, another consideration is a uuid that is packed down into a binary() column, which is faster than varchar | 22:38 |
| SpamapS | jeblair: so each unique build gets a uuid, and how many things join to that uuid? | 22:38 |
| clarkb | pabelanger: can you fix the package deps isntead? | 22:38 |
| clarkb | pabelanger: looks like you can just not install npm? | 22:39 |
| jeblair | SpamapS: yeah -- a table with builds (20k per day, each build has a uuid), joined with a table with metadata for each build... not sure how much metadata yet, let's say around 10 rows for each build... | 22:40 |
| jeblair | (i'm still reading the patch) | 22:40 |
| SpamapS | actually, let me explain the problem: varchar(36), which is most often used for uuid's, in a utf8 table, will make index keys that are 108 bytes wide because InnoDB wants to use fixed-width b-tree keys. | 22:40 |
| *** jamesmcarthur has quit IRC | 22:40 | |
| *** tonytan4ever has quit IRC | 22:41 | |
| jeblair | SpamapS: now that i have done this math, i think i would like to ask you to actually review the schema in the patch :) | 22:41 |
| jeblair | cause i think the volume here will make the details important | 22:41 |
| SpamapS | so if you have 1 million rows, you will have 108 million bytes just in PK's in your index. If you have a table that links 100 records to each of those 1 million rows, you will have over 1GB just of foreign keys. | 22:41 |
| *** ddieterly[away] is now known as ddieterly | 22:42 | |
| clarkb | SpamapS: and its even more bytes if you use proper utf8 | 22:42 |
| SpamapS | jeblair: yeah, it made massive boosts in query speed to do bigint autoinc keys in subunit2sql. This sounds like similar scale. | 22:42 |
| SpamapS | clarkb: yeah, this is the shortcut 3 byte utf8 | 22:42 |
| SpamapS | if you use mb4 you get 25% more bytes FOR FREE | 22:42 |
| jeblair | SpamapS: yes, and nearly identical data / problem space :) | 22:42 |
| SpamapS | and let's not even get started about actual proper utf-8 that does 6 byte wide chars | 22:43 |
| SpamapS | are there things that will want to query and summarize this data btw? | 22:43 |
| *** matt-borland has joined #openstack-infra | 22:44 | |
| SpamapS | because, subunit2sql is specifically a datamart, so query optimized schema is important. If zuul is just recording this for single key lookups.. it could be premature optimization to fight it too hard. | 22:44 |
| *** jamesmcarthur has joined #openstack-infra | 22:44 | |
| jeblair | SpamapS: i believe the idea is that subunit2sql will start using this data | 22:45 |
| jeblair | er | 22:45 |
| jeblair | SpamapS: openstack health will start using it | 22:45 |
| SpamapS | ah well that's the ticket right there. :) | 22:45 |
| jeblair | in addition to the subunit2sql data | 22:45 |
| SpamapS | yeah, so same space | 22:45 |
| SpamapS | It would be so much better to start this way and not have to figure out how to do the migration on a box with no tmp space. :) | 22:45 |
| SpamapS | also dear RAX, please put tmp space on your trove nodes. kthxbai | 22:46 |
| jeblair | i don't know who to "^" for that comment :( | 22:46 |
| SpamapS | nor I.. or I'd have ^'d them long ago | 22:47 |
| *** mordred has joined #openstack-infra | 22:47 | |
| pabelanger | clarkb: I am not sure, I think stackviz also needs npm too | 22:47 |
| clarkb | pabelanger: yes I think that bug is saying the node package include npm | 22:47 |
| *** tpsilva has quit IRC | 22:48 | |
| *** hashar has quit IRC | 22:48 | |
| pabelanger | clarkb: okay, we could try updating the pkg-map | 22:49 |
| openstackgerrit | Clark Boylan proposed openstack-infra/git-review: Install bc libs when running testsuite https://review.openstack.org/341833 | 22:49 |
| clarkb | fungi: zaro I believe ^ complete sorts git-review on xenial | 22:49 |
| *** garyk has joined #openstack-infra | 22:50 | |
| *** gfreeman has quit IRC | 22:51 | |
| zigo | pabelanger: Did it work? | 22:51 |
| *** jamesmcarthur has quit IRC | 22:51 | |
| pabelanger | zigo: in post pipeline now | 22:51 |
| zigo | Ok. | 22:52 |
| zigo | pabelanger: *I* can't see the pipeline, right? | 22:52 |
| *** rbrndt has quit IRC | 22:52 | |
| pabelanger | zigo: status.o.o/zuul | 22:52 |
| zigo | pabelanger: I thought it would only show gate jobs, not post. | 22:52 |
| *** garyk has quit IRC | 22:52 | |
| craige | o/ | 22:53 |
| zigo | oh... | 22:53 |
| zaro | clarkb: why do you need to reindex? aren't those completely new sites? | 22:53 |
| pabelanger | zigo: filter on deb-openstack-pkg-tools | 22:53 |
| pabelanger | zigo: Ya, we are running it from post, so we build from the merge patch | 22:54 |
| pabelanger | merged* | 22:54 |
| clarkb | zaro: I do not know but my new push also failed | 22:54 |
| zigo | Yeah, I got that point. | 22:54 |
| clarkb | zaro: it failed when zuul ran it whihc is on a brand new VM so no existing site at all | 22:54 |
| *** jamesmcarthur has joined #openstack-infra | 22:54 | |
| pabelanger | just waiting for debian-jessie node to come online now | 22:54 |
| *** sarob has joined #openstack-infra | 22:54 | |
| clarkb | zigo: its possible that it is because I am rpecreating the review site in order to write the ssh keys that this is necessary | 22:54 |
| clarkb | er zaro ^ | 22:54 |
| pabelanger | clarkb: reading https://bugzilla.redhat.com/show_bug.cgi?id=1351007#c11 removing npm might not be the right fix, but a temp workaround | 22:55 |
| openstack | bugzilla.redhat.com bug 1351007 in nodejs "nodejs should provides npm and obsolete npm-3.5.4-5.fc24.noarch" [Unspecified,New] - Assigned to nodejs-sig | 22:55 |
| fungi | clarkb: i'm betting that undocumented "for some reason" is "if you supplied a key format/size it needs bc to handle" | 22:55 |
| fungi | clarkb: lgtm. let's see what the jobs come back with | 22:56 |
| *** jamesmcarthur has quit IRC | 22:56 | |
| clarkb | pabelanger: thats possible but it shouldn't break npm once the npm package gets past that version, it will just allow you to install the npm package gain | 22:56 |
| clarkb | pabelanger: so I don't think there is any problem with doing just nodejs assuming the included version of npm is functional | 22:57 |
| jeblair | SpamapS: in subunit2sql, i notice some "sa.String(256)" columns... that is one character more than i'm accustomed to seeing in String() types -- what does that signify? | 22:57 |
| *** garyk has joined #openstack-infra | 22:57 | |
| *** jamesmcarthur has joined #openstack-infra | 22:58 | |
| *** PollyZ_ has quit IRC | 22:58 | |
| *** sarob has quit IRC | 22:59 | |
| pabelanger | clarkb: ianw: okay, let me figure out how to only install npm for fedora-23 and not on fedora-24 | 22:59 |
| clarkb | pabelanger: in the package map you can do "foo": "" to make foo noop on whatever install | 22:59 |
| clarkb | so in this case npm: "" | 23:00 |
| pabelanger | ya, I need to use the release field it looks like too | 23:00 |
| pabelanger | http://docs.openstack.org/developer/diskimage-builder/elements/pkg-map/README.html | 23:00 |
| *** jamesmcarthur has quit IRC | 23:00 | |
| *** garyk1 has joined #openstack-infra | 23:01 | |
| *** garyk has quit IRC | 23:01 | |
| pabelanger | zigo: you did your patch to mitaka, we're only setup for newton right now | 23:01 |
| pabelanger | so close | 23:01 |
| *** jamesmcarthur has joined #openstack-infra | 23:01 | |
| zigo | :/ | 23:01 |
| zigo | pabelanger: It really was a patch to the debian/newton branch. | 23:02 |
| jeblair | SpamapS: okay, i finished my review and got the high stuff i think; if you want to take a look it's here: https://review.openstack.org/223333 | 23:02 |
| pabelanger | Hmm | 23:02 |
| jeblair | jhesketh, mtreinish: ^ | 23:02 |
| * SpamapS looking | 23:02 | |
| zigo | pabelanger: https://review.openstack.org/341825 <--- This was the patch. | 23:03 |
| pabelanger | zigo: your topic was debian/newton | 23:03 |
| pabelanger | but the branch is debian/mitaka | 23:03 |
| pleia2 | clarkb: given space considerations, do we have criteria for including things in logstash? looking at https://review.openstack.org/#/c/321604/ for some packstack logs | 23:03 |
| *** sarob has joined #openstack-infra | 23:04 | |
| SpamapS | heh | 23:04 |
| SpamapS | this reminds me I need to bring up a pet peeve about sqlalchemy, which is that it makes it really hard to use varbinary. | 23:04 |
| pabelanger | zigo: see what I mean? | 23:04 |
| *** garyk1 has quit IRC | 23:04 | |
| zigo | pabelanger: How can I push to the correct branch then? | 23:04 |
| zigo | pabelanger: I see now, yes, but not sure how to do it correctly. | 23:04 |
| *** rdx_matt has joined #openstack-infra | 23:04 | |
| *** asettle has joined #openstack-infra | 23:04 | |
| SpamapS | (since ascii-only uuid's should just be varbinary) | 23:04 |
| pabelanger | zigo: oh, did you update .gitreview? | 23:04 |
| *** rdx_matt has quit IRC | 23:05 | |
| *** _sarob has joined #openstack-infra | 23:05 | |
| *** rdx_matt has joined #openstack-infra | 23:05 | |
| ianw | pabelanger: not sure why i didn't hit this, maybe i'm not up-to-date in elements | 23:05 |
| zigo | pabelanger: No... :( | 23:05 |
| zigo | pabelanger: That's going to be my patch then! :) | 23:06 |
| fungi | yeah, add/change defaultbranch=debian/newton in .gitreview, or specify debian/newton as the last parameter to the git-review command (see the git-review manpage for details) | 23:06 |
| pabelanger | zigo: yup | 23:06 |
| *** garyk has joined #openstack-infra | 23:06 | |
| *** jamesmcarthur has quit IRC | 23:06 | |
| *** hemna is now known as hemnafk | 23:06 | |
| *** bradjones has quit IRC | 23:06 | |
| pabelanger | ianw: stackviz is new, and was likely missing from the build-image.sh script | 23:06 |
| *** jamesmcarthur has joined #openstack-infra | 23:06 | |
| ianw | yeah, i think i missed that in my testing ... geez, it's always something! | 23:07 |
| pabelanger | I want to update build-tools.sh to read nodepool.yaml | 23:07 |
| *** yamamoto has joined #openstack-infra | 23:07 | |
| *** bradjones has joined #openstack-infra | 23:07 | |
| *** bradjones has quit IRC | 23:07 | |
| *** bradjones has joined #openstack-infra | 23:07 | |
| pabelanger | atleast for the elements | 23:07 |
| pabelanger | zigo: that is better! | 23:08 |
| *** sarob has quit IRC | 23:08 | |
| *** tonytan4ever has joined #openstack-infra | 23:08 | |
| zigo | pabelanger: At this point, I need to go sleep, thanks so much for your help. | 23:08 |
| *** jamesmcarthur has quit IRC | 23:08 | |
| ianw | pabelanger: that could work. i'm usually just running by hand. i also had https://review.openstack.org/#/c/271110/ out there in a similar note | 23:09 |
| *** ddieterly is now known as ddieterly[away] | 23:09 | |
| fungi | zigo: remember to abandon the change that you submitted to the wrong branch too | 23:09 |
| fungi | since changing the branch creates a separate change | 23:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Disable npm for stackviz on fedora-24 https://review.openstack.org/341834 | 23:09 |
| pabelanger | zigo: okay, this _should_ be it | 23:09 |
| *** asettle has quit IRC | 23:09 | |
| zigo | Let's hope so. | 23:09 |
| pabelanger | ianw: ^ should be our fix | 23:09 |
| pabelanger | untested | 23:10 |
| *** rdx_matt has quit IRC | 23:10 | |
| *** piet has quit IRC | 23:10 | |
| *** cbader has quit IRC | 23:10 | |
| jhesketh | Morning | 23:10 |
| *** ddieterly[away] has quit IRC | 23:11 | |
| ianw | pabelanger: so am i understanding the bug that nodejs includes npm anyway? | 23:11 |
| *** garyk has quit IRC | 23:12 | |
| *** garyk1 has joined #openstack-infra | 23:12 | |
| clarkb | I think I figured out the pifpaf issue it was a hostname problem | 23:12 |
| *** xyang1 has quit IRC | 23:12 | |
| pabelanger | ianw: I guess so | 23:13 |
| clarkb | need to see if that is also the pbr problem | 23:13 |
| *** yamamoto has quit IRC | 23:13 | |
| pabelanger | ianw: which means, anything using nodejs or npm in the gate, on fedora-24 is likely broken | 23:13 |
| *** karthikp_ has quit IRC | 23:13 | |
| clarkb | jd__: you might consider printing the output you do get when you don't get what you expect as part of the error message in pifpaf | 23:13 |
| * clarkb files a bug | 23:14 | |
| ianw | pabelanger: hmm, it seems nodejs package comes with npm (10.16.19.154 internally i tested on) | 23:14 |
| ianw | if it works ... i don't know | 23:14 |
| *** tonytan4ever has quit IRC | 23:15 | |
| pabelanger | Ya, not too sure. | 23:15 |
| SpamapS | jeblair: reviewed | 23:15 |
| *** garyk1 has quit IRC | 23:15 | |
| pabelanger | ianw: I'm not wanting to go down the rabbit hole of npm / nodejs too :) | 23:15 |
| *** tonytan4ever has joined #openstack-infra | 23:15 | |
| *** garyk has joined #openstack-infra | 23:15 | |
| openstackgerrit | Madhumitha Viswanathan proposed openstack-infra/jenkins-job-builder: Can we merge this please? https://review.openstack.org/341845 | 23:16 |
| anteaya | morning jhesketh | 23:16 |
| timothyb89 | pabelanger, ianw: fwiw stackviz does need npm in its nodepool element | 23:16 |
| timothyb89 | it's fine if they're both included in nodejs but it will error otherwise | 23:17 |
| *** garyk has quit IRC | 23:18 | |
| clarkb | timothyb89: right the nodejs package gives y ou npm | 23:18 |
| clarkb | timothyb89: is the situation we are running into and we just have to handle it | 23:18 |
| *** jamesmcarthur has joined #openstack-infra | 23:19 | |
| timothyb89 | cool, good to know :) | 23:19 |
| ianw | i really hate how json makes it impossible to comment, terrible for config files | 23:20 |
| pabelanger | ++ | 23:21 |
| *** karthikp_ has joined #openstack-infra | 23:21 | |
| *** jamesmcarthur has quit IRC | 23:21 | |
| *** piet has joined #openstack-infra | 23:21 | |
| clarkb | isn't the trick you make a random string | 23:22 |
| *** garyk has joined #openstack-infra | 23:22 | |
| clarkb | Nakato: mordred figured the pbr thing out it was a test instance issue | 23:22 |
| *** kzaitsev_mb has quit IRC | 23:22 | |
| clarkb | Nakato: mordred it turns out that glean doesn't set /etc/hosts properly if you don't have a config drive | 23:22 |
| clarkb | or at all | 23:22 |
| Nakato | clarkb: So the command failed to start? | 23:23 |
| clarkb | Nakato: ya I think it was failing to listne on * | 23:23 |
| clarkb | or wherever it tries to listen | 23:23 |
| *** jamesmcarthur has joined #openstack-infra | 23:23 | |
| clarkb | this is somethign we will want to tell people when we distribute our images | 23:24 |
| clarkb | jeblair: ^ btw, basically config drive seems to be required for current glean if you want a host that can run unittests for pbr and a couple other projects | 23:24 |
| Shrews | jeblair: all the things SpamapS said | 23:25 |
| *** sdake has joined #openstack-infra | 23:26 | |
| Shrews | and if the table could be large, i'd consider partitioning | 23:26 |
| *** edmondsw has quit IRC | 23:26 | |
| jeblair | Shrews: *nod* change is 223333 | 23:27 |
| *** garyk has quit IRC | 23:27 | |
| pabelanger | zigo: 2016-07-13 23:25:35.726279 | .changes put in a distribution not listed within it! | 23:27 |
| *** yamahata has joined #openstack-infra | 23:27 | |
| *** karthikp_ has quit IRC | 23:28 | |
| pabelanger | zigo: full log: http://logs.openstack.org/0a/0a408c9a18c11bf5ccaacf001f6e8bfeb4d06805/post/reprepro-import-debian-openstack-jessie/eb77dd6//console.html | 23:28 |
| pabelanger | looks like you need to update your side now | 23:28 |
| *** sdake__ has joined #openstack-infra | 23:28 | |
| *** berendt has quit IRC | 23:28 | |
| zigo | pabelanger: Well, the .changes has "jessie", what's wrong with that? | 23:29 |
| pabelanger | zigo: we no longer have jessie, it is jessie-newton | 23:29 |
| zigo | :/ | 23:29 |
| zigo | pabelanger: I will fix, but not today, this implies changing the name of the chroot and such. | 23:30 |
| zigo | I need to go sleep. | 23:30 |
| pabelanger | zigo: okay, for the most part everything should be fixed on our side now | 23:31 |
| zigo | Hopefully ! :) | 23:31 |
| zigo | Thanks. | 23:31 |
| pabelanger | np | 23:31 |
| pabelanger | I'll start work on updating configure_mirror.sh to list the new mirror info | 23:31 |
| *** garyk has joined #openstack-infra | 23:31 | |
| zigo | At least, here, I'm in known grounds ... :P | 23:31 |
| *** sdake has quit IRC | 23:32 | |
| *** jamesmcarthur has quit IRC | 23:32 | |
| clarkb | pabelanger: re restarting nodepool things a nodepoold restart should pick up the new function demand code | 23:32 |
| clarkb | pabelanger: I will likely try to get that done sometime tomorrow | 23:32 |
| *** garyk has quit IRC | 23:32 | |
| pabelanger | okay | 23:32 |
| *** piet has quit IRC | 23:33 | |
| openstackgerrit | Merged openstack-infra/project-config: Disable npm for stackviz on fedora-24 https://review.openstack.org/341834 | 23:33 |
| *** piet has joined #openstack-infra | 23:33 | |
| *** garyk has joined #openstack-infra | 23:33 | |
| *** dingyichen has joined #openstack-infra | 23:33 | |
| *** dimtruck is now known as zz_dimtruck | 23:33 | |
| pabelanger | ianw: have you added your public sshkey yet? | 23:34 |
| pabelanger | ianw: curious if I need to wait around to restart nodepool-builder or if you have the permission now | 23:35 |
| ianw | pabelanger: i was playing with some 2fa stuff with it, but i think i'm going to not do that | 23:35 |
| *** hurgleburgler has quit IRC | 23:36 | |
| *** sdake__ has quit IRC | 23:36 | |
| ianw | since it basically adds a big failure point to what is something that is being used in a failure situation. "sorry i can't fix that, my gpg ssh agent is faffing about ..." | 23:37 |
| *** yuanying_off is now known as yuanying | 23:37 | |
| mordred | clarkb: zomg. back to /etc/hosts ? I feel like we've gone round in loops about setting /etc/hosts from glean like 20 times | 23:38 |
| ianw | so no, but i'll just do one with a strong password now | 23:38 |
| clarkb | therve: are you around? I am trying to debug a failing zaqar test on ubuntu xenial and wondering if it is familiar to you | 23:38 |
| clarkb | mordred: ya so my hostname is 'ubuntu' but because no config drive it neversets that in /etc/hosts which makes socket.gethostbyname(socket.gethostname)) fails | 23:39 |
| mordred | clarkb: also, if you don't have config-drive, then there is no point in having glean in an image. it's purpose in life is to take information from config-drive and use it to set things up on the host | 23:39 |
| clarkb | mordred: and that seemed to be tripped by wsgi in pbr and pifpaf | 23:39 |
| mordred | awesome | 23:39 |
| clarkb | mordred: yes but we are talking about giving other people our images to boot locally | 23:39 |
| mordred | ah | 23:39 |
| mordred | nod | 23:39 |
| clarkb | mordred: so just pointing out we either need to make it work without config drive | 23:39 |
| clarkb | OR | 23:39 |
| clarkb | let people know its required and give detaileddocs on how to make that work | 23:40 |
| mordred | sorry - when you said test instance, I was thinking one of our test vms | 23:40 |
| clarkb | (because it turns out that config drive is completely undocumented) | 23:40 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add debian-openstack source.list to debian https://review.openstack.org/341856 | 23:40 |
| notmorgan | mordred: o/ | 23:40 |
| mordred | yah - I think we should make it work without config-drive more better | 23:40 |
| clarkb | mordred: I am doing everything locally in order to figure these things out :) | 23:40 |
| mordred | clarkb: yup. I'm with you now | 23:40 |
| notmorgan | mordred: .. well crap, i just spaced on the question i was going to ask you | 23:40 |
| clarkb | ianw: speaking of config drive the only way I can get it to work locally is to use your blog post on it. The crazy thing is that your yaml files do not match anything like what cloud init documents as valid | 23:41 |
| notmorgan | clarkb, Shrews: issues with shade and slowness, can you duplicate it still [keystone admin vs non-admin] abnd if so can you provide me with a VM? | 23:41 |
| clarkb | ianw: and I think they won't work with glean but I might be wrong | 23:41 |
| notmorgan | or snapshot of said thing. | 23:41 |
| notmorgan | mordred: ^ you too. | 23:41 |
| *** watanabe_isao has joined #openstack-infra | 23:41 | |
| mordred | clarkb: fwiw, bifrost creates config drives for bare metals it boots | 23:41 |
| clarkb | mordred: is it as easy as rechecking shade and holding the test hosts? if so I can do that and give one to notmorgan | 23:41 |
| mordred | clarkb: grabbing the build-a-config-drive code from them and making it easily usable for vms sohuldn't be hard | 23:41 |
| clarkb | mordred: ya and it does them in a different format too as Irecently discovered | 23:41 |
| notmorgan | clarkb: not sure. | 23:41 |
| pabelanger | mordred: also, we have reprepro working in the gate for deb-openstack team. zigo just needs to make some changes on his side, but -infra is ready to publish them to AFS | 23:42 |
| clarkb | mordred: its why we have to check 3 different places for network config in glean | 23:42 |
| notmorgan | because i'd be happy to dig in further, but i just can't duplicate it locally (i've tried 5 different ways of installing it all now) | 23:42 |
| clarkb | rax is one, nova the other, and bifrost the third | 23:42 |
| *** hurgleburgler has joined #openstack-infra | 23:42 | |
| mordred | I thought bifrost just used the nova format - but oh well | 23:43 |
| *** jamesmcarthur has joined #openstack-infra | 23:43 | |
| clarkb | mordred: I think it might now, but for a long time it was its own thing | 23:43 |
| mordred | in any case, there is code for making one if we want to go that route | 23:43 |
| clarkb | and glean still supports old bifrost | 23:43 |
| mordred | nod | 23:43 |
| mordred | pabelanger: woot! | 23:43 |
| *** cardeois_ has quit IRC | 23:43 | |
| mordred | notmorgan, clarkb: re: shade - I put in a hold job in nodepool to catch a fail | 23:43 |
| clarkb | oh cool I will look for it | 23:43 |
| notmorgan | mordred: thanks | 23:44 |
| clarkb | hrm there none in hold now | 23:44 |
| clarkb | I wonder if it got cleaned up | 23:44 |
| clarkb | or is my grep wrong | 23:44 |
| mordred | clarkb: I also don't see any | 23:44 |
| ianw | clarkb: which post? if it's the one i'm thinking of, the clouds.yaml bit was for uploading to rax via shade? | 23:44 |
| *** mtanino has quit IRC | 23:44 | |
| mordred | clarkb: on the local vm thing, I'm going to have to defer to you for what's right there as that's not a thing I ever do | 23:45 |
| clarkb | ianw: https://www.technovelty.org/linux/running-cloud-images-locally.html | 23:45 |
| *** sdake has joined #openstack-infra | 23:46 | |
| *** sdake_ has quit IRC | 23:46 | |
| *** jamesmcarthur has quit IRC | 23:46 | |
| clarkb | mordred: I think easiest thign for users would be to take /etc/hostname if no config drive/metadata and edit /etc/hosts | 23:46 |
| clarkb | the other option is to make a thing that writes out a config drive given a few pieces of key info like hostname | 23:46 |
| mordred | clarkb: k. will that screw cloud users who have glean in an image but don't attach a config-drive? | 23:47 |
| clarkb | mordred: should I recheck a shade cahnge or are you able to work with notmorgan on that? | 23:47 |
| *** garyk has quit IRC | 23:47 | |
| clarkb | mordred: maybe? | 23:47 |
| *** jamesmcarthur has joined #openstack-infra | 23:47 | |
| clarkb | mordred: I would expect them to be broken too if using glean | 23:47 |
| clarkb | but not sure if they would be intentionally broken | 23:47 |
| mordred | right - that's the issue I've got ... "broken" here means different things depending on intent | 23:48 |
| mordred | and glean just always setting something in /etc/hosts seems potentially odd | 23:48 |
| ianw | clarkb: ohh, that one. yeah that's the config file for the "nocloud" plugin to cloud-init ... that wouldn't work with our images & glean | 23:48 |
| mordred | yah. glean not so much with supporting cloud-init user-data things | 23:48 |
| *** garyk has joined #openstack-infra | 23:49 | |
| mordred | that said - the theory should be largely the same - make an iso filesystem, attach it to the vm as device config-2 | 23:49 |
| clarkb | mordred: ya name resolution is hard | 23:49 |
| clarkb | mordred: I think you need to set config-2 at iso build time since its a disk label | 23:49 |
| clarkb | but ye | 23:49 |
| mordred | yah | 23:49 |
| clarkb | and really the hard part isn't the making iso or attaching it, its knowing what to put in it because there are a hundred different acceptable formats it seems like | 23:50 |
| clarkb | so you can't just tell someone use config drive | 23:50 |
| clarkb | you ahve to be very clear on what glean expects | 23:50 |
| *** sdake has quit IRC | 23:50 | |
| mordred | also - if someone is booting a vm to runa test in, are they going to _have_ a hostname they want the vm to have? | 23:50 |
| clarkb | ianw: ya I used it with an ubuntu published image to bootstrap my local virt stuff. I built an image with it then shifted to my built images | 23:51 |
| mordred | I mean, it seems like the sort of thing where we're going to say "you need to make a config-drive to contain the hostname" and the user is going to say "what hostname" | 23:51 |
| jeblair | "hostname" | 23:51 |
| clarkb | I know that I like to have proper hostnames because then my dhcp server does magical things | 23:51 |
| mordred | right | 23:51 |
| mordred | but that's not going to be 99.9 of our users who just want to reproduce a gate bug | 23:51 |
| *** garyk has quit IRC | 23:51 | |
| *** garyk1 has joined #openstack-infra | 23:51 | |
| clarkb | right for them the just make /etc/hosts match /etc/hostname default is what they will likelywant | 23:52 |
| clarkb | because then pbr works | 23:52 |
| mordred | yah. I'm leaning more towards that | 23:52 |
| clarkb | its possible there is a weird case where a "power" user would not want that behavior and also not use a config drive | 23:52 |
| clarkb | but I can't come up with a good situation for that myself | 23:52 |
| mordred | me either | 23:53 |
| mordred | thinking of us | 23:53 |
| mordred | we might want something different and not use config drive on a long-lived host | 23:53 |
| openstackgerrit | Merged openstack-infra/system-config: Add signing01.ci to cacti https://review.openstack.org/339190 | 23:53 |
| mordred | but we're also going to ansible in and puppet the thing right after boot | 23:53 |
| mordred | so likely don't care what glean did with /etc/hosts | 23:53 |
| clarkb | as long as we change /etc/hostname and /etc/hosts togetehr then we should be fine | 23:54 |
| *** tonytan4ever has quit IRC | 23:54 | |
| clarkb | in the new potential glean behavior land | 23:54 |
| mordred | wfm | 23:54 |
| clarkb | anyone have a trusty host handy? | 23:55 |
| clarkb | can you run python and check if 'from uuid import UUID, uuid4 as _uuid4, _uuid_generate_random' works? | 23:56 |
| clarkb | this fails on xenial but is in a code base so wondering what is going on | 23:56 |
| ianw | >>> from uuid import UUID, uuid4 as _uuid4, _uuid_generate_random | 23:56 |
| ianw | >>> | 23:56 |
| ianw | so, yep | 23:56 |
| clarkb | wow what changed | 23:56 |
| *** Kaiyan has quit IRC | 23:57 | |
| *** garyk1 has quit IRC | 23:57 | |
| clarkb | looks like you can import them individually but not together | 23:57 |
| * clarkb looks for a python changelog | 23:58 | |
| *** Sukhdev has quit IRC | 23:58 | |
| *** xarses has quit IRC | 23:59 | |
| notmorgan | clarkb: eeuuuwww. that fails on both 2.7.11 and 3.5.1 | 23:59 |
| *** Sukhdev has joined #openstack-infra | 23:59 | |
| notmorgan | clarkb: this might be an ubuntu "fix"? | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
