| clarkb | fungi: so I think I have confirmed your change is good | 00:04 |
|---|---|---|
| clarkb | fungi: at least for dib. If your test works I say you approve it | 00:04 |
| fungi | will do--it's still running for the moment | 00:05 |
| fungi | mmm... dried mango slices packed in paprika and cayenne | 00:06 |
| fungi | addictive | 00:07 |
| *** dmsimard_away is now known as dmsimard | 00:07 | |
| *** nelsnelson has quit IRC | 00:08 | |
| *** amitgandhinz has joined #openstack-infra | 00:09 | |
| mordred | clarkb: I get the post0 version - and with tons of prints in the code I cannot see where the post is getting added | 00:10 |
| clarkb | mordred: ya I was stumped too | 00:11 |
| *** dmsimard is now known as dmsimard_away | 00:12 | |
| *** mattfarina has quit IRC | 00:13 | |
| *** amitgandhinz has quit IRC | 00:14 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Set the executable bit on all dib element scripts https://review.openstack.org/146707 | 00:15 |
| clarkb | fungi: ^ I am testing that now | 00:15 |
| *** wenlock has quit IRC | 00:16 | |
| fungi | k | 00:18 |
| mordred | BOOM | 00:20 |
| mordred | found it | 00:20 |
| mordred | I have NO IDEA why | 00:20 |
| mordred | but I found it | 00:20 |
| *** markmcclain has joined #openstack-infra | 00:21 | |
| mordred | clarkb, fungi, dhellmann: https://review.openstack.org/146714 | 00:21 |
| *** markmcclain1 has joined #openstack-infra | 00:22 | |
| *** markmcclain has quit IRC | 00:22 | |
| *** mtanino_ has joined #openstack-infra | 00:23 | |
| *** Rockyg has quit IRC | 00:23 | |
| clarkb | mordred: thanks | 00:23 |
| clarkb | mriedem: ^ you will likely want a 0.9.4 tag on that | 00:23 |
| fungi | i saw that and thought it might be to blame, but couldn't reproduce to confirm | 00:24 |
| *** david-lyle has joined #openstack-infra | 00:24 | |
| mriedem | clarkb: mordred: ok, thanks | 00:24 |
| *** Rockyg has joined #openstack-infra | 00:24 | |
| *** mtanino has quit IRC | 00:24 | |
| mriedem | can i validate that by just running "tox -evenv python setup.py bdist_wheel" ? | 00:25 |
| mriedem | and checking the version | 00:25 |
| mordred | yah, should work | 00:25 |
| clarkb | mriedem: ya and python setup.py sdist | 00:25 |
| clarkb | though drop the tox iirc | 00:25 |
| clarkb | let me double check how we do it | 00:25 |
| mriedem | that came from the tarball job | 00:25 |
| mordred | I'm pretty sure we do it in the tox venv | 00:25 |
| clarkb | mriedem: oh then yes | 00:25 |
| mriedem | k, pulling it down now | 00:26 |
| *** markmcclain1 has quit IRC | 00:28 | |
| *** markmcclain has joined #openstack-infra | 00:29 | |
| clarkb | fungi: I am +2 on our two changes | 00:31 |
| clarkb | fungi: can you merge the two of them if you test comes back successful? | 00:31 |
| *** markmcclain1 has joined #openstack-infra | 00:33 | |
| *** markmcclain has quit IRC | 00:33 | |
| fungi | planning to | 00:33 |
| fungi | it's still downloading files to cache for devstack | 00:34 |
| clarkb | wow | 00:34 |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Pin python-daemon<2.0 https://review.openstack.org/146716 | 00:34 |
| fungi | on the fedora image finally | 00:34 |
| openstackgerrit | James E. Blair proposed openstack/requirements: DO NOT MERGE https://review.openstack.org/146673 | 00:35 |
| *** chlong has quit IRC | 00:35 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Remove py26 support https://review.openstack.org/146717 | 00:35 |
| *** banix has joined #openstack-infra | 00:35 | |
| *** annegentle has joined #openstack-infra | 00:36 | |
| Shrews | mordred: ^^^ | 00:36 |
| *** baoli has joined #openstack-infra | 00:37 | |
| *** ZZelle has quit IRC | 00:37 | |
| *** kmartin has joined #openstack-infra | 00:38 | |
| clarkb | fungi: oh are you testing all the images? | 00:38 |
| clarkb | I was just testing trust | 00:38 |
| *** dims__ has joined #openstack-infra | 00:39 | |
| *** baoli has quit IRC | 00:40 | |
| *** baoli has joined #openstack-infra | 00:41 | |
| fungi | clarkb: no, just devstack-trusty in hpcloud-b1 | 00:42 |
| clarkb | oh you mean downloading the image for fedora we cache on our images | 00:43 |
| *** avozza is now known as zz_avozza | 00:43 | |
| fungi | yep | 00:44 |
| *** Masahiro has joined #openstack-infra | 00:45 | |
| fungi | now it's on the trove mysql image download | 00:45 |
| *** david-lyle has quit IRC | 00:46 | |
| mriedem | clarkb: what provides the bdist_wheel targeT? | 00:46 |
| mriedem | i'm missing something from my env | 00:46 |
| clarkb | mriedem: wheel | 00:46 |
| clarkb | mriedem: so pip install wheel first iirc | 00:46 |
| mriedem | hmm, says i'm at the latest | 00:47 |
| mriedem | trying again | 00:47 |
| *** annegentle has quit IRC | 00:47 | |
| *** david-lyle has joined #openstack-infra | 00:51 | |
| *** asettle has joined #openstack-infra | 00:51 | |
| *** sputnik13 has quit IRC | 00:53 | |
| *** sputnik13 has joined #openstack-infra | 00:53 | |
| *** armax has joined #openstack-infra | 00:54 | |
| *** gyee has quit IRC | 00:55 | |
| *** TravT has joined #openstack-infra | 00:55 | |
| mriedem | ah, didn't have wheel in the venv | 00:55 |
| mriedem | creating build/bdist.linux-i686/wheel/sqlalchemy_migrate-0.9.3.post1.dist-info/WHEE | 00:55 |
| mriedem | that's what i should see? | 00:55 |
| mriedem | clarkb: mordred: ^? | 00:55 |
| clarkb | mriedem: no you should make a 0.9.4 tag on mordreds chagne then make sure it shows up only as 0.9.4 | 00:56 |
| clarkb | without any postX suffix | 00:56 |
| *** ddieterly has joined #openstack-infra | 00:56 | |
| clarkb | and if that works the nmerge mordreds change then push the tag up | 00:56 |
| fungi | it finally got to snapshotting | 00:56 |
| mriedem | ok, signed release tag? | 00:56 |
| *** hdd has joined #openstack-infra | 00:57 | |
| clarkb | fungi: so it worked \o/ | 00:57 |
| clarkb | mriedem: ya | 00:57 |
| mriedem | clarkb: booya | 00:58 |
| mriedem | creating build/bdist.linux-i686/wheel/sqlalchemy_migrate-0.9.4.dist-info/WHEEL | 00:58 |
| fungi | probably. close enough i'll go ahead and approve those changes anyway | 00:58 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Pin python-daemon<2.0 https://review.openstack.org/146716 | 01:03 |
| *** sputnik13 has quit IRC | 01:03 | |
| *** nosnos has joined #openstack-infra | 01:04 | |
| *** david-lyle has quit IRC | 01:04 | |
| *** nosnos has quit IRC | 01:04 | |
| fungi | approved. also the image finally finished snapshotting and went ready | 01:04 |
| *** nosnos has joined #openstack-infra | 01:05 | |
| *** annegentle has joined #openstack-infra | 01:06 | |
| *** melwitt has quit IRC | 01:07 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Remove py26 support https://review.openstack.org/146717 | 01:07 |
| *** hemna is now known as hemnafk | 01:08 | |
| *** nosnos has quit IRC | 01:09 | |
| *** dannywilson has quit IRC | 01:09 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Make build_short_uuid work with URLs with trailing slashes https://review.openstack.org/146722 | 01:10 |
| *** dkliban is now known as dkliban_afk | 01:12 | |
| *** Sukhdev has quit IRC | 01:12 | |
| *** mbacchi has quit IRC | 01:12 | |
| *** mohitsharma has joined #openstack-infra | 01:12 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for heat unit test fail bug 1408704 https://review.openstack.org/146556 | 01:14 |
| uvirtbot | Launchpad bug 1408704 in heat "mocking of oslo.utils.timeutils.utcnow() is not working" [Critical,Fix committed] https://launchpad.net/bugs/1408704 | 01:14 |
| openstackgerrit | Merged openstack-infra/project-config: Use PyMySQL and venv path when caching subunit2sql https://review.openstack.org/146682 | 01:15 |
| mordred | Shrews: ok - your comment was great - which means I have a patch bomb incoming | 01:16 |
| openstackgerrit | Merged openstack-infra/project-config: Set the executable bit on all dib element scripts https://review.openstack.org/146707 | 01:16 |
| Shrews | mordred: w00t | 01:16 |
| *** banix has quit IRC | 01:17 | |
| *** annegentle has quit IRC | 01:18 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Make build_short_uuid work with URLs with trailing slashes https://review.openstack.org/146722 | 01:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Refactor glance version call into method https://review.openstack.org/145604 | 01:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add image upload support https://review.openstack.org/145605 | 01:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Fix python3 unittests https://review.openstack.org/145651 | 01:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Debug log any time we re-raise an exception https://review.openstack.org/146633 | 01:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support uploading swift objects https://review.openstack.org/145603 | 01:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Explain obj_to_dict https://review.openstack.org/146724 | 01:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Don't include deleted images https://review.openstack.org/146725 | 01:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Remove positional args to create_server https://review.openstack.org/146726 | 01:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Pull in improvements from nodepool https://review.openstack.org/146727 | 01:19 |
| Shrews | *boom* | 01:19 |
| mordred | Shrews: also - I may have been hacking on the airplane earlier | 01:19 |
| mordred | clarkb misses the days when I used to get off of planes and let 30 patches drop :) | 01:20 |
| Shrews | mordred: crazy-pants | 01:20 |
| jeblair | mordred: can you look at https://jenkins03.openstack.org/job/check-requirements-integration-dsvm/424/console ? | 01:21 |
| *** markmcclain1 has quit IRC | 01:21 | |
| asselin | clarkb, fungi ok, I think we're good this time :) https://review.openstack.org/#/c/146666/ | 01:21 |
| jeblair | clarkb: you may be interested too ^ | 01:21 |
| *** markmcclain has joined #openstack-infra | 01:21 | |
| *** bhuvan has quit IRC | 01:22 | |
| mtreinish | fungi: had a reason for what? But, chances are I probably didn't and was just sloppy :) | 01:22 |
| jeblair | mordred: i'm trying to figure out why the update.py script did not print "Version change for: "... and the rest of the updated message that's in there | 01:22 |
| mordred | jeblair: looking | 01:22 |
| *** nelsnelson has joined #openstack-infra | 01:22 | |
| jeblair | mordred: and yet, it dif the "git commit" which is supposed to only happen if the repo is different | 01:22 |
| *** sabari is now known as zz_sabari | 01:23 | |
| *** ihrachyshka has quit IRC | 01:23 | |
| fungi | mtreinish: sudo vs sudo -i between the prep script and dib element | 01:23 |
| jeblair | mordred: i'm looking into this because strangely, hp's internal version is doing the exact oppsite -- it prints the updated message but does not run "git commit" | 01:23 |
| mordred | jeblair: oh, spectacular | 01:23 |
| *** rkukura has quit IRC | 01:24 | |
| mordred | jeblair: well, we fixed weird version earlier today that had something to do with svn | 01:24 |
| mordred | so it might just be one of those days | 01:24 |
| *** nelsnelson has quit IRC | 01:24 | |
| jeblair | mordred: neither job appears to run like i expect. i'm trying to understand the reason | 01:24 |
| *** yamahata has quit IRC | 01:24 | |
| jeblair | i don't think this is a python version thing, i think this is just shell and python script mechanics | 01:24 |
| mtreinish | fungi: yeah I think that was just copy and paste from other scripts in those dirs | 01:25 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Remove py26 support https://review.openstack.org/146717 | 01:25 |
| mordred | jeblair: btw - investigation goes better when I pull the latest code ... | 01:25 |
| mtreinish | fungi: is it causing an issue? | 01:25 |
| *** chlong has joined #openstack-infra | 01:25 | |
| *** otter768 has joined #openstack-infra | 01:26 | |
| *** nosnos has joined #openstack-infra | 01:26 | |
| fungi | mtreinish: nah | 01:26 |
| mordred | jeblair: possibly hacking | 01:27 |
| fungi | mtreinish: https://review.openstack.org/146682 covered the remaining outstanding issues with it | 01:27 |
| mordred | jeblair: there are a few cases, hacking being one, where changes is not appended to, so if changes would be false | 01:27 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 01:27 | |
| mtreinish | fungi: ah very cool thanks | 01:27 |
| mordred | jeblair: /me talking out loud at the moment - still reading | 01:27 |
| mtreinish | oh, yeah forgot about the mysql connector install | 01:28 |
| StevenK | mordred: Are you in Auckland yet, out of interest? | 01:28 |
| mtreinish | and I guess pymysql was easier because it was pure python | 01:28 |
| mordred | StevenK: nope. I will board in 1.5 hours and then will fly there | 01:28 |
| jeblair | mordred: i changed 'sqlalchemy' in my test change | 01:28 |
| StevenK | mordred: So your ETA is tonight? | 01:28 |
| mordred | jeblair: ah. ok. then yeah - I would not expect that behavior | 01:29 |
| jeblair | mordred: https://review.openstack.org/#/c/68546/ says "git diff" can be buggy | 01:29 |
| jeblair | though that does not explain the lack of the printed output from "if changes" | 01:29 |
| mordred | jeblair: wow. | 01:29 |
| *** otter768 has quit IRC | 01:30 | |
| *** ihrachyshka has joined #openstack-infra | 01:31 | |
| jeblair | mordred: when i run the update.py code locally, it prints the output as expected :/ | 01:31 |
| fungi | mtreinish: yeah, no need to install c headers on the system that way | 01:32 |
| mordred | jeblair: I can't see any logic that would cause that - any chance there is something in devstack eating output since it's being called ina subshell in a function? | 01:33 |
| * mordred grasping at straws | 01:33 | |
| jeblair | mordred: oh, huh, the script did output the message for ironic | 01:33 |
| mordred | jeblair: other thing- elif _functionally_equal(old_require, source_reqs[old_pip]): | 01:33 |
| mtreinish | fungi: I wonder if it makes effects performance (I doubt it) | 01:34 |
| * mtreinish tests | 01:34 | |
| mriedem | clarkb: https://review.openstack.org/#/c/146714/ is merged, i'm pushing that 0.9.4 tag now | 01:34 |
| jeblair | mordred: since we've now seen one instance of output, then i don't think the _functionally_equal call could be involved | 01:34 |
| *** nosnos has quit IRC | 01:34 | |
| *** signed8bit has quit IRC | 01:34 | |
| jeblair | mordred: i think that at least tells us that we're running the correct version of the script | 01:34 |
| mordred | jeblair: well that's a good thing! | 01:34 |
| jeblair | mordred: i still don't know why we would have git commits without that output though | 01:35 |
| *** ryanpetrello has quit IRC | 01:35 | |
| mordred | me either | 01:35 |
| *** achanda has joined #openstack-infra | 01:35 | |
| *** hichtakk has quit IRC | 01:35 | |
| mordred | maybe send in another patch and hardcode verbose to true? | 01:35 |
| mordred | so that we can see a few of those trace messages to make sure | 01:36 |
| mordred | hrm. I guess that's only one message - might not be worth it | 01:36 |
| mtreinish | fungi: heh, it's noticeably slower :) | 01:36 |
| *** david-lyle has joined #openstack-infra | 01:37 | |
| *** koolhead17 has joined #openstack-infra | 01:38 | |
| *** markmcclain has quit IRC | 01:38 | |
| *** markmcclain has joined #openstack-infra | 01:38 | |
| fungi | nowhere near as slow as downloading that ubuntu root tarball for the openvz support we don't test | 01:38 |
| mordred | fungi: are we still doing that? | 01:38 |
| mtreinish | fungi: heh, actually ignore me I'm on the other side of the world so it's probably latency from that | 01:39 |
| fungi | yep | 01:39 |
| mordred | fungi: I could have sworn that I got angry and deleted that a while back just out of spite | 01:39 |
| mordred | jeblair: I'm very baffled by your thing | 01:39 |
| *** kmartin has quit IRC | 01:40 | |
| *** shakamunyi has quit IRC | 01:40 | |
| lifeless | mtreinish: oh yeah, welcome to latency. THIS is why some things reallllly bug me :) | 01:43 |
| fungi | mordred: i guess it grew back | 01:44 |
| jeblair | mordred: hrm, the only time it's outputing the change info is if oslo.serialization changes | 01:44 |
| mordred | jeblair: that is ... I mean ... what? | 01:45 |
| jeblair | mordred: i just don't know. when i run it locally, it still outputs it with my sqlalchemy change | 01:45 |
| *** signed8bit has joined #openstack-infra | 01:46 | |
| *** jerryz has joined #openstack-infra | 01:46 | |
| mordred | jeblair: I don't see anything in the reqs file that would cause it to break in such a way as to only see oslo.serialization | 01:46 |
| jeblair | i'm going to hold the node | 01:46 |
| *** mtanino_ has quit IRC | 01:46 | |
| mriedem | clarkb: it worked https://pypi.python.org/pypi/sqlalchemy-migrate/0.9.4 | 01:46 |
| mriedem | mordred: thanks for the fix | 01:47 |
| *** achanda has quit IRC | 01:47 | |
| *** dannywilson has joined #openstack-infra | 01:47 | |
| mordred | jeblair: if you find out that there is a special hacked version of python there that is causing this, I'm going to lose it | 01:48 |
| *** otter768 has joined #openstack-infra | 01:49 | |
| *** achanda has joined #openstack-infra | 01:50 | |
| *** achanda has quit IRC | 01:51 | |
| *** bdpayne has quit IRC | 01:51 | |
| *** markmcclain has quit IRC | 01:51 | |
| *** markmcclain has joined #openstack-infra | 01:52 | |
| *** dannywilson has quit IRC | 01:52 | |
| *** david-lyle has quit IRC | 01:52 | |
| *** markmcclain has quit IRC | 01:54 | |
| *** kgiusti has quit IRC | 01:56 | |
| *** mohitsharma has joined #openstack-infra | 01:57 | |
| *** annegentle has joined #openstack-infra | 01:58 | |
| openstackgerrit | Merged openstack-dev/pbr: Be more aggressive about building wheels https://review.openstack.org/146650 | 02:02 |
| *** jyuso has joined #openstack-infra | 02:03 | |
| *** Rockyg has quit IRC | 02:03 | |
| *** annegentle has quit IRC | 02:03 | |
| *** Rockyg has joined #openstack-infra | 02:06 | |
| *** ryanpetrello has joined #openstack-infra | 02:07 | |
| *** dims__ has quit IRC | 02:09 | |
| *** thingee has quit IRC | 02:09 | |
| jeblair | sdague: i don't understand why there was no "Version change" output here: http://paste.openstack.org/show/156660/ | 02:09 |
| *** dims__ has joined #openstack-infra | 02:09 | |
| jeblair | mordred: i can't reproduce it on that host :/ | 02:10 |
| mordred | jeblair: ????? | 02:10 |
| jeblair | yeah, i made a new clone of nova, ran the script, and got the output that i should have | 02:10 |
| mordred | jeblair, clarkb, fungi: btw- you might have opinions on https://review.openstack.org/#/c/146679/ | 02:11 |
| *** tqtran has quit IRC | 02:11 | |
| mordred | which is ianw's change to add some suggestions about where external devstack plugins can and can't live | 02:11 |
| mordred | jeblair: I looked through the devstack code that calls update.py | 02:11 |
| mordred | jeblair: I see nothing that would cause output to be eaten | 02:11 |
| *** banix has joined #openstack-infra | 02:12 | |
| mordred | jeblair: and of course ironic did get applied | 02:13 |
| *** oomichi has joined #openstack-infra | 02:13 | |
| *** TravT has quit IRC | 02:13 | |
| jeblair | ianw, mordred: further, devstack needs to not clone anything, including those plugin repos, when running in the gate. they need to be cloned and prepared by zuul as normal for other repos | 02:14 |
| *** dims__ has quit IRC | 02:14 | |
| jeblair | ianw, mordred: i think that's probably already the case in sdague's implementation | 02:16 |
| *** spzala has quit IRC | 02:16 | |
| mordred | jeblair: I think you're right - and I also agree with you | 02:17 |
| *** ihrachyshka has quit IRC | 02:19 | |
| clarkb | usually those plugins have gone in the project they test. works well | 02:19 |
| jeblair | clarkb: yeah, i like that approach too. i could see the argument that perhaps that's not the best place for them? | 02:21 |
| openstackgerrit | Angus Salkeld proposed openstack-infra/project-config: Allow Heat to provide some localrc options https://review.openstack.org/146736 | 02:21 |
| *** salv-orlando has quit IRC | 02:25 | |
| *** zz_dimtruck is now known as dimtruck | 02:29 | |
| *** rwsu has quit IRC | 02:37 | |
| *** zz_sabari is now known as sabari | 02:38 | |
| *** Rockyg has quit IRC | 02:39 | |
| *** banix has quit IRC | 02:40 | |
| *** signed8bit has quit IRC | 02:41 | |
| *** stevemar has joined #openstack-infra | 02:43 | |
| *** banix has joined #openstack-infra | 02:44 | |
| *** dims__ has joined #openstack-infra | 02:45 | |
| ianw | i'm mostly worried that people have their scripts in github, push in changes which get picked up on the next run and it breaks | 02:46 |
| *** banix has quit IRC | 02:47 | |
| *** dims__ has quit IRC | 02:47 | |
| *** dims__ has joined #openstack-infra | 02:48 | |
| mordred | ianw: yah - that's amongst the reasons I think that we need to make it a hard rule and not a recommendation | 02:48 |
| mordred | ianw: it's WAY too complex up in here to accomodate an obsession with some other code hosting service | 02:48 |
| ianw | ok, i'll reword and add some info on devstack-gate | 02:49 |
| *** yamahata has joined #openstack-infra | 02:49 | |
| *** mohitsha_ has joined #openstack-infra | 02:50 | |
| *** mohitsharma has quit IRC | 02:53 | |
| *** david-lyle has joined #openstack-infra | 02:55 | |
| jogo | https://review.openstack.org/#/c/146192/ should fix some gate bugs | 02:57 |
| jogo | tested and all so at the very least it shouldn't break things | 02:57 |
| jogo | clarkb fungi: ^ | 02:57 |
| jogo | mordred: what happened with 'dox'? | 02:58 |
| *** hdd has quit IRC | 02:59 | |
| *** banix has joined #openstack-infra | 03:00 | |
| ianw | jeblair: are you talking about something else other than the cloning done from projects.yaml? | 03:00 |
| *** banix has quit IRC | 03:01 | |
| jeblair | ianw: devstack-gate clones all repos spcified in its PROJECTS list, and it also sets a flag for devstack that tells it _not_ to clone anything on its own and error out if that happens | 03:01 |
| ianw | oh, right, that bit | 03:01 |
| jeblair | ianw: that's the cloning i was referring to. as for projects.yaml, if someone wants to import something from github into stackforge, that's fine (is not at issue here). | 03:02 |
| ianw | yeah, that might be worth calling out | 03:02 |
| ianw | jeblair: i presume you're looking at moving that into a yaml file like the testing matrix? or something else? | 03:03 |
| jeblair | ianw: using zuul cloner, so probably a clone mapper yaml file | 03:03 |
| *** dims__ has quit IRC | 03:04 | |
| *** barra204 has joined #openstack-infra | 03:05 | |
| *** asettle has quit IRC | 03:08 | |
| *** bdpayne has joined #openstack-infra | 03:09 | |
| *** hdd has joined #openstack-infra | 03:10 | |
| *** julim has joined #openstack-infra | 03:13 | |
| *** Masahiro has quit IRC | 03:15 | |
| *** patrickeast has quit IRC | 03:15 | |
| *** koolhead17 has quit IRC | 03:16 | |
| *** ddieterly has quit IRC | 03:18 | |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Include descriptions in review dialog https://review.openstack.org/146744 | 03:18 |
| jeblair | mtreinish: ^ | 03:19 |
| *** banix has joined #openstack-infra | 03:20 | |
| *** jyuso has quit IRC | 03:22 | |
| *** barra204 has quit IRC | 03:22 | |
| *** bdpayne has quit IRC | 03:23 | |
| *** markmcclain has joined #openstack-infra | 03:23 | |
| *** amrith is now known as _amrith_ | 03:23 | |
| *** _amrith_ is now known as amrith | 03:24 | |
| *** salv-orlando has joined #openstack-infra | 03:26 | |
| *** hdd has quit IRC | 03:27 | |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Colorize values in review dialog https://review.openstack.org/146746 | 03:30 |
| jeblair | mtreinish: ^ and there's the full trio | 03:30 |
| *** camunoz has quit IRC | 03:31 | |
| *** harlowja is now known as harlowja_away | 03:31 | |
| *** camunoz has joined #openstack-infra | 03:31 | |
| *** camunoz is now known as camunoz_mtg | 03:32 | |
| *** weshay has quit IRC | 03:35 | |
| *** mriedem has quit IRC | 03:35 | |
| *** markmcclain has quit IRC | 03:35 | |
| *** yaguang has joined #openstack-infra | 03:36 | |
| mtreinish | jeblair: cool, thanks | 03:36 |
| *** barra204 has joined #openstack-infra | 03:37 | |
| mtreinish | wow, that's much simpler than I thought it would be. Clearly I was missing something :) | 03:37 |
| *** markmcclain has joined #openstack-infra | 03:37 | |
| jeblair | mtreinish: yeah, the interaction of attrmaps isn't obvious, but are pretty powerful | 03:37 |
| *** markmcclain has quit IRC | 03:38 | |
| *** markmcclain has joined #openstack-infra | 03:38 | |
| *** harlowja_away is now known as harlowja | 03:39 | |
| *** amrith is now known as _amrith_ | 03:41 | |
| jeblair | mtreinish: you can basically wrap any widget and make palette substitutions, including (in this case) change the default (unstyled) text to something else | 03:41 |
| *** banix has quit IRC | 03:42 | |
| *** jyuso has joined #openstack-infra | 03:42 | |
| *** salv-orlando has quit IRC | 03:42 | |
| *** ivar-laz_ has joined #openstack-infra | 03:49 | |
| *** rlandy has quit IRC | 03:50 | |
| *** ivar-lazzaro has quit IRC | 03:52 | |
| *** ivar-laz_ has quit IRC | 03:53 | |
| *** Ryan_Lane has quit IRC | 03:55 | |
| *** yaguang has quit IRC | 04:00 | |
| *** pcrews has quit IRC | 04:03 | |
| *** yfried_ has joined #openstack-infra | 04:03 | |
| *** koolhead17 has joined #openstack-infra | 04:05 | |
| *** camunoz_mtg has quit IRC | 04:06 | |
| *** banix has joined #openstack-infra | 04:06 | |
| *** Masahiro has joined #openstack-infra | 04:06 | |
| *** pcrews has joined #openstack-infra | 04:08 | |
| jogo | anteaya: https://review.openstack.org/#/c/146192/ | 04:09 |
| *** camunoz has joined #openstack-infra | 04:09 | |
| *** ddieterly has joined #openstack-infra | 04:09 | |
| *** bdpayne has joined #openstack-infra | 04:10 | |
| *** ddieterly has quit IRC | 04:11 | |
| *** ddieterly has joined #openstack-infra | 04:11 | |
| *** banix has quit IRC | 04:13 | |
| *** ddieterly has quit IRC | 04:16 | |
| *** hdd has joined #openstack-infra | 04:18 | |
| *** david-lyle has quit IRC | 04:20 | |
| *** camunoz has quit IRC | 04:21 | |
| *** teran_ has joined #openstack-infra | 04:21 | |
| *** ryanpetrello has quit IRC | 04:22 | |
| *** teran__ has joined #openstack-infra | 04:23 | |
| *** teran has quit IRC | 04:24 | |
| *** amotoki has quit IRC | 04:25 | |
| *** amotoki has joined #openstack-infra | 04:25 | |
| *** teran_ has quit IRC | 04:26 | |
| *** Longgeek has joined #openstack-infra | 04:26 | |
| *** otter768 has quit IRC | 04:27 | |
| *** Longgeek has quit IRC | 04:27 | |
| *** pcrews has quit IRC | 04:30 | |
| *** Longgeek has joined #openstack-infra | 04:31 | |
| *** achanda has joined #openstack-infra | 04:32 | |
| *** david-lyle has joined #openstack-infra | 04:33 | |
| *** camunoz has joined #openstack-infra | 04:34 | |
| *** tomoe has joined #openstack-infra | 04:35 | |
| *** markmcclain has quit IRC | 04:36 | |
| *** bdpayne has joined #openstack-infra | 04:38 | |
| *** mohitsha_ has quit IRC | 04:46 | |
| *** pradhan has joined #openstack-infra | 04:47 | |
| *** sabari is now known as zz_sabari | 04:47 | |
| *** dannywilson has joined #openstack-infra | 04:48 | |
| *** david-lyle has quit IRC | 04:48 | |
| *** ayoung has quit IRC | 04:49 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Move devstack f20 jobs to f21 https://review.openstack.org/146760 | 04:49 |
| *** dannywilson has quit IRC | 04:53 | |
| pradhan | <pradhan> jaypipes: I was trying to set up third party CI following your #link https://www.mirantis.com/blog/setting-external-openstack-testing-system-part-1/ while setting up the jenkin master, bash install_master.sh throws error: Error: Could not find class snmpd for ubuntu on node ubuntu | 04:53 |
| pradhan | jaypipes: any work around please | 04:55 |
| *** mohitsharma has joined #openstack-infra | 04:57 | |
| *** amotoki has quit IRC | 04:58 | |
| *** pradhan has quit IRC | 05:02 | |
| *** amotoki_ has joined #openstack-infra | 05:02 | |
| *** yaguang has joined #openstack-infra | 05:03 | |
| *** baoli_ has joined #openstack-infra | 05:03 | |
| *** baoli_ has quit IRC | 05:04 | |
| *** stevemar has quit IRC | 05:04 | |
| *** baoli_ has joined #openstack-infra | 05:04 | |
| *** stevemar has joined #openstack-infra | 05:05 | |
| *** baoli has quit IRC | 05:05 | |
| *** baoli has joined #openstack-infra | 05:05 | |
| *** baoli_ has quit IRC | 05:06 | |
| clarkb | fungi: if you are still around can I enable puppet on nodepool.o.o? | 05:06 |
| clarkb | fungi: I want to make sure tha ttomorrow's image builds happen. I will probably go ahead and enable it | 05:06 |
| clarkb | fungi: since your fixes were pushed up | 05:06 |
| *** _buzz has quit IRC | 05:07 | |
| *** teran__ has quit IRC | 05:08 | |
| *** _buzz has joined #openstack-infra | 05:08 | |
| *** amotoki_ has quit IRC | 05:08 | |
| openstackgerrit | Maru Newby proposed openstack-infra/zuul: Add support for skip-if-only job filters https://review.openstack.org/146762 | 05:09 |
| *** garyh has quit IRC | 05:09 | |
| *** yfried_ has quit IRC | 05:10 | |
| *** signed8bit has joined #openstack-infra | 05:14 | |
| *** ddieterly has joined #openstack-infra | 05:14 | |
| *** marun has quit IRC | 05:15 | |
| *** banix has joined #openstack-infra | 05:17 | |
| *** punith has joined #openstack-infra | 05:18 | |
| *** ddieterly has quit IRC | 05:19 | |
| *** achanda has quit IRC | 05:20 | |
| *** amotoki has joined #openstack-infra | 05:24 | |
| *** signed8bit has quit IRC | 05:25 | |
| *** dimtruck is now known as zz_dimtruck | 05:31 | |
| *** koolhead17 has quit IRC | 05:33 | |
| *** _et has joined #openstack-infra | 05:33 | |
| *** zz_dimtruck is now known as dimtruck | 05:34 | |
| *** achanda has joined #openstack-infra | 05:35 | |
| *** zz_sabari is now known as sabari | 05:35 | |
| punith | ERROR zuul.IndependentPipelineManager: Unable to find change queue for project openstack/cinder | 05:36 |
| punith | hi can someone having internal knowledge of zuul explain this error ? | 05:36 |
| punith | ERROR zuul.IndependentPipelineManager: Unable to find change queue for project openstack/cinder | 05:36 |
| *** achanda has quit IRC | 05:37 | |
| *** dimtruck is now known as zz_dimtruck | 05:38 | |
| *** Longgeek has quit IRC | 05:39 | |
| *** Longgeek has joined #openstack-infra | 05:39 | |
| *** harlowja is now known as harlowja_away | 05:42 | |
| *** hdd has quit IRC | 05:43 | |
| clarkb | I thibk that means you dont have jobs set up for cinder but got cinder events | 05:45 |
| clarkb | so in zuuls layout.yaml add openstack/cinder to the projects list with some jobs if that is your goal | 05:46 |
| *** jerryz has quit IRC | 05:48 | |
| *** teran has joined #openstack-infra | 05:49 | |
| *** teran has quit IRC | 05:49 | |
| *** teran has joined #openstack-infra | 05:49 | |
| *** koolhead17 has joined #openstack-infra | 05:50 | |
| *** oomichi has quit IRC | 05:51 | |
| *** tomoe_ has joined #openstack-infra | 05:51 | |
| *** yfried_ has joined #openstack-infra | 05:55 | |
| *** tomoe has quit IRC | 05:55 | |
| *** salv-orlando has joined #openstack-infra | 05:58 | |
| *** salv-orlando has quit IRC | 06:00 | |
| *** jerryz has joined #openstack-infra | 06:00 | |
| *** pcrews has joined #openstack-infra | 06:02 | |
| *** xyang1 has quit IRC | 06:03 | |
| punith | hi this is my current layout.yaml for zuul in our ci setup | 06:04 |
| punith | http://paste.openstack.org/show/156776/ | 06:04 |
| *** dims__ has joined #openstack-infra | 06:04 | |
| *** david-lyle has joined #openstack-infra | 06:08 | |
| *** dims__ has quit IRC | 06:09 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Use correct path for tempest in testr dib script https://review.openstack.org/146768 | 06:09 |
| *** ddieterly has joined #openstack-infra | 06:10 | |
| *** ddieterly has quit IRC | 06:14 | |
| *** yfried_ has quit IRC | 06:14 | |
| *** mohitsharma has quit IRC | 06:15 | |
| clarkb | fungi: ^ dib finallyworks with that. I have puppet disabled on nodepool.o.o to get that on but once it merges (and probably before) it hsould be fine to reenable puppet | 06:16 |
| clarkb | punith: sorry but I don't see anything abviously wrong. Are the errors tied to zuul not doing something you expect it to | 06:17 |
| *** amotoki has quit IRC | 06:17 | |
| *** mohitsharma has joined #openstack-infra | 06:17 | |
| *** pcrews has quit IRC | 06:18 | |
| *** amotoki has joined #openstack-infra | 06:18 | |
| punith | zuul seems to read the gerrit events and posts the merge failed comment in the gerrit | 06:18 |
| clarkb | do you have a running zuul merger? | 06:18 |
| punith | Unable to merge change <Change 0x7ffb95c4e350 146763,2> | 06:18 |
| punith | yes | 06:18 |
| clarkb | if so check the zuul merger logs. | 06:18 |
| clarkb | it shoud tell you why the merge check failed | 06:19 |
| punith | yes it is giving a python trace | 06:19 |
| punith | 2015-01-13 11:42:51,423 ERROR zuul.Merger: Exception while merging a change: | 06:19 |
| *** mohitsharma has quit IRC | 06:19 | |
| *** mohitsha_ has joined #openstack-infra | 06:19 | |
| punith | File "/usr/local/lib/python2.7/dist-packages/git/remote.py", line 252, in _from_line | 06:19 |
| *** yfried_ has joined #openstack-infra | 06:19 | |
| punith | zuul merger.log trace http://paste.openstack.org/show/156785/ | 06:20 |
| *** doude_ has quit IRC | 06:21 | |
| clarkb | oh right gitpython having a hard time | 06:22 |
| punith | http://paste.openstack.org/show/156793/ | 06:22 |
| punith | this is debug log | 06:22 |
| clarkb | what version of gitpython do you have installed? check `pip freeze` | 06:22 |
| punith | root@cimaster:/var/log/zuul# git version git version 1.7.9.5 | 06:22 |
| *** emagana has quit IRC | 06:23 | |
| punith | root@cimaster:/var/log/zuul# pip -V pip 6.0.3 from /usr/local/lib/python2.7/dist-packages (python 2.7) | 06:23 |
| clarkb | what about gitpython | 06:24 |
| *** yfried_ has quit IRC | 06:24 | |
| *** yfried__ has joined #openstack-infra | 06:24 | |
| *** punith has quit IRC | 06:27 | |
| *** naggappan has joined #openstack-infra | 06:27 | |
| *** punith has joined #openstack-infra | 06:28 | |
| *** otter768 has joined #openstack-infra | 06:28 | |
| *** otter768 has quit IRC | 06:32 | |
| *** BharatK has joined #openstack-infra | 06:32 | |
| *** punith has quit IRC | 06:34 | |
| BharatK | Hi All | 06:34 |
| *** punit_ has joined #openstack-infra | 06:34 | |
| BharatK | Can anyone please tell me the procedure to create a project in https://git.openstack.org/cgit/stackforge/? | 06:35 |
| BharatK | I mean project in opestack stackforge | 06:35 |
| *** Longgeek has quit IRC | 06:36 | |
| clarkb | BharatK: see http://ci.openstack.org/stackforge.html | 06:36 |
| BharatK | clarkb, Thanks, I followed http://docs.openstack.org/infra/manual/creators.html document | 06:37 |
| BharatK | But I didn't find any clue for creation. | 06:37 |
| *** salv-orlando has joined #openstack-infra | 06:40 | |
| clarkb | BharatK: if you read through that it shoul dtake you step by step through the entire process | 06:42 |
| *** Longgeek has joined #openstack-infra | 06:42 | |
| clarkb | was there something in particular that was confusing? | 06:42 |
| *** jyuso has quit IRC | 06:42 | |
| *** salv-orlando has quit IRC | 06:43 | |
| *** banix has quit IRC | 06:45 | |
| *** punit_ has quit IRC | 06:45 | |
| BharatK | clarkb, Yeah is there any web portal to create an account, | 06:46 |
| BharatK | Or do I need to send mail to openstack-infra team to create a project | 06:46 |
| clarkb | neither, you submit a gerrit change that is reviewed and when merged your project gets created | 06:47 |
| *** Abhishek has joined #openstack-infra | 06:47 | |
| clarkb | that doc walks through all the file changes and so on | 06:47 |
| *** punith has joined #openstack-infra | 06:48 | |
| *** bdpayne has quit IRC | 06:49 | |
| BharatK | Oh okay. Can you please point me to any such earlier patch set? | 06:49 |
| *** ildikov has joined #openstack-infra | 06:49 | |
| *** banix has joined #openstack-infra | 06:50 | |
| *** _et has quit IRC | 06:51 | |
| *** ryanpetrello has joined #openstack-infra | 06:52 | |
| clarkb | punith: 0.3.2.1 is what we use so I don't think that is the problem | 06:53 |
| clarkb | punith: I really don't know you will have to debug why you get that traceback | 06:53 |
| punith | sure clark, thanks a lot | 06:54 |
| clarkb | BharatK: https://review.openstack.org/#/c/145160/ | 06:55 |
| BharatK | clarkb, Thank you very much clarkb | 06:55 |
| BharatK | clarkb, This helps me a lot. | 06:55 |
| *** unicell has joined #openstack-infra | 07:05 | |
| *** banix has quit IRC | 07:06 | |
| BharatK | clarkb, I just want to place my plugin code in stackforge | 07:07 |
| BharatK | clarkb, even for that also we need to follow the same procedure? | 07:07 |
| clarkb | yes | 07:07 |
| BharatK | clarkb, Okay thank you once again. | 07:08 |
| *** mrunge has joined #openstack-infra | 07:08 | |
| *** ddieterly has joined #openstack-infra | 07:10 | |
| *** tkelsey has joined #openstack-infra | 07:10 | |
| *** yfried__ is now known as yfried|afk | 07:11 | |
| *** yfried|afk is now known as yfried__ | 07:12 | |
| clarkb | woot got a dib image based node to boot in hpcloud | 07:12 |
| clarkb | with that time for bed | 07:12 |
| *** jyuso has joined #openstack-infra | 07:14 | |
| *** ddieterly has quit IRC | 07:15 | |
| *** ryanpetrello has quit IRC | 07:17 | |
| *** ddieterly has joined #openstack-infra | 07:18 | |
| openstackgerrit | Merged openstack-infra/project-config: Reduce number of services running in large-ops https://review.openstack.org/146192 | 07:19 |
| *** david-lyle has quit IRC | 07:22 | |
| *** ddieterly has quit IRC | 07:23 | |
| *** sabari is now known as zz_sabari | 07:27 | |
| *** zz_sabari is now known as sabari | 07:27 | |
| *** unicell has quit IRC | 07:31 | |
| *** sabari is now known as zz_sabari | 07:32 | |
| *** yaguang has quit IRC | 07:37 | |
| *** amotoki has quit IRC | 07:40 | |
| *** amotoki has joined #openstack-infra | 07:40 | |
| *** mrmartin has joined #openstack-infra | 07:42 | |
| *** pcrews has joined #openstack-infra | 07:44 | |
| *** mrmartin has quit IRC | 07:47 | |
| *** jlibosva has joined #openstack-infra | 07:49 | |
| *** mohitsharma has joined #openstack-infra | 07:51 | |
| *** mohitsha_ has quit IRC | 07:52 | |
| *** kashyap has quit IRC | 07:53 | |
| *** deepakcs has joined #openstack-infra | 07:54 | |
| deepakcs | clarkb, ping | 07:54 |
| *** praveenkumar has quit IRC | 07:54 | |
| *** e0ne has joined #openstack-infra | 07:55 | |
| *** markus_z has joined #openstack-infra | 07:55 | |
| *** dhritishikhar has joined #openstack-infra | 07:56 | |
| *** kashyap_bbiab has joined #openstack-infra | 07:59 | |
| *** kashyap_bbiab is now known as kashyap | 07:59 | |
| *** e0ne is now known as e0ne_ | 08:02 | |
| *** Ala has joined #openstack-infra | 08:02 | |
| *** zz_avozza is now known as avozza | 08:03 | |
| *** mrmartin has joined #openstack-infra | 08:06 | |
| *** pcrews has quit IRC | 08:07 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Interpolate params inside of params. https://review.openstack.org/143138 | 08:07 |
| *** e0ne_ has quit IRC | 08:08 | |
| *** praveenkumar has joined #openstack-infra | 08:08 | |
| *** chlong has quit IRC | 08:09 | |
| *** imeerovi has joined #openstack-infra | 08:09 | |
| *** kashyap` has joined #openstack-infra | 08:13 | |
| *** praveenkumar_ has joined #openstack-infra | 08:13 | |
| *** Abhishek has quit IRC | 08:14 | |
| *** kashyap has quit IRC | 08:15 | |
| *** salv-orlando has joined #openstack-infra | 08:16 | |
| *** Sukhdev has joined #openstack-infra | 08:17 | |
| *** praveenkumar has quit IRC | 08:17 | |
| *** k4n0 has joined #openstack-infra | 08:18 | |
| *** arxcruz has joined #openstack-infra | 08:18 | |
| *** e0ne has joined #openstack-infra | 08:20 | |
| *** funzo_ has joined #openstack-infra | 08:23 | |
| *** salv-orlando has quit IRC | 08:24 | |
| *** funzo has quit IRC | 08:25 | |
| *** e0ne is now known as e0ne_ | 08:25 | |
| *** armax has quit IRC | 08:26 | |
| *** e0ne_ is now known as e0ne | 08:27 | |
| *** e0ne has quit IRC | 08:27 | |
| *** otter768 has joined #openstack-infra | 08:28 | |
| *** yaguang has joined #openstack-infra | 08:29 | |
| *** cnesa has joined #openstack-infra | 08:31 | |
| *** cnesa has quit IRC | 08:31 | |
| *** jcoufal has joined #openstack-infra | 08:32 | |
| *** kashyap` is now known as kashyap | 08:33 | |
| *** otter768 has quit IRC | 08:33 | |
| *** stevemar has quit IRC | 08:33 | |
| *** HeOS has joined #openstack-infra | 08:33 | |
| *** dhritishikhar has quit IRC | 08:35 | |
| *** pblaho has joined #openstack-infra | 08:36 | |
| *** otherwiseguy has quit IRC | 08:36 | |
| *** otherwiseguy has joined #openstack-infra | 08:38 | |
| *** emagana has joined #openstack-infra | 08:42 | |
| *** MaxV has joined #openstack-infra | 08:43 | |
| *** emagana has quit IRC | 08:47 | |
| *** Longgeek has quit IRC | 08:47 | |
| *** michchap has quit IRC | 08:54 | |
| *** michchap has joined #openstack-infra | 08:55 | |
| *** Longgeek has joined #openstack-infra | 08:55 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 08:56 | |
| *** belmoreira has joined #openstack-infra | 08:57 | |
| *** _nadya_ has joined #openstack-infra | 08:58 | |
| *** jpich has joined #openstack-infra | 08:59 | |
| *** _nadya_ has joined #openstack-infra | 08:59 | |
| *** Hal_ has joined #openstack-infra | 09:01 | |
| *** mohitsharma has quit IRC | 09:01 | |
| *** romcheg has joined #openstack-infra | 09:01 | |
| *** dtantsur|afk is now known as dtantsur | 09:03 | |
| *** Sukhdev has quit IRC | 09:05 | |
| *** mohitsharma has joined #openstack-infra | 09:07 | |
| *** yamahata has quit IRC | 09:16 | |
| *** deepakcs has quit IRC | 09:22 | |
| *** marcusvrn has joined #openstack-infra | 09:22 | |
| *** derekh has joined #openstack-infra | 09:23 | |
| *** jistr has joined #openstack-infra | 09:23 | |
| *** che-arne has quit IRC | 09:24 | |
| *** mpaolino has joined #openstack-infra | 09:25 | |
| *** dizquierdo has joined #openstack-infra | 09:35 | |
| *** ZZelle_ has quit IRC | 09:35 | |
| *** ZZelle_ has joined #openstack-infra | 09:36 | |
| *** emagana has joined #openstack-infra | 09:37 | |
| *** _nadya_ has quit IRC | 09:37 | |
| *** mkerrin has quit IRC | 09:40 | |
| *** punith has quit IRC | 09:41 | |
| *** hashar has joined #openstack-infra | 09:41 | |
| *** emagana has quit IRC | 09:41 | |
| *** yaguang has quit IRC | 09:43 | |
| *** Longgeek has quit IRC | 09:45 | |
| *** doude has joined #openstack-infra | 09:47 | |
| *** links has joined #openstack-infra | 09:51 | |
| *** e0ne has joined #openstack-infra | 09:56 | |
| *** jp_at_hp has joined #openstack-infra | 09:57 | |
| *** mohitsharma has quit IRC | 09:57 | |
| *** andreykurilin has joined #openstack-infra | 09:58 | |
| *** mohitsharma has joined #openstack-infra | 10:02 | |
| *** BharatK has quit IRC | 10:03 | |
| *** marcusvrn has quit IRC | 10:04 | |
| openstackgerrit | Mikhail Dubov proposed openstack/requirements: Add sphinx_rtd_theme to enhance doc gate jobs https://review.openstack.org/146808 | 10:06 |
| *** marcusvrn has joined #openstack-infra | 10:09 | |
| *** marcusvrn1 has joined #openstack-infra | 10:09 | |
| *** marcusvrn has quit IRC | 10:13 | |
| *** BharatK has joined #openstack-infra | 10:15 | |
| *** che-arne has joined #openstack-infra | 10:23 | |
| *** mohitsharma has quit IRC | 10:26 | |
| *** _nadya_ has joined #openstack-infra | 10:28 | |
| *** otter768 has joined #openstack-infra | 10:29 | |
| *** emagana has joined #openstack-infra | 10:31 | |
| *** _nadya_ has quit IRC | 10:31 | |
| *** nithyag_ has left #openstack-infra | 10:33 | |
| *** otter768 has quit IRC | 10:34 | |
| *** ldnunes has joined #openstack-infra | 10:34 | |
| *** ihrachyshka has joined #openstack-infra | 10:34 | |
| *** salv-orlando has joined #openstack-infra | 10:34 | |
| *** emagana has quit IRC | 10:35 | |
| *** BharatK has quit IRC | 10:36 | |
| *** salv-orlando has quit IRC | 10:40 | |
| *** ryanpetrello has joined #openstack-infra | 10:41 | |
| *** fandi has joined #openstack-infra | 10:41 | |
| *** cdent has joined #openstack-infra | 10:41 | |
| *** salv-orlando has joined #openstack-infra | 10:42 | |
| *** amotoki has quit IRC | 10:45 | |
| *** ryanpetrello has quit IRC | 10:45 | |
| *** andreykurilin has quit IRC | 10:48 | |
| *** andreykurilin has joined #openstack-infra | 10:48 | |
| *** BharatK has joined #openstack-infra | 10:48 | |
| *** Hal_ has quit IRC | 10:57 | |
| *** avozza is now known as zz_avozza | 11:00 | |
| *** imeerovi has quit IRC | 11:00 | |
| *** Masahiro has quit IRC | 11:00 | |
| *** dstufft has quit IRC | 11:05 | |
| *** e0ne is now known as e0ne_ | 11:07 | |
| *** dstufft has joined #openstack-infra | 11:10 | |
| *** adalbas has joined #openstack-infra | 11:13 | |
| *** imeerovi has joined #openstack-infra | 11:13 | |
| *** e0ne_ is now known as e0ne | 11:14 | |
| *** yfried__ is now known as yfried|afk | 11:14 | |
| *** rfolco has joined #openstack-infra | 11:15 | |
| *** rfolco has quit IRC | 11:19 | |
| romcheg | Hi folks! | 11:20 |
| *** fandi has quit IRC | 11:20 | |
| romcheg | May I please ask for some core-review for this patch that moves a client for fuel into a separate repository https://review.openstack.org/#/c/145843/? | 11:21 |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Adding devstack-plugin-glusterfs project to stackforge https://review.openstack.org/146822 | 11:21 |
| romcheg | It blocks some of the ongoing work for fuel-web project which is also on Stackforge | 11:22 |
| *** KanagarajM has joined #openstack-infra | 11:24 | |
| *** emagana has joined #openstack-infra | 11:25 | |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Adding devstack-plugin-glusterfs project to stackforge https://review.openstack.org/146822 | 11:25 |
| *** emagana_ has joined #openstack-infra | 11:27 | |
| *** emagana has quit IRC | 11:30 | |
| *** emagana_ has quit IRC | 11:31 | |
| *** pelix has joined #openstack-infra | 11:33 | |
| *** chlong has joined #openstack-infra | 11:33 | |
| *** afazekas has joined #openstack-infra | 11:34 | |
| *** yfried|afk is now known as yfried__ | 11:34 | |
| *** imeerovi has quit IRC | 11:40 | |
| *** jamielennox is now known as jamielennox|away | 11:43 | |
| *** KanagarajM has quit IRC | 11:43 | |
| *** KanagarajM has joined #openstack-infra | 11:43 | |
| *** HeOS__ is now known as HeOS_ | 11:46 | |
| *** aysyd has joined #openstack-infra | 11:47 | |
| *** dims__ has joined #openstack-infra | 11:47 | |
| *** zz_avozza is now known as avozza | 11:50 | |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Adding devstack-plugin-glusterfs project to stackforge https://review.openstack.org/146822 | 11:52 |
| *** tomoe_ has quit IRC | 11:55 | |
| *** tomoe has joined #openstack-infra | 11:56 | |
| *** e0ne is now known as e0ne_ | 11:56 | |
| *** e0ne_ is now known as e0ne | 11:56 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Expose SSL key/cert/chain file parameters in etherpad class signature https://review.openstack.org/146833 | 11:57 |
| *** teran has quit IRC | 11:59 | |
| *** teran has joined #openstack-infra | 11:59 | |
| *** Masahiro has joined #openstack-infra | 12:01 | |
| *** teran_ has joined #openstack-infra | 12:02 | |
| *** teran has quit IRC | 12:04 | |
| *** yfried__ is now known as yfried|afk | 12:04 | |
| *** BharatK has quit IRC | 12:04 | |
| *** Masahiro has quit IRC | 12:05 | |
| *** avozza is now known as zz_avozza | 12:06 | |
| *** _nadya_ has joined #openstack-infra | 12:08 | |
| *** _amrith_ is now known as amrith | 12:08 | |
| *** KanagarajM has quit IRC | 12:09 | |
| *** dhritishikhar has joined #openstack-infra | 12:11 | |
| *** alexpilotti has joined #openstack-infra | 12:11 | |
| *** _nadya_ has quit IRC | 12:12 | |
| *** e0ne is now known as e0ne_ | 12:13 | |
| *** dmsimard_away is now known as dmsimard | 12:13 | |
| *** yfried|afk is now known as yfried__ | 12:15 | |
| *** jp_at_hp has quit IRC | 12:18 | |
| *** doude has quit IRC | 12:19 | |
| *** BharatK has joined #openstack-infra | 12:20 | |
| *** fandi has joined #openstack-infra | 12:21 | |
| *** emagana has joined #openstack-infra | 12:21 | |
| *** e0ne_ has quit IRC | 12:23 | |
| *** dstufft has quit IRC | 12:25 | |
| *** emagana has quit IRC | 12:25 | |
| *** dstufft has joined #openstack-infra | 12:26 | |
| *** dhritishikhar has quit IRC | 12:26 | |
| *** ryanpetrello has joined #openstack-infra | 12:27 | |
| *** andreykurilin has quit IRC | 12:27 | |
| *** ctracey has quit IRC | 12:29 | |
| *** otter768 has joined #openstack-infra | 12:30 | |
| *** ctracey has joined #openstack-infra | 12:32 | |
| *** koolhead17 has quit IRC | 12:33 | |
| openstackgerrit | Nikita Konovalov proposed openstack-infra/python-storyboardclient: Update method improved https://review.openstack.org/146840 | 12:34 |
| rcarrillocruz | hmm | 12:34 |
| rcarrillocruz | folks, can anyone tell me which OS is the etherpad machine? | 12:34 |
| rcarrillocruz | is it a Ubuntu or a Fedora one? | 12:35 |
| *** otter768 has quit IRC | 12:35 | |
| openstackgerrit | Nikita Konovalov proposed openstack-infra/python-storyboardclient: Teams endpoint https://review.openstack.org/146451 | 12:35 |
| rcarrillocruz | i'm applying the etherpad manifest on a Ubuntu VM and I get an error about '/sbin/nologin' does not exist, from what I've googled that works for RH based distros, /bin/false should be used instead for Debian based distros... | 12:36 |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Adding devstack-plugin-glusterfs project to stackforge https://review.openstack.org/146822 | 12:36 |
| *** weshay has joined #openstack-infra | 12:40 | |
| *** ryanpetrello has quit IRC | 12:41 | |
| *** e0ne has joined #openstack-infra | 12:44 | |
| *** esmute has quit IRC | 12:47 | |
| *** esmute has joined #openstack-infra | 12:48 | |
| *** amotoki has joined #openstack-infra | 12:49 | |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Adding devstack-plugin-glusterfs project to stackforge https://review.openstack.org/146822 | 12:52 |
| *** zz_avozza is now known as avozza | 12:53 | |
| *** doude has joined #openstack-infra | 12:54 | |
| *** mase_x200 has joined #openstack-infra | 12:54 | |
| *** rfolco has joined #openstack-infra | 12:56 | |
| *** pblaho has quit IRC | 12:56 | |
| *** avozza is now known as zz_avozza | 12:58 | |
| *** rfolco has quit IRC | 13:00 | |
| *** kacham has joined #openstack-infra | 13:01 | |
| *** Masahiro has joined #openstack-infra | 13:02 | |
| *** skolekonov has joined #openstack-infra | 13:02 | |
| *** dprince has joined #openstack-infra | 13:03 | |
| *** zz_avozza is now known as avozza | 13:03 | |
| *** mbacchi has joined #openstack-infra | 13:05 | |
| rcarrillocruz | another etherpad question: you guys using a Trove instance? I notice that the manifest does not install mysql package by default... | 13:06 |
| *** Masahiro has quit IRC | 13:06 | |
| *** dhritishikhar has joined #openstack-infra | 13:07 | |
| *** ryanpetrello has joined #openstack-infra | 13:08 | |
| *** mpaolino has quit IRC | 13:08 | |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Adding devstack-plugin-glusterfs project to stackforge https://review.openstack.org/146822 | 13:11 |
| *** mfink has quit IRC | 13:11 | |
| *** emagana has joined #openstack-infra | 13:15 | |
| *** Longgeek has joined #openstack-infra | 13:15 | |
| *** kgiusti has joined #openstack-infra | 13:16 | |
| *** _shaps_ has joined #openstack-infra | 13:18 | |
| *** _nadya_ has joined #openstack-infra | 13:18 | |
| *** dstufft has quit IRC | 13:19 | |
| *** emagana has quit IRC | 13:20 | |
| *** dstufft has joined #openstack-infra | 13:20 | |
| *** mpaolino has joined #openstack-infra | 13:21 | |
| *** jswarren has joined #openstack-infra | 13:22 | |
| *** avozza is now known as zz_avozza | 13:23 | |
| jswarren | Hello. I'm looking for the configuration files for jenkins job builder. They are not located at https://git.openstack.org/cgit/openstack-infra/system-config In modules/openstack_project/files/jenkins_job_builder/config. Have they been moved? | 13:23 |
| *** koolhead17 has joined #openstack-infra | 13:23 | |
| *** bswartz has quit IRC | 13:23 | |
| *** dstufft has quit IRC | 13:23 | |
| *** mfink has joined #openstack-infra | 13:23 | |
| *** dstufft has joined #openstack-infra | 13:24 | |
| *** BharatK has quit IRC | 13:25 | |
| *** rlandy has joined #openstack-infra | 13:25 | |
| vponomaryov | jswarren: https://github.com/openstack-infra/project-config/tree/master/jenkins/jobs or https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs | 13:26 |
| jswarren | vponomaryov: many thanks! | 13:27 |
| *** hdd has joined #openstack-infra | 13:28 | |
| *** chlong has quit IRC | 13:30 | |
| *** ociuhandu has joined #openstack-infra | 13:31 | |
| *** SergeyLukjanov has quit IRC | 13:36 | |
| *** jp_at_hp has joined #openstack-infra | 13:36 | |
| *** alazarev has quit IRC | 13:37 | |
| *** ihrachyshka has quit IRC | 13:38 | |
| *** ddieterly has joined #openstack-infra | 13:38 | |
| *** pradk has joined #openstack-infra | 13:39 | |
| *** ZZelle_ is now known as ZZelle | 13:39 | |
| *** k4n0 has quit IRC | 13:41 | |
| *** SergeyLukjanov has joined #openstack-infra | 13:44 | |
| *** alazarev has joined #openstack-infra | 13:44 | |
| *** mrmartin has quit IRC | 13:44 | |
| *** sabeen1 has quit IRC | 13:44 | |
| *** jaypipes has quit IRC | 13:45 | |
| *** _nadya_ has quit IRC | 13:46 | |
| *** achanda has joined #openstack-infra | 13:46 | |
| *** Hal_ has joined #openstack-infra | 13:48 | |
| *** ihrachyshka has joined #openstack-infra | 13:51 | |
| *** mrmartin has joined #openstack-infra | 13:53 | |
| *** pc_m has joined #openstack-infra | 13:55 | |
| openstackgerrit | John Warren proposed openstack-infra/project-config: Update config location in project descriptions https://review.openstack.org/146868 | 13:55 |
| *** yamahata has joined #openstack-infra | 13:55 | |
| *** yamahata has quit IRC | 13:55 | |
| *** radez is now known as radez_g0n3 | 13:56 | |
| *** yamahata has joined #openstack-infra | 13:56 | |
| *** imeerovi has joined #openstack-infra | 13:56 | |
| hashar | jswarren: project/config | 13:57 |
| hashar | jswarren: openstack-infra/project-config.git :-D | 13:57 |
| hashar | bah someone replied already, sorry for the dupe ping | 13:58 |
| jswarren | hashhar: thanks anyway. I submitted a change set to update the job description. | 13:58 |
| jswarren | https://review.openstack.org/#/c/146768/ | 13:58 |
| jswarren | oops. | 13:58 |
| jswarren | That's https://review.openstack.org/#/c/146868/ | 13:59 |
| *** banix has joined #openstack-infra | 14:00 | |
| *** Egoist_ has joined #openstack-infra | 14:00 | |
| Egoist_ | Hello | 14:00 |
| Egoist_ | i want to ask about hardware on compute host | 14:00 |
| Egoist_ | is it something like openstack way to check hardware of compute node (cpu, ram etc.) before adding it to production environment ? | 14:01 |
| *** armax has joined #openstack-infra | 14:01 | |
| *** pc_m has quit IRC | 14:02 | |
| *** pc_m has joined #openstack-infra | 14:03 | |
| *** ddieterly has quit IRC | 14:05 | |
| *** pc_m has quit IRC | 14:07 | |
| *** xyang1 has joined #openstack-infra | 14:08 | |
| *** zz_avozza is now known as avozza | 14:09 | |
| *** emagana has joined #openstack-infra | 14:09 | |
| *** k4n0 has joined #openstack-infra | 14:10 | |
| *** k4n0 has quit IRC | 14:10 | |
| *** hdd has quit IRC | 14:10 | |
| *** dhritishikhar has quit IRC | 14:11 | |
| *** bswartz has joined #openstack-infra | 14:12 | |
| rcarrillocruz | SergeyLukjanov: hi there, are you still around? | 14:13 |
| openstackgerrit | Merged openstack-infra/storyboard: Git repo links in project table https://review.openstack.org/143455 | 14:13 |
| *** _nadya_ has joined #openstack-infra | 14:13 | |
| *** pc_m has joined #openstack-infra | 14:14 | |
| *** emagana has quit IRC | 14:14 | |
| openstackgerrit | Merged openstack-infra/project-config: Add Fuel Client to Stackforge https://review.openstack.org/145843 | 14:14 |
| *** arielb has joined #openstack-infra | 14:15 | |
| *** arielb has joined #openstack-infra | 14:15 | |
| *** jp_at_hp has quit IRC | 14:16 | |
| *** jp_at_hp has joined #openstack-infra | 14:16 | |
| *** changbl has quit IRC | 14:17 | |
| *** spzala has joined #openstack-infra | 14:18 | |
| *** jokke_ has left #openstack-infra | 14:18 | |
| *** yfried__ is now known as yfried|afk | 14:19 | |
| openstackgerrit | Aleksey proposed openstack-infra/storyboard: Team and project groups delete methods https://review.openstack.org/143675 | 14:21 |
| anteaya | I'm not sure who is running the infra meeting today, I just want to share my intent to not attend | 14:22 |
| fungi | i expect to chair it | 14:22 |
| fungi | i also expect to be missing a significant percentage of core reviewers | 14:22 |
| fungi | lca and all | 14:22 |
| anteaya | fungi: thanks | 14:22 |
| *** openstackgerrit has quit IRC | 14:22 | |
| anteaya | I'm hoping this is my last meeting until nova on thursday | 14:23 |
| *** openstackgerrit has joined #openstack-infra | 14:23 | |
| anteaya | need to do more conferencing | 14:23 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:23 | |
| romcheg | anteaya: Hi! How's it going? | 14:24 |
| anteaya | romcheg: hi, awesome | 14:24 |
| anteaya | I am in love with Auckland | 14:24 |
| anteaya | and the conference is going really well | 14:24 |
| romcheg | That's cool \o/ :) | 14:24 |
| anteaya | :D | 14:25 |
| anteaya | I highly recommend a trip to nz if you can figure it out | 14:25 |
| romcheg | anteaya: Could you please tell me how would I know when my new stacforge project was created and everything is synced? | 14:25 |
| anteaya | sure | 14:25 |
| romcheg | Is it going to be an email or what? | 14:25 |
| anteaya | once your patch is approved, you should get an email when that happens | 14:26 |
| romcheg | The patch is merged now | 14:26 |
| anteaya | ah look on git.openstack.org | 14:26 |
| anteaya | can you find the repo? | 14:26 |
| romcheg | anteaya: I can | 14:26 |
| anteaya | next look on gerrit | 14:27 |
| anteaya | and search people > groups | 14:27 |
| anteaya | can you find your core group and release group for the repo? | 14:27 |
| romcheg | No, nothing on Gerrit | 14:27 |
| anteaya | what is the name of the repo? | 14:27 |
| romcheg | python-fuelclient | 14:27 |
| *** doug-fish has left #openstack-infra | 14:27 | |
| * anteaya looks | 14:27 | |
| romcheg | I can see it on github neither | 14:28 |
| *** yfried|afk is now known as yfried__ | 14:28 | |
| *** ayoung has joined #openstack-infra | 14:29 | |
| romcheg | anteaya: And the repo on git.openstack.org seems to be empty | 14:29 |
| anteaya | fungi: looks like we have an issue: http://git05.openstack.org:8080/cgit/openstack-infra/python-fuelclient | 14:29 |
| anteaya | romcheg: yes, I am seeing that | 14:29 |
| *** otter768 has joined #openstack-infra | 14:31 | |
| *** pc_m_ has joined #openstack-infra | 14:31 | |
| ttx | fungi: back in December you took an action in the cross-project meeting, to advance the situation around default config files | 14:32 |
| anteaya | romcheg: did you pull in any content when the repo wwas created? | 14:32 |
| ttx | fungi: I'm supposed to put it back on the agenda in January to measure progress -- buty don't want to do that just now if that didn't make that much progress yet | 14:32 |
| anteaya | romcheg: or did you create the repo in an empty state? | 14:32 |
| ttx | fungi: let me know where that stands | 14:32 |
| *** jaypipes has joined #openstack-infra | 14:32 | |
| *** jerryz has quit IRC | 14:32 | |
| *** pradk has quit IRC | 14:33 | |
| *** dkranz has joined #openstack-infra | 14:33 | |
| romcheg | Anteya, I specified the upstream which is not empty. | 14:33 |
| openstackgerrit | Merged openstack-infra/project-config: Use correct path for tempest in testr dib script https://review.openstack.org/146768 | 14:33 |
| *** pc_m_ has quit IRC | 14:33 | |
| *** pc_m_ has joined #openstack-infra | 14:33 | |
| anteaya | romcheg: okay great thanks | 14:33 |
| *** dustins has joined #openstack-infra | 14:34 | |
| *** pc_m_ has quit IRC | 14:34 | |
| *** pc_m has quit IRC | 14:34 | |
| romcheg | anteaya: https://github.com/openstack-infra/project-config/blob/master/gerrit/projects.yaml#L1668 | 14:35 |
| *** pc_m has joined #openstack-infra | 14:35 | |
| anteaya | romcheg: at this point, fungi or clarkb are the ones who need to dig into logs to see why the repo has no content on all 5 git servers | 14:35 |
| anteaya | romcheg: thanks for that link | 14:35 |
| anteaya | looks like a project creation bug | 14:35 |
| *** otter768 has quit IRC | 14:36 | |
| *** andreaf has joined #openstack-infra | 14:36 | |
| *** ddieterly has joined #openstack-infra | 14:36 | |
| fungi | ttx: i started an e-mail thread with on the ops list with a summary, seeking consensus and someone to draft a cross-project spec. there was very little response... http://lists.openstack.org/pipermail/openstack-operators/2014-December/005742.html | 14:37 |
| fungi | python-fuelclient... is that new? | 14:37 |
| fungi | romcheg: ^ ? | 14:38 |
| romcheg | fungi: python-fuelclient was the part of the fuel-web project | 14:39 |
| romcheg | fungi: fuel-web is on Stackforge | 14:39 |
| *** _nadya_ has quit IRC | 14:39 | |
| fungi | python-fuelclient is on stackforge too | 14:39 |
| fungi | anteaya: why would there be a openstack-infra/python-fuelclient ? | 14:40 |
| fungi | that's not an openstack-infra project | 14:40 |
| anteaya | fungi: I'm a fool | 14:40 |
| fungi | 's okay | 14:40 |
| fungi | you're on the wrong side of the planet right now | 14:40 |
| romcheg | Ah, so it's ok? | 14:41 |
| romcheg | *proejct creation, not being a fool on the wrong side of the planet :) | 14:41 |
| fungi | no idea what you think is wrong | 14:41 |
| anteaya | well it is on all 5 git servers: http://git05.openstack.org:8080/cgit/stackforge/python-fuelclient | 14:41 |
| anteaya | so that is a start | 14:41 |
| anteaya | fungi: it doesn't have gerrit groups | 14:41 |
| * fungi checks | 14:41 | |
| *** salv-orlando has quit IRC | 14:41 | |
| romcheg | It does not | 14:42 |
| romcheg | *now | 14:42 |
| fungi | gerrit says it has two groups, in fact | 14:42 |
| *** salv-orlando has joined #openstack-infra | 14:42 | |
| fungi | python-fuelclient-core and python-fuelclient-release | 14:42 |
| romcheg | Looks like that just took a bit longer than I expected | 14:42 |
| fungi | they're empty though. who should be in them? | 14:42 |
| anteaya | wonderful | 14:42 |
| rcarrillocruz | fungi: hi there, may I ask you something about the etherpad server? | 14:43 |
| fungi | rcarrillocruz: trove, yes | 14:43 |
| fungi | rcarrillocruz: and ubuntu precise pangolin 12.04 lts | 14:43 |
| romcheg | fungi, anteaya: Thanks for youre help and sorry for the false alarm :) | 14:43 |
| romcheg | I'm going to file a request to populate that core group | 14:43 |
| fungi | romcheg: file a request here and i'll take care of it now | 14:43 |
| rcarrillocruz | do you guys keep a wiki page of the Precise->Trusty migration schedule? | 14:44 |
| romcheg | fungi: I'm on it | 14:44 |
| fungi | rcarrillocruz: there is no schedule | 14:44 |
| rcarrillocruz | i'm asking cos I have a change to enable websockets on etherpad, jeblair suggested me to do it. Thing is we need http://httpd.apache.org/docs/2.4/mod/mod_proxy_wstunnel.html to pass-thru websockets to Etherpad server | 14:44 |
| fungi | rcarrillocruz: though we comment teh entries in openstack-infra/system-config:manifests/site.pp as to what base os they're using | 14:44 |
| rcarrillocruz | but that mod only is available as a package for Apache 2.4, thus only Trusty | 14:45 |
| fungi | rcarrillocruz: yeah, we don't have apache 2.4 on the etherpad.openstack.org server, it's running 2.2 | 14:45 |
| rcarrillocruz | yeah, i saw the comment but I get an error about '/sbin/nologin' not being available. Per my research, /sbin/nologin is meant to work on RH/Fedora servers, /bin/false should be used for Ubuntu/Debian | 14:45 |
| fungi | rcarrillocruz: we could try rebuilding etherpad-dev on trusty and see what happens i guess | 14:45 |
| *** salv-orlando has quit IRC | 14:46 | |
| *** r-daneel has joined #openstack-infra | 14:46 | |
| rcarrillocruz | so I guess that someone fixed that manually after the puppet apply | 14:46 |
| rcarrillocruz | i'll push a change for that | 14:46 |
| rcarrillocruz | fungi: that'd be awesome the etherpad-dev thing | 14:46 |
| ttx | fungi: do you think it's time to put it back on the cross-project meeting agenda ? Or wait a bit more ? | 14:46 |
| romcheg | fungi: Which project should I file a request to? WIki only says "ask the Infra team to add you to both groups" | 14:46 |
| fungi | rcarrillocruz: there's no /sbin/nologin on the etherpad.openstack.org server | 14:46 |
| *** salv-orlando has joined #openstack-infra | 14:46 | |
| fungi | romcheg: file a request here and i'll take care of it now | 14:46 |
| romcheg | Ah, ok | 14:46 |
| *** baoli has quit IRC | 14:46 | |
| fungi | romcheg: we're trying not to abuse bug reports as help requests | 14:47 |
| rcarrillocruz | yet the manifest expects it, thus it fails, thx for confirming | 14:47 |
| rcarrillocruz | i'll push another change for the mod_proxy_wstunnel and mention in the commit that is meant for etherpad-dev | 14:47 |
| fungi | (at least i am, because they're not really bugs) | 14:47 |
| openstackgerrit | Aleksey proposed openstack-infra/storyboard: Convert db exceptions to api exceptions https://review.openstack.org/144442 | 14:47 |
| *** baoli has joined #openstack-infra | 14:47 | |
| fungi | rcarrillocruz: weird. i wonder why the manifest isn't failing on the server | 14:47 |
| *** mriedem has joined #openstack-infra | 14:48 | |
| romcheg | Please add me "me@romcheg.me" to both -core and -release groups and dpyzhov@mirantis.com to python-fuelclient-core | 14:48 |
| fungi | romcheg: i've added you to both groups. they're self-managed so you can add whoever you like. https://review.openstack.org/#/admin/groups/551,members is where you would do that for python-fuelclient-core | 14:49 |
| *** mase_x200 has quit IRC | 14:49 | |
| romcheg | fungi: Thank you very much for your help :) | 14:49 |
| *** dkliban_afk is now known as dkliban | 14:50 | |
| fungi | rcarrillocruz: i just did 'puppet agent --test --server puppetmaster.openstack.org' on etherpad.openstack.org and there was no error, so perhaps that conditional is not being hit? | 14:50 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Change /sbin/nologin to /bin/false for Ubuntu https://review.openstack.org/146889 | 14:50 |
| *** TravT has joined #openstack-infra | 14:50 | |
| *** Masahiro has joined #openstack-infra | 14:50 | |
| fungi | ttx: i can ping the ml thread again to see if there's renewed interest. i did plug it in the operators irc meeting last week or the week before | 14:51 |
| rcarrillocruz | weird | 14:51 |
| fungi | ttx: i'm not sure there's much benefit to putting it back on the agenda if the operators aren't _actually_ interested in solving the problem | 14:51 |
| *** pcaruana|off| is now known as pcaruana | 14:51 | |
| fungi | rcarrillocruz: do you have a paste of the error output? | 14:52 |
| rcarrillocruz | i will paste you in an hour, about to get into a meeting | 14:53 |
| fungi | rcarrillocruz: cool. once we have some confidence in the current manifest, replacing etherpad-dev with trusty is probably worth discussing in more detail | 14:53 |
| openstackgerrit | Endre Karlson proposed openstack-infra/project-config: Add python-cueclient https://review.openstack.org/145561 | 14:54 |
| ekarlso- | can I get a +W for ^? | 14:54 |
| rcarrillocruz | fungi: actually, i can spin later this week a trusty VM and check for issues, now that I've been testing this out locally | 14:54 |
| rcarrillocruz | i'll update on that | 14:55 |
| *** Masahiro has quit IRC | 14:55 | |
| *** achanda has quit IRC | 14:56 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 14:57 | |
| *** ddieterly has quit IRC | 14:58 | |
| *** Egoist_ has quit IRC | 14:59 | |
| *** dstufft has quit IRC | 15:00 | |
| *** dstufft has joined #openstack-infra | 15:01 | |
| *** yfried__ is now known as yfried|afk | 15:01 | |
| *** sabeen1 has joined #openstack-infra | 15:01 | |
| *** barra204_ has joined #openstack-infra | 15:01 | |
| *** marun has joined #openstack-infra | 15:02 | |
| *** emagana has joined #openstack-infra | 15:02 | |
| *** radez_g0n3 is now known as radez | 15:02 | |
| ihrachyshka | hi. any recent issues in gate due to slowliness? I see neutron services taking enormous time for simple jobs like reporting state (>30 secs) | 15:02 |
| *** boris-42 has quit IRC | 15:03 | |
| *** nelsnelson has joined #openstack-infra | 15:03 | |
| *** barra204 has quit IRC | 15:03 | |
| fungi | ihrachyshka: it's possible neutron got slower. it's also possible some of the instances we're getting from our cloud providers are slower for some reason | 15:04 |
| fungi | ihrachyshka: i'm not personally aware of anything specific though, no | 15:04 |
| ihrachyshka | fungi, the jobs completes, so it's not like it's slow forever. ok, thanks for update. | 15:04 |
| *** dustins_ has joined #openstack-infra | 15:05 | |
| *** plaurin_ has joined #openstack-infra | 15:07 | |
| *** tomoe has quit IRC | 15:07 | |
| katherine__ | fungi: would you mind pointing me to your gerrit httpd config file again? | 15:08 |
| openstackgerrit | garyk proposed openstack-infra/project-config: Limit python26 jobs to icehouse/juno for oslo.vmware https://review.openstack.org/146892 | 15:08 |
| *** mattfarina has joined #openstack-infra | 15:08 | |
| fungi | katherine__: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/gerrit/templates/gerrit.vhost.erb | 15:08 |
| *** dustins has quit IRC | 15:08 | |
| katherine__ | fungi: thank you! | 15:09 |
| *** zz_dimtruck is now known as dimtruck | 15:09 | |
| mattfarina | hello folks. | 15:10 |
| mattfarina | I was wondering if someone could tell me why the check check-tempest-dsvm-postgres-full wouldn't have any logs following it reporting unstable | 15:10 |
| mattfarina | for ref see https://review.openstack.org/#/c/141489/ | 15:10 |
| fungi | mattfarina: "unstable" is the usual job result when the publisher fails for some reason | 15:11 |
| hashar | fungi: do you have some spare cycles? I am wondering whether one can run two zuul-merger on the same server :] each having their own ssd | 15:11 |
| mattfarina | i've seen this a couple times on Horizon today | 15:11 |
| *** asselin_ has joined #openstack-infra | 15:11 | |
| fungi | hashar: i haven't tried it, but you'd need some way to split their url (name-based vhost?) and their git tree | 15:12 |
| hashar | fungi: I though about using two sub interfaces each with their own IP | 15:12 |
| hashar | fungi: then spawn the zuul-merger with different configuration file, each having a different URL (the sub interface ip) | 15:12 |
| fungi | yeah, ip-based vhost would accomplish the same thing as name-based vhost | 15:12 |
| *** nelsnelson has quit IRC | 15:12 | |
| hashar | fungi: I am more wondering how the gearman merge function is registered. | 15:12 |
| *** bswartz has quit IRC | 15:12 | |
| hashar | and I expose the zuul-merger git repositories with git-daemon not the git http daemon (broken for me for some reason) | 15:13 |
| *** alivigni has joined #openstack-infra | 15:14 | |
| *** tonytan4ever has joined #openstack-infra | 15:14 | |
| SergeyLukjanov | anteaya, fungi, I should be available on meeting today | 15:14 |
| hashar | fungi: I am doing design work to get NodePool on the wmf infrastructure :] https://upload.wikimedia.org/wikipedia/commons/thumb/9/9f/Integrationwikimediaci-architecture-isolation.svg/1024px-Integrationwikimediaci-architecture-isolation.svg.png | 15:14 |
| fungi | hashar: i don't _think_ running more than one gear client/worker on a single machine should pose a problem, but i may be overlooking something obvious | 15:14 |
| hashar | fungi: I will give it a try and find out :] | 15:15 |
| *** banix has quit IRC | 15:15 | |
| fungi | hashar: and yes, krinkle was talking about getting nodepool into wmf, so that's awesome | 15:15 |
| anteaya | SergeyLukjanov: awesome, I won't be, I hope the meeting is productive | 15:15 |
| anteaya | SergeyLukjanov: did you have good holidays? | 15:15 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 15:15 | |
| hashar | fungi: will probably poke the mailing list over the next few weeks. Some part are mysterious such as zeromq :-D | 15:15 |
| *** signed8bit has joined #openstack-infra | 15:16 | |
| *** pblaho has joined #openstack-infra | 15:16 | |
| *** yfried|afk is now known as yfried__ | 15:16 | |
| * anteaya goes back to bed | 15:16 | |
| *** bswartz has joined #openstack-infra | 15:17 | |
| fungi | mattfarina: i saw a couple yesterday and tracked them down to ssh authentication failures when the scp publisher plugin tried to connect to static.openstack.org to copy the job logs. could be intermittent network disruption or a myriad of possibilities | 15:17 |
| mattfarina | any recommendation? | 15:18 |
| ihrachyshka | fungi, see http://logs.openstack.org/84/145784/1/gate/gate-tempest-dsvm-neutron-full-2/7fff461/logs/screen-dstat.txt.gz around "11-01 23:49:21" | 15:18 |
| *** e0ne is now known as e0ne_ | 15:18 | |
| ihrachyshka | fungi, that's when I see all services 'locked' for ~40-50 secs | 15:19 |
| ihrachyshka | fungi, no disk activity, cpu usage ~ 1%, ... | 15:19 |
| ihrachyshka | then at 11-01 23:50:15 services restore activity | 15:19 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for oslo.db/neutron bug 1410298 https://review.openstack.org/146894 | 15:19 |
| uvirtbot | Launchpad bug 1410298 in oslo.db "gate-neutron-dsvm-functional fails with "AttributeError: 'TestModelsMigrationsMysql' object has no attribute 'check_foreign_keys'" on oslo.db 1.4.0" [Critical,Fix released] https://launchpad.net/bugs/1410298 | 15:19 |
| ihrachyshka | it's either mysql locked or rabbitmq (I suspect the former) | 15:19 |
| *** imeerovi has quit IRC | 15:19 | |
| SergeyLukjanov | anteaya, yeah, almost two weeks of holidays is awesome ;) | 15:21 |
| ihrachyshka | also see 'wait' cpu raises like hell | 15:21 |
| fungi | ihrachyshka: sounds like i/o bandwidth starvation/contention | 15:23 |
| fungi | or possibly spikes in interrupt handling | 15:23 |
| ihrachyshka | fungi, I also see the following in kernel: "kernel: [ 2256.322345] connection2:0: detected conn error (1019)" | 15:24 |
| ihrachyshka | I guess that's iscsi | 15:24 |
| fungi | looks like it | 15:24 |
| *** esmute has quit IRC | 15:24 | |
| fungi | no soft lockup errors though? | 15:24 |
| *** coolsvap is now known as coolsvap|afk | 15:25 | |
| ihrachyshka | I guess no. how do they look like? | 15:25 |
| ihrachyshka | nothing for 'soft lockup' or 'lockup' | 15:25 |
| *** barra204 has joined #openstack-infra | 15:25 | |
| *** kacham has quit IRC | 15:26 | |
| ihrachyshka | and those connection errors seem to correlate with the lock of all processes | 15:26 |
| *** yamahata has quit IRC | 15:26 | |
| ihrachyshka | starts at Jan 11 23:49:21 and ends at Jan 11 23:50:18 | 15:26 |
| *** esmute has joined #openstack-infra | 15:27 | |
| ihrachyshka | ok, I guess it's hardly related to neutron, so I can just recheck and move on | 15:27 |
| *** barra204_ has quit IRC | 15:28 | |
| *** pradk has joined #openstack-infra | 15:28 | |
| *** MaxV_ has joined #openstack-infra | 15:29 | |
| *** MaxV_ has quit IRC | 15:29 | |
| *** jcoufal_ has joined #openstack-infra | 15:29 | |
| *** e0ne_ has quit IRC | 15:29 | |
| *** MaxV_ has joined #openstack-infra | 15:29 | |
| *** nelsnelson has joined #openstack-infra | 15:29 | |
| *** salv-orlando has quit IRC | 15:30 | |
| *** nelsnelson has quit IRC | 15:31 | |
| *** nelsnelson has joined #openstack-infra | 15:31 | |
| *** jcoufal has quit IRC | 15:31 | |
| *** e0ne has joined #openstack-infra | 15:32 | |
| *** MaxV has quit IRC | 15:32 | |
| *** pradk has quit IRC | 15:33 | |
| fungi | ihrachyshka: yeah, lacking sufficient evidence since we don't control the cloud providing those instances, but wouldn't be surprised if some of them are ending up on compute nodes with very busy neighbors causing cpu or i/o starvation | 15:33 |
| *** rfolco has joined #openstack-infra | 15:34 | |
| *** stevemar has joined #openstack-infra | 15:34 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 15:34 | |
| rcarrillocruz | fungi: http://paste.openstack.org/show/157098/ | 15:35 |
| rcarrillocruz | that's the stack trace if the manifest checks for /sbin/nologin | 15:35 |
| rcarrillocruz | my vm is on ubuntu 12.04.5 | 15:35 |
| clarkb | if you update to trusty you should also see if system node.js works for etherpad | 15:36 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 15:36 | |
| rcarrillocruz | yah, that's another test i have pending | 15:36 |
| *** rfolco has quit IRC | 15:36 | |
| *** pcrews has joined #openstack-infra | 15:36 | |
| clarkb | also why do we nees websocket support in apache? is this to enable more features? | 15:36 |
| rcarrillocruz | so I wonder why puppet works for you | 15:36 |
| rcarrillocruz | clarkb: i'm working on the streaming API for storyboard, that uses websocket. jeblair suggested I enable websockets on etherpad so we all get used to this technology | 15:37 |
| rcarrillocruz | problems | 15:37 |
| rcarrillocruz | etc | 15:37 |
| rcarrillocruz | in terms of features: | 15:37 |
| clarkb | probably because rax gives us images with sbib/nologin or old puppet didnt care but new puppet does | 15:37 |
| *** signed8bit is now known as signed8bit_ZZZzz | 15:37 | |
| *** rfolco has joined #openstack-infra | 15:37 | |
| rcarrillocruz | websocket is the best performing transport for socketio | 15:37 |
| rcarrillocruz | so i assume the latency would improve | 15:37 |
| rcarrillocruz | but for that, we need mod_proxy_wstunnel, it's an apache module that passes-thru websockets from port 80 to whicever you set it | 15:38 |
| rcarrillocruz | too bad it's only packaged for apache 2.4 | 15:38 |
| *** banix has joined #openstack-infra | 15:39 | |
| *** rfolco_ has joined #openstack-infra | 15:39 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 15:39 | |
| clarkb | ya updating to trusty is good overall especially if we can use system node.js | 15:39 |
| rcarrillocruz | i'll spin a VM and test out manifest | 15:40 |
| *** rfolco__ has joined #openstack-infra | 15:40 | |
| rcarrillocruz | for now, i'm pushing the /sbin/nologin fix | 15:40 |
| *** banix has quit IRC | 15:40 | |
| rcarrillocruz | and the websocket enabling | 15:40 |
| rcarrillocruz | the way socketio, it tries the best trnasport available from client (browser), and then fallsback to whatever has in the list | 15:40 |
| *** andreaf has quit IRC | 15:40 | |
| fungi | clarkb: rcarrillocruz: yeah, i think the reason we haven't hit that error is that the module hasn't been used to bootstrap a new server since that changed, and since we have existing eplite accounts on our servers that code path is never traversed | 15:41 |
| rcarrillocruz | so even though prod etherpad can't make it websocket work, it'll still work for users, cos it will fallback to long-polling, xhr, what may have you | 15:41 |
| *** andreaf has joined #openstack-infra | 15:41 | |
| *** banix has joined #openstack-infra | 15:41 | |
| *** rfolco has quit IRC | 15:41 | |
| *** tonytan4ever has quit IRC | 15:41 | |
| rcarrillocruz | fungi: gotcha | 15:41 |
| *** rfolco_ has quit IRC | 15:43 | |
| *** e0ne is now known as e0ne_ | 15:43 | |
| fungi | our eplite user does actually have its shell set to a nonexistent /sbin/nologin in the passwd file, so presumably that worked at some point and wasn't checking for the existence of the file | 15:43 |
| *** pradk has joined #openstack-infra | 15:43 | |
| *** baoli has quit IRC | 15:44 | |
| *** rfolco__ has quit IRC | 15:44 | |
| clarkb | likely puppet got smarter | 15:44 |
| *** ddieterly has joined #openstack-infra | 15:44 | |
| *** rfolco__ has joined #openstack-infra | 15:44 | |
| *** rfolco__ is now known as rfolco | 15:44 | |
| *** wenlock has joined #openstack-infra | 15:45 | |
| *** salv-orlando has joined #openstack-infra | 15:46 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Enable websockets transport on Etherpad https://review.openstack.org/146903 | 15:46 |
| *** rfolco has quit IRC | 15:46 | |
| *** emagana has quit IRC | 15:48 | |
| *** r-daneel has quit IRC | 15:49 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 15:51 | |
| *** yfried__ has quit IRC | 15:51 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 15:52 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 15:53 | |
| *** e0ne_ has quit IRC | 15:53 | |
| *** erikwilson has joined #openstack-infra | 15:54 | |
| *** erikmwilson has quit IRC | 15:54 | |
| *** erikwilson is now known as erikmwilson_ | 15:54 | |
| *** marun has quit IRC | 15:55 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 15:55 | |
| *** erikmwilson has joined #openstack-infra | 15:55 | |
| *** imcsk8 has quit IRC | 15:56 | |
| *** mohitsharma has joined #openstack-infra | 15:56 | |
| *** imcsk8 has joined #openstack-infra | 15:56 | |
| clarkb | fungi: I don't think nodepool is correctly building new dib images prior to uploading to glance. so `nodepool dib-image-list` shows old images but `nodepool image-list` shows up to date images | 15:58 |
| *** banix has quit IRC | 15:59 | |
| *** mohitsha_ has joined #openstack-infra | 16:00 | |
| fungi | hrm | 16:01 |
| *** tonytan4ever has joined #openstack-infra | 16:01 | |
| *** pradk is now known as prad-afk | 16:01 | |
| *** kmartin has joined #openstack-infra | 16:01 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 16:01 | |
| *** mohitsharma has quit IRC | 16:03 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 16:05 | |
| *** amotoki has quit IRC | 16:08 | |
| *** arxcruz has quit IRC | 16:08 | |
| *** marun has joined #openstack-infra | 16:08 | |
| *** dkranz has quit IRC | 16:09 | |
| *** ildikov has quit IRC | 16:10 | |
| sdague | it looks like the 2 fails at the top of the gate right now are freshness problems (last valid tests were pre christmas) | 16:10 |
| *** prad-afk has quit IRC | 16:10 | |
| *** rcarrillocruz has quit IRC | 16:12 | |
| *** dkranz has joined #openstack-infra | 16:12 | |
| *** mohitsha_ has quit IRC | 16:12 | |
| *** asselin_ has quit IRC | 16:13 | |
| *** dhritishikhar has joined #openstack-infra | 16:13 | |
| *** Ala has quit IRC | 16:15 | |
| *** katherine__ has quit IRC | 16:16 | |
| nelsnelson | Greetings, channel. May I please have one more review for a change? https://review.openstack.org/#/c/134348/ | 16:16 |
| *** belmoreira has quit IRC | 16:18 | |
| *** dannywilson has joined #openstack-infra | 16:20 | |
| *** dannywilson has quit IRC | 16:20 | |
| *** dannywilson has joined #openstack-infra | 16:20 | |
| *** zz_sabari is now known as sabari | 16:21 | |
| *** hashar has quit IRC | 16:22 | |
| *** xyang1 has quit IRC | 16:22 | |
| *** doug-fish has joined #openstack-infra | 16:22 | |
| *** pc_m has quit IRC | 16:23 | |
| *** mpaolino has quit IRC | 16:24 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 16:25 | |
| *** ryanpetrello has quit IRC | 16:26 | |
| *** e0ne has joined #openstack-infra | 16:27 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 16:28 | |
| *** dkranz has quit IRC | 16:29 | |
| *** primeministerp has quit IRC | 16:29 | |
| *** dkranz has joined #openstack-infra | 16:29 | |
| *** primemin1sterp has quit IRC | 16:30 | |
| *** ChuckC_ is now known as ChuckC | 16:30 | |
| *** otter768 has joined #openstack-infra | 16:32 | |
| *** salv-orlando has quit IRC | 16:33 | |
| *** salv-orlando has joined #openstack-infra | 16:34 | |
| *** ildikov has joined #openstack-infra | 16:35 | |
| *** mrmartin has quit IRC | 16:35 | |
| *** otter768 has quit IRC | 16:37 | |
| *** mpaolino has joined #openstack-infra | 16:37 | |
| *** Masahiro has joined #openstack-infra | 16:39 | |
| *** jcoufal_ has quit IRC | 16:39 | |
| *** e0ne is now known as e0ne_ | 16:40 | |
| *** Masahiro has quit IRC | 16:43 | |
| clarkb | fungi: nevermind, we apparently have multiple log files per day with nodepool. I have found in a previous log that we ran the daily updates and they all failed, not sure how they failed yet though | 16:43 |
| *** sabari is now known as zz_sabari | 16:44 | |
| *** ChuckC has quit IRC | 16:44 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 16:44 | |
| openstackgerrit | Kyle Rockman proposed openstack-infra/jenkins-job-builder: adding support for the xcode builder plugin https://review.openstack.org/146918 | 16:45 |
| clarkb | fungi: looks like cache contention | 16:45 |
| *** signed8bit_ZZZzz is now known as signed8bit | 16:45 | |
| *** changbl has joined #openstack-infra | 16:45 | |
| clarkb | I am going to manually build a precise dib image then centos7 so we at least have images thatwork | 16:46 |
| *** zz_jgrimm is now known as jgrimm | 16:48 | |
| clarkb | SpamapS: is there a good way to deal with multiple dib builds using the case dib cache? | 16:48 |
| *** baoli has joined #openstack-infra | 16:49 | |
| openstackgerrit | Kyle Rockman proposed openstack-infra/jenkins-job-builder: adding support for the xcode builder plugin https://review.openstack.org/146918 | 16:49 |
| *** salv-orlando has quit IRC | 16:49 | |
| clarkb | SpamapS: iirc dib has an offline mode. Is there any way to update the cache without doing a real image build? that way we could do all our image builds in offline mode but have something else update the cache prior to a bunch of builds? | 16:49 |
| *** rcarrillocruz has joined #openstack-infra | 16:49 | |
| clarkb | SpamapS: mostly thinking that cache updates should be decoupled from builds and wondering if I can do that easily | 16:50 |
| clarkb | greghaynes: ^ | 16:50 |
| *** e0ne_ has quit IRC | 16:51 | |
| clarkb | mordred: ^ you may also have ideas | 16:51 |
| clarkb | it doesn't look like dib has a just update cache option | 16:52 |
| *** banix has joined #openstack-infra | 16:53 | |
| openstackgerrit | Kyle Rockman proposed openstack-infra/jenkins-job-builder: adding support for the xcode builder plugin https://review.openstack.org/146918 | 16:53 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for oslo.concurrency/nova UT bug 1410348 https://review.openstack.org/146922 | 16:53 |
| uvirtbot | Launchpad bug 1410348 in oslo.concurrency "test_ssh_encrypt_decrypt_text fails with UnicodeDecodeError after oslo.concurrency 0.4.0 release" [Undecided,New] https://launchpad.net/bugs/1410348 | 16:53 |
| *** mrmartin has joined #openstack-infra | 16:55 | |
| *** rfolco has joined #openstack-infra | 16:55 | |
| *** ildikov is now known as ildikov_afk | 16:55 | |
| *** ihrachyshka has quit IRC | 16:55 | |
| fungi | clarkb: okay, yeah that's definitely the issue i ran into last time i tried to update our dib images in nodepool | 16:55 |
| openstackgerrit | Kevin L. Mitchell proposed stackforge/python-jenkins: Raise an exception on 404 https://review.openstack.org/139158 | 16:57 |
| *** rfolco has quit IRC | 16:57 | |
| *** sarob has joined #openstack-infra | 16:57 | |
| *** jcoufal has joined #openstack-infra | 16:58 | |
| *** emagana has joined #openstack-infra | 16:58 | |
| *** markus_z has quit IRC | 16:58 | |
| *** jlibosva has quit IRC | 16:58 | |
| *** rf0lc0 has joined #openstack-infra | 16:58 | |
| openstackgerrit | Kevin L. Mitchell proposed stackforge/python-jenkins: Eliminate redundant calls to assert_job_exists() https://review.openstack.org/145598 | 16:59 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Only run one DIB image "online" https://review.openstack.org/146925 | 16:59 |
| clarkb | fungi: ^ I am not very proud of that | 16:59 |
| clarkb | but it should allow us to get working image builds | 16:59 |
| clarkb | going to test it really quickly on my test machine | 16:59 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Script to generate a unique address list for ATCs https://review.openstack.org/127315 | 16:59 |
| *** derekh has quit IRC | 16:59 | |
| *** rwsu has joined #openstack-infra | 16:59 | |
| *** BharatK has joined #openstack-infra | 17:00 | |
| *** signed8bit has quit IRC | 17:00 | |
| fungi | clarkb: the idea being that the trusty image build will pre-cache the majority of what we need and that should be "good enough for now"? | 17:01 |
| *** signed8bit has joined #openstack-infra | 17:01 | |
| clarkb | fungi: ya | 17:01 |
| fungi | clarkb: also i expect that the other two will race ahead and get based off a day-old cache | 17:01 |
| mordred | clarkb: looking | 17:01 |
| clarkb | except that it won't actually cache quickly enough for the other builds most likely so they will end up with ~24 hour old caches | 17:01 |
| clarkb | but they should build | 17:01 |
| fungi | yeah | 17:01 |
| *** pc_m has joined #openstack-infra | 17:02 | |
| mordred | clarkb: it's not TERRIBLE | 17:02 |
| *** avozza is now known as zz_avozza | 17:02 | |
| *** rf0lc0 has quit IRC | 17:03 | |
| *** jamielennox|away is now known as jamielennox | 17:03 | |
| *** rf0lc0 has joined #openstack-infra | 17:03 | |
| clarkb | precise image is build doing cento7 now then will upload them | 17:04 |
| clarkb | so they definitely work when serialized | 17:04 |
| *** bswartz1 has joined #openstack-infra | 17:05 | |
| *** ChuckC has joined #openstack-infra | 17:06 | |
| fungi | clarkb: given that there are far fewer dib builds, they're much faster than snapshot builds and we've already decoupled the uploading, how about serializing the dib create pass for now (would probably require some minor changes in nodepool admittedly) | 17:06 |
| clarkb | that is another option | 17:06 |
| clarkb | also now that I think about it I may need to stringify that "1" | 17:07 |
| *** bswartz has quit IRC | 17:07 | |
| *** kmartin has quit IRC | 17:07 | |
| *** tqtran has joined #openstack-infra | 17:07 | |
| clarkb | otherwise I think we may pass through a literal 1 byte? | 17:07 |
| fungi | clarkb: another option, at the expense of multiplying cache space, would be to separate the cache directories for individual diskimages | 17:08 |
| *** rf0lc0 has quit IRC | 17:08 | |
| fungi | just basically namespace the TMPDIR and DIB_IMAGE_CACHE values for each of them | 17:08 |
| *** rf0lc0 has joined #openstack-infra | 17:08 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Only run one DIB image "online" https://review.openstack.org/146925 | 17:08 |
| clarkb | fungi: ya I wanted to avoid that because its a nontrivial amount of disk | 17:09 |
| clarkb | and we don't have a bunch once we start spitting out qcow images and have half as much once we xen image too | 17:09 |
| fungi | agreed. we'd need a larger /opt than we have now | 17:09 |
| *** shayneburgess has joined #openstack-infra | 17:10 | |
| clarkb | but we do have a few options. Need to think on it a bit. I do like the idea of running all builds in offline mode then having something else maintain the cache | 17:10 |
| clarkb | that way we get consistent git repos, devstack images, et al on our machines | 17:11 |
| *** kmartin has joined #openstack-infra | 17:11 | |
| *** boris-42 has joined #openstack-infra | 17:12 | |
| *** rf0lc0 has quit IRC | 17:14 | |
| *** Hal_ has quit IRC | 17:15 | |
| *** Hefeweizen has joined #openstack-infra | 17:15 | |
| *** sarob_ has joined #openstack-infra | 17:17 | |
| *** pc_m has quit IRC | 17:18 | |
| *** banix has quit IRC | 17:18 | |
| *** pc_m has joined #openstack-infra | 17:18 | |
| zaro | morning | 17:19 |
| *** mpaolino has quit IRC | 17:19 | |
| SpamapS | clarkb: we don't have an easy answer for concurrent cache access no. I believe we just rely on squids to coalesce concurrent fetches right now. | 17:19 |
| clarkb | SpamapS its not reads that are a problem its the writes | 17:19 |
| fungi | yeah, contention trying to update the same local cache | 17:19 |
| *** sarob has quit IRC | 17:20 | |
| SpamapS | IIRC we fixed a few bugs in that area. | 17:21 |
| *** gyee has joined #openstack-infra | 17:21 | |
| SpamapS | mostly by liberal use of 'mv' | 17:21 |
| SpamapS | But since we isolate 1 build to 1 VM right now, there are likely many we haven't found. | 17:22 |
| SpamapS | clarkb: the simplest answer would be to have a lock one can grab to do the non-offline build that updates the cache. If the lock is taken, just run in offline. And then fix any issues with reading from updating caches. | 17:23 |
| SpamapS | Because chasing all of the concurrent writer problems would be complicated. | 17:23 |
| clarkb | SpamapS: you don't even need a lock to do that | 17:23 |
| SpamapS | clarkb: well we can call it whatever we want. Single-writer pattern. :) | 17:23 |
| clarkb | SpamapS: mostly what I want is a `dib-update-cache` | 17:23 |
| clarkb | SpamapS: but that doesn't seem to exist | 17:24 |
| SpamapS | clarkb: dib-update-cache would require extensive changes to elements. | 17:24 |
| *** _shaps_ has quit IRC | 17:24 | |
| *** ryanpetrello has joined #openstack-infra | 17:24 | |
| SpamapS | a --dont-finalize option would work tho | 17:24 |
| SpamapS | clarkb: actually yeah ok so as long as you don't care that we do still write stuff into a chroot we plan to throw away, then we can have a cache-update-only mode. | 17:25 |
| clarkb | SpamapS: that should be fine | 17:25 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for oslo.concurrency/nova UT bug 1410348 https://review.openstack.org/146922 | 17:26 |
| clarkb | I guess that is needed to know what to cache? | 17:26 |
| uvirtbot | Launchpad bug 1410348 in oslo.concurrency "test_ssh_encrypt_decrypt_text fails with UnicodeDecodeError after oslo.concurrency 0.4.0 release" [Undecided,New] https://launchpad.net/bugs/1410348 | 17:26 |
| SpamapS | clarkb: Right, the elements do all of the caching. So we can probably have an environment variable to signal elements to noop, something like 'DIB_CACHE_ONLY'.. it would just work faster when elements implement it, it would still work fine if they wrote to the doomed chroot. | 17:27 |
| *** zz_sabari is now known as sabari | 17:28 | |
| *** hdd has joined #openstack-infra | 17:28 | |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Adding devstack-plugin-glusterfs project to stackforge https://review.openstack.org/146822 | 17:30 |
| *** signed8bit has quit IRC | 17:30 | |
| JayF | Hey; I'm looking at https://bugs.launchpad.net/ironic/+bug/1358820 where someone is saying they're running "opportunistic tests" because they have mysql setup with "openstack_citest" | 17:30 |
| uvirtbot | Launchpad bug 1358820 in ironic "fuser/permissioning issue occurring during vanilla unit test run" [Undecided,New] | 17:30 |
| JayF | I can't find docs anywhere talking about how to setup openstack_citest; does anyone know of any? | 17:30 |
| *** rfolco has joined #openstack-infra | 17:30 | |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Adding devstack-plugin-glusterfs project to stackforge https://review.openstack.org/146822 | 17:31 |
| *** lucasagomes has joined #openstack-infra | 17:32 | |
| *** lucasagomes has left #openstack-infra | 17:32 | |
| fungi | JayF: https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/slave_db.pp | 17:32 |
| clarkb | JayF: https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/slave_db.pp#n29 its not super well documented as we are trying to move to having tests set that up iirc | 17:32 |
| clarkb | tl;dr is log in with that user then do what you want on the DB | 17:32 |
| JayF | Alright. So basically we have tests that exist that aren't exercised today. Wonderful. This probably is a real bug then | 17:33 |
| JayF | hooray | 17:33 |
| JayF | I can manage that setup, thanks! | 17:33 |
| clarkb | ? | 17:33 |
| *** mpaolino has joined #openstack-infra | 17:33 | |
| JayF | clarkb: meaning if we don't setup that user in the check jobs, the scenario in the bug is not getting exercised | 17:33 |
| clarkb | JayF: no the user is set up for ou | 17:33 |
| clarkb | all you hve to do is connect to the db and use it | 17:34 |
| JayF | aha, okay | 17:34 |
| *** signed8bit has joined #openstack-infra | 17:34 | |
| *** rfolco has quit IRC | 17:35 | |
| clarkb | ok I need to run. | 17:35 |
| clarkb | fungi: the node graph does look funny I wonder if jenkins is unhappy again? also https://review.openstack.org/#/c/145645/ | 17:35 |
| fungi | clarkb: possibly. i'll take a look | 17:36 |
| *** rfolco has joined #openstack-infra | 17:36 | |
| *** jaypipes has quit IRC | 17:36 | |
| *** pc_m has quit IRC | 17:36 | |
| clarkb | I have no idea if fixing that will make jenkins happier (probably not) but its annoyingto have that error message staring you down when debugging jenkins | 17:36 |
| * fungi nods | 17:36 | |
| *** ryanpetrello_ has joined #openstack-infra | 17:37 | |
| *** hashar has joined #openstack-infra | 17:37 | |
| *** ryanpetrello has quit IRC | 17:37 | |
| *** ryanpetrello_ is now known as ryanpetrello | 17:37 | |
| *** che-arne has quit IRC | 17:38 | |
| *** pc_m has joined #openstack-infra | 17:38 | |
| *** bhuvan has joined #openstack-infra | 17:39 | |
| *** bhuvan has joined #openstack-infra | 17:39 | |
| *** links has quit IRC | 17:40 | |
| *** jistr has quit IRC | 17:40 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for oslo.db/neutron bug 1410298 https://review.openstack.org/146894 | 17:40 |
| uvirtbot | Launchpad bug 1410298 in oslo.db "gate-neutron-dsvm-functional fails with "AttributeError: 'TestModelsMigrationsMysql' object has no attribute 'check_foreign_keys'" on oslo.db 1.4.0" [Critical,Fix released] https://launchpad.net/bugs/1410298 | 17:40 |
| fungi | jenkkins01 is the only one which looks especially bad off, so i'll give it a restart | 17:41 |
| *** pc_m has quit IRC | 17:41 | |
| *** e0ne has joined #openstack-infra | 17:41 | |
| *** pc_m_ has joined #openstack-infra | 17:41 | |
| *** e0ne has quit IRC | 17:42 | |
| *** sputnik13 has joined #openstack-infra | 17:42 | |
| *** mpaolino has quit IRC | 17:43 | |
| *** bhuvan has quit IRC | 17:44 | |
| *** xyang0 has joined #openstack-infra | 17:44 | |
| *** bhuvan has joined #openstack-infra | 17:44 | |
| *** bhuvan has quit IRC | 17:44 | |
| *** bhuvan has joined #openstack-infra | 17:44 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 17:44 | |
| *** dhritishikhar has quit IRC | 17:44 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 17:45 | |
| *** jaypipes has joined #openstack-infra | 17:45 | |
| *** jpich has quit IRC | 17:45 | |
| *** ryanpetrello has quit IRC | 17:47 | |
| *** barra204 has quit IRC | 17:47 | |
| openstackgerrit | Matt Riedemann proposed openstack/requirements: Block oslo.concurrency 0.4.0 https://review.openstack.org/146942 | 17:49 |
| *** shashankhegde has joined #openstack-infra | 17:49 | |
| *** salv-orlando has joined #openstack-infra | 17:50 | |
| *** dizquierdo has quit IRC | 17:50 | |
| *** sarob_ is now known as sarob | 17:51 | |
| *** rfolco has quit IRC | 17:51 | |
| *** cdent has quit IRC | 17:52 | |
| *** rfolco has joined #openstack-infra | 17:52 | |
| *** EmilienM is now known as EmilienM|afk | 17:53 | |
| *** sputnik13 has quit IRC | 17:53 | |
| *** sputnik13 has joined #openstack-infra | 17:53 | |
| *** denis_makogon has quit IRC | 17:54 | |
| *** rfolco has quit IRC | 17:54 | |
| mriedem | dhellmann: fungi: clarkb: dansmith: dims__: can we ram this in to unblock nova in the gate while the oslo.concurrency 0.4.1 fix is being worked on? https://review.openstack.org/#/c/146942/ | 17:54 |
| *** signed8bit is now known as signed8bit_ZZZzz | 17:54 | |
| dims__ | +1 mriedem | 17:54 |
| dansmith | that seems like a very safe patch to promote, | 17:54 |
| mriedem | this is the revert https://review.openstack.org/#/c/146940/ | 17:55 |
| mriedem | that will fix oslo.concurrency (fix nova) with a 0.4.1 release | 17:55 |
| dansmith | and if it solves the problem, then it's much less impactful than our alternatives, AFAICT | 17:55 |
| dhellmann | mriedem: yeah, we'll want that anyway | 17:55 |
| *** salv-orlando has quit IRC | 17:55 | |
| mriedem | dhellmann: well, w/o sdague's workaround | 17:55 |
| mriedem | which it sounds like we probably won't merge | 17:55 |
| dhellmann | mriedem: +2a | 17:56 |
| mriedem | cool | 17:56 |
| *** ChuckC_ has joined #openstack-infra | 17:57 | |
| dhellmann | I need to get some lunch, but I shouldn't be gone long | 17:57 |
| mriedem | and dansmith and i can be on the lookout for the proposal bot | 17:57 |
| mriedem | me too, it's taco tuesday! | 17:57 |
| dims__ | mriedem: once "oslo.concurrency>=0.3.0,!=0.4.0" is in global requirements, do we still need to update nova's requirements.txt to unblock nova? | 17:57 |
| dansmith | mriedem: we need that promoted past the fourteen things in the gate right now, and past check too right? | 17:57 |
| *** signed8bit_ZZZzz is now known as signed8bit | 17:58 | |
| mriedem | dims__: yeah, once the bot proposes it | 17:58 |
| mriedem | dansmith: probably... | 17:58 |
| mriedem | jeblair: fungi: clarkb: any chance to promote https://review.openstack.org/#/c/146942/ ? | 17:58 |
| dims__ | mriedem: do we want to promote it as well? along with 146942? | 17:59 |
| mriedem | dims__: the bot update? maybe once it shows up | 17:59 |
| mriedem | i hope to have 4 tacos in my gut by then | 17:59 |
| *** hashar has quit IRC | 17:59 | |
| mriedem | bbiab | 17:59 |
| *** emagana has quit IRC | 18:00 | |
| *** tonytan4ever has quit IRC | 18:00 | |
| dhellmann | mriedem, dansmith : you can bump things out of the gate by changing their commit messages in the gerrit ui (just reformat stuff, add newlines, etc.) | 18:00 |
| dansmith | dhellmann: it's check that is the problem | 18:00 |
| dansmith | dhellmann: things in check have been there for four hours without getting started | 18:00 |
| *** ChuckC has quit IRC | 18:00 | |
| dansmith | dhellmann: so we need divine intervention if we want to skirt that | 18:01 |
| *** eharney has quit IRC | 18:01 | |
| dhellmann | ah | 18:01 |
| dansmith | (yes, I just deified fungi :P) | 18:01 |
| fungi | mriedem: is it breaking more than one project? | 18:01 |
| *** eharney has joined #openstack-infra | 18:01 | |
| dansmith | fungi: meaning the broken release or the fact that we're wedging the gate? | 18:01 |
| fungi | dansmith: right--is it fixing failures for multiple projects in the integrated gate? | 18:02 |
| *** zz_avozza is now known as avozza | 18:02 | |
| *** rfolco has joined #openstack-infra | 18:02 | |
| dansmith | fungi: I don't know that any other projects are *actually* hitting the problem with the oslo code, but they're certainly affected by nova being unable to pass any tests until it lands, right? | 18:03 |
| *** bhunter71 has joined #openstack-infra | 18:03 | |
| fungi | dansmith: other projects aren't tested on nova's tests are they? | 18:03 |
| * fungi looks to see if any changes are failing in the gate besides nova changes | 18:03 | |
| *** timcline has joined #openstack-infra | 18:03 | |
| *** dhritishikhar has joined #openstack-infra | 18:04 | |
| *** bswartz1 has quit IRC | 18:04 | |
| fungi | looks to me like it's only impacting nova? | 18:04 |
| *** patrickeast has joined #openstack-infra | 18:04 | |
| dansmith | fungi: I think this is breaking our ability to run tempest tests, which does gate other projects, right? | 18:04 |
| dims__ | fungi: y gate-nova-python27 is the only one i see that breaks | 18:04 |
| *** signed8bit has joined #openstack-infra | 18:04 | |
| dansmith | ah, I thought it'd be affecting our d-g runs | 18:04 |
| fungi | dansmith: looks like tempest tests are all fine | 18:04 |
| dansmith | hmm, I'm not sure why that would be | 18:05 |
| dims__ | dansmith: build_name:"gate-nova-python27" AND NOT project:"openstack/nova" is empty | 18:05 |
| fungi | doesn't look like an all-hands emergency scramble, just an annoyance for nova devs | 18:05 |
| *** signed8bit has quit IRC | 18:05 | |
| dims__ | dansmith: so we go back to sdague's fix | 18:06 |
| *** signed8bit has joined #openstack-infra | 18:06 | |
| dansmith | fungi: well, what we're talking about is trying to avoid two things | 18:06 |
| *** bswartz has joined #openstack-infra | 18:06 | |
| dansmith | fungi: the first is merging a hack where we write security-sensitive stuff to the disk to sidestep the issue | 18:06 |
| dansmith | fungi: the second is waiting for multiple things to land in order to fix it properly | 18:06 |
| *** sarob has quit IRC | 18:06 | |
| dansmith | which could be tomorrow easily, given how the check queue looks right now | 18:07 |
| *** rfolco has quit IRC | 18:07 | |
| fungi | yep, working on that | 18:07 |
| *** tkelsey has quit IRC | 18:07 | |
| *** melwitt has joined #openstack-infra | 18:08 | |
| *** erikmwilson has quit IRC | 18:08 | |
| *** erikmwilson_ is now known as erikmwilson | 18:08 | |
| pleia2 | fungi: re: tamiflu, I'm too stubborn when I get sick ("it's just allergies" "it's just a little cold") so I never manage to get+use such things fast enough | 18:08 |
| *** banix has joined #openstack-infra | 18:09 | |
| pleia2 | that said, I think I'm mostly out of my flu-induced fugue state this morning ;) catching up with emails and things now | 18:09 |
| *** signed8bit has quit IRC | 18:09 | |
| openstackgerrit | Merged openstack-infra/storyboard: Added cron plugin to clean old access tokens. https://review.openstack.org/140536 | 18:09 |
| *** emagana has joined #openstack-infra | 18:09 | |
| *** erikwilson has joined #openstack-infra | 18:09 | |
| *** signed8bit has joined #openstack-infra | 18:09 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:09 | |
| *** ivar-lazzaro has quit IRC | 18:10 | |
| dansmith | fungi: out of curiosity, is the requirement for promotion that something has to be affecting more than one project? | 18:10 |
| dansmith | because it seems like not wasting a bunch of resources on something we know is going to fail for 24 hours is also a good reason :) | 18:10 |
| openstackgerrit | Merged openstack-infra/storyboard: Consolidated OAuth Configuration, added enable flag to oauth cleaner. https://review.openstack.org/144355 | 18:10 |
| *** ivar-lazzaro has joined #openstack-infra | 18:11 | |
| fungi | dansmith: sorry, trying to prioritize fixing things that are impacting multiple projects right now. and yes in the past we've not considered a break in a single project which wasn't impacting development of other projects to merit giving that project's fix a free pass to the head of the line | 18:12 |
| dansmith | fungi: well, this isn't a nova patch, FWIW :) | 18:13 |
| dansmith | but okay | 18:13 |
| fungi | the easy way out is for oslo devs to re-tag a higher version on their previous state, right? | 18:13 |
| fungi | that doesn't have to go through review, testing, anything | 18:14 |
| mriedem | working on that too right now | 18:14 |
| *** signed8bit has quit IRC | 18:14 | |
| mriedem | right | 18:14 |
| mriedem | so it'll be a race to see which fixes it first | 18:14 |
| *** ivar-lazzaro has quit IRC | 18:14 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:14 | |
| *** signed8bit has joined #openstack-infra | 18:14 | |
| *** ihrachyshka has joined #openstack-infra | 18:14 | |
| bhunter71 | question/sanity checks; What is the path of least resistance when dealing with the serving of jenkins logs in a openstack CI infra clone? I'm correct that the scp publisher to the 'static' host is the way this works? Is there an easier way where Jenkins can just serve them? Also, could anyone clarify the role of Swift in CI, particuarly as it relates to zuul/jenkins and build logs? Thanks much!! | 18:17 |
| *** mtanino has joined #openstack-infra | 18:18 | |
| *** dhritishikhar has quit IRC | 18:18 | |
| rcarrillocruz | bhunter71: the rationale for getting Swift is to save space, historically logs have been put into tarballs.openstack.org | 18:18 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Added story_id to comment event. https://review.openstack.org/145912 | 18:18 |
| rcarrillocruz | we still do, but there's work ongoing to move to swift | 18:19 |
| *** hdd has quit IRC | 18:19 | |
| dims__ | mriedem: +2'ed the oslo.concurrency revert | 18:20 |
| rcarrillocruz | erm, logs.openstack.org | 18:20 |
| rcarrillocruz | although i think they;re the same machines, just cnames | 18:20 |
| bhunter71 | rcarrillocruz; thanks. tarballs is just a vhost off of static, and that's that webserver with the large LVM storage | 18:21 |
| *** signed8bit has quit IRC | 18:21 | |
| *** pc_m_ has quit IRC | 18:21 | |
| BharatK | Hi All | 18:22 |
| BharatK | Can anyone please review my patch https://review.openstack.org/#/c/146822/ | 18:22 |
| BharatK | ? | 18:22 |
| *** MaxV_ has quit IRC | 18:22 | |
| *** pc_m has joined #openstack-infra | 18:22 | |
| *** signed8bit has joined #openstack-infra | 18:22 | |
| *** dustins_ is now known as dustins | 18:22 | |
| *** pc_m has quit IRC | 18:23 | |
| *** _nadya_ has joined #openstack-infra | 18:23 | |
| *** pc_m has joined #openstack-infra | 18:23 | |
| *** ivar-lazzaro has quit IRC | 18:24 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:24 | |
| *** EmilienM|afk is now known as EmilienM | 18:24 | |
| *** Ryan_Lane has joined #openstack-infra | 18:25 | |
| *** hdd has joined #openstack-infra | 18:26 | |
| *** koolhead17 has quit IRC | 18:26 | |
| rcarrillocruz | fungi , clarkb: http://paste.openstack.org/show/157231/ | 18:26 |
| rcarrillocruz | i'm seeing issues applying the manifest on trusty | 18:26 |
| rcarrillocruz | so def it needs some work | 18:26 |
| rcarrillocruz | i'll investigate | 18:27 |
| *** rfolco has joined #openstack-infra | 18:27 | |
| *** Masahiro has joined #openstack-infra | 18:28 | |
| rcarrillocruz | hah | 18:31 |
| rcarrillocruz | in apache 2.4 there's no conf.d folder :-) | 18:31 |
| *** avozza is now known as zz_avozza | 18:32 | |
| *** _nadya_ has quit IRC | 18:32 | |
| *** Masahiro has quit IRC | 18:32 | |
| *** _nadya_ has joined #openstack-infra | 18:33 | |
| *** johnthetubaguy is now known as zz_johnthetubagu | 18:33 | |
| *** signed8bit has quit IRC | 18:33 | |
| *** otter768 has joined #openstack-infra | 18:33 | |
| *** signed8bit has joined #openstack-infra | 18:33 | |
| *** salv-orlando has joined #openstack-infra | 18:34 | |
| *** teran_ has quit IRC | 18:35 | |
| *** signed8bit has quit IRC | 18:35 | |
| dhellmann | fungi: hmm, tagging 0.3.0 as 0.4.1 might do it | 18:36 |
| *** Longgeek has quit IRC | 18:36 | |
| dhellmann | feels like it might break other things though | 18:36 |
| fungi | dhellmann: yeah, that was the idea i was floating. no idea if it's safe for your case | 18:36 |
| *** _nadya_ has quit IRC | 18:37 | |
| dhellmann | I think I'd rather block it in the requirements list to avoid unexpected consequences from essentially reverting all of the 0.4.0 changes | 18:37 |
| *** salv-orlando has quit IRC | 18:38 | |
| *** otter768 has quit IRC | 18:38 | |
| *** harlowja_away is now known as harlowja | 18:39 | |
| *** ZZelle_ has joined #openstack-infra | 18:39 | |
| *** Rockyg has joined #openstack-infra | 18:40 | |
| *** rfolco has left #openstack-infra | 18:41 | |
| *** sabari is now known as zz_sabari | 18:41 | |
| *** BharatK has left #openstack-infra | 18:42 | |
| *** ivar-lazzaro has quit IRC | 18:42 | |
| *** salv-orlando has joined #openstack-infra | 18:42 | |
| *** salv-orlando has quit IRC | 18:42 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:42 | |
| *** ivar-lazzaro has quit IRC | 18:44 | |
| openstackgerrit | Adam Gandelman proposed openstack-infra/elastic-recheck: Add query for bug 1410411 https://review.openstack.org/146947 | 18:44 |
| uvirtbot | Launchpad bug 1410411 in ceilometer "unit tests are leaking sudo commands" [Undecided,New] https://launchpad.net/bugs/1410411 | 18:44 |
| *** ivar-lazzaro has joined #openstack-infra | 18:45 | |
| *** salv-orlando has joined #openstack-infra | 18:45 | |
| *** tonytan4ever has joined #openstack-infra | 18:47 | |
| *** salv-orlando has quit IRC | 18:48 | |
| *** spzala has quit IRC | 18:49 | |
| *** katherine_ has quit IRC | 18:50 | |
| *** romcheg has quit IRC | 18:51 | |
| *** romcheg has joined #openstack-infra | 18:51 | |
| *** romcheg has quit IRC | 18:52 | |
| *** romcheg has joined #openstack-infra | 18:53 | |
| *** e0ne has joined #openstack-infra | 18:53 | |
| *** rkukura has joined #openstack-infra | 18:54 | |
| *** sarob has joined #openstack-infra | 18:56 | |
| *** banix has quit IRC | 18:56 | |
| *** rfolco has joined #openstack-infra | 18:56 | |
| *** sarob has quit IRC | 18:56 | |
| jeblair | sdague: did you see my message from yesterday about the req update script? | 18:56 |
| *** hdd has quit IRC | 18:56 | |
| *** MaxV has joined #openstack-infra | 18:58 | |
| *** hichtakk has joined #openstack-infra | 18:58 | |
| *** baoli has quit IRC | 18:59 | |
| *** e0ne has quit IRC | 18:59 | |
| *** doude has quit IRC | 18:59 | |
| *** sarob has joined #openstack-infra | 18:59 | |
| *** emagana has quit IRC | 19:00 | |
| *** zz_sabari is now known as sabari | 19:00 | |
| fungi | meeting time | 19:00 |
| pleia2 | meeting time | 19:00 |
| *** emagana has joined #openstack-infra | 19:00 | |
| *** rfolco has quit IRC | 19:00 | |
| sdague | jeblair: only vaguely, what's the issue? | 19:01 |
| *** alexpilotti has quit IRC | 19:01 | |
| *** rfolco has joined #openstack-infra | 19:01 | |
| *** emagana has quit IRC | 19:01 | |
| *** sabari is now known as zz_sabari | 19:02 | |
| *** ihrachyshka has quit IRC | 19:02 | |
| *** emagana has joined #openstack-infra | 19:02 | |
| *** baoli has joined #openstack-infra | 19:02 | |
| *** zz_sabari is now known as sabari | 19:03 | |
| *** banix has joined #openstack-infra | 19:03 | |
| *** ivar-laz_ has joined #openstack-infra | 19:04 | |
| *** ChuckC_ has quit IRC | 19:04 | |
| jesusaurus | clarkb: can you star https://review.openstack.org/#/c/76057 for review? | 19:05 |
| *** ivar-lazzaro has quit IRC | 19:06 | |
| *** pblaho has quit IRC | 19:08 | |
| *** hdd has joined #openstack-infra | 19:10 | |
| *** dtantsur is now known as dtantsur|afk | 19:13 | |
| *** dannywilson has quit IRC | 19:13 | |
| *** ociuhandu has quit IRC | 19:13 | |
| *** tqtran has left #openstack-infra | 19:14 | |
| *** dannywilson has joined #openstack-infra | 19:14 | |
| *** dannywilson has quit IRC | 19:15 | |
| *** dannywilson has joined #openstack-infra | 19:15 | |
| *** MaxV has quit IRC | 19:15 | |
| *** rfolco has quit IRC | 19:17 | |
| *** rfolco has joined #openstack-infra | 19:18 | |
| *** yamahata has joined #openstack-infra | 19:19 | |
| *** hdd has quit IRC | 19:19 | |
| *** ChuckC has joined #openstack-infra | 19:19 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Created Subscriber Utility https://review.openstack.org/146956 | 19:20 |
| *** jp_at_hp has quit IRC | 19:20 | |
| *** hdd has joined #openstack-infra | 19:21 | |
| *** rfolco has quit IRC | 19:22 | |
| *** Hal_ has joined #openstack-infra | 19:23 | |
| *** rfolco has joined #openstack-infra | 19:23 | |
| openstackgerrit | Steve McLellan proposed openstack-dev/pbr: Use diff --exit-code instead of --quiet https://review.openstack.org/146958 | 19:23 |
| *** Rockyg has quit IRC | 19:24 | |
| *** banix has quit IRC | 19:24 | |
| HenryG | anteaya: Hi, can you recommend who to ping to get another +2 for https://review.openstack.org/145793 and https://review.openstack.org/145928 | 19:24 |
| *** Sukhdev has joined #openstack-infra | 19:24 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Created Subscriber Utility https://review.openstack.org/146956 | 19:25 |
| *** TravT has quit IRC | 19:25 | |
| *** achanda has joined #openstack-infra | 19:25 | |
| *** banix has joined #openstack-infra | 19:25 | |
| *** Rockyg has joined #openstack-infra | 19:25 | |
| *** rfolco has quit IRC | 19:27 | |
| *** rfolco has joined #openstack-infra | 19:28 | |
| *** nikesh_vedams_ has quit IRC | 19:29 | |
| jeblair | sdague: http://paste.openstack.org/show/156660/ | 19:31 |
| jeblair | sdague: the script did not output "Version change for..." | 19:31 |
| NobodyCam | hi -infra just checking on the gate status. I'm seeing 503 Service Unavailable fetching apt-get indexes. I see a couple of almost similar bugs just not exact so figured i'd ask | 19:31 |
| sdague | jeblair: hmmm | 19:32 |
| jeblair | sdague: but it then did run "git commit", so it thinks something changed | 19:32 |
| *** rfolco has quit IRC | 19:32 | |
| *** _nadya_ has joined #openstack-infra | 19:33 | |
| jeblair | sdague: i can't figure it out yet. i do note that in devstack there is a comment saying "git diff --quiet" is buggy, but i don't know if that particular bug would affect this (and besides, i think we _do_ expect a reqs change there) | 19:33 |
| sdague | so more interestingly, I don't know where 'Update requirements' comes from | 19:33 |
| jeblair | sdague: oh i think that's in tools/integration.sh | 19:34 |
| *** rfolco has joined #openstack-infra | 19:35 | |
| sdague | because the stock message from the update script is 'INITIAL_COMMIT_MSG="Updated from global requirements"' | 19:35 |
| jeblair | sdague: sorry, this is in the check-requirements job (so not the proposal job) | 19:35 |
| sdague | ah, ok | 19:35 |
| *** thingee has joined #openstack-infra | 19:35 | |
| sdague | so that's still running out of the pbr tree? | 19:35 |
| sdague | or did that cut over | 19:35 |
| sdague | jeblair: do you have the review in question so I can look? | 19:36 |
| *** bswartz has quit IRC | 19:36 | |
| jeblair | sdague: here's the job: https://jenkins03.openstack.org/job/check-requirements-integration-dsvm/424/console | 19:36 |
| jeblair | better get a logs.o.o link before that goes away | 19:36 |
| *** Longgeek has joined #openstack-infra | 19:37 | |
| jeblair | (it was still running when i wrote that up) | 19:37 |
| jeblair | as soon as firefox works again, i'll find the change :) | 19:37 |
| sdague | ok, yeh, so probably first thing to do stop running the requirements test suite from pbr | 19:37 |
| *** elyezer has joined #openstack-infra | 19:37 | |
| sdague | 015-01-13 01:04:22.129 | + bash -xe /opt/stack/new/pbr/tools/integration.sh | 19:37 |
| *** bswartz has joined #openstack-infra | 19:37 | |
| sdague | then fix it in requirements repo | 19:38 |
| elyezer | I need help with jenkins job builder | 19:38 |
| elyezer | it is raising an exception here https://github.com/openstack-infra/jenkins-job-builder/blob/master/jenkins_jobs/builder.py#L345 | 19:38 |
| *** sabari is now known as zz_sabari | 19:38 | |
| *** salv-orlando has joined #openstack-infra | 19:38 | |
| *** rkukura has quit IRC | 19:38 | |
| sdague | though, the reality is, this doesn't do anything outside of that test, so it's mostly just a nicety fail in that one test | 19:39 |
| *** rfolco has quit IRC | 19:39 | |
| jeblair | sdague: oh! wow. that just might help with the "this code does not appear to be doing what it says" part of the problem | 19:40 |
| sdague | jeblair: yeh | 19:40 |
| sdague | I'll propose some patches to do that shortly | 19:40 |
| jeblair | sdague: https://review.openstack.org/146673 was the test change that run was from | 19:41 |
| *** rfolco has joined #openstack-infra | 19:41 | |
| openstackgerrit | Merged openstack-infra/storyboard: Added story_id to comment event. https://review.openstack.org/145912 | 19:42 |
| openstackgerrit | Merged openstack-infra/project-config: Move devstack f20 jobs to f21 https://review.openstack.org/146760 | 19:43 |
| jeblair | sdague: so if i'm still following correctly, the pbr integration script should still be running the current (checked out under test, so in my test change, current) version of the requirements update script. so i think the puzzle still stands | 19:43 |
| *** zz_sabari is now known as sabari | 19:43 | |
| SergeyLukjanov | jeblair, asselin, please, take a look on announcement email draft - https://etherpad.openstack.org/p/announce-puppet-split-sprint | 19:44 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Text fields validation with json schema https://review.openstack.org/143988 | 19:44 |
| SergeyLukjanov | jeblair, asselin and the q. is what's the expected lenght of the event? | 19:44 |
| jeblair | SergeyLukjanov: 24h i think | 19:44 |
| *** signed8bit has joined #openstack-infra | 19:45 | |
| *** rfolco has quit IRC | 19:45 | |
| bhunter71 | elyezer: do you know the parameters 'project' and 'template' when it fails? i don't know this code, but seems maybe the template is missing or something? the full contents of your job-builder yaml directory/definitions may also help if they're available somewhere | 19:46 |
| *** rmcall has joined #openstack-infra | 19:46 | |
| clarkb | fungi thinking about dib, its possibly a perms issue if sudoing wasnt done right. maybe try a `sudo -u nodepool nodepool image-build devstack-trusty-dib` and see if that fails? | 19:46 |
| *** Hal_ has quit IRC | 19:46 | |
| jeblair | SergeyLukjanov: made some changes to make it clear that we're working on the infra puppet modules, not the openstack ones | 19:46 |
| asselin | SergeyLukjanov, looks good to me | 19:47 |
| *** banix has quit IRC | 19:47 | |
| openstackgerrit | Kurt Taylor proposed openstack-infra/system-config: Refresh Third-party Overview section https://review.openstack.org/146968 | 19:47 |
| asselin | SergeyLukjanov, links are all good | 19:48 |
| openstackgerrit | Steve McLellan proposed openstack/requirements: Use diff --exit-code instead of --quiet https://review.openstack.org/146969 | 19:48 |
| *** signed8bit has quit IRC | 19:48 | |
| *** rkukura has joined #openstack-infra | 19:48 | |
| jeblair | sdague: ^ maybe related | 19:48 |
| elyezer | bhunter71: https://gist.github.com/elyezer/73eece902d8d9e86db98 | 19:48 |
| *** teran has joined #openstack-infra | 19:48 | |
| *** rfolco has joined #openstack-infra | 19:48 | |
| elyezer | as simple as this it fails with | 19:48 |
| fungi | clarkb: is it possible that the cache is sometimes being updated by diskimage creation running as root (manual) and sometimes running as nodepool (scheduled)? | 19:48 |
| elyezer | bhunter71: it fail with https://gist.github.com/elyezer/73eece902d8d9e86db98#file-exception-py | 19:49 |
| *** sputnik13 has quit IRC | 19:49 | |
| rfolco | HexChat: 2.9.5 ** OS: Linux 2.6.32-431.30.1.el6.x86_64 x86_64 ** Distro: ? "?" ? ** CPU: 4 x Intel(R) Core(TM) i5-2520M CPU @ 2.50Hzz (GenuieIIntel) @ 800MHz ** RAM: Physical: 7.6GB, 76.8% free ** Disk: Total: 285.5GB, 63.2% free ** VGA: Intel Corporation 2nd Generation Core Processor Family Integrated Graphics Controller ** Sound: HDA-Intel - HDA Intel PCH ** Ethernet: | 19:49 |
| rfolco | Intel Corporation 82579LM Gigabit Network Connection ** Uptime: 4d 8h 34m 14s ** | 19:49 |
| elyezer | the weird thing is that it was not failing... | 19:50 |
| clarkb | fungi ya thats ehat I am wondering | 19:50 |
| clarkb | its possible I derped the cache that way | 19:50 |
| fungi | clarkb: reviewing the image logs with a more critical eye, diskimages are being generated serially as jeblair and yolanda thought | 19:50 |
| *** baoli has quit IRC | 19:50 | |
| fungi | trusty runs to completion, then precise, then centos7 (no overlap from what i can see in the logs) | 19:51 |
| *** rfolco has quit IRC | 19:51 | |
| SergeyLukjanov | jeblair, asselin thanks folks | 19:51 |
| fungi | so the cache contention theory is invalid, at least for scheduled builds (obviously if you manually update images concurrently then you get to keep both pieces) | 19:52 |
| *** achanda has quit IRC | 19:52 | |
| *** TravT has joined #openstack-infra | 19:52 | |
| *** dannywilson has quit IRC | 19:53 | |
| *** pc_m has quit IRC | 19:53 | |
| *** TravT has joined #openstack-infra | 19:53 | |
| *** rfolco has joined #openstack-infra | 19:53 | |
| *** sputnik13 has joined #openstack-infra | 19:54 | |
| *** dannywilson has joined #openstack-infra | 19:54 | |
| *** _nadya_ has quit IRC | 19:55 | |
| *** achanda has joined #openstack-infra | 19:55 | |
| *** Longgeek has quit IRC | 19:55 | |
| *** _nadya_ has joined #openstack-infra | 19:55 | |
| elyezer | bhunter71: never mind I was able to figure out the issue, this extra `:` was causing that https://gist.github.com/elyezer/73eece902d8d9e86db98#file-job-yaml-L11 | 19:55 |
| *** gyee has quit IRC | 19:56 | |
| *** reed has quit IRC | 19:56 | |
| *** sabari is now known as zz_sabari | 19:57 | |
| *** rkukura has quit IRC | 19:58 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Created Subscriber Utility https://review.openstack.org/146956 | 19:58 |
| yolanda | yes, also looked at my logs here for several weeks, all dib images are built sequentially | 19:58 |
| *** banix has joined #openstack-infra | 19:58 | |
| *** sc68cal_ has joined #openstack-infra | 19:58 | |
| *** tonytan4ever has quit IRC | 19:58 | |
| *** teran has quit IRC | 19:58 | |
| *** sc68cal has quit IRC | 19:59 | |
| *** isviridov_away is now known as isviridov | 19:59 | |
| *** teran has joined #openstack-infra | 19:59 | |
| *** ddieterly has quit IRC | 19:59 | |
| fungi | clarkb: should we chown -R nodepool:nodepool all of the current cache, or just blow it away and let it repopulate naturally? | 20:00 |
| *** rackertom has quit IRC | 20:00 | |
| *** _nadya_ has quit IRC | 20:00 | |
| *** dprince has quit IRC | 20:00 | |
| *** rackertom has joined #openstack-infra | 20:00 | |
| *** ddieterly has joined #openstack-infra | 20:00 | |
| *** melwitt has quit IRC | 20:00 | |
| *** melwitt has joined #openstack-infra | 20:01 | |
| clarkb | I would test the above command first just to see if it fails | 20:01 |
| *** aysyd has quit IRC | 20:01 | |
| clarkb | if it does fail chown should work | 20:01 |
| *** melwitt has quit IRC | 20:01 | |
| *** melwitt has joined #openstack-infra | 20:01 | |
| *** melwitt has quit IRC | 20:03 | |
| *** sarob has quit IRC | 20:03 | |
| *** melwitt has joined #openstack-infra | 20:03 | |
| *** rfolco has quit IRC | 20:04 | |
| *** bhuvan has quit IRC | 20:04 | |
| *** reed has joined #openstack-infra | 20:04 | |
| *** reed has quit IRC | 20:04 | |
| *** reed has joined #openstack-infra | 20:04 | |
| *** amitgandhinz has joined #openstack-infra | 20:05 | |
| mtreinish | clarkb: if you get a sec: https://review.openstack.org/#/c/146666/ should fix problem #3 from my subunit/testr changes | 20:05 |
| *** ddieterly has quit IRC | 20:05 | |
| *** zz_gondoi is now known as gondoi | 20:06 | |
| *** melwitt has quit IRC | 20:06 | |
| *** melwitt has joined #openstack-infra | 20:06 | |
| *** pelix has quit IRC | 20:07 | |
| *** timcline has quit IRC | 20:07 | |
| *** bhuvan has joined #openstack-infra | 20:07 | |
| sigmavirus24 | mordred: ping | 20:07 |
| *** melwitt has quit IRC | 20:08 | |
| *** melwitt has joined #openstack-infra | 20:08 | |
| *** gondoi is now known as zz_gondoi | 20:08 | |
| fungi | clarkb: i'll give it a go and see what happens | 20:09 |
| fungi | running now | 20:09 |
| *** sarob has joined #openstack-infra | 20:09 | |
| fungi | mkdir: cannot create directory ‘/home/fungi/.cache’: Permission denied | 20:10 |
| *** zz_avozza is now known as avozza | 20:10 | |
| fungi | that's that dib bug | 20:10 |
| fungi | i'll make my ~/.cache owned by nodepool:nodepool and see what else breaks | 20:11 |
| clarkb | oh ya I havent fixed that yet | 20:11 |
| clarkb | will do that first thing | 20:11 |
| fungi | error: insufficient permission for adding an object to repository database /opt/dib_cache/source-repositories/devstack_9383d75c34a24bf0cd2ce50da1f4b74274dfb57b/.git/objects | 20:12 |
| fungi | drwxrwxrwx 68 nodepool nodepool 4096 Jan 13 20:11 /opt/dib_cache/source-repositories/devstack_9383d75c34a24bf0cd2ce50da1f4b74274dfb57b/.git/objects | 20:13 |
| *** ildikov_afk is now known as ildikov | 20:13 | |
| fungi | sudo -H maybe? | 20:13 |
| fungi | wait, no, that only affects homedir | 20:14 |
| fungi | which would still solve my ~/.cache dilemma | 20:14 |
| *** banix has quit IRC | 20:14 | |
| fungi | though i do find it a little odd that the cache is 0777 perms | 20:14 |
| *** ldnunes has quit IRC | 20:15 | |
| *** david-lyle has joined #openstack-infra | 20:16 | |
| *** markmcclain has joined #openstack-infra | 20:16 | |
| *** achanda has quit IRC | 20:16 | |
| *** Masahiro has joined #openstack-infra | 20:17 | |
| *** markmcclain has quit IRC | 20:17 | |
| *** markmcclain has joined #openstack-infra | 20:17 | |
| clarkb | huh | 20:17 |
| fungi | all parent dirs of that dir are also nodepool:nodepool owned | 20:19 |
| clarkb | maybe it has to remove another file? | 20:19 |
| clarkb | and the error is bad? | 20:19 |
| fungi | ahh, yep, there are a mix of root:root and nodepool:nodepool owned files under it | 20:20 |
| *** mikedillion has joined #openstack-infra | 20:20 | |
| *** avozza is now known as zz_avozza | 20:20 | |
| fungi | let me chown everything and see what happens | 20:20 |
| fungi | clarkb: any objection to me running `sudo chown -R nodepool:nodepool /opt/dib_cache` now? | 20:20 |
| clarkb | nope | 20:20 |
| fungi | i expect this to take a few minutes | 20:21 |
| fungi | pleasantly surprised. already finished | 20:21 |
| fungi | trying to update again | 20:21 |
| *** Masahiro has quit IRC | 20:21 | |
| *** teran_ has joined #openstack-infra | 20:22 | |
| fungi | also using `sudo -H -u nodepool ...` so that it will put .cache in its own homedir rather than mine | 20:22 |
| nikhil_k | hi, wanted to mention that the Glance gate is broken as of now | 20:23 |
| nikhil_k | Have filed this bug https://bugs.launchpad.net/sqlalchemy-migrate/+bug/1410494 | 20:23 |
| uvirtbot | Launchpad bug 1410494 in glance "sqlalchemy-migrate>0.9.1 and <0.9.5 causes glance test failures" [Critical,New] | 20:23 |
| nikhil_k | ok to PR to global requirements? | 20:23 |
| *** teran__ has joined #openstack-infra | 20:23 | |
| *** teran has quit IRC | 20:24 | |
| *** Rockyg has quit IRC | 20:25 | |
| fungi | nikhil_k: interesting. 0.9.2 has been released for 4 months. any idea why you're only just now noticing? | 20:26 |
| *** teran_ has quit IRC | 20:26 | |
| *** Rockyg has joined #openstack-infra | 20:26 | |
| fungi | mriedem: ^ | 20:26 |
| nikhil_k | fungi: it's for & above 0.9.2, prolly should mention that too | 20:27 |
| *** MaxV has joined #openstack-infra | 20:27 | |
| nikhil_k | current, requirement is pinned to | 20:27 |
| *** shashankhegde has quit IRC | 20:27 | |
| *** sc68cal_ is now known as sc68cal | 20:27 | |
| nikhil_k | !=0.9.2 | 20:27 |
| openstack | nikhil_k: Error: "=0.9.2" is not a valid command. | 20:27 |
| fungi | nikhil_k: oh, got it, so some regression introduced in 0.9.3/0.9.4 in the past day or so | 20:27 |
| *** dprince has joined #openstack-infra | 20:28 | |
| *** rkukura has joined #openstack-infra | 20:28 | |
| fungi | looks like the !=0.9.2 was due to bug 1368391 | 20:28 |
| uvirtbot | Launchpad bug 1368391 in sqlalchemy-migrate "sqlalchemy-migrate 0.9.2 is breaking nova unit tests" [High,Fix committed] https://launchpad.net/bugs/1368391 | 20:28 |
| nikhil_k | yeah | 20:29 |
| nikhil_k | (I mean yes and yes) | 20:29 |
| *** rkukura has quit IRC | 20:29 | |
| *** achanda has joined #openstack-infra | 20:30 | |
| *** hichtakk has quit IRC | 20:30 | |
| *** shashankhegde has joined #openstack-infra | 20:31 | |
| *** ivar-laz_ has quit IRC | 20:32 | |
| *** ddieterly has joined #openstack-infra | 20:32 | |
| fungi | anyway, yeah, you could probably expand the constraint to !=0.9.2,!=0.9.3,!=0.9.4 and then hope 0.9.5 addresses the new issue | 20:32 |
| fungi | nikhil_k: ^ | 20:32 |
| *** ivar-lazzaro has joined #openstack-infra | 20:32 | |
| *** hichtakk has joined #openstack-infra | 20:32 | |
| *** hichtakk has quit IRC | 20:32 | |
| nikhil_k | fungi: ah cool, PR on your way | 20:33 |
| *** hichtakk has joined #openstack-infra | 20:33 | |
| *** hichtakk has quit IRC | 20:33 | |
| *** hichtakk has joined #openstack-infra | 20:33 | |
| fungi | nikhil_k: keep mriedem apprised of this, since he's driven the current release spree there | 20:33 |
| *** hichtakk has quit IRC | 20:33 | |
| *** otter768 has joined #openstack-infra | 20:34 | |
| *** hichtakk has joined #openstack-infra | 20:34 | |
| *** hichtakk has quit IRC | 20:34 | |
| *** ociuhandu has joined #openstack-infra | 20:34 | |
| *** hichtakk has joined #openstack-infra | 20:34 | |
| *** MaxV has quit IRC | 20:34 | |
| *** rkukura has joined #openstack-infra | 20:35 | |
| *** hichtakk has quit IRC | 20:35 | |
| *** mikedillion has quit IRC | 20:36 | |
| *** hichtakk has joined #openstack-infra | 20:36 | |
| *** salv-orlando has quit IRC | 20:36 | |
| clarkb | mriedem ^ | 20:36 |
| *** hichtakk has quit IRC | 20:36 | |
| *** hichtakk has joined #openstack-infra | 20:36 | |
| *** hichtakk has quit IRC | 20:36 | |
| openstackgerrit | nikhil komawar proposed openstack/requirements: Pin down sqlalchemy-migrate versions https://review.openstack.org/146975 | 20:37 |
| fungi | clarkb: DIB image 118082 with file devstack-trusty-dib is built | 20:37 |
| *** hichtakk has joined #openstack-infra | 20:37 | |
| fungi | clarkb: so that seems to have been the issue | 20:37 |
| *** hichtakk has quit IRC | 20:37 | |
| fungi | i'll do the other two the same way while i'm in here, and then upload them | 20:37 |
| *** hichtakk has joined #openstack-infra | 20:37 | |
| openstackgerrit | Adam Gandelman proposed openstack-infra/elastic-recheck: Add query for bug 1410411 https://review.openstack.org/146947 | 20:38 |
| *** hichtakk has quit IRC | 20:38 | |
| uvirtbot | Launchpad bug 1410411 in neutron "unit tests are leaking sudo commands" [Undecided,New] https://launchpad.net/bugs/1410411 | 20:38 |
| nikhil_k | mriedem: https://review.openstack.org/146975 | 20:38 |
| *** hichtakk has joined #openstack-infra | 20:38 | |
| *** hichtakk has quit IRC | 20:38 | |
| clarkb | fungi kk | 20:38 |
| *** sputnik13 has quit IRC | 20:38 | |
| *** hichtakk has joined #openstack-infra | 20:39 | |
| clarkb | we ahould document somewhere the necessityfor -H and -u nodepool | 20:39 |
| *** hichtakk has quit IRC | 20:39 | |
| *** otter768 has quit IRC | 20:39 | |
| *** hichtakk has joined #openstack-infra | 20:39 | |
| clarkb | I am almost home. will work on the cache path thing | 20:39 |
| fungi | should the nodepool cli take care of that? | 20:39 |
| openstackgerrit | nikhil komawar proposed openstack/requirements: Pin down sqlalchemy-migrate versions https://review.openstack.org/146975 | 20:39 |
| *** banix has joined #openstack-infra | 20:39 | |
| clarkb | fungi hrm maybe | 20:39 |
| *** hichtakk has quit IRC | 20:39 | |
| *** hichtakk has joined #openstack-infra | 20:40 | |
| clarkb | it could reexec itself properly if not correct | 20:40 |
| fungi | otherwise i can see us just breaking this regularly | 20:40 |
| clarkb | ya | 20:41 |
| *** hichtakk has quit IRC | 20:41 | |
| *** hichtakk has joined #openstack-infra | 20:41 | |
| *** hichtakk has quit IRC | 20:41 | |
| *** hichtakk has joined #openstack-infra | 20:42 | |
| *** hichtakk has quit IRC | 20:42 | |
| *** doude has joined #openstack-infra | 20:42 | |
| *** hichtakk has joined #openstack-infra | 20:42 | |
| mtreinish | clarkb, fungi: if you get a sec this should be fairly quick: https://review.openstack.org/#/c/143142/1 | 20:42 |
| *** hichtakk has quit IRC | 20:42 | |
| *** boris-42 has quit IRC | 20:43 | |
| *** hichtakk has joined #openstack-infra | 20:43 | |
| openstackgerrit | Adam Gandelman proposed openstack-infra/elastic-recheck: Add query for bug 1410411 https://review.openstack.org/146947 | 20:43 |
| *** hichtakk has quit IRC | 20:43 | |
| uvirtbot | Launchpad bug 1410411 in neutron "unit tests are leaking sudo commands" [Undecided,New] https://launchpad.net/bugs/1410411 | 20:43 |
| *** hichtakk has joined #openstack-infra | 20:43 | |
| *** hichtakk has quit IRC | 20:43 | |
| *** melwitt has quit IRC | 20:43 | |
| *** hichtakk has joined #openstack-infra | 20:44 | |
| *** melwitt has joined #openstack-infra | 20:44 | |
| *** hichtakk has quit IRC | 20:45 | |
| *** hichtakk has joined #openstack-infra | 20:45 | |
| *** hichtakk has quit IRC | 20:46 | |
| *** hichtakk has joined #openstack-infra | 20:46 | |
| *** hichtakk has quit IRC | 20:46 | |
| *** hichtakk has joined #openstack-infra | 20:46 | |
| *** hichtakk has quit IRC | 20:47 | |
| *** hichtakk has joined #openstack-infra | 20:47 | |
| *** hichtakk has quit IRC | 20:47 | |
| *** hichtakk has joined #openstack-infra | 20:47 | |
| openstackgerrit | nikhil komawar proposed openstack/requirements: Pin down sqlalchemy-migrate versions https://review.openstack.org/146975 | 20:47 |
| *** hichtakk has quit IRC | 20:48 | |
| *** shashankhegde has quit IRC | 20:48 | |
| *** hichtakk has joined #openstack-infra | 20:48 | |
| *** hichtakk has quit IRC | 20:48 | |
| *** hichtakk has joined #openstack-infra | 20:49 | |
| *** hichtakk has quit IRC | 20:49 | |
| *** hichtakk has joined #openstack-infra | 20:49 | |
| clarkb | ok I should be back now | 20:49 |
| *** hichtakk has quit IRC | 20:49 | |
| *** hichtakk has joined #openstack-infra | 20:50 | |
| openstackgerrit | ayoung proposed openstack-infra/project-config: Graduate oslo.policy https://review.openstack.org/146645 | 20:50 |
| *** zz_sabari is now known as sabari | 20:50 | |
| openstackgerrit | Matt Riedemann proposed openstack/requirements: Pin down sqlalchemy-migrate versions https://review.openstack.org/146975 | 20:50 |
| *** hichtakk has quit IRC | 20:51 | |
| *** kmartin has quit IRC | 20:51 | |
| *** hichtakk has joined #openstack-infra | 20:51 | |
| *** TravT_ has joined #openstack-infra | 20:51 | |
| *** hichtakk has quit IRC | 20:51 | |
| *** hichtakk has joined #openstack-infra | 20:52 | |
| ianw | clarkb: might it be better to specify different DIB_IMAGE_CACHE dirs per image? | 20:52 |
| *** hichtakk has quit IRC | 20:52 | |
| dims__ | mriedem: 2 step forward, 1 step back - sigh | 20:52 |
| fungi | ianw: we're past that. there's no cache contention | 20:52 |
| *** hichtakk has joined #openstack-infra | 20:52 | |
| clarkb | ianw: no that won't fix this problem | 20:52 |
| fungi | DIB image 118083 with file devstack-precise-dib is built | 20:52 |
| *** hichtakk has quit IRC | 20:52 | |
| mriedem | dims__: yeah, no joke | 20:52 |
| clarkb | the issue is you must run nodepool image-build with the proper homdir and user set otherwise ou break the cache | 20:53 |
| *** hichtakk has joined #openstack-infra | 20:53 | |
| clarkb | so my manual intervention and testing was making the cache degrade | 20:53 |
| *** hichtakk has quit IRC | 20:53 | |
| *** TravT has quit IRC | 20:53 | |
| *** hichtakk has joined #openstack-infra | 20:53 | |
| ianw | ah | 20:53 |
| ianw | makes sense | 20:53 |
| *** hichtakk has quit IRC | 20:53 | |
| sdague | clarkb: is there a reason we don't have a pycrypto wheel in our mirror? | 20:54 |
| *** amitgandhinz has quit IRC | 20:54 | |
| *** hichtakk has joined #openstack-infra | 20:54 | |
| fungi | sdague: is there one on pypi.python.org? | 20:54 |
| *** hichtakk has quit IRC | 20:54 | |
| fungi | sdague: signs point to no https://pypi.python.org/simple/pycrypto/ | 20:54 |
| *** hichtakk has joined #openstack-infra | 20:54 | |
| *** hichtakk has quit IRC | 20:54 | |
| *** hichtakk has joined #openstack-infra | 20:55 | |
| *** hichtakk has quit IRC | 20:55 | |
| *** hichtakk has joined #openstack-infra | 20:55 | |
| *** hichtakk has quit IRC | 20:56 | |
| *** TravT_ has quit IRC | 20:56 | |
| *** hichtakk has joined #openstack-infra | 20:56 | |
| *** hichtakk has quit IRC | 20:56 | |
| *** TravT has joined #openstack-infra | 20:56 | |
| *** hichtakk has joined #openstack-infra | 20:56 | |
| *** hichtakk has quit IRC | 20:57 | |
| *** hichtakk has joined #openstack-infra | 20:57 | |
| *** salv-orlando has joined #openstack-infra | 20:57 | |
| *** hichtakk has quit IRC | 20:57 | |
| *** hichtakk has joined #openstack-infra | 20:57 | |
| *** hichtakk has quit IRC | 20:58 | |
| *** hichtakk has joined #openstack-infra | 20:58 | |
| *** hichtakk has quit IRC | 20:58 | |
| *** isviridov is now known as isviridov_away | 20:58 | |
| *** hichtakk has joined #openstack-infra | 20:59 | |
| *** hichtakk has quit IRC | 20:59 | |
| *** hichtakk has joined #openstack-infra | 20:59 | |
| *** hichtakk has quit IRC | 20:59 | |
| *** hichtakk has joined #openstack-infra | 21:00 | |
| clarkb | fungi: I am testing a fix for the ~/.cache path thing | 21:00 |
| *** hichtakk has quit IRC | 21:00 | |
| *** sabeen2 has joined #openstack-infra | 21:00 | |
| *** hichtakk has joined #openstack-infra | 21:00 | |
| mtreinish | lifeless: https://github.com/testing-cabal/testrepository/pull/4 from yesterday | 21:00 |
| *** hichtakk has quit IRC | 21:00 | |
| clarkb | apparently our nodepool graph is sad because hpcloud is basically all failures? | 21:01 |
| *** banix has quit IRC | 21:01 | |
| *** hichtakk has joined #openstack-infra | 21:01 | |
| fungi | SergeyLukjanov: where in https://etherpad.openstack.org/p/puppet-module-split-sprint should we be adding our names to sign up? | 21:01 |
| *** Rockyg has quit IRC | 21:01 | |
| mriedem | some reqs cores around that can get this in? https://review.openstack.org/#/c/146975/ | 21:01 |
| *** banix has joined #openstack-infra | 21:02 | |
| lifeless | mtreinish: reviewed :) | 21:02 |
| *** hichtakk has quit IRC | 21:02 | |
| *** sabeen1 has quit IRC | 21:02 | |
| clarkb | mriedem: is 0.9.5 a thing yet? | 21:02 |
| *** hichtakk has joined #openstack-infra | 21:02 | |
| mriedem | clarkb: we don't have a fix in migrate right now | 21:02 |
| fungi | clarkb: no, the only sqlam version which matches that string is 0.9.1 | 21:02 |
| *** hichtakk has quit IRC | 21:02 | |
| fungi | it's presently functionally equivalent to a ==0.9.1 | 21:03 |
| *** hichtakk has joined #openstack-infra | 21:03 | |
| mriedem | yeah the thing that busted nova unit tests in 0.9.2 was fixed in 0.9.4 but something else is busted now in glance unit tests | 21:03 |
| *** hichtakk has quit IRC | 21:03 | |
| clarkb | fungi: looking at nodepool list hpcloud appears to be basically dead to us | 21:03 |
| *** achanda has quit IRC | 21:03 | |
| fungi | clarkb: joyous | 21:03 |
| *** dprince has quit IRC | 21:03 | |
| *** hichtakk has joined #openstack-infra | 21:03 | |
| *** markmcclain has quit IRC | 21:03 | |
| fungi | clarkb: just spinning in build/delete cycles then? | 21:04 |
| *** hichtakk has quit IRC | 21:04 | |
| clarkb | fungi: ya and they don't seem to be timing out quickly either | 21:04 |
| clarkb | there are builds going for > 4 hours | 21:04 |
| *** hichtakk has joined #openstack-infra | 21:04 | |
| clarkb | so nodepool things it is addressing demand | 21:04 |
| *** hichtakk has quit IRC | 21:04 | |
| clarkb | no incident reported on hpcloud status page for east | 21:04 |
| *** hichtakk has joined #openstack-infra | 21:04 | |
| fungi | on a related note, i'm still trying to get jenkins01 to quiesce so i can clean up and restart it | 21:04 |
| *** hichtakk has quit IRC | 21:05 | |
| clarkb | kk | 21:05 |
| *** hichtakk has joined #openstack-infra | 21:05 | |
| clarkb | I think we may just have to ride out whatever is wrong in hpcloud but I will try to dig for more info so that we can potentially push that upstream | 21:05 |
| fungi | oh, looks like one of my various attempts must have actually worked but didn't return a reqult page | 21:05 |
| clarkb | tteggel: ^ | 21:05 |
| fungi | and a while ago because there are no jobs running on jenkins01 any longer | 21:05 |
| fungi | taking care of it now | 21:05 |
| *** hichtakk_ has joined #openstack-infra | 21:06 | |
| *** hichtakk has quit IRC | 21:06 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 21:06 | |
| *** david-ly_ has joined #openstack-infra | 21:07 | |
| *** hichtakk_ has quit IRC | 21:07 | |
| *** hichtakk has joined #openstack-infra | 21:07 | |
| *** hichtakk has quit IRC | 21:07 | |
| mrmartin | SergeyLukjanov: are you here? | 21:07 |
| *** hichtakk has joined #openstack-infra | 21:07 | |
| *** hichtakk has quit IRC | 21:08 | |
| clarkb | 'OperationalError: (OperationalError) (2006, 'MySQL server has gone away') None None' is a fune one | 21:08 |
| clarkb | happened when trying to delete a node | 21:08 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 21:08 | |
| clarkb | but mysql is still running | 21:08 |
| *** hichtakk has joined #openstack-infra | 21:08 | |
| *** achanda has joined #openstack-infra | 21:08 | |
| *** david-lyle has quit IRC | 21:09 | |
| *** hichtakk has quit IRC | 21:09 | |
| *** hichtakk has joined #openstack-infra | 21:09 | |
| clarkb | I wonder if the delete took so long that mysql closed the connection | 21:09 |
| *** hichtakk has quit IRC | 21:10 | |
| *** hichtakk has joined #openstack-infra | 21:10 | |
| sdague | fungi: ok, I was trying to get to the bottom of why the integration job takes almost 2 hrs now | 21:11 |
| *** hichtakk has quit IRC | 21:11 | |
| sdague | we are spending ~30minutes installing lxml from source, 30 times | 21:11 |
| *** hichtakk has joined #openstack-infra | 21:11 | |
| *** achanda has quit IRC | 21:12 | |
| *** david-ly_ has quit IRC | 21:12 | |
| *** hichtakk has quit IRC | 21:12 | |
| fungi | i thought the wheelhouse change was supposed to make sure we did that only once and then cached and reused the resulting wheel? | 21:12 |
| clarkb | ya that should've been fixed | 21:12 |
| *** hichtakk has joined #openstack-infra | 21:12 | |
| *** gyee has joined #openstack-infra | 21:12 | |
| *** hichtakk has quit IRC | 21:12 | |
| fungi | maybe it's not working for certain packages | 21:12 |
| clarkb | or maybe pip is insisting on installing from source for some other reason | 21:12 |
| SergeyLukjanov | mrmartin, 50/50 | 21:12 |
| *** hichtakk has joined #openstack-infra | 21:12 | |
| clarkb | fungi: so looking at nodepool nodes in a building state against hpcloud that have uuids shows them as ACTIVE in hpcloud | 21:13 |
| *** elyezer has left #openstack-infra | 21:13 | |
| SergeyLukjanov | fungi, adding section for interested people | 21:13 |
| clarkb | fungi: but for some reason they are 'building' for 4 hours in nodepool | 21:13 |
| mrmartin | SergeyLukjanov: ok, I just checked this puppet split spec, I'll add the groups puppet it is missing from the repos | 21:13 |
| fungi | SergeyLukjanov: i went ahead and added a section | 21:13 |
| SergeyLukjanov | fungi, thx! | 21:13 |
| clarkb | fungi: I am going to try manually deleting some of these to see if it frees up quota that we can use | 21:13 |
| *** hichtakk has quit IRC | 21:14 | |
| SergeyLukjanov | mrmartin, please, add note to the etherpad | 21:14 |
| *** hichtakk has joined #openstack-infra | 21:14 | |
| *** hichtakk has quit IRC | 21:14 | |
| fungi | clarkb: when i've seen this in the past, something was causing the nova boot call to never result in a running instance with a uuid, so nodepool waited the 8 hours and then switched them to delete | 21:14 |
| *** e0ne has joined #openstack-infra | 21:14 | |
| *** hichtakk has joined #openstack-infra | 21:14 | |
| *** hichtakk has quit IRC | 21:15 | |
| *** hichtakk has joined #openstack-infra | 21:15 | |
| clarkb | fungi: it looks like that in some cases and in other cases we get uuids | 21:15 |
| *** hichtakk has quit IRC | 21:15 | |
| clarkb | fungi: but there are definitely a bunch without uuids too | 21:15 |
| clarkb | so potentially related | 21:15 |
| *** hichtakk has joined #openstack-infra | 21:16 | |
| clarkb | in any case deletions of 'delete' state nodes is happening now. will do building state after (they will need a more critical eye so I don't delete those that could become ready in the interim) | 21:16 |
| sdague | clarkb: the lines for lxml are odd enough, I can imagine something else is going on | 21:16 |
| sdague | http://logs.openstack.org/73/146673/2/check/check-requirements-integration-dsvm/8c15100/console.html#_2015-01-13_02_30_56_044 | 21:16 |
| clarkb | sdague: do you have a recent log to look at ? | 21:16 |
| clarkb | way ahead of me | 21:16 |
| *** hichtakk has quit IRC | 21:17 | |
| *** hichtakk_ has joined #openstack-infra | 21:17 | |
| *** bhunter71 has quit IRC | 21:17 | |
| *** hichtakk_ has quit IRC | 21:17 | |
| *** hichtakk has joined #openstack-infra | 21:18 | |
| *** hichtakk has quit IRC | 21:18 | |
| sdague | so the 1 minute delay is always at the beginning | 21:18 |
| sdague | like that | 21:18 |
| fungi | clarkb: i'm also cleaning up all the jenkins01 nodes which predated my restarting and clearing out its slaves list | 21:18 |
| *** hichtakk has joined #openstack-infra | 21:18 | |
| clarkb | sdague: http://logs.openstack.org/73/146673/2/check/check-requirements-integration-dsvm/8c15100/console.html#_2015-01-13_01_04_46_085 that is where we start to make the wheelhouse | 21:18 |
| fungi | that was something like 91 nodes | 21:18 |
| fungi | there may be some overlap between our deletions too | 21:18 |
| *** hichtakk has quit IRC | 21:19 | |
| clarkb | fungi: that should be fine, my deletes will fail and move on | 21:19 |
| fungi | mine too | 21:19 |
| clarkb | sdague: so it appears that pip isn't using the wheelhouse | 21:19 |
| *** hichtakk has joined #openstack-infra | 21:19 | |
| *** hichtakk has quit IRC | 21:19 | |
| *** mrunge has quit IRC | 21:19 | |
| zaro | fungi: about the review-dev rebuild.. aren't the repos in the gerrit db? | 21:19 |
| *** hichtakk has joined #openstack-infra | 21:20 | |
| *** kmartin has joined #openstack-infra | 21:20 | |
| *** hichtakk has quit IRC | 21:20 | |
| fungi | zaro: gerrit keeps them on disk, not in the db | 21:20 |
| *** hichtakk has joined #openstack-infra | 21:20 | |
| fungi | zaro: ~gerrit2/review_site/git | 21:20 |
| sdague | clarkb: interesting | 21:21 |
| zaro | fungi: ohh yeah, but the review_site is backed up right? | 21:21 |
| fungi | zaro: in particular, the All-Projects.git subtree will be necessary to bring over since it has the global acl/configuration in it | 21:21 |
| *** dkliban is now known as dkliban_afk | 21:21 | |
| *** hichtakk has quit IRC | 21:21 | |
| openstackgerrit | Sean Dague proposed openstack/requirements: update tools/integration.sh to latest version from pbr https://review.openstack.org/146980 | 21:21 |
| fungi | zaro: it's backed up, yes. just saying that if i replace the server then we need to copy those files into it | 21:21 |
| *** hichtakk has joined #openstack-infra | 21:22 | |
| fungi | zaro: either by restoring from bup or just tarring and copying via scp or something | 21:22 |
| openstackgerrit | Merged openstack-infra/storyboard: Text fields validation with json schema https://review.openstack.org/143988 | 21:22 |
| clarkb | dstufft: http://logs.openstack.org/73/146673/2/check/check-requirements-integration-dsvm/8c15100/console.html#_2015-01-13_01_04_46_087 we set a PIP_WHEEL_DIR and PIP_FIND_LINKS pair of vars there is that sufficient to make pip use the wheelhouse? | 21:23 |
| *** hichtakk has quit IRC | 21:23 | |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config: move testing from pbr to requirements repo https://review.openstack.org/146981 | 21:23 |
| clarkb | sdague: maybe the env isn't making it to later pip runs? | 21:23 |
| *** hichtakk has joined #openstack-infra | 21:23 | |
| sdague | clarkb: maybe? | 21:23 |
| *** hichtakk has quit IRC | 21:23 | |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config: move testing from pbr to requirements repo https://review.openstack.org/146981 | 21:23 |
| *** hichtakk has joined #openstack-infra | 21:24 | |
| *** hichtakk has quit IRC | 21:24 | |
| *** hichtakk has joined #openstack-infra | 21:24 | |
| clarkb | sdague: damnit I know | 21:24 |
| *** Sukhdev has quit IRC | 21:24 | |
| *** hichtakk has quit IRC | 21:24 | |
| openstackgerrit | Sean Dague proposed openstack-dev/pbr: remove integration test, it now lives in requirements https://review.openstack.org/146982 | 21:24 |
| clarkb | sdague: http://logs.openstack.org/73/146673/2/check/check-requirements-integration-dsvm/8c15100/console.html#_2015-01-13_01_05_45_163 because the egg_info fails there the whole thing dies early | 21:25 |
| clarkb | sdague: dhellman has a fix let me dig it up | 21:25 |
| *** hichtakk has joined #openstack-infra | 21:25 | |
| *** hichtakk has quit IRC | 21:25 | |
| clarkb | sdague: https://review.openstack.org/#/c/146650/1/tools/integration.sh that should've made it better | 21:25 |
| *** dims__ has quit IRC | 21:25 | |
| *** hichtakk has joined #openstack-infra | 21:25 | |
| openstackgerrit | Kyle Rockman proposed openstack-infra/jenkins-job-builder: adding support for the xcode builder plugin https://review.openstack.org/146918 | 21:25 |
| *** hichtakk has quit IRC | 21:25 | |
| sdague | clarkb: hmmm... don't know | 21:26 |
| *** dims__ has joined #openstack-infra | 21:26 | |
| *** hichtakk has joined #openstack-infra | 21:26 | |
| *** hichtakk has quit IRC | 21:26 | |
| sdague | also, can we get that out of pbr :) | 21:26 |
| clarkb | but based on http://logs.openstack.org/73/146673/2/check/check-requirements-integration-dsvm/8c15100/console.html#_2015-01-13_01_04_48_703 dhellmans change wasn't used | 21:26 |
| *** ronis has joined #openstack-infra | 21:26 | |
| clarkb | sdague: the test? | 21:26 |
| clarkb | I don't care where it lives | 21:26 |
| sdague | see patch pushes above | 21:26 |
| *** hichtakk has joined #openstack-infra | 21:26 | |
| *** hichtakk has quit IRC | 21:27 | |
| *** hichtakk has joined #openstack-infra | 21:27 | |
| clarkb | sdague: you will need to put these changes in requirements repo too | 21:27 |
| *** hichtakk has quit IRC | 21:27 | |
| sdague | clarkb: yes, I just synced it | 21:27 |
| sdague | <openstackgerrit> Sean Dague proposed openstack/requirements: update tools/integration.sh to latest version from pbr https://review.openstack.org/146980 | 21:27 |
| *** hichtakk has joined #openstack-infra | 21:27 | |
| *** hichtakk has quit IRC | 21:28 | |
| *** dims__ has quit IRC | 21:28 | |
| ronis | guys | 21:28 |
| *** dims__ has joined #openstack-infra | 21:28 | |
| ronis | How can i attach regular iSCSI storage which one does not have any cinder plugins ? | 21:28 |
| *** hichtakk has joined #openstack-infra | 21:28 | |
| *** hichtakk has quit IRC | 21:28 | |
| *** hichtakk has joined #openstack-infra | 21:29 | |
| sdague | clarkb: oh, yeh, we're doing pbr from libs | 21:29 |
| *** hichtakk has quit IRC | 21:29 | |
| sdague | hmmm | 21:29 |
| fungi | ronis: what brings you to the #openstack-infra channel? this is where we run the project community services | 21:29 |
| *** hichtakk has joined #openstack-infra | 21:29 | |
| sdague | yeh, I have no idea if the on disk pbr repo got updated or not | 21:29 |
| *** samueldmq has joined #openstack-infra | 21:29 | |
| fungi | ronis: sounds like you might have a question about running/using openstack itself, so might want to ask in #openstack or #openstack-101 | 21:30 |
| ronis | fungi, thank you | 21:30 |
| clarkb | sdague: I think it is but its cached | 21:30 |
| clarkb | sdague: so we need new images | 21:30 |
| clarkb | or something silly like that? | 21:30 |
| fungi | ronis: or ask on https://ask.openstack.org/ | 21:30 |
| clarkb | anyways moving to requirements then cleaning that up is +2 from me | 21:30 |
| clarkb | hrm no the job runs devstack-gate so not a cache issue | 21:30 |
| *** hichtakk_ has joined #openstack-infra | 21:30 | |
| *** hichtakk has quit IRC | 21:30 | |
| *** markmcclain has joined #openstack-infra | 21:31 | |
| *** hichtakk_ has quit IRC | 21:31 | |
| ekarlso- | clarkb: / fungi can u + on https://review.openstack.org/#/c/145561/ ? | 21:31 |
| *** bhunter71 has joined #openstack-infra | 21:31 | |
| sdague | yeh, I don't know, but I also know all the bits in devstack that check the git hash and print it out don't run for pbr here, because it's not touching that repo | 21:31 |
| *** hichtakk has joined #openstack-infra | 21:31 | |
| jogo | wow the number of nodes in building has spiked | 21:31 |
| sdague | so it's probably easier to debug in requirements | 21:31 |
| *** hichtakk has quit IRC | 21:31 | |
| dstufft | clarkb: should be yea | 21:31 |
| *** markmcclain has quit IRC | 21:31 | |
| clarkb | sdague: http://logs.openstack.org/73/146673/2/check/check-requirements-integration-dsvm/8c15100/logs/devstack-gate-setup-workspace-new.txt.gz#_2015-01-13_00_56_14_915 is where pbr was pulled in | 21:32 |
| *** bcourt has quit IRC | 21:32 | |
| *** hichtakk has joined #openstack-infra | 21:32 | |
| *** hichtakk has quit IRC | 21:32 | |
| *** thingee has quit IRC | 21:32 | |
| *** patrickeast has quit IRC | 21:32 | |
| *** jcoufal has quit IRC | 21:32 | |
| *** kashyap has quit IRC | 21:32 | |
| *** camunoz has quit IRC | 21:32 | |
| *** harlowja has quit IRC | 21:32 | |
| *** sandywalsh has quit IRC | 21:32 | |
| *** vponomaryov has quit IRC | 21:32 | |
| *** mase_home has quit IRC | 21:32 | |
| *** SotK has quit IRC | 21:32 | |
| *** mfisch has quit IRC | 21:32 | |
| *** Mmike has quit IRC | 21:32 | |
| *** fabo has quit IRC | 21:32 | |
| *** mwhudson has quit IRC | 21:32 | |
| *** tteggel has quit IRC | 21:32 | |
| *** alaski has quit IRC | 21:32 | |
| *** rodrigods has quit IRC | 21:32 | |
| *** lifeless has quit IRC | 21:32 | |
| *** uvirtbot has quit IRC | 21:32 | |
| *** annegentle_ has quit IRC | 21:32 | |
| *** kmartin has quit IRC | 21:32 | |
| *** e0ne has quit IRC | 21:32 | |
| *** gyee has quit IRC | 21:32 | |
| *** doude has quit IRC | 21:32 | |
| *** ivar-lazzaro has quit IRC | 21:32 | |
| *** romcheg has quit IRC | 21:32 | |
| *** ZZelle_ has quit IRC | 21:32 | |
| *** mrmartin has quit IRC | 21:32 | |
| *** pcrews has quit IRC | 21:32 | |
| *** alazarev has quit IRC | 21:32 | |
| *** SergeyLukjanov has quit IRC | 21:32 | |
| *** _buzz has quit IRC | 21:32 | |
| *** morgabra has quit IRC | 21:32 | |
| *** dkehn has quit IRC | 21:32 | |
| *** zxiiro has quit IRC | 21:32 | |
| *** paul-- has quit IRC | 21:32 | |
| *** jhesketh has quit IRC | 21:32 | |
| *** dims__ has quit IRC | 21:32 | |
| *** salv-orlando has quit IRC | 21:32 | |
| *** dannywilson has quit IRC | 21:32 | |
| *** hdd has quit IRC | 21:32 | |
| *** yamahata has quit IRC | 21:32 | |
| *** ronis has quit IRC | 21:32 | |
| *** erikmwilson has quit IRC | 21:32 | |
| *** arielb has quit IRC | 21:32 | |
| *** kgiusti has quit IRC | 21:32 | |
| *** mbacchi has quit IRC | 21:32 | |
| *** HeOS has quit IRC | 21:32 | |
| *** funzo_ has quit IRC | 21:32 | |
| *** slagle has quit IRC | 21:32 | |
| *** yolanda has quit IRC | 21:32 | |
| *** sdake has quit IRC | 21:32 | |
| *** TheJulia has quit IRC | 21:32 | |
| *** smoser has quit IRC | 21:32 | |
| *** Kiall has quit IRC | 21:32 | |
| *** NobodyCam has quit IRC | 21:32 | |
| *** kragniz has quit IRC | 21:32 | |
| *** markvan has quit IRC | 21:32 | |
| *** tcammann has quit IRC | 21:32 | |
| *** davidlenwell has quit IRC | 21:32 | |
| *** SlickNik has quit IRC | 21:32 | |
| *** pleia2 has quit IRC | 21:32 | |
| *** HeOS_ has quit IRC | 21:32 | |
| *** mtreinish has quit IRC | 21:32 | |
| *** vladan has quit IRC | 21:32 | |
| *** bogdando has quit IRC | 21:32 | |
| *** maurosr has quit IRC | 21:32 | |
| *** BobBall has quit IRC | 21:32 | |
| *** dteselkin has quit IRC | 21:32 | |
| *** ruhe has quit IRC | 21:32 | |
| *** Apsu has quit IRC | 21:32 | |
| *** amrith has quit IRC | 21:32 | |
| *** eikke has quit IRC | 21:32 | |
| *** SpamapS has quit IRC | 21:32 | |
| *** EntropyWorks has quit IRC | 21:32 | |
| sdague | clarkb: https://review.openstack.org/#/q/status:open+branch:master+topic:req_integration,n,z is the set of 3 changes to flip | 21:32 |
| clarkb | sdague: which is my change and not dhellmans | 21:32 |
| fungi | jogo: we seem to not be successfully building nodes in hpcloud. they just pile up in building state with no uuid | 21:32 |
| *** markmcclain has joined #openstack-infra | 21:32 | |
| sdague | is it just a timing issue? | 21:32 |
| sdague | yeh, it might not have merged for that job | 21:32 |
| clarkb | sdague: ya it may e | 21:33 |
| jogo | fungi: ahh, that sounds bad | 21:33 |
| clarkb | sdague: if it happens again then likely we need to debug further, but if not then timing | 21:33 |
| * sdague looks for something more current | 21:33 | |
| fungi | jogo: yeah, we issue a nova boot and hours go by with no uuid for the instance | 21:33 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for bug 1410411 https://review.openstack.org/146947 | 21:33 |
| *** ddieterly has quit IRC | 21:33 | |
| *** ChuckC has quit IRC | 21:33 | |
| *** xyang0 has quit IRC | 21:33 | |
| *** mfink has quit IRC | 21:33 | |
| *** weshay has quit IRC | 21:33 | |
| *** afazekas has quit IRC | 21:33 | |
| *** bknudson has quit IRC | 21:33 | |
| *** pfallenop has quit IRC | 21:33 | |
| *** bodepd has quit IRC | 21:33 | |
| *** bhuvan has quit IRC | 21:33 | |
| *** wenlock has quit IRC | 21:33 | |
| *** mriedem has quit IRC | 21:33 | |
| *** sdague has quit IRC | 21:33 | |
| *** briancline has quit IRC | 21:33 | |
| *** hogepodge has quit IRC | 21:33 | |
| clarkb | woo freenode maintenance | 21:34 |
| fungi | indeed | 21:34 |
| *** banix has quit IRC | 21:34 | |
| jogo | fungi: hmm I woner if that is a nova bug or something bad in production | 21:34 |
| *** fandi has quit IRC | 21:34 | |
| *** eikke has joined #openstack-infra | 21:34 | |
| *** maurosr has joined #openstack-infra | 21:34 | |
| *** BobBall has joined #openstack-infra | 21:34 | |
| *** dteselkin has joined #openstack-infra | 21:34 | |
| *** ruhe has joined #openstack-infra | 21:34 | |
| *** Apsu has joined #openstack-infra | 21:34 | |
| *** EntropyWorks has joined #openstack-infra | 21:34 | |
| *** SpamapS has joined #openstack-infra | 21:34 | |
| *** jhesketh has joined #openstack-infra | 21:34 | |
| *** annegentle_ has joined #openstack-infra | 21:34 | |
| *** uvirtbot has joined #openstack-infra | 21:34 | |
| *** lifeless has joined #openstack-infra | 21:34 | |
| *** rodrigods has joined #openstack-infra | 21:34 | |
| *** bogdando has joined #openstack-infra | 21:34 | |
| *** alaski has joined #openstack-infra | 21:34 | |
| *** vladan has joined #openstack-infra | 21:34 | |
| *** mtreinish has joined #openstack-infra | 21:34 | |
| *** HeOS_ has joined #openstack-infra | 21:34 | |
| *** pleia2 has joined #openstack-infra | 21:34 | |
| *** SlickNik has joined #openstack-infra | 21:34 | |
| *** tteggel has joined #openstack-infra | 21:34 | |
| *** davidlenwell has joined #openstack-infra | 21:34 | |
| *** tcammann has joined #openstack-infra | 21:34 | |
| *** markvan has joined #openstack-infra | 21:34 | |
| *** kragniz has joined #openstack-infra | 21:34 | |
| *** fabo has joined #openstack-infra | 21:34 | |
| *** mwhudson has joined #openstack-infra | 21:34 | |
| *** NobodyCam has joined #openstack-infra | 21:34 | |
| *** Mmike has joined #openstack-infra | 21:34 | |
| *** mfisch has joined #openstack-infra | 21:34 | |
| *** Kiall has joined #openstack-infra | 21:34 | |
| *** smoser has joined #openstack-infra | 21:34 | |
| *** zxiiro has joined #openstack-infra | 21:34 | |
| *** TheJulia has joined #openstack-infra | 21:34 | |
| *** amrith has joined #openstack-infra | 21:34 | |
| *** sdake has joined #openstack-infra | 21:34 | |
| *** SotK has joined #openstack-infra | 21:34 | |
| *** mase_home has joined #openstack-infra | 21:34 | |
| *** paul-- has joined #openstack-infra | 21:34 | |
| *** yolanda has joined #openstack-infra | 21:34 | |
| *** vponomaryov has joined #openstack-infra | 21:34 | |
| *** dkehn has joined #openstack-infra | 21:34 | |
| *** sandywalsh has joined #openstack-infra | 21:34 | |
| *** slagle has joined #openstack-infra | 21:34 | |
| *** harlowja has joined #openstack-infra | 21:34 | |
| *** morgabra has joined #openstack-infra | 21:34 | |
| *** camunoz has joined #openstack-infra | 21:34 | |
| *** _buzz has joined #openstack-infra | 21:34 | |
| *** kashyap has joined #openstack-infra | 21:34 | |
| *** funzo_ has joined #openstack-infra | 21:34 | |
| *** HeOS has joined #openstack-infra | 21:34 | |
| *** mbacchi has joined #openstack-infra | 21:34 | |
| *** kgiusti has joined #openstack-infra | 21:34 | |
| *** SergeyLukjanov has joined #openstack-infra | 21:34 | |
| *** alazarev has joined #openstack-infra | 21:34 | |
| *** arielb has joined #openstack-infra | 21:34 | |
| *** pcrews has joined #openstack-infra | 21:34 | |
| *** erikmwilson has joined #openstack-infra | 21:34 | |
| *** mrmartin has joined #openstack-infra | 21:34 | |
| *** jcoufal has joined #openstack-infra | 21:34 | |
| *** patrickeast has joined #openstack-infra | 21:34 | |
| *** ZZelle_ has joined #openstack-infra | 21:34 | |
| *** romcheg has joined #openstack-infra | 21:34 | |
| *** yamahata has joined #openstack-infra | 21:34 | |
| *** hdd has joined #openstack-infra | 21:34 | |
| *** thingee has joined #openstack-infra | 21:34 | |
| *** dannywilson has joined #openstack-infra | 21:34 | |
| *** ivar-lazzaro has joined #openstack-infra | 21:34 | |
| *** doude has joined #openstack-infra | 21:34 | |
| *** salv-orlando has joined #openstack-infra | 21:34 | |
| *** gyee has joined #openstack-infra | 21:34 | |
| *** e0ne has joined #openstack-infra | 21:34 | |
| *** kmartin has joined #openstack-infra | 21:34 | |
| *** ronis has joined #openstack-infra | 21:34 | |
| *** dims__ has joined #openstack-infra | 21:34 | |
| *** hichtakk has joined #openstack-infra | 21:34 | |
| *** ddieterly has joined #openstack-infra | 21:34 | |
| *** bhuvan has joined #openstack-infra | 21:34 | |
| *** ChuckC has joined #openstack-infra | 21:34 | |
| *** xyang0 has joined #openstack-infra | 21:34 | |
| *** wenlock has joined #openstack-infra | 21:34 | |
| *** mriedem has joined #openstack-infra | 21:34 | |
| *** mfink has joined #openstack-infra | 21:34 | |
| *** weshay has joined #openstack-infra | 21:34 | |
| *** afazekas has joined #openstack-infra | 21:34 | |
| *** bknudson has joined #openstack-infra | 21:34 | |
| *** pfallenop has joined #openstack-infra | 21:34 | |
| *** bodepd has joined #openstack-infra | 21:34 | |
| *** sdague has joined #openstack-infra | 21:34 | |
| *** briancline has joined #openstack-infra | 21:34 | |
| *** hogepodge has joined #openstack-infra | 21:34 | |
| *** hichtakk has quit IRC | 21:34 | |
| *** hichtakk has joined #openstack-infra | 21:34 | |
| *** hichtakk has quit IRC | 21:35 | |
| *** hichtakk has joined #openstack-infra | 21:35 | |
| *** hichtakk has quit IRC | 21:35 | |
| *** ameade has quit IRC | 21:35 | |
| fungi | jogo: if only you knew someone who worked there, you could ask ;) | 21:35 |
| *** hichtakk has joined #openstack-infra | 21:35 | |
| *** hichtakk has quit IRC | 21:35 | |
| clarkb | fungi: it actually looks like this may still be going on | 21:35 |
| *** HenryG has quit IRC | 21:35 | |
| *** MaxV has joined #openstack-infra | 21:35 | |
| *** hashar has joined #openstack-infra | 21:35 | |
| clarkb | fungi: it appears that as we delete more building nodes get spun up and they don't go ready | 21:35 |
| *** hichtakk has joined #openstack-infra | 21:35 | |
| fungi | yeah, i'm seeing the same | 21:36 |
| jogo | fungi: anyone in this channel work on public cloud | 21:36 |
| clarkb | will need a bit more time to confirm but it appears that building nodes is derp | 21:36 |
| *** hichtakk has quit IRC | 21:36 | |
| fungi | jogo: tteggel and gilliard | 21:36 |
| clarkb | fungi: I am going to try booting node by hand | 21:36 |
| *** hichtakk has joined #openstack-infra | 21:36 | |
| fungi | those are the only two i know of for sure | 21:36 |
| *** imcsk8 has quit IRC | 21:36 | |
| *** andreaf has quit IRC | 21:36 | |
| *** nelsnelson has quit IRC | 21:36 | |
| *** ayoung has quit IRC | 21:36 | |
| *** armax has quit IRC | 21:36 | |
| *** yjiang5 has quit IRC | 21:36 | |
| *** redixin has quit IRC | 21:36 | |
| *** nijaba has quit IRC | 21:36 | |
| *** Clint has quit IRC | 21:36 | |
| *** psedlak has quit IRC | 21:36 | |
| *** shardy has quit IRC | 21:36 | |
| *** dstanek has quit IRC | 21:36 | |
| *** hichtakk has quit IRC | 21:36 | |
| *** hichtakk has joined #openstack-infra | 21:37 | |
| *** fandi has joined #openstack-infra | 21:37 | |
| *** imcsk8 has joined #openstack-infra | 21:37 | |
| *** ayoung has joined #openstack-infra | 21:37 | |
| *** armax has joined #openstack-infra | 21:37 | |
| *** yjiang5 has joined #openstack-infra | 21:37 | |
| *** redixin has joined #openstack-infra | 21:37 | |
| *** nijaba has joined #openstack-infra | 21:37 | |
| *** Clint has joined #openstack-infra | 21:37 | |
| *** psedlak has joined #openstack-infra | 21:37 | |
| *** shardy has joined #openstack-infra | 21:37 | |
| *** dstanek has joined #openstack-infra | 21:37 | |
| *** jasonamyers has quit IRC | 21:37 | |
| clarkb | fungi: checkout `nova image-list | grep dib` on hpcloud | 21:37 |
| *** HenryG has joined #openstack-infra | 21:37 | |
| clarkb | fungi: the 5 * images really makes things nasty when they go sideways | 21:38 |
| clarkb | if only clouds would just work | 21:38 |
| *** bhunter71 has quit IRC | 21:38 | |
| *** emagana has quit IRC | 21:38 | |
| *** dustins has quit IRC | 21:38 | |
| *** julim has quit IRC | 21:38 | |
| *** mwagner_lap has quit IRC | 21:38 | |
| *** sabari has quit IRC | 21:38 | |
| *** samueldmq has quit IRC | 21:38 | |
| *** zul has quit IRC | 21:38 | |
| *** bnemec has quit IRC | 21:38 | |
| *** tsufiev has quit IRC | 21:38 | |
| *** phschwartz has quit IRC | 21:38 | |
| *** gaelL has quit IRC | 21:38 | |
| *** med_ has quit IRC | 21:38 | |
| *** krotscheck has quit IRC | 21:38 | |
| *** gema has quit IRC | 21:38 | |
| *** gpocentek has quit IRC | 21:38 | |
| *** redrobot has quit IRC | 21:38 | |
| *** Vivek has quit IRC | 21:38 | |
| *** igorbelikov has quit IRC | 21:38 | |
| *** therve has quit IRC | 21:38 | |
| *** ekarlso- has quit IRC | 21:38 | |
| *** cburgess has quit IRC | 21:38 | |
| *** DinaBelova has quit IRC | 21:38 | |
| *** jcooley has quit IRC | 21:38 | |
| *** leifmadsen has quit IRC | 21:38 | |
| *** timfreund has quit IRC | 21:38 | |
| *** jogo has quit IRC | 21:38 | |
| *** grantbow has quit IRC | 21:38 | |
| *** niedbalski has quit IRC | 21:38 | |
| *** patrickeast has quit IRC | 21:38 | |
| *** mrmartin has quit IRC | 21:38 | |
| *** hichtakk has quit IRC | 21:39 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for sqla-migrate/glance bug 1410494 https://review.openstack.org/146986 | 21:39 |
| uvirtbot | Launchpad bug 1410494 in glance "sqlalchemy-migrate>0.9.1 and <0.9.5 causes glance test failures" [Critical,In progress] https://launchpad.net/bugs/1410494 | 21:39 |
| *** patrickeast has joined #openstack-infra | 21:39 | |
| *** hichtakk has joined #openstack-infra | 21:39 | |
| *** flaper87 has quit IRC | 21:39 | |
| *** flaper87 has joined #openstack-infra | 21:39 | |
| fungi | yikes. 675 images | 21:40 |
| clarkb | fungi: :) but most are "SAVING" | 21:40 |
| *** ameade has joined #openstack-infra | 21:40 | |
| *** hichtakk has quit IRC | 21:40 | |
| fungi | wow | 21:40 |
| *** bhunter71 has joined #openstack-infra | 21:40 | |
| *** samueldmq has joined #openstack-infra | 21:40 | |
| *** emagana has joined #openstack-infra | 21:40 | |
| *** dustins has joined #openstack-infra | 21:40 | |
| *** julim has joined #openstack-infra | 21:40 | |
| *** mwagner_lap has joined #openstack-infra | 21:40 | |
| *** sabari has joined #openstack-infra | 21:40 | |
| *** zul has joined #openstack-infra | 21:40 | |
| *** bnemec has joined #openstack-infra | 21:40 | |
| *** tsufiev has joined #openstack-infra | 21:40 | |
| *** phschwartz has joined #openstack-infra | 21:40 | |
| *** gaelL has joined #openstack-infra | 21:40 | |
| *** med_ has joined #openstack-infra | 21:40 | |
| *** krotscheck has joined #openstack-infra | 21:40 | |
| *** gema has joined #openstack-infra | 21:40 | |
| *** gpocentek has joined #openstack-infra | 21:40 | |
| *** Vivek has joined #openstack-infra | 21:40 | |
| *** igorbelikov has joined #openstack-infra | 21:40 | |
| *** cburgess has joined #openstack-infra | 21:40 | |
| *** therve has joined #openstack-infra | 21:40 | |
| *** ekarlso- has joined #openstack-infra | 21:40 | |
| *** DinaBelova has joined #openstack-infra | 21:40 | |
| *** jcooley has joined #openstack-infra | 21:40 | |
| *** leifmadsen has joined #openstack-infra | 21:40 | |
| *** timfreund has joined #openstack-infra | 21:40 | |
| *** jogo has joined #openstack-infra | 21:40 | |
| *** grantbow has joined #openstack-infra | 21:40 | |
| *** niedbalski has joined #openstack-infra | 21:40 | |
| clarkb | fungi: I think they must fail to upload so nodepool goes meh don't need to delete that | 21:40 |
| *** hichtakk has joined #openstack-infra | 21:40 | |
| *** redrobot has joined #openstack-infra | 21:40 | |
| clarkb | fungi: when in reality the cloud isn't deleting it after a failure | 21:40 |
| sigmavirus24 | sdague: if you have a second https://review.openstack.org/#/c/146975/ | 21:40 |
| *** achanda has joined #openstack-infra | 21:41 | |
| *** hichtakk has quit IRC | 21:41 | |
| *** redrobot is now known as Guest80861 | 21:41 | |
| *** hichtakk has joined #openstack-infra | 21:41 | |
| *** david-lyle has joined #openstack-infra | 21:41 | |
| *** hichtakk has quit IRC | 21:41 | |
| fungi | clarkb: in good news, i have fresh dib images for devstack trusty, precise and centos7 all uploaded now | 21:41 |
| *** hichtakk has joined #openstack-infra | 21:41 | |
| clarkb | fungi: nice | 21:41 |
| clarkb | fungi: I am going to try deleting one of those saving images | 21:42 |
| clarkb | to see if that even works | 21:42 |
| *** nelsnelson has joined #openstack-infra | 21:42 | |
| *** hichtakk has quit IRC | 21:42 | |
| fungi | k | 21:42 |
| jogo | hmm getting 404s http://docs-draft.openstack.org/20/129420/35/check/gate-nova-specs-docs/d7dd5d4//doc/build/html/ | 21:42 |
| sdague | sigmavirus24: is there no glance fix? | 21:42 |
| *** hichtakk has joined #openstack-infra | 21:42 | |
| *** isviridov_away has quit IRC | 21:42 | |
| *** Guest80861 is now known as redrobot | 21:42 | |
| clarkb | jogo: how old was that build? | 21:42 |
| *** isviridov_away has joined #openstack-infra | 21:42 | |
| clarkb | jogo: you get one month of docs-draft | 21:42 |
| fungi | jogo: a recheck will regenerate it | 21:43 |
| *** markmcclain has quit IRC | 21:43 | |
| *** rkukura has quit IRC | 21:43 | |
| *** ociuhandu has quit IRC | 21:43 | |
| *** bswartz has quit IRC | 21:43 | |
| *** eharney has quit IRC | 21:43 | |
| *** rwsu has quit IRC | 21:43 | |
| *** dkranz has quit IRC | 21:43 | |
| *** esmute has quit IRC | 21:43 | |
| *** marcusvrn1 has quit IRC | 21:43 | |
| *** mestery has quit IRC | 21:43 | |
| *** enikanorov has quit IRC | 21:43 | |
| *** zz_avozza has quit IRC | 21:43 | |
| *** mjturek has quit IRC | 21:43 | |
| *** vhoward has quit IRC | 21:43 | |
| *** viglesia1 has quit IRC | 21:43 | |
| *** jgrimm has quit IRC | 21:43 | |
| *** jklare has quit IRC | 21:43 | |
| *** tristanC has quit IRC | 21:43 | |
| *** xianghui has quit IRC | 21:43 | |
| *** enikanorov__ has quit IRC | 21:43 | |
| *** spiffxp_ has quit IRC | 21:43 | |
| *** cinerama has quit IRC | 21:43 | |
| *** Longgeek has joined #openstack-infra | 21:43 | |
| *** markmcclain has joined #openstack-infra | 21:43 | |
| *** rkukura has joined #openstack-infra | 21:43 | |
| *** ociuhandu has joined #openstack-infra | 21:43 | |
| *** bswartz has joined #openstack-infra | 21:43 | |
| *** eharney has joined #openstack-infra | 21:43 | |
| *** rwsu has joined #openstack-infra | 21:43 | |
| *** dkranz has joined #openstack-infra | 21:43 | |
| *** esmute has joined #openstack-infra | 21:43 | |
| *** marcusvrn1 has joined #openstack-infra | 21:43 | |
| *** mestery has joined #openstack-infra | 21:43 | |
| *** enikanorov has joined #openstack-infra | 21:43 | |
| *** zz_avozza has joined #openstack-infra | 21:43 | |
| *** mjturek has joined #openstack-infra | 21:43 | |
| *** vhoward has joined #openstack-infra | 21:43 | |
| *** viglesia1 has joined #openstack-infra | 21:43 | |
| *** jgrimm has joined #openstack-infra | 21:43 | |
| *** jklare has joined #openstack-infra | 21:43 | |
| *** tristanC has joined #openstack-infra | 21:43 | |
| *** xianghui has joined #openstack-infra | 21:43 | |
| *** enikanorov__ has joined #openstack-infra | 21:43 | |
| *** spiffxp_ has joined #openstack-infra | 21:43 | |
| *** cinerama has joined #openstack-infra | 21:43 | |
| *** hichtakk has quit IRC | 21:43 | |
| sdague | clarkb: Dec 18 2:45 PM | 21:43 |
| jogo | Dec 19th | 21:43 |
| sigmavirus24 | sdague: We're researching it but right now it's blocking patches that shouldn't otherwise be affected | 21:43 |
| jogo | oh right local time zone views | 21:43 |
| *** zz_johnthetubagu has quit IRC | 21:43 | |
| sdague | heh | 21:43 |
| *** zz_johnthetubagu has joined #openstack-infra | 21:43 | |
| *** hichtakk has joined #openstack-infra | 21:43 | |
| *** hichtakk has quit IRC | 21:44 | |
| *** ChanServ has quit IRC | 21:44 | |
| *** ildikov has quit IRC | 21:44 | |
| *** tnurlygayanov_ has quit IRC | 21:44 | |
| *** achanda has quit IRC | 21:44 | |
| *** patrickeast has quit IRC | 21:44 | |
| *** Hefeweizen has quit IRC | 21:44 | |
| *** changbl has quit IRC | 21:44 | |
| *** marun has quit IRC | 21:44 | |
| *** dstufft has quit IRC | 21:44 | |
| *** openstackgerrit has quit IRC | 21:44 | |
| *** michchap has quit IRC | 21:44 | |
| *** praveenkumar_ has quit IRC | 21:44 | |
| *** erw has quit IRC | 21:44 | |
| *** wznoinsk has quit IRC | 21:44 | |
| *** NithyaG has quit IRC | 21:44 | |
| *** cody-somerville has quit IRC | 21:44 | |
| *** nikhil_k has quit IRC | 21:44 | |
| *** mrodden has quit IRC | 21:44 | |
| *** jkt has quit IRC | 21:44 | |
| *** jpeeler has quit IRC | 21:44 | |
| *** dosaboy has quit IRC | 21:44 | |
| *** asadoughi has quit IRC | 21:44 | |
| *** wolsen has quit IRC | 21:44 | |
| *** dkliban_afk has quit IRC | 21:44 | |
| *** LinuxJedi has quit IRC | 21:44 | |
| *** hamzy has quit IRC | 21:44 | |
| *** dguerri_ has quit IRC | 21:44 | |
| *** gnuoy has quit IRC | 21:44 | |
| *** tlbr has quit IRC | 21:44 | |
| *** darvon has quit IRC | 21:44 | |
| *** mfink_ has quit IRC | 21:44 | |
| *** spiffxp has quit IRC | 21:44 | |
| *** Guest20522 has quit IRC | 21:44 | |
| *** mattymo has quit IRC | 21:44 | |
| *** teran__ has quit IRC | 21:44 | |
| *** mattfarina has quit IRC | 21:44 | |
| *** jyuso has quit IRC | 21:44 | |
| *** sweston has quit IRC | 21:44 | |
| *** coolsvap|afk has quit IRC | 21:44 | |
| *** skraynev has quit IRC | 21:44 | |
| *** ianw has quit IRC | 21:44 | |
| *** luqas has quit IRC | 21:44 | |
| *** sressot has quit IRC | 21:44 | |
| *** zaro has quit IRC | 21:44 | |
| *** notmyname has quit IRC | 21:44 | |
| *** vipul has quit IRC | 21:44 | |
| *** dmellado has quit IRC | 21:44 | |
| *** juice has quit IRC | 21:44 | |
| *** greghaynes has quit IRC | 21:44 | |
| *** chmouel has quit IRC | 21:44 | |
| *** toabctl has quit IRC | 21:44 | |
| *** dmsimard has quit IRC | 21:44 | |
| *** bookwar_ has quit IRC | 21:44 | |
| *** jd__ has quit IRC | 21:44 | |
| *** zz_johnthetubagu has quit IRC | 21:44 | |
| *** markmcclain has quit IRC | 21:44 | |
| *** rkukura has quit IRC | 21:44 | |
| *** ociuhandu has quit IRC | 21:44 | |
| *** bswartz has quit IRC | 21:44 | |
| *** eharney has quit IRC | 21:44 | |
| *** rwsu has quit IRC | 21:44 | |
| *** dkranz has quit IRC | 21:44 | |
| *** esmute has quit IRC | 21:44 | |
| *** marcusvrn1 has quit IRC | 21:44 | |
| *** mestery has quit IRC | 21:44 | |
| *** enikanorov has quit IRC | 21:44 | |
| *** zz_avozza has quit IRC | 21:44 | |
| *** mjturek has quit IRC | 21:44 | |
| *** vhoward has quit IRC | 21:44 | |
| *** viglesia1 has quit IRC | 21:44 | |
| *** jgrimm has quit IRC | 21:44 | |
| *** jklare has quit IRC | 21:44 | |
| *** tristanC has quit IRC | 21:44 | |
| *** xianghui has quit IRC | 21:44 | |
| *** enikanorov__ has quit IRC | 21:44 | |
| *** spiffxp_ has quit IRC | 21:44 | |
| *** cinerama has quit IRC | 21:44 | |
| *** isviridov_away has quit IRC | 21:44 | |
| *** bhunter71 has quit IRC | 21:44 | |
| *** emagana has quit IRC | 21:44 | |
| *** dustins has quit IRC | 21:44 | |
| *** julim has quit IRC | 21:44 | |
| *** mwagner_lap has quit IRC | 21:44 | |
| *** sabari has quit IRC | 21:44 | |
| *** samueldmq has quit IRC | 21:44 | |
| *** zul has quit IRC | 21:44 | |
| *** bnemec has quit IRC | 21:45 | |
| *** tsufiev has quit IRC | 21:45 | |
| *** phschwartz has quit IRC | 21:45 | |
| *** gaelL has quit IRC | 21:45 | |
| *** med_ has quit IRC | 21:45 | |
| *** krotscheck has quit IRC | 21:45 | |
| *** gema has quit IRC | 21:45 | |
| *** gpocentek has quit IRC | 21:45 | |
| *** Vivek has quit IRC | 21:45 | |
| *** igorbelikov has quit IRC | 21:45 | |
| *** therve has quit IRC | 21:45 | |
| *** ekarlso- has quit IRC | 21:45 | |
| *** cburgess has quit IRC | 21:45 | |
| *** DinaBelova has quit IRC | 21:45 | |
| *** jcooley has quit IRC | 21:45 | |
| *** leifmadsen has quit IRC | 21:45 | |
| *** timfreund has quit IRC | 21:45 | |
| *** jogo has quit IRC | 21:45 | |
| *** grantbow has quit IRC | 21:45 | |
| *** niedbalski has quit IRC | 21:45 | |
| *** imcsk8 has quit IRC | 21:45 | |
| *** ayoung has quit IRC | 21:45 | |
| *** armax has quit IRC | 21:45 | |
| *** yjiang5 has quit IRC | 21:45 | |
| *** redixin has quit IRC | 21:45 | |
| *** nijaba has quit IRC | 21:45 | |
| *** Clint has quit IRC | 21:45 | |
| *** psedlak has quit IRC | 21:45 | |
| *** shardy has quit IRC | 21:45 | |
| *** dstanek has quit IRC | 21:45 | |
| *** david-lyle has quit IRC | 21:45 | |
| *** fandi has quit IRC | 21:45 | |
| *** hashar has quit IRC | 21:45 | |
| *** thingee has quit IRC | 21:45 | |
| *** jcoufal has quit IRC | 21:45 | |
| *** kashyap has quit IRC | 21:45 | |
| *** camunoz has quit IRC | 21:45 | |
| *** harlowja has quit IRC | 21:45 | |
| *** sandywalsh has quit IRC | 21:45 | |
| *** vponomaryov has quit IRC | 21:45 | |
| *** mase_home has quit IRC | 21:45 | |
| *** SotK has quit IRC | 21:45 | |
| *** mfisch has quit IRC | 21:45 | |
| *** Mmike has quit IRC | 21:45 | |
| *** fabo has quit IRC | 21:45 | |
| *** mwhudson has quit IRC | 21:45 | |
| *** tteggel has quit IRC | 21:45 | |
| *** alaski has quit IRC | 21:45 | |
| *** rodrigods has quit IRC | 21:45 | |
| *** lifeless has quit IRC | 21:45 | |
| *** uvirtbot has quit IRC | 21:45 | |
| *** annegentle_ has quit IRC | 21:45 | |
| *** kmartin has quit IRC | 21:45 | |
| *** e0ne has quit IRC | 21:45 | |
| *** gyee has quit IRC | 21:45 | |
| *** doude has quit IRC | 21:45 | |
| *** ivar-lazzaro has quit IRC | 21:45 | |
| *** romcheg has quit IRC | 21:45 | |
| *** ZZelle_ has quit IRC | 21:45 | |
| *** pcrews has quit IRC | 21:45 | |
| *** alazarev has quit IRC | 21:45 | |
| *** SergeyLukjanov has quit IRC | 21:45 | |
| *** _buzz has quit IRC | 21:45 | |
| *** morgabra has quit IRC | 21:45 | |
| *** dkehn has quit IRC | 21:45 | |
| *** zxiiro has quit IRC | 21:45 | |
| *** paul-- has quit IRC | 21:45 | |
| *** jhesketh has quit IRC | 21:45 | |
| *** HenryG has quit IRC | 21:45 | |
| *** dims__ has quit IRC | 21:45 | |
| *** salv-orlando has quit IRC | 21:45 | |
| *** dannywilson has quit IRC | 21:45 | |
| *** hdd has quit IRC | 21:45 | |
| *** yamahata has quit IRC | 21:45 | |
| *** ronis has quit IRC | 21:45 | |
| *** erikmwilson has quit IRC | 21:45 | |
| *** arielb has quit IRC | 21:45 | |
| *** kgiusti has quit IRC | 21:45 | |
| *** mbacchi has quit IRC | 21:45 | |
| *** HeOS has quit IRC | 21:45 | |
| *** funzo_ has quit IRC | 21:45 | |
| *** slagle has quit IRC | 21:45 | |
| *** yolanda has quit IRC | 21:45 | |
| *** sdake has quit IRC | 21:45 | |
| *** TheJulia has quit IRC | 21:45 | |
| *** smoser has quit IRC | 21:45 | |
| *** Kiall has quit IRC | 21:45 | |
| *** NobodyCam has quit IRC | 21:45 | |
| *** kragniz has quit IRC | 21:45 | |
| *** markvan has quit IRC | 21:45 | |
| *** tcammann has quit IRC | 21:45 | |
| *** davidlenwell has quit IRC | 21:45 | |
| *** SlickNik has quit IRC | 21:45 | |
| *** pleia2 has quit IRC | 21:45 | |
| *** HeOS_ has quit IRC | 21:45 | |
| *** mtreinish has quit IRC | 21:45 | |
| *** vladan has quit IRC | 21:45 | |
| *** bogdando has quit IRC | 21:45 | |
| *** maurosr has quit IRC | 21:45 | |
| *** BobBall has quit IRC | 21:45 | |
| *** dteselkin has quit IRC | 21:45 | |
| *** ruhe has quit IRC | 21:45 | |
| *** Apsu has quit IRC | 21:45 | |
| *** amrith has quit IRC | 21:45 | |
| *** eikke has quit IRC | 21:45 | |
| *** SpamapS has quit IRC | 21:45 | |
| *** EntropyWorks has quit IRC | 21:45 | |
| *** ddieterly has quit IRC | 21:45 | |
| *** ChuckC has quit IRC | 21:45 | |
| *** xyang0 has quit IRC | 21:45 | |
| *** mfink has quit IRC | 21:45 | |
| *** weshay has quit IRC | 21:45 | |
| *** afazekas has quit IRC | 21:45 | |
| *** bknudson has quit IRC | 21:45 | |
| *** pfallenop has quit IRC | 21:45 | |
| *** bodepd has quit IRC | 21:45 | |
| *** bhuvan has quit IRC | 21:45 | |
| *** wenlock has quit IRC | 21:45 | |
| *** mriedem has quit IRC | 21:45 | |
| *** sdague has quit IRC | 21:45 | |
| *** briancline has quit IRC | 21:45 | |
| *** hogepodge has quit IRC | 21:45 | |
| *** sabeen2 has quit IRC | 21:45 | |
| *** TravT has quit IRC | 21:45 | |
| *** sarob has quit IRC | 21:45 | |
| *** sc68cal has quit IRC | 21:45 | |
| *** Ryan_Lane has quit IRC | 21:45 | |
| *** jaypipes has quit IRC | 21:45 | |
| *** stevemar has quit IRC | 21:46 | |
| *** plaurin_ has quit IRC | 21:46 | |
| *** rlandy has quit IRC | 21:46 | |
| *** adalbas has quit IRC | 21:46 | |
| *** otherwiseguy has quit IRC | 21:46 | |
| *** pabelanger has quit IRC | 21:46 | |
| *** hughsaunders has quit IRC | 21:46 | |
| *** StevenK has quit IRC | 21:46 | |
| *** Ng has quit IRC | 21:46 | |
| *** krtaylor has quit IRC | 21:46 | |
| *** rm_work has quit IRC | 21:46 | |
| *** jraim has quit IRC | 21:46 | |
| *** jbryce has quit IRC | 21:46 | |
| *** lbragstad has quit IRC | 21:46 | |
| *** mgagne has quit IRC | 21:46 | |
| *** russellb has quit IRC | 21:46 | |
| *** dimtruck has quit IRC | 21:46 | |
| *** stevebaker has quit IRC | 21:46 | |
| *** dhellmann has quit IRC | 21:46 | |
| *** pcaruana has quit IRC | 21:46 | |
| *** dtantsur|afk has quit IRC | 21:46 | |
| *** asselin has quit IRC | 21:46 | |
| *** waynr has quit IRC | 21:46 | |
| *** mattt has quit IRC | 21:46 | |
| *** gus has quit IRC | 21:46 | |
| *** mugsie has quit IRC | 21:46 | |
| *** dansmith has quit IRC | 21:46 | |
| *** jdandrea has quit IRC | 21:46 | |
| *** gothicmindfood has quit IRC | 21:46 | |
| *** anteaya has quit IRC | 21:46 | |
| *** jamespage has quit IRC | 21:46 | |
| *** rakhmerov has quit IRC | 21:46 | |
| *** devananda has quit IRC | 21:46 | |
| *** dmitryme has quit IRC | 21:46 | |
| *** tchaypo has quit IRC | 21:46 | |
| *** cloudnull has quit IRC | 21:46 | |
| *** JayF has quit IRC | 21:46 | |
| *** zz_gondoi has quit IRC | 21:46 | |
| *** simonmcc has quit IRC | 21:46 | |
| *** kevinbenton has quit IRC | 21:46 | |
| *** dougwig has quit IRC | 21:46 | |
| *** beecee has quit IRC | 21:46 | |
| *** JoshNang has quit IRC | 21:46 | |
| *** Mithrandir has quit IRC | 21:46 | |
| *** timrc has quit IRC | 21:46 | |
| *** Daviey has quit IRC | 21:46 | |
| *** jesusaurus has quit IRC | 21:46 | |
| *** ctlaugh has quit IRC | 21:46 | |
| *** ttx has quit IRC | 21:46 | |
| *** odyssey4me has quit IRC | 21:46 | |
| *** sigmavirus24 has quit IRC | 21:46 | |
| *** dolphm has quit IRC | 21:46 | |
| *** fungi has quit IRC | 21:46 | |
| *** clif_h has quit IRC | 21:46 | |
| *** mancdaz has quit IRC | 21:46 | |
| *** Svedrin has quit IRC | 21:46 | |
| *** jeblair has quit IRC | 21:46 | |
| *** adam_g has quit IRC | 21:46 | |
| *** msuriar has quit IRC | 21:46 | |
| *** d0ugal has quit IRC | 21:46 | |
| *** mordred has quit IRC | 21:46 | |
| *** abramley has quit IRC | 21:46 | |
| *** clarkb has quit IRC | 21:46 | |
| *** morganfainberg has quit IRC | 21:46 | |
| *** redrobot has quit IRC | 21:46 | |
| *** reed has quit IRC | 21:46 | |
| *** rmcall has quit IRC | 21:46 | |
| *** shayneburgess has quit IRC | 21:46 | |
| *** alivigni has quit IRC | 21:46 | |
| *** skolekonov has quit IRC | 21:46 | |
| *** ZZelle has quit IRC | 21:46 | |
| *** wendar has quit IRC | 21:46 | |
| *** fifieldt__ has quit IRC | 21:46 | |
| *** mika has quit IRC | 21:46 | |
| *** sbadia has quit IRC | 21:46 | |
| *** radez has quit IRC | 21:46 | |
| *** mkoderer has quit IRC | 21:46 | |
| *** andreaf_ has quit IRC | 21:46 | |
| *** Shrews has quit IRC | 21:46 | |
| *** saper has quit IRC | 21:46 | |
| *** flaper87 has quit IRC | 21:46 | |
| *** antonym has quit IRC | 21:46 | |
| *** jgriffith has quit IRC | 21:46 | |
| *** dvorak has quit IRC | 21:46 | |
| *** mikal has quit IRC | 21:46 | |
| *** ondergetekende has quit IRC | 21:46 | |
| *** heyongli has quit IRC | 21:46 | |
| *** charz has quit IRC | 21:46 | |
| *** dhp has quit IRC | 21:46 | |
| *** s0nea has quit IRC | 21:46 | |
| *** crinkle has quit IRC | 21:46 | |
| *** openstack has joined #openstack-infra | 21:48 | |
| *** hichtakk has joined #openstack-infra | 21:49 | |
| *** hichtakk is now known as 16WAAYUHW | 21:50 | |
| *** hichtakk has joined #openstack-infra | 21:51 | |
| *** tnurlygayanov_ has joined #openstack-infra | 21:51 | |
| *** ildikov has joined #openstack-infra | 21:51 | |
| *** sputnik13 has joined #openstack-infra | 21:51 | |
| *** david-lyle has joined #openstack-infra | 21:51 | |
| *** zz_johnthetubagu has joined #openstack-infra | 21:51 | |
| *** cinerama has joined #openstack-infra | 21:51 | |
| *** spiffxp_ has joined #openstack-infra | 21:51 | |
| *** enikanorov__ has joined #openstack-infra | 21:51 | |
| *** xianghui has joined #openstack-infra | 21:51 | |
| *** tristanC has joined #openstack-infra | 21:51 | |
| *** jklare has joined #openstack-infra | 21:51 | |
| *** jgrimm has joined #openstack-infra | 21:51 | |
| *** viglesia1 has joined #openstack-infra | 21:51 | |
| *** vhoward has joined #openstack-infra | 21:51 | |
| *** mjturek has joined #openstack-infra | 21:51 | |
| *** zz_avozza has joined #openstack-infra | 21:51 | |
| *** enikanorov has joined #openstack-infra | 21:51 | |
| *** mestery has joined #openstack-infra | 21:51 | |
| *** marcusvrn1 has joined #openstack-infra | 21:51 | |
| *** esmute has joined #openstack-infra | 21:51 | |
| *** dkranz has joined #openstack-infra | 21:51 | |
| *** rwsu has joined #openstack-infra | 21:51 | |
| *** eharney has joined #openstack-infra | 21:51 | |
| *** bswartz has joined #openstack-infra | 21:51 | |
| *** ociuhandu has joined #openstack-infra | 21:51 | |
| *** rkukura has joined #openstack-infra | 21:51 | |
| *** markmcclain has joined #openstack-infra | 21:51 | |
| *** isviridov_away has joined #openstack-infra | 21:51 | |
| *** redrobot has joined #openstack-infra | 21:51 | |
| *** niedbalski has joined #openstack-infra | 21:51 | |
| *** grantbow has joined #openstack-infra | 21:51 | |
| *** jogo has joined #openstack-infra | 21:51 | |
| *** timfreund has joined #openstack-infra | 21:51 | |
| *** leifmadsen has joined #openstack-infra | 21:51 | |
| *** jcooley has joined #openstack-infra | 21:51 | |
| *** DinaBelova has joined #openstack-infra | 21:51 | |
| *** ekarlso- has joined #openstack-infra | 21:51 | |
| *** therve has joined #openstack-infra | 21:51 | |
| *** cburgess has joined #openstack-infra | 21:51 | |
| *** igorbelikov has joined #openstack-infra | 21:51 | |
| *** Vivek has joined #openstack-infra | 21:51 | |
| *** gpocentek has joined #openstack-infra | 21:51 | |
| *** gema has joined #openstack-infra | 21:51 | |
| *** krotscheck has joined #openstack-infra | 21:51 | |
| *** med_ has joined #openstack-infra | 21:51 | |
| *** gaelL has joined #openstack-infra | 21:51 | |
| *** phschwartz has joined #openstack-infra | 21:51 | |
| *** tsufiev has joined #openstack-infra | 21:51 | |
| *** bnemec has joined #openstack-infra | 21:51 | |
| *** zul has joined #openstack-infra | 21:51 | |
| *** sabari has joined #openstack-infra | 21:51 | |
| *** mwagner_lap has joined #openstack-infra | 21:51 | |
| *** julim has joined #openstack-infra | 21:51 | |
| *** dustins has joined #openstack-infra | 21:51 | |
| *** emagana has joined #openstack-infra | 21:51 | |
| *** samueldmq has joined #openstack-infra | 21:51 | |
| *** bhunter71 has joined #openstack-infra | 21:51 | |
| *** HenryG has joined #openstack-infra | 21:51 | |
| *** dstanek has joined #openstack-infra | 21:51 | |
| *** shardy has joined #openstack-infra | 21:51 | |
| *** psedlak has joined #openstack-infra | 21:51 | |
| *** Clint has joined #openstack-infra | 21:51 | |
| *** nijaba has joined #openstack-infra | 21:51 | |
| *** redixin has joined #openstack-infra | 21:51 | |
| *** yjiang5 has joined #openstack-infra | 21:51 | |
| *** armax has joined #openstack-infra | 21:51 | |
| *** ayoung has joined #openstack-infra | 21:51 | |
| *** imcsk8 has joined #openstack-infra | 21:51 | |
| *** fandi has joined #openstack-infra | 21:51 | |
| *** hashar has joined #openstack-infra | 21:51 | |
| *** hogepodge has joined #openstack-infra | 21:51 | |
| *** briancline has joined #openstack-infra | 21:51 | |
| *** sdague has joined #openstack-infra | 21:51 | |
| *** bodepd has joined #openstack-infra | 21:51 | |
| *** pfallenop has joined #openstack-infra | 21:51 | |
| *** bknudson has joined #openstack-infra | 21:51 | |
| *** afazekas has joined #openstack-infra | 21:51 | |
| *** weshay has joined #openstack-infra | 21:51 | |
| *** mfink has joined #openstack-infra | 21:51 | |
| *** mriedem has joined #openstack-infra | 21:51 | |
| *** wenlock has joined #openstack-infra | 21:51 | |
| *** xyang0 has joined #openstack-infra | 21:51 | |
| *** ChuckC has joined #openstack-infra | 21:51 | |
| *** bhuvan has joined #openstack-infra | 21:51 | |
| *** ddieterly has joined #openstack-infra | 21:51 | |
| *** dims__ has joined #openstack-infra | 21:51 | |
| *** ronis has joined #openstack-infra | 21:51 | |
| *** kmartin has joined #openstack-infra | 21:51 | |
| *** e0ne has joined #openstack-infra | 21:51 | |
| *** gyee has joined #openstack-infra | 21:51 | |
| *** salv-orlando has joined #openstack-infra | 21:51 | |
| *** doude has joined #openstack-infra | 21:51 | |
| *** ivar-lazzaro has joined #openstack-infra | 21:51 | |
| *** dannywilson has joined #openstack-infra | 21:51 | |
| *** thingee has joined #openstack-infra | 21:51 | |
| *** hdd has joined #openstack-infra | 21:51 | |
| *** yamahata has joined #openstack-infra | 21:51 | |
| *** romcheg has joined #openstack-infra | 21:51 | |
| *** ZZelle_ has joined #openstack-infra | 21:51 | |
| *** jcoufal has joined #openstack-infra | 21:51 | |
| *** erikmwilson has joined #openstack-infra | 21:51 | |
| *** pcrews has joined #openstack-infra | 21:51 | |
| *** arielb has joined #openstack-infra | 21:51 | |
| *** alazarev has joined #openstack-infra | 21:51 | |
| *** SergeyLukjanov has joined #openstack-infra | 21:51 | |
| *** kgiusti has joined #openstack-infra | 21:51 | |
| *** mbacchi has joined #openstack-infra | 21:51 | |
| *** HeOS has joined #openstack-infra | 21:51 | |
| *** funzo_ has joined #openstack-infra | 21:51 | |
| *** kashyap has joined #openstack-infra | 21:51 | |
| *** _buzz has joined #openstack-infra | 21:51 | |
| *** camunoz has joined #openstack-infra | 21:51 | |
| *** morgabra has joined #openstack-infra | 21:51 | |
| *** harlowja has joined #openstack-infra | 21:51 | |
| *** slagle has joined #openstack-infra | 21:51 | |
| *** sandywalsh has joined #openstack-infra | 21:51 | |
| *** dkehn has joined #openstack-infra | 21:51 | |
| *** vponomaryov has joined #openstack-infra | 21:51 | |
| *** yolanda has joined #openstack-infra | 21:51 | |
| *** paul-- has joined #openstack-infra | 21:51 | |
| *** mase_home has joined #openstack-infra | 21:51 | |
| *** SotK has joined #openstack-infra | 21:51 | |
| *** sdake has joined #openstack-infra | 21:51 | |
| *** amrith has joined #openstack-infra | 21:51 | |
| *** TheJulia has joined #openstack-infra | 21:51 | |
| *** zxiiro has joined #openstack-infra | 21:51 | |
| *** smoser has joined #openstack-infra | 21:51 | |
| *** Kiall has joined #openstack-infra | 21:51 | |
| *** mfisch has joined #openstack-infra | 21:51 | |
| *** Mmike has joined #openstack-infra | 21:51 | |
| *** NobodyCam has joined #openstack-infra | 21:51 | |
| *** mwhudson has joined #openstack-infra | 21:51 | |
| *** fabo has joined #openstack-infra | 21:51 | |
| *** kragniz has joined #openstack-infra | 21:51 | |
| *** markvan has joined #openstack-infra | 21:51 | |
| *** tcammann has joined #openstack-infra | 21:51 | |
| *** davidlenwell has joined #openstack-infra | 21:51 | |
| *** tteggel has joined #openstack-infra | 21:51 | |
| *** SlickNik has joined #openstack-infra | 21:51 | |
| *** pleia2 has joined #openstack-infra | 21:51 | |
| *** HeOS_ has joined #openstack-infra | 21:51 | |
| *** mtreinish has joined #openstack-infra | 21:51 | |
| *** vladan has joined #openstack-infra | 21:51 | |
| *** alaski has joined #openstack-infra | 21:51 | |
| *** bogdando has joined #openstack-infra | 21:51 | |
| *** rodrigods has joined #openstack-infra | 21:51 | |
| *** lifeless has joined #openstack-infra | 21:51 | |
| *** uvirtbot has joined #openstack-infra | 21:51 | |
| *** annegentle_ has joined #openstack-infra | 21:51 | |
| *** jhesketh has joined #openstack-infra | 21:51 | |
| *** SpamapS has joined #openstack-infra | 21:51 | |
| *** EntropyWorks has joined #openstack-infra | 21:51 | |
| *** Apsu has joined #openstack-infra | 21:51 | |
| *** ruhe has joined #openstack-infra | 21:51 | |
| *** dteselkin has joined #openstack-infra | 21:51 | |
| *** BobBall has joined #openstack-infra | 21:51 | |
| *** maurosr has joined #openstack-infra | 21:51 | |
| *** eikke has joined #openstack-infra | 21:51 | |
| *** sabeen2 has joined #openstack-infra | 21:51 | |
| *** TravT has joined #openstack-infra | 21:51 | |
| *** teran__ has joined #openstack-infra | 21:51 | |
| *** sarob has joined #openstack-infra | 21:51 | |
| *** reed has joined #openstack-infra | 21:51 | |
| *** sc68cal has joined #openstack-infra | 21:51 | |
| *** rmcall has joined #openstack-infra | 21:51 | |
| *** Ryan_Lane has joined #openstack-infra | 21:51 | |
| *** jaypipes has joined #openstack-infra | 21:51 | |
| *** shayneburgess has joined #openstack-infra | 21:51 | |
| *** stevemar has joined #openstack-infra | 21:51 | |
| *** alivigni has joined #openstack-infra | 21:51 | |
| *** mattfarina has joined #openstack-infra | 21:51 | |
| *** plaurin_ has joined #openstack-infra | 21:51 | |
| *** rlandy has joined #openstack-infra | 21:51 | |
| *** jswarren has joined #openstack-infra | 21:51 | |
| *** skolekonov has joined #openstack-infra | 21:51 | |
| *** adalbas has joined #openstack-infra | 21:51 | |
| *** ZZelle has joined #openstack-infra | 21:51 | |
| *** otherwiseguy has joined #openstack-infra | 21:51 | |
| *** jyuso has joined #openstack-infra | 21:51 | |
| *** naggappan has joined #openstack-infra | 21:51 | |
| *** pabelanger has joined #openstack-infra | 21:51 | |
| *** hughsaunders has joined #openstack-infra | 21:51 | |
| *** StevenK has joined #openstack-infra | 21:51 | |
| *** Ng has joined #openstack-infra | 21:51 | |
| *** krtaylor has joined #openstack-infra | 21:51 | |
| *** rm_work has joined #openstack-infra | 21:51 | |
| *** jbryce has joined #openstack-infra | 21:51 | |
| *** dimtruck has joined #openstack-infra | 21:51 | |
| *** russellb has joined #openstack-infra | 21:51 | |
| *** jraim has joined #openstack-infra | 21:51 | |
| *** lbragstad has joined #openstack-infra | 21:51 | |
| *** mgagne has joined #openstack-infra | 21:51 | |
| *** stevebaker has joined #openstack-infra | 21:51 | |
| *** sweston has joined #openstack-infra | 21:51 | |
| *** wendar has joined #openstack-infra | 21:51 | |
| *** coolsvap|afk has joined #openstack-infra | 21:51 | |
| *** btran has joined #openstack-infra | 21:51 | |
| *** dhellmann has joined #openstack-infra | 21:51 | |
| *** fifieldt__ has joined #openstack-infra | 21:51 | |
| *** pcaruana has joined #openstack-infra | 21:51 | |
| *** skraynev has joined #openstack-infra | 21:51 | |
| *** mika has joined #openstack-infra | 21:51 | |
| *** ianw has joined #openstack-infra | 21:51 | |
| *** dtantsur|afk has joined #openstack-infra | 21:51 | |
| *** luqas has joined #openstack-infra | 21:51 | |
| *** ricolin has joined #openstack-infra | 21:51 | |
| *** asselin has joined #openstack-infra | 21:51 | |
| *** sressot has joined #openstack-infra | 21:51 | |
| *** sbadia has joined #openstack-infra | 21:51 | |
| *** zaro has joined #openstack-infra | 21:51 | |
| *** mkoderer has joined #openstack-infra | 21:51 | |
| *** notmyname has joined #openstack-infra | 21:51 | |
| *** radez has joined #openstack-infra | 21:51 | |
| *** waynr has joined #openstack-infra | 21:51 | |
| *** mattt has joined #openstack-infra | 21:51 | |
| *** vipul has joined #openstack-infra | 21:51 | |
| *** andreaf_ has joined #openstack-infra | 21:51 | |
| *** gus has joined #openstack-infra | 21:51 | |
| *** nuritv has joined #openstack-infra | 21:51 | |
| *** dmellado has joined #openstack-infra | 21:51 | |
| *** juice has joined #openstack-infra | 21:51 | |
| *** Shrews has joined #openstack-infra | 21:51 | |
| *** mugsie has joined #openstack-infra | 21:51 | |
| *** dansmith has joined #openstack-infra | 21:51 | |
| *** greghaynes has joined #openstack-infra | 21:51 | |
| *** jamespage has joined #openstack-infra | 21:51 | |
| *** jdandrea has joined #openstack-infra | 21:51 | |
| *** saper has joined #openstack-infra | 21:51 | |
| *** chmouel has joined #openstack-infra | 21:51 | |
| *** antonym has joined #openstack-infra | 21:51 | |
| *** flaper87 has joined #openstack-infra | 21:51 | |
| *** jgriffith has joined #openstack-infra | 21:51 | |
| *** gothicmindfood has joined #openstack-infra | 21:51 | |
| *** dmitryme has joined #openstack-infra | 21:51 | |
| *** tchaypo has joined #openstack-infra | 21:51 | |
| *** cloudnull has joined #openstack-infra | 21:51 | |
| *** anteaya has joined #openstack-infra | 21:51 | |
| *** dvorak has joined #openstack-infra | 21:51 | |
| *** zz_gondoi has joined #openstack-infra | 21:51 | |
| *** JayF has joined #openstack-infra | 21:51 | |
| *** simonmcc has joined #openstack-infra | 21:51 | |
| *** kevinbenton has joined #openstack-infra | 21:51 | |
| *** dougwig has joined #openstack-infra | 21:51 | |
| *** beecee has joined #openstack-infra | 21:51 | |
| *** mikal has joined #openstack-infra | 21:51 | |
| *** JoshNang has joined #openstack-infra | 21:51 | |
| *** ChanServ has joined #openstack-infra | 21:51 | |
| *** ondergetekende has joined #openstack-infra | 21:51 | |
| *** heyongli has joined #openstack-infra | 21:51 | |
| *** Mithrandir has joined #openstack-infra | 21:51 | |
| *** toabctl has joined #openstack-infra | 21:51 | |
| *** timrc has joined #openstack-infra | 21:51 | |
| *** Daviey has joined #openstack-infra | 21:51 | |
| *** rakhmerov has joined #openstack-infra | 21:51 | |
| *** jesusaurus has joined #openstack-infra | 21:51 | |
| *** charz has joined #openstack-infra | 21:51 | |
| *** dhp has joined #openstack-infra | 21:51 | |
| *** ctlaugh has joined #openstack-infra | 21:51 | |
| *** s0nea has joined #openstack-infra | 21:51 | |
| *** ttx has joined #openstack-infra | 21:51 | |
| *** dmsimard has joined #openstack-infra | 21:51 | |
| *** devananda has joined #openstack-infra | 21:51 | |
| *** crinkle has joined #openstack-infra | 21:51 | |
| *** odyssey4me has joined #openstack-infra | 21:51 | |
| *** sigmavirus24 has joined #openstack-infra | 21:51 | |
| *** dolphm has joined #openstack-infra | 21:51 | |
| *** bookwar_ has joined #openstack-infra | 21:51 | |
| *** a2hill has joined #openstack-infra | 21:51 | |
| *** fungi has joined #openstack-infra | 21:51 | |
| *** clif_h has joined #openstack-infra | 21:51 | |
| *** nibalizer has joined #openstack-infra | 21:51 | |
| *** mancdaz has joined #openstack-infra | 21:51 | |
| *** Svedrin has joined #openstack-infra | 21:51 | |
| *** jeblair has joined #openstack-infra | 21:51 | |
| *** BadCub_ has joined #openstack-infra | 21:51 | |
| *** sendak.freenode.net sets mode: +o ChanServ | 21:51 | |
| *** adam_g has joined #openstack-infra | 21:51 | |
| *** msuriar has joined #openstack-infra | 21:51 | |
| *** d0ugal has joined #openstack-infra | 21:51 | |
| *** mordred has joined #openstack-infra | 21:51 | |
| *** jd__ has joined #openstack-infra | 21:51 | |
| *** abramley has joined #openstack-infra | 21:51 | |
| *** clarkb has joined #openstack-infra | 21:51 | |
| *** morganfainberg has joined #openstack-infra | 21:51 | |
| *** niska has joined #openstack-infra | 21:51 | |
| *** zz_naotok has joined #openstack-infra | 21:51 | |
| *** david-lyle has quit IRC | 21:51 | |
| *** david-lyle has joined #openstack-infra | 21:51 | |
| lifeless | dstanek: clarkb: + whatever the setuptools fallout was | 21:51 |
| *** andreaf has joined #openstack-infra | 21:51 | |
| clarkb | lifeless: I think setuptools fallout should be forward ported too so just semver related things need to be done | 21:51 |
| fungi | i think all the pep 440 related fixes have ben ported to master at this point | 21:51 |
| fungi | been | 21:51 |
| *** 16WAAYUHW has quit IRC | 21:51 | |
| *** darvon_ has joined #openstack-infra | 21:51 | |
| *** hichtakk has quit IRC | 21:51 | |
| *** ameade has quit IRC | 21:51 | |
| *** ameade has joined #openstack-infra | 21:51 | |
| *** jasonamyers has quit IRC | 21:52 | |
| *** jasonamyers has joined #openstack-infra | 21:52 | |
| *** zhiyan has quit IRC | 21:52 | |
| *** zhiyan has joined #openstack-infra | 21:52 | |
| *** signed8bit has joined #openstack-infra | 21:52 | |
| *** signed8bit has quit IRC | 21:52 | |
| *** signed8bit has joined #openstack-infra | 21:52 | |
| *** hichtakk has joined #openstack-infra | 21:52 | |
| *** hichtakk has quit IRC | 21:53 | |
| *** dstufft_ has joined #openstack-infra | 21:53 | |
| fungi | clarkb: could we have a dead socket to the provider api endpoint? | 21:53 |
| *** sabeen2 has quit IRC | 21:53 | |
| *** TravT has quit IRC | 21:53 | |
| *** sarob has quit IRC | 21:53 | |
| *** sc68cal has quit IRC | 21:53 | |
| *** Ryan_Lane has quit IRC | 21:53 | |
| *** jaypipes has quit IRC | 21:53 | |
| *** stevemar has quit IRC | 21:53 | |
| *** plaurin_ has quit IRC | 21:53 | |
| *** rlandy has quit IRC | 21:53 | |
| *** adalbas has quit IRC | 21:53 | |
| *** otherwiseguy has quit IRC | 21:53 | |
| *** pabelanger has quit IRC | 21:53 | |
| *** hughsaunders has quit IRC | 21:53 | |
| *** StevenK has quit IRC | 21:53 | |
| *** Ng has quit IRC | 21:53 | |
| *** krtaylor has quit IRC | 21:53 | |
| *** rm_work has quit IRC | 21:53 | |
| *** jraim has quit IRC | 21:53 | |
| *** jbryce has quit IRC | 21:53 | |
| *** lbragstad has quit IRC | 21:53 | |
| *** mgagne has quit IRC | 21:53 | |
| *** russellb has quit IRC | 21:53 | |
| *** dimtruck has quit IRC | 21:53 | |
| *** stevebaker has quit IRC | 21:53 | |
| *** dhellmann has quit IRC | 21:53 | |
| *** pcaruana has quit IRC | 21:53 | |
| *** dtantsur|afk has quit IRC | 21:53 | |
| *** asselin has quit IRC | 21:53 | |
| *** waynr has quit IRC | 21:53 | |
| *** mattt has quit IRC | 21:53 | |
| *** gus has quit IRC | 21:53 | |
| *** mugsie has quit IRC | 21:53 | |
| *** dansmith has quit IRC | 21:53 | |
| *** jdandrea has quit IRC | 21:53 | |
| *** gothicmindfood has quit IRC | 21:53 | |
| *** anteaya has quit IRC | 21:53 | |
| *** jamespage has quit IRC | 21:53 | |
| *** rakhmerov has quit IRC | 21:53 | |
| *** devananda has quit IRC | 21:53 | |
| fungi | i suppose i could tcpdump it looking for return traffic | 21:53 |
| *** hichtakk has joined #openstack-infra | 21:53 | |
| *** hichtakk has quit IRC | 21:53 | |
| clarkb | fungi: maybe? would be odd for all 5 providers to have that issue | 21:53 |
| clarkb | though perhaps they closed the hpcloud side and didn't send the proper fins | 21:53 |
| *** sabeen2 has joined #openstack-infra | 21:53 | |
| *** TravT has joined #openstack-infra | 21:53 | |
| *** sarob has joined #openstack-infra | 21:53 | |
| *** sc68cal has joined #openstack-infra | 21:53 | |
| *** Ryan_Lane has joined #openstack-infra | 21:53 | |
| *** jaypipes has joined #openstack-infra | 21:53 | |
| *** stevemar has joined #openstack-infra | 21:53 | |
| *** plaurin_ has joined #openstack-infra | 21:53 | |
| *** rlandy has joined #openstack-infra | 21:53 | |
| *** adalbas has joined #openstack-infra | 21:53 | |
| *** otherwiseguy has joined #openstack-infra | 21:53 | |
| *** pabelanger has joined #openstack-infra | 21:53 | |
| *** hughsaunders has joined #openstack-infra | 21:53 | |
| *** StevenK has joined #openstack-infra | 21:53 | |
| *** Ng has joined #openstack-infra | 21:53 | |
| *** krtaylor has joined #openstack-infra | 21:53 | |
| *** rm_work has joined #openstack-infra | 21:53 | |
| *** jbryce has joined #openstack-infra | 21:53 | |
| *** dimtruck has joined #openstack-infra | 21:53 | |
| *** russellb has joined #openstack-infra | 21:53 | |
| *** jraim has joined #openstack-infra | 21:53 | |
| *** lbragstad has joined #openstack-infra | 21:53 | |
| *** mgagne has joined #openstack-infra | 21:53 | |
| *** stevebaker has joined #openstack-infra | 21:53 | |
| *** dhellmann has joined #openstack-infra | 21:53 | |
| *** pcaruana has joined #openstack-infra | 21:53 | |
| *** dtantsur|afk has joined #openstack-infra | 21:53 | |
| *** asselin has joined #openstack-infra | 21:53 | |
| *** waynr has joined #openstack-infra | 21:53 | |
| *** mattt has joined #openstack-infra | 21:53 | |
| *** gus has joined #openstack-infra | 21:53 | |
| *** mugsie has joined #openstack-infra | 21:53 | |
| *** dansmith has joined #openstack-infra | 21:53 | |
| *** jamespage has joined #openstack-infra | 21:53 | |
| *** jdandrea has joined #openstack-infra | 21:53 | |
| *** gothicmindfood has joined #openstack-infra | 21:53 | |
| *** anteaya has joined #openstack-infra | 21:53 | |
| *** rakhmerov has joined #openstack-infra | 21:53 | |
| *** devananda has joined #openstack-infra | 21:53 | |
| *** hichtakk has joined #openstack-infra | 21:54 | |
| fungi | clarkb: also i noticed during my dib uploads i got a lot of "WARNING urllib3.connectionpool: HttpConnectionPool is full, discarding connection: region-b.geo-1.images.hpcloudsvc.com" | 21:54 |
| *** dmitryme has quit IRC | 21:54 | |
| *** tchaypo has quit IRC | 21:54 | |
| *** cloudnull has quit IRC | 21:54 | |
| *** JayF has quit IRC | 21:54 | |
| *** zz_gondoi has quit IRC | 21:54 | |
| *** simonmcc has quit IRC | 21:54 | |
| *** kevinbenton has quit IRC | 21:54 | |
| *** dougwig has quit IRC | 21:54 | |
| *** beecee has quit IRC | 21:54 | |
| *** JoshNang has quit IRC | 21:54 | |
| *** Mithrandir has quit IRC | 21:54 | |
| *** timrc has quit IRC | 21:54 | |
| *** Daviey has quit IRC | 21:54 | |
| *** jesusaurus has quit IRC | 21:54 | |
| *** ctlaugh has quit IRC | 21:54 | |
| *** ttx has quit IRC | 21:54 | |
| *** odyssey4me has quit IRC | 21:54 | |
| *** sigmavirus24 has quit IRC | 21:54 | |
| *** dolphm has quit IRC | 21:54 | |
| *** fungi has quit IRC | 21:54 | |
| *** clif_h has quit IRC | 21:54 | |
| *** mancdaz has quit IRC | 21:54 | |
| *** Svedrin has quit IRC | 21:54 | |
| *** jeblair has quit IRC | 21:54 | |
| *** adam_g has quit IRC | 21:54 | |
| *** msuriar has quit IRC | 21:54 | |
| *** d0ugal has quit IRC | 21:54 | |
| *** mordred has quit IRC | 21:54 | |
| *** abramley has quit IRC | 21:54 | |
| *** clarkb has quit IRC | 21:54 | |
| *** morganfainberg has quit IRC | 21:54 | |
| *** hichtakk has quit IRC | 21:54 | |
| *** hichtakk has joined #openstack-infra | 21:54 | |
| *** patrickeast_ has joined #openstack-infra | 21:54 | |
| *** Hefeweiz1n has joined #openstack-infra | 21:54 | |
| *** jkt_ has joined #openstack-infra | 21:54 | |
| *** hichtakk has quit IRC | 21:54 | |
| *** dmitryme has joined #openstack-infra | 21:54 | |
| *** tchaypo has joined #openstack-infra | 21:54 | |
| *** cloudnull has joined #openstack-infra | 21:54 | |
| *** zz_gondoi has joined #openstack-infra | 21:54 | |
| *** JayF has joined #openstack-infra | 21:54 | |
| *** simonmcc has joined #openstack-infra | 21:54 | |
| *** kevinbenton has joined #openstack-infra | 21:54 | |
| *** dougwig has joined #openstack-infra | 21:54 | |
| *** beecee has joined #openstack-infra | 21:54 | |
| *** JoshNang has joined #openstack-infra | 21:54 | |
| *** Mithrandir has joined #openstack-infra | 21:54 | |
| *** timrc has joined #openstack-infra | 21:54 | |
| *** Daviey has joined #openstack-infra | 21:54 | |
| *** jesusaurus has joined #openstack-infra | 21:54 | |
| *** ctlaugh has joined #openstack-infra | 21:54 | |
| *** ttx has joined #openstack-infra | 21:54 | |
| *** odyssey4me has joined #openstack-infra | 21:54 | |
| *** sigmavirus24 has joined #openstack-infra | 21:54 | |
| *** dolphm has joined #openstack-infra | 21:54 | |
| *** fungi has joined #openstack-infra | 21:54 | |
| *** clif_h has joined #openstack-infra | 21:54 | |
| *** mancdaz has joined #openstack-infra | 21:54 | |
| *** Svedrin has joined #openstack-infra | 21:54 | |
| *** jeblair has joined #openstack-infra | 21:54 | |
| *** adam_g has joined #openstack-infra | 21:54 | |
| *** msuriar has joined #openstack-infra | 21:54 | |
| *** d0ugal has joined #openstack-infra | 21:54 | |
| *** mordred has joined #openstack-infra | 21:54 | |
| *** abramley has joined #openstack-infra | 21:54 | |
| *** clarkb has joined #openstack-infra | 21:54 | |
| *** morganfainberg has joined #openstack-infra | 21:54 | |
| *** achanda_ has joined #openstack-infra | 21:54 | |
| *** darvon_ has quit IRC | 21:54 | |
| *** redrobot has quit IRC | 21:54 | |
| *** reed has quit IRC | 21:54 | |
| *** rmcall has quit IRC | 21:54 | |
| *** shayneburgess has quit IRC | 21:54 | |
| *** alivigni has quit IRC | 21:54 | |
| *** skolekonov has quit IRC | 21:54 | |
| *** ZZelle has quit IRC | 21:54 | |
| *** wendar has quit IRC | 21:54 | |
| *** fifieldt__ has quit IRC | 21:54 | |
| *** mika has quit IRC | 21:54 | |
| *** sbadia has quit IRC | 21:55 | |
| *** radez has quit IRC | 21:55 | |
| *** mkoderer has quit IRC | 21:55 | |
| *** andreaf_ has quit IRC | 21:55 | |
| *** Shrews has quit IRC | 21:55 | |
| *** saper has quit IRC | 21:55 | |
| *** flaper87 has quit IRC | 21:55 | |
| *** antonym has quit IRC | 21:55 | |
| *** jgriffith has quit IRC | 21:55 | |
| *** dvorak has quit IRC | 21:55 | |
| *** mikal has quit IRC | 21:55 | |
| *** ondergetekende has quit IRC | 21:55 | |
| *** heyongli has quit IRC | 21:55 | |
| *** charz has quit IRC | 21:55 | |
| *** dhp has quit IRC | 21:55 | |
| *** s0nea has quit IRC | 21:55 | |
| *** crinkle has quit IRC | 21:55 | |
| *** a2hill has quit IRC | 21:55 | |
| *** nibalizer has quit IRC | 21:55 | |
| *** BadCub_ has quit IRC | 21:55 | |
| *** niska has quit IRC | 21:55 | |
| *** zz_naotok has quit IRC | 21:55 | |
| *** hichtakk has joined #openstack-infra | 21:55 | |
| *** hichtakk has quit IRC | 21:55 | |
| *** hichtakk has joined #openstack-infra | 21:55 | |
| *** zz_avozza is now known as avozza | 21:55 | |
| *** achanda has joined #openstack-infra | 21:55 | |
| *** patrickeast has joined #openstack-infra | 21:55 | |
| *** Hefeweizen has joined #openstack-infra | 21:55 | |
| *** changbl has joined #openstack-infra | 21:55 | |
| *** marun has joined #openstack-infra | 21:55 | |
| *** dstufft has joined #openstack-infra | 21:55 | |
| *** openstackgerrit has joined #openstack-infra | 21:55 | |
| *** michchap has joined #openstack-infra | 21:55 | |
| *** praveenkumar_ has joined #openstack-infra | 21:55 | |
| *** erw has joined #openstack-infra | 21:55 | |
| *** wznoinsk has joined #openstack-infra | 21:55 | |
| *** NithyaG has joined #openstack-infra | 21:55 | |
| *** cody-somerville has joined #openstack-infra | 21:55 | |
| *** nikhil_k has joined #openstack-infra | 21:55 | |
| *** mrodden has joined #openstack-infra | 21:55 | |
| *** jkt has joined #openstack-infra | 21:55 | |
| *** jpeeler has joined #openstack-infra | 21:55 | |
| *** dosaboy has joined #openstack-infra | 21:55 | |
| *** asadoughi has joined #openstack-infra | 21:55 | |
| *** wolsen has joined #openstack-infra | 21:55 | |
| *** dkliban_afk has joined #openstack-infra | 21:55 | |
| *** LinuxJedi has joined #openstack-infra | 21:55 | |
| *** hamzy has joined #openstack-infra | 21:55 | |
| *** dguerri_ has joined #openstack-infra | 21:55 | |
| *** gnuoy has joined #openstack-infra | 21:55 | |
| *** tlbr has joined #openstack-infra | 21:55 | |
| *** darvon has joined #openstack-infra | 21:55 | |
| *** mfink_ has joined #openstack-infra | 21:55 | |
| *** spiffxp has joined #openstack-infra | 21:55 | |
| *** Guest20522 has joined #openstack-infra | 21:55 | |
| *** mattymo has joined #openstack-infra | 21:55 | |
| *** darvon has quit IRC | 21:55 | |
| *** dstufft has quit IRC | 21:55 | |
| *** erw has quit IRC | 21:55 | |
| *** dguerri_ has quit IRC | 21:55 | |
| openstackgerrit | Merged openstack-infra/devstack-gate: testr last requires sudo https://review.openstack.org/146666 | 21:55 |
| *** 17WAAWSUB has joined #openstack-infra | 21:55 | |
| *** 17WAAWSUB has quit IRC | 21:55 | |
| *** dstufft_ is now known as dstufft | 21:55 | |
| *** jkt has quit IRC | 21:55 | |
| *** achanda has quit IRC | 21:55 | |
| *** Hefeweizen has quit IRC | 21:55 | |
| *** dguerri has joined #openstack-infra | 21:55 | |
| *** patrickeast has quit IRC | 21:55 | |
| *** patrickeast_ is now known as patrickeast | 21:55 | |
| *** hichtakk has quit IRC | 21:56 | |
| *** hichtakk has joined #openstack-infra | 21:56 | |
| clarkb | fungi: 206.164.176.21 is the host? | 21:57 |
| *** hichtakk has quit IRC | 21:57 | |
| *** redrobot has joined #openstack-infra | 21:57 | |
| *** jswarren has quit IRC | 21:57 | |
| *** naggappan has quit IRC | 21:57 | |
| *** btran has quit IRC | 21:57 | |
| *** ricolin has quit IRC | 21:57 | |
| *** nuritv has quit IRC | 21:57 | |
| *** hichtakk has joined #openstack-infra | 21:57 | |
| *** jswarren has joined #openstack-infra | 21:57 | |
| *** naggappan has joined #openstack-infra | 21:57 | |
| *** btran has joined #openstack-infra | 21:57 | |
| *** ricolin has joined #openstack-infra | 21:57 | |
| *** nuritv has joined #openstack-infra | 21:57 | |
| fungi | clarkb: i think so | 21:57 |
| *** redrobot is now known as Guest8210 | 21:57 | |
| *** hichtakk has quit IRC | 21:57 | |
| *** hichtakk has joined #openstack-infra | 21:58 | |
| fungi | currently looking for any packets at all coming from that ip address | 21:58 |
| *** hichtakk has quit IRC | 21:58 | |
| fungi | we have 5 established connections to it, according to netstat | 21:58 |
| clarkb | I didn't even check direction just host 206.164.176.21 | 21:58 |
| clarkb | and nothing yet | 21:58 |
| ianw | clarkb: so i really think it would be clearer to split out image builds into their own log files rather than having them all mashed into image.log . seems like this could be done with logging.config.dictConfig much easier. ok if we add an option and migrate in that direction? | 21:58 |
| *** hichtakk has joined #openstack-infra | 21:58 | |
| *** hichtakk has quit IRC | 21:58 | |
| fungi | ianw: sounds fine to me | 21:58 |
| clarkb | ianw: I typically prefer one log file | 21:58 |
| ianw | particularly, we can have a callable to determine the output filename | 21:59 |
| clarkb | because then I don't have to merge | 21:59 |
| clarkb | but in this case we shouldn't have to merge often if ever so that is probably fine | 21:59 |
| *** erw has joined #openstack-infra | 21:59 | |
| ianw | clarkb: i'd agree, but for the image builds i don't see any reason to keep them all together | 21:59 |
| *** bswartz has quit IRC | 21:59 | |
| *** hichtakk has joined #openstack-infra | 21:59 | |
| *** darvon has joined #openstack-infra | 21:59 | |
| *** reed has joined #openstack-infra | 21:59 | |
| *** rmcall has joined #openstack-infra | 21:59 | |
| *** shayneburgess has joined #openstack-infra | 21:59 | |
| *** alivigni has joined #openstack-infra | 21:59 | |
| *** skolekonov has joined #openstack-infra | 21:59 | |
| *** ZZelle has joined #openstack-infra | 21:59 | |
| *** wendar has joined #openstack-infra | 21:59 | |
| *** fifieldt__ has joined #openstack-infra | 21:59 | |
| *** mika has joined #openstack-infra | 21:59 | |
| *** sbadia has joined #openstack-infra | 21:59 | |
| *** mkoderer has joined #openstack-infra | 21:59 | |
| *** radez has joined #openstack-infra | 21:59 | |
| *** andreaf_ has joined #openstack-infra | 21:59 | |
| *** Shrews has joined #openstack-infra | 21:59 | |
| *** saper has joined #openstack-infra | 21:59 | |
| *** antonym has joined #openstack-infra | 21:59 | |
| *** flaper87 has joined #openstack-infra | 21:59 | |
| *** jgriffith has joined #openstack-infra | 21:59 | |
| *** dvorak has joined #openstack-infra | 21:59 | |
| *** mikal has joined #openstack-infra | 21:59 | |
| *** ondergetekende has joined #openstack-infra | 21:59 | |
| *** heyongli has joined #openstack-infra | 21:59 | |
| *** charz has joined #openstack-infra | 21:59 | |
| *** dhp has joined #openstack-infra | 21:59 | |
| *** s0nea has joined #openstack-infra | 21:59 | |
| *** crinkle has joined #openstack-infra | 21:59 | |
| *** a2hill has joined #openstack-infra | 21:59 | |
| *** nibalizer has joined #openstack-infra | 21:59 | |
| *** BadCub_ has joined #openstack-infra | 21:59 | |
| *** niska has joined #openstack-infra | 21:59 | |
| *** zz_naotok has joined #openstack-infra | 21:59 | |
| clarkb | fungi: maybe we should try killing those tcp connections? | 21:59 |
| ianw | and also the output sometimes isn't prefixed properly, i think embedded newlines | 21:59 |
| fungi | clarkb: yeah, i'll give that a shot now | 21:59 |
| *** signed8bit is now known as signed8bit_ZZZzz | 22:00 | |
| *** hichtakk_ has joined #openstack-infra | 22:00 | |
| *** hichtakk_ has quit IRC | 22:00 | |
| *** mfink has quit IRC | 22:00 | |
| *** mfink has joined #openstack-infra | 22:01 | |
| dstanek | lifeless: i'm looking at http://docs.openstack.org/developer/pbr/semver.html and i don't see any references to .prerelease is this something we are doing in addition to rfc2119? | 22:01 |
| *** hichtakk has quit IRC | 22:01 | |
| *** sputnik13 has quit IRC | 22:01 | |
| dstanek | lifeless: strike the rfc reference :-) | 22:01 |
| lifeless | heh, was about to say | 22:01 |
| *** hichtakk has joined #openstack-infra | 22:01 | |
| *** apmelton has quit IRC | 22:01 | |
| *** mfink has quit IRC | 22:01 | |
| *** apmelton has joined #openstack-infra | 22:01 | |
| *** hichtakk has quit IRC | 22:01 | |
| *** sdake has quit IRC | 22:01 | |
| lifeless | a/b/c - are prereleases | 22:02 |
| openstackgerrit | Kyle Rockman proposed openstack-infra/jenkins-job-builder: adding support for android emulator https://review.openstack.org/146990 | 22:02 |
| *** hichtakk has joined #openstack-infra | 22:02 | |
| *** ChanServ has quit IRC | 22:02 | |
| *** david-lyle has quit IRC | 22:02 | |
| *** teran__ has quit IRC | 22:02 | |
| *** mattfarina has quit IRC | 22:02 | |
| *** jyuso has quit IRC | 22:02 | |
| *** sweston has quit IRC | 22:02 | |
| *** coolsvap|afk has quit IRC | 22:02 | |
| *** skraynev has quit IRC | 22:02 | |
| *** ianw has quit IRC | 22:02 | |
| *** luqas has quit IRC | 22:02 | |
| *** sressot has quit IRC | 22:02 | |
| *** zaro has quit IRC | 22:02 | |
| *** notmyname has quit IRC | 22:02 | |
| *** vipul has quit IRC | 22:02 | |
| *** dmellado has quit IRC | 22:02 | |
| *** juice has quit IRC | 22:02 | |
| *** greghaynes has quit IRC | 22:02 | |
| *** chmouel has quit IRC | 22:02 | |
| *** toabctl has quit IRC | 22:02 | |
| *** dmsimard has quit IRC | 22:02 | |
| *** bookwar_ has quit IRC | 22:02 | |
| *** jd__ has quit IRC | 22:02 | |
| *** darvon has quit IRC | 22:02 | |
| *** reed has quit IRC | 22:02 | |
| *** rmcall has quit IRC | 22:02 | |
| *** shayneburgess has quit IRC | 22:02 | |
| *** alivigni has quit IRC | 22:02 | |
| *** skolekonov has quit IRC | 22:02 | |
| *** ZZelle has quit IRC | 22:02 | |
| *** wendar has quit IRC | 22:02 | |
| *** fifieldt__ has quit IRC | 22:02 | |
| *** mika has quit IRC | 22:02 | |
| *** sbadia has quit IRC | 22:02 | |
| *** radez has quit IRC | 22:02 | |
| *** mkoderer has quit IRC | 22:02 | |
| *** andreaf_ has quit IRC | 22:02 | |
| *** Shrews has quit IRC | 22:02 | |
| *** saper has quit IRC | 22:02 | |
| *** flaper87 has quit IRC | 22:02 | |
| *** antonym has quit IRC | 22:02 | |
| *** jgriffith has quit IRC | 22:02 | |
| *** dvorak has quit IRC | 22:02 | |
| *** mikal has quit IRC | 22:02 | |
| *** ondergetekende has quit IRC | 22:02 | |
| *** heyongli has quit IRC | 22:02 | |
| *** charz has quit IRC | 22:02 | |
| *** dhp has quit IRC | 22:02 | |
| *** s0nea has quit IRC | 22:02 | |
| *** crinkle has quit IRC | 22:02 | |
| *** a2hill has quit IRC | 22:02 | |
| *** nibalizer has quit IRC | 22:02 | |
| *** BadCub_ has quit IRC | 22:02 | |
| *** niska has quit IRC | 22:02 | |
| *** zz_naotok has quit IRC | 22:02 | |
| *** jswarren has quit IRC | 22:02 | |
| *** naggappan has quit IRC | 22:02 | |
| *** btran has quit IRC | 22:02 | |
| *** ricolin has quit IRC | 22:02 | |
| *** nuritv has quit IRC | 22:02 | |
| *** dmitryme has quit IRC | 22:02 | |
| *** tchaypo has quit IRC | 22:02 | |
| *** cloudnull has quit IRC | 22:02 | |
| *** JayF has quit IRC | 22:02 | |
| *** zz_gondoi has quit IRC | 22:02 | |
| *** simonmcc has quit IRC | 22:02 | |
| *** kevinbenton has quit IRC | 22:02 | |
| *** dougwig has quit IRC | 22:02 | |
| *** beecee has quit IRC | 22:02 | |
| *** JoshNang has quit IRC | 22:02 | |
| *** Mithrandir has quit IRC | 22:02 | |
| *** timrc has quit IRC | 22:02 | |
| *** Daviey has quit IRC | 22:02 | |
| *** jesusaurus has quit IRC | 22:02 | |
| *** ctlaugh has quit IRC | 22:02 | |
| *** ttx has quit IRC | 22:02 | |
| *** odyssey4me has quit IRC | 22:02 | |
| *** sigmavirus24 has quit IRC | 22:02 | |
| *** dolphm has quit IRC | 22:02 | |
| *** fungi has quit IRC | 22:02 | |
| *** clif_h has quit IRC | 22:02 | |
| *** mancdaz has quit IRC | 22:03 | |
| *** Svedrin has quit IRC | 22:03 | |
| *** jeblair has quit IRC | 22:03 | |
| *** adam_g has quit IRC | 22:03 | |
| *** msuriar has quit IRC | 22:03 | |
| *** d0ugal has quit IRC | 22:03 | |
| *** mordred has quit IRC | 22:03 | |
| *** abramley has quit IRC | 22:03 | |
| *** clarkb has quit IRC | 22:03 | |
| *** morganfainberg has quit IRC | 22:03 | |
| *** sabeen2 has quit IRC | 22:03 | |
| *** TravT has quit IRC | 22:03 | |
| *** sarob has quit IRC | 22:03 | |
| *** sc68cal has quit IRC | 22:03 | |
| *** Ryan_Lane has quit IRC | 22:03 | |
| *** jaypipes has quit IRC | 22:03 | |
| *** stevemar has quit IRC | 22:03 | |
| *** plaurin_ has quit IRC | 22:03 | |
| *** rlandy has quit IRC | 22:03 | |
| *** adalbas has quit IRC | 22:03 | |
| *** otherwiseguy has quit IRC | 22:03 | |
| *** pabelanger has quit IRC | 22:03 | |
| *** hughsaunders has quit IRC | 22:03 | |
| *** StevenK has quit IRC | 22:03 | |
| *** Ng has quit IRC | 22:03 | |
| *** krtaylor has quit IRC | 22:03 | |
| *** jbryce has quit IRC | 22:03 | |
| *** lbragstad has quit IRC | 22:03 | |
| *** rm_work has quit IRC | 22:03 | |
| *** mgagne has quit IRC | 22:03 | |
| *** jraim has quit IRC | 22:03 | |
| *** russellb has quit IRC | 22:03 | |
| *** dimtruck has quit IRC | 22:03 | |
| *** stevebaker has quit IRC | 22:03 | |
| *** dhellmann has quit IRC | 22:03 | |
| *** pcaruana has quit IRC | 22:03 | |
| *** dtantsur|afk has quit IRC | 22:03 | |
| *** asselin has quit IRC | 22:03 | |
| *** waynr has quit IRC | 22:03 | |
| *** mattt has quit IRC | 22:03 | |
| *** gus has quit IRC | 22:03 | |
| *** mugsie has quit IRC | 22:03 | |
| *** dansmith has quit IRC | 22:03 | |
| *** jdandrea has quit IRC | 22:03 | |
| *** gothicmindfood has quit IRC | 22:03 | |
| *** anteaya has quit IRC | 22:03 | |
| *** jamespage has quit IRC | 22:03 | |
| *** rakhmerov has quit IRC | 22:03 | |
| *** devananda has quit IRC | 22:03 | |
| *** dguerri has quit IRC | 22:03 | |
| *** changbl has quit IRC | 22:03 | |
| *** marun has quit IRC | 22:03 | |
| *** openstackgerrit has quit IRC | 22:03 | |
| *** michchap has quit IRC | 22:03 | |
| *** praveenkumar_ has quit IRC | 22:03 | |
| *** wznoinsk has quit IRC | 22:03 | |
| *** NithyaG has quit IRC | 22:03 | |
| *** cody-somerville has quit IRC | 22:03 | |
| *** nikhil_k has quit IRC | 22:03 | |
| *** mrodden has quit IRC | 22:03 | |
| *** jpeeler has quit IRC | 22:03 | |
| *** dosaboy has quit IRC | 22:03 | |
| *** asadoughi has quit IRC | 22:03 | |
| *** wolsen has quit IRC | 22:03 | |
| *** dkliban_afk has quit IRC | 22:03 | |
| *** LinuxJedi has quit IRC | 22:03 | |
| *** hamzy has quit IRC | 22:03 | |
| *** gnuoy has quit IRC | 22:03 | |
| *** tlbr has quit IRC | 22:03 | |
| *** mfink_ has quit IRC | 22:03 | |
| *** spiffxp has quit IRC | 22:03 | |
| *** Guest20522 has quit IRC | 22:03 | |
| *** mattymo has quit IRC | 22:03 | |
| *** ildikov has quit IRC | 22:03 | |
| *** tnurlygayanov_ has quit IRC | 22:03 | |
| *** zz_johnthetubagu has quit IRC | 22:03 | |
| *** Guest8210 has quit IRC | 22:03 | |
| *** patrickeast has quit IRC | 22:03 | |
| *** markmcclain has quit IRC | 22:03 | |
| *** rkukura has quit IRC | 22:03 | |
| *** ociuhandu has quit IRC | 22:03 | |
| *** eharney has quit IRC | 22:03 | |
| *** rwsu has quit IRC | 22:03 | |
| *** dkranz has quit IRC | 22:03 | |
| *** esmute has quit IRC | 22:03 | |
| *** marcusvrn1 has quit IRC | 22:03 | |
| *** mestery has quit IRC | 22:03 | |
| *** enikanorov has quit IRC | 22:03 | |
| *** avozza has quit IRC | 22:03 | |
| *** mjturek has quit IRC | 22:03 | |
| *** vhoward has quit IRC | 22:03 | |
| *** viglesia1 has quit IRC | 22:03 | |
| *** jgrimm has quit IRC | 22:03 | |
| *** jklare has quit IRC | 22:03 | |
| *** tristanC has quit IRC | 22:03 | |
| *** xianghui has quit IRC | 22:03 | |
| *** enikanorov__ has quit IRC | 22:03 | |
| *** spiffxp_ has quit IRC | 22:03 | |
| *** cinerama has quit IRC | 22:03 | |
| *** dstufft has quit IRC | 22:03 | |
| *** isviridov_away has quit IRC | 22:03 | |
| *** achanda_ has quit IRC | 22:04 | |
| *** bhunter71 has quit IRC | 22:04 | |
| *** emagana has quit IRC | 22:04 | |
| *** dustins has quit IRC | 22:04 | |
| *** julim has quit IRC | 22:04 | |
| *** mwagner_lap has quit IRC | 22:04 | |
| *** sabari has quit IRC | 22:04 | |
| *** samueldmq has quit IRC | 22:04 | |
| *** zul has quit IRC | 22:04 | |
| *** bnemec has quit IRC | 22:04 | |
| *** tsufiev has quit IRC | 22:04 | |
| *** phschwartz has quit IRC | 22:04 | |
| *** gaelL has quit IRC | 22:04 | |
| *** med_ has quit IRC | 22:04 | |
| *** krotscheck has quit IRC | 22:04 | |
| *** gema has quit IRC | 22:04 | |
| *** gpocentek has quit IRC | 22:04 | |
| *** Vivek has quit IRC | 22:04 | |
| *** igorbelikov has quit IRC | 22:04 | |
| *** therve has quit IRC | 22:04 | |
| *** ekarlso- has quit IRC | 22:04 | |
| *** cburgess has quit IRC | 22:04 | |
| *** DinaBelova has quit IRC | 22:04 | |
| *** jcooley has quit IRC | 22:04 | |
| *** leifmadsen has quit IRC | 22:04 | |
| *** timfreund has quit IRC | 22:04 | |
| *** jogo has quit IRC | 22:04 | |
| *** grantbow has quit IRC | 22:04 | |
| *** niedbalski has quit IRC | 22:04 | |
| *** imcsk8 has quit IRC | 22:04 | |
| *** ayoung has quit IRC | 22:04 | |
| *** armax has quit IRC | 22:04 | |
| *** yjiang5 has quit IRC | 22:04 | |
| *** redixin has quit IRC | 22:04 | |
| *** nijaba has quit IRC | 22:04 | |
| *** Clint has quit IRC | 22:04 | |
| *** psedlak has quit IRC | 22:04 | |
| *** shardy has quit IRC | 22:04 | |
| *** dstanek has quit IRC | 22:04 | |
| *** Hefeweiz1n has quit IRC | 22:04 | |
| *** andreaf has quit IRC | 22:04 | |
| *** fandi has quit IRC | 22:04 | |
| *** hashar has quit IRC | 22:04 | |
| *** thingee has quit IRC | 22:04 | |
| *** jcoufal has quit IRC | 22:04 | |
| *** kashyap has quit IRC | 22:04 | |
| *** camunoz has quit IRC | 22:04 | |
| *** harlowja has quit IRC | 22:04 | |
| *** sandywalsh has quit IRC | 22:04 | |
| *** vponomaryov has quit IRC | 22:04 | |
| *** mase_home has quit IRC | 22:04 | |
| *** SotK has quit IRC | 22:04 | |
| *** mfisch has quit IRC | 22:04 | |
| *** Mmike has quit IRC | 22:04 | |
| *** fabo has quit IRC | 22:04 | |
| *** mwhudson has quit IRC | 22:04 | |
| *** tteggel has quit IRC | 22:04 | |
| *** alaski has quit IRC | 22:04 | |
| *** rodrigods has quit IRC | 22:04 | |
| *** lifeless has quit IRC | 22:04 | |
| *** uvirtbot has quit IRC | 22:04 | |
| *** annegentle_ has quit IRC | 22:04 | |
| *** kmartin has quit IRC | 22:04 | |
| *** e0ne has quit IRC | 22:04 | |
| *** gyee has quit IRC | 22:04 | |
| *** doude has quit IRC | 22:04 | |
| *** ivar-lazzaro has quit IRC | 22:04 | |
| *** romcheg has quit IRC | 22:04 | |
| *** ZZelle_ has quit IRC | 22:04 | |
| *** pcrews has quit IRC | 22:04 | |
| *** alazarev has quit IRC | 22:04 | |
| *** SergeyLukjanov has quit IRC | 22:04 | |
| *** _buzz has quit IRC | 22:04 | |
| *** morgabra has quit IRC | 22:04 | |
| *** dkehn has quit IRC | 22:04 | |
| *** zxiiro has quit IRC | 22:04 | |
| *** paul-- has quit IRC | 22:05 | |
| *** jhesketh has quit IRC | 22:05 | |
| *** erw has quit IRC | 22:05 | |
| *** HenryG has quit IRC | 22:05 | |
| *** dims__ has quit IRC | 22:05 | |
| *** salv-orlando has quit IRC | 22:05 | |
| *** dannywilson has quit IRC | 22:05 | |
| *** hdd has quit IRC | 22:05 | |
| *** yamahata has quit IRC | 22:05 | |
| *** ronis has quit IRC | 22:05 | |
| *** erikmwilson has quit IRC | 22:05 | |
| *** arielb has quit IRC | 22:05 | |
| *** kgiusti has quit IRC | 22:05 | |
| *** mbacchi has quit IRC | 22:05 | |
| *** HeOS has quit IRC | 22:05 | |
| *** funzo_ has quit IRC | 22:05 | |
| *** slagle has quit IRC | 22:05 | |
| *** yolanda has quit IRC | 22:05 | |
| *** TheJulia has quit IRC | 22:05 | |
| *** smoser has quit IRC | 22:05 | |
| *** Kiall has quit IRC | 22:05 | |
| *** NobodyCam has quit IRC | 22:05 | |
| *** kragniz has quit IRC | 22:05 | |
| *** markvan has quit IRC | 22:05 | |
| *** tcammann has quit IRC | 22:05 | |
| *** davidlenwell has quit IRC | 22:05 | |
| *** SlickNik has quit IRC | 22:05 | |
| *** pleia2 has quit IRC | 22:05 | |
| *** HeOS_ has quit IRC | 22:05 | |
| *** mtreinish has quit IRC | 22:05 | |
| *** vladan has quit IRC | 22:05 | |
| *** bogdando has quit IRC | 22:05 | |
| *** maurosr has quit IRC | 22:05 | |
| *** BobBall has quit IRC | 22:05 | |
| *** dteselkin has quit IRC | 22:05 | |
| *** ruhe has quit IRC | 22:05 | |
| *** Apsu has quit IRC | 22:05 | |
| *** amrith has quit IRC | 22:05 | |
| *** eikke has quit IRC | 22:05 | |
| *** SpamapS has quit IRC | 22:05 | |
| *** EntropyWorks has quit IRC | 22:05 | |
| *** hichtakk has quit IRC | 22:05 | |
| *** ddieterly has quit IRC | 22:05 | |
| *** ChuckC has quit IRC | 22:05 | |
| *** xyang0 has quit IRC | 22:05 | |
| *** weshay has quit IRC | 22:05 | |
| *** afazekas has quit IRC | 22:05 | |
| *** bknudson has quit IRC | 22:05 | |
| *** pfallenop has quit IRC | 22:05 | |
| *** bodepd has quit IRC | 22:05 | |
| *** bhuvan has quit IRC | 22:05 | |
| *** wenlock has quit IRC | 22:05 | |
| *** mriedem has quit IRC | 22:05 | |
| *** sdague has quit IRC | 22:05 | |
| *** briancline has quit IRC | 22:05 | |
| *** hogepodge has quit IRC | 22:05 | |
| *** MaxV has quit IRC | 22:05 | |
| *** sdake has joined #openstack-infra | 22:05 | |
| *** sdake has quit IRC | 22:05 | |
| *** ashp has quit IRC | 22:05 | |
| *** Longgeek has quit IRC | 22:05 | |
| *** signed8bit_ZZZzz has quit IRC | 22:05 | |
| *** d34dh0r53 has quit IRC | 22:05 | |
| *** Sukhdev has joined #openstack-infra | 22:05 | |
| *** ashp has joined #openstack-infra | 22:06 | |
| *** d34dh0r53 has joined #openstack-infra | 22:06 | |
| *** Masahiro has joined #openstack-infra | 22:07 | |
| *** sdake has joined #openstack-infra | 22:07 | |
| *** sputnik13 has joined #openstack-infra | 22:07 | |
| *** zz_naotok has joined #openstack-infra | 22:07 | |
| *** niska has joined #openstack-infra | 22:07 | |
| *** BadCub_ has joined #openstack-infra | 22:07 | |
| *** nibalizer has joined #openstack-infra | 22:07 | |
| *** a2hill has joined #openstack-infra | 22:07 | |
| *** crinkle has joined #openstack-infra | 22:07 | |
| *** s0nea has joined #openstack-infra | 22:07 | |
| *** dhp has joined #openstack-infra | 22:07 | |
| *** charz has joined #openstack-infra | 22:07 | |
| *** heyongli has joined #openstack-infra | 22:07 | |
| *** ondergetekende has joined #openstack-infra | 22:07 | |
| *** mikal has joined #openstack-infra | 22:07 | |
| *** dvorak has joined #openstack-infra | 22:07 | |
| *** jgriffith has joined #openstack-infra | 22:07 | |
| *** flaper87 has joined #openstack-infra | 22:07 | |
| *** antonym has joined #openstack-infra | 22:07 | |
| *** saper has joined #openstack-infra | 22:07 | |
| *** Shrews has joined #openstack-infra | 22:07 | |
| *** andreaf_ has joined #openstack-infra | 22:07 | |
| *** radez_g0n3 has joined #openstack-infra | 22:07 | |
| *** mkoderer has joined #openstack-infra | 22:07 | |
| *** sbadia has joined #openstack-infra | 22:07 | |
| *** mika has joined #openstack-infra | 22:07 | |
| *** fifieldt__ has joined #openstack-infra | 22:07 | |
| *** wendar has joined #openstack-infra | 22:07 | |
| *** ZZelle has joined #openstack-infra | 22:07 | |
| *** skolekonov has joined #openstack-infra | 22:07 | |
| *** alivigni has joined #openstack-infra | 22:07 | |
| *** shayneburgess has joined #openstack-infra | 22:07 | |
| *** rmcall has joined #openstack-infra | 22:07 | |
| *** reed has joined #openstack-infra | 22:07 | |
| *** darvon has joined #openstack-infra | 22:07 | |
| *** erw has joined #openstack-infra | 22:07 | |
| *** nuritv has joined #openstack-infra | 22:07 | |
| *** ricolin has joined #openstack-infra | 22:07 | |
| *** btran has joined #openstack-infra | 22:07 | |
| *** naggappan has joined #openstack-infra | 22:07 | |
| *** jswarren has joined #openstack-infra | 22:07 | |
| *** Guest8210 has joined #openstack-infra | 22:07 | |
| *** dguerri has joined #openstack-infra | 22:07 | |
| *** mattymo has joined #openstack-infra | 22:07 | |
| *** Guest20522 has joined #openstack-infra | 22:07 | |
| *** spiffxp has joined #openstack-infra | 22:07 | |
| *** mfink_ has joined #openstack-infra | 22:07 | |
| *** tlbr has joined #openstack-infra | 22:07 | |
| *** gnuoy has joined #openstack-infra | 22:07 | |
| *** hamzy has joined #openstack-infra | 22:07 | |
| *** LinuxJedi has joined #openstack-infra | 22:07 | |
| *** dkliban_afk has joined #openstack-infra | 22:07 | |
| *** wolsen has joined #openstack-infra | 22:07 | |
| *** asadoughi has joined #openstack-infra | 22:07 | |
| *** dosaboy has joined #openstack-infra | 22:07 | |
| *** jpeeler has joined #openstack-infra | 22:07 | |
| *** mrodden has joined #openstack-infra | 22:07 | |
| *** nikhil_k has joined #openstack-infra | 22:07 | |
| *** cody-somerville has joined #openstack-infra | 22:07 | |
| *** NithyaG has joined #openstack-infra | 22:07 | |
| *** wznoinsk has joined #openstack-infra | 22:07 | |
| *** praveenkumar_ has joined #openstack-infra | 22:07 | |
| *** michchap has joined #openstack-infra | 22:07 | |
| *** openstackgerrit has joined #openstack-infra | 22:07 | |
| *** marun has joined #openstack-infra | 22:07 | |
| *** changbl has joined #openstack-infra | 22:07 | |
| *** achanda_ has joined #openstack-infra | 22:07 | |
| *** morganfainberg has joined #openstack-infra | 22:07 | |
| *** clarkb has joined #openstack-infra | 22:07 | |
| *** abramley has joined #openstack-infra | 22:07 | |
| *** mordred has joined #openstack-infra | 22:07 | |
| *** d0ugal has joined #openstack-infra | 22:07 | |
| *** msuriar has joined #openstack-infra | 22:07 | |
| *** adam_g has joined #openstack-infra | 22:07 | |
| *** jeblair has joined #openstack-infra | 22:07 | |
| *** Svedrin has joined #openstack-infra | 22:07 | |
| *** mancdaz has joined #openstack-infra | 22:07 | |
| *** clif_h has joined #openstack-infra | 22:07 | |
| *** fungi has joined #openstack-infra | 22:07 | |
| *** dolphm has joined #openstack-infra | 22:07 | |
| *** sigmavirus24 has joined #openstack-infra | 22:07 | |
| *** odyssey4me has joined #openstack-infra | 22:07 | |
| *** ttx has joined #openstack-infra | 22:07 | |
| *** ctlaugh has joined #openstack-infra | 22:07 | |
| *** jesusaurus has joined #openstack-infra | 22:07 | |
| *** Daviey has joined #openstack-infra | 22:07 | |
| *** timrc has joined #openstack-infra | 22:07 | |
| *** Mithrandir has joined #openstack-infra | 22:07 | |
| *** JoshNang has joined #openstack-infra | 22:07 | |
| *** beecee has joined #openstack-infra | 22:07 | |
| *** dougwig has joined #openstack-infra | 22:07 | |
| *** kevinbenton has joined #openstack-infra | 22:07 | |
| *** simonmcc has joined #openstack-infra | 22:07 | |
| *** JayF has joined #openstack-infra | 22:07 | |
| *** zz_gondoi has joined #openstack-infra | 22:07 | |
| *** cloudnull has joined #openstack-infra | 22:07 | |
| *** tchaypo has joined #openstack-infra | 22:07 | |
| *** dmitryme has joined #openstack-infra | 22:07 | |
| *** Hefeweiz1n has joined #openstack-infra | 22:07 | |
| *** patrickeast has joined #openstack-infra | 22:07 | |
| *** devananda has joined #openstack-infra | 22:07 | |
| *** rakhmerov has joined #openstack-infra | 22:07 | |
| *** anteaya has joined #openstack-infra | 22:07 | |
| *** gothicmindfood has joined #openstack-infra | 22:07 | |
| *** jdandrea has joined #openstack-infra | 22:07 | |
| *** jamespage has joined #openstack-infra | 22:07 | |
| *** dansmith has joined #openstack-infra | 22:07 | |
| *** mugsie has joined #openstack-infra | 22:07 | |
| *** gus has joined #openstack-infra | 22:07 | |
| *** mattt has joined #openstack-infra | 22:07 | |
| *** waynr has joined #openstack-infra | 22:07 | |
| *** asselin has joined #openstack-infra | 22:07 | |
| *** dtantsur|afk has joined #openstack-infra | 22:07 | |
| *** pcaruana has joined #openstack-infra | 22:07 | |
| *** dhellmann has joined #openstack-infra | 22:07 | |
| *** stevebaker has joined #openstack-infra | 22:07 | |
| *** mgagne has joined #openstack-infra | 22:07 | |
| *** lbragstad has joined #openstack-infra | 22:07 | |
| *** jraim has joined #openstack-infra | 22:07 | |
| *** russellb has joined #openstack-infra | 22:07 | |
| *** dimtruck has joined #openstack-infra | 22:07 | |
| *** jbryce has joined #openstack-infra | 22:07 | |
| *** rm_work has joined #openstack-infra | 22:07 | |
| *** krtaylor has joined #openstack-infra | 22:07 | |
| *** Ng has joined #openstack-infra | 22:07 | |
| *** StevenK has joined #openstack-infra | 22:07 | |
| *** hughsaunders has joined #openstack-infra | 22:07 | |
| *** pabelanger has joined #openstack-infra | 22:07 | |
| *** otherwiseguy has joined #openstack-infra | 22:07 | |
| *** adalbas has joined #openstack-infra | 22:07 | |
| *** rlandy has joined #openstack-infra | 22:07 | |
| *** plaurin_ has joined #openstack-infra | 22:07 | |
| *** stevemar has joined #openstack-infra | 22:07 | |
| *** jaypipes has joined #openstack-infra | 22:07 | |
| *** Ryan_Lane has joined #openstack-infra | 22:07 | |
| *** sc68cal has joined #openstack-infra | 22:07 | |
| *** sarob has joined #openstack-infra | 22:07 | |
| *** TravT has joined #openstack-infra | 22:07 | |
| *** sabeen2 has joined #openstack-infra | 22:07 | |
| *** dstufft has joined #openstack-infra | 22:07 | |
| *** andreaf has joined #openstack-infra | 22:07 | |
| *** tnurlygayanov_ has joined #openstack-infra | 22:07 | |
| *** ildikov has joined #openstack-infra | 22:07 | |
| *** david-lyle has joined #openstack-infra | 22:07 | |
| *** zz_johnthetubagu has joined #openstack-infra | 22:07 | |
| *** cinerama has joined #openstack-infra | 22:07 | |
| *** spiffxp_ has joined #openstack-infra | 22:07 | |
| *** enikanorov__ has joined #openstack-infra | 22:07 | |
| *** xianghui has joined #openstack-infra | 22:07 | |
| *** tristanC has joined #openstack-infra | 22:07 | |
| *** jklare has joined #openstack-infra | 22:07 | |
| *** jgrimm has joined #openstack-infra | 22:07 | |
| *** viglesia1 has joined #openstack-infra | 22:07 | |
| *** vhoward has joined #openstack-infra | 22:07 | |
| *** mjturek has joined #openstack-infra | 22:07 | |
| *** avozza has joined #openstack-infra | 22:07 | |
| *** enikanorov has joined #openstack-infra | 22:07 | |
| *** mestery has joined #openstack-infra | 22:07 | |
| *** marcusvrn1 has joined #openstack-infra | 22:07 | |
| *** esmute has joined #openstack-infra | 22:07 | |
| *** dkranz has joined #openstack-infra | 22:07 | |
| *** rwsu has joined #openstack-infra | 22:07 | |
| *** eharney has joined #openstack-infra | 22:07 | |
| *** ociuhandu has joined #openstack-infra | 22:07 | |
| *** rkukura has joined #openstack-infra | 22:07 | |
| *** markmcclain has joined #openstack-infra | 22:07 | |
| *** isviridov_away has joined #openstack-infra | 22:07 | |
| *** niedbalski has joined #openstack-infra | 22:07 | |
| *** grantbow has joined #openstack-infra | 22:07 | |
| *** jogo has joined #openstack-infra | 22:07 | |
| *** timfreund has joined #openstack-infra | 22:07 | |
| *** leifmadsen has joined #openstack-infra | 22:07 | |
| *** jcooley has joined #openstack-infra | 22:07 | |
| *** DinaBelova has joined #openstack-infra | 22:07 | |
| *** ekarlso- has joined #openstack-infra | 22:07 | |
| *** therve has joined #openstack-infra | 22:07 | |
| *** cburgess has joined #openstack-infra | 22:07 | |
| *** igorbelikov has joined #openstack-infra | 22:07 | |
| *** Vivek has joined #openstack-infra | 22:07 | |
| *** gpocentek has joined #openstack-infra | 22:07 | |
| *** gema has joined #openstack-infra | 22:07 | |
| *** krotscheck has joined #openstack-infra | 22:07 | |
| *** med_ has joined #openstack-infra | 22:07 | |
| *** gaelL has joined #openstack-infra | 22:07 | |
| *** phschwartz has joined #openstack-infra | 22:07 | |
| *** tsufiev has joined #openstack-infra | 22:07 | |
| *** bnemec has joined #openstack-infra | 22:07 | |
| *** zul has joined #openstack-infra | 22:07 | |
| *** sabari has joined #openstack-infra | 22:07 | |
| *** mwagner_lap has joined #openstack-infra | 22:07 | |
| *** julim has joined #openstack-infra | 22:07 | |
| *** dustins has joined #openstack-infra | 22:07 | |
| *** emagana has joined #openstack-infra | 22:07 | |
| *** samueldmq has joined #openstack-infra | 22:07 | |
| *** bhunter71 has joined #openstack-infra | 22:07 | |
| *** HenryG has joined #openstack-infra | 22:07 | |
| *** dstanek has joined #openstack-infra | 22:07 | |
| *** shardy has joined #openstack-infra | 22:07 | |
| *** psedlak has joined #openstack-infra | 22:07 | |
| *** Clint has joined #openstack-infra | 22:07 | |
| *** nijaba has joined #openstack-infra | 22:07 | |
| *** redixin has joined #openstack-infra | 22:07 | |
| *** yjiang5 has joined #openstack-infra | 22:07 | |
| *** armax has joined #openstack-infra | 22:07 | |
| *** ayoung has joined #openstack-infra | 22:07 | |
| *** imcsk8 has joined #openstack-infra | 22:07 | |
| *** fandi has joined #openstack-infra | 22:07 | |
| *** hashar has joined #openstack-infra | 22:07 | |
| *** hogepodge has joined #openstack-infra | 22:07 | |
| *** briancline has joined #openstack-infra | 22:07 | |
| *** sdague has joined #openstack-infra | 22:07 | |
| *** bodepd has joined #openstack-infra | 22:07 | |
| *** pfallenop has joined #openstack-infra | 22:07 | |
| *** bknudson has joined #openstack-infra | 22:07 | |
| *** afazekas has joined #openstack-infra | 22:07 | |
| *** weshay has joined #openstack-infra | 22:07 | |
| *** mriedem has joined #openstack-infra | 22:07 | |
| *** wenlock has joined #openstack-infra | 22:07 | |
| *** ChuckC has joined #openstack-infra | 22:07 | |
| *** bhuvan has joined #openstack-infra | 22:07 | |
| *** ddieterly has joined #openstack-infra | 22:07 | |
| *** dims__ has joined #openstack-infra | 22:07 | |
| *** kmartin has joined #openstack-infra | 22:07 | |
| *** e0ne has joined #openstack-infra | 22:07 | |
| *** gyee has joined #openstack-infra | 22:07 | |
| *** salv-orlando has joined #openstack-infra | 22:07 | |
| *** doude has joined #openstack-infra | 22:07 | |
| *** ivar-lazzaro has joined #openstack-infra | 22:07 | |
| *** dannywilson has joined #openstack-infra | 22:07 | |
| *** thingee has joined #openstack-infra | 22:07 | |
| *** hdd has joined #openstack-infra | 22:07 | |
| *** yamahata has joined #openstack-infra | 22:07 | |
| *** romcheg has joined #openstack-infra | 22:07 | |
| *** ZZelle_ has joined #openstack-infra | 22:07 | |
| *** jcoufal has joined #openstack-infra | 22:07 | |
| *** erikmwilson has joined #openstack-infra | 22:07 | |
| *** pcrews has joined #openstack-infra | 22:07 | |
| *** arielb has joined #openstack-infra | 22:07 | |
| *** alazarev has joined #openstack-infra | 22:07 | |
| *** SergeyLukjanov has joined #openstack-infra | 22:07 | |
| *** kgiusti has joined #openstack-infra | 22:07 | |
| *** mbacchi has joined #openstack-infra | 22:07 | |
| *** HeOS has joined #openstack-infra | 22:07 | |
| *** funzo_ has joined #openstack-infra | 22:07 | |
| *** kashyap has joined #openstack-infra | 22:07 | |
| *** _buzz has joined #openstack-infra | 22:07 | |
| *** camunoz has joined #openstack-infra | 22:07 | |
| *** morgabra has joined #openstack-infra | 22:07 | |
| *** harlowja has joined #openstack-infra | 22:07 | |
| *** slagle has joined #openstack-infra | 22:07 | |
| *** sandywalsh has joined #openstack-infra | 22:07 | |
| *** dkehn has joined #openstack-infra | 22:07 | |
| *** vponomaryov has joined #openstack-infra | 22:07 | |
| *** yolanda has joined #openstack-infra | 22:07 | |
| *** paul-- has joined #openstack-infra | 22:07 | |
| *** mase_home has joined #openstack-infra | 22:07 | |
| *** SotK has joined #openstack-infra | 22:07 | |
| *** amrith has joined #openstack-infra | 22:07 | |
| *** TheJulia has joined #openstack-infra | 22:07 | |
| *** zxiiro has joined #openstack-infra | 22:07 | |
| *** smoser has joined #openstack-infra | 22:07 | |
| *** Kiall has joined #openstack-infra | 22:07 | |
| *** mfisch has joined #openstack-infra | 22:07 | |
| *** Mmike has joined #openstack-infra | 22:07 | |
| *** NobodyCam has joined #openstack-infra | 22:07 | |
| *** mwhudson has joined #openstack-infra | 22:07 | |
| *** fabo has joined #openstack-infra | 22:07 | |
| *** kragniz has joined #openstack-infra | 22:07 | |
| *** markvan has joined #openstack-infra | 22:07 | |
| *** tcammann has joined #openstack-infra | 22:07 | |
| *** davidlenwell has joined #openstack-infra | 22:07 | |
| *** tteggel has joined #openstack-infra | 22:07 | |
| *** SlickNik has joined #openstack-infra | 22:07 | |
| *** pleia2 has joined #openstack-infra | 22:07 | |
| *** HeOS_ has joined #openstack-infra | 22:07 | |
| *** mtreinish has joined #openstack-infra | 22:07 | |
| *** vladan has joined #openstack-infra | 22:07 | |
| *** alaski has joined #openstack-infra | 22:07 | |
| *** bogdando has joined #openstack-infra | 22:07 | |
| *** rodrigods has joined #openstack-infra | 22:07 | |
| *** lifeless has joined #openstack-infra | 22:07 | |
| *** uvirtbot has joined #openstack-infra | 22:07 | |
| *** annegentle_ has joined #openstack-infra | 22:07 | |
| *** jhesketh has joined #openstack-infra | 22:07 | |
| *** SpamapS has joined #openstack-infra | 22:07 | |
| *** EntropyWorks has joined #openstack-infra | 22:07 | |
| *** Apsu has joined #openstack-infra | 22:07 | |
| *** ruhe has joined #openstack-infra | 22:07 | |
| *** dteselkin has joined #openstack-infra | 22:07 | |
| *** BobBall has joined #openstack-infra | 22:07 | |
| *** maurosr has joined #openstack-infra | 22:07 | |
| *** eikke has joined #openstack-infra | 22:07 | |
| *** teran__ has joined #openstack-infra | 22:07 | |
| *** mattfarina has joined #openstack-infra | 22:07 | |
| *** jyuso has joined #openstack-infra | 22:07 | |
| *** sweston has joined #openstack-infra | 22:07 | |
| *** coolsvap|afk has joined #openstack-infra | 22:07 | |
| *** skraynev has joined #openstack-infra | 22:07 | |
| *** ianw has joined #openstack-infra | 22:07 | |
| *** luqas has joined #openstack-infra | 22:07 | |
| *** sressot has joined #openstack-infra | 22:07 | |
| *** zaro has joined #openstack-infra | 22:07 | |
| *** notmyname has joined #openstack-infra | 22:07 | |
| *** vipul has joined #openstack-infra | 22:07 | |
| *** dmellado has joined #openstack-infra | 22:07 | |
| *** juice has joined #openstack-infra | 22:07 | |
| *** greghaynes has joined #openstack-infra | 22:07 | |
| *** chmouel has joined #openstack-infra | 22:07 | |
| *** ChanServ has joined #openstack-infra | 22:07 | |
| *** toabctl has joined #openstack-infra | 22:07 | |
| *** dmsimard has joined #openstack-infra | 22:07 | |
| *** bookwar_ has joined #openstack-infra | 22:07 | |
| *** jd__ has joined #openstack-infra | 22:07 | |
| *** sendak.freenode.net sets mode: +o ChanServ | 22:07 | |
| *** erikwilson has quit IRC | 22:07 | |
| *** signed8bit has joined #openstack-infra | 22:07 | |
| *** booly-yam has joined #openstack-infra | 22:07 | |
| *** hichtakk has joined #openstack-infra | 22:07 | |
| *** hichtakk has quit IRC | 22:07 | |
| *** med_ has quit IRC | 22:07 | |
| *** mfisch has quit IRC | 22:07 | |
| *** med_ has joined #openstack-infra | 22:08 | |
| *** hichtakk has joined #openstack-infra | 22:08 | |
| *** hichtakk has quit IRC | 22:08 | |
| *** med_ has quit IRC | 22:08 | |
| *** med_ has joined #openstack-infra | 22:08 | |
| zaro | fungi: ok, files all copied off from review-dev. | 22:08 |
| *** mfisch has joined #openstack-infra | 22:08 | |
| *** mfisch is now known as Guest85585 | 22:08 | |
| *** hichtakk has joined #openstack-infra | 22:08 | |
| *** hichtakk has quit IRC | 22:08 | |
| clarkb | fungi: no I don't think so | 22:08 |
| clarkb | fungi: all the urgent nodepoold changes are in | 22:08 |
| fungi | clarkb: yeah, none jumping out at me in the open list | 22:08 |
| *** hichtakk has joined #openstack-infra | 22:08 | |
| *** hichtakk has quit IRC | 22:08 | |
| fungi | okay, restarting now | 22:08 |
| *** sputnik13 has quit IRC | 22:08 | |
| *** hichtakk has joined #openstack-infra | 22:08 | |
| *** hichtakk has quit IRC | 22:09 | |
| *** hichtakk has joined #openstack-infra | 22:09 | |
| *** alivigni has quit IRC | 22:09 | |
| *** asselin_ has joined #openstack-infra | 22:09 | |
| *** mmedvede has quit IRC | 22:09 | |
| *** markmcclain has quit IRC | 22:10 | |
| *** hichtakk has quit IRC | 22:10 | |
| *** Masahiro has quit IRC | 22:10 | |
| *** mmedvede has joined #openstack-infra | 22:10 | |
| *** hichtakk has joined #openstack-infra | 22:10 | |
| fungi | clarkb: tons of response traffic from 206.164.176.21:443 now | 22:11 |
| *** signed8bit is now known as signed8bit_ZZZzz | 22:12 | |
| fungi | clarkb: so, yes, i would wager something happened on the network between nodepool and that api endpoint which dropped the sessions at the hpcloud end without nodepool finding out | 22:12 |
| *** hichtakk has quit IRC | 22:13 | |
| *** hichtakk has joined #openstack-infra | 22:14 | |
| *** asselin_ has quit IRC | 22:14 | |
| *** sabari is now known as zz_sabari | 22:14 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 22:14 | |
| *** hichtakk has quit IRC | 22:14 | |
| *** hichtakk has joined #openstack-infra | 22:14 | |
| *** hichtakk has quit IRC | 22:14 | |
| *** hichtakk has joined #openstack-infra | 22:15 | |
| *** hichtakk has quit IRC | 22:15 | |
| *** sputnik13 has joined #openstack-infra | 22:15 | |
| *** kgiusti has left #openstack-infra | 22:15 | |
| *** hichtakk has joined #openstack-infra | 22:15 | |
| *** hichtakk has quit IRC | 22:16 | |
| clarkb | fungi: we should probbly do mass deletes again | 22:16 |
| clarkb | fungi: and possibly look for alien nodes | 22:16 |
| *** hichtakk has joined #openstack-infra | 22:16 | |
| *** hichtakk has quit IRC | 22:16 | |
| fungi | clarkb: did yesterday, but i'll do another pass today | 22:16 |
| *** hichtakk has joined #openstack-infra | 22:16 | |
| *** hichtakk has quit IRC | 22:17 | |
| *** hichtakk has joined #openstack-infra | 22:17 | |
| *** hichtakk has quit IRC | 22:17 | |
| *** doug-fish has left #openstack-infra | 22:17 | |
| *** hichtakk has joined #openstack-infra | 22:17 | |
| *** hichtakk has quit IRC | 22:18 | |
| clarkb | fungi: I expect that many of these nodes were actually booted in hpcloud but nodepool never got their uuids so it can't clean them properly | 22:18 |
| *** sputnik13 has quit IRC | 22:18 | |
| *** hichtakk has joined #openstack-infra | 22:18 | |
| *** hichtakk has quit IRC | 22:18 | |
| *** hichtakk has joined #openstack-infra | 22:18 | |
| *** hichtakk has quit IRC | 22:19 | |
| *** dougwig has quit IRC | 22:19 | |
| *** hichtakk has joined #openstack-infra | 22:19 | |
| *** emagana has quit IRC | 22:20 | |
| fungi | possible. i'll have a count soon enough | 22:20 |
| *** hichtakk has quit IRC | 22:20 | |
| *** hichtakk has joined #openstack-infra | 22:20 | |
| *** sputnik13 has joined #openstack-infra | 22:21 | |
| *** ayoung has quit IRC | 22:21 | |
| *** ryanpetrello has joined #openstack-infra | 22:21 | |
| *** hichtakk has quit IRC | 22:22 | |
| *** hichtakk has joined #openstack-infra | 22:22 | |
| *** dustins has quit IRC | 22:22 | |
| *** hichtakk has quit IRC | 22:23 | |
| *** emagana has joined #openstack-infra | 22:23 | |
| *** hichtakk has joined #openstack-infra | 22:23 | |
| *** stevemar has quit IRC | 22:23 | |
| *** shashankhegde has joined #openstack-infra | 22:24 | |
| *** hichtakk has quit IRC | 22:24 | |
| *** sputnik13 has quit IRC | 22:24 | |
| *** hichtakk has joined #openstack-infra | 22:24 | |
| *** hichtakk has quit IRC | 22:24 | |
| *** hichtakk has joined #openstack-infra | 22:25 | |
| *** hichtakk has quit IRC | 22:25 | |
| *** hichtakk has joined #openstack-infra | 22:25 | |
| *** hichtakk has quit IRC | 22:25 | |
| *** hichtakk has joined #openstack-infra | 22:26 | |
| *** hichtakk has quit IRC | 22:26 | |
| *** hichtakk has joined #openstack-infra | 22:26 | |
| *** hichtakk has quit IRC | 22:26 | |
| *** hichtakk has joined #openstack-infra | 22:27 | |
| *** david-lyle has quit IRC | 22:27 | |
| *** hichtakk has quit IRC | 22:27 | |
| *** hichtakk has joined #openstack-infra | 22:27 | |
| *** hichtakk has quit IRC | 22:27 | |
| *** hichtakk has joined #openstack-infra | 22:28 | |
| *** markvoelker has joined #openstack-infra | 22:28 | |
| *** signed8bit has quit IRC | 22:28 | |
| fungi | i've disabled puppet agent and stopped gerrit on review-dev | 22:29 |
| *** signed8bit has joined #openstack-infra | 22:29 | |
| *** david-lyle has joined #openstack-infra | 22:30 | |
| *** hichtakk has quit IRC | 22:30 | |
| *** jcoufal has quit IRC | 22:30 | |
| *** hichtakk has joined #openstack-infra | 22:30 | |
| sdague | hmmmm is gerrit good an slow for other folks today? | 22:30 |
| fungi | sdague: from nz? | 22:30 |
| *** hichtakk has quit IRC | 22:30 | |
| sdague | nope | 22:31 |
| *** hichtakk has joined #openstack-infra | 22:31 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Fix DIB image cache path in DIB element https://review.openstack.org/146998 | 22:31 |
| *** hichtakk has quit IRC | 22:31 | |
| fungi | i hadn't noticed it being slow, but i've been interacting with it less today than usual | 22:31 |
| fungi | clarkb: 46 alien nodes in hpcloud. deleting them now | 22:31 |
| clarkb | fungi: ^ thats one half of the ~/.cache problem. The other half will require a dib release after they merge my second patch | 22:31 |
| *** hichtakk has joined #openstack-infra | 22:31 | |
| clarkb | sdague: I opened a giant diff and that was slow but I attributed that to the diff size. Let me try some other pages | 22:32 |
| *** hichtakk has quit IRC | 22:32 | |
| *** hichtakk has joined #openstack-infra | 22:32 | |
| sdague | my git review pushes have been slow all day, I assumed it was the normal nova slow down, but the glance one I just did also was pretty slow | 22:32 |
| *** hichtakk has quit IRC | 22:32 | |
| *** hichtakk has joined #openstack-infra | 22:32 | |
| *** signed8bit has quit IRC | 22:32 | |
| *** hichtakk has quit IRC | 22:33 | |
| *** erikmwilson has quit IRC | 22:33 | |
| *** hichtakk has joined #openstack-infra | 22:33 | |
| clarkb | mtreinish: why not just use a single log file in https://review.openstack.org/#/c/143142/1 ? | 22:33 |
| *** hichtakk has quit IRC | 22:33 | |
| clarkb | sdague: could also be your network path and any issues there | 22:33 |
| *** hichtakk has joined #openstack-infra | 22:33 | |
| *** hichtakk has quit IRC | 22:34 | |
| sdague | clarkb: could be | 22:34 |
| clarkb | fungi: we appear to still be building all the things... | 22:34 |
| *** hichtakk has joined #openstack-infra | 22:34 | |
| *** hichtakk has quit IRC | 22:34 | |
| sdague | I'm 59ms by icmp from review.openstack.org | 22:34 |
| *** hichtakk has joined #openstack-infra | 22:35 | |
| *** otter768 has joined #openstack-infra | 22:35 | |
| clarkb | sdague: and packet loss isn't terrible? I occasionally get ~25% loss through denver on comcast's network to rax | 22:35 |
| *** hichtakk has quit IRC | 22:35 | |
| clarkb | its amazing sauce and typically worse on ipv6 than ipv4 | 22:35 |
| sdague | nope | 22:35 |
| *** Rockyg has joined #openstack-infra | 22:35 | |
| *** hichtakk has joined #openstack-infra | 22:35 | |
| *** hichtakk has quit IRC | 22:35 | |
| *** dimtruck is now known as zz_dimtruck | 22:35 | |
| sdague | 26 packets transmitted, 26 received, 0% packet loss, time 25042ms | 22:35 |
| sdague | rtt min/avg/max/mdev = 58.596/58.861/59.605/0.352 ms | 22:35 |
| *** hichtakk has joined #openstack-infra | 22:36 | |
| *** hichtakk has quit IRC | 22:36 | |
| clarkb | so likely not network problems | 22:36 |
| *** hichtakk has joined #openstack-infra | 22:36 | |
| *** hichtakk has quit IRC | 22:36 | |
| *** sputnik13 has joined #openstack-infra | 22:37 | |
| *** hichtakk has joined #openstack-infra | 22:37 | |
| *** hichtakk has quit IRC | 22:37 | |
| clarkb | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=26&rra_id=all doesn't appear crazy | 22:37 |
| *** hichtakk has joined #openstack-infra | 22:37 | |
| *** hichtakk has quit IRC | 22:37 | |
| *** hichtakk has joined #openstack-infra | 22:38 | |
| *** hichtakk has quit IRC | 22:38 | |
| openstackgerrit | Kevin L. Mitchell proposed stackforge/python-jenkins: Raise an exception on 404 https://review.openstack.org/139158 | 22:38 |
| *** hichtakk has joined #openstack-infra | 22:38 | |
| *** hichtakk has quit IRC | 22:38 | |
| *** hichtakk has joined #openstack-infra | 22:39 | |
| *** fandi has quit IRC | 22:39 | |
| *** hichtakk has quit IRC | 22:39 | |
| clarkb | I don't see anything crazy in java melody either. I wonder if maybe its just contention for ssh workers | 22:39 |
| *** jkt_ is now known as jkt | 22:39 | |
| *** hichtakk has joined #openstack-infra | 22:39 | |
| *** hichtakk has quit IRC | 22:40 | |
| *** otter768 has quit IRC | 22:40 | |
| openstackgerrit | Kevin L. Mitchell proposed stackforge/python-jenkins: Eliminate redundant calls to assert_job_exists() https://review.openstack.org/145598 | 22:40 |
| *** hichtakk has joined #openstack-infra | 22:40 | |
| clarkb | zaro: ^ any other thoughts? | 22:40 |
| *** hichtakk has quit IRC | 22:40 | |
| *** hashar has quit IRC | 22:40 | |
| *** hichtakk has joined #openstack-infra | 22:41 | |
| *** hichtakk has quit IRC | 22:41 | |
| *** hichtakk has joined #openstack-infra | 22:41 | |
| *** hichtakk_ has joined #openstack-infra | 22:42 | |
| *** hichtakk has quit IRC | 22:42 | |
| *** hichtakk_ has quit IRC | 22:42 | |
| *** hichtakk has joined #openstack-infra | 22:42 | |
| *** dmsimard is now known as dmsimard_away | 22:42 | |
| *** Rockyg has quit IRC | 22:42 | |
| *** hichtakk has quit IRC | 22:42 | |
| *** hichtakk has joined #openstack-infra | 22:43 | |
| *** hichtakk has quit IRC | 22:43 | |
| *** hichtakk has joined #openstack-infra | 22:43 | |
| *** hichtakk has quit IRC | 22:44 | |
| *** hichtakk has joined #openstack-infra | 22:44 | |
| *** sputnik13 has quit IRC | 22:44 | |
| *** hichtakk has quit IRC | 22:44 | |
| *** hichtakk has joined #openstack-infra | 22:45 | |
| *** hichtakk has quit IRC | 22:45 | |
| *** hichtakk has joined #openstack-infra | 22:45 | |
| *** Ryan_Lane has quit IRC | 22:46 | |
| *** hichtakk has quit IRC | 22:46 | |
| *** fandi has joined #openstack-infra | 22:46 | |
| *** hichtakk has joined #openstack-infra | 22:46 | |
| *** hichtakk_ has joined #openstack-infra | 22:46 | |
| *** hichtakk has quit IRC | 22:46 | |
| *** hichtakk_ has quit IRC | 22:47 | |
| *** hichtakk has joined #openstack-infra | 22:47 | |
| *** hichtakk has quit IRC | 22:47 | |
| *** hichtakk has joined #openstack-infra | 22:47 | |
| jeblair | clarkb: the active threads seem low enough that it doesn't seem like thread contention | 22:48 |
| *** hichtakk has quit IRC | 22:48 | |
| *** mriedem has quit IRC | 22:48 | |
| *** hichtakk has joined #openstack-infra | 22:48 | |
| *** hichtakk has quit IRC | 22:48 | |
| *** pc_m has joined #openstack-infra | 22:48 | |
| *** hichtakk has joined #openstack-infra | 22:49 | |
| *** sputnik13 has joined #openstack-infra | 22:49 | |
| clarkb | ya I am not sure its being slow for me either | 22:49 |
| *** baoli has joined #openstack-infra | 22:49 | |
| *** hichtakk has quit IRC | 22:49 | |
| *** hichtakk_ has joined #openstack-infra | 22:49 | |
| clarkb | jeblair: any ideas on the hpcloud nodepool situation? | 22:49 |
| jeblair | clarkb: er, no context :( | 22:49 |
| *** hichtakk_ has quit IRC | 22:49 | |
| clarkb | jeblair: sorry, nodepool is unable to transition nodes from building to ready with hpcloud | 22:50 |
| clarkb | jeblair: the vast majority of nodes end up with no uuid | 22:50 |
| fungi | and what looked like dead established sockets to the api endpoint for all 5 hpcloud providers from nodepool.o.o | 22:50 |
| jogo | clarkb: no uuid from hp's nova? | 22:50 |
| clarkb | some have uuids and show active according to nova | 22:50 |
| *** doug-fish has joined #openstack-infra | 22:51 | |
| *** achanda_ has quit IRC | 22:51 | |
| *** sputnik13 has quit IRC | 22:51 | |
| clarkb | and they have sat over 5 hours in these states | 22:51 |
| jeblair | 2015-01-13 22:28:28,865 DEBUG nodepool.ProviderManager: Manager hpcloud-b4 running task <nodepool.provider_manager.CreateServerTask object at 0x7fa7d47bd7d0> (queue: 74) | 22:51 |
| jeblair | clarkb: that's the last time nodepool ran an api command against hpcloud | 22:52 |
| jeblair | so yeah, seems stuck (and with a moderate queue of pending requests) | 22:52 |
| *** hichtakk has joined #openstack-infra | 22:52 | |
| jeblair | we really, really, really, really, need tcp keepalives with the python requests lib | 22:52 |
| *** hichtakk has quit IRC | 22:52 | |
| *** andreaf has quit IRC | 22:53 | |
| *** hichtakk has joined #openstack-infra | 22:53 | |
| fungi | sigmavirus24: ^ ;) | 22:53 |
| *** hichtakk has quit IRC | 22:53 | |
| jeblair | i expect that nodepool is sitting in a python-novaclient -> requeuests call. i can try to confirm that | 22:53 |
| *** hichtakk has joined #openstack-infra | 22:53 | |
| zaro | sdague, clarkb might be repo dependent. large files maybe? | 22:54 |
| sigmavirus24 | jeblair: it exists | 22:54 |
| *** Rockyg has joined #openstack-infra | 22:54 | |
| jeblair | woot! last time someone looked at this there was a problem | 22:54 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for sqla-migrate/glance bug 1410494 https://review.openstack.org/146986 | 22:54 |
| uvirtbot | Launchpad bug 1410494 in glance "sqlalchemy-migrate>0.9.1 and <0.9.5 causes glance test failures" [Critical,In progress] https://launchpad.net/bugs/1410494 | 22:54 |
| jeblair | maybe we need to track that down again | 22:54 |
| sigmavirus24 | jeblair: https://review.openstack.org/#/c/120571/ | 22:54 |
| *** hichtakk has quit IRC | 22:54 | |
| *** fandi has quit IRC | 22:54 | |
| sigmavirus24 | jeblair: well it's not on by default | 22:55 |
| *** hichtakk has joined #openstack-infra | 22:55 | |
| clarkb | and its not merged | 22:55 |
| zaro | sdague, clarkb : or maybe the git client being used? | 22:55 |
| *** hichtakk has quit IRC | 22:55 | |
| *** hichtakk_ has joined #openstack-infra | 22:55 | |
| clarkb | its weird to me that novaclient is the only thing that wants that | 22:55 |
| sigmavirus24 | clarkb: I know. People wanted it everywhere but novaclient | 22:55 |
| *** hichtakk_ has quit IRC | 22:56 | |
| sdague | it's sitting in WIP, so it's going to be soundly ignored | 22:56 |
| sigmavirus24 | clarkb: that's where the bug report was and then I was told I was wrong and it hasn't been consistently bumped so I've left it to see if it was /really/ needed | 22:56 |
| *** hichtakk has joined #openstack-infra | 22:56 | |
| *** hichtakk has quit IRC | 22:56 | |
| clarkb | sigmavirus24: I just mean in general the ability to set a keepalive seems important to an http requests lib | 22:56 |
| sigmavirus24 | sdague: no movement on the bug about other people needing it, so it seemed like a theory and not something that was either a high priority or actually necessary | 22:56 |
| *** hichtakk has joined #openstack-infra | 22:56 | |
| sigmavirus24 | clarkb: and you can set it | 22:56 |
| clarkb | sigmavirus24: only by subclassing and doing magic | 22:57 |
| *** ryanpetrello has quit IRC | 22:57 | |
| sigmavirus24 | for subjective values of magic | 22:57 |
| clarkb | or am I misreading the comments on that change? | 22:57 |
| jeblair | yeah, we're stuck on a dead connection with no feedback as such: http://paste.openstack.org/show/157392/ | 22:57 |
| *** hichtakk has quit IRC | 22:58 | |
| *** dizquierdo has joined #openstack-infra | 22:58 | |
| fungi | and that connection went dead very soon after i restarted nodepoold | 22:58 |
| *** hichtakk has joined #openstack-infra | 22:58 | |
| clarkb | sigmavirus24: the magic involved is understanding request internals | 22:58 |
| *** hichtakk has quit IRC | 22:58 | |
| *** hichtakk has joined #openstack-infra | 22:58 | |
| sigmavirus24 | clarkb: Adapters aren't internals. They're documented parts of the API. | 22:59 |
| *** dannywilson has quit IRC | 22:59 | |
| *** hichtakk_ has joined #openstack-infra | 22:59 | |
| clarkb | jeblair: you got that paste via the stack dump signal? | 22:59 |
| *** achanda has joined #openstack-infra | 22:59 | |
| fungi | ugh. puppet's user/group resource manager tries to be "smart" and add new users by autoincrementing past the highest seen uid/gid | 22:59 |
| jeblair | so perhaps there's a network issue between rax and hpcloud. maybe we should see if we can identify where it is? maybe it's something that we could ping people about. otherwise we may need to wait it out and try restarting again later. maybe we should offline hpcloud for now. | 23:00 |
| jeblair | clarkb: yep | 23:00 |
| jeblair | clarkb: Thread: hpcloud-b1 (140359769474816) | 23:00 |
| jeblair | clarkb: that's the top (that's the naming convention for manager threads) | 23:00 |
| cody-somerville | We see nodepool slowness all the time. :) | 23:00 |
| clarkb | sigmavirus24: knowing that kwargs takes a socket_options key seems like internals | 23:01 |
| sigmavirus24 | jeblair: https://bugs.launchpad.net/python-novaclient/+bug/1323862 is the relevant bug. I'll add this back to my todo-list | 23:01 |
| fungi | cody-somerville: this is less slowness and more deadness | 23:01 |
| uvirtbot | Launchpad bug 1323862 in python-novaclient "novaclient can get hung when used for extended periods" [Undecided,In progress] | 23:01 |
| jeblair | cody-somerville: this isn't slowness, this is dead connections to hpcloud | 23:01 |
| cody-somerville | does that make nodepool not do much? | 23:01 |
| clarkb | anyways I will shut up | 23:01 |
| *** hichtakk has quit IRC | 23:01 | |
| *** hichtak__ has joined #openstack-infra | 23:01 | |
| sigmavirus24 | clarkb: knowing kwargs is passed to urllib3 is documented iirc and urllib3's docs document what it accepts | 23:01 |
| sdague | clarkb: no, I agree with you, it seems like it should be another adapter in requests | 23:01 |
| cody-somerville | cause we'll see it just act dead like and then bam it does a bunch of stuff | 23:01 |
| cody-somerville | and it's not clear why it was ever just waiting | 23:01 |
| jeblair | cody-somerville: (also, i'd love a bug report on 'slowness' -- nodepool generally should run as fast as the backing cloud) | 23:02 |
| sigmavirus24 | sdague: literally socket_options was added *just* for openstack (I added it) | 23:02 |
| *** hichtak__ has quit IRC | 23:02 | |
| *** dannywil_ has joined #openstack-infra | 23:02 | |
| sdague | the fact that you have to import socket in novaclient feels very much like a layers violation | 23:02 |
| sigmavirus24 | so it doesn't need to be a separate adapter because only openstack cares about it | 23:02 |
| jeblair | sigmavirus24: (i would use this in my other requests apps (eg gertty), for basically the same reason) | 23:02 |
| sigmavirus24 | honestly I think openstack works at way too high a layer | 23:02 |
| *** gyee has quit IRC | 23:03 | |
| sigmavirus24 | openstack reaches around requests for way too many things and ends up using urllib3 for half of its work in the end | 23:03 |
| cody-somerville | Sometimes nodepool will just stop spawning nodes despite a demand. And we have to restart and it'll take 30-40 minutes before it's back to normal. | 23:03 |
| *** hichtakk has joined #openstack-infra | 23:03 | |
| sigmavirus24 | I'm not certain why it continues to use requests | 23:03 |
| *** zz_sabari is now known as sabari | 23:03 | |
| jeblair | cody-somerville: so that's clearly not the designed behavior. that would be worth looking into. | 23:03 |
| *** maxbit has joined #openstack-infra | 23:03 | |
| *** dizquierdo has quit IRC | 23:03 | |
| fungi | sigmavirus24: i think a lot of the drive to use requests was to get x.509 cert validation for https connections | 23:04 |
| cody-somerville | jeblair: It drives us bonkers. | 23:04 |
| clarkb | cody-somerville: I thnk that may be this issue | 23:04 |
| *** hichtakk_ has quit IRC | 23:04 | |
| *** hichtakk has quit IRC | 23:04 | |
| clarkb | we have demand right now but we aren't properly building anything | 23:04 |
| jesusaurus | clarkb: and the issue is a lack of keepalive? | 23:04 |
| clarkb | jesusaurus: ya the provider manager tcp connection goes away with no timeout | 23:05 |
| *** hichtakk has joined #openstack-infra | 23:05 | |
| jesusaurus | hm | 23:05 |
| clarkb | so no more items are pulled from the queue and processed | 23:05 |
| *** hichtakk has quit IRC | 23:05 | |
| fungi | jesusaurus: hard to know. a lack of keepalive means we can't be certain the socket hasn't gone dead on us (dead peer detection) | 23:05 |
| clarkb | right it could be blocking for other reasons but worst case we go down on that forever | 23:05 |
| *** e0ne is now known as e0ne_ | 23:05 | |
| *** hichtakk has joined #openstack-infra | 23:05 | |
| sigmavirus24 | fungi: so urllib3 is what actually does that for requests it's just off by default | 23:05 |
| *** sabari is now known as zz_sabari | 23:05 | |
| sigmavirus24 | we turn it on by default and give you higher level (read: common) ways of configuring it | 23:05 |
| *** hichtakk has quit IRC | 23:06 | |
| *** zz_dimtruck is now known as dimtruck | 23:06 | |
| *** hichtakk has joined #openstack-infra | 23:06 | |
| *** gyee has joined #openstack-infra | 23:06 | |
| sigmavirus24 | As soon as you want lower level things, like pinning, you have to reach back into urllib3 because 98% of our users don't use that | 23:06 |
| jesusaurus | clarkb: ah, so a keepalive would either resolve the issue or point us in a better direction | 23:06 |
| *** hichtakk has quit IRC | 23:06 | |
| clarkb | jesusaurus: ya | 23:06 |
| *** ihrachyshka has joined #openstack-infra | 23:07 | |
| fungi | sigmavirus24: and yeah, now that cert validation is on in 2.7.x stdlib we can probably more or less just rely on that (once we're finally able to drop support for python 2.6) | 23:07 |
| *** hichtakk has joined #openstack-infra | 23:07 | |
| *** e0ne_ is now known as e0ne | 23:08 | |
| *** hichtakk has quit IRC | 23:08 | |
| sigmavirus24 | fungi: it's only in 2.7.9 and 3.4.3 | 23:08 |
| fungi | but i suppose urllib3 would also get us there for 2.6 | 23:08 |
| sigmavirus24 | so relying on that won't get you far, especially when distros aren't yet shipping 2.7.9 | 23:08 |
| fungi | true | 23:08 |
| *** hichtakk has joined #openstack-infra | 23:08 | |
| fungi | but we're still stuck supporting 2.6 for now anyway | 23:08 |
| *** hichtakk has quit IRC | 23:08 | |
| sigmavirus24 | yeah I know | 23:09 |
| *** hichtakk has joined #openstack-infra | 23:09 | |
| *** e0ne has quit IRC | 23:09 | |
| sigmavirus24 | I just feel like we've fielded a lot of "bugs" from OpenStack when the level of control they want is a /feature/ in urllib3 and requires ugly amounts of extra work to enable in requests | 23:09 |
| sigmavirus24 | And the request is always "Just add another keyword arg" which if we did, we'd be upwards of 30 or 40 by now | 23:09 |
| *** erlon has quit IRC | 23:10 | |
| *** hichtakk has quit IRC | 23:10 | |
| *** hichtakk_ has joined #openstack-infra | 23:10 | |
| *** doug-fish has quit IRC | 23:10 | |
| *** hichtakk_ has quit IRC | 23:10 | |
| *** doug-fish has joined #openstack-infra | 23:10 | |
| jeblair | sigmavirus24: not wearing my openstack hat, i think that requests having the option to not hang indefinitely in the case of a bad network connection is a good general purpose feature. i think it fits with the 'http for humans' theme | 23:10 |
| fungi | i honestly don't know if there are other things in requests we rely on. i do find requests to be a lot simpler to use, but we have plenty of cases where simple is no longer an option anyway | 23:10 |
| *** wenlock has quit IRC | 23:11 | |
| *** hichtakk has joined #openstack-infra | 23:11 | |
| *** gyee has quit IRC | 23:11 | |
| *** hichtakk has quit IRC | 23:11 | |
| lifeless | jeblair: +1 | 23:11 |
| *** hichtakk has joined #openstack-infra | 23:11 | |
| sigmavirus24 | jeblair: I agree but we've literally never had this request from anyone else, ever. And I looked for it on StackOverflow and our bugs | 23:11 |
| *** hichtakk has quit IRC | 23:11 | |
| sigmavirus24 | So it's a problem that either no one is encountering outside of openstack or no one is reporting as having trouble with | 23:11 |
| jeblair | sigmavirus24: it may only come up more in the daemon context | 23:12 |
| *** hichtakk has joined #openstack-infra | 23:12 | |
| jeblair | or really long running apps | 23:12 |
| sigmavirus24 | I find the former unlikely and the latter troubling | 23:12 |
| *** mfink has joined #openstack-infra | 23:12 | |
| sdague | sigmavirus24: or no one has figured out what the root issue is | 23:12 |
| *** zz_sabari is now known as sabari | 23:12 | |
| sigmavirus24 | sdague: that never stops people from filing bugs https://github.com/kennethreitz/requests/issues/2406 | 23:12 |
| lifeless | sigmavirus24: it took us a chunk of time to track this down | 23:12 |
| sigmavirus24 | anyway, I have to run for a while | 23:12 |
| sigmavirus24 | I'll be back on tonight | 23:13 |
| sigmavirus24 | lifeless: I believe that. Which is why urllib3 now supports it (which enables requests to support it) | 23:13 |
| *** hichtakk has quit IRC | 23:13 | |
| sigmavirus24 | I didn't say I disbelieved the problem, just the usefulness of requests adding a bunch of stuff only one consumer seems to ever use | 23:13 |
| lifeless | ah | 23:13 |
| *** hichtakk has joined #openstack-infra | 23:13 | |
| *** hichtakk has quit IRC | 23:13 | |
| fungi | we are probably in a minority of people writing rest services in python | 23:13 |
| *** hichtakk has joined #openstack-infra | 23:14 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 23:14 | |
| *** hichtakk has quit IRC | 23:14 | |
| dims__ | fungi: switch to "go"? :) | 23:14 |
| clarkb | so we do have a keepalive time of 2 hours on nodepool .o.o with 75 second interval and 9 probes | 23:14 |
| *** hichtakk has joined #openstack-infra | 23:14 | |
| fungi | dims__: that's how i heard it anyway ;) | 23:14 |
| jeblair | clarkb: ? | 23:14 |
| clarkb | so we should've run the probes after 2 hours on the >5hour connection | 23:14 |
| *** hichtakk has quit IRC | 23:14 | |
| clarkb | jeblair: checking kernel parameters | 23:14 |
| *** emagana has quit IRC | 23:15 | |
| clarkb | so it is possible that hpcloud ponged the probes | 23:15 |
| *** hichtakk has joined #openstack-infra | 23:15 | |
| jeblair | clarkb: did we do something to enable that? | 23:15 |
| *** hichtakk has quit IRC | 23:15 | |
| clarkb | or that requests/urllib3 is overriding? | 23:15 |
| clarkb | jeblair: no I think its default | 23:15 |
| *** hichtakk has joined #openstack-infra | 23:15 | |
| *** dims_ has joined #openstack-infra | 23:15 | |
| fungi | kernel-level tcp socket defaults? | 23:15 |
| clarkb | fungi: ya | 23:15 |
| *** dizquierdo has joined #openstack-infra | 23:16 | |
| clarkb | cat /proc/sys/net/ipv4/tcp_keepalive_time and _intvl and _proves | 23:16 |
| clarkb | er _probes | 23:16 |
| clarkb | (we are using ipv4 for these connections) | 23:16 |
| *** shashankhegde has quit IRC | 23:16 | |
| *** hichtakk has quit IRC | 23:16 | |
| *** dimtruck is now known as zz_dimtruck | 23:16 | |
| jeblair | clarkb: so a tcpdump should show activity within 76 seconds, right? | 23:16 |
| *** hichtakk has joined #openstack-infra | 23:17 | |
| clarkb | oh wait you have to request that in a scoekt anyways | 23:17 |
| fungi | it definitely didn't when i was sniffing | 23:17 |
| clarkb | so those are the values you get if novaclient did the right thing | 23:17 |
| *** hichtakk has quit IRC | 23:17 | |
| jeblair | right. that matches my recollection. | 23:17 |
| *** hichtakk has joined #openstack-infra | 23:17 | |
| *** hichtakk has quit IRC | 23:17 | |
| *** hichtakk has joined #openstack-infra | 23:18 | |
| *** hichtakk has quit IRC | 23:18 | |
| *** ddieterly has quit IRC | 23:18 | |
| *** hichtakk has joined #openstack-infra | 23:18 | |
| *** hichtakk has quit IRC | 23:19 | |
| *** sputnik13 has joined #openstack-infra | 23:19 | |
| *** hichtakk has joined #openstack-infra | 23:19 | |
| *** hichtakk has quit IRC | 23:19 | |
| *** dims__ has quit IRC | 23:19 | |
| *** hichtakk has joined #openstack-infra | 23:19 | |
| *** bhunter71 has quit IRC | 23:20 | |
| *** hichtakk has quit IRC | 23:20 | |
| *** hichtakk has joined #openstack-infra | 23:20 | |
| *** hichtakk has quit IRC | 23:20 | |
| jeblair | gotta run | 23:20 |
| *** hichtakk has joined #openstack-infra | 23:21 | |
| *** hichtakk has quit IRC | 23:21 | |
| *** hichtakk has joined #openstack-infra | 23:21 | |
| *** hichtakk has quit IRC | 23:21 | |
| *** shashankhegde has joined #openstack-infra | 23:22 | |
| *** hichtakk has joined #openstack-infra | 23:22 | |
| *** hichtakk has quit IRC | 23:22 | |
| *** reed has quit IRC | 23:22 | |
| *** hichtakk has joined #openstack-infra | 23:22 | |
| *** hichtakk has quit IRC | 23:22 | |
| *** sputnik13 has quit IRC | 23:23 | |
| *** hichtakk has joined #openstack-infra | 23:23 | |
| *** hichtakk has quit IRC | 23:23 | |
| *** hichtakk has joined #openstack-infra | 23:23 | |
| *** hichtakk has quit IRC | 23:24 | |
| fungi | nibalizer: any clue if anyone ever solved this? http://projects.puppetlabs.com/issues/2645 | 23:24 |
| fungi | i'm worried we're going to need to puppet /etc/login.defs | 23:24 |
| *** hichtakk has joined #openstack-infra | 23:24 | |
| fungi | for multiple platforms | 23:24 |
| clarkb | we could try libkeepalive | 23:24 |
| clarkb | fungi: ^ and restart nodepool running under that | 23:24 |
| *** hichtakk_ has joined #openstack-infra | 23:25 | |
| fungi | clarkb: looks worth a try | 23:26 |
| *** hichtakk_ has quit IRC | 23:26 | |
| *** hichtak__ has joined #openstack-infra | 23:26 | |
| *** hichtakk has quit IRC | 23:26 | |
| fungi | though it's sort of a hackish solution to recommend to downstream users of nodepool | 23:26 |
| clarkb | indeed | 23:27 |
| *** david-lyle has quit IRC | 23:27 | |
| *** bhuvan has quit IRC | 23:27 | |
| *** ryanpetrello has joined #openstack-infra | 23:27 | |
| clarkb | I am thinking more for immediate issue of half our capacity is useable right now | 23:27 |
| fungi | so having it solved _in_ nodepool would obviously be preferable | 23:27 |
| fungi | but yeah, worth a try | 23:27 |
| krotscheck | Could someone hop onto storyboard.o.o and restart the worker daemon? I think it’s running with outdated code. | 23:27 |
| fungi | if nothing else, it might rule out the dead socket vs blocked on something hypothesis | 23:27 |
| clarkb | fungi: ya | 23:28 |
| clarkb | krotscheck: sure | 23:28 |
| clarkb | krotscheck: the storyboard-workers service? | 23:28 |
| krotscheck | clarkb: Thanks, I think the service is called storyboard_work_daemon or something similar | 23:28 |
| krotscheck | Yep | 23:28 |
| krotscheck | That one | 23:28 |
| clarkb | hrm stop didn't seem to work right | 23:29 |
| krotscheck | clarkb: Huhn. That would explain the outdated code. | 23:29 |
| *** hemnafk is now known as hemna | 23:29 | |
| clarkb | krotscheck: let me poke around to celaln them up. new ones did start though | 23:30 |
| krotscheck | clarkb: Thanks. | 23:30 |
| *** fandi has joined #openstack-infra | 23:30 | |
| *** hichtak__ has quit IRC | 23:30 | |
| clarkb | ya kill on the manager process seems to no properly make them go away | 23:31 |
| clarkb | krotscheck: is it safe to -9 them? | 23:31 |
| krotscheck | clarkb: Yep | 23:31 |
| *** doude has quit IRC | 23:32 | |
| *** melwitt has quit IRC | 23:32 | |
| clarkb | krotscheck: all done. you might want to make the init script a bit more aggressive if things don't go away | 23:33 |
| krotscheck | clarkb: Roger Wilco. | 23:33 |
| *** dims_ has quit IRC | 23:33 | |
| *** Ng has quit IRC | 23:33 | |
| *** plaurin_ has quit IRC | 23:33 | |
| *** dims__ has joined #openstack-infra | 23:33 | |
| clarkb | fungi: ok, should we just stop puppet and mash the keepalive thing in? or should I whip up a puppet change o install libkeepalive and update init script? | 23:34 |
| *** sputnik13 has joined #openstack-infra | 23:34 | |
| *** fandi has quit IRC | 23:36 | |
| *** fandi has joined #openstack-infra | 23:36 | |
| *** sputnik13 has quit IRC | 23:36 | |
| krotscheck | clarkb: Looks like it’s all working, thanks :) | 23:37 |
| *** ivar-laz_ has joined #openstack-infra | 23:37 | |
| fungi | clarkb: i'm fine with disabling puppet and trying it out as long as we don't leave it in that state indefinitely | 23:37 |
| *** sputnik13 has joined #openstack-infra | 23:38 | |
| *** dims__ has quit IRC | 23:38 | |
| fungi | in good news, login.defs is identical between precise and trusty | 23:39 |
| *** fandi has quit IRC | 23:39 | |
| clarkb | krotscheck: maybe just change the signal argument to start stop daemon to 9 | 23:39 |
| fungi | in less good news, it's not at all similar on centos6 | 23:39 |
| *** dougwig has joined #openstack-infra | 23:39 | |
| clarkb | krotscheck: but that may be overkill | 23:39 |
| clarkb | fungi: login.defs? | 23:39 |
| fungi | clarkb: /etc/login.defs, which we will likely need to puppet to deal with uid/gid collisions | 23:40 |
| *** oomichi_ has joined #openstack-infra | 23:40 | |
| clarkb | fungi: I will go ahead and stop puppet and put some monkey patching in place for libkeepalive | 23:40 |
| fungi | k | 23:40 |
| *** ctracey has quit IRC | 23:40 | |
| *** simonmcc has quit IRC | 23:40 | |
| *** jraim has quit IRC | 23:40 | |
| *** ameade has quit IRC | 23:40 | |
| *** zhiyan has quit IRC | 23:40 | |
| *** sputnik13 has quit IRC | 23:40 | |
| fungi | mired in building the trusty review-dev replacement, and discovering that our current uid/gid hard-coding is creating a new problem | 23:41 |
| *** ivar-lazzaro has quit IRC | 23:41 | |
| clarkb | :/ I see | 23:41 |
| krotscheck | clarkb: Most of that is handled inside of python. We spin up a manager that then spins up processes. I suspect the process is getting terminated before it can clean up after itself. | 23:41 |
| *** sabari is now known as zz_sabari | 23:41 | |
| *** zz_sabari is now known as sabari | 23:42 | |
| *** mattfarina has quit IRC | 23:42 | |
| fungi | specifically, that since we're hard-coding uids/gids in the range defined in login.defs, puppet picks the next available in that range _higher_ than any we've used yet, and then the next hard-coded user it tries to create conflicts with the auto-numbered one and puppet breaks | 23:42 |
| *** mriedem has joined #openstack-infra | 23:43 | |
| fungi | so we need to up the UID_MIN and GID_MIN to something higher than any of the accounts we're going to hard-set | 23:43 |
| *** shakamunyi has joined #openstack-infra | 23:44 | |
| sdague | mordred: not sure if you are on from mordor, looking at the pbr/tools/integration.sh script, and realizing how much of a mix of concerns it is between what pbr cares about and what requirements might care about | 23:45 |
| fungi | and we'll also need to set SYS_UID_MAX and SYS_GID_MAX to something lower than we're using for hard-coded users, since those default to UID_MIN-1 and GID_MIN-1 respectively | 23:45 |
| clarkb | fungi: ok want to check the LD_PRELOAD value in /etc/init.d/nodepool? | 23:45 |
| clarkb | fungi: if it looks good to you I can restart nodepool | 23:45 |
| clarkb | fungi: gah on uids | 23:46 |
| *** banix has joined #openstack-infra | 23:46 | |
| *** maxbit has quit IRC | 23:46 | |
| *** banix has quit IRC | 23:46 | |
| *** mattfarina has joined #openstack-infra | 23:47 | |
| *** mattfarina has quit IRC | 23:47 | |
| fungi | clarkb: your LD_PRELOAD lgtm | 23:47 |
| fungi | go for it | 23:47 |
| clarkb | ok restarted | 23:47 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Copy tempest.log from verify-tempest-config https://review.openstack.org/143142 | 23:47 |
| *** markvoelker has quit IRC | 23:48 | |
| fungi | sdague: i think that's because it started life as the "try to install everything to make sure this pbr change doesn't break packaging" job and only later got renamed/repurposed when we realized that some changes to the requirements list were breaking that job for pbr | 23:48 |
| sdague | yeh | 23:48 |
| sdague | also, what's using gear from global-requirements? | 23:49 |
| fungi | that's a great question. checking | 23:49 |
| *** Longgeek has joined #openstack-infra | 23:50 | |
| fungi | sdague: tripleo-ci apparently uses it | 23:50 |
| clarkb | ya they use it to lock test envs | 23:50 |
| sdague | that's not in projects.txt | 23:51 |
| clarkb | you have a client + worker pair on slave node and a client + worker pair on test environment and if they end up starting jobs on each other then they have locked | 23:51 |
| sdague | so I think this was added back when this controlled the mirror | 23:51 |
| clarkb | sdague: possible | 23:51 |
| sdague | realistically, you can't install gear without python-daemon pinned | 23:52 |
| fungi | sdague: https://review.openstack.org/69264 added it a year ago | 23:52 |
| sdague | which is actually the thing that was breaking wheel | 23:52 |
| sdague | fungi: yeh, I started git blaming as well | 23:52 |
| *** sputnik13 has joined #openstack-infra | 23:52 | |
| clarkb | sdague: ya but dhellamns change should unbreak wheel | 23:52 |
| *** hichtakk has joined #openstack-infra | 23:52 | |
| sdague | sure, but it doesn't unbreak the test we really want | 23:53 |
| sdague | which is pip install -r global-requirements.txt | 23:53 |
| clarkb | sdague: not sure I follow | 23:53 |
| sdague | because, realistically that's actually the requirements test | 23:53 |
| fungi | might be it's time for us to check all supported branches of projects listed in projects.txt to see what they declare in their requirements lists and trim down global-requirements.txt accordingly | 23:53 |
| sdague | all the pbr looping that takes forever, isn't really the test | 23:53 |
| clarkb | sdague: its a bit more than that | 23:53 |
| clarkb | sdague: it checks that specific subsets of the requirements when installed together work | 23:54 |
| clarkb | ebcause pip | 23:54 |
| sdague | right, but if we install everything, that should be fine, right? | 23:54 |
| clarkb | sdague: no because order matters | 23:54 |
| clarkb | you actuall do have to check each project individually | 23:54 |
| sdague | ok, sure | 23:54 |
| *** Masahiro has joined #openstack-infra | 23:54 | |
| sdague | but we don't need to do every project 3 times | 23:54 |
| fungi | i think what that job is testing is "loop over the projects list and try to install those things with requirements sync'd from the global list" | 23:54 |
| fungi | (for each branch) | 23:55 |
| clarkb | fungi: ya | 23:55 |
| clarkb | but the other dimension is wheel, sdist, and ? | 23:55 |
| clarkb | which probably pbr can do without requirements doing | 23:55 |
| fungi | develop? | 23:55 |
| sdague | clarkb: but from a requirements perspective, is that actually useful? | 23:55 |
| sdague | will it pass in one, and not in the others? | 23:56 |
| clarkb | sdague: no I think you are right that is likely not useful | 23:56 |
| fungi | it could be a separate pbr-only job, sure | 23:56 |
| sdague | I get that it's useful for pbr | 23:56 |
| sdague | yeh, that's where I think I'm getting to, this is actually 2 jobs | 23:56 |
| *** sputnik13 has quit IRC | 23:56 | |
| openstackgerrit | Sean Dague proposed openstack/requirements: remove gear from g-r https://review.openstack.org/147021 | 23:57 |
| *** sputnik13 has joined #openstack-infra | 23:58 | |
| *** ryanpetrello has quit IRC | 23:59 | |
| *** dims__ has joined #openstack-infra | 23:59 | |
| openstackgerrit | Merged openstack/requirements: Block oslo.concurrency 0.4.0 https://review.openstack.org/146942 | 23:59 |
| *** Masahiro has quit IRC | 23:59 | |
| clarkb | wow we have ready nodes in hpcloud | 23:59 |
| clarkb | oh wait those are old ignore me | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
