| ianw | greghaynes: i *think* so ... see prior note about logging what's happening :) | 00:00 |
|---|---|---|
| mordred | like, perhaps we should have glean check for a symlink and remove it | 00:00 |
| mordred | OR | 00:00 |
| mordred | maybe we shuld make an element that puts in an 8.8.8.8 resolv.conf | 00:00 |
| greghaynes | Yep, glean should either do nothing or remove the symlink, I have no strong opinion of which | 00:00 |
| *** esker has quit IRC | 00:00 | |
| mordred | so that if you're not planning on systemd, you can prevent it from doing a symlink thing | 00:01 |
| greghaynes | mordred: hrm, I need to remember the details of the unbound workaround | 00:01 |
| mordred | yah | 00:01 |
| ianw | i think the image should be just shipping a blank resolv.conf, that will stop systemd thinking it has been asked to be the resolver | 00:01 |
| greghaynes | I want to say we need working dns during a build but unbound wants that file missing so it can manage it? | 00:01 |
| greghaynes | clarkb: ^ do you remember the deets? | 00:02 |
| clarkb | we write the file | 00:02 |
| clarkb | but we don't write it until the end of the image build because the unbound daemon isn't running during build time so no resolver at 127.0.1.1 exists | 00:02 |
| *** timothyb89 has joined #openstack-infra | 00:02 | |
| mordred | right. we do | 00:03 |
| mordred | but people who are not running infra-puppet don't | 00:03 |
| mordred | and are, it seems, getting an image with no resolv.conf | 00:03 |
| *** tzn has quit IRC | 00:03 | |
| greghaynes | ianw: Ah, so this is just in youre local testing, not in nodepool f23 images | 00:03 |
| greghaynes | s/youre/your | 00:03 |
| *** salv-orl_ has joined #openstack-infra | 00:04 | |
| ianw | ah, yes ... this is just a dib image with "fedora-minimal devuser simpleinit vm" | 00:04 |
| ianw | i ain't got time to be iterating with full infra-puppet builds :) | 00:04 |
| greghaynes | ianw: so ya, I would be fine with dib creating that file as long as it is super early (maybe during root.d?) | 00:04 |
| ZZelle_ | Hi everyone | 00:04 |
| ZZelle_ | It seems gerrit is from time to time really really slow | 00:04 |
| clarkb | what does an emty file mean? | 00:04 |
| clarkb | ZZelle_: like right now? | 00:05 |
| clarkb | ZZelle_: DB backups | 00:05 |
| ianw | clarkb: hopefully that dhclient overwrites it, or in our case, glean | 00:05 |
| ZZelle_ | clarkb, yes, but also yesterday around the same time iirc | 00:05 |
| clarkb | ZZelle_: yup db backups | 00:05 |
| openstackgerrit | Merged openstack-infra/jeepyb: Updated from global requirements https://review.openstack.org/241032 | 00:06 |
| greghaynes | daily db backups | 00:06 |
| clarkb | ianw: oh right beecause dns resolvers are a cloud configy thing | 00:06 |
| ZZelle_ | clarkb, thanks | 00:06 |
| *** timothyb89 has quit IRC | 00:06 | |
| *** salv-orlando has quit IRC | 00:06 | |
| *** Daisy has joined #openstack-infra | 00:08 | |
| *** arxcruz has quit IRC | 00:09 | |
| *** xarses has quit IRC | 00:09 | |
| *** sabeen1 has quit IRC | 00:09 | |
| vilobhmm11 | can someone please help me understand what am I doing wrong here https://review.openstack.org/#/c/254488/3/zuul/layout.yaml | 00:09 |
| *** sabeen1 has joined #openstack-infra | 00:10 | |
| vilobhmm11 | ianw, clarkb, greghaynes : ^^ | 00:10 |
| jeblair | vilobhmm11: you can't put a voting clause there, it's an attribute of the job so it has to go in the job specification | 00:10 |
| jeblair | vilobhmm11: look for the other instances of 'voting' and add gate-tooz-tox-pyxx-consul there with the voting flag | 00:11 |
| jeblair | (incidentally, i'm changing this in zuulv3 to support nearly that syntax :) | 00:12 |
| *** Daisy has quit IRC | 00:13 | |
| *** Qiming has quit IRC | 00:13 | |
| mordred | \o/ | 00:14 |
| vilobhmm11 | jeblair : cool…just by adding in zuul/layout job gate-tooz-tox-pyxx-consul would do or do I also need to add this job at any other place like jenkins/jobs | 00:14 |
| jeblair | vilobhmm11: oh if it hasn't been defined yet, youll need to add it there too (jenkins/jobs defines the jobs, zuul/layout says when to run them) | 00:15 |
| vilobhmm11 | ok jeblair : thanks! I will add you to review | 00:15 |
| *** timothyb89 has joined #openstack-infra | 00:15 | |
| zaro | clarkb: yes, i've tested the rollback script. it works great. | 00:17 |
| *** spzala_ has joined #openstack-infra | 00:21 | |
| openstackgerrit | Vilobh Meshram proposed openstack-infra/project-config: Add Consul Gate Job https://review.openstack.org/254488 | 00:22 |
| *** spzala has quit IRC | 00:23 | |
| *** spzala_ is now known as spzala | 00:23 | |
| *** pvaneck has quit IRC | 00:24 | |
| *** xyang1 has quit IRC | 00:24 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 00:26 | |
| *** Sukhdev has joined #openstack-infra | 00:31 | |
| *** ddieterly has joined #openstack-infra | 00:32 | |
| jhesketh | jeblair: are your v3 things ready for review? | 00:33 |
| *** ashleighfarnham has quit IRC | 00:33 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Add python-constraints-jobs to networking-ofagent as an experimental https://review.openstack.org/256163 | 00:35 |
| *** mriedem has joined #openstack-infra | 00:39 | |
| *** xarses has joined #openstack-infra | 00:39 | |
| *** mriedem is now known as mriedem_away | 00:40 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Adding the meeting_id value to the meeting yaml file. https://review.openstack.org/255452 | 00:41 |
| clarkb | jhesketh: re https://review.openstack.org/#/c/255930/2 I think there are now several users using that patch with legacy config | 00:42 |
| *** Piet has quit IRC | 00:42 | |
| clarkb | jhesketh: I think it works becuase the if statement doesn't change | 00:42 |
| clarkb | "if gerrit in config" | 00:42 |
| clarkb | though I notice the comment there is no longer correct | 00:43 |
| clarkb | but either way shoul dwork | 00:43 |
| *** amuller has quit IRC | 00:43 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Add the agenda link for the SR-IOV meeting https://review.openstack.org/255184 | 00:45 |
| *** Sukhdev has quit IRC | 00:45 | |
| *** gongysh has quit IRC | 00:46 | |
| jhesketh | clarkb: the issue I'm predicting is http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/scheduler.py#n295 .. The connection_name comes from http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/scheduler.py#n419 (called trigger_name) | 00:48 |
| jhesketh | that said, I'm surprised the patch actually works, so maybe I'm missing something | 00:48 |
| *** _denisra has joined #openstack-infra | 00:50 | |
| clarkb | jhesketh: it did sound like it was possible only mergers were affected or were restared under new code and they don't go through layout.yaml | 00:51 |
| clarkb | so maybe its restrited to only working on some subset of gerrit connection | 00:51 |
| jhesketh | right, that's a good point | 00:51 |
| jhesketh | so the alternative fix of just calling it 'gerrit' should work very similarly and avoids the problem I'm predicting | 00:52 |
| jhesketh | so maybe we should just put that in | 00:52 |
| clarkb | ya | 00:52 |
| clarkb | seems sane | 00:52 |
| clarkb | then rebase your warnings change on it | 00:52 |
| clarkb | (I think they will conflict) | 00:52 |
| *** tzn has joined #openstack-infra | 00:52 | |
| jhesketh | and my other patch (linked in the review) will protect users from overwriting the gerrit section unwittingly | 00:52 |
| jhesketh | YEAH | 00:52 |
| jhesketh | (woo, caps) | 00:52 |
| *** chlong has joined #openstack-infra | 00:52 | |
| jhesketh | eantyshev: ping | 00:54 |
| *** ashleighfarnham has joined #openstack-infra | 00:54 | |
| *** sputnik13 has quit IRC | 00:54 | |
| *** tzn has quit IRC | 00:57 | |
| *** lykinsbd has joined #openstack-infra | 00:58 | |
| asselin_ | jhesketh, I think he's in european time zone | 00:59 |
| *** agentle has quit IRC | 00:59 | |
| jhesketh | clarkb: do you think I should fix up eantyshev's patch and we review it through? | 00:59 |
| asselin_ | jhesketh, I can update his patch but didn't test it today | 00:59 |
| asselin_ | can't* | 00:59 |
| *** lykinsbd_ has joined #openstack-infra | 00:59 | |
| *** salv-orl_ has quit IRC | 01:00 | |
| clarkb | jhesketh: ya its probably worht getitng the fix in so that if we have to restart it works (and to avoid further confusion for other users) | 01:00 |
| jhesketh | k, will do | 01:00 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/zuul: Connection names for legacy configs https://review.openstack.org/255930 | 01:00 |
| asselin_ | jhesketh, ^^ | 01:00 |
| jhesketh | asselin_: cool, thanks :-) | 01:01 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Set keepalives for gerrit connections https://review.openstack.org/238988 | 01:03 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Tidy up loggers https://review.openstack.org/224336 | 01:03 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Update python-daemon https://review.openstack.org/250315 | 01:03 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Log a warning when zuul.conf is misconfigured https://review.openstack.org/250270 | 01:03 |
| *** lykinsbd has quit IRC | 01:03 | |
| jhesketh | asselin_: reordered my patches so the warning is next up | 01:03 |
| clarkb | I went ahead and approved the first one | 01:04 |
| clarkb | and +2'd the warning one | 01:04 |
| jhesketh | clarkb: thanks :-) | 01:04 |
| *** tqtran has quit IRC | 01:05 | |
| asselin_ | cool thanks | 01:05 |
| *** agentle has joined #openstack-infra | 01:08 | |
| *** bharathm has quit IRC | 01:08 | |
| lifeless | clarkb: if you're still around https://review.openstack.org/#/c/255616/ is an easy +2A | 01:09 |
| *** ParsectiX has joined #openstack-infra | 01:09 | |
| clarkb | oh there was a parent change /me reviews | 01:09 |
| *** ParsectiX has quit IRC | 01:09 | |
| *** ParsectiX has joined #openstack-infra | 01:10 | |
| lifeless | clarkb: thanks | 01:10 |
| openstackgerrit | Merged openstack-infra/irc-meetings: Add the agenda link for the SR-IOV meeting https://review.openstack.org/255184 | 01:12 |
| openstackgerrit | Merged openstack-infra/zuul: Connection names for legacy configs https://review.openstack.org/255930 | 01:12 |
| *** ashleighfarnham has quit IRC | 01:14 | |
| *** agentle has quit IRC | 01:15 | |
| *** mtanino has quit IRC | 01:15 | |
| *** baoli has joined #openstack-infra | 01:19 | |
| *** terriyu has quit IRC | 01:22 | |
| *** pradk has joined #openstack-infra | 01:32 | |
| *** ParsectiX has quit IRC | 01:34 | |
| *** david-lyle has joined #openstack-infra | 01:37 | |
| *** jyuso1 has joined #openstack-infra | 01:37 | |
| *** rhallisey has joined #openstack-infra | 01:38 | |
| *** gongysh has joined #openstack-infra | 01:41 | |
| *** gongysh has quit IRC | 01:44 | |
| *** rhallisey has quit IRC | 01:45 | |
| *** tzn has joined #openstack-infra | 01:47 | |
| *** tzn has quit IRC | 01:51 | |
| *** sridhar_ram1 has joined #openstack-infra | 01:52 | |
| *** rhallisey has joined #openstack-infra | 01:53 | |
| *** sridhar_ram has quit IRC | 01:54 | |
| *** jyuso has joined #openstack-infra | 01:58 | |
| *** jyuso1 has quit IRC | 02:01 | |
| *** jamielennox is now known as jamielennox|away | 02:01 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add db manage command to clean empty runs https://review.openstack.org/256179 | 02:03 |
| *** ParsectiX has joined #openstack-infra | 02:04 | |
| *** Qiming has joined #openstack-infra | 02:04 | |
| *** bpokorny_ has joined #openstack-infra | 02:05 | |
| *** bpokorny has quit IRC | 02:09 | |
| *** bpokorny_ has quit IRC | 02:10 | |
| openstackgerrit | Michael Micucci proposed openstack-infra/system-config: Added eavesdrop and statusbot for openstack-zephyr https://review.openstack.org/254489 | 02:10 |
| *** lykinsbd_ has quit IRC | 02:11 | |
| *** kitsuneninetails has joined #openstack-infra | 02:12 | |
| openstackgerrit | Merged openstack-dev/pbr: passenv integration environment variables re-enabling integration tests https://review.openstack.org/255616 | 02:14 |
| kitsuneninetails | Hello! If someone with +2/merge permission has a chance to look, could you please verify and merge https://review.openstack.org/#/c/254489/? It's been +2'd a few times and passes gates. Thanks! | 02:15 |
| kitsuneninetails | Also, I wonder if it is possible to change the channel list in system-config/manifests/sites.pp to a multi-line string so we don't get so many merge conflicts when people change the channel list? I'm not a ruby/puppet expert, and it looks like there isn' too great of support for multi-line strings, but maybe there's a way to do it and keep the code looking nice (ala Python and the ("foo"\n"bar") construct? | 02:17 |
| *** armax has quit IRC | 02:19 | |
| *** r-daneel has quit IRC | 02:22 | |
| openstackgerrit | gordon chung proposed openstack-infra/project-config: split gnocchi tests by indexer to avoid timeouts https://review.openstack.org/256063 | 02:27 |
| *** jamielennox|away is now known as jamielennox | 02:29 | |
| *** ZZelle_ has quit IRC | 02:29 | |
| *** baoli has quit IRC | 02:30 | |
| *** sridhar_ram1 has quit IRC | 02:30 | |
| *** baoli has joined #openstack-infra | 02:32 | |
| *** Apoorva has joined #openstack-infra | 02:34 | |
| *** Apoorva is now known as apoorvad | 02:34 | |
| *** baoli has quit IRC | 02:35 | |
| *** tzn has joined #openstack-infra | 02:41 | |
| *** ddieterly has quit IRC | 02:43 | |
| *** flepied has joined #openstack-infra | 02:43 | |
| *** thorst has joined #openstack-infra | 02:44 | |
| *** otter768 has joined #openstack-infra | 02:45 | |
| *** thorst_ has joined #openstack-infra | 02:45 | |
| *** tzn has quit IRC | 02:45 | |
| mordred | kitsuneninetails: I don't see zephyr in gerrit | 02:46 |
| mordred | kitsuneninetails: is there a patch up to import it? | 02:46 |
| *** thorst_ has quit IRC | 02:48 | |
| *** thorst has quit IRC | 02:49 | |
| *** hichihara has quit IRC | 02:49 | |
| *** Hink has joined #openstack-infra | 02:52 | |
| *** dewsday has quit IRC | 02:57 | |
| *** rguillebert has quit IRC | 02:57 | |
| *** eil397 has joined #openstack-infra | 02:59 | |
| *** lykinsbd has joined #openstack-infra | 02:59 | |
| *** pradk is now known as pradk-afk | 03:00 | |
| *** pradk-afk is now known as pradk | 03:01 | |
| *** ddieterly has joined #openstack-infra | 03:03 | |
| *** rhallisey has quit IRC | 03:04 | |
| *** salv-orlando has joined #openstack-infra | 03:04 | |
| *** lykinsbd has quit IRC | 03:05 | |
| *** tjones has joined #openstack-infra | 03:06 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/project-config: Make the tox macro understand environment lists https://review.openstack.org/256189 | 03:08 |
| *** slogan621 has quit IRC | 03:08 | |
| *** tjones has quit IRC | 03:08 | |
| *** fawadkhaliq has joined #openstack-infra | 03:09 | |
| *** salv-orlando has quit IRC | 03:14 | |
| *** gongysh has joined #openstack-infra | 03:14 | |
| *** Hink_ has joined #openstack-infra | 03:15 | |
| *** unicell has quit IRC | 03:16 | |
| *** tlian has quit IRC | 03:16 | |
| *** Hink has quit IRC | 03:18 | |
| *** gongysh has quit IRC | 03:19 | |
| *** yamahata has quit IRC | 03:19 | |
| ianw | mordred: so ... network_info.json ... | 03:20 |
| *** apoorvad has quit IRC | 03:20 | |
| *** tjones has joined #openstack-infra | 03:20 | |
| ianw | i do not have this in my cloud, and vendor_info.json is blank | 03:21 |
| ianw | which seems to be not helping glean to setup networking | 03:21 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: toci_gate_test/overcloud/non-ha: enable monitoring https://review.openstack.org/254787 | 03:22 |
| *** tlian has joined #openstack-infra | 03:23 | |
| *** boris-42_ has quit IRC | 03:23 | |
| *** Hink_ has quit IRC | 03:30 | |
| *** fawadkhaliq has quit IRC | 03:31 | |
| *** tzn has joined #openstack-infra | 03:35 | |
| *** tzn has quit IRC | 03:40 | |
| *** vilobhmm11 has quit IRC | 03:40 | |
| *** vilobhmm11 has joined #openstack-infra | 03:40 | |
| *** links has joined #openstack-infra | 03:42 | |
| *** rlandy has quit IRC | 03:42 | |
| clarkb | ianw many/most clouds should dhcp | 03:48 |
| clarkb | and I believe glean stays out of the way of dhcp | 03:48 |
| clarkb | its only rax right now that does the other thing (granted thats where we failed ) | 03:49 |
| ianw | clarkb: yeah ... it's starting to make some sense now | 03:49 |
| *** binbincong has quit IRC | 03:50 | |
| ianw | this makes testing even more ... interesting | 03:50 |
| kitsuneninetails | mordred: I am currently working on moving to openstack gerrit and other open infrstructure, but I'm moving one step at a time :) So, I thought getting the IRC channel open was a good first move, then open up the gerrit, the CI, etc. | 03:51 |
| clarkb | ianw glean has example network info json globs if you want to artificially inject some. under tests/fixtures iirc | 03:53 |
| *** erikwilson has joined #openstack-infra | 03:53 | |
| *** vilobhmm11 has quit IRC | 03:55 | |
| *** yamamoto has joined #openstack-infra | 03:55 | |
| *** unicell has joined #openstack-infra | 03:56 | |
| greghaynes | Ya, glean checks for config-drive, if none is found it writes out a config to dhcp and then up's the interface | 03:58 |
| *** bpokorny has joined #openstack-infra | 03:59 | |
| timburke | i saw something a few hours ago about caps in swiftclient; i'm guessing that was about os-loganalyze? if you want to get rid of that, https://review.openstack.org/#/c/233245/ should do it | 04:02 |
| *** binbincong has joined #openstack-infra | 04:03 | |
| *** flepied has quit IRC | 04:05 | |
| *** cfarquhar has quit IRC | 04:06 | |
| *** ddieterly has quit IRC | 04:06 | |
| *** gongysh has joined #openstack-infra | 04:08 | |
| *** gongysh has quit IRC | 04:11 | |
| *** dims has quit IRC | 04:12 | |
| *** armax has joined #openstack-infra | 04:13 | |
| *** hichihara has joined #openstack-infra | 04:13 | |
| *** binbincong has quit IRC | 04:13 | |
| *** cfarquhar has joined #openstack-infra | 04:13 | |
| *** cfarquhar has quit IRC | 04:13 | |
| *** cfarquhar has joined #openstack-infra | 04:13 | |
| *** unicell has quit IRC | 04:14 | |
| *** gongysh has joined #openstack-infra | 04:19 | |
| *** dims has joined #openstack-infra | 04:19 | |
| *** vilobhmm11 has joined #openstack-infra | 04:20 | |
| *** vilobhmm111 has joined #openstack-infra | 04:22 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/glean: Update documentation and logging https://review.openstack.org/256206 | 04:23 |
| ianw | greghayes / clarkb: ^ it's a start, anyway | 04:24 |
| *** vilobhmm11 has quit IRC | 04:25 | |
| *** binbincong has joined #openstack-infra | 04:25 | |
| openstackgerrit | Anusha Ramineni proposed openstack-infra/system-config: Add statusbot/eavesdrop to #congress channel https://review.openstack.org/255654 | 04:28 |
| *** gongysh has quit IRC | 04:28 | |
| *** tzn has joined #openstack-infra | 04:29 | |
| *** rossella_s has quit IRC | 04:30 | |
| *** Ramanjaneya has joined #openstack-infra | 04:30 | |
| *** dims has quit IRC | 04:30 | |
| *** rossella_s has joined #openstack-infra | 04:31 | |
| *** dims has joined #openstack-infra | 04:31 | |
| *** tzn has quit IRC | 04:33 | |
| *** tjones has quit IRC | 04:41 | |
| *** esker has joined #openstack-infra | 04:41 | |
| *** esker has quit IRC | 04:42 | |
| *** jerryz has quit IRC | 04:44 | |
| mordred | ianw: if you use bifrost to boot a bare metal server, bifrost also creates the network_info.json file | 04:44 |
| mordred | ianw: I don't know if that makes it any easier to test for you | 04:44 |
| *** otter768 has quit IRC | 04:46 | |
| *** baoli has joined #openstack-infra | 04:46 | |
| ianw | mordred: TBH that sounds like a yak-shaving exercise in debugging about 4 more components :) | 04:47 |
| mordred | ianw: yup. almost certainly :) | 04:47 |
| ianw | anyway, at this point, dhcp doesn't work, so i've got a first step in working that out | 04:48 |
| mordred | ianw: I'm excited about logging | 04:48 |
| ianw | mordred: https://review.openstack.org/256206 if you missed it | 04:50 |
| *** ppai has joined #openstack-infra | 04:50 | |
| *** ppai has left #openstack-infra | 04:50 | |
| *** jaosorior has quit IRC | 04:51 | |
| *** baoli has quit IRC | 04:51 | |
| *** jaosorior has joined #openstack-infra | 04:51 | |
| *** binbincong has quit IRC | 04:51 | |
| *** ppai has joined #openstack-infra | 04:52 | |
| ppai | Hi. Could anyone please merge this change ? https://review.openstack.org/255827 Thanks :) | 04:53 |
| mordred | ianw: +2 on that and +A on your other one | 04:54 |
| ianw | mordred: thanks, i'll see how i go, might be helpful to get this out to a file, etc. | 04:55 |
| *** fawadkhaliq has joined #openstack-infra | 04:55 | |
| openstackgerrit | Merged openstack-infra/glean: Handle different paths to glean.sh https://review.openstack.org/255597 | 04:57 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: tap-as-a-service: Enable check-requirements https://review.openstack.org/256213 | 04:57 |
| openstackgerrit | Merged openstack-infra/glean: Update documentation and logging https://review.openstack.org/256206 | 04:59 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack/requirements: Add tap-as-a-service to projects.txt https://review.openstack.org/256214 | 05:00 |
| *** esker has joined #openstack-infra | 05:02 | |
| *** binbincong has joined #openstack-infra | 05:05 | |
| *** salv-orlando has joined #openstack-infra | 05:05 | |
| *** esker has quit IRC | 05:08 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: networking-midonet: Avoid running tempest for specs changes https://review.openstack.org/256217 | 05:08 |
| *** dims has quit IRC | 05:08 | |
| *** ddieterly has joined #openstack-infra | 05:11 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: tap-as-a-service: Skip tempest for unrelated changes https://review.openstack.org/256218 | 05:13 |
| openstackgerrit | Roger Luethi proposed openstack-infra/irc-meetings: Add training-labs weekly meeting https://review.openstack.org/254122 | 05:15 |
| *** _denisra has quit IRC | 05:15 | |
| *** ig0r__ has joined #openstack-infra | 05:15 | |
| *** ddieterly has quit IRC | 05:15 | |
| *** bexelbie has joined #openstack-infra | 05:18 | |
| *** ig0r_ has quit IRC | 05:19 | |
| *** unicell has joined #openstack-infra | 05:19 | |
| *** ig0r__ has quit IRC | 05:21 | |
| *** tzn has joined #openstack-infra | 05:23 | |
| *** esker has joined #openstack-infra | 05:24 | |
| *** bexelbie has quit IRC | 05:26 | |
| *** tzn has quit IRC | 05:28 | |
| *** binbincong has quit IRC | 05:29 | |
| *** esker has quit IRC | 05:30 | |
| *** ParsectiX has quit IRC | 05:30 | |
| *** amotoki has joined #openstack-infra | 05:31 | |
| *** tlian has quit IRC | 05:32 | |
| *** ParsectiX has joined #openstack-infra | 05:33 | |
| *** ParsectiX has quit IRC | 05:33 | |
| *** ParsectiX has joined #openstack-infra | 05:33 | |
| *** ParsectiX has quit IRC | 05:34 | |
| *** bexelbie has joined #openstack-infra | 05:39 | |
| *** aeng has quit IRC | 05:42 | |
| *** binbincong has joined #openstack-infra | 05:44 | |
| *** esker has joined #openstack-infra | 05:46 | |
| *** harlowja_at_home has joined #openstack-infra | 05:48 | |
| *** esker has quit IRC | 05:52 | |
| *** bpokorny has quit IRC | 05:56 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/256225 | 06:02 |
| *** salv-orl_ has joined #openstack-infra | 06:04 | |
| *** yamahata has joined #openstack-infra | 06:05 | |
| *** sabeen1 has quit IRC | 06:05 | |
| *** salv-orlando has quit IRC | 06:07 | |
| *** bharathm has joined #openstack-infra | 06:09 | |
| *** mohankumar has joined #openstack-infra | 06:11 | |
| *** ddieterly has joined #openstack-infra | 06:11 | |
| *** chlong has quit IRC | 06:15 | |
| *** ddieterly has quit IRC | 06:16 | |
| *** tzn has joined #openstack-infra | 06:17 | |
| *** FallenPegasus has joined #openstack-infra | 06:19 | |
| *** yonglihe has quit IRC | 06:21 | |
| *** tzn has quit IRC | 06:22 | |
| *** tpeoples has joined #openstack-infra | 06:22 | |
| *** camunoz has quit IRC | 06:22 | |
| *** zhenguo has joined #openstack-infra | 06:24 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/256225 | 06:24 |
| *** dingyichen has quit IRC | 06:26 | |
| *** fdegir has quit IRC | 06:26 | |
| *** fdegir has joined #openstack-infra | 06:27 | |
| *** simonmcc has quit IRC | 06:27 | |
| *** simonmcc has joined #openstack-infra | 06:27 | |
| *** ashishb has joined #openstack-infra | 06:28 | |
| *** ppai is now known as ppai|afk | 06:30 | |
| *** esker has joined #openstack-infra | 06:31 | |
| yamamoto | anyone working on decorator 4.0.5 issue? | 06:33 |
| *** jamielennox is now known as jamielennox|away | 06:33 | |
| *** ParsectiX has joined #openstack-infra | 06:33 | |
| *** ParsectiX has quit IRC | 06:34 | |
| *** harlowja_at_home has quit IRC | 06:34 | |
| *** ParsectiX has joined #openstack-infra | 06:34 | |
| *** ParsectiX has quit IRC | 06:34 | |
| *** ParsectiX has joined #openstack-infra | 06:34 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/256238 | 06:34 |
| *** bexelbie has quit IRC | 06:36 | |
| *** esker has quit IRC | 06:36 | |
| *** gyee has quit IRC | 06:38 | |
| *** hdd has quit IRC | 06:39 | |
| *** Qiming has quit IRC | 06:44 | |
| *** otter768 has joined #openstack-infra | 06:47 | |
| *** unicell has quit IRC | 06:48 | |
| *** bexelbie has joined #openstack-infra | 06:52 | |
| *** otter768 has quit IRC | 06:52 | |
| *** dims has joined #openstack-infra | 06:52 | |
| *** Ramanjaneya has quit IRC | 06:52 | |
| *** mohankumar has quit IRC | 06:52 | |
| *** Kennan has quit IRC | 06:55 | |
| *** Kennan has joined #openstack-infra | 06:56 | |
| *** dims has quit IRC | 06:56 | |
| *** salv-orlando has joined #openstack-infra | 06:57 | |
| *** salv-orl_ has quit IRC | 06:59 | |
| *** gildub has quit IRC | 07:00 | |
| *** _denisra has joined #openstack-infra | 07:01 | |
| *** salv-orlando has quit IRC | 07:01 | |
| *** mohankumar has joined #openstack-infra | 07:06 | |
| *** Ramanjaneya has joined #openstack-infra | 07:07 | |
| *** dims has joined #openstack-infra | 07:10 | |
| *** tzn has joined #openstack-infra | 07:11 | |
| *** ddieterly has joined #openstack-infra | 07:13 | |
| *** tzn has quit IRC | 07:16 | |
| *** FallenPegasus has quit IRC | 07:16 | |
| *** bharathm has quit IRC | 07:17 | |
| *** ddieterly has quit IRC | 07:17 | |
| *** scheuran has joined #openstack-infra | 07:17 | |
| *** bharathm has joined #openstack-infra | 07:17 | |
| *** FallenPegasus has joined #openstack-infra | 07:20 | |
| *** FallenPegasus has quit IRC | 07:20 | |
| *** jaypipes has joined #openstack-infra | 07:20 | |
| *** FallenPegasus has joined #openstack-infra | 07:20 | |
| openstackgerrit | Merged openstack-infra/release-tools: add reno notes to announce script output https://review.openstack.org/255526 | 07:21 |
| openstackgerrit | Merged openstack-infra/release-tools: format reno section of release notes more nicely https://review.openstack.org/255527 | 07:21 |
| openstackgerrit | Merged openstack-infra/release-tools: add URLs from links to the text output https://review.openstack.org/255528 | 07:22 |
| openstackgerrit | Sergey Nikitin proposed openstack/requirements: Updated oslo.db to 4.1.0 https://review.openstack.org/254624 | 07:22 |
| stevemar | everything is failing \o/ | 07:25 |
| *** gongysh has joined #openstack-infra | 07:26 | |
| *** ig0r_ has joined #openstack-infra | 07:32 | |
| *** _nadya_ has joined #openstack-infra | 07:37 | |
| *** FallenPegasus has quit IRC | 07:38 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/requirements: Bump decorator version from 4.0.5 to 4.0.6 https://review.openstack.org/256268 | 07:43 |
| *** mohankumar has quit IRC | 07:45 | |
| openstackgerrit | Guido Günther proposed openstack-infra/jenkins-job-builder: delivery-pipeline: support task description template https://review.openstack.org/255365 | 07:45 |
| *** tzn has joined #openstack-infra | 07:45 | |
| *** mrmartin has joined #openstack-infra | 07:46 | |
| *** _nadya_ has quit IRC | 07:47 | |
| *** _nadya_ has joined #openstack-infra | 07:48 | |
| *** ParsectiX has quit IRC | 07:49 | |
| *** tzn has quit IRC | 07:50 | |
| *** gongysh has quit IRC | 07:51 | |
| *** ParsectiX has joined #openstack-infra | 07:52 | |
| *** erikwilson has quit IRC | 07:55 | |
| *** vilobhmm111 has quit IRC | 08:00 | |
| *** egonzalez has joined #openstack-infra | 08:03 | |
| *** ppai|afk is now known as ppai | 08:04 | |
| *** jaosorior has quit IRC | 08:04 | |
| *** AJaeger has joined #openstack-infra | 08:05 | |
| AJaeger | yolanda, could you put https://review.openstack.org/255715 on your review list for today, please? | 08:05 |
| *** jlanoux has joined #openstack-infra | 08:08 | |
| *** denisra_ has quit IRC | 08:09 | |
| *** denisra_ has joined #openstack-infra | 08:10 | |
| *** ig0r_ has quit IRC | 08:11 | |
| *** _nadya_ has quit IRC | 08:12 | |
| *** ddieterly has joined #openstack-infra | 08:13 | |
| *** matrohon has joined #openstack-infra | 08:13 | |
| *** christiana_ has joined #openstack-infra | 08:13 | |
| *** gongysh has joined #openstack-infra | 08:14 | |
| *** esker has joined #openstack-infra | 08:17 | |
| *** ddieterly has quit IRC | 08:19 | |
| *** ig0r_ has joined #openstack-infra | 08:19 | |
| *** ParsectiX has quit IRC | 08:21 | |
| *** ParsectiX has joined #openstack-infra | 08:22 | |
| *** ParsectiX has quit IRC | 08:22 | |
| *** ParsectiX has joined #openstack-infra | 08:22 | |
| *** esker has quit IRC | 08:23 | |
| yolanda | AJaeger sure | 08:23 |
| yolanda | starting reviews now | 08:23 |
| *** Steap has quit IRC | 08:24 | |
| *** HeOS has quit IRC | 08:24 | |
| *** Steap has joined #openstack-infra | 08:24 | |
| *** mpavone has joined #openstack-infra | 08:26 | |
| openstackgerrit | Merged openstack-infra/jeepyb: Always add prelude for docimpact bugs https://review.openstack.org/255715 | 08:26 |
| *** mpavone has quit IRC | 08:26 | |
| AJaeger | thanks, yolanda ! | 08:28 |
| yolanda | np | 08:28 |
| *** gongysh has quit IRC | 08:28 | |
| openstackgerrit | Merged openstack-infra/project-config: Add an Ironic job to use devstack plugin https://review.openstack.org/255981 | 08:30 |
| *** rossella_s has quit IRC | 08:30 | |
| *** fawadkhaliq has quit IRC | 08:30 | |
| *** rossella_s has joined #openstack-infra | 08:30 | |
| *** jaosorior has joined #openstack-infra | 08:31 | |
| *** kitsuneninetails has quit IRC | 08:31 | |
| openstackgerrit | Merged openstack-infra/project-config: networking-midonet: Avoid running tempest for specs changes https://review.openstack.org/256217 | 08:32 |
| *** arxcruz has joined #openstack-infra | 08:32 | |
| *** hichihara has quit IRC | 08:33 | |
| *** Hal has joined #openstack-infra | 08:33 | |
| *** Hal is now known as Guest67013 | 08:34 | |
| *** daemontool has joined #openstack-infra | 08:35 | |
| openstackgerrit | Merged openstack-infra/project-config: tap-as-a-service: Skip tempest for unrelated changes https://review.openstack.org/256218 | 08:35 |
| openstackgerrit | Merged openstack-infra/project-config: tap-as-a-service: Enable check-requirements https://review.openstack.org/256213 | 08:35 |
| openstackgerrit | Merged openstack-infra/project-config: Add install-distro-packages.sh job script https://review.openstack.org/256121 | 08:36 |
| *** daemontool has quit IRC | 08:38 | |
| *** binbincong has quit IRC | 08:38 | |
| *** jcoufal has joined #openstack-infra | 08:38 | |
| *** tzn has joined #openstack-infra | 08:39 | |
| *** esker has joined #openstack-infra | 08:40 | |
| *** kitsuneninetails has joined #openstack-infra | 08:40 | |
| openstackgerrit | Merged openstack-infra/zuul: Fix documentation example https://review.openstack.org/255689 | 08:43 |
| *** salv-orlando has joined #openstack-infra | 08:44 | |
| openstackgerrit | Merged openstack-infra/zuul: Add vim swap files to .gitignore https://review.openstack.org/256027 | 08:44 |
| *** tzn has quit IRC | 08:44 | |
| *** rcernin has joined #openstack-infra | 08:44 | |
| *** tzn has joined #openstack-infra | 08:45 | |
| *** esker has quit IRC | 08:46 | |
| *** yamamoto has quit IRC | 08:47 | |
| *** mohankumar has joined #openstack-infra | 08:47 | |
| *** otter768 has joined #openstack-infra | 08:48 | |
| *** yamamoto has joined #openstack-infra | 08:49 | |
| *** tzn has quit IRC | 08:49 | |
| yolanda | AJaeger, i'm looking at https://review.openstack.org/#/c/255325 ... this will need review from some Neutron liaison? | 08:50 |
| *** salv-orlando has quit IRC | 08:50 | |
| *** FallenPegasus has joined #openstack-infra | 08:51 | |
| *** binbincong has joined #openstack-infra | 08:52 | |
| *** otter768 has quit IRC | 08:53 | |
| *** ig0r_ has quit IRC | 08:53 | |
| *** ifarkas has joined #openstack-infra | 08:54 | |
| openstackgerrit | Merged openstack-infra/project-config: Bring back python27 checks for fuel-specs https://review.openstack.org/255828 | 08:54 |
| openstackgerrit | Merged openstack-infra/project-config: Disable stable/kilo python3 jobs for networking_hyperv https://review.openstack.org/255882 | 08:54 |
| openstackgerrit | Merged openstack-infra/project-config: Allow branch creation for swiftonfile project https://review.openstack.org/255827 | 08:55 |
| *** fawadkhaliq has joined #openstack-infra | 08:57 | |
| openstackgerrit | Merged openstack-infra/project-config: networking-midonet: Move ML2 job out of experimental https://review.openstack.org/255167 | 08:59 |
| AJaeger | yolanda: yes. Everything neutron/networking related should have a neutron liason | 09:01 |
| AJaeger | review | 09:01 |
| * AJaeger commented on the review | 09:02 | |
| *** abhishekk has joined #openstack-infra | 09:04 | |
| *** timothyb89 has quit IRC | 09:04 | |
| abhishekk | hi, I facing issue with devstack installation, it is saying No matching distribution found for decorator===4.0.5 | 09:05 |
| abhishekk | any idea about this?? | 09:05 |
| *** timothyb89 has joined #openstack-infra | 09:08 | |
| *** jlanoux has quit IRC | 09:11 | |
| dims | abhishekk : i am baby-sitting this review https://review.openstack.org/#/c/256238/ | 09:11 |
| *** mhickey has joined #openstack-infra | 09:11 | |
| dims | abhishekk : that should help with the decorator problem | 09:11 |
| abhishekk | dims: thank you | 09:12 |
| dims | abhishekk : someone nuked the file from pypi | 09:12 |
| abhishekk | dims: ohh, got it | 09:12 |
| *** ddieterly has joined #openstack-infra | 09:15 | |
| * dims drops an email to openstack-dev@ | 09:16 | |
| *** HeOS has joined #openstack-infra | 09:16 | |
| *** ig0r_ has joined #openstack-infra | 09:20 | |
| *** ddieterly has quit IRC | 09:20 | |
| *** placko has joined #openstack-infra | 09:21 | |
| *** cdent has joined #openstack-infra | 09:25 | |
| openstackgerrit | venkatamahesh proposed openstack/requirements: Fix a little spelling typo in README and error message https://review.openstack.org/226729 | 09:26 |
| openstackgerrit | Alexander Evseev proposed openstack-infra/zuul: Allow using numeric change number in addition to ID in Depends-On tag https://review.openstack.org/215553 | 09:26 |
| *** zeih has joined #openstack-infra | 09:27 | |
| *** ParsectiX has quit IRC | 09:27 | |
| *** _nadya_ has joined #openstack-infra | 09:28 | |
| *** zeih_ has joined #openstack-infra | 09:29 | |
| *** dims is now known as dimsum__ | 09:29 | |
| *** binbincong has quit IRC | 09:30 | |
| openstackgerrit | venkatamahesh proposed openstack/requirements: Drop py26 and add py34 https://review.openstack.org/256304 | 09:32 |
| *** zeih has quit IRC | 09:34 | |
| *** daemontool has joined #openstack-infra | 09:34 | |
| *** sfinucan has joined #openstack-infra | 09:36 | |
| *** kozhukalov_ has joined #openstack-infra | 09:37 | |
| *** jordanP has joined #openstack-infra | 09:38 | |
| *** jaypipes is now known as leakypipes | 09:39 | |
| *** dizquierdo has joined #openstack-infra | 09:39 | |
| *** binbincong has joined #openstack-infra | 09:42 | |
| *** ociuhandu has joined #openstack-infra | 09:46 | |
| *** tzn has joined #openstack-infra | 09:46 | |
| *** vgridnev has joined #openstack-infra | 09:46 | |
| *** ig0r_ has quit IRC | 09:47 | |
| *** jlanoux has joined #openstack-infra | 09:48 | |
| *** amotoki has quit IRC | 09:50 | |
| *** yamamoto has quit IRC | 09:51 | |
| dmellado | hi yolanda is there something wrong with the gates now? | 09:51 |
| dmellado | I'm seeing way too many failures that shouldn't be there, IMHO | 09:51 |
| yolanda | hi dmellado, i am not aware of problems, but please show me | 09:51 |
| yolanda | what kind of failures? | 09:51 |
| dmellado | will pm you ;) | 09:51 |
| *** tzn has quit IRC | 09:52 | |
| *** _nadya_ has quit IRC | 09:52 | |
| dguitarbite | can we have this merged? https://review.openstack.org/#/c/254122/ | 09:52 |
| *** dtardivel has joined #openstack-infra | 09:52 | |
| *** shardy has joined #openstack-infra | 09:53 | |
| *** jistr has joined #openstack-infra | 09:55 | |
| *** erikwilson has joined #openstack-infra | 09:56 | |
| *** dtantsur|afk is now known as dtantsur | 09:56 | |
| *** dizquierdo has quit IRC | 09:58 | |
| onovy | hi, can someone help me with this pls? https://review.openstack.org/#/c/245603/ gate failing not related to patch | 10:00 |
| *** erikwilson has quit IRC | 10:01 | |
| *** zhenguo has quit IRC | 10:01 | |
| yolanda | hi onovy, i am taking a look, seems gate is not working correctly | 10:01 |
| onovy | yolanda, thank you | 10:01 |
| *** hashar has joined #openstack-infra | 10:04 | |
| *** placko has quit IRC | 10:06 | |
| *** masber has joined #openstack-infra | 10:08 | |
| *** yamahata has quit IRC | 10:13 | |
| *** kitsuneninetails has quit IRC | 10:14 | |
| *** rguillebert has joined #openstack-infra | 10:14 | |
| *** kitsuneninetails has joined #openstack-infra | 10:15 | |
| *** ddieterly has joined #openstack-infra | 10:16 | |
| *** k4n0 has joined #openstack-infra | 10:16 | |
| *** k4n0 has quit IRC | 10:17 | |
| yolanda | hi, so i found that devstack jobs are failing with Collecting decorator===4.0.5 (from -c /opt/stack/new/requirements/upper-constraints.txt (line 95)) | 10:18 |
| *** placko has joined #openstack-infra | 10:19 | |
| *** piyush__ has joined #openstack-infra | 10:19 | |
| vponomaryov | yolanda, onovy: https://review.openstack.org/#/c/256238/ | 10:20 |
| *** masber has quit IRC | 10:20 | |
| piyush__ | Hi , is there any issue going in gate, i just made small change in my patch locally its passing but in uplink gate job is failing | 10:20 |
| piyush__ | :-( | 10:20 |
| yolanda | yes, gate is failing | 10:20 |
| *** ddieterly has quit IRC | 10:20 | |
| vponomaryov | and no one reads history of chat )) | 10:21 |
| *** salv-orlando has joined #openstack-infra | 10:23 | |
| yolanda | vponomaryov, thanks | 10:23 |
| yolanda | so that is on gate, as soon as it lands, gate should be functional right? | 10:24 |
| vponomaryov | that problem will be fixed, yes | 10:24 |
| yolanda | great, thanks | 10:24 |
| onovy | thanks too | 10:24 |
| *** esker has joined #openstack-infra | 10:27 | |
| *** fawadkhaliq has quit IRC | 10:28 | |
| *** tzn has joined #openstack-infra | 10:30 | |
| AJaeger | dguitarbite: please ping tonyb | 10:31 |
| *** esker has quit IRC | 10:32 | |
| AJaeger | onovy: see also http://lists.openstack.org/pipermail/openstack-dev/2015-December/082035.html | 10:34 |
| onovy | ok | 10:34 |
| *** e0ne has joined #openstack-infra | 10:36 | |
| *** sh1kel has joined #openstack-infra | 10:38 | |
| sh1kel | hello guys, i have a problem. i can't update my contact data in https://review.openstack.org/#/settings/contact. When i push "Save Changes" button, i get message Code Review - Error Server Error Cannot store contact information | 10:40 |
| openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/256238 | 10:43 |
| yolanda | that is the change that we were expecting ^ | 10:43 |
| *** acabot has quit IRC | 10:44 | |
| *** ldnunes has joined #openstack-infra | 10:45 | |
| *** ashishb has quit IRC | 10:46 | |
| *** dizquierdo has joined #openstack-infra | 10:47 | |
| *** fawadkhaliq has joined #openstack-infra | 10:47 | |
| *** koolhead17 has joined #openstack-infra | 10:48 | |
| *** koolhead17 has quit IRC | 10:48 | |
| *** koolhead17 has joined #openstack-infra | 10:48 | |
| *** esker has joined #openstack-infra | 10:48 | |
| *** otter768 has joined #openstack-infra | 10:49 | |
| *** _denisra has quit IRC | 10:50 | |
| sh1kel | openstack infra root please help | 10:50 |
| *** mkj_wk has quit IRC | 10:51 | |
| *** mkj_wk has joined #openstack-infra | 10:52 | |
| *** otter768 has quit IRC | 10:53 | |
| *** esker has quit IRC | 10:54 | |
| openstackgerrit | Evgeniy L proposed openstack-infra/system-config: Add statusbot/eavesdrop to #openstack-bareon channel https://review.openstack.org/255804 | 10:58 |
| yolanda | hi sh1kel | 11:01 |
| *** AJaeger has quit IRC | 11:01 | |
| yolanda | have you followed all instructions to configure gerrit properly? | 11:01 |
| *** ppai has quit IRC | 11:02 | |
| sh1kel | hello Yolanda | 11:02 |
| sh1kel | can you help me with error in https://review.openstack.org/#/settings/contact? | 11:02 |
| *** leakypipes has quit IRC | 11:02 | |
| *** flepied has joined #openstack-infra | 11:02 | |
| dguitarbite | tonyb: can we get his merged? https://review.openstack.org/#/c/254122/ | 11:03 |
| igorbelikov | AJaeger, yolanda: would you mind looking at https://review.openstack.org/#/c/252936/ when you'll have the time? It's a simple one, but it didn't receive any attention for over a week | 11:03 |
| yolanda | sh1kel , have you followed guidelines on https://wiki.openstack.org/wiki/How_To_Contribute#If_you.27re_a_developer ? | 11:03 |
| sh1kel | yep | 11:04 |
| yolanda | also http://docs.openstack.org/infra/manual/developers.html#account-setup ? | 11:04 |
| yolanda | have you accepted license agreement? | 11:04 |
| sh1kel | yes, i did it some month ago | 11:05 |
| yolanda | also look at https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/ | 11:05 |
| yolanda | have you followed that? | 11:05 |
| sh1kel | yes, i just cant save my contact information because of error | 11:05 |
| *** binbincong has quit IRC | 11:06 | |
| sh1kel | and i can't send any info to gerrit without contact information filled | 11:06 |
| yolanda | can you double check that the email you have in openstack profile page http://openstack.org/profile matches the one you use as primary email on gerrit? | 11:07 |
| sh1kel | yep | 11:08 |
| *** ig0r_ has joined #openstack-infra | 11:09 | |
| yolanda | what's your email in gerrit? so i can debug | 11:09 |
| sh1kel | aelagin@mirantis.com | 11:10 |
| *** esker has joined #openstack-infra | 11:11 | |
| *** admin0 has joined #openstack-infra | 11:11 | |
| yolanda | and the link of your openstack.org profile? | 11:12 |
| ekarlso | any of you know if neutron devstack is bork atm? | 11:13 |
| *** AJaeger has joined #openstack-infra | 11:13 | |
| sh1kel | http://www.openstack.org/community/members/profile/50598 | 11:13 |
| *** koolhead17 has left #openstack-infra | 11:14 | |
| *** aysyd has joined #openstack-infra | 11:16 | |
| yolanda | ok let me check logs | 11:16 |
| *** ddieterly has joined #openstack-infra | 11:17 | |
| *** esker has quit IRC | 11:17 | |
| *** AJaeger has quit IRC | 11:18 | |
| *** AJaeger_ has joined #openstack-infra | 11:18 | |
| *** AJaeger_ is now known as AJaeger | 11:18 | |
| *** binbincong has joined #openstack-infra | 11:18 | |
| *** aysyd has quit IRC | 11:20 | |
| openstackgerrit | Deepak C Shetty (deepakcs) proposed openstack-infra/project-config: Enable devstack-plugin-ceph NV jobs for glance and nova https://review.openstack.org/256359 | 11:20 |
| *** aysyd has joined #openstack-infra | 11:20 | |
| *** ddieterly has quit IRC | 11:22 | |
| *** jaypipes has joined #openstack-infra | 11:27 | |
| *** Guest67013 has quit IRC | 11:31 | |
| *** chlong has joined #openstack-infra | 11:33 | |
| *** flepied has quit IRC | 11:36 | |
| yolanda | sh1kel, if the email you provided me matches the one in openstack profile, i am out of ideas. I look at logs and see some errors related to contact information, but the main reason is always email not matching | 11:37 |
| yolanda | let's raise that problem later in the afternoon, where more infra-root can get new ideas | 11:39 |
| yolanda | infra-root, so there are several entries on gerrit error.log | 11:41 |
| yolanda | ERROR com.google.gerrit.server.contact.EncryptedContactStore : Cannot store encrypted contact information | 11:41 |
| yolanda | java.io.IOException: Store failed: 78111 | 11:41 |
| yolanda | do you know what can cause that? | 11:41 |
| *** vponomaryov has left #openstack-infra | 11:41 | |
| *** vponomaryov has joined #openstack-infra | 11:42 | |
| *** ig0r_ has quit IRC | 11:46 | |
| *** abregman has joined #openstack-infra | 11:48 | |
| *** abregman has quit IRC | 11:48 | |
| *** abregman has joined #openstack-infra | 11:48 | |
| *** abregman is now known as abregman|mafk | 11:49 | |
| *** ddieterly has joined #openstack-infra | 11:49 | |
| *** salv-orl_ has joined #openstack-infra | 11:50 | |
| *** vlaza has joined #openstack-infra | 11:50 | |
| *** salv-orlando has quit IRC | 11:54 | |
| *** salv-orl_ has quit IRC | 11:54 | |
| sh1kel | emm.. | 11:55 |
| sh1kel | i dont know) | 11:55 |
| *** erikwilson has joined #openstack-infra | 11:56 | |
| *** erikwilson has quit IRC | 12:01 | |
| *** jaypipes has quit IRC | 12:01 | |
| *** Hal has joined #openstack-infra | 12:02 | |
| *** Hal is now known as Guest61184 | 12:03 | |
| *** changbl has quit IRC | 12:04 | |
| *** smarcet has joined #openstack-infra | 12:05 | |
| *** julim has joined #openstack-infra | 12:06 | |
| *** ig0r_ has joined #openstack-infra | 12:15 | |
| *** rcernin has quit IRC | 12:18 | |
| *** links has quit IRC | 12:19 | |
| *** ig0r_ has quit IRC | 12:24 | |
| *** jaypipes has joined #openstack-infra | 12:25 | |
| *** admin0 has quit IRC | 12:28 | |
| *** aopincar has joined #openstack-infra | 12:29 | |
| *** salv-orlando has joined #openstack-infra | 12:31 | |
| *** jaypipes has quit IRC | 12:31 | |
| *** tlian has joined #openstack-infra | 12:31 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Add doc on launching jenkins job builder https://review.openstack.org/256389 | 12:33 |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Make VPN constraints jobs voting https://review.openstack.org/255992 | 12:33 |
| *** Ramanjaneya has quit IRC | 12:33 | |
| AJaeger | sdague: could you review this nova change again, please? https://review.openstack.org/#/c/255729 | 12:33 |
| *** gordc has joined #openstack-infra | 12:34 | |
| sdague | done | 12:35 |
| AJaeger | thanks! | 12:35 |
| *** dprince has joined #openstack-infra | 12:39 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Make LBaaS constraints jobs voting https://review.openstack.org/256391 | 12:43 |
| AJaeger | gordc: are you around to discuss your change? | 12:44 |
| *** scheuran has quit IRC | 12:45 | |
| *** claudiub has joined #openstack-infra | 12:46 | |
| gordc | AJaeger: yep | 12:46 |
| gordc | sorry, i'm not super familiar with everything in project-config | 12:46 |
| *** thorst has joined #openstack-infra | 12:46 | |
| AJaeger | gordc: no worries | 12:48 |
| AJaeger | gordc: I just commented on the review | 12:48 |
| *** flepied has joined #openstack-infra | 12:48 | |
| AJaeger | gordc: not using the usual templates will make it harder for you to update project-config ;) | 12:49 |
| AJaeger | gordc: but it might be the best tradeoff we can make... | 12:49 |
| *** flepied1 has joined #openstack-infra | 12:49 | |
| AJaeger | will be back later - lunch time... | 12:49 |
| gordc | AJaeger: yeah, i tried to reuse jobs templates but i couldn't find one which didn't run python27.. | 12:50 |
| *** otter768 has joined #openstack-infra | 12:50 | |
| gordc | or python34. if that runs, i think it'll end up running the same job that is currently timing out | 12:50 |
| gordc | i created a copy of existing python-jobs template but i figured it woudln't really solve the issue that my template will be different from standard python-jobs template | 12:51 |
| *** jaosorior has quit IRC | 12:52 | |
| *** jaosorior has joined #openstack-infra | 12:52 | |
| *** flepied has quit IRC | 12:53 | |
| *** otter768 has quit IRC | 12:54 | |
| *** jffische has joined #openstack-infra | 12:55 | |
| *** jaosorior has quit IRC | 12:56 | |
| *** zeih_ has quit IRC | 12:57 | |
| *** zeih has joined #openstack-infra | 12:58 | |
| *** esker has joined #openstack-infra | 12:59 | |
| *** EricGonczer_ has joined #openstack-infra | 12:59 | |
| *** jffische has left #openstack-infra | 12:59 | |
| *** sh1kel has quit IRC | 13:00 | |
| *** Guest61184 has quit IRC | 13:00 | |
| matrohon | Hi infra team | 13:02 |
| *** salv-orl_ has joined #openstack-infra | 13:03 | |
| *** esker has quit IRC | 13:03 | |
| *** weshay_xchat has joined #openstack-infra | 13:03 | |
| matrohon | I see hudson-openstack changing bug status from "In Progress" to "Fix release" on some bugs | 13:04 |
| matrohon | For instance : https://bugs.launchpad.net/bgpvpn/+bug/1517978 | 13:04 |
| openstack | Launchpad bug 1517978 in bgpvpn "neutronclient help info missing" [Medium,Fix released] - Assigned to Thomas Morin (tmmorin-orange) | 13:04 |
| *** pradk has quit IRC | 13:04 | |
| matrohon | Shouldn't it move the status to "Fix Commited" instead | 13:04 |
| *** kzaitsev_mb has joined #openstack-infra | 13:05 | |
| *** salv-orlando has quit IRC | 13:05 | |
| *** binbincong has quit IRC | 13:06 | |
| kzaitsev_mb | AJaeger: it completely slipped out of my mind, but we have removed the last non-global requirement from murano-agent | 13:06 |
| kzaitsev_mb | So I'm ready to make requirements job voting, just wanted to ask 1 thing | 13:07 |
| kzaitsev_mb | Do I need to do anything for openstack-proposal-bot to go and update the requirements? | 13:07 |
| kzaitsev_mb | they're probably a bit out of date right now ) | 13:07 |
| *** aopincar has quit IRC | 13:10 | |
| *** jistr is now known as jistr|biab | 13:10 | |
| *** placko has quit IRC | 13:11 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add UI for complex permissions on boards and worklists https://review.openstack.org/235476 | 13:12 |
| *** placko has joined #openstack-infra | 13:13 | |
| *** kozhukalov_ has quit IRC | 13:13 | |
| *** ddieterly has quit IRC | 13:13 | |
| AJaeger | matrohon: read the openstack-dev mailing list posts by Doug Hellmann to understand the change... | 13:15 |
| AJaeger | kzaitsev_mb: once the jobs are running, they'll update your list for you, you shouldn't need to do anything | 13:16 |
| AJaeger | kzaitsev_mb: you could run the sync manually to double check, there are instructions in the requirements repo for that | 13:16 |
| *** ig0r_ has joined #openstack-infra | 13:16 | |
| kzaitsev_mb | ok, will do ) | 13:16 |
| Shrews | mordred: SpamapS: jeblair: clarkb: fungi: I have several shade reviews that could use some love today | 13:16 |
| AJaeger | gordc: my idea was more of using the default environment for one job and an extra environment for the second, so tox -e py27 does the mysql ones and tox -e py27-postgresql the others... But let's see what others say | 13:17 |
| *** mohankumar has quit IRC | 13:19 | |
| gordc | AJaeger: ah, i see. our py27 tox job currently does everything but we can make change in gnocchi if required i guess. | 13:19 |
| *** esker has joined #openstack-infra | 13:19 | |
| AJaeger | so, kzaitsev_mb I'm looking forward for a change from you to remove the non-voting from the requirements job and using the requirements template for murano-agent then ;) | 13:20 |
| AJaeger | gordc: weight the pros and cons of that ;) consider what you tell developers to run locally in both cases... | 13:21 |
| *** egonzalez has quit IRC | 13:21 | |
| gordc | AJaeger: well we run even more granular jobs: ie py27-mysql-ceph. we don't have patience for 20min test let alone 40min :) | 13:23 |
| AJaeger | ;) | 13:24 |
| *** pblaho has joined #openstack-infra | 13:24 | |
| *** ddieterly has joined #openstack-infra | 13:25 | |
| *** ig0r_ has quit IRC | 13:25 | |
| *** esker has quit IRC | 13:26 | |
| matrohon | AJaeger, thanks | 13:27 |
| *** sdake has joined #openstack-infra | 13:28 | |
| *** dkranz has joined #openstack-infra | 13:28 | |
| openstackgerrit | gordon chung proposed openstack-infra/project-config: add requirements job to aodh https://review.openstack.org/256407 | 13:29 |
| AJaeger | gordc: that's an obvious change ;) ^ | 13:29 |
| gordc | AJaeger: lol, trying to keep your life simple :) | 13:31 |
| *** piyush__ has quit IRC | 13:31 | |
| *** jaypipes has joined #openstack-infra | 13:31 | |
| *** rhallisey has joined #openstack-infra | 13:31 | |
| *** rhallisey has quit IRC | 13:31 | |
| *** rhallisey has joined #openstack-infra | 13:31 | |
| openstackgerrit | gordon chung proposed openstack/requirements: add aodh to projects.txt https://review.openstack.org/244881 | 13:32 |
| *** jaypipes has quit IRC | 13:32 | |
| *** dims has joined #openstack-infra | 13:32 | |
| *** jaypipes has joined #openstack-infra | 13:34 | |
| *** ociuhandu has quit IRC | 13:34 | |
| *** dimsum__ has quit IRC | 13:36 | |
| *** ddieterly has quit IRC | 13:38 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Parse path correctly when it begins with /api https://review.openstack.org/254859 | 13:38 |
| *** salv-orl_ has quit IRC | 13:39 | |
| *** HeOS has quit IRC | 13:39 | |
| *** pradk has joined #openstack-infra | 13:40 | |
| *** Hal has joined #openstack-infra | 13:40 | |
| *** Hal is now known as Guest1486 | 13:41 | |
| *** tzn has quit IRC | 13:43 | |
| *** esker has joined #openstack-infra | 13:44 | |
| *** baoli has joined #openstack-infra | 13:45 | |
| *** derekh has joined #openstack-infra | 13:45 | |
| *** dguitarbite has quit IRC | 13:46 | |
| *** dprince has quit IRC | 13:46 | |
| *** baoli_ has joined #openstack-infra | 13:46 | |
| *** _nadya_ has joined #openstack-infra | 13:48 | |
| openstackgerrit | Julia Kreger proposed openstack-infra/shade: Add wait support for ironic node [de]activate https://review.openstack.org/253979 | 13:48 |
| *** esker has quit IRC | 13:48 | |
| *** samuelBartel has joined #openstack-infra | 13:49 | |
| *** baoli has quit IRC | 13:50 | |
| *** dprince has joined #openstack-infra | 13:50 | |
| *** dizquierdo has quit IRC | 13:50 | |
| *** lucasagomes is now known as lucas-afk | 13:51 | |
| *** fawadkhaliq has quit IRC | 13:52 | |
| *** kozhukalov_ has joined #openstack-infra | 13:55 | |
| *** dizquierdo has joined #openstack-infra | 13:56 | |
| *** ociuhandu has joined #openstack-infra | 13:56 | |
| *** mrmartin has quit IRC | 13:56 | |
| *** erikwilson has joined #openstack-infra | 13:57 | |
| *** smarcet has quit IRC | 14:00 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Align comment timestamps on the right on dashboard https://review.openstack.org/254802 | 14:02 |
| *** dprince_ has joined #openstack-infra | 14:02 | |
| *** erikwilson has quit IRC | 14:02 | |
| *** smarcet has joined #openstack-infra | 14:03 | |
| *** sfinucan has quit IRC | 14:03 | |
| *** hashar has quit IRC | 14:03 | |
| *** sdake has quit IRC | 14:03 | |
| *** hashar has joined #openstack-infra | 14:04 | |
| *** admin0 has joined #openstack-infra | 14:04 | |
| *** esker has joined #openstack-infra | 14:04 | |
| *** kgiusti has joined #openstack-infra | 14:05 | |
| *** bcourt has joined #openstack-infra | 14:06 | |
| *** dtantsur is now known as dtantsur|brb | 14:08 | |
| *** binbincong has joined #openstack-infra | 14:08 | |
| *** erikwilson has joined #openstack-infra | 14:09 | |
| *** jistr|biab is now known as jistr | 14:09 | |
| *** eil397 has quit IRC | 14:09 | |
| openstackgerrit | Merged openstack/requirements: Bump inspectorclient to 1.3.0 to support get_data https://review.openstack.org/255482 | 14:09 |
| openstackgerrit | Merged openstack/requirements: Bumps os-win version to 0.0.7 https://review.openstack.org/255045 | 14:09 |
| *** esker has quit IRC | 14:09 | |
| *** spzala has quit IRC | 14:09 | |
| *** derekh has quit IRC | 14:11 | |
| openstackgerrit | Jim Rollenhagen proposed openstack-infra/project-config: Switch all ironic jobs to use devstack plugin https://review.openstack.org/255942 | 14:11 |
| fungi | yolanda: the other common cause of that error is having a "community member" profile rather than "foundation member", per the first answer at https://ask.openstack.org/question/56720/ | 14:13 |
| fungi | the gerrit log entries for "Cannot store encrypted contact information" are generic because gerrit only either knows that the contact store returned a 200 ok or "something else" | 14:13 |
| fungi | it doesn't have any more detail about failures other than knowing that they're not successes | 14:14 |
| jordanP | tox 2.3 was released today and it seems to cause issue with Tempest: http://paste.openstack.org/show/481647/ | 14:14 |
| *** binbincong has quit IRC | 14:14 | |
| jordanP | it doesn"t hit the gate right now | 14:14 |
| jordanP | but it will soon I think | 14:15 |
| *** shardy has quit IRC | 14:15 | |
| fungi | jordanP: thanks for the heads up. it likely won't impact us until we have new worker images going into rotation | 14:15 |
| yolanda | fungi, it's an individual member profile http://www.openstack.org/community/members/profile/50598 | 14:15 |
| fungi | jordanP: since tox is preinstalled for us | 14:15 |
| jordanP | fungi, when will that be ? | 14:16 |
| jordanP | (new worker images) | 14:16 |
| *** changbl has joined #openstack-infra | 14:16 | |
| yolanda | sh1kel, can you check if you are a foundation member as fungi says? | 14:16 |
| fungi | jordanP: likely later today, in which case we'll need to delete those images if tempest isn't altered to work around it by then | 14:17 |
| *** shardy has joined #openstack-infra | 14:17 | |
| jordanP | ok | 14:17 |
| fungi | yolanda: i was going to ask sh1kel myself, but he seems to have left the channel | 14:17 |
| yolanda | oh | 14:17 |
| *** rlandy has joined #openstack-infra | 14:20 | |
| *** dprince_ has quit IRC | 14:21 | |
| *** dprince_ has joined #openstack-infra | 14:21 | |
| *** _nadya_ has quit IRC | 14:21 | |
| *** hdd has joined #openstack-infra | 14:26 | |
| *** dprince_ has quit IRC | 14:26 | |
| fungi | anyway, i've confirmed that i can update my contact info in gerrit, so if it's not an address mismatch or a profile type problem, then it's likely some sort of issue with sh1kel's foundation member account which is causing the api call to fail. the fallback is to open a bug against the openstack-org project on launchpad so we can bring it to the attention of the foundation staff web devs | 14:28 |
| *** daemontool has quit IRC | 14:28 | |
| *** peristeri has joined #openstack-infra | 14:29 | |
| *** ddieterly has joined #openstack-infra | 14:31 | |
| *** ddieterly has quit IRC | 14:31 | |
| *** shardy has quit IRC | 14:31 | |
| *** ddieterly has joined #openstack-infra | 14:31 | |
| *** alaski is now known as lascii | 14:35 | |
| yolanda | fungi thanks for the info | 14:35 |
| *** tzn has joined #openstack-infra | 14:35 | |
| yolanda | good to learn a new thing | 14:35 |
| *** jffische has joined #openstack-infra | 14:36 | |
| *** smarcet has quit IRC | 14:37 | |
| *** tzn has quit IRC | 14:40 | |
| *** sdake has joined #openstack-infra | 14:41 | |
| *** ig0r_ has joined #openstack-infra | 14:41 | |
| *** u_glide1 has joined #openstack-infra | 14:43 | |
| *** ig0r_ has quit IRC | 14:43 | |
| *** jaypipes has quit IRC | 14:47 | |
| *** amuller has joined #openstack-infra | 14:48 | |
| u_glide1 | ianw, clarkb: Hello, Could you please review https://review.openstack.org/233065/ ? Thanks in advance! | 14:49 |
| *** regXboi has joined #openstack-infra | 14:49 | |
| *** pradk has quit IRC | 14:51 | |
| *** otter768 has joined #openstack-infra | 14:51 | |
| *** pradk has joined #openstack-infra | 14:51 | |
| *** dansmith is now known as superdan | 14:53 | |
| *** christiana_ has quit IRC | 14:53 | |
| *** eharney has joined #openstack-infra | 14:55 | |
| *** otter768 has quit IRC | 14:55 | |
| *** kozhukalov_ has quit IRC | 14:56 | |
| *** xarses has quit IRC | 14:57 | |
| *** bcourt has quit IRC | 14:57 | |
| *** tzn has joined #openstack-infra | 14:59 | |
| *** bcourt has joined #openstack-infra | 15:00 | |
| *** rbrndt has joined #openstack-infra | 15:00 | |
| *** kozhukalov_ has joined #openstack-infra | 15:01 | |
| openstackgerrit | Merged openstack/requirements: Block oslo.utils 3.1.0 https://review.openstack.org/256116 | 15:01 |
| *** ig0r_ has joined #openstack-infra | 15:02 | |
| openstackgerrit | gordon chung proposed openstack/requirements: add aodh to projects.txt https://review.openstack.org/244881 | 15:02 |
| *** mohankumar has joined #openstack-infra | 15:02 | |
| *** mtanino has joined #openstack-infra | 15:03 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Make kanban cards be the correct width https://review.openstack.org/256457 | 15:05 |
| *** Liuqing has joined #openstack-infra | 15:05 | |
| *** jaypipes has joined #openstack-infra | 15:05 | |
| *** ig0r_ has quit IRC | 15:06 | |
| matrohon | AJaeger, for projects that use direct release, how can we now see the mapping between releases and launchpad bugs? | 15:06 |
| sdague | AJaeger: how long are we doubling all the non dsvm tests | 15:06 |
| sdague | 6 extra nodes on every nova patch is ... quite a lot | 15:07 |
| *** esker has joined #openstack-infra | 15:07 | |
| matrohon | AJaeger, Oh releases tools are now posting comments on bugs, I see | 15:07 |
| *** _nadya_ has joined #openstack-infra | 15:07 | |
| AJaeger | sdague: for the constraints? Until you decide that they are stable... | 15:08 |
| AJaeger | matrohon: read the mail thread and ask there... | 15:08 |
| *** shardy has joined #openstack-infra | 15:08 | |
| AJaeger | sdague: or Nakato considers them stable ;) | 15:09 |
| *** jbernard has quit IRC | 15:09 | |
| sdague | ok, they all seem to be spiking failures of late | 15:09 |
| sdague | http://tinyurl.com/hk8wa95 | 15:09 |
| openstackgerrit | Dong Ma proposed openstack/python-jenkins: Fixed create_node() Error https://review.openstack.org/254644 | 15:10 |
| AJaeger | might be due to the package that was removed from pypi | 15:10 |
| *** yonglihe has joined #openstack-infra | 15:10 | |
| AJaeger | we had it in the constraints already and due to constraints, wouldn't use an older version ;( | 15:10 |
| AJaeger | sdague: the "decorator===4.0.5" problem... | 15:11 |
| sdague | ok | 15:11 |
| *** links has joined #openstack-infra | 15:11 | |
| AJaeger | so, if we ignore that loop-hole, it looks you're ready to change | 15:11 |
| sdague | neat, so a new failure mode we didn't realize | 15:12 |
| AJaeger | sdague: yeah, hope lifeless is aware of that... | 15:12 |
| *** _nadya_ has quit IRC | 15:12 | |
| AJaeger | still the higher numbers on the 4th puzzle me. | 15:12 |
| *** admin0 has quit IRC | 15:13 | |
| *** bexelbie has quit IRC | 15:13 | |
| *** jbernard has joined #openstack-infra | 15:14 | |
| *** abhishekk has quit IRC | 15:14 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 15:15 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Grenade jobs for testing libraries (esp. oslo.messaging) https://review.openstack.org/256467 | 15:15 |
| *** eandersson has quit IRC | 15:19 | |
| openstackgerrit | Dong Ma proposed openstack-infra/jenkins-job-builder: Add support for cucumber reports plugin https://review.openstack.org/251489 | 15:21 |
| *** vgridnev has quit IRC | 15:22 | |
| *** tonytan4ever has joined #openstack-infra | 15:23 | |
| openstackgerrit | Vincent Françoise proposed openstack-infra/project-config: Python 3.4 support - add py34 gate https://review.openstack.org/256504 | 15:24 |
| *** tongli has joined #openstack-infra | 15:25 | |
| *** lucas-afk is now known as lucasagomes | 15:26 | |
| *** vlaza has left #openstack-infra | 15:27 | |
| *** tjones has joined #openstack-infra | 15:29 | |
| *** ociuhandu has quit IRC | 15:29 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Bump oslo.middleware to 3.2.0 https://review.openstack.org/256539 | 15:29 |
| *** zeih has quit IRC | 15:29 | |
| *** zeih has joined #openstack-infra | 15:30 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Grenade jobs for testing libraries (esp. oslo.messaging) https://review.openstack.org/256467 | 15:30 |
| *** xarses has joined #openstack-infra | 15:32 | |
| *** dims has quit IRC | 15:32 | |
| *** mohankumar has quit IRC | 15:33 | |
| *** tsg has joined #openstack-infra | 15:33 | |
| *** mohankumar has joined #openstack-infra | 15:33 | |
| *** mrmartin has joined #openstack-infra | 15:36 | |
| *** jyuso has quit IRC | 15:37 | |
| *** zeih has quit IRC | 15:39 | |
| *** zeih has joined #openstack-infra | 15:41 | |
| *** claudiub has quit IRC | 15:41 | |
| *** admin0 has joined #openstack-infra | 15:42 | |
| *** Liuqing has quit IRC | 15:42 | |
| *** dprince has quit IRC | 15:43 | |
| *** dprince has joined #openstack-infra | 15:43 | |
| *** claudiub has joined #openstack-infra | 15:44 | |
| *** zeih has quit IRC | 15:46 | |
| *** smarcet has joined #openstack-infra | 15:46 | |
| *** david-ly_ has joined #openstack-infra | 15:50 | |
| cbader | Ajaeger, I you are talking about the issue with "decorator===4.0.5" problem... I am seeing all my ci tests fail at 4:15 yesterday with this "decorator===4.0.5" problem... is there a fix coming | 15:51 |
| openstackgerrit | Craig Bryant proposed openstack-infra/project-config: Skip Tempest tests for monasca-api doc only changes https://review.openstack.org/256551 | 15:52 |
| *** bcourt has quit IRC | 15:53 | |
| *** david-lyle has quit IRC | 15:53 | |
| *** david-ly_ is now known as david-lyle | 15:53 | |
| dulek | jordanP, fungi: So tox update is starting to break grenade tests: https://review.openstack.org/#/c/247763/ | 15:53 |
| mordred | sdague, AJaeger: wow. this is the second time this week that someone has deleted a release from pypi | 15:54 |
| mordred | it would be really great if people would stop doing that | 15:54 |
| sdague | mordred: right, so I think we need to not consider that a black swan event | 15:54 |
| sdague | and realize people do it | 15:54 |
| mordred | yup. agree | 15:54 |
| mordred | although I | 15:54 |
| mordred | _don't_ have good ideas as to how to fix it at the moment | 15:54 |
| * mordred waits for lifeless and Nakato to have smarts | 15:55 | |
| *** amitgandhinz has joined #openstack-infra | 15:57 | |
| openstackgerrit | Victor Ryzhenkin proposed openstack-infra/project-config: Add check-requirements template to murano-agent https://review.openstack.org/256554 | 15:57 |
| *** yamahata has joined #openstack-infra | 15:58 | |
| *** placko has quit IRC | 15:59 | |
| AJaeger | cbader: should be fixed already... | 15:59 |
| openstackgerrit | Victor Ryzhenkin proposed openstack/requirements: Add openstack/murano-agent to projects.txt https://review.openstack.org/256555 | 16:00 |
| cbader | AJaeger, I see the bug in launchpad and just says confirmed not fixed | 16:00 |
| fungi | dulek: interesting, that job started around when new images would have first started coming online i think. i'll start rolling back any that are done building while people decide whether we go back to pinning a specific tox version for our images or fix tox or tempest somehow | 16:01 |
| AJaeger | cbader: https://review.openstack.org/#/c/256238/ is the fix and it was proposed by a bot that never heard about launchpad ;) | 16:01 |
| cbader | AJaeger, Thank you for the response. | 16:02 |
| clarkb | fwiw if a fix is possoble (config change etc) that shpuld be preferred | 16:03 |
| *** changbl has quit IRC | 16:03 | |
| clarkb | pinning tox is hard and confuses people | 16:03 |
| jordanP | many projects are affected, e.g nova | 16:04 |
| jordanP | we can"t land quickly a fix accross many repos | 16:04 |
| fungi | jordanP: oh, awesome. you originally said it was affecting tempest, which i took to mean other projects were fine | 16:04 |
| jordanP | so we should expect a fix from Tox, and it's going to take some time | 16:04 |
| jordanP | I notices that with tempest but then checked nova too | 16:05 |
| fungi | given past history, i'm not going to expect a fix from tox | 16:05 |
| *** dprince has quit IRC | 16:05 | |
| fungi | we should be prepared, as a community, to do mass tox.ini changes or, worst case, switch to something else instead of tox | 16:05 |
| jordanP | I'll start by creating a bug report to Tox | 16:06 |
| *** bcourt has joined #openstack-infra | 16:06 | |
| fungi | please do | 16:06 |
| mtreinish | jordanP: is this a different bug than https://bitbucket.org/hpk42/tox/issues/285 | 16:07 |
| jordanP | I don't know | 16:07 |
| fungi | i have a feeling it's related to the attempted "fix" for 285 in latest tox | 16:07 |
| jordanP | but this fix for #285 might have introduced a regressiob | 16:07 |
| fungi | yeah, that | 16:07 |
| *** dprince has joined #openstack-infra | 16:08 | |
| mtreinish | fungi: I didn't think the fix for 285 landed | 16:09 |
| *** hashar has quit IRC | 16:09 | |
| *** links has quit IRC | 16:09 | |
| *** armax has left #openstack-infra | 16:09 | |
| openstackgerrit | Victor Ryzhenkin proposed openstack/requirements: Add openstack/murano-agent to projects.txt https://review.openstack.org/256555 | 16:10 |
| fungi | all worker images built so far today have been deleted and i'll try to stay on top of squashing any more that come online throughout the day | 16:10 |
| fungi | mtreinish: the most recent comments indicate it's in 2.3.0.dev2 and later | 16:10 |
| *** daemontool has joined #openstack-infra | 16:11 | |
| fungi | 2.3.0 is later than 2.3.0.dev2 | 16:11 |
| apuimedo | AJaeger: any chance you could take a look at this silly patch https://review.openstack.org/#/c/252483/ | 16:11 |
| apuimedo | ? | 16:11 |
| mtreinish | fungi: it;s from someones branch | 16:12 |
| mtreinish | https://bitbucket.org/hpk42/tox/commits/all | 16:12 |
| fungi | mtreinish: "i think i have fully fixed the issue now, please try it out with [...] tox==2.3.0.dev2 as least [...] | 16:12 |
| fungi | 4 days ago | 16:12 |
| fungi | oh, maybe still only in the dev branch then? | 16:13 |
| *** FallenPegasus has quit IRC | 16:13 | |
| *** _nadya_ has joined #openstack-infra | 16:13 | |
| *** kozhukalov_ has quit IRC | 16:15 | |
| *** changbl has joined #openstack-infra | 16:16 | |
| AJaeger | apuimedo: I'm not a core for lodgeit and have enough on my plate, please find others to review it... | 16:16 |
| *** erikwilson has quit IRC | 16:16 | |
| fungi | mtreinish: aha, looks like 2.3.0.dev2 and 2.3.0.dev3 packages in his devpy are built from the https://bitbucket.org/hpk42/tox/commits/branch/issue285 branch | 16:17 |
| jordanP | https://bitbucket.org/hpk42/tox/issues/294/tox-23-regression | 16:17 |
| apuimedo | AJaeger: sorry then ;-) | 16:17 |
| onovy | yolanda, vponomaryov AJaeger: https://review.openstack.org/#/c/245603/ still failing. :/ | 16:17 |
| *** erikwilson has joined #openstack-infra | 16:17 | |
| *** erikwilson has quit IRC | 16:18 | |
| *** harlowja_at_home has joined #openstack-infra | 16:18 | |
| openstackgerrit | Merged openstack-infra/shade: Add wait support for ironic node [de]activate https://review.openstack.org/253979 | 16:18 |
| fungi | mtreinish: though i see stuff merged from the issue285 branch into the default branch prior to the 2.3.0 tag so i think it is expected to be fixed in 2.3.0 | 16:18 |
| *** mohankumar has quit IRC | 16:18 | |
| mtreinish | ah ok | 16:18 |
| *** unicell has joined #openstack-infra | 16:19 | |
| jordanP | it seems the tox author is already aware of this issue | 16:20 |
| jordanP | which is good | 16:20 |
| AJaeger | onovy: that job timed out ;( | 16:20 |
| *** bexelbie_ has joined #openstack-infra | 16:20 | |
| *** ig0r_ has joined #openstack-infra | 16:21 | |
| *** jlvillal has quit IRC | 16:22 | |
| *** jlvillal has joined #openstack-infra | 16:22 | |
| AJaeger | not sure whether we need to increase the timeout there... | 16:24 |
| *** jlvillal has quit IRC | 16:24 | |
| AJaeger | fungi, do you know why the requirements gate times out? see 245603 | 16:24 |
| openstackgerrit | Merged openstack-infra/shade: Make a new swift client prior to each image upload https://review.openstack.org/255623 | 16:26 |
| openstackgerrit | Merged openstack-infra/shade: Improve test coverage: container/object list API https://review.openstack.org/255926 | 16:26 |
| fungi | AJaeger: there's a pretty lengthy pause at http://logs.openstack.org/03/245603/2/check/gate-requirements-integration-dsvm/46a7734/console.html#_2015-12-11_15_29_31_420 | 16:27 |
| *** jlvillal has joined #openstack-infra | 16:28 | |
| *** bpokorny has joined #openstack-infra | 16:28 | |
| AJaeger | fungi, you have better eyes than I have ;/ | 16:28 |
| fungi | not sure what step that's at, but someone can probably match it up to the script to find out | 16:28 |
| *** kozhukalov_ has joined #openstack-infra | 16:28 | |
| *** annegentle has joined #openstack-infra | 16:28 | |
| fungi | looks like it's generate-constraints taking ~40 minutes to run | 16:29 |
| *** admin0 has quit IRC | 16:29 | |
| fungi | though the job times out at around 2 hours so there's got to be more to it than just that delay | 16:29 |
| AJaeger | onovy: better debug with lifeless | 16:30 |
| *** jlvillal has quit IRC | 16:30 | |
| *** rossella_s has quit IRC | 16:30 | |
| AJaeger | lifeless: see above, we wonder why 245603 gets timeouts | 16:30 |
| mordred | fungi: that seems like a long time for that to take | 16:30 |
| fungi | devstack takes about 25 minutes to run at http://logs.openstack.org/03/245603/2/check/gate-requirements-integration-dsvm/46a7734/console.html#_2015-12-11_14_26_23_060 | 16:30 |
| AJaeger | so, the usual recheck? | 16:30 |
| *** rossella_s has joined #openstack-infra | 16:30 | |
| *** jlvillal has joined #openstack-infra | 16:31 | |
| fungi | AJaeger: 3 rechecks since december 3, all of which failed the integration job | 16:32 |
| fungi | though the one on the 3rd was because of linuxbridge issues in devstack | 16:34 |
| AJaeger | passed on the 2nd December... | 16:34 |
| fungi | i think | 16:34 |
| *** ddieterly has quit IRC | 16:34 | |
| openstackgerrit | Merged openstack-infra/shade: Improve test coverage: volume attach/detach API https://review.openstack.org/255534 | 16:34 |
| openstackgerrit | Merged openstack-infra/shade: Bug fix: Fix pass thru filtering in list_networks https://review.openstack.org/254884 | 16:34 |
| fungi | ahh, the failures on the 3rd and 4th were both neutron ml2 linuxbridge plugin packaging issues | 16:35 |
| fungi | so this looks like the first time it's failed from a timeout of that job | 16:35 |
| fungi | but the previous two never ran to completion due to another bug | 16:35 |
| AJaeger | jroll: do you want to WIP https://review.openstack.org/#/c/255942/ or should we merge that quickly? ;) | 16:35 |
| *** armax has joined #openstack-infra | 16:36 | |
| zaro | morning | 16:36 |
| fungi | AJaeger: onovy: so yeah, might have just been a really slow worker? i'd recheck and see if you get similar performance issues on the next run | 16:36 |
| *** ddieterly has joined #openstack-infra | 16:36 | |
| onovy | so should i write recheck again? :) | 16:36 |
| AJaeger | onovy: yes, lease | 16:37 |
| AJaeger | please I mean. | 16:37 |
| *** arxcruz has quit IRC | 16:37 | |
| AJaeger | onovy: and reverify is deprecated, use "recheck" | 16:37 |
| onovy | ok | 16:37 |
| onovy | done | 16:37 |
| onovy | if reverify is deprecated, why "recheck" now (after +A+V) runs in check and not in gate queue? | 16:39 |
| jroll | AJaeger: wip'd. still need to figure out what to do about stable branches :/ | 16:39 |
| jroll | thanks for pointing that out | 16:39 |
| mordred | onovy: recheck runs in both | 16:40 |
| fungi | onovy: because all changes have to pass the check pipeline jobs before they're reenqueued into the gate pipeline | 16:40 |
| mordred | that ^^ | 16:40 |
| onovy | ah | 16:40 |
| jroll | AJaeger: actually, devstack is branched, so the ironic code will be in stable devstack. if enable_plugin doesn't fail on unavailable plugins, we're good, otherwise I guess I special case that? | 16:40 |
| onovy | thanks | 16:40 |
| *** armax has quit IRC | 16:40 | |
| *** mrmartin has quit IRC | 16:40 | |
| fungi | onovy: so if your change passes check jobs, then fails gate jobs, it needs to pass check jobs _again_ before gate jobs get reattempted | 16:41 |
| onovy | fungi, yep, got it | 16:41 |
| fungi | as an added safety check | 16:41 |
| *** terriyu has joined #openstack-infra | 16:42 | |
| *** mfalatic has joined #openstack-infra | 16:42 | |
| fungi | we were seeing lots of changes sit around for up to many months sometimes after passing check before gettign approved, and in that time new jobs may have been added or other parts of the repo changed which mean that the same change could never pass check at that point | 16:42 |
| AJaeger | jroll: your plugin is in ironic, not devstack. I guess it fails. sdague, what do you think about branch hanlding on https://review.openstack.org/#/c/255942/ ? | 16:42 |
| *** terriyu has quit IRC | 16:43 | |
| *** terriyu has joined #openstack-infra | 16:43 | |
| jroll | AJaeger: yeah, it probably does fail... wondering if we can put a conditional in project-config based on the branch | 16:44 |
| *** dtantsur|brb is now known as dtantsur | 16:44 | |
| *** devananda has quit IRC | 16:45 | |
| *** terriyu has quit IRC | 16:45 | |
| *** mfalatic has quit IRC | 16:45 | |
| *** terriyu has joined #openstack-infra | 16:46 | |
| AJaeger | jroll: see jenkins/jobs/heat.yaml and search for kilo | 16:46 |
| *** jordanP has quit IRC | 16:46 | |
| AJaeger | or backport it... | 16:47 |
| *** jordanP has joined #openstack-infra | 16:47 | |
| * AJaeger has to leave now... | 16:47 | |
| *** devananda has joined #openstack-infra | 16:47 | |
| *** kozhukalov_ has quit IRC | 16:47 | |
| *** ig0r_ has quit IRC | 16:47 | |
| *** salv-orlando has joined #openstack-infra | 16:48 | |
| sdague | jroll: yeh, doing the conditional based on branch is the right approach | 16:48 |
| *** sputnik13 has joined #openstack-infra | 16:48 | |
| * AJaeger wishes everybody a nice weekend | 16:49 | |
| *** AJaeger has quit IRC | 16:49 | |
| *** samuelBartel has quit IRC | 16:50 | |
| nibalizer | :) | 16:50 |
| jroll | sdague: cool, thanks | 16:51 |
| *** otter768 has joined #openstack-infra | 16:51 | |
| cbader | is there a fix for the TOX issue or is there a way to lock my TOX test to the pre 2.3 release? | 16:52 |
| *** alex_xu has quit IRC | 16:53 | |
| jordanP | cbader, https://bitbucket.org/hpk42/tox/issues/294/tox-23-regression | 16:53 |
| clarkb | cbader: we have deleted our newest slave images in order to rollback to previous version of tox | 16:53 |
| jordanP | pip install tox==2.2 should do | 16:53 |
| *** alex_xu has joined #openstack-infra | 16:54 | |
| cbader | jordanP, thanks for information | 16:54 |
| openstackgerrit | Jim Rollenhagen proposed openstack-infra/project-config: Switch all ironic jobs to use devstack plugin https://review.openstack.org/255942 | 16:54 |
| *** FallenPegasus has joined #openstack-infra | 16:55 | |
| jroll | sdague: ^ I think that should do it, assuming juno is for-real-gone now | 16:55 |
| clarkb | jroll: it is | 16:55 |
| *** FallenPegasus is now known as MarkAtwood | 16:56 | |
| *** Piet has joined #openstack-infra | 16:56 | |
| *** otter768 has quit IRC | 16:57 | |
| onovy | can someone reply to this please? http://lists.openstack.org/pipermail/openstack-infra/2015-November/003475.html | 16:57 |
| *** daemontool_ has joined #openstack-infra | 17:00 | |
| *** kozhukalov_ has joined #openstack-infra | 17:00 | |
| *** esker has quit IRC | 17:01 | |
| *** daemontool has quit IRC | 17:02 | |
| *** fawadkhaliq has joined #openstack-infra | 17:02 | |
| *** yamahata has quit IRC | 17:03 | |
| *** jlanoux has quit IRC | 17:03 | |
| *** harlowja_at_home has quit IRC | 17:03 | |
| openstackgerrit | venkatamahesh proposed openstack-infra/project-config: Drop quamtum from ENABLED_SERVICES https://review.openstack.org/250913 | 17:04 |
| *** claudiub|2 has joined #openstack-infra | 17:05 | |
| *** unicell has quit IRC | 17:05 | |
| fungi | onovy: i'm not sure anyone reading that ml has any better answer than the information you already linked | 17:05 |
| *** vilobhmm11 has joined #openstack-infra | 17:05 | |
| *** pblaho has quit IRC | 17:05 | |
| *** vilobhmm11 has quit IRC | 17:05 | |
| mtreinish | fungi, clarkb, nibalizer: if you get a sec can you restart the logstash gearman client and the subunit gearman worker? | 17:05 |
| *** _nadya_ has quit IRC | 17:06 | |
| mtreinish | there have been a few recent changes to both and it doesn't look like puppet restarted either when they were picked up | 17:06 |
| onovy | fungi, but that's not answer :) just want to know if i should add this to cutter and my project (swauth) or should i remove it from swift,keystone,etc. :) | 17:06 |
| onovy | to keep it consistent | 17:06 |
| pleia2 | taron: did you want to create a docs page for codesearch.o.o? Doesn't need to be complicated, but I want to wrap up the spec for it, I can take care of it if you're busy :) | 17:06 |
| mtreinish | pleia2: ^^^ you can help too :) | 17:06 |
| * mtreinish will remember one day | 17:06 | |
| fungi | onovy: and i'm saying you have as much information as the rest of us as to whether that's warranted | 17:06 |
| *** sdake_ has joined #openstack-infra | 17:07 | |
| *** claudiub has quit IRC | 17:07 | |
| fungi | onovy: it's not really an infra question, it's a tox (and pip) question. and the tox authors seem to have answered it in their documentation | 17:07 |
| onovy | exactly it's infra question too | 17:07 |
| *** matrohon has quit IRC | 17:07 | |
| onovy | from tox/pip point of view is correct way to remove this obsolete option | 17:07 |
| *** jcoufal has quit IRC | 17:08 | |
| onovy | but from infra point of view: will it break cache in some way? | 17:08 |
| fungi | onovy: yeah, that's how i interpret the documentation as well | 17:08 |
| clarkb | mtreinish: sure, the client is a little backlogged so we should avoid restarting it now, but can try t odo that if the job queue falls off | 17:08 |
| jgriffith | mordred: ping | 17:08 |
| fungi | onovy: break what cache? | 17:08 |
| *** sdake has quit IRC | 17:08 | |
| *** Piet has quit IRC | 17:08 | |
| mordred | jgriffith: heya | 17:08 |
| onovy | fungi, pip download cache | 17:08 |
| fungi | onovy: pip (recent versions anyway) build and cache wheels of everything | 17:08 |
| jgriffith | mordred: hola! | 17:08 |
| mtreinish | clarkb: ok cool, thanks | 17:08 |
| jgriffith | mordred: hey, wanted to get your thoughts on something.... | 17:09 |
| onovy | i think infra don't want to download every pip package again and again from pypi web | 17:09 |
| fungi | onovy: by default | 17:09 |
| fungi | onovy: we don't, we rely on pip's default behavior to not do that | 17:09 |
| onovy | SO this cache is working fine "by default"? | 17:09 |
| fungi | onovy: correct | 17:09 |
| jgriffith | mordred: with the newish timelines on how quickly stable releases go to sec fix only.... are you hearing much feedback about issues with distros and how to support things? | 17:09 |
| onovy | so i should send review to remove this option, right? :) | 17:09 |
| *** bexelbie_ has quit IRC | 17:09 | |
| mtreinish | clarkb: for the client side it should just be an updated yaml config from system config. But, IIRC there isn't a reload config for it | 17:09 |
| onovy | because it's obsolete and from infra point of view useless | 17:10 |
| cbader | clarkb, question about deleting latest slave versions are talking about nodepool images? | 17:10 |
| fungi | onovy: sounds like it--i'm basing this on reading the same documentation you are though | 17:10 |
| zaro | infra-core: anybody want to help land pre gerrit-upgrade changes? | 17:10 |
| jgriffith | mordred: in other words, a number of distros are just geting traction on Kilo... finding issues; and my response has been "I can give you something out of tree.. but other than that you're kinda SOL until next year" | 17:10 |
| zaro | infra-core: like today? | 17:10 |
| fungi | onovy: which is why i'm saying i don't have any better answer than the information you've already found about it | 17:10 |
| *** annegentle has quit IRC | 17:10 | |
| onovy | fungi, ok, but how can i be sure? how can i check if this cache (default config) works fine inside infra? | 17:10 |
| clarkb | cbader: yes | 17:11 |
| fungi | onovy: we run tox. check if it works with tox | 17:11 |
| clarkb | cbader: nodepool keeps two images, latest and previous. If you delete latest while previous still has old tox you essentially revert to that state. fungi went ahead and did this for us | 17:11 |
| fungi | onovy: "inside infra" still just runs tox | 17:11 |
| mordred | jgriffith: not really? I mean, one of the problems with older openstack releases is that people dont' bother to do anything with them upstream | 17:11 |
| cbader | clarkb, sorry new to this process, ok will figure out how to do that. | 17:11 |
| jgriffith | mordred: hehe... fair enough | 17:12 |
| onovy | fungi, ok, so if running tox again and again don't download pip packages again, it's working fine and it will work fine inside infra too | 17:12 |
| *** fawadkhaliq has quit IRC | 17:12 | |
| mtreinish | jgriffith: I can make the rant about upstream stable if you'd like :) | 17:12 |
| fungi | cbader: the number of previous images nodepool keeps is also configurable | 17:12 |
| clarkb | cbader: nodepool image list will report images, you should have two for each image. The one with a bigger timestamp is older, delete the one with the smaller timestamp | 17:12 |
| jgriffith | mtreinish: heeh.. I LOVE rants! | 17:12 |
| clarkb | cbader: using nodepool image-delete $imageid | 17:12 |
| mtreinish | jgriffith: I'm tired of this one, because nothing changes | 17:12 |
| cbader | clarkb, thanks looking now. | 17:12 |
| *** miqui has quit IRC | 17:12 | |
| *** shardy has quit IRC | 17:13 | |
| mordred | greghaynes, clarkb: so - _apparently_ qemu-img can now produce bootable vhd files for rax - AND they're supposedly smaller too | 17:13 |
| jgriffith | mtreinish: interesting... so in your view it's distros NOT upgrading their versions of stable? | 17:13 |
| clarkb | mordred: woah | 17:13 |
| *** miqui has joined #openstack-infra | 17:13 | |
| mordred | clarkb: I'm going to start poking at it | 17:13 |
| clarkb | mordred: that sounds like voodoo | 17:13 |
| jgriffith | mtreinish: that's different than what I'm talking/thinking but I'm interested in what you're saying | 17:13 |
| clarkb | smaller vhds? | 17:13 |
| jgriffith | mtreinish: the problem I'm getting at is some distros are JUST NOW rolling out Kilo | 17:14 |
| openstackgerrit | Timur Sufiev proposed openstack-infra/project-config: Don't install sahara in horizon integration tests https://review.openstack.org/256593 | 17:14 |
| mordred | clarkb: yah | 17:14 |
| mordred | clarkb: https://github.com/coreos/scripts/blob/master/build_library/vm_image_util.sh#L467 | 17:14 |
| fungi | jgriffith: you refer to "recent" shortened timelines for stable branch backporting/support. can you elaborate? from my point of view it's at least as lengthy as before, if not longer on average | 17:14 |
| mtreinish | jgriffith: I actually don't care what distros do, but they complain about limited upstream stable windows | 17:14 |
| mordred | clarkb: is what they use for vhd | 17:14 |
| jgriffith | mtreinish: and Kilo is already in Sec mode only... so when they find things... well they're pretty well F'd | 17:14 |
| mordred | clarkb: for rackspace | 17:14 |
| *** nelsnelson has joined #openstack-infra | 17:14 | |
| *** nelsnels_ has quit IRC | 17:14 | |
| mtreinish | and then do nothign to actually help with sustaining anything | 17:14 |
| *** ifarkas has quit IRC | 17:14 | |
| mtreinish | so it's their own fault | 17:14 |
| lifeless | fungi: tox passenv perhaps? not sure, can't look today, sorry | 17:14 |
| clarkb | mordred: huh any idea how new of a qemu-img that requires? | 17:14 |
| jgriffith | fungi: I *thought* we used to give about a year before going sec-only, but I could be completely mistaken | 17:14 |
| *** shardy has joined #openstack-infra | 17:15 | |
| *** fawadkhaliq has joined #openstack-infra | 17:15 | |
| mordred | clarkb: and I'm told that vhd-util writes blocks even if they're all zeros | 17:15 |
| mordred | clarkb: nope. sending an email to ask that question | 17:15 |
| fungi | jgriffith: no, we've been consistently switching stable branches to eol at or before a year | 17:15 |
| clarkb | mordred: in any case that looks promising so yay | 17:15 |
| jgriffith | fungi: cool... fair enough | 17:15 |
| lifeless | mordred: re: deleted-from-pypi, sure; we can either run a mirror and gate updates to it, or make adjusting *-constraints fast when it happens | 17:15 |
| jgriffith | fungi: so that part doesn't matter :) The problem I still see though is MOST distros don't seem to be able to get a release out for almost a year | 17:16 |
| fungi | jgriffith: anyway, the "security fixes only" thing is really more of a guideline for stable branch backporters and reviewers to work out among themselves | 17:16 |
| *** gyee has joined #openstack-infra | 17:16 | |
| mordred | lifeless: well, we do run a mirror, but we use the mirroring protocol which propogates deletes | 17:16 |
| jgriffith | fungi: so that's sort of what I'm wondering about.... but it doesn't sound like others are really getting feedback on this | 17:16 |
| lifeless | mordred: I know :) | 17:16 |
| jgriffith | fungi: true.. but then there's the point made by mordred and mtreinish (I think) that distros may or may not do anything with the updates anyway :( | 17:17 |
| fungi | jgriffith: if people are coming up with good bug fixes backported to stable branches then great, but in the past that's not been the case (distros were mostly just maintaining their own forks as much as we encouraged them to pitch in on backporting stuff upstream instead) | 17:17 |
| pleia2 | jd__: closure of #openstack-ceilometer is officially done now | 17:17 |
| jgriffith | so that just means "distros suck" :) | 17:17 |
| lifeless | I guess 3) lobby pypi to remove delete-a-release functionality | 17:17 |
| mordred | dstufft: ^^ +100 | 17:17 |
| jgriffith | fungi: ewww | 17:17 |
| clarkb | sdague: mtreinish ianw if you get a moment can you see my question on https://review.openstack.org/#/c/250913/ | 17:17 |
| clarkb | sc68cal: ^ you problably know as well | 17:18 |
| *** sputnik13 has quit IRC | 17:18 | |
| jgriffith | fungi: ok, that all makes sense... thanks all of you for your input/thoughts | 17:18 |
| fungi | jgriffith: to rephrase, our stable support timelines are inferred from the amount of interest in those branches (gauged by the actual work put in by people to maintain them) | 17:18 |
| *** annegentle has joined #openstack-infra | 17:18 | |
| *** sputnik13 has joined #openstack-infra | 17:19 | |
| jgriffith | fungi: yeah, I think I get it. But there are some reviewers that take the guidelines pretty literal :) | 17:19 |
| fungi | jgriffith: so if distros start coming forward actively engaging upstream on maintaining working stable branch support then we (gradually) lengthen the planned support/eol timeframes | 17:19 |
| *** agentle_ has joined #openstack-infra | 17:19 | |
| *** dims has joined #openstack-infra | 17:19 | |
| *** agentle_ has quit IRC | 17:19 | |
| fungi | and they're longer now than they were, say, 2-3 years ago | 17:20 |
| *** annegentle has quit IRC | 17:20 | |
| jgriffith | fungi: ahhh.... got it, instead of forking and just screwing up the whole process | 17:20 |
| sdague | clarkb: yeh, we should remove it | 17:20 |
| *** annegentle has joined #openstack-infra | 17:20 | |
| cbader | clarkb, after delete of bad image do I need to delete the nodepool vm that was probably running the image I just deleted | 17:20 |
| clarkb | sdague: not replace it with 'neutron' ? | 17:20 |
| sdague | nope | 17:20 |
| clarkb | sdague: thanks | 17:20 |
| sdague | I think I said that in patch 1 | 17:21 |
| clarkb | cbader: depends, if you know they will fail anyways go for it otherwise might be worth letting them work their way through on their own | 17:21 |
| clarkb | sdague: oh yup | 17:21 |
| fungi | jgriffith: instead, from what i've seen most of the backporting and reviewing being done on stable branches is still coming primarily from upstream developers who are also working on master development | 17:21 |
| cbader | clarkb, ok thanks will watch and see. | 17:21 |
| *** abregman|mafk is now known as abregman | 17:21 | |
| *** EricGonc_ has joined #openstack-infra | 17:22 | |
| jgriffith | fungi: I totally concur with that observation | 17:22 |
| fungi | jgriffith: most of the time downstreams like distros have one or two token people who can spend some of their spare time pitching in, but they're generally busy doing other stuff and don't really have much time for this | 17:22 |
| jgriffith | fungi: ya know, that's an interesting point. I never really paid attention to that, but looking at the git-logs it's kinda sad | 17:23 |
| clarkb | infra-root https://review.openstack.org/#/q/status:open+topic:gerrit-upgrade,n,z has a bunch of changes that can actually merge nowish well ahead of the upgrade /me is actually double checking on whether or not I can approve one of them now. All this to say reviews welcome so we can be prepared for next week | 17:23 |
| jgriffith | fungi: you'd think that if you're trying to make money of of this then you'd invest a little | 17:23 |
| *** kzaitsev_mb has quit IRC | 17:23 | |
| fungi | so in the end, it's downstreams asking the primary development teams to also develop stable branches for them | 17:23 |
| *** sputnik13 has quit IRC | 17:23 | |
| jgriffith | fungi: indeed... and I now understand the comments by mordred and mtreinish | 17:23 |
| *** daemontool_ has quit IRC | 17:24 | |
| fungi | and interest from those developers is in short enough supply that it's hard to keep it going after the code they're maintaining is >1 year old | 17:24 |
| openstackgerrit | venkatamahesh proposed openstack-infra/project-config: Drop quamtum from ENABLED_SERVICES https://review.openstack.org/250913 | 17:24 |
| fungi | you end up frustrated that you're working around bugs you've solved in better, cleaner ways in master | 17:24 |
| jgriffith | fungi: don't get me wrong... I have ZERO sympathy for the vendor/distro in these cases.... I was only trying to figure out how to help the end customer.... and it turns out this is EXACTLY one of those cases | 17:25 |
| mtreinish | jgriffith: this is a visualization I like that shows how stable things work: http://i.imgur.com/bt8lUZM.png | 17:25 |
| fungi | jgriffith: yep, it's a hard problem | 17:25 |
| jd__ | thanks pleia2 ! | 17:25 |
| *** EricGonczer_ has quit IRC | 17:25 | |
| mtreinish | and that's not including requirements issues or anything that breaks before tempest is run... | 17:25 |
| *** miqui has quit IRC | 17:26 | |
| mtreinish | it's a very consistent trend | 17:26 |
| *** miqui has joined #openstack-infra | 17:26 | |
| jgriffith | I"m glad I popped in and asked... enlightening... sad, but enlightening | 17:27 |
| fungi | mtreinish: that's very interesting | 17:27 |
| fungi | master: 98.67%, stable/liberty: 97.93%, stable/kilo: 97.48%, stable/juno: 86.67% | 17:28 |
| clarkb | ya gerrit does not subscribe to its config and should ignore config options it doesn't know about there fore I am approving https://review.openstack.org/#/c/253260/ can anyone think of a reason to not have groups visible by default? | 17:28 |
| clarkb | jeepyb does it manually so having it just happen in gerrit would be nice I think | 17:28 |
| *** abregman is now known as abregman|afk | 17:28 | |
| mtreinish | fungi: yep, it's something I've seen for a long time. But now I have pictures to back it up :) | 17:28 |
| fungi | mtreinish: i'm imagining some curve sliced in discrete windows | 17:29 |
| *** jffische has quit IRC | 17:29 | |
| *** ashleighfarnham has joined #openstack-infra | 17:29 | |
| fungi | mtreinish: where, if we did still "maintain" stable/icehouse it would be somwhere in the 25% pass rate | 17:29 |
| *** tjones has quit IRC | 17:29 | |
| mtreinish | haha, yeah | 17:29 |
| *** abregman|afk is now known as abregman | 17:30 | |
| fungi | i mean, the drop off at juno is pretty drastic | 17:30 |
| pleia2 | zaro: want to have a look at nibalizer's comment on this change? I think it's a good idea, so we don't miss it: https://review.openstack.org/#/c/246020/ | 17:30 |
| *** vilobhmm11 has joined #openstack-infra | 17:30 | |
| fungi | it was clearly due for eol | 17:30 |
| zaro | pleia2: will push another patch for that | 17:31 |
| jeblair | i don't think we've used the hold-following-changes feature in zuul for a long time; should i drop it in zuulv3? | 17:31 |
| mtreinish | fungi: yep, which is why all those ML threads really annoyed me... | 17:31 |
| clarkb | mtreinish: thats neat, I have often imagined a release system based on numbers like that rather than timescales | 17:31 |
| pleia2 | zaro: thanks :) | 17:31 |
| jeblair | i want to say we used it for the "-merge" job before zuul had its own merger | 17:31 |
| *** skolekonov is now known as _skolekonov | 17:31 | |
| clarkb | mtreinish: basically if a rolling average gets above some value (or some other statistical model) cut a release automagically | 17:31 |
| jeblair | but i don't think we've used it for anything since | 17:31 |
| clarkb | mtreinish: then as things get less reliable stop caring about them | 17:32 |
| clarkb | jeblair: release jobs? | 17:32 |
| fungi | jeblair: yeah, i can't think of anything else it's ever been used for | 17:32 |
| *** Swami has joined #openstack-infra | 17:32 | |
| clarkb | er no those aren't changes | 17:32 |
| clarkb | so ya I don't think we use it anywhere | 17:32 |
| jeblair | clarkb: yeah, only applies to changes in a dependent pipeline | 17:32 |
| *** abregman is now known as abregman|afk | 17:32 | |
| clarkb | but an analog that would serialize publishing jobs would be useful | 17:32 |
| clarkb | to avoid out of order writes or concurrent writes | 17:33 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Grenade jobs for testing libraries (esp. oslo.messaging) https://review.openstack.org/256467 | 17:33 |
| mtreinish | clarkb: ooh, that would be cool | 17:33 |
| fungi | clarkb: i'd rather see something which collapses those. they don't need to run multiple times if they're queued | 17:33 |
| clarkb | fungi: thats a good point | 17:33 |
| jeblair | clarkb: well, i actually want to implement a new manager for the post pipeline, which is "only run jobs for one item per project at a time, and at most, only ever have 2 items in the queue for a project at a time; new items replace the queued second item" | 17:34 |
| jeblair | or what fungi said in fewer words | 17:34 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add support for cucumber reports plugin https://review.openstack.org/251489 | 17:34 |
| clarkb | jeblair: fungi ++ | 17:34 |
| fungi | if two jobs are designed to produce (and overwrite) the same artifacts (docs publication, branch tarball updates) just run once with the latest state | 17:34 |
| mordred | clarkb, greghaynes: btw - running dib on debian required "uuid-runtime" to be installed | 17:34 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Add script to cleanup Gerrit 2.8 data https://review.openstack.org/246020 | 17:35 |
| jeblair | mordred: any desire to keep hold-following-changes around? | 17:35 |
| zaro | pleia2: ^ | 17:35 |
| *** rellerreller has joined #openstack-infra | 17:35 | |
| *** alivigni has joined #openstack-infra | 17:35 | |
| *** sridhar_ram has joined #openstack-infra | 17:36 | |
| mordred | jeblair: that word doesn't make sense to me | 17:36 |
| *** esker has joined #openstack-infra | 17:36 | |
| *** esker has quit IRC | 17:36 | |
| pleia2 | zaro: thumubs up | 17:36 |
| mordred | jeblair: so, nope! | 17:36 |
| *** esker has joined #openstack-infra | 17:36 | |
| *** abregman|afk has quit IRC | 17:36 | |
| zaro | pleia2: interested in helping apprv some of those today? | 17:36 |
| jeblair | mordred: ok, you were a big proponent of it in the day -- it's what we used with the merge jobs, but i think we've completely replaced their use with the internal merger now and haven't found a use for it since | 17:37 |
| clarkb | ok haven't heard and dissent on the groups visibile by default /me approves | 17:37 |
| pleia2 | zaro: going through the ones clarkb linked now | 17:37 |
| jeblair | mordred: http://docs.openstack.org/infra/zuul/zuul.html#jobs | 17:37 |
| *** sambetts is now known as sambetts-afk | 17:38 | |
| clarkb | zaro: like the groupsVisibleToAll change I think this drafts change https://review.openstack.org/#/c/253110/7 can remove the depends on and merge ahead of the upgrade | 17:38 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: builders: fix mavenName sorting with py35 https://review.openstack.org/252487 | 17:38 |
| jeblair | mordred, clarkb, fungi: i'm looking at removing it because i think it will make the job selection logic easier in v3, but we'll completely lose that ability; it'll be hard to add it back in | 17:38 |
| clarkb | zaro: since old gerrit should ignore that config option | 17:38 |
| mordred | jeblair: ah! that | 17:38 |
| fungi | clarkb: zaro: i haven't looked over that one yet, but is it going to unhide all our old empty groups? | 17:38 |
| mordred | jeblair: yeah - the only reason I ever wanted such things was to do fast-fail | 17:39 |
| clarkb | fungi: no its only at creation time from my reading of docs | 17:39 |
| fungi | clarkb: zaro: count me in favor then | 17:39 |
| clarkb | fungi: "ontrols whether newly created groups should be by default visible to all registered users" | 17:39 |
| clarkb | oh its newGroupsVisibleToAll | 17:39 |
| fungi | yeah, i think jeepyb did that already, but we can stop being explicit about it now | 17:39 |
| jeblair | mordred: 'fast-fail' means a lot of things to different people, but the most common meaning, "abort all jobs for this item if this job fails" is not/would not be affected by this | 17:40 |
| clarkb | so even the name is better than what I typed the first time | 17:40 |
| *** sridhar_ram1 has joined #openstack-infra | 17:40 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Allow puppet to configure the Gerrit drafts feature https://review.openstack.org/253110 | 17:40 |
| *** sridhar_ram has quit IRC | 17:40 | |
| *** kozhukalov_ has quit IRC | 17:40 | |
| *** smarcet has quit IRC | 17:40 | |
| *** weshay_xchat has quit IRC | 17:41 | |
| zaro | clarkb: yep, gerrit will ignore configs it doesn't know about so safe for 2.8. i have removed the depends-on | 17:41 |
| jeblair | mordred: but yeah, i see the relation there -- we made a job tree rooted at the merge job to more-or-less get a similar effect | 17:41 |
| mordred | jeblair: yah | 17:41 |
| *** sridhar_ram1 is now known as sridhar_ram | 17:41 | |
| *** dangers_away has joined #openstack-infra | 17:41 | |
| jeblair | mordred: but we'll still support job trees, we just won't have them delay subsequent changes | 17:41 |
| zaro | fungi: no affect to existing groups, gerrit 2.8 will ignore that option | 17:41 |
| mordred | jeblair: yah - I thnk it's fine to lose | 17:41 |
| jeblair | ok | 17:42 |
| clarkb | zaro: +2 thanks | 17:42 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Add a gate-bindep-fallback-ubuntu-trusty job https://review.openstack.org/256122 | 17:42 |
| *** sdake_ has quit IRC | 17:43 | |
| zaro | fungi: also it only affects newly created groups in gerrit 2.11 so won't affect existing groups in 2.11 either | 17:43 |
| *** sdake has joined #openstack-infra | 17:44 | |
| *** terriyu has quit IRC | 17:44 | |
| zaro | fungi, clarkb, pleia2 : so i believe these are safe to merge today: https://review.openstack.org/#/c/245598 | 17:44 |
| zaro | https://review.openstack.org/#/c/246020/ | 17:44 |
| zaro | https://review.openstack.org/#/c/253110/ | 17:45 |
| pleia2 | aprvd the first | 17:45 |
| clarkb | I will have to review the second | 17:46 |
| zaro | https://review.openstack.org/#/c/255050/ | 17:46 |
| clarkb | the last one depends on the one before it | 17:46 |
| zaro | https://review.openstack.org/#/c/251019/ | 17:47 |
| openstackgerrit | Merged openstack-infra/puppet-gerrit: Ensure all groups are visible to all registered users. https://review.openstack.org/253260 | 17:47 |
| zaro | https://review.openstack.org/#/c/253139/ | 17:47 |
| *** esker has quit IRC | 17:47 | |
| zaro | https://review.openstack.org/#/c/253137/ | 17:47 |
| *** esker has joined #openstack-infra | 17:48 | |
| SpamapS | zigo: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=806683 .. <bump> | 17:48 |
| openstack | Debian bug 806683 in src:python-os-client-config "src:python-os-client-config: New upstream (>= 1.11.1) needed to support python-shade 1.2.0Hello! We need os-client-config 1.11.1 or later to support the mostrecent release of python-shade. The library is a dependency of theansible OpenStack modules, so convenience of installing it helps Ansibleusers utlize OpenStack directly." [Normal,Open] | 17:48 |
| openstackgerrit | David Lyle proposed openstack-infra/project-config: Adding trove-dashboard repo and jobs https://review.openstack.org/256605 | 17:48 |
| clarkb | zaro: pleia2 also notmorgan's apache vhost change should be safe to merge | 17:49 |
| *** armax_ has joined #openstack-infra | 17:49 | |
| clarkb | it will affect review.o.o but shouldn't change anything user visible | 17:49 |
| zaro | this one https://review.openstack.org/#/c/252054/ | 17:50 |
| clarkb | yup | 17:50 |
| clarkb | looks like that has the needed +2's just needs a babysitter | 17:50 |
| clarkb | will swing around to it after reviewing 246020 | 17:50 |
| zaro | https://review.openstack.org/#/c/253143/ | 17:50 |
| notmorgan | o/ here if anything goes wrong with the apache change. | 17:51 |
| pleia2 | notmorgan: brave soul ;) | 17:51 |
| mordred | clarkb: fwiw: | 17:51 |
| mordred | -rw-r--r-- 1 mordred mordred 1941700608 Dec 11 12:48 ubuntu-minimal.raw | 17:51 |
| mordred | -rw-r--r-- 1 mordred mordred 523270144 Dec 11 12:49 ubuntu-minimal.qcow2 | 17:51 |
| mordred | -rw-r--r-- 1 mordred mordred 1250213888 Dec 11 12:50 ubuntu-minimal.vhd | 17:52 |
| mordred | clarkb: still not as good as qcow2, but better than raw | 17:52 |
| clarkb | mordred: nice, thats a erasonable improvemtn | 17:52 |
| * mordred will now try uploading that to rax | 17:52 | |
| *** kozhukalov_ has joined #openstack-infra | 17:52 | |
| notmorgan | pleia2: well... It is my change, figure it is important to be available. | 17:52 |
| pleia2 | notmorgan: I kid, it's appreciated | 17:53 |
| clarkb | zaro: pleia2 et al is https://review.openstack.org/#/c/246020/6/tools/gerrit-2.8.4-cleanup.sh something we actually want to merge considering how specific it is to us? do we just want it up in gerrit to get it reviewed or do we also want it in the repo for historical purposes? | 17:55 |
| openstackgerrit | Merged openstack-infra/system-config: Add rollback script for 2.11 https://review.openstack.org/245598 | 17:55 |
| *** tonytan4ever has quit IRC | 17:55 | |
| openstackgerrit | David Lyle proposed openstack-infra/project-config: Adding trove-dashboard repo and jobs https://review.openstack.org/256605 | 17:55 |
| zaro | clarkb: i only pushed it up because anteaya asked it to be there | 17:56 |
| clarkb | zaro: kk I think its nice to have it up just not sure if we want it merged or not | 17:56 |
| pleia2 | clarkb: I'm on the fence, system-config does have a fair amount that's specific to us, and it is a useful thing | 17:56 |
| zaro | i was only in etherpad before, and that's historical right? | 17:56 |
| pabelanger | What is the process for restarting zuul these days? Is it a manual process or have we automated it yet? | 17:57 |
| pleia2 | but I understand not wanting to add more us-specific stuff | 17:57 |
| *** armax_ has quit IRC | 17:57 | |
| *** annegentle has quit IRC | 17:57 | |
| *** armax_ has joined #openstack-infra | 17:57 | |
| clarkb | pleia2: not only is it specific to us its one time use (though possibly useful down the road if we need something similar0 | 17:57 |
| clarkb | I will just +2 it for now | 17:57 |
| pleia2 | clarkb: since we seem to be the only ones doing it, I think it would be useful for us in the future | 17:57 |
| clarkb | notmorgan: is now a good time for apache change to get approved? | 17:57 |
| pleia2 | so I like keeping it around | 17:58 |
| notmorgan | clarkb: sure | 17:58 |
| *** bpokorny_ has joined #openstack-infra | 17:58 | |
| clarkb | let me just check on thing (make sure mod proxy is enabled (it should be since we use proxypassreverse) | 17:58 |
| *** bpokorny_ has quit IRC | 17:58 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Grenade jobs for testing libraries (esp. oslo.messaging) https://review.openstack.org/256467 | 17:58 |
| *** eil397 has joined #openstack-infra | 17:59 | |
| *** bpokorny_ has joined #openstack-infra | 17:59 | |
| clarkb | yup it is enabled, approving now | 17:59 |
| *** shivharis has joined #openstack-infra | 18:00 | |
| notmorgan | cool | 18:00 |
| mordred | clarkb: also - got a response from coreos folks - they're using qemu-img version 2.4.0 | 18:00 |
| *** fawadkhaliq has quit IRC | 18:00 | |
| clarkb | mordred: trusty has 2.0.0 | 18:01 |
| shivharis | hi folks, does any one know the irc handle for Doug Hellman | 18:01 |
| mordred | yah. my debian machine has 2.1 | 18:01 |
| clarkb | shivharis: dhellmann | 18:01 |
| mordred | clarkb: I'm double-checking that the version created by pre-2.4 does not work | 18:01 |
| shivharis | clarkb: thanks | 18:01 |
| nibalizer | i went through the gerrit upgrade stack giving +2s not +as | 18:02 |
| nibalizer | figuring we would land those with coordination next week | 18:02 |
| *** bpokorny has quit IRC | 18:02 | |
| mordred | clarkb: and if it doesn't work, I'll see if I can verify that 2.4 _does_ | 18:02 |
| mordred | clarkb: because honestly, a backport of an unpatched util would still be better than a forked package in a PPA | 18:02 |
| shivharis | dhellmann: ping | 18:02 |
| dims | zaro : clarkb : i was watching a job in jenkins : it suddenly aborted and i see "queued" on the zuul page again | 18:03 |
| clarkb | nibalizer most of the dtack is forward and backward compat | 18:03 |
| dims | zaro : clarkb : https://jenkins05.openstack.org/job/gate-grenade-dsvm/22634/console | 18:03 |
| clarkb | nibalizer getting them in now makes upgrade simpler | 18:03 |
| nibalizer | clarkb: fine by me | 18:04 |
| clarkb | dims: usually means that something ahead of it failed meaning it had to be restarted without the failing thing ahead of it | 18:04 |
| clarkb | dims: perfectly normal for zuul | 18:04 |
| nibalizer | i am planes today so I'll be in and out | 18:04 |
| clarkb | dims: since it is predictive and not all predictions pan out | 18:04 |
| rellerreller | Silly question, but what are the login credentials for a newly created image using `disk-image-create ubuntu vm`? | 18:04 |
| nibalizer | working on omfra-nodepool mostly | 18:04 |
| clarkb | rellerreller: I believe they are expected to be set by cloud-init | 18:04 |
| dims | clarkb : ah ok thanks! just making sure | 18:04 |
| *** smarcet has joined #openstack-infra | 18:04 | |
| clarkb | rellerreller: so they don't exist until you boot the image and it consults your metadata sources for the info | 18:05 |
| *** jordanP has quit IRC | 18:05 | |
| rellerreller | clarkb do you have any links or keywords I can search to look into this more? | 18:05 |
| clarkb | mordred: ++ much nicer to consume real things than hacky forked random thngs especially if it makes smaller images | 18:06 |
| dims | shivharis : dhellmann is off for a few days, what's up? | 18:06 |
| clarkb | rellerreller: https://cloudinit.readthedocs.org/en/latest/ | 18:06 |
| *** fawadkhaliq has joined #openstack-infra | 18:06 | |
| *** harlowja has quit IRC | 18:06 | |
| rellerreller | clarkb thanks! | 18:06 |
| clarkb | rellerreller: on an ubuntu image you would typically provide an ssh key via metadata service or config drive then ssh to the ubuntu user on that VM using that key | 18:06 |
| *** harlowja has joined #openstack-infra | 18:07 | |
| * zaro fixing up the merge conflicts now | 18:07 | |
| *** sdake has quit IRC | 18:07 | |
| shivharis | dims: I had spoken to Doug regarding a new project at the Tokyo summit and he asked me to ping him for help creating this thing in stackforge. | 18:08 |
| *** tzn has quit IRC | 18:08 | |
| *** sputnik13 has joined #openstack-infra | 18:08 | |
| shivharis | dims: if there is some pointer that I can read up on that will be great | 18:09 |
| dims | shivharis : there's no more stackforge, have you looked here yet? http://docs.openstack.org/infra/manual/creators.html | 18:09 |
| *** dizquierdo has quit IRC | 18:09 | |
| shivharis | dims: looking.. | 18:10 |
| *** kozhukalov_ has quit IRC | 18:11 | |
| zaro | pleia2, clarkb : fixed up merge conflict: https://review.openstack.org/#/c/253110/ | 18:13 |
| shivharis | dims; thanks for the pointer - will take me some time to read through. Thanks. | 18:13 |
| *** jbernard has quit IRC | 18:14 | |
| onovy | yolanda, vponomaryov: https://review.openstack.org/#/c/245603/ still failing no. 2 :) | 18:15 |
| *** tjones has joined #openstack-infra | 18:16 | |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config: remove grenade partial cpu from kilo https://review.openstack.org/256621 | 18:16 |
| yolanda | hi onovy, so your failure was not related with the issue we had this morning | 18:16 |
| sdague | fyi, kilo is blocked on https://review.openstack.org/256621 | 18:16 |
| onovy | no i don't think so | 18:16 |
| sdague | clarkb / mordred / pleia2 if any of you could take a look | 18:17 |
| yolanda | it is failing with some ini file on linuxbridge, i don't know what's causing that | 18:17 |
| onovy | because it's failing for few days | 18:17 |
| mordred | clarkb: ok. I have verified that uploading a qemu-img v2.1 created vhd does not result in a bootable image | 18:18 |
| *** unicell has joined #openstack-infra | 18:19 | |
| yolanda | onovy, i suggest you check with neutron team | 18:19 |
| openstackgerrit | Merged openstack-infra/shade: Improve test coverage: network delete API https://review.openstack.org/254922 | 18:20 |
| *** rhsu has joined #openstack-infra | 18:21 | |
| openstackgerrit | Merged openstack-infra/shade: Bug fix: Allow name update for domains https://review.openstack.org/254940 | 18:22 |
| clarkb | mordred: time to test 2.4.0? | 18:22 |
| phschwartz | What would cause <Worker Unknown> for the running of a build in the zuul debug log? | 18:23 |
| mordred | clarkb: yup. doing that now | 18:23 |
| *** bharathm has quit IRC | 18:24 | |
| *** dtantsur is now known as dtantsur|afk | 18:25 | |
| *** e0ne has quit IRC | 18:27 | |
| jeblair | phschwartz: it's normal for jenkins | 18:28 |
| jeblair | phschwartz: turbo-hipster sets worker names but the gearman-plugin for jenkins does not | 18:28 |
| phschwartz | jeblair: hmm, interesting because I see that and figured it was the issue running jobs. The job that it is trying to run is there but I never see the job hit the jenkins queue | 18:28 |
| phschwartz | and then I see NOT_REGIESTERED written out to gerrit with a failure | 18:29 |
| jeblair | phschwartz: do you have a zuul debug log line (perhaps more than one) with "not registered" ? | 18:31 |
| fungi | phschwartz: zuul's debug log will indicate what the full work request was, including the worker name | 18:32 |
| phschwartz | jeblair: 2015-12-11 17:43:06,778 DEBUG zuul.Gearman: Function build:noop-check-communication:bare-trusty is not registered | 18:33 |
| phschwartz | 2015-12-11 17:43:06,778 ERROR zuul.Gearman: Job <gear.Job 0x7fba9a86dc90 handle: None name: build:noop-check-communication:bare-trusty unique: 318aec1fe0be456791caeb5315821635> is not registered with Gearman | 18:33 |
| phschwartz | 2015-12-11 17:43:06,778 INFO zuul.Gearman: Build <gear.Job 0x7fba9a86dc90 handle: None name: build:noop-check-communication:bare-trusty unique: 318aec1fe0be456791caeb5315821635> complete, result NOT_REGISTERED | 18:33 |
| phschwartz | jeblair: yes, appears to not be registered but not sure why | 18:33 |
| jeblair | phschwartz: "build:noop-check-communication:bare-trusty" means that zuul is specifically requesting noop-check-communication run on a bare-trusty node | 18:34 |
| fungi | phschwartz: echo status|nc -q 3 localhost 4730|grep build:noop-check-communication | 18:34 |
| jeblair | phschwartz: if you don't have a noop-check-communication job in jenkins, that would be the problem, but if you do, you may not have a bare-trusty node attached to jenkins | 18:34 |
| fungi | you will likely see no build:noop-check-communication:bare-trusty there, but maybe build:noop-check-communication:devstack-trusty or something instead | 18:34 |
| jeblair | phschwartz: or the noop-check-communication job may not be configured to run on bare-trusty | 18:34 |
| jeblair | which fungi's process should confirm :) | 18:35 |
| * fungi has to run down NOT_REGISTERED reports pretty often | 18:35 | |
| fungi | most of the time, for us, it's either someone set the wrong node parameter in a job config, or we have an unwanted override in our zuul parameter functions | 18:37 |
| phschwartz | fungi: jeblair: so the netcat returns nothing | 18:37 |
| fungi | phschwartz: then the job itself has not been registered in gearman | 18:37 |
| phschwartz | fungi: how would I correct that. It was created with a run of puppet-openstackci | 18:38 |
| *** sdake has joined #openstack-infra | 18:38 | |
| fungi | phschwartz: make sure the jenkins gearman plugin is connecting successfully, for starters | 18:38 |
| phschwartz | fungi: the test returns success | 18:38 |
| fungi | phschwartz: also it can be that no new nodes which are capable of running that job have been added in jenkins since the last time zuul was restarted | 18:39 |
| mordred | clarkb: building qemu from source is 'fun' | 18:39 |
| fungi | phschwartz: disabling and enabling the jenkins gearman plugin should trigger all jobs to get reregistered into gearman | 18:39 |
| phschwartz | fungi: hmm, it might be an issue with my nodepool config. | 18:39 |
| fungi | as long as there are workers capable of running them | 18:39 |
| openstackgerrit | Merged openstack-infra/project-config: remove grenade partial cpu from kilo https://review.openstack.org/256621 | 18:39 |
| jeblair | mordred: can you tldr why you're doing qemu/image stuff? | 18:39 |
| clarkb | mordred: there is a reason I don't really want to start managing libvirt/qemu/kernel/ovs packages :) | 18:40 |
| jeblair | mordred: (i feel like i missed something important) | 18:40 |
| phschwartz | fungi: : disabled and enabled, but not change to the nc output | 18:40 |
| fungi | phschwartz: just grep for build: and see if you have _any_ jobs registered | 18:40 |
| *** shardy has quit IRC | 18:41 | |
| fungi | phschwartz: and confirm that the job in question actually exists in the jenkins config | 18:41 |
| fungi | like by looking in the jobs list in teh jenkins administrative webui | 18:41 |
| jeblair | phschwartz: and go to https://<jenkins>/computer/ to see if you have any slaves | 18:42 |
| fungi | yeah, that too | 18:42 |
| phschwartz | fungi: so nothing when greping for build | 18:42 |
| fungi | so check in jenkins to see if you have any jobs or even any slaves | 18:43 |
| phschwartz | jeblair: so yeah, no slaves | 18:43 |
| fungi | if no jobs, it's time to dig into jjb. if no slaves, dig into nodepool | 18:43 |
| phschwartz | hmm, the images built and an image-list has them as ready | 18:44 |
| phschwartz | they should have a ready node in nodepool list right? | 18:44 |
| fungi | if nodepool is able to successfully boot and connect to a node from the image, then yes | 18:45 |
| *** jerryz has joined #openstack-infra | 18:45 | |
| *** jistr has quit IRC | 18:45 | |
| fungi | look in your nodepool list output and see if you have nodes in other states than ready (most likely either building or delete) | 18:45 |
| fungi | it could be that nodepool is failing to boot an instance from the image it has... either it goes into error in nova or never becomes reachable or nodepool can't ssh into it to run the ready script, then it will generally transition straight from building to delete instead of becoming ready | 18:46 |
| *** armax_ has quit IRC | 18:47 | |
| *** sdake_ has joined #openstack-infra | 18:47 | |
| *** toabctl has quit IRC | 18:47 | |
| mordred | jeblair: I heard a rumor that we can stop using the patched vhd-util to make vhd's | 18:47 |
| phschwartz | fungi: yay, no build at all. the logging for nodepool wasn't working. I got it fixed and get BadRequest: Multiple possible networks found, use a Network ID to be more specific. (HTTP 400) (Request-ID: req-f0102446-69b9-49da-bc1e-937645b7222f) | 18:47 |
| jeblair | mordred: ah, excellent, good luck! | 18:47 |
| phschwartz | so need to add a network to my config | 18:47 |
| mordred | jeblair: and then when I was tracking down the truthiness of that - I learned that qemu-img makes smaller vhd's than vhd-util | 18:47 |
| mordred | which is ALSO nice | 18:47 |
| fungi | phschwartz: yep, if you have neutron and multiple available networks you need to get more specific in the config | 18:47 |
| *** dtardivel has quit IRC | 18:47 | |
| greghaynes | mordred: ^ | 18:47 |
| greghaynes | mordred: er, ! | 18:47 |
| greghaynes | mordred: that would be awesome | 18:47 |
| *** armax_ has joined #openstack-infra | 18:48 | |
| mordred | greghaynes: so far what I've provisionally learned is that 2.4 is required | 18:49 |
| *** sdake has quit IRC | 18:50 | |
| *** Sukhdev has joined #openstack-infra | 18:51 | |
| *** elo has joined #openstack-infra | 18:51 | |
| clarkb | mordred: would be interesting if 2.4's image size is different than 2.1's | 18:51 |
| *** toabctl has joined #openstack-infra | 18:51 | |
| *** armax_ has quit IRC | 18:51 | |
| mordred | clarkb: agree | 18:51 |
| *** armax_ has joined #openstack-infra | 18:52 | |
| *** otter768 has joined #openstack-infra | 18:52 | |
| *** bharathm has joined #openstack-infra | 18:52 | |
| notmorgan | fungi: so. it all looks good eh? [things aren't exploding] | 18:55 |
| *** abregman has joined #openstack-infra | 18:55 | |
| fungi | notmorgan: i haven't been watching, but nobody's complained | 18:55 |
| *** tonytan4ever has joined #openstack-infra | 18:55 | |
| *** lezbar has quit IRC | 18:55 | |
| notmorgan | fungi: then i think we're probably good | 18:55 |
| fungi | so either we have a couple thousand developers taking the day off, or... | 18:55 |
| notmorgan | well i mean... | 18:56 |
| notmorgan | people could be taking the day off.. | 18:56 |
| * fungi could be taking the day off | 18:56 | |
| *** cdent has quit IRC | 18:56 | |
| phschwartz | fungi: and there we go nodes building, now to hope they come up fine :) | 18:56 |
| *** dims has quit IRC | 18:56 | |
| zaro | cool, i may take the day. | 18:57 |
| zaro | off | 18:57 |
| *** flepied1 has quit IRC | 18:57 | |
| *** sdake_ has quit IRC | 18:57 | |
| *** otter768 has quit IRC | 18:57 | |
| clarkb | did the change actually merge? | 18:57 |
| *** fawadkhaliq has quit IRC | 18:57 | |
| notmorgan | clarkb: gerrit says it did | 18:57 |
| clarkb | ah yup wasn't seeing it in irc | 18:58 |
| * clarkb checks puppet run for after that timestamp | 18:58 | |
| clarkb | http://puppetboard.openstack.org/report/review.openstack.org/13441d3f438529eff980c93c7ca23786180b55ba seems like it applied it but may not have restarted apache | 18:58 |
| notmorgan | hm | 18:59 |
| *** cdent has joined #openstack-infra | 18:59 | |
| notmorgan | clarkb: so do we need to do something manual? | 18:59 |
| *** BobBall has quit IRC | 19:00 | |
| zaro | fungi: looks like pleia2 is not around, would you be able to git push this? just fixed a merge conflict on last PS | 19:00 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Update the README https://review.openstack.org/256629 | 19:01 |
| zaro | fungi: https://review.openstack.org/#/c/253110/ | 19:01 |
| pleia2 | zaro: sorry, missed that earlier, looking now | 19:01 |
| *** BobBall has joined #openstack-infra | 19:01 | |
| fungi | zaro: i'm happy to help, but looks like pleia2's got it | 19:01 |
| *** BobBall is now known as Guest81438 | 19:02 | |
| zaro | ahh great! | 19:02 |
| clarkb | notmorgan: ya I will have to look in a sec unless pleia2 can check | 19:02 |
| notmorgan | clarkb: thnx | 19:02 |
| clarkb | I am currently wrangling a local wifi thing | 19:02 |
| clarkb | (new hardware is too tempting to mess with) | 19:02 |
| notmorgan | clarkb: ouch | 19:02 |
| *** cdent has quit IRC | 19:02 | |
| *** yuanying has quit IRC | 19:03 | |
| pleia2 | confirmed, apache did not restart | 19:04 |
| *** apoorvad has joined #openstack-infra | 19:08 | |
| pleia2 | I can manually do a service restart if we want, but we should probably fix it so that updating the config does that | 19:08 |
| clarkb | pleia2: that may be intentional? not sure, but ya we should manually restart so we aren't caught off guard later | 19:09 |
| pleia2 | ah, perhaps, ok, I'll do it now | 19:09 |
| pleia2 | hold on gerrit /o\ | 19:09 |
| *** Guest81438 has quit IRC | 19:10 | |
| *** BobBall_ has joined #openstack-infra | 19:10 | |
| pleia2 | it's done | 19:10 |
| *** BobBall_ is now known as Guest58914 | 19:10 | |
| pleia2 | notmorgan: want to take a look? | 19:10 |
| notmorgan | pleia2: looking | 19:11 |
| *** e0ne has joined #openstack-infra | 19:11 | |
| notmorgan | looks good to me | 19:11 |
| pleia2 | seems good here too | 19:12 |
| zaro | me too! | 19:12 |
| clarkb | its still there for me | 19:12 |
| *** aysyd has quit IRC | 19:12 | |
| clarkb | let me log in and out | 19:12 |
| clarkb | er out and in | 19:13 |
| *** aysyd has joined #openstack-infra | 19:13 | |
| clarkb | that works | 19:13 |
| pleia2 | and not seeing things in the error logs | 19:13 |
| zaro | i've tested the redirect, seem good. | 19:13 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Add a gate-bindep-fallback-ubuntu-trusty job https://review.openstack.org/256122 | 19:14 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Make install-distro-packages.sh configurable https://review.openstack.org/256632 | 19:14 |
| clarkb | I can recheck the system-config change to disable drafts once its dependency merges | 19:15 |
| zaro | clarkb, pleia2 : i forgot this one, https://review.openstack.org/#/c/235079/ | 19:15 |
| clarkb | that one actually does require a gerrit restart so holding off on that is probably good? | 19:16 |
| clarkb | since gerrits caching of the files always gets confused when we swap them out or have we fixed that? | 19:16 |
| zaro | i don't think there was any work to fix that. | 19:17 |
| fungi | clarkb: modifying javascript? | 19:17 |
| clarkb | fungi: ya | 19:17 |
| clarkb | for the hideci stuff | 19:17 |
| zaro | but fine to wait to apprv that on upgrade | 19:17 |
| mordred | clarkb: interestingly, qemu-img 2.4 produces EXACTLY the same sized image | 19:18 |
| *** hogepodge has quit IRC | 19:18 | |
| fungi | clarkb: pretty sure it works without a restart if we wait a bit (60 seconds?) after modification and then `sudo touch ~gerrit2/review_site/etc/GerritSiteHeader.html` | 19:18 |
| zaro | i guess all the other config changes would require restart to confirm that it's ok for 2.8. | 19:18 |
| *** hogepodge has joined #openstack-infra | 19:18 | |
| clarkb | mordred: will it boot | 19:19 |
| *** krtaylor has joined #openstack-infra | 19:19 | |
| fungi | clarkb: manually it's worked fine every time i've tried it, but for some reason none of our attempts at automating that have panned out | 19:19 |
| clarkb | fungi: huh | 19:19 |
| mordred | clarkb: dunno. uploading now | 19:19 |
| *** hogepodge has quit IRC | 19:19 | |
| zaro | i'm pretty sure fungi is correct. | 19:19 |
| clarkb | fungi: is it broken for all users in that 60 seconds though? | 19:19 |
| *** hogepodge has joined #openstack-infra | 19:19 | |
| *** changbl has quit IRC | 19:19 | |
| zaro | i believe it should work as before the change. | 19:20 |
| clarkb | zaro: the js should but browsers and gerrit get confused | 19:20 |
| clarkb | I am willing to try it if we think its reaosnable safe | 19:20 |
| clarkb | pleia2: ^ | 19:20 |
| fungi | clarkb: well, i think it's that as soon as the problem behavior appears (because the modification has taken effect) then you can fix it by touching the site header file and getting gerrit to rebuild it | 19:20 |
| *** abregman has quit IRC | 19:21 | |
| fungi | but if you touch that file too soon, then it seems like it doesn't do any good | 19:21 |
| *** mrmartin has joined #openstack-infra | 19:21 | |
| clarkb | for X in `seq 1 60` ; do sleep $X && touch $file ; done | 19:22 |
| openstackgerrit | Merged openstack-infra/puppet-gerrit: Allow puppet to configure the Gerrit drafts feature https://review.openstack.org/253110 | 19:22 |
| *** jbernard has joined #openstack-infra | 19:22 | |
| *** hogepodge has quit IRC | 19:23 | |
| *** hogepodge has joined #openstack-infra | 19:23 | |
| fungi | clarkb: nice backoff! | 19:23 |
| zaro | depenency ^ requieres to kick this one https://review.openstack.org/#/c/255050/ | 19:23 |
| fungi | clarkb: that will take a lot longer than i think you realize though | 19:24 |
| *** dprince has quit IRC | 19:24 | |
| *** amuller has quit IRC | 19:25 | |
| clarkb | fungi: its to handle gerrit delay :) | 19:25 |
| *** amuller has joined #openstack-infra | 19:25 | |
| *** e0ne_ has joined #openstack-infra | 19:26 | |
| jeblair | that sequence is what, half an hour? | 19:26 |
| fungi | clarkb: a sum sequence is n * (n + 1) / 2, so that's going to take over half an hour | 19:26 |
| fungi | jeblair: indeed! | 19:26 |
| fungi | it's that time of the day when i turn to recreational mathematics to distract me from writing job configurations | 19:27 |
| *** e0ne has quit IRC | 19:28 | |
| *** claudiub|2 has quit IRC | 19:28 | |
| clarkb | I am glad my unintentional derps are so entertaining :) | 19:28 |
| mordred | clarkb: Exceeded maximum number of retries. Exceeded max scheduling attempts 3 for instance cd5a3c0e-229e-4cc8-bd6c-e695d6f9ddd7. | 19:28 |
| mordred | clarkb: so at first glance "no" | 19:28 |
| nibalizer | clarkb: just change the second ; to an & | 19:29 |
| mordred | clarkb: of course, it's impossible as a user to know what's wrong | 19:29 |
| clarkb | mordred: I wonder if coreos' thing "works" because they don't "test" it | 19:29 |
| jeblair | fungi: i feel like i'm working on making job configurations more like recreational mathematics. dunno how that makes you feel. | 19:29 |
| nibalizer | sleepsort ftw | 19:29 |
| nibalizer | ofc you generated the set with seq so you don't need that at all but :) | 19:29 |
| fungi | jeblair: you're stealing away my remaining excuses not to write jobs? | 19:29 |
| mordred | clarkb: nah - I imagine if nobody was ever able to use coreos on rackspace that someone would have complained beore now | 19:29 |
| *** rhsu has quit IRC | 19:29 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Make VPN constraints jobs voting https://review.openstack.org/255992 | 19:30 |
| mordred | clarkb: (this is how the coreos folks make the official images for rax cloud) | 19:30 |
| clarkb | mordred: could be another magical image or boot flag then | 19:30 |
| jroll | mordred: unless they have some out of tree edits, or it bitrotted since they made the last image | 19:30 |
| *** ericksonsantos has quit IRC | 19:30 | |
| mordred | clarkb: I don't see any in their scripts | 19:30 |
| mordred | clarkb: btw - they set compat=0.10 on their qcow command line too | 19:31 |
| clarkb | mordred: hahahahaha | 19:31 |
| clarkb | sorry I just its so amazing | 19:31 |
| clarkb | we really should just call qcow2>0.10 qcow3 | 19:31 |
| mordred | yah | 19:31 |
| *** ericksonsantos has joined #openstack-infra | 19:32 | |
| fungi | qcow2-ng++ | 19:32 |
| eantyshev | jeblair: Hello! May I ask you to merge these: https://review.openstack.org/253642, https://review.openstack.org/253619 and https://review.openstack.org/254128 . They all have at least 1 +2 | 19:33 |
| mordred | ok. I'm giving up on new qemu-img for today | 19:33 |
| mordred | cloud failures are too opaque | 19:34 |
| greghaynes | My hope was to just ignore the qcow2 1.0 compat thing until hp cloud sunset and then forget that it ever existed | 19:34 |
| greghaynes | I am guessing the coreos folk just do it for the same reason though - work by default? | 19:35 |
| mordred | johnthetubaguy, sdague: ^^ fwiw, as a user it's very hard for me to know whether the image I uploaded to openstack can't boot because there is something wrong with the image, or because there is a capacity problem meaning I should try again later. I'm _certain_ it's probably a hard problem, but just thought I'd pass on the "wow, I have no idea honestly where to go from here with this error" | 19:35 |
| mordred | yah | 19:35 |
| jeblair | i can't believe i haven't literally imagined what a 'cloud sunset' looks like until now. | 19:36 |
| *** abregman has joined #openstack-infra | 19:36 | |
| jeblair | it's beautiful and terrifying | 19:36 |
| mordred | :) | 19:37 |
| mordred | for the record, the error message is: | 19:37 |
| mordred | Exceeded maximum number of retries. Exceeded max scheduling attempts 3 for instance cd5a3c0e-229e-4cc8-bd6c-e695d6f9ddd7. Last exception: ['Traceback (most recent call last):\n', ' File "/opt/rackstack/rackstack.399.15/nova/lib/python2.7/site-packages/no | 19:37 |
| mordred | (and no, the paste didn't cut that off - that's as much as I get from nova | 19:37 |
| *** thomasem has left #openstack-infra | 19:38 | |
| *** changbl has joined #openstack-infra | 19:39 | |
| *** claudiub has joined #openstack-infra | 19:39 | |
| *** kozhukalov_ has joined #openstack-infra | 19:39 | |
| clarkb | mordred: I would suggest making a Xen to test locally but I remember then I remember what running a Xen looked like | 19:40 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Add a gate-bindep-fallback-ubuntu-trusty job https://review.openstack.org/256122 | 19:40 |
| clarkb | you oculd try hyperv | 19:40 |
| clarkb | but that has similar and different problems | 19:40 |
| mordred | clarkb: yeah. I'm probably not going to troubleshoot this by installing xen | 19:40 |
| *** fawadkhaliq has joined #openstack-infra | 19:41 | |
| *** harlowja has quit IRC | 19:41 | |
| *** harlowja has joined #openstack-infra | 19:41 | |
| clarkb | anyone up for revieiwng the outstanding gerrit 2.11.4 changes so we can push a new WIP change for the war we are going to use? | 19:42 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Add a gate-bindep-fallback-ubuntu-trusty job https://review.openstack.org/256122 | 19:42 |
| *** rhsu has joined #openstack-infra | 19:42 | |
| fungi | clarkb: yep, switching gears to that now | 19:42 |
| *** fawadkhaliq has quit IRC | 19:42 | |
| clarkb | danke | 19:42 |
| jeblair | mordred: what if you proposed a change to devstack that built the image and uploaded it and looked at the output from the citrix xenserver third party ci? :) | 19:43 |
| fungi | was trying to make some headway on the bindep job migration prerequisites while i had some ideas | 19:43 |
| mordred | jeblair: wow | 19:43 |
| mordred | jeblair: well, that devstack job would ALSO have to build the qemu-img backport package | 19:43 |
| mordred | jeblair: which took about an hour on my laptop | 19:43 |
| mordred | jeblair: so I'd need to make an experimental job that has a longer timeout | 19:43 |
| *** claudiub has quit IRC | 19:44 | |
| clarkb | mordred: yo umight get away with disabling tempest | 19:44 |
| jeblair | i don't know what the xenserver timeout is... | 19:44 |
| jeblair | 18:56:25 + export DEVSTACK_GATE_TIMEOUT=180 | 19:44 |
| mordred | well there you go | 19:45 |
| jeblair | mordred: you could have it fetch your already-built image | 19:45 |
| mordred | I suppose I could also just upload a pre-built image and package | 19:45 |
| mordred | from my personal website :) | 19:45 |
| jeblair | ya | 19:45 |
| mordred | god, I'm ALMOST tempted | 19:45 |
| clarkb | wow | 19:45 |
| jeblair | mordred: yeah, tbh, i'm really not sure if i'm serious | 19:45 |
| mordred | jeblair: me either | 19:45 |
| jeblair | it started as a joke but clearly this is a "haha, only serious" moment. | 19:46 |
| mordred | EXCEPT - working on this at all has distracted me from the novaclient patch I need to work on | 19:46 |
| fungi | why else would there be third-party ci, but to test whether things work in environments we can't easily (or at all) build? | 19:46 |
| mordred | and I need to finish that before I cna finalize the os-client-config patch that I want to land before I release that - which I want to do before I finish working on the ansible inventory patch | 19:47 |
| clarkb | mordred: did you catch the swift glance image uploads aren't working in nodepool train of discussion here the other day? | 19:47 |
| mordred | clarkb: oh - I did not | 19:47 |
| mordred | clarkb: like, at all? | 19:47 |
| mordred | clarkb: and do we know what's not working about them? | 19:47 |
| clarkb | mordred: https://review.openstack.org/#/c/255623/ that is the tldr change | 19:48 |
| clarkb | looks like it merged | 19:48 |
| mordred | ah- yeah, I merged that | 19:48 |
| clarkb | but we grab capabilities from swift using swift client not swift session service thing | 19:48 |
| *** esker has quit IRC | 19:48 | |
| clarkb | only the service thing understands keystone sessions | 19:48 |
| clarkb | since nodepool runs for days that one swift client object has a token that expires and we lose | 19:48 |
| clarkb | anyways sounds like notmorgan and timburke were going to try picking up work on sessioning swift client objects? | 19:48 |
| clarkb | so hopefully we don't need the workaround for long | 19:49 |
| mordred | yah - it's on the list | 19:49 |
| notmorgan | clarkb: it is on the list | 19:49 |
| mordred | once novaclient is done I can work on that too | 19:49 |
| mordred | notmorgan: jinx | 19:49 |
| notmorgan | mordred: DAMN. | 19:49 |
| *** Piet has joined #openstack-infra | 19:49 | |
| notmorgan | :P | 19:49 |
| clarkb | *the* list | 19:49 |
| rhsu | Is anyone aware of the Tox 2.3.0 release breaking things today? It has affected Devstacking for some of the 3rd party CIs | 19:49 |
| clarkb | rhsu: yes | 19:49 |
| rhsu | I have a bug up here: https://bugs.launchpad.net/devstack/+bug/1525352 | 19:50 |
| openstack | Launchpad bug 1525352 in devstack "Devstack fails with ValueError when trying to parse Tempest tox.ini" [Undecided,In progress] - Assigned to Ryan Hsu (rhsu) | 19:50 |
| rhsu | ah ok | 19:50 |
| clarkb | rhsu: there is a bug in tox | 19:50 |
| rhsu | regression? | 19:50 |
| clarkb | I haven't looked too closely at it. Last time Idid I spent too much time being mad | 19:50 |
| mordred | yes. regression | 19:50 |
| mordred | holger is aware | 19:50 |
| clarkb | (last time this happened to us I wrote a fix, upstream took about 4 months to merge it) | 19:50 |
| mordred | and is going to release a 2.3.1 probably monday | 19:50 |
| rhsu | wow | 19:51 |
| clarkb | while they argued with me over the meaning of life | 19:51 |
| mordred | it has to do with removing the ability to pull setenv things from other environments | 19:51 |
| fungi | i guess we're stuck deleting our nodepool images daily through monday then | 19:51 |
| clarkb | I can always resurrect the makefile I wrote | 19:51 |
| fungi | clarkb: i was only half-joking when i suggested revisiting that earlier today in #-qa | 19:52 |
| clarkb | fungi: it would need updates to accomodate changes in how we do stuff now (constraints etc) but the general shape of it should be valid stil | 19:52 |
| *** baoli_ has quit IRC | 19:53 | |
| *** lucasagomes is now known as lucas-beer | 19:53 | |
| *** ajmiller has quit IRC | 19:53 | |
| *** baoli has joined #openstack-infra | 19:53 | |
| *** abregman is now known as abregman|nearby | 19:53 | |
| *** e0ne_ has quit IRC | 19:54 | |
| fungi | clarkb: which outstanding gerrit changes did we still have? i only see two open changes in openstack-infra/gerrit and those are for 2.8.4 | 19:54 |
| fungi | zaro: ^ ? | 19:55 |
| fungi | i've approved the remaining topic:gerrit-upgrade changes except those indicating they're waiting for the maintenance, and the toggle-ci one where we need some quick manual intervention | 19:55 |
| clarkb | fungi: see https://review.openstack.org/#/q/status:open+topic:gerrit-upgrade,n,z | 19:55 |
| clarkb | there are 4 there | 19:55 |
| fungi | clarkb: one has a -2, another has a depends-on the one with the -2 | 19:56 |
| fungi | and one is wip | 19:56 |
| clarkb | fungi: the changes against gerrit itself should all be good to go | 19:57 |
| fungi | oh... i just realized i need to subscribe gertty to those | 19:57 |
| clarkb | we need those to merge so that a new war is built so we can updat epuppet to use that war | 19:57 |
| fungi | sorry | 19:57 |
| clarkb | oh right gertty | 19:57 |
| fungi | yeah, i wasn't previously subscribed to openstack-infra/gerrit | 19:59 |
| *** ddieterly has quit IRC | 20:00 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Make LBaaS constraints jobs voting https://review.openstack.org/256391 | 20:00 |
| zaro | fungi: the -2 one should be good to go once recheck is done | 20:00 |
| clarkb | it already has the votes it needs though so should go through as part of the recheck | 20:00 |
| *** tsg has quit IRC | 20:02 | |
| *** tonytan4ever has quit IRC | 20:02 | |
| *** ayoung is now known as ayoung-mtg | 20:03 | |
| *** claudiub has joined #openstack-infra | 20:03 | |
| notmorgan | crinkle: should have fixed the CLI bootstrap thing now | 20:05 |
| *** bcourt has quit IRC | 20:05 | |
| openstackgerrit | Adam Gandelman proposed openstack-infra/project-config: Publish per-branch astara-appliance images, cleanup jobs https://review.openstack.org/256076 | 20:06 |
| *** jffische has joined #openstack-infra | 20:07 | |
| *** _nadya_ has joined #openstack-infra | 20:07 | |
| *** _nadya_ has quit IRC | 20:08 | |
| openstackgerrit | Ondřej Nový proposed openstack-dev/hacking: Deprecated tox -downloadcache option removed https://review.openstack.org/256667 | 20:08 |
| *** tjones has quit IRC | 20:08 | |
| openstackgerrit | Merged openstack-infra/system-config: Update plugin version for Gerrit 2.11 on review-dev.o.o https://review.openstack.org/245456 | 20:09 |
| openstackgerrit | Ondřej Nový proposed openstack-infra/gear: Deprecated tox -downloadcache option removed https://review.openstack.org/256668 | 20:09 |
| openstackgerrit | Ondřej Nový proposed openstack-infra/zuul: Deprecated tox -downloadcache option removed https://review.openstack.org/256671 | 20:10 |
| *** tonytan4ever has joined #openstack-infra | 20:11 | |
| *** mrmartin has quit IRC | 20:11 | |
| *** Piet has quit IRC | 20:11 | |
| openstackgerrit | Merged openstack-infra/system-config: Add script to cleanup Gerrit 2.8 data https://review.openstack.org/246020 | 20:12 |
| *** ldnunes has quit IRC | 20:14 | |
| *** Piet has joined #openstack-infra | 20:15 | |
| *** ajmiller has joined #openstack-infra | 20:15 | |
| *** regXboi has quit IRC | 20:15 | |
| *** mhickey has quit IRC | 20:17 | |
| mriedem_away | new tox breaking everything? | 20:17 |
| mriedem_away | http://logs.openstack.org/62/255662/4/gate/gate-manila-tempest-dsvm-neutron-multibackend/659205b/logs/devstacklog.txt.gz#_2015-12-11_16_12_07_438 | 20:17 |
| clarkb | yes | 20:18 |
| mriedem_away | ah i see https://bugs.launchpad.net/devstack/+bug/1525352 | 20:18 |
| openstack | Launchpad bug 1525352 in devstack "Devstack fails with ValueError when trying to parse Tempest tox.ini" [Undecided,In progress] - Assigned to Ryan Hsu (rhsu) | 20:18 |
| clarkb | we deleted new images as the workaround | 20:18 |
| mriedem_away | ok | 20:18 |
| fungi | and will likely continue to do so until holger releases a 2.3.1 or whatever sometime next week | 20:19 |
| mriedem_away | is there a bug reported upstream? | 20:19 |
| fungi | yep | 20:19 |
| clarkb | yes | 20:19 |
| mriedem_away | https://bitbucket.org/hpk42/tox/issues/294/tox-23-regression | 20:19 |
| mriedem_away | yar | 20:19 |
| *** jffische has quit IRC | 20:19 | |
| *** notnownikki has joined #openstack-infra | 20:19 | |
| nibalizer | clarkb: i could use some help with omfra-nodepool | 20:20 |
| clarkb | nibalizer: sure | 20:21 |
| nibalizer | I'm having auth issues (which are in shade/oscc) | 20:21 |
| nibalizer | ill put your key on my devbox and we can screen -x ? | 20:21 |
| clarkb | ok let me put baby down | 20:21 |
| *** sdake has joined #openstack-infra | 20:21 | |
| *** EricGonczer_ has joined #openstack-infra | 20:22 | |
| fungi | make the babies troubleshoot nodepool. they're old enough for real work now | 20:22 |
| nibalizer | heh | 20:22 |
| pleia2 | hehe | 20:22 |
| nibalizer | really its not nodepool, the issue is getting shade/oscc to auth infracloud | 20:23 |
| davideagnello | zaro: hello! | 20:23 |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Make FWaaS constraints jobs voting https://review.openstack.org/256702 | 20:23 |
| nibalizer | clarkb: root@104.130.17.196 | 20:23 |
| nibalizer | fungi: pleia2 i can add your keys if you wish | 20:23 |
| clarkb | nibalizer: I am in | 20:24 |
| *** Piet has quit IRC | 20:24 | |
| *** EricGonc_ has quit IRC | 20:24 | |
| fungi | only if you also put it in dns as zomfra-nodepool-over-9000.openstack.org | 20:24 |
| nibalizer | clarkb: there is a root sreen | 20:24 |
| nibalizer | one of the windows is the nodepool uesr | 20:25 |
| openstackgerrit | Ondřej Nový proposed openstack/python-jenkins: Deprecated tox -downloadcache option removed https://review.openstack.org/256711 | 20:25 |
| *** Piet has joined #openstack-infra | 20:25 | |
| *** jaosorior has joined #openstack-infra | 20:25 | |
| clarkb | nibalizer: I only see root user? | 20:26 |
| clarkb | oh wrong window | 20:26 |
| *** flepied has joined #openstack-infra | 20:27 | |
| openstackgerrit | Jerry Zhao proposed openstack-infra/project-config: add more jobs for networking-fortinet https://review.openstack.org/256719 | 20:27 |
| openstackgerrit | Merged openstack-infra/system-config: Disable Gerrit drafts feature https://review.openstack.org/255050 | 20:29 |
| * zaro has emergency child now! bbl | 20:31 | |
| notmorgan | clarkb, fungi, mordred, zaro: we might have an issue with gerrit under proxypass a query that dstanek was using utilizing the REST API is not longer working | 20:33 |
| clarkb | notmorgan: what query? | 20:33 |
| notmorgan | sec | 20:33 |
| notmorgan | https://review.openstack.org/a/changes/openstack%252Fkeystone~master~Ie5441ab469668aa23418ca2290c43693e04142dc/detail | 20:33 |
| notmorgan | aparantly that worked yesterday and no longer works | 20:34 |
| fungi | i'm using gertty and it operates over rest api | 20:34 |
| fungi | makes all sorts of queries | 20:34 |
| notmorgan | unless we changed something else as well | 20:34 |
| dstanek | clarkb: it appears that i no longer need to double encode | 20:34 |
| *** sdake has quit IRC | 20:34 | |
| notmorgan | dstanek: oh yes | 20:34 |
| notmorgan | that we did change | 20:34 |
| notmorgan | sorry | 20:34 |
| fungi | oh interesting! | 20:34 |
| notmorgan | we disabled the forced encoding | 20:34 |
| clarkb | https://review.openstack.org/a/changes/openstack%2Fkeystone~master~Ie5441ab469668aa23418ca2290c43693e04142dc/detail that works | 20:34 |
| dstanek | notmorgan: really? | 20:34 |
| fungi | yeah, that would happen | 20:34 |
| notmorgan | dstanek: yeah | 20:35 |
| notmorgan | we allow encoded slashes now | 20:35 |
| notmorgan | so double encoding isn't needed | 20:35 |
| fungi | because of direct proxying | 20:35 |
| notmorgan | fungi: ++ | 20:35 |
| notmorgan | yes | 20:35 |
| dstanek | ah, interesting | 20:35 |
| clarkb | nibalizer: where di you go? want me to make those edits or do you wan tto try? | 20:35 |
| fungi | seems gertty was not double-encoding slashes either | 20:36 |
| nibalizer | oh sorry looking | 20:36 |
| nibalizer | clarkb: ya go for it | 20:36 |
| notmorgan | fungi: i think mod_rewrite does some other things that allowed both | 20:36 |
| fungi | quite possible | 20:37 |
| *** kgiusti has left #openstack-infra | 20:37 | |
| dstanek | fungi: that surprises me. things were failing when i wasn't doing that | 20:37 |
| *** ig0r_ has joined #openstack-infra | 20:37 | |
| notmorgan | we also changed the directive AllowEncodedSlashes On | 20:37 |
| dstanek | not trello is updated again! | 20:37 |
| dstanek | s/not/now/ | 20:37 |
| fungi | yeah, that's why it stopped | 20:38 |
| notmorgan | and mod_rewrite is a very different path | 20:38 |
| notmorgan | as we have learned with the whole issue gerrit has w/ it | 20:38 |
| fungi | gerrit is now not receiving the slashes encoded under normal circumstances, and is disallowing the encoded ones | 20:38 |
| notmorgan | fungi: so, in short, i think this is still safe change. | 20:39 |
| *** gordc has quit IRC | 20:39 | |
| notmorgan | esp. with 2.11 | 20:39 |
| fungi | yeah, as long as anyone who was previously double-encoding slashes in queries updates their code | 20:39 |
| notmorgan | fungi: and we might have to have them do that anyway | 20:39 |
| fungi | which i think is a reasonable compromise | 20:39 |
| fungi | yep | 20:40 |
| *** tzn has joined #openstack-infra | 20:40 | |
| notmorgan | so we should toss something out on the ML, you want me to write it up? | 20:40 |
| notmorgan | -infra and -dev? or just -dev? | 20:40 |
| *** rhsu has quit IRC | 20:40 | |
| *** Piet has quit IRC | 20:40 | |
| fungi | if you have a moment to write and send something about that, then awesome. just -dev is probably fine | 20:40 |
| notmorgan | yeah, let me write up something, let me go grab quick lunch | 20:41 |
| notmorgan | cause i'll forget to grab food otherwise. | 20:41 |
| nibalizer | clarkb: thanks a bunch | 20:42 |
| clarkb | nibalizer: I detached | 20:42 |
| clarkb | nibalizer: np | 20:42 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Add a gate-bindep-fallback-ubuntu-trusty job https://review.openstack.org/256122 | 20:42 |
| nibalizer | mordred: yea so we had to move back down to keystone v2 to get nodepool working | 20:42 |
| clarkb | nibalizer: I would grab that traceback for mordred | 20:42 |
| nibalizer | not that nodepool works yet, but its further along | 20:42 |
| clarkb | but 99% sure its oscc + keystoneclient's v3password client object breaking | 20:43 |
| clarkb | ran into this with the devstack plugin work | 20:43 |
| clarkb | the parameters are different | 20:43 |
| notmorgan | fungi: we are doing the gerrit update on the 19th right? | 20:43 |
| pleia2 | 16th | 20:44 |
| fungi | notmorgan: 16th (wednesday) | 20:44 |
| clarkb | I wasn't able to be around for the reschedule time but I do have an optometrist visit on the 16th | 20:44 |
| clarkb | what time on the 16th was turn off gerrit time? | 20:44 |
| * clarkb checks email | 20:44 | |
| fungi | 17:00 | 20:44 |
| *** e0ne has joined #openstack-infra | 20:44 | |
| fungi | notmorgan: our last experience with a major gerrit upgrade on saturday was that we didn't realize there was a serious problem until load ramped up well into monday | 20:45 |
| pleia2 | it's a lengthy window though | 20:45 |
| notmorgan | fungi: ok 16th | 20:45 |
| notmorgan | fungi: cool | 20:45 |
| nibalizer | mordred: http://paste.openstack.org/show/481709/ | 20:45 |
| fungi | this way hopefully load will pick back up as soon as we're done, or worse case the very next day | 20:45 |
| clarkb | ok my optometrist visit is at 2115 so I can be useful | 20:45 |
| fungi | yeah, hopefully we'll already be wrapped up by the time you need to ditch | 20:46 |
| clarkb | (trying to be useful now in getting those changes shephered through) | 20:46 |
| fungi | we blocked out 4 hours but ideally it won't take more than ~2 | 20:46 |
| *** sridhar_ram has quit IRC | 20:46 | |
| clarkb | nibalizer: mordred from memory its very specifically how using v3password auth type selects a different client class in keystoneclient or keystoneauth whcih takes a different set of parameters | 20:46 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Bug fix: delete_object() returns True/False https://review.openstack.org/256741 | 20:47 |
| clarkb | there was a discussion in here about it with jamielennox|away at one point and I got all confused with how oslo.config works | 20:47 |
| *** hogepodge has quit IRC | 20:47 | |
| clarkb | since oslo.config says "foo-param is required" but really you have ot pass in "foo_param" or something | 20:47 |
| *** weshay_xchat has joined #openstack-infra | 20:47 | |
| *** Piet has joined #openstack-infra | 20:48 | |
| *** Sukhdev has quit IRC | 20:48 | |
| notmorgan | fungi: https://etherpad.openstack.org/p/gerrit-update-encoded-slashes | 20:48 |
| clarkb | nibalizer: if you want fast image builds and boots the devstack plugin has a snapshot script and a dib setup for ubuntu that makes a much smaller image than our normal builds | 20:49 |
| clarkb | nibalizer: its basically just make a use rand add ssh key so nodepool can ssh in | 20:49 |
| *** thomasem has joined #openstack-infra | 20:49 | |
| thomasem | Hey there | 20:49 |
| *** yamahata has joined #openstack-infra | 20:49 | |
| clarkb | thomasem: hello | 20:49 |
| thomasem | Trying to follow these steps: https://github.com/openstack-infra/devstack-gate#simulating-devstack-gate-tests to figure out why I'm getting different results in my devstack than the gate's devstack, and after running the setup steps right after the reboot, it seems like my ssh key no longer works >.> | 20:50 |
| fungi | notmorgan: lgtm | 20:50 |
| notmorgan | fungi: cool | 20:50 |
| notmorgan | sending | 20:50 |
| fungi | thanks! | 20:50 |
| nibalizer | clarkb: okay ill check that out | 20:51 |
| thomasem | Like it bombed my authorized_keys file or something | 20:51 |
| clarkb | thomasem: is the cat command for the public key working? | 20:51 |
| clarkb | thomasem: path is correct and all that? | 20:51 |
| thomasem | cat: .ssh/id_rsa.pub: No such file or directory | 20:52 |
| thomasem | looks like not | 20:52 |
| clarkb | that'll do it | 20:52 |
| notmorgan | fungi: sent. | 20:53 |
| notmorgan | nibalizer: let me know if you need some extra eyes on password plugin things | 20:53 |
| *** otter768 has joined #openstack-infra | 20:53 | |
| thomasem | clarkb: but that looks like it's trying to cat .ssh/id_rsa.pub from the remote server where I'm setting up the tests... the key I'm using to log into that server is on my local machine, that's the one that was originally set up. | 20:53 |
| clarkb | thomasem: its going to cat it wherever you run that command | 20:54 |
| clarkb | thomasem: the idea is to take the existing key and reinject it so ssh continues to work | 20:54 |
| thomasem | oh crud, it's not using ~/ | 20:54 |
| thomasem | heh, wut | 20:55 |
| thomasem | okay | 20:55 |
| thomasem | thanks | 20:55 |
| thomasem | Yeah, I ran that command from inside the testserver | 20:56 |
| *** rcernin has joined #openstack-infra | 20:56 | |
| *** rguillebert has quit IRC | 20:57 | |
| openstackgerrit | Craige McWhirter proposed openstack-infra/puppet-phabricator: Added OpenID Apache configuration options https://review.openstack.org/254595 | 20:57 |
| thomasem | lemme try this again | 20:58 |
| mordred | nibalizer: looking | 20:58 |
| *** otter768 has quit IRC | 20:58 | |
| mordred | nibalizer: isyour clouds.yaml somewhere I cna see it? | 20:58 |
| thomasem | thanks, clarkb! | 20:58 |
| clarkb | thomasem: np | 20:58 |
| nibalizer | mordred: yes it is | 20:59 |
| fungi | for some reason i can not seem to get project-config's tox -e jjb working locally. is this expected to work? | 20:59 |
| nibalizer | let me get you enabled | 20:59 |
| *** rellerreller has quit IRC | 20:59 | |
| *** weshay_xchat has quit IRC | 21:00 | |
| clarkb | fungi: need jjb release | 21:00 |
| clarkb | iirc | 21:00 |
| fungi | even if i checkout origin/master, delete my pip and jenkins_jobs cache, and completely git clean the work tree i still get "jenkins_jobs.errors.JenkinsJobsException: template-name parameter missing to format {template-name}" | 21:00 |
| *** baoli has quit IRC | 21:00 | |
| nibalizer | mordred: root@104.130.17.196 | 21:00 |
| clarkb | ya | 21:00 |
| fungi | ahh, perhaps that's it. i'll see if a jjb master commit works | 21:00 |
| fungi | thanks! | 21:01 |
| jeblair | we should release or update the tox env to zuul-cloner that | 21:01 |
| fungi | this has resulted in me pushing far more broken patches into gerrit that i would otherwise have done | 21:01 |
| fungi | zaro: pelix: zxiiro: what are the plans for tagging a new jjb release? | 21:02 |
| *** gordc has joined #openstack-infra | 21:03 | |
| *** peristeri has quit IRC | 21:04 | |
| *** tzn has quit IRC | 21:04 | |
| *** peristeri has joined #openstack-infra | 21:04 | |
| nibalizer | mordred: there is a root screen you can hop in | 21:05 |
| fungi | yeah, switching to master branch tip of jjb does indeed seem to get that tox env working again | 21:05 |
| nibalizer | also clarkb we didn't actually fix it | 21:05 |
| nibalizer | when we sourced the environment variables we changed shades behaviour | 21:05 |
| clarkb | nibalizer: bwhahaha | 21:06 |
| nibalizer | without those env forms and only clouds.yaml it doesnt work | 21:06 |
| clarkb | nibalizer: same error? | 21:06 |
| nibalizer | its very generic but yes: 'Problem with auth parameters' | 21:06 |
| clarkb | nibalizer: try removing the auth type and auth version and only set the auth url | 21:07 |
| clarkb | nibalizer: lets see if it figures it out properly on its own | 21:07 |
| nibalizer | kk | 21:07 |
| mordred | nibalizer: I have updated your file | 21:07 |
| mordred | wait | 21:07 |
| clarkb | also we should se eaboubt better logging in ksa/oscc/shade | 21:07 |
| mordred | seriously | 21:07 |
| clarkb | mordred: ? | 21:07 |
| mordred | don't just be chanign auth_type and auth_version | 21:08 |
| mordred | the file tha twas there was just wrong | 21:08 |
| mordred | it is now fixed | 21:08 |
| mordred | try the file now | 21:08 |
| clarkb | what was wrong with it? | 21:08 |
| nibalizer | /etc/openstack/clouds.yaml ? | 21:08 |
| mordred | it was missing domain information | 21:08 |
| mordred | which I have just added | 21:08 |
| clarkb | mordred: ok, maybe we should log that then | 21:08 |
| nibalizer | oh sorry | 21:08 |
| clarkb | (and I wonder if thats what I had problems with when I tried it with devstack a while back) | 21:08 |
| mordred | it's possible | 21:08 |
| nibalizer | mordred: does it look right now? | 21:09 |
| mordred | both v2 and v3 work - you just have to put the infos in | 21:09 |
| *** aysyd has quit IRC | 21:09 | |
| *** dewsday has joined #openstack-infra | 21:09 | |
| mordred | yes. it's worth trying that - my network has decided to be crappy - so I'd try "openstack --os-cloud=omfra-cloud flavor list" | 21:09 |
| mordred | and see if it works | 21:09 |
| *** mriedem_away has quit IRC | 21:10 | |
| *** Piet has quit IRC | 21:11 | |
| *** aysyd has joined #openstack-infra | 21:12 | |
| *** hogepodge has joined #openstack-infra | 21:12 | |
| *** dewsday has quit IRC | 21:12 | |
| greghaynes | wow it is actually being called omfra-cloud? nic3. | 21:13 |
| greghaynes | nice, even. | 21:13 |
| *** flepied has quit IRC | 21:13 | |
| fungi | i'll never live that typo down | 21:13 |
| *** tsg has joined #openstack-infra | 21:14 | |
| greghaynes | It was a good typo | 21:14 |
| mordred | nibalizer: ok. your clouds.yaml works now | 21:14 |
| *** flepied has joined #openstack-infra | 21:14 | |
| fungi | as typos go, it's up there | 21:14 |
| *** slogan621 has joined #openstack-infra | 21:14 | |
| clarkb | mordred: nibalizer but make sure nodepool works too | 21:14 |
| mordred | yah | 21:14 |
| mordred | that's the next step | 21:14 |
| clarkb | I wouldn't trust openstack client to be definitive :) | 21:14 |
| mordred | :) | 21:14 |
| fungi | in another circle of friends we use exokide and unokide instead of explode and implode | 21:14 |
| *** peristeri has quit IRC | 21:15 | |
| *** hashar has joined #openstack-infra | 21:15 | |
| mordred | clarkb: works from shade too | 21:15 |
| clarkb | mordred: so it waas just addition of domain that was missing? | 21:15 |
| mordred | http://paste.openstack.org/show/481712/ | 21:16 |
| mordred | yes | 21:16 |
| mordred | also, there were 3 values that were in auth dict which are not auth params | 21:16 |
| fungi | actually best example of a typo where one hand is shifted by a (qwerty) key position is someone i used to know named alice, who went online by slivr | 21:16 |
| fungi | (left hand shifted right one key) | 21:16 |
| *** claudiub has quit IRC | 21:17 | |
| mordred | cacert: '/etc/openstack/omfra_cacert.pem' | 21:17 |
| mordred | auth_type: 'v3password' | 21:17 |
| clarkb | mordred: they need to be up a level? | 21:17 |
| mordred | identity_api_version: '3' | 21:17 |
| *** bcourt has joined #openstack-infra | 21:17 | |
| mordred | those are not auth params, yes, they need to be up one level (which they are now) | 21:17 |
| mordred | openstack flavor list was helpful in diagnosing that | 21:17 |
| clarkb | does it traceback more explicitly? | 21:17 |
| *** smarcet has quit IRC | 21:17 | |
| mordred | well, it gives you the one error and you don't have to read nodepool logs | 21:18 |
| slogan621 | clarkb: do unofficial projects get "released" in the same way as official projects? | 21:18 |
| mordred | __init__() got an unexpected keyword argument 'auth_type' | 21:18 |
| mordred | clarkb: that's the error you get in that case | 21:19 |
| nibalizer | um i have to afk | 21:19 |
| clarkb | slogan621: yes, the underlying mechanisms are the same but I don't think you will end up using reno for it. You make a signed git tag and push it to gerrit which triggers the release machinery | 21:19 |
| nibalizer | flight changes that were unexpectes | 21:19 |
| mordred | with that in the right place but without domains | 21:19 |
| mordred | you get | 21:19 |
| *** rlandy has quit IRC | 21:19 | |
| mordred | The request you have made requires authentication. (HTTP 401) (Request-ID: req-03fe6038-447a-4297-924a-b32f0091e43e) | 21:19 |
| clarkb | mordred: ah yup thats a bit more verbose, can we get shade/oscc/nodepool to expose that ? /me wonders where in the stack its breaking | 21:20 |
| mordred | which, sadly, is about as precise as you can get | 21:20 |
| clarkb | mordred: thats a lot better than what nodepool was doing, probably nodepool or shade wrapping it then | 21:20 |
| mordred | clarkb: I'd expect that to be in the nodepol logs | 21:20 |
| fungi | slogan621: clarkb: also you wouldn't release by proposing a change to the openstack/releases repository (though not all "official" projects are release managed in that way either) | 21:20 |
| clarkb | mordred: it wasn't see http://paste.openstack.org/show/481709/ | 21:20 |
| *** eharney has quit IRC | 21:20 | |
| mordred | clarkb: shade.exc.OpenStackCloudException: Error fetching flavor list (Inner Exception: Problem with auth parameters) | 21:21 |
| mordred | that's what I get from shade | 21:21 |
| clarkb | mordred: right it should say got an unexpected keyword argument 'auth_type' in order to make that debuggable | 21:21 |
| mordred | k. lemme figure out where that's going south | 21:21 |
| clarkb | might just be a missed exception wrapping thing in shade | 21:21 |
| slogan621 | clarkb: so, it's an opt in - contributing code to OpenStack projects can be done without regard to release schedules, if we don't take specific action, there is no release. | 21:22 |
| fungi | slogan621: correct | 21:22 |
| clarkb | except that I think the TC may be asking official projects to do some sort of release cadence? | 21:22 |
| clarkb | you can't perpetually be unreleased and be official, but I will let TC clarify that | 21:22 |
| fungi | clarkb: only if they have a specific release management tag in the governance list of projects | 21:23 |
| *** bpokorny_ has quit IRC | 21:23 | |
| slogan621 | yeah, would think the pressure is on more for official projects | 21:23 |
| *** bpokorny has joined #openstack-infra | 21:23 | |
| fungi | we (infra) have plenty of "official" projects which have never had any formal release | 21:23 |
| clarkb | good point | 21:23 |
| slogan621 | I'm just going to be hitting the repos late in the current cycle, want to make sure I'm not going to cause issues for the OpenStack release if code is in a half baked state | 21:24 |
| *** bpokorny has quit IRC | 21:24 | |
| *** bpokorny has joined #openstack-infra | 21:25 | |
| *** krtaylor has quit IRC | 21:25 | |
| clarkb | if you are unofficial you are pretty much free to do what you want in your repos except restrict the licensing on them. | 21:25 |
| clarkb | if you do that you should attic the code that was free and open and move development elsewhere | 21:26 |
| slogan621 | meaning, if we are Apache 2 license, all is good | 21:26 |
| clarkb | yup all is good | 21:26 |
| slogan621 | great. And if we have something fully baked in "n" release, we can play the release game | 21:26 |
| clarkb | ya | 21:27 |
| *** eharney has joined #openstack-infra | 21:27 | |
| slogan621 | and surely between then people can use what is in the repo by running patching in our devstack scripts | 21:27 |
| slogan621 | if they choose | 21:27 |
| fungi | not having the foggiest what will be inside that repo, i'm just going to smile and nod at this point | 21:28 |
| slogan621 | heh | 21:28 |
| slogan621 | well, that will come :-) | 21:28 |
| openstackgerrit | Ondřej Nový proposed openstack-dev/pbr: Deprecated tox -downloadcache option removed https://review.openstack.org/256750 | 21:28 |
| slogan621 | it's going to be in the monitoring/metrics space | 21:28 |
| slogan621 | that's about all I can share at the moment | 21:29 |
| clarkb | heh | 21:29 |
| fungi | downside to having tox -e jjb working locally again... remembering that i still need to find a replacement cpu fan for this computer | 21:29 |
| clarkb | fungi: just strap a box fan to the case | 21:30 |
| fungi | if only, but it's one of those super-compact jobbies like a nuc | 21:30 |
| fungi | with a teensy laptop fan sandwiched in between the boards | 21:30 |
| *** abregman|nearby has quit IRC | 21:30 | |
| fungi | a laptop fan for which i cannot seem to source any replacement online | 21:30 |
| openstackgerrit | Jerry Zhao proposed openstack-infra/project-config: add more jobs for networking-fortinet https://review.openstack.org/256719 | 21:31 |
| *** pradk has quit IRC | 21:31 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Stack API improvements https://review.openstack.org/256751 | 21:32 |
| *** pradk has joined #openstack-infra | 21:36 | |
| *** baoli has joined #openstack-infra | 21:37 | |
| *** krtaylor has joined #openstack-infra | 21:37 | |
| *** pradk has quit IRC | 21:37 | |
| *** tzn has joined #openstack-infra | 21:39 | |
| *** mdenny has quit IRC | 21:39 | |
| *** pradk has joined #openstack-infra | 21:42 | |
| *** tzn has quit IRC | 21:42 | |
| *** Piet has joined #openstack-infra | 21:45 | |
| *** flepied has left #openstack-infra | 21:46 | |
| *** e0ne has quit IRC | 21:47 | |
| *** notnownikki has quit IRC | 21:47 | |
| sdague | tox is reregressing in the gate | 21:47 |
| fungi | more images have probably come online--checking and deleting now | 21:47 |
| *** e0ne has joined #openstack-infra | 21:49 | |
| *** flepied has joined #openstack-infra | 21:49 | |
| fungi | yep, that was it. dib diskimages don't end up going live until much later than our snapshot images. those newest ones are now deleted as well | 21:49 |
| *** e0ne has quit IRC | 21:49 | |
| openstackgerrit | Ondřej Nový proposed openstack-infra/jenkins-job-builder: Deprecated tox -downloadcache option removed https://review.openstack.org/256754 | 21:50 |
| openstackgerrit | Ondřej Nový proposed openstack-infra/nodepool: Deprecated tox -downloadcache option removed https://review.openstack.org/256755 | 21:50 |
| fungi | instead of pinning tox to an old version, which as we've acknowledged is problematic, how about stopping nodepool image refreshes until there's a fixed tox, so we're not hammering at this over and over through the weekend? | 21:51 |
| openstackgerrit | Ondřej Nový proposed openstack-infra/requestsexceptions: Deprecated tox -downloadcache option removed https://review.openstack.org/256756 | 21:51 |
| clarkb | fungi: sure, just change the cron on that? | 21:51 |
| *** thorst has quit IRC | 21:51 | |
| fungi | that's what i was considering. looking now to see if it's feasible | 21:52 |
| openstackgerrit | Ondřej Nový proposed openstack-infra/storyboard: Deprecated tox -downloadcache option removed https://review.openstack.org/256757 | 21:52 |
| *** thorst has joined #openstack-infra | 21:52 | |
| fungi | oh, righth, nodepool.yaml moved to project-config | 21:54 |
| clarkb | pretty sure you can just set it to run every tuesday | 21:54 |
| clarkb | then revert that change once we get fix | 21:54 |
| fungi | i'm curious if the logging config template (which is still in system-config) is being kept up to date | 21:54 |
| clarkb | that is an excellent quetion | 21:55 |
| clarkb | particularly since we removed centos6 | 21:55 |
| *** pradk has quit IRC | 21:55 | |
| fungi | yep, our cron pattern seems to allow for day of month and day of week | 21:55 |
| *** thorst has quit IRC | 21:56 | |
| fungi | oh, except now i've completely crashed my workstation from running it overheated for too long | 21:57 |
| fungi | i should just go back to pushing untested changes into gerrit | 21:58 |
| openstackgerrit | Ondřej Nový proposed openstack/diskimage-builder: Deprecated tox -downloadcache option removed https://review.openstack.org/256770 | 21:58 |
| *** flepied has quit IRC | 22:00 | |
| *** EricGonc_ has joined #openstack-infra | 22:01 | |
| *** flepied has joined #openstack-infra | 22:02 | |
| *** EricGonczer_ has quit IRC | 22:04 | |
| *** lascii is now known as alaski | 22:05 | |
| *** alivigni has quit IRC | 22:06 | |
| *** Sukhdev has joined #openstack-infra | 22:08 | |
| *** aysyd has quit IRC | 22:08 | |
| thomasem | hmmm, clarkb I think there's a workflow problem here with this. So, it tells me to boot a server with my SSH key allowed, but never creates an SSH key to be used with the cat that sends the SSH key to the puppet module... and, even when I do create an SSH key at .ssh/id_rsa.pub, it doesn't copy over the one I used to log in in the first place. That's the part that's confusing me. | 22:10 |
| thomasem | So, I've now had to create an ssh key there, then copy that key onto my workstation to actually log into the box as jenkins | 22:10 |
| clarkb | thomasem: it copies it over in the authorized_keys file | 22:10 |
| clarkb | so maybe the thing to do is cat that file instead of hte pubkey file which may not exist | 22:10 |
| *** thorst has joined #openstack-infra | 22:11 | |
| *** armax_ is now known as armax | 22:11 | |
| *** tjones has joined #openstack-infra | 22:11 | |
| thomasem | Yeah, probably... I'm concerned about the documentation. I know I can make it work, just the documentation is what's confusing me. | 22:11 |
| thomasem | I'll throw together a bug against it, if that's cool | 22:11 |
| clarkb | thomasem: just push the fix | 22:12 |
| thomasem | okey doke | 22:12 |
| clarkb | cat ~/.ssh/authorized_keys | 22:12 |
| thomasem | yeah, sorry. Wasn't sure what sort of ceremony was required with dev on this project :P | 22:12 |
| thomasem | I can do that too :) | 22:12 |
| fungi | ceremony is for churches. this is a buffet line | 22:12 |
| thomasem | LOL | 22:13 |
| *** sridhar_ram has joined #openstack-infra | 22:13 | |
| *** flepied has quit IRC | 22:13 | |
| thomasem | sounds good, thanks, clarkb | 22:13 |
| thomasem | I'm about to run, but I'll get a PR up Monday, for sure. | 22:13 |
| thomasem | fungi: Seems like every project has its own flavor. | 22:14 |
| fungi | our documentation is maintained by people who read it, almost get it working, figure out what wasn't quite right, and update it | 22:14 |
| thomasem | okay, cool | 22:15 |
| *** flepied has joined #openstack-infra | 22:15 | |
| *** thorst has quit IRC | 22:15 | |
| *** flepied has quit IRC | 22:17 | |
| *** flepied has joined #openstack-infra | 22:17 | |
| *** denisra has joined #openstack-infra | 22:17 | |
| *** bcourt has quit IRC | 22:21 | |
| *** masber has joined #openstack-infra | 22:24 | |
| clarkb | oh I bet I know why we don't cat the athorized keys file, because that may have >1 key in it | 22:26 |
| clarkb | so we may just want to | head -1 and note that only the first key is used or soething | 22:27 |
| *** cbader has quit IRC | 22:30 | |
| thomasem | clarkb: well, if they're following the tutorial verbatim, they'll only have one key in there. | 22:31 |
| thomasem | I figured that was the assumption | 22:31 |
| *** baoli has quit IRC | 22:31 | |
| thomasem | The problem is in determining which is the key one expects to attach with... I think it's better to force them into using one key, than be ambiguous about it. | 22:31 |
| fungi | clarkb: 256821 and 256822 for the nodepool image frequency and revert (took a few minutes to get a dev environment set up on another machine) | 22:31 |
| thomasem | s/attach/ssh/ | 22:31 |
| fungi | also openstackgerrit is oddly quiet about my upload | 22:32 |
| thomasem | After all, it is just a test server :) | 22:32 |
| thomasem | Anyway, I got a command that does the whole zero-to-hero thing. | 22:33 |
| thomasem | At least for that particular portion. I'll push a PR of that up | 22:33 |
| thomasem | in the README | 22:33 |
| clarkb | is openstackgerrit afk? | 22:34 |
| fungi | openstackgerrit is in channel and responding to irc ping. i wonder if it's really lagged? or if we broke it somehow? or if something's got the gerrit event stream stuck again | 22:34 |
| thomasem | well it is 4pm CST on a Friday, perhaps openstackgerrit started hitting the bottle? | 22:34 |
| fungi | openstackgerrit is always hitting the bottle | 22:34 |
| thomasem | I knew it | 22:34 |
| fungi | it's never too early | 22:34 |
| thomasem | LOL | 22:35 |
| fungi | 2015-12-11 22:35:48,530 INFO gerritbot: Sending "Khai Do proposed openstack-infra/system-config: Upgrade review.o.o to Gerrit 2.11 https://review.openstack.org/241309" to #openstack-infra | 22:36 |
| clarkb | fungi: +2 to both | 22:36 |
| fungi | so it thinks it's still doing things | 22:36 |
| fungi | getting events from gerrit obviously and seems to believe it's reporting them into the channel | 22:36 |
| *** ZZelle_ has joined #openstack-infra | 22:37 | |
| fungi | i'm going to give it a restart | 22:37 |
| *** openstackgerrit has quit IRC | 22:37 | |
| *** openstackgerrit has joined #openstack-infra | 22:37 | |
| *** rcernin has quit IRC | 22:37 | |
| fungi | tailing the debug log to see if it continues to be silently silent | 22:37 |
| clarkb | I wonder if this is the silent netsplit behavior people have been complaing about | 22:38 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Bump Gerrit version on review-dev.o.o https://review.openstack.org/256838 | 22:38 |
| thomasem | Alright, y'all. I'm going to find dinner. Nice chatting, and have a wonderful weekend! | 22:38 |
| fungi | looks like it's working now | 22:38 |
| fungi | have a good weekend thomasem | 22:38 |
| *** thomasem is now known as thomasem-away | 22:39 | |
| fungi | clarkb: yeah, could be a netsplit that was only half-duplex, so to speak | 22:39 |
| *** cbader has joined #openstack-infra | 22:39 | |
| *** gordc has quit IRC | 22:39 | |
| fungi | not something i've ever witnessed before now | 22:40 |
| openstackgerrit | Merged openstack/requirements: Updated oslo.db to 4.1.0 https://review.openstack.org/254624 | 22:40 |
| *** u_glide1 has left #openstack-infra | 22:41 | |
| fungi | need to disappear and get something to eat shortly myself | 22:41 |
| fungi | and then come home and beg my workstation to start back up | 22:42 |
| fungi | it's about time for me to replace it and expense a new one though. coming up on the 3-year mark | 22:42 |
| fungi | i bet i could find some thinner, lighter 36" monitors this time too | 22:43 |
| *** masber has quit IRC | 22:43 | |
| fungi | and likely cheaper | 22:44 |
| fungi | one of them is constantly blowing out dc power supplies, and i'm getting tired of having to hack together replacements for it | 22:44 |
| clarkb | 24" 4k monitors are cheapish | 22:45 |
| clarkb | you could get 3 of them for all the pixels | 22:45 |
| fungi | indeed | 22:46 |
| *** jaypipes has quit IRC | 22:46 | |
| fungi | good mainline kernel support for multiple 4k panels on a displayport interface? | 22:46 |
| fungi | finally got displayport multi-streaming working in debian/sid with the haswell chipset on this machine only a few months ago | 22:47 |
| openstackgerrit | Merged openstack-infra/shade: Bug fix: delete_object() returns True/False https://review.openstack.org/256741 | 22:47 |
| clarkb | I am not sure | 22:48 |
| *** salv-orl_ has joined #openstack-infra | 22:48 | |
| fungi | so right now have both panels run from a displayport hub | 22:48 |
| fungi | anyway, heading out to eat. back later if i get the workstation back online in a timely fashion | 22:49 |
| *** tsg has quit IRC | 22:49 | |
| *** salv-orlando has quit IRC | 22:51 | |
| *** flepied has quit IRC | 22:51 | |
| *** flepied has joined #openstack-infra | 22:52 | |
| *** thorst has joined #openstack-infra | 22:52 | |
| *** otter768 has joined #openstack-infra | 22:54 | |
| *** amuller has quit IRC | 22:55 | |
| crinkle | nibalizer: clarkb mordred i've been afk all day, what's going on with omfra? | 22:55 |
| *** dims has joined #openstack-infra | 22:55 | |
| *** otter768 has quit IRC | 22:58 | |
| *** flepied has quit IRC | 23:00 | |
| *** dims has quit IRC | 23:00 | |
| *** tonytan4ever has quit IRC | 23:01 | |
| *** dims has joined #openstack-infra | 23:01 | |
| *** August1914 has joined #openstack-infra | 23:03 | |
| *** dims has quit IRC | 23:04 | |
| *** bpokorny has quit IRC | 23:05 | |
| mordred | crinkle: nibz set up a nodepool - we worked through a little connection issue | 23:05 |
| mordred | crinkle: but then he afkd | 23:05 |
| nibalizer | ya | 23:05 |
| nibalizer | im actually just back right now | 23:06 |
| *** bpokorny has joined #openstack-infra | 23:06 | |
| nibalizer | delta decided i would be better served by an alaska flight leaving earlier from the other side of the airport | 23:06 |
| *** thorst_ has joined #openstack-infra | 23:06 | |
| crinkle | mordred: nibalizer cool | 23:07 |
| mordred | clarkb, jeblair, fungi: there is an issue with the memory in one of our bluebox hosts | 23:08 |
| mordred | do we have an preference as to maint window times for them to fix it? | 23:08 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for tox 2.3.0 bug 1525352 https://review.openstack.org/256823 | 23:08 |
| openstack | bug 1525352 in devstack "Devstack fails with ValueError when trying to parse Tempest tox.ini" [Undecided,In progress] https://launchpad.net/bugs/1525352 - Assigned to Ryan Hsu (rhsu) | 23:08 |
| *** hashar has quit IRC | 23:09 | |
| *** thorst has quit IRC | 23:09 | |
| *** amitgandhinz has quit IRC | 23:11 | |
| jeblair | mordred: i don't think so... do we need to do anything? can they just remove the hypervisor and add it in without us? | 23:12 |
| *** dims has joined #openstack-infra | 23:12 | |
| jeblair | (is there a way to say "don't schedule anything else on this host" in nova?) | 23:12 |
| jeblair | mordred: oh, if it has the mirror, we will need to quiesce the provider | 23:12 |
| nibalizer | mordred: so when you say that the clouds.yaml we were working with works now... i have a hard time replicating that | 23:13 |
| nibalizer | i still get auth errors | 23:13 |
| nibalizer | http://paste.openstack.org/show/481722/ | 23:15 |
| mordred | jeblair: ds0004.sjc03 is the host | 23:17 |
| mordred | nibalizer: oh - sorry - I broke it again on purpose because I was trying to duplicate bad error messages | 23:18 |
| nibalizer | haha | 23:18 |
| mordred | one sec | 23:18 |
| nibalizer | a cautionary tale of giving mordred ssh access | 23:18 |
| mordred | nibalizer: try again | 23:18 |
| nibalizer | you can copy the clouds.yaml and cacert out if you want | 23:18 |
| nibalizer | or I could be not-lazy and put them in the root bastion | 23:18 |
| mordred | nah. I don't need it anymore | 23:18 |
| nibalizer | cool | 23:18 |
| nibalizer | did fungi make dns? | 23:19 |
| nibalizer | what about certs? stay self-signed or get a real one? | 23:19 |
| nibalizer | crinkle: how hard is it to change certs? | 23:19 |
| mordred | jeblair: pypi mirror is on ds0005 | 23:20 |
| crinkle | nibalizer: shouldn't be very hard, just put the new ones in hiera | 23:20 |
| crinkle | puppet should restart the right things | 23:21 |
| nibalizer | oh is infra-cloud puppeting against our main master now? | 23:21 |
| crinkle | no | 23:21 |
| nibalizer | oh | 23:21 |
| crinkle | you'd have to rerun puppet manually | 23:21 |
| nibalizer | ok thats what i thought | 23:21 |
| nibalizer | where is hiera? | 23:21 |
| nibalizer | i mean I don't have certs, fungi or someone would have to show me how infra gets certs | 23:22 |
| *** baoli has joined #openstack-infra | 23:22 | |
| nibalizer | but copying and pasting around thi cacert file is getting pretty old | 23:22 |
| openstackgerrit | David Lyle proposed openstack-infra/project-config: Adding trove-dashboard repo and jobs https://review.openstack.org/256605 | 23:22 |
| crinkle | it's in /opt/system-config/hieradata/production | 23:22 |
| *** jcoufal has joined #openstack-infra | 23:23 | |
| nibalizer | on the controller? | 23:23 |
| *** amitgandhinz has joined #openstack-infra | 23:24 | |
| crinkle | nibalizer: yes | 23:25 |
| nibalizer | so you manage this with puppet apply? i thought you had a puppet master | 23:25 |
| clarkb | for ansible running puppet apply are the current issues dns (maybe done?) and different module versions? | 23:26 |
| crinkle | nibalizer: yes it's just done with puppet apply right now | 23:27 |
| crinkle | clarkb: yes and also hiera data | 23:27 |
| nibalizer | what bout the nodes? they puppet apply too? | 23:27 |
| clarkb | zaro: can you wip https://review.openstack.org/#/c/241309/ so it doesn't merge early? | 23:27 |
| crinkle | nibalizer: yes | 23:27 |
| nibalizer | ok | 23:27 |
| clarkb | nibalizer: ya so need dns for them too I htink | 23:27 |
| clarkb | not just the controller | 23:27 |
| nibalizer | sorry not trying to be dense just lean | 23:27 |
| *** bharathm has quit IRC | 23:27 | |
| *** baoli has quit IRC | 23:27 | |
| *** kozhukalov_ has quit IRC | 23:27 | |
| clarkb | crinkle: for the hiera data we can just scp from controller to master (lets not do that now so we don't double account but should be easy to do once we are ready) | 23:28 |
| *** sdake has joined #openstack-infra | 23:28 | |
| nibalizer | ya | 23:28 |
| *** thorst_ has quit IRC | 23:28 | |
| crinkle | clarkb: i assume you'll want to change the passwords and keys before it goes onto the master | 23:28 |
| nibalizer | so install_modules isn't currently being run on clients | 23:29 |
| nibalizer | we're just rsyncing /etc/puppet/modules from the master to a client | 23:29 |
| mordred | the modules thing | 23:29 |
| clarkb | crinkle: ya probably, though maybe not? not sure if we have settled on an administrivia process yet | 23:29 |
| mordred | where did we come down on that? | 23:29 |
| *** jaosorior has quit IRC | 23:29 | |
| *** thorst has joined #openstack-infra | 23:29 | |
| clarkb | I think we can either finish up the work to ocnverge the modules | 23:29 |
| clarkb | or install on individual hosts | 23:29 |
| crinkle | mordred: i made https://review.openstack.org/#/c/247755/ and https://review.openstack.org/#/c/247273/ as a possible hack, i know pabelanger also had ideas | 23:29 |
| clarkb | paste and wiki | 23:29 |
| nibalizer | we kinda keep having the conversation and never really getting to a solution | 23:30 |
| clarkb | for paste I am semi inclined to yolo | 23:30 |
| clarkb | for wiki I am a little less in my element | 23:30 |
| nibalizer | i know i get asked about current state of the plan a lot and don't have a good answer | 23:30 |
| crinkle | if we just get those upgraded then we don't really need to keep talking about it | 23:30 |
| clarkb | crinkle: right | 23:30 |
| *** armax has quit IRC | 23:30 | |
| mordred | I think I vote for convergence | 23:31 |
| clarkb | maybe what we do is this, disable puppet on wiki and paste, update modules, do db backups, manually trigger puppet run to check output, reenable puppet if all goes well | 23:31 |
| clarkb | and we can do paste first | 23:32 |
| clarkb | little late in the day/week to start that now for me at least | 23:32 |
| clarkb | but I can probably help do that next week when not gerrit upgrading | 23:32 |
| clarkb | crinkle: mordred nibalizer is that a reaosnable plan? | 23:32 |
| crinkle | clarkb: awesome | 23:32 |
| *** sdake_ has joined #openstack-infra | 23:33 | |
| mordred | cool | 23:33 |
| nibalizer | sure | 23:33 |
| mordred | and I will also finishing fixing the inventory to not be ugly | 23:33 |
| nibalizer | mordred: ++ | 23:33 |
| mordred | and we can swap over to apply | 23:33 |
| mordred | as well | 23:33 |
| clarkb | mordred: arent'y we applying? | 23:33 |
| mordred | nope | 23:34 |
| mordred | we stopped one step short | 23:34 |
| pabelanger | I like install on individual hosts, it's worked well in the past for me | 23:34 |
| nibalizer | mordred: reed lly? | 23:34 |
| nibalizer | i juts believed clark | 23:34 |
| clarkb | oh really? beacuse I accidentally a thing on logstash-worker20 and puppetmsater stopped working | 23:34 |
| pabelanger | but, at this point, anything is better :) | 23:34 |
| clarkb | and had to manually undo it and use apply | 23:34 |
| mordred | https://review.openstack.org/#/c/249492/ | 23:34 |
| clarkb | well in that case puppet apply works when I run it :) | 23:34 |
| nibalizer | mordred: ya i'd <3 if the inventory got sane agian | 23:34 |
| mordred | yeah - the ryncs are all happening | 23:35 |
| nibalizer | all uuids like this is really hard to tell whats going on | 23:35 |
| mordred | so puppet apply will TOTALLY work | 23:35 |
| clarkb | we just aren't doing it as normal process | 23:35 |
| mordred | nibalizer: yeah - my original plan had been to fix the uuid problem before moving forward | 23:35 |
| mordred | nibalizer: there is also currently a problem with group membership mismatch | 23:35 |
| *** sdake has quit IRC | 23:35 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 23:35 | |
| crinkle | clarkb: what about http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/slave_db.pp | 23:35 |
| clarkb | crinkle I am much less worried about the image builds | 23:36 |
| clarkb | crinkle: I think those iwll just work tm because they start from a clean slate each time | 23:36 |
| *** August1914 has quit IRC | 23:36 | |
| clarkb | there is no existing db that you care about to worry about | 23:36 |
| crinkle | clarkb: okay cool | 23:36 |
| reed | nibalizer, whazzup? | 23:37 |
| clarkb | haha typo ping | 23:37 |
| clarkb | reed: I think nibalizer meant to say "really" | 23:37 |
| *** thorst has quit IRC | 23:37 | |
| reed | ehehe | 23:37 |
| clarkb | mordred: based on my puppet applying on logstash-worker20 I am pretty confident in the process. I have already +2d that change, anything specific we are waiting on before going live? | 23:40 |
| nibalizer | haha sorry reed | 23:40 |
| *** ajmiller has quit IRC | 23:40 | |
| clarkb | maybe doing it on not firday? | 23:40 |
| mordred | clarkb: yeah. not doing it on a friday is the thing | 23:40 |
| *** smarcet has joined #openstack-infra | 23:40 | |
| clarkb | there are docs changes zaro has suggested too | 23:40 |
| mordred | clarkb: also, there is a bug in the group membership | 23:41 |
| reed | no problem | 23:41 |
| mordred | clarkb: I can't remember what right now - but I'll hack up a patch tomorrow (it's not a big one) | 23:41 |
| clarkb | ok | 23:41 |
| mordred | clarkb: and we can go live monday | 23:41 |
| jeblair | reedly | 23:41 |
| nibalizer | clarkb: your (unlanded) nodepool docs have been really useful | 23:44 |
| *** baoli has joined #openstack-infra | 23:44 | |
| nibalizer | clarkb: haha you are two heredocs deep in this devstack-plugin | 23:46 |
| nibalizer | nice | 23:46 |
| *** MarkAtwood has quit IRC | 23:46 | |
| *** salv-orl_ has quit IRC | 23:47 | |
| clarkb | ya ... | 23:47 |
| clarkb | though to be fair the outer one is just for easy writing if you copy pasta iirc | 23:47 |
| *** tjones has quit IRC | 23:48 | |
| *** tongli has quit IRC | 23:50 | |
| nibalizer | this was is openstack-101, but the person left "Hi, trying to sign the ICLA at /settings/new-agreement; blocked, getting “Code Review - Error” Server Error Cannot store contact information [continue]" | 23:50 |
| nibalizer | maybe we broke that with notmorgan's apache changes? | 23:51 |
| clarkb | I can test but more likely its the normal issues | 23:51 |
| nibalizer | ok | 23:51 |
| clarkb | https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/ is what yo ucan point at for that | 23:51 |
| clarkb | nibalizer: you can test too, just go in and update your contact info | 23:51 |
| phschwartz | jeblair: fungi: so I finally got nodepool squared away, I have 2 ready nodes when I do a `nodepool list` but <jenkins url>/computer doesn't show them as slaves | 23:52 |
| nibalizer | ok | 23:52 |
| *** sridhar_ram has quit IRC | 23:53 | |
| phschwartz | or anyone else familar with nodepool/jenkins | 23:53 |
| *** smarcet has quit IRC | 23:54 | |
| clarkb | phschwartz: do you have a jenkins configured? are credentials for it in secure.conf? | 23:54 |
| pabelanger | phschwartz: PB your `nodepool list` output | 23:54 |
| clarkb | nibalizer: I can update my contact info | 23:55 |
| clarkb | so its like they didn't have a foundation account or the emails didn't match or the foundation account type isn't member etc | 23:56 |
| clarkb | that ask answer should walk people though getting it configured right | 23:56 |
| nibalizer | :shrug: | 23:56 |
| phschwartz | pabelanger: http://paste.openstack.org/show/481723/ | 23:56 |
| phschwartz | clarkb: yes, the api key and user are in there | 23:56 |
| nibalizer | clarkb: maybe I am not an individual member of the organization | 23:56 |
| clarkb | phschwartz: and they work? | 23:56 |
| clarkb | nodepool should log if its not able to hit the api | 23:56 |
| notmorgan | nibalizer: hmm? | 23:56 |
| clarkb | nibalizer: you have to be to have a signed cla | 23:56 |
| *** bpokorny has quit IRC | 23:57 | |
| notmorgan | nibalizer: no that is not a change i've seen that issue before the apache config stuff | 23:57 |
| *** bpokorny has joined #openstack-infra | 23:57 | |
| phschwartz | clarkb: they should. I have verified that it is the right id and key. | 23:57 |
| pabelanger | phschwartz: Ya, looks ask expected. I'd check the logs like clarkb said. Nodepool doesn't do a good job confirming the slave actually came online | 23:57 |
| pabelanger | EG: if your global credentials are wrong | 23:57 |
| pabelanger | or it cannot ssh into the node | 23:57 |
| pabelanger | s/node/slave | 23:58 |
| clarkb | pabelanger: well it does for the ssh, by actually sshing into it | 23:58 |
| pabelanger | clarkb: right, but if jenkins is mis-configued nodepool doesn't know | 23:58 |
| clarkb | pabelanger: in that case you should still have a computer listed | 23:58 |
| clarkb | it would just be offline | 23:58 |
| phschwartz | clarkb: : no errors hitting the api in nodepools debug log | 23:59 |
| *** baoli has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
