| *** dkehn__ is now known as dkehn_ | 00:00 | |
| lifeless | unless you physically pulled the switch, how can you be sure? | 00:00 |
|---|---|---|
| lifeless | it might think its still alive | 00:00 |
| lifeless | and be running local cron jobs | 00:00 |
| greghaynes | damn two generals | 00:02 |
| openstackgerrit | A change was merged to openstack/tuskar-ui: Fix node detail link on Overview page https://review.openstack.org/72411 | 00:04 |
| greghaynes | I guess I was proposing only allow graceful failover to slave, where there is communication betwen the two and slave can get confirmation the master is dead. It doesnt give you actual HA but it would let us to updates with a very brief downtime | 00:06 |
| *** dkehn has quit IRC | 00:06 | |
| lifeless | oh, graceful removal of nodes applies for active-active and active-passive | 00:07 |
| *** dkehn has joined #tripleo | 00:07 | |
| greghaynes | ah | 00:07 |
| lifeless | you can downsize anything that way (in principle) | 00:07 |
| lifeless | its only something-died-oops thats unsafe - and why you need STNITH tools | 00:08 |
| lifeless | which you have to be *super* confident in | 00:08 |
| greghaynes | heh, UART? | 00:08 |
| lifeless | github had a brilliant outage a while ago | 00:09 |
| lifeless | when they failed over | 00:09 |
| *** dkehn_ has quit IRC | 00:09 | |
| lifeless | but hadn't shot the node hard enoug | 00:09 |
| lifeless | when it came back up | 00:09 |
| lifeless | EPIC FAIL | 00:09 |
| *** dkehn is now known as dkehn_ | 00:09 | |
| *** dkehn_ has quit IRC | 00:09 | |
| greghaynes | oh, whenever they go down nowdays I start the countdown until they post about data corruption :) | 00:09 |
| *** dkehn has joined #tripleo | 00:10 | |
| *** dkehn_ has joined #tripleo | 00:10 | |
| openstackgerrit | A change was merged to openstack/tuskar-ui: Connect OvercloudRole api calls to Tuskar https://review.openstack.org/72989 | 00:10 |
| bnemec | SpamapS: https://review.openstack.org/#/c/73109/ | 00:10 |
| bnemec | Got baremetal working again for me. | 00:10 |
| lifeless | hahha hyperv-CI | 00:11 |
| lifeless | This change was unable to be automatically merged with the current state of the repository. Please rebase your change and upload a new patchset. | 00:11 |
| bnemec | Yeah, I think there was even a thread about that. :-) | 00:12 |
| lifeless | there was | 00:12 |
| lifeless | still funny | 00:12 |
| *** edmund has quit IRC | 00:13 | |
| bnemec | | 06e79b59-b69c-47d5-be97-efb2252daf08 | undercloud | CREATE_COMPLETE | 2014-02-13T00:07:53Z | | 00:17 |
| bnemec | \o/ | 00:17 |
| bnemec | Okay, going home now. | 00:17 |
| bnemec | And by "going home" I mean I'm walking upstairs and not working anymore. :-) | 00:17 |
| greghaynes | woo new cloud images | 00:23 |
| *** dkehn__ has joined #tripleo | 00:23 | |
| *** dkehn__ has quit IRC | 00:26 | |
| *** dkehn_ has quit IRC | 00:26 | |
| *** dkehn has quit IRC | 00:26 | |
| *** dkehn__ has joined #tripleo | 00:27 | |
| *** dkehn has joined #tripleo | 00:28 | |
| SpamapS | bnemec: thanks for working on that! | 00:41 |
| StevenK | lifeless: Is the wall of text approachable? | 00:47 |
| StevenK | lifeless: Rebasing 71219 against master since it's complaining about an outdated ref anyway | 00:54 |
| lifeless | StevenK: nuts, I got sucked into coding. | 00:55 |
| lifeless | StevenK: greghaynes: thanks for your reminders | 00:55 |
| lifeless | I'm going to wrap this up, get lunch, then I'll do scale-out-duties for you two. | 00:56 |
| greghaynes | No prob | 00:56 |
| SpamapS | bnemec: writing a unit test for the bug you found | 00:58 |
| bnemec | SpamapS: I actually just pushed one. | 00:59 |
| bnemec | It isn't great though. | 00:59 |
| SpamapS | bnemec: ah looking | 00:59 |
| * SpamapS is still refreshing his .tox/py27 | 00:59 | |
| bnemec | It wouldn't have caught this even if it had been there because it's only verifying the expected behavior, and the problem was someone changed the expectations on us. | 01:00 |
| SpamapS | bnemec: uh | 01:00 |
| bnemec | Really what we need is integration testing of the baremetal driver, but obviously that's an Ironic thing. | 01:00 |
| SpamapS | oh I see what you're saying | 01:01 |
| SpamapS | and agree.. :-P | 01:01 |
| SpamapS | bnemec: still this helps | 01:01 |
| SpamapS | bnemec: by the time we have something reliable enough for the gate, we'll be using ironic. :-P | 01:01 |
| bnemec | SpamapS: Yeah, that's why I'm not trying to do a better unit test. ;-) | 01:02 |
| bnemec | Really not that inclined to put a bunch of effort into something that's going away Very Soon Now(tm) | 01:03 |
| SpamapS | yeah I think even requiring this unit test is silly | 01:03 |
| SpamapS | but easier to write it than to argue that | 01:03 |
| bnemec | Well, some change needed to be made anyway. The unit test actually failed in the original patch set. | 01:04 |
| bnemec | In fact, just fixing that would have been sufficient verification of the change, but I didn't realize it was broken until after I added the new assert. :-) | 01:04 |
| bnemec | gate-nova-python27: SUCCESS | 01:05 |
| bnemec | \o/ | 01:05 |
| *** cody-somerville has quit IRC | 01:06 | |
| StevenK | Not shown: gate-nova-python26: queued ? :-) | 01:06 |
| bnemec | Bah, nobody actually uses 2.6 these days, right? | 01:07 |
| bnemec | Besides, I'm sure Tempest will fail on heisenbugs at least two or three times before this merges anyway. :-) | 01:07 |
| clarkb | those weird red hat people do :P | 01:07 |
| StevenK | Launchpad was until like a week ago | 01:07 |
| bnemec | clarkb: :-) | 01:08 |
| *** cd-undercloud has joined #tripleo | 01:09 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 01:09 |
| *** cd-undercloud has quit IRC | 01:09 | |
| * bnemec re-triages the nova bug | 01:09 | |
| bnemec | Okay, really leaving now. Fingers crossed that Jenkins blesses the fix. | 01:11 |
| SpamapS | bnemec: thanks, I'll foster it through the gate if I can on my way back down to LA the next few hours | 01:12 |
| bnemec | SpamapS: Great, thanks! | 01:12 |
| *** dkehn_ has joined #tripleo | 01:17 | |
| *** cody-somerville has joined #tripleo | 01:18 | |
| *** dkehn_ has quit IRC | 01:19 | |
| *** dkehn has quit IRC | 01:19 | |
| *** dkehn_ has joined #tripleo | 01:20 | |
| *** dkehn__ has quit IRC | 01:20 | |
| *** dkehn has joined #tripleo | 01:21 | |
| *** xuhanp has joined #tripleo | 01:39 | |
| lifeless | ok, deleting the right mirror now. wheeee single disk is slower :) | 01:39 |
| lifeless | SpamapS: slagle: ^ is another key-for-CI patch | 01:48 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Fixup missing variables for CI. https://review.openstack.org/73089 | 01:48 |
| *** w_ has joined #tripleo | 01:48 | |
| lifeless | StevenK: ok so here's one thing - see that patch ^ do an audit and make sure that all the uses of NODE_ARCH etc are pulling out of the test environment json definition, not random env variables that might have been set arbitrarily far away. | 01:49 |
| lifeless | StevenK: within incubator | 01:49 |
| *** olaph has quit IRC | 01:50 | |
| lifeless | so we need https://review.openstack.org/#/c/73089/2 https://review.openstack.org/#/c/73078/ and https://review.openstack.org/#/c/73085/ | 01:54 |
| lifeless | we'll probably have a toci one too - we need the new keys (arch, power manager) added to the environment | 01:55 |
| lifeless | thats another thing StevenK or greghaynes could do - but I intend to push on that today, so unless you're doing it 'now' ... :) | 01:55 |
| StevenK | lifeless: Is https://review.openstack.org/#/c/73085/ why the undercloud job never manages to get the undercloud stack up? | 01:59 |
| *** ramishra has joined #tripleo | 01:59 | |
| *** nosnos has joined #tripleo | 02:00 | |
| StevenK | lifeless: Re: Trello, the "Disable file injection in overcloud" is done, due to the patches the two of us landed? | 02:01 |
| *** newell has quit IRC | 02:06 | |
| *** wusWWW has quit IRC | 02:09 | |
| *** sballe_ has joined #tripleo | 02:09 | |
| *** wusWWW has joined #tripleo | 02:10 | |
| *** ramishra_ has joined #tripleo | 02:11 | |
| lifeless | StevenK: we should probably remove our manual setting of that value now the default is sane[r] | 02:12 |
| lifeless | StevenK: sadly more file injection stuff happens anyway :( | 02:12 |
| lifeless | StevenK: so I think not quite done - remove the setting from the template, then done. | 02:12 |
| *** mtaylor has joined #tripleo | 02:13 | |
| *** tzumainn_ has joined #tripleo | 02:13 | |
| lifeless | StevenK: you have a -1 on your landscape patch | 02:13 |
| *** mikal_ has joined #tripleo | 02:14 | |
| *** mikal has quit IRC | 02:14 | |
| *** BLZbubba has quit IRC | 02:14 | |
| *** bnemec_ has joined #tripleo | 02:15 | |
| lifeless | greghaynes: https://etherpad.openstack.org/p/tripleo-incubator-rationalise-ui | 02:15 |
| *** viktors has quit IRC | 02:15 | |
| *** ramishra has quit IRC | 02:15 | |
| *** mordred has quit IRC | 02:15 | |
| *** SpamapS has quit IRC | 02:15 | |
| *** bnemec has quit IRC | 02:15 | |
| *** morazi has quit IRC | 02:15 | |
| *** kevinbenton has quit IRC | 02:15 | |
| *** nosnos_ has joined #tripleo | 02:15 | |
| *** davidlenwell_ has joined #tripleo | 02:15 | |
| *** viktors has joined #tripleo | 02:16 | |
| *** max_lobur has joined #tripleo | 02:16 | |
| StevenK | lifeless: Remove the setting for file injection from our template? | 02:16 |
| *** dkehn__ has joined #tripleo | 02:16 | |
| StevenK | lifeless: I'd be delighted to do so, is that in toci or incubator? | 02:16 |
| *** wusWWW has quit IRC | 02:16 | |
| *** kevinbenton has joined #tripleo | 02:17 | |
| lifeless | StevenK: tie | 02:17 |
| StevenK | Right | 02:17 |
| *** morazi has joined #tripleo | 02:17 | |
| *** michchap_ has joined #tripleo | 02:17 | |
| *** CaptTofu has quit IRC | 02:18 | |
| *** max_lobur_afk has quit IRC | 02:18 | |
| *** dkehn_ has quit IRC | 02:18 | |
| *** tzumainn has quit IRC | 02:19 | |
| *** sballe has quit IRC | 02:19 | |
| *** michchap has quit IRC | 02:19 | |
| *** jeremydei has quit IRC | 02:19 | |
| *** yamahata_ has quit IRC | 02:19 | |
| *** ccrouch1 has joined #tripleo | 02:19 | |
| openstackgerrit | Steve Kowalik proposed a change to openstack/tripleo-image-elements: Remove file injection settings from nova.conf https://review.openstack.org/73129 | 02:20 |
| *** jeremydei has joined #tripleo | 02:20 | |
| *** nosnos has quit IRC | 02:22 | |
| *** ccrouch has quit IRC | 02:22 | |
| *** spzala has quit IRC | 02:22 | |
| *** geerdest has quit IRC | 02:22 | |
| *** davidlenwell has quit IRC | 02:22 | |
| *** bogdando has quit IRC | 02:22 | |
| *** sgrasley has quit IRC | 02:22 | |
| *** tserong has quit IRC | 02:22 | |
| *** uvirtbot has quit IRC | 02:22 | |
| *** cody-somerville has quit IRC | 02:23 | |
| *** BLZbubba has joined #tripleo | 02:23 | |
| *** kevinbenton_ has joined #tripleo | 02:24 | |
| *** SpamapS has joined #tripleo | 02:24 | |
| *** SpamapS has quit IRC | 02:24 | |
| *** SpamapS has joined #tripleo | 02:24 | |
| *** tserong has joined #tripleo | 02:24 | |
| *** tserong has joined #tripleo | 02:24 | |
| *** CaptTofu has joined #tripleo | 02:25 | |
| *** yamahata__ has joined #tripleo | 02:26 | |
| *** BLZbubba has quit IRC | 02:26 | |
| *** cody-somerville has joined #tripleo | 02:27 | |
| *** cody-somerville has quit IRC | 02:27 | |
| *** cody-somerville has joined #tripleo | 02:27 | |
| *** davidlenwell has joined #tripleo | 02:28 | |
| *** max_lobur has quit IRC | 02:28 | |
| *** ramishra_ has quit IRC | 02:29 | |
| *** SpamapS has quit IRC | 02:29 | |
| *** julim has quit IRC | 02:30 | |
| *** SpamapS has joined #tripleo | 02:30 | |
| *** coolsvap has quit IRC | 02:30 | |
| *** max_lobur has joined #tripleo | 02:30 | |
| *** sballe_ has quit IRC | 02:32 | |
| *** cd-undercloud has joined #tripleo | 02:32 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 02:32 |
| *** cd-undercloud has quit IRC | 02:32 | |
| *** julim_ has joined #tripleo | 02:32 | |
| *** julim_ has quit IRC | 02:32 | |
| *** ccrouch1 has quit IRC | 02:32 | |
| *** nosnos has joined #tripleo | 02:32 | |
| *** morazi has quit IRC | 02:33 | |
| *** kevinbenton has quit IRC | 02:33 | |
| *** dkehn__ has quit IRC | 02:33 | |
| *** davidlenwell_ has quit IRC | 02:33 | |
| *** nosnos_ has quit IRC | 02:33 | |
| *** kevinbenton_ is now known as kevinbenton | 02:33 | |
| *** dkehn has quit IRC | 02:35 | |
| *** SpamapS has quit IRC | 02:36 | |
| *** SpamapS has joined #tripleo | 02:36 | |
| *** SpamapS has quit IRC | 02:36 | |
| *** SpamapS has joined #tripleo | 02:36 | |
| *** BLZbubba has joined #tripleo | 02:38 | |
| *** ramishra has joined #tripleo | 02:38 | |
| *** StevenD57 has quit IRC | 02:38 | |
| *** StevenD57 has joined #tripleo | 02:38 | |
| *** sballe has joined #tripleo | 02:38 | |
| *** julim has joined #tripleo | 02:38 | |
| *** weshay has quit IRC | 02:38 | |
| *** weshay has joined #tripleo | 02:40 | |
| *** dkehn_ has joined #tripleo | 02:42 | |
| *** sgrasley has joined #tripleo | 02:43 | |
| *** bnemec has joined #tripleo | 02:43 | |
| *** tzumainn__ has joined #tripleo | 02:43 | |
| *** slagle_ has joined #tripleo | 02:46 | |
| *** BLZbubba_ has joined #tripleo | 02:46 | |
| *** ohadlevy_ has joined #tripleo | 02:46 | |
| *** BLZbubba has quit IRC | 02:47 | |
| *** ramishra_ has joined #tripleo | 02:47 | |
| *** ramishra has quit IRC | 02:48 | |
| *** panda has joined #tripleo | 02:49 | |
| *** mikal has joined #tripleo | 02:49 | |
| *** nosnos has quit IRC | 02:49 | |
| *** kevinbenton has quit IRC | 02:49 | |
| *** viktors has quit IRC | 02:49 | |
| *** bnemec_ has quit IRC | 02:49 | |
| *** mikal_ has quit IRC | 02:49 | |
| *** tzumainn_ has quit IRC | 02:49 | |
| *** xuhanp has quit IRC | 02:50 | |
| *** rwsu has quit IRC | 02:50 | |
| *** peoplemerge has quit IRC | 02:50 | |
| *** lifeless has quit IRC | 02:50 | |
| *** rpodolyaka has quit IRC | 02:50 | |
| *** NearlyFunctional has quit IRC | 02:50 | |
| *** jrist has quit IRC | 02:50 | |
| *** slagle has quit IRC | 02:50 | |
| *** jpeeler has quit IRC | 02:50 | |
| *** panda_ has quit IRC | 02:50 | |
| *** ohadlevy has quit IRC | 02:50 | |
| *** anteaya has quit IRC | 02:50 | |
| *** ohadlevy_ has quit IRC | 02:51 | |
| *** kevinbenton has joined #tripleo | 02:51 | |
| *** ohadlevy has joined #tripleo | 02:52 | |
| *** ohadlevy is now known as Guest60345 | 02:52 | |
| *** morazi has joined #tripleo | 02:53 | |
| *** nosnos has joined #tripleo | 02:56 | |
| *** anteaya has joined #tripleo | 02:56 | |
| *** jrist has joined #tripleo | 02:57 | |
| *** NearlyFunctiona1 has joined #tripleo | 02:57 | |
| *** jpeeler1 has joined #tripleo | 02:57 | |
| *** lifeless has joined #tripleo | 02:58 | |
| *** ChanServ sets mode: +v lifeless | 02:58 | |
| *** rwsu has joined #tripleo | 03:01 | |
| lifeless | and bac | 03:01 |
| lifeless | StevenK: I am updating https://etherpad.openstack.org/p/tripleo-test-cluster | 03:01 |
| lifeless | StevenK: one thing that leapt out - we haven't documented this. At all. | 03:01 |
| StevenK | lifeless: What's Brad got to do with it? :-P | 03:01 |
| lifeless | StevenK: line 28 of that wall of text :) | 03:02 |
| *** whayutin_ has joined #tripleo | 03:02 | |
| *** rpodolyaka has joined #tripleo | 03:03 | |
| openstackgerrit | Yongli He proposed a change to openstack/tuskar: Apply six for metaclass https://review.openstack.org/73138 | 03:03 |
| *** pleia2 has quit IRC | 03:03 | |
| *** pleia2 has joined #tripleo | 03:03 | |
| *** weshay has quit IRC | 03:04 | |
| lifeless | pleia2: oh hay | 03:04 |
| lifeless | pleia2: we should sync at some point | 03:04 |
| StevenK | lifeless: I'm a little disturbed by the "Finally wrap this all up into JSON." portion | 03:05 |
| lifeless | StevenK: not evil enough for you? | 03:06 |
| *** viktors has joined #tripleo | 03:06 | |
| lifeless | oh and yay LP timeouts | 03:06 |
| lifeless | what is wgrant doing | 03:06 |
| StevenK | Ask him? :-P | 03:06 |
| StevenK | lifeless: I'd prefer something actually readable | 03:06 |
| lifeless | he's offline.. | 03:07 |
| lifeless | StevenK: so, give me a little more context | 03:07 |
| StevenK | In terms of that? | 03:07 |
| lifeless | 'Finally wrap this all up into JSON. | 03:08 |
| StevenK | lifeless: The comment itself is fine, it's shelling out in a python one-liner that's >280 chars | 03:09 |
| lifeless | StevenK: oh rught | 03:09 |
| *** yamahata__ has quit IRC | 03:09 | |
| lifeless | StevenK: yes, its a little unideal. | 03:09 |
| lifeless | needs a newer jq to us that though | 03:09 |
| StevenK | lifeless: Perhaps 'section' rather than 'portion' would have gotten that point across | 03:09 |
| *** yamahata__ has joined #tripleo | 03:10 | |
| lifeless | StevenK: no, it was more I didn't know what doc or patch you were referring to | 03:10 |
| lifeless | StevenK: I've written a lot of JSON related bits today | 03:10 |
| *** dkehn_ has quit IRC | 03:21 | |
| *** dkehn has joined #tripleo | 03:22 | |
| *** cwolferh_ has quit IRC | 03:24 | |
| StevenK | lifeless: Okay, audit is done. The only one that looks strange to my eyes is NODE_ARCH. | 03:25 |
| StevenK | lifeless: We set it in _variables, use it all over the place, and then _undercloud pulls it out of the JSON, but after its used once | 03:26 |
| *** CaptTofu has quit IRC | 03:26 | |
| *** spzala has joined #tripleo | 03:29 | |
| *** ccrouch has joined #tripleo | 03:29 | |
| *** bogdando has joined #tripleo | 03:29 | |
| lifeless | StevenK: so, for CI - read line 12-16 of https://etherpad.openstack.org/p/tripleo-test-cluster | 03:29 |
| lifeless | StevenK: we need to use the arch defined in the test environment | 03:29 |
| lifeless | StevenK: because it defines the machines we're running on | 03:29 |
| *** sgrasley has quit IRC | 03:30 | |
| *** sgrasley has joined #tripleo | 03:30 | |
| *** yamahata__ has quit IRC | 03:30 | |
| *** yamahata__ has joined #tripleo | 03:30 | |
| lifeless | StevenK: so I'd probably move the first ref to NODE_ARCH to devtest_testenv, and then pull it out from there wherever we need it (built on top of my patch that adds it to the testenv definition in the first place, of course) | 03:31 |
| *** ramishra_ has quit IRC | 03:32 | |
| *** ramishra has joined #tripleo | 03:33 | |
| StevenK | lifeless: Along with the other NODE_* ? | 03:34 |
| lifeless | StevenK: other NODE_ ? | 03:35 |
| StevenK | NODE_CPU NODE_MEM NODE_DISK | 03:35 |
| *** cwolferh has joined #tripleo | 03:36 | |
| lifeless | CPU MEM DISK yes, they should indeed move into the description of the testenvironment. | 03:36 |
| lifeless | I'd like to get rid of node-macs and instead have 'nodes' | 03:37 |
| lifeless | which would be a list of dicts | 03:37 |
| lifeless | and each dict would describe one machine in the test environment: cpu, arch, memory, disk, [] of macs | 03:37 |
| lifeless | oh and power management details, so | 03:38 |
| StevenK | But NODE_{CPU,MEM,DISK} are defaults we use to create nodes | 03:38 |
| lifeless | {cpu:... , arch: ..., memory: ..., disk: ..., macs: [...], pm_user: ..., pm_addr: ..., pm_password: ...} | 03:38 |
| StevenK | And arch | 03:39 |
| lifeless | StevenK: yes and they are also things we need to know about nodes even if we didn't create the nodes. | 03:39 |
| StevenK | lifeless: So we should have both | 03:39 |
| lifeless | StevenK: there are now two parts to the incubator: test environment setup (devtest_testenv.sh) and everything else. | 03:39 |
| lifeless | for CI, we never run devtest_testenv.sh | 03:40 |
| StevenK | default_cpu / default_mem / default_arch and nodes: [{cpu:, arch: }] | 03:40 |
| lifeless | because nested virt == omg pain. | 03:40 |
| lifeless | StevenK: the te json doesn't need defaults at all | 03:40 |
| lifeless | StevenK: machines might not be heterogeneous | 03:40 |
| lifeless | StevenK: so, we need the defaults in precisely one place: when we create nodes in devtest_testenv.sh - nowhere else. | 03:41 |
| StevenK | lifeless: scripts/devtest_seed.sh:setup-baremetal $NODE_CPU $NODE_MEM $NODE_DISK $NODE_ARCH | 03:42 |
| lifeless | StevenK: so to answer your question, yes, NODE_CPU/MEM/DISK should move. | 03:42 |
| lifeless | StevenK: I would argue that the seed is a known quantity, only ever installs one VM, will never get difference services on it. | 03:42 |
| lifeless | StevenK: We probably need a machine descriptor (same as any other) in the te json | 03:43 |
| lifeless | StevenK: but - oh, I misread what you pased | 03:43 |
| lifeless | StevenK: devtest_seed.sh runs with a TE_DATAFILE defined. | 03:43 |
| lifeless | StevenK: so we put a seed machine descriptor in testenv.json, and its all fine. | 03:43 |
| StevenK | lifeless: You were arguing that we don't need defaults, but that's what NODE_{CPU,MEM,DISK,ARCH} are. | 03:44 |
| lifeless | StevenK: setup-baremetal is /registering/ what exists. | 03:44 |
| lifeless | StevenK: its not defaults there. It must match reality for the machine that will be the undercloud. | 03:44 |
| StevenK | lifeless: Anyway, I'm happy to swing an axe around _variables and shift them all into _testenv. Can't find the patch you're referencing on your dashboard | 03:45 |
| lifeless | StevenK: the only time the defaults matter is when we make a VM. There are two callsites that make VMs. | 03:45 |
| lifeless | Ia373cd2007750a2ce5ad0b1ee18cf3c44591d9dc | 03:45 |
| lifeless | StevenK: ^ patch | 03:45 |
| lifeless | StevenK: NODE_DIST shouldn't move, thats not a machine descriptor | 03:45 |
| StevenK | Oh, right. The one I was already auditing | 03:46 |
| lifeless | arguably it should be renamed to IMAGE_DIST or something less conflated | 03:47 |
| StevenK | lifeless: Yeah, I'd figured that, which is why I didn't mention it | 03:47 |
| lifeless | StevenK: cool | 03:47 |
| greghaynes | lifeless: ty for the rationalise ui etherpad | 03:48 |
| * greghaynes reads | 03:48 | |
| *** cd-undercloud has joined #tripleo | 03:54 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 03:54 |
| *** cd-undercloud has quit IRC | 03:54 | |
| lifeless | StevenK: line 67 of https://etherpad.openstack.org/p/tripleo-test-cluster is coming together | 03:55 |
| StevenK | lifeless: \o/ | 03:56 |
| *** spzala has quit IRC | 03:59 | |
| * StevenK gets tempted to yak shave `` out of devtest | 04:01 | |
| tchaypo | replace with $()? | 04:01 |
| StevenK | Yeah | 04:01 |
| tchaypo | I'm tempted to yak shave ## out of devtest.rst | 04:01 |
| tchaypo | ... perhaps by creating a bash domain for sphinx | 04:04 |
| tchaypo | looking at https://bitbucket.org/birkenfeld/sphinx-contrib/src/d7b8cc81b9098ed214b5d20de25a344a3e87d786/rubydomain/sphinxcontrib/rubydomain.py?at=default it looks no worse than "Very mindbending" | 04:05 |
| * StevenK reaches for the rusty spoon | 04:07 | |
| lifeless | StevenK: its still a little wall of texty but much more prose in there | 04:08 |
| lifeless | StevenK: cheers for your interest in this! | 04:08 |
| *** mikal has quit IRC | 04:26 | |
| *** mikal has joined #tripleo | 04:27 | |
| SpamapS | ahoy there | 04:41 |
| * SpamapS is at the san jose airport and only slightly buzzed enjoying a spicy tuna roll and reading the tripleo-test-cluster etherpad | 04:41 | |
| *** edmund has joined #tripleo | 04:41 | |
| greghaynes | mmm tuna roll | 04:43 |
| SpamapS | SPICY | 04:44 |
| SpamapS | like | 04:44 |
| SpamapS | more spicy than it should be | 04:44 |
| SpamapS | :-P | 04:44 |
| SpamapS | my plane has finally arrived, so I may actually go home now :) | 04:44 |
| clarkb | SpamapS: you were in sunnyvale this week/ | 04:48 |
| SpamapS | clarkb: just for today | 04:48 |
| SpamapS | clarkb: they needed a deep dive into where we need to focus some efforts on Heat and testing. | 04:48 |
| StevenK | SpamapS: Productive? | 04:48 |
| SpamapS | and it seems A 1-30 is boarding so.. off I go | 04:48 |
| SpamapS | StevenK: highly | 04:48 |
| StevenK | SpamapS: \o/ | 04:48 |
| SpamapS | I'd say we can expect more engagement from HP folks soon. :) | 04:49 |
| * SpamapS boards | 04:49 | |
| StevenK | Fantastic! | 04:49 |
| openstackgerrit | Steve Kowalik proposed a change to openstack/tripleo-incubator: Shift NODE_{CPU,DISK,MEM} into the JSON data file https://review.openstack.org/73145 | 04:50 |
| *** tzumainn__ has quit IRC | 04:51 | |
| *** cadenzajon has quit IRC | 05:05 | |
| openstackgerrit | Yongli He proposed a change to openstack/tuskar: Remove extraneous vim configuration comments https://review.openstack.org/73148 | 05:07 |
| *** cd-undercloud has joined #tripleo | 05:17 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 05:17 |
| *** cd-undercloud has quit IRC | 05:17 | |
| *** peoplemerge has joined #tripleo | 05:19 | |
| *** CaptTofu has joined #tripleo | 05:27 | |
| StevenK | lifeless: Haha, and 73145 ended horribly since they're not in the JSON, I'm struggling to find it, but I'm guessing it's in toci's testenv-worker element somewhere | 05:28 |
| *** CaptTofu has quit IRC | 05:31 | |
| *** UtahDave has joined #tripleo | 05:32 | |
| *** john-n-seattle2 has quit IRC | 05:40 | |
| *** dkehn has quit IRC | 05:52 | |
| *** dkehn has joined #tripleo | 05:54 | |
| *** UtahDave has quit IRC | 05:57 | |
| *** rpodolyaka1 has joined #tripleo | 05:59 | |
| *** dkehn_ has joined #tripleo | 06:04 | |
| *** dkehn_ has joined #tripleo | 06:05 | |
| *** edmund has quit IRC | 06:08 | |
| lifeless | 73145 ended ? | 06:20 |
| lifeless | 7 | 06:21 |
| lifeless | StevenK: oh, I see | 06:21 |
| lifeless | StevenK: yes, we need to add the new keys to the deployed testenv before you can get a clean CI run with it | 06:21 |
| *** e0ne has joined #tripleo | 06:22 | |
| *** e0ne has quit IRC | 06:23 | |
| *** w_ is now known as olaph | 06:26 | |
| lifeless | StevenK: arg, stab @ apt-mirror | 06:27 |
| lifeless | md5sum /var/lib/apt/lists/partial/mirror.robertcollins.net_ubuntu_dists_saucy-updates_universe_binary-i386_Packages | 06:27 |
| lifeless | 95f651350b066c32f5d68a79538e6ef3 /var/lib/apt/lists/partial/mirror.robertcollins.net_ubuntu_dists_saucy-updates_universe_binary-i386_Packages | 06:27 |
| lifeless | 4418558c8a025a7f40dfc1b86177d4daf0c24a20c7d99c845a9dee51bd49f4d3 941786 universe/binary-i386/Packages | 06:28 |
| lifeless | StevenK: utter fail : mirrored an inconsistent tree | 06:28 |
| *** john-n-seattle has joined #tripleo | 06:37 | |
| *** cd-undercloud has joined #tripleo | 06:39 | |
| cd-undercloud | ************** overcloud complete status=1 ************ | 06:39 |
| *** cd-undercloud has quit IRC | 06:39 | |
| *** marun has quit IRC | 06:40 | |
| lifeless | and now, can't close the mozilla 'about' window. WAT | 06:40 |
| StevenK | lifeless: Perhaps your upstream mirror is broken? | 06:40 |
| StevenK | I've seen it happen once or twice with mirror.aarnet | 06:41 |
| lifeless | StevenK: archive.u.c | 06:41 |
| lifeless | race conditions. apt disk archive. | 06:41 |
| lifeless | OH HOW I LOVE THEE APT | 06:41 |
| StevenK | WTB lmirror (I think?) | 06:42 |
| *** cd-undercloud has joined #tripleo | 06:43 | |
| cd-undercloud | ************** overcloud complete status=128 ************ | 06:43 |
| *** cd-undercloud has quit IRC | 06:43 | |
| lifeless | StevenK: yeah, or in this case, apt-mirror validating what it copies would do | 06:44 |
| lifeless | it could loop until consistent | 06:44 |
| lifeless | bbiaw | 06:44 |
| *** pblaho has joined #tripleo | 06:50 | |
| *** cd-undercloud has joined #tripleo | 06:53 | |
| cd-undercloud | ************** overcloud complete status=128 ************ | 06:53 |
| *** cd-undercloud has quit IRC | 06:53 | |
| *** akuznetsov has quit IRC | 06:58 | |
| *** akuznetsov has joined #tripleo | 06:59 | |
| *** john-n-seattle has quit IRC | 07:03 | |
| *** akuznetsov has quit IRC | 07:06 | |
| *** akuznetsov has joined #tripleo | 07:10 | |
| *** rdopieralski has joined #tripleo | 07:10 | |
| *** rdopieralski has joined #tripleo | 07:10 | |
| *** ramishra has quit IRC | 07:11 | |
| *** rdopieralski has quit IRC | 07:13 | |
| *** rdopieralski has joined #tripleo | 07:14 | |
| *** dkehn__ has joined #tripleo | 07:19 | |
| *** dkehn__ has quit IRC | 07:21 | |
| *** dkehn__ has joined #tripleo | 07:21 | |
| *** dkehn_ has quit IRC | 07:22 | |
| *** dkehn has quit IRC | 07:22 | |
| *** dkehn has joined #tripleo | 07:24 | |
| *** rsacharya_ has joined #tripleo | 07:25 | |
| *** jtomasek has joined #tripleo | 07:25 | |
| *** cwolferh has quit IRC | 07:27 | |
| *** CaptTofu has joined #tripleo | 07:27 | |
| *** ramishra has joined #tripleo | 07:29 | |
| *** CaptTofu has quit IRC | 07:32 | |
| *** UtahDave has joined #tripleo | 07:38 | |
| *** lazy_prince has joined #tripleo | 07:41 | |
| *** ramishra has quit IRC | 07:41 | |
| GheRivero | morning all | 07:43 |
| *** john-n-seattle has joined #tripleo | 07:44 | |
| *** rpodolyaka1 has quit IRC | 07:45 | |
| *** mrunge has joined #tripleo | 07:46 | |
| openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Add missing semicolons in js https://review.openstack.org/73182 | 07:46 |
| *** e0ne has joined #tripleo | 07:47 | |
| *** ifarkas has joined #tripleo | 07:47 | |
| *** jprovazn has joined #tripleo | 07:47 | |
| *** dtantsur has joined #tripleo | 07:49 | |
| *** dko has joined #tripleo | 07:50 | |
| *** john-n-seattle has quit IRC | 07:57 | |
| *** rlandy has joined #tripleo | 07:58 | |
| *** akuznetsov has quit IRC | 08:12 | |
| *** SpamapS has quit IRC | 08:14 | |
| *** greghaynes has quit IRC | 08:14 | |
| *** SpamapS has joined #tripleo | 08:15 | |
| *** SpamapS has quit IRC | 08:15 | |
| *** SpamapS has joined #tripleo | 08:15 | |
| *** peoplemerge has quit IRC | 08:15 | |
| *** openstackgerrit has quit IRC | 08:16 | |
| *** peoplemerge has joined #tripleo | 08:17 | |
| *** peoplemerge has quit IRC | 08:17 | |
| *** lifeless has quit IRC | 08:17 | |
| *** lifeless has joined #tripleo | 08:19 | |
| *** ChanServ sets mode: +v lifeless | 08:20 | |
| *** ramishra has joined #tripleo | 08:21 | |
| *** jcoufal has joined #tripleo | 08:35 | |
| *** shardy_afk is now known as shardy | 08:35 | |
| *** bogdando has quit IRC | 08:38 | |
| *** bogdando has joined #tripleo | 08:39 | |
| *** gcha has joined #tripleo | 08:48 | |
| *** d0ugal has joined #tripleo | 08:49 | |
| *** d0ugal has joined #tripleo | 08:49 | |
| *** saju_m has joined #tripleo | 08:50 | |
| *** hashar has joined #tripleo | 09:01 | |
| *** derekh has joined #tripleo | 09:09 | |
| *** john-n-seattle has joined #tripleo | 09:12 | |
| *** ramishra_ has joined #tripleo | 09:20 | |
| *** ramishra has quit IRC | 09:20 | |
| *** john-n-seattle has quit IRC | 09:21 | |
| *** markmc has joined #tripleo | 09:26 | |
| *** CaptTofu has joined #tripleo | 09:28 | |
| *** lucasagomes has joined #tripleo | 09:30 | |
| *** john-n-seattle has joined #tripleo | 09:30 | |
| *** CaptTofu has quit IRC | 09:33 | |
| lifeless | derekh: hey | 09:35 |
| lifeless | derekh: so whats needed in tripleo-ci is to fill in the additional keys in the testenv json | 09:35 |
| lifeless | derekh: i was going to get to that, but ETIME | 09:35 |
| lifeless | derekh: arch and power_manager were the only new keys. | 09:36 |
| *** athomas has joined #tripleo | 09:37 | |
| derekh | lifeless: ok, I'm currently setting up a new test env to run the whole lot end to end, will verify whats there and put the additional keys in the json | 09:38 |
| derekh | :-( | 09:40 |
| derekh | | b27e4048-32ed-4213-a276-9cc21b4c303e | testenv-derekh-testenv0-7qmepu3fwzvz | ERROR | None | NOSTATE | | | 09:40 |
| derekh | lifeless: looks like I can't start a instance on the cd-undercloud, going to take over testenv-testenv9 for some tests if thats ok | 09:50 |
| derekh | lifeless: is the cd-undercloud haveing problems? | 09:50 |
| lifeless | uhm , sec | 09:50 |
| derekh | k, brb | 09:51 |
| lifeless | derekh: no its fine | 09:51 |
| lifeless | derekh: but don't take over the prod testenvs | 09:52 |
| lifeless | derekh: just delete some of the findbroken machines | 09:52 |
| lifeless | derekh: we're tracking down glitching hardware | 09:52 |
| derekh | lifeless: ok, will do | 09:52 |
| lifeless | derekh: check out nova list | 09:52 |
| *** Guest60345 is now known as ohadlevy | 09:52 | |
| lifeless | hwtest is mine (has 4 nics, not three?!?!), overcloud-* and ci-overcloud* are obvious | 09:52 |
| lifeless | testenv-* is prod | 09:53 |
| *** bauzas has joined #tripleo | 09:53 | |
| lifeless | the rest you can delete and spin up as whatever you want | 09:53 |
| *** ohadlevy is now known as Guest70966 | 09:53 | |
| derekh | lifeless: ok, so I can zap findbroken-*, will do that | 09:53 |
| lifeless | derekh: I rewrote your incubator patch to be somewhat more comprehensive | 09:53 |
| lifeless | derekh: there were other settings we'd missed etc - you'll want to review -d it :) | 09:54 |
| lifeless | I don't think I redid anything else | 09:54 |
| lifeless | gnight! | 09:54 |
| derekh | lifeless: will do, night | 09:54 |
| *** Guest70966 is now known as ohadlevy_ | 10:04 | |
| *** greghaynes has joined #tripleo | 10:14 | |
| *** akuznetsov has joined #tripleo | 10:14 | |
| *** CaptTofu has joined #tripleo | 10:25 | |
| *** martyntaylor has joined #tripleo | 10:26 | |
| StevenK | derekh: Can you point me at the toci patch you put up, I'll have to add more keys to it due an incubator branch I put up earlier | 10:28 |
| *** killer_prince has quit IRC | 10:30 | |
| derekh | StevenK: is this the one you mean https://review.openstack.org/#/c/73103/ , lifeless has said it wont be needed, running through everything at the moment to figure it all out | 10:30 |
| StevenK | derekh: Right. https://review.openstack.org/#/c/73145/ is what I've put on top of yours, but it failed horribly since the new variables are in $TE_DATAFILE | 10:33 |
| *** e0ne has quit IRC | 10:33 | |
| derekh | StevenK: so you have to wait for those values to get into TE_DATAFILE first ? | 10:39 |
| *** UtahDave has quit IRC | 10:57 | |
| *** hashar is now known as hasharCodingDojo | 11:01 | |
| *** gcha has quit IRC | 11:05 | |
| *** rsacharya_ has quit IRC | 11:06 | |
| *** w_ has joined #tripleo | 11:08 | |
| *** olaph has quit IRC | 11:10 | |
| *** CaptTofu has quit IRC | 11:13 | |
| *** hasharCodingDojo has quit IRC | 11:21 | |
| *** CaptTofu has joined #tripleo | 11:31 | |
| *** pleia2 has quit IRC | 11:31 | |
| *** pleia2 has joined #tripleo | 11:32 | |
| *** dkehn_ has joined #tripleo | 11:32 | |
| *** antonym has quit IRC | 11:32 | |
| *** tteggel has joined #tripleo | 11:33 | |
| *** tteggel_ has joined #tripleo | 11:33 | |
| *** tteggel_ has quit IRC | 11:34 | |
| *** dkehn_ has quit IRC | 11:35 | |
| *** tteggel_ has joined #tripleo | 11:35 | |
| *** dkehn__ has quit IRC | 11:35 | |
| *** dkehn has quit IRC | 11:35 | |
| *** dkehn_ has joined #tripleo | 11:35 | |
| *** dkehn has joined #tripleo | 11:37 | |
| *** tteggel_ has quit IRC | 11:40 | |
| *** tteggel_ has joined #tripleo | 11:41 | |
| *** tteggel_ has quit IRC | 11:41 | |
| *** tteggel_ has joined #tripleo | 11:42 | |
| *** tteggel_ has quit IRC | 11:42 | |
| *** tteggel has quit IRC | 11:42 | |
| *** tteggel has joined #tripleo | 11:42 | |
| *** e0ne has joined #tripleo | 11:44 | |
| *** e0ne has quit IRC | 11:48 | |
| *** e0ne has joined #tripleo | 11:51 | |
| *** vkozhukalov has joined #tripleo | 11:59 | |
| *** jcooley has quit IRC | 12:17 | |
| *** EntropyWorks has quit IRC | 12:18 | |
| *** jcooley has joined #tripleo | 12:20 | |
| *** EntropyWorks has joined #tripleo | 12:22 | |
| *** d0ugal_ has joined #tripleo | 12:22 | |
| *** d0ugal has quit IRC | 12:25 | |
| *** d0ugal_ is now known as d0ugal | 12:27 | |
| *** d0ugal has quit IRC | 12:27 | |
| *** d0ugal has joined #tripleo | 12:28 | |
| *** d0ugal has joined #tripleo | 12:28 | |
| *** hashar has joined #tripleo | 12:28 | |
| *** CaptTofu has quit IRC | 12:39 | |
| *** jprovazn has quit IRC | 12:39 | |
| *** gcha has joined #tripleo | 12:46 | |
| *** chrisf_ has joined #tripleo | 12:47 | |
| *** sballe has quit IRC | 12:50 | |
| *** sballe has joined #tripleo | 12:51 | |
| *** lucasagomes is now known as lucas-hungry | 12:53 | |
| chrisf_ | I'm using slagle / deploy-steps.md and getting create_fail for the overcloud stack, specifically the NovaCompute0 and notCompute0 Heat resources. Any troubleshooting suggestions would be welcome....thanks and goodnight | 12:56 |
| *** jprovazn has joined #tripleo | 13:02 | |
| *** dko has quit IRC | 13:02 | |
| *** jcoufal has quit IRC | 13:04 | |
| *** jcoufal has joined #tripleo | 13:05 | |
| *** dko has joined #tripleo | 13:07 | |
| *** nosnos has quit IRC | 13:10 | |
| *** dprince has joined #tripleo | 13:10 | |
| *** jdob has joined #tripleo | 13:14 | |
| *** lblanchard has joined #tripleo | 13:29 | |
| *** sballe has quit IRC | 13:29 | |
| *** sballe has joined #tripleo | 13:29 | |
| *** antonym has joined #tripleo | 13:32 | |
| Ng | morning | 13:32 |
| *** chrisf_ has quit IRC | 13:36 | |
| *** w_ is now known as olaph | 13:43 | |
| *** edmund has joined #tripleo | 13:47 | |
| *** tzumainn__ has joined #tripleo | 13:47 | |
| *** lucas-hungry is now known as lucasagomes | 13:48 | |
| *** matty_dubs|gone is now known as matty_dubs | 13:58 | |
| SpamapS | Ng: morning? | 14:21 |
| *** spzala has joined #tripleo | 14:21 | |
| SpamapS | bnemec: good job, your baremetal fix landed. :) | 14:22 |
| Ng | SpamapS: wed-fri I'm doing something like US/East hours, so it's work-morning, even though it's local-afternoon ;) | 14:28 |
| *** saju_m has quit IRC | 14:28 | |
| SpamapS | Ng: oh fun | 14:29 |
| Ng | SpamapS: more colleague overlap and cheaper childcare, double win ;) | 14:30 |
| SpamapS | Ng: no with Krellm! | 14:31 |
| SpamapS | now | 14:31 |
| Ng | SpamapS: now with wat?! Did I just fail a pop-culture reference? ;( | 14:32 |
| *** max_lobur is now known as max_lobur_afk | 14:36 | |
| SpamapS | Ng: obscure one | 14:38 |
| *** akuznetsov has quit IRC | 14:38 | |
| SpamapS | Ng: though it is from YOUR culture.. its from one of the monty python audio records | 14:39 |
| Ng | doh | 14:39 |
| *** CaptTofu has joined #tripleo | 14:40 | |
| *** CaptTofu has quit IRC | 14:44 | |
| *** olaph has quit IRC | 14:45 | |
| *** ramishra_ has quit IRC | 14:52 | |
| *** ramishra has joined #tripleo | 14:52 | |
| *** olaph has joined #tripleo | 14:58 | |
| *** akuznetsov has joined #tripleo | 15:04 | |
| shadower | I can't push the new release tag to tuskar-ui's gerrit repo. Could that be because of the move under Horizon? | 15:06 |
| shadower | jcoufal: ^ | 15:06 |
| jcoufal | shadower: quite likely | 15:07 |
| shadower | yeah so I'm guessing the release responsibilities now fall under the people from horizon-ptl group: https://review.openstack.org/#/admin/groups/146,members | 15:08 |
| shadower | mrunge: any chance you could look at that and confirm/deny it? | 15:09 |
| shadower | I'm doing a release for all tripleo projects | 15:09 |
| *** ramishra has quit IRC | 15:11 | |
| shadower | okay, apart from Tuskar UI, all the Triple Os have a new release | 15:12 |
| shadower | get them while they're hot! | 15:13 |
| shadower | ccrouch: ^ includes d-i-b, t-h-t and t-i-e | 15:13 |
| rpodolyaka | :) | 15:13 |
| shadower | rpodolyaka: thanks for your help | 15:13 |
| rpodolyaka | shadower: np | 15:14 |
| *** CaptTofu has joined #tripleo | 15:17 | |
| *** akuznetsov has quit IRC | 15:19 | |
| *** akuznetsov has joined #tripleo | 15:22 | |
| *** ftcjeff has joined #tripleo | 15:25 | |
| mrunge | shadower, I can't confirm nor deny | 15:25 |
| ccrouch | shadower: awesome thanks | 15:30 |
| *** rdopieralski has quit IRC | 15:31 | |
| *** jcoufal has quit IRC | 15:31 | |
| shadower | mrunge: spoke like a true politician :-) | 15:31 |
| mrunge | hrrr, shadower afaik, you need a special right to do releases. lifeless should be able to answer that question | 15:32 |
| mrunge | and you might ask david_lyle in #openstack-horizon | 15:33 |
| mrunge | ah, shadower david is currently not there | 15:33 |
| shadower | mrunge: yeah. I have that for tripleo. But I think with the tuskar-ui -> horizon move, I need the permissions from the horizon team | 15:33 |
| shadower | mrunge: okay, I'll ask david once he comes online | 15:33 |
| *** marun has joined #tripleo | 15:34 | |
| *** ramishra has joined #tripleo | 15:39 | |
| *** tserong has quit IRC | 15:39 | |
| *** hashar has quit IRC | 15:42 | |
| *** vkozhukalov has quit IRC | 15:42 | |
| *** pblaho has quit IRC | 15:43 | |
| *** hashar has joined #tripleo | 15:43 | |
| *** tserong has joined #tripleo | 15:44 | |
| *** openstackgerrit has joined #tripleo | 15:47 | |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Increase RAM allocated to test environments https://review.openstack.org/73334 | 15:47 |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: No longer base64 encode the private ssh key https://review.openstack.org/73335 | 15:47 |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Add power_manager and arch to the test env json https://review.openstack.org/73336 | 15:47 |
| openstackgerrit | A change was merged to openstack/tuskar: Enable gating with flake8 on E121 https://review.openstack.org/73268 | 15:55 |
| *** tzumainn__ is now known as tzumainn | 15:55 | |
| *** lblanchard1 has joined #tripleo | 16:06 | |
| *** lblanchard has quit IRC | 16:06 | |
| *** mtaylor is now known as mordred | 16:07 | |
| *** mordred has quit IRC | 16:07 | |
| *** mordred has joined #tripleo | 16:07 | |
| *** saju_m has joined #tripleo | 16:08 | |
| *** ifarkas has quit IRC | 16:10 | |
| *** jpeeler1 has quit IRC | 16:14 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Install openstack-swift-object https://review.openstack.org/70335 | 16:16 |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Add needed swift storage dirs for packaged install https://review.openstack.org/70381 | 16:17 |
| openstackgerrit | Ladislav Smola proposed a change to openstack/tuskar-ui: Adding real deleting and creating of overcloud https://review.openstack.org/73343 | 16:20 |
| openstackgerrit | Dan Prince proposed a change to openstack/tripleo-incubator: Line break the undercloud heat stack command. https://review.openstack.org/73345 | 16:23 |
| *** smulcahy has joined #tripleo | 16:28 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Remove file injection settings from nova.conf https://review.openstack.org/73129 | 16:36 |
| *** bauzas has quit IRC | 16:37 | |
| *** dko has quit IRC | 16:41 | |
| *** athomas has quit IRC | 16:42 | |
| openstackgerrit | A change was merged to openstack/diskimage-builder: Support adding DHCP interfaces one at a time. https://review.openstack.org/71963 | 16:43 |
| openstackgerrit | A change was merged to openstack/diskimage-builder: Add Fedora DHCP interfaces via udev rules https://review.openstack.org/71964 | 16:44 |
| *** athomas has joined #tripleo | 16:49 | |
| *** jtomasek has quit IRC | 16:54 | |
| *** ramishra has quit IRC | 16:56 | |
| *** vkdrao has joined #tripleo | 16:56 | |
| *** e0ne has quit IRC | 16:58 | |
| *** cwolferh has joined #tripleo | 16:58 | |
| *** matty_dubs is now known as matty_dubs|lunch | 17:01 | |
| openstackgerrit | Dirk Mueller proposed a change to openstack/tuskar-ui: Switch over to oslosphinx https://review.openstack.org/73352 | 17:01 |
| openstackgerrit | Dougal Matthews proposed a change to openstack/tuskar: Use TripleO Heat Merge to manage the stack https://review.openstack.org/52045 | 17:04 |
| openstackgerrit | Dirk Mueller proposed a change to openstack/tripleo-incubator: Switch over to oslosphinx https://review.openstack.org/73353 | 17:04 |
| openstackgerrit | Dougal Matthews proposed a change to openstack/tuskar: Use TripleO Heat Merge to manage the stack https://review.openstack.org/52045 | 17:06 |
| *** markmc has quit IRC | 17:10 | |
| *** rcarrillocruz has joined #tripleo | 17:14 | |
| *** taps has joined #tripleo | 17:15 | |
| *** duker has joined #tripleo | 17:17 | |
| *** ramishra has joined #tripleo | 17:26 | |
| *** gcha has quit IRC | 17:30 | |
| *** martyntaylor has quit IRC | 17:31 | |
| *** ramishra has quit IRC | 17:31 | |
| *** viktors has quit IRC | 17:33 | |
| *** lazy_prince has quit IRC | 17:35 | |
| *** hashar has quit IRC | 17:38 | |
| *** jtomasek has joined #tripleo | 17:41 | |
| *** hashar has joined #tripleo | 17:43 | |
| *** vkozhukalov has joined #tripleo | 17:43 | |
| lifeless | mrunge: shadower: yes. there is an acl; infra don't like mistakes and asked that the set of releasers be kept small | 17:47 |
| SpamapS | Oh I forgot about that | 17:48 |
| lifeless | derekh: morning | 17:51 |
| SpamapS | lifeless: have we ever tried to get a deb/apt mirror shoved into swift? seems like it would be entirely doable. | 17:54 |
| *** hashar has quit IRC | 17:54 | |
| *** matty_dubs|lunch is now known as matty_dubs | 17:55 | |
| derekh | lifeless: good morning, so I got a successfull rin of the undercloud in CI | 17:57 |
| openstackgerrit | Ben Nemec proposed a change to openstack/tuskar-ui: Use git.openstack.org instead of github.com https://review.openstack.org/73371 | 17:57 |
| derekh | lifeless: small fixup to the heat template patch (pix pushed up) and we changes needed to toci, all in gerrit | 17:58 |
| lifeless | derekh: looking | 17:58 |
| derekh | *we -? 3 | 17:58 |
| lifeless | SpamapS: https://review.openstack.org/#/c/73078/ +2 please | 17:59 |
| *** killer_prince has joined #tripleo | 18:01 | |
| *** hashar has joined #tripleo | 18:01 | |
| derekh | lifeless: I had to remove the line that sets the arch on our baremetal flavor but I see bnemec had a fix up in that area , so I'm rerunning it with the new nova hoping its not a problem with the ci | 18:02 |
| derekh | lifeless: I'll check back later and see how it went | 18:02 |
| *** peoplemerge has joined #tripleo | 18:02 | |
| *** jprovazn has quit IRC | 18:04 | |
| lifeless | derekh: which line is that ? | 18:04 |
| *** hashar is now known as hasharMeeting | 18:05 | |
| derekh | lifeless: https://github.com/openstack/tripleo-incubator/blob/master/scripts/setup-baremetal#L42 | 18:05 |
| derekh | lifeless: I was getting | 18:06 |
| derekh | extra_spec requirement 'i386' does not match 'None' _satisfies_extra_specs /opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/scheduler/filters/compute_capabilities_filter.py:63 | 18:06 |
| derekh | in the scheduler so undercloud had no node to run on | 18:06 |
| lifeless | derekh: was the flavor spec set to None, or the nova.conf setting set to None ? | 18:07 |
| derekh | looks like its better now as I'm now getting | 18:07 |
| derekh | the flavor spec was i386 so it must have been a problem with nova | 18:07 |
| SpamapS | lifeless: how urgent is 73078 ? | 18:08 |
| derekh | looks like the new nevo fixed the problem as I'm now getting | 18:08 |
| derekh | lifeless: extra_spec requirement 'i386' does not match 'amd64' _satisfies_extra_specs | 18:08 |
| SpamapS | lifeless: I have an alternative approach that doesn't have us leaving the private SSH key unencrypted in the mysql database. | 18:08 |
| derekh | lifeless: so the arch is being picked up, we just have to set it correctly when defining the flavor | 18:09 |
| lifeless | dprince: https://review.openstack.org/#/c/73089/ | 18:09 |
| SpamapS | lifeless: instead of passing a private key in, we can use cfn-signal's data argument to push the public portion into Heat. | 18:09 |
| lifeless | SpamapS: we're unable to CI anything until derekh and I get this all laid down and deployed. | 18:09 |
| *** e0ne has joined #tripleo | 18:09 | |
| lifeless | SpamapS: so, very. | 18:09 |
| SpamapS | lifeless: I figured as much. I dislike it but will +2. I think we need to treat it as a high importance bug though. | 18:10 |
| SpamapS | These things have a way of getting forgotten. | 18:10 |
| lifeless | SpamapS: I don't understand your proposal | 18:10 |
| SpamapS | Anyway, I just don't want devs to accidentally send a sql dump that gives everyone ssh to their box. :-/ | 18:11 |
| derekh | lifeless: so in short everything in gerrit now worked bar a mismatch in flavor / baremetal node arch | 18:11 |
| derekh | lifeless: once we march the toci change we'll need to build a new testenv | 18:11 |
| lifeless | SpamapS: I think thats fair - thats why I put in prose about it. Note that the current situation is basically the same - share an image, share ssh access | 18:11 |
| SpamapS | lifeless: You're moving the key generation to the host system and passing in the private key. I'm suggesting that, instead, we pass the public portion to Heat using cfn-signal, which you can then, on the host, fetch and apply for virtual power manager. | 18:11 |
| *** e0ne has quit IRC | 18:12 | |
| lifeless | SpamapS: What I'd rather do is bring ci-commands into devtest and then they get limited access at most. | 18:12 |
| derekh | lifeless: and I gotta depart, will probably be back in a few hours | 18:12 |
| lifeless | SpamapS: no, we *had* that, it was terrible. | 18:12 |
| *** e0ne has joined #tripleo | 18:12 | |
| lifeless | SpamapS: we end up with hundreds and hundreds of local public keys | 18:12 |
| SpamapS | lifeless: we should probably be maintaining those. :-P but I see your point entirely. | 18:12 |
| lifeless | SpamapS: and with toci we don't have heat access (remember this has to be setup for the seed) | 18:13 |
| *** derekh has quit IRC | 18:13 | |
| lifeless | SpamapS: so we'd end up with toci makes key -> user, who uses it to ssh in, to then copy the public part back, to put it up somewhere to copy in ... makes no sense. | 18:13 |
| SpamapS | lifeless: you can run 'heat stack-create', but not 'heat metadata-show' ? | 18:14 |
| lifeless | SpamapS: you can't run either on the te host. | 18:14 |
| lifeless | SpamapS: there is an entirely separate machine hosting the seed/bm-N nodes/brbm. | 18:14 |
| SpamapS | no I don't remember this has to be setup for the seed, I don't really understand at all why you can't run things on the seed, but I'm trusting you've thought it through. | 18:14 |
| lifeless | SpamapS: how do we turn the seed on on a remote machine? | 18:15 |
| SpamapS | ssh to it and run virsh | 18:15 |
| lifeless | SpamapS: how do we ssh to it ? | 18:15 |
| SpamapS | with the key we put on it? | 18:15 |
| lifeless | no | 18:15 |
| SpamapS | when we nova booted it? | 18:15 |
| lifeless | it gives us a key | 18:15 |
| SpamapS | Yeah look, I don't want to slow things down. I don't understand, and frankly, I don't think I need to understand. :) | 18:16 |
| lifeless | the key we use to nova boot the machines is for root access | 18:16 |
| lifeless | SpamapS: you probably do need a brain dump | 18:16 |
| SpamapS | I'm not really involved at all in administering it. | 18:16 |
| lifeless | you're a tripleo-cd-admin | 18:16 |
| SpamapS | If you'd like me to, then yeah. But I do have... stuff. | 18:16 |
| lifeless | which means you are on the hook if it breaks and infra need it fixed | 18:16 |
| SpamapS | Yeah but thats for tripleo-cd .. I have no idea what the other thing is. | 18:17 |
| lifeless | this is a baremetal workload deployed on the cd-undercloud | 18:17 |
| pleia2 | lifeless: I have a lunch thing in 1.5 hrs, but pretty much free until then (and all afternoon) if you want to sync up today | 18:17 |
| SpamapS | Like really, it has appeared, I have had zero input.. I don't mind that, but it is not in my headspace at all other than seeing it in nova list. | 18:17 |
| lifeless | SpamapS: right, which is fine as far as it goes, but I think you need some familiarity with it | 18:17 |
| lifeless | SpamapS: so; here's a rapid primery | 18:18 |
| lifeless | we boot N machines | 18:18 |
| lifeless | they locally create Y test environments b subidiving their hardware amongst devtest_testenv.sh setups | 18:18 |
| lifeless | they create a random ssh key and command limit it to running /only/ the commands needed to boot the seed and those used by nova-bm | 18:18 |
| SpamapS | that much I've gathered from reviews | 18:18 |
| *** lucasagomes has quit IRC | 18:19 | |
| lifeless | they populate a json file describing the environment, which includes the hostip, ssh username, ssh private key, environment identifier etc | 18:19 |
| lifeless | mac addresses ... | 18:19 |
| lifeless | we have only the access to the machine that we encode in ci-commands | 18:19 |
| lifeless | anything else will fail | 18:20 |
| lifeless | no other code runs on the host - it doesn't interact with the test run at all other than to host emulated bm machines. | 18:20 |
| lifeless | SpamapS: now, putting the ssh key into heat is a bit of an issue, but its not needed for Ironic | 18:21 |
| lifeless | erm, I might be lying. will come back to that | 18:21 |
| lifeless | for nova-bm the key is a global setting in a conf file, it has to be in the image. | 18:21 |
| lifeless | we can either make a new key over and above the key we used to control the seed | 18:22 |
| lifeless | and add another ssh based RPC to copy that key in and install it(still command limited) | 18:22 |
| lifeless | or we can take the key that lets us run the seed, and use it to run the other vms | 18:22 |
| lifeless | so this is why I'm saying I'd rather ci limit the local key, and not be in the business of continually editing authorization files :) | 18:23 |
| lifeless | hope that clears it up a bit | 18:23 |
| *** hasharMeeting has quit IRC | 18:23 | |
| *** shardy is now known as shardy_afk | 18:26 | |
| *** ramishra has joined #tripleo | 18:27 | |
| SpamapS | lifeless: I think I knew the details, but I did not want to think about the overall system. :) | 18:29 |
| SpamapS | brain is filling up | 18:29 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Fixup missing variables for CI. https://review.openstack.org/73089 | 18:32 |
| lifeless | SpamapS: new version of ^ up, fixes the problem derekh saw with arch being wrong | 18:32 |
| *** ramishra has quit IRC | 18:32 | |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Support TripleO-CI for overcloud builds. https://review.openstack.org/73078 | 18:40 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Allow manual hosts entry exports in overcloud. https://review.openstack.org/71725 | 18:40 |
| lifeless | SpamapS: ok so 71725 has the edit, should be good to land | 18:40 |
| lifeless | SpamapS: it had a +2 from derekh before :) | 18:40 |
| *** wusWWW has joined #tripleo | 18:41 | |
| lifeless | dprince: https://review.openstack.org/#/c/73085/ please | 18:41 |
| lifeless | dprince: I've answered your (reasonable) concern I think | 18:41 |
| *** athomas has quit IRC | 18:42 | |
| lifeless | pleia2: dprince: shall we hangout ? | 18:42 |
| pleia2 | lifeless: wfm | 18:43 |
| *** dtantsur has quit IRC | 18:43 | |
| *** akuznetsov has quit IRC | 18:44 | |
| dprince | lifeless: Looking at the reviews now... re: the hangout: what did you want to talk about? | 18:44 |
| *** cadenzajon has joined #tripleo | 18:44 | |
| lifeless | dprince: syncing on ci progress | 18:45 |
| lifeless | dprince: particularly want to sync with pleia2, if you're not interested in a quick call thats fine | 18:45 |
| *** ccorrigan has quit IRC | 18:45 | |
| dprince | lifeless: you guys go for it. I'd vote to just have a sync up earlier next week if possible. | 18:45 |
| lifeless | dprince: ack | 18:46 |
| dprince | lifeless: whips have been cracked to get our rack up so I hope to have news to report by then | 18:46 |
| lifeless | woo | 18:46 |
| dprince | lifeless: re: 73085 file the bug and my -1 goes away for now. We've got a mounting set of technical debt though for this CI push | 18:48 |
| lifeless | dprince: I know. I will file the bug when I'm off this call - can you +2 now? Promise I won't forget. | 18:48 |
| lifeless | dprince: I can't really put a bug link in the file... | 18:48 |
| dprince | lifeless: I'll file it for you and +1, best I can do | 18:49 |
| lifeless | dprince: thanks! | 18:49 |
| * dprince isn't core on tripleo-image-elements | 18:49 | |
| *** rcarrillocruz1 has joined #tripleo | 18:51 | |
| *** rcarrillocruz has quit IRC | 18:52 | |
| *** marun has quit IRC | 18:52 | |
| openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Increase RAM allocated to test environments https://review.openstack.org/73334 | 18:57 |
| openstackgerrit | Dougal Matthews proposed a change to openstack/tuskar: Use TripleO Heat Merge to manage the stack https://review.openstack.org/52045 | 18:57 |
| lifeless | dprince: https://review.openstack.org/#/c/73336/ and its dependencies are all +2'd by me | 18:59 |
| *** newell has joined #tripleo | 19:03 | |
| dprince | lifeless: why was the base64'ing a problem? | 19:05 |
| openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Lets not recommend stackuser is used on testenv images https://review.openstack.org/71954 | 19:05 |
| lifeless | dprince: would need an executable template rather than a simple {{key}} | 19:06 |
| *** peoplemerge has quit IRC | 19:06 | |
| dprince | lifeless: all of this virtual power management stuff makes me glad I don't use it (for the most part) | 19:07 |
| openstackgerrit | A change was merged to openstack-infra/tripleo-ci: No longer base64 encode the private ssh key https://review.openstack.org/73335 | 19:07 |
| openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Add power_manager and arch to the test env json https://review.openstack.org/73336 | 19:07 |
| dprince | lifeless: anyways, ^^ there you go | 19:08 |
| *** vkdrao has quit IRC | 19:08 | |
| lifeless | dprince: can you review https://review.openstack.org/#/c/73081/1/toci_devtest.sh while yo uare around ? | 19:09 |
| lifeless | then we'll have cleaned tripleo-ci of all non-WIP | 19:09 |
| dprince | lifeless: sure. and I'm not going anywhere today. all snowed in... | 19:09 |
| lifeless | dprince: ugh:) | 19:10 |
| * jdob cannot wait until Sunnyvale... | 19:10 | |
| openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Support overcloud testing https://review.openstack.org/73081 | 19:10 |
| *** peoplemerge has joined #tripleo | 19:11 | |
| openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Add a debian-mirror heat template https://review.openstack.org/68541 | 19:11 |
| lifeless | SpamapS: slagle_: its review tax time - https://review.openstack.org/#/c/71725/ and https://review.openstack.org/#/c/73078/ please | 19:21 |
| lifeless | SpamapS: slagle_: https://review.openstack.org/#/c/73089/ too please | 19:22 |
| lifeless | dprince: https://review.openstack.org/#/c/71706/ I think I answered your -1 | 19:23 |
| lifeless | SpamapS: slagle_: and https://review.openstack.org/#/c/73085/ | 19:23 |
| lifeless | and we should be able to CI test things | 19:23 |
| *** ramishra has joined #tripleo | 19:28 | |
| *** ramishra has quit IRC | 19:33 | |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Line break the undercloud heat stack command. https://review.openstack.org/73345 | 19:37 |
| openstackgerrit | Ivan Kolodyazhny proposed a change to openstack/python-tuskarclient: Using tox instead of tuskar_with_venv.sh script https://review.openstack.org/73383 | 19:38 |
| *** e0ne has quit IRC | 19:39 | |
| *** e0ne has joined #tripleo | 19:40 | |
| lifeless | ugh | 19:41 |
| lifeless | now we need to rebase the CI fix | 19:41 |
| *** e0ne_ has joined #tripleo | 19:42 | |
| openstackgerrit | Chris Jones proposed a change to openstack/diskimage-builder: Teach cache-url to handle file:// URIs. https://review.openstack.org/72964 | 19:44 |
| lifeless | Ng: I gotta ask - why^ ? | 19:44 |
| Ng | lifeless: it came up while helping someone in here, seemed like a fairly reasonable request | 19:45 |
| *** e0ne has quit IRC | 19:45 | |
| lifeless | Ng: just seems odd to have two copies of X locally. | 19:45 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Fixup missing variables for CI. https://review.openstack.org/73089 | 19:45 |
| lifeless | Ng: SpamapS: slagle_: https://review.openstack.org/73089 | 19:46 |
| lifeless | needs review - critical path to fixing CI | 19:46 |
| Ng | lifeless: I think your merge didn't work out, there's a "<<<<<< HEAD" in devtest_undercloud.sh | 19:47 |
| lifeless | frell | 19:48 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Fixup missing variables for CI. https://review.openstack.org/73089 | 19:48 |
| lifeless | Ng: so if you are reviewing, please also prioritise https://review.openstack.org/#/c/73089/ https://review.openstack.org/#/c/71725/ https://review.openstack.org/#/c/73078/ https://review.openstack.org/#/c/73085/ | 19:50 |
| Ng | graaa, sorry, I also think PowerUserName=$(whoami) wanted to keep the ${POWER_USER} value? I think that that's (at least one of) the changes that made you rebase. Sorry, should have spotted that the first time | 19:50 |
| Ng | (by way of redemption, I had already reviewed the other 3 :) | 19:52 |
| lifeless | gnarrr mornings | 19:53 |
| openstackgerrit | Jay Dobies proposed a change to openstack/tuskar: Fix delete cascade for attribute and counts https://review.openstack.org/72464 | 19:54 |
| lifeless | Ng: also "PowerManager=${POWER_MANAGER" is messed up. | 19:54 |
| Ng | we are winning | 19:55 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Fixup missing variables for CI. https://review.openstack.org/73089 | 19:55 |
| *** rcarrillocruz has joined #tripleo | 19:55 | |
| lifeless | now I just need to hunt down the clint | 19:55 |
| SpamapS | eh? | 19:56 |
| Ng | the clint be a wily critter | 19:56 |
| *** bauzas has joined #tripleo | 19:56 | |
| lifeless | SpamapS: hey, we've got a stack of stuff to make CI actually useful | 19:56 |
| *** rcarrillocruz1 has quit IRC | 19:56 | |
| lifeless | SpamapS: I'm hunting second reviewers | 19:56 |
| lifeless | SpamapS: see all the pings to you above :) | 19:57 |
| lifeless | SpamapS: https://review.openstack.org/73089 https://review.openstack.org/#/c/71725/ https://review.openstack.org/#/c/73078/ https://review.openstack.org/#/c/73085/ | 19:57 |
| lifeless | taking C to kindy, brb | 19:57 |
| SpamapS | lifeless: pester much? ;) | 19:58 |
| Ng | StevenK: fyi, you're gonna need to rebase 73145 after all this kerfuffle :) | 20:00 |
| devananda | SpamapS: did you get anywhere with the DBError from yesterday? | 20:01 |
| SpamapS | devananda: it's fixed | 20:01 |
| SpamapS | devananda: nova broke baremetal | 20:01 |
| devananda | \o/ | 20:01 |
| SpamapS | devananda: ENOTESTSINTHEGATE | 20:01 |
| devananda | right | 20:01 |
| SpamapS | Basically some internal virt API changed | 20:01 |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Fixup missing variables for CI. https://review.openstack.org/73089 | 20:01 |
| SpamapS | and nova got missed | 20:01 |
| SpamapS | err | 20:01 |
| devananda | ugh... | 20:01 |
| SpamapS | baremetal got missed | 20:01 |
| devananda | which one? | 20:02 |
| SpamapS | stats | 20:02 |
| devananda | we'll need to update ironic driver too | 20:02 |
| SpamapS | it went from expecting a dict, to expecting a json string | 20:02 |
| SpamapS | which, IMO, means it wasn't coded defensively enough | 20:02 |
| SpamapS | virt drivers cannot be trusted. ;) | 20:02 |
| devananda | definitely not! they're all shady! :) | 20:03 |
| *** e0ne has joined #tripleo | 20:03 | |
| * devananda rebuilds seed | 20:03 | |
| openstackgerrit | Jason E. Rist proposed a change to openstack/tuskar-ui: Missing Apache header on example caused Horizon flake8 failure. https://review.openstack.org/73390 | 20:05 |
| *** e0ne_ has quit IRC | 20:06 | |
| *** boris-42_ has quit IRC | 20:07 | |
| *** taps has quit IRC | 20:08 | |
| openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-heat-templates: Support TripleO-CI for overcloud builds. https://review.openstack.org/73078 | 20:09 |
| *** rcarrillocruz1 has joined #tripleo | 20:10 | |
| *** peoplemerge has quit IRC | 20:11 | |
| *** rcarrillocruz has quit IRC | 20:12 | |
| *** CaptTofu has quit IRC | 20:14 | |
| openstackgerrit | Tzu-Mainn Chen proposed a change to openstack/tuskar-ui: Add base overcloud role edit form https://review.openstack.org/73391 | 20:14 |
| *** rpodolyaka1 has joined #tripleo | 20:16 | |
| devananda | hm, anyone doing GSoC mentoring from tripleo team? | 20:18 |
| *** saju_m has quit IRC | 20:19 | |
| *** peoplemerge has joined #tripleo | 20:21 | |
| *** ftcjeff has quit IRC | 20:23 | |
| *** ftcjeff has joined #tripleo | 20:23 | |
| *** jrist is now known as jrist-afk | 20:24 | |
| *** jrist-afk is now known as jrist | 20:24 | |
| *** taps has joined #tripleo | 20:25 | |
| *** cadenzajon has quit IRC | 20:26 | |
| *** ramishra has joined #tripleo | 20:29 | |
| *** boris-42_ has joined #tripleo | 20:34 | |
| *** ramishra has quit IRC | 20:34 | |
| *** epim has joined #tripleo | 20:36 | |
| openstackgerrit | Dougal Matthews proposed a change to openstack/tuskar: Use TripleO Heat Merge to manage the stack https://review.openstack.org/52045 | 20:36 |
| lifeless | back | 20:38 |
| lifeless | devananda: not that I know of | 20:38 |
| lifeless | SpamapS: yes | 20:38 |
| lifeless | SpamapS: DB layer API | 20:39 |
| lifeless | SpamapS: reason I"m pestering is that I want to be able to give early warning of breakage like yesterday, which needs CI up | 20:39 |
| openstackgerrit | Dougal Matthews proposed a change to openstack/tuskar: Enable gating on E122 https://review.openstack.org/73400 | 20:43 |
| SpamapS | lifeless: I for one welcome our new pestering overlords. | 20:43 |
| * SpamapS goes take a walk/get coffee | 20:43 | |
| *** morazi has quit IRC | 20:47 | |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Look for local.json in preference to config.json. https://review.openstack.org/73401 | 20:47 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Inject rather than read-out the virt power key. https://review.openstack.org/73085 | 20:47 |
| lifeless | dprince: SpamapS: ^ when you've had the coffee https://review.openstack.org/73085 is still in the critical set | 20:47 |
| *** CaptTofu has joined #tripleo | 20:48 | |
| dprince | lifeless: +1 from me, I filed the bug... | 20:48 |
| lifeless | dprince: oh, whats the # ? | 20:48 |
| dprince | https://bugs.launchpad.net/tripleo/+bug/1279927 | 20:49 |
| lifeless | dprince: thats the other bug | 20:50 |
| lifeless | :) | 20:50 |
| lifeless | dprince: but thanks! | 20:50 |
| *** rlandy has quit IRC | 21:06 | |
| openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Allow manual hosts entry exports in overcloud. https://review.openstack.org/71725 | 21:07 |
| openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Support TripleO-CI for overcloud builds. https://review.openstack.org/73078 | 21:07 |
| bnemec | lol, apparently the Gerrit parser hates that bug. | 21:08 |
| lifeless | dprince: so https://review.openstack.org/#/c/71706/ | 21:08 |
| *** rcarrillocruz has joined #tripleo | 21:14 | |
| *** rcarrillocruz1 has quit IRC | 21:16 | |
| openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Add fedora-rdo-icehouse element https://review.openstack.org/73411 | 21:17 |
| openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Fix neutron package install https://review.openstack.org/71606 | 21:17 |
| openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Correct owner for glance api log file https://review.openstack.org/71607 | 21:17 |
| openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Ability to add *-create-dir service separately https://review.openstack.org/70399 | 21:17 |
| openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Add create-dir service for neutron https://review.openstack.org/70793 | 21:17 |
| openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Add create-dir service for nova https://review.openstack.org/70794 | 21:17 |
| openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Fix glance package install config https://review.openstack.org/71608 | 21:17 |
| lifeless | MERGEBOMB | 21:17 |
| lifeless | To the tune of Tom Jones | 21:17 |
| slagle_ | that's how i roll | 21:17 |
| *** slagle_ is now known as slagle | 21:17 | |
| lifeless | slagle: can I beg a review? | 21:19 |
| lifeless | https://review.openstack.org/73085 | 21:19 |
| slagle | looking | 21:19 |
| openstackgerrit | Dougal Matthews proposed a change to openstack/tuskar: Use TripleO Heat Merge to manage the stack https://review.openstack.org/52045 | 21:23 |
| *** derekh has joined #tripleo | 21:23 | |
| openstackgerrit | Derek Higgins proposed a change to openstack/tripleo-heat-templates: Fix typo in undercloud-vm-source.yaml https://review.openstack.org/73415 | 21:23 |
| *** marun has joined #tripleo | 21:24 | |
| derekh | SpamapS: lifeless: ^^ I had fixed that in patchset 2 but looks like it got stomped on in the rebases | 21:24 |
| *** CaptTofu has quit IRC | 21:25 | |
| *** cadenzajon has joined #tripleo | 21:26 | |
| *** jtomasek has quit IRC | 21:27 | |
| lifeless | derekh: nuts, looking | 21:27 |
| lifeless | slagle: and https://review.openstack.org/#/c/73415/ | 21:27 |
| lifeless | derekh: yeah, I lost it here https://review.openstack.org/#/c/73078/2..3/undercloud-vm-source.yaml | 21:28 |
| derekh | lifeless: Yup, suppose its one of the risks of editing other peoples reviews | 21:29 |
| *** ramishra has joined #tripleo | 21:30 | |
| lifeless | derekh: yah, still, relatively rate to mess it up | 21:30 |
| bnemec | It's a danger even if you just depend on someone else's review. | 21:30 |
| bnemec | Not that I would know anything about that... | 21:30 |
| * derekh nodes | 21:31 | |
| *** cody-somerville has quit IRC | 21:31 | |
| derekh | errr : nods | 21:32 |
| *** cody-somerville has joined #tripleo | 21:33 | |
| *** cody-somerville has joined #tripleo | 21:33 | |
| *** rpodolyaka1 has quit IRC | 21:34 | |
| *** ramishra has quit IRC | 21:35 | |
| * SpamapS nodes too | 21:35 | |
| lifeless | derekh: heh, thought you meant you were redeploying testenv | 21:37 |
| lifeless | derekh: I'll get on that in a few minutes | 21:37 |
| derekh | lifeless: nope, I was waiting for everything to merge but we should be good to go now, I just popped in and gotta go again, back soon to give a hand if you need it. | 21:39 |
| *** derekh is now known as derekh_afk | 21:39 | |
| *** vkozhukalov has quit IRC | 21:41 | |
| lifeless | derekh_afk: cool | 21:41 |
| lifeless | derekh_afk: yeah we still need tie and that heat fix | 21:41 |
| openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Fix typo in undercloud-vm-source.yaml https://review.openstack.org/73415 | 21:41 |
| lifeless | btw everyone | 21:41 |
| lifeless | zuul is not merging things +A'd before checks complete. | 21:42 |
| lifeless | infra are on it but to fix just remove then add the +A | 21:42 |
| lifeless | or if you didn't give it, just add one. | 21:42 |
| *** peoplemerge has quit IRC | 21:45 | |
| *** CaptTofu has joined #tripleo | 21:55 | |
| SpamapS | lifeless: ahhhh I was wondering :-P | 21:57 |
| *** jdob has quit IRC | 22:05 | |
| *** mrunge has quit IRC | 22:05 | |
| lifeless | Ng: are you still hunting down failed machines ? | 22:11 |
| lifeless | Ng: trello reckons you are; SpamapS made a firedrill card | 22:11 |
| Ng | lifeless: I haven't been this week, I've been super sidetracked with HP corp stuff, but I am intending to get back onto it | 22:11 |
| lifeless | Ng: mgr bit stuff ? | 22:12 |
| Ng | lifeless: yep | 22:12 |
| lifeless | Ng: sucker :) | 22:12 |
| Ng | best news of all, all the systems I'm learning about atm are being replaced in a month ;) | 22:12 |
| lifeless | ok yay so I now *have* a working local ubuntu mirrior | 22:12 |
| lifeless | I guess next I need to setup a fedora mirror | 22:13 |
| lifeless | also I need to publically export my ubuntu mirror. sigh. Things. | 22:13 |
| lifeless | Ng: so, on machines, we're getting to critically low as we scale up CI | 22:14 |
| lifeless | SpamapS: I can delete your test-clint nodes right ? | 22:14 |
| Ng | lifeless: okidoke | 22:14 |
| lifeless | Ng: we're down to 29 thought working | 22:15 |
| *** matty_dubs is now known as matty_dubs|gone | 22:15 | |
| lifeless | Ng: from nearly 50 | 22:15 |
| Ng | ouch, I hadn't clocked it was that low. I shall get some jiras filed tomorrow | 22:16 |
| lifeless | Ng: nova hypervisor-stats | 22:16 |
| lifeless | | count | 29 | | 22:16 |
| lifeless | baremetal-node-list has 40 registered | 22:17 |
| SpamapS | lifeless: yes those are me hanging on to errors/nodes for finding bad machines | 22:17 |
| SpamapS | lifeless: I have 12 suspect machines | 22:18 |
| lifeless | and there are 48 in machine-information-tab.txt, of which 3 are mgmt overhead | 22:18 |
| lifeless | A the bastion, b) the seed, c) the undercloud host. | 22:18 |
| lifeless | so we should have 45 registered with nova, with many marked bad | 22:18 |
| lifeless | this needs some dedicated legwork fixing up, and currently only HP cd-admins can do it | 22:18 |
| lifeless | SpamapS: so I'd like to purge them, deploy all capacity, see what works, pick 10 nodes for testenv redeploy, then do that, then hand back to you. | 22:19 |
| lifeless | SpamapS: ok ? | 22:19 |
| lifeless | Ng: simple cross ref of IPMI IP addr should identify unregistered ones | 22:20 |
| * lifeless cross references while waiting for SpamapS to answer | 22:23 | |
| *** e0ne has quit IRC | 22:23 | |
| *** e0ne has joined #tripleo | 22:23 | |
| lifeless | Ng: SpamapS: https://review.openstack.org/#/c/73085/ is still waiting a +2 (urgent) | 22:23 |
| SpamapS | lifeless: I already marked 12 bad ones. If you just delete all the findbroken and my machines you'll have lots of capacity and it should be reliable capacity. | 22:24 |
| SpamapS | or at least, more reliable | 22:24 |
| lifeless | SpamapS: nova list | grep ERROR | 22:25 |
| lifeless | SpamapS: plus there were two failed from the testenv deploy | 22:26 |
| *** sballe has quit IRC | 22:26 | |
| lifeless | SpamapS: is clint6 bad ? | 22:26 |
| SpamapS | lifeless: ERROR == bad. ACTIVE == good. | 22:26 |
| *** sballe has joined #tripleo | 22:26 | |
| SpamapS | lifeless: if it went ACTIVE, and I couldn't ssh in, I tested it a few more times and then marked it bad (that only happened once) | 22:27 |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Inject rather than read-out the virt power key. https://review.openstack.org/73085 | 22:27 |
| lifeless | SpamapS: clint6 is ERROR | 22:27 |
| *** e0ne has quit IRC | 22:28 | |
| *** marun has quit IRC | 22:29 | |
| lifeless | Ng: have either you unregistered bad ndoes? | 22:29 |
| lifeless | SpamapS: ^ | 22:29 |
| lifeless | vs giving them a different service host | 22:30 |
| SpamapS | lifeless: If I unregistered them, I noted that in the tab.txt | 22:30 |
| *** ramishra has joined #tripleo | 22:30 | |
| SpamapS | lifeless: but the most recent ones I gave a different service host | 22:31 |
| Ng | lifeless: I have not | 22:31 |
| lifeless | ok | 22:31 |
| lifeless | so I think we should have all but the three bootstrap ones registered | 22:32 |
| lifeless | any disagreement ? | 22:32 |
| SpamapS | lifeless: suspected-bad are the ones that failed once but may still have been because of the dhcp agent bugs | 22:32 |
| lifeless | I've identified 7 unregistered | 22:33 |
| lifeless | I must be missing one. | 22:33 |
| lifeless | nuts | 22:33 |
| SpamapS | lifeless: and agreed, registering them all helps us know wtf | 22:33 |
| lifeless | ahha found the missing nodes | 22:35 |
| lifeless | we have an HP dhcp/whatnot server | 22:35 |
| lifeless | that we've never touched | 22:35 |
| lifeless | or needed | 22:35 |
| lifeless | time to nuke IMO | 22:35 |
| *** ramishra has quit IRC | 22:35 | |
| *** ccrouch has quit IRC | 22:36 | |
| *** lblanchard1 has quit IRC | 22:36 | |
| lifeless | I'll register these new ones as 'newly-registered' because they might be in crap condition | 22:37 |
| lifeless | ones with jira tickets | 22:40 |
| lifeless | I'll name the service host the jira ticket | 22:40 |
| lifeless | 48-3+4=49.. | 22:47 |
| lifeless | ok, all non bootstrap machines are now registered | 22:47 |
| lifeless | but none of the 5 I registered are in the pool yet. they need validation / fixing | 22:47 |
| lifeless | lock on -tab released | 22:48 |
| lifeless | so SpamapS I'm confused - is test-clint6 good-but-failed, or bad ? Its still an instance | 22:48 |
| *** ccrouch has joined #tripleo | 22:49 | |
| openstackgerrit | Jason E. Rist proposed a change to openstack/tuskar-ui: Missing Apache header on example caused Horizon flake8 failure. https://review.openstack.org/73439 | 22:50 |
| openstackgerrit | A change was merged to openstack/os-apply-config: Fix misspellings in os-apply-config https://review.openstack.org/71786 | 22:51 |
| *** peoplemerge has joined #tripleo | 22:52 | |
| *** e0ne has joined #tripleo | 22:54 | |
| *** e0ne has quit IRC | 22:55 | |
| *** e0ne has joined #tripleo | 22:56 | |
| SpamapS | lifeless: delete it | 22:58 |
| lifeless | SpamapS: I will, but I still want to understand :) | 22:58 |
| lifeless | SpamapS: what does it represent, sitting there with state ERROR | 22:58 |
| SpamapS | lifeless: 3 fails in a row.. nothing more | 22:59 |
| lifeless | SpamapS: same node ? | 22:59 |
| SpamapS | lifeless: it is no longer helping me learn | 22:59 |
| SpamapS | lifeless: yes same node | 22:59 |
| lifeless | SpamapS: ok, I'll leave it so I don't land on a bad ndoe | 22:59 |
| SpamapS | it won't help with that | 22:59 |
| SpamapS | I think? | 23:00 |
| lifeless | its using a node atm | 23:00 |
| lifeless | it failed to deploy | 23:00 |
| lifeless | if its a bad node, I don't want it. If its something else, then I don't try to use a good node, but thats a better failure to have :) | 23:00 |
| *** e0ne has quit IRC | 23:01 | |
| lifeless | ah bind mounts | 23:08 |
| lifeless | I hate thee ;) | 23:08 |
| *** e0ne has joined #tripleo | 23:12 | |
| *** e0ne has quit IRC | 23:14 | |
| *** e0ne has joined #tripleo | 23:14 | |
| *** e0ne has quit IRC | 23:15 | |
| *** e0ne has joined #tripleo | 23:16 | |
| *** e0ne has quit IRC | 23:21 | |
| openstackgerrit | Jason E. Rist proposed a change to openstack/tuskar-ui: Missing Apache header on example caused Horizon flake8 failure https://review.openstack.org/73439 | 23:22 |
| *** bauzas has quit IRC | 23:28 | |
| *** ramishra has joined #tripleo | 23:31 | |
| openstackgerrit | Richard Su proposed a change to openstack/tripleo-incubator: Messaging backend selection https://review.openstack.org/72524 | 23:33 |
| *** ramishra has quit IRC | 23:36 | |
| lifeless | wendar: around ? | 23:44 |
| *** ftcjeff has quit IRC | 23:45 | |
| *** spzala has quit IRC | 23:49 | |
| *** derekh_afk is now known as derekh | 23:56 | |
| *** chrisfoster has joined #tripleo | 23:57 | |
| SpamapS | alright.. -> kids | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!