| *** smatzek has joined #openstack-powervm | 00:10 | |
| *** smatzek has quit IRC | 00:25 | |
| *** thorst has joined #openstack-powervm | 00:42 | |
| *** mdrabe has quit IRC | 00:53 | |
| *** thorst has quit IRC | 01:21 | |
| *** thorst has joined #openstack-powervm | 01:22 | |
| *** thorst has quit IRC | 01:31 | |
| *** thorst has joined #openstack-powervm | 01:36 | |
| *** thorst has quit IRC | 01:37 | |
| *** thorst has joined #openstack-powervm | 02:07 | |
| *** thorst has quit IRC | 02:16 | |
| *** thorst has joined #openstack-powervm | 03:14 | |
| *** thorst has quit IRC | 03:21 | |
| *** thorst has joined #openstack-powervm | 04:21 | |
| *** thorst has quit IRC | 04:26 | |
| *** thorst has joined #openstack-powervm | 05:23 | |
| *** thorst has quit IRC | 05:32 | |
| *** k0da has joined #openstack-powervm | 05:47 | |
| *** k0da has quit IRC | 05:57 | |
| *** thorst has joined #openstack-powervm | 06:30 | |
| *** thorst has quit IRC | 06:37 | |
| *** thorst has joined #openstack-powervm | 07:35 | |
| *** thorst has quit IRC | 07:41 | |
| *** k0da has joined #openstack-powervm | 08:05 | |
| *** thorst has joined #openstack-powervm | 09:44 | |
| *** thorst has quit IRC | 09:51 | |
| *** viclarson has joined #openstack-powervm | 10:09 | |
| *** smatzek has joined #openstack-powervm | 10:35 | |
| *** thorst has joined #openstack-powervm | 10:49 | |
| *** thorst has quit IRC | 10:56 | |
| *** thorst has joined #openstack-powervm | 11:53 | |
| openstackgerrit | Shyama proposed openstack/nova-powervm: WIP: SSP Volume Adapter https://review.openstack.org/372254 | 12:05 |
|---|---|---|
| *** shyama has joined #openstack-powervm | 12:12 | |
| thorst | shyama: so chmod666org did a reset-state of the error'd VMs and it looks like that did put them back to active | 12:13 |
| thorst | but he'll be sending us the logs to inspect | 12:13 |
| thorst | just a FYI | 12:13 |
| shyama | sure. that would help | 12:13 |
| shyama | chmod666org: can you please let me know if the uuid of the instance changed after live-migration | 12:16 |
| *** edmondsw has joined #openstack-powervm | 12:30 | |
| *** burgerk has joined #openstack-powervm | 12:33 | |
| *** tblakes has joined #openstack-powervm | 12:51 | |
| *** mdrabe has joined #openstack-powervm | 13:10 | |
| *** efried has joined #openstack-powervm | 13:31 | |
| *** shyama has quit IRC | 13:31 | |
| *** shyama has joined #openstack-powervm | 13:32 | |
| *** esberglu has joined #openstack-powervm | 13:33 | |
| *** smatzek has quit IRC | 13:34 | |
| *** tblakes has quit IRC | 13:34 | |
| *** tjakobs has joined #openstack-powervm | 13:38 | |
| *** tjakobs has quit IRC | 13:49 | |
| thorst | esberglu: I was thinking about the multiple network issue with the CI | 13:55 |
| *** kriskend has joined #openstack-powervm | 13:55 | |
| thorst | try making one of the networks 'external' | 13:55 |
| thorst | the 'public' network | 13:55 |
| thorst | I bet that is it. | 13:55 |
| *** seroyer has joined #openstack-powervm | 13:55 | |
| thorst | and by bet, I mean I'm 30% confident | 13:55 |
| esberglu | thorst: Haha better than where I’m at! What makes you say that? | 13:57 |
| *** smatzek has joined #openstack-powervm | 13:57 | |
| *** efried has quit IRC | 13:57 | |
| kriskend | thorst: I don't know what you are asking me to look for when you say anything that let the thread join finish | 13:57 |
| *** tblakes has joined #openstack-powervm | 13:58 | |
| thorst | esberglu: I was working on the blueprint for PowerVM and Nova...and it popped into my head | 13:59 |
| thorst | kriskend: so the glance image corruption thing... | 13:59 |
| thorst | https://github.com/powervm/pypowervm/blob/master/pypowervm/tasks/storage.py#L316-L328 | 14:00 |
| thorst | I forgot to add a log 'Completed' comment in there basically | 14:00 |
| thorst | we need to see it coming back when we see that 'corruption' issue | 14:00 |
| thorst | (which...weird glance...weird) | 14:00 |
| thorst | but if we see it completes, we're pretty sure it's giving back the lock | 14:01 |
| thorst | if it corrupts but never completes...then ugh | 14:01 |
| *** kylek3h has quit IRC | 14:09 | |
| *** burgerk has quit IRC | 14:23 | |
| *** tjakobs has joined #openstack-powervm | 14:26 | |
| *** kylek3h has joined #openstack-powervm | 14:29 | |
| *** shyama has quit IRC | 14:44 | |
| *** burgerk has joined #openstack-powervm | 14:48 | |
| seroyer | thorst, I suspect it isn’t a problem with the lock not getting released. If we see one stream get corruption, then that should only block one of the streams and we support 3. So we’d only see things hang if we hit that corruption on 3 streams. I’m pretty sure we see hangs after a single stream sees corruption. | 14:53 |
| thorst | huh. | 14:53 |
| thorst | can you update the glance on the controller, the nova on the controller (maybe..) and the glance on the compute? | 14:53 |
| seroyer | That was on my list of things to do before Edge but haven’t gotten to it yet. | 14:53 |
| thorst | I wonder if its just glance won't let us open a new stream | 14:54 |
| seroyer | kriskend, you want to do that or you want me to take over? | 14:57 |
| kriskend | seroyer You can work on it if you want.. I have to go to an appointment in a bit | 14:58 |
| * thorst dropped out of that meeting... | 14:59 | |
| seroyer | thorst, So think I should just reclone everything or just glance/nova? | 15:01 |
| thorst | seroyer: how old is everything else/ | 15:02 |
| *** k0da has quit IRC | 15:03 | |
| kriskend | I would say we should go ahead and update everything.... | 15:03 |
| seroyer | thorst, weeks. maybe a month. | 15:04 |
| thorst | so are you doing an ansible re-deploy? | 15:05 |
| thorst | or were you just planning to clone and go? | 15:05 |
| thorst | cloning and going is probably a bad idea - as you could miss DB updates that may have come in | 15:05 |
| thorst | I'd try to just update glance, if that doesn't work...then OSA redeploy | 15:06 |
| seroyer | This is devstack. | 15:06 |
| thorst | ahh, maybe easier | 15:06 |
| thorst | you can just update and restack | 15:06 |
| seroyer | We got exactly zero training from adreznec on doing anything with OSA before he left. | 15:06 |
| thorst | hope devstack cooperates | 15:06 |
| thorst | heh, I have some. Qing Wu is also available to help at times | 15:06 |
| seroyer | Well maybe you can help kriskend try to rebuild that OSA so we can try some testing.... | 15:07 |
| kriskend | Yeah... we really need to be able to do some stuff on the OSA environment... Do you have any time this afternoon to help me? | 15:09 |
| kriskend | the only system that hits the glance corruption issue for us is a tuleta | 15:10 |
| thorst | kriskend: tomorrow looks better... | 15:10 |
| kriskend | ok | 15:10 |
| seroyer | kriskend, since I’m going to restack the controller, that will impact one of your test systems. Is that ok? | 15:10 |
| kriskend | that is the one that is completely hosed anyways | 15:11 |
| kriskend | hence why I said just update everything... good time for it | 15:11 |
| kriskend | i am flashing it now... | 15:11 |
| seroyer | Will do. | 15:11 |
| thorst | kriskend: can we throw something on the calendar so someone doesn't steal time? | 15:11 |
| kriskend | works for me.. my day is pretty much completely open, so whenever works for you | 15:12 |
| kriskend | seroyer probably wants to learn it too :-) | 15:12 |
| seroyer | Probably should. :) | 15:12 |
| *** mdrabe has quit IRC | 15:14 | |
| *** openstackgerrit has quit IRC | 15:18 | |
| *** openstackgerrit has joined #openstack-powervm | 15:19 | |
| *** mdrabe has joined #openstack-powervm | 15:20 | |
| esberglu | thorst: Only a few runs have finished since switching the network to external, but looking good so far! | 15:31 |
| thorst | weird | 15:40 |
| thorst | esberglu: but cool | 15:40 |
| *** kriskend has quit IRC | 15:40 | |
| *** kriskend has joined #openstack-powervm | 15:41 | |
| *** kriskend has quit IRC | 15:43 | |
| *** kriskend has joined #openstack-powervm | 15:43 | |
| *** mdrabe has quit IRC | 15:50 | |
| *** viclarson has quit IRC | 15:50 | |
| *** mdrabe has joined #openstack-powervm | 15:50 | |
| openstackgerrit | Ravi Kumar Kota proposed openstack/networking-powervm: Translation files for supported languages https://review.openstack.org/377818 | 15:58 |
| seroyer | kriskend, controller is restacked. FYI | 16:09 |
| *** seroyer has quit IRC | 16:09 | |
| *** kylek3h_ has joined #openstack-powervm | 16:34 | |
| *** burgerk_ has joined #openstack-powervm | 16:34 | |
| *** tsjakobs has joined #openstack-powervm | 16:35 | |
| *** kriskend_ has joined #openstack-powervm | 16:36 | |
| *** tblakes_ has joined #openstack-powervm | 16:36 | |
| *** tblakes has quit IRC | 16:36 | |
| *** thorst has quit IRC | 16:37 | |
| *** kylek3h has quit IRC | 16:37 | |
| *** kriskend has quit IRC | 16:37 | |
| *** tjakobs has quit IRC | 16:37 | |
| *** tblakes_ is now known as tblakes | 16:37 | |
| *** burgerk has quit IRC | 16:38 | |
| *** smatzek_ has joined #openstack-powervm | 16:38 | |
| *** smatzek_ has quit IRC | 16:38 | |
| *** smatzek_ has joined #openstack-powervm | 16:38 | |
| *** smatzek has quit IRC | 16:38 | |
| *** dwayne has quit IRC | 16:38 | |
| *** smatzek__ has joined #openstack-powervm | 16:44 | |
| *** kriskend__ has joined #openstack-powervm | 16:45 | |
| *** tblakes_ has joined #openstack-powervm | 16:46 | |
| *** kriskend_ has quit IRC | 16:47 | |
| *** tblakes has quit IRC | 16:47 | |
| *** tblakes_ is now known as tblakes | 16:48 | |
| *** smatzek_ has quit IRC | 16:48 | |
| *** thorst has joined #openstack-powervm | 16:50 | |
| *** AndyWojo has quit IRC | 16:52 | |
| *** dwayne has joined #openstack-powervm | 16:53 | |
| *** tsjakobs has quit IRC | 17:10 | |
| *** tblakes has quit IRC | 17:10 | |
| *** thorst_ has joined #openstack-powervm | 17:11 | |
| *** mdrabe has quit IRC | 17:11 | |
| *** thorst has quit IRC | 17:11 | |
| *** tblakes_ has joined #openstack-powervm | 17:12 | |
| *** tblakes_ is now known as tblakes | 17:13 | |
| *** dwayne_ has joined #openstack-powervm | 17:22 | |
| *** dwayne has quit IRC | 17:22 | |
| *** tblakes has quit IRC | 17:22 | |
| *** shyama has joined #openstack-powervm | 17:23 | |
| *** efried has joined #openstack-powervm | 17:25 | |
| *** tblakes has joined #openstack-powervm | 17:27 | |
| *** efried has quit IRC | 17:33 | |
| *** dwayne_ has quit IRC | 17:33 | |
| *** shyama has quit IRC | 17:33 | |
| *** dwayne__ has joined #openstack-powervm | 17:34 | |
| *** shyama has joined #openstack-powervm | 17:35 | |
| *** efried has joined #openstack-powervm | 17:36 | |
| *** shyama has quit IRC | 17:46 | |
| *** shyama has joined #openstack-powervm | 17:48 | |
| *** AndyWojo has joined #openstack-powervm | 17:57 | |
| *** thorst_ has quit IRC | 17:59 | |
| *** thorst_ has joined #openstack-powervm | 18:03 | |
| efried | thorst_, adreznec: ugh, what's the best way to do a sweep to identify missed master candidates for newton cherry-pick? | 18:04 |
| *** tjakobs has joined #openstack-powervm | 18:10 | |
| *** tjakobs has quit IRC | 18:10 | |
| *** tjakobs has joined #openstack-powervm | 18:10 | |
| *** thorst_ has quit IRC | 18:11 | |
| *** shyama has quit IRC | 18:11 | |
| *** shyama has joined #openstack-powervm | 18:11 | |
| *** tjakobs_ has joined #openstack-powervm | 18:18 | |
| *** tjakobs has quit IRC | 18:21 | |
| *** shyama has quit IRC | 18:21 | |
| *** shyama has joined #openstack-powervm | 18:21 | |
| *** thorst_ has joined #openstack-powervm | 18:25 | |
| *** dwayne_ has joined #openstack-powervm | 18:30 | |
| *** shyama has quit IRC | 18:30 | |
| *** shyama has joined #openstack-powervm | 18:30 | |
| *** dwayne__ has quit IRC | 18:30 | |
| *** thorst_ has quit IRC | 18:35 | |
| *** thorst_ has joined #openstack-powervm | 18:36 | |
| *** thorst_ has quit IRC | 18:36 | |
| *** thorst_ has joined #openstack-powervm | 18:36 | |
| *** shyama has quit IRC | 18:40 | |
| *** thorst_ has quit IRC | 18:50 | |
| *** thorst_ has joined #openstack-powervm | 18:56 | |
| *** burgerk__ has joined #openstack-powervm | 19:23 | |
| *** burgerk_ has quit IRC | 19:26 | |
| openstackgerrit | Eric Fried proposed openstack/networking-powervm: Time out port update waiting for vif plug https://review.openstack.org/370223 | 19:32 |
| openstackgerrit | Eric Fried proposed openstack/networking-powervm: [WIP] Refactor, consolidate, and clean up agents https://review.openstack.org/378000 | 19:32 |
| *** tonyb has quit IRC | 19:35 | |
| *** adreznec has quit IRC | 19:35 | |
| openstackgerrit | Eric Fried proposed openstack/networking-powervm: [WIP] Refactor, consolidate, and clean up agents https://review.openstack.org/378000 | 19:35 |
| *** AndyWojo has quit IRC | 19:36 | |
| *** tonyb_ has joined #openstack-powervm | 19:36 | |
| *** adreznec has joined #openstack-powervm | 19:36 | |
| efried | thorst_, here it is, as a start: https://review.openstack.org/#/c/378000/ For this change set (though particularly for agent_base), you may get best mileage out of looking at the file as a whole rather than the diff. | 19:39 |
| thorst_ | efried: if you're giving me that...I'm sending something your way | 19:40 |
| efried | Oh, riiight, so if I take it back, you'll take yours back? | 19:40 |
| efried | I have a feeling I get the better end of this deal either way. | 19:40 |
| thorst_ | efried: you do not | 19:41 |
| thorst_ | https://etherpad.openstack.org/p/powervm-nova-ocata-bp | 19:41 |
| thorst_ | please update along the way :-) | 19:41 |
| thorst_ | I'd like to see if we can't get that filed this week, and discuss it in the next nova IRC meeting | 19:41 |
| efried | roger wilco. | 19:41 |
| thorst_ | there's also a pypowervm one of us needs to get on this week... | 19:42 |
| efried | I have a fairly urgent pypowervm fix to do: set_vnic_backdevs needs to take sys/vios capabilities into account. | 19:43 |
| thorst_ | https://bugs.launchpad.net/pypowervm/+bug/1627579 -> basically a VIOS hosted a VIOS...and we wiped out the mapping | 19:43 |
| openstack | Launchpad bug 1627579 in pypowervm "Novalink vscsi mappings removed from VIOS" [Undecided,New] | 19:43 |
| thorst_ | ahh | 19:43 |
| efried | Yeah, I saw that conversation, but need to understand it more before diving in. | 19:43 |
| efried | Let's circle back tomorrow. | 19:43 |
| thorst_ | efried: sounds good | 19:43 |
| thorst_ | today has been a mess | 19:43 |
| thorst_ | like 8 solid hours of phone time. | 19:43 |
| efried | ugh | 19:44 |
| thorst_ | yeah. | 19:44 |
| efried | Well, I have poison ivy in my eyes. | 19:44 |
| thorst_ | you win | 19:44 |
| efried | Naaah, was gonna say: you win. | 19:44 |
| *** adreznec has quit IRC | 19:44 | |
| thorst_ | though, we've told you before that blowing your nose on poison ivy is a bad idea | 19:44 |
| *** adreznec_ has joined #openstack-powervm | 19:46 | |
| efried | Out of IRC for the rest of the afternoon. Slack me if you need something. | 19:46 |
| *** adreznec_ is now known as adreznec | 19:46 | |
| *** efried has quit IRC | 19:46 | |
| *** zerick has joined #openstack-powervm | 19:58 | |
| *** AndyWojo has joined #openstack-powervm | 20:07 | |
| *** tjakobs__ has joined #openstack-powervm | 20:21 | |
| *** tjakobs_ has quit IRC | 20:23 | |
| *** adreznec has quit IRC | 20:24 | |
| *** smatzek__ has quit IRC | 20:24 | |
| *** adreznec has joined #openstack-powervm | 20:24 | |
| *** burgerk_ has joined #openstack-powervm | 20:28 | |
| *** burgerk has joined #openstack-powervm | 20:31 | |
| *** burgerk__ has quit IRC | 20:31 | |
| *** AndyWojo has quit IRC | 20:32 | |
| *** adreznec has quit IRC | 20:32 | |
| *** k0da has joined #openstack-powervm | 20:33 | |
| *** burgerk_ has quit IRC | 20:33 | |
| *** adreznec has joined #openstack-powervm | 20:33 | |
| *** burgerk has quit IRC | 20:37 | |
| *** adreznec_ has joined #openstack-powervm | 20:44 | |
| *** k0da has quit IRC | 20:45 | |
| *** k0da has joined #openstack-powervm | 20:45 | |
| *** adreznec has quit IRC | 20:46 | |
| *** adreznec_ is now known as adreznec | 20:46 | |
| *** AndyWojo has joined #openstack-powervm | 20:53 | |
| *** thorst_ has quit IRC | 21:23 | |
| *** thorst_ has joined #openstack-powervm | 21:24 | |
| *** thorst_ has quit IRC | 21:29 | |
| *** kylek3h_ has quit IRC | 21:36 | |
| *** esberglu has quit IRC | 21:37 | |
| *** tblakes has quit IRC | 21:49 | |
| *** tonyb_ is now known as tonyb | 21:56 | |
| *** k0da has quit IRC | 22:26 | |
| *** tjakobs__ has quit IRC | 22:35 | |
| *** kriskend__ has quit IRC | 23:07 | |
| *** kylek3h has joined #openstack-powervm | 23:11 | |
| *** kylek3h has quit IRC | 23:11 | |
| *** kylek3h has joined #openstack-powervm | 23:11 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!