| *** tjakobs has joined #openstack-powervm | 00:15 | |
| *** thorst_ has joined #openstack-powervm | 00:41 | |
| *** tjakobs has quit IRC | 00:44 | |
| *** openstackgerrit has quit IRC | 01:02 | |
| *** thorst_ has quit IRC | 01:05 | |
| *** thorst_ has joined #openstack-powervm | 01:06 | |
| *** thorst_ has quit IRC | 01:10 | |
| *** thorst_ has joined #openstack-powervm | 01:16 | |
| *** thorst_ has quit IRC | 01:25 | |
| *** tlian has quit IRC | 01:32 | |
| *** thorst_ has joined #openstack-powervm | 01:33 | |
| *** thorst_ has quit IRC | 01:33 | |
| *** tlian has joined #openstack-powervm | 01:41 | |
| *** thorst_ has joined #openstack-powervm | 01:53 | |
| *** thorst_ has quit IRC | 01:57 | |
| *** efried has quit IRC | 02:09 | |
| *** efried has joined #openstack-powervm | 02:11 | |
| *** thorst_ has joined #openstack-powervm | 02:29 | |
| *** thorst_ has quit IRC | 02:29 | |
| *** thorst_ has joined #openstack-powervm | 02:52 | |
| *** thorst_ has quit IRC | 02:52 | |
| *** tlian has quit IRC | 03:06 | |
| *** thorst_ has joined #openstack-powervm | 03:13 | |
| *** tlian has joined #openstack-powervm | 03:18 | |
| *** thorst_ has quit IRC | 03:20 | |
| *** tjakobs has joined #openstack-powervm | 03:48 | |
| *** tlian has quit IRC | 03:52 | |
| *** thorst_ has joined #openstack-powervm | 03:55 | |
| *** thorst_ has quit IRC | 03:55 | |
| *** tjakobs has quit IRC | 04:10 | |
| *** efried has quit IRC | 04:59 | |
| *** efried has joined #openstack-powervm | 05:12 | |
| *** thorst_ has joined #openstack-powervm | 05:33 | |
| *** thorst_ has quit IRC | 05:38 | |
| *** efried has quit IRC | 06:07 | |
| *** efried has joined #openstack-powervm | 06:11 | |
| *** thorst_ has joined #openstack-powervm | 07:00 | |
| *** thorst_ has quit IRC | 07:06 | |
| *** efried has quit IRC | 07:51 | |
| *** efried has joined #openstack-powervm | 07:55 | |
| *** k0da has joined #openstack-powervm | 08:41 | |
| *** edmondsw has joined #openstack-powervm | 08:43 | |
| *** edmondsw has quit IRC | 08:48 | |
| chmod666org | /names | 09:01 |
|---|---|---|
| *** thorst_ has joined #openstack-powervm | 09:02 | |
| *** thorst_ has quit IRC | 09:08 | |
| *** efried has quit IRC | 10:57 | |
| *** thorst_ has joined #openstack-powervm | 11:04 | |
| *** thorst_ has quit IRC | 11:08 | |
| *** efried has joined #openstack-powervm | 11:09 | |
| *** edmondsw has joined #openstack-powervm | 12:04 | |
| *** thorst_ has joined #openstack-powervm | 12:33 | |
| *** thorst_ has quit IRC | 12:34 | |
| *** thorst_ has joined #openstack-powervm | 13:01 | |
| efried | thorst_ See https://review.openstack.org/#/c/391288/33/nova/conf/powervm.py@1 - is that right? Do we add the OpenStack Foundation copyright? | 13:15 |
| efried | I looked at driver.py for some of the other drivers: hyperv and libvirt don't have it; xenapi does. | 13:17 |
| *** esberglu has joined #openstack-powervm | 13:21 | |
| thorst_ | I think for that file it kinda makes sense. We at least followed the style? But I didn't think that was the guidelines. | 13:22 |
| *** xia has joined #openstack-powervm | 13:28 | |
| *** XiaYan has joined #openstack-powervm | 13:30 | |
| esberglu | #startmeeting powervm_ci_meeting | 13:30 |
| openstack | Meeting started Thu Feb 2 13:30:37 2017 UTC and is due to finish in 60 minutes. The chair is esberglu. Information about MeetBot at http://wiki.debian.org/MeetBot. | 13:30 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 13:30 |
| openstack | The meeting name has been set to 'powervm_ci_meeting' | 13:30 |
| esberglu | Hi | 13:30 |
| xia | o/ | 13:31 |
| xia | Hi | 13:31 |
| thorst_ | o/ | 13:31 |
| efried | o/ | 13:31 |
| efried | #topic In-tree runs | 13:32 |
| efried | Have we rebuilt and done runs with the latest pypowervm power-off fix? | 13:32 |
| esberglu | Yeah, still hitting power off issues | 13:32 |
| efried | Wait, that was for oot | 13:32 |
| esberglu | Oh yeah for oot, didn't look at topic | 13:33 |
| esberglu | In tree also picked has those changes patches in | 13:34 |
| esberglu | In tree needs some further whitelist work | 13:35 |
| esberglu | Latest in-tree results from patch 1 | 13:36 |
| esberglu | http://184.172.12.213/88/391288/33/silent/nova-in-tree-pvm/98345c2/powervm_os_ci.html | 13:36 |
| efried | Yeah, those port binding failures are what I expect to see any time you try to spawn a VM with that first change set. | 13:38 |
| efried | In fact, anything network-related I would say indicates that test should be stricken from the whitelist. | 13:38 |
| thorst_ | +1 | 13:39 |
| esberglu | Yep | 13:40 |
| efried | Server rename isn't supposed to work either; though that failure looks like the VM didn't build in the first place. Probably worth looking into that further - but again, I don't think we should be running that test. | 13:40 |
| esberglu | #action: esberglu: Update whitelist based on In Tree results | 13:40 |
| efried | All in all, I'm fairly pleased that we can pass 862 tests in-tree. | 13:41 |
| efried | Though I suppose the vast majority of them never hit our code. | 13:41 |
| thorst_ | yeah... | 13:41 |
| thorst_ | I don't know that its a huge success of anything other than the framework and that our driver doesn't die on start up at the moment :-) | 13:42 |
| thorst_ | unless we did get that network-less test in? | 13:42 |
| efried | Validating the framework is a win, in my book. | 13:42 |
| thorst_ | totes | 13:42 |
| efried | A bigger deal than proving a real spawn, with no disk or network, IMO. | 13:43 |
| thorst_ | true | 13:43 |
| efried | esberglu I thought we ascertained that there was some way we could set up the networks where there were existing tests that would do real spawns - i.e. we didn't need to write our own explicit network-less spawn tests. | 13:43 |
| efried | Any update on that statement? | 13:44 |
| efried | Like, can you point to one or more of the tests in this run and say, "This is doing a spawn and succeeding"? | 13:44 |
| efried | Guess I could grep the log... | 13:44 |
| esberglu | tempest.api.compute.servers.test_servers.ServersTestJSON | 13:44 |
| esberglu | Look at the tests under that | 13:44 |
| esberglu | Yeah I stopped looking into the networkless spawn test when we started passing other ones | 13:46 |
| efried | Well, shoot, I see a ton of successful spawns in the log. This is mucho goodness. | 13:46 |
| efried | 29 of them. | 13:47 |
| thorst_ | neat | 13:48 |
| efried | So: let's get rid of failing tests that we know we don't/shouldn't support yet, and produce a list of remaining failures that we don't think should be failures, and look into those. | 13:48 |
| efried | Delete the former from the whitelist, but go ahead and comment out the latter, and let's see if we can get some consistent successful runs out of that. | 13:49 |
| esberglu | Sounds good | 13:49 |
| esberglu | Once that change is in I will push through some runs | 13:49 |
| esberglu | Anything else for in tree CI? | 13:50 |
| efried | #topic Out-of-tree runs | 13:50 |
| efried | So you said we're still seeing power-off failures? Show me. | 13:50 |
| esberglu | One sec, finding the right logs | 13:51 |
| efried | I'm refactoring the power on/off code. Hopefully that'll make it a lot easier to isolate where these failures happen, and make appropriate tweaks. | 13:51 |
| esberglu | http://184.172.12.213/30/427930/1/check/nova-out-of-tree-pvm/5bbe540/powervm_os_ci.html | 13:51 |
| efried | looking... | 13:52 |
| esberglu | http://184.172.12.213/82/416882/9/check/nova-out-of-tree-pvm/5cb242a/powervm_os_ci.html | 13:53 |
| esberglu | Hitting a diff. test case in that second one | 13:53 |
| efried | So here again it looks like we're trying the power-off with force_immediate=False - which is ON_FAILURE, which is _supposed_ to retry with vsp hard shutdown on any failure. But it ain't. | 13:56 |
| efried | Give me the day to finish this refactor, and then we can start verifying those code paths better. | 13:57 |
| thorst_ | efried: did we add logging to the power off code? | 13:58 |
| thorst_ | seems like we're at that point. | 13:58 |
| esberglu | Okay | 13:58 |
| *** dwayne has quit IRC | 13:58 | |
| thorst_ | especially if they ask for an force on failure | 13:58 |
| thorst_ | we should log warn that we're escalating | 13:58 |
| esberglu | Other than that there is this register image test that is hitting us | 13:59 |
| esberglu | And a few other ones that are failing (but may be related / side effects of power off) | 13:59 |
| efried | I'm glad you asked. The power_off method was under @logcall, but without params logged. So I'm adding that. But yeah, I'm also going to add more log statements so we can follow the flow. | 13:59 |
| thorst_ | cool beans dude | 14:00 |
| thorst_ | what a weird mess | 14:00 |
| thorst_ | I wonder if this is a side effect of the NovaLink's being up for so long. | 14:00 |
| thorst_ | is there some leak in core that we're just now seeing... | 14:00 |
| efried | The flow diagrams nvcastet showed us yesterday are really informative. I'm actually suspecting we're not completely honoring those - as in this case. | 14:00 |
| efried | I'm going to render those ascii-wise in the docstrings. | 14:01 |
| efried | I still have some questions on what paths we should take along those flows depending on the different values of force_immediate, though. | 14:01 |
| thorst_ | nvcastet is probably the right one for that...he's super smart. | 14:02 |
| thorst_ | smarter than me :-) | 14:02 |
| *** apearson has joined #openstack-powervm | 14:04 | |
| efried | Well, I think the semantics of force_immediate were more of an artifact of how we wanted the community code to flow. So I'll need input from both of you. | 14:05 |
| efried | nvcastet implied that the IBMi folks said we should "always" try vsp normal before vsp hard - so I'll want to know if that applies even if we say NO_RETRY. | 14:06 |
| efried | The contract of NO_RETRY is supposedly that we *don't* go to vsp hard if the previous attempt failed. | 14:07 |
| efried | So I'm stuck in the middle, at least for IBMi. | 14:07 |
| efried | Anywho... | 14:07 |
| efried | Are we done talking about CI? | 14:07 |
| esberglu | I am | 14:08 |
| thorst_ | yep | 14:08 |
| efried | xia, anything? | 14:08 |
| *** mdrabe has joined #openstack-powervm | 14:08 | |
| xia | No,Thanks | 14:09 |
| esberglu | Thanks for joining | 14:09 |
| esberglu | #endmeeting | 14:09 |
| openstack | Meeting ended Thu Feb 2 14:09:54 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:09 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/powervm_ci_meeting/2017/powervm_ci_meeting.2017-02-02-13.30.html | 14:09 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/powervm_ci_meeting/2017/powervm_ci_meeting.2017-02-02-13.30.txt | 14:09 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/powervm_ci_meeting/2017/powervm_ci_meeting.2017-02-02-13.30.log.html | 14:09 |
| efried | 试 | 14:11 |
| efried | Cool. | 14:12 |
| *** xia has quit IRC | 14:16 | |
| *** XiaYan has quit IRC | 14:16 | |
| *** esberglu has quit IRC | 14:23 | |
| *** tblakes has joined #openstack-powervm | 14:43 | |
| *** esberglu has joined #openstack-powervm | 14:45 | |
| *** dwayne has joined #openstack-powervm | 14:48 | |
| *** dwayne has quit IRC | 15:04 | |
| *** kriskend has joined #openstack-powervm | 15:06 | |
| *** edmondsw_ has joined #openstack-powervm | 15:32 | |
| *** tjakobs has joined #openstack-powervm | 15:33 | |
| *** edmondsw has quit IRC | 15:34 | |
| esberglu | efried: thorst_: Whitelist change is up. 4771. | 15:57 |
| thorst_ | looked reasonable to me. I think efried gets +2 on it | 15:58 |
| *** burgerk has joined #openstack-powervm | 15:59 | |
| efried | esberglu: Are all those deleted tests really failing, or are you just removing them based on their names? | 15:59 |
| efried | Why are we getting rid of the list_servers tests? Those ought to work. | 16:00 |
| esberglu | Oh I thought you said get rid of those during the CI meeting. They have failed every in tree run so far | 16:01 |
| esberglu | But we can debug if they should be working | 16:01 |
| efried | oh, the one you showed me earlier didn't fail those, did it? | 16:02 |
| efried | If it did, at least move those into the "pending debug" comment. Don't whack 'em entirely. | 16:03 |
| efried | Unless I'm missing something. thorst_ ? | 16:03 |
| esberglu | They failed the set up | 16:03 |
| esberglu | So it only came through as one failure | 16:03 |
| thorst_ | they probably failed the setup because they did a deploy | 16:03 |
| thorst_ | with a network. | 16:03 |
| thorst_ | to try to list the thing it deployed. | 16:03 |
| esberglu | Yeah it fails binding a port | 16:04 |
| thorst_ | so I think its fine tossing for now | 16:07 |
| *** mdrabe has quit IRC | 16:09 | |
| efried | mm, okay. | 16:15 |
| esberglu | I can still toss them in the debug section if you want | 16:15 |
| efried | Nah, +2. | 16:16 |
| efried | As long as we still end up with some tests doing successful deploys, I'm happy. | 16:16 |
| *** mdrabe has joined #openstack-powervm | 16:19 | |
| *** tlian has joined #openstack-powervm | 16:28 | |
| *** dwayne has joined #openstack-powervm | 16:37 | |
| *** tblakes has quit IRC | 16:55 | |
| *** tlian has quit IRC | 16:58 | |
| *** k0da has quit IRC | 17:02 | |
| *** tblakes has joined #openstack-powervm | 17:05 | |
| *** dwayne has quit IRC | 17:56 | |
| *** dwayne has joined #openstack-powervm | 18:15 | |
| *** k0da has joined #openstack-powervm | 19:48 | |
| *** jpasqualetto has joined #openstack-powervm | 19:53 | |
| jpasqualetto | Hello everyone. I've deployed the powervm driver in my test environment and I have some issues to take snapshots of the instances. Is there any special configuration or pre-requisite to take snapshots? | 19:57 |
| thorst_ | jpasqualetto: shouldn't be...can you post a pastebin of what you're seeing? | 19:57 |
| jpasqualetto | thorst_, http://pastebin.com/GLUmHYg5 | 20:00 |
| *** apearson has quit IRC | 20:00 | |
| *** apearson has joined #openstack-powervm | 20:02 | |
| efried | thorst_ Ouch. | 20:06 |
| thorst_ | dual vios? | 20:06 |
| efried | Wouldn't think that should matter. "Logical Volumes can not be associated with more than one virtual SCSI adapter". I thought localdisk used LVs - have we never tried snapshot with localdisk? | 20:08 |
| esberglu | efried: thorst_: More failures popping up on In Tree runs even with the new whitelist. | 20:10 |
| esberglu | A bunch more port binding errors | 20:10 |
| efried | weird that we're seeing these now but not before. | 20:11 |
| efried | Are we pulling a new tempest every run? | 20:11 |
| thorst_ | oooo | 20:11 |
| esberglu | Thats what I was thinking | 20:11 |
| thorst_ | efried: you're right. | 20:11 |
| thorst_ | jpasqualetto: I guess we had only tried with SSPs. | 20:11 |
| thorst_ | we can go poke on the VIOS guys to see what's up with that...see if we can't figure something out | 20:12 |
| jpasqualetto | thorst_, I have a more detailed log here: http://pastebin.com/LNcwb8aZ | 20:12 |
| esberglu | efried: Yeah we are | 20:12 |
| thorst_ | jpasqualetto: do you have an opportunity to try SSP? | 20:15 |
| jpasqualetto | thorst_, I can try to use SSP | 20:16 |
| thorst_ | that would be fantastic to know...we do this many times a day on SSP | 20:17 |
| efried | Meanwhile, thorst_, looks like we need a launchpad bug. TBH, not sure how we're going to fix it, though. | 20:18 |
| jpasqualetto | thorst_, i'll need some time to configure SSP in my environment (actually, other person of my team needs to do it)... i'll come back with results once I can get it done | 20:22 |
| thorst_ | jpasqualetto: definitely let us know | 20:25 |
| thorst_ | efried: yeah, I agree. | 20:25 |
| *** seroyer has joined #openstack-powervm | 20:46 | |
| esberglu | thorst_: efried: adreznec: Any patches that should get in before tagging RC1 and branching today? | 20:58 |
| thorst_ | not to my knowledge | 20:58 |
| efried | esberglu We talking about nova-powervm/networking-powervm/ceilometer-powervm? | 20:58 |
| esberglu | Yeah | 20:58 |
| efried | Hold on, lemme merge that backports one... | 20:59 |
| efried | esberglu Wait for https://review.openstack.org/426956 | 20:59 |
| esberglu | Will do | 21:00 |
| *** openstackgerrit has joined #openstack-powervm | 21:06 | |
| openstackgerrit | Merged openstack/nova-powervm master: In-tree backports (2) https://review.openstack.org/426956 | 21:06 |
| openstackgerrit | Eric Fried proposed openstack/nova-powervm master: WIP: Sanitize the config drive UUID https://review.openstack.org/428433 | 21:22 |
| efried | jpasqualetto - conclusion is that we can't support snapshot with localdisk. I opened https://bugs.launchpad.net/nova-powervm/+bug/1661395 to make this behave better if you try it. | 21:34 |
| openstack | Launchpad bug 1661395 in nova-powervm "Snapshot with localdisk not supported" [Undecided,New] | 21:34 |
| efried | ( thorst_ apearson ^^ ) | 21:34 |
| efried | Meanwhile, let us know how you get along with the SSP disk driver. | 21:34 |
| *** jpasqualetto has quit IRC | 21:41 | |
| *** apearson has quit IRC | 21:50 | |
| *** jpasqualetto has joined #openstack-powervm | 21:53 | |
| *** Jay1 has joined #openstack-powervm | 21:58 | |
| *** thorst_ has quit IRC | 22:06 | |
| *** jpasqualetto has quit IRC | 22:11 | |
| *** esberglu has quit IRC | 22:24 | |
| *** esberglu has joined #openstack-powervm | 22:24 | |
| *** esberglu has quit IRC | 22:28 | |
| *** tlian has joined #openstack-powervm | 22:30 | |
| *** thorst_ has joined #openstack-powervm | 22:31 | |
| *** thorst_ has quit IRC | 22:35 | |
| *** Jay1 has quit IRC | 22:40 | |
| *** esberglu has joined #openstack-powervm | 22:45 | |
| -openstackstatus- NOTICE: Restarting gerrit due to performance problems | 22:51 | |
| *** edmondsw_ has quit IRC | 22:53 | |
| *** edmondsw has joined #openstack-powervm | 22:54 | |
| openstackgerrit | Eric Fried proposed openstack/nova-powervm master: WIP: Sanitize the config drive UUID https://review.openstack.org/428433 | 22:54 |
| *** apearson has joined #openstack-powervm | 22:57 | |
| *** edmondsw has quit IRC | 22:58 | |
| *** burgerk_ has joined #openstack-powervm | 23:00 | |
| *** dwayne has quit IRC | 23:00 | |
| *** burgerk has quit IRC | 23:03 | |
| *** burgerk_ has quit IRC | 23:04 | |
| *** mdrabe has quit IRC | 23:06 | |
| adreznec | esberglu: Did you cut ceilometer-powervm 4.0.0.0rc1? Or did it get done under the general ceilometer project release process? | 23:10 |
| adreznec | Just got an email about it | 23:10 |
| esberglu | Yeah I cut 4.0.0.0rc1 for all 3 | 23:12 |
| adreznec | Cool :) | 23:12 |
| *** kriskend has quit IRC | 23:13 | |
| *** thorst_ has joined #openstack-powervm | 23:20 | |
| *** apearson has quit IRC | 23:33 | |
| *** esberglu has quit IRC | 23:33 | |
| *** tblakes has quit IRC | 23:33 | |
| *** tlian has quit IRC | 23:35 | |
| *** tjakobs has quit IRC | 23:37 | |
| *** seroyer has quit IRC | 23:45 | |
| *** dwayne has joined #openstack-powervm | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!