| *** smatzek has joined #openstack-powervm | 00:01 | |
| *** smatzek_ has joined #openstack-powervm | 00:03 | |
| *** svenkat has joined #openstack-powervm | 00:04 | |
| *** smatzek has quit IRC | 00:06 | |
| *** kriskend has quit IRC | 00:10 | |
| *** seroyer has quit IRC | 00:15 | |
| *** thorst_ has joined #openstack-powervm | 00:19 | |
| *** smatzek_ has quit IRC | 00:25 | |
| *** seroyer has joined #openstack-powervm | 00:36 | |
| *** seroyer has quit IRC | 00:49 | |
| *** dwayne has quit IRC | 00:54 | |
| *** kylek3h_away has joined #openstack-powervm | 01:06 | |
| *** thorst_ has quit IRC | 01:09 | |
| *** seroyer has joined #openstack-powervm | 01:44 | |
| *** thorst_ has joined #openstack-powervm | 02:48 | |
| *** thorst_ has quit IRC | 02:48 | |
| *** burgerk has joined #openstack-powervm | 03:00 | |
| *** thorst_ has joined #openstack-powervm | 03:04 | |
| *** thorst_ has quit IRC | 03:04 | |
| *** burgerk has quit IRC | 03:22 | |
| *** edmondsw has joined #openstack-powervm | 03:37 | |
| *** seroyer has quit IRC | 03:39 | |
| *** edmondsw has quit IRC | 03:41 | |
| *** thorst_ has joined #openstack-powervm | 03:59 | |
| *** thorst_ has quit IRC | 04:00 | |
| *** thorst_ has joined #openstack-powervm | 04:19 | |
| *** thorst_ has quit IRC | 04:19 | |
| *** nbante has joined #openstack-powervm | 04:59 | |
| *** svenkat has quit IRC | 05:08 | |
| *** thorst_ has joined #openstack-powervm | 06:20 | |
| *** thorst_ has quit IRC | 06:25 | |
| *** Jay2 has joined #openstack-powervm | 07:05 | |
| *** edmondsw has joined #openstack-powervm | 07:15 | |
| *** edmondsw has quit IRC | 07:19 | |
| *** Jay2 has quit IRC | 07:37 | |
| *** k0da has joined #openstack-powervm | 07:56 | |
| *** thorst_ has joined #openstack-powervm | 08:21 | |
| *** thorst_ has quit IRC | 08:26 | |
| *** svenkat has joined #openstack-powervm | 09:52 | |
| *** svenkat has quit IRC | 09:56 | |
| *** thorst_ has joined #openstack-powervm | 10:22 | |
| *** thorst_ has quit IRC | 10:26 | |
| *** svenkat has joined #openstack-powervm | 10:33 | |
| *** svenkat has quit IRC | 10:37 | |
| *** edmondsw has joined #openstack-powervm | 11:33 | |
| *** jpasqualetto has joined #openstack-powervm | 11:37 | |
| *** edmondsw has quit IRC | 11:37 | |
| *** svenkat has joined #openstack-powervm | 11:37 | |
| *** svenkat has quit IRC | 11:42 | |
| *** smatzek_ has joined #openstack-powervm | 12:08 | |
| *** nbante has quit IRC | 12:10 | |
| *** thorst_ has joined #openstack-powervm | 12:39 | |
| *** seroyer has joined #openstack-powervm | 12:44 | |
| *** svenkat has joined #openstack-powervm | 12:47 | |
| *** svenkat has quit IRC | 12:51 | |
| *** tblakes has joined #openstack-powervm | 13:09 | |
| *** svenkat has joined #openstack-powervm | 13:18 | |
| *** edmondsw has joined #openstack-powervm | 13:23 | |
| *** nbante has joined #openstack-powervm | 13:47 | |
| *** apearson has joined #openstack-powervm | 14:02 | |
| *** wangqwsh has joined #openstack-powervm | 14:02 | |
| thorst_ | driver meeting? | 14:02 |
|---|---|---|
| efried | o/ | 14:03 |
| efried | adreznec wangqwsh ? | 14:03 |
| wangqwsh | :) | 14:04 |
| thorst_ | I think esberglu normally drives it | 14:04 |
| thorst_ | ? | 14:04 |
| efried | We need him for some topics, but we can make progress while we wait. | 14:06 |
| thorst_ | you want to kick off meeting? | 14:06 |
| efried | #startmeeting PowerVM Driver meeting | 14:06 |
| openstack | Meeting started Tue Feb 7 14:06:25 2017 UTC and is due to finish in 60 minutes. The chair is efried. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:06 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:06 |
| openstack | The meeting name has been set to 'powervm_driver_meeting' | 14:06 |
| thorst_ | I still owe you a review...I know that | 14:06 |
| efried | #topic power on/off module refactor | 14:06 |
| efried | #action thorst_ to review | 14:07 |
| efried | #action efried to make sonar happy | 14:07 |
| * thorst_ review all the things | 14:07 | |
| efried | The UT I put up last night gives me a fairly high degree of confidence that what I have is backward compatible. | 14:07 |
| efried | Cause I wrote it against the old code first. | 14:07 |
| efried | #action esberglu to pull it into the CI env and give it a spin. | 14:08 |
| efried | That'll serve two purposes. 1) Make sure it works at all; and then 2) give us an easier way to make tweaks if we still see those power-off timeouts we were getting. | 14:09 |
| thorst_ | dig it | 14:09 |
| efried | #topic In-tree change sets | 14:09 |
| efried | I believe I have the bottom five properly rebased on one another, and I was in the process of going through the ovs-vif one when the power train left the station. | 14:10 |
| efried | wow, that was WAY too many metaphors mixed in there. | 14:10 |
| thorst_ | oook | 14:11 |
| thorst_ | and the in-tree CI runs against them now? | 14:11 |
| efried | Runs, yes. We still get bitten by new tests seemingly daily. | 14:11 |
| thorst_ | even though its a white list? | 14:11 |
| thorst_ | how could we get bit? | 14:11 |
| efried | That's a great question. | 14:12 |
| efried | Maybe I'm wrong. | 14:12 |
| efried | But we need esberglu to answer that. | 14:12 |
| thorst_ | I bet we got clever with the whitelist | 14:12 |
| thorst_ | and have some wildcard flags | 14:12 |
| thorst_ | that pick up new tests | 14:12 |
| thorst_ | I think mriedem really just wanted a couple tests in there... | 14:12 |
| efried | Nope, it's all UUIDs | 14:13 |
| thorst_ | hmm | 14:13 |
| thorst_ | OK | 14:13 |
| efried | Looking at the latest run, it didn't even get started. | 14:13 |
| thorst_ | then we'll wait for esberglu | 14:13 |
| efried | stack failed | 14:13 |
| thorst_ | wonder if that's like Jay's | 14:13 |
| thorst_ | but I haven't been keeping an eye on them | 14:13 |
| *** mdrabe has joined #openstack-powervm | 14:14 | |
| thorst_ | OK - so I think I need to take some time investigating the state of the in-tree. | 14:15 |
| efried | Actually, I was looking at the OOT CI for the first in-tree change, which is still failing on duplicate conf options. I don't see the in-tree having run at all. | 14:15 |
| thorst_ | #action thorst to look over the in tree stuff a bit more now | 14:16 |
| thorst_ | what else is there for today? | 14:17 |
| *** Jay2 has joined #openstack-powervm | 14:18 | |
| efried | wangqwsh Ni you shama? | 14:18 |
| wangqwsh | nope, | 14:18 |
| efried | Guess we call it early, and fup with esberglu later. | 14:18 |
| efried | #endmeeting | 14:19 |
| openstack | Meeting ended Tue Feb 7 14:19:00 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:19 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2017/powervm_driver_meeting.2017-02-07-14.06.html | 14:19 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2017/powervm_driver_meeting.2017-02-07-14.06.txt | 14:19 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2017/powervm_driver_meeting.2017-02-07-14.06.log.html | 14:19 |
| *** wangqwsh has quit IRC | 14:27 | |
| *** Jay2 has quit IRC | 14:28 | |
| *** wangqwsh has joined #openstack-powervm | 14:28 | |
| *** wangqwsh has quit IRC | 14:33 | |
| *** smatzek_ has quit IRC | 14:35 | |
| *** smatzek_ has joined #openstack-powervm | 14:55 | |
| *** smatzek__ has joined #openstack-powervm | 14:56 | |
| *** tjakobs has joined #openstack-powervm | 14:59 | |
| *** smatzek_ has quit IRC | 15:01 | |
| *** smatzek_ has joined #openstack-powervm | 15:02 | |
| *** seroyer has quit IRC | 15:02 | |
| *** smatzek__ has quit IRC | 15:06 | |
| *** tjakobs has quit IRC | 15:08 | |
| *** kriskend has joined #openstack-powervm | 15:13 | |
| *** Jay2 has joined #openstack-powervm | 15:15 | |
| *** seroyer has joined #openstack-powervm | 15:16 | |
| *** nbante has quit IRC | 15:37 | |
| *** mdrabe has quit IRC | 15:40 | |
| thorst_ | efried: good with me merging in https://review.openstack.org/#/c/408758 ? | 15:42 |
| efried | thorst_ Yup. | 15:42 |
| thorst_ | W+1 | 15:42 |
| *** tjakobs has joined #openstack-powervm | 15:45 | |
| *** mdrabe has joined #openstack-powervm | 15:48 | |
| openstackgerrit | Merged openstack/nova-powervm master: First pass at imagecache https://review.openstack.org/408758 | 15:50 |
| *** esberglu has joined #openstack-powervm | 15:53 | |
| efried | esberglu - here's the minutes http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2017/powervm_driver_meeting.2017-02-07-14.06.html and log http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2017/powervm_driver_meeting.2017-02-07-14.06.log.html from this morning. Let me know when you're caught up. | 16:00 |
| efried | esberglu Main thing to look at is: where's the in-tree CI run for https://review.openstack.org/391288 ? | 16:08 |
| esberglu | efried: I think you're confused about the in-tree CI. It's still running silent, so it isn't linking there | 16:08 |
| efried | esberglu Oh. So where do I go to look at it? | 16:08 |
| esberglu | I haven't turned it on like the OOT because it will fail every single patch that isn't our in-tree stuff | 16:09 |
| esberglu | Until the 1st in-tree patch is merged | 16:09 |
| esberglu | I will link you some logs | 16:09 |
| *** burgerk has joined #openstack-powervm | 16:10 | |
| esberglu | efried: http://184.172.12.213/88/391288/33/silent/nova-in-tree-pvm/ | 16:35 |
| *** openstackgerrit has quit IRC | 16:35 | |
| esberglu | Those are all of the runs from the latest patchset | 16:35 |
| thorst_ | efried: you still want me to hold off on the review for power, or rip it? | 16:39 |
| efried | thorst_ Rip it. | 16:39 |
| efried | thorst_ Still trying to satisfy sonar a bit, but shouldn't affect anything. | 16:41 |
| thorst_ | k | 16:45 |
| thorst_ | I'm mostly good with it...I think there are some ways you can cut complexity | 16:45 |
| thorst_ | of course you uploaded a new rev as I was commenting | 16:48 |
| thorst_ | I think some of my comments are dupes | 16:48 |
| thorst_ | no, don't think they are | 16:49 |
| thorst_ | give it a look | 16:49 |
| efried | Dude, thorst_, you're worse than sonar. | 16:54 |
| thorst_ | :-) | 17:08 |
| thorst_ | hugs | 17:08 |
| adreznec | efried: Is that a compliment? Insult? Both at once? | 17:09 |
| *** nbante has joined #openstack-powervm | 17:13 | |
| *** jpasqualetto has quit IRC | 17:18 | |
| *** efried has quit IRC | 17:28 | |
| thorst_ | a delay that long from efried means its an insult ;-) | 17:28 |
| *** jpasqualetto has joined #openstack-powervm | 17:35 | |
| *** esberglu has quit IRC | 17:38 | |
| *** efried has joined #openstack-powervm | 17:41 | |
| *** efried has quit IRC | 17:50 | |
| *** esberglu has joined #openstack-powervm | 17:52 | |
| *** efried has joined #openstack-powervm | 17:54 | |
| *** jpasqualetto has quit IRC | 17:56 | |
| efried | thorst_ Responses on the power change set. Only one thing I'm going to act on right now; other issues are pending discussion. | 18:12 |
| *** jpasqualetto has joined #openstack-powervm | 18:14 | |
| *** nbante has quit IRC | 18:16 | |
| thorst_ | efried: ok | 18:47 |
| *** apearson has quit IRC | 19:00 | |
| *** apearson has joined #openstack-powervm | 19:01 | |
| esberglu | efried: CI runs are going through with the power refactor. Results should come through within the hour | 19:19 |
| *** jpasqualetto has quit IRC | 19:27 | |
| efried | esberglu noyce. What did you have to do to get the patches to stack up right? | 19:35 |
| esberglu | Put the refactor change 1st | 19:35 |
| efried | esberglu And remove 4761? | 19:36 |
| efried | Hope so, else results will be pretty unpredictable ;-) | 19:36 |
| efried | esberglu Can I go look at the pypowervm code somewhere this is running? | 19:37 |
| esberglu | One sec I'll pm | 19:37 |
| *** jpasqualetto has joined #openstack-powervm | 19:44 | |
| *** apearson has quit IRC | 20:05 | |
| thorst_ | esberglu: there/ | 20:07 |
| esberglu | Yeah | 20:07 |
| thorst_ | I can move the VMs running our CI over to a SAN now | 20:07 |
| thorst_ | should give us much higher throughput...better perf and all that good stuff | 20:08 |
| thorst_ | but not sure when is a good time to do that | 20:08 |
| thorst_ | will have same issue with morpheus. | 20:08 |
| thorst_ | but I need you to start thinking about when you want me to do that. | 20:08 |
| thorst_ | it means an hour or so of downtime for the VMs...maybe a bit more | 20:09 |
| thorst_ | efried: you probably care about that too :-) | 20:10 |
| efried | shrug | 20:10 |
| *** apearson has joined #openstack-powervm | 20:12 | |
| esberglu | What issue with morpheus? | 20:15 |
| *** jpasqualetto has quit IRC | 20:18 | |
| efried | adreznec thorst_ esberglu - Anybody remember what we do with pastebin et al when we see 'cannot import name deploy'? Jay2 is hitting that. | 20:21 |
| thorst_ | efried: uninstall pastebin | 20:21 |
| thorst_ | pip install pastebin | 20:21 |
| thorst_ | esberglu: morpheus is just slow | 20:21 |
| esberglu | I'm thinking we at least want to get the power-off stuff finished first | 20:27 |
| mdrabe | adreznec esberglu So any chance of getting the CI rebuilt for https://review.openstack.org/#/c/425780/? | 20:36 |
| *** jpasqualetto has joined #openstack-powervm | 20:36 | |
| adreznec | mdrabe: what do you need rebuilt for that exactly? newer novalink? | 20:37 |
| mdrabe | Yup | 20:37 |
| efried | thorst_ esberglu - new rev of the power change set is up, with nontrivial changes. Need new review & CI deploy, respectively. | 20:38 |
| adreznec | thorst_: esberglu ^^ so I assume we'd need things on near-latest 1.0.0.5 for that mdrabe? | 20:38 |
| mdrabe | Yea, the very latest, for something that merged hours ago | 20:38 |
| adreznec | Ok, figured that would be the case. thorst_ efried can you think of anything that was changed from an API/core standpoint that would break say a Mitaka run? | 20:40 |
| efried | oh, absolutely. But I don't think mdrabe is looking for mitaka or even newton. | 20:40 |
| adreznec | Sure | 20:41 |
| adreznec | But if we need the latest novalink code to get these runs passing CI | 20:41 |
| efried | We always use the latest novalink code for master | 20:41 |
| adreznec | Well | 20:41 |
| adreznec | You use the latest pypowervm | 20:41 |
| efried | The only reason we don't update it on every run is because we do the whole pre-preparing nodes thingy. | 20:42 |
| adreznec | But the underlying novalink code is still 1.0.0.4 | 20:42 |
| adreznec | From REST down | 20:42 |
| adreznec | One of the... complications... of the CI environment | 20:42 |
| efried | Is it? I didn't think so. | 20:42 |
| adreznec | I'm pretty sure it is... esberglu would know for sure | 20:43 |
| adreznec | Otherwise let me look | 20:43 |
| efried | I thought we were updating the underlying novalink packages to dev levels every time they put in a feature we built on top of in e.g. pypowervm. | 20:43 |
| efried | That's the only thing that makes sense. | 20:43 |
| efried | It's just a question of how disruptive it is to get it in there. | 20:43 |
| mdrabe | It would make sense for pypowervm | 20:44 |
| adreznec | ii pvm-rest-app 1.0.0.4-161114-385 ppc64el The PowerVM NovaLink REST API Application | 20:44 |
| adreznec | ii pvm-novalink 1.0.0.4-161114-1819 ppc64el Meta package for all PowerVM Novalink packages | 20:44 |
| efried | I'm not well-versed on the specifics, but it seems like there's at least three levels of "rebuild the CI env" depending on what we need to pick up. | 20:44 |
| adreznec | From at least 2 of the nodes | 20:44 |
| mdrabe | But right now my change is failing in the CI with exactly what I expected, and it's b/c the REST level isn't right | 20:44 |
| adreznec | Right | 20:44 |
| efried | So is this one of the "really rebuild the whole shootin match" times? | 20:44 |
| adreznec | We shouldn't have to do thart | 20:45 |
| adreznec | *that | 20:45 |
| mdrabe | Yea, and it'll happen any time we've got dependant changes coming up the stack | 20:45 |
| adreznec | The only part that really needs to change is to upgrade the novalink packages | 20:45 |
| adreznec | From 1.0.0.4 -> 1.0.0.5 | 20:45 |
| adreznec | The question is more what the impact of doing that is | 20:46 |
| adreznec | Do we break CI runs for mitaka, for example, by doing that? | 20:46 |
| mdrabe | I mean, it'd have to happen eventually no? Can't stay on 1.0.0.4 forever? | 20:46 |
| adreznec | Right | 20:46 |
| mdrabe | Is it possible to keep a few nodes on 1.0.0.4 and dedicate those to mitaka runs? | 20:47 |
| adreznec | esberglu: is there an "easy" way to bump staging to 1.0.0.5 and see what happens to a stable/mitaka run? | 20:47 |
| adreznec | mdrabe: Not super easily right now... not a lot of flexibility in the jenkins/nodepool setup there IIRC | 20:47 |
| adreznec | Dedicated node types were something that esberglu was looking at when we moved to zuulv3 | 20:48 |
| esberglu | Wow picked the wrong time to grab a coffee. Let me get caught up quick | 20:49 |
| thorst_ | if we're talking about a full rebuild...lets tie it to my 'fix the disks' work. | 20:51 |
| adreznec | esberglu: tsk tsk, you should know the CI requires constant vigilance! | 20:51 |
| adreznec | thorst_: We shouldn't be | 20:51 |
| thorst_ | we could take that on tomorrow even. | 20:51 |
| adreznec | At least not for this | 20:51 |
| thorst_ | ok | 20:51 |
| esberglu | I don't think we need a full rebuild? Pretty sure we can just update the packages right? | 20:52 |
| adreznec | Right | 20:52 |
| adreznec | The question is what, if anything, that breaks | 20:52 |
| esberglu | Well looks like testing on staging is the way to go | 20:53 |
| esberglu | I will update it there | 20:53 |
| adreznec | Sounds like a plan | 20:53 |
| thorst_ | all in progress runs would likely be impacted | 20:53 |
| thorst_ | but you could also do a rolling upgrade through the under cloud | 20:54 |
| adreznec | mdrabe: esberglu will let you know how it works on staging | 20:54 |
| thorst_ | just put certain hosts in 'maintenance' (no new deploys there) | 20:54 |
| thorst_ | and update that host when all the workload is off of it | 20:54 |
| adreznec | If it goes well we could do a rolling upgrade like thorst_ is describing | 20:54 |
| mdrabe | cool thnx guys | 20:54 |
| thorst_ | mdrabe: I liked your blog post | 20:54 |
| adreznec | If not we'll have to brainstorm a bit on how to handle things | 20:54 |
| efried | We don't run on mitaka anymore, I thought. | 20:56 |
| mdrabe | thorst_ Now to get that support in nova | 20:56 |
| efried | And it's *possible* that 1.0.0.5-dev won't break newton. | 20:56 |
| *** jpasqualetto has quit IRC | 20:57 | |
| esberglu | We are also using a newton undercloud. So this could potentially impact that as well right? | 21:06 |
| thorst_ | efried: 1.0.0.5-dev better not break newton | 21:06 |
| thorst_ | ;-) | 21:06 |
| thorst_ | I think you're just saying you haven't verified it | 21:06 |
| thorst_ | so this is a good thing to test. | 21:06 |
| esberglu | Do I have to restart anything after moving from 1.0.0.4 --> 1.0.0.5? | 21:09 |
| adreznec | esberglu: things should restart on their own I think | 21:12 |
| *** smatzek_ has quit IRC | 21:29 | |
| *** seroyer has quit IRC | 21:33 | |
| *** seroyer has joined #openstack-powervm | 21:54 | |
| *** smatzek_ has joined #openstack-powervm | 22:00 | |
| *** thorst_ has quit IRC | 22:01 | |
| *** svenkat has quit IRC | 22:02 | |
| *** thorst_ has joined #openstack-powervm | 22:03 | |
| *** thorst_ has quit IRC | 22:08 | |
| *** Jay2 has quit IRC | 22:09 | |
| *** thorst_ has joined #openstack-powervm | 22:20 | |
| *** thorst_ has quit IRC | 22:25 | |
| *** smatzek_ has quit IRC | 22:26 | |
| *** edmondsw has quit IRC | 22:29 | |
| *** burgerk has quit IRC | 22:30 | |
| *** tblakes has quit IRC | 22:46 | |
| *** seroyer has quit IRC | 22:55 | |
| *** edmondsw has joined #openstack-powervm | 22:59 | |
| *** esberglu has quit IRC | 23:00 | |
| *** esberglu has joined #openstack-powervm | 23:00 | |
| *** esberglu has quit IRC | 23:01 | |
| *** edmondsw has quit IRC | 23:04 | |
| *** kriskend has quit IRC | 23:04 | |
| *** mdrabe has quit IRC | 23:09 | |
| *** esberglu has joined #openstack-powervm | 23:16 | |
| *** esberglu has quit IRC | 23:18 | |
| *** tlian has quit IRC | 23:26 | |
| *** apearson has quit IRC | 23:34 | |
| *** tlian has joined #openstack-powervm | 23:42 | |
| *** tjakobs has quit IRC | 23:49 | |
| *** seroyer has joined #openstack-powervm | 23:49 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!