| *** thorst_afk has joined #openstack-powervm | 00:10 | |
| *** chhavi has joined #openstack-powervm | 00:17 | |
| *** mdrabe has quit IRC | 00:31 | |
| *** svenkat has joined #openstack-powervm | 00:33 | |
| *** chas has joined #openstack-powervm | 00:47 | |
| *** chas has quit IRC | 00:53 | |
| *** chas has joined #openstack-powervm | 01:09 | |
| *** chas has quit IRC | 01:13 | |
| *** thorst_afk has quit IRC | 01:19 | |
| *** thorst_afk has joined #openstack-powervm | 01:28 | |
| *** chas has joined #openstack-powervm | 01:30 | |
| *** chas has quit IRC | 01:34 | |
| *** thorst_afk has quit IRC | 01:35 | |
| *** esberglu has quit IRC | 01:38 | |
| *** chas has joined #openstack-powervm | 01:50 | |
| *** lan has joined #openstack-powervm | 01:55 | |
| *** chas has quit IRC | 01:55 | |
| *** chhavi has quit IRC | 02:01 | |
| *** thorst_afk has joined #openstack-powervm | 02:03 | |
| *** thorst_afk has quit IRC | 02:04 | |
| *** chas has joined #openstack-powervm | 02:11 | |
| *** chas has quit IRC | 02:16 | |
| *** esberglu has joined #openstack-powervm | 02:31 | |
| *** chas has joined #openstack-powervm | 02:32 | |
| *** lan1 has joined #openstack-powervm | 02:33 | |
| *** esberglu has quit IRC | 02:35 | |
| *** lan has quit IRC | 02:36 | |
| *** chas has quit IRC | 02:37 | |
| *** shyama has quit IRC | 02:52 | |
| *** thorst_afk has joined #openstack-powervm | 03:04 | |
| *** svenkat has quit IRC | 03:09 | |
| openstackgerrit | Gautam Prasad proposed openstack/nova-powervm master: Save management switch mac address on deploy and use on rebuild https://review.openstack.org/464554 | 03:15 |
|---|---|---|
| *** thorst_afk has quit IRC | 03:25 | |
| *** chhavi has joined #openstack-powervm | 04:15 | |
| *** shyama has joined #openstack-powervm | 04:33 | |
| *** chas has joined #openstack-powervm | 04:37 | |
| *** chas has quit IRC | 04:42 | |
| *** chas has joined #openstack-powervm | 04:58 | |
| *** lan1 is now known as lan | 04:58 | |
| *** chas has quit IRC | 05:03 | |
| *** esberglu has joined #openstack-powervm | 05:15 | |
| *** esberglu has quit IRC | 05:19 | |
| *** thorst_afk has joined #openstack-powervm | 05:22 | |
| *** thorst_afk has quit IRC | 05:26 | |
| *** edmondsw has joined #openstack-powervm | 06:53 | |
| openstackgerrit | Gautam Prasad proposed openstack/nova-powervm master: Save management switch mac address on deploy and use on rebuild https://review.openstack.org/464554 | 06:53 |
| *** chas has joined #openstack-powervm | 06:55 | |
| *** edmondsw has quit IRC | 06:57 | |
| *** k0da has joined #openstack-powervm | 06:59 | |
| *** k0da has quit IRC | 07:44 | |
| *** thorst_afk has joined #openstack-powervm | 08:24 | |
| *** thorst_afk has quit IRC | 08:29 | |
| *** YuYangWang has joined #openstack-powervm | 08:57 | |
| lan | Can anyone help with this problem: https://bugs.launchpad.net/nova-powervm/+bug/1691055 thanks! | 09:11 |
| openstack | Launchpad bug 1691055 in nova-powervm "400 error when launching an instance" [Undecided,New] | 09:11 |
| lan | 09:11 | |
| lan | chhavi, are you around, could you help me with that problem, https://bugs.launchpad.net/nova-powervm/+bug/1691055 thanks! | 09:11 |
| *** thorst_afk has joined #openstack-powervm | 09:25 | |
| *** k0da has joined #openstack-powervm | 09:37 | |
| *** thorst_afk has quit IRC | 09:44 | |
| *** a1fisher has quit IRC | 09:55 | |
| *** thorst_afk has joined #openstack-powervm | 10:41 | |
| *** thorst_afk has quit IRC | 10:45 | |
| *** thorst_afk has joined #openstack-powervm | 11:12 | |
| *** smatzek has joined #openstack-powervm | 11:20 | |
| openstackgerrit | Arun Mani proposed openstack/nova-powervm master: Remove block_migration attribute from migration rollback call https://review.openstack.org/465045 | 11:35 |
| *** svenkat has joined #openstack-powervm | 11:51 | |
| thorst_afk | chhavi: I posted a comment on https://review.openstack.org/#/c/463720/4 | 12:05 |
| thorst_afk | let me know if I'm remembering that one wrong | 12:05 |
| *** thorst_afk is now known as thorst | 12:05 | |
| chhavi | thorst: yes we will no more need the vios_uuid changes, will be handling in pypowervm | 12:20 |
| thorst | cool | 12:21 |
| thorst | so we'll need a new rev of pypowervm for the nova-powervm changes...but that should be OK | 12:21 |
| *** jpasqualetto has quit IRC | 12:23 | |
| *** edmondsw has joined #openstack-powervm | 12:35 | |
| lan | thorst, thanks for your answer in my problem. I am using HMC, not NovaLink since I am trying to manage power7 or power6 system. | 12:37 |
| *** jpasqualetto has joined #openstack-powervm | 12:37 | |
| lan | thorst, it there a way to just call HMC rest api without using NovaLink ? | 12:37 |
| lan | thorst, or other ways to manage lower version of power system? | 12:42 |
| *** kylek3h has joined #openstack-powervm | 12:42 | |
| thorst | lan: sorry for the delay. The PowerVM drivers are only compatible with Power8 (currently - later revs will of course be supported) and PowerVM NovaLink | 12:46 |
| thorst | if P7 and P6 are requirements, you should look at PowerVC | 12:46 |
| thorst | that supports HMC management and NovaLink together. | 12:47 |
| *** esberglu has joined #openstack-powervm | 12:50 | |
| lan | thorst, OK , can I just use IVM command through "ssh" , I can find this kind of code in havana release of nova code base. | 12:52 |
| thorst | that driver was dropped then and severely lacked features/support. I would strongly advise against using it. | 12:53 |
| lan | since some power customers may not by powerVC licese, right ? | 12:53 |
| lan | what's the key features/support that driver not support ? | 12:55 |
| thorst | The IVM Driver? | 12:57 |
| thorst | or the PowerVM NovaLink driver that is suppported? | 12:57 |
| lan | the IVM driver | 12:58 |
| thorst | I'm not sure. I think it could do a basic deploy. Had no neutron integration. Didn't have cinder support. Minimal glance support. | 12:58 |
| thorst | it's several years old, so it will not work on any new openstack... | 12:59 |
| thorst | none of the supported openstack releases. | 12:59 |
| *** jay1_ has joined #openstack-powervm | 12:59 | |
| thorst | I'm not really sure, I didn't work on it...I reviewed the code at one point...but it was like a couple hundred line driver. It was quite lacking. | 12:59 |
| lan | yes, you are right. How can I make PowerVC come into use ? Firstly setup PowerVC env and then use nova-powervc driver? | 13:00 |
| thorst | well, a PowerVC environment deploys the drivers and everything for you | 13:01 |
| thorst | it is an OpenStack | 13:01 |
| thorst | (FYI - we have a driver meeting starting in a minute here) | 13:01 |
| lan | OK, thank you so much!!! : ) | 13:01 |
| esberglu | #startmeeting powervm_driver_meeting | 13:01 |
| openstack | Meeting started Tue May 16 13:01:52 2017 UTC and is due to finish in 60 minutes. The chair is esberglu. Information about MeetBot at http://wiki.debian.org/MeetBot. | 13:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 13:01 |
| openstack | The meeting name has been set to 'powervm_driver_meeting' | 13:01 |
| edmondsw | o/ | 13:02 |
| esberglu | #topic In Tree Driver | 13:02 |
| efried | o/ | 13:03 |
| thorst | \o | 13:03 |
| efried | No progress | 13:03 |
| efried | obviously nothing was going to happen during the summit. | 13:03 |
| esberglu | Yep that's what I thought. Anything to discuss here? | 13:03 |
| efried | And at this point I wanna give everyone a bit to calm back down. | 13:03 |
| efried | Nope. I'll look for an opportune time to pester again. | 13:03 |
| esberglu | #topic Out-of-tree Driver | 13:04 |
| thorst | lots of reviews out. PowerVC team has been pushing up some solid patches | 13:04 |
| thorst | I sent efried a list to review | 13:04 |
| efried | #action efried to do those | 13:05 |
| thorst | chhavi has also been driving a ton of the iSCSI work. She found a ton of issues that needed to be worked, changes in the REST itself, etc... | 13:05 |
| thorst | so great work chhavi...many many thanks | 13:05 |
| efried | +1 | 13:05 |
| thorst | I'm basically working on core issues with the QCOW handler | 13:07 |
| thorst | but they're transparent to the OpenStack driver | 13:07 |
| efried | I have a couple of topics for the driver in general, came out of the summit. Let's have a separate "Summit takeaways" topic later. | 13:07 |
| thorst | k | 13:07 |
| thorst | I think that's all I had. | 13:07 |
| esberglu | I'm still continuing to work in-tree backports as able. Nothing else from me | 13:07 |
| *** edmondsw_ has joined #openstack-powervm | 13:08 | |
| efried | CI? | 13:08 |
| esberglu | #topic PowerVM CI | 13:08 |
| esberglu | My #1 priority this week is identifying/opening/fixing bugs that are causing tempest tests | 13:08 |
| *** mdrabe has joined #openstack-powervm | 13:09 | |
| *** edmondsw has quit IRC | 13:09 | |
| *** edmondsw_ has quit IRC | 13:09 | |
| *** edmondsw has joined #openstack-powervm | 13:09 | |
| esberglu | There are still some in-tree tests that fail occaisonally because of other networks that exist from other tests during the time they are running | 13:09 |
| esberglu | And a handful of problematic tests for OOT | 13:10 |
| *** YuYangWang has quit IRC | 13:10 | |
| esberglu | Other than that I'm still working the systemd change. It's looking good for the most part. | 13:10 |
| efried | I'd still like a systemd'd setup to noodle around with. | 13:11 |
| efried | I've got some definite comments queued up for 5245; but will have more once I've had a chance to play. | 13:11 |
| esberglu | However the n-dhcp service looks like it is still getting started with screen, which doesn't work with the logserver changes | 13:11 |
| esberglu | Haven't got into a node to play around with it yet. | 13:12 |
| thorst | that systemd thing is weird | 13:12 |
| thorst | I'm not sure I'm a fan of getting rid of screen. | 13:12 |
| thorst | but that may just be that I'm so used to screen. | 13:12 |
| efried | thorst Totally agree. I'm old, and not a fan of change. But I think once we get used to it, it'll be better. | 13:13 |
| efried | The one thing I'm going to miss the most is the coloring. | 13:13 |
| thorst | totes...but grumble in the mean time | 13:13 |
| efried | Hopefully we figure out how to get colors. | 13:13 |
| esberglu | efried: I can spin you up a node on the prod. cloud. I'm gonna be tearing the staging down a bunch this week | 13:13 |
| efried | I don't see why we can't still throw color codes into journald - mebbe it doesn't allow them? | 13:14 |
| thorst | I thought I was seeing it... | 13:14 |
| efried | thorst Where? We haven't produced anything with journald yet, have we? | 13:14 |
| thorst | chhavi's env | 13:15 |
| thorst | iscsi debug | 13:15 |
| efried | Anyway, converged logs plus the "traveling request-id" stuff jaypipes is working on ought to make debugging much nicer. | 13:15 |
| thorst | traveling request-id? Sounds beautiful | 13:16 |
| thorst | almost as nice as the service token stuff | 13:16 |
| edmondsw | it's related, actually | 13:16 |
| edmondsw | dependent on service tokens... so another reason to love those | 13:17 |
| thorst | heh, you know how much I love security discussions... | 13:17 |
| thorst | anywho... | 13:18 |
| thorst | anything else here? | 13:18 |
| esberglu | Backlog of small CI issues as always. But nothing noteworthy | 13:18 |
| esberglu | #topic Driver Testing | 13:19 |
| efried | thorst #link https://review.openstack.org/#/c/464746/ | 13:19 |
| efried | ^^ request-id spec | 13:19 |
| *** dwayne has joined #openstack-powervm | 13:20 | |
| esberglu | Any issues or updates on the manual driver testing? | 13:20 |
| efried | jay1_ ^^ ? | 13:21 |
| efried | FYI guys, I gotta jump in about 20 minutes. My #3 has a track meet. (He's running the hurdles, like his ol' dad used to do ;-) | 13:23 |
| efried | Can we move on, and come back to jay1_ later? | 13:23 |
| esberglu | Alright moving on. | 13:23 |
| esberglu | #topic Open Discussion | 13:24 |
| efried | Okay, couple things came out of the summit that I wanted to document for the sake of having 'em in writing (read: before I forget all about 'em) | 13:24 |
| efried | First, placement and SR-IOV. Talked with jaypipes; he agrees PCI stuff is totally broken, and would definitely be in the corner of anyone "volunteering" to fix it. | 13:25 |
| efried | He seemed at least superficially sympathetic to the fact that the existing model doesn't work at all for us (or anyone who's not running on the hypervisor - access to /dev special files, pre-creation of VFs, etc.) | 13:26 |
| efried | So this would be an opportunity for us to a) fix our SR-IOV story; and b) look good in the community. | 13:26 |
| edmondsw | +1 | 13:27 |
| edmondsw | that should definitely be on our TODO list | 13:27 |
| efried | Second, resource groups. Today, if we have 5 compute nodes all on the same SSP which has, say, 20GB of free space, and you ask the conductor how much storage you have in your cloud, it answers 5x20GB, cause it doesn't know any better. | 13:27 |
| jay1_ | efried: the update on the ISCSI verification, issue is there with attach/detach. | 13:28 |
| jay1_ | https://jazz07.rchland.ibm.com:13443/jazz/web/projects/NEO#action=com.ibm.team.workitem.viewWorkItem&id=174342 | 13:28 |
| efried | jay1_ Hold on, we'll come back to that. | 13:28 |
| edmondsw | I thought there was a concept of shared resources... are we not signaling something correctly there? | 13:28 |
| efried | There's a spec to define resource groups within placement, seems to be mostly done. This would allow you to register the fact that all of those computes are on the same SSP, and the math would fix itself. | 13:28 |
| edmondsw | ah... so still in the works. Is the spec almost done, or the implementation? | 13:29 |
| efried | bah, I'll have to find that spec later, I've got it here somewhere. | 13:29 |
| efried | edmondsw I think the code is ready for use. | 13:29 |
| efried | So the thing is: | 13:29 |
| efried | The user can define the resource group by running commands. In that picture, we don't have to do anything - but it's the responsibility of the user to get it right. | 13:30 |
| efried | However, there's a way we can tie into the placement API with code and set up this resource group ourselves from within our driver. | 13:30 |
| efried | Like, when get_inventory is called. | 13:31 |
| edmondsw | yeah, we don't want users having to do that | 13:31 |
| efried | Roughly, from get_inventory, we would check whether the SSP is registered (hopefully we're allowed to specify its UUID). If not, register it from this host. If so (and this might be a no-op), add this host to it. | 13:32 |
| efried | jaypipes volunteered to show me where that code is, but he's in China this week, so I'll follow up next week. | 13:32 |
| efried | Those were the two major takeaways from the summit. | 13:33 |
| efried | from me. | 13:33 |
| efried | to-dos, I should say. I had much more takeaway than that. | 13:33 |
| edmondsw | :) | 13:33 |
| *** smatzek has quit IRC | 13:33 | |
| edmondsw | thanks, efried | 13:33 |
| edmondsw | esberglu did you get a chance to look at that etcd stuff and see whether it would impact us? | 13:34 |
| edmondsw | or more likely, how? | 13:34 |
| esberglu | That totally slipped my mind. Adding it to the list now | 13:35 |
| efried | Also on the backlog of driver work to be done (these have been hanging out for a while, but I may as well mention them here to get them on record): | 13:37 |
| efried | o Implement get_inventory(). This replaces get_available_resource(). | 13:37 |
| efried | o Make the compute driver mark the host unavailable if the REST API is | 13:37 |
| efried | busted. | 13:37 |
| efried | o Subsume HttpNotFound exception - now available via pypowervm 1.1.4, | 13:37 |
| efried | which is through global-reqs. | 13:37 |
| edmondsw | efried that's all for the IT driver, right? | 13:38 |
| efried | Both. | 13:38 |
| edmondsw | ah, true | 13:38 |
| efried | Oh, also need to keep an eye on https://review.openstack.org/#/c/452958/ and remove that arg from our destroy method when it merges. | 13:39 |
| edmondsw | efried why isn't that fixing the IT driver as part of the patch? | 13:40 |
| thorst | I love the idea to mark the driver down if the REST API isn't working | 13:40 |
| efried | edmondsw Was just about to -1 for that. | 13:40 |
| edmondsw | good | 13:40 |
| *** shyama has quit IRC | 13:40 | |
| edmondsw | should we go back to the iSCSI testing now? | 13:41 |
| *** shyama has joined #openstack-powervm | 13:42 | |
| esberglu | Sure. I didn't have anything else | 13:42 |
| edmondsw | #topic iSCSI testing | 13:42 |
| efried | Gotta bounce - I'll have to catch up on the iSCSI stuff later. (I think I may have some to-dos wrt scrubbers there.) | 13:42 |
| edmondsw | bye efried | 13:43 |
| edmondsw | jay1_ ready to talk about iSCSI testing now | 13:43 |
| jay1_ | sure; so far the progress is that we are able to do successful deploy without NW | 13:44 |
| jay1_ | attach/detach issue is still getting fixed | 13:44 |
| *** apearson has joined #openstack-powervm | 13:45 | |
| jay1_ | the next target would be to try LPM. | 13:45 |
| edmondsw | jay1_ this is with a CHAP secret configured but not using CHAP, is that right? | 13:46 |
| thorst | multi attach has REST issues as well | 13:46 |
| edmondsw | I spoke to gfm about the CHAP issues... sounds like a couple different problems we're trying to track down and get fixed | 13:46 |
| edmondsw | glad you were able to work around that in the meantime | 13:46 |
| edmondsw | jay1_ is the bug you linked above the only other issue we're seeing? | 13:47 |
| edmondsw | do we have a bug for the CHAP issues? | 13:47 |
| jay1_ | edmondsw: yes we are not using CHAP yet | 13:48 |
| chhavi | edmondsw: currently we have the CHAP disabled for SVC, | 13:48 |
| chhavi | edmondsw: reason why i disabled CHAP, we were having discovery issues if we enable CHAP | 13:49 |
| thorst | working the multi attach, lpm, then chap can come in | 13:49 |
| edmondsw | thorst +1 | 13:49 |
| thorst | just chipping away at all the edge cases | 13:49 |
| chhavi | edmondsw: reason is on neo34 iscsid.conf CHAP is not configured | 13:49 |
| edmondsw | I'm trying to work CHAP in parallel with the storage guys, but that shouldnt' be focus for jay1_ or chhavi right now | 13:49 |
| chhavi | yeah, for us we have put CHAP on the side for now, and just playing with attach/detach | 13:50 |
| edmondsw | what's the latest on the attach issues? | 13:50 |
| jay1_ | https://jazz07.rchland.ibm.com:13443/jazz/web/projects/NEO#action=com.ibm.team.workitem.viewWorkItem&id=174342 | 13:50 |
| chhavi | currently the issue which I am seing is, if I am trying to attach say 2 volumes on the VM. the second volume is not getting discovered correctly | 13:50 |
| jay1_ | we have other open defect as well | 13:50 |
| thorst | jay1_: as noted earlier, please don't put links to internal IBM sites in here :-) | 13:51 |
| thorst | but that issue is for multi-attach | 13:51 |
| chhavi | the problem which i suspect is, while we do the discover we just do iscsiadm login, i am trying to find, where we can use lun id to identify the correct lun on the same target | 13:51 |
| chhavi | thorst: this is not multiattach | 13:52 |
| thorst | ooo | 13:52 |
| thorst | its just straight detach | 13:52 |
| jay1_ | thorst: sure .. | 13:52 |
| chhavi | multiattach means, same volume on multiple VM | 13:52 |
| thorst | ahh, sorry I meant multiple volumes on same vm | 13:52 |
| edmondsw | chhavi if we only attach/detach one volume, things work, but if we attach/detach a second volume we have issues... is that correct? | 13:53 |
| chhavi | yeah | 13:53 |
| edmondsw | chhavi have you spoken to the owner of that bug? Do they have any ideas on how to fix it? | 13:54 |
| chhavi | another use case which i have seen, is we have 2 VM's on the same host, and if u try to attach one volume on each VM, it does not discover that as well | 13:54 |
| thorst | edmondsw: changch is aware. He's got a backlog himself that he's working through unfortunately | 13:55 |
| thorst | maybe nvcastet can help him out | 13:55 |
| chhavi | i am waiting for hsien to come, and i am also checking parallely how to do iscidisovery using lun-id | 13:55 |
| chhavi | by the time, i am updating my pypowervm review with exception handling, too many stuff's in parallel :) | 13:55 |
| *** smatzek has joined #openstack-powervm | 13:57 | |
| thorst | chhavi: yeah, we probably need to just list out the active items there. Maybe a etherpad would help keep track of it all | 13:57 |
| thorst | but we know we'll at least need a new pypowervm rev when all said and done | 13:57 |
| edmondsw | we're at the top of the hour... any last words? | 13:59 |
| esberglu | Thanks for joining | 14:00 |
| esberglu | #endmeeting | 14:00 |
| openstack | Meeting ended Tue May 16 14:00:32 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2017/powervm_driver_meeting.2017-05-16-13.01.html | 14:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2017/powervm_driver_meeting.2017-05-16-13.01.txt | 14:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2017/powervm_driver_meeting.2017-05-16-13.01.log.html | 14:00 |
| *** jay1_ has quit IRC | 14:05 | |
| *** tjakobs has joined #openstack-powervm | 14:34 | |
| *** mdrabe has quit IRC | 14:35 | |
| *** mdrabe has joined #openstack-powervm | 14:41 | |
| *** chas has quit IRC | 15:01 | |
| *** chas has joined #openstack-powervm | 15:02 | |
| *** YuYangWang has joined #openstack-powervm | 15:06 | |
| *** chas has quit IRC | 15:06 | |
| *** chas has joined #openstack-powervm | 15:22 | |
| *** chas has quit IRC | 15:27 | |
| esberglu | efried: Hitting an issue with power-off/destroy in the CI. Here's the error we are seeing | 15:38 |
| esberglu | HTTP error 500 for method DELETE on path /rest/api/uom/LogicalPartition/72E42FB1-FE45-4A05-9DC9-B59FB0D809C1: Internal Server Error -- [PVME01050010-0056] This task is only allowed when the partition is powered off. | 15:38 |
| esberglu | So I looked through the power off flow in the logs | 15:38 |
| efried | esberglu What version of pypowervm? | 15:38 |
| *** kriskend has joined #openstack-powervm | 15:38 | |
| efried | oh, never mind, reread the message. | 15:39 |
| esberglu | efried: Whatever the upper constraint is right now it pulls it each time (1.1.4?) | 15:39 |
| efried | So yeah, look a little earlier and see if we caught and ignored PVME01050901 | 15:39 |
| efried | ...for the power-off | 15:39 |
| esberglu | What I'm seeing for power off is that it goes through and tries to power off. The first fails the os_shutdown because the RMC connection is not active | 15:40 |
| esberglu | Then it goes through and tries power off again | 15:40 |
| esberglu | At this point it says that power off is not required for the instance (I think the state at this point is not activated) | 15:41 |
| esberglu | So it seems that it is getting to a state that is considered "powered off" but where you can't destroy | 15:42 |
| esberglu | efried: Not seeing PVME01050901 in the logs | 15:42 |
| efried | esberglu I wonder if we're just not logging that. | 15:42 |
| efried | Checking... | 15:42 |
| efried | Okay, we should see a WARN like "Partition %s already powered off." | 15:43 |
| efried | Do you see that? | 15:43 |
| efried | I should print the code in there. | 15:43 |
| *** chas has joined #openstack-powervm | 15:43 | |
| efried | I'm paranoid that we just added PVME01050901 to the ignore list, but it may not have been appropriate to do so. | 15:44 |
| esberglu | efried: This is running 1.1.2, not 1.1.4 I lied | 15:48 |
| *** chas has quit IRC | 15:48 | |
| efried | Okay, even so, if that code were a problem, it would be showing up as a failure on the power-off, not on the delete. | 15:48 |
| efried | esberglu Are you seeing "Partition %s already powered off." ? | 15:49 |
| esberglu | efried: No I'm not | 15:49 |
| esberglu | http://184.172.12.213/87/435387/23/check/nova-out-of-tree-pvm/a7f8cdb/ | 15:50 |
| esberglu | If you look for 08:35:49.002 | 15:50 |
| esberglu | You can see where the power off flow starts | 15:51 |
| esberglu | Instance ID: 72e42fb1-fe45-4a05-9dc9-b59fb0d809c1 | 15:51 |
| esberglu | Instance name: pvm4-tempest-Ser-72e42fb1 | 15:51 |
| *** chas has joined #openstack-powervm | 16:04 | |
| *** chas has quit IRC | 16:09 | |
| *** chas has joined #openstack-powervm | 16:25 | |
| *** jwcroppe has quit IRC | 16:29 | |
| *** chas has quit IRC | 16:29 | |
| *** jwcroppe has joined #openstack-powervm | 16:37 | |
| chhavi | thorst, efried: we need to have a call to discuss on the iscsi changes needed in the rest layer | 16:37 |
| *** k0da has quit IRC | 16:44 | |
| *** chas has joined #openstack-powervm | 16:46 | |
| *** chas has quit IRC | 16:50 | |
| efried | esberglu Ahahahahahahahaaaaa! | 16:54 |
| efried | Add -a to journalctl and you get COLORS! | 16:54 |
| chhavi | thorst, efried: i have started one new etherpad, how to add the members to view it | 16:57 |
| chhavi | https://etherpad.openstack.org/p/powervm-iscsi | 16:57 |
| efried | chhavi Nothing special needed. Just openID login. I can read & write it. | 16:58 |
| chhavi | are u able to view the discussion on etherpad | 16:59 |
| efried | yes | 17:00 |
| chhavi | so thats the summary of the discussion | 17:03 |
| *** chas has joined #openstack-powervm | 17:07 | |
| *** chas has quit IRC | 17:11 | |
| esberglu | efried: Does that work for outputting to files too? | 17:21 |
| efried | esberglu Yes... but it's not going to help us much (except with pypowervm/nova_powervm lines) because they switched off colors in devstack. I'm working with sdague to fix it for the world. | 17:22 |
| esberglu | efried: Alright keep me posted | 17:26 |
| efried | ack | 17:27 |
| efried | esberglu Actually, do you have a way I can noodle with the devstack source before you stack, and then stack and test? | 17:27 |
| *** chas has joined #openstack-powervm | 17:28 | |
| esberglu | You can just unstack the one you are using right? Otherwise I can spin you up a new one and not stack it | 17:28 |
| *** shyama has quit IRC | 17:28 | |
| *** chas has quit IRC | 17:32 | |
| *** chhavi has quit IRC | 17:34 | |
| efried | esberglu Okay, I'll try to unstack. | 17:38 |
| efried | esberglu Do I do that as powervmci or jenkins? | 17:39 |
| esberglu | jenkins | 17:39 |
| efried | thx | 17:39 |
| *** chhavi has joined #openstack-powervm | 17:52 | |
| edmondsw | esberglu even if you assume "This task is only allowed with the partition is powered off" is the correct error message, it shouldn't be an HTTP 500... that should be an HTTP 400. | 18:08 |
| *** chas has joined #openstack-powervm | 18:09 | |
| *** chas has quit IRC | 18:14 | |
| *** kriskend has quit IRC | 18:15 | |
| *** openstackgerrit has quit IRC | 18:17 | |
| thorst | efried: did you have a chance to go through (or will you have a chance to go through) that list of reviews I sent earlier? | 18:27 |
| thorst | I'd like to get them through for PowerVC | 18:27 |
| efried | thorst Haven't yet. Distracted. Can do now. | 18:27 |
| thorst | thx | 18:27 |
| *** chhavi has quit IRC | 18:29 | |
| *** kriskend has joined #openstack-powervm | 18:29 | |
| esberglu | efried: Is "Not activated" the state we would expect after powering off? | 18:29 |
| efried | esberglu Yeah. | 18:29 |
| efried | I looked through those logs you sent me earlier and I can't see where we went wrong. | 18:30 |
| efried | We've seen this before, though, I believe. | 18:30 |
| efried | This fails intermittently, not all the time, right? | 18:30 |
| esberglu | Yeah on and off | 18:30 |
| *** chas has joined #openstack-powervm | 18:30 | |
| esberglu | Every time we look into it something larger seems to break in CI | 18:31 |
| efried | Clearly a timing thing. Wonder if it's a UUID conflict with the instance we're rebuilding vs. the one we're rebuilding from. | 18:31 |
| *** openstackgerrit has joined #openstack-powervm | 18:33 | |
| openstackgerrit | Merged openstack/nova-powervm master: Update host cpu util calculation to consider idle proc cycles https://review.openstack.org/460078 | 18:33 |
| *** chas has quit IRC | 18:35 | |
| efried | thorst Reviews done. | 18:41 |
| thorst | hugs | 18:41 |
| thorst | how was the summit? | 18:41 |
| openstackgerrit | Merged openstack/nova-powervm master: Save management switch mac address on deploy and use on rebuild https://review.openstack.org/464554 | 18:48 |
| *** chas has joined #openstack-powervm | 18:51 | |
| *** k0da has joined #openstack-powervm | 18:53 | |
| *** chas has quit IRC | 18:56 | |
| efried | esberglu https://review.openstack.org/#/c/465147/ | 19:00 |
| efried | thorst Kick ass. I got SO much more out of it this time. | 19:00 |
| thorst | :-) | 19:01 |
| thorst | good | 19:01 |
| efried | thorst I got log colors back ;-) | 19:08 |
| thorst | oo | 19:09 |
| *** chas has joined #openstack-powervm | 19:12 | |
| *** chas has quit IRC | 19:16 | |
| *** YuYangWang has quit IRC | 19:24 | |
| efried | thorst https://review.openstack.org/#/c/465147/ | 19:27 |
| esberglu | efried: Cool. Saw your comment about the systemd changes. Doing a manual run with the improved commands for sanity. Then I think that should be good to go | 19:30 |
| efried | esberglu You're doing a manual run with the devstack change set? | 19:30 |
| esberglu | Nah just with your improved bash | 19:30 |
| efried | oh, that. | 19:31 |
| efried | Okay, good deal. | 19:31 |
| esberglu | I can also do a run with your devstack change if you want | 19:31 |
| efried | esberglu Actually, yeah, let's do that. Cause one of my suggestions was to include -a in the journalctl command. So including the devstack change set as well will give us end-to-end proof that the colors come through. | 19:32 |
| *** chas has joined #openstack-powervm | 19:33 | |
| esberglu | Yeah I can get them both in one run | 19:33 |
| esberglu | So no problem | 19:33 |
| *** chas has quit IRC | 19:37 | |
| *** chas has joined #openstack-powervm | 19:54 | |
| efried | esberglu Have you started that yet? | 19:56 |
| esberglu | efried: Yeah it's stacking right now | 19:57 |
| efried | k. One more patch set coming into the devstack change, but should be a no-op. | 19:57 |
| esberglu | ok | 19:57 |
| *** chas has quit IRC | 19:59 | |
| efried | esberglu Oh, hey, did you look at that `=-` thing too? Was that bogus? | 20:06 |
| esberglu | efried: You mean when setting EnvironmentFile? | 20:08 |
| efried | esberglu Yeah | 20:08 |
| esberglu | That's needed | 20:08 |
| esberglu | Can't remember why off the top of my head, but I know if was needed | 20:08 |
| efried | weird | 20:10 |
| esberglu | At least I think it was needed. There was some note about it in whatever I was following to set that var | 20:10 |
| *** chas has joined #openstack-powervm | 20:15 | |
| esberglu | efried: Manual runs don't copy the logs to the logserver. So you won't have a link to logs like normal CI runs have | 20:17 |
| *** chas has quit IRC | 20:19 | |
| esberglu | efried: Ok found it. The - makes it so that it doesn't error out if the path supplied doesn't exist | 20:22 |
| esberglu | Which maybe we don't actually want? Because if that file doesn't exist in CI, remote is broken | 20:23 |
| mdrabe | I assumed that "-" was alright since I saw it in other .service files | 20:24 |
| mdrabe | Might be for files that are "to be created" | 20:25 |
| esberglu | Shouldn't really matter for CI since we know /etc/environment exists since we create it earlier | 20:27 |
| *** thorst has quit IRC | 20:31 | |
| *** chas has joined #openstack-powervm | 20:36 | |
| *** smatzek has quit IRC | 20:38 | |
| *** kriskend has quit IRC | 20:40 | |
| *** chas has quit IRC | 20:40 | |
| efried | esberglu Okay, either way is fine by me. | 20:46 |
| efried | esberglu Can you copy the logs out manuall? | 20:46 |
| efried | y | 20:46 |
| esberglu | efried: You can just scp from the node. That good enough for your purposes? | 20:50 |
| efried | esberglu Yes; though I'd like to put it somewhere public (and perhaps even semi-permanent) so I can link it from the change set. | 20:51 |
| *** thorst has joined #openstack-powervm | 20:51 | |
| edmondsw | efried nice job with the nova patch adding colors back | 20:51 |
| efried | edmondsw Thanks | 20:52 |
| edmondsw | s/nova/devstack | 20:52 |
| *** kriskend has joined #openstack-powervm | 20:55 | |
| *** thorst has quit IRC | 20:55 | |
| *** chas has joined #openstack-powervm | 20:56 | |
| *** thorst has joined #openstack-powervm | 20:59 | |
| *** chas has quit IRC | 21:01 | |
| *** thorst has quit IRC | 21:02 | |
| *** kriskend_ has joined #openstack-powervm | 21:04 | |
| *** kriskend has quit IRC | 21:04 | |
| *** k0da has quit IRC | 21:09 | |
| *** thorst has joined #openstack-powervm | 21:11 | |
| *** apearson has quit IRC | 21:12 | |
| *** svenkat has quit IRC | 21:13 | |
| *** chas has joined #openstack-powervm | 21:17 | |
| *** chas has quit IRC | 21:22 | |
| *** k0da has joined #openstack-powervm | 21:25 | |
| *** chas has joined #openstack-powervm | 21:38 | |
| *** chas has quit IRC | 21:43 | |
| *** dwayne has quit IRC | 21:45 | |
| *** thorst has quit IRC | 21:51 | |
| *** esberglu has quit IRC | 21:53 | |
| *** mdrabe has quit IRC | 21:57 | |
| *** k0da has quit IRC | 21:57 | |
| *** chas has joined #openstack-powervm | 21:59 | |
| *** edmondsw has quit IRC | 21:59 | |
| *** edmondsw has joined #openstack-powervm | 22:00 | |
| *** kriskend_ has quit IRC | 22:02 | |
| *** chas has quit IRC | 22:03 | |
| *** edmondsw has quit IRC | 22:04 | |
| *** chas has joined #openstack-powervm | 22:20 | |
| *** chas has quit IRC | 22:24 | |
| *** chas has joined #openstack-powervm | 22:41 | |
| *** chas has quit IRC | 22:45 | |
| *** tjakobs has quit IRC | 22:48 | |
| *** chas has joined #openstack-powervm | 23:02 | |
| *** chas has quit IRC | 23:06 | |
| *** dwayne has joined #openstack-powervm | 23:22 | |
| *** chas has joined #openstack-powervm | 23:22 | |
| *** chas has quit IRC | 23:27 | |
| *** chas has joined #openstack-powervm | 23:43 | |
| *** chas has quit IRC | 23:48 | |
| *** thorst has joined #openstack-powervm | 23:51 | |
| *** thorst has quit IRC | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!