Tuesday, 2018-08-07

*** esberglu has quit IRC03:33
*** esberglu has joined #openstack-powervm03:35
*** esberglu has quit IRC03:40
*** esberglu has joined #openstack-powervm03:41
*** esberglu has quit IRC03:45
*** esberglu has joined #openstack-powervm04:07
*** esberglu has quit IRC04:15
*** esberglu has joined #openstack-powervm06:03
*** esberglu has quit IRC06:08
*** esberglu has joined #openstack-powervm06:33
*** esberglu has quit IRC06:38
*** esberglu has joined #openstack-powervm06:54
*** esberglu has quit IRC06:58
*** esberglu has joined #openstack-powervm07:34
*** esberglu has quit IRC07:39
*** esberglu has joined #openstack-powervm08:15
*** esberglu has quit IRC08:20
*** esberglu has joined #openstack-powervm08:46
*** esberglu has quit IRC08:51
*** esberglu has joined #openstack-powervm09:06
*** esberglu has quit IRC09:11
*** esberglu has joined #openstack-powervm10:21
*** esberglu has quit IRC10:29
*** esberglu has joined #openstack-powervm10:31
*** esberglu has quit IRC10:35
*** esberglu has joined #openstack-powervm11:00
*** esberglu has quit IRC11:05
*** edmondsw has joined #openstack-powervm12:04
*** esberglu has joined #openstack-powervm12:32
*** esberglu has quit IRC12:36
*** esberglu has joined #openstack-powervm13:33
edmondswefried can you get to your neo yet?13:52
efried...13:52
efriednope13:52
*** mujahidali has joined #openstack-powervm13:53
edmondswboo13:53
edmondswI think most everything else is back up, so you may need to open a ticket13:53
efriedWhat would I do with the fsp IP to see if the system is up?13:55
efriedthe fsp doesn't ping, fwiw. Not sure if it's supposed to.13:57
edmondswefried you would login to it in the web (making sure to use https, not http... they don't have a redirect, so http will fail) and use it to boot the system14:00
edmondswbut looks like your FSP is not reachable in the web either (and I think they do normally ping)14:00
edmondsw#startmeeting PowerVM Driver Meeting14:01
openstackMeeting started Tue Aug  7 14:01:04 2018 UTC and is due to finish in 60 minutes.  The chair is edmondsw. Information about MeetBot at http://wiki.debian.org/MeetBot.14:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:01
openstackThe meeting name has been set to 'powervm_driver_meeting'14:01
efriededmondsw: I'm going to be late, gotta step away for 10.14:01
edmondswefried ack14:01
edmondswlink: https://etherpad.openstack.org/p/powervm_driver_meeting_agenda14:01
edmondswmdrabe mujahidali you around?14:02
mujahidaliyes14:02
mdrabeyep14:02
edmondswalright, we'll go ahead and get started and efried can catch up14:02
edmondsw#topic In-Tree Driver14:03
edmondswI don't have anything to discuss here... anyone else?14:03
edmondswesberglu did all the blueprints you completed get marked as such?14:04
esbergluedmondsw: I think so. I'll verify and let you know14:04
edmondswtx14:04
edmondswI was hoping that we would be able to do a little more work on vSCSI (multiattach and bfv) but I think we've run out of time there14:05
edmondswso I think that can be marked complete and we'll have to pick up in a later release14:05
edmondswsame for localdisk (image caching)14:06
edmondsw#topic Out-of-Tree Driver14:06
edmondsw#link https://etherpad.openstack.org/p/powervm-oot-todos14:06
edmondswthe switch from fileio to loop merged: https://review.openstack.org/#/c/568374/14:07
edmondswand we got networking-powervm fixed https://review.openstack.org/#/c/588096/ after a recent neutron change14:08
edmondswand updated to use neutron-lib 1.18 https://review.openstack.org/#/c/585469/14:08
efriedō/ Sorry about that.14:09
edmondswnp14:09
edmondswI think the top remaining item for OOT is getting the docs fixed14:09
edmondswbut I haven't had time to spend on that14:09
edmondswso hopefully this week14:09
edmondswany other comments for OOT?14:09
edmondswoh mdrabe I'm still trying to get a dual-node devstack for you to test MSP14:10
edmondswbeen trying to kill many birds with one stone there, and it's been painful. Lab outages haven't been helping either14:10
mdrabeYup thanks for letting me know14:11
edmondswthe good news is that when I get it working, we should be able to devstack much easier in future14:11
edmondswWHEN I get working14:11
edmondsw#topic Device Passthrough14:11
edmondswefried take it away14:11
efriedWorked a bit more code yesterday, now three patches in the series, bottom two ready (ish). I keep revising earlier patches as I work on later ones, so expect some continuing churn, but feel free to put eyes on the code.14:12
efriedThe topic has been getting some attention from others - currently discussing with CERN in #openstack-nova, who wants to help contribute to the effort by writing a similar spec for Nova for Stein.14:13
edmondswinteresting14:14
efriedFor libvirt, obviously, but this would be great exposure, good to have others reviewing and contributing mind share, good to have CERN flushing out stuff that applies to huge deployments, etc.14:14
efriedThis is clearly what we were going for eventually anyway - having a generic device passthrough framework in nova proper - so it's a nice to have the prospect of not doing all the work ourselves :)14:15
edmondswI definitely don't want it all powervm-specific14:16
edmondswor any more than it has to be14:16
efriedright, for sure. E.g. the traits, I'm thinking some of those will be common, but e.g. drc name/index will be power-specific. We'll need to figure all that out.14:17
edmondswyep14:17
efriedI suspect there will be some overlap in the traits, but we've "prepared" by namespacing ours with _POWERVM_ so if that happens, it'll be okay.14:17
efriedanyway, good to be getting attention from outside of powervm, is what I'm getting at.14:17
efried#link bottom of device passthrough series https://review.openstack.org/#/c/579289/14:18
efriedThat's it for me, unless questions/comments/concerns14:18
edmondswsounds good, thanks14:19
edmondsw#topic PowerVM CI14:19
edmondsw#link https://etherpad.openstack.org/p/powervm_ci_todos14:20
edmondswmujahidali ^14:20
edmondswfirst, how is the CI looking after the outage?14:20
mujahidaliI redeployed the copmplete CI and it's looking fine now.14:20
edmondsw\o/14:20
esbergluWe're in the green again! :)14:20
edmondswhelps when neutron doesn't kick us while we're down14:21
esbergluWhat's next here? Finishing up the stable vSCSI?14:22
mujahidaliI tried to stack the stage env for multinode setup, but when I posted a comment "powervm:recheck" I didn't see any job triggered on jenkins.14:22
esberglumujahidali: Did you check the zuul logs? And the zuul merger logs? That's where I usually start if runs aren't getting kicked off properly14:23
esbergluZuul is responsible for monitoring gerrit for the powervm:recheck comments and kicking off jobs14:23
mujahidaliI saw zuul merger logs and I think there is some repo cloning problem.14:24
edmondswis this related to that one VM that you wanted to resize with more disk?14:25
mujahidalino, it's on the other vm.14:25
esbergluedmondsw: If you're resizing that one, the staging openstack controller, I would also resize the production controller14:26
edmondswesberglu mujahidali I haven't figured out how to resize it14:26
esbergluCould also experiment with smaller images than 30G14:27
edmondswnot top of my priority list atm... not knowing what this is affecting14:27
esbergluTo change the size of the default image all you need to do is change the powervm.large flavor in neo-os-ci/ci-ansible/roles/devstack-control/tasks/main.yml14:28
edmondswand then redeploy to clear out the old ones?14:28
esbergluYeah you would have to redeploy cloud and management14:29
edmondswthat should be something mujahidali can try14:29
mujahidaliI will give it a try on stage env.14:29
edmondswright, I meant redeploy staging14:29
mujahidaliyes14:30
esberglumujahidali: We used to use 16G images which were too small. I don't know why we went to 30G. I'd try somewhere in the middle14:30
edmondswmaybe 25GB ?14:30
esbergluCutting to 25GB would save 20G of space on the system14:31
edmondswright14:31
mujahidaliI think I just need to change the disk option to 25 and redeploy the stage env esberglu??14:32
esbergluYep. Change the powervm.large flavor size in that file I posted above and redeploy14:32
esbergluedmondsw: Something else I was thinking about. Right now the vSCSI CI run is on demand only14:32
mujahidaliyeah, got it.14:32
esbergluWhich means it is essentially never being run14:33
esbergluMight be nice to have some sort of scheduled runs just to verify it isn't breaking14:33
esbergluOnce a week or however often you think is reasonable14:33
edmondswesberglu agreed14:33
edmondswI'll add that to the todo list mujahidali14:33
mujahidaliokay14:34
esbergluHas any progress been made on stable vSCSI? I left some comments on that patch, but idk if the fixes were ever attempted with all of the outages14:34
esbergluLet me know if you guys have any questions/issues going forward there14:35
mujahidaliwe were able to stack and there were some tempest failure for stable/ocata, that we weren't able to resolved dut to lab outages.14:35
esbergluWe're carrying this patch in CI14:37
esbergluhttps://review.openstack.org/#/c/565239/14:37
esbergluI keep forgetting about it and they've requested a few more changes14:38
esbergluI'll try to get to it sometime this week14:38
esbergluThat's all I had today14:38
edmondswesberglu tx14:38
edmondswmujahidali anything else?14:39
mujahidalinope14:39
edmondsw#topic Open Discussion14:39
edmondswanyone have anything here?14:39
efriedI'll be asking you how to "open a ticket"14:40
efriedotherwise, nothing from me.14:40
edmondswack14:41
edmondsw#endmeeting14:41
openstackMeeting ended Tue Aug  7 14:41:09 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:41
openstackMinutes:        http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2018/powervm_driver_meeting.2018-08-07-14.01.html14:41
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2018/powervm_driver_meeting.2018-08-07-14.01.txt14:41
openstackLog:            http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2018/powervm_driver_meeting.2018-08-07-14.01.log.html14:41
efriededmondsw: How do I "open a ticket"?14:41
efriedmaybe move this conversation internal...14:41
edmondswthat's a slack conv... yeah14:41
*** mujahidali has quit IRC14:53
edmondswefried your FSP is now reachable16:21
efriededmondsw: Nice, thanks.16:22
efriedand my neo is up16:22
efriededmondsw: Hum, this is interesting, it actually looks like it never went down.16:22
efried 12:22:43 up 302 days,  6:19,  1 user,  load average: 0.35, 0.33, 0.4116:23
efriedWas it just the network that was borqué?16:23
edmondswI think some switches were messed up, yes16:24
edmondswgood uptime there :)16:24
*** openstackgerrit has quit IRC18:49
esbergluedmondsw: All my blueprints are closed except for migrate/resize19:51
edmondswesberglu thanks19:51
edmondswefried woah... did you know that vi/vim can open remote files via URL? Even gzipped?20:13
edmondswTIL...20:13
edmondswthis is useful for debugging CI failures20:13
efriedcool20:13
efriedIf you're using it for CI failures, you're not getting gzipped files over the wire.20:14
efriedBut it's still cool.20:14
edmondswoh, even though the file names say they're gzipped?20:14
efriedyeah, the web server gizmo is unzipping them and streaming them over the wire.20:14
edmondswah, that's right20:14
efriedit would be cooler the other way, but your browser doesn't know how to handle .gz20:14
efriedWhat's neat is that vim is sending the appropriate headers to make the web server do that.20:15
efriedBecause if you download the file, I think you do actually get the gzipped version.20:15
edmondswthat explains why I got a gzip error that I had to skip over to get to the contents of the file20:15
efriedor... maybe not.20:15
edmondswshows it did try to unzip it though20:15
*** openstackgerrit has joined #openstack-powervm20:34
openstackgerritEric Fried proposed openstack/nova-powervm master: Filter IOSlots per inventory config yaml  https://review.openstack.org/58930620:34
openstackgerritEric Fried proposed openstack/nova-powervm master: Placement-isms for inventory items  https://review.openstack.org/58930720:34
openstackgerritEric Fried proposed openstack/nova-powervm master: Inventory whitelist schema and loading  https://review.openstack.org/57928920:39
openstackgerritEric Fried proposed openstack/nova-powervm master: Filter IOSlots per inventory config yaml  https://review.openstack.org/58930620:40
openstackgerritEric Fried proposed openstack/nova-powervm master: Placement-isms for inventory items  https://review.openstack.org/58930720:40
-openstackstatus- NOTICE: Due to a bug, Zuul has been unable to report on cherry-picked changes over the last 24 hours. This has now been fixed; if you encounter a cherry-picked change missing its results (or was unable to merge), please recheck now.20:43
*** esberglu has quit IRC20:58
*** edmondsw has quit IRC21:29
*** edmondsw has joined #openstack-powervm22:54
openstackgerritEric Fried proposed openstack/nova-powervm master: Placement-isms for inventory items  https://review.openstack.org/58930722:55
openstackgerritEric Fried proposed openstack/nova-powervm master: WIP: update_provider_tree with device exposure  https://review.openstack.org/58966822:55
openstackgerritEric Fried proposed openstack/nova-powervm master: WIP: update_provider_tree with device exposure  https://review.openstack.org/58966822:57
*** edmondsw has quit IRC22:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!