Friday, 2017-02-17

*** erlon has quit IRC00:05
*** krtaylor has quit IRC00:09
*** baoli has joined #openstack-nova00:11
*** dtp has quit IRC00:11
*** jogo has quit IRC00:12
*** Sukhdev has quit IRC00:12
*** jogo has joined #openstack-nova00:12
*** baoli has quit IRC00:16
*** sdague has quit IRC00:16
*** tbachman has joined #openstack-nova00:17
*** cku has joined #openstack-nova00:18
*** Sukhdev has joined #openstack-nova00:21
*** CristinaPauna has quit IRC00:23
*** salv-orlando has joined #openstack-nova00:24
*** Sukhdev has quit IRC00:25
cburgessmrodden So... food update...00:26
cburgessOpps00:26
cburgessWrong person.00:26
cburgessmriedem You still around?00:26
*** yassine_ has quit IRC00:26
melwittcburgess: he's heading home right now, said he'll be back online later00:27
cburgessmelwitt Thanks... have a food update for him and wanted his opinion00:27
melwitt:)00:27
edleafecburgess: if possible, please keep in mind those of us who are not meat eaters00:28
* edleafe loves seafood, though00:28
cburgessWell thats a problem since he asked me about BBQ... ummm ok.00:28
cburgessI'll... see what we can do.00:28
cburgessbbq and not meat don't usually go well together...00:28
*** salv-orlando has quit IRC00:29
*** mlavalle has quit IRC00:31
*** yassine_ has joined #openstack-nova00:32
*** CristinaPauna has joined #openstack-nova00:33
*** hongbin has quit IRC00:35
*** kaisers_ has joined #openstack-nova00:35
*** hfu has joined #openstack-nova00:36
*** chyka has quit IRC00:36
*** hoangcx has joined #openstack-nova00:38
edleafecburgess: understood. I live in Texas, after all  :)00:38
edleafecburgess: As long as there will be beer, I'll survive00:39
*** gouthamr has joined #openstack-nova00:39
*** tovin07 has joined #openstack-nova00:39
cburgessedleafe No worries00:40
*** kaisers_ has quit IRC00:40
*** tovin07_ has joined #openstack-nova00:40
*** mriedem has joined #openstack-nova00:44
openstackgerritmelanie witt proposed openstack/nova master: Count resources to check quota for cells  https://review.openstack.org/41652100:45
openstackgerritmelanie witt proposed openstack/nova master: Make Quotas object favor the API database  https://review.openstack.org/41094500:45
openstackgerritmelanie witt proposed openstack/nova master: Add online migration to move quotas to API database  https://review.openstack.org/41094600:45
*** armax has joined #openstack-nova00:45
*** efried has quit IRC00:48
*** krtaylor has joined #openstack-nova00:54
*** liusheng has joined #openstack-nova00:57
*** jwcroppe has quit IRC00:57
*** efried has joined #openstack-nova01:02
*** armax has quit IRC01:03
*** armax has joined #openstack-nova01:03
*** phuongnh has joined #openstack-nova01:05
*** kevinz has joined #openstack-nova01:08
*** ZZelle_ has quit IRC01:11
*** sam_nowitzki has joined #openstack-nova01:12
*** catintheroof has quit IRC01:13
*** thorst_afk has joined #openstack-nova01:17
*** jamielennox is now known as jamielennox|away01:18
*** mtanino has quit IRC01:22
*** baoli has joined #openstack-nova01:22
*** jamielennox|away is now known as jamielennox01:25
*** baoli has quit IRC01:27
*** dave-mccowan has joined #openstack-nova01:28
*** iceyao has joined #openstack-nova01:31
*** Jinxing has joined #openstack-nova01:33
*** xiaoyang has joined #openstack-nova01:33
*** gcb has joined #openstack-nova01:35
*** rfolco has joined #openstack-nova01:36
*** rfolco has quit IRC01:36
*** kaisers_ has joined #openstack-nova01:36
*** thorst_afk has quit IRC01:41
*** baoli has joined #openstack-nova01:44
*** baoli has quit IRC01:44
*** baoli has joined #openstack-nova01:45
*** yuntongjin has joined #openstack-nova01:45
xiaoyanghi, everyone. Why instance live migration after success doesn't change the availability zone?01:47
*** gcb has quit IRC01:48
*** yufei has joined #openstack-nova01:50
*** d-bark has joined #openstack-nova01:53
*** Jinxing has quit IRC01:54
*** thorst_afk has joined #openstack-nova01:56
*** kaisers_ has quit IRC01:56
*** d-bark has quit IRC01:57
*** d-bark has joined #openstack-nova01:58
*** gcb has joined #openstack-nova02:00
*** Jinxing has joined #openstack-nova02:01
*** baoli has quit IRC02:04
*** nkrinner_afk has quit IRC02:08
*** slunkad has quit IRC02:08
*** tuanluong has joined #openstack-nova02:16
*** zz_dimtruck is now known as dimtruck02:19
*** unicell has quit IRC02:19
*** salv-orlando has joined #openstack-nova02:26
*** ijw has quit IRC02:26
*** baoli has joined #openstack-nova02:27
*** armax has quit IRC02:29
*** ijw has joined #openstack-nova02:30
*** salv-orlando has quit IRC02:30
*** ijw has quit IRC02:31
*** kaisers_ has joined #openstack-nova02:39
*** Jinxing has quit IRC02:40
*** kaisers_ has quit IRC02:44
*** Apoorva has quit IRC02:49
*** thorst_afk has quit IRC02:50
*** Jinxing has joined #openstack-nova02:54
*** Hosam has quit IRC02:54
*** Hosam has joined #openstack-nova02:58
*** Hosam has quit IRC02:59
*** slunkad has joined #openstack-nova03:00
*** Sukhdev has joined #openstack-nova03:02
*** thorst_afk has joined #openstack-nova03:03
*** Hosam has joined #openstack-nova03:03
*** thorst_afk has quit IRC03:04
*** Jinxing has quit IRC03:08
*** Jinxing has joined #openstack-nova03:09
*** nkrinner_afk has joined #openstack-nova03:12
*** Hosam has quit IRC03:12
*** baoli has quit IRC03:12
*** Hosam has joined #openstack-nova03:13
Jeffrey4lcan i say, introducing nova_api database is only(or mainly?) used for nova cell v2?03:18
Jeffrey4lalex_xu, ^^ ;)03:18
*** schlueter has quit IRC03:20
*** tojuvone has quit IRC03:21
cku We recently submitted a blueprint and spec for adding a Nova volume driver for Veritas HyperScale storage (https://review.openstack.org/#/c/430488/).03:24
*** ducttape_ has quit IRC03:24
ckuI'm uncertain about the process to take this forward.03:24
cku1. Should we submit a separate blueprint and spec to the Cinder project for the Nova volume driver's os-brick connector?03:25
cku2. Do we need to set up CI for the volume driver, the os-brick connector, or both?03:25
cku3. Which existing volume driver should I use as a model for the proper specs, architecture, and CI setup?03:25
ckuThanks (eom)03:25
smcginniscku: I believe there is already a Cinder blueprint for HyperScale.03:26
smcginniscku: If you need an os-brick connector, you can associate that change in os-brick to the same blueprint.03:26
*** yuntongjin has quit IRC03:26
smcginniscku: The Cinder repo needs CI reporting.03:26
smcginniscku: We encourage also reporting on os-brick changes, but we haven't made that a requirement. (yet)03:27
ckuYes, a Cinder volume driver, but that is different from the os-brick connector component of the Nova volume driver.03:27
smcginnisos-brick is a shared library by Nova and Cinder.03:27
ckuAh, so the blueprint and spec we submitted in the Nova project should suffice?03:28
*** tojuvone has joined #openstack-nova03:28
*** deepbook5broo has joined #openstack-nova03:30
*** armax has joined #openstack-nova03:32
*** deepbook5broo has left #openstack-nova03:33
*** armax has quit IRC03:35
*** thorst_afk has joined #openstack-nova03:35
*** thorst_afk has quit IRC03:35
*** Jinxing has quit IRC03:38
*** kaisers_ has joined #openstack-nova03:41
smcginniscku: No, I mean the Cinder spec. os-brick is part of the Cinder umbrella.03:42
openstackgerritChangBo Guo(gcb) proposed openstack/nova master: Use check_string_length from oslo_utils  https://review.openstack.org/28639003:42
*** armax has joined #openstack-nova03:43
*** hongbin has joined #openstack-nova03:43
*** rmk has quit IRC03:46
*** dave-mccowan has quit IRC03:47
*** nmathew has joined #openstack-nova03:49
*** david-lyle has quit IRC03:49
*** david-lyle has joined #openstack-nova03:50
*** kaisers_ has quit IRC03:54
*** mdrabe has joined #openstack-nova03:57
*** sudipto_ has joined #openstack-nova03:57
*** sudipto has joined #openstack-nova03:57
*** adrian_otto has joined #openstack-nova03:57
*** Jinxing has joined #openstack-nova03:58
mriedemcku: i've already replied about this in the nova spec, and linked the nova blueprint to the cinder blueprint03:59
mriedembut smcginnis has already answered most of this03:59
mriedemJeffrey4l: the nova_api database has gone back a few releases and mostly predates the majority of the cells v2 work04:00
*** Sukhdev has quit IRC04:00
mriedemwell i guess it was added for cells v2 primarily, i was thinking the request spec was in there first, but it's been around since liberty04:01
*** links has joined #openstack-nova04:03
*** sudipto has quit IRC04:12
*** sudipto_ has quit IRC04:12
Jeffrey4lmriedem, roger. thanks.04:12
*** adrian_otto has quit IRC04:14
*** xiaoyang has quit IRC04:15
*** nicolasbock has quit IRC04:17
*** psachin has joined #openstack-nova04:19
*** diga has joined #openstack-nova04:20
*** hongbin has quit IRC04:22
*** dimtruck is now known as zz_dimtruck04:24
*** rmk has joined #openstack-nova04:25
*** rmk has quit IRC04:25
*** rmk has joined #openstack-nova04:25
*** gongysh has joined #openstack-nova04:26
*** salv-orlando has joined #openstack-nova04:26
*** salv-orlando has quit IRC04:31
*** karthiks has joined #openstack-nova04:31
*** xiaoyang has joined #openstack-nova04:31
*** adrian_otto has joined #openstack-nova04:34
*** gouthamr has quit IRC04:38
*** adisky_ has joined #openstack-nova04:38
*** sudipto has joined #openstack-nova04:39
*** sudipto_ has joined #openstack-nova04:39
*** mdnadeem has joined #openstack-nova04:40
*** sree has joined #openstack-nova04:43
*** sudipto has quit IRC04:43
*** sudipto_ has quit IRC04:43
*** Hosam has quit IRC04:44
*** Hosam has joined #openstack-nova04:44
*** yuntongjin has joined #openstack-nova04:44
*** xiaoyang has quit IRC04:45
*** xiaoyang has joined #openstack-nova04:45
*** sree has quit IRC04:47
mriedemocata rc2 patch is up and ready to go, should be released by tomorrow04:48
*** kaisers_ has joined #openstack-nova04:49
*** sudipto_ has joined #openstack-nova04:51
*** sudipto has joined #openstack-nova04:51
*** kaisers_ has quit IRC04:52
*** kaisers_ has joined #openstack-nova04:52
*** diana_clarke has quit IRC04:54
*** adrian_otto has quit IRC04:54
*** kaisers_ has quit IRC04:57
*** thorst_afk has joined #openstack-nova04:57
*** diga has quit IRC05:00
*** thorst_afk has quit IRC05:02
*** slunkad has quit IRC05:02
*** viks has quit IRC05:04
*** mdrabe has quit IRC05:05
*** slunkad has joined #openstack-nova05:07
*** rcernin has joined #openstack-nova05:08
*** gongysh has quit IRC05:10
*** ssurana has quit IRC05:11
*** prateek has joined #openstack-nova05:13
*** armax has quit IRC05:14
*** dikonoor has joined #openstack-nova05:17
*** maestropandy has joined #openstack-nova05:17
*** yuntongjin has quit IRC05:18
*** unicell has joined #openstack-nova05:18
openstackgerritchristopher.uhler proposed openstack/nova-specs master: Spec for libvirt driver extension for Veritas HyperScale  https://review.openstack.org/43048805:19
*** unicell1 has joined #openstack-nova05:22
*** unicell has quit IRC05:23
*** tyrola has quit IRC05:24
*** tyrola has joined #openstack-nova05:25
*** salv-orlando has joined #openstack-nova05:27
*** ratailor has joined #openstack-nova05:29
*** salv-orlando has quit IRC05:31
*** faizy has joined #openstack-nova05:32
*** tlian has quit IRC05:32
*** seongu has joined #openstack-nova05:34
*** cku has quit IRC05:34
*** udesale has joined #openstack-nova05:39
*** seongu has quit IRC05:41
*** CristinaPauna has quit IRC05:46
*** jbernard has quit IRC05:47
*** kaisers_ has joined #openstack-nova05:52
*** jbernard has joined #openstack-nova05:56
*** kaisers_ has quit IRC05:57
*** CristinaPauna has joined #openstack-nova05:58
*** yamahata has joined #openstack-nova05:59
*** yamamoto has quit IRC06:08
*** Jinxing has quit IRC06:09
*** Hosam has quit IRC06:09
*** Hosam has joined #openstack-nova06:10
openstackgerritAnh Tran proposed openstack/nova master: Remove unused logging import  https://review.openstack.org/43526106:10
*** amotoki has joined #openstack-nova06:12
*** xiaoyang has quit IRC06:16
*** Hosam has quit IRC06:19
*** Hosam has joined #openstack-nova06:20
*** lpetrut has joined #openstack-nova06:20
*** rcernin has quit IRC06:21
*** phuongnh has quit IRC06:22
*** nkrinner_afk is now known as nkrinner06:31
*** Jinxing has joined #openstack-nova06:32
*** satyar has joined #openstack-nova06:37
*** ltomasbo|away is now known as ltomasbo06:37
*** diga has joined #openstack-nova06:37
*** moshele has joined #openstack-nova06:37
*** Hosam has quit IRC06:38
*** Hosam has joined #openstack-nova06:39
*** yuntongjin has joined #openstack-nova06:40
*** jerrygb has joined #openstack-nova06:41
*** jerrygb has quit IRC06:46
*** Hosam has quit IRC06:47
*** yamamoto has joined #openstack-nova06:47
*** Hosam has joined #openstack-nova06:48
*** kaisers_ has joined #openstack-nova06:55
*** hoangcx_ has joined #openstack-nova06:57
*** moshele has quit IRC06:57
*** thorst_afk has joined #openstack-nova06:59
*** hoangcx has quit IRC06:59
*** jerrygb has joined #openstack-nova07:00
*** amotoki has quit IRC07:01
*** rcernin has joined #openstack-nova07:01
*** thorst_afk has quit IRC07:03
*** jerrygb has quit IRC07:05
*** Oku_OS-away is now known as Oku_OS07:07
*** d-bark has quit IRC07:08
*** amotoki has joined #openstack-nova07:08
*** tesseract has joined #openstack-nova07:11
*** fragatin_ has joined #openstack-nova07:15
*** kaisers_ has quit IRC07:16
*** fragatina has quit IRC07:19
*** fragatin_ has quit IRC07:19
*** sridharg has joined #openstack-nova07:21
*** salv-orlando has joined #openstack-nova07:22
*** lpetrut has quit IRC07:25
*** andreas_s has joined #openstack-nova07:25
*** lpetrut has joined #openstack-nova07:25
*** markus_z has joined #openstack-nova07:29
*** vsaienk0 has quit IRC07:30
*** fragatina has joined #openstack-nova07:35
*** lpetrut has quit IRC07:36
*** fragatina has quit IRC07:37
*** fragatina has joined #openstack-nova07:38
*** fragatina has quit IRC07:38
*** unicell1 has quit IRC07:38
*** fragatina has joined #openstack-nova07:39
*** xiaoyang has joined #openstack-nova07:39
*** gongysh has joined #openstack-nova07:41
*** maestropandy has quit IRC07:45
*** amoralej|off is now known as amoralej07:46
*** sree has joined #openstack-nova07:54
*** shardy_afk is now known as shardy07:57
*** migi_ is now known as migi07:58
*** hoangcx has joined #openstack-nova07:59
*** hoangcx_ has quit IRC08:00
*** yuntongjin has quit IRC08:01
*** yuntongjin has joined #openstack-nova08:02
*** sree has quit IRC08:12
*** kaisers_ has joined #openstack-nova08:12
*** sree has joined #openstack-nova08:14
*** fandi has joined #openstack-nova08:14
openstackgerritAnh Tran proposed openstack/nova master: Remove unused logging import  https://review.openstack.org/43526108:17
*** moshele has joined #openstack-nova08:17
*** yamamoto has quit IRC08:18
*** mlakat has quit IRC08:21
*** pcaruana has joined #openstack-nova08:22
*** ijw has joined #openstack-nova08:27
*** slaweq has quit IRC08:27
*** xiaoyang has quit IRC08:29
*** sree has quit IRC08:29
*** xiaoyang has joined #openstack-nova08:29
*** avolkov has joined #openstack-nova08:30
*** yamamoto has joined #openstack-nova08:31
*** ijw has quit IRC08:32
*** jpena|away is now known as jpena08:32
*** slaweq has joined #openstack-nova08:33
xiaoyanghi, everyone. Why instance live migration after success doesn't change the availability zone?08:33
*** xiaoyang has quit IRC08:36
*** mlakat has joined #openstack-nova08:36
*** xiaoyang has joined #openstack-nova08:36
*** xiaoyang has quit IRC08:38
*** xiaoyang has joined #openstack-nova08:38
*** yamamoto has quit IRC08:44
*** jpena is now known as jpena|away08:45
*** bkopilov_ has quit IRC08:48
*** bkopilov has quit IRC08:48
*** sree has joined #openstack-nova08:50
*** moshele has quit IRC08:52
johnthetubaguyxiaoyang: we don't really support availability zone concept, except for scheduling Nova resources close to Cinder resources when you first boot the instance08:53
*** jpena|away is now known as jpena08:53
johnthetubaguyxiaoyang: sounds like a bug worth reporting (and fixing) though08:53
*** xiaoyang has quit IRC08:53
*** xiaoyang has joined #openstack-nova08:53
johnthetubaguyit seems like live-migration shouldn't really allow you to move outside the original availability zone, but I guess we don't check that.08:54
*** sree has quit IRC08:57
*** gcb has quit IRC08:58
*** thorst_afk has joined #openstack-nova08:59
*** zzzeek has quit IRC09:00
*** zzzeek has joined #openstack-nova09:00
*** xiaoyang has quit IRC09:01
*** xiaoyang has joined #openstack-nova09:01
*** thorst_afk has quit IRC09:04
*** xiaoyang has quit IRC09:07
*** xiaoyang has joined #openstack-nova09:07
bauzasjohnthetubaguy: there is something I saw about AZs09:07
bauzasand live-migration09:08
bauzasjohnthetubaguy: tbc, if an instance is booted using the az flag, then we force to keep that instance in the AZ if live-migrate is calling the scheduler09:08
bauzasbut only after Mitaka09:09
johnthetubaguybauzas: ah, right, and I guess unless we force it to a host09:09
*** kaisers_ has quit IRC09:10
bauzasyup using the new flag I added in Newton IIRC09:11
bauzas(or Mitaka? not sure)09:12
bauzasanyway09:12
*** xiaoyang has quit IRC09:12
bauzasthat said, I saw something weirdo in that from a internal perspective, and I'm still looking at it09:12
*** gcb has joined #openstack-nova09:12
openstackgerritZhenyu Zheng proposed openstack/nova master: Should raise correct error instead of class exist in Placement API  https://review.openstack.org/42861209:16
*** karimb has joined #openstack-nova09:18
openstackgerritSilvan Kaiser proposed openstack/nova master: Removes getfattr from Quobyte Nova driver  https://review.openstack.org/42864609:19
*** lucas-afk is now known as lucasagomes09:20
*** tovin07 has quit IRC09:26
*** yuntongjin has quit IRC09:26
*** jaosorior has joined #openstack-nova09:27
openstackgerritMarkus Zoeller (markus_z) proposed openstack/nova master: live-migration test hook for serial console  https://review.openstack.org/34747109:27
bauzasjohnthetubaguy: found the bug I noticed internally https://bugs.launchpad.net/nova/+bug/165233509:29
openstackLaunchpad bug 1652335 in OpenStack Compute (nova) "The scheduler returns limits even if the instance was boot using AZ forced flag" [Medium,Confirmed] - Assigned to Sylvain Bauza (sylvain-bauza)09:29
*** maestropandy has joined #openstack-nova09:30
*** maestropandy has left #openstack-nova09:30
*** slunkad has quit IRC09:30
*** tovin07_ has quit IRC09:31
*** Jinxing has quit IRC09:32
*** Hosam has quit IRC09:35
*** slunkad has joined #openstack-nova09:35
*** Hosam has joined #openstack-nova09:35
*** Jinxing has joined #openstack-nova09:36
*** Jeffrey4l has quit IRC09:42
*** lpetrut has joined #openstack-nova09:43
*** yamamoto has joined #openstack-nova09:44
*** yamamoto has quit IRC09:49
*** cdent has joined #openstack-nova09:50
*** yamahata has quit IRC09:51
*** Jinxing has quit IRC09:54
*** edmondsw has joined #openstack-nova09:54
*** Jeffrey4l has joined #openstack-nova09:55
*** Jeffrey4l has quit IRC09:56
*** amotoki has quit IRC09:56
*** Jeffrey4l has joined #openstack-nova09:57
*** edmondsw has quit IRC09:58
*** Hosam has quit IRC09:59
*** Hosam has joined #openstack-nova09:59
tojuvonejohnthetubaguy, Hi, continuing host maintenance where left before Ocata as working with it in Craton10:01
tojuvonejohnthetubaguy, https://review.openstack.org/428070/10:01
mdboothlyarwood: Do you have an opinion on https://review.openstack.org/#/c/430091/5, btw? Trade off of expedient fix for 1 edge case vs a more complex fix for the underlying problem. I ask because your previous reviews were positive.10:01
*** hoangcx has quit IRC10:02
*** tuanluong has quit IRC10:03
*** haplo37_ has quit IRC10:03
*** haplo37_ has joined #openstack-nova10:03
johnthetubaguytojuvone: ah, remember to bug me about that one when we are back from the PTG, interesting in getting progress on that10:03
tojuvonejohnthetubaguy, Thanks10:05
*** rmart04 has joined #openstack-nova10:05
johnthetubaguytojuvone: my initial take is you should focus on the os-services API instead of looking as os-hypervisors, because that is where all the actions are like force-host-down10:05
*** xiaoyang has joined #openstack-nova10:06
tojuvonejohnthetubaguy, yes, could remove that part. It was more or less to have os-hypervisors inline with fileds shown, but really not needed10:06
*** derekh has joined #openstack-nova10:08
*** Hosam has quit IRC10:08
*** Hosam has joined #openstack-nova10:09
*** hfu has quit IRC10:09
*** ratailor has quit IRC10:11
johnthetubaguytojuvone: I added a comment on the use cases, I think you should write out two flows: what the admin does during a "typical" maintenance, and what the user does. That should show how the new APIs are needed to enable those flows.10:11
*** ratailor has joined #openstack-nova10:11
*** sambetts|afk is now known as sambetts10:11
*** iceyao has quit IRC10:11
johnthetubaguytojuvone: stuff like schedules windows for AZ A, B and C, user notes the windows and decides what workloads are affected, etc, etc10:11
*** xiaoyang has quit IRC10:12
johnthetubaguytojuvone: I would keep them separate though, do the admin flow, then the user flow that relates to what the admin has done10:12
*** faizy has quit IRC10:12
*** yufei has quit IRC10:13
*** faizy has joined #openstack-nova10:13
*** gongysh has quit IRC10:13
*** xiaoyang has joined #openstack-nova10:14
*** kevinz has quit IRC10:14
tojuvonejohnthetubaguy, ok, now just have link to external material. But like you said, better to explain more in spec, so it is more readable10:15
johnthetubaguytojuvone: right, but you need to describe how that link gets used within the real situation10:15
johnthetubaguytojuvone: something tells me we should define expected start/stop times and a link for more information, so the scheduler can be told about what is happening10:16
johnthetubaguybut once the use case is clear, it should be easier to understand10:17
xiaoyangi think haveif make compute node add other aggregate which have different availability zone. The instance`s availability zone on this node will not change10:17
tojuvoneall that was moved away in Ocata as it was agreed earlier not to have that much in Nova10:17
*** yamamoto has joined #openstack-nova10:17
tojuvoneI mean spec in Ocata10:18
*** Jeffrey4l has quit IRC10:18
tojuvoneall that start, stop, state was put to external service where there would only be a link10:18
tojuvonethat surely is not so good when looking scheduler should read it from there10:19
lyarwoodmdbooth: well given where we are in the cycle now I guess I'm fine with going after the bigger fix but I don't see the harm in also resolving this edge case in the short term10:19
*** Jeffrey4l has joined #openstack-nova10:19
mdboothlyarwood: The harm I see is that it's obtuse.10:19
mdboothI think if we add that there, it will never be removed.10:19
lyarwoodmdbooth: and if we fix the underlying issue that shouldn't be a problem right?10:20
mdboothlyarwood: Right.10:20
mdboothThat fix is going to work for shops who use almost entirely BFV.10:20
mdboothBecause it basically disables DiskFilter.10:21
mdboothBut... they might as well just disable DiskFilter.10:21
tojuvoneWell, if I get to write enough to spec about the case in admin, user and host monitoring perspective. Let's see where it goes10:21
*** xiaoyang has quit IRC10:21
johnthetubaguytojuvone: well, we really want to see if just the URL is enough for the required use cases, and write that up in a spec to show that it is10:21
*** xiaoyang has joined #openstack-nova10:21
lyarwoodmdbooth: right but to hit this you would need to run a mix of bfv and local disks10:21
lyarwoodmdbooth: for the reported host values to go negative, AFAICT at least10:22
mdboothI think you'll hit this if you run 100% bfv10:22
lyarwoodah, it's just on the flavors?10:22
mdboothYeah10:22
tojuvonejohnthetubaguy, yes10:22
*** Hosam has quit IRC10:23
johnthetubaguytojuvone: basically, a very common request is for the scheduler to not place new VMs where maintenance is about to occur, and prefer unaffected places10:23
mdboothlyarwood: Did you see the code I highlighted in resourcemanager?10:23
*** Hosam has joined #openstack-nova10:23
lyarwoodmdbooth: yeah, just going back through scrollback now, I missed your convo with bauzas about this yesterday10:23
mdboothNot 100% sure, but at least moderately sure that's the source of the error.10:23
johnthetubaguytojuvone: or just prefer things that now are no longer impacted by the maintenance, I guess10:23
lyarwoodhttps://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L1049-L105310:24
johnthetubaguytojuvone: lets discuss making sure we have enough information to make that all work10:24
mdboothresource tracker, even. Yeah10:24
bauzasmdbooth: sorry, yesterday's evening was pretty busy and I had no time replying to you10:24
mdboothbauzas: NP. I was just trying to short cut :)10:24
bauzasmdbooth: what's the gist of the problem ?10:24
mdboothbauzas: I think it's the code lyarwood just pasted above10:24
tojuvonejohnthetubaguy, yes, the scheduling I had earlier as it was mostly wanted by ops10:25
* bauzas looking10:25
mdboothbauzas: The issue, I think, is that it doesn't take account of bdms.10:25
*** yamamoto has quit IRC10:25
*** satyar has quit IRC10:25
mdboothSo, although the flavor has root_gb of X, if the instance is BFV it actually doesn't use that10:25
mdboothSame with ephemeral10:25
johnthetubaguytojuvone: we need to keep the use cases that are required like that one10:25
mdboothAnd it doesn't account for swap, or kernel/ramdisk10:25
*** xiaoyang has quit IRC10:25
bauzasmdbooth: right, that's a known issue that we're trying to solve by using shared resource providers10:26
*** xiaoyang has joined #openstack-nova10:26
mdboothbauzas: That's a different problem10:26
mdboothThis has nothing to do with shared storage10:26
bauzasmdbooth: it has to do about volumes, right?10:27
mdboothbauzas: In this case it has to do with block device mappings10:27
bauzasmdbooth: lemme rephrase then10:27
mdboothIIUC, that code is what's calculating an instance's resource usage to update whatever10:27
mdboothHowever, it's incorrectly calculating an instance's resource usage10:27
mdboothIf the thing it's updated is aware of shared storage, it'll still update it incorrectly10:28
bauzasmdbooth: the problem you state is that if you have an attached volume that maps your instance, the flavor disk information is not accurate, right?10:28
mdboothThe flavor disk information doesn't necessarily apply to the instance10:28
mdboothSo although the instance is booted with flavor X which has root_gb=2010:28
bauzasso, mdbooth I said :10:29
bauzas(11:28:16) bauzas: mdbooth: the problem you state is that if you have an attached volume that maps your instance, the flavor disk information is not accurate, right?10:29
mdboothIt may actually be using any amount of root disk between 0 and 2010:29
*** sam_nowitzki has quit IRC10:29
tojuvonejohnthetubaguy, Thanks, I'll work that out.10:29
*** jaosorior has quit IRC10:29
bauzasmdbooth: it may be using less than 20, but in which case ?10:29
mdboothbauzas: block device mappings also do volumes, so yeah I guess that's an aspect10:29
bauzasah-ah I see10:30
bauzasI see your point about BDMs10:30
bauzasthe fact that we don't know the real size ?10:30
mdboothYes10:30
johnthetubaguytojuvone: yeah, the aim here is to cover your use cases in a way that fits with long term direction of the APIs etc10:30
*** jaosorior has joined #openstack-nova10:30
johnthetubaguytojuvone: so keep all the use cases and problems that need to be solved, and concentrate on getting a good user story10:30
johnthetubaguytojuvone: the negotiation here is on how we implement it, and where the hard stuff goes10:31
bauzasmdbooth: well, the fact is that it depends on what's behind the BDM, right?10:32
*** markus_z has quit IRC10:32
bauzasmdbooth: but whatever it is, it's still capping at the maximum size given by the flavor ?10:32
tojuvonejohnthetubaguy, Yes and there is different sides. Generic "host state" to be outside with notif about change makes it again easier to catch that in monitoring hosts10:32
mdboothbauzas: Yes, flavor is a maximum.10:32
mdboothThe issue reported here is that if your instances are predominantly BFV, then RM thinks you ran out of disk long before you actually did.10:33
mdboothIn fact, RM thinks you have negative disk space10:34
bauzasmdbooth: but those instances could max out up to that size10:34
johnthetubaguytojuvone: yeah, lets get that admin view and user view pinned down nicely10:34
mdboothbauzas: Interesting idea. Not without rescheduling, I think.10:34
*** owalsh-afk is now known as owalsh10:34
mdboothbauzas: I think you'd have to resize.10:34
bauzasmdbooth: if my BDM source type is image10:35
mdboothEven then, can you change the non-volume bdms?10:35
lyarwooddon't we have periodic jobs already checking the sizes of local disks etc on each of the hosts? I assumed we were already reporting this somewhere for quotas etc?10:36
bauzasthe size on the disk can grow for a non-volume, right?10:36
mdboothbauzas: I can't think of anything in the libvirt driver which allows resizing/adding ephemeral disks, except for the resize operation10:36
*** karthiks has quit IRC10:36
mdboothbauzas: No10:36
mdboothThis isn't overcommit.10:36
*** rfolco has joined #openstack-nova10:36
bauzasI'm puzzled honestly10:36
mdboothThis is, the user specified a BDM with a smaller disk size.10:36
mdboothOr in the case of BFV, no disk at all.10:37
bauzasokay, let's admit a flavor of 010:37
*** gszasz has joined #openstack-nova10:38
bauzasmdbooth: tbh, I'm not particularly seasoned with BDMs, so reading https://docs.openstack.org/developer/nova/block_device_mapping.html10:40
mdboothbauzas: You're not alone :)10:41
bauzasmdbooth: I mean, I trust you when you describe it could be suboptimal10:41
bauzasmdbooth: I'm just tryint to get more picture to know whether it's by design10:42
bauzasmdbooth: lemme explain10:42
mdboothbauzas: So I'm not that familiar with the resource manager code, which was probably pretty apparent yesterday10:42
bauzasmdbooth: that's how community works :)10:43
mdboothI have a vague understanding of what happens, but I'm not entirely sure which bits do what, or even what all the bits are. So I did some digging.10:43
mdboothI *think* that code above is what RM ultimately uses to update the scheduler's understanding of host resource usage, based on scheduling a specific instance.10:44
mdboothWhich I *think* means that, if it's wrong, something up the line will ultimately add up a bunch of wrong numbers.10:44
*** markus_z has joined #openstack-nova10:46
*** jerrygb has joined #openstack-nova10:46
*** ratailor is now known as ratailor|afk10:49
*** sdague has joined #openstack-nova10:50
*** jerrygb has quit IRC10:50
*** jerrygb has joined #openstack-nova10:51
*** khappone has quit IRC10:51
*** jaosorior has quit IRC10:52
*** udesale has quit IRC10:52
*** jaosorior has joined #openstack-nova10:53
*** khappone has joined #openstack-nova10:53
openstackgerritjichenjc proposed openstack/nova master: add zvm migration object  https://review.openstack.org/41409010:54
*** jerrygb_ has joined #openstack-nova10:54
*** jerrygb has quit IRC10:55
BobBallmriedem: Many thanks for your help + shepherding on the XAPI live migration fix :) I'm really glad it made Ocata.  Now it's up to us to make sure it doesn't happen again.10:58
*** thorst_afk has joined #openstack-nova11:01
*** Fdaisuke has quit IRC11:01
*** karimb has quit IRC11:04
*** thorst_afk has quit IRC11:05
*** kaisers_ has joined #openstack-nova11:06
*** xiaoyang has quit IRC11:06
*** sudipto_ has quit IRC11:08
*** sudipto has quit IRC11:08
openstackgerritSivasathurappan Radhakrishnan proposed openstack/nova-specs master: Live Migration of Rescued Instances  https://review.openstack.org/34716111:11
openstackgerritLee Yarwood proposed openstack/nova master: encryptors: Switch to os-brick encryptor classes  https://review.openstack.org/39159711:18
*** nicolasbock has joined #openstack-nova11:19
* lyarwood wonders if ^ needs a releasenote, it shouldn't have any user facing impact tbh.11:19
*** sridharg has quit IRC11:20
openstackgerritArtom Lifshitz proposed openstack/nova master: Plumbing for tagged nic attachment  https://review.openstack.org/41562211:22
openstackgerritArtom Lifshitz proposed openstack/nova master: Libvirt support for tagged volume attachment  https://review.openstack.org/41810011:22
openstackgerritArtom Lifshitz proposed openstack/nova master: Delete disk metadata when detaching volume  https://review.openstack.org/43508211:22
openstackgerritArtom Lifshitz proposed openstack/nova master: Plumbing for tagged volume attachment  https://review.openstack.org/39194111:22
openstackgerritArtom Lifshitz proposed openstack/nova master: API support for tagged device attachment  https://review.openstack.org/37602111:22
openstackgerritArtom Lifshitz proposed openstack/nova master: Libvirt support for tagged nic attachment  https://review.openstack.org/41552011:22
openstackgerritArtom Lifshitz proposed openstack/nova master: Delete nic metadata when detaching interface  https://review.openstack.org/43538711:22
*** Hosam has quit IRC11:24
*** Hosam has joined #openstack-nova11:25
*** kaisers_ has quit IRC11:31
*** sridharg has joined #openstack-nova11:32
*** Hosam has quit IRC11:34
*** karimb has joined #openstack-nova11:34
*** hfu has joined #openstack-nova11:35
*** Hosam has joined #openstack-nova11:35
openstackgerritSilvan Kaiser proposed openstack/nova master: Removes getfattr from Quobyte Nova driver  https://review.openstack.org/42864611:36
*** tbachman has quit IRC11:37
*** yamamoto has joined #openstack-nova11:37
*** yamamoto has quit IRC11:37
*** smatzek_ has joined #openstack-nova11:39
*** markus_z has quit IRC11:39
*** smatzek_ has quit IRC11:40
*** smatzek has joined #openstack-nova11:41
mdboothbauzas: Hey, what does scheduler/client/report.py do? That's also not quite right.11:41
bauzasmdbooth: it's both updating the DB and also calling the placement API11:41
openstackgerritArtom Lifshitz proposed openstack/nova-specs master: Virtual guest device role tagging  https://review.openstack.org/43539711:42
mdboothbauzas: Is the behaviour of DiskFilter provided by anything else, btw?11:42
mdboothCan we just deprecate it in favour of X?11:42
*** nmathew has quit IRC11:48
*** ratailor|afk is now known as ratailor11:49
*** salv-orlando has quit IRC11:50
*** Jinxing has joined #openstack-nova11:52
*** markus_z has joined #openstack-nova11:54
*** Jinxing has quit IRC11:57
openstackgerritSean Dague proposed openstack/nova master: Verify project_id when quotas are checked  https://review.openstack.org/43501011:59
*** ducttape_ has joined #openstack-nova12:00
lyarwoodsdague: morning, just looking at https://review.openstack.org/#/c/433825/ - would https://review.openstack.org/435406 - disabling gate-tempest-dsvm-full-devstack-plugin-ceph-ubuntu-trusty for stable/mitaka help here?12:01
lyarwoodor should we skip this with another devstack rc file?12:02
lyarwoods/skip this/skip the test/g12:02
sdaguelyarwood: yeh, we could make it non voting on mitaka to get that other fix in12:03
sdaguelyarwood: is anyone working on the ceph issue?12:03
lyarwoodsdague: I was about to add the fact that it's non-voting to the ptg etherpad, I don't think anyone is working on it tbh12:04
bauzasmdbooth: so, the DiskFilter is now legacy12:06
bauzasmdbooth: given we now use the Placement API for verifying the disk usage12:06
*** gcb has quit IRC12:07
bauzaswe still use it for the CachingScheduler12:07
mdboothbauzas: So it's worth fixing ResourceTracker?12:07
bauzasmdbooth: well, the RT is still used for providing the resources12:08
mdboothbauzas: Ok, cool.12:08
bauzasmdbooth: when are you arriving in ATL ? we could be discussing about that during the PTG12:08
mdboothbauzas: You forget :)12:09
* mdbooth will be in France by this time tomorrow12:09
*** adisky_ has quit IRC12:09
mdboothATL or the alps... which to choose?12:10
cdentwait, does this mean that I won't get a chance to have the beers with mdbooth that I was supposed to have in BCN in ATL?12:10
*** jerrygb_ has quit IRC12:10
mdboothcdent: Bah!12:10
* cdent burns down the world12:10
bauzasmdbooth: ooooooh right :p12:10
cdentI was coping just fine until now, but this is the last straw.12:10
bauzasmdbooth: lemme just take a picture for you :p12:10
mdboothcdent: lol12:10
* cdent stomps around12:10
*** ansiwen_ is now known as ansiwen12:10
mdboothbauzas: Yeah, yeah, I know12:10
mdboothcdent: If we took an American view, we both live in London and could therefore meet up any time12:11
*** abhishekk has quit IRC12:11
lyarwoodmdbooth: it's just down the road from you right?12:11
cdentheh, yeah. weird that.12:11
bauzasheh12:12
* cdent doesn't get upcountry much12:12
bauzasmdbooth: snow will be awesome12:12
mdboothcdent: Wait, do you actually live in London?12:12
cdentcornwall12:12
mdboothRight... :)12:12
mdboothSouth West London12:12
cdentha!12:12
*** ratailor has quit IRC12:13
*** haplo37 has quit IRC12:13
cdentWhen bauzas goes outside he sees the snowy mountains. I see the shining blue sea.12:13
lyarwoodthe commuter belt12:13
* mdbooth notes that Cornwall is far from everywhere and everything.12:13
mdboothlyarwood: lol12:13
cdentit certainly feels that way12:13
*** dave-mccowan has joined #openstack-nova12:14
*** fandi has quit IRC12:14
bauzasheh12:14
mdboothbauzas: Weather in the mountains next week looks nice12:14
*** jaosorior has quit IRC12:16
*** fengzhr has left #openstack-nova12:18
*** tbachman_ has joined #openstack-nova12:20
bauzascorrect12:21
*** haplo37 has joined #openstack-nova12:22
*** shardy is now known as shardy_lunch12:23
*** catintheroof has joined #openstack-nova12:23
bauzasmdbooth: just teasing a bit, here is what I had last Sat https://scontent-cdg2-1.xx.fbcdn.net/v/t35.0-12/16709262_10210130727278505_1924147998_o.jpg?oh=da67edbd122e61da21a7d59e8cd13ae7&oe=58A9279F12:24
bauzas:)12:24
*** nmathew has joined #openstack-nova12:24
mdboothbauzas: git12:24
bauzas80cm of pow or around12:24
bauzasand just fresh12:24
mdboothVT hasn't had fresh for about a week, I think12:25
* mdbooth doesn't understand the implications of that, though12:25
*** nmathew has quit IRC12:25
bauzasplanned for tonight IIRC12:25
bauzaseither way, I recommend you to enjoy on mornings, afternoons could be a bit not that good12:26
*** kaisers_ has joined #openstack-nova12:27
*** yamamoto has joined #openstack-nova12:27
*** ociuhandu has joined #openstack-nova12:29
*** jerrygb has joined #openstack-nova12:29
*** jaosorior has joined #openstack-nova12:30
*** diegows has joined #openstack-nova12:34
*** bvanhav has joined #openstack-nova12:36
*** karimb has quit IRC12:39
*** thorst_afk has joined #openstack-nova12:43
*** jerrygb_ has joined #openstack-nova12:45
*** faizy has quit IRC12:45
*** jerrygb has quit IRC12:46
openstackgerritSean Dague proposed openstack/nova master: Verify project_id when quotas are checked  https://review.openstack.org/43501012:47
*** erlon has joined #openstack-nova12:51
*** dikonoor has quit IRC12:55
*** d9k has quit IRC12:55
*** dikonoor has joined #openstack-nova12:55
openstackgerritSean Dague proposed openstack/nova master: Verify project id for flavor access calls  https://review.openstack.org/43543212:57
*** yamamoto has quit IRC12:58
*** tblakes has joined #openstack-nova12:58
*** macsz_and_cheese has joined #openstack-nova12:59
*** mtanino has joined #openstack-nova12:59
*** Hosam has quit IRC13:00
*** iceyao has joined #openstack-nova13:00
*** Hosam has joined #openstack-nova13:01
*** lucasagomes is now known as lucas-hungry13:01
*** yamamoto has joined #openstack-nova13:01
*** jerrygb_ has quit IRC13:02
*** jerrygb has joined #openstack-nova13:02
*** liverpooler has joined #openstack-nova13:03
sdaguealex_xu: https://review.openstack.org/#/c/435010 if you have a chance13:04
*** iceyao has quit IRC13:05
*** yamamoto has quit IRC13:06
*** edmondsw has joined #openstack-nova13:07
*** edleafe is now known as figleaf13:09
*** Hosam has quit IRC13:09
*** Hosam has joined #openstack-nova13:10
*** satyar has joined #openstack-nova13:12
*** jsho has joined #openstack-nova13:12
*** owalsh is now known as owalsh-afk13:12
*** Dinesh_Bhor has quit IRC13:14
*** mtanino has quit IRC13:15
*** sudipto has joined #openstack-nova13:16
*** sudipto_ has joined #openstack-nova13:16
*** diana_clarke has joined #openstack-nova13:17
*** satyar has quit IRC13:20
*** d9k has joined #openstack-nova13:21
*** iceyao has joined #openstack-nova13:22
*** salv-orlando has joined #openstack-nova13:22
*** ygl has joined #openstack-nova13:22
*** kaisers_ has quit IRC13:26
*** kaisers_ has joined #openstack-nova13:26
*** jpena is now known as jpena|lunch13:30
*** shardy_lunch is now known as shardy13:32
*** xyang1 has joined #openstack-nova13:33
*** andreas_s has quit IRC13:34
*** links has quit IRC13:36
*** artom has quit IRC13:37
*** faizy has joined #openstack-nova13:41
*** jheroux has joined #openstack-nova13:44
*** coreywright has quit IRC13:44
*** baoli has joined #openstack-nova13:46
*** wllabs has quit IRC13:46
*** owalsh-afk has quit IRC13:47
*** jsheeren has joined #openstack-nova13:47
*** jsheeren has quit IRC13:48
*** jaosorior has quit IRC13:50
*** liangy has joined #openstack-nova13:51
*** jaosorior has joined #openstack-nova13:51
*** slunkad has quit IRC13:52
*** prateek has quit IRC13:53
*** mdrabe has joined #openstack-nova13:54
*** owalsh-afk has joined #openstack-nova13:54
*** jaosorior has quit IRC13:56
*** jaosorior has joined #openstack-nova13:56
*** thorst_afk is now known as thorst_13:56
*** coreywright has joined #openstack-nova13:58
*** tbachman_ has quit IRC13:58
*** bhagyashris has left #openstack-nova13:59
*** tbachman has joined #openstack-nova13:59
*** bvanhav has quit IRC14:00
*** karimb has joined #openstack-nova14:01
*** gouthamr has joined #openstack-nova14:01
*** andymaier has joined #openstack-nova14:02
*** bvanhav has joined #openstack-nova14:02
*** jbernard has quit IRC14:03
*** jbernard has joined #openstack-nova14:04
*** yamamoto has joined #openstack-nova14:05
*** krtaylor has quit IRC14:06
*** eharney has joined #openstack-nova14:06
*** jamesdenton has joined #openstack-nova14:09
*** mdnadeem has quit IRC14:09
*** yamamoto has quit IRC14:11
openstackgerritMatt Riedemann proposed openstack/nova-specs master: Fix a couple of spec names  https://review.openstack.org/43246914:11
openstackgerritMatt Riedemann proposed openstack/nova-specs master: Fix paths when moving specs  https://review.openstack.org/43247014:11
openstackgerritMatt Riedemann proposed openstack/nova-specs master: Move implemented specs for Ocata  https://review.openstack.org/43247114:11
*** mriedem has quit IRC14:13
*** jamesdenton has quit IRC14:13
*** diga has quit IRC14:14
*** lucas-hungry is now known as lucasagomes14:18
*** moshele has joined #openstack-nova14:19
*** jaosorior has quit IRC14:22
*** moshele has quit IRC14:24
*** owalsh-afk is now known as owalsh14:25
*** mtanino has joined #openstack-nova14:28
*** jpena|lunch is now known as jpena14:28
*** burgerk has joined #openstack-nova14:28
*** amotoki has joined #openstack-nova14:30
*** READ10 has joined #openstack-nova14:30
*** jaosorior has joined #openstack-nova14:30
*** jamesdenton has joined #openstack-nova14:30
*** jsho has quit IRC14:31
*** dansmith is now known as superdan14:32
*** hfu has quit IRC14:32
*** felipemonteiro has joined #openstack-nova14:33
*** rmcadams has quit IRC14:34
*** rmcadams has joined #openstack-nova14:35
*** yassine_ has quit IRC14:35
*** yassine has joined #openstack-nova14:35
*** jsho has joined #openstack-nova14:35
*** artom has joined #openstack-nova14:35
*** yassine is now known as Guest7082414:35
openstackgerritArtom Lifshitz proposed openstack/nova-specs master: Virtual guest device role tagging  https://review.openstack.org/43539714:38
*** amotoki has quit IRC14:38
*** nkrinner is now known as nkrinner_afk14:40
*** amoralej is now known as amoralej|lunch14:41
*** agarner_away has quit IRC14:42
*** jwcroppe has joined #openstack-nova14:42
*** aleph1 has joined #openstack-nova14:43
*** iceyao has quit IRC14:43
*** esberglu has joined #openstack-nova14:44
*** zz_dimtruck is now known as dimtruck14:44
*** xinliang has quit IRC14:46
artomHas anyone with gmail solved the CI bot spam problem?14:47
artomGmail is retarded in that it applies filters to entire "conversations"14:47
artomSo while it filters out all the CIs spamming me, it also filters out the useful human reviews, and Jenkins, since they're in the same conversation14:48
*** tyrola has quit IRC14:48
*** ratailor has joined #openstack-nova14:48
*** tyrola has joined #openstack-nova14:49
sdagueartom: I found gmail filtering completely unuseful for gerrit, one of the reasons I moved over to fastmail14:50
artomsdague, very agree on point 1, will explore point 2, thanks :)14:51
*** dikonoor has quit IRC14:51
superdanI have found gmail useful for not very much14:52
*** mriedem has joined #openstack-nova14:53
*** tlian has joined #openstack-nova14:53
artomsuperdan, what do you use for the gerrit spam?14:54
superdanartom: sieve :)14:55
cdentsieve is too new and fancy, I use procmail :)14:55
superdanprocmail > gmail14:56
superdanwell, sieve > sliced bread > procmail > gmail14:56
openstackgerritSean Dague proposed openstack/nova master: Verify project id for flavor access calls  https://review.openstack.org/43543214:56
openstackgerritSean Dague proposed openstack/nova master: Verify project_id when quotas are checked  https://review.openstack.org/43501014:56
superdanto be complete14:56
artomsuperdan, oh, you're one of those14:56
artomWith their own email server14:56
artomDo you also grow your own wheat for bread? ;)14:56
superdanartom: I would if the store stopped selling good bread14:57
artomBut the store is giving the bread away14:57
artomIt just asks that you store all your personal paperwork in their vault14:57
superdanit's giving away bean bread14:57
superdanwhich is not really bread14:58
superdanit doesn't have slices, although it has lines to look like slices14:58
artomThis comparison is starting to break down, and I'm very confused14:58
*** xinliang has joined #openstack-nova14:58
superdanno real folders in gmail == no slices14:59
superdananyway, you keep using your store bought bread and I'll keep filtering gerrit spam14:59
*** jerrygb has quit IRC14:59
cdentartom: that (This comparison...) is  what the special guest on the superdan weeky comedy hour always says at the end of the show.14:59
*** jamesdenton has quit IRC14:59
*** jerrygb has joined #openstack-nova15:00
artomcdent, wait, there's a comedy show at the bread store now?15:00
artomHow does email fit into that? Is it the heckler?15:00
*** jamesdenton has joined #openstack-nova15:01
cdentMy brain is starting to break down, and I'm very confused.15:02
*** hongbin has joined #openstack-nova15:02
*** psachin has quit IRC15:04
*** jerrygb has quit IRC15:04
*** jsho has quit IRC15:12
*** lucasxu has joined #openstack-nova15:13
*** psachin has joined #openstack-nova15:15
*** tblakes has quit IRC15:17
des_consoladogah I'm trying to create instances and they just get stuck in the Spawning state and then eventually fail after ages, saying failed to provision instance15:18
openstackgerritJohn Garbutt proposed openstack/nova master: POC: improved policy functional tests  https://review.openstack.org/43548415:18
openstackgerritJohn Garbutt proposed openstack/nova master: POC: add context.check_scope  https://review.openstack.org/43548515:18
des_consoladosomething or other timed out etc15:18
*** amoralej|lunch is now known as amoralej15:18
des_consoladoI'm tailing every nova log and nothing interesting is there15:18
*** tblakes has joined #openstack-nova15:20
*** faizy has quit IRC15:22
*** armax has joined #openstack-nova15:23
*** salv-orlando has quit IRC15:23
artomdes_consolado, you're probably better off asking in #openstack, as this channel is for development, but it could be waiting for an external event. I've seen these symptoms before where a network-plugged event from Neutron didn't arrive, and the spawn timed out.15:23
des_consoladooh yeah I just read the topic, sorry15:25
*** bkopilov has joined #openstack-nova15:26
*** bkopilov_ has joined #openstack-nova15:26
des_consoladothe other openstack project channels don't seem to make as much of a point about that15:26
des_consoladoI also noticed the developers of given projects tend to have all the answers :P15:27
*** karimb has quit IRC15:28
*** sridharg has quit IRC15:28
mriedemdes_consolado: if it's a virtual interface exception / timeout thing in the n-cpu logs, then yes it's timing out waiting for the external vif plugged callback event from neutron as artom points out15:29
mriedemwhich probably means something is failing on the neutron side, check the neutron agent health status and logs15:29
*** bnemec is now known as beekneemech15:30
sdaguejohnthetubaguy: I respun with the drop on the delete call15:30
cdentmriedem: was there a change you pushed up as a result of your kvm-on-the-subnode debugging last night? I'd like to look at it if so.15:32
*** faizy has joined #openstack-nova15:32
mriedemyeah, sec15:33
mriedemcdent: https://review.openstack.org/#/c/435154/15:33
cdentthanks15:33
mriedemyour googling about nested kvm tipped me off15:33
mriedemthen i asked in infra and clarkb confirmed the nested kvm issue, and we found the problem in d-g15:33
mriedemmega bash15:33
mriedemwhat could go wrong15:34
*** marst has quit IRC15:34
*** marst has joined #openstack-nova15:34
cdentyour change was interesting enough to pull jo*go?15:34
*** dtp has joined #openstack-nova15:37
*** mlavalle has joined #openstack-nova15:37
*** liangy is now known as lyan15:39
*** marst has quit IRC15:39
*** databus23_ has joined #openstack-nova15:39
*** nkrinner_afk has quit IRC15:39
*** nkrinner_afk has joined #openstack-nova15:40
cdentmriedem: were you a good boy and search for 'localrc' where $localrc_file ought to be in the rest of the file, or only fix the presenting problem?15:40
mriedemcdent: i pinged him15:41
mriedemcdent: i did15:42
*** jvgrant__ has joined #openstack-nova15:42
cdent🍪15:43
*** ratailor has quit IRC15:45
*** jvgrant_ has quit IRC15:45
*** crushil has joined #openstack-nova15:46
*** marst has joined #openstack-nova15:46
*** armax has quit IRC15:48
*** bvanhav_ has joined #openstack-nova15:49
*** krtaylor has joined #openstack-nova15:49
*** bvanhav has quit IRC15:50
*** ijw has joined #openstack-nova15:53
*** psachin has quit IRC15:56
*** artom has quit IRC15:58
*** kylek3h has quit IRC15:58
*** kylek3h has joined #openstack-nova15:59
*** yamahata has joined #openstack-nova16:00
*** baoli has quit IRC16:01
*** kylek3h has quit IRC16:01
*** baoli has joined #openstack-nova16:01
mriedemyikes http://logs.openstack.org/11/349011/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial-ocata/bee08f9/logs/screen-n-api.txt.gz?level=TRACE#_2017-02-14_22_13_03_34516:01
mriedemPassing insecure dynamic vendordata requests because of missing or incorrect service account configuration.16:01
mriedemall over the logs16:01
*** kylek3h has joined #openstack-nova16:01
melwittI have noticed that too16:02
*** romainh has joined #openstack-nova16:02
melwitthaven't made time to look into it yet16:03
mriedemhttp://git.openstack.org/cgit/openstack/nova/tree/nova/api/metadata/vendordata_dynamic.py#n5216:04
mriedemwe should just log that once16:04
mriedemi'm reporting a bug16:05
mriedemif LP will stop timing out16:05
*** lpetrut has quit IRC16:07
melwittnice16:07
*** jdurgin1 has joined #openstack-nova16:07
*** tlian2 has joined #openstack-nova16:10
*** markus_z has quit IRC16:10
*** tlian has quit IRC16:12
sdaguemriedem: isn't that feature opt in?16:12
sdagueso if it's off, shouldn't we just not log16:13
mriedemhttps://bugs.launchpad.net/nova/+bug/166569316:13
openstackLaunchpad bug 1665693 in OpenStack Compute (nova) ""Passing insecure dynamic vendordata requests because of missing or incorrect service account configuration." warnings all over n-api logs" [Medium,Confirmed]16:13
*** bkopilov_ has quit IRC16:13
*** bkopilov has quit IRC16:13
mriedemsdague: maybe, i haven't dug in16:13
sdaguemriedem: I do agree, it's logging a lot16:14
*** tlian2 has quit IRC16:15
*** artom has joined #openstack-nova16:18
sdaguemriedem: if you get bored - https://review.openstack.org/#/c/435010/ is the code for the project_id enforcement16:19
sdaguewe get some review on it and I could probably have that in land state for next week. Early blueprint completion for the win.16:20
*** annegentle has joined #openstack-nova16:20
*** jpena is now known as jpena|brb16:20
*** karimb has joined #openstack-nova16:21
*** pcaruana has quit IRC16:21
*** Apoorva has joined #openstack-nova16:23
*** ababich has quit IRC16:23
*** salv-orlando has joined #openstack-nova16:24
mriedemsfinucan: did i answer your questions here? https://review.openstack.org/#/c/380433/16:25
*** rmart04 has quit IRC16:25
mriedemsdague: ok16:25
*** salv-orlando has quit IRC16:29
*** jaosorior has quit IRC16:30
mriedemsdague: when do you get into ATL?16:30
mriedemmtreinish: ^16:30
sdaguemriedem: like 9pm on Sunday16:30
mriedemgeez16:31
sdagueI can send you my tripit info if you like16:31
*** aarefiev has quit IRC16:32
sdaguemriedem: why, when are you getting in?16:33
*** chyka has joined #openstack-nova16:34
sdagueI think my reasonable options were this flight, or a super early in the morning one on Sunday, so I went with not having to wake up at unusual times16:34
*** rcernin has quit IRC16:35
*** andymaier has quit IRC16:35
mriedemsdague: comments in https://review.openstack.org/#/c/435010/16:36
mriedemsdague: 2:45 on sunday16:36
*** ygl has quit IRC16:38
*** sudipto_ has quit IRC16:39
*** sudipto has quit IRC16:39
*** tesseract has quit IRC16:41
mriedemi know why we're getting the billions of vendordata warnings then, it's because it's hit on each init of the InstanceMetadata object16:41
mriedemwhich is every server that gets created with config drive16:41
*** jamesdenton has quit IRC16:42
mriedemsdague: so can we just pick one of these options to tell if we can safely assume dynamic vendordata is just not configured to work? http://logs.openstack.org/11/349011/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial-ocata/bee08f9/logs/screen-n-api.txt.gz#_2017-02-14_21_31_00_83816:44
mriedemlike auth_section or auth_type?16:44
mriedemjamielennox: ^16:44
*** Oku_OS is now known as Oku_OS-away16:45
mriedemsounds like auth_section is optional16:45
mriedem" auth_section: the group from which further auth plugin options should be taken. If section is not provided then the auth plugin options will be taken from the same group as provided in the parameters.   "16:45
mriedembut auth_type has to be set right?16:45
mriedemlbragstad: ^?16:46
mriedemwell, i guess it doesn't matter, we can just log it once16:48
mriedemwe still make the requests, they just aren't with the service token16:48
*** jpena|brb is now known as jpena16:48
*** jdurgin1 has quit IRC16:53
*** faizy has quit IRC16:54
*** lyan has quit IRC16:54
*** fragatina has quit IRC16:54
*** artom has quit IRC16:55
lbragstadmriedem yes - i believe auth_type needs to be set16:55
*** figleaf is now known as edleafe16:56
*** baoli has quit IRC16:58
*** tblakes has quit IRC17:03
*** tblakes has joined #openstack-nova17:03
*** ZZelle_ has joined #openstack-nova17:04
*** liangy has joined #openstack-nova17:05
*** ijw has quit IRC17:05
*** baoli has joined #openstack-nova17:11
openstackgerritChris Dent proposed openstack/nova master: Update placement_dev with info about new decorator  https://review.openstack.org/43553917:13
sdaguemriedem: of course, by tightening up the exception handling, I can't use the testing exception :)17:13
*** nic has joined #openstack-nova17:15
cdentIs there a rule of thumb on when lack of response on a bug report is cause for marking invalid?17:16
sdaguecdent: if you set it to Incomplete, and remove assignee, it will expire in 60 days (IIRC)17:17
*** crushil has quit IRC17:17
cdentthanks17:18
*** artom has joined #openstack-nova17:19
*** mriedem1 has joined #openstack-nova17:20
*** mriedem has quit IRC17:21
*** mdrabe has quit IRC17:24
*** Hosam has quit IRC17:25
*** Hosam has joined #openstack-nova17:25
*** artom has quit IRC17:26
ildikovjohnthetubaguy: etherpad for the Cinder-Nova session next week: https://etherpad.openstack.org/p/ptg-pike-cinder-nova-session17:26
*** artom has joined #openstack-nova17:26
ildikovjohnthetubaguy: if you can get there please add a few bullet points for discussion, I will try to look into it too17:27
ildikovjohnthetubaguy: also safe travels and see you next week :)17:27
johnthetubaguyildikov: ah, cool, will try get into that17:27
ildikovjohnthetubaguy: thanks much17:27
*** derekh has quit IRC17:27
ildikovjohnthetubaguy: would be great to have a somewhat guided discussion17:28
*** annegentle has quit IRC17:28
johnthetubaguyildikov: +117:29
*** annegentle has joined #openstack-nova17:29
*** unicell has joined #openstack-nova17:31
openstackgerritmelanie witt proposed openstack/nova master: Skip soft-deleted records in 330_enforce_mitaka_online_migrations  https://review.openstack.org/43554617:31
*** unicell has quit IRC17:31
*** mdrabe has joined #openstack-nova17:32
*** lucasxu has quit IRC17:33
*** dimtruck is now known as zz_dimtruck17:33
*** artom has quit IRC17:36
*** salv-orlando has joined #openstack-nova17:40
zzfooHi, I'm trying to get live migration working. I have shared store setup and working with NFS though when i do a live migrate I get the following error in the nova-compute logs:  error:17:42
zzfooUnable to acquire lock on `/opt/stack/data/nova/instances/locks/nova-fd2836e4eef36d5483a37a5000a42a72fb95ea7c` due to [Errno 37] No locks available17:42
zzfooThe weird, thing is this lock file does exist17:43
*** lucasagomes is now known as lucas-afk17:43
zzfooany ideas why this is occurring? I also set the libvirtd group id to be the same across all the nodes and ls in this shared mount shows the same group ownerships17:43
*** zz_dimtruck is now known as dimtruck17:46
*** jerrygb_ has joined #openstack-nova17:46
*** cdent has quit IRC17:47
*** ssurana has joined #openstack-nova17:48
*** jerrygb has joined #openstack-nova17:50
*** jerrygb_ has quit IRC17:51
*** ssurana has quit IRC17:52
*** ssurana has joined #openstack-nova17:57
*** yamahata has quit IRC18:01
diana_clarkemriedem1: Do you know approximately how many people will be at the nova PTG?18:01
*** pbandark has joined #openstack-nova18:02
*** unicell has joined #openstack-nova18:03
*** romainh has quit IRC18:03
*** dtp has quit IRC18:06
*** artom has joined #openstack-nova18:07
*** ijw_ has joined #openstack-nova18:08
*** salv-orl_ has joined #openstack-nova18:10
*** salv-orlando has quit IRC18:12
*** shaner has quit IRC18:13
*** jpena is now known as jpena|away18:13
*** ijw_ has quit IRC18:15
*** fragatina has joined #openstack-nova18:17
*** tlian has joined #openstack-nova18:18
*** armax has joined #openstack-nova18:19
*** ociuhandu has quit IRC18:20
*** shaner has joined #openstack-nova18:20
*** ijw has joined #openstack-nova18:20
*** annegentle has quit IRC18:21
*** mlavalle has quit IRC18:22
*** jamesdenton has joined #openstack-nova18:23
*** crushil has joined #openstack-nova18:30
*** mriedem1 is now known as mriedem18:30
mriedemdiana_clarke: i do not18:30
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Only log vendoradata_dynamic auth warning once  https://review.openstack.org/43556318:32
openstackgerritJohn Garbutt proposed openstack/nova-specs master: Add additional-default-policy-roles spec  https://review.openstack.org/42787218:34
openstackgerritJohn Garbutt proposed openstack/nova-specs master: Add policy-remove-scope-checks spec  https://review.openstack.org/43303718:34
mriedema shiny nickel to whoever can figure out why my unit test is failing in ^18:36
*** bvanhav__ has joined #openstack-nova18:37
*** bvanhav__ is now known as bvanhav18:37
openstackgerritJohn Garbutt proposed openstack/nova-specs master: Add policy-docs spec  https://review.openstack.org/43301018:37
*** ltomasbo is now known as ltomasbo|away18:37
openstackgerritJohn Garbutt proposed openstack/nova-specs master: Add policy-remove-scope-checks spec  https://review.openstack.org/43303718:38
openstackgerritJohn Garbutt proposed openstack/nova-specs master: Add additional-default-policy-roles spec  https://review.openstack.org/42787218:38
*** bvanhav_ has quit IRC18:38
*** yamahata has joined #openstack-nova18:39
sdaguemriedem: because something else managed to set that global already18:39
mriedemgah18:39
mriedemok i knew i needed to mock that out at some point in here too18:40
mriedemsdague: i owe you a nickel18:40
mriedem:)18:40
*** sambetts is now known as sambetts|afk18:42
openstackgerritPushkar Umaranikar proposed openstack/nova master: Placement api: set custom json_error_formatter in resource_class  https://review.openstack.org/43046318:50
openstackgerritEric Fried proposed openstack/nova master: WIP(5): PowerVM driver: ovs vif  https://review.openstack.org/42251218:52
*** owalsh has quit IRC18:55
zzfooAny ideas why I'm getting this trace on live migrate: http://paste.openstack.org/show/599457/18:57
zzfoo MigrationError_Remote: Migration error: failed to detect a valid IP address from ''18:57
thorst_zzfoo: not sure...that looks like a controller (possibly AMQP) error?18:57
artomzzfoo, it almost looks as though one of your computes disappeared from the network19:00
zzfooThe exception is actually even longer here's the full thing: http://paste.openstack.org/show/599459/19:01
* sdague looks to what I missed in the review 19:01
*** kylek3h is now known as kylek3h_away19:02
cburgessmriedem *ping*19:03
openstackgerritEric Fried proposed openstack/nova master: WIP(6): Introduce base PowerVM driver (ssp drv)  https://review.openstack.org/42259419:03
-openstackstatus- NOTICE: Restarting gerrit due to performance problems19:03
mriedemcburgess: pong19:04
zzfooon the other side of the live migrate it gets this error: http://paste.openstack.org/show/599460/19:04
cburgessmriedem Food stuff: So neither of those BBQ places take reservations, we could try and get in. I would recommend trying Sweet Auburn as its a tad closer. But.. both at 3 miles away and thats going to be a long walk, also as edleafe pointed out there are some non-meat eaters.19:05
mriedemsdague: yeah i suppose we don't need to even setup the ksa session stuff for vendordata if CONF.api.vendordata_dynamic_targets is not set19:05
mriedemsince we won't have any targets to hit19:05
cburgessmriedem So... another option would be https://www.tedsmontanagrill.com Its less then a mile and has a more varied menu.19:05
superdanmriedem: I think you might have looked at this "cell not found for instance" error before: http://logs.openstack.org/62/433362/5/check/gate-tempest-dsvm-cells-ubuntu-xenial/ac9584a/logs/screen-n-cell-child.txt.gz#_2017-02-16_22_40_43_88219:06
superdanmriedem: from what I see there the instance is getting deleted in the middle of something, so maybe that is expected, but I'm seeing it bubble out of the api nine times there19:06
superdanmriedem: so it must be related to my patch, but I'm not sure why19:07
mriedemcburgess: sure, that's a 10 min walk from the sheraton, decent review19:07
mriedem*reviews19:07
*** dharinic is now known as dharinic|lunch19:07
mriedemsuperdan: hmm cells v1 yeah19:07
mriedemsuperdan: it is a negative test...19:08
cburgessmriedem Yeah there are a few in ATL I've been to one twice and its not bad. The BBQ is better but Ted's is closer and I can try and see if we can get a reso. I'll call them today.19:08
superdanmriedem: yeah,19:08
openstackgerritSean Dague proposed openstack/nova master: Verify project id for flavor access calls  https://review.openstack.org/43543219:08
openstackgerritSean Dague proposed openstack/nova master: Verify project_id when quotas are checked  https://review.openstack.org/43501019:08
mriedemcburgess: it doesn't look like ted's is vegan/vegetarian/gluten free friendly either19:08
mriedembut maybe they have an eraser people can eat19:08
superdanmriedem: so maybe that trace is incidental to the negative test and these others are silently failing I guess19:09
mriedemyeah it looks like http://logs.openstack.org/62/433362/5/check/gate-tempest-dsvm-cells-ubuntu-xenial/ac9584a/console.html#_2017-02-16_22_58_39_396399 is the test failure19:09
mriedemthe snapshot test19:09
mriedemi've seen that one fail plenty in the cells v1 job19:09
mriedemalthough i'm seeing lots of this in the console log19:10
superdanyeah19:10
mriedemDetails: {u'code': 404, u'message': u'Cell is not known for instance 518086f2-4bf8-412e-9758-8d66947b8668'}19:10
superdanright19:10
mriedemi guess that's what you're debugging19:10
superdanthat's a cellsv1 error19:10
cburgessmriedem THey have a gluten free menu https://www.tedsmontanagrill.com/menu/download/TMGGlutenFreeMenu.pdf19:10
superdanyeah19:10
cburgessmriedem They have a lot of fish and salads. Vegans though will probably have a hard time but I'm not sure of a vegan place in downtown (the BBQ places surely wouldn't work either).19:11
mriedemthere may be some random roots growing between buildings downtown19:11
cburgessmriedem  Indeed19:12
superdanmriedem: that patch is only changing the rest api which really shouldn't know or care or influence any of the cells stuff below19:12
superdanso maybe I'll recheck it and see if it's the same set of failures or not19:12
*** bjolo_ has joined #openstack-nova19:15
*** READ10 has quit IRC19:17
*** mlavalle has joined #openstack-nova19:27
*** annegentle has joined #openstack-nova19:30
openstackgerritJohn L. Villalovos proposed openstack/nova master: Use flake8-import-order  https://review.openstack.org/43557519:32
*** armax has quit IRC19:33
openstackgerritSean Dague proposed openstack/nova master: Verify project id for flavor access calls  https://review.openstack.org/43543219:37
openstackgerritSean Dague proposed openstack/nova master: Verify project_id when quotas are checked  https://review.openstack.org/43501019:37
*** ociuhandu has joined #openstack-nova19:37
*** owalsh has joined #openstack-nova19:39
*** owalsh is now known as owalsh-afk19:39
*** dtp has joined #openstack-nova19:44
*** claudiub has joined #openstack-nova19:46
*** fragatina has quit IRC19:47
*** lpetrut has joined #openstack-nova19:48
*** rfolco has quit IRC19:51
melwittmriedem, superdan: I have a patch up for a blocker migration that operators can get stuck on upgrading from mitaka -> newton if they have soft-deleted records https://review.openstack.org/43554619:55
superdanoh yeah19:55
*** annegentle has quit IRC19:55
superdanmriedem: that one needs to get in19:55
*** dharinic|lunch is now known as dharinic19:56
*** annegentle has joined #openstack-nova19:57
openstackgerritMatt Riedemann proposed openstack/nova master: Only create vendordata_dynamic ksa session if needed  https://review.openstack.org/43556320:00
mriedemi don't want to actually think today20:00
mriedemthat needs to go back to stable/newton?20:00
mriedembecause we haven't released https://review.openstack.org/#/c/434928/ yet20:00
superdanit does yeah20:01
mriedembtw, this just again goes to show how much no one is event close to trunk20:01
superdanmriedem: well, it's actually probably not very common20:01
superdanmriedem: but definitely hit-able20:01
mriedemlet me read up on the bug report and such20:02
superdanit would only happen if you completely decommissioned compute nodes and never replaced them20:02
melwittit can also happen if you've ever deleted aggregates or pci devices. it's just that wasn't the case in our real world example20:03
superdanmelwitt: yeah, true I guess I forgot about those since the CN was the issue in the bug20:04
melwittsuperdan: yeah. I was debating whether to fix it only for compute_nodes or for the other tables too. I figured it's the same problem, and that assumes no apis ever read those soft-deleted records for anything later. I don't think they do20:05
mriedemin the red hat bugzilla i guess20:05
mriedemso i guess,20:05
superdanwas the aggregate move to api in ocata?20:05
melwittI thought it was earlier20:06
melwittI mean, it's definitely before ocata20:06
superdanmelwitt: if so we can't have deleted aggregates20:06
mriedemnewton20:06
mriedemhttps://github.com/openstack/nova/commit/35748e7a9b3445a60522e088e38bf25e6bfef25e20:06
mriedemi was thinking it's odd to update the migration itself,20:06
mriedembut i guess if you're stuck on 330,20:06
mriedemthen you can't get past that anyway20:06
superdanI guess that move happens after the sync though, if they both happened in newton20:06
superdanmriedem: yeah20:06
superdanmriedem: the other option is to convert all the deleted records, but that's kinda silly20:07
melwittthere's a REST API for deleting an aggregate https://developer.openstack.org/api-ref/compute/?expanded=delete-aggregate-detail#delete-aggregate20:07
superdanespecially if we're about to delete them in the case of aggregates20:07
melwittso if that connects to an Aggregate.destroy(), that would do it20:07
superdanmelwitt: right, but once they're in the api db they can;t be soft deleted20:07
*** crushil has quit IRC20:07
melwittah, that's what you meant. yeah20:07
mriedemso in mitaka i deleted a compute node,20:07
mriedemactually i need to see the online migration code first20:08
melwittyeah, I have links up still I think20:08
melwittthe online migration only migrates non-soft-deleted things and the blocker doesn't filter on deleted=0 so it just gets everything20:08
mriedemwhat does https://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L595 have to do with compute nodes?20:09
mriedemyou guys got some out of tree online migrations?20:09
mriedemor is it just this? https://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L59720:09
mriedemdb.aggregate_uuids_online_data_migration,20:10
mriedemthat's the only mitaka one in that list20:10
mriedemi should be looking at stable/newton i guess https://github.com/openstack/nova/blob/stable/newton/nova/cmd/manage.py#L78620:10
melwittno, it looks like we removed the compute nodes one20:10
mriedemwhich includes pci devices20:10
melwittafter20:10
melwittyeah20:10
*** ssurana has quit IRC20:11
mriedemoh nvm i see https://github.com/openstack/nova/blob/stable/mitaka/nova/cmd/manage.py#L93020:11
mriedemin mitaka we had an online migration for compute nodes20:11
mriedemfor the uuid20:11
mriedemhttps://github.com/openstack/nova/blob/stable/mitaka/nova/db/sqlalchemy/api.py#L653120:12
mriedemso that online migration can get soft deleted compute nodes with no uuid20:12
mriedemright?20:12
*** smatzek has quit IRC20:13
melwittthe online migration does not migrate soft-deleted compute nodes with no uuid20:13
melwittso I thought our choices are: migrate even soft-deleted things or skip soft-deleted things in the blocker20:13
mriedembecause of model_query20:14
mriedemi suppose20:14
melwittyeah20:14
melwittmodel_query defaults to read_deleted='no'20:14
mriedemand the context doesn't have read_deleted='yes' or whatever20:14
mriedemok20:14
mriedemyup20:14
mriedemok so in mitaka we have soft deleted compute_nodes, online data migration doesn't get them b/c of model_query, but 330 blocked migration pulls them in b/c it's not using the orm and it explodes20:14
mriedembecause we don't filter on deleted==020:15
melwittthe only gotcha would be if it were valid for any of those objects: compute nodes, aggregates, pci devices to be read in a deleted state20:15
mriedemwhich is your fix20:15
melwittright20:15
mriedemgeez melwitt your commit message could have been several more paragraphs of explanation :)20:15
melwittbecause this fix would leave the soft-deleted unmigrated records around. the alternate fix would migrate potentially a lot of soft-deleted things for no reason20:16
mriedemwe don't read deleted on any of those records as far as i know20:16
melwittmriedem: yeah, sorry about that. I can add more info to it20:16
mriedemmelwitt: i'm only half joking20:16
mriedem:)20:16
melwittyeah, that's what I thought too20:16
mriedemsuperdan: do you know if we read deleted any of those?20:17
superdanon compute nodes?20:17
melwittaggregates and pci devices also20:17
mriedemi have like 1% knowledge of the pci_devices code20:17
superdandefinitely not pci_devices20:17
superdanmelwitt: if we did read aggregates, we'd generate on load: https://github.com/openstack/nova/blob/stable/newton/nova/objects/aggregate.py#L28820:18
superdanso we're okay20:18
melwittah, nice20:18
mriedemwe mostly read deleted instances20:20
*** gszasz has quit IRC20:20
mriedemso yeah i think we're ok there20:20
mriedemand flavors20:21
*** moshele has joined #openstack-nova20:22
mriedemjust testing the test quick20:24
mriedemdo we want/need a release note for this?20:24
mriedemsince it's going to be backported20:24
mriedemlike even a "fixes" note or "upgrade" note? as i said earlier, if you hit this you can't get past 330 anyway20:24
mriedemso this is more about fixing it before people hit it20:25
mriedemlast time we backported a db schema migration to stable and released it i got some flak from red hat20:25
*** rfolco has joined #openstack-nova20:26
*** rfolco has quit IRC20:26
*** bvanhav has quit IRC20:27
superdanthis isn't backporting a new one,20:27
superdanit's just tweaking an old one,20:28
mriedemi know20:28
superdanwhich we did in ocata too20:28
mriedemmelwitt: see my comment in the test20:28
superdanbut release notes are cool20:28
* melwitt looks20:29
mriedemso the test doesn't fail on the aggregate b/c you're using an object, which creates the aggregate in the api db20:29
mriedemi don't know why it doesn't fail on the compute node when i remove your fi20:29
mriedem*fix20:29
melwittoh, hm20:29
superdanmriedem: it's because it has a uuid20:29
superdanmriedem: if you reate it20:29
mriedemah20:29
superdanI'm thinking20:29
mriedemyup20:29
superdanshe'd have to use the db api20:29
melwittokay, let me fix this to put things in the old db20:29
mriedemyup20:30
mriedempci device object one is fine20:30
mriedembut use the db api directly for the compute notes and aggregates20:30
melwittright20:30
mriedemfwiw i've put a hold on https://review.openstack.org/#/c/434928/ until we get this backported and merged20:30
diana_clarkemelwitt: Here's an easy review that fixes up the mismatch in metavars you noticed a couple of weeks back: https://review.openstack.org/#/c/431714/20:33
*** moshele has quit IRC20:34
diana_clarkeHave a blast at the PTG, folks!20:34
*** salv-orl_ has quit IRC20:35
*** amoralej is now known as amoralej|off20:37
*** crushil has joined #openstack-nova20:38
openstackgerritEric Fried proposed openstack/nova master: PowerVM Driver: console  https://review.openstack.org/40940220:42
diana_clarkemelwitt: And here are some manual testing notes that should make that easier to review: http://paste.openstack.org/show/598292/20:42
diana_clarke(anyhoo, no pressure, just cleaning up my TODO list)20:43
*** jerrygb has quit IRC20:44
melwittdiana_clarke: okay, thanks20:46
*** ssurana has joined #openstack-nova20:46
diana_clarkelol, I just read "python-wsmanclient" as "python-womanclient"...20:46
*** mtanino has quit IRC20:51
*** fragatina has joined #openstack-nova20:55
*** ducttape_ has quit IRC20:57
mriedemwalmartclient20:57
*** ducttape_ has joined #openstack-nova20:57
*** jdurgin has quit IRC20:58
*** pbandark has quit IRC21:00
*** bkopilov has joined #openstack-nova21:04
*** bkopilov_ has joined #openstack-nova21:04
*** browne has joined #openstack-nova21:05
*** haplo37 has quit IRC21:06
*** ducttape_ has quit IRC21:09
*** haplo37_ has quit IRC21:09
*** annegentle has quit IRC21:10
openstackgerritAnusha Unnam proposed openstack/nova master: Stop using mox from tests/unit/test_service.py  https://review.openstack.org/33439521:11
*** armax has joined #openstack-nova21:14
*** jdurgin has joined #openstack-nova21:16
*** crushil has quit IRC21:18
*** haplo37 has joined #openstack-nova21:18
*** haplo37_ has joined #openstack-nova21:19
*** dmsimard has left #openstack-nova21:20
*** crushil has joined #openstack-nova21:21
*** tbachman has quit IRC21:21
*** dimtruck is now known as zz_dimtruck21:22
openstackgerritDan Smith proposed openstack/nova master: DNM: Find InstanceUnknownCell instances  https://review.openstack.org/43560021:24
*** Jeffrey4l_ has joined #openstack-nova21:34
*** burgerk has quit IRC21:34
*** Jeffrey4l has quit IRC21:34
openstackgerritDan Smith proposed openstack/nova master: DNM: Find InstanceUnknownCell instances  https://review.openstack.org/43560021:35
*** annegentle has joined #openstack-nova21:37
openstackgerritSujitha proposed openstack/nova master: Remove mox from nova/tests/unit/api/openstack/compute/test_create_backup.py  https://review.openstack.org/43561021:38
*** fragatin_ has joined #openstack-nova21:38
openstackgerritSean Dague proposed openstack/nova master: Verify project id for flavor access calls  https://review.openstack.org/43543221:38
openstackgerritSean Dague proposed openstack/nova master: Verify project_id when quotas are checked  https://review.openstack.org/43501021:38
*** fragatina has quit IRC21:40
*** annegentle has quit IRC21:41
openstackgerritAnusha Unnam proposed openstack/nova master: Remove mox from nova/tests/unit/objects/test_service.py  https://review.openstack.org/43561121:42
*** bjolo_ has quit IRC21:51
*** thorst_ has quit IRC21:53
*** tbachman has joined #openstack-nova21:53
*** jamesdenton has quit IRC21:54
*** ducttape_ has joined #openstack-nova21:56
*** liangy has quit IRC21:57
*** jerrygb has joined #openstack-nova21:57
*** amotoki has joined #openstack-nova21:57
*** amotoki has quit IRC21:58
*** amotoki has joined #openstack-nova21:59
*** amotoki has quit IRC21:59
*** cfriesen has quit IRC22:02
*** jerrygb has quit IRC22:03
*** Guest70824 has quit IRC22:03
*** Guest70824 has joined #openstack-nova22:03
*** sterdnotshaken has joined #openstack-nova22:06
openstackgerritSean Dague proposed openstack/nova master: Verify project id for flavor access calls  https://review.openstack.org/43543222:09
openstackgerritSean Dague proposed openstack/nova master: Verify project_id when quotas are checked  https://review.openstack.org/43501022:09
openstackgerritmelanie witt proposed openstack/nova master: Skip soft-deleted records in 330_enforce_mitaka_online_migrations  https://review.openstack.org/43554622:09
*** gouthamr has quit IRC22:11
*** fragatin_ has quit IRC22:16
*** dave-mccowan has quit IRC22:17
*** fragatina has joined #openstack-nova22:17
*** crushil has quit IRC22:19
*** edmondsw has quit IRC22:23
melwittmriedem, superdan: fixed the unit test ^22:24
*** jheroux has quit IRC22:24
mriedemyup just pulling it down22:24
*** avolkov has quit IRC22:25
*** salv-orlando has joined #openstack-nova22:26
*** esberglu has quit IRC22:29
*** tblakes has quit IRC22:32
*** Hosam has quit IRC22:33
*** baoli has quit IRC22:33
*** gouthamr has joined #openstack-nova22:34
*** dtp has quit IRC22:35
jamielennoxmriedem: you want auth_type, auth_section allows you to move auth options to a new ini section so you can reuse them22:35
mriedemjamielennox: yup, thanks. turns out i don't need that check anyway22:37
mriedembut good to know22:37
mriedemmelwitt: superdan: +2 on that fix now22:39
mriedemmelwitt: want to start the backport shenanigans?22:39
melwittmriedem: thanks. yeah, sure22:40
*** jwcroppe has quit IRC22:40
*** esberglu has joined #openstack-nova22:47
*** zz_dimtruck is now known as dimtruck22:49
*** esberglu has quit IRC22:52
*** liverpooler has quit IRC22:52
*** liangy has joined #openstack-nova22:54
*** edmondsw has joined #openstack-nova22:55
*** ducttape_ has quit IRC22:56
*** edmondsw has quit IRC22:59
*** jerrygb has joined #openstack-nova23:00
*** xyang1 has quit IRC23:02
superdanguh23:04
superdanI see why the cells job is failing23:04
*** jwcroppe has joined #openstack-nova23:05
mriedemwhat it be?23:06
*** ducttape_ has joined #openstack-nova23:06
superdanthat change makes us skirt around the cellsv1 replication23:07
superdanso we can only target if we're non-cellsv123:07
openstackgerritDan Smith proposed openstack/nova master: Make servers API use cell-targeted context  https://review.openstack.org/43336223:07
openstackgerritDan Smith proposed openstack/nova master: DNM: Find InstanceUnknownCell instances  https://review.openstack.org/43560023:07
superdanwhich we did in the get and list case, it was just a while ago and I kinda forgot about why that matters23:07
melwittah, yeah23:08
*** jwcroppe has quit IRC23:09
*** mdrabe has quit IRC23:10
*** ijw has quit IRC23:18
*** jdurgin has quit IRC23:19
*** burt has quit IRC23:20
*** catintheroof has quit IRC23:21
*** armax has quit IRC23:22
*** catintheroof has joined #openstack-nova23:22
*** lpetrut has quit IRC23:23
mriedemsuperdan: +2 on those backports https://review.openstack.org/#/q/I2285005098b7dab7753366f53667ff8d4532d668,n,z23:25
mriedemand now i'm getting the f out of here23:25
*** mriedem has quit IRC23:26
*** ducttape_ has quit IRC23:26
*** catintheroof has quit IRC23:26
*** thorst has joined #openstack-nova23:27
*** ZZelle_ has quit IRC23:30
*** claudiub|2 has joined #openstack-nova23:30
*** thorst has quit IRC23:32
*** claudiub has quit IRC23:32
*** jdurgin has joined #openstack-nova23:34
*** ducttape_ has joined #openstack-nova23:38
*** marst has quit IRC23:41
openstackgerritDan Smith proposed openstack/nova master: Make servers API use cell-targeted context  https://review.openstack.org/43336223:43
*** Guest70824 has quit IRC23:45
openstackgerritAnusha Unnam proposed openstack/nova master: Remove mox from nova/tests/unit/objects/test_service.py  https://review.openstack.org/43561123:48
*** liangy has quit IRC23:48
*** marst has joined #openstack-nova23:55
openstackgerritSujitha proposed openstack/nova master: Remove mox from nova/tests/unit/api/openstack/compute/test_create_backup.py  https://review.openstack.org/43561023:56
*** Guest70824 has joined #openstack-nova23:57
*** smatzek has joined #openstack-nova23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!