Wednesday, 2018-10-10

*** tetsuro has joined #openstack-placement00:24
*** tetsuro has quit IRC01:00
*** openstackgerrit has quit IRC01:37
*** rubasov has quit IRC01:37
*** jroll has quit IRC01:37
*** vdrok has quit IRC01:37
*** jaypipes has quit IRC01:37
*** sean-k-mooney has quit IRC01:37
*** edleafe has quit IRC01:37
*** gibi has quit IRC01:37
*** mgagne has quit IRC01:37
*** efried has quit IRC01:37
*** belmoreira has quit IRC01:37
*** yikun has quit IRC01:37
*** stephenfin has quit IRC01:37
*** melwitt has quit IRC01:37
*** bauzas has quit IRC01:37
*** mnaser has quit IRC01:37
*** dims has quit IRC01:37
*** alex_xu has quit IRC01:37
*** purplerbot has quit IRC01:37
*** dansmith has quit IRC01:37
*** smcginnis has quit IRC01:37
*** ChanServ has quit IRC01:37
*** vdrok has joined #openstack-placement01:43
*** jroll has joined #openstack-placement01:43
*** rubasov has joined #openstack-placement01:43
*** smcginnis has joined #openstack-placement01:43
*** dansmith has joined #openstack-placement01:43
*** purplerbot has joined #openstack-placement01:43
*** alex_xu has joined #openstack-placement01:43
*** melwitt has joined #openstack-placement01:44
*** efried has joined #openstack-placement01:44
*** belmoreira has joined #openstack-placement01:44
*** openstackgerrit has joined #openstack-placement01:44
*** yikun has joined #openstack-placement01:45
*** stephenfin has joined #openstack-placement01:45
*** edleafe has joined #openstack-placement01:45
*** sean-k-mooney has joined #openstack-placement01:45
*** gibi has joined #openstack-placement01:45
*** mnaser has joined #openstack-placement01:46
*** bauzas has joined #openstack-placement01:46
*** ChanServ has joined #openstack-placement01:47
*** card.freenode.net sets mode: +o ChanServ01:47
*** mgagne has joined #openstack-placement01:49
*** Guest10461 has joined #openstack-placement01:49
*** tetsuro has joined #openstack-placement02:03
*** takashin has joined #openstack-placement02:11
openstackgerritSundar Nadathur proposed openstack/nova-specs master: Nova Cyborg interaction specification.  https://review.openstack.org/60395504:27
openstackgerritTetsuro Nakamura proposed openstack/nova-specs master: Spec: Support filtering by forbidden aggregate  https://review.openstack.org/60335206:37
*** helenafm has joined #openstack-placement06:47
*** tssurya has joined #openstack-placement06:47
*** tssurya has quit IRC07:01
*** vdrok has quit IRC07:07
*** vdrok has joined #openstack-placement07:08
*** mgagne has quit IRC07:09
*** mgagne has joined #openstack-placement07:10
*** jroll has quit IRC07:10
*** jroll has joined #openstack-placement07:12
*** ttsiouts has joined #openstack-placement07:12
*** helenafm has quit IRC07:32
*** mgagne has quit IRC07:34
*** ttsiouts has quit IRC07:35
*** mgagne has joined #openstack-placement07:36
*** ttsiouts has joined #openstack-placement07:59
*** ttsiouts has quit IRC08:05
*** ttsiouts has joined #openstack-placement08:08
*** ttsiouts has quit IRC08:14
*** ttsiouts has joined #openstack-placement08:21
*** tetsuro has quit IRC08:46
*** belmorei_ has joined #openstack-placement08:57
openstackgerritBalazs Gibizer proposed openstack/nova-specs master: Remove force flag from live-migrate and evacuate  https://review.openstack.org/60933008:58
*** belmoreira has quit IRC09:00
openstackgerritYikun Jiang proposed openstack/nova-specs master: Support initial allocation ratios  https://review.openstack.org/55210509:35
bauzasgibi: I have a weird internal bug about the fact that a compute UUID != resource_provider UUID09:43
bauzasgibi: for an upgrade09:43
bauzasgibi: do you know if we can easily fix it by updating the DB to modify the RP UUID ?09:43
gibibauzas: I've never tried it so I'm not sure. Nova has a provider tree cache but if the UUID doesn't match then that cache is not filled10:19
*** ttsiouts has quit IRC10:20
gibibauzas: if there is no force live migration in progress from / to this compute then I think nova does not have knowledge the old RP UIID10:21
gibibauzas: the live_migrate task has a held_allocations field that holds allocation during the migration10:21
*** ttsiouts has joined #openstack-placement10:32
*** belmorei_ has quit IRC10:46
*** belmoreira has joined #openstack-placement10:48
*** e0ne has joined #openstack-placement10:51
*** ttsiouts has quit IRC10:53
*** ttsiouts has joined #openstack-placement10:53
*** ttsiouts has quit IRC10:58
*** takashin has left #openstack-placement11:01
*** alex_xu has quit IRC11:09
*** alex_xu has joined #openstack-placement11:12
*** ttsiouts has joined #openstack-placement11:17
bauzasgibi: thanks, yeah I know the fact we look at the existing RP11:55
*** belmoreira has quit IRC12:05
*** belmoreira has joined #openstack-placement12:08
*** jaypipes has joined #openstack-placement12:47
*** mriedem has joined #openstack-placement12:58
openstackgerritYikun Jiang proposed openstack/nova-specs master: Support initial allocation ratios  https://review.openstack.org/55210513:24
bauzashah13:53
bauzasit took me a while but I found some bug13:53
bauzashttps://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L58613:53
bauzasvs. https://github.com/openstack/nova/blob/master/nova/api/openstack/placement/handlers/resource_provider.py#L11213:54
bauzasefried: ^13:55
efried...13:55
bauzaswhen we look at the conflict in the response, it's not the same13:55
bauzasthat's 2 days I'm trying to understand why it doesn't accept a RP UUID modification13:56
efriedbauzas: Mm, wonder how that slipped through. Bug it!13:58
bauzasyup, just doing it13:58
bauzasefried: mmm, that's interesting14:06
bauzasefried: I'm trying to reproduce the issue on my local devstack but then I get an exception14:06
efriedbauzas: what exception?14:08
bauzasefried: dc8ff6314:11
bauzasshit14:11
bauzasefried: https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L68514:11
bauzaswhich is because we return None from _create_resource_provider()14:11
*** e0ne has quit IRC14:12
efriedwhich we do when we try to _get_resource_provider and get 40414:12
bauzassure, but when we got a 404 for GET, then we try to POST a new one, and in case we get a 408, we look at the response14:13
bauzas409*14:13
efried_get_resource_provider happens twice14:14
bauzasso, looks like the conditional works on my devstack, while on some pike internal, it doesn't14:14
bauzasI know14:14
efriedI'm talking about the second one14:14
bauzasin create ?14:14
efriedno, from _ensure14:14
bauzasoops sorry yeah I meant that14:16
efriedbauzas: So the repro looks like this:14:25
efried- Create a provider with name 'foo'14:25
efried- Run _ensure with name 'foo' and a new UUID14:25
efriedThis should cause _create to call _get, which will return None, causing _ensure to raise ResourceProviderCreationFailed14:25
efriedWhich is what you were seeing, right?14:25
bauzasI get this on my devstack14:29
bauzasbut I don't see this behaviour on a pike install :)14:29
bauzasefried: it just goes thru this section of code https://github.com/openstack/nova/blob/stable/pike/nova/scheduler/client/report.py#L457-L46514:29
efriedwell, that code wasn't developed in pike, was it?14:30
bauzasefried: but I know, from looking up the DB, that the RP exists with the same name but a different UUID14:30
bauzasefried: it was14:30
bauzaspike and master are similar14:30
efriedoh, yeah, I see the pike backport.14:31
efriedWell, the handler side wasn't backported.14:33
efriedThe previous rev would have been the same, but I didn't go back further than that.14:33
efriedUnfortunately I'm in meeting hell for basically the rest of the day, so will be unable to help nail this down.14:33
bauzaswhich handler backport ?14:34
bauzasanyway, looks like my customer will be happy if I'm asking to update the DB directly14:34
bauzassince even if we miss something in pike, the only way to solve this is to amend the RP record manually because of the duplicate name14:34
bauzasefried: ^ fair enough to say ?14:35
bauzas(and I feel your pain for the meeting stuff, my whole week since Monday is full of downstream stuff)14:35
efriedbauzas: are you on latest pike?14:38
*** ttsiouts has quit IRC14:40
efrieddoesn't matter, afaict there was never such a message. Really don't know how that ended up in there :(  :(  :(14:41
bauzasefried: it runs 16.1.4 but whatever14:43
bauzasefried: like I said, in case the RP has a new UUID for some reason but the same name, the only way to fix it to SQL IT14:44
bauzasSQL it*14:44
efriedbauzas: Nooo, surely we can run an explicit PUT?14:44
efrieddon't need to go directly to the database?14:44
efrieddoes the conflicting provider have allocations against it?14:45
bauzasefried: yup14:46
*** ttsiouts has joined #openstack-placement14:46
efriedAnd what are you actually trying to do, make it have a different name, or make it have a different UUID?14:46
bauzasefried: for some reason that I don't know, the UUID changed for this RP14:48
bauzasnow the compute asks for a UUID that placement dones't know14:49
efriedthat's really weird.14:50
*** e0ne has joined #openstack-placement14:58
*** ttsiouts has quit IRC15:21
*** ttsiouts has joined #openstack-placement15:21
*** ttsiouts has quit IRC15:26
*** Guest10461 is now known as dims15:44
*** e0ne has quit IRC15:47
*** e0ne has joined #openstack-placement15:50
openstackgerritChris Friesen proposed openstack/nova-specs master: Add support for emulated virtual TPM  https://review.openstack.org/57111115:57
*** tssurya has joined #openstack-placement16:33
*** e0ne has quit IRC16:41
*** tssurya has quit IRC17:46
*** e0ne has joined #openstack-placement19:22
openstackgerritMerged openstack/nova-specs master: Update blueprint name so spec matches launchpad  https://review.openstack.org/60734719:25
openstackgerritJack Ding proposed openstack/nova-specs master: High Precision Event Timer (HPET) on x86 guests  https://review.openstack.org/60798920:36
openstackgerritJack Ding proposed openstack/nova-specs master: High Precision Event Timer (HPET) on x86 guests  https://review.openstack.org/60798920:36
*** e0ne has quit IRC21:06
*** mriedem has quit IRC23:18
*** takashin has joined #openstack-placement23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!