Thursday, 2022-05-12

EugenMayerToday it happened the second time. A VM has been shutdown - by the audit logs by the user '-' - and i do not understand what that is and what that is causing this. Are there any ways to find out. is '-' a systemic users, or what could this stand for?06:26
EugenMayerFound this https://serverfault.com/questions/783053/openstack-instances-power-off-by-itself - not sure that is related in some way06:28
SharathCk_Hi, I am trying to enable Keystone audit middleware in our openstack services, But I can see placement does not contain api paste init conf or any other configuration where middleware can be added. Hence wanted to confirm whether keystone audit middleware is supported in Placement service.07:08
bauzasgood morning Nova07:58
Ugglabauzas, I was looking at "new" upstream bugs. Is it normal that https://bugs.launchpad.net/nova/+bug/1787846 was opened 2018-08-19 ?08:50
bauzasUggla: yes, if the bug was previously not "New"08:50
bauzashttps://bugs.launchpad.net/nova/+bug/1787846/+activity08:51
Ugglayep but latest update 2020-09-18 is it still relevent ?08:51
gibiUggla: we then to go from the newest bugs backwards in time 08:55
Ugglabauzas, gibi, should we ask to close it ? As I guess no ones would like to dig into that one and that's probably not relevent anymore ?08:56
gibiUggla: one way to treat it is that pike is already EOL upstream. So ask the reported to reproduce the problem on newer branch08:59
gibiand set the bug back to Incomplete09:00
gibiyou can order the bugs from newer to older with https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New&orderby=-date_last_updated&start=009:01
Ugglagibi, ok sounds good, otherwise we will keep this bug until the end of time. :)09:01
Ugglagibi, in fact I treated several recent yesterday. But I looked at that one and was surprised by the open date and the "new" state. :)09:02
gibiahh OK09:02
gibicool then09:02
Ugglabauzas, did you had a chance to look at https://review.opendev.org/c/openstack/nova-specs/+/831506/4/specs/zed/approved/unshelve-to-host.rst just to know if it looks ok for you ?09:06
bauzasUggla: not yet, will do today09:12
* bauzas has to work on a downstream bug09:12
Ugglabauzas, no hurries so far.09:15
bauzasgibi: sean-k-mooney: do you remember if we verify the usage about an inventory if we create a new allocation directly by calling the Placement API ?10:03
bauzasor do we verify it by Nova ?10:04
sean-k-mooneyyou mean prevent over allocation10:05
sean-k-mooneywe prevent over allocation in placment i belive10:05
sean-k-mooneyso if two boot requests both recive an allocation_candiate for the same host in parallel and then both try to allocate that candiate only one will succeed and that is enforce by placment if im not mistaken10:06
sean-k-mooneygibi: ^ that is correct right? or have i been fundementaly misunderstanding placment for years10:07
bauzassean-k-mooney: gibi: let's discuss this on downstream IRC, I have a BZ10:07
sean-k-mooneyok just getting coffee10:08
sean-k-mooneywe can have a call if it helps10:08
sean-k-mooneyyou can get into over allocation situations if the allocation ratio is change by the way10:08
sean-k-mooneybrb10:08
bauzasI need to prepare lunch for my kid, but let's discuss this when I'm back10:18
gibisorry I was having lunch11:12
gibibut overall yes, placement prevent overallocation via allocation creation, placement does not prevent overallocation via inventory modification (i.e changing allocation ratio, reserved, or total field)11:13
sean-k-mooneyright and when you go into an overallocated situation via inventory modifcaiotn placemnt allows you to free allocaitons agaisnt that inventory but wont allow you to crate new ones until you have enough capsity11:14
sean-k-mooneyso we have seen that were people have updated the cpu_pin_set or altered the allocation raitos and over commited it can prevent things like evacuate form working11:15
sean-k-mooneysince evacuate currently uses one allcoation isntead of two11:16
gibiyes11:22
gibifor all tree11:23
gibithree11:23
gibiin an overallocation situation inventory can change but allocation cannot11:23
gibiexcept removal11:23
gibiso you can delete allocations11:23
gibiand yes evac is special as it needs to modify the single allocation of the VM11:25
gibihm but non evacuation also needs to move the VM allocation from the VM uuid to the migration uuid so that would fail too in an overallocation11:27
gibithis is suboptimal as it prevents cleaning up an overallocated host by moving VMs out11:27
gibiso I would temporary remove the overallocation by bumping allocation ratio high up, move the VMs out, and then restore the allocation ratio11:28
sean-k-mooneyya that is the workaround for now11:28
sean-k-mooneyideally we woudl mvoe to useing the migration object to track either the source or dest allcoations11:29
sean-k-mooneyim not sure bauzas case was related to evac11:29
sean-k-mooneywe can see when they are back11:29
gibiand we would also need to special case the allocation update that only change consumer uuid, in placement to be allowed even in overallocated situation11:30
gibiyepp, I checked decreasing allocation is rejected, but deleting allocation is accepted in overallocation case11:39
opendevreviewPavlo Shchelokovskyy proposed openstack/nova master: Sort PCI devices by their address  https://review.opendev.org/c/openstack/nova/+/83013612:37
*** dasm|off is now known as dasm13:15
opendevreviewAlexey Stupnikov proposed openstack/nova stable/wallaby: Test aborting queued live migration  https://review.opendev.org/c/openstack/nova/+/84148314:09
opendevreviewHervĂ© Beraud proposed openstack/nova-specs master: Fix typo  https://review.opendev.org/c/openstack/nova-specs/+/84160014:15
opendevreviewHervĂ© Beraud proposed openstack/nova-specs master: Fix typo  https://review.opendev.org/c/openstack/nova-specs/+/84160014:17
opendevreviewMerged openstack/nova-specs master: Fix typo  https://review.opendev.org/c/openstack/nova-specs/+/84160016:09
opendevreviewGorka Eguileor proposed openstack/nova master: Fix extending non LUKSv1 encrypted volumes  https://review.opendev.org/c/openstack/nova/+/83606416:54
geguileostephenfin: I had to change the commit message, could you +2 it again, please: https://review.opendev.org/c/openstack/nova/+/83606416:58
geguileosean-k-mooney: ^16:58
stephenfindone16:58
geguileostephenfin: wow, that was quick, thanks :-)16:58
sean-k-mooneygeguileo: ill take a look again shortly too17:22
sean-k-mooneyah stephen put it back in the gate17:22
sean-k-mooneycool17:22
mnasersean-k-mooney: do you think the `hw:mlock` thing deserves a full-on spec as well if we want to do that as well?17:32
mnaser(i.e. https://review.opendev.org/c/openstack/nova/+/778347)17:33
mnaserif so, i can try and ask ricolin to work on that as well17:33
sean-k-mooneytechnically its a seperate feature which could be a seperate spec but im ok to combine the to unless others want it split out17:34
sean-k-mooneyi can unabandone that if you like if ricolin wants to take over the patch17:35
sean-k-mooneymy inital patch technically does not enfoce that you ahve a mem_page_size17:36
sean-k-mooneyso it can lead to OOM issues17:36
sean-k-mooneybut it was functional17:36
sean-k-mooneyit looks like artom and stephenfin had a prference for hw:locked_memory instead of hw:mlock17:37
sean-k-mooneyso it proably makes sense to at least make that change17:37
sean-k-mooneyi was ment ot re review the viommu spec today too sorry ricolin 17:37
sean-k-mooneyill try and get back to it tomorrow but likely wont get to it today17:38
opendevreviewArtom Lifshitz proposed openstack/nova stable/wallaby: DNM: Testing stuff  https://review.opendev.org/c/openstack/nova/+/84162618:15
*** dasm is now known as dasm|off21:11
*** prometheanfire is now known as Guest022:26
ricolinsean-k-mooney: yeah, I can help with the mlock patch, and thanks for your review:) 23:29

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!