Friday, 2022-03-25

opendevreviewMerged openstack/nova master: objects: Remove 'NovaObjectDictCompat' from 'Migration'  https://review.opendev.org/c/openstack/nova/+/72357200:16
opendevreviewMerged openstack/nova master: objects: Remove 'NovaObjectDictCompat' from 'InstancePCIRequest'  https://review.opendev.org/c/openstack/nova/+/72357300:17
opendevreviewMerged openstack/nova master: Update contributor guide for Zed  https://review.opendev.org/c/openstack/nova/+/83344106:21
opendevreviewMerged openstack/placement master: Add zed spec directory  https://review.opendev.org/c/openstack/placement/+/82953206:21
*** mgoddard- is now known as mgoddard09:11
noonedeadpunkhey there! Any considerations if to use `resources:PCPU` or `hw:cpu_policy='dedicated'` for cpu-pinning?13:01
noonedeadpunkAs I just realized they result in quite different xmls13:02
noonedeadpunkIn first case through "static" vcpu placement, in second through reall mapping of vCPUs to CPUs...13:03
sean-k-mooneythey shoudl result in the same13:03
noonedeadpunkhuh13:03
sean-k-mooneyboth should do a one to one vcpu pinning with the vcpupin element13:03
noonedeadpunkFor resources:PCPU I got just  <vcpu placement='static'>4</vcpu>13:04
sean-k-mooneyya that is not correct13:04
noonedeadpunkand no vcpupin13:04
sean-k-mooneywhat release are you on13:04
noonedeadpunkXena13:04
sean-k-mooneyi wonder if the mixed cpu support regressed that13:05
noonedeadpunkmaybe I have some mistake in flavor, let me double-check13:06
sean-k-mooneyif you have resouces:PCPU it shoudl be all you need although i dont recommend that people use the resouces: syntax in general13:06
sean-k-mooneyhttps://github.com/openstack/nova-specs/blob/master/specs/victoria/implemented/use-pcpu-vcpu-in-one-instance.rst was implemented in victoria13:07
sean-k-mooneyits possibe that intoduced a regression but we shoudl have functional test for this13:07
noonedeadpunkYah I read https://docs.openstack.org/nova/latest/admin/cpu-topologies.html quite carefully :)13:07
noonedeadpunkI just didn't find any difference in there13:08
noonedeadpunkbut `hw:cpu_policy='dedicated'` doing correct thing13:08
noonedeadpunkAnother question - I do remember some changelog, that suport of live migration for pinned instances was added - was I dreaming or it's a thing?13:09
sean-k-mooneyits a thing i know its in wallaby for sure but i think it was before that even13:09
sean-k-mooneyso xena has it13:09
sean-k-mooneyour functional test are not actully asserting things about the xml at first glace 13:10
noonedeadpunkShould we submit bug then?13:12
sean-k-mooneyfor the pinnign yes please do 13:13
sean-k-mooneyi was just looking at some other integration tests we have 13:13
sean-k-mooneywhitebox has test to assert the xml generateion https://opendev.org/openstack/whitebox-tempest-plugin/src/branch/master/whitebox_tempest_plugin/api/compute/test_cpu_pinning.py#L94-L11013:14
sean-k-mooneybut i think that is only testing the dedicated case not pcpus13:14
sean-k-mooneythats actully just the helper function 13:15
sean-k-mooneyhttps://opendev.org/openstack/whitebox-tempest-plugin/src/branch/master/whitebox_tempest_plugin/api/compute/test_cpu_pinning.py#L143-L172 is one of the test13:15
sean-k-mooneynoonedeadpunk: i was going to try and create a func test to repoduce something else but ill see if i can trigger this too.13:16
noonedeadpunkyeah, it's testing only dedicated one13:17
sean-k-mooneythanks for binging this up. i normally only test dedicated personally since i dont like using pcpus13:18
sean-k-mooneyi suspect when others spot check this form time to time its a simlar story13:18
noonedeadpunkI was just wondering if there's any difference, so decided to try both and was quite surprised about the result)13:20
sean-k-mooneyya am one question its still emiting the vcpu top level element and listing the n host cpus in the cpuset that were allcoated to the vm right13:21
sean-k-mooneylibvirt will internally generate vcpupin element but the behavior it will have is to let the cpu of the guest float over the n cpus in the set13:21
noonedeadpunkoh, ok, I see13:23
sean-k-mooneyso the vm shoudl still be pinned to a dedicated set of cores that other vms wont use but each guest cpu wont be be pinned to a speicic core but a set of cores13:23
sean-k-mooneythat will potentally still have latency issue if the host schduer decided to move the vcpu threads between the cores so not ideal13:24
sean-k-mooneybut not terible13:24
sean-k-mooneywould you mind providign an xml or sanatised one as part of the bug13:24
noonedeadpunksure thing13:24
noonedeadpunksean-k-mooney: https://bugs.launchpad.net/nova/+bug/196645213:32
sean-k-mooney<vcpu placement="static">4</vcpu> so ya that will still pin it but if that vm had 2 cores for exampel that woudl then be a range or list of hosts13:34
sean-k-mooneye.g. <vcpu placement="static">4,6</vcpu>13:34
sean-k-mooneyor <vcpu placement="static">4-5</vcpu>13:34
sean-k-mooneyonce we fix this you coudl fix the vms with a hard reboot and or live migration13:34
noonedeadpunkbut vm should have 4 cores actually13:34
noonedeadpunkthankfully, I don't have that in production yet:)13:35
sean-k-mooneyoh just saw that13:35
sean-k-mooney<nova:vcpus>4</nova:vcpus>13:35
sean-k-mooneyok this is worse then i taught13:35
sean-k-mooneyok i was going to mark this medium but i think ill triage this as high instead13:36
noonedeadpunkor well, we likely have it until EOD, but jsut use hw:cpu_policy13:36
sean-k-mooneyya the workaroudn is to use hw:cpu_policy dedicated which is my perfered option anyway so i don think this need to be critical but its valid and a high impact to performance13:37
sean-k-mooneyi have devstack running currently on my home server so ill see if i can recreate with master and we can go from there13:38
sean-k-mooney trait:CUSTOM_HIGHCPU='required are you useing provider.yaml to set that or the cli out of interest13:40
noonedeadpunkCLI13:43
sean-k-mooneyack i dont think we have many using provider.yaml yet so just was wondering if you were13:43
noonedeadpunknah, not yet:) We already had some traits set in environment, so were following usual path13:47
*** artom__ is now known as artom14:14
*** dasm|off is now known as dasm14:38
outbritoG'day folks!15:02
outbritoAbout the problem I had running tox the other day, I filed this bug: https://bugs.launchpad.net/nova/+bug/196647715:03
outbritoNot very sure how to handle it properly though. Any thoughts?15:03
outbritoI left some options to fix it on the comments15:04
sean-k-mooneythat looks like an osbrick issue15:11
sean-k-mooneythe unit and func test shoudl not need iscsi15:11
sean-k-mooneyso we also shoudl be mocking any calls to os-brick in our unit tests15:12
outbritoI believe theirs don't, but we do mock when we set that global15:12
outbritohttps://github.com/openstack/nova/blob/8f250f50446ca2d7aa84609d5144088aa4cded78/nova/test.py#L20315:13
sean-k-mooneymy point wa that this code shoudl nto be running in install or during the tests15:13
outbritonot iscsiadmin anyway, but the lock15:13
sean-k-mooney so none fo this shoudl depend on the os you are on15:14
mlozaI know this isn't supported but I wanted to add server group to running VMs, I found  `instance_group_member` table in nova_api needs to be modified. Any other tables I missed?16:20
mlozaalso, is there any reason server group can't be added to running VMs?16:21
sean-k-mooneynoonedeadpunk: actully thinking about your pinning bug again i dont think that config enabeld pinning at all16:34
sean-k-mooneythat is asking for 4 floating cores16:35
sean-k-mooneyit does not have any cores specified in the cpuset atirbute16:35
sean-k-mooney <vcpu placement='static' cpuset="1-4,^3,6" current="1">2</vcpu> is the alternitive way to pin16:36
sean-k-mooney<vcpu placement="static">4</vcpu> just mean 4 cpus16:36
dansmithmloza: we don't do it because of the affinity policies, if we just let you add them you could violate those, and we're not going to move things around to keep the policies straight16:36
sean-k-mooneyso ya resouces:PCPUs is totally broken16:37
opendevreviewSylvain Bauza proposed openstack/nova-specs master: Move implemented specs for the Yoga release  https://review.opendev.org/c/openstack/nova-specs/+/83527216:40
noonedeadpunksean-k-mooney: I just noticed a typo in flavor :(16:47
noonedeadpunkSo I just wasted your time likely16:48
sean-k-mooneyi havent spendt much on it yet currently debuging downstream issue and devstack problems17:05
sean-k-mooneyi was just looking at a different xml an realise i read your one wrong the first time17:05
sean-k-mooneynoonedeadpunk: if there isnt an issue great but we found we are missing coverage in whitebox in either case17:06
sean-k-mooneynoonedeadpunk: if the bug is not required feel free to close it but if its still does not work after you fix the typo let me know17:16
sean-k-mooneyoh s/resouces/resources/17:17
sean-k-mooneyya i would never spot that17:17
*** dasm is now known as dasm|off19:14
opendevreviewMerged openstack/nova master: Adds regression test for bug LP#1944619  https://review.opendev.org/c/openstack/nova/+/83316621:24

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!