Wednesday, 2020-09-02

*** songwenping_ has joined #openstack-nova00:00
*** songwenping__ has quit IRC00:02
*** JamesBenson has joined #openstack-nova00:13
*** JamesBenson has quit IRC00:18
*** songwenping_ has quit IRC00:19
*** songwenping_ has joined #openstack-nova00:19
*** mlavalle has quit IRC00:27
*** mlavalle has joined #openstack-nova00:31
*** zhanglong has joined #openstack-nova00:36
*** rcernin_ has joined #openstack-nova00:45
*** rcernin has quit IRC00:47
*** JamesBenson has joined #openstack-nova00:56
*** JamesBenson has quit IRC01:00
*** xiaolin has joined #openstack-nova01:09
*** zhanglong has quit IRC01:31
*** JamesBenson has joined #openstack-nova01:35
*** JamesBenson has quit IRC01:40
*** zhanglong has joined #openstack-nova01:46
*** xiaolin has quit IRC01:50
*** xiaolin has joined #openstack-nova01:50
openstackgerritYingji Sun proposed openstack/nova stable/stein: Set different VirtualDevice.key  https://review.opendev.org/74941501:51
*** xiaolin has quit IRC01:55
openstackgerritYingji Sun proposed openstack/nova stable/ussuri: Set different VirtualDevice.key  https://review.opendev.org/74941802:10
*** manuvakery has joined #openstack-nova02:19
*** aj_mailing has quit IRC02:37
*** JamesBenson has joined #openstack-nova02:46
*** rcernin_ has quit IRC03:19
*** aj_mailing has joined #openstack-nova03:26
*** rcernin_ has joined #openstack-nova03:34
*** psachin has joined #openstack-nova03:35
*** dunweifu has joined #openstack-nova03:36
*** dunweifu has quit IRC03:47
*** zhanglong has quit IRC03:58
*** dunweifu has joined #openstack-nova04:04
*** aj_mailing has quit IRC04:05
*** dunweifu has quit IRC04:18
openstackgerritMerged openstack/nova master: Cyborg evacuate support  https://review.opendev.org/71532604:30
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-nova04:33
*** manuvakery has quit IRC04:39
*** vishalmanchanda has joined #openstack-nova04:55
*** viks____ has joined #openstack-nova04:59
*** gyee has quit IRC05:07
*** links has joined #openstack-nova05:14
*** bhagyashris|away is now known as bhagyashris05:27
*** zhanglong has joined #openstack-nova05:34
openstackgerritBrin Zhang proposed openstack/nova master: Reject resize operation for accelerator  https://review.opendev.org/74856005:34
*** kevinz has joined #openstack-nova05:34
*** jsuchome has joined #openstack-nova05:39
*** aj_mailing has joined #openstack-nova05:39
*** slaweq has joined #openstack-nova05:53
brinzhang_stephenfin: can you +A for https://review.opendev.org/#/c/748560/, reabsed because of the merged conflict but lost the +A06:00
*** viks____ has quit IRC06:01
*** luyao has quit IRC06:01
openstackgerritJiri Suchomel proposed openstack/nova master: Describe '[glance]/enable_rbd_download'  https://review.opendev.org/74943706:01
*** arne_wiebalck has quit IRC06:01
*** arne_wiebalck has joined #openstack-nova06:02
*** luyao has joined #openstack-nova06:02
*** viks____ has joined #openstack-nova06:04
*** ratailor has joined #openstack-nova06:15
*** slaweq has quit IRC06:18
*** Yumeng has joined #openstack-nova06:30
*** damien_r has joined #openstack-nova06:34
*** hemanth_n has joined #openstack-nova06:35
openstackgerritElancheran S proposed openstack/nova stable/train: Removes the delta file once image is extracted  https://review.opendev.org/74803506:38
*** damien_r has quit IRC06:38
*** ralonsoh has joined #openstack-nova06:39
*** JamesBenson has quit IRC06:39
bauzasgood morning Nova06:49
*** rcernin_ has quit IRC06:51
*** rcernin_ has joined #openstack-nova06:54
*** slaweq has joined #openstack-nova06:55
*** manuvakery has joined #openstack-nova06:57
*** ralonsoh has quit IRC07:04
*** ralonsoh has joined #openstack-nova07:09
*** tesseract has joined #openstack-nova07:10
gibibauzas: good morning07:15
gibisean-k-mooney: thanks for the tests07:22
*** songwenping__ has joined #openstack-nova07:23
bauzasgibi: you can't imagine how providing the networks is difficult...07:25
*** songwenping_ has quit IRC07:26
gibimaybe this was the reason why mriedem didn't go down that way07:27
openstackgerritWenping Song proposed openstack/nova-specs master: Correct some spell errors  https://review.opendev.org/74944907:30
gibisean-k-mooney: could the 9.2 where the VFs are freed but not exists after a PF detach can be worked around by setting the host to auto allocate VFs via /etc/network/interfaces.d/ config?07:32
* bauzas raises fist at why we don't provide all the physnets07:33
*** rcernin_ has quit IRC07:35
*** brinzhang0 has joined #openstack-nova07:35
*** tosky has joined #openstack-nova07:37
*** brinzhang_ has quit IRC07:38
*** ralonsoh has quit IRC07:43
*** martinkennelly has joined #openstack-nova08:07
openstackgerritBalazs Gibizer proposed openstack/nova master: Delete non tag related device metadata during detach  https://review.opendev.org/74143608:21
openstackgerritBalazs Gibizer proposed openstack/nova master: Remove unused vpn param from allocate_for_instance  https://review.opendev.org/74493308:21
openstackgerritBalazs Gibizer proposed openstack/nova master: Move equality check into LibvirtConfigGuestInterface  https://review.opendev.org/74452408:21
*** dtantsur|afk is now known as dtantsur08:23
openstackgerritBalazs Gibizer proposed openstack/nova master: Only unplug vif after the device is detached from libvirt  https://review.opendev.org/74493408:24
openstackgerritBalazs Gibizer proposed openstack/nova master: Make PCI claim NUMA aware during live migration  https://review.opendev.org/74845308:24
openstackgerritBalazs Gibizer proposed openstack/nova master: Use UUID as vif and network_id in vif tests  https://review.opendev.org/74872208:24
openstackgerritBalazs Gibizer proposed openstack/nova master: [WIP] Support SRIOV interface attach and detach  https://review.opendev.org/74099508:28
openstackgerritBalazs Gibizer proposed openstack/nova master: DNM: tracing the PCI allocation code path  https://review.opendev.org/74845408:30
stephenfinjangutter: care to look at https://review.opendev.org/#/c/744816/ ?08:31
openstackgerritLuyao Zhong proposed openstack/nova master: Track error migrations in resource tracker  https://review.opendev.org/74528108:38
openstackgerritLuyao Zhong proposed openstack/nova master: Rollback when reset running live migration  https://review.opendev.org/74789908:38
openstackgerritLuyao Zhong proposed openstack/nova master: Improve orphans tracking in resource tracker  https://review.opendev.org/74528208:38
*** rcernin_ has joined #openstack-nova08:40
*** rcernin_ has quit IRC08:46
jangutterstephenfin: ack, looking!09:01
jsuchomegibi: lyarwood artom: hi, please take a look at https://review.opendev.org/#/c/574301/ (patch updated with stephenfin idea)+ https://review.opendev.org/#/c/749437/ (release notes)09:03
gibijsuchome: looking...09:04
*** derekh has joined #openstack-nova09:05
gibijsuchome: thanks. I'm +209:09
jangutterstephenfin, sean-k-mooney: I see https://review.opendev.org/#/c/744816/ is already in the gate. +2 from me, with a potential followup to clean up one of the nits (if it's actually a nit).09:10
stephenfinjangutter: Yup, makes sense to me09:13
lyarwoodgibi: thanks!09:17
lyarwoodjsuchome: https://review.opendev.org/#/c/743220/ - could you update that to use the new configurables?09:18
lyarwoodjsuchome: I'm going to be pretty busy downstream this week so I'll not be able to get to it for a while09:18
lyarwoodhttps://review.opendev.org/#/c/748212/ is the actual job sorry09:19
jsuchomelyarwood: yep; later today I hope09:20
lyarwoodjsuchome: cool thanks09:20
suryasinghsean-k-mooney:  melwitt dansmith lyarwood  Sorry to interrupt you all. I have simple query. Does the current nova-compute service(Data-plane) support graceful shutdown ? Will the nova-compute service stop(systemctl stop openstack-nova-compute.service) wait for the ongoing operation(instance provisioning) to finish ?09:25
*** zzzeek has quit IRC09:32
*** zzzeek has joined #openstack-nova09:33
jkuliksuryasingh, there's https://review.opendev.org/#/c/666245/ for spawning VMs at least09:34
openstackgerritBrin Zhang proposed openstack/nova-specs master: Unified virtual persistent memory restrictions  https://review.opendev.org/74947209:35
brinzhang0alex_xu: if you are free, please review https://review.opendev.org/#/c/749472/, modify the depency of vPMEM limit in the spec, make it keep consistent with admin guide docs09:38
openstackgerritLee Yarwood proposed openstack/nova stable/queens: Add regression tests for bug #1889108  https://review.opendev.org/74923209:39
openstackgerritLee Yarwood proposed openstack/nova stable/queens: compute: Don't delete the original attachment during pre LM rollback  https://review.opendev.org/74923309:39
openstackbug 1889108 in OpenStack Compute (nova) train "failures during driver.pre_live_migration remove source attachments during rollback" [Undecided,In progress] https://launchpad.net/bugs/1889108 - Assigned to Lee Yarwood (lyarwood)09:39
brinzhang0alex_xu: please check the dependency package version, is it reasonable?09:40
lyarwoodbauzas / elod: would you mind taking a look at https://review.opendev.org/#/c/748496/09:46
suryasingh@jkulik thanks for response and patch link. Did you tested this patch ? And is there any priority from nova-community side for this patch, if you know about it, sorry for asking.09:47
*** zzzeek has quit IRC09:48
*** zzzeek has joined #openstack-nova09:49
jkuliksuryasingh, we're running some version of this patch in production on a queens code-base. I haven't seen any push from the nova-community for this.09:56
bauzaslyarwood: ack09:57
suryasingh@jkulik I see, thanks for info.09:58
*** zhanglong has quit IRC10:04
openstackgerritMerged openstack/os-vif master: deprecate ovs-vsctl driver and make native the default  https://review.opendev.org/74481610:05
*** aj_mailing has quit IRC10:06
*** zzzeek has quit IRC10:08
*** zzzeek has joined #openstack-nova10:10
*** sapd1_x has joined #openstack-nova10:21
fricklerwhat do I need to do in order to be able to extend an attached RBD volume? https://review.opendev.org/613039 makes me think that this should work since stein, but if I try via cinder, it wants to see an unattached volume. is there some special nova API for this?10:27
lyarwoodfrickler: isn't that a microversion thing on the c-api side?10:30
lyarwoodfrickler: https://docs.openstack.org/api-ref/block-storage/v3/index.html?expanded=extend-a-volume-size-detail#volume-actions-volumes-action10:30
lyarwoodfrickler: Prior to microversion 3.42 the volume status must be available. Starting with microversion 3.42, attached volumes with status in-use may be able to be extended depending on policy and backend volume and compute driver constraints in the cloud. Note that reserved is not a valid state for extend.10:30
fricklerlyarwood: ha, I'll try that, thx10:31
*** k_mouza has joined #openstack-nova10:32
elodlyarwood: sure, I'll review those patches today10:34
fricklerlyarwood: works like a charm, though seemingly only with the cinder CLI, not OSC, but that's a different topic. thx again10:37
lyarwoodfrickler: cool np :)10:37
lyarwoodelod: awesome thanks!10:37
*** lpetrut has joined #openstack-nova10:47
*** brinzhang_ has joined #openstack-nova10:48
*** songwenping_ has joined #openstack-nova10:50
*** brinzhang0 has quit IRC10:51
*** brinzhang has joined #openstack-nova10:51
*** songwenping__ has quit IRC10:53
*** brinzhang_ has quit IRC10:54
openstackgerritMerged openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD  https://review.opendev.org/57430110:57
*** zzzeek has quit IRC10:57
*** zzzeek has joined #openstack-nova11:00
stephenfingibi: So, interesting problem. I'm trying to remove those XenAPI-only APIs and need to optionally disable their tests in Tempest on Victoria+. The pattern we have for that is to check if our max API version > the max of the past release, but Victoria's max is the same as Ussuri (we didn't add new microversions this cycle)11:02
stephenfinSo i wonder if there are any last minute API changes we want to make/ :-D11:02
stephenfin?11:02
*** sridharg has joined #openstack-nova11:03
*** k_mouza has quit IRC11:09
alex_xubrinzhang: that is better to have luyao to take a look at, but I think that is the version luyao tested11:09
*** elod has quit IRC11:15
*** jangutter_ has joined #openstack-nova11:16
*** elod has joined #openstack-nova11:16
*** jangutter has quit IRC11:20
*** k_mouza has joined #openstack-nova11:30
*** k_mouza has quit IRC11:31
*** k_mouza has joined #openstack-nova11:32
*** k_mouza has quit IRC11:34
gibistephenfin: hm, that is an interesting catch11:40
gibiI'm not aware of inflight microversion bumps11:41
gibiyeah, looking through our bp list I don't think we have a version bump https://launchpad.net/nova/+milestone/victoria-311:42
sean-k-mooneygibi: i think that might be a first for m3 since they were added :)11:45
sean-k-mooneystephenfin: you could just add a microverion for this11:46
gibiI guess it is a definit signal that nova development is slowing down11:46
sean-k-mooneyto singal the xenapi apis being removed11:46
sean-k-mooney then use that for tempest11:47
sean-k-mooneygibi: by the way i didnt find any thing broken in your code although there is that latent bug for keeping the vfs in teh db in sync with reality after a vf is detached11:50
sean-k-mooneywas there anything in particalar you wanted me to test that i did not11:50
gibisean-k-mooney: thanks for the tests. I think you covered everything.11:50
gibisean-k-mooney: regarding the latent bug. when a pf is attached to a guest then the host deletes the vfs from the pf11:51
gibiand then when the pf is freed from the guest11:51
gibithe vfs are not recreated by the host11:51
sean-k-mooneykind of11:52
gibiI did added a bit of configuration to re-create the vfs11:52
gibiI mean host config11:52
sean-k-mooneythat is the effect but its not somuch the host deleting the vf as we are unbining the pf from the kernel and the vf are destoyed when that happens11:52
sean-k-mooneybasically i allocated the VFs using /sys and echo at run time11:53
gibihow the vfs was created in the first place? I guess by writing under /sys11:53
gibiyeah11:53
gibiso that steps is not persistent11:53
sean-k-mooneybut that configurtion info is lost when you allocate teh pf to the vm11:53
gibiyepp11:53
sean-k-mooneythen wehn qemu is done it does a functionl level pci reset11:53
gibiI think this is a host configuration task to keep the number of vfs perisitent11:53
gibipersistent11:53
sean-k-mooneyit is11:53
gibiso I put11:54
gibipre-up echo '4' > /sys/class/net/enp129s0f0/device/sriov_numvfs11:54
sean-k-mooneybut we could also protect against it eaisly in nova11:54
gibihm, how?11:54
gibidoes nova know what is the number of vfs to be re-created?11:54
sean-k-mooneygibi: when we set teh vfs from unavaiable to avaiable after freeing the PF in the db we chould check with libvirt to make sure the exist11:54
sean-k-mooneyif they dont we can delete them in the db11:55
sean-k-mooneyor i guess we could count them and recreate them with that echo but deleteing seams simpler11:55
gibiohh, yes, we could sync our db with reality11:55
sean-k-mooneyyep11:55
gibiI don't want to recreate anything host level11:55
sean-k-mooneyso syncing with reality shoudl be simple11:56
gibiI see11:56
*** raildo has joined #openstack-nova11:56
sean-k-mooneythe other thning is that unless your udev rules are correct when you unbind the pf form the vm11:56
sean-k-mooneythe pf might not bind back to the netdev vendor driver11:56
sean-k-mooneyit can stay bound to vfio-pci11:57
sean-k-mooneyin that case the vf wont be recreated by a pre-up command11:57
songwenping_bauzas: hi, i'm test vGPU with VM and meet some problems. I have install nvidia-smi driver and my GPU's already set nvidia driver, but i cannot find mdev_bus at /sys/class path.11:57
sean-k-mooneybut that is definetly out of nova scope11:57
sean-k-mooneysongwenping_: what kernel are you using11:57
gibisean-k-mooney: ack11:58
sean-k-mooneysongwenping_: also i dont think that is where it is11:58
bauzassongwenping_: have you installed the nvidia driver in the compute service ?11:58
songwenping_i use ubuntu 18.04.11:58
songwenping_my centos env is ok.11:59
sean-k-mooneysongwenping_: i think its /sys/bus/mdev not /sys/class/mdev but its only created after you modporbe vfio-mdev11:59
sean-k-mooneyyep sean@pop-os:~$ ls /sys/bus/mdev/12:00
sean-k-mooneydevices  drivers  drivers_autoprobe  drivers_probe  uevent12:00
songwenping_sean-k-mooney: also not find at /sys/bus/mdev12:00
sean-k-mooneyyep you need to do "sudo modprobe vfio-mdev"12:00
sean-k-mooneyto create it12:00
sean-k-mooneywait is this a ubuntu 18.04 host12:01
*** JamesBenson has joined #openstack-nova12:01
sean-k-mooneyor guest12:01
songwenping_host12:01
sean-k-mooneynvidia annoyingly does not have ubuntu host drivers12:01
sean-k-mooneyfor virtual gpus12:01
sean-k-mooneythey only suppor ubuntu guests12:02
sean-k-mooneyso unless you used alien or something to install the rhel rpm on your ubuntu host i dont see how you can install the correct driver and kernel module12:03
sean-k-mooneymdevs will work but not nvidia grid on a ubuntu host12:03
songwenping_i get nvidia-* last week and create vm with vgpu success with devstack on ubuntu 18.04 host.12:04
openstackgerritJohannes Kulik proposed openstack/nova master: vmware tests: Support different moref backend representations  https://review.opendev.org/74948812:04
bauzassongwenping_: what sean-k-mooney said, nvidia doesn't support ubunutu as a compute OS12:05
jkulikstephenfin, if you find some time, please have a look at https://review.opendev.org/749488 for the first patch for the oslo.vmware SOAP library switch. sorry for the long wait, downstream needed a lot more love than usual ...12:06
songwenping_i really get the nivida-* is at /sys/class/mdev_bus as centos. but now i cannot get it.12:06
*** derekh has quit IRC12:09
*** sridharg has quit IRC12:12
sean-k-mooneysongwenping_: i think that class path will only exist if you have mdevs allocated12:13
sean-k-mooneysongwenping_: but as i said you cant use ubuntu as a host os for nvida grid12:13
sean-k-mooneyi can be the guest os but nvidia does not make the host level driver availabel for ubuntu12:14
songwenping_sean-k-mooney: yeah, i have allocated mdevs and i reinstall vgpu-kvm package.12:17
*** dave-mccowan has joined #openstack-nova12:17
sean-k-mooneysongwenping_: where did you get the package for ubuntu?12:17
songwenping_nvidia official website12:18
songwenping_NVIDIA-Linux-x86_64-440.107-vgpu-kvm.run12:18
sean-k-mooneyhttps://docs.nvidia.com/grid/10.0/product-support-matrix/index.html12:19
sean-k-mooneyaccording to that ubnuntu is not supported as a host os12:19
songwenping_the path is /sys/class/mdev_bus/0000\:af\:00.0/mdev_supported_types/ generate, but nothing in it.:(12:20
sean-k-mooneyyour going to have to talk to nvidia about that12:20
sean-k-mooneythe offical nividia doc which was last update on the 21st of august says ubunut is not supported i think you install the ubunut guest driver on the host12:22
songwenping_sean-k-mooney, bauzas: thanks a lot. i'll try to use ubuntu guest.12:22
openstackgerritYao wang proposed openstack/nova master: Use VIR_DOMAIN_XML_INACTIVE for detach volume  https://review.opendev.org/74948912:22
*** songwenping__ has joined #openstack-nova12:33
*** lbragstad has quit IRC12:35
*** songwenping_ has quit IRC12:36
bauzassongwenping__: FWIW, for nvidia specific issues like it, please look at their documentation for vGPUs https://docs.nvidia.com/grid/latest/grid-vgpu-user-guide/index.html#grid-vgpu-introduction12:36
bauzasthe openstack community is not an nvidia support team :p12:37
*** lbragstad has joined #openstack-nova12:38
openstackgerritLee Yarwood proposed openstack/nova stable/queens: Add regression tests for bug #1889108  https://review.opendev.org/74923212:46
openstackgerritLee Yarwood proposed openstack/nova stable/queens: compute: Don't delete the original attachment during pre LM rollback  https://review.opendev.org/74923312:46
openstackbug 1889108 in OpenStack Compute (nova) train "failures during driver.pre_live_migration remove source attachments during rollback" [Undecided,In progress] https://launchpad.net/bugs/1889108 - Assigned to Lee Yarwood (lyarwood)12:46
stephenfinjkulik: sure, done12:47
*** zhanglong has joined #openstack-nova12:53
*** derekh has joined #openstack-nova13:03
*** avolkov has joined #openstack-nova13:03
*** ratailor has quit IRC13:09
*** johanssone has quit IRC13:11
*** zhanglong has quit IRC13:15
*** zhanglong has joined #openstack-nova13:16
*** jangutter has joined #openstack-nova13:19
*** jangutte_ has joined #openstack-nova13:21
*** jangutter_ has quit IRC13:21
*** jangutter has quit IRC13:24
*** jangutte_ has quit IRC13:26
*** jangutter has joined #openstack-nova13:26
*** jangutter has quit IRC13:29
*** jangutter has joined #openstack-nova13:30
*** nweinber has joined #openstack-nova13:42
*** _mlavalle_1 has joined #openstack-nova13:44
*** nweinber has quit IRC13:45
*** nweinber has joined #openstack-nova13:45
*** zhanglong has quit IRC13:45
openstackgerritStephen Finucane proposed openstack/nova master: WIP: Resolve issues with various HTTP status codes  https://review.opendev.org/74950513:46
stephenfingmann, sean-k-mooney, gibi: There's a potential solution to our "no microversion in Victoria" conundrum ^ If that's not completely bonkers, I could probably finish it today13:46
*** mlavalle has quit IRC13:46
stephenfinthough, in fairness, it probably is completely bonkers :)13:47
gibistephenfin: ack, will look.13:47
* gibi is knee deep in sriov testing13:47
stephenfinfair fair13:47
*** kaisers has joined #openstack-nova13:50
bauzasgibi: sean-k-mooney: /me needs help of a network specialist13:51
gibibauzas: I'm not sure I can help but ask :)13:52
bauzasgibi: for instance create, we're passing requested_networks here https://github.com/openstack/nova/blob/b5d48043466b53fbdfe7b93c2e4efd449904e593/nova/compute/api.py#L95413:53
bauzasit's a NetworkRequestList object13:53
* sean-k-mooney im a "network" specialist, i just tought i did not hate networking13:53
sean-k-mooney:)13:54
bauzashttps://github.com/openstack/nova/blob/b5d48043466b53fbdfe7b93c2e4efd449904e593/nova/objects/network_request.py#L3013:54
bauzasso I can try to add a new field in some object that would be NetworkRequestList13:54
sean-k-mooneystephenfin: our you could just add a microverion for the api removal too13:54
bauzassean-k-mooney: gibi: for example, directly the RequestSpec13:55
stephenfinsean-k-mooney: it would be no-op though13:55
bauzassean-k-mooney: gibi: but if so, I need to use the same for the other move operations13:55
sean-k-mooneywell no after the version you would get 404 for the apis13:55
sean-k-mooneystephenfin: ill take a look at your patch after bauzas thing13:55
stephenfinright, but before the version you'd get nothing too13:55
bauzassean-k-mooney: gibi: but then, we no longer have NetworkRequests, just VIF objects13:55
stephenfinsince XenAPI is gone and those things only worked with XenAPI13:55
sean-k-mooneystephenfin: oh i guess ya13:56
gibibauzas: yeah, so for boot you have network request for move you have either the cache or you can ask neutron for the bound ports of the instance13:56
bauzassean-k-mooney: gibi: so I wonder if I can create a new NetworkRequest object by using a VIF object13:56
gmannstephenfin: ack, I will check  in afternoon13:56
bauzassean-k-mooney: gibi: like we do in https://github.com/openstack/nova/blob/b5d48043466b53fbdfe7b93c2e4efd449904e593/nova/objects/request_spec.py#L54713:56
sean-k-mooney the vifs would have everything expction the pci_request_id i think13:57
bauzassean-k-mooney: gibi: tbc, what's the difference between a VIF object and a NetworkRequest one13:57
bauzassean-k-mooney: right, see https://github.com/openstack/nova/blob/b5d48043466b53fbdfe7b93c2e4efd449904e593/nova/network/neutron.py#L3064-L307613:58
sean-k-mooneyno tags or pci requests https://github.com/openstack/nova/blob/master/nova/network/model.py#L380-L40413:58
gibiI never tried to diff them, but I honeslty affraid of cached data as it might be stale13:58
sean-k-mooneybut it will have the network id and port id13:58
*** Liang__ has joined #openstack-nova13:58
gibiI might try to recreate the network request from neutron13:59
bauzasgibi: do we persist it ?13:59
sean-k-mooney bauzas VIF object are constructed form the info we get back form neutron13:59
*** Liang__ is now known as LiangFang13:59
sean-k-mooneyso they dont exist untill that point13:59
sean-k-mooneythe newtork request obejct are created in the api13:59
sean-k-mooneybased on the inital boot request14:00
gibibauzas: I think we persist the info_cache but I can be mistaken14:00
sean-k-mooneyyes14:00
sean-k-mooneythey are only persited in the info cache14:00
sean-k-mooneythey are also not ovo by the way14:00
bauzasokay, I think we just need network_id14:00
bauzasso this should work14:01
sean-k-mooneyyep so the VIF has a network subobject14:01
bauzasie. having a nested object be NetworkRequestList14:01
sean-k-mooneyhttps://github.com/openstack/nova/blob/master/nova/network/model.py#L33214:01
sean-k-mooneywhich has the network id14:01
sean-k-mooneybauzas: but just to be clear this will only work for migrations14:01
bauzasand when moving, valuing this field like we do for https://github.com/openstack/nova/blob/master/nova/objects/request_spec.py#L538 by using the VIFs objects from instance info cache14:02
sean-k-mooneyit will likely not work for new spawns14:02
bauzassean-k-mooney: yeah that works, because we directly have the NetworkRequest objects when spawning14:02
sean-k-mooneyfor new spawns we dont populate the info cache untill the compute node14:02
bauzasyup, that's not a problem14:02
sean-k-mooneyok14:02
bauzasokay, I can try to provide a new revision today then14:03
bauzasthanks14:03
gibiI'm OK recovering the network_id from the cache and then populate network metadata based on that14:03
sean-k-mooneyyou will proably want to add a function on the network_metadata object to do that14:04
bauzassean-k-mooney: I don't want to modify the network_medata object14:04
bauzasjust the requestspec object or the destination one14:04
sean-k-mooneywell you could put it in the request_sep too14:04
bauzasyup, either14:04
sean-k-mooneywhich ever object your adding the filed too14:04
sean-k-mooneyjust have a helper function to populated it14:05
sean-k-mooneybasically i would like that fucntion to be testable on its own is all im really asking for14:05
sean-k-mooneyso we dont have to do complicated mocking in unit tests14:05
*** LiangFang has quit IRC14:12
*** _mlavalle_2 has joined #openstack-nova14:14
openstackgerritMerged openstack/nova master: Provider Config File: Coding style and test cases improvement  https://review.opendev.org/74893914:14
*** Liang__ has joined #openstack-nova14:14
*** _mlavalle_1 has quit IRC14:17
*** johanssone has joined #openstack-nova14:36
lyarwoodstephenfin: https://review.opendev.org/#/c/639934 LGTM, asked a quick question wrt to actual gate testing, I assume this isn't something we could wire up right now correct?14:40
stephenfinlooking14:45
*** _mlavalle3 has joined #openstack-nova14:50
*** _mlavalle_2 has quit IRC14:53
sean-k-mooneylyarwood: vtpm can be tested in the gate14:53
*** _mlavalle3 has quit IRC14:53
sean-k-mooneywe just need tempest tests with a new compute feature flag14:54
sean-k-mooneyto contol running them then we need to update devstack to install teh swtpm software and configure it14:54
sean-k-mooneyso it could be tested but we would need to do the automation14:55
sean-k-mooneymaybe this is somethign we can work with our qe folks to do14:55
sean-k-mooneye.g. the tempest tests14:56
lyarwoodsean-k-mooney: wouldn't we need the clouds we are using to have vTPM enabled instances for us to passthrough?14:56
sean-k-mooneyextenting devstack is really just adding a new flag and apt/dnf instaling the package14:56
sean-k-mooneyno14:57
lyarwoodsean-k-mooney: or is it fully emulated14:57
sean-k-mooneythis is fully emulated14:57
lyarwoodgah sorry I got confused reading the libvirt docs14:57
openstackgerritAkhil Gudise proposed openstack/nova master: Introduced a service UP check for host to the Rebuild path  https://review.opendev.org/74953114:57
lyarwoodif it's fully emulated then it would've been nice to have a WIP posted already for this tbh14:58
sean-k-mooneyi could wip up a temp patch but we dont normally require tempest for a featre to merge14:58
sean-k-mooneye.g. jsut chnage the tempest flaovrs and hardcode the tpm extra specs14:59
sean-k-mooneyand manulaly install swtpm14:59
lyarwoodsean-k-mooney: we have required tempest changes in the past FWIW14:59
*** belmoreira has joined #openstack-nova14:59
sean-k-mooneynot that im aware of14:59
stephenfinswtpm isn't packaged on Ubuntu yet :(14:59
sean-k-mooneywe have said they shoudl be added but we have merged the code before hand14:59
lyarwoodsean-k-mooney: I've had encrypted volume and stable rescue stuff held up in the past15:00
stephenfinso we'd need to enable some PPAs15:00
sean-k-mooneyreally15:00
lyarwoodstephenfin: well we also have Fedora ;)15:00
sean-k-mooneystephenfin: ya that is easy to do15:00
sean-k-mooneyany way moving on form that crazy fedora idea :P15:01
sean-k-mooneyam do we want a quick DNM patch to hack in a full tempest run15:01
stephenfinalso, the version of QEMU and libvirt on Ubuntu 18.04 is too old15:01
sean-k-mooneylike we have done for numa before15:01
*** jangutter_ has joined #openstack-nova15:01
stephenfinI had to use Fedora 31 for testing this locally15:01
lyarwood*cough* Fedora *cough*15:01
sean-k-mooneystephenfin: we are ment to be on ubuntu 20.0415:02
sean-k-mooneybefore m315:02
lyarwoodyeah good luck with that15:02
sean-k-mooneyits a comuntiy goal15:02
sean-k-mooneyand we really really should have done it already15:02
*** jangutter_ has quit IRC15:02
stephenfinthere a issues with some storage-related tests15:02
stephenfinlyarwood has the specifics, iirc15:02
sean-k-mooneythat also affects cento8 and fedora15:02
sean-k-mooneysince they use teh same version of libvirt and qemu15:02
*** jangutter_ has joined #openstack-nova15:03
stephenfinlyarwood: do we have a Fedora job I can hack on?15:03
sean-k-mooneyat least centos 8 and ubuntu 20.04 do15:03
sean-k-mooneyfedora might be newer15:03
lyarwoodwell I could at least reproduce it with bionic and the UCA15:04
stephenfinlyarwood, sean-k-mooney: oh, more fun, cirros doesn't support TPM so we'd have to use different guest images too15:04
*** jangutter has quit IRC15:04
lyarwoodstephenfin: >< okay well this is getting harder, I just wanted to ensure the file copying part worked tbh15:04
stephenfinlyarwood: I can reproduce locally with DevStack master on Fedora 31, if that would help? Just go paste the results somewhere.15:05
stephenfinHappy to get whitebox tests going post-M3 then. We'll need them at some point anyway15:05
lyarwoodstephenfin: yeah sure it's not worth holding this up for15:06
lyarwoodstephenfin: the -1 was for the commit nit btw not this testing15:08
openstackgerritStephen Finucane proposed openstack/nova master: Add support for resize and cold migration of emulated TPM files  https://review.opendev.org/63993415:10
stephenfinlyarwood: ta-da ^15:10
jsuchomelyarwood: adapted https://review.opendev.org/#/c/748212/15:11
gibisean-k-mooney: as https://review.opendev.org/#/c/744816/ merged, will you propose an os-vif relase before the lib freeze?15:12
sean-k-mooneyam yes although i want to review two other patches today15:13
sean-k-mooneyill propose a patch by eod15:13
*** links has quit IRC15:19
stephenfingibi, sean-k-mooney: I can do it. Major or minor release, given the change in behavior?15:20
stephenfinI'm tempted to say major15:20
sean-k-mooneyits minor we have not broke backwards compatblity15:21
gibisean-k-mooney, stephenfin: It is OK to have it done tomorrow, no rush.15:21
stephenfinsean-k-mooney: cool15:22
sean-k-mooneyhttps://review.opendev.org/#/c/746673/ and https://review.opendev.org/#/c/745895/ are the two i want to re review15:22
*** mlavalle has joined #openstack-nova15:22
stephenfingibi: It was a 1 minute job (I timed it :)) https://review.opendev.org/74953515:22
stephenfinreleasing-as-code++15:22
gibistephenfin: because you are fast :D15:22
sean-k-mooneyya there is a tool you can run15:23
sean-k-mooneythat generate the patch for you15:23
gibistephenfin: thanks anyhow15:23
stephenfinI know hberaud had one alright. Didn't know there was a generic one15:23
sean-k-mooneyits in the repo15:23
sean-k-mooneyyou just use tox15:23
gibisean-k-mooney: hit me up with any of those patches if need a push on them before the freeze15:23
sean-k-mooneyi need to see if the previous comments have been adressed15:24
sean-k-mooneyit is a bug fix so we could backported anyway15:24
stephenfingibi: Could you carry your +2 from https://review.opendev.org/#/c/741995/10 to https://review.opendev.org/#/c/744958/8 ? They should be identical, commit message aside15:25
stephenfinI had them separate to avoid intertwining two series, but that's not an issue now as the base patches for both have merged15:25
stephenfinI'll abandon https://review.opendev.org/#/c/741995/10 now15:26
gibidone15:27
stephenfinthanks15:27
gibithanks for that ping, I forget about these duplications15:27
stephenfinand while I have you (last one, promise) - this has two changes since your last +2: a change to some mocks to mock out the new "does this user/group exist" check, and a commit message nit from lyarwood https://review.opendev.org/#/c/639934/15:29
*** Liang__ has quit IRC15:29
stephenfinif you could revisit and close out the vTPM series \o/15:29
gibisure15:29
gibion it15:29
gibiclosing features before the FF week is nice :D15:29
gibiand I'm planning for asking favors on the SRIOV series soon (as it is getting close to be ready)...15:30
stephenfinfire 'em at me15:30
gibistephenfin: I will, working on functional tests now15:31
*** tosky has quit IRC15:31
gibi+215:33
sean-k-mooneygibi: i havent reviewd the WIP patch fully although i tested it. are you ready to remove the WIP status from it15:34
sean-k-mooneyi do think its close too15:34
gibisean-k-mooney: from code perspective it is ready (and my next push will remove the WIP tag) from test perspective I will push the unit test coverage today, but the functional test needs another day15:35
sean-k-mooneyok thanks ill start reviewing the code so.15:35
gibicool, thanks15:35
openstackgerritMerged openstack/nova-specs master: Correct some spell errors  https://review.opendev.org/74944915:47
*** lpetrut has quit IRC15:53
*** belmoreira has quit IRC15:53
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Remove '[vnc] keymap', '[spice] keymap' options  https://review.opendev.org/74905615:56
openstackgerritMerged openstack/nova master: trivial: Use constants for libvirt version checks  https://review.opendev.org/74092116:02
openstackgerritBalazs Gibizer proposed openstack/nova master: Support SRIOV interface attach and detach  https://review.opendev.org/74099516:21
gibisean-k-mooney, stephenfin: unit test coverage is ready, and there is the first passing functional test as well ^^16:22
gibiI will continue with the functional tests tomorrow16:22
stephenfingreat16:22
stephenfincan review in the AM too16:23
*** links has joined #openstack-nova16:28
sean-k-mooneystephenfin: speaking fo funcitonal tests what is the state of your sriov functional tests16:40
sean-k-mooneyare those merged16:40
sean-k-mooneygibi: did you base your functional tests on stephens work?16:40
sean-k-mooneygibi: i guess you are not doing live migration tests16:40
sean-k-mooneyso dont need to16:40
sean-k-mooneyit is conflicting with stephens patches however16:41
*** dtantsur is now known as dtantsur|afk16:57
*** gibi has quit IRC16:57
*** derekh has quit IRC17:08
*** psachin has quit IRC17:09
*** mgoddard has quit IRC17:12
*** tesseract has quit IRC17:29
*** aj_mailing has joined #openstack-nova17:42
*** jsuchome has quit IRC17:43
*** aj_mailing has quit IRC17:52
*** links has quit IRC17:59
*** manuvakery has quit IRC18:05
gansoHi nova folks! I know everyone is busy at the moment, but I'd like to ask for some input in https://bugs.launchpad.net/nova/+bug/1893263 , it is a blocker bug that I have already pushed a fix, would like someone's blessing on it.18:15
openstackLaunchpad bug 1893263 in OpenStack Compute (nova) "Cannot create instance with multiqueue image and vif_type=tap (calico)" [Undecided,In progress] - Assigned to Rodrigo Barbieri (rodrigo-barbieri2010)18:15
*** k_mouza has joined #openstack-nova18:32
*** k_mouza has quit IRC18:36
sean-k-mooneyganso: you should be checking the vif_model18:40
sean-k-mooneyyou are also checking the image property via the system metadata table rather then form the image18:41
sean-k-mooneybut yes that is where you would fix this but just not how you should fix this18:41
gansosean-k-mooney: you mean check vif_model to confirm the vif_type before setting multiqueue?18:42
sean-k-mooneyno check the vif_model to confirm its virtio18:42
*** vishalmanchanda has quit IRC18:43
sean-k-mooneyif you set hw_vif_model=e1000 then you cant use multiqueue18:43
sean-k-mooneysince its a virtio feature18:43
gansosean-k-mooney: oh I see!18:43
gansoregarding the system metadata. I don't have access to the image in the vif.plug() method (or I am missing something)18:44
sean-k-mooneyyou have acess via the instance18:45
sean-k-mooneyinstance.image_meta18:45
sean-k-mooneyhttps://github.com/openstack/nova/blob/master/nova/objects/instance.py#L25018:45
gansooh I see! when I printed those fields I didn't get that, probably due to object property lazy loading18:46
gansosean-k-mooney: thanks, I will address those and push a new patch!18:46
sean-k-mooneyand yes the image_meta is a property on the instance its not stored in the instnace table directly so the proerty makes sure we correctly build an instance of the class meaning we get validation of the data19:07
sean-k-mooneywhich is preferebale over parsing the raw data in the system metadta table19:07
*** ftarasenko has joined #openstack-nova19:08
*** zzzeek has quit IRC19:17
*** zzzeek has joined #openstack-nova19:18
*** zzzeek has quit IRC19:25
*** zzzeek has joined #openstack-nova19:27
*** artom has quit IRC19:39
*** zzzeek has quit IRC19:53
*** zzzeek has joined #openstack-nova19:56
*** nweinber has quit IRC20:00
*** gyee has joined #openstack-nova20:17
sean-k-mooneyadrianc: https://review.opendev.org/#/c/745895/2/vif_plug_ovs/linux_net.py could you follow up with that offline20:20
sean-k-mooneyadrianc: the client lib freeze is tomorrow20:21
sean-k-mooneyso we need to resovle the outstaidn question or we wont have this in victoria20:21
sean-k-mooneywe could backport it technically but that will be after the upstream release20:21
sean-k-mooneyunless we ask for an exception.20:21
sean-k-mooneyi just +2d the precedding refactor patch. ill ping gibi and stephenfin to review it again in the morning but we need to confirm if that regex will work with other vendors too20:23
*** artom has joined #openstack-nova20:23
sean-k-mooneythe fact teh mellanox ci passed on it is somewhat reasuring unfortuntely the netronome one went away some time ago20:24
*** martinkennelly has quit IRC20:32
openstackgerritArtom Lifshitz proposed openstack/nova master: post live migration: don't call Neutron needlessly  https://review.opendev.org/74745120:38
artomsean-k-mooney, lyarwood ^^ if you still have the time/energy20:38
*** zzzeek has quit IRC20:50
*** zzzeek has joined #openstack-nova20:51
sean-k-mooneyso you just removed raise NotImplemted and moved the stub up20:56
sean-k-mooneywell and update the doc string20:57
artomsean-k-mooney, I fixed the test logic as well20:57
sean-k-mooneystubing _notify_about_instance_usage instead of post_live_migration_at_source20:57
sean-k-mooneythis is the delta https://review.opendev.org/#/c/747451/5..6/nova/tests/functional/compute/test_live_migration.py20:58
artomsean-k-mooney, since your migrate_data.vifs patch hasn't merged yet, we currently call driver.post_live_migration_at_source with a different network_info20:58
artomSo we can't assert anything about it, so I went and mocked the notification helper instead20:58
artomTo assert that we're using the correct network_info20:58
sean-k-mooneyah ok20:58
*** dustinc has joined #openstack-nova20:58
sean-k-mooneyits a litle non obvious but i guess that works20:58
artomsean-k-mooney, I didn't have a better idea :/20:59
artomMaybe I should add a note?20:59
sean-k-mooneyneither do i so i +1d it20:59
sean-k-mooneywell other then merge my patches20:59
artomCheers!20:59
artomI need to review that20:59
sean-k-mooneysure https://review.opendev.org/#/q/topic:bug/1888395+(status:open+OR+status:merged)21:00
sean-k-mooneyalso im so shocked a test fixture that does not behave liek reality :P21:01
sean-k-mooneythe sad thing is it proably did at one point and our assumetion and precondition have been broken in neturon21:01
sean-k-mooneybut its equally likely it was broken form the start just doiong the minium we needed21:02
sean-k-mooneyoh cool my devstack patch merged :) https://review.opendev.org/#/c/749295/ i can now stack and unstack without having to delete pyc file the whole time21:03
*** sapd1_x has quit IRC21:04
artomsean-k-mooney, no the fixture's actually fine21:04
artomWe just clobber what it gives us with migrate_data.vifs21:05
artomWhich makes the test pointless, because that never contains `migrating_to` in the peofile21:05
*** rcernin_ has joined #openstack-nova21:06
*** rcernin_ has quit IRC21:12
*** k_mouza has joined #openstack-nova21:12
*** sapd1_x has joined #openstack-nova21:17
*** artom has quit IRC21:18
*** k_mouza has quit IRC21:21
*** artom has joined #openstack-nova21:23
*** k_mouza has joined #openstack-nova21:27
*** k_mouza has quit IRC21:31
openstackgerritRodrigo Barbieri proposed openstack/nova master: Allow tap interface with multiqueue  https://review.opendev.org/74853321:35
openstackgerritMerged openstack/nova master: Don't unset Instance.old_flavor, new_flavor until necessary  https://review.opendev.org/74495821:43
openstackgerritMerged openstack/nova master: Describe '[glance]/enable_rbd_download'  https://review.opendev.org/74943721:44
*** kevinbenton has quit IRC21:59
*** kevinbenton has joined #openstack-nova22:00
*** k_mouza has joined #openstack-nova22:07
*** k_mouza has quit IRC22:11
*** rcernin_ has joined #openstack-nova22:15
*** avolkov has quit IRC22:23
*** raildo_ has joined #openstack-nova22:30
*** raildo has quit IRC22:32
*** k_mouza has joined #openstack-nova22:41
*** k_mouza has quit IRC22:47
*** rcernin_ has quit IRC23:04
*** rcernin has joined #openstack-nova23:04
*** mlavalle has quit IRC23:07
*** dustinc has quit IRC23:08
*** k_mouza has joined #openstack-nova23:19
*** k_mouza has quit IRC23:24
*** lifeless has quit IRC23:29
*** irclogbot_0 has quit IRC23:29
gmannstephenfin: replied on https://review.opendev.org/#/c/749505/. I remember we discussed this as one of the possible API clean during train cycle but dropped it as there are lot of API changes needed. But as this is API change we definitely need spec first.23:29
*** irclogbot_1 has joined #openstack-nova23:33
*** k_mouza has joined #openstack-nova23:57

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!