Wednesday, 2024-02-28

*** jph6 is now known as jph00:21
opendevreviewMerged openstack/nova master: block_device: Add encryption attributes to swap disks  https://review.opendev.org/c/openstack/nova/+/88431200:41
opendevreviewTakashi Kajinami proposed openstack/nova master: Override new KeyManager interfaces  https://review.opendev.org/c/openstack/nova/+/91045902:18
opendevreviewMerged openstack/nova master: libvirt: Support maxphysaddr.  https://review.opendev.org/c/openstack/nova/+/90751606:18
opendevreviewSteven Blatzheim proposed openstack/nova master: fixed nova-metadata-api for ovn dhcp native networks  https://review.opendev.org/c/openstack/nova/+/91046606:26
opendevreviewTakashi Kajinami proposed openstack/nova master: Override new KeyManager interfaces  https://review.opendev.org/c/openstack/nova/+/91045907:00
tkajinamo/  I'd like to ask for some attention to https://review.opendev.org/c/openstack/nova/+/896100 to unblock u-c update to pull in the new castellan release for Caracal.07:10
tkajinam(thanks stephenfin for that patch, by the way07:13
opendevreviewRajesh Tailor proposed openstack/nova master: Add support for showing requested az in output  https://review.opendev.org/c/openstack/nova/+/90456808:13
*** mklejn__ is now known as mklejn08:15
opendevreviewribaudr proposed openstack/nova master: Amend ShareMappingStatus due to asynchronous call  https://review.opendev.org/c/openstack/nova/+/90886408:22
opendevreviewribaudr proposed openstack/nova master: Attach Manila shares via virtiofs (manila abstraction)  https://review.opendev.org/c/openstack/nova/+/83119408:22
opendevreviewribaudr proposed openstack/nova master: Attach Manila shares via virtiofs (drivers and compute manager part)  https://review.opendev.org/c/openstack/nova/+/83309008:22
opendevreviewribaudr proposed openstack/nova master: Mounting the shares as part of the initialization process  https://review.opendev.org/c/openstack/nova/+/88007508:23
opendevreviewribaudr proposed openstack/nova master: Deletion of associated share mappings on instance deletion  https://review.opendev.org/c/openstack/nova/+/88147208:23
opendevreviewribaudr proposed openstack/nova master: Add metadata for shares  https://review.opendev.org/c/openstack/nova/+/85050008:23
opendevreviewribaudr proposed openstack/nova master: Add share_info parameter to reboot method for each driver (driver part)  https://review.opendev.org/c/openstack/nova/+/85482308:23
opendevreviewribaudr proposed openstack/nova master: Support rebooting an instance with shares (compute manager part)  https://review.opendev.org/c/openstack/nova/+/85482408:23
opendevreviewribaudr proposed openstack/nova master: Add share_info parameter to resume method for each driver (driver part)  https://review.opendev.org/c/openstack/nova/+/86028408:23
opendevreviewribaudr proposed openstack/nova master: Support resuming an instance with shares (compute manager part)  https://review.opendev.org/c/openstack/nova/+/86028508:23
opendevreviewribaudr proposed openstack/nova master: Add helper methods to rescue/unrescue shares  https://review.opendev.org/c/openstack/nova/+/86028608:23
opendevreviewribaudr proposed openstack/nova master: Support rescuing an instance with shares (driver part)  https://review.opendev.org/c/openstack/nova/+/86028708:23
opendevreviewribaudr proposed openstack/nova master: Support rescuing an instance with shares (compute manager part)  https://review.opendev.org/c/openstack/nova/+/86028808:23
opendevreviewribaudr proposed openstack/nova master: Allow to mount manila share using Cephfs protocol  https://review.opendev.org/c/openstack/nova/+/88386208:23
opendevreviewribaudr proposed openstack/nova master: Check shares support (compute manager)  https://review.opendev.org/c/openstack/nova/+/88575108:23
opendevreviewribaudr proposed openstack/nova master: Add share lock/unlock and restrict visibility  https://review.opendev.org/c/openstack/nova/+/89034008:23
opendevreviewribaudr proposed openstack/nova master: Check shares support (only API exception)  https://review.opendev.org/c/openstack/nova/+/88575208:23
opendevreviewribaudr proposed openstack/nova master: Attach Manila shares via virtiofs (API)  https://review.opendev.org/c/openstack/nova/+/83683008:23
opendevreviewribaudr proposed openstack/nova master: Check shares support (API)  https://review.opendev.org/c/openstack/nova/+/85049908:23
opendevreviewribaudr proposed openstack/nova master: Add helper methods to attach/detach shares  https://review.opendev.org/c/openstack/nova/+/88575308:23
opendevreviewribaudr proposed openstack/nova master: Add instance.share_attach notification  https://review.opendev.org/c/openstack/nova/+/85050108:23
opendevreviewribaudr proposed openstack/nova master: Add instance.share_detach notification  https://review.opendev.org/c/openstack/nova/+/85102808:23
opendevreviewribaudr proposed openstack/nova master: Add shares to InstancePayload  https://review.opendev.org/c/openstack/nova/+/85102908:23
opendevreviewribaudr proposed openstack/nova master: Add instance.share_attach_error notification  https://review.opendev.org/c/openstack/nova/+/86028208:23
opendevreviewribaudr proposed openstack/nova master: Add instance.share_detach_error notification  https://review.opendev.org/c/openstack/nova/+/86028308:23
opendevreviewribaudr proposed openstack/nova master: Add libvirt test to ensure metadata are working.  https://review.opendev.org/c/openstack/nova/+/85208608:23
opendevreviewribaudr proposed openstack/nova master: Add virt/libvirt error test cases  https://review.opendev.org/c/openstack/nova/+/85208708:23
opendevreviewribaudr proposed openstack/nova master: Docs about Manila shares API usage  https://review.opendev.org/c/openstack/nova/+/87164208:23
Ugglagibi, bauzas , new update of virtiofs ^ please note that I have not fully tested it yet with devstack. I'm gonna do it now. The doc may need a review as well. However this is a new round to show you the new code.08:25
stblatzheimCan someone have a look at https://bugs.launchpad.net/nova/+bug/2055245 ? I already posted a suitable solution for this behaviour.08:36
bauzasUggla: ack, and thanks all for the fish :)09:15
opendevreviewmelanie witt proposed openstack/nova master: libvirt: Configure and teardown ephemeral encryption secrets  https://review.opendev.org/c/openstack/nova/+/82675409:20
opendevreviewmelanie witt proposed openstack/nova master: imagebackend: Add support to libvirt_info for LUKS based encryption  https://review.opendev.org/c/openstack/nova/+/82675509:20
opendevreviewmelanie witt proposed openstack/nova master: Add encryption support to convert_image  https://review.opendev.org/c/openstack/nova/+/87093409:20
opendevreviewmelanie witt proposed openstack/nova master: Add hw_ephemeral_encryption_secret_uuid image property  https://review.opendev.org/c/openstack/nova/+/87093509:20
opendevreviewmelanie witt proposed openstack/nova master: libvirt: make <encryption> a sub element of <source>  https://review.opendev.org/c/openstack/nova/+/90551509:20
opendevreviewmelanie witt proposed openstack/nova master: Support create with ephemeral encryption for qcow2  https://review.opendev.org/c/openstack/nova/+/87093209:20
opendevreviewmelanie witt proposed openstack/nova master: Support (resize|cold migration) with ephemeral encryption for qcow2  https://review.opendev.org/c/openstack/nova/+/87093309:20
opendevreviewmelanie witt proposed openstack/nova master: Support live migration with ephemeral encryption for qcow2  https://review.opendev.org/c/openstack/nova/+/90551209:20
opendevreviewmelanie witt proposed openstack/nova master: Support rebuild with ephemeral encryption for qcow2  https://review.opendev.org/c/openstack/nova/+/87093909:20
opendevreviewmelanie witt proposed openstack/nova master: Support rescue with ephemeral encryption for qcow2  https://review.opendev.org/c/openstack/nova/+/87367509:20
opendevreviewmelanie witt proposed openstack/nova master: Add encryption support to qemu-img rebase  https://review.opendev.org/c/openstack/nova/+/87093609:20
opendevreviewmelanie witt proposed openstack/nova master: Support snapshot with ephemeral encryption for qcow2  https://review.opendev.org/c/openstack/nova/+/87093709:20
opendevreviewmelanie witt proposed openstack/nova master: Add backing_encryption_secret_uuid to BlockDeviceMapping  https://review.opendev.org/c/openstack/nova/+/90796009:20
opendevreviewmelanie witt proposed openstack/nova master: Support encrypted backing files for qcow2  https://review.opendev.org/c/openstack/nova/+/90796109:20
opendevreviewmelanie witt proposed openstack/nova master: Support cross cell resize with ephemeral encryption for qcow2  https://review.opendev.org/c/openstack/nova/+/90959509:20
opendevreviewmelanie witt proposed openstack/nova master: libvirt: Introduce support for raw with LUKS  https://review.opendev.org/c/openstack/nova/+/88431309:20
opendevreviewmelanie witt proposed openstack/nova master: libvirt: Introduce support for rbd with LUKS  https://review.opendev.org/c/openstack/nova/+/88991209:20
opendevreviewmelanie witt proposed openstack/nova master: Report ephemeral disk encryption in the metadata API  https://review.opendev.org/c/openstack/nova/+/90994509:20
opendevreviewmelanie witt proposed openstack/nova master: Deprecate legacy ephemeral storage encryption using dm-crypt  https://review.opendev.org/c/openstack/nova/+/90994709:20
opendevreviewmelanie witt proposed openstack/nova master: Documentation for ephemeral encryption  https://review.opendev.org/c/openstack/nova/+/91003409:20
Ugglabauzas, for the fish ? You lost me ?09:26
bauzasUggla: no, just a famous H2G2 sentence :)09:28
bauzasso long and thanks all for the fish :)09:29
bauzasthanks for *all* the fish (btw.)09:30
UgglaUggla, I was not on that page. :)09:30
opendevreviewSteven Blatzheim proposed openstack/nova master: Fix nova-metadata-api for ovn dhcp native networks  https://review.opendev.org/c/openstack/nova/+/91046609:51
gibiUggla: ack, start looking...09:52
Ugglagibi, thx09:52
opendevreviewSteven Blatzheim proposed openstack/nova master: Fix nova-metadata-api for ovn dhcp native networks  https://review.opendev.org/c/openstack/nova/+/91046609:53
opendevreviewSteven Blatzheim proposed openstack/nova master: Fix nova-metadata-api for ovn dhcp native networks  https://review.opendev.org/c/openstack/nova/+/91046609:59
Ugglagibi, fyi https://review.opendev.org/c/openstack/openstacksdk/+/889519 is merged10:02
Ugglaso no need to cherry pick it10:02
opendevreviewSteven Blatzheim proposed openstack/nova master: fix indention  https://review.opendev.org/c/openstack/nova/+/91047910:24
opendevreviewSteven Blatzheim proposed openstack/nova master: Fix nova-metadata-api for ovn dhcp native networks  https://review.opendev.org/c/openstack/nova/+/91046610:29
opendevreviewSylvain Bauza proposed openstack/nova master: Modify the mdevs in the migrate XML  https://review.opendev.org/c/openstack/nova/+/90425811:21
opendevreviewSylvain Bauza proposed openstack/nova master: WIP: add a periodic check for migrations  https://review.opendev.org/c/openstack/nova/+/90959811:21
sean-k-mooney[m]tkajinam:  i had a look at the castellan pathch. i have +2’d it but form my perspective you missed the non-clinet lib freeze so im treating this as an expcetion because its small but i dont think its in line wiht our normal release process11:36
sean-k-mooney[m]bauzas: i was holding off on comeitng on the docs change because i didnt want you to repsin it but since you have im going to ask you to correct some other issues 11:38
fricklersean-k-mooney[m]: the lib was released in time last week, it is just the reqs update that got stuck because of test failures. technically there's time for that until friday without an exception11:56
sean-k-mooney[m] frickler that not how i managed this when i was the release leasion for nova and i was asked ot get an excption in the past11:57
sean-k-mooney[m]for libs in the same situration11:57
sean-k-mooney[m]as i said im not blockign this but i dont really like late breakign chnages like this espcially when the lib in question could have added the new api witout breaking the existing users11:58
stblatzheimsean-k-mooney[m]: Regarding https://review.opendev.org/c/openstack/nova/+/910466 i don't get why this should be solved in neutron. It's just a changed behaviour which wasn't adapted in the decision making of dhcp in nova-api. Can you clarify this?11:59
sean-k-mooney[m]this should have been a castalan 5.0 bump not 4.4 by the way as its an api breakage11:59
sean-k-mooney[m]it should not have been a minor version bump11:59
fricklerI don't want to defend that change, but I also note that the nova patch has gone unreviewed for 5 months or so11:59
sean-k-mooney[m]because its not additive11:59
sean-k-mooney[m]stblatzheim: this behavior should not vary based on the neutron backend12:01
sean-k-mooney[m]if the subnet has dhcp enabled in any form12:01
sean-k-mooney[m]the subnet should have a port with network:dhcp12:02
stblatzheimBut then the whole decision making is not valid anymore. You could just get the enable_dhcp option and not search for any port with the tenant then12:02
sean-k-mooney[m]as the owner12:02
stblatzheimAs there are no dedicated dhcp ports anymore this descision can't be done like this in ovn context12:03
stblatzheimOtherwise you would have to fake the device owner in neutron api12:04
fricklersean-k-mooney[m]: is "the subnet should have a port with network:dhcp" defined in some nova-neutron contract? or is that just the way it used to work with earlier backends?12:04
sean-k-mooney[m]no what im saying is neutron is not implementing the api correctly the ovn dhcp interface should be network:dhcp_port as the owner12:04
fricklerbut iiuc there is no specific interface for dhcp12:05
sean-k-mooney[m]frickler:  that is the way its used in other backend so we should not be special casing for ovn12:05
sean-k-mooney[m]and if we are then thats reallly a feature not a bug12:05
fricklersean-k-mooney[m]: maybe nova relying on undocumented things is the bug12:06
sean-k-mooney[m]the implict contract is that the ip used for dhcp is held by a port with   network:dhcp12:06
sean-k-mooney[m]or ovn doing it differntly is a bug12:06
sean-k-mooney[m]i dont like adding yet another fallback here12:08
sean-k-mooney[m]like if a diffent backend decided to use somethign difffent again we should not have to keep extiding nova for this12:09
stblatzheimThe fallback to the gateway ip seems worse for me12:09
stblatzheimWhy do we even need an ip in dhcp context?12:09
sean-k-mooney[m]well what is broekn for you now when dhcp is not in the metadata12:11
stblatzheimThe instance get's a static configuration for the network interfaces instead of a dhcp configuration12:11
sean-k-mooney[m]oh you dont want static ips12:12
stblatzheimThats why we use dhcp :) In the specific case we have vms that may get additional routes via dhcp12:13
sean-k-mooney[m]i would be ok with a nova change to the metadata to make this work based on if dhcpu is enabled and not based on finding a port ip for that server12:13
sean-k-mooney[m]like i think we should just be using subnet.get(‘enable_dhcp’) to set the type in the metadata to ipv4_dhcp12:14
stblatzheimWould be fine for me, do we even need a real ip in the dhcp_server field subnet_dict['dhcp_server']?12:15
sean-k-mooney[m]likely not but i am not sure you should be fixing this in _get_subnets_from_port12:15
sean-k-mooney[m]if you are trying to fix this for metadata i think a fix in the generatio would make more sense12:16
stblatzheimLet me just check. My first work on openstack code itself ...12:17
sean-k-mooney[m]https://github.com/openstack/nova/blob/7fa1859576ac577da89cb817f93b1c54d3a937ce/nova/virt/netutils.py#L16812:23
sean-k-mooney[m]my inclination is it should be adressed in ^ or related code12:23
sean-k-mooney[m]in either case we will need at least unit test coverage for this12:23
sean-k-mooney[m]stblatzheim:  you should be fixing this here https://github.com/openstack/nova/blob/7fa1859576ac577da89cb817f93b1c54d3a937ce/nova/virt/netutils.py#L29212:28
stblatzheimI'll check if i find a suitable solution there.12:29
sean-k-mooney[m]you might be able to just check subnet.get_meta(enable_dhcp)12:30
stblatzheimI think there would be an additional change to make enable_dhcp available there12:31
stblatzheimBut i'm sure i can make this12:31
stblatzheimsubnet_dict (which is returned) is defined here: https://github.com/openstack/nova/blob/7fa1859576ac577da89cb817f93b1c54d3a937ce/nova/network/neutron.py#L3608 Would need to add the enable_dhcp conditionaly here also i suppose. Should i make a new review for this?12:34
opendevreviewPavlo Shchelokovskyy proposed openstack/nova master: Auto set heartbeat_in_pthread for wsgi services  https://review.opendev.org/c/openstack/nova/+/90988012:35
sean-k-mooney stblatzheim  adding the enable_dhcp there is fine13:02
sean-k-mooneystblatzheim: so yes feel free to update your exixting reivew13:02
sean-k-mooneyso just add enable_dhcp there adn then make the if check for either enable_dhcp or dhcp_server13:03
opendevreviewribaudr proposed openstack/nova master: Allow to mount manila share using Cephfs protocol  https://review.opendev.org/c/openstack/nova/+/88386213:05
opendevreviewribaudr proposed openstack/nova master: Check shares support (compute manager)  https://review.opendev.org/c/openstack/nova/+/88575113:05
opendevreviewribaudr proposed openstack/nova master: Add share lock/unlock and restrict visibility  https://review.opendev.org/c/openstack/nova/+/89034013:05
opendevreviewribaudr proposed openstack/nova master: Check shares support (only API exception)  https://review.opendev.org/c/openstack/nova/+/88575213:05
opendevreviewribaudr proposed openstack/nova master: Attach Manila shares via virtiofs (API)  https://review.opendev.org/c/openstack/nova/+/83683013:05
opendevreviewribaudr proposed openstack/nova master: Check shares support (API)  https://review.opendev.org/c/openstack/nova/+/85049913:05
opendevreviewribaudr proposed openstack/nova master: Add helper methods to attach/detach shares  https://review.opendev.org/c/openstack/nova/+/88575313:05
opendevreviewribaudr proposed openstack/nova master: Add instance.share_attach notification  https://review.opendev.org/c/openstack/nova/+/85050113:05
opendevreviewribaudr proposed openstack/nova master: Add instance.share_detach notification  https://review.opendev.org/c/openstack/nova/+/85102813:05
opendevreviewribaudr proposed openstack/nova master: Add shares to InstancePayload  https://review.opendev.org/c/openstack/nova/+/85102913:05
opendevreviewribaudr proposed openstack/nova master: Add instance.share_attach_error notification  https://review.opendev.org/c/openstack/nova/+/86028213:05
opendevreviewribaudr proposed openstack/nova master: Add instance.share_detach_error notification  https://review.opendev.org/c/openstack/nova/+/86028313:05
opendevreviewribaudr proposed openstack/nova master: Add libvirt test to ensure metadata are working.  https://review.opendev.org/c/openstack/nova/+/85208613:05
opendevreviewribaudr proposed openstack/nova master: Add virt/libvirt error test cases  https://review.opendev.org/c/openstack/nova/+/85208713:05
opendevreviewribaudr proposed openstack/nova master: Docs about Manila shares API usage  https://review.opendev.org/c/openstack/nova/+/87164213:05
auniyalhi melwitt, dansmith any ideas on this fail no test really failed but job failed with TIMEOUT - https://zuul.opendev.org/t/openstack/build/0e88ede030024fcbb16405750614fb2f13:12
auniyaldo you think its a deployment issue ?13:14
opendevreviewSteven Blatzheim proposed openstack/nova master: Fix nova-metadata-api for ovn dhcp native networks  https://review.opendev.org/c/openstack/nova/+/91046613:14
opendevreviewSteven Blatzheim proposed openstack/nova master: Fix nova-metadata-api for ovn dhcp native networks  https://review.opendev.org/c/openstack/nova/+/91046613:20
stblatzheimsean-k-mooney: Updated the review like you suggested and reused existing unit test with the adaption of the new behaviour.13:22
sean-k-mooneystblatzheim: ack im in a meeting but ill take a look when done.13:31
opendevreviewPavlo Shchelokovskyy proposed openstack/nova master: Auto set heartbeat_in_pthread for wsgi services  https://review.opendev.org/c/openstack/nova/+/90988013:39
opendevreviewKonrad Gube proposed openstack/nova master: Use Cinder's os-extend_volume_completion volume action.  https://review.opendev.org/c/openstack/nova/+/87356013:57
opendevreviewSylvain Bauza proposed openstack/nova master: Modify the mdevs in the migrate XML  https://review.opendev.org/c/openstack/nova/+/90425814:54
opendevreviewSylvain Bauza proposed openstack/nova master: WIP: add a periodic check for migrations  https://review.opendev.org/c/openstack/nova/+/90959814:54
bauzassean-k-mooney: did a respin ^ was simplier 14:54
tkajinamsean-k-mooney, I totally agree there are multiple things we can improve, but for this specific case tbvh this was out of our control from oslo side (at least it was out of my own control) because castellan is maintained between barbican and oslo and all the changes were merged by barbican side without any consultation to oslo side...15:04
tkajinamand they don't really care about anything they are not actually interested in. /me sighs15:04
tkajinamwe probably should try creating a mid-cycle release of some oslo libraries to detect such problems early, so that we can more smoothly complete requirement bumps, instead of finding multiple problems at last minutes15:07
sean-k-mooneybauzas: thanks +2w on the non WIP patch15:18
bauzastks15:18
sean-k-mooneyill review the perodic after you decdid it ready15:18
bauzasI need to test it 15:18
bauzasnot sure I'll have time until Friday15:18
bauzasETOOMANYTHINGS15:18
sean-k-mooneytkajinam: or we just need to have something mroe visiable in our meetings ectra15:19
sean-k-mooneyto ensure we have better comuncitation15:19
sean-k-mooneytkajinam: we have beenb usign a etherpad this cycle15:19
sean-k-mooneyin past cycle wee used review priority15:19
sean-k-mooneyso we just need a way to signal this work will be needed eiarlr so ti does not come as a surpise at the end.15:20
tkajinamI'll try15:23
kgubesean-k-mooney, bauzas: regarding yesterdays discussion of my patch, would it also be acceptable to just check for the supported cinder microversion in the code, so the patch is compatible with older cinderclient versions?15:34
dansmithsean-k-mooney: so I'm a bit confused about how this encryption stuff works with ceph15:35
dansmithsean-k-mooney: the key we're using to access a given disk is known really only to libvirt and qemu on the host, right? It's really qemu's integrated rbd client that's doing the luks on top, AFAK15:36
dansmithso what I don't understand is how something that does *not* know about those things do image operations like flatten when it doesn't know those details15:36
dansmithlike, let's say we have an unencrypted base image, encrypted root disk on top. we haven't read or written block 10,15:37
dansmithwe call librbd to flatten the image (detach from parent), we have to copy any un-CoW'd blocks into the detached disk to make it whole15:38
dansmithbut we don't have the key, or even know that there's an encryption scheme going on in the child disk15:38
dansmithmelwitt: ^ when you're around15:50
mnaserhttps://review.opendev.org/c/openstack/nova/+/909098 + https://review.opendev.org/c/openstack/nova/+/909541 is finally passing thanks15:59
opendevreviewSteven Blatzheim proposed openstack/nova master: Fix nova-metadata-api for ovn dhcp native networks  https://review.opendev.org/c/openstack/nova/+/91046616:20
opendevreviewSteven Blatzheim proposed openstack/nova master: Fix nova-metadata-api for ovn dhcp native networks  https://review.opendev.org/c/openstack/nova/+/91046616:24
opendevreviewMerged openstack/nova master: enforce remote console shutdown  https://review.opendev.org/c/openstack/nova/+/90182416:33

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!