Wednesday, 2019-07-17

*** betherly has joined #openstack-nova00:10
*** slaweq has joined #openstack-nova00:11
*** betherly has quit IRC00:15
*** slaweq has quit IRC00:15
*** TxGirlGeek has quit IRC00:21
*** hemna has joined #openstack-nova00:35
*** hemna has quit IRC00:42
*** sapd1_x has joined #openstack-nova00:47
*** gyee has quit IRC00:48
*** sapd1_x has quit IRC00:57
*** slaweq has joined #openstack-nova00:59
*** icarusfactor has quit IRC01:01
*** icarusfactor has joined #openstack-nova01:02
*** betherly has joined #openstack-nova01:02
*** slaweq has quit IRC01:04
*** betherly has quit IRC01:07
*** TxGirlGeek has joined #openstack-nova01:09
*** slaweq has joined #openstack-nova01:11
*** TxGirlGeek has quit IRC01:11
*** imacdonn has quit IRC01:16
*** slaweq has quit IRC01:16
*** imacdonn has joined #openstack-nova01:16
*** TxGirlGeek has joined #openstack-nova01:16
*** betherly has joined #openstack-nova01:43
*** tbachman has quit IRC01:45
*** betherly has quit IRC01:49
*** tetsuro has joined #openstack-nova01:53
*** yaawang has quit IRC02:10
*** tetsuro has quit IRC02:13
openstackgerritYongli He proposed openstack/nova master: Clean up orphan instances virt driver  https://review.opendev.org/64891202:23
openstackgerritYongli He proposed openstack/nova master: clean up orphan instances  https://review.opendev.org/62776502:23
*** ricolin has joined #openstack-nova02:33
*** BjoernT has joined #openstack-nova02:39
*** icarusfactor has quit IRC02:40
*** BjoernT_ has joined #openstack-nova02:40
*** icarusfactor has joined #openstack-nova02:40
*** BjoernT has quit IRC02:44
*** betherly has joined #openstack-nova02:46
*** betherly has quit IRC02:51
*** icarusfactor has quit IRC02:54
*** icarusfactor has joined #openstack-nova02:55
*** yaawang has joined #openstack-nova02:58
*** tetsuro has joined #openstack-nova03:01
*** tetsuro has quit IRC03:05
*** betherly has joined #openstack-nova03:06
*** tbachman has joined #openstack-nova03:08
*** igordc has quit IRC03:08
*** slaweq has joined #openstack-nova03:11
*** betherly has quit IRC03:12
*** tbachman_ has joined #openstack-nova03:12
*** icarusfactor has quit IRC03:12
*** icarusfactor has joined #openstack-nova03:12
*** tbachman has quit IRC03:13
*** tbachman_ is now known as tbachman03:13
*** icarusfactor has quit IRC03:14
*** icarusfactor has joined #openstack-nova03:14
*** slaweq has quit IRC03:16
openstackgerritTakashi NATSUME proposed openstack/python-novaclient master: Deprecate the '--config-drive' option  https://review.opendev.org/65368303:20
*** icarusfactor has quit IRC03:24
*** factor has joined #openstack-nova03:25
*** BjoernT_ has quit IRC03:27
*** factor has quit IRC03:29
*** factor has joined #openstack-nova03:29
*** psachin has joined #openstack-nova03:32
openstackgerrithuanhongda proposed openstack/nova master: Fix for auth during live-migration (2)  https://review.opendev.org/66986703:34
*** mmethot has quit IRC03:35
*** betherly has joined #openstack-nova03:38
*** betherly has quit IRC03:42
*** tetsuro has joined #openstack-nova03:49
*** sapd1_x has joined #openstack-nova03:50
*** sapd1_x has quit IRC03:58
*** udesale has joined #openstack-nova04:03
*** mmethot has joined #openstack-nova04:04
*** betherly has joined #openstack-nova04:09
*** slaweq has joined #openstack-nova04:11
*** betherly has quit IRC04:13
openstackgerritMerged openstack/nova master: vif: Resolve a TODO and update another  https://review.opendev.org/66663104:15
*** slaweq has quit IRC04:16
*** tetsuro has quit IRC04:22
*** igordc has joined #openstack-nova04:22
*** betherly has joined #openstack-nova04:29
*** betherly has quit IRC04:34
*** betherly has joined #openstack-nova04:50
*** betherly has quit IRC04:54
*** tetsuro has joined #openstack-nova04:58
*** brinzhang_ has joined #openstack-nova04:59
*** tbachman has quit IRC05:00
*** Luzi has joined #openstack-nova05:02
*** brinzhang has quit IRC05:02
*** slaweq has joined #openstack-nova05:11
*** slaweq has quit IRC05:17
*** TxGirlGeek has quit IRC05:22
*** ratailor has joined #openstack-nova05:33
*** udesale has quit IRC05:35
*** udesale has joined #openstack-nova05:35
*** ratailor_ has joined #openstack-nova05:36
*** udesale has quit IRC05:36
*** udesale has joined #openstack-nova05:36
*** shilpasd has quit IRC05:37
*** ratailor has quit IRC05:38
*** betherly has joined #openstack-nova05:41
*** betherly has quit IRC05:46
*** maciejjozefczyk has joined #openstack-nova06:01
*** whoami-rajat has joined #openstack-nova06:06
*** slaweq has joined #openstack-nova06:11
*** igordc has quit IRC06:11
*** betherly has joined #openstack-nova06:12
*** igordc has joined #openstack-nova06:15
*** slaweq has quit IRC06:16
*** betherly has quit IRC06:17
*** liuyulong has quit IRC06:19
*** pcaruana has joined #openstack-nova06:20
*** udesale has quit IRC06:22
*** udesale has joined #openstack-nova06:22
*** udesale has quit IRC06:24
*** udesale has joined #openstack-nova06:25
*** slaweq has joined #openstack-nova06:28
*** takashin has joined #openstack-nova06:32
*** slaweq has quit IRC06:33
*** igordc has quit IRC06:33
*** tetsuro has quit IRC06:35
*** gokhani has joined #openstack-nova06:36
*** luksky11 has joined #openstack-nova06:37
*** betherly has joined #openstack-nova06:43
*** betherly has quit IRC06:48
*** damien_r has joined #openstack-nova06:57
*** damien_r has quit IRC06:57
*** damien_r has joined #openstack-nova06:58
openstackgerrithuanhongda proposed openstack/nova master: Fix for auth during live-migration (2)  https://review.opendev.org/66986707:00
*** slaweq has joined #openstack-nova07:01
*** betherly has joined #openstack-nova07:04
*** rpittau|afk is now known as rpittau07:08
*** betherly has quit IRC07:09
*** ralonsoh has joined #openstack-nova07:15
*** ttsiouts has joined #openstack-nova07:15
*** xek has joined #openstack-nova07:26
*** tssurya has joined #openstack-nova07:29
*** helenafm has joined #openstack-nova07:43
*** ttsiouts has quit IRC07:46
*** ttsiouts has joined #openstack-nova07:46
*** ttsiouts has quit IRC07:51
*** damien_r has quit IRC07:51
*** ratailor__ has joined #openstack-nova07:52
*** ratailor_ has quit IRC07:55
*** rcernin has quit IRC07:56
*** udesale has quit IRC07:56
*** ttsiouts has joined #openstack-nova08:04
*** spatel has joined #openstack-nova08:10
openstackgerritBalazs Gibizer proposed openstack/nova master: allow getting resource request of every bound ports of an instance  https://review.opendev.org/65511008:11
*** rcernin has joined #openstack-nova08:12
openstackgerritBalazs Gibizer proposed openstack/nova master: Pass network API to the conducor's MigrationTask  https://review.opendev.org/65511108:13
*** spatel has quit IRC08:14
*** damien_r has joined #openstack-nova08:14
openstackgerritBalazs Gibizer proposed openstack/nova master: Add request_spec to server move RPC calls  https://review.opendev.org/65572108:15
openstackgerritBalazs Gibizer proposed openstack/nova master: re-calculate provider mapping during migration  https://review.opendev.org/65511208:17
openstackgerritBalazs Gibizer proposed openstack/nova master: update allocation in binding profile during migrate  https://review.opendev.org/65642208:19
*** betherly has joined #openstack-nova08:19
openstackgerritBalazs Gibizer proposed openstack/nova master: Extend NeutronFixture to handle migrations  https://review.opendev.org/65511408:21
openstackgerritBalazs Gibizer proposed openstack/nova master: prepare func test env for moving servers with bandwidth  https://review.opendev.org/65510908:23
*** betherly has quit IRC08:24
openstackgerritBalazs Gibizer proposed openstack/nova master: func test for migrate server with ports having resource request  https://review.opendev.org/65511308:24
*** betherly has joined #openstack-nova08:40
*** tssurya_ has joined #openstack-nova08:41
*** tssurya has quit IRC08:41
*** betherly has quit IRC08:44
*** udesale has joined #openstack-nova08:46
*** luksky11 has quit IRC08:47
*** ociuhandu has joined #openstack-nova08:57
*** ociuhandu has quit IRC08:58
*** derekh has joined #openstack-nova08:58
*** takashin has left #openstack-nova09:00
*** ociuhandu has joined #openstack-nova09:04
*** helenafm has quit IRC09:07
*** helenafm has joined #openstack-nova09:08
*** tkajinam has quit IRC09:09
*** ociuhandu has quit IRC09:10
*** davidsha has joined #openstack-nova09:18
*** luksky11 has joined #openstack-nova09:22
*** dikonoor has joined #openstack-nova09:25
openstackgerritAlex Xu proposed openstack/nova master: Add the virt driver interface for claim and unclaim the devices  https://review.opendev.org/67078209:27
openstackgerritAlex Xu proposed openstack/nova master: Moves the allocation retrieving early  https://review.opendev.org/67078309:27
openstackgerritAlex Xu proposed openstack/nova master: Calling the virt driver's claim/unclaim_for_instance in resource tracker  https://review.opendev.org/67078409:27
openstackgerritAlex Xu proposed openstack/nova master: [WIP] Populate the existing mediated devices in the libvirt device manager  https://review.opendev.org/67078709:27
openstackgerritAlex Xu proposed openstack/nova master: [WIP] Using the claim/unclaim_for_instance for mdevs  https://review.opendev.org/67122209:27
*** ttsiouts has quit IRC09:29
openstackgerritBoris Bobrov proposed openstack/nova master: Provide HW_CPU_X86_AMD_SEV trait when SEV is supported  https://review.opendev.org/63868009:29
openstackgerritBoris Bobrov proposed openstack/nova master: Add extra spec parameter and image property for memory encryption  https://review.opendev.org/66442009:29
openstackgerritBoris Bobrov proposed openstack/nova master: Extract SEV-specific bits on host detection  https://review.opendev.org/63633409:29
openstackgerritBoris Bobrov proposed openstack/nova master: Add <launchSecurity> and <driver iommu='on' /> to config.py  https://review.opendev.org/63631809:29
openstackgerritBoris Bobrov proposed openstack/nova master: Apply SEV-specific guest config when SEV is required  https://review.opendev.org/64456509:29
openstackgerritBoris Bobrov proposed openstack/nova master: Enable booting of libvirt guests with AMD SEV memory encryption  https://review.opendev.org/66661609:29
*** ttsiouts has joined #openstack-nova09:29
openstackgerritChris Dent proposed openstack/nova master: Restore RT.old_resources if ComputeNode.save() fails  https://review.opendev.org/66826309:29
*** cdent has joined #openstack-nova09:31
cdentstephenfin: https://review.opendev.org/#/c/668263/ went into merge conflict, so I fixed it since mriedem is away. Wanna drop your +W back on?09:31
stephenfinSure09:31
cdentthanks09:32
*** ttsiouts_ has joined #openstack-nova09:33
*** ttsiouts has quit IRC09:34
*** cdent has quit IRC09:50
*** ttsiouts_ has quit IRC09:53
*** ttsiouts has joined #openstack-nova09:53
*** ttsiouts_ has joined #openstack-nova09:57
*** ttsiouts has quit IRC09:58
*** helenafm has quit IRC10:03
*** ociuhandu has joined #openstack-nova10:05
*** helenafm has joined #openstack-nova10:07
*** tssurya_ is now known as tssurya10:10
*** ociuhandu has quit IRC10:13
*** cdent has joined #openstack-nova10:16
*** ttsiouts_ has quit IRC10:17
*** ttsiouts has joined #openstack-nova10:18
*** ttsiouts has quit IRC10:23
*** cdent has quit IRC10:23
*** cdent has joined #openstack-nova10:26
*** dikonoor has quit IRC10:38
*** udesale has quit IRC10:38
*** owalsh has quit IRC10:42
*** slaweq has quit IRC10:43
*** slaweq has joined #openstack-nova10:43
*** belmoreira has joined #openstack-nova10:45
*** priteau has joined #openstack-nova10:45
*** shilpasd has joined #openstack-nova10:46
*** ociuhandu has joined #openstack-nova10:46
*** Bidwe_jay has joined #openstack-nova10:49
*** betherly has joined #openstack-nova10:50
*** xek has quit IRC10:55
*** ociuhandu has quit IRC10:57
*** xek has joined #openstack-nova10:58
*** ttsiouts has joined #openstack-nova11:07
*** owalsh has joined #openstack-nova11:18
*** maciejjozefczyk is now known as mjozefcz|lunch11:18
*** maciejjozefczyk has joined #openstack-nova11:25
*** mjozefcz|lunch has quit IRC11:27
*** tesseract has joined #openstack-nova11:28
*** rcernin has quit IRC11:30
*** panda is now known as panda|lunch11:44
kashyapcoreycb: Hi, just as a follow-up on that distro-specific work for EDK2/OVMF:11:44
kashyapcoreycb: My Fedora patch is merged: https://src.fedoraproject.org/rpms/edk2/c/674b3c8a27a811:44
kashyapcoreycb: And I've filed the bugs for Debian and Ubuntu:11:45
kashyap  - Ubuntu: https://bugs.launchpad.net/ubuntu/+source/edk2/+bug/183685911:45
openstackLaunchpad bug 1836859 in edk2 (Ubuntu) "RFE: Ship the firmware "descriptor files" as part of the 'ovmf' package" [Undecided,New]11:45
kashyap  - Debian: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=93226911:45
openstackDebian bug 932269 in ovmf "Ship the firmware "descriptor files" as part of the 'ovmf' package" [Normal,Open]11:45
*** ociuhandu has joined #openstack-nova12:04
*** _erlon_ has joined #openstack-nova12:13
*** ociuhandu has quit IRC12:14
*** ratailor__ has quit IRC12:26
*** hongda has joined #openstack-nova12:29
*** udesale has joined #openstack-nova12:33
*** panda|lunch is now known as panda12:37
coreycbkashyap: thank you very much for doing that. i'll let cpaelzer know.12:41
kashyapcoreycb: Cool; can you Cc me when an Ubuntu build?12:42
coreycbkashyap: i'd recommend syncing with cpaelzer in #ubuntu-server12:42
*** shilpasd has quit IRC12:42
coreycbkashyap: the bug will get updated though12:42
kashyapcoreycb: Okay, I'll follow the bug.  I don't want to spend 100% of the time doing all distro work :-)12:43
kashyapThanks!12:43
coreycbkashyap: completely understandable :)12:43
kashyapThere's a cap on the no. yaks I could trim in a week :D12:43
*** belmoreira has quit IRC12:52
*** tbachman has joined #openstack-nova12:53
*** ttsiouts has quit IRC12:54
*** ttsiouts has joined #openstack-nova12:55
*** tbachman has quit IRC12:57
*** tbachman_ has joined #openstack-nova12:57
*** ttsiouts has quit IRC12:59
*** hamzy has quit IRC13:05
*** hemna has joined #openstack-nova13:14
Bidwe_jayHi all13:14
*** ttsiouts has joined #openstack-nova13:15
*** jamesdenton has quit IRC13:16
Bidwe_jaywant to discuss regarding how to create placementclient in horizon if anyone have any idea please help..13:16
*** jamesdenton has joined #openstack-nova13:17
*** artom has quit IRC13:19
*** liuyulong has joined #openstack-nova13:24
*** tbachman_ has quit IRC13:25
ralonsohstephenfin, show should I do this? https://review.opendev.org/#/c/641670/4/specs/train/approved/vm-boot-with-unaddressed-port.rst@19813:26
*** liuyulong has quit IRC13:26
ralonsohstephenfin, is there a way to write those references correctly? I say that because I want those references to be there13:26
ralonsohstephenfin, thanks in advance!13:26
stephenfinralonsoh: If you did care, I think you need to use the footnote style of reference https://thomas-cokelaer.info/tutorials/sphinx/rest_syntax.html#footnote13:28
stephenfinPersonally though, I'd just say 'None' or remove the 'Reference' section if you don't need it13:29
*** belmoreira has joined #openstack-nova13:31
stephenfindansmith: Care to look at this https://review.opendev.org/#/c/665626/ ?13:32
ralonsohstephenfin, I don't understand. This is the way used in all specs in Stein13:33
sean-k-mooneyralonsoh: by the way was https://review.opendev.org/#/c/640258/ what you were asking me to do13:34
*** rajinir has joined #openstack-nova13:34
ralonsohsean-k-mooney, get_vifs_by_ids is used in https://github.com/openstack/neutron/blob/3b2521a89496a9857ed3873e5a0172a41b2f8a9f/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_dvr_neutron_agent.py#L40113:35
sean-k-mooneyyes13:35
sean-k-mooneyi filtered the ids it passed in13:35
ralonsohsean-k-mooney, and you are modifying the behaviour in your patch13:35
ralonsohallowing ofport=-113:35
sean-k-mooneyhttps://review.opendev.org/#/c/640258/9/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_dvr_neutron_agent.py13:35
stephenfinralonsoh: If that's the case, feel free to ignore me :) This is what I mean though, fwiw https://bit.ly/2Y5AjUR13:35
sean-k-mooneyi also forgot a space after the comma which is why pep8 is unhappy13:35
*** belmoreira has quit IRC13:36
ralonsohok, that's PS9, I reviewed PS813:36
sean-k-mooneyyep i was asking is that all you wanted me to fix13:36
*** hamzy has joined #openstack-nova13:36
sean-k-mooneyill fix the pep8 issue shortly13:36
ralonsohsean-k-mooney, yes, exactly13:36
stephenfin(vs. https://bit.ly/2XN4D7f)13:36
ralonsohand please, use the constants for invalid ports13:37
*** psachin has quit IRC13:37
ralonsohstephenfin, ahhhhhhh13:37
ralonsohstephenfin, now I understand!!13:37
sean-k-mooneyi prefer the second for what its worth13:37
ralonsohstephenfin, thanks!!13:37
stephenfinno problemo13:37
sean-k-mooneyi think it looks better in pdf too13:37
sean-k-mooneynot that i expect nova specs to rendered to pdf like some of the other docs but its nice to be consitent13:38
ralonsohsean-k-mooney, you mean https://bit.ly/2XN4D7f ??13:38
sean-k-mooneyya i think that is nicer to read and eisier to serach for if you are reading the rst file directly13:39
ralonsohokidoki13:39
openstackgerritBalazs Gibizer proposed openstack/nova master: func test for migrate server with ports having resource request  https://review.opendev.org/65511313:39
sean-k-mooneyi almost exclisively read teh docs and sepc in gerrit/locally without rendering so i have a bias to that form.13:40
*** tbachman has joined #openstack-nova13:42
openstackgerritStephen Finucane proposed openstack/nova master: doc: Note use of 'nova-manage db sync --config-file'  https://review.opendev.org/67129813:42
stephenfinsean-k-mooney: You'll probably like that ^13:43
*** udesale has quit IRC13:43
stephenfinAlso13:43
* stephenfin has been looking at rst2pdf to try avoid needing to use LaTeX for the "build PDFs for all community docs"13:43
*** udesale has joined #openstack-nova13:43
stephenfinI forget just how good we've got it in OpenStack whenever I look at community projects13:44
stephenfin"Why are half your tests skipped?" "Oh, they just stopped working so we disabled them"13:44
stephenfin:)13:44
cdentsweet13:45
sean-k-mooneystephenfin: +1'd what had you running that manually anwyway? just trying to avoid restacking?13:47
stephenfinI'm still working on the cpu-resources spec. I'd stacked with master and then wanted to work through an upgrade13:48
stephenfinI foresee a lot of restacks in the coming week or so13:48
stephenfinBut! http://paste.openstack.org/show/754499/13:49
Nick_AHello - we have instance images and snapshots set to qcow2 in nova.conf. Is there a way to bypass what appears to be an unnecessary conversion step before it uploads the snapshot to glance? Am I right in understanding that it's trying to convert qcow2 > qcow2?13:50
*** artom has joined #openstack-nova13:57
*** Luzi has quit IRC14:05
*** altlogbot_1 has quit IRC14:09
openstackgerritArtom Lifshitz proposed openstack/nova stable/rocky: [DNM] testing bug/1813789 revert resize events  https://review.opendev.org/67130314:09
*** belmoreira has joined #openstack-nova14:10
openstackgerritRodolfo Alonso Hernandez proposed openstack/nova-specs master: Boot a VM with an unaddressed port  https://review.opendev.org/64167014:12
*** irclogbot_3 has quit IRC14:17
*** ricolin_ has joined #openstack-nova14:17
*** altlogbot_0 has joined #openstack-nova14:18
*** ricolin has quit IRC14:19
*** TxGirlGeek has joined #openstack-nova14:20
*** belmoreira has quit IRC14:21
*** altlogbot_0 has quit IRC14:22
*** belmoreira has joined #openstack-nova14:23
*** udesale has quit IRC14:25
*** altlogbot_0 has joined #openstack-nova14:27
*** mlavalle has joined #openstack-nova14:29
*** altlogbot_0 has quit IRC14:32
*** altlogbot_0 has joined #openstack-nova14:34
*** altlogbot_0 has quit IRC14:38
*** altlogbot_0 has joined #openstack-nova14:40
*** artom has quit IRC14:42
*** altlogbot_0 has quit IRC14:44
Zarahullo! I'm back with my '`nova list` slow when run with member user but not admin user' question-- narrowed it down a bit; the slow requests are the ones via the neutronclient to ports.json (as part of nova's servers/detail request). 10s apiece for member; 200ms apiece for admin. maybe a neutron or keystone issue?14:45
*** altlogbot_2 has joined #openstack-nova14:46
sean-k-mooneyZara: did you check if the delay was in the neuron api or in nova14:46
*** factor has quit IRC14:47
*** altlogbot_2 has quit IRC14:50
*** luksky11 has quit IRC14:51
*** altlogbot_2 has joined #openstack-nova14:52
*** altlogbot_2 has quit IRC14:56
*** altlogbot_3 has joined #openstack-nova14:58
*** factor has joined #openstack-nova14:59
*** gyee has joined #openstack-nova14:59
Zaraahhhh, listing ports alone is also slow, so almost certainly neutron (so I'm even more in-the-wrong-channel than I thought; sorry!)14:59
sean-k-mooneyhaha no worries15:00
*** JamesBenson has joined #openstack-nova15:00
Zara:)15:01
*** altlogbot_3 has quit IRC15:02
*** igordc has joined #openstack-nova15:02
*** shilpasd has joined #openstack-nova15:04
*** altlogbot_1 has joined #openstack-nova15:04
*** artom has joined #openstack-nova15:05
*** ociuhandu has joined #openstack-nova15:06
*** altlogbot_1 has quit IRC15:08
*** belmoreira has quit IRC15:08
*** priteau has quit IRC15:11
*** ttsiouts has quit IRC15:13
*** ttsiouts has joined #openstack-nova15:14
*** shilpasd has quit IRC15:14
*** altlogbot_0 has joined #openstack-nova15:14
*** altlogbot_0 has quit IRC15:18
*** ttsiouts has quit IRC15:18
*** tssurya has quit IRC15:19
*** ociuhandu has quit IRC15:19
*** altlogbot_2 has joined #openstack-nova15:20
*** factor has quit IRC15:20
*** factor has joined #openstack-nova15:22
*** altlogbot_2 has quit IRC15:28
alex_xudansmith: I faced a problem. Seems the dst host's libvirt won't keep the dst domain xml when live-migration failed due to the dst host down. So when the dst host's nova-compute startup again, it can't know the target vpmem which may dirty by the live-migration, then can't do a cleanup for that vpmem.15:28
alex_xuefried: ^15:28
dansmithum15:29
dansmithyou mean live migration, which fails in the middle because the compute host goes down or something?15:29
efriedyes15:29
alex_xuyes, the dst compute host goes down15:29
*** Luzi has joined #openstack-nova15:30
sean-k-mooneywell that should be reverted right. so i guess the problem is some of the data could have been copied15:30
alex_xuyes15:30
sean-k-mooneyalex_xu: could we optionally clean the unsed namespaces on agent start15:31
dansmithyeah, I mean, that's a serious failure, and all kinds of things could go wrong there15:31
dansmithsean-k-mooney: yeah was just going to say.. that's probably safest15:31
alex_xuok, but it should be slow15:31
sean-k-mooneywe could proably store a file somewhere of things we are currently programing and delete the file if we completed properly15:31
alex_xuit is ok to cleanup, since the live-migration won't be continue again15:32
dansmithbecause even if you were tracking them some other way, that failure scenario, followed by a db archive before the compute node starts up again would result in not knowing about the previous failure15:32
dansmithsean-k-mooney: yeah, there may be residue just from the incoming disk images and stuff actually15:32
*** prometheanfire has left #openstack-nova15:32
dansmithalso,15:32
dansmiththere should be an uncompleted migration record in the db15:32
dansmithwhich we already look for in a couple situations to clean up15:32
sean-k-mooneythe migration record wont have the vpmem info unfortuately15:33
dansmithso maybe if there are aborted migrations against us when we start, we do a full clean for safety or something?15:33
dansmithno, I know15:33
sean-k-mooneyso we really need to write somethign to the compute node disk to keep track of it15:33
*** altlogbot_1 has joined #openstack-nova15:34
sean-k-mooneye.g. we need to store it locally incase teh instance is delete and archive before we restart teh agaent on the failed node15:34
dansmith...or just clean all unused namespaces on startup if we see an aborted live migration15:34
efried++15:34
sean-k-mooneyya that too15:34
efriedalex_xu: ^15:34
alex_xuyea, I'm ok with that15:35
dansmithwhy is it slow btw?15:35
sean-k-mooneybut alex_xu was concerned about the time. i guess if its done asyc outside of the agent then its fine15:35
efriedneed some way to mark them unavailable for spawns15:35
dansmithshouldn't this be a TRIM type operation on some silicon?15:35
efrieddon't you have to write zeroes to the whole thing, or something?15:35
dansmithefried: block compute startup until it's finished like all our other "recover from failure" type things15:35
efriedah, nice15:36
dansmithefried: shouldn't, that would be terrible15:36
alex_xuno..just write zero to each bit...15:36
dansmiththat's ridiculous15:36
dansmithisn't this effectively flash?15:36
sean-k-mooneydansmith: well we would have to do a secure erase rather then trim but ya optane is like flash but different15:37
alex_xuI guess there is no cache, since it is write by the DAX way15:37
dansmithsean-k-mooney: either, trim or dump the key.. either should be fast and avoid wearing the flash to friggin write zeroes15:37
*** altlogbot_1 has quit IRC15:38
dansmithsean-k-mooney: so does that mean every time we destroy an instance using one of these that we have to block destroy until we've written gigabytes to this device?15:38
sean-k-mooneyalex_xu: i assume we can delgate the erase to a cli too and just do it async or in parallel15:38
dansmithwhereas if we were giving them flash we could just run a single trim command and move on?15:38
alex_xuwe are using the daxio15:38
sean-k-mooneydansmith: i mean technically yes15:38
sean-k-mooneythat would be similar to the lvm image backend erase15:39
dansmithsean-k-mooney: right, which is ridiculous and based on 1980s notions of disk, so I give it a pass15:39
dansmithand also not really enjoyed by operators everywhere :)15:39
sean-k-mooneyalex_xu: to dansmith's point if we are using daxio can we just tell the device to nuke everythin in the namespace15:40
alex_xuno, I don't think we have that kind of TRIM15:40
efriedthis seems like a separate issue though. Whatever "clear" we have to do, we have to do the same thing on destroy()15:40
sean-k-mooneyya15:40
sean-k-mooneythat is fair15:40
*** altlogbot_1 has joined #openstack-nova15:41
dansmithefried: sure, it's more just that if we're going to massively slow down destroy, it'd be good to know that15:41
dansmithso we can mock this "feature" if nothing else15:41
sean-k-mooneythe question that raises is can we have the agent wait to start up or not15:41
dansmithjay would be rolling over in his grave15:41
efriedIIRC that was in the spec15:41
sean-k-mooneycould we play with the reserved value in placment15:41
dansmithsean-k-mooney: we can and should, like anything else we do on this15:41
dansmithI'm less concerned about the delayed compute startup than I am with destroy15:41
*** belmoreira has joined #openstack-nova15:41
sean-k-mooneye.g. make the dirty namespces reserved until we clean it15:42
dansmithif you're billing by the hour, and a bunch of people destroy instances all at once and they all have to wait in line to have zeroes written to this new whizbang memory thing...15:42
*** belmoreira has quit IRC15:42
efriedsean-k-mooney: if we change inventory on destroy() we're going to run into cdent's generation conflict race all over the place.15:42
dansmithsean-k-mooney: that's a lot more complex and more opportunity to be interrupted in the middle and needing to be properly resumed15:42
sean-k-mooneyfor what its worth it can do that at several GB/S15:42
sean-k-mooneyok then lets just keep it simple15:43
cdent(my patch to not do that, controlled by config, got merged internally)15:43
sean-k-mooneyand block untill they are all cleaned if their was a faild migration as ye suggested15:43
dansmithsean-k-mooney: ++15:44
*** altlogbot_1 has quit IRC15:44
sean-k-mooneyapparently the frist gen stuff will hit 8.9 GB/s in sequtial writes15:45
sean-k-mooneyalthough the cleaning operation would likely impact the performce of other isntances if you tried to max it out15:45
dansmithwhich is why it's stupid to have to do this15:45
dansmithI mean honestly, wtf15:46
dansmithcheap sata SSDs have not required writing zeros to erase for ten years15:46
*** altlogbot_0 has joined #openstack-nova15:46
sean-k-mooneyits because its been mapped as memory rather then via a filesystem15:46
dansmithwhich is also stupid15:47
dansmithhowever,15:47
sean-k-mooneyif you did use it via the filesystem interface which is ssupported it proably would handel this interally15:47
dansmithyou have a cli tool to manage it, so there should be some thing to do it.. doesn't have to be _actual_ ATA TRIM15:47
dansmith...but intel *has* to have this seem memory like for optics, so.. :/15:48
sean-k-mooneywell it littaly replaces ram dims15:48
dansmithso?15:48
sean-k-mooneyand is byte adressable15:48
sean-k-mooneyso its pretty ram like15:48
dansmithit's a block device to the guest yeah?15:48
sean-k-mooneyno15:48
alex_xuit is ram for the guest15:49
sean-k-mooneyits exposed as dims to the guest15:49
dansmithbut people are going to use it as semi-persistent storage right?15:49
sean-k-mooneyno15:49
sean-k-mooneywell indirectly15:49
sean-k-mooneythey will be mmaping it into there application adress space15:49
dansmithright15:49
*** altlogbot_0 has quit IRC15:50
sean-k-mooneyand using it as an "in memeory" cache / scratch space for there workign set15:50
dansmithwhich works fine for block-addressable storage, to look like byte-addressable memory, even for rotating rust :)15:50
*** helenafm has quit IRC15:51
dansmithanyway, whatever, I know this ship has sailed15:51
sean-k-mooneysure :) you know we live in a world of hardward defiend software right :P15:51
dansmithall too well15:51
*** altlogbot_1 has joined #openstack-nova15:52
*** artom has quit IRC15:52
alex_xudansmith: efried sean-k-mooney anyway...thank you guys15:55
openstackgerritDakshina Ilangovan proposed openstack/nova-specs master: Spec: Provider config YAML file  https://review.opendev.org/61249715:55
zzzeekis mriedem on vacation15:56
dansmithzzzeek: yes15:56
zzzeekdansmith: hokay15:56
*** altlogbot_1 has quit IRC15:57
*** artom has joined #openstack-nova15:59
*** damien_r has quit IRC15:59
edleafeb16:01
edleafe*ETOOMANYTERMINALSOPEN16:02
*** altlogbot_2 has joined #openstack-nova16:04
*** rpittau is now known as rpittau|afk16:04
*** altlogbot_2 has quit IRC16:08
*** altlogbot_1 has joined #openstack-nova16:10
*** altlogbot_1 has quit IRC16:14
*** irclogbot_1 has joined #openstack-nova16:14
*** altlogbot_0 has joined #openstack-nova16:15
*** irclogbot_1 has quit IRC16:17
efriedgibi: dansmith: cdent: I gotta roll, but would you please have a look at the providers.yaml spec soonish? https://review.opendev.org/#/c/612497/16:19
efriedIMO it's pretty much ready to go - but I may be too close to it to see the gaps.16:19
cdentaye aye, will poke at it tomorrow mornig16:19
*** ricolin_ is now known as ricolin16:20
*** icarusfactor has joined #openstack-nova16:21
*** efried is now known as efried_rollin16:21
*** factor has quit IRC16:21
*** icarusfactor has quit IRC16:21
*** betherly has quit IRC16:26
*** altlogbot_0 has quit IRC16:34
*** altlogbot_1 has joined #openstack-nova16:36
*** artom has quit IRC16:42
*** artom has joined #openstack-nova17:00
*** derekh has quit IRC17:00
stephenfinsean-k-mooney: What do we do if none of 'vcpu_pin_set', '[compute] cpu_shared_set' or '[compute] cpu_dedicated_set' are configured?17:02
*** Luzi has quit IRC17:03
stephenfinI'm thinking we need to return both VCPUs and PCPUs for all host cores, like we would do if 'vcpu_pin_set' is configured17:03
stephenfinBut if we do that, we'll introduce a possibly breaking change when we stop doing that in U17:03
sean-k-mooneyif none are set then ya17:04
sean-k-mooneyi would report all host cpus as both17:04
sean-k-mooneyideally we would require that one of cpu_shared_set or cpu_dedicated_set are set going forward17:05
*** hongda has quit IRC17:05
sean-k-mooneyand issue a warning if neither are set17:05
stephenfinCool. Going to push drafts of this in a few minutes. It will fail every gate test there is but it should be good enough to see where I'm going with it17:07
sean-k-mooneye.g in train we report both and issue warning. in U if you dont set one of the cpu_shared_set or cpu_dedicated_set we raise an error and refuse to start17:07
*** davidsha has quit IRC17:07
openstackgerritMerged openstack/nova master: Restore RT.old_resources if ComputeNode.save() fails  https://review.opendev.org/66826317:11
*** ociuhandu has joined #openstack-nova17:17
*** ociuhandu has quit IRC17:22
*** maciejjozefczyk has quit IRC17:22
*** Zara has left #openstack-nova17:23
openstackgerritsean mooney proposed openstack/nova master: Libvirt: add support for vPMU configuration.  https://review.opendev.org/67133817:28
sean-k-mooneyi think ^ is the full implemtation of the vPMU spec17:29
sean-k-mooneyits pretty short so should be a quick win if people want to review.17:29
openstackgerritDakshina Ilangovan proposed openstack/nova-specs master: Spec: Provider config YAML file  https://review.opendev.org/61249717:29
sean-k-mooneyits 75% unit tests,docs and release notes and like 40 lines of code that does something userful17:30
sean-k-mooney... actully its proably goign to fail the notification api tests...17:32
sean-k-mooneyi was actully trying to have it ready to mrege in the first patch but oh well17:33
*** ociuhandu has joined #openstack-nova17:53
*** cdent has quit IRC17:58
*** ociuhandu has quit IRC18:01
*** ociuhandu_ has joined #openstack-nova18:01
*** IvensZambrano has joined #openstack-nova18:02
*** ociuhandu_ has quit IRC18:18
*** ralonsoh has quit IRC19:04
artomdansmith, around? Let's say with save a Nova object in one nova component, for example calling in nova-compute instance.save() after setting instance.migration_context19:07
artomAnd then later, a different instance object, without migration_context lazy-loaded, also gets save()'ed, in the conductor19:07
artomWill the second save clobber the first's migration_context?19:07
dansmithmeaning will the not-context-having instance.save() cause the migration context to go away?19:08
artomYeah19:08
dansmithit shouldn't.. that would be a bug.. this is why objects track dirty fields.. so we know what to update in the database and what to leave as-is19:09
artom(I tried to understand save()'s code, it's not super scrutable)19:10
artomdansmith, ack, much thanks19:10
* artom goes back to putting LOG.debug's all over the place19:10
dansmithinstance is complicated, thus is has a complicated save handler19:11
dansmiththe actual save is not innate behavior for objects, it has to be implemented each time, so always an opportunity for a bug19:11
artomThere's no default "save each field into its column" implementation?19:12
artom"each field" being overly simplistic19:12
dansmithno19:12
dansmiththe number of objects that are just a simple "this field goes unchanged in this column" was never 100%, and has shrunk ever since19:13
dansmithat a low-level, any object that is like that would just have a save handler of db_obj.update(self.obj_get_changes()), but even the ones that are 1:1 mappings aren't that simple,19:13
dansmithbecause they check a few things, look up the db object maybe not in the same way first, etc19:13
*** ociuhandu has joined #openstack-nova19:15
*** igordc has quit IRC19:18
*** ociuhandu has quit IRC19:21
artomDammit journalctl19:24
artomI dunno what kind of "optimization" it does, but if I journalctl -e a thing, and then reverse search for a word, I want to see it19:24
artomDoesn't matter if you haven't actually loaded it in memory or whatever you're doing19:24
artomBecause without the -e doing a forward search, it shows up just fine19:25
artomOr even scrolling to the end manually in less, then doing a reverse search19:26
artomdansmith, and actually, I'm an idiot, because the first thing apply_migration_context() does is check self.migration_context, so it'll lazy-load it regardless19:42
artom(That's the bug I'm chasing, migration context not being correctly applied)19:42
artomAh no, it could still get clobbered after19:42
artomBleah, moar coffee19:42
dansmithartom: those two things may both be true, but are unrelated I believe19:44
artomdansmith, yeah, just came to that realization19:44
dansmithartom: I meant you being an idiot and "the first thing apply_migration_context" does :)19:44
artomAh, in that case, I came to the first half of that realization a long time ago :P19:45
*** luksky11 has joined #openstack-nova19:45
dansmithhah19:46
artomWaaay ahead of you there buddy :)19:47
*** gyee has quit IRC19:49
*** gyee has joined #openstack-nova19:50
* artom thinks he's seeing the light19:56
artomThe whole migration context is a red herring19:56
artomIt's applied correctly19:56
artomWhat's being clobbered is the numa_topology19:56
artomBecause while the apply_migration_context() saves the new one to the instance from the mig_cxtx, there's a save() later when the source cleans up19:56
artomAnd that instance object still has the original numa_topology19:57
openstackgerritMerged openstack/nova master: vif: Remove dead minimum libvirt checks  https://review.opendev.org/66681420:00
artomBOOM20:08
*** bnemec has quit IRC20:11
openstackgerritArtom Lifshitz proposed openstack/nova master: [WIP-until-series-is-ready] Introduce live_migration_claim()  https://review.opendev.org/63566920:13
openstackgerritArtom Lifshitz proposed openstack/nova master: New objects for NUMA live migration  https://review.opendev.org/63482720:13
openstackgerritArtom Lifshitz proposed openstack/nova master: LM: add support for sending NUMAMigrateData to the source  https://review.opendev.org/63482820:13
openstackgerritArtom Lifshitz proposed openstack/nova master: LM: add support for updating NUMA-related XML on the source  https://review.opendev.org/63522920:13
openstackgerritArtom Lifshitz proposed openstack/nova master: RPC changes to prepare for NUMA live migration  https://review.opendev.org/63460520:13
openstackgerritArtom Lifshitz proposed openstack/nova master: NUMA live migration support  https://review.opendev.org/63460620:13
openstackgerritArtom Lifshitz proposed openstack/nova master: Deprecate CONF.workarounds.enable_numa_live_migration  https://review.opendev.org/64002120:13
artomAnd with that perfect timing, it's daycare time20:13
*** bnemec has joined #openstack-nova20:15
*** igordc has joined #openstack-nova20:15
*** beekneemech has joined #openstack-nova20:16
*** bnemec has quit IRC20:16
efried_rollinstephenfin, sean-k-mooney: what do you mean, report them as both VCPU and PCPU? Won't that lead to double the real inventory?20:16
*** beekneemech has quit IRC20:16
*** bnemec has joined #openstack-nova20:16
efried_rollinartom: don't forget pysnooper20:17
*** efried_rollin is now known as efried20:18
*** artom has quit IRC20:18
*** beekneemech has joined #openstack-nova20:18
*** xek has quit IRC20:21
*** ociuhandu has joined #openstack-nova20:24
*** ociuhandu has quit IRC20:33
*** pcaruana has quit IRC20:48
*** bnemec has quit IRC20:48
*** bnemec has joined #openstack-nova20:51
*** beekneemech has quit IRC20:54
*** tjgresha_nope has quit IRC20:55
*** tjgresha has joined #openstack-nova20:56
*** _erlon_ has quit IRC21:02
efrieddansmith: deployers can implement their own filters, right?21:20
dansmithefried: scheduler filters?21:20
efriedyeah21:20
*** BjoernT has joined #openstack-nova21:21
efrieddansmith: that live on the compute and get the option to say "this host is no good for this instance"21:21
dansmithefried: live on the compute?21:22
efrieddo they not live on the compute? They live on the scheduler?21:22
dansmithbut yeah, scheduler filters are the only real plug point we offer21:22
dansmithefried: scheduler filters? yeah they live on the ... scheduler :)21:22
efrieddansmith: So the NUMATopologyFilter lives on the scheduler despite needing to know very specific things about the NUMA topology of the host it's filtering for?21:23
*** BjoernT has quit IRC21:23
*** irclogbot_1 has joined #openstack-nova21:23
efried(recognizing that one is an us-provided filter, that does things beyond just binarily saying yea or nay to a host)21:23
dansmithefried: yeah, that's kinda the whole point21:24
efriedokay; I mean I'm just curious how the NUMATopologyFilter gets to know those things about the hosts21:25
dansmithI'm not even sure how you're thinking things would/could be working with them on the compute21:25
*** jdillaman has quit IRC21:25
dansmithbut the compute and virt driver expose a generalized model so the scheduler can operate on an abstraction, because not all clouds have all the same hypervisors, versions of hypervisors, etc21:25
efriedI guess the compute service comes up and detects the topology and reports it back to the scheduler or puts it in the database or something.21:25
dansmithefried: they expose a generalized model21:25
*** mdbooth has quit IRC21:29
*** mdbooth has joined #openstack-nova21:29
*** JamesBenson has quit IRC21:33
efrieddansmith: thanks. I posted answers to your comments on the providers.yaml spec. LMK if you want to discuss (since Dakshina doesn't really seem to do IRC ):21:34
dansmithack, it'll be tomorrow21:34
efriedthanks21:34
*** ociuhandu has joined #openstack-nova21:35
*** JamesBenson has joined #openstack-nova21:36
*** whoami-rajat has quit IRC21:36
*** betherly has joined #openstack-nova21:36
*** JamesBenson has quit IRC21:40
*** betherly has quit IRC21:41
*** ociuhandu has quit IRC21:45
*** panda has quit IRC21:46
*** panda has joined #openstack-nova21:48
*** ociuhandu has joined #openstack-nova22:00
*** ociuhandu has quit IRC22:06
*** betherly has joined #openstack-nova22:14
*** betherly has quit IRC22:18
*** slaweq has quit IRC22:23
*** luksky11 has quit IRC22:24
*** logan- has quit IRC22:38
*** logan- has joined #openstack-nova22:39
*** tesseract has quit IRC22:40
*** TxGirlGeek has quit IRC23:01
*** ociuhandu has joined #openstack-nova23:02
*** ricolin_ has joined #openstack-nova23:03
*** ricolin has quit IRC23:06
*** ociuhandu has quit IRC23:06
*** rcernin has joined #openstack-nova23:11
*** tkajinam has joined #openstack-nova23:15
*** rcernin has quit IRC23:16
*** rcernin has joined #openstack-nova23:17
*** JamesBenson has joined #openstack-nova23:19
*** betherly has joined #openstack-nova23:21
*** JamesBenson has quit IRC23:23
*** betherly has quit IRC23:26
openstackgerritMerged openstack/python-novaclient master: Add Python 3 Train unit tests  https://review.opendev.org/66943923:30
*** _hemna has joined #openstack-nova23:39
*** brinzhang_ has quit IRC23:49
*** artom has joined #openstack-nova23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!