Tuesday, 2019-06-11

*** markvoelker has joined #openstack-nova00:16
*** nicolasbock has quit IRC00:16
Nick_AIs there a way to take online snapshots of LXC instances?00:22
*** brinzhang has joined #openstack-nova00:27
*** brinzh has joined #openstack-nova00:37
*** tbachman has quit IRC00:40
*** rcernin_ has quit IRC00:41
*** rcernin has joined #openstack-nova00:41
*** tbachman has joined #openstack-nova00:41
openstackgerritMerged openstack/nova master: Fix python3 compatibility of rbd get_fsid  https://review.opendev.org/66360700:42
*** lbragstad has quit IRC00:48
*** markvoelker has quit IRC00:49
*** igordc has quit IRC00:56
*** icarusfactor has joined #openstack-nova01:00
*** tbachman_ has joined #openstack-nova01:00
openstackgerritMerged openstack/nova-specs master: Clarify the error response in proposed change  https://review.opendev.org/66419801:01
*** factor has quit IRC01:02
*** tbachman has quit IRC01:02
*** tbachman_ is now known as tbachman01:02
*** ricolin has joined #openstack-nova01:10
*** threestrands_ has joined #openstack-nova01:11
*** threestrands has quit IRC01:14
*** icarusfactor has quit IRC01:19
*** factor__ has joined #openstack-nova01:19
*** threestrands_ has quit IRC01:21
*** factor__ has quit IRC01:24
*** factor__ has joined #openstack-nova01:25
*** bhagyashris has joined #openstack-nova01:33
*** gyee has quit IRC01:34
*** markvoelker has joined #openstack-nova01:46
*** factor__ has quit IRC01:49
*** factor__ has joined #openstack-nova01:50
*** guozijn has joined #openstack-nova01:54
*** whoami-rajat has joined #openstack-nova02:09
openstackgerritKeerthi Reddy proposed openstack/nova master: [do not review] [Learning] Add a new link  https://review.opendev.org/66448302:09
*** sapd1_x has joined #openstack-nova02:14
*** factor__ has quit IRC02:17
*** itlinux has joined #openstack-nova02:17
*** factor__ has joined #openstack-nova02:18
*** factor__ has quit IRC02:18
*** markvoelker has quit IRC02:20
*** hongbin has joined #openstack-nova02:25
*** guozijn has quit IRC02:30
*** cfriesen has quit IRC02:54
*** cfriesen has joined #openstack-nova03:02
*** bhagyashris has quit IRC03:03
*** bnemec has quit IRC03:07
*** bnemec has joined #openstack-nova03:08
openstackgerritBrin Zhang proposed openstack/nova master: Specify availability_zone to unshelve  https://review.opendev.org/66385103:14
*** markvoelker has joined #openstack-nova03:17
*** psachin has joined #openstack-nova03:39
*** markvoelker has quit IRC03:50
*** brinzhang has quit IRC03:53
*** brinzhang has joined #openstack-nova03:54
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix default values in update_cell command  https://review.opendev.org/66238303:55
*** hongbin has quit IRC04:01
*** udesale has joined #openstack-nova04:05
*** janki has joined #openstack-nova04:10
*** dave-mccowan has quit IRC04:23
*** shilpasd has joined #openstack-nova04:38
*** sorrison has joined #openstack-nova04:46
*** markvoelker has joined #openstack-nova04:47
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix default values in update_cell command  https://review.opendev.org/66238305:04
*** luksky has joined #openstack-nova05:09
*** markvoelker has quit IRC05:21
*** luksky has quit IRC05:25
*** lpetrut has joined #openstack-nova05:28
*** udesale has quit IRC05:35
*** udesale has joined #openstack-nova05:36
*** brinzh has quit IRC05:42
*** brinzh has joined #openstack-nova05:42
*** lpetrut has quit IRC05:43
*** threestrands has joined #openstack-nova05:52
*** Luzi has joined #openstack-nova05:53
*** threestrands has quit IRC05:53
*** ratailor has joined #openstack-nova06:04
*** hamdyk has joined #openstack-nova06:15
*** markvoelker has joined #openstack-nova06:18
*** cfriesen has quit IRC06:23
*** udesale has quit IRC06:32
*** udesale has joined #openstack-nova06:32
*** ccamacho has joined #openstack-nova06:36
*** lpetrut has joined #openstack-nova06:46
*** markvoelker has quit IRC06:51
*** pcaruana has joined #openstack-nova06:55
*** damien_r has joined #openstack-nova06:55
*** slaweq has joined #openstack-nova06:56
*** nicolasbock has joined #openstack-nova06:57
*** rpittau|afk is now known as rpittau07:08
*** rcernin has quit IRC07:08
*** tesseract has joined #openstack-nova07:08
*** maciejjozefczyk has joined #openstack-nova07:14
*** slaweq has quit IRC07:20
*** tssurya has joined #openstack-nova07:29
*** maciejjozefczyk has quit IRC07:30
openstackgerritEdward Hope-Morley proposed openstack/nova stable/stein: Fix python3 compatibility of rbd get_fsid  https://review.opendev.org/66451207:39
openstackgerritEdward Hope-Morley proposed openstack/nova stable/rocky: Fix python3 compatibility of rbd get_fsid  https://review.opendev.org/66451307:40
*** markvoelker has joined #openstack-nova07:48
*** helenafm has joined #openstack-nova07:53
*** udesale has quit IRC07:53
*** udesale has joined #openstack-nova07:53
*** takashin has left #openstack-nova08:00
*** ttsiouts has joined #openstack-nova08:01
*** dtantsur|afk is now known as dtantsur08:02
*** nicolasbock has quit IRC08:04
*** tkajinam has quit IRC08:05
*** ociuhandu has joined #openstack-nova08:07
*** ralonsoh has joined #openstack-nova08:09
*** liuyulong has joined #openstack-nova08:16
*** ttsiouts has quit IRC08:19
*** ttsiouts has joined #openstack-nova08:20
*** mdbooth has quit IRC08:21
*** markvoelker has quit IRC08:22
*** mdbooth has joined #openstack-nova08:24
*** ttsiouts has quit IRC08:24
*** bhagyashris has joined #openstack-nova08:27
*** davidsha has joined #openstack-nova08:29
lyarwoodstephenfin / bauzas ; would you mind taking a look at https://review.opendev.org/#/c/663011/ & https://review.opendev.org/#/c/664036/ this morning please?08:31
stephenfinsure08:32
*** ttsiouts has joined #openstack-nova08:33
*** imacdonn has quit IRC08:38
*** imacdonn has joined #openstack-nova08:38
*** derekh has joined #openstack-nova08:40
*** cdent has joined #openstack-nova08:42
kashyapNit-pick: please don't use "fup" as a summary, it's this IRC channel specifc lingo, and most people might not be aware of it.08:43
kashyaps/"as a summary"/"in the summary of Git commits"/08:44
aspierskashyap: it could also be misinterpreted as "f*** up" ;-)08:44
lyarwoodsigh08:44
kashyapaspiers: That too. :D08:44
aspiersmy brain still does that every time I see it08:45
kashyapaspiers: Really, I was confused when I heard it first time here.08:45
kashyapI don't like it it at all.08:45
kashyaps/it it/it/08:45
lyarwoodfup is a prefectly useful summary tag for a commit IMHO08:45
kashyaplyarwood: Really, who knows it?08:45
aspierslyarwood: fixup is only 2 bytes more, and far clearer08:45
stephenfinHave to agree here08:46
lyarwoodmeh08:46
kashyapI bet if you ask any non-native speaker to guess that is, 10/10 won't be able to guess it.08:46
* stephenfin ducks back out08:46
kashyapClarity is power.08:46
lyarwoodbike sheds need painting08:46
aspiersit needs painting RED08:46
lyarwoodI'll continue to use it08:46
stephenfinlyarwood: Question on https://review.opendev.org/#/c/664036/08:46
kashyapNot really; it's a death by thousand cuts08:46
lyarwoodack looking08:46
stephenfinother one is +W08:46
lyarwoodstephenfin: gah, why is it always so obvious when someone comments on my change08:48
lyarwoodstephenfin: I'll respin for the elif now08:48
stephenfinIt's the same for everyone else, I assure you :)08:48
stephenfinThoughts on the logging? Do we want to do a full run through first to catch potential issues, or just highlight them as we encounter them?08:49
lyarwoodstephenfin: just left a note, I don't think we care enough to loop through everything everytime to find invalid values.08:51
stephenfinCool08:51
lyarwoodstephenfin: worst case is that we can't find a mapping for our arch and find the invalid mappings that way08:51
aspiersstephenfin: sorry, just remembered you asked me to look at a potential bug I might have caused with the machtype mapping stuff08:53
stephenfinaspiers: I think lyarwood's patch has fixed it so we should be good08:53
aspiersstephenfin: ah cool08:53
aspiersstephenfin: feel free to add me to review08:54
stephenfinaspiers: It was this comment https://review.opendev.org/#/c/663011/9/nova/virt/libvirt/utils.py@56308:54
stephenfinlyarwood has moved it to 'get_default_machine_type' so the potential mixup should be resolved08:55
lyarwoodon stephenfin's suggestion FWIW, thanks for that.08:56
*** priteau has joined #openstack-nova08:57
*** udesale has quit IRC08:59
kashyaplyarwood: When we can't find a valid mapping, _do_ we print everything out?08:59
* kashyap goes to read the code08:59
aspierslyarwood: there's still the {} default mapping bug stephenfin pointed out in https://review.opendev.org/#/c/663011/9/nova/virt/libvirt/utils.py@57108:59
*** cdent has quit IRC09:00
lyarwoodkashyap: no, just the invalid mappings09:01
kashyap(Nod)09:02
openstackgerritLee Yarwood proposed openstack/nova master: fup: Merge machine_type_mappings into get_default_machine_type  https://review.opendev.org/66403609:02
*** rcernin has joined #openstack-nova09:03
kashyapSigh; the crappy "fup" again09:04
lyarwoodAs I said above, I'm going to continue using it.09:05
*** ttsiouts has quit IRC09:06
kashyapSure, at the cost of the death by shitty commit messages09:06
*** ttsiouts has joined #openstack-nova09:06
*** udesale has joined #openstack-nova09:07
*** ttsiouts has quit IRC09:11
*** liuyulong has quit IRC09:11
*** ratailor_ has joined #openstack-nova09:16
*** ttsiouts has joined #openstack-nova09:18
*** ratailor has quit IRC09:19
*** markvoelker has joined #openstack-nova09:19
*** tobberydberg has quit IRC09:22
*** kaliya has joined #openstack-nova09:23
*** nicolasbock has joined #openstack-nova09:26
*** ratailor__ has joined #openstack-nova09:29
*** tobberydberg has joined #openstack-nova09:31
*** bhagyashris has quit IRC09:32
*** ratailor_ has quit IRC09:32
openstackgerritStephen Finucane proposed openstack/nova master: Recalculate 'RequestSpec.numa_topology' on resize  https://review.opendev.org/66252209:33
openstackgerritStephen Finucane proposed openstack/nova master: tests: Cleanup of '_test_resize' helper test  https://review.opendev.org/66424509:33
openstackgerritStephen Finucane proposed openstack/nova master: tests: Add '_setup_compute_services' helper  https://review.opendev.org/66310209:33
*** cdent has joined #openstack-nova09:36
stephenfinlyarwood: Can you put this through? https://review.opendev.org/#/c/657844/09:41
stephenfin(as a stable patch)09:41
*** maciejjozefczyk has joined #openstack-nova09:47
*** panda has quit IRC09:47
*** slaweq has joined #openstack-nova09:47
lyarwoodstephenfin: ack, I'll look now09:48
lyarwoodstephenfin: ah no sorry, I'm not actually stable-maint09:48
lyarwoodstephenfin: only nova-stable-core09:49
stephenfinAh, I thought you were. Np09:49
*** panda has joined #openstack-nova09:49
*** markvoelker has quit IRC09:52
*** hamdykhader has joined #openstack-nova10:05
*** hamdyk has quit IRC10:06
*** hamdyk has joined #openstack-nova10:16
*** hamdykhader has quit IRC10:17
*** pcaruana has quit IRC10:19
*** brinzhang has quit IRC10:22
*** brinzhang has joined #openstack-nova10:23
*** ttsiouts has quit IRC10:28
*** ttsiouts has joined #openstack-nova10:29
*** slaweq has quit IRC10:31
*** maciejjozefczyk has quit IRC10:32
*** ttsiouts has quit IRC10:33
*** bbowen has quit IRC10:38
*** slaweq has joined #openstack-nova10:40
*** markvoelker has joined #openstack-nova10:49
*** jchhatbar has joined #openstack-nova10:55
*** janki has quit IRC10:56
*** slaweq has quit IRC10:59
*** jchhatbar has quit IRC10:59
*** janki has joined #openstack-nova10:59
*** janki has quit IRC11:00
*** janki has joined #openstack-nova11:01
*** pcaruana has joined #openstack-nova11:09
*** udesale has quit IRC11:20
*** markvoelker has quit IRC11:21
*** dave-mccowan has joined #openstack-nova11:23
*** ttsiouts has joined #openstack-nova11:40
*** rcernin has quit IRC11:43
openstackgerritHarald Jensås proposed openstack/nova master: cell_mapping - wrap IPv6 address in format_url  https://review.opendev.org/66455911:46
*** hjensas has joined #openstack-nova11:46
openstackgerritBrin Zhang proposed openstack/nova master: Specify availability_zone to unshelve  https://review.opendev.org/66385111:46
*** bbowen has joined #openstack-nova11:50
*** janki has quit IRC11:51
*** janki has joined #openstack-nova11:51
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Use SATA bus for cdrom devices when using Q35 machine type  https://review.opendev.org/66301111:55
openstackgerritLee Yarwood proposed openstack/nova master: fup: Merge machine_type_mappings into get_default_machine_type  https://review.opendev.org/66403611:55
lyarwood^ I've rebased these as both keep failing on nova.tests.unit.test_hacking.HackingTestCase.test_check_doubled_words in check queue and gate but are passing locally. stephenfin ^ any ideas?11:55
*** dave-mccowan has quit IRC12:05
*** brinzhang has quit IRC12:10
*** brinzh has quit IRC12:10
artomlyarwood, you've seen https://bugs.launchpad.net/nova/+bug/1804062 I assume?12:12
openstackLaunchpad bug 1804062 in nova (Ubuntu Eoan) "test_hacking fails for python 3.6.7 and newer" [High,Triaged]12:12
artom(It's in the comment immediately above your failing test)12:12
aspiersam I right in thinking use of _LE() etc. is deprecated since Pike? as per https://docs.openstack.org/oslo.i18n/latest/user/usage.html12:15
artomaspiers, think so, yeah12:21
*** maciejjozefczyk has joined #openstack-nova12:21
*** jchhatbar has joined #openstack-nova12:21
lyarwoodartom: no missed that thanks, however this is on 2.7 oddly enough.12:22
lyarwoodah https://bugs.launchpad.net/nova/+bug/1804062/comments/412:23
openstackLaunchpad bug 1804062 in nova (Ubuntu Eoan) "test_hacking fails for python 3.6.7 and newer" [High,Triaged]12:23
artomlyarwood, I didn't really read it TBH, just kinda left it for you, like a cat leaving a mouse corpse12:24
sean-k-mooneyaspiers: we nolonger translate exception or logs12:24
sean-k-mooneyaspiers: only end user facing content12:24
*** janki has quit IRC12:24
*** ricolin_ has joined #openstack-nova12:27
stephenfinsean-k-mooney: I thought we still translated exceptions but not logs?12:27
*** jchhatbar has quit IRC12:27
sean-k-mooneystephenfin: not since pike as far as i am aware12:27
*** jchhatbar has joined #openstack-nova12:27
aspiersAFAICS exceptions are translated according to https://docs.openstack.org/oslo.i18n/latest/user/usage.html12:28
sean-k-mooneyhttps://docs.openstack.org/oslo.i18n/latest/user/guidelines.html#log-translation12:28
sean-k-mooneyaspiers: excetions retruned from the api might be12:28
aspiersright, logs != exceptions12:28
sean-k-mooneyexcptions that are logged are not12:28
aspiersobviously :) I mean exceptions which are raised12:29
* aspiers reads some more12:29
sean-k-mooneyno what i mean is if you raise an excetip and also log it then the logged version is not translated12:29
*** ricolin has quit IRC12:29
*** slaweq has joined #openstack-nova12:30
aspiersright12:30
aspiersanyway the page you linked answers my questions so thanks for that12:30
*** READ10 has joined #openstack-nova12:32
*** eharney has quit IRC12:39
*** zbr|ruck is now known as zbr|rover12:44
*** maciejjozefczyk has quit IRC12:44
*** slaweq has quit IRC12:46
yaawangjohnthetubaguy: Hi, are you good with the spec after updates? https://review.opendev.org/#/c/651681/12:49
*** ttsiouts has quit IRC12:49
*** ttsiouts has joined #openstack-nova12:50
*** pchavva has joined #openstack-nova12:53
*** pchavva has left #openstack-nova12:54
*** ttsiouts has quit IRC12:54
*** udesale has joined #openstack-nova12:55
*** ratailor__ has quit IRC13:01
*** lbragstad has joined #openstack-nova13:03
*** nicolasbock has quit IRC13:07
*** nicolasbock has joined #openstack-nova13:08
*** mriedem has joined #openstack-nova13:16
openstackgerritHamdy Khader proposed openstack/os-vif master: OVS DPDK port representors support  https://review.opendev.org/65878613:17
openstackgerritHamdy Khader proposed openstack/os-vif master: Fix mock of built in "open" function in unit tests  https://review.opendev.org/66458313:17
*** READ10 has quit IRC13:17
*** markvoelker has joined #openstack-nova13:18
*** ttsiouts has joined #openstack-nova13:22
*** markvoelker has quit IRC13:23
sean-k-mooneymriedem: when you have a sec i need your advice on how we should be mocking "open" in os-vif if you can comment on https://review.opendev.org/#/c/664583/1/vif_plug_ovs/tests/unit/test_linux_net.py13:23
sean-k-mooneythat would be awsome13:23
*** eharney has joined #openstack-nova13:26
openstackgerritMatthew Booth proposed openstack/nova master: Add functional test for bug 1550919  https://review.opendev.org/63129413:28
openstackbug 1550919 in OpenStack Compute (nova) "[Libvirt]Evacuate fail may cause disk image be deleted" [Medium,In progress] https://launchpad.net/bugs/1550919 - Assigned to Matthew Booth (mbooth-9)13:28
openstackgerritMatthew Booth proposed openstack/nova master: libvirt: Don't delete disks on shared storage during evacuate  https://review.opendev.org/57884613:28
mriedemsean-k-mooney: i just said should probably be using the mock_open stuff that's part of mock rather than directly mocking the builtin13:28
mriedemsince i think that's what you're supposed to do13:29
sean-k-mooneymriedem: ah ok i was not sure if there was more or not13:29
aspiersmriedem: he is using mock_open()13:29
aspiersoh ok sorry, not in test__disable_ipv6()13:30
yonglihespec "show-server-numa-topology" need core reviewer, alex_xu, mriedem , hope you have time , thanks. https://review.opendev.org/#/c/658716/13:30
yonglihesean-k-mooney, hi, have a good day.13:30
sean-k-mooneyi got confused by the other stuff that aspiers is andding in nova for conditional mocking which we dont need13:30
aspierssean-k-mooney: right, the conditional stuff isn't usually needed for unit tests, just for functional13:31
aspiersthe docstring I added for patch_open covers that in detail13:31
sean-k-mooneyyonglihe: o/13:31
sean-k-mooneyaspiers: right but i dont want to prot that to os-vif unless we really need it for something13:31
sean-k-mooneyin the unit test we have we dont really need it13:32
sean-k-mooneyand our functional test are intended to actully create bridges and ports13:32
aspierssean-k-mooney: sure, I think I just said that :)13:32
aspiersyou don't need it in this case13:32
sean-k-mooneyyep13:32
*** BjoernT has joined #openstack-nova13:34
yonglihesean-k-mooney, we kind of address the NUMA stuff concern, i hope this spec cloud get approved. wish me lucky.13:36
sean-k-mooneyyonglihe: yes i reviewd the latest version and it looked fine to me https://review.opendev.org/#/c/658716/13:37
sean-k-mooneyyonglihe: johnthetubaguy and alex_xu are p[roably the people you need to convicne now13:38
yonglihesean-k-mooney, sure,  only if they got spare time.13:40
*** boxiang has joined #openstack-nova13:40
*** boxiang has quit IRC13:42
yonglihesean-k-mooney, and i'm working on to checking the vm's signature to make sure we delete only the VM OS created. That cleanup orphan suff.13:42
stephenfinlyarwood, artom: Do I need to rebase the whole series for this so? http://logs.openstack.org/11/651311/11/check/openstack-tox-py27/5910a90/testr_results.html.gz13:43
stephenfinNot sure if it's even fixed yet13:43
stephenfinOr do we need a fix?13:44
openstackgerritEric Fried proposed openstack/nova master: fup: Remove unused mock in libvirt functional base  https://review.opendev.org/66444913:44
openstackgerritEric Fried proposed openstack/nova master: Remove unused mock in libvirt functional base  https://review.opendev.org/66444913:45
*** mchlumsky has joined #openstack-nova13:46
*** BjoernT_ has joined #openstack-nova13:48
*** BjoernT has quit IRC13:48
sean-k-mooneyyonglihe: ah ok cool yes that would be a nice saftey feature to add for the libvirt driver so im glad to hear your looking into it13:49
yongliheThere may have some gap, if that VM no db recording and we want get the whole xml parsed i guess.13:50
*** mlavalle has joined #openstack-nova13:52
*** jchhatbar has quit IRC13:52
*** hongbin has joined #openstack-nova13:55
*** slaweq has joined #openstack-nova13:56
artomstephenfin, not sure what to tell you, lyarwood has more context I believe13:56
*** mchlumsky has quit IRC13:59
*** pcaruana has quit IRC14:04
lyarwoodstephenfin / artom ; no you don't need to rebase, I just did it blind before artom pointed out it was a known unresolved issue14:04
stephenfinah, it's still unresolved14:04
*** liuyulong has joined #openstack-nova14:04
* stephenfin dives down that rabbit hole14:04
yaawangsean-k-mooney: Hi, I've replied your comment on gerrit, please take a look if you have time. https://review.opendev.org/#/c/65168114:08
*** maciejjozefczyk has joined #openstack-nova14:09
artomdannins, thanks for the review :) I'm not married to the naming, obviously, so I'll try to come up with something better14:09
artomErr, dansmith ^^14:09
dansmithartom: ack, I feel like an ass complaining about the hardest problem in computer science, but..14:10
dansmithmight be that I'm just feeling my base state14:10
artomdansmith, in terms of where to put them... get_virt_ in to libvirt/driver.py and get_manager_ in the compute manager? They're 2 sides of the same logic, so I kinda think they should go in the same place, one that's callable by both libvirt and the compute manager, so...?14:11
artomdansmith, no, naming is important, it's fine :)14:11
dansmithartom: virtapi is the wrong place for that, IMHO. I'm not opposed to them being adjacent14:12
kashyapefried: Thanks for not minding my nit-pick!  New PS looks good to me14:12
kashyap[With the test failures fixed.]14:12
efriedthanks. Any idea wtf is up with the doubled words hacking test??14:13
artomdansmith, fair enough about virtapi being wrong, but... what else do we have? We talked about putting them in utils somewhere14:13
kashyapefried: Which are those?14:13
efriedkashyap: This morning I saw py27 failing on several totally unrelated patches on hacking test_check_doubled_words14:14
efriede.g. http://logs.openstack.org/49/664449/1/check/openstack-tox-py27/4ad64aa/testr_results.html.gz14:14
dansmithartom: yeah, I dunno. utils feels a little generic.. what about in neutronapi or thereabouts?14:16
efriednothing about that test has changed. No new hacking rules have been added recently (months). The only thing around hacking that's changed is when stephenfin updated hacking reqs, but that was like 6 weeks ago.14:16
stephenfinefried: Scroll up14:16
artomefried, https://bugs.launchpad.net/nova/+bug/1804062 I think14:16
openstackLaunchpad bug 1804062 in nova (Ubuntu Eoan) "test_hacking fails for python 3.6.7 and newer" [High,Triaged]14:16
kashyapefried: No idea about that one, afraid.14:16
stephenfin<artom> lyarwood, you've seen https://bugs.launchpad.net/nova/+bug/1804062 I assume?14:16
stephenfinefried: ^14:17
stephenfin(or down)14:17
stephenfinI'm looking at it14:17
efriedstephenfin: But all the failures I saw today were in py2714:17
artomefried, <lyarwood> artom: no missed that thanks, however this is on 2.7 oddly enough.14:17
artom<lyarwood> ah https://bugs.launchpad.net/nova/+bug/1804062/comments/414:17
openstackLaunchpad bug 1804062 in nova (Ubuntu Eoan) "test_hacking fails for python 3.6.7 and newer" [High,Triaged]14:17
stephenfinHmm, Canonical hardly backported the change, did they?14:17
artomdansmith, hrmm, neutronapi does make sense14:18
artomAnd it's something both compute manager and driver use already14:18
artom*libvirt driver14:18
dansmithartom: mmhmm :)14:18
artomIt's still kinda weird that suddenly neutronapi will understand about compute manager and libvirt14:19
artomBut... that was going to be weird regardless14:19
dansmithwell, it doesn't reall,y14:19
dansmithit just declares "late" and "early" events or something14:19
dansmithit doesn't need to be revert specific, or even compute/virt specific14:19
artomdansmith, ah I see - "bind-time" vs "plug-time"14:19
dansmithsomething like that yeah14:19
artomWell, except it's *very* revert specific14:19
artomBecause IIUC it doesn't happen unless the instance is present on the host, shut off14:20
dansmiththe fact that it's revert specific is a nova detail14:20
dansmithit's specific to re-binding without changing the host, or whatever the eff it is14:20
efriedstephenfin: looks like it may have been backported, yeah.14:20
artomUpdating the binding to a host that already has the instance14:20
*** prometheanfire has joined #openstack-nova14:21
dansmithartom: there's also nova/network/somethingelse14:21
dansmithif you prefer14:21
prometheanfirenova tests flakey?14:21
*** maciejjozefczyk has quit IRC14:21
efriedprometheanfire: We think we're hitting https://bugs.launchpad.net/nova/+bug/1804062/comments/414:21
openstackLaunchpad bug 1804062 in nova (Ubuntu Eoan) "test_hacking fails for python 3.6.7 and newer" [High,Triaged]14:21
artomdansmith, events.py?14:21
artomneutronapi is fine14:21
dansmithartom: but the detail here is pretty neutron specific, as I understand it14:21
artomdansmith, oh yeah14:22
efriedstephenfin: I'm going to propose a patch to disable in 2.7.15, unless you're already on that.14:22
stephenfinI was just going to fix the test14:22
efriedstephenfin: oh, what's the fix?14:22
stephenfinNo idea. I'm working on that :)14:22
dansmithartom: if you meant nova/network/events.py as a new modiule.. maybe but that's pretty heavy.. I dunno, I don't care that much, I just don't want it in virtapi14:22
stephenfinWait, is this fixed in 2.7.16?14:22
dansmithartom: I bet mriedem has an opinion14:22
stephenfini.e. is it a Python bug?14:22
dansmithartom: and it's probably contrary to my opinion14:23
artomdansmith, mriedem, well you guys can oil-wrestle it out14:23
artomI'm gonna go write code ;)14:23
dansmithartom: I think he likes to disagree with me because he thinks it makes him look smart, whereas I like to think agreeing with him makes _me_ look smart14:23
efriedcdent: Do you understand the issue underlying https://bugs.launchpad.net/nova/+bug/1804062/comments/4 ?14:25
openstackLaunchpad bug 1804062 in nova (Ubuntu Eoan) "test_hacking fails for python 3.6.7 and newer" [High,Triaged]14:25
* cdent reads14:25
*** cfriesen has joined #openstack-nova14:26
efried(whoah, that's a pretty serious regex in that hacking check)14:27
prometheanfireefried: thanks for the pointer14:27
*** slaweq has quit IRC14:28
cdentweird. I have no memory of any of this14:28
sean-k-mooneycdent: efried do vmware or powervm have a similar feature to libvirt auto converge livemigation optio where the vm is slowed if the migration is taking a long time to allow it too complete14:29
*** dave-mccowan has joined #openstack-nova14:29
efriedsean-k-mooney: I don't recall any such thing, but that doesn't mean it doesn't exist.14:29
sean-k-mooneyi dont think any driver other then libvirt support it in nova but i was wondering if it was supported by other hyperviors in general14:30
*** pcaruana has joined #openstack-nova14:30
cdentefried: I don't know if the underlying issue much matters? Basically if we take off the skip and things work, groovy, if not, we still stuck? Or are you after "can we fix the regex"?14:30
efriedactually, I think powervm live migrate might actually quiesce the vm while it's migrating14:30
*** pcaruana has quit IRC14:31
cdentsean-k-mooney: the mysteries of the DRS are beyond me. If you can think it, it probably does it if you set the right setting.14:31
*** pcaruana has joined #openstack-nova14:31
kashyapyonglihe: I've also asked the QEMU post-copy migration author/maintainer to look at the spec, too.  (I myself need to re-look at it, just been buried)14:31
kashyap(s/need/"wanted to"/)14:31
sean-k-mooneycdent: ya i assumed that its proably done under the hood in vspher or whatever14:32
efriedcdent: Well, stephenfin is looking for a way to fix whatever we're doing in the test, but so far we're stymied on that. If it's not possible (or if it takes us longer than a few more minutes to figure out) I'd like to just disable the test. But since you touched it, and your code change implies some kind of understanding of the root cause of the breakage, I though I would ask you if you know what's going on there.14:32
cdentmy understanding was based on chasing many links through the interwebs, not understanding the tokenizer14:32
efriedokay14:33
*** hamdyk has quit IRC14:34
efriedI'm trying to repro on bionic. Not happening at 2.7.15rc114:34
efriedaha, but does reproduce on latest14:35
stephenfinyeah, I can't reproduce on Fedora 20 with 2.7.1614:35
efriedwhich lists self as 2.7.15+ -- not helpful :(14:35
*** prometheanfire has left #openstack-nova14:36
stephenfinor 3.6.8. Hmm14:42
stephenfinI always forget how damn big the nova repo is14:44
stephenfinDefinitely should have shallow cloned14:44
kashyapsean-k-mooney: In that PostCopy spec, this naming sounds scary to me: "*_permit_reboot_risk"14:52
*** itlinux has quit IRC14:55
*** ttsiouts has quit IRC14:57
*** ttsiouts has joined #openstack-nova14:58
*** mchlumsky has joined #openstack-nova14:59
*** ttsiouts_ has joined #openstack-nova15:00
*** ttsiouts has quit IRC15:01
efriedstephenfin: It's looking like it's only broken at 3.6.7 (some releaselevels - at least 'final') and 2.7.15 (likewise). So we could skip those and move on with life.15:03
efriedoh, never mind, I just reproduced at 3.6.8 'final'.15:04
stephenfinIf that's the case, yup, let's do that15:04
stephenfindamn15:04
efriedstephenfin: what's your 3.6.8 where it wasn't reproducing?15:05
efriedstephenfin: and did you remember to turn off the skip decorator? :P15:05
stephenfinpython36-3.6.8-6.fc30.x86_6415:05
stephenfinThat only applies to 2.7, no?15:05
stephenfinI've got it reproduced in an Ubuntu VM15:06
sean-k-mooneykashyap: yes i agree i dont like that charaterisation which is why i suggeted other names instead15:06
efriedstephenfin: The skip decorator is skipping the test in anything >= 3.6.715:06
stephenfinSorry, yeah, 3.615:07
sean-k-mooneykashyap: my -1 is mainly for the extraspec names an di have one question regarding if post copy and auto converge can be used togeter at teh qemu/libvirt layer15:07
kashyapsean-k-mooney: Thanks.  Didn't read everything yet; need a fresher mind.15:07
kashyapsean-k-mooney: I asked Dave (PostCopy author) to also comment, FWIW.15:07
*** damien_r has quit IRC15:07
sean-k-mooneykashyap: cool15:07
kashyapsean-k-mooney: Another thing is, how does one prioritize between PostCopy and AutoConverge15:07
*** slaweq has joined #openstack-nova15:08
sean-k-mooneykashyap: currently its states its an error to use both15:08
sean-k-mooneyaparently nova perfers post copy over auto converge15:09
sean-k-mooneyalthough if i rememebr correctly danpb prefered the idea of having auto converge enabled by default in nova and was less confindent in post copy15:09
kashyapsean-k-mooney: That's the response:15:09
kashyap17:08 < kashyap> dgilbert: Can you use PostCopy and AutoConverge at the _same_ time, Dave?15:09
kashyap17:08 < dgilbert> hmmmm15:10
kashyap17:09 < dgilbert> if you can I don't think we've ever tested it15:10
kashyapsean-k-mooney: The thing is, some workloads will be "surprized" in a bad way to realize AutoConverge is auto-enabled15:10
cfriesenit doesn't make sense to use postcopy and autoconverge at the same time15:10
kashyapcfriesen: Yeah, it doesn't.  One needs to know WTF they're doing before they start trying things15:11
sean-k-mooneykashyap: ya i know things like watcher15:11
cfriesenonce you've enabled postcopy it'll naturally slow down as it pulls pages over the network, no need to artificially slow it down to allow to converge15:11
sean-k-mooneycfriesen: well autoconverge only slow it down if it failed to copy less the half of the outstanding pages in the last interval15:11
kashyapcfriesen: Yeah, the unsatisfying answer, as usual is, "it depends on the workload"15:11
sean-k-mooneyand it does not slow down the workload intially untill a certin time has passed15:12
cfriesensean-k-mooney: details. :)15:12
stephenfinprintf-debugging++15:12
sean-k-mooneyif you are dirtiying memory fast enough i dont know if post-copy is required to ever finish or if write to remote memory will always be paged to local memory instead15:12
*** lpetrut has quit IRC15:12
cfriesensean-k-mooney: once you've written to all local pages, then post-copy is done. :)15:13
sean-k-mooneyif post-copy works by treating the remote meory as read only then its fine15:13
cfriesensean-k-mooney: it does15:13
sean-k-mooneyok then ya no need to use both15:13
cfriesensean-k-mooney: but if you lose the network while in post-copy, you're hosed15:13
sean-k-mooneyyep i know15:13
sean-k-mooneybut if you looes netwroking with shared storage your equally screwed15:14
artomWe're allowed methods in neutronv2/api.py that aren't in network/api.py, right?15:16
artomOr is this like virt drivers, they all need to match?15:16
sean-k-mooneyprivate ones yes15:16
artomPublic ones15:16
sean-k-mooneywhat methods are you adding15:16
sean-k-mooneythat moduel shoudl really only have methods that call neutron15:16
artomThe get_events stuff, see convo with dansmith above15:16
sean-k-mooneyits does not interact with the api15:17
sean-k-mooneyso why would it be in that module15:17
*** hamzy_ is now known as hamzy15:17
*** pcaruana has quit IRC15:17
artomTBH, because dansmith said so, and it makes sense to me as well15:17
artomBut mostly because he said so ;)15:17
artomThis is not something I have the energy to debate15:17
dansmithartom: don15:17
dansmithartom: don't hedge :)15:18
*** Luzi has quit IRC15:18
efriedstephenfin: I'm stumped. Are you getting anywhere? If not, I'm going to call time and just disable the test for now.15:18
sean-k-mooneydansmith: why in the api module and not here https://github.com/openstack/nova/blob/master/nova/network/model.py#L46015:18
stephenfinefried: Yeah, I'm down in pycodestle15:18
stephenfin*pycodestyle15:19
dansmithsean-k-mooney: I said nova/network/something would be fine too15:19
artomI wasn't aware of the "must call neutron API" rule15:19
efriedstephenfin: Was that "yeah I'm getting somewhere" or "yeah disable the test"?15:20
dansmithartom: I'm aware of no such rule15:20
sean-k-mooneyartom: im not sure it a rule but that module is nova.network.neutronv2.api15:20
artomsean-k-mooney, actually yeah, with the new abstraction suggested by dansmith (plug-time vs bind-time), it fits in model as well15:20
stephenfinefried: Disable it. I'll keep looking15:20
stephenfinHere's our issue though https://github.com/PyCQA/pycodestyle/blob/2.0.0/pycodestyle.py#L163915:20
stephenfinWe shouldn't be getting there but I don't know yet what's changed15:20
sean-k-mooneypretty much everything it does interacts with the neutron api in one way or another15:20
*** sapd1_x has quit IRC15:21
dansmithsean-k-mooney: we have constants defined in that module, and this detail is completely related to "what to expect from the neutron api" so I have no problem saying it should (or can) be in there15:21
stephenfinThings like this are why I was trying to get us onto a newer hacking version. Things invariably break15:21
efriedstephenfin: aren't we on a newer hacking version at this point?15:21
sean-k-mooneyartom: plugtime and bind time is more or less what i was thinking about in the neutron spec too so that makes sense to me15:21
stephenfinnot really. Hacking is relying on a really old version of flake815:22
artomkawn sen suss!15:22
stephenfinLike, super old15:22
stephenfinand I can't update because they broke all the things in flake8 3.x :( https://gitlab.com/pycqa/flake8/issues/54515:23
* stephenfin stops grumbling15:23
*** maciejjozefczyk has joined #openstack-nova15:23
sean-k-mooneyok well its not where i would instintivly look for them but i can live with it.15:23
* artom moves stuff around once more15:24
*** ociuhandu_ has joined #openstack-nova15:24
sean-k-mooneyartom: to your orginal question https://github.com/openstack/nova/blob/master/nova/network/api.py isthe old nova networks api and the neton one extends it15:25
sean-k-mooneyi think you can ignore https://github.com/openstack/nova/blob/master/nova/network/api.py at this point15:25
artomsean-k-mooney, ack, thanks for looking :)15:25
*** ociuhand_ has joined #openstack-nova15:25
artom(Though tbf my original question was rendered moot when we agreed to put it in model)15:26
*** ociuhandu_ has quit IRC15:26
sean-k-mooneyartom: :) by the way i proposed https://review.opendev.org/#/c/664442/ to test this15:27
artomsean-k-mooney, yep, thanks for that15:28
*** ociuhandu has quit IRC15:28
*** ociuhand_ has quit IRC15:29
*** ociuhandu has joined #openstack-nova15:30
openstackgerritEric Fried proposed openstack/nova master: Skip test_check_doubled_words hacking check UT  https://review.opendev.org/66462215:30
efriedstephenfin: ^15:30
efrieddansmith: mind unblocking the gate ^15:35
* efried bbiab15:35
*** udesale has quit IRC15:42
*** pcaruana has joined #openstack-nova15:43
*** maciejjozefczyk has quit IRC15:44
*** igordc has joined #openstack-nova15:44
openstackgerritAdam Spiers proposed openstack/nova master: Add extra spec parameter and image property for memory encryption  https://review.opendev.org/66442015:45
aspiersefried: vastly improved patchset based on your feedback ^^^15:45
*** eharney has quit IRC15:46
openstackgerritSylvain Bauza proposed openstack/nova-specs master: Proposes NUMA affinity for vGPUs  https://review.opendev.org/65096315:47
*** luksky has joined #openstack-nova15:47
efriedaspiers: looking.15:48
*** _alastor_ has joined #openstack-nova15:48
*** tbachman has quit IRC15:48
*** helenafm has quit IRC15:49
stephenfinefried, cdent: Here's what's happening15:49
stephenfinBecause of https://bugs.python.org/issue33899, we now insert a NEWLINE token at the end of all lines15:50
stephenfinthat manifests itself in pycodestyle15:50
stephenfinwhich is interating through all the tokens on the test line15:50
stephenfinhttps://github.com/PyCQA/pycodestyle/blob/2.0.0/pycodestyle.py#L161615:50
*** tbachman has joined #openstack-nova15:51
stephenfinpreviously, when we got to the end of the line we were falling through to this case https://github.com/PyCQA/pycodestyle/blob/2.0.0/pycodestyle.py#L1650-L165215:51
stephenfinbut now, because we see this newline token, we hit this case instead https://github.com/PyCQA/pycodestyle/blob/2.0.0/pycodestyle.py#L1632-L163515:52
stephenfinnote that that case doesn't include a call to 'check_physical'15:52
stephenfinso our test never gets run15:52
stephenfinI don't know how to fix that. It feels like this is now a bug in pycodestyle15:53
stephenfinI note that the latest version of pycodestyle does pretty much the same thing too https://github.com/PyCQA/pycodestyle/blob/2.5.0/pycodestyle.py#L2104-L210715:54
cdentstephenfin: sorry stephenfin, I thought most of what you said above was already understood: and it being a bug on pycodestyle was known15:54
cdentor rather: pycodestyle's continued behavior is the root15:54
stephenfinUm, whut? :)15:54
stephenfinClearly I didn't read far enough15:55
*** aram1s has quit IRC15:55
cdentOr maybe I just reached that conclusion based on the discussion on https://bugs.python.org/issue33899 which if I recall right suggests the same thing15:55
*** pcaruana has quit IRC15:55
stephenfinYup, now that I search for pycodestyle I see the line of course. Dang it15:56
stephenfinTheir fix is rather odd though https://github.com/PyCQA/pycodestyle/pull/801/files15:56
* stephenfin keeps looking15:56
openstackgerritAdam Spiers proposed openstack/nova master: Pass extra_specs to flavor in vif tests  https://review.opendev.org/66255615:58
*** eharney has joined #openstack-nova15:58
*** tbachman has quit IRC15:59
aspiersefried: What's supposed to happen when hw:mem_encryption=True but trait:HW_CPU_X86_AMD_SEV=required is missing?16:01
efriedaspiers: How could that happen?16:02
efriedoh16:02
aspiersefried: Should the filter automatically add it for now, but then later error if we add support for MKTME?16:02
efriedNo, we should never add the trait.16:02
stephenfinefried: If you apply this to '.tox/py27/lib/python2.7/site-packages/pycodestyle.py' it fixes things, yeah? http://paste.openstack.org/show/752752/16:02
aspiersOK, so then we need to error if it's missing, which somewhat reduces the user-friendliness benefit of hw:mem_encryption16:03
efriedaspiers: You're assured of landing on capable hosts because they're the only ones that can satisfy the MEM_ENCRYPTION_CONTEXT inventory.16:03
efriedNo16:03
efriedif the image/flavor prop is specified, it means I want mem encryption16:04
efriedif I care that it's SEV, I specify the SEV trait and land on an AMD host16:04
efriedif I care that it's MKTME, I specify the MKTME trait and land on an Intel host16:04
efriedif I don't care which, I leave the trait out and land on either one.16:04
aspiersSure, but I'm talking about the last case16:04
aspiersIn that case, there needs to be logic *somewhere* in the code which says "OK, the user wants encrypted memory, and the only way to achieve that currently is SEV"16:04
aspiersso that it triggers usage of all the SEV bits16:04
efriedNo.16:04
efriedI never land on a non-capable host, because only capable hosts have MEM_ENCRYPTION_CONTEXT inventory.16:04
*** ttsiouts_ has quit IRC16:04
efriedToday the only hosts exposing that inventory will be SEV-capable hosts, so that falls into place.16:05
aspiersSure16:05
aspiersbut where does that logic go? ^^^16:05
*** ttsiouts has joined #openstack-nova16:05
efriedIt's implicit. It's free. It doesn't "go" anywhere.16:05
aspiersIt's not enough to land on the right host16:05
aspiersnova needs to know to add all the extra bits to the guest config16:05
efriedextra bits16:06
aspiersyes, like <launchSecurity /> and <locked />16:06
aspiersand a whole bunch of iommu stuff16:06
efriedalways the same if I'm SEV, right?16:06
*** cdent has quit IRC16:06
aspiersNot sure I understand the question16:07
aspiersThat extra config varies depending on a whole bunch of things16:07
efriedokay, but the virt driver knows how to twiddle the guest config based on a) mem_encryption flavor/image prop, and b) fact I'm on an AMD host16:07
efriedIf there are user-/admin-configurable options beyond "yes" or "no", we should talk about where those should go.16:08
efriedBut my understanding was that from the admin/user pov it was "yes" or "no".16:08
aspiersIt is16:08
efriedand if there are any variations, it's discovered based on specifics of the system16:08
efriedokay16:08
efriedso the virt driver knows b)16:08
efriedthat's how it knows it's doing SEV16:09
aspiersIt sounds like you are saying that the logic should go in the virt driver and it should be "if the current context has MEM_ENCRYPTION_CONTEXT=1 and the current host is SEV, then add the SEV bits"16:09
efriedokay, yes16:09
*** ttsiouts has quit IRC16:10
aspiersOK, thanks - think I know how to write it now16:10
efriedI suppose if you're being careful, you should raise a nice exception if you get MEM_ENCRYPTION_CONTEXT without being SEV-capable (regardless of AMD-ness)16:10
aspiersYes can do.  BTW SEV is AMD-only16:11
aspiersVery much a vendor-specific thing16:11
aspiersYou probably knew that and I'm just misinterpreting the point of your last clause in parentheses16:12
*** boxiang_ has quit IRC16:14
efriedYes, what I'm saying is, theoretically there should have been no way you got this far if the host wasn't SEV-capable, but, I don't know, if someone switched off the capability between allocation and spawn, you should fail hard.16:14
aspiersYep, absolutely16:15
aspiersIt was the "(regardless of AMD-ness)" bit I didn't quite get16:15
efriedstephenfin: fixes it py2716:15
stephenfinsweet16:16
stephenfinI'll submit that as a fix to pycodestyle16:16
*** kaliya has quit IRC16:17
efriedstephenfin: fixes in py36 as well16:17
efriedstephenfin: why is self.lines[-1] correct?16:18
*** tesseract has quit IRC16:18
stephenfinIt's not, actually, now that you mention it16:19
stephenfinOr maybe it is. Needs more tests16:21
aspiersefried: bbobrov is on vacation so I'm taking over his SEV patches, and thinking about rebasing them all into a single linear commit series (even though this won't accurately reflect the dependencies between them) - does that make sense?16:21
efriedaspiers: Yes it does. I was kind of wondering why they weren't already in one line.16:22
aspiersefried: Well, I gave a few reasons for that in our previous discussions on this, but an additional reason is weak coordination between me and him ... :)16:23
efriedack16:23
aspiersOne downside is that if an earlier patch fails CI, it bottlenecks merging of anything higher up16:23
aspiersbut if it makes life easier for reviewers then that probably overrules any other considerations16:24
*** mdbooth has quit IRC16:24
efriedIt's not just that. It's that ultimately you're going to need a patch that ties everything together. And as previously discussed, you can't have a dep tree that's upside down.16:24
aspiersSure16:24
aspiersAnother downside is that it will significantly increase the number of rebases16:25
efriedSo yes, the fact that some patches *could* be merged independently if they were separated - it's just something that we live with.16:25
aspiersbut again I can live with those16:25
aspiersDefinitely a nice future enhancement for Gerrit16:25
aspiersOne can dream ...16:25
aspiersI guess I'll rebase all his stuff on top of mine, since it's the next phase16:26
aspiersMy stuff is all about feature detection and scheduling; his is about guest config and booting16:26
aspiersThen the series will roughly match the order of work items16:27
aspiersas listed http://specs.openstack.org/openstack/nova-specs/specs/train/approved/amd-sev-libvirt-support.html#work-items16:27
efriedaspiers:16:29
efried> It was the "(regardless of AMD-ness)" bit I didn't quite get16:29
efriedI just meant "being on AMD isn't enough; other stars must align for SEV to be supported"16:29
efriedSo your check in the virt driver should just reuse the same "am I SEV capable" method that it used to expose the MEM_ENCRYPTION_CONTEXT inventory and the HW_CPU_X86_AMD_SEV trait in the first place. Which is why there should be no way for that check to fail - unless something changed in between update_provider_tree and spawn.16:29
efriedand yes, I agree with your ordering, especially since your patches are already 2/3 with one +2 and the last one very close to same, but the other ones are still awaiting your nod before I even dig into them.16:31
*** spatel has joined #openstack-nova16:32
*** ccamacho has quit IRC16:36
*** davidsha has quit IRC16:36
aspiersefried: OK thanks, we're 100% aligned :)16:37
*** whoami-rajat has quit IRC16:38
*** ociuhandu_ has joined #openstack-nova16:39
*** ociuhandu has quit IRC16:39
aspiersefried: Oh, one extra detail regarding the above - yes the check can just look at the supports_amd_sev instance variable, but it also needs to check extra_specs for resources:MEM_ENCRYPTION_CONTEXT=1 to know that encrypted memory was requested, right?16:40
aspiersIf *both* are true then it should add all the SEV guest config tweaks16:40
efrieds/check extra_specs/check the allocation/ but otherwise, ja, genau16:42
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: flatten rbd images when unshelving an instance  https://review.opendev.org/45788616:44
*** slaweq has quit IRC16:49
aspiersefried: OK thanks, I guess that will become self-evident when I look into how to check allocations16:49
*** pcaruana has joined #openstack-nova16:49
efriedaspiers: Well, I would rather you check the allocations rather than duplicating the logic you just put in your request filter to check and validate the flavor & image16:49
efriedThe allocations are passed to spawn. They're just a dict. See the placement API reference for the format.16:50
aspiersCool, thanks!16:50
aspiersI'm beginning to feel that this is nearing code-completion and maybe can be added to the runway queue soon16:50
efriedyup16:51
*** dtantsur is now known as dtantsur|afk16:51
aspiersI do want to test the whole series on real SEV hardware first though16:51
aspiers(which I have available to me right now)16:51
*** slaweq has joined #openstack-nova16:52
*** rpittau is now known as rpittau|afk16:55
*** spatel has quit IRC16:56
*** slaweq has quit IRC16:56
*** itlinux has joined #openstack-nova16:57
efrieddustinc: sdk release 0.31.0 is in u-c now, so I'd like to respin the series to bump that and fix up that other thing we talked about yesterday. Let me know when you're clear of local edits.16:58
*** luksky has quit IRC16:59
*** derekh has quit IRC17:01
*** tssurya has quit IRC17:04
*** whoami-rajat has joined #openstack-nova17:05
*** luksky has joined #openstack-nova17:05
*** luksky has quit IRC17:12
*** hemna has quit IRC17:30
*** hemna has joined #openstack-nova17:30
dustincefried: Hmm...might be a bit, go for it and I can deal with merging my local edits17:44
*** ralonsoh has quit IRC17:53
*** priteau has quit IRC17:54
*** ociuhandu has joined #openstack-nova17:54
*** ociuhandu_ has quit IRC17:57
*** ociuhandu has quit IRC17:59
*** spatel has joined #openstack-nova18:03
spatelsean-k-mooney: any idea about this setting https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1724614 ?18:03
openstackLaunchpad bug 1724614 in linux (Ubuntu) "[KVM] Lower the default for halt_poll_ns to 200000 ns" [Medium,Triaged]18:03
spateli have default value but i heard it gives good boost to CPU if you play with this setting18:03
mriedemefried: do we have a bug for the test_check_doubled_words py27 failures?18:05
*** mdbooth has joined #openstack-nova18:08
sean-k-mooneyspatel: i have not had experience with tweaking that specific tunable in the past.18:09
spateleven i am running in default, i heard from someone but may be its application specific.18:10
sean-k-mooneyspatel: i would proably try to find some infomation on it form nfv/hpc tuning guide but there are man paramaters that can be tweaked not all of which will help for all workloads18:10
spatel+118:11
spatelbut i am seeing sometime my ksm cpu usage going high on compute node18:11
spatel[ksmd]18:12
sean-k-mooneyyou proably want to read this https://www.kernel.org/doc/Documentation/virtual/kvm/halt-polling.txt18:12
*** christopher_mcca has joined #openstack-nova18:16
sean-k-mooneyspatel: ibm seam to be recommendign a value fo 80000 ns based on https://www.ibm.com/support/knowledgecenter/en/linuxonibm/liaag/wkvm/wkvm_c_tune_kvm.htm but this seams to be a tradeoff between powersavings and latency which translated to higher throughput at the cost of cpu efficenty18:17
*** christopher_mcca has left #openstack-nova18:18
spatelit seem that setting will schedule in very less time which increase power usage18:19
spatelanyway i am not going to change until i have solid reason to do18:20
*** tbachman has joined #openstack-nova18:35
mriedemcoreycb: is this the right change log to be looking at for ubuntu bionic py27? http://changelogs.ubuntu.com/changelogs/pool/main/p/python2.7/python2.7_2.7.15~rc1-1ubuntu0.1/changelog18:37
mriedemefried: https://bugs.launchpad.net/nova/+bug/183239218:38
openstackLaunchpad bug 1832392 in OpenStack Compute (nova) "nova.tests.unit.test_hacking.HackingTestCase.test_check_doubled_words failing in py27 jobs since June 10" [High,Confirmed]18:38
*** ricolin_ has quit IRC18:38
*** pcaruana has quit IRC18:39
efriedmriedem: Tracking it against bug/180406218:40
efriedmriedem: https://review.opendev.org/664622 is merging to disable the test18:40
coreycbmriedem: that is the latest update for the bionic-security pocket but bionic-updates is more recent. you can see the versions here: https://launchpad.net/ubuntu/+source/python2.718:40
efriedmriedem: and stephenfin is working on a patch to pycodestyle to get closer to fixing the core issue.18:40
mriedemcoreycb: ah ok here is the june 10 change then https://launchpad.net/ubuntu/+source/python2.7/2.7.15-4ubuntu4~18.0418:41
coreycbmriedem: yep18:43
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: Revert resize: wait for events according to hybrid plug  https://review.opendev.org/64488118:44
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: Include direct-physical in compute manager events check  https://review.opendev.org/66443118:44
openstackgerritArtom Lifshitz proposed openstack/nova master: [DNM] testing bug/1813789 revert resize events  https://review.opendev.org/66444218:45
openstackgerritArtom Lifshitz proposed openstack/nova master: Revert resize: wait for events according to hybrid plug  https://review.opendev.org/64488118:46
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: Include direct-physical in compute manager events check  https://review.opendev.org/66443118:46
openstackgerritArtom Lifshitz proposed openstack/nova master: [DNM] testing bug/1813789 revert resize events  https://review.opendev.org/66444218:46
artomFscked up my rebases18:46
mriedemok so probably no point in rechecking anything18:48
mriedemor working on nova for a few days...18:48
openstackgerritMatt Riedemann proposed openstack/nova master: Refresh instance network info on deletion  https://review.opendev.org/66076118:49
*** tbachman has quit IRC18:52
*** markvoelker has joined #openstack-nova18:55
openstackgerritAdam Spiers proposed openstack/nova master: Add extra spec parameter and image property for memory encryption  https://review.opendev.org/66442019:03
aspiersefried: there ya go ^^^19:03
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix default values in update_cell command  https://review.opendev.org/66238319:03
aspiersartom: reflog is your friend ;-)19:04
artomaspiers, wasn't that bad19:04
artomIf I need reflog then I've really messed up19:05
aspiershehe19:05
aspiersOh I dunno, it can be a real handy shortcut sometimes19:06
artomI'm off to the gym, during the day, for a change, while Zuul runs19:07
*** tbachman has joined #openstack-nova19:09
efriedmriedem: Once that bypass merges, which should hopefully happen pdq (test-only patches don't run tempest/dsvm stuff, right?) you can recheck the world.19:09
mriedemdansmith: would you see a use for a weigher config option for the vgpu/numa affinity weigher in sylvain's spec? https://review.opendev.org/#/c/650963/19:13
mriedemsince we have config options to control all other weighers19:13
dansmithjust in general? I mean, I would expect all weighers to be controllable like that19:13
mriedemin general yes19:13
dansmithunless it was something SUPER airtight like the failed computes weigher19:14
* dansmith shoots self19:14
dansmithdude19:15
dansmithyou should have snipped that last line19:15
mriedemha19:15
mriedemsorry19:16
mriedemalso not sure what he's proposing for the claim stuff,19:16
mriedemnormally if we were to link up the scheduler to some RT claim, we'd use the limits so that if you disable the filter we don't claim on those limits in the RT,19:16
mriedembut with this, it sounds like the compute would always just pull the VGPU allocations and pass those onto the claim19:17
dansmitherm19:19
dansmithis this really adding new claims to the RT?19:20
mriedemit says it is19:20
mriedemhttps://review.opendev.org/#/c/650963/7/specs/train/approved/libvirt-vgpu-numa-affinity.rst@9919:21
dansmithyeah, that's the line I'm wondering about19:21
*** igordc has quit IRC19:26
*** markvoelker has quit IRC19:29
melwittdoes anyone know if the failed_builds count is exposed out of the REST API at all?19:29
*** mdbooth has quit IRC19:31
mriedemmelwitt: it's not19:32
melwittdanke19:32
mriedemit's shoved into compute_nodes.stats which is a json blob in the db19:32
melwittah ok, I was wondering about that too. I found the nova/compute/stats.py file and didn't know how it's used. thanks19:33
Nick_AIs there a way to take online snapshots of lxd containers?19:34
mriedemNick_A: you should ask the lxd devs in #lxcontainers19:34
Nick_Athank you19:34
mriedemhttps://github.com/openstack/nova-lxd#support-and-discussions19:34
*** damien_r has joined #openstack-nova19:47
*** damien_r has quit IRC19:51
*** amodi has quit IRC19:59
*** efried has quit IRC20:01
*** psachin has quit IRC20:02
*** Sundar has joined #openstack-nova20:04
*** bbowen has quit IRC20:09
*** efried has joined #openstack-nova20:10
efrieddustinc: gonna do that now, mkay?20:11
dustinc👍20:11
*** JamesBenson has joined #openstack-nova20:17
openstackgerritEric Fried proposed openstack/nova master: Introduces the openstacksdk to nova  https://review.opendev.org/64366420:23
openstackgerritEric Fried proposed openstack/nova master: Introduces SDK to IronicDriver and uses for node.get  https://review.opendev.org/64289920:23
openstackgerritEric Fried proposed openstack/nova master: Use SDK instead of ironicclient for node.list  https://review.opendev.org/65602720:23
openstackgerritEric Fried proposed openstack/nova master: Use SDK instead of ironicclient for validating instance and node  https://review.opendev.org/65602820:23
openstackgerritEric Fried proposed openstack/nova master: Use SDK instead of ironicclient for setting instance id  https://review.opendev.org/65969020:23
openstackgerritEric Fried proposed openstack/nova master: WIP: Use SDK instead of ironicclient for add/remove instance info from node  https://review.opendev.org/65969120:23
openstackgerritEric Fried proposed openstack/nova master: Use OpenStack SDK for placement  https://review.opendev.org/65602320:23
efrieddustinc: ^20:23
*** markvoelker has joined #openstack-nova20:26
*** eharney has quit IRC20:32
*** tbachman has quit IRC20:35
efriedf f f f. bug 1823251 hit https://review.opendev.org/#/c/664622/ after sitting in the queue for 5h.20:44
openstackbug 1823251 in OpenStack Compute (nova) "Spike in TestNovaMigrationsMySQL.test_walk_versions/test_innodb_tables failures since April 1 2019 on limestone-regionone" [High,Confirmed] https://launchpad.net/bugs/182325120:44
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: [ironic] Don't remove instance info twice in destroy  https://review.opendev.org/66258420:46
sean-k-mooneyefried: is the 5 hour lag just a general issue with the gate being slow or is it related20:47
efriedsean-k-mooney: I'm sure it's just because we had a couple dozen patches in the queue (all of which failed on that issue of course) so that one got pushed.20:48
mordredefried: ooh - and you've got the ironicclient patches too - that's so cool20:51
efriedmordred: Yes, dustinc has been working on those. I'm not sure how done he is (percentage-wise) - dustinc?20:51
* mordred hands dustinc a somewhat uneaten bunch of carrots20:51
sean-k-mooneyi have a ptach queue in neutron for a little over 2 and a half hours without it starting so i think the gate is slow to start jobs currently in general20:51
efriedmordred: I'm pretty sure we're going to need some feature parity for ironic in sdk before we can be all the way complete there, but fortunately dtantsur|afk knows his sdk AND his ironic :)20:52
* dustinc munches20:52
dustincI am not even sure how far done I am percentage-wise20:52
mordredefried: yah - and has already been working through feature parity for other usage20:53
dustincbut it is coming along20:53
* mordred is excited for the additional usage surface-area ... we should probably add a tempest test job to sdk's gate20:54
mordred(we don't have one of those right now, because it wouldn't be valuable - but with nova using it to talk to services, it's an additinoal useful thing to check)20:55
openstackgerritEric Fried proposed openstack/nova master: get_ksa_adapter: nix by-service-type confgrp hack  https://review.opendev.org/66468920:56
*** markvoelker has quit IRC20:59
efriedmordred: probably not relevant until some of the above merges, eh?20:59
efriedmordred: We don't even have an approved blueprint yet :P20:59
redkriegdoes anyone have any troubleshooting tips for tracking down why cloud-init on my guests isn't getting ssh keys or passwords from metadata?  it works for me in one of my regions but not another, I don't see anything odd in my nova metadata wsgi logs either.21:00
efriedsean-k-mooney: your patch is going to fail unless you rebase it on https://review.opendev.org/#/c/664622/21:01
sean-k-mooneywhich one?21:02
sean-k-mooneythe one i said is 2 and a half hours in the queue?21:02
sean-k-mooneyif so its a neutorn patch so its fine21:02
sean-k-mooneymy other nova paths will fail however yes21:03
sean-k-mooneyim not going to push anything more today so if that isnt merged tommorw ill rebase things on top of it as needed21:03
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: Disable limit if affinity(anti)/same(different)host is requested  https://review.opendev.org/65924621:04
*** nicolasbock has quit IRC21:06
*** itlinux has quit IRC21:07
*** nicolasbock has joined #openstack-nova21:08
mriedemcan i get some stable core love on https://review.opendev.org/#/q/topic:bug/1830747+branch:stable/rocky ?21:08
mriedemworking on flushing stable/rocky for a release21:09
*** luksky has joined #openstack-nova21:09
mordredefried: oh - yeah - definitely not until it's actually going to test something21:10
openstackgerritEric Fried proposed openstack/nova master: Remove _ContextAuthPlugin.get_endpoint* workaround  https://review.opendev.org/66470321:21
openstackgerritMerged openstack/nova master: Replace 'is comprised of' with 'comprises'  https://review.opendev.org/66317521:29
*** igordc has joined #openstack-nova21:31
sean-k-mooney can we revert ^21:32
sean-k-mooneyefried: it is not correct21:32
sean-k-mooney... i guess i dont care enought but "is comprised of" was correct "comprises" as used in that patch is not.21:33
sean-k-mooney"Nova is composed of multiple server processes" would also be correct21:34
*** luksky has quit IRC21:35
efriedsean-k-mooney: google it21:35
efriedpick any result21:35
efried"is composed of" would be correct. "is comprised of" is not, nor is "comprises of".21:35
efriedbut it is correct as patched21:36
sean-k-mooneythe current wording read quite badly to me21:36
sean-k-mooneythe pacing feels wrong21:37
efriedI would have accepted "is composed of", but now that it's grammatically correct, I don't see it being worth changing.21:38
*** nicolasbock has quit IRC21:39
*** spatel has quit IRC21:39
sean-k-mooneyi keep wanting to read it as if there is a comma after comprises21:39
sean-k-mooneyif i force my self t to read it as written the its fine21:40
*** nicolasbock has joined #openstack-nova21:41
sean-k-mooneyhum i can reluctanlty agree to never use comprises but https://www.grammarly.com/blog/comprise-vs-compose/ makes some sense21:46
*** JamesBenson has quit IRC21:48
melwittI'm surprised someone opened a doc bug for that. as far as I've known, "is comprised of" makes OK sense21:53
sean-k-mooneymelwitt: i was assuming it was a us vs uk thing21:53
melwittyeah, I assumed must be a regional thing21:53
*** markvoelker has joined #openstack-nova21:56
*** bbowen has joined #openstack-nova21:58
efriedno, just such a common mistake it's almost become accepted22:05
efriedAsk asettle :P22:05
sean-k-mooneygot distracted reading the wiki article https://en.wikipedia.org/wiki/Comprised_of22:07
sean-k-mooneyapparently its is commonly used in us patents and dates forn the 18 century22:07
melwitt¯\_(ツ)_/¯22:08
sean-k-mooneyso i think its on better footing then performant22:08
melwitthaha right?22:08
efriedoh, please do not base real english on what's in patents22:09
melwittof all the other non-words we accept, "is comprised of" is the one to go after22:09
sean-k-mooneyefried: the stonger argument is dont belive everything you read on wikipedia :P22:10
*** rcernin has joined #openstack-nova22:10
*** itlinux has joined #openstack-nova22:14
*** slaweq has joined #openstack-nova22:22
*** markvoelker has quit IRC22:30
*** slaweq has quit IRC22:30
*** itlinux has quit IRC22:38
openstackgerritMerged openstack/nova stable/rocky: libvirt: Avoid using os-brick encryptors when device_path isn't provided  https://review.opendev.org/65646322:50
*** whoami-rajat has quit IRC22:55
openstackgerritMerged openstack/nova stable/rocky: Stop logging traceback when skipping quiesce  https://review.opendev.org/66032722:57
*** tkajinam has joined #openstack-nova23:04
*** mriedem has quit IRC23:06
*** BjoernT_ has quit IRC23:09
openstackgerritMerged openstack/nova stable/rocky: Restore connection_info after live migration rollback  https://review.opendev.org/66037523:16
openstackgerritMerged openstack/nova stable/rocky: libvirt: Do not reraise DiskNotFound exceptions during resize  https://review.opendev.org/66036223:17
*** JamesBenson has joined #openstack-nova23:18
*** JamesBenson has quit IRC23:22
*** factor has joined #openstack-nova23:22
*** markvoelker has joined #openstack-nova23:26
*** mlavalle has quit IRC23:28
openstackgerritMatt Riedemann proposed openstack/nova master: Make get_provider_by_name public and remove safe_connect  https://review.opendev.org/66406223:33
openstackgerritMerged openstack/nova stable/rocky: Replace the invalid index of nova-rocky releasenote  https://review.opendev.org/66317823:37
openstackgerritMerged openstack/nova stable/rocky: [stable-only] Improve the reno for consoleauth upgrade check  https://review.opendev.org/66111823:37
*** lbragstad has quit IRC23:41
*** liuyulong has quit IRC23:48
*** BjoernT has joined #openstack-nova23:50
*** BjoernT_ has joined #openstack-nova23:52
*** BjoernT has quit IRC23:54
*** brinzhang has joined #openstack-nova23:56
*** nicolasbock has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!