Monday, 2020-02-17

*** ociuhandu has joined #openstack-nova00:02
*** ociuhandu has quit IRC00:03
*** ociuhandu has joined #openstack-nova00:04
*** tbachman has quit IRC00:06
*** tbachman has joined #openstack-nova00:06
*** ociuhandu has quit IRC00:09
*** jmlowe has joined #openstack-nova00:16
*** jmlowe has quit IRC00:23
*** dave-mccowan has joined #openstack-nova00:23
*** vishalmanchanda has joined #openstack-nova00:24
*** jmlowe has joined #openstack-nova00:32
*** xiaolin has joined #openstack-nova00:45
*** dave-mccowan has quit IRC00:48
*** jmlowe has quit IRC00:55
*** tbachman has quit IRC01:10
*** yedongcan has joined #openstack-nova01:11
*** zhanglong has joined #openstack-nova01:18
*** ociuhandu has joined #openstack-nova02:23
*** ociuhandu has quit IRC02:29
*** brinzhang_ has quit IRC02:34
*** mkrai has joined #openstack-nova03:33
*** tbachman has joined #openstack-nova03:39
*** udesale has joined #openstack-nova04:10
*** tbachman has quit IRC04:31
*** imacdonn has quit IRC04:43
*** imacdonn has joined #openstack-nova04:44
*** mkrai has quit IRC05:17
*** ociuhandu has joined #openstack-nova05:30
*** mkrai has joined #openstack-nova05:31
*** evrardjp has quit IRC05:34
*** evrardjp has joined #openstack-nova05:34
*** ociuhandu has quit IRC05:35
openstackgerritAbhishek Kekane proposed openstack/nova-specs master: Fixed minor suggestions  https://review.opendev.org/70805805:41
*** ratailor has joined #openstack-nova05:58
*** mkrai has quit IRC05:59
*** links has joined #openstack-nova06:09
*** mkrai has joined #openstack-nova06:19
*** ircuser-1 has quit IRC06:23
*** TristanSullivan has quit IRC06:34
*** dpawlik has joined #openstack-nova06:48
*** iurygregory has joined #openstack-nova06:57
*** ociuhandu has joined #openstack-nova07:01
*** ociuhandu has quit IRC07:05
openstackgerritKobi Samoray proposed openstack/nova master: Support large network queries towards neutron  https://review.opendev.org/70452007:37
openstackgerritKobi Samoray proposed openstack/nova master: Support large network queries towards neutron  https://review.opendev.org/70452007:39
*** Jeffrey4l has quit IRC07:41
*** Jeffrey4l has joined #openstack-nova07:41
*** ralonsoh has joined #openstack-nova07:52
*** maciejjozefczyk has joined #openstack-nova07:57
*** slaweq_ has joined #openstack-nova07:58
*** slaweq_ is now known as slaweq07:59
*** zhanglong has quit IRC08:01
*** ociuhandu has joined #openstack-nova08:01
*** zhanglong has joined #openstack-nova08:02
*** ociuhandu has quit IRC08:03
*** ociuhandu has joined #openstack-nova08:04
*** rpittau|afk is now known as rpittau08:10
*** tkajinam has quit IRC08:15
*** ociuhandu has quit IRC08:16
*** lpetrut has joined #openstack-nova08:22
*** lpetrut has quit IRC08:22
*** lpetrut has joined #openstack-nova08:23
*** mkrai has quit IRC08:25
bauzasgibi: thanks for +Wing https://review.opendev.org/#/c/552924/ I'll create a FUP change08:26
*** mkrai has joined #openstack-nova08:27
*** tesseract has joined #openstack-nova08:30
*** ociuhandu has joined #openstack-nova08:35
*** amoralej|off is now known as amoralej08:37
*** ccamacho has joined #openstack-nova08:37
*** dtantsur|afk is now known as dtantsur08:41
*** ociuhandu has quit IRC08:46
*** ociuhandu has joined #openstack-nova08:47
*** ociuhandu has quit IRC08:52
*** xek has joined #openstack-nova08:52
*** lpetrut has quit IRC09:03
*** ivve has joined #openstack-nova09:07
*** FlorianFa has joined #openstack-nova09:18
gibibauzas: I was happy to push it through09:23
bauzascool thanks09:23
*** martinkennelly has joined #openstack-nova09:30
*** derekh has joined #openstack-nova09:33
*** Xuchu has joined #openstack-nova09:39
*** ratailor has quit IRC09:43
*** ratailor has joined #openstack-nova09:44
*** ociuhandu has joined #openstack-nova09:45
*** ociuhandu has quit IRC09:49
*** mkrai has quit IRC09:58
*** damien_r has joined #openstack-nova09:58
*** udesale_ has joined #openstack-nova10:00
*** udesale_ has quit IRC10:01
*** udesale has quit IRC10:01
*** udesale has joined #openstack-nova10:01
*** damien_r has quit IRC10:02
*** aloga has quit IRC10:03
*** purplerbot has joined #openstack-nova10:04
*** mkrai has joined #openstack-nova10:09
*** brinzhang has joined #openstack-nova10:11
*** ociuhandu has joined #openstack-nova10:22
openstackgerritBrin Zhang proposed openstack/nova master: Add new default roles in os-instance-actions policies  https://review.opendev.org/70647010:23
*** ociuhandu has quit IRC10:27
openstackgerritBrin Zhang proposed openstack/nova master: Add new default roles in os-instance-actions policies  https://review.opendev.org/70647010:30
*** udesale has quit IRC10:38
openstackgerritSylvain Bauza proposed openstack/nova-specs master: FUP for NUMA Topology spec  https://review.opendev.org/70808810:40
bauzasgibi: ^10:40
gibibauzas: ack10:40
gibibauzas: thanks, +210:42
bauzaskk thanks10:42
*** ociuhandu has joined #openstack-nova10:44
*** decrypt has quit IRC10:49
*** mkrai has quit IRC10:58
*** lpetrut has joined #openstack-nova11:03
*** rpittau is now known as rpittau|bbl11:03
*** ratailor has quit IRC11:16
*** ociuhandu has quit IRC11:20
*** ratailor has joined #openstack-nova11:23
openstackgerritKevin Zhao proposed openstack/nova master: [WIP] Add arm64 CI  https://review.opendev.org/70810211:32
openstackgerritKevin Zhao proposed openstack/nova master: [WIP] Add arm64 CI  https://review.opendev.org/70810211:36
openstackgerritKevin Zhao proposed openstack/nova master: [WIP] Add arm64 CI  https://review.opendev.org/70810211:42
*** ratailor has quit IRC11:47
*** ociuhandu has joined #openstack-nova11:54
*** ociuhandu has quit IRC11:59
*** aloga has joined #openstack-nova12:00
*** mvkr has joined #openstack-nova12:10
openstackgerritLuyao Zhong proposed openstack/nova master: bug-fix: Reject live migration with vpmem  https://review.opendev.org/70811012:11
openstackgerritKevin Zhao proposed openstack/nova master: [WIP] Add arm64 CI  https://review.opendev.org/70810212:14
*** factor has joined #openstack-nova12:15
openstackgerritKevin Zhao proposed openstack/nova master: [WIP] Add arm64 CI  https://review.opendev.org/70810212:25
*** udesale has joined #openstack-nova12:31
openstackgerritKevin Zhao proposed openstack/nova master: [WIP] Add arm64 CI  https://review.opendev.org/70810212:35
*** rpittau|bbl is now known as rpittau12:37
*** jaosorior has joined #openstack-nova12:37
*** Luzi has joined #openstack-nova12:44
openstackgerritKevin Zhao proposed openstack/nova master: [WIP] Add arm64 CI  https://review.opendev.org/70810212:47
*** maciejjozefczyk has quit IRC12:47
*** nicolasbock has joined #openstack-nova12:47
*** bbowen_ has quit IRC12:48
*** bbowen has joined #openstack-nova12:49
openstackgerritKevin Zhao proposed openstack/nova master: [WIP] Add arm64 CI  https://review.opendev.org/70810212:49
sean-k-mooneybauzas: gibi by the way rather then adapt the exitisting filter to work on allocation candiates we might actully want to a seperate filtering laywer that works on allocatgion candiates before the existing filters12:55
gibisean-k-mooney: that could be an alternative12:56
sean-k-mooneythat would avoid needing to pass an addtional paramater to all the filters so we wont break out of tree filters by changing the interface12:56
gibisean-k-mooney: it has a trade off to change the order of the filters as then NTF would run before any other filter12:56
gibibut the such order just affects scheduling performance not scheduling result12:57
sean-k-mooneyim suggesting we leave the NTF unchanged and add a new one but yes the oder does affect performance12:57
sean-k-mooney*order12:57
sean-k-mooneyyou could put the new filter after the exstiing onece i guess12:58
sean-k-mooneythe NTF normally should go at the end of the existing list anyway12:58
sean-k-mooneyso maybe that would make more sense12:58
sean-k-mooneyso prefilters->placemnt->currnent filters->allocation candiate filters->weighers?12:59
*** brinzhang has quit IRC13:00
*** brinzhang has joined #openstack-nova13:01
gibisean-k-mooney: yeah, NTF tend to be at the end of the list so having the ac filter at the end would be closer to todays behavior13:01
sean-k-mooneyfrom an information gain point of view the host based fileter have the potentail to eliminate multipel allocation candiates by removing the host13:02
sean-k-mooneyso i think it makes sesne for them to come after too13:02
bauzassean-k-mooney: well, let's discuss this during the implementation13:02
sean-k-mooneyya we can13:03
sean-k-mooneyi was just wondering if we could avoid breaking out of tree filters13:03
sean-k-mooneywhich i think this would allow13:03
*** ociuhandu has joined #openstack-nova13:07
openstackgerritBrian Rosmaita proposed openstack/nova master: Reject boot request for unsupported images  https://review.opendev.org/70812613:07
*** maciejjozefczyk has joined #openstack-nova13:09
*** ociuhandu has quit IRC13:12
*** amoralej is now known as amoralej|lunch13:12
gibistephenfin: do you have some ideas why jsonutils fails while json does not in https://review.opendev.org/#/c/703133 ?13:20
stephenfinhave you got a traceback?13:20
gibistephenfin: sure, give me a sec13:21
gibistephenfin: http://paste.openstack.org/show/789642/13:21
gibistephenfin: are nova uses old oslo.serialization that is not py37 compatible?13:22
sean-k-mooneyit would seam that we are mixing byte and text strings somehwere13:23
sean-k-mooneybut this would have broken on py3.513:23
sean-k-mooneyso its not a py 3.7 thing13:23
gibisean-k-mooney: right. but the combination for byte and str seems to happen in codecs which is stdlib13:26
sean-k-mooneyright so we are expecting to pass in a string13:27
stephenfingibi: looking at the source, it seems we attempt to decode whatever file we get to utf-813:27
sean-k-mooneyand its expecting bytes?13:27
stephenfinbut I don't know why that's no okay13:27
sean-k-mooneyyou mean https://github.com/openstack/oslo.serialization/blob/master/oslo_serialization/jsonutils.py#L255-L27613:28
stephenfinat meetings for the day but I'll take a look over the week13:28
stephenfinbauzas: You think you could take a look at this today? https://review.opendev.org/#/c/662522/13:37
*** ociuhandu has joined #openstack-nova13:37
* bauzas clicks13:40
*** dave-mccowan has joined #openstack-nova13:41
bauzasstephenfin: ok, will look today13:41
*** yedongcan has left #openstack-nova13:47
*** stephenfin has left #openstack-nova13:49
*** stephenfin has joined #openstack-nova13:49
*** amoralej|lunch is now known as amoralej13:53
gibihm. If I change the test to load the content of the file first and then call jsonutils.loads() then it works13:57
gibi        with open(schema_file) as f:13:57
gibi            data = f.read()13:57
gibi        schema = jsonutils.loads(data)13:57
* gibi needs to get away from the keyboard for a while13:58
*** dave-mccowan has quit IRC14:06
openstackgerritBrian Rosmaita proposed openstack/nova master: Reject boot request for unsupported images  https://review.opendev.org/70773814:07
*** dave-mccowan has joined #openstack-nova14:10
*** lbragstad__ is now known as lbragstad14:15
*** lbragstad has quit IRC14:21
*** eharney has quit IRC14:22
openstackgerritBrian Rosmaita proposed openstack/nova master: Absolutely-non-inheritable image properties  https://review.opendev.org/70812614:28
*** Luzi has quit IRC14:30
*** vishalmanchanda has quit IRC14:32
*** links has quit IRC14:34
*** zhanglong has quit IRC14:36
*** nweinber has joined #openstack-nova14:42
*** larainema_ has joined #openstack-nova14:54
*** larainema_ is now known as larainema14:55
*** jhesketh has quit IRC14:55
*** artom has joined #openstack-nova14:56
*** jhesketh has joined #openstack-nova14:56
*** lbragstad has joined #openstack-nova15:02
openstackgerritArtom Lifshitz proposed openstack/nova master: func tests: move _run_periodics() into own mixin  https://review.opendev.org/70554515:04
openstackgerritArtom Lifshitz proposed openstack/nova master: tests: work around malformed serial XML  https://review.opendev.org/70554615:04
openstackgerritArtom Lifshitz proposed openstack/nova master: Functional tests for NUMA live migration  https://review.opendev.org/67259515:04
openstackgerritArtom Lifshitz proposed openstack/nova master: NUMA LM: Add func test for bug 1845146  https://review.opendev.org/68740415:04
openstackbug 1845146 in OpenStack Compute (nova) train "NUMA aware live migration failed when vCPU pin set" [High,Fix committed] https://launchpad.net/bugs/1845146 - Assigned to Dan Smith (danms)15:04
*** eharney has joined #openstack-nova15:05
openstackgerritBrian Rosmaita proposed openstack/nova master: Absolutely-non-inheritable image properties  https://review.opendev.org/70812615:14
*** efried has joined #openstack-nova15:15
openstackgerritBrian Rosmaita proposed openstack/nova master: Reject boot request for unsupported images  https://review.opendev.org/70773815:21
artomSo I guess something Fedora-specific is wrong with the stable/queens func tests?15:23
artomBecause locally I don't get the same failure as https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_c05/707887/1/check/nova-tox-functional-py35/c05109a/testr_results.html15:24
*** lpetrut has quit IRC15:29
*** rosmaita has joined #openstack-nova15:34
*** mlavalle has joined #openstack-nova15:34
rosmaitaalex_xu: gmann: need your opinion on whether https://review.opendev.org/#/c/707738/ will require a microversion bump15:34
*** efried has quit IRC15:37
*** efried has joined #openstack-nova15:37
*** nicolasbock has quit IRC15:38
sean-k-mooneyartom: the functional tests should not be os specific nor should any of the other tests really15:38
artomsean-k-mooney, I know, which is why it's so weird15:40
artomIn any case, it's a moot point15:40
artomBecause turns out my backport isn't applicable, and I got the root cause completely wrong15:40
artomSo back to square 1 for me, and I really don't feel like log diving15:40
artomBut no choice :(15:40
openstackgerritEric Fried proposed openstack/nova-specs master: Fixed minor suggestions  https://review.opendev.org/70805815:42
openstackgerritEric Fried proposed openstack/nova-specs master: Fixed minor suggestions  https://review.opendev.org/70805815:43
*** ccamacho has quit IRC15:58
*** ccamacho has joined #openstack-nova15:58
openstackgerritMerged openstack/nova master: Support large network queries towards neutron  https://review.opendev.org/70452016:04
*** ccamacho has quit IRC16:05
bauzasstephenfin: FWIW, have a comment https://review.opendev.org/#/c/662522/1716:06
bauzasstephenfin: just tell me when you see it and then I'll +W it16:06
stephenfinbauzas: Do you mean something more than I provided? https://review.opendev.org/#/c/662522/17/nova/tests/functional/libvirt/test_numa_servers.py16:07
sean-k-mooneyefried: regarding https://review.opendev.org/#/c/706276/ i can remove the changes related to the one ussuri spec that got pulled in but for the removal of the template, looking at the other releases we keep it in the root of the specs folder an remove it in the approve/implemented folder16:07
bauzasstephenfin: oh my bad16:07
bauzasstephenfin: lemme look at it16:07
bauzas(for some reason, I only saw the L169 modification)16:08
sean-k-mooneyefried: so i think removing the template is correct and the only issue with the auto generated patch was the spec that got finished in ussuri16:08
bauzasstephenfin: +W16:09
*** maciejjozefczyk has quit IRC16:09
sean-k-mooneyyay :) it will be nice to have ^ merged16:10
sean-k-mooneyalso very much https://review.opendev.org/#/c/663382/16:11
openstackgerritsean mooney proposed openstack/nova-specs master: move implemented spec for train  https://review.opendev.org/70627616:20
sean-k-mooneyefried: ^ i fixed the incorrect spec but left the deletion of the symlinks to the template. the teamplate is still n the root spec folder i just wont be listed in teh set of specs on the specs site under specific release16:22
stephenfinbauzas: Thanks :)16:30
bauzasstephenfin: again, apologies for missing it16:30
stephenfinit's all good16:30
stephenfinleast we know you and gibi think alike (he suggested adding it in the first place) ;)16:31
sean-k-mooneystephenfin: i have given up on unit test being enough anythime i go near numa at this point16:31
sean-k-mooneyi just always assume a new functional test will be needed16:32
stephenfinagreed16:34
efriedsean-k-mooney: Technically the reason to never delete anything without providing a redirect is in case there's a link to the old thing somewhere in the wild.16:36
efriedFor a template for $release I'm not super worried about it, really.16:37
efriedbut it's the Right Thing To Do16:37
*** N3l1x has joined #openstack-nova16:39
efriedsean-k-mooney: Cross-cell resize needs to not be moved to implemented for Train. So since a respin is needed, might as well add those redirects.16:45
efriedFor that matter, I'm really not convinced we need those templates in the directories in the first place. Maybe starting in V we can just drop them and just have specs/victoria-template.rst16:45
efriedor actually I would prefer specs/victoria/template.rst16:46
*** tbachman has joined #openstack-nova16:48
*** jmlowe has joined #openstack-nova16:52
*** rpittau is now known as rpittau|afk16:54
*** ivve has quit IRC16:58
sean-k-mooneyefried: sorry was in a meeting just saw your comments ya ill make those changes manually so and update the script in a seperate change17:02
sean-k-mooneyefried: and ya we dont need the templates in the directories17:02
sean-k-mooneyi think they were there to make copying them 1% simpler17:03
*** dtantsur is now known as dtantsur|afk17:03
*** jmlowe has quit IRC17:13
*** jmlowe has joined #openstack-nova17:15
*** udesale has quit IRC17:17
*** ociuhandu_ has joined #openstack-nova17:20
*** ccamacho has joined #openstack-nova17:20
*** dpawlik has quit IRC17:22
*** jmlowe has quit IRC17:22
efriedmelwitt: there's no code for nova-audit yet, right?17:23
*** ociuhandu has quit IRC17:24
dansmithgibi: I saw you +2d the bottom patch of the cyborg stuff but there's only +2s three patches up the stack17:24
dansmithgibi: are you comfortable with the whole stack now? I haven't circled back on all the resched stuff yet, but should I?17:25
*** ociuhandu_ has quit IRC17:25
dansmithsean-k-mooney: I don't suppose you've poked at the resched/move operations with the latest patch set yet have you?17:25
*** dklyle has joined #openstack-nova17:29
efriedbrinzhang: Are you taking over https://review.opendev.org/#/c/623120/ (safer remote console with password authentication)?17:30
efriedMore specifically the code here https://review.opendev.org/#/c/622336/ (last updated in May)17:30
*** factor has quit IRC17:30
*** evrardjp has quit IRC17:34
*** evrardjp has joined #openstack-nova17:34
openstackgerritMerged openstack/nova-specs master: FUP for NUMA Topology spec  https://review.opendev.org/70808817:39
openstackgerritMerged openstack/nova-specs master: Fixed minor suggestions  https://review.opendev.org/70805817:39
sean-k-mooneydansmith: no i have not. would you like me to prioitise that17:39
dansmithsean-k-mooney: well, I just figured since you had been doing testing with that stuff it'd be easier sooner than later17:40
dansmithI suppose we can get on with the set without knowing that and fix it later if it doesn't work it's just one of those things where if we're not going to be able to gate on it normally, it could just never get tested/fixed17:41
sean-k-mooneyok well i deploy 2 vms later today and set up the multi node env with the fake driver.17:42
dansmithsean-k-mooney: yeah doing it with the fake driver seems enough to make sure the plumbing is good at least17:44
sean-k-mooneycool ill do that so.17:45
dansmithsean-k-mooney: is it possible that hacking some multi-node-ness on top of the tempest test patch in this set would be worthwhile for gating?17:45
sean-k-mooneywell i can just run the standard tempest multinode test with a cyborg flavor17:45
sean-k-mooneyi could proably hack up an experimtal job to do that17:46
sean-k-mooneybut im not sure if that is worth it or not17:46
sean-k-mooneyi guess i could add tests to the plugin17:46
*** ociuhandu has joined #openstack-nova17:51
*** mvkr has quit IRC17:52
efriedlyarwood: virt-bfv-instance-rescue -- what state is this code in? Would you say ready for review?17:54
efriedhttps://review.opendev.org/#/q/topic:bp/virt-bfv-instance-rescue+status:open17:54
*** cz3 is now known as tequilasunset17:55
*** tequilasunset is now known as cz317:56
openstackgerritMerged openstack/nova master: Recalculate 'RequestSpec.numa_topology' on resize  https://review.opendev.org/66252217:59
*** ociuhandu has quit IRC18:00
*** derekh has quit IRC18:00
*** ircuser-1 has joined #openstack-nova18:01
*** tesseract has quit IRC18:02
*** ociuhandu has joined #openstack-nova18:05
*** rcernin has quit IRC18:06
*** mordred has quit IRC18:06
efriedkashyap: What's the state of https://review.opendev.org/#/q/topic:bp/allow-secure-boot-for-qemu-kvm-guests+status:open ?18:06
*** klippo has quit IRC18:07
*** mordred has joined #openstack-nova18:09
*** jmlowe has joined #openstack-nova18:09
gibidansmith: I will check the cyborg series tomorrow18:10
*** martinkennelly has quit IRC18:14
*** jmlowe has quit IRC18:19
*** rcernin has joined #openstack-nova18:20
*** jmlowe has joined #openstack-nova18:24
*** jmlowe has quit IRC18:27
*** jmlowe has joined #openstack-nova18:29
openstackgerritEric Fried proposed openstack/nova-specs master: Move 'live migration with vpmems' spec  https://review.opendev.org/70822918:30
*** larainema has quit IRC18:30
efriedlyarwood: what about this one https://review.opendev.org/#/q/topic:bp/virt-rescue-stable-disk-devices+status:open18:37
*** ociuhandu has quit IRC18:40
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing evacuate policies  https://review.opendev.org/70823018:41
*** ociuhandu has joined #openstack-nova18:41
*** jmlowe has quit IRC18:41
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing evacuate policies  https://review.opendev.org/70823018:41
efrieddustinc: checking in on provider config.18:41
*** ociuhandu has quit IRC18:47
*** klippo has joined #openstack-nova18:47
melwittefried: no code yet18:49
efriedthx18:49
*** mvkr has joined #openstack-nova18:51
*** amoralej is now known as amoralej|off18:52
*** ralonsoh has quit IRC18:55
dansmithgibi: aight18:59
*** jmlowe has joined #openstack-nova19:00
dansmithefried: do you know enough about zuul things to guess at how difficult it would be to make the cyborg job run with multiple nodes?19:00
dansmithit's been a long time since I've had to look at this stuff, and things have evolved way out of my scope of understanding19:00
dansmithI'm wondering if it's tied to n-cpu enough that just spinning up another node where n-cpu will be installed would be enough to properly configure the cyborg bits?19:01
efrieddansmith: Sorry, no, I would probably ask sean-k-mooney's help if I had to go there.19:01
dansmithyeah, trying not to just depend on him for everything :D19:01
efrieddepending on me for anything might not be the best strategy either.19:02
sean-k-mooneydansmith: making the job multinode is just changing the nodeset and then for the subnode defining sliktly differnet setting in the local.conf19:05
sean-k-mooneydansmith: the cyborg devstack plugin appartly support multi node so when i get it stackted that way locally i can try and push a patch on top of the current cyborg tempest patch that deploys it multi node19:06
dansmithsean-k-mooney: okay I was just about to look through the cyborg devstack stuff before  my call just now to see, but good to know19:07
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing evacuate policies  https://review.opendev.org/70823019:07
sean-k-mooneywe basically just have to disabel the cyborg conductor and api services so that it just install the cyborg agent19:07
dansmithyeah, I figured.. do they not look at n-cpu to determine whether or not they should install the other things? I would think that would be a reasonable sentinel19:08
dansmithunless they really want to be able to be installed in isolation19:08
openstackgerritGhanshyam Mann proposed openstack/nova master: Introduce scope_types in os-evacuate  https://review.opendev.org/70823519:14
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in os-evacuate policies  https://review.opendev.org/70823719:20
*** maciejjozefczyk has joined #openstack-nova19:22
*** mvkr has quit IRC19:32
*** maciejjozefczyk_ has joined #openstack-nova19:32
*** maciejjozefczyk has quit IRC19:33
*** jmlowe has quit IRC19:37
*** maciejjozefczyk has joined #openstack-nova19:38
*** maciejjozefczyk_ has quit IRC19:40
*** klippo has quit IRC19:46
*** openstackstatus has quit IRC19:49
*** maciejjozefczyk_ has joined #openstack-nova19:52
*** maciejjozefczyk has quit IRC19:54
*** jaosorior has quit IRC20:02
*** ociuhandu has joined #openstack-nova20:04
*** ociuhandu has quit IRC20:09
*** hoonetorg has quit IRC20:14
*** hoonetorg has joined #openstack-nova20:18
*** klippo has joined #openstack-nova20:20
*** maciejjozefczyk_ has quit IRC20:36
*** maciejjozefczyk has joined #openstack-nova20:37
*** ociuhandu has joined #openstack-nova20:42
*** eharney has quit IRC20:43
*** nicolasbock has joined #openstack-nova20:43
*** ociuhandu has quit IRC20:45
*** ociuhandu has joined #openstack-nova20:45
*** ociuhandu has quit IRC20:51
*** prometheanfire has joined #openstack-nova20:52
prometheanfirereqs update causing issues, might be mock https://review.opendev.org/#/c/707064/20:52
prometheanfirehttps://review.opendev.org/#/c/708232 is how octavia solved it20:52
sean-k-mooneyprometheanfire: whats the backport candiate lable in gerrit? is that new20:56
prometheanfireya, first time I've seen it20:57
sean-k-mooneyi wonder if that is enforced anyway e.g. will it prevent you form cherry picking or something20:57
sean-k-mooneyif not im not sure its very useful20:57
sean-k-mooneyalthough it might be20:57
*** mlavalle has quit IRC21:01
efriedprometheanfire: are we really going to fix this, rather than letting mock fix self and blacklisting 4.0.1?21:03
prometheanfireefried: talking about mock?  Is there an upstream bug you are talking about?21:06
efriedprometheanfire: Yes. Don't know, would assume if it breaks half a dozen openstack projects that we know of, there will be, or there should be.21:07
sean-k-mooneyby the way now that we using python3 only is there any reason to keep using mock the lib21:07
sean-k-mooneywe should be able to drop it as a dep an just use the standard lib version now21:08
prometheanfiresean-k-mooney: good point, but that's on the projects themselves :P21:08
sean-k-mooneysure i was asking more for nova21:09
efriedsean-k-mooney: I don't even know how we would do that. Can you propose a patch?21:09
efriedsean-k-mooney: Like, how would we prevent picking up transitive deps etc?21:09
*** nweinber has quit IRC21:09
sean-k-mooneyya so i dont know if we could prevent it21:09
sean-k-mooneybut we could just stop listing it in our test requirements21:10
sean-k-mooneyeventurally if we got all the project to do that we would stop using it21:10
efriedprometheanfire: At a quick look, there are on the order of a hundred uses of mock spec in nova. I would rather find a better way to fix this than hacking dir() into each of them (and it *is* a hack).21:10
efriedsean-k-mooney: since it's in the test env, hopefully projects only have it in their test-requirements, which *should* mean the only transitive deps we would have to worry about would be things like oslotest. But... no idea.21:11
prometheanfireefried: if upstream considers it a bug (aka, they plan on fixing something) we can blacklist 4.0.0/4.0.121:12
prometheanfireotherwise we are in denial21:12
efriedprometheanfire: okay, that was going to be my next question: also broken in 4.0.0?21:12
prometheanfireefried: not sure, this jumped over it, but I imagine it has the same issue21:12
sean-k-mooneyya so os-vif does not use it as far as i know. ill remove it if it does. os-brick might but other then that the only other poject nova really depends on is oslo21:12
sean-k-mooneyi guess hacking also21:13
efriedprometheanfire: okay, so we need to make sure an upstream issue is opened. They may kill it, but at least the path would be clear. If you don't know of one already, or know of someone who would know, I can go digging...21:13
efriedjohnsom: ^ ?21:14
johnsomReading scroll back21:14
efriedmeanwhile I'll try a local build with mock removed from reqs and see if the venv still installs it...21:14
sean-k-mooneyya so bunch of oslo libs use it21:15
sean-k-mooneyhttp://codesearch.openstack.org/?q=mock&i=nope&files=test-requirements.txt&repos=openstack/oslo-cookiecutter,openstack/oslo-specs,openstack/oslo.cache,openstack/oslo.concurrency,openstack/oslo.config,openstack/oslo.context,openstack/oslo.db,openstack/oslo.i18n,openstack/oslo.limit,openstack/oslo.log,openstack/oslo.messaging,openstack/oslo.middleware,openstack/oslo.policy,openstack/oslo.privsep,opensta21:15
sean-k-mooneyck/oslo.reports,openstack/oslo.rootwrap,openstack/oslo.serialization,openstack/oslo.service,openstack/oslo.tools,openstack/oslo.upgradecheck,openstack/oslo.utils,openstack/oslo.versionedobjects,openstack/oslo.vmware,openstack/oslotest21:15
efriedf21:15
*** jmlowe has joined #openstack-nova21:15
johnsombackport candidate is a tool the Octavia cores are using to track patches for backport to stable branches. We added that for our repos.21:15
johnsomSince.... Storyboard......  Enough said21:16
efriedjohnsom: I was poking you about whether there's a known bug opened against mock for this21:16
sean-k-mooneyefried: what we could do is update the requriements file only install mock on python221:16
johnsomefried I burned my morning trying to fix a cause and or fix for this. No luck. I'm also not sure this is the same issue your project has with the UC changes.21:17
sean-k-mooneywe would then need to update all the projects.21:17
efriedsean-k-mooney: not sure that helps,21:17
efriedBut taking that idea...21:17
efriedIt might be possible to say21:17
efriedmock;python!=3.xx21:17
efriedjohnsom: yeah, valid point, I didn't actually look.21:17
*** maciejjozefczyk has quit IRC21:17
johnsomWe are having the same discussion, whether we should be using this package or reverting to the built-in now.21:17
sean-k-mooneyya so we have a way to match based on python version in the  requeriments file already21:17
efriedwell, fwiw, simply removing mock from test-requirements didn't stop it from installing in the venv. Imagine we would have to yank it from oslotest and oslo.vmware at least.21:18
sean-k-mooneyefried: i can ask the requirements folk about it tomorrow seperate form the current disucssion21:18
sean-k-mooneyefried: yes we would21:18
sean-k-mooneyefried: if you mannually remove it form the enve does it resovel the issue21:19
efriedright -- prometheanfire fyi ^ unless you know a way we can explicitly prevent mock from installing, we'll still get it from transitive if we just remove it from our own test-requirements.21:19
johnsomAgreed, it is a total hack, but it was only in "legacy" code for us, so we were like....  good enough, it's going to die anyway.21:19
prometheanfireheh, that's a good point21:20
*** artom has quit IRC21:20
prometheanfireefried: I don't know of one yet21:20
efriedjohnsom: I totally wasn't judging you btw :P21:21
sean-k-mooneyprometheanfire: have you confirmed if removing the lib version resolved the issue21:21
sean-k-mooneyalso what is the issue?21:21
efriedhttps://ad2781ccb869c0ef3e99-0fce708e89812c28d28e2be1213f1c9b.ssl.cf5.rackcdn.com/707064/10/check/cross-nova-py36/d1c7fa6/testr_results.html21:22
prometheanfireI don't have a link to an issue yet, this is bigger than I first though that it was21:22
johnsomYeah, your logs don't look like the same issue we had21:22
sean-k-mooney"ValueError: Sentinels must not start with _" ?21:23
johnsomAh, ok, some are kind of similar21:23
johnsomYeah, that appears to be on a "spec" mock21:23
prometheanfireheh https://github.com/testing-cabal/mock/pull/48221:23
sean-k-mooneyright so we could just replace all uses of import mock with import unittest.mock?21:25
sean-k-mooneyto get rid of the dep on mock the lib21:25
efried"just"21:25
sean-k-mooneyif we wanted too in the futrue and add a hacking check21:25
sean-k-mooneyefried: its hopefully 1 sed command but yes21:26
sean-k-mooneyit could explode21:26
efried384 occurrences.21:26
prometheanfirewell, there's a way to find out I guess21:27
efriedyeah, working on it.21:28
sean-k-mooneythere has been a long standing issue in nova where we cant use self.assertRaises as a context manager in a with statement which im pretty sure is caused by mock the lib by the way whic this might also fix21:28
efriedprometheanfire, sean-k-mooney, johnsom: so yeah, that fixes it, at least for the one instance I tried.21:29
efrieds/^import mock$/from unittest import mock/21:29
prometheanfireheh21:29
johnsomHmmm, so tempting..... grin21:29
sean-k-mooneycan you do that for all nova and see if the tests still run21:29
johnsomYeah, I think I will try that too21:29
efriedsean-k-mooney: yeah but I'm not gonna run locally.21:30
efriedMy laptop will burn a hole to the center of the earth.21:30
efriedI'll let zuul do it.21:30
sean-k-mooneyok21:30
johnsomIt's a mock revolt. lol21:30
sean-k-mooneyif it does have issue i guess we could just do it selectivly to solve the issues we currently have until either mock is fixt or we fix the issues  we find21:31
efriedsean-k-mooney: the sed command works fine... except for the pep8 requirement to sort imports :P21:32
sean-k-mooneyautopep8 might fix that for you21:32
sean-k-mooneyunlike black it only fixes the minium amount of stuff to pass pep821:32
sean-k-mooneyso it does not break the worlds and passes our gate21:33
sean-k-mooneyanyway we coudl cross that bridge when we see if it even passes the zuul run21:33
efriedprometheanfire: having proven this is a bug in the mock library, are you more convinced that we should blacklist the mock versions?21:37
sean-k-mooneygot to love that commit message https://github.com/testing-cabal/mock/commit/9e5e0380626fd3c540aa4799df0e794cf24d16aa21:38
prometheanfireefried: ya, kinda sucks, but ok21:38
openstackgerritEric Fried proposed openstack/nova master: WIP: Use stock mock  https://review.opendev.org/70826221:38
*** mvkr has joined #openstack-nova21:38
efriedprometheanfire: if you want to try making your patch dep on ^ ...21:38
*** eharney has joined #openstack-nova21:39
efriedsean-k-mooney: --^21:39
johnsomYeah, octavia seems to pass fine with the native mock21:39
efriedo queso we need a bug against mock21:39
efriedam I reading this right that there are zero open issues?21:40
efriedam I looking at the right repo?21:40
sean-k-mooneyand 404 closed21:40
johnsomZero for that repo21:40
johnsomThough they pull in from the native bugs too21:41
sean-k-mooneyi guess they just fix them quickly or close them as wont fix21:41
prometheanfireefried: well, for me I'm blacklisting on the reqs side, not nova side21:41
sean-k-mooneye.g. they dont leave them open for log21:41
sean-k-mooney*long21:41
efriedprometheanfire: I assume we would like to be able to continue following upgrades here, given that trying to fix the transitive deps through all of openstack would be hard and take long. So we should still open an issue for this. Agree?21:43
sean-k-mooneyefried: if it broke us it will proably break others21:44
sean-k-mooneyso its worth reporting in any case21:44
prometheanfireefried: ya, definitely21:44
*** xek has quit IRC21:45
efriedprometheanfire, sean-k-mooney, johnsom: https://github.com/testing-cabal/mock/issues/48721:46
*** nicolasbock has quit IRC21:46
prometheanfirewatching, thanks21:47
prometheanfireI'll submit a blacklist review to the reqs repo in a few min21:47
prometheanfiresubmitted and updated the gr update review21:54
sean-k-mooneyoh looking at that traceback this looks like our error21:54
sean-k-mooneythe reason its passing on python 3.7 is _is_coroutine was likely added by python 3.821:55
efriedjohnsom: want to throw https://zuul.opendev.org/t/openstack/build/c5fd6cadc9bf4b3b9ea81372ef047246/log/job-output.txt#4605 in there?21:56
efriedsean-k-mooney: what do you mean passing on py37? It failed locally for me on py3721:56
sean-k-mooneywith unittest.mock21:57
johnsomYeah, I can21:57
*** ociuhandu has joined #openstack-nova22:00
sean-k-mooneyefried: basiacly i think we are asserting that that the attibute does not start with _ incorrectly here https://github.com/openstack/oslo.utils/blob/master/oslo_utils/fixture.py#L81-L8222:04
sean-k-mooneyor actully no maybe that is not the issue22:04
sean-k-mooneythat is where the exctip is being raised but i have looked at why we are calling that code22:05
efriedyeah, the issue is that the wrong `name` is now getting to that point.22:05
efriedprobably '_AutoSpecMagicMock' as opposed to the name of the actual sentinel.22:05
sean-k-mooneyya22:06
sean-k-mooneyso i was wondering is this a change in python 3.822:06
*** ociuhandu has quit IRC22:06
sean-k-mooneythat they have now backported to mock the lib22:06
sean-k-mooneyor is it a mock the lib issue22:07
efriedsean-k-mooney: do you have 3.8 installed somewhere? Easy enough to try it out.22:07
efriedJust22:08
efried.tox/py38/bin/pip install -U mock22:08
efriedand run nova.tests.unit.virt.libvirt.test_host.HostTestCase22:08
efried...with stock/lib mock22:08
sean-k-mooneymock the lib give you the py38 behavior on all python versions22:09
sean-k-mooneyand i might let me check22:10
sean-k-mooneyim wonder if its related to https://bugs.python.org/issue39082 or https://bugs.python.org/issue3948522:12
*** efried has quit IRC22:12
*** efried has joined #openstack-nova22:15
*** adrianc has quit IRC22:15
*** lennyb has quit IRC22:17
*** adrianc has joined #openstack-nova22:17
*** slaweq has quit IRC22:17
*** lennyb has joined #openstack-nova22:20
*** nweinber has joined #openstack-nova22:23
*** jmlowe has quit IRC22:27
*** nweinber has quit IRC22:34
*** jmlowe has joined #openstack-nova22:36
*** jmlowe has quit IRC22:53
*** tkajinam has joined #openstack-nova22:59
*** tkajinam has quit IRC22:59
*** tkajinam has joined #openstack-nova23:01
*** openstackstatus has joined #openstack-nova23:02
*** ChanServ sets mode: +v openstackstatus23:02
*** igordc has joined #openstack-nova23:03
*** slaweq has joined #openstack-nova23:11
sean-k-mooneyefried: regarding https://review.opendev.org/#/c/702451/10 the conenction to the nova net removal is that stephenfin removed the nova.network.api modules earlier in the series and now image module was the only  one with a .api module so stephenfin wrote that patch to make them all consitent23:15
sean-k-mooneyefried: but ya it confused the hell out of me too at first23:15
sean-k-mooneyalso i jsut realised what time it is so o/ night all23:15
*** slaweq has quit IRC23:16
*** ociuhandu has joined #openstack-nova23:30
*** ociuhandu has quit IRC23:35
*** mvkr has quit IRC23:38
*** artom has joined #openstack-nova23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!