Wednesday, 2019-03-27

*** erlon has joined #openstack-nova00:07
openstackgerritTakashi NATSUME proposed openstack/nova master: Add a live migration regression test  https://review.openstack.org/64120000:09
*** takashin has joined #openstack-nova00:10
*** stakeda has quit IRC00:13
*** tetsuro has joined #openstack-nova00:18
*** slaweq has joined #openstack-nova00:22
*** dustinc has quit IRC00:25
*** slaweq has quit IRC00:27
*** igordc has quit IRC00:48
*** markvoelker has joined #openstack-nova00:51
*** zhubx has quit IRC00:53
*** zhubx has joined #openstack-nova00:53
*** ileixe has joined #openstack-nova00:54
*** ileixe has quit IRC00:54
*** ileixe has joined #openstack-nova00:55
*** Sundar has quit IRC00:56
openstackgerritMagnus Bergman proposed openstack/nova master: Fix bug preventing forbidden traits from working  https://review.openstack.org/64795700:59
tridentmriedem: Found the issue with forbidden flavor traits. See bug #1821824 and the proposed fix above ^01:02
openstackbug 1821824 in OpenStack Compute (nova) "Forbidden traits in flavor properties don't work" [Undecided,In progress] https://launchpad.net/bugs/1821824 - Assigned to Magnus Bergman (magnusbe)01:02
*** awalende has joined #openstack-nova01:02
*** markvoelker has quit IRC01:03
*** awalende has quit IRC01:07
*** tiendc has joined #openstack-nova01:07
*** wolverineav has quit IRC01:08
openstackgerritTakashi NATSUME proposed openstack/nova master: doc: Capitalize keystone domain name  https://review.openstack.org/64797201:38
openstackgerrityenai proposed openstack/nova master: Disconnect volume when encryption is failed  https://review.openstack.org/63259801:47
*** rcernin has quit IRC01:49
*** rcernin has joined #openstack-nova01:53
*** erlon has quit IRC01:53
*** hongbin has joined #openstack-nova01:54
*** whoami-rajat has joined #openstack-nova02:08
*** mgagne has quit IRC02:15
*** mgagne has joined #openstack-nova02:15
yonglihealex_xu: please mark -1 for me, thanks everyone to stop by. https://review.openstack.org/#/c/627765/02:24
openstackgerritMerged openstack/nova master: Add a reference PTL guide to the contributor docs  https://review.openstack.org/64785402:25
*** gbarros has joined #openstack-nova02:30
*** wolverineav has joined #openstack-nova02:34
*** psachin has joined #openstack-nova02:51
openstackgerritGhanshyam Mann proposed openstack/nova master: WIP: Make os-services policies granular  https://review.openstack.org/64542702:52
*** gbarros has quit IRC03:00
*** hongbin has quit IRC03:06
*** wolverineav has quit IRC03:08
*** wolverineav has joined #openstack-nova03:23
openstackgerritMerged openstack/nova master: Fix JsonFilter query hint examples in docs  https://review.openstack.org/64777803:45
openstackgerritMerged openstack/nova master: Document a warning about using the JsonFilter  https://review.openstack.org/64779603:45
*** udesale has joined #openstack-nova03:46
*** wolverineav has quit IRC03:49
*** wolverineav has joined #openstack-nova03:50
*** wolverineav has quit IRC03:54
*** tetsuro has quit IRC03:58
*** ileixe has quit IRC04:11
openstackgerritMichael Still proposed openstack/nova master: Privsepify ipv4 forwarding enablement.  https://review.openstack.org/63543104:38
openstackgerritMichael Still proposed openstack/nova master: Remove unused FP device creation and deletion methods.  https://review.openstack.org/63543304:38
openstackgerritMichael Still proposed openstack/nova master: Privsep the ebtables modification code.  https://review.openstack.org/63543504:38
openstackgerritMichael Still proposed openstack/nova master: Move adding vlans to interfaces to privsep.  https://review.openstack.org/63543604:39
openstackgerritMichael Still proposed openstack/nova master: Move iptables rule fetching and setting to privsep.  https://review.openstack.org/63650804:39
openstackgerritMichael Still proposed openstack/nova master: Move dnsmasq restarts to privsep.  https://review.openstack.org/63928004:39
openstackgerritMichael Still proposed openstack/nova master: Move router advertisement daemon restarts to privsep.  https://review.openstack.org/63928104:39
openstackgerritMichael Still proposed openstack/nova master: Move calls to ovs-vsctl to privsep.  https://review.openstack.org/63928204:39
openstackgerritMichael Still proposed openstack/nova master: Move setting of device trust to privsep.  https://review.openstack.org/63928304:39
openstackgerritMichael Still proposed openstack/nova master: Move final bridge commands to privsep.  https://review.openstack.org/63958004:39
openstackgerritMichael Still proposed openstack/nova master: Cleanup the _execute shim in nova/network.  https://review.openstack.org/63958104:39
openstackgerritMichael Still proposed openstack/nova master: We no longer need rootwrap.  https://review.openstack.org/55443804:39
openstackgerritMichael Still proposed openstack/nova master: Cleanup no longer required filters and add a release note.  https://review.openstack.org/63982604:39
*** udesale has quit IRC04:44
*** cfriesen has quit IRC04:46
*** udesale has joined #openstack-nova04:46
*** janki has joined #openstack-nova04:50
*** psachin has quit IRC04:58
*** ileixe has joined #openstack-nova05:08
*** tetsuro has joined #openstack-nova05:18
*** psachin has joined #openstack-nova05:19
*** lbragstad has joined #openstack-nova05:25
openstackgerritTakashi NATSUME proposed openstack/nova master: Add a live migration regression test  https://review.openstack.org/64120005:38
*** lbragstad has quit IRC05:41
*** ratailor has joined #openstack-nova05:41
openstackgerritBoxiang Zhu proposed openstack/nova master: [WIP] Scheduler filters evaluated even forced host  https://review.openstack.org/64552005:57
*** alex_xu has quit IRC06:23
*** jaosorior has quit IRC06:26
*** jaosorior has joined #openstack-nova06:28
*** alex_xu has joined #openstack-nova06:29
*** markvoelker has joined #openstack-nova06:31
*** liuyulong has joined #openstack-nova06:32
*** jistr is now known as jistr|doc06:33
openstackgerritBoxiang Zhu proposed openstack/nova-specs master: Scheduler filters evaluated even forced host  https://review.openstack.org/64545806:51
*** avolkov has joined #openstack-nova07:18
*** slaweq has joined #openstack-nova07:20
*** dpawlik has quit IRC07:20
openstackgerritMerged openstack/nova stable/ocata: Drop legacy-grenade-dsvm-neutron-multinode-live-migration  https://review.openstack.org/64021907:23
openstackgerritYongli He proposed openstack/nova master: Clean up orphan instances  https://review.openstack.org/62776507:23
openstackgerritBoxiang Zhu proposed openstack/python-novaclient master: [WIP] Add force_scheduler in boot instance  https://review.openstack.org/64767107:26
*** rpittau|afk is now known as rpittau07:35
*** ivve has joined #openstack-nova07:47
*** liuyulong_ has joined #openstack-nova07:51
*** liuyulong has quit IRC07:54
*** luksky has joined #openstack-nova08:03
*** liuyulong_ has quit IRC08:04
*** takashin has left #openstack-nova08:06
*** tesseract has joined #openstack-nova08:13
*** awalende has joined #openstack-nova08:16
*** tkajinam has quit IRC08:16
*** tosky has joined #openstack-nova08:17
*** dtantsur|afk is now known as dtantsur08:32
*** dpawlik has joined #openstack-nova08:37
*** ccamacho has joined #openstack-nova08:38
*** helenafm has joined #openstack-nova08:44
*** sridharg has quit IRC08:54
*** sridharg has joined #openstack-nova08:56
*** pcaruana has joined #openstack-nova08:57
*** ttsiouts has joined #openstack-nova09:00
openstackgerritBoxiang Zhu proposed openstack/python-novaclient master: [WIP] Add force_scheduler in boot instance  https://review.openstack.org/64767109:00
openstackgerritAbhishek Kekane proposed openstack/nova-specs master: Support multiple backend of Glance  https://review.openstack.org/64121009:01
*** ttsiouts has quit IRC09:10
*** tetsuro has quit IRC09:12
*** ttsiouts has joined #openstack-nova09:13
*** jistr|doc is now known as jistr09:15
*** priteau has joined #openstack-nova09:16
*** tssurya has joined #openstack-nova09:18
*** dr_gogeta86 has joined #openstack-nova09:38
*** derekh has joined #openstack-nova09:39
*** davidepanarese_ has joined #openstack-nova09:40
davidepanarese_Hello everyone09:40
*** ralonsoh has joined #openstack-nova09:42
davidepanarese_anyone knows if automatic rescan of cinder external volume using ceph in nova will be implemented? Or better, is already exists a method to rescan virtio drives (ceph volumes) into kvm virtual machine after a live volume resize?09:44
openstackgerritSurya Seetharaman proposed openstack/nova-specs master: Support adding the reason behind a server lock  https://review.openstack.org/63862909:48
openstackgerritBalazs Gibizer proposed openstack/nova master: Reproduce bug #1819460 in functional test  https://review.openstack.org/64244409:49
openstackbug 1819460 in OpenStack Compute (nova) "instance stuck in BUILD state due to unhandled exceptions in conductor" [Low,In progress] https://launchpad.net/bugs/1819460 - Assigned to Balazs Gibizer (balazs-gibizer)09:49
openstackgerritBalazs Gibizer proposed openstack/nova master: Handle placement error during re-schedule  https://review.openstack.org/63960809:49
openstackgerritBalazs Gibizer proposed openstack/nova master: Reproduce bug #1819460 in functional test  https://review.openstack.org/64244409:57
openstackbug 1819460 in OpenStack Compute (nova) "instance stuck in BUILD state due to unhandled exceptions in conductor" [Low,In progress] https://launchpad.net/bugs/1819460 - Assigned to Balazs Gibizer (balazs-gibizer)09:57
openstackgerritBalazs Gibizer proposed openstack/nova master: Handle placement error during re-schedule  https://review.openstack.org/63960809:57
openstackgerritMerged openstack/nova master: Add functional recreate test for bug 1819963  https://review.openstack.org/64315110:03
openstackbug 1819963 in OpenStack Compute (nova) "Reverting a resize does not update the instance.availability_zone value to the source az" [Medium,In progress] https://launchpad.net/bugs/1819963 - Assigned to Matt Riedemann (mriedem)10:03
openstackgerritSurya Seetharaman proposed openstack/nova-specs master: Support adding the reason behind a server lock  https://review.openstack.org/63862910:05
*** dpawlik has quit IRC10:34
*** dpawlik has joined #openstack-nova10:35
*** tbachman has quit IRC10:41
fricklerdavidepanarese_: there is this recent patch that iiuc should handle your use case https://review.openstack.org/61303910:43
*** kaisers has quit IRC10:47
*** kaisers has joined #openstack-nova10:49
*** mvkr has joined #openstack-nova10:51
*** rcernin has quit IRC10:51
*** tiendc has quit IRC10:51
*** IvensZambrano has joined #openstack-nova10:53
*** hughsaunders has quit IRC11:03
*** zbr|ssbarnea has quit IRC11:06
*** zbr has joined #openstack-nova11:08
*** cdent has joined #openstack-nova11:08
*** IvensZambrano has quit IRC11:15
openstackgerritSilvan Kaiser proposed openstack/nova master: Adds systemd detection result caching in Quobyte driver  https://review.openstack.org/64809311:18
kaisersmdbooth_: thanks for looking into https://review.openstack.org/#/c/554195/28 . Could you update your -1 if you're fine with the follow up as proposed?11:32
*** ratailor has quit IRC11:37
*** davidepanarese_ has quit IRC11:59
openstackgerritzhaixiaojun proposed openstack/nova master: Remove flavor id and name validation code because of jsonschema validation.  https://review.openstack.org/63815012:04
*** tbachman has joined #openstack-nova12:05
*** tbachman has quit IRC12:09
*** tbachman has joined #openstack-nova12:13
*** avolkov has quit IRC12:18
*** markvoelker has quit IRC12:21
*** mchlumsky has joined #openstack-nova12:22
openstackgerritStephen Finucane proposed openstack/nova stable/queens: [Stable Only] hardware: Handle races during pinning  https://review.openstack.org/64783112:30
*** liuyulong_zzzZ is now known as liuyulong12:31
*** mvkr has quit IRC12:37
*** pcaruana has quit IRC12:39
*** cdent has quit IRC12:40
*** pcaruana has joined #openstack-nova12:42
*** pcaruana has quit IRC12:42
*** pcaruana has joined #openstack-nova12:43
*** mdbooth_ is now known as mdbooth12:44
mdboothkaisers: Sure. As I said though, the only thing I was -1 about was the comment. If you stick that in the follow-on I'll happily update, esp as you can keep the +2 from stephenfin.12:45
*** lbragstad has joined #openstack-nova12:46
*** udesale has quit IRC12:48
*** udesale has joined #openstack-nova12:49
kaisersmdbooth: ok, will do :)12:50
*** gbarros has joined #openstack-nova12:51
*** gbarros has quit IRC12:51
*** itlinux has quit IRC12:57
*** ileixe has quit IRC13:04
*** jhesketh has quit IRC13:10
*** mvkr has joined #openstack-nova13:12
*** gbarros has joined #openstack-nova13:14
*** eharney has joined #openstack-nova13:23
openstackgerritFrançois Palin proposed openstack/nova master: WIP - nova diagnostics command is not working with all interfaces  https://review.openstack.org/64812313:30
openstackgerritSilvan Kaiser proposed openstack/nova master: Adds systemd detection result caching in Quobyte driver  https://review.openstack.org/64809313:36
kaisersmdbooth: done----^13:38
mdboothkaisers: Meh, my preference is for long form, but it works13:43
mdboothkaisers: Updated, thanks!13:44
*** priteau has quit IRC13:44
kaisersmdbooth: thanks for looking into this13:52
*** hongbin has joined #openstack-nova13:56
*** mlavalle has joined #openstack-nova14:01
*** igordc has joined #openstack-nova14:03
*** cdent has joined #openstack-nova14:19
*** itlinux has joined #openstack-nova14:27
openstackgerritsean mooney proposed openstack/nova-specs master: add spec for image metadata prefiltering  https://review.openstack.org/64757814:27
*** janki has quit IRC14:41
*** munimeha1 has joined #openstack-nova14:45
*** priteau has joined #openstack-nova14:46
*** awaugama has joined #openstack-nova14:47
*** derekh has quit IRC14:53
*** ratailor has joined #openstack-nova14:54
bauzascores, https://review.openstack.org/#/c/647519/ is a RC potential https://etherpad.openstack.org/p/nova-stein-rc-potential14:54
openstackgerritDan Smith proposed openstack/os-traits master: Add IMAGE_TYPE_SUPPORT_* traits  https://review.openstack.org/64814714:56
*** cfriesen has joined #openstack-nova15:01
openstackgerritSylvain Bauza proposed openstack/nova master: Refactor CONTRIBUTING.rst  https://review.openstack.org/64097015:01
efriedbauzas, dansmith: Should we be cutting an RC2 just for a doc?15:03
bauzasefried: well, maybe not15:04
efriedI don't think there's anything else we would be including15:04
dansmithno15:04
efriedsean-k-mooney's lower-constraints fix is on the list15:04
bauzaswe should be just merging it now for master15:04
bauzasthen I'd backport it to stein15:04
efried++15:04
dansmithafter ga15:04
bauzasbut it could be not needing a RC215:04
efried...but the lower-constraints thing has been busted for a while.15:04
bauzasso +W the stein backport after GA15:04
bauzasunless we find other bugs15:04
bauzasand then we could merge it with the other fixes15:05
bauzasbut yeah, not needing a RC2 just for it15:05
*** awalende has quit IRC15:11
*** artom has quit IRC15:11
*** awalende has joined #openstack-nova15:12
tridentcdent: Are you around to answer a couple of questions about the implementation of forbidden traits?15:15
*** awalende has quit IRC15:16
cdenttrident: I am around, either here or in #openstack-placement. Not promising I'll be able to help15:16
efriedtrident: Is this about https://review.openstack.org/647957 ?15:17
tridentcdent: I am working on an issue that prevents forbidden traits in flavors from being acted upon: https://review.openstack.org/#/c/647957/ While working on some tests I found that traits of the trait:CUSTOM_FOO=forbidden in image properties doesn't seem to work either. Is that expected or should they work both for flavors and images?15:19
tridentefried: Yup.15:19
efriedgibi: if you're around, you may want to join in ^15:19
* gibi is present15:19
cdenttrident: is the issue that the wrong request is built and sent to placement, or that placement is behaving incorrectly with a valid request?15:20
efriedMm, I don't remember whether we have implemented support for traits (positive or negative) coming from image props yet.15:20
gibiefried: did we ever said that forbidden trait support is a thing in nova? in placement I know that it is a thing15:20
sean-k-mooneyefried: bauzas well my lower constraitn fix is not complete15:20
gibiefried: similarly placement had support for nested a_c for a while but nova need a lot of adaptation to use it15:21
tridentefried: The wrong request is sent to placement.15:21
efriedsean-k-mooney: I suspect that would be a clusterf*** to backport in any case, so we may want to consider just fixing it in master and moving on.15:21
tridentThis is the commit implementing it: https://github.com/openstack/nova/commit/2c51688558504f2e8ce80bac06642772be67b2a915:21
efriedtrident: Yup, that looks like it's pulling from flavor extra_specs; do you have any evidence that we did same for image props?15:22
tridentSorry, cdent:  The wrong request is sent to placement.15:22
sean-k-mooneyefried: ya. the main thing i need to figure out is where the mocking of rabbitmq is borked so that we use the fake message bus when running the unit tests in all cases15:22
efriedsean-k-mooney: I'll ask you about it in tomorrow's meeting, but I'm expecting we won't want to try to put it in stein RC2 even if you do get it all fixed up by then.15:23
cdenttrident: that patch is only doing it for flavor extra specs15:24
gibitrident: the linked bp https://blueprints.launchpad.net/nova/+spec/forbidden-traits-in-nova explicitly talks about flavor extra_spec so I think there was no intention to support it from image metadata15:24
sean-k-mooneyefried: ya that is fair. we can consider backporting it when i have the final fix.15:24
efriedtrident: It is something we've discussed doing, for sure, but I don't think we've implemented it yet.15:24
sean-k-mooneyefried: actully one thing i might try is fixing it on the stabel branches and see if they pass15:24
tridentefried, cdent: I am a little bit of a newbie when it comes to the code base, that's why I am asking. But my understanding from following the code path is that the logic for getting forbidden traits from image props is not there. Just wanted to verify that before putting more time into it.15:24
cdentyes, it's not there15:25
efriedWe do support positive traits from image props, nah?15:25
* efried goes looking...15:25
sean-k-mooneyefried: we do15:25
tridentefried: Yes.15:25
efriedwherezat code?15:25
cdentit's a thing that ought to exist, I think it just didn't happen yet. Perhaps because we couldn't decide precedence? I can't remember15:26
sean-k-mooneyin the schduler uitls i think one sec15:26
tridentefried: https://github.com/openstack/nova/blob/771e102654b54d257f437f16be2aeeef51fa0783/nova/scheduler/utils.py#L18615:26
sean-k-mooneyyep ^ which is called by resources_from_request_spec15:27
*** eharney has quit IRC15:28
sean-k-mooneyand i think but i woudl have to confim when we build the request spec we grab the image properties form a voluem in the bfv case so it should also work in that case too15:28
*** eharney has joined #openstack-nova15:29
sean-k-mooneythere may however be the same issue. the traits are part of the unnumbered request group which is matched agaist the compute node RP but if we did nto requerst any resouces form it that would not work correctly15:29
efriedsean-k-mooney: Yup, same issue we've been thrashing in mriedem's multiattach capability patch.15:30
gibisean-k-mooney: we don't have to solve the empty unnumbered group issue yet. That will happen when NUMA is modelled in placement. And it requires a lot of other changes15:30
efriedI think we decided that *right now* we always request resources in the unnumbered group for the root RP.15:31
efriedso <sweep under rug>15:31
efried<fingers in ears>15:31
sean-k-mooneygibi: ya that true15:31
efried<problem for future us>15:31
tridentSo supporting forbidden traits in image props as well seems like a clear case of something that would make sense to implement. But out of scope of what I am working on with this bug. (had it just been a similar bug as with forbidden traits in flavors I might as well just have fixed it while I was at it).15:31
sean-k-mooneyefried: easy fix. all compute node have a inventory of instnace which match the max instance per host value that in the nova.conf15:31
sean-k-mooneyand all vms in the futre requerst one allocation of an instance resouce class15:32
efriedtrident: Right. I agree it's something that makes sense to implement, though we would probably want a clear use case / demand before prioritizing the work.15:32
sean-k-mooneyefried: we could allso kill one of the filter if we did that15:32
sean-k-mooneyspecifically we could kill this filter https://github.com/openstack/nova/blob/master/nova/scheduler/filters/num_instances_filter.py15:33
efriedsean-k-mooney: that would require us to tack on that "resource" to every request15:33
sean-k-mooneyefried: yes15:33
efriedbecause we can't expect it to be in flavors.15:33
sean-k-mooneybut i think that would be fine15:33
sean-k-mooneyit requires not change to placement15:33
sean-k-mooneyand this is really a nova specific issue with a nova specific fix15:33
efriedtrident: So given that it's *not* supported currently, do you actually have any other way of introducing a forbidden trait that doesn't get picked up by the scheduler?15:33
efriedtrident: but still conforms to the rules ("you can't have a request group with no resources")?15:34
efriedsean-k-mooney: Isn't there a way to set max instances per host to unlimited?15:35
*** udesale has quit IRC15:35
sean-k-mooneyyes but i think max int is close enough15:35
gibifamous last words :)15:36
tridentefried: Yes. My initial issue and what the bug report / review is about is when introducing it from flavors. So, that still stands.15:36
efriedsean-k-mooney: Could work. Seems like a pretty heavy solution, not sure if it's worth it. But we could talk about it at the PTG if you're into it.15:36
tridentefried: And that is supposed to be supported.15:36
sean-k-mooneyefried: if you think there may be some merrit in it i can write up a short spec proposing how it would work15:36
efriedtrident: Okay, so the very best thing you could do is what gibi suggested: come up with a functional test case that demonstrates it being broken.15:37
sean-k-mooneywe could proably make it opt in via a config and a prefilter.15:37
efriedsean-k-mooney: I have no opinion. It seems like a messy solution to something that's not really a problem.15:37
efried(I guess that's an opinion)15:37
*** wolverineav has joined #openstack-nova15:37
efriedsean-k-mooney: I just think we have more important things to focus on for train.15:38
efriedit would be nice if we had a future/wishlist bucket we could put such things into...15:38
sean-k-mooneysure it was just a taught15:38
tridentefried: That, I have done. Looking at unit tests at the moment as well.15:38
efriedtrident: Sweet. We'll look for that patch. Thanks for working on this!15:39
sean-k-mooneyi might just write it up as a way to migrate eh numInstacnefilter  to placemetn and we can decide to do it if/when it makes sense15:39
efriedsean-k-mooney: ++15:39
gibitrident: hit me with the patch adding the functional test and I can review it quickly15:40
*** ratailor has quit IRC15:41
tridentI have two questions related to the functional tests and the review flow. First, Looking at the test on https://github.com/openstack/nova/blob/771e102654b54d257f437f16be2aeeef51fa0783/nova/tests/functional/test_servers.py#L4524 , wouldn't that one potentially pass around 50% of the times even if the required flavor didn't work? When it ends up on the expected node out of chance?15:42
gibitrident: looking15:44
sean-k-mooney trident yes and no15:45
sean-k-mooneythe use of VMX is unfortuete15:45
sean-k-mooneythe upsteam ci does not provide nested vert15:45
gibisean-k-mooney: this is functional test so no virt layer is involved15:45
sean-k-mooneyya just realised that15:46
sean-k-mooneyas i was typeing15:46
efriedtrident: The point of that test is that the flavor (not the image) contains the required trait15:46
gibitrident: I think this test can pass half of the time15:46
tridentThe second one, how should I submit the functional tests for review? In the same commit or some other way to get it in as a "related change"? I imagine we would like to first see it fail and then not fail with the patch.15:46
efriedtrident: So it should always land on the host that exposes that trait.15:46
efriedtrident: A good way to do it is to propose a patch with the test code that demonstrates the broken behavior with a FIXME or TODO comment describing what's supposed to happen, and Related-Bug: #XXXXX in the commit message15:47
gibitrident: I agree with efried ^^15:47
sean-k-mooneywell it depend on if you are fixing a bug or writing a new feature15:47
efriedtrident: Then propose the fix as a separate commit on top of that one (in a series) which removes the FIXME and demonstrates the correct behavior. This one includes Closes-Bug: #XXXXX in the commit message.15:47
efriedsean-k-mooney: We're talking about a bug15:47
sean-k-mooneyah then i think we have a doc for this15:48
efriedsean-k-mooney: bug 182182415:48
openstackbug 1821824 in OpenStack Compute (nova) "Forbidden traits in flavor properties don't work" [Undecided,In progress] https://launchpad.net/bugs/1821824 - Assigned to Magnus Bergman (magnusbe)15:48
tridentefried: Exactly, and it verifies that it ends up on the correct host. But, if traits are not passed it will end up on any one of the two nodes, so the verification will pass when it by chance end up on the host expected by the test.15:48
sean-k-mooneyin that case yes two patch one that intoduces the fuctional test that intentonlly assert the broken behavior or has the skip expect fail decortor and the a follow up that fixes it is the best way to go15:49
efriedtrident: Correct. But we don't (or shouldn't) have a test case that behaven that way.15:49
efriedbehaves*15:49
*** wolverineav has quit IRC15:49
tridentefried: So, I should remove the fix from my branch, add the test cases and re submit for review. And then add the fix and submit again. Right?15:52
tridentefried: Yeah, so I am right in my conclusion that the current test that I pointed to is buggy and should be fixed as well?15:53
gibitrident: yes, I think so15:53
efriedgibi, trident: I don't see the bug in the test15:55
gibiefried: there are two hosts and only compute1 has the required trait15:56
efriedgibi: Right. That's the whole point of the test.15:57
efriedthe flavor is requiring that trait15:57
efriedso we should always land on the host with that trait.15:57
gibiefried: so if the required trait handling is broken then this test only pass by chance15:57
efriedoic15:57
efriedright15:57
efriedbut trident wasn't saying the *required* trait handling was broken.15:57
efriedHe was saying the *forbidden* trait handling was broken.15:57
efried(I thought)15:58
efriedso duplicating that test case with forbidden traits would be a good start to the test case.15:58
efriedyou could implement a weigher that would normally prefer the "wrong" host so you could get consistent results.15:58
efriedlike this: https://review.openstack.org/#/c/647811/1/nova/tests/functional/test_json_filter.py15:59
*** gbarros has quit IRC15:59
openstackgerritDan Smith proposed openstack/os-traits master: Add COMPUTE_IMAGE_TYPE_SUPPORT_* traits  https://review.openstack.org/64814715:59
tridentefried: That's my point. If duplicating that test, I'll get a test for forbidden traits that also will pass half of the times even if the forbidden trait is not passed.15:59
efriedtrident: see above, implement a weigher to make the scheduler behavior deterministic15:59
*** tbachman has quit IRC16:00
tridentefried: Ah, nice. That sounds like a good solution. I have already implemented a test that sets the forbidden trait on both hosts and verifies that it gets into error.16:00
efriedsweet16:01
efried...gets into error only after your fix is in place, though?16:01
tridentYes.16:01
gibiefried, trident: I would suggest to disable the host that has the trait and asser that the boot fails16:01
efriedthat would work too.16:01
gibiit is easier than implementing a weigher, I think16:01
efriedtrident: So yeah, it's definitely important that we see your test case in "before" and "after" states.16:01
tridentBefore the fix it doesn't get into error.16:02
efriedif you put it all in one patch, we have to pull down the patch and remove your fix manually and run the tests to see that they fail.16:02
efriedcool16:02
gibiI agree ^^16:02
efriedocraplookatthetime16:02
* efried gotta run16:02
*** efried is now known as efried_rollin16:02
tridentGreat. I'll clean it up a little, get one node disabled and submit something by tomorrow. Thanks everyone for the assistance!16:04
gibitrident: thanks for the effort!16:05
*** artom has joined #openstack-nova16:06
*** artom has quit IRC16:06
*** artom has joined #openstack-nova16:07
openstackgerritMerged openstack/nova master: Add doc on VGPU allocs and inventories for nrp  https://review.openstack.org/64751916:14
*** gyee has joined #openstack-nova16:17
*** imacdonn has quit IRC16:22
*** imacdonn has joined #openstack-nova16:23
*** helenafm has quit IRC16:28
*** mrch_ has quit IRC16:32
*** cdent has quit IRC16:34
*** ttsiouts has quit IRC16:34
*** ttsiouts has joined #openstack-nova16:35
*** tssurya has quit IRC16:39
*** ttsiouts has quit IRC16:40
*** dustinc has joined #openstack-nova16:52
*** wolverineav has joined #openstack-nova16:55
*** wolverineav has quit IRC17:00
*** gbarros has joined #openstack-nova17:01
*** tesseract-rh has joined #openstack-nova17:09
*** tesseract has quit IRC17:09
*** wolverineav has joined #openstack-nova17:11
openstackgerritBalazs Gibizer proposed openstack/nova master: Prepare _heal_allocations_for_instance for nested allocations  https://review.openstack.org/63795417:12
openstackgerritBalazs Gibizer proposed openstack/nova master: nova-manage: heal port allocations  https://review.openstack.org/63795517:12
openstackgerritBalazs Gibizer proposed openstack/nova master: cache neutron ports in heal allocation  https://review.openstack.org/63820717:12
*** wolverineav has quit IRC17:13
melwittdansmith: do you think there would be any issues with having a module global ComputeAPI instance in console proxy? discussion in this patch of mine https://review.openstack.org/64499817:13
*** wolverineav has joined #openstack-nova17:13
*** rpittau is now known as rpittau|afk17:13
dansmithmelwitt: I think the only state computeapi maintains is the compute rpc instance right?17:14
melwittdansmith: I believe so17:14
dansmithI don't remember how SIGHUP wires into triggering that to re-calculate the pins, so that would be my only concern I think17:14
dansmithbut otherwise probably fine17:14
dansmithoh wait17:15
dansmithyou mean rpcapi/ComputeAPI yeah?17:15
melwittdansmith: ok, I'll look into it. thanks17:15
melwittyeah, I do. sorry17:15
dansmithI was thinking you meant compute_api/TheThingWhatever17:16
melwittI was just realizing there's two different ones17:16
melwittyeah17:16
dansmithso confusing that they're ... confusing17:16
dansmithmelwitt: yeah so right now that rpcapi gets created each time, which means it's never stale (but also means it's doing a calculation on every load)17:16
dansmithso I think you'd want to make sure to wire up the sighup like the other services use to bump it17:16
dansmithassuming that oslo.service gets fixed of course :)17:17
melwittI see, ok17:17
*** cdent has joined #openstack-nova17:17
*** dtantsur is now known as dtantsur|afk17:21
*** wolverineav has quit IRC17:24
*** wolverineav has joined #openstack-nova17:26
*** priteau has quit IRC17:27
openstackgerritBalazs Gibizer proposed openstack/nova master: Change the TODO to NOTE about instance multi-create  https://review.openstack.org/63884717:27
*** gbarros has quit IRC17:29
*** wolverineav has quit IRC17:30
*** wolverineav has joined #openstack-nova17:30
*** mdbooth has quit IRC17:35
*** psachin has quit IRC17:36
melwittdansmith: hm, the console proxies don't actually use oslo.service. they are websockify servers, and it looks like websockify currently ignores SIGHUP https://github.com/novnc/websockify/blob/master/other/websocket.c#L76817:39
*** priteau has joined #openstack-nova17:43
*** mvkr has quit IRC17:44
dansmithmelwitt: ah, aight then17:45
dansmithmelwitt: it still means it's a change from current, but maybe more meh17:45
*** eharney has quit IRC17:47
melwittdansmith: yeah. in my patch currently, I have rpcapi/ComputeAPI still as a class variable, but I'm relying on knowing the order of calls internally in websockify. making ComputeAPI global would eliminate that, but then I wouldn't be able to handle SIGHUP17:49
dansmithwell, it doesn't matter now because it's instantiated per request right?17:50
dansmithmeaning, no need for sighup currently, but after your change...17:50
melwittper connection yeah17:50
melwittyeah, if I make it global. I didn't make it global yet. maybe it's better to leave it as it is, per connection. because relying on the websockify call ordering seems less bad17:51
dansmithyeah17:57
*** wolverineav has quit IRC18:08
*** gbarros has joined #openstack-nova18:10
*** wolverineav has joined #openstack-nova18:10
*** wolverineav has quit IRC18:12
*** wolverineav has joined #openstack-nova18:12
*** ralonsoh has quit IRC18:16
*** tesseract-rh has quit IRC18:29
*** cdent has quit IRC18:36
*** priteau has quit IRC18:43
*** eharney has joined #openstack-nova18:47
*** wolverineav has quit IRC18:55
*** wolverineav has joined #openstack-nova18:56
openstackgerritArtom Lifshitz proposed openstack/nova master: [WIP] Revert resize: wait for external events in compute manager  https://review.openstack.org/64488118:58
openstackgerritArtom Lifshitz proposed openstack/nova master: [WIP] Revert resize: wait for external events in compute manager  https://review.openstack.org/64488119:00
*** wolverineav has quit IRC19:00
*** artom has quit IRC19:06
sean-k-mooneyso related to ^ i am currently porposing a change to neutron so that they will tell us when network events are sent so we can do that sanely https://review.openstack.org/#/c/645173/219:08
*** hongbin has quit IRC19:15
*** gbarros has quit IRC19:22
*** hongbin has joined #openstack-nova19:28
*** wolverineav has joined #openstack-nova19:29
*** sridharg has quit IRC19:30
*** wolverineav has quit IRC19:34
*** efried_rollin is now known as efried19:45
*** IvensZambrano has joined #openstack-nova19:51
*** wolverineav has joined #openstack-nova19:51
*** erlon has joined #openstack-nova19:53
*** pcaruana has quit IRC19:53
*** mdbooth has joined #openstack-nova19:57
efriedmelwitt: I thought the concern was that we would do a bunch of init on ComputeAPI objects that ended up not being used19:59
efriedmelwitt: in which case lazy load (but no global/singleton) would work okay, right?19:59
*** IvensZambrano has quit IRC20:02
*** lbragstad has quit IRC20:05
*** hongbin has quit IRC20:07
*** erlon has quit IRC20:09
melwittefried: oh, you mean in new_websocket_client? hm, I guess that should work. from the pre-existing code comment, I was thinking it needed to be instantiated ahead of new_websocket_client, but I can try that and see if the tempest novnc tests pass20:19
melwittit = ComputeAPI20:20
efriedmelwitt: I'm saying, instantiate it in the same place, but through a lazy loader20:21
efriedso it only actually initializes if you get down into new_websocket_client20:21
efriedbut in the code paths that never get there, nothing ever happens to it and you don't waste the... whatever20:21
efriedbut that way you don't have to worry about if like the code path changes from underneath you20:21
melwittefried: what is a "lazy loader"? I was thinking in __init__ it's set to None, in new_websocket_client, it's instantiated if None20:22
efriedWe did a thing with this for the scheduler client at some point (we have since removed it)20:22
* efried looks...20:22
melwittthat's how lazy load works underneath. won't be instantiated until use. I had thought from the pre-existing comment, it was saying it needed to be instantiated before new_websocket_client, but I don't see why it wouldn't work to instantiate it (once, if None) in new_websocket_client20:25
efriedmelwitt: https://github.com/openstack/nova/blob/stable/queens/nova/scheduler/client/__init__.py20:25
melwittyeah, that's what I'm already saying I think20:26
efriedmelwitt: I'm saying we shouldn't rely on new_websocket_client continuing to be the right place to do that init, in case the code flow changes underneath us.20:26
melwittefried: I get what you're saying, I'm saying I had thought from the existing code comment that it couldn't be that way. but I can try it and see what happens20:26
efriedso you keep it in init as20:26
efriedcompute_api = LazyLoader(...)20:26
efriedoh20:27
melwittbecause what LazyLoader will do is what I said, construct a ComputeAPI object in new_websocket_client20:28
melwittI think it will work fine. I probably took the code comment too literally20:29
efriedokay, yeah, the way I read the comment is that new_websocket_client needs to use the ComputeAPI, so it had better be instantiated by the time it needs to use it.20:29
efriedbut if you make it a lazy load, then it gets instantiated dynamically by the thing that needs to use it20:29
efriedbadabing etc.20:29
melwittyeah20:29
efriedanyway, worth a shot20:30
melwittyeah, I'll try it20:30
*** mdbooth has quit IRC20:37
*** lbragstad has joined #openstack-nova20:43
*** wolverineav has quit IRC20:46
*** itlinux has quit IRC20:46
*** wolverineav has joined #openstack-nova20:48
*** wolverineav has quit IRC20:53
*** mchlumsky has quit IRC21:01
*** wolverineav has joined #openstack-nova21:12
openstackgerritFrançois Palin proposed openstack/nova master: WIP - nova diagnostics command is not working with all interfaces  https://review.openstack.org/64812321:16
*** _alastor_ has quit IRC21:16
*** jmlowe has quit IRC21:20
*** whoami-rajat has quit IRC21:28
*** betherly has joined #openstack-nova21:32
*** erlon has joined #openstack-nova21:35
*** betherly has quit IRC21:36
openstackgerritDan Smith proposed openstack/os-traits master: Add COMPUTE_IMAGE_TYPE_SUPPORT_* traits  https://review.openstack.org/64814721:39
*** awaugama has quit IRC21:40
*** betherly has joined #openstack-nova21:48
*** ivve has quit IRC21:50
openstackgerritmelanie witt proposed openstack/nova master: Move create of ComputeAPI object in websocketproxy  https://review.openstack.org/64499821:51
*** betherly has quit IRC21:53
efriedmelwitt: ^ Very nice. So are we waiting for test results to prove it?22:03
melwittefried: yeah, just want to see the result of the tempest novnc tests22:04
*** wolverineav has quit IRC22:09
*** betherly has joined #openstack-nova22:10
*** mlavalle has quit IRC22:11
*** wolverineav has joined #openstack-nova22:12
*** itlinux has joined #openstack-nova22:14
*** betherly has quit IRC22:15
*** wolverineav has quit IRC22:17
*** jmlowe has joined #openstack-nova22:19
*** rcernin has joined #openstack-nova22:31
*** wolverineav has joined #openstack-nova22:33
*** zhubx has quit IRC22:37
*** zhubx007 has joined #openstack-nova22:37
*** _alastor_ has joined #openstack-nova22:46
*** erlon has quit IRC22:47
*** munimeha1 has quit IRC22:51
*** _alastor_ has quit IRC22:51
*** betherly has joined #openstack-nova22:53
*** betherly has quit IRC22:57
*** tkajinam has joined #openstack-nova23:00
*** gibi has quit IRC23:03
*** mdbooth has joined #openstack-nova23:04
*** mdbooth has quit IRC23:08
*** wolverineav has quit IRC23:19
*** wolverineav has joined #openstack-nova23:19
*** wolverineav has quit IRC23:22
*** wolverineav has joined #openstack-nova23:22
*** gibi has joined #openstack-nova23:22
*** tosky has quit IRC23:27
*** artom has joined #openstack-nova23:32
*** betherly has joined #openstack-nova23:35
*** betherly has quit IRC23:40
*** dsuper7 has joined #openstack-nova23:43
*** lbragstad has quit IRC23:48
*** takashin has joined #openstack-nova23:48
*** tetsuro has joined #openstack-nova23:58
*** gbarros has joined #openstack-nova23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!