Thursday, 2018-08-02

*** edmondsw has joined #openstack-placement00:07
*** edmondsw has quit IRC00:12
*** mriedem has quit IRC00:29
*** edmondsw has joined #openstack-placement01:29
openstackgerritTetsuro Nakamura proposed openstack/nova master: Use common functions in granular fixture  https://review.openstack.org/58811301:39
*** edmondsw has quit IRC01:50
*** edmondsw has joined #openstack-placement01:51
*** edmondsw has quit IRC01:55
openstackgerritTetsuro Nakamura proposed openstack/nova master: Use common functions in NonSharedStorageFixture  https://review.openstack.org/58811402:01
*** e0ne has joined #openstack-placement02:23
*** e0ne has quit IRC02:23
openstackgerritMerged openstack/nova master: Make ResourceTracker.stats node-specific  https://review.openstack.org/58763602:30
openstackgerritVishakha Agarwal proposed openstack/nova master: 'Updated_at' is NULL when show aggregate info  https://review.openstack.org/58027103:13
*** edmondsw has joined #openstack-placement03:19
*** edmondsw has quit IRC03:24
openstackgerritZhenyu Zheng proposed openstack/nova master: Fix a typo in comment in resource_provider.py  https://review.openstack.org/58814506:26
openstackgerrithuanhongda proposed openstack/nova master: Destroy evacuated instance while unset nova-compute forced_down  https://review.openstack.org/58780706:58
openstackgerritTetsuro Nakamura proposed openstack/nova master: Increase max_unit in placement test fixture  https://review.openstack.org/58815807:14
openstackgerritTetsuro Nakamura proposed openstack/nova master: Refactor AllocationFixture in placement test  https://review.openstack.org/58815907:14
*** avolkov has joined #openstack-placement08:18
*** tssurya has joined #openstack-placement08:26
*** cdent has joined #openstack-placement08:49
*** tetsuro__ has joined #openstack-placement08:59
*** tetsuro__ has quit IRC08:59
*** tetsuro_ has joined #openstack-placement08:59
*** tetsuro_ has quit IRC09:02
*** tetsuro_ has joined #openstack-placement09:04
*** tetsuro_ has quit IRC09:04
cdentmorning gibi , thanks for getting all that stuff merged09:14
gibicdent: those were good stuff, worth to merge :)09:14
*** fanzhang has joined #openstack-placement09:23
*** edmondsw has joined #openstack-placement09:48
openstackgerritMerged openstack/nova master: Add note about reschedules and num_attempts in filter_properties  https://review.openstack.org/58241210:36
openstackgerritStephen Finucane proposed openstack/nova master: tox: Ensure reused envdirs share the same deps  https://review.openstack.org/58820710:37
openstackgerritChen proposed openstack/nova master: Make nova-manage db archive_delete_rows take --all-cells  https://review.openstack.org/58785810:48
openstackgerrithuanhongda proposed openstack/nova master: Destroy evacuated instance while unset nova-compute forced_down  https://review.openstack.org/58780710:52
*** cdent has quit IRC11:59
openstackgerritMerged openstack/nova master: Hook resource_tracker to remove stale node information  https://review.openstack.org/58792212:34
*** s10 has joined #openstack-placement12:44
*** tssurya has quit IRC12:51
openstackgerritEric Fried proposed openstack/nova master: doc: fix resize user guide link  https://review.openstack.org/58809712:52
openstackgerritStephen Finucane proposed openstack/nova master: Remove unused stubbing function from test  https://review.openstack.org/58696812:53
*** tssurya has joined #openstack-placement12:54
*** mriedem has joined #openstack-placement12:57
*** cdent has joined #openstack-placement13:02
*** jaypipes has joined #openstack-placement13:02
openstackgerritBalazs Gibizer proposed openstack/nova master: Improve NeutronFixture and remove unncessary stubbing  https://review.openstack.org/58741213:15
*** tetsuro_ has joined #openstack-placement13:20
*** tetsuro_ has quit IRC13:24
*** cdent has quit IRC13:27
openstackgerritMerged openstack/nova stable/queens: Call generate_image_url only for legacy notification  https://review.openstack.org/58496914:00
*** cdent has joined #openstack-placement14:02
efriedcdent jaypipes: I'd like to draw your attention to https://review.openstack.org/#/c/588091/ and https://review.openstack.org/#/c/588094/ which are two more approaches to eliminating the duplicate placement calls on every periodic. I made no attempt to fix unit & functional tests; but as you can see the tempest/devstack tests are green (except for one, not sure if related, rechecking to find out).14:02
efriedcdent: If you have a way of slotting these into your instrumentation or whatever to see if they do in fact dedup the placement calls, that would be handy.14:04
jaypipesefried: ack. will get to those shortly (just wrapping up reviews on the patches below there)14:04
cdentefried: my instrumentation is: run devstack, look at the logs for placement14:04
efriedcool. I'll wait to rebase since you're still reviewing. Sounds like you're going to want to solve @safe_connect first.14:04
jaypipesefried: yeah14:05
efriedjaypipes: IMO that should be done entirely separately. I had a patch that was working on that. I'll go back to it...14:06
jaypipesefried: I like your approach of fixing this one method at a time. the problem with "fixing" safe_connect in a single patch is that the patch ends up being YUGE and you will end up running into a boatload of failures in the functional tests that are being hidden by safe_connect()...14:07
jaypipes(I know because I've tried this multiple times already)14:07
efriedjaypipes: Yes indeed. But now I'm not sure what you're asking for anymore.14:07
efriedjaypipes: FYI, this was my latest attempt: https://review.openstack.org/#/c/584593/14:08
jaypipesefried: I like your approach, I just don't like the strict_get() thing (I feel it's just being used to gather all the safe_connect() failures up into a single PlacementConnectFailure exception.14:08
efriedExactly true ^14:08
efriedjaypipes: It was a way to fix things one call stack at a time, and eventually strict_get would be eliminated and the PlacementConnectFailure conversion would be folded into @safe_connect itself.14:09
jaypipesefried: but why not change safe_connect's exceptions to inherit from a single exception class (PlacementAPIConnectFailure or whatevs) and then simply add patches that remove @safe_connect decorator from one method at a time, with the call site catching PlacementAPIConnectFailure and logging the error (or re-raising) as appropriate?14:09
jaypipesthat way there's no need for a wrapper like strict_get()14:10
efriedjaypipes: You mean making a separate, transitional @safe_connect decorator?14:10
jaypipesno, I mean just removing it entirely and allowing the PlacementAPIConnectFailure to raise.14:10
efriedThere is no PlacementAPIConnectFailure.14:11
jaypipesremoving it entirely *from one method of report client at a time*, that is..14:11
jaypipesefried: no, I'm saying create that exception, have all the existing exceptions that the @safe_connect decorator currently catches inherit from that14:11
efriedYou mean wrapping .request() with a try/except that converts all those exceptions to PlacementAPIConnectFaliure...14:11
jaypipesno..14:11
efriedWell, we can't make ksa exceptions inherit from PlacementAPIConnectFailure...14:11
efriedwe need something that converts those.14:12
jaypipessure, that's fine.14:12
efried...which would either be a different/fixed @safe_connect or a catch-all in our .request() in the report client.14:13
jaypipesno...14:13
efriedthe former (a fixed @safe_connect) is what I'm trying with https://review.openstack.org/#/c/584593/14:13
jaypipesone sec, lemme throw a gist up14:13
efriedight14:13
efriedgibi: I don't see a _stop_compute(). Is there one, or do I have to make it up?14:17
efriedperhaps it's as simple as compute.stop(); compute.start()14:19
efriedyeah, that seems to work just fine.14:22
openstackgerritJay Pipes proposed openstack/nova master: DNM - example  https://review.openstack.org/58829514:31
jaypipesefried: ^^ no tests, not verified, just example of what I've been thinking...14:31
efriedack14:32
openstackgerritKonstantinos Samaras-Tsakiris proposed openstack/nova master: Hide hypervisor id on windows guests  https://review.openstack.org/57989714:32
efriedjaypipes: Okay, so it would actually need to be14:34
efriedexcept (the five-ish ksa exceptions that @safe_connect currently handles):14:34
efried...which we could define in a const tuple somewhere.14:34
openstackgerritEric Fried proposed openstack/nova master: WIP/PoC: safe_connect shouldn't hide failures  https://review.openstack.org/58459314:34
efriedjaypipes: FYI ^ attempts to take a big hammer to the test failures...14:35
gibiefried: sorry, I'm on a spotty connection. if start() stop() works for you thats cool. i have an enhancement for it somewhere on gerrit...14:35
efriedgibi: TestCase has restart_compute_service, which ought to suffice. The big part of the work will be refactoring, because currently that shared private method incorporates running periodics explicitly.14:37
gibiefried: Here it is, but it does more than what you need https://review.openstack.org/#/c/512552/14:38
gibiefried: if you feel this work is more than the valie it generates then I can accept that and you can ignore my comment14:38
gibis/valie/value/14:39
efriedoo, your patch may solve a problem I didn't think about having, which is whether the instances will continue to survive after the compute restart.14:39
efriedIf they don't, that might be okay, as long as their allocations don't get cleaned up...14:39
efriedgibi: It's a good idea; but yeah, it would be a nontrivial amount of work. Not sure if it's worth it or not.14:40
gibikvm instances survive nova-compute restart14:40
gibiefried: then a todo is enough. we can do it later.14:40
efriedight14:40
gibia libvirt instance definition (not the running domain) survives the whole compute host restart14:41
efriedgibi: Then what's with this comment? https://review.openstack.org/#/c/512552/10/nova/test.py@47414:42
jaypipesefried: all the ksa exceptions inherit from heystoneauth1.exceptions.ClientException, though, right?14:43
efriedjaypipes: Oh, do they? That would be convenient, looking...14:43
jaypipesefried: I suppose it would be very useful to have a decorator that just did retries versus safe_connect which does retries as well as hide any exceptions that might occur..14:43
efriedjaypipes: safe_connect doesn't retry14:44
efriedyou're saying it would be useful to have a decorator that does retries14:44
efriedlike the `retries` decorator in report.py?14:45
* efried confused again14:45
gibiefried: that comment is about the case when the definition of a server survives a compute host restart14:45
jaypipesefried: yeah, sorry, you're right.14:45
efriedthough @retries sucks in that it returns False when it runs out of retries.14:45
efriedjaypipes: Anyway, we shouldn't try to combine safe_connect and retries. Their relative usefulnesses overlap, but don't coincide.14:46
efriedjaypipes: Confirmed that ClientException is the common base, cool.14:47
*** efried is now known as efried_afk14:55
openstackgerritMerged openstack/nova master: tox: Ensure reused envdirs share the same deps  https://review.openstack.org/58820714:59
openstackgerritMerged openstack/nova master: Fix a typo in comment in resource_provider.py  https://review.openstack.org/58814515:18
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: guest: introduce blockStats instead of domain.blockStats  https://review.openstack.org/52683315:35
*** tssurya has quit IRC16:16
*** s10 has quit IRC16:33
openstackgerritBalazs Gibizer proposed openstack/nova master: Refactor NeutronFixture  https://review.openstack.org/58833816:54
*** efried_afk is now known as efried17:14
openstackgerritMatt Riedemann proposed openstack/nova master: Remove old check_attach version check in API  https://review.openstack.org/58834817:36
openstackgerritEric Fried proposed openstack/nova master: [placement] Debug log per granular request group  https://review.openstack.org/58835017:38
cdentefried: I wish you hadn't done that17:40
efriedwarum nicht?17:40
efriedThis one is cheap and easy, dude.17:40
cdentbecause you've violated the stack17:41
efriedeh?17:41
cdentyou're stack oriented, not queue oriented17:41
cdentand that's bad for getting stuff done, well17:41
cdentthere's no doubt that this is a a nice add17:41
* efried waits for 'but'17:42
cdentbut it's enough to say "we did something" but not really enough to say "we analysed the problem and came up with a good solution"17:42
cdentalso17:42
cdentsince nested doesn't work yet from anywhere but placement itself, request groups are rare17:42
cdentso for the common case, there is no new information here17:42
efriedCompletely true.17:42
efriedwishing I hadn't done it might be a bit strong, though.17:43
cdentso if you have the strenght of mind to remember that this is halfway and we'll come back to it for th ereal thing17:43
cdentthen that's cool17:43
cdentbut given our history, I'm not sure that as a group we have that strenght of mind17:43
efriedOh, sheee-yit, of course I understand this isn't the whole solution.17:43
efriedmaybe I should have made that clearer in my email.17:44
efriedI'll follow up.17:44
cdentyes, "wish you hadn't done that" is a bit strong. I don't want it to go away.17:44
cdentoh, I didn't know about any email, I just saw the link above17:44
openstackgerritMerged openstack/nova master: Remove unused stubbing function from test  https://review.openstack.org/58696817:44
efriednot much to the email17:44
openstackgerritMerged openstack/nova master: Improve NeutronFixture and remove unncessary stubbing  https://review.openstack.org/58741217:45
cdenta followup would be awesome to explain why it's not (yet) very useful17:45
cdentmy "wish" is more related to "ugh, I wish we could linearize more", c.f. our conversation about "getting big arcs done"17:46
efriedcdent: fup'd17:47
cdentthanks, perfect17:48
efriedcdent: Yes, linearize I get, but this was too easy to pass up. It took me like five minutes, 4 1/2 of which was getting the output into paste.o.o and composing the email.17:48
* cdent nods17:49
cdentyeah, sorry for being assy about it. I'm frustrated by the number of dangling questions and issues in my message on that thread. They've been accumulating for so long and I'm worn by choosing or needing to accept it. I don't want to anymore.17:50
efriedAgree that the bigger questions need to be answered, and will probably lead to big feature work one way or another. But IMO anything we can do cheap and easy like this, we should do, because it's clearly useful and a near-zero drain on perf and on dev time.17:52
cdentI don't dispute that.17:55
openstackgerritEric Fried proposed openstack/nova master: WIP/PoC: safe_connect shouldn't hide failures  https://review.openstack.org/58459317:57
cdentI reckon about some rather large %age of my dev time is blown on depression from languishing bigger questions17:59
cdentmaybe I should switch to stack-based time mgt17:59
cdentthanks for the fup fup efried18:23
efriedfo sho18:24
openstackgerritEric Fried proposed openstack/nova master: [placement] Add /reshaper handler for POST  https://review.openstack.org/57692718:53
openstackgerritEric Fried proposed openstack/nova master: reshaper: Look up provider if not in inventories  https://review.openstack.org/58503318:53
openstackgerritEric Fried proposed openstack/nova master: Make get_allocations_for_resource_provider sane  https://review.openstack.org/58459818:53
openstackgerritEric Fried proposed openstack/nova master: Report client: Real get_allocs_for_consumer  https://review.openstack.org/58459918:53
openstackgerritEric Fried proposed openstack/nova master: Report client: get_allocations_for_provider_tree  https://review.openstack.org/58464818:53
openstackgerritEric Fried proposed openstack/nova master: Report client: _reshape helper, placement min bump  https://review.openstack.org/58503418:53
openstackgerritEric Fried proposed openstack/nova master: Report client: update_from_provider_tree w/reshape  https://review.openstack.org/58504918:53
openstackgerritEric Fried proposed openstack/nova master: Compute: Handle reshaped provider trees  https://review.openstack.org/57623618:53
openstackgerritEric Fried proposed openstack/nova master: WIP: only _init_compute_node on startup  https://review.openstack.org/58809418:53
efriedrebase only18:54
openstackgerritEric Fried proposed openstack/nova master: WIP: Remove redundant _update()s  https://review.openstack.org/58809118:54
efriedI get *why* zuul refuses to run when the patch is in merge conflict, but it's inconvenient when I want to use zuul to identify test failures.18:55
efried...without having to rebase the world first18:55
edleafethat's what local tests are for18:56
efriededleafe: Sure, except toxing the world takes 20 minutes and raises the ambient temperature by two degrees.18:59
cdentefried: I forget how it works, but is it the case that you've just eaten 10 zuul nodes?19:02
efriedcould be, could be.19:02
efriedI would have only eaten one if zuul would just run on the merge-conflicting patch.19:02
openstackgerritMerged openstack/nova master: Wait for vif plugging during live migration job  https://review.openstack.org/57855119:03
efriedit's also annoying that submitting a series changes all the topics to whatever branch you were running on.19:03
openstackgerritMerged openstack/nova master: Stop setting glance_api_version in cinder.conf in nova-live-migration  https://review.openstack.org/57987119:03
efriedsince I'm griping about infra that's probably not worth changing.19:03
openstackgerritMerged openstack/nova master: doc: fix resize user guide link  https://review.openstack.org/58809719:03
cdentefried: do you know about -t -T on git review? If you're aware in advance, that might be some kind of help19:06
openstackgerritMerged openstack/nova master: Hyper-V + OVS: plug vifs before starting VMs  https://review.openstack.org/58566119:06
efriedoo, no, looking...19:06
openstackgerritMerged openstack/nova master: Complete the api-ref of security group rule  https://review.openstack.org/58010919:06
efriedcdent: I don't see -T19:07
efriedcdent: But -t won't help me, cause my gripe is that 7 out of those 9 patches *should* be on the same topic - the one corresponding to the branch I was on - but the other two's topics should be left tf alone.19:07
cdentOh, I think gerrit's thinking on that is that if you are in a stack, they must be the same topic, otherwise why are they in the same stack?19:08
cdent-T is in 1.26, dunno what it actually does based on the man page19:08
efriedone is a bug fix that enables something else in the stack; the other is an unrelated thing that has to go on top of that stack because it uses a thing that was introduced in that stack.19:09
efriedWhat I don't get is why "it" (not sure if "it" is git-review or gerrit) feels the need to change the topic of a patch that already has one.19:09
cdentdunno19:09
cdentI gotta run, I hope you figure out something useful19:10
cdentbbl19:10
efriedcdent: I was at 1.23. Upgrading...19:11
efried-T might do it - or it might clear the existing topic...19:11
openstackgerritEric Fried proposed openstack/nova master: Grease test_try_deallocate_network_retry_direct  https://review.openstack.org/58836419:31
*** cdent has quit IRC19:35
*** avolkov has quit IRC19:35
openstackgerritMerged openstack/nova master: Fix all invalid obj_make_compatible test case  https://review.openstack.org/57424019:55
openstackgerritMatt Riedemann proposed openstack/nova master: Scrub hw:cpu_model from API samples  https://review.openstack.org/58837120:02
openstackgerritEric Fried proposed openstack/nova master: WIP/PoC: safe_connect shouldn't hide failures  https://review.openstack.org/58459320:07
*** takashin has joined #openstack-placement20:48
openstackgerritEric Fried proposed openstack/nova master: Grease some more tests hitting RetryDecorator  https://review.openstack.org/58839120:53
openstackgerritEric Fried proposed openstack/nova master: Grease some more tests hitting RetryDecorator  https://review.openstack.org/58839120:55
*** mriedem is now known as mriedem_afk21:28
openstackgerritTakashi NATSUME proposed openstack/nova master: Reno for notification-transformation-rocky  https://review.openstack.org/58840322:20
openstackgerritEric Fried proposed openstack/nova master: [placement] Add /reshaper handler for POST  https://review.openstack.org/57692722:45
openstackgerritEric Fried proposed openstack/nova master: reshaper: Look up provider if not in inventories  https://review.openstack.org/58503322:45
openstackgerritEric Fried proposed openstack/nova master: Make get_allocations_for_resource_provider sane  https://review.openstack.org/58459822:45
openstackgerritEric Fried proposed openstack/nova master: Report client: Real get_allocs_for_consumer  https://review.openstack.org/58459922:45
openstackgerritEric Fried proposed openstack/nova master: Report client: get_allocations_for_provider_tree  https://review.openstack.org/58464822:45
openstackgerritEric Fried proposed openstack/nova master: Report client: _reshape helper, placement min bump  https://review.openstack.org/58503422:45
openstackgerritEric Fried proposed openstack/nova master: Report client: update_from_provider_tree w/reshape  https://review.openstack.org/58504922:45
openstackgerritEric Fried proposed openstack/nova master: Compute: Handle reshaped provider trees  https://review.openstack.org/57623622:45
openstackgerritEric Fried proposed openstack/nova master: WIP: Remove redundant _update()s  https://review.openstack.org/58809122:45
efriedcdent: git review -T did the trick ^ -- thanks for that!22:46
*** takashin has left #openstack-placement23:02
*** edmondsw has quit IRC23:08
*** jaypipes has quit IRC23:14
*** jaypipes has joined #openstack-placement23:16

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!