Monday, 2019-03-04

*** belmoreira has joined #openstack-placement07:05
*** diga has joined #openstack-placement07:25
*** bhagyashris_ has joined #openstack-placement07:50
*** tetsuro has joined #openstack-placement08:18
*** rubasov has quit IRC08:28
*** helenafm has joined #openstack-placement08:29
*** giblet is now known as gibi08:33
*** e0ne has joined #openstack-placement08:34
*** tssurya has joined #openstack-placement08:47
*** ttsiouts has joined #openstack-placement09:11
*** bhagyashris_ has quit IRC09:34
*** e0ne has quit IRC09:40
*** rubasov has joined #openstack-placement09:56
*** cdent has joined #openstack-placement09:57
*** rubasov has quit IRC10:06
*** rubasov has joined #openstack-placement10:12
*** tetsuro has quit IRC10:15
*** e0ne has joined #openstack-placement10:16
*** takashin has quit IRC10:19
*** takashin has joined #openstack-placement10:45
openstackgerritChris Dent proposed openstack/placement master: Factor listiness into an ObjectList base class  https://review.openstack.org/63732510:51
openstackgerritChris Dent proposed openstack/placement master: Move _set_objects into ObjectList  https://review.openstack.org/63732810:51
openstackgerritChris Dent proposed openstack/placement master: Move *List.__repr__ into ObjectList  https://review.openstack.org/63733210:51
openstackgerritChris Dent proposed openstack/placement master: Clean up ObjectList._set_objects signature  https://review.openstack.org/63733510:51
openstackgerritChris Dent proposed openstack/placement master: Move RC_CACHE in resource_class_cache  https://review.openstack.org/64011410:51
openstackgerritChris Dent proposed openstack/placement master: Use native list for lists of Usage  https://review.openstack.org/63939110:51
openstackgerritChris Dent proposed openstack/placement master: Make base test case file for object unit tests  https://review.openstack.org/64040610:51
openstackgerritChris Dent proposed openstack/placement master: Move reshape() into placement.objects.reshaper  https://review.openstack.org/64054010:51
openstackgerritChris Dent proposed openstack/placement master: ResourceProvider.increment_generation()  https://review.openstack.org/64043310:51
openstackgerritChris Dent proposed openstack/placement master: Move Allocation and AllocationList to own module  https://review.openstack.org/64018410:51
openstackgerritChris Dent proposed openstack/placement master: Use native list for lists of Allocation  https://review.openstack.org/64045010:51
openstackgerritChris Dent proposed openstack/placement master: Inline Consumer.increment_generation()  https://review.openstack.org/64043710:51
openstackgerritChris Dent proposed openstack/placement master: Remove pep8 whitespace ignores  https://review.openstack.org/64055410:51
openstackgerritChris Dent proposed openstack/placement master: Nit collector  https://review.openstack.org/64055510:51
* cdent sighs10:52
cdentrebase messiness10:52
cdentgibi: if you have any cycles that ^ stuff may be of interest. The real value is towards the end of the stack, but we're being incremental.10:54
cdentbbl10:54
*** cdent has quit IRC10:54
*** ttsiouts has quit IRC11:04
*** ttsiouts has joined #openstack-placement11:05
*** ttsiouts has quit IRC11:09
*** e0ne has quit IRC11:10
*** e0ne has joined #openstack-placement11:11
*** diga has quit IRC11:14
*** cdent has joined #openstack-placement11:34
*** ttsiouts has joined #openstack-placement11:59
*** e0ne has quit IRC12:00
openstackgerritMerged openstack/osc-placement master: add python 3.7 unit test job  https://review.openstack.org/61007412:06
*** e0ne has joined #openstack-placement12:08
*** ttsiouts_ has joined #openstack-placement12:36
*** ttsiouts has quit IRC12:40
*** edmondsw has joined #openstack-placement12:49
*** cdent has quit IRC13:03
*** e0ne has quit IRC13:04
openstackgerritMerged openstack/placement master: Refactor _get_trees_matching_all()  https://review.openstack.org/63988813:20
openstackgerritMerged openstack/placement master: Adds debug log in allocation candidates  https://review.openstack.org/63988913:20
*** cdent has joined #openstack-placement13:21
cdentjaypipes or gibi: this is entirely optional, so if you like, it's not dangerous: https://review.openstack.org/#/c/619050/13:35
cdentneeds one more +213:35
gibicdent: ack, I'm a bit swamped with FF13:35
cdentgibi: noted, there's no real rush on that stuff. I'm simply cruising outstanding stuff13:36
cdentefried: is your +1 on https://review.openstack.org/#/c/601614/ waiting on something13:36
cdentgibi: if there's something I can help with, let me know13:37
gibicdent: there are 3 patches left for the Stein part of the bandwidth the current concern is with pci passthrough and pci claim :)13:38
cdentsadly that stuff is way outside my wheelhouse, but getting it down to 3 is a huge accomplishment13:39
gibisean-k-mooney helped to go to the right direction so I'm fixing tests now13:39
gibicdent: understood. There is not many devs who are happy to touch that part of nova13:39
sean-k-mooneygibi: happy may be a strech but im content or jaded enough to deal with the numa/pci/nfv code13:42
gibisean-k-mooney: you have a very valuable knowledge13:43
sean-k-mooneygibi: did you push the auto name lookup patch by the way. feel free to add me to the review when you do13:45
gibisean-k-mooney: still workig on it I will ping you when ready13:46
jaypipescdent: will try my best. raging headache this morning...13:47
cdentjaypipes: don't strain yourself. make sure you're hydrated. etc etc.13:48
*** tetsuro has joined #openstack-placement13:55
efriedcdent: just not feeling qualified to +2 it.13:57
cdentefried: roger that13:58
efriedn-sch meeting now in #openstack-meeting-alt14:00
*** diga has joined #openstack-placement14:01
openstackgerritMerged openstack/placement master: Add a vision-reflection  https://review.openstack.org/63021614:04
*** diga has quit IRC14:12
*** ttsiouts_ has quit IRC14:18
*** ttsiouts has joined #openstack-placement14:19
*** ttsiouts has quit IRC14:21
*** ttsiouts has joined #openstack-placement14:21
cdentefried: I'll resolve the merge conflicts on scrub-Lists after the meeting14:28
efriedokay.14:29
*** mriedem has joined #openstack-placement14:36
*** tetsuro has quit IRC14:53
efriedcdent: is https://storyboard.openstack.org/#!/project_group/placement going to be the best "top link" to see placement bugs in sb?14:56
cdentefried: I don't know yet. And I guess it depends on what you mean by "placement". That's the "group" which includes all 4 projecdts14:57
efriedright, I'm just looking for a link to put next to the lp one in the meeting agenda. I'll use that for now; lmk if there's something better14:57
cdentAll these "I don't know" is why I'm not rushing to say "we're soley using storyboard now"14:57
cdentseems fine14:57
efriedyeah, but imo now that we've got the sb available, it's not too early to announce we're transitioning.14:58
efriedI don't think anyone's suggesting we cut over exclusively and completely immediately.14:58
efriedor really ever. I think a transition period is healthy.14:58
*** e0ne has joined #openstack-placement14:59
efriedespecially considering how loose the existing mechanism is, piggybacked on nova and broken tool-wise.14:59
efriedso it's not like we'd really lose anything if somebody put something in sb and it wasn't perfect.14:59
cdentyeah, I don't disagree with any of that. I'm just not feeling any immediacy14:59
cdentit's in the queue14:59
efriedight14:59
cdentright, I agree with that too14:59
*** 18WAAFJGJ has quit IRC15:00
*** guilhermesp has joined #openstack-placement15:01
*** takashin has left #openstack-placement15:01
*** e0ne has quit IRC15:02
*** e0ne has joined #openstack-placement15:04
*** ttsiouts has quit IRC15:06
*** ttsiouts has joined #openstack-placement15:07
*** ttsiouts has quit IRC15:11
alex_xuefried: what can you do when we have NUMA, you already separate request group for different request group, and group_policy is isolate, how do you separate the VGPU request15:15
alex_xuefried: just like the case at https://review.openstack.org/#/c/552924/14/specs/stein/approved/numa-topology-with-rps.rst@28215:18
openstackgerritChris Dent proposed openstack/placement master: Factor listiness into an ObjectList base class  https://review.openstack.org/63732515:38
openstackgerritChris Dent proposed openstack/placement master: Move _set_objects into ObjectList  https://review.openstack.org/63732815:38
openstackgerritChris Dent proposed openstack/placement master: Move *List.__repr__ into ObjectList  https://review.openstack.org/63733215:38
openstackgerritChris Dent proposed openstack/placement master: Clean up ObjectList._set_objects signature  https://review.openstack.org/63733515:38
openstackgerritChris Dent proposed openstack/placement master: Move RC_CACHE in resource_class_cache  https://review.openstack.org/64011415:38
openstackgerritChris Dent proposed openstack/placement master: Use native list for lists of Usage  https://review.openstack.org/63939115:38
openstackgerritChris Dent proposed openstack/placement master: Make base test case file for object unit tests  https://review.openstack.org/64040615:38
openstackgerritChris Dent proposed openstack/placement master: Move reshape() into placement.objects.reshaper  https://review.openstack.org/64054015:38
openstackgerritChris Dent proposed openstack/placement master: ResourceProvider.increment_generation()  https://review.openstack.org/64043315:38
openstackgerritChris Dent proposed openstack/placement master: Move Allocation and AllocationList to own module  https://review.openstack.org/64018415:38
openstackgerritChris Dent proposed openstack/placement master: Use native list for lists of Allocation  https://review.openstack.org/64045015:38
openstackgerritChris Dent proposed openstack/placement master: Inline Consumer.increment_generation()  https://review.openstack.org/64043715:38
openstackgerritChris Dent proposed openstack/placement master: Remove pep8 whitespace ignores  https://review.openstack.org/64055415:38
openstackgerritChris Dent proposed openstack/placement master: Nit collector  https://review.openstack.org/64055515:38
cdentefried: that was more complicated that I expected15:38
cdentbiab15:48
*** cdent has quit IRC15:48
*** e0ne has quit IRC16:06
*** e0ne has joined #openstack-placement16:12
*** e0ne has quit IRC16:20
*** rubasov has quit IRC16:21
*** e0ne has joined #openstack-placement16:22
*** e0ne has quit IRC16:23
efriedalex_xu: If you care enough to isolate your CPUs, presumably you care enough to isolate your VGPUs as well.16:24
efriedalex_xu: I assume you would want to affine (some of?) your VGPUs with (some of?) your CPUs, in which case you would put them together in the same request group16:25
efriedalex_xu: So like, if you wanted one VGPU in the "smaller" group and two in the "larger":16:26
efried  group_policy=isolate16:26
efried  &resources1=VCPU:2,MEMORY_MB:1024,VGPU:116:26
efried  &resources2=VCPU:6,MEMORY_MB:3072,VGPU:216:26
*** cdent has joined #openstack-placement16:34
openstackgerritChris Dent proposed openstack/placement master: Docs: extract testing info to own sub-page  https://review.openstack.org/63962816:41
*** helenafm has quit IRC16:43
*** rubasov has joined #openstack-placement17:03
efriedcdent: I'm back17:05
efriedI'm confused as to why you needed to rebase anything.17:05
efriedI rebased everything on Friday.17:06
efriedI guess tetsuro's refactors merged this morning, that would have needed some conflict resolution.17:06
efriedBut before that, was just an accident?17:06
cdentmerge conflicts with code that17:06
cdentyes that17:07
cdentEarlier today I got a reject when sending code, because the code was based on stuff that was already "closed" and in the process of resolving that I over-rebased17:08
efriedcdent: I've finished re-reviewing those and (re-)approved the ones I didn't author.17:18
cdentgreat, thanks17:19
openstackgerritMerged openstack/placement master: Optionally migrate database at service startup  https://review.openstack.org/61905017:25
cdentefried: how do we feel about me voting on your changes at the start of that stack? seems legit, yeah?17:36
efriedcdent: Yeah, your changes to them were negligible, right?17:36
* cdent nods17:37
efriedConsider me +2 on your changes to my changes, then, which adds up to your +2.17:37
cdentgack, sometimes I really really hate the opt in nature of microversions17:44
*** tssurya has quit IRC17:58
*** e0ne has joined #openstack-placement17:59
*** mriedem has quit IRC18:05
*** e0ne has quit IRC18:17
*** mriedem has joined #openstack-placement19:11
*** e0ne has joined #openstack-placement19:13
*** openstackgerrit has quit IRC19:23
*** openstackgerrit has joined #openstack-placement20:07
openstackgerritChris Dent proposed openstack/placement master: Make the PlacementFixture usable without intercept  https://review.openstack.org/64085220:07
*** e0ne has quit IRC20:22
openstackgerritChris Dent proposed openstack/placement master: Make the PlacementFixture usable without intercept  https://review.openstack.org/64085220:36
cdentefried: I was thinking of intercept as a verb, but I'll adapt to be more clear20:39
cdentalso that typo is just hilarious20:40
efriedI thought so20:40
efriedcdent: you're using it as a noun in the code later, which if consumers are just looking at the interface is maybe okay, but that happens never.20:41
efriedcdent: Is this reproducible locally?20:46
cdentyes, pull down aspiers patch, (or likely just nova master), run `tox -r -efunctional-py37 test_report_client`, should get some failures20:47
efriedcdent: and enginefacade blows up if there are conf options it doesn't recognize? That's... weird.20:49
cdentthat's a slightly different thing20:50
cdentThe bug that aspiers revealed is that the CONF in test_report_client has no sync_on_startup registered on it, because it's a nova conf, not a placement conf20:50
efriedwell, right, but it's the reason that del existed in the first place.20:51
cdentyes20:51
cdentand yes, eginefacade, when taking a dict, will blow up when it gets keys it doesn't know20:55
openstackgerritChris Dent proposed openstack/placement master: Make the PlacementFixture usable without intercept  https://review.openstack.org/64085220:56
openstackgerritKashyap Chamarthy proposed openstack/nova-specs master: cpu-model-selection: s/cpu_models/cpu_model_list/  https://review.openstack.org/64086620:59
efriedcdent: afaict, test_report_client is the only thing using PlacementDirect. And there's exactly one place in there where we *aren't* wrapping the entire test case in the interceptor. And that one place we could achieve similar functionality by temporarily re-mocking, say, SchedulerReportClient._client.request to blow up. So I think we could "solve" this by replacing use of PlacementDirect in test_report_client with21:16
efriedPlacementFixture.21:16
efriedwhich kind of begs the question as to what we should do with PlacementDirect - kill it? Does it have the utility we thought it should?21:16
cdentefried: as I recall the recent we used placement direct there was because we need to have a wsgi intercept under our direct control, because we have to shut down the application for a duration, right?21:17
cdent[t 6017]21:18
purplerbot<cdent> however I have seen zero evidence that PlacementDirect ever should have existed, so I'm not inclined to put a lot of energy into it [2019-03-04 20:36:22.844291] [n 6017]21:18
efriedYeah, "shut down" sort of. Like I said, we can simulate that by re-mocking out the request method in a context manager.21:18
efriedI'll work on that fix while we wait for the gate here.21:18
cdentI don't know if we should kill PlacementDirect or just let it languish until someone comes along and wants it and finds it doesn't quite work21:18
cdentI think it _will_ work for the non-test case (where you make a command line tool that read /etc/placement/placement.conf and make a database conection, etc)21:19
cdentbut does anyone want that?21:19
efrieddon't know. I was excited about being able to use it for test, but much less so when I found that you had to instantiate the interceptor in every test case. And you explained to me why that was desirable so I let it go.21:20
efriedYou agreed with me that Direct and Fixture were very similar and could potentially be consolidated.21:21
efriedand I looked at doing that at some point, but it was going to be nontrivial.21:21
efriedMainly because what I wanted was to preserve Direct and get rid of Fixture, which would have entailed changing a lot more test cases.21:21
efriedNow looking at doing it the other way, that would be a smaller surface area (just test_report_client, I believe), so...21:21
* cdent nods21:23
cdentIf there's stuff that needs to be done in the morning, somebody leave me a note on the reviews or email or something. I need to be done for today.21:25
cdentgood night all21:25
*** cdent has quit IRC21:25
*** mriedem has quit IRC21:50
*** zzzeek has quit IRC21:54
*** zzzeek has joined #openstack-placement21:54
openstackgerritChris Dent proposed openstack/placement master: Fix typo in db-auto-sync release note  https://review.openstack.org/64088622:19
alex_xuefried: but say, we have two pGPU on NUMA node2, and you request 2 vGPUs on node2, and each pGPU on node2 only left 1 vGPU :)23:28
* alex_xu can't stop annoying23:28
*** openstackgerrit has quit IRC23:28
efriedalex_xu: You will always be able to come up with scenarios that we can't manage perfectly with existing syntax.23:30
efriedalex_xu: But before you start coming up with those scenarios involving NUMA, we should have some idea of how we're going to solve the NUMA affinity problem in placement in the first place.23:30
alex_xuefried: you mean we still need more think on https://review.openstack.org/55292423:31
efriedalex_xu: yes, absolutely.23:32
efriedthough I do need to give that another read.23:32
alex_xuthanks, will keep thinking23:32
efriedsorry, this sucks that I'm having to leave just as you're arriving, but I need to run :(23:32
alex_xuno worries, i already get answer23:33
*** dklyle has quit IRC23:39
*** mriedem has joined #openstack-placement23:43
*** mriedem has quit IRC23:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!