Monday, 2019-08-05

*** yikun has joined #openstack-placement01:44
*** belmoreira has joined #openstack-placement06:51
openstackgerrityatin proposed openstack/placement master: Make placement base API return version without auth  https://review.opendev.org/67454307:39
*** belmoreira has quit IRC08:08
*** belmoreira has joined #openstack-placement08:12
*** tssurya has joined #openstack-placement08:41
*** e0ne has joined #openstack-placement08:48
*** belmoreira has quit IRC09:03
*** ykarel has joined #openstack-placement09:11
ykarelcores can u look at https://review.opendev.org/#/c/674543/09:13
*** takashin has left #openstack-placement09:32
*** belmoreira has joined #openstack-placement09:49
*** cdent has joined #openstack-placement09:49
openstackgerritChris Dent proposed openstack/placement master: Make placement base API return version without auth  https://review.opendev.org/67454310:33
ykarelcdent, Thanks for ^^11:08
cdentykarel: you're welcome11:08
cdentI suspect that'll get merged pretty soon. Is it something you're hoping to be able to backport?11:08
ykarelcdent, not looking for backport, only seen this issue after nova patch merged which swictched to openstacksdk11:09
ykarelbut it's seems a good candidate for backport11:09
cdentah, okay, cool11:09
ykarelcdent, but i still can't get what part is appending / to requests in devstack11:10
cdentyeah, I'll ask around with a few other folk11:10
ykarelokk Thanks11:10
cdentit might be mod_proxy_uwsgi11:10
ykarelyup i am guessing that11:10
ykarelbut can't find a reference11:10
openstackgerritChris Dent proposed openstack/placement master: Track usage info on RequestWideSearchContext  https://review.opendev.org/67458112:00
cdentefried: that is riffing off you riffing off me12:01
*** gibi_off is now known as gibi12:01
cdentgibi: you back? welcome back!12:02
gibicdent: thanks12:02
gibinow I have a looong list of mails to process :D12:02
cdenti bet12:03
*** tssurya has quit IRC12:07
*** tssurya has joined #openstack-placement12:08
*** jroll has quit IRC12:39
*** belmoreira has quit IRC12:39
*** jroll has joined #openstack-placement12:39
*** belmoreira has joined #openstack-placement12:59
efriedo/ gibi!13:10
efriedwe missed you :*13:10
gibiefried: o/13:10
gibi:)13:10
*** mriedem has joined #openstack-placement13:14
*** ykarel is now known as ykarel|afk13:22
efriedcdent: Will https://review.opendev.org/#/c/674543/ actually help with https://bugs.launchpad.net/nova/+bug/1838807 ?13:28
openstackLaunchpad bug 1838807 in OpenStack Compute (nova) "UnsupportedServiceVersion: Service placement has no discoverable version. The resulting Proxy object will only have direct passthrough REST capabilities." [Medium,In progress] - Assigned to Takashi NATSUME (natsume-takashi)13:28
cdentefried: yes, see my comment13:28
cdentI think the issue is fairly...weird13:29
efriedI asked mordred to put in a (passthrough) Proxy in sdk for Placement13:29
efried...which I thought was what was missing, and mordred seemed to agree that that would sort the problem.13:29
cdentactually13:29
cdenthmmm13:29
cdentI'm not sure13:29
cdentthere is always a discoverable version13:29
cdentbut if you request wrong, you won't get it13:30
efriedI agree having version endpoint support fixed as you've done is a necessary thing.13:30
cdentsee the other bug for a bit more context13:30
cdentit's possible that somet hings are request /placement and getting something weird, which is not triggering an error in sdk (but probably should be) but telling it couldn't find version doc13:31
cdentbut there is (and always has been) a version doc13:31
openstackgerritMatt Riedemann proposed openstack/placement master: Make placement base API return version without auth  https://review.opendev.org/67454313:33
efriedYeah, I did this last week:13:35
efried3:15:18 PM - efried: […] curl http://192.168.218.27/placement13:35
efried3:15:18 PM - efried: {"versions": [{"status": "CURRENT", "min_version": "1.0", "max_version": "1.36", "id": "v1.0", "links": [{"href": "", "rel": "self"}]}]}13:35
efriedso like, at least curl is happy with non-trailing-slash13:36
efriedanother piece of the discussion was: should placement be using versioned endpoints?  .../placement/v1/*13:36
cdentefried: it makes a big big difference whether you are running in devstack, tripleo, something else13:37
efriedokay. Above was devstack13:37
cdentplacement is and always will be unversioned, I've had that discussion with mordred before13:37
cdentif it needs to have a new version, then it needs to be a new service13:38
cdentand that's fine13:38
efriedokay.13:38
cdentthey are just urls13:38
cdentbut versions in urls is a sing13:38
cdentsin!13:38
cdentI believe ykarel|afk (from earlier, the original author on that fix) has more details on which deployments a / or '' happens13:38
cdentalso, efried, I'm ignoring your mock bait, but almost got distracted going on a screed, decided my time was spent elsewhere13:39
efried:P13:40
efriedI was of course totally baiting you. Not even slightly serious.13:40
ykarel|afkefried, so if u run curl http://192.168.218.27/placement13:42
ykarel|afkalso check logs13:42
ykarel|afkthere you will find actual request was GET /placement/13:42
ykarel|afkchecked in a devstack env ^^13:42
ykarel|afkso something is adding / with devstack setup, so 1st thing placement should fix it, second openstacksdk should provide compatibility with urls not having /13:43
ykarel|afkas earlier with keystone adapter it was working, i browsed through keystoneauth code, and there the are hacking urls multiple places13:44
efriedykarel|afk: the latter should be brought up with mordred in the #openstack-sdks channel13:44
efriedYes, this is one of the reasons we wanted to merge this cutover to sdk sooner rather than later. To flush out weirdnesses like this.13:44
efriedsdk is piggybacking on ksa by the way.13:44
ykarel|afkefried, sure i can ping him later, currently need to go out13:45
efriedbut I'm sure some pieces are being sidestepped.13:45
*** ykarel|afk is now known as ykarel|away13:52
openstackgerritChris Dent proposed openstack/placement master: Add RequestWideSearchContext.summaries_by_id  https://review.opendev.org/67425414:01
openstackgerritChris Dent proposed openstack/placement master: Further optimize _build_provider_summaries  https://review.opendev.org/67434914:01
openstackgerritChris Dent proposed openstack/placement master: Track usage info on RequestWideSearchContext  https://review.opendev.org/67458114:01
cdentefried: all that ^ needed a rebase to catch up with change in lower-constraits14:01
efriedoh, I thought I had done that.14:01
*** belmoreira has quit IRC14:02
cdentI might have messed it up when I added another patch to the end14:02
efriedk14:02
efriedI'm getting set up to look at the last patch soonisg.14:02
efriedsoonish14:02
*** belmoreira has joined #openstack-placement14:03
efried(/me got in the poison ivy again, on antihistamines, brain furry)14:03
cdentit's interesting and probably opens up a fair few other possibilities14:03
cdentoops14:03
cdentsomething got me yesterday14:03
cdenti've kind of reached a stopping point on the profiling. I can't really make any further headway until there's a new common base for analysis14:09
cdentgibi: if you've got a few cycles to spare reviewing the several performance-related patches I made to placement near the end of last week, that would be awesome14:10
gibicdent: I put it on my list14:23
cdentgibi: thanks!14:23
gibicdent: I've already seen your work using _slots_14:23
cdentare not because of missing rebase. "'expanding' parameters with an empty list not supported until SQLAlchemy 1.3"14:24
cdenti'll fix that14:24
gibimriedem, cdent: btw. regarding profiling the nova scheduler with os-profile vs. cProfiler. I think if we targeting a single process then cProfiler is better. os-profiler is more for profiling a multi process, multi module interaction as it has pretty severe overhead to store each trace point14:25
gibiif I remember correctly neutron guys see the rally tests slowing down 5 times when os-profiler is enabled14:26
cdentyow14:26
mriedemgibi: ack thanks. i at least got a patch to add a nova osprofiler job to the experimental queue https://review.opendev.org/#/c/674326/ and from looking at some of that found a thing to clean up https://review.opendev.org/#/c/674422/ but it's hitting some weirdness in a libvirt numa functional test14:27
mriedemtotally unrelated to the -placement channel though :)14:27
mriedemalso, welcome back14:27
gibimriedem: thanks. I've added your patches to my queue too :)14:28
* gibi building backlog today14:29
*** mriedem has quit IRC14:29
*** mriedem has joined #openstack-placement14:29
openstackgerritChris Dent proposed openstack/placement master: Further optimize _build_provider_summaries  https://review.opendev.org/67434914:33
openstackgerritChris Dent proposed openstack/placement master: Track usage info on RequestWideSearchContext  https://review.opendev.org/67458114:33
cdentefried: on "further optimize" had to add a skip if no rp_ids14:33
efriedcdent: You gonna still +2 that guy?14:39
cdentefried: I was waiting to ask you if you thought my little fix took me out of the running14:39
cdent2nd opinion all that14:40
efriedcdent: Add my +1 and go ahead and +2 the thing14:40
cdentaye14:40
cdentRPCandidates.filter_by_rp is now (interestingly) a noticeable contributor14:43
*** belmoreira has quit IRC14:48
*** belmoreira has joined #openstack-placement14:51
openstackgerritChris Dent proposed openstack/placement master: Make _get_trees_with_traits return a set  https://review.opendev.org/67463015:03
cdentefried: becasue you're not already busy enough ^15:03
cdentwe appear to be down under 2 seconds from somewhere above 615:11
cdentbut that's only guesswork15:11
openstackgerritChris Dent proposed openstack/placement master: Make _get_trees_with_traits return a set  https://review.opendev.org/67463015:11
efriedcdent: that's with the complex-y topo?15:12
cdentyeah, I have my database full of about 6500 of the complexy providers (plus some others)15:12
cdent9423 total providers in the thing15:13
cdent6551 in the results of a GET /a_c with the complexy topo15:14
cdentthat's just with that stack15:14
cdentstill go the double join to get rid of15:15
cdentgot15:15
cdentand another one of the redudant casts15:15
cdentonce we get all that merged it might make sense to do some small scale profiling, because now things like transforming all that data to json is showing up as a big factor15:16
cdentand stuff in the creation of the data is getting obscured15:16
*** belmoreira has quit IRC15:52
*** belmoreira has joined #openstack-placement16:02
*** belmoreira has quit IRC16:03
*** e0ne has quit IRC16:19
openstackgerritChris Dent proposed openstack/placement master: Use expanding bindparam in extend_usages_by_provider_tree  https://review.opendev.org/67464716:21
openstackgerritMerged openstack/placement master: Make placement base API return version without auth  https://review.opendev.org/67454317:07
*** tssurya has quit IRC17:34
openstackgerritChris Dent proposed openstack/placement master: WIP: Use orjson in python3 for allocation candidate dump  https://review.opendev.org/67466117:49
*** ykarel|away has quit IRC17:56
*** e0ne has joined #openstack-placement18:05
*** e0ne has quit IRC18:45
*** cdent has quit IRC18:59
*** e0ne has joined #openstack-placement19:16
*** e0ne has quit IRC19:31
*** mriedem has quit IRC21:19
*** mriedem has joined #openstack-placement21:21
*** artom has joined #openstack-placement23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!