Monday, 2016-03-14

*** markvoelker has quit IRC00:00
*** dims_ has joined #openstack-meeting-cp00:27
*** dims has quit IRC00:28
*** vilobhmm11 has joined #openstack-meeting-cp00:28
*** dims has joined #openstack-meeting-cp00:33
*** dims_ has quit IRC00:33
*** david-lyle has quit IRC00:54
*** david-lyle has joined #openstack-meeting-cp00:54
*** sheel has joined #openstack-meeting-cp01:26
*** sdake has joined #openstack-meeting-cp01:41
*** markvoelker has joined #openstack-meeting-cp01:56
*** markvoelker has quit IRC02:00
*** dims has quit IRC02:07
*** dims has joined #openstack-meeting-cp02:21
*** vilobhmm11 has quit IRC02:27
*** dims has quit IRC02:41
*** sdake has quit IRC03:01
*** markvoelker has joined #openstack-meeting-cp03:57
*** markvoelker has quit IRC04:01
*** vilobhmm11 has joined #openstack-meeting-cp05:08
*** markvoelker has joined #openstack-meeting-cp05:58
*** markvoelker has quit IRC06:02
*** pgreg has joined #openstack-meeting-cp06:35
*** vilobhmm111 has joined #openstack-meeting-cp06:42
*** vilobhmm11 has quit IRC06:44
*** sdake has joined #openstack-meeting-cp07:06
*** persia has quit IRC07:15
*** bswartz has quit IRC07:15
*** olaph has quit IRC07:15
*** olaph has joined #openstack-meeting-cp07:16
*** persia has joined #openstack-meeting-cp07:18
*** markvoelker has joined #openstack-meeting-cp07:58
*** belmoreira has joined #openstack-meeting-cp07:59
*** markvoelker has quit IRC08:03
*** vilobhmm111 has quit IRC08:03
*** vilobhmm11 has joined #openstack-meeting-cp08:04
*** vilobhmm11 has quit IRC09:01
*** markvoelker has joined #openstack-meeting-cp09:59
*** markvoelker has quit IRC10:03
*** dims has joined #openstack-meeting-cp10:09
*** sdague has joined #openstack-meeting-cp10:13
*** pgreg has quit IRC10:15
*** dims has quit IRC10:21
*** dims has joined #openstack-meeting-cp10:30
*** sdake has quit IRC10:38
*** dims has quit IRC10:39
*** dims has joined #openstack-meeting-cp10:40
*** dims_ has joined #openstack-meeting-cp11:45
*** dims has quit IRC11:47
*** markvoelker has joined #openstack-meeting-cp12:00
*** markvoelker has quit IRC12:04
*** ninag has joined #openstack-meeting-cp12:41
*** ninag has quit IRC12:46
*** ninag has joined #openstack-meeting-cp12:51
*** markvoelker has joined #openstack-meeting-cp12:51
*** bswartz has joined #openstack-meeting-cp13:00
*** david-lyle has quit IRC14:16
*** david-lyle has joined #openstack-meeting-cp14:19
*** elmiko has joined #openstack-meeting-cp15:48
*** sdake has joined #openstack-meeting-cp16:31
*** vilobhmm11 has joined #openstack-meeting-cp17:07
*** belmoreira has quit IRC17:07
*** dims has joined #openstack-meeting-cp17:08
*** vilobhmm111 has joined #openstack-meeting-cp17:09
*** dims_ has quit IRC17:09
*** vilobhmm11 has quit IRC17:11
*** sdake_ has joined #openstack-meeting-cp17:15
*** sdake has quit IRC17:17
*** vilobhmm111 has quit IRC18:07
*** angdraug has joined #openstack-meeting-cp18:20
*** angdraug has quit IRC18:30
*** belmoreira has joined #openstack-meeting-cp18:38
*** belmoreira has quit IRC18:48
*** vilobhmm11 has joined #openstack-meeting-cp18:51
*** angdraug has joined #openstack-meeting-cp19:03
*** sdake has joined #openstack-meeting-cp19:35
*** sdake_ has quit IRC19:36
*** belmoreira has joined #openstack-meeting-cp19:36
*** sdake_ has joined #openstack-meeting-cp19:43
*** sdake has quit IRC19:45
*** sdake_ has quit IRC20:01
vilobhmm11hi20:04
*** mc_nair has joined #openstack-meeting-cp20:04
*** vilobhmm111 has joined #openstack-meeting-cp20:32
*** vilobhmm11 has quit IRC20:34
*** dims_ has joined #openstack-meeting-cp20:36
*** dims has quit IRC20:38
nikhilhi20:42
nikhilvilobhmm111: DST starts, we've 15 mins20:42
nikhil18 rather20:42
vilobhmm111nikhil : so are we meeting at 2:00 then ?20:49
nikhilvilobhmm111: yes20:54
nikhil#startmeeting quotas-wg21:00
openstackMeeting started Mon Mar 14 21:00:25 2016 UTC and is due to finish in 60 minutes.  The chair is nikhil. Information about MeetBot at http://wiki.debian.org/MeetBot.21:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:00
*** openstack changes topic to " (Meeting topic: quotas-wg)"21:00
openstackThe meeting name has been set to 'quotas_wg'21:00
nikhilCourtesy quotas-wg meeting reminder: nikhil, vilobhmm, DuncanT, mc_nair, ninag21:00
ninago/21:00
*** cshahani has joined #openstack-meeting-cp21:00
vilobhmm111o/21:01
nikhilHello everyone!21:01
vilobhmm111hi nikhil21:01
nikhilHow's the DST treating you (whoever it affects)? :)21:01
vilobhmm111haha may be the first day so didn;t realize it21:02
DuncanTHi21:02
mc_nairhey21:02
nikhilI know I thought to have driven 4.5 hours from CLT-Bburg but then realized it was Sunday where DST starts so it was merely 3.5 hours starting at 12am21:02
vilobhmm111okies21:02
nikhilfun DST experience!21:03
nikhilanyways, I added a few items to the agenda21:03
* thingee lurks21:03
nikhilnow that we've a few folks online and lurking :D21:03
* nikhil pokes thingee21:03
nikhil#topic agenda21:03
*** openstack changes topic to "agenda (Meeting topic: quotas-wg)"21:03
nikhil#link https://etherpad.openstack.org/p/quotas-wg-meeting-agenda21:03
vilobhmm111so about https://review.openstack.org/#/c/284454/ i have updated the patch with few comments…thinking more on the need for reservation..spoke with andrew laski on nova channel and i agree we can get rid of reservations overall21:03
nikhilvilobhmm111: let's get to that in a just a bit. sorry, I had a outline for today's meeting predetermined ..21:04
nikhilSorry, I wasn't at the last meeting but saw the logs and they look pretty good. We are still pending on the discussion of service vs lib21:05
vilobhmm111nikhil : sure..21:05
nikhilI had a great F2F convo with sdague on that point in NYC last week.21:05
DuncanTCan you explain a bit about how you get rid of reservations on an async system?21:06
ninagHow about quota as a micro service that each project can run?21:06
vilobhmm111DuncanT : once nikhil is done will answer to your que21:07
nikhilawesome, thanks vilobhmm11121:07
DuncanTThanks21:07
nikhilSO, let's recap last meeting on the review front, these questions today and then go with action items follow up. I've kept the feedback discussion for the open discussion topic given the amount og time weget today.21:08
nikhil#topic recap from last meeting & review quotas21:08
*** openstack changes topic to "recap from last meeting & review quotas (Meeting topic: quotas-wg)"21:08
nikhil#link http://eavesdrop.openstack.org/irclogs/%23openstack-meeting-cp/%23openstack-meeting-cp.2016-03-07.log.html#t2016-03-07T21:13:3121:09
nikhilThat's the ad-hoc meeting we'd but we don't have official logs unfortunately as we ran over in the on air hangout last week.21:09
nikhilvilobhmm111: floor is all yours on the follow up and the above questions21:10
vilobhmm111nikhil :ok21:10
vilobhmm111so if we think about nova flow might look like irc://irc.freenode.net:6667/#1. nova boot cli irc://irc.freenode.net:6667/#2. commit the irc://irc.freenode.net:6667/#of resource depending on request (source of truth being the quota.usages table) irc://irc.freenode.net:6667/#3. go to scheduling pick up a host to boot the instance on irc://irc.freenode.net:6667/#4. on nova-api side claim the commited resources in ir21:11
vilobhmm111a. nova boot cli21:11
vilobhmm111b. commit resource depending on request (source of truth being the quota.usages table)21:12
vilobhmm111c. go to scheduling pick up a host to boot the instance21:12
vilobhmm111d. on nova-api side claim the commited resources21:12
vilobhmm111right now nova and all other projects have concept of reservation and then commit (or rollback)21:13
vilobhmm111reservation is just a guarantee that (within a certain timeout) a particular req owns the resouce21:14
vilobhmm111which is redundant imho21:14
vilobhmm111why not just rely on quota_usages21:14
vilobhmm111and make commit / rollback accordingly21:15
nikhilvilobhmm111: can you please elaborate more?21:15
vilobhmm111does the team see any possible pitfalls with this design21:15
nikhilwhat is the difference in the race condition during the reservation vs quotas_usages ?21:16
vilobhmm111a reservation id is created for every resource request21:16
mc_nairvilobhmm111: is the redundant part that we're splitting up reserved/in-use, but anytime we check the free resources we need to take the total (in-use + reserved)?21:16
* alaski peeks in21:17
vilobhmm111alaski : hi21:17
alaskimc_nair: that's a big part of it21:17
alaskiI was questioning the benefit of reservations vs just committing the usage optimistically up front21:17
nikhilI see and that's makes me curious ..21:18
mc_nairalaski: yea I was curious about that also.  We did something similar with the most recent Cinder nested quota changes, where we did the reservations of "allocated" values up front (took it out immediately and rolled back if needed)21:18
mc_nairbut we still had it using a reservation21:18
nikhilwe've this option of either undercommit using reservation or overcommit using usages?21:18
mc_nairjust not split into reserved/in-use21:18
*** sdague has quit IRC21:19
alaskimc_nair: gotcha. that can work, but I do wonder if we can take it further21:19
vilobhmm111mc_nair : reserved/in_use/allocated all 3 needs to be considered21:19
vilobhmm111imho21:19
vilobhmm111alaski : ^^21:20
mc_nairbut the reservation-id part of it still seems useful, because otherwise how do you keep track of when to timeout a reservation and roll it back, or group updates to multiple project reservations into one unit that's rolled back / committed as one unit21:20
mc_nairvilobhmm111: considered as in decide if we need them at all?21:20
alaskivilobhmm111: the benefit of distinguishing reserved/in-use is what I'm trying to figure out21:20
alaskimc_nair: rather than timing out a reservation I was thinking along the lines of having usage tied to the consuming thing, and if that thing doesn't exist or gets cleaned up then the usage can be cleaned up21:21
alaskigroup updates is still a question mark21:22
alaskianother way to put it might be don't time out the reservation, time out the consuming entity21:23
mc_nairalaski: ok, that's interesting.  I don't have my head wrapped around how that'd actually work yet, but I'm slightly more following :)21:23
vilobhmm111alaski : you have an example for it21:23
vilobhmm111will help to understand better what you want to convey here21:23
nikhilok guys, I think this needs a brainstorming session. While we do that, we need to move forward on some of the action items too and get the requirements from other projects that people might be itching to give as per last meeting logs.21:24
mc_nairwe'd want to consider the nested quota design for that carefully, cause currently we're doing the grouped reservations21:24
alaskimc_nair: cool. I realize I'm raising more questions than proposing answers, but this seems like the right time to think a bit21:24
mc_nairnikhil: sounds good21:24
mc_nairalaski: makes sense21:24
vilobhmm111nikhil : it surely does…alaski : +121:25
nikhilninag: you can go first if you want21:25
nikhil#info action items follow up below21:25
ninagnikhil: in terms of the Auto Scaling for VMs?21:25
nikhilninag: yes, abvout to ask21:25
nikhildid we get feedback from them yet?21:25
nikhil(heat/autoscaling use cases drivers)21:26
ninagYes, I did talk with them..there are really no new requirements..since the policies are being built at thr PaaS layer21:26
DuncanTSo the thing about reservations is that they go (time out) if the create creates21:26
ninagThey are interested in APIs to query quotas and actuals21:26
nikhilninag: I see, so sketching out an API first would help more?21:27
ninagYeah21:27
nikhilexcellent direction21:27
nikhil#action all: provide feedback on the API front for the quotas21:27
nikhilof-course, this ties into our discussion about service vs lib21:28
nikhilbut let's comment a bit about our perspective so far on the spec21:28
nikhilvilobhmm111: you seem to have action item on migration plan21:29
nikhilnot sure if you wanted to add anything to it today21:29
vilobhmm111migration plan still brainstorming…will have an update by tommorow21:29
nikhilokay, we can say no-op for now21:29
vilobhmm111yep21:29
nikhilanything else on the action item follow up?21:30
vilobhmm111i was working on getting this need for reservation thing sorted out + addressing feedback + adding details about quota for PaaS related details.21:30
nikhilvilobhmm111: ++21:31
nikhilwe'd have a quick open discussion, couple of small things21:31
nikhil#topic open discussion21:31
*** openstack changes topic to "open discussion (Meeting topic: quotas-wg)"21:31
vilobhmm111few things which we should clarify imho #1. what this entity should be (lib/service) #2. reservtion or no reservation21:31
nikhil#starvote extend the meeting length to 1 hours? yes, no, maybe21:31
mc_nairyes21:31
ninagyes21:31
nikhilvilobhmm111: exactly21:31
nikhil#vote yes21:32
vilobhmm111#vote yes21:32
nikhilanyone else?21:32
nikhil#endvote21:32
nikhilokay, I misspelled startvote hence bot did not pick up21:33
nikhilmc_nair: vilobhmm111 ninag should we continue for the rest of the hour today then?21:33
ninagSure21:34
mc_nairnikhil: I'm fine with that21:34
mc_nairAre there any design sessions planned for quotas in Austin summit?21:34
nikhilsilence would mean yes (for all)21:34
nikhilmc_nair: not yet, once TC gets elected they will review the x-prj topics21:34
nikhilwe'd get the link to proposal soon-ish I think (usually up in the wiki)21:35
nikhil#info we are continuing the meeting to the full hour as there were no objections raised today's meeting21:35
nikhilA quick update to everyone, we'd a great talk from vilobhmm111 on quotas and scheduling as a hangout on air last week. It's got ton of views already so, I get a feeling that quotas is super important to openstack realm just that not everyone can/wants to impl.21:37
nikhil#link https://www.youtube.com/watch?v=PTFww2RH21c21:37
*** vilobhmm111 has quit IRC21:37
*** vilobhmm11 has joined #openstack-meeting-cp21:37
nikhilAll in all, I think we're in the right time for impl quotas.21:37
nikhilNow about the right place:21:37
nikhil1. service21:37
nikhil2. library21:37
ninagMicroservice?21:38
vilobhmm11why ninag21:38
nikhilMy discussion with Sean gave me a understanding that it being a library that defines a bare-bone quotas DB table for all projects to source in should be a good starting point.21:38
nikhilok, let's add that21:38
nikhil3. Microservice21:38
ninagIt is not a full fledged service, and given that we want to define behavior with a backing db21:39
ninagSeemed like a good fit for a micro service..21:40
ninagbut am open..wanted to put it out there..21:40
nikhilninag: what would be the critical defining point for it being called a micro service?21:40
ninagIn my mind, we are not providing quota as a service..21:41
ninagit still exists in the context of another service (nova etc)21:41
nikhilhaha, then so is glance :D21:41
ninagbut is more than a library..21:41
ninag:)21:41
nikhil++21:42
nikhilI got the similar feedback21:42
ninagLets talk about what you were proposing...I think it is pretty similar21:42
nikhilbut not necessarily defining it as a separate service21:42
nikhilninag: right on21:42
nikhil(I wanted to let you-ninag go first on micro service as this should open a new dimension of thinking separate from what we've already discussed on others)21:43
nikhilOn the feedback:21:43
vilobhmm11nikhil, ninag : making it a service adss addional dependency about deployments issues etc as opposed to it being a lib21:43
vilobhmm11micros-service we can think more21:44
*** belmoreira has quit IRC21:44
nikhilIf we've a library that defines bare-bone structure for the quotas and has a backing of the tables that all projects should have on quotas. Similar to what oslo.db does on the models for DB tables.21:44
vilobhmm11imho a lib with a db bare bones seems reasonable for what its purpose is21:45
nikhilSourcing into the project tree and then implementing custom logic seems like a good plausibility.21:45
vilobhmm11+121:45
nikhilOF course, DB migrations would 'a' if not 'the' pain point21:46
vilobhmm11but that you would have irrespective of it being a service or a lib21:46
vilobhmm11DB migrations21:46
ninagyup21:46
nikhilwell sure, but not necessarily so distributed21:47
vilobhmm11what do you mean by that nikhil : ^^21:47
nikhilit's easier to source out than source in information, imho21:47
nikhilmy presumptions being the DBs would be owned by this service and not by individual projects21:48
nikhiland the migration plans would be part and release of this service release cycle21:48
ninagnikhil: not sure I get you..even in the library model, i thought you talked of its being backed by tables21:49
nikhilfor example, if nova and cinder were two projects using this new service21:49
nikhilthe implementation for nova & cinder quotas and the increments of DB migration will be done as a  part of this service21:50
DuncanTI'd suggest you're going to want to define a new table with a name not used by any project then drain the records across over time... you can't just copy data around during migrations anymore, due to live upgrades21:50
nikhilyeah, and the idea is that for a library it will be a DB model and not DB table provided by this library21:51
ninagAh ok21:51
nikhilthat way when to do the (live) upgrade is dependent on the prj21:52
nikhilso, I'm inclining towards a lib of that sorts21:52
*** dims_ has quit IRC21:53
nikhilcode that maps to a generic table that defines: Resource R has Usage S and is Nested (N or not S) that has a limit L etc.21:53
vilobhmm11lib should provide quota engine and the db model only21:54
nikhilR becomes instances for nova and volumes for Cinder21:54
nikhil(per se)21:54
nikhilAnyways, we've 5 mins and that was the feedback I'd.21:55
nikhilDuncanT: had a good question earlier that we'd prolly get to before next week's meeting and possibly more brainstorming.21:55
vilobhmm11all this the grammer "Resource R has Usage S and is Nested (N or not S) that has a limit L etc." can be taken care by the quota engine which can be the main component of the quota lib(entity)21:55
vilobhmm11ok so nikhil i think it will be better to start an e-mail thread21:56
vilobhmm11what do other think ?21:56
nikhilAlso, I wanted to ask quickly: Would people like to have a video conference session prior to summit? (~3 weeks from now)21:56
nikhilvilobhmm11: that's a good idea. Let's begin with that.21:56
ninagvilobhmn11, nikhil +1 to both21:57
nikhilAlso, let's try to bring this spec up in next CPL meeting. I think we'd had good structure by then.21:57
vilobhmm11nikhil : yup21:57
nikhilJust so that I ack this question and get a sense if we're waiting for more brainstorm or not:21:58
nikhil"So the thing about reservations is that they go (time out) if the create creates - DuncanT"21:58
DuncanTIf the create crashes21:59
DuncanTIs what I meant21:59
nikhilany takers?21:59
vilobhmm11need to brainstorm this more21:59
nikhilDuncanT: IMO, that's what reservation wants to achieve but may not be what it does atm22:00
nikhilSo, I think reservation should help for non-flat quotas -- something that folks have been quite worries about. Correct?22:00
DuncanTnikhil: That wouldn't entirely surprise me22:00
DuncanTWhat are non-flat quotas?22:01
vilobhmm11non-heirarchical22:01
vilobhmm11is what you meant nikhil right22:01
vilobhmm11by flat22:01
nikhilvilobhmm11: eh, I think we need to get the terminology right there.22:02
nikhilI meant hierarchal flat (non-floating).22:02
nikhilsorry, and we're out of time...22:02
nikhilThanks all for joining!22:02
nikhil#endmeeting22:02
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"22:02
openstackMeeting ended Mon Mar 14 22:02:49 2016 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)22:02
openstackMinutes:        http://eavesdrop.openstack.org/meetings/quotas_wg/2016/quotas_wg.2016-03-14-21.00.html22:02
vilobhmm11thanks all for the feedback22:02
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/quotas_wg/2016/quotas_wg.2016-03-14-21.00.txt22:02
openstackLog:            http://eavesdrop.openstack.org/meetings/quotas_wg/2016/quotas_wg.2016-03-14-21.00.log.html22:02
DuncanTA glossary would be useful for sure22:02
nikhilI think we've 3 types atm:22:03
*** ninag has quit IRC22:03
nikhil1. Simple (is what I'd like to call them) -- are non-hierarchal22:03
nikhil2. Flat (hierarchal but not overcommitting)22:04
nikhil3. Floating (hierarchal and overcommitting)22:04
nikhil vilobhmm11: does that terminology work?22:04
vilobhmm11nope22:04
nikhilwhat am I missing?22:05
vilobhmm11#1. Flat = non-hierarchal #2. hierarchal but not overcommitting  #3. hierarchal and overcommitting22:05
vilobhmm11imho22:05
vilobhmm11the need for hierarchical multitenancy was to overcome the probles exposed by flat project namespace22:05
vilobhmm11so we should not mix flat and hierachical together22:05
vilobhmm11it will be confusing22:05
nikhilsure, what can we call the #2 and #3 ?22:05
nikhilAbsolute and Relative ?22:06
nikhilwe can do that on ML but then it will get trolled22:06
nikhil:D22:06
vilobhmm11overcommit is not closely related to relative22:06
vilobhmm11lets spell it out completely #2. hierarchal but not overcommitting #3. hierarchal and overcommitting22:07
vilobhmm11or by next meeting we can come up with something better22:07
vilobhmm11i can take ownership for that22:07
mc_nairovercommit meaning your setting the quota higher than the resources available for that part of the hierarchy?22:08
nikhilvilobhmm11: my thinking was that to identify if a resource can get space or not, it will need to relate to other sub-prjs resources22:08
nikhilmc_nair: yeah22:08
nikhilmc_nair: like for 10 you give 7 and 7 to 2 sub prjs (making it possibility of 14)22:08
nikhilit's like running airlines! :D22:08
mc_nairnikhil: got it. Thanks22:09
nikhilvilobhmm11: sure, we'd get names as spelling out completely is quite tough for F2F conversations and people will misunderstand things easily before, during & after the summit.22:10
vilobhmm11nikhil : sure22:10
vilobhmm11lets do that..i should come up with a better naming by next meeting..infact will update spec22:10
mc_nairnikhil: and for that would we still force total of 10 with regards to the parent?  So if sub proj A eats up 7, then subproject B can only get to 3?22:10
vilobhmm11and we can see if that sounds ok..and rephrasee it if needed22:11
nikhilvilobhmm11: I couldn't follow you guys today with the reservation talk just because I don't get the terms correct. My personal preference is to come up with explicit grammar if possible into the spec.22:11
nikhilmc_nair: correct22:11
nikhilmc_nair: that's the optimistic part22:11
vilobhmm11nikhil : sounds like a good approach to me22:11
nikhilvilobhmm11: perfect! thank you!22:11
vilobhmm11nikhil : np :)22:11
mc_nairnikhil: good to stay optimistic :) thanks22:14
nikhilmc_nair: haha, yeah.22:14
*** mc_nair has left #openstack-meeting-cp22:16
*** dims has joined #openstack-meeting-cp22:26
*** markvoelker has quit IRC22:39
*** dims has quit IRC22:50
*** smcginnis is now known as smcginnis_away23:08
*** dims has joined #openstack-meeting-cp23:21
*** dims has quit IRC23:27
*** sdake has joined #openstack-meeting-cp23:43
*** sdake has quit IRC23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!