Tuesday, 2016-05-10

*** sdake has joined #openstack-meeting-cp01:02
*** vilobhmm11 has joined #openstack-meeting-cp02:27
*** jokke_ has quit IRC02:45
*** jokke_ has joined #openstack-meeting-cp02:45
*** sdake has quit IRC03:07
*** ebalduf has joined #openstack-meeting-cp03:34
*** vilobhmm11 has quit IRC04:04
*** vilobhmm11 has joined #openstack-meeting-cp04:10
*** vilobhmm11 has quit IRC04:13
*** sdake has joined #openstack-meeting-cp04:13
*** vilobhmm11 has joined #openstack-meeting-cp04:20
*** vilobhmm11 has quit IRC04:25
*** sheel has joined #openstack-meeting-cp04:44
*** sdake has quit IRC05:06
*** vilobhmm11 has joined #openstack-meeting-cp06:34
*** vilobhmm11 has quit IRC07:49
*** belmoreira has joined #openstack-meeting-cp07:51
*** sdake has joined #openstack-meeting-cp09:01
*** ebalduf has quit IRC09:13
*** sdague has joined #openstack-meeting-cp10:12
*** sdake has quit IRC10:42
*** sdake has joined #openstack-meeting-cp11:07
*** dims has quit IRC11:20
*** dims has joined #openstack-meeting-cp11:25
*** sdake has quit IRC11:56
*** sdake has joined #openstack-meeting-cp12:02
*** sdake_ has joined #openstack-meeting-cp12:08
*** sdake has quit IRC12:11
*** amrith is now known as _amrith_12:15
*** itisha has quit IRC12:59
*** _amrith_ is now known as amrith13:43
*** ebalduf has joined #openstack-meeting-cp13:55
*** sigmavirus24_awa is now known as sigmavirus2414:04
*** sigmavirus24 is now known as sigmavirus24_awa14:32
*** sigmavirus24_awa is now known as sigmavirus2414:33
*** sigmavirus24 is now known as sigmavirus24_awa14:35
*** sigmavirus24_awa is now known as sigmavirus2414:37
*** belmoreira has quit IRC14:40
*** tyr has joined #openstack-meeting-cp14:44
*** piet has joined #openstack-meeting-cp15:03
*** tyr has quit IRC15:11
*** tyr_ has joined #openstack-meeting-cp15:11
*** mageshgv has joined #openstack-meeting-cp15:13
*** tyr__ has joined #openstack-meeting-cp15:27
*** hemnafk is now known as hemna15:27
*** tyr_ has quit IRC15:30
*** sdake_ has quit IRC15:47
*** sdake has joined #openstack-meeting-cp15:50
*** sdake_ has joined #openstack-meeting-cp15:54
*** sdake has quit IRC15:57
*** sdake_ is now known as sdake16:38
*** flaper87 has quit IRC16:46
*** flaper87 has joined #openstack-meeting-cp16:46
*** flwang1 has joined #openstack-meeting-cp16:58
*** vilobhmm11 has joined #openstack-meeting-cp17:00
nikhilo/17:00
vilobhmm11Courtesy quotas-wg meeting reminder: nikhil, vilobhmm, DuncanT, mc_nair, ninag, amrith17:01
vilobhmm11hi all17:01
vilobhmm11#startmeeting quotas-wg17:01
openstackMeeting started Tue May 10 17:01:19 2016 UTC and is due to finish in 60 minutes.  The chair is vilobhmm11. Information about MeetBot at http://wiki.debian.org/MeetBot.17:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.17:01
vilobhmm11hi all17:01
nikhilola17:01
*** openstack changes topic to " (Meeting topic: quotas-wg)"17:01
openstackThe meeting name has been set to 'quotas_wg'17:01
nikhilo/17:01
vilobhmm11hi nikhil :)17:01
pieto/17:01
flwang1o/17:01
amrith./17:01
nikhil#info agenda - https://etherpad.openstack.org/p/quotas-wg-meeting-agenda17:02
amrithDuncanT was looking for meeting time a short while ago17:02
vilobhmm11welcome everyone ..lets start17:02
*** gjayavelu has joined #openstack-meeting-cp17:02
vilobhmm11#topic sync on status17:02
*** openstack changes topic to "sync on status (Meeting topic: quotas-wg)"17:02
vilobhmm111. last week we created a launchpad page for delimiter17:03
vilobhmm11https://launchpad.net/delimiter17:03
*** Qijing has joined #openstack-meeting-cp17:03
vilobhmm112. We also have source code here17:03
vilobhmm11https://github.com/vilobhmm/delimiter17:03
* DuncanT waves17:03
vilobhmm11setting up new project in openstack takes some time so meanwhile code will reside here https://github.com/vilobhmm/delimiter and then we can migrate under the openstack repo17:04
vilobhmm11itisha is working on the effort to set things up for delimiter17:04
vilobhmm11#3. a summary of decisions made in the design summit was sent out to the ML17:05
nikhil#info itisha is working on the effort to set things up for delimiter17:05
vilobhmm11http://osdir.com/ml/openstack-dev/2016-05/msg00393.html17:05
vilobhmm11link for the summary sent to ML17:05
vilobhmm11that were the updates from last week…so spending time to get things going by doing some ground work17:06
vilobhmm11anyone has any questions, suggestions till now ?17:06
vilobhmm11for every meetings agenda we maintain this etherpad https://etherpad.openstack.org/p/quotas-wg-meeting-agenda17:07
vilobhmm11we have detailed out today's agenda here https://etherpad.openstack.org/p/quotas-wg-meeting-agenda please check17:07
vilobhmm11we will directly move on to #6 now as its kind of high priority17:07
vilobhmm11#agenda Discussion on features for Newton 17:07
vilobhmm11so I have few suggestions ; need feedback from the team17:08
vilobhmm11For Newton we should focus on :-17:08
vilobhmm11#1. Enforce Quota : Get inputs from respective projects and enforce quota.17:08
vilobhmm11which involves17:08
vilobhmm11#1.1. Design Quota Engine17:08
vilobhmm11#1.2. Basic Quota Engine Objects17:09
flwang1do we need to talk about #5?17:09
vilobhmm11flwang : sure we can but it will be a subpart in #6 imho17:09
vilobhmm11since its more of a implementation detail and we will discuss this as part of features17:10
vilobhmm11does that makes sense ?17:10
vilobhmm11#1.3 Unit Tests17:10
flwang1vilobhmm11: ok, cool17:10
*** sudipto has joined #openstack-meeting-cp17:10
vilobhmm11#1.4  Functional Tests17:10
vilobhmm11#1.5 Document changes17:10
vilobhmm11#1.6 Seperate driver for different project models or single driver to handle all the different project models (flat, nested)17:11
vilobhmm11we can discuss #1.6 first since we have seen interest in that17:11
nikhilno, let's go one by one please17:12
vilobhmm11ok17:12
nikhilwhat is the purpose of this section?17:12
nikhilare we trying to generate action items out of it?17:12
nikhilor are we going to discuss use cases?17:12
vilobhmm11both…for few you don't need use-cases for example designing quota objects..but for few you do need…1.617:13
vilobhmm11we would want to have some action items to get things done17:13
vilobhmm11nikhil : ^^17:14
nikhilok, then I would encourage to split these two things17:14
vilobhmm11ok17:14
nikhilmostly as we've a lot of interest in this work17:14
nikhilwhile one sub-team works on foundational stuff17:14
nikhilothers can focus on seeing the feasiblity of adoption17:14
nikhiljust trying to get a sense of whether the bare minimul will work for any one project?17:15
vilobhmm11so first of all thats what i wanted to ask; does these features makes sense; is it too much; too less;  ?17:15
nikhilbasically, do we need to start discussing if any project wants to adopt it in newton?17:15
vilobhmm11glance :)17:15
vilobhmm11ha17:16
*** amrith is now known as _amrith_17:16
nikhilok, so for glance I think we've 3 people here :)17:16
vilobhmm11cool17:16
nikhilflwang1: sudipto and me17:16
DuncanTI hope to do a POC patch for cinder using it, though I don't expect it to get merged in Newton17:16
*** _amrith_ is now known as amrith17:16
nikhilwe would like to figure out what we can do in glance and in here to get started17:16
vilobhmm11DuncanT : good to know that..that will be nice17:16
nikhilthat way we don't step on each others toes and also the progress of lib isn't halted17:17
nikhil(that's the requirements part)17:17
DuncanTMy employer seems determined to fill my time with other things though, so it is a background task17:17
DuncanTMostly I just want to make sure the library isn't shaping up in a way that makes it impossible to use in cinder17:17
nikhilthe more important question is how can be craft the foundational work17:17
vilobhmm11so nikhil, sudipto, flwang1 : what are your expectations; requirements from the lib for newton (that can be achieved in newton timeframe)?17:17
vilobhmm11let me frame it in different way17:18
nikhilI think DuncanT and I are saying the same thing17:18
vilobhmm11the earlier question17:18
vilobhmm11ok17:18
vilobhmm11we would like to keep it more generic and not specific to a project as we discussed in design summit17:18
flwang1i'm thinking if we(zaqar) can adopt as well for limiting queue number17:18
vilobhmm11flwang1 : thats nice17:19
vilobhmm11nikhil, DuncanT, others : because if you see the api's exposed by library17:19
vilobhmm11check_quota(usage_details, objects/tables to operate upon, generation-id)17:20
vilobhmm11which is quite generic and most of the things are provided by respective projects17:20
nikhilok17:20
DuncanTI still a little fuzzy on the generation stuff, but I will read up some more before asking questions - I'll be clear by next week, one way or the other.17:21
DuncanTOther than that, the design looks ok at a first look17:22
nikhilin a gist, gen_id should work for you unless you want reservation17:22
amrithDuncanT, drop me a note if you have q's about that17:22
vilobhmm11DuncanT : https://review.openstack.org/#/c/283253/ - generation-id stuff details17:22
flwang1vilobhmm11: : i'm repeating DuncanT's words. where to get the generation info? keystone?17:22
amrithno17:22
flwang1what happened if there is no HM17:22
Qijingme too, I need to understand how generation to ensure sequencing17:22
amrithgeneration infor should be in the library/delimiter17:22
amrithand NEVER exposed17:22
nikhilvilobhmm11: we need documentation on the generation_id work17:22
DuncanTamrith: I plan too :-) Thanks17:23
vilobhmm11flwang1 : https://review.openstack.org/#/c/283253/ - more details17:23
nikhillooks like our first action item17:23
flwang1vilobhmm11: cool, thanks17:23
nikhilvilobhmm11: I think sudipto can help us get some official doc page on the gen_id stuff17:23
nikhilhe was looking at things from nova perspective17:24
vilobhmm11amrith : shouldn't the generation-id info be passed from the caller ? since it is associated with a point in time view of resource that the project has seen17:24
nikhilflwang1: and I can discuss it for glance17:24
flwang1nikhil: awesome17:24
vilobhmm11nikhil : that would be great; if not i can include one in the repo17:24
amrithvilobhmm11, No17:24
Qijingit looks the generation-id is used internally17:25
vilobhmm11amrith : may be then i am missing something; please clarify17:25
nikhilgen_id seems like something in the lib as it involves info/comput of the resource limits/usage17:25
amrithrather than doing it here, maybe a short writeup that you can put in your doc?17:25
vilobhmm11amrith : that works; will connect after the meeting17:26
nikhilplease create a etherpad17:26
nikhil(at least)17:26
vilobhmm11#action vilobhmm to come up with a doc explaining about generation-id and how it will be used by projects consuming delimiter17:26
vilobhmm11#action vilobhmm send out for review the generation id stuff and get feedback…include it under docs section of https://github.com/vilobhmm/delimiter17:27
nikhilI think we also need a etherpad explaining the foundational stuff17:27
nikhilcheck_ enforce_ delete_ quotas17:28
vilobhmm11nikhil : i thought thats already covered in the spec17:28
vilobhmm11https://review.openstack.org/#/c/28445417:28
vilobhmm11or if its not clear in spec i can update the spec with more details17:29
nikhilok, let's chat after the meeting on this.17:29
vilobhmm11please suggest and i can have an action item for it; whatever is easier17:29
*** gjayavelu has quit IRC17:29
vilobhmm11sure17:29
vilobhmm11nikhil : do you still want to have a discussion on which project want to consume delimiter and then talk about features for newton ?17:30
vilobhmm11nikhil, flwang1, sudipto : ^^17:30
vilobhmm11i am open to options17:31
nikhilvilobhmm11: I want to talk about #2, 3, 4, 5 from etherpad17:31
nikhilthat is all related to glance17:31
nikhiland that is somewhat tied to foundational stuff17:31
nikhil(bare min required to get things rolling in glance)17:31
vilobhmm11nikhil sure…may be we can revisit #6 in next meeting then17:32
nikhilworks for me17:32
vilobhmm11#action : discuss about #6 from 05/10 agenda on 05/17 https://etherpad.openstack.org/p/quotas-wg-meeting-agenda17:32
vilobhmm11nikhil : lets talk about #2,3,417:33
vilobhmm11over to you17:33
nikhil#topic updates17:33
nikhilSo, the update is that glance team thinks it's a 6 month job to implement quotas (nested) and 5mo (for simple -- extending existing logic)17:34
nikhilI wanted to get feedback from other teams on that perspective.17:34
*** sudipto has quit IRC17:35
vilobhmm11imho thats correct…if that includes detailed unit tests, functional tests17:35
nikhilFrom the spec, it looks like the library will be a thin layer and we can implement it in 6 weeks. But the research for some projects like nova shows it may not be the case.17:35
nikhilwell, development ideally should be TDD17:35
vilobhmm11nikhil : +2 for TDD17:36
nikhil(I want to avoid unit tests as something separate from normal code proposals)17:36
flwang1a silly question, will the lib talk to database layer?17:36
nikhilso, do we think we can get the lib running in 6 weeks?17:36
nikhilyes17:36
nikhilflwang1: yes17:37
nikhil(API <-> lib <-> DB)17:37
vilobhmm11flwang1 : yes; althought it won't maintain any db of its own17:37
flwang1nikhil: wow, if so, it may impact a lot and i think it's a little bit hard to complete in 6 weeks17:37
flwang1since it will impact the api17:37
nikhilI am talking about the POC17:37
nikhilit should not impact API17:38
vilobhmm11i agree with flwang117:38
vilobhmm11nikhil : for 6 weeks we need more people17:38
nikhilvilobhmm11: we've at least 6 people here who can contribute!17:38
nikhiland that's why I wanted to break down dependencies17:38
vilobhmm11ok thats gr8 then if everyone can actively contribute and we have deliverable plans for every week it should be do-able17:39
vilobhmm11nikhil : ^^17:39
nikhilbasically for glance to even try to do this in newton, we need the lib ready to be adopted before june 1517:39
vilobhmm11ok17:40
nikhilvilobhmm11: that would be awesome, if we can discuss the foundational stuff once done by you we can diversify the tasks17:40
vilobhmm11nikhil : i didn't get that17:40
vilobhmm11for me the foundational stuff include17:41
vilobhmm11quota engine17:41
nikhilvilobhmm11: we can chat more on the logistics after the meeting. I just want us to think us in terms of lego pieces and not the entire workflow atm.17:41
vilobhmm11basic set of api's to be exposed to outside world check_quota, enforce_quota17:41
*** sudipto has joined #openstack-meeting-cp17:42
vilobhmm11nikhil : sure need to define foundational stuff :) as it means different for different people…please carry on17:42
nikhilthanks!17:42
nikhil#topic     Complexity comparison of independent quota implementation and nested (non-floating) one17:42
DuncanTOnce there's enough defined for me to start bashing out code, I'll look at the db migration issue17:42
nikhilSo, glance (and may be other prjs) implement quota as aconfig value17:43
DuncanTSorry, should have left that until AoB17:43
nikhilwhich is something I defined as a comment onthe spec17:43
nikhilvilobhmm11: how complex do you think it will be to accomodate what exists for ops in prod env today?17:43
nikhilbasically, if you see the response from Tim Bell to the email thread started by you17:44
nikhilhe wants us to implement delimiter that will keep business logic consistent for different drivers17:44
nikhil(and that is somewhat tied to the design question #5)17:45
vilobhmm11sure17:45
DuncanTIf you use different drivers (nested, not nested, etc) then they need a consistent data model anyway, for when an operator wants to move from one to the other17:45
nikhilexactly17:46
nikhiland I think that's too complex17:46
nikhilvilobhmm11: ?17:46
vilobhmm11DuncanT, nikhil : trying to understand the problem here17:47
vilobhmm11why having different drivers will be a problem17:47
nikhilsay if the operator today are using config to enforce quota (comsumption calculated using something like a "file" command)17:47
vilobhmm11ok17:48
DuncanTvilobhmm11: Operators using one driver (e.g. flat) will want to be able to move to e.g. nested in the future, without downtime (at least in cinder, nova)17:48
nikhilif we move to nested, that logic will be different17:48
nikhil:-)17:48
nikhilsee this ties with upgrade story17:48
nikhilwe need to break things down, now17:49
vilobhmm11nikhil, DuncanT : the way i had implemented it was that the source of truth for both flat and nested remains the same17:49
nikhilbefore we are stuck arguing later17:49
*** sudipto has quit IRC17:49
vilobhmm11just that in case of nested we have few more attributes to the tables into consideration than the flat approach17:49
*** gjayavelu has joined #openstack-meeting-cp17:50
nikhilbut it's not just flat that people will be using17:50
vilobhmm11so lets say if we admin wants to move from "flat" => "nested" then can something be done to take these additional attributes into consideration for computation17:50
nikhilthere's a ton of combinations that one can have while using quotas in production17:50
nikhilthe business logic should be opaque as far as library is concerned17:51
*** gjayavelu has quit IRC17:51
nikhillike jay said at the summit, this is thin wrapper on top of DB tables17:52
DuncanTvilobhmm11:  In the cinder case, we've also got values in the existing db tables for quota limits that we need a way of live migrating across on a running system17:52
vilobhmm11or lets say if we have seperate drivers then changing the driver in config to use for quota computation can help for example for "flat" => dbquotadriver whereas for nested => nesteddbquotadriver and the driver will have the business logic….which will be opaque (since its already getting all the inputs from consuming project) …the lib won't be smart enough todistinguish this data is coming from which project17:53
DuncanTvilobhmm11: Calling all the tables 'delimiter_*' and having a 'get_existing_limits' config controlled callback will take care of the live upgrade, among designs17:53
DuncanTvilobhmm11: The different  logics need to be kept in rough sync htough, so one can consume the other's data17:54
vilobhmm11DuncanT : delimiter won't own any value in db; all the db migration and stuff is individual project responsibility17:55
vilobhmm11delimiter will consume from what exist in the project database and rely on that17:55
nikhilvilobhmm11: can you please add a research action item here? we need to send out to resp folks to get inputs from their projects I think.17:55
DuncanTvilobhmm11: It needs to be able to handle schema differences between projects then17:55
nikhilI realize that piet is here and didn't want to consume all the time for my topic when he wants to discuss UX aspects17:56
piet;^)17:56
vilobhmm11#action : start ML discussion about Seperate driver for different project models or single driver to handle all the different project models (flat, nested). - nikhil17:56
nikhilworks, thanks.17:56
vilobhmm11hi piet17:56
pietHi!17:56
vilobhmm11please go ahead17:57
vilobhmm11we just have 5 more min before we wrap up17:57
vilobhmm11and realized we don't have time for open discussion today17:57
pietSo, I’m the current PTL for the OpenStack UX project.17:57
pietWe’re going down the path of identifying research needs for the next six months.17:57
vilobhmm11DuncanT : will chat with you on this after the meeting17:57
pietI'd like to focus on cross-project quotas since it was raised as an issue by operators17:58
pietInlcuding operators from places like BestBuy and TWC17:59
pietThere are several different research methodologies we can use, eg interviews or usability studies, that can be used based on the project’s specific needs.17:59
vilobhmm11piet : sure that would be great17:59
*** vilobhmm11 has quit IRC17:59
pietWe need to start hammering on ways to use the time17:59
nikhilI would really like that input piet18:00
nikhilbasically -- are people happy with what's currently out there and if not, how can we make it better18:00
pietFor example, there is a ton of value in just watching operators complete tasks with quotas18:00
pietnikhil Yep, helps to prioritize efforts.18:01
pietI have a meeting with one of you this week, but will roll-out the research plan to the rest of the group for revieww18:01
pietIs that cool with you?18:02
pietCan also start a discussion through the ML18:03
nikhilpiet: would you be able to join us next week?18:03
pietAt this point, I just need to understand whether you would like a slot before the next summit - otherwise, I'll give it to another project18:03
pietnikhil yep18:04
nikhilwe can discuss UX stuff first so that you don't have to wait the full hour.18:04
piet;^)18:04
nikhilvilobhmm seems disconnected18:04
nikhilpiet: I think the research study seems essential18:04
pietDoes the group have an active ML?18:04
pietnikhil k18:05
pietI think we're five over...18:05
nikhilpiet:  subscription to [cross-project] [quota] [delimiter] on openstack-dev18:05
nikhilyeah :)18:05
nikhilthanks all18:05
pietCheers18:05
nikhil#endmeeting18:05
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"18:05
openstackMeeting ended Tue May 10 18:05:49 2016 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)18:05
openstackMinutes:        http://eavesdrop.openstack.org/meetings/quotas_wg/2016/quotas_wg.2016-05-10-17.01.html18:05
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/quotas_wg/2016/quotas_wg.2016-05-10-17.01.txt18:05
openstackLog:            http://eavesdrop.openstack.org/meetings/quotas_wg/2016/quotas_wg.2016-05-10-17.01.log.html18:05
*** tyr_ has joined #openstack-meeting-cp18:23
*** tyr__ has quit IRC18:26
*** mestery has quit IRC18:45
*** mestery has joined #openstack-meeting-cp18:47
*** sdake has quit IRC18:52
*** rockyg has joined #openstack-meeting-cp18:53
*** piet has quit IRC18:58
*** xyang1 has joined #openstack-meeting-cp19:02
*** piet has joined #openstack-meeting-cp19:13
*** amrith is now known as _amrith_19:16
*** diablo_rojo has joined #openstack-meeting-cp19:29
*** tyr__ has joined #openstack-meeting-cp19:38
*** tyr_ has quit IRC19:40
*** flwang1 has quit IRC19:42
*** piet has quit IRC19:51
*** _amrith_ is now known as amrith20:11
*** tyr_ has joined #openstack-meeting-cp20:15
*** tyr__ has quit IRC20:18
*** ebalduf has quit IRC20:27
*** diablo_rojo has quit IRC20:28
*** mriedem has joined #openstack-meeting-cp20:57
*** ametts has joined #openstack-meeting-cp20:59
*** hongbin has joined #openstack-meeting-cp21:00
*** vgridnev has joined #openstack-meeting-cp21:00
*** thingee has joined #openstack-meeting-cp21:07
thingeeno cross-project meetings - times are a changing http://lists.openstack.org/pipermail/openstack-dev/2016-May/094443.html21:07
thingeestandby for more things with cross-project stuff on the ML tho21:08
*** tyr__ has joined #openstack-meeting-cp21:09
*** tyr_ has quit IRC21:11
*** xyang1 has quit IRC21:12
*** rockyg has quit IRC21:15
*** ebalduf has joined #openstack-meeting-cp21:16
*** ametts has quit IRC21:17
*** flwang1 has joined #openstack-meeting-cp21:39
*** Qijing has quit IRC21:42
*** mriedem has quit IRC21:52
*** hongbin has left #openstack-meeting-cp21:59
*** mageshgv has quit IRC22:07
*** markvoelker_ has joined #openstack-meeting-cp22:10
*** sigmavirus24 is now known as sigmavirus24_awa22:10
*** piet has joined #openstack-meeting-cp22:14
*** sheel has quit IRC22:15
*** sdake has joined #openstack-meeting-cp22:22
*** markvoelker_ has quit IRC22:32
*** raildo is now known as raildo-afk22:38
*** diablo_rojo has joined #openstack-meeting-cp22:58
*** diablo_rojo has quit IRC23:08
*** diablo_rojo has joined #openstack-meeting-cp23:14
*** hemna is now known as hemnafk23:20
*** sdague has quit IRC23:21
*** sdake has quit IRC23:30
*** sdake has joined #openstack-meeting-cp23:38
*** piet has quit IRC23:51

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!