Wednesday, 2017-05-31

*** dasanind_ has joined #openstack-valence08:54
*** lin_yang has quit IRC09:01
*** dasanind has quit IRC09:01
*** dasanind_ is now known as dasanind09:01
*** lin_yang has joined #openstack-valence10:51
*** openstackgerrit has joined #openstack-valence12:15
openstackgerritAkhil jain proposed openstack/valence master: Fixing installation for Ubuntu 16.04  https://review.openstack.org/46136912:15
*** hubian has joined #openstack-valence14:13
*** ntpttr_laptop has joined #openstack-valence14:56
*** ananth_n has joined #openstack-valence14:56
ananth_n#topic valence14:57
*** shuquan has joined #openstack-valence14:57
ntpttr_laptopananth_n: I don't think we have the meeting bot14:58
ananth_nyes :) i didn't mean to hit 'enter' but it happened14:58
shuquanhi guys14:58
hubianhello all14:59
ntpttr_laptophi everyone14:59
ananth_nhi shuquan, hubian14:59
mkraiHi14:59
shuquanlong time no see, ananth :)14:59
lin_yangHello everyone14:59
ananth_nthere's still a couple of minutes, so let's see if anyone else joins14:59
ananth_nshuquan yes :) been busy with a few things.15:00
ananth_nok - i guess we can start15:01
ananth_nmadhuri & i had one agenda item. are there others?15:01
*** ramineni_ has joined #openstack-valence15:02
ntpttr_laptopI think some of the things that anusha was emailing me about would be good to talk about15:02
ntpttr_laptopI CCed a few more folks in that but not everyone here15:02
ntpttr_laptopwrt storage APIs15:02
*** jfding has joined #openstack-valence15:02
hubianseems the mutli-podm talking could be a topic15:02
ntpttr_laptopalso, just to let folks know, I've gotten the okay to spend some more of my time working on this project again, there was a while that I was all focused on another but now I'll be spending time on Valence again15:03
hubianHello jianfeng @jfding15:03
jfdinghi~15:03
ntpttr_laptopso you'll see me around more and I'll spend more time w/ reviews and things15:03
shuquananother topic could be the 2.1 api support15:03
ananth_nntpttr_laptop that is great15:03
lin_yangsound great ntpttr15:03
ananth_nok - shall I begin with the topic that Madhuri  & I had15:03
ntpttr_laptopananth_n: we can start with your and madhuri's item15:03
ananth_nthanks nate15:04
jfding@ntpttr so great15:04
ananth_nwe've been exploring some scalability related items, and it also relates to some extent to multi-podm support15:04
ananth_nbecause we need to add a 'scheduler'15:05
*** Mrittika has joined #openstack-valence15:05
hubianyeah, the scheduler sould be "must to have"15:05
MrittikaHi.15:05
ananth_ni've submitted blueprints for scheduler and Mrittika had submitted one on task manager15:05
ntpttr_laptopI think it can definitely be something simple to start15:05
ananth_nthat's the ones I'm refering to in this context15:05
ntpttr_laptopI think in most cases people will likely rather select pods themselves15:06
ntpttr_laptopthe scheduler being there for backup15:06
MrittikaDid folks have a chance to seethe new blueprints15:06
ntpttr_laptopI'll take a look today, do you have a link?15:06
ananth_nntpttr_laptop that's how we have it today. but we'd want to move that logic into the scheduler15:06
lin_yangmake sense to add scheduler module, will take a look the bp today15:07
ntpttr_laptopananth_n: move which logic?15:07
ntpttr_laptopselecting pods? I think we should keep the ability to choose a pod when composing15:07
lin_yangananth: the same question with ntpttr15:07
ananth_n"people will select pods themselves" to "valence takes that decision"15:07
MrittikaYup15:08
ntpttr_laptopWell Valence might do it as a backup, but I do think we shouldn't take away the ability to make the decision yourself15:08
hubianWe could define a file to store all kinds of "scheduler functions for pod manager" , also we need both support munally select by user and auto select by scheduler15:08
ntpttr_laptopI feel like control over which pod you're composing in is important15:08
ananth_ni'll let Mrittika chip in, she also had some points on this15:08
ramineni_ananth_n: i think both the options are to be provided15:08
MrittikaGood point @ntppttr15:08
mkraiOr we can have both, but the default one would be scheduler making the decision15:08
shuquanagree, there should be multiple scheduler can be configured15:09
hubianyeah ~15:09
ananth_nwe could assume that the scheduler mechanism is the primary, while "user driven" is the exception15:09
ntpttr_laptopsure, just an option in the compose API for selecting a pod, and if it's left blank the scheduler makes the decision15:09
ntpttr_laptopmakes sense15:09
ananth_nto second what mkrai says15:09
shuquanand use some scheduler hit to make the decision by the user15:09
lin_yangif user don't specify any pod, scheduler will decide one15:09
MrittikaOption can be provided for both. Add that to the blueprint15:09
ramineni_ntpttr_laptop: +115:09
mkraintpttr_laptop: +115:10
ananth_nok - so i guess there is agreement there. that was fast!15:10
hubianntpttr_laptop +115:10
ananth_n:)15:10
ntpttr_laptoplink to BP?15:10
ananth_none sec15:10
MrittikaSo here is the use case green field and brown field15:10
ntpttr_laptopI want to open it up in a tab so I get to it today15:10
hubianthat's actually the original design15:10
ananth_nhttps://blueprints.launchpad.net/openstack-valence/+spec/valence-multipodm-scheduler15:10
MrittikaGreen field use case valence installs and pods register with it15:10
ntpttr_laptopsweet thanks15:11
MrittikaBrown field you roll in a rack or new servers in an existing setup15:11
ramineni_i guess hubian already have one implementation in his mult-podm patch?15:12
MrittikaSo discovered pods could be listed on the ui15:12
ntpttr_laptopyeah I'm guessing if Valence is already up and running you'll need to manually add the new pod - and when it's added valence can do a sweep to see what resources it has and add them to the DB?15:12
ntpttr_laptopramineni_ and I had a bit of email correspondence on this15:12
MrittikaNo it registers itself15:12
ntpttr_laptopit's sort of a new topic though15:12
ntpttr_laptopMrittika: how will a pod know how to register itself with valence?15:12
lin_yangMrittika: you mean register it into podm or valence?15:13
MrittikaThe scheduler blueprint is only scheduler15:13
Mrittika@lin_yang valence15:13
ntpttr_laptopI'm not sure what you're saying Mrittika; the user will need to give the new endpoint and credentials of the new pod15:14
hubianyeah , i have the patch for mutli-podm : https://review.openstack.org/#/c/445360/15:14
ntpttr_laptophow will Valence auto-add new pods that happen to come up15:14
mkraiI think admin has to do that part15:14
mkraiAdd new podmanager to valence15:14
ntpttr_laptopme too mkrai15:14
MrittikaWill be adding a blueprint15:14
ntpttr_laptopand then when the new podm is added, valence will automatically discover all the resources it controls15:14
hubian+1 mkrai15:15
MrittikaCan be manual at first15:15
ananth_nwe're considering the option of auto discovery of podms. that part requires PODM to be modified, and is a future path15:15
lin_yang+1 ntpttr valence will discover all resources after podm added15:15
ananth_ncurrently we have a manual method15:15
ntpttr_laptophmm I'm not sure that I agree that the podm software will want to have logic for telling valence about itself15:15
ntpttr_laptopI think it does make more sense for valence to be doing that work, will the folks writing the pod manager even want that stuff to be in the podm?15:16
Mrittikado add a blueprint on that15:16
ananth_nntpttr_laptop, that we have to influence them to do :)15:16
mkraiYes we might in future have some polling service in valence to auto discover new pods15:17
lin_yangand we might need a periodic task to refresh the resource of every podm, so scheduler can depend on that to make decision15:17
ntpttr_laptopananth_n: but I don't think we should tbh15:17
ntpttr_laptopI don't think that really belongs on the podm side15:17
MrittikaGoing back to the scheduler it should be a simple task scheduler with queues15:18
MrittikaHi Ian's multipodm can use this scheduler15:18
ntpttr_laptoplike in OpenStack in general, say the cinder service, storage services aren't auto-registering with it. The open source solution is provided with info on how to connect to the hardware15:18
ntpttr_laptopMrittika: that sounds good15:18
MrittikaSorry hubian15:18
ananth_nfolks, just a quick time check, there's one more topic I need to discuss, and 2 other topics, maybe we can discuss this in an email chain. maybe schedule further voice/IRC meetings?15:19
hubianno need sorry @ mrittika15:19
lin_yangananth: sounds good to me15:19
ntpttr_laptopsure we can move to the next topic15:19
ananth_nMrittika : you wanted to discuss networking15:19
shuquanmove forward15:20
ntpttr_laptopI'd like to talk more about this podm auto-register sometime though15:20
Mrittika Yup15:20
MrittikaAnd storage15:20
hubianI thouth i put a such big change in only one patch , that make these thing more stuff15:20
MrittikaWhich one do we need to implement first15:20
shuquanstorage +115:20
MrittikaOk hubian15:20
ananth_n@ramineni_ i'd sent you a note on networking15:20
ntpttr_laptopMrittika: Can we do both in parallel? I'm happy to do storage15:20
ntpttr_laptopI have the existing patch that I can update15:20
MrittikaOk ntpttr15:21
ramineni_ananth_n: yes, i dont have particular usecase for networking , but im interested in managing all devices in general though15:21
MrittikaWe want a network service and a storage service15:21
hubianI can continue to make up the codes to support mutli-podm in my patch15:21
MrittikaSo each service can then do its own thing15:21
ramineni_Mrittika: can you provide some context, which exact feature you are talking about?15:22
MrittikaThe service is used for configuring, get, set compose storage or networki etc15:22
hubianAbout the redfish and podmanager , seems we do have serval choice @ramineni @ntpttr_laptop15:23
hubiandefine the compose function in redfish.py or in the podmanager.py ?15:23
lin_yangMrittika: besides the valence, new service for network and storage? or new module?15:23
ntpttr_laptophubian: one sec I don't think we're on that topic yet15:23
hubianoo , it is ok ~15:23
ntpttr_laptopMrittika: do you have any other opens on storage/networking?15:23
hubiansorry15:24
ntpttr_laptophubian: no problem :)15:24
MrittikaHubian compose can come from podm now but later redfish will have compose15:24
ntpttr_laptopdo we have someone willing to work on networking and adding that module?15:24
ananth_n@lin_yang our current codebase uses blocking calls. the suggestion is to break this into services, for scalability.15:24
mkraiMrittika is suggesting to redesign valence and introduce new RPC servicces to manage compute, storage, networking etc15:24
MrittikaYes mkrai15:24
ananth_nso we redesign15:24
ananth_nmkrai +115:24
ntpttr_laptopmkrai: whoa whoa whoa why would we touch rpc15:24
ntpttr_laptopwhat's the rationale there, that's a lot of added complexity that we agreed to avoid from the beginning15:25
mkraifor scalabily15:25
MrittikaTo make it scalable15:25
mkrai*scalability15:25
ntpttr_laptopat the end of the day all these services are doing is making API calls and DB calls15:25
MrittikaTo support multipods15:25
ntpttr_laptopI don't think RPC is going to make it more scalable15:26
ntpttr_laptopRPC is used in openstack for talking between many different major services15:26
MrittikaChange API calls to service based15:26
ntpttr_laptopthis would be like cinder adding it's own mini RPC for different storage drivers15:26
mkraiHaving just an API service makes valence non scalable15:26
MrittikaValence needs to be a controller and not driver15:26
mkraintpttr_laptop: We could run multiple instances of scheduler, compute, network etc service to scale valence15:27
MrittikaI don't think we need to conclude today. Think about it15:27
ntpttr_laptopokay, I'm open to looking into it15:27
ntpttr_laptopI just remember having this conversation a few months ago w/ Malini and all and deciding that it was overkill15:27
ntpttr_laptopbut that was before multi-podm maybe15:27
MrittikaYes15:28
MrittikaAnd Malini is not there😀15:28
ananth_nntpttr_laptop i agree, we had decided to keep away from few things. but as you mention, multi podm is a new dimension15:28
mkraiYes we will share an architecture design to all to have a look and provide their input15:28
ntpttr_laptopthat doesn't make what she said invalid though ;)15:28
mkraivia email15:28
lin_yangyep, to make sure everyone fully understand the context at first, please drop us a mail or bp15:28
ntpttr_laptopsounds good mkrai15:28
MrittikaJust joking15:28
ramineni_lin_yang: +115:28
ananth_nmkrai and I had a discussion15:28
ananth_nmkrai +115:29
ananth_nlin_yang sure15:29
hubianwait for the email :)15:29
mkraiSure we will do it soon15:29
ananth_nwe're almost out of time.15:29
hubianthanks ·15:29
ananth_nntpttr_laptop wanted to discuss the mail thread which anusha had initiated15:29
ntpttr_laptopmaybe we need to reserve more time for this meeting in the future?15:29
mkraiyes15:30
MrittikaYes15:30
mkraiand also have meeting in proper format15:30
ntpttr_laptopwe can talk about that over email15:30
MrittikaHow about 1hr15:30
ramineni_ananth_n: ntpttr_laptop: yes15:30
ntpttr_laptopmkrai: +115:30
lin_yangagree one hour make more sense15:30
mkraiChair, meetbot15:30
mkraietc etc15:30
ntpttr_laptopmkrai: we need to reserve a slot in a meeting channel15:30
mkraintpttr_laptop: Yes15:30
ntpttr_laptopI think that would be really helpful15:30
shuquanhow about one hour earlier? :)15:30
mkrailet's have an email for that also15:30
lin_yangmkrai: I remember you have enabled the meetbot before, right?15:31
MrittikaOk bye then15:31
ntpttr_laptopshuquan: half hour earlier?15:31
ntpttr_laptopwe can talk about this on email, I have another meeting :)15:31
shuquanit will be great15:31
ntpttr_laptopthanks everyone15:31
shuquanthanks15:31
lin_yangthanks everyone15:31
hubianhalf hour earlier +115:31
mkrailin_yang:I think it was there in our infra patch15:31
ananth_nbye folks. another meeting to jump15:31
mkraiBut not sure whether we have one or not.15:31
ramineni_bye all15:31
shuquanbye15:31
mkraiBye. Thank you all15:31
*** ramineni_ has left #openstack-valence15:31
ntpttr_laptopbye15:31
*** shuquan has quit IRC15:32
*** ananth_n has quit IRC15:32
hubian@ntpttr @ramineni do you have time to have a talk for the emails on redfish and podm  ?15:33
hubianok , let's continuing this talk by emails15:34
ntpttr_laptophubian: sorry I'm in another meeting now15:34
*** hubian has quit IRC15:35
*** Mrittika has quit IRC15:35
*** ntpttr_laptop has quit IRC16:56
*** ntpttr_laptop has joined #openstack-valence17:34
*** ntpttr_laptop has quit IRC17:35
*** jfding has quit IRC19:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!