*** crushil has joined #openstack-cyborg | 03:15 | |
*** crushil_ has joined #openstack-cyborg | 03:15 | |
*** crushil_ has quit IRC | 03:15 | |
*** mikeH has joined #openstack-cyborg | 03:17 | |
*** mikeH has quit IRC | 03:23 | |
*** masber has quit IRC | 03:32 | |
*** masber has joined #openstack-cyborg | 04:21 | |
*** crushil_ has joined #openstack-cyborg | 04:46 | |
*** crushil_ has quit IRC | 04:51 | |
*** crushil_ has joined #openstack-cyborg | 04:51 | |
*** crushil_ has quit IRC | 05:25 | |
*** crushil_ has joined #openstack-cyborg | 05:31 | |
*** crushil_ has quit IRC | 05:33 | |
*** crushil_ has joined #openstack-cyborg | 05:34 | |
*** masber has quit IRC | 06:13 | |
*** crushil_ has quit IRC | 06:32 | |
*** jkilpatr has quit IRC | 11:00 | |
*** jkilpatr has joined #openstack-cyborg | 11:49 | |
*** jkilpatr has quit IRC | 12:28 | |
*** crushil has quit IRC | 12:53 | |
*** crushil has joined #openstack-cyborg | 13:02 | |
*** crushil has quit IRC | 13:07 | |
*** crushil has joined #openstack-cyborg | 13:08 | |
*** jkilpatr has joined #openstack-cyborg | 13:42 | |
*** zhipeng has joined #openstack-cyborg | 14:23 | |
jkilpatr | howdy everyone | 14:47 |
---|---|---|
*** vipparthy has joined #openstack-cyborg | 14:50 | |
vipparthy | good morning folks | 14:51 |
zhipeng | happy new year folks:) | 14:52 |
*** mpaolino has joined #openstack-cyborg | 14:53 | |
*** Li_Liu has joined #openstack-cyborg | 14:59 | |
zhipeng | ho ho ho | 15:00 |
zhipeng | #startmeeting openstack-cyborg | 15:00 |
openstack | Meeting started Wed Jan 3 15:00:24 2018 UTC and is due to finish in 60 minutes. The chair is zhipeng. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
*** openstack changes topic to " (Meeting topic: openstack-cyborg)" | 15:00 | |
openstack | The meeting name has been set to 'openstack_cyborg' | 15:00 |
*** Yumeng__ has joined #openstack-cyborg | 15:00 | |
zhipeng | meetbot still on vacation ? | 15:00 |
Li_Liu | Happy New Year guys! | 15:01 |
Yumeng__ | Hi | 15:01 |
jkilpatr | happy new year | 15:01 |
zhipeng | #startmeeting openstack-cyborg | 15:02 |
openstack | zhipeng: Error: Can't start another meeting, one is in progress. Use #endmeeting first. | 15:02 |
zhipeng | #startmeeting | 15:03 |
openstack | zhipeng: Error: Can't start another meeting, one is in progress. Use #endmeeting first. | 15:03 |
jkilpatr | meetbot seemed to have worked the first time? | 15:03 |
zhipeng | ah looks like my network's problem | 15:03 |
zhipeng | who do we have here? | 15:04 |
zhipeng | #topic Roll Call | 15:04 |
*** openstack changes topic to "Roll Call (Meeting topic: openstack-cyborg)" | 15:04 | |
zhipeng | #info Howard | 15:04 |
jkilpatr | #info Justin | 15:04 |
mpaolino | #info Michele | 15:05 |
zhipeng | and also #info liliu and yumeng | 15:06 |
zhipeng | #topic Queens Release Prep | 15:07 |
*** openstack changes topic to "Queens Release Prep (Meeting topic: openstack-cyborg)" | 15:07 | |
zhipeng | folks entering Jan we are officially in the mode for release prep | 15:07 |
vipparthy | here is Vipparthy | 15:07 |
zhipeng | so we need to accelerate our progress | 15:07 |
zhipeng | let's run through the open patches, see what is still missing and what could be closed | 15:08 |
zhipeng | #link https://review.openstack.org/#/q/status:open+project:openstack/cyborg | 15:08 |
zhipeng | #info code freeze is Feb 5 | 15:08 |
zhipeng | #info 1. Internal API spec | 15:08 |
zhipeng | #link https://review.openstack.org/525598 | 15:09 |
zhipeng | jkilpatr any update on this one ? | 15:09 |
jkilpatr | zhipeng, waiting on feedback, I'm pretty happy with it. | 15:09 |
zhipeng | i think we should keep it open as we flash out the api/conductor/agent extension update ? | 15:10 |
jkilpatr | sounds good to me, talk about what you want in the review. | 15:10 |
zhipeng | no problem, I think we should go back to the spec after we land zhuli's API patch | 15:11 |
zhipeng | ok next up | 15:11 |
zhipeng | #info 2. CRUD api extension | 15:11 |
zhipeng | #link https://review.openstack.org/527396 | 15:12 |
Li_Liu | #info Li | 15:13 |
zhipeng | TL; DR for this patch is that | 15:13 |
zhipeng | for Queens we will need a working API/DB that implements the resource provider data model | 15:13 |
zhipeng | this patch is the attempt to achieve that | 15:14 |
jkilpatr | I'll review today | 15:14 |
crushil | zhipeng, The generic driver depends on this patch. Once this patch merges, I can add the implementation for the CRUD to the generic driver too | 15:14 |
crushil | And it doesn't have unit tests yet | 15:14 |
zhipeng | so I think as I mentioned before, the implementation should align with jkilpatr's internal API spec | 15:14 |
zhipeng | crushil ya I saw your comment | 15:15 |
zhipeng | I will work with zhuli and let's land this patch this week | 15:15 |
crushil | I have already added create functionality to the generic driver | 15:15 |
jkilpatr | I need to look at my own commit again, it's been a while. | 15:16 |
zhipeng | i know :P | 15:16 |
*** Amol has joined #openstack-cyborg | 15:16 | |
zhipeng | okey without further a due | 15:16 |
zhipeng | #info 3. generic driver | 15:16 |
zhipeng | #link https://review.openstack.org/525057 | 15:16 |
zhipeng | crushil take away | 15:16 |
crushil | So, as I already mentioned this patch depends on https://review.openstack.org/527396 and once that patch merges, I can add functionality for the other use cases for Cyborg. | 15:17 |
zhipeng | we also need unit test for this one right ? I mean later | 15:19 |
crushil | yup | 15:19 |
*** shaohe_feng_ has joined #openstack-cyborg | 15:19 | |
zhipeng | how generic should we expect for the driver when we release it ? Can we have very simple demo on NVIDIA GPU ? | 15:20 |
crushil | That's the goal | 15:21 |
crushil | We can do a simple POC at the OS summit | 15:21 |
zhipeng | cool | 15:21 |
zhipeng | ok now let's move on two the relative two new specs | 15:22 |
zhipeng | #info 4. FPGA data modeling spec | 15:22 |
vipparthy | can you please plan for Demo online, so we can join and view functionality , Thank you | 15:22 |
zhipeng | #link https://review.openstack.org/526559 | 15:22 |
zhipeng | this is actually the spec that zhuli is implementing in his patch | 15:22 |
zhipeng | vipparthy we could discuss that at Dublin PTG for sure | 15:23 |
zhipeng | Li Liu you there ? | 15:23 |
Li_Liu | yup | 15:23 |
vipparthy | Thank you Zhipeng | 15:23 |
zhipeng | Li_Liu | 15:23 |
zhipeng | could you briefly introduce the spec ? | 15:24 |
Li_Liu | sure | 15:24 |
zhipeng | so that everyone gets up to speed | 15:24 |
Li_Liu | Basically, the spec introduces a way to describe hierarchy accelerator structure | 15:25 |
Li_Liu | One of the most typical usage is FPGA | 15:26 |
Li_Liu | We plan to add a new table called Deployables | 15:26 |
Li_Liu | It represent any accelerators that can be discovered/deployed | 15:27 |
Li_Liu | The key is it has 2 pointers, parent_id and root_ir | 15:27 |
Li_Liu | root_id* | 15:28 |
Li_Liu | parent_id points to the parent Deployable row | 15:28 |
Li_Liu | root_id points to the root Deployable row | 15:28 |
Li_Liu | This way, we can form nested tree structures | 15:29 |
Li_Liu | For instance, in the case of FPGA | 15:29 |
Li_Liu | Each FPGA can have multiple Physical Functions | 15:30 |
Li_Liu | Each Physical Functions can have multiple Virtual Functions | 15:30 |
Li_Liu | Also, we have a Attribute table which stores k-v pairs referencing back to the Deployables table | 15:32 |
zhipeng | is this aligned with the nested resource provider spec ? | 15:32 |
Li_Liu | this way, we can track arbitrary type of attributes for generic types | 15:32 |
zhipeng | (which expected to be done in Queens) | 15:32 |
Li_Liu | It does, actually | 15:33 |
zhipeng | cool | 15:33 |
zhipeng | thx for the intro, everyone plz help review the spec | 15:34 |
Li_Liu | the Deployable is counterpart to resource providers in NOVA | 15:34 |
zhipeng | zhuli will also reflect the changes in the spec on the fly | 15:34 |
Li_Liu | Thanks a lot guys | 15:34 |
zhipeng | moving on to the next | 15:35 |
zhipeng | #info 5. Intel's FPGA device driver | 15:35 |
zhipeng | #link https://review.openstack.org/530720 | 15:35 |
zhipeng | shaohe_feng_ could you help introduce the spec ? | 15:36 |
shaohe_feng_ | zhipeng: yes | 15:38 |
shaohe_feng_ | zhipeng: this spec is going to provide the fpga information to the Li_Liu's spec | 15:39 |
shaohe_feng_ | zhipeng: and support a program interface for FPGA | 15:40 |
shaohe_feng_ | When cyborg agent starts or does resource check periodically, the cyborg FPGA driver should enumerate the list of the FPGA devices, and report the details of all available FPGA accelerator on the host. Such as BDF, PID, VID, IMAGE_ID, PF/VF type. | 15:41 |
zhipeng | this has any impact on your work @crushil ? | 15:41 |
shaohe_feng_ | When user uses empty FPGA regions as its accelerator, cyborg agent should call driver's program() interface. Cyborg agent should provide BDF of VF, and local image path to the driver. More details ref | 15:41 |
crushil | I'm not sure | 15:44 |
crushil | I need to look at the spec | 15:44 |
shaohe_feng_ | zhipeng: I'm not familiar with other vendor's FPGA. Not sure we need a virtual FPGA driver interface. | 15:44 |
zhipeng | crushil okey | 15:45 |
zhipeng | shaohe_feng_ I think Li_Liu could help you with the insight of other vendor implementation | 15:46 |
shaohe_feng_ | o, sorry. the driver should can program any FPGA regions not only empty region | 15:46 |
shaohe_feng_ | zhipeng: that's greate | 15:46 |
shaohe_feng_ | will update the spec. | 15:47 |
zhipeng | cool | 15:47 |
zhipeng | okey then we have the last non-priority patch | 15:47 |
zhipeng | #info 6. SPDK driver code | 15:47 |
zhipeng | #link https://review.openstack.org/513704 | 15:48 |
shaohe_feng_ | the agent decide which region need to be re-program. | 15:48 |
zhipeng | the SPDK code is developed by people in my team, so if we could squeeze it in Queens then it would be great, if not it is also not an issue | 15:49 |
zhipeng | will ping you guys when it is ready | 15:49 |
zhipeng | #topic Queens Priorities | 15:49 |
*** openstack changes topic to "Queens Priorities (Meeting topic: openstack-cyborg)" | 15:49 | |
jkilpatr | proof of concept? | 15:49 |
zhipeng | I would suggest the following priorities for this month | 15:49 |
zhipeng | jkilpatr ya like that | 15:49 |
zhipeng | we have patches need to be merged in spdk in the first place to make it work | 15:50 |
zhipeng | but it is non-priority so no hurry on that one | 15:50 |
zhipeng | i will handle that quietly on my side :P | 15:50 |
zhipeng | okey back to priority suggestion | 15:51 |
zhipeng | #info suggestion 1: land LiLiu and zhuli's patch this week | 15:51 |
*** Amol has quit IRC | 15:51 | |
zhipeng | i know there are a lot of reviews to be done, but let's try to crunch it this week | 15:52 |
zhipeng | so that crushil and justin's work could move ahead | 15:52 |
zhipeng | #info suggestion 2: we land justin's and shaohe's spec by the end of next week | 15:52 |
zhipeng | meaning that once we agreed upon the API layer implementation this week, we could crunch out the conductor/agent/driver interface pretty much next Wed | 15:53 |
zhipeng | and we should be okey to have a full picture for the internal API spec, as well as shalhe's driver spec to align with it | 15:54 |
Li_Liu | sounds great | 15:54 |
zhipeng | #info suggestion 3: at the moment we keep the vendor driver code in-tree since there are not a lot | 15:54 |
jkilpatr | I'll give it a go. | 15:54 |
jkilpatr | agreed | 15:54 |
jkilpatr | no reason to make things more complicated until it becomes an issue. | 15:55 |
zhipeng | yep | 15:55 |
zhipeng | anyone else comment on my three suggestions ? | 15:55 |
zhipeng | crushil ? | 16:02 |
crushil | 3 | 16:03 |
crushil | We should keep it in-tree | 16:03 |
crushil | We are not in that position yet to move it out of tree | 16:03 |
vipparthy | zhipeng, who can help me to identify driver specs to be written for different FPGA's in our team ? | 16:04 |
zhipeng | crushil exactly | 16:04 |
crushil | And apologies for delays. I'm in a conference right now | 16:04 |
zhipeng | no problem :) | 16:04 |
zhipeng | vipparthy you could go over the log, there are info points that could help you identify it | 16:05 |
zhipeng | so if there are no other issues, I will close the meeting on time-ish :P | 16:06 |
zhipeng | let's go to work and try to deliver an awesome first release | 16:06 |
*** jkilpatr has quit IRC | 16:06 | |
crushil | \o/ | 16:07 |
*** dims has quit IRC | 16:09 | |
zhipeng | #endmeeting | 16:09 |
*** openstack changes topic to "#openstack-cyborg" | 16:09 | |
openstack | Meeting ended Wed Jan 3 16:09:23 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:09 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_cyborg/2018/openstack_cyborg.2018-01-03-15.00.html | 16:09 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_cyborg/2018/openstack_cyborg.2018-01-03-15.00.txt | 16:09 |
openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_cyborg/2018/openstack_cyborg.2018-01-03-15.00.log.html | 16:09 |
*** dims has joined #openstack-cyborg | 16:10 | |
*** shaohe_feng_ has quit IRC | 16:11 | |
*** zhipeng has quit IRC | 16:13 | |
*** jkilpatr has joined #openstack-cyborg | 16:20 | |
*** jkilpatr has quit IRC | 16:22 | |
*** jkilpatr has joined #openstack-cyborg | 16:23 | |
vipparthy | thank you folks | 16:23 |
*** vipparthy has quit IRC | 16:23 | |
*** Yumeng__ has left #openstack-cyborg | 16:26 | |
*** A_ has joined #openstack-cyborg | 16:50 | |
*** A_ has quit IRC | 16:50 | |
*** mpaolino has quit IRC | 17:01 | |
*** jkilpatr has quit IRC | 18:03 | |
*** jkilpatr has joined #openstack-cyborg | 18:04 | |
*** jkilpatr has quit IRC | 18:40 | |
*** mikeH_ has joined #openstack-cyborg | 18:41 | |
*** mikeH_ has quit IRC | 18:43 | |
*** mikeH_ has joined #openstack-cyborg | 19:07 | |
*** mikeH_ has quit IRC | 19:08 | |
*** mikeH_ has joined #openstack-cyborg | 19:09 | |
*** mikeH_ has quit IRC | 19:10 | |
*** jkilpatr has joined #openstack-cyborg | 20:21 | |
*** am_ has joined #openstack-cyborg | 21:43 | |
*** am_ has quit IRC | 21:44 | |
*** crushil has quit IRC | 22:06 | |
*** crushil has joined #openstack-cyborg | 22:33 | |
*** vipparthy has joined #openstack-cyborg | 22:42 | |
*** vipparthy has quit IRC | 22:42 | |
*** crushil has quit IRC | 22:47 | |
*** crushil has joined #openstack-cyborg | 22:48 | |
*** crushil has quit IRC | 22:51 | |
*** crushil has joined #openstack-cyborg | 22:55 | |
*** crushil has quit IRC | 23:07 | |
*** masber has joined #openstack-cyborg | 23:16 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!