| *** zhurong has quit IRC | 00:52 | |
| *** ikuo_o has joined #openstack-cyborg | 01:01 | |
| openstackgerrit | Merged openstack/cyborg master: Dropping the py35 testing https://review.opendev.org/659898 | 01:34 |
|---|---|---|
| *** Sundar has quit IRC | 01:39 | |
| openstackgerrit | Merged openstack/cyborg-specs master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/654984 | 01:54 |
| openstackgerrit | Merged openstack/cyborg-specs master: Use opendev repository https://review.opendev.org/654924 | 01:56 |
| openstackgerrit | Merged openstack/cyborg-specs master: Change openstack-dev to openstack-discuss https://review.opendev.org/622031 | 01:56 |
| *** yikun has joined #openstack-cyborg | 01:56 | |
| *** Sundar has joined #openstack-cyborg | 02:45 | |
| *** wangzhh has joined #openstack-cyborg | 02:53 | |
| *** Biwei has joined #openstack-cyborg | 02:59 | |
| Sundar | Hi wangzhh, Biwei | 03:01 |
| Biwei | Hi Sundar | 03:01 |
| Sundar | Let's wait a couple of min for folks to join | 03:01 |
| ikuo_o | Hi Sundar, Biwei | 03:01 |
| Sundar | Hi ikuo_o | 03:01 |
| yikun | Hi | 03:01 |
| Sundar | Hi yikun | 03:01 |
| Li_Liu | Hi Sundar | 03:02 |
| Sundar | Hi Li_Liu | 03:02 |
| wangzhh | Hi Sundar. | 03:02 |
| Sundar | #startmeeting openstack-cyborg | 03:02 |
| openstack | Meeting started Wed Jun 12 03:02:29 2019 UTC and is due to finish in 60 minutes. The chair is Sundar. Information about MeetBot at http://wiki.debian.org/MeetBot. | 03:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 03:02 |
| *** openstack changes topic to " (Meeting topic: openstack-cyborg)" | 03:02 | |
| openstack | The meeting name has been set to 'openstack_cyborg' | 03:02 |
| Sundar | #topic Roll call and agenda | 03:02 |
| xinranwang | Hi all | 03:02 |
| *** openstack changes topic to "Roll call and agenda (Meeting topic: openstack-cyborg)" | 03:02 | |
| Sundar | #info Sundar | 03:02 |
| wangzhh | #info wangzhh | 03:03 |
| Biwei | #info Biwei | 03:03 |
| ikuo_o | #info ikuo_o | 03:03 |
| yikun | #info yikun | 03:03 |
| Sundar | Agenda: https://wiki.openstack.org/wiki/Meetings/CyborgTeamMeeting#Agenda | 03:03 |
| xinranwang | #info xinranwang | 03:03 |
| Sundar | Anything to add to agenda? | 03:03 |
| Sundar | #topic Cyborg CI | 03:04 |
| *** openstack changes topic to "Cyborg CI (Meeting topic: openstack-cyborg)" | 03:04 | |
| Sundar | As we have said, we need two things to merge Nova patches: Nova functional test with fake Cyborg API, and tempest CI with fake driver | 03:05 |
| Sundar | Taking the tempest one first, xinranwang and Biwei are working on the general framework and plugins. | 03:05 |
| Sundar | For the fake driver, yikun has kindly agreed. But he needs help. I'll help as much as I know. | 03:06 |
| Sundar | It would be great if others can also help him out. | 03:06 |
| Sundar | yikun, please feel free to ask questions. | 03:06 |
| Sundar | ANy comments or questions on fake driver and/or tempest? | 03:07 |
| Li_Liu | #info Li_Liu | 03:07 |
| ikuo_o | Thanks Yikun. | 03:07 |
| yikun | I still don't know what is the real requirement of fake driver. I assume it's just a driver that will return empty or just pass | 03:07 |
| xinranwang | Biwei and I are working on the tempest test case and general framework. We will test them in real env, once the fake driver is implemented, yikun can use these testcases. | 03:07 |
| yikun | and also, we should merge these two patch, :) https://review.opendev.org/#/c/658986 https://review.opendev.org/#/c/658987 | 03:08 |
| yikun | and then I can append the patch base on these two | 03:08 |
| xinranwang | real env means an openstack env with fpga | 03:08 |
| Sundar | yikun: The fake driver ill be a derivative of the generic driver, which will return some pre-defined driver OVO for discover() | 03:08 |
| yikun | Sundar: ok, will summit a patch this week, and any detail comments can be happened in the patch | 03:09 |
| Sundar | It can return success or NULL for other APIs. | 03:09 |
| Sundar | yikun: Great, thanks. Please ensure the fake driver is added to the tempest repo. | 03:10 |
| yikun | Sundar: got it | 03:10 |
| Sundar | Now, for the Nova functional test | 03:10 |
| Sundar | Can somebody take that up? | 03:11 |
| Sundar | It will just mock the Cyborg APIs called by Nova -- get device profile, post/patch/delete ARQs | 03:11 |
| yikun | “Please ensure the fake driver is added to the tempest repo.” not sure why it is tempest repo? | 03:12 |
| yikun | I thought it should be in cyborg repo | 03:12 |
| Biwei | yikun, there's a cyborg-tempest-plugin repo, living outside of the cyborg repo | 03:13 |
| Sundar | The tempest plugins are going to call that fake driver. | 03:14 |
| xinranwang | Sundar: what should fake driver return exactly, the info returned by this fake driver will be used in nova to boot vm, right ? | 03:14 |
| Sundar | xinranwang: Yes. Its discover() API should return a pre-defined device OVO object | 03:15 |
| yikun | Biwei: OK, https://github.com/openstack/cyborg-tempest-plugin | 03:15 |
| xinranwang | Sundar: tempest has api test and scenario test, those 2 types only interact with API layers, I don't think tempest should call driver directly. | 03:15 |
| Sundar | It could define a device with soem fake controlpath-IDs, 1 deployable and an attach handle, all with fake PCI addresses | 03:15 |
| xinranwang | Biwei: what do you think? | 03:15 |
| xinranwang | Sundar: yes, but what info stored in this OVO, like pci address | 03:16 |
| Biwei | tempest will not call driver directly | 03:16 |
| Sundar | Can be totally bogus PCI addresses. The VM may not boot up without the hardware. | 03:17 |
| Sundar | To quote Eric Fried: "It should be sufficient to wait for the instance to go ACTIVE (according to Nova) (which will happen even if the guest OS boot pukes) and scrape its domain XML to assert that the correct PCI devices are present." | 03:17 |
| yikun | Biwei: how to call driver directly, shouldn't it call cyborg api and cyborg api call the fake driver | 03:18 |
| Sundar | Biwei Yes. Not sure if the CYborg agent will call driver API in tempest env, as it happens in real env | 03:19 |
| Biwei | Sundar in tempest test, we only need to call the cyborg restful APIs. | 03:20 |
| Sundar | The API invocation need not even call the driver -- as long as the driver has reported the device(s). | 03:20 |
| yikun | Biwei: "Sundar in tempest test, we only need to call the cyborg restful APIs." < Yes, so the fake driver should be in cyborg repo, right? | 03:21 |
| yikun | and tempest should do something config the cyborg to use the fake dirver | 03:21 |
| Sundar | Biwei, if there were some way to set up the Cyborg database in tempest env, like I did with initial_setup.sh in pilot code, we may not even need a fake driver perhaps | 03:21 |
| Sundar | Have you seen if tempest can run some script to set up the env? | 03:22 |
| xinranwang | I have some discussion with others like Alex, Shaohe. We are not sure if the status will switch to active in that case. I test in local with fake device, it failed. | 03:22 |
| Biwei | I haven't figured that out yet. I have done the steps including creating flavor and update the flavor with device and all working so far | 03:22 |
| Biwei | but not sure how to do the database set up | 03:23 |
| xinranwang | tempest run in an installed openstack env where already have cybrog db, every thing same as a real env | 03:24 |
| Sundar | xinranwang: True, I think it goes to error state. However, if we can do 'virsh dumpxml' equivalent and look for the hostdev device, that should be good enough | 03:24 |
| xinranwang | Sundar: yes, I agree, but nova api will return error directly to tempest. where should we got the xml from virt driver. | 03:26 |
| Sundar | Can you run a comand like 'virsh dumpxml'? | 03:26 |
| xinranwang | you mean in tempest? | 03:27 |
| Sundar | Yes | 03:27 |
| xinranwang | I am not sure if libvirt will really boot it, I wonder that libvirt may do pci | 03:28 |
| xinranwang | I am not sure if libvirt will really boot it, I wonder that libvirt may do pci check first before boot a vm | 03:29 |
| Sundar | I have tried to launch a VM inside a development VM. It will error out but the VM exists in error state as shown by 'openstack server list' | 03:29 |
| Sundar | Then we can look at Nova logs | 03:30 |
| Sundar | You are right, the instance won't launch -- so can't do 'virsh dumpxml' | 03:31 |
| openstackgerrit | tonybrad proposed openstack/cyborg master: Move to releases.openstack.org https://review.opendev.org/664774 | 03:31 |
| xinranwang | I know, the xml file is generate before calling libvirt. Have you run virsh list to see if the instance exists. | 03:31 |
| Sundar | The 'virsh list' won't show the instance -- so we should scrap that idea. I used to look at Nova logs. But I also modify the LOG statement in Nova virt driver to dump the xml all the time | 03:32 |
| Sundar | We should probably ask other projects that use hardware. I'll get back on this. | 03:33 |
| xinranwang | Ok, we should find another way. | 03:34 |
| Sundar | Even if it fails in a predictable way, we can look for that specific error in n-cpu logs and declare success. | 03:35 |
| Sundar | OK, let's table it for now. | 03:35 |
| Sundar | #topic Python 3 migration | 03:35 |
| *** openstack changes topic to "Python 3 migration (Meeting topic: openstack-cyborg)" | 03:35 | |
| xinranwang | Yes, of course. I agree with you. That was what I did when I don't have devices lol | 03:35 |
| Sundar | ikuo_o and all: are there any questions or comments on Py3 migration? | 03:36 |
| yikun | The fake driver in my mind it's that: we implement a fake driver in *Cyborg driver*, and tempest set the CONF.agent.enabled_drivers to this fakedriver when test setup. | 03:36 |
| yikun | And the tempest can test the case which the fake driver can complete, such as some cyborg API, but for Nova-cyborg intergration test, we should run in real env. | 03:36 |
| yikun | [1] https://github.com/openstack/cyborg/blob/master/cyborg/agent/resource_tracker.py#L57 | 03:36 |
| ikuo_o | We just fixed stable/stein cord. | 03:37 |
| ikuo_o | and will throw patches in some days. | 03:38 |
| Sundar | ikuo_o: Great. Was that much work? | 03:38 |
| Sundar | Will look for the patches. | 03:39 |
| Sundar | #topic Cyborg client migration | 03:39 |
| *** openstack changes topic to "Cyborg client migration (Meeting topic: openstack-cyborg)" | 03:39 | |
| ikuo_o | Not so much, but we should fix continuously because new patches will come out. | 03:39 |
| Sundar | ikuo_o: Can you please let us know where this stands? Do you need any help? | 03:40 |
| ikuo_o | I will tell you If I post patchs, off cource, I ask you help if needed. | 03:41 |
| ikuo_o | sorry, "this" means cyborg client migration? | 03:41 |
| Sundar | Yes | 03:41 |
| ikuo_o | We are discussing how to break down tasks. | 03:42 |
| Sundar | OK. Good. | 03:42 |
| ikuo_o | I think the tasks would be: 1) implement object open via API eg, device_profile, arq | 03:42 |
| Sundar | #topic Cyborg specs and patches | 03:42 |
| *** openstack changes topic to "Cyborg specs and patches (Meeting topic: openstack-cyborg)" | 03:42 | |
| ikuo_o | 2) implement operation (CRUD) open via API | 03:42 |
| ikuo_o | 3)implement call point from library users | 03:43 |
| ikuo_o | 4)all the functional tests (toX) | 03:43 |
| ikuo_o | any advices welcome! | 03:43 |
| Sundar | ikuo_o: I would think the first step is to adopt openstack-sdk? | 03:43 |
| ikuo_o | yes, It include adopting openstacksdk. | 03:44 |
| Sundar | ok | 03:44 |
| ikuo_o | we are preparing write storyboard, pls wait. | 03:44 |
| Sundar | Re. Cyborg patches, I approved the generic driver and got it merged. Thanks, yikun | 03:44 |
| Sundar | Also, approved a bunch of small patches on fixing opendev URL or email addresses | 03:45 |
| yikun | Sundar: thanks, but we should first https://review.opendev.org/#/c/658986 first, :) | 03:46 |
| Sundar | I have partial fixes for the pilot code comments. Unfortunately, I could not dedicate a few days to get this done completely. | 03:46 |
| Sundar | yikun: Agreed. Missed that | 03:47 |
| Sundar | Will refresh the pilot code this week with whatever I have. | 03:48 |
| Sundar | @all, please do review the specs | 03:48 |
| Sundar | Can we aim to get one set of reviews by this week? | 03:48 |
| *** ikuo_o has quit IRC | 03:49 | |
| Sundar | #link https://review.opendev.org/#/q/status:open+project:openstack/cyborg-specs+owner:Sundar | 03:49 |
| Sundar | wangzhh, Li_Liu, yikun, xinranwang, all: Can we aim to get one set of reviews for the specs by this week? | 03:50 |
| *** ikuo_o has joined #openstack-cyborg | 03:51 | |
| *** yikun has quit IRC | 03:51 | |
| ikuo_o | sorry, poor connection | 03:51 |
| Sundar | NP, ikuo_o. I was asking if we can get the specs reviewed by this week. | 03:52 |
| ikuo_o | ok, I will check logs. | 03:53 |
| Sundar | #topic AoB | 03:53 |
| *** openstack changes topic to "AoB (Meeting topic: openstack-cyborg)" | 03:53 | |
| Sundar | I think we can skip the Zoom call tomorrow, and use that time to get the specs reviewed | 03:53 |
| ikuo_o | all right, thank you Sundar. | 03:54 |
| Sundar | Thanks, ikuo_o and all. Have a good day. Bye. | 03:55 |
| Sundar | #endmeeting | 03:55 |
| *** openstack changes topic to "Pending patches (Meeting topic: openstack-cyborg)" | 03:55 | |
| openstack | Meeting ended Wed Jun 12 03:55:10 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 03:55 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_cyborg/2019/openstack_cyborg.2019-06-12-03.02.html | 03:55 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_cyborg/2019/openstack_cyborg.2019-06-12-03.02.txt | 03:55 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_cyborg/2019/openstack_cyborg.2019-06-12-03.02.log.html | 03:55 |
| *** Biwei has left #openstack-cyborg | 03:58 | |
| *** yikun has joined #openstack-cyborg | 04:03 | |
| *** links has joined #openstack-cyborg | 04:20 | |
| *** Sundar has quit IRC | 06:40 | |
| *** zhurong has joined #openstack-cyborg | 06:47 | |
| *** xinranwang has quit IRC | 06:54 | |
| *** helenfm has joined #openstack-cyborg | 07:30 | |
| *** ikuo_o has quit IRC | 11:06 | |
| *** jraju__ has joined #openstack-cyborg | 11:36 | |
| *** links has quit IRC | 11:37 | |
| *** jraju__ has quit IRC | 13:47 | |
| *** Sundar has joined #openstack-cyborg | 15:16 | |
| *** helenfm has quit IRC | 15:48 | |
| Sundar | yikun, xinranwang, Biwei: Please see http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2019-06-12.log.html#t2019-06-12T15:55:18 | 16:02 |
| *** Sundar has quit IRC | 17:46 | |
| *** wangzhh has quit IRC | 23:28 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!