| *** diablo_rojo has quit IRC | 01:07 | |
| *** diablo_rojo has joined #openstack-meeting-4 | 01:20 | |
| *** hongbin has joined #openstack-meeting-4 | 01:21 | |
| *** LiangFang has joined #openstack-meeting-4 | 01:32 | |
| *** iyamahat_ has joined #openstack-meeting-4 | 02:00 | |
| *** yamahata has quit IRC | 02:03 | |
| *** iyamahat__ has quit IRC | 02:03 | |
| *** iyamahat_ has quit IRC | 02:08 | |
| *** tinwood has quit IRC | 02:10 | |
| *** tinwood has joined #openstack-meeting-4 | 02:11 | |
| *** bobh has joined #openstack-meeting-4 | 02:13 | |
| *** psachin has joined #openstack-meeting-4 | 02:54 | |
| *** iyamahat has joined #openstack-meeting-4 | 03:04 | |
| *** diablo_rojo has quit IRC | 03:21 | |
| *** bobh has quit IRC | 03:32 | |
| *** yamahata has joined #openstack-meeting-4 | 04:01 | |
| *** hongbin has quit IRC | 04:08 | |
| *** janki has joined #openstack-meeting-4 | 04:12 | |
| *** spsurya has joined #openstack-meeting-4 | 04:50 | |
| *** yboaron_ has joined #openstack-meeting-4 | 05:16 | |
| *** Luzi has joined #openstack-meeting-4 | 06:00 | |
| *** slaweq has joined #openstack-meeting-4 | 06:35 | |
| *** eyalb has joined #openstack-meeting-4 | 07:01 | |
| *** pcaruana has joined #openstack-meeting-4 | 07:04 | |
| *** gibi has joined #openstack-meeting-4 | 07:23 | |
| *** yboaron_ has quit IRC | 07:43 | |
| *** ktibi has joined #openstack-meeting-4 | 08:06 | |
| *** celebdor has joined #openstack-meeting-4 | 08:13 | |
| *** ktibi has quit IRC | 08:21 | |
| *** ktibi has joined #openstack-meeting-4 | 08:21 | |
| *** yboaron_ has joined #openstack-meeting-4 | 08:28 | |
| *** ktibi has quit IRC | 08:30 | |
| *** yboaron_ has quit IRC | 08:32 | |
| *** yboaron_ has joined #openstack-meeting-4 | 08:32 | |
| *** e0ne has joined #openstack-meeting-4 | 08:42 | |
| *** eyalb has quit IRC | 09:00 | |
| *** salmankhan has joined #openstack-meeting-4 | 09:08 | |
| *** dangtrinhnt_x has joined #openstack-meeting-4 | 09:27 | |
| *** dangtrinhnt_x_ has joined #openstack-meeting-4 | 09:27 | |
| *** dangtrinhnt_x has quit IRC | 09:32 | |
| *** psachin has quit IRC | 09:35 | |
| *** psachin has joined #openstack-meeting-4 | 09:40 | |
| *** LiangFang has quit IRC | 09:42 | |
| *** dangtrinhnt_x_ has quit IRC | 09:42 | |
| *** yamamoto has quit IRC | 09:44 | |
| *** yamamoto has joined #openstack-meeting-4 | 09:45 | |
| *** yamamoto has quit IRC | 09:49 | |
| *** dangtrinhnt_x has joined #openstack-meeting-4 | 10:01 | |
| *** psachin has quit IRC | 10:03 | |
| *** psachin has joined #openstack-meeting-4 | 10:05 | |
| *** dangtrinhnt_x has quit IRC | 10:06 | |
| *** dangtrinhnt_x has joined #openstack-meeting-4 | 10:10 | |
| *** dangtrinhnt_x has quit IRC | 10:14 | |
| *** yamamoto has joined #openstack-meeting-4 | 10:17 | |
| *** psachin has quit IRC | 10:25 | |
| *** psachin has joined #openstack-meeting-4 | 10:27 | |
| *** yamamoto has quit IRC | 10:34 | |
| *** yamamoto has joined #openstack-meeting-4 | 10:35 | |
| *** dkrol has joined #openstack-meeting-4 | 10:37 | |
| *** yamamoto has quit IRC | 10:39 | |
| *** pbourke has quit IRC | 10:48 | |
| *** pbourke has joined #openstack-meeting-4 | 10:48 | |
| *** psachin has quit IRC | 11:02 | |
| *** dangtrinhnt_x has joined #openstack-meeting-4 | 11:04 | |
| *** dkrol has quit IRC | 11:07 | |
| *** dangtrinhnt_x has quit IRC | 11:08 | |
| *** dave-mccowan has joined #openstack-meeting-4 | 11:16 | |
| *** yamamoto has joined #openstack-meeting-4 | 11:24 | |
| *** itzikb has joined #openstack-meeting-4 | 11:25 | |
| *** thuydang has joined #openstack-meeting-4 | 11:26 | |
| dangtrinhnt | #startmeeting openstack search | 12:00 |
|---|---|---|
| openstack | Meeting started Thu Oct 25 12:00:54 2018 UTC and is due to finish in 60 minutes. The chair is dangtrinhnt. Information about MeetBot at http://wiki.debian.org/MeetBot. | 12:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 12:00 |
| *** openstack changes topic to " (Meeting topic: openstack search)" | 12:00 | |
| openstack | The meeting name has been set to 'openstack_search' | 12:00 |
| dangtrinhnt | #topic patch stein-1 progress checking | 12:01 |
| *** openstack changes topic to "patch stein-1 progress checking (Meeting topic: openstack search)" | 12:01 | |
| dangtrinhnt | #topic Roll Call | 12:01 |
| dangtrinhnt | thuydang, hi | 12:01 |
| thuydang | hi trinh | 12:02 |
| dangtrinhnt | yingjun, hi | 12:02 |
| dangtrinhnt | Yingjun said he will join the meeting but looks like he not available yet | 12:03 |
| dangtrinhnt | so we just move on | 12:03 |
| dangtrinhnt | #topic Stein-1 progress check | 12:03 |
| *** openstack changes topic to "Stein-1 progress check (Meeting topic: openstack search)" | 12:03 | |
| *** gibi has quit IRC | 12:03 | |
| dangtrinhnt | thuydang, how are you? | 12:03 |
| thuydang | I'm fine, but too busy :-) | 12:04 |
| dangtrinhnt | yes, I can see that | 12:04 |
| dangtrinhnt | there was noone here last meeting :) | 12:04 |
| dangtrinhnt | So for the Stein-1 milestone | 12:04 |
| dangtrinhnt | do you have anything to add about the use cases we talked about last time? | 12:05 |
| thuydang | unfortunately not | 12:05 |
| thuydang | when should it due? | 12:05 |
| dangtrinhnt | this week | 12:05 |
| dangtrinhnt | :D | 12:05 |
| thuydang | hmm, I'm not clear about timeline yet | 12:06 |
| dangtrinhnt | https://releases.openstack.org/stein/schedule.html | 12:06 |
| dangtrinhnt | This is the schedule | 12:06 |
| dangtrinhnt | It's not required to release at Stein-1 but I think it's a good idea to evaluate our team's work | 12:07 |
| thuydang | yes, I looked at it. So the stein-1 milestone is Apr next year and we want to have searchlight integrated | 12:07 |
| *** seajay has joined #openstack-meeting-4 | 12:07 | |
| thuydang | ah ok, I mistake it with RC-1 | 12:08 |
| thuydang | I see | 12:08 |
| dangtrinhnt | RC-1 is wait ahead :) | 12:08 |
| dangtrinhnt | no problem | 12:08 |
| *** yingjun has joined #openstack-meeting-4 | 12:08 | |
| dangtrinhnt | yingjun hi | 12:08 |
| dangtrinhnt | :) | 12:08 |
| yingjun | Hi | 12:09 |
| thuydang | I think use-case will be documentation or event blueprint task | 12:09 |
| thuydang | so I missed milestone 1 | 12:09 |
| dangtrinhnt | thuydang, ok, no worries. Just add the plan on our storyboard | 12:10 |
| yingjun | Did I miss something？ | 12:10 |
| dangtrinhnt | yingjun, no | 12:10 |
| dangtrinhnt | we just started :D | 12:10 |
| dangtrinhnt | It's great to see another core back :) | 12:10 |
| thuydang | hi yingjun | 12:10 |
| thuydang | I tried to setup openstack and searchlight but not successful after 2 weeks | 12:11 |
| dangtrinhnt | thuydang, for the use cases, you can add your plan here: https://storyboard.openstack.org/#!/project/openstack/searchlight | 12:12 |
| dangtrinhnt | The recommended way to try Searchlight is via devstack | 12:12 |
| thuydang | I wanted to see searchlight in action so I can identify some connection points with use-cases | 12:12 |
| thuydang | devstack is probably the recommended way. I try with openstack ansible though | 12:13 |
| dangtrinhnt | When working with Ansible, you have to deal with compatibility issues of the services while devstack doing that for you with the built-in constraints | 12:14 |
| dangtrinhnt | ok, so, you can give me your configuration later in the openstack-searchlight channel to have a look | 12:15 |
| dangtrinhnt | yingjun, how are you? | 12:15 |
| thuydang | I see the getting start document of other openstack proejct also, but mostly they say "install devstack" :-) | 12:15 |
| thuydang | so I think we can have a more detailed document for helping new contributor | 12:16 |
| *** gibi has joined #openstack-meeting-4 | 12:16 | |
| yingjun | Kolla-ansible is also supported,it's pretty esay to setup | 12:16 |
| dangtrinhnt | thuydang, :) it's great, I will put a note about it. | 12:16 |
| dangtrinhnt | yingjun, if you have experience with it, could you please add some docs? :) | 12:17 |
| thuydang | some pointers are already helpful. I kind of lost in openstack eco | 12:17 |
| dangtrinhnt | thuydang, sure, I will put some next week. | 12:18 |
| thuydang | 2 years ago the most complicated part was only neutron :-) | 12:18 |
| dangtrinhnt | ok, let's get back to the Stein-1 topic | 12:18 |
| dangtrinhnt | :) | 12:18 |
| dangtrinhnt | yingjun, you can have a look at our vPTG notes: https://etherpad.openstack.org/p/searchlight-stein-ptg | 12:19 |
| yingjun | Ok | 12:19 |
| dangtrinhnt | We about to do these in Stein-1 | 12:19 |
| dangtrinhnt | - ES 5.x support - Fix bugs - Versioned Nova notifications - tox use py3 by default - Docs clean up | 12:20 |
| dangtrinhnt | Now only the "Version Nova notifications" patch left | 12:20 |
| dangtrinhnt | yingjun, if you have sometime this week, before Sunday, please review this: https://review.openstack.org/#/c/453352/ | 12:21 |
| dangtrinhnt | I will do a release on Monday (a little bit late) | 12:21 |
| dangtrinhnt | I know you have been a great contributor of Searchlight and really love to have you back | 12:22 |
| dangtrinhnt | Searchlight needs you and other contributors | 12:22 |
| yingjun | Ok, will do | 12:22 |
| dangtrinhnt | thanks | 12:22 |
| dangtrinhnt | ok, looks like we are on track now :) yay | 12:24 |
| thuydang | the use-case is planned for stein-2 as I see in vPTG | 12:25 |
| thuydang | :-) | 12:25 |
| dangtrinhnt | yes | 12:25 |
| dangtrinhnt | :) | 12:25 |
| thuydang | by that time I'm also targeting some network management survey for my research, good timing | 12:26 |
| dangtrinhnt | awesome, thuydang | 12:26 |
| dangtrinhnt | just want to look ahead :) | 12:26 |
| *** pcaruana has quit IRC | 12:26 | |
| dangtrinhnt | #topic Stein-2 | 12:26 |
| *** openstack changes topic to "Stein-2 (Meeting topic: openstack search)" | 12:26 | |
| dangtrinhnt | Besides the use cases, anything else you want to add? yingjun, thuydang? | 12:27 |
| dangtrinhnt | yingjun, you must have more experience than us | 12:27 |
| dangtrinhnt | :) | 12:27 |
| thuydang | I would be great if the installation guide is complete by then | 12:28 |
| dangtrinhnt | awesome | 12:29 |
| thuydang | I will join some tutorial session in the Openstack summit, especially OS ansible, and probably will compose a developer guide | 12:29 |
| dangtrinhnt | I will put it as the 1st priority next week | 12:29 |
| dangtrinhnt | Cool, thuydang, could you please write some report about that for the team? | 12:29 |
| thuydang | sure | 12:30 |
| *** janki has quit IRC | 12:31 | |
| dangtrinhnt | great thanks | 12:31 |
| *** janki has joined #openstack-meeting-4 | 12:31 | |
| *** liuyulong has quit IRC | 12:31 | |
| yingjun | All good, nothing from me, hope i can still catch up for missing about half year | 12:32 |
| *** yboaron_ has quit IRC | 12:32 | |
| dangtrinhnt | yingjun, a big thanks from me. I learn a lot from your patches :D | 12:33 |
| *** yboaron_ has joined #openstack-meeting-4 | 12:33 | |
| thuydang | Can you explain a bit about release process? do we have to propose some technical changes in each milestone and report to openstack release team? | 12:33 |
| dangtrinhnt | no, thuydang | 12:34 |
| dangtrinhnt | it depends on us | 12:34 |
| dangtrinhnt | we as a team will decide which ones will be released at each milestone | 12:35 |
| dangtrinhnt | But according to the discussion of the Release management team, we don't have to release at each milestone | 12:35 |
| dangtrinhnt | only the RCs is required | 12:35 |
| thuydang | ok, so just make sure searchlight is stable to be included in the next OS version | 12:36 |
| dangtrinhnt | thuydang, correct | 12:36 |
| dangtrinhnt | yingjun, I'm trying to write a weekly report of what going on with Searchlight here: https://www.dangtrinh.com/search/label/Searchlight | 12:36 |
| dangtrinhnt | you can have a look | 12:36 |
| thuydang | that's great dangtrinhnt, very helpful | 12:37 |
| dangtrinhnt | :D | 12:37 |
| yingjun | nice | 12:37 |
| dangtrinhnt | also, I'm trying to attract more contributors | 12:37 |
| dangtrinhnt | last week I attended the OS Korea User Group | 12:38 |
| dangtrinhnt | hopefully our team will have more people :D | 12:38 |
| dangtrinhnt | ok, anything you want to talk about this time? thuydang, yingjun | 12:39 |
| thuydang | that's all from my side | 12:39 |
| *** pcaruana has joined #openstack-meeting-4 | 12:39 | |
| dangtrinhnt | yingjun | 12:40 |
| yingjun | no | 12:41 |
| dangtrinhnt | ok | 12:41 |
| dangtrinhnt | So, let's end the meeting now. Talk to you guys at the #openstack-searchlight channel | 12:41 |
| dangtrinhnt | Thank for joining the meeting today :) | 12:42 |
| dangtrinhnt | #endmeeting | 12:42 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 12:42 | |
| openstack | Meeting ended Thu Oct 25 12:42:11 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 12:42 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_search/2018/openstack_search.2018-10-25-12.00.html | 12:42 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_search/2018/openstack_search.2018-10-25-12.00.txt | 12:42 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_search/2018/openstack_search.2018-10-25-12.00.log.html | 12:42 |
| *** thuydang has left #openstack-meeting-4 | 12:43 | |
| *** caboucha has joined #openstack-meeting-4 | 12:44 | |
| *** janki has quit IRC | 12:56 | |
| *** bnemec has joined #openstack-meeting-4 | 12:56 | |
| *** yamamoto has quit IRC | 12:56 | |
| *** yamamoto has joined #openstack-meeting-4 | 12:56 | |
| *** itzikb has quit IRC | 12:57 | |
| *** itzikb has joined #openstack-meeting-4 | 13:01 | |
| *** bobh has joined #openstack-meeting-4 | 13:02 | |
| *** itzikb is now known as itzikb|afk | 13:04 | |
| *** yboaron_ has quit IRC | 13:04 | |
| *** yboaron_ has joined #openstack-meeting-4 | 13:04 | |
| *** liuyulong has joined #openstack-meeting-4 | 13:08 | |
| *** pliu has quit IRC | 13:15 | |
| *** abhishekk has joined #openstack-meeting-4 | 13:17 | |
| *** rnoriega has quit IRC | 13:31 | |
| *** yamamoto has quit IRC | 13:31 | |
| *** yamamoto has joined #openstack-meeting-4 | 13:31 | |
| *** d0ugal has quit IRC | 13:33 | |
| *** d0ugal has joined #openstack-meeting-4 | 13:34 | |
| *** pcaruana has quit IRC | 13:37 | |
| *** rnoriega has joined #openstack-meeting-4 | 13:38 | |
| *** mhen has joined #openstack-meeting-4 | 13:41 | |
| *** mjturek has joined #openstack-meeting-4 | 13:48 | |
| *** Liang__ has joined #openstack-meeting-4 | 13:48 | |
| *** d0ugal has quit IRC | 13:49 | |
| *** Liang__ is now known as LiangFang | 13:49 | |
| *** itzikb|afk has quit IRC | 13:56 | |
| *** Luzi has quit IRC | 13:57 | |
| *** mjturek has quit IRC | 13:59 | |
| LiangFang | hi | 14:00 |
| abhishekk | hi | 14:01 |
| *** rosmaita has joined #openstack-meeting-4 | 14:01 | |
| jokke_ | #startmeeting glance | 14:01 |
| openstack | Meeting started Thu Oct 25 14:01:38 2018 UTC and is due to finish in 60 minutes. The chair is jokke_. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:01 |
| *** openstack changes topic to " (Meeting topic: glance)" | 14:01 | |
| openstack | The meeting name has been set to 'glance' | 14:01 |
| abhishekk | o/ | 14:01 |
| jokke_ | #topic roll-call | 14:01 |
| *** openstack changes topic to "roll-call (Meeting topic: glance)" | 14:01 | |
| jokke_ | #link https://etherpad.openstack.org/p/glance-team-meeting-agenda | 14:01 |
| jokke_ | o/ | 14:01 |
| mhen | o/ | 14:01 |
| LiangFang | o/ | 14:02 |
| rosmaita | o/ | 14:02 |
| jokke_ | #topic updates | 14:02 |
| *** openstack changes topic to "updates (Meeting topic: glance)" | 14:02 | |
| jokke_ | First of all, we have S-1 deadline today | 14:02 |
| rosmaita | that snuck up quickly | 14:03 |
| jokke_ | there shouldn't be anything burning waiting to be merged but now is the last moments to yell | 14:03 |
| jokke_ | rosmaita: indeed | 14:03 |
| *** smcginnis has joined #openstack-meeting-4 | 14:03 | |
| abhishekk | I think we should have my functional tests timeout patch in | 14:03 |
| rosmaita | also, this would be the last chance to revert the image status change from queued -> active from PATCH add location | 14:04 |
| jokke_ | rosmaita: you mean replace? | 14:04 |
| rosmaita | sorry, you are correct, replace | 14:05 |
| jokke_ | yes so are we going to keep that or revert it? | 14:05 |
| rosmaita | i am in favor of keeping it | 14:06 |
| abhishekk | me too | 14:06 |
| jokke_ | I still think it's unnecessary api change | 14:06 |
| rosmaita | i don't see it as an api change, i see it as a bugfix | 14:07 |
| smcginnis | I don't have enough knowledge there to vote one way or the other. | 14:07 |
| *** mjturek has joined #openstack-meeting-4 | 14:07 | |
| jokke_ | but but taken into account where it is, I really don't have interest to fight about it | 14:07 |
| rosmaita | yeah, pretty low traffic in that part of the api | 14:08 |
| jokke_ | need to bump the api version for that 'though | 14:08 |
| rosmaita | not for S-1, though, i wouldn't think | 14:08 |
| jokke_ | you recon it's nuf to do it at the end of the cycle? | 14:09 |
| abhishekk | generally we do it at the end of the cycle, right? | 14:09 |
| rosmaita | i really don't think it's necessary for this at all, but i think that's the usual practice, end of cycle | 14:09 |
| rosmaita | no one has complained before | 14:10 |
| rosmaita | or at least, i haven't payed attention if they have :) | 14:10 |
| jokke_ | k, I guess we should be good to go then with S-1 | 14:10 |
| jokke_ | next thing is, Summit is approaching, fast | 14:10 |
| rosmaita | abhishekk: do you have your func test update patch link handy? | 14:10 |
| abhishekk | (I am talking about this, https://review.openstack.org/#/c/608856/) | 14:10 |
| jokke_ | which means spec freeze is approaching fast | 14:11 |
| abhishekk | rosmaita, ^^ | 14:11 |
| jokke_ | so lets get them specs reviewed and merged what we are going to accept | 14:12 |
| *** JamesBenson has joined #openstack-meeting-4 | 14:12 | |
| jokke_ | which gives us nice brindge to the next topic | 14:12 |
| jokke_ | bridge | 14:12 |
| jokke_ | #topic validation_data in image locations patch call | 14:12 |
| *** openstack changes topic to "validation_data in image locations patch call (Meeting topic: glance)" | 14:12 | |
| jokke_ | imacdonn has been chasing this actively and has new revision out | 14:13 |
| abhishekk | new revision looks good to me, does it going to add new discovery call? | 14:13 |
| rosmaita | abhishekk: it doesn't mention that, i think the idea is rely on the local operator docs for now | 14:14 |
| abhishekk | rosmaita, ack | 14:14 |
| rosmaita | since the admin has to allow use of locations anyway, should not be a big deal | 14:15 |
| jokke_ | we shoud definitely look to include these details when expanding the discovery endpoint | 14:15 |
| rosmaita | i mean the admin/operator | 14:15 |
| rosmaita | jokke_: ++ | 14:15 |
| *** hongbin has joined #openstack-meeting-4 | 14:15 | |
| jokke_ | that said I don't think this will be widely used due to the fact that it opens such a can of worms | 14:16 |
| rosmaita | also ++ | 14:16 |
| abhishekk | so it will just check it against config set in glance-api.conf and if does not match then returns 409 | 14:16 |
| abhishekk | agree | 14:16 |
| rosmaita | right | 14:16 |
| abhishekk | got it | 14:17 |
| jokke_ | ok, cool | 14:17 |
| jokke_ | lets read it through once more with good thought but I think it's getting there (again) | 14:17 |
| jokke_ | next up is showing store IDs in image listing | 14:18 |
| jokke_ | #topic show store ID in image listing with -vv | 14:18 |
| *** openstack changes topic to "show store ID in image listing with -vv (Meeting topic: glance)" | 14:18 | |
| jokke_ | LiangFang: you're up | 14:18 |
| LiangFang | hi erno | 14:18 |
| LiangFang | I prepared the spec, and at this moment, the conclution is to add --include-stores option to image-list | 14:19 |
| LiangFang | openstack client just have -long, not option like -vv | 14:19 |
| LiangFang | so try to use --include-stores | 14:20 |
| LiangFang | erno, are you agree with this? | 14:20 |
| rosmaita | LiangFang: are you thinking the --include-stores will work with both "regular" image-list and also image-list -v calls? | 14:21 |
| jokke_ | so are you proposing thing change to python-glanceclint or openstackclient? | 14:21 |
| LiangFang | the change is in python-glanceclient | 14:22 |
| LiangFang | glance -v image-list --include-stores | 14:22 |
| LiangFang | glance image-list --include-stores | 14:22 |
| LiangFang | all can work | 14:22 |
| rosmaita | excellent | 14:22 |
| smcginnis | jokke_: osc comes into play from a comment I made about it not really fitting with the standardization they are doing there. | 14:23 |
| jokke_ | ok, I have one concern which might be just language thing in the spec | 14:23 |
| smcginnis | I think this new option fits better and is probably easier for a user to discover and use. | 14:23 |
| rosmaita | i think smcginnis had a good point about that | 14:23 |
| jokke_ | You're mentioning listing store type, I think that needs to change to store ID (and use those, "fast", "cheap", "reliable" as example) ... we are not going to leak the backend information to the user unless that's how the operator decides to set it | 14:24 |
| LiangFang | OK | 14:25 |
| jokke_ | so we're not listing the store type, but it's ID | 14:25 |
| smcginnis | jokke_: Good point. | 14:25 |
| LiangFang | I will update | 14:25 |
| jokke_ | other than that, the proposal looks good to me | 14:25 |
| rosmaita | good catch, i missed that | 14:25 |
| LiangFang | thanks | 14:25 |
| LiangFang | and I also updated the related code | 14:26 |
| LiangFang | and the review is:https://review.openstack.org/#/c/605014/ | 14:26 |
| jokke_ | thanks, anything else about this? | 14:27 |
| LiangFang | no more | 14:27 |
| LiangFang | thanks | 14:27 |
| jokke_ | #topic image size to prevent backend resizes | 14:27 |
| *** openstack changes topic to "image size to prevent backend resizes (Meeting topic: glance)" | 14:27 | |
| jokke_ | this is yours as well | 14:27 |
| LiangFang | about this, last week you mentioned we should consider other component as well, not only cinder | 14:28 |
| jokke_ | and first of all I have to say this keeps slipping on me, so no I haven't got to test it yet :( | 14:28 |
| LiangFang | that's fine:) | 14:28 |
| jokke_ | yes so we need to make sure that this addresses any applicable backends (if others than cinder is affected) | 14:29 |
| LiangFang | considering this, I think solution 1 is better | 14:29 |
| jokke_ | #link https://review.openstack.org/#/c/608400/ | 14:29 |
| LiangFang | solution 1 is: | 14:29 |
| jokke_ | ^^ is the spec | 14:29 |
| LiangFang | cinder calculate the image size | 14:30 |
| LiangFang | python-glanceclient: convey the image size via http header | 14:30 |
| LiangFang | glance: extract the image size in request deserialize phase | 14:30 |
| LiangFang | Sean mentioned previously that, move the work did in cinder to python-glanceclient | 14:31 |
| LiangFang | let python-glanceclient to calculate the image size | 14:32 |
| LiangFang | I take a look again this week, seems this is workable | 14:32 |
| rosmaita | Quick question: the point of this is to provide info that the glance backend driver can use in allocating how much space to store the image, but the 'size' in glance will still be computed as it is now? | 14:32 |
| abhishekk | how this will fit in case of web-download import method? | 14:34 |
| LiangFang | in current code, size is returned by backend when it finished all the data upload | 14:34 |
| jokke_ | So iirc we can't access the request body before all the data has been uploaded to glance (this was either webop or wsgi thing). Whic means that we should know the size before we upload it to backend | 14:34 |
| LiangFang | abhishekk: let me take a think | 14:35 |
| jokke_ | also it's definitely the case with image import | 14:35 |
| abhishekk | LiangFang, yes | 14:35 |
| jokke_ | so I don't think we should offload the work to glanceclient specially as there is cases when glanceclient can't determine the size before it's iterated the whole image | 14:36 |
| jokke_ | those being if the data is streamed to the client from command line or the fd is socket | 14:37 |
| LiangFang | agree | 14:37 |
| LiangFang | so should let the user of glanceclient to give the size | 14:37 |
| jokke_ | and these were the reasons why the decision was made not to send the size from client in v2 like it was done in v1 | 14:38 |
| jokke_ | we should let glance-api to calculate the data before upload to the backend | 14:38 |
| smcginnis | Are there any DoS issues with user supplied size input to glanceclient? | 14:38 |
| jokke_ | and make sure our upload is not streaming it from local disk in very small chunks | 14:39 |
| jokke_ | smcginnis: not really, there is the max image size parameter that eliminates any crazy calls | 14:40 |
| smcginnis | OK, good. | 14:40 |
| jokke_ | but yet I think we have all the needed data in the api before we do the upload call, it's just not utilized | 14:40 |
| LiangFang | I seems glance-api don't know the size | 14:41 |
| jokke_ | so we update the image size based on the info we got from the backend instead of telling the backend "We have this much data we're dumping into you" | 14:42 |
| LiangFang | I did experiment with ceph as backend, if give size, it can save 30% uploading time | 14:42 |
| jokke_ | yeah, I thought that might be the case | 14:43 |
| jokke_ | one of the problems we have and this is hitting the edge usecases hard is that we always thought the backends are somewhere close by. We're using extremely small chunks when doing backend transactions. like 4k which is even small for disk writes | 14:44 |
| LiangFang | the chunk size using by ceph is 8M | 14:45 |
| LiangFang | lvm is 64K | 14:45 |
| rosmaita | so really, for this purpose, we don't need to know the image size exactly, | 14:45 |
| jokke_ | yeah, well with ceph we use rdb which takes care of it | 14:46 |
| jokke_ | when ever we chnk it ourselves it's very very small | 14:46 |
| LiangFang | sorry erno, I may not catched your point | 14:48 |
| jokke_ | rosmaita: well I'm not sure how cinder behaves if you try to shrink the volume ... the problem is atm, that when we don't know the size, behind the scenes we end up calling cinder resize to expand for each chunk we're sending | 14:48 |
| jokke_ | same happens with other backends that actually allocate the space | 14:48 |
| smcginnis | Cinder will never shrink, only extend. | 14:48 |
| jokke_ | yeah, so we can't just estimate and shrink back to size after we get to the end of the data | 14:49 |
| abhishekk | yes, downsize is not allowed | 14:49 |
| *** yingjun has quit IRC | 14:49 | |
| jokke_ | ok, we're running out of time. Lets keep investigating this | 14:50 |
| LiangFang | OK | 14:50 |
| jokke_ | #topic python-glanceclient release | 14:50 |
| *** openstack changes topic to "python-glanceclient release (Meeting topic: glance)" | 14:50 | |
| jokke_ | rosmaita: the stage is yours | 14:50 |
| rosmaita | I send something to the ML about this | 14:51 |
| rosmaita | #link http://lists.openstack.org/pipermail/openstack-dev/2018-October/135902.html | 14:51 |
| rosmaita | master contains the multihash validation code | 14:52 |
| abhishekk | at the moment 2nd option looks more convenient | 14:52 |
| rosmaita | yes, and smcginnis already has a patch up for that | 14:53 |
| rosmaita | and now that we've decided that iain's validation_data will use the configured hash algo, i'm not so worried | 14:53 |
| smcginnis | We can hold the release patch or update it. There's also one up for glance_store. | 14:54 |
| rosmaita | ok, this looked like it could be an issue at the end of last week, not so much now. | 14:54 |
| rosmaita | let's go with option 2 | 14:55 |
| *** bobh has quit IRC | 14:55 | |
| jokke_ | so we don't have the multihash validation in rocky client and we never ended up backporting that to rocky branch | 14:55 |
| rosmaita | jokke_: correct | 14:55 |
| jokke_ | ok, crap | 14:56 |
| jokke_ | I thought it had been done, just not tagged | 14:56 |
| rosmaita | give me a minute to check, pretty sure i;m right though | 14:57 |
| jokke_ | just looked the rocky branch, didn't see it there | 14:57 |
| rosmaita | yeah, not there | 14:58 |
| jokke_ | so yeah, I guess we need to do the same trickstery we did at the start of rocky | 14:58 |
| jokke_ | which is backport, cut 2.13.0 from the stable branch and then 2.14 from master before towards end of the cycle cutting 3.0.0 | 14:59 |
| abhishekk | last minute to go | 14:59 |
| jokke_ | that way we get it for those who insists using the client from rocky branch on their rocky deployment | 14:59 |
| rosmaita | abhishekk: are you handling glance s-1 release, or do you want me to do it? | 15:00 |
| jokke_ | yup, we're out of time, lets wrap this client plan together in #os-glance | 15:00 |
| jokke_ | #endmeeting | 15:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:00 | |
| openstack | Meeting ended Thu Oct 25 15:00:33 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:00 |
| abhishekk | rosmaita, you can | 15:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/glance/2018/glance.2018-10-25-14.01.html | 15:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/glance/2018/glance.2018-10-25-14.01.txt | 15:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/glance/2018/glance.2018-10-25-14.01.log.html | 15:00 |
| jokke_ | thanks all | 15:00 |
| rosmaita | abhishekk: ok | 15:00 |
| smcginnis | rosmaita, jokke_: That makes sense. Thanks! | 15:00 |
| abhishekk | rosmaita, I will catchup from s-2 | 15:01 |
| *** smcginnis has left #openstack-meeting-4 | 15:01 | |
| *** Luzi has joined #openstack-meeting-4 | 15:01 | |
| *** abhishekk has quit IRC | 15:05 | |
| *** yamamoto has quit IRC | 15:09 | |
| *** yamamoto has joined #openstack-meeting-4 | 15:10 | |
| *** yamamoto has quit IRC | 15:16 | |
| *** Luzi has quit IRC | 15:26 | |
| *** bobh has joined #openstack-meeting-4 | 15:29 | |
| *** mjturek has quit IRC | 15:34 | |
| *** bobh has quit IRC | 15:35 | |
| *** yboaron_ has quit IRC | 15:36 | |
| *** bobh has joined #openstack-meeting-4 | 15:39 | |
| *** mjturek has joined #openstack-meeting-4 | 15:40 | |
| *** LiangFang has quit IRC | 15:46 | |
| *** yamamoto has joined #openstack-meeting-4 | 15:50 | |
| *** celebdor has quit IRC | 15:51 | |
| *** liuyulong is now known as liuyulong|away | 15:54 | |
| *** e0ne has quit IRC | 15:59 | |
| *** yamamoto has quit IRC | 16:26 | |
| *** yamamoto has joined #openstack-meeting-4 | 16:26 | |
| *** salmankhan has quit IRC | 16:34 | |
| *** mjturek has quit IRC | 16:40 | |
| *** imacdonn has quit IRC | 16:42 | |
| *** iyamahat has quit IRC | 16:42 | |
| *** imacdonn has joined #openstack-meeting-4 | 16:43 | |
| *** mjturek has joined #openstack-meeting-4 | 16:50 | |
| *** yamahata has quit IRC | 16:52 | |
| *** pcaruana has joined #openstack-meeting-4 | 17:03 | |
| *** iyamahat has joined #openstack-meeting-4 | 17:21 | |
| *** yamahata has joined #openstack-meeting-4 | 17:24 | |
| *** diablo_rojo has joined #openstack-meeting-4 | 17:26 | |
| *** mjturek has quit IRC | 17:36 | |
| *** JamesBenson has quit IRC | 18:05 | |
| *** JamesBenson has joined #openstack-meeting-4 | 18:06 | |
| *** rosmaita has left #openstack-meeting-4 | 18:12 | |
| *** salmankhan has joined #openstack-meeting-4 | 18:16 | |
| *** salmankhan has quit IRC | 18:20 | |
| *** bnemec has quit IRC | 18:29 | |
| *** bobh has quit IRC | 18:40 | |
| *** njohnston has quit IRC | 19:07 | |
| *** njohnston has joined #openstack-meeting-4 | 19:09 | |
| *** bobh has joined #openstack-meeting-4 | 19:15 | |
| *** bobh has quit IRC | 19:20 | |
| *** bobh has joined #openstack-meeting-4 | 19:31 | |
| *** irclogbot_1 has joined #openstack-meeting-4 | 20:02 | |
| *** irclogbot_1 has quit IRC | 20:22 | |
| *** imacdonn has quit IRC | 20:31 | |
| *** caboucha has quit IRC | 20:49 | |
| *** bobh has quit IRC | 21:16 | |
| *** irclogbot_1 has joined #openstack-meeting-4 | 21:16 | |
| *** iyamahat_ has joined #openstack-meeting-4 | 21:40 | |
| *** iyamahat has quit IRC | 21:42 | |
| *** bobh has joined #openstack-meeting-4 | 21:51 | |
| *** bobh has quit IRC | 21:56 | |
| *** JamesBenson has quit IRC | 22:01 | |
| *** seajay has quit IRC | 22:13 | |
| *** njohnston has quit IRC | 22:36 | |
| *** njohnston has joined #openstack-meeting-4 | 22:36 | |
| *** yamamoto has quit IRC | 23:01 | |
| *** yamamoto has joined #openstack-meeting-4 | 23:01 | |
| *** yamamoto has quit IRC | 23:06 | |
| *** hongbin has quit IRC | 23:24 | |
| *** yamamoto has joined #openstack-meeting-4 | 23:44 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!