Wednesday, 2023-11-08

tobberydbergo/08:01
gtemamorning08:02
tobberydbergI wonder if its more than just you and me here today :-) 08:03
gtemayeah, nice question indeed08:04
gtemawell, at least we can discuss here with you a bit different topic - https://review.opendev.org/c/openstack/project-config/+/847135. In OTC we developed HashiVault plugin for OTC and wanted to donate it to community but it did not went beyond proposing change to allocate project08:06
gtemafrom your perspective - do you think it should be done or in the light of recent Hashi licence change "dropped"08:07
joek-officeGood Morning publiccloud-sig, anyone there?08:09
gtemayes joek-office, we are here08:09
gtemaat least me and tobberydberg08:09
tobberydbergwelcome08:09
joek-officeok, sorry for the late join. 08:09
tobberydberg#startmeeting publiccloud_sig08:10
opendevmeetMeeting started Wed Nov  8 08:10:09 2023 UTC and is due to finish in 60 minutes.  The chair is tobberydberg. Information about MeetBot at http://wiki.debian.org/MeetBot.08:10
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.08:10
opendevmeetThe meeting name has been set to 'publiccloud_sig'08:10
tobberydberg1. Recap vPTG 08:11
tobberydbergfkr did write a summary that can be found here: https://etherpad.opendev.org/p/oct2023-ptg-publiccloud-sig#L6408:11
gtemathanks to fkr for that, a pretty detailed recap08:12
tobberydbergYes, indeed 08:12
tobberydbergI did change the time in the schedule to out "winter time" slot, so should appear in calendars at 0900 CET08:13
gtemaoh right.08:14
gtemathanks, didn't even thought about that08:14
tobberydberg:-) 08:14
tobberydbergWorth highlighting from the PTG is potentially the weirdness around "standard set of properties"08:16
gtemaindeed.08:16
joek-officei'm not fully ready at the moment. i'm just for ten minutes on my pc and havent read the recap. But the first look seems nice08:16
gtemawe wanted to have another round of wider discussion of the topic, weren't we?08:17
joek-officeyes. i remind me that we have long discussion about that.08:17
gtemaI mean with the findings from the PTG and discussion with Nova folks08:17
tobberydbergyes08:18
gtemasince more or less our initial desire is not going to fly08:18
joek-officeif i'm really honest, i'm not fully in picture about all the things in this complex subject08:18
joek-officeif it's possible can we outline the goals that would be reached?08:19
tobberydbergThe ask from nova folks is for us to have a look at https://docs.openstack.org/glance/latest/user/metadefs-concepts.html08:20
gtemagoal is that every "user" of OpenStack does not need to take care about flavor/image name, but instead specifies properties and the "code" just finds suitable for him08:20
joek-officeok. thanks gtema. Than i was more in picture than i think.08:21
gtemametadefs are indeed an interesting thing, but you can't expect operators to double data that is already out there into the metadefs and user to change deployment scripts to parse through metadef in order to find suitable flavor/image08:21
gtemain my eyes this is for really advanced usecases while we need first something for a regular user who "just" want to have his VM running08:23
tobberydbergis it even possible to filter on metadefs in the client?08:23
tobberydbergyea...08:23
joek-officeI havent speak about it on the vPTG, but in the discussion my thoughts going in the direction that this is a problem or a the goal is a two way thing. One thing is the technical part. How can a client find the respective meta data. the other thing is the organisational part. more or less the definition, i think a part for scs, which metadata should be the standard set.08:24
gtemawell, with metadefs you can find description (mapping) of metadata on the flavors/images08:24
gtemaso technically you go 1st to metadef and grep through it to find property name you need i.e. to get count of cpus08:24
gtemaand then you go to flavors and grep them with this metadata in mind08:25
gtemaso you double your APIs08:25
gtemaand the main part is not addressed - it is not possible to have filters based on metadata/extra_specs right now08:25
gtemaso for me this is not a solution from usability pov08:26
tobberydbergOk08:26
joek-officealso these definitions are already present in the flavors. 08:28
gtemanot all of them08:28
gtemathat was a finding of the nova operators hour08:28
joek-officeis there any search functionality in the nova/cinder/glance client api's?08:28
gtemathere are traits behind flavors which are sort of not always visible08:28
gtemathere is search functionality, but not always optimal08:29
gtemai.e. for flavors you can't filter list based on extra_specs and this is where majority of the needed data is kept08:29
joek-officeand why is this information not visible? Is this a techincal/security reason?08:29
gtemaso you end up fetching 1000 flavors to filter on the client side08:29
gtemaneither of both - it's architectural issue, that those are only something like "scheduler_hints" which are not guaranteed to be used directly08:30
tobberydbergwhich is not feasible 08:30
joek-officecan the api of the services extended to reach this search functionality on the server side? Or what is the current idea to go?08:31
gtemathat is exactly what we wanted to discuss with a wider audience from other operators08:32
gtemaextending is possible, but will require one of us to implement that08:33
joek-officeok, thank you for these explanations. 08:33
gtemayw08:33
joek-officeIs there a user story defined that will outline the user perspective how this will easy work or usable for the client? 08:34
gtemait's more or less my statement to you wrt that08:35
gtema"goal is that every "user" of OpenStack does not need to take care about flavor/image name, but instead specifies properties and the "code" just finds suitable for him"08:35
tobberydbergWhich seams to be a hidden gem in the traits section :-) 08:36
joek-officeyes, this is clear to me. But from this starting point there comes many questions. That should we discuss and find a quorum.08:37
gtemaright, but it is deep 08:37
joek-officeyes, i have at the moment just three questions in my mind adn every of these question will have many following things. But is anywhere something written down like a specification/blueprint?08:38
gtemahttps://etherpad.opendev.org/p/publiccloud-sig-specs is something in written08:40
gtemabut I guess we understood ourselves that in this form it does not make much sense08:40
joek-officeyes, also that what i see in first fly is in my opinion the organizational part that is discussed. There is a complete lack of the technical part.08:41
tobberydbergI'm not fully following the whole traits thingi, I have to read up on that. But from what I can tell, will not give the user much visibility?08:41
gtemathey are currently not visible to user at all so first we would need to make them visible08:42
gtemaand basically filterable08:42
gtemahttps://docs.openstack.org/api-ref/placement/#list-traits08:43
tobberydbergAnd to make them visible, reflect traits info into the list of flavors?08:43
tobberydberg...in a consumable fashion...08:44
gtemanot directly. traits themselves are sort of mapping between extra_specs of flavors into something what scheduler understands08:45
gtemaso to some extend they are there, but enduser is not able to understand them08:45
gtemaso we need to expose this info08:45
gtemaand make it filterable08:45
joek-officeare there at the moment any ideas/requirements from the csp side?08:46
joek-officewe just discuss the client side?08:47
gtemabecause the whole idea was spinning around making user life easier and portable08:48
joek-officewhen i'm right, the filtering should be done on the server side?08:48
gtemacorrect, on the server side, because there are cases with more then 1000 flavors in region08:48
joek-officeyes, thats clear, but i think there would be also csp requirements for such a feature.08:48
joek-officejust to get a better acceptance08:49
gtemawell, we all wanted to exactly align from the csp side how to achieve that08:49
joek-officebecause i think the csp would have also a bit intense to adapt the filter result in a way that doesnt change the filtering but is better aligned to the csp thoughts08:51
joek-officethings like what is when there are a new and a old ceph pool. Both will have the same flavors. in such a case the filter give back flavors for both pools and the csp would prefer the new pool08:53
joek-officeor hide the old pool from the filtering08:54
joek-officeto get the pool empty and then end this pool08:54
tobberydbergBut then you will just delete the flavors connected to that pool, right? Or maybe I'm not following you here :-) 08:56
joek-officein the end, yes. but what is in the mean time when you have deployed vm's that use the old flavors. Can you in this situation delete the flavor? or hide it?08:57
joek-officei think about the migration path.08:58
joek-officeand i think that the filter/search functionality can add a sort of smooth migration path to csp's.08:59
tobberydbergYea, that is a problem that we are facing as well with our current 1000 flavors we would like to get rid of....08:59
tobberydbergWell, time is up and I need to run to another meeting unfortunate... Thanks for today guys! We will indeed have to come back to this topic...09:00
joek-officejust as i mentioned above, the flavors that the csp would get rid of, are hidden for the search and so the users/clients use new flavors in favour09:00
joek-officeok. thanks for the time and the discussions.09:01
gtemahe does not, because his TF/Ansible uses coded names09:01
tobberydbergYes, would be a good way forward...09:01
tobberydberg#endmeeting09:02
opendevmeetMeeting ended Wed Nov  8 09:02:07 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)09:02
opendevmeetMinutes:        https://meetings.opendev.org/meetings/publiccloud_sig/2023/publiccloud_sig.2023-11-08-08.10.html09:02
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/publiccloud_sig/2023/publiccloud_sig.2023-11-08-08.10.txt09:02
opendevmeetLog:            https://meetings.opendev.org/meetings/publiccloud_sig/2023/publiccloud_sig.2023-11-08-08.10.log.html09:02
joek-officebut i think to have the ability to search is just for these situations, where the client use TF/Ansible and in future should switch to the search way to find a suitable flavor09:02

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!