Wednesday, 2022-08-10

*** Adri2000_ is now known as Adri200008:29
NilsMagnus[m]hi13:58
Kristian[m]Hi13:58
tobberydberghi13:59
gtemaHey Tobby13:59
tobberydbergNice to see some people here! :-) 14:01
tobberydbergLets see if we can record som notes for this meeting as well14:01
tobberydberg#startmeeting publiccloud_sig14:01
opendevmeetMeeting started Wed Aug 10 14:01:53 2022 UTC and is due to finish in 60 minutes.  The chair is tobberydberg. Information about MeetBot at http://wiki.debian.org/MeetBot.14:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:01
opendevmeetThe meeting name has been set to 'publiccloud_sig'14:01
zigoo/14:02
fricklero/14:02
amorinhello14:02
gtemaanybody here tried to pass 2022.06 guideline?14:03
tobberydbergHello you all! Great to see you here 14:03
damiandabrowskihi14:03
tobberydbergI created an etherpad for this meeting. .. found here https://etherpad.opendev.org/p/publiccloud-sig-kickoff14:03
NilsMagnus[m]I'd like to start with a very wide-soped question: are we going to just discuss smaller fixes to the existing refstack process or is it also possible to dream about a general different way of public cloud certification in the O/S context?14:03
lhommeRareso/14:03
zigoNilsMagnus[m]: I don't think we're there yet, but eventually that's the start of the road no ?14:04
NilsMagnus[m]I for myself see a lot of problems with the existing refstack/guidelines/tempest/etc. process it just don't matches the realities of public clouds14:04
tobberydbergPlease put your name there and help out to fill in some other blanks 14:05
tobberydbergTo answer some above questions, the plan for this meeting is to set some goals for what we want to achieve  with this group14:05
zigoNilsMagnus[m]: I very much agree with all the remarks you did during the Berlin summit.14:05
gtemamy question on 2022.06 is actually going exactly into that direction. This guideline passes so many "assumptions" that are not by default valid that we are once again thinking that this makes no sense this way14:05
zigogtema: Can you give an example?14:06
gtemaimage download14:07
gtemawe forbid it from security reasons14:07
simeonhi!14:07
tobberydbergWe haven't tried that to the best of my knowledge 14:07
gtemathen on the subnet it uses enable_dhcp which in neutron is an optional feature14:07
gtemait also requires that "default" domain exists in the cloud14:08
zigoThat last one is obviously broken with Designate no?14:08
zigoOh, sorry, right.14:08
zigoDomain as in Keystone...14:08
gtemaI can't imagine as such any regular user is able to list domains, how should that work14:09
gtemaand also quote specific networking cases that fail on our side14:09
tobberydbergOne thing that I would like to start asking you all is time and how often to have these meetings. Is this a good time slot? Should we set up a poll with different slots and have a voting for that? What is your thoughts?14:09
fricklerI'd like a different slot to avoid conflict with kolla meeting14:10
gtemaI am ok with the time, maybe one hour later can be even better 14:10
NilsMagnus[m]<tobberydberg> "To answer some above questions..." <- One of my goals is to provide a mean/tool/way that is useful for public cloud users. They should be able to estimate if a public cloud offering deserves the label "public cloud based on openstack"14:10
zigoOne hour later would be max for me, not later (after, it's back home and dinner with familly).14:10
amorinsame here, 3PM UTC max14:11
amorinat least during summer time14:11
zigoAnyone against 15UTC during summer dailight changes?14:12
NilsMagnus[m]I go with any time. sleep is overrated anyway.14:13
gtemayou shouldn't be sleeping at that time anyway14:13
tobberydbergI'm ok with that as well, even if it is stretching it during summer time :-) 14:13
zigoHow often would the meeting be then?14:13
zigoWouldn't 1 a week be too much?14:14
gtemaI do not think be-weekly is required. Maybe 1x month14:14
zigoWorks for me.14:14
tobberydbergso, 1500 UTC we resolve the Kolla conflict and also seams ok to most. Did get a request from catalyst cloud to have a completely different slot for them to be able to participate 14:14
amorin+114:14
gtemawhich TZ are they from?14:15
fricklermaybe alternate between apac friendly and the 1500 slot?14:15
zigogtema: NZ ...14:15
tobberydbergI think bi-weekly is a good starting point, we can change later to less or more if we feel like it14:15
gtemaoh, that is going to be challenging for most here14:15
gtema(I mean about NZ TZ)14:15
tobberydbergYea, I know, that one is challenging indeed14:16
fricklersomething like 0800 UTC should be fine for europeans?14:16
zigoFor them, it has to be in EU's morning (or USA nights...).14:16
zigoYeah, 8UTC works (that's 10am in the summer).14:16
zigoNo confict for me.14:16
tobberydbergfor EU morning will at least map with evenings over there...14:17
damiandabrowski+1 for 8UTC14:17
zigotobberydberg: Did you think about changing time each week, so that we cover both NZ and USA?14:17
amorin8UTC ok also here14:17
zigoIs there anyone from north america in this group btw?14:17
zigo+1 too ...14:17
tobberydbergDo we have representation from america here as well?14:17
tobberydberghehe14:18
tobberydberg8UTC works very well for me as well. 14:18
tobberydbergzigo : thought about that as an alternative as well14:18
zigoIf none are joining from America TZ, then we can keep 8am UTC...14:20
gtema+0 (not perfect, but ok)14:21
tobberydbergDoes even or odd weeks matter for people here?14:21
amorinno matter here14:21
gtemanot for me14:21
* zigo doesn't mind14:21
* frickler neither14:21
NilsMagnus[m]are we still talking about wednesdays?14:21
gtemamost likely, otherwise I jump off the train ;-)14:22
tobberydbergHahaha14:22
tobberydbergMy suggestion, Wednesdays odd weeks at 0800 UTC14:23
* gtema agrees14:23
damiandabrowskiworks for me14:23
amorinhum, we have large scale meeting every wed at 15UTC14:23
amorinare we still considering 15UTC? or only 8?14:23
zigoamorin: Only 814:23
tobberydberg8 UTC suggestion right now14:23
amorinok perfect then14:23
zigoSo the kiwis can join ... :P14:24
gtemaLOL14:24
zigoNext topic? Can we talk about standardizing images?14:25
tobberydbergHahaha14:25
tobberydbergOk. good, made a comment of this in the etherpad14:25
tobberydbergMy plan was to discuss the goals for this group :-) 14:26
zigoRight, sorry.14:26
tobberydbergI think that can be good to get on paper14:26
NilsMagnus[m]goal proposal: make life easier for public cloud users14:26
tobberydbergMore of a mission NilsMagnus[m], but I totally agree 14:27
zigoAs discussed in berlin we have:14:27
zigo- Standadizing stuff (images, networking, flavors) so we have coherence between public clouds14:27
zigo- Validating public clouds (ie: refstack)14:27
zigoAnything else?14:27
NilsMagnus[m]@zigo: with "standardizing" you mean standardizing their names? then the same also applies to flavors etc.?14:28
zigoNilsMagnus[m]: Content too. Like for example, for images, we need to use the same set of properties (for example --property os_distro=debian), but names are important too.14:28
tobberydbergI agree that is really good goals that will go in the direction of what NilsMagnus[m] mentioned, make life easier for public cloud users14:29
gtemazigo: I do not believe we would be able to achieve general naming convention across all, this is utopic14:29
zigoFor images, my idea is that we all participate in a single tooling that we would all use, so that it sets the same images, properties, tags, etc. That's probably the easiest part to achieve, and it can be a start.14:30
zigoI'm sure we all have automated tooling that we aren't sharing between each other.14:30
zigoThat's a silly situation, IMO.14:30
gtemabased on metadata - ok, based on names - I doubt14:30
tobberydbergFor reference - the discussion notes from Berlin: https://etherpad.opendev.org/p/berlin-summit-future-public-cloud-sig14:30
fricklerfor flavors, there is some prior art like e.g. https://github.com/SovereignCloudStack/Docs/blob/main/Design-Docs/flavor-naming.md14:31
zigogtema: If we were to settle on common recommended names, I'd be very happy of the move, and would try to follow the standard.14:31
zigofrickler: I saw it, but it's a bit over-engineered. We have something very similar in production though.14:32
amorinfor flavors, that would be hard, it can depend a lot on the hardware..14:32
gtemawell, from my side I can only have some influence on adding some standart metadata, but naming is absolutely inachievable for me14:32
* frickler didn't mean to endorse that doc14:32
zigoThe biggest flow in that spec, IMO, is that it's very hard to understand from a final user point of view.14:32
NilsMagnus[m]For naming conventions I wonder if it is sufficient to have alias names, but I agree to gtema that selecting those instances by real properties is much better than parsing the resource's name14:33
zigoamorin: The point is to have a naming convention that includes the type of hardware you're proposing.14:33
amorinalso, it's hard to rename flavor after the region has been opened...14:33
tobberydbergI think metadata will take us pretty far, of course naming would be really useful for end users well. Recommendations of naming could be there though14:33
amorinI agree with gtema about metadata VS name14:33
zigoIs it possible to filter flavors using the openstack API ?!?14:34
* gtema checks14:34
zigoLike, can I ask nova "what are the flavors with between 10 and 20 GB RAM" ?14:34
zigoI don't think OpenStack has such a feature.14:35
gtemaminDisk, minRam, is_public are supported now14:35
zigoRight.14:35
NilsMagnus[m]zigo: at least that's possible (and feasible) on the client side14:35
zigoBut that's really not enough to get something useful.14:35
zigoYeah, with some json parsing ...14:35
NilsMagnus[m]it's a five-liner in SDK14:36
gtemathat is still a beginning, rest can be filtered by clients14:36
gtemaflavors sadly are currently not supporting metadata as such14:37
zigoNilsMagnus[m]: If it's a 5 liners in SDK, then it'd be easy to add as a new feature to the standard openstack client, no?14:37
gtemazigo: sure, but is OSC the only "target"?14:37
tobberydbergOther things mentioned in Berlin was the .well-known, test public clouds from upstram (SDK team)14:38
damiandabrowskion the other hand, if we can't agree on image names, i think there is absolutely no way to agree on a set of common flavors(in most cases it's more a business decision)14:38
gtemayeah, I can implement this in SDK/OSC and wanted to come up with proposal what should it contain14:39
zigogtema: Flavors have properties though, which are key/value stores. We could use that, but then we need the client to be able to filter when listing them.14:39
tobberydbergFor sure gtema 14:39
gtemazigo: sure? I do not see this now in the API docs14:40
zigodamiandabrowski: A set of common flavor, probably not, but a way to name them in a standard way, maybe.14:40
zigogtema: Absolutely not sure ... :)14:40
gtemaI know it is possible for images, but not sure about flavors14:40
zigo(about filters, though properties, pretty sure...)14:40
gtemahttps://docs.openstack.org/api-ref/compute/?expanded=create-flavor-detail,list-flavors-detail#list-flavors14:41
tobberydbergWould it be impossible for clouds to have a set of standard flavors that matches the recommendations? Even if they become duplicated of other flavors?14:41
zigoopenstack flavor set --property bla=bli cpu1-ram3-disk20 <--- this works, and it's been there since like the very begining of OpenStack.14:41
gtemahmm, interesting14:42
* NilsMagnus[m] sent a code block: https://matrix.org/_matrix/media/r0/download/matrix.org/VtRXOvKHpeNKkRRLBHLRficx14:42
zigoThough I don't think one can do "openstack flavor list --property bla=bli" to select the needed one.14:42
gtemaaaah, they have extra_specs (from 2.61) and those work like metadata14:43
gtemajust purely documented14:44
gtemaso maybe what can be done is `openstack flavor set --property alias "some_standard_name" my_funny_name`14:44
fricklerNilsMagnus[m]: just fyi sending multiline messages from the Matrix doesn't work well for normal clients14:45
gtemathis way we could have both full "metadata" stuff and also alias (which is then used on the client side for filtering)14:45
NilsMagnus[m]@frickler: ah, ok, will stop then14:45
tobberydbergThat is definitely an easier way to start with the naming situation, even though a recommended naming convention would be great14:46
tobberydberg(lets help out putting this into the etherpad as well) 14:47
simeonfor naming, this could be a (small) set of new "private" flavors just added to provider ones, for user who ask them ? Added in their specific projects ?14:48
simeonmeaning, no need to change anything but just add new ones uppon user request (through anyone admin panel or such)14:49
NilsMagnus[m]is our goal here to actually standardize names, or is it not rather more important to obtain the name of a {flavor, image} based on a few, important properties? (or all possible properties, which will be tough again)14:49
gtemaafair there were clouds with thousands of flavors already14:49
tobberydbergAs I see it, if there are already thousands of flavors, another 10 would make it worse ;-) (looking at our selves here) 14:50
simeonthe goal is more to have one common name instead of filtering thousands of flavors :) 14:50
gtemaadding those "virtual" resources will bring just more maintenance mess with it14:50
gtemasimeon: it is utopic to believe this is achievable across multiple clouds with their business owners14:51
gtemaand on the other side this is what "metadata" was created for14:52
tobberydbergMaybe you are right gtema, but NON enforcing naming convention I guess could be a start, even if it doesn't bring any value if none is following it14:53
gtemaI think agreeing on "alias" naming convention is achievable, but not the resource naming itself14:53
tobberydbergYea, metadata is definitely the most important 14:53
tobberydberg....including alias....14:54
gtemamaybe we should then list resources for which we need "agreement" first14:54
gtemaand then start talking on how to do this in particular14:54
tobberydbergSo, images then ... we discussed hosting a standard set of images upstream ... is that to much to strive for? 14:55
fricklerwhat is upstream here? opendev?14:55
tobberydbergAh, sorry ... you mean resources like ram, disk, cpu etc gtema?14:55
tobberydbergfrickler yes14:56
gtemanope, flavor, image, etc14:56
gtemaand for every one of those we would need to define set of those properties. But resource types first14:56
tobberydbergok14:57
tobberydbergFor me images and flavors are a given for a start, that will do a lot14:57
tobberydberg+114:57
gtemaI hope nobody will have an idea of standardizing regions and AZs ;-)14:57
fricklerI don't think opendev should host copies of distro images, if that is what you are suggesting14:57
tobberydbergif names of images are impossible, guess not ;-) 14:57
zigoSorry, but I have to go now.14:58
gtemafeel free to extend props (and resources) on etherpad14:58
damiandabrowskiI wonder if we want to have the same set of flavors, we are talking also about bandwidth/IOPS limits etc.14:58
zigoWill join next time we have a meeting, bye.14:58
damiandabrowskias flavors are not only about vcpu/ram/disk14:59
tobberydbergfrickler Was brought up during the summit, but maybe some reference specification of "links" to resources, also which images that are considered default for a public cloud14:59
fricklerwe have a list of links to distro image source somewhere, if you want to add some machine-readable version of it, that should be possible. doing a selection would be very biased however, I doubt there could be consensus on such a thing15:01
tobberydbergdamiandabrowski ... you are thinking about volume types for the IOPS?15:01
damiandabrowskinot exactly volume types, things like quota:disk_total_iops_sec, quota:vif_outbound_peak etc.15:02
damiandabrowskihttps://docs.openstack.org/horizon/latest/admin/manage-flavors.html#update-metadata15:02
tobberydbergfrickler Depends on how that list of "standard images" is composed, I mean it could be it staandard to have ubuntu 20.04, 22.04, centos 7, 8 etc15:02
NilsMagnus[m]import openstack... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/nuopUZNRGkSSWiIZsTJnZzYH)15:02
NilsMagnus[m]do we need more than ram, vcpus? I mean there are dozens of properties15:03
gtemayeah Nils, but not all of them are standard. I.e. for flavor naming SCS suggest things I never even thought about15:03
NilsMagnus[m]same applies to images, but these are not standardized intrinsically themselves15:03
fricklertobberydberg: but then I'd object to centos and require debian instead - just for the sake of argumentation, others would talk openEuler or suse maybe15:04
* damiandabrowski needs to leave15:04
tobberydbergSo, a suggestion from my side. When it comes to resources, maybe agree that flavors and images is what we start with ... might be too much with more from the start, then we have a baseline and can extend on that?15:05
tobberydbergfrickler get you point :-) 15:05
gtemaare we talking about which images must be on every cloud?15:05
tobberydbergRight15:05
NilsMagnus[m]What I actually mean: Is this really a problem we have to solve? I wrote the threeliner to show that's easy to find out matching resources as long as the data is there15:05
gtemarequiring there must be "ubuntu" on the cloud is too much I guess. User just should have possibility to request booting server with some distro not taking care of how it is called15:06
gtemaenforcing cloud to have "ubuntu" is even more utopic then having naming convention 15:07
* gtema is not agains ubuntu as such15:07
tobberydbergyou are probably right ... 15:07
tobberydbergI see that we are over time here... Lets continue to add thoughts in the etherpad and then we'll continue the discussion next week.15:07
gtemaoki15:08
* benoit joined late15:08
gtemawith a review of last minutes next time pls15:08
tobberydbergThanks a lot for today! Looking forward to continue this discussion next week!15:09
tobberydbergAbsolutely! 15:09
benoitI joined but there would be more people interested in joining this meeting but from NZ timezone15:09
benoitwould it be possible to make it easier for such people to join?15:09
gtemabenoit, we agreed to make it 8am UTC15:09
tobberydbergNext meeting will be Wednesday next week at 0800 UTC15:09
gtemaexactly for you guys to have it easier to join15:10
benoitthat'd be more people from Catalyst Cloud,15:10
benoitah awesome15:10
tobberydbergI hope that will make it better 15:10
NilsMagnus[m]okay, see you next time15:10
tobberydbergTake care! 15:10
gtemasee you, guys15:10
tobberydberg#endmeeting15:10
opendevmeetMeeting ended Wed Aug 10 15:10:35 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:10
opendevmeetMinutes:        https://meetings.opendev.org/meetings/publiccloud_sig/2022/publiccloud_sig.2022-08-10-14.01.html15:10
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/publiccloud_sig/2022/publiccloud_sig.2022-08-10-14.01.txt15:10
opendevmeetLog:            https://meetings.opendev.org/meetings/publiccloud_sig/2022/publiccloud_sig.2022-08-10-14.01.log.html15:10
simeonbye!15:10

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!