Thursday, 2024-06-13

*** bauzas_ is now known as bauzas00:32
*** bauzas_ is now known as bauzas01:42
*** mhen_ is now known as mhen01:44
*** bauzas_ is now known as bauzas03:45
*** bauzas_ is now known as bauzas04:01
*** bauzas- is now known as bauzas04:34
*** bauzas_ is now known as bauzas05:34
*** bauzas_ is now known as bauzas05:59
*** bauzas_ is now known as bauzas06:15
*** bauzas_ is now known as bauzas06:31
*** bauzas_ is now known as bauzas07:00
*** bauzas_ is now known as bauzas07:41
*** bauzas_ is now known as bauzas08:24
*** bauzas_ is now known as bauzas08:55
*** bauzas_ is now known as bauzas09:23
*** tosky_ is now known as tosky12:28
mrjoshi#startmeeting glance14:00
opendevmeetMeeting started Thu Jun 13 14:00:39 2024 UTC and is due to finish in 60 minutes.  The chair is mrjoshi. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
opendevmeetThe meeting name has been set to 'glance'14:00
mrjoshi#topic roll call14:00
mrjoshi#link https://etherpad.openstack.org/p/glance-team-meeting-agenda14:00
mrjoshio/14:00
rubasovo/14:01
dansmitho/14:09
stephenfino/14:09
mrjoshiabhishek and pranali are not around today14:10
mrjoshishall we start?14:10
* abhishekk joining from mobile, might be late in replying14:12
mrjoshilet's start14:12
mrjoshi#topic release/periodic jobs updates14:12
mrjoshiM2 is 3 weeks from now14:13
mrjoshiperiodic jobs are all green 14:13
abhishekkack14:13
mrjoshi#topic Important Review14:14
mrjoshiSpec - deprecate metadata-encryption-key #link- https://review.opendev.org/c/openstack/glance-specs/+/91617814:14
mrjoshiSpec - Revised spec for Image Encryption #link - https://review.opendev.org/c/openstack/glance-specs/+/91572614:15
abhishekkI think pranali and you should provide reviews on encryption spec on priority14:15
mrjoshiNew location APIs #link - https://review.opendev.org/q/topic:%22New-Location-Apis%22+project:openstack/glance14:15
mrjoshiFix 500 if multi-tenant swift is enabled along with conf file #link- https://review.opendev.org/c/openstack/glance/+/92017014:16
dansmithso what's the status on the location api work? is it _actually_ ready for review now?14:16
mrjoshiabhishekk, ack14:16
abhishekkdansmith: last time I checked, it is ready IMO14:17
dansmithabhishekk: okay doesn't look like it has +1 or +2 on all the patches14:18
dansmithevery time I've gone through it I've found really obviously wrong stuff so I don't want to waste my time if it's not really ready14:18
dansmithbut if you say it is I'll take another pass through it14:18
abhishekkI haven't reviewed it since busy with other stuff but I will have a look at those 14:18
abhishekkmay be croeland1 will also help us here ^^14:19
dansmithokay maybe I'll hold off a week as I too have other things in the fire now14:19
abhishekkack, makes sense14:19
dansmithyeah that'd be good if croeland1 can could take a pass14:19
abhishekkI will request him offline, he might be not around today14:20
dansmithcool, thanks14:20
abhishekknp!, lets move ahead14:20
mrjoshimoving ahead14:20
mrjoshi#topic Open Discussions14:20
stephenfinGuess we're up. mbooth is out sick 🤒 today so I'm going to cover for him14:22
abhishekkohh14:22
abhishekkyou can take over14:23
stephenfinPer the agenda doc, we're working on openshift-installer and would like to take advantage of web-download to store the boot images for k8s nodes in Glance, avoiding proxying everything through localhost14:24
stephenfinThe image on the remote host is a qcow2.gz file, and we would expect to be able to use rely on the image_decompression plugin to decompress this before saving it in the store(s)14:25
abhishekkwe have import method discovery call which we can extend to provide required information 14:25
abhishekkhttps://docs.openstack.org/api-ref/image/v2/#import-methods-and-values-discovery14:25
stephenfinYup, that's what we need. It need sto be discoverable14:25
stephenfin*It needs to14:26
stephenfinAs things stand, we can identify the supported import methods, but not the supported plugins14:26
abhishekkI think as this is admin only api we can add --include-plugins option there to include available plugins14:26
dansmithnot all the plugins are really relevant I think (like conversion) but knowing if decompression is available is obviously pretty important to expose14:27
stephenfinOh, is '/v2/info/import' admin-only?14:27
abhishekkstephenfin: I think so14:28
dansmithis it? that seems, odd14:28
stephenfinHow does a user know they can import an image using e.g. web-download without access to that API? Try and wait for a failure?14:28
dansmithusers need to know if web-download is available, for example14:28
stephenfin^ this14:28
abhishekkcan't verify right now, as away from machine14:29
dansmithso,14:29
dansmiththe only thing I can think of,14:29
stephenfinnah, 'OS_CLOUD=devstack openstack image import info' gives me results back14:29
stephenfin(running against a normal devstack deploy)14:29
stephenfinso I think we're good14:29
abhishekkack14:30
dansmithis that the import stuff is sort of intertwined with the old tasks stuff, which was admin-only, so there may be some cases there where some or all of the details are hidden to normal users14:30
dansmithbut the discovery endpoint should be pretty open I expect14:30
abhishekkhmm14:30
stephenfinyes, I will check in more detail but the quick reproducer suggests this is open by default14:30
abhishekkSo we need a spec lite for this change and then we can make it quick to implement14:30
stephenfinsweet. I am happy to implement this if it would 14:31
abhishekkyes, it is open, checked policy file and found no policy rule related to it14:31
stephenfinhelp14:31
abhishekk++14:31
dansmithso, do you think any operators will be opposed to exposing, for example that image conversion or meta injection is enabled?14:31
dansmiththose are sort of operator policy decisions,14:31
dansmithbut decompression is more like "fyi, this is available"14:31
dansmithnot like they won't see the end result of the metadata/conversion once it's done of course...14:32
abhishekkNot sure about conversion, but inject metadata should not be exposed14:32
stephenfinI'm happy to treat decompression as special. We don't care about the other things since (afaict) that doesn't affect the user14:32
dansmithso we could either (a) have an exclude list of plugins to expose, or (b) just have a special flag for "is decompression enabled"14:33
abhishekkbetter to go with b14:33
dansmith(or just make decompression compulsory, as I kinda expect there's not much reason to not support that, if you're doing other transformation)14:33
abhishekkif we make it compulsory then we need to tweak a code to not include it in taskflow if image provided is not decompressed?14:34
stephenfinmaking it compulsory seems even better, otherwise imo the import should fail if the image is compressed and the plugin doesn't exist14:34
dansmithcould also make it a list of supported decompression routines, so people know, and then it can be empty if disabled and we can add to it later if we support like bzip2 or something14:34
dansmith"The supported archive types for Image Decompression are zip, lha/lzh and gzip"14:34
stephenfinmakes sense14:34
stephenfinso  it sounds like there's general acceptance that this is a valid feature and I should go write a small spec?14:35
dansmiththat ^ is tied to a specific release and a list of those in discovery would be more useful14:35
dansmithyes14:35
stephenfinspot on, I can start on that so14:35
stephenfinit won't help us right now, but it will down the line14:35
abhishekk++, thank you for taking it up14:35
stephenfinnp14:35
stephenfinwe have one other things but I think rubasov is up next14:36
rubasovhi everyone, I hope to ask for a bit of review attention14:36
rubasovI have a wip bugfix with two open questions14:36
abhishekkI have answered one I think14:36
abhishekkon the review14:36
rubasovthanks already!14:37
dansmithlink?14:37
abhishekkjust one suggestion, the bug has two many patches attached, I would suggest to abandon those which are not requird14:37
rubasovhttps://review.opendev.org/c/openstack/glance_store/+/91571114:37
abhishekk#link https://bugs.launchpad.net/glance-store/+bug/196567914:37
rubasovthe old fix was proposed by someone else so I cannot abandon that14:38
abhishekkOk, I will ask PTL to abandon that14:38
abhishekkSo you have 3 active patches out of the current you linked here is WIP14:39
rubasovthe first two in the series are not too important refactors14:39
rubasovthe 3rd wip patch if the proposed bugfix14:39
rubasovand that's where I was a bit lost with my questions, the remaining question is: is there a way to detect from glance if we have multiple glance processe started by wsgi?14:40
rubasov(because the bug itself only occurs when we have multiple glance processes)14:40
* abhishekk need to check for uwsgi14:41
rubasovit's not urgent in any way, but if you could add a review comment about it I'd really appreciate it14:41
dansmithis the problem when running glance standalone/eventlet mode or under wsgi with real threads? I assumed the former.14:42
rubasovand then I could turn the patch into something properly reviewable (not wip)14:42
rubasovI believe in both mode we can have multiple processes14:42
rubasovso I think I need to cover both modes14:43
dansmiththere's no *need* for multiple processes in wsgi/real-thread mode but sure, okay14:43
dansmithis the problem just that you need to use a lock(external=True) so that all the threads respect the lock around some cinder setup?14:43
rubasovbasically yes14:44
dansmithhttps://docs.openstack.org/oslo.concurrency/ocata/api/lockutils.html#oslo_concurrency.lockutils.synchronized14:44
dansmithexternal=True14:45
dansmithoh you're already using external_lock in your patch14:45
rubasovyes, but we also need to keep counting from how many places we need to keep the volume attached14:46
dansmithoh you need a refcount14:46
rubasovthat's why the current patch has a lockfile (to lock the acces to the state file) and a state file, keeping track of all volume uses14:47
dansmithnot really any way to do that across the processes without either doing it in the database or with posix ipc sort of stuff14:47
dansmithack, I haven't reviewed the patch, just skimmed while we're talking here14:47
rubasovI hope the idea is workable and clear from the current state, but because of the open questions could not make it non-wip14:49
dansmithack, I need to go grok the patch probably14:49
rubasovso if you could look at a bit despite it being wip, I'd appreciate that and could continue with it14:49
dansmithI see the state file stuff, I'd probably rather not do it that way but we can discuss more on the patch14:50
rubasovand that's all from me unless you have other questions about it14:51
rubasovI'm open to all suggestions and directions14:51
rubasovthanks in advance for your review!14:52
abhishekkthanks rubasov, stephenfin I think you can continue now14:52
stephenfinsweet14:52
stephenfinso our other issue is hopefully self-explanatory14:53
stephenfinwe have images and we have md5, sha1, and sha256 hashes available from the image provider, but glance will only gives us a sha512 hash14:53
stephenfinwe'd like to be able to ask glance to gives us hashes in (a limited set of) other formats14:54
abhishekkwe have hashing_algo config option14:55
stephenfinright, but that's not user-configurable so we can't use it on public clouds or clouds where we're just one of many tenants14:55
abhishekkSo you want to override the default by providing it while creating the image?14:56
dansmithI think we'd need to carefully consider that.. seems like a bad thing to give users control over14:56
dansmithAFAIK, the "these are the hashes we maintain on images" is sort of a site-wide policy/security decision, not to mention a CPU usage consideration14:57
stephenfinThat's mbooth's suggestion, yes. We could also store multiple hashes and allow the user to select which one they see, but there's a CPU consumption question there of course14:58
dansmithi.e. asking for "no hashes" or only weak ones is sort of an attack vector14:58
dansmithwe *do* store multiple hashes right?14:58
dansmithI mean, glance does/can14:58
dansmithokay maybe not multiple simultaneously14:59
abhishekkI haven't seen it though15:00
dansmithmrjoshi: I have to run to another meeting now, maybe we can continue this topic next week15:00
abhishekk++15:00
mrjoshidansmith, ack15:00
abhishekkwe are out of time anyway15:00
abhishekkthanks stephenfin and rubasov for joining15:00
rubasovthanks everyone!15:01
mrjoshilet's wrap up then!15:01
stephenfinokay, I can continue the discussion on #openstack-glance later. Thanks for your time!15:01
mrjoshithanks everyone for joining!15:01
mrjoshi#endmeeting15:01
opendevmeetMeeting ended Thu Jun 13 15:01:49 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:01
opendevmeetMinutes:        https://meetings.opendev.org/meetings/glance/2024/glance.2024-06-13-14.00.html15:01
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/glance/2024/glance.2024-06-13-14.00.txt15:01
opendevmeetLog:            https://meetings.opendev.org/meetings/glance/2024/glance.2024-06-13-14.00.log.html15:01
*** bauzas_ is now known as bauzas17:07
*** bauzas_ is now known as bauzas18:29
*** bauzas_ is now known as bauzas18:46
*** bauzas_ is now known as bauzas19:51
*** bauzas_ is now known as bauzas20:21
*** bauzas_ is now known as bauzas20:42
*** haleyb is now known as haleyb|out20:56
*** bauzas_ is now known as bauzas22:52

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!