Wednesday, 2021-08-04

opendevreviewRajat Dhasmana proposed openstack/glance master: DNM: check grenade gate fix  https://review.opendev.org/c/openstack/glance/+/80332506:19
opendevreviewMerged openstack/glance master: Refactor gateway get_repo auth layer  https://review.opendev.org/c/openstack/glance/+/78991307:10
*** mabrams is now known as Guest327908:58
*** mabrams1 is now known as mabrams08:58
opendevreviewJosephine Seifert proposed openstack/glance-specs master: Spec-Lite to implement Image Encryption with delayed Secret Consumers  https://review.opendev.org/c/openstack/glance-specs/+/79213409:56
opendevreviewDan Smith proposed openstack/glance master: Make image update check policy at API layer  https://review.opendev.org/c/openstack/glance/+/78991513:54
opendevreviewDan Smith proposed openstack/glance master: Check get_image(s) in the API  https://review.opendev.org/c/openstack/glance/+/79606713:54
opendevreviewDan Smith proposed openstack/glance master: Add a member field to Image when appropriate  https://review.opendev.org/c/openstack/glance/+/79606613:54
opendevreviewDan Smith proposed openstack/glance master: Check delete_image policy in the API  https://review.opendev.org/c/openstack/glance/+/79807313:54
dansmithabhishekk: what about those requirements changes do you think impacts our use of enabled_backends?14:00
dansmithsince networkx is bumped in that patch and that is also in the trace, I imagine it has something to do with it,14:01
dansmithbut I don't know why it would have worked before and not now, and the only change needed is our enabled_backends14:01
abhishekkdansmith, same thing14:01
abhishekkI was not able to understand so I added you there14:02
abhishekkis this something like earlier mock was working for load_plugin and now its not ?14:03
dansmithI don't know, but apparently taskflow uses something in networkx and that seems like it must have changed14:03
dansmithmaybe we were never able to load_plugin, but taskflow didn't choke on a task step of None?14:03
abhishekkI think so14:04
abhishekkmay be I should try it locally14:06
dansmithI've repro'd it locally14:07
dansmithI really don't understand some of the multistore config stuff.. config options that are totally not present sometimes but are others14:07
dansmithit's very confusing14:07
dansmithlike why setting enabled_backends gives me this: oslo_config.cfg.NoSuchOptError: no such option os_glance_staging_store in group [DEFAULT]14:07
abhishekk:D14:08
abhishekkwhen you set config option, while store loading in glance-store it adds reserved stores to those options14:09
abhishekkmay be related to that14:09
dansmithbut tests above mine don't seem to do anything different, but they work14:10
abhishekklooking14:11
abhishekkbetween delete image patch of yours unit and functional is failing 14:12
dansmithyup14:13
opendevreviewDan Smith proposed openstack/glance master: Fix failing copy_image flow init  https://review.opendev.org/c/openstack/glance/+/80348414:17
abhishekk\o/14:18
abhishekkmay be we should add this patch as depends on to the requirements patch14:21
dansmithit has to be the other way around I think14:21
dansmithwell, we can for testing I guess, but they won't be able to merge until this lands, so we'd have to depends-on and then remove14:22
abhishekkhmm14:22
dansmithprometheanfire: the above is a potential fix for the glance fail on your requirements bump, do you want to depends-on it and try again?14:34
opendevreviewDan Smith proposed openstack/glance master: Check delete_image policy in the API  https://review.opendev.org/c/openstack/glance/+/79807314:34
dansmithabhishekk: I dunno why this wasn't failing before, because it was mocking the auth layer, which is gone ^14:34
prometheanfiredansmith: sure14:34
prometheanfirethanks for looking at it14:34
dansmithprometheanfire: tbc, it's this: https://review.opendev.org/c/openstack/glance/+/80348414:35
abhishekkdansmith, need to check14:36
prometheanfireupdated the commit14:38
dansmithprometheanfire: I shall remain perched upon the extreme edge of my seating surface14:38
prometheanfiredon't fall off14:39
prometheanfirethink there might be a merge conflict with virtualenv, going to preempt a rebase14:40
opendevreviewErno Kuvaja proposed openstack/glance master: Cache API endpoints  https://review.opendev.org/c/openstack/glance/+/79202214:50
jokke_abhishekk: ^^14:51
abhishekkjokke_, ack, will have a look soon14:51
abhishekkdansmith, there are other tests in that file which are using authorization for mocking as well, e.g. this test_image_import_proxies_error15:15
dansmiththis is really weird, because I ran all these yesterday locally and I swear they passed, but I repro'd that fail this morning15:16
dansmithbut yeah makes sense15:17
abhishekkyeah, I know because I also ran those locally :/15:17
dansmithI need to finish something else and then will circle back to this delete patch.. I haven't really spent much time on it (as you can tell)15:17
abhishekkack15:17
abhishekkbut others down the line looks solid and good to go15:18
*** whoami-rajat__ is now known as whoami-rajat15:37
opendevreviewAbhishek Kekane proposed openstack/glance master: Refactor gateway auth layer for metadef APIs  https://review.opendev.org/c/openstack/glance/+/79963215:39
opendevreviewAbhishek Kekane proposed openstack/glance master: Move metadef namespace policy checks in the API  https://review.opendev.org/c/openstack/glance/+/79963315:39
opendevreviewAbhishek Kekane proposed openstack/glance master: Move metadef object policy checks in the API  https://review.opendev.org/c/openstack/glance/+/79963415:39
opendevreviewAbhishek Kekane proposed openstack/glance master: Move metadef resource type association policy checks in the API  https://review.opendev.org/c/openstack/glance/+/79963715:39
opendevreviewAbhishek Kekane proposed openstack/glance master: Move metadef property policy checks in the API  https://review.opendev.org/c/openstack/glance/+/79963515:39
opendevreviewAbhishek Kekane proposed openstack/glance master: Move metadef tag policy checks in the API  https://review.opendev.org/c/openstack/glance/+/79963615:39
lbragstadi'm spinning up a new environment atm and i'm going to start looking at the glance changes here soon15:55
lbragstadsorry it's taken me a bit to get around to those - but they're at the top of my list for today 15:56
lbragstadi take it this is where i should start? https://review.opendev.org/q/topic:%22policy-refactor%22+(status:open%20OR%20status:merged)15:56
lbragstadhttps://review.opendev.org/q/topic:%2522policy-refactor%2522+status:open *15:57
abhishekklooking15:58
abhishekklbragstad, this sheet will give you all the overview15:59
abhishekkhttps://docs.google.com/spreadsheets/d/1SWBq0CsHw8jofHxmOG8QeZEX6veDE4eU0QHItOu8uQs/edit?pli=1#gid=015:59
abhishekkthis includes spec as well15:59
lbragstadsweet 15:59
lbragstadi'll familiarize myself with that and then pester if i have questions15:59
lbragstadthanks abhishekk 16:00
abhishekklbragstad, sounds good16:00
abhishekkhappy to have you back :D16:00
lbragstad:) i'm glad to see some patches and the refactor happening, that's awesome16:01
abhishekk:D16:03
abhishekkI will be back shortly from dinner break16:04
lbragstadok - biab16:04
dansmithabhishekk: prometheanfire blessed this: https://review.opendev.org/c/openstack/glance/+/80348416:18
abhishekkdansmith, ack, will approve as soon as it passes the job16:23
dansmithcool16:23
opendevreviewAbhishek Kekane proposed openstack/glance master: Refactor gateway auth layer for task APIs  https://review.opendev.org/c/openstack/glance/+/80224316:26
opendevreviewAbhishek Kekane proposed openstack/glance master: Deprecate task specific policies  https://review.opendev.org/c/openstack/glance/+/80224416:26
opendevreviewAbhishek Kekane proposed openstack/glance master: Move Tasks policy checks in the API  https://review.opendev.org/c/openstack/glance/+/80224516:26
opendevreviewDan Smith proposed openstack/glance master: Check delete_image policy in the API  https://review.opendev.org/c/openstack/glance/+/79807317:01
abhishekkdansmith, if I am correct, then the visibility checks like, publicize_image and communitize_image are part of modify (update) image policy patch17:15
dansmithmeaning the other ones that patch out auth layer.get?17:16
abhishekkno, wait17:18
dansmiththe others I saw in there were all import,17:18
dansmithwhich is not converted17:18
dansmithdid I miss some?17:18
abhishekkhttps://review.opendev.org/c/openstack/glance/+/789915/12/glance/api/v2/policy.py17:19
abhishekkthere is visibility check but I think those are for update only17:19
abhishekkwe need to perform those while creation as well17:19
dansmithokay you're just saying that we need to convert create, publicize, etc, right?17:21
abhishekkyes17:21
dansmithbut update is good as it is, no?17:21
abhishekkyeah17:21
abhishekkI was just updating the excel sheet, so thought we have it partially covered17:21
dansmithokay17:23
opendevreviewMerged openstack/glance master: Make image update check policy at API layer  https://review.opendev.org/c/openstack/glance/+/78991517:25
abhishekk\o/ first one got in17:26
dansmithhah, pretty quick on the draw marking that one complete on the spreadsheet :)17:29
abhishekklbragstad, when I clone glance-tempest-plugin manually and run tempest it does not work17:29
abhishekk:D17:29
abhishekkany reason why?17:29
abhishekkfails with oslo_config.cfg.NoSuchOptError: no such option enforce_scope in group [image-feature-enabled]17:29
lbragstadno idea - sounds like a tempest issue?17:29
abhishekkI do have tempest.conf under glance-tempest-plugin/etc directory17:30
abhishekkmight be17:30
opendevreviewMerged openstack/glance master: Fix failing copy_image flow init  https://review.opendev.org/c/openstack/glance/+/80348417:39
abhishekkcool17:41
*** ricolin_ is now known as ricolin18:02
ade_leerosmaita, hey - I responded to your question in https://review.opendev.org/c/openstack/glance/+/790536  with a question of my own 18:19
rosmaitaade_lee: i don't remember, will have to look more closely18:20
ade_leerosmaita, ok thanks -- I've been on pto for the last month, so I'm just getting back to things18:21
rosmaitaade_lee: left a response for you on https://review.opendev.org/c/openstack/glance/+/79053618:37
rosmaitaalso, when you have time, i left a question on a patch that merged already: https://review.opendev.org/c/openstack/glance_store/+/756157/3/glance_store/_drivers/cinder.py#83218:38
rosmaitano rush, though18:38
opendevreviewAbhishek Kekane proposed openstack/glance master: Refactor gateway auth layer for task APIs  https://review.opendev.org/c/openstack/glance/+/80224318:39
opendevreviewAbhishek Kekane proposed openstack/glance master: Deprecate task specific policies  https://review.opendev.org/c/openstack/glance/+/80224418:39
opendevreviewAbhishek Kekane proposed openstack/glance master: Move Tasks policy checks in the API  https://review.opendev.org/c/openstack/glance/+/80224518:39
abhishekkResolved merged conflicts ^^^18:39
ade_leerosmaita, the point of the patch was to run through whatever functional or other tests that glance runs through on a system where fips is enabled and make sure things still pass. 18:40
ade_leerosmaita, if that means we need to run a different test job under fips - then thats fine -- please add comments indicating which tests we should run18:41
ade_leerosmaita, I would guess given that we annotated out the md5 references, that things will likely pass - but you never know what else shows up and this makes sure we stay fips compliant18:43
ade_leeI'll take a look at your comment on the merged patch though too.18:43
rosmaitaade_lee: i thought you had already added a fips job?18:44
ade_leerosmaita, yup -- openstack-tox-functional-py36-fips  -- this patch just runs it on the glance repo18:45
ade_lee(makes it run on the glance repo)18:46
ade_leegiven that it passes - I can set it as voting if you like18:47
rosmaitawe should probably discuss at the weekly meeting ... i think we'd want to run a fips-mode job that excercised image import18:47
rosmaitaprobably some kind of tempest/devstack based job18:48
rosmaita(not that you have to put it together)18:48
ade_leerosmaita, is there one that already does this?18:48
rosmaitanot sure, probably best to ask dansmith or abhishekk, i think they've been working on the glance-tempest-plugin recently18:49
ade_leerosmaita, when is your weekly meeting?18:50
abhishekkade_lee, its tomorrow at 1400 UTC18:50
dansmiththe tempest plugin won't get you much in the way of import stuff, if that's what you want, IIRC18:50
dansmithjust copy our import devstack job and enable the other stuff18:51
rosmaitadansmith: i think that might be the job most likely to encounter fips difficulties?18:51
dansmithbecause of import? not sure why that would be, but..sure?18:52
ade_leedansmith, is that job defined in the devstack repo?18:53
dansmithno, in glance18:53
dansmithade_lee: https://github.com/openstack/glance/blob/master/.zuul.yaml#L22818:53
ade_leedansmith, rosmaita abhishekk ok - that should be easy enough to fipsify18:55
ade_leeI'll do that today and maybe we'll have a result by tomorrow18:55
rosmaitacool18:55
abhishekkack18:55
ade_leeI won't be able to make the meeting tomorrow, but I'll see if I can get dmendiza to join 18:56
abhishekkok18:57
abhishekkKindly add the topic to agenda, https://etherpad.opendev.org/p/glance-team-meeting-agenda18:57
ade_leewill do 18:57
abhishekkthanks18:58
ade_leethanks all!18:58
abhishekklbragstad, https://bugs.launchpad.net/glance-tempest-plugin/+bug/193893918:58
abhishekkmay be if you are busy then I will have a look and add you as a reviewe18:59
lbragstadabhishekk ack 19:10
abhishekkdansmith, added one question at https://review.opendev.org/c/openstack/glance/+/79963319:22
abhishekkthis is my patch :D19:22
abhishekklbragstad, for metadefs we haven't implemented RBAC yet that is the reason we are not testing it in functional testing19:30
abhishekkalso for other cases we have added new job in glance 'glance-tox-functional-py38-rbac-defaults' which will run all existing functional tests with secure rbac enabled19:32
lbragstadabhishekk ok - cool, that sounds good19:41
lbragstadi see the glance-secure-rbac-protection-functional job is still running and green 19:42
abhishekkyep 19:42
lbragstadbut - i imagine we will continue adding tests to that after the functional stuff lands?19:42
abhishekkyou mean additional tests to support these policy refactoring ?19:43
abhishekklbragstad, I am signing out for the day (its almost 1:30 AM here) 19:46
abhishekkplease add your suggestions on remaining metadef patches19:46
abhishekkglad to see that finally we are making progress 19:47
* abhishekk signing out for the day19:57
lbragstadabhishekk thanks - catch up with you tomorrow19:58
abhishekkyep, good day19:59
abhishekklbragstad, I think I should discuss the object case with you and then leave20:07
abhishekkhttps://review.opendev.org/c/openstack/glance/+/799634/13/glance/tests/unit/v2/test_metadef_resources.py20:07
abhishekkI guess I do see your point and try to fix it tomorrow20:10
abhishekkyep, will fix it tomorrow20:24
*** timburke_ is now known as timburke20:57
opendevreviewAde Lee proposed openstack/glance master: Add fips check job  https://review.opendev.org/c/openstack/glance/+/79053622:22

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!