Thursday, 2021-01-28

*** tosky has quit IRC00:21
*** lifeless has quit IRC00:55
*** lifeless has joined #openstack-cinder00:57
*** sapd__x has joined #openstack-cinder01:12
*** priteau has quit IRC01:16
*** enriquetaso has quit IRC01:19
*** zenkuro has joined #openstack-cinder01:19
*** zenkuro has quit IRC01:24
*** zenkuro has joined #openstack-cinder01:24
*** baojg has joined #openstack-cinder01:37
*** knomura has joined #openstack-cinder02:05
*** sapd__x has quit IRC02:07
*** knomura has quit IRC02:09
*** hamalq has quit IRC02:10
*** irclogbot_1 has quit IRC02:21
*** n-saito has quit IRC02:21
*** CeeMac has quit IRC02:21
*** jdillaman has quit IRC02:22
*** jdillaman has joined #openstack-cinder02:22
*** CeeMac has joined #openstack-cinder02:22
*** irclogbot_2 has joined #openstack-cinder02:22
*** xinliang has joined #openstack-cinder02:29
*** rcernin has quit IRC02:34
*** rcernin has joined #openstack-cinder02:36
*** psachin has joined #openstack-cinder03:36
openstackgerritHironori Shiina proposed openstack/cinder-tempest-plugin master: WIP: Add a job for S3 backup driver  https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/77208504:07
*** xinliang has quit IRC04:13
*** gouthamr has quit IRC04:18
*** benfelin has quit IRC04:19
*** GirishChilukuri has joined #openstack-cinder04:21
*** vishalmanchanda has joined #openstack-cinder04:22
openstackgerritMerged openstack/cinder master: doc: update release cycle tasks  https://review.opendev.org/c/openstack/cinder/+/75978204:29
*** lifeless has quit IRC04:36
*** lifeless has joined #openstack-cinder04:38
*** lemko7 has joined #openstack-cinder04:57
*** lemko has quit IRC04:58
*** lemko7 is now known as lemko04:58
*** whoami-rajat__ has joined #openstack-cinder04:59
*** lemko2 has joined #openstack-cinder05:11
*** lemko has quit IRC05:12
*** lemko2 is now known as lemko05:12
*** ircuser-1 has joined #openstack-cinder05:13
*** GirishChilukuri has quit IRC05:22
openstackgerritHironori Shiina proposed openstack/cinder master: WIP: Temporal fix for S3 backup driver test  https://review.opendev.org/c/openstack/cinder/+/77277305:23
*** udesale has joined #openstack-cinder05:28
*** GirishChilukuri has joined #openstack-cinder05:41
*** baojg has quit IRC05:49
*** baojg has joined #openstack-cinder05:49
*** baojg has quit IRC05:49
*** baojg has joined #openstack-cinder05:50
*** baojg has quit IRC05:50
*** udesale_ has joined #openstack-cinder05:50
*** baojg has joined #openstack-cinder05:51
*** baojg has quit IRC05:51
*** baojg has joined #openstack-cinder05:51
*** baojg has quit IRC05:52
*** baojg has joined #openstack-cinder05:52
*** baojg has quit IRC05:52
*** baojg has joined #openstack-cinder05:53
*** udesale has quit IRC05:53
*** baojg has quit IRC05:53
*** baojg has joined #openstack-cinder05:54
*** baojg has quit IRC05:54
*** baojg has joined #openstack-cinder05:55
*** baojg has quit IRC05:55
*** baojg has joined #openstack-cinder05:55
*** baojg has quit IRC05:56
*** baojg has joined #openstack-cinder05:56
*** baojg has quit IRC05:56
*** baojg has joined #openstack-cinder05:57
*** baojg has quit IRC05:57
*** baojg has joined #openstack-cinder05:58
*** baojg has quit IRC05:58
*** baojg has joined #openstack-cinder05:58
*** baojg has quit IRC05:59
*** baojg has joined #openstack-cinder05:59
*** baojg has quit IRC06:00
*** baojg has joined #openstack-cinder06:00
*** baojg has quit IRC06:00
*** baojg has joined #openstack-cinder06:07
*** tzumainn has quit IRC06:11
*** sfernand has quit IRC06:11
*** rcernin has quit IRC06:18
*** rcernin has joined #openstack-cinder06:22
*** ircuser-1 has quit IRC06:31
*** jopdorp has joined #openstack-cinder06:32
jopdorplooks like the s3 backup driver is finally going to get merged, awesome!06:32
jopdorpMasahiro Okuri is a hero06:33
*** ircuser-1 has joined #openstack-cinder06:34
*** hdahly has joined #openstack-cinder06:35
*** GirishChilukuri_ has joined #openstack-cinder06:38
*** GirishChilukuri has quit IRC06:41
*** hdahly has quit IRC06:45
*** baojg has quit IRC06:45
*** walshh__ has joined #openstack-cinder06:49
*** walshh_ has quit IRC06:49
*** walshh__ is now known as walshh_06:49
*** hshiina has quit IRC06:53
*** ircuser-1 has quit IRC06:54
*** hdahly has joined #openstack-cinder06:57
*** JaySee has joined #openstack-cinder07:03
*** udesale__ has joined #openstack-cinder07:05
*** m75abrams has joined #openstack-cinder07:05
*** udesale_ has quit IRC07:07
*** udesale__ has quit IRC07:12
*** hshiina has joined #openstack-cinder07:19
*** hdahly has quit IRC07:22
*** rcernin has quit IRC07:42
*** GirishChilukuri_ has quit IRC07:50
*** rcernin has joined #openstack-cinder08:15
openstackgerritMasahiro Okuri proposed openstack/cinder master: created s3 cinder backup driver  https://review.opendev.org/c/openstack/cinder/+/74656108:18
*** jgriffith has quit IRC08:25
*** jgriffith has joined #openstack-cinder08:26
*** rpittau|afk is now known as rpittau08:27
*** caiqilong has joined #openstack-cinder08:33
*** hshiina has quit IRC08:41
*** tosky has joined #openstack-cinder08:45
*** GirishChilukuri has joined #openstack-cinder08:50
*** hshiina has joined #openstack-cinder08:54
*** tkajinam has quit IRC08:58
openstackgerritMasahiro Okuri proposed openstack/cinder-tempest-plugin master: WIP: Add a job for S3 backup driver  https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/77208509:03
*** GirishChilukuri_ has joined #openstack-cinder09:08
*** GirishChilukuri has quit IRC09:12
*** martinkennelly has joined #openstack-cinder09:27
*** ircuser-1 has joined #openstack-cinder09:36
*** ociuhandu has joined #openstack-cinder09:40
*** udesale has joined #openstack-cinder10:20
*** rcernin has quit IRC10:24
*** zenkuro has quit IRC10:26
*** udesale has quit IRC10:46
*** baojg has joined #openstack-cinder10:47
*** udesale has joined #openstack-cinder10:48
*** benfelin has joined #openstack-cinder10:49
*** rcernin has joined #openstack-cinder10:50
*** martinkennelly has quit IRC10:59
*** rcernin has quit IRC11:08
*** ociuhandu has quit IRC11:09
*** ociuhandu has joined #openstack-cinder11:09
*** ociuhandu has quit IRC11:10
*** ociuhandu has joined #openstack-cinder11:10
*** ociuhandu has quit IRC11:11
*** ociuhandu has joined #openstack-cinder11:12
*** ociuhandu has quit IRC11:17
*** udesale has quit IRC11:18
*** zenkuro has joined #openstack-cinder11:23
*** ociuhandu has joined #openstack-cinder11:25
*** zenkuro has quit IRC11:27
openstackgerritRajat Dhasmana proposed openstack/cinder-tempest-plugin master: Add Snapshot data integrity test  https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/70249511:37
whoami-rajat__eharney: hey, the devstack-plugin-nfs-tempest-full-ussuri job is failing consistently on devstack-plugin-nfs project gate. I found the trace of failure but not sure what to make out of it http://paste.openstack.org/show/802078/12:12
whoami-rajat__both the paths are same unless it's comparing the json with the path string12:13
*** dviroel_ is now known as dviroel12:16
*** ociuhandu has quit IRC12:31
*** ociuhandu has joined #openstack-cinder12:31
*** ociuhandu has quit IRC12:36
*** priteau has joined #openstack-cinder12:42
openstackgerritIvan Pchelintsev proposed openstack/cinder master: PowerFlex documentation contains invalid paths  https://review.opendev.org/c/openstack/cinder/+/77287512:54
*** GirishChilukuri_ has quit IRC12:58
*** GirishChilukuri_ has joined #openstack-cinder12:58
*** sapd__x has joined #openstack-cinder13:01
*** GirishChilukuri has joined #openstack-cinder13:03
*** ociuhandu has joined #openstack-cinder13:04
*** GirishChilukuri_ has quit IRC13:05
*** udesale has joined #openstack-cinder13:14
openstackgerritWalt proposed openstack/cinder master: Add ceph iscsi volume driver  https://review.opendev.org/c/openstack/cinder/+/66282913:22
*** baojg has quit IRC13:35
*** GirishChilukuri has quit IRC13:45
*** tosky has quit IRC13:45
*** tosky_ has joined #openstack-cinder13:46
*** sapd__x has quit IRC13:46
*** benfelin has quit IRC13:46
*** benfelin has joined #openstack-cinder13:46
*** sapd__x has joined #openstack-cinder13:46
*** vishalmanchanda has quit IRC13:51
*** enriquetaso has joined #openstack-cinder14:00
*** sfernand has joined #openstack-cinder14:27
*** ociuhandu has quit IRC14:33
*** ociuhandu has joined #openstack-cinder14:33
*** ociuhandu has quit IRC14:38
*** pcaruana has quit IRC14:42
*** rcernin has joined #openstack-cinder14:46
*** rcernin has quit IRC15:00
*** pcaruana has joined #openstack-cinder15:01
*** ociuhandu has joined #openstack-cinder15:03
*** felipe_rodrigues has joined #openstack-cinder15:03
*** GirishChilukuri has joined #openstack-cinder15:11
*** gouthamr has joined #openstack-cinder15:23
*** hdahly has joined #openstack-cinder15:48
*** TusharTgite has joined #openstack-cinder15:52
*** m75abrams has quit IRC15:55
openstackgerritHironori Shiina proposed openstack/cinder master: created s3 cinder backup driver  https://review.opendev.org/c/openstack/cinder/+/74656115:57
*** psachin has quit IRC16:00
*** tosky_ is now known as tosky16:06
openstackgerritCorey Bryant proposed openstack/cinder master: Tests: Add another mock psutil in quobyte tests  https://review.opendev.org/c/openstack/cinder/+/77290216:10
*** mgagne has joined #openstack-cinder16:11
*** udesale has quit IRC16:17
openstackgerritLance Bragstad proposed openstack/cinder-tempest-plugin master: Implement basic protection testing jobs  https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/77291516:31
lbragstadgmann rosmaita ^ i think we have some issues16:31
rosmaitalbragstad: ok, will look later16:31
gmannlbragstad: rosmaita are we going with full stack tests in cinder? or unit/functional with mock ?16:33
gmannI might have missed the discussion you guys had16:34
openstackgerritLance Bragstad proposed openstack/cinder-tempest-plugin master: Implement basic protection testing jobs  https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/77291516:35
lbragstadgmann so - i attempted four different approaches for protection testing with cinder16:35
lbragstadi'm actually going to throw this in an etherpad...16:35
lbragstadhttps://etherpad.opendev.org/p/cinder-secure-rbac-protection-testing16:35
gmanni see thanks16:36
*** coreycb has quit IRC16:37
*** coreycb has joined #openstack-cinder16:38
lbragstadgmann i'll brain dump and get everything on paper16:39
*** TusharTgite has quit IRC16:40
*** dosaboy has quit IRC16:41
*** dosaboy has joined #openstack-cinder16:41
gmannlbragstad: thanks a lot but before you are spending so much time on PoC, I think we can decide which one we want to pick up and then spend time accordingly16:42
gmannrosmaita: ^^16:42
gmannbecause we know the overall pros/cons of each of them right16:43
rosmaitagmann: i think we are leaning toward a full stack test because we are concerned about getting the mocking correct, or having the mocks get out of date and diverge from real life16:44
gmannlbragstad: ah you already did those poc16:44
rosmaitagmann: yes, lbragstad has been very busy!16:45
lbragstadso - i've been tinkering with each approach16:45
gmannrosmaita: sure but only concern for me on those is runtime. to test policy we run the compelete opetration16:45
lbragstadthen i brought three of them to cinder's meeting yesterday, and we all decided to do another PoC using the cinder-tempest-plugin16:45
gmannand gate runtime issue  which we are facing now a days16:45
rosmaitagmann: i share your concern, but most of the time for the cinder-tempest-plugin jobs are spent in setup16:46
gmannif full test then we can reuse patrole test also but that need some work to have all context configured16:46
gmannon gate related issue we are discussing it in TC meeting too to optimize the jobs as it is very worst now a days16:48
gmannbut anyways I do not know the runtime yet so cannot say if that is something we should or should nto do16:49
gmannlbragstad: rosmaita other concern is - are you going to write all new tests for each policy?16:49
gmannso tests duplication is also one thing to consider16:49
openstackgerritMerged openstack/cinder stable/train: Change default glance_num_retries to 3  https://review.opendev.org/c/openstack/cinder/+/76278316:50
lbragstadgmann yeah - i agree16:58
lbragstadi put together each approach so cinder developers can see what they're getting into before they pick one16:58
lbragstadand i just noticed something with the tempest approach that's going to be interesting to fix...16:59
lbragstadso - currently, cinder endpoints from keystone have a project id substituted into the endpoint tempest, right?16:59
lbragstadfor example17:01
lbragstadhttp://paste.openstack.org/show/802091/17:01
lbragstadthat's ^ using a fresh devstack from yesterday17:01
lbragstadnotice the endpoint template for cinder17:01
*** GirishChilukuri_ has joined #openstack-cinder17:01
lbragstadand then look at the endpoint list in the catalog, it's empty17:01
lbragstadthis means that if you attempt to use dynamic credentials in tempest with a system user persona, it's not going to find a suitable endpoint when you use the volume client17:03
lbragstadfor example, if you were to uncomment this line https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/772915/2/cinder_tempest_plugin/rbac/v3/test_volume.py#19717:03
lbragstadthe call to volume_v3_client.delete_volume() is going to fail because the service catalog doesn't have any endpoints for the cinderv3 service.17:03
*** GirishChilukuri has quit IRC17:04
lbragstadso - you end up with a failure like this - http://paste.openstack.org/show/802092/17:06
*** hdahly has quit IRC17:07
*** ircuser-1 has quit IRC17:07
*** tosky has quit IRC17:07
*** tosky has joined #openstack-cinder17:07
*** hdahly has joined #openstack-cinder17:07
*** ircuser-1 has joined #openstack-cinder17:08
gmannlbragstad: interesting, it worked for nova case at least in my testing patches17:11
lbragstadhttp://paste.openstack.org/show/802093/ is updated with a project-scoped token so you can compare the two catalogs17:12
lbragstadgmann it works for nova because keystone isn't doing any string substitution17:13
lbragstadhttp://paste.openstack.org/show/802094/17:13
lbragstadat least in the endpoint17:13
lbragstadthe request doesn't have project_id in the path17:14
lbragstadGET call to compute for http://192.168.1.29/compute/v2.1/servers/detail17:14
lbragstadi think nova's legacy v2 endpoint has project_id templating17:21
lbragstadbut v2.1 does not17:21
gmannyeah 'compute' does not - https://github.com/openstack/devstack/blob/master/lib/nova#L36017:26
gmannlbragstad: for cinder here it is configuring https://github.com/openstack/devstack/blob/master/lib/cinder#L36217:26
lbragstadright17:27
gmanndoes cinder support non-project id too17:27
lbragstadi don't think so?17:27
gmannlbragstad: error is from mismatching at region https://github.com/openstack/tempest/blob/master/tempest/lib/auth.py#L59017:36
lbragstadthe API references project-id https://docs.openstack.org/api-ref/block-storage/v3/index.html#volumes-volumes17:37
*** hrybacki has joined #openstack-cinder17:37
gmannlet's wait for logs here and we can compare the what we got from keystone - https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/77291517:37
lbragstadgmann it's because the service catalog doesn't have endpoints for cinder - so there isn't anything in that list17:37
gmanni do not thinks so otherwise it could fail in  https://github.com/openstack/tempest/blob/master/tempest/lib/auth.py#L57117:38
lbragstadgmann the service is in the catalog - but it doesn't have endpoints17:39
lbragstadsee line 87 http://paste.openstack.org/show/802093/17:39
gmannlbragstad: ah got it, its empty one17:40
*** ociuhandu_ has joined #openstack-cinder17:40
lbragstadright17:40
gmannhumm17:41
lbragstadsystem-scoped tokens don't have projects, right... so keystone doesn't do any string substitutions when it builds the catalog (and i don't think it should)17:41
gmannyeah,17:42
*** ociuhandu has quit IRC17:43
gmannit was all project only scope on service side until now17:43
gmannlbragstad: I think we should remove project-id form url first but gain if anyone request with project-id then it is same issue. and nova also support both(i think we have note removed the old way)17:44
*** ociuhandu_ has quit IRC17:45
lbragstadgmann this is going to be naive question - but did nova do that using microversions? because wasn't v2 -> v2.1 a major shift?17:47
openstackgerritLee Yarwood proposed openstack/cinder-tempest-plugin master: zuul: Add nova-ceph-multistore as a non-voting job  https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/77183617:51
gmannlbragstad: we did with microversion but that was just for signal purpose and in v2.1 project_id is optional for all microversion17:51
lbragstadok - so someone from cinder is going to have to weigh in here, but it sounds like we might be able to fix this with microversions?17:51
gmannlbragstad: yeah, we may or maynot need microversion depends on how we want to notify it to users as this is big change from url perspective17:54
gmannbut i am wondering how we should convey or ignore/error for url with project-id which we still suport17:55
gmannnot just tempest but if anyone using similar catalog in their env17:56
*** rpittau is now known as rpittau|afk17:57
*** enriquetaso has quit IRC17:58
lbragstadmhm17:58
lbragstadthey'd need to remove the catalog templating i think17:58
*** enriquetaso has joined #openstack-cinder17:58
gmannhum18:03
gmannmay be we can docuement it kesystone side18:04
gmann*keystone18:04
lbragstadas in - if you want to use secure rbac with cinder you need to setup your cinder endpoints like this...18:04
lbragstadis that what you mean?18:04
gmannlbragstad: or not sure if that is good idea or not, keystone can ignore the project_id  (provide non project id endpoitns) if non project scope is requested ?18:05
gmannthat is silent ignore but can be done with warning ?18:05
lbragstadmaybe?18:05
*** GirishChilukuri_ has quit IRC18:08
lbragstadgmann this is the implementation in keystone that handles the substitution18:09
lbragstadhttps://opendev.org/openstack/keystone/src/branch/master/keystone/catalog/backends/sql.py#L325-L43018:09
lbragstadhttps://opendev.org/openstack/keystone/src/branch/master/keystone/catalog/backends/sql.py#L330-L33318:10
lbragstadwe take the same approach with domain-scoped tokens18:13
gmannlbragstad: i see, so if they get all with CONF.endpoint_filter.return_all_endpoints_if_no_filter=True then it can be still used right ?18:14
lbragstadthat option is True by default i think18:16
lbragstadhttps://opendev.org/openstack/keystone/src/branch/master/keystone/conf/endpoint_filter.py#L28-L3618:17
*** felipe_rodrigues has quit IRC18:23
*** whoami-rajat__ has quit IRC19:58
*** rcernin has joined #openstack-cinder20:03
*** rcernin has quit IRC20:30
*** rcernin has joined #openstack-cinder20:41
*** ircuser-1 has quit IRC20:44
*** zzzeek has quit IRC20:57
*** zzzeek has joined #openstack-cinder20:57
*** ircuser-1 has joined #openstack-cinder21:00
*** rcernin has quit IRC21:34
*** rcernin has joined #openstack-cinder21:51
*** JaySee has quit IRC22:23
*** JaySee has joined #openstack-cinder22:23
*** abishop has quit IRC22:24
*** jgriffith has quit IRC23:02
*** jgriffith has joined #openstack-cinder23:04
*** JaySee has quit IRC23:12
*** JaySee has joined #openstack-cinder23:13
*** JaySee has quit IRC23:15
*** JaySee has joined #openstack-cinder23:15
*** knikolla has quit IRC23:36
*** sri_ has quit IRC23:36
*** knikolla has joined #openstack-cinder23:36
*** ildikov has quit IRC23:36
*** sri_ has joined #openstack-cinder23:36
*** Nebby has quit IRC23:37
*** dviroel_ has joined #openstack-cinder23:37
*** PrinzElvis_ has joined #openstack-cinder23:37
*** PrinzElvis has quit IRC23:37
*** PrinzElvis_ is now known as PrinzElvis23:37
*** patrickeast_ has joined #openstack-cinder23:37
*** patrickeast has quit IRC23:37
*** patrickeast_ is now known as patrickeast23:37
*** Nebby has joined #openstack-cinder23:37
*** dviroel has quit IRC23:37
*** dviroel_ is now known as dviroel23:37
*** ildikov has joined #openstack-cinder23:38
*** ircuser-1 has quit IRC23:41
*** sri_ has quit IRC23:41
*** sri_ has joined #openstack-cinder23:54
rosmaitaanyone who likes code removal, please review https://review.opendev.org/c/openstack/cinder/+/75891323:58
rosmaitait's also one less policy to worry about :)23:58

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!