Thursday, 2018-09-20

openstackgerritVipin Balachandran proposed openstack/cinder master: VMware: Storage policy support  https://review.openstack.org/60393800:38
*** lixiaoy1 has joined #openstack-cinder00:41
openstackgerritzhufl proposed openstack/cinder master: services api ref: fix field enum value and add missing field  https://review.openstack.org/60361900:43
*** hedvig_01 has quit IRC00:45
*** dhineshob has quit IRC00:46
jungleboyjlbragstad:  That is a good question.  It works somehow as users can see their own volumes and admin can see all volumes.  geguileo knows the database stuff better.  Maybe he has insight ...00:46
*** imacdonn has quit IRC00:49
*** cloudnull has quit IRC01:00
*** tezar has quit IRC01:00
*** tobias-urdin has quit IRC01:00
*** Guest58757 has joined #openstack-cinder01:03
*** mriedem_away has quit IRC01:08
*** Zer0Byte_ has quit IRC01:08
*** imacdonn has joined #openstack-cinder01:09
*** imacdonn has quit IRC01:14
*** imacdonn has joined #openstack-cinder01:15
*** yumiriam has quit IRC01:23
*** zhaochao has joined #openstack-cinder01:27
*** mschuppert has quit IRC01:29
*** erlon has joined #openstack-cinder01:35
lbragstadjungleboyj hmm - ok... it looks like it's because is_admin is set on the context?01:40
jungleboyjlbragstad:  Ah, that could be.01:41
lbragstadhttps://github.com/openstack/cinder/blob/446a9381ebbe2eb1315f52735cad24f7da0a5bcb/cinder/db/sqlalchemy/api.py#L1947 -> https://github.com/openstack/cinder/blob/446a9381ebbe2eb1315f52735cad24f7da0a5bcb/cinder/db/sqlalchemy/api.py#L192601:42
lbragstadhttps://github.com/openstack/cinder/blob/446a9381ebbe2eb1315f52735cad24f7da0a5bcb/cinder/db/sqlalchemy/api.py#L109-L11401:44
jungleboyjThe difference between the admin and non-admin one is if the volume_admin_metadata is returned.01:46
jungleboyjWhich makes sense.01:46
lbragstadhmm01:46
lbragstadyou mean the difference between how the queries are built?01:47
*** _hemna has quit IRC01:47
jungleboyjRight.01:48
lbragstadjungleboyj ahh01:48
jungleboyjBecause the owner of a volume should be able to see the volume but not the admin portion.01:49
*** _hemna has joined #openstack-cinder01:49
lbragstadso maybe it's a problem in how i'm mocking the volume using the fakes?01:50
lbragstadhttps://review.openstack.org/#/c/602489/3/cinder/tests/unit/api/v3/test_volume_protection.py@7501:50
jungleboyjLet me look here.01:50
* jungleboyj wants to note that I am terrible at mocks01:51
lbragstadi guess the big thing i was curious about was if a user that creates a volume can actually retrieve it01:51
jungleboyjlbragstad:  Yes.01:51
lbragstadok - then that points me in the right direction, if that's possible (and I assume things would be broken if that wasn't true) then i'm more than likely doing something wrong in the test01:52
*** erlon has quit IRC01:52
lbragstadi saw mocks used in other places for creating volumes to test the API, but i didn't go digging in the mock code all that much01:52
jungleboyjYeah, looking at the test here.01:53
jungleboyjlbragstad:  Oh, look at the next test.01:54
jungleboyjWait, you wrote that one too though.01:55
lbragstadhttps://review.openstack.org/#/c/602489/3/cinder/tests/unit/api/v3/test_volume_protection.py@75 ?01:55
lbragstadyeah - both of those fail, but not at the actual assertion01:55
jungleboyjOk.  That makes sense.01:55
lbragstadthey fail in the volume creation step01:55
lbragstadit looks like when a volume is created it's fetched, oto01:56
lbragstadtoo*01:56
lbragstadthe get appears to be failing01:56
lbragstadbecause the context i'm building for the request doesn't have is_admin=True (which is normal?)01:56
lbragstadso it doesn't return the volume i think it should?01:57
jungleboyjYeah.01:57
jungleboyjIt has to be something with the volume not being created with the right user and project.01:58
jungleboyjWe have some place you can easily create a fake colume but I can't find that right now.01:59
jungleboyjhttps://github.com/openstack/cinder/blob/master/cinder/tests/unit/fake_volume.py ?02:01
lbragstadi wonder if admin_metadata is being set on the object02:02
lbragstadby default or something?02:03
jungleboyjWell not in the fake_db_volume .02:03
jungleboyjhttps://github.com/openstack/cinder/blob/master/cinder/tests/unit/fake_volume.py#L3402:03
*** Dinesh_Bhor has joined #openstack-cinder02:04
*** hoonetorg has quit IRC02:04
lbragstadyeah - i'm building the volume by just using a cinder.objects.Volume()02:05
tommylikehuhey lbragstad, basically you need to pass project id into volume object when creating.02:05
lbragstad"building" becuase I don't think i'm actually building it? it's just an object to give to the mock to return i think?02:05
lbragstadahhh02:05
jungleboyjtommylikehu: Yay, someone smarter than me!  ;-)02:05
tommylikehulbragstad:  line 75: https://review.openstack.org/#/c/602489/3/cinder/tests/unit/api/v3/test_volume_protection.py02:05
tommylikehujungleboyj: lol02:06
lbragstadok02:06
jungleboyjtommylikehu:  Oh, that makes sense.02:06
lbragstadso the Volume object doesn't inspect the context to determine the project id?02:06
tommylikehulbragstad:  I guess so02:07
lbragstadinteresting02:07
jungleboyjlbragstad: That, however would explain the problem.02:07
lbragstadyeah.. exactly02:08
lbragstadlol02:08
lbragstadif a user attempts to ask cinder for a volume that was created by someone else, and they aren't an admin, what does cinder do?02:09
lbragstaddoes cinder return a 404 or a 403?02:09
jungleboyjI think it is a 403.02:09
jungleboyjThat or it may do 404 so as to not expose that the volume even exists.02:09
lbragstadsure...02:10
jungleboyjWe generally try not to provide any more information than we have to.02:10
openstackgerritLance Bragstad proposed openstack/cinder master: Propose example volume protection tests  https://review.openstack.org/60248902:11
lbragstadnice - that ^ passes for me locally02:11
lbragstadthanks tommylikehu jungleboyj!02:11
tommylikehulbragstad:  kind of funny , we do have policy to ensure the request context is the owner but the question is we will retrieve the object from database before we check the policy, so it's 404 now:)02:12
lbragstadi left a note on the 404 vs 403 part though...02:12
lbragstadyeah - it's kind of a chicken and egg situation02:12
tommylikehulbragstad:  correct:)02:12
lbragstadi wouldn't be opposed to excepting a 404 to return a 403 for uniformity, because i think we hit things like this in keystone, too02:13
lbragstadbut that's probably an API discussion for another time ;)02:14
*** hoonetorg has joined #openstack-cinder02:17
jungleboyjlbragstad:  Yay for it passing!02:19
lbragstad... maybe?02:19
lbragstadhmm02:20
lbragstadi can't make it fail..02:20
lbragstadby changing the policy02:20
jungleboyjAhip ir.02:20
jungleboyjShip it02:20
openstackgerritMerged openstack/os-brick stable/queens: FC Allow for multipath volumes with different LUNs  https://review.openstack.org/59450102:24
lbragstadi'll see if i can get something up that proves that this fails (or that the policy engine is working in tests) tomorrow02:26
lbragstadi appreciate the help!02:26
jungleboyjlbragstad:  Thank you for continuing to work on it.02:26
*** Dinesh_Bhor has quit IRC03:11
*** Dinesh_Bhor has joined #openstack-cinder03:12
*** caixiaoyu has joined #openstack-cinder03:19
*** caixiaoyu has joined #openstack-cinder03:20
*** caixiaoyu has quit IRC03:22
*** caixiaoyu has joined #openstack-cinder03:23
*** sapd1_ has quit IRC03:45
*** sapd1 has joined #openstack-cinder03:45
*** Dinesh_Bhor has quit IRC03:50
*** Dinesh_Bhor has joined #openstack-cinder04:46
*** Guest58757 is now known as cloudnull05:32
*** brinzhang has joined #openstack-cinder05:36
*** alexchadin has joined #openstack-cinder05:39
*** Luzi has joined #openstack-cinder05:44
tommylikehulbragstad: we have lots of similar testcases that proof our policy system works, but not for the volume show api, see one of these: https://github.com/openstack/cinder/blob/b669eeab36e1d179f3aa7cb36281adbda6fe78ca/cinder/tests/unit/api/contrib/test_hosts.py#L21505:53
*** Dinesh_Bhor has quit IRC06:08
*** alexchadin has quit IRC06:08
openstackgerrityenai proposed openstack/os-brick master: Improve docstrings  https://review.openstack.org/60399106:12
*** Dinesh_Bhor has joined #openstack-cinder06:15
*** dpawlik_ has joined #openstack-cinder06:38
*** Dinesh_Bhor has quit IRC06:38
*** belmoreira has joined #openstack-cinder06:39
*** dpawlik has quit IRC06:39
*** Dinesh_Bhor has joined #openstack-cinder06:42
*** dpawlik_ has quit IRC06:45
*** dpawlik has joined #openstack-cinder06:45
*** gkadam has joined #openstack-cinder06:46
*** rcernin has quit IRC07:02
*** e0ne has joined #openstack-cinder07:16
openstackgerrityenai proposed openstack/os-brick master: Remove the split mistake  https://review.openstack.org/60400407:37
*** Dinesh_Bhor has quit IRC07:39
*** Dinesh_Bhor has joined #openstack-cinder07:49
*** Dinesh_Bhor has quit IRC07:54
*** Dinesh_Bhor has joined #openstack-cinder08:01
*** zhongjun2_ has quit IRC08:04
*** hoangcx has quit IRC08:04
*** hoangcx has joined #openstack-cinder08:04
openstackgerritMerged openstack/cinder master: Fix typos in volume api ref doc  https://review.openstack.org/60326308:26
openstackgerritzhufl proposed openstack/cinder master: Fix some inconsistencies in qos-specs api ref  https://review.openstack.org/60402008:55
*** lixiaoy1 has quit IRC08:58
*** lixiaoy11 has joined #openstack-cinder08:58
*** Bhujay has joined #openstack-cinder09:00
*** Dinesh_Bhor has quit IRC09:01
*** lixiaoy11 has quit IRC09:03
*** Dinesh_Bhor has joined #openstack-cinder09:19
*** Tahvok has left #openstack-cinder09:19
*** tobias-urdin has joined #openstack-cinder09:35
openstackgerrithzliaoyuehua proposed openstack/cinder master: for test  https://review.openstack.org/60402509:35
*** belmoreira has quit IRC09:38
*** moshele has joined #openstack-cinder09:38
openstackgerrityenai proposed openstack/os-brick master: Improve docstrings  https://review.openstack.org/60399109:40
*** pcaruana has joined #openstack-cinder10:04
*** Dinesh_Bhor has quit IRC10:13
*** Dinesh_Bhor has joined #openstack-cinder10:15
*** Dinesh_Bhor has quit IRC10:16
*** alexchadin has joined #openstack-cinder10:27
*** alexchadin has quit IRC10:28
*** alexchadin has joined #openstack-cinder10:28
*** alexchadin has quit IRC10:33
*** abishop has joined #openstack-cinder10:51
*** ganso has joined #openstack-cinder10:54
*** belmoreira has joined #openstack-cinder10:57
*** erlon has joined #openstack-cinder11:07
openstackgerritRajat Dhasmana proposed openstack/cinder master: Fix multiattach set to false after retype  https://review.openstack.org/60404011:08
*** gnufied has joined #openstack-cinder11:08
*** pcaruana has quit IRC11:15
*** pcaruana has joined #openstack-cinder11:20
*** alexchadin has joined #openstack-cinder11:28
*** luizbag has joined #openstack-cinder11:29
*** pcaruana has quit IRC11:32
*** alexchadin has quit IRC11:33
*** gnufied has quit IRC11:34
*** pcaruana has joined #openstack-cinder11:39
openstackgerrithzliaoyuehua proposed openstack/cinder master: Fix TypeError when retrieve pools filtered by volume-type  https://review.openstack.org/60406711:47
*** pcaruana has quit IRC11:50
*** gnufied has joined #openstack-cinder11:57
*** alexchadin has joined #openstack-cinder12:08
*** gnufied has quit IRC12:14
*** dustins has joined #openstack-cinder12:26
*** dustins has quit IRC12:31
*** tpsilva has joined #openstack-cinder12:34
*** dustins has joined #openstack-cinder12:35
*** gnufied has joined #openstack-cinder12:41
*** dustins has quit IRC12:43
*** dustins has joined #openstack-cinder12:43
*** Bhujay has quit IRC12:43
*** Bhujay has joined #openstack-cinder12:44
*** Bhujay has quit IRC12:45
*** Bhujay has joined #openstack-cinder12:45
*** gkadam has quit IRC12:46
*** alexchadin has quit IRC12:48
*** gkadam has joined #openstack-cinder12:48
*** alexchadin has joined #openstack-cinder12:48
*** gkadam has quit IRC12:48
*** alexchadin has quit IRC13:01
*** mriedem has joined #openstack-cinder13:06
*** finix has joined #openstack-cinder13:27
*** caixiaoyu has quit IRC13:28
*** jistr is now known as jistr|call13:32
*** alexchadin has joined #openstack-cinder13:46
*** brinzhang has quit IRC13:46
*** e0ne has quit IRC13:48
lbragstaddoes cinder override policies in unit tests?14:11
*** dpawlik has quit IRC14:11
*** moshele has quit IRC14:11
smcginnislbragstad: I think I remember seeing that somewhere. In meeting now, but if you can't find an answer, I will try digging later.14:12
lbragstadsmcginnis no worries - i'll keep digging and see what i can find14:13
openstackgerritKeith Berger proposed openstack/cinder stable/pike: VMware: Use vSphere template as snapshot format  https://review.openstack.org/60410314:15
openstackgerritSean McGinnis proposed openstack/cinder stable/ocata: ScaleIO: Prevent usage of unsafe volumes  https://review.openstack.org/60410514:17
*** alexchadin has quit IRC14:21
*** alexchadin has joined #openstack-cinder14:25
lbragstadnvm... i think i figured it out https://github.com/openstack/cinder/blob/master/cinder/test.py#L261-L27014:28
lbragstadhttps://github.com/openstack/cinder/blob/master/cinder/tests/unit/policy.json14:29
smcginnisbingo14:29
ericyoungsmcginnis, I added the new scaleio/vxflex maintainer to that most recent patch14:29
smcginnisThanks ericyoung14:30
ericyoungI look in on each of them still but wanted to make sure that msabag was aware14:31
openstackgerritSean McGinnis proposed openstack/cinder stable/ocata: ScaleIO: Prevent usage of unsafe volumes  https://review.openstack.org/60410514:32
*** jistr|call is now known as jistr14:34
*** Luzi has quit IRC14:37
*** KeithMnemonic has joined #openstack-cinder14:40
*** zhaochao has quit IRC14:41
*** dpawlik has joined #openstack-cinder14:41
KeithMnemonicsmcginnis: Sanity check please. This is in Rocky already AFAIK, but maybe I am reading it wrong. https://review.openstack.org/60410314:41
*** dpawlik has quit IRC14:45
smcginnisKeithMnemonic: Yep, that merged in 2017. whoami-rajat must have just have only seen the patch against master and assumed it was recent.14:45
KeithMnemonicwhoami-rajat: please remove you -114:46
whoami-rajatsmcginnis: my bad, but IMO it still needs to be backported to queens first right?14:47
smcginniswhoami-rajat: It was committed in queens.14:49
*** Bhujay has quit IRC14:51
whoami-rajatsmcginnis: ok, thanks for the insights. KeithMnemonic done14:52
*** e0ne has joined #openstack-cinder14:56
openstackgerritLance Bragstad proposed openstack/cinder master: DO NOT MERGE: Showcase policy protection with tests  https://review.openstack.org/60411514:56
openstackgerritLance Bragstad proposed openstack/cinder master: DO NOT MERGE: Add an example test for policy change  https://review.openstack.org/60411614:56
lbragstadjungleboyj tommylikehu smcginnis ^14:57
smcginnisThanks for digging in to that lbragstad14:57
lbragstadi was able to make the tests i wrote in https://review.openstack.org/#/c/602489/4 fail14:58
lbragstadmore test coverage like that should make it so you can modify policies without being unaware of breaking users14:58
KeithMnemonicthanks whoami-rajat: , smcginnis:15:00
jungleboyjlbragstad:  Cool.15:00
*** etp has joined #openstack-cinder15:03
*** alexchadin has quit IRC15:04
lbragstadi can propose some docs to oslo.policy that elaborates on how to unit test APIs without integration tests by using oslo.context if that is helpful15:04
*** dklyle has joined #openstack-cinder15:04
smcginnislbragstad: That might be useful. I think this is probably a common thing that I would bet isn't well covered right now.15:07
lbragstadyeah - i would agree15:08
*** finix has quit IRC15:10
*** finix has joined #openstack-cinder15:11
*** jiaopengju has quit IRC15:15
*** jiaopengju has joined #openstack-cinder15:15
openstackgerritMerged openstack/cinder master: Remove aoe-revalidate, aoe-discover, aoe-flush  https://review.openstack.org/60323115:18
*** LiangFang has joined #openstack-cinder15:20
*** dave-mccowan has quit IRC15:25
*** Liang___ has joined #openstack-cinder15:27
*** Liang___ has quit IRC15:28
*** dave-mccowan has joined #openstack-cinder15:29
*** LiangFang has quit IRC15:31
*** yumiriam has joined #openstack-cinder15:44
*** uberjay has quit IRC15:50
*** uberjay has joined #openstack-cinder15:50
*** LiangFang has joined #openstack-cinder15:52
openstackgerrithzliaoyuehua proposed openstack/cinder master: Fix TypeError when retrieving pools filtered by volume-type  https://review.openstack.org/60406715:52
LiangFangCould anybody help to review:https://review.openstack.org/#/c/602571/ Specify image size to avoid glance backend resize when uploading volume to glance15:57
jungleboyjLiangFang:  Looking.15:58
LiangFangthanks, this works well in my environment15:58
*** finix has quit IRC16:00
openstackgerritDhinesh Balasubramaniam proposed openstack/cinder master: Hedvig Cinder driver implementation  https://review.openstack.org/43334116:18
*** keper7 has joined #openstack-cinder16:20
keper7Hi Cinder, I'm trying to import some Pure Storage volumes in and following their guide it says to use the cinder manageable-list command. My Cinder client is telling me that command does not exist, even though I see it in the documentation. ```cinder --version``` shows 4.0.1. Does anyone know which version supports this command? We really need it to succeed in a migration project.16:23
smcginniskeper7: It's a bit confusing because that was a microversion addition. So the client won't allow it unless you provide the version it was added or higher.16:24
smcginniskeper7: I think that was added in 3.8, but it appears our docs on that are not very clear.16:26
smcginniskeper7: But try "cinder --os-volume-api-version 3.8 manageable-list".16:26
keper7Yes!! Thank you so much16:27
smcginnisCool. No problem.16:27
jungleboyj:-)  We really need to improve the documentation around micro-versions.16:27
jungleboyjI think I had that as a to-do coming out of the PTG.16:27
smcginnisYet another example of why we need to change that client behavior like we talked about at the ptg.16:27
jungleboyjsmcginnis: ++16:28
smcginnisI think I said I would do it, but didn't see it in the #ACTION list.16:28
smcginnisOr someone did at least.16:28
jungleboyjHmmm, let me look at that.16:28
smcginnisWednesday morning IIRC.16:28
jungleboyjsmcginnis:  Ah, that was during the Review of the user Survey Results.  I missed creating a ACTION on that one.16:35
jungleboyjDo you want to take looking at that one or want me to look at it?16:36
smcginnisI can take it.16:36
jungleboyjOk.16:36
jungleboyjOk.  Action items updated.16:38
*** Bhujay has joined #openstack-cinder16:40
*** e0ne has quit IRC16:41
*** Bhujay has quit IRC16:41
*** Bhujay has joined #openstack-cinder16:42
openstackgerritSean McGinnis proposed openstack/python-cinderclient master: Default help output to include MV updates  https://review.openstack.org/60416016:44
smcginnisjungleboyj: ^16:44
smcginnis+1, -2 --- #winning16:45
*** hedvig_02 has joined #openstack-cinder16:45
openstackgerritMiriam Yumi proposed openstack/cinder-tempest-plugin master: Fix tempest_roles to run backup tests  https://review.openstack.org/60416116:47
smcginnishedvig_02: No need for private messages.16:47
smcginnisI can't unblock you from running your tests. No one is blocking you from doing so.16:48
hedvig_02@smcginnis: I wasn't sure if my user id was working for the openstack cinder channel16:48
hedvig_02@smcginnis: "Abandoned. Restore once you've actually run local tests so this doesn't waste gate resources when it can easily be checked for failures. " We received this comment from you on our check in. Could you please explain the status abandoned?16:50
smcginnishedvig_02: Yes. Despite repeated warnings to stop pushing up code without testing it locally, it keeps happening. So rather than letting that keep going through the gate and consuming resources there, I stopped it.16:52
*** BLZbubba has joined #openstack-cinder16:53
smcginnishedvig_02: I thought I saw issues there, but rerunning tests locally looks OK, so I've restored it.16:53
smcginnishedvig_02: But please do not push up future updates without running tests first.16:53
hedvig_02@smcginnis: The tox runs are passing on our end. We are not sure why it's failing on openstack. We have done our preliminary tests before pushing to openstack gate resources16:53
BLZbubbahi guys i'm trying "openstack volume service list" and when i use tcpdump on the cinder node, it shows a connection to localhost:35357 instead of controller:500016:53
BLZbubbabut there is nothing in /var/log/cinder/*log or /var/log/apache2/*log at all to say who is attempting this connection16:54
smcginnishedvig_02: The last patches pep8 job failure could not have passed locally.16:54
smcginnishedvig_02: Nor the several dozen other ones prior to that.16:54
BLZbubbahow do i figure out who has the bogus keystone_authtoken section?16:54
hedvig_02@smcginnis: I can show a screenshot which clearly displays tox -ep27 and tox -pep8 has passed.16:55
smcginnishedvig_02: Yes, as I said, I tested this one and it is fine now.16:55
hedvig_02okay16:55
BLZbubbai suspect something is up with wsgi but i have no idea how to debug that16:56
whoami-rajatBLZbubba: did you install openstack using devstack?16:57
hedvig_02@smcginnis:  I see the status Restored. Do we have to do run some command on us to resume the zuul run ?17:00
smcginnishedvig_02: No, it should automatically go as if it was a new version posted.17:01
hedvig_02@smcginnis:  Thank you17:01
smcginnishedvig_02: Thanks for checking on it.17:01
BLZbubbawhoami-rajat: no17:01
BLZbubbai used https://docs.openstack.org/cinder/rocky/install/cinder-storage-install-ubuntu.html17:02
BLZbubbacould this error in /var/log/apache2/cinder_error.log be the problem: The policy file policy.json could not be found.17:05
whoami-rajatBLZbubba: strange, can you share the output of  openstack --debug volume service list? also your cinder.conf17:11
whoami-rajatBLZbubba: you can try and create a policy file using this sample  https://docs.openstack.org/cinder/queens/sample_policy.html but that doesn't seem to be the problem here.17:13
imacdonnsmcginnis jungleboyj: I've coded an implementation of get_manageable_volumes() for the ZFSSA iSCSI volume driver ... would we need a BP to get that added? Maybe it could be considered a bug that we have manage/unmanage-volume but not get_manageable_volumes :)17:13
*** gkadam has joined #openstack-cinder17:14
jungleboyjimacdonn:  So, the offical person in me says it needs a BP.  The person who is moving to Storyboard says don't worry about it.  :-)17:15
imacdonnheh17:15
jungleboyjDon't worry about the BP.  There is a new process coming.17:15
jungleboyjIf it has a release note, that is what I care about.  Creating a bug for it wouldn't be all bad.17:16
jungleboyjBecause yeah, that should have probably been there.17:16
BLZbubba"GET /v2/os-services HTTP/1.1" 404 112 "-" "python-cinderclient"17:16
imacdonnI didn't do the manage/unmanage implementation (but I'm fixing a couple of issues with it) ... I'll look for a RN17:17
imacdonnspeaking of fixing those issues, this one (doc only) is ready for approval: https://review.openstack.org/#/c/603936/17:18
imacdonnthe other one (code fix) got hung up in the zuul illness yesterday .. I'm waiting for the backlog to clear a bit before retrying it17:18
jungleboyjJust need to put a Release Note in with the change you are creating now imacdonn17:21
imacdonnright, can do that17:21
jungleboyjimacdonn:  Thank you sir.17:22
imacdonnthank you :)17:22
BLZbubbawhen i run cinder-wsgi --port=8776 instead of apache, it also says "GET /v2/os-services HTTP/1.1" 404 11217:24
BLZbubbacould it mean that the volume service isn't registering properly or something like that?17:24
openstackgerritMerged openstack/cinder master: [Optimize] Use OVO when retrieve volume object  https://review.openstack.org/60355217:33
openstackgerritMerged openstack/cinder master: Add microversion history to api-ref  https://review.openstack.org/60348617:33
*** Bhujay has quit IRC17:34
keper7Hey guys is cinder manageable-list supposed to work with Ceph? Or just "real" storage appliances like Pure Storage? I'm trying to test it in pre-prod with Ceph Luminous and its not throwing an error, but returning nothing. Wondering if this is expected behaviour or maybe I have something configured wrong?17:34
jungleboyjkeper7:  I don't think Ceph has that implemented yet.  I feel like we talked about that last week.17:34
imacdonnIt's implemnented in the rbd driver, but I dunno if it works17:35
imacdonnI plagiarised it quite a bit for my implementation ;)17:35
keper7Ok, so not much point in my fighting with it right now. I'll wait and use the one with Pure, I'm told it is tested and works. Thanks again!17:36
jungleboyjimacdonn:  Ruh roh.17:36
imacdonnhttps://github.com/openstack/cinder/blob/master/cinder/volume/drivers/rbd.py#L1554-L159717:36
jungleboyjimacdonn:  So, they don't have unmanage.17:36
imacdonnyeah, I saw that17:36
jungleboyjkeper7:  Is it possible that your volumes are in-use?17:37
jungleboyjIt won't show up in your list if there is more than one watcher on a volume as it thinks it is in use by a client.17:38
imacdonnif that's the case, it should just list with with safe_to_manage=False .... if it works ;)17:38
jungleboyjimacdonn:  Oh, you are right.17:38
jungleboyjHmm, I need to play with that on one of my clusters.17:39
keper7rbd create --size 5 volumes/manageTest ;  cinder --os-volume-api-version 3.8 manageable-list $pool17:39
keper7returns an empty table17:39
keper7where pool came from ```cinder get-pools``` for my rbd driver17:41
jungleboyjHmmm.  That isn't good.17:42
*** dave-mccowan has quit IRC17:44
keper7I'm on Pike, could it not be implemented yet in my version?17:44
imacdonnYes, it looks like it got implemented in Queens17:45
jungleboyjkeper7:  Ah, good catch.  *phew*17:45
keper7ah ok, well glad that adds up then.17:46
*** dave-mccowan has joined #openstack-cinder17:46
keper7@imacdonn, for reference, how would you use safe_to_manage=False? I dont see it as an argument17:47
imacdonnkeper7: it's decided by the driver17:48
imacdonnsee https://docs.openstack.org/cinder/latest/contributor/drivers.html17:48
jungleboyjkeper7:  Right.  If it is an image that can't be managed for whatever reason that is what you will see.17:48
imacdonn"safe_to_manage (boolean): Whether or not this volume is safe to manage according to the storage backend. For example, is the volume in use or invalid for any reason."17:48
keper7An ok, I thought you meant I had to pass that to the manageable-list command to be able to see them. Thanks17:49
imacdonnnp17:49
BLZbubbawhoami-rajat: http://185.56.20.124/cinder.conf18:06
BLZbubbawhat's weird is that cinder-volume seems to be registering the lvm properly but any request to cinder-wsgi gives a 40418:06
BLZbubbabut don't they use the same cinder.conf?18:06
whoami-rajatBLZbubba: did you try using curl to hit the API if it succeeds, it maybe a problem at the openstack client side.18:09
whoami-rajatthe conf seems fine18:09
BLZbubbahere's the output from python2-cinder --debug service-list: http://185.56.20.124/service_error.txt18:10
*** e0ne has joined #openstack-cinder18:10
BLZbubbalet me figure out how to do the tokens with curl, curl gives me a 401 currently18:10
openstackgerritRajat Dhasmana proposed openstack/cinder master: Fix multiattach set to false after retype  https://review.openstack.org/60404018:11
BLZbubbai wish i could see WTF cinder-wsgi is doing, it is currently just saying 404 even with debug=True18:11
whoami-rajatopenstack token issue seems to generate valid authorized tokens18:12
BLZbubbaok cool it just says 404 still18:14
BLZbubbai think cinder-wsgi is jacked somehow18:14
imacdonnyou should be able to GET http://controller:8776/ without a keystone token18:15
imacdonn(it should show available API versions)18:16
BLZbubbawell this is on the cinder node18:17
BLZbubbahmm does that endpoint need to be on the controller?18:17
BLZbubbamaybe that's where i'm going wrong18:17
imacdonnwherever cinder-api is running18:18
BLZbubbacinder-api and cinder-wsgi are the same thing, right?18:19
BLZbubbaat least, cinder-wsgi seems to be the only important file in the cinder-api package18:20
imacdonnI think cinder-wsgi is intended to be run in something like uwsgi or mod_wsgi, whereas cinder-api is the eventlet-based version18:21
BLZbubbahmm, on ubuntu 18.04 the cinder-api package only contains some docs and /etc/apache2/conf-available/cinder-wsgi.conf18:22
imacdonnyeah, so that'd be for mod_wsgi18:22
BLZbubbathe real cinder-wsgi executable is from the python-cinder package18:23
imacdonnso are you running cinder-wsgi manually, or via httpd ?18:25
BLZbubbai tried it both ways18:27
BLZbubbaalways gives a 404 on any uri other than / and /v3/18:27
imacdonndoes / show API versions ?18:31
*** dhineshob has joined #openstack-cinder18:33
BLZbubbait appears so, there is application/vnd.openstack.volume+json;version=3 and also a version=218:34
*** LiangFang has quit IRC18:47
openstackgerritMerged openstack/cinder master: Fix typo  https://review.openstack.org/59750618:48
BLZbubbaugh this is just weird18:50
BLZbubbathe apache log says "Loaded extension: os-services register /usr/lib/python2.7/dist-packages/cinder/api/extensions.py:140"18:53
BLZbubbadoes that mean it should stop giving a 404 on /os-services or is there another step or two?18:57
openstackgerritMerged openstack/cinder master: trival: Fix some spacing issues  https://review.openstack.org/59754019:00
openstackgerritMerged openstack/cinder master: Dell PS Driver moves to maintenance mode  https://review.openstack.org/60344119:01
openstackgerritMerged openstack/cinder master: Remove os-image-create API extension  https://review.openstack.org/56852819:01
*** e0ne has quit IRC19:03
BLZbubbashould the / uri give a 300 response?19:09
*** dpawlik has joined #openstack-cinder19:12
imacdonnBLZbubba: what are you actually trying to accomplish ?19:12
*** dpawlik has quit IRC19:16
BLZbubbaimacdonn trying to make cinder-wsgi work for uris other than / /v2/ and /v3/19:16
BLZbubbai get a 404 on everything else19:17
imacdonnBLZbubba: But ... are you trying to install a released version of some distro of OpenStack, or make a development environment, or ... ??19:17
BLZbubbait is rocky from the standard ubuntu repo, using this guide: https://docs.openstack.org/cinder/rocky/install/cinder-controller-install-ubuntu.html19:18
BLZbubbacinder-volume seems to be reporting the correct lvm info19:18
BLZbubbathe debug logs claim that things like os-services are initializing19:19
imacdonnI don't know if there's a forum for help with the Ubuntu distro, but it seems you need that ... basic install/configure/get-started help ...19:19
imacdonnI'm not familiar with the way things are done in the Ubuntu distro, so can only guess19:20
jungleboyjBLZbubba:  You didn't actually make the endpoint http://controller:8776/v2/%\(project_id\)s did you?19:20
jungleboyjI saw you refernece that earlier.  'Controller' should be replaced with the system where CInder is running.19:20
BLZbubbai think this is ok, i'm not even using the endpoint really, just curl to port 8776 directly19:21
imacdonnthat is using the endpoint :) but you're not getting it from the keystone catalog19:21
*** dustins has quit IRC19:22
BLZbubbahehe yeah19:22
jungleboyjOk.19:22
BLZbubbai'm a n00b to wsgi, i'm trying to look in the code to figure out how the actual /v3/os-services uri is registered19:23
imacdonnyou're missing the project ID part19:25
imacdonnyou should be GET'ing something like '/v3/77e9ba96c4824317afc6c016725d5d7f/os-services' where "77e9ba96c4824317afc6c016725d5d7f" is the project ID associated with your keystone token19:26
imacdonnwhat does this say? openstack endpoint list --service volumev2 --interface public --format value --column URL19:28
imacdonn(or "volumev3")19:28
BLZbubbathe correct url: http://os-cinder:8776/v2/19:29
imacdonnthat is not the correct URL19:29
imacdonnit should be "http://os-cinder:8776/v2/%(tenant_id)s"19:29
BLZbubbaah ok19:29
imacdonner make that "project_id", not "tenant_id", although I think either will work19:30
*** e0ne has joined #openstack-cinder19:30
BLZbubbahehe i was just going to ask that19:31
*** e0ne has quit IRC19:34
imacdonnI need to fix that in my own deployment playbook19:34
*** belmoreira has quit IRC19:35
BLZbubbahmm should i just skip volumev2 from now on?19:36
imacdonnit's supposedly deprecated, but it still gets used by default in some places - e.g. openstacksdk/openstackclient19:37
imacdonnstory for that: https://storyboard.openstack.org/#!/story/200369119:37
BLZbubbaawesome, service list works now!19:39
BLZbubbayou guys rock19:39
imacdonn\o/19:39
BLZbubba_\m/19:39
BLZbubbanow the big question: will it magically work in horizon19:39
openstackgerritMerged openstack/cinder master: Fix pylint warnings for "unnecessary not"  https://review.openstack.org/60131219:40
*** e0ne has joined #openstack-cinder19:43
BLZbubbavolume attach worked on the first try.19:53
BLZbubbathat is bad luck :P19:53
imacdonnhah19:53
imacdonn"Wait - that worked? That can't be right"19:54
BLZbubbaok next i need to get the nvmet version working.  that is practically guaranteed not to work the first time20:04
*** erlon has quit IRC20:07
*** gkadam has quit IRC20:10
*** dustins has joined #openstack-cinder20:12
*** luizbag has quit IRC20:18
openstackgerritMerged openstack/os-brick master: Improve docstrings  https://review.openstack.org/60399120:28
*** keper7 has quit IRC20:39
*** dustins has quit IRC21:31
*** e0ne has quit IRC21:36
*** nikeshm has joined #openstack-cinder21:50
nikeshmany date on deadline for submission of new driver for S release21:51
nikeshmany date on approval of bp for new driver for S release21:52
openstackgerritiain MacDonnell proposed openstack/cinder master: ZFSSA iSCSI implement get_manageable_volumes()  https://review.openstack.org/60423021:57
woojaynikeshm: I think it will be similar to Manila timeline around early January for driver submission deadline.  https://releases.openstack.org/stein/schedule.html21:58
*** hedvig_02 has quit IRC22:07
openstackgerritMerged openstack/cinder stable/pike: ScaleIO: Prevent usage of unsafe volumes  https://review.openstack.org/60168122:10
openstackgerritMerged openstack/cinder stable/queens: Add missing 'target_obj' when perform policy check  https://review.openstack.org/59367522:10
openstackgerritMerged openstack/cinder stable/queens: Update delete group snapshot API exception handling  https://review.openstack.org/59320122:10
KeithMnemonicjungleboyj: Hi again ;-0  https://review.openstack.org/#/c/604103/22:15
*** ganso has quit IRC22:17
jungleboyjKeithMnemonic:  Will take a look later.22:17
KeithMnemonicthanks!22:18
*** spsurya has quit IRC22:48
*** xyang has quit IRC22:48
*** david-lyle has joined #openstack-cinder22:49
*** spsurya has joined #openstack-cinder22:50
*** dklyle has quit IRC22:51
*** rcernin has joined #openstack-cinder22:53
*** mriedem is now known as mriedem_away23:10
*** dpawlik has joined #openstack-cinder23:12
imacdonnany core team other than jungleboyj and smcginnis, please review https://review.openstack.org/#/c/593955/23:15
*** erlon has joined #openstack-cinder23:16
*** dpawlik has quit IRC23:16
openstackgerritDhinesh Balasubramaniam proposed openstack/cinder master: Hedvig Cinder driver implementation  https://review.openstack.org/43334123:18
openstackgerritMerged openstack/cinder stable/queens: Add user messages for extend volume operation  https://review.openstack.org/59320223:19
*** brinzhang has joined #openstack-cinder23:26
*** andreykurilin has quit IRC23:34
*** andreykurilin has joined #openstack-cinder23:35
*** rcernin has quit IRC23:36
*** rcernin has joined #openstack-cinder23:36
*** dpawlik has joined #openstack-cinder23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!