| *** enriquetaso has quit IRC | 01:12 | |
| *** RyanLiang has joined #openstack-manila | 02:04 | |
| *** tridde has joined #openstack-manila | 02:45 | |
| *** trident has quit IRC | 02:46 | |
| openstackgerrit | zhongshengping proposed openstack/puppet-manila master: Prepare Ussuri M1 https://review.opendev.org/698158 | 06:25 |
|---|---|---|
| *** lpetrut has joined #openstack-manila | 07:00 | |
| *** pcaruana has joined #openstack-manila | 07:39 | |
| openstackgerrit | Ryan Liang proposed openstack/manila master: VNX/Powermax: Make it work under python3 https://review.opendev.org/696002 | 07:44 |
| *** tosky has joined #openstack-manila | 08:11 | |
| *** maaritamm has joined #openstack-manila | 08:36 | |
| *** RyanLiang has left #openstack-manila | 08:57 | |
| *** RyanLiang has joined #openstack-manila | 08:58 | |
| *** sam_wan has quit IRC | 09:14 | |
| *** kambiz has quit IRC | 11:09 | |
| *** kambiz has joined #openstack-manila | 11:14 | |
| *** tommylikehu has joined #openstack-manila | 11:37 | |
| *** enriquetaso has joined #openstack-manila | 13:04 | |
| *** jcollin has joined #openstack-manila | 13:16 | |
| brtknr | hey folks, we have a ceph server on Luminous and Manila on Stein which uses Nautilus client | 13:17 |
| brtknr | unfortunately, there appears to be incompatibility as the server fails to accept requrests to create volumes | 13:18 |
| vkmc | brtknr, hey | 13:18 |
| brtknr | self.fs.setxattr(path, 'ceph.quota.max_bytes', to_bytes(size), 0) | 13:18 |
| vkmc | it is, yes, we are working on updates for the drivers so they can work with latest ceph versions | 13:18 |
| jcollin | that^ should be coming from create_subvolume() call | 13:19 |
| brtknr | vkmc: so the problem is with ceph client version? | 13:19 |
| brtknr | not ceph server? | 13:20 |
| brtknr | as the ceph client that comes with rocky doesnt have this issue | 13:20 |
| vkmc | jcollin, maybe you can address this better :) | 13:20 |
| brtknr | is there ia bug report for this somewhere? | 13:20 |
| jcollin | brtknr: can you give the complete logs to check? | 13:22 |
| tbarron | brtknr: why is your Stein manila using nautilus client? manila hasn't yet been updated to use nautilus so I'm | 13:22 |
| brtknr | http://paste.openstack.org/show/787368/ | 13:22 |
| tbarron | trying to understand why your client upgraded to nautilus when you went to stein (if that's what happened) | 13:23 |
| *** ChanServ changes topic to "OpenStack Shared File System Service | Ussuri Virtual PTG - 11th Dec 2019, 13:00 UTC - details/notes: https://etherpad.openstack.org/p/shanghai-ptg-manila-virtual" | 13:23 | |
| brtknr | in the kolla container i was using, the python-rbd version was python-rbd-14.2.1-0.el7.x86_64 | 13:24 |
| tbarron | manila is still tested with luminous upstream and just installing maniila doesn't install ceph ... | 13:24 |
| tbarron | brtknr: ah, kolla install, hmm.. | 13:25 |
| brtknr | and python-cephfs-12.2.11-0.el7.x86_64 | 13:25 |
| brtknr | in the kolla container i was using, the python-rbd version was python-cephfs-14.2.1-0.el7.x86_64 | 13:25 |
| brtknr | in rocky its python-cephfs-12.2.11-0.el7.x86_64 | 13:25 |
| brtknr | and python-rbd-12.2.11-0.el7.x86_64 | 13:25 |
| tbarron | brtknr: so this is really a deployment tool question, why is kolla forcing install of an incompatible client version | 13:26 |
| brtknr | tbarron: hmm not sure | 13:26 |
| tbarron | brtknr: why not sure :) | 13:26 |
| brtknr | i'll go ask in the kolla channel :) thanks for the swift responses | 13:27 |
| tbarron | manila doesn't determine the ceph versions that are actually installed | 13:27 |
| tbarron | tripleo, kolla, osa, etc. do | 13:27 |
| brtknr | where is the ceph version requirement supported by manila listed? | 13:27 |
| tbarron | but manila needs to do some work to be compatbile with nautilus, octopus, etc. as vkmc says | 13:27 |
| * tbarron looks | 13:28 | |
| jcollin | yeah, this should be upgraded to use mgr/volumes plugin interfaces. | 13:29 |
| brtknr | tbarron: ouch | 13:30 |
| tbarron | brtknr: we need to update | 13:31 |
| tbarron | https://docs.openstack.org/manila/latest/admin/cephfs_driver.html | 13:31 |
| tbarron | which just says "jewel or later" | 13:31 |
| tbarron | or just get the nautilus+ support in place :) | 13:32 |
| vkmc | tbarron, we need to update both drivers and docs yes | 13:32 |
| tbarron | jcollin: so that's the work vkmc is going to do in consultation with you :) | 13:32 |
| brtknr | so mimic is supported correct? | 13:32 |
| tbarron | brtknr: should work, not tested upstream where luminous is working in CI | 13:33 |
| jcollin | tbarron: Yes I understand :) | 13:33 |
| gouthamr | tbf, we test only with LTS releases, and haven't caught up to Nautilus yet | 13:33 |
| tbarron | brtknr: assuming your client and server ceph stuff are com[patible | 13:33 |
| tbarron | gouthamr: +1 | 13:33 |
| jcollin | there should be more details than shown here: http://paste.openstack.org/show/787368/. what setxattr returns from cephfs.pyx? | 13:34 |
| tbarron | jcollin: could that be a pythoo2/python3 issue in the ceph volume library? to_btyes(0) is having trouble? | 13:37 |
| tbarron | to_bytes ... (maybe) | 13:38 |
| tbarron | hmm my underscores are disappearing ... | 13:38 |
| jcollin | tbarron: "File "cephfs.pyx", line 1051" - which upstream ceph version you use? So that I could check what is 1051. | 13:40 |
| brtknr | i have filed a bug here: https://bugs.launchpad.net/kolla-ansible/+bug/1855885 | 13:41 |
| openstack | Launchpad bug 1855885 in kolla-ansible "Stein Manila+ only supports up to ceph mimic client" [Undecided,New] | 13:41 |
| brtknr | tbarron: jcollin: what follows is [Errno 95] error in setxattr | 13:46 |
| brtknr | tbarron: jcollin: what follows is OperationNotSupported: [Errno 95] error in setxattr | 13:46 |
| jcollin | brtknr, Yeah I saw that | 13:46 |
| vkmc | brtknr++ | 13:47 |
| tbarron | brtknr: what are the ceph versions from inside the kolla container running manila-share service | 13:47 |
| tbarron | for jcollin ^^ | 13:47 |
| brtknr | as mentioned in the bug report: 14.2.1-0 | 13:47 |
| brtknr | tbarron: | 13:47 |
| tbarron | brtknr: ty :) | 13:47 |
| brtknr | np | 13:48 |
| brtknr | we recently upgraded openstack to stein | 13:48 |
| jcollin | ret = ceph_setxattr(self.cluster, _path, _name, _value, _value_len, _flags) | 13:48 |
| brtknr | but now have rolled back manila to rocky | 13:48 |
| jcollin | This call returns a negative value | 13:48 |
| jcollin | I'm checking that | 13:49 |
| vkmc | jcollin, you managed to get your manila deploy with cephfs native using nautilus? | 13:54 |
| jcollin | vkmc, I've been working on that. Playing with openstack instances. | 13:55 |
| vkmc | jcollin, nice | 13:55 |
| jcollin | vkmc, this week I've been fixing some teuthology bugs related to mgr/volumes. I will continue where I stopped last week. | 13:56 |
| vkmc | jcollin, k k, I was going to ping you to hear how were you doing... got distracted with some other stuff | 13:57 |
| vkmc | we should sync up this/next week | 13:57 |
| jcollin | vkmc, sure. We will have a Bluejeans sometime this week. | 13:57 |
| *** eharney has quit IRC | 14:07 | |
| jcollin | brtknr: this seems to be an invalid size argument to_bytes() might have failed. Can you give python bt pastebin? | 14:12 |
| brtknr | jcollin: not sure what that means sorry | 14:17 |
| brtknr | "python bt"' | 14:17 |
| jcollin | brtknr: the full backtrace when the error occured? | 14:31 |
| gouthamr | vkmc tbarron: we had this mimic bug a while ago: https://bugs.launchpad.net/manila/+bug/1838936 | 14:31 |
| openstack | Launchpad bug 1838936 in Manila "manila-share not working with ceph mimic 13.2.6" [Undecided,New] | 14:31 |
| gouthamr | it appears to be very similar to the issue brtknr hit with nautilus | 14:31 |
| vkmc | gouthamr, good catch | 14:32 |
| brtknr | jcollin: gouthamr: that looks identical | 14:32 |
| tbarron | gouthamr: ++ | 14:32 |
| brtknr | jcollin: i put the full backtrace in the bug report | 14:33 |
| brtknr | so actaully, mimic doesnt work either | 14:33 |
| *** mmethot has joined #openstack-manila | 14:35 | |
| *** mmethot is now known as mmethot|conferen | 14:35 | |
| *** pcaruana has quit IRC | 14:36 | |
| tbarron | brtknr: agree. I wonder if the error is present with ceph-volume-library mimic+ irrespective of server side version or | 14:37 |
| tbarron | only if the server is still running luminous | 14:37 |
| brtknr | our server is Luminous | 14:37 |
| tbarron | jcollin: ^^ no need for immediate response, just framing a debug question | 14:37 |
| tbarron | brtknr: ack | 14:38 |
| tbarron | I think mimic or nautiluse volume-library will get baked into container images for manila (as happened to you with kolla) so | 14:39 |
| tbarron | the volume library needs to be backwards compatabile (if this is a compatibility issue) | 14:39 |
| tbarron | it might just be a plain bug in the newer volume library versions | 14:39 |
| *** eharney has joined #openstack-manila | 14:47 | |
| jcollin | tbarron, size 0 is allowed to unset the quota (infinite) in the mgr/volumes plugin. But it seems different in ceph_volume_client. | 14:49 |
| gouthamr | carloss: re: our earlier discussion of limiting the number of shares per share server: https://review.opendev.org/#/c/510542/ | 14:52 |
| carloss | oh, ty gouthamr, I'll take a look on the patch | 14:54 |
| jcollin | brtknr, I see that now. | 14:58 |
| *** pcaruana has joined #openstack-manila | 15:01 | |
| *** jcollin has quit IRC | 15:03 | |
| *** senrique_ has joined #openstack-manila | 15:08 | |
| *** enriquetaso has quit IRC | 15:10 | |
| tbarron | jcollin: yeah as you can see from https://bugs.launchpad.net/manila/+bug/1838936 we don't know why it's being set to zero there | 15:23 |
| openstack | Launchpad bug 1838936 in Manila "manila-share not working with ceph mimic 13.2.6" [Undecided,New] | 15:23 |
| *** jmlowe has joined #openstack-manila | 16:00 | |
| *** lpetrut has quit IRC | 16:29 | |
| *** lpetrut has joined #openstack-manila | 16:39 | |
| openstackgerrit | Merged openstack/puppet-manila master: Prepare Ussuri M1 https://review.opendev.org/698158 | 16:44 |
| *** mmethot|conferen is now known as mmethot | 16:48 | |
| *** jmlowe has quit IRC | 16:50 | |
| *** lpetrut has quit IRC | 16:50 | |
| *** senrique__ has joined #openstack-manila | 16:54 | |
| *** senrique_ has quit IRC | 16:57 | |
| *** RyanLiang has quit IRC | 16:58 | |
| *** tosky has quit IRC | 17:27 | |
| *** senrique__ is now known as enriquetaso | 17:50 | |
| *** kopecmartin is now known as kopecmartin|off | 18:41 | |
| *** mmethot has quit IRC | 18:46 | |
| *** mmethot has joined #openstack-manila | 18:46 | |
| *** eharney has quit IRC | 19:55 | |
| *** pcaruana has quit IRC | 20:16 | |
| *** eharney has joined #openstack-manila | 21:02 | |
| *** enriquetaso has quit IRC | 23:30 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!