*** gouthamr_ has joined #openstack-manila | 00:04 | |
*** gouthamr has quit IRC | 00:08 | |
*** mtanino has quit IRC | 00:16 | |
*** Suyi_ has quit IRC | 00:16 | |
*** akerr has joined #openstack-manila | 00:19 | |
openstackgerrit | Rodrigo Barbieri proposed openstack/manila: Share migration Newton improvements https://review.openstack.org/328431 | 00:52 |
---|---|---|
*** akerr has quit IRC | 00:55 | |
*** kaisers_ has quit IRC | 01:14 | |
*** yangyapeng has joined #openstack-manila | 01:18 | |
openstackgerrit | Rodrigo Barbieri proposed openstack/manila: Share migration Newton improvements https://review.openstack.org/328431 | 01:24 |
*** wangqun has joined #openstack-manila | 01:32 | |
*** ociuhandu has joined #openstack-manila | 01:32 | |
*** ociuhandu has quit IRC | 01:34 | |
*** akerr has joined #openstack-manila | 01:59 | |
*** akerr is now known as akerr_away | 02:19 | |
*** akerr_away is now known as akerr | 02:19 | |
*** akerr is now known as akerr_away | 02:20 | |
*** akerr_away is now known as akerr | 02:20 | |
*** akerr is now known as akerr_away | 02:20 | |
*** akerr_away is now known as akerr | 02:20 | |
*** akerr is now known as akerr_away | 02:21 | |
*** akerr_away is now known as akerr | 02:21 | |
*** akerr is now known as akerr_away | 02:22 | |
openstackgerrit | Rodrigo Barbieri proposed openstack/manila: [ZFSonLinux] Add share migration support https://review.openstack.org/353417 | 02:22 |
*** akerr_away is now known as akerr | 02:22 | |
*** akerr is now known as akerr_away | 02:23 | |
*** akerr_away is now known as akerr | 02:23 | |
*** gouthamr_ has quit IRC | 02:30 | |
*** magic has joined #openstack-manila | 02:32 | |
*** magic is now known as Guest33431 | 02:32 | |
*** xiaoyang has quit IRC | 02:35 | |
*** draynium has quit IRC | 02:45 | |
*** draynium has joined #openstack-manila | 02:48 | |
*** ociuhandu has joined #openstack-manila | 02:53 | |
*** akerr_ has joined #openstack-manila | 03:02 | |
*** kaisers_ has joined #openstack-manila | 03:02 | |
openstackgerrit | Peter Wang proposed openstack/manila: VNX: Use job for NFS share creation https://review.openstack.org/359567 | 03:05 |
*** akerr has quit IRC | 03:06 | |
*** ociuhandu has quit IRC | 03:07 | |
*** kaisers_ has quit IRC | 03:08 | |
*** akerr_ has quit IRC | 03:23 | |
openstackgerrit | Nam Nguyen Hoai proposed openstack/manila: TrivialFix: Remove cfg import unused https://review.openstack.org/360960 | 03:32 |
openstackgerrit | Merged openstack/manila: Implement replication support in huawei driver https://review.openstack.org/331586 | 04:05 |
*** ganso has quit IRC | 04:25 | |
*** senk has joined #openstack-manila | 04:34 | |
*** kaisers_ has joined #openstack-manila | 04:52 | |
*** kaisers_ has quit IRC | 04:57 | |
*** sandanar has joined #openstack-manila | 05:47 | |
*** nkrinner_afk is now known as nkrinner | 05:48 | |
*** kaisers_ has joined #openstack-manila | 05:56 | |
*** rhefner has quit IRC | 06:20 | |
*** pcaruana has joined #openstack-manila | 06:26 | |
*** lpetrut has joined #openstack-manila | 06:36 | |
*** ubijtsa has joined #openstack-manila | 06:39 | |
*** ubijtsa is now known as Guest54568 | 06:39 | |
*** Guest54568 has quit IRC | 06:42 | |
*** Guest54568 has joined #openstack-manila | 06:42 | |
*** Guest54568 is now known as assassin | 06:43 | |
*** rraja has joined #openstack-manila | 06:58 | |
*** dsariel has joined #openstack-manila | 07:09 | |
*** lpetrut has quit IRC | 07:21 | |
*** akapil has joined #openstack-manila | 07:32 | |
openstackgerrit | gecong proposed openstack/manila: Change assertTrue(isinstance()) by optimal assert https://review.openstack.org/362671 | 07:39 |
*** kaisers1 has quit IRC | 07:50 | |
*** kaisers has quit IRC | 07:52 | |
*** senk has quit IRC | 07:52 | |
*** kaisers has joined #openstack-manila | 07:53 | |
*** kaisers1 has joined #openstack-manila | 07:53 | |
*** vponomaryov has joined #openstack-manila | 08:07 | |
*** kaisers_ has quit IRC | 08:07 | |
*** kaisers_ has joined #openstack-manila | 08:08 | |
openstackgerrit | gecong proposed openstack/manila: Change assertTrue(isinstance()) by optimal assert https://review.openstack.org/362671 | 08:11 |
*** magic has joined #openstack-manila | 08:18 | |
*** magic is now known as Guest99973 | 08:19 | |
*** Guest33431 has quit IRC | 08:22 | |
*** aovchinnikov has joined #openstack-manila | 08:48 | |
*** akapil has quit IRC | 08:58 | |
*** akapil has joined #openstack-manila | 08:59 | |
*** lpetrut has joined #openstack-manila | 09:06 | |
openstackgerrit | Alexey Ovchinnikov proposed openstack/manila: [DNM] Tests for scenario tests https://review.openstack.org/340236 | 09:26 |
*** nkrinner has quit IRC | 09:29 | |
*** lpetrut1 has joined #openstack-manila | 09:34 | |
*** lpetrut has quit IRC | 09:34 | |
*** lpetrut1 is now known as lpetrut | 09:34 | |
*** nkrinner has joined #openstack-manila | 09:35 | |
*** kaisers_ has quit IRC | 09:48 | |
*** wangqun has quit IRC | 10:08 | |
*** yangyapeng has quit IRC | 10:21 | |
openstackgerrit | Alexey Ovchinnikov proposed openstack/manila: [DNM] Tests for scenario tests https://review.openstack.org/340236 | 10:34 |
openstackgerrit | Bhagyashri Shewale proposed openstack/python-manilaclient: Replace functions 'Dict.get' and 'del' with 'Dict.pop' https://review.openstack.org/361858 | 10:37 |
*** akapil has quit IRC | 10:44 | |
*** timcl has joined #openstack-manila | 10:54 | |
*** akapil has joined #openstack-manila | 10:58 | |
*** akapil_ has joined #openstack-manila | 10:59 | |
*** akapil has quit IRC | 10:59 | |
*** ganso has joined #openstack-manila | 11:18 | |
openstackgerrit | zhongjun proposed openstack/manila-specs: Add spec for enable IPv6 in manila https://review.openstack.org/362786 | 11:27 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [Tempest] Run tempest with the only plugin - manila's https://review.openstack.org/338371 | 11:33 |
ganso | vponomaryov: welcome back | 11:33 |
vponomaryov | ganso: hey, Hello Rodrigo | 11:34 |
ganso | vponomaryov: Hello Valeriy. How was your vacation? | 11:34 |
vponomaryov | ganso: great ) | 11:34 |
ganso | vponomaryov: =D | 11:34 |
vponomaryov | ganso: Now I have loong list of things to look at ) | 11:35 |
ganso | vponomaryov: yes ^_^ | 11:36 |
*** kaisers_ has joined #openstack-manila | 11:37 | |
*** timcl has quit IRC | 11:39 | |
*** kaisers_ has quit IRC | 11:41 | |
*** tpsilva has joined #openstack-manila | 11:48 | |
*** yangyapeng has joined #openstack-manila | 11:53 | |
*** sandanar has quit IRC | 12:04 | |
*** timcl has joined #openstack-manila | 12:05 | |
tbarron | now the manila channel looks right again | 12:08 |
tbarron | vponomaryov: welcome back! | 12:08 |
vponomaryov | tbarron: hello Tom )) | 12:08 |
openstackgerrit | Rodrigo Barbieri proposed openstack/manila: Share migration Newton improvements https://review.openstack.org/328431 | 12:11 |
openstackgerrit | Rodrigo Barbieri proposed openstack/manila: Fix Share Migration improper behavior for drivers https://review.openstack.org/332267 | 12:11 |
openstackgerrit | Alexey Ovchinnikov proposed openstack/manila: [DNM] Tests for scenario tests https://review.openstack.org/340236 | 12:15 |
*** gouthamr has joined #openstack-manila | 12:17 | |
openstackgerrit | Rodrigo Barbieri proposed openstack/manila: Share migration Newton improvements https://review.openstack.org/328431 | 12:38 |
openstackgerrit | Rodrigo Barbieri proposed openstack/manila: Add share type change to Share Migration https://review.openstack.org/345142 | 12:38 |
*** akapil_ has quit IRC | 12:41 | |
*** rooneym has joined #openstack-manila | 12:41 | |
*** gouthamr_ has joined #openstack-manila | 12:49 | |
*** gouthamr has quit IRC | 12:51 | |
*** akerr has joined #openstack-manila | 12:53 | |
openstackgerrit | Merged openstack/manila-ui: Fix tables layout https://review.openstack.org/360588 | 12:55 |
*** yangyapeng has quit IRC | 12:57 | |
*** rraja has quit IRC | 13:00 | |
*** xyang1 has joined #openstack-manila | 13:02 | |
*** david-lyle has quit IRC | 13:10 | |
openstackgerrit | Alexey Ovchinnikov proposed openstack/manila: [DNM] Tests for scenario tests https://review.openstack.org/340236 | 13:16 |
*** david-lyle has joined #openstack-manila | 13:18 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila-ui: Add share replication support https://review.openstack.org/226389 | 13:21 |
*** dustins has joined #openstack-manila | 13:26 | |
*** rraja has joined #openstack-manila | 13:43 | |
openstackgerrit | Alexey Khodos proposed openstack/manila: Nexenta: adding share drivers for NexentaStor https://review.openstack.org/309286 | 13:43 |
openstackgerrit | Alexey Khodos proposed openstack/manila: Nexenta: adding share drivers for NexentaStor https://review.openstack.org/309286 | 13:45 |
*** baojg has joined #openstack-manila | 13:46 | |
ganso | bswartz, xyang1, markstur, vponomaryov, tbarron, gouthamr_ : Hello, https://review.openstack.org/#/c/328431/ is waiting for review, passed all jenkins jobs. Please take a look when you have some time | 13:51 |
gouthamr_ | ganso: sure.. would like to see the ZFSOnLinux migration patch pass on that.. it currently needs some more work.. | 13:52 |
*** gouthamr_ is now known as gouthamr | 13:53 | |
gouthamr | ganso: also, were you going to add 'task_state' to get_progress? | 13:54 |
ganso | gouthamr: nope. I preferred to stay with the error message which informs the user of what the share migration state is | 13:55 |
bswartz | ganso: isn't this more important? https://review.openstack.org/#/c/345125/ | 13:57 |
ganso | bswartz: that one requires https://review.openstack.org/#/c/328437/ and https://review.openstack.org/#/c/345142/ to merge first, which require the one I linked you | 13:58 |
bswartz | I see | 13:58 |
*** faiz89 has joined #openstack-manila | 14:01 | |
*** eharney has joined #openstack-manila | 14:02 | |
openstackgerrit | Merged openstack/manila: Fix Share Migration improper behavior for drivers https://review.openstack.org/332267 | 14:03 |
bswartz | ganso how can I sqaush 328431 together with 353417? | 14:03 |
bswartz | I'm trying to test all this stuff together | 14:04 |
*** cknight has joined #openstack-manila | 14:04 | |
ganso | bswartz: cherry pick 353417 on top of 328431 and update migration_check_compatiblity accordingly | 14:05 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila-ui: Add share replication support https://review.openstack.org/226389 | 14:05 |
ganso | bswartz: and if you are running tempest, add run_optimized_migration_tests = True to your tempest.conf | 14:06 |
bswartz | ganso: okay I'll try that | 14:06 |
bswartz | gah, still merge conflict | 14:08 |
bswartz | vponomaryov: I want to rebase 353417 on 328431 | 14:08 |
bswartz | vponomaryov: any issues with that? | 14:09 |
openstackgerrit | Alexey Khodos proposed openstack/manila: Nexenta: adding share drivers for NexentaStor https://review.openstack.org/309286 | 14:09 |
vponomaryov | I applied it on top of current master with "driver fixes" commit that has just been merged | 14:09 |
vponomaryov | I should do it on top of that other commit? | 14:09 |
*** rraja has quit IRC | 14:09 | |
vponomaryov | bswartz/ ganso? | 14:10 |
ganso | I'll try that rebase here, just a sec | 14:10 |
bswartz | vponomaryov: I think it needs rebased on top of "Share migration Newton improvements" | 14:10 |
vponomaryov | ganso: can you answer question? | 14:10 |
ganso | vponomaryov: ideally, it is best, because you will make your ZFS driver implementation compatible with preserve-metadata and non-disruptive parameters | 14:11 |
ganso | vponomaryov: else it will just assume your driver cannot do any of those | 14:11 |
ganso | bswartz: conflict is in post_test_hook | 14:12 |
ganso | bswartz: a single line | 14:12 |
openstackgerrit | Alexey Ovchinnikov proposed openstack/manila: [DNM] Tests for scenario tests https://review.openstack.org/340236 | 14:12 |
bswartz | ganso: I know, but who is going to push the rebase? I'm offering to do it but I don't want to clobber anybody | 14:13 |
vponomaryov | I am going | 14:13 |
ganso | bswartz: I'm on it | 14:13 |
bswartz | ganso: ty | 14:13 |
openstackgerrit | Rodrigo Barbieri proposed openstack/manila: [ZFSonLinux] Add share migration support https://review.openstack.org/353417 | 14:13 |
vponomaryov | ganso; just apply rebase on top of master for 431 | 14:14 |
vponomaryov | best coop ever )) | 14:14 |
ganso | vponomaryov: I am confused, didn't bswartz just say he wanted to rebase on top of 417? | 14:14 |
bswartz | ganso: you rebased on 345142 | 14:16 |
bswartz | was that correct? | 14:16 |
*** baojg has quit IRC | 14:16 | |
ganso | bswartz: it is similarto 417 | 14:16 |
ganso | bswartz: does not affect any driver interface | 14:16 |
bswartz | okay | 14:16 |
* bswartz head spins with too many changes | 14:17 | |
bswartz | I think this will work I'm running tests now | 14:17 |
*** baojg has joined #openstack-manila | 14:18 | |
*** rraja has joined #openstack-manila | 14:22 | |
*** Yogi1 has joined #openstack-manila | 14:22 | |
*** yangyapeng has joined #openstack-manila | 14:25 | |
openstackgerrit | Rodrigo Barbieri proposed openstack/manila: [Dummy driver] Add share migration support https://review.openstack.org/347853 | 14:26 |
*** baojg has quit IRC | 14:28 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [Dummy driver] Add share migration support https://review.openstack.org/347853 | 14:33 |
*** ociuhandu has joined #openstack-manila | 14:33 | |
bswartz | ganso: ERROR: The resource could not be found. | 14:33 |
bswartz | :-( | 14:34 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [Dummy driver] Add share migration support https://review.openstack.org/347853 | 14:34 |
*** nkrinner has quit IRC | 14:36 | |
*** kaisers_ has joined #openstack-manila | 14:37 | |
bswartz | ganso: I'm getting a HTTP 404 from migration-start | 14:37 |
*** nkrinner has joined #openstack-manila | 14:39 | |
*** aovchinnikov has quit IRC | 14:40 | |
*** david-lyle has quit IRC | 14:43 | |
*** nkrinner has quit IRC | 14:46 | |
*** david-lyle has joined #openstack-manila | 14:48 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [ZFSonLinux] Add share migration support https://review.openstack.org/353417 | 14:58 |
bswartz | vponomaryov: have you had any luck testing latest migration patch w/ ZFS? | 14:59 |
bswartz | I think I must be doing something wrong | 14:59 |
*** nkrinner has joined #openstack-manila | 14:59 | |
vponomaryov | bswartz: it hangs in "migrating" state for me | 14:59 |
bswartz | why would the migration-start API give me a 404? | 15:00 |
vponomaryov | bswartz: latest PS has just fixes for rebase ganso made | 15:00 |
vponomaryov | bswartz: when server does not support such API | 15:00 |
vponomaryov | bswartz: have you restarted manila-api? | 15:00 |
vponomaryov | bswartz: have you set up proper microversion? | 15:01 |
bswartz | my workflow is to download the patch before running stack.sh | 15:01 |
bswartz | so no restart should be required | 15:01 |
*** david-lyle has quit IRC | 15:02 | |
*** yangyapeng has quit IRC | 15:04 | |
vponomaryov | bswartz: manilaclient is updated as well? | 15:05 |
vponomaryov | bswartz: so, just tested, it worked | 15:06 |
bswartz | with your latest change? | 15:08 |
bswartz | that's great | 15:08 |
bswartz | I will test shortly | 15:08 |
vponomaryov | yes | 15:08 |
bswartz | go ahead and put your reviews on ganso's patches | 15:08 |
vponomaryov | 1,5k changes )) | 15:09 |
vponomaryov | + 500 second | 15:09 |
vponomaryov | will not be fast | 15:09 |
*** akerr has quit IRC | 15:10 | |
*** akerr has joined #openstack-manila | 15:11 | |
*** nkrinner is now known as nkrinner_afk | 15:11 | |
bswartz | well if you see any problems point them out as soon as you see them | 15:11 |
ganso | bswartz: that was probably your manilaclient | 15:11 |
ganso | (I just got back) | 15:12 |
bswartz | ganso: what client should I use? | 15:12 |
vponomaryov | https://review.openstack.org/#/c/328437/ | 15:13 |
ganso | bswartz: https://review.openstack.org/345125 | 15:13 |
vponomaryov | any ^ | 15:13 |
bswartz | ganso: what's what I have | 15:15 |
bswartz | I wonder if it's not getting used for some reason | 15:15 |
*** kaisers_ has quit IRC | 15:19 | |
*** david-lyle has joined #openstack-manila | 15:22 | |
bswartz | okay my patch download is what was failing | 15:22 |
bswartz | I have no idea why... | 15:23 |
*** sandanar has joined #openstack-manila | 15:23 | |
bswartz | ganso: I started the migration but when I get progress is say no migration in progress | 15:25 |
ganso | bswartz: what is the share's status and task_state? | 15:27 |
bswartz | status available / task_state migration_error | 15:28 |
ganso | bswartz: it needs to be in migrating status and migration_driver_in_progress task_state to be able to obtain progress | 15:28 |
bswartz | k this might be a subpar user experience | 15:29 |
bswartz | if I start a migration and that succeeds, I'm going to follow up with a get progresse | 15:29 |
ganso | bswartz: the error message is correct, it seems to me you are not doing any migration to obtain progress | 15:29 |
*** kaisers_ has joined #openstack-manila | 15:29 | |
bswartz | even if an error occurs, it makes sense for the get progress to tell me that | 15:29 |
bswartz | otherwise it's unclear what API to call to query the progress | 15:30 |
*** senk has joined #openstack-manila | 15:30 | |
ganso | bswartz: if an error occurs, the error message will be in the logs and task_state will be migration_error, there is no place to store that error message right now. Maybe when we have the jobs table we can store it there and include it in migration_get_progress | 15:31 |
ganso | bswartz: shouldn't this put on hold until Ocata? https://review.openstack.org/#/c/226389/ | 15:40 |
*** david-lyle has quit IRC | 15:40 | |
vponomaryov | ganso: why it should be on hold? | 15:42 |
ganso | vponomaryov: manila-ui FF was last week | 15:42 |
*** faiz89 has quit IRC | 15:42 | |
ganso | vponomaryov: if it merges now, it will be included for RC1 version of manila-ui | 15:42 |
vponomaryov | ganso: it should have been merged long time ago | 15:42 |
ganso | vponomaryov: indeed, it should have | 15:43 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [Dummy driver] Add share migration support https://review.openstack.org/347853 | 15:45 |
*** lpetrut has quit IRC | 15:48 | |
*** david-lyle has joined #openstack-manila | 15:50 | |
*** timcl1 has joined #openstack-manila | 15:51 | |
*** timcl has quit IRC | 15:54 | |
vponomaryov | bswartz, ganso: zfsonlinux passed migration tests -> http://logs.openstack.org/17/353417/13/check/gate-manila-tempest-dsvm-postgres-zfsonlinux/8177733/console.html#_2016-08-30_15_51_15_008710 | 16:15 |
*** ociuhandu has quit IRC | 16:15 | |
*** lpetrut has joined #openstack-manila | 16:20 | |
*** david-lyle has quit IRC | 16:21 | |
*** david-lyle has joined #openstack-manila | 16:23 | |
*** kaisers_ has quit IRC | 16:28 | |
ganso | vponomaryov: \o/ | 16:28 |
ganso | gouthamr: ping | 16:31 |
*** david-lyle_ has joined #openstack-manila | 16:36 | |
*** timcl1 has quit IRC | 16:39 | |
*** david-lyle has quit IRC | 16:39 | |
bswartz | aha | 16:45 |
bswartz | I think I found out why my test doesn't work >_< | 16:45 |
bswartz | ganso, vponomaryov: this is what I'm currently getting http://paste.openstack.org/show/564860/ | 16:48 |
vponomaryov | bswartz: use --writable False | 16:49 |
bswartz | doh! | 16:49 |
vponomaryov | optional argument for command with migration | 16:49 |
vponomaryov | it is True by default | 16:49 |
bswartz | good catch vponomaryov | 16:49 |
vponomaryov | also, you may want to disable fallback migration | 16:49 |
vponomaryov | with --skip_optimized_migration True | 16:50 |
bswartz | vponomaryov: why didn't you support writable migration with your original implementation? | 16:50 |
vponomaryov | bswartz: "writable" means we can write to share and be sure all changes are applied | 16:50 |
vponomaryov | bswartz: it is false for case of zfsonlinux driver | 16:50 |
vponomaryov | bswartz; write while migrating | 16:51 |
bswartz | okay | 16:51 |
bswartz | but we *could* support it | 16:51 |
vponomaryov | bswartz: no | 16:51 |
bswartz | just need to take an extra snapshot and transfer it during the cutover | 16:51 |
ganso | vponomaryov: you cannot disable fallback migration. Skip_optimized_migration = True will skip your driver's implementation and run fallback | 16:51 |
vponomaryov | bswartz: it will be endless loop | 16:51 |
vponomaryov | ganso: right, with False | 16:52 |
bswartz | vponomaryov: no, the design of the feature is that when the migration is completed, it's disruptive | 16:52 |
vponomaryov | ganso: but as you can see, it is confusing right now )) | 16:52 |
vponomaryov | fallback, optimized... | 16:52 |
bswartz | so after the disruption you can send one last snapshot and be sure you got all the data | 16:52 |
vponomaryov | need to use driver-based and generic migrations | 16:52 |
ganso | vponomaryov: you can use a parameter that prevents fallback from running, such as preserve-metadata or nondisruptable | 16:52 |
bswartz | actually I agree with half of that -- I don't like "optimized" | 16:52 |
bswartz | I would prefer "driver assisted" and "fallback" migration types | 16:53 |
vponomaryov | bswartz: I do not see real value in making such feature, we either make sure that "everything" was ported or do not support it | 16:53 |
vponomaryov | in the former case it is endless loop | 16:53 |
bswartz | "optimized" implies it's somehow better than the fallback migration | 16:53 |
vponomaryov | in case we write constantly | 16:53 |
ganso | bswartz: gouthamr doesn't like fallback... I kinda like it but I understand his point... need something better else I think it is fine to stick with it | 16:53 |
ganso | bswartz: it usually is better | 16:54 |
bswartz | vponomaryov: I can be done -- but I agree it's additional code we don't need to write today | 16:54 |
ganso | bswartz: at least, it is supposed to be | 16:54 |
vponomaryov | bswartz: even if we had time | 16:54 |
vponomaryov | bswartz: we should assume constant writing | 16:54 |
bswartz | ganso: it's different -- usually better, but not required -- therefore "optimized" is misleading | 16:54 |
vponomaryov | bswartz: it is endless, cannot support | 16:54 |
bswartz | vponomaryov: what you're forgetting is that the share is unexported when you call migration complete, so you can't continue writing after that | 16:55 |
bswartz | in the time between the migration-complete API call and the migration actually finishing, there is no access to the share | 16:56 |
bswartz | we can use that window of disruption to ensure no data loss | 16:56 |
*** erlon has quit IRC | 16:57 | |
gouthamr | "fallback" sounds like dev language to me.. | 17:02 |
bswartz | http://paste.openstack.org/show/564864/ | 17:03 |
gouthamr | like imho, we should be saying 'driver-assisted' vs 'host-assisted' data copy :P | 17:03 |
openstackgerrit | Lucian Petrut proposed openstack/manila: Windows SMB: implement 'update_access' method https://review.openstack.org/354855 | 17:03 |
*** faiz89 has joined #openstack-manila | 17:05 | |
openstackgerrit | Alexey Ovchinnikov proposed openstack/manila: [DNM] Tests for scenario tests https://review.openstack.org/340236 | 17:08 |
*** Suyi_ has joined #openstack-manila | 17:14 | |
ganso | gouthamr: not bad | 17:17 |
ganso | gouthamr: can we talk about migration_get_progress change? | 17:18 |
*** sandanar_ has joined #openstack-manila | 17:21 | |
gouthamr | ganso: yep... | 17:21 |
ganso | gouthamr: ok so, I got your point that the current approach is not good for scripts that keep checking progress | 17:22 |
ganso | gouthamr: Also, could you please clarify your comment in https://review.openstack.org/#/c/328431/50/manila_tempest_tests/tests/api/admin/test_migration_negative.py@174 ? | 17:23 |
*** sandanar has quit IRC | 17:24 | |
*** pcaruana has quit IRC | 17:25 | |
gouthamr | ganso: yes.. we have negative tests where requesting an API with a version less than the version in which it was changed is validated.. | 17:25 |
ganso | gouthamr: but if we are dropping support, why do we need to have a test for that? | 17:26 |
gouthamr | ganso: dropping support to? | 17:26 |
ganso | gouthamr: everything migration-related | 17:26 |
ganso | gouthamr: only 2.22 and above will work | 17:26 |
gouthamr | ganso: i'm talking about preserve_metadata, writable, nondisruptive | 17:26 |
gouthamr | ganso: those are available only 2.22 and beyond? | 17:26 |
ganso | gouthamr: yes | 17:27 |
gouthamr | ganso: also, allowing 'unsetting' task state should only be allowed 2.22 and beyond? | 17:27 |
* bswartz fails again | 17:27 | |
bswartz | MANILA_ZFSONLINUX_USE_SSH=True | 17:27 |
ganso | gouthamr: yes, I am considering that as well | 17:27 |
gouthamr | ganso: so those can be added as negative tests.. | 17:27 |
ganso | gouthamr: the API will just reject | 17:28 |
ganso | gouthamr: because it is below the minimum supported | 17:28 |
gouthamr | ganso: would be a simple ddt test, and you expect HTTP400 | 17:28 |
gouthamr | ganso: no, you're microversioning the body params.. and not the API.. | 17:28 |
ganso | gouthamr: but I am changing the API as well to accept only 2.22 and beyond | 17:28 |
gouthamr | ganso: oh. wait, migration won't work at all under 2.22? | 17:29 |
ganso | gouthamr: no, the API will reject | 17:29 |
ganso | gouthamr: say the action is not found | 17:29 |
gouthamr | ganso: o.O i'm stupid if i overlooked that in my review and tests.. | 17:29 |
ganso | gouthamr: I thought you suggested that when you said to remove all backwards compatibility | 17:30 |
gouthamr | ganso: that's a huge change.. | 17:30 |
ganso | gouthamr: so it is as if migration never existed before | 17:30 |
gouthamr | ganso: i was suggesting you break microversion support entirely because we seem to have a loose definition of that for experimental APIs anyway.. i meant, if a user uses 2.15, give him all the features of 2.22.. because 2.15 wouldn't know that you dropped support for notify.. | 17:31 |
ganso | gouthamr: I was doing exactly that before | 17:32 |
ganso | gouthamr: main problem was testing manilaclient | 17:32 |
ganso | gouthamr: I don't remember what it was exactly, but only the latest could be used | 17:33 |
ganso | gouthamr: shell could not be microversioned with different parameters | 17:34 |
gouthamr | ganso: yes, i guess we only test latest in the client.. | 17:34 |
ganso | gouthamr: so, the user had to have a real older version of python-manilaclient | 17:34 |
gouthamr | ganso: we've done that before.. os-some_action to some_action | 17:34 |
ganso | gouthamr: and I had already accomplished that, just removing the commit | 17:34 |
ganso | gouthamr: yes, but the CLI command must not be the same | 17:35 |
ganso | gouthamr: or in fact, must not have different parameters | 17:35 |
gouthamr | ganso: oh.. yes.. these changes can only be done inside the client | 17:35 |
gouthamr | ganso: not shell.. | 17:35 |
gouthamr | ganso: so the command is the same, but since everything goes through the client, you can fence off invalid req parameters there..? | 17:36 |
ganso | gouthamr: if the user has the latest client, it cannot invoke a previous microversion method with an older-named parameter | 17:37 |
*** rraja has quit IRC | 17:37 | |
ganso | gouthamr: the client would have to know that, like for example, skip_optimized_migration is force_host_copy in previous versions | 17:37 |
ganso | gouthamr: so he would use skip_optimized_migration in shell, and then the client would send force_host_copy | 17:38 |
gouthamr | ganso: oh.. so that's why this API only makes sense in 2.22 and beyond? | 17:40 |
ganso | gouthamr: right now, yes | 17:41 |
bswartz | ganso: new error "ERROR: Invalid share: Migration progress of share d7bded87-3d00-4bec-aaa3-52dffca6797c cannot be obtained at this moment." | 17:42 |
ganso | bswartz: what is your status and task_state at the moment? | 17:43 |
bswartz | statusmigrating, task_statemigration_driver_phase1_done | 17:43 |
gouthamr | ganso: that's what i mean ^ | 17:43 |
bswartz | wtf spacing | 17:43 |
bswartz | status migrating, task_state migration_driver_phase1_done | 17:44 |
bswartz | ganso it was a transient thing | 17:44 |
gouthamr | ganso: i am okay with 2.22 being the minimum microversion... can we call that out in the commit message and the reno? | 17:44 |
bswartz | eventually it returned "ERROR: Invalid share: Migration of share d7bded87-3d00-4bec-aaa3-52dffca6797c has already completed first phase." | 17:44 |
ganso | bswartz: you should have received ""Migration of share %s has already completed first phase." message instead of that one | 17:44 |
bswartz | so it's weird that there's a race condition where you can get the first error | 17:45 |
ganso | bswartz: what I am doing right now is that I am changing all those "error" messages to a standard dictionary response that includes the task_state | 17:45 |
bswartz | the share should instantly go into a state where progress is reported as zero when the start completes | 17:45 |
bswartz | and when it's done it should just say done instead of "error" | 17:46 |
*** lpetrut has quit IRC | 17:46 | |
ganso | bswartz: so instead of the message you got, you will get {'total_progress': 100, 'task_state': 'migration_driver_phase1_done'} | 17:46 |
ganso | bswartz: as zero? | 17:46 |
ganso | bswartz: I am hardcoding it as 100 right now | 17:46 |
ganso | bswartz: oh, when migration-start completes... sorry I misread 'when migration completes' | 17:47 |
gouthamr | vponomaryov: still around by any chance? | 17:48 |
bswartz | ganso: yeah there seems to be a race after you start the migration when you get progress | 17:49 |
bswartz | if you get progress too fast you get the error I got | 17:49 |
ganso | bswartz: it is not really an error, that's why I am changing that now | 17:49 |
ganso | bswartz: it is just informative | 17:49 |
*** gouthamr has quit IRC | 17:54 | |
*** gouthamr has joined #openstack-manila | 17:54 | |
*** senk has quit IRC | 18:02 | |
*** sandanar_ has quit IRC | 18:03 | |
*** akerr is now known as akerr_away | 18:04 | |
*** akerr_away is now known as akerr | 18:04 | |
ganso | gouthamr: ping | 18:20 |
gouthamr | ganso: pong | 18:20 |
ganso | bswartz, gouthamr: are you ok with changing "skip_optimized_migration" to "skip_driver_assisted_migration" ? | 18:20 |
ganso | bswartz, gouthamr: or "force_host_assisted_migration" | 18:21 |
bswartz | ganso: yes | 18:23 |
ganso | bswartz: which one? | 18:23 |
gouthamr | ganso: i like "force_host_assisted_migration" | 18:23 |
bswartz | ganso: however I was wondering if we could convert the CLL flags that are --xxx True/False to jut --xxx with no boolean, so the presence of the flag determines the behavior | 18:25 |
ganso | bswartz: depends on the default value | 18:25 |
ganso | bswartz: writable is true by default | 18:26 |
ganso | bswartz: so it needs --writable False | 18:26 |
ganso | bswartz: the only ones that can do that is --nondisruptive and --skip_optimized_migration | 18:26 |
openstackgerrit | Jay Mehta proposed openstack/manila: HPE 3PAR driver pool support https://review.openstack.org/329552 | 18:26 |
ganso | bswartz: but I don't like the idea of half parameters behaving one way and the other half behaving differently | 18:26 |
bswartz | ganso: I'm in favor of changing them all | 18:31 |
bswartz | I agree consistency is important | 18:31 |
bswartz | do you have examples of ones we can't change because they've non-experimental? | 18:31 |
ganso | bswartz: yes but what I said is that some cannot be just --writable, such as 'writable' | 18:32 |
ganso | bswartz: it is not related to being experimental | 18:32 |
ganso | bswartz: it is because of their default value | 18:32 |
ganso | bswartz: --writable defaults to True | 18:32 |
ganso | bswartz: so you need the parameter to disable it | 18:32 |
ganso | bswartz: or, change it to --nonwritable | 18:32 |
bswartz | ganso: the flag would be --readonly, and it would default to falkse | 18:33 |
bswartz | false | 18:33 |
ganso | bswartz: that too | 18:33 |
ganso | bswartz: how about preserve-metadata ? | 18:33 |
gouthamr | (--preserve-metadata (true) / --preserve-metadata=True) vs (--preserve-metadata=False) | 18:35 |
gouthamr | (--writable / --writable=True vs --writable=False) | 18:35 |
ganso | gouthamr: ? | 18:35 |
gouthamr | (--skip-optimized-migration / --skip-optimized-migration=True) vs (--skip-optimized-migration=False) | 18:36 |
gouthamr | sorry, was just enumerating the options.. | 18:36 |
gouthamr | i didn't understand the confusion | 18:36 |
ganso | oh | 18:37 |
ganso | so, we need to invert preserve-metadata | 18:37 |
ganso | --writable would change to --readonly as bswartz suggested | 18:37 |
*** faiz89 has quit IRC | 18:38 | |
bswartz | ganso: --no-preserve-metadata? --degrade-metadata? --modify-metadata? | 18:40 |
ganso | bswartz: those look terrible | 18:40 |
ganso | bswartz: lol | 18:40 |
ganso | bswartz: we've had --lossy discussed in the midcycle | 18:40 |
ganso | bswartz: but --lossy is bad | 18:40 |
bswartz | better than --corrupt-metadata or --destroy-metadata | 18:40 |
gouthamr | --readonly? It's strange that the adminstrator will tell you that he/she wants the share to be readonly.. | 18:40 |
gouthamr | like that's saying i want this migration only if you can do it by removing all current write access on the share | 18:41 |
*** mtanino has joined #openstack-manila | 18:41 | |
ganso | --disregard-metadata ? | 18:41 |
ganso | gouthamr: yes it is a bit weird | 18:41 |
ganso | gouthamr: writable is True by default and admin says "ok if you cannot do it writable, then do it non-writable" | 18:42 |
bswartz | ganso: https://review.openstack.org/#/c/226389 | 18:42 |
bswartz | ganso: well what we want to communicate is that the metadata will be modified in the same way that tar/untar would modify it | 18:42 |
bswartz | so it's not really "lost" or "disregarded" it's just degraded to minimum posix owners/acls | 18:43 |
*** lpetrut has joined #openstack-manila | 18:45 | |
bswartz | ganso: --posix-metadata-only ? | 18:46 |
ganso | bswartz: :\ | 18:47 |
bswartz | I don't see how --no-preserve-metadata is any different than --preserve-metadata False | 18:47 |
*** dsariel has quit IRC | 18:47 | |
ganso | bswartz: then we can stick with '--preserve-metadata False' :P | 18:49 |
bswartz | yeah but --xxx True/False is just bad UI design | 18:49 |
bswartz | I can think of almost no software that does CLI flags that wya | 18:49 |
bswartz | way | 18:49 |
*** Suyi_1 has joined #openstack-manila | 18:50 | |
ganso | OpenStack has some CLIs that are like that | 18:50 |
bswartz | boolean flags are always simply flags with no following parameter | 18:50 |
*** Suyi_ has quit IRC | 18:52 | |
bswartz | ganso: it's not a huge deal for me | 18:52 |
bswartz | again it's something we could change later if needed | 18:52 |
bswartz | just wanted to express my opinion | 18:53 |
bswartz | ganso: btw ZFS migrations are working reliably for me now that I fixed my env | 18:53 |
*** Yogi1 has quit IRC | 18:56 | |
*** erlon has joined #openstack-manila | 18:59 | |
*** david-lyle_ is now known as david-lyle | 19:05 | |
*** lpetrut has quit IRC | 19:10 | |
*** faiz89 has joined #openstack-manila | 19:21 | |
*** akshai has joined #openstack-manila | 19:53 | |
*** harlowja has quit IRC | 19:58 | |
*** akerr has quit IRC | 20:16 | |
*** dsariel has joined #openstack-manila | 20:18 | |
*** FL1SK has quit IRC | 20:30 | |
tbarron | ganso: bswartz Downstream I need to backport https://review.openstack.org/#/c/363118/ - would be great to get it into stable/mitaka upstream if it's acceptable. | 20:38 |
*** faiz89 has quit IRC | 20:52 | |
*** cknight has quit IRC | 20:53 | |
*** lpetrut has joined #openstack-manila | 20:54 | |
*** dustins has quit IRC | 21:04 | |
*** faiz89 has joined #openstack-manila | 21:10 | |
*** faiz89 is now known as faiz89_away | 21:10 | |
*** faiz89_away is now known as faiz89 | 21:10 | |
*** harlowja has joined #openstack-manila | 21:17 | |
*** gouthamr has quit IRC | 21:19 | |
*** faiz89 has quit IRC | 21:20 | |
*** rhefner has joined #openstack-manila | 21:23 | |
*** dustins has joined #openstack-manila | 21:26 | |
*** ganso has quit IRC | 21:35 | |
*** dsariel has quit IRC | 21:36 | |
*** ganso has joined #openstack-manila | 21:39 | |
*** eharney has quit IRC | 21:48 | |
*** dustins has quit IRC | 21:50 | |
*** cknight has joined #openstack-manila | 21:58 | |
*** cknight1 has joined #openstack-manila | 22:00 | |
*** cknight has quit IRC | 22:02 | |
*** alyson_ has quit IRC | 22:03 | |
*** lpetrut has quit IRC | 22:12 | |
*** cknight1 has quit IRC | 22:24 | |
*** FL1SK has joined #openstack-manila | 22:39 | |
openstackgerrit | Jay Mehta proposed openstack/manila: HPE 3PAR driver pool support https://review.openstack.org/329552 | 23:37 |
*** tpsilva has quit IRC | 23:44 | |
*** rooneym has quit IRC | 23:49 | |
openstackgerrit | Rodrigo Barbieri proposed openstack/manila: Share migration Newton improvements https://review.openstack.org/328431 | 23:56 |
*** akerr has joined #openstack-manila | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!