*** haomaiwa_ has quit IRC | 00:01 | |
*** haomaiwang has joined #openstack-manila | 00:02 | |
*** DericHorn-HP has quit IRC | 00:19 | |
*** chlong has joined #openstack-manila | 00:26 | |
*** haigang has joined #openstack-manila | 00:35 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/manila: Updated from global requirements https://review.openstack.org/206822 | 00:45 |
---|---|---|
*** mtanino has quit IRC | 00:51 | |
*** kjelly has joined #openstack-manila | 00:52 | |
*** erlon has quit IRC | 00:53 | |
*** haomaiwang has quit IRC | 01:01 | |
*** haomaiwang has joined #openstack-manila | 01:02 | |
*** zhonghua-lee has joined #openstack-manila | 01:06 | |
*** haigang has quit IRC | 01:26 | |
*** haigang has joined #openstack-manila | 01:27 | |
*** rcallawa has joined #openstack-manila | 01:41 | |
*** rcallawa has quit IRC | 01:42 | |
*** rcallawa has joined #openstack-manila | 01:43 | |
*** rcallawa_ has joined #openstack-manila | 01:51 | |
*** rcallawa has quit IRC | 01:53 | |
*** kjelly has quit IRC | 01:55 | |
*** haomaiwang has quit IRC | 02:01 | |
*** haomaiwang has joined #openstack-manila | 02:02 | |
*** kjelly has joined #openstack-manila | 02:24 | |
*** cknight has joined #openstack-manila | 02:32 | |
*** cknight has quit IRC | 02:45 | |
*** cknight has joined #openstack-manila | 02:45 | |
*** haomaiwang has quit IRC | 03:01 | |
*** haomaiwang has joined #openstack-manila | 03:02 | |
*** lpetrut has joined #openstack-manila | 03:07 | |
*** DericHorn-HP has joined #openstack-manila | 03:13 | |
*** BharatK has quit IRC | 03:15 | |
*** DericHorn-HP has quit IRC | 03:27 | |
*** rcallawa_ has quit IRC | 03:32 | |
*** rcallawa has joined #openstack-manila | 03:33 | |
*** DericHorn-HP has joined #openstack-manila | 03:57 | |
*** haomaiwang has quit IRC | 04:01 | |
*** cknight has quit IRC | 04:01 | |
*** haomaiwang has joined #openstack-manila | 04:02 | |
*** vbellur has quit IRC | 04:11 | |
*** deepakcs has joined #openstack-manila | 04:13 | |
*** haigang has quit IRC | 04:22 | |
*** breitz has quit IRC | 04:25 | |
*** haigang has joined #openstack-manila | 04:25 | |
*** DericHorn-HP has quit IRC | 04:26 | |
*** zhonghua-lee has quit IRC | 04:28 | |
*** deepakcs has quit IRC | 04:33 | |
*** zhonghua-lee has joined #openstack-manila | 04:52 | |
*** lpetrut has quit IRC | 04:58 | |
*** haomaiwang has quit IRC | 05:01 | |
*** 32NAAAL0S has joined #openstack-manila | 05:02 | |
*** haigang has quit IRC | 05:04 | |
*** zaitcev has quit IRC | 05:07 | |
*** vbellur has joined #openstack-manila | 05:12 | |
*** rraja has joined #openstack-manila | 05:15 | |
*** haigang has joined #openstack-manila | 05:50 | |
*** deepakcs has joined #openstack-manila | 05:57 | |
*** BharatK has joined #openstack-manila | 06:12 | |
*** deepakcs has quit IRC | 06:13 | |
*** deepakcs has joined #openstack-manila | 06:26 | |
*** anubhav has joined #openstack-manila | 06:38 | |
openstackgerrit | Peter Wang proposed openstack/manila: Add retry logic when delete a nfs share in VNX https://review.openstack.org/208846 | 06:41 |
*** zhonghua-li has joined #openstack-manila | 06:53 | |
*** zhonghua-lee has quit IRC | 06:56 | |
*** rraja has quit IRC | 07:00 | |
*** rraja has joined #openstack-manila | 07:00 | |
*** h00327910__ has joined #openstack-manila | 07:01 | |
*** zhonghua-li has quit IRC | 07:08 | |
*** zhonghua-li has joined #openstack-manila | 07:14 | |
*** anubhav has quit IRC | 07:29 | |
*** zhongjun has joined #openstack-manila | 07:37 | |
openstackgerrit | zhongjun proposed openstack/manila: Support manage_existing in Huawei driver https://review.openstack.org/196680 | 07:39 |
*** chlong has quit IRC | 07:47 | |
*** sbjorn has joined #openstack-manila | 07:52 | |
*** sgotliv has joined #openstack-manila | 08:14 | |
*** anubhav has joined #openstack-manila | 08:15 | |
*** zhongjun has quit IRC | 08:21 | |
*** zhonghua-li is now known as zhonghua-lee | 08:37 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [DEBUG] debug3 tempest scenario job https://review.openstack.org/208881 | 08:48 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [DEBUG] debug3.1 tempest scenario job https://review.openstack.org/208884 | 08:48 |
mkoderer | vponomaryov: the CIFS scneario test are somehow flaky? | 09:13 |
mkoderer | vponomaryov: are you investigating it? | 09:14 |
vponomaryov | mkoderer: why CIFS? | 09:14 |
mkoderer | vponomaryov: I had a failure just for those two tests | 09:14 |
mkoderer | vponomaryov: is it a general issue? | 09:14 |
vponomaryov | mkoderer: "test_read_write_two_vms" for both protocols | 09:14 |
vponomaryov | fails | 09:14 |
mkoderer | vponomaryov: ok I see.. | 09:15 |
vponomaryov | yes, I am investigating it and has not succeeded yet. | 09:15 |
vponomaryov | it is really strange bug | 09:15 |
vponomaryov | another test is ok, but this one fails | 09:16 |
*** zhongjun has joined #openstack-manila | 09:20 | |
mkoderer | vponomaryov: ok having a look at it too | 09:21 |
vponomaryov | mkoderer: so far, it is known that problem appeared last Friday - 31th of July. And Manila + Tempest are out of suspicion. | 09:21 |
vponomaryov | mkoderer: paramiko lib, that fails to connect didn't cahnge | 09:21 |
vponomaryov | mkoderer: https://review.openstack.org/#/c/204692/ , comment with jenkins rsults at Jul 31 9:19 AM | 09:23 |
vponomaryov | mkoderer: postgres failed with same errors as in scenario job | 09:23 |
openstackgerrit | zhongjun proposed openstack/manila: Huawei driver support smartcache and smartpartition https://review.openstack.org/202000 | 09:23 |
vponomaryov | mkoderer: first seen appearence - morning of 31th July | 09:24 |
mkoderer | vponomaryov: strange.. yep I saw this failure 3rd august for the first time | 09:26 |
mkoderer | vponomaryov: is it the first ssh connection to the serivce VM? we may hit a memory issue? | 09:29 |
vponomaryov | mkoderer: this test runs after first one, that not fails | 09:29 |
vponomaryov | mkoderer: in each test suite, both test suites run in parallel | 09:29 |
mkoderer | vponomaryov: http://logs.openstack.org/92/204692/3/check/gate-manila-tempest-dsvm-neutron-scenario/7263eca/logs/screen-dstat.txt.gz | 09:36 |
mkoderer | the failure appears around 05:40.. the most active process is swift... | 09:36 |
mkoderer | I have the feeling the VM is still copying the glance image? | 09:37 |
* mkoderer needs to get lunch | 09:38 | |
vponomaryov | mkoderer: actually in logs we see that VM becomes available via SSH, then we try to initialize helpers and here we fail with SSH connection | 09:39 |
mkoderer | vponomaryov: ok thats really strange | 09:39 |
vponomaryov | mkoderer: http://logs.openstack.org/92/204692/3/check/gate-manila-tempest-dsvm-neutron-scenario/7263eca/logs/screen-m-shr.txt.gz#_2015-07-31_05_41_46_220 | 09:40 |
mkoderer | ok brb | 09:42 |
*** zhonghua-lee has quit IRC | 09:43 | |
*** zhonghua-lee has joined #openstack-manila | 09:44 | |
*** openstackgerrit_ has joined #openstack-manila | 09:53 | |
*** sac has quit IRC | 09:58 | |
*** rraja has quit IRC | 09:59 | |
*** sac has joined #openstack-manila | 09:59 | |
*** vbellur has quit IRC | 09:59 | |
*** rraja has joined #openstack-manila | 09:59 | |
*** vbellur has joined #openstack-manila | 10:02 | |
*** zhongjun has quit IRC | 10:06 | |
*** anubhav has quit IRC | 10:09 | |
*** anubhav has joined #openstack-manila | 10:09 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [DEBUG] debug4 tempest scenario job https://review.openstack.org/208954 | 10:10 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [DEBUG] debug4.1 tempest scenario job https://review.openstack.org/208955 | 10:10 |
mkoderer | vponomaryov: http://logs.openstack.org/55/201955/11/check/gate-manila-tempest-dsvm-neutron-scenario/e61ba83/logs/screen-m-shr.txt.gz?#_2015-08-03_09_30_38_804 | 10:10 |
mkoderer | vponomaryov: a successful job reports "Service VM is available via SSH" and then a "ECONNREFUSED _check_server_availability " with a "Waiting..." message | 10:11 |
mkoderer | I have the feeling this is a timing issue somehow | 10:11 |
vponomaryov | mkoderer: don't forget, there are two of them | 10:11 |
vponomaryov | mkoderer: being created at once | 10:12 |
vponomaryov | one for NFS and one for CIFS test suite | 10:12 |
mkoderer | vponomaryov: ahhh ok... I see | 10:12 |
mkoderer | vponomaryov: much more complex | 10:12 |
*** zhonghua-li has joined #openstack-manila | 10:12 | |
*** zhonghua-lee has quit IRC | 10:13 | |
*** haigang has quit IRC | 10:14 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [DEBUG] debug5.1 tempest scenario job https://review.openstack.org/208959 | 10:16 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [DEBUG] debug5 tempest scenario job https://review.openstack.org/208961 | 10:16 |
openstackgerrit | Igor Malinovskiy proposed openstack/manila: Clean up admin_actions API extension unit tests https://review.openstack.org/208962 | 10:16 |
*** zhonghua-li has quit IRC | 10:39 | |
openstackgerrit | Marc Koderer proposed openstack/manila: [DEBUG] debug10.1 tempest scenario job https://review.openstack.org/208986 | 10:43 |
mkoderer | vponomaryov: I added a short sleep after the port 22 check within check_server_availability.. let's see .. | 10:46 |
vponomaryov | mkoderer: 'check_server_availability' just does not use key | 10:48 |
*** timcl has joined #openstack-manila | 10:48 | |
mkoderer | vponomaryov: but after that the ssh connection need to get established.. | 10:48 |
vponomaryov | mkoderer: yes, we get SSH error on first attempt to use key | 10:48 |
vponomaryov | mkoderer: but connectivity is OK indeed | 10:49 |
mkoderer | vponomaryov: should we "cat" the private key? | 10:49 |
mkoderer | vponomaryov: but how can this file be changed... it's already used before | 10:49 |
vponomaryov | mkoderer: what do you mean? | 10:49 |
mkoderer | vponomaryov: https://github.com/paramiko/paramiko/blob/master/paramiko/pkey.py#L264 | 10:49 |
mkoderer | vponomaryov: so it seems the private key is invalid... but I have no clue how this can happen | 10:50 |
vponomaryov | mkoderer: it is possible when key is empty | 10:52 |
vponomaryov | line 263 becomes "if 0 >= 0:" | 10:53 |
*** sgotliv_ has joined #openstack-manila | 10:54 | |
*** sgotliv has quit IRC | 10:54 | |
*** zhongjun has joined #openstack-manila | 11:02 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [DEBUG] debug6 tempest scenario job https://review.openstack.org/208991 | 11:02 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [DEBUG] debug6.1 tempest scenario job https://review.openstack.org/208992 | 11:03 |
*** deepakcs has quit IRC | 11:03 | |
openstackgerrit | zhongjun proposed openstack/manila: Support manage_existing in Huawei driver https://review.openstack.org/196680 | 11:16 |
*** rcallawa has quit IRC | 11:22 | |
*** openstackgerrit has quit IRC | 11:31 | |
*** openstackgerrit_ is now known as openstackgerrit | 11:31 | |
*** openstackgerrit has quit IRC | 11:32 | |
*** openstackgerrit_ has joined #openstack-manila | 11:32 | |
*** zhongjun22 has joined #openstack-manila | 11:32 | |
*** openstackgerrit_ is now known as openstackgerrit | 11:32 | |
*** BharatK has quit IRC | 11:32 | |
*** openstackgerrit_ has joined #openstack-manila | 11:33 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: Use 'read_file_as_root' func in service_instance https://review.openstack.org/209005 | 11:37 |
*** BharatK has joined #openstack-manila | 11:46 | |
openstackgerrit | Peter Wang proposed openstack/manila: Add retry logic when delete a NFS share in VNX https://review.openstack.org/208846 | 11:47 |
*** haigang has joined #openstack-manila | 11:56 | |
ganso_ | u_glide: ping | 11:57 |
u_glide | ganso_: pong | 11:57 |
ganso_ | hi, your share instances patch has worked great with Share Migration so far | 11:57 |
ganso_ | u_glide: but there is one item that I thought it would be included at this moment and if it is, it will prevent temporary workarounds for Share Migration | 11:58 |
*** haigang has quit IRC | 11:59 | |
u_glide | ganso_: feel free to ask new changes :) | 11:59 |
ganso_ | u_glide: when I create a new share instance during Migration, while I am still copying files, "manila list" command retrieves the list of shares, and the one being migrated may show the new instance instead of the original one, because it selects "share.instances[0]" | 11:59 |
u_glide | ganso_: yes, that's right. you should modify this logic in migration patch | 12:01 |
ganso_ | u_glide: a temporary workaround I would do would be to filter instances with certain statuses or certain field value, but the definitive implementation would be to set one instance as active | 12:01 |
ganso_ | u_glide: my change would be in "share.instances[0]" | 12:01 |
u_glide | ganso_: no need to implement 'active instance', because with replication all instances will be 'active' | 12:02 |
u_glide | ganso_: just do filtering by status, it's enough for the moment | 12:03 |
*** lpetrut has joined #openstack-manila | 12:03 | |
ganso_ | u_glide: ok, I just wanted to confirm if "active instance" was something still planned, thanks! :) | 12:06 |
vponomaryov | mkoderer: see https://github.com/paramiko/paramiko/blob/424ba615/paramiko/client.py#L442 we get invalid "EC" private key, because it is the last exception. Actually our key should be RSA and we do not see real error | 12:14 |
mkoderer | vponomaryov: this is really ugly code | 12:15 |
vponomaryov | mkoderer: so, paramiko hides lots of usefull info | 12:15 |
vponomaryov | mkoderer: I see only one possible way - reproduce it on lab | 12:16 |
*** zhongjun22 has quit IRC | 12:16 | |
vponomaryov | mkoderer: somehow =) | 12:16 |
*** zhongjun has quit IRC | 12:16 | |
vponomaryov | mkoderer: and hack paramiko | 12:16 |
*** openstackgerrit has quit IRC | 12:16 | |
*** openstackgerrit has joined #openstack-manila | 12:17 | |
*** rcallawa has joined #openstack-manila | 12:18 | |
*** akerr has joined #openstack-manila | 12:21 | |
*** marcusvrn has joined #openstack-manila | 12:26 | |
vponomaryov | mkoderer: http://logs.openstack.org/55/208955/1/check/gate-manila-tempest-dsvm-neutron-scenario/16fa869/logs/screen-m-shr.txt.gz#_2015-08-04_11_24_38_377 -> https://github.com/paramiko/paramiko/blob/54415207/paramiko/transport.py#L1639 | 12:29 |
*** chlong has joined #openstack-manila | 12:41 | |
*** dustins has joined #openstack-manila | 12:55 | |
*** timcl1 has joined #openstack-manila | 12:56 | |
mkoderer | vponomaryov: mh, so it aborts the connection? | 12:56 |
vponomaryov | mkoderer: it tries to read our key and faces unexpected EOF | 12:57 |
vponomaryov | so, itis concurrency issue and it was introduced either early 31th July or late 30th | 12:58 |
*** rcallawa_ has joined #openstack-manila | 12:58 | |
*** timcl has quit IRC | 12:59 | |
*** rcallawa has quit IRC | 13:01 | |
*** cknight has joined #openstack-manila | 13:02 | |
*** lpetrut has quit IRC | 13:10 | |
ganso_ | vponomaryov: ping | 13:11 |
vponomaryov | ganso_: pong | 13:12 |
ganso_ | vponomaryov: hello, could you please give me your opinion on this item? LN 460 in https://review.openstack.org/#/c/179790/20/manila/share/manager.py | 13:13 |
vponomaryov | ganso_: AMQP is message transport, not data transport | 13:14 |
vponomaryov | ganso_: so, it is unclear what kind of errors you mention there | 13:15 |
*** erlon has joined #openstack-manila | 13:15 | |
ganso_ | vponomaryov: yes, but it seems to be the single threaded service is busy copying the files and to not reply to AMQP heartbeat messages | 13:15 |
ganso_ | vponomaryov: so it shows a huge stack trace of socket closed errors, and then reconnects and proceeds normally | 13:16 |
ganso_ | vponomaryov: do you think creating a thread for copying is a bad idea? | 13:17 |
*** xyang has quit IRC | 13:18 | |
vponomaryov | ganso_: what service is single-threaded as you say? | 13:18 |
ganso_ | vponomaryov: manager and driver code | 13:18 |
vponomaryov | ganso_: each request to manila-share runs in separate thread | 13:19 |
ganso_ | vponomaryov: hummm I have no idea then, I will reproduce and paste the stack trace for you | 13:20 |
openstackgerrit | Peter Wang proposed openstack/manila: Add retry logic when delete a NFS share in VNX https://review.openstack.org/208846 | 13:20 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [DEBUG] debug7 tempest scenario job https://review.openstack.org/209060 | 13:26 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: [DEBUG] debug7.1 tempest scenario job https://review.openstack.org/209061 | 13:26 |
openstackgerrit | Marc Koderer proposed openstack/manila: Use Tempest plugin interface https://review.openstack.org/201955 | 13:27 |
openstackgerrit | Marc Koderer proposed openstack/manila: Reduce dependency to tempest: exceptions https://review.openstack.org/209062 | 13:27 |
*** chlong has quit IRC | 13:31 | |
ganso_ | vponomaryov: http://paste.openstack.org/show/406869/ | 13:36 |
ganso_ | vponomaryov: every time I copy big files I see the above errors | 13:37 |
ganso_ | vponomaryov: any idea on how to prevent such errors? | 13:39 |
*** lpetrut has joined #openstack-manila | 13:40 | |
vponomaryov | ganso_: need investigate your code. Looks like you have bug in new code, because it is common situation when some manager/driver method gets minutes for execution | 13:41 |
*** DericHorn-HP has joined #openstack-manila | 13:42 | |
ganso_ | vponomaryov: it is expected to get minutes | 13:45 |
*** lpetrut has quit IRC | 13:47 | |
*** anubhav has quit IRC | 13:49 | |
*** esker has joined #openstack-manila | 13:49 | |
vponomaryov | ganso_: why you do not use "shutil.copytree()"? | 13:50 |
vponomaryov | ganso_: in https://review.openstack.org/#/c/179790/20/manila/share/driver.py | 13:50 |
ganso_ | vponomaryov: because if there are files that cannot be copied, the entire copy is aborted | 13:51 |
vponomaryov | ganso_: and you think it is OK to continue migration when something was not migrated? | 13:52 |
vponomaryov | ganso_: and what files are commonly fail to be copied? | 13:53 |
ganso_ | vponomaryov: no, I also abort, but I skip files that should be ignored, I need to find a way to have a list of ignored files | 13:54 |
ganso_ | vponomaryov: lost+found folder commonly fails | 13:54 |
ganso_ | vponomaryov: I know copytree() can receive "ignore" parameters. At first I was planning on having progress tracking, and this was not possible with copytree(). Progress tracking is not being very useful at this moment, but I am sure it will be useful. | 13:56 |
vponomaryov | ganso_: https://docs.python.org/2/library/shutil.html#shutil.copytree "ignore" | 13:56 |
*** vbellur has quit IRC | 13:57 | |
ganso_ | vponomaryov: I have had more work to implement what copytree() already does, but I see the progress tracking as an advantage | 13:57 |
ganso_ | vponomaryov: I still have to use copystat() for folders though | 13:57 |
vponomaryov | ganso_: what about using "bash" for copying process? | 13:59 |
vponomaryov | ganso_: its "cp"? | 13:59 |
ganso_ | vponomaryov: I tried cp and rsync before, they give I/O errors randomly | 14:00 |
vponomaryov | ganso_: randomly? | 14:00 |
ganso_ | vponomaryov: my first patches were using rsync | 14:00 |
ganso_ | vponomaryov: yes | 14:00 |
vponomaryov | ganso_: now you do too granular work. We need to copy everything as is except "lost+found" | 14:01 |
vponomaryov | ganso_: also, where are you going to track status of copying? | 14:02 |
vponomaryov | ganso_: logs? | 14:02 |
ganso_ | vponomaryov: yes, I would have to do the same "ignore" treatment for cp, rsync, copytree(), etc... but I just reimplemented copytree() with progress tracking | 14:02 |
ganso_ | vponomaryov: yes, since there is nobody to read (like horizon), just logs | 14:02 |
vponomaryov | ganso_: "reimplemented" =) | 14:02 |
ganso_ | vponomaryov: hehe | 14:03 |
*** 32NAAAL0S has quit IRC | 14:06 | |
ganso_ | vponomaryov: I also thought about implementing another thread that tracks copy progress, if the progress of a single file gets stuck, I abort copying. This is for crazy network situations such as NFS disconnects that leave processes waiting indefinitely | 14:06 |
*** haomaiwang has joined #openstack-manila | 14:07 | |
*** BharatK has quit IRC | 14:07 | |
ganso_ | vponomaryov: in other words, a timeout | 14:07 |
*** mtanino has joined #openstack-manila | 14:09 | |
*** DericHorn-HP has quit IRC | 14:13 | |
vponomaryov | ganso_: rsync --info=progress2 source dest | 14:14 |
vponomaryov | ganso_: rsync -avh --progress source dest | 14:15 |
vponomaryov | ganso_: ^ shows progress | 14:16 |
ganso_ | vponomaryov: python cannot the buffered output of rsync's --progress, I spent a week researching that :\ | 14:16 |
ganso_ | vponomaryov: It works in bash, but processutils.execute cannot read it | 14:16 |
ganso_ | vponomaryov: python cannot *read the buffered output | 14:17 |
vponomaryov | ganso_: write log and read it | 14:17 |
vponomaryov | ganso_: =) | 14:17 |
ganso_ | vponomaryov: still, does not solve the random I/O errors | 14:17 |
*** timcl1 has quit IRC | 14:18 | |
ganso_ | vponomaryov: and I would also need multiple threads for that, which I rather not use... I am not using multiple threads in my implementation. Rsync blocks the thread completely. | 14:19 |
vponomaryov | ganso_: about multithreading for rsync - http://www.gnu.org/software/parallel/man.html#EXAMPLE:-Parallelizing-rsync | 14:21 |
*** DericHorn-HP has joined #openstack-manila | 14:22 | |
ganso_ | vponomaryov: "The dirs created may end up with wrong permissions and smaller files are not being transferred. To fix those run rsync a final time" | 14:23 |
ganso_ | vponomaryov: yea I could repeatedly run rsync until all copy is completed when I get I/O errors | 14:24 |
ganso_ | vponomaryov: but to me, this does not look better than to stick with the granular implementation and improve it as needed | 14:25 |
vponomaryov | ganso_: wait | 14:28 |
vponomaryov | ganso_: you use rpc in driver | 14:30 |
vponomaryov | ganso_: adding new functionality | 14:31 |
ganso_ | vponomaryov: what are you talking about exactly? | 14:31 |
vponomaryov | ganso_: just set timeout to your new transport | 14:34 |
vponomaryov | ganso_: https://github.com/openstack/oslo.messaging/blob/0969bfcd/oslo_messaging/rpc/client.py#L167 | 14:35 |
vponomaryov | ganso_: https://review.openstack.org/#/c/179790/20/manila/share/rpcapi.py - line 89 | 14:35 |
*** dustins has quit IRC | 14:36 | |
vponomaryov | ganso_: instead of current "cctxt = self.client.prepare(server=new_host, version='1.5')" make it "cctxt = self.client.prepare(server=new_host, version='1.5', timeout=%zillion%)" | 14:36 |
ganso_ | vponomaryov: lol %zillion% | 14:36 |
*** DericHorn-HP has quit IRC | 14:37 | |
ganso_ | vponomaryov: yea I was just wondering how much for the timeout... for a migration, it could take days... | 14:37 |
vponomaryov | ganso_: make it configurable | 14:37 |
vponomaryov | ganso_: and that's it | 14:37 |
vponomaryov | ganso_: with exceedence of timeout fail migration | 14:37 |
ganso_ | vponomaryov: if this timeout is causing the AMQP errors, then it will not fail migration | 14:38 |
vponomaryov | ganso_: i mean there is always time that we can wait and do not want even to start if it takes ZILLION secs =) | 14:39 |
ganso_ | vponomaryov: oh I get it | 14:39 |
ganso_ | vponomaryov: but again, this timeout does not abort migration per se, I will need another mechanism to abort | 14:40 |
vponomaryov | ganso_: it is different story | 14:40 |
ganso_ | vponomaryov: unless it does cancel the RPC thread, which it should already be doing for me, but it is not | 14:40 |
*** vbellur has joined #openstack-manila | 14:43 | |
*** lpetrut has joined #openstack-manila | 14:45 | |
ganso_ | vponomaryov: I gotta go, I will be back later | 14:46 |
*** xyang has joined #openstack-manila | 14:48 | |
*** dustins has joined #openstack-manila | 14:53 | |
*** haomaiwang has quit IRC | 15:00 | |
*** haomaiwang has joined #openstack-manila | 15:00 | |
openstackgerrit | Sebastien Badia proposed openstack/puppet-manila: Initial msync run for all Puppet OpenStack modules https://review.openstack.org/189872 | 15:16 |
*** bswartz has joined #openstack-manila | 15:20 | |
*** esker has quit IRC | 15:20 | |
*** rcallawa_ has quit IRC | 15:21 | |
*** rcallawa has joined #openstack-manila | 15:21 | |
*** dustins has quit IRC | 15:52 | |
*** DericHorn-HP has joined #openstack-manila | 15:53 | |
*** esker has joined #openstack-manila | 15:55 | |
*** rraja has quit IRC | 15:57 | |
*** haomaiwang has quit IRC | 16:00 | |
*** haomaiwang has joined #openstack-manila | 16:00 | |
*** esker has quit IRC | 16:04 | |
*** cknight has quit IRC | 16:04 | |
*** dustins has joined #openstack-manila | 16:05 | |
*** xyang_ has joined #openstack-manila | 16:05 | |
*** DericHorn-HP has quit IRC | 16:07 | |
*** DericHorn-HP has joined #openstack-manila | 16:08 | |
*** zaitcev has joined #openstack-manila | 16:12 | |
openstackgerrit | Mark Sturdevant proposed openstack/manila: Fix HP3PAR extra-specs scoping prefix bug https://review.openstack.org/208684 | 16:19 |
*** pmcnabb has joined #openstack-manila | 16:24 | |
*** dzamboni has joined #openstack-manila | 16:25 | |
*** openstackgerrit_ has quit IRC | 16:29 | |
*** cknight has joined #openstack-manila | 16:29 | |
*** pmcnabb has left #openstack-manila | 16:40 | |
*** sbjorn has quit IRC | 16:41 | |
*** haomaiwang has quit IRC | 17:00 | |
*** haomaiwang has joined #openstack-manila | 17:00 | |
*** timcl has joined #openstack-manila | 17:04 | |
*** jasonsb has quit IRC | 17:12 | |
*** jasonsb has joined #openstack-manila | 17:16 | |
*** jasonsb has quit IRC | 17:19 | |
*** breitz has joined #openstack-manila | 17:35 | |
*** david-lyle has quit IRC | 17:48 | |
*** sgotliv_ has quit IRC | 17:54 | |
*** haomaiwang has quit IRC | 18:00 | |
*** haomaiwang has joined #openstack-manila | 18:00 | |
*** jasonsb has joined #openstack-manila | 18:05 | |
*** akerr has quit IRC | 18:12 | |
*** akerr has joined #openstack-manila | 18:12 | |
*** lpetrut has quit IRC | 18:27 | |
*** breitz has quit IRC | 18:28 | |
*** xyang_ has quit IRC | 18:29 | |
*** bswartz has quit IRC | 18:34 | |
*** dzamboni has quit IRC | 18:37 | |
openstackgerrit | Cody Herriges proposed openstack/puppet-manila: Initial msync run for all Puppet OpenStack modules https://review.openstack.org/189872 | 18:40 |
*** timcl1 has joined #openstack-manila | 18:51 | |
*** timcl has quit IRC | 18:52 | |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: Add retryer to SSH client 'connect' func https://review.openstack.org/209215 | 18:55 |
openstackgerrit | Valeriy Ponomaryov proposed openstack/manila: Add retryer to SSH client 'connect' func https://review.openstack.org/209215 | 18:56 |
*** cknight has quit IRC | 18:57 | |
*** cknight has joined #openstack-manila | 18:58 | |
vponomaryov | xyang, u_glide, toabctl, markstur, mkoderer, cknight: ^ is our blocker-fix. If we manage to merge it, then it is bugfix indeed ^_^ | 18:58 |
*** haomaiwang has quit IRC | 19:00 | |
*** haomaiwang has joined #openstack-manila | 19:00 | |
*** esker has joined #openstack-manila | 19:02 | |
*** DericHorn-HP has quit IRC | 19:02 | |
*** DericHorn-HP has joined #openstack-manila | 19:02 | |
*** bswartz has joined #openstack-manila | 19:05 | |
*** xyang has quit IRC | 19:18 | |
openstackgerrit | Merged openstack/manila: Replace '__metaclass__' with '@six.add_metaclass' https://review.openstack.org/207782 | 19:29 |
*** timcl has joined #openstack-manila | 19:34 | |
*** timcl1 has quit IRC | 19:35 | |
*** timcl1 has joined #openstack-manila | 19:42 | |
*** timcl has quit IRC | 19:43 | |
*** lpetrut has joined #openstack-manila | 19:43 | |
*** xyang_ has joined #openstack-manila | 19:46 | |
*** ekarlso has quit IRC | 19:55 | |
*** ekarlso has joined #openstack-manila | 19:57 | |
*** haomaiwang has quit IRC | 20:00 | |
*** haomaiwang has joined #openstack-manila | 20:00 | |
*** DericHorn-HP has quit IRC | 20:00 | |
*** bswartz has quit IRC | 20:01 | |
*** bswartz has joined #openstack-manila | 20:02 | |
*** lpetrut has quit IRC | 20:05 | |
*** esker has quit IRC | 20:09 | |
*** lpetrut has joined #openstack-manila | 20:10 | |
*** esker has joined #openstack-manila | 20:11 | |
*** esker has quit IRC | 20:11 | |
*** esker has joined #openstack-manila | 20:11 | |
*** akerr has quit IRC | 20:43 | |
*** sgotliv_ has joined #openstack-manila | 20:43 | |
*** echoingumesh has joined #openstack-manila | 20:48 | |
*** haomaiwang has quit IRC | 21:00 | |
*** haomaiwang has joined #openstack-manila | 21:00 | |
*** esker has quit IRC | 21:01 | |
*** rcallawa_ has joined #openstack-manila | 21:07 | |
*** rcallawa has quit IRC | 21:11 | |
*** rcallawa_ has quit IRC | 21:11 | |
*** xyang_ has quit IRC | 21:48 | |
*** jasonsb has quit IRC | 21:50 | |
*** jasonsb has joined #openstack-manila | 21:51 | |
*** haomaiwang has quit IRC | 22:00 | |
*** haomaiwang has joined #openstack-manila | 22:00 | |
*** chlong has joined #openstack-manila | 22:07 | |
*** jasonsb_ has joined #openstack-manila | 22:14 | |
*** jasonsb has quit IRC | 22:16 | |
*** cknight has quit IRC | 22:32 | |
*** dustins has quit IRC | 22:32 | |
*** sgotliv_ has quit IRC | 22:47 | |
*** haomaiwang has quit IRC | 23:00 | |
*** rcallawa_ has joined #openstack-manila | 23:00 | |
*** rcallawa_ has quit IRC | 23:00 | |
*** haomaiwang has joined #openstack-manila | 23:00 | |
*** rcallawa_ has joined #openstack-manila | 23:01 | |
*** bill_az has joined #openstack-manila | 23:02 | |
*** bill_az has quit IRC | 23:05 | |
*** bill_az has joined #openstack-manila | 23:05 | |
*** echoingumesh has quit IRC | 23:07 | |
*** echoingumesh has joined #openstack-manila | 23:12 | |
*** zaitcev has quit IRC | 23:13 | |
*** lpetrut has quit IRC | 23:28 | |
*** bswartz has quit IRC | 23:28 | |
*** marcusvrn has quit IRC | 23:33 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!