Thursday, 2017-04-20

*** yangyapeng has quit IRC00:00
*** markstur has joined #openstack-cinder00:21
*** viks has quit IRC00:22
*** edmondsw has joined #openstack-cinder00:23
*** markstur has quit IRC00:25
*** felipemonteiro__ has joined #openstack-cinder00:26
*** edmondsw has quit IRC00:28
*** gcb has quit IRC00:29
*** ngupta has joined #openstack-cinder00:30
*** michael__ has quit IRC00:30
*** Apoorva_ has joined #openstack-cinder00:30
*** gcb has joined #openstack-cinder00:31
*** Apoorva has quit IRC00:34
*** Apoorva_ has quit IRC00:35
*** Julien-zte has joined #openstack-cinder00:38
*** Jack_Iv has joined #openstack-cinder00:45
openstackgerritwangxiyuan proposed openstack/cinder master: Don't return empty volume_image_metadata when list volume  https://review.openstack.org/45800800:49
*** jerrygb has joined #openstack-cinder00:50
*** Jack_Iv has quit IRC00:50
*** catintheroof has quit IRC00:52
*** markstur has joined #openstack-cinder00:53
*** jerrygb has quit IRC00:56
*** markstur has quit IRC00:57
*** zhangguoqing has joined #openstack-cinder01:04
*** yangyapeng has joined #openstack-cinder01:08
*** mriedem has quit IRC01:22
*** markstur has joined #openstack-cinder01:24
*** Julien-zte has quit IRC01:27
*** markstur has quit IRC01:28
*** david-lyle has quit IRC01:35
*** markstur has joined #openstack-cinder01:40
*** jerrygb has joined #openstack-cinder01:43
*** markstur has quit IRC01:44
*** david-lyle has joined #openstack-cinder01:50
*** dave-mcc_ has joined #openstack-cinder01:51
*** dave-mccowan has quit IRC01:53
*** Julien-zte has joined #openstack-cinder02:00
*** yangyapeng has quit IRC02:02
*** zhangguoqing has quit IRC02:03
*** zhangguoqing has joined #openstack-cinder02:04
*** zhangguoqing has quit IRC02:04
*** zhangguoqing has joined #openstack-cinder02:05
*** huanxuan has joined #openstack-cinder02:05
*** zhangguoqing has quit IRC02:05
*** zhangguoqing has joined #openstack-cinder02:06
*** s-shiono has quit IRC02:10
*** zhurong has joined #openstack-cinder02:10
*** dave-mccowan has joined #openstack-cinder02:11
openstackgerritMerged openstack/cinder master: Filtering attachment doesn't support 'instance_id'  https://review.openstack.org/45756802:11
*** markstur has joined #openstack-cinder02:11
*** Shunli has joined #openstack-cinder02:11
*** bkopilov has quit IRC02:13
*** dave-mcc_ has quit IRC02:13
*** markstur has quit IRC02:16
*** Julien-zte has quit IRC02:20
openstackgerritwangxiyuan proposed openstack/cinder master: Add VolumeStatus enum field-Part(1)  https://review.openstack.org/44473402:26
*** markstur has joined #openstack-cinder02:36
*** ngupta has quit IRC02:38
*** ngupta has joined #openstack-cinder02:38
*** markstur has quit IRC02:44
openstackgerritjiamin proposed openstack/cinder master: ds8k: should verify REST version separately  https://review.openstack.org/45405902:44
*** markstur has joined #openstack-cinder02:44
*** gouthamr has joined #openstack-cinder02:45
*** yangyapeng has joined #openstack-cinder02:48
*** markstur has quit IRC02:49
*** gkadam has joined #openstack-cinder02:53
*** ngupta has quit IRC02:54
*** jerrygb has quit IRC02:55
openstackgerritjiamin proposed openstack/cinder master: DS8K driver: specify pool and lss in extra-specs  https://review.openstack.org/43585703:00
*** markstur has joined #openstack-cinder03:00
openstackgerritliuyamin proposed openstack/cinder master: Add the missing parameters in the api-ref of ext-backups.inc  https://review.openstack.org/45053703:02
*** yangyape_ has joined #openstack-cinder03:02
*** yangyapeng has quit IRC03:03
*** zhangguoqing has quit IRC03:04
*** markstur has quit IRC03:05
*** zhangguoqing has joined #openstack-cinder03:06
*** Fdaisuke_ has joined #openstack-cinder03:08
*** Fdaisuke has quit IRC03:09
*** felipemonteiro_ has joined #openstack-cinder03:14
*** felipemonteiro__ has quit IRC03:18
*** ebalduf has joined #openstack-cinder03:20
*** zhurong has quit IRC03:21
*** zhurong has joined #openstack-cinder03:28
*** imacdonn has quit IRC03:28
*** imacdonn has joined #openstack-cinder03:28
*** zhurong has quit IRC03:31
*** markstur has joined #openstack-cinder03:31
*** nicolasbock has quit IRC03:31
*** markstur has quit IRC03:36
*** bkopilov has joined #openstack-cinder03:44
openstackgerritwangxiyuan proposed openstack/cinder master: Add VolumeStatus enum field-Part(1)  https://review.openstack.org/44473403:55
openstackgerritwangxiyuan proposed openstack/cinder master: Add VolumeStatus enum field-Part(2)  https://review.openstack.org/45831803:55
*** ngupta has joined #openstack-cinder03:55
*** Shashi has joined #openstack-cinder03:59
*** edmondsw has joined #openstack-cinder04:00
*** markstur has joined #openstack-cinder04:03
*** zhangguoqing has quit IRC04:03
*** Fdaisuke has joined #openstack-cinder04:03
*** edmondsw has quit IRC04:04
*** zhangguoqing has joined #openstack-cinder04:05
*** Fdaisuke_ has quit IRC04:06
*** dave-mccowan has quit IRC04:07
*** shyama has joined #openstack-cinder04:07
*** markstur has quit IRC04:08
*** zhangguoqing has quit IRC04:09
*** vivsoni has joined #openstack-cinder04:14
*** jerrygb has joined #openstack-cinder04:15
*** salv-orlando has joined #openstack-cinder04:19
*** salv-orlando has quit IRC04:23
*** stakeda has joined #openstack-cinder04:25
*** adisky_ has joined #openstack-cinder04:28
*** zhurong has joined #openstack-cinder04:31
*** jerrygb has quit IRC04:32
*** jerrygb has joined #openstack-cinder04:32
*** salv-orlando has joined #openstack-cinder04:33
*** markstur has joined #openstack-cinder04:34
*** markstur has quit IRC04:39
*** kaisers has joined #openstack-cinder04:42
*** psachin has joined #openstack-cinder04:43
*** Jack_Iv has joined #openstack-cinder04:45
*** kaisers has quit IRC04:47
*** jerrygb has quit IRC04:47
*** kaisers has joined #openstack-cinder04:48
*** Jack_Iv has quit IRC04:50
*** alonma has joined #openstack-cinder04:51
*** Jack_Iv has joined #openstack-cinder04:52
*** Julien-zte has joined #openstack-cinder04:53
*** Jack_Iv has quit IRC04:56
*** Shashi has quit IRC04:56
*** Shashi has joined #openstack-cinder05:00
*** markstur has joined #openstack-cinder05:06
*** markstur has quit IRC05:10
*** dikonoor has joined #openstack-cinder05:18
*** lamt has joined #openstack-cinder05:19
*** Jack_Iv has joined #openstack-cinder05:30
*** ChubYann has quit IRC05:32
*** lkuchlan has joined #openstack-cinder05:34
*** alonma has quit IRC05:46
*** alonma has joined #openstack-cinder05:49
*** gcb has quit IRC05:51
*** e0ne has joined #openstack-cinder05:52
*** gouthamr has quit IRC05:54
*** e0ne has quit IRC05:59
*** edmondsw has joined #openstack-cinder06:00
*** Jack_Iv has quit IRC06:02
*** winston-d_ has joined #openstack-cinder06:03
*** alonma has quit IRC06:03
*** edmondsw has quit IRC06:05
*** Jack_Iv has joined #openstack-cinder06:11
*** zhurong has quit IRC06:12
*** salv-orlando has quit IRC06:12
*** lamt has quit IRC06:14
*** Jack_Iv has quit IRC06:15
*** e0ne has joined #openstack-cinder06:16
*** e0ne has quit IRC06:18
*** lamt has joined #openstack-cinder06:22
*** david-lyle has quit IRC06:23
*** isaacb has joined #openstack-cinder06:24
*** Jack_Iv has joined #openstack-cinder06:27
*** Jack_Iv has quit IRC06:27
*** lamt has quit IRC06:27
*** rcernin has joined #openstack-cinder06:28
*** david-lyle has joined #openstack-cinder06:37
*** pcaruana has joined #openstack-cinder06:40
*** alonma has joined #openstack-cinder06:56
*** tesseract has joined #openstack-cinder06:56
*** hidekazu has joined #openstack-cinder07:01
*** david-lyle has quit IRC07:02
hidekazuhi, cinder developers.07:02
hidekazui want to know when pool is not be created, is it possible?07:03
*** david-lyle has joined #openstack-cinder07:03
hidekazuit may be happen we wrote bad configuration?07:03
openstackgerritNidhiMittalHada proposed openstack/cinder master: validate_integer doesn't check non int properly  https://review.openstack.org/45131607:04
*** salv-orlando has joined #openstack-cinder07:11
*** zhurong has joined #openstack-cinder07:12
*** alonma has quit IRC07:19
*** alonma has joined #openstack-cinder07:19
*** alonma has quit IRC07:24
*** mlakat has joined #openstack-cinder07:24
*** alonma has joined #openstack-cinder07:27
*** jamielennox has quit IRC07:28
*** gkadam has quit IRC07:29
*** gkadam has joined #openstack-cinder07:29
openstackgerritMate Lakat proposed openstack/cinder master: Create indexes for foreign keys  https://review.openstack.org/43731307:36
*** e0ne has joined #openstack-cinder07:37
*** jamielennox has joined #openstack-cinder07:42
openstackgerritMichal Dulko proposed openstack/cinder master: Move driver options to "backend" section  https://review.openstack.org/45365407:48
*** pgadiya has joined #openstack-cinder07:53
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-cinder08:00
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - Pre-zoned port group fix  https://review.openstack.org/45628508:21
*** ebalduf has quit IRC08:21
*** alonma has quit IRC08:23
*** alonma has joined #openstack-cinder08:23
*** ebalduf has joined #openstack-cinder08:28
*** alonma has quit IRC08:28
*** aarefiev_afk is now known as aarefiev08:29
*** alonma has joined #openstack-cinder08:29
*** alonma has quit IRC08:33
openstackgerritStephen Finucane proposed openstack/python-cinderclient master: Explicitly set 'builders' option  https://review.openstack.org/45795408:34
openstackgerritStephen Finucane proposed openstack/python-cinderclient master: doc: Remove cruft from conf.py  https://review.openstack.org/45795508:34
openstackgerritStephen Finucane proposed openstack/python-cinderclient master: Use Sphinx 1.5 warning-is-error  https://review.openstack.org/45795308:34
*** alonma has joined #openstack-cinder08:36
*** Fdaisuke_ has joined #openstack-cinder08:40
*** pgadiya has quit IRC08:42
*** Fdaisuke has quit IRC08:42
*** david-lyle has quit IRC08:47
openstackgerritwangxiyuan proposed openstack/cinder master: Add VolumeStatus enum field-Part(1)  https://review.openstack.org/44473409:06
openstackgerritwangxiyuan proposed openstack/cinder master: Add VolumeStatus enum field-Part(2)  https://review.openstack.org/45831809:06
*** faizy_ has joined #openstack-cinder09:08
*** faizy_ has quit IRC09:09
*** faizy_ has joined #openstack-cinder09:09
*** faizy_ has quit IRC09:11
*** faizy has quit IRC09:11
*** salv-orlando has quit IRC09:13
*** elurkki has joined #openstack-cinder09:17
vivsoniHi, please review https://review.openstack.org/#/c/454062/09:19
elurkkiOpenStack end user here testing OpenStack a bit. When reboot causes /dev/disk/by-path block device files to be removed (compute node), how can I get them generated when reboot doesn't do that? Creating new instance creates new block device file though. Thank you very much for any tips.09:21
*** gkadam is now known as gkadam-afk09:26
*** lpetrut has joined #openstack-cinder09:32
*** Julien-zte has quit IRC09:32
*** yangyapeng has joined #openstack-cinder09:32
*** hidekazu has quit IRC09:34
*** yangyape_ has quit IRC09:35
*** dalgaaf has quit IRC09:35
*** dalgaaf has joined #openstack-cinder09:37
iceyany chance for a workflow (or more code review) on https://review.openstack.org/#/c/453072/ ?09:41
*** huanxuan has quit IRC09:42
elurkkiTo clarify a bit, the missing block device files occurs only when the cinder service is rebooted as well.09:45
*** nicolasbock has joined #openstack-cinder10:02
*** haplo37_ has quit IRC10:05
*** lkuchlan has quit IRC10:08
*** lkuchlan has joined #openstack-cinder10:08
*** alonma has quit IRC10:12
*** alonma has joined #openstack-cinder10:13
openstackgerritTommyLike proposed openstack/cinder master: [WIP]Explicit user messages.  https://review.openstack.org/44838410:13
*** alonma has quit IRC10:13
*** alonma has joined #openstack-cinder10:13
*** haplo37_ has joined #openstack-cinder10:16
*** abishop has joined #openstack-cinder10:16
*** zhurong has quit IRC10:19
*** sdague has joined #openstack-cinder10:21
danpawlikHello10:25
danpawlikCan you review https://review.openstack.org/#/c/456672/ ?10:25
danpawlikwhen you have some free time ofc ;)10:26
*** ociuhandu has joined #openstack-cinder10:45
openstackgerritMerged openstack/os-brick master: Fixed generated temp file problem for RBD backend  https://review.openstack.org/45802110:52
*** winston-d_ has quit IRC11:03
*** markvoelker has quit IRC11:06
*** markvoelker has joined #openstack-cinder11:06
*** mvk has quit IRC11:06
*** bkopilov has quit IRC11:07
*** shyama has quit IRC11:07
*** stakeda has quit IRC11:09
*** markvoelker has quit IRC11:11
openstackgerritGeorgy Dyuldin proposed openstack/python-cinderclient master: Fix client `retries` default value.  https://review.openstack.org/45845511:14
*** zhurong has joined #openstack-cinder11:17
*** kaisers_ has joined #openstack-cinder11:17
*** yangyapeng has quit IRC11:19
*** kaisers has quit IRC11:20
*** BlackDex has quit IRC11:21
openstackgerritHelen Walsh proposed openstack/cinder master: VMAX driver - Detaching volumes if part of two or more MVs  https://review.openstack.org/45845811:22
*** Julien-zte has joined #openstack-cinder11:26
*** shyama has joined #openstack-cinder11:27
*** lennyb has quit IRC11:29
*** lennyb has joined #openstack-cinder11:31
*** openstackgerrit has quit IRC11:32
*** Shunli has quit IRC11:46
*** jerrygb has joined #openstack-cinder11:49
*** yangyapeng has joined #openstack-cinder11:51
*** jerrygb has quit IRC11:54
*** Swanson has quit IRC11:56
*** alonma has quit IRC12:01
*** alonma has joined #openstack-cinder12:01
*** openstackgerrit has joined #openstack-cinder12:01
openstackgerritGaurang Tapase proposed openstack/cinder master: GPFS: Enhance GPFS driver to work in container  https://review.openstack.org/41137712:01
*** Jack_Iv has joined #openstack-cinder12:02
*** Jack_Iv has quit IRC12:02
*** alonma has quit IRC12:05
*** alonma has joined #openstack-cinder12:07
*** lkuchlan has quit IRC12:08
*** lkuchlan has joined #openstack-cinder12:09
*** jerrygb has joined #openstack-cinder12:09
*** alonma has quit IRC12:11
*** edmondsw has joined #openstack-cinder12:12
*** jerrygb has quit IRC12:14
*** mvk has joined #openstack-cinder12:15
*** alonma has joined #openstack-cinder12:18
*** yangyapeng has quit IRC12:19
*** alonma has quit IRC12:23
*** dave-mccowan has joined #openstack-cinder12:27
*** catintheroof has joined #openstack-cinder12:27
openstackgerritTommyLike proposed openstack/cinder master: [WIP]Explicit user messages.  https://review.openstack.org/44838412:29
*** alonma has joined #openstack-cinder12:29
*** catintheroof has quit IRC12:30
*** catintheroof has joined #openstack-cinder12:30
*** abishop is now known as abishop|bbl12:33
*** alonma has quit IRC12:34
*** salv-orlando has joined #openstack-cinder12:35
*** Shashi has quit IRC12:37
*** chhavi has joined #openstack-cinder12:38
*** markvoelker has joined #openstack-cinder12:39
*** catintheroof has quit IRC12:40
*** catintheroof has joined #openstack-cinder12:41
*** catintheroof has quit IRC12:41
*** catintheroof has joined #openstack-cinder12:41
*** gcb has joined #openstack-cinder12:43
*** catintheroof has quit IRC12:43
*** catintheroof has joined #openstack-cinder12:43
*** alonma has joined #openstack-cinder12:44
*** liverpooler has joined #openstack-cinder12:46
openstackgerritTommyLike proposed openstack/cinder master: Add support for generalized filtering on list APIs  https://review.openstack.org/44459812:48
*** alonma has quit IRC12:49
*** bkopilov has joined #openstack-cinder12:50
*** gkadam-afk has quit IRC12:51
*** eharney has joined #openstack-cinder12:51
*** alonma has joined #openstack-cinder12:52
*** jerrygb has joined #openstack-cinder12:56
*** porrua has joined #openstack-cinder13:00
*** lamt has joined #openstack-cinder13:03
arnewiebalckThe deletion of several volumes in one call seems to break our Mitaka Cinder setup with sqlalchemy “Deadlock detected” messages. Is it worth upgrading before looking more closely into this, i.e. has there been work to fix potential race conditions around deletions since Mitaka?13:05
*** jiaopengju has joined #openstack-cinder13:07
*** jiaopeng_ has joined #openstack-cinder13:07
*** Julien-zte has quit IRC13:10
geguileoarnewiebalck: what kind of DB deployment do you have?13:10
arnewiebalckgeguileo: what do mean specifically?13:11
*** Julien-zte has joined #openstack-cinder13:12
geguileoarnewiebalck: do you have a singe DBMS? Or do you have a multinode galeray cluster? If it's multinode, is it master-master, master-slave?13:14
arnewiebalckgeguileo: single server13:17
*** yangyapeng has joined #openstack-cinder13:18
arnewiebalckgeguileo: the way I trigger this is by “cinder delete vol0 vol1 … vol100”13:19
*** abishop|bbl is now known as abishop13:20
*** mriedem has joined #openstack-cinder13:20
geguileoarnewiebalck: I would have to try it in master, because I haven't seen that error before in those kind of situations13:21
geguileoMost deadlocks I've seen are due to a multinode DBMS13:22
*** erhudy has joined #openstack-cinder13:23
*** lamt has quit IRC13:23
*** alonma has quit IRC13:23
*** alonma has joined #openstack-cinder13:24
*** hypothermic_cat is now known as ildikov13:25
*** ociuhandu has quit IRC13:25
arnewiebalckgeguileo: I was naively traing this on our prod setup as I didn’t expect this … bad idea13:25
arnewiebalckgeguileo: I had this with Manila w/o issues13:25
arnewiebalckgeguileo: but maybe that is not comparable13:26
geguileoarnewiebalck: Maybe it isn't, I really don't know why it should fail... r:-???13:26
*** lpetrut has quit IRC13:27
*** jiaopeng_ has quit IRC13:27
*** jiaopengju has quit IRC13:27
*** alonma has quit IRC13:28
geguileoarnewiebalck: I just launched a delete of 5 volumes and it worked just fine13:29
arnewiebalckgeguileo: I can file a bug with the logs if that is helpful?13:29
geguileoI tried this on master13:30
*** alonma has joined #openstack-cinder13:31
*** dustins has joined #openstack-cinder13:32
*** zhangguoqing has joined #openstack-cinder13:32
*** alonma_ has joined #openstack-cinder13:33
arnewiebalckgeguileo: works for you?13:33
geguileoarnewiebalck: with master and 5 volumes it does13:33
*** ociuhandu has joined #openstack-cinder13:34
arnewiebalckgeguileo: I tried to delete 100 and it started when it came to volume 25 or so13:34
arnewiebalckgeguileo: these were 1G empty volumes on a Ceph backend13:34
*** ig0r_ has joined #openstack-cinder13:35
geguileoarnewiebalck: I don't have a Ceph setup right now13:36
*** alonma has quit IRC13:36
geguileoarnewiebalck: So the volumes ended up in error-deleting status?13:36
eharneythis may be a good thing to test w/ our fake driver13:37
arnewiebalckgeguileo: yes13:37
*** alonma_ has quit IRC13:37
arnewiebalckgeguileo: at some point started to intervene as things we’re not moving (and I hence DDOS attacked our prod setup)13:37
arnewiebalckgeguileo: DOS not DDOS13:38
*** zhangguoqing has quit IRC13:38
geguileoarnewiebalck: You could also be experiencing a bottleneck in the number of DB connections from Cinder13:39
geguileoThis was fixed in oslo db at some point, but I don't remember exactly on which release13:39
arnewiebalckgeguileo: yes, I see this as well (“TimeoutError: QueuePool limit of size …”)13:39
arnewiebalckgeguileo: but actually I dont understand why13:40
*** gcb has quit IRC13:40
geguileoBecause default is only 15 simultaneous connections13:40
*** alonma has joined #openstack-cinder13:40
geguileoOn older releases13:40
arnewiebalckgeguileo: are the deletions happening in parallel?13:40
geguileo5 + another 10 of overflow13:40
arnewiebalckgeguileo: I have 20 + 30 overflow13:41
geguileoarnewiebalck: Well, you don't make 1 request to cinder to delete 100 volumes, the client request 100 delete requests13:41
*** ociuhandu has quit IRC13:41
arnewiebalckgeguileo: so, there is no server-side serilization?13:42
geguileoThere is no Cinder REST API call to delete multiple volumes13:42
geguileoSo the client just makes one after the other13:43
geguileoAnd the API processes them and sends them to the respective backends13:43
geguileoYou should increase the max_overflow value in all cinder nodes13:43
geguileoI have to run now, it's almost 4pm and I haven't have lunch yet, and I only have 10 minutes before the next meeting...13:44
arnewiebalckgeguileo: the DB limit of 1000 connections is not that big for our setup13:46
*** david-lyle has joined #openstack-cinder13:46
arnewiebalckgeguileo: bon appetit!13:46
arnewiebalckgeguileo: thx!13:47
*** chlong has joined #openstack-cinder13:51
openstackgerritPooja Jadhav proposed openstack/cinder master: Extracted HTTP response codes to constants  https://review.openstack.org/43489413:54
openstackgerritMate Lakat proposed openstack/cinder master: Create indexes for foreign keys  https://review.openstack.org/43731313:54
*** lamt has joined #openstack-cinder13:55
*** diegows has joined #openstack-cinder13:56
geguileoarnewiebalck: 1000 is probably not the configuration you have in Cinder, but on your DBMS14:00
openstackgerritGeorgy Dyuldin proposed openstack/python-cinderclient master: Fix client `retries` default value.  https://review.openstack.org/45845514:00
*** shaner has quit IRC14:00
*** eharney has quit IRC14:01
arnewiebalckgeguileo: yes, on the DB14:02
geguileoarnewiebalck: you would need to change the max_overflow in the database section on the cinder configuration14:02
arnewiebalckgeguileo: but with 4 backends, 4 controllers, each with several c-apis, plus the c-sched and the c-col, increasing max_overflow has its limits14:03
geguileoarnewiebalck: it does, but having only 15 simultaneous connections on each service...14:03
geguileokind of too low14:03
arnewiebalckgeguileo: 15 is independent of what I configured (20 + 30 overflow)?14:08
*** lamt has quit IRC14:09
*** jonesn has joined #openstack-cinder14:11
*** esker has joined #openstack-cinder14:11
*** eharney has joined #openstack-cinder14:14
*** david-lyle has quit IRC14:14
*** ngupta has quit IRC14:17
*** ngupta has joined #openstack-cinder14:17
*** esker has quit IRC14:18
*** gouthamr has joined #openstack-cinder14:18
*** esker has joined #openstack-cinder14:18
*** esker has quit IRC14:20
geguileoarnewiebalck: Oh, so you defined the max_overflow to 30?14:20
*** monjoshi has joined #openstack-cinder14:21
*** esker has joined #openstack-cinder14:21
*** shaner has joined #openstack-cinder14:23
*** lucasxu has joined #openstack-cinder14:26
*** dikonoor has quit IRC14:26
arnewiebalckgeguileo: yes14:28
monjoshiHi, I need work flow approvals for https://review.openstack.org/#/c/450110/ thanks in advance14:28
arnewiebalckarnewiebalck: max_pool_size=20, max_overflow=3014:29
*** Julien-zte has quit IRC14:29
arnewiebalcks/arnewiebalck/geguileo/14:30
*** Julien-zte has joined #openstack-cinder14:30
geguileoarnewiebalck: have you confirmed that those values are being used by Cinder?14:31
*** ebalduf has quit IRC14:31
arnewiebalckgeguileo: yes, the log reports: “TimeoutError: QueuePool limit of size 20 overflow 30 reached, connection timed out, timeout 30”14:33
geguileoOh, ok14:33
*** Julien-zte has quit IRC14:33
*** ebalduf has joined #openstack-cinder14:33
*** kfarr has joined #openstack-cinder14:34
geguileoAnd your DBMS is not clustered?14:34
*** Julien-zte has joined #openstack-cinder14:37
arnewiebalckgeguileo: No, single server.14:38
geguileoThat's even weirder...14:39
*** alonma has quit IRC14:39
arnewiebalckgeguileo: Maybe opening a bug and posting logs is helpful?14:39
*** alonma has joined #openstack-cinder14:39
geguileoarnewiebalck: sure, maybe someone will know the answer or start working on it14:40
arnewiebalckgeguileo: hoping someone was you ;)14:40
*** markstur has joined #openstack-cinder14:41
*** psachin has quit IRC14:42
*** alonma has quit IRC14:43
*** alonma has joined #openstack-cinder14:46
*** esker has quit IRC14:47
*** lamt has joined #openstack-cinder14:49
*** alonma has quit IRC14:50
*** mdovgal has quit IRC14:53
*** bkopilov has quit IRC14:54
*** isaacb has quit IRC14:54
*** esker has joined #openstack-cinder14:54
geguileoarnewiebalck: Improbable, I really don't have time at this moment, and my todo list is huge  :'-(14:58
*** adisky_ has quit IRC14:59
*** danpawlik has quit IRC14:59
arnewiebalckgeguileo: np, I’ll file a bug, let’s see if someone has an idea what is wrong, thanks for your help!15:00
smcginnisarnewiebalck: I can attest that he has a few things to catch up on yet. ;)15:00
* geguileo hides in shame15:01
smcginnis:)15:01
smcginnisNo shame. There's just always a never ending backlog of things to get done.15:01
*** felipemonteiro has joined #openstack-cinder15:01
*** aarefiev is now known as aarefiev_afk15:01
*** rcernin has quit IRC15:01
openstackgerritJay Bryant proposed openstack/cinder-specs master: Dynamic Log Level control via REST API  https://review.openstack.org/40426015:01
openstackgerritNicholas Jones proposed openstack/cinder master: Remove obsolete Liberty code  https://review.openstack.org/45821715:03
*** lamt has quit IRC15:03
*** mlakat has quit IRC15:05
*** Swanson has joined #openstack-cinder15:05
*** mdovgal has joined #openstack-cinder15:08
*** alonma has joined #openstack-cinder15:09
arnewiebalcksmcginnis: didn’t think geguileo wouldn’t look at this b/c he’s not interested :)15:10
*** felipemonteiro__ has joined #openstack-cinder15:10
openstackgerritMerged openstack/cinder-specs master: Dynamic Log Level control via REST API  https://review.openstack.org/40426015:10
*** felipemonteiro has quit IRC15:11
*** isaacb has joined #openstack-cinder15:11
smcginnisarnewiebalck: ;)15:12
*** david-lyle has joined #openstack-cinder15:13
*** alonma has quit IRC15:13
*** pcaruana has quit IRC15:14
*** lucasxu has quit IRC15:16
*** alonma has joined #openstack-cinder15:16
*** alonma has quit IRC15:17
*** lucasxu has joined #openstack-cinder15:17
openstackgerritMathieu Gagné proposed openstack/cinder-specs master: Allow an attached volume to be extended  https://review.openstack.org/45328615:24
*** lamt has joined #openstack-cinder15:24
jungleboyjmgagne:  Ping .15:25
mgagnejungleboyj: thanks, was trying to find your irc handle :P15:25
mgagnejungleboyj: so what do you suggest? (re spec)15:26
jungleboyjHello.  smcginnis  and I are trying to get specs merged.15:26
jungleboyjSo, I think have error-extending in there makes sense but doesn't appear everyone agrees.15:27
jungleboyjxyang1:  smcginnis  Thoughts?  https://review.openstack.org/#/c/453286/15:27
smcginnisHow would that state be cleared?15:28
smcginnisJust stay error-extending until some other operation is done that updates it?15:28
mgagnehow? with database update? can't extend to same size (and force nova call)15:28
smcginnismgagne: That raises an interesting question. If the volume is extended, and for whatever reason Nova misses that event, how do we eventually reconcile the Cinder view of the world and the Nova view of the world?15:30
mgagneyou could craft a request to Nova external event endpoint (like nova refresh-network CLI command) so iscsi --scan and qemu block-resize is done but Nova wouldn't clear the error for you in Cinder15:30
smcginnismgagne: Ah, OK, that sounds reasonable.15:31
mgagneand you also lose the original state unless you list attachments and base your logic on it len(attachements) > 0 => in-use15:31
xyang1smcginnis: jungleboyj admin has to do reset status to bring it back15:31
smcginnisI'm leaning toward not setting the state then.15:32
mgagnexyang1: thanks, didn't know about reset-state (or forgot)15:32
jungleboyjxyang1:  Right.  That was what I was thinking.  I was assuming that the code in Cinder would take care of bringing it back to the original state under the covers.  The 'error-extending' is just a flag to the admin that something went wrong.15:32
mgagnefor the POV of Cinder, the volume is extended15:32
mgagnethere is nothing left to be done by Cinder15:32
jungleboyjmgagne: Yeah.  reset-state for the admin.15:32
xyang1jungleboyj: yes15:32
smcginnismgagne: +1, I think that's a key point.15:33
mgagneunless we can jam a state in the attachment but I'm not familiar with that15:33
smcginnisSo I would rather not put a requirement on the operator to know about and run the reset state if there's nothing else to be done on the Cinder side.15:33
mgagneright, I think we can iterate later on those edge cases15:34
smcginnismgagne: +115:34
*** lamt has quit IRC15:35
jungleboyjmgagne: smcginnis  Ok, I am ok with that.  Just odd, if it fails, that it will just go back to in-use and the size will be unchanged.15:36
jungleboyjI don't want to hold up the spec on that though.15:36
mgagnejungleboyj: the size is changed in the Cinder backend15:37
smcginnisYeah, our size will change. They'll just have to notice that Nova does not realize that.15:37
mgagnejungleboyj: only error you can get from Nova is failure to connect to Nova API or somehow, API calls fail (which is async btw)15:37
jungleboyjAhhhh ... I see.15:37
jungleboyjSo this really is an edge case.15:37
smcginnisHopefully15:38
jungleboyjmgagne:  Ok, I am onboard now.15:38
*** lucasxu has quit IRC15:39
*** lucasxu has joined #openstack-cinder15:41
*** eharney has quit IRC15:42
*** lucasxu has quit IRC15:42
*** lamt has joined #openstack-cinder15:43
jungleboyjSo, I am going to merge that.15:43
*** lucasxu has joined #openstack-cinder15:43
openstackgerritPavel Gluschak (scsnow) proposed openstack/cinder master: VStorage: changed log path  https://review.openstack.org/45856015:43
*** eharney has joined #openstack-cinder15:46
openstackgerritMerged openstack/cinder-specs master: Allow an attached volume to be extended  https://review.openstack.org/45328615:49
*** salv-orl_ has joined #openstack-cinder15:49
*** salv-orlando has quit IRC15:51
*** felipemonteiro__ has quit IRC15:51
*** felipemonteiro has joined #openstack-cinder15:58
*** david-lyle has quit IRC15:59
*** afazekas_ is now known as afazekas16:00
felipemonteiroIf someone has a moment, may you review: https://review.openstack.org/#/c/450896/ It's been open for about 20 days.16:00
*** ig0r_ has quit IRC16:01
*** liverpooler has quit IRC16:01
*** newmember has joined #openstack-cinder16:03
*** liverpooler has joined #openstack-cinder16:03
*** esker has quit IRC16:05
*** dave-mccowan has quit IRC16:06
*** david-lyle has joined #openstack-cinder16:07
*** vivsoni_ has joined #openstack-cinder16:07
*** vivsoni has quit IRC16:07
*** isaacb has quit IRC16:08
*** zhurong has quit IRC16:11
*** dikonoor has joined #openstack-cinder16:12
*** alonma has joined #openstack-cinder16:13
*** alonma has quit IRC16:19
*** dave-mccowan has joined #openstack-cinder16:21
*** Julien-zte has quit IRC16:22
*** newmember has quit IRC16:22
*** Julien-zte has joined #openstack-cinder16:22
*** dave-mcc_ has joined #openstack-cinder16:23
*** Julien-zte has quit IRC16:23
*** newmember has joined #openstack-cinder16:23
openstackgerritOpenStack Proposal Bot proposed openstack/os-brick master: Updated from global requirements  https://review.openstack.org/45818716:24
*** Julien-zte has joined #openstack-cinder16:25
*** dave-mccowan has quit IRC16:26
openstackgerritMerged openstack/cinder-specs master: Explicit user messages  https://review.openstack.org/45176116:27
*** ngupta has quit IRC16:27
*** tesseract has quit IRC16:34
*** alonma has joined #openstack-cinder16:42
*** lucasxu has quit IRC16:44
openstackgerritMerged openstack/cinder-specs master: Replication with More Granularity (Tiramisu)  https://review.openstack.org/22972216:49
*** kfarr has quit IRC16:53
*** lucasxu has joined #openstack-cinder16:55
*** newmember has quit IRC16:56
openstackgerritMerged openstack/cinder-specs master: Capacity-based QoS  https://review.openstack.org/45156516:56
*** hemna is now known as willynilly16:59
*** willynilly is now known as hemna16:59
*** liverpooler has quit IRC17:03
*** mvk has quit IRC17:03
smcginniseharney: Did you see the ceph gate job is borked?17:04
*** liverpooler has joined #openstack-cinder17:06
geguileosmcginnis: I think jbernard is working on the ceph gate17:10
smcginnisgeguileo: Oh good. Hadn't noticed until this morning.17:11
smcginnisLooks like hopefully a simple job configuration issue.17:11
geguileosmcginnis: I believe he's working right now on some regex that will work for tempest tests as well as the project specific ones17:11
*** david-lyle_ has joined #openstack-cinder17:17
*** david-lyle has quit IRC17:17
openstackgerritMerged openstack/cinder-specs master: Use 'LIKE' operator to filter some resource  https://review.openstack.org/44298217:21
*** david-lyle_ has quit IRC17:23
*** alonma has quit IRC17:25
*** mvk has joined #openstack-cinder17:25
*** Apoorva has joined #openstack-cinder17:28
*** ig0r_ has joined #openstack-cinder17:29
*** salv-orl_ has quit IRC17:44
*** salv-orlando has joined #openstack-cinder17:44
*** lamt has quit IRC17:49
chhavismcginnis: Have a query on os-brick, While trying to get the HBA channel and scsi target17:51
chhavihttps://github.com/openstack/os-brick/blob/master/os_brick/initiator/linuxfc.py#L5217:51
jungleboyjsmcginnis:  Is traveling right now.  hemna  ^^17:52
hemnasup17:52
chhavigrep is performed on the fc_host node_name, fc_transport sysfs contains the storage target ports,17:52
*** shyama has quit IRC17:53
chhavii think it should look for target_wwn instead of fc_host node name17:53
*** e0ne has quit IRC17:53
hemnachhavi, this has worked forever17:54
hemnaI'm not sure what you are getting at17:54
*** shyama has joined #openstack-cinder17:54
chhavihttps://github.com/openstack/os-brick/blob/master/os_brick/initiator/linuxfc.py#L5217:54
chhavii am talking about this part of code17:54
hemnaok, this has been in there for ages and works17:55
chhavithis is currently not returning any clt, i always return empty,17:55
*** dillaman has quit IRC17:56
hemnaare your HBA's online ?17:56
chhavithere are 2 changes needed, one for looking the correct wwn, and second it should use grep -l , instead of grep17:56
chhaviyes17:56
hemnaif the /sys/class/fc_transport/target* isn't there, then you have other problems17:56
chhavii can see all the data returned properly by sysfs and the filepaths exist,17:57
chhavihemna: shall i open a bug, so i can put some more details there,18:03
chhavithere are no test cases written for this code path, so i don't think its tested.18:04
hemnathat's fine, but this has been in place since the beginning and works18:04
hemnaI think you need to check out why it's not on your host.18:04
chhaviits working because of the default values18:04
hemnaif that didn't work, FC wouldn't work for anyone18:04
chhaviif the match is not found, default clts are considered, so its not breaking because rescan still happens [-, -]18:05
*** salv-orlando has quit IRC18:06
*** alonma has joined #openstack-cinder18:10
*** dillaman has joined #openstack-cinder18:12
*** ChubYann has joined #openstack-cinder18:26
*** monjoshi has quit IRC18:30
*** lamt has joined #openstack-cinder18:31
*** jerrygb has quit IRC18:39
*** lucasxu has quit IRC18:44
*** lucasxu has joined #openstack-cinder18:44
*** dikonoor has quit IRC18:45
*** viks has joined #openstack-cinder18:49
openstackgerritMerged openstack/cinder master: Add IOPS limits that scale per-GB  https://review.openstack.org/44712718:50
*** jerrygb has joined #openstack-cinder18:51
chhavihemna:https://bugs.launchpad.net/cinder/+bug/168499618:57
openstackLaunchpad bug 1684996 in Cinder "os-brick _get_hba_channel_scsi_target always return empty" [Undecided,New]18:57
chhaviopened a bug, u can check the details there.18:58
*** lucasxu has quit IRC19:00
*** lucasxu has joined #openstack-cinder19:01
*** chhavi has quit IRC19:02
*** lucasxu has quit IRC19:04
*** lucasxu has joined #openstack-cinder19:04
*** lucasxu has quit IRC19:04
*** jerrygb has quit IRC19:07
*** e0ne has joined #openstack-cinder19:08
*** shyama has quit IRC19:10
iceycould I get more review or workflow on https://review.openstack.org/#/c/453072/ when people have a moment :)19:10
*** zhonghua2 has quit IRC19:22
*** zhonghua has joined #openstack-cinder19:23
*** newmember has joined #openstack-cinder19:23
*** newmember has quit IRC19:27
*** newmember has joined #openstack-cinder19:28
*** felipemonteiro has quit IRC19:33
*** david-lyle has joined #openstack-cinder19:33
*** newmember has quit IRC19:34
*** newmember has joined #openstack-cinder19:35
*** jerrygb has joined #openstack-cinder19:36
*** salv-orlando has joined #openstack-cinder19:41
*** cebruns has quit IRC19:46
*** cebruns has joined #openstack-cinder19:48
*** e0ne has quit IRC19:54
*** salv-orlando has quit IRC20:01
openstackgerritEric Harney proposed openstack/cinder master: NFS: Fix nas_secure auto mode permissions failure  https://review.openstack.org/45864520:02
*** eharney has quit IRC20:08
*** salv-orlando has joined #openstack-cinder20:09
*** porrua has quit IRC20:13
*** liverpooler has quit IRC20:16
*** lkuchlan has quit IRC20:24
*** felipemonteiro has joined #openstack-cinder20:28
elurkkiFound out that linux-iscsi looses its target configuration in boot when the disk provided for cinder is located in other machine (over iscsi), so there are volume groip inside volume group. Is there some way to keep the iscsi target configuration over hw reboot or should I create some mechanism to save the target configuration every time new virtual macjine is created? Thanks a lot for tips20:34
*** kaisers_ has quit IRC20:35
*** dustins has quit IRC20:37
smcginniselurkki: So you're using the LVM backend, and if you reboot the node it's no longer exposing the volumes?20:37
*** alonma has quit IRC20:39
*** cknight has joined #openstack-cinder20:47
openstackgerritMerged openstack/os-brick master: Include identity information in rbd commands  https://review.openstack.org/45307220:47
*** edmondsw has quit IRC20:51
*** edmondsw has joined #openstack-cinder20:51
*** edmondsw has quit IRC20:56
*** david-lyle has quit IRC20:57
*** jdurgin has quit IRC21:03
imacdonnsmcginnis: re https://review.openstack.org/#/c/371199/ , they (ZFSSA team) had a lot of trouble getting their CI back to a functional state .. it seemed like they were really close last week, then it went quiet again :/21:16
smcginnisimacdonn: OK, thanks for the update. Hopefully they work it out soon.21:16
imacdonnyeah, I hope so .. I have two more fixes queued behind that one (not submitted for review yet)21:16
smcginnisimacdonn: You could probably submit them to start getting review feedback.21:17
smcginnisimacdonn: Just wouldn't go anywhere until we get CI results.21:17
imacdonnyeah, I could .. I was kinda hoping to get one all the way through the process before starting any more, so I can learn from my mistakes21:17
smcginnisFair enough. ;)21:18
imacdonnbut at this point, it's been so long that I've gotten most of my mistakes :)21:18
imacdonnforgotten*21:19
smcginnisHah21:19
*** edmondsw has joined #openstack-cinder21:20
*** sdague has quit IRC21:23
*** edmondsw has quit IRC21:25
Apoorvasmcginnis FYI Tintri CI is facing this issue since last week https://bugs.launchpad.net/openstack-devel/+bug/168269221:30
openstackLaunchpad bug 1682692 in OpenStack Development Infrastructure "nova fails with error: 'module' object has no attribute 'VIR_MIGRATE_POSTCOPY' after using libvirt 2.5.0 from UCA" [Undecided,New]21:30
Apoorvasmcginnis there are other CIs affected by this too. like Quobyte, Fujitsu etc21:31
smcginnisApoorva: Thanks for the heads up. Looks like the fix is making slow progress.21:32
Apoorvasmcginnis looks like it. If anyone knows how to fix it through Tempest configuration I can give it a try, I have asked for help on the review as well21:33
*** catintheroof has quit IRC21:34
*** kaisers has joined #openstack-cinder21:35
*** felipemonteiro has quit IRC21:42
*** jonesn has quit IRC21:44
*** salv-orl_ has joined #openstack-cinder21:49
*** salv-orlando has quit IRC21:51
*** gouthamr has quit IRC21:57
*** Apoorva_ has joined #openstack-cinder22:08
*** Apoorva has quit IRC22:11
*** jdurgin has joined #openstack-cinder22:12
*** salv-orl_ has quit IRC22:22
*** salv-orlando has joined #openstack-cinder22:23
*** jdurgin has quit IRC22:25
*** Julien-zte has joined #openstack-cinder22:25
*** jamielennox is now known as jamielennox|away22:25
*** salv-orlando has quit IRC22:27
*** jamielennox|away is now known as jamielennox22:29
*** Apoorva_ has quit IRC22:41
*** Apoorva has joined #openstack-cinder22:41
*** Julien-zte has quit IRC22:42
*** Julien-zte has joined #openstack-cinder22:43
openstackgerritOpenStack Proposal Bot proposed openstack/os-brick master: Updated from global requirements  https://review.openstack.org/45818722:53
*** sdague has joined #openstack-cinder23:06
*** kaisers has quit IRC23:19
*** jdurgin has joined #openstack-cinder23:22
*** gouthamr has joined #openstack-cinder23:34
*** Julien-zte has quit IRC23:36
*** abhi has joined #openstack-cinder23:37
*** markvoelker has quit IRC23:39
*** lamt has quit IRC23:41
*** jerrygb has quit IRC23:45
*** salv-orlando has joined #openstack-cinder23:54
*** yangyapeng has quit IRC23:59
*** yangyapeng has joined #openstack-cinder23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!