Thursday, 2020-02-20

*** dviroel has joined #openstack-cinder00:15
*** jmlowe has quit IRC00:36
*** enriquetaso has joined #openstack-cinder00:50
*** xiaolin has joined #openstack-cinder00:59
openstackgerritMerged openstack/cinder stable/queens: Tell reno to ignore the kilo branch  https://review.opendev.org/70750001:02
*** Xuchu has quit IRC01:26
*** ociuhandu has quit IRC01:27
*** ociuhandu has joined #openstack-cinder01:28
*** ociuhandu has quit IRC01:34
*** enriquetaso has quit IRC02:10
*** dviroel has quit IRC02:30
openstackgerritMerged openstack/cinder master: Create backups via scheduler  https://review.opendev.org/63030502:31
*** openstackstatus has joined #openstack-cinder02:55
*** ChanServ sets mode: +v openstackstatus02:55
*** ociuhandu has joined #openstack-cinder03:11
*** ociuhandu has quit IRC03:16
*** psachin has joined #openstack-cinder03:32
*** ykarel|away is now known as ykarel03:34
*** xiaolin has quit IRC03:54
*** migawa is now known as migawa|lunch|AFK04:10
*** migawa|lunch|AFK is now known as migawa|lunch04:12
*** udesale has joined #openstack-cinder04:20
*** imacdonn has quit IRC04:44
*** imacdonn has joined #openstack-cinder04:45
*** ociuhandu has joined #openstack-cinder05:30
*** ociuhandu has quit IRC05:35
*** Xuchu has joined #openstack-cinder06:01
*** udesale_ has joined #openstack-cinder06:03
*** udesale has quit IRC06:06
*** Lucas_Gray has joined #openstack-cinder06:24
*** Lucas_Gray has quit IRC06:41
*** Lucas_Gray has joined #openstack-cinder06:42
*** zhanglong has joined #openstack-cinder06:51
*** jonasnemeiksis has joined #openstack-cinder07:23
jonasnemeiksisHello!07:25
*** Lucas_Gray has quit IRC07:25
jonasnemeiksisWho can you describe cinder retype? I would like to known background steps. I'm trying retype from emc scaleio to ceph rbd and it works. When I retyping I see emc block device mount on cinder node, but I not see ceph rbd volume mount on cinder node. What's that? How copy data to volume if it not mounted?07:26
*** dpawlik has joined #openstack-cinder07:31
openstackgerritAnkit Kumar proposed openstack/cinder master: DNM Patch : Testing the Cinder CI  https://review.opendev.org/70881407:32
*** zhanglong has quit IRC07:37
*** zhanglong has joined #openstack-cinder07:38
*** ociuhandu has joined #openstack-cinder07:40
*** Lucas_Gray has joined #openstack-cinder07:43
*** ociuhandu has quit IRC07:45
*** zhanglong has quit IRC07:47
*** zhanglong has joined #openstack-cinder07:48
*** ykarel is now known as ykarel|lunch08:01
*** tesseract has joined #openstack-cinder08:05
*** ociuhandu has joined #openstack-cinder08:13
*** ociuhandu has quit IRC08:17
*** ociuhandu has joined #openstack-cinder08:19
*** jcosmao has joined #openstack-cinder08:24
*** tosky has joined #openstack-cinder08:29
*** tesseract has quit IRC08:38
*** tesseract has joined #openstack-cinder08:39
*** ociuhandu has quit IRC08:50
*** brinzhang__ has joined #openstack-cinder08:56
*** ociuhandu has joined #openstack-cinder08:56
*** brinzhang_ has quit IRC08:59
*** Lucas_Gray has quit IRC09:02
*** jonasnemeiksis has quit IRC09:05
*** ykarel|lunch is now known as ykarel09:13
*** n-saito has quit IRC09:19
*** tkajinam has quit IRC09:19
*** zhanglong has quit IRC09:19
*** zhanglong has joined #openstack-cinder09:20
*** mvkr has joined #openstack-cinder09:24
*** brinzhang__ has quit IRC09:29
*** brinzhang__ has joined #openstack-cinder09:29
*** e0ne has joined #openstack-cinder09:33
*** xinliang has joined #openstack-cinder09:43
*** Lucas_Gray has joined #openstack-cinder09:43
*** paddyoneill has joined #openstack-cinder09:54
*** tesseract has quit IRC09:58
*** Lucas_Gray has quit IRC10:03
openstackgerritAnkit Kumar proposed openstack/cinder master: DNM Patch : Testing the Cinder CI  https://review.opendev.org/70881410:09
*** tesseract has joined #openstack-cinder10:11
*** Lucas_Gray has joined #openstack-cinder10:14
*** Wryhder has joined #openstack-cinder10:17
*** Lucas_Gray has quit IRC10:18
*** Wryhder is now known as Lucas_Gray10:19
openstackgerritRajat Dhasmana proposed openstack/cinder stable/train: Support volume transfer `name` filters  https://review.opendev.org/70884510:25
*** zhanglong has quit IRC10:42
*** zhanglong has joined #openstack-cinder10:44
*** vishalmanchanda has joined #openstack-cinder10:49
*** LiangFang has quit IRC11:00
*** Lucas_Gray has quit IRC11:02
*** udesale_ has quit IRC11:03
*** dviroel has joined #openstack-cinder11:14
*** ykarel is now known as ykarel|afk11:24
*** doubletao has joined #openstack-cinder11:34
*** Lucas_Gray has joined #openstack-cinder11:39
*** zhanglong has quit IRC11:42
*** Liang__ has joined #openstack-cinder11:43
*** zhanglong has joined #openstack-cinder11:44
*** lpetrut has joined #openstack-cinder11:50
*** enriquetaso has joined #openstack-cinder12:00
*** Liang__ has quit IRC12:15
*** Liang__ has joined #openstack-cinder12:16
*** jvisser has joined #openstack-cinder12:17
*** jvisser has quit IRC12:26
*** jvisser has joined #openstack-cinder12:27
*** xakaitetoia has joined #openstack-cinder12:32
xakaitetoiaHello team, I have a question. Does cinder-migrate works for rbd backend (ceph) for both attached and detached volumes?12:33
*** zhanglong has quit IRC12:33
*** udesale has joined #openstack-cinder12:34
*** jvisser has quit IRC12:47
*** jvisser has joined #openstack-cinder12:49
*** psachin has quit IRC12:49
*** mriosfer has joined #openstack-cinder12:50
openstackgerritMerged openstack/cinder-specs master: Support volume local cache  https://review.opendev.org/68455612:55
rosmaitaLiang__: ^^12:56
mriosferHi, we're at Openstack Queens, running fine since 2 yrs. Today i found that cinder services for ceph are enabled + down in the controller . I connected and check ceph -s etc.. and get a report from ceph cluster. Glance running in the same ceph storage is running fine just uploaded a new image without problem. I checked time diference between controller and ceph and is less than 1 sec12:59
mriosferdiference. Im getting out of ideas13:00
*** jvisser has quit IRC13:00
*** jvisser has joined #openstack-cinder13:00
*** jvisser has quit IRC13:01
*** jvisser has joined #openstack-cinder13:01
xakaitetoiasystemctl status cinder-volume , cinder-scheduler, cinder-api etc .. What are the logs saying in the controller13:01
*** jonasnemeiksis has joined #openstack-cinder13:04
mriosfer"cinder.scheduler.host_manager [req-96ba4efc-6ce6-474a-bd09-6d54f2fbaa30 - - - - -] volume service is down. (host: controller.openstack-easydatahost.local@SSD)"13:05
mriosfersame for ARCHIVE type disk13:05
mriosferbut really nothing more about why13:05
mriosferi restarted all services and the controller to13:05
smcginnismriosfer: There should be something before those down messages started. If you restarted the services, then watch for something to report an issue there.13:06
xakaitetoiadid you change anything on ceph? like pool name etc?13:08
xakaitetoiacause the keys might point to old ceph pools13:09
xakaitetoiaceph auth ls.. and check these keys match what they are on controller13:09
mriosferim upgraded in controller the ceph client from 14.2.1 to 2513:10
mriosfer14.2.7 the lastest13:10
mriosferthats a diference ..13:10
*** martinkennelly has joined #openstack-cinder13:16
xakaitetoiahmm can't think of anything like it, only to check logs i am agfraid13:16
*** jvisser has quit IRC13:18
*** jvisser has joined #openstack-cinder13:18
hemnamorning13:23
*** jvisser has quit IRC13:23
mriosferAnyone see anything wrong? https://pastebin.com/x5q31iQX just moved old logs to create a new ones and restarted services no specials errors apart deprecated13:24
xakaitetoiawhat about cinder stuff13:29
xakaitetoiaAnd btw guys anyone has seen a weird bug with cinder-migrate ? I will probably report it in a bit. We use ceph as backend and if you try to do openstack volume migrate to another cinder-host controller... It deletes the volume from CEPH . It tried to copy itsef in the beginning wit error " 2020-02-20 13:24:44.109 9642 ERROR cinder.volume.drivers.rbd [req-259bb180-f2c2-42f6-8918-7c20a9470f00 b8a9ffc54d074db998cab1013:32
xakaitetoiabd7d4bcbb 21c7e4fd83c5456d977b1e397869ff9c - default default] Error copying rbd image volume-e6357853-d66b-46c6-85b8-876517a1d9ab to target pool cinder-volumes_p02.: rbd.ImageExists: [errno 17] error copying image b'volume-e6357853-d66b-46c6-85b8-876517a1d9ab' to b'volume-e6357853-d66b-46c6-85b8-876517a1d9ab'" and in the end it says doesn't exist13:32
mriosfercheck volume.log https://pastebin.com/Ysrf0wTC   just 30 lines13:33
mriosferno show errors just warnings :S13:33
xakaitetoiawhat about rabbit?13:34
xakaitetoiaand also ntp :)13:34
mriosferntp is ok with less than 1 second between ceph and openstack13:34
mriosferand rabbit looks runing fine hungry as hell with 16gb ram13:35
mriosferin your ceph.conf do you define just the monitors no?13:35
mriosferwith the minimal configuration no?13:35
*** psachin has joined #openstack-cinder13:36
*** Lucas_Gray has quit IRC13:38
xakaitetoiamonitoris yes13:38
xakaitetoiawhat we saw with rabbit and why it's taking a lot of ram is about the workers.. Seems ceilometer configs etc have a lot of workers.. which are not needed13:38
xakaitetoiagenerally try to drop down the workers in your config from original config (workers = total cpu cores x2) you don't need that many workers13:39
mriosferfrom rabbit?13:39
xakaitetoiano from controller node13:40
xakaitetoiafrom various config like nova/ceilometer/gnocchi etc13:40
xakaitetoiaworkers/threads13:41
mriosferhttps://gyazo.com/20fba0f257cb612c91753f775bdab32213:42
mriosferwhere i can take information about @ceph-archive with status up?13:42
mriosferok im retard13:44
mriosferenabled_backends=ceph,ceph-archive13:44
mriosferi need to cleanup that cinder services13:45
mriosferand deleted the olders like archives/archive SSD13:45
xakaitetoiaglad you were able to find it ;)13:46
mriosferits possible rename @ceph to @SSD once deleted old records?13:47
*** jmlowe has joined #openstack-cinder13:49
*** ociuhandu has quit IRC13:50
xakaitetoiai believe there are some cinder commands to remove backends13:51
mriosferyes just found13:51
mriosfercinder-manage service remove cinder-volume  <binary> <host>13:52
xakaitetoiacheers13:55
*** Liang__ is now known as LiangFang13:56
*** ociuhandu has joined #openstack-cinder13:58
*** jvisser has joined #openstack-cinder14:00
mriosfer xakaitetoia & @smcginnis thanks for your amazing help and time now looks im able to create volumes again in ceph without problem :)14:02
smcginnis\o/14:02
*** ociuhandu has quit IRC14:02
mriosferPD: im not sure about what happened14:02
mriosferjust another question did you disable from loggin warnings like "WARNING cinder.quota [req-d70a4fa8-5a6d-4152-bd72-69060632b9d4 421b5fa2544547eb8ff7b337f245a477 cade050c137142afa082e98c8e99cb4a - default default] Deprecated: Default quota for resource: volumes_ARCHIVE is set by the default quota flag: quota_volumes_ARCHIVE, it is now deprecated. Please use the default quota class for14:04
mriosferdefault quota.14:04
mriosfer"14:04
xakaitetoianope haven't change that14:04
openstackgerritSofia Enriquez proposed openstack/cinder master: WIP: NFS encrypted volume support  https://review.opendev.org/59714814:07
*** eharney has joined #openstack-cinder14:21
*** ykarel|afk is now known as ykarel14:23
*** spatel has joined #openstack-cinder14:26
*** ociuhandu has joined #openstack-cinder14:29
*** spatel has quit IRC14:31
*** jc_ has joined #openstack-cinder14:45
*** dave-mccowan has joined #openstack-cinder14:51
*** efried has joined #openstack-cinder14:54
efriedrosmaita: does https://blueprints.launchpad.net/cinder/+spec/support-volume-local-cache need to be marked approved?14:54
rosmaitaefried: i actually don't know14:55
rosmaitathe spec has been merged, which is the key thing14:55
smcginnisefried, rosmaita: I would occasionally go through and mark those approved when I was PTL, but it was always unclear to me how worth my time it was to try to reflect all those things in Launchpad.14:56
efriedyeah, I personally don't attach a lot of value to that paperwork, but some do. No skin off my nose, just thought I would mention it :)14:57
smcginnisHonestly, BPs in general can probably just go away, but I did hear from at least one person that they looked at those to try to see what the roadmap looked like.14:57
smcginnisThat was quite awhile ago now though.14:57
efriedI agree they seem unnecessary14:57
*** andrebeltrami has joined #openstack-cinder14:57
efriedbut have heard the same thing14:57
rosmaitawhat's the difference between "direction" and "definition"?14:57
rosmaitaor should i just make them both "approved"14:58
*** abishop has joined #openstack-cinder14:59
smcginnisI think that's what I did.14:59
rosmaitasounds good15:00
rosmaitaefried: updated the bp15:00
efriedrosmaita: I made an attempt this cycle to distinguish15:01
efriedDefinition:Approved => Spec is merged; if we're gonna do it, we've agreed on the "how".15:01
efriedDirection:Approved => We actually commit to doing this in the release marked on the bp.15:01
efriedbut was shot down.15:01
rosmaita:)15:03
openstackgerritMerged openstack/cinder stable/stein: PowerMax Docs -  corrections and improvements  https://review.opendev.org/70795215:06
*** jdillaman has joined #openstack-cinder15:20
*** lpetrut has quit IRC15:20
*** psachin has quit IRC15:22
xakaitetoiaJust reported this bug https://bugs.launchpad.net/cinder/+bug/1864058 - Let me know if anyone has experienced anything similar15:30
openstackLaunchpad bug 1864058 in Cinder "openstack volume migrate with ceph rbd backend fails and deleted the volume in ceph" [Undecided,New]15:30
xakaitetoiawow.. nice timing15:30
mriosferxakaitetoia : how is going train release? we need to move out Queens asap, maybe to Rocky or Train15:43
xakaitetoiaall is good so far15:54
xakaitetoiai love vpnaas and octavia (lbaas) Works really good15:54
xakaitetoianeed to check some things on spare amphoraas and also the rotate certificate stuff15:54
smcginnisjungleboyj: Do you have some time to rebase and fix merged conflicts on https://review.opendev.org/#/c/703157/15:58
jungleboyjSure.  Though with the new policy do I want to actually remove that?15:58
jungleboyjI had looked at that yesterday and that was why I didn't proceed.15:59
jungleboyjrosmaita: ^^15:59
rosmaitalooking15:59
smcginnisI think so. Isn't that one that they had actually asked be removed?15:59
smcginnisOr am I thinking of a different one?15:59
rosmaitano, that's the one16:00
rosmaitawell, with the new policy it's up to us whether we want to keep it around until tests start failing, or remove it now16:00
jungleboyjYeah.16:01
jungleboyjOn that one I have already heard that the driver can't be run in a container.16:01
rosmaitaso, the question remains, do we want to remove it16:01
smcginnisAlso, should we revert the removals of the other drivers now?16:02
rosmaitawe should probably go through them on a case-by-case basis16:02
rosmaitaeither at the virtual mid-cycle16:02
rosmaitaor we could just have a short videoconf just on this16:02
smcginnisMidcycle is probably good.16:03
smcginnisOr even mailing list discussion to make sure it's out there.16:03
jungleboyjLets discuss at the mid-cycle and then take decisions to the mailing list for trasparency.16:04
rosmaitayeah, i could put out an email saying we're considering this, please respond if you are interested in a driver being around longer16:04
rosmaitamid-cycle is roughly 1 month away, though16:04
jungleboyjrosmaita:  That would be a good starting point.16:04
rosmaitawell, 3 weeks16:04
rosmaitaok, i will draft something and run it by the two of you before sending it out16:05
*** ykarel is now known as ykarel|afk16:05
rosmaitaunless someone else wants to draft it :)16:05
rosmaitaanyway, doesn't seem to be an immediate rush -- i can get something together by monday afternoon16:06
jungleboyjOh weird.16:06
jungleboyjJust got an e-mail from kolla-ansible asking about it.16:06
jungleboyjJust forwarded you the e-mail.16:07
rosmaitaok, thanks16:08
*** brinzhang__ has quit IRC16:08
*** brinzhang__ has joined #openstack-cinder16:08
*** brinzhang__ has quit IRC16:09
rosmaitajungleboyj: could you reply to him saying we haven't decided yet, but will have an update to the ML early next week16:10
jungleboyjYep.16:11
*** brinzhang has joined #openstack-cinder16:11
rosmaitabbiab -- coffee emergency16:12
*** brinzhang has quit IRC16:12
jungleboyj:-)  Hopefully that just means that you need to get more coffee.  Not something like the coffee pot is on fire.  :-)16:12
*** brinzhang has joined #openstack-cinder16:12
jungleboyjhttps://gph.is/1ffbqu516:13
*** brinzhang has quit IRC16:13
*** brinzhang has joined #openstack-cinder16:14
*** mriosfer has quit IRC16:15
rosmaitayeah, only a metaphorical fire -- the emergency is trying to handle both inputs and outputs in a short time frame16:24
rosmaitaif you know what i mean16:24
jungleboyj*Laughing*16:24
jungleboyjhttps://gph.is/2JBTDie16:25
*** brinzhang has quit IRC16:26
*** brinzhang has joined #openstack-cinder16:27
openstackgerritSofia Enriquez proposed openstack/cinder master: WIP Cinder backup export broken  https://review.opendev.org/70890816:28
*** brinzhang has quit IRC16:28
*** brinzhang has joined #openstack-cinder16:29
jonasnemeiksisWho can help with retype background in rbd side? I would like to know how works drivers,etc..16:29
jungleboyjjonasnemeiksis:  Hey.  Welcome!16:34
openstackgerritMerged openstack/cinder stable/train: NEC driver: fix migrate/retype an in-use volume  https://review.opendev.org/70854016:34
jungleboyjjonasnemeiksis:  Best if chat out here so our rbd experts can answer the question.16:36
jungleboyjSo, the way that retype happens depends on each driver.16:37
jungleboyjSome drivers need to mount the volume and do a 'dd' out of one storage backend to another.16:37
jungleboyjIn the case of the rbd driver I am guessing the reason you never see anything mounted is that they are using rbd directly to create the volume.16:38
jonasnemeiksis I'm trying retype from emc scaleio to ceph rbd and it works. When I retyping I see emc block device mount on cinder node, but I not see ceph rbd volume mount on cinder node. What's that? How copy data to volume if it not mounted?  I not see rbd devides /dev/rbd*16:38
jungleboyjeharney: might be able to explain better16:38
eharneythe rbd driver doesn't mount an rbd device on the host for this case16:39
jonasnemeiksisAlways use dd?16:39
jungleboyjNo.  Depends on the driver.16:39
jonasnemeiksisBut how it works if not mount?16:40
eharneyin this case we actually open the rbd volume remotely via librbd from cinder (via os-brick) and do I/O there16:41
eharneyso there is no block device attached on the host for rbd16:41
jungleboyjeharney: Assuming that is more efficient and secure.16:41
eharneyjungleboyj: yeah, it means we can avoid relying on the kernel rbd client which makes some things easier16:43
jungleboyj++16:43
openstackgerritMerged openstack/cinder stable/train: Configurable timeout of the QEMU img conversion  https://review.opendev.org/70730516:43
jonasnemeiksisinteresting. Could I see source code how data copy to rbd volume?16:44
*** ociuhandu has quit IRC16:44
jungleboyjIt is an OpenSource project.  :-)16:45
eharneyjonasnemeiksis: https://opendev.org/openstack/os-brick/src/branch/master/os_brick/initiator/linuxrbd.py16:45
eharneyRBDClient() there creates a client, RBDVolumeIOWrapper() handles the I/O part of it16:46
jonasnemeiksisThank you!16:46
*** ociuhandu has joined #openstack-cinder16:46
jungleboyjeharney:  Thank you!16:47
eharneyCinder gets to that code via the RBD connector in https://opendev.org/openstack/os-brick/src/branch/master/os_brick/initiator/connectors/rbd.py16:47
jungleboyjFigured you could help pretty quickly.16:47
*** ociuhandu has quit IRC16:52
*** brinzhang has quit IRC16:54
*** brinzhang has joined #openstack-cinder16:55
*** brinzhang has quit IRC16:57
*** brinzhang has joined #openstack-cinder16:58
*** brinzhang has quit IRC16:59
*** tesseract has quit IRC17:00
*** brinzhang has joined #openstack-cinder17:01
*** brinzhang has quit IRC17:01
*** e0ne has quit IRC17:05
*** abishop has quit IRC17:06
*** ociuhandu has joined #openstack-cinder17:12
openstackgerritMerged openstack/cinder master: VMware: Implement clone_image  https://review.opendev.org/66257917:22
openstackgerritMerged openstack/cinder master: Fix an issue in storwize unit test case  https://review.opendev.org/70037517:22
openstackgerritChris Krelle proposed openstack/cinder master: Tegile Driver  https://review.opendev.org/70727517:26
*** udesale has quit IRC17:33
openstackgerritChris Krelle proposed openstack/cinder master: Tegile Driver  https://review.opendev.org/70727517:40
*** ociuhandu_ has joined #openstack-cinder18:00
*** ociuhandu has quit IRC18:04
*** ociuhandu_ has quit IRC18:05
*** e0ne has joined #openstack-cinder18:33
*** ykarel|afk is now known as ykarel|away18:34
*** e0ne has quit IRC18:53
*** andrebeltrami has quit IRC18:57
openstackgerritSofia Enriquez proposed openstack/cinder master: Cinder backup export broken  https://review.opendev.org/70890818:58
*** mvkr has quit IRC19:01
*** brinzhang has joined #openstack-cinder19:03
*** e0ne has joined #openstack-cinder19:15
*** e0ne has quit IRC19:15
*** jonasnemeiksis has quit IRC19:21
*** pcaruana has quit IRC19:32
*** martinkennelly has quit IRC20:10
*** penick has joined #openstack-cinder20:27
*** eharney has quit IRC20:30
*** e0ne has joined #openstack-cinder20:43
*** jvisser has quit IRC20:53
*** jmlowe has quit IRC21:03
*** Lucas_Gray has joined #openstack-cinder21:03
*** Lucas_Gray has quit IRC21:03
*** vishalmanchanda has quit IRC21:06
*** brinzhang_ has joined #openstack-cinder21:13
*** brinzhang has quit IRC21:15
*** jvisser has joined #openstack-cinder21:25
*** eharney has joined #openstack-cinder21:29
*** enriquetaso has quit IRC21:33
*** jmlowe has joined #openstack-cinder21:50
*** xakaitetoia has quit IRC22:04
*** e0ne has quit IRC22:04
*** spatel has joined #openstack-cinder22:08
openstackgerritLuigi Toscano proposed openstack/cinder-tempest-plugin master: Update cinder-tempest-plugin-lvm-lio (revamp)  https://review.opendev.org/67280422:11
openstackgerritLuigi Toscano proposed openstack/cinder-tempest-plugin master: Enable volume_revert tests  https://review.opendev.org/69729122:11
*** jmlowe has quit IRC22:12
*** spatel has quit IRC22:12
*** jvisser has quit IRC22:22
*** penick has quit IRC22:22
*** dviroel has quit IRC22:24
*** dpawlik has quit IRC22:33
*** jmlowe has joined #openstack-cinder22:46
*** jmlowe has quit IRC22:55
*** tkajinam has joined #openstack-cinder22:58
*** enriquetaso has joined #openstack-cinder22:59
*** brinzhang_ has quit IRC22:59
*** brinzhang_ has joined #openstack-cinder23:00
*** jmlowe has joined #openstack-cinder23:02
*** jmlowe has quit IRC23:09
*** ociuhandu has joined #openstack-cinder23:16
*** N3l1x has quit IRC23:20
*** ociuhandu has quit IRC23:22
*** eharney has quit IRC23:30
*** spatel has joined #openstack-cinder23:32
*** spatel has quit IRC23:37
*** n-saito has joined #openstack-cinder23:49
*** dave-mccowan has quit IRC23:51
*** dave-mccowan has joined #openstack-cinder23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!