Thursday, 2015-01-08

*** takedakn has joined #openstack-cinder00:00
*** chlong has quit IRC00:01
*** chlong has joined #openstack-cinder00:02
*** takedakn has quit IRC00:03
*** takedakn has joined #openstack-cinder00:03
*** fischerw has quit IRC00:04
*** chlong has quit IRC00:06
openstackgerritJohn Griffith proposed openstack/cinder: Implement clone_image caching on SolidFire  https://review.openstack.org/14285900:18
*** jaypipes has quit IRC00:18
*** jungleboyj has joined #openstack-cinder00:18
*** Masahiro has joined #openstack-cinder00:20
thingeejgriffith: hey so I stated looking at some of the stub issues from the unit tests that are failing with cinder objects.00:22
*** scottda_ has quit IRC00:23
thingeejgriffith: I noticed the first set of tests failing are using the stubs from cinder.tests.api.v2.stubs00:23
thingeewhich is somewhat good, because it's using shared fixtures00:23
jungleboyjthingee: jgriffith smcginnis hemna Here is the fix for the _lazy in stable/juno:  https://review.openstack.org/14564200:23
thingeejust they need to be improved00:23
*** Masahiro has quit IRC00:24
openstackgerritJohn Griffith proposed openstack/cinder: Fix drbd driver to load without 3'rd party libs  https://review.openstack.org/14564400:25
*** IanGovett has quit IRC00:27
thingeejungleboyj: thanks, lgtm once jenkins signs off00:28
*** chlong has joined #openstack-cinder00:29
jungleboyjthingee: Thank you!00:31
thingeejungleboyj: https://review.openstack.org/#/c/145613/00:31
thingeejungleboyj: http://paste.openstack.org/raw/155906/00:32
vishythingee, jgriffith so it turns out the allocated space code is pretty broken00:32
vishyallocated_capacity_gb for scheduling00:32
jungleboyjI saw you pushed that up thingee Let me look here.00:33
vishyit is tracked in the manager but if volume creation fails in the driver it doesn’t add to the allocated_capacity00:33
vishybut it deletes it when you delete the volume00:33
*** smoriya has joined #openstack-cinder00:34
*** takedakn has quit IRC00:34
jungleboyjthingee: Hmmm, that is pretty simple.00:35
thingeejungleboyj: suspicious00:36
jungleboyjthingee: suspicious?00:36
thingeeyeah simple code, probably something is wrong00:36
thingeemy manual testing seems to disagree, but wanted other eyes on it00:36
jungleboyjthingee: No, not at all.00:36
*** annashen has joined #openstack-cinder00:37
*** bswartz has joined #openstack-cinder00:37
thingeevishy: interesting00:37
jungleboyjMy eyes on it are probably not the best as the client and session code are all a mystery to me.00:37
jungleboyjMy only concern is what if _get_project returns None.  What heppsn then?00:38
*** Mandell has quit IRC00:38
thingeejungleboyj: so I was talking with jamielennox about that. My understanding was that happens if a keystone plugin doesn't implement that. But apparently most are based off identity.00:39
thingeeso it shouldn't be a problem, but a valid concern00:39
thingeemost = all?00:39
thingeeI dunno.00:39
* jungleboyj really needs to figure out the keystone stuff.00:39
openstackgerritJohn Griffith proposed openstack/cinder: Deal with tgt already exists errors  https://review.openstack.org/14560800:40
jgriffithvishy: son of a....00:41
jgriffithvishy: so it's broken for a number of other reasons, but that one isn't one that I had on the list00:41
vishyjgriffith: also in the icehouse code it doesn’t count available volumes to the total00:42
jamielennoxthingee: is that running, you have def _get_project(self) and self._get_project_id()00:42
vishybut that has been fixed00:42
thingeejamielennox: ha, apparently.00:43
jgriffithvishy: I'll spend some time going through tomorrow and logging bugs/fixing as I go00:43
thingeejamielennox: I don't know how00:43
jgriffithvishy: unless you're already doing that :)00:43
vishyjgriffith: thing is i’m not quite sure how to fix it00:43
jamielennoxmy thought would be if there is no project_id returned then just don't try and append anything00:43
jgriffithvishy: might not be able to, that's what we've been fighting about for a year now00:43
*** km has quit IRC00:43
vishythe problem is if the driver errors is the space used or not?00:44
vishyit seems like the driver should be reporting this data00:44
jgriffithvishy: yeah, and if we fix the stats reporting they will00:44
jgriffithvishy: so what I'm thinking is just brute force the change rather than waiting for everybody to agree00:44
jgriffithvishy: in other words, go purely from stats reported back to mgr from driver00:45
vishyjgriffith: i was thinking you could gust get it from the driver but default it to total - free if it isn’t set00:45
jgriffithvishy: we already rely on that soley for scheduler (or should)00:45
jamielennoxthingee: what i'd love is that for every path in v2 with a URL containing the project_id you validate that project_id in URL == project_id in token then redirect the call to the same url without the project_id00:45
vishybut that doesn’t work for those drivers that are passing back total as ‘unknown'00:45
jamielennoxthingee: a path to removing the project_id from cinder calls altogether00:45
jamielennoxs/calls/urls00:45
vishymaybe it is just ‘unknown’ for those drivers?00:45
*** scottda_ has joined #openstack-cinder00:46
thingeejamielennox: k00:46
jgriffithvishy: so maybe that's a good motivation actually.00:46
jamielennoxbig job, small pay off short term00:47
jgriffithvishy: if you report unknown or inf we'll use the crappy internal guessing00:47
jgriffithso it's in your best interest to fix it00:47
jgriffithvishy: you around tomorrow?00:47
jungleboyjthingee: The paste link you have doesn't work.00:51
*** scottda_ has quit IRC00:52
thingeeyeah I think there might be something wrong with paste...it was working earlier00:52
jungleboyjOk.  Weird.00:53
vishyjgriffith: probably00:55
*** Mandell has joined #openstack-cinder00:56
*** annashen has quit IRC00:58
*** dank has quit IRC01:04
*** alexpilotti has quit IRC01:08
jungleboyjjgriffith: Good point on the _lazy review.  I need to drop off agian but I will fix that up a little later and push another patch.01:08
*** jdurgin has quit IRC01:09
openstackgerritwanghao proposed openstack/cinder: Implement function of import/export snapshots  https://review.openstack.org/14459001:15
*** jungleboyj has quit IRC01:15
*** scottda_ has joined #openstack-cinder01:18
*** ebalduf has quit IRC01:19
openstackgerritMitsuhiro Tanino proposed openstack/cinder: Remove unused variables from ensure_export()  https://review.openstack.org/14538101:20
*** scottda_ has quit IRC01:20
*** tsekiyam_ has joined #openstack-cinder01:23
mudassirlatifhey jgriffith, can you please approve this (again) https://review.openstack.org/#/c/145386/ …. I had approval from you and workflow +1 from someone else but had to rebase because of the oslo _lazy bug. It’s a easy to examine change regarding i18n fixes01:24
*** tsekiyama has quit IRC01:26
openstackgerritAnthony Lee proposed openstack/cinder: Fixed server name being retained after detach in LeftHand  https://review.openstack.org/12414501:27
openstackgerritAnthony Lee proposed openstack/cinder: Remove locks from LeftHand driver  https://review.openstack.org/14147501:28
*** tsekiyam_ has quit IRC01:28
*** mtanino has quit IRC01:28
openstackgerritJohn Griffith proposed openstack/cinder: Use cinder.utils.execute directly  https://review.openstack.org/14563001:29
*** zhithuang has joined #openstack-cinder01:31
*** zhithuang is now known as winston-d_01:31
*** leeantho has quit IRC01:33
thingeewinston-d_: ping01:41
*** nosnos has joined #openstack-cinder01:54
*** thingee has quit IRC01:57
*** Mandell has quit IRC02:02
*** elazro has quit IRC02:06
*** elazro has joined #openstack-cinder02:06
*** ryanpetrello has quit IRC02:08
*** haomaiwang has joined #openstack-cinder02:08
*** Masahiro has joined #openstack-cinder02:09
*** _cjones_ has quit IRC02:11
*** chlong has quit IRC02:11
*** ebalduf has joined #openstack-cinder02:14
*** winston-d_ has quit IRC02:15
*** winston-d_ has joined #openstack-cinder02:15
*** julim has joined #openstack-cinder02:16
*** ebalduf has quit IRC02:21
*** ebalduf has joined #openstack-cinder02:24
*** Mandell has joined #openstack-cinder02:27
openstackgerritOpenStack Proposal Bot proposed openstack/cinder: Updated from global requirements  https://review.openstack.org/14566102:28
*** ebalduf has quit IRC02:28
*** winston-d_ has quit IRC02:31
*** thingee has joined #openstack-cinder02:34
openstackgerritMudassir Latif proposed openstack/cinder: Add replication and PG setup methods on PureISCSIDriver  https://review.openstack.org/14509002:36
*** ling-yun-1 has joined #openstack-cinder02:37
*** zengyunling__ has joined #openstack-cinder02:39
*** winston-d_ has joined #openstack-cinder02:39
*** ling-yun has quit IRC02:40
*** kaisers has joined #openstack-cinder02:41
*** fandi has quit IRC02:42
*** ling-yun-1 has quit IRC02:42
thingeewinston-d_: ping02:42
*** mberlin1 has joined #openstack-cinder02:43
*** mberlin has quit IRC02:43
*** kaisers1 has quit IRC02:44
openstackgerritThang Pham proposed openstack/cinder: WIP: Cinder objects base  https://review.openstack.org/13187302:44
openstackgerritThang Pham proposed openstack/cinder: WIP: Snapshot object  https://review.openstack.org/13356602:45
*** winston-d_ has quit IRC02:46
*** Mandell has quit IRC02:48
*** winston-d_ has joined #openstack-cinder02:52
winston-d_thingee: pong02:53
*** ryanpetrello has joined #openstack-cinder02:53
winston-d_thingee: sorry i am having a bad internet connection today.02:53
*** annashen has joined #openstack-cinder02:56
thingeewinston-d_: heh seems like a trend today :)03:00
thingeeso not sure if you saw vishy's earlier comments03:00
thingeein #openstack-cinder03:00
winston-d_thingee: I didn't. what is it?03:02
thingeewinston-d_: allocated_capacity_gb code for the scheduler appears to be broken. Since it's tracked in the manager, if the volume creation fails in the driver, it doesn't add the allocated_capacity.03:02
*** Mandell has joined #openstack-cinder03:02
winston-d_thingee: is there a bug?03:02
thingeewinston-d_: convo is here http://eavesdrop.openstack.org/irclogs/%23openstack-cinder/%23openstack-cinder.2015-01-08.log03:03
*** lcurtis has joined #openstack-cinder03:03
thingeewinston-d_: search for timestamp '2015-01-08T00:32:24'03:03
winston-d_thingee: can't believe that I didn't know that we have log in cinder channel now!03:04
winston-d_thingee: looking, thx.03:04
thingeewinston-d_: oh yeah, pretty recently turned on.03:05
*** winston-d_ has quit IRC03:11
*** winston-d_ has joined #openstack-cinder03:13
*** Mandell has quit IRC03:16
*** scottda_ has joined #openstack-cinder03:18
*** mudassirlatif has quit IRC03:20
*** patrickeast has quit IRC03:20
openstackgerritAlan Jiang proposed openstack/cinder: rbd calls block eventlet threads  https://review.openstack.org/14567803:21
*** bill_az has quit IRC03:22
*** ebalduf has joined #openstack-cinder03:25
*** Mandell has joined #openstack-cinder03:27
*** scottda_ has quit IRC03:29
*** ebalduf has quit IRC03:30
*** scottda_ has joined #openstack-cinder03:36
*** nosnos has quit IRC03:43
*** ryanpetrello has quit IRC03:49
*** _cjones_ has joined #openstack-cinder03:54
*** _cjones_ has joined #openstack-cinder03:54
*** ebalduf has joined #openstack-cinder03:55
*** annashen has quit IRC03:55
*** chlong has joined #openstack-cinder03:57
*** k_ has joined #openstack-cinder03:59
*** bkopilov has quit IRC04:01
*** chlong has quit IRC04:02
*** jungleboyj has joined #openstack-cinder04:09
openstackgerritJohn Griffith proposed openstack/cinder: Use cinder.utils.execute directly  https://review.openstack.org/14563004:10
thingeejgriffith: you around?04:17
*** chlong has joined #openstack-cinder04:18
*** _cjones_ has quit IRC04:20
*** fandi has joined #openstack-cinder04:22
*** fandi has quit IRC04:23
*** fandi has joined #openstack-cinder04:24
*** fandi has quit IRC04:24
*** fandi has joined #openstack-cinder04:26
*** annashen has joined #openstack-cinder04:28
*** scottda_ has quit IRC04:30
openstackgerritMike Perez proposed openstack/python-cinderclient: Remove unused service catalog module  https://review.openstack.org/14568604:35
*** nosnos has joined #openstack-cinder04:36
*** ebalduf has quit IRC04:39
*** lcurtis has quit IRC04:39
*** annashen has quit IRC04:42
*** ebalduf has joined #openstack-cinder04:42
*** rakesh_ has joined #openstack-cinder04:45
*** rakesh_ is now known as Guest4553204:45
*** Longgeek has joined #openstack-cinder04:45
Guest45532rakesh_mishra51004:46
*** Guest45532 is now known as rakesh_mishra04:46
*** ebalduf has quit IRC04:47
*** david-lyle has quit IRC04:50
*** winston-d_ has quit IRC04:51
*** dannywilson has quit IRC04:51
*** annashen has joined #openstack-cinder05:00
*** winston-d_ has joined #openstack-cinder05:05
*** anshul has joined #openstack-cinder05:06
*** annashen has quit IRC05:10
*** _cjones_ has joined #openstack-cinder05:12
*** winston-d_ has quit IRC05:14
*** winston-d_ has joined #openstack-cinder05:14
*** _cjones_ has quit IRC05:17
*** annashen has joined #openstack-cinder05:19
*** annashen has quit IRC05:19
openstackgerritAlan Jiang proposed openstack/cinder: rbd calls block eventlet threads  https://review.openstack.org/14567805:26
*** annashen has joined #openstack-cinder05:26
*** BharatK has joined #openstack-cinder05:27
*** bill_az has joined #openstack-cinder05:30
*** annashen has quit IRC05:30
*** Mandell has joined #openstack-cinder05:32
*** nshaikh has joined #openstack-cinder05:36
*** ebalduf has joined #openstack-cinder05:43
openstackgerritMike Perez proposed openstack/python-cinderclient: Remove v1 support  https://review.openstack.org/14568805:48
*** ebalduf has quit IRC05:48
*** rakesh_mishra has quit IRC05:52
*** winston-d_ has quit IRC05:53
*** rakesh_mishra has joined #openstack-cinder05:58
*** mudassirlatif has joined #openstack-cinder05:58
*** winston-d_ has joined #openstack-cinder06:00
openstackgerritOpenStack Proposal Bot proposed openstack/cinder: Imported Translations from Transifex  https://review.openstack.org/14493306:04
*** rushil has quit IRC06:08
*** RJ_ has joined #openstack-cinder06:12
*** mudassirlatif has quit IRC06:14
*** mudassirlatif has joined #openstack-cinder06:17
openstackgerritTrung Trinh proposed openstack/cinder: Delete volume attached to already-deleted VM  https://review.openstack.org/14200606:19
*** mudassirlatif has quit IRC06:26
*** winston-d_ has quit IRC06:27
*** winston-d_ has joined #openstack-cinder06:29
*** jamielennox is now known as jamielennox|away06:33
*** bkopilov has joined #openstack-cinder06:33
*** nshaikh has quit IRC06:41
*** ebalduf has joined #openstack-cinder06:44
anishjgriffith: you had mentioned previously that the generic iscsi-helper code was being re-written for kilo06:46
anishis there a place to follow this so that I make sure I don't end up writing deprecated code wrt https://review.openstack.org/#/c/134398/06:47
*** ebalduf has quit IRC06:50
*** pradipta_away is now known as pradipta06:52
*** nlevinki has joined #openstack-cinder06:53
*** mogami has joined #openstack-cinder06:54
thingeeanish: targets are now being created in https://github.com/openstack/cinder/tree/master/cinder/volume/targets06:56
thingeeexample, tgt and lio being iscsi helpers06:56
*** nkrinner has joined #openstack-cinder06:57
anishyep, saw that06:57
anishiet seems to have gone away ?06:57
*** mogami has quit IRC06:59
openstackgerritMike Perez proposed openstack/cinder: Remove v1 server support  https://review.openstack.org/14570307:00
thingeeanish: not sure about iet, sorry07:01
anishno worries, I just ask because I was working on this before the holidays, and a git pull basically broke everything07:02
anishthingee: just wanted to confirm if there are more changes coming07:02
*** Longgeek has quit IRC07:02
*** lpetrut has joined #openstack-cinder07:03
thingeeanish: We have bug fixes, but that should be it in terms of big move changes07:03
anishexcellent !07:03
*** Longgeek has joined #openstack-cinder07:03
*** afazekas is now known as __afazekas07:04
openstackgerritTrung Trinh proposed openstack/cinder: Delete volume attached to already-deleted VM  https://review.openstack.org/14200607:04
*** winston-d_ has quit IRC07:04
*** winston-d_ has joined #openstack-cinder07:06
*** coolsvap|afk is now known as coolsvap07:08
*** e0ne has joined #openstack-cinder07:11
*** karimb has joined #openstack-cinder07:11
*** bill_az has quit IRC07:13
*** EduardBiceriMate has joined #openstack-cinder07:17
*** Mandell has quit IRC07:23
flip214jgriffith: now I am ... but that won't help much, I guess.07:24
*** winston-d_ has quit IRC07:24
*** Mandell has joined #openstack-cinder07:25
thingeeflip214: :)07:25
flip214thingee: I guess I know what john wants, already reviewing / replying.07:28
flip214thingee: [x] 145644 done07:31
*** k4n0 has joined #openstack-cinder07:38
*** k4n0 has quit IRC07:42
openstackgerritMarc Koderer proposed openstack/cinder: Update README.rst to current state  https://review.openstack.org/14551907:45
*** afazekas_ has joined #openstack-cinder07:46
*** chlong has quit IRC07:47
*** TobiasE has joined #openstack-cinder07:47
*** nshaikh has joined #openstack-cinder07:51
*** dannywilson has joined #openstack-cinder07:52
*** e0ne has quit IRC07:54
*** dannywilson has quit IRC07:57
*** rakesh_mishra has quit IRC07:59
*** rakesh_mishra has joined #openstack-cinder08:00
*** thingee has quit IRC08:17
*** sgotliv has joined #openstack-cinder08:18
*** delattec has joined #openstack-cinder08:21
*** rakesh_mishra has quit IRC08:21
*** cdelatte has quit IRC08:23
openstackgerritTaoBai proposed openstack/cinder: IBM Storwize driver Consistency Group Implementation  https://review.openstack.org/14268308:25
*** ndipanov has joined #openstack-cinder08:29
*** pradipta is now known as pradipta_away08:31
*** alexpilotti has joined #openstack-cinder08:31
*** alexpilotti has quit IRC08:36
*** alexpilotti has joined #openstack-cinder08:36
*** Mandell has quit IRC08:38
*** jkraj has joined #openstack-cinder08:40
*** ebalduf has joined #openstack-cinder08:48
*** anshul has quit IRC08:51
*** anshul has joined #openstack-cinder08:53
*** ebalduf has quit IRC08:53
*** jpich has joined #openstack-cinder08:54
*** jistr has joined #openstack-cinder09:10
*** jordanP has joined #openstack-cinder09:12
openstackgerritJeegn Chen proposed openstack/cinder: EMC VNX Cinder Driver Update  https://review.openstack.org/14162909:13
*** lpetrut has quit IRC09:17
*** dalgaaf has joined #openstack-cinder09:26
*** tshefi has joined #openstack-cinder09:28
*** alecv has joined #openstack-cinder09:31
*** Guest57286 has joined #openstack-cinder09:38
*** nellysmitt has joined #openstack-cinder09:45
*** jordanP has quit IRC09:45
*** jordanP has joined #openstack-cinder09:45
*** ebalduf has joined #openstack-cinder09:49
*** RJ_ has left #openstack-cinder09:51
*** sgotliv has quit IRC09:52
*** ebalduf has quit IRC09:54
*** dulek has joined #openstack-cinder09:55
*** sgotliv has joined #openstack-cinder10:06
*** lpetrut has joined #openstack-cinder10:09
*** rakesh__mishra has joined #openstack-cinder10:10
*** TobiasE has quit IRC10:17
*** RJ_ has joined #openstack-cinder10:17
*** e0ne has joined #openstack-cinder10:23
*** Masahiro has quit IRC10:27
*** rushiagr_away is now known as rushiagr10:32
*** rushiagr is now known as rushiagr_away10:33
*** smoriya has quit IRC10:42
*** e0ne_ has joined #openstack-cinder10:48
*** e0ne has quit IRC10:48
*** ebalduf has joined #openstack-cinder10:50
*** ebalduf has quit IRC10:55
erlon_.10:55
erlon_thingee: ping10:55
*** haomaiwang has quit IRC10:56
*** karimb has quit IRC10:57
RJ_hi11:05
RJ_i am facing the error while creating the volume with type having capabilities:replication= True in key11:06
RJ_..?11:06
RJ_http://paste.openstack.org/show/155969/11:07
*** deepakcs has joined #openstack-cinder11:10
*** TobiasE has joined #openstack-cinder11:25
*** chlong has joined #openstack-cinder11:43
*** ebalduf has joined #openstack-cinder11:51
*** BharatK has quit IRC11:54
*** ebalduf has quit IRC11:55
*** Miouge has quit IRC12:02
*** Miouge has joined #openstack-cinder12:03
*** ho has quit IRC12:08
*** Miouge has quit IRC12:08
*** Masahiro has joined #openstack-cinder12:16
*** Masahiro has quit IRC12:20
openstackgerritgit-harry proposed openstack/python-cinderclient: v2 error message grammatical error  https://review.openstack.org/14576712:24
*** sandywalsh has quit IRC12:24
*** k_ has quit IRC12:25
*** rakesh__mishra has quit IRC12:26
*** nosnos has quit IRC12:30
*** deepakcs has quit IRC12:35
*** karimb has joined #openstack-cinder12:38
*** IanGovett has joined #openstack-cinder12:40
*** dulek has quit IRC12:50
*** ebalduf has joined #openstack-cinder12:51
*** dulek has joined #openstack-cinder12:53
*** ryanpetrello has joined #openstack-cinder12:54
*** ebalduf has quit IRC12:56
*** sgotliv_ has joined #openstack-cinder12:59
*** sgotliv has quit IRC13:00
*** Miouge has joined #openstack-cinder13:03
openstackgerritPratik Das proposed openstack/python-cinderclient: Removed --name from cinder list as there was no NAME column in cinder volumes database.  https://review.openstack.org/14577413:07
*** anshul has quit IRC13:13
*** ryanpetrello has quit IRC13:16
*** ryanpetrello has joined #openstack-cinder13:17
*** bswartz has quit IRC13:19
openstackgerritnikeshmahalka proposed openstack/cinder: Add iSCSI SCST Target support to cinder.  https://review.openstack.org/14577813:24
*** alexpilotti has quit IRC13:26
*** bill_az has joined #openstack-cinder13:29
openstackgerritAnton Arefiev proposed openstack/cinder: Import only modules in volume manager  https://review.openstack.org/14578013:33
*** nikesh_vedams has joined #openstack-cinder13:39
*** ryanpetrello has quit IRC13:50
*** e0ne_ has quit IRC13:51
*** kaufer has joined #openstack-cinder13:52
*** ebalduf has joined #openstack-cinder13:52
*** jcru has joined #openstack-cinder13:54
*** timcl has joined #openstack-cinder13:55
*** bswartz has joined #openstack-cinder13:56
*** jungleboyj has quit IRC13:56
*** ebalduf has quit IRC13:56
*** jaypipes has joined #openstack-cinder13:58
*** e0ne has joined #openstack-cinder13:58
*** nlevinki has quit IRC14:01
nikesh_vedamsHi,i have a small doubt,i want to create a Gerrit CI account and i already have  a launchpad account for submitting patch,so for CI account can i use this launchpad account?14:03
nikesh_vedamsi used this launchpad account for registering blueprint and submitting patch for blueprint14:04
larsksnikesh_vedams: yes, you can use that same account with openstack gerrit.14:04
*** Masahiro has joined #openstack-cinder14:05
nikesh_vedamslarsks: this link is confusing for me http://ci.openstack.org/third_party.html14:06
nikesh_vedamslarsks: under Creating a Service Account14:07
nikesh_vedamslarsks: its saying "You may already have an existing personal account in Launchpad, but you should create a new and entirely separate account for this purpose."14:07
larsksnikesh_vedams: that page is about setting up a third party CI envrionment, not about submitting reviews to gerrit.  Which are you trying to do?14:08
larsksI may have misunderstood.14:08
nikesh_vedamslarsks: i want to set up a CI setup14:08
larsksOkay.  In that case, you *would* want to create a new account specifically for the CI setup.14:09
*** Yogi1 has joined #openstack-cinder14:09
larsksSo that the results of CI testing can be distinguished from your own comments on patches.14:09
*** akerr has joined #openstack-cinder14:09
*** Masahiro has quit IRC14:09
nikesh_vedamslarsks: ok got it,thanks14:11
nikesh_vedamslarsks:i want to set up "sos-ci",but stuggling where to start14:12
nikesh_vedamslarsks:https://github.com/j-griffith/sos-ci14:12
*** esker has joined #openstack-cinder14:12
*** esker has quit IRC14:13
larsksnikesh_vedams: That I'm not familiar with.14:14
nikesh_vedamslarsks:ok no probs :)14:15
*** nlevinki has joined #openstack-cinder14:16
*** ndipanov has quit IRC14:19
*** ndipanov has joined #openstack-cinder14:21
*** mriedem has joined #openstack-cinder14:21
openstackgerritBoris Pavlovic proposed openstack/cinder: Add more rally benchmarks related to Cinder  https://review.openstack.org/14559514:25
openstackgerritBoris Pavlovic proposed openstack/cinder: Add more rally benchmarks related to Cinder  https://review.openstack.org/14559514:28
*** xyang has joined #openstack-cinder14:30
*** alexpilotti has joined #openstack-cinder14:30
openstackgerritSteven Kaufer proposed openstack/cinder: GET volumes API sorting REST/volume/DB updates  https://review.openstack.org/14191514:31
openstackgerritSteven Kaufer proposed openstack/cinder: GET volumes API sorting enhancements common utilities  https://review.openstack.org/14191414:31
*** nshaikh has quit IRC14:33
*** dustins has joined #openstack-cinder14:35
*** thangp has joined #openstack-cinder14:42
*** ebalduf has joined #openstack-cinder14:53
*** lcurtis has joined #openstack-cinder14:53
*** ebalduf has quit IRC14:58
*** ling-yun-1 has joined #openstack-cinder14:58
*** zengyunling__ has quit IRC15:02
*** ndipanov has quit IRC15:05
*** Miouge has quit IRC15:09
*** EduardBiceriMate has quit IRC15:09
*** mtanino has joined #openstack-cinder15:11
*** ryanpetrello has joined #openstack-cinder15:11
*** rushil has joined #openstack-cinder15:12
*** akerr_ has joined #openstack-cinder15:13
*** lpabon has joined #openstack-cinder15:14
*** akerr has quit IRC15:14
*** vmtyler has joined #openstack-cinder15:15
*** ebalduf has joined #openstack-cinder15:17
*** nlevinki has quit IRC15:17
*** nlevinki has joined #openstack-cinder15:18
*** ndipanov has joined #openstack-cinder15:18
*** Longgeek has quit IRC15:19
*** Longgeek has joined #openstack-cinder15:21
*** thingee has joined #openstack-cinder15:24
*** tbarron has joined #openstack-cinder15:25
*** takedakn has joined #openstack-cinder15:25
*** takedakn has quit IRC15:27
*** takedakn has joined #openstack-cinder15:27
*** takedakn has quit IRC15:28
*** takedakn has joined #openstack-cinder15:28
*** Mandell has joined #openstack-cinder15:32
openstackgerritMudassir Latif proposed openstack/cinder: Add replication and PG setup methods on PureISCSIDriver  https://review.openstack.org/14509015:32
*** Miouge has joined #openstack-cinder15:33
*** tshefi has quit IRC15:35
*** takedakn has quit IRC15:35
*** jecarey has joined #openstack-cinder15:36
*** alecv has quit IRC15:38
*** vmtyler has quit IRC15:39
*** fischerw has joined #openstack-cinder15:42
*** alecv has joined #openstack-cinder15:43
*** Mandell has quit IRC15:43
*** e0ne is now known as e0ne_15:47
*** lpetrut has quit IRC15:50
*** nlevinki has quit IRC15:51
*** Masahiro has joined #openstack-cinder15:53
*** mberlin1 has quit IRC15:54
*** mberlin has joined #openstack-cinder15:55
*** coolsvap is now known as coolsvap|afk15:55
*** e0ne_ has quit IRC15:57
*** TobiasE has quit IRC15:58
*** tsekiyama has joined #openstack-cinder15:58
*** Masahiro has quit IRC15:58
*** TobiasE has joined #openstack-cinder15:59
*** dulek has quit IRC16:00
*** dulek has joined #openstack-cinder16:00
*** RJ_ has left #openstack-cinder16:03
*** changbl has quit IRC16:04
annegentle_hey thingee, I could use help triaging https://bugs.launchpad.net/openstack-api-site/+bug/1331246 -- basically what are attachments and snapshot_id in responses for GET volume for v1 API?16:08
*** alecv has quit IRC16:09
*** e0ne has joined #openstack-cinder16:09
*** changbl has joined #openstack-cinder16:15
*** nshaikh has joined #openstack-cinder16:16
openstackgerritYuriy Nesenenko proposed openstack/cinder: PEP8(E265): block comment should start with '# '  https://review.openstack.org/14582116:16
*** afazekas_ has quit IRC16:18
*** dulek has quit IRC16:19
*** lpabon_ has joined #openstack-cinder16:20
openstackgerritRushil Chugh proposed openstack/cinder: Garbage Remains when Attached Volume is Migrated with NFS Driver  https://review.openstack.org/14343116:20
*** xyang has quit IRC16:23
*** alecv has joined #openstack-cinder16:23
e0nejgriffith, eharney: hi! some thoughts about https://bugs.launchpad.net/cinder/+bug/1373513: i've fixed similar issue in Ubuntu upgrading lvm2 package to v2.0.111. for now, i've got errors on centos with lvm2 v2.0.100. may be it isn't cinder issue. i'm still investigating it16:23
*** sgotliv_ has quit IRC16:26
openstackgerritYuriy Nesenenko proposed openstack/cinder: PEP8(E265): block comment should start with '# '  https://review.openstack.org/14582116:26
*** ebalduf has quit IRC16:29
*** Mandell has joined #openstack-cinder16:29
*** EduardBiceriMate has joined #openstack-cinder16:30
*** jkraj has quit IRC16:30
eharneye0ne: have you seen anything indicating why upgrading helped?16:31
e0neeharney: a very similar bug in debian https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=65976216:32
*** Mandell has quit IRC16:32
*** Mandell has joined #openstack-cinder16:33
*** chlong has quit IRC16:34
*** ebalduf has joined #openstack-cinder16:34
*** Mandell has quit IRC16:38
*** sgotliv_ has joined #openstack-cinder16:39
*** nellysmitt has quit IRC16:44
openstackgerritYuriy Nesenenko proposed openstack/cinder: Fixed comments style according to the Hacking Rules  https://review.openstack.org/14582116:48
*** lpetrut has joined #openstack-cinder16:48
*** lpabon_ has quit IRC16:51
*** jecarey has quit IRC16:51
*** lpetrut has quit IRC16:53
openstackgerritNavneet Singh proposed openstack/cinder: Implement Cinder Manage/Unmanage APIs in NFS driver.  https://review.openstack.org/13812516:54
nikesh_vedamsHi  We have commited our scst code. https://review.openstack.org/#/c/145778/ To have CI setup,we are following link: https://github.com/j-griffith/sos-ci16:55
nikesh_vedamsWe have a Ubuntu 14.04 server VM and we will integrate SCST changes in this VM. Now how can we use this VM for CI setup.16:55
nikesh_vedamsWe are also using this VM for commiting our scst patch16:56
nikesh_vedamsWe have differnt launchpad account for patch submission and CI account16:57
*** TobiasE1 has joined #openstack-cinder16:59
nikesh_vedamsBut we want to know how to setup our VM with  https://github.com/j-griffith/sos-ci   CI for testing our  https://review.openstack.org/#/c/145778 patch17:00
*** patrickeast has joined #openstack-cinder17:00
nikesh_vedamsplease guide us17:00
*** _cjones_ has joined #openstack-cinder17:00
*** jecarey has joined #openstack-cinder17:00
*** TobiasE has quit IRC17:01
*** xyang has joined #openstack-cinder17:03
*** e0ne has quit IRC17:03
*** timcl has quit IRC17:04
*** andymaier has joined #openstack-cinder17:05
*** esker has joined #openstack-cinder17:07
tsekiyamaHi, any suggestion for renaming 'target_portals / target_iqns / target_luns' in iSCSI multipath patch https://review.openstack.org/#/c/134681/ ? thingee told me these need better names when the cinder-spec was approved.17:08
jgriffithhemna: thinking more about detach my thoughts about the detach method signature might have been kinda stupid :)17:11
jgriffithhemna: WRT multi-attach17:11
hemnajgriffith, ah ok.  :)  I was hoping to circle back on that today17:11
jgriffithhemna: haha... you know me well enough that if you ignore me for a day or two I may change my mind or forget :)17:12
hemna:P17:12
hemnanow if I can just get the javelin tests to pass.....17:12
openstackgerritJohn Griffith proposed openstack/cinder: Implement clone_image caching on SolidFire  https://review.openstack.org/14285917:13
*** EmilienM is now known as EmilienM|afk17:15
jgriffithwinston-d_zZZ: ping...17:16
jgriffithdoh!  the dreaded zZZ17:16
openstackgerritPatrick East proposed openstack/cinder: Add support for manage/unmanage volume commands to PureISCSIDriver  https://review.openstack.org/14372617:17
*** nshaikh has quit IRC17:18
thingeejgriffith: did you see all the v1 removal patches? :)17:19
jgriffiththingee: no...17:19
thingeehttps://review.openstack.org/#/c/145703/17:20
thingeehttps://review.openstack.org/#/c/145688/17:20
jgriffiththingee: got'em17:20
jgriffiththingee: only thing is do we really want to "remove" them?17:20
thingeeI thought that was the plan for Kilo.17:21
jgriffiththingee: and part of the only reason I ask is that although we had it enabled in Grizzly, it wasn't default until Juno17:21
jgriffiththingee: it was...17:21
thingeejgriffith: https://github.com/openstack/cinder/blob/master/cinder/api/__init__.py#L3117:21
jgriffithI'm just making sure we're thinking it through and not shooting ourselves in the foot17:21
jgriffithor pissin a bunch of people off :)17:21
thingeejgriffith: I agree, but we gotta rip the bandaid at some point17:22
jgriffiththingee: yeah... and your log message is pretty clear :)17:22
thingeeunfortunately openstackclient, heat, tripleo, etc need to be updated to use the cinderclient itself instead of assuming volumev2 is the service type. so that discovery works17:22
jgriffithugh17:23
jgriffiththingee: I'm happy to help on some of those....17:23
jgriffithor at least openstackclient17:23
thingeejgriffith: https://github.com/Thingee/python-openstackclient/commit/4f32c6755346ab5068533bd9c5963ff60ab8e6a617:23
jgriffithI'm concerne about some other externals (ansible, shade etc)17:23
jgriffiththingee: oh fine.. take the one that I was interested in helping with :)17:24
jgriffiththingee: I want nothing to do with OOO17:24
*** andymaier has quit IRC17:24
jgriffiththingee: that being said, I'll help out on anything you like, just give me orders :)17:24
*** timcl has joined #openstack-cinder17:24
thingeejgriffith: https://github.com/openstack/heat/blob/master/heat/engine/clients/os/cinder.py#L3917:24
mdenny\\csim-cloud.rose.hp.com\CloudGroupShare\testing\perf\logs17:25
jgriffiththingee: oh... so did you do all of them already?17:25
thingeejgriffith: nah, that's master of heat..was pointing out the use of volumev217:25
mdennywrong channel17:26
*** nkrinner has quit IRC17:26
thingeejgriffith, jamielennox|away: so I noticed a problem with https://review.openstack.org/#/c/145613/.17:27
nikesh_vedamsjgriffith:hi17:27
jgriffithnikesh_vedams: hello there17:27
jgriffiththingee: yeah?17:28
thingeejamielennox|away: besides the problems you pointed out17:28
nikesh_vedamsjgriffith:uploaded patch,need some help :)17:28
nikesh_vedamsin CI17:28
jgriffithnikesh_vedams: looking17:29
thingeejgriffith: so remember these https://github.com/openstack/python-cinderclient/blob/master/cinderclient/v2/shell.py#L190 ?17:29
jgriffithnikesh_vedams: pep8 and pylint, no big deal17:29
jgriffiththingee: oh17:30
nikesh_vedamsjgriffith: we want to know how to setup our VM with  https://github.com/j-griffith/sos-ci   CI for testing our  https://review.openstack.org/#/c/145778 patch17:30
jgriffiththingee: that's problematic17:30
jgriffithnikesh_vedams: so sos-ci is meant to interact with an OpenStack cloud... run devstack and Temest on Instances in that Cloud17:31
*** jpich has quit IRC17:31
thingeejgriffith: these are making my life harder for version discovery with backwards compat. If I have x.x.x.x:8776 as the publicURL and service_type 'volume'...I'll get endpoint not found if I have OS_VOLUME_API_VERSION=1 set.17:31
jgriffithYou need to deploy OpenStack and point sos-ci at that17:31
thingeejgriffith: because this will set volumev2 for the service_type https://github.com/openstack/python-cinderclient/blob/master/cinderclient/shell.py#L57817:32
jgriffiththingee: can we do a mapping trick?17:32
jgriffiththingee: because we can't change the client17:32
jgriffiththingee: I mean, we can't count on the client not being "older"17:32
nikesh_vedamsjgriffith: how can we create this Openstack cloud,we have a VM with ubuntu 14.04 server and also we have a ESXi Host17:34
thingeejgriffith: well so first question, we need to decide if it's worth making the cinderclient backwards compat. so either fix up https://review.openstack.org/#/c/145613/ to do some hack of if endpoint not found is raised, we fall back to service_type 'volume'17:34
thingeejgriffith: or17:34
thingeewe assume in a major cinderclient release that v1 is gone https://review.openstack.org/#/c/145688/17:34
jgriffithnikesh_vedams: if you don't know how to deploy OpenStack yet you've got a very very long way to go I'm afraid17:34
thingeeand that the service_catalog needs to be updated before upgrading to kilo17:34
thingeeservice type has to be volume and endpoint has to be x.x.x.x:877617:35
jgriffiththingee: but you can't assume people have upgraded the client... I mean you can't break their existing clients IMHO17:35
jgriffithhmmm....17:35
thingeejgriffith: that's true.17:35
jgriffiththingee: I mean moving everything to default to v2 is def good, and even "hiding" v1 a little17:36
nikesh_vedamsjgriffith:so i know how to deploy it by http://docs.openstack.org/juno/install-guide/install/apt/content/17:36
jgriffithnikesh_vedams: you need to be looking at devstack IMHO17:37
*** dustins_ has joined #openstack-cinder17:39
nikesh_vedamsjgriffith: any link will be greatly helpful :)17:39
thingeenikesh_vedams: http://devstack.org17:39
*** jwcroppe has quit IRC17:40
*** jwcroppe has joined #openstack-cinder17:41
*** dustins has quit IRC17:41
thingeejgriffith: if you have an outdated client, I guess we should make it so on the server side, you can service types volume and volumev2 point to x.x.x.x:8776?17:41
thingeejgriffith: I actually haven't thought about that before, but may work...would have to test it17:42
*** jistr has quit IRC17:43
*** Masahiro has joined #openstack-cinder17:43
*** jwcroppe has quit IRC17:45
thingeejgriffith: what a mess :)17:46
jgriffiththingee: sigh17:46
thingeeI couldn't sleep for two hours last night because of this. :)17:47
jgriffiththingee: maybe this is why nobody else has really "removed" and API version17:47
nikesh_vedamsjgriffith thingee: sorry for silly question but what is IMHO17:47
jgriffithnikesh_vedams: not silly... "IMHO = In My Humble Opinion"17:47
*** Masahiro has quit IRC17:48
thingeejgriffith is very humble with his opinions :)17:48
thingeehey so austin, bbq all week?17:48
jgriffiththingee: kinda of funny that I use that term huh?17:48
jgriffithLOL17:48
jgriffiththingee: I'm a vegetarian17:48
jgriffithNOT!17:48
*** rushiagr_away is now known as rushiagr17:48
thingeejgriffith: ain't foolin' me17:48
jgriffith:)17:49
*** sgotliv_ has quit IRC17:49
jgriffiththingee: so I'm looking at some things on the allocated capacity issues vishy mentioned yesterday17:49
jgriffiththingee: it's kind of a mess17:49
jgriffiththingee: I'm working through some things now, I'll get a bug posted and ping you when it's up17:50
*** fandi has quit IRC17:50
nikesh_vedamsjgriifith thingee : hmm then we can give Openstack colud to sos-ci by running devstack right17:51
jgriffithnikesh_vedams: right17:51
thingeejgriffith: for the creates, is it enough to notify the scheduler if we get an exception from the driver?17:51
jgriffiththingee: that's what I'm messing with right now17:51
jgriffiththingee: it "should"17:52
thingeejgriffith: Ok, wasn't sure if it was as simple as that. I tried bugging winston-d_zZZ about it last night, but I never heard from him17:52
nikesh_vedamsjgriiffith thingee : thanks17:52
thingeenikesh_vedams: np17:52
*** lpetrut has joined #openstack-cinder17:52
openstackgerritThang Pham proposed openstack/cinder-specs: Cinder objects  https://review.openstack.org/13004417:52
jgriffithwell, so it's kinda funky... esp with pools in the mix17:52
thingeejgriffith: yeah my head was starting to hurt when I saw the pool docstring :)17:52
jgriffithanyway, I'm testing some things out on it.17:52
jgriffithI'd like to move to just pulling from the driver for all of this17:53
thingeeI need to write a cheatsheet so I don't have to keep remembering things17:53
jgriffithand don't even try and count ourselves17:53
jgriffiththingee: welcome to my world :)17:53
thingeejgriffith: +117:53
jgriffiththingee: the problem is now that we have 28+ drivers that's a real pain in my *$$17:53
jgriffiththingee: and looking at some of them and trying to determine how the hell they work is not fun17:54
jgriffiththingee: so maybe a driver impl, with a fall back17:54
jgriffithanyway.... need to waste another hour of my life in a pointless meeting, then be back to look at it again17:54
*** karimb has quit IRC17:55
*** TobiasE1 has quit IRC17:57
rushiagrjgriffith: that's a good time to check out all social networking sites on your phone ;)17:58
rushiagrI'm not back from holidays yet, so I think I should shut my lappy down and enjoy instead :)18:00
rushiagrgood night :)18:00
*** jordanP has quit IRC18:01
*** fandi has joined #openstack-cinder18:02
*** jwcroppe has joined #openstack-cinder18:04
nikesh_vedamsjgriffith thingee :Like you said that sos-ci will run devstack and Temest on Instances in that Cloud,so will it create instance itself or we have to create instance manually?18:04
*** leeantho has joined #openstack-cinder18:04
*** rushiagr is now known as rushiagr_away18:06
thingeenikesh_vedams: it will create the instance18:06
nikesh_vedamsjgriffith thingee : ok but i think we have to manually install scst packages in those VMs18:08
nikesh_vedamsjgriffith thingee : without scst packages tempest will fail18:09
*** dannywilson has joined #openstack-cinder18:09
nikesh_vedamsjgriffith thingee : i mean if sos-ci create VM and deploy devstack in VM and try to run tempest,it will fail without scst packages18:10
thingeenikesh_vedams: then you should modify sos-ci for your case. When it installs devstack it has a place to install additional packages https://github.com/j-griffith/sos-ci/blob/master/sos-ci/ansible/tasks/install_devstack.yml#L418:12
thingeeassuming they are available via apt-get18:12
openstackgerritMudassir Latif proposed openstack/cinder: Add replication and PG setup methods on PureISCSIDriver  https://review.openstack.org/14509018:12
*** EmilienM|afk is now known as EmilienM18:14
*** annashen has joined #openstack-cinder18:18
nikesh_vedamsjgriffith thingee : ohhh,we are getting scst packages through wget and then we are doing "make and make install" for installing scst packages and some other commands we are running for scst18:19
nikesh_vedamsrunning18:20
nikesh_vedamsand also we are editing /etc/rootwrap.d/18:20
thingeenikesh_vedams: Ok, so you'll need modify that file so ansible does that18:20
*** MIDENN_ has quit IRC18:23
*** mdenny has quit IRC18:23
*** e0ne has joined #openstack-cinder18:24
*** mdenny has joined #openstack-cinder18:25
thingeejgriffith: ok whew, this will work if we backwards compat http://paste.openstack.org/show/156006/18:25
*** leeantho has quit IRC18:25
*** mdenny has quit IRC18:25
*** bswartz has quit IRC18:30
*** mdenny has joined #openstack-cinder18:33
*** e0ne has quit IRC18:34
*** e0ne has joined #openstack-cinder18:37
*** junhongl has quit IRC18:38
*** lpabon has quit IRC18:39
*** junhongl has joined #openstack-cinder18:39
openstackgerritOpenStack Proposal Bot proposed openstack/cinder: Updated from global requirements  https://review.openstack.org/14566118:42
*** sgotliv has joined #openstack-cinder18:43
*** nellysmitt has joined #openstack-cinder18:45
*** Mandell has joined #openstack-cinder18:47
*** _cjones_ has quit IRC18:48
thingeejgriffith: now to deal with volumev2 being removed =/18:49
*** _cjones_ has joined #openstack-cinder18:49
*** nellysmitt has quit IRC18:50
*** Mandell_ has joined #openstack-cinder18:50
*** Mandell has quit IRC18:51
*** jecarey has quit IRC18:59
nikesh_vedamsthingee : one more question ,how sos-ci will take my patch and CI account information :)19:01
thingeenikesh_vedams: environment variables or hard coded https://github.com/j-griffith/sos-ci/blob/master/sos-ci/os_ci.py#L1719:02
thingeenikesh_vedams: the patch comes from the event queue that is being tested with19:04
*** jecarey has joined #openstack-cinder19:05
*** adrien1 has joined #openstack-cinder19:05
*** adrien1 is now known as adrienverge19:05
adrienvergeHi everyone19:05
adrienvergeA new feature got merged into Cinder and I would like to have it documented in http://docs.openstack.org/trunk/config-reference/content/19:06
adrienvergeHow can I contribute? Where's the source of this config-reference?19:07
*** mriedem has quit IRC19:07
nikesh_vedamsthingee: i want it to run only patches for this "https://review.openstack.org/#/c/145778/"19:08
thingeenikesh_vedams: If you want to do an individual patch, I would recommend just creating a vm manually with devstack, but in the local.conf specify the CINDER_REPO and CINDER_BRANCH as explained here http://docs.openstack.org/developer/devstack/stackrc.html?highlight=_repo19:10
thingeenikesh_vedams: no need for sos-ci if that's the case19:11
thingeenikesh_vedams: sos-ci is for monitoring upstream events and automating the testing19:11
*** alexpilotti has quit IRC19:14
*** adrienverge has quit IRC19:16
nikesh_vedamsthingee: but by this way how coud we provide resut of tempest log to gerrit19:18
*** ebalduf has quit IRC19:18
nikesh_vedamsthingee: we must need some CI to provide results to gerrit right19:18
nikesh_vedamsand so i was wondering how sos-ci wil take only our patch and provide resluts to gerrit19:20
*** mriedem has joined #openstack-cinder19:22
*** annashen has quit IRC19:23
*** annashen has joined #openstack-cinder19:24
*** EduardBiceriMate has quit IRC19:24
timclameade: to add your phone go here - http://hr.netapp.com/how-do-i/19:25
timclselect Change - Phone #s19:26
timclfill out and submit19:26
timcloops wrong window19:26
ameade_hehe19:27
*** ameade_ is now known as ameade19:29
*** Masahiro has joined #openstack-cinder19:31
thingeenikesh_vedams: if you have the ci setup, and reupload the patch, the idea is the ci would pull in the patch.19:32
*** _cjones_ has quit IRC19:33
*** jecarey has quit IRC19:33
*** jecarey has joined #openstack-cinder19:33
*** _cjones_ has joined #openstack-cinder19:34
*** Longgeek has quit IRC19:34
*** Masahiro has quit IRC19:35
*** Longgeek has joined #openstack-cinder19:36
*** dalgaaf has quit IRC19:37
nikesh_vedamsthingee: ok but i have fear that it will take other patches too along with my patch so there should be some restrictions19:38
*** annashen has quit IRC19:39
thingeenikesh_vedams: that's the idea of a CI. If that's not what you want, then you don't want continous integration.19:40
thingeenikesh_vedams: if you want to do a one time test, start a vm manually, install whatevwer, run tempest, record the logs, upload it somewhere, post it in comments of the review.19:40
*** Longgeek has quit IRC19:41
*** e0ne is now known as e0ne_19:41
nikesh_vedamsthingee:For our patch what is good according to community  https://review.openstack.org/#/c/145778/19:42
nikesh_vedamsthingee: having CI or manuall logs19:43
thingeenikesh_vedams: definitely having a ci. If you test manually now, it may work now, but might not work later.19:44
thingeenikesh_vedams: a CI would report if any proposed patch would break scst support19:45
thingeebecause you are continuously testing19:45
jgriffithvishy: so it seems to me that to start, we should increment allocated cap regardless of the result from the driver on create19:47
jgriffithvishy: the volume's going to be there and allocated regardless19:47
*** timcl has quit IRC19:47
jgriffithby "there" I mean in Cinder's DB19:47
thingeejgriffith: we don't know where the driver failed though19:48
jgriffiththingee: doesn't matter19:48
jgriffiththingee: it's "allocated"19:48
jgriffiththingee: in Cinder19:48
*** e0ne_ is now known as e0ne19:48
jgriffitheven if it's not used on the backend a request was made to allocate the space19:48
nikesh_vedamsjgriffith thingee : thanks for giving your valueable time to us :)19:48
thingeejgriffith: I get that, but I guess it doesn't seem accurate. not saying it's any better than now.19:49
jgriffiththingee: but it is accurate19:49
openstackgerritSteven Kaufer proposed openstack/python-cinderclient: WIP Adopt CLI Sorting Argument Guidelines  https://review.openstack.org/14591319:49
jgriffiththingee: as opposed ot now which is NOT at all accurate19:49
jgriffiththingee: so look at it like this....19:49
jgriffithyou create a 1G volume.... acap = 1G19:50
jgriffithyou create another 1G vol, but it fails...19:50
jgriffithYou STILL have 2Gig of storage allocated from Cinder's perspective19:50
jgriffithuntil you delete the volume that's in error state19:50
jgriffiththat being said....19:51
jgriffiththe next step I'd like is to say; "hey, get this info via a call to the driver"19:51
jgriffithand then, if that's not implemented fall back and use the local tracking19:51
thingeebut cinder is going to think 2 gigs is allocated, when it could've been a network issue between the cinder manager and the backend. The backend never knew about it.19:51
thingeeunless I'm still missing something here.19:51
jgriffiththingee: but it IS allocated!!!19:51
jgriffiththingee: there's a volume of 1G in the database19:51
jgriffiththingee: you do a volume list and there it is19:52
jgriffiththat's allocated,19:52
jgriffithmaybe not "used" but it's been allocated19:52
jgriffiththingee: see what I mean?19:52
openstackgerritSteven Kaufer proposed openstack/python-cinderclient: WIP Adopt CLI Sorting Argument Guidelines  https://review.openstack.org/14591319:52
thingeeYeah i understand now. I'm not sure I have a good understanding of what allocated means to the scheduler here then.19:52
jgriffiththingee: so for scheduler that's how the weigher works and the capacity filter etc19:53
*** _cjones_ has quit IRC19:53
jgriffiththingee: the thing is there's a difference between allocation and utilization19:53
jgriffithand as long as we're clear and consistent on that I think it's "ok"19:53
thingeebecause I was under the impression is was as best as we can guess is allocated from the backend. Unless we get to the expected state, it's not counted.19:54
thingeenot disagreeing, just talking through here.19:54
jgriffiththingee: oh sure... yeah, talk is good :)19:54
jgriffiththingee: but I'm not sure I understand your statement there?19:54
jgriffiththingee: so this all kinda comes back to what we've grappled with for a while in terms of consistent definitions and reporting19:55
*** ebalduf has joined #openstack-cinder19:56
jgriffithhonestly I don't think it matters if we define blue as red and green as purple.... as long as it's consistent19:56
*** thangp has quit IRC19:56
* jgriffith doesn't know if that analogy helps or makes things worse :)19:56
thingeeso with what you were saying, allocated makes sense from cinder's perspective and is more accurate. I agree with that. However, it's not any better of being accurate of the backend, and that's not going to happen until we actually get reporting from the backend itself.19:56
thingeeam I accurate with that? :P19:56
jgriffiththingee: well it's way better actually19:56
jgriffiththingee: cuz right now if you have 5 volumes, create one and it goes to error you don't increment19:57
jgriffithBUT... when you delete that volume it does decrement :(19:57
jgriffiththingee: and it's nothing new in the storage industry to differentiate between allocated and used space19:57
thingeesure19:58
thingeeI think I got it now19:58
jgriffithand since Cinder is the application here we say "yes, you allocated it.  Even if you didn't actually reserve any blocks on your device, you did in fact allocate N blocks from backend-foo"19:58
thingeeyeah seems reasonable to me. would be curious vishy's thoughts.19:58
jgriffiththingee: vishy it's def just an interim improvement19:59
openstackgerritPatrick East proposed openstack/cinder: Add support for manage/unmanage volume commands to PureISCSIDriver  https://review.openstack.org/14372619:59
*** jecarey has quit IRC19:59
jgriffiththingee: there's some other weird things in here too, but that's a start anyway20:00
*** jecarey has joined #openstack-cinder20:01
jgriffiththingee: hmmm.... so tricky part is if we do a revert on failure to create20:08
openstackgerritNavneet Singh proposed openstack/cinder: Implement Cinder Manage/Unmanage APIs in NFS driver.  https://review.openstack.org/13812520:08
jgriffiththingee: or I should say if "taskflow" does a revert20:08
thingeeprobably taskflow, in case retries20:09
jgriffiththingee: what I mean is we track in the manager, we don't know what taskflow is doing higher up :(20:09
jgriffiththingee: in most cases you just get a volume in error state, but in some it actually reverts it20:10
jgriffithso the volume gets nuked out of db, BUT your allocated cap isn't adjusted20:10
jgriffithand the hooks into manager's cap reporting aren't exactly "readily" available20:10
jgriffithhmm... guess I'll look at this some more20:11
*** fandi has quit IRC20:13
thingeejgriffith: wait, I thought for allocated we were going to just go by what's known in the cinder db, instead of incrementing and decrementing. Would it not matter then?20:14
jgriffiththingee: yes20:20
jgriffiththingee: but... taskflow calls manager20:20
jgriffithtaskflow creates vol in db.... calls manager20:20
jgriffithmanager does allocation stuff20:20
jgriffithreturns to taskflow20:20
*** annashen has joined #openstack-cinder20:20
jgriffithproblem is that if something goes wrong, taskflow may or may not delete the volume from db20:20
jgriffiththe retries is a non-issue20:21
jgriffithbut if it reverts we've allocated and we're screwed20:21
jgriffithbut I think I know how to work that20:21
jgriffithso never mind :)20:21
thingeejgriffith: I think I might still be missing. so if you have 1G volume, alloc=1G....then you do another 1G create, fails in taskflow, the volume is not deleted by taskflow..so you have 2 x 1G volumes know to cinder. One is error the other available. If we remove out the increment/decrement code and just purely go off what's know in the cinder db. it will still be alloc 2G. Now if taskflow was to20:24
thingeedelete volume, we would still go off what's known in the cinder db, and be at 1G.20:24
*** leeantho has joined #openstack-cinder20:24
jgriffiththingee: so that scenario is good... yes20:24
thingeethose are scenarios20:24
thingeetwo*20:24
thingeeI'm trying to understand what the manager has to do with any of that if the scheduler is just asking the cinder db directly. there is no incrementing or decrementing20:25
jgriffiththingee: ahh.... so you're saying just skip the update on create/delete altogether maybe and just do the periodic task of checking db and counting refs?20:25
thingeeyes20:25
jgriffiththingee: so the problem is you do a create of 10 volumes at once20:26
jgriffiththingee: your capacity info isn't updated until the next periodic20:26
jgriffithbad things happen20:26
thingeegot it20:26
thingeejgriffith: the other problem to is if reschedule fails in taskflow.20:30
thingeejust glancing at the code, might be a concern20:30
*** fifieldt_ has quit IRC20:32
thingeejgriffith: actually, I can't find anywhere in taskflow manager create volume code where the volume is explicitly deleted from the db20:33
thingeejust the common.error_out_volume()20:33
*** fifieldt_ has joined #openstack-cinder20:33
*** Mandell_ has quit IRC20:34
e0nethingee: just 2c from my side: afaik, our flow manager doesn't support anything except creating20:37
*** harlowja_away is now known as harlowja20:37
e0nehope, i'm wrong20:37
thingeee0ne: that's correct20:37
e0ne:(20:37
thingeee0ne: eharney signed up to delete volume next20:38
e0nethingee, eharney: great news20:38
thingeee0ne: as discussed in paris, we wanted something that would be more useful to use taskflow to determine if wanted to keep using taskflow at all20:38
e0nethingee: i'm looking on it and starting of state machine impl for a last few days20:39
*** kaufer has quit IRC20:39
*** jecarey has quit IRC20:40
*** jecarey has joined #openstack-cinder20:41
*** e0ne has quit IRC20:41
*** jecarey_ has joined #openstack-cinder20:42
*** bswartz has joined #openstack-cinder20:43
*** lpetrut has quit IRC20:43
*** kvidvans has quit IRC20:44
*** jecarey has quit IRC20:45
*** e0ne has joined #openstack-cinder20:46
*** nellysmitt has joined #openstack-cinder20:46
*** nellysmitt has quit IRC20:51
*** _cjones_ has joined #openstack-cinder20:53
*** david-lyle has joined #openstack-cinder20:54
*** lpabon has joined #openstack-cinder20:58
boris-42thingee: jgriffith hey guys20:58
boris-42thingee: jgriffith can we get this in https://review.openstack.org/#/c/145595/20:58
boris-42seems like I put proper numbers now20:58
*** _cjones_ has quit IRC20:59
*** _cjones_ has joined #openstack-cinder20:59
*** Mandell has joined #openstack-cinder20:59
jgriffithboris-42: yeah, once we get Jenkins coerced21:02
boris-42jgriffith: thanks21:03
*** markvoelker has joined #openstack-cinder21:04
*** kaufer has joined #openstack-cinder21:06
*** e0ne has quit IRC21:09
rushiljgriffith, thingee, xyang, avishay, jungleboyj: Can you look at https://review.openstack.org/#/c/143431/ ? I have included the reasoning for the change in both the commit message and the bug. Thanks21:10
*** e0ne has joined #openstack-cinder21:12
*** mriedem has quit IRC21:13
*** mriedem has joined #openstack-cinder21:15
thingeeboris-42: sure. e0ne left you a comment tho21:18
*** lpetrut has joined #openstack-cinder21:18
*** patrickeast has quit IRC21:18
thingeejgriffith: did you see my earlier commments about not finding explicit deletes in the taskflow manager create volume code?21:19
thingeejgriffith: all I found was common.error_out_volume()21:19
*** Masahiro has joined #openstack-cinder21:20
jgriffiththingee: https://github.com/openstack/cinder/blob/master/cinder/volume/flows/api/create_volume.py#L52221:20
thingeedoes the manager talk to the api taskflow code? I thought it was just the manager taskflow code21:21
thingeejgriffith: ^21:21
jgriffiththingee: you tell me, you and DuncanT keep saying how easy taskflow is :)21:21
jgriffiththingee: or at least DuncanT did, not sure if you did or not :)21:22
jgriffiththingee: I'm trying to force that whitelist to trace through it21:22
e0ne:)21:22
jgriffithmaybe harlowja is around?21:23
thingeejgriffith: my impression was api/taskflow was just for api code to talk to.21:23
jgriffiththingee: that would make sense21:23
harlowjajgriffith what u saying, lol21:23
jgriffithharlowja: long time no hear21:24
harlowjaya, happy new year21:24
harlowjai got a case of poison oak for xmas21:24
harlowjafun fun21:24
harlowjalol21:24
thingeeharlowja: is it safe to assume volume/flows/api/create_volume.py is only access from the cinder api code, not the manager?21:24
*** jamielennox|away is now known as jamielennox21:24
jgriffithharlowja: revert routine on taskflow create volume21:24
*** patrickeast has joined #openstack-cinder21:24
jgriffithharlowja: does taskflow ever go back and delete the db ref on a failure?21:24
harlowjathingee afaik ya, tried to keep them under a specific folder (api -> api)21:24
*** Masahiro has quit IRC21:25
thingeeharlowja: from what I gather, when the manager talks to taskflow, taskflow will only set the volume to error state. A volume is only deleted if something fails from the cinder api side.21:26
thingeebefore getting to the manager/scheduler, etc.21:26
harlowjaya, that should be the expected case21:26
jgriffithharlowja: thingee I'm not sure what you folks are referring to21:27
thingeejgriffith: so the cinder api code, talk to volume/flows/api/create_volume.py. the manager should be just talking to volume/flows/manager/create_volume.py21:28
jgriffiththingee: ummm... nope21:28
jgriffiththingee: :)21:29
harlowjahttps://github.com/openstack/cinder/blob/master/cinder/volume/flows/manager/create_volume.py#L14721:29
jgriffithcreate volume from cinder api goes to flows/api/create_volume21:29
jgriffiththat's where the db entry is created21:29
jgriffith:)21:29
harlowjaya21:30
jgriffithwhich is the link I sent21:30
jgriffithand it's also where the rever method is that does a db.volume_destroy21:30
jgriffithsimple :)21:30
harlowjaok maybe i'm confused to then, ha, no api workflow code should be used in other workflows21:31
harlowjai think thats the jist of the question21:31
jgriffithharlowja: thingee I could be confusing everybody....21:31
jgriffithharlowja: thingee let's start over :)21:31
harlowjapossibly, ha21:31
jgriffithharlowja: thingee my question was.....21:31
jgriffithharlowja: thingee under what circumstances can the revert method get called (here: https://github.com/openstack/cinder/blob/master/cinder/volume/flows/api/create_volume.py#L511)21:32
harlowjawhen a later task fails21:32
*** lpabon has quit IRC21:32
jgriffithharlowja: thingee and yes, volume create calls go through here21:32
harlowjawhich is the quota commit task, VolumeCastTask21:32
jgriffithharlowja: ahh... so create was fine (or not) but quota update fails21:33
jgriffithso then we revert?21:33
harlowjaseems like it21:33
harlowjathat would be one case of that, ya21:33
harlowjaor if casting fails, it should get there also21:34
harlowjabut at that point someone set 'optional_args['is_quota_committed']'21:34
harlowjabb21:34
*** jgravel has joined #openstack-cinder21:37
*** eharney has quit IRC21:39
*** Mandell_ has joined #openstack-cinder21:45
*** Mandell has quit IRC21:46
*** Tross has joined #openstack-cinder21:47
*** ryanpetrello has quit IRC21:53
*** e0ne has quit IRC21:54
openstackgerritGloria Gu proposed openstack/python-cinderclient: Update to change name for volume type client  https://review.openstack.org/14118721:55
*** e0ne has joined #openstack-cinder21:58
*** dannywilson has quit IRC21:59
*** dannywilson has joined #openstack-cinder22:00
*** patrickeast has quit IRC22:01
*** dannywilson has quit IRC22:01
*** dannywilson has joined #openstack-cinder22:01
*** patrickeast has joined #openstack-cinder22:02
*** dannywilson has quit IRC22:02
*** dannywilson has joined #openstack-cinder22:02
*** fischerw has quit IRC22:03
*** fischerw has joined #openstack-cinder22:03
*** e0ne has quit IRC22:05
*** fischerw has quit IRC22:09
*** xyang has quit IRC22:10
*** xyang has joined #openstack-cinder22:11
guglthingee, xyang , this is the change splitted out from the original change to have more discussion regarding whether to allow the volume type name change : https://review.openstack.org/#/c/140906/ whenever you have a change please shed some light. Thank a lot!22:14
guglthingee, xyang s/change/chance22:14
*** fischerw has joined #openstack-cinder22:15
*** EmilienM is now known as EmilienM|afk22:17
*** Mandell_ has quit IRC22:22
*** Yogi1 has quit IRC22:22
*** lcurtis has quit IRC22:26
*** markstur has quit IRC22:27
*** david-lyle has quit IRC22:28
*** mwichmann has quit IRC22:29
*** e0ne has joined #openstack-cinder22:34
*** kaufer has quit IRC22:35
*** jecarey_ has quit IRC22:38
openstackgerritxing-yang proposed openstack/cinder: Create Consistency Group from CG Snapshot  https://review.openstack.org/14595222:41
*** markstur has joined #openstack-cinder22:43
*** delattec has quit IRC22:43
openstackgerritxing-yang proposed openstack/cinder: Create Consistency Group from CG Snapshot  https://review.openstack.org/14595222:45
*** Mandell has joined #openstack-cinder22:47
*** nellysmitt has joined #openstack-cinder22:47
*** e0ne has quit IRC22:47
*** mriedem has quit IRC22:49
*** xyang has quit IRC22:51
*** nellysmitt has quit IRC22:51
*** annashen has quit IRC22:58
*** patrickeast has quit IRC22:59
*** dannywilson has quit IRC22:59
*** dannywilson has joined #openstack-cinder23:01
*** patrickeast has joined #openstack-cinder23:02
*** annashen has joined #openstack-cinder23:03
*** btran has quit IRC23:05
*** btran has joined #openstack-cinder23:05
*** Masahiro has joined #openstack-cinder23:09
*** esker has quit IRC23:09
*** Masahiro has quit IRC23:13
*** jwcroppe has quit IRC23:15
*** jwcroppe has joined #openstack-cinder23:15
*** jwcroppe has quit IRC23:20
*** eharney has joined #openstack-cinder23:21
*** eharney_ has joined #openstack-cinder23:25
*** eharney has quit IRC23:26
*** lpetrut has quit IRC23:28
*** dustins_ has quit IRC23:28
*** fischerw has quit IRC23:31
*** jcru has quit IRC23:31
*** asselin has quit IRC23:33
*** asselin has joined #openstack-cinder23:38
*** krtaylor has quit IRC23:39
*** akerr_ has quit IRC23:40
*** erlon_ has quit IRC23:40
openstackgerritNagendra Rao Jaladanki proposed openstack/cinder-specs: Spec for Brocade Zone Driver Virtual Fabrics support  https://review.openstack.org/14438923:42
openstackgerritJohn Griffith proposed openstack/cinder: Implement clone_image caching on SolidFire  https://review.openstack.org/14285923:46
openstackgerritAnthony Lee proposed openstack/cinder: Fixed server name being retained after detach in LeftHand  https://review.openstack.org/12414523:48
*** krtaylor has joined #openstack-cinder23:52
*** dannywilson has quit IRC23:55
*** dannywilson has joined #openstack-cinder23:56
*** smoriya has joined #openstack-cinder23:59
*** patrickeast has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!