Thursday, 2015-07-30

*** haomaiwang has quit IRC00:01
*** adurbin_ has quit IRC00:01
*** haomaiwang has joined #openstack-cinder00:02
tbarronthingee: pong (sorry, just got back from commute home)00:03
jgriffithmkoderer: BTW... just for an example: https://gist.github.com/j-griffith/ad409d3beb67053b77cc00:05
jgriffithThe decorators do in fact work, but like I said in the review; it's a mute point00:06
jgriffithand on that note.. I'm getting dinner :)00:06
thingeetbarron: it's fine, figured out the answer to my question in looking at the POC to your scaling backup spec00:06
thingeetbarron: scaling is going to be a pain for FC00:06
tbarronthingee: for FibreChannel?00:06
thingeeyea00:06
thingeeassuming they're not running on the same node as c-vol00:07
*** hemna is now known as hemnafk00:07
tbarronhmm, I hadn't thought of that problem.00:07
thingeetbarron: just all the additional hba00:07
tbarronremote attach is hard?00:07
*** annashen has joined #openstack-cinder00:08
tbarronthingee: who wants FC anyways?00:08
* tbarron ducks00:08
thingeetbarron: TRUTH00:08
patrickeasto/00:09
patrickeasti’ve been told i need to like FC00:09
tbarronpatrickeast: I've been told it covers a good part of my paycheck, but I consider that dirty money :-)00:09
patrickeastlol00:09
*** rmcall has quit IRC00:10
*** raunak has joined #openstack-cinder00:10
tbarronthingee: I hadn't thought of that problem but will add it to the list of unresolved issues.00:10
*** garthb has quit IRC00:12
* thingee is getting angry with the usps, being on hold for 20 mins00:12
*** annashen has quit IRC00:12
tbarronthat sucks00:12
thingeeat this rate, the office will be closed before they get to my call00:15
*** mtanino has quit IRC00:15
*** tsekiyama has quit IRC00:16
thingeewe should've called brick cement00:16
tbarronthingee: are they holding hostage goods due to you but you were travelling when they arrived?00:16
openstackgerritVilobh Meshram proposed openstack/cinder: Cinder Nested Quota Driver  https://review.openstack.org/20536900:17
tbarronbecause it's glue00:17
thingeetbarron: no, I'm making a dispute with the usps because they're sorter didn't register a forward I had setup00:17
tbarronthingee: i see, and wish you luck00:17
thingeetbarron: their support has no idea where my package is, nor does the facility of where it was last at according to the tracking number.00:18
tbarronthingee: could a node with local FC attach and c-vol to FC connected backend offer an attach to a backup service node via tgtd/iscsi?00:18
*** patrickeast has quit IRC00:18
thingeetbarron: you want c-vol to attach, offer that device as a target to c-bak?00:19
thingeevia iscsi00:19
*** vokt has quit IRC00:19
tbarronthingee: yes, but I may be deranged.00:20
thingeetbarron: that as interesting when I suggested to use a message queue as a DLM00:20
tbarronthingee: my general idea is that c-bak is accessing volumes more or less as nova does00:20
* thingee is still sad people don't think he's a genius00:20
tbarronthingee: I followed that conversation closely as we have an init problem for c-bak (decoupled version) as well as for c-vol (geguileo's problem)00:21
*** _cjones_ has quit IRC00:21
tbarronthingee: w/o bringing HA A/A in, there are similar cleanup issues if more than one service is running00:21
thingeetbarron: my problem isn't something to be alarmed about. This problem exists with c-vol today.00:21
thingeeif you want c-vol to do anything that involves attaching a volume, you need an HBA on the node running c-vol00:22
tbarronand the ways I've brainstormed to deal with were: (1) store in the DB which service instance "owns" a bakup op, or (2) have the various backup00:22
vilobhmmjgriffith : ping00:22
tbarronservice instances talk to one another about which ops they own.00:23
*** jasondotstar has quit IRC00:23
tbarron#2 is kinda like your idea00:23
vilobhmmthingee : https://review.openstack.org/#/c/206170/4 has lots of +1 and +2…if you find this ok will save few more rebase cycles..00:24
tbarronthingee: but w.r.t. the FC problem you raised, how does a remote nova compute instance or a remote ironic node attach to an FC-connected volume today?00:25
*** marcusvrn has quit IRC00:25
tbarronthingee: I would think the problem for decoupled backup service would be similar00:25
*** lixiaoy1 has joined #openstack-cinder00:25
*** annashen has joined #openstack-cinder00:29
*** salv-orlando has quit IRC00:31
*** laughterwym has joined #openstack-cinder00:32
*** tellesnobrega has joined #openstack-cinder00:33
openstackgerritwanghao proposed openstack/cinder: Implement function to manage/unmanage snapshots  https://review.openstack.org/14459000:34
*** edmondsw has quit IRC00:34
*** annashen has quit IRC00:34
*** tellesnobrega has quit IRC00:34
thingeetbarron: that's what I'm saying00:36
thingeetbarron: I don't think it's anything to be alarmed about00:36
*** dannywilson has quit IRC00:36
tbarronthingee: got it, not alarmed, just thinkin' a little bit00:36
thingeeI think it's fine if you have a node, and just bring up vms that represent c-bak instances. not sure if that accomplishes anything00:37
openstackgerritwanghao proposed openstack/cinder: Add pagination to backups  https://review.openstack.org/20449300:37
tbarronthere is smoke coming out of tbarron's ears righ tnow00:37
*** heyun has joined #openstack-cinder00:39
tbarronthingee: well, it might be a start towards elastic data motion services (waving hands).  The backup, copy, migrate, etc. operations have scaling00:39
tbarronchallenges very difft than most of the rest of cinder.00:39
tbarronA lot of the rest could run on a rasberry pi00:39
* tbarron ducks00:39
tbarronif the rasberry pi had massive DB access :-)00:40
tbarronthingee: that is to say, most is control plane scaling, where the danger is DOS b/c of bad DB access.00:40
tbarron(I'm sure there's a lot more there I don't know, but I think in broad strokes what I'm saying may be correct.)00:41
tbarronBut the data motion operations, which tend to run a long time, use lots of network, lots of bandwitdh in data path to the actual backend.00:42
tbarronhave a different set of scaling challenges.00:42
tbarronI see backup, which is already a separate service, as an opportunity to begin thinking about elastic data motion services for cinder.00:43
tbarronthingee: that could all be a crock, but it's my self-motivational speech for being interested in this backup problem right now.00:43
tbarronthese data motion operations are in principle very loosely coupled to the rest of cinder, or even to one another as long as they operate on separate volumes.00:45
tbarronbut there are corner cases where some of the interesting distributed computing consistency issues like those you were discussing with Gorka, John, and Eric come up.00:46
*** daneyon has quit IRC00:48
*** daneyon has joined #openstack-cinder00:48
*** jwcroppe has joined #openstack-cinder00:49
*** daneyon has quit IRC00:49
thingeetbarron: so this purely wip, not ready for testing?00:49
*** daneyon has joined #openstack-cinder00:49
tbarronthingee: I had it running before xyang's non-disruptive backup merged.  I've rebased but need to do a bit more work to ensure it still works.00:50
*** daneyon has quit IRC00:51
tbarronBy "works" I mean it worked for LVM c-vol and multi-node devstack with c-back running on three nodes.00:51
*** daneyon has joined #openstack-cinder00:52
tbarronIt won't work for c-vol backends that are doing special weird stuff in their backup and restore methods like vmware.00:52
thingeetbarron: mind pasting me your local.conf's ... I haven't done a multinode devstack yet.00:52
jdurginlixiaoy1: re: full restore when backup['volume_id'] == volume['id'], I think that's a short circuit to tell that the volume already contains data00:52
thingeejdurgin: hi00:53
jdurginthingee: hey00:53
thingeejdurgin: haven't seen you in a while :)00:53
tbarronFor those we'd probably need to make some kind of pre-attach (or overide the attach I amd using) so that they can do whatever they do besides just make a file handle available.00:53
jdurginthingee: I'm still around :)00:53
tbarronthingee: yeah, I'll send them to you.00:53
thingeetbarron: anything to make getting things tested easier for me is well appreciated.00:53
tbarronthingee: yeah, I know you are real busy, especially right now.00:54
thingeetbarron: unfortunately this is my list, but you're in there: image caching, volume migration, nested quotas, scaling backups00:54
thingeetbarron: just in the order people have bugged me :P00:54
thingeeor me being interested in testing something00:54
tbarronthingee: so since we are talking about it, the drop dead date for continuing to work on this backup scaliing in Liberty requires that this backup bp-spce be approved Friday?00:55
thingeetbarron: cool, I should be fine with the spec. I have dinner and dance lessons soon, but should be back on later.00:55
thingeeDuncanT: ^00:55
*** vilobhmm has quit IRC00:55
thingeetbarron: yes00:55
tbarronthingee: I think there is productive investigation we can do iin this time frame, but can't promise that we'll get all the problems solved.00:56
thingeetbarron: I haven't figured out how I'm going to approve my own specs. Maybe have jgriffith do them00:56
*** daneyon has quit IRC00:56
tbarronthingee: I'll +1 :-)00:56
tbarronthingee: ballroom dancing?00:56
*** zhonghua has joined #openstack-cinder00:56
thingeetbarron: swing and rumba right now00:56
tbarronthingee: I'll let you go.  I gotta call my Dad in a minute.00:57
thingeeseeya00:57
tbarronI took swing and rumba but that's another story.00:57
*** vilobhmm has joined #openstack-cinder00:57
openstackgerritVilobh Meshram proposed openstack/cinder: Cinder Nested Quota Driver  https://review.openstack.org/20536900:58
*** jasondotstar has joined #openstack-cinder00:58
*** h00327910__ has joined #openstack-cinder00:59
*** mriedem has joined #openstack-cinder00:59
*** vilobhmm1 has joined #openstack-cinder00:59
*** haomaiwang has quit IRC01:01
*** vilobhmm has quit IRC01:02
*** haomaiwang has joined #openstack-cinder01:02
*** Apoorva has quit IRC01:03
*** vilobhmm1 has quit IRC01:04
*** leeantho has quit IRC01:06
*** Strony has quit IRC01:08
*** zhonghua is now known as zhonghua-lee01:12
openstackgerritwanghao proposed openstack/cinder: Enhance deletion efficiency when backup init host  https://review.openstack.org/20635901:15
thingeescottda__: did we get the coffee dispenser thing figured out?01:21
thingeescottda__: trying to figure out if I need to buy some beans before I head out.01:21
*** ganso_ has quit IRC01:25
openstackgerritLi Yingjun proposed openstack/cinder: Validate 'is_public' when creating volume type  https://review.openstack.org/20678401:25
openstackgerritLi Yingjun proposed openstack/cinder: Add the ability to update type public status  https://review.openstack.org/20678801:25
*** mylu has joined #openstack-cinder01:28
*** chlong has joined #openstack-cinder01:29
*** annashen has joined #openstack-cinder01:30
lixiaoy1:jdurgin Thanks01:33
*** annashen has quit IRC01:35
lixiaoy1Hi guys. Anyone who know encryption feature? I noticed that I created a volume in ceph with encrption type, but it failed to attach to VM as no device_path in connection_info. Does ceph volume with encryption not been supported?01:35
*** jasondotstar has quit IRC01:35
lixiaoy1I am not sure whether this is by design. if yes, I think we should prevent created ceph volume with encryption type.01:36
*** akerr has quit IRC01:42
*** vilobhmm has joined #openstack-cinder01:47
*** vilobhmm1 has joined #openstack-cinder01:51
*** vilobhmm has quit IRC01:51
*** mylu has quit IRC02:00
*** haomaiwang has quit IRC02:01
*** mylu has joined #openstack-cinder02:01
*** haomaiwang has joined #openstack-cinder02:02
*** annashen has joined #openstack-cinder02:05
*** davechen has joined #openstack-cinder02:06
*** davechen is now known as davehcne02:06
*** davehcne is now known as davechen02:06
*** annegentle has quit IRC02:06
*** mylu has quit IRC02:07
openstackgerritWenPing Zhang proposed openstack/cinder: New cinder driver to support Daowoo YeeSan  https://review.openstack.org/20244002:14
*** davechen1 has joined #openstack-cinder02:15
*** davechen has quit IRC02:17
*** davechen1 is now known as davechen02:17
*** dims has quit IRC02:19
*** dims has joined #openstack-cinder02:19
*** mylu has joined #openstack-cinder02:22
*** akshai has quit IRC02:23
*** akshai has joined #openstack-cinder02:23
*** akshai has quit IRC02:24
openstackgerritwanghao proposed openstack/cinder: Implement function to manage/unmanage snapshots  https://review.openstack.org/14459002:25
*** vilobhmm1 has quit IRC02:26
*** BharatK has quit IRC02:26
*** raunak has quit IRC02:27
*** mriedem1 has joined #openstack-cinder02:29
*** bill_az has quit IRC02:30
*** jasondotstar has joined #openstack-cinder02:31
*** annashen_ has joined #openstack-cinder02:31
*** mriedem has quit IRC02:31
*** annashen_ has quit IRC02:36
*** earlephilhower_ has joined #openstack-cinder02:39
*** earlephilhower has quit IRC02:41
*** jasondotstar has quit IRC02:41
*** BharatK has joined #openstack-cinder02:43
*** Apoorva has joined #openstack-cinder02:46
*** changbl has quit IRC02:47
*** annegentle has joined #openstack-cinder02:50
*** hakimo_ has joined #openstack-cinder02:52
*** hakimo has quit IRC02:54
*** breitz has quit IRC02:55
*** dims has quit IRC02:57
*** haomaiwang has quit IRC03:01
*** haomaiwang has joined #openstack-cinder03:01
*** earlephilhower_ is now known as earlephilhower03:04
*** changbl has joined #openstack-cinder03:07
*** breitz has joined #openstack-cinder03:07
*** jungleboyj has joined #openstack-cinder03:14
*** annegentle has quit IRC03:20
*** markvoelker_ has quit IRC03:20
openstackgerritLisaLi proposed openstack/cinder: Fix error message in cinder/api/v2/volumes.py  https://review.openstack.org/20728003:21
*** markvoelker_ has joined #openstack-cinder03:22
openstackgerritVincent Hou proposed openstack/cinder: Adds the migration progress support for migration  https://review.openstack.org/20495303:24
*** annegentle has joined #openstack-cinder03:26
*** annegentle has quit IRC03:26
*** kvidvans has quit IRC03:28
*** annashen_ has joined #openstack-cinder03:32
*** julim has quit IRC03:32
*** jwcroppe has quit IRC03:33
*** jwcroppe has joined #openstack-cinder03:34
*** laughterwym_ has joined #openstack-cinder03:36
*** laughterwym has quit IRC03:36
*** annashen_ has quit IRC03:37
*** jwcroppe has quit IRC03:38
*** annegentle has joined #openstack-cinder03:40
*** jamielennox|away is now known as jamielennox03:47
*** shyama has joined #openstack-cinder03:53
*** esker has joined #openstack-cinder03:53
openstackgerritDave Chen proposed openstack/cinder: Role based properties protection  https://review.openstack.org/16009003:58
openstackgerritDave Chen proposed openstack/cinder: Policies based properties protection  https://review.openstack.org/16014503:58
*** coolsvap|away is now known as coolsvap03:59
*** mylu has quit IRC04:00
*** haomaiwang has quit IRC04:01
*** avishay has joined #openstack-cinder04:01
openstackgerritTeruaki Ishizaki proposed openstack/cinder: Add missing backup/restore methods to Sheepdog driver  https://review.openstack.org/16292704:01
*** 16WAAEKLZ has joined #openstack-cinder04:02
*** annashen has quit IRC04:03
*** harlowja_at_home has joined #openstack-cinder04:13
*** lpetrut has joined #openstack-cinder04:14
*** salv-orlando has joined #openstack-cinder04:21
*** salv-orlando has quit IRC04:25
*** annashen has joined #openstack-cinder04:33
*** jamielennox is now known as jamielennox|away04:33
*** zhonghua-lee has quit IRC04:34
*** zhonghua-lee has joined #openstack-cinder04:36
*** annashen has quit IRC04:38
*** sakaYK has joined #openstack-cinder04:42
*** annegentle has quit IRC04:44
*** deepakcs has joined #openstack-cinder04:48
*** annashen has joined #openstack-cinder04:50
*** shausy has joined #openstack-cinder04:57
*** 16WAAEKLZ has quit IRC05:01
*** haomaiwang has joined #openstack-cinder05:02
*** ub2 has quit IRC05:05
*** yrabl_afk has quit IRC05:06
*** shyama has quit IRC05:06
*** yrabl has joined #openstack-cinder05:06
*** harlowja_at_home has quit IRC05:10
*** shyama has joined #openstack-cinder05:11
*** sakaYK has quit IRC05:14
*** annashen has quit IRC05:18
*** amickus has joined #openstack-cinder05:21
*** laughterwym__ has joined #openstack-cinder05:32
*** annashen has joined #openstack-cinder05:34
*** laughterwym_ has quit IRC05:35
*** vilobhmm has joined #openstack-cinder05:36
*** shausy has quit IRC05:37
*** shausy has joined #openstack-cinder05:38
*** zhonghua-lee has quit IRC05:38
*** zhonghua-lee has joined #openstack-cinder05:39
*** annashen has quit IRC05:39
*** lpetrut has quit IRC05:41
*** Apoorva has quit IRC05:43
*** annashen has joined #openstack-cinder05:45
*** dannywilson has joined #openstack-cinder05:49
*** shyama has quit IRC05:49
*** lpetrut has joined #openstack-cinder05:52
*** salv-orlando has joined #openstack-cinder05:54
*** salv-orlando has quit IRC05:55
*** salv-orlando has joined #openstack-cinder05:56
*** agarciam has joined #openstack-cinder05:57
*** lpetrut has quit IRC05:59
*** haomaiwang has quit IRC06:01
*** haomaiwang has joined #openstack-cinder06:02
*** BharatK has quit IRC06:04
*** nkrinner has joined #openstack-cinder06:06
*** dannywilson has quit IRC06:11
*** dannywilson has joined #openstack-cinder06:12
*** esker has quit IRC06:13
*** agarciam has quit IRC06:14
*** agarciam has joined #openstack-cinder06:14
*** shausy has quit IRC06:15
*** shausy has joined #openstack-cinder06:15
*** zhonghua-lee has quit IRC06:20
*** smyz709 has joined #openstack-cinder06:23
*** abehl has joined #openstack-cinder06:24
*** sakaYK has joined #openstack-cinder06:25
*** smyz709 has quit IRC06:29
*** ankit_ag has joined #openstack-cinder06:29
*** rmcall has joined #openstack-cinder06:30
*** rmcall has quit IRC06:33
*** thingee has quit IRC06:33
*** thingee_ is now known as thingee06:33
*** annashen_ has joined #openstack-cinder06:35
openstackgerritXinXiaohui proposed openstack/cinder: capacity-headroom  https://review.openstack.org/20692306:36
*** annashen_ has quit IRC06:39
*** vlaza has joined #openstack-cinder06:43
*** david-lyle has quit IRC06:43
*** Apoorva has joined #openstack-cinder06:43
*** agarciam has quit IRC06:45
*** agarciam has joined #openstack-cinder06:45
*** annashen has quit IRC06:46
*** shyama has joined #openstack-cinder06:46
*** BharatK has joined #openstack-cinder06:48
*** Apoorva has quit IRC06:48
*** vilobhmm has quit IRC06:49
openstackgerritVincent Hou proposed openstack/python-cinderclient: Change cinderclient according to volume migration improvement  https://review.openstack.org/18954706:49
*** david-lyle has joined #openstack-cinder06:49
*** BharatK has quit IRC06:51
*** BharatK has joined #openstack-cinder06:51
kjellyHi, guys, Does anyonoe know why “invisible_key” disappear in expected result?06:51
kjellyhttps://github.com/openstack/cinder/blob/master/cinder/tests/unit/api/v2/test_volumes.py#L152506:51
*** bkopilov has quit IRC06:52
*** sgotliv has quit IRC06:55
*** bkopilov has joined #openstack-cinder06:55
*** vilobhmm has joined #openstack-cinder06:56
openstackgerritVincent Hou proposed openstack/cinder: Volume status management during migration  https://review.openstack.org/18631206:59
*** haomaiwang has quit IRC07:01
openstackgerritVincent Hou proposed openstack/cinder: Adds the migration progress support for migration  https://review.openstack.org/20495307:02
*** haomaiwang has joined #openstack-cinder07:02
*** rakesh_mishra has joined #openstack-cinder07:05
rakesh_mishraHello,07:05
*** abhishekk has joined #openstack-cinder07:06
rakesh_mishracan anyone tell me how i can upgrade from juno to kilo07:06
*** belmoreira has joined #openstack-cinder07:10
openstackgerritVincent Hou proposed openstack/cinder: Adds the migration progress support for migration  https://review.openstack.org/20495307:12
*** ronis has joined #openstack-cinder07:14
*** salv-orlando has quit IRC07:15
*** markus_z has joined #openstack-cinder07:16
*** Lee1092 has joined #openstack-cinder07:17
*** dannywilson has quit IRC07:18
*** lihit has joined #openstack-cinder07:19
*** ub has joined #openstack-cinder07:19
*** lihit has quit IRC07:19
*** kodoku has joined #openstack-cinder07:24
*** vilobhmm1 has joined #openstack-cinder07:24
openstackgerritVipin Balachandran proposed openstack/cinder: VMware: Deprecate vCenter version less than 5.1  https://review.openstack.org/20732107:24
*** chlong has quit IRC07:25
*** vilobhmm has quit IRC07:26
openstackgerritVipin Balachandran proposed openstack/cinder: VMware: Deprecate vCenter version less than 5.1  https://review.openstack.org/20732107:28
*** jwcroppe has joined #openstack-cinder07:29
openstackgerritVipin Balachandran proposed openstack/cinder: VMware: Deprecate vCenter version less than 5.1  https://review.openstack.org/20732107:30
*** vilobhmm1 has quit IRC07:31
*** BharatK_ has joined #openstack-cinder07:33
*** shyama has quit IRC07:34
*** BharatK has quit IRC07:35
*** annashen has joined #openstack-cinder07:35
-openstackstatus- NOTICE: Our CI system is broken again today, jobs are not getting processed at all.07:39
*** ChanServ changes topic to "Our CI system is broken again today, jobs are not getting processed at all."07:39
*** annashen has quit IRC07:40
*** rmcall has joined #openstack-cinder07:45
*** amickus has quit IRC07:46
*** ndipanov has quit IRC07:46
-openstackstatus- NOTICE: CI system is broken and very far behind. Please do not approve any changes for a while.07:49
*** ChanServ changes topic to "CI system is broken and very far behind. Please do not approve any changes for a while."07:49
*** sgotliv has joined #openstack-cinder07:53
*** jordanP has joined #openstack-cinder07:55
*** jamielennox|away is now known as jamielennox07:57
*** haomaiwang has quit IRC08:01
*** haomaiwang has joined #openstack-cinder08:02
*** shyama has joined #openstack-cinder08:09
*** markus_z has quit IRC08:09
*** rmcall has quit IRC08:12
*** kodoku has quit IRC08:17
*** zhonghua-lee has joined #openstack-cinder08:19
openstackgerritAnton Arefiev proposed openstack/cinder: Add Cinder API WSGI app to run under Apache/Nginx  https://review.openstack.org/20055108:20
openstackgerritAnton Arefiev proposed openstack/cinder: Add instructions on how deploy API under Apache  https://review.openstack.org/20702008:21
openstackgerritPranali Deore proposed openstack/cinder: Validate name and description string  https://review.openstack.org/18299408:24
openstackgerritPranali Deore proposed openstack/cinder: Validate string, integer limit for input parameter  https://review.openstack.org/19496808:24
*** jistr has joined #openstack-cinder08:25
*** kodoku has joined #openstack-cinder08:25
*** laughterwym__ has quit IRC08:28
*** zhonghua-li has joined #openstack-cinder08:29
DuncanTaarefiev: Any idea who is working on CI for the WSGI deploy?08:29
openstackgerritAbhishek Shrivastava proposed openstack/cinder: Adding delete-wait-loop for CloudByte Volumes  https://review.openstack.org/20105908:30
DuncanTaarefiev: It was something discussed during the spec phase as being a requirement08:30
aarefievDuncanT: maybe I will or e0ne08:31
DuncanTaarefiev: Thanks. I just wanted to ensure it was on somebody's road map. At a glance the patches look fine, I'll take a proper look later08:31
*** zhonghua-lee has quit IRC08:33
aarefiev DuncanT: ok, thanks, I've made patch for devstack, so I think CI shouldn't be a problem08:33
DuncanTaarefiev: Perfect08:33
*** afazekas has joined #openstack-cinder08:33
*** annashen has joined #openstack-cinder08:36
*** jwcroppe has quit IRC08:37
*** salv-orlando has joined #openstack-cinder08:37
*** jwcroppe has joined #openstack-cinder08:38
aarefievDuncanT: about https://review.openstack.org/#/c/143645/08:39
aarefievI have some doubts about tenant id validation after speaking with you08:39
*** annashen has quit IRC08:41
DuncanTaarefiev: It's not a trivial problem, certainly08:41
DuncanTaarefiev: On admin-only paths it is a little less worrying, but there's no guarantee that the tenant with cinder admin rights has enough keystone rights to validate the tenant08:42
*** jwcroppe has quit IRC08:42
DuncanTaarefiev: We /could/ use a magic service tenant to do it, but I don't want to see it in none-admin paths since blocking calls in the API lead to DoS conditions easily08:43
aarefievDuncanT: yea, also we should think about more generally approach here, possibly nova has the same problem08:43
johnthetubaguyDuncanT: that has come up, we should co-ordinate around that, ideally08:44
johnthetubaguyswift and glance have a concept of swift resources needing both the tenant token and a service token to access them08:44
johnthetubaguyNova has the concept of a "locked" resource, i.e. you can see it but not alter it in any way08:45
johnthetubaguyso we were thinking of combining the two, do you "lock" a Nova resources with a service token, or something like that08:45
johnthetubaguyso to boot/snapshot/delete the instance you would need to have both the service token and the users token08:46
DuncanTjohnthetubaguy: The service token stuff we can use for swift access during backup too - I'd hoped to find time to implement it this cycle - I had some some input on the service token design on the swift end to make them suitable for our usecase08:46
johnthetubaguyalthough honestly, we are a long way from an agreed approach at this point08:46
johnthetubaguyDuncanT: ah, interesting, sounds like we are going in similar directions, although we are quite a long way from agreement at this point, in my head I am targeting getting a spec merged/proposed before the Mitaka summit08:47
*** lpetrut has joined #openstack-cinder08:47
*** aix has joined #openstack-cinder08:47
DuncanTjohnthetubaguy: I'm sure it can be used to improve our nova interactions too - some calls to cinder should only ever come via nova (reserve, init_connection, etc) on a normal setup, never direct from the tenant, and nova has some api that cinder calls (assisted snap among them) that again should only ever come via cinder08:48
johnthetubaguyDuncanT: +10008:48
aarefievDuncanT: +108:48
johnthetubaguyDuncanT: I would love for the service token to be used, so it doesn't matter if a users token is expired, its still accepted as previously valid (its more of an issue with glance, honestly)08:48
*** salv-orlando has quit IRC08:49
DuncanTjohnthetubaguy: The swift work should be far easier since it is 90% 'copy what glance did'08:49
johnthetubaguyyes, that makes sense08:49
DuncanTjohnthetubaguy: I don't *think* you get that behaviour currently, you need to add a trust into the mix for that, I believe08:49
johnthetubaguyI feel a cross project session coming on, I think there is an etherpad for those now08:49
johnthetubaguyDuncanT: yeah, you are right, I think you do currently08:50
johnthetubaguyDuncanT: I got my dreaming hat on, where security issues seems to melt away, oops08:50
DuncanTjohnthetubaguy: Trusts and backup are something else people are working on - there's a draft patch around for it somewhere08:50
DuncanTjohnthetubaguy: We should probably use them for glance too at some point08:50
johnthetubaguyDuncanT: yeah, I need to get my nose into that, the policy stuff is similar08:50
johnthetubaguyDuncanT: we are talking about a new lib to talk to glance that could deal with all this, to stop the repeated code between cinder and glance, but I have to run in a bit, be I should try write some of this up on the ML next week (I hope I remember to do that)08:51
johnthetubaguy(or someone else does it :) )08:51
DuncanTjohnthetubaguy: I've been ignoring policy for a while08:52
DuncanTjohnthetubaguy: I'll keep an eye out for the post. Please tag it as cinder, since I'll see it far faster that way08:52
johnthetubaguyDuncanT: yeah, good point08:53
openstackgerritKuo-tung Kao proposed openstack/cinder: Don't use context.elevated to get volume.  https://review.openstack.org/20645008:53
*** zhonghua-li has quit IRC08:53
*** lixiaoy1 has quit IRC08:56
openstackgerritwanghao proposed openstack/python-cinderclient: Add to_dict method to Resource class  https://review.openstack.org/20734008:57
aarefievDuncanT: could you take a look on https://review.openstack.org/#/c/165403/ once more time, please08:58
*** ChanServ changes topic to "The OpenStack Block Storage Project Cinder | The New Kids On the Block | https://wiki.openstack.org/wiki/Cinder"08:58
-openstackstatus- NOTICE: CI is back online but has a huge backlog. Please be patient and if possible delay approving changes until it has caught up.08:58
kjellyhi, guys. In the return value of “self.db.volume_get”, why the type of volumes[“volume_metadata”] is list of “cinder.db.sqlalchemy.models.VolumeMetadata” instead of dict ? The api expose the implement to caller.08:59
kjellyhttps://github.com/openstack/cinder/blob/master/cinder/volume/api.py#L40708:59
*** rakesh_mishra has quit IRC08:59
kjellythe volume looks like {'migration_status': None, 'provider_id': None, 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2015, 7, 30, 2, 15, 25), 'provider_geometry': None, 'replication_extended_status': None, 'replication_status': u'disabled', 'snapshot_id': None, 'ec2_id': None, 'deleted_at': None, 'id': u'aa71155a-d17d-481a-bdb9-af7b97654ff2', 'size': 1L, 'user_id': u'd91955965f7a47ddbcc8f7c6a98ee488', 'volume_09:00
kjellyattachment': [], 'display_description': None, 'volume_admin_metadata': [<cinder.db.sqlalchemy.models.VolumeAdminMetadata object at 0x7f57b3389350>], 'encryption_key_id': None, 'project_id': u'da3bbc6e175541b0ac1952135838bf30', 'launched_at': datetime.datetime(2015, 7, 30, 2, 15, 25), 'scheduled_at': datetime.datetime(2015, 7, 30, 2, 15, 24), 'status': u'available', 'volume_type_id': u'03357ed8-567e-4755-8cc4-8cd1ba725e7f', 'multiattach': False, '09:00
kjellydeleted': False, 'provider_location': None, 'host': u'user-GA-6PXSV3@lvm#lvm', 'consistencygroup_id': None, 'source_volid': None, 'provider_auth': None, 'display_name': u'a', 'bootable': False, 'created_at': datetime.datetime(2015, 7, 30, 2, 15, 24), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x7f57b33dc990>, 'consistencygroup': None, '_name_id': None, 'volume_metadata': [<cinder.db.sqlalchemy.09:00
kjellymodels.VolumeMetadata object at 0x7f57b33fd490>, <cinder.db.sqlalchemy.models.VolumeMetadata object at 0x7f57b3389910>], 'replication_driver_data': None}09:00
*** haomaiwang has quit IRC09:01
*** ndipanov has joined #openstack-cinder09:01
*** haomaiwang has joined #openstack-cinder09:02
*** e0ne has joined #openstack-cinder09:03
*** chlong has joined #openstack-cinder09:07
*** bluex-pl has joined #openstack-cinder09:09
openstackgerritwanghao proposed openstack/cinder: Add ability to filter by volume_glance_metadata  https://review.openstack.org/14773809:11
openstackgerritwanghao proposed openstack/python-cinderclient: Add to_dict method to Resource class  https://review.openstack.org/20734009:12
*** kodoku has quit IRC09:20
*** jwcroppe has joined #openstack-cinder09:20
*** jwcroppe has quit IRC09:21
*** jwcroppe has joined #openstack-cinder09:21
*** jwcroppe_ has joined #openstack-cinder09:23
*** jwcroppe_ has quit IRC09:23
*** jwcroppe_ has joined #openstack-cinder09:24
*** jamielennox is now known as jamielennox|away09:25
*** sasi has joined #openstack-cinder09:26
*** jwcroppe has quit IRC09:27
*** jwcroppe_ has quit IRC09:28
*** sasi has quit IRC09:30
*** ig0r_ has joined #openstack-cinder09:32
*** sakaYK has quit IRC09:34
*** ishant has joined #openstack-cinder09:35
*** annashen has joined #openstack-cinder09:37
*** salv-orlando has joined #openstack-cinder09:38
*** jwcroppe has joined #openstack-cinder09:38
kjellyhi, guys. In volume_get, the return value contains some object whose type is cinder.db.sqlalchemy.models.VolumeMetadata. Should I report bug for it?09:39
*** jwcroppe has quit IRC09:40
*** annashen has quit IRC09:42
kjellyhttps://github.com/openstack/cinder/blob/master/cinder/db/sqlalchemy/api.py#L133609:46
*** davechen has left #openstack-cinder09:46
*** Apoorva has joined #openstack-cinder09:46
*** kjelly has quit IRC09:49
*** dims has joined #openstack-cinder09:50
*** Apoorva has quit IRC09:51
e0nekjelly: it's strange. this methid shoud return Volume object09:51
*** coolsvap is now known as coolsvap|away09:55
*** haomaiwang has quit IRC10:01
*** alexpilotti has joined #openstack-cinder10:01
*** haomaiwang has joined #openstack-cinder10:01
deepakcse0ne: when u have some time, have implemented ur commetns. https://review.openstack.org/#/q/status:open+project:openstack/cinder+branch:master+topic:bp/assisted-snapshot-improvements,n,z10:06
*** zhonghua-li has joined #openstack-cinder10:06
*** shyama has quit IRC10:10
e0nedeepakcs: thanks. i added 'recheck' comment to run ci again10:10
deepakcse0ne: given the state of CI, I didn't feel we should do a recheck :)10:11
e0nedeepakcs: :)10:11
deepakcse0ne: anyways, can u review the patches, until then hopefully CI gets back to normak10:11
deepakcs*normal10:11
e0nedeepakcs: sure. i'll review your patches later today10:12
*** shausy has quit IRC10:12
*** shausy has joined #openstack-cinder10:13
*** jasondotstar has joined #openstack-cinder10:15
geguileoe0ne: Have a minute to discuss the backup import issue?10:19
e0negeguileo: yep10:19
geguileoe0ne: I have done tests and it works  r:-??10:19
e0negeguileo: did you change anything in your patch?10:20
geguileoe0ne: No10:20
geguileoe0ne: What were your steps?10:20
e0negeguileo: o_010:20
geguileoe0ne: I think you are actually deleting the backup10:20
geguileoe0ne: cinder backup-delete BACKUP-ID10:20
e0negeguileo: 2minutes, plz10:21
geguileoe0ne: And then you are trying to restore it10:21
e0negeguileo: i'' delete volumes and backupd and try again10:21
geguileoe0ne: If you delete the backup then there's nothing to restore from10:21
*** kbyrne has quit IRC10:21
geguileoe0ne: You have deleted the backup10:21
geguileoe0ne: it's like deleting a volume and then trying to do something with it10:22
e0negeguileo: oops10:22
e0negeguileo: that was i did10:22
geguileoe0ne: You need to delete the row in the DB10:22
geguileoe0ne: Manually10:22
e0negeguileo: you're right10:22
e0negeguileo: please, give me few minutes to test it10:23
openstackgerritAnton Arefiev proposed openstack/cinder-specs: Rootwrap daemon mode  https://review.openstack.org/13731810:23
geguileoe0ne: Oh, as long as you need, there's no hurry10:23
e0negeguileo: and i'll be happy to remove -1 from your patch10:23
*** kbyrne has joined #openstack-cinder10:23
geguileoe0ne: I just wanted to confirm that that's what you had done  :-)10:23
openstackgerritXiangfei Zhu proposed openstack/cinder: VMware: Fix re-attach volume error for VC 5.1  https://review.openstack.org/20738010:24
e0negeguileo: you're absolutly right!10:27
e0negeguileo: i failed10:27
e0negeguileo: thank you for pointing me where i was wrong. removed -110:29
e0negeguileo: i'll review your patch once again a bit later10:29
geguileoe0ne: Thanks10:30
e0negeguileo: thanks you for clarification and fixing it10:30
geguileoe0ne: np10:30
*** jwcroppe has joined #openstack-cinder10:32
*** shausy has quit IRC10:32
*** sgotliv has quit IRC10:37
*** annashen has joined #openstack-cinder10:38
*** shausy has joined #openstack-cinder10:38
*** shyama has joined #openstack-cinder10:39
*** aix has quit IRC10:39
openstackgerritDeepak C Shetty (deepakcs) proposed openstack/cinder: Cinder part of volume snapshot improvements  https://review.openstack.org/17280810:41
openstackgerritDeepak C Shetty (deepakcs) proposed openstack/cinder: db: Add support for snapshot_admin_metadata  https://review.openstack.org/20397910:41
*** annashen has quit IRC10:42
openstackgerritVipin Balachandran proposed openstack/cinder: VMware: Fix protocol in backend stats  https://review.openstack.org/20738810:44
*** msno has joined #openstack-cinder10:45
msnodid anyone had any issue configuring netapp NFS with Juno release of openstack10:46
msnoJuno + Cinder + NetAPP + NFS10:46
msnothe vol creation is not working for me when suing NetAPP with NFS10:46
*** heyun has quit IRC10:46
msnowhere as manual mounting of the NFS share to the controller node is working fine10:46
openstackgerritSergey Vilgelm proposed openstack/cinder: Switch to the oslo_utils.fileutils  https://review.openstack.org/19953710:47
*** zhonghua-li has quit IRC10:51
*** zhonghua-li has joined #openstack-cinder10:51
*** sgotliv has joined #openstack-cinder10:51
*** timcl has joined #openstack-cinder10:55
openstackgerritVincent Hou proposed openstack/cinder: Adds the migration progress support for migration  https://review.openstack.org/20495311:00
*** haomaiwang has quit IRC11:01
*** dims_ has joined #openstack-cinder11:02
*** svilgelm has joined #openstack-cinder11:02
*** jwcroppe has quit IRC11:02
*** dims has quit IRC11:02
*** 7GHAAT9JB has joined #openstack-cinder11:02
*** zhenguo has quit IRC11:04
tbarronmsno: does c-vol log show that the mount is failing?11:07
tbarronmsno: there is not some general issue with cinder + netapp + juno + nfs, so something needs to be re-configured.11:08
tbarronmsno: maybe take the discussion to #openstack-netapp ...11:09
msnotbarron, i alsready asked there.. let me try again11:09
tbarronmsno: a lot of us are in the US, just waking up :-)11:10
msnotbarron, yes .. i know :) thats why i am waiting11:10
*** sgotliv has quit IRC11:12
*** aix has joined #openstack-cinder11:13
*** shyama has quit IRC11:13
tbarronmsno: well, I'm getting a cup of coffee and heading over to that channel11:13
msnotbarron, sure.. meanwhile .. let me reproduce the issue11:14
msnoif not today.. i will get in touch with you later11:14
msnoin netapp channel11:14
*** svilgelm has left #openstack-cinder11:15
tbarronmsno: cool.  you should be able to get the mount to work manually then use the same nfs options in your cinder.conf11:16
tbarronmsno: assuming that the problem is with cinder doing the  mount successfully11:16
msnotbarron, sure .. let me check ..11:16
msnobtw: does netapp NFS support both NFS V 4 and V3?11:16
msnotbarron, as per my debbugging .. the vol creation is getting failed when its doen via cinder.. Without cinder .. its working fine11:17
tbarronmsno: both v4 and v3 are supported11:18
msnotbarron, ok11:18
tbarronmsno: the filers have config options though and some admins turn off one or the other11:18
msnotbarron, ok.. i will check those11:19
*** ganso_ has joined #openstack-cinder11:19
*** jasondotstar has quit IRC11:19
tbarronthe c-vol logs will show if the mount succeeds or fails from cinder.  That is likely the first thing to check.11:20
msnotbarron, ok11:20
*** sgotliv has joined #openstack-cinder11:24
*** zhonghua-li has quit IRC11:25
*** deepakcs has quit IRC11:25
*** salv-orl_ has joined #openstack-cinder11:25
*** salv-orlando has quit IRC11:26
*** cdelatte has quit IRC11:35
*** annashen has joined #openstack-cinder11:39
openstackgerritDaniel Tadrzak proposed openstack/cinder: ConsistencyGroup Object  https://review.openstack.org/16364111:41
*** annashen has quit IRC11:43
*** aagrawal has joined #openstack-cinder11:45
*** jordanP has quit IRC11:46
*** marcusvrn has joined #openstack-cinder11:47
*** e0ne has quit IRC11:47
*** jordanP has joined #openstack-cinder11:47
openstackgerritDaniel Tadrzak proposed openstack/cinder: CGSnapshot Object  https://review.openstack.org/19502711:50
*** cdelatte has joined #openstack-cinder11:51
*** delattec has joined #openstack-cinder11:51
openstackgerritVincent Hou proposed openstack/cinder: Adds the migration progress support for migration  https://review.openstack.org/20495311:53
*** bswartz has quit IRC11:57
*** aagrawal has quit IRC11:58
*** aagrawal has joined #openstack-cinder11:58
*** 7GHAAT9JB has quit IRC12:01
*** haomaiwang has joined #openstack-cinder12:02
*** cdelatte has quit IRC12:03
*** delattec has quit IRC12:03
*** msno has quit IRC12:04
*** lpabon has joined #openstack-cinder12:07
*** shyama has joined #openstack-cinder12:07
*** akerr has joined #openstack-cinder12:09
*** agarciam has quit IRC12:10
*** ishant has quit IRC12:11
openstackgerritLi Yingjun proposed openstack/cinder: Validate 'is_public' when creating volume type  https://review.openstack.org/20678412:12
openstackgerritGorka Eguileor proposed openstack/cinder: Move import and export backup metadata to object  https://review.openstack.org/20092712:15
openstackgerritGorka Eguileor proposed openstack/cinder: Fix backup metadata import missing fields  https://review.openstack.org/18322212:15
*** aagrawal has quit IRC12:18
*** aagrawal has joined #openstack-cinder12:18
*** edmondsw has joined #openstack-cinder12:19
*** eharney has quit IRC12:21
*** jasondotstar has joined #openstack-cinder12:22
*** jwcroppe has joined #openstack-cinder12:23
*** ericksonsantos has joined #openstack-cinder12:25
*** aagrawal has quit IRC12:30
*** aagrawal has joined #openstack-cinder12:30
*** jamielennox|away is now known as jamielennox12:35
*** bswartz has joined #openstack-cinder12:39
*** annashen has joined #openstack-cinder12:40
*** aagrawal has quit IRC12:41
*** aagrawal has joined #openstack-cinder12:41
*** annashen has quit IRC12:44
*** markstur_ has joined #openstack-cinder12:48
*** dustins has joined #openstack-cinder12:48
*** Apoorva has joined #openstack-cinder12:48
*** aagrawal has quit IRC12:50
*** aagrawal has joined #openstack-cinder12:50
*** Apoorva has quit IRC12:53
*** e0ne has joined #openstack-cinder12:54
*** salv-orl_ has quit IRC12:54
*** nkrinner has quit IRC12:55
*** aagrawal has quit IRC12:55
*** aagrawal has joined #openstack-cinder12:55
*** aagrawal has quit IRC12:59
*** aagrawal has joined #openstack-cinder13:00
*** haomaiwang has quit IRC13:01
*** haomaiwang has joined #openstack-cinder13:02
*** markstur_ has left #openstack-cinder13:03
*** Yogi1 has joined #openstack-cinder13:03
openstackgerritYuriy Nesenenko proposed openstack/cinder: Add support '--all-tenants' argument for admin for cinder backup-list  https://review.openstack.org/20745113:04
*** akshai has joined #openstack-cinder13:04
*** markus_z has joined #openstack-cinder13:05
*** jamielennox is now known as jamielennox|away13:06
*** eharney has joined #openstack-cinder13:06
*** julim has joined #openstack-cinder13:10
*** ig0r_ has quit IRC13:10
*** markus_z has quit IRC13:12
*** lpabon has quit IRC13:13
*** ig0r_ has joined #openstack-cinder13:16
*** rushiagr_away is now known as rushiagr13:17
*** aagrawal has quit IRC13:19
*** dims_ has quit IRC13:20
*** dims has joined #openstack-cinder13:20
*** e0ne has quit IRC13:22
*** dustins_ has joined #openstack-cinder13:22
*** dustins has quit IRC13:22
*** dustins_ is now known as dustins13:22
*** lpabon has joined #openstack-cinder13:22
*** Guest10__ has joined #openstack-cinder13:23
*** bill_az has joined #openstack-cinder13:25
*** kbyrne has quit IRC13:26
*** kvidvans has joined #openstack-cinder13:26
*** jwcroppe has quit IRC13:26
*** jwcroppe has joined #openstack-cinder13:27
*** kbyrne has joined #openstack-cinder13:27
*** mylu has joined #openstack-cinder13:27
*** jasondotstar has quit IRC13:30
*** ig0r_ has quit IRC13:31
*** e0ne has joined #openstack-cinder13:31
*** jwcroppe has quit IRC13:32
*** xyang1 has joined #openstack-cinder13:35
*** annashen has joined #openstack-cinder13:40
*** annegentle has joined #openstack-cinder13:43
*** annashen has quit IRC13:45
*** abhishekk has quit IRC13:46
*** salv-orlando has joined #openstack-cinder13:49
*** jaypipes has joined #openstack-cinder13:53
*** cbader has joined #openstack-cinder13:54
*** krtaylor has quit IRC13:55
*** annegentle has quit IRC13:55
*** jungleboyj has quit IRC13:56
*** haomaiwang has quit IRC14:01
*** haomaiwang has joined #openstack-cinder14:02
*** ankit_ag has quit IRC14:04
*** markvoelker_ has quit IRC14:06
*** thangp has joined #openstack-cinder14:07
*** krtaylor has joined #openstack-cinder14:08
openstackgerritYuriy Nesenenko proposed openstack/python-cinderclient: Add support '--all-tenants' argument for admin for cinder backup-list  https://review.openstack.org/20746914:09
openstackgerritabhiram moturi proposed openstack/cinder: Oracle ZFSSA iSCSI driver to return 'free' instead of 'available' space  https://review.openstack.org/20710614:12
openstackgerritYuriy Nesenenko proposed openstack/python-cinderclient: Add support '--all-tenants' argument for admin for cinder backup-list  https://review.openstack.org/20746914:12
*** liuxinguo has joined #openstack-cinder14:16
*** breitz has quit IRC14:22
*** annegentle has joined #openstack-cinder14:24
*** markvoelker has joined #openstack-cinder14:27
*** markvoelker_ has joined #openstack-cinder14:28
*** eharney has quit IRC14:29
*** jungleboyj has joined #openstack-cinder14:30
*** ig0r_ has joined #openstack-cinder14:32
*** markvoelker has quit IRC14:32
*** abehl has quit IRC14:32
*** garthb has joined #openstack-cinder14:34
*** BharatK_ has quit IRC14:35
openstackgerritMatthew Edmonds proposed openstack/cinder: mark oslo.vmware as optional requirement  https://review.openstack.org/20323714:38
*** annashen has joined #openstack-cinder14:41
*** salv-orlando has quit IRC14:42
*** bapalm_ has joined #openstack-cinder14:43
openstackgerritxing-yang proposed openstack/cinder: EMC VMAX Create CG from CG Snapshot  https://review.openstack.org/19528014:43
*** agarciam has joined #openstack-cinder14:43
*** vlaza has quit IRC14:44
*** eharney has joined #openstack-cinder14:44
*** annashen has quit IRC14:46
*** BharatK_ has joined #openstack-cinder14:46
*** kjelly_ has joined #openstack-cinder14:48
*** kjelly_ is now known as kjelly14:48
*** timcl1 has joined #openstack-cinder14:49
*** mtanino has joined #openstack-cinder14:50
*** lcurtis has joined #openstack-cinder14:52
*** timcl has quit IRC14:52
*** afazekas has quit IRC14:55
*** breitz has joined #openstack-cinder14:55
*** avishay has quit IRC14:57
*** avishay has joined #openstack-cinder14:57
*** BharatK_ has quit IRC14:59
*** rmcall has joined #openstack-cinder15:00
*** haomaiwang has quit IRC15:01
*** krtaylor has quit IRC15:01
*** haomaiwang has joined #openstack-cinder15:02
*** edtubill has joined #openstack-cinder15:02
*** ig0r_ has quit IRC15:03
*** primechuck has joined #openstack-cinder15:03
*** rmcall has quit IRC15:03
*** ig0r__ has joined #openstack-cinder15:04
*** logan2 has quit IRC15:08
*** ig0r__ has quit IRC15:09
*** ig0r_ has joined #openstack-cinder15:09
*** crose has joined #openstack-cinder15:09
mriedem1hemnafk: thingee: fyi, this is going to be a release blocker for nova https://bugs.launchpad.net/devstack/+bug/147984215:10
openstackLaunchpad bug 1479842 in OpenStack Compute (nova) "os-brick needs to provide it's own rootwrap filters file" [High,Confirmed]15:10
mriedem1we're letting some things into nova now under the assertion that we need to resolve that rootwrap filters bug before liberty release15:11
*** ig0r__ has joined #openstack-cinder15:13
*** krtaylor has joined #openstack-cinder15:14
*** ig0r__ has quit IRC15:15
*** ig0r_ has quit IRC15:15
openstackgerritYuriy Nesenenko proposed openstack/cinder: Add support '--all-tenants' argument for cinder backup-list  https://review.openstack.org/20745115:16
SwansonI need to set up a CI test bed.  Anyone got a favorite link or blog post or something on how to do this?  I don't want it to report so I don't need any of that.  It just needs to fire off as patches come in.15:17
*** diogogmt has joined #openstack-cinder15:17
*** dannywilson has joined #openstack-cinder15:17
*** timcl1 has quit IRC15:19
e0nesmcginnis: hi. around?15:19
openstackgerritYuriy Nesenenko proposed openstack/python-cinderclient: Add support '--all-tenants' argument for cinder backup-list  https://review.openstack.org/20746915:21
*** dannywil_ has joined #openstack-cinder15:22
*** dannywil_ has quit IRC15:22
*** timcl has joined #openstack-cinder15:22
*** dannywil_ has joined #openstack-cinder15:22
*** dannywi__ has joined #openstack-cinder15:23
*** ronis has quit IRC15:23
*** dannywi__ has quit IRC15:24
*** dannywilson has quit IRC15:24
*** IlyaG has joined #openstack-cinder15:24
*** garthb_ has joined #openstack-cinder15:25
*** garthb has quit IRC15:25
openstackgerritIvan Kolodyazhny proposed openstack/python-cinderclient: Set default OS_VOLUME_API_VERSION to '2'  https://review.openstack.org/14654115:25
*** dannywi__ has joined #openstack-cinder15:26
*** dannywil_ has quit IRC15:27
*** cppforlife_ has quit IRC15:29
cebrunsSwanson: Have a look at: http://specs.openstack.org/openstack-infra/infra-specs/specs/openstackci.html and http://docs.openstack.org/infra/system-config/third_party.html15:29
*** cebruns_ has quit IRC15:29
*** Lee1092 has quit IRC15:29
*** crose has quit IRC15:30
*** crose has joined #openstack-cinder15:30
*** agarciam has quit IRC15:30
xyanghemnafk: I can help you with those bugs15:30
*** scottda__ has left #openstack-cinder15:31
*** zul has quit IRC15:31
*** dannywi__ has quit IRC15:32
scottdathingee: I haven't gotten the coffee thermos sorted. I won't be in the office until Monday, so that'd be the earliest I can get it figured out.15:33
xyang1e0ne: hi, can you take a look of my reply here: https://review.openstack.org/#/c/203473/8/cinder/consistencygroup/api.py15:33
*** dannywilson has joined #openstack-cinder15:34
Swansoncebruns: Thanks!15:34
*** dannywilson has quit IRC15:35
*** dannywilson has joined #openstack-cinder15:36
*** timcl1 has joined #openstack-cinder15:39
*** timcl has quit IRC15:39
*** liuxinguo has quit IRC15:40
*** Apoorva has joined #openstack-cinder15:41
ubhi! why is jenkins not merging? https://review.openstack.org/#/c/204702/ Did i forget something?15:41
*** jasondotstar has joined #openstack-cinder15:42
thangpub: zuul is backed up15:42
*** annashen has joined #openstack-cinder15:42
thangpub: its going to take sometime for it to process the backlog15:42
ubthangp: thanks. so i all is ok?15:43
thangpub: probably15:43
SwansonYou're only in 3 1/2 hours.  There are jobs in that have been in the queue for some 7+ hours.  So, good luck.15:43
*** hemnafk is now known as hemna15:45
hemnamriedem1, morning15:45
hemnaoh fun :)15:46
*** annashen has quit IRC15:47
*** alexpilotti has quit IRC15:48
mriedem1yeah :(15:48
hemnamriedem1, I think thats the right way to go though.  I had thought of doing that, but wasn't sure about the automated pieces15:48
*** annashen has joined #openstack-cinder15:50
e0nexyang1: hi. sure. will do it right now15:50
*** skraynev has quit IRC15:51
*** skraynev has joined #openstack-cinder15:51
xyange0ne: thanks15:52
*** ig0r_ has joined #openstack-cinder15:53
xyanghemna: I can work with you on that15:53
hemnaxyang, I'm creating the filters file now.15:53
xyanghemna: cool15:53
hemnaso an issue is that there are filters that are needed by os-brick that already exist in nova and cinder filters15:54
hemnasuch as tee15:54
hemnaif the devstack script is simply going to do something like cat os-brick.filters >> /etc/nova/rootwrap.d/computer.filters, then there may be dupes15:55
*** DuncanT has quit IRC15:55
*** dalgaaf has quit IRC15:55
*** h00327910__ has quit IRC15:55
*** marcusvrn has quit IRC15:55
hemnaso doesn't it make sense then to make os-brick have it's own rootwrap ?15:59
*** amickus has joined #openstack-cinder15:59
hemnaincluding /etc/os-brick/rootwrap.conf, /etc/os-brick/rootwrap.d/os-brick.filters15:59
hemnadunno15:59
e0nehemna: imo, because os-brick is a library, it shouldn't have own configs15:59
hemnae0ne, well, the problem is stated well in the bug and I tend to agree with it.16:00
hemnae0ne, https://bugs.launchpad.net/devstack/+bug/147984216:00
openstackLaunchpad bug 1479842 in OpenStack Compute (nova) "os-brick needs to provide it's own rootwrap filters file" [High,Confirmed]16:00
xyanghemna: what about just copy it there, not cat16:00
e0nehemna: it should be configured via cinder/nova conf/rootwrap16:00
hemnae0ne, well that's the problem16:00
*** haomaiwang has quit IRC16:01
hemnait is now, and it's a blocker16:01
hemnabecause any time os-brick changes and needs to change the filters, then we have the problem of touching nova and cinder's filters16:01
hemnaand keep that in sync with the os-brick released version16:01
e0nehemna: after reading the bug description I'm agree about rootwrap.conf16:01
hemnaheh16:01
*** timcl1 has quit IRC16:01
hemnaso, I think xyang might be right.16:01
e0nevery strong arguments are there:)16:01
hemnajust create a self contained os-brick.filters16:01
hemnaand dump that in /etc/nova/rootwrap.d, /etc/cinder/rootwrap.d16:02
*** haomaiwa_ has joined #openstack-cinder16:02
hemnaso I'm going to create a completely self contained os-brick.filters16:02
hemnamount, tee, etc16:02
hemnawhich nova has as well16:02
hemnaand just hope the dupes don't cause issues16:03
hemna?16:03
*** kjelly has quit IRC16:04
xyanghemna: seems that should work16:05
hemnamriedem1, thoughts ?16:05
hemnaI'll try and get this done shortly16:05
*** salv-orl_ has joined #openstack-cinder16:06
mriedem1hemna: so we don't want configs in the library, i agree there16:07
hemnayah16:07
mriedem1i think a totally self-contained os-brick.filters is what i had in mind16:07
mriedem1we'll have dupes, but meh16:07
hemnaok that's what I'm working on, but we'll have dupes16:07
mriedem1hemna: this also probably removes the need for nova/cinder to have to pass in a root_helper to os-brick when creating the intiator16:07
hemnathe problem with the dupes long term is if nova changes it's definition of mkdir's filter vs. brick for example16:08
mriedem1i'm not sure how rootwrap will treat that kind of case16:08
hemnaso for now I'll just create a completely self contained filter for brick that includes everything it needs16:08
mriedem1does it puke, pick the first found, other?16:08
mriedem1we could ask ttx16:09
hemnaif that turns into a problem, we could create a nova.filters and cinder.filters16:09
mriedem1well, compute.filters/volume.filters16:09
mriedem1hell,16:09
mriedem1well, nvm16:09
mriedem1i was going to say, you could just copy those now, but nvm16:09
hemnaheh16:09
hemnayah, let me push this up as a WIP and get some feedback16:10
mriedem1the depends-on with these changes is going to be interesting16:10
hemnawe'll have to do something in devstack to copy it into /etc/nova, /etc/cinder16:10
mriedem1yup16:10
hemnaxyang, if you want to work on that part, that'd be great.16:10
*** zul has joined #openstack-cinder16:10
hemnaassume I'll create an os-brick/etc/os-brick/rootwrap.d/os-brick.filters file.16:10
mriedem1we'll also need an upgradeimpact in the os-brick change probably so that people writing deploy/config tools are aware of this in the liberty release notes16:11
xyanghemna: devstack?  I'll see what needs to changed there16:11
hemnamriedem1, ok I'll make sure I add that to the commit message16:12
mriedem1it would actually be really nice if pbr supported dropping files in setup.cfg into multiple locations16:12
mriedem1actually, couldn't we just do that in the tree structure in os-brick?16:12
mriedem1os-brick/etc/nova/os-brick.filters16:13
mriedem1os-brick/etc/cinder/os-brick.filters16:13
mriedem1they are the same16:13
hemnaso, I'm planning on putting the file in os-brick/etc/os-brick/rootwrap.d/os-brick.filters16:13
mriedem1then in setup.cfg both are listed, and pbr/setuptools should install both in the right place16:13
hemnaso, 2 copies of the same file ?16:13
*** Lee1092 has joined #openstack-cinder16:14
mriedem1yeah, well, the idea is, if setuptools can just install those in the right place when the library is installed,16:14
mriedem1then there is no devstack change16:14
mriedem1but...16:14
mriedem1could be packaging issues, since nova/cinder require os-brick, os-brick would be installed first and create those directories,16:14
hemnayah16:14
mriedem1i'm not sure if the nova/cinder users own /etc/nova and /etc/cinder in most packaging16:15
mriedem1i'd have to look16:15
mriedem1crap, furniture delivery guys are here, afk for awhile16:15
openstackgerritErickson Filipe Guedes dos Santos proposed openstack/cinder: Nested Quota Driver: Get Project Hierarchy  https://review.openstack.org/20617116:15
hemnaon my vm it looks like /etc/nova is owned by the user that ran stack.sh, not root16:16
*** zul has quit IRC16:16
*** leeantho has joined #openstack-cinder16:17
openstackgerritScott DAngelo proposed openstack/cinder: sqlalchemy exception kills FixedIntervalLoopingCall thread  https://review.openstack.org/20752916:18
mriedem1hemna: yeah, me too16:18
mriedem1so....sounds crazy but maybe that would work?16:18
*** logan2 has joined #openstack-cinder16:19
*** vokt has joined #openstack-cinder16:19
*** dalgaaf has joined #openstack-cinder16:21
*** timcl has joined #openstack-cinder16:21
mriedem1looking at some rpms that we create for nova, etc/nova/ contents are owned by the nova user rather than the user installing the package, but that's rhel based16:22
mriedem1i'm not sure what rdo does16:22
*** lpetrut has quit IRC16:22
*** jasondotstar has quit IRC16:23
*** _cjones_ has joined #openstack-cinder16:23
mriedem1rdo does the same http://pkgs.fedoraproject.org/cgit/openstack-nova.git/tree/openstack-nova.spec#n69216:23
mriedem1that package also adds the nova user http://pkgs.fedoraproject.org/cgit/openstack-nova.git/tree/openstack-nova.spec#n60116:24
*** shausy has quit IRC16:24
*** jistr has quit IRC16:24
mriedem1idk, i guess just letting os-brick lay it's own file down and leave it up to deployment/config tools sort it out works too - if you're not using libvirt you're not using these files anyway16:25
*** marcusvrn has joined #openstack-cinder16:26
*** zul has joined #openstack-cinder16:28
mriedem1zigo: are you around?16:28
*** apevec has joined #openstack-cinder16:28
apevecmriedem1, here?16:28
mriedem1apevec: yeah, we're talking about https://bugs.launchpad.net/devstack/+bug/147984216:28
openstackLaunchpad bug 1479842 in os-brick "os-brick needs to provide it's own rootwrap filters file" [High,Confirmed] - Assigned to Walt Boring (walter-boring)16:28
apevecwhat's the packaging question?16:28
mriedem1apevec: nova and cinder are now using os-brick (library),16:29
apevecright16:29
mriedem1and right now, nova and cinder pass in their root helpers to os-brick to do rootwrap things16:29
mriedem1which means the commands run as root in os-brick have to have rootwrap filters in nova and cinder, which is not good16:29
*** e0ne has quit IRC16:29
mriedem1so we want to move the filters that os-brick needs into os-brick so nova/cinder don't need to be synced up with what os-brick needs,16:29
mriedem1the question is, how to drop the os-brick filters into /etc/nova/ and /etc/cinder16:30
mriedem1apevec: b/c i think you can specify that structure in os-brick and setup.cfg and setuptools will put them in /etc/nova and /etc/cinder at install time,16:30
mriedem1but the os-brick package will be installed before nova/cinder packages, and it seems weird for the os-brick package to create the /etc/nova and /etc/cinder directories,16:31
mriedem1especially since in rdo, the contents of /etc/nova are owned by the nova user, which is created in the openstack-nova package16:31
*** aix has quit IRC16:31
apevecright, in rpm it would required osbrick to depend on nova/cinder to be able to drop into their folders16:31
mriedem1apevec: so i'm wondering if there is some packaging black magic that can be done, or do we just punt and let deploy/config tools sort it out16:31
hemnathat creates a circular dep though16:32
mriedem1yeah16:32
apevecyeah16:32
mriedem1i guess the nova/cinder packages could just have a %post macro that copies the os-brick filters into /etc/nova/rootwrap.d16:32
apevecand looking at nova spec, it moves rootwrap files manually in %install16:32
apevecmriedem1, ugh16:33
*** cppforlife_ has joined #openstack-cinder16:33
mriedem1as long as the nova package requires the os-brick package and knows it's a version with those files, it could do the copy (or just dev/null any failures if the files don't exist)16:33
mriedem1apevec: yeah, it's hacky16:33
*** dims has quit IRC16:33
*** zul has quit IRC16:33
openstackgerritCindy Pallares proposed openstack/cinder: Fix multi-line docstrings to meet hacking rules  https://review.openstack.org/18482016:34
*** jordanP has quit IRC16:36
apevecmriedem1, discussing this in #rdo, symlinks might be better than copying16:38
apevecbut it's tricky one, I'll think of it more16:38
sdaguemriedem1: this makes it impossible to user from pip though, right? given that pip doesn't understand etc files16:39
*** salv-orl_ has quit IRC16:39
jgriffithNot to interrupt... but isn't this sort of library design problem?16:40
mriedem1sdague: not sure, i thought that if setup.cfg had files pointing to etc/ that setuptools would lay those down on the file system.....but i guess it would probably throw them under /usr/lib/python......16:40
jgriffithIn other words, shouldn't the lib be unaware of policy like the rest of our libs?16:40
jgriffithLeave it to nova and cinder and .... specific policy usage and details completely independent of the library?16:41
hemnajgriffith, that's hinting at one of the alternatives I mentioned earlier, giving the library it's own rootwrap16:41
mriedem1are there any other libraries that are running commands as root though?16:41
hemnawhich it would then use to execute commands16:41
jgriffithhemna: NO, I'm saying that's wrong16:42
hemnaI'm not sure this has come up before though in other libs16:42
jgriffithhemna: I'm saying jus the opposite16:42
sdaguejgriffith: doesn't that mean really tight coupling between cinder / nova / and osbrick then?16:42
sdaguewhich is what this was trying to avoid16:42
hemnaI think 'the rest of our libs' don't execute commands as root though.16:42
*** zul has joined #openstack-cinder16:42
sdaguehemna: I think that's probably true16:43
jgriffithsdague: possibly.  but I don't think that's a requirement16:43
jgriffithhonestly I have to look at what's at issue here in the root-wrap to understand why this is an issue16:43
*** annashen_ has joined #openstack-cinder16:43
*** DuncanT has joined #openstack-cinder16:43
hemnajgriffith, so the problem is when new connectors are added to brick, they may require executing new commands.16:43
jgriffithsdague: We do things with the process module for example and use Nova or Cinder root wrap for that16:43
jgriffiththis should be designed similarly IMHO16:44
jgriffithand sorry... I think I said "policy" earlier but meant rootwrap16:44
hemnawhich would then have to be added to nova's computer.filters and cinder's filters and tie that with the specific release of brick that contains that new connector16:44
hemnaI think that's what we are trying to avoid16:44
jgriffithsdague: mriedem1 is that correct.... you don't want any of this info in the nova rootwrap for some reason?16:45
*** alexpilotti has joined #openstack-cinder16:46
jgriffithhemna: do you have an example of the entries?16:46
jgriffithNM... found the review16:46
hemnajgriffith, https://review.openstack.org/#/c/194454/16/etc/nova/rootwrap.d/compute.filters16:46
mriedem1jgriffith: well we wanted to avoid the tight coupling16:46
jgriffithhemna: yeah.. I found it16:46
mriedem1and duplication between nova and cinder filters to use os-brick16:46
jgriffithand IMHO that' s BS16:47
jgriffithThe patch.. not the objections to it16:47
*** annashen_ has quit IRC16:47
mriedem1the precedent is the multipathd entry to compute.filters in the os-brick integration change https://review.openstack.org/#/c/175569/32/etc/nova/rootwrap.d/compute.filters16:48
*** ronis has joined #openstack-cinder16:48
mriedem1which has landed16:48
jgriffithmriedem1: yeah, reading that now16:48
jgriffithmriedem1: hemna so here's my take; if you're configuring a 3'rd party device like ScaleIO, then update the root wrap your self and install/config16:48
hemnawell that's only one aspect16:49
jgriffithmriedem1: hemna leave that patch out of the mix; document the steps as part of install requirements16:49
jgriffithhemna: yes16:49
jgriffithhemna: it is16:49
jgriffithhemna: let me finish please16:49
hemnathere are some changes that may happen that aren't 3rd party16:49
jgriffithmriedem1: hemna so rather then continue to compound the issue based on precedence, recognize it's probably not the right direction going forward.16:49
jgriffithmriedem1: hemna and note that we're going to change it16:50
hemnaI think that's exactly what we are trying to do :)16:50
jgriffithmriedem1: hemna if somebody wants to crank out a patch to the include brick-filters today... so be it16:50
*** lpetrut has joined #openstack-cinder16:50
mriedem1yeah, so my thinking was we landed the os-brick change and don't want to revert it,16:50
mriedem1and we had the scaleio and hgst changes lined up which add 2 new entries to compute.filters,16:51
mriedem1and today is nova feature freeze16:51
jgriffithmriedem1: +116:51
mriedem1so we thought, we're already busted, this goes from 1->3 weird filters, let them in and fix this as a bug before liberty release16:51
jgriffithmriedem1: I'm also wondering if there's another option to this besides a brick specific rootwrap16:51
jgriffithmriedem1: yeah... there's some logic there that makes sense I suppose.  I kinda wish I had noticed this before :(16:52
openstackgerritDaniel Tadrzak proposed openstack/cinder: Cleanup for cinder tests with ConsistencyGroups.  https://review.openstack.org/20754416:52
jgriffithmriedem1: I wonder if there's a way to do a generic "brick" filter in each projects rootwrap16:52
mriedem1jgriffith: well that would organize it better but doesn't decouple it16:53
hemnaso I still think having an os-brick.filters is a way to decouple things and drop that file into nova and cinder.16:53
jgriffithmriedem1: it doesn't?16:53
*** vokt has quit IRC16:53
hemnabrick knows what it needs to run, nova shouldn't have to keep track of that.16:53
jgriffithmriedem1: I'm tinking like an "enable_brick_methods"16:53
jgriffithmriedem1: yeah... true.16:53
jgriffithmriedem1: hemna yeah... it may in fact be the best answer :(16:54
mriedem1hemna: well, drop it in on the part of deploy/config tools right?16:54
jgriffithhemna: mriedem1 what the heck... what's one more thing to make deployment more difficult16:54
mriedem1puppet/chef/ansible/devstack16:54
hemnamriedem1, yah16:54
jgriffithWe've managed to create an entire industry around that at this point16:54
openstackgerritSzymon Wróblewski proposed openstack/cinder: Tooz locks  https://review.openstack.org/18353716:54
*** jordanP has joined #openstack-cinder16:55
mriedem1yeah so i'm all for os-brick owning it's own rootwrap filter in it's own tree16:55
jgriffithdocs.openstack.org install16:55
mriedem1sounds like dhellmann has some ideas too16:55
jgriffithmriedem1: cool16:56
mriedem1however, at this point, it's time for me to get lunch16:56
dhellmannwe have oslo.privsep in development to replace rootwrap, I wonder if we can live with a little pain until gus finishes that and we can migrate over. https://launchpad.net/oslo.privsep16:56
jgriffithmriedem1: hemna so it does sound like you guys have the best short term answer for sure.  But I'm wondering long-term16:56
openstackgerritSzymon Wróblewski proposed openstack/cinder: Tooz locks  https://review.openstack.org/18353716:56
hemnajgriffith, +116:57
jgriffithdhellmann: oh.. that sounds interesting16:57
*** dims has joined #openstack-cinder16:57
dhellmannjgriffith: I don't want to promise too much, since it's early, but we should track gus down and get his input16:57
*** ub has quit IRC16:57
dhellmannI can't seem to find the spec16:57
jgriffithdhellmann: he's got  a patch in neutron :)16:57
dhellmannhttps://blueprints.launchpad.net/oslo-incubator/+spec/privsep16:58
hemnadhellmann, would be nice that privsep could help solve this a little bit long term.16:58
*** belmoreira has quit IRC16:58
jgriffithhttps://review.openstack.org/#/c/155631/14/etc/neutron.conf16:58
jgriffithinteresting16:58
dhellmannhttps://etherpad.openstack.org/p/YVR-oslo-rootwrap-plans16:58
*** lpetrut has quit IRC16:59
*** timcl1 has joined #openstack-cinder16:59
dhellmannjgriffith: I think that was POC for the code going into the library16:59
jgriffithhaha... just run brick as Root :)16:59
dhellmannjgriffith: dims would know better about the current status16:59
hemnaheh17:00
jgriffithdhellmann: well, I think it's def worth holding out for IMHO17:00
dhellmannit might make more sense than looking for ways to ship config files with the library17:00
jgriffithor waiting till we have more info on it before doing anything drastic :)17:00
dhellmannotoh, it might not solve this problem directly, so please do talk to dims & gus to make sure it's taken into account17:00
*** haomaiwa_ has quit IRC17:01
jgriffithdhellmann: indeed, I'm not certain why that idea bothers me so much17:01
jgriffithdhellmann: understood... it may not be a fit; but warrants discussion/investigation for sure17:01
*** timcl has quit IRC17:02
*** haomaiwang has joined #openstack-cinder17:02
jgriffithhemna: You want to follow up with dims and gus at some point?17:02
jgriffithor mriedem117:02
jgriffithor any lurkers about :)17:02
hemnajgriffith, yah17:03
*** avishay has quit IRC17:03
*** cebruns_ has joined #openstack-cinder17:08
openstackgerritDaniel Tadrzak proposed openstack/cinder: ConsistencyGroup Object  https://review.openstack.org/16364117:09
*** h00327910__ has joined #openstack-cinder17:09
*** liewegas has quit IRC17:11
openstackgerritErlon R. Cruz proposed openstack/cinder: Fix HNAS iSCSI 32 targets limitation error  https://review.openstack.org/20665117:12
*** bluex-pl has quit IRC17:14
openstackgerritDaniel Tadrzak proposed openstack/cinder: CGSnapshot Object  https://review.openstack.org/19502717:16
*** vilobhmm has joined #openstack-cinder17:16
*** lpetrut has joined #openstack-cinder17:18
*** liewegas has joined #openstack-cinder17:19
*** ub has joined #openstack-cinder17:20
DTadrzakCould someone forward me link to priority  list :)?17:21
*** e0ne has joined #openstack-cinder17:22
*** e0ne has quit IRC17:23
*** e0ne has joined #openstack-cinder17:23
openstackgerritWalter A. Boring IV (hemna) proposed openstack/os-brick: Add rootwrap filters  https://review.openstack.org/20755317:24
*** bapalm_ has quit IRC17:25
hemnabah, trailing whitespace.  pita.17:25
*** dims has quit IRC17:26
openstackgerritErlon R. Cruz proposed openstack/cinder: Fix HNAS iSCSI 32 targets limitation error  https://review.openstack.org/20665117:26
*** IlyaG has quit IRC17:26
*** annashen has quit IRC17:28
*** IlyaG has joined #openstack-cinder17:29
*** lpetrut has quit IRC17:30
openstackgerritDuncan Thomas proposed openstack/cinder: Add ability to get endpoints from catalog  https://review.openstack.org/20755517:31
openstackgerritWalter A. Boring IV (hemna) proposed openstack/os-brick: Add rootwrap filters  https://review.openstack.org/20755317:31
*** IlyaG has quit IRC17:33
*** erlon has joined #openstack-cinder17:35
*** pv_ has joined #openstack-cinder17:36
jgriffithhemna: put this in your .vimrc17:36
jgriffithautocmd BufWritePre * :%s/\s\+$//e17:36
*** boris-42 has joined #openstack-cinder17:37
pv_i had a quick question on the configuration attribute in the volumedriver class, if the driver code i'm writing inherits from the FibreChannelDriver, and that in turn inherits from VolumeDriver which says it inherits from BaseVD where the line17:39
pv_ self.configuration = kwargs.get('configuration', None) occurs17:39
pv_my devstack stack.sh isn't completing because the self.configuration attribute is a Nonetype, which is the default value for it17:39
pv_but how can I check why kwargs.get(configuration) isn't setting the config variable to local.conf or a similar conf file?17:40
jgriffithpv_: Your local.conf file?17:41
jgriffithpv_: as in can we see it :)17:41
* jgriffith should've saved your links last week :)17:41
pv_yup gimme a sec17:42
*** ub has quit IRC17:42
*** daneyon has joined #openstack-cinder17:43
*** jungleboyj has quit IRC17:43
*** annashen has joined #openstack-cinder17:44
*** daneyon_ has joined #openstack-cinder17:44
pv_http://pastebin.com/30DXeD4D17:45
*** ub has joined #openstack-cinder17:46
openstackgerritJohn Griffith proposed openstack/cinder: Use prefix for SolidFire template account  https://review.openstack.org/20756117:47
*** daneyon has quit IRC17:47
*** jungleboyj has joined #openstack-cinder17:48
*** xyang1 has left #openstack-cinder17:48
jgriffithpv_: that should work... and without seeing your driver hard to know if you're missing something in the init17:48
jgriffithpv_: since you have to keep your stuff "secret" afraid I'm not going to be able to help much17:48
hemnajgriffith, thanks :)17:49
*** annashen has quit IRC17:49
pv_hm alright, i know that the traceback is showing me the error is with this line self.configuration.append_config_values(volume_opts) in my __init__ method for my driver17:49
*** sgotliv has quit IRC17:50
*** xyang1 has joined #openstack-cinder17:50
pv_line 117, in __init__ 2015-07-30 10:27:56.981 1329 ERROR cinder     self.configuration.append_config_values(volume_opts) 2015-07-30 10:27:56.981 1329 ERROR cinder AttributeError: 'NoneType' object has no attribute 'append_config_values' 2015-07-30 10:27:56.981 1329 ERROR cinder c-vol failed to start17:50
jgriffithpv_: double check this: https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/lvm.py#L6817:50
*** apevec has quit IRC17:50
jgriffithpv_: and this: https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/lvm.py#L7317:50
jgriffithpv_: also make surrey have the opts setup properly in your cfg section17:51
jgriffithpv_: DONT use volume_opts17:51
jgriffithpv_: https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/lvm.py#L4417:51
xyang1hemna: if we just add "configure_rootwrap os-brick" in devstack/lib/nova, does that work17:51
jgriffithpv_: change that... s/volume_opts/ourdriver_opts/17:52
jgriffithpv_: in your driver17:52
hemnaxyang1, I don't know.17:52
xyang1hemna: I'm not familiar with devstack:(17:53
pv_alright i changed it from volume_opts to ourdriver_opts17:53
pv_thats what you mean right?17:53
pv_and i looked at the LVM driver's init method, im doing the same thing17:53
hemnaxyang1, so, that function seems to do lots of stuffs17:54
*** Tross1 has quit IRC17:54
*** Tross has joined #openstack-cinder17:54
hemnaxyang1, and I don't think it's what we want.  all we want to do is copy the file into the project's rootwrap.d folder.17:54
jgriffithpv_: yeah17:54
xyang1hemna: /etc/os-brick/rootwrap.d/os-brick.filters ?17:55
hemnaxyang1, no17:55
*** annashen has joined #openstack-cinder17:56
*** timcl has joined #openstack-cinder17:56
xyang1hemna: /etc/nova/rootwrap.d/os-brick.filters?17:56
*** timcl1 has quit IRC17:56
*** alexpilotti has quit IRC17:56
hemnayah17:57
hemnaand cinder as well17:57
xyang1hemna: then we can't use that configure_rootwrap project directly .  I think that copy it directly under the "project"17:58
hemnayup17:58
*** angela-s has joined #openstack-cinder17:58
*** coolsvap|away is now known as coolsvap17:59
*** ronis has quit IRC18:00
*** haomaiwang has quit IRC18:01
*** haomaiwang has joined #openstack-cinder18:02
*** ub has quit IRC18:02
*** rlucio has quit IRC18:03
*** salv-orlando has joined #openstack-cinder18:05
*** ub has joined #openstack-cinder18:05
smcginnise0ne: Sorry, just saw your ping. You still around?18:15
jungleboyj*insert snorting sound here*18:16
jungleboyj*snoring*18:16
thingeescottda: yeah that sounds good to sign up for nova liaison. thanks hemna18:16
smcginnisjungleboyj: Wondered why you were snorting. :)18:16
e0nesmcginnis: np. i just wanted to confirm that i understood your comment for https://review.openstack.org/#/ right18:17
thingeejgriffith: reminder on replication v2 spec https://review.openstack.org/#/c/155644/ if we can get an update on that for approval18:18
smcginnise0ne: Looking18:18
e0nesmcginnis: thanks18:18
smcginnise0ne: Oh, wait. Missed something there.18:18
smcginnise0ne: #18:18
e0nesmcginnis: what do you mean?18:19
smcginnise0ne: The link you pasted isn't complete. Which review number are you referring to?18:19
thingeescottda: no problem on the thermos. I have the coffee and gear in my bag in case.18:20
e0nesmcginnis: oh, i'm sorry. here it is: https://review.openstack.org/#/c/146541/18:20
smcginnise0ne: Thanks. OK, now I'm looking. :)18:20
thingeemriedem1: looking at release blocker18:20
e0ne:)18:20
mriedem1thingee: we kind of beat that horse to death about an hour ago18:21
mriedem1thingee: feel free to add thoughts though18:21
* thingee catches up on backlog18:21
smcginnise0ne: OK, I see. So you're saying it's OK that those tests still validate v1 is being called?18:21
thingeelooks like a fix is in os-brick and we're waiting on some change change with devstack18:21
hemnathingee, mriedem1 xyang1 is working on a devstack patch to plop the os-brick.filters file into rootwrap.d dirs for cinder and nova.18:22
e0nesmcginnis: tbh, i didn't check coverage18:22
thingeehemna: gotcha18:22
e0nesmcginnis: but we've got tests in v1 directory18:22
thingeemriedem1, hemna : so we're ok?18:22
smcginnise0ne: I'm trying to find the specific lines I was concerned about.18:22
hemnathingee, we have a plan....we just need to test it out, once the devstack piece is in place18:22
thingeemriedem1, hemna, xyang1: whew thanks everyone.18:22
* thingee goes back to specs18:22
hemnathingee, it's my top priority right now.18:23
*** ub has quit IRC18:23
smcginnise0ne: Well, I can't find it. Not sure what I was looking at for that one.18:24
smcginnise0ne: I don't see an issue with any of your changes. I'll wait for jenkins and make one more pass.18:24
smcginnise0ne: In the mean time I'll keep looking and if I find anything elsewhere of concern I'll make sure to be more explicit.18:24
e0nesmcginnis: thank you!18:25
*** ig0r__ has joined #openstack-cinder18:25
smcginnise0ne: NP. Sorry for the confusion.18:25
*** ndipanov has quit IRC18:25
*** ndipanov has joined #openstack-cinder18:26
*** patrickeast has joined #openstack-cinder18:26
e0nesmcginnis: don't worry. imo, it's better to -1 and ask question than merge something broken18:26
*** dims has joined #openstack-cinder18:26
*** ronis has joined #openstack-cinder18:27
*** jasondotstar has joined #openstack-cinder18:30
*** wanghao_ has joined #openstack-cinder18:30
vilobhmmjgriffith : ping18:31
*** briancurtin_ has joined #openstack-cinder18:32
*** sweston_ has joined #openstack-cinder18:32
*** thingee_ has joined #openstack-cinder18:32
*** coolsvap is now known as coolsvap|away18:32
thingee_hemna: thank you :)18:32
*** bill_az_ has joined #openstack-cinder18:33
*** amickus has quit IRC18:33
*** marcusvrn has quit IRC18:33
*** briancurtin has quit IRC18:34
*** dalgaaf has quit IRC18:34
*** wanghao has quit IRC18:34
*** thingee has quit IRC18:34
*** sweston has quit IRC18:34
*** rushiagr has quit IRC18:34
*** xyang1 has quit IRC18:34
*** ericksonsantos has quit IRC18:34
*** kbyrne has quit IRC18:34
*** bill_az has quit IRC18:34
*** ericksonfgds has joined #openstack-cinder18:34
*** briancurtin_ is now known as briancurtin18:34
*** wanghao_ is now known as wanghao18:34
*** thingee_ is now known as thingee18:35
*** kbyrne has joined #openstack-cinder18:35
geguileothingee: Are you in the mood for some specs review pestering?18:35
geguileo:-)18:35
*** sweston_ is now known as sweston18:35
vilobhmmsmcginnis : ping18:36
vilobhmmany specific reason you can think of why the root parameter is added in this method https://github.com/openstack/cinder/blob/master/cinder/tests/unit/api/contrib/test_quotas.py#L3118:37
*** salv-orlando has quit IRC18:40
smcginnisvilobhmm: Not sure. Looks like it is only overridden in the last test.18:42
*** rushiagr has joined #openstack-cinder18:42
openstackgerritJordan Pittier proposed openstack/cinder: Rework Scality SOFS driver to use RemoteFS class  https://review.openstack.org/20061018:42
*** dalgaaf has joined #openstack-cinder18:42
smcginnisvilobhmm: So it's just setting the quota_set. I think that's normal. Not a quota expert by any means though.18:43
*** changbl has quit IRC18:43
jgriffithvilobhmm: pong18:44
Swansonhemna: did your create_export patch land?18:45
hemnanot yet18:45
hemnathe spec did18:45
Swansonthanks18:45
openstackgerritJon Bernard proposed openstack/cinder: Add support for file I/O volume migration  https://review.openstack.org/18727018:47
*** ig0r_ has quit IRC18:50
*** xyang1 has joined #openstack-cinder18:52
*** changbl has joined #openstack-cinder18:56
*** bapalm_ has joined #openstack-cinder19:00
*** haomaiwang has quit IRC19:01
*** haomaiwang has joined #openstack-cinder19:02
*** ig0r_ has joined #openstack-cinder19:04
*** bapalm_ has quit IRC19:05
*** annashen has quit IRC19:08
*** annashen has joined #openstack-cinder19:09
*** lpabon has quit IRC19:10
*** annashen has quit IRC19:10
*** annashen has joined #openstack-cinder19:10
*** kvidvans has quit IRC19:11
*** uberjay has quit IRC19:11
*** uberjay has joined #openstack-cinder19:12
*** marcusvrn has joined #openstack-cinder19:14
thingeehemna, mriedem1 looks like https://review.openstack.org/#/c/194454 is already resolved. Sorry just now getting back to it due to my backlog19:15
hemnayah, so at this point we are waiting for the devstack patch that will use my WIP for brick patch, to install the filters.19:16
hemnahttps://review.openstack.org/#/c/207553/19:16
thingeegeguileo: not sure if you saw my earlier message, but I'm already looking at specs. Not sure what good it's going to do.19:16
thingeehemna: got it, it's related to that19:16
geguileothingee: Oh, I didn't see it, thanks for pointing that out19:16
thingeedoes anyone besides tbarron care about scalable backup service spec? https://review.openstack.org/#/c/203215/419:17
geguileothingee: I care, but I haven't had time to review it19:18
thingeewinston-d_zZZ agrees it's a good approach according to the WIP patch https://review.openstack.org/#/c/203291/19:18
thingeejust haven't see any movement on the spec19:19
*** ronis has quit IRC19:20
tbarronand I think when winston said that he was awake :)19:20
thingeeaarefiev: rootwrap daemon spec is approved19:23
hemnaxyang, heading to lunch...bbiab19:25
*** ub has joined #openstack-cinder19:25
*** e0ne has quit IRC19:25
*** annashen has quit IRC19:26
*** annashen has joined #openstack-cinder19:26
*** julim has quit IRC19:27
*** lpetrut has joined #openstack-cinder19:28
*** jasondotstar has quit IRC19:29
*** salv-orlando has joined #openstack-cinder19:29
*** annashen_ has joined #openstack-cinder19:29
*** Apoorva has quit IRC19:30
*** kvidvans has joined #openstack-cinder19:30
*** lpetrut has quit IRC19:30
thingeegeguileo: did you give some of the other solutions thoughts that were discussed with jgriffith https://review.openstack.org/#/c/202615/619:31
thingeeand I19:31
geguileothingee: The thing is I think we'll need locking for any initial approach19:32
geguileothingee: And some drivers will need locks anyway19:32
thingeegeguileo: you must've not understood what I was explaining yesterday.19:32
geguileothingee: Even when we finally remove all locks from the manager19:32
geguileothingee: Oh, the UUID broadcasting19:32
*** timcl has quit IRC19:32
thingeeIf I can avoid the deployer having to learn about zookeeper, etcd, whatever, that's a huge huge win19:33
geguileothingee: I thought a little bit (I must admit not as much as I should have)19:33
tbarronvs storing the uuid owner for each operation19:33
thingeetbarron: that's already too complex from what I was explaining19:34
thingeetbarron: storing the operation is not needed. we've already agreed we don't need allow parallel tasks for a resource.19:34
*** annashen_ has quit IRC19:34
geguileothingee: I think your solution will add more complexity and after all we are going to remove most locks eventually19:34
thingeehow so?19:34
thingeeunlike every solution explained here, mine can be explained in one sentence.19:35
thingeenot a blog post or spec.19:35
geguileothingee: You need to distribute the UUIDs and keep track of the timeouts to remove them if we haven't received updates in a while19:35
geguileothingee: And maybe we aren't receiving notifications because we have lost connection to the broker19:36
thingeeuuids are broadcast to each c-api, c-vol, do a time out if needed.19:36
tbarronhow to distinguish between broken link and node down ...19:36
thingeegeguileo: if you lose connection you have more problems than that19:36
thingeethat argument is a dead horse at this point19:36
geguileothingee: The effort I believe is smaller for locks19:37
geguileothingee: And we are going to remove it later, so...19:38
thingeewhat is "it" in this context?19:38
geguileothingee: And we would need to provide some kind of methods for the drivers as well19:38
geguileothingee: The locking (using locks or the UUID broadcasting)19:38
geguileothingee: except in some drivers19:38
thingeegeguileo: if you're relying on drivers to enforce things, that's the wrong approach19:38
thingeegeguileo: the manager is enforcing19:38
geguileothingee: No, what I mean is that some drivers19:39
geguileothingee: need locks19:39
thingeegeguileo: removing the broadcast approach was never something I said19:39
geguileothingee: For their own purposes19:39
geguileothingee: Not for resource locking19:39
geguileothingee: Like you said, that will be taken care by Cinder (API and Manager)19:39
geguileothingee: But some drivers still need locking mechanism for other stuff19:39
geguileothingee: I think glusterFS was one such drivers19:40
thingeegeguileo: they can keep their local locks. Only one c-vol can work with a uuid anyways.19:40
thingeegeguileo: with the broadcast approach19:40
*** annashen has quit IRC19:40
*** annashen has joined #openstack-cinder19:41
geguileothingee: But sometimes it's not a matter of the UUID of the resource they need to lock on19:41
thingeegeguileo: can you give me an example? I've been noticing <method>-<resource-uuid>19:41
geguileothingee: And that's the problem, because the UUID exclusion will be handled by Cinder19:41
geguileothingee: When you say <metho>-<resource-uuid> you are talking about the locks?19:42
thingeegeguileo: why is that a problem if it's a matter of keeping track of uuids in a global pool?19:42
thingeegeguileo: yes, I want an example of what you're talking about where drivers it's not a matter of the uuid19:42
geguileothingee: Locks are weird right now, and they would be changed to remove the <method> part19:42
thingeegeguileo: I want an example19:42
geguileothingee: They would be <resource-type>-<uuid>19:42
thingeegeguileo> thingee: But sometimes it's not a matter of the UUID of the resource they need to lock on19:43
geguileothingee: Dulek was the one that saw that19:43
geguileothingee: But he's on vacation until next week19:43
geguileothingee: I'll need a couple of minutes to dig into that19:43
thingeegeguileo: mute point then19:43
*** lpetrut has joined #openstack-cinder19:43
thingeegeguileo: point is, I'm not completely sold on putting the deployer through what developers are excited about.19:43
geguileothingee: Let me get back to you in a couple of minutes19:43
thingeegeguileo: I appreciate your work on this, but I just feel like we're assuming DLM and tooz is just going to solve all of our problems.19:45
geguileothingee: Nooooooo, they are not19:45
geguileothingee: I wish!!!19:45
thingee:)19:45
geguileothingee: That's just a little piece of the puzzle, and one that will mostly go away after Walter's work on Nova is completed19:45
*** openstackgerrit has quit IRC19:46
*** openstackgerrit has joined #openstack-cinder19:47
*** lpetrut has quit IRC19:48
*** jasondotstar has joined #openstack-cinder19:50
geguileothingee: As far as I can see the example dulek mentioned should be solved if Cinder did the resource exclusion properly19:52
geguileothingee: I'll ask bluex tomorrow19:52
*** lpetrut has joined #openstack-cinder19:54
*** lpetrut has quit IRC19:55
geguileothingee: Sorry I couldn't give more info :-(19:56
*** annashen has quit IRC19:56
*** ig0r_ has quit IRC19:56
openstackgerritJames Carey proposed openstack/cinder: Sync scheduler module from oslo-incubator  https://review.openstack.org/15853419:56
*** julim has joined #openstack-cinder19:57
*** annashen has joined #openstack-cinder19:57
*** belmoreira has joined #openstack-cinder19:57
*** haomaiwang has quit IRC20:01
*** haomaiwang has joined #openstack-cinder20:02
*** e0ne has joined #openstack-cinder20:11
e0nethingee: thanks for approving rootwrap spec20:11
*** mriedem1 is now known as mriedem_away20:12
hemnaxyang, back.   any updates?  need any help ?20:13
*** annegentle has quit IRC20:13
*** annegentle has joined #openstack-cinder20:13
e0nejgriffith, hemna: is any chance that we'll implemtn https://blueprints.launchpad.net/cinder/+spec/use-cinder-without-nova for liberty?20:14
hemnae0ne, I think it's too late for that guy for Liberty20:14
hemnaI'm definitely still interested in it.20:15
e0neme too20:15
e0newe still need to have a spec and/or api poc20:15
hemnayah, I think jgriffith had mentioned he had an idea for a new API that could help20:16
hemnaand then the discussion was where to put the tool that did all of the coordination and discovery20:16
e0neyep. that's why i'm asking about it20:16
hemnaI still like the cinderclient change20:16
hemnabut others didn't20:16
*** openstackgerrit has quit IRC20:16
e0neit would be confusing20:16
hemnayah it would be20:17
e0nenow, we've got attach in cinderclient20:17
*** openstackgerrit has joined #openstack-cinder20:17
e0neand we know what it does:)20:17
hemnayah, which is a call to update the db for a volume.20:17
hemnableh20:17
e0ne:)20:17
e0neso, i would like ho have some kind of brick- or cinder-baremetal-client20:18
*** Apoorva_ has joined #openstack-cinder20:18
xyang1hemna: hi20:23
hemnaxyang1, hey20:23
vilobhmme0ne, xyang1 : can you please review this20:23
vilobhmmhttps://review.openstack.org/#/c/206170/420:23
thingeehemna: thoughts? https://review.openstack.org/#/c/207101/120:23
vilobhmmit has already lots of +1 and + 220:23
vilobhmmdont want to end up in the rebase cycles20:23
hemnathingee, I'll check it out20:24
xyang1hemna: so I'm thinking about adding the following to devstack/inc/rootwrap/configure_rootwrap20:25
xyang1hemna:    if [ "${project}" == "nova" ]; then20:25
xyang1        sudo install -o root -g root -m 644 $rootwrap_brick_dir/rootwrap.d/*.filters /etc/${project}/rootwrap.d20:25
xyang1    fi20:25
hemnaxyang1, hrmm.  so why not add a generic function in inc/rootwrap for installing a lib's rootwrap file.  Then in lib/nova make a call to it to install the os-brick.filters file, then you can reuse that in lib/cinder as well.20:27
hemnaand then inc/rootwrap doesn't have checks for nova, and cinder20:27
hemnaxyang1, does that make sense ?20:29
xyang1hemna: yes, but I don't know how to tell it is a lib there20:30
hemnaxyang1, so the call should include 2 params, where the file is, and where you want to put it.  basically just a copy operation at that point.20:31
hemnaxyang1, I think we should avoid putting project specific checks into the inc/rootwrap functions.20:32
hemnae0ne, heh yah.  we have lots of things to change.  https://etherpad.openstack.org/p/CinderNovaAPI20:32
xyang1hemna: makes sense.  I just need to figure out how to specify that is os-brick20:32
e0nehemna: it'd great plan. did you talk about cinde-nova liaisons?20:33
hemnae0ne, I think scottda got assigned to be the nova liason. not me.20:34
e0nehemna: oh, great! so that's idea not a new:)20:35
*** vokt has joined #openstack-cinder20:35
thingeejaypipes: would it be possible for scottda to do the update on https://review.openstack.org/#/c/84048/ ?20:38
thingeejaypipes: I'm also unsure if johnthetubaguy would grant it at this point.20:38
xyang1hemna:  # configure_rootwrap lib20:39
xyang1function configure_rootwrap_lib {20:39
xyang1    local lib=$120:39
xyang1    local project=$220:39
xyang1    # Fix me20:39
xyang1    local lib_dir=""20:39
xyang1    local rootwrap_conf_src_dir="${lib_dir}/etc/${lib}"20:39
xyang1    sudo install -o root -g root -m 644 $rootwrap_conf_src_dir/rootwrap.d/*.filters /etc/${proj20:39
xyang1ect}/rootwrap.d20:39
xyang1}20:39
*** annegentle has quit IRC20:40
hemnaheh20:40
xyang1hemna: should have used paste bin:)20:41
hemnaso I just did an install of os-brick with my os-brick.filters patch, and the etc dir doesn't get installed20:41
xyang1where is it then?20:41
xyang1should still be part of os-brick, right20:42
hemnahttp://paste.openstack.org/show/406503/20:42
*** Yogi1 has quit IRC20:42
hemnahave to tell setup.py to install the etc dir along with it I guess.20:42
hemnaneeds some pbr magic20:43
*** thangp has quit IRC20:43
*** akshai has quit IRC20:44
*** akerr has quit IRC20:44
xyang1oh, ok20:44
hemnahttp://docs.openstack.org/developer/pbr/#files20:45
*** Guest10__ has quit IRC20:46
*** bswartz has quit IRC20:46
*** openstackgerrit has quit IRC20:46
*** openstackgerrit has joined #openstack-cinder20:47
xyang1hemna: so those need to be added to setup.cfg of os-brick?20:48
hemnayah I think so20:48
hemnaor the filters won't get installed20:48
hemnaxyang1, http://paste.openstack.org/show/406504/20:48
hemnaso that installs them in /usr/local/etc/os_brick20:48
xyang1ok20:49
openstackgerritKurt Martin proposed openstack/cinder: Over subscription for HP LeftHand iSCSI driver  https://review.openstack.org/20724820:49
thingeetbarron: there are comments in ps3 from Lisa https://review.openstack.org/#/c/203215/20:49
hemnaand pip show os-brick doesn't show the location of the files.  so i guess it's ok to assume /usr/local/etc/os_brick ?20:50
xyang1hemna: for me it is different20:50
hemnaxyang1,  you can see the installed files in the output from that paste20:50
*** lpetrut has joined #openstack-cinder20:51
hemnaxyang1, the data files are installed in a different location for you ?20:51
hemnawith that setup.cfg patch included in the paste ?20:51
hemnaxyang1, https://gist.github.com/WaltHP/e2b07a660b421f5ebfed20:52
xyang1hemna: I mean the /usr/local part is different.  /usr/local/lib/python2.7/dist-packages20:53
hemnaxyang1, right that should be the lib itself and it's .py files20:54
hemnabut not the os-brick.filters file20:54
xyang1hemna: oh, you are saying etc is installed at /usr/local/etc always20:55
hemnayah, hold on I have another patch gist for you20:55
*** jasondotstar has quit IRC20:56
hemnaxyang1, https://gist.github.com/d760d736861a972b680520:56
hemnaxyang1, http://paste.openstack.org/show/406505/20:57
*** jamielennox|away is now known as jamielennox20:57
hemnayou can see in that paste it installs the os-brick.filters file into /usr/local/etc/os-brick/rootwrap.d20:57
xyang1yes, I see20:57
thingeehemna: nevermind on that spec. I mean feel free to review it...I'm just undecided with tooz atm20:58
hemnayah20:59
hemnathingee, so the tooz thing20:59
hemnaI'm 'ok' with it as long as it's a short term approach.20:59
thingeehemna: I would like to speak at the midcycle about my thoughts there. jgriffith I'm sure is going to share as well.20:59
hemnapresuming that tooz works really well and doesn't have it's own set of problems that now Cinder will have in inherit.21:00
openstackgerritWalter A. Boring IV (hemna) proposed openstack/os-brick: Add rootwrap filters  https://review.openstack.org/20755321:00
hemnaxyang1, ok that update patch has the setup.cfg changes to install the filters file.21:00
thingeehemna: so I have no knowledge of how any of this works so ever, but another idea is using swift's ring solution. akanda is doing work in bringing that in21:00
*** haomaiwang has quit IRC21:01
*** lpetrut has quit IRC21:01
*** openstack has joined #openstack-cinder21:09
thingeehemna: yeah lets get that update. leeantho still have spare cycles with this in l-3?21:09
hemnahehe21:10
hemnaI can work with leeantho on the spec and see if we can get it updated.21:10
thingeehemna: I also mean cycles to do the actual change too :)21:11
leeanthoI have some time after I finish a few other things.  I can work on some of it after that21:11
thingeetbarron: ok, I'll hold off until tomorrow. Please try to finish up discussions :)21:12
thingeeleeantho: thanks21:12
thingeejaypipes: also don't be ashamed. People are busy. I get it. Trust me, I understand.21:12
hemnathingee, yah.  I'm probably going to help out with that effort as well.21:13
scottdaOK, but we cannot return VolumeIsBusy to nova until they are able to catch the exception. That should just be a bugfix (no API change) so should be able to get in L21:13
thingeescottda: +121:13
thingeeWe have a bug21:13
thingeeI kept bugging winston-d_zZZ about it, but he has been busy21:14
hemnaso that atomic status change spec is basically a bug fix21:14
hemnajust for db updates for status21:14
* thingee looks for it21:14
scottdaAnd if we do this, where does that leave a DLM/tooz solution? Is it even necessary?21:14
hemnascottda, yah the nova side needs to be updated before we can change the Cinder API to report VolumeIsBusy21:14
hemnascottda, I think if we get that in place, then we don't need locks in the volume manager.21:15
*** annashen has quit IRC21:15
*** mylu has quit IRC21:16
scottdahemna: yeah, and that seems to be the long-term solution we want (this is pointed out in Add Cinder Volume A/A HA lock spec)21:16
hemnayup21:16
*** annegentle has joined #openstack-cinder21:16
* thingee would really like to solve this problem in liberty versus introducing a DLM at this point21:16
thingeeI'd like to just see what problems we have after introducing this change21:16
scottdaso, it seems that is could be short-term (fixed in L) not long-term to report VolumeIsBusy21:16
hemnaso the real catch here is Nova is FF after today.21:16
thingeeand *see* what problems by actually testing21:16
scottdathingee: +121:17
thingeehemna: it's a bug not a feature21:17
hemnaso we'd have to file a bug and see if we can get buyoff on it for adding VolumeIsBusy checks.21:17
thingeehemna: we have one, I'm digging it up21:17
hemnaI think leeantho might have already filed a bug on this for me a while ack21:17
hemnaback21:17
thingeevilobhmm filed one for me :P21:17
* thingee continues to look for it21:17
*** mylu has joined #openstack-cinder21:18
*** annashen has joined #openstack-cinder21:18
leeanthohemna,  yes I have an old WIP patch: https://review.openstack.org/#/c/153748/21:18
scottdahttps://bugs.launchpad.net/nova/+bug/145895821:18
openstackLaunchpad bug 1460044 in OpenStack Compute (nova) "duplicate for #1458958 Data loss can occur if cinder attach fails" [High,In progress] - Assigned to Vipin Balachandran (vbala)21:18
hemnaleeantho, did we have a bug for the nova side though ?21:18
jaypipesthingee: cheers and thanks for your understanding21:19
*** zul has joined #openstack-cinder21:19
hemnascottda, :)  thanks21:19
thingeejaypipes: can you answer my question on this being an issue of getting liberty at this point?21:19
thingee:)21:19
*** mylu has quit IRC21:19
thingeejaypipes: if you want me to just figure that out with johnthetubaguy, I can do that as well.21:20
tbarronthingee: thanks.  I have responded in the review as well, as maybe I do understand what she's suggesting after all.21:20
jaypipesthingee: I will likely need to talk with mriedem and johnthetubaguy about it. it will likely be a stretch, to be entirely up-front with you. I will see what I can do.21:20
thingeejaypipes, scottda: understood, thanks21:21
*** crose has quit IRC21:22
thingeebreitz: ping21:23
thingeebreitz: how are we doing with getting started?21:23
thingeescottda, hemna ah thanks, yeah that's the bug21:24
scottdaI'll get with winston-d_zZZ on that to see if he needs help21:24
hemnahrmm that bug is marked a dupe of 1460044, which I don't think is related.21:25
thingeewinston-d_zZZ: I think he's just busy. I remember in the cinder meeting he said he couldn't do it, then changed his mind...but still nothing21:25
thingeecould probably just take it21:25
thingeescottda: whoops ^21:26
scottdaalso note that jaypipes mentioned in the bug a change to cinderclient to return proper HTTP error ...21:26
hemnascottda, yah I noticed that.21:26
hemnascottda, so if we do that, is a Nova change needed?21:26
*** bswartz has joined #openstack-cinder21:27
hemnaI think nova would just get an exception from cinderclient method call at that point and puke, which it's not currently expecting.21:27
scottdaI would think so.  I'll look at the code and/or test to see...21:27
hemnaI'm pretty sure that's the case from what I recall.21:28
scottdayes, I think Nova will still fail, he's just saying that's the proper HTTP return.21:28
hemnasure21:28
scottdaso, the cinderclient change will probably be required to make reviewers happy, that's all I'm saying on this.21:28
hemnascottda, +121:29
breitzthingee, pong21:29
breitzdoing ok - got devstack up and trying to play with image cache - reading code - trying to set breakpoints - the usual thrashing21:30
*** annashen_ has joined #openstack-cinder21:30
openstackgerritErickson Filipe Guedes dos Santos proposed openstack/cinder: Nested Quota Driver: Get Project Hierarchy  https://review.openstack.org/20617121:31
thingeebreitz: excellent. reach out to patrickeast about any questions :D21:31
breitzI have been - he has been very helpful21:31
*** annashen_ has quit IRC21:35
*** ub2 has joined #openstack-cinder21:35
scottdabreitz: I see you are coming to the Cinder mid-cycle next week.21:36
*** vilobhmm has left #openstack-cinder21:37
*** ub has quit IRC21:38
*** edtubill has left #openstack-cinder21:39
thingeebreitz: who are you with?21:39
thingeejwang: what's going on with the nimble CI?21:40
* thingee is going to disappear soon.. plane landing soon21:40
scottdathingee: I don't like this: "The nova-manage isn't properly documented, but it's going away in Folsom...."21:42
scottdahttps://wiki.openstack.org/wiki/NovaManage21:42
thingeelololo21:42
thingeejaypipes: ^21:42
scottdaI thought jaypipes said nova-manage was supported and here to stay?21:43
thingeeCinder just found a reason to keep it around!21:43
scottdahehe21:43
thingeeit's a trap21:43
scottdaIt's probably OK...I see them talking about adding things to nova-manage in theiNOva meeng ATM21:45
scottdain the Nova meeing21:46
* thingee is going to propose a spec to remove it21:46
thingeeI was there at folsom. I remember21:46
*** markvoelker_ has quit IRC21:46
* thingee disappears21:47
*** jasondotstar has joined #openstack-cinder21:48
*** annegentle has quit IRC21:49
*** rushiagr is now known as rushiagr_away21:50
jaypipesscottda: "it's going away in Folsom" LOL.21:51
jaypipesscottda: no, nova-manage isn't going anywhere.21:51
jaypipeshttp://datanetpacific.com/wp-content/uploads/2015/05/targeting_computer_in_blog_3.gif21:51
*** ig0r__ has quit IRC21:51
*** markstur_ has joined #openstack-cinder21:51
scottdajaypipes: thingee https://review.openstack.org/#/c/84048/4421:53
*** markstur_ has left #openstack-cinder21:53
scottdaUploaded patch to use nova-manage21:54
*** jungleboyj has joined #openstack-cinder21:59
*** annegentle has joined #openstack-cinder22:00
*** haomaiwang has quit IRC22:01
breitzthingee:  <sorry stepped away from my machine>  I work for Oracle - if that is what you were asking22:01
*** jwcroppe has joined #openstack-cinder22:02
*** annashen has quit IRC22:02
*** haomaiwang has joined #openstack-cinder22:02
*** e0ne has quit IRC22:02
scottdabreitz: Are you in Broomfield, CO?22:05
breitzNo - I wish - I work from my home in Minneapolis, MN22:06
breitzI used to live in CO, I miss it22:06
scottdaahh..OK.22:06
scottdaBut you are coming to Fort Collins next week?22:07
breitzyes - that is my plan22:07
breitztickets purchased and all that......22:07
*** markvoelker has joined #openstack-cinder22:08
scottdacool See you there (here)22:09
breitzmy flight is on Tuesday morning - so with any luck I'll be there before noon22:09
*** jamielennox is now known as jamielennox|away22:15
zigomriedem: I am now.22:20
*** jordanP has quit IRC22:22
openstackgerritTomoki Sekiyama proposed openstack/cinder: Efficient image transfer for Glance cinder store  https://review.openstack.org/20175422:22
*** markvoelker_ has joined #openstack-cinder22:32
*** Lee1092 has quit IRC22:33
*** markvoelker has quit IRC22:35
*** belmoreira has quit IRC22:37
*** eharney has quit IRC22:38
*** primechuck has quit IRC22:39
*** annegentle has quit IRC22:44
*** harlowja has quit IRC22:44
*** harlowja has joined #openstack-cinder22:44
*** dustins has quit IRC22:52
*** boris-42 has quit IRC23:00
*** haomaiwang has quit IRC23:01
*** haomaiwa_ has joined #openstack-cinder23:02
*** zhenguo has joined #openstack-cinder23:03
*** xyang1 has quit IRC23:04
hemnaxyang, I'm about to head out for a while23:06
hemnaxyang, my son has soccer until 8pm locally23:06
openstackgerritPatrick East proposed openstack/cinder: Generic image-volume cache  https://review.openstack.org/19579523:06
*** krypton has joined #openstack-cinder23:09
*** markvoelker_ has quit IRC23:14
*** _cjones_ has quit IRC23:24
*** jungler has quit IRC23:27
*** jungler has joined #openstack-cinder23:28
*** diogogmt has quit IRC23:28
*** dims_ has joined #openstack-cinder23:31
*** dims_ has quit IRC23:31
*** annashen has joined #openstack-cinder23:31
*** dims has quit IRC23:35
*** annashen has quit IRC23:36
*** jaypipes has quit IRC23:39
*** daneyon_ has quit IRC23:41
*** vokt has quit IRC23:43
*** marcusvrn has quit IRC23:43
*** lcurtis has quit IRC23:46
*** patrickeast has quit IRC23:54
*** dannywilson has quit IRC23:55
*** salv-orlando has quit IRC23:57
openstackgerritJohn Griffith proposed openstack/cinder-specs: Cinder Volume replication V2  https://review.openstack.org/15564423:57
anteayathingee: the account is disabled: http://lists.openstack.org/pipermail/third-party-announce/2015-July/000259.html23:57
jgriffiththingee: ^^23:58
jgriffiththingee: I stripped out the detail while keeping something close to what the patch is shaping up to be.  Hopefully that can just be approved and we can focus on the patch.23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!