Sunday, 2012-03-18

*** andrewbogott has quit IRC00:01
*** andrewbogott has joined #openstack-dev00:16
*** anotherjesse is now known as anotherjesse_zz00:17
*** anotherjesse_zz is now known as anotherjesse00:20
*** anotherjesse is now known as anotherjesse_zz00:30
*** ncode has joined #openstack-dev00:31
*** ncode has joined #openstack-dev00:31
*** shevek_ has quit IRC00:33
*** jakedahn_zz is now known as jakedahn00:38
*** andrewbogott has quit IRC00:46
*** pvo-away is now known as pvo00:51
*** ncode has joined #openstack-dev01:01
*** dtroyer is now known as dtroyer_zzz01:02
*** ncode has quit IRC01:10
*** dolphm has joined #openstack-dev01:41
*** novas0x2a|laptop has quit IRC01:53
*** martine has joined #openstack-dev02:27
*** danwent has quit IRC02:39
*** ywu has quit IRC02:52
*** novas0x2a|laptop has joined #openstack-dev03:05
*** sdake has quit IRC03:06
*** dolphm has quit IRC03:07
*** flaviamissi_ has joined #openstack-dev03:15
*** flaviamissi has quit IRC03:18
*** flaviamissi_ has quit IRC03:19
*** Mandell has joined #openstack-dev03:24
*** devcamcar has quit IRC04:02
*** kpepple_ has quit IRC04:02
*** openstackgerrit has quit IRC04:02
*** devcamcar has joined #openstack-dev04:06
*** kpepple_ has joined #openstack-dev04:06
*** openstackgerrit has joined #openstack-dev04:06
*** danwent has joined #openstack-dev04:14
*** asalkeld has joined #openstack-dev04:23
*** asalkeld has quit IRC04:24
*** asalkeld has joined #openstack-dev04:24
*** martine has quit IRC04:36
*** ncode has joined #openstack-dev04:37
*** asalkeld has quit IRC04:37
*** anotherjesse_zz is now known as anotherjesse04:38
*** andrewsmedina has quit IRC04:48
*** andrewsmedina has joined #openstack-dev04:52
*** andrewsmedina has quit IRC04:59
*** mjfork has quit IRC05:07
*** anotherjesse is now known as anotherjesse_zz05:08
*** zigo has joined #openstack-dev05:13
*** ncode has quit IRC05:13
*** dolphm has joined #openstack-dev05:30
*** Mandell has quit IRC05:31
*** hattwick has quit IRC05:32
*** wwkeyboard has quit IRC05:32
*** thingee has joined #openstack-dev05:34
bcwaldonjeblair: when you get a chance, glance unit tests are failing due to too many links in /tmp05:35
*** Mandell has joined #openstack-dev05:46
*** zaitcev has quit IRC05:46
*** dolphm has quit IRC05:50
*** dolphm has joined #openstack-dev05:52
*** dtroyer_zzz is now known as dtroyer06:02
*** dtroyer is now known as dtroyer_zzz06:09
*** Shrews has joined #openstack-dev06:14
*** dolphm has quit IRC06:16
*** dolphm has joined #openstack-dev06:24
*** danwent has quit IRC06:28
*** littleidea has quit IRC06:52
*** Shrews has quit IRC06:55
*** Mandell has quit IRC07:08
*** dolphm has quit IRC07:29
*** dolphm has joined #openstack-dev07:52
*** hattwick has joined #openstack-dev07:59
*** dachary has joined #openstack-dev08:03
*** thingee is now known as thingee_zzz08:08
*** roge has joined #openstack-dev08:15
*** dolphm has quit IRC08:17
*** roge has quit IRC09:16
*** shevek_ has joined #openstack-dev10:05
*** martine has joined #openstack-dev10:33
*** martine has quit IRC10:38
*** berendt has joined #openstack-dev11:06
*** Ryan_Lane has quit IRC11:38
*** benner has quit IRC12:15
*** eglynn_ has quit IRC12:16
*** flaviamissi has joined #openstack-dev12:16
*** eglynn_ has joined #openstack-dev12:18
*** benner has joined #openstack-dev12:22
notmynamejustinsb: ping13:07
*** justinsb_ has joined #openstack-dev13:13
*** termie_ has joined #openstack-dev13:13
*** benner_ has joined #openstack-dev13:13
*** yamahata_ has joined #openstack-dev13:13
*** Kiall_ has joined #openstack-dev13:17
*** benner has quit IRC13:19
*** dachary has quit IRC13:19
*** Kiall has quit IRC13:19
*** justinsb has quit IRC13:19
*** termie has quit IRC13:19
*** villep has quit IRC13:19
*** fesnel has quit IRC13:19
*** yamahata has quit IRC13:19
*** Kiall_ is now known as Kiall13:19
*** villep has joined #openstack-dev13:20
*** dachary has joined #openstack-dev13:20
*** fesnel has joined #openstack-dev13:20
*** mjfork has joined #openstack-dev13:27
*** ncode has joined #openstack-dev13:52
*** roge has joined #openstack-dev14:00
*** dolphm has joined #openstack-dev14:08
*** ywu has joined #openstack-dev14:09
*** wwkeyboard has joined #openstack-dev14:23
*** dolphm has quit IRC14:26
*** dolphm has joined #openstack-dev14:28
*** dolphm has quit IRC14:32
*** sdake has joined #openstack-dev14:40
*** ncode has quit IRC14:43
*** ywu has quit IRC14:47
*** dolphm has joined #openstack-dev14:49
*** eglynn__ has joined #openstack-dev14:56
*** eglynn_ has quit IRC14:56
*** roge has quit IRC15:08
*** ywu has joined #openstack-dev15:34
jeblairbcwaldon: thanks.  cleaned them up.  devananda has a fix in progress for that.15:45
*** dolphm has quit IRC15:52
*** dolphm_ has joined #openstack-dev15:55
*** Mandell has joined #openstack-dev16:02
*** dolphm_ has quit IRC16:09
*** roge has joined #openstack-dev16:11
*** dolphm has joined #openstack-dev16:20
*** dolphm has quit IRC16:24
*** danwent has joined #openstack-dev16:25
*** roge has quit IRC16:27
*** danwent has quit IRC16:27
*** dneary has joined #openstack-dev16:29
*** dneary has quit IRC16:29
*** dneary has joined #openstack-dev16:29
*** rgoodwin is now known as rgoodwin_away16:44
*** rgoodwin_away is now known as rgoodwin16:46
*** Mandell has quit IRC16:52
*** byeager has quit IRC17:15
*** akshayms_ has joined #openstack-dev17:20
*** dolphm has joined #openstack-dev17:22
*** ywu has quit IRC17:22
*** ywu has joined #openstack-dev17:25
*** dneary has quit IRC17:35
*** btorch_ has joined #openstack-dev17:42
eglynn__jeblair: still around?17:47
eglynn__ jeblair: could you re-enable GLANCE_TEST_S3_CONF & GLANCE_TEST_SWIFT_CONF for the glance builds in Jenkins?17:47
eglynn__(now that https://review.openstack.org/5466 has landed)17:47
*** andrewsmedina has joined #openstack-dev17:47
eglynn__jaypipes / bcwaldon: https://review.openstack.org/5487 should address the temp dir leakage that was borking /tmp on the Jenkins slaves17:48
*** dubsquared has quit IRC17:54
*** Ryan_Lane has joined #openstack-dev18:00
*** roge has joined #openstack-dev18:01
*** dolphm has quit IRC18:12
*** akshayms_ has quit IRC18:14
*** ywu has quit IRC18:17
*** jakedahn is now known as jakedahn_zz18:18
*** dolphm has joined #openstack-dev18:18
*** novas0x2a|laptop has quit IRC18:28
*** roge has quit IRC18:30
*** novas0x2a|laptop has joined #openstack-dev18:31
*** ncode has joined #openstack-dev18:31
*** ncode has joined #openstack-dev18:31
*** novas0x2a|laptop has quit IRC18:37
*** novas0x2a|laptop has joined #openstack-dev18:40
*** danwent has joined #openstack-dev19:41
*** dolphm has quit IRC19:47
*** novas0x2a|laptop has quit IRC19:53
*** novas0x2a|laptop has joined #openstack-dev19:56
*** ywu has joined #openstack-dev20:03
*** roge has joined #openstack-dev20:18
*** roge has quit IRC20:25
*** dolphm has joined #openstack-dev20:46
*** dolphm has quit IRC20:49
*** asalkeld has joined #openstack-dev21:09
*** roge has joined #openstack-dev21:40
*** zigo has quit IRC21:43
*** roge has quit IRC21:44
*** anotherjesse_zz is now known as anotherjesse22:48
*** ncode has quit IRC22:55
justinsb_notmyname: (Very delayed) ack23:12
*** Mandell has joined #openstack-dev23:19
notmynamejustinsb_: still here?23:21
notmynamejustinsb_: I haven't looked at your code yet, but I wanted to run a related idea by you23:23
notmyname(the swift ring changes)23:23
notmynamejustinsb_: if I don't catch you tonight, ping me sometime tomorrow23:29
*** hazmat has quit IRC23:33
justinsb_notmyname: Stepped away for a minute, but I'm back!23:37
*** martine has joined #openstack-dev23:37
justinsb_notmyname: I'm working on figuring out how to actually test changing the # replicas23:39
notmynamejustinsb_: have you heard of the idea to make replica placement in the zones "as unique as possible"?23:41
justinsb_notmyname: I think chmouel pointed me to it, but I didn't really see how to apply it23:42
notmynamejustinsb_: the idea is to keep N replicas (because you really do want that), but you can have as few as one zone. you then grow your cluster by adding zones (not replicas)23:43
notmynameright now, swift places each replica in a unique zone and requires that you have at least as many zones as replicas.23:44
notmynamethis works fine from the medium to large case, but isn't very elegant for smaller clusters23:44
notmyname(none of this should be taken as me opposed to exploring dynamic replica counts)23:45
*** hazmat has joined #openstack-dev23:45
notmynamejustinsb_: I'm curious if you think that sort of change (the as unique as possible one) would work in your use case23:45
justinsb_notmyname: What I'd like to solve is the packaging problem - I'm trying to figure how we install the first server and then grow nicely to a properly redundant system23:45
justinsb_notmyname: It sounds like I'd still have to install multiple swift instances on my first box23:45
notmynameno, you wouldn't23:45
notmynamewell, perhaps multiple processes, but just one of each (proxy, account, etc)23:46
justinsb_notmyname: So it would only store it once if there was only one zone?23:47
notmynamewhat would happen is that the 3 replicas would go to the same zone/box/process23:47
notmynameall 3 replicas would go to the first zone23:47
notmynameof course, at that point the replicas aren't really doing much for you except taking up extra space23:47
notmynamebut it's a starting point for a larger cluster23:48
justinsb_notmyname: But as I added more machines it would rebalance, I presume23:48
notmynameya23:48
justinsb_notmyname: That does solve the packaging issue then23:48
*** deshantm has joined #openstack-dev23:48
notmynameand if you aren't planning on growing past the capabilities of one box, perhaps swift isn't the right storage solution (just use RAID and NFS or something similar)23:48
justinsb_notmyname: I'm coming at this from the point of view of e.g. what should apt-get do.23:49
justinsb_notmyname: I think you should be able to apt-get install swift and get a single node install that works23:49
notmynamehttp://joearnold.com/swift-in-the-small/23:49
notmynameexampel of how to do small clusters with the current design ^23:50
justinsb_notmyname: But then you should also be able to grow it from that point to a full swift install23:50
*** martine has quit IRC23:50
justinsb_notmyname: I definitely agree that swift on one node isn't the best example of swift in action23:50
justinsb_notmyname: But it is nice to be able to use the same APIs etc23:51
notmynamejustinsb_: I don't really buy the argument that packaging should dictate design changes. swift is intended to be used in a distributed system. apt-get on one box doesn't really make sense23:51
notmynameI do like the argument of starting from a small cluster and growing from there, though23:51
justinsb_I just want to see it being used, and a complicated installation process is a big barrier to that.23:52
justinsb_Even if we're not using the full capabilities on one box, I think it should be possible to get something up and running on one box23:52
notmynameI'm a big fan of lowering barriers to entry :-)23:52
justinsb_Both incrementing the replica count and the 'as unique as possible' approach seem good to me23:53
notmynameI don't like changing replica counts as much because it doesn't make sense in existing clusters of most any size23:53
Lumierepackaging is meant as a configuration management tool as much as anything else23:54
notmynamejustinsb_: the replication bandwidth needed would be tremendous (I haven't read your code to see how you handle this yet)23:54
justinsb_notmyname: I can certainly see that you don't want to change replica count too often23:55
justinsb_notmyname: I haven't even tried it yet.  I just reconfigure the ring and rely on the repair to fix things.  I'm working on trying it now and seeing where it breaks!23:55
justinsb_notmyname: The 'as unique as possible' isn't going to be available for essex though, right?23:56
notmynamecorrect23:56
notmynameit's been attempted as a side project by one of the swift devs, but it hasn't been integrated into swift yet.23:57
notmynameI'd give it better than 50% odds of being in folsom, though23:58
justinsb_notmyname: So are we suggesting that swift be packaged?  You can apt-get it, but it won't work unless you have at least 3 machines and configure them together?23:58
justinsb_notmyname: Oops... "so how are we" ...23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!