Wednesday, 2014-04-23

*** openstackgerrit has quit IRC03:04
*** openstackgerrit has joined #magnetodb03:05
*** shakamunyi has quit IRC05:14
*** ominakov has joined #magnetodb05:42
*** shakamunyi has joined #magnetodb06:10
openstackgerritDmitriy Ukhlov proposed a change to stackforge/magnetodb:  Parallelize BatchWrite operation  https://review.openstack.org/8664406:11
*** crxz0193 has joined #magnetodb06:13
*** shakamunyi has quit IRC06:15
ominakovhi all06:19
achuprinHi everyone06:22
*** crxz0193 has quit IRC06:35
*** crxz0193 has joined #magnetodb06:37
*** achuprin has quit IRC06:55
*** idegtiarov has joined #magnetodb07:03
*** achuprin has joined #magnetodb07:10
*** shakamunyi has joined #magnetodb07:14
*** shakamunyi has quit IRC07:19
*** crxz0193 has quit IRC07:22
*** crxz0193 has joined #magnetodb07:23
*** jeromatron has joined #magnetodb07:45
isviridovGood morning, achuprin07:50
*** crxz0193 has quit IRC08:08
*** crxz0193 has joined #magnetodb08:09
*** crxz0193 has quit IRC08:13
*** jeromatron has quit IRC08:14
*** achuprin has quit IRC08:16
*** achuprin has joined #magnetodb08:16
miarmakgood morning guys!08:30
*** keith_newstadt has quit IRC08:32
*** jeromatron has joined #magnetodb08:36
*** jeromatron has quit IRC09:09
*** jeromatron has joined #magnetodb09:09
*** jeromatron has quit IRC09:10
*** jeromatron has joined #magnetodb09:12
*** jeromatron has quit IRC09:16
*** jeromatron has joined #magnetodb09:16
*** jeromatron has quit IRC09:20
*** jeromatron has joined #magnetodb09:58
*** denis_makogon has joined #magnetodb10:08
openstackgerritAleksey Chuprin proposed a change to stackforge/magnetodb: Changed cassandra version from 2.0.6 to 2.0.7  https://review.openstack.org/8981012:16
*** [o__o] has quit IRC12:43
*** [o__o] has joined #magnetodb12:45
ominakovisviridov, hi13:29
ominakovisviridov, please verify this bug https://bugs.launchpad.net/magnetodb/+bug/129724713:40
ikhudoshynguys, looks like there is a bug in C* that bothers me pretty much, https://issues.apache.org/jira/browse/CASSANDRA-598713:59
ikhudoshyndoes anybody know anything about it aside of what can be read in jira?14:00
ikhudoshynjeromatron, I just wonder could you be any closer to the ^ ^ then the rest of us?14:01
jeromatronhmm, sounds like there wasn't necessarily a problem in the Cassandra code, Yuki gave him some suggestions to go from.14:03
jeromatronthe bulk loader is used for a variety of purposes including restoring from backup, so I would be surprised if there were any problems that don't get worked out quickly.14:04
*** ominakov has quit IRC14:06
miarmakHey guys, take a look please on this bp, and join the discussion in it's whiteboard: https://blueprints.launchpad.net/magnetodb/+spec/configurable-consistency14:15
jeromatronikhudoshyn do you have a reproducible case of that bug?14:21
ikhudoshynjeromatron, well, I tried to follow Yuki's suggestion but failed with it14:39
ikhudoshynyep, i do14:40
isviridovominakov, done. Nice shot14:44
jeromatron@ikhudoshyn I was just asking Yuki and he said "hmm, now we have CQL SSTableWriter so he can try that instead."14:46
ikhudoshynjeromatron, do you mean using SSTableWriter instead of SSTableSimpleUnsortedWriter?14:48
jeromatronikhudoshyn https://github.com/apache/cassandra/blob/cassandra-2.0.7/src/java/org/apache/cassandra/io/sstable/CQLSSTableWriter.java14:49
ikhudoshynjeromatron, thanks, gonna go and try14:51
jeromatronnp - let us know on the ticket or in here if that doesn't work for you14:52
*** CharlesW has joined #magnetodb14:54
*** ominakov has joined #magnetodb14:56
isviridovWelcome back, CharlesW14:56
isviridovCan we congratulate you?14:57
*** idegtiarov has quit IRC15:04
openstackgerritCharles Wang proposed a change to stackforge/magnetodb: Implement the RESTFul API of DeleteItem operation  https://review.openstack.org/8488915:09
openstackgerritA change was merged to stackforge/magnetodb: Changed cassandra version from 2.0.6 to 2.0.7  https://review.openstack.org/8981015:11
ikhudoshynjeromatron, big thanks, it works for me15:13
jeromatronikhudoshyn great to hear.  do you mind updating the ticket indicating that for anyone who stumbles across it?15:14
ikhudoshynsure, I can do that15:17
isviridovdukhlov, around?15:19
CharlesWI'm also looking for Dmitriy15:21
CharlesWThanks isviridov. I have a wonderful new addition to my family. Very happy :)15:25
isviridovIs it boy or girl?15:27
*** dukhlov_ has joined #magnetodb15:27
isviridovdukhlov,  or dukhlov_15:28
isviridov?15:28
isviridov))15:28
CharlesWBoy. Now I have a girl and boy in my family.15:28
dukhlov_hi guys15:28
miarmakdukhlov_: hello!15:28
isviridovCharlesW, it is great news! I'm just 2 months ahead of you, man :))15:29
CharlesWboy or girl?15:31
isviridovCharlesW, it is a boy15:31
CharlesWGreat. Will some of you guys go to Atlanta OS summit?15:35
CharlesW@dukhlov_, wrt async table creation, shall we continue our discussion about two weeks ago?15:43
CharlesWor let me know a more convenient time for you so we can chat?15:46
dukhlov_CharlesW: unfortunately I haven't finished my plugability task and can't give you information to start your task15:47
dukhlov_but is you have general questions we can to talk about it15:47
dukhlov_*if15:48
*** achuprin has quit IRC15:51
CharlesWquestion: will schema disagreement happen and require manual intervention if schema changes come in in parallel? Or it just takes long time to reach schema agreement and disagreement will resolve on its own?16:02
*** jeromatron has quit IRC16:03
dukhlov_116:08
dukhlov_1) Cassandra handle parallel schema changes correct16:09
dukhlov_and we shoudn't have schema disagreement on Cassandra level16:10
dukhlov_eventually16:10
dukhlov_and there we don't have problem with long time of that operation16:11
dukhlov_but on MagnetoDB level we need to check that schema is the same on each node16:12
dukhlov_if you use original python-driver  you can meet some concurrency problem16:14
dukhlov_it can return that table already distributed between all nodes but it actually isn't16:15
dukhlov_to fix this we patched python-driver16:15
CharlesWso what's the problem if we use the execute_async to create table, and return CREATING to magnetodb client. Client needs to run describe table on their own to make sure it's in active state16:16
dukhlov_and now we have only problem with possible long time of create table operation16:16
dukhlov_1) we need to use patched python-driver16:17
dukhlov_2) we can get more longer time of async_create table operation and describe table will return status CREATING for 5 min for example instead of 1 min16:19
*** ominakov has quit IRC16:20
dukhlov_3) it hard to recover after fails: we can have a lot of workers and we heve no information about them16:21
dukhlov_if some table creation hang we have no information why16:22
dukhlov_is it still in progress16:22
dukhlov_or it was failed16:22
dukhlov_It is possible problem which I  expect16:23
CharlesW1) python driver should be fixed on C* side to handle schema refresh16:25
CharlesW2) depending on the Q on magnetodb side, it can also take long time > 1 min16:26
CharlesW3) C* is supposed to handle this, shouldn't it?16:26
dukhlov_1) I think so, but we need to talk with its developers first16:27
dukhlov_2) yes, but this queue will be processed with predictabe time and we will change status to ACTIVE when table is distributed between nodes immediately16:31
dukhlov_3) No I mean problem on Magnetodb layer. For example our magnetodb instance crashed. And async work will never finished. We restart instance, but our async task is lost16:34
dukhlov_we can send create_table again by client16:34
dukhlov_but we don't know is that task was on that crashed node16:35
miarmakguys, pay attantion please to this bp: https://blueprints.launchpad.net/magnetodb/+spec/configurable-consistency and join discussion in it's whiteboard. Thanks!16:35
miarmakand bye all :)16:35
dukhlov_or maybe it serves by another node and it stiil alive16:35
dukhlov_miarmak: sure16:36
dukhlov_miarmak: bye!16:36
isviridovdukhlov, bye bye17:22
*** denis_makogon has quit IRC17:32
*** denis_makogon has joined #magnetodb17:33
*** denis_makogon has quit IRC17:36
*** ominakov has joined #magnetodb17:42
dukhlov_isviridov: bye!17:53
*** ominakov has quit IRC18:29
*** ominakov has joined #magnetodb19:33
*** jeromatron has joined #magnetodb19:40
*** ominakov has quit IRC19:41
*** pas-ha has joined #magnetodb19:55
*** pas-ha has left #magnetodb19:56
*** jeromatron has quit IRC20:04
*** jeromatron has joined #magnetodb20:41
*** jeromatron has quit IRC21:39
*** CharlesW has quit IRC22:33

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!