Wednesday, 2016-03-02

openstackgerritEric K proposed openstack/congress: Use partitions in all DSE2 tests  https://review.openstack.org/28691100:05
openstackgerritEric K proposed openstack/congress: Use partitions in all DSE2 tests  https://review.openstack.org/28691100:08
*** ekcs has joined #congress00:28
thinrichsekcs: you there?00:33
ekcshey thinrichs00:33
thinrichsJust saw your new patch.00:33
thinrichsWas it the same problem we saw before?00:33
ekcsvery similar. same cause.00:35
ekcssame solution.00:35
thinrichsI was hoping the other tests wouldn't be so sensitive.00:35
thinrichsAnd that we might only need to use partitions for a few.00:36
thinrichsBut it seems that's not the case.00:36
thinrichsI never saw a failure locally—was it just in the gate?00:36
ekcsright. they’re all sensitive. every time I send an rpc call and there is another node with the same id still hanging around, the call can go to the wrong node.00:36
ekcsyes local failure happens when I delete the .tox dir to start clean.00:37
ekcsnot totall sure why.00:37
*** banix has joined #congress00:37
ekcsas in not tottaly sure why and old .tox folder would cause the problem not to occur.00:38
thinrichsThat .tox problem seems totally weird.00:38
thinrichsYou think we could have also fixed it by stopping all the nodes at the end of every test?00:38
thinrichsI still think the partition approach is the right one, since you can fix 1 test before all the other tests are fixed.00:39
ekcsyes. making sure I stop all nodes is the first thing I did. that worked.00:40
ekcsbut then I went partitions cuz I agree that’s the better approach.00:40
thinrichsWith the node-stop approach, we're fixing test A by going around and fixing all of the other tests B.00:40
thinrichsWas that why you thought partitioning was the right answer?  Or was it something else?  (I'm always trying to re-evaluate those kinds of decisions after the fact.)00:41
ekcswell i still think either solution would be OK. Stopping in each test has the advantage that if someone forgets to do that in a test, it’ll likely fail on gate. On the other hand, the failure would be confusing because it’d show up all over the place in unrelated tests.00:44
ekcspartitioning has the disadvantage that if someone forgets to add partition in a new test, failure probably won’t show up right away (because everything else it’s in a diff part). On the other hand, when failures do eventually show up, it’ll be clear which tests are causing the failure because only the non-partitioned tests would fail.00:45
ekcsIt’s not definitive, but I think partitioning makes sense. A new contributor would be thoroughly confused if s/he writes a new test and all of a sudden things fail all over the place. Let’s say it happens a year from now, diagnosis even by old-timers would depend on retaining this oral tradition of knowledge passed down about test interference.00:48
thinrichsMakes sense to me.  Thinking long-term is definitely important here.00:49
thinrichsI pushed your change in by the way.  Looks great.00:49
ekcsit’s a trade-off between fail-fast and fail-local.00:49
ekcsgreat thanks!00:50
ekcsdiff topic, the plan now is to focus on testing right?00:50
ekcshaha wacky idea. we could add to the test suite a bunch of extraneous nodes sitting in the default partition and trying to interfere with things. that way anyone would forgets to use partitions would likely see failure right away. Don’t think we should do that now but if people forget to partition a lot, then maybe worth considering.00:53
ekcsthen we get both fail-fast and fail-local.00:54
ekcswell actually a better way would be to let test base set a unittest flag. and then make DseNode throw an error every time no partition is supplied AND the unittest flag is set.00:59
*** achanda has quit IRC01:03
thinrichsOr maybe we should have the partition argument always be required and let Python handle it.01:06
thinrichsYes.  The idea is to focus on testing.  I'm struggling to get a devstack set up.01:07
thinrichsThat's the only real way to test the system.01:07
*** banix has quit IRC01:07
thinrichs(I always struggle to get devstack set up, by the way.)01:07
ekcshaha yea everyone has trouble with devstack.01:13
thinrichsekcs: do you have a local.conf file that works?01:17
ekcsthinrichs: i think you can pull it out of the HOL image.01:23
ekcsthat’s what I did before. will probably do that again.01:23
thinrichsI tried pulling it out of the devstack setup we use in the gate.  That hasn't worked out.  Maybe I'll see if the HOL is any different.01:24
*** jasonsb has joined #congress01:25
openstackgerritMerged openstack/congress: Use partitions in all DSE2 tests  https://review.openstack.org/28691101:41
*** fawadkhaliq has quit IRC01:42
openstackgerritEric K proposed openstack/congress: Heartbeat update of subscribed tables  https://review.openstack.org/28158601:43
*** achanda has joined #congress01:51
openstackgerritEric K proposed openstack/congress: Heartbeat update of subscribed tables  https://review.openstack.org/28158601:59
openstackgerritEric K proposed openstack/congress: Heartbeat update of subscribed tables  https://review.openstack.org/28158602:00
*** thinrichs has quit IRC02:18
*** banix has joined #congress02:34
openstackgerritEric K proposed openstack/congress: Remove redundant dse2 partitioning code  https://review.openstack.org/28693902:42
openstackgerritEric K proposed openstack/congress: Require dse2 partitioning in unittesting  https://review.openstack.org/28696103:41
*** fawadkhaliq has joined #congress03:43
*** ekcs has quit IRC03:56
*** banix has quit IRC04:20
openstackgerritAnusha Ramineni proposed openstack/congress: Migrate datasource api model  https://review.openstack.org/28050904:22
openstackgerritAnusha Ramineni proposed openstack/congress: Migrate datasource api model  https://review.openstack.org/28050904:25
*** fawadkhaliq has quit IRC04:58
*** banix has joined #congress05:06
*** banix has quit IRC05:09
*** achanda has quit IRC05:35
*** achanda has joined #congress05:39
*** achanda has quit IRC05:39
*** achanda has joined #congress06:00
*** masahito has joined #congress07:51
*** achanda has quit IRC08:03
*** achanda has joined #congress08:07
*** achanda has quit IRC08:18
*** jasonsb has quit IRC09:16
openstackgerritBéla Vancsics proposed openstack/congress: Use assert(Not)Equal/Less/GreaterEqual  https://review.openstack.org/28706009:39
*** jasonsb has joined #congress09:43
*** masahito has quit IRC12:53
*** fawadkhaliq has joined #congress12:54
*** fawadkhaliq has quit IRC13:21
*** thumpba has joined #congress14:16
*** thinrichs has joined #congress15:48
*** thinrichs has quit IRC15:49
*** thinrichs has joined #congress15:50
*** fawadkhaliq has joined #congress16:06
*** banix has joined #congress16:12
*** fawadkhaliq has quit IRC16:14
*** bryan_att has quit IRC16:15
*** bryan_att has joined #congress16:20
openstackgerritMerged openstack/congress: Use assert(Not)Equal/Less/GreaterEqual  https://review.openstack.org/28706016:35
openstackgerritMerged openstack/congress: Migrate datasource api model  https://review.openstack.org/28050917:11
openstackgerritMerged openstack/congress: Remove redundant dse2 partitioning code  https://review.openstack.org/28693917:11
*** achanda has joined #congress17:12
*** fawadkhaliq has joined #congress17:21
*** achanda has quit IRC17:27
*** jasonsb has quit IRC17:30
*** jasonsb has joined #congress17:32
*** jasonsb has quit IRC17:36
*** achanda has joined #congress17:45
*** absubram has joined #congress18:13
*** thinrichs has quit IRC18:16
*** thinrichs has joined #congress18:44
*** ekcs has joined #congress18:50
*** thinrichs has quit IRC19:46
*** thinrichs has joined #congress19:48
*** thinrichs has quit IRC20:30
*** thinrichs has joined #congress20:31
*** thinrichs has quit IRC20:41
*** thumpba has quit IRC20:44
*** tsandall has joined #congress21:18
*** achanda has quit IRC22:06
*** banix has quit IRC22:06
*** achanda has joined #congress22:13
*** achanda has quit IRC22:20
*** pballand has joined #congress22:38
openstackgerritEric K proposed openstack/congress: Require dse2 partitioning in unittesting  https://review.openstack.org/28696122:48
*** thinrichs has joined #congress23:04
*** achanda has joined #congress23:20
*** absubram has quit IRC23:25
*** achanda has quit IRC23:28
*** banix has joined #congress23:30
*** banix has quit IRC23:32
*** thinrichs has quit IRC23:38
*** thinrichs has joined #congress23:48
*** ramineni1 has joined #congress23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!