Tuesday, 2015-12-15

*** salv-orl_ has joined #openstack-oslo00:02
*** pballand has quit IRC00:03
*** salv-orlando has quit IRC00:05
*** zqfan_AFK has joined #openstack-oslo00:10
*** salv-orl_ has quit IRC00:11
openstackgerritJoshua Harlow proposed openstack/taskflow: Change name of misc.ensure_dict to misc.safe_copy_dict  https://review.openstack.org/25762300:19
*** dimtruck is now known as zz_dimtruck00:23
*** EinstCrazy has joined #openstack-oslo00:23
*** EinstCrazy has quit IRC00:25
*** yottatsa has joined #openstack-oslo00:38
openstackgerritMerged openstack/taskflow: Add validation of base exception type(s) in failure type  https://review.openstack.org/23713500:40
*** yottatsa has quit IRC00:51
*** yottatsa has joined #openstack-oslo00:53
*** yottatsa has quit IRC00:54
*** EinstCrazy has joined #openstack-oslo00:58
*** openstack has joined #openstack-oslo01:07
harlowja_bogdando yt01:17
*** sputnik13 has quit IRC01:26
openstackgerritJoshua Harlow proposed openstack/taskflow: Disallow and raise on duplicate conductor run calls  https://review.openstack.org/25764101:31
*** zz_dimtruck is now known as dimtruck01:34
*** yamamoto has joined #openstack-oslo01:42
*** yamamoto has quit IRC01:52
*** yamamoto has joined #openstack-oslo01:52
*** yamamoto has quit IRC01:56
openstackgerritJoshua Harlow proposed openstack/taskflow: Translate kazoo exceptions into job equivalents if register_entity fails  https://review.openstack.org/25764501:56
*** mtanino has quit IRC02:00
*** salv-orlando has joined #openstack-oslo02:15
*** browne has quit IRC02:16
*** mtreinish has quit IRC02:20
*** mtreinish has joined #openstack-oslo02:20
*** salv-orlando has quit IRC02:22
*** ericksonsantos has quit IRC02:28
*** ericksonsantos has joined #openstack-oslo02:29
*** salv-orlando has joined #openstack-oslo02:31
*** salv-orlando has quit IRC02:35
*** jecarey has joined #openstack-oslo02:48
*** dimtruck is now known as zz_dimtruck02:51
*** jecarey has quit IRC02:53
*** vilobhmm11 has quit IRC02:54
*** yamamoto has joined #openstack-oslo02:54
*** wusWWW has joined #openstack-oslo02:55
openstackgerritMerged openstack/taskflow: Use the misc.ensure_dict helper in conductor engine options saving  https://review.openstack.org/24387502:55
openstackgerritMerged openstack/taskflow: Add in-memory backend delete() in recursive/non-recursive modes  https://review.openstack.org/18998203:00
openstackgerritMerged openstack/taskflow: Use the sqlalchemy-utils json type instead of our own  https://review.openstack.org/18825803:00
*** yamahata has quit IRC03:05
*** EinstCrazy has quit IRC03:20
*** browne has joined #openstack-oslo03:20
*** EinstCrazy has joined #openstack-oslo03:21
*** pratikmallya has quit IRC03:36
*** david-lyle has quit IRC03:50
*** david-lyle has joined #openstack-oslo03:58
*** krotscheck is now known as krotscheck_vaca04:00
*** david-lyle has quit IRC04:01
*** david-lyle has joined #openstack-oslo04:02
*** links has joined #openstack-oslo04:07
*** sputnik13 has joined #openstack-oslo04:10
*** boris-42_ has quit IRC04:13
*** sputnik13 has quit IRC04:19
*** yamahata has joined #openstack-oslo04:19
*** openstackstatus has quit IRC04:24
*** openstack has joined #openstack-oslo04:25
*** sputnik1_ has joined #openstack-oslo04:25
*** openstackstatus has joined #openstack-oslo04:25
*** ChanServ sets mode: +v openstackstatus04:25
*** pratikmallya has joined #openstack-oslo04:36
*** salv-orl_ has joined #openstack-oslo04:37
*** vilobhmm11 has joined #openstack-oslo04:39
*** pratikmallya has quit IRC04:41
*** salv-orl_ has quit IRC04:41
*** wusWWW has quit IRC05:01
*** jecarey has joined #openstack-oslo05:08
openstackgerritSteve Martinelli proposed openstack/oslo-incubator: remove py26 handling from install_venv files  https://review.openstack.org/25767305:11
stevemaroh is incubator dead?05:12
*** jecarey has quit IRC05:13
*** harlowja_at_home has joined #openstack-oslo05:18
openstackgerritJoshua Harlow proposed openstack/taskflow: Remove failure version number  https://review.openstack.org/23728005:26
*** salv-orlando has joined #openstack-oslo05:37
openstackgerritMerged openstack/taskflow: Change name of misc.ensure_dict to misc.safe_copy_dict  https://review.openstack.org/25762305:38
*** salv-orlando has quit IRC05:40
*** dims has quit IRC05:41
openstackgerritJoshua Harlow proposed openstack/taskflow: Trap and expose exception any 'args'  https://review.openstack.org/23727905:43
openstackgerritJoshua Harlow proposed openstack/taskflow: Use 'match_type' utility function instead of staticmethod  https://review.openstack.org/23130905:45
*** gcb has joined #openstack-oslo05:56
openstackgerritJoshua Harlow proposed openstack/taskflow: POC of seeing how a graph with cycles would work  https://review.openstack.org/25768406:12
*** harlowja_at_home has quit IRC06:16
*** vilobhmm11 has quit IRC06:24
*** dims has joined #openstack-oslo06:56
*** gcb has quit IRC07:08
*** gcb has joined #openstack-oslo07:21
*** jecarey has joined #openstack-oslo07:24
*** dims has quit IRC07:26
*** pratikmallya has joined #openstack-oslo07:27
*** jecarey has quit IRC07:28
*** nkrinner has joined #openstack-oslo07:34
*** dims_ has joined #openstack-oslo07:45
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo.messaging: [WIP] Trying grenade tests  https://review.openstack.org/25771507:50
*** jaypipes has joined #openstack-oslo07:53
*** dims_ has quit IRC08:01
*** dims_ has joined #openstack-oslo08:09
*** mkovacik has joined #openstack-oslo08:15
*** browne has quit IRC08:18
*** nihilifer has joined #openstack-oslo08:18
*** sbelous_ has joined #openstack-oslo08:24
*** yamahata has quit IRC08:26
*** shardy has joined #openstack-oslo08:37
*** dims_ has quit IRC08:41
*** eezhova has joined #openstack-oslo08:48
*** yassine__ has joined #openstack-oslo09:07
*** salv-orlando has joined #openstack-oslo09:19
*** dims has joined #openstack-oslo09:21
*** mhickey has joined #openstack-oslo09:25
dimsozamiatin : https://review.openstack.org/#/c/257373/ is a merge from master so we should let that in and then fix it. looks like dukhlov has another review to fix the ci jobs09:27
ozamiatindims: +2A both patches09:28
dukhlovdims, ozamiatin: thank you09:29
dimsdukhlov : ozamiatin : if you see zuul page for 257715, you will see gate-oslo.messaging-src-grenade-dsvm-multinode and gate-oslo.messaging-src-grenade-dsvm in experimental queue09:30
dimsdukhlov : ozamiatin : that tests upgrade from liberty to master09:30
dimssileht : ^^09:31
silehtdims, cool !09:31
dimsif that works correctly, we should move that as non-voting on check queue09:31
dimszmq - we'll need to figure out how to run grenade to do master->master upgrade as we don't have zmq in liberty09:32
dimspika - we should merge into master and then figure out how to do the grenade like zmq09:33
dimsozamiatin : dukhlov : sileht : in the current set of tests we don't run ceilometer anywhere...right?09:33
dimsozamiatin : dukhlov : sileht : what else do we don't run?09:34
silehtdims, only ceilometer  API is tested by tempest09:34
ozamiatinsileht: isn't it skipped by default?09:34
silehtthat's possible09:34
dimssileht : how can we ensure we don't break ceilometer?09:38
dimsi.e. notifications09:38
silehtdims, functional tests have tests that reproduce the ceilometer use-cases, but this a really small testing09:39
dimssileht : right, those run in ceilometer and do not use oslo.messaging from master09:40
dimsright?09:40
silehtdims, I'm talking about oslo.messaging functional tests09:41
silehtdims, but yes ceilometer don't use oslo.messaging master09:41
dimsozamiatin : the magic to add the grenade jobs was in https://review.openstack.org/#/c/256467/ - see zuul/layout.yaml where it is in experimental block09:41
dimsozamiatin : can you please add a review to move that to check job?09:41
dimssileht : right. so we need something to be able to test that09:42
silehtdims, we have a job in ceilometer that we can put on oslo.messaging, but I think this is overkill09:42
dimssileht : problem is that we don't cover notifications at all anywhere09:42
ozamiatindims: ok, I'll try09:42
dimsozamiatin : move the 2 lines from experimental block to the check block should be enough :)09:43
ozamiatindims: ok :)09:43
silehtdims, the only I known where we tests the notification is: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/ceilometer.yaml#L19009:43
silehtdims, it's create a heat stack and ensure upscaling and downscaling occurs with heat/ceilometer/gnocchi09:44
dimsdukhlov : let's plan to stabilize the pika driver add some more tests and merge into master in a week or so?09:44
dimssileht : looking09:44
silehtdims, this is the only job that test the collector part of ceilometer09:45
dimssileht : ah scary :)09:46
silehtdims, tempest have always refused our patch to test it, so we built our own job09:46
*** openstackgerrit has quit IRC09:47
*** openstackgerrit has joined #openstack-oslo09:47
dukhlovdims: ok, I believe that it is stable enough. I'm working on unit tests now09:48
dimsthanks dukhlov09:48
*** e0ne has joined #openstack-oslo09:48
dimssileht : would ceilometer folks welcome an experimental job?09:49
*** cdent has joined #openstack-oslo09:49
*** jecarey has joined #openstack-oslo09:49
*** ndipanov has quit IRC09:49
dimssileht : and actually run it periodically to spot errors :)09:49
silehtdims, why not it easy to create it :)09:49
silehtdims, you want to put on oslo.messaging side or ceilometer side ?09:50
silehtoslo.messaging is perhaps better09:50
dimssileht : if we get the job running correctly which is half the battle we can put it as experimental in both09:50
dimssileht : y problem is we would have no clue what we broke :)09:51
silehtdims, it should work I always have oslo.messaging master on my devstack09:51
dimssileht : if i add that job exactly as is in the CI it won't pick up oslo.messaging master09:52
dimssileht : you probably have LIBS_FROM_GIT set to oslo.messaging in your devstack09:52
silehtdims, of course I'm talking about my testing env09:52
dimssileht : ok i'll try to line something up and ping you later this week09:53
*** jecarey has quit IRC09:53
*** gcb has quit IRC09:53
ozamiatindims: https://review.openstack.org/#/c/25778109:54
dimsozamiatin : lgtm09:55
dimsozamiatin : thanks09:55
dimssdague : how do i tell grenade to do master->master upgrade as we don't have zmq or pika driver in liberty? is that do-able?09:56
dimsozamiatin : hop onto #openstack-infra please09:58
ozamiatindims: ok09:58
silehtdims, https://review.openstack.org/25779009:58
*** e0ne has quit IRC09:59
*** e0ne has joined #openstack-oslo10:00
dimssileht : nice!10:03
silehtdims, running it on ceilometer side, need to refactor a bit the job, I will do it later10:03
*** ihrachys has joined #openstack-oslo10:06
dukhlovdims: what are these new grenade jobs are?10:14
dukhlovdism: one for multinode, what about the second one? why "grenade"10:15
dimsdukhlov : https://github.com/openstack-dev/grenade - tests upgrade scenario from one version of openstack to another10:15
dimsdukhlov : more info here http://docs.openstack.org/developer/grenade/10:17
dukhlovok, thank you for info10:17
dimsdukhlov : we'll have to trying to figure out "master+pika -> master+pika" upgrades and "liberty+kombu -> master+pika" upgrades eventually10:20
dukhlov"master+pika -> master+pika"?10:20
dukhlovdims: have you  meant "feature+pika -> master+pika"10:22
dimsdukhlov : no we should get pika from feature to master soon10:22
dimsthe first element refers to all of openstack "master" means mitaka openstack from sources "liberty" means the liberty release of everything10:23
dukhlovso another words you are talking about rolling updates?10:25
dukhlovdims: another point, should we develop some more generic update mechanism, to update from pika to zmq for example10:27
dimsdukhlov : right, we'll have to figure out what's needed10:28
*** ihrachys has quit IRC10:28
dimsdukhlov : first would be from kombu to pika :)10:28
dukhlovdims, agree10:29
*** SlickNik has quit IRC10:29
*** vipul has quit IRC10:30
*** zqfan_AFK has quit IRC10:31
*** openstackgerrit has quit IRC10:32
*** openstackgerrit has joined #openstack-oslo10:32
*** sbelous_ has quit IRC10:34
*** ihrachys has joined #openstack-oslo10:35
*** vipul has joined #openstack-oslo10:35
*** ihrachys has quit IRC10:35
*** SlickNik has joined #openstack-oslo10:35
*** ihrachys has joined #openstack-oslo10:41
*** pratikmallya has quit IRC10:48
*** EinstCrazy has quit IRC10:54
*** dims has quit IRC11:15
*** _amrith_ is now known as amrith11:15
*** EinstCrazy has joined #openstack-oslo11:18
*** lucas-dinner is now known as lucasagomes11:18
*** ig0r_ has quit IRC11:20
*** salv-orlando has quit IRC11:22
*** salv-orlando has joined #openstack-oslo11:22
*** sbelous_ has joined #openstack-oslo11:32
*** jaypipes has quit IRC11:35
*** yamamoto has quit IRC11:42
*** ihrachys has quit IRC11:43
*** ihrachys has joined #openstack-oslo11:44
*** yamamoto has joined #openstack-oslo11:44
*** SlickNik has quit IRC11:50
*** vipul has quit IRC11:50
*** yamamoto has quit IRC11:51
*** yamamoto has joined #openstack-oslo11:51
*** SlickNik has joined #openstack-oslo11:54
*** jaypipes has joined #openstack-oslo11:58
*** vipul has joined #openstack-oslo11:59
*** salv-orl_ has joined #openstack-oslo12:03
*** jaypipes has quit IRC12:03
*** salv-orlando has quit IRC12:06
*** pc_m has left #openstack-oslo12:11
*** yamamoto has quit IRC12:14
*** sputnik13 has joined #openstack-oslo12:17
*** sputnik13 has quit IRC12:25
*** ndipanov has joined #openstack-oslo12:33
*** EinstCrazy has quit IRC12:35
*** EinstCrazy has joined #openstack-oslo12:36
*** dims has joined #openstack-oslo12:39
*** gordc has joined #openstack-oslo12:45
openstackgerritMerged openstack/tooz: File: read member id from file with suffix ".raw"  https://review.openstack.org/25690512:45
*** salv-orl_ has quit IRC12:46
openstackgerritMerged openstack/tooz: Reduce duplication of code in handling multi-type blocking argument  https://review.openstack.org/25314912:47
*** dims has quit IRC12:51
*** yamamoto has joined #openstack-oslo12:54
*** gcb has joined #openstack-oslo13:06
openstackgerritMerged openstack/oslo-incubator: remove py26 handling from install_venv files  https://review.openstack.org/25767313:09
*** links has quit IRC13:09
*** snikitin has joined #openstack-oslo13:12
*** zz_dimtruck is now known as dimtruck13:23
*** fultonj has joined #openstack-oslo13:30
*** e0ne has quit IRC13:34
*** whydidyoustealmy has joined #openstack-oslo13:35
*** shakamunyi has joined #openstack-oslo13:35
*** e0ne has joined #openstack-oslo13:35
*** whydidyoustealmy is now known as superflyy13:36
*** kgiusti has joined #openstack-oslo13:40
*** yamamoto has quit IRC13:41
*** dimtruck is now known as zz_dimtruck13:46
openstackgerritZhiQiang Fan proposed openstack/oslo.utils: fix fileutils ut code random failure  https://review.openstack.org/25790313:50
*** links has joined #openstack-oslo13:51
*** rlrossit has joined #openstack-oslo13:52
*** regXboi has joined #openstack-oslo13:54
*** yamamoto has joined #openstack-oslo13:56
*** yamahata has joined #openstack-oslo13:58
*** cdent_ has joined #openstack-oslo14:00
*** rcernin has joined #openstack-oslo14:02
*** cdent has quit IRC14:02
*** cdent_ is now known as cdent14:02
*** sbelous_ has quit IRC14:02
*** amotoki has joined #openstack-oslo14:03
*** obondarev_afk is now known as obondarev14:04
*** e0ne has quit IRC14:12
*** vipul has quit IRC14:13
*** SlickNik has quit IRC14:14
*** vipul has joined #openstack-oslo14:19
*** jecarey has joined #openstack-oslo14:23
*** SlickNik has joined #openstack-oslo14:23
*** edmondsw has joined #openstack-oslo14:24
*** edmondsw has quit IRC14:28
*** dims has joined #openstack-oslo14:34
*** binarin has joined #openstack-oslo14:34
mhickeyHi. What tool is used to generate hash for objects in oslo.versionobject?14:35
rlrossitmhickey: https://github.com/openstack/oslo.versionedobjects/blob/master/oslo_versionedobjects/fixture.py#L13714:35
mhickeyrlrossit: ok, so how is this hooked into a project?14:38
rlrossitmhickey: you need to explicitly import oslo.versionedobjects[fixtures] into your project (which requires some odd tox.ini stuff https://github.com/openstack/nova/blob/master/tox.ini#L21-L22)14:40
*** binarin has quit IRC14:40
rlrossitand then you use that fixture in a test (let me dig that up for nova)14:40
*** zz_dimtruck is now known as dimtruck14:41
*** binarin has joined #openstack-oslo14:41
mhickeyrlrossit: grt, thanks14:41
*** ChuckC has joined #openstack-oslo14:41
rlrossitmhickey: here's the test_versions() test that generates the hashes: https://github.com/openstack/nova/blob/master/nova/tests/unit/objects/test_objects.py#L1242-L125714:42
rlrossitand here's all the hashes: https://github.com/openstack/nova/blob/master/nova/tests/unit/objects/test_objects.py#L1109-L119614:43
*** yassine__ has quit IRC14:43
*** mriedem has joined #openstack-oslo14:43
mhickeyrlrossit: kewl, let me take a look .. i am using nova as a pattern but was unsure how the hashes worked. Will report back when I know more. thanks14:44
*** ChuckC has quit IRC14:45
*** ChuckC has joined #openstack-oslo14:46
*** lucasagomes is now known as lucas-hungry14:56
*** yassine__ has joined #openstack-oslo14:58
*** links has quit IRC14:58
*** links has joined #openstack-oslo14:59
*** dims has quit IRC15:00
*** binarin has quit IRC15:03
*** evgenyl has left #openstack-oslo15:11
*** e0ne has joined #openstack-oslo15:12
*** boris-42_ has joined #openstack-oslo15:12
*** sigmavirus24_awa is now known as sigmavirus2415:14
*** bnemec has quit IRC15:25
*** gcb has quit IRC15:26
*** ChuckC has quit IRC15:27
*** mkovacik has quit IRC15:28
*** pratikmallya has joined #openstack-oslo15:30
*** bnemec has joined #openstack-oslo15:32
*** mtanino has joined #openstack-oslo15:32
*** pratikma_ has joined #openstack-oslo15:34
*** pratikmallya has quit IRC15:36
*** fultonj has left #openstack-oslo15:38
*** pradk has joined #openstack-oslo15:39
*** lucas-hungry is now known as lucasagomes15:40
openstackgerritZhiQiang Fan proposed openstack/oslo.utils: fix fnmatch.filter in non-posix system  https://review.openstack.org/25716115:45
*** nkrinner has quit IRC15:53
*** rcernin has quit IRC15:58
*** amotoki has quit IRC16:01
*** vilobhmm11 has joined #openstack-oslo16:03
openstackgerritZhiQiang Fan proposed openstack/oslo.utils: fix fnmatch.filter in non-posix system  https://review.openstack.org/25716116:04
*** devananda has quit IRC16:05
*** devananda has joined #openstack-oslo16:08
*** binarin has joined #openstack-oslo16:17
*** binarin has quit IRC16:21
*** yamamoto has quit IRC16:25
*** yamamoto has joined #openstack-oslo16:26
*** yamahata has quit IRC16:27
*** browne has joined #openstack-oslo16:37
mhickeyrlrossit: Hi16:37
rlrossitmhickey: howdy!16:37
openstackgerritMerged openstack/oslo.utils: fix fileutils ut code random failure  https://review.openstack.org/25790316:38
mhickeyrlrossit: I have been playing around with the version objects. The get_hashes is returning an empty dict for me unfortunately16:39
*** yamamoto has quit IRC16:39
rlrossitmhickey: when you created the ObjectVersionChecker, did you set obj_classes to be your registry's obj_classes?16:40
rlrossit(and if you're willing to tell, what project is this for?)16:40
mhickeyrlrossit: sorry, neutron16:41
mhickeylike so: @base.NeutronObjectRegistry.register_if(False) ?16:43
rlrossitif you do register_if(False), it doesn't put the object in the registry, so anything you register that way won't be in the dict. If you just to the regular @base.NeutronObjectRegistry.register it will be a part of that dict16:44
rlrossitif you make the checker like so: checker = fixtures.ObjectVersionChecker(obj_classes=base.NeutronObjectRegistry.obj_classes())16:45
mhickeyrlrossit: ah shoot, thats it!16:46
mhickeyrlrossit: let me give that a go..16:46
*** stpierre has joined #openstack-oslo16:52
stpierrelxsli: from your initial comment, i thought it was a precision issue -- i.e., .00 didn't include microseconds, but .001 did because it included precision to the thousandths.16:53
*** yamahata has joined #openstack-oslo16:53
stpierrethis seems to me like a bug in .isoformat(), tbh16:53
stpierrewhich makes me sad16:54
lxslistpierre: hiya16:56
lxslistpierre: 0 = 0.000 so I don't think it can tell16:57
stpierreyeah16:57
stpierreyou're right, it doesn't care about precision, it just cares about a non-zero number of microseconds16:57
mhickeyrlrossit: thank you sir; that was the trick! :_)16:57
stpierrewhich is dumb16:57
lxslistpierre: suboptimal :|16:57
mhickeyrlrossit: :)16:57
mhickey rlrossit: much appreciated16:58
lxslistpierre: what do you think about having two vars?16:58
rlrossitmhickey: sweet! no prob. always happy to evangelize o.vo more :)16:58
mhickey rlrossit: excellent16:59
stpierrelxsli: every option sucks in numerous and different ways, but that one seems to have the Least Mean Suckage17:00
lxslistpierre: either that or only provide a "with fracsec" var - they're vital tbh17:01
stpierreyeah, i hate to discard that data17:01
*** david-lyle has quit IRC17:02
stpierrewe've been carrying a local version of this for quite a while, and it looks like we use isoformat() without worrying about the microseconds17:03
stpierrethat's not perfect, obviously, but it's at least one data point from real-world operational clouds17:03
lxsliwe've been using asctime.msecs and not caring about TZs17:06
*** david-lyle has joined #openstack-oslo17:12
*** yassine__ has quit IRC17:14
*** e0ne has quit IRC17:19
*** pballand has joined #openstack-oslo17:35
*** sigmavirus24 is now known as sigmavirus24_awa17:38
openstackgerritBogdan Dobrelya proposed openstack/oslo-specs: Add a spec for a work queue messaging pattern  https://review.openstack.org/25634217:48
*** links has quit IRC17:50
*** yassine__ has joined #openstack-oslo17:50
*** browne has quit IRC17:51
*** vilobhmm11 has quit IRC17:52
*** mhickey has quit IRC18:00
*** e0ne has joined #openstack-oslo18:04
*** pballand has quit IRC18:07
*** sputnik13 has joined #openstack-oslo18:09
*** vilobhmm11 has joined #openstack-oslo18:20
*** salv-orlando has joined #openstack-oslo18:31
*** sigmavirus24_awa is now known as sigmavirus2418:31
*** ihrachys has quit IRC18:35
*** ericksonsantos has quit IRC18:36
*** pballand has joined #openstack-oslo18:36
*** pballand has quit IRC18:36
*** rlrossit has quit IRC18:38
*** browne has joined #openstack-oslo18:39
*** browne has quit IRC18:43
*** browne has joined #openstack-oslo18:43
*** rlrossit has joined #openstack-oslo18:44
*** dims has joined #openstack-oslo18:45
*** harlowja_ has quit IRC18:49
*** harlowja has joined #openstack-oslo18:50
*** browne has quit IRC18:50
*** yassine__ has quit IRC18:51
*** yassine__ has joined #openstack-oslo18:53
*** yassine__ has quit IRC18:53
*** yassine__ has joined #openstack-oslo18:53
rlrossitdansmith: one of the unit tests in o.vo is being very nondeterministic for me :(. Stupid fingerprints... (on master too)19:03
dansmithrlrossit: really?19:04
rlrossitit's this guy: https://github.com/openstack/oslo.versionedobjects/blob/master/oslo_versionedobjects/tests/test_fixture.py#L7519:04
rlrossitabout 2/3 times it's successful19:05
dansmithyou mean that one that you wrote? :)19:05
*** pblaho_ has joined #openstack-oslo19:05
dansmithyou need to sort things like obj_classes.keys() to get deterministic behavior, right?19:05
rlrossityeah one that I wrote..........19:06
dansmithassuming a non-static hash seed19:06
rlrossitwait nope it's this guy https://github.com/openstack/oslo.versionedobjects/blob/master/oslo_versionedobjects/tests/test_fixture.py#L37819:06
rlrossitI'm doing sorted on all those guys...19:07
dansmithrlrossit: not here: https://github.com/openstack/oslo.versionedobjects/blob/master/oslo_versionedobjects/tests/test_fixture.py#L8519:07
*** pblaho has quit IRC19:08
rlrossitdansmith: that test is a-ok. It's the other "with_extra_data" on that's failing19:08
rlrossits/on/one19:09
rlrossitthe only thing I'm not calling sorted on is the class https://github.com/openstack/oslo.versionedobjects/blob/master/oslo_versionedobjects/tests/test_fixture.py#L392-L39519:09
dansmithokay, but the upper one is probably needing a sort too19:10
dansmithyeah, I dunno, I'd have to just start dumping things out19:11
rlrossitdansmith: even the fingerprints being generated by the regular code is changing between these failures...19:11
dansmithwell something must have changed, right? I mean, I've not seen any spurious fingerprint problems since like ever19:11
*** pblaho_ has quit IRC19:13
dansmithI just ran it like 20 times and got a few fails, but always in that _with_extra_data() test19:13
rlrossitdansmith: was the "expected" fp changing between those tests too?19:14
*** pblaho has joined #openstack-oslo19:14
dansmithrlrossit: nope19:15
rlrossithmmmm.... I wonder why mine is moving around then19:15
dansmithwell, if it is, it probably just means you made the same mistake in the test and the real code right?19:16
rlrossitdansmith: well, I'm wondering if something is wrong with that extra_data function I made up in that test19:16
rlrossitI'll have it return (1,) and see what happens19:17
rlrossitthe integer 1 is pretty nondeterministic19:17
dansmithum, where is that?19:17
*** pratikma_ has quit IRC19:18
dansmithI see get_data() as returning a tuple with obj_class in it19:18
rlrossitdansmith: yeah I'm changing that to return (1,)19:19
dansmithso is it deterministic if you run it by itself?19:19
dansmithsince you're fetching MyObject out of the registry,19:19
dansmithand you're modifying it there and in other tests,19:19
dansmithit might be getting out a different MyObject class each time19:19
*** browne has joined #openstack-oslo19:20
dansmithI mean, I guess you're mocking getargspec, but maybe there's something else?19:20
dansmithmaybe safer to define a class you just use for this test?19:20
rlrossityeah I'll give that a shot19:20
*** shardy is now known as shardy_afk19:23
*** cprmrf has joined #openstack-oslo19:23
*** pratikmallya has joined #openstack-oslo19:26
rlrossitdansmith: is running 20 times successfully enough to say "it's fixed"?19:27
dansmithrlrossit: no, but 42 is19:28
dansmithrlrossit: use testr --until-failure19:28
rlrossitis... is that a thing?19:28
dansmithit is19:28
dansmiththere is also something like --analyze-isolation19:28
*** ndipanov has quit IRC19:28
dansmithwhich tries to run it in varying patterns of overlapping parallelism19:29
rlrossittestr --magically-tell-me-whats-going-wrong19:29
rlrossittestr --please-help19:29
dansmithheh19:29
rlrossittestr --my-wife-is-going-to-leave-me19:29
*** browne has quit IRC19:29
*** browne has joined #openstack-oslo19:30
rbradforrlrossit, It may be time to put down your Python and communicate with your wife19:31
rlrossitrbradfor: jokes on you, I'm only married to oslo.versionedobjects19:32
*** browne has quit IRC19:32
*** openstackgerrit has quit IRC19:32
*** browne has joined #openstack-oslo19:32
*** openstackgerrit has joined #openstack-oslo19:32
rbradforrlrossit, well played.  Speaking of unique options, mysql has the option -i-am-a-dummy19:33
*** browne has quit IRC19:33
*** browne has joined #openstack-oslo19:33
*** e0ne has quit IRC19:34
*** e0ne_ has joined #openstack-oslo19:35
*** browne has quit IRC19:35
*** browne has joined #openstack-oslo19:36
*** salv-orlando has quit IRC19:37
openstackgerritRyan Rossiter proposed openstack/oslo.versionedobjects: Fixed nondeterministicness of extra_data test  https://review.openstack.org/25812319:38
rlrossitdansmith: ^ hopefully that gets it19:38
dansmithrlrossit: -1: Use a bigger word19:38
rlrossit"Fixed supercalifragilisticexpialidocious ..."19:39
dansmithweak.19:41
*** e0ne_ has quit IRC19:42
harlowjabogdando yt19:49
*** ndipanov has joined #openstack-oslo19:55
*** yassine__ has quit IRC19:56
*** dimtruck is now known as zz_dimtruck20:04
*** pratikma_ has joined #openstack-oslo20:07
*** zz_dimtruck is now known as dimtruck20:07
*** pratikmallya has quit IRC20:09
*** e0ne has joined #openstack-oslo20:13
*** e0ne_ has joined #openstack-oslo20:15
*** e0ne has quit IRC20:16
*** lucasagomes is now known as lucas-dinner20:17
openstackgerritRyan Rossiter proposed openstack/oslo.versionedobjects: Added checking compat using manifest backports  https://review.openstack.org/25813820:30
*** rlrossit has quit IRC20:39
*** e0ne_ has quit IRC20:59
*** jecarey has quit IRC21:14
*** jecarey has joined #openstack-oslo21:15
*** sigmavirus24 is now known as sigmavirus24_awa21:17
*** sigmavirus24_awa is now known as sigmavirus2421:17
*** jecarey has quit IRC21:19
*** kgiusti has left #openstack-oslo21:28
*** mkovacik has joined #openstack-oslo21:29
*** e0ne has joined #openstack-oslo21:30
mkovacikharlowja, hello, w/r the inspector HA, would you have a minute?21:33
*** pradk has quit IRC21:33
harlowjamkovacik actually got sorta tied up in a tooz chat21:33
harlowjaand haven't had food, and food closes in about 20 minutes :(21:34
mkovacikharlowja, OK cool, possibly tomorrow, a hour sooner?21:34
harlowjasureee21:34
mkovacikcool, thanks21:35
*** david-lyle has quit IRC21:58
*** david-lyle has joined #openstack-oslo22:00
*** regXboi has quit IRC22:02
*** cdent has quit IRC22:05
*** ndipanov has quit IRC22:08
*** ndipanov has joined #openstack-oslo22:11
*** ndipanov has quit IRC22:16
*** rcernin has joined #openstack-oslo22:16
*** mkovacik has quit IRC22:18
*** shardy_afk has quit IRC22:23
*** ndipanov has joined #openstack-oslo22:28
*** salv-orlando has joined #openstack-oslo22:29
*** stpierre has quit IRC22:32
*** e0ne has quit IRC22:32
*** dimtruck is now known as zz_dimtruck22:41
*** ericksonsantos has joined #openstack-oslo22:42
*** mriedem is now known as mriedem_away22:44
openstackgerritJoshua Harlow proposed openstack/tooz: Add nice and peaceful message around `get_lock` of some drivers  https://review.openstack.org/25817622:45
harlowjajd__ lifeless  mordred SpamapS ^22:45
SpamapSharlowja: Redis gets a pass?22:47
SpamapSI mean, it is C_P if you run single-server ... so I guess that counts for something.22:48
harlowjaSpamapS i put depreciated message on it :-P22:50
SpamapSharlowja: oh I hit ] twice on accident22:51
SpamapSharlowja: so missed it as the last one. :)22:51
harlowja:-P22:51
SpamapSso lets think this through22:51
harlowjasure22:51
SpamapSRedis, unlike memcached and mysql, can at least be atomically consistent22:51
harlowjai like the thinking22:51
harlowjayup22:51
SpamapSit just falls apart when you cluster it22:52
harlowjaif u deploy it right22:52
harlowjaannd u have to tell it to use its log appending mode22:52
*** cprmrf has quit IRC22:52
harlowjaAOF mode or whatever22:52
harlowjanot the RDB mode22:52
harlowja* http://redis.io/topics/persistence22:52
SpamapSright instead of the one that just throws things away on fail?22:52
harlowjathrows some things away, ha22:52
harlowja*depending on when last RDB snapshot was taken22:53
SpamapSsome == worse than all22:53
harlowjafair enough22:53
harlowja*point taken, ha22:53
SpamapSit's a fantastic scaling paradigm for a cache22:53
SpamapSdon't get me wrong. :)22:53
harlowjawell its something22:53
harlowjalol22:53
SpamapSok so that is, to me, Consistent, and Partition Tolerant.22:53
harlowjaright22:54
SpamapSwhich I think is the requirement for DLM's22:54
harlowjacomplete sacrifice of availability imho22:54
harlowja*but meh, maybe thats fine for some22:54
SpamapSbut.. the moment you replicate ... bad things can happen.22:54
harlowjaright, thats where the clustering or replication redis additions get involved22:54
SpamapSreleased locks can be re-acquired22:54
SpamapSacquired locks can be released22:54
SpamapSI wonder if there's some way we can interrogate a redis and ask if it is standalone...22:55
harlowjaright, the potential for that exists22:55
harlowjaSpamapS hmmm22:55
harlowjaso there's 2 modes here22:55
*** dstanek has quit IRC22:56
harlowjathe clustering redis stuff22:56
harlowjaand the master/slave sentinel stuff22:56
harlowjaclustering redis stuff being like 3 months old22:56
SpamapSboth failed jepsen IIRC22:56
*** dstanek has joined #openstack-oslo22:56
harlowjaright22:56
harlowja*unsure if the clustering stuff is evolving22:56
SpamapSoh no ok that one I don't think he tested yet.22:56
harlowjaya, i forget, master/slave likely fails, well because afaik there is no replication stream/commit stream or whatever22:57
harlowjaits not especially advanced master/slave afaik22:57
SpamapShttps://news.ycombinator.com/item?id=8432709 heh22:57
SpamapSApparently it's already known to not be linearizable.22:57
harlowjaright, there was a bunch of chatter on that22:58
harlowjai'm unsure if its getting better or not22:59
harlowjajd__ yt22:59
harlowja;)23:00
harlowjaperhaps doesn't want to be here, hahaah23:00
jd__I don't know how it fails and in which category it goes TBH23:00
harlowjaright, its unclear to me also23:01
jd__but it should be pretty easy to figure out?23:01
harlowjaespecially because its evolving (likely as we speak)23:01
*** david-lyle has quit IRC23:01
jd__worse thing we mark it "unsafe" unless proven otherwise23:01
*** david-lyle has joined #openstack-oslo23:01
jd__and someone smarter will come by and say "you're wrong" but we never hurt anyone anyway23:01
jd__we'll nod, fix, and move one23:02
jd__and light a cigar or something23:02
*** jecarey has joined #openstack-oslo23:02
harlowjai thought it was cigaretees only in france23:02
harlowjawe we23:02
harlowjawith those little cigaratee holders23:02
harlowjai'd be ok with note say 'unsafe, known to work in AOF mode, in single-server mode, clustering mode TBD'23:03
jd__cool, let's do that then23:05
harlowjaSpamapS happy?23:05
jd__now I'm gonna sleep and I don't want to see any new dumb ideas by tomorrow23:05
jd__so be nice gentlemen ;)23:05
*** ndipanov_ has joined #openstack-oslo23:05
harlowjalol23:05
jd__and happy hacking!23:05
harlowjaha23:05
harlowjaoh man, i have to wait till tommorow for another dumb idea23:06
harlowjadamn23:06
harlowjai'm not sure i can hold it in23:06
harlowjalol23:06
*** dstanek has quit IRC23:06
*** jecarey has quit IRC23:06
*** dstanek has joined #openstack-oslo23:07
SpamapSso one thing to do is to make get_coordinator require that you specify what caps you need from your driver.23:07
harlowjai need the caps patch to merge first, ha23:08
harlowjahttps://review.openstack.org/#/c/240681/ :-P23:08
harlowja*which is the 1st of a few steps for tha23:08
harlowja*for that23:08
harlowjaas for people knowing what the capabilities mean, please check out that patch, trying to make them as understandable as possible23:10
SpamapSI'm also sorry if I haven't been as active in this space. We got some deadlines moved up a bit and so I'm having to focus on areas that are way way way less scalable than the current non-tooz lock things unfortunately. :-P23:10
harlowjalol23:11
harlowjai can guess what those are23:11
openstackgerritJoshua Harlow proposed openstack/tooz: Add noted driver weaknesses onto the drivers docs  https://review.openstack.org/25818623:12
openstackgerritJoshua Harlow proposed openstack/tooz: Add noted driver weaknesses onto the drivers docs  https://review.openstack.org/25818623:13
openstackgerritJoshua Harlow proposed openstack/tooz: Add noted driver weaknesses onto the drivers docs  https://review.openstack.org/25818623:14
*** sigmavirus24 is now known as sigmavirus24_awa23:15
openstackgerritJoshua Harlow proposed openstack/tooz: Add noted driver weaknesses onto the drivers docs  https://review.openstack.org/25818623:16
*** ndipanov_ has quit IRC23:19
*** ndipanov_ has joined #openstack-oslo23:20
*** rcernin has quit IRC23:20
*** e0ne has joined #openstack-oslo23:21
*** salv-orlando has quit IRC23:23
*** gordc has quit IRC23:23
*** ndipanov_ has quit IRC23:23
*** david-lyle_ has joined #openstack-oslo23:33
*** david-lyle has quit IRC23:36
*** ndipanov has quit IRC23:37
openstackgerritJoshua Harlow proposed openstack/taskflow: Trap and expose exception any 'args'  https://review.openstack.org/23727923:43

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!