Thursday, 2015-12-17

*** jeckersb_gone is now known as jeckersb00:02
*** harlowja has joined #openstack-oslo00:09
*** ozamiatin_ has quit IRC00:10
*** EinstCrazy has joined #openstack-oslo00:13
*** zz_dimtruck is now known as dimtruck00:15
*** EinstCrazy has quit IRC00:24
*** zqfan_AFK has joined #openstack-oslo00:26
*** dimtruck is now known as zz_dimtruck00:27
*** zz_dimtruck is now known as dimtruck00:29
*** dims has quit IRC00:29
*** zqfan_AFK is now known as zqfan00:30
*** pratikmallya has joined #openstack-oslo00:42
*** dimtruck is now known as zz_dimtruck00:43
*** rcernin has quit IRC00:50
*** EinstCrazy has joined #openstack-oslo00:53
openstackgerritJoshua Harlow proposed openstack/taskflow: Allow for alterations in decider 'area of influence'  https://review.openstack.org/24605101:00
openstackgerritSachi King proposed openstack-dev/pbr: Handle markers to support sdist on pip < 6  https://review.openstack.org/25328901:01
*** dguitarbite has joined #openstack-oslo01:02
openstackgerritJoshua Harlow proposed openstack/taskflow: Some additional logging  https://review.openstack.org/25874601:16
openstackgerritJoshua Harlow proposed openstack/taskflow: Some additional engine logging  https://review.openstack.org/25874601:23
openstackgerritJoshua Harlow proposed openstack/taskflow: Some additional engine logging  https://review.openstack.org/25874601:25
*** zhiyan has quit IRC01:25
openstackgerritBoris Pavlovic proposed openstack/oslo-specs: OSprofiler cross service & project profiling  https://review.openstack.org/10382501:27
*** zhiyan has joined #openstack-oslo01:28
openstackgerritJoshua Harlow proposed openstack/taskflow: Allow for alterations in decider 'area of influence'  https://review.openstack.org/24605101:31
openstackgerritJoshua Harlow proposed openstack/taskflow: Some additional engine logging  https://review.openstack.org/25874601:32
*** ozamiatin_ has joined #openstack-oslo01:42
openstackgerritJoshua Harlow proposed openstack/taskflow: Start rename of BLATHER -> TRACE  https://review.openstack.org/25875201:48
*** mriedem has joined #openstack-oslo01:48
*** mtanino has joined #openstack-oslo01:59
*** amotoki has joined #openstack-oslo02:03
*** amotoki_ has joined #openstack-oslo02:05
*** amotoki has quit IRC02:09
*** browne has quit IRC02:12
*** yamamoto has joined #openstack-oslo02:14
*** yamahata has quit IRC02:19
openstackgerritVilobh Meshram proposed openstack/tooz: Add Consul Driver  https://review.openstack.org/24536202:23
*** sputnik13 has quit IRC02:32
*** yamamoto has quit IRC02:33
*** droyal has quit IRC02:37
*** dguitarbite has quit IRC02:40
*** dguitarbite has joined #openstack-oslo02:41
*** gcb has joined #openstack-oslo02:44
*** droyal has joined #openstack-oslo02:48
*** vilobhmm11 has quit IRC02:55
*** droyal has quit IRC02:56
*** amotoki_ has quit IRC02:57
*** harlowja has quit IRC02:58
*** ozamiatin_ has quit IRC03:02
openstackgerritMerged openstack/oslo.middleware: Updated from global requirements  https://review.openstack.org/25810203:07
openstackgerritMerged openstack/oslo.policy: Pass environment variables of proxy to tox  https://review.openstack.org/25712603:12
*** browne has joined #openstack-oslo03:13
*** mriedem has quit IRC03:13
*** yamamoto has joined #openstack-oslo03:15
*** jecarey has quit IRC03:15
*** jamielennox is now known as jamielennox|away03:26
*** links has joined #openstack-oslo03:28
*** droyal has joined #openstack-oslo03:29
*** jamielennox|away is now known as jamielennox03:31
*** droyal has quit IRC03:38
*** amotoki has joined #openstack-oslo03:47
*** amotoki has quit IRC03:50
*** amotoki has joined #openstack-oslo03:56
*** amotoki_ has joined #openstack-oslo04:02
*** amotoki has quit IRC04:05
*** droyal has joined #openstack-oslo04:05
*** dguitarbite has quit IRC04:08
*** vilobhmm11 has joined #openstack-oslo04:12
*** jecarey has joined #openstack-oslo04:15
*** pratikmallya has quit IRC04:16
*** jeckersb is now known as jeckersb_gone04:16
*** jecarey has quit IRC04:20
*** mriedem has joined #openstack-oslo04:32
*** jecarey has joined #openstack-oslo04:36
*** Nakato has quit IRC04:51
*** Nakato has joined #openstack-oslo04:51
*** gcb has quit IRC04:52
*** boris-42_ has quit IRC04:53
*** gus has quit IRC05:04
*** mtreinish has quit IRC05:08
*** jecarey has quit IRC05:09
*** mtreinish has joined #openstack-oslo05:17
*** mtanino has quit IRC05:30
*** gus has joined #openstack-oslo05:49
*** vilobhmm11 has quit IRC05:50
*** vilobhmm11 has joined #openstack-oslo05:51
*** vilobhmm11 has quit IRC05:55
openstackgerritAkira YOSHIYAMA proposed openstack/oslo.policy: Add string format rendering to RoleCheck.__call__()  https://review.openstack.org/25880805:56
*** vilobhmm11 has joined #openstack-oslo05:58
*** harlowja_at_home has joined #openstack-oslo06:01
*** harlowja_still_a has joined #openstack-oslo06:05
*** harlowja_at_home has quit IRC06:08
*** davidlenwell has quit IRC06:12
*** davidlenwell has joined #openstack-oslo06:14
*** pratikmallya has joined #openstack-oslo06:32
openstackgerritJoshua Harlow proposed openstack/taskflow: Some additional engine logging  https://review.openstack.org/25874606:33
*** vilobhmm11 has quit IRC07:10
openstackgerritjaveme proposed openstack/oslo.vmware: isoformat instead of deprecated timeutils.strtime  https://review.openstack.org/25884207:14
*** tobe has joined #openstack-oslo07:27
*** deray has joined #openstack-oslo07:44
*** harlowja_still_a has quit IRC08:03
*** browne has quit IRC08:15
*** shardy has joined #openstack-oslo08:22
*** e0ne has joined #openstack-oslo08:23
*** rcernin has joined #openstack-oslo08:26
*** markus_z has joined #openstack-oslo08:27
openstackgerritAnn Kamyshnikova proposed openstack/oslo.db: Fix comparison of Variant and other type in compare_type  https://review.openstack.org/25847808:35
*** pratikmallya has quit IRC08:38
*** e0ne has quit IRC08:38
*** e0ne has joined #openstack-oslo08:40
*** rcernin has quit IRC08:40
*** rcernin has joined #openstack-oslo08:41
*** mkovacik has joined #openstack-oslo08:52
*** e0ne has quit IRC08:53
openstackgerritjaveme proposed openstack/oslo.vmware: isoformat instead of deprecated timeutils.strtime  https://review.openstack.org/25884208:59
openstackgerritKseniya Tychkova proposed openstack/oslo.policy: Support RBAC with LDAP in oslo.policy  https://review.openstack.org/24405909:03
*** amotoki_ has quit IRC09:06
*** ozamiatin_ has joined #openstack-oslo09:09
*** ndipanov has joined #openstack-oslo09:09
*** yassine__ has joined #openstack-oslo09:13
*** zigo has quit IRC09:25
*** zigo_ has joined #openstack-oslo09:26
*** ozamiatin_ has quit IRC09:27
*** salv-orlando has joined #openstack-oslo09:28
*** mkovacik has quit IRC09:30
*** amotoki has joined #openstack-oslo09:33
*** tobe has quit IRC09:38
*** pratikmallya has joined #openstack-oslo09:39
*** tobe has joined #openstack-oslo09:40
*** tobe has quit IRC09:41
*** tobe has joined #openstack-oslo09:41
*** pratikmallya has quit IRC09:43
*** amotoki has quit IRC09:44
*** tobe has quit IRC09:46
*** openstackgerrit has quit IRC09:47
*** openstackgerrit has joined #openstack-oslo09:47
*** cdent has joined #openstack-oslo09:51
*** e0ne has joined #openstack-oslo09:55
*** mhickey has joined #openstack-oslo09:55
*** binarin has quit IRC10:03
*** ihrachys has joined #openstack-oslo10:03
*** e0ne has quit IRC10:05
*** binarin has joined #openstack-oslo10:07
*** shakamunyi has quit IRC10:20
*** shakamunyi has joined #openstack-oslo10:21
*** superflyy has quit IRC10:21
*** barra204 has joined #openstack-oslo10:21
*** ihrachys has quit IRC10:21
*** ihrachys has joined #openstack-oslo10:22
*** ihrachys has quit IRC10:23
*** ihrachys has joined #openstack-oslo10:24
*** cdent has quit IRC10:27
*** cdent has joined #openstack-oslo10:29
*** cdent has quit IRC10:39
*** cdent has joined #openstack-oslo10:41
*** e0ne has joined #openstack-oslo10:43
*** EinstCrazy has quit IRC10:48
*** yamahata has joined #openstack-oslo10:48
*** dims has joined #openstack-oslo11:07
*** lucas-dinner is now known as lucasagomes11:07
*** salv-orlando has quit IRC11:08
*** mkovacik has joined #openstack-oslo11:09
*** salv-orlando has joined #openstack-oslo11:11
*** EinstCrazy has joined #openstack-oslo11:11
*** salv-orlando has quit IRC11:12
*** salv-orlando has joined #openstack-oslo11:12
*** deray has quit IRC11:13
*** salv-orl_ has joined #openstack-oslo11:15
*** yamahata has quit IRC11:18
*** salv-orlando has quit IRC11:18
*** BG_Patrick has joined #openstack-oslo11:21
*** BG_Patrick has left #openstack-oslo11:21
*** _amrith_ is now known as amrith11:23
*** yamamoto has quit IRC11:42
*** rcernin has quit IRC12:00
*** rcernin has joined #openstack-oslo12:15
*** yamamoto has joined #openstack-oslo12:23
*** jaypipes has joined #openstack-oslo12:26
*** pratikmallya has joined #openstack-oslo12:41
*** amotoki has joined #openstack-oslo12:43
*** amotoki has quit IRC12:46
*** pratikmallya has quit IRC12:46
*** jecarey has joined #openstack-oslo12:55
*** links has quit IRC12:58
*** jecarey has quit IRC13:00
*** salv-orl_ has quit IRC13:04
*** yamamoto has quit IRC13:08
*** salv-orlando has joined #openstack-oslo13:09
*** fultonj has joined #openstack-oslo13:16
*** gordc has joined #openstack-oslo13:19
*** yamamoto has joined #openstack-oslo13:20
openstackgerritKseniya Tychkova proposed openstack/oslo.policy: Support RBAC with LDAP in oslo.policy  https://review.openstack.org/24405913:21
*** rcernin has quit IRC13:21
*** kgiusti has joined #openstack-oslo13:22
openstackgerritVladislav Kuzmin proposed openstack/oslo.log: Add ability to specify the log_config_append option in yaml format  https://review.openstack.org/25900013:23
*** pradk has joined #openstack-oslo13:31
*** links has joined #openstack-oslo13:33
*** amrith is now known as _amrith_13:37
*** sigmavirus24_awa is now known as sigmavirus2413:39
*** yamamoto has quit IRC13:46
*** yamamoto has joined #openstack-oslo13:50
*** fultonj has left #openstack-oslo13:53
*** rlrossit has joined #openstack-oslo14:12
*** jeckersb_gone is now known as jeckersb14:13
*** lucasagomes is now known as lucas-hungry14:17
*** cprmrf has joined #openstack-oslo14:22
*** cprmrf__ has joined #openstack-oslo14:26
*** cprmrf has quit IRC14:29
*** pradk has quit IRC14:41
*** pradk has joined #openstack-oslo14:41
*** ChuckC has joined #openstack-oslo14:42
*** yamamoto has quit IRC14:46
*** yamamoto has joined #openstack-oslo14:46
*** bogdando has quit IRC14:55
*** rohit_ has joined #openstack-oslo15:04
*** _amrith_ is now known as amrith15:10
*** jeckersb is now known as jeckersb_gone15:10
*** pratikmallya has joined #openstack-oslo15:12
*** lucas-hungry is now known as lucasagomes15:13
*** jeckersb_gone is now known as jeckersb15:16
*** bogdando has joined #openstack-oslo15:20
*** mtanino has joined #openstack-oslo15:36
openstackgerritChris St. Pierre proposed openstack/oslo.log: Add ISO8601/RFC3339 timestamp to ContextFormatter  https://review.openstack.org/25658415:36
*** mhorban has joined #openstack-oslo15:45
*** mhickey has quit IRC15:47
*** links has quit IRC15:50
*** mriedem has quit IRC15:50
*** pratikmallya has quit IRC15:50
openstackgerritOleksii Zamiatin proposed openstack/oslo.messaging: (WIP) [zmq] Heartbeat implementation  https://review.openstack.org/25734615:50
*** david-lyle_ has joined #openstack-oslo15:55
*** david-lyle_ has quit IRC15:57
*** david-lyle has quit IRC15:59
*** ChuckC has quit IRC15:59
*** mhickey has joined #openstack-oslo16:00
*** david-lyle has joined #openstack-oslo16:05
*** yassine__ has quit IRC16:06
*** yassine__ has joined #openstack-oslo16:07
openstackgerritBoris Pavlovic proposed openstack/oslo-specs: OSprofiler cross service & project profiling  https://review.openstack.org/10382516:09
*** mhickey has quit IRC16:10
*** jecarey has joined #openstack-oslo16:10
*** yamahata has joined #openstack-oslo16:10
*** boris-42_ has joined #openstack-oslo16:12
*** ihrachys has quit IRC16:12
*** markus_z has quit IRC16:22
*** yamamoto has quit IRC16:26
*** pratikmallya has joined #openstack-oslo16:26
*** pratikma_ has joined #openstack-oslo16:27
*** pratikmallya has quit IRC16:30
*** browne has joined #openstack-oslo16:38
-openstackstatus- NOTICE: Zuul is moving in very slow motion since roughly 13:30 UTC; the Infra team is investigating.16:43
*** mkovacik has quit IRC16:47
*** yassine__ has quit IRC16:53
*** ihrachys has joined #openstack-oslo16:59
*** pkholkin has quit IRC17:09
openstackgerritJoshua Harlow proposed openstack/tooz: Add programatic introspection of drivers characteristic(s)  https://review.openstack.org/24068117:11
*** salv-orl_ has joined #openstack-oslo17:15
*** salv-orlando has quit IRC17:18
*** yamahata has quit IRC17:22
*** rlrossit has quit IRC17:32
*** cprmrf__ has quit IRC17:41
*** shardy has quit IRC17:43
*** yamahata has joined #openstack-oslo17:48
*** e0ne has quit IRC17:53
openstackgerritMerged openstack/oslo.config: Remove warning for option type not a ConfigType  https://review.openstack.org/25659418:02
openstackgerritMerged openstack/oslo.messaging: Removes MANIFEST.in as it is not needed explicitely by PBR  https://review.openstack.org/25573118:02
openstackgerritMerged openstack/oslo.utils: Fix DeprecationWarning when call method delta_seconds  https://review.openstack.org/25826518:02
openstackgerritMerged openstack/oslo.utils: Add missing doc index for imageutils and fnmatch  https://review.openstack.org/25720318:02
*** ndipanov has quit IRC18:03
openstackgerritMerged openstack/tooz: Add noted driver weaknesses onto the drivers docs  https://review.openstack.org/25818618:03
*** pkholkin has joined #openstack-oslo18:04
openstackgerritBoris Pavlovic proposed openstack/oslo-specs: OSprofiler cross service & project profiling  https://review.openstack.org/10382518:04
*** sputnik13 has joined #openstack-oslo18:05
*** browne has quit IRC18:09
*** cdent has quit IRC18:10
*** pkholkin has quit IRC18:11
*** ihrachys has quit IRC18:12
*** ihrachys has joined #openstack-oslo18:13
*** vilobhmm11 has joined #openstack-oslo18:13
*** harlowja has joined #openstack-oslo18:27
*** devananda has quit IRC18:36
*** mkovacik has joined #openstack-oslo18:37
*** e0ne has joined #openstack-oslo18:46
*** cdent has joined #openstack-oslo18:48
harlowjalifeless if u get some time someday can u give your super-awesome inputs on https://review.openstack.org/#/c/240681/ :)18:52
harlowjai'd appreciate that ;)18:52
*** devananda has joined #openstack-oslo18:53
*** browne has joined #openstack-oslo18:55
lifelessharlowja: I have to do dims extras thing first :/ this week, man. a write off18:58
harlowja:)19:01
harlowjanp19:01
*** cprmrf has joined #openstack-oslo19:07
openstackgerritVilobh Meshram proposed openstack/tooz: Add Consul Driver  https://review.openstack.org/24536219:07
openstackgerritJoshua Harlow proposed openstack/tooz: Make all locks operate the same when fetched from different coordinators  https://review.openstack.org/25211519:07
*** ihrachys has quit IRC19:09
dimslifeless : yay thanks!19:24
*** gordc has quit IRC19:26
openstackgerritMerged openstack/oslo.vmware: Overwrite VMwareDriverException message  https://review.openstack.org/25826619:30
*** e0ne has quit IRC19:34
*** cdent has quit IRC19:40
*** ozamiatin_ has joined #openstack-oslo19:42
mkovacikharlowja, hi, can I bother you a bit ;)19:54
harlowjamkovacik sureee19:54
harlowjawhere do we begin!19:55
harlowjalol19:55
mkovacikgreat :)19:55
mkovacikuff, not quite sure19:55
harlowja:)19:55
*** jeckersb is now known as jeckersb_gone19:55
mkovacikharlowja, how would you suggest to best incorporate the state transitions I need with task flow?19:55
mkovacikI mean with the loops and external events ant timeouts/retries...19:56
harlowjaso the loops stuff i think can be handled if we dare19:56
harlowjathe timeouts and retries and stuff i still sorta don't understand why they are external :-P19:57
*** lucasagomes is now known as lucas-dinner19:57
harlowjamaybe let me throw an idea out :-P19:57
mkovacikok19:57
harlowjacorrect me if i'm wrong here19:57
harlowjabut introspection is basically a workflow of a bunch of steps right19:57
mkovaciktrue19:57
*** jecarey_ has joined #openstack-oslo19:58
harlowjaand the desire is to make some part of that workflow async and some part of it not19:59
harlowjabut for now let's consider it as a sync workflow, that basically gets processed by a worker somewhere20:00
harlowjathat worker goes through steps Starting -> Waiting -> Processing -> Finishing -> Finished right?20:00
harlowjafrom a simplistic view thats the steps its doing for each workflow20:00
*** salv-orl_ has quit IRC20:01
*** jecarey_ has quit IRC20:01
*** jecarey_ has joined #openstack-oslo20:01
harlowja(thats the steps each worker would be doing)20:01
*** jecarey has quit IRC20:01
mkovacikharlowja, the Waiting state  requires the bare metal node to confirm by a Continue event20:01
harlowjaok20:02
mkovacikthen the rest of the steps can proceed20:02
harlowjaStarting -> Waiting_For_Confirm -> Processing -> Finishing -> Finished20:02
harlowjalike ^ right20:02
harlowja?20:02
mkovacikyeah20:02
harlowjaso let's consider the thing here ((Starting -> Waiting_For_Confirm -> Processing -> Finishing -> Finished), the node to do it on), lets give that a name20:04
harlowjafor usefulness, workflow+node seems good20:04
mkovacikright, or introspection job for a node_id20:05
harlowjasure20:05
*** cdent has joined #openstack-oslo20:06
harlowjaso the majority of complexity of the rest of that spec then becomes how to make that workflow 100% async in a way that works out20:06
mkovacikok20:07
harlowjawhen i start to wonder if perhaps u just treat 1 worker as owning that workflow (and progressing through it) would that be much simpler (and more likely to work out)20:08
harlowjanow if that 1 worker crashes, thats ok, another worker can pick it back up and start it up20:08
harlowja*this is pretty much what taskflow  specializes in20:08
harlowjathe HA Worker in that spec is basically the equivalent of http://docs.openstack.org/developer/taskflow/conductors.html20:09
harlowjaand the  introspection job for a node_id named above is basically http://docs.openstack.org/developer/taskflow/jobs.html20:10
harlowjathe difference is that taskflow's concept is 1 'conductor' (HA worker) owns/tracks the whole workflow until it completes20:11
mkovacikok20:11
mkovacikso if it is possible to route the continue request to that worker, it could be a flow20:11
mkovacik(or cancel request )20:12
harlowjaso we'd have to work on that, but yes, depending on how those requests arrive and from where20:12
harlowjabasically those are just job cancel and job continue generic concepts20:13
harlowjajust have to figure out how to plumb them in20:13
mkovacikideally that would be without handling the state outside of taskflow20:13
harlowjaright20:13
harlowjathis also imho has the benefit of cleanly seperating the job and execution/scheduliing transitions from the workflow transitions20:15
harlowjathat spec has merged them all together a little (for better or worse)20:15
harlowjain that the workflow transitions are really (Starting -> Waiting_For_Confirm -> Processing -> Finishing -> Finished)20:15
harlowjaand then it also has to merge the handling of sigint and all that (which are app level concerns)20:16
mkovacik... yeah, that would stem from the fact I wanted to maintain the state decentralised but execute 1 transition per worker...20:17
harlowjaright20:17
harlowjawhich i totally get, its very very decentralized20:17
harlowjafor better or worse :)20:17
mkovacikheh :)20:17
mkovacikwhere's the emphasise I wonder ;)20:18
harlowjabut i then start to wonder if it should go to 1 ha worker (conductor), 1 workflow and then scale out that way20:18
harlowja1 ha worker (conductor), N workflows (threads...)20:18
harlowjacomplete decomposition of all things vs decomposition at the 'introspection job for a node_id' level20:19
harlowjai personally think  decomposition at the 'introspection job for a node_id' level will be easier to thing about, but i get the other approach to20:19
harlowja*think about20:19
mkovacikideally, there would be some interleaving, because of the continue call takes ~10 minutes to arrive20:19
harlowjaright20:20
mkovacikquite a lot for a worker to get partitioned20:20
mkovacikor to do nothing but sleep20:20
harlowjawhich is why i think we can probably not to hard do that interleaving20:20
harlowjawith a simple addition to taskflow to say drop a job into 'waiting' state until well it gets signaled to be ready again20:21
harlowja*taskflow job concept20:21
harlowjai'm pretty sure others want a similar concept :-P20:21
mkovacikor canceled20:21
mkovacik100*100% sure20:21
harlowjaya,20:21
harlowjalol20:21
harlowja1million% sure20:21
harlowjaha20:21
harlowjasoooo that's some stuff to think about imho20:22
harlowjathe ultimate decision is the inspector folks (which includes u)20:22
harlowjai like the interleving at job level + a continue addition20:23
mkovaciksame here20:23
harlowjabut i get the desire to do full decomposition of all the things20:23
harlowja^ its an interesting thing to try (full on decompsition of all the things)20:23
harlowjaalthough i'm not sure i would want to debug it :-P20:23
harlowja^ such a thing probably needs a whole new way of debugging, ha20:24
harlowja*distributed debugger ftw, ha20:24
harlowjaanyways, there u go :)20:24
harlowjamy 3 cents, ha20:25
mkovaciki guess you don't have anything like that debugger hidden around ;)20:25
harlowjamkovacik if u jump in #openstack-state-management u can poke others that are using that job concept and all the rest of these to20:25
mkovacikthanks a lot, much appreciate all the input20:25
harlowjarackspace folks, some openstack projects are using this thing (and they would probably like that continue/wait thing, ha)20:25
harlowja*if u want to know how it has worked out for folks20:25
harlowja*not all of them are in this channel20:26
mkovacikI sure do20:26
*** jeckersb_gone is now known as jeckersb20:26
harlowjacools20:26
*** e0ne has joined #openstack-oslo20:27
harlowjahopefully all of this made some sense btw :-P20:27
harlowjaha20:27
mkovacikharlowja, thanks a lot, really great to have someone to read through the spec and talk about it20:27
mkovacikyeah20:27
mkovacikit did :D20:27
mkovacikI had one more concern, but forgotten about it :D20:27
harlowja:)20:28
harlowjawell when u remember, let me know, ha20:28
mkovacikI'll try to remember, thanks again20:28
harlowjanp20:28
mkovacikah, got it now, exclusivity of the bare metal node; up-to-single worker can perform the introspection, I guess holding locks for 10 mins isn't cool20:31
mkovacikharlowja, ^20:32
harlowjaso this is basically needing a lock around (Starting -> Waiting_For_Confirm -> Processing -> Finishing -> Finished)20:32
harlowja?20:32
mkovacikyes20:33
mkovacikit does20:33
*** fhermeni has joined #openstack-oslo20:33
harlowjaso is that good or bad?20:33
*** regXboi has joined #openstack-oslo20:33
fhermenihi there20:33
harlowjamkovacik i guess if one is needed, then hold it :-P20:33
harlowjaif thats 10 minutes, then i guess so bet it :-/20:33
harlowja*so be it20:33
harlowjafhermeni yo20:33
harlowjamkovacik the lock could be released after  Starting and reacquired at Processing20:34
mkovacikharlowja, the locks just have to be there no matter what :) yeah, no other way I guess.20:34
harlowjaif u gotta lock it, then i guess u gotta lock it, ha20:34
*** pratikma_ is now known as pratikmallya20:35
mkovacikwon't work, with releasing in the middle, race condition with other worker20:35
harlowjak20:35
mkovacikwell, locks are inevitable20:35
harlowjaso if a job is worked on by only one worker at a time20:35
harlowja1 ha worker/conductor20:35
harlowjathen well the job itself is the lock20:35
harlowja*owning the job is the lock20:35
harlowjawhich is pretty much what the api @ http://docs.openstack.org/developer/taskflow/jobs.html#taskflow.jobs.base.JobBoard.claim does20:36
mkovacikso the user can't request 2 parallel introspections for same node?20:36
*** regXboi has quit IRC20:37
harlowjadepends on how jobs are formed, each job has a name, the name becomes the primary thing u can only have 1 of20:37
harlowjaformed/posted20:37
harlowjahttp://docs.openstack.org/developer/taskflow/jobs.html#taskflow.jobs.base.JobBoard.post20:37
harlowjaso u could make that name the node name, and then it wouldn't be able to have 2 jobs at once20:38
harlowjaor u could make it something else and then allow 2+ parallel to happen20:38
harlowja^ which would then require other locking somewhere else20:38
harlowja*something else like a random uuid()20:40
mkovacikharlowja, that seems to be the key, naming it with the node_id, I definitely need some time to process this20:40
harlowjanp20:40
harlowjayour brain buffer is full :-P20:40
harlowjaha20:40
harlowjathat happens to me sometimes, ha20:40
mkovacikharlowja, thanks a lot for filling my brain buffer :D20:40
harlowjalol20:40
harlowjahahaha20:40
harlowjanp20:40
openstackgerritJoshua Harlow proposed openstack/tooz: Spice up the driver summary/info page  https://review.openstack.org/25863020:47
*** gordc has joined #openstack-oslo20:48
harlowjafhermeni vilobhmm11 if u haven't met (more super-scheduling coauthors)20:50
harlowjasuper super20:50
fhermenihi vilobhmm1120:50
fhermenivilobhmm11: I just replied to your point by a comment. When I browse nova issue tracker I see a lot of bugs that seem to be related to eventual consistency issues20:52
*** jecarey_ has quit IRC20:52
vilobhmm11fhermeni : hello! thanks harlowja for the introduction20:54
harlowja:)20:54
vilobhmm11fhermeni : cool if you have an etherpad with the link to all those bugs20:54
*** cprmrf__ has joined #openstack-oslo20:54
*** jecarey has joined #openstack-oslo20:54
vilobhmm11fhermeni : should be good to add as a reference in the spec IMHO and that should be helpful to jot down current scheduling issues20:55
fhermenivilobhmm11: of course I don’t have one. I browsed them a day because I want to study some kind of bugs but that stopped there20:56
*** cprmrf has quit IRC20:56
vilobhmm11fhermeni : will get back to you comment by eod20:56
fhermenivilobhmm11: from what I read, the current issues look more related to implementation bugs and a few unconsistencies (like manual operation that may or may no bypass a scheduler)20:57
fhermenivilobhmm11: so they seem not to be solvable through the spec20:57
fhermeniharlowja: you said nova initially relied on a central view ?20:58
harlowjafhermeni time before time20:58
harlowjathere was only one project :-P20:59
harlowjawell sorry 220:59
harlowjaswift and nova20:59
harlowjaso at that point nova did know about all of its things20:59
fhermeniharlowja: ok. Indeed it is not surprising to have scalability as an issue20:59
harlowjascalability from many different aspects was i think why nova started to split also21:00
fhermeniharlowja: I speak a bit with cdupont from watcher today21:00
harlowjacool21:00
fhermeniharlowja: he proposed kind of a spec for their watcher. Basically a copy/paste of BtrPlace21:00
harlowjainteresting21:01
fhermeniharlowja: I will try to attend their next wednesday meeting to talk to them about our initiative more directly21:01
vilobhmm11fhermeni : BtrPlace whats that ?21:01
harlowjasounds like u will have more convserations with watcher people :-P21:01
harlowjavilobhmm11 http://www.btrplace.org/21:01
harlowjabutterplace21:02
harlowjaor betterplace (idk)21:02
harlowjaha21:02
vilobhmm11cools21:02
harlowjadepends on how u want to pronouce it, ha21:02
fhermeniharlowja: the thing is that a few of them (the whole create-net team) work with me inside the EU project DC4Cities: http://www.dc4cities.eu/en/21:02
harlowjaah21:02
harlowjacool21:02
fhermeniharlowja: better ;)21:02
harlowja:)21:02
*** amrith is now known as _amrith_21:03
fhermeniharlowja: and I will be a reviewer of a Phd. between b com the startup behind watcher and Inria Rennes21:03
* harlowja was thinking about a butter castle, ha21:03
fhermeniharlowja: :D21:03
harlowjafhermeni cools, nice nice21:03
*** salv-orl_ has joined #openstack-oslo21:06
openstackgerritJoshua Harlow proposed openstack/tooz: Spice up the driver summary/info page  https://review.openstack.org/25863021:06
fhermeniharlowja: so, back to the spec. It seems to me that if we put the storage layer aside, there is enough to discuss with other project-schedulers to see what they already support and check if the spec is then complete enough21:06
harlowjaagreed21:06
harlowjathe earlier we start trying to see how others feel about this the better21:07
fhermeniharlowja: as I said earlier, « You’re the gu y"21:07
fhermeniharlowja: :D21:07
harlowjamaybe once vilobhmm11  finishes out his little analysis section we can try to disperse this outwards21:07
harlowjafhermeni haha21:07
fhermeniharlowja: k21:07
fhermeniharlowja: aside, for fun, I will try to write a spec parser to feed btrplace. like a « conceptual proof of concept » CPOC21:08
harlowja??21:09
harlowjabtrplace requires feeding?21:09
harlowjalol21:09
fhermeniharlowja: http://www.btrplace.org/play/ but with the spec as input instead of my DSL21:09
harlowjaah21:10
harlowjaneat21:10
harlowjais all that client side?21:11
fhermenijust the solution computation is made on a server21:11
harlowjak21:11
harlowjaneat21:12
fhermeniharlowja: I made that during a project review :D. The benefit to come at a review without having to say a word :D21:12
vilobhmm11harlowja : sure..21:12
harlowjafhermeni ya, i'm trying to figure out the grammar ha21:13
harlowjathen i'll calculate pi with that, ha21:13
harlowjahaha21:13
*** kgiusti has quit IRC21:23
*** mkovacik has quit IRC21:32
*** browne has quit IRC21:36
*** haypo has left #openstack-oslo21:40
*** browne has joined #openstack-oslo21:41
dimsharlowja : other oslo cores, please vote - https://review.openstack.org/#/c/259169/21:43
*** gordc has quit IRC21:57
*** jecarey has quit IRC22:04
*** jecarey has joined #openstack-oslo22:04
*** jecarey has quit IRC22:04
*** jecarey has joined #openstack-oslo22:05
*** jecarey has quit IRC22:05
*** alejandrito has joined #openstack-oslo22:32
*** wusWWW has joined #openstack-oslo22:34
wusWWW@all: Hi all, not sure whether this is the right place to ask ... can anyone shed some light on internalization on the comment in the yaml file?22:36
*** rohit_ has quit IRC22:41
openstackgerritJoshua Harlow proposed openstack/tooz: Add basic file content schema validation  https://review.openstack.org/25920622:41
*** rohit_ has joined #openstack-oslo22:43
*** e0ne has quit IRC22:47
*** pradk has quit IRC22:53
openstackgerritJoshua Harlow proposed openstack/taskflow: Some additional engine logging  https://review.openstack.org/25874623:02
*** cprmrf__ has quit IRC23:13
*** fhermeni has quit IRC23:14
openstackgerritLianhao Lu proposed openstack/oslo.log: Set keystoneauth default log level to WARN  https://review.openstack.org/25921823:23
*** jaypipes has quit IRC23:47
*** pratikmallya has quit IRC23:51
*** cdent has quit IRC23:53

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!