Tuesday, 2016-02-16

*** EinstCra_ has quit IRC00:31
*** reldan has quit IRC01:16
*** daemontool has quit IRC04:02
*** samuelBartel has joined #openstack-freezer07:56
*** reldan has joined #openstack-freezer08:51
vannifmorning09:08
vannifyes, I'd really like to. But not before next week.09:09
*** reldan has quit IRC09:32
*** reldan has joined #openstack-freezer10:09
slashmedaemontool: Did we take a decision on : python-freezerclient versus integration in python-openstackclient10:12
m3m0_slashme we should focus on the python-freezerclient first and the integrate it with python-openstackclient,10:34
slashmePerfect10:34
m3m0_so we can start integrating our on code first10:34
slashme+1 on that10:34
openstackgerritEldar Nugaev proposed openstack/freezer: Refactoring of mysql, msserver and mongo code.  https://review.openstack.org/28060211:00
*** reldan has quit IRC11:11
*** reldan has joined #openstack-freezer12:07
dmellado+1 on that12:48
openstackgerritEldar Nugaev proposed openstack/freezer: Refactoring of mysql, msserver and mongo code.  https://review.openstack.org/28060213:18
openstackgerritEldar Nugaev proposed openstack/freezer: Refactoring of mysql, msserver and mongo code.  https://review.openstack.org/28060213:41
*** EinstCrazy has joined #openstack-freezer13:42
openstackgerritEldar Nugaev proposed openstack/freezer: Refactoring of mysql, msserver and mongo code.  https://review.openstack.org/28060214:14
*** EinstCra_ has joined #openstack-freezer14:25
*** EinstCrazy has quit IRC14:28
openstackgerritMemo Garcia proposed openstack/freezer-web-ui: Liberty guidelines for freezer web ui  https://review.openstack.org/28074514:56
*** EinstCra_ has quit IRC15:04
*** EinstCrazy has joined #openstack-freezer15:04
*** EinstCrazy has quit IRC15:12
*** EinstCrazy has joined #openstack-freezer15:14
*** EinstCrazy has quit IRC15:25
*** EinstCrazy has joined #openstack-freezer15:39
*** dschroeder has joined #openstack-freezer16:05
*** EinstCrazy has quit IRC16:15
*** EinstCrazy has joined #openstack-freezer16:16
*** EinstCrazy has quit IRC16:20
*** jonaspf has joined #openstack-freezer16:25
*** reldan has quit IRC16:31
*** reldan has joined #openstack-freezer16:31
*** reldan has quit IRC16:42
openstackgerritMemo Garcia proposed openstack/freezer-web-ui: Actions for a job no longer shows irrelevant actions for specific cases  https://review.openstack.org/28081116:43
*** reldan has joined #openstack-freezer16:51
*** reldan has quit IRC17:02
*** reldan has joined #openstack-freezer17:07
*** samuelBartel has quit IRC17:13
*** reldan has quit IRC18:00
slashmeGuy we have a big bug:19:08
slashmeWhen the freezer-scheduler is restarted, it will stop executing scheduled jobs.19:08
slashmeIt will just output things like 2016-02-16 18:38:17,677 root WARNING Job 799802f09c074545aee04129a56ab7dd already has scheduled status, skipping19:09
*** reldan has joined #openstack-freezer19:13
*** daemontool has joined #openstack-freezer19:14
*** daemontool_ has joined #openstack-freezer19:17
*** daemontool has quit IRC19:19
slashmeI think we need to rework the way we manage the scheduling. The solution used by mistral seems smarted. I'll do some checking and I'll explain during the next freezer-meeting.19:23
slashmeBug report : https://bugs.launchpad.net/freezer/+bug/154626919:28
openstackLaunchpad bug 1546269 in Freezer "When restarted, the freezer-scheduler stops executing scheduled jobs." [Undecided,New]19:28
daemontool_slashme, ok19:29
daemontool_slashme,  does it require an architectural change?19:31
daemontool_vannif, any thought? ^^19:33
slashmeI'm not sure it is the solution yet (but I think so). It would require a small data change (adding a field to the scheduling info). Basicaly that solution relies on the usage of a "next_execution_date" field, which is a very simple and reliable scheduling mechanism.19:36
daemontool_ok19:36
vannifarchitectural change no. unless we decouple the scheduling from the scheduler :)19:37
vannifI mean. the scheduler now has its own internal execution timers19:38
daemontool_ok19:39
vannifthat is needed for the consistent point in time backups19:39
vannifgiven that the scheduler have datetime synchronized, of course19:40
daemontool_vannif,  are you working on that bug?19:40
vannif*schedulers19:40
vannifwe're still discussing19:40
daemontool_ah ok19:40
vannifbasically, any scheduler has an internal "next execution date" which will trigger the action. at the moment this is managed by the apscheduler19:41
slashmeFYI: https://github.com/openstack/mistral/blob/master/mistral/services/periodic.py19:42
slashme     https://github.com/openstack/mistral/blob/master/mistral/services/triggers.py19:42
vannifthe error comes from the fact that the scheduler and the status of the job are separate. in fact any job should not even bear the status "scheduled". the job is "enable". if it's also scheduled depends if the scheduler is running or not19:42
daemontool_ok, but that bug is quite critical for job scheduling19:43
vannifwhat if the scheduler crasches ? the job status in the api will become invalid19:43
daemontool_would be good to understand why19:43
daemontool_at the next schedule interval should be executed19:44
vannifthat bug is given by the behavior of the scheduler. when it starts, it schedules any job except those in a stop status (or stop request) and those which are already "scheduled"19:44
daemontool_ok19:44
daemontool_what happen if that is a recurrent execution?19:45
vannifso. if you have a scheduler running its jobs will be "scheduled". if you stop the scheduler and you start it again, it will ignore all previous jobs because thay are "scheduled"19:45
vannifthat would not be a tremendous issue if the jobs could be restarted. I'm investigating if that's possible19:45
daemontool_do we need to have a scheduling timeout then?19:45
vannifscheduling timeout ?19:46
daemontool_so the job start19:46
daemontool_sorry19:46
daemontool_the scheduler is running19:46
daemontool_and the jobs are scheduled, but not executed yet19:47
daemontool_the scheduler crash19:47
daemontool_will the job status stay in scheduled for ever?19:47
vannifwell, how do you set the timeout interval ? the API should investigate the scheduling information. but that doesn't work for "running" jobs, unless you use a "wathdog" strategy: refresh the status of a scheduled/running job often, otherwise its status gets reset20:04
daemontool_when the status get reset?20:06
daemontool_is something that is happening now or it was a thought?20:06
daemontool_it was a thought ok :)20:07
daemontool_ok20:07
daemontool_got it20:07
vannifyes :)20:07
daemontool_so going back to my question?20:07
daemontool_the status will keep staying in scheduled state for ever?20:08
daemontool_right now I mean20:09
vannifyes. only the scheduler actively changes it. if the scheduler is dead, the jobs will not change status20:09
daemontool_two scheduler at the same time on the same node cannot run,  right?20:10
daemontool_so if the current scheduler that is running, is not executing the jobs with status scheduled20:12
daemontool_for that node20:13
daemontool_the same scheduler can change the status of that job on the API and/or execute them20:14
*** reldan has quit IRC20:14
*** reldan has joined #openstack-freezer20:18
*** daemontool__ has joined #openstack-freezer21:17
*** daemontool_ has quit IRC21:20
*** daemontool has joined #openstack-freezer21:38
*** daemontool__ has quit IRC21:42
*** reldan has quit IRC21:54
*** daemontool has quit IRC22:05
*** daemontool has joined #openstack-freezer22:48
*** DuncanT_ has joined #openstack-freezer23:30
*** m3m0 has joined #openstack-freezer23:34
*** m3m0_ has quit IRC23:37
*** DuncanT has quit IRC23:37
*** DuncanT_ is now known as DuncanT23:43
*** yangyapeng has joined #openstack-freezer23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!