Wednesday, 2014-03-05

*** IlyaE has joined #murano00:01
*** IlyaE has quit IRC00:05
*** rakhmerov has joined #murano00:29
*** rakhmerov has quit IRC00:33
*** IlyaE has joined #murano00:42
*** wirehead_ has joined #murano00:46
*** wirehead_ has left #murano00:55
*** IlyaE has quit IRC01:01
*** rakhmerov has joined #murano01:29
*** gokrokve_ has quit IRC01:30
*** rakhmerov has quit IRC01:34
*** gokrokve has joined #murano02:16
*** rakhmerov has joined #murano02:30
*** rakhmerov has quit IRC02:34
*** gokrokve has quit IRC02:35
*** rakhmerov has joined #murano02:41
*** gokrokve has joined #murano03:05
*** IlyaE has joined #murano03:55
*** chandankumar_ has quit IRC05:28
*** IlyaE has quit IRC06:32
*** gokrokve has quit IRC06:37
*** saju_m has joined #murano07:02
*** IlyaE has joined #murano07:43
*** IlyaE has quit IRC08:11
*** asalkeld has quit IRC08:11
*** openstackgerrit has quit IRC08:11
*** tnurlygayanov has quit IRC08:11
*** saju_m has quit IRC08:11
*** igormarnat has quit IRC08:11
*** bogdando has quit IRC08:11
*** dteselkin_ has quit IRC08:11
*** killer_prince has quit IRC08:11
*** smurashov has quit IRC08:11
*** sergmelikyan has quit IRC08:11
*** tsufiev___ has quit IRC08:11
*** katyafervent has quit IRC08:11
*** ruhe has quit IRC08:11
*** ogelbukh has quit IRC08:11
*** akuznetsova has quit IRC08:11
*** ativelkov has quit IRC08:11
*** ekarlso has quit IRC08:11
*** IgorYozhikov has quit IRC08:11
*** asalkeld has joined #murano08:29
*** tnurlygayanov has joined #murano08:29
*** openstackgerrit has joined #murano09:01
*** saju_m has joined #murano09:01
*** ekarlso has joined #murano09:01
*** bogdando has joined #murano09:01
*** killer_prince has joined #murano09:01
*** smurashov has joined #murano09:01
*** sergmelikyan has joined #murano09:01
*** ruhe has joined #murano09:01
*** ogelbukh has joined #murano09:01
*** IgorYozhikov has joined #murano09:01
*** igormarnat has joined #murano09:01
*** dteselkin_ has joined #murano09:01
*** tsufiev___ has joined #murano09:01
*** katyafervent has joined #murano09:01
*** akuznetsova has joined #murano09:01
*** ativelkov has joined #murano09:01
*** ativelkov has quit IRC09:05
*** saju_m has quit IRC09:19
*** saju_m has joined #murano09:34
openstackgerritSergey Murashov proposed a change to stackforge/murano-tests: Add script which compares the requirements  https://review.openstack.org/7814609:35
openstackgerritSergey Murashov proposed a change to stackforge/murano-tests: Add script which compares the requirements  https://review.openstack.org/7814609:43
*** ativelkov has joined #murano09:59
ruhesmurashov: ping. why do you need a copy of a script which already existing in openstack-infra/config and is already used in murano jenkins jobs?10:00
tnurlygayanovwe have some modifications for this script )10:01
tnurlygayanovwe have parameters 'allowed count of known errors'10:01
tnurlygayanovthis will allow to avoid extra alarm while we will not move all requirements to global requirements.10:02
ruhetnurlygayanov: we alreaday have check-requirements jobs right? you want to add something new and ignore error messages about real problems we have?10:03
ruhelink https://git.openstack.org/cgit/openstack-infra/config/tree/modules/jenkins/files/slave_scripts/project-requirements-change.py10:04
openstackgerritSergey Murashov proposed a change to stackforge/murano-tests: Add script which compares the requirements  https://review.openstack.org/7814610:05
tnurlygayanovruhe, yes10:06
ruhetnurlygayanov: it seems like a bad idea. i'd prefer to be alerted in each patch until we resolve all requirements issues10:07
tnurlygayanovruhe: we have check-requirements jobs. And these jobs fail all the time because we have some problems with global requirements now.10:07
tnurlygayanovso10:07
tnurlygayanovthe idea is to have additional check which will test requirements with ignoring the known issues10:08
tnurlygayanovto have the ability to detect real unknown  problems10:08
ruhei wouldn't mind to have additional check10:08
tnurlygayanovyes, and now we will have this check )10:09
ruheoh, one moment10:10
ruhewhen do you think we will resolve all the requirements issues?10:11
ruhei guess very soon10:11
tnurlygayanovI don't know. probably it will take about 1-2 months10:12
ruhetnurlygayanov: you had a bunch of patches yesterday to bring some of the requirements up to date. i thought that custom puka is the only one left10:17
tnurlygayanovyes, we have this document https://docs.google.com/spreadsheet/pub?key=0Aiup6hoNUUUedGt3cnJIMHAxbTlHdlFDZGhxLS1yRXc&output=html10:19
tnurlygayanovI don't know how we can fast fix the issue with custom puka10:20
tnurlygayanovthis is marked with red bold in this table10:20
ruhetnurlygayanov: sergmelikyan is working on that already10:21
tnurlygayanovyes, but it is not done yet.10:23
tnurlygayanovalso we have bunch, deep, yaql and django-floppyforms10:24
tnurlygayanovwhich is not presented in global requirements10:24
*** igormarnat has quit IRC10:30
*** sergmelikyan has quit IRC10:31
*** igormarnat has joined #murano10:31
tnurlygayanovGuys, I want to commit some packages (bunch and dee) to global requirements repo. You ok with this idea?10:32
*** dteselkin_ has quit IRC10:32
*** IgorYozhikov has quit IRC10:32
*** dteselkin has joined #murano10:32
*** katyafervent is now known as katyafervent_awa10:33
*** IgorYozhikov has joined #murano10:33
tnurlygayanovWhat about django-floppyforms ?10:36
tnurlygayanovtsufiev___: do we plan to remove requirement django-floppyforms for murano-dashboard?10:36
*** gokrokve has joined #murano10:52
*** gokrokve_ has joined #murano10:54
*** gokrokve has quit IRC10:57
*** katyafervent_awa is now known as katyafervent10:58
*** gokrokve_ has quit IRC10:59
tsufiev___tnurlygayanov: nope11:15
*** tsufiev___ is now known as tsufiev11:15
tnurlygayanovok11:26
tnurlygayanovlooks like we should remove all external dependencies which are not presented in global requirements11:26
*** lazy_prince has joined #murano11:44
*** gokrokve has joined #murano11:52
*** killer_prince has quit IRC11:55
*** lazy_prince is now known as killer_prince11:56
*** gokrokve has quit IRC11:56
*** IgorYozhikov has quit IRC11:56
*** IgorYozhikov has joined #murano12:03
*** chandan_kumar has joined #murano12:11
*** rakhmerov has quit IRC12:36
*** rakhmerov has joined #murano12:38
*** rakhmerov has quit IRC12:42
*** gokrokve has joined #murano12:52
*** gokrokve has quit IRC12:56
*** rakhmerov has joined #murano13:02
*** rakhmerov has quit IRC13:06
*** sergmelikyan has joined #murano13:15
*** gokrokve has joined #murano13:52
*** gokrokve has quit IRC13:57
*** rakhmerov has joined #murano14:02
*** rakhmerov has quit IRC14:07
*** saju_m has quit IRC14:15
*** gokrokve has joined #murano14:25
*** IlyaE has joined #murano14:28
*** gokrokve has quit IRC14:28
*** gokrokve has joined #murano14:33
*** rakhmerov has joined #murano14:42
*** rakhmerov has quit IRC14:54
*** rakhmero_ has joined #murano15:22
*** rakhmero_ has quit IRC15:27
*** rakhmerov has joined #murano15:29
*** rakhmerov has quit IRC15:33
*** rakhmerov has joined #murano15:39
*** chandan_kumar has quit IRC15:51
ativelkovHi folks!16:01
ativelkovAnybody here for an eventhandling discussion?16:01
gokrokveHi16:02
*** stanlagun has joined #murano16:03
gokrokveI suggest to start the discussion16:05
ativelkovHi16:07
ativelkovShould we do it here or may we move to some voice chat?16:07
ruhehi16:08
ativelkovas it turns out that there are just a few people here16:08
stanlagunhi16:08
gokrokvethis is fine. We will come to agreement faster :-)16:10
gokrokveSo. Let me again define what we want to have.16:10
gokrokve1) Applications can define different actions which can be triggered by some external event16:11
gokrokve2) There is no currently a mechanism to pass the event to Murano16:11
gokrokve3) The existing projects use:16:12
gokrokve  a) HTTP hooks to expose hook for an event16:12
gokrokve  b) MQ message or notification to trig an event16:12
gokrokve  c) potentially one can use API call to trig an event but I did not see this approach implemented in any OpenStack project16:13
gokrokve4) User will want to be able to enable or disable event handler16:14
gokrokve5) User will want to find information about existing event handlers exposed by application16:14
gokrokvethis is a brief definition of what is required.16:15
ruhegokrokve: for a healthy discussion it would be nice to have a list of core use-cases you would like to solve with your proposal16:15
gokrokveThere are some:16:16
gokrokve1) Autoscaling - scale up or scale down events triggered by Ceilometer and handled by Murano\Heat16:16
ativelkovCould you please exaplain what do you mean by "existing projects"?16:17
gokrokve2) Periodic tasks for applications like backups, triggered by external scheduller -Mistral -> Murano handler16:17
sergmelikyanativelkov, and what difference between 3a and 3c16:17
gokrokve"Existing projects" Heat, Ceilometer, Trove,....16:17
sergmelikyanHeat support WaitConditions through API Call (as it is done AWS)16:18
gokrokve3a) non authenticated HTTP hook which is simple GET or may be POST request handler. Uses some shared secred for security.16:18
gokrokve3c) a special API methods defined as a part of API specs, use keystone authentication and specific path in API tree16:19
ativelkovSo, these "hooks" are exposed not by the application definitions16:19
ativelkovThey are exposed by their particular instances16:19
ativelkovI.e., the application definition define a "scaleUp" action16:20
gokrokveativelkov: Did i wrote application definitions expose something?16:20
ativelkovno, you just wrote "application"16:20
ativelkovbut this may mean both definition and its instance16:21
ativelkovso I wanted to clearly state the difference16:21
ativelkovdefinitions define actions16:21
ativelkovfor a given instance it is possible to wire-up any action with a public URL or notification16:21
gokrokveYes. Application definition contains some information about actions it want to expose.16:22
ativelkovyep, so, we've got the context16:22
ativelkovafaik, stanlagun had some concerns about it.16:22
gokrokveThere is a reason why I want to have a specific DSL entiry for events, not just actions16:22
ativelkovgokrokve: what do you mean?16:23
gokrokve1) event definition can be abstracted from actual implementation16:23
sergmelikyangokrokve, what the reason behind specific entity vs action + access definition?16:23
ativelkovwait16:23
ativelkovthere is some terminology issue here16:23
gokrokve2) event handler definition can have text description which will be shown in UI16:23
ativelkov"event" is something which happens externally16:24
ativelkovDSL does not know anything about the events16:24
gokrokves/event/event handler16:24
ativelkovIt may just define "event handlers"16:24
ativelkovyup, this is much better16:24
ativelkovbut "event handlers" are just action16:24
ativelkovs16:24
gokrokveativelkov: Do not mix implementation and definition16:25
ativelkovevery event handler is an action, while not all the actions are event handlers16:25
gokrokveyes, event handlers are actions16:25
gokrokvethats clear16:25
stanlagunthere can be more than 1 handler for each event16:25
stanlagunand event source cannot be aware of event handlers16:26
gokrokvebut there is a difference between event handler and actions in a sense that for user it has some special memaning16:26
gokrokvestanlagun: yes. so we need to provide a way to describe even handlers to expose some meaningfull information for user and event source16:27
gokrokveadd an ability to find this handler, without preliminary knowledgr of application internals16:27
ativelkovSo, we speak about some addiional markup for workflow's actions which will: 1) indicate that the action is publicly available, 2) provide information of what this action does16:28
gokrokveativelkov: Yes, exactly16:28
ativelkovAnd we will have an API returning this list of these actions with their descriptions16:28
gokrokveYes16:29
stanlagunactions != event handlers16:29
ativelkovyes16:29
ativelkovI would agree16:29
ativelkovevent handlers are defined by the user16:29
ativelkovuser specifies the event source (URL or notfication type)16:29
ativelkovin the UI for the deployed instance of application16:29
ativelkovAnd then selects one or more actions to handle it16:29
sergmelikyanand than maps to the actual actions?16:30
ativelkovsergmelikyan: exactly16:30
gokrokveativelkov: event handlers are defined by application writer. They are actions in DSL.16:30
stanlagunnot neccessary16:30
gokrokveativelkov: I don't like an idea user maps something to actions16:30
stanlagunThis can be more complex. Applications may subscribe to event themselv. But external systems sygnal event conditions16:31
gokrokveUser do not know the implementation details. He should not know any action name16:31
ativelkovwell, user has to manually define the endpoint anyway16:31
stanlagunUser is cloud admin in this case16:31
gokrokveNo,16:31
gokrokveLet me explain16:32
gokrokveI think event handlers will be a part of DSL code and it will be an application writer responsibility to designe how application will interact with external world.16:32
gokrokveFor example I am creation DB application and I want to provide an abiliity to do backup on DB16:33
ativelkovIn this case you define an action is "public"16:33
gokrokveAs an Application writer I say in app definition:16:33
ativelkovand set its desctipyion16:33
ativelkovlike this16:34
gokrokveexpose event handler "onBackup"16:34
ruheor in case of Savanna App publisher would like to run periodic MapReduce jobs16:34
gokrokve  descr "This is a handler for backup event. External system can trig a backup process to start on DB instance"16:34
ruheWhich bring me to a question - how will the caller get the keystone token?16:35
gokrokveSo. This is application writer responsibility to architect app edfinition and expose meaningfull handlers for some particular events16:35
ativelkovworkflow:16:35
ativelkovbackup:16:35
ativelkovType: Public16:35
gokrokveruhe: use keystone trusts, use non authenticated HTTP hook with secret16:35
ativelkovDescription: This handles the database backup16:35
ativelkovBody:16:35
ativelkov...16:35
ativelkovhm.. IRC cuts-out tabs16:36
gokrokveativelkov: Yes. something like that16:36
sergmelikyanruhe - we can expose any event handler to anyone with a user-token, and only certain eventhandler with defined public endpoint to not authenticated ones16:36
gokrokveI don't know how it shoould look like in YAML16:36
ativelkovhttp://paste.openstack.org/show/72649/16:36
ativelkovBut there is nothing about actual event here16:37
ativelkovUser still has to map it to the event source16:37
ativelkovi.e. to the URL call or notification16:38
ativelkovAnd what I say is that the user should be able to map a single event source to multiple actions16:39
sergmelikyanativelkov, do you mean cloud-user, not application writer?16:40
ativelkovyes, the end-user16:40
ativelkovbecause this will be done for a particular instance of application16:40
ativelkovnot for the definition16:40
stanlagunWhat if one app whants to handle events happening in another app?16:41
gokrokveativelkov: For now I think it will be enough just to show hook URL in UI16:41
gokrokveso user can go and copy&paste it to eny external event source16:42
gokrokvethese event source are not necessary OpenStack components16:42
gokrokvebut16:42
gokrokveAlso we ned to support the use case when app writer knows that there is an external system in his environment which will exist (like private cloud)16:43
gokrokveand app writer will nedd to add an event handler link to this ext system via DSL16:43
gokrokvehe will have a special function to configure this external system16:44
gokrokveSo we need to provide a way to obtain thins event link in runtime in DSL16:44
gokrokveto be able to express something like16:44
gokrokve$.monitoring.addEventHook($.hookLink)16:45
ativelkovThis will not work16:46
ativelkovas the link exists per application instance16:46
ativelkovso this links will need to generated by the engine16:47
ativelkovlike $.generateEventLink(eventName)16:47
ativelkovthen this will generate a link like hostname/api/environemnet_id/application_id/event_name/some_secret_key16:49
*** openstackgerrit has quit IRC17:32
*** rakhmerov has quit IRC17:58
*** gokrokve has quit IRC18:22
*** openstackgerrit has joined #murano18:26
*** rakhmerov has joined #murano18:29
*** IlyaE has quit IRC18:31
*** rakhmerov has quit IRC18:31
*** rakhmerov has joined #murano18:31
*** rakhmerov has quit IRC18:36
*** IlyaE has joined #murano18:48
*** openstackgerrit has quit IRC19:02
*** egorkamis has joined #murano19:07
*** gokrokve has joined #murano19:23
*** rakhmerov has joined #murano19:32
*** rakhmerov has quit IRC19:34
*** rakhmerov has joined #murano19:34
*** egorkamis has quit IRC19:36
*** rakhmerov has quit IRC19:38
*** asalkeld has quit IRC19:44
*** _dim_ has joined #murano19:52
*** _dim_ has left #murano19:53
*** asalkeld has joined #murano19:57
*** rakhmerov has joined #murano20:34
*** IlyaE has quit IRC20:36
*** IlyaE has joined #murano20:38
*** rakhmerov has quit IRC20:39
*** gokrokve has quit IRC20:51
*** mordashova has joined #murano21:34
*** rakhmerov has joined #murano21:35
*** rakhmerov has quit IRC21:39
*** asalkeld has quit IRC21:58
*** asalkeld has joined #murano22:10
*** rakhmerov has joined #murano22:36
*** rakhmerov has quit IRC22:40
*** openstack has joined #murano23:03
*** mordashova has quit IRC23:03
*** rakhmerov has joined #murano23:37
*** rakhmerov has quit IRC23:41

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!