Friday, 2017-01-20

*** VW has quit IRC00:10
*** Syed__ has quit IRC01:25
*** VW has joined #craton01:38
*** valw has joined #craton02:22
*** VW has quit IRC02:29
*** VW has joined #craton02:53
tojuvonejimbaker: Let's see if can catch some meeting next week.03:42
*** valw has quit IRC03:51
*** valw has joined #craton03:52
*** valw has quit IRC04:13
*** valw has joined #craton04:28
*** VW has quit IRC05:02
*** valw has quit IRC05:08
*** valw has joined #craton06:53
*** valw has quit IRC06:58
*** valw has joined #craton08:52
*** valw has quit IRC08:57
*** johnthetubaguy has quit IRC09:16
*** johnthetubaguy has joined #craton09:19
*** tojuvone has quit IRC09:36
*** tojuvone has joined #craton09:36
*** rainya_ has quit IRC10:00
*** rainya has joined #craton10:01
*** valw has joined #craton12:55
*** valw has quit IRC13:14
*** valw has joined #craton14:40
*** valw has quit IRC14:42
*** valw has joined #craton14:46
*** valw has quit IRC14:56
*** valw has joined #craton15:00
*** VW has joined #craton15:07
*** Syed__ has joined #craton15:14
*** jovon has joined #craton15:15
*** VW has quit IRC15:20
*** VW has joined #craton15:21
*** valw_ has joined #craton15:26
*** rainya_ has joined #craton15:27
*** valw has quit IRC15:28
*** rainya has quit IRC15:28
*** valw_ has quit IRC15:35
*** valw has joined #craton15:36
*** valw has quit IRC15:38
jimbakertojuvone, sounds good!15:46
*** VW_ has joined #craton16:01
*** VW_ has quit IRC16:02
*** VW_ has joined #craton16:03
*** VW_ has quit IRC16:03
*** rainya_ has quit IRC16:04
*** VW has quit IRC16:04
*** VW has joined #craton16:04
tojuvoneHi, catch some evening snack, brb16:48
tojuvonerye bread. It was just nominated our national food yesterday.16:56
*** VW has quit IRC16:58
*** VW has joined #craton16:58
jimbakertojuvone, nice. i do enjoy rye bread myself. rye also makes for a great beer :)17:02
tojuvone:)17:03
*** valw has joined #craton18:08
*** jovon has quit IRC18:10
sigmavirusIn order of preference: pumpernickel rye, rye, pumpernickel18:11
sigmavirusother breads are just too dang sweet for me18:11
jimbakersigmavirus, yeah, no sugar please in breads. unless it's a quick bread or something similar18:17
jimbaker(been trying to cut out added sugars in my diet in 2017. so far, working out pretty well)18:17
tojuvoneI still eat everything I like and try to do sport18:18
tojuvoneseems not workign that good anymore as getting age :D18:18
jimbakertojuvone, hah18:18
jimbakerme, i'm probably doing about the same. but i'm just trying to avoid certain unnecessary things. most breads traditionally are not made with sugar. but these days in the US, they are, in part because sugar is a preservative18:20
sigmavirusand in part because sugar is added to all the foods in the US these days18:20
sigmaviruswhich is so unsettling18:20
sigmavirusI'm trying to follow an Atkins like diet (and have done so to great effect in the past) but it's hard18:21
jimbakerso one could go to an extreme: limited carbs. or another. eat more traditionally. i'm trying the latter approach. it takes a careful eye to sort this stuff out18:21
sigmavirusYeah18:21
tojuvonetell me about it. In Austin it was so annying in hotel when all I could get for breakfast was sugar18:21
sigmavirusThis diet doesn't work for my fiancée for example, she needs grains18:21
sigmavirustojuvone: it's also cheaper when it has sugar in it, oddly enough18:21
tojuvonewe have tax for sugar :)18:21
jimbakersure, but a traditional muesli has no added sugar18:21
jimbakerso one can get complex grains. and if it has some dry fruit like raisins or dates, that's fine too. anyway, i'm trying "traditional diet" for 2017. any world tradition is fine. like to mix it up!18:23
jimbakertojuvone, +1 about the sugar tax18:23
tojuvoneok, but back to Craton as short of time18:23
jimbakeryes indeed :)18:24
tojuvonewhile this was highly important discussion :D18:24
jimbaker(it's only our health!) so yesterday we were talking about auditing, which i think is close to what you need for notification support18:24
jimbakerhttps://blueprints.launchpad.net/craton/+spec/craton-notifications18:25
jimbakerwe need to expand this blueprint out; come up with a spec; and part of that spec should include user stories from what is needed for NFV18:26
tojuvoneok18:26
jimbakerso user stories can include the discussion you had with us back in november re health checks; or performance constraints18:27
*** VW has quit IRC18:28
tojuvonewhat I would fast see is notification about host maintenance "state". I think that is important for everybody18:28
tojuvoneI mean the part that some alarms should not be triggered from onitoring when host is actualyl in maintenance18:29
*** VW has joined #craton18:29
tojuvonewow, my typing is soo good18:29
jimbakerso we have some very early modeling about this in the note and active columns for devices18:30
jimbakertojuvone, ;)18:30
tojuvonethen that part is more "telco" that user should know about coming / ongoing maintenance by alarm18:30
jimbakertojuvone, i always saw this modeling as sort of inadequate, but a start for such governance aspects. consider it a placeholder18:30
tojuvonebut that is also if there is notification from Craton, "monitoring" could catch and send alarm here too18:31
jimbakerright. so i think the important thing here is to come up with some sort of state description that can be used in such automation18:32
tojuvoneDo not know Monasca that much, but like Vitrage does RCA for different issues in cloud and raises alarm on everything related18:33
jimbakeri know the basic problem space for root cause analysis, although no detailed knowledge of vitrage; i have worked with monasca which is different18:34
tojuvoneso maintenance could be addition to receiving "raw faults", anylysing that and sending alarms (I mean at least in vitrage)18:34
jimbakerso presumably we can share information with vitrage for RCA18:35
tojuvoneYes, Vitrage is quite new18:35
tojuvoneanyhow still any monitoring might want to ignore some alarming when maintenance if not otherwise informs about it. I am not aware of billing here. I am still far from ops myself :)18:36
jimbakertojuvone, we should have enough to make a start here18:38
jimbaker1. notification events to indicate something is of interest. this will build on auditing18:39
tojuvonethen I know there is other workflow engines. I do not know if somebody wants to use them. Like catching notification and do workflow somewhere else18:40
jimbaker2. refine how we express our states. active/note are not sufficient for automated descriptions of maintenance18:40
jimbakerwith that then18:40
jimbaker1. capture of such events. may be into a workflow engine. (we are not building a workflow engine for process stuff.) or could be a pulling script for now18:41
jimbaker2. use craton inventory to help with the RCA graph18:42
jimbaker3. profit ;)18:42
jimbaker(with some sort of computation of course)18:42
tojuvoneI was in some Mistral workflow session in Barcelona, but the demo failed. Then again I do not like tiding tons of projects doing different parts, gets more complicated and more room for error18:45
jimbakertojuvone, yeah, it's a great question. i had assumed this was the place for mistral to do such workflows. maybe vitrage could do them instead, depending on how pluggable it is?18:47
jimbakerbut that's why i suggested doing it in a script18:47
jimbakerbecause if it cannot be done in a cronjob, likely not going to work in some overly complicated workflow engine ;)18:48
tojuvonewell, I think Vitrage does some simple API calls and not whole flows of actions18:48
tojuvonesimple thing is when notice host fault and call nova (compute) force down18:48
*** VW has quit IRC18:49
tojuvonesome real workflow should do different operation to "move" VMs depending what "user" wants to do with them18:49
tojuvonesurely first step is that admin might just offer one static flow that does predifined actions always18:50
tojuvoneto "move VMS"18:50
tojuvonemore advanced case is that user get to interact (configure) way or the other. And still he wouldn't have rights, but admin would18:51
jimbakertojuvone, right, so kicking off movement is something we can isolate from, do the movement (which is what sulo is working on)18:51
jimbakertojuvone, if in craton, we will have pretty good support for that with the forthcoming rbac impl18:52
jimbakerpretty much can lock down anything that is a resource in craton18:52
tojuvoneyes, I took a quick glance on that18:52
jimbakersuch as "put this host in maintenance"18:53
jimbakerso i think this is pretty workable then. the really big piece here is just the dependency we need some sort of auditing support18:54
tojuvonethen there is this going into maintenance soon18:54
jimbakerright, so that's part of a state transition graph to be defined18:55
tojuvoneI mean in Telco at least, user wants to know that, so actually there is nothing running on host when time comes18:55
jimbakerbasically what i would suggest is that we make "active" a computed column18:55
jimbakerthere's some other column that captures how a device can from inactive to active18:56
jimbakerand back18:56
jimbakerlet's not put time in the picture just yet (not certain if you were suggesting it should be, just seems to complicate)18:56
*** VW has joined #craton18:56
jimbakerbut a transition of "running" -> "entering maintenance" (maybe with a note) -> "maintenance", etc18:57
jimbakerthat could work18:58
jimbakeriirc, we currently use active to help with quiescence - this host no longer takes new VMs18:58
jimbakersulo, ^^^, if you're around (not likely on an early fri evening!)18:59
tojuvoneyes, the beef is just that user do not suddenly hit maintenance. We have complex chain of different VMs that might be interacting in subscriber session18:59
jimbakertojuvone, no worries. if we need to refine this state transition to reflect, should be fine19:00
jimbakermy only possible concern is modeling "shutdown in 120 seconds" or something like that. mostly because i haven't thought about such modeling before, vs a simple state machine19:01
*** VW has quit IRC19:01
tojuvonewell... how would one do maintenance for group of hosts?19:02
tojuvonewould he like to predifene different time for different host19:02
tojuvoneand that might be notified as planned maintenance time19:02
tojuvonelike there never would be many hosts in mainteancne at the same time19:03
jimbakertojuvone, that's just a group op19:03
tojuvoneI really do not know how ops does this19:04
jimbakertojuvone, for our public cloud work, we have been able to do this just with an active flag19:04
tojuvoneok19:04
jimbakerwhat we miss is the ability to use that for the rca aspects19:05
jimbakerso that's why i would describe it as being a *refinement*19:05
tojuvoneok19:05
jimbakerthe literature of computer science has all sorts of stuff on "process calculuses" that allow for modeling time and interaction. but if we can avoid that sort of stuff, i think that would be best19:06
jimbakercertainly as a next step :)19:06
tojuvoneWas just thinking if set some "planned maintenance time", at that hour it would just roll automatically. (if not cancelled or time redifined)19:07
jimbakertojuvone, we could certainly set a time-to-live19:07
jimbakerbut i was thinking all these changes are best done by an external tool that uses craton19:07
tojuvoneI do not have strong opinion and also no ops experience. The importance was jsut for user to know early enough19:08
jimbakerthat's the "script" (or set of scripts, eventually to be run by a workflow engine) that would work with craton here19:08
jimbakertojuvone, yeah, we can make that story happen19:08
tojuvonewell that is the notif part, but also talked earlier with Nova that servers API thingy.19:10
tojuvoneAnyhow that is also more advanced use case if looking we have already notif19:10
*** VW has joined #craton19:11
tojuvoneMeaning "host maintenance state" could be seen trough Nova servers API by having like to Craton API.19:12
jimbakersure19:13
tojuvoneLooking the time frame I see this coming later if feasible.19:13
tojuvonelike -> link19:14
jimbakerthe big dependency is just getting the auditing/notification done. refining the active column is straightforward, once we know the states19:14
tojuvoneI should have IRC with spell check on a fly19:14
jimbakerwe will also want to make it easier to do that linkage as well (that's the virtualized variable support)19:14
jimbaker;)19:14
tojuvoneusing xchat btw, should there be better client19:15
*** VW has quit IRC19:15
jimbakerpresumably possible with emacs...19:15
jimbakerbut on ubuntu, i use xchat. on mac, i use textual19:16
jimbakermy good enough tooling i suppose19:16
tojuvoneok, then I should not be that far off with my choice :)19:17
tojuvoneyou know it is pretty hard to come up with everything myself, as nobody else working with similar stuff at office19:18
jimbakerno worries, we will help each other figure it out19:18
tojuvoneBut that is all so great also. New stuff :)19:19
jimbakerso i think we have enough to really start working out the blueprint with respect to notifications; and another one to describe maintenance19:21
tojuvoneThanks for all this great discussion. Really great as it is not easy for me to have these hours for "work".19:21
jimbakeri will also take a detailed look at vitrage19:22
jimbakertojuvone, thanks for your great input! i really look forward to working with you more on this19:22
tojuvonethanks19:22
tojuvoneBy fast I think at least Thursday works next week. Kid has floorball at same time with meeting and I can take laptop there19:24
tojuvonejimbaker: Also look forward getting all this and trying to help you as I can.19:25
jimbakertojuvone, sounds great!19:26
*** VW has joined #craton19:29
*** valw has quit IRC20:51
*** valw has joined #craton20:58
*** jovon has joined #craton21:00
*** valw has quit IRC21:21
*** valw has joined #craton22:16
*** VW_ has joined #craton22:39
*** VW has quit IRC22:42
*** valw has quit IRC22:42
*** VW_ has quit IRC22:43
*** jovon has quit IRC23:10
*** VW has joined #craton23:18
*** VW has quit IRC23:24

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!