Monday, 2019-05-20

*** hyunsikyang has joined #openstack-fenix02:02
tojuvoneGood morning, meeting in 10min04:50
dangtrinhnttojuvone, hi04:51
hyunsikyanghi04:53
tojuvonedangtrinhnt, hyunsikyang hi :)04:53
tojuvone#startmeeting Fenix05:00
openstackMeeting started Mon May 20 05:00:10 2019 UTC and is due to finish in 60 minutes.  The chair is tojuvone. Information about MeetBot at http://wiki.debian.org/MeetBot.05:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.05:00
*** openstack changes topic to " (Meeting topic: Fenix)"05:00
openstackThe meeting name has been set to 'fenix'05:00
dangtrinhnto/05:00
tojuvoneWecome to Fenix meeting, time to start05:00
tojuvoneSo, let's have the first topic05:01
tojuvone#topic status05:01
*** openstack changes topic to "status (Meeting topic: Fenix)"05:01
tojuvoneSome bits from OIS + PTG...05:02
tojuvoneOIS summit and PTG went well, once more links to etherpads05:02
tojuvonehttps://etherpad.openstack.org/p/DEN-fenix-forum-brainstorming05:02
tojuvonehttps://etherpad.openstack.org/p/DEN2019-fenix-ETSI-NFV-PTG05:02
tojuvonehttps://etherpad.openstack.org/p/DEN2019-fenix-PTG05:02
tojuvoneThere was good amount of participants in forum and also good input in PTG05:02
tojuvone22 people in Forum was nice for a new project05:03
dangtrinhntwow05:03
hyunsikyangGreat05:03
tojuvoneand in PTG some 5 - 10.. wel there wass 2 sessions anyhow05:04
tojuvoneThere was some discussion about the ETSI changes05:05
tojuvoneBut did not have participants from ETSI side really05:05
tojuvoneAnyhow good input on the document proposal I had05:05
tojuvoneLike the interface to be used between Fenix and VNFM05:06
tojuvoneOtherwise the details are still not ready in ETSI too05:07
tojuvoneBut the interface is the thing to be considered. So still with the AODH05:07
dangtrinhntI'm looking into it. Truth is AODH is only for OpenStack.05:08
hyunsikyangYes. I think the first integration of VNFM, I only think about using AODH and tacker API05:08
hyunsikyangHowever, after that, we can make it independantly.05:08
hyunsikyangwith this, we also consider ETSI sol interface too:)05:09
tojuvoneThere is was also this etcd v2 "watch" API that one can look at05:09
tojuvoneand still there is wither someting should be pushed to Nova05:10
tojuvonebad thing is that it will then be Nova and not for other cloud05:10
dangtrinhntYou meant this #link https://coreos.com/etcd/docs/latest/learning/api.html#watch-api05:11
tojuvoneThose are like "instance group" details during mainteannce05:11
tojuvonedangtrinhnt, yes.. I looked fast there, but haven't given a thought on this05:12
tojuvoneThe thing was that infra should nto call something external (VNFM) directly05:13
tojuvoneAnyhow just like if have opinions, this is what was mentioned05:14
tojuvoneAnyhow I would have reasons to have something else as priority first05:14
hyunsikyangok..05:15
tojuvoneas becasue summit input...05:15
tojuvoneWant to hear? :)05:15
dangtrinhntSo is it that you worrying about Fenix too much depends on OpenStack?05:15
tojuvoneWell, Kubecon is 16000 people05:16
dangtrinhntholy...05:16
hyunsikyangkkkkkkkkk05:16
tojuvonethat is some number to play against05:16
tojuvoneYes, we need to have the OpenStack, but that is so coming next05:17
hyunsikyangright.05:18
tojuvoneIn other words, whiel I have not had time for k8s, it will come and fast05:18
tojuvoneBut maybe moving on from this ETSI thing for now?05:19
dangtrinhntTrue. I had a plan to add support for K8S in Searchlight this cycle.05:19
dangtrinhnt+1 tojuvone05:19
tojuvoneAnd what would lead to our priority...05:20
tojuvoneAs from PTG input...05:20
tojuvoneTwo big users told to be interested in Fenix. This means we need to focus on maturity05:20
tojuvoneLike if I recall 147 regions were mentioned05:21
tojuvoneI would say as of this: Serving potential users is the first priority05:22
dangtrinhntOkie, I looked at the pad. So I think next thing we need to do is to define what maturity means for Fenix.05:22
tojuvoneyes05:22
dangtrinhntHow can we know if Fenix is matured. Some measurable metrics like features, test cases, use cases, number of contributors, etc.05:23
tojuvoneFor me it would be security (interfaces) and ability to take Fenix into use in general05:23
hyunsikyangIMO, usecase is important05:23
tojuvoneMaturity as being able to utilize it. Having testing...05:24
hyunsikyangso, I think that we focus on integration of openstack and we should show the result accroding to fenix architecture.05:24
tojuvoneyes, both user were surely looking into OpenStack maintenance scenario05:25
tojuvoneThis bigger cloud case was to have continuous maintenance as of size of cloud05:26
tojuvoneSo what is "generic" in Fenix should be in shape05:26
hyunsikyangwe show demo and open the source code and many people can test it. After mature of each function, we make it independently05:26
hyunsikyangfor generic.05:27
tojuvoneWhiel users might end up with own plugins05:27
tojuvoneOur biggest problem is to build testing05:27
tojuvoneEffort to complete that in every level is huge05:28
dangtrinhnttrue.05:28
tojuvoneSo I have tried to put priority in storybord and wiki05:29
dangtrinhntokie, that's great.05:29
hyunsikyangok:)05:29
tojuvonethat would aim to have things ready for users05:29
dangtrinhntThanks tojuvone.05:30
tojuvonestoryborad had some tag on priority work05:30
tojuvone<level>-priority05:31
tojuvoneLatest work on this is live migration and almost ready devstack plugin05:31
tojuvoneNext would be documenting how to install Fenix and how to configure AODH for VNFM interaction05:31
tojuvonebut I have some other thing going on as well..05:32
tojuvonemight slow me down, but again showing Fenix to the world05:32
dangtrinhnttojuvone, let put it there and let me see if can do something.05:33
tojuvonedangtrinhnt, +105:33
hyunsikyangyes. please share it:)05:33
tojuvoneSo in OPNFV, looking to have a closed-loop demo for something "new"05:34
tojuvoneWork has started for self-healing + maintenance demo05:34
tojuvoneMaybe: Prometheus + Vitrage + Mistral and finally Fenix05:35
tojuvoneaim might be ONS Europe05:35
dangtrinhntgreat05:35
hyunsikyanggood05:35
tojuvoneThis kind of closes everything OPNFV Doctor is aiming to do05:36
tojuvonethat is "fault management and maintenance"05:36
tojuvoneFirst you heal instance that is affected by memory fault05:36
tojuvoneisolate that memory, do nto allow new instances to host05:37
tojuvoneother instances still stable on host05:37
tojuvonebut Fenix needs to be called so one can maintain the host then05:37
tojuvoneand finally all instances running on healthy hosts05:37
dangtrinhnt+105:38
hyunsikyangwhat is the usage(function) of vitrage in this demo?05:39
tojuvoneI will keep you up-to-date on this05:39
hyunsikyangjust for GUI?05:39
tojuvoneVitrage is root casue analysis05:39
tojuvoneso it analyses 5 memory faults from monitoring...05:40
tojuvoneraises alarm in its graph05:40
tojuvoneand Vitrage template will trigger further action on this05:41
hyunsikyangusing mistarl. I got it.05:41
tojuvoneAlso Vitrage graph should show Fenix state for a host05:41
tojuvoneMistral might have the workflow for self-healing05:41
tojuvoneWhile I might rather do the switchover for VM withing sample VNFM code05:42
tojuvoneas this should be using some Doctor test code05:42
tojuvoneThis is part of Intel started OPNFV closed loop WG work05:43
tojuvoneok, I do not think I have anything further05:44
tojuvoneDo you have something?05:44
dangtrinhntThe telemetry is designing its new future. If you have any input, please feel free #link https://etherpad.openstack.org/p/telemetry-train-roadmap05:45
tojuvoneGreat, I also saw there was some AODH demo.. need to look that05:47
tojuvoneautohealing05:47
dangtrinhntSome suggest auto-scaling and self-healing that may need Fenix :)05:47
dangtrinhntThis #link https://www.youtube.com/watch?v=dXsGnbr7DfM&feature=youtu.be05:48
tojuvoneyes, you could do "self-healing" with Fenix too05:48
tojuvoneI just do not see it in Telco thing where you react fast05:49
dangtrinhntlxkong, one of the core made that. We're developing some use cases of Ceilometer and AODH in Train-1 milestone05:49
tojuvoneso more like maintenance05:49
tojuvone:)05:49
dangtrinhnt:)05:49
tojuvoneI will definitely watch that05:50
dangtrinhntBut I think it more like application self-healing than infras.05:50
tojuvoneyes, self-healing is mostly that05:51
tojuvoneif you are not in a hurry, you can utilize Fenix05:51
tojuvoneOtherwise you need something faster05:51
dangtrinhntAbsolutely, I will put it on the next meeting agenda of Telemetry.05:51
tojuvoneNormally you need ready policy fro infra fault to trigger self-healing05:52
tojuvonein split second05:52
tojuvonebut if it is not that crucial, it can be done with mainteannce session, like fenix05:53
dangtrinhnt+105:53
dangtrinhntFenix is on our meeting agenda this Thursday :) #link https://etherpad.openstack.org/p/telemetry-meeting-agenda05:53
hyunsikyangTacker also can use it later.05:54
tojuvonegreat, let's see if I can join the meeting05:54
hyunsikyanggood05:54
tojuvoneYes, you have the Tacker BP ongoing :)05:54
dangtrinhntOkie, that's all from me.05:55
tojuvoneok, anything else? I will need to jump to doctor meeting soon05:55
hyunsikyangnothing from me.05:56
tojuvoneok, thanks for the meeting05:56
tojuvoneAnd if want to work on sometinhg, just ask05:56
dangtrinhntThanks, tojuvone.05:56
hyunsikyangthanks all05:56
tojuvone#endmeeting05:56
*** openstack changes topic to "Welcome to Fenix. Next meeting: 20th May 5 AM UTC. Add topics to: https://wiki.openstack.org/wiki/Fenix#Meetings"05:56
openstackMeeting ended Mon May 20 05:56:58 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)05:57
openstackMinutes:        http://eavesdrop.openstack.org/meetings/fenix/2019/fenix.2019-05-20-05.00.html05:57
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/fenix/2019/fenix.2019-05-20-05.00.txt05:57
openstackLog:            http://eavesdrop.openstack.org/meetings/fenix/2019/fenix.2019-05-20-05.00.log.html05:57
openstackgerritTomi Juvonen proposed x/fenix master: Add DevStack plugin  https://review.opendev.org/65979307:38
openstackgerritTomi Juvonen proposed x/fenix master: Add DevStack plugin  https://review.opendev.org/65979311:48
tojuvonedtruong, I watched the summit presentation: https://youtu.be/e9Mj7k-BoGU12:27
tojuvoneThat was great :)12:27
tojuvoneSo I have now had some input from other huge cloud that could look into Fenix12:31
tojuvoneso looking to constantly running Fenix maintaining some hosts in some part of the cloud.12:32
tojuvoneAlso I bet have to be very careful with the DB. Anyhow currently only keeping there instances under maintenance session12:33
tojuvoneNot like "whole inventory". Anyhow not having the whole inventory is that, Fenix do not  hold the history of what host has undergone which maintenance over time12:36
openstackgerritMerged x/fenix master: Add DevStack plugin  https://review.opendev.org/65979312:54
*** tojuvone has quit IRC13:35
*** tojuvone has joined #openstack-fenix13:36
dtruongtojuvone Glad you liked the presentation :)15:58
dtruongFor our use case of hypervisor maintenance, we are thinking of just using different host aggregates that contain the maintenance information (i.e OS version, firmware version, etc) as metadata.16:00
dtruongThat way we don't have to keep track of which hosts have been updated or not in a separate DB.16:02
*** tojuvone has quit IRC19:58
*** tojuvone has joined #openstack-fenix19:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!