| *** sshank has quit IRC | 00:24 | |
| *** TuanLA has joined #openstack-meeting-5 | 00:59 | |
| *** ricolin_ has joined #openstack-meeting-5 | 01:15 | |
| *** iyamahat_ has quit IRC | 02:30 | |
| *** yamahata has quit IRC | 02:30 | |
| *** yamamoto has joined #openstack-meeting-5 | 03:52 | |
| *** kei-ichi has quit IRC | 03:53 | |
| *** kei-ichi has joined #openstack-meeting-5 | 03:53 | |
| *** TuanLA has quit IRC | 04:43 | |
| *** TuanLA has joined #openstack-meeting-5 | 04:44 | |
| *** TuanLA has quit IRC | 04:47 | |
| *** yamahata has joined #openstack-meeting-5 | 05:31 | |
| *** 3NAABTTL6 has quit IRC | 05:32 | |
| *** benj_ has joined #openstack-meeting-5 | 05:33 | |
| *** makowals has joined #openstack-meeting-5 | 07:29 | |
| *** ralonsoh has joined #openstack-meeting-5 | 08:09 | |
| *** yamamoto has quit IRC | 08:09 | |
| *** yamamoto has joined #openstack-meeting-5 | 08:12 | |
| *** yamamoto has quit IRC | 08:12 | |
| *** kei-ichi has quit IRC | 08:14 | |
| *** kei-ichi has joined #openstack-meeting-5 | 08:15 | |
| *** iyamahat has joined #openstack-meeting-5 | 08:40 | |
| *** yamamoto has joined #openstack-meeting-5 | 08:41 | |
| *** yamahata has quit IRC | 08:44 | |
| *** yamamoto has quit IRC | 08:50 | |
| *** iyamahat has quit IRC | 08:51 | |
| *** haint has joined #openstack-meeting-5 | 08:59 | |
| *** nguyentrihai has quit IRC | 09:01 | |
| *** markvoelker has quit IRC | 09:21 | |
| *** derekh has joined #openstack-meeting-5 | 09:39 | |
| *** zaneb has quit IRC | 09:54 | |
| *** yamamoto has joined #openstack-meeting-5 | 10:01 | |
| *** makowals has quit IRC | 10:01 | |
| *** makowals has joined #openstack-meeting-5 | 10:03 | |
| *** felipemonteiro has joined #openstack-meeting-5 | 10:16 | |
| *** markvoelker has joined #openstack-meeting-5 | 10:21 | |
| *** yamamoto has quit IRC | 10:36 | |
| *** yamamoto has joined #openstack-meeting-5 | 10:36 | |
| *** xek_ is now known as xek | 11:00 | |
| *** felipemonteiro has quit IRC | 11:38 | |
| *** ralonsoh has quit IRC | 13:32 | |
| *** ralonsoh has joined #openstack-meeting-5 | 14:24 | |
| *** markvoelker has quit IRC | 14:43 | |
| *** markvoelker has joined #openstack-meeting-5 | 14:43 | |
| *** yamahata has joined #openstack-meeting-5 | 14:53 | |
| *** iyamahat has joined #openstack-meeting-5 | 14:55 | |
| *** zaneb has joined #openstack-meeting-5 | 14:58 | |
| *** mateuszb has joined #openstack-meeting-5 | 14:59 | |
| *** korzen_ has joined #openstack-meeting-5 | 14:59 | |
| srwilkers | #startmeeting openstack-helm | 15:00 |
|---|---|---|
| openstack | Meeting started Tue Nov 14 15:00:49 2017 UTC and is due to finish in 60 minutes. The chair is srwilkers. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: openstack-helm)" | 15:00 | |
| openstack | The meeting name has been set to 'openstack_helm' | 15:00 |
| srwilkers | #topic rollcall | 15:01 |
| *** openstack changes topic to "rollcall (Meeting topic: openstack-helm)" | 15:01 | |
| korzen_ | hello | 15:01 |
| srwilkers | o/ | 15:01 |
| jayahn | o/ | 15:01 |
| mateuszb | o/ | 15:02 |
| srwilkers | here's the agenda: https://etherpad.openstack.org/p/openstack-helm-meeting-2017-11-14 | 15:02 |
| srwilkers | we'll give it a few minutes to see if anyone else comes along or wants to add to it | 15:02 |
| *** Quack has joined #openstack-meeting-5 | 15:02 | |
| v1k0d3n | hey all! o/\o | 15:03 |
| srwilkers | hey v1k0d3n \o/ | 15:03 |
| v1k0d3n | o/*\o | 15:03 |
| srwilkers | alright, seems we've got a good list to start with | 15:04 |
| srwilkers | #topic: graph drawing in documentation | 15:05 |
| *** openstack changes topic to ": graph drawing in documentation (Meeting topic: openstack-helm)" | 15:05 | |
| srwilkers | all you jayahn | 15:05 |
| *** seungkyua has joined #openstack-meeting-5 | 15:05 | |
| jayahn | I just wanted to have a graph drawing capability in doc. :) | 15:05 |
| jayahn | i did my best to copy the example configuration. | 15:05 |
| srwilkers | i agree -- pictures are a great way to share things | 15:06 |
| jayahn | not sure if i did all the necessary stuff to setup "sphinxcontrib-blockdig". if anyone can give more feedback. please. :) | 15:06 |
| srwilkers | admittedly i dont know enough about getting it enabled to tell if that's the right way or not | 15:06 |
| srwilkers | lamt is really good at that sort of stuff | 15:07 |
| lamt | o/ | 15:07 |
| jayahn | ah. lamt is here. :) | 15:07 |
| jayahn | https://review.openstack.org/#/c/519653/ | 15:07 |
| *** iyamahat has quit IRC | 15:08 | |
| jayahn | pls leave any feedback on ps. :) | 15:08 |
| srwilkers | ill poke lamt and make sure he gives some feedback there | 15:08 |
| srwilkers | anything else on this jayahn? | 15:08 |
| jayahn | nope | 15:08 |
| srwilkers | sweet | 15:09 |
| srwilkers | #topic fluent-logging | 15:09 |
| *** openstack changes topic to "fluent-logging (Meeting topic: openstack-helm)" | 15:09 | |
| srwilkers | i like this one -- take it away jayahn | 15:09 |
| jayahn | we are almost done with putting flunt-based logging. | 15:09 |
| jayahn | this is be the first one, it will be followed by next steps. | 15:10 |
| jayahn | however, is openstack-helm-infra gate is working properly? | 15:10 |
| srwilkers | yeah, it's working -- i can work with you and provide feedback to do what we need to run it properly | 15:10 |
| jayahn | okay. that would be great. | 15:11 |
| srwilkers | once things are tidied up, ill make sure everythings documented appropriately so adding new services is easy | 15:11 |
| jayahn | can you do through review? or will it be better to setup a serate time? | 15:11 |
| srwilkers | id be happy to do it through review | 15:11 |
| srwilkers | if that's okay | 15:11 |
| jayahn | okay. great! | 15:11 |
| srwilkers | also, wanted to get everyones and yours thoughts on something with the fluent-logging stuff | 15:12 |
| jayahn | fyi, we have checked new version of fluent-bit support kubernetes plugin and some experimental kafka output. that will be our very next thing to do after this is merged. | 15:12 |
| jayahn | okay. srwilkers shoot it. :) | 15:13 |
| srwilkers | would it be worth considering handling the parsers and fluentbit configurations via values.yaml? reason i ask is because while it works out of the box, its very opinionated in that it's expecting you'll only ever use the json logging driver for docker | 15:13 |
| srwilkers | ie, it only gets log events via tailing /var/log/whatever and /var/lib/docker/containers/whatever | 15:14 |
| srwilkers | it's not something i want us to spin the wheels on with the current patchset, because some of your work and mateuszb's work really depends on the fluent-logging stuff being finished | 15:14 |
| srwilkers | but might be worth considering as an enhancement down the road | 15:14 |
| jayahn | okay. we will surely consider your idea into our enhancement task. | 15:15 |
| jayahn | i will talk to sungil about this. | 15:15 |
| srwilkers | awesome :) i can draw up some pictures and throw some roughed up ideas your way too if that helps | 15:15 |
| seungkyua | right all docker container logs are json type. We need to change that. | 15:16 |
| seungkyua | and kubernetes logs in /var/log/xxx | 15:16 |
| srwilkers | but really jayahn -- it's great work. :) | 15:16 |
| jayahn | as you said, the current ps will be just the first of all the waves coming after. let's make this base thing work, then continuosly enhance it | 15:16 |
| srwilkers | i agree | 15:16 |
| srwilkers | thats all i had | 15:17 |
| jayahn | seungkyua is our senior developer. he agrees with you, srwilkers. | 15:17 |
| jayahn | :) | 15:17 |
| srwilkers | nice -- pleasure to meet you seungkyua o/ | 15:17 |
| seungkyua | nice to meet you. | 15:18 |
| jayahn | if he says yes.. it means yes for us :) | 15:18 |
| srwilkers | #topic default alert list spec | 15:18 |
| *** openstack changes topic to "default alert list spec (Meeting topic: openstack-helm)" | 15:18 | |
| srwilkers | awesome :) | 15:18 |
| seungkyua | this is the first time online chat. :) | 15:18 |
| jayahn | ah. this is very very early draft. | 15:18 |
| jayahn | just want to get everyone's opinion on "what is the best way to write it". | 15:19 |
| mateuszb | I'll take a look at it tomorrow jayahn :) | 15:19 |
| jayahn | I think we first define "alert/alarm definition" things like we would like to alert on cpu idle, cpu percent, etc. | 15:20 |
| jayahn | but not defining actual trigger threshold in this spec. | 15:20 |
| srwilkers | yeah, i was going to say your input would be awesome mateuszb since this touches what you've been working against | 15:20 |
| v1k0d3n | jayahn: wrt to the fluent work, i can take a look at it too...we've been doing a lot of this recently too for some internal demos. would be nice to get this into upstream. | 15:20 |
| srwilkers | jayahn: yeah i agree | 15:20 |
| srwilkers | v1k0d3n: thatd be awesome :) | 15:20 |
| jayahn | v1k0d3n, awesome :) | 15:20 |
| jayahn | thanks mateuszb. i will add more alert definition in this week. your feedback would be really helpful | 15:21 |
| *** zaneb has quit IRC | 15:21 | |
| srwilkers | anything else on this one? | 15:22 |
| jayahn | i think korzen_ only has the firs half of meeting time. let's turn it to him now. :) | 15:22 |
| srwilkers | sounds good | 15:23 |
| korzen_ | yes | 15:23 |
| srwilkers | #topic multi namespace support for entrypoint | 15:23 |
| *** openstack changes topic to "multi namespace support for entrypoint (Meeting topic: openstack-helm)" | 15:23 | |
| korzen_ | so I would like to highlight that multiple namespace support is done in the PS | 15:23 |
| srwilkers | i just workflowed it :) | 15:23 |
| korzen_ | #link https://review.openstack.org/#/c/510810 Support services in different namespaces | 15:23 |
| korzen_ | #link https://review.openstack.org/#/c/511515/ Add jobs and daemonsets namespace support | 15:24 |
| korzen_ | after it being merged, the full solution is enabled | 15:24 |
| korzen_ | so we can add cross namespace dependencies for services via enpoints, and for jobs and daemonsets in dependencies section | 15:24 |
| korzen_ | I am testing it in use-case where every service have its own infra | 15:25 |
| v1k0d3n | nice work over there korzen_ ! :) great to see this added. | 15:25 |
| srwilkers | nice korzen_ :) | 15:25 |
| korzen_ | like keystone namespace would have its own mariadb, rabbimq ingress etc | 15:25 |
| korzen_ | ceph would be common | 15:25 |
| v1k0d3n | yeah that's awesome. always been the goal... | 15:26 |
| korzen_ | thx ;) | 15:26 |
| v1k0d3n | you guys made it reality. :) | 15:26 |
| korzen_ | glad to see that it is appreciated ;) | 15:26 |
| korzen_ | I guess that multiple namespace it is all | 15:27 |
| korzen_ | for RBAC | 15:27 |
| srwilkers | #topic RBAC support | 15:27 |
| *** openstack changes topic to "RBAC support (Meeting topic: openstack-helm)" | 15:27 | |
| korzen_ | #link https://review.openstack.org/#/c/464630 RBAC authorization support | 15:28 |
| korzen_ | this one i huge but it contains all RBAC rules that are needed to be run | 15:28 |
| korzen_ | I wanted to get portdirect review on that one | 15:28 |
| korzen_ | all necessary details are included in agenda | 15:29 |
| korzen_ | I would also test in for multiple namespace use-case in following days | 15:29 |
| korzen_ | but example with ceph and ceph-config made this PS ready for multiple namespace | 15:30 |
| jayahn | korzen_ we will try to review this RBAC one as well | 15:30 |
| srwilkers | ill get portdirect to look at it today and provide his feedback | 15:30 |
| korzen_ | ok, I need to run | 15:31 |
| korzen_ | it is all from my side | 15:31 |
| srwilkers | later korzen_ :) | 15:31 |
| srwilkers | #topic log based alerting approaches | 15:31 |
| jayahn | thanks korzen_ | 15:31 |
| *** openstack changes topic to "log based alerting approaches (Meeting topic: openstack-helm)" | 15:31 | |
| korzen_ | bye | 15:31 |
| srwilkers | take it away mateuszb | 15:31 |
| mateuszb | I've got a couple of patchsets in review regarding log-based alarms | 15:31 |
| mateuszb | I've grouped them into 2 categories depending on the approach: | 15:31 |
| mateuszb | 1. Based on ElastAlert: | 15:32 |
| mateuszb | ElastAlert chart: https://review.openstack.org/#/c/516629/ | 15:32 |
| mateuszb | Nagios: passive check for DB errors: https://review.openstack.org/#/c/518543/ | 15:32 |
| mateuszb | Pushing notifications from ElastAlert to Nagios: https://review.openstack.org/#/c/518711/ | 15:32 |
| mateuszb | and 2. Based on fluent-plugin-prometheus: | 15:32 |
| mateuszb | Gathering DB errors count using fluent-plugin-prometheus: https://review.openstack.org/#/c/514938/ | 15:32 |
| mateuszb | Example log-based alert in Prometheus: https://review.openstack.org/#/c/515061/ | 15:32 |
| mateuszb | Nagios: Prometheus check for DB errors in logs: https://review.openstack.org/#/c/519318/ | 15:32 |
| mateuszb | So I've verified that both of the solutions are ready to be integrated with Nagios (I wasn't so sure about ElastAlert+Nagios, but it works well) | 15:33 |
| jayahn | these are really beautifully categorized examples. :) | 15:33 |
| mateuszb | I'm leaving it as it is until the decision is made which of the two approaches we choose (I'd vote for ElastAlert as it's precisely designed for log-based alerting - with a lot of configuration capabilities in place) | 15:34 |
| mateuszb | So any comments and votes are welcome :) | 15:34 |
| *** korzen_ has quit IRC | 15:36 | |
| mateuszb | that's all from me | 15:36 |
| jayahn | ElastAlert seems great tool to use. +1 on that. | 15:37 |
| jayahn | however, since we are probably use prometheus alert manager for metric-based alert, it would be good to use single solution for all the alert. so +1 on fluent-plugin-prometheus. :) | 15:37 |
| jayahn | i will do some discussion with my team members, and will leave our feedback. | 15:37 |
| mateuszb | You're not helping ;) | 15:37 |
| mateuszb | Ok that would be great | 15:37 |
| jayahn | yeap. i know. :( | 15:37 |
| srwilkers | yeah, im a bit torn on this. i feel like ive introduced some confusion with nagios, as it was meant to be pitched as a deadmans switch for things like backing prometheus with ceph | 15:37 |
| srwilkers | but elastalert is able to fire off alerts independently right? it doesnt need nagios or alertmanager? | 15:38 |
| mateuszb | No, it doesn't need nagios and alertmanager | 15:38 |
| srwilkers | okay, that makes me feel better. | 15:38 |
| mateuszb | It fires off alerts independently - but there is a possibility to execute a script, which in turns executes the passive chech to Nagios | 15:39 |
| mateuszb | check * | 15:39 |
| srwilkers | cool :) | 15:39 |
| jayahn | I would like to compare alert template on both solution, i mean how flexible it is to set some alert patterns. | 15:40 |
| srwilkers | yeah, that's something to consider for sure | 15:40 |
| srwilkers | but great work all around on this stuff mateuszb | 15:40 |
| mateuszb | Well, I may prepare a list of what's needed to add additional alert in both cases | 15:41 |
| mateuszb | to make things faster, I'll write it on slack tomorrow | 15:41 |
| srwilkers | sounds good :) | 15:42 |
| mateuszb | in order not to wait until the next meeting :) | 15:42 |
| jayahn | great! | 15:42 |
| *** zaneb has joined #openstack-meeting-5 | 15:43 | |
| srwilkers | anything else? | 15:43 |
| mateuszb | no, that's all. Thanks | 15:44 |
| srwilkers | #topic reviews needed | 15:44 |
| *** openstack changes topic to "reviews needed (Meeting topic: openstack-helm)" | 15:44 | |
| srwilkers | Cell service: https://review.openstack.org/#/c/516810/ | 15:45 |
| jayahn | cell service and nova placement is two essential stuff to do ocata. these are almost ready. pls do final review on this. :) | 15:45 |
| srwilkers | :) | 15:45 |
| jayahn | FYI, as portdirect's request, we will do separate upstream "value override to make ocata work". probably make a new mvp values. | 15:46 |
| jayahn | Neutron: Correct section name for linuxbridge bridge_mappings config: https://review.openstack.org/#/c/518503/ | 15:46 |
| srwilkers | jayahn: that'd be awesome. | 15:46 |
| jayahn | we have been testing vlan-based provider-network w/ linuxbridge | 15:47 |
| jayahn | to support some of legacy openstack env. | 15:47 |
| jayahn | this is one of few thing we are fixing while doing that. | 15:47 |
| jayahn | i think it is rather straight-forward. pls review. :) | 15:47 |
| srwilkers | just workflowed it | 15:48 |
| jayahn | thanks | 15:48 |
| jayahn | that is all | 15:49 |
| srwilkers | awesome :) | 15:49 |
| srwilkers | any other last minute items? | 15:49 |
| srwilkers | otherwise we can take the open discussion to the openstack-helm channel -- im getting rushed out of my conference room :) | 15:50 |
| jayahn | bye | 15:50 |
| srwilkers | :) | 15:50 |
| mateuszb | bye | 15:50 |
| srwilkers | thanks for coming everyone | 15:50 |
| srwilkers | #endmeeting | 15:50 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings" | 15:50 | |
| openstack | Meeting ended Tue Nov 14 15:50:57 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:50 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_helm/2017/openstack_helm.2017-11-14-15.00.html | 15:51 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_helm/2017/openstack_helm.2017-11-14-15.00.txt | 15:51 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_helm/2017/openstack_helm.2017-11-14-15.00.log.html | 15:51 |
| *** ricolin_ has quit IRC | 15:56 | |
| *** mateuszb has quit IRC | 16:09 | |
| *** seungkyua has quit IRC | 16:23 | |
| *** zaneb has quit IRC | 16:25 | |
| *** zaneb has joined #openstack-meeting-5 | 16:25 | |
| *** yamamoto has quit IRC | 17:15 | |
| *** yamahata has quit IRC | 17:15 | |
| *** yamamoto has joined #openstack-meeting-5 | 17:21 | |
| *** yamamoto has quit IRC | 17:26 | |
| *** yamamoto has joined #openstack-meeting-5 | 17:36 | |
| *** yamamoto_ has joined #openstack-meeting-5 | 17:40 | |
| *** yamamoto has quit IRC | 17:41 | |
| *** seungkyua has joined #openstack-meeting-5 | 17:42 | |
| *** yamamoto_ has quit IRC | 17:45 | |
| *** seungkyua has quit IRC | 17:46 | |
| *** iyamahat has joined #openstack-meeting-5 | 17:49 | |
| *** yamamoto has joined #openstack-meeting-5 | 17:52 | |
| *** derekh has quit IRC | 17:54 | |
| *** yamahata has joined #openstack-meeting-5 | 17:59 | |
| *** yamamoto has quit IRC | 18:03 | |
| *** sshank has joined #openstack-meeting-5 | 18:19 | |
| *** sshank has quit IRC | 18:25 | |
| *** sshank has joined #openstack-meeting-5 | 18:29 | |
| *** yamamoto has joined #openstack-meeting-5 | 18:29 | |
| *** yamamoto has quit IRC | 18:35 | |
| *** yamamoto has joined #openstack-meeting-5 | 18:36 | |
| *** iyamahat_ has joined #openstack-meeting-5 | 19:03 | |
| *** iyamahat has quit IRC | 19:03 | |
| *** yamamoto has quit IRC | 19:11 | |
| *** ralonsoh has quit IRC | 19:46 | |
| *** sshank has quit IRC | 20:01 | |
| *** yamamoto has joined #openstack-meeting-5 | 20:12 | |
| *** yamamoto has quit IRC | 20:23 | |
| *** seungkyua has joined #openstack-meeting-5 | 21:12 | |
| *** seungkyua has quit IRC | 21:16 | |
| *** sshank has joined #openstack-meeting-5 | 21:33 | |
| *** felipemonteiro has joined #openstack-meeting-5 | 21:35 | |
| *** sshank has quit IRC | 21:40 | |
| *** sshank has joined #openstack-meeting-5 | 21:42 | |
| *** makowals_ has joined #openstack-meeting-5 | 21:56 | |
| *** zigo has quit IRC | 21:59 | |
| *** makowals has quit IRC | 22:00 | |
| *** zigo has joined #openstack-meeting-5 | 22:01 | |
| *** kei-ichi has quit IRC | 22:02 | |
| *** kei-ichi has joined #openstack-meeting-5 | 22:02 | |
| *** sshank has quit IRC | 22:18 | |
| *** sshank has joined #openstack-meeting-5 | 22:27 | |
| *** sshank has quit IRC | 22:30 | |
| *** felipemonteiro has quit IRC | 23:34 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!