Wednesday, 2019-08-07

*** ivve has quit IRC00:21
*** pcaruana has quit IRC01:26
*** bobh has joined #openstack-monasca01:40
*** bobh has quit IRC02:53
*** pcaruana has joined #openstack-monasca03:44
openstackgerritjianweizhang proposed openstack/monasca-common master: fix confluent kafka pull method  https://review.opendev.org/67503706:52
openstackgerritjianweizhang proposed openstack/monasca-persister master: python3 json loads issue  https://review.opendev.org/67503807:05
openstackgerritjianweizhang proposed openstack/monasca-persister master: use confluent kafka python driver  https://review.opendev.org/67504607:29
*** ivve has joined #openstack-monasca07:34
*** witek has joined #openstack-monasca07:40
*** spsurya has joined #openstack-monasca07:50
openstackgerritjianweizhang proposed openstack/monasca-common master: fix confluent kafka pull method  https://review.opendev.org/67503708:07
*** Wasaac has joined #openstack-monasca08:11
openstackgerritjianweizhang proposed openstack/monasca-common master: Confluent kafka driver broker otpion bug  https://review.opendev.org/67505508:20
*** dougsz has joined #openstack-monasca08:21
openstackgerritArseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack  https://review.opendev.org/67329708:36
openstackgerritArseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack  https://review.opendev.org/67329708:38
openstackgerritArseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack  https://review.opendev.org/67506108:52
openstackgerritjianweizhang proposed openstack/monasca-persister master: python3 json loads issue  https://review.opendev.org/67503809:12
openstackgerritArseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack  https://review.opendev.org/67506109:14
openstackgerritArseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack  https://review.opendev.org/67506109:15
openstackgerritArseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack  https://review.opendev.org/67506109:16
openstackgerritArseni Lipinski proposed openstack/monasca-agent master: [WIP] Change Elasticsearch urls to fix failing metrics retrieval  https://review.opendev.org/67293709:27
openstackgerritArseni Lipinski proposed openstack/monasca-tempest-plugin master: [WIP] Change body in requests to Kibana  https://review.opendev.org/67459809:30
openstackgerritArseni Lipinski proposed openstack/monasca-ui master: [WIP] Add content-type field  https://review.opendev.org/67460109:56
*** chaconpiza has quit IRC10:23
openstackgerritWitold Bedyk proposed openstack/monasca-notification master: Use Confluent Kafka client  https://review.opendev.org/67481210:25
openstackgerritArseni Lipinski proposed openstack/monasca-ui master: [WIP] Add content-type field  https://review.opendev.org/67460110:27
*** Wasaac has quit IRC10:34
*** Wasaac has joined #openstack-monasca10:38
*** Wasaac has quit IRC11:53
*** Wasaac_ has joined #openstack-monasca11:53
openstackgerritDobroslaw Zybort proposed openstack/monasca-persister master: Fix InfluxdbClientError exception bug  https://review.opendev.org/66559111:54
*** Wasaac_ has quit IRC11:54
*** Wasaac has joined #openstack-monasca11:55
openstackgerritMerged openstack/monasca-notification master: Templates for Slack notifications  https://review.opendev.org/51963012:04
openstackgerritMerged openstack/monasca-notification master: Add PagerDuty notification plugin documentation  https://review.opendev.org/65675012:13
openstackgerritMerged openstack/monasca-persister master: Add tests for influxdb/metrics_repository.py  https://review.opendev.org/65207012:41
openstackgerritMerged openstack/monasca-common master: Fix Confluent Kafka consumer topics subscription  https://review.opendev.org/67480412:41
openstackgerritArseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack  https://review.opendev.org/67506113:04
*** Wasaac has quit IRC14:38
*** Wasaac has joined #openstack-monasca14:39
*** sgrasley has joined #openstack-monasca14:45
*** altlogbot_1 has quit IRC14:46
*** altlogbot_3 has joined #openstack-monasca14:47
witekCourtesy Monasca meeting reminder in #openstack-monasca: witek, jayahn,iurygregory,ezpz,igorn,haad,sc,joadavis, akiraY,tobiajo,dougsz,fouadben, amofakhar, haru5ny (haruki),kaiokmo,pandiyan,charana,guilhermesp,chaconpiza,toabctl,hosanai,Wasaac15:00
witek#startmeeting monasca15:00
openstackMeeting started Wed Aug  7 15:00:51 2019 UTC and is due to finish in 60 minutes.  The chair is witek. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
dougszhello all15:00
*** openstack changes topic to " (Meeting topic: monasca)"15:00
openstackThe meeting name has been set to 'monasca'15:00
witekhi dougsz15:01
witekthe agenda as usual:15:01
witekhttps://etherpad.openstack.org/p/monasca-team-meeting-agenda15:02
witek#topic IPv615:02
*** openstack changes topic to "IPv6 (Meeting topic: monasca)"15:02
witeknot much from me to this one15:02
witekjust an update on gmann's work15:03
witekhere the list of current reviews:15:03
witekhttps://review.opendev.org/#/q/topic:ipv6-only-deployment-and-testing+projects:openstack/monasca15:03
witekI haven't look into this but we probably will have to change the way we configure Kafka15:04
witekto be IPv6 compliant15:04
joadavisdo we need a new version of kafka, or is it just configuration?15:04
witekconfiguration I assume15:04
gmannyeah, seems still issue. I have not checked the recent log though15:06
gmannkafka  seems configured with correct uri - https://logs.opendev.org/74/673274/6/check/monasca-tempest-influxdb-ipv6-only/0e53dc2/controller/logs/etc/monasca-api/monasca-api_conf.txt.gz15:07
witekthe action item is unassigned, it reminds me I should update our priorities list for that15:07
*** Wasaac has quit IRC15:07
*** Wasaac has joined #openstack-monasca15:08
witek gmann: we have a change in review upgrading Kafka and updating the configuration file15:09
witekhttps://review.opendev.org/67091415:09
witekbut I understand it's probably a misconfiguration of clients, right?15:10
gmannyeah, i am not seeing all logs there in recent run so cannot confirm exactly what failing15:11
gmannmay be other failure happening now.15:11
witek#action witek Update Train priorities page with IPv6 goal15:12
witekthanks gmann, I hope we can pick up on that work15:13
gmannthanks witek .15:13
witek#topic Confluent Kafka client [notification]15:13
*** openstack changes topic to "Confluent Kafka client [notification] (Meeting topic: monasca)"15:13
witekthanks a log for your reviews in the last week15:14
witekI pushed new changes with the implementation in monasca-notification15:14
witekhttps://review.opendev.org/67481215:15
witekand https://review.opendev.org/67481415:15
dougszthanks a log :)15:15
witekthe keys are too close each other :)15:16
witekwhen testing these changes I've noticed problems with kafka-python and newest broker versions15:17
witekI think it's related with probing the Kafka API version and the very outdated Kafka client15:17
witekanyone there are errors in Kafka log and notification engine crashes15:18
witekthe latest compatible Kafka version I found was 2.0.115:18
witekhttps://review.opendev.org/67091415:19
witekanother bad news is that this is not tested in CI15:19
witekI mean notification engine15:19
witekI think we should add it to our backlog to add some integration testing here15:20
witekdo you have any questions to these changes or anything related?15:22
witek#topic Faust investigation15:23
*** openstack changes topic to "Faust investigation (Meeting topic: monasca)"15:23
dougszNice work, it seems like a great time to be upgrading the Kafka client given the issues with Kafka 2.3 and other work going on to upgrade ELK15:23
witekyes, it's been way too long in the backlog15:24
witekfor the Faust library investigation, I wanted to share the link to Sumit's repo with some initial code15:25
witekone issue which he identified is, that there is no way to dynamically create Tables and Windows after the Application has been initialized15:26
witekwhich means that in the running Faust Application we cannot add alarms with different evaluation periods15:27
witekbut I think we can work around this by starting new subprocesses15:28
witekhere is Sumit's repo:15:29
witekhttps://github.com/sjamgade/pythresh-proto15:29
witek#topic AOB15:29
*** openstack changes topic to "AOB (Meeting topic: monasca)"15:29
dougszSo a subprocess per alarm in the most extreme case?15:29
witekI think we'd need subprocess per evaluation period15:30
witekso, if all alarms have the same period, they'd fit in one Table15:31
dougszI see - that wouldn't be too bad15:31
witekbut yes, if every alarm would have a different evaluation period, we'll need as many subprocesses with own Tables15:32
witekor we'd have to rethink the approach15:32
joadavisis there a minimum granularity to the evaluation period?15:33
joadaviscould you just put all alarms into a table at the minimum period, but have the processing recognize when the per-alarm period wasn't met and just no-op for a cycle?15:34
joadavisI may be misunderstanding hwo it works, if the table is used to collect data for just a period and would not carry over to another period15:34
witekwhat we're using here are Windows, being views on the Table15:36
witekhttps://faust.readthedocs.io/en/latest/userguide/tables.html#windowing15:36
witekif the window is configured to fit our evaluation period, then we don't have to do much more15:37
witekwe probably could indeed build in some logic and evaluate alarms for other periods as well though15:38
dougszI forget - do we have any benchmark data yet?15:38
witekfor Faust? no15:39
dougszJust thinking it would be nice to check that it scales well early on15:39
witekyes, good point15:40
witekplease take a moment to look at our board:15:42
witekhttps://storyboard.openstack.org/#!/board/14115:42
witekand add or move the cards to reflect the work you're active on15:43
witekI think it can help us all with reviewing15:43
witekdo we have any other topics for today?15:44
joadavisCongratulations to all who had sessions acepted to Shanghai15:45
witekoh yes, forgot that one :)15:45
witekcongratulations joadavis !15:45
dougszyes, well done!15:45
joadavisWell, now I have to actually come up with content...15:45
joadavisI guess I'll be working card #1165 from our board :)15:46
dougszThis is the CloudKitty + Monasca talk right?15:46
joadavishttps://www.openstack.org/summit/shanghai-2019/summit-schedule/events/23932/transitioning-your-cloud-monitoring-from-ceilometer-to-monasca15:47
joadavisquite controversial, I'm sure. ;)15:47
joadavisI think Witek's other session will be interesting too - https://www.openstack.org/summit/shanghai-2019/summit-schedule/events/23919/efficient-monitoring-and-root-cause-analysis-in-complex-systems15:48
witekthe workshop hasn't been accepted this time, right?15:49
joadavisI haven't looked for workshops yet...15:49
joadavisthere are a couple of monitoring in kubernetes talks that may be interesting too15:49
witekalright, thanks for joining today15:52
dougszthanks all15:52
joadavisthanks, see you later15:52
witekhave a nice summer week15:52
witekand see you next Wednesday15:53
witek#endmeeting15:53
joadavis(and the workshop list seems really short this time around)15:53
*** openstack changes topic to "OpenStack Monitoring as a Service | https://wiki.openstack.org/wiki/Monasca"15:53
openstackMeeting ended Wed Aug  7 15:53:18 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:53
openstackMinutes:        http://eavesdrop.openstack.org/meetings/monasca/2019/monasca.2019-08-07-15.00.html15:53
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/monasca/2019/monasca.2019-08-07-15.00.txt15:53
openstackLog:            http://eavesdrop.openstack.org/meetings/monasca/2019/monasca.2019-08-07-15.00.log.html15:53
*** ivve has quit IRC16:23
*** dougsz has quit IRC16:57
*** altlogbot_3 has quit IRC17:17
*** altlogbot_3 has joined #openstack-monasca17:23
*** altlogbot_3 has quit IRC17:30
*** altlogbot_3 has joined #openstack-monasca17:35
*** spsurya has quit IRC18:22
*** Wasaac has quit IRC18:29
*** Wasaac has joined #openstack-monasca18:30
*** Wasaac has quit IRC18:52
*** Wasaac has joined #openstack-monasca19:00
*** Wasaac has joined #openstack-monasca19:29
*** Wasaac has quit IRC19:38
*** Wasaac has joined #openstack-monasca19:44
*** ivve has joined #openstack-monasca20:15
*** witek has quit IRC20:24
*** Wasaac has quit IRC21:10
*** Wasaac has joined #openstack-monasca21:15
*** Wasaac has quit IRC21:43
*** Wasaac has joined #openstack-monasca21:43
*** ivve has quit IRC22:45
*** Wasaac has quit IRC23:19

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!