| *** vishalmanchanda has joined #openstack-monasca | 03:52 | |
| *** arseni-lipinski has joined #openstack-monasca | 09:13 | |
| *** dougsz has joined #openstack-monasca | 09:17 | |
| *** witek has joined #openstack-monasca | 09:21 | |
| *** vishalmanchanda has quit IRC | 11:14 | |
| *** Dobroslaw has quit IRC | 11:14 | |
| *** Anticimex has quit IRC | 11:14 | |
| *** dougsz has quit IRC | 11:14 | |
| *** piotrowskim has quit IRC | 11:14 | |
| *** srwilkers has quit IRC | 11:14 | |
| *** andreaf has quit IRC | 11:14 | |
| *** irclogbot_0 has quit IRC | 11:15 | |
| *** openstackstatus has quit IRC | 11:16 | |
| *** irclogbot_3 has joined #openstack-monasca | 11:17 | |
| *** Anticimex has joined #openstack-monasca | 11:17 | |
| *** witek has quit IRC | 11:18 | |
| *** jgrassler has quit IRC | 11:18 | |
| *** johanssone has quit IRC | 11:18 | |
| *** vishalmanchanda has joined #openstack-monasca | 11:18 | |
| *** Dobroslaw has joined #openstack-monasca | 11:18 | |
| *** dougsz has joined #openstack-monasca | 11:18 | |
| *** piotrowskim has joined #openstack-monasca | 11:18 | |
| *** srwilkers has joined #openstack-monasca | 11:18 | |
| *** andreaf has joined #openstack-monasca | 11:18 | |
| *** johanssone has joined #openstack-monasca | 11:20 | |
| *** witek has joined #openstack-monasca | 11:50 | |
| *** dougsz has quit IRC | 12:18 | |
| *** vishalmanchanda has quit IRC | 12:29 | |
| *** adriancz has joined #openstack-monasca | 12:29 | |
| witek | Courtesy Monasca meeting reminder in 5 minutes in #openstack-monasca: witek, jayahn,iurygregory,ezpz,igorn,haad,sc,joadavis, akiraY,tobiajo,dougsz,fouadben, amofakhar, haru5ny (haruki),kaiokmo,pandiyan,guilhermesp,chaconpiza,hosanai,Wasaac,brtknr | 12:55 |
|---|---|---|
| witek | #startmeeting monasca | 13:00 |
| openstack | Meeting started Tue Feb 4 13:00:21 2020 UTC and is due to finish in 60 minutes. The chair is witek. Information about MeetBot at http://wiki.debian.org/MeetBot. | 13:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 13:00 |
| *** openstack changes topic to " (Meeting topic: monasca)" | 13:00 | |
| openstack | The meeting name has been set to 'monasca' | 13:00 |
| witek | hello everyone | 13:00 |
| chaconpiza | Hello | 13:00 |
| piotrowskim | hi | 13:00 |
| adriancz | Hello | 13:00 |
| Dobroslaw | hi | 13:00 |
| arseni-lipinski | hi | 13:00 |
| witek | hi, strong Fujitsu today :) | 13:01 |
| adriancz | :) | 13:01 |
| witek | nice | 13:01 |
| witek | the agenda for today | 13:01 |
| witek | https://etherpad.openstack.org/p/monasca-team-meeting-agenda | 13:01 |
| witek | please add items if applicable | 13:01 |
| witek | #topic ujson not maintained | 13:02 |
| *** openstack changes topic to "ujson not maintained (Meeting topic: monasca)" | 13:02 | |
| witek | it was raised in openstack-discuss that ujson library is causing problems when deploying Ceilometer in Kolla | 13:02 |
| witek | the library hasn't been maintained for a long time already | 13:03 |
| witek | and we should consider replacing it with some alternative | 13:04 |
| witek | I've included related links into etherpad | 13:04 |
| witek | https://github.com/esnme/ultrajson/issues/343 | 13:04 |
| chaconpiza | I imagine that ujson was used in order to improve performance, instead of regular json or simplejson ? | 13:04 |
| witek | yes, we're using it for serialization and wanted to improve performance | 13:05 |
| witek | from what I recall, deserializing of Kafka messages was one of the items identified in persister to consume most of the time | 13:06 |
| witek | Dobroslaw: was that you doing the profiling? | 13:07 |
| Dobroslaw | yes | 13:07 |
| Dobroslaw | if I remember correctly then main problem with speed was kafka lib | 13:08 |
| witek | right, deserialization second? | 13:08 |
| Dobroslaw | I think yes | 13:09 |
| Dobroslaw | but my memory is hazy about that | 13:10 |
| witek | could you try to dig out the results? | 13:11 |
| witek | so what alternatives do we have? | 13:12 |
| piotrowskim | orjson? | 13:12 |
| witek | we could go with json from stdlib, simplejson | 13:12 |
| witek | yes, orjson | 13:12 |
| witek | there is also rapidjson | 13:13 |
| adriancz | https://artem.krylysov.com/blog/2015/09/29/benchmark-python-json-libraries/ | 13:13 |
| adriancz | pleas cehck this benchmark | 13:13 |
| adriancz | it looks like simplejson is faster then ujson in python3 | 13:13 |
| witek | what is actually relevant for us is to know, how fast our messages are getting deserialized | 13:14 |
| adriancz | but this benchmark is quite old ( 2016/08/13) | 13:14 |
| witek | it's all about this line of code I guess: | 13:14 |
| witek | https://opendev.org/openstack/monasca-persister/src/branch/master/monasca_persister/repositories/utils.py#L21 | 13:14 |
| witek | so running a quick comparison check should be easy | 13:15 |
| witek | there is also another aspect: orjson and rapidjson are not included in global requirements | 13:17 |
| *** dougsz has joined #openstack-monasca | 13:18 | |
| witek | would someone like to do a comparison check of alternatives for our use case? | 13:19 |
| chaconpiza | Do you think results using Devstack can be used? | 13:21 |
| witek | yes | 13:21 |
| witek | I mean, messages from DevStack | 13:21 |
| chaconpiza | I will try | 13:22 |
| witek | but measuring only deserialization as done in persister | 13:22 |
| witek | that would be cool, thanks Martin | 13:24 |
| chaconpiza | I will contact in case of more details | 13:24 |
| witek | thanks, any other comments on that topic? | 13:24 |
| witek | #topic OpenDev + PTG | 13:25 |
| *** openstack changes topic to "OpenDev + PTG (Meeting topic: monasca)" | 13:25 | |
| witek | continuing the topic from last week | 13:26 |
| witek | TC encourages devs and ops to shape the content of the event | 13:26 |
| witek | http://lists.openstack.org/pipermail/openstack-discuss/2020-January/012239.html | 13:26 |
| witek | is anyone interested in traveling and contributing? | 13:27 |
| witek | monitoring session could be interesting to many | 13:27 |
| chaconpiza | I am interested. So, I will ask my manager. | 13:30 |
| witek | +1 | 13:30 |
| adriancz | +2 | 13:30 |
| witek | #AOB | 13:31 |
| witek | #topic AOB | 13:31 |
| *** openstack changes topic to "AOB (Meeting topic: monasca)" | 13:31 | |
| witek | I've attended FOSDEM this weekend | 13:32 |
| witek | on Sunday there was a complete track on Monitoring and Observability | 13:32 |
| witek | https://fosdem.org/2020/schedule/track/monitoring_and_observability/ | 13:32 |
| witek | many Prometheus and Grafana related talks | 13:33 |
| witek | I think we should better integrate with Prometheus in future | 13:34 |
| witek | not necessarily as the fixed model for Monasca | 13:34 |
| witek | but to enable integrating it | 13:34 |
| witek | so that operators can build own alerting rules and existing community dashboards | 13:35 |
| chaconpiza | SOCM 10 ? :D | 13:35 |
| witek | there is no SOC 10 | 13:35 |
| witek | and won't be | 13:35 |
| chaconpiza | just kidding | 13:35 |
| witek | if we want to get any traction in the project we have to integrate with what people are using | 13:36 |
| witek | and the simplest integration we could do is to use the Prometheus remote read | 13:37 |
| witek | it doesn't change the general architecture and enables ops to use both Monasca and Prometheus | 13:38 |
| witek | what is required is a minor change in time series message format | 13:38 |
| Dobroslaw | would be good with backward compatibility so that old messages are working fine | 13:40 |
| witek | we could have a configuration option to control that, or implement a migration script | 13:41 |
| witek | one presentation I wanted to point to was from Rob Skillington | 13:42 |
| witek | about M3DB | 13:42 |
| witek | it's a scalable TSDB querying much faster then Prometheus | 13:43 |
| Dobroslaw | looks nice | 13:43 |
| *** pcaruana has quit IRC | 13:43 | |
| witek | dougsz was mentioning this DB in the past as one of potential options for us | 13:44 |
| witek | also here, they integrate seamlessly with Prometheus with remote read/write mechanism | 13:44 |
| witek | one barrier for us, they only have a Go client | 13:45 |
| witek | but I chatted shortly with Rob and they seem to have an undocumented support for InfluxDB line protocol | 13:46 |
| Dobroslaw | oh, that's interesting | 13:46 |
| witek | meaning that on the persister side we could probably just replace it with InfluxDB | 13:46 |
| witek | still, we'd have to implement the query API | 13:47 |
| witek | I want to follow up with Rob and ask more details | 13:47 |
| witek | here the link to presentation: | 13:48 |
| witek | https://fosdem.org/2020/schedule/event/m3db/ | 13:48 |
| witek | do we have any other topics? | 13:49 |
| witek | if not, thanks for joining | 13:51 |
| chaconpiza | thanks | 13:51 |
| witek | thanks Martin for volunteering on benchmarking | 13:51 |
| chaconpiza | np | 13:51 |
| witek | see you next week, bye | 13:51 |
| Dobroslaw | see you | 13:51 |
| witek | #endmeeting | 13:51 |
| piotrowskim | bye | 13:51 |
| *** openstack changes topic to "OpenStack Monitoring as a Service | https://wiki.openstack.org/wiki/Monasca" | 13:51 | |
| openstack | Meeting ended Tue Feb 4 13:51:49 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 13:51 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/monasca/2020/monasca.2020-02-04-13.00.html | 13:51 |
| adriancz | see you bb | 13:51 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/monasca/2020/monasca.2020-02-04-13.00.txt | 13:51 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/monasca/2020/monasca.2020-02-04-13.00.log.html | 13:51 |
| *** witek has quit IRC | 14:47 | |
| *** vishalmanchanda has joined #openstack-monasca | 14:49 | |
| *** pcaruana has joined #openstack-monasca | 14:56 | |
| *** witek has joined #openstack-monasca | 15:37 | |
| *** witek has quit IRC | 17:49 | |
| *** dougsz has quit IRC | 17:59 | |
| *** Anticimex has quit IRC | 19:00 | |
| *** Anticimex has joined #openstack-monasca | 19:02 | |
| *** vishalmanchanda has quit IRC | 19:53 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!