Tuesday, 2020-05-05

« Monday, 2020-05-04 Index Wednesday, 2020-05-06 »
*** k_mouza has joined #openstack-monasca01:48
*** k_mouza has quit IRC01:52
*** bandorf14 has joined #openstack-monasca06:03
*** gokhani has joined #openstack-monasca06:15
*** nikparasyr has joined #openstack-monasca06:17
*** vishalmanchanda has joined #openstack-monasca06:26
openstackgerritMichał Piotrowski proposed openstack/monasca-kibana-plugin master: [WiP] Adding .zuul job for building plugin  https://review.opendev.org/72520006:41
openstackgerritMichał Piotrowski proposed openstack/monasca-kibana-plugin master: [WiP] Adding .zuul job for building plugin  https://review.opendev.org/72520006:45
*** KeithMnemonic has quit IRC07:09
*** bandorf has quit IRC07:09
*** toabctl has quit IRC07:09
*** chaconpiza has quit IRC07:10
*** PrinzElvis has quit IRC07:10
*** elod has quit IRC07:10
*** johanssone has quit IRC07:10
*** trident has quit IRC07:10
*** Wasaac has quit IRC07:10
*** nikparasyr has quit IRC07:10
*** gokhani has quit IRC07:10
*** bandorf14 has quit IRC07:10
*** brtknr has quit IRC07:10
*** Anticimex has quit IRC07:10
*** vishalmanchanda has quit IRC07:10
*** viks____ has quit IRC07:10
*** andreaf has quit IRC07:10
*** srwilkers has quit IRC07:10
*** sum12 has quit IRC07:10
*** irclogbot_1 has quit IRC07:10
*** coreycb has quit IRC07:10
*** osmanlicilegi has quit IRC07:10
*** openstackgerrit has quit IRC07:10
*** piotrowskim has quit IRC07:10
*** gmann has quit IRC07:10
*** fungi has quit IRC07:10
*** portdirect has quit IRC07:10
*** tobberydberg has quit IRC07:10
*** witek_ has joined #openstack-monasca07:16
*** vishalmanchanda has joined #openstack-monasca07:16
*** nikparasyr has joined #openstack-monasca07:16
*** gokhani has joined #openstack-monasca07:16
*** bandorf14 has joined #openstack-monasca07:16
*** KeithMnemonic has joined #openstack-monasca07:16
*** bandorf has joined #openstack-monasca07:16
*** chaconpiza has joined #openstack-monasca07:16
*** irclogbot_1 has joined #openstack-monasca07:16
*** toabctl has joined #openstack-monasca07:16
*** elod has joined #openstack-monasca07:16
*** openstackgerrit has joined #openstack-monasca07:16
*** osmanlicilegi has joined #openstack-monasca07:16
*** johanssone has joined #openstack-monasca07:16
*** brtknr has joined #openstack-monasca07:16
*** PrinzElvis has joined #openstack-monasca07:16
*** trident has joined #openstack-monasca07:16
*** viks____ has joined #openstack-monasca07:16
*** srwilkers has joined #openstack-monasca07:16
*** piotrowskim has joined #openstack-monasca07:16
*** portdirect has joined #openstack-monasca07:16
*** andreaf has joined #openstack-monasca07:16
*** Anticimex has joined #openstack-monasca07:16
*** tobberydberg has joined #openstack-monasca07:16
*** sum12 has joined #openstack-monasca07:16
*** Wasaac has joined #openstack-monasca07:16
*** coreycb has joined #openstack-monasca07:16
*** gmann has joined #openstack-monasca07:16
*** fungi has joined #openstack-monasca07:16
openstackgerritMichał Piotrowski proposed openstack/monasca-kibana-plugin master: [WiP] Adding .zuul job for building plugin  https://review.opendev.org/72520007:17
openstackgerritMichał Piotrowski proposed openstack/monasca-kibana-plugin master: [WiP] Adding .zuul job for building plugin  https://review.opendev.org/72520007:27
openstackgerritMichał Piotrowski proposed openstack/monasca-kibana-plugin master: [WiP] Adding .zuul job for building plugin  https://review.opendev.org/72520007:39
*** kaiokmo has joined #openstack-monasca07:53
openstackgerritMichał Piotrowski proposed openstack/monasca-kibana-plugin master: [WiP] Adding .zuul job for building plugin  https://review.opendev.org/72520007:54
*** k_mouza has joined #openstack-monasca09:17
*** bandorf14 has quit IRC09:30
*** gokhani has quit IRC10:04
*** adriancz has joined #openstack-monasca10:37
*** gokhani has joined #openstack-monasca11:06
*** dougsz has joined #openstack-monasca11:45
dougszapologies, I have a conflict today and can't make the meeting11:46
witek_does the current meeting time work in general for you or should we consider moving?11:49
witek_dougsz: ^^11:49
dougszhey witek_: I think it's good in general, although at the moment I can only make every other week.11:52
*** dougsz has left #openstack-monasca11:56
chaconpizaWe have a small issue in monasca-api getting data from influxdb.11:59
chaconpizaJust after stacking:  vagrant@devstack:~$ monasca metric-list --name zookeeper.out_bytes12:00
chaconpizaThe repository was unable to process your request (HTTP 500) (Request-ID: req-d6106c5d-3bf9-4adc-af93-cd14efddac13)12:00
chaconpizaadriancz and me were finding the root cause:12:01
chaconpizaThe problem is with the new library:  influxdb 5.3.012:01
chaconpizaDowngrading to the previous version:12:02
chaconpizavagrant@devstack:~$ pip install influxdb==5.2.312:02
chaconpizavagrant@devstack:~$ sudo systemctl restart devstack@monasca-api12:02
chaconpizavagrant@devstack:~$ monasca metric-list --name zookeeper.out_bytes12:02
chaconpiza+---------------------+----------------------+12:03
chaconpiza| name                | dimensions           |12:03
chaconpiza+---------------------+----------------------+12:03
chaconpiza| zookeeper.out_bytes | component: zookeeper |12:03
chaconpiza|                     | hostname: devstack   |12:03
chaconpiza|                     | mode: standalone     |12:03
chaconpiza|                     | service: zookeeper   |12:03
chaconpiza+---------------------+----------------------+12:03
witek_sounds plausible, influxdb has bumped in upper-constraints on Saturday12:04
chaconpizaThis issue impacts on Zuul Check monasca-tempest-python3-influxdb12:04
witek_have a look upstream, if there is an issue filed already12:04
witek_5.3.0 has been released on April 10 already12:05
chaconpizayes https://pypi.org/project/influxdb/#history12:05
witek_is this related?12:13
witek_https://github.com/influxdata/influxdb-python/issues/82012:13
chaconpizaNot sure yet, but sounds suspicious12:17
witek_even if not, we know that there are other regressions as well, so the easiest and quickest right now is to cap it in upper-constraints12:20
witek_investing the root cause helps anyway so that the bug can be fixed upstream12:20
chaconpiza👍12:21
chaconpizaCould be other option to handle it locally in requirements ?12:26
chaconpizalike oslo.serialization https://github.com/openstack/monasca-api/blob/master/requirements.txt#L1012:26
witek_but it cannot conflict with u-c, otherwise tests and DevStack won't run12:32
*** witek_ is now known as witek12:32
chaconpizawhat does mean u-c?12:33
witekupper-constraints12:33
chaconpizaah, ok12:35
*** bandorf44 has joined #openstack-monasca12:56
*** bandorf44 has quit IRC12:56
*** bandorf91 has joined #openstack-monasca12:57
chaconpizaCourtesy Monasca meeting reminder in #openstack-monasca: witek, jayahn,iurygregory,ezpz,igorn,haad,sc,joadavis, akiraY,tobiajo,dougsz,fouadben, amofakhar, haru5ny (haruki),kaiokmo,pandiyan,guilhermesp,chaconpiza,hosanai,Wasaac,brtknr,bandorf12:59
chaconpizaHello everyone!13:00
bandorfHi, everybody13:01
piotrowskimhi13:01
witekhi13:01
chaconpizaThe agenda as usual https://etherpad.opendev.org/p/monasca-team-meeting-agenda13:01
adrianczhi13:02
witekplease start the meeting so that we can easier look up the logs13:02
chaconpizaHi Adrian, Witek, Michal and Matthias13:02
chaconpiza#startmeeting monasca13:02
openstackMeeting started Tue May  5 13:02:40 2020 UTC and is due to finish in 60 minutes.  The chair is chaconpiza. Information about MeetBot at http://wiki.debian.org/MeetBot.13:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:02
*** openstack changes topic to " (Meeting topic: monasca)"13:02
witek:)13:02
openstackThe meeting name has been set to 'monasca'13:02
chaconpizaThanks for the reminder13:02
chaconpizalets start!13:02
chaconpiza#topic Summary: Investigation: Alarm Definition update13:03
*** openstack changes topic to "Summary: Investigation: Alarm Definition update (Meeting topic: monasca)"13:03
bandorf1.1-1.3: Just a summary, as reported last week already. Any questions for this?13:03
witekmore or less clear for me so far13:04
bandorfIf not, let me continue with 1.4/1.5: Update of det. alarm defs.13:04
bandorfWe investigated further for the ttopic I mentioned last week.13:04
bandorfResults: Alarms get more or less "destroyed" if the alarm definition is being updated.13:05
bandorfThis happens with any update, can be e.g. update of operator13:05
bandorfIt's a different bug than the one we know already.13:05
bandorfIn database, there's a table sub_alarm. In this table, expression is stored as well.13:06
bandorfAfter update of alarm def., determinstic is no more part of this expression.13:06
bandorfThus, a deterministic alarm can reach status "UNDETERMINED"13:07
bandorfAny questions related to this?13:08
chaconpizaI would like to add, that we have the list of commands to reproduce it in devstack.13:08
witeksounds plausible, that this is another bug13:09
bandorfYes13:09
witekdo you think the bug is only in API?13:09
chaconpizaI am not sure yet13:10
bandorfI assume that it's a bug in monasca-thresh, but I need to investigate further. However, this will take some time.13:10
bandorfI'm currently working on a diferent, monasca-thresh-related topic (metrics too old in log)13:11
chaconpizawe can create a Story with tag `bug` and assign so far to project monasca-api13:11
witekand what's the priority? are you impacted more by `update function, period` or deterministic alarms?13:11
witekchaconpiza: +113:11
bandorfIn our customer environment, they're not using det. alarms.13:12
bandorfHowever, they can live with the work-around for update function, period.13:12
bandorfThus, from our site, "metrics too old" has highest priority13:13
witekdo we have a story for `update function, period` bug?13:13
bandorfNo, not yet, wanted to finish investigation first - done now.  If everybody agrees with the proposal in 1.6.2, I can create such a story13:14
chaconpiza+113:15
witeksounds good to me, that would be validation in API, right?13:15
bandorfYes, this wil impact api only13:16
bandorfSo, I will create 2 stories, ok.13:16
witek+113:17
bandorfThat's it from my site13:17
chaconpizaalright, then lets move to next topic13:17
chaconpizathanks Matthias!13:17
chaconpiza#topic Ussuri release13:17
witekthanks13:17
*** openstack changes topic to "Ussuri release (Meeting topic: monasca)"13:17
witekwe're approaching the release deadlines13:18
witekon Thu is the final RC deadline13:18
witekI've created new RC for monasca-persister already13:18
witekincluding the simplejson requirement13:19
witekdo we know of any other bugs on stable/ussuri which have to be fixed?13:19
chaconpizaI don't recall any13:20
witekI also think other components are good13:20
witekthe official final release will be announced next week13:21
chaconpizais it announced in the mailing list?13:22
adrianczi have small fix13:22
adrianczhttps://review.opendev.org/#/c/724155/13:22
witekyes, will be, for now they're sending release countdown email13:23
adrianczwould be nice to have this in ussuri13:23
witekhttp://lists.openstack.org/pipermail/openstack-discuss/2020-May/014577.html13:23
chaconpizathanks13:24
chaconpizaI added myself as reviewer for the Adrian's fix13:25
adrianczthanks13:25
chaconpizaOk, lets go for the next topic13:25
chaconpiza#topic Bump librdkafka to 1.4.013:25
witekadriancz: I think it's not release critical, so we can review and merge on master and then cherry-pick to stable/ussuri after the official release13:25
*** openstack changes topic to "Bump librdkafka to 1.4.0 (Meeting topic: monasca)"13:25
chaconpizaWe are using now confluent-kafka-python v1.4.113:26
adrianczyes we can merge this later13:26
chaconpizafor docker we need to compile the source code13:26
chaconpizaI started an Alpine container to do this fix https://review.opendev.org/#/c/725258/13:27
chaconpizabecause it brakes the zuul check build-monasca-docker-image13:28
chaconpizaThen we found a new broken zuul check: monasca-tempest-python3-influxdb13:29
witeklooks good to me, the failing tempest test are not related13:29
chaconpizaI will paste what I wrote one hour ago, for the record.13:29
chaconpizaWe have a small issue in monasca-api getting data from influxdb.13:29
chaconpizaJust after stacking:  vagrant@devstack:~$ monasca metric-list --name zookeeper.out_bytes13:29
chaconpizaThe repository was unable to process your request (HTTP 500) (Request-ID: req-d6106c5d-3bf9-4adc-af93-cd14efddac13)13:30
chaconpizaadriancz and me were finding the root cause:13:30
chaconpizaThe problem is with the new library:  influxdb 5.3.013:30
chaconpizaDowngrading to the previous version:13:30
chaconpizavagrant@devstack:~$ pip install influxdb==5.2.313:30
chaconpizavagrant@devstack:~$ sudo systemctl restart devstack@monasca-api13:30
chaconpizavagrant@devstack:~$ monasca metric-list --name zookeeper.out_bytes13:30
chaconpiza+---------------------+----------------------+13:30
chaconpiza| name                | dimensions           |13:30
chaconpiza+---------------------+----------------------+13:30
chaconpiza| zookeeper.out_bytes | component: zookeeper |13:30
chaconpiza|                     | hostname: devstack   |13:30
chaconpiza|                     | mode: standalone     |13:30
chaconpiza|                     | service: zookeeper   |13:30
chaconpiza+---------------------+----------------------+13:30
chaconpizaAs witek found, influxdb was upgraded in u-c during the weekend13:30
chaconpiza😉13:30
chaconpizaAs well witek found an issue related to the new version of influxdb that could be the reason13:31
chaconpizahttps://github.com/influxdata/influxdb-python/issues/82013:31
chaconpizawhat to do now? 1. try to update our code to be compatible with new influxdb client13:33
openstackgerritAdrian Czarnecki proposed openstack/monasca-api master: Fix incorrect old  log-api tempest test configuration  https://review.opendev.org/71851213:33
chaconpiza2. send a change to the u-c to avoid the new version13:33
chaconpiza??13:33
witekI vote for 213:34
adrianczi vote for 113:35
chaconpizaI will vote for 2, to keep CI working  and in parallel try to make our code compatible with new version13:35
chaconpizabecause is a high possibility that the new version of influxdb client is buggy13:36
adrianczI think this is the best option13:36
chaconpizaadriancz, is it ok to you?13:36
*** nikparasyr has quit IRC13:36
chaconpizaok13:36
witekwell, right now we don't really know if that's a bug in influxdb client or our code13:37
chaconpiza:D13:37
witekbut +1 for investigating the problem and trying to solve the root cause13:37
adrianczand also we don't know what we need to do to make our code compatible with new influx13:38
chaconpizawell, then it seems we are choosing the option 113:39
bandorf+1 for investigation of root cause13:39
witeklet's follow up next week then13:40
chaconpizaok, I will continue digging on it13:40
chaconpizaalright13:40
chaconpizalets jump to the final topic13:40
chaconpiza#topic Docker images13:40
*** openstack changes topic to "Docker images (Meeting topic: monasca)"13:40
witekoh, that's mine13:41
witekas we just discussed, building Python Docker images requires compiling from sources13:41
witekbecause installing from wheels is disabled in Alpine13:42
witekthe following blog article describes it13:42
witekhttps://pythonspeed.com/articles/alpine-docker-python/13:42
witekit causes problems for some requirements, like for example confluent-kafka13:42
witekalso, the build process gets really long, and the resulting image isn't small13:43
witekthe author suggests other base images for Python13:43
witekwhich at the first glance makes sense to me13:44
witekjust wanted to share13:44
chaconpizawitek, I barely recall that there is other option call Eggs, it is possible in Alpine?13:44
witekdon't understand13:45
chaconpizainstead of wheels13:45
chaconpizahttps://packaging.python.org/discussions/wheel-vs-egg/13:45
witekpip in Alpine installs from source package13:45
chaconpizaI see13:46
witekat least for confluent-kafka13:47
chaconpizaTo choose a new base image or continue with Alpine is important. Would you like to add into the etherpad for the PTG?13:47
witekyes, I think we can discuss it during PTG13:48
witekbut is not my priority13:48
chaconpiza+1 thanks13:48
chaconpiza#topic AOB13:49
*** openstack changes topic to "AOB (Meeting topic: monasca)"13:49
chaconpizais there any other topic you would like to discuss?13:50
*** bandorf91 has quit IRC13:50
witekI have one, could have added to the agenda actually13:50
chaconpiza#topic Fix monasca-log-api CI13:51
*** openstack changes topic to "Fix monasca-log-api CI (Meeting topic: monasca)"13:51
witekwe've got two competing approaches to fixing CI in monasca-log-api13:51
witekhttps://review.opendev.org/71851213:51
witekhttps://review.opendev.org/70453613:51
witekwe've chatted with adriancz yesterday and he convinced me to his approach13:52
witekseems cleaner13:52
witekso, the concept is, we've deprecated monasca-log-api and its DevStack plugin in Ussuri13:52
witekwe still maintain monasca-log-api code but stop maintaining DevStack plugin from Ussuri onwards13:53
witekso for testing, we run new DevStack plugin in monasca-api for changes in monasca-log-api master and stable/ussuri13:54
witekfor stable/train and older branches we test with old DevStack plugin in monasca-log-api13:54
witekI know, it's a little complicated but I think makes sense13:55
chaconpizaI would vote to Adrian's way, since we have already the infrastructure to proceed, I mean: USE_OLD_LOG_API13:56
witekoh, I've missed one review for that:13:56
witekhttps://review.opendev.org/72024013:56
adrianczi create change for that13:56
adrianczhttps://review.opendev.org/#/c/720240/13:56
adrianczo sorry witek13:57
witekadriancz: could you please rebase on top of https://review.opendev.org/724658 ?13:58
witekalso, please add a topic for both your changes, so it's easier to find13:58
adrianczyes13:58
chaconpizafor https://review.opendev.org/724658 I need the fix of docker (Bump librdkafka to 1.4.0)13:59
chaconpizaand for that the fix of influxdb new version13:59
chaconpizawe have a long chain13:59
witekyes, influxdb client seems to be prio 1 today14:00
chaconpizaOk, lets go with Adrian's way14:00
witek+114:00
chaconpizaI will digg into influxdb14:00
chaconpizawe ran out of time14:00
witekthanks, good meeting14:00
chaconpizaThanks for your ideas14:01
chaconpiza+114:01
chaconpizabye bye14:01
bandorfBye, everybody14:01
witekbye, see you next week14:01
chaconpiza#endmeeting14:01
*** openstack changes topic to "OpenStack Monitoring as a Service | https://wiki.openstack.org/wiki/Monasca"14:01
adrianczBye14:01
openstackMeeting ended Tue May  5 14:01:37 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:01
openstackMinutes:        http://eavesdrop.openstack.org/meetings/monasca/2020/monasca.2020-05-05-13.02.html14:01
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/monasca/2020/monasca.2020-05-05-13.02.txt14:01
openstackLog:            http://eavesdrop.openstack.org/meetings/monasca/2020/monasca.2020-05-05-13.02.log.html14:01
openstackgerritAdrian Czarnecki proposed openstack/monasca-log-api master: Replace deprecated log api test with up-to-date version  https://review.opendev.org/72024014:05
*** k_mouza has quit IRC14:31
*** k_mouza has joined #openstack-monasca14:59
openstackgerritAdrian Czarnecki proposed openstack/monasca-log-api master: Replace deprecated log api test with up-to-date version  https://review.opendev.org/72024015:53
*** vishalmanchanda has quit IRC16:00
*** gokhani has quit IRC16:07
*** k_mouza has quit IRC16:15
*** k_mouza has joined #openstack-monasca16:15
*** witek has quit IRC16:43
*** k_mouza has quit IRC18:19
*** k_mouza has joined #openstack-monasca20:09
*** k_mouza has quit IRC20:09
*** k_mouza has joined #openstack-monasca20:10
*** k_mouza has quit IRC21:02
*** kaiokmo has quit IRC21:24
*** k_mouza has joined #openstack-monasca21:33
*** k_mouza has quit IRC22:10
openstackgerritGhanshyam Mann proposed openstack/monasca-tempest-plugin master: Add stable branch jobs on the plugins master gate  https://review.opendev.org/72570022:16
*** k_mouza has joined #openstack-monasca22:31
*** k_mouza has quit IRC22:43
« Monday, 2020-05-04 Index Wednesday, 2020-05-06 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!