| *** AlexeyAbashkin has quit IRC | 00:02 | |
| *** donghao has joined #openstack-telemetry | 00:31 | |
| *** sdaniel has quit IRC | 00:33 | |
| *** donghao has quit IRC | 00:35 | |
| *** tovin07_ has joined #openstack-telemetry | 00:45 | |
| *** jmlowe_ has joined #openstack-telemetry | 00:54 | |
| *** jmlowe has quit IRC | 00:55 | |
| *** jmlowe_ has quit IRC | 00:59 | |
| *** Tom-Tom has joined #openstack-telemetry | 01:50 | |
| *** zhurong has joined #openstack-telemetry | 02:22 | |
| *** r-daneel has quit IRC | 02:50 | |
| *** larainema has joined #openstack-telemetry | 02:50 | |
| *** donghao has joined #openstack-telemetry | 03:20 | |
| *** donghao has quit IRC | 03:25 | |
| *** zhurong has quit IRC | 03:47 | |
| *** ykarel has joined #openstack-telemetry | 03:53 | |
| *** edmondsw has joined #openstack-telemetry | 03:53 | |
| *** edmondsw has quit IRC | 04:02 | |
| *** Tom-Tom has quit IRC | 04:27 | |
| *** Tom-Tom has joined #openstack-telemetry | 04:41 | |
| *** Tom-Tom has quit IRC | 04:45 | |
| *** edmondsw has joined #openstack-telemetry | 05:18 | |
| *** edmondsw has quit IRC | 05:23 | |
| *** ykarel has quit IRC | 06:03 | |
| *** ykarel has joined #openstack-telemetry | 06:03 | |
| *** donghao has joined #openstack-telemetry | 06:09 | |
| *** Tom-Tom has joined #openstack-telemetry | 06:10 | |
| *** zhurong has joined #openstack-telemetry | 06:11 | |
| *** ykarel_ has joined #openstack-telemetry | 06:12 | |
| *** donghao has quit IRC | 06:14 | |
| *** ykarel has quit IRC | 06:15 | |
| *** lhx_ has joined #openstack-telemetry | 06:23 | |
| *** iranzo has joined #openstack-telemetry | 06:57 | |
| *** edmondsw has joined #openstack-telemetry | 07:07 | |
| *** Tommy-Tom has joined #openstack-telemetry | 07:07 | |
| *** edmondsw has quit IRC | 07:12 | |
| *** adisky__ has joined #openstack-telemetry | 07:20 | |
| *** rcernin has quit IRC | 07:21 | |
| *** AlexeyAbashkin has joined #openstack-telemetry | 07:53 | |
| *** hoonetorg has quit IRC | 08:06 | |
| *** gkadam has joined #openstack-telemetry | 08:07 | |
| *** ykarel_ has quit IRC | 08:13 | |
| *** ykarel_ has joined #openstack-telemetry | 08:14 | |
| *** yprokule has joined #openstack-telemetry | 08:16 | |
| *** hoonetorg has joined #openstack-telemetry | 08:19 | |
| *** tesseract has joined #openstack-telemetry | 08:22 | |
| *** rcernin has joined #openstack-telemetry | 08:36 | |
| *** ykarel_ is now known as ykarel|away | 08:42 | |
| *** ykarel|away has quit IRC | 08:47 | |
| -openstackstatus- NOTICE: Our CI system Zuul is currently not accessible. Wait with approving changes and rechecks until it's back online. Currently waiting for an admin to investigate. | 08:49 | |
| *** ykarel has joined #openstack-telemetry | 08:50 | |
| *** linkmark has joined #openstack-telemetry | 08:51 | |
| *** edmondsw has joined #openstack-telemetry | 08:56 | |
| *** edmondsw has quit IRC | 09:00 | |
| *** sdaniel has joined #openstack-telemetry | 09:05 | |
| sdaniel | Hi, thank you for the many help | 09:06 |
|---|---|---|
| sdaniel | The alarming based on gnocchi almost working | 09:07 |
| sdaniel | I get an exception on aodh-notifier: Unable to notify alarm 97901000-55d5-4aa4-9491-c9f370697a3a: BadRequest: Expecting to find domain in user. | 09:08 |
| -openstackstatus- NOTICE: Zuul is back online, looks like a temporary network problem. | 09:09 | |
| *** jappleii__ has quit IRC | 09:10 | |
| *** shardy has joined #openstack-telemetry | 09:12 | |
| *** iranzo has quit IRC | 09:35 | |
| *** iranzo has joined #openstack-telemetry | 09:35 | |
| *** iranzo has quit IRC | 09:35 | |
| *** iranzo has joined #openstack-telemetry | 09:35 | |
| openstackgerrit | Julien Danjou proposed openstack/ceilometer master: utils: remove unused decimal/dt conversion functions https://review.openstack.org/521088 | 09:36 |
| *** donghao has joined #openstack-telemetry | 09:46 | |
| *** donghao has quit IRC | 09:50 | |
| *** zhurong has quit IRC | 09:57 | |
| openstackgerrit | Nguyen Van Trung proposed openstack/ceilometer master: Add doc8 to pep8 check for ceilometer project https://review.openstack.org/527359 | 10:07 |
| *** tovin07_ has quit IRC | 10:11 | |
| *** ykarel_ has joined #openstack-telemetry | 10:12 | |
| *** ykarel has quit IRC | 10:16 | |
| openstackgerrit | Nguyen Van Trung proposed openstack/ceilometer master: Improve gitignore for project https://review.openstack.org/527361 | 10:16 |
| *** zhurong has joined #openstack-telemetry | 10:26 | |
| *** ykarel__ has joined #openstack-telemetry | 10:26 | |
| *** Tommy-Tom has quit IRC | 10:30 | |
| *** ykarel_ has quit IRC | 10:30 | |
| *** Tommy-Tom has joined #openstack-telemetry | 10:30 | |
| *** Tommy-Tom has quit IRC | 10:32 | |
| *** Tommy-Tom has joined #openstack-telemetry | 10:32 | |
| *** alexchadin has joined #openstack-telemetry | 10:36 | |
| *** alexchadin has quit IRC | 10:39 | |
| *** alexchadin has joined #openstack-telemetry | 10:39 | |
| *** alexchadin has quit IRC | 10:40 | |
| *** alexchadin has joined #openstack-telemetry | 10:40 | |
| *** alexchadin has quit IRC | 10:42 | |
| *** alexchadin has joined #openstack-telemetry | 10:43 | |
| *** Tommy-Tom has quit IRC | 10:48 | |
| *** Tommy-Tom has joined #openstack-telemetry | 10:48 | |
| *** Tommy-Tom has quit IRC | 10:53 | |
| *** Tom-Tom has quit IRC | 11:10 | |
| *** AlexeyAbashkin has quit IRC | 11:15 | |
| *** zhurong has quit IRC | 11:25 | |
| *** alexchadin has quit IRC | 11:28 | |
| *** alexchadin has joined #openstack-telemetry | 11:28 | |
| *** ykarel__ is now known as ykarel | 11:38 | |
| *** AlexeyAbashkin has joined #openstack-telemetry | 11:40 | |
| *** gmann_afk is now known as gmann | 11:55 | |
| *** donghao has joined #openstack-telemetry | 12:35 | |
| *** donghao has quit IRC | 12:41 | |
| *** Tommy-Tom has joined #openstack-telemetry | 12:51 | |
| *** Tommy-Tom has quit IRC | 12:56 | |
| *** alexchadin has quit IRC | 12:56 | |
| *** alexchadin has joined #openstack-telemetry | 12:57 | |
| *** zhurong has joined #openstack-telemetry | 12:59 | |
| *** lhx_ has quit IRC | 12:59 | |
| *** Tom-Tom has joined #openstack-telemetry | 13:01 | |
| *** gordc has joined #openstack-telemetry | 13:02 | |
| *** Tom-Tom has quit IRC | 13:06 | |
| *** zhurong has quit IRC | 13:14 | |
| *** weshay|sickday is now known as weshay | 13:15 | |
| *** edmondsw has joined #openstack-telemetry | 13:16 | |
| *** Tommy-Tom has joined #openstack-telemetry | 13:20 | |
| *** Tommy-Tom has quit IRC | 13:21 | |
| *** Tommy-Tom has joined #openstack-telemetry | 13:22 | |
| *** alexchadin has quit IRC | 13:25 | |
| *** Tommy-Tom has quit IRC | 13:26 | |
| *** Tommy-Tom has joined #openstack-telemetry | 13:26 | |
| *** alexchadin has joined #openstack-telemetry | 13:39 | |
| *** sbezverk has quit IRC | 13:44 | |
| *** dave-mccowan has joined #openstack-telemetry | 13:45 | |
| *** dave-mccowan has quit IRC | 13:48 | |
| *** sdaniel has quit IRC | 13:54 | |
| *** dave-mccowan has joined #openstack-telemetry | 13:55 | |
| *** dave-mccowan has quit IRC | 14:00 | |
| openstackgerrit | gordon chung proposed openstack/ceilometer stable/pike: hack around upper-constraints https://review.openstack.org/527407 | 14:07 |
| *** Tom-Tom has joined #openstack-telemetry | 14:08 | |
| openstackgerrit | gordon chung proposed openstack/ceilometer stable/pike: hack around upper-constraints https://review.openstack.org/527407 | 14:08 |
| *** ykarel is now known as ykarel|afk | 14:23 | |
| *** donghao has joined #openstack-telemetry | 14:23 | |
| *** tesseract has quit IRC | 14:26 | |
| *** ykarel|afk has quit IRC | 14:28 | |
| *** donghao has quit IRC | 14:28 | |
| -openstackstatus- NOTICE: We're currently seeing an elevated rate of timeouts in jobs and the zuulv3.openstack.org dashboard is intermittently unresponsive, please stand by while we troubleshoot the issues. | 14:40 | |
| *** alexchadin has quit IRC | 14:41 | |
| *** lhx_ has joined #openstack-telemetry | 14:45 | |
| *** Tommy-Tom has quit IRC | 14:45 | |
| *** Tommy-Tom has joined #openstack-telemetry | 14:46 | |
| *** gordc has quit IRC | 14:48 | |
| *** Tommy-Tom has quit IRC | 14:50 | |
| *** rcernin has quit IRC | 15:00 | |
| *** dave-mccowan has joined #openstack-telemetry | 15:08 | |
| *** sdaniel has joined #openstack-telemetry | 15:25 | |
| sdaniel | Hi, my previous problem has solved, but I'm struggling with the following: my generateed alarms have state "insufficient data" and no idea why, because the granularity of the alarm is 120, but in gnocchi I can see new measures in every 60 second. | 15:26 |
| sdaniel | (The intervall in the ceilometer is set for 60 ) | 15:27 |
| sdaniel | ( in the pipeline.yaml. Both in compute and controller also.) | 15:28 |
| *** gordc has joined #openstack-telemetry | 15:34 | |
| *** yprokule has quit IRC | 15:35 | |
| jd_ | sdaniel: if you ask Aodh to fetch a granularity that does not exist in Gnocchi, that happens indeed | 15:35 |
| *** jmlowe has joined #openstack-telemetry | 15:44 | |
| *** jmlowe has quit IRC | 15:48 | |
| *** donghao has joined #openstack-telemetry | 15:48 | |
| *** Tommy-Tom has joined #openstack-telemetry | 15:57 | |
| *** Tommy-Tom has quit IRC | 15:57 | |
| *** Tommy-Tom has joined #openstack-telemetry | 15:57 | |
| *** donghao has quit IRC | 15:58 | |
| *** dave-mccowan has quit IRC | 16:02 | |
| sdaniel | jd: I'm lost a little bit. I configured every interval in the pipeline.yaml to 60, the polling is 60, the resource polling is 20, the alarm granuality is 120, and in the gnocchi there are new measures in every 60 sec | 16:08 |
| sdaniel | and still insufficient. Did I make something wrong ? | 16:08 |
| *** jmlowe has joined #openstack-telemetry | 16:10 | |
| gordc | sdaniel: what is resource polling? | 16:12 |
| gordc | you should be setting your alarm granularity to match the granularity of the data you capture in gnocchi. | 16:12 |
| gordc | it seems you want to be changnig the evaluation periods if you want alarm timespan to be 120 vs existing granularity of 60 is gnocchi. | 16:13 |
| sdaniel | alarm granuality in aodh has to be match with the granuality of measuresments in gnocchi ? | 16:14 |
| gordc | yes, (if i remember correctly)... aodh alarms do not resample so if the granularity doesn't exist in gnocchi, it won't work. | 16:15 |
| sdaniel | gordc: I mean resource_update_interval. I thought, that somehow I can make it faster to recognize when the heat create a new instance, but now I removed this parameter from my ceilometer.conf. | 16:17 |
| gordc | is resource_update_interval a heat option? | 16:17 |
| gordc | oh. that's not related to alarms | 16:18 |
| gordc | that just defines how often ceilometer attempts to discover new instances to start metering/monitoring. | 16:19 |
| sdaniel | yes, I know. I hoped that can make the detection faster and I will leave this insufficient data sooner in alarm state, but it did not help actually | 16:20 |
| gordc | ok | 16:21 |
| *** jmlowe has quit IRC | 16:21 | |
| sdaniel | gordc, it seems your right (again). After I changed the granuality of the alarm to match gnocchi, it found | 16:21 |
| *** Tom-Tom has quit IRC | 16:22 | |
| *** Tom-Tom has joined #openstack-telemetry | 16:22 | |
| *** Tommy-Tom has quit IRC | 16:23 | |
| gordc | cool cool. i imagine you could add support to resample on a granularity that doesn't exist in gnocchi (gnocchi itself supports this already). the only issue is that the results of resampling are not necessarily precise. | 16:25 |
| *** AlexeyAbashkin has quit IRC | 16:26 | |
| *** Tom-Tom has quit IRC | 16:26 | |
| *** gkadam has quit IRC | 16:29 | |
| *** yprokule has joined #openstack-telemetry | 16:36 | |
| *** AlexeyAbashkin has joined #openstack-telemetry | 16:38 | |
| *** jmlowe has joined #openstack-telemetry | 16:39 | |
| *** jmlowe has quit IRC | 16:44 | |
| *** r-daneel has joined #openstack-telemetry | 16:44 | |
| *** AlexeyAbashkin has quit IRC | 16:47 | |
| *** dave-mccowan has joined #openstack-telemetry | 16:50 | |
| sdaniel | gordc: Your right. If somebody would implement it, it just has to be document, that the required granuality has tob equal or more than the granuality in gnocchi, and if more then 1 measures are matched, then the same calculation will be happen than it defined in the alarm itself as expected aggregation. | 16:52 |
| sdaniel | *granularity (misspelling) | 16:53 |
| sdaniel | gordc: For sure, I recreated the alarms from heat (like before) and I did not change anything else. How much time needed to leave this insufficient data state ? I'm waiting for around 8 minutes. | 16:55 |
| gordc | sdaniel: depends the granularity in gnocchi, the evaluation_interval in aodh, the polling interval in ceilometer... it's complicated (which is why we have https://github.com/gnocchixyz/gnocchi/issues/71) | 17:02 |
| *** dave-mccowan has quit IRC | 17:05 | |
| *** edmondsw has quit IRC | 17:06 | |
| jd_ | yeah or we need someone to fix aodh and the doc :) | 17:07 |
| *** iranzo has quit IRC | 17:07 | |
| * gordc looks around for someone | 17:09 | |
| *** dave-mccowan has joined #openstack-telemetry | 17:38 | |
| *** edmondsw has joined #openstack-telemetry | 17:56 | |
| openstackgerrit | Joseph Davis proposed openstack/ceilometer stable/pike: Exclude keystonemiddleware 4.19.0, force gnocchi install in devstack https://review.openstack.org/526751 | 17:59 |
| *** shardy has quit IRC | 18:01 | |
| *** edmondsw has quit IRC | 18:04 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/aodh master: don't use last keystonemiddleware https://review.openstack.org/527486 | 18:05 |
| *** Guest52604 has quit IRC | 18:08 | |
| *** jmlowe has joined #openstack-telemetry | 18:12 | |
| *** lhx_ has quit IRC | 18:13 | |
| *** AlexeyAbashkin has joined #openstack-telemetry | 18:14 | |
| *** AlexeyAbashkin has quit IRC | 18:18 | |
| *** AlexeyAbashkin has joined #openstack-telemetry | 18:34 | |
| *** AlexeyAbashkin has quit IRC | 18:38 | |
| *** sbezverk has joined #openstack-telemetry | 18:50 | |
| *** adisky__ has quit IRC | 18:50 | |
| *** edmondsw has joined #openstack-telemetry | 18:59 | |
| gordc | lol https://review.openstack.org/#/c/526624/ | 19:32 |
| gordc | love when you get -2'd for trying to help others. | 19:33 |
| jd_ | without an alternative | 19:43 |
| gordc | the bug is not a bug... at least it wasn't a copy paste reply? is that a positive? :P | 19:44 |
| * jd_ shrugs | 19:45 | |
| gordc | sigh | 19:45 |
| *** masuberu has joined #openstack-telemetry | 19:48 | |
| *** masber has quit IRC | 19:51 | |
| *** tonyb_ has quit IRC | 19:52 | |
| *** tonyb has joined #openstack-telemetry | 19:52 | |
| *** dave-mccowan has quit IRC | 19:56 | |
| -openstackstatus- NOTICE: The zuul scheduler has been restarted after lengthy troubleshooting for a memory consumption issue; earlier changes have been reenqueued but if you notice jobs not running for a new or approved change you may want to leave a recheck comment or a new approval vote | 20:16 | |
| sileht | grep 2017-12-.*openstackstatus.*NOTICE irc.freenode.#openstack-telemetry.weechatlog -c | 20:27 |
| sileht | 7 | 20:27 |
| sileht | 7 restart is 12 days awesome | 20:27 |
| sileht | 3 in november | 20:27 |
| sileht | 25 in october, the month zuulv3 have moved to prod | 20:28 |
| *** openstackgerrit has quit IRC | 20:34 | |
| *** hughhalf has quit IRC | 20:34 | |
| *** joadavis has quit IRC | 20:35 | |
| *** de_Varf has quit IRC | 20:35 | |
| *** sileht has quit IRC | 20:35 | |
| *** de_Varf has joined #openstack-telemetry | 20:35 | |
| *** swamireddy has quit IRC | 20:35 | |
| *** purplerbot has quit IRC | 20:35 | |
| *** vkmc has quit IRC | 20:36 | |
| *** homeski has quit IRC | 20:37 | |
| *** hughhalf has joined #openstack-telemetry | 20:39 | |
| *** sileht has joined #openstack-telemetry | 20:39 | |
| *** homeski has joined #openstack-telemetry | 20:40 | |
| *** joadavis has joined #openstack-telemetry | 20:41 | |
| *** swamireddy has joined #openstack-telemetry | 20:42 | |
| *** andymccr has quit IRC | 20:45 | |
| *** vkmc has joined #openstack-telemetry | 20:45 | |
| *** andymccr has joined #openstack-telemetry | 20:45 | |
| *** vkmc has quit IRC | 20:46 | |
| *** vkmc has joined #openstack-telemetry | 20:46 | |
| *** dave-mccowan has joined #openstack-telemetry | 20:55 | |
| *** dave-mcc_ has joined #openstack-telemetry | 20:59 | |
| *** dave-mccowan has quit IRC | 20:59 | |
| *** openstackgerrit has joined #openstack-telemetry | 21:07 | |
| openstackgerrit | Merged openstack/ceilometer master: Move delayed out of utils https://review.openstack.org/521101 | 21:07 |
| openstackgerrit | Merged openstack/ceilometer master: static resources not picked up https://review.openstack.org/527108 | 21:07 |
| openstackgerrit | Merged openstack/ceilometer master: drop base polling test separation https://review.openstack.org/527170 | 21:07 |
| openstackgerrit | gordon chung proposed openstack/ceilometer stable/pike: static resources not picked up https://review.openstack.org/527521 | 21:16 |
| sdaniel | Hi again, I think something is still missing. I re-created the alarms via heat (at now I have scale up and down alarms), but I anyhow set aodh,ceilometer and gnocchi, both of them will still in insufficient data state | 21:16 |
| sdaniel | The strange part, that at first I did not change anything, just recreated the heat stack and I waited for the configurated alarms,, but never happened. After that I tried to change the configuration, but I failed. | 21:17 |
| *** linkmark has quit IRC | 21:20 | |
| gordc | sdaniel: did you look at how this scenario is tested in gate? what you're describing is basically what the integration gate on every patch is testing. | 21:22 |
| *** andreykurilin_ has joined #openstack-telemetry | 21:22 | |
| sdaniel | ceilometer.conf: archive_policy = low (in gnocchi the granularity is 5min), pipeline.yaml: every source interval is 300 (5min), polling.yaml: 300, aodh.conf evaluation_interval is also 300, granularity in the alarm is 300 | 21:22 |
| *** jappleii__ has joined #openstack-telemetry | 21:23 | |
| sdaniel | gordc: I've never tried, but then I will do that at now | 21:23 |
| *** jappleii__ has quit IRC | 21:24 | |
| *** jappleii__ has joined #openstack-telemetry | 21:25 | |
| *** jappleii__ has quit IRC | 21:26 | |
| *** jappleii__ has joined #openstack-telemetry | 21:27 | |
| *** jappleii__ has quit IRC | 21:27 | |
| *** jappleii__ has joined #openstack-telemetry | 21:28 | |
| *** AlexeyAbashkin has joined #openstack-telemetry | 21:34 | |
| *** AlexeyAbashkin has quit IRC | 21:38 | |
| openstackgerrit | Merged openstack/ceilometer master: split partitioning polling tests https://review.openstack.org/527187 | 21:45 |
| *** AlexeyAbashkin has joined #openstack-telemetry | 21:57 | |
| *** rcernin has joined #openstack-telemetry | 21:58 | |
| *** AlexeyAbashkin has quit IRC | 22:02 | |
| sdaniel | Unfortunatelly I could not spend enough time to try this gate tests, but somehow my alarms started work. | 22:10 |
| sdaniel | After 1 hour after the alarm creation | 22:11 |
| sdaniel | It's much more, than acceptable. If I change the heat template and I have to recreate the stack, then is it possible, that I have to wait 1 hour again, before I can test the alarms. Not sounds good. | 22:14 |
| gordc | sdaniel: uh so i have no idea what your alarm rule is but did you ever just manually query gnocchi to see if the rule is satisfied? | 22:17 |
| gordc | as you said it works, so either aodh is not evaluating it in a timely matter, or the rule was just never satisfied to begin with. | 22:18 |
| sdaniel | gordc: usually I did, but in the last hour, I did not. Actually the scaling down alarm became active, because the cpu_util was less then 10 (%) in the last 5 min (granularity 300) | 22:27 |
| *** yassine has joined #openstack-telemetry | 22:27 | |
| *** yassine is now known as Guest26528 | 22:28 | |
| sdaniel | gordc: Strange part: In gnocchi I can't find cpu_util metric for the one active vms which can be the part of the aggregation | 22:28 |
| gordc | sdaniel: did you set your archive policy to store the minimum number of datapoints for your alarm? i imagnie you should be able to look back at full timeseries | 22:46 |
| gordc | it's possible your user doesn't have right permission. try querying with admin? | 22:47 |
| *** jmlowe has quit IRC | 22:55 | |
| *** edmondsw has quit IRC | 23:02 | |
| *** edmondsw has joined #openstack-telemetry | 23:05 | |
| *** edmondsw has quit IRC | 23:10 | |
| sdaniel | gordc: I'm pretty sure, that I'm using the admin user and before that I always could monitor the alarm measures. (via gnocchi metric list | grep INTSANCE_ID and gnocchi measures show METRIC_ID) | 23:11 |
| *** jmlowe has joined #openstack-telemetry | 23:21 | |
| *** chandankumar has quit IRC | 23:22 | |
| *** chandankumar has joined #openstack-telemetry | 23:23 | |
| *** chandankumar has quit IRC | 23:29 | |
| *** gordc has quit IRC | 23:30 | |
| *** jmlowe has quit IRC | 23:33 | |
| *** chandankumar has joined #openstack-telemetry | 23:34 | |
| *** edmondsw has joined #openstack-telemetry | 23:44 | |
| *** yprokule has quit IRC | 23:44 | |
| *** edmondsw has quit IRC | 23:48 | |
| *** jmlowe has joined #openstack-telemetry | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!