| *** JamesBenson has joined #openstack-meeting-4 | 00:53 | |
| *** JamesBenson has quit IRC | 00:55 | |
| *** hongbin has joined #openstack-meeting-4 | 01:03 | |
| *** igordc has quit IRC | 01:08 | |
| *** macz has quit IRC | 01:36 | |
| *** zhipeng[m] has quit IRC | 02:18 | |
| *** zhipeng[m] has joined #openstack-meeting-4 | 02:27 | |
| *** roman_g has quit IRC | 02:33 | |
| *** persia has quit IRC | 02:50 | |
| *** mgkwill has quit IRC | 02:50 | |
| *** persia has joined #openstack-meeting-4 | 02:56 | |
| *** mgkwill has joined #openstack-meeting-4 | 02:56 | |
| *** radeks has quit IRC | 03:00 | |
| *** persia has quit IRC | 03:18 | |
| *** mgkwill has quit IRC | 03:18 | |
| *** psachin has joined #openstack-meeting-4 | 03:22 | |
| *** persia has joined #openstack-meeting-4 | 03:24 | |
| *** mgkwill has joined #openstack-meeting-4 | 03:24 | |
| *** rmcallis has quit IRC | 03:59 | |
| *** hongbin has quit IRC | 04:01 | |
| *** hongbin has joined #openstack-meeting-4 | 04:08 | |
| *** hongbin has quit IRC | 04:10 | |
| *** macz has joined #openstack-meeting-4 | 04:28 | |
| *** pmesserli has quit IRC | 04:32 | |
| *** macz has quit IRC | 04:33 | |
| *** k_mouza has joined #openstack-meeting-4 | 04:45 | |
| *** k_mouza has quit IRC | 04:49 | |
| *** radeks has joined #openstack-meeting-4 | 05:01 | |
| *** radeks has quit IRC | 05:03 | |
| *** radeks has joined #openstack-meeting-4 | 05:05 | |
| *** pcaruana has joined #openstack-meeting-4 | 05:16 | |
| *** Luzi has joined #openstack-meeting-4 | 05:16 | |
| *** gcheresh has joined #openstack-meeting-4 | 05:23 | |
| *** pcaruana has quit IRC | 05:29 | |
| *** gcheresh has quit IRC | 05:45 | |
| *** spsurya has joined #openstack-meeting-4 | 05:55 | |
| *** diablo_rojo has joined #openstack-meeting-4 | 06:04 | |
| *** slaweq has joined #openstack-meeting-4 | 06:26 | |
| *** gcheresh has joined #openstack-meeting-4 | 06:34 | |
| *** gcheresh has quit IRC | 06:44 | |
| *** diablo_rojo has quit IRC | 07:10 | |
| *** diablo_rojo has joined #openstack-meeting-4 | 07:20 | |
| *** trident has quit IRC | 07:22 | |
| *** diablo_rojo has quit IRC | 07:27 | |
| *** trident has joined #openstack-meeting-4 | 07:31 | |
| *** ralonsoh has joined #openstack-meeting-4 | 07:33 | |
| *** trident has quit IRC | 07:36 | |
| *** slaweq has quit IRC | 07:43 | |
| *** trident has joined #openstack-meeting-4 | 07:46 | |
| *** gcheresh has joined #openstack-meeting-4 | 07:47 | |
| *** slaweq has joined #openstack-meeting-4 | 07:52 | |
| *** gcheresh has quit IRC | 08:03 | |
| *** lpetrut has joined #openstack-meeting-4 | 08:07 | |
| *** lpetrut has quit IRC | 08:08 | |
| *** k_mouza has joined #openstack-meeting-4 | 08:19 | |
| *** igordc has joined #openstack-meeting-4 | 08:20 | |
| *** igordc has quit IRC | 08:28 | |
| *** bobmel has joined #openstack-meeting-4 | 08:38 | |
| *** e0ne has joined #openstack-meeting-4 | 08:41 | |
| *** slaweq has quit IRC | 08:52 | |
| *** slaweq has joined #openstack-meeting-4 | 09:10 | |
| *** pcaruana has joined #openstack-meeting-4 | 09:19 | |
| *** roman_g has joined #openstack-meeting-4 | 09:30 | |
| *** k_mouza has quit IRC | 09:38 | |
| *** k_mouza has joined #openstack-meeting-4 | 09:56 | |
| *** pcaruana has quit IRC | 10:07 | |
| *** Luzi has quit IRC | 10:13 | |
| *** k_mouza has quit IRC | 10:13 | |
| *** k_mouza has joined #openstack-meeting-4 | 10:14 | |
| *** Luzi has joined #openstack-meeting-4 | 10:29 | |
| *** pcaruana has joined #openstack-meeting-4 | 10:55 | |
| *** dave-mccowan has joined #openstack-meeting-4 | 12:25 | |
| *** pcaruana has quit IRC | 12:27 | |
| *** openstack has joined #openstack-meeting-4 | 12:29 | |
| *** ChanServ sets mode: +o openstack | 12:29 | |
| *** macz has joined #openstack-meeting-4 | 12:31 | |
| *** macz has quit IRC | 12:36 | |
| *** rihabb has quit IRC | 12:47 | |
| *** fdegir has quit IRC | 12:47 | |
| *** georgk has quit IRC | 12:47 | |
| *** rihabb has joined #openstack-meeting-4 | 12:48 | |
| *** georgk has joined #openstack-meeting-4 | 12:48 | |
| *** fdegir has joined #openstack-meeting-4 | 12:48 | |
| *** bobmel has quit IRC | 12:52 | |
| *** bobmel has joined #openstack-meeting-4 | 12:53 | |
| *** bobmel has quit IRC | 12:55 | |
| *** bobmel has joined #openstack-meeting-4 | 12:56 | |
| *** bobmel has quit IRC | 12:57 | |
| *** bh526r has joined #openstack-meeting-4 | 12:59 | |
| *** pcaruana has joined #openstack-meeting-4 | 12:59 | |
| *** bobmel has joined #openstack-meeting-4 | 13:00 | |
| *** abhishekk has joined #openstack-meeting-4 | 13:07 | |
| *** pmesserli has joined #openstack-meeting-4 | 13:10 | |
| *** yamamoto has joined #openstack-meeting-4 | 13:20 | |
| *** belmoreira has joined #openstack-meeting-4 | 13:23 | |
| *** pcaruana has quit IRC | 13:28 | |
| *** macz has joined #openstack-meeting-4 | 13:38 | |
| *** Luzi has quit IRC | 13:38 | |
| *** psachin has quit IRC | 13:43 | |
| *** macz has quit IRC | 13:43 | |
| *** wuchunyang has joined #openstack-meeting-4 | 13:51 | |
| *** pcaruana has joined #openstack-meeting-4 | 13:59 | |
| *** michael-beaver has joined #openstack-meeting-4 | 14:00 | |
| *** JamesBenson has joined #openstack-meeting-4 | 14:09 | |
| *** wuchunyang has quit IRC | 14:10 | |
| *** wuchunyang has joined #openstack-meeting-4 | 14:12 | |
| *** stevthedev has joined #openstack-meeting-4 | 14:46 | |
| *** wuchunyang has quit IRC | 14:53 | |
| *** pcaruana has quit IRC | 14:55 | |
| *** hemanth_n has joined #openstack-meeting-4 | 15:00 | |
| portdirect | #startmeeting openstack-helm | 15:00 |
|---|---|---|
| openstack | Meeting started Tue Sep 17 15:00:24 2019 UTC and is due to finish in 60 minutes. The chair is portdirect. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: openstack-helm)" | 15:00 | |
| openstack | The meeting name has been set to 'openstack_helm' | 15:00 |
| portdirect | sorry im running a bit late this morning, i'll get an etherpad up now | 15:00 |
| portdirect | https://etherpad.openstack.org/p/openstack-helm-meeting-2019-09-17 | 15:00 |
| lamt | o/ | 15:02 |
| stevthedev | \o | 15:02 |
| *** gagehugo has joined #openstack-meeting-4 | 15:02 | |
| itxaka | \o/ | 15:03 |
| rihabb | o/ | 15:03 |
| mattmceuen | o/ | 15:04 |
| portdirect | #topic topics | 15:06 |
| *** openstack changes topic to "topics (Meeting topic: openstack-helm)" | 15:06 | |
| portdirect | anything that we should be discussing this week? | 15:06 |
| srwilkers | o/ | 15:08 |
| itxaka | spiderman out of the MCU? Good/bad/neutral, discuss. | 15:08 |
| stevthedev | At some point I would like to discuss more what we have in mind re: using nagios upstream gates. I know srwiklers and I briefly touched on it the other day | 15:08 |
| itxaka | it migth be a bit offtopic though | 15:08 |
| itxaka | oh good, real discussion items :D | 15:09 |
| *** k_mouza has quit IRC | 15:10 | |
| *** k_mouza_ has joined #openstack-meeting-4 | 15:10 | |
| srwilkers | spiderman out of the MCU makes me sad | 15:11 |
| itxaka | nagios makes me sad | 15:12 |
| itxaka | :p | 15:12 |
| srwilkers | join the clun | 15:12 |
| srwilkers | club | 15:12 |
| portdirect | itxaka: i think nagios makes everyone sad | 15:12 |
| portdirect | so - what could we use instead of it? | 15:12 |
| portdirect | its been the tool we've used for the following use cases: | 15:12 |
| portdirect | * storage is down | 15:12 |
| portdirect | * integration with corp ticketing/slerting systems | 15:13 |
| portdirect | * simple to understand (from an ops perspective) | 15:13 |
| itxaka | isnt prometheus already in the osh-infra repo? | 15:13 |
| portdirect | it is, and most of what nagios reports on comes from prom | 15:14 |
| portdirect | (as i understand it) | 15:14 |
| stevthedev | I think that's correct | 15:14 |
| itxaka | Im out of touch with monitoring systems (THANK GOD), last thing I used was mmonit years ago | 15:14 |
| itxaka | now I live free of the monitoring overlords corrupting my life | 15:14 |
| srwilkers | >:( | 15:15 |
| srwilkers | the storage part is tricky - and our current approach with nagios comes with its own cost | 15:15 |
| srwilkers | that being without a way to persist nagios's log file, we can't realistically enable alert/notification history as nagios generates that history by tracking state changes in its log file | 15:16 |
| itxaka | no pvc? | 15:16 |
| srwilkers | well, that's the tricky part - if we use a PVC (ie, ceph), then nagios is subject to the same limitations that drove us to use it in the way we do in the first place | 15:17 |
| itxaka | to be fair this seems like an AT&T problem rather than a upstream problem, doesnt it? | 15:17 |
| * itxaka hides | 15:17 | |
| srwilkers | that being: when ceph is unhappy/misbehaving/dead, we can't really tell | 15:17 |
| srwilkers | i'd say it's a nagios problem in general if you're wanting to use it to provide insight into in-cluster storage it relies on, not just an AT&T problem | 15:18 |
| itxaka | how about using ses with rook? That should fix the misbehaving stuff by moving it to be a k8s problem lol | 15:19 |
| itxaka | at least for the misbehaving/dead point of view | 15:19 |
| portdirect | the fundimantal point remains | 15:19 |
| portdirect | we need something to alert that cluster storage is having issues | 15:20 |
| itxaka | cant you save the history to db? | 15:23 |
| itxaka | so you get history + replication? | 15:23 |
| itxaka | or you do offsite log replication every X minutes so its safe and secure? | 15:25 |
| itxaka | that would be local storage + remote sync of course, so you dont depend on the backend storage | 15:26 |
| itxaka | but of course that means sending data offsite which is not always possible | 15:26 |
| itxaka | sorry if this sounds stupid, missing context on the architecture makes it difficult to come with decent ideas :D | 15:30 |
| srwilkers | this is probably heading too far into the weeds, really. if i had my way, i'd just have nagios reporting alerts for things like downed hosts or ceph being unhealthy/bad, and use alertmanager for everything else. alertmanager supports smtp out of the box, just like nagios, and whatever system is listening should realistically be able to handle both with a little bit of effort | 15:30 |
| srwilkers | but monitoring and alarming are two things that are likely unique enterprise-to-enterprise, so discussing a one-size-fits-all here might be a bit pie in the sky | 15:31 |
| * srwilkers pokes portdirect | 15:33 | |
| * gagehugo hands srwilkers a rather large trout | 15:36 | |
| *** hemanth_n has quit IRC | 15:36 | |
| * portdirect falls of end of warf | 15:37 | |
| portdirect | sorry - got called into something | 15:37 |
| portdirect | ive got very little to add at this point to the convo | 15:37 |
| portdirect | im still trying to wrap my head round all the aspects atm | 15:38 |
| portdirect | anything else we should think about before we move onto the plea for reviews? | 15:38 |
| portdirect | #topic reviews | 15:42 |
| *** openstack changes topic to "reviews (Meeting topic: openstack-helm)" | 15:42 | |
| portdirect | please can we look at the following: | 15:42 |
| portdirect | https://review.opendev.org/#/c/672678/ | 15:42 |
| portdirect | https://review.opendev.org/#/c/670550/ | 15:42 |
| portdirect | itxaka: if you could help with https://review.opendev.org/#/c/672678/ it would be great | 15:43 |
| itxaka | oh, interesting | 15:43 |
| itxaka | will have a look | 15:43 |
| *** e0ne has quit IRC | 15:48 | |
| portdirect | ok folks | 15:48 |
| portdirect | catch you all in #openstack-helm | 15:49 |
| portdirect | #endmeeting | 15:49 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:49 | |
| openstack | Meeting ended Tue Sep 17 15:49:04 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:49 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_helm/2019/openstack_helm.2019-09-17-15.00.html | 15:49 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_helm/2019/openstack_helm.2019-09-17-15.00.txt | 15:49 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_helm/2019/openstack_helm.2019-09-17-15.00.log.html | 15:49 |
| *** gagehugo has left #openstack-meeting-4 | 15:53 | |
| *** k_mouza_ has quit IRC | 16:06 | |
| *** yamamoto has quit IRC | 16:14 | |
| *** k_mouza has joined #openstack-meeting-4 | 16:16 | |
| *** diablo_rojo has joined #openstack-meeting-4 | 16:48 | |
| *** k_mouza has quit IRC | 16:54 | |
| *** e0ne has joined #openstack-meeting-4 | 16:55 | |
| *** pcaruana has joined #openstack-meeting-4 | 16:55 | |
| *** diablo_rojo has quit IRC | 16:55 | |
| *** e0ne has quit IRC | 17:00 | |
| *** e0ne has joined #openstack-meeting-4 | 17:01 | |
| *** k_mouza has joined #openstack-meeting-4 | 17:03 | |
| *** k_mouza_ has joined #openstack-meeting-4 | 17:04 | |
| *** e0ne has quit IRC | 17:05 | |
| *** k_mouza has quit IRC | 17:07 | |
| *** k_mouza_ has quit IRC | 17:08 | |
| *** bh526r has quit IRC | 17:08 | |
| *** e0ne has joined #openstack-meeting-4 | 17:13 | |
| *** ralonsoh has quit IRC | 17:16 | |
| *** e0ne has quit IRC | 17:17 | |
| *** e0ne has joined #openstack-meeting-4 | 17:33 | |
| *** yamamoto has joined #openstack-meeting-4 | 17:40 | |
| *** michael-beaver has quit IRC | 17:40 | |
| *** e0ne has quit IRC | 17:43 | |
| *** yamamoto has quit IRC | 17:48 | |
| *** igordc has joined #openstack-meeting-4 | 18:16 | |
| *** e0ne has joined #openstack-meeting-4 | 18:59 | |
| *** k_mouza has joined #openstack-meeting-4 | 19:10 | |
| *** k_mouza has quit IRC | 19:14 | |
| *** e0ne has quit IRC | 19:38 | |
| *** spsurya has quit IRC | 19:48 | |
| *** e0ne has joined #openstack-meeting-4 | 19:50 | |
| *** radeks has quit IRC | 19:56 | |
| *** k_mouza has joined #openstack-meeting-4 | 19:57 | |
| *** k_mouza has quit IRC | 20:40 | |
| *** trident has quit IRC | 20:48 | |
| *** pcaruana has quit IRC | 20:58 | |
| *** trident has joined #openstack-meeting-4 | 21:00 | |
| *** stevthedev has quit IRC | 21:02 | |
| *** slaweq has quit IRC | 21:10 | |
| *** slaweq has joined #openstack-meeting-4 | 21:11 | |
| *** slaweq has quit IRC | 21:16 | |
| *** k_mouza has joined #openstack-meeting-4 | 21:17 | |
| *** e0ne has quit IRC | 21:19 | |
| *** abhishekk has quit IRC | 21:27 | |
| *** e0ne has joined #openstack-meeting-4 | 21:28 | |
| *** JamesBenson has quit IRC | 21:28 | |
| *** e0ne has quit IRC | 21:28 | |
| *** k_mouza has quit IRC | 21:29 | |
| *** slaweq has joined #openstack-meeting-4 | 21:32 | |
| *** slaweq has quit IRC | 21:36 | |
| *** macz has joined #openstack-meeting-4 | 22:40 | |
| *** macz has quit IRC | 22:47 | |
| *** slaweq has joined #openstack-meeting-4 | 23:11 | |
| *** slaweq has quit IRC | 23:15 | |
| *** igordc has quit IRC | 23:39 | |
| *** yamamoto has joined #openstack-meeting-4 | 23:46 | |
| *** JamesBenson has joined #openstack-meeting-4 | 23:47 | |
| *** yamamoto has quit IRC | 23:51 | |
| *** JamesBenson has quit IRC | 23:52 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!