*** rfolco has quit IRC | 00:42 | |
*** tovin07 has joined #openstack-performance | 00:54 | |
*** tovin07 has quit IRC | 00:57 | |
*** markvoelker has joined #openstack-performance | 01:05 | |
*** markvoelker has quit IRC | 01:09 | |
*** tovin07 has joined #openstack-performance | 01:16 | |
*** zz_dimtruck is now known as dimtruck | 01:42 | |
*** yujunz has joined #openstack-performance | 01:46 | |
*** markvoelker has joined #openstack-performance | 02:05 | |
*** markvoelker has quit IRC | 02:10 | |
*** dimtruck is now known as zz_dimtruck | 02:53 | |
*** markvoelker has joined #openstack-performance | 03:06 | |
*** markvoelker has quit IRC | 03:10 | |
*** tovin07 has quit IRC | 03:34 | |
*** tovin07 has joined #openstack-performance | 03:34 | |
*** yujunz has quit IRC | 04:03 | |
*** yujunz has joined #openstack-performance | 04:03 | |
*** masber has joined #openstack-performance | 04:27 | |
*** jkilpatr has quit IRC | 05:45 | |
*** jkilpatr has joined #openstack-performance | 05:49 | |
*** msimonin has joined #openstack-performance | 06:41 | |
*** msimonin1 has joined #openstack-performance | 06:44 | |
*** msimonin has quit IRC | 06:44 | |
*** msimonin1 has quit IRC | 07:10 | |
*** msimonin has joined #openstack-performance | 07:10 | |
*** msimonin has quit IRC | 07:14 | |
*** yujunz has quit IRC | 07:21 | |
*** yujunz has joined #openstack-performance | 07:22 | |
*** pcaruana has joined #openstack-performance | 07:41 | |
*** brault has joined #openstack-performance | 08:17 | |
*** msimonin has joined #openstack-performance | 08:26 | |
*** yujunz is now known as yujunz[away] | 08:33 | |
*** yujunz[away] is now known as yujunz | 08:36 | |
*** yujunz has quit IRC | 08:46 | |
*** yujunz has joined #openstack-performance | 08:47 | |
*** msimonin has quit IRC | 09:24 | |
*** msimonin has joined #openstack-performance | 09:29 | |
*** yujunz has quit IRC | 09:38 | |
*** yujunz has joined #openstack-performance | 09:39 | |
*** tovin07 has quit IRC | 09:59 | |
*** markvoelker has joined #openstack-performance | 10:10 | |
*** markvoelker has quit IRC | 10:15 | |
*** yujunz-zte has joined #openstack-performance | 10:16 | |
*** rmart04 has joined #openstack-performance | 10:17 | |
*** hieulq has quit IRC | 10:17 | |
*** yujunz has quit IRC | 10:18 | |
*** hieulq has joined #openstack-performance | 10:18 | |
*** yujunz-zte is now known as yujunz[away] | 10:24 | |
*** yujunz[away] is now known as yujunz-zte | 10:25 | |
*** yujunz-zte has quit IRC | 10:25 | |
*** klindgren_ has joined #openstack-performance | 10:29 | |
*** klindgren has quit IRC | 10:32 | |
*** yujunz has joined #openstack-performance | 10:56 | |
*** yujunz has quit IRC | 11:00 | |
*** yujunz has joined #openstack-performance | 11:00 | |
*** msimonin has quit IRC | 11:01 | |
*** msimonin has joined #openstack-performance | 11:03 | |
*** msimonin has quit IRC | 11:03 | |
*** yujunz has quit IRC | 11:06 | |
*** msimonin has joined #openstack-performance | 11:07 | |
*** markvoelker has joined #openstack-performance | 11:11 | |
*** markvoelker has quit IRC | 11:16 | |
*** yujunz has joined #openstack-performance | 11:21 | |
*** yujunz is now known as yujunz[away] | 11:25 | |
*** yujunz[away] is now known as yujunz | 11:34 | |
*** jkilpatr has quit IRC | 11:39 | |
*** rfolco has joined #openstack-performance | 11:40 | |
*** jkilpatr has joined #openstack-performance | 12:03 | |
*** markvoelker has joined #openstack-performance | 12:12 | |
*** yujunz has quit IRC | 12:12 | |
*** markvoelker has quit IRC | 12:16 | |
*** fyxim has quit IRC | 12:19 | |
*** serverascode has quit IRC | 12:19 | |
*** zz_dimtruck has quit IRC | 12:19 | |
*** dimtruckl has joined #openstack-performance | 12:19 | |
*** dimtruckl is now known as dimtruck | 12:19 | |
*** bvanhav has joined #openstack-performance | 12:21 | |
*** fyxim has joined #openstack-performance | 12:22 | |
*** serverascode has joined #openstack-performance | 12:24 | |
*** msimonin has quit IRC | 12:48 | |
*** msimonin has joined #openstack-performance | 12:50 | |
*** msimonin has quit IRC | 12:50 | |
*** msimonin has joined #openstack-performance | 12:52 | |
*** markvoelker has joined #openstack-performance | 13:12 | |
*** markvoelker has quit IRC | 13:17 | |
*** yujunz has joined #openstack-performance | 13:20 | |
*** yujunz is now known as yujunz[away] | 13:31 | |
*** yujunz[away] is now known as yujunz | 13:32 | |
*** yee37913 has joined #openstack-performance | 13:46 | |
*** akrzos has quit IRC | 13:46 | |
*** yee379 has quit IRC | 13:46 | |
*** akrzos has joined #openstack-performance | 13:46 | |
*** sai has quit IRC | 13:47 | |
*** sai has joined #openstack-performance | 13:48 | |
*** furlongm_ has quit IRC | 13:48 | |
*** furlongm has joined #openstack-performance | 13:48 | |
*** bvanhav_ has joined #openstack-performance | 14:02 | |
*** bvanhav has quit IRC | 14:03 | |
*** yujunz is now known as yujunz[away] | 14:11 | |
*** markvoelker has joined #openstack-performance | 14:13 | |
*** yujunz[away] has quit IRC | 14:15 | |
*** markvoelker has quit IRC | 14:18 | |
*** yujunz has joined #openstack-performance | 14:24 | |
*** yujunz is now known as yujunz[away] | 14:28 | |
*** yujunz[away] is now known as yujunz | 14:30 | |
*** msimonin has quit IRC | 14:31 | |
*** bvanhav_ is now known as bvanhav | 14:33 | |
*** yujunz is now known as yujunz[away] | 14:34 | |
*** yujunz[away] is now known as yujunz | 14:34 | |
*** msimonin has joined #openstack-performance | 14:36 | |
*** markvoelker has joined #openstack-performance | 14:38 | |
*** yujunz has quit IRC | 14:48 | |
*** rmart04_ has joined #openstack-performance | 15:06 | |
*** rmart04 has quit IRC | 15:06 | |
*** rmart04_ is now known as rmart04 | 15:06 | |
*** rmart04 has quit IRC | 15:12 | |
*** rmart04 has joined #openstack-performance | 15:17 | |
*** med_` is now known as medberry | 15:28 | |
*** medberry is now known as med_ | 15:28 | |
*** med_ is now known as Guest46232 | 15:29 | |
*** Guest46232 is now known as medberry | 15:29 | |
*** medberry has joined #openstack-performance | 15:29 | |
*** tovin07 has joined #openstack-performance | 15:29 | |
DinaBelova | #startmeeting Performance Team | 15:30 |
---|---|---|
openstack | Meeting started Tue Jan 3 15:30:01 2017 UTC and is due to finish in 60 minutes. The chair is DinaBelova. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:30 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:30 |
openstack | The meeting name has been set to 'performance_team' | 15:30 |
DinaBelova | hello folks! | 15:30 |
DinaBelova | let's see who has survived after holidays :D | 15:30 |
tovin07 | hello :D | 15:30 |
DinaBelova | akrzos tovin07 msimonin o/ | 15:30 |
*** spn has joined #openstack-performance | 15:30 | |
akrzos | DinaBelova: hello | 15:31 |
msimonin | Hello | 15:31 |
spn | o/ | 15:31 |
DinaBelova | wow, we have quorum :D | 15:31 |
spn | Happy new year to all :) | 15:31 |
*** rcherrueau has joined #openstack-performance | 15:32 | |
DinaBelova | yeah, first of all Happy New Year to all of you folks :) I hope holidays were as merry as they should :) | 15:32 |
DinaBelova | and it looks like we an start our first 2017 brand new meeting :) | 15:32 |
DinaBelova | #topic Action Items | 15:32 |
DinaBelova | last time we only had one action item on myself | 15:33 |
DinaBelova | regarding creating an etherpad to start collecting PGT agenda | 15:33 |
DinaBelova | here it is | 15:33 |
DinaBelova | #link https://etherpad.openstack.org/p/ptg-performance-team | 15:33 |
DinaBelova | @akrzos @msimonin ^^ | 15:33 |
DinaBelova | let's have two weeks or so to collect ideas | 15:34 |
DinaBelova | #info let's use https://etherpad.openstack.org/p/ptg-performance-team to collect ideas to discuss on PTG | 15:34 |
spn | yup | 15:34 |
DinaBelova | #info let's have two weeks timeframe to prepare it | 15:35 |
tovin07 | (y) | 15:35 |
akrzos | *nod* | 15:35 |
DinaBelova | @msimonin do you have any news about Inria participance? are you guys going to attend in person? | 15:35 |
msimonin | Hum I don't think we'll go in person | 15:36 |
DinaBelova | msimonin ok, so we need to plan somehow your remote participance | 15:36 |
msimonin | yes if it's possible | 15:37 |
msimonin | technically speaking this would be great | 15:37 |
spn | is there a list to tell who all are attending in person? | 15:37 |
akrzos | can we use that etherpad to track | 15:37 |
DinaBelova | spn I and andreykurilin (Rally PTL) | 15:37 |
DinaBelova | akrzos sure | 15:37 |
msimonin | +1 to track on the etherpad | 15:37 |
spn | I am attending in person too | 15:37 |
spn | +1 to etherpad. I will update it | 15:38 |
DinaBelova | ok, cool | 15:39 |
DinaBelova | I've added who's going to attend from mirantis side | 15:39 |
akrzos | We have budget for it. just not sure if who is going just yet | 15:40 |
DinaBelova | akrzos cool | 15:40 |
DinaBelova | please update the etherpad once you'll know for sure | 15:40 |
DinaBelova | :) | 15:40 |
akrzos | I'll try and confirm before End of today | 15:40 |
DinaBelova | akrzos ack | 15:40 |
DinaBelova | so it looks like we may proceed to researches and updates | 15:41 |
DinaBelova | #topic Current progress on the planned tests | 15:41 |
DinaBelova | msimonin any updates from you sir? (I do not think we all hav something sagnificant to talk about as it ere holidays, but still) | 15:42 |
msimonin | Yes :) | 15:42 |
msimonin | Holliday was productive for other things than current actions :) | 15:42 |
DinaBelova | ** significant, sorry for the typo | 15:42 |
DinaBelova | :D | 15:42 |
DinaBelova | ok, I believe akrzos you have pretty the same situation :D | 15:42 |
DinaBelova | from our side I have some items to share | 15:43 |
akrzos | pretty much just trying to get gnocchi on swift on the same hardware as ceph i did about two weeks ago | 15:43 |
akrzos | though already changes in gnocchi | 15:43 |
akrzos | 's defaults | 15:43 |
akrzos | (again) | 15:43 |
DinaBelova | oh, I got it | 15:43 |
rook | DinaBelova et all any more feedback on #link https://review.openstack.org/#/c/412554/ | 15:44 |
DinaBelova | so waiting for the some updates next week I guess :) | 15:44 |
DinaBelova | rook I see, not more reviews there | 15:45 |
DinaBelova | lemme just merge it | 15:45 |
rook | yup | 15:45 |
rook | i want to post the results | 15:45 |
DinaBelova | as I feel pretty confident about it | 15:45 |
DinaBelova | cool, lemme click merge button | 15:45 |
rook | thx | 15:45 |
DinaBelova | rook it should land in few moments | 15:45 |
DinaBelova | from our side: several documents have been published on review: https://review.openstack.org/#/q/project:openstack/performance-docs+status:open | 15:46 |
DinaBelova | I guess one of the most interesting parts for you folks will be monitoring methodology | 15:46 |
DinaBelova | akrzos msimonin https://review.openstack.org/#/c/415563/ | 15:46 |
rook | oh fun, prometheus | 15:47 |
DinaBelova | please review, we're going to continue this effort this year to improve it, so some feedback it welcome :D | 15:47 |
DinaBelova | rook yeah :D | 15:47 |
msimonin | DinaBelova: ack | 15:47 |
akrzos | interesting | 15:48 |
msimonin | I see Heka for log collection | 15:48 |
DinaBelova | msimonin true | 15:48 |
msimonin | Kolla is dropping Heka probably in favour of fluentd | 15:48 |
tovin07 | Heka is now deprecated in some other projects as I see | 15:49 |
msimonin | yes | 15:49 |
tovin07 | Yup, Kolla | 15:49 |
akrzos | DinaBelova: I'll review and provide feedback though i don't have experience with promethous, definitely interested in it vs graphite or gnocchi or any other monitoring solution :) | 15:49 |
DinaBelova | akrzos ack, thank you sir :) | 15:49 |
*** rmart04 has quit IRC | 15:49 | |
tovin07 | Kolla plans to move to Fluentd | 15:49 |
DinaBelova | msimonin tovin07 well, that's all matter of just what o choose :) | 15:49 |
DinaBelova | lemme ask team go through this option as well :) | 15:49 |
DinaBelova | thanks for letting know | 15:50 |
msimonin | yes it was just to give the information | 15:50 |
DinaBelova | #action DinaBelova discuss Fluentd option for logs collecting in our monitoring solution | 15:50 |
DinaBelova | thank you folks for the info :) | 15:50 |
openstackgerrit | Merged openstack/performance-docs: Performance of OpenStack API Workers test plan https://review.openstack.org/412554 | 15:51 |
rook | interesting... | 15:51 |
rook | DinaBelova: do you guys have scale/perf data on these solutions? | 15:51 |
DinaBelova | rook we have run this type of monitoring for 900 nodes environment | 15:52 |
rook | hm ok cool, what are you collecting? | 15:52 |
rook | all metrics? or a subset | 15:52 |
DinaBelova | all of them :) | 15:52 |
DinaBelova | in that caae it was 13,5 million time series were collected | 15:52 |
rook | per second? | 15:52 |
DinaBelova | and we needed to have two prometheus instances to survive this load | 15:53 |
rook | hm ok | 15:53 |
rook | cool!! | 15:53 |
DinaBelova | rook not per second, but at all in Prometheus "list" of what needs to be collected | 15:53 |
DinaBelova | although prometheus is first of all monitoring and alerting tool | 15:53 |
*** rmart04 has joined #openstack-performance | 15:53 | |
*** hieulq_ has joined #openstack-performance | 15:54 | |
DinaBelova | and that means that there is high data retention being used by us | 15:54 |
akrzos | so promethues is not just time-series data, but also collecting logs? | 15:54 |
akrzos | or receiving logs from fluentd* | 15:54 |
DinaBelova | as if data was stored there for a long time, it became less responsive | 15:54 |
*** rmart04 has quit IRC | 15:54 | |
DinaBelova | akrzos moniotirng only, we used elastic search for the logs in most common way. weka was used to parse some of the data from it and push as measurements to prometheus | 15:55 |
DinaBelova | like Kubernetes API response time | 15:55 |
DinaBelova | the only way you can gather this metric - calculate it from logs | 15:55 |
akrzos | oh so some of the performance metrics from services is emitted only into the logs thus using the log collection component to pull the performance data and graph in time-series, thats very cool | 15:56 |
DinaBelova | akrzos indeed | 15:56 |
akrzos | thought I'm an advocate for the performance data to be exposed outside logs (to begin with) | 15:56 |
akrzos | though* | 15:56 |
DinaBelova | well, I'll agree with you personally, but we were really interested in k8s API response time :D | 15:57 |
DinaBelova | so we had to find a way to collect it | 15:57 |
akrzos | gotta do what you gotta do | 15:57 |
DinaBelova | we plan to continue this effort in new year - at very first we need to configure some external time series DB to collect all this data for longer time for post-experiments researches and calculations | 15:58 |
DinaBelova | like Cassandra or OpenTSDB | 15:58 |
DinaBelova | as right now we use pure promethues, and it's not really good in storing data for a ong time | 15:59 |
DinaBelova | long* | 15:59 |
akrzos | same problem with graphite | 15:59 |
DinaBelova | akrzos yeah | 15:59 |
*** rmart04_ has joined #openstack-performance | 15:59 | |
DinaBelova | we had issues like "oh, let's take a look on a data we had a month ago, oh sh*t no this data anymore" | 15:59 |
DinaBelova | so I really would like not having this issue in 2017 :D | 16:00 |
akrzos | yeah or downsampling or what was done to "aggregation" of samples | 16:00 |
akrzos | samples/measurements | 16:00 |
spn | what is the backend for promethues? | 16:01 |
akrzos | grafana can even "change" what the measurements look likes based on the number of pixels you have available to display :O | 16:01 |
* akrzos assumes your using grafana for the visualization portion | 16:01 | |
DinaBelova | spn prometheus has its own prometheus db (not sure what technology are they using under the hood), but if you want to have this data persistent - use some persistent DB prometheus can work with - it might be cassandra, opentsdb, influx | 16:02 |
DinaBelova | akrzos true | 16:02 |
spn | DinaBelova: ok cool | 16:02 |
DinaBelova | so grafana is sometimes a challenge as well, that's true :D | 16:02 |
DinaBelova | anyway, so folks I'm kindly asking to review it | 16:03 |
spn | akrzos: can we export the visualization portion of grafana so that it can be imported on a newer grafana elsewhere? | 16:03 |
akrzos | spn: should be able to export the json and then push it into another grafana via the api | 16:04 |
akrzos | i haven't tried the latest grafana to be honest | 16:04 |
DinaBelova | my team is going to be back around Jan 9th (Russian winder holidays are after the New year for about a week) so I really hope they'll have the feedback from you :) | 16:04 |
DinaBelova | ok, so it looks like we may jump to open discussions | 16:05 |
DinaBelova | #topic Open Discussion | 16:06 |
DinaBelova | anything else to share folks? | 16:06 |
spn | can we discuss about spec in our face to face? | 16:06 |
spn | I am using spec @ Dell for openstack | 16:06 |
DinaBelova | I believe we can | 16:06 |
DinaBelova | spn please propose this item to the list of what to discuss | 16:07 |
spn | ok sure | 16:07 |
DinaBelova | ok, anything else folks? | 16:08 |
msimonin | Yep | 16:08 |
msimonin | From Inria side | 16:08 |
DinaBelova | sure, please go ahead :) | 16:09 |
msimonin | Among other things we'll use osprofiler | 16:09 |
msimonin | more precisely some interns will use it | 16:09 |
msimonin | ;) | 16:09 |
DinaBelova | yay :) | 16:09 |
DinaBelova | I'm glad to read this | 16:09 |
tovin07 | That’s a good new | 16:10 |
msimonin | I may be wrong but I thing there is still a review for its intergration in nova | 16:10 |
DinaBelova | msimonin that's right | 16:10 |
msimonin | DinaBelova: ack | 16:10 |
DinaBelova | although right now it's tracked by our (Mirnatis) Nova team - they are really interesting in landing it | 16:10 |
msimonin | ok :) | 16:10 |
DinaBelova | this change is up to date in fact | 16:11 |
tovin07 | Not just Mirantis :)) | 16:11 |
DinaBelova | and can be used | 16:11 |
DinaBelova | tovin07 yes, you're right ;) | 16:11 |
msimonin | ok good to know | 16:11 |
DinaBelova | msimonin please keep me updated if any issues will occur, let's fix them :) | 16:12 |
msimonin | Thanks ! | 16:12 |
*** rama_y has joined #openstack-performance | 16:12 | |
*** rama_y_ has joined #openstack-performance | 16:12 | |
*** rama_y_ has quit IRC | 16:12 | |
DinaBelova | msimonin anything else to share? | 16:12 |
msimonin | I think that's all for today | 16:13 |
DinaBelova | yeah, thank you folks! | 16:13 |
DinaBelova | have a nice 2017 :) | 16:13 |
DinaBelova | #endmeeting | 16:13 |
openstack | Meeting ended Tue Jan 3 16:13:44 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:13 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/performance_team/2017/performance_team.2017-01-03-15.30.html | 16:13 |
akrzos | Thanks, you too! | 16:13 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/performance_team/2017/performance_team.2017-01-03-15.30.txt | 16:13 |
openstack | Log: http://eavesdrop.openstack.org/meetings/performance_team/2017/performance_team.2017-01-03-15.30.log.html | 16:13 |
msimonin | you too, thx | 16:13 |
tovin07 | Thanks! :D | 16:14 |
spn | bye all | 16:14 |
*** rmart04_ has quit IRC | 16:23 | |
*** bvanhav has quit IRC | 16:39 | |
*** klindgren_ has quit IRC | 16:40 | |
*** bvanhav has joined #openstack-performance | 16:40 | |
*** tovin07 has quit IRC | 16:42 | |
*** klindgren has joined #openstack-performance | 16:46 | |
*** rama_y has quit IRC | 16:46 | |
*** medberry is now known as med_ | 17:14 | |
*** msimonin has quit IRC | 17:35 | |
*** rcherrueau has quit IRC | 17:37 | |
*** bvanhav_ has joined #openstack-performance | 17:57 | |
*** pcaruana has quit IRC | 17:58 | |
*** bvanhav has quit IRC | 17:58 | |
*** hieulq_ has quit IRC | 18:33 | |
*** hieulq_ has joined #openstack-performance | 18:34 | |
*** hieulq_ has quit IRC | 18:34 | |
*** rama_y has joined #openstack-performance | 18:44 | |
*** catintheroof has quit IRC | 19:33 | |
*** catintheroof has joined #openstack-performance | 19:34 | |
*** serverascode has quit IRC | 19:35 | |
*** dimtruck has quit IRC | 19:35 | |
*** dimtruck_ has joined #openstack-performance | 19:36 | |
*** dimtruck_ is now known as dimtruck | 19:36 | |
*** harlowja has joined #openstack-performance | 19:38 | |
*** catintheroof has quit IRC | 19:38 | |
*** rmart04 has joined #openstack-performance | 19:39 | |
*** jkilpatr has quit IRC | 19:42 | |
*** yee37913 has quit IRC | 19:48 | |
*** yee379 has joined #openstack-performance | 19:49 | |
*** rmart04 has quit IRC | 19:50 | |
*** serverascode has joined #openstack-performance | 19:51 | |
*** jkilpatr has joined #openstack-performance | 19:55 | |
*** msimonin has joined #openstack-performance | 19:59 | |
*** openstackgerrit has quit IRC | 20:03 | |
*** dimtruck is now known as zz_dimtruck | 20:22 | |
*** zz_dimtruck is now known as dimtruck | 20:22 | |
*** dimtruck is now known as zz_dimtruck | 20:31 | |
*** bvanhav_ has quit IRC | 20:39 | |
*** zz_dimtruck is now known as dimtruck | 20:47 | |
*** rfolco_ has joined #openstack-performance | 21:13 | |
*** rfolco has quit IRC | 21:14 | |
*** jkilpatr has quit IRC | 21:29 | |
*** rfolco_ has quit IRC | 21:36 | |
*** msimonin1 has joined #openstack-performance | 21:53 | |
*** msimonin has quit IRC | 21:56 | |
*** jkilpatr has joined #openstack-performance | 22:05 | |
*** openstack has joined #openstack-performance | 23:15 | |
*** msimonin1 has quit IRC | 23:41 | |
*** msimonin has joined #openstack-performance | 23:41 | |
*** msimonin has quit IRC | 23:41 | |
*** msimonin has joined #openstack-performance | 23:41 | |
*** msimonin has quit IRC | 23:42 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!