*** dimtruck is now known as zz_dimtruck | 00:00 | |
*** itsuugo has joined #openstack-performance | 00:00 | |
*** AnarchyAo has quit IRC | 00:09 | |
*** itsuugo has quit IRC | 00:24 | |
*** itsuugo has joined #openstack-performance | 00:26 | |
*** itsuugo has quit IRC | 00:40 | |
*** itsuugo has joined #openstack-performance | 00:42 | |
*** itsuugo has quit IRC | 00:48 | |
*** itsuugo has joined #openstack-performance | 00:49 | |
*** claudiub has quit IRC | 00:57 | |
*** itsuugo has quit IRC | 00:59 | |
*** itsuugo has joined #openstack-performance | 01:00 | |
*** itsuugo has quit IRC | 01:25 | |
*** itsuugo has joined #openstack-performance | 01:25 | |
*** itsuugo has quit IRC | 01:34 | |
*** itsuugo has joined #openstack-performance | 01:36 | |
*** itsuugo has quit IRC | 01:41 | |
*** itsuugo has joined #openstack-performance | 01:42 | |
*** fredli has joined #openstack-performance | 01:48 | |
*** itsuugo has quit IRC | 01:50 | |
*** itsuugo has joined #openstack-performance | 01:51 | |
*** itsuugo has quit IRC | 01:58 | |
*** itsuugo has joined #openstack-performance | 02:00 | |
*** itsuugo has quit IRC | 02:09 | |
*** itsuugo has joined #openstack-performance | 02:10 | |
*** itsuugo has quit IRC | 02:15 | |
*** itsuugo has joined #openstack-performance | 02:17 | |
*** itsuugo has quit IRC | 02:21 | |
*** itsuugo has joined #openstack-performance | 02:22 | |
*** itsuugo has quit IRC | 02:27 | |
*** itsuugo has joined #openstack-performance | 02:28 | |
*** zz_dimtruck is now known as dimtruck | 02:28 | |
*** itsuugo has quit IRC | 02:34 | |
*** itsuugo has joined #openstack-performance | 02:37 | |
*** rfolco has quit IRC | 02:48 | |
*** itsuugo has quit IRC | 02:50 | |
*** itsuugo has joined #openstack-performance | 02:51 | |
*** itsuugo has quit IRC | 03:20 | |
*** itsuugo has joined #openstack-performance | 03:22 | |
*** itsuugo has quit IRC | 03:29 | |
*** markvoelker has quit IRC | 03:30 | |
*** itsuugo has joined #openstack-performance | 03:31 | |
*** rfolco has joined #openstack-performance | 03:33 | |
*** rfolco has quit IRC | 03:33 | |
*** itsuugo has quit IRC | 04:01 | |
*** itsuugo has joined #openstack-performance | 04:02 | |
*** itsuugo has quit IRC | 04:11 | |
*** itsuugo has joined #openstack-performance | 04:12 | |
*** itsuugo has quit IRC | 04:16 | |
*** itsuugo has joined #openstack-performance | 04:17 | |
*** itsuugo has quit IRC | 04:22 | |
*** itsuugo has joined #openstack-performance | 04:24 | |
*** dimtruck is now known as zz_dimtruck | 04:29 | |
*** itsuugo has quit IRC | 04:31 | |
*** itsuugo has joined #openstack-performance | 04:32 | |
*** itsuugo has quit IRC | 04:36 | |
*** itsuugo has joined #openstack-performance | 04:37 | |
*** fredli has quit IRC | 04:40 | |
*** itsuugo has quit IRC | 04:42 | |
*** itsuugo has joined #openstack-performance | 04:43 | |
*** msimonin has joined #openstack-performance | 04:46 | |
*** itsuugo has quit IRC | 04:48 | |
*** itsuugo has joined #openstack-performance | 04:49 | |
*** itsuugo has quit IRC | 04:53 | |
*** itsuugo has joined #openstack-performance | 04:55 | |
*** itsuugo has quit IRC | 05:06 | |
*** itsuugo has joined #openstack-performance | 05:06 | |
*** itsuugo has quit IRC | 05:11 | |
*** itsuugo has joined #openstack-performance | 05:12 | |
*** itsuugo has quit IRC | 05:17 | |
*** itsuugo has joined #openstack-performance | 05:17 | |
*** ilyashakhat_mobi has joined #openstack-performance | 05:19 | |
*** claudiub has joined #openstack-performance | 05:21 | |
*** itsuugo has quit IRC | 05:24 | |
*** msimonin has quit IRC | 05:25 | |
*** itsuugo has joined #openstack-performance | 05:25 | |
*** markvoelker has joined #openstack-performance | 05:30 | |
*** itsuugo has quit IRC | 05:30 | |
*** itsuugo has joined #openstack-performance | 05:31 | |
*** markvoelker has quit IRC | 05:35 | |
*** ilyashakhat_mobi has quit IRC | 05:36 | |
*** itsuugo has quit IRC | 05:36 | |
*** itsuugo has joined #openstack-performance | 05:36 | |
*** itsuugo has quit IRC | 05:44 | |
*** itsuugo has joined #openstack-performance | 05:46 | |
*** ilyashakhat_mobi has joined #openstack-performance | 05:46 | |
*** itsuugo has quit IRC | 05:54 | |
*** itsuugo has joined #openstack-performance | 05:54 | |
*** itsuugo has quit IRC | 05:59 | |
*** itsuugo has joined #openstack-performance | 06:00 | |
*** ilyashakhat_mobi has quit IRC | 06:06 | |
*** itsuugo has quit IRC | 06:12 | |
*** itsuugo has joined #openstack-performance | 06:13 | |
*** itsuugo has quit IRC | 06:18 | |
*** itsuugo has joined #openstack-performance | 06:19 | |
*** itsuugo has quit IRC | 06:24 | |
*** itsuugo has joined #openstack-performance | 06:25 | |
*** itsuugo has quit IRC | 06:36 | |
*** ilyashakhat_mobi has joined #openstack-performance | 06:36 | |
*** ilyashak_ has joined #openstack-performance | 06:37 | |
*** ilyashakhat_mobi has quit IRC | 06:37 | |
*** itsuugo has joined #openstack-performance | 06:37 | |
*** itsuugo has quit IRC | 06:49 | |
*** itsuugo has joined #openstack-performance | 06:50 | |
*** pcaruana has joined #openstack-performance | 07:02 | |
*** ilyashak_ has quit IRC | 07:05 | |
*** yarkot has quit IRC | 07:11 | |
*** msimonin has joined #openstack-performance | 07:15 | |
*** msimonin has quit IRC | 07:15 | |
*** markvoelker has joined #openstack-performance | 07:31 | |
*** markvoelker has quit IRC | 07:36 | |
*** itsuugo has quit IRC | 07:37 | |
*** itsuugo has joined #openstack-performance | 07:39 | |
*** itsuugo has quit IRC | 07:45 | |
*** itsuugo has joined #openstack-performance | 07:47 | |
*** openstackgerrit has quit IRC | 07:48 | |
*** openstackgerrit has joined #openstack-performance | 07:49 | |
*** itsuugo has quit IRC | 07:56 | |
*** itsuugo has joined #openstack-performance | 07:57 | |
*** itsuugo has quit IRC | 08:02 | |
*** itsuugo has joined #openstack-performance | 08:03 | |
*** ilyashakhat_mobi has joined #openstack-performance | 08:05 | |
*** ilyashakhat_mobi has quit IRC | 08:10 | |
*** itsuugo has quit IRC | 08:10 | |
*** itsuugo has joined #openstack-performance | 08:12 | |
*** lmiccini_ has joined #openstack-performance | 08:19 | |
*** cgross has quit IRC | 08:19 | |
*** lmiccini has quit IRC | 08:20 | |
*** cgross has joined #openstack-performance | 08:21 | |
*** lmiccini_ is now known as lmiccini | 08:25 | |
*** msimonin has joined #openstack-performance | 08:33 | |
*** msimonin has quit IRC | 08:34 | |
*** msimonin has joined #openstack-performance | 08:37 | |
*** msimonin has quit IRC | 08:39 | |
*** itsuugo has quit IRC | 08:53 | |
*** itsuugo has joined #openstack-performance | 08:54 | |
*** itsuugo has quit IRC | 08:59 | |
*** itsuugo has joined #openstack-performance | 09:00 | |
*** markvoelker has joined #openstack-performance | 09:25 | |
*** markvoelker has quit IRC | 09:29 | |
*** itsuugo has quit IRC | 09:45 | |
*** itsuugo has joined #openstack-performance | 09:47 | |
*** msimonin has joined #openstack-performance | 09:51 | |
*** ilyashakhat_mobi has joined #openstack-performance | 09:51 | |
*** ilyashakhat_mobi has quit IRC | 09:56 | |
*** msimonin has quit IRC | 09:59 | |
*** itsuugo has quit IRC | 10:06 | |
*** itsuugo has joined #openstack-performance | 10:08 | |
*** mikal has quit IRC | 10:10 | |
*** mikal has joined #openstack-performance | 10:12 | |
*** mikal has quit IRC | 10:14 | |
*** mikal has joined #openstack-performance | 10:16 | |
*** permalac has joined #openstack-performance | 10:17 | |
*** lmiccini has quit IRC | 10:25 | |
*** cgross has quit IRC | 10:25 | |
*** itsuugo has quit IRC | 10:43 | |
*** itsuugo has joined #openstack-performance | 10:44 | |
*** permalac has quit IRC | 10:51 | |
*** itsuugo has quit IRC | 10:58 | |
*** itsuugo has joined #openstack-performance | 10:59 | |
*** msimonin has joined #openstack-performance | 11:01 | |
*** msimonin has quit IRC | 11:08 | |
*** itsuugo has quit IRC | 11:09 | |
*** itsuugo has joined #openstack-performance | 11:09 | |
*** itsuugo has quit IRC | 11:22 | |
*** itsuugo has joined #openstack-performance | 11:23 | |
*** markvoelker has joined #openstack-performance | 11:25 | |
*** bvanhav has joined #openstack-performance | 11:28 | |
*** markvoelker has quit IRC | 11:30 | |
*** itsuugo has quit IRC | 11:48 | |
*** itsuugo has joined #openstack-performance | 11:49 | |
*** ilyashakhat_mobi has joined #openstack-performance | 11:53 | |
*** ilyashakhat_mobi has quit IRC | 11:57 | |
*** itsuugo has quit IRC | 11:59 | |
*** itsuugo has joined #openstack-performance | 12:00 | |
*** markvoelker has joined #openstack-performance | 12:11 | |
*** rfolco has joined #openstack-performance | 12:19 | |
*** msimonin has joined #openstack-performance | 12:33 | |
*** permalac has joined #openstack-performance | 12:33 | |
sai | ilyashakhat: ping | 12:41 |
---|---|---|
*** itsuugo has quit IRC | 12:42 | |
*** itsuugo has joined #openstack-performance | 12:43 | |
ilyashakhat | sai: hi~ | 12:46 |
*** msimonin has quit IRC | 12:48 | |
sai | ilyashakhat: hey, https://github.com/openstack/shaker/blob/master/doc/source/usage.rst states that for flent i could chose any of the tests from the list | 12:55 |
sai | but trying anything other than defaults like download, upload or bidrectional fails | 12:56 |
sai | 2016-09-12 20:07:58.175 768 DEBUG shaker.engine.messaging [-] Received request: {'finish': 1473725487.789398, 'stdout': u'', 'start': 1473725447.622127, 'agent_id': 'shaker_zdairm_master_0', 'stderr': '\ngzip: stdin: unexpected end of file\n', 'operation': 'reply'} __iter__ /home/stack/shaker-venv/lib/python2.7/site-packages/shaker/engine/messaging.py:39 | 12:56 |
sai | is what is see | 12:56 |
sai | trying to do tcp_4down | 12:56 |
sai | tcp with 4 threads. | 12:56 |
ilyashakhat | could you try to run the same command manually? | 13:01 |
sai | sure will try | 13:14 |
sai | ilyashakhat: another question is there a test class in the shaker that lets me do network testing with different IP packet sizes | 13:15 |
*** msimonin has joined #openstack-performance | 13:17 | |
ilyashakhat | iperf class accepts --datagram_size which is passed as --len parameter into iperf tool | 13:19 |
ilyashakhat | according to code this parameter sets packet size | 13:19 |
ilyashakhat | but for UDP only | 13:20 |
*** msimonin has quit IRC | 13:24 | |
ilyashakhat | sai, I'm looking at "flent --list-tests" -- there's no tcp_4down test | 13:24 |
ilyashakhat | it exists in master, but not released yet | 13:24 |
sai | ah ok, that was missing | 13:25 |
sai | yeh i just looked at where the docs point and that seemed to have a list of tests | 13:25 |
sai | thanks | 13:25 |
sai | so ilyashakhat i cant do different packet sizes for tcp correct? | 13:26 |
sai | are u doing any openstack network testing with varying packet sizes? | 13:26 |
sai | i have some network test results id like to push to upstream performance-docs | 13:26 |
ilyashakhat | sai, we do only udp with 64 bytes | 13:27 |
sai | and tcp is whatever flent/iperf comes with? | 13:27 |
sai | and what would that default to? | 13:27 |
sai | ilyashakhat: also i have some results with DVR in Newton Id like to push upstream, know if similar work has already been done, cause i see test results with dvr in the name, but nothing was mentioned abt dvr in the test plan/setup | 13:28 |
ilyashakhat | test plan is written to be common for all types of deployment, that's why it doesn't mention DVR | 13:35 |
ilyashakhat | but test results are for specific deployment | 13:35 |
ilyashakhat | e.g. http://docs.openstack.org/developer/performance-docs/test_results/tenant_networking/index.html | 13:35 |
ilyashakhat | please post your results to performance-doc repo, next to existing 200 nodes DVR+VXLAN | 13:36 |
ilyashakhat | > and tcp is whatever flent/iperf comes with? -- I suppose the default value set on VM interface is used -- we see the difference in numbers when OpenStack is deployed with jumbo frames | 13:37 |
*** zz_dimtruck is now known as dimtruck | 13:42 | |
*** ilyashakhat_mobi has joined #openstack-performance | 13:54 | |
*** ilyashakhat_mobi has quit IRC | 13:59 | |
*** msimonin has joined #openstack-performance | 14:06 | |
sai | ilyashakhat: thanks, but was wondering abt IP packet size for TCP, not MTU specifically because in some of my tests with uperf where i can set packet sizes, have been seeing significant throughput imporvement on large packets sizes | 14:16 |
sai | 16k and 64k | 14:16 |
sai | ilyashakhat: last question promise :) https://github.com/openstack/shaker/blob/master/doc/source/images/topology_l3_north_south.png | 14:19 |
sai | ^ is that the topology for network N-S tests u r doing/ | 14:19 |
sai | cause it turns out that it is covering two N-S tests essentially, VM to external and external to Vm again | 14:20 |
sai | or is there any different testing u do for N-S | 14:20 |
*** dimtruck is now known as zz_dimtruck | 14:24 | |
ilyashakhat | sai, yes, N-S is actually double pass | 14:32 |
sai | yeh double pass was the word i was looking for | 14:32 |
sai | :) | 14:32 |
ilyashakhat | https://github.com/openstack/shaker/tree/master/shaker/scenarios/openstack/external -- these are the true N-S | 14:33 |
ilyashakhat | but require an external host with the same tools as Shaker image contains | 14:33 |
ilyashakhat | http://pyshaker.readthedocs.io/en/latest/catalog.html#openstack-l3-north-south-to-external-target | 14:34 |
ilyashakhat | the trick is to pass the destination host address -- it is done via --matrix "{host: <address>}" | 14:35 |
sai | gotcha | 14:38 |
sai | and the host could be anything routable from the cloud right | 14:38 |
sai | i will install whatever tools shaker image on the external host and do i need to do anything else to the host | 14:39 |
sai | start netserver or.. | 14:39 |
*** ad_rien_ has joined #openstack-performance | 14:39 | |
ilyashakhat | sai, yep, you can follow the same script that image-builder does | 14:40 |
*** zz_dimtruck is now known as dimtruck | 14:41 | |
sai | ilyashakhat++ | 14:43 |
sai | oops no karma bot ;0 | 14:43 |
sai | ;) | 14:43 |
*** JorgeCardoso has joined #openstack-performance | 14:53 | |
*** itsuugo has quit IRC | 14:53 | |
*** itsuugo has joined #openstack-performance | 14:54 | |
*** aignatev has joined #openstack-performance | 15:08 | |
*** dmitryme has quit IRC | 15:13 | |
*** dmitryme has joined #openstack-performance | 15:15 | |
*** itsuugo has quit IRC | 15:23 | |
*** rohanion has joined #openstack-performance | 15:23 | |
*** itsuugo has joined #openstack-performance | 15:24 | |
*** AugieMena has joined #openstack-performance | 15:28 | |
DinaBelova | #startmeeting Performance Team | 15:30 |
openstack | Meeting started Tue Sep 13 15:30:02 2016 UTC and is due to finish in 60 minutes. The chair is DinaBelova. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:30 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:30 |
openstack | The meeting name has been set to 'performance_team' | 15:30 |
DinaBelova | hey folks o/ | 15:30 |
AugieMena | o/ | 15:30 |
ad_rien_ | o/ | 15:30 |
aignatev | o/ | 15:30 |
*** rcherrueau has joined #openstack-performance | 15:30 | |
DinaBelova | rohanion, rcherrueau o/ | 15:30 |
rcherrueau | Hi, | 15:30 |
msimonin | hello | 15:30 |
JorgeCardoso | o/ | 15:30 |
DinaBelova | JorgeCardoso nice to see you sir | 15:31 |
DinaBelova | ilyashakhat are you around today? :) | 15:31 |
JorgeCardoso | likewise :) | 15:31 |
DinaBelova | ok, so good evening / good morning :) | 15:31 |
DinaBelova | let's start with action items from last meeting | 15:31 |
DinaBelova | #topic Action Items | 15:31 |
DinaBelova | msimonin rcherrueau - one of them was on you folks | 15:32 |
DinaBelova | add information about what monitoring tools were used to the https://pad.inria.fr/p/FK18ZSyjFyLPITfE | 15:32 |
msimonin | yep sorry we are doing it right now | 15:32 |
DinaBelova | msimonin ack, lemme keep this action item | 15:32 |
rohanion | hey everyone! | 15:33 |
*** rohanion has left #openstack-performance | 15:33 | |
DinaBelova | #action msimonin rcherrueau add information about what monitoring tools were used to the https://pad.inria.fr/p/FK18ZSyjFyLPITfE | 15:33 |
*** rohanion has joined #openstack-performance | 15:33 | |
DinaBelova | rohanion o/ | 15:33 |
DinaBelova | rohanion second action item is about you | 15:33 |
DinaBelova | publish osprofiler config patcher | 15:33 |
DinaBelova | rohanion afaik you pushed it somewhere | 15:33 |
DinaBelova | may you please share? | 15:34 |
rohanion | yes | 15:34 |
rohanion | https://github.com/rohanion/osprofiler-cfg | 15:34 |
rohanion | here we go | 15:34 |
DinaBelova | #link https://github.com/rohanion/osprofiler-cfg | 15:34 |
rohanion | is the readme good enough or should I change it? | 15:34 |
DinaBelova | rohanion I'd propose to add info that this needs to be run on all OpenStack nodes | 15:35 |
DinaBelova | rohanion and mention that services need to be restrted separately | 15:35 |
DinaBelova | as this depends much on the deployment | 15:35 |
DinaBelova | rohanion what do you think? | 15:36 |
rohanion | I guess it's pretty obvious... but will do, thanks | 15:36 |
DinaBelova | rohanion it's obvious for you :) | 15:36 |
DinaBelova | rohanion thanks | 15:36 |
DinaBelova | that' all about our action items for today | 15:37 |
DinaBelova | #topic Current progress on the planned tests | 15:37 |
DinaBelova | okay msimonin ad_rien_ rcherrueau - the floor is yours | 15:37 |
ad_rien_ | thanks | 15:37 |
DinaBelova | I see some new details added to the etherpad | 15:37 |
ad_rien_ | actually we have lot of questions | 15:37 |
ad_rien_ | :-) | 15:37 |
DinaBelova | #link https://pad.inria.fr/p/FK18ZSyjFyLPITfE | 15:37 |
DinaBelova | ad_rien_ sure | 15:37 |
ad_rien_ | msimonin will start | 15:38 |
msimonin | so, | 15:38 |
msimonin | :) | 15:38 |
msimonin | first set of experiments : collect metric of an "idle" openstack with different number of compute | 15:39 |
msimonin | this one is done | 15:39 |
msimonin | we are analysing the results | 15:39 |
DinaBelova | msimonin may you please clarify what is :idle: here? | 15:39 |
msimonin | DinaBelova: sure | 15:39 |
*** Menthos has joined #openstack-performance | 15:39 | |
msimonin | For us idle means an openstack without any incoming requests | 15:40 |
msimonin | the goal is to measure the noise generated by openstack services | 15:40 |
msimonin | an maybe find some patterns | 15:40 |
DinaBelova | msimonin ack, gotcha | 15:40 |
msimonin | second set of experiments : collect metric of an "non-idle" openstack with different number of compute | 15:41 |
msimonin | basically during rally benchmarks | 15:41 |
DinaBelova | msimonin due to what I ee in the etherpad - some timeouts happen? | 15:42 |
msimonin | which line ? | 15:42 |
DinaBelova | 376 | 15:42 |
*** claudiub|2 has joined #openstack-performance | 15:42 | |
msimonin | yep right this has to be explained | 15:42 |
DinaBelova | msimonin is this happening for boot VM I suppose? | 15:43 |
msimonin | the fact is that with a bigger deployment (1000 compute) we got some timeout in the rally reports | 15:43 |
DinaBelova | msimonin was rally timed out waiting for server to become active? | 15:44 |
rcherrueau | DinaBelova: Here is an example of error we got 'Timed out waiting for a reply to message ID b0628f97f1f942c1962859a3c290a731' | 15:45 |
DinaBelova | rcherrueau oh, interesting | 15:45 |
ad_rien_ | Actually, we are working on these experiments now so we can dive into details I'm not sure whether it is the best time to discuss such points right now ;) Maybe we can just raise all our questions and see which ones need deeper investigations. | 15:45 |
*** claudiub has quit IRC | 15:46 | |
DinaBelova | ad_rien_ probably ye | 15:46 |
ad_rien_ | ok thanks | 15:46 |
DinaBelova | rcherrueau btw - where are you observing these logs? | 15:46 |
DinaBelova | the final quesiton :) | 15:46 |
ad_rien_ | :) | 15:46 |
rcherrueau | From the rally report | 15:46 |
DinaBelova | in rally? or in one of the services? | 15:46 |
DinaBelova | rcherrueau ack | 15:46 |
rcherrueau | Yes I have to dig into this and take a look at the logs of other services | 15:47 |
rcherrueau | maybe rabbitmq | 15:47 |
DinaBelova | ad_rien_ rcherrueau if you won't be able to find the root cause quickly, may you please send me rally logs / rally report? | 15:47 |
ad_rien_ | sure | 15:47 |
ad_rien_ | Can we switch to next questions ;) ? | 15:47 |
DinaBelova | I'd jump to our rally folks :) they have observed all types of isssues :) | 15:47 |
DinaBelova | ad_rien_ sure | 15:47 |
msimonin | DinaBelova: cool :) | 15:48 |
ad_rien_ | OK we observed another issue. If we do not redeploy our testbed between scenarios, we got weird behaviors | 15:48 |
ad_rien_ | For that point we need to better understand what does happen…. | 15:49 |
ad_rien_ | maybe you can just tell us if one your side you saw such issues ? | 15:49 |
ad_rien_ | We plan to launch 10 times the same scenario on a small deployment to see whether we got same results | 15:49 |
ad_rien_ | So DinaBelova others ? did you see such issue ? Maybe we should ask the rally team ? | 15:50 |
rohanion | folks, Dina's laptop froze to death, she's rebooting | 15:50 |
msimonin | lol | 15:50 |
rohanion | please wait for a couple of minutes | 15:50 |
ad_rien_ | sorry | 15:50 |
msimonin | she's already tired of our questions | 15:50 |
ad_rien_ | ;) | 15:51 |
ad_rien_ | meanwhile AugieMena may I ask you if you received our email regarding the IBM scheduling presentation ? | 15:52 |
DinaBelova | folks, I'm back, sorry, my laptop went crazy | 15:52 |
ad_rien_ | we are definitely interested by this work | 15:52 |
ad_rien_ | ok | 15:52 |
DinaBelova | ad_rien_ may you please repeat everything I missed? :) | 15:52 |
DinaBelova | the last msg I see is about second question | 15:53 |
AugieMena | ad_rien_ Yes, got the email. I believe Chris K replied to that | 15:53 |
ad_rien_ | We observed  another issue. If we do not redeploy our testbed between scenarios, we got weird behaviors | 15:53 |
ad_rien_ | For this point we need to better understand what does happen…. | 15:53 |
ad_rien_ | Maybe you can just tell us if one your side you saw such issues ? | 15:53 |
ad_rien_ | We plan to launch 10 times the same scenario on a small deployment to see whether we got same results | 15:53 |
ad_rien_ | So DinaBelova others ? did you see such issue ? Maybe we should ask the rally team ? | 15:53 |
ad_rien_ | s/one your side/on your side sorry for the typo | 15:54 |
DinaBelova | ad_rien_ ususally we do not observe some behavior changing - rally clean up usually is enough | 15:54 |
DinaBelova | I mean clean up done after every scenario | 15:54 |
ad_rien_ | we also did that (actually Rally is doing that :() | 15:55 |
ad_rien_ | ok we will confirm that for the next meeting | 15:55 |
DinaBelova | ad_rien_ - what kind of changes? andreykurilin - may you please try to help? | 15:55 |
DinaBelova | ad_rien_ ack | 15:55 |
ad_rien_ | increase in the memory of the DB | 15:55 |
andreykurilin | DinaBelova ad_rien_: hi hi | 15:55 |
ad_rien_ | Hi andreykurilin | 15:56 |
*** ilyashakhat_mobi has joined #openstack-performance | 15:56 | |
andreykurilin | ad_rien_ I'm rally core and I'm ready to help | 15:56 |
andreykurilin | ) | 15:56 |
ad_rien_ | thanks | 15:56 |
ad_rien_ | that's a good news | 15:56 |
ad_rien_ | Actually we would like to be able reproduce such weird behaviors | 15:57 |
DinaBelova | ad_rien_ what DB? if Nova - so lines with deleted VMs still will be there :) with deleted == true there | 15:57 |
msimonin | soft-delete ? | 15:57 |
ad_rien_ | so we can come back to you with a concrete example | 15:57 |
andreykurilin | ok | 15:57 |
DinaBelova | ad_rien_ sure | 15:57 |
DinaBelova | ad_rien_ anything else? | 15:57 |
msimonin | so the state of openstack isn't the same when running a second time a benchmark ? | 15:58 |
ad_rien_ | Since the DB is not on the same state, the question is whether there will be an impact on the performance we measured | 15:58 |
*** victorhe has joined #openstack-performance | 15:58 | |
ad_rien_ | Memcached is also not cleaned | 15:58 |
DinaBelova | msimonin ad_rien_ well, that's a complex system - if you'll run tests always on purely new env, you'll always observe warming up OpenStack - with all caches being not filled, etc. | 15:59 |
ad_rien_ | so I think we need time to identify all aspects and get back to andreykurilin | 15:59 |
andreykurilin | ad_rien_: feel free to ping me here or at #openstack-rally (there you can find more number of friendly rally cores) :) | 15:59 |
ad_rien_ | DinaBelova: yes that's why we would like to see whether we can ensure reproducibility criteria between experiments | 16:00 |
DinaBelova | so the ideal test case is to run every case twice (each pair on 100% clean env) and count only a second attempt | 16:00 |
ad_rien_ | andreykurilin: thanks | 16:00 |
DinaBelova | ad_rien_ yes, that's tricky | 16:00 |
ad_rien_ | Ok | 16:00 |
ad_rien_ | so the last question for today is related to the scheduling process on top of the fake driver | 16:01 |
*** ilyashakhat_mobi has quit IRC | 16:01 | |
DinaBelova | ad_rien_ sure | 16:01 |
ad_rien_ | actually the fake driver presents 1000 vcpu and a lot of memory | 16:01 |
ad_rien_ | we are wondering how 1000 VM instances are scheduled on top of a 1000 fake drivers | 16:01 |
ad_rien_ | Can all VMs be scheduled on the same fake driver ? | 16:02 |
ad_rien_ | What does prevent to get such a placement ? | 16:02 |
*** ilyashakhat_mobi has joined #openstack-performance | 16:02 | |
DinaBelova | ad_rien_ afaik the whole process is the same as for usual runs - filter scheduler uses filters to schedule servers to the compute nodes, some of the filters define if one node should be filled as a priority or all nodes should be filled in more or less same fasion (nova has info about resources already "eaten" on the each hypervisor) | 16:03 |
DinaBelova | ad_rien_ I guess you need to take a look on the scheduler filters used | 16:04 |
DinaBelova | and see what kind of configurations are used | 16:04 |
sai | DinaBelova: i have a few networking questions, let me know when i can go | 16:05 |
DinaBelova | sai sure | 16:05 |
ad_rien_ | Ok we will perform a small test to answer this question | 16:05 |
ad_rien_ | thanks DinaBelova this is ok from our side | 16:05 |
DinaBelova | sai we'll jump soon to the open discussions | 16:05 |
DinaBelova | ad_rien_ ack, thanks | 16:05 |
DinaBelova | please keep us updated | 16:05 |
DinaBelova | rohanion are you still around? ready for osprofiler? | 16:05 |
rohanion | always am! | 16:06 |
DinaBelova | #topic OSProfiler weekly update | 16:06 |
DinaBelova | rohanion please proceed | 16:06 |
rohanion | 5 sec.. | 16:07 |
rohanion | We're ready to merge the neutron patch https://review.openstack.org/#/c/342505/, waiting for CR from neutron core team | 16:07 |
rohanion | cinder https://review.openstack.org/#/c/315676/ - add one test and ready to merge too. | 16:08 |
DinaBelova | #link https://review.openstack.org/#/c/342505/ | 16:09 |
DinaBelova | #link https://review.openstack.org/#/c/315676/ | 16:09 |
DinaBelova | rohanion ack, thanks | 16:09 |
rohanion | it's not everything :) | 16:09 |
DinaBelova | it's just thanks :) you can proceed :D | 16:09 |
rohanion | glance https://review.openstack.org/#/c/316799/ - work in progress, debugging failed tests | 16:09 |
DinaBelova | #link https://review.openstack.org/#/c/316799/ | 16:10 |
rohanion | sahara https://review.openstack.org/#/c/344370/ - nothing, no active development. will ask sahara team for support | 16:10 |
rohanion | internal osprofiler stuff: | 16:10 |
DinaBelova | #link https://review.openstack.org/#/c/344370/ | 16:10 |
rohanion | elasticsearch https://review.openstack.org/#/c/340936/ - on review, almost ready to merge. will finish reviewing that tomorrow | 16:11 |
rohanion | redis driver https://review.openstack.org/#/c/364487/ - I had no time to review it, will work on that tomorrow as well. | 16:12 |
DinaBelova | rohanion ack | 16:12 |
rohanion | influxdb driver - no active development. if the performance team decides that we have to implement it asap, I'll code it in an hour. | 16:12 |
DinaBelova | rohanion :D | 16:12 |
DinaBelova | you'll be quick :D | 16:13 |
DinaBelova | anything else sir? | 16:13 |
rohanion | 1 hour writing - 1 week testing :) | 16:13 |
rohanion | no, that's everything regarding OSProfiler | 16:13 |
DinaBelova | rohanion thanks for extended update | 16:13 |
DinaBelova | #topic Open Discussion | 16:13 |
DinaBelova | sai please go ahead | 16:13 |
sai | sure | 16:13 |
sai | so DinaBelova was wondering what kind of networking tests you are running currently and I could update with some of the network perf work we are doing at red hat | 16:14 |
DinaBelova | sai so mostly we're running data plane tests using shaker | 16:14 |
sai | ok shaker is what we are using too | 16:15 |
DinaBelova | sai lemme share a test plan | 16:15 |
DinaBelova | #link http://docs.openstack.org/developer/performance-docs/test_plans/tenant_networking/plan.html | 16:15 |
DinaBelova | sai here it is ^^ | 16:15 |
sai | cool | 16:15 |
DinaBelova | and the related report http://docs.openstack.org/developer/performance-docs/test_results/tenant_networking/neutron_vxlan_dvr_200/index.html#tenant-networking-report-vxlan-dvr-200-nodes | 16:15 |
sai | any specific neutron features u r targetting? | 16:15 |
sai | we r working on DVR currently | 16:15 |
DinaBelova | sai for neutron features we have separated tests being run | 16:16 |
sai | and had some previous work looking at control plane performance tuning neutron workers | 16:16 |
DinaBelova | sai http://docs.openstack.org/developer/performance-docs/test_plans/hardware_features/index.html | 16:16 |
DinaBelova | as for DVR - we usually run with it, yes | 16:16 |
DinaBelova | sai some time ago we run both DVR and non-DVR topologies | 16:16 |
DinaBelova | right now mostly DVR (as requested by Mirantis) | 16:17 |
sai | cool, i have some of those results, i can share upstream and contribute to the repo | 16:17 |
sai | the comparison | 16:17 |
DinaBelova | sai this will be perfect | 16:17 |
DinaBelova | so please submit lab description here as well http://docs.openstack.org/developer/performance-docs/labs/index.html | 16:17 |
DinaBelova | sai ^^ | 16:17 |
DinaBelova | so we can compare the test bed as well | 16:17 |
sai | DinaBelova: what im really curious about is the tunings that u put into the network tests | 16:18 |
sai | threads of neteprf/iperf | 16:18 |
sai | and TCP packet sizes | 16:18 |
sai | or u run defaults | 16:18 |
DinaBelova | sai sorry I added a wrong link when was targeting the neutron features - here is right one http://docs.openstack.org/developer/performance-docs/test_plans/neutron_features/index.html | 16:18 |
DinaBelova | sai you can take a look here http://docs.openstack.org/developer/performance-docs/test_results/tenant_networking/neutron_vxlan_dvr_200/index.html#tenant-networking-report-vxlan-dvr-200-nodes - if you'll click to every scenario - e.g. http://docs.openstack.org/developer/performance-docs/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/index.html - you'll see full scenario | 16:19 |
sai | DinaBelova: because we are running uperf with different IP packet sizes( outside of shaker) and seeing better throughput at higher packet sizes | 16:19 |
sai | cool thanks DinaBelova | 16:20 |
ilyashakhat_mobi | sai: we ran with defaults, but our networking guys tried with different settings, mostly number of threads | 16:20 |
DinaBelova | sai np, you're really welcome | 16:20 |
sai | hopefully i will controbute to performance-docs | 16:20 |
*** permalac has quit IRC | 16:20 | |
sai | and do i need to have a test plan or just test-results with scenario will help?/ | 16:20 |
sai | ilyashakhat_mobi: ack | 16:20 |
ilyashakhat_mobi | sai: it would be interesting to run tests with the same parameters as you do (meaning packet size) | 16:20 |
ilyashakhat_mobi | yu can follow existing plan or update it | 16:21 |
ilyashakhat_mobi | it's not restricted :) | 16:21 |
DinaBelova | sai if your tests are a subset of http://docs.openstack.org/developer/performance-docs/test_plans/tenant_networking/plan.html (just with different params) you can jut push test results with other configs and explanations - if scenarios are different, you can add yours to the test plan - http://docs.openstack.org/developer/performance-docs/test_plans/tenant_networking/plan.html | 16:21 |
sai | DinaBelova: ilyashakhat_mobi https://github.com/openstack/browbeat/tree/master/rally/rally-plugins/nova-create-pbench-uperf | 16:22 |
DinaBelova | #link https://github.com/openstack/browbeat/tree/master/rally/rally-plugins/nova-create-pbench-uperf | 16:22 |
sai | that is the rally plugin we use combined with pbench(inhouse but opensourced) | 16:22 |
sai | kicks of uperf with varying packet sizes and threads | 16:22 |
sai | prints rally summary with throughput results as well | 16:23 |
sai | so interesting data plane perf through rally | 16:23 |
DinaBelova | sai ok, so the tool is different - so you can add new section to the test plan I believe | 16:23 |
DinaBelova | as it's still the same testing field (tenant networking) but really other type of tools used | 16:24 |
sai | DinaBelova: my test results are with shaker | 16:24 |
DinaBelova | sai ah | 16:24 |
DinaBelova | I got it | 16:24 |
sai | but i have some toher results too with the tool i mentioned | 16:24 |
sai | :) | 16:24 |
sai | i think thats all the network perf questions i have | 16:24 |
DinaBelova | sai :D ack :) so shaker stuff can be just published as test report - against your env with your configs, for browbeat stuff I'll propose to add one more section to the test plan | 16:25 |
DinaBelova | and publish results regarding it | 16:25 |
DinaBelova | sai you're welcome | 16:25 |
sai | sure, we index shaker results into elastic | 16:25 |
sai | i can pull up the graphs thru kibana | 16:25 |
sai | :) | 16:25 |
DinaBelova | cool | 16:25 |
sai | that was we average out results | 16:25 |
sai | because im seeing varying results due to NUMA | 16:26 |
sai | when a vm is numa local vs non local | 16:26 |
sai | so we figured the best was it rerun same test multiple times and average out using elasticsearch/kibana | 16:26 |
sai | so we can get something really representative | 16:26 |
DinaBelova | sai I believe our networking folks were looking on this as well, but not sure | 16:26 |
DinaBelova | sai that's a good apprioach | 16:26 |
sai | cool, is there a specific subset of openstack-network=perf somewhere on irc | 16:27 |
sai | or is this the best channel | 16:27 |
sai | i know ilyashakhat_mobi does networking perf | 16:27 |
sai | not sure who else | 16:27 |
DinaBelova | sai I believe that's a best channel | 16:27 |
sai | awesome | 16:27 |
DinaBelova | and ilyashakhat_mobi is probably the best person to ping | 16:27 |
sai | ill stick to this then | 16:27 |
DinaBelova | sure | 16:27 |
DinaBelova | ok, anything else here? | 16:28 |
DinaBelova | msimonin rcherrueau ad_rien_ ? | 16:28 |
msimonin | nope | 16:28 |
ad_rien_ | nothing on my side | 16:28 |
msimonin | thanks | 16:28 |
rcherrueau | nope | 16:28 |
DinaBelova | thanks folks! | 16:28 |
DinaBelova | bye! | 16:28 |
DinaBelova | #endmeeting | 16:28 |
ad_rien_ | thanks to you | 16:28 |
openstack | Meeting ended Tue Sep 13 16:28:41 2016 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:28 |
ilyashakhat_mobi | bye! | 16:28 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/performance_team/2016/performance_team.2016-09-13-15.30.html | 16:28 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/performance_team/2016/performance_team.2016-09-13-15.30.txt | 16:28 |
sai | thanks DinaBelova | 16:28 |
openstack | Log: http://eavesdrop.openstack.org/meetings/performance_team/2016/performance_team.2016-09-13-15.30.log.html | 16:28 |
*** aignatev has quit IRC | 16:28 | |
*** rohanion has quit IRC | 16:28 | |
*** JorgeCardoso has quit IRC | 16:29 | |
*** msimonin has quit IRC | 16:29 | |
*** Menthos has quit IRC | 16:32 | |
*** markvoelker has quit IRC | 16:44 | |
*** AugieMena has quit IRC | 16:44 | |
*** rcherrueau has quit IRC | 16:50 | |
*** ad_rien_ has quit IRC | 16:55 | |
*** pcaruana has quit IRC | 16:59 | |
*** xek has quit IRC | 17:03 | |
*** msimonin has joined #openstack-performance | 17:11 | |
*** yarkot has joined #openstack-performance | 17:14 | |
*** itsuugo has quit IRC | 17:14 | |
*** yarkot has quit IRC | 17:14 | |
*** itsuugo has joined #openstack-performance | 17:17 | |
*** xek has joined #openstack-performance | 17:24 | |
*** victorhe has quit IRC | 17:42 | |
*** ilyashakhat_mobi has quit IRC | 17:46 | |
*** yarkot has joined #openstack-performance | 17:56 | |
*** dimtruck is now known as zz_dimtruck | 18:03 | |
*** peyunco has joined #openstack-performance | 18:30 | |
*** pcaruana has joined #openstack-performance | 18:36 | |
*** yarkot has quit IRC | 18:44 | |
*** ilyashakhat_mobi has joined #openstack-performance | 18:57 | |
*** peyunco has quit IRC | 19:08 | |
*** ilyashakhat_mobi has quit IRC | 19:09 | |
*** yarkot1 has quit IRC | 19:16 | |
*** luzC has quit IRC | 19:16 | |
*** ilyashakhat has quit IRC | 19:17 | |
*** meteorfox has quit IRC | 19:17 | |
*** beisner has quit IRC | 19:17 | |
*** med_ has quit IRC | 19:17 | |
*** odyssey4me has quit IRC | 19:17 | |
*** alaski has quit IRC | 19:17 | |
*** SpamapS has quit IRC | 19:17 | |
*** serverascode has quit IRC | 19:17 | |
*** HenryG has quit IRC | 19:17 | |
*** boris-42 has quit IRC | 19:17 | |
*** zz_dimtruck has quit IRC | 19:17 | |
*** andreaf has quit IRC | 19:17 | |
*** mgagne has quit IRC | 19:17 | |
*** toan has quit IRC | 19:17 | |
*** ChanServ has quit IRC | 19:17 | |
*** anevenchannyy has quit IRC | 19:17 | |
*** Cassowary has quit IRC | 19:17 | |
*** mikal has quit IRC | 19:17 | |
*** v12aml has quit IRC | 19:17 | |
*** claudiub|2 has quit IRC | 19:17 | |
*** harlowja has quit IRC | 19:17 | |
*** dewanee has quit IRC | 19:17 | |
*** AlexeyAbashkin has quit IRC | 19:17 | |
*** Anticimex has quit IRC | 19:17 | |
*** amit213 has quit IRC | 19:17 | |
*** malos has quit IRC | 19:17 | |
*** kun_huang has quit IRC | 19:17 | |
*** ishant|away has quit IRC | 19:17 | |
*** doffm has quit IRC | 19:18 | |
*** bvanhav has quit IRC | 19:18 | |
*** bapalm has quit IRC | 19:18 | |
*** dims has quit IRC | 19:18 | |
*** jamesd has quit IRC | 19:18 | |
*** andreykurilin has quit IRC | 19:18 | |
*** afranc has quit IRC | 19:18 | |
*** itsuugo has quit IRC | 19:18 | |
*** msimonin has quit IRC | 19:18 | |
*** rook has quit IRC | 19:18 | |
*** klindgren has quit IRC | 19:18 | |
*** haukebruno has quit IRC | 19:18 | |
*** pcaruana has quit IRC | 19:18 | |
*** rfolco has quit IRC | 19:18 | |
*** DuncanT has quit IRC | 19:18 | |
*** furlongm has quit IRC | 19:18 | |
*** kragniz has quit IRC | 19:18 | |
*** fyxim has quit IRC | 19:18 | |
*** ggherdov- has quit IRC | 19:18 | |
*** ossifrath has quit IRC | 19:18 | |
*** rpodolyaka has quit IRC | 19:18 | |
*** johnthetubaguy has quit IRC | 19:18 | |
*** openstackgerrit has quit IRC | 19:18 | |
*** johnthetubaguy has joined #openstack-performance | 19:23 | |
*** yarkot1 has joined #openstack-performance | 19:23 | |
*** rfolco has joined #openstack-performance | 19:23 | |
*** klindgren has joined #openstack-performance | 19:23 | |
*** kragniz has joined #openstack-performance | 19:23 | |
*** pcaruana has joined #openstack-performance | 19:23 | |
*** Cassowary has joined #openstack-performance | 19:23 | |
*** anevenchannyy has joined #openstack-performance | 19:23 | |
*** yarkot has joined #openstack-performance | 19:23 | |
*** kun_huang has joined #openstack-performance | 19:23 | |
*** malos has joined #openstack-performance | 19:23 | |
*** Anticimex has joined #openstack-performance | 19:23 | |
*** AlexeyAbashkin has joined #openstack-performance | 19:23 | |
*** msimonin has joined #openstack-performance | 19:23 | |
*** luzC has joined #openstack-performance | 19:23 | |
*** itsuugo has joined #openstack-performance | 19:23 | |
*** ChanServ has joined #openstack-performance | 19:23 | |
*** HenryG has joined #openstack-performance | 19:23 | |
*** boris-42 has joined #openstack-performance | 19:23 | |
*** dimtruck has joined #openstack-performance | 19:23 | |
*** andreaf has joined #openstack-performance | 19:23 | |
*** mgagne has joined #openstack-performance | 19:23 | |
*** toan has joined #openstack-performance | 19:23 | |
*** haukebruno has joined #openstack-performance | 19:23 | |
*** ishant|away has joined #openstack-performance | 19:23 | |
*** doffm has joined #openstack-performance | 19:23 | |
*** bapalm has joined #openstack-performance | 19:23 | |
*** bvanhav has joined #openstack-performance | 19:23 | |
*** furlongm has joined #openstack-performance | 19:23 | |
*** ilyashakhat has joined #openstack-performance | 19:23 | |
*** meteorfox has joined #openstack-performance | 19:23 | |
*** beisner has joined #openstack-performance | 19:23 | |
*** med_ has joined #openstack-performance | 19:23 | |
*** odyssey4me has joined #openstack-performance | 19:23 | |
*** alaski has joined #openstack-performance | 19:23 | |
*** SpamapS has joined #openstack-performance | 19:23 | |
*** orwell.freenode.net sets mode: +o ChanServ | 19:23 | |
*** rook has joined #openstack-performance | 19:23 | |
*** andreykurilin has joined #openstack-performance | 19:23 | |
*** openstackgerrit has joined #openstack-performance | 19:23 | |
*** dims has joined #openstack-performance | 19:23 | |
*** afranc has joined #openstack-performance | 19:23 | |
*** mikal has joined #openstack-performance | 19:23 | |
*** v12aml has joined #openstack-performance | 19:23 | |
*** luzC has quit IRC | 19:23 | |
*** luzC has joined #openstack-performance | 19:23 | |
*** jamesd has joined #openstack-performance | 19:23 | |
*** claudiub|2 has joined #openstack-performance | 19:24 | |
*** harlowja has joined #openstack-performance | 19:24 | |
*** dewanee has joined #openstack-performance | 19:24 | |
*** boris-42 has quit IRC | 19:24 | |
*** rook has quit IRC | 19:24 | |
*** rook has joined #openstack-performance | 19:24 | |
*** rook is now known as Guest46013 | 19:24 | |
*** fyxim has joined #openstack-performance | 19:33 | |
*** bvanhav has quit IRC | 19:33 | |
*** rpodolyaka has joined #openstack-performance | 19:40 | |
*** ossifrath has joined #openstack-performance | 19:41 | |
*** serverascode has joined #openstack-performance | 19:53 | |
*** klindgren_ has joined #openstack-performance | 19:57 | |
*** klindgren has quit IRC | 19:58 | |
*** DuncanT has joined #openstack-performance | 19:59 | |
*** amit213 has joined #openstack-performance | 19:59 | |
*** klindgren has joined #openstack-performance | 20:00 | |
*** ggherdov- has joined #openstack-performance | 20:02 | |
*** klindgren_ has quit IRC | 20:02 | |
*** klindgren_ has joined #openstack-performance | 20:05 | |
*** klindgren has quit IRC | 20:06 | |
*** pcaruana has quit IRC | 20:11 | |
*** boris-42 has joined #openstack-performance | 20:18 | |
*** claudiub has joined #openstack-performance | 20:33 | |
*** claudiub|2 has quit IRC | 20:36 | |
*** oDoylero0lz has joined #openstack-performance | 21:03 | |
*** harlowja has quit IRC | 21:04 | |
*** msimonin has quit IRC | 21:08 | |
*** msimonin has joined #openstack-performance | 21:12 | |
*** jamesd has quit IRC | 21:21 | |
*** jamesd has joined #openstack-performance | 21:21 | |
*** msimonin has quit IRC | 21:27 | |
*** amit213 has quit IRC | 21:27 | |
*** dewanee has quit IRC | 21:28 | |
*** dewanee has joined #openstack-performance | 21:28 | |
*** msimonin has joined #openstack-performance | 21:28 | |
*** claudiub has quit IRC | 21:29 | |
*** amit213 has joined #openstack-performance | 21:34 | |
*** Guest46013 has quit IRC | 21:42 | |
*** rook has joined #openstack-performance | 21:42 | |
*** rook is now known as Guest734 | 21:42 | |
*** sai has quit IRC | 21:43 | |
*** sai has joined #openstack-performance | 21:43 | |
*** rfolco has quit IRC | 21:48 | |
*** harlowja has joined #openstack-performance | 22:03 | |
*** msimonin has quit IRC | 22:06 | |
*** msimonin1 has joined #openstack-performance | 22:06 | |
*** itsuugo has quit IRC | 22:42 | |
*** sai has quit IRC | 22:43 | |
*** sai has joined #openstack-performance | 22:44 | |
*** itsuugo has joined #openstack-performance | 22:45 | |
*** sai has quit IRC | 22:56 | |
*** sai has joined #openstack-performance | 23:00 | |
*** itsuugo has quit IRC | 23:20 | |
*** itsuugo has joined #openstack-performance | 23:22 | |
*** sai has quit IRC | 23:34 | |
*** sai has joined #openstack-performance | 23:38 | |
*** itsuugo has quit IRC | 23:46 | |
*** itsuugo has joined #openstack-performance | 23:47 | |
*** sai has quit IRC | 23:56 | |
*** sai has joined #openstack-performance | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!