Tuesday, 2016-09-13

*** dimtruck is now known as zz_dimtruck00:00
*** itsuugo has joined #openstack-performance00:00
*** AnarchyAo has quit IRC00:09
*** itsuugo has quit IRC00:24
*** itsuugo has joined #openstack-performance00:26
*** itsuugo has quit IRC00:40
*** itsuugo has joined #openstack-performance00:42
*** itsuugo has quit IRC00:48
*** itsuugo has joined #openstack-performance00:49
*** claudiub has quit IRC00:57
*** itsuugo has quit IRC00:59
*** itsuugo has joined #openstack-performance01:00
*** itsuugo has quit IRC01:25
*** itsuugo has joined #openstack-performance01:25
*** itsuugo has quit IRC01:34
*** itsuugo has joined #openstack-performance01:36
*** itsuugo has quit IRC01:41
*** itsuugo has joined #openstack-performance01:42
*** fredli has joined #openstack-performance01:48
*** itsuugo has quit IRC01:50
*** itsuugo has joined #openstack-performance01:51
*** itsuugo has quit IRC01:58
*** itsuugo has joined #openstack-performance02:00
*** itsuugo has quit IRC02:09
*** itsuugo has joined #openstack-performance02:10
*** itsuugo has quit IRC02:15
*** itsuugo has joined #openstack-performance02:17
*** itsuugo has quit IRC02:21
*** itsuugo has joined #openstack-performance02:22
*** itsuugo has quit IRC02:27
*** itsuugo has joined #openstack-performance02:28
*** zz_dimtruck is now known as dimtruck02:28
*** itsuugo has quit IRC02:34
*** itsuugo has joined #openstack-performance02:37
*** rfolco has quit IRC02:48
*** itsuugo has quit IRC02:50
*** itsuugo has joined #openstack-performance02:51
*** itsuugo has quit IRC03:20
*** itsuugo has joined #openstack-performance03:22
*** itsuugo has quit IRC03:29
*** markvoelker has quit IRC03:30
*** itsuugo has joined #openstack-performance03:31
*** rfolco has joined #openstack-performance03:33
*** rfolco has quit IRC03:33
*** itsuugo has quit IRC04:01
*** itsuugo has joined #openstack-performance04:02
*** itsuugo has quit IRC04:11
*** itsuugo has joined #openstack-performance04:12
*** itsuugo has quit IRC04:16
*** itsuugo has joined #openstack-performance04:17
*** itsuugo has quit IRC04:22
*** itsuugo has joined #openstack-performance04:24
*** dimtruck is now known as zz_dimtruck04:29
*** itsuugo has quit IRC04:31
*** itsuugo has joined #openstack-performance04:32
*** itsuugo has quit IRC04:36
*** itsuugo has joined #openstack-performance04:37
*** fredli has quit IRC04:40
*** itsuugo has quit IRC04:42
*** itsuugo has joined #openstack-performance04:43
*** msimonin has joined #openstack-performance04:46
*** itsuugo has quit IRC04:48
*** itsuugo has joined #openstack-performance04:49
*** itsuugo has quit IRC04:53
*** itsuugo has joined #openstack-performance04:55
*** itsuugo has quit IRC05:06
*** itsuugo has joined #openstack-performance05:06
*** itsuugo has quit IRC05:11
*** itsuugo has joined #openstack-performance05:12
*** itsuugo has quit IRC05:17
*** itsuugo has joined #openstack-performance05:17
*** ilyashakhat_mobi has joined #openstack-performance05:19
*** claudiub has joined #openstack-performance05:21
*** itsuugo has quit IRC05:24
*** msimonin has quit IRC05:25
*** itsuugo has joined #openstack-performance05:25
*** markvoelker has joined #openstack-performance05:30
*** itsuugo has quit IRC05:30
*** itsuugo has joined #openstack-performance05:31
*** markvoelker has quit IRC05:35
*** ilyashakhat_mobi has quit IRC05:36
*** itsuugo has quit IRC05:36
*** itsuugo has joined #openstack-performance05:36
*** itsuugo has quit IRC05:44
*** itsuugo has joined #openstack-performance05:46
*** ilyashakhat_mobi has joined #openstack-performance05:46
*** itsuugo has quit IRC05:54
*** itsuugo has joined #openstack-performance05:54
*** itsuugo has quit IRC05:59
*** itsuugo has joined #openstack-performance06:00
*** ilyashakhat_mobi has quit IRC06:06
*** itsuugo has quit IRC06:12
*** itsuugo has joined #openstack-performance06:13
*** itsuugo has quit IRC06:18
*** itsuugo has joined #openstack-performance06:19
*** itsuugo has quit IRC06:24
*** itsuugo has joined #openstack-performance06:25
*** itsuugo has quit IRC06:36
*** ilyashakhat_mobi has joined #openstack-performance06:36
*** ilyashak_ has joined #openstack-performance06:37
*** ilyashakhat_mobi has quit IRC06:37
*** itsuugo has joined #openstack-performance06:37
*** itsuugo has quit IRC06:49
*** itsuugo has joined #openstack-performance06:50
*** pcaruana has joined #openstack-performance07:02
*** ilyashak_ has quit IRC07:05
*** yarkot has quit IRC07:11
*** msimonin has joined #openstack-performance07:15
*** msimonin has quit IRC07:15
*** markvoelker has joined #openstack-performance07:31
*** markvoelker has quit IRC07:36
*** itsuugo has quit IRC07:37
*** itsuugo has joined #openstack-performance07:39
*** itsuugo has quit IRC07:45
*** itsuugo has joined #openstack-performance07:47
*** openstackgerrit has quit IRC07:48
*** openstackgerrit has joined #openstack-performance07:49
*** itsuugo has quit IRC07:56
*** itsuugo has joined #openstack-performance07:57
*** itsuugo has quit IRC08:02
*** itsuugo has joined #openstack-performance08:03
*** ilyashakhat_mobi has joined #openstack-performance08:05
*** ilyashakhat_mobi has quit IRC08:10
*** itsuugo has quit IRC08:10
*** itsuugo has joined #openstack-performance08:12
*** lmiccini_ has joined #openstack-performance08:19
*** cgross has quit IRC08:19
*** lmiccini has quit IRC08:20
*** cgross has joined #openstack-performance08:21
*** lmiccini_ is now known as lmiccini08:25
*** msimonin has joined #openstack-performance08:33
*** msimonin has quit IRC08:34
*** msimonin has joined #openstack-performance08:37
*** msimonin has quit IRC08:39
*** itsuugo has quit IRC08:53
*** itsuugo has joined #openstack-performance08:54
*** itsuugo has quit IRC08:59
*** itsuugo has joined #openstack-performance09:00
*** markvoelker has joined #openstack-performance09:25
*** markvoelker has quit IRC09:29
*** itsuugo has quit IRC09:45
*** itsuugo has joined #openstack-performance09:47
*** msimonin has joined #openstack-performance09:51
*** ilyashakhat_mobi has joined #openstack-performance09:51
*** ilyashakhat_mobi has quit IRC09:56
*** msimonin has quit IRC09:59
*** itsuugo has quit IRC10:06
*** itsuugo has joined #openstack-performance10:08
*** mikal has quit IRC10:10
*** mikal has joined #openstack-performance10:12
*** mikal has quit IRC10:14
*** mikal has joined #openstack-performance10:16
*** permalac has joined #openstack-performance10:17
*** lmiccini has quit IRC10:25
*** cgross has quit IRC10:25
*** itsuugo has quit IRC10:43
*** itsuugo has joined #openstack-performance10:44
*** permalac has quit IRC10:51
*** itsuugo has quit IRC10:58
*** itsuugo has joined #openstack-performance10:59
*** msimonin has joined #openstack-performance11:01
*** msimonin has quit IRC11:08
*** itsuugo has quit IRC11:09
*** itsuugo has joined #openstack-performance11:09
*** itsuugo has quit IRC11:22
*** itsuugo has joined #openstack-performance11:23
*** markvoelker has joined #openstack-performance11:25
*** bvanhav has joined #openstack-performance11:28
*** markvoelker has quit IRC11:30
*** itsuugo has quit IRC11:48
*** itsuugo has joined #openstack-performance11:49
*** ilyashakhat_mobi has joined #openstack-performance11:53
*** ilyashakhat_mobi has quit IRC11:57
*** itsuugo has quit IRC11:59
*** itsuugo has joined #openstack-performance12:00
*** markvoelker has joined #openstack-performance12:11
*** rfolco has joined #openstack-performance12:19
*** msimonin has joined #openstack-performance12:33
*** permalac has joined #openstack-performance12:33
saiilyashakhat: ping12:41
*** itsuugo has quit IRC12:42
*** itsuugo has joined #openstack-performance12:43
ilyashakhatsai: hi~12:46
*** msimonin has quit IRC12:48
saiilyashakhat: hey, https://github.com/openstack/shaker/blob/master/doc/source/usage.rst states that for flent i could chose any of the tests from the list12:55
saibut trying anything other than defaults like download, upload or bidrectional fails12:56
sai2016-09-12 20:07:58.175 768 DEBUG shaker.engine.messaging [-] Received request: {'finish': 1473725487.789398, 'stdout': u'', 'start': 1473725447.622127, 'agent_id': 'shaker_zdairm_master_0', 'stderr': '\ngzip: stdin: unexpected end of file\n', 'operation': 'reply'} __iter__ /home/stack/shaker-venv/lib/python2.7/site-packages/shaker/engine/messaging.py:3912:56
saiis what is see12:56
saitrying to do tcp_4down12:56
saitcp with 4 threads.12:56
ilyashakhatcould you try to run the same command manually?13:01
saisure will try13:14
saiilyashakhat: another question is there a test class in the shaker that lets me do network testing with different IP packet sizes13:15
*** msimonin has joined #openstack-performance13:17
ilyashakhatiperf class accepts --datagram_size which is passed as --len parameter into iperf tool13:19
ilyashakhataccording to code this parameter sets packet size13:19
ilyashakhatbut for UDP only13:20
*** msimonin has quit IRC13:24
ilyashakhatsai, I'm looking at "flent --list-tests" -- there's no tcp_4down test13:24
ilyashakhatit exists in master, but not released yet13:24
saiah ok, that was missing13:25
saiyeh i just looked at where the docs point and that seemed to have a list of tests13:25
saithanks13:25
saiso ilyashakhat i cant do different packet sizes for tcp correct?13:26
saiare u doing any openstack network testing with varying packet sizes?13:26
saii have some network test results id like to push to upstream performance-docs13:26
ilyashakhatsai, we do only udp with 64 bytes13:27
saiand tcp is whatever flent/iperf comes with?13:27
saiand what would that default to?13:27
saiilyashakhat: also i have some results with DVR in Newton Id like to push upstream, know if similar work has already been done, cause i see test results with dvr in the name, but nothing was mentioned abt dvr in the test plan/setup13:28
ilyashakhattest plan is written to be common for all types of deployment, that's why it doesn't mention DVR13:35
ilyashakhatbut test results are for specific deployment13:35
ilyashakhate.g. http://docs.openstack.org/developer/performance-docs/test_results/tenant_networking/index.html13:35
ilyashakhatplease post your results to performance-doc repo, next to existing 200 nodes DVR+VXLAN13:36
ilyashakhat> and tcp is whatever flent/iperf comes with?  -- I suppose the default value set on VM interface is used -- we see the difference in numbers when OpenStack is deployed with jumbo frames13:37
*** zz_dimtruck is now known as dimtruck13:42
*** ilyashakhat_mobi has joined #openstack-performance13:54
*** ilyashakhat_mobi has quit IRC13:59
*** msimonin has joined #openstack-performance14:06
saiilyashakhat: thanks, but was wondering abt IP packet size for TCP, not MTU specifically because in some of my tests with uperf where i can set packet sizes, have been seeing significant throughput imporvement on large packets sizes14:16
sai16k and 64k14:16
saiilyashakhat: last question promise :) https://github.com/openstack/shaker/blob/master/doc/source/images/topology_l3_north_south.png14:19
sai^ is that the topology for network N-S tests u r doing/14:19
saicause it turns out that it is covering two N-S tests essentially, VM to external and external to Vm again14:20
saior is there any different testing u do for N-S14:20
*** dimtruck is now known as zz_dimtruck14:24
ilyashakhatsai, yes, N-S is actually double pass14:32
saiyeh double pass was the word i was looking for14:32
sai:)14:32
ilyashakhathttps://github.com/openstack/shaker/tree/master/shaker/scenarios/openstack/external -- these are the true N-S14:33
ilyashakhatbut require an external host with the same tools as Shaker image contains14:33
ilyashakhathttp://pyshaker.readthedocs.io/en/latest/catalog.html#openstack-l3-north-south-to-external-target14:34
ilyashakhatthe trick is to pass the destination host address -- it is done via --matrix "{host: <address>}"14:35
saigotcha14:38
saiand the host could be anything routable from the cloud right14:38
saii will install whatever tools shaker image on the external host and do i need to do anything else to the host14:39
saistart netserver or..14:39
*** ad_rien_ has joined #openstack-performance14:39
ilyashakhatsai, yep, you can follow the same script that image-builder does14:40
*** zz_dimtruck is now known as dimtruck14:41
saiilyashakhat++14:43
saioops no karma bot ;014:43
sai;)14:43
*** JorgeCardoso has joined #openstack-performance14:53
*** itsuugo has quit IRC14:53
*** itsuugo has joined #openstack-performance14:54
*** aignatev has joined #openstack-performance15:08
*** dmitryme has quit IRC15:13
*** dmitryme has joined #openstack-performance15:15
*** itsuugo has quit IRC15:23
*** rohanion has joined #openstack-performance15:23
*** itsuugo has joined #openstack-performance15:24
*** AugieMena has joined #openstack-performance15:28
DinaBelova#startmeeting Performance Team15:30
openstackMeeting started Tue Sep 13 15:30:02 2016 UTC and is due to finish in 60 minutes.  The chair is DinaBelova. Information about MeetBot at http://wiki.debian.org/MeetBot.15:30
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:30
openstackThe meeting name has been set to 'performance_team'15:30
DinaBelovahey folks o/15:30
AugieMenao/15:30
ad_rien_o/15:30
aignatevo/15:30
*** rcherrueau has joined #openstack-performance15:30
DinaBelovarohanion, rcherrueau o/15:30
rcherrueauHi,15:30
msimoninhello15:30
JorgeCardosoo/15:30
DinaBelovaJorgeCardoso nice to see you sir15:31
DinaBelovailyashakhat are you around today? :)15:31
JorgeCardosolikewise :)15:31
DinaBelovaok, so good evening / good morning :)15:31
DinaBelovalet's start with action items from last meeting15:31
DinaBelova#topic Action Items15:31
DinaBelovamsimonin rcherrueau - one of them was on you folks15:32
DinaBelova add information about what monitoring tools were used to the https://pad.inria.fr/p/FK18ZSyjFyLPITfE15:32
msimoninyep sorry we are doing it right now15:32
DinaBelovamsimonin ack, lemme keep this action item15:32
rohanionhey everyone!15:33
*** rohanion has left #openstack-performance15:33
DinaBelova#action msimonin rcherrueau add information about what monitoring tools were used to the https://pad.inria.fr/p/FK18ZSyjFyLPITfE15:33
*** rohanion has joined #openstack-performance15:33
DinaBelovarohanion o/15:33
DinaBelovarohanion second action item is about you15:33
DinaBelovapublish osprofiler config patcher15:33
DinaBelovarohanion afaik you pushed it somewhere15:33
DinaBelovamay you please share?15:34
rohanionyes15:34
rohanionhttps://github.com/rohanion/osprofiler-cfg15:34
rohanionhere we go15:34
DinaBelova#link https://github.com/rohanion/osprofiler-cfg15:34
rohanionis the readme good enough or should I change it?15:34
DinaBelovarohanion I'd propose to add info that this needs to be run on all OpenStack nodes15:35
DinaBelovarohanion and mention that services need to be restrted separately15:35
DinaBelovaas this depends much on the deployment15:35
DinaBelovarohanion what do you think?15:36
rohanionI guess it's pretty obvious... but will do, thanks15:36
DinaBelovarohanion it's obvious for you :)15:36
DinaBelovarohanion thanks15:36
DinaBelovathat' all about our action items for today15:37
DinaBelova#topic Current progress on the planned tests15:37
DinaBelovaokay msimonin ad_rien_ rcherrueau - the floor is yours15:37
ad_rien_thanks15:37
DinaBelovaI see some new details added to the etherpad15:37
ad_rien_actually we have lot of questions15:37
ad_rien_:-)15:37
DinaBelova#link https://pad.inria.fr/p/FK18ZSyjFyLPITfE15:37
DinaBelovaad_rien_ sure15:37
ad_rien_msimonin will start15:38
msimoninso,15:38
msimonin:)15:38
msimoninfirst set of experiments : collect metric of an "idle" openstack with different number of compute15:39
msimoninthis one is done15:39
msimoninwe are analysing the results15:39
DinaBelovamsimonin may you please clarify what is :idle: here?15:39
msimoninDinaBelova: sure15:39
*** Menthos has joined #openstack-performance15:39
msimoninFor us idle means an openstack without any incoming requests15:40
msimoninthe goal is to measure the noise generated by openstack services15:40
msimoninan maybe find some patterns15:40
DinaBelovamsimonin ack, gotcha15:40
msimoninsecond set of experiments : collect metric of an "non-idle" openstack with different number of compute15:41
msimoninbasically during rally benchmarks15:41
DinaBelovamsimonin due to what I ee in the etherpad - some timeouts happen?15:42
msimoninwhich line ?15:42
DinaBelova37615:42
*** claudiub|2 has joined #openstack-performance15:42
msimoninyep right this has to be explained15:42
DinaBelovamsimonin is this happening for boot VM I suppose?15:43
msimoninthe fact is that with a bigger deployment (1000 compute) we got some timeout in the rally reports15:43
DinaBelovamsimonin was rally timed out waiting for server to become active?15:44
rcherrueauDinaBelova: Here is an example of error we got 'Timed out waiting for a reply to message ID b0628f97f1f942c1962859a3c290a731'15:45
DinaBelovarcherrueau oh, interesting15:45
ad_rien_Actually, we are working on  these experiments now so we can dive into details I'm not sure whether it is the best time to discuss such points right now ;)  Maybe we can just raise all our questions and see which ones need deeper investigations.15:45
*** claudiub has quit IRC15:46
DinaBelovaad_rien_ probably ye15:46
ad_rien_ok thanks15:46
DinaBelovarcherrueau btw - where are you observing these logs?15:46
DinaBelovathe final quesiton :)15:46
ad_rien_:)15:46
rcherrueauFrom the rally report15:46
DinaBelovain rally? or in one of the services?15:46
DinaBelovarcherrueau ack15:46
rcherrueauYes I have to dig into this and take a look at the logs of other services15:47
rcherrueaumaybe rabbitmq15:47
DinaBelovaad_rien_ rcherrueau if you won't be able to find the root cause quickly, may you please send me rally logs / rally report?15:47
ad_rien_sure15:47
ad_rien_Can we switch to next questions ;) ?15:47
DinaBelovaI'd jump to our rally folks :) they have observed all types of isssues :)15:47
DinaBelovaad_rien_ sure15:47
msimoninDinaBelova: cool :)15:48
ad_rien_OK we observed  another issue. If we do not redeploy our testbed between scenarios, we got weird behaviors15:48
ad_rien_For that point we need to better understand what does happen….15:49
ad_rien_maybe you can just tell us if one your side you saw such issues ?15:49
ad_rien_We plan to launch 10 times the same scenario on a small deployment to see whether we got same results15:49
ad_rien_So DinaBelova others ? did you see such issue ? Maybe we should ask the rally team ?15:50
rohanionfolks, Dina's laptop froze to death, she's rebooting15:50
msimoninlol15:50
rohanionplease wait for a couple of minutes15:50
ad_rien_sorry15:50
msimoninshe's already tired of our questions15:50
ad_rien_;)15:51
ad_rien_meanwhile AugieMena may I ask you if you received our email regarding the IBM scheduling presentation ?15:52
DinaBelovafolks, I'm back, sorry, my laptop went crazy15:52
ad_rien_we are definitely interested by this work15:52
ad_rien_ok15:52
DinaBelovaad_rien_ may you please repeat everything I missed? :)15:52
DinaBelovathe last msg I see is about second question15:53
AugieMenaad_rien_ Yes, got the email.  I believe Chris K replied to that15:53
ad_rien_We observed  another issue. If we do not redeploy our testbed between scenarios, we got weird behaviors15:53
ad_rien_For this point we need to better understand what does happen….15:53
ad_rien_Maybe you can just tell us if one your side you saw such issues ?15:53
ad_rien_We plan to launch 10 times the same scenario on a small deployment to see whether we got same results15:53
ad_rien_So DinaBelova others ? did you see such issue ? Maybe we should ask the rally team ?15:53
ad_rien_s/one your side/on your side sorry for the typo15:54
DinaBelovaad_rien_ ususally we do not observe some behavior changing - rally clean up usually is enough15:54
DinaBelovaI mean clean up done after every scenario15:54
ad_rien_we also did that (actually Rally is doing that :()15:55
ad_rien_ok we will confirm that for the next meeting15:55
DinaBelovaad_rien_ - what kind of changes? andreykurilin - may you please try to help?15:55
DinaBelovaad_rien_ ack15:55
ad_rien_increase in the memory of the DB15:55
andreykurilinDinaBelova ad_rien_: hi hi15:55
ad_rien_Hi andreykurilin15:56
*** ilyashakhat_mobi has joined #openstack-performance15:56
andreykurilinad_rien_ I'm rally core and I'm ready to help15:56
andreykurilin)15:56
ad_rien_thanks15:56
ad_rien_that's a good news15:56
ad_rien_Actually we would like to be able reproduce such weird behaviors15:57
DinaBelovaad_rien_ what DB? if Nova - so lines with deleted VMs still will be there :) with deleted == true there15:57
msimoninsoft-delete ?15:57
ad_rien_so we can come back to you with a concrete example15:57
andreykurilinok15:57
DinaBelovaad_rien_ sure15:57
DinaBelovaad_rien_ anything else?15:57
msimoninso the state of openstack isn't the same when running a second time a benchmark ?15:58
ad_rien_Since the DB is not on the same state, the question is whether there will be an impact on the performance we measured15:58
*** victorhe has joined #openstack-performance15:58
ad_rien_Memcached is also not cleaned15:58
DinaBelovamsimonin ad_rien_ well, that's a complex system - if you'll run tests always on purely new env, you'll always observe warming up OpenStack - with all caches being not filled, etc.15:59
ad_rien_so I think we need time to identify all aspects and get back to andreykurilin15:59
andreykurilinad_rien_: feel free to ping me here or at #openstack-rally (there you can find more number of friendly rally cores) :)15:59
ad_rien_DinaBelova:   yes that's why we would like to see whether we can ensure reproducibility criteria between experiments16:00
DinaBelovaso the ideal test case is to run every case twice (each pair on 100% clean env) and count only a second attempt16:00
ad_rien_andreykurilin: thanks16:00
DinaBelovaad_rien_ yes, that's tricky16:00
ad_rien_Ok16:00
ad_rien_so the last question for today is related to the scheduling process on top of the fake driver16:01
*** ilyashakhat_mobi has quit IRC16:01
DinaBelovaad_rien_ sure16:01
ad_rien_actually the fake driver presents 1000 vcpu and a lot of memory16:01
ad_rien_we are wondering how 1000 VM instances are scheduled on top of a 1000 fake drivers16:01
ad_rien_Can all VMs be scheduled on the same fake driver ?16:02
ad_rien_What does prevent to get such a placement ?16:02
*** ilyashakhat_mobi has joined #openstack-performance16:02
DinaBelovaad_rien_ afaik the whole process is the same as for usual runs - filter scheduler uses filters to schedule servers to the compute nodes, some of the filters define if one node should be filled as a priority or all nodes should be filled in more or less same fasion (nova has info about resources already "eaten" on the each hypervisor)16:03
DinaBelovaad_rien_ I guess you need to take a look on the scheduler filters used16:04
DinaBelovaand see what kind of configurations are used16:04
saiDinaBelova: i have a few networking questions, let me know when i can go16:05
DinaBelovasai sure16:05
ad_rien_Ok we will perform a small test to answer this question16:05
ad_rien_thanks DinaBelova this is ok from our side16:05
DinaBelovasai we'll jump soon to the open discussions16:05
DinaBelovaad_rien_ ack, thanks16:05
DinaBelovaplease keep us updated16:05
DinaBelovarohanion are you still around? ready for osprofiler?16:05
rohanionalways am!16:06
DinaBelova#topic OSProfiler weekly update16:06
DinaBelovarohanion please proceed16:06
rohanion5 sec..16:07
rohanionWe're ready to merge the neutron patch https://review.openstack.org/#/c/342505/, waiting for CR from neutron core team16:07
rohanioncinder https://review.openstack.org/#/c/315676/ - add one test and ready to merge too.16:08
DinaBelova#link  https://review.openstack.org/#/c/342505/16:09
DinaBelova#link https://review.openstack.org/#/c/315676/16:09
DinaBelovarohanion ack, thanks16:09
rohanionit's not everything :)16:09
DinaBelovait's just thanks :) you can proceed :D16:09
rohanionglance https://review.openstack.org/#/c/316799/ - work in progress, debugging failed tests16:09
DinaBelova#link  https://review.openstack.org/#/c/316799/16:10
rohanionsahara https://review.openstack.org/#/c/344370/ - nothing, no active development. will ask sahara team for support16:10
rohanioninternal osprofiler stuff:16:10
DinaBelova#link  https://review.openstack.org/#/c/344370/16:10
rohanionelasticsearch https://review.openstack.org/#/c/340936/ - on review, almost ready to merge. will finish reviewing that tomorrow16:11
rohanionredis driver https://review.openstack.org/#/c/364487/ - I had no time to review it, will work on that tomorrow as well.16:12
DinaBelovarohanion ack16:12
rohanioninfluxdb driver - no active development. if the performance team decides that we have to implement it asap, I'll code it in an hour.16:12
DinaBelovarohanion :D16:12
DinaBelovayou'll be quick :D16:13
DinaBelovaanything else sir?16:13
rohanion1 hour writing - 1 week testing :)16:13
rohanionno, that's everything regarding OSProfiler16:13
DinaBelovarohanion thanks for extended update16:13
DinaBelova#topic Open Discussion16:13
DinaBelovasai please go ahead16:13
saisure16:13
saiso DinaBelova was wondering what kind of networking tests you are running currently and I could update with some of the network perf work we are doing at red hat16:14
DinaBelovasai so mostly we're running data plane tests using shaker16:14
saiok shaker is what we are using too16:15
DinaBelovasai lemme share a test plan16:15
DinaBelova#link http://docs.openstack.org/developer/performance-docs/test_plans/tenant_networking/plan.html16:15
DinaBelovasai here it is ^^16:15
saicool16:15
DinaBelovaand the related report http://docs.openstack.org/developer/performance-docs/test_results/tenant_networking/neutron_vxlan_dvr_200/index.html#tenant-networking-report-vxlan-dvr-200-nodes16:15
saiany specific neutron features u r targetting?16:15
saiwe r working on DVR currently16:15
DinaBelovasai for neutron features we have separated tests being run16:16
saiand had some previous work looking at control plane performance tuning neutron workers16:16
DinaBelovasai http://docs.openstack.org/developer/performance-docs/test_plans/hardware_features/index.html16:16
DinaBelovaas for DVR - we usually run with it, yes16:16
DinaBelovasai some time ago we run both DVR and non-DVR topologies16:16
DinaBelovaright now mostly DVR (as requested by Mirantis)16:17
saicool, i have some of those results, i can share upstream and contribute to the repo16:17
saithe comparison16:17
DinaBelovasai this will be perfect16:17
DinaBelovaso please submit lab description here as well http://docs.openstack.org/developer/performance-docs/labs/index.html16:17
DinaBelovasai ^^16:17
DinaBelovaso we can compare the test bed as well16:17
saiDinaBelova: what im really curious about is the tunings that u put into the network tests16:18
saithreads of neteprf/iperf16:18
saiand TCP packet sizes16:18
saior u run defaults16:18
DinaBelovasai sorry I added a wrong link when was targeting the neutron features - here is right one http://docs.openstack.org/developer/performance-docs/test_plans/neutron_features/index.html16:18
DinaBelovasai you can take a look here http://docs.openstack.org/developer/performance-docs/test_results/tenant_networking/neutron_vxlan_dvr_200/index.html#tenant-networking-report-vxlan-dvr-200-nodes - if you'll click to every scenario - e.g. http://docs.openstack.org/developer/performance-docs/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l2_dense/index.html - you'll see full scenario16:19
saiDinaBelova: because we are running uperf with different IP packet sizes( outside of shaker) and seeing better throughput at higher packet sizes16:19
saicool thanks DinaBelova16:20
ilyashakhat_mobisai: we ran with defaults, but our networking guys tried with different settings, mostly number of threads16:20
DinaBelovasai np, you're really welcome16:20
saihopefully i will controbute to performance-docs16:20
*** permalac has quit IRC16:20
saiand do i need to have a test plan or just test-results with scenario will help?/16:20
saiilyashakhat_mobi: ack16:20
ilyashakhat_mobisai: it would be interesting to run tests with the same parameters as you do (meaning packet size)16:20
ilyashakhat_mobiyu can follow existing plan or update it16:21
ilyashakhat_mobiit's not restricted :)16:21
DinaBelovasai if your tests are a subset of http://docs.openstack.org/developer/performance-docs/test_plans/tenant_networking/plan.html (just with different params) you can jut push test results with other configs and explanations - if scenarios are different, you can add yours to the test plan - http://docs.openstack.org/developer/performance-docs/test_plans/tenant_networking/plan.html16:21
saiDinaBelova: ilyashakhat_mobi https://github.com/openstack/browbeat/tree/master/rally/rally-plugins/nova-create-pbench-uperf16:22
DinaBelova#link https://github.com/openstack/browbeat/tree/master/rally/rally-plugins/nova-create-pbench-uperf16:22
saithat is the rally plugin we use combined with pbench(inhouse but opensourced)16:22
saikicks of uperf with varying packet sizes and threads16:22
saiprints rally summary with throughput results as well16:23
saiso interesting data plane perf through rally16:23
DinaBelovasai ok, so the tool is different - so you can add new section to the test plan I believe16:23
DinaBelovaas it's still the same testing field (tenant networking) but really other type of tools used16:24
saiDinaBelova: my test results are with shaker16:24
DinaBelovasai ah16:24
DinaBelovaI got it16:24
saibut i have some toher results too with the tool i mentioned16:24
sai:)16:24
saii think thats all the network perf questions i have16:24
DinaBelovasai :D ack :) so shaker stuff can be just published as test report - against your env with your configs, for browbeat stuff I'll propose to add one more section to the test plan16:25
DinaBelovaand publish results regarding it16:25
DinaBelovasai you're welcome16:25
saisure, we index shaker results into elastic16:25
saii can pull up the graphs thru kibana16:25
sai:)16:25
DinaBelovacool16:25
saithat was we average out results16:25
saibecause im seeing varying results due to NUMA16:26
saiwhen a vm is numa local vs non local16:26
saiso we figured the best was it rerun same test multiple times and average out using elasticsearch/kibana16:26
saiso we can get something really representative16:26
DinaBelovasai I believe our networking folks were looking on this as well, but not sure16:26
DinaBelovasai that's a good apprioach16:26
saicool, is there a specific subset of openstack-network=perf somewhere on irc16:27
saior is this the best channel16:27
saii know ilyashakhat_mobi does networking perf16:27
sainot sure who else16:27
DinaBelovasai I believe that's a best channel16:27
saiawesome16:27
DinaBelovaand ilyashakhat_mobi is probably the best person to ping16:27
saiill stick to this then16:27
DinaBelovasure16:27
DinaBelovaok, anything else here?16:28
DinaBelovamsimonin rcherrueau ad_rien_ ?16:28
msimoninnope16:28
ad_rien_nothing on my side16:28
msimoninthanks16:28
rcherrueaunope16:28
DinaBelovathanks folks!16:28
DinaBelovabye!16:28
DinaBelova#endmeeting16:28
ad_rien_thanks to you16:28
openstackMeeting ended Tue Sep 13 16:28:41 2016 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:28
ilyashakhat_mobibye!16:28
openstackMinutes:        http://eavesdrop.openstack.org/meetings/performance_team/2016/performance_team.2016-09-13-15.30.html16:28
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/performance_team/2016/performance_team.2016-09-13-15.30.txt16:28
saithanks DinaBelova16:28
openstackLog:            http://eavesdrop.openstack.org/meetings/performance_team/2016/performance_team.2016-09-13-15.30.log.html16:28
*** aignatev has quit IRC16:28
*** rohanion has quit IRC16:28
*** JorgeCardoso has quit IRC16:29
*** msimonin has quit IRC16:29
*** Menthos has quit IRC16:32
*** markvoelker has quit IRC16:44
*** AugieMena has quit IRC16:44
*** rcherrueau has quit IRC16:50
*** ad_rien_ has quit IRC16:55
*** pcaruana has quit IRC16:59
*** xek has quit IRC17:03
*** msimonin has joined #openstack-performance17:11
*** yarkot has joined #openstack-performance17:14
*** itsuugo has quit IRC17:14
*** yarkot has quit IRC17:14
*** itsuugo has joined #openstack-performance17:17
*** xek has joined #openstack-performance17:24
*** victorhe has quit IRC17:42
*** ilyashakhat_mobi has quit IRC17:46
*** yarkot has joined #openstack-performance17:56
*** dimtruck is now known as zz_dimtruck18:03
*** peyunco has joined #openstack-performance18:30
*** pcaruana has joined #openstack-performance18:36
*** yarkot has quit IRC18:44
*** ilyashakhat_mobi has joined #openstack-performance18:57
*** peyunco has quit IRC19:08
*** ilyashakhat_mobi has quit IRC19:09
*** yarkot1 has quit IRC19:16
*** luzC has quit IRC19:16
*** ilyashakhat has quit IRC19:17
*** meteorfox has quit IRC19:17
*** beisner has quit IRC19:17
*** med_ has quit IRC19:17
*** odyssey4me has quit IRC19:17
*** alaski has quit IRC19:17
*** SpamapS has quit IRC19:17
*** serverascode has quit IRC19:17
*** HenryG has quit IRC19:17
*** boris-42 has quit IRC19:17
*** zz_dimtruck has quit IRC19:17
*** andreaf has quit IRC19:17
*** mgagne has quit IRC19:17
*** toan has quit IRC19:17
*** ChanServ has quit IRC19:17
*** anevenchannyy has quit IRC19:17
*** Cassowary has quit IRC19:17
*** mikal has quit IRC19:17
*** v12aml has quit IRC19:17
*** claudiub|2 has quit IRC19:17
*** harlowja has quit IRC19:17
*** dewanee has quit IRC19:17
*** AlexeyAbashkin has quit IRC19:17
*** Anticimex has quit IRC19:17
*** amit213 has quit IRC19:17
*** malos has quit IRC19:17
*** kun_huang has quit IRC19:17
*** ishant|away has quit IRC19:17
*** doffm has quit IRC19:18
*** bvanhav has quit IRC19:18
*** bapalm has quit IRC19:18
*** dims has quit IRC19:18
*** jamesd has quit IRC19:18
*** andreykurilin has quit IRC19:18
*** afranc has quit IRC19:18
*** itsuugo has quit IRC19:18
*** msimonin has quit IRC19:18
*** rook has quit IRC19:18
*** klindgren has quit IRC19:18
*** haukebruno has quit IRC19:18
*** pcaruana has quit IRC19:18
*** rfolco has quit IRC19:18
*** DuncanT has quit IRC19:18
*** furlongm has quit IRC19:18
*** kragniz has quit IRC19:18
*** fyxim has quit IRC19:18
*** ggherdov- has quit IRC19:18
*** ossifrath has quit IRC19:18
*** rpodolyaka has quit IRC19:18
*** johnthetubaguy has quit IRC19:18
*** openstackgerrit has quit IRC19:18
*** johnthetubaguy has joined #openstack-performance19:23
*** yarkot1 has joined #openstack-performance19:23
*** rfolco has joined #openstack-performance19:23
*** klindgren has joined #openstack-performance19:23
*** kragniz has joined #openstack-performance19:23
*** pcaruana has joined #openstack-performance19:23
*** Cassowary has joined #openstack-performance19:23
*** anevenchannyy has joined #openstack-performance19:23
*** yarkot has joined #openstack-performance19:23
*** kun_huang has joined #openstack-performance19:23
*** malos has joined #openstack-performance19:23
*** Anticimex has joined #openstack-performance19:23
*** AlexeyAbashkin has joined #openstack-performance19:23
*** msimonin has joined #openstack-performance19:23
*** luzC has joined #openstack-performance19:23
*** itsuugo has joined #openstack-performance19:23
*** ChanServ has joined #openstack-performance19:23
*** HenryG has joined #openstack-performance19:23
*** boris-42 has joined #openstack-performance19:23
*** dimtruck has joined #openstack-performance19:23
*** andreaf has joined #openstack-performance19:23
*** mgagne has joined #openstack-performance19:23
*** toan has joined #openstack-performance19:23
*** haukebruno has joined #openstack-performance19:23
*** ishant|away has joined #openstack-performance19:23
*** doffm has joined #openstack-performance19:23
*** bapalm has joined #openstack-performance19:23
*** bvanhav has joined #openstack-performance19:23
*** furlongm has joined #openstack-performance19:23
*** ilyashakhat has joined #openstack-performance19:23
*** meteorfox has joined #openstack-performance19:23
*** beisner has joined #openstack-performance19:23
*** med_ has joined #openstack-performance19:23
*** odyssey4me has joined #openstack-performance19:23
*** alaski has joined #openstack-performance19:23
*** SpamapS has joined #openstack-performance19:23
*** orwell.freenode.net sets mode: +o ChanServ19:23
*** rook has joined #openstack-performance19:23
*** andreykurilin has joined #openstack-performance19:23
*** openstackgerrit has joined #openstack-performance19:23
*** dims has joined #openstack-performance19:23
*** afranc has joined #openstack-performance19:23
*** mikal has joined #openstack-performance19:23
*** v12aml has joined #openstack-performance19:23
*** luzC has quit IRC19:23
*** luzC has joined #openstack-performance19:23
*** jamesd has joined #openstack-performance19:23
*** claudiub|2 has joined #openstack-performance19:24
*** harlowja has joined #openstack-performance19:24
*** dewanee has joined #openstack-performance19:24
*** boris-42 has quit IRC19:24
*** rook has quit IRC19:24
*** rook has joined #openstack-performance19:24
*** rook is now known as Guest4601319:24
*** fyxim has joined #openstack-performance19:33
*** bvanhav has quit IRC19:33
*** rpodolyaka has joined #openstack-performance19:40
*** ossifrath has joined #openstack-performance19:41
*** serverascode has joined #openstack-performance19:53
*** klindgren_ has joined #openstack-performance19:57
*** klindgren has quit IRC19:58
*** DuncanT has joined #openstack-performance19:59
*** amit213 has joined #openstack-performance19:59
*** klindgren has joined #openstack-performance20:00
*** ggherdov- has joined #openstack-performance20:02
*** klindgren_ has quit IRC20:02
*** klindgren_ has joined #openstack-performance20:05
*** klindgren has quit IRC20:06
*** pcaruana has quit IRC20:11
*** boris-42 has joined #openstack-performance20:18
*** claudiub has joined #openstack-performance20:33
*** claudiub|2 has quit IRC20:36
*** oDoylero0lz has joined #openstack-performance21:03
*** harlowja has quit IRC21:04
*** msimonin has quit IRC21:08
*** msimonin has joined #openstack-performance21:12
*** jamesd has quit IRC21:21
*** jamesd has joined #openstack-performance21:21
*** msimonin has quit IRC21:27
*** amit213 has quit IRC21:27
*** dewanee has quit IRC21:28
*** dewanee has joined #openstack-performance21:28
*** msimonin has joined #openstack-performance21:28
*** claudiub has quit IRC21:29
*** amit213 has joined #openstack-performance21:34
*** Guest46013 has quit IRC21:42
*** rook has joined #openstack-performance21:42
*** rook is now known as Guest73421:42
*** sai has quit IRC21:43
*** sai has joined #openstack-performance21:43
*** rfolco has quit IRC21:48
*** harlowja has joined #openstack-performance22:03
*** msimonin has quit IRC22:06
*** msimonin1 has joined #openstack-performance22:06
*** itsuugo has quit IRC22:42
*** sai has quit IRC22:43
*** sai has joined #openstack-performance22:44
*** itsuugo has joined #openstack-performance22:45
*** sai has quit IRC22:56
*** sai has joined #openstack-performance23:00
*** itsuugo has quit IRC23:20
*** itsuugo has joined #openstack-performance23:22
*** sai has quit IRC23:34
*** sai has joined #openstack-performance23:38
*** itsuugo has quit IRC23:46
*** itsuugo has joined #openstack-performance23:47
*** sai has quit IRC23:56
*** sai has joined #openstack-performance23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!