Monday, 2018-10-08

*** jamesmcarthur has quit IRC00:05
*** jamesmcarthur has joined #openstack-meeting00:14
*** zaneb has joined #openstack-meeting00:18
*** jamesmcarthur has quit IRC00:23
*** longkb has joined #openstack-meeting00:38
*** jamesmcarthur has joined #openstack-meeting00:58
*** hyunsikyang has quit IRC01:14
*** erlon has joined #openstack-meeting01:15
*** yikun has joined #openstack-meeting01:16
*** yamamoto has quit IRC01:29
*** yamamoto has joined #openstack-meeting01:29
*** tommylikehu has joined #openstack-meeting01:31
*** mschuppert has quit IRC01:36
*** hongbin has joined #openstack-meeting01:48
*** mhen has quit IRC01:58
*** mhen has joined #openstack-meeting02:00
*** yamamoto has quit IRC02:01
*** yamamoto has joined #openstack-meeting02:02
*** yamamoto has quit IRC02:06
*** yamamoto has joined #openstack-meeting02:43
*** yamamoto has quit IRC02:57
*** yamamoto has joined #openstack-meeting02:58
*** yamamoto has quit IRC03:02
*** bobh has joined #openstack-meeting03:35
*** bobh has quit IRC03:40
*** yamamoto has joined #openstack-meeting03:46
*** ykatabam has quit IRC03:52
*** kaisers has quit IRC03:56
*** kaisers has joined #openstack-meeting04:05
*** kaisers has quit IRC04:12
*** kaisers has joined #openstack-meeting04:19
*** tetsuro has joined #openstack-meeting04:25
*** ekcs has quit IRC04:29
*** yamamoto has quit IRC04:29
*** ekcs has joined #openstack-meeting04:29
*** hongbin has quit IRC04:32
*** tetsuro has quit IRC04:37
*** tetsuro has joined #openstack-meeting04:38
*** janki has joined #openstack-meeting04:54
*** ykatabam has joined #openstack-meeting04:56
*** yamamoto has joined #openstack-meeting04:58
*** apetrich has joined #openstack-meeting05:06
*** sheel has joined #openstack-meeting05:11
*** tommylikehu has quit IRC05:27
*** yamamoto has quit IRC05:45
*** felipemonteiro has quit IRC05:49
*** e0ne has joined #openstack-meeting06:21
*** tetsuro has quit IRC06:22
*** tetsuro has joined #openstack-meeting06:25
*** aojea has joined #openstack-meeting06:39
*** aojeagarcia has joined #openstack-meeting06:43
*** yamamoto has joined #openstack-meeting06:44
*** aojea has quit IRC06:47
*** giblet is now known as gibi06:50
*** ykatabam has quit IRC06:50
*** kopecmartin|off is now known as kopecmartin|ruck07:02
*** slaweq_ has joined #openstack-meeting07:12
*** electrofelix has joined #openstack-meeting07:20
*** rcernin has quit IRC07:21
*** ttsiouts has joined #openstack-meeting07:23
*** ralonsoh has joined #openstack-meeting07:34
*** ttsiouts has quit IRC07:39
*** yamamoto has quit IRC07:55
*** ttsiouts has joined #openstack-meeting07:57
*** tssurya has joined #openstack-meeting08:15
*** finucannot is now known as stephenfin08:15
*** belmoreira has joined #openstack-meeting08:17
*** yamamoto has joined #openstack-meeting08:53
*** tetsuro has quit IRC09:29
*** yamamoto has quit IRC09:49
*** ttsiouts has quit IRC10:01
*** longkb has quit IRC10:08
*** janki has quit IRC10:12
*** janki has joined #openstack-meeting10:13
*** ssbarnea_ has quit IRC10:24
*** rossella_s has joined #openstack-meeting10:33
*** rcernin has joined #openstack-meeting10:36
*** slaweq_ is now known as slaweq10:44
*** slaweq is now known as dpawlik_10:45
*** dpawlik_ is now known as slaweq10:45
*** Luzi has joined #openstack-meeting10:46
*** ykatabam has joined #openstack-meeting10:47
*** yamamoto has joined #openstack-meeting10:48
*** rossella_s has quit IRC10:55
*** rossella_s has joined #openstack-meeting10:55
*** yamamoto has quit IRC11:00
*** yamamoto has joined #openstack-meeting11:00
*** rossella_s has quit IRC11:04
*** rossella_s has joined #openstack-meeting11:05
*** yamamoto has quit IRC11:07
*** erlon has quit IRC11:08
*** psachin has joined #openstack-meeting11:12
*** rcernin has quit IRC11:17
*** rossella_s has quit IRC11:19
*** rossella_s has joined #openstack-meeting11:19
*** rossella_s has quit IRC11:30
*** rossella_s has joined #openstack-meeting11:31
*** ralonsoh has quit IRC11:35
*** rossella_s has quit IRC11:39
*** rossella_s has joined #openstack-meeting11:39
*** sw3 has joined #openstack-meeting11:39
*** ralonsoh has joined #openstack-meeting11:45
*** yamamoto has joined #openstack-meeting11:46
*** belmorei_ has joined #openstack-meeting11:48
*** rossella_s has quit IRC11:50
*** belmoreira has quit IRC11:51
*** rossella_s has joined #openstack-meeting11:54
*** yamamoto has quit IRC11:59
*** yamamoto has joined #openstack-meeting11:59
*** yamamoto has quit IRC12:01
*** yamamoto has joined #openstack-meeting12:01
*** raildo has joined #openstack-meeting12:02
*** e0ne has quit IRC12:04
*** yamamoto has quit IRC12:06
*** yamamoto has joined #openstack-meeting12:08
*** rossella_s has quit IRC12:09
*** rossella_s has joined #openstack-meeting12:12
*** yamamoto has quit IRC12:12
*** e0ne has joined #openstack-meeting12:13
*** ttsiouts has joined #openstack-meeting12:14
*** armax has quit IRC12:27
*** fried_rice is now known as efried12:49
*** yamamoto has joined #openstack-meeting12:51
*** lbragstad has joined #openstack-meeting12:54
*** iyamahat has joined #openstack-meeting12:54
*** ijw has joined #openstack-meeting12:56
*** ijw has quit IRC12:56
*** ijw has joined #openstack-meeting12:57
*** ijw has quit IRC12:59
*** ijw_ has joined #openstack-meeting13:00
*** psachin has quit IRC13:01
*** eharney has joined #openstack-meeting13:02
*** tetsuro has joined #openstack-meeting13:04
*** e0ne has quit IRC13:05
*** rossella_s has quit IRC13:07
*** rossella_s has joined #openstack-meeting13:07
*** mjturek has joined #openstack-meeting13:12
*** dustins has joined #openstack-meeting13:13
*** mriedem has joined #openstack-meeting13:15
*** lbragstad has quit IRC13:24
*** bobh has joined #openstack-meeting13:27
*** rossella_s has quit IRC13:28
*** rossella_s has joined #openstack-meeting13:29
*** zaneb has quit IRC13:29
*** zaneb has joined #openstack-meeting13:29
*** erlon has joined #openstack-meeting13:30
*** erlon_ has joined #openstack-meeting13:31
*** cloudrancher has quit IRC13:31
*** cloudrancher has joined #openstack-meeting13:32
*** lbragstad has joined #openstack-meeting13:32
*** annabelleB has joined #openstack-meeting13:35
*** erlon has quit IRC13:35
*** annabelleB has quit IRC13:37
*** awaugama has joined #openstack-meeting13:38
*** rossella_s has quit IRC13:42
*** rossella_s has joined #openstack-meeting13:43
*** sheel has quit IRC13:50
*** cloudrancher has quit IRC13:51
*** janki has quit IRC13:51
*** janki has joined #openstack-meeting13:52
*** cloudrancher has joined #openstack-meeting13:52
*** jaypipes has joined #openstack-meeting13:53
*** armax has joined #openstack-meeting13:53
*** longkb has joined #openstack-meeting13:54
*** longkb has quit IRC14:01
*** armax has quit IRC14:06
*** munimeha1 has joined #openstack-meeting14:07
*** awaugama has quit IRC14:09
*** walshh__ has quit IRC14:09
*** awaugama has joined #openstack-meeting14:11
*** SteelyDan is now known as dansmith14:13
*** rossella_s has quit IRC14:16
*** e0ne has joined #openstack-meeting14:17
*** heikkine has quit IRC14:19
*** beekneemech is now known as bnemec14:22
*** eharney has quit IRC14:24
*** rossella_s has joined #openstack-meeting14:25
*** dtrainor has joined #openstack-meeting14:26
*** lpetrut has joined #openstack-meeting14:32
*** rossella_s has quit IRC14:36
*** rossella_s has joined #openstack-meeting14:39
*** rossella_s has quit IRC14:44
*** rossella_s has joined #openstack-meeting14:46
*** Emine has joined #openstack-meeting14:49
*** edleafe has joined #openstack-meeting14:51
*** gcb_ has joined #openstack-meeting14:53
*** e0ne has quit IRC14:54
*** tetsuro has quit IRC14:56
*** lpetrut has quit IRC14:57
*** ijw_ has quit IRC14:58
*** ijw has joined #openstack-meeting14:58
*** cloudrancher has quit IRC15:01
*** cloudrancher has joined #openstack-meeting15:02
*** mriedem has quit IRC15:03
*** dklyle has joined #openstack-meeting15:04
*** mriedem has joined #openstack-meeting15:04
*** cloudrancher has quit IRC15:07
*** cloudrancher has joined #openstack-meeting15:08
*** e0ne has joined #openstack-meeting15:11
*** Luzi has quit IRC15:17
*** janki has quit IRC15:20
*** Emine has quit IRC15:21
*** rossella_s has quit IRC15:35
*** rossella_s has joined #openstack-meeting15:37
*** e0ne has quit IRC15:40
*** e0ne has joined #openstack-meeting15:42
*** jamesmcarthur has quit IRC15:47
*** tssurya has quit IRC15:47
*** jamesmcarthur has joined #openstack-meeting15:47
*** rubasov_ has joined #openstack-meeting15:48
*** e0ne has quit IRC15:49
*** rossella_s has quit IRC15:51
*** rossella_s has joined #openstack-meeting15:51
*** ssbarnea|bkp2 has joined #openstack-meeting15:53
*** rossella_s has quit IRC15:56
*** cloudrancher has quit IRC15:59
*** cloudrancher has joined #openstack-meeting15:59
*** mlavalle has joined #openstack-meeting16:00
mlavalle#startmeeting neutron_performance16:00
openstackMeeting started Mon Oct  8 16:00:14 2018 UTC and is due to finish in 60 minutes.  The chair is mlavalle. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: neutron_performance)"16:00
openstackThe meeting name has been set to 'neutron_performance'16:00
rubasov_hi everyone!16:00
mlavallehi rubasov_16:01
*** rossella_s has joined #openstack-meeting16:01
mlavallelet's give other guys a minute to join the meeting16:01
rubasov_sure, it's a first16:02
mlavalleok, let's get going16:03
mlavalle#topic Brainstorm16:03
*** openstack changes topic to "Brainstorm (Meeting topic: neutron_performance)"16:03
*** gcb_ has quit IRC16:03
mlavalleslaweq sent me an email indicating that he will be unable to attend the meeting, due to personal reasons16:04
mlavalleI also know thant njonhnston will not attend. Today is Columbus Day in the US and some people take the day off (mostly beaacuse their children get their day off from school)16:05
rubasov_sorry to hear that, he did most of the work to kick this off16:05
mlavallebefore getting to a solid agenda for this meeting, I wanted to use the first gathering to brainstrom how to tackle this problem16:06
mlavallebased on this we can evolve gradually an agenda for future meetings16:06
mlavalleis that ok?16:06
*** cloudrancher has quit IRC16:06
rubasov_makes sense16:06
mlavalleso....16:07
mlavallein prepartion for today's meeting I spent some time getting myself up to speed on osprofiler16:07
mlavallehttps://github.com/openstack/osprofiler16:07
*** cloudrancher has joined #openstack-meeting16:08
mlavalleto tell you the truth, I had seen some of the calls in the code16:08
rubasov_I'm still lagging in that regard, because I just returned to work from vacation16:08
mlavallebut never had sat down to understand exactly what it does16:08
rubasov_but I want to catch up on that16:08
mlavallethe good news is that it seems it is excatly what we need16:09
mlavalleit allows you to intrument the call to trace where the bottlenecks are located16:10
mlavallethe code^^^^16:10
rubasov_that sounds good16:10
mlavalleand we even have already hooks in the code:16:10
rubasov_what did you use to generate load? rally?16:10
mlavallehttp://codesearch.openstack.org/?q=osprofiler&i=nope&files=&repos=neutron16:11
mlavalleI haven't gotten so far as to generate load16:11
*** belmorei_ has quit IRC16:11
mlavallebut it seems Rally uses osprofiler anyways16:11
rubasov_sorry for getting too much ahead16:12
mlavallethat's ok16:12
mlavallelook at https://docs.openstack.org/developer/rally/quick_start/tutorial/step_11_profiling_openstack_internals.html16:12
mlavallethere is also a recent Vancouver Summit presentation on osprofiler: https://www.youtube.com/watch?v=Gvi8NfDjxxM16:15
rubasov_do we want to create a gate job using these tools?16:16
mlavalleand the other thing that I want to mention is that slaweq refined the script he used to get data and produced this: http://paste.openstack.org/show/731684/ and http://paste.openstack.org/show/731683/16:17
mlavalleso based on all this here's the action items I propose between now and the next meeting:16:19
*** aojeagarcia has quit IRC16:19
mlavalle1) We all should get more familiar with osprofiler. I propose we enable it in our local devstack and start playing with it locally, possibly combined with Rally16:20
*** ttsiouts has quit IRC16:21
rubasov_agree on 1) and sorry for not having done that already16:21
*** ttsiouts has joined #openstack-meeting16:22
mlavalle2) We should make sure that we have in the code calls to osprofiler to capture the problematic areas that are reflected in the dta provided by slaweq. It seems to me that this means the L3 code (I see a lot of router and floatingip related requests in the top offenders) as well as ports and networks16:22
mlavallewe should probably throw in subnets, just to make sure we cover the fundamental absatractions16:23
mlavalledo you agree with my reading of the dat?16:24
mlavalledata^^^16:24
rubasov_yes, especially the router-interface operations16:25
mlavalleit seems the l3 agent is intrumented: http://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n17916:26
*** ttsiouts has quit IRC16:26
mlavallebut I am not sure that's the only place we want to look at16:27
rubasov_server-side code may also be interesting16:28
mlavalleexactly16:28
mlavalleI am trying to find the places in the code where I think we are profiling16:29
* mlavalle digging16:29
mlavallehere they are: http://codesearch.openstack.org/?q=from%20neutron.common%20import%20profiler&i=nope&files=&repos=neutron16:30
*** efried has quit IRC16:30
*** rossella_s has quit IRC16:31
mlavallethere are a couple of places there that seem server related:16:31
mlavallehttp://git.openstack.org/cgit/openstack/neutron/tree/neutron/server/__init__.py#n7716:32
mlavalleand16:32
mlavallehttp://git.openstack.org/cgit/openstack/neutron/tree/neutron/service.py#n7116:32
mlavallebut I am not sure that enough to start profiling16:33
*** rossella_s has joined #openstack-meeting16:33
mlavallethe next action item is16:34
mlavalle3) as rubasov_ already suggested, we need to start looking at creating a job in the check queue where we routenile gather profiling data16:35
mlavallethis job maybe should a mix of tests similar to the jobs where we see the most timeouts, which is where I assume slaweq has been gathering data16:36
rubasov_I'd be happy to work on that as soon as I catch up learning the tools16:36
mlavalleok16:36
mlavallelet's do that16:37
*** efried has joined #openstack-meeting16:37
mlavalleform my point of view, I think we have enough homework here for two weeks16:37
mlavallewhat do you think?16:37
rubasov_I definitely do16:37
mlavalleok, let's summarize:16:37
mlavalle#action mlavalle and rubasov to deepen knowledge on osprofiler16:38
mlavalle#action mlavalle to make sure we have calls to osprofiler in the code that correspond to problematic areas: routers, fips, ports, networks, subnets16:39
mlavalle#action rubasov to start defining a job for check queue to gather performance data16:39
mlavalleam I missing something?16:39
rubasov_sounds complete16:39
mlavallebtw, I think this presentation is pretty good: https://www.youtube.com/watch?v=Gvi8NfDjxxM16:40
mlavalleto get started with odprofiler16:40
rubasov_it's on my watchlist and next meeting I shall be more prepared16:41
mlavalleok16:41
mlavalleThanks for attending the first ever Neutron performance meeting!16:41
mlavalleHave a nice week16:41
mlavalle#endmeeting16:41
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"16:41
rubasov_thank you for all the good work16:41
openstackMeeting ended Mon Oct  8 16:41:51 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:41
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_performance/2018/neutron_performance.2018-10-08-16.00.html16:41
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_performance/2018/neutron_performance.2018-10-08-16.00.txt16:41
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_performance/2018/neutron_performance.2018-10-08-16.00.log.html16:41
rubasov_good bye16:42
mlavallebye16:42
*** eharney has joined #openstack-meeting16:43
*** rossella_s has quit IRC16:47
*** gyee has joined #openstack-meeting16:48
*** rossella_s has joined #openstack-meeting16:48
*** mlavalle has left #openstack-meeting16:57
*** ralonsoh has quit IRC16:57
*** rossella_s has quit IRC16:57
*** rossella_s has joined #openstack-meeting16:58
*** jamesmcarthur has quit IRC17:11
*** apetrich has quit IRC17:11
*** jamesmcarthur has joined #openstack-meeting17:14
*** iyamahat has quit IRC17:15
*** ekcs has quit IRC17:16
*** e0ne has joined #openstack-meeting17:24
*** rossella_s has quit IRC17:25
*** rossella_s has joined #openstack-meeting17:27
*** iyamahat has joined #openstack-meeting17:28
*** e0ne has quit IRC17:29
*** ssbarnea_ has joined #openstack-meeting17:29
*** ssbarnea|bkp2 has quit IRC17:30
*** iyamahat_ has joined #openstack-meeting17:32
*** rossella_s has quit IRC17:35
*** ykatabam has quit IRC17:35
*** iyamahat has quit IRC17:36
*** rossella_s has joined #openstack-meeting17:38
*** ralonsoh has joined #openstack-meeting17:44
*** ralonsoh has quit IRC17:45
*** jamesmcarthur has quit IRC17:47
*** apetrich has joined #openstack-meeting17:47
*** ekcs has joined #openstack-meeting17:52
*** rossella_s has quit IRC17:52
*** e0ne has joined #openstack-meeting17:54
*** jamesmcarthur has joined #openstack-meeting17:55
*** jamesmcarthur has quit IRC17:56
*** rossella_s has joined #openstack-meeting17:56
*** bdperkin has quit IRC17:56
*** rossella_s has quit IRC18:03
*** electrofelix has quit IRC18:05
*** rossella_s has joined #openstack-meeting18:05
*** Swami has joined #openstack-meeting18:13
*** rossella_s has quit IRC18:16
*** rossella_s has joined #openstack-meeting18:18
*** jamesmcarthur has joined #openstack-meeting18:20
*** imacdonn has quit IRC18:23
*** imacdonn has joined #openstack-meeting18:23
*** jamesmcarthur has quit IRC18:25
*** rossella_s has quit IRC18:38
*** rossella_s has joined #openstack-meeting18:39
*** kopecmartin|ruck is now known as kopecmartin|off18:45
*** hongbin has joined #openstack-meeting18:50
*** slagle has joined #openstack-meeting18:52
*** tssurya has joined #openstack-meeting18:53
*** _hemna has quit IRC18:54
*** _pewp_ has quit IRC18:54
*** _hemna has joined #openstack-meeting18:54
*** _pewp_ has joined #openstack-meeting18:55
*** rockyg has joined #openstack-meeting18:55
*** jamesmcarthur has joined #openstack-meeting19:00
*** rossella_s has quit IRC19:01
*** eharney has quit IRC19:02
*** rossella_s has joined #openstack-meeting19:03
*** diablo_rojo has joined #openstack-meeting19:04
*** eharney has joined #openstack-meeting19:04
*** sambetts|afk has quit IRC19:07
*** sambetts_ has joined #openstack-meeting19:10
*** armstrong has joined #openstack-meeting19:11
*** rossella_s has quit IRC19:18
*** rossella_s has joined #openstack-meeting19:20
*** slagle has quit IRC19:40
*** diablo_rojo has quit IRC19:42
*** cloudrancher has quit IRC19:43
*** cloudrancher has joined #openstack-meeting19:44
*** jamesmcarthur has quit IRC19:49
*** jamesmcarthur has joined #openstack-meeting19:51
*** jamesmcarthur has quit IRC19:52
*** jamesmcarthur has joined #openstack-meeting19:56
*** rossella_s has quit IRC19:57
*** jamesmca_ has joined #openstack-meeting19:58
*** jamesmca_ has quit IRC19:59
*** rossella_s has joined #openstack-meeting19:59
*** jamesmcarthur has quit IRC20:00
*** rockyg has quit IRC20:05
*** Arsenick has quit IRC20:09
*** Arsenick has joined #openstack-meeting20:09
*** jamesmcarthur has joined #openstack-meeting20:10
*** e0ne has quit IRC20:19
*** slagle has joined #openstack-meeting20:20
*** e0ne has joined #openstack-meeting20:20
*** bdperkin has joined #openstack-meeting20:26
*** tssurya has quit IRC20:28
*** eharney has quit IRC20:32
*** lbragstad has quit IRC20:37
*** slagle has quit IRC20:37
*** lbragstad has joined #openstack-meeting20:37
*** awaugama has quit IRC20:46
*** e0ne has quit IRC20:48
*** pcaruana has quit IRC20:49
*** jamesmcarthur has quit IRC20:54
*** rossella_s has quit IRC20:55
*** rossella_s has joined #openstack-meeting20:56
*** raildo has quit IRC20:57
*** jamesmcarthur has joined #openstack-meeting21:00
*** bobh has quit IRC21:01
*** jamesmcarthur has quit IRC21:21
*** bobh has joined #openstack-meeting21:33
*** bobh has quit IRC21:42
*** bobh has joined #openstack-meeting21:47
*** iyamahat__ has joined #openstack-meeting21:52
*** erlon_ has quit IRC21:54
*** iyamahat_ has quit IRC21:55
*** mahatic has quit IRC21:55
*** mahatic has joined #openstack-meeting21:58
*** slaweq has quit IRC22:01
*** dustins has quit IRC22:09
*** armstrong has quit IRC22:12
*** bobh has quit IRC22:19
*** ijw has quit IRC22:19
*** bobh has joined #openstack-meeting22:24
*** ekcs has quit IRC22:27
*** bobh has quit IRC22:29
*** hongbin has quit IRC22:38
*** munimeha1 has quit IRC22:50
*** rcernin has joined #openstack-meeting22:50
*** mriedem has quit IRC22:57
*** slaweq has joined #openstack-meeting23:11
*** slaweq has quit IRC23:15
*** lbragstad has quit IRC23:16
*** cloudrancher has quit IRC23:24
*** cloudrancher has joined #openstack-meeting23:25
*** ykatabam has joined #openstack-meeting23:26
*** artom has joined #openstack-meeting23:34
*** Swami has quit IRC23:37
*** tpsilva has quit IRC23:41
*** ykatabam has quit IRC23:52
*** gyee has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!