Wednesday, 2015-03-25

*** hj-hp has joined #openstack-operators00:04
*** SimonChung has quit IRC00:10
*** SimonChung has joined #openstack-operators00:10
*** hj-hp has quit IRC00:15
*** dboik_ has quit IRC00:17
*** SimonChung has quit IRC00:19
*** vinsh has joined #openstack-operators00:23
*** markvoelker has joined #openstack-operators00:25
*** alop has quit IRC00:39
*** Marga_ has quit IRC00:48
*** emagana has joined #openstack-operators00:51
*** emagana_ has joined #openstack-operators00:53
*** emagana has quit IRC00:55
*** Marga_ has joined #openstack-operators01:16
*** Marga_ has quit IRC01:19
*** Marga_ has joined #openstack-operators01:25
*** VW_ has joined #openstack-operators01:48
*** emagana_ has quit IRC02:01
*** dboik has joined #openstack-operators02:04
*** VW_ has quit IRC02:04
*** dboik_ has joined #openstack-operators02:04
*** dboik has quit IRC02:08
*** Marga_ has quit IRC02:13
*** harlowja is now known as harlowja_away02:17
*** SimonChung has joined #openstack-operators02:50
*** Marga_ has joined #openstack-operators02:56
*** Marga_ has quit IRC02:59
*** Marga_ has joined #openstack-operators02:59
*** SimonChung1 has joined #openstack-operators03:07
*** SimonChung has quit IRC03:10
*** andyhky` has joined #openstack-operators03:27
*** andyhky has quit IRC03:28
*** esker has joined #openstack-operators03:29
*** purp_2 has joined #openstack-operators03:36
*** WormMan_ has joined #openstack-operators03:37
*** purp has quit IRC03:37
*** WormMan has quit IRC03:37
*** purp_2 is now known as purp03:41
*** csd has quit IRC03:51
*** csd has joined #openstack-operators03:59
*** WormMan_ is now known as WormMan04:02
*** andrewbogott_afk is now known as andrewbogott04:36
*** dboik_ has quit IRC04:38
*** andrewbogott is now known as andrewbogott_afk04:39
*** zerda has joined #openstack-operators04:45
*** Marga_ has quit IRC04:49
*** sandywalsh_ has quit IRC04:52
*** VW_ has joined #openstack-operators04:56
*** reed has quit IRC05:00
*** sandywalsh has joined #openstack-operators05:04
*** rzerda has joined #openstack-operators05:10
*** zerda has quit IRC05:11
*** VW_ has quit IRC05:26
*** emagana has joined #openstack-operators05:49
*** Marga_ has joined #openstack-operators05:52
*** rainbowzerda has joined #openstack-operators06:07
*** rainbowzerda has quit IRC06:09
*** rzerda has quit IRC06:10
*** jemangs has quit IRC06:12
*** jemangs has joined #openstack-operators06:15
*** markvoelker has quit IRC06:17
*** Marga_ has quit IRC06:20
*** esker has quit IRC06:25
*** esker has joined #openstack-operators06:26
*** markvoelker has joined #openstack-operators06:47
*** markvoelker has quit IRC06:52
*** WormMan has quit IRC07:07
*** bvandenh has joined #openstack-operators07:11
*** WormMan has joined #openstack-operators07:14
*** emagana has quit IRC07:40
*** markvoelker has joined #openstack-operators07:48
*** markvoelker has quit IRC07:53
*** matrohon has joined #openstack-operators08:23
*** pboros has joined #openstack-operators08:40
*** Miouge_ has joined #openstack-operators08:49
*** markvoelker has joined #openstack-operators08:49
*** Miouge has quit IRC08:50
*** Miouge_ is now known as Miouge08:50
*** markvoelker has quit IRC08:54
*** hj-hp has joined #openstack-operators09:03
*** hj-hp has quit IRC09:10
*** hj-hp has joined #openstack-operators09:12
*** matrohon has quit IRC09:17
*** matrohon has joined #openstack-operators09:18
*** saneax has joined #openstack-operators09:18
*** hj-hp has quit IRC09:20
*** hj-hp has joined #openstack-operators09:21
*** matrohon has quit IRC09:34
*** hj-hp has quit IRC09:37
*** hj-hp has joined #openstack-operators09:39
*** matrohon has joined #openstack-operators09:41
*** arcimboldo has joined #openstack-operators09:45
*** markvoelker has joined #openstack-operators09:50
*** markvoelker has quit IRC09:54
*** hj-hp has quit IRC09:55
*** hj-hp has joined #openstack-operators09:57
*** Miouge has quit IRC10:04
*** hj-hp has quit IRC10:05
*** hj-hp has joined #openstack-operators10:06
*** Miouge has joined #openstack-operators10:09
*** hj-hp has quit IRC10:14
*** hj-hp has joined #openstack-operators10:16
*** hj-hp has quit IRC10:23
*** hj-hp has joined #openstack-operators10:24
*** derekh has joined #openstack-operators10:33
*** hj-hp has quit IRC10:33
*** hj-hp has joined #openstack-operators10:33
*** hj-hp has quit IRC10:41
*** hj-hp has joined #openstack-operators10:42
*** hj-hp has quit IRC10:50
*** markvoelker has joined #openstack-operators10:50
*** hj-hp has joined #openstack-operators10:51
*** markvoelker has quit IRC10:55
*** hj-hp has quit IRC10:59
*** hj-hp has joined #openstack-operators11:00
*** hj-hp has quit IRC11:08
*** pboros has quit IRC11:08
*** hj-hp has joined #openstack-operators11:09
*** hj-hp has quit IRC11:17
*** hj-hp has joined #openstack-operators11:18
*** gavan has joined #openstack-operators11:22
*** hj-hp has quit IRC11:26
*** hj-hp has joined #openstack-operators11:27
*** hj-hp has quit IRC11:35
*** hj-hp has joined #openstack-operators11:36
*** hj-hp has quit IRC11:44
*** hj-hp has joined #openstack-operators11:45
*** markvoelker has joined #openstack-operators11:51
*** hj-hp has quit IRC11:53
*** hj-hp has joined #openstack-operators11:54
*** markvoelker has quit IRC11:56
*** turnerg has joined #openstack-operators11:58
*** hj-hp has quit IRC12:02
*** hj-hp has joined #openstack-operators12:03
*** markvoelker has joined #openstack-operators12:09
*** saneax has quit IRC12:14
*** hj-hp has quit IRC12:21
*** hj-hp has joined #openstack-operators12:22
*** hj-hp has quit IRC12:29
*** hj-hp has joined #openstack-operators12:30
*** hj-hp has quit IRC12:56
*** hj-hp has joined #openstack-operators12:57
*** saneax has joined #openstack-operators12:58
*** VW_ has joined #openstack-operators13:00
*** saneax has quit IRC13:02
*** hj-hp has quit IRC13:06
*** hj-hp has joined #openstack-operators13:06
*** radez_g0n3 is now known as radez13:09
*** radez is now known as radez_g0n313:12
*** hj-hp has quit IRC13:14
*** hj-hp has joined #openstack-operators13:15
*** hj-hp has quit IRC13:23
*** ferest has joined #openstack-operators13:24
*** pboros has joined #openstack-operators13:24
*** hj-hp has joined #openstack-operators13:25
*** Marga_ has joined #openstack-operators13:28
*** andrewbogott_afk is now known as andrewbogott13:30
*** Marga_ has quit IRC13:30
*** Marga_ has joined #openstack-operators13:31
*** hj-hp has quit IRC13:33
*** ferest has quit IRC13:33
*** hj-hp has joined #openstack-operators13:34
*** radez_g0n3 is now known as radez13:34
*** andrewbogott has left #openstack-operators13:39
*** hj-hp has quit IRC13:41
*** hj-hp has joined #openstack-operators13:42
*** dboik has joined #openstack-operators13:44
*** dboik has joined #openstack-operators13:45
*** blair has quit IRC13:50
*** hj-hp has quit IRC13:51
*** hj-hp has joined #openstack-operators13:52
*** DaSchab has joined #openstack-operators13:55
*** hj-hp has quit IRC13:59
*** hj-hp has joined #openstack-operators14:00
*** hj-hp has quit IRC14:09
*** hj-hp has joined #openstack-operators14:10
*** hj-hp has quit IRC14:17
*** hj-hp has joined #openstack-operators14:18
*** Piet has quit IRC14:20
*** vinsh has quit IRC14:23
*** mdorman has joined #openstack-operators14:30
*** Miouge_ has joined #openstack-operators14:33
*** Miouge has quit IRC14:35
*** Miouge_ is now known as Miouge14:35
*** vinsh has joined #openstack-operators14:44
*** Marga_ has quit IRC14:47
*** reed has joined #openstack-operators14:47
*** DaSchab has quit IRC14:49
*** jaypipes_ is now known as jaypipes14:49
*** subscope has joined #openstack-operators14:50
*** blair has joined #openstack-operators14:51
*** esker has quit IRC14:53
*** blair has quit IRC14:55
*** gavan has quit IRC15:05
*** andyhky` is now known as andyhky15:06
*** jaypipes has quit IRC15:14
*** SimonChung1 has quit IRC15:40
*** alop has joined #openstack-operators15:49
*** blair has joined #openstack-operators15:52
*** emagana has joined #openstack-operators15:53
*** Piet has joined #openstack-operators15:56
*** blair has quit IRC15:57
*** belmoreira has joined #openstack-operators16:09
*** Marga_ has joined #openstack-operators16:12
*** SimonChung has joined #openstack-operators16:16
*** j05h has joined #openstack-operators16:23
*** belmoreira has quit IRC16:23
*** emagana has quit IRC16:31
*** mfink has joined #openstack-operators16:34
*** emagana has joined #openstack-operators16:39
*** emagana has quit IRC16:39
*** emagana has joined #openstack-operators16:40
*** blair has joined #openstack-operators16:54
*** turnerg has quit IRC16:55
*** bvandenh has quit IRC16:57
*** blair has quit IRC16:58
*** turnerg has joined #openstack-operators17:00
*** matrohon has quit IRC17:02
*** alop has quit IRC17:04
*** SimonChung1 has joined #openstack-operators17:07
*** SimonChung has quit IRC17:07
*** j05h has quit IRC17:08
*** alop has joined #openstack-operators17:12
*** vinsh_ has joined #openstack-operators17:13
*** vinsh has quit IRC17:16
*** vinsh has joined #openstack-operators17:17
*** harlowja_away is now known as harlowja17:18
jlkAny of you using ml2 and vlan on Juno?17:18
jlk(neutron obviously)17:18
jlkRunning rally on it, seems like neutron is having a heck of a time deleting ports.17:19
jlkand then it runs out of IPs17:19
*** arcimboldo has quit IRC17:19
*** vinsh_ has quit IRC17:20
*** VW_ has quit IRC17:26
*** SimonChung1 has quit IRC17:28
*** SimonChung has joined #openstack-operators17:28
*** emagana has quit IRC17:29
*** alop has quit IRC17:29
*** SimonChung1 has joined #openstack-operators17:29
*** SimonChung has quit IRC17:29
*** SimonChung1 has quit IRC17:30
*** SimonChung has joined #openstack-operators17:30
*** Marga_ has quit IRC17:32
*** esker has joined #openstack-operators17:32
*** verdurin is now known as verdurin_afk17:35
*** emagana has joined #openstack-operators17:35
*** alop has joined #openstack-operators17:41
*** blair has joined #openstack-operators17:55
*** VW_ has joined #openstack-operators17:55
*** turnerg has quit IRC17:56
*** derekh has quit IRC17:56
*** Marga_ has joined #openstack-operators17:59
*** blair has quit IRC17:59
*** turnerg has joined #openstack-operators18:03
*** turnerg has quit IRC18:03
*** turnerg has joined #openstack-operators18:03
*** SimonChung1 has joined #openstack-operators18:05
*** SimonChung has quit IRC18:05
klindgren_jlk: neutron + ml2 + flat on juno - seems fine so far?18:06
jlkokay. It seems fine under normal usage, but rally is set to do a LOT of builds and deletes in quick succession18:06
jlkand it leaves a bunch of ports behind.18:06
*** Marga_ has quit IRC18:06
*** Marga_ has joined #openstack-operators18:07
klindgren_are you getting timeouts or anything of the like?18:09
jlknot sure. I'm re-running and going to dive into some logs to see18:09
*** turnerg has quit IRC18:10
klindgren_If you aren't already I would turn on memcache for neutron.  That seemed to fix a number of issues for us18:10
*** SimonChung1 has quit IRC18:11
*** SimonChung has joined #openstack-operators18:11
*** Marga_ has quit IRC18:13
*** Marga_ has joined #openstack-operators18:13
*** jaypipes has joined #openstack-operators18:16
jlkyeah, we're trying to not increase our footprint. This worked fine with vxlan, seems to be an issue specifically with vlan18:17
*** esker has quit IRC18:18
klindgren_jlk - re: your email about ssl.18:25
klindgren_I totally agree SSL config in openstack is a travesty18:26
klindgren_then you get devs who bascially say you shouldn't be using ssl with python anyway and termiante ssl in front of python18:26
klindgren_iirc jay pipes was saying that18:26
jaypipesyes.18:29
jaypipesindeed yes.18:29
*** VW_ has quit IRC18:29
jlkwell18:29
jlkwe do terminate ssl in front18:29
jlkon the haproxy18:29
jlkbut services still talk to each other18:29
jlkthrough that termination18:29
jlkso that we get balancing of services talking to endpoints18:29
jlkWe could create ANOTHER set of haproxy end points that are non-ssl and try to point services to that set, but that raises haproxy memory usage.18:30
jaypipesjlk: yep, that works fine. at the T, we terminated SSL at the F5 load balancers for all services except Glance. For Glance, we never made the endpoint public to begin with and kept it hidden and on no SSL.18:31
jaypipesjlk: what's the issue with SSL and VxLAN vs. VLAN? First I've heard of that...18:31
jlkseparate issues18:31
jaypipesah18:31
jlkmy ssl issue is that service configs can't agree on config entry names for pointing to CA files so that when nova talks to neutron via the SSL terminated LB it can validate the cert it gets back18:32
jlkhttp://lists.openstack.org/pipermail/openstack-operators/2015-March/006614.html18:33
*** Marga_ has quit IRC18:38
*** Marga_ has joined #openstack-operators18:39
*** Marga_ has quit IRC18:46
jlkis it even neutron-linuxbridge-agent that's responsible for deleting vlan ports?18:47
jlkseems to be responsible for /creating/ them18:47
*** Marga_ has joined #openstack-operators18:48
*** blair has joined #openstack-operators18:56
*** Rockyg has joined #openstack-operators18:59
*** blair has quit IRC19:01
mgagnejlk: don't start me on consistency...19:01
jlkheh19:01
mgagnewhy does it have to be that way? are people/projects living in silos or what?19:02
jlkI think so, yes.19:02
*** harlowja is now known as harlowja_away19:02
jlkneutron likely had its own code at one time to read config sections to map them to things it would set in the novaclient object19:03
jlknovaclient object probably called them something different than neutronclient called them, and so on and so forth19:03
jlkoslo is supposed to "fix" this all for us, by consolidating some of this stuff, but...19:03
*** alop has quit IRC19:07
*** VW_ has joined #openstack-operators19:10
*** alop has joined #openstack-operators19:12
*** Marga_ has quit IRC19:14
*** Marga_ has joined #openstack-operators19:14
*** Marga_ has quit IRC19:14
*** Marga_ has joined #openstack-operators19:15
*** alop_ has joined #openstack-operators19:16
*** alop has quit IRC19:17
*** alop_ is now known as alop19:17
*** radez is now known as radez_g0n319:19
*** radez_g0n3 is now known as radez19:22
*** Marga_ has quit IRC19:25
*** klindgren__ has joined #openstack-operators19:26
*** emagana has quit IRC19:29
*** klindgren_ has quit IRC19:29
*** Rockyg has quit IRC19:36
*** Piet has quit IRC19:38
*** harlowja_away is now known as harlowja19:38
*** emagana has joined #openstack-operators19:39
*** matrohon has joined #openstack-operators19:46
*** radez is now known as radez_g0n319:53
*** Rockyg has joined #openstack-operators19:57
*** blair has joined #openstack-operators19:57
*** Piet has joined #openstack-operators19:58
*** alop has quit IRC20:00
*** blair has quit IRC20:02
klindgren__So - Op's here who aren't already doing so - running nscd on your API/compute servers is a good thing.  Turns out that intermittent dns responses can really play havoc with openstack.20:07
klindgren__And you got a number of weird errors that dont look like dns issues20:08
klindgren__like oslo.messaging connection reset by peer messages and ECONNRESET20:09
med_nods.20:10
* med_ looks up nscd... National Sports Center for the Disabled.20:11
jlkoh, yeah20:11
med_http://linux.die.net/man/8/nscd20:11
mgagneklindgren__: true. we are running dnsmasq here.20:11
*** klindgren__ is now known as klindgren20:11
mgagneklindgren__: any reason for nscd? "built-in" support?20:12
klindgrenmgagne, it caches locally on each server dns responses so if a dns server is down or responding itermittently querries will still work if they have been made in the past 10-15 minutes (or however long you cache stuff for)20:13
klindgrenand its mainly install nscd and start it20:13
klindgrenand goodness happens20:13
mgagnewill have to check it, I forgot about its existence =)20:14
*** dboik_ has joined #openstack-operators20:20
*** emagana has quit IRC20:21
*** dboik has quit IRC20:24
*** Marga_ has joined #openstack-operators20:26
*** kencjohnston has joined #openstack-operators20:27
*** Marga_ has quit IRC20:31
*** alop has joined #openstack-operators20:35
*** med_ has quit IRC20:36
*** j05h has joined #openstack-operators20:37
*** dboik_ has quit IRC20:48
*** blair has joined #openstack-operators20:49
*** dboik has joined #openstack-operators20:49
*** hitalia has joined #openstack-operators20:50
*** Rockyg has quit IRC20:51
*** Marga_ has joined #openstack-operators20:54
*** VW_ has quit IRC20:56
*** VW_ has joined #openstack-operators21:01
*** SimonChung1 has joined #openstack-operators21:03
*** SimonChung has quit IRC21:03
*** SimonChung has joined #openstack-operators21:03
*** SimonChung2 has joined #openstack-operators21:04
*** SimonChung has quit IRC21:04
*** SimonChung1 has quit IRC21:05
*** SimonChung2 has quit IRC21:05
*** SimonChung has joined #openstack-operators21:05
*** VW_ has quit IRC21:05
*** SimonChung1 has joined #openstack-operators21:05
*** SimonChung has quit IRC21:06
*** VW_ has joined #openstack-operators21:09
*** Marga_ has quit IRC21:23
*** Marga_ has joined #openstack-operators21:26
*** verdurin_afk is now known as verdurin21:28
*** esker has joined #openstack-operators21:30
*** kencjohnston has quit IRC21:37
*** esker has quit IRC21:41
*** j05h has quit IRC22:05
*** matrohon has quit IRC22:08
*** dboik has quit IRC22:15
*** Marga_ has quit IRC22:19
*** Marga_ has joined #openstack-operators22:20
*** pboros has quit IRC22:38
*** dboik has joined #openstack-operators22:42
*** Marga_ has quit IRC22:51
*** Marga_ has joined #openstack-operators22:52
*** dboik_ has joined #openstack-operators22:53
*** dboik has quit IRC22:56
*** markvoelker has quit IRC22:58
*** VW_ has quit IRC23:01
*** Marga_ has quit IRC23:06
*** Marga_ has joined #openstack-operators23:07
*** j05h has joined #openstack-operators23:09
*** j05h has quit IRC23:11
*** alop has quit IRC23:13
*** dboik_ has quit IRC23:32
*** dboik has joined #openstack-operators23:33
*** dboik_ has joined #openstack-operators23:35
*** dboik has quit IRC23:37
*** SimonChung has joined #openstack-operators23:42
*** SimonChung1 has quit IRC23:42
*** SimonChung1 has joined #openstack-operators23:43
*** SimonChung has quit IRC23:43
*** markvoelker has joined #openstack-operators23:47
*** markvoelker has quit IRC23:52
*** mdorman has quit IRC23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!