Friday, 2015-08-14

*** VW_ has joined #openstack-operators00:01
*** alop has quit IRC00:05
*** geoffarnold has quit IRC00:08
*** geoffarnold has joined #openstack-operators00:17
*** SimonChung has quit IRC00:29
*** stanchan has quit IRC00:32
*** geoffarnold has quit IRC00:38
*** saneax has quit IRC00:44
*** markvoelker has joined #openstack-operators00:51
*** markvoelker has quit IRC00:56
*** mdorman has quit IRC01:03
*** bhunter71 has joined #openstack-operators01:12
*** gfa is now known as gfa_01:36
*** gfa_ is now known as gfa01:37
*** markvoelker has joined #openstack-operators01:43
*** markvoelker has quit IRC01:48
*** ruagair has quit IRC02:48
*** ruagair has joined #openstack-operators02:48
*** hakimo has joined #openstack-operators02:53
*** hakimo_ has quit IRC02:55
*** markvoelker has joined #openstack-operators02:55
*** Marga_ has joined #openstack-operators02:56
*** Marga_ has quit IRC02:57
*** Marga_ has joined #openstack-operators02:58
*** pontusf has quit IRC03:31
*** pontusf has joined #openstack-operators03:33
*** VW_ has quit IRC04:00
*** VW_ has joined #openstack-operators04:00
*** VW_ has quit IRC04:05
*** SimonChung has joined #openstack-operators04:19
*** SimonChung1 has joined #openstack-operators04:20
*** SimonChung has quit IRC04:24
*** markvoelker has quit IRC04:26
*** morgan_404 is now known as morgan_20404:42
*** morgan_204 is now known as morgan_20604:44
*** morgan_206 is now known as morgan_50304:45
*** bhunter71 has quit IRC05:00
*** bvandenh has joined #openstack-operators05:22
*** saneax has joined #openstack-operators05:34
*** bvandenh has quit IRC05:38
*** chlong has quit IRC05:41
*** chlong has joined #openstack-operators05:44
*** fawadkhaliq has joined #openstack-operators05:48
*** fifieldt_ has quit IRC06:00
*** chlong has quit IRC07:36
*** matrohon has joined #openstack-operators07:38
*** chlong has joined #openstack-operators07:39
*** saneax has quit IRC07:43
*** michchap has quit IRC08:22
*** ferest has joined #openstack-operators08:37
*** mahito has quit IRC08:38
*** ferest has quit IRC08:45
*** VW_ has joined #openstack-operators09:25
*** matrohon has quit IRC09:29
*** VW_ has quit IRC09:30
*** matrohon has joined #openstack-operators10:20
*** ggillies has quit IRC11:39
*** delattec has joined #openstack-operators11:51
*** cdelatte has quit IRC11:53
*** delattec has quit IRC12:02
*** delattec has joined #openstack-operators12:02
*** markvoelker has joined #openstack-operators12:21
*** britthouser has joined #openstack-operators12:33
*** _nick has quit IRC12:33
*** britthou_ has joined #openstack-operators12:34
*** _nick has joined #openstack-operators12:34
*** britthouser has quit IRC12:38
*** radez is now known as radez_g0n312:48
*** britthou_ has quit IRC12:57
*** britthouser has joined #openstack-operators12:58
*** VW_ has joined #openstack-operators13:00
*** alaski is now known as lascii13:25
*** fifieldt has joined #openstack-operators13:30
*** jaypipes has joined #openstack-operators13:33
*** jaypipes has quit IRC13:39
*** radez_g0n3 is now known as radez13:41
*** jaypipes has joined #openstack-operators13:42
*** jaypipes is now known as leakypipes\13:43
*** jmckind has joined #openstack-operators13:46
*** leakypipes\ is now known as leakypipes13:47
*** jmckind has quit IRC13:52
*** maishsk has joined #openstack-operators13:59
*** jmckind has joined #openstack-operators14:02
*** mdorman has joined #openstack-operators14:15
*** chlong has quit IRC14:19
*** fawadkhaliq has quit IRC14:22
*** maishsk has quit IRC14:32
*** geoffarnold has joined #openstack-operators14:35
*** geoffarnold has quit IRC14:39
*** geoffarnold has joined #openstack-operators14:41
*** alejandrito has joined #openstack-operators14:44
alejandritohi, we have a KILO cloud under ubuntu, after a total power off of the cloud after restarting rabbitmq, mysql databases and every service, half of the instances (on the compute nodes) dont have the tap interfaces on their XML's and the linux interfaces tap - qvo - qvbe never gets created, doing hard reboots, etc doesnt recreate the taps, someone ran into this problem ?14:51
*** radez is now known as radez_g0n314:56
*** radez_g0n3 is now known as radez15:08
*** Piet has quit IRC15:19
*** alop has joined #openstack-operators15:24
*** laron has joined #openstack-operators15:33
*** VW_ has quit IRC15:37
*** VW_ has joined #openstack-operators15:38
*** radez is now known as radez_g0n315:38
*** alop has quit IRC15:43
*** alop has joined #openstack-operators15:44
*** matrohon has quit IRC16:04
*** bhunter71 has joined #openstack-operators16:27
*** Piet has joined #openstack-operators16:33
*** gyee has joined #openstack-operators16:37
*** david-lyle is now known as cbrown17:17
mfischmdorman: you around?17:19
*** radez_g0n3 is now known as radez17:28
*** Piet has quit IRC17:55
*** Piet has joined #openstack-operators18:16
*** VW_ has quit IRC18:20
*** VW_ has joined #openstack-operators18:21
*** fawadkhaliq has joined #openstack-operators18:30
mdormanmfisch:  yup what’s up?18:41
mdorman80 minutes later18:41
mdormanheh18:41
*** dminer has joined #openstack-operators18:43
mfischmdorman: no worries I was at lunch anyway18:45
mfischmdorman: you've been using rabbit with haproxy for awhile now right?18:45
mdormanwe used to in our lab environments to mimic what we had in prod (rmq behing a a10 lb).   but we moved away from that setup a while ago so now all the clients just connect directly via rabbimq_hosts instead of through the lb18:49
mfischokay, we just moved from that to the LB so we'd have an easier time with maintenance18:49
mfischits better than it was in kilo, nova-compute still is a piece of shit about reconnecting18:49
mfischsome other weirdness too but sounds like you're not the right guy to discuss it with18:50
mdormanklindgren probably has more swapped in to his brain to be able to talk intelligently about it.18:50
mdormanbut yeah my understanding is the newer oslo-messaging’s are better when you’re connecting through a LB18:50
mdormani mean regardless the client is going to see a reconnect18:51
mfischbetter but not perfect18:51
mfischnova-compute even if it reconnects randomly fails18:51
mdormanalthough i guess with a real LB you can set a longer drain time and hopefully clients move organically18:51
mfischyeah18:51
mfischthey dont18:51
mdormanwe haven’t really experienced that18:51
mfischwhich is what I'm wondering about18:51
mdormaninteresting18:51
mdormanso even when things are just running normally and you’re not restarting RMQ or whatever, nova-compute loses connections?18:52
mfischmdorman: let me get back to you in 518:53
mdormannp18:53
klindgrenyea - we moved back to list of hosts - even under 1.8.x when testing something was still not good with load blanacers.  SOme error that they hand't found/fixed18:55
mdormanpossible it’s something in RMQ itself, too.  we might be on a different version than you are18:56
klindgrenhonestly - list of hosts for us has been much better.  This is one of those do I use the thing that should make maintenance "easier"?  Or do I do the thing that make maintenace "harder" but lets our cloud actually stay up wihtout restarting services all the time18:57
klindgrenwe went with the later - after having nothing but problems with rabbitmq behind an lb18:57
klindgrenneutron - with the most unhelpful error messages ever: 2015-08-14 11:53:22.707 20919 INFO neutron.plugins.linuxbridge.agent.linuxbridge_neutron_agent [req-94a80bfc-709e-4e45-918a-c48f55b42fe8 ] Device tap2076ee2c-d8 not defined on plugin19:06
*** esker has quit IRC19:13
*** fawadkhaliq has quit IRC19:14
*** delattec has quit IRC19:53
*** VW_ has quit IRC20:04
*** VW_ has joined #openstack-operators20:04
*** alejandrito has quit IRC20:04
*** gyee has quit IRC21:09
*** lascii is now known as alaski21:11
*** radez is now known as radez_g0n321:11
*** cbrown is now known as david-lyle21:20
*** laron has quit IRC21:23
*** jmckind has quit IRC21:32
*** VW_ has quit IRC21:49
*** VW_ has joined #openstack-operators21:50
*** laron has joined #openstack-operators22:13
*** markvoelker has quit IRC22:15
*** laron has quit IRC22:17
*** VW_ has quit IRC22:37
*** VW_ has joined #openstack-operators22:37
*** ToMiles has joined #openstack-operators22:48
*** dminer has quit IRC22:49
*** mdorman has quit IRC22:58
*** saneax has joined #openstack-operators23:21
*** markvoelker has joined #openstack-operators23:31
*** markvoelker has quit IRC23:35

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!