Monday, 2016-12-12

*** tommylikehu_ has joined #openstack-oslo00:04
*** tommylikehu_ has quit IRC00:09
*** amotoki has joined #openstack-oslo00:14
*** ansmith has joined #openstack-oslo00:21
*** ansmith has quit IRC00:46
*** tovin07 has joined #openstack-oslo00:48
*** int32bit has joined #openstack-oslo00:50
*** tovin07_ has joined #openstack-oslo00:51
*** tovin07_ has quit IRC00:52
*** int32bit has quit IRC00:54
*** tovin07 has quit IRC00:56
*** tovin07 has joined #openstack-oslo00:57
*** tovin07_ has joined #openstack-oslo00:58
*** mtanino has joined #openstack-oslo01:35
*** gcb has joined #openstack-oslo01:47
*** mtanino has quit IRC01:50
*** tommylikehu_ has joined #openstack-oslo02:06
*** int32bit has joined #openstack-oslo02:09
*** amotoki has quit IRC02:11
*** tommylikehu_ has quit IRC02:14
*** int32bit_ has joined #openstack-oslo02:18
*** int32bit has quit IRC02:21
*** int32bit_ has quit IRC02:23
*** int32bit has joined #openstack-oslo02:28
*** spzala has joined #openstack-oslo02:30
*** spzala has quit IRC02:35
*** ozamiatin_ has quit IRC02:36
openstackgerritgecong proposed openstack/oslo.serialization: Replace six.iteritems() with .items()  https://review.openstack.org/40958202:50
openstackgerritgecong proposed openstack/oslo.utils: Replace six.iteritems() with .items()  https://review.openstack.org/40958303:06
openstackgerritOpenStack Proposal Bot proposed openstack/tooz: Updated from global requirements  https://review.openstack.org/34678203:48
*** nicolasbock has joined #openstack-oslo03:49
*** nicolasbock has quit IRC04:07
*** int32bit has quit IRC04:27
*** int32bit has joined #openstack-oslo04:28
*** tommylikehu_ has joined #openstack-oslo04:32
*** tommylikehu_ has quit IRC04:36
openstackgerritgecong proposed openstack/oslo.versionedobjects: Replace six.iteritems() with .items()  https://review.openstack.org/40960605:09
openstackgerritgecong proposed openstack/oslo.db: Replace six.iteritems() with .items()  https://review.openstack.org/40961005:30
*** tommylikehu_ has joined #openstack-oslo05:33
*** tommylikehu_ has quit IRC05:37
*** nkrinner_afk has quit IRC05:54
*** nkrinner has joined #openstack-oslo05:55
*** lifeless_ has quit IRC06:02
*** lifeless has joined #openstack-oslo06:03
*** lpetrut has joined #openstack-oslo06:07
*** yamahata has joined #openstack-oslo06:15
*** openstackgerrit_ has joined #openstack-oslo06:23
*** openstackgerrit_ has quit IRC06:25
*** openstackgerrit_ has joined #openstack-oslo06:26
*** openstackgerrit_ has quit IRC06:27
*** spzala has joined #openstack-oslo06:31
*** openstackgerrit_ has joined #openstack-oslo06:34
*** openstackgerrit_ has quit IRC06:35
*** spzala has quit IRC06:36
openstackgerritMerged openstack/oslo.serialization: Replaces uuid.uuid4 with uuidutils.generate_uuid()  https://review.openstack.org/40669506:41
*** oanson has joined #openstack-oslo06:43
openstackgerritMerged openstack/oslo.config: Replace six.iteritems() with .items()  https://review.openstack.org/40892606:46
*** nkrinner is now known as nkrinner_afk06:53
*** openstackgerrit_ has joined #openstack-oslo06:59
*** openstackgerrit_ has quit IRC07:00
*** eezhova has joined #openstack-oslo07:15
*** ihrachys has joined #openstack-oslo07:19
*** nkrinner_afk is now known as nkrinner07:22
*** yamamoto has quit IRC07:26
*** lpetrut has quit IRC07:27
*** eezhova has quit IRC07:43
*** int32bit_ has joined #openstack-oslo07:56
*** int32bit has quit IRC07:59
*** rasca has joined #openstack-oslo08:02
*** yamamoto has joined #openstack-oslo08:09
*** yamamoto_ has joined #openstack-oslo08:10
*** flaper87 has quit IRC08:11
*** flaper87 has joined #openstack-oslo08:11
*** dkehn_ has quit IRC08:11
*** dkehn_ has joined #openstack-oslo08:12
*** yamamoto has quit IRC08:13
*** yamamoto_ has quit IRC08:20
*** yamamoto has joined #openstack-oslo08:24
*** pcaruana has joined #openstack-oslo08:30
*** amoralej|off is now known as amoralej08:31
*** yamamoto has quit IRC08:34
*** pcaruana has quit IRC08:37
*** pcaruana has joined #openstack-oslo08:38
*** eezhova has joined #openstack-oslo08:41
*** tommylikehu has joined #openstack-oslo08:42
*** jpena|off is now known as jpena08:45
*** jpena is now known as jpena|off08:56
*** zzzeek has quit IRC09:00
*** tommylikehu_ has joined #openstack-oslo09:00
*** zzzeek has joined #openstack-oslo09:00
*** dtardivel has joined #openstack-oslo09:01
*** shardy has joined #openstack-oslo09:02
*** tommylikehu_ has quit IRC09:04
*** jpena|off is now known as jpena09:05
*** d0ugal has quit IRC09:09
*** shardy has quit IRC09:12
*** shardy has joined #openstack-oslo09:12
*** d0ugal has joined #openstack-oslo09:14
*** d0ugal has quit IRC09:14
*** d0ugal has joined #openstack-oslo09:14
*** bogdando has joined #openstack-oslo09:15
*** lpetrut has joined #openstack-oslo09:16
*** yassine has joined #openstack-oslo09:16
*** d0ugal has quit IRC09:17
*** d0ugal has joined #openstack-oslo09:19
*** yassine has joined #openstack-oslo09:23
*** yassine is now known as Guest7169009:23
*** Guest71690 has quit IRC09:24
*** lucas-pto is now known as lucasagomes09:24
*** eliqiao has quit IRC09:28
*** eliqiao has joined #openstack-oslo09:30
*** spzala has joined #openstack-oslo09:31
*** e0ne has joined #openstack-oslo09:32
*** yamahata has quit IRC09:33
*** spzala has quit IRC09:36
*** zhangguoqing has joined #openstack-oslo09:40
*** int32bit has joined #openstack-oslo09:41
*** int32bit_ has quit IRC09:41
*** int32bit has quit IRC09:46
*** yamamoto has joined #openstack-oslo09:48
*** int32bit has joined #openstack-oslo09:48
*** yamamoto has quit IRC09:49
*** jamespag` is now known as jamespage09:53
*** ihrachys has quit IRC09:57
*** yassine_ has joined #openstack-oslo09:59
*** tommylikehu_ has joined #openstack-oslo10:01
*** tommylikehu_ has quit IRC10:05
*** tovin07_ has quit IRC10:09
*** cdent has joined #openstack-oslo10:20
*** int32bit_ has joined #openstack-oslo10:20
*** int32bit has quit IRC10:23
*** yamamoto has joined #openstack-oslo10:27
*** yamamoto has quit IRC10:30
*** gibi has quit IRC10:32
*** cdent has quit IRC10:33
*** cdent has joined #openstack-oslo10:35
*** gibi has joined #openstack-oslo10:37
openstackgerritRoman Podoliaka proposed openstack/oslo.db: docs: mention that it's possible to use Connection directly  https://review.openstack.org/39321310:38
*** yamamoto has joined #openstack-oslo10:43
*** yamamoto has quit IRC10:51
*** mkoderer has joined #openstack-oslo10:52
*** ihrachys has joined #openstack-oslo11:01
*** tommylikehu_ has joined #openstack-oslo11:01
*** yamamoto has joined #openstack-oslo11:03
*** tommylikehu_ has quit IRC11:06
*** pblaho has joined #openstack-oslo11:07
*** yamamoto has quit IRC11:08
*** boden has joined #openstack-oslo11:09
*** pblaho1 has joined #openstack-oslo11:13
*** pblaho has quit IRC11:15
*** int32bit_ has quit IRC11:17
*** int32bit has joined #openstack-oslo11:19
*** int32bit has quit IRC11:23
*** sdague_ has joined #openstack-oslo11:24
*** sdague_ is now known as sdague11:31
*** mhickey has joined #openstack-oslo11:34
*** nicolasbock has joined #openstack-oslo11:35
*** cdent has quit IRC11:40
*** pblaho1 is now known as pblaho11:42
*** tommylikehu_ has joined #openstack-oslo12:02
*** yamamoto has joined #openstack-oslo12:04
*** yamamoto has quit IRC12:05
*** ozamiatin_ has joined #openstack-oslo12:07
*** tommylikehu_ has quit IRC12:07
*** tovin07_ has joined #openstack-oslo12:07
*** tommylikehu_ has joined #openstack-oslo12:09
*** tommylikehu_ has quit IRC12:14
*** shardy is now known as shardy_lunch12:26
*** tovin07__ has joined #openstack-oslo12:38
*** gordc has joined #openstack-oslo12:40
*** lucasagomes is now known as lucas-hungry12:44
*** pblaho has quit IRC12:46
*** cdent has joined #openstack-oslo12:49
*** cdent_ has joined #openstack-oslo12:51
openstackgerritgordon chung proposed openstack/oslo.messaging: support kombu4  https://review.openstack.org/40929412:52
*** cdent has quit IRC12:53
*** cdent_ is now known as cdent12:53
*** int32bit has joined #openstack-oslo13:01
*** gcb has quit IRC13:01
*** gibi has quit IRC13:01
*** bauwser is now known as bauzas13:01
*** int32bit has quit IRC13:05
*** gibi has joined #openstack-oslo13:08
*** int32bit has joined #openstack-oslo13:10
*** int32bit has quit IRC13:15
openstackgerritJulien Danjou proposed openstack/tooz: Add partitioner implementation  https://review.openstack.org/39860413:16
openstackgerritJulien Danjou proposed openstack/tooz: Add weight support to the hashring  https://review.openstack.org/40978713:16
*** pblaho has joined #openstack-oslo13:18
*** trown|outtypewww is now known as trown13:26
*** shardy_lunch is now known as shardy13:28
*** tovin07_ has quit IRC13:28
*** ansmith has joined #openstack-oslo13:32
*** tovin07_ has joined #openstack-oslo13:32
*** electrocucaracha has quit IRC13:35
*** electrocucaracha has joined #openstack-oslo13:35
*** rtheis has joined #openstack-oslo13:38
*** int32bit has joined #openstack-oslo13:42
*** tommylikehu_ has joined #openstack-oslo13:44
*** amoralej is now known as amoralej|lunch13:45
*** tommylikehu_ has quit IRC13:45
*** tommylikehu_ has joined #openstack-oslo13:45
openstackgerritMerged openstack/oslo.utils: Allow 'get_all_class_names' to pass kwargs  https://review.openstack.org/40937513:46
*** jpena is now known as jpena|lunch13:48
*** amotoki has joined #openstack-oslo13:50
*** bauzas has quit IRC13:53
*** bauzas has joined #openstack-oslo13:53
*** mhickey has quit IRC13:55
*** int32bit_ has joined #openstack-oslo13:56
*** int32bit has quit IRC13:56
*** amotoki has quit IRC14:01
*** lucas-hungry is now known as lucasagomes14:02
*** oanson has quit IRC14:02
*** int32bit_ has quit IRC14:12
*** zzzeek has quit IRC14:13
*** kgiusti has joined #openstack-oslo14:14
*** zzzeek has joined #openstack-oslo14:14
*** eezhova_ has joined #openstack-oslo14:16
*** purplerbot has quit IRC14:18
*** eezhova has quit IRC14:18
*** ozamiatin_ has quit IRC14:21
*** amoralej|lunch is now known as amoralej14:25
*** ozamiatin_ has joined #openstack-oslo14:27
*** mriedem has joined #openstack-oslo14:27
*** jamielennox is now known as jamielennox|away14:38
openstackgerritMehdi Abaakouk (sileht) proposed openstack/oslo.messaging: kafka: Remove Producer singleton  https://review.openstack.org/40823414:40
openstackgerritMehdi Abaakouk (sileht) proposed openstack/oslo.messaging: kafka: Don't hide unpack/unserialize exception  https://review.openstack.org/40915714:40
openstackgerritMehdi Abaakouk (sileht) proposed openstack/oslo.messaging: kafka: timeout is in milliseconds  https://review.openstack.org/40915614:40
openstackgerritMehdi Abaakouk (sileht) proposed openstack/oslo.messaging: kafka: remove no really implemented feature  https://review.openstack.org/40915914:40
openstackgerritMehdi Abaakouk (sileht) proposed openstack/oslo.messaging: kafka: return to poller when timeout is reach  https://review.openstack.org/40915814:40
openstackgerritMehdi Abaakouk (sileht) proposed openstack/oslo.messaging: kafka: disable batch for functional tests  https://review.openstack.org/40915514:40
*** jamielennox|away is now known as jamielennox14:45
*** spzala has joined #openstack-oslo14:46
*** spzala has quit IRC14:48
*** jpena|lunch is now known as jpena14:52
*** jdandrea has joined #openstack-oslo14:53
*** zhangguoqing has quit IRC14:56
*** purplerbot has joined #openstack-oslo15:02
*** pradk has joined #openstack-oslo15:04
*** mtanino has joined #openstack-oslo15:05
-openstackstatus- NOTICE: The Gerrit service on review.openstack.org is restarting now to address acute performance issues, and will be back online momentarily.15:06
*** cdent has quit IRC15:08
*** pkholkin has quit IRC15:15
*** pkholkin has joined #openstack-oslo15:15
*** bnemec has joined #openstack-oslo15:25
*** mhickey has joined #openstack-oslo15:33
*** tommylikehu_ has quit IRC15:37
*** gcb has joined #openstack-oslo15:42
*** lpetrut has quit IRC15:42
*** trown is now known as trown|brb15:51
*** harlowja_at_home has joined #openstack-oslo15:52
*** yamahata has joined #openstack-oslo15:56
*** dkehn_ has quit IRC16:01
*** dkehn_ has joined #openstack-oslo16:01
harlowja_at_homejd__, u got any time to look into http://status.openstack.org/openstack-health/#/g/build_name/periodic-cinder-py27-with-oslo-master ?16:02
harlowja_at_homei am thinking the change in tooz exception hierachy caused that16:02
*** tommylikehu_ has joined #openstack-oslo16:06
*** diablo_rojo has joined #openstack-oslo16:08
jd__harlowja_at_home: I'll look into it16:14
harlowja_at_homekk, if u don't have enough time i can also, i'm thinking exception review16:15
*** spzala has joined #openstack-oslo16:15
*** zz_dimtruck has joined #openstack-oslo16:16
*** zz_dimtruck is now known as dimtruck16:17
*** trown|brb is now known as trown16:18
*** shardy has quit IRC16:19
openstackgerritJulien Danjou proposed openstack/tooz: coordination: fix moved_class usage for ToozError  https://review.openstack.org/40985316:24
jd__harlowja_at_home: https://review.openstack.org/409853 that should be it16:24
harlowja_at_homejd__, nice nice, thx :)16:25
*** pradk- has joined #openstack-oslo16:28
*** pradk- has quit IRC16:28
*** pradk- has joined #openstack-oslo16:29
*** pradk- has quit IRC16:29
*** pradk- has joined #openstack-oslo16:30
*** pradk- has quit IRC16:30
*** pradk has quit IRC16:31
*** pradk has joined #openstack-oslo16:32
*** nkrinner is now known as nkrinner_afk16:32
*** kgiusti has quit IRC16:35
*** cdent has joined #openstack-oslo16:39
*** eezhova_ has quit IRC16:48
*** gcb has quit IRC16:49
*** harlowja_at_home has quit IRC16:55
*** tovin07_ has quit IRC16:57
*** jdandrea has quit IRC16:57
*** pcaruana has quit IRC16:59
openstackgerritNakul Dahiwade proposed openstack/oslo.versionedobjects: Add Dict and List as valid value types in String()  https://review.openstack.org/40873917:01
dhellmannharlowja, sileht : so what's the issue with kombu 4.x?17:03
*** ozamiatin_ has quit IRC17:10
*** mhickey has quit IRC17:12
*** mhickey has joined #openstack-oslo17:15
*** e0ne has quit IRC17:16
*** shardy has joined #openstack-oslo17:24
*** mhickey has quit IRC17:25
*** lpetrut has joined #openstack-oslo17:39
*** lucasagomes is now known as lucas-afk17:46
*** int32bit has joined #openstack-oslo17:51
*** int32bit has quit IRC17:56
*** openstack has joined #openstack-oslo17:58
*** trown is now known as trown|lunch17:58
*** jdandrea has joined #openstack-oslo17:59
*** ozamiatin_ has joined #openstack-oslo18:05
*** jpena is now known as jpena|away18:09
*** ihrachys has quit IRC18:18
*** harlowja has joined #openstack-oslo18:20
*** yamahata has quit IRC18:23
*** e0ne has joined #openstack-oslo18:31
*** kgiusti has joined #openstack-oslo18:35
*** rasca has quit IRC18:45
*** dharinic is now known as dharinic|lunch18:45
*** shardy is now known as shardy_afk18:50
*** Rockyg has joined #openstack-oslo18:50
*** ihrachys has joined #openstack-oslo18:53
*** Rockyg has quit IRC18:54
*** Rockyg has joined #openstack-oslo18:54
*** ihrachys has quit IRC18:57
*** lpetrut has quit IRC19:00
*** trown|lunch is now known as trown19:01
*** jdandrea has quit IRC19:09
*** jdandrea has joined #openstack-oslo19:11
*** yamahata has joined #openstack-oslo19:20
*** dharinic|lunch is now known as dharinic19:40
*** jamielennox is now known as jamielennox|away19:46
*** edmondsw has joined #openstack-oslo19:50
*** amoralej is now known as amoralej|off19:51
*** edmondsw has quit IRC19:52
*** jamielennox|away is now known as jamielennox19:53
*** SamYaple has joined #openstack-oslo20:02
*** ozamiatin__ has joined #openstack-oslo20:02
*** dimtruck is now known as zz_dimtruck20:03
SamYaplehello. i have a question about oslo.messaging. In ceilometer and rabbitmq I am getting lots of "bad record mac" and "record overflow".20:03
SamYaplethrough much google fu, ive found something that might explain why "FWIW, I figured this out - it ended up being concurrent access to the socket file descriptor due to a forked child process causing the MAC calculations to be wrong."20:03
SamYapleis this a problem that is know to anyone?20:03
SamYaplethis would be rabbitmq using ssl20:03
SamYaplethe quote above isn't from anything openstack related, but using ampq20:04
*** cdent has quit IRC20:06
*** mtanin___ has joined #openstack-oslo20:07
*** mtanino has quit IRC20:09
gordcSamYaple: can you paste the full error? maybe in a bug. you might want to include oslo.messaging/ceilometer/rabbit/kombu versions.20:13
SamYaplegordc: ill see if I can get that info (its in an environment i dont have access to an have to communicate through someone else for)20:14
SamYaplegordc: off the top of your head, do you know how oslo.messaging forks?20:14
SamYaplesaw in some docs that these errors can be caused by "unintentional socket sharing in the client (e.g. due to the use of fork(2))"20:14
SamYaplewhich the above message agrees with20:15
gordcSamYaple: do you know if the error is in notification agent logs or polling agent logs?20:17
SamYaplechecking20:18
gordcin notification agent, prior to Newton, there were a lot of threads20:18
gordcit's possible that's the case... but i've never seen your issue tbh20:18
SamYaplecollector logs20:18
gordcnot an oslo.messaging person either.20:18
gordcoh. hmm20:18
SamYapleyea, its a few 1000 messages a day like this20:19
SamYaple48 workers20:19
SamYaplessl rabbit20:19
gordc... you have 48 collector workers?20:19
SamYaplei mean _I_ don't, but yea the evironment does20:19
SamYaplei know nothing beyond being brought in about 2 hours ago20:20
gordclol understood20:20
gordcum. so if you're using default oslo.messaging rabbit configurations. it'll give you 64threads per listener20:20
gordceach collector has it's own listener20:20
SamYaple3000ish threads sounds right20:21
gordcthat seems like a lot... but i don't have a large environment.20:22
SamYaplei think this one is 300+ computes20:22
SamYaplewith high rate of vm churn20:22
gordcdo you ahve 48 notification agent workers too?20:24
SamYapleno i mean the environment im talking about20:24
SamYaplei personally stay away from ceilometer20:24
gordcfair enough. i think if you can get full error that'd help.20:26
SamYapleindeed. ill work on it. im going to try to confirm that a single worker doesnt presnt the issue20:27
SamYapleto see if I can point to forking being the issue20:27
gordcSamYaple: i only have 1 collector and notification agent worker with little load (only 50VM though)20:27
SamYaplealthough I did just follow the code to oslo_service and also service is indeed using os.fork() which means ceilometer is forking in the bad way that will cause this issue according to rabbitmq20:28
SamYaplenot sure if this makes it a ceilomter or oslo_messaging bug to be honest20:29
gordcSamYaple: what version of ceilometer is this?20:30
SamYaplemitaka20:30
*** lpetrut has joined #openstack-oslo20:30
gordcoh. ok. yeah we stopped using oslo.service in newton.20:31
SamYapletime to upgrade! :P20:32
SamYaplehow is forking done now?20:32
SamYaplethis seems like a hard issue to work around20:32
*** zz_dimtruck is now known as dimtruck20:32
gordcwe use cotyledon to manage services... i'm not familiar with how it works exactly20:33
gordchttps://github.com/sileht/cotyledon20:33
SamYaplethanks gordc. ill dig a little20:33
gordcnp. you could ping owner. he's based in France though20:34
SamYapleowner of cotyledon?20:34
SamYapleoh! sileht20:34
*** dtardivel has quit IRC20:34
SamYapleive talked to him before20:34
gordcyeah :) he owns everything.20:34
*** mhickey has joined #openstack-oslo20:40
*** spzala has quit IRC20:40
*** mtanino has joined #openstack-oslo20:40
*** spzala has joined #openstack-oslo20:41
*** mtanin___ has quit IRC20:42
*** spzala_ has joined #openstack-oslo20:43
*** spzala has quit IRC20:45
*** spzala_ has quit IRC20:48
*** shardy_afk has quit IRC20:49
*** ihrachys has joined #openstack-oslo20:50
*** oanson has joined #openstack-oslo20:56
openstackgerritKen Giusti proposed openstack/oslo.messaging: [AMQP 1.0] Propagate authentication errors to caller  https://review.openstack.org/40991820:57
*** mtanin___ has joined #openstack-oslo20:58
*** mtanino has quit IRC20:59
*** jdandrea has quit IRC21:08
*** ansmith has quit IRC21:12
*** jpena|away is now known as jpena|off21:15
*** rtheis has quit IRC21:15
*** lpetrut has quit IRC21:25
*** mtanino has joined #openstack-oslo21:33
*** mtanin___ has quit IRC21:34
*** ozamiatin_ has quit IRC21:49
*** oanson has quit IRC21:50
*** eezhova_ has joined #openstack-oslo21:57
*** amotoki has joined #openstack-oslo21:57
*** jdandrea has joined #openstack-oslo21:59
*** trown is now known as trown|outtypewww22:05
*** jpena|off is now known as jpena22:05
*** diablo_rojo has quit IRC22:05
*** amotoki has quit IRC22:10
*** jdandrea has quit IRC22:10
*** ihrachys has quit IRC22:11
*** amotoki has joined #openstack-oslo22:14
*** e0ne has quit IRC22:15
*** amotoki has quit IRC22:15
*** ozamiatin__ has quit IRC22:18
*** yamamoto has joined #openstack-oslo22:22
*** eezhova_ has quit IRC22:24
*** kgiusti has left #openstack-oslo22:50
*** spzala has joined #openstack-oslo22:51
*** jpena is now known as jpena|off22:55
*** tommylikehu_ has quit IRC23:23
*** tommylikehu_ has joined #openstack-oslo23:23
*** mkoderer has quit IRC23:36
*** pradk has quit IRC23:40
*** gordc has quit IRC23:43
*** spzala has quit IRC23:44
*** spzala has joined #openstack-oslo23:44

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!