Monday, 2015-06-15

*** manishg has quit IRC00:18
*** ozamiatin has joined #openstack-oslo00:38
*** sputnik13 has quit IRC00:45
*** ozamiatin has quit IRC01:00
*** ozamiatin has joined #openstack-oslo01:01
*** ozamiatin has quit IRC01:43
*** r0j4z0 has quit IRC02:04
*** dimsum__ has quit IRC02:22
*** dimsum__ has joined #openstack-oslo02:36
*** vilobhmm has joined #openstack-oslo02:55
*** dimsum__ has quit IRC02:58
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.concurrency: Updated from global requirements  https://review.openstack.org/19161303:12
openstackgerritOpenStack Proposal Bot proposed openstack/taskflow: Updated from global requirements  https://review.openstack.org/19161403:13
openstackgerritOpenStack Proposal Bot proposed openstack/tooz: Updated from global requirements  https://review.openstack.org/19161503:13
openstackgerritOpenStack Proposal Bot proposed openstack/automaton: Updated from global requirements  https://review.openstack.org/19161603:13
*** tobe has joined #openstack-oslo03:20
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.cache: Updated from global requirements  https://review.openstack.org/19161703:20
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.reports: Updated from global requirements  https://review.openstack.org/19161803:20
*** salv-orl_ has quit IRC03:55
*** vilobhmm has quit IRC03:55
*** amotoki has joined #openstack-oslo03:56
*** dimsum__ has joined #openstack-oslo03:58
*** dimsum__ has quit IRC04:03
*** amotoki has quit IRC04:04
*** achanda has joined #openstack-oslo04:07
*** amotoki has joined #openstack-oslo04:08
*** achanda has quit IRC04:17
*** amotoki has quit IRC04:31
*** takedakn has joined #openstack-oslo04:35
*** takedakn has quit IRC04:39
*** rpodolyaka1 has joined #openstack-oslo04:40
*** amotoki has joined #openstack-oslo04:41
*** rpodolyaka1 has quit IRC04:49
*** manishg has joined #openstack-oslo04:53
*** arnaud___ has joined #openstack-oslo04:54
*** sdake_ has joined #openstack-oslo04:56
*** sdake has quit IRC04:59
*** rpodolyaka1 has joined #openstack-oslo05:08
*** nkrinner has joined #openstack-oslo05:20
openstackgerritMerged openstack/taskflow: Updated from global requirements  https://review.openstack.org/19161405:28
*** manishg has quit IRC05:46
*** rpodolyaka1 has quit IRC05:51
*** r0j4z0 has joined #openstack-oslo05:52
*** tteggel has quit IRC05:59
*** tteggel has joined #openstack-oslo06:01
*** Kennan2 has joined #openstack-oslo06:03
*** Kennan has quit IRC06:04
*** vilobhmm has joined #openstack-oslo06:12
*** Kennan2 is now known as Kennan06:14
*** vilobhmm has quit IRC06:16
*** vilobhmm has joined #openstack-oslo06:17
*** ihrachyshka has joined #openstack-oslo06:23
openstackgerritLei Zhang proposed openstack/oslotest: Avoid automatic mock replacements  https://review.openstack.org/19166506:26
*** shardy has joined #openstack-oslo06:29
*** pblaho has joined #openstack-oslo06:31
*** takedakn has joined #openstack-oslo06:39
*** ihrachyshka has quit IRC06:42
*** tobe has quit IRC06:44
*** arnaud___ has quit IRC06:44
*** takedakn has quit IRC06:46
*** sdake has joined #openstack-oslo06:56
*** sdake has quit IRC06:57
*** sdake has joined #openstack-oslo06:57
*** sdake_ has quit IRC07:00
*** rpodolyaka1 has joined #openstack-oslo07:00
*** tobe has joined #openstack-oslo07:07
*** dulek has joined #openstack-oslo07:21
*** prad has quit IRC07:27
*** subscope has joined #openstack-oslo07:34
*** ndipanov has joined #openstack-oslo07:42
*** prad has joined #openstack-oslo07:42
*** rpodolyaka1 has quit IRC07:47
*** salv-orlando has joined #openstack-oslo07:48
*** browne has quit IRC07:50
*** r0j4z0 has quit IRC07:55
*** pblaho has quit IRC07:59
*** ozamiatin has joined #openstack-oslo08:01
*** sdake has quit IRC08:06
*** ihrachyshka has joined #openstack-oslo08:10
*** haypo has joined #openstack-oslo08:11
*** vilobhmm has quit IRC08:11
*** haypo has quit IRC08:11
*** pblaho has joined #openstack-oslo08:14
*** yassine has joined #openstack-oslo08:23
*** rpodolyaka1 has joined #openstack-oslo08:23
*** pblaho has quit IRC08:29
*** shardy_ has joined #openstack-oslo08:38
*** shardy has quit IRC08:39
*** takedakn has joined #openstack-oslo08:42
*** Daviey has joined #openstack-oslo08:42
*** ozamiatin has quit IRC08:43
*** takedakn has quit IRC08:43
*** shardy_ has quit IRC08:44
*** shardy has joined #openstack-oslo08:44
*** ozamiatin has joined #openstack-oslo08:45
*** r0j4z0 has joined #openstack-oslo08:47
*** subscope has quit IRC08:54
*** rpodolyaka1 has quit IRC08:57
*** rpodolyaka1 has joined #openstack-oslo08:59
openstackgerritMehdi Abaakouk (sileht) proposed openstack/oslo.messaging: Disable aioeventlet tests for py3  https://review.openstack.org/19099309:01
*** ozamiatin has quit IRC09:03
*** pblaho has joined #openstack-oslo09:03
*** pblaho has quit IRC09:17
*** e0ne has joined #openstack-oslo09:30
*** rushiagr_away is now known as rushiagr09:34
*** e0ne has quit IRC09:40
*** ozamiatin has joined #openstack-oslo09:44
*** e0ne has joined #openstack-oslo09:47
*** salv-orl_ has joined #openstack-oslo09:51
*** salv-orlando has quit IRC09:52
*** f13o has joined #openstack-oslo09:56
*** Kennan2 has joined #openstack-oslo10:03
*** Kennan has quit IRC10:05
*** dimsum__ has joined #openstack-oslo10:09
*** ozamiatin has quit IRC10:10
*** arnaud___ has joined #openstack-oslo10:11
*** rpodolyaka1 has quit IRC10:15
*** arnaud___ has quit IRC10:15
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo-incubator: Just use os.urandom instead of Crypto.Random  https://review.openstack.org/19158110:27
*** ozamiatin has joined #openstack-oslo10:30
*** e0ne is now known as e0ne_10:32
*** r0j4z0 has quit IRC10:36
*** e0ne_ has quit IRC10:39
*** e0ne has joined #openstack-oslo10:41
*** jaypipes has joined #openstack-oslo11:00
*** rushiagr is now known as rushiagr_away11:15
*** dguitarbite has joined #openstack-oslo11:16
*** pblaho has joined #openstack-oslo11:18
*** rpodolyaka1 has joined #openstack-oslo11:20
*** shardy_ has joined #openstack-oslo11:22
*** shardy has quit IRC11:24
*** tobe has quit IRC11:25
*** rushiagr_away is now known as rushiagr11:27
*** shardy_ has quit IRC11:28
*** r0j4z0 has joined #openstack-oslo11:29
*** shardy has joined #openstack-oslo11:29
*** e0ne is now known as e0ne_11:36
openstackgerritElena Ezhova proposed openstack/oslo.service: Add documentation for the service module  https://review.openstack.org/19176811:38
*** e0ne_ is now known as e0ne11:39
openstackgerritElena Ezhova proposed openstack/oslo.service: Add documentation for the service module  https://review.openstack.org/19176811:41
*** sdake has joined #openstack-oslo11:54
*** sdake has quit IRC11:55
*** sdake has joined #openstack-oslo11:55
*** pblaho has quit IRC11:55
*** stpierre has joined #openstack-oslo12:04
*** rpodolyaka1 has quit IRC12:07
*** rpodolyaka1 has joined #openstack-oslo12:11
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Enable amqp's protocol unit tests everywhere  https://review.openstack.org/18667112:16
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Use `inferred=True` by default  https://review.openstack.org/19177812:16
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Enable amqp's protocol unit tests everywhere  https://review.openstack.org/18667112:17
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Use `inferred=True` by default  https://review.openstack.org/19177812:17
*** amrith is now known as _amrith_12:19
*** e0ne is now known as e0ne_12:28
*** e0ne_ is now known as e0ne12:28
*** prad has quit IRC12:30
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo-incubator: Crypto.Random.atfork before fetching random bytes  https://review.openstack.org/19158112:31
*** gentux has joined #openstack-oslo12:36
gentuxHi there, I got a question from another team in my company : They want oslo.config to load variable from environment variable12:42
*** shardy_ has joined #openstack-oslo12:43
gentuxis there anything is oslo to do something like that ?12:43
*** shardy has quit IRC12:47
*** bknudson has joined #openstack-oslo12:48
ihrachyshkagentux, why not just reading the variable?12:50
*** shardy_ has quit IRC12:50
ihrachyshkaI mean, directly12:50
*** shardy has joined #openstack-oslo12:51
*** dimsum__ has quit IRC12:52
*** f13o has quit IRC12:54
*** dimsum__ has joined #openstack-oslo12:54
*** dimsum__ is now known as dims12:55
gentuxThey want oslo.config to read variable directly from OS environment vars instead of configuration *.ini files12:55
dhellmanngentux: we don't have anything like that right now. Which option do they want to control via the environment?12:55
*** exploreshaifali has joined #openstack-oslo12:55
*** dims has quit IRC12:55
*** dims has joined #openstack-oslo12:56
gentuxthat's the problem, they want to generalize this concept and be able to load any configuration value from OS instead of ini file.12:56
*** shardy has quit IRC12:56
gentuxIt seems some projet made a simple script to generate ini file from OS environment and then merge two ini files12:57
dhellmannok, the config parser supports some constructs that would be very difficult to express as environment variables12:57
dhellmannyou don't need to merge the files if you use the --config-dir option12:57
dhellmanngentux: how are the environment variables set in the first place?12:58
gentuxI'll ask them, I'll be back in 5min13:00
*** shardy has joined #openstack-oslo13:01
*** cdent has joined #openstack-oslo13:08
*** jaosorior has joined #openstack-oslo13:10
*** rushiagr is now known as rushiagr_away13:14
gentuxwell, it's not that clear. They are building a proof of concept close to what kolla does13:14
gentuxhttp://lists.openstack.org/pipermail/openstack-dev/2015-February/056144.html13:14
sdakegentux i think we are abanonding that idea13:15
sdakefyi :)13:15
gentuxsdake: I can understand that, the more I think about the more I find that quite hard to implement13:15
sdakewe have an implementation13:16
gentuxI'll dig it a little more, if I have some good information for you I'll share it here13:16
gentuxsdake: do you know where I can find this implementation ?13:17
*** yassine has quit IRC13:18
*** yassine has joined #openstack-oslo13:19
*** prad has joined #openstack-oslo13:23
sdakegentux moment13:25
*** mriedem has joined #openstack-oslo13:27
sdakegentux     https://review.openstack.org/#/c/182168/13:27
sdakegentux for more details check:13:28
sdakeor maybe its less details:13:28
sdakehttps://review.openstack.org/#/c/189157/4/specs/ansible-multi.rst13:28
gentuxok, thanks sdake13:29
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Enable amqp's protocol unit tests everywhere  https://review.openstack.org/18667113:34
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Use `inferred=True` by default  https://review.openstack.org/19177813:34
openstackgerritOleksii Zamiatin proposed openstack/oslo-specs: New ZeroMQ driver implementation details  https://review.openstack.org/18733813:34
*** kgiusti has joined #openstack-oslo13:37
*** _amrith_ is now known as amrith13:37
*** ccrouch has joined #openstack-oslo13:37
*** superdan is now known as dansmith13:49
*** rpodolyaka1 has quit IRC13:50
*** rpodolyaka1 has joined #openstack-oslo13:50
*** jecarey has joined #openstack-oslo13:51
*** claudiub has joined #openstack-oslo13:52
*** amotoki has quit IRC13:54
*** stevemar has joined #openstack-oslo14:12
*** shardy_ has joined #openstack-oslo14:13
*** shardy has quit IRC14:15
*** arnaud___ has joined #openstack-oslo14:18
*** shardy_ has quit IRC14:19
*** shardy has joined #openstack-oslo14:19
*** openstackgerrit has quit IRC14:24
*** openstackgerrit has joined #openstack-oslo14:24
*** bnemec has joined #openstack-oslo14:24
*** ozamiatin has quit IRC14:25
*** achanda has joined #openstack-oslo14:27
*** sigmavirus24_awa is now known as sigmavirus2414:28
openstackgerritVipin Balachandran proposed openstack/oslo.vmware: Exception hierarchy refactoring - part 1  https://review.openstack.org/11450314:32
*** rpodolyaka1 has quit IRC14:35
*** arnaud___ has quit IRC14:39
*** achanda has quit IRC14:42
openstackgerritMerged openstack/oslo.cache: Updated from global requirements  https://review.openstack.org/19161714:43
*** browne has joined #openstack-oslo14:52
*** tsekiyama has joined #openstack-oslo14:53
*** achanda has joined #openstack-oslo14:53
*** dulek has quit IRC14:53
*** ozamiatin has joined #openstack-oslo14:54
*** rpodolyaka1 has joined #openstack-oslo14:56
*** achanda_ has joined #openstack-oslo14:58
*** zzzeek has joined #openstack-oslo14:58
flaper87sileht: how would you feel with always installing uuid-devel/swig and the amqp1-requirements ?14:58
flaper87otherwise I'll have to put back the ImportError thing in the amqp1 tests14:59
flaper87which I really don't want because that misguides14:59
silehtflaper87, I'm feeling good15:00
*** achanda has quit IRC15:00
flaper87sileht: cool, will do that :D15:01
*** amotoki has joined #openstack-oslo15:01
*** nkrinner has quit IRC15:01
*** ozamiatin has quit IRC15:02
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Enable amqp's protocol unit tests everywhere  https://review.openstack.org/18667115:13
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Use `inferred=True` by default  https://review.openstack.org/19177815:13
*** ihrachyshka has quit IRC15:13
krotscheckI made a change in https://review.openstack.org/#/c/190753/ to oslo_middleware that could use some discussion.15:13
silehtflaper87, we cannot put the pyngus requirement into requirements.txt ?15:14
krotscheckIn particular, whether request should be optinoal or not.15:14
krotscheckNot making it optional: Breaking change.15:14
krotscheckBut perhaps more consistent.15:14
krotscheckMaking it optional, not breaking change.15:15
flaper87sileht: apparently no (or not yet)15:20
flaper87ideally, we should have them in test-requirements15:20
flaper87but right now that'll make the requirements job fail15:20
flaper87I need to talk to lifeless15:20
silehtflaper87, pyngus is still not  into global-requirements  ?15:20
*** e0ne is now known as e0ne_15:22
openstackgerritMerged openstack/oslo.concurrency: Updated from global requirements  https://review.openstack.org/19161315:23
*** sdake_ has joined #openstack-oslo15:23
*** browne has quit IRC15:23
silehtflaper87, it should be now, the installation through pip works well now.15:23
silehtflaper87, have you proposed a patch to raise the requirement to 1.3.1 ?15:24
flaper87sileht: wait, pyngus is in global-requirements but the version 1.2.0 is. We need 1.3.1, which requires changes in devstack to install those 2 packages15:25
flaper87which is what I was discussing with sdague earlier in -qa15:25
flaper87eventually, AFAIU, pyngus should not be in g-r15:25
silehtflaper87, now we don't care of devstack15:26
silehtflaper87, we can just raise the requirement15:26
*** Kevin_Bishop has joined #openstack-oslo15:26
flaper87sileht: exactly, but pyngus 1.3.1 can't land in requirements since that change in devstack because the requirements test will try to install it15:26
*** sdake has quit IRC15:27
flaper87Therefore, I'm forced to keep it in a separate requirements for now until that thing is cleared out15:27
flaper87sileht: does that make sense?15:27
flaper87Eventually, I'd guess pyngus should go to test-requirements.txt15:27
flaper87but again, I need  to talk w/ lifeless about that15:28
silehtflaper87, the requirements tests should not depends on devstack ...15:28
silehtflaper87, ok15:28
Kevin_BishopHi, I noticed that oslo_service is not listed in openstack's global-requirements.txt. Is there a reason for this?15:28
dimsKevin_Bishop: we just started this work in liberty cycle, api is not yet ready15:28
Kevin_Bishopdims ok great, thank you15:29
silehtflaper87, got it, let's land that as-is, so and move it to requirements later, the requirements testing issue is fixed15:29
sileht"later when the requirements testing issue is fixed"15:29
*** manishg has joined #openstack-oslo15:30
*** rpodolyaka1 has quit IRC15:30
*** e0ne_ has quit IRC15:32
*** pradk has joined #openstack-oslo15:33
*** e0ne has joined #openstack-oslo15:35
*** isq_ has quit IRC15:39
*** isq_ has joined #openstack-oslo15:39
*** r0j4z0 has quit IRC15:41
*** harlowja_at_home has joined #openstack-oslo15:43
*** pradk has quit IRC15:43
*** rpodolyaka1 has joined #openstack-oslo15:45
*** jaosorior has quit IRC15:45
*** ozamiatin has joined #openstack-oslo15:46
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Enable amqp's protocol unit tests everywhere  https://review.openstack.org/18667115:46
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Use `inferred=True` by default  https://review.openstack.org/19177815:46
flaper87sileht: I'll get it right, I swear ^15:46
dims5 mins to oslo meeting on #openstack-meeting-alt15:55
*** yassine has quit IRC15:57
harlowja_at_homewho wants to review super-awesome example of a state-machine @ https://review.openstack.org/#/c/191477/15:57
openstackgerritQin Zhao proposed openstack/oslo.vmware: Add a locale param to allow locale specification.  https://review.openstack.org/17810415:57
harlowja_at_homethat oddly looks like the same machine as http://www.boost.org/doc/libs/1_55_0/libs/msm/doc/HTML/ch03s02.html#d0e358 ;)15:57
harlowja_at_home^ what a weird coincidence ;)15:58
*** ihrachyshka has joined #openstack-oslo15:58
dimsharlowja_at_home: my kids were impressed when i told them if the just turned around the "cassette tape" there's a whole new set of songs :) they had never seen one before15:59
harlowja_at_homelol15:59
harlowja_at_homeah, the good ole days15:59
*** manishg has quit IRC15:59
dims:) will check it out after the meeting harlowja_at_home16:00
ihrachyshkashow them how to play music with a nail and a vynil16:00
harlowja_at_homenp :)16:00
ihrachyshkadims, hm. is it openstack-meeting-3?16:01
*** manishg has joined #openstack-oslo16:01
ihrachyshkadims, cause there is chef meeting starting there16:01
harlowja_at_homereminds me of the hipster stuff like @ https://imgur.com/ENeBi lol16:01
dims#openstack-meeting-alt16:01
ihrachyshkaah, openstack is about change, right!16:01
ihrachyshkathanks16:02
*** ashleighfarnham has joined #openstack-oslo16:02
ihrachyshkahm, no change, it's my calendar showing some obsolete entries, sorry16:02
*** Guest67074 is now known as redrobot16:02
*** exploreshaifali has quit IRC16:02
*** jaypipes has quit IRC16:03
amrith./16:03
*** jaypipes has joined #openstack-oslo16:05
*** ashleighfarnham has quit IRC16:09
*** ashleighfarnham has joined #openstack-oslo16:09
*** sdake has joined #openstack-oslo16:11
*** salv-orlando has joined #openstack-oslo16:12
*** hogepodge has quit IRC16:13
*** sdake_ has quit IRC16:14
*** salv-orl_ has quit IRC16:16
*** ashleighfarnham has quit IRC16:17
*** hogepodge has joined #openstack-oslo16:20
*** ganso_ has joined #openstack-oslo16:22
*** zz_jgrimm is now known as jgrimm16:22
*** ashleighfarnham has joined #openstack-oslo16:25
*** sputnik13 has joined #openstack-oslo16:30
*** vilobhmm has joined #openstack-oslo16:30
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Enable amqp's protocol unit tests everywhere  https://review.openstack.org/18667116:36
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Use `inferred=True` by default  https://review.openstack.org/19177816:36
ganso_Hello folks. I am trying to use processutils from oslo_concurrency to run a rsync command with --progress and display progress in stdout, but the command does not output anything to stdout while it is running. Is there another command or library in oslo that is able to accomplish this?16:42
openstackgerritMerged openstack/taskflow: Remove all 'lock_utils' now that fasteners provides equivalents  https://review.openstack.org/18862916:46
*** browne has joined #openstack-oslo16:51
*** harlowja_at_home has quit IRC16:53
*** exploreshaifali has joined #openstack-oslo17:00
*** jdandrea has joined #openstack-oslo17:01
*** e0ne has quit IRC17:02
openstackgerritIhar Hrachyshka proposed openstack/oslo.rootwrap: daemon: avoid raising UnboundLocalError to callers  https://review.openstack.org/19189517:02
*** rpodolyaka1 has quit IRC17:05
*** ozamiatin has quit IRC17:14
jdandreaIs anyone aware of (and can point me toward) add-ons to OpenStack projects (e.g., heat, nova, cinder, neutron, et. al) that use oslo config files that are *separate* from the project config files?17:17
openstackgerritMerged openstack/oslo.log: Switch badges from 'pypip.in' to 'shields.io'  https://review.openstack.org/19090617:20
openstackgerritMerged openstack/oslo.messaging: Switch badges from 'pypip.in' to 'shields.io'  https://review.openstack.org/19090417:22
dhellmannjdandrea: I'm not sure I understand what you mean. We have lots of drivers that define options not used directly by the applications, and we have a --config-dir option to allow an app to be run using more than one config file at a time. Can you give more detail about what you're trying to do?17:22
*** manishg has quit IRC17:23
*** manishg has joined #openstack-oslo17:24
jdandreaI have a Heat plugin that isn't tied to any other project/server/etc. and has it's own config (just a few options). Right now the only thing I can seem to access via cfg.CONF is Heat's /etc/heat/heat.conf ... but me putting my options in there is reportedly not a good idea.17:24
openstackgerritMerged openstack/oslo.concurrency: Switch badges from 'pypip.in' to 'shields.io'  https://review.openstack.org/19090517:24
openstackgerritMerged openstack/oslo.db: Switch badges from 'pypip.in' to 'shields.io'  https://review.openstack.org/19090717:25
jdandreaI also looked at the config docs and it wasn't clear to me how I'd use it for my own separate config.17:25
dhellmannjdandrea: the deployer can launch the app with --config-dir (set to something like /etc/heat) and then you can use a separate file17:25
openstackgerritMerged openstack/stevedore: Switch badges from 'pypip.in' to 'shields.io'  https://review.openstack.org/19091117:25
openstackgerritMerged openstack/oslo.serialization: Switch badges from 'pypip.in' to 'shields.io'  https://review.openstack.org/19090317:26
jdandreaI'm afraid I'm a bit naive here. Deployer? When I start heat I imagine the config dir is already /etc/heat by default (?).17:26
openstackgerritMerged openstack/taskflow: Switch badges from 'pypip.in' to 'shields.io'  https://review.openstack.org/19090917:26
openstackgerritMerged openstack/debtcollector: Switch badges from 'pypip.in' to 'shields.io'  https://review.openstack.org/19091017:26
openstackgerritMerged openstack/oslo.config: Switch badges from 'pypip.in' to 'shields.io'  https://review.openstack.org/19090217:26
dimsjdandrea: here's a stripped down example - https://gist.github.com/dims/19cb6ee280c3177fbf5217:26
jdandreaThanks, dims. Studying it ...17:27
*** dims has quit IRC17:27
*** crc32 has joined #openstack-oslo17:27
*** dims has joined #openstack-oslo17:28
jdandreadims: How does that example know to use /etc/my.conf specifically? (Don't see it referenced in the app.py code) ... unless that should read /etc/app.conf ... and then as far as sys.argv[1:] I am not sure what is passed in on the cmd line that CONF will expect. *checking source*17:31
dhellmannjdandrea: the --config-dir doesn't have a default, IIRC, only --config-file, so it may depend on how heat is launched17:33
dhellmannjdandrea: once the config files are loaded, oslo.config doesn't differentiate on where the values come from, so it doesn't actually matter to your code which file the configuration settings live in17:33
dimsjdandrea: the conf file should have been named app.conf not my.conf (see line 10 of app.py)17:34
jdandreadims: Got it, thank you!17:34
jdandreadhellmann: Ooh, interesting.17:34
dhellmannjdandrea: what you want to avoid, though, is having to update heat to tell it what files to load based on plugins. That's why we have --config-dir17:35
jdandreadhellmann: Yeah, I see what you mean, and I can't control *how* heat is launched in this case. Hmm ...17:35
*** crc32 has quit IRC17:35
dimsjdandrea: you can create an instance of ConfigOpts() instead of using cfg.CONF17:35
dhellmannjdandrea: right, so the actual location of the config settings is not something you should worry about in your code.17:35
openstackgerritMerged openstack/oslo.utils: Switch badges from 'pypip.in' to 'shields.io'  https://review.openstack.org/19090117:36
jdandreadhellmann: Thank goodness. :)  ... but I've been told "you should not put your third party plugin config settings inside heat.conf"17:36
dhellmannjdandrea: if you register all of your options in a config group, that will provide a namespace to protect them from other heat options17:36
jdandreadhellmann: So, for instance, when I install my plugin I was thinking it would be nice to also install a default config file (or maybe that's not a good idea either).17:36
dimsjdandrea: if you use your own ConfigOptions, and pass it the name of the default_config_files to load from, you are all set17:36
dhellmannjdandrea: see the driver options in oslo.messaging, for example17:36
dhellmannjdandrea: you could drop a file in /etc/heat, but whether that's a good idea depends entirely on the distro packager rules17:37
jdandreadims: Oh, so in my plugin init I can use my own ConfigOptions and then amend default_config_files (but then to dhellmann's point that means I am worrying about the location of those settings huh). Sorry, trying not to confuse myself. :)17:37
*** salv-orlando has quit IRC17:37
dhellmanndims: I think you're making this harder than it needs to be?17:38
* dhellmann may not understand17:38
jdandreadhellmann: Probably, but that's because I'm not sure how to make it easier. :)17:38
jdandreaI have config options and I'm told "don't put them in heat.conf" ... so I'm all "OK, now what do I do."17:38
dimsdhellmann: from what i understood, heat folks want this stuff totally stand alone, so cfg.CONF of heat should never have stuff from jdandrea's conf files17:38
dhellmannjdandrea: register your options in a group named in a way related to your plugin, and then don't worry about the source of any option settings. That's very explicitly not something application code should deal with.17:39
dhellmanndims: that's not how config is meant to work17:39
dhellmanndims: using a namespace group should be enough isolation17:39
jdandreadhellmann: Ok, that's good, and it turns out I already have that group.17:39
jdandreadhellmann: But ... the only place I seem to be able to place those options, then, is in heat.conf. Am I stuck or is there an easier way I'm missing?17:39
dhellmannjdandrea: how are you running heat?17:40
jdandreaRight now I am indeed using heat.conf17:40
*** arnaud___ has joined #openstack-oslo17:40
jdandreadhellmann: I'm running it as-installed. No special mods.17:40
dhellmannjdandrea: what actual command line do you use to start it?17:40
jdandreaservice heat-engine start17:41
dhellmannjdandrea: what options are being given to heat by whatever startup script that command runs?17:41
jdandreadhellmann: Good question. I have no idea. *checking*17:41
jdandreadhellmann: I *do* see that, with devstack, it uses --config-file and expressly points to /etc/heat/heat.conf ... now checking the startup script version.17:42
dhellmanndims: the idea with all of this config stuff is that the app developer shouldn't think too much about it, because how many config files and what they are called is a deployer concern -- different deployment styles will want different files in different places, and we don't want to have to code around all of them17:42
dhellmannjdandrea: yes, so devstack may have to be changed to add --config-dir for your case17:43
jdandreadhellmann: By deployer are you referring to whomever installs and sets it up?17:43
dhellmannjdandrea: yes, or whoever creates the packages with the startup scripts17:43
dimsdhellmann: true17:43
openstackgerritMerged openstack/tooz: Updated from global requirements  https://review.openstack.org/19161517:43
jdandreadhellmann: Ok, in this case I am not sure where the startup scripts came from (thinking they were provided with heat, but maybe not!).17:44
dhellmannjdandrea: what os are you on? where did you get the packages?17:44
*** shardy_ has joined #openstack-oslo17:44
jdandreaUbuntu 14.04 and I think (and will re-confirm) that everything was installed according to the online docs (vs. getting an all-in-one kind of thing).17:45
dhellmannso you got packages from canonical?17:45
jdandreadhellmann: That's what I'm going to confirm.17:45
jdandrea(suspecting probably)17:45
dhellmannyeah, I think probably17:45
*** arnaud___ has quit IRC17:45
dhellmannI don't know what the startup script in those packages looks like, but it might also need to have a config-dir set17:45
*** shardy has quit IRC17:45
jdandreaSo it might simply end up being a case of: "When you install my plugin, change your startup script to point to some_file.conf for the config and here's a sample config file." I was trying to make it more bootstrap-y in my setup.cfg so that they didn't need to do anything extra.17:46
jdandreaAlas, sometimes those kind of changes end up taking a long time to get approved (anything apart from some already documented or approved method). :/17:47
dhellmannif your plugin is going to be packaged by multiple distros, you won't have a lot of control over that anyway17:47
dhellmannso you should just document the options that need to be set and not worry about what file they are set in17:47
jdandreadhellmann: Not sure it will be packaged by any distros.17:47
dhellmannis it public?17:48
jdandreadhellmann: Ok. So I can't write a sample.17:48
jdandreadhellmann: Not yet. I'd like it to be though.17:48
dhellmannyou could provide a partial sample file17:48
dhellmannah, well, if it's not public then yeah I wouldn't expect it to be packaged :-)17:48
jdandreadhellmann: Ok. I think, then, that my setup.cfg installing a cfg file is not advised. Instead I can provide a sample and say "put it wherever and reference it in your startup"17:49
dhellmannyeah17:49
jdandreaBut when it's public I hope it will be! Just not yet. :)17:49
dhellmannfwiw, it's completely legal to append that to the end of heat.conf17:49
jdandreadhellmann: it is? Oh. Well ... it already is. :)17:49
jdandreaIn that case I'm *really* in good shape. :D17:49
dhellmanncool :-)17:50
*** shardy_ has quit IRC17:50
*** shardy has joined #openstack-oslo17:51
*** ozamiatin has joined #openstack-oslo17:58
ihrachyshkadhellmann, is there any alternative way to reach log wg except going to their meeting?17:58
jdandreadhellmann, dims: ty, appreciate the help17:59
dhellmannihrachyshka: I would expect the mailing list. I see some messages to openstack-dev with "[log]" for example17:59
dhellmannjdandrea: np18:00
dhellmannihrachyshka: maybe I can help?18:00
*** ozamiatin has quit IRC18:02
ihrachyshkadhellmann, well, that email about oslo context/oslo log interactions... http://lists.openstack.org/pipermail/openstack-dev/2015-June/066295.html I wrote to both operators and -dev, not response so far. maybe I should try to add [log] too...18:02
dhellmannihrachyshka: yes, and I think that slipped off of my list of things to reply to so I'll look for it again18:03
ihrachyshkadhellmann, thanks.18:06
*** stevemar2 has joined #openstack-oslo18:09
*** stevemar has quit IRC18:09
*** rpodolyaka1 has joined #openstack-oslo18:16
*** sdake_ has joined #openstack-oslo18:30
*** exploreshaifali has quit IRC18:33
*** sdake has quit IRC18:34
*** Kevin_Bishop has quit IRC18:36
*** Kevin_Bishop has joined #openstack-oslo18:37
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Enable amqp's protocol unit tests everywhere  https://review.openstack.org/18667118:39
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Use `inferred=True` by default  https://review.openstack.org/19177818:39
*** achanda_ has quit IRC18:40
lifelessmorning18:45
lifelessflaper87: hi18:45
flaper87lifeless: hey there :)18:45
flaper87I summoned you like too many times today18:46
flaper87:P18:46
flaper87lifeless: quick question: https://review.openstack.org/#/c/191107/18:46
flaper87I've that requirement that also depends on that change on devstack. I talked to sdague and he explained that the goal is to remove non-rabbit things out of devstack18:47
flaper87my question is what's the right way to add that requirement to the requirements repo?18:47
flaper87Is it putting it in the test-requirements file?18:47
flaper87or should I wait until your spec is applied18:47
*** cdent has quit IRC18:49
harlowjazzzeek sooo for https://github.com/openstack/taskflow/blob/master/taskflow/persistence/backends/sqlalchemy/migration.py there is an easier way to run through the migration steps u say?18:49
harlowjain a way that can be called via 'db_sync' (progromatically)18:50
zzzeekharlowja: should be able to run command.upgrade() rather than re-implementing it18:50
harlowjak18:50
zzzeekhttp://alembic.readthedocs.org/en/latest/api.html#commands18:50
harlowjathx18:50
zzzeeksomeone else did this same thing some months ago18:50
harlowja:-P18:50
*** stevemar2 is now known as stevemar18:51
harlowjalooks good to me18:51
harlowjawill use that18:51
*** e0ne has joined #openstack-oslo18:51
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Enable amqp's protocol unit tests everywhere  https://review.openstack.org/18667118:53
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Use `inferred=True` by default  https://review.openstack.org/19177818:53
*** crc32 has joined #openstack-oslo18:58
*** Rockyg has joined #openstack-oslo18:59
harlowjazzzeek would https://bitbucket.org/zzzeek/alembic/pull-request/45/allow-for-providing-an-existing-connection/diff be ok with u?19:00
harlowjaor something similar/better19:00
zzzeekharlowja: see http://alembic.readthedocs.org/en/latest/cookbook.html#sharing-a-connection-with-a-series-of-migration-commands-and-environments19:00
zzzeekharlowja: added this just for openstack19:00
harlowjaah19:00
harlowjawell there u go :-P19:00
zzzeekthis must be why ive seen this before19:00
harlowjamaybe, ha19:01
*** ViswaV has joined #openstack-oslo19:02
*** rpodolyaka1 has quit IRC19:02
flaper87sileht: around ?19:05
flaper87sileht: it passes now :P19:06
ViswaVHi, Question to olso.messaging team.  Is there a future plan to support zaqar/marconi as an underlying messaging platform ?19:06
dhellmannViswaV: what's your use case for that?19:06
flaper87ViswaV: not right now19:06
flaper87and I honestly don't think it will19:06
flaper87not in o.m code-base at least19:07
flaper87but please, do share your thoughts19:07
flaper87:)19:07
ViswaVWe are using openstack.common.rpc  (I know we are lagging way behind....!  ).  But we plan to move to oslo.messaging soon.19:07
flaper87ViswaV: may I ask who is we ?19:07
flaper87what project?19:07
openstackgerritJoshua Harlow proposed openstack/taskflow: Use alembic upgrade function/command directly  https://review.openstack.org/19193519:08
ViswaVBut we heard from another team that some Openstack projects including Nova is potentially considering to use Zaqar as the RPC/messaging transport.... so I was wondering if  moving to oslo.messaging now is the right choice or wait until Openstack decides and settles on it's next gen RPC/messaging protocol...19:09
flaper87ViswaV: uh, no.19:09
ViswaV'We' is an internal team in eBay... We have teams that work on Trove and other yet not disclosed/opensourced openstack internal projects.19:10
flaper87Some projects are considering to use Zaqar for different use-cases but none of them is considering to use it as a replacement for rabbit/qpid/zmq19:10
flaper87ViswaV: ah so this probably came from the discussion with Trove folks19:10
flaper87the use case in the case of trove was to communicate with the guest agent and they mentioned they're using o.m in the guest agent19:11
ViswaVok. thx for the info. Yeah heard from another trove team member. Could you please elaborate on what kind of use cases?19:11
flaper87Therefore, they asked to have an o.m driver to make things simpler19:11
flaper87However, I really don't think that's going to happen (any time soon). The reason is precisely the question you asked19:11
flaper87Whether Zaqar can/cannot be used as an underlying message broker is a different discussion that can be taken elsewhere. However, it's not Zaqar's intention to do so19:12
harlowjashouldn't zaquar make a nice library that provides a nice pub/sub api first before this?19:12
harlowja*does that library exist?19:12
flaper87harlowja: zaqar* :P19:12
harlowjaya, that19:13
flaper87harlowja: zaqarclient is what you're looking for19:13
harlowjak19:13
flaper87and there's support for kombu19:13
flaper87well, I believe that landed19:13
flaper87but I gotta double check19:13
flaper87that said, there's still lot of work to do19:13
ViswaVok. got it. So o.m  is not considering zaqar as a driver any time soon?  I see kafka, zeromq etc in the BPs.19:13
harlowjaflaper87 thats a good start (kombu being more generic imho anyway)19:13
flaper87ViswaV: that's correct19:14
* flaper87 has serious doubts about kafka but...19:14
harlowjahmmm, i don't see zaqar https://github.com/celery/kombu/tree/master/kombu/transport in there19:14
*** exploreshaifali has joined #openstack-oslo19:14
flaper87I'd love folks to start looking more into message federation for the underlying messaging later19:15
flaper87like the amqp1 protocol driver19:15
flaper87harlowja: aw https://github.com/celery/kombu/pull/31519:15
flaper87it got stalled, I'll get it done19:15
harlowja'This pull request contains merge conflicts that must be resolved. ' sad face19:15
flaper87lol, it was called Marconi when that PR was propsoed19:15
ViswaVWhen is zeromq landing in o.m ? .... a broker less messaging might be an attractive option for guestagent models... like trove and our product.19:15
flaper87proposed19:15
harlowjaya, back in the olden days19:16
harlowjatime before time19:16
flaper87ViswaV: FWIW, there's a brokerless messaging driver already already ( http://docs.openstack.org/developer/oslo.messaging/AMQP1.0.html )19:16
flaper87ViswaV: that said, there's also ZMQ but I believe it still needs some work19:17
* harlowja thought we were going to switch to all HTTP all the places ;)19:17
flaper87ViswaV: I'll be writing more docs, posts and useful (TM) things for the amqp protocol soon19:17
flaper87harlowja: LOL19:17
ViswaVflaper87: from that link you gave:  "The driver also requires a broker that supports version 1.0 of the AMQP protocol.19:17
flaper87ok, going afk for a bit19:17
lifelessflaper87: I don't understand the question, the pyngus thing is approved and seems straight forward19:18
*** crc32 has quit IRC19:18
flaper87ViswaV: well, you can either have a broker for store-forward or just use a message router (qpid-dispatch) which is completely brokerless19:18
* flaper87 needs to fix those docs19:18
flaper87ViswaV: the whole point is that it provides federation19:18
ViswaVGot it. Thx.19:18
flaper87cases were you'd like to have store include notifications19:18
flaper87if you loose a message, you'll be sad and you won't be able to charge19:19
flaper87:P19:19
lifelessflaper87: test-requirements are subject to the same logic as requirements.txt19:19
lifelessflaper87: there's no difference19:19
flaper87lifeless: yeah, that's my current problem, I guess.19:19
harlowjazzzeek i guess if u get a free moment or 2 https://review.openstack.org/#/c/191935/ :)19:19
flaper87lifeless: that patch was approved but it depends on a patch from devstack because pyngus 1.3.1 requires uuid-dev and swig19:19
zzzeekharlowja: ok19:19
harlowjathx19:19
flaper87lifeless: and those 2 are not isntalled by default19:20
flaper87installed*19:20
openstackgerritMerged openstack/tooz: Switch badges from 'pypip.in' to 'shields.io'  https://review.openstack.org/19090819:21
openstackgerritMitsuhiro Tanino proposed openstack/oslo.service: Revert "service child process normal SIGTERM exit"  https://review.openstack.org/18941819:27
*** mtanino has joined #openstack-oslo19:28
*** jaosorior has joined #openstack-oslo19:29
*** amotoki has quit IRC19:33
elarsondoes anyone have tips for understanding why oslo_log is not logging for a module?19:33
elarsonthe logs here don't work https://github.com/openstack/designate/blob/master/designate/hookpoints.py#L2319:34
Kevin_Bishopdims: Hey again, what is the timeline for oslo_service? Is there anything I can do to help out?19:35
lifelessflaper87: so you need the glance module in devstack to install uuid-dev and swig ?19:35
lifelessflaper87: I'm clearly still not understanding the policy problem.19:36
lifelessflaper87: you say that oslo.messaging needs pyngus19:36
lifelessflaper87: and we had pygnus in g-r19:37
lifelessflaper87: sdague: perhaps step me through this? I can say what the requirements influence on any step is19:37
sdaguelifeless: there is a glance thing here? I thought it was just a proton thing?19:39
lifelesssdague: I made an assumption based on flaper87 asking ;)19:39
sdagueI told flaper87 that honestly we want all the non rabbit rpc backends out of devstack, so instead of fixing things for proton in devstack, it should be moved out of tree.19:40
lifelessso if its in an out of tree repo19:40
lifelessthat subscribes to projects.txt19:40
lifelessthen its still going to be in global-requirements.txt19:40
lifelessif its in an unsynchronised repo, thats different19:41
stevemaroh lifeless and sdague are around, how fortunate ...19:41
sdaguelifeless: it's not going to be a thing that subscribes to projects.txt I don't think, it would be an external devstack plugin19:41
stevemardhellmann, already sorta +2'ed this, but if you guys could take a quick look at https://review.openstack.org/#/c/190268/19:42
lifelessI'm not 100% clear on the rules for 'add to projects.txt' - the README.rst in requirements doesn't specify policy other than 'has accepted'19:42
*** Rockyg has quit IRC19:42
*** Rockyg has joined #openstack-oslo19:43
lifelessbut there's no harm to global-requirements.txt in having it there *as long as its installable for constraints generation*19:43
sdaguestevemar: it's python-dateutil right?19:43
lifelessif we can't calculate an install of it on either py2.7 or 3.419:43
lifelessinside a venv, on the periodic jobs node - then thats going to be an issue19:44
sdaguestevemar: pip search python_dateutil returns 0 hits19:44
*** jgrimm is now known as zz_jgrimm19:44
sdaguestevemar: also the requirements review should mention the state of packaging19:45
lifelesshttps://pypi.python.org/pypi/python-dateutil19:45
lifelessstevemar: put that in the review19:46
*** ozamiatin has joined #openstack-oslo19:47
*** rpodolyaka1 has joined #openstack-oslo19:47
*** alexpilotti has quit IRC19:48
*** yamahata has joined #openstack-oslo19:49
lifelesssdague: pypi's UI handles case and punctuation differences btw for doing searches19:49
*** achanda has joined #openstack-oslo19:50
sigmavirus24elarson: define "dont' work"19:51
*** boris-42 has quit IRC19:52
elarsonsigmavirus24: beyond things like LOG.info (when the debug is the default) not working, getLogger doesn't add the logger to oslo_log.log._loggers19:52
stevemarlifeless, thx lifeless, i'll put that in there. sdague i'll see what i can get in terms of packaging info19:53
sigmavirus24Stupid question elarson, is that module even being imported?19:53
elarsonsigmavirus24: great question. it should be as I can throw an exception and stop the process.19:54
elarsonsigmavirus24: I also tried instantiating the logger lazily in an object property but that didn't do it either19:54
*** sdake has joined #openstack-oslo19:54
elarsonmy thought being that the loggers are already configured and mine wasn't included19:54
elarsonaka no handlers were added19:55
sigmavirus24elarson: so the only reason I can imagine that it would not add the handler would be if it was never actually imported19:55
sigmavirus24which would explain why nothing is logged (because nothing is executed)19:55
sigmavirus24elarson: fwiw: https://github.com/openstack/designate/search?utf8=%E2%9C%93&q=hookpoints19:55
sigmavirus24nothing's importing hookpoints at the moment19:55
elarsonsigmavirus24: right, I have a local branch with a hook point19:56
elarsonsigmavirus24: http://paste.openstack.org/show/294469/19:56
sigmavirus24You know what my next question is, right?19:57
elarsonsigmavirus24: unfortunately no :(19:58
*** sdake_ has quit IRC19:58
sigmavirus24What, if anything, imports designate.pool_manager.service19:58
sigmavirus24So far only https://github.com/openstack/designate/blob/6acb7191c8780880df3c923165a4a8b39c46c2a7/designate/cmd/pool_manager.py19:58
sigmavirus24(from https://github.com/openstack/designate/search?utf8=%E2%9C%93&q=pool_manager&type=Code)19:58
elarsonsigmavirus24: right, I'm running the pool manager19:59
elarsonbut that does make me wonder what the logging.setup is getting there19:59
sigmavirus24elarson: Well failing all other things, I'd chuck some print statements in those modules to make sure they're actually being imported19:59
elarsonsigmavirus24: I am getting print statements, which is how I know things get imported. but I'm suspect of the config bits in the pool_manager.20:00
stevemarsdague, lifeless danke, new patch should be up20:01
sigmavirus24elarson: interesting20:01
openstackgerritJoshua Harlow proposed openstack/automaton: Add `is_actionable_event` checking function (WIP)  https://review.openstack.org/19195520:01
*** sdake_ has joined #openstack-oslo20:01
*** Rockyg has quit IRC20:04
*** sdake has quit IRC20:05
*** Rockyg has joined #openstack-oslo20:05
lifelessflaper87: so - summarising the pyngus thing: g-r has the union of all requirements, whether unconditional, conditional, optional, or test, for all projects that receive updates and sync.20:10
lifelessflaper87: all projects that want to be co-installable should be in that list; if the proton driver needs to be co-installable, it needs to be in that list.20:10
lifelessflaper87: there's very little incremental cost having things in there at this stage, if we run into computability issues, we'll raise and discuss, but the optionality or not of a backend doesn't affect it IMO20:11
lifelessflaper87: HTH20:11
*** amrith is now known as _amrith_20:12
lifelessflaper87: there are soft-update projects which you could be, if you want to have things that aren't acceptable for g-r, but I don't see anything about pyngus that makes it unacceptable20:12
*** ViswaV_ has joined #openstack-oslo20:14
*** ViswaV has quit IRC20:14
*** ihrachyshka has quit IRC20:14
*** zzzeek has quit IRC20:16
flaper87lifeless: that was my thought as well. I'll have to sync with sdague again since he things the changes I proposed for destack shouldn't land because those move away from devstack's goals for liberty20:16
*** Rockyg has quit IRC20:17
openstackgerritJoshua Harlow proposed openstack/automaton: Add `is_actionable_event` checking function  https://review.openstack.org/19195520:22
*** zzzeek has joined #openstack-oslo20:24
*** yamahata has quit IRC20:29
*** rpodolyaka1 has quit IRC20:31
*** achanda has quit IRC20:34
*** achanda_ has joined #openstack-oslo20:34
*** zzzeek has quit IRC20:38
*** kgiusti has quit IRC20:41
*** sdake has joined #openstack-oslo20:44
*** achanda_ has quit IRC20:46
*** ViswaV_ has quit IRC20:46
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo-incubator: Crypto.Random.atfork before fetching random bytes  https://review.openstack.org/19158120:46
*** sdake_ has quit IRC20:48
openstackgerritMerged openstack/oslotest: Create ConfigureLogging fixture  https://review.openstack.org/19077520:51
openstackgerritMerged openstack/oslotest: Add CreateFileWithContent fixture  https://review.openstack.org/19079520:51
*** ozamiatin has quit IRC20:54
*** ozamiatin has joined #openstack-oslo20:55
*** dims_ has joined #openstack-oslo20:56
*** dims has quit IRC21:00
*** dims_ has quit IRC21:00
flaper87harlowja: https://review.openstack.org/#/c/186671/ pls ?21:03
*** stevemar2 has joined #openstack-oslo21:03
*** stevemar has quit IRC21:04
*** ViswaV has joined #openstack-oslo21:06
*** bknudson has quit IRC21:09
openstackgerritMarian Horban proposed openstack/oslo.service: Graceful shutdown WSGI/RPC server  https://review.openstack.org/19017521:14
*** manishg_ has joined #openstack-oslo21:16
*** manishg has quit IRC21:17
elarsonare there any strategies for lazy loading or reloading a the oslo logging config?21:19
elarsonmy app starts and immediately complains that there are no handlers, which makes sense b/c at import time, they wouldn't have been configured.21:19
elarsonbut then, after the module should have been imported, there is still no logging configured21:20
openstackgerritFlavio Percoco proposed openstack/oslo.messaging: Use `inferred=True` by default  https://review.openstack.org/19177821:22
* elarson pokes around for any sort of `after_config_loaded` event in oslo_config21:23
dhellmannelarson: either your app should be setting up logging sooner, or your lib should be adding null handlers21:24
elarsonthis is nasty... http://paste.openstack.org/show/294502/21:24
dhellmannugh, yeah, why does that exist?21:25
elarsondhellmann: I think the problem is that this is loading something as import time (hooks via stevedore), which means no config could have been loaded at that time21:25
dhellmannelarson: what is logging on import though?21:25
dhellmannand couldn't the app set up logging before loading the plugins?21:26
elarsondhellmann: I added some .debug messages to show what plugins are found and what get applied21:26
dhellmannelarson: is stevedore being invoked as part of importing a module?21:27
elarsondhellmann: the plugins end up applied as decorators, so they need to return a function when applied21:27
elarsondhellmann: for reference https://github.com/openstack/designate/blob/master/designate/hookpoints.py21:27
dhellmannelarson: I'm trying to understand the startup order of the application, because it should read the config file, set up logging, then do anything else that is app-specific and it doesn't sound like that's what's happening21:28
*** ViswaV has quit IRC21:29
elarsondhellmann: right, so the idea is to decorate a function with a hook point (@hookpoints.hook_point()). then a package can be installed that provides a decorator for that hook point. so by the time the config has been loaded, we've already applied the decorator21:29
*** exploreshaifali has quit IRC21:30
elarsonI could move towards applying the hookpoints more lazily, but I think that would make them more complicated.21:30
elarsonsounds like it might be better to call a loaded_hooks() after the config has been loaded in order to provide the necessary debug info21:31
dhellmannyes, I think moving that import to a point after the config is loaded and the logging is set up is what you want to do21:31
*** zzzeek has joined #openstack-oslo21:32
dhellmannelarson: you could also let the decorator build a cache of functions from plugins the first time it is called, instead of on import21:32
elarsondhellmann: yeah, I think that is how it would have to work if I want to keep the application of the decorator reasonable21:33
dhellmannelarson: a generic version of that might be a useful addition to stevedore21:33
elarsondhellmann: the lazy binding or a helpful debug messsage that can logged after logging is configure?21:34
elarsonconfigured*21:34
dhellmannelarson: the lazy binding decorator that uses a hook manager21:35
*** sputnik13 has quit IRC21:35
*** dims has joined #openstack-oslo21:35
*** e0ne has quit IRC21:36
elarsondhellmann: would it be reasonable to only target decorators? ie any plugin found needs to accept a function?21:37
dhellmannelarson: probably a class that takes a namespace as argument and then provides a decorator method that takes a hook name. Then when the decorated function is called it makes sure the plugins are loaded and invokes the right hooks before & after calling the function.21:37
*** sputnik13 has joined #openstack-oslo21:37
dhellmannI guess it depends on what you want the hooks to do. Are all of the hook functions decorators, too?21:38
elarsondhellmann: I actually started down that route, but preferred the decorator method as it lets users completely replace the function21:39
dhellmannbut yeah, if that's the thing you need, I think a version that didn't rely on oslo.config could live in stevedore and be used elsewhere21:39
dhellmannelarson: oh, the interop folks are going to hate that :-/21:39
elarsondhellmann: why do you say that?21:39
dhellmann"I installed this plugin and now the app doesn't pass defcore's tests"21:39
elarsondhellmann: well the plugins are meant to be org specific.21:40
dhellmannelarson: ok, I guess it's up to the org to make the choice about interop then21:41
elarsonexactly21:41
dhellmannanyway, don't let me derail the real work you're doing, but if you have a pattern you want to add to stevedore we would welcome the contribution21:41
elarsondhellmann: definitely.21:41
*** bknudson has joined #openstack-oslo21:43
*** ozamiatin has quit IRC21:43
elarsonI know the rax nova folks have implemented a similar system for applying org patches and I imagine there are similar patterns everyone uses to merge org with upstream, so I'm hoping there is some fruit to be shared there.21:43
dhellmannelarson: feel free to add me to the reviewer list to make sure I see it21:43
elarsontime will tell...21:43
elarsondhellmann: ah ok, will do21:43
*** stevemar2 is now known as stevemar21:43
openstackgerritJoshua Harlow proposed openstack/taskflow: Use alembic upgrade function/command directly  https://review.openstack.org/19193521:43
dhellmannelarson: yeah, I think rax relies heavily on a monkeypatching tool, IIUC, and that's another approach but I like having it baked in as a feature21:43
openstackgerritJoshua Harlow proposed openstack/taskflow: Use alembic upgrade function/command directly  https://review.openstack.org/19193521:44
mtaninodims: hi, may I ask about the Marian's fix 190175?21:46
dimsmtanino: sure21:46
mtaninodims: After merged the patch, do we need to backport that fix into each component such as cinder, nova, etc?21:46
mtaninoor are there plan to use oslo.service directly at each component?21:47
dimsmtanino: i'd like to do the latter. (oslo.service directly at each component). we should be able to get the first revision of oslo.service API soon enough (a couple of weeks)21:48
dimswould that work?21:48
*** manishg_ has quit IRC21:48
mtaninodims: sure. It would work.21:48
dimsawesome!21:48
mtaninothanks for letting me know :)21:49
dimsyw. is there a cinder bug? mtanino21:49
dimslooks like you have one https://bugs.launchpad.net/oslo.service/+bug/146313221:50
openstackLaunchpad bug 1463132 in oslo.service "Graceful shutdown was broken at Kilo" [Undecided,New] - Assigned to Mitsuhiro Tanino (mitsuhiro-tanino)21:50
mtaninodims: https://bugs.launchpad.net/cinder/+bug/146482221:50
openstackLaunchpad bug 1464822 in Cinder "Cinder does not shutdown processes gracefully" [Low,In progress] - Assigned to Mitsuhiro Tanino (mitsuhiro-tanino)21:50
mtaninoyes. this one.21:50
mtaninooh, different21:51
dimscool lets make sure they refer to reach other so you get notified21:51
mtaninodims: OK. so, I will duplicate my oslo.service bug for Marian's bug and add refecence into Cinder's bug.21:53
dimssounds good mtanino21:53
mtaninothanks :)21:53
*** boris-42 has joined #openstack-oslo22:02
*** yamahata has joined #openstack-oslo22:03
*** claudiub has quit IRC22:04
openstackgerritJoshua Harlow proposed openstack/taskflow: Notify on the individual engine steps  https://review.openstack.org/18955422:07
openstackgerritJoshua Harlow proposed openstack/taskflow: Handle conductor ctrl-c more appropriately  https://review.openstack.org/18953622:07
openstackgerritJoshua Harlow proposed openstack/taskflow: Add indestructible 99 bottles of beer example  https://review.openstack.org/18952622:07
*** mriedem is now known as mriedem_away22:09
*** exploreshaifali has joined #openstack-oslo22:13
openstackgerritJoshua Harlow proposed openstack/taskflow: Address concurrent mutation of sqlalchemy backend  https://review.openstack.org/9868922:13
openstackgerritJoshua Harlow proposed openstack/taskflow: Address concurrent mutation of sqlalchemy backend  https://review.openstack.org/9868922:14
openstackgerritJoshua Harlow proposed openstack/taskflow: Rename logbook module -> models module  https://review.openstack.org/18999522:15
openstackgerritJoshua Harlow proposed openstack/taskflow: Rename logbook module -> models module  https://review.openstack.org/18999522:16
openstackgerritJoshua Harlow proposed openstack/taskflow: Add ability to use tooz to find and advertise workers  https://review.openstack.org/15149522:17
*** stevemar has quit IRC22:21
*** david-lyle has quit IRC22:31
*** Kevin_Bishop has quit IRC22:32
*** yamahata has quit IRC22:33
*** dims has quit IRC22:34
*** ViswaV has joined #openstack-oslo22:35
*** exploreshaifali has quit IRC22:35
*** jecarey has quit IRC22:37
openstackgerritJoshua Harlow proposed openstack/futurist: Allow adding periodic callables at runtime (WIP)  https://review.openstack.org/19199822:42
*** hogepodge has quit IRC22:52
*** zzzeek has quit IRC22:56
*** alexpilotti has joined #openstack-oslo23:01
bknudsonhas anyone used http://pythonhosted.org/testfixtures/mocking.html ?23:02
*** dims has joined #openstack-oslo23:03
*** alexpilotti has quit IRC23:03
*** dims has quit IRC23:03
bknudsonthis looks handy: http://pythonhosted.org/testfixtures/datetime.html#datetimes23:04
*** dims has joined #openstack-oslo23:04
*** jaosorior has quit IRC23:05
*** zzzeek has joined #openstack-oslo23:08
*** david-lyle has joined #openstack-oslo23:11
openstackgerritJoshua Harlow proposed openstack/automaton: Add a bigger CD-player state-machine doctest(ed) example  https://review.openstack.org/19147723:16
*** ganso_ has quit IRC23:18
*** hogepodge has joined #openstack-oslo23:19
openstackgerritMerged openstack/taskflow: Use hash path lookup vs path finding  https://review.openstack.org/18213223:22
*** EmilienM|afk is now known as EmilienM23:24
*** zzzeek has quit IRC23:25
*** ashleighfarnham has quit IRC23:42
*** zzzeek has joined #openstack-oslo23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!