Wednesday, 2015-05-13

*** prad has quit IRC00:00
*** gordc has quit IRC00:03
*** sputnik13 has quit IRC00:05
*** achanda_ has joined #openstack-oslo00:06
*** achanda has quit IRC00:10
*** achanda_ has quit IRC00:11
lifelessharlowja: see my email to -dev about the neutron gate issue00:12
harlowjak00:12
lifelessharlowja: it has a link to a patch00:12
lifelessfor neutron00:12
lifelesstchaypo: ok so breath in, breath out00:13
tchaypofortunately the unrelated gas leak was fixed last week, so that no longer makes me want to vomit :p00:13
tchaypoI’m working throuh comments at the moment00:13
harlowjalifeless also http://paste.openstack.org/show/221292/ (for why not publishing things to pip); i wonder that in march and asked infra folks00:14
*** salv-orlando has joined #openstack-oslo00:15
harlowjanothing to super amazing came out of that, but some history :-P00:16
harlowjaok, let me see if i can figure out extra requires there00:18
harlowjadon't care about win32 though, ha00:19
lifelessoh man, wordpress you so drunk00:22
lifelessharlowja: https://rbtcollins.wordpress.com/2015/05/13/improving-dependency-handling-upstream-for-openstack/ has links that will help00:22
harlowjacool, think i figured  it out , just gotta check00:22
harlowjaonce i found https://www.python.org/dev/peps/pep-0426/#environment-markers00:22
harlowja:-P00:22
* harlowja wasn't sure what that mini language supported00:23
tchaypotoo much.00:23
tchaypo;)00:23
harlowja:)00:23
tchaypobut on the other hand00:23
tchaypoat least it’s not turing-complete00:23
lifelessit doesn't support it all00:24
lifelesslike, whats defined and whats supported differ00:24
harlowjaawesome00:24
harlowjathats the best kind of support00:24
harlowjaand docs00:24
harlowjalol00:24
*** tsekiyam_ has joined #openstack-oslo00:25
*** amuller has quit IRC00:25
*** salv-orlando has quit IRC00:26
*** mtanino has quit IRC00:27
*** david-lyle has quit IRC00:28
*** tsekiyama has quit IRC00:28
*** tsekiyam_ has quit IRC00:29
lifelessaieee theme explosion00:30
lifelessI think I've got an ok one now00:30
lifelessright, context switch time - tchaypo how you going?00:30
lifelessdhellmann: sdague: https://rbtcollins.wordpress.com/2015/05/13/improving-dependency-handling-upstream-for-openstack/ <- probably useful context for the discussion the other day00:31
harlowjasomeday i'll be a cool blogger00:33
harlowjalol00:33
*** bogdando has joined #openstack-oslo00:35
tchaypolifeless: updating code based on your comments00:35
openstackgerritJoshua Harlow proposed openstack/taskflow: Remove custom py26/py27 and tweak requirements  https://review.openstack.org/18242300:44
harlowjatchaypo lifeless  does the setup.py stuff in ^ look ok?00:44
harlowjaoops, duped 2.6, lol00:45
openstackgerritJoshua Harlow proposed openstack/taskflow: Remove custom py26/py27 and tweak requirements  https://review.openstack.org/18242300:45
tchaypoI think so00:46
harlowjak00:46
harlowjatox knows how to install those ?00:46
harlowjai guess when it runs setup.py develop that will get sucked down?00:47
tchayponow that’s a whole nother question.00:47
harlowjaah00:47
harlowjahmmm, nice to have them get packaged right, even better if they get used by tox to, lol00:47
harlowja^ ensures they are tested :-P00:47
tchaypoI haven’t tested that. but my understanding is that the intent with env_markers is that they’re meant to be automatically acted on00:47
harlowjak00:48
*** browne has quit IRC00:53
*** stevemar has joined #openstack-oslo00:54
openstackgerritJoshua Harlow proposed openstack/taskflow: Remove custom py26/py27 tox venvs no longer used  https://review.openstack.org/18251200:56
harlowjahmmm, ya, doesn't seem to be getting installed on my 2.7 env with those markers00:57
harlowja*mysql-python that is00:57
harlowjathink i'll wait as lifeless  suggested :-P00:58
lifelessharlowja: when we do do it you'll want to add file://$(pwd)/[test] to your deps= in tox.ini00:59
harlowjakk00:59
lifelessharlowja: and have them guarded by test as i mentioned in my review00:59
harlowjamaybe thats why it wasn't working lcoally00:59
harlowja*locally00:59
*** erickson has joined #openstack-oslo00:59
tchaypolifeless: responded with comments on test_util.py, still working through the rest01:00
*** ericksonfgds has quit IRC01:00
openstackgerritJoshua Harlow proposed openstack/taskflow: Remove custom py26/py27 tox requirements  https://review.openstack.org/18242301:05
lifelesstchaypo: replied back to you01:05
lifeless:)01:05
openstackgerritJoshua Harlow proposed openstack/taskflow: Remove customized pyX.Y tox requirements  https://review.openstack.org/18242301:07
*** bknudson has joined #openstack-oslo01:07
tchaypolifeless: nit on your blog post - " Only use supplied requirements” should be “Only user supplied requirements"01:11
lifelessfixed01:21
tchaypothere was a “pips” later on that should have been “pip’s” as well01:33
tchaypo*reads about list ordering in python*01:36
tchaypoI can’t find anything that says list ordering is guaranteed to be preserved. I know that it is, but I thought that was an implementation detail rather than something to rely on01:39
lifelesstchaypo: preserved under what operation ?01:42
tchaypoobviously not sorting :p01:42
lifelesstchaypo: the semantics of a list is that its an ordered sequence.01:42
tchaypoadd/append01:42
lifelesstchaypo: it is very much not a detail. It is le raison d'etre01:43
tchaypois that documented somewhere?01:44
lifelessdoes it matter?01:44
lifelessI mean, we can burn cycles digging up the chapter and verse if needed.01:44
tchaypohttps://docs.python.org/2/reference/datamodel.html - “These represent finite ordered sets"01:45
lifelessthere you go01:45
tchaypowoo01:45
*** ozamiatin has quit IRC01:45
lifelessthough technical I would have thought finite ordered multi-set01:46
*** zzzeek has quit IRC01:47
*** erickson has quit IRC01:47
tchaypoI’m constantly surprised that things like http://stackoverflow.com/questions/3495124/not-reading-vimrc/9700719#9700719 keep getting upvotes01:48
tchaypo… and I’m constantly surprised that I’m apparently in the top 8% of repo on stackoverflow01:48
*** vilobhmm1 has quit IRC01:49
*** vilobhmm1 has joined #openstack-oslo01:49
openstackgerritJames Polley proposed openstack-dev/pbr: WIP: Teach pbr to read extras from setup.cfg  https://review.openstack.org/18179501:53
*** vilobhmm1 has quit IRC01:54
lifelesstchaypo: this is my equivalent - http://stackoverflow.com/questions/3277367/how-does-pythons-super-work-with-multiple-inheritance/16310777#1631077701:58
lifelesssomeday it will surpase the wrong answer above it02:00
lifelesstchaypo: looks like none of my review comments made it through your local git ops, you may need to check the older review to be sure.02:05
lifelessok -> doctors, bbialw02:06
tchaypobah. enjoy the doctor!02:06
*** erickson has joined #openstack-oslo02:11
*** ihrachyshka has quit IRC02:13
*** shardy_z has quit IRC02:16
*** browne has joined #openstack-oslo02:17
openstackgerritEthan Lynn proposed openstack/oslo.utils: Add mac validate function in netutils  https://review.openstack.org/18216702:21
tchaypolifeless: in case you see this - i think you mean the comments about using test scnearios? I did see those, and I do plan to go that way02:24
*** zzzeek has joined #openstack-oslo02:26
*** zzzeek has quit IRC02:26
*** sputnik13 has joined #openstack-oslo02:27
*** yamahata has quit IRC02:39
*** achanda has joined #openstack-oslo02:47
*** sdake has quit IRC02:51
*** ashleighfarnham has quit IRC02:54
*** alexpilotti has quit IRC03:00
*** yamahata has joined #openstack-oslo03:03
*** erickson has quit IRC03:10
*** salv-orlando has joined #openstack-oslo03:17
*** dims_ has quit IRC03:18
*** links has joined #openstack-oslo03:30
*** vilobhmm1 has joined #openstack-oslo03:33
openstackgerritEric Brown proposed openstack/oslo.vmware: Add ToolsUnavailable exception  https://review.openstack.org/18252703:37
*** salv-orlando has quit IRC03:42
*** david-lyle has joined #openstack-oslo03:48
*** sigmavirus24 is now known as sigmavirus24_awa04:06
*** salv-orlando has joined #openstack-oslo04:10
*** dims has joined #openstack-oslo04:18
*** salv-orlando has quit IRC04:25
*** dims has quit IRC04:25
*** vilobhmm1 has quit IRC04:25
*** vilobhmm1 has joined #openstack-oslo04:26
*** salv-orlando has joined #openstack-oslo04:32
*** salv-orlando has quit IRC04:33
openstackgerritJames Polley proposed openstack-dev/pbr: WIP: Teach pbr to read extras from setup.cfg  https://review.openstack.org/18179504:41
*** nkrinner has joined #openstack-oslo04:58
lifelesstchaypo: I meant that, and the per fiel comments05:11
lifelesstchaypo: which seemed entirely ignored judging from the diff05:11
*** vilobhmm11 has joined #openstack-oslo05:11
tchayposorry, I probably should have been clearer about the fact that I was uploading a partially-done set of changes05:11
tchaypoI’m moving off this now so I can work on other things, will pick it up again in the morning05:12
*** achanda_ has joined #openstack-oslo05:12
lifelessk05:13
*** SlickN1k has joined #openstack-oslo05:14
*** stevemar2 has joined #openstack-oslo05:14
*** vilobhmm1 has quit IRC05:15
lifelesstchaypo: I'd love to have this bedded down before Canvouver05:15
*** achanda has quit IRC05:26
*** stevemar has quit IRC05:26
*** ir2ivps10 has quit IRC05:26
*** SlickNik has quit IRC05:27
*** SlickN1k is now known as SlickNik05:27
*** ir2ivps10 has joined #openstack-oslo05:39
*** ashleighfarnham has joined #openstack-oslo05:43
*** dulek has joined #openstack-oslo05:48
*** ashleighfarnham has quit IRC05:59
*** ashleighfarnham has joined #openstack-oslo05:59
*** dims has joined #openstack-oslo06:01
*** ashleighfarnham has quit IRC06:04
*** dims has quit IRC06:06
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.versionedobjects: Imported Translations from Transifex  https://review.openstack.org/18254506:06
*** stevemar2 is now known as stevemar06:10
*** shardy has joined #openstack-oslo06:32
*** inc0 has joined #openstack-oslo06:42
*** stevemar has quit IRC06:43
*** smallbig has left #openstack-oslo06:50
*** dulek has quit IRC06:51
*** dulek has joined #openstack-oslo06:51
*** achanda_ has quit IRC06:55
*** dulek has quit IRC07:09
*** x3k is now known as xek07:19
*** vilobhmm11 has quit IRC07:27
*** xek has quit IRC07:40
*** xek has joined #openstack-oslo07:41
*** dulek has joined #openstack-oslo07:50
*** browne has quit IRC07:54
*** dulek has quit IRC07:55
*** haypo has joined #openstack-oslo08:19
*** e0ne has joined #openstack-oslo08:25
*** e0ne has quit IRC08:28
*** jaosorior has joined #openstack-oslo08:28
*** e0ne has joined #openstack-oslo08:30
*** e0ne has quit IRC08:31
*** dguitarbite has joined #openstack-oslo08:43
*** ozamiatin has joined #openstack-oslo08:46
*** ericksonfgds has joined #openstack-oslo08:52
*** inc0 has quit IRC09:06
*** inc0 has joined #openstack-oslo09:08
*** dulek has joined #openstack-oslo09:09
openstackgerritMerged openstack/stevedore: re-raise exception with full traceback  https://review.openstack.org/17679309:09
*** ihrachyshka has joined #openstack-oslo09:10
*** inc0 has quit IRC09:13
*** ericksonfgds has quit IRC09:20
openstackgerritMehdi Abaakouk (sileht) proposed openstack/oslo.messaging: Remove outdated release notes  https://review.openstack.org/18258509:21
*** e0ne has joined #openstack-oslo09:22
openstackgerritMerged openstack/stevedore: Remove run_cross_tests.sh  https://review.openstack.org/17948209:22
openstackgerritMehdi Abaakouk (sileht) proposed openstack/oslo.config: Remove outdated release notes  https://review.openstack.org/18258809:23
openstackgerritJulien Danjou proposed openstack/oslo.serialization: jsonutils: simplify simple value handling  https://review.openstack.org/16686609:28
openstackgerritJulien Danjou proposed openstack/oslo.serialization: jsonutils: encode dict keys  https://review.openstack.org/16690209:28
openstackgerritJulien Danjou proposed openstack/oslo.serialization: jsonutils: replace strtime() usage with isotime()  https://review.openstack.org/16686109:28
*** dulek has quit IRC09:28
*** dulek has joined #openstack-oslo09:29
*** dims has joined #openstack-oslo09:35
*** e0ne is now known as e0ne_09:36
*** e0ne_ is now known as e0ne09:38
*** inc0 has joined #openstack-oslo09:40
*** dims has quit IRC09:40
openstackgerritJulien Danjou proposed openstack/oslo.utils: timeutils: make marshall timezone aware  https://review.openstack.org/18259709:43
openstackgerritJulien Danjou proposed openstack/oslo.utils: timeutils: utcnow() returns a value with a timezone  https://review.openstack.org/18259809:43
openstackgerritJulien Danjou proposed openstack/oslo.utils: Deprecate strtime  https://review.openstack.org/14850009:45
*** inc0 has quit IRC09:47
*** ozamiatin has quit IRC09:48
*** inc0 has joined #openstack-oslo09:49
haypojd__, hi. here is a typo in your oslo.serialization patch https://review.openstack.org/#/c/166861/09:49
*** inc0_ has joined #openstack-oslo09:50
jd__haypo: yeah I need to update it09:50
openstackgerritJulien Danjou proposed openstack/oslo.utils: timeutils: deprecate isotime()  https://review.openstack.org/18260209:51
*** inc0 has quit IRC09:53
openstackgerritJulien Danjou proposed openstack/oslo.serialization: jsonutils: simplify simple value handling  https://review.openstack.org/16686609:54
openstackgerritJulien Danjou proposed openstack/oslo.serialization: jsonutils: encode dict keys  https://review.openstack.org/16690209:54
openstackgerritJulien Danjou proposed openstack/oslo.serialization: jsonutils: replace strtime() usage with isotime()  https://review.openstack.org/16686109:54
openstackgerritJulien Danjou proposed openstack/oslo.utils: Deprecate strtime  https://review.openstack.org/14850009:54
jd__haypo: curious on your opinion on https://review.openstack.org/#/c/182602/09:54
haypojd__, did you check if timeutils is able to parse the +HH:HH format of timezones, at least for UTC?09:55
jd__haypo: we rely on iso8601 module to do that, so yeah it works fine09:56
haypo>>> timeutils.parse_isotime('2015-05-13T11:56:41.879782')09:57
haypodatetime.datetime(2015, 5, 13, 11, 56, 41, 879782, tzinfo=<iso8601.iso8601.Utc object at 0x7fb945a6d1d0>)09:57
haypooh, the function expects UTC timezone09:57
haypo>>> timeutils.parse_isotime('2015-05-13T11:56:41.879782+00:00')09:57
haypodatetime.datetime(2015, 5, 13, 11, 56, 41, 879782, tzinfo=<FixedOffset '+00:00' datetime.timedelta(0)>)09:57
haypobut yes, it supports +HH:HH format (it works also with any other fixed offset like +01:02)09:58
haypojd__, oh wait, you want to deprecate isotime(), sorry i read strtime() :-p09:59
haypojd__, isotime() has two features: format a datetime but also get the current datetime in the UTC timezone10:00
*** dims has joined #openstack-oslo10:01
haypo>>> datetime.datetime.now(tz=iso8601.iso8601.UTC).isoformat()10:01
haypo'2015-05-13T10:01:43.742092+00:00'10:01
haypojd__, ^^ it would be nice to have a function for this10:02
jd__haypo: that's timeutils.utcnow().isoformat()10:02
jd__haypo: with my patches obviously10:02
haypo>>> timeutils.utcnow().isoformat()10:03
haypo'2015-05-13T10:03:00.603834'10:03
openstackgerritMerged openstack/oslo.log: Add versionutils to API documentation  https://review.openstack.org/16776810:03
openstackgerritMerged openstack/oslo.log: Add versionutils options to list_opts  https://review.openstack.org/16776910:03
haypojd__, wait, i have to read your whole patch serie :)10:03
jd__np10:03
haypojd__, i don't understand the purpose of utcnow.override_time10:05
openstackgerritMerged openstack/oslo.log: Make remove_in=0 (no removal) use a better syntax  https://review.openstack.org/16818610:05
haypojd__, is it for unit tests? why not using mock.patch?10:05
openstackgerritMerged openstack/oslo.log: Remove is_compatible from versionutils  https://review.openstack.org/17047110:05
tchaypohaypo: oh hai!10:05
haypotchaypo, hi myself, hum no, wait ;-)10:06
jd__haypo: that's another subject, I think that's because mock does not work in certain cases10:06
tchaypohaypo: I look forward to us working together on something10:07
tchaypohaypo: mostly because I’ll enjoy others being confused :)10:07
*** jamielennox is now known as jamielennox|away10:08
haypojd__, sorry, new typo found in the title of your commit message /o\ https://review.openstack.org/#/c/166861/10:10
haypojd__, except of that, the patch looks good to me10:10
jd__thanks10:10
haypotchaypo, ah? i'm going to eat10:10
openstackgerritJulien Danjou proposed openstack/oslo.serialization: jsonutils: simplify simple value handling  https://review.openstack.org/16686610:11
openstackgerritJulien Danjou proposed openstack/oslo.serialization: jsonutils: encode dict keys  https://review.openstack.org/16690210:11
openstackgerritJulien Danjou proposed openstack/oslo.serialization: jsonutils: replace strtime() usage with isoformat()  https://review.openstack.org/16686110:11
openstackgerritJulien Danjou proposed openstack/oslo.utils: timeutils: utcnow() returns a value with a timezone  https://review.openstack.org/18259810:12
jd__ETOOMANYPATCHES10:12
*** ozamiatin has joined #openstack-oslo10:14
silehthum, I guess is very hard to get merged a patch in oslo.cache: https://review.openstack.org/#/admin/projects/openstack/oslo.cache,access10:18
*** ozamiatin has quit IRC10:19
*** dulek has quit IRC10:19
*** e0ne is now known as e0ne_10:25
*** wendar has quit IRC10:25
*** gus has quit IRC10:25
*** wendar_ has joined #openstack-oslo10:25
*** e0ne_ is now known as e0ne10:26
*** dulek has joined #openstack-oslo10:28
*** jd__ has quit IRC10:28
*** jd__ has joined #openstack-oslo10:32
*** EmilienM has quit IRC10:33
*** ekarlso has quit IRC10:33
*** gus has joined #openstack-oslo10:33
*** Steap has quit IRC10:34
*** Steap has joined #openstack-oslo10:35
*** EmilienM has joined #openstack-oslo10:35
*** e0ne is now known as e0ne_10:39
*** e0ne_ is now known as e0ne10:40
*** ekarlso has joined #openstack-oslo10:41
*** ekarlso has quit IRC10:45
*** ekarlso has joined #openstack-oslo10:45
*** dulek has quit IRC10:50
*** dulek has joined #openstack-oslo10:50
*** dulek_ has joined #openstack-oslo10:53
*** dulek_ has quit IRC10:53
*** dulek_ has joined #openstack-oslo10:54
*** dulek has quit IRC10:54
*** cdent has joined #openstack-oslo11:13
*** e0ne is now known as e0ne_11:26
*** salv-orlando has joined #openstack-oslo11:28
*** salv-orlando has quit IRC11:37
*** salv-orlando has joined #openstack-oslo11:43
viktorssileht: hi!11:48
*** yamahata has quit IRC11:48
haypotchaypo, on which project do you want to collaborate?11:49
tchaypooh, nothing in particular, but it’d be funny if we did some day :)11:50
*** ozamiatin has joined #openstack-oslo11:52
*** sdake has joined #openstack-oslo12:00
haypojd__, ok, i reviewed the patch serie for oslo.serialize, +2 for all of them12:01
*** e0ne_ is now known as e0ne12:08
openstackgerritJulien Danjou proposed openstack/oslo.utils: timeutils: deprecate isotime()  https://review.openstack.org/18260212:12
openstackgerritJulien Danjou proposed openstack/oslo.utils: Deprecate strtime  https://review.openstack.org/14850012:13
*** gordc has joined #openstack-oslo12:25
*** sputnik13 has quit IRC12:29
dimssileht: filed a patch for oslo.cache - https://review.openstack.org/18264512:29
*** amrith is now known as _amrith_12:30
*** dulek_ has quit IRC12:31
*** alexpilotti has joined #openstack-oslo12:32
haypojd__, ok, i also reviewed your patches for oslo.utils. there is a low risk of breaking applications if timeutils begins to create aware datetime objects. it's more a matter of warnings users and help them to fix their applications12:36
jd__haypo: one of the patch fails likely because it breaks Keystone12:37
jd__clearly this is far from being won12:37
haypojd__, the safe approach is to add new optional parameters or new functions12:37
haypojd__, but i know that you prefer to break the world to force users to enhance their code :-D12:38
haypoi have no strong opinion on the better approach12:38
*** prad has joined #openstack-oslo12:39
*** salv-orlando has quit IRC12:39
*** bknudson has quit IRC12:40
openstackgerritJulien Danjou proposed openstack/oslo.utils: timeutils: make marshall timezone aware  https://review.openstack.org/18259712:49
openstackgerritJulien Danjou proposed openstack/oslo.utils: timeutils: utcnow() returns a value with a timezone  https://review.openstack.org/18259812:49
*** kgiusti has joined #openstack-oslo12:51
openstackgerritJulien Danjou proposed openstack/oslo.utils: timeutils: deprecate isotime()  https://review.openstack.org/18260212:53
openstackgerritJulien Danjou proposed openstack/oslo.utils: Deprecate strtime  https://review.openstack.org/14850012:56
*** nkrinner has quit IRC13:06
*** mriedem has left #openstack-oslo13:10
*** mriedem has joined #openstack-oslo13:11
*** stpierre has joined #openstack-oslo13:20
openstackgerritVictor Sergeyev proposed openstack/oslo.messaging: Use connection.ChannelPool in RabbitMQ driver  https://review.openstack.org/18227213:21
viktorssileht: around?13:21
*** exploreshaifali has joined #openstack-oslo13:34
*** sputnik13 has joined #openstack-oslo13:34
silehtviktors, hi13:36
*** sigmavirus24_awa is now known as sigmavirus2413:37
*** sdake_ has joined #openstack-oslo13:39
viktorssileht: firs of all, thanks for your help with remove-double-reply spec. Will you suggest the comments or I'll do it?13:40
viktorssileht: and I found, that RabbitMQ driver spend a lot of time for creating a new channel, so I made a patch, which uses ChannelPool.13:41
viktorssileht: Please look at it, when you'll have a time - https://review.openstack.org/18227213:41
*** sdake has quit IRC13:42
silehtviktors, cool, I'm unsure about using a ChannelPool, but avoiding the recreation of a channel with this one work is a good enhancement.13:45
silehtviktors, I don't think I can review the patch soon, I will be in holiday in a couple of hour and then I go to the summit13:46
*** links has quit IRC13:48
viktorssileht: ok, enjoy your holiday :)13:50
*** _amrith_ is now known as amrith13:50
*** sdake has joined #openstack-oslo14:01
*** Kennan has quit IRC14:03
*** Kennan has joined #openstack-oslo14:03
*** sdake_ has quit IRC14:04
*** amotoki_ has joined #openstack-oslo14:06
*** mtanino has joined #openstack-oslo14:07
*** bknudson has joined #openstack-oslo14:15
*** jaypipes has joined #openstack-oslo14:15
*** jecarey has joined #openstack-oslo14:24
*** dulek has joined #openstack-oslo14:26
*** stevemar has joined #openstack-oslo14:32
openstackgerritVictor Stinner proposed openstack/oslo.versionedobjects: Drop outdated notes and docstrings  https://review.openstack.org/18269814:33
openstackgerritVictor Stinner proposed openstack/oslo.versionedobjects: Enhance dict compat of VersionedObjectDictCompat  https://review.openstack.org/18269914:33
haypois there someone here who can review my oslo.versionedobjects patches?14:38
haypoi don't know if this project is currently used outside nova14:38
ihrachyshkahaypo, there are plans for neutron to consume it in L14:38
haypoihrachyshka, ah, good to know14:39
ihrachyshkaalso heat?14:39
*** tsekiyama has joined #openstack-oslo14:39
haypowell, my second patch is required to port nova to python 314:43
*** e0ne is now known as e0ne_14:50
*** e0ne_ is now known as e0ne14:52
openstackgerritVictor Stinner proposed openstack/oslo.versionedobjects: Enhance docuemntation  https://review.openstack.org/18270714:53
dimssigmavirus24: around?14:54
sigmavirus24dims: I am14:54
sigmavirus24I was thinking about the problem last night, there must be a client that nova's using that is using streamed requests14:54
dimssigmavirus24: one _get_conn followed by 2 _put_conn's - http://paste.openstack.org/show/221879/14:54
sigmavirus24It doesn't necessarily have to be using iter_chunked, the thing we need to be looking for is stream=True14:55
dimssigmavirus24: from http://logs.openstack.org/95/182495/4/check/check-tempest-dsvm-multinode-full/86c885b/logs/screen-n-cpu.txt.gz14:55
sigmavirus24dims: interesting14:55
dimssigmavirus24: here's how i logged those lines https://review.openstack.org/#/c/182495/4/nova/utils.py,cm14:55
sigmavirus24dims: I'll try to figure out why that's happening, doesn't make sense based on the added log-info14:59
dimssigmavirus24: glanceclient/common/http.py", line 209 and glanceclient/common/http.py", line 243 both end up triggering a _put_conn essentially14:59
dimsand the 2nd one fails as the Queue size is 10 already15:00
dimsthanks sigmavirus2415:01
sigmavirus24So https://github.com/shazow/urllib3/blob/d5f6cefbd90268fbf5e4c976bad933246870e572/urllib3/connectionpool.py#L270 is where that log message comes from and self.pool is a Queue.LifoQueue15:02
sigmavirus24https://github.com/shazow/urllib3/blob/d5f6cefbd90268fbf5e4c976bad933246870e572/urllib3/connectionpool.py#L176 (is where self.pool is initialized)15:02
*** e0ne is now known as e0ne_15:02
sigmavirus24Hm, this is interesting15:03
sigmavirus24That should all be correct. The question becomes, why do we call _put_conn twice with the same HTTPConnection15:03
openstackgerritJulien Danjou proposed openstack/oslo.utils: timeutils: make marshall timezone aware  https://review.openstack.org/18259715:05
openstackgerritJulien Danjou proposed openstack/oslo.utils: timeutils: utcnow() returns a value with a timezone  https://review.openstack.org/18259815:05
openstackgerritJulien Danjou proposed openstack/oslo.utils: Deprecate strtime  https://review.openstack.org/14850015:07
viktorshaypo: around?15:12
haypoviktors, yes15:12
viktorshaypo: just a curiosity - are you sure, that DB tests were not skipped on patch  https://review.openstack.org/#/c/182709 ?15:12
haypoviktors, no, i'm not sure15:13
openstackgerritJulien Danjou proposed openstack/oslo.utils: timeutils: deprecate isotime()  https://review.openstack.org/18260215:13
viktorshaypo: ok, will wait for Jenkins :)15:13
haypoviktors, i didn't run tests locally, i don't think that i have the right setup to run tests, and i'm very confident in my change :-D15:14
viktors:-D15:14
haypoviktors, it doesn't look possible to make a choice between mysql-python, mysqlclient and pymysql; this patch is a quick change to unblock my work on python 315:15
haypoviktors, i guess that tempest will continue to use mysql-python, my change is specific to nova unit & functional tests15:15
*** dims has quit IRC15:15
viktorshaypo: in Ironic I've made a such thing - https://github.com/openstack/ironic/blob/master/tox.ini#L26-L3415:16
viktorshaypo: I think, it's can be a good addition to your patch15:16
*** dims has joined #openstack-oslo15:16
haypoviktors, i hesitate to split test-requirements.txt. i see that you chose to split15:17
*** ozamiatin has quit IRC15:18
haypoviktors, i don't know OS_TEST_DBAPI_ADMIN_CONNECTION. how is it used? see my nova patch, i saw hardcoded "mysql://..." URLs in the code15:18
viktorshaypo: it used for functional DB tests only to replace default DB connection strings15:19
*** salv-orlando has joined #openstack-oslo15:22
openstackgerritVictor Sergeyev proposed openstack/oslo.messaging: Use connection.ChannelPool in RabbitMQ driver  https://review.openstack.org/18227215:27
*** sdake has quit IRC15:30
*** sdake has joined #openstack-oslo15:31
jd__haypo: you have a penchant to comment things that do not need comments in reviews which is very disturbing15:32
haypojd__, right :)15:32
haypojd__, sorry for distrubing you :-p15:32
*** yamahata has joined #openstack-oslo15:33
jd__haypo: no problem, thanks for your help anyway15:34
mriedemdhellmann: gordc: dims: looks like we need a 0.6.1 release of pycadf on stable/juno15:34
mriedemoslo.messaging is uncapped on pycadf 0.6.0 which is breaking keystonemiddleware on stable/juno which is breaking glance15:34
jd__I really wonder sometimes how we ended up with so much crap in Oslo but well15:34
mriedempycadf stable/juno has a cap https://github.com/openstack/pycadf/commit/002953f683b0eb441a926c179c550ab3895f868315:34
mriedemjust need to release that bad boy15:34
*** browne has joined #openstack-oslo15:34
gordcmriedem: hmm. i thought i had release 0.6.1 last week15:35
mriedemhrm, looks like that's actually already in a 0.6.1 pycadf15:35
mriedemyeah there is15:35
*** yamahata has quit IRC15:36
gordcmriedem: ... i have a feeling i released it when the gate was broken... i guess it didn't publish to pypi15:36
*** yamahata has joined #openstack-oslo15:36
*** mriedem has left #openstack-oslo15:36
*** zqfan_afk has quit IRC15:37
*** mriedem has joined #openstack-oslo15:37
gordcmriedem: i will try to manually copy over tarballs over to pypi15:37
*** exploreshaifali has quit IRC15:37
dimsgordc: you may want to ask infra folks too on how they would recommend to copy things over15:38
gordcdims: i was just going to say... i don't know how safe it is for me to manually do that or if i should push an identical 0.6.2.15:38
gordci'll check with infra15:38
openstackgerritDavanum Srinivas (dims) proposed openstack/stevedore: Fix Python versions supported  https://review.openstack.org/18152415:39
*** salv-orlando has quit IRC15:41
*** e0ne_ is now known as e0ne15:43
*** kgiusti has quit IRC15:47
*** shakamunyi has quit IRC15:51
*** barra204 has quit IRC15:51
*** ashleighfarnham has joined #openstack-oslo15:58
*** viktors is now known as viktors|afk15:59
*** vilobhmm1 has joined #openstack-oslo16:00
*** amrith is now known as _amrith_16:02
openstackgerritVictor Stinner proposed openstack/oslo.versionedobjects: Enhance documentation  https://review.openstack.org/18270716:02
*** ashleighfarnham has quit IRC16:06
*** dulek has quit IRC16:08
*** ashleighfarnham has joined #openstack-oslo16:20
*** ashleighfarnham has quit IRC16:21
*** ashleighfarnham has joined #openstack-oslo16:22
*** vilobhmm1 has quit IRC16:25
*** haypo has quit IRC16:32
*** kgiusti has joined #openstack-oslo16:34
*** ihrachyshka has quit IRC16:34
openstackgerritOpenStack Proposal Bot proposed openstack/stevedore: Updated from global requirements  https://review.openstack.org/17987716:39
*** arnaud____ has joined #openstack-oslo16:43
*** inc0_ has quit IRC16:43
*** prad has quit IRC16:44
*** prad has joined #openstack-oslo16:44
*** amotoki_ has quit IRC16:46
*** arnaud____ has quit IRC16:49
*** browne has quit IRC16:51
*** vilobhmm1 has joined #openstack-oslo16:59
*** sdake has quit IRC17:00
*** zzzeek has joined #openstack-oslo17:06
*** achanda has joined #openstack-oslo17:14
*** _amrith_ is now known as amrith17:16
*** vilobhmm1 has quit IRC17:18
*** vilobhmm1 has joined #openstack-oslo17:19
*** harlowja has quit IRC17:20
*** harlowja has joined #openstack-oslo17:20
harlowjasamueldmq fyi, https://review.openstack.org/#/c/182445 if u want to comment on that to; i'm not exactly sure how that works yet (seems pretty preliminary/drafting)17:22
samueldmqharlowja, k will take a look later thanks17:23
harlowjacool17:24
harlowjajd__ maybe that marshall time stuff should be shared between oslo.serialization and oslo.utils17:29
harlowjai think the code is the same now :-P17:29
*** cdent has quit IRC17:30
*** salv-orlando has joined #openstack-oslo17:30
*** rrepaka123 has joined #openstack-oslo17:32
*** browne has joined #openstack-oslo17:33
*** yamahata has quit IRC17:40
*** alexpilotti has quit IRC17:41
*** salv-orlando has quit IRC17:44
rrepaka123llifeless:Hi Ping me if you need any additional info from me, yesterday i got pulled into other things, so didnt login to IRC.17:45
*** e0ne is now known as e0ne_18:00
*** e0ne_ is now known as e0ne18:04
*** yamahata has joined #openstack-oslo18:05
*** e0ne has quit IRC18:06
*** ajo has quit IRC18:10
openstackgerritMerged openstack/oslo.vmware: Add ToolsUnavailable exception  https://review.openstack.org/18252718:21
openstackgerritJoshua Harlow proposed openstack/taskflow: Remove customized pyX.Y tox requirements  https://review.openstack.org/18242318:23
gordcmriedem: we need a stable/icehouse for pycadf i think18:40
mriedemoh no18:40
gordcthe juno grenade test is broken because of new pycadf18:40
mriedemoh fun18:40
gordcit looks like new pycadf needs pytz<=2014.10 but pycadf 0.5.1 (which icehouse uses) has  pytz>=2010h18:40
mriedemhttps://github.com/openstack/requirements/blob/stable/icehouse/global-requirements.txt#L9518:41
mriedempytz>=2010h,<=2015.218:41
mriedemspecifically right?18:41
lifelessrrepaka123: hi sorry, wehad a gate wedge ysterdday and I had to pop into a (routine followup) with a doctor in the city, chewed up my day after the early rush of meetings18:41
lifelessrrepaka123: I will look at the pastebins shortly18:41
gordcmriedem: yeah... but i pycadf doesn't have an icehouse requirements sync.. so it just has whatever it was at the time (no upper cap)18:42
gordcmriedem: that's weird that icehouse has a later cap than juno18:42
mriedemgordc: yeah, was thinking the same18:42
mriedemgordc: maybe that's the problem18:43
gordcmriedem: i guess i can cut a 0.5.2 release (without creating a stable/branch18:43
rrepaka123lifeless: No problem just check before i vanish for next few days18:44
gordcmriedem: maybe i'll just create a 0.5.2 release with appropriate requirements.18:44
gordcmriedem: but yeah, i think that weird cap diff is going to be an issue.18:44
*** e0ne has joined #openstack-oslo18:45
*** jaosorior has quit IRC18:52
dimsstevemar: wanna do this in liberty? https://review.openstack.org/#/c/170685/18:58
stevemardims, if you guys think it's worth it, yes19:00
dimsstevemar: y please switch that from kilo to liberty and we can vote on it19:00
openstackgerritMerged openstack/oslo-specs: Add an adopt futurist spec  https://review.openstack.org/17989019:02
harlowjamerged19:02
harlowjabegin the fun19:02
* harlowja starting rocket-engine19:02
*** exploreshaifali has joined #openstack-oslo19:05
*** sdake has joined #openstack-oslo19:06
openstackgerritMerged openstack/taskflow: Remove custom py26/py27 tox venvs no longer used  https://review.openstack.org/18251219:06
openstackgerritMerged openstack/oslotest: Do not sync run_cross_tests.sh  https://review.openstack.org/18028119:08
mriedemi said this in -qa this morning half jokingly, but could some of our requirements nightmares be solved with a single large oslo library?19:11
mriedemso we do less cat herding?19:11
*** Rockyg_ has joined #openstack-oslo19:12
dhellmannmriedem: that would significantly limit the usefulness of some of the libraries19:13
harlowjamriedem dhellmann  said that was considered once :-P19:13
harlowjamake oslo-incubator.zip19:14
dhellmannmriedem: we're going to be sitting down next week to think through some of these requirements changes, so I expect some fixes in the week or two after the summit19:14
harlowjabut it really does do what dhellmann says, makes it basically a u take it all or u take nothing, even if u only use 1 little function from it19:14
dhellmannsome of those will likely involve breaking semver in the stable branches to cap requirements there, but we don't want to just do that without thinking it through19:14
mriedemdhellmann: i was trying to find the session link to add to my schedule but wasn't sure which one it was19:15
*** exploreshaifali has quit IRC19:16
*** amrith is now known as _amrith_19:17
gordcdhellmann: just a headsup, i think i neeed you to create a stable/icehouse branch for pycadf.... pytz issue above ^^19:18
dhellmannmriedem: I think ttx plans to discuss it in the release working session friday19:23
harlowjaanyone know how to connect https://launchpad.net/futurist into the oslo project listing @ https://launchpad.net/oslo19:26
harlowjai see no add my project to link19:26
harlowjamaybe someone knows the magic incantation19:27
dhellmanndims, harlowja : https://twitter.com/doughellmann/status/59856892130692300819:27
dhellmannharlowja: let me find the page where you set that, hang on19:27
harlowjasweet hotnesss dhellmann19:27
harlowjathx launchpad is weird, lol19:28
dhellmannharlowja: https://launchpad.net/futurist/+edit and in the "part of" field put "oslo" (no quotes)19:28
harlowjak19:28
harlowjahmm well thats weird19:28
harlowja'Not allowed here'19:28
harlowjaso dhellmann  maybe u can do that :P19:28
harlowja'Sorry, you don't have permission to access this page or the information in this page is not shared with you. '19:28
harlowjalol19:28
dhellmannharlowja: hmm19:28
dimsdhellmann: looks good!19:28
harlowja'Not allowed here19:28
harlowjaSorry, you don't have permission to access this page or the information in this page is not shared with you.19:28
harlowjaYou are logged in as Joshua Harlow.19:28
harlowja'19:28
harlowja:-/19:28
harlowjasadface19:28
dhellmannharlowja: ah, you may not be in the drivers group19:28
harlowjalol19:28
harlowjaah19:29
harlowjamaybe19:29
harlowjashould i be? (maybe sileht to?19:29
dhellmannprobably?19:29
harlowjalol19:29
dhellmannsileht is19:29
dhellmannlet me see about adding you19:29
dhellmanndone19:29
harlowjasweet19:29
harlowjai'm now offically cool19:29
harlowjaso who's gonna be the first to get the oslo moose tattoo?19:30
dhellmannharlowja: it would be good if you updated the "driver" field on futurist to refer to the oslo drivers team now19:30
harlowjajd__ ?19:30
harlowjak19:30
harlowjadone19:30
dhellmannno tats for me, but you go for it :-)19:30
harlowjalol19:31
harlowjanext time, http://www.temporarytattoo.in/water-based-tattoos.html19:32
harlowjalol19:32
*** e0ne has quit IRC19:32
dimsso i count futurist, automaton, oslo.cache, oslo.io and oslo.service so far...19:32
dimsanything else?19:32
harlowjahave we adopted sqlalchemy yet19:32
harlowja:-P19:32
* harlowja runs away19:33
dimshaha19:33
dhellmanndims: reports, maybe?19:33
* dims labels harlowja as "primary instigator of libraries"19:33
dimsah. right dhellmann19:33
harlowja:-/19:33
*** e0ne has joined #openstack-oslo19:33
harlowjaprimary awesome-person u mean19:33
dims:)19:34
*** frickler has quit IRC19:36
*** nkrinner has joined #openstack-oslo19:36
harlowjaok, https://review.openstack.org/182803 dims19:39
harlowjacopy/pasted the work items from a previous run of this @ https://blueprints.launchpad.net/oslo.utils/+spec/adopt-futurist (adjusting that as this goes)19:39
dimsfunny, i can't even +1 that review19:40
harlowja:-/19:41
harlowjathat repo is weird19:41
harlowjalol19:41
harlowjagovernance by the-one-true-dicator only, lol19:41
harlowjano comments allowed, lol19:41
harlowjafeedback and u go to prison19:41
harlowjalol19:41
dimscomments are ok i guess. just don't vote19:41
harlowjano pass go19:41
harlowjadims agreed with u, its odd that u can't do much of anything there19:42
harlowjademocracy fail, lol19:43
lifelessWALL OF TEXT19:43
*** e0ne has quit IRC19:43
mriedemgordc: is this the stable/icehouse pycadf thing you were talking about?19:44
mriedemhttp://logs.openstack.org/55/182755/1/check/check-grenade-dsvm/1f665f1/logs/grenade.sh.txt.gz#_2015-05-13_18_34_16_15619:44
*** stevemar has quit IRC19:44
openstackgerritMerged openstack/oslo.utils: Move versionutils into place and remove deprecation tools  https://review.openstack.org/17046919:49
openstackgerritMerged openstack/oslo.vmware: Add support for dynamicProperty  https://review.openstack.org/18239819:49
*** arnaud____ has joined #openstack-oslo19:50
openstackgerritMerged openstack/oslo.messaging: rabbit: redeclare consumers when ack/requeue fail  https://review.openstack.org/18005919:50
mriedemgordc: i'm kind of thinking pytz shouldn't be capped in g-r19:51
mriedemit doesn't require anything else so it's not a transitive dependency risk19:51
gordcmriedem: yep. that's the issue.19:52
mtreinishmriedem: well unless they break things19:52
mriedemblarg19:52
mriedemmtreinish: pytz is a pretty tiny thing19:52
mtreinishif pytz breaks an api that's consumed it could cause issues19:52
mtreinishmriedem: yeah I know, I'm just saying19:52
mriedemthere are other things that are uncapped in g-r19:53
mtreinishand at least in recent months backwards incompatible changes have not been a common failure on stable19:53
mtreinishthe most recent is probably boto19:53
dhellmanngordc: which hash should I use to create the branch?19:54
openstackgerritMerged openstack/oslo.messaging: rabbit: smarter declaration of the notif. queue  https://review.openstack.org/17927019:54
*** arnaud____ has quit IRC19:55
dhellmannmtreinish, mriedem : is pytz the thing that gives us the timezone database?19:55
mtreinishdhellmann: yep19:55
dhellmannmtreinish: ok, capping that would be bad -- that db changes way more often than you'd think19:55
dhellmannit turns out when you have political constructs like dst, politicians feel free to change them19:56
gordcdhellmann: if we don't uncap pytz, we'll need a stable/icehouse branch on https://github.com/openstack/pycadf/commit/d68002f9fb714e1897662fc4e89f261a9b8aacaa19:56
mriedemhere https://review.openstack.org/#/c/182755/19:57
gordc0.5.1 is the last pycadf release before juno requirements19:57
mriedemi updated that19:57
mtreinishdhellmann: sure19:57
dhellmanngordc: we can do both, it shouldn't be capped, imo19:57
mriedemhttps://review.openstack.org/#/c/182755/ uncaps pytz on stable/juno in g-r19:57
mriedemi will push a separate change to g-r stable/icehouse to uncap there19:57
dhellmannmriedem: +2a19:58
*** Rockyg_ has quit IRC19:59
*** e0ne has joined #openstack-oslo19:59
gordcthere's a pep8 comment in regards to pytz in master: https://github.com/openstack/requirements/blob/master/global-requirements.txt#L142-L14320:00
gordcdo we need to enforce a minimum?20:00
mriedemumm20:00
mriedemonly if we care about pep 44020:00
harlowjaok, main one up @ https://review.openstack.org/#/c/182808/20:01
harlowjawill wait for rest of work items until that goes in20:01
*** Rockyg has joined #openstack-oslo20:01
gordcmriedem: i don't know why it's there to be honest? didn't know other libs can cause pep failures.20:01
openstackgerritMerged openstack/oslo.log: fix pep8 errors  https://review.openstack.org/17357220:01
openstackgerritMerged openstack/oslo.log: Provide an API to let tempest control the log file  https://review.openstack.org/17357320:01
dhellmanngordc: so, create stable/icehouse for pycadf from 0.5.1?20:01
harlowjasileht https://review.openstack.org/#/c/182808/ for u to20:02
gordcdhellmann: yes please.20:02
mriedemgordc: pytz is 2015.2 on icehouse changes that i see so pep440 must not be a problem20:03
dhellmanngordc: https://review.openstack.org/#/c/182816/20:05
dhellmanngordc: branch created20:05
gordcmriedem: cool cool. need to pull in that update to pycadf for 0.6.3 release anyways so we can verify there.20:05
openstackgerritMerged openstack/oslo.utils: Remove run_cross_tests.sh  https://review.openstack.org/17948020:05
openstackgerritMerged openstack/oslo.utils: Denote monotonic import ordering + usage  https://review.openstack.org/17521820:05
openstackgerritMerged openstack/oslo.i18n: Remove run_cross_tests.sh  https://review.openstack.org/17947420:05
gordcdhellmann: cool +2a... thanks!20:06
openstackgerritMerged openstack/oslo.utils: Add exception_to_unicode() function  https://review.openstack.org/16350720:07
openstackgerritMerged openstack/oslo.rootwrap: Remove run_cross_tests.sh  https://review.openstack.org/17947720:08
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo.messaging: Remove stale copy of context.py  https://review.openstack.org/18282220:11
*** haypo has joined #openstack-oslo20:21
openstackgerritVictor Stinner proposed openstack/oslo.versionedobjects: Enhance dict compat of VersionedObjectDictCompat  https://review.openstack.org/18269920:23
*** jecarey has quit IRC20:24
*** jecarey has joined #openstack-oslo20:40
*** _amrith_ is now known as amrith20:40
gordcmriedem: i think you need to change https://review.openstack.org/#/c/182755/2/global-requirements.txt to say pycadf>=0.6.0,!=0.6.2,<0.7.020:44
*** ajo has joined #openstack-oslo20:47
*** achanda has quit IRC20:48
mriedemb/c pycadf has capped pytz20:50
gordcyeah...or at least 0.6.2 does20:50
mriedemright20:50
mriedemgod, who's idea was it to release that anyway20:51
*** nkrinner has quit IRC20:51
gordc... /me walks away.20:52
mriedemi'll remove the note in the requirements file too20:53
haypojaypipes, thanks for your support for if in the class body ;) https://review.openstack.org/#/c/182699/20:53
mriedemsince it doesn't really apply if we blacklist pycadf 0.6.220:53
gordcmriedem: cool cool20:54
jaypipeshaypo: hey now... I didn't say I loved it, just that I didn't hate it :) I still need to do a review on that...20:54
haypojaypipes, ah ok, but thanks ;)20:58
jaypipeshaypo: done20:59
haypojaypipes, cool :) i didn't know oslo.versionedobjects, so i checked the doc, but the doc is... empty! i wrote a patch to add a little bit more doc; ) https://review.openstack.org/#/c/182707/21:00
haypojaypipes, for nova, i will need the patch for dict api. would it be possible to schedule a release and later depend on it in nova?21:01
haypoi heard that heat and neutron may use this library, cool21:02
dansmithhaypo: why do you need a release immediately?21:04
*** isq_ has joined #openstack-oslo21:04
*** sreshetn1ak has joined #openstack-oslo21:05
haypodansmith, i'm not sure that a release is needed. i'm asking to be able to replace dict(obj.iteritems()) with dict(obj) in nova21:05
dansmithoh21:05
*** viktors has joined #openstack-oslo21:06
dansmithI guess I did just land the bit to make us use this dict layer didn't I?21:06
* dansmith completely forgot21:06
dansmithhaypo: I'd like to delay a bit if possible because I need to make another round of conversions in nova and I'd like to hold off in case there is anything else I need to bring over21:06
*** mriedem has quit IRC21:06
dansmithhaypo: can you get around it by just adding __iter__ to the nova class maybe?21:07
haypodansmith, my patch "Replace dict.iteritems() with six.iteritems(dict)" is not required right now. it's just a huge cleanup to start on a fresh base to start porting nova21:08
haypodansmith, i mean, smaller patches replacing dict.iteritems() can be written if it's really needed21:08
*** shardy has quit IRC21:08
haypodansmith, "can you get around it by just adding __iter__ to the nova class maybe?" yeah, that's a compromise. i have to investigate this option21:09
dansmithokay21:09
dansmiththere is that indirection bit still in nova at this point21:09
dansmithso you should be able to hide it in there I think21:09
*** rakhmerov has quit IRC21:09
*** sreshetnyak has quit IRC21:09
*** amaurymedeiros has quit IRC21:09
*** ekarlso has quit IRC21:09
*** bogdando has quit IRC21:09
*** viktors|afk has quit IRC21:09
*** larsks has quit IRC21:09
*** Kennan has quit IRC21:09
*** samueldmq has quit IRC21:09
*** isq has quit IRC21:09
*** isq_ has quit IRC21:09
*** isq_ has joined #openstack-oslo21:09
*** bogdando has joined #openstack-oslo21:09
*** amaurymedeiros has joined #openstack-oslo21:10
*** samueldmq has joined #openstack-oslo21:10
*** amaurymedeiros has quit IRC21:10
*** amaurymedeiros has joined #openstack-oslo21:10
*** ekarlso has joined #openstack-oslo21:10
*** Kennan has joined #openstack-oslo21:10
*** rakhmerov has joined #openstack-oslo21:10
*** larsks has joined #openstack-oslo21:11
*** achanda has joined #openstack-oslo21:11
*** vilobhmm11 has joined #openstack-oslo21:20
*** vilobhmm12 has joined #openstack-oslo21:21
*** vilobhmm11 has quit IRC21:21
*** kgiusti has quit IRC21:22
*** vilobhmm11 has joined #openstack-oslo21:22
*** vilobhmm1 has quit IRC21:23
*** vilobhmm1 has joined #openstack-oslo21:24
*** mriedem has joined #openstack-oslo21:25
*** vilobhmm12 has quit IRC21:26
*** vilobhmm11 has quit IRC21:27
mriedemgordc: https://review.openstack.org/#/c/182858/21:32
gordcmriedem: done21:33
lifelesstchaypo: ok so lets get this patch landed today21:41
harlowjahaypo i really loved http://docs-draft.openstack.org/07/182707/2/check/gate-oslo.versionedobjects-docs/f3573e9//doc/build/html/usage.html21:41
harlowjalol21:41
*** stpierre has quit IRC21:41
tchaypowell, ready to land at least21:41
tchaypolanding requires more +2s than I can deliver21:41
haypoharlowja, best doc ever21:41
tchaypomaybe you can help with that bit :)21:42
harlowja:)21:42
harlowjasomeday i wonder about how we can use http://marshmallow.readthedocs.org/en/latest/ in oslo.versionedobjects (maybe there is overlap there we can take advantage of) idk21:42
harlowjathat has a nice marshmallow logo21:43
harlowjalol21:43
lifelesstchaypo: once its ready I can shop it around21:44
lifelesstchaypo: did you push again last night?21:44
bknudsonit generates json so we could use something like marshmallow all over the place21:45
harlowjacool21:47
harlowjasomething to ponder on21:47
*** ho has joined #openstack-oslo21:47
harlowjathe marshmallow folks i didn't think wanted versioning in it21:47
harlowjaso maybe thats what oslo.versionedobjects adds21:47
harlowjai asked some time ago to the marshmallow folks21:47
bknudsonthis would clean up the keystone code quite a bit21:48
harlowjahttps://github.com/marshmallow-code/marshmallow/issues/17121:48
harlowja^ no thx to versions (at least a couple months ago)21:48
bknudsonbut it seems like other projects are using pecan or something laready21:48
harlowjamaybe they could be 'convinced' though21:48
* harlowja didn't push hard (at all)21:48
bknudson"Object versioning is outside of marshmallow's scope" -- ouch!21:49
harlowjaya, i didn't push harder, haha21:49
harlowjasomeone else could try21:49
harlowjamaybe that guy was in a bad mood :-P21:49
bknudsonkind of kills it for any project that plans to be around for a while21:49
tchaypolifeless: no; I did more work but haven’t pushed it yet21:49
hohello, is it possible to check my email "[openstack-dev] [oslo.policy] service_roles checks in oslo.policy" ?21:50
tchaypolet me push it up; aside from docs, I think it completes the extras21:50
harlowjabknudson i'm thinking maybe just need to dive deeper, or find that guy on IRC if we really wanted to go farther here...21:50
harlowjai'm guessing it could be figured out (or maybe thats what oslo.versionedobjects add, the versioning part)21:50
bknudsonhow similar is nova objects to marshmallow?21:50
harlowjaanyways, just idears21:50
bknudsonit's got a schema and serializing?21:50
haypoharlowja, it has a logo but also a doc :)21:50
harlowjafrom a high level, it looks similar21:51
harlowjabut i'm not an expert on either21:51
harlowjahaypo it has a marshmallow man logo21:51
harlowjalol21:51
tchaypogit review is running. lately it’s been taking ~4 minutes to push up21:51
bknudsonmaybe that part could be split out of nova.objects21:51
harlowjamarshmallow face21:51
haypoharlowja, there is maybe a unicode character for marshmallow21:52
openstackgerritMerged openstack/oslo.versionedobjects: Drop outdated notes and docstrings  https://review.openstack.org/18269821:52
harlowjamy guess is there has to be, lol21:52
harlowjaall sorta of weird crap in unicode21:52
harlowjalol21:52
harlowjaincluding literally a poo symbol21:52
harlowjahttp://www.fileformat.info/info/unicode/char/1f4a9/index.htm21:52
harlowjalol21:52
openstackgerritJames Polley proposed openstack-dev/pbr: WIP: Teach pbr to read extras from setup.cfg  https://review.openstack.org/18179521:53
harlowjabknudson it'd be an intersting investigation, use marshmallow (with docs) and if they don't want versioning support, we'll we add that ontop of it (or convince them to add it)21:54
harlowjabut i'm more of just theorizing :-P21:54
openstackgerritMerged openstack/oslo.versionedobjects: Enhance dict compat of VersionedObjectDictCompat  https://review.openstack.org/18269921:55
bknudson 💩21:55
haypocool, my first contribution to olso.versionedobjects was merged: drop doc, haha21:55
bknudsondid that work?21:55
harlowjayp21:55
harlowjayup21:55
harlowjai see poo21:55
harlowjalol21:55
harlowjapoo happy face21:56
harlowjalol21:56
bknudsonall I see is 01F4A9 :(21:56
harlowjaoh21:56
tchaypolifeless: I think I’m missing a step here. your comment mentions requirements.txt but I can’t find where util.py touches requirements.txt at all21:56
harlowjaare u using a client in a terminal without unicode font support (or with crappy unicode font support)21:56
bknudsonpidgin.21:57
bknudsonI wonder what makes poo happy.21:57
tchaypoit looks like that parsing happens in packaging21:58
*** ajo has quit IRC21:58
*** mriedem is now known as mriedem_away21:58
harlowjabknudson hmmm, odd, u'd think it'd work (on mac os x shows a poo sign)21:59
bknudsonstart leaving comments like -1 💩21:59
harlowjalol21:59
harlowjaor other fun ones @ http://www.fileformat.info/info/unicode/block/miscellaneous_symbols_and_pictographs/utf8test.htm21:59
lifelesstchaypo: parse_requirements is the direct parser; it may need touching22:00
lifelesstchaypo: that reflects into requires_dist in the config in MetadataConfig22:00
bknudsonI need a new computer to see those symbols22:00
lifeless(see hooks/metadata)22:00
harlowjabknudson or an updated font package maybe?22:00
lifelesstchaypo: which you then see as install_requires in the function you're accessing (see line 113 of util.py22:01
harlowjajaypipes dansmith do u know if anyone has looked at the overlap between oslo versioned objects and marshmallow.readthedocs.org/  (and perhaps someway the oslo versioned objects could use the work being done in marshmallow, a cooperative partnership if u will)22:02
* tchaypo notices that the first line of cfg_to_args is a comment saying that the method source code starts here22:04
* tchaypo imagines there used to be unimportant code before the comment22:04
bknudsonpecan has its own model / serializer - https://pecan.readthedocs.org/en/latest/jsonify.html22:05
lifelesstchaypo: so my comment stands, you should be able to work just within that metod22:06
bknudsontie the sqlalchemy model to the json model and keystone would be about 5 lines of code22:06
lifelesstchaypo: but - shove pdb in there, run setup.py egg_info locally, and you can see22:06
lifelesstchaypo: easy :)22:06
*** gordc has quit IRC22:06
harlowjahmmm, bknudson but thats another weird tying, something like marshmallow (which all it does is that stuff) seems more appropriate than using one in a web framework22:06
harlowjai mean i understand why pecan has one, just doesn't seem ideal22:06
bknudsonlooks like there's alternatives to marshmallow but they're all tied to web frameworks like pecan.jsonify -- http://marshmallow.readthedocs.org/en/latest/why.html#why22:10
harlowjaah, good link there22:11
harlowjaguess thats why it was created :-P22:11
harlowja(or one of the reasons it was)22:11
harlowjaless  💩22:12
bknudsongross!22:13
*** achanda has quit IRC22:13
*** salv-orlando has joined #openstack-oslo22:15
*** salv-orlando has quit IRC22:15
*** jecarey has quit IRC22:16
*** vilobhmm1 has quit IRC22:16
*** zzzeek has quit IRC22:17
*** vilobhmm1 has joined #openstack-oslo22:17
*** jamielennox|away is now known as jamielennox22:19
*** bknudson has quit IRC22:20
tchaypolifeless: yep, i see the hooks now22:22
*** e0ne has quit IRC22:28
*** Rockyg has quit IRC22:33
*** ekarlso has quit IRC22:34
*** ekarlso has joined #openstack-oslo22:34
*** ozamiatin has joined #openstack-oslo22:37
lifelesstchaypo: excellent22:37
*** ashleighfarnham has quit IRC22:39
*** ashleighfarnham has joined #openstack-oslo22:39
*** dims_ has joined #openstack-oslo22:40
*** achanda has joined #openstack-oslo22:40
-openstackstatus- NOTICE: Gerrit and Zuul are going offline for reboots to fix a security vulnerability.22:40
*** ChanServ changes topic to "Gerrit and Zuul are going offline for reboots to fix a security vulnerability."22:40
*** dims has quit IRC22:41
tchaypoidle thought22:42
tchaypodo we care about env markers in test_requires?22:42
tchaypos/test_requires/tests_require/22:42
*** dims has joined #openstack-oslo22:43
*** ashleighfarnham has quit IRC22:44
lifelesstchaypo: yes but its complicated22:46
lifelesstchaypo: see my thread on pypa-dev, but for this patch I recommend ignoring it22:46
lifelesssince I think the answer is going to be something like 'stop using test-requires'22:47
*** dims_ has quit IRC22:47
*** openstackgerrit has quit IRC22:47
tchaypookay. your comments on the review are almost starting to make sense to me22:49
*** openstackgerrit has joined #openstack-oslo22:49
tchaypomy first instinct is to move the data in requires-dist into extras[‘']22:55
tchaypowhich will then get it parsed by the code I’ve already written, and then we can pop it out again at the end22:55
tchaypomy second instinct is to be slightly horrified that I want to do all that shuffling-around with the data just to avoid slightly tweaking code just because I know it currently works22:56
*** ericksonfgds has joined #openstack-oslo22:58
*** ChanServ changes topic to "#openstack-oslo"22:58
-openstackstatus- NOTICE: Gerrit and Zuul are back online.22:58
tchaypookay, I can see two ways to do this23:02
tchaypoone is to pull the stuff I’ve already written into a parse-these-requirements function that gets called once on requires-dist around line 327 and again on extras around line 37723:03
tchaypothe other is to simply stuff requires-dist into extras[‘’] before line 377 and then pull extra_requires[‘’] out again after line 39223:04
tchaypo*thinks out loud*23:04
openstackgerritJoshua Harlow proposed openstack/taskflow: Beef up docs on the logbook/flow detail/atom details models  https://review.openstack.org/18158123:05
tchaypoeither way we need to handle the fact that the seperator is : in extras but ; in requires-dist23:05
lifelesstchaypo: so no23:06
lifelesstchaypo: I suggested you pull it into a single data structure because the other way won't work23:06
*** Rockyg has joined #openstack-oslo23:07
lifelesstchaypo: you need to merge any extras the user has written directly into anything coming out of install_requires23:07
lifelesstchaypo: so your first instinct - which is what i proposed last night - will just work, the other one will require corner case handling23:07
tchaypowell - it will if I s/;/:/g and then put it into extras[‘']23:08
lifelessI'm confused23:08
*** achanda has quit IRC23:09
lifelessreading up I think you described your options twice, once in one order and once in the reverse order23:09
lifelessfirst time: 'my first instinct is to move the data in requires-dist into extras[‘']'23:09
lifelesssecond time: 'one is to pull the stuff I’ve already written into a parse-these-requirements function'23:09
lifelessso, I was referring to the first time. MOving the data into extras ;)23:09
tchaypo*reads up*23:09
lifelessbut - there are two stages23:09
tchaypoyes I did get the order wrong *sigh*23:10
lifelessrather than s/;/:/ which will break on url requirements etc23:10
lifelessparse it locally in each case23:10
lifelessand union into a first-stage data structure23:10
tchaypoho hum. url requirements.23:10
lifelessthen process that into the final data structure23:10
tchaypothe code I’ve already written splits on the first :, so i think that’s going to break for url requirementsd23:11
lifelessright23:11
lifelessbut you've conflated two things23:11
lifelessparsing23:11
lifelessand marshalling23:11
lifelessparse into (req, marker)23:11
lifelessadd the same parse step up above for install requires23:11
lifelessthen a single marshalling loop23:11
openstackgerritVictor Stinner proposed openstack/oslo.db: Add a keys() method to SQLAlchemy ModelBase  https://review.openstack.org/18287723:14
tchaypoyep.23:16
tchaypoI have to go make a coffee, but when I’m back I’ll make a note that I need to add a test case that has a url requirement and fix anything that breaks23:17
lifelessuhm23:17
harlowjalifeless u should do like a talk at the summit about all this versioning stuff23:17
harlowjai'd go to that23:17
lifelessso thats a rathole23:17
harlowja*so u'd have at least 1 person23:17
lifelesstchaypo: because - I don't want to cry - so please don't. Lets just be a little careful on the code so far and not peer into the abyss.23:17
lifelessharlowja: hah. I might do one next summit. When the tooling is available.23:18
lifelessUNLEARNING 3 years of suffering23:18
harlowjalol23:18
harlowja^ perfect title23:18
harlowjaha23:18
harlowjaUNLEARNING 3 years of suffering: bring your lashings/rods/whipes23:20
harlowjathere, a little better23:20
harlowjaalthough maybe thats a difference conference :-/23:20
*** vipuls is now known as vipul23:20
lifelesswell23:21
lifelessI'm sure there is a set intersection in attendees23:21
harlowjahighly likely23:21
*** ozamiatin has quit IRC23:24
*** achanda has joined #openstack-oslo23:26
*** ho has quit IRC23:28
harlowjahmmm, is https://www.python.org/ down for othrs?23:28
harlowjasomeone killed it23:28
lifelesshttp://downforeveryoneorjustme.com/www.python.com23:29
lifelessoh org23:29
lifelesss is down23:29
lifelessh is up23:29
harlowjaah23:29
harlowjathx23:29
harlowjaforgot about that downforme site thingy23:29
tchaypolifeless: i should at least least change it to split on ‘ :’ rather than just ‘:'23:32
lifelesstchaypo: why?23:33
lifelesstchaypo: this is another reason to have your sample data be a text literal, its easier to show expected inputs23:33
tchaypo-f git+git://github.com/mozilla/elasticutils.git23:34
lifelesstchaypo: not a valid install_requires23:34
lifelesstchaypo: can't be present in an extras field23:34
lifelesstchaypo: urls are special, please don't try to understand. I don't want to page it all in ;)23:35
tchaypookay. I’ll just ignore them for now23:35
lifelesstchaypo: but the heart of the fault goes back to requirements != install-requires even though they do23:35
lifelesspip -r AFILE can specify things install_requires can't23:35
lifelessand what you're writing is in a saner spot23:35
lifelessor its meant to be23:36
tchaypo-e git://github.com/mozilla/elasticutils.git#egg=elasticutils ?23:36
lifelessvalid in a requirements file, not a valid install_requires23:37
tchaypoor extras23:37
lifelessvalid as a dependency link, which is deprecated, or a named doodah per pep426, but thats not implemented yet23:37
tchaypo*checks*23:38
tchayponot that I ever doubted you23:38
tchaypobut pdb confirms that as of line 244, requires_dist just has ‘pip\nelasticutils'23:39
tchaypookay good. moving right along...23:40
lifelessso there's probably preprocessing stripping out the matchers23:40
lifelessyou'll find that out when we write an acceptance test23:41
*** ho has joined #openstack-oslo23:44
*** rrepaka123 has quit IRC23:48
tchaypodoesn’t pip already handle env markers in requirements.txt?23:51
*** bknudson has joined #openstack-oslo23:51
haypotchaypo, it does since pip 623:51
*** tsekiyam_ has joined #openstack-oslo23:53
*** exploreshaifali has joined #openstack-oslo23:54
*** ericksonfgds has quit IRC23:55
lifelesstchaypo: it does, but thats requirements.txt, not install_requires23:55
lifelesstchaypo: see, I keep saying you don't want to stare down the abyss :)23:55
lifelesstchaypo: there is a data model for distributions23:56
lifelesstchaypo: markers are part of that. pbr doesn't export markers to that data model.23:56
lifelesstchaypo: we do our own parsing of requirements files23:56
lifelesstchaypo: (and only support a subset of pips capabilities)23:56
lifelesstchaypo: we use requirements files as both requirements files and as install_requires23:56
lifelesstchaypo: -> nothing you've learnt about or know about requirements files is relevant to the work we're doing now23:57
*** tsekiyama has quit IRC23:57
lifelesstchaypo: because we're working in the distribution data model23:57
jaypipesharlowja: the giant gaping hole that marshmallow is missing is schema evolution :) i.e. versioning.23:57
*** mtanino has quit IRC23:57
tchaypooh right.23:57
tchaypopip handles them when it’s installing packages23:57
harlowjajaypipes agreed, https://github.com/marshmallow-code/marshmallow/issues/171 was my attempt/initial probe to see if the author was willing to take that (or interested in it)23:58
lifelessour goal here is to get away from using requirements.txt entirely23:58
*** tsekiyam_ has quit IRC23:58
lifelessso we can separate out the distribution metadata and the deployment metadata23:58
harlowjajaypipes but maybe thats the value add we go to the author with and discuss more with (or if that doesn't work, thats the value add of the versionedobjects library?)23:58
lifelessfrom-git is a deployment decisions23:58
lifelessneeds-neutron is a distribution metadata statement23:58
jaypipesharlowja: not entirely sure it's worth it, but feel free to pursue.23:58
harlowjajaypipes i didn't especially try hard to 'convince him'23:58
jaypipesand letus know what you find :)23:58
harlowjadamn, i was gonna volunteer u23:59
harlowjalol23:59
tchayposo to do that, pbr has to be able to handle both requirements coming from requirements.txt but also install_requires in setup.cfg?23:59
*** ashleighfarnham has joined #openstack-oslo23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!