Tuesday, 2015-06-30

*** ashleighfarnham has quit IRC00:02
*** Rockyg has quit IRC00:05
*** sdake has quit IRC00:07
*** dims has joined #openstack-oslo00:12
*** sputnik13 has quit IRC00:12
dimsharlowja: around? can you please bless the pip-missing-requirements ones? https://review.openstack.org/#/q/status:open+topic:pip-missing-reqs,n,z00:13
harlowjayuppers00:13
* harlowja getting his holy water ready00:13
openstackgerritKomei Shimamura proposed openstack/oslo-specs: Blueprint Spec for Adding Kafka Driver  https://review.openstack.org/18900300:13
*** tsekiyam_ has joined #openstack-oslo00:13
dimsthanks harlowja00:14
harlowjaholy water gun ready00:14
harlowjastarts to shoot holywatergu00:14
harlowja*gun00:14
harlowja*super soaker like*00:14
*** mtanino has quit IRC00:16
dimshaha00:16
*** tsekiyama has quit IRC00:17
openstackgerritKomei Shimamura proposed openstack/oslo-specs: Specification for Adding Kafka Driver  https://review.openstack.org/18900300:18
*** tsekiyam_ has quit IRC00:18
harlowjadims spotted dups00:19
harlowjahttps://review.openstack.org/#/c/195837/00:19
harlowjahttps://review.openstack.org/#/c/195826/00:19
harlowjau pick00:19
harlowjaha00:19
dimsnuked one!00:20
harlowjawoah, oslo.messaging requires webob00:23
dimsmiddleware thingy00:23
harlowjaah00:23
harlowjak00:23
*** amotoki has joined #openstack-oslo00:27
harlowjaok, think i exhaused my hold watergun00:28
harlowja*exhausted00:28
harlowja*ye olde holy watergun00:28
*** boris-42 has joined #openstack-oslo00:31
*** ozamiatin has quit IRC00:31
*** manishg has quit IRC00:42
*** jamespd has joined #openstack-oslo00:47
jamespdIs there a good place to learn about the semantics of unique_id and msg_id?  I'm reading the amqpdriver code, but don't see any good docs regarding what these two are used for.00:49
harlowjalifeless dims  if u interested, i'm trying to form https://github.com/harlowja/taskflow_paper/blob/master/paper.tex (maybe can get that published somewhere); just an outline right now (but hopefully grows into something useful), ha00:53
*** abitha has quit IRC00:54
* harlowja seeking any volunterrs that want to be involved :_P00:54
harlowja:-P00:54
*** ViswaV has quit IRC00:55
*** ViswaV has joined #openstack-oslo00:56
lifelessharlowja: would I have to write tex?00:57
lifeless:)00:57
harlowja:-P00:57
harlowjamaybe a little?00:57
harlowjalol00:57
harlowjaits not that hard :-P00:57
dimsharlowja: very interesting, will let you know :)00:58
harlowjak00:58
* dims still has not read the papers you pointed out over the weekend00:58
harlowjahahaha00:58
harlowjathere's to many00:58
harlowjabut some interesting ones there00:59
harlowja* http://tempsend.com/4FD06CA829/7826/paper.pdf (what that paper.tex looks like rendered)00:59
harlowjaanyway, something i was thinking of doing01:00
harlowjacause u know, why the heck not, ha01:01
dims++ harlowja01:01
*** ashleighfarnham has joined #openstack-oslo01:03
*** ashleighfarnham has quit IRC01:07
lifelessharlowja: so maybe. I dunno ? :)01:10
harlowjaha, something to consider, idk either :-P01:11
lifelesslike, I don't think I've contributed much to taskflow01:12
lifelessI've kibbitzed here and there01:12
lifelessif you wanted to put my name in the fine print, that would be cool01:12
harlowjawell professor, its ok01:12
harlowjalol01:12
harlowja:-P01:12
lifelessI'm certainly happy to read and critique drafts01:12
harlowjacool01:12
*** sigmavirus24 is now known as sigmavirus24_awa01:13
* harlowja we need more openstack people to produce this stuff IMHO :-P01:13
lifeless[btw I've used beamer for presentations in the past01:13
lifelessthe tex thing was a tease01:13
lifelessI'm certainly stale on it, but not scared01:13
harlowjajust a weird-funky syntax, ha01:14
openstackgerritMerged openstack/oslo.rootwrap: Add tox target to find missing requirements  https://review.openstack.org/19583901:14
harlowja*yet another weird-funky syntax01:14
openstackgerritMerged openstack/oslo.middleware: Add tox target to find missing requirements  https://review.openstack.org/19583001:15
lifelessYAWFS01:17
harlowja:)01:17
lifelessmust make project for that now.01:17
harlowjasounds like a new filesystem, ha01:17
harlowjaYAW FS01:18
lifelessYou forgot the YEE01:20
lifelessYEE YAW FS01:21
harlowjaha01:33
dimsharlowja: cinder managed to get their test working with newer o.vo?01:36
*** timsim has joined #openstack-oslo01:38
*** tobe has joined #openstack-oslo01:38
*** timsim has left #openstack-oslo01:38
*** tobe has quit IRC01:39
*** yamahata has quit IRC01:43
*** kzaitsev_mb has joined #openstack-oslo02:01
*** sigmavirus24_awa is now known as sigmavirus2402:05
*** tobe has joined #openstack-oslo02:16
*** mriedem_away has quit IRC02:16
dimsativelkov: ping02:20
*** manishg has joined #openstack-oslo02:24
*** kzaitsev_mb has quit IRC02:24
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo.versionedobjects: Revert "Compound fields now coerce their elements' values"  https://review.openstack.org/19692602:26
*** ashleighfarnham has joined #openstack-oslo02:27
*** manishg has quit IRC02:28
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo.versionedobjects: Revert "Compound fields now coerce their elements' values"  https://review.openstack.org/19692602:28
*** stevemar has joined #openstack-oslo02:35
harlowjadims unsure02:37
dimsharlowja: unsure about?02:38
harlowja*about cinder fixing there test02:38
harlowjafor o.vo02:38
dimsack. looks like they were able to merge stuff and i just ran their py34 by hand and that works too02:38
harlowjak02:38
harlowjaguess something got tweaked somewhere then02:38
dimsso for Nova i figured out that i need a revert ^^^02:39
dimsy02:39
harlowjarevert all the things02:40
harlowjaback to commit #002:40
harlowjaoh, u probably don't mean that kind of revert02:40
harlowjaha02:40
dimsno this one was a single review02:40
harlowjahmmm, looks like a revert of things to me :-P02:41
harlowjayup yup, verified it changed some code back to something else02:41
*** mriedem has joined #openstack-oslo02:45
*** manishg has joined #openstack-oslo02:50
harlowjadims do u know if anyone uses that eventlet backdoor stuff, have u heard of people actually using it?02:58
harlowjathat one probably can be made into a real thread (with some kind of additions/changes when eventlet is active) but meh, or just delete that code, lol02:59
*** kevinbenton has joined #openstack-oslo03:08
*** manishg has quit IRC03:12
openstackgerritJoshua Harlow proposed openstack/oslo.service: Make the loopingcall code less dependent on eventlet  https://review.openstack.org/19447903:17
harlowjaeezhova let me know what u think of ^03:17
harlowjait does work :-P03:17
*** yamahata has joined #openstack-oslo03:41
*** rjaiswal has quit IRC03:44
*** ViswaV has quit IRC03:44
*** ViswaV has joined #openstack-oslo03:45
*** dims has quit IRC03:48
*** mriedem has quit IRC03:53
*** manishg has joined #openstack-oslo03:56
*** sdake has joined #openstack-oslo04:09
*** sdake_ has joined #openstack-oslo04:10
*** david-lyle has quit IRC04:13
*** achanda has joined #openstack-oslo04:13
*** sdake has quit IRC04:13
*** david-lyle has joined #openstack-oslo04:14
*** zz_jgrimm has quit IRC04:15
*** ihrachyshka has joined #openstack-oslo04:24
*** ihrachyshka has quit IRC04:25
*** ihrachyshka_ has joined #openstack-oslo04:25
*** sdake has joined #openstack-oslo04:25
*** zz_jgrimm has joined #openstack-oslo04:26
*** sdake_ has quit IRC04:29
*** achanda has quit IRC04:30
*** tobe has quit IRC04:31
openstackgerritMerged openstack/oslo.versionedobjects: Revert "Compound fields now coerce their elements' values"  https://review.openstack.org/19692604:32
*** hogepodge has quit IRC04:32
*** tobe has joined #openstack-oslo04:32
*** hogepodge has joined #openstack-oslo04:32
*** manishg has quit IRC04:33
*** sigmavirus24 is now known as sigmavirus24_awa04:39
*** zz_jgrimm has quit IRC04:39
*** zz_jgrimm has joined #openstack-oslo04:42
openstackgerritSteve Martinelli proposed openstack/oslo.concurrency: Remove redundant fileutils  https://review.openstack.org/19694504:42
*** amotoki_ has joined #openstack-oslo04:49
*** arnaud____ has joined #openstack-oslo04:50
openstackgerritJoshua Harlow proposed openstack/taskflow: Add ability to reset an engine via a `reset` method  https://review.openstack.org/18623904:54
*** arnaud____ has quit IRC04:54
*** sdake_ has joined #openstack-oslo04:59
*** arnaud____ has joined #openstack-oslo05:00
*** sdake has quit IRC05:03
*** sputnik13 has joined #openstack-oslo05:04
*** stevemar has quit IRC05:05
*** stevemar has joined #openstack-oslo05:06
*** rpodolyaka1 has joined #openstack-oslo05:07
*** ihrachyshka_ has quit IRC05:13
*** amotoki__ has joined #openstack-oslo05:24
*** amotoki_ has quit IRC05:24
*** arnaud____ has quit IRC05:31
*** jaosorior has joined #openstack-oslo05:38
*** hogepodge has quit IRC05:42
*** hogepodge has joined #openstack-oslo05:42
*** nkrinner has joined #openstack-oslo05:44
*** sputnik1_ has joined #openstack-oslo05:45
*** sputnik13 has quit IRC05:48
*** achanda has joined #openstack-oslo05:48
openstackgerritSteve Martinelli proposed openstack/oslo-specs: Graduate fileutils to oslo.utils and oslo.policy  https://review.openstack.org/17068505:49
*** rjaiswal has joined #openstack-oslo05:50
*** browne has quit IRC05:53
openstackgerritEric Brown proposed openstack/oslo.config: Expose min and max to IntOpt  https://review.openstack.org/19695505:59
*** browne has joined #openstack-oslo06:00
*** achanda has quit IRC06:04
*** stevemar has quit IRC06:05
*** stevemar has joined #openstack-oslo06:06
*** arnaud____ has joined #openstack-oslo06:06
*** ihrachyshka_ has joined #openstack-oslo06:07
*** stevemar has quit IRC06:09
*** SridharGaddam has joined #openstack-oslo06:16
*** rpodolyaka1 has quit IRC06:19
*** achanda has joined #openstack-oslo06:26
*** sdake_ has quit IRC06:29
openstackgerritEric Brown proposed openstack/oslo.config: Expose min and max to IntOpt  https://review.openstack.org/19695506:32
*** browne has quit IRC06:52
*** rpodolyaka1 has joined #openstack-oslo06:58
*** pblaho_ has joined #openstack-oslo07:00
*** arnaud____ has quit IRC07:01
*** boris-42 has quit IRC07:02
*** achanda has quit IRC07:03
*** pblaho has quit IRC07:04
*** sputnik1_ has quit IRC07:05
*** sputnik13 has joined #openstack-oslo07:05
*** pblaho_ has quit IRC07:06
*** pblaho has joined #openstack-oslo07:06
*** sputnik13 has quit IRC07:09
openstackgerritVictor Sergeyev proposed openstack/oslo.messaging: Remove qpid-config call  https://review.openstack.org/19472307:28
*** subscope has quit IRC07:31
*** e0ne has joined #openstack-oslo07:33
*** e0ne has quit IRC07:37
*** rpodolyaka1 has quit IRC07:40
*** ndipanov has quit IRC07:42
*** ndipanov has joined #openstack-oslo07:44
*** subscope has joined #openstack-oslo07:47
*** amotoki__ has quit IRC07:50
*** yamahata has quit IRC07:52
*** sdake_ has joined #openstack-oslo07:55
*** subscope has quit IRC07:55
*** shardy_ has joined #openstack-oslo07:58
*** shardy has quit IRC07:59
*** pblaho_ has joined #openstack-oslo08:02
*** shardy_ has quit IRC08:03
*** shardy has joined #openstack-oslo08:04
*** pblaho has quit IRC08:05
*** jaosorior has quit IRC08:06
*** pblaho_ has quit IRC08:07
*** stevemar has joined #openstack-oslo08:07
*** pblaho has joined #openstack-oslo08:08
*** stevemar has quit IRC08:10
*** rpodolyaka1 has joined #openstack-oslo08:11
*** subscope has joined #openstack-oslo08:11
*** droyal has quit IRC08:16
*** tobe has quit IRC08:17
*** rpodolyaka1 has quit IRC08:21
*** rpodolyaka1 has joined #openstack-oslo08:23
*** subscope has quit IRC08:24
*** rpodolyaka1 has quit IRC08:25
*** rpodolyaka1 has joined #openstack-oslo08:28
*** yassine_ has joined #openstack-oslo08:34
*** Kennan has quit IRC08:38
*** subscope has joined #openstack-oslo08:38
*** Kennan has joined #openstack-oslo08:38
*** dguitarbite has joined #openstack-oslo08:42
*** sdake_ has quit IRC08:45
-openstackstatus- NOTICE: OpenStack CI is down due to hard drive failures08:49
*** ChanServ changes topic to "OpenStack CI is down due to hard drive failures"08:49
*** rjaiswal has quit IRC08:54
*** e0ne has joined #openstack-oslo09:02
*** e0ne is now known as e0ne_09:15
*** ozamiatin has joined #openstack-oslo09:17
*** kzaitsev_mb has joined #openstack-oslo09:24
*** e0ne_ has quit IRC09:26
*** e0ne has joined #openstack-oslo09:29
*** kzaitsev_mb has quit IRC09:31
*** rpodolyaka1 has quit IRC09:39
*** rpodolyaka1 has joined #openstack-oslo09:42
*** subscope has quit IRC09:44
*** rpodolyaka1 has quit IRC09:46
*** stevemar has joined #openstack-oslo09:56
*** stevemar has quit IRC10:00
*** subscope has joined #openstack-oslo10:01
*** arnaud____ has joined #openstack-oslo10:02
*** arnaud____ has quit IRC10:07
*** e0ne is now known as e0ne_10:23
*** e0ne_ is now known as e0ne10:25
*** shardy_ has joined #openstack-oslo10:43
*** shardy has quit IRC10:45
*** shardy_ has quit IRC10:48
*** shardy has joined #openstack-oslo10:49
*** rpodolyaka1 has joined #openstack-oslo10:50
*** dims has joined #openstack-oslo11:07
*** exploreshaifali has joined #openstack-oslo11:13
haypodims: hi. we need to something to enhance tests before oslo releases11:26
dimshaypo: yep11:27
haypodims: to catch more bugs. it's annoying to notify bugs only after a release. the cost is fix them is much higher, and bugs are annoying - as you probably already know :-D11:27
haypodims: are you using a script?11:27
haypodims: did you have time to investigate why oslo.db was installed using the version 0.12.0 and not the master branch?11:28
dimshaypo: figured out what was wrong - am using https://review.openstack.org/#/c/186413/11:28
dimshaypo: see the install_command - https://review.openstack.org/#/c/186413/9/tox.ini,cm11:28
dimsthat was causing older versions to be installed11:28
haypooh, i didn't notice this line11:28
*** rpodolyaka1 has quit IRC11:28
dimsif you see latest runs, you can see that we pick up right version of oslo from master11:29
dimshaypo: see example http://logs.openstack.org/13/186413/9/check/gate-nova-python27/9a85e81/testr_results.html.gz11:30
dimsit shows the problem we saw in nova yesterday11:30
haypodims: cool11:30
*** rpodolyaka1 has joined #openstack-oslo11:30
haypodims: how did you write the patch https://review.openstack.org/#/c/186413/ ?11:30
dimshaypo: see requirements.txt11:30
*** subscope has quit IRC11:31
haypodims: i saw it. but i would like if you wrote the patch manually, or if you have a tool for that11:31
haypodims: what do you think of having a CI (where C stands for continuous :-)) for running tempest with the master branch of oslo.* ?11:32
haypodims: it's also annoying to only detect bugs while preparing a release11:32
dhellmannhaypo: we run like tempest on every patch, the problem is the unit tests in the other projects11:32
dimshaypo: i have one of those too - https://review.openstack.org/#/c/186418/11:33
dims++ dhellmann11:33
haypodhellmann: i don't understand how the oslo.versionedobject regression was not detected before11:33
dhellmannI don't know what happened there, did it break something?11:34
haypodhellmann: yes, cinder & nova...11:34
haypodhellmann: https://review.openstack.org/#/c/196926/ i don't see tempest here11:34
dimshaypo: 186413 was working well before, something changed in the harness which reinstalled old versions over the one specified in requirements and i did not notice that11:34
haypodhellmann: maybe, tempest is only run for some oslo projects, but not all of them?11:34
dhellmannhaypo: gate-tempest-dsvm-neutron-src-oslo.versionedobjects11:34
dimsright11:34
*** manishg has joined #openstack-oslo11:35
dimshaypo: see pip freeze of that job11:35
haypodims: ok, i understood for 18641311:36
dimsdhellmann: the jobs the release script generates do not log anything do they? (thinking if i can release o.vo 0.5.1)11:36
haypodhellmann: oh ok. hum. does it mean that the test failure in nova was only in nova unit tests, not in tempest?11:36
dimshaypo: yep11:36
haypook. so i have to rephrase my question: should we have a CI running nova unit tests with all oslo.* master branches? or add a check job running nova unit tests to oslo.* projects?11:37
haypomaybe more than just nova. also cinder & neutron?11:38
haypocinder, neutron, nova are the 3 most important projects in openstack, right?11:38
dimshaypo: not sure what you are asking, i just pointed you to 2 reviews, one runs oslo.* master against nova itself, the other one runs oslo.* against devstack for a bunch more projects11:38
dhellmanndims: they do log, but they're not visible through gerrit. you can use "git os-job" (pip install git-os-job) and the version number to find the URL to the logs11:39
haypodims: i would like to automate this to detect bugs earlier11:39
haypodims: i don't want to wait until we prepare a release to detect a regression11:39
haypo(it's too late)11:39
dimshaypo: sure, ideas beyond those 2 reviews are welcome11:39
dhellmannhaypo: it is not practical to run all of the unit tests for all projects against all of the oslo libraries that use them every time we send in a patch. Submitting patches to oslo.config or oslo.log would take up all of our available test nodes at this point11:40
haypodhellmann: you mean that it would cost too much resources to openstack infra?11:40
dhellmannhaypo: yes. We would use our entire quota just to run a single patch through the check queue for some of the more popular libraries11:41
haypodhellmann: well, i understand this practical issue :-) in this case, we have to double check manual checks done before a release11:41
dimshaypo: ++ please kick tires on thu/fri11:41
dhellmannhaypo: there's a script in oslotest that does what you want, serially11:41
haypoand maybe run them once per week11:41
haypodhellmann: can this script be used on a desktop PC?11:42
dimshaypo: and we do already do a go-no-go on monday meeting11:42
dhellmannit takes something like 12 hours to run, which is longer than jobs are allowed to live in CI, so I use it by hand (I'm using it to pre-test the namespace removals)11:42
haypodhellmann: (how long does it take)11:42
haypo12 hours, wow :)11:42
dhellmannhaypo: I use it on a cloud vm, but it would work anywhere you could run the tests. It might not work on OS X11:42
dhellmannthe length actually depends on how many projects use the libs, of course, so some are less11:43
haypodhellmann: maybe we can ask to get dedicated resources from the openstack infra to run such test?11:43
haypomy idea is to run this script and then send a report11:44
haypowould it be insane to run it every day?11:44
haypoin an ideal world without any bug, it would not send any email :)11:44
*** stevemar has joined #openstack-oslo11:45
*** manishg has quit IRC11:45
*** jaosorior has joined #openstack-oslo11:45
*** manishg has joined #openstack-oslo11:45
*** subscope has joined #openstack-oslo11:47
hayposuch email would not be send to openstack-dev, maybe to users who explicitly asked (ex: me!)11:47
*** manishg has quit IRC11:47
*** stevemar has quit IRC11:48
haypo(we may start with the oslo liaison guys)11:48
*** rpodolyaka1 has quit IRC11:51
*** rpodolyaka1 has joined #openstack-oslo11:52
dimshaypo: get familiar with that script, see what it takes and we can propose something11:55
dimstry it out a few times :)11:55
haypodims: "what it takes" what do you mean?11:56
dimsmachine cpu/ram, scripts around it11:56
dimsto pull everything from git, scripts to collect error11:57
dimss11:57
haypotools/oslo_run_cross_tests doesn't look to install the development version of oslo.* projects11:58
haypois it the right script?11:58
*** prad has joined #openstack-oslo12:02
*** marcusvrn has joined #openstack-oslo12:07
dhellmannhaypo: if you want to test oslo.config, you go to the oslo.config source directory and run "tox -e venv -- oslo_run_pre_release_tests"12:09
dhellmannhaypo: you need to have already checked out all of the sources for openstack using the script for that in oslo-incubator/tools12:10
dhellmannoslo_run_pre_release_tests uses a config file (~/.oslo.conf) where you can set the repo_root to point to the directory where you have the source checked out12:11
* dhellmann needs to document these things12:11
haypo"dhellmann needs to document these things" yeah, that would be nice :)12:11
haypodhellmann, dims : i sent an email to openstack-dev to discuss how we can enhance the oslo release process12:13
haypo(i tried to summurize our discussion here)12:14
*** stpierre has joined #openstack-oslo12:14
*** subscope has quit IRC12:17
*** amrith is now known as _amrith_12:25
haypodhellmann: it would be great if you can reply to my email to give the commands to run tests12:29
haypodhellmann: sorry, i'm unable to rebuild the puzzle12:29
dhellmannhaypo: I'm working on that right now12:29
haypodhellmann: coolness12:29
haypodims: serisouly, i want to blame anyone. i don't care if you missed a bug. i only care of making the process better ;)12:30
haypowoops12:30
dhellmanndims: I wonder if we should ask the nova folks to remove that install customization with the --force-reinstall option from their tox file?12:30
haypodims: serisouly, i *don't* want to blame anyone. i don't care if you missed a bug. i only care of making the process better ;)12:30
dimshaypo: no worries.12:31
haypodims: i know that it's an hard task to cook a release12:32
*** ozamiatin has quit IRC12:32
*** gordc_afk is now known as gordc12:38
*** kgiusti has joined #openstack-oslo12:42
*** shardy has quit IRC12:43
*** shardy has joined #openstack-oslo12:43
*** manishg has joined #openstack-oslo12:47
openstackgerritDoug Hellmann proposed openstack/oslotest: Add documentation for cross-project unit testing  https://review.openstack.org/19705012:47
dhellmannhaypo, dims : ^^12:47
*** bknudson has joined #openstack-oslo12:47
*** manishg has quit IRC12:51
*** rpodolyaka1 has quit IRC12:53
*** manishg has joined #openstack-oslo12:54
*** bknudson has quit IRC12:54
*** zzzeek has joined #openstack-oslo13:06
ativelkovhi dims13:06
ativelkovseems like that was my patch which caused the trouble, or at least part of it.  Now trying to understand how to detect such issues before they hit the gate13:07
dimsativelkov: we were just talking about it. one way was doc'ed by doug just now - https://review.openstack.org/19705013:09
dimsativelkov: here's another way i was using https://review.openstack.org/#/c/186413/13:10
*** bknudson has joined #openstack-oslo13:10
*** rpodolyaka1 has joined #openstack-oslo13:12
*** manishg has quit IRC13:14
ativelkovGot it. And so it seems like it should be done for cinder as well13:14
dimsativelkov: problem is someone has to run it thu/fri everyweek and follow up when errors show up13:23
ativelkovdims: May we add some more tempest jobs to oslo so they are run on each commit?13:25
openstackgerritBrant Knudson proposed openstack/oslo.serialization: Stop using deprecated oslo_utils.timeutils.strtime  https://review.openstack.org/19706913:26
dimsativelkov: counter productive, too much load on info and not scalable big-tentwise (how many can we add)13:28
dimsproblem is the unit tests are tripping up13:28
dimswe have a dsvm job already for each oslo project that runs tempes13:28
*** e0ne is now known as e0ne_13:29
ativelkovSo, the problem is only unit-tests? I thought that as least some of the failures reported at https://bugs.launchpad.net/oslo.versionedobjects/+bug/1469865 were tempest jobs13:30
openstackLaunchpad bug 1469865 in OpenStack Compute (nova) "oslo.versionedobjects breaks nova/cinder tests" [Critical,In progress] - Assigned to Victor Stinner (victor-stinner)13:30
bknudsonif the unit tests don't catch it then fix the unit tests13:30
dimsbknudson: ++13:31
*** boris-42 has joined #openstack-oslo13:31
*** _amrith_ is now known as amrith13:33
*** stevemar has joined #openstack-oslo13:34
*** manishg has joined #openstack-oslo13:35
dansmithativelkov: are you working on the fix for that?13:37
*** stevemar has quit IRC13:37
*** manishg has quit IRC13:38
*** mriedem has joined #openstack-oslo13:39
*** e0ne_ has quit IRC13:39
ativelkovdansmith: yes. Seems like the reason is the way how deepcopy reinstantiates CoercedCollections, such as CoercesList, CoercedDict and CoercedSet. For set it is unable to properly infer the constuctor agrs13:39
dansmithativelkov: okay13:39
ativelkovTrying to find the best way to do it without having custom constructors13:40
dansmithokay, thanks for working on it13:40
*** sigmavirus24_awa is now known as sigmavirus2413:40
*** zz_jgrimm is now known as jgrimm13:42
*** stevemar has joined #openstack-oslo13:42
*** e0ne has joined #openstack-oslo13:46
openstackgerritSteve Martinelli proposed openstack/oslo.concurrency: Remove redundant fileutils  https://review.openstack.org/19694513:47
*** manishg has joined #openstack-oslo13:52
dimsativelkov: thanks!13:53
*** pblaho has quit IRC13:53
*** manishg_ has joined #openstack-oslo13:55
*** manishg has quit IRC13:55
*** yamahata has joined #openstack-oslo13:58
*** jecarey has joined #openstack-oslo14:00
*** dims has quit IRC14:01
*** dims has joined #openstack-oslo14:01
*** browne has joined #openstack-oslo14:05
*** rjaiswal has joined #openstack-oslo14:08
*** mtanino has joined #openstack-oslo14:11
*** pblaho has joined #openstack-oslo14:11
*** ozamiatin has joined #openstack-oslo14:12
*** ihrachyshka_ has quit IRC14:13
*** ihrachyshka has joined #openstack-oslo14:14
*** dbite has joined #openstack-oslo14:19
*** manishg_ has quit IRC14:23
*** shardy_ has joined #openstack-oslo14:24
*** shardy has quit IRC14:24
*** shardy_ has quit IRC14:29
*** shardy has joined #openstack-oslo14:30
*** pblaho has quit IRC14:39
*** pblaho has joined #openstack-oslo14:39
*** rushiagr_away is now known as rushiagr14:45
*** rpodolyaka1 has quit IRC14:51
*** subscope has joined #openstack-oslo14:52
krotscheckdims, dhellmann: It's been a week since I've addressed gordc's questions and comments on https://review.openstack.org/#/c/191238/ and https://review.openstack.org/#/c/194268/ . In order to not delay this any further, could you two take a look?14:53
*** rpodolyaka1 has joined #openstack-oslo14:53
*** ChanServ changes topic to "#openstack-oslo"14:54
-openstackstatus- NOTICE: The log volume was repaired and brought back online at 14:00 UTC. Log links today from before that time may be missing, and changes should be rechecked if fresh job logs are desired for them.14:54
*** e0ne is now known as e0ne_14:55
*** shardy has quit IRC14:56
*** shardy has joined #openstack-oslo14:56
dhellmannkrotscheck: I wonder if he was offline last week? I'll take a look14:58
*** jaypipes has quit IRC14:58
*** e0ne_ is now known as e0ne14:58
*** e0ne is now known as e0ne_14:59
*** e0ne_ is now known as e0ne14:59
dhellmannkrotscheck: https://review.openstack.org/#/c/191238/5 is going to be backwards incompatible, right? are we concerned about that?14:59
*** nkrinner has quit IRC15:00
krotscheckdhellmann: Well, I don't know to what extent people are using the middleware. I know that I myself haven't landed anything in openstack, but I can't speak for shadow-downstream.15:00
krotscheckdhellmann: So I'm personally not concerned.15:00
krotscheckBut my level of not-being-concerned may vary with others'.15:01
*** exploreshaifali has quit IRC15:01
dhellmannkrotscheck: yeah, if we've released it we can't break it because it's next to impossible to discover users15:02
dhellmannthis one is particularly challenging because it requires a change to the paste.ini file for a project, but if we haven't landed those ourselves I think we're probably ok to deprecate the old class in favor of the new API, but we have to retain the old API15:03
*** shardy has quit IRC15:12
*** ihrachyshka has quit IRC15:12
krotscheckdhellmann: Alright, I'll see what I can do.15:15
dhellmannkrotscheck: the "simple" fix is to literally make a new class and mark the old one deprecated, but if you want to get fancier that's fine15:15
dhellmannthis is a case where duplicating code feels fine, because you don't want that old behavior to change at all15:16
krotscheckdhellmann: Honestly, I think I'm going to make the config non-oslo-specific.15:16
dhellmannkrotscheck: I'm not sure what you mean?15:16
krotscheckWell, the constructor takes config as a property, however at the moment it makes the assumption that it's an instance of oslo.config. I'm wondering if there's a decent way to have it sanely detect that and adjust itself accordingly.15:17
*** shardy has joined #openstack-oslo15:18
dhellmannkrotscheck: ah, I see, yeah, probably15:18
dhellmannI mean, you could do an explicit check and convert it to something more generic in that case15:18
*** tsekiyama has joined #openstack-oslo15:20
krotscheckdhellmann: Yeah, something like that. I'll play around with it, see what I can make the tests accept.15:23
dhellmannkrotscheck: ok. like I said, it's perfectly ok to be expedient in this case, too, so don't spin your wheels on it15:24
*** krotscheck has left #openstack-oslo15:24
*** haypo has left #openstack-oslo15:24
*** krotscheck has joined #openstack-oslo15:24
krotscheckAight15:24
*** yamahata has quit IRC15:26
*** ozamiatin has quit IRC15:27
dhellmanndims: is this the test that was failing in nova with the versioned objects release? http://paste.openstack.org/show/328826/15:29
dhellmannthat actually looks like an oslo.db issue, so probably not?15:30
dimsdhellmann: that was the oslo.db one15:30
dimsdhellmann: o.vo failures were about __init__ having wrong number of parameters15:30
dhellmannok, I got that from the cross-tests in oslo.versionedobjects15:30
dhellmannhmm, I only saw the one failure15:31
dhellmannoh, heh, the change was reverted15:31
dhellmannduh15:31
dimsdhellmann: y, we reverted one change and issued 0.5.115:31
dhellmannk15:31
dimsdhellmann: i am looking at travis-ci.org to see if we can setup something there15:32
dhellmanndims: we should probably just talk to the infra team about running some of these longer jobs -- it's fine to run all of the unit tests in one node in this case if we can prevent the job from timing out15:33
dimsdhellmann: y, will look at a few things including that15:33
openstackgerritJoshua Harlow proposed openstack/futurist: Add future waiting helper module  https://review.openstack.org/19626915:34
*** ViswaV_ has joined #openstack-oslo15:40
*** ViswaV has quit IRC15:41
openstackgerritMichael Krotscheck proposed openstack/oslo.middleware: Support PasteDeploy  https://review.openstack.org/19123815:44
krotscheckdhellmann: ^^ That should do it. Thoughts on the approach?15:44
*** manishg has joined #openstack-oslo15:44
krotscheckdhellmann: I still have to update the documentation.15:45
*** amrith is now known as _amrith_15:48
*** manishg has quit IRC15:49
*** abitha has joined #openstack-oslo15:50
openstackgerritThomas Goirand proposed openstack-dev/cookiecutter: Add insentive to write a long description  https://review.openstack.org/19714615:51
stevemardims: did the oslo releases not happen yesterday?15:51
dimsstevemar: we did a bunch. which one did you need?15:51
stevemardims: oslo.cache15:51
dimsstevemar: let me check my notes15:52
dimsstevemar: there was only one change in tests.15:53
dimsstevemar: at the time when i ran my report15:54
dimslooks like a couple more went in later in the day15:54
*** sdake has joined #openstack-oslo15:54
dimsstevemar: lets get the 4 in the queue in (https://review.openstack.org/#/q/project:openstack%2Foslo.cache+is:open,n,z) and i'll cut another release. ok?15:56
*** achanda has joined #openstack-oslo15:56
dimsbknudson: ^^15:56
*** sdake_ has joined #openstack-oslo15:56
stevemardims: oh sure15:57
ativelkovdims:  I think I've got the fix for versioned_object but I am stuck trying to verify it: attempt to do a clean checkout of nova to run its unittest leads to a number of tests failing with "No module named request" exceptions. I am definetely doing something wrong, but don't know what exactly.15:58
openstackgerritMichael Krotscheck proposed openstack/oslo.middleware: Support PasteDeploy  https://review.openstack.org/19123815:58
stevemarbknudson: whats the deal with reworking the exceptions for oslo.cache15:59
stevemarthey are currently overkill?15:59
bknudsonstevemar: mixing http response codes into exceptions doesn't make sense in a library15:59
stevemarthat too16:00
*** achanda has quit IRC16:00
*** sdake has quit IRC16:00
openstackgerritMichael Krotscheck proposed openstack/oslo.middleware: Support PasteDeploy  https://review.openstack.org/19123816:01
openstackgerritMichael Krotscheck proposed openstack/oslo.middleware: Support PasteDeploy  https://review.openstack.org/19123816:01
openstackgerritMerged openstack/oslo.cache: Remove unnecessary file  https://review.openstack.org/19663616:02
stevemarbknudson: no auto docs for the backends?16:02
krotscheckok, dhellmann. This patch addresses your last set of comments. ^^16:03
dhellmannkrotscheck: +216:04
openstackgerritMerged openstack/oslo.service: Add tox target to find missing requirements  https://review.openstack.org/19582916:05
openstackgerritMerged openstack/oslo.service: Add greenlet to requirements  https://review.openstack.org/19583516:05
*** shardy has quit IRC16:06
bknudsonstevemar: are they part of the public API?16:06
*** shardy has joined #openstack-oslo16:07
*** ViswaV_ has quit IRC16:08
*** ViswaV has joined #openstack-oslo16:09
openstackgerritMerged openstack/oslo.cache: Cleanup exceptions  https://review.openstack.org/19647816:09
*** ViswaV has quit IRC16:09
*** arnaud____ has joined #openstack-oslo16:10
*** shardy_ has joined #openstack-oslo16:17
*** shardy has quit IRC16:18
stevemarbknudson: commented on more stuff16:19
*** beekneemech is now known as bnemec16:19
dimsativelkov: fix Routes==1.13 in requirements.txt16:22
ativelkovdims: thanks16:22
dimsativelkov: https://bugs.launchpad.net/nova/+bug/146988316:22
openstackLaunchpad bug 1469883 in OpenStack Compute (nova) "Unit tests fail with Routes==2.1" [Undecided,New]16:22
*** shardy_ has quit IRC16:23
*** e0ne is now known as e0ne_16:23
*** shardy has joined #openstack-oslo16:24
dimsativelkov: that reminds me to ping dhellmann about https://review.openstack.org/#/c/196867/ :)16:25
ativelkovdims: now it complains on "cannot import name apirequest". Missing something else?16:26
*** jaypipes has joined #openstack-oslo16:26
*** _amrith_ is now known as amrith16:26
dimsativelkov: did you recreate the .tox ?16:27
openstackgerritBrant Knudson proposed openstack/oslo.cache: Make symbols private  https://review.openstack.org/19646316:27
*** dontalton has joined #openstack-oslo16:29
openstackgerritBrant Knudson proposed openstack/oslo.cache: Make symbols private  https://review.openstack.org/19646316:29
ativelkovdims: nope. Thanks, looks like it helps.16:31
*** e0ne_ has quit IRC16:34
*** achanda has joined #openstack-oslo16:35
*** e0ne has joined #openstack-oslo16:36
*** manishg has joined #openstack-oslo16:38
*** rpodolyaka1 has quit IRC16:41
*** manishg has quit IRC16:43
*** rpodolyaka1 has joined #openstack-oslo16:44
*** yassine_ has quit IRC16:47
*** openstackgerrit has quit IRC16:50
*** openstackgerrit has joined #openstack-oslo16:51
*** manishg has joined #openstack-oslo16:58
*** manishg has quit IRC16:59
*** manishg has joined #openstack-oslo16:59
*** manishg has quit IRC17:00
*** rpodolyaka1 has quit IRC17:02
*** e0ne has quit IRC17:05
*** ViswaV has joined #openstack-oslo17:07
*** manishg has joined #openstack-oslo17:07
*** samueldmq has quit IRC17:08
openstackgerritMerged openstack/oslo.cache: Module docs  https://review.openstack.org/19646417:09
*** sdake has joined #openstack-oslo17:18
*** rpodolyaka1 has joined #openstack-oslo17:18
*** rpodolyaka3 has joined #openstack-oslo17:19
*** rpodolyaka1 has quit IRC17:19
*** rpodolyaka3 has quit IRC17:21
*** sdake_ has quit IRC17:21
* harlowja thinks everyone in US has left for vacation17:27
harlowjaoh wells17:27
*** zzzeek_ has joined #openstack-oslo17:28
*** zzzeek_ has quit IRC17:31
*** achanda_ has joined #openstack-oslo17:38
*** zzzeek_ has joined #openstack-oslo17:40
*** abitha has quit IRC17:40
*** achanda has quit IRC17:40
*** achanda has joined #openstack-oslo17:42
*** zzzeek_ has quit IRC17:42
*** kzaitsev_mb has joined #openstack-oslo17:43
*** jecarey has quit IRC17:43
*** pradk has joined #openstack-oslo17:44
*** achanda_ has quit IRC17:44
openstackgerritMerged openstack/automaton: Add a bigger CD-player state-machine doctest(ed) example  https://review.openstack.org/19147717:45
openstackgerritMerged openstack/futurist: Add badge support to README.rst  https://review.openstack.org/19627917:45
*** mgarza_ has joined #openstack-oslo17:46
*** sputnik13 has joined #openstack-oslo17:46
*** sdake_ has joined #openstack-oslo17:47
openstackgerritMerged openstack/oslo.concurrency: Remove redundant fileutils  https://review.openstack.org/19694517:47
openstackgerritMerged openstack/oslo.reports: Add tox target to find missing requirements  https://review.openstack.org/19584017:48
openstackgerritMerged openstack/oslo.serialization: Stop using deprecated oslo_utils.timeutils.strtime  https://review.openstack.org/19706917:48
openstackgerritMerged openstack/oslo.reports: Add oslo.utils dependency  https://review.openstack.org/19584117:49
*** sdake has quit IRC17:50
*** sdake_ is now known as sdake17:50
*** ihrachyshka has joined #openstack-oslo17:52
*** kzaitsev_mb has quit IRC17:52
*** jecarey has joined #openstack-oslo17:56
*** manishg has quit IRC17:58
*** yamahata has joined #openstack-oslo17:58
*** e0ne has joined #openstack-oslo17:58
*** ViswaV_ has joined #openstack-oslo18:01
*** ViswaV has quit IRC18:01
openstackgerritJoshua Harlow proposed openstack/oslo.service: Make it easier to use the eventlet backdoor locally  https://review.openstack.org/19632418:03
*** e0ne is now known as e0ne_18:04
*** ViswaV_ has quit IRC18:05
*** ViswaV has joined #openstack-oslo18:06
*** e0ne_ is now known as e0ne18:07
*** ericksonsantos has joined #openstack-oslo18:14
*** manishg has joined #openstack-oslo18:17
*** e0ne is now known as e0ne_18:18
*** rushiagr is now known as rushiagr_away18:18
*** rpodolyaka1 has joined #openstack-oslo18:19
*** achanda has quit IRC18:21
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo.versionedobjects: Sort child versions before generating fingerprint  https://review.openstack.org/19721218:22
*** e0ne_ is now known as e0ne18:23
dimsdansmith: ^^ need one more thing before we can drop fingerprint code from nova and use the one in o.vo18:25
dansmithdims: hah, we're actually just ripping that out of nova right now18:26
*** rpodolyaka1 has quit IRC18:26
dimsdansmith: so we won't need this?18:27
*** shardy has quit IRC18:27
dansmithwell,18:27
*** tsekiyama has quit IRC18:27
dansmithit's in the fixture, which means we can't remove it I guess18:27
*** shardy has joined #openstack-oslo18:27
dansmithbut soonish nova won't use it so none of our fingerprints will include it18:27
dansmithso probably good to fix it in o.vo I guess18:27
dimsright18:28
*** manishg has quit IRC18:37
*** pradk has quit IRC18:37
*** tsekiyama has joined #openstack-oslo18:38
*** arnaud____ has quit IRC18:41
openstackgerritJoshua Harlow proposed openstack/taskflow: Add ability to reset an engine via a `reset` method  https://review.openstack.org/18623918:42
*** rpodolyaka1 has joined #openstack-oslo18:43
*** sdake has quit IRC18:46
*** manishg has joined #openstack-oslo18:47
mtaninodims: Thank you for pushing https://review.openstack.org/19435718:47
dimsmtanino: you have been waiting too long. thanks for your patience18:47
mtaninodims: I will try to backport that fix to other components. thanks,18:47
*** sdake has joined #openstack-oslo18:48
openstackgerritMerged openstack-dev/cookiecutter: Add insentive to write a long description  https://review.openstack.org/19714618:56
*** ozamiatin has joined #openstack-oslo18:58
*** browne has quit IRC19:00
*** kgiusti has left #openstack-oslo19:01
dimsstevemar: looks like 196463 is still in merging19:01
openstackgerritMerged openstack/oslo.concurrency: Add tox target to find missing requirements  https://review.openstack.org/19600019:05
dstanekdhellmann: what's the difference between using oslo_policy.opts.set_defaults() vs. oslo_policy.opts.register() - other than register being more explicit19:08
*** achanda has joined #openstack-oslo19:10
dhellmanndstanek: set_defaults() does not then assume you will go cfg.CONF.oslo_policy.some_option = value19:11
*** ozamiatin has quit IRC19:11
dhellmannso if we change "some_option" to "new_name_for_option" your code won't break, because we'll make set_defaults() handle the transition19:11
openstackgerritMerged openstack/oslo.cache: Make symbols private  https://review.openstack.org/19646319:11
dhellmanndstanek: the minute you allow something outside of the library to use a configuration option directly through the config object, that option is frozen and cannot be change19:12
dstanekdhellmann: do you're saying we shouldn't use the config fixture anymore?19:12
*** manishg has quit IRC19:12
dhellmanndstanek: the config fixture is appropriate for tests within a repo to set the options within that repo, but it's not a good idea for setting options in code from another repo19:12
dhellmannso keystone can use it to set their own options, but should not use it to set options for a library -- that's why we provide the set_defaults() API19:13
dhellmannAPI(s)19:13
*** shardy has quit IRC19:13
*** e0ne is now known as e0ne_19:14
dstanekdhellmann: that's interesting. i've not seen that used anywhere yet. do we document that we should be using that?19:14
*** e0ne_ is now known as e0ne19:15
dhellmanndstanek: I'm not sure we do have that written down, I should write up a policy document19:15
dhellmannit mostly comes up when folks try to add APIs like this to the libraries and we say no, so education is happening that way, but it's not optimal19:15
*** manishg has joined #openstack-oslo19:16
dstanekso right now oslo_policy's set_defaults only allows one of the options to be set :-(19:16
*** manishg_ has joined #openstack-oslo19:17
dhellmanndstanek: that's ok, we can add some more. Which ones do you need to set?19:17
*** mgarza_ has quit IRC19:18
openstackgerritMerged openstack/automaton: Add runners to features.rst & add a runner base & update docstrings  https://review.openstack.org/19639419:19
*** rpodolyaka1 has quit IRC19:20
dstanekdhellmann: i think keystone only needs the one defined. we should add a reset method that tests can call in a teardown19:20
*** manishg has quit IRC19:20
*** rpodolyaka1 has joined #openstack-oslo19:21
dhellmanndstanek: I think set_defaults() expects a config object as argument, and if you past a ConfigFixture it will register the options in a way that unregisters them later19:22
dstanekdhellmann: does that mean oslo_log.register_options() should not longer be used?19:22
dstanekdhellmann: the config fixture won't let me set an option until it is defined19:23
dstanekthat's why i wanted to call register19:23
dhellmanndstanek: that's a special case. We have to register some of the log options before we can parse the config file. I forget why.19:23
dhellmanndstanek: does the config fixture not have a register_opt method? I thought it did19:23
dhellmannyeah, it does19:24
dstanekdhellmann: doesn't that defeat the purpose of why you want to do with set_defaults?19:24
dhellmannyou're keeping the level of indirection intact19:24
dhellmannyour code is not ever accessing the config option as an attribute directly, so it's safe for us to change the name of the option19:25
dstanekeither way my tests will depend on knowing the config file option right?19:25
dhellmannhang on, let me put together an example19:25
*** kzaitsev_mb has joined #openstack-oslo19:26
openstackgerritMerged openstack/oslo.messaging: Add tox target to find missing requirements  https://review.openstack.org/19581919:28
dimsstevemar: 0.1.2 oslo.cache is out19:28
openstackgerritMerged openstack/automaton: Add badge support to README.rst  https://review.openstack.org/19628119:30
openstackgerritMerged openstack/automaton: Disallow adding transitions from terminal states  https://review.openstack.org/19532319:30
dhellmanndstanek: oh, bother, what I told you doesn't actually work. We can make it work, it just doesn't right now.19:30
*** crc32 has joined #openstack-oslo19:33
dhellmanndstanek: patch coming shortly19:35
dstanekdhellmann: patch for register_opt?19:35
dhellmanndstanek: to make the fixture work the way you need it to, yeah19:35
dhellmannbah, now I can't make the oslo.config tests run19:39
openstackgerritJoshua Harlow proposed openstack/taskflow: Use encodeutils for exception -> string function  https://review.openstack.org/19245819:39
dimsdhellmann: a couple of pending reviews?19:40
dhellmanndims, lifeless : have you seen http://paste.openstack.org/show/329443/ before?19:40
*** rpodolyaka1 has quit IRC19:40
dhellmanndims: I don't see anything that looks related19:40
dhellmannI suspect something is wrong with my local setup, but I can't imagine what19:41
dimsdhellmann: i saw it here in CI just a half hour ago, haven't looked yet http://logs.openstack.org/49/195849/4/check/gate-oslo.config-python26/48adfd1/testr_results.html.gz19:41
dhellmannthat version of fixtures was released today, I wonder if it has a bug19:42
dhellmanndims: downgrading fixtures to 1.2.0 fixed it19:44
dhellmannit looks like a problem with calling cleanup more than once on a fixture19:46
*** Rockyg has joined #openstack-oslo19:51
stevemardims: ty!19:52
*** pblaho has quit IRC19:52
*** yamahata has quit IRC19:54
*** yamahata has joined #openstack-oslo19:54
openstackgerritOpenStack Proposal Bot proposed openstack-dev/pbr: Updated from global requirements  https://review.openstack.org/19724919:54
*** achanda has quit IRC19:54
openstackgerritOpenStack Proposal Bot proposed openstack/futurist: Updated from global requirements  https://review.openstack.org/19626219:55
dhellmanndims: ok, it looks like the right fix is for us to rewrite these fixture tests, so I'll work on that19:55
*** achanda has joined #openstack-oslo19:55
openstackgerritOpenStack Proposal Bot proposed openstack/mox3: Updated from global requirements  https://review.openstack.org/19725719:57
*** browne has joined #openstack-oslo19:58
*** rpodolyaka1 has joined #openstack-oslo19:58
*** amrith is now known as _amrith_19:59
*** achanda has quit IRC19:59
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.concurrency: Updated from global requirements  https://review.openstack.org/19483520:02
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.config: Updated from global requirements  https://review.openstack.org/19726220:02
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.db: Updated from global requirements  https://review.openstack.org/19726320:02
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.log: Updated from global requirements  https://review.openstack.org/19726420:02
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.messaging: Updated from global requirements  https://review.openstack.org/19238220:02
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.middleware: Updated from global requirements  https://review.openstack.org/19726520:02
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.rootwrap: Updated from global requirements  https://review.openstack.org/19726620:02
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.utils: Updated from global requirements  https://review.openstack.org/19726720:02
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.versionedobjects: Updated from global requirements  https://review.openstack.org/19626320:02
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.vmware: Updated from global requirements  https://review.openstack.org/19726820:02
openstackgerritOpenStack Proposal Bot proposed openstack/oslotest: Updated from global requirements  https://review.openstack.org/19726920:02
openstackgerritOpenStack Proposal Bot proposed openstack/tooz: Updated from global requirements  https://review.openstack.org/19483720:04
lifelessdhellmann: hi, thats fallout from 1.3.020:05
lifelessdhellmann: what it means is that somewhere this is happening:20:14
lifelessf = Fixture()20:14
lifelessf.setUp()20:14
lifelessf.cleanUp()20:14
lifelessf.cleanUp()20:14
lifelessdhellmann: which was never legal20:14
dhellmannyeah, I have a patch to fix it up20:14
lifelessdhellmann: linky linky?20:14
dhellmannlifeless: not submitted yet, I'm still working on the one I actually wanted to merge :-)20:15
dhellmannI'll submit both together20:15
lifelessk20:15
openstackgerritDoug Hellmann proposed openstack/oslo.config: fix fixture tests for fixtures 1.3.x  https://review.openstack.org/19729920:26
openstackgerritDoug Hellmann proposed openstack/oslo.config: Add set_default() method to fixture  https://review.openstack.org/19730020:26
dhellmannlifeless: ^^20:26
dimsdhellmann: so will work with both old and new fixtures right?20:27
dhellmanndstanek: the thing you need is in ^^20:28
dhellmanndims: yes20:28
dimsthanks20:28
dhellmanndims: it changes the way we were using the fixture, but doesn't change its implementation20:28
dimsdhellmann: add one more test with a group? https://review.openstack.org/#/c/197300/1/oslo_config/tests/test_fixture.py,cm20:29
dhellmanndims: sure20:30
*** mgarza has joined #openstack-oslo20:31
openstackgerritDoug Hellmann proposed openstack/oslo.config: Add set_default() method to fixture  https://review.openstack.org/19730020:31
*** e0ne has quit IRC20:35
lifelessdhellmann: some thoughts posted on 29920:38
*** rpodolyaka1 has quit IRC20:41
dhellmannlifeless: replied20:44
dstanekdhellmann: i'll give that a try, but it still ties the consumer project to the library via the config opt name, which is what i thought you were arguing against when you said to use set_default20:45
*** jaosorior has quit IRC20:46
dhellmanndstanek: no, it ties you to the library via the name of the argument to set_defaults(). That happens to be the same as the config name, but it does not have to be. If we ever change a config option, or move options from the DEFAULT group to a private group, that can all happen transparently.20:46
dhellmanndstanek: I never posted my example, hang on20:46
dhellmanndstanek: http://paste.openstack.org/show/32959420:46
*** ozamiatin has joined #openstack-oslo20:47
dhellmanndstanek: I admit the distinction is subtle, but the technicality of it is important20:47
dstanekdhellmann: i get the sentiment, but it feels wrong that they would ever be different.20:47
lifelessdhellmann: reviewed 300 too now20:47
dhellmanndstanek: that's how we'll address renames, though, so it may happen during a deprecation period20:47
dhellmanndstanek: I would expect the old name to trigger a deprecation warning, and then apply the value to the new name20:48
dstanekdhellmann: i thought we already had a way to deprecate config options in oslo.config20:48
dhellmanndstanek: we do20:49
dstanekdhellmann: isn't that sufficient?20:49
dhellmanndstanek: I'm just saying that when that happens, the API for setting the default programmatically would also need to change20:49
dhellmanndstanek: I'm in a meeting, i can't give this my full attention. Can we chat tomorrow?20:49
dstanekdhellmann: sure20:49
lifelesskrotscheck: dhellmann: I don't want the wsgi stuff to be wedged between two reviewers. Can we make a timeslice to jointly discuss today ?20:50
dhellmanndstanek: thanks, and sorry20:50
dstanekdhellmann: no reason to be sorry! we can char tomorrow20:50
dstanekchat20:50
dhellmannlifeless: 66 minutes from now-ish?20:55
lifelesskrotscheck: ^ work for you ?20:56
lifelessdhellmann: it certainly works for me20:56
*** stevemar has quit IRC20:58
openstackgerritDoug Hellmann proposed openstack/oslo.config: Add set_default() method to fixture  https://review.openstack.org/19730021:07
dhellmannlifeless: I rolled your suggestions into 300 since it was going to fail pep8 checks anyway21:07
krotschecklifeless: Eh? Wsgi stuff?21:22
krotscheckAre we talking about the TypeError thing?21:22
lifelesskrotscheck: yeah21:25
lifelesskrotscheck: I just want to make sure you're unblocked21:25
krotschecklifeless: I'm not really blocked. That add was your idea ;)21:25
krotschecklifeless: I can live without it :)21:25
lifelessoh, I see, the getargspec one landed21:26
lifelessI presume its not in a release yet.21:26
lifelessok, so I'll arm wrestle with doug on it and we'll get back to you :)21:26
lifelesskrotscheck: thanks for following up21:27
krotschecklifeless: Aight, no problem21:29
krotschecklifeless: You could just git review -d it and make any modifications yourself :)21:29
lifelessso there are three routes; as-is, double-dispatch (the current patch in question), or new-method (which avoids all the failure modes)21:30
lifelessI'll talk with dhellmann in 34m+- and we'll see :)21:30
openstackgerritDoug Hellmann proposed openstack/oslo.i18n: clarify translation policy  https://review.openstack.org/19733921:30
openstackgerritMerged openstack/mox3: Updated from global requirements  https://review.openstack.org/19725721:32
lifelessdhellmann: you missed the changes I separately suggested on 300 itself in patchset 221:33
*** mriedem has quit IRC21:41
openstackgerritDoug Hellmann proposed openstack/oslo.config: Add set_default() method to fixture  https://review.openstack.org/19730021:42
dhellmannlifeless: done ^^21:42
*** kzaitsev_mb has quit IRC21:46
openstackgerritJoshua Harlow proposed openstack/automaton: Document `process_event` return and return type  https://review.openstack.org/19734521:48
*** eezhova has quit IRC21:48
*** sreshetnyak has quit IRC21:49
dhellmannlifeless, krotscheck : ok21:50
krotscheckyeees?21:52
dhellmannkrotscheck: I think lifeless wanted to talk about https://review.openstack.org/#/c/194268/1/oslo_middleware/base.py,cm21:53
dhellmannis there some background behind that change? there's not much detail in the commit message21:53
krotscheckdhellmann, lifeless: Ok, so the issue is that lifeless doesn't like using getargspec, because it's heavy and could have a noticable impact on performance across 1000's of requests. His proposed alternative, using except TypeError:, is a bit too aggressive in its exception handling.21:54
krotscheckI'm just the poor schmuck who decided to propose lifeless's suggested change. I should have just let him do it.21:54
dhellmannkrotscheck: ok, if we have a performance concern then it would be good to have that in the commit message explaining why the change is desired21:55
dhellmannI'm still not sure about the exception handling thing, though. I dislike that it's such a common exception21:55
dhellmannsomeone could pass an int where we expect a string and we could get that and run the request again21:55
krotscheckdhellmann: I'm going to tag out to lifeless. I'm ok with the getargspec bit.21:55
dhellmannkrotscheck: ok21:55
*** ozamiatin has quit IRC21:57
dhellmannlifeless: I'm going to step away for a couple of minutes, but will be back21:57
*** jecarey has quit IRC21:57
*** stpierre has quit IRC21:57
*** ihrachyshka has quit IRC21:58
lifelessok back21:59
dhellmannlifeless: krotscheck explained that the change is coming from a performance concern?22:00
lifelessdhellmann: well22:00
lifelessdhellmann: I raised some issues on the original change22:01
lifelessdhellmann: and proposed this approach22:01
dhellmannI'm trying to understand what those are22:01
lifelessdhellmann: the original change has several issues - a) its heavyweight and per-request, b) it doesn't permit decorators or *args or *kwargs function definitions in subclasses22:01
lifelesswhich is surprising22:01
dhellmannlifeless: ok. I am probably less familiar with the wsgi spec than you. Is process_response() even a part of that spec? do we need to be worried about someone using this middleware to wrap something we didn't write?22:04
lifelessits not22:04
lifelessbut22:04
*** yamahata has quit IRC22:04
dhellmannok, that's fine22:04
lifelessnothing in webob is :)22:04
dhellmannso that means we can be more flexible22:04
dhellmannor not22:04
lifelessright22:04
lifelessso in a lot of ways i'd like to rip webob out entirely22:04
lifelessbut thats an entirely different discussion22:05
lifelessif all our middleware is in the one repo22:05
lifelessthen we don't need the backwards compat shim22:05
lifelessif its not in the one repo, then we're essentially dealing with the whole openstack ecosystem22:05
lifelesswhich means IMO that we should think about this as a public API evolution22:05
dhellmannwell, no, I'm trying to understand how this stuff is intended to be used because it seems like adding this argument is a hugely dangerous change if we're going to say sometimes it's there and sometimes its not and the way we tell if it's not is if we try to use it an get TypeError, because all sorts of things throw TypeError22:06
dhellmannright, exactly22:06
dhellmannso, I get the point about looking for the special name22:06
lifelessso lets step back a second22:06
dhellmannand we should at least change it to allow *args22:06
openstackgerritJoshua Harlow proposed openstack/automaton: Allow providing and using a 'nested_start_state_fetcher'  https://review.openstack.org/19735122:06
dhellmannit's less clear how we could handle **kwds22:06
lifelesswe've three ways to deal with 'add an argument to an override point'22:06
lifeless - introspection [which landed]22:06
lifeless - new override point- e.g. process_response222:07
lifeless - try-and-handle-typeerror22:07
harlowjaalso fyi, https://docs.python.org/dev/library/inspect.html#inspect.getargspec22:07
harlowja'This function will be removed in Python 3.6.'22:07
harlowjajust fyi :-/22:07
lifelessrather than ratholling on the typeerror aspect22:07
lifelessmaybe we should just do the graceful thing and use a new function name22:07
lifelessif hasattr(self, 'process_response2'): call-that else call-process_response()22:08
dhellmannsure, that works. I don't know what that's going to break now that we have this -- is it released?22:08
lifelessI don't think so22:08
lifelessit landed in the last week I think ?22:08
*** gordc is now known as gordc_afk22:09
dhellmannyeah, it was released22:09
lifelessargh22:09
lifelessso the graceful way is to add parse_response222:09
dhellmannlooks like it was in version 2.2.022:09
lifelesswith the CORS middleware (the only in-tree user) updated to use tha22:10
dhellmannI'm ok with doing that22:10
lifelessand add a deprecation warning to the argspec path22:10
lifelesskrotscheck: are you willing to do that? I realise its adding more work to your plate. perhaps if you have a few idle minutes?22:11
dhellmannit would be interesting to see if we even need to do the deprecation, but safer to just do it22:11
krotscheckSec, reading backscroll.22:12
lifelessdhellmann: someone might pick up 2.2.0 in 3 months then use the thing, then be surprised in e.g. 2.4.22:12
*** Rockyg has quit IRC22:12
dhellmannlifeless: we can make the next release 3.022:12
dhellmannI'd be pretty surprised if someone outside of openstack was using this lib in this way22:13
lifelessdhellmann: I'd rather not do API breaks rapidly. I know we can...22:13
dhellmannyeah22:13
lifelessdhellmann: but I really like being pleasant for consumers22:13
dhellmannyeah, I'm ok with the deprecations, just trying to cut down on supporting dead weight22:14
* krotscheck is amused that we're already talking about deprecating things when we don't even know that anyone's using the middleware yet.22:15
dhellmannkrotscheck: yeah, that's the problem, we have no way of telling, so we have to be conservative22:15
morganfainbergdims, dhellmann: added you both to https://review.openstack.org/#/c/196329/ when you have a few22:16
krotscheckdhellmann: See, that's where we disagree. I'm more of a forgiveness > permission type.22:16
dhellmannkrotscheck: I'll have to send you some of the hate mail I get22:16
krotscheckMind you, breaking changes in anything but major versions are bad juju22:16
krotscheckdhellmann: I'll warm up the popcorn.22:17
krotscheck(And this is why I love Java. Because if I update a library, it won't compile.)22:17
dhellmannkrotscheck: it's just a different type of break22:17
dhellmannmorganfainberg: I don't know anything about the background there22:18
*** manishg_ has quit IRC22:18
*** dims_ has joined #openstack-oslo22:19
morganfainbergdhellmann: so the sanity check doesn't really catch anything in the gate22:19
morganfainbergwhat it does do is catch when our deployers have already got a broken - non-utf-8 table22:19
morganfainbergand then they are wedged22:19
dhellmannwhy are they wedged?22:19
morganfainbergbecause the sanity check runs before and after migrations22:20
morganfainbergyou can't unwedge w/o a try/except or specific disable of the sanity check in the db_sync cli took22:20
morganfainbergtool*22:20
krotschecklifeless: I don't think I quite get what you're suggesting. I think it might be easier on all of us, and reduce churn, if you take over this patch.22:20
morganfainbergthe migration can't disable the sanity check22:20
dhellmannmorganfainberg: ok22:20
morganfainbergso you're wedged when any table is not utf-8. ive never seen this catch things in gate - i've seen it wedge multiple deployers -- i think this is the 4th time?22:20
lifelesskrotscheck: I have negative available cycles. Remember your complaint about TC bandwidth?22:21
dhellmannmorganfainberg: should we just turn this off in oslo.db?22:21
lifelesskrotscheck: we're dependent on being able to convince other people to do things, or we end up just busy and not doing what we're meant to be doing.22:21
morganfainbergdhellmann: thats my view. but i'm also happy to just disable it in keystone (i think we're the only ones that have ended up wedged)22:21
*** manishg has joined #openstack-oslo22:21
krotschecklifeless: Ok, so we've got a problem where a change needs to be made, but the people who are most qualified to make it are tied up with other things.22:21
morganfainbergdhellmann: the real fix is to make sure we specify utf-8 on the migrations22:21
lifelesskrotscheck: I think you're entirely qualified. I'll write a paragraph up on the review and see if it helps clarify things.22:21
dhellmannmorganfainberg: ok. Maybe submit a second patch to oslo.db, then we can discuss them separately with rpodolyaka and viktors22:21
krotschecklifeless: I'm saying that I'm also busy22:22
*** dims has quit IRC22:22
morganfainbergyeah wanted to run it buy you and dims before the oslo.db change22:22
dhellmannmorganfainberg: ok, now I'm caught up :-)22:22
morganfainbergdhellmann: cool i'll also propose [as promised, now that we have proper stable branches] the little code to elegantly say "no no no no downgrades" to oslo.db22:23
*** pleia2 has quit IRC22:23
dhellmannmorganfainberg: ack22:24
*** pleia2 has joined #openstack-oslo22:25
ViswaVHi Need some help with olso.messaging.  Our RabbitMQ servers are filling up with reply_*  queues which are created when you make a sync call().  The calls are succeeding and returning output from remote server. But the queues are not getting cleaned up.22:25
ViswaVI even invoke transport.cleanup() after the sync call completes. Is there some config param I need to set or is this a known issue?22:26
*** bknudson has quit IRC22:26
dhellmannViswaV: I think you're going to want sileht, but he's in Europe so it's late there right now22:27
ViswaVThx dhellmann.  Will try reaching out to him via email or check back again later in the day22:27
lifelesskrotscheck: so, everyone is busy. We landed something that has added technical debt to the project - its added use of a deprecated function (getargspec) - and we've got a fairly small better path.22:28
krotschecklifeless: Would love to keep discussing this, however I've got a doctor's appointment I have to be at. Back in 1 hour + commute.22:28
lifelesskrotscheck: ok22:29
lifelesskrotscheck: I have added a comment that hopefully clarifies on the review22:29
dstanekdhellmann: was https://review.openstack.org/#/c/197300 to fix my issue?22:30
*** jgrimm is now known as zz_jgrimm22:31
*** mriedem has joined #openstack-oslo22:32
dhellmanndstanek: yes22:33
*** manishg has quit IRC22:36
openstackgerritThomas Goirand proposed openstack-dev/oslo-cookiecutter: Add insentive to write a long description  https://review.openstack.org/19735722:36
*** dontalton has quit IRC22:37
dstanekdhellmann: it doesn't actually fix it because it still want me to register the options before i call set_default22:38
dstanekdhellmann: i'm trying the latest patch now22:39
dhellmanndstanek: the set_defaults() function inside the library should register them for you -- the docstring illustrates how you should use it22:40
*** zz_jgrimm is now known as jgrimm22:40
openstackgerritDoug Hellmann proposed openstack/oslo.config: Add FAQ entry for why we do not treat config options as API  https://review.openstack.org/19735922:41
dhellmanndstanek: ^^22:41
dstanekdhellmann: http://paste.openstack.org/show/329910/22:41
dhellmanndstanek: where's your app code?22:41
dhellmannor that test or whatever22:42
dstanekit doesn't look like it gets to the point where oslo_config's set_default is called22:42
dstanekdhellmann: the diff is here http://paste.openstack.org/show/329911/22:42
dstanekthen i run the test with 'tox -e py27 -- keystone.tests.unit.test_v2_keystoneclient_sql.ClientDrivenSqlTestCase.test_authenticate_disabled_tenant'22:42
dhellmanndstanek: change self.config_fixture.set_default(...) to oslo_policy.opts.set_defaults(self.config_fixture, ...)22:43
dhellmanndstanek: you're calling the low-level API directly, but you should be passing the fixture to the high-level API22:44
openstackgerritOpenStack Proposal Bot proposed openstack/oslo.db: Updated from global requirements  https://review.openstack.org/19726322:44
dhellmanndstanek: make it oslo_policy.opts.set_defaults(self.config_fixture, policy_file=dirs.etc('policy.json'))22:45
dhellmannthe group name should be hidden from you outside of the lib22:45
dstanekdhellmann: ah, ok. let me give that a try22:46
dhellmanndstanek: dinner time here, I'll catch up with you tomorrow and make sure you've got it working22:48
*** ozamiatin has joined #openstack-oslo22:50
krotschecklifeless: I'm afraid I don't really see how this patch should be high priority for me, sorry.23:01
*** dims_ has quit IRC23:01
krotscheckI'll put it on my list, but I can't guarantee that I'll get around to it by the time liberty ships, what with paternity and all.23:01
*** manishg has joined #openstack-oslo23:03
lifelesskrotscheck: I can understand that. I need to figure out how to reconcile everyone's focus-on-just-narrow-slice with managing techdebt, and not hairing off and just doing-myself. E.g. meeting TC needs etc.23:04
lifelesskrotscheck: because, the knee jerk thing is to seek lots of control, start -1ing and -2ing everything thats not perfect etc23:04
lifelesskrotscheck: which has lots of negative side effects23:04
lifelesskrotscheck: I appreciate your frankness however23:05
openstackgerritAdam Gandelman proposed openstack/tooz: Ensure run_watchers called from mixin, not base class  https://review.openstack.org/19736723:05
*** ashleighfarnham has quit IRC23:06
harlowjalifeless i thought me and u were gonna fix all of openstack man23:07
harlowjalol23:07
harlowjaby tommorow noon23:07
*** tsbot_ has quit IRC23:07
lifelessharlowja: if we can discard compat, sure :)23:08
harlowjaappend -redux on all the things, and be done with it23:08
lifelessharlowja: nova2.023:09
harlowja:-P23:09
harlowjanova X23:12
harlowja*has nothing to do with os X*23:12
harlowjalol23:12
openstackgerritMerged openstack/tooz: Updated from global requirements  https://review.openstack.org/19483723:13
openstackgerritMerged openstack/oslo.middleware: Updated from global requirements  https://review.openstack.org/19726523:13
*** mgarza has quit IRC23:15
*** mgarza_ has joined #openstack-oslo23:15
*** mgarza_ has quit IRC23:16
*** ozamiatin has quit IRC23:16
*** zzzeek has quit IRC23:18
*** ozamiatin has joined #openstack-oslo23:18
lifelessiNova23:18
openstackgerritMerged openstack/oslo.utils: Updated from global requirements  https://review.openstack.org/19726723:21
openstackgerritMerged openstack/automaton: Add `is_actionable_event` checking function  https://review.openstack.org/19195523:27
*** yamahata has joined #openstack-oslo23:28
*** ozamiatin has quit IRC23:28
openstackgerritMerged openstack/oslo.log: Updated from global requirements  https://review.openstack.org/19726423:30
openstackgerritMerged openstack/oslo.concurrency: Updated from global requirements  https://review.openstack.org/19483523:33
openstackgerritMerged openstack/oslo.versionedobjects: Updated from global requirements  https://review.openstack.org/19626323:38
*** dims has joined #openstack-oslo23:45
*** dims has quit IRC23:46
*** _amrith_ is now known as amrith23:47
*** manishg has quit IRC23:53
openstackgerritJoshua Harlow proposed openstack/oslo.service: Ensure the stop watch is always stopped  https://review.openstack.org/19737523:53
*** sputnik1_ has joined #openstack-oslo23:54
*** zzzeek has joined #openstack-oslo23:55
*** sputnik13 has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!