Wednesday, 2014-07-09

*** dims__ has quit IRC00:20
*** tsekiyam_ has joined #openstack-oslo00:29
*** jaosorior has quit IRC00:32
*** tsekiyama has quit IRC00:32
*** tsekiyam_ has quit IRC00:33
*** dims__ has joined #openstack-oslo00:44
*** pcm_ has joined #openstack-oslo00:47
*** zzzeek has quit IRC00:47
*** pcm_ has quit IRC00:48
*** jaosorior has joined #openstack-oslo00:48
*** pcm_ has joined #openstack-oslo00:48
*** pcm_ has quit IRC01:16
guszzzeek, i159: note that OS_TEST_DBAPI_ADMIN_CONNECTION doesn't exist in oslo.db (only oslo-incubator).01:30
gusI'm still waiting on reviews for https://review.openstack.org/#/c/104447/ (hint)01:30
gusAnd it depends on https://review.openstack.org/#/c/104428/ - also awaiting reviews.01:31
gusAnd viktors|afk: I replied to your comment on https://review.openstack.org/#/c/104425/  - let me know if you need more information before you're willing to approve that change01:32
gusA question for the room: We have some deadlock/concurrency issues with eventlet vs mysqldb driver.  I have a test that demonstrates that, but it imports/uses eventlet explicitly.01:34
gusVictor quite reasonably pointed out that requiring eventlet in an olso.db test is frowned upon.  This test identifies an important issue, so I'd like to have it somewhere.  Any suggestions for how/where this test could exist?01:35
gus^^ https://review.openstack.org/#/c/104436/01:35
gus(note that the deadlock could also occur with other n:m-greenthread-style implementations, like asyncio and futures - but reproducing it reliably will probably require explicit asyncio/futures code too)01:39
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Add the core 10k view omnigraffle diagram  https://review.openstack.org/10564201:45
*** zhiyan_ is now known as zhiyan01:47
*** arnaud has joined #openstack-oslo01:47
*** zzzeek has joined #openstack-oslo01:55
*** zhiyan is now known as zhiyan_01:56
*** zhiyan_ is now known as zhiyan01:56
*** arnaud has quit IRC02:25
*** zzzeek has quit IRC02:31
*** oomichi has joined #openstack-oslo02:45
*** SridharG has joined #openstack-oslo02:47
*** harlowja is now known as harlowja_away02:50
*** arnaud has joined #openstack-oslo03:01
*** praneshp has quit IRC03:10
*** SridharG has quit IRC03:13
*** dstanek_zzz is now known as dstanek03:20
*** arnaud has quit IRC03:20
*** arnaud has joined #openstack-oslo03:27
*** pcm_ has joined #openstack-oslo03:40
*** arnaud has quit IRC03:42
*** arnaud has joined #openstack-oslo03:43
*** dims__ has quit IRC03:55
*** arnaud has quit IRC03:59
*** yamahata has joined #openstack-oslo04:03
*** arnaud has joined #openstack-oslo04:05
*** harlowja_at_home has joined #openstack-oslo04:23
harlowja_at_homehaypo, https://wiki.openstack.org/wiki/TaskFlow#Ten_thousand_foot_view (this might help in understand wtf taskflow is, haha)04:30
*** praneshp has joined #openstack-oslo04:35
*** SridharG has joined #openstack-oslo04:50
*** dims__ has joined #openstack-oslo04:51
*** dims__ has quit IRC04:56
*** dims__ has joined #openstack-oslo04:57
*** dims__ has quit IRC05:02
*** ildikov has quit IRC05:02
*** praneshp_ has joined #openstack-oslo05:11
*** praneshp has quit IRC05:14
*** praneshp_ is now known as praneshp05:14
*** harlowja_at_home has quit IRC05:17
*** morganfainberg_Z is now known as morganfainberg05:18
*** ildikov has joined #openstack-oslo05:46
*** dims__ has joined #openstack-oslo05:58
*** nacim has quit IRC06:01
*** dims__ has quit IRC06:03
*** dstanek is now known as dstanek_zzz06:08
*** mkoderer has joined #openstack-oslo06:09
*** morganfainberg is now known as morganfainberg_Z06:23
*** AAzza_afk is now known as AAzza06:43
*** dstanek_zzz is now known as dstanek06:43
*** arnaud has quit IRC06:53
*** dstanek is now known as dstanek_zzz06:53
*** dims__ has joined #openstack-oslo06:58
*** flaper87|afk is now known as flaper8706:59
*** jaosorior has quit IRC07:02
*** dims__ has quit IRC07:03
openstackgerritAbhishek Kekane proposed a change to openstack/oslo-incubator: Add default log level for websocket  https://review.openstack.org/10190807:12
*** tkelsey has joined #openstack-oslo07:26
*** mrda is now known as mrda-away07:28
*** pcm_ has quit IRC07:33
openstackgerritA change was merged to openstack/oslo.config: Hook IPOpt class into the docs  https://review.openstack.org/10553807:33
openstackgerritAngus Lees proposed a change to openstack/oslo.db: Don't drop pre-existing database before tests  https://review.openstack.org/10443007:53
*** ildikov has quit IRC07:55
*** markmc has joined #openstack-oslo07:57
*** ildikov has joined #openstack-oslo07:58
*** dims__ has joined #openstack-oslo07:59
openstackgerritAngus Lees proposed a change to openstack/oslo.db: Add DBDuplicateEntry detection for mysqlconnector driver  https://review.openstack.org/10442508:04
*** nacim has joined #openstack-oslo08:04
*** dims__ has quit IRC08:04
*** Alexei_9871 has quit IRC08:09
openstackgerritMark McLoughlin proposed a change to openstack/oslo.config: generator: tweak how MultiStrOpt defaults are handled  https://review.openstack.org/10567108:11
zhiyanviktors|afk: hi08:13
*** viktors|afk is now known as viktors08:14
viktorszhiyan: hi!08:14
*** AAzza is now known as AAzza_afk08:17
zhiyanviktors: may i send you a PM, pls check?08:17
viktorszhiyan: sure08:18
zhiyanviktors: thanks!08:18
*** i159 has joined #openstack-oslo08:19
*** dims__ has joined #openstack-oslo08:28
*** pblaho has joined #openstack-oslo08:32
*** dims__ has quit IRC08:34
openstackgerritIlya Pekelny proposed a change to openstack/oslo.db: oslo.db.options module documentation  https://review.openstack.org/9343608:45
*** ihrachyshka has joined #openstack-oslo08:50
*** AAzza_afk is now known as AAzza08:52
ihrachyshkagus: hey. still around?08:55
openstackgerritIlya Pekelny proposed a change to openstack/oslo.db: oslo.db.exceptions module documentation  https://review.openstack.org/9343509:14
openstackgerritRomain Soufflet proposed a change to openstack/oslo-incubator: Fix tests.unit.reports.test_base_report with python3.4  https://review.openstack.org/10568009:21
*** dims__ has joined #openstack-oslo09:30
*** dims__ has quit IRC09:35
viktorsdhellmann: hi! Please ping me, when you'll be around09:36
*** yamahata has quit IRC09:48
*** AAzza is now known as AAzza_afk09:50
*** SridharG has quit IRC09:51
*** praneshp has quit IRC09:56
*** ildikov has quit IRC09:57
*** viktors is now known as viktors|afk10:01
*** ildikov has joined #openstack-oslo10:15
*** dims__ has joined #openstack-oslo10:31
*** alexpilotti has joined #openstack-oslo10:35
*** dims__ has quit IRC10:36
*** yamahata has joined #openstack-oslo10:47
*** dims__ has joined #openstack-oslo11:10
openstackgerritPetr Blaho proposed a change to openstack/oslo.db: Changes import orders to pass H305 check  https://review.openstack.org/9967011:14
openstackgerritPetr Blaho proposed a change to openstack/oslo.db: Fixes whitespaces between imports to pass H307  https://review.openstack.org/9967111:14
openstackgerritPetr Blaho proposed a change to openstack/oslo.db: Fixes comments to pass E265 check.  https://review.openstack.org/9967611:14
openstackgerritPetr Blaho proposed a change to openstack/oslo.db: Uses keyword params for i18n string to pass H703  https://review.openstack.org/9967411:14
openstackgerritPetr Blaho proposed a change to openstack/oslo.db: Fixes indentations to pass E128 check.  https://review.openstack.org/9967511:14
openstackgerritPetr Blaho proposed a change to openstack/oslo.db: Updates one line docstring with dot to pass H402  https://review.openstack.org/9967211:14
openstackgerritPetr Blaho proposed a change to openstack/oslo.db: Adds empty line to multilines docs to pass H405  https://review.openstack.org/9967311:14
*** dstanek_zzz is now known as dstanek11:22
*** alexpilotti has quit IRC11:26
*** alexpilotti has joined #openstack-oslo11:30
openstackgerritA change was merged to openstack/oslo-incubator: Fix tests.unit.reports.test_base_report with python3.4  https://review.openstack.org/10568011:32
*** tkelsey has quit IRC11:34
*** alexpilotti has quit IRC11:35
openstackgerritMiguel Angel Ajo proposed a change to openstack/oslo-specs: Add service-status-interface spec  https://review.openstack.org/9774811:36
*** ujjain has quit IRC11:37
openstackgerritMiguel Angel Ajo proposed a change to openstack/oslo-specs: Add service-status-interface spec  https://review.openstack.org/9774811:41
ajodhellmann, https://review.openstack.org/97748  sorry for the delay updating the service status spec11:43
*** pcm_ has joined #openstack-oslo11:43
ajoI decided to turn it into plugin-based, as it makes more sense, and makes everything cleaner & simpler11:43
ajoI have also extended it to include watchdog support (that at least systemd supports)  and readyness notification (upstart supports that too in a different way -based in signals AFAIK-)11:44
*** viktors|afk is now known as viktors11:53
*** jecarey has joined #openstack-oslo11:57
*** pcm_ has quit IRC11:59
*** pcm_ has joined #openstack-oslo12:00
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.config: Changes imports order to pass H305, enables check  https://review.openstack.org/9963912:01
openstackgerritDavanum Srinivas (dims) proposed a change to openstack-dev/pbr: Switch from pypi.python.org to pypi.openstack.org  https://review.openstack.org/10534412:05
*** dstanek is now known as dstanek_zzz12:11
pblahodims__: ping12:12
pblahodims__: thanks for update of https://review.openstack.org/#/c/99639/12:13
*** dstanek_zzz is now known as dstanek12:18
*** jecarey has quit IRC12:19
*** dims__ has quit IRC12:32
*** dims__ has joined #openstack-oslo12:32
*** mkoderer has quit IRC12:42
*** jecarey has joined #openstack-oslo12:46
*** pcm_ has quit IRC12:48
*** ndipanov has joined #openstack-oslo12:52
*** jecarey has quit IRC12:58
jd__I'm thinking about moving oslo-incubator/o/c/middleware/notifier.py to oslo.messaging13:04
jd__any opinion?13:04
*** Alexei_987 has quit IRC13:05
openstackgerritRadoslav Gerganov proposed a change to openstack/oslo.vmware: Refactor the PBM support  https://review.openstack.org/10248013:07
*** joesavak has joined #openstack-oslo13:08
*** oomichi has quit IRC13:10
*** Alexei_987 has joined #openstack-oslo13:10
*** ndipanov has quit IRC13:12
*** ildikov has quit IRC13:14
Alexei_987markmc: Hi are you available?13:15
*** amotoki has quit IRC13:16
*** mriedem has joined #openstack-oslo13:18
*** pcm_ has joined #openstack-oslo13:21
*** tkelsey has joined #openstack-oslo13:24
viktorsdhellmann: ping13:30
openstackgerritAlexei Kornienko proposed a change to openstack/oslo.messaging: Moved main loop to server class  https://review.openstack.org/10498313:35
dhellmannjd__: that's the plan - https://wiki.openstack.org/wiki/Oslo/GraduationStatus#notifier13:35
dhellmannviktors: hi13:35
viktorsdhellmann: hello13:36
jd__dhellmann: thanks!13:36
viktorsdhellmann: recenty I found that I can't make `git push gerrit` :(13:37
dhellmannjd__: I don't know if there's a blueprint, yet, since I didn't anticipate doing that during this cycle.13:37
dhellmannviktors: which repo?13:37
viktorsdhellmann: oslo.db13:37
dhellmannviktors: we did some cleanup of acls and I might need to add you back to a group, just a sec13:37
jd__dhellmann: https://blueprints.launchpad.net/oslo/+spec/graduate-notifier-middleware I guess?13:37
viktorsit seems to be, that only folks fron grup oslo-db-ptl can do it13:37
viktorsdhellmann: ok, sure13:38
dhellmannviktors: yeah, and I'm not in that group yet, either, so let me ping infra13:38
viktorsdhellmann: thanks!13:38
*** dims_ has joined #openstack-oslo13:39
*** markmcclain has joined #openstack-oslo13:39
*** dstanek is now known as dstanek_zzz13:41
dhellmannviktors: you should be ready to go13:41
*** haypo_ has joined #openstack-oslo13:43
*** GheRiver1 has joined #openstack-oslo13:43
*** jokke__ has joined #openstack-oslo13:44
viktorsdhellmann: thanks, will check13:44
viktorsdhellmann: is works, thanks13:46
*** krotscheck_ has joined #openstack-oslo13:47
*** zzzeek has joined #openstack-oslo13:47
dims_pblaho, welcome13:47
*** tkelsey has quit IRC13:48
*** dims__ has quit IRC13:48
*** rpodolyaka has quit IRC13:48
*** GheRivero has quit IRC13:48
*** jogo has quit IRC13:48
*** eezhova has quit IRC13:48
*** haypo has quit IRC13:48
*** jokke_ has quit IRC13:48
*** krotscheck has quit IRC13:48
*** anteaya has quit IRC13:48
*** krotscheck_ is now known as krotscheck13:48
*** jogo has joined #openstack-oslo13:49
*** yamahata has quit IRC13:52
*** yamahata has joined #openstack-oslo13:53
ihrachyshkazzzeek: hey! I have a question on oslo.db13:54
zzzeekif it can be quick :) i have to leave in 5 minutes13:54
*** eezhova has joined #openstack-oslo13:54
ihrachyshkazzzeek: when I've tried to switch to mysqlconnector, I got some alembic migration failures. And this is because raise_on_warnings is True for the driver.13:54
ihrachyshkazzzeek: I can fix it by setting the option to False passing it thru connection URI13:55
zzzeekhow about we fix the warnings13:55
*** anteaya has joined #openstack-oslo13:55
ihrachyshkazzzeek: but I wonder whether we need to set it to False by default somewhere in oslo.db13:55
ihrachyshkazzzeek: we use CREATE TABLE IF NOT EXISTS quite extensively everywhere13:55
zzzeekwe could do that in oslo’s create_engine.13:55
ihrachyshkazzzeek: and this issues WARNING (no idea why)13:55
zzzeekthat emits a warning ?13:55
ihrachyshkayeah, it's weird, but it does13:56
zzzeekwell, SQLAlchemy doesnt emit that so it woudl be nice to move to Table().create() and friends13:56
*** markmcclain has quit IRC13:56
*** dstanek_zzz is now known as dstanek13:56
zzzeekbut anyway, oslo.db has its own create_engine where anything can be set up13:56
*** tkelsey has joined #openstack-oslo13:56
ihrachyshkazzzeek: ok, I'll check it, thanks13:57
ihrachyshkazzzeek: you mean, if we use Table().create(), it will be smart enough to detect table existance?13:57
ihrachyshka[I'm dumb in things db related]13:57
zzzeekany of SQLAclhemy or Alembics systems dont rely on “IF NOT EXISTS”13:57
ihrachyshkaI see13:58
zzzeekits not supported by all backends13:58
ihrachyshkawe have only one rule that uses it actually13:58
ihrachyshkaI thought there are more :)13:58
*** jokke__ is now known as jokke_13:58
ihrachyshkazzzeek: can we use alembic.op.create_table for that?14:02
zzzeekin a migration script, sure14:02
ihrachyshkagood, thanks :)14:02
zzzeekgotta run :)14:02
*** zzzeek has quit IRC14:02
*** YorikSar has quit IRC14:04
*** markmcclain has joined #openstack-oslo14:06
*** rpodolyaka has joined #openstack-oslo14:09
openstackgerritJulien Danjou proposed a change to openstack/oslo.messaging: Update oslo-incubator  https://review.openstack.org/10574314:11
openstackgerritJulien Danjou proposed a change to openstack/oslo.messaging: Import oslo-incubator/middleware/base  https://review.openstack.org/10574414:11
openstackgerritJulien Danjou proposed a change to openstack/oslo.messaging: Import oslo-incubator context module  https://review.openstack.org/10574514:11
openstackgerritJulien Danjou proposed a change to openstack/oslo.messaging: Import notifier middleware from oslo-incubator  https://review.openstack.org/10574614:11
*** lbragstad_ has joined #openstack-oslo14:11
*** alexpilotti has joined #openstack-oslo14:14
*** ihrachyshka has quit IRC14:16
*** ihrachyshka has joined #openstack-oslo14:17
jd__dhellmann: is there a plan about memorycache? should we drop it in favor of 'cache'?14:19
dhellmannjd__: morganfainberg_Z has a blueprint for doing something with that14:27
dhellmannjd__: https://review.openstack.org/#/c/97155/14:27
*** pblaho has quit IRC14:27
*** tsekiyama has joined #openstack-oslo14:28
viktorsdhellmann: just for information - how soon the new release comes to http://pypi.openstack.org/ ?14:28
jd__dhellmann: ah that covers 'cache', not 'memorycache' actually14:28
dhellmannjd__: oops14:28
jd__I need to read that anyway14:28
dhellmannviktors: you can watch the job run in the release queue on http://status.openstack.org/zuul/14:29
openstackgerritRomain Soufflet proposed a change to openstack/oslo-incubator: Fix tests.unit.reports.* with python3.4  https://review.openstack.org/10574914:29
dhellmannviktors: it looks like it's done (0.3.0, right?)14:29
viktorsdhellmann: I see 0.2.0 on http://pypi.openstack.org/openstack/oslo.db/14:29
viktorsbut 0.3.0 on tarballs.openstack14:30
dhellmannviktors: hit reload, I'm seeing 0.3.014:30
viktorsdhellmann:  hm... )14:30
dhellmannviktors: possibly a cache issue14:30
dhellmannviktors: https://pypi.python.org/pypi/oslo.db/0.3.014:30
viktorsdhellmann: I see 0.3.0 on pypi.openstack.org also14:31
viktorsbut 0.2.0 on http://pypi.openstack.org/14:31
dhellmannjd__: do you think we will need a separate memorycache module, since dogpile supports memcache?14:32
dhellmannviktors: ah, I should have read the full url :-/14:32
dhellmannviktors: the mirror update can take a little while; I don't know how often that job runs14:32
viktorsdhellmann: ok, thanks. I just worried a bit )14:33
*** pcm_ has quit IRC14:35
*** pcm_ has joined #openstack-oslo14:35
jd__dhellmann: now I'm thinking about dropping memorycache14:36
jd__s/now/no/14:36
*** mkoderer has joined #openstack-oslo14:37
dhellmannjd__: I suspect cleaning up the cache library is going to be a theme for the next release14:38
*** lbragstad_ has left #openstack-oslo14:38
openstackgerritA change was merged to openstack/oslo.config: Hook up config fixture docs  https://review.openstack.org/10553914:39
jd__dhellmann: ok, what am I supposed to do for this release then? :D14:39
dhellmannjd__: you and morganfainberg_Z are the experts :-)14:40
openstackgerritA change was merged to openstack/oslo.config: Add release notes for 1.3.0 and 1.4.0.0a1/2  https://review.openstack.org/10554014:41
jd__anyway the spec LGTM14:41
*** jaosorior has joined #openstack-oslo14:44
dhellmannjd__: ok, good14:45
*** nacim has quit IRC14:46
*** morganfainberg_Z is now known as morganfainberg14:46
*** haypo_ is now known as haypo14:48
*** HenryG has joined #openstack-oslo15:02
*** YorikSar has joined #openstack-oslo15:02
*** AAzza_afk is now known as AAzza15:09
*** zhiyan is now known as zhiyan_15:10
openstackgerritJulien Danjou proposed a change to openstack/oslo.messaging: Import notifier middleware from oslo-incubator  https://review.openstack.org/10574615:11
openstackgerritJulien Danjou proposed a change to openstack/oslo.messaging: Import oslo-incubator context module  https://review.openstack.org/10574515:11
openstackgerritJulien Danjou proposed a change to openstack/oslo.messaging: Import oslo-incubator/middleware/base  https://review.openstack.org/10574415:11
openstackgerritJulien Danjou proposed a change to openstack/oslo.messaging: Update oslo-incubator  https://review.openstack.org/10574315:11
*** joesavak has quit IRC15:30
*** ihrachyshka has quit IRC15:34
*** lbragstad_ has joined #openstack-oslo15:39
*** alexpilotti has quit IRC15:45
markmcjd__, dhellmann, flaper87, need https://review.openstack.org/105671 for the config generator to be usable, if one of you don't mind approving15:59
*** viktors is now known as viktors|afk15:59
* flaper87 clicks15:59
* jd__ clicks too16:00
flaper87markmc: LGTM16:01
jd__beaten by flaper87 :(16:02
markmcthanks :)16:05
*** markmc has quit IRC16:05
*** pcm__ has joined #openstack-oslo16:08
*** pcm_ has quit IRC16:10
*** arnaud has joined #openstack-oslo16:10
*** SridharG has joined #openstack-oslo16:21
*** arnaud has quit IRC16:23
*** i159 has quit IRC16:32
*** GheRiver1 is now known as GheRivero16:43
*** lbragstad_ is now known as lbragstad16:51
*** jecarey has joined #openstack-oslo16:52
*** tkelsey has quit IRC16:54
*** praneshp has joined #openstack-oslo16:59
*** pcm__ has quit IRC17:00
*** zzzeek has joined #openstack-oslo17:03
*** harlowja_away is now known as harlowja17:03
*** pcm_ has joined #openstack-oslo17:04
openstackgerritAlexei Kornienko proposed a change to openstack/oslo-specs: oslo.messaging main loop refactoring  https://review.openstack.org/10579617:05
*** Alexei_987 has quit IRC17:07
*** jecarey has quit IRC17:08
*** AAzza is now known as AAzza_afk17:29
*** arnaud__ has joined #openstack-oslo17:34
openstackgerritMichael Bayer proposed a change to openstack/oslo.db: Implement exception interception and filtering layer  https://review.openstack.org/10530717:35
*** ildikov has joined #openstack-oslo17:59
*** Alexei_987 has joined #openstack-oslo18:02
boris-42zzzeek hi18:05
zzzeekhey18:05
boris-42zzzeek thank you for advice18:05
boris-42zzzeek to use before_cursor_execute18:05
boris-42zzzeek and after_cursor_execute18:05
zzzeekohhh, right18:05
zzzeekhowd that work18:05
boris-42zzzeek it works super great18:06
zzzeekwhat wre you trying to do? i forget.  log queries right18:06
boris-42zzzeek cause without it i have to disable osprofiler during migrations18:06
boris-42zzzeek and now I don't need to do that18:06
boris-42zzzeek https://github.com/stackforge/osprofiler/blob/master/osprofiler/sqlalchemy.py18:06
zzzeekgreat18:06
boris-42zzzeek yep yep it's much better=)18:07
zzzeekdid u see my oslo.db refactoring https://review.openstack.org/#/c/105307/ ?18:07
zzzeekwho should review this?18:07
boris-42zzzeek heh I didn't try it18:07
boris-42zzzeek I'm mostly working now on rally & osprofiler and integration it everywehre=)18:07
zzzeekok well, here’s the main part, do you like this: https://review.openstack.org/#/c/105307/8/oslo/db/sqlalchemy/exc_filters.py18:07
zzzeekyour code is in there, i moved it around18:08
boris-42zzzeek yep I will take a look at your patch18:08
zzzeekthe main impact is that this is how we handle exceptions , using filter functions18:08
zzzeektheres no need for lots of if/then18:08
zzzeekand it works everywhere automatically without any wrapping18:08
boris-42zzzeek btw18:10
boris-42zzzeek one thing about OpenStack=) here it's better to split big pathces18:10
boris-42zzzeek I mean +1k -0.4k is too big change to make a proper and detailed review18:10
zzzeekboris-42: there’s no way to split this up without adding more code that is then thrown away18:11
zzzeeki could add the event in one, and then copy-and-paste @_wrap_db_error onto it18:11
zzzeekbut that still means the tests have to change18:11
boris-42zzzeek okay18:12
zzzeekabsoutely, if this could be done in smaller steps id have done it like that but i dont have the impression this patch has a great spot for that.18:13
zzzeekmaybe it does but thats more work :)18:13
zzzeekits true though, the handle_error event and then the filtering system are two different things.18:14
zzzeekdo i need to split it out ?18:14
*** lbragstad has quit IRC18:14
zzzeekwhen you have two gerrits for one blueprint, how do you name the branches for each of the reviews?18:14
*** pcm_ has quit IRC18:15
zzzeekthe branch is named bp/use-events-for-error-wrapping18:15
zzzeekid need two branches right?18:15
zzzeekbp/use-events-for-error-wrapping-1 bp/use-events-for-error-wrapping-2 ?18:15
*** pcm_ has joined #openstack-oslo18:17
*** AAzza_afk is now known as AAzza18:18
boris-42zzzeek sorry was not here)18:19
boris-42zzzeek reading18:19
boris-42zzzeek btw could you write "boris-42" in msg's so I won't miss your messages18:20
boris-42zzzeek so about branches18:20
boris-42zzzeek you have 1 branch18:20
boris-42zzzeek in this branch you may have multiple patches18:20
boris-42zzzeek if you run "git review -R" it will push all patches on review and update all dependencies18:21
zzzeekboris-42: ok.   hm18:21
boris-42zzzeek ^ that command is very smart18:21
zzzeekboris-42: how do i do an —amend to just one of them ?18:21
boris-42zzzeek and it won't update any untouched pathces18:21
boris-42zzzeek just do it18:21
*** AAzza is now known as AAzza_afk18:21
boris-42zzzeek via rebase e.g.18:21
boris-42<hash_of_last>18:21
boris-42<has_of_last_-1>18:22
boris-42<has_of_last_-2>18:22
boris-42you would like to change in <hash_of_last_-1> something18:22
boris-42you'll need to do git rebase -i  <has_of_last_-2>18:22
boris-42then you should put "e" insetad of "p" on patch that you would like to change18:22
openstackgerritJohn Dewey proposed a change to openstack/oslo-incubator: Add healthcheck middleware  https://review.openstack.org/10583318:22
boris-42and it will stop just after your patch18:23
boris-42then you do changes18:23
boris-42commit --amend18:23
boris-42after that git rebase --continut18:23
boris-42continue*18:23
zzzeekgeez18:23
boris-42and then git review -R18:23
*** dstanek is now known as dstanek_zzz18:23
boris-42and it will update hash_of_last_-1 and hash_of_last patches18:24
boris-42and won't touch hash_of_last18:24
boris-42zzzeek =)18:24
*** dims_ has quit IRC18:24
boris-42zzzeek at least it's my work flow=)18:24
zzzeekseems like its required18:24
zzzeekif i need to split this18:24
*** morganfainberg is now known as morganfainberg_Z18:25
*** dims_ has joined #openstack-oslo18:25
openstackgerritAlexei Kornienko proposed a change to openstack/oslo-specs: oslo.messaging main loop refactoring  https://review.openstack.org/10579618:26
*** SridharG has quit IRC18:32
*** SridharG has joined #openstack-oslo18:34
openstackgerritAlexei Kornienko proposed a change to openstack/oslo.messaging: Moved main loop to server class  https://review.openstack.org/10498318:38
Alexei_987harlowja: Hi are you available?18:39
harlowjaAlexei_987 hey hey, a little ya18:39
Alexei_987harlowja: I've made a spec for my change and patch seems to be production ready ^^18:39
Alexei_987harlowja: sorry for being little late18:39
openstackgerritAlexei Kornienko proposed a change to openstack/oslo.messaging: Moved main loop to server class  https://review.openstack.org/10498318:44
*** mriedem has quit IRC18:45
*** mriedem has joined #openstack-oslo18:48
openstackgerritJohn Dewey proposed a change to openstack/oslo-incubator: Add healthcheck middleware  https://review.openstack.org/10583318:51
*** Alexei_987 has quit IRC18:55
harlowjaAlexei_987 cool, i'll look it over :)18:56
*** Alexei_987 has joined #openstack-oslo19:00
*** praneshp has quit IRC19:00
*** praneshp has joined #openstack-oslo19:03
*** dims_ has quit IRC19:03
*** praneshp has quit IRC19:03
*** praneshp has joined #openstack-oslo19:04
*** ihrachyshka has joined #openstack-oslo19:10
ihrachyshkazzzeek, gus, do you know when sqlalchemy 1.0 will be released? I'm interested in that fix for unicode + mysqlconnector19:12
zzzeek1.0?  months19:12
zzzeekwhat fix, the NATIONAL one?  i have a workaround in the ticket19:12
zzzeekcan use that right now19:12
*** AAzza_afk is now known as AAzza19:13
zzzeekand/or just send encoding=utf8 on the mysqlconnector URL19:13
ihrachyshkazzzeek, yes, that one. you mean, starting mysql with an option?19:13
zzzeekwell the best is Unicode().with_variant(mysql.VARCHAR(national=True))19:13
ihrachyshkazzzeek, can we set it in oslo.db then, in create_engine?19:13
zzzeeksure19:13
ihrachyshkazzzeek, ok. we will still need to set raise_on_warnins to False anyway. alembic.op.create_table won't work for offline migration anyway.19:14
zzzeekwhys that19:15
ihrachyshkazzzeek, for offline migration, we just generate sql script, and then run it later. if we put create table with no condition, it will fail.19:15
ihrachyshkazzzeek, in that case, we don't have access to db contents to check whether table is there19:16
ihrachyshkawell, I may be wrong, but that's what jlibosva from neutron confirmed19:16
zzzeekihrachyshka: thats wrong19:18
zzzeekihrachyshka: menaing, not that waht theyre saying isnt happening19:18
zzzeekihrachyshka: but, you shoud not be running a .sql script against a DB in an unknown state19:18
ihrachyshkazzzeek, maybe, but still, there is that offline migration thing present, and we support it :)19:19
zzzeekwhat “offline migration thing” ?19:19
*** arnaud__ has quit IRC19:19
zzzeekyou can’t safely run a sql script that has a full set of migrations in it, against a DB that is in an unknown state19:19
ihrachyshkaoffline migration mode, with sql script run later19:19
ihrachyshkawe have online and offline modes19:19
zzzeekif a table has the wrong columns in it, that approach fails19:19
ihrachyshkaI think you generate it for some specific revision of models19:20
ihrachyshkabut honestly, I don't know details, yet19:20
zzzeeka migration script shoudl never need to check anything whatsoever in the exsiting schema19:21
zzzeekmigration script should *only* be run against a schema whos state is exactly determined ahead of time19:21
zzzeekotherwise, it is wrong.  it will fail19:21
zzzeekeither loudly or silently19:21
zzzeekthis is probably why “create if not exists” raises a warning19:22
zzzeekif you are using that, it means you are guessing19:22
ihrachyshkaI think those conditions in migration are due to some known errors made previously, everyone knows it's hacks, but still, we have them, and we can't remove them now19:22
zzzeekI am 100% sure it can be fixed :)19:22
zzzeekihrachyshka - “everyone knows it's hacks, but still, we have them, and we can't remove them now” - anytime someone says that, then I know the problem is fixable :)19:23
ihrachyshkazzzeek, the problem is that earlier, db could have different models created depemding on configuration used, for the same revision. that's why those conditional rules19:24
zzzeekyup, so, you need separate migration scripts for each of those conditions19:24
zzzeekthose conditions need to be enumerated19:24
zzzeek“create table if not exists”, is one thing, but there is no “alter column set type = integer if the type is string but is not datetime”19:25
zzzeekso these hacks are of limited scope, they have to be19:25
ihrachyshkathere are lots of different configuration setups, it's basically a set of plugins enabled locally that define models19:26
ihrachyshkabetter, "defined"19:26
ihrachyshkanow neutron introduces "healing script" to get back to single sane schema19:27
zzzeekihrachyshka: OK, so are we referring strictly to the “healing script” part of this?19:27
ihrachyshkahm? no, those conditional create tables are in migration rules defined before people realized it's insane how they handled migration before19:28
zzzeekset the setting in create_engine() for now, that is easiet19:30
zzzeekbut if it were me I’d fix all those migrations and for those that definitely need special rules I’d hardwire MySQL directives to suppress the warnings at the SQL level19:30
zzzeekihrachyshka: http://dev.mysql.com/doc/connector-python/en/connector-python-api-mysqlconnection-raise-on-warnings.html  default says “False"19:31
ihrachyshkait's true in sqlalchemy19:32
ihrachyshkafor that specific driver19:32
zzzeekwell there’s your bug wtf is it like that for19:33
ihrachyshkaline 8119:34
zzzeeki know that19:34
zzzeekthis was contributed by the author of mysqlconnector19:34
zzzeeklook set it to False on create_engine()19:34
zzzeekthis default shouldnt be like that19:34
zzzeekbut easy enough to fix19:34
ihrachyshkaso probably should be false in sa too?19:34
zzzeekim changing it right now19:35
zzzeekas well as that buffered BS19:35
zzzeekbut you need to support back to 0.7.8, so, needs to be set19:36
ihrachyshkayeah, I get it. great, thanks a lot, I'll send a patch tomorrow19:36
zzzeekno patch needed i am doing it here.  buffered seems a little more important....19:37
ihrachyshkai mean oslo.db19:37
ihrachyshkaor will you handle it too?19:37
ihrachyshkawhat's that buffered?19:38
zzzeekwow, it is a PITA19:41
zzzeekno, you do oslo.db19:41
zzzeekbuffered is really broken in mysqlconnecvtor.  at its default, results arent bufffered. which is great!  but then it refuses to let the cursor be closed without fetching all of them19:42
zzzeekthat is wrong wrong wrong19:42
ihrachyshkaso we better leave buffered to true for now?19:43
zzzeekon your end yes19:43
zzzeekdont name it at all19:43
ihrachyshkaok, got it. doesn't it mean the library is not that mature and we may get other surprises after we switch to it? ;)19:44
ihrachyshka(not that existing one is great)19:45
*** dims has joined #openstack-oslo19:46
zzzeekit passes all tests19:46
zzzeekso it’s pretty strong19:47
zzzeekbut this one, ugh.  in the early days it had a lot of troublesome things like this19:47
*** SridharG has quit IRC19:49
*** AAzza is now known as AAzza_afk19:50
ihrachyshkabtw I think we support sa starting from 0.8.4 now, 0.7.* is gone for us19:50
*** mkoderer has quit IRC19:52
*** dims_ has joined #openstack-oslo19:55
*** dstanek_zzz is now known as dstanek19:56
*** dims has quit IRC19:57
*** morganfainberg_Z is now known as morganfainberg19:57
zzzeekihrachyshka: wow when the heck did that happen19:58
*** ihrachyshka has quit IRC19:59
*** ihrachyshka has joined #openstack-oslo19:59
*** lbragstad_ has joined #openstack-oslo19:59
*** arnaud has joined #openstack-oslo20:02
*** YorikSar has quit IRC20:06
*** YorikSar has joined #openstack-oslo20:08
ihrachyshkahttps://review.openstack.org/#/c/96438/20:09
ihrachyshkazzzeek, ^^20:10
ihrachyshkait requires sa 0.8 (at least that's why version was bumped)20:10
*** ihrachyshka has quit IRC20:16
*** markmcclain has quit IRC20:23
*** YorikSar has quit IRC20:38
*** YorikSar has joined #openstack-oslo20:40
*** bknudson has joined #openstack-oslo20:43
*** arnaud has quit IRC20:45
zzzeekwhat feature20:47
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Add the core 10k view omnigraffle diagram  https://review.openstack.org/10564221:00
boris-42zzzeek one questions about sqla21:02
zzzeeksure21:02
boris-42zzzeek can I add event listener after engine.connect()21:02
*** lbragstad_ is now known as lbragstad21:03
zzzeekpool events for that21:04
zzzeekthe checkout event21:04
zzzeekyou should be tracking pool checkouts/checkins, thats where DB connection resources are used21:05
boris-42zzzeek okay lemme show the code21:06
boris-42zzzeek this doesn't work https://review.openstack.org/#/c/105635/6/glance/db/sqlalchemy/api.py21:06
zzzeekand why is that21:08
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Add the core 10k view omnigraffle diagram  https://review.openstack.org/10564221:11
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Add the core 10k view omnigraffle diagram  https://review.openstack.org/10564221:12
zzzeekboris-42: what does git review -R do as opposed to git review ?  I see it at http://www.mediawiki.org/wiki/Gerrit/Tutorial#Configuring_git-review, says nothing about why, there is no —help21:13
boris-42zzzeek ?21:13
zzzeekboris-42: ?21:13
boris-42zzzeek you mean "-R"21:13
boris-42zzzeek "-R" if you don't specify it, it will update all patches in any case21:14
zzzeekboris-42: here: http://www.mediawiki.org/wiki/Gerrit/Tutorial#Push_your_change_set_to_Gerrit21:14
zzzeekboris-42: where is that documnted?  i can’t find any doc for what -R means21:14
boris-42zzzeek it's secret knowledge21:14
boris-42zzzeek =)21:14
zzzeekboris-42: so -R gives me some kind of edit screen ?21:14
boris-42zzzeek nope21:14
zzzeekboris-42: i cant test it b.c. i dont have anything to push up21:14
boris-42zzzeek -R sends to gerrit patches only that were changed21:15
zzzeekboris-42: oh21:15
boris-42zzzeek if you have 5 patches in branch21:15
boris-42zzzeek and you edited only last one21:15
boris-42zzzeek and run "git review" it will send all 521:15
boris-42zzzeek in case of "git review -R" only last one21:16
zzzeekboris-42: so if i take my changeset at https://review.openstack.org/#/c/105307/, and rework/rebase it into two separate commits, then do “git review -R”, it will update this one, then make a second review for the other changeset?21:18
boris-42zzzeek it will make to separated change sets21:22
boris-42zzzeek i mean with 2 unique numbers in url21:22
*** markmcclain has joined #openstack-oslo21:22
* zzzeek is giong to do it! 21:22
* zzzeek will see if it ruins everything!21:22
boris-42zzzeek and btw21:22
boris-42zzzeek number 105307 is 1-1 to Change-ID number21:22
boris-42zzzeek it sadness21:23
boris-42zzzeek but for some reason I am not able to trace sqlalchemy in glance21:23
zzzeekboris-42: i dont know why your api.py doesnt work there’s nothing in that file that uses SQLA APIs directly21:23
zzzeekthey use NullPool, but that works: http://paste.openstack.org/show/85833/21:25
*** praneshp has quit IRC21:31
boris-42zzzeek I found the reason21:31
boris-42zzzeek they call another service, and it doesn't have inited profiler21:31
*** arnaud has joined #openstack-oslo21:40
openstackgerritMichael Bayer proposed a change to openstack/oslo.db: Implement the SQLAlchemy ``handle_error()`` event.  https://review.openstack.org/10530721:46
openstackgerritMichael Bayer proposed a change to openstack/oslo.db: Implement new exception interception and filtering layer  https://review.openstack.org/10589121:46
openstackgerritA change was merged to openstack/oslo.messaging: Synced jsonutils and its dependencies from oslo-incubator  https://review.openstack.org/9569621:46
zzzeekboris-42: wow!  https://review.openstack.org/#/c/105307/ and https://review.openstack.org/#/c/105891/21:47
boris-42zzzeek yep magic =)21:47
zzzeekmagic!21:47
boris-42zzzeek and don't worry if you change order of patches with git rebase21:48
boris-42zzzeek it will change in gerrit as well automatically=)21:48
*** mrda-away is now known as mrda21:51
*** praneshp has joined #openstack-oslo21:53
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Add the arch/big picture omnigraffle diagram  https://review.openstack.org/10564222:02
*** mriedem has quit IRC22:09
*** nacim has joined #openstack-oslo22:15
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Add the arch/big picture omnigraffle diagram  https://review.openstack.org/10564222:26
*** nacim has quit IRC22:28
*** boris-42 has quit IRC22:37
*** boris-42 has joined #openstack-oslo22:39
*** praneshp has quit IRC22:44
*** praneshp has joined #openstack-oslo22:47
*** dstanek is now known as dstanek_zzz22:49
HenryGrpodolyaka: around? I have a problem with oslo.db in neutron unit tests22:55
*** lbragstad has quit IRC23:04
*** bknudson has quit IRC23:10
*** pcm_ has quit IRC23:16
*** HenryG has quit IRC23:16
*** morganfainberg is now known as morganfainberg_Z23:17
*** markmcclain has quit IRC23:21
gusihrachyshka: sorry, we keep missing each other online :/23:28
guszzzeek: There's some strangeness in both mysqldb + mysqlconnector wrt unicode enums.23:29
gusmysqldb seems to incorrectly think my connection encoding is latin1, even though in this case it isn't, so that adds an extra round of broken escaping.23:30
gusmysqlconnector doesn't have that issue, but still the contents coming back from the db are interpreted as a byte sequence, not codepoints at some point.  I've traced it as far as ResultProxy.23:31
gus(still hunting further backwards)23:31
gus(mysqldb unicode seems broken in several ways without being forced with ?charset=utf8)23:34
zzzeekgus: not sure, i might be running it with charset=utf823:43
zzzeekhmmm nope23:43
zzzeeki run mysqldb without it.  but the DB encoding might be a factor23:44
zzzeeklike the deafulst of mysql23:44
guszzzeek: huh. yeah, utf8 has to get in there at some point.23:44
guseither your mysqld is compiled with a different default than the usual mysql default (latin1), or your server config, or DB were created to default to utf823:44
gusat least, afaiui.23:44
zzzeekok waht is the SHOW command that will tell me23:45
gusshow variables;23:45
gusand there's a bunch of character_set_% settings23:46
gusthat shows you server + db defaults.23:46
zzzeekserver is utf8 here23:47
guseach table can have a default which should be in show create table foo;23:47
guszzzeek: yep.23:47
zzzeektehre are tests that have non-latin1 data, so the connecrtion needs to be utf823:47
zzzeekor the server23:47
gusso character_set_server is --character-set-server command line flag, or config file option.23:48
gusthen it falls back to the compiled in default, which is supposedly latin1, but can be set to something else at build time.23:48
zzzeekanyway, SQLAlchemy’s job is either to send u’’ as is, or to encode it with ‘encoding’, and it does both correctly.  if mysql chokes on it then mysql or client has to be configured23:49
guszzzeek: I respectfully disagree23:49
gusI can point to several sqlalchemy generated statements that don't specify charset.23:49
gus... when the intention was clearly to specify unicode.23:50
zzzeekhere’s our docs for that http://docs.sqlalchemy.org/en/rel_0_9/dialects/mysql.html#unicode23:50
zzzeekyou disagree that SQLA’s job is to send a u’’ string or a correctly encoded ‘’ string ?23:51
gustake for example the one I'm currently looking at: test.dialect.mysql.test_types:EnumSetTest.test_unicode_enum23:51
gusthat test tries to create an enum with unicode chars in the names, and then sees if they get reflected correctly.23:52
gusthere's nothing there that I can see that tells the DB that these are going to be unicode.23:52
gusSpecifically, I think the test cases should be mysql.ENUM((u('...'), ...), charset='utf8')23:53
gusor similar.23:53
guslikewise Unicode and UnicodeText (before my change) didn't do anything at all to specify charset for mysql.23:53
zzzeekgus: so first off, I was talking about the actual data values passed to cursor.execute(stmt, <data goes here>)23:54
zzzeekgus: that’s where we may or may not have to encode depending on DBAPI behavior23:54
zzzeekgus: in this case you’re referring to the DDL passed to the database, and that it should contain directives that guide the DB towards a specific encoding23:55
zzzeekgus: I would argue that because MySQL does the right thing when the server-side or client-side encoding is set correctly, it would be surprising behavior for this encoding to be hardwired into the DDL23:55
zzzeekgus: unless you’re saying, just the test here should have charset=‘utf8’ in it, in which case, sure that would help the test here pass, though im not sure the test suite can run all the way thru without a default encoding of utf-823:56
zzzeekgus: or osmethign unicode-capable23:56
zzzeekgus: theoretically someone might want to run the whole test suite using utf-1623:56
zzzeekand it woudl be nice if that worked too !23:56
gusright, the results I'm seeing now assume the db is set to default to utf823:57
zzzeekgus: does it assume utf-8, or unicode-capable encoding ?23:57
gusin particular, the mysqldb engine seems to get out of sync, and even if the database *is* set to default to utf8, then it assumes latin1 unless ?charset=utf823:57
guszzzeek: erm ... I guess I mean it defaults to unicode-capable.23:58
gusactually no, I mean both.23:58
gusit assumes the db is unicode-capable, and the connection is utf8.23:58
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Make greenexecutor not keep greenthreads active  https://review.openstack.org/10592223:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!