Tuesday, 2013-10-01

*** reed_ has quit IRC00:00
*** markwash has joined #openstack-dev00:11
*** otherwiseguy has quit IRC00:12
*** MaxV has joined #openstack-dev00:13
*** MaxV has quit IRC00:18
*** jab416171 has quit IRC00:18
*** mrodden has joined #openstack-dev00:20
*** Mandell has quit IRC00:26
*** Thor has joined #openstack-dev00:26
ayoungjamielennox, hmmm.  not sure00:29
ayoungjamielennox, as dolphm pointed out, once we document them, we set them in stone\00:30
ayoungand the cert stuff is, well, clunky00:30
ayoungjamielennox, but..yeah take them and run with them.00:30
*** huats has quit IRC00:31
*** Thor has quit IRC00:31
*** huats has joined #openstack-dev00:32
*** huats has joined #openstack-dev00:32
*** Thor has joined #openstack-dev00:33
*** chenxu has joined #openstack-dev00:33
*** Tross has joined #openstack-dev00:34
*** bdpayne has quit IRC00:34
*** sarob has quit IRC00:34
*** sarob has joined #openstack-dev00:35
*** davidhadas has quit IRC00:38
*** sarob has quit IRC00:39
*** davidhadas has joined #openstack-dev00:39
*** dstanek has joined #openstack-dev00:42
mordreddolphm: I thnk we should just land the https://review.openstack.org/#/c/48988/ change and worry about the others later00:42
*** alop has quit IRC00:42
*** SumitNaiksatam has joined #openstack-dev00:44
*** nosnos has joined #openstack-dev00:50
*** adjohn has quit IRC00:50
*** chenxu has quit IRC00:50
*** freedomhui has joined #openstack-dev00:52
*** otherwiseguy has joined #openstack-dev00:52
*** Javin has joined #openstack-dev00:52
*** shakayumi has quit IRC00:56
*** anteaya has quit IRC00:56
*** colinmcnamara has quit IRC00:57
*** dhubbard_ is now known as dhubbard00:59
*** dhubbard is now known as dhubbard_gone00:59
*** Tross has quit IRC01:01
*** amotoki has joined #openstack-dev01:03
*** roz_ has joined #openstack-dev01:04
*** emagana has quit IRC01:04
*** thingee is now known as thingee_zzz01:05
*** roz has quit IRC01:05
*** sarob has joined #openstack-dev01:05
*** gmurphy has quit IRC01:06
*** chenxu has joined #openstack-dev01:06
*** adjohn has joined #openstack-dev01:08
*** sarob has quit IRC01:10
*** faramir1 has joined #openstack-dev01:11
*** changbl has joined #openstack-dev01:12
*** sarob has joined #openstack-dev01:13
*** FatDarrel has quit IRC01:14
*** dstanek has quit IRC01:16
*** sarob has quit IRC01:18
*** radez_g0n3 is now known as radez01:20
*** nati_ueno has quit IRC01:22
*** gmurphy has joined #openstack-dev01:22
*** bdpayne has joined #openstack-dev01:25
*** RajeshMohan has quit IRC01:25
*** RajeshMohan has joined #openstack-dev01:26
*** edmund has joined #openstack-dev01:26
*** adjohn has quit IRC01:26
*** bdpayne has quit IRC01:27
*** spzala has joined #openstack-dev01:27
*** dguitarbite has joined #openstack-dev01:28
*** melwitt1 has quit IRC01:30
*** erkules_ has joined #openstack-dev01:31
*** erkules has quit IRC01:33
*** boris-42 has quit IRC01:33
*** gmurphy has quit IRC01:39
*** adjohn has joined #openstack-dev01:39
*** danwent has quit IRC01:40
*** adjohn has quit IRC01:45
*** egallen has quit IRC01:45
*** neelashah has joined #openstack-dev01:46
dolphmayoung: jamielennox: feature frozen a milestone ahead of the services, and set in stone once the implementation sees a release (bugs and all)01:50
dolphmayoung: jamielennox: for example, if there was a bug in the oauth1 api or something, we could still fix the api and fix the impl... up until about today01:50
*** gmurphy has joined #openstack-dev01:52
*** angdraug has quit IRC01:53
*** adjohn has joined #openstack-dev01:56
jamielennoxdolphm: damn, i was a bit excited then as i was just thinking that the oauth api is just not really right01:56
dolphmjamielennox: how so?01:57
jamielennoxdolphm: i've been going back and forwards with stevemar on the client review01:57
dolphmjamielennox: i'01:58
jamielennoxi think that an 'entity' whatever that may be should always have a unique id and be a top level namespace01:58
jamielennoxat the moment everything about oauth is namespaced behind a user_id01:58
jamielennoxso /user/:id/consumer/X01:58
jamielennoxwhich causes problems with how clients are set up01:58
dolphmjamielennox: clientS, or our client?01:59
jamielennoxah, at least ours01:59
jamielennoxbut i'm pretty sure it's bigger than that01:59
dolphmjamielennox: i'll take the blame for that, then01:59
jamielennoxso for future api reviews i'm going to say that everything needs to have a unique id01:59
jamielennoxand be at /OS-EXT/entity/:id02:00
dolphmjamielennox: it made sense (at some point) that users own the consumer keys that they create -- do you disagree?02:00
jamielennoxand then we just use permissions to check who it actually belongs to02:00
jamielennoxso the problem comes in in that managers create entity objects02:00
jamielennoxso user = client.users.get(x)02:00
jamielennoxthat .get() doesn't work now without a user_id02:01
jamielennoxthere is some stuff i'm hoping we can override - like for user.delete calls client.users.delete(user.id)02:01
*** xjiujiu has joined #openstack-dev02:01
jamielennoxi'm hoping if we save user_id in the consumer entity we can still reconstruct the URL - but it means that a lot of the inheritted helper functions just won't work02:02
*** sthaha has joined #openstack-dev02:03
jamielennoxand so given that consumer ids and token ids are globally unique anyway it would have just worked better if we'd had them at a top level02:03
ayoungdolphm, I see your point,  but I'm starting to think that relationships like "a users entity"  should be handled by links, and, where ever possible, we references entities (genereic meaning of the world) by top level URLs02:05
*** adjohn has quit IRC02:05
*** novas0x2a|laptop has quit IRC02:05
jamielennoxayoung: i'm of the opinion that if you define an extension then EVERY url that the extension needs should live under it's own /OS-EXT route02:05
*** sarob has joined #openstack-dev02:06
jamielennoxno more intertwining core and extension URIs02:06
ayoungjamielennox, Oh, yeah, under the extensions root is fine02:06
ayoungtop level is a relative term02:07
jamielennoxthe url we currently have could have been expressed as /OS-OAUTH1/users/:user_id/consumer/:consumer_id and be just as expressive02:07
jamielennoxexactly the same but with the prefix02:07
jamielennoxayoung: sure - i mean top level as after /v3/02:07
*** briancurtin has quit IRC02:08
ayoungjamielennox, my point is that it makes more sense if you are going to extend the user object that the things it points to are pointed to by links.  It really doesn't matter where the links point to.  HAving them in the same subtree is useless without some form of enumeraiton to know that they are there02:08
ayoungjamielennox, I think we are in violent agreement02:08
ayoungWhat is the best way to read an file designed to set environemt variables from Python?02:09
jamielennoxgood, cause i'm trying to re-read that last sentence and i'm not sure what you mean exactly02:09
ayoungjamielennox, so, you know that HTML I was tlaking about earlier today?  THat kind of thinking.02:10
jamielennoxayoung: line = f.readline() line.split('=')02:10
jamielennoxat a guess02:10
ayounghttps://review.openstack.org/#/c/29105/02:10
ayoungjamielennox, yeah, you're probably right...just write the code02:10
*** sarob has quit IRC02:10
jamielennoxayoung: i'm fine with links in user objects, that's a good thing for extensions - i'm still not convinced on html02:12
jamielennoxand by fine i mean that sounds like a good idea02:12
ayoungjamielennox, "not conviced on html"  what you prefer flash?02:13
ayoungSilverlight02:13
jamielennoxayoung: the other thing i guess you could do is snapshot the environment variables, source your file and then see what changed :)02:13
*** Javin has quit IRC02:14
jamielennoxayoung: heh, no i'm just not sure yet that keystone has any business providing a html front end02:15
ayoungjamielennox, don't think I could do that cleanly from inside python....well, I guess I could in a subshell.  Nah, I'll just read them fro now.02:15
*** mrda has quit IRC02:15
jamielennoxayoung: wasn't a serious suggestion02:15
ayoungjamielennox, It should have been there from the start.  We'd have a much better web services impl if we had done discovery right from the start02:16
jamielennoxayoung: completely agree about discovery02:16
ayoungjamielennox, I know it wasn't serious...but it had a certain "wouldn't it be cool..." factor02:16
ayoungjamielennox, and...we'll end up with better APIs.  cus once you try to do it from the browser and can't, you'll throw in the missing links....like forms02:17
*** jab416171 has joined #openstack-dev02:17
jamielennoxcompromise on an extension? Anything that goes to /v3/OS-HTML/xxx gets forwarded to /v3/xxx and json pretty printed on the way out?02:18
jamielennoxactually i guess it doesn't matter if the html rendering is done in the pipeline like json then it can be optional in production02:19
*** anniec has quit IRC02:20
ayoungjamielennox, nah...that will actually be harder to do.  Doing HTML rendering is trivial in a pipeline, and the logic of dealing with contenttypes really should not be sprad out...the XML/JSON thing is already pretty ugly.  But that is not where th real work is going to be...02:20
ayoungexactly02:20
*** edmund has quit IRC02:20
ayoungthe hard work is going to be figuring out what should be a table (lists) and what should be a form.02:20
jamielennoxi keep forgetting to use the pipeline02:20
*** colinmcnamara has joined #openstack-dev02:21
ayoungfiguring out how to do "add  item" in the current scheme, and Delete for multiples02:21
ayoungBulk operations in general02:21
jamielennoxalso determining a RO vs RW backend ahead of time02:23
jamielennoxalright, i'll have a look at the html review later as i want discoverability to be a focus of at least mine in Icehouse02:24
dolphmayoung: (sorry, not really paying attention to IRC) agree, relationships should be handled by entities02:24
dolphmerr, links02:24
*** spzala has quit IRC02:24
ayoungdolphm, so, the question then becomes:  if we add links to an object (like the user object) from an extension, how do we show that enumeration.  I wonder if we should use the links collection, and the rel/rev fields?02:25
dolphmayoung: yeah, that's what "links" was intended to be02:26
*** sarob has joined #openstack-dev02:26
*** RajeshMohan has quit IRC02:27
*** RajeshMohan has joined #openstack-dev02:28
*** sarob has quit IRC02:31
*** AlexF has joined #openstack-dev02:31
*** schwicht has quit IRC02:31
ayoungdolphm, so, it sounds like things are pretty free form there, as there are no standard meanins forrel and rev.  I wonder if we will need to come up with some.   For example,  under /v3,  I would like to enumerate all of the top level packages:  user, token, policy.  Would it make sense to do 'rel= module'  for those, and have a comparable 'rel='extension'  for the actual top level URL of the extension?02:31
ayoungand then the rev would be 'container'  for both?02:32
dolphmayoung: "meanins forrel and rev"? very much agree with the basic collections enumerated as links from /v3/02:33
ayoungdolphm, cool....I can add that to the html review.  It is much more useful if we can actually drill down to the collections02:35
ayoungdolphm, once we cut rc1, we are going to branch Havana, and Master becomes Icehouse, right?02:36
dolphmayoung: yep02:36
dolphmayoung: https://review.openstack.org/#/c/46193/ https://review.openstack.org/#/c/48988/ then https://review.openstack.org/#/c/48971/02:37
ayoungdolphm, Keystone work is going to have to be half done by the time the Summit comes around if we do API freeze in I2...and I think we should do it.02:37
ayounglooking02:37
*** novas0x2a|laptop has joined #openstack-dev02:37
ayoung3?  There were only 2 bugs when I looked earlier02:37
dolphmayoung: well, we already have a lot of api ideas on the table02:37
dolphmayoung: it's not like everything from the summit will be new02:37
dolphmayoung: token revocation events, for example02:37
ayoungright...I'd like to get a prototype of that done by summit02:38
dolphmayoung: ++02:38
ayoungKDS needs a rebase ,but it should be just about ready to go.02:38
ayoungah...just saw what the last review was for.  Cool.02:39
*** dims has quit IRC02:40
*** dguitarbite has quit IRC02:40
dolphmayoung: it just took 10 hours for the transifex patch to fail, so this will take awhile this week02:40
ayoungdolphm, let me reinforce how right you were to suggest we  freeze early.02:42
dolphmayoung: ha, thanks02:42
dolphmayoung: other than transient failures, this release was fairly smooth i thought02:42
ayoungdolphm, yeah.02:43
*** sarob has joined #openstack-dev02:44
*** sarob has quit IRC02:49
*** zodiak has joined #openstack-dev02:55
*** sushils has joined #openstack-dev02:58
*** AlexF has quit IRC03:00
*** dguitarbite has joined #openstack-dev03:01
*** dhubbard_gone has quit IRC03:08
*** rcleere has joined #openstack-dev03:08
*** yaguang has joined #openstack-dev03:08
*** bdpayne has joined #openstack-dev03:09
*** chenxu has quit IRC03:09
*** FatDarrel has joined #openstack-dev03:10
*** bdpayne has quit IRC03:11
*** Mandell has joined #openstack-dev03:13
* mordred loves transient failures03:13
*** freedomhui has quit IRC03:14
*** faramir1 has quit IRC03:14
*** adjohn has joined #openstack-dev03:15
*** dhubbard has joined #openstack-dev03:16
*** adjohn_ has joined #openstack-dev03:16
*** paragan has joined #openstack-dev03:17
*** adjohn has quit IRC03:19
*** DennyZhang has joined #openstack-dev03:20
*** prekarat has joined #openstack-dev03:20
*** ArcTanSusan has joined #openstack-dev03:22
*** Tross has joined #openstack-dev03:22
*** Tross has quit IRC03:23
*** sandywalsh has quit IRC03:23
*** senk has joined #openstack-dev03:24
*** yaguang has quit IRC03:25
*** colinmcnamara has quit IRC03:26
*** dstanek has joined #openstack-dev03:28
*** dguitarbite has quit IRC03:29
*** FatDarrel has quit IRC03:32
*** xjiujiu has quit IRC03:33
*** xjiujiu has joined #openstack-dev03:34
*** Mandell has quit IRC03:34
*** adjohn_ has quit IRC03:35
*** radez is now known as radez_g0n303:37
*** alunch_ has joined #openstack-dev03:38
*** bnemec has quit IRC03:39
*** alunch has quit IRC03:39
*** alunch_ is now known as alunch03:39
*** zodiak has quit IRC03:41
*** garyk has quit IRC03:41
*** adjohn has joined #openstack-dev03:42
*** jhesketh_ has joined #openstack-dev03:42
*** bnemec has joined #openstack-dev03:43
*** adjohn_ has joined #openstack-dev03:43
*** ArcTanSusan has quit IRC03:43
*** freedomhui has joined #openstack-dev03:44
*** senk has quit IRC03:46
*** adjohn has quit IRC03:46
*** sandywalsh has joined #openstack-dev03:49
*** briancurtin has joined #openstack-dev03:51
*** adjohn_ has quit IRC03:53
*** alexxu has joined #openstack-dev03:53
*** sushils has quit IRC03:53
*** adjohn has joined #openstack-dev03:54
*** AlexF has joined #openstack-dev03:55
*** shinylasers has joined #openstack-dev03:55
*** neelashah has quit IRC03:56
*** ayoung has quit IRC03:59
*** adjohn has quit IRC04:00
*** kushal has joined #openstack-dev04:01
*** dstanek has quit IRC04:03
*** aditirav has joined #openstack-dev04:03
*** radsy has quit IRC04:05
*** adjohn_ has joined #openstack-dev04:06
*** DennyZhang has quit IRC04:08
*** adjohn_ has quit IRC04:08
*** aditirav has quit IRC04:10
*** aditirav has joined #openstack-dev04:11
*** ArcTanSusan has joined #openstack-dev04:12
*** danwent has joined #openstack-dev04:13
*** Mandell has joined #openstack-dev04:13
*** garyk has joined #openstack-dev04:14
*** gimps__ has joined #openstack-dev04:15
*** gimps__ has quit IRC04:16
*** gimps__ has joined #openstack-dev04:16
*** mjb_ has joined #openstack-dev04:21
*** AlexF has quit IRC04:22
*** AlexF has joined #openstack-dev04:31
*** sridevi has joined #openstack-dev04:32
*** xjiujiu has quit IRC04:32
*** erkules_ is now known as erkules04:34
*** chandankumar has joined #openstack-dev04:36
*** colinmcnamara has joined #openstack-dev04:37
*** Ryan_Lane has quit IRC04:38
*** vartom10 has joined #openstack-dev04:41
*** crank has quit IRC04:41
*** colinmcnamara has quit IRC04:41
*** tvb has joined #openstack-dev04:46
*** briancurtin has quit IRC04:46
*** senk has joined #openstack-dev04:47
*** senk has quit IRC04:51
*** vartom11 has joined #openstack-dev04:51
*** vartom12 has joined #openstack-dev04:53
*** vartom10 has quit IRC04:54
*** sumanthns has joined #openstack-dev04:54
*** vartom11 has quit IRC04:56
*** garyk has quit IRC04:56
*** vartom13 has joined #openstack-dev04:57
*** f3nd3 has joined #openstack-dev04:58
*** tvb has quit IRC04:58
*** vartom12 has quit IRC04:59
*** bashok has joined #openstack-dev05:00
*** garyk has joined #openstack-dev05:01
*** freedomhui has quit IRC05:01
*** vartom14 has joined #openstack-dev05:05
*** bashok has quit IRC05:05
*** afazekas has quit IRC05:05
*** bashok has joined #openstack-dev05:05
*** jhesketh_ has quit IRC05:06
*** vartom13 has quit IRC05:06
*** vartom15 has joined #openstack-dev05:06
*** sushils has joined #openstack-dev05:07
*** SergeyLukjanov has joined #openstack-dev05:08
*** Ryan_Lane has joined #openstack-dev05:08
*** vartom14 has quit IRC05:09
*** Ryan_Lane has quit IRC05:13
*** kushal has quit IRC05:14
*** SergeyLukjanov has quit IRC05:14
*** SergeyLukjanov has joined #openstack-dev05:15
*** kushal has joined #openstack-dev05:16
*** otherwiseguy has quit IRC05:17
*** f3nd3 has left #openstack-dev05:17
*** zaitcev has quit IRC05:22
*** AlexF has quit IRC05:24
*** amohn9 has joined #openstack-dev05:25
*** amohn9 has left #openstack-dev05:25
*** thingee_zzz is now known as thingee05:32
*** danwent has quit IRC05:33
*** adjohn has joined #openstack-dev05:34
*** afazekas has joined #openstack-dev05:35
*** jeremyb has quit IRC05:36
*** jeremyb has joined #openstack-dev05:36
*** Ryan_Lane has joined #openstack-dev05:39
*** jasdeepH has joined #openstack-dev05:39
*** adjohn has quit IRC05:40
*** nshaikh has joined #openstack-dev05:42
*** networkstatic has quit IRC05:44
*** networkstatic has joined #openstack-dev05:45
*** jeremyb has quit IRC05:46
*** jeremyb has joined #openstack-dev05:46
*** Javin has joined #openstack-dev05:46
*** senk has joined #openstack-dev05:47
*** Ryan_Lane has quit IRC05:47
*** afazekas is now known as afazekas_no_irq05:49
*** bashok has quit IRC05:49
*** Tross has joined #openstack-dev05:50
*** adjohn has joined #openstack-dev05:51
*** senk has quit IRC05:54
*** tvb|afk has joined #openstack-dev05:54
*** tvb|afk has quit IRC05:54
*** tvb|afk has joined #openstack-dev05:54
*** adjohn has quit IRC05:55
*** adjohn has joined #openstack-dev05:56
*** Javin has quit IRC05:57
*** ctracey has quit IRC05:57
*** adjohn has quit IRC06:02
*** adjohn has joined #openstack-dev06:02
*** ctracey|away has joined #openstack-dev06:07
*** ctracey|away is now known as ctracey06:07
*** Javin has joined #openstack-dev06:08
*** rushiagr has joined #openstack-dev06:10
*** vartom15 has quit IRC06:11
*** doron_afk has joined #openstack-dev06:12
*** yolanda has joined #openstack-dev06:13
*** freedomhui has joined #openstack-dev06:14
*** gmurphy has quit IRC06:14
*** SergeyLukjanov has quit IRC06:15
*** zbitter has joined #openstack-dev06:15
*** vipul is now known as vipul-away06:16
*** stevemar has quit IRC06:16
*** odyssey4me has joined #openstack-dev06:18
*** shinylasers has quit IRC06:18
*** zaneb has quit IRC06:18
*** faramir1 has joined #openstack-dev06:18
*** xqueralt-afk has quit IRC06:20
*** blamar has quit IRC06:20
*** gmurphy has joined #openstack-dev06:20
*** adjohn_ has joined #openstack-dev06:22
*** adjohn has quit IRC06:24
*** doron_afk is now known as doron06:25
*** MaxV has joined #openstack-dev06:29
*** mjb_ has quit IRC06:29
*** AlexF has joined #openstack-dev06:29
*** jbresnah has joined #openstack-dev06:30
*** vipul-away is now known as vipul06:30
*** kushal has quit IRC06:31
*** doron is now known as doron_afk06:35
*** adjohn_ has quit IRC06:36
*** adjohn has joined #openstack-dev06:37
*** aditirav_ has joined #openstack-dev06:38
*** aditirav_ has quit IRC06:38
*** aditirav_ has joined #openstack-dev06:39
*** Ryan_Lane has joined #openstack-dev06:39
*** MaxV has quit IRC06:40
*** shinylasers has joined #openstack-dev06:40
*** aditirav has quit IRC06:41
*** aditirav_ is now known as aditirav06:41
*** o_petit has joined #openstack-dev06:42
*** mrunge has joined #openstack-dev06:42
*** flaper87|afk is now known as flaper8706:43
*** Ryan_Lane has quit IRC06:46
*** rushiagr has quit IRC06:47
*** kdas__ has joined #openstack-dev06:47
*** adjohn has quit IRC06:48
*** senk has joined #openstack-dev06:50
*** AlexF has quit IRC06:54
*** senk has quit IRC06:54
*** egallen has joined #openstack-dev06:57
*** jprovazn has joined #openstack-dev07:00
*** reidrac has joined #openstack-dev07:02
*** belmoreira has joined #openstack-dev07:08
*** shinylasers has quit IRC07:10
*** basha has joined #openstack-dev07:11
*** jcoufal has joined #openstack-dev07:11
*** thingee is now known as thingee_zzz07:11
*** freedomhui has quit IRC07:14
*** salv-orlando has joined #openstack-dev07:15
*** SergeyLukjanov has joined #openstack-dev07:18
*** gargya has joined #openstack-dev07:18
*** DinaBelova has joined #openstack-dev07:19
*** rushiagr has joined #openstack-dev07:20
*** shinylasers has joined #openstack-dev07:23
*** jbresnah has quit IRC07:31
*** athomas has joined #openstack-dev07:31
*** tsufiev has joined #openstack-dev07:32
*** vsergeyev has left #openstack-dev07:33
*** xga_ has joined #openstack-dev07:33
*** markmc has joined #openstack-dev07:35
*** JordanP has joined #openstack-dev07:35
*** gsilvis has quit IRC07:36
*** tsufiev has quit IRC07:37
*** xga has quit IRC07:37
*** rushiagr has quit IRC07:37
*** jistr has joined #openstack-dev07:39
*** jtomasek has joined #openstack-dev07:40
*** Ryan_Lane has joined #openstack-dev07:40
*** MaxV has joined #openstack-dev07:40
*** rushiagr has joined #openstack-dev07:42
*** fbo_away is now known as fbo07:42
*** Ryan_Lane has quit IRC07:44
*** arezmerita has joined #openstack-dev07:46
*** gmurphy is now known as gmurphy_gone07:46
*** Javin has quit IRC07:47
*** xqueralt has joined #openstack-dev07:49
*** xga has joined #openstack-dev07:49
*** Max__ has joined #openstack-dev07:49
*** MaxV has quit IRC07:50
*** jpich has joined #openstack-dev07:50
*** ygbo has joined #openstack-dev07:51
*** xga_ has quit IRC07:53
*** romcheg has joined #openstack-dev07:55
*** vartom15 has joined #openstack-dev07:56
*** johnthetubaguy has joined #openstack-dev07:57
*** o_petit has quit IRC07:57
*** mkollaro has joined #openstack-dev07:57
*** ndipanov_gone is now known as ndipanov07:58
*** rushiagr has quit IRC07:59
*** DinaBelova has quit IRC08:00
*** vartom15 has quit IRC08:00
*** vartom15 has joined #openstack-dev08:01
*** mmagr has joined #openstack-dev08:02
*** matrohon has joined #openstack-dev08:02
*** AlexF has joined #openstack-dev08:04
*** salv-orlando has quit IRC08:05
*** boden has joined #openstack-dev08:05
*** romcheg has left #openstack-dev08:06
*** o_petit has joined #openstack-dev08:06
*** xga_ has joined #openstack-dev08:07
*** DinaBelova has joined #openstack-dev08:08
*** rushiagr has joined #openstack-dev08:08
*** ArcTanSusan has quit IRC08:09
*** xga has quit IRC08:10
*** mosulica has joined #openstack-dev08:11
*** yassine has joined #openstack-dev08:11
*** gsilvis has joined #openstack-dev08:13
*** tvb|afk has quit IRC08:14
*** JordanP has quit IRC08:14
*** tvb|afk has joined #openstack-dev08:14
*** tvb|afk has quit IRC08:14
*** tvb|afk has joined #openstack-dev08:14
*** kpavel has joined #openstack-dev08:16
*** derekh has joined #openstack-dev08:18
*** vuntz has quit IRC08:18
*** AlexF has quit IRC08:19
*** kpavel has quit IRC08:19
*** vuntz has joined #openstack-dev08:19
*** vuntz has quit IRC08:19
*** vuntz has joined #openstack-dev08:19
*** safchain has joined #openstack-dev08:21
*** gatuus has quit IRC08:25
*** JordanP has joined #openstack-dev08:26
*** rushiagr has quit IRC08:27
*** dnoll has joined #openstack-dev08:28
*** gfidente has joined #openstack-dev08:30
*** gfidente has quit IRC08:30
*** corXi has joined #openstack-dev08:30
*** rushiagr has joined #openstack-dev08:30
*** ygbo has quit IRC08:31
*** pfreund has joined #openstack-dev08:35
*** lucasagomes has joined #openstack-dev08:37
*** eglynn has joined #openstack-dev08:39
*** Ryan_Lane has joined #openstack-dev08:40
*** ygbo has joined #openstack-dev08:41
*** sushils has quit IRC08:41
*** ctracey has quit IRC08:42
*** testingtesting has joined #openstack-dev08:43
*** Ryan_Lane has quit IRC08:44
*** tkammer has joined #openstack-dev08:45
*** danpb has joined #openstack-dev08:46
*** ctracey|away has joined #openstack-dev08:46
*** ctracey|away is now known as ctracey08:46
*** akrogames has joined #openstack-dev08:47
akrogamesHi all08:47
*** AlexF has joined #openstack-dev08:47
*** lsmola has quit IRC08:49
*** rushiagr has quit IRC08:49
*** shinylasers has quit IRC08:53
*** networkstatic has quit IRC08:55
*** flaper87 is now known as flaper87|afk08:55
*** flaper87|afk is now known as flaper8708:56
*** iartarisi has joined #openstack-dev08:59
*** viktors has joined #openstack-dev08:59
*** feleouet has joined #openstack-dev09:00
*** JordanP has quit IRC09:00
*** xga has joined #openstack-dev09:01
*** JordanP has joined #openstack-dev09:02
*** pixelb has joined #openstack-dev09:04
*** xga_ has quit IRC09:04
*** toabctl has quit IRC09:05
*** toabctl has joined #openstack-dev09:06
*** toabctl has joined #openstack-dev09:06
*** Shaan7 has quit IRC09:08
*** Ryan_Lane has joined #openstack-dev09:10
*** akrogames has quit IRC09:10
*** martyntaylor has joined #openstack-dev09:11
*** AlexF has quit IRC09:12
*** Ryan_Lane has quit IRC09:15
*** senk has joined #openstack-dev09:22
*** dosaboy has quit IRC09:22
*** dosaboy has joined #openstack-dev09:22
*** xga_ has joined #openstack-dev09:23
*** rushiagr has joined #openstack-dev09:25
*** xga has quit IRC09:26
*** senk has quit IRC09:26
*** sridevi has quit IRC09:28
*** faramir1 has quit IRC09:29
*** sridevi has joined #openstack-dev09:29
*** o_petit has quit IRC09:33
*** o_petit has joined #openstack-dev09:34
koolhead17garyk: around09:37
*** danwent has joined #openstack-dev09:38
*** eglynn has quit IRC09:39
*** eglynn has joined #openstack-dev09:40
*** danwent has quit IRC09:43
*** belmoreira has quit IRC09:48
*** AnilV4 has quit IRC09:49
*** danwent has joined #openstack-dev09:51
*** sushils has joined #openstack-dev09:51
*** prekarat has quit IRC09:52
*** DinaBelova has quit IRC09:59
*** AnilV4 has joined #openstack-dev10:07
*** o_petit has quit IRC10:09
*** sandywalsh has quit IRC10:10
*** Ryan_Lane has joined #openstack-dev10:11
*** Ghe_Holidays is now known as GheRivero10:14
*** Ryan_Lane has quit IRC10:15
*** flaper87 is now known as flaper87|afk10:17
*** freedomhui has joined #openstack-dev10:17
*** pcm_ has joined #openstack-dev10:19
*** jruzicka has joined #openstack-dev10:19
*** pcm_ has quit IRC10:21
*** o_petit has joined #openstack-dev10:21
*** pcm_ has joined #openstack-dev10:21
*** senk has joined #openstack-dev10:22
*** sandywalsh has joined #openstack-dev10:23
*** schwicht has joined #openstack-dev10:23
*** egallen has quit IRC10:24
*** SergeyLukjanov has quit IRC10:25
*** senk has quit IRC10:27
*** AnilV4 has quit IRC10:27
*** SergeyLukjanov has joined #openstack-dev10:27
*** rushiagr has quit IRC10:27
*** novas0x2a|laptop has quit IRC10:28
*** rushiagr has joined #openstack-dev10:29
*** flaper87|afk is now known as flaper8710:29
*** DinaBelova has joined #openstack-dev10:30
*** adjohn has joined #openstack-dev10:31
*** lsmola has joined #openstack-dev10:32
*** o_petit has quit IRC10:33
*** kaushikc has joined #openstack-dev10:33
*** paragan has quit IRC10:34
*** lbragstad has quit IRC10:35
*** AlexF has joined #openstack-dev10:35
*** danwent has quit IRC10:36
kaushikcjohnthetubaguy: hi10:39
johnthetubaguyhey10:39
johnthetubaguykaushikc: hows things10:39
*** Ryan_Lane has joined #openstack-dev10:41
*** lbragstad has joined #openstack-dev10:43
*** Ryan_Lane has quit IRC10:45
*** zbitter is now known as zaneb10:50
*** gargya has quit IRC10:51
*** gargya has joined #openstack-dev10:52
*** sergmelikyan has joined #openstack-dev10:52
*** rushiagr has quit IRC10:53
*** basha has quit IRC10:54
*** AnilV4 has joined #openstack-dev11:00
*** rushiagr has joined #openstack-dev11:03
*** rkukura has quit IRC11:04
*** AlexF has quit IRC11:04
*** AlexF has joined #openstack-dev11:05
*** boris-42 has joined #openstack-dev11:07
*** dstanek has joined #openstack-dev11:09
*** radez_g0n3 is now known as radez11:09
*** sushils has quit IRC11:10
*** yolanda has quit IRC11:10
*** yolanda has joined #openstack-dev11:11
*** doron_afk is now known as doron11:13
*** flaper87 is now known as flaper87|afk11:16
*** doron is now known as doron_afk11:17
*** dims has joined #openstack-dev11:18
*** doron_afk is now known as doron11:19
*** rushiagr has quit IRC11:20
*** flaper87|afk is now known as flaper8711:21
*** doron is now known as doron_afk11:21
*** romcheg1 has joined #openstack-dev11:22
*** senk has joined #openstack-dev11:23
*** senk has quit IRC11:27
*** rushiagr has joined #openstack-dev11:28
*** lucasagomes has quit IRC11:29
*** lucasagomes has joined #openstack-dev11:29
*** michchap has quit IRC11:29
*** michchap has joined #openstack-dev11:30
*** doron_afk is now known as doron11:30
*** primemin1sterp has joined #openstack-dev11:31
*** primeministerp has quit IRC11:31
*** nosnos has quit IRC11:33
*** o_petit has joined #openstack-dev11:34
*** drewlander has joined #openstack-dev11:36
*** o_petit_ has joined #openstack-dev11:37
*** matsuhashi has quit IRC11:37
*** o_petit has quit IRC11:40
*** Ryan_Lane has joined #openstack-dev11:41
*** Ryan_Lane has quit IRC11:41
*** Ryan_Lane has joined #openstack-dev11:41
*** markmcclain has quit IRC11:42
*** markmcclain has joined #openstack-dev11:43
*** markmcclain1 has joined #openstack-dev11:44
*** markmcclain has quit IRC11:44
*** AnilV4 has quit IRC11:45
*** alunduil has quit IRC11:45
*** Ryan_Lane has quit IRC11:46
*** sandywalsh has quit IRC11:47
*** markmc has quit IRC11:49
*** testingtesting has quit IRC11:50
*** testingtesting has joined #openstack-dev11:51
*** yassine_ has joined #openstack-dev11:52
*** testingtesting is now known as djoreilly11:55
*** yassine has quit IRC11:56
*** AnilV4 has joined #openstack-dev11:56
*** kdas__ has quit IRC11:56
*** safchain_ has joined #openstack-dev11:58
*** kushal has joined #openstack-dev11:58
*** safchain_ has quit IRC11:58
*** safchain has quit IRC11:58
*** safchain has joined #openstack-dev11:58
*** dolphm has quit IRC11:58
*** nil1511 has joined #openstack-dev11:59
*** venkatesh has joined #openstack-dev12:00
*** sandywalsh has joined #openstack-dev12:01
*** dkranz has joined #openstack-dev12:01
*** mkollaro1 has joined #openstack-dev12:01
*** mkollaro has quit IRC12:01
*** doron is now known as doron_afk12:03
*** tkammer has quit IRC12:03
*** safchain has quit IRC12:05
*** safchain_ has joined #openstack-dev12:05
*** gordc has joined #openstack-dev12:05
*** dnoll has quit IRC12:06
*** dims has quit IRC12:07
*** mohits has quit IRC12:08
*** egallen has joined #openstack-dev12:08
*** dims has joined #openstack-dev12:08
*** rcrit has quit IRC12:08
*** clouded_tux has quit IRC12:08
*** rcrit has joined #openstack-dev12:10
*** larsks is now known as larsks|kids12:11
*** Ryan_Lane has joined #openstack-dev12:12
*** galstrom_zzz is now known as galstrom12:12
*** galstrom is now known as galstrom_zzz12:13
*** mrunge has quit IRC12:15
*** pfreund has quit IRC12:16
*** Ryan_Lane has quit IRC12:16
*** paragan has joined #openstack-dev12:18
*** doron_afk is now known as doron12:19
*** rushiagr has quit IRC12:19
*** flaper87 is now known as flaper87|afk12:20
*** tkammer has joined #openstack-dev12:22
*** romcheg1 has quit IRC12:23
*** romcheg has joined #openstack-dev12:23
*** romcheg1 has joined #openstack-dev12:23
*** senk has joined #openstack-dev12:23
*** vladikr has joined #openstack-dev12:24
*** Ruetobas has quit IRC12:25
*** Ruetobas has joined #openstack-dev12:25
*** romcheg1 has quit IRC12:27
*** romcheg has quit IRC12:27
*** senk has quit IRC12:27
*** romcheg has joined #openstack-dev12:28
ekarlsoannegentle: is there any docs on installing on xenserver atm ?12:28
*** jasondot_ has joined #openstack-dev12:28
*** doron is now known as doron_afk12:31
*** dsantos_ has joined #openstack-dev12:31
*** rfolco has joined #openstack-dev12:32
*** jayg|g0n3 is now known as jayg12:33
*** flaper87|afk is now known as flaper8712:33
*** jayg is now known as jayg|g0n312:33
*** jayg|g0n3 is now known as jayg12:33
*** nil1511_ has joined #openstack-dev12:34
*** tellesnobrega has joined #openstack-dev12:35
*** drewlander has quit IRC12:35
*** drewlander has joined #openstack-dev12:35
dsantos_hi guys, I'm getting this bug to fix https://bugs.launchpad.net/nova/+bug/120161612:36
uvirtbotLaunchpad bug 1201616 in nova "misconfigured baremetal deploy environments are hard to debug" [High,Triaged]12:36
*** mohits has joined #openstack-dev12:36
dsantos_but I don't know what the guy who reported the bug did to get an exception12:36
*** Ruetobas has quit IRC12:36
dsantos_does someone knows what I can do to reproduce this bug?12:37
*** nil1511 has quit IRC12:37
*** blues-man has joined #openstack-dev12:39
*** odyssey4me has quit IRC12:39
*** sgordon_ has joined #openstack-dev12:40
*** thomasm has joined #openstack-dev12:40
*** markmc has joined #openstack-dev12:42
ttxmarkmc: around ? Looking into stable/havana cut for oslo-incubator12:42
markmcttx, hey12:42
ttxmarkmc: you still have bug 1225099 targeted12:43
uvirtbotLaunchpad bug 1225099 in oslo "Encoding hard-coded in gettextutils.Message" [High,In progress] https://launchpad.net/bugs/122509912:43
*** Ryan_Lane has joined #openstack-dev12:43
markmcttx, thanks, looking12:43
markmcttx, wow, some commit message and discussion in that review12:44
markmcttx, as bnemec says "this is giving me a headache" :)12:44
ttxmarkmc: got me worried. Doesn't exactly look like it's around the corner12:44
markmcttx, right12:44
markmcbnemec, any thoughts on how critical this is for the release?12:44
*** jvrbanac has joined #openstack-dev12:45
markmcttx, crap, I'm going to be in the air during the project meeting later - just realized12:45
ttxmarkmc: we can solve most of the questions now if you're around12:46
markmcttx, yeah - still reading through this stuff on 122509912:47
ttxI only had that bug's fate and your signoff for stable/havana cutting12:47
*** kincl has joined #openstack-dev12:47
*** Ryan_Lane has quit IRC12:47
*** rushiagr has joined #openstack-dev12:47
*** dvarga has joined #openstack-dev12:48
*** dolphm has joined #openstack-dev12:48
*** sgordon has quit IRC12:49
markmcttx, I have to say, this bug makes me very nervous12:51
*** kushal has quit IRC12:51
*** gargya_ has joined #openstack-dev12:51
markmcttx, I'm not totally clear on the user implications - but it sounds like it could be bad12:52
ttxmarkmc: how common are those double-byte things ?12:52
*** Ruetobas has joined #openstack-dev12:52
*** jvrbanac has quit IRC12:52
markmcttx, and I'm far from clear on the code, it's complete voodoo12:52
markmcttx, I'm assuming they'd have to come from translations12:52
ttxthat's my supposition too12:52
*** gargya has quit IRC12:52
*** gargya_ is now known as gargya12:52
*** radez is now known as radez_g0n312:53
ttxmarkmc: can you clarify it (or punt to dhellmann early today) ?12:53
markmcttx, yeah12:53
ttxmarkmc: note that we can still cut stable/havana alright, nothing prevents backporting from it12:53
*** edmund has joined #openstack-dev12:53
* dhellmann reads backlog12:53
*** kaushikc has quit IRC12:53
ttxbut would like to know if affected projects need to sync it before rc12:53
markmcttx, yep, agree12:53
*** rushiagr has quit IRC12:54
dhellmannew, some of this is hairy12:54
markmcttx, I'm going to target this to nova's rc1 - AFAICT the code is used by nova, and only used by nova12:55
*** o_petit_ has quit IRC12:55
markmcttx, again, not clear on the user implications for nova yet, but assuming potentially bad12:55
*** READ10 has quit IRC12:55
*** xga has joined #openstack-dev12:56
*** Max__ has quit IRC12:56
*** Ruetobas has quit IRC12:57
*** o_petit has joined #openstack-dev12:57
markmcttx, dhellmann, oh, ceilometer uses it too apparently12:57
*** jcoufal has quit IRC12:58
*** dprince has joined #openstack-dev12:58
*** xga_ has quit IRC12:58
*** safchain_ has quit IRC12:58
*** safchain_ has joined #openstack-dev12:59
*** o_petit has quit IRC12:59
*** safchain_ has quit IRC12:59
*** safchain has joined #openstack-dev12:59
*** o_petit has joined #openstack-dev12:59
dhellmannmarkmc: I'm not sure this is the right approach. Isn't the point of lazy evaluation that the translation happens when the message is rendered? This changes when the translation occurs, doesn't it?12:59
*** jorisroovers has joined #openstack-dev12:59
*** Ruetobas has joined #openstack-dev13:01
markmcdhellmann, the new translate_into() is for delayed translation I assume13:01
dhellmannmarkmc: it seems like the right approach is to set the encoding for Message objects to use instead of 'ascii'13:01
dhellmannafaict, that's the problem described in the (epic) commit message13:01
markmcdhellmann, my instinct on this is that the problem is gnarly enough that we've a very high chance of getting it wrong13:02
*** venkatesh has quit IRC13:02
dhellmannmarkmc: agreed13:02
markmcdhellmann, so we should consider punting delayed-translation support to icehouse13:03
dhellmannmarkmc: also agreed13:03
markmcdhellmann, i.e. removing the enable_lazy() calls from projects13:03
dhellmannmarkmc: also, this solution looks gnarly enough that I suspect it's wrong just on the face of it13:03
*** mkollaro has joined #openstack-dev13:03
markmcdhellmann, yeah13:03
dhellmannmarkmc: remove them,  or make them a no-op?13:03
*** sandywalsh has quit IRC13:03
*** anteaya has joined #openstack-dev13:03
markmcdhellmann, I'd just remove the calls13:04
*** xga has quit IRC13:04
markmcdhellmann, that way work on gettextutils isn't disrupted13:04
dhellmannmarkmc: fair point13:04
markmcdhellmann, and if people/vendors want to enable it, they can just carry a patch to add back the calls13:04
dhellmannI was worried about something sneaking back in to a project before it was ready13:04
dhellmanntrue13:05
markmcconfused13:05
markmccinder affected but doesn't call enable_lazy() ?13:05
markmchttps://bugs.launchpad.net/cinder/+bug/122980013:05
uvirtbotLaunchpad bug 1229800 in cinder "UnicodeDecodeError in log when message includes non-ascii characters" [Undecided,New]13:05
markmcluisg, there?13:05
*** blues-man has quit IRC13:05
*** davidhadas has quit IRC13:06
*** jasondot_ has quit IRC13:06
*** Ruetobas has quit IRC13:06
*** nshaikh has left #openstack-dev13:07
*** mkollaro1 has quit IRC13:07
*** aditirav has quit IRC13:07
*** nil1511_ has quit IRC13:08
*** sridevi has quit IRC13:08
*** rushiagr has joined #openstack-dev13:08
*** egallen has quit IRC13:09
*** chandankumar has quit IRC13:09
*** o_petit has quit IRC13:10
markmcdhellmann, ah, it's either enable_lazy() or gettextutils.install('foo', lazy=True)13:10
dhellmannaha13:10
*** adalbas has joined #openstack-dev13:10
*** Ruetobas has joined #openstack-dev13:12
*** jasondot_ has joined #openstack-dev13:12
*** o_petit has joined #openstack-dev13:12
dhellmannI'm trying to figure out why this required a new class method factory, too13:12
*** Ryan_Lane has joined #openstack-dev13:13
*** MaxV has joined #openstack-dev13:14
*** egallen has joined #openstack-dev13:14
*** sumanthns has quit IRC13:14
*** yassine has joined #openstack-dev13:15
*** corXi has quit IRC13:15
*** corXi has joined #openstack-dev13:15
*** sumanthns has joined #openstack-dev13:16
markmcmrodden, there?13:16
*** Ryan_Lane has quit IRC13:18
*** zul has quit IRC13:18
*** sandywalsh has joined #openstack-dev13:19
*** yassine_ has quit IRC13:19
*** vartom15 has quit IRC13:19
*** Ruetobas has quit IRC13:20
*** AlexF has quit IRC13:20
*** SumitNaiksatam has left #openstack-dev13:21
*** kbringard has joined #openstack-dev13:21
*** nermina has joined #openstack-dev13:22
*** larsks|kids is now known as larsks13:24
*** jecarey_ has quit IRC13:25
*** jecarey has quit IRC13:25
*** henrynash has joined #openstack-dev13:26
*** jistr has quit IRC13:27
*** Ruetobas has joined #openstack-dev13:27
*** jistr has joined #openstack-dev13:28
*** jasondot_ has quit IRC13:30
markmcttx, dropping off again soon13:30
*** alexpilotti has joined #openstack-dev13:30
markmcttx, posted a summary to https://bugs.launchpad.net/oslo/+bug/122509913:30
uvirtbotLaunchpad bug 1225099 in oslo "Encoding hard-coded in gettextutils.Message" [High,In progress]13:30
*** AlexF has joined #openstack-dev13:31
*** eharney has joined #openstack-dev13:32
ttxmarkmc: ok, will read13:32
*** zul has joined #openstack-dev13:32
ttxmarkmc: is dhellmann replacing you for today's meeting ?13:32
markmcdhellmann, would you mind?13:33
*** alunch has quit IRC13:33
*** RajeshMohan has quit IRC13:33
*** blamar has joined #openstack-dev13:34
*** RajeshMohan has joined #openstack-dev13:34
*** alunch has joined #openstack-dev13:35
*** rcrit has quit IRC13:35
*** ifarkas has quit IRC13:35
mroddenmarkmc: i'm around but in a call at the moment13:36
mroddenwill be kind of slow13:36
*** ifarkas has joined #openstack-dev13:36
markmcmrodden, ok, take a look at https://bugs.launchpad.net/neutron/+bug/1225099/comments/9 when you're ready13:36
uvirtbotLaunchpad bug 1225099 in oslo "Encoding hard-coded in gettextutils.Message" [High,In progress]13:36
*** rushiagr has quit IRC13:37
*** egallen has quit IRC13:38
*** neelashah has joined #openstack-dev13:38
*** venkatesh has joined #openstack-dev13:40
*** rcrit has joined #openstack-dev13:41
*** davidhadas has joined #openstack-dev13:41
*** jcoufal has joined #openstack-dev13:42
*** alunch_ has joined #openstack-dev13:44
*** Ryan_Lane has joined #openstack-dev13:44
*** blues-man has joined #openstack-dev13:44
*** bknudson has joined #openstack-dev13:44
*** alunch has quit IRC13:44
*** alunch_ is now known as alunch13:44
bnemecmarkmc: mrodden: I'm inclined to agree with Mark's comment.  The fix is ugly (an immutable object that we want to change on the fly) and intrusive to the other projects using it, which means there's a significant chance of regression if we push it through.13:46
bnemecSo I guess I'm +1 on punting for Havana.13:46
*** zaitcev has joined #openstack-dev13:46
markmcbnemec, thanks for the input13:46
bnemecWhich is too bad because a lot of work went into this, but I just don't feel that good about it right now.13:46
*** rcrit has quit IRC13:46
*** tkammer has quit IRC13:47
*** dkranz has quit IRC13:47
*** colinmcnamara has joined #openstack-dev13:47
*** Ruetobas has quit IRC13:48
*** Ryan_Lane has quit IRC13:48
*** insanidade has joined #openstack-dev13:49
*** Max__ has joined #openstack-dev13:49
*** rcleere has quit IRC13:49
*** MaxV has quit IRC13:49
*** morazi has joined #openstack-dev13:51
*** spzala has joined #openstack-dev13:51
insanidadeanyone: when it comes to neutron plugin development, are we strictly talking about making it able to interact with new switching techonologies? Doesn't it include new routing techonologies ?13:52
*** Ruetobas has joined #openstack-dev13:52
insanidade*technologies13:52
*** gargya_ has joined #openstack-dev13:52
*** gargya has quit IRC13:53
*** gargya_ is now known as gargya13:53
*** jecarey has joined #openstack-dev13:53
*** jecarey_ has joined #openstack-dev13:53
*** rcrit has joined #openstack-dev13:53
*** paragan has quit IRC13:54
*** changbl has quit IRC13:54
*** bauzas has quit IRC13:56
*** bauzas has joined #openstack-dev13:57
*** safchain has quit IRC13:58
*** safchain has joined #openstack-dev13:58
*** athomas has quit IRC13:58
*** safchain has quit IRC13:58
*** AlexF has quit IRC13:59
*** safchain has joined #openstack-dev14:00
*** salv-orlando has joined #openstack-dev14:00
*** tkammer has joined #openstack-dev14:01
*** READ10 has joined #openstack-dev14:02
*** sumanthns has quit IRC14:02
*** markmc has quit IRC14:03
*** jtomasek_ has joined #openstack-dev14:03
*** jcoufal has quit IRC14:04
*** jtomasek has quit IRC14:04
*** jvrbanac has joined #openstack-dev14:05
*** markmcclain1 has quit IRC14:05
*** alunch has quit IRC14:05
*** jimfehlig has joined #openstack-dev14:05
*** dstanek has quit IRC14:06
*** freedomhui has quit IRC14:06
mroddenbnemec: i'm confused... what are we punting on?14:07
*** alunch has joined #openstack-dev14:07
*** venkatesh has quit IRC14:07
bnemecmrodden: Lazy translation14:07
*** thedodd has joined #openstack-dev14:07
mroddenok yeah i see14:07
*** clouded_tux has joined #openstack-dev14:08
mroddenso mark wants to disabled lazy14:08
bnemecIt's broken right now and the proposed fix is...scary. :-)14:08
bnemecYeah14:08
*** rushiagr has joined #openstack-dev14:08
mroddenyeah the double-byte thing was interesting to discover14:08
*** davidhadas_ has joined #openstack-dev14:09
bnemecSeems like the underlying issues is that the logging module doesn't handle unicode well, but that's still a problem for us.14:09
mroddenyeah14:09
mroddendarn python standard library...14:09
mrodden:P14:09
bnemec:-)14:09
*** AlexF has joined #openstack-dev14:10
*** davidhadas has quit IRC14:11
*** tmclaugh[work] has joined #openstack-dev14:11
*** radez_g0n3 is now known as radez14:11
mroddeni think changing the encoding in __str__ to system default would solve the main issue14:12
mroddensince anyone doing translations to something with double-byte chars would run into the same issue even without lazy=True14:13
*** jprovazn is now known as jprovazn_mtg14:13
*** jtomasek_ is now known as jtomasek14:13
*** RajeshMohan has quit IRC14:14
*** egallen has joined #openstack-dev14:15
*** jcoufal has joined #openstack-dev14:15
*** mkoderer has quit IRC14:15
*** ausxxh has quit IRC14:15
*** dstanek has joined #openstack-dev14:15
*** Alex_Gaynor has quit IRC14:15
*** RajeshMohan has joined #openstack-dev14:16
*** clouded_tux has quit IRC14:16
*** mohits has quit IRC14:16
*** s2r2 has quit IRC14:17
*** jab416171 has quit IRC14:17
*** briancurtin has joined #openstack-dev14:17
*** tvb|afk has quit IRC14:18
*** kenperkins has joined #openstack-dev14:20
*** athomas has joined #openstack-dev14:21
*** rkukura has joined #openstack-dev14:22
*** chenxu has joined #openstack-dev14:25
*** FunnyLookinHat has joined #openstack-dev14:27
*** epim has joined #openstack-dev14:31
*** Javin has joined #openstack-dev14:32
*** otherwiseguy has joined #openstack-dev14:35
*** markmcclain has joined #openstack-dev14:37
*** rushiagr has quit IRC14:38
*** davidhadas has joined #openstack-dev14:39
*** mohits has joined #openstack-dev14:40
*** jab416171 has joined #openstack-dev14:41
*** s2r2 has joined #openstack-dev14:41
*** clouded_tux has joined #openstack-dev14:41
*** Alex_Gaynor has joined #openstack-dev14:41
*** imsurit has joined #openstack-dev14:42
*** davidhadas_ has quit IRC14:43
*** kevinconway has quit IRC14:43
*** tkammer has quit IRC14:43
*** tkammer has joined #openstack-dev14:44
*** ayoung has joined #openstack-dev14:44
*** jecarey has quit IRC14:44
*** Ryan_Lane has joined #openstack-dev14:45
*** adjohn has quit IRC14:48
*** Ryan_Lane has quit IRC14:49
*** tellesnobrega has quit IRC14:50
*** imsurit has quit IRC14:50
*** imsurit has joined #openstack-dev14:51
*** imsurit is now known as Guest7708814:51
*** Guest77088 is now known as imsurit_14:52
*** changbl has joined #openstack-dev14:52
*** Mandell has quit IRC14:53
*** jruzicka has quit IRC14:53
*** rcleere has joined #openstack-dev14:54
*** imsurit_ has quit IRC14:54
*** jasondot_ has joined #openstack-dev14:54
*** carl_baldwin has joined #openstack-dev14:55
*** epim_ has joined #openstack-dev14:55
*** epim has quit IRC14:56
*** epim_ is now known as epim14:57
*** kevinconway has joined #openstack-dev14:58
*** athomas has quit IRC15:00
*** ndipanov is now known as ndipanov_gone15:00
*** reidrac has quit IRC15:00
*** cdub has quit IRC15:00
*** jprovazn_mtg has quit IRC15:00
*** amuller has quit IRC15:01
*** jcoufal has quit IRC15:02
*** boris-42 has quit IRC15:02
mroddenjswarren, luisg: looking into the issue a bit more, whats stopping us from attempting to encode into the system default, and if that doesn't work then just punting and returning the original english message in ascii15:02
*** jistr has quit IRC15:03
mroddenstack doesn't fall over15:03
*** bpokorny has joined #openstack-dev15:03
*** jtomasek has quit IRC15:03
mroddenuser just doesn't get the translated message since their system encoding is weird15:03
*** amuller has joined #openstack-dev15:03
*** DinaBelova has quit IRC15:04
luisgi think jswarren tried that, but it didn't work b/c the default is likely ascii and so all non-ascii langs won't work15:04
jswarrenYes, I basically came to the conclusion that no matter what you did, there were cases where it broke.15:05
*** dkranz has joined #openstack-dev15:05
mroddenmmk15:06
jswarrenIt has to do with whether a mod operation involves parameters that are all str or a mixture of str and unicode15:06
*** yamahata has joined #openstack-dev15:06
mroddenyeah...15:06
*** pmathews has joined #openstack-dev15:08
*** yamahata has quit IRC15:09
*** dstanek has quit IRC15:10
*** paragan has joined #openstack-dev15:10
*** paragan has quit IRC15:10
*** paragan has joined #openstack-dev15:10
*** aeperezt has joined #openstack-dev15:10
*** xqueralt has quit IRC15:10
*** doron_afk is now known as doron15:12
*** gargya_ has joined #openstack-dev15:12
*** mkollaro has quit IRC15:12
*** basha has joined #openstack-dev15:13
*** dstanek has joined #openstack-dev15:13
*** gargya has quit IRC15:13
*** markwash has quit IRC15:14
*** jtomasek has joined #openstack-dev15:15
*** Ryan_Lane has joined #openstack-dev15:16
*** gargya_ has quit IRC15:16
crazedhenrynash: hey, i haven't touched the keystone ldap code in awhile and noticed there's this new assignment api. is the goal there to move project/role membership to sql and remove ldap from that? i know the code was a bit hairy before15:18
*** shinylasers has joined #openstack-dev15:19
*** fandikurnia01 has joined #openstack-dev15:19
fandikurnia01hi15:19
*** doron is now known as doron_afk15:19
*** Ryan_Lane has quit IRC15:20
*** doron_afk is now known as doron15:20
jswarrenbnemec, the change is ugly in terms of how much code is changed, but what it does in practical terms should not be objectionable: it extends the unicode class by adding one method: translate-into, and this method returns a new unicode object containing the translated text.  It no more changes a string on the fly than any other operation, such as mod or slice.15:20
*** kbringard has quit IRC15:20
*** qba73 has quit IRC15:21
fandikurnia01hi all15:21
jswarrenI agree that it's a lot of code changes, but I disagree on the substance.15:21
fandikurnia01can i ask some thing15:21
fandikurnia01i am new in openstack15:21
fandikurnia01 error: Installed distribution pyparsing 1.5.7 conflicts with requirement pyparsing>=2.0.15:21
bnemecjswarren: Sure, but it's a fundamental change in how the Message class works.15:22
*** adjohn has joined #openstack-dev15:22
bnemecAnd the Message class was already an edge case.15:22
*** adjohn has quit IRC15:22
jswarrenI would say that the changes make it less of an edge case--they bring it closer to the norm.15:22
dhellmannttx: I can be in the meeting today, but I'll need to catch up with markmc about status or I won't be much help15:23
jswarrenIf you used only the extent of changes as a yard stick, no one would ever refactor.15:23
*** networkstatic has joined #openstack-dev15:23
bnemecRight, but at the very end of a release the extent of changes is relevant.15:24
jswarrenAgreed.15:24
bnemecI'm not saying this should enver go in, just not right now.15:24
*** Ryan_Lane has joined #openstack-dev15:24
bnemec*never15:24
jswarrenYup.15:24
*** senk has joined #openstack-dev15:25
ttxdhellmann: the only thing up is that new bug he mentioned to you15:25
*** basha has quit IRC15:25
mroddenthe unicode extend thing would solve the problem with logger15:25
ttxdhellmann: so I'll just need an up to date status on where that is15:25
mroddenbut it has no burn-in yet15:26
*** datsun180b has joined #openstack-dev15:26
mroddenwhich is the issue there15:26
ttxdhellmann: for reference: https://bugs.launchpad.net/oslo/+bug/122509915:26
uvirtbotLaunchpad bug 1225099 in oslo "Encoding hard-coded in gettextutils.Message" [High,In progress]15:26
*** doron is now known as doron_afk15:27
*** doron_afk is now known as doron15:27
*** arezmerita has quit IRC15:27
dhellmannttx: ok, I should be able to provide that15:28
*** xga has joined #openstack-dev15:28
luisgbnemec, we were actually thinking of going with a tactical approach15:28
ttxdhellmann: thanks! looks like the most uncertain thing affecting RC1 at this point15:28
dhellmannbnemec, jswarren : sorry for joining the party late (commute), but it sounds like we're basically in agreement to hold off on merging the change?15:29
luisgso abandoning that change that change s the fundamental way Message works15:29
ttxdhellmann: any clarification on impact, in particular, would be welcome. I.e. should it really be a RC1 blocker15:29
jswarren...and delaying the strategic approach until Icehouse.15:29
*** senk has quit IRC15:29
luisgdhellmann, yeah i think we want to hold off on that particualr change, because its practically a redesign15:29
*** o_petit has quit IRC15:29
luisghowever, there is a tactical solution15:29
luisgthe main problem is that the LogHandlers don't think Messages are basestrings15:29
dhellmannluisg: can we return something better from __str__?15:30
luisgso we can extend the Message class from unicode, and the problem will be resolved15:30
luisgdhellmann, i'd like to investigate that approach too15:30
luisga trial and error on __str__15:30
*** doron has left #openstack-dev15:30
dhellmannluisg: jswarren's change does subclass from unicode, right? it had other changes, too, so are you saying changing the base class would be good enough?15:30
*** jmontemayor has joined #openstack-dev15:30
luisgbnemec, and dhellmann what do u guys think of that? those more "tactial" solutions, we can delay the strategic to I15:31
jswarrendhellman, a number of different approaches were tried and the conclusion was that the only solution that has worked in all cases so far is when Message extends unicode.15:31
*** basha has joined #openstack-dev15:31
jswarrenWe tried various encodings, etc.15:31
luisgdhellmann, it did in addition to doing a lot of other stuff to make it look more like unicode in terms of its immutability15:31
*** kbringard has joined #openstack-dev15:31
dhellmannright15:31
*** romcheg has quit IRC15:31
bnemecMy major issue here is that unicode support is not well tested in the other projects, so even though lazy translation went in months ago, we're still finding problems now.15:31
jswarrenBut nothing worked in all possible permutations, especially when it comes to mod operations.15:31
dhellmannjswarren: I'm a bit surprised that using the default system encoding didn't fix the problem15:31
bnemecSo if we make a significant change to how Message works now, we have no time to make sure it doesn't trigger some other issue in the other projects.15:31
jswarrenYeah, so was I.15:32
dhellmannbnemec: yep, I'm in favor of markmc's proposal to disable the feature entirely for now15:32
bnemecThe system encoding does not necessarily equal the locale of the message though.15:32
dhellmannbut I do still want to understand the nature of the issue15:32
bnemecI think that's the issue.15:32
mroddenthats correct15:32
mroddenour messages can be dynamic and independent of system locale15:32
mroddenthats the idea of Message15:32
dhellmannah, good point, bnemec15:32
bnemecI'm pretty sure I left that comment on a review at some point...15:32
*** fungi has quit IRC15:33
mroddeni did find a library that would help with detecting the encoding of the bytes15:33
mroddenchardet15:33
jswarrendhellman, basically it has to do with what happens during mod operations.  When there is a mixture of str and unicode, the str objects are "promoted" to unicode using the default encoding (almost always ascii)15:33
dhellmanndoes this issue cause problems for other uses of translation, other than logging?15:33
*** fungi has joined #openstack-dev15:33
*** o_petit has joined #openstack-dev15:33
*** troytoman-away is now known as troytoman15:34
dhellmannjswarren: right, that part I do get15:34
jswarrenPotentially, but not confirmed.15:34
dhellmannI wonder if we can solve the logging problem independently, with an adapter?15:34
jswarrenWell, you also have problems when it's all strings.15:34
mroddenthe API translations have been working fine15:34
mroddensince we can control the output at the API level15:34
mroddenlogging is all internal to python libs15:35
mroddenunfortunately15:35
luisgyeah so far it appears its all in logging15:35
jswarrendhellman, one approach we tried was to swap out the isinstance method...that worked, but needless to say, not kosher.15:35
dhellmannjswarren: no, that feels pretty ugly :-)15:35
*** xga_ has joined #openstack-dev15:36
mroddenhave we investigated a logging wrapper?15:36
luisgso dhellmann basically the fix out there already extends from unicode, and that is why the problem is solved15:36
*** basha has quit IRC15:36
jswarrenMy thinking was that we didn't want to do anything specific for logging, since logging might change between releases of Python.15:36
luisgbut it came in with a bunch of extra stuff that i thinw e can remoce15:36
luisg*remove15:36
*** xga has quit IRC15:36
mroddena wrapper not a monkey patch to the logging15:37
mroddenwrapper would ideally be portable15:37
dhellmannjswarren: I can see that position. If what we have is working for API messages, though, maybe logging is enough of a special case that we need to treat it differently.15:37
*** amuller has quit IRC15:37
dhellmannjswarren: if only because for logging we can know what the encoding should be15:37
mroddenwell we can catch the Messages at a logger adapter level15:37
mroddentranslate them to the best known locale at the time15:38
dhellmannmrodden: right, that's why I was wondering if an adapter would let us handle this case15:38
*** safchain_ has joined #openstack-dev15:38
mroddenand let it pass through as a unicode15:38
jswarrenI guess if we're talking tactical, an adapter makes sense.15:38
*** safchain has quit IRC15:38
*** armax has joined #openstack-dev15:38
jswarrenI don't think it's a good long-term solution, because ultimately _ should behave as much as possible as it did before--other libraries see it as a unicode object and no special treatment is required.15:39
*** dkranz has quit IRC15:39
luisgwhere would the adapter be placed?15:39
mroddenlog.py probably...15:39
mroddenor gettextutils.py and used in log.py15:39
bnemecWe could even just coerce it to unicode before logging.15:39
dhellmannjswarren: practicality vs. purity15:39
bnemecIt's not like logging needs delayed translation behavior.15:40
mroddenbnemec: yep, that would be the adapter's job i was thinking15:40
jswarrendhellman...right a place and time for both.15:40
bnemecThere's even been some debate over whether log messages should be translated.15:40
mroddenyeah15:40
dhellmannbnemec: right, logging translation doesn't need to be delayed -- maybe we don't use _ for logging translations15:40
mroddeni dont like it15:40
mrodden(translating logs)15:40
dhellmannI don't either, but users want it15:40
dhellmannso I'm ok doing it15:40
*** AlexF has quit IRC15:40
bnemecApparently some users prefer logs in English because it makes googling errors easier.15:41
dhellmanndo we need a summit session on this?15:41
*** sthaha has quit IRC15:41
dhellmannbnemec: yep; translation would be optional, right?15:41
* bnemec won't be at summit15:41
dhellmann:-(15:41
bnemecdhellmann: I don't think it is right now.15:41
mroddenyeah i won't make it either15:41
dhellmannbnemec: oh, true, we would need separate domains for the log messages, wouldn't we15:42
* dhellmann needs to brush up on gettext15:42
mroddenyeah that goes way back15:42
bnemecYeah.15:42
clarkbmarkmc ^15:42
mroddenmarkmc suggested two domains originally15:42
mroddenAPI_()15:42
mroddenand _()15:42
dhellmannI remember seeing something about that15:42
mroddenor something like that15:42
bnemecI think that predates my involvement in this. :-)15:43
mroddeni think it predated mine too :)15:43
* dhellmann checks for a blueprint15:43
luisgso going back to the adapter idea, if ppl setup the logging through logging.conf how would the adapter be involved15:44
brianclinemayhap this is a dumb question; but when would a fix like this make its way down to the precise packages for havana? https://code.launchpad.net/~zulcss/horizon/1210253/+merge/18131115:44
neelashahluisg: mroddem: would it be possible to see a change proposed for the logging wrapper?15:44
*** venkatesh has joined #openstack-dev15:44
luisgneelashah, yeah i think so, just want to make sure i understand the approach15:45
mroddenactually we already have the wrapper15:45
mroddenits the test handler in the bottom of gettextutils15:45
mroddenits just a Handler right now instead of an Adapter15:45
mroddenits actually a Handler that wraps other Handlers15:46
*** mriedem has joined #openstack-dev15:46
mroddenbut it is the same concept15:46
luisgmrodden, u have a good handle on the approach i would say go for it15:46
jswarrenHow invasive is this change?15:47
luisg:)15:47
mroddenevery project that uses Messages would need an additional logging adapter15:48
mroddenin place15:48
mroddenobviously we can do that with code in oslo15:48
*** primemin1sterp has quit IRC15:49
dhellmannI thought we already had some sort of log adapter already, but I don't see one in the incubator code15:49
bnemecbriancline: You'd have to ask the Ubuntu people.  We don't have anything to do with packaging.15:49
*** primeministerp has joined #openstack-dev15:50
mroddendhellmann: there is a ContextAdapter in log.py15:50
bnemecbriancline: Looks like Chuck is zul here.  He might know.15:50
mroddenand LocalizedLogHander (or something) in gettextutils.py15:50
dhellmannmrodden: thanks, I must have typo-ed "adapter"15:50
bnemecProbably spelled it adaptor.  I can never remember which it is. :-)15:51
*** mlavalle has joined #openstack-dev15:51
*** epim has quit IRC15:51
dhellmannmrodden: well it looks like the place to set the encoding for log messages is in the LocaleHandler, since that's what it claims to be doing now15:52
*** yassine has quit IRC15:52
*** dkranz has joined #openstack-dev15:52
mroddendhellmann: correct, but the handler is an example available for users15:52
mroddenit doesn't get utilized yet15:53
zulbriancline:  it should be getting updated soon15:53
mroddenexcept by some internal stuff we have15:53
bnemecBTW, this was the comment I made previously on this: http://docs.python.org/2/library/locale.html#locale.nl_langinfo15:53
dhellmannmrodden: do you see an issue with changing that?15:53
bnemecRegarding getting the encoding for the locale.15:53
mroddena LoggingAdapter would have all messages flow through it15:53
dhellmannI know we need to be careful about tying the logging and gettextutils modules together15:53
mroddenright15:54
mroddenanother risk15:54
*** SergeyLukjanov has quit IRC15:54
dhellmannok, maybe the adapter makes more sense -- I was looking for an existing place to fix it15:54
*** networkstatic has quit IRC15:54
*** dprince has quit IRC15:54
bnemecI'm +1 on the adapter.15:54
jswarrenbnemec, aren't locales and encodings independent?  Russian, for instance can be encoded in UTF8, UTF16 or KOI815:54
*** senk has joined #openstack-dev15:54
bnemecI looked into it before, but I don't know enough about logging to make it work. :-)15:55
bnemecjswarren: Yeah, I was thinking locale.CODESET sounded like what we needed though.15:55
bnemechttp://docs.python.org/2/library/locale.html#locale.CODESET15:55
bnemecWhatever that returns should properly encode the locale at least.15:56
bnemecOne would hope.15:56
bnemec:-)15:56
bnemecI could be completely wrong too.  I haven't looked into it much.15:56
*** senk has quit IRC15:56
*** dosaboy has quit IRC15:56
*** dosaboy has joined #openstack-dev15:56
luisgbnemec, i think that is a good idea15:56
luisgbut im kind of worried about the system giving us various encodings15:57
luisgbut it looks like it just chooses 115:57
luisgmaybe u can only use 1 jswarren15:57
*** danwent has joined #openstack-dev15:57
*** emagana has joined #openstack-dev15:58
dhellmannbnemec: locale.getlocale() returns the locale name and an encoding name15:58
luisgso we could in the str method see the locale and use this to get the encoding15:58
luisgand encode to that15:58
jswarrenI'm not sure what is being discussed...in any case, changing the default locale is possible, but python must be started with -s option, as I recall.15:58
*** jasondot_ has quit IRC15:58
luisgjswarren, see bnemec proposal above15:58
*** senk has joined #openstack-dev15:58
bnemecNot looking to change the default - just the value used here: https://github.com/openstack/oslo-incubator/blob/master/openstack/common/gettextutils.py#L24015:58
dhellmannlocale.getlocale() honors the posix environment variables to control the locale15:58
luisgwe would not change the default locale15:58
jswarrenThe problem isn't only with the __str__ method that is in Message...it's with encoding/decoding logic in modules we don't control.15:59
*** egallen has quit IRC15:59
bnemecjswarren: The logging adapter would take care of that though.15:59
*** xga_ has quit IRC15:59
bnemecWe'd encode the string before it got to that code.15:59
bnemec(as I understand it)15:59
dhellmannjswarren: the proposed fix is to leave Message alone (or make fewer changes) and have a logging adapter that catches Message instances and turns them into encoded strings15:59
*** xga_ has joined #openstack-dev16:00
jswarrenThe logging formatter perform a mod operation...does that go before or after the adapter?16:00
dhellmannthat may not fix the problem for API uses, so we may still need changes in Message16:00
dhellmannafter16:00
jswarrenThen you still have the same problem.16:00
dhellmannso the logging formatter could even get a unicode string, maybe the adapter doesn't do encoding at all16:00
mroddenbut we should be injecting into a unicode16:00
*** Ruetobas has quit IRC16:01
jswarrenYeah, OK.16:01
*** gmoro has quit IRC16:01
jswarrenIf the adapter makes it a unicode object, then it should be OK.16:01
dhellmannyeah, I got that backwards, but you're right16:01
mroddenthe idea is the the adapter will do Message -> Unicode16:01
brianclinezul: thanks -- I know that particular one is marked as low urgency, but is that a <7days soon or a <~14 days soon? :)16:02
dhellmannwho can summarize this discussion in the bug report so we have a record?16:02
*** adalbas has quit IRC16:02
*** chenxu has quit IRC16:02
luisgk so it looks like we have at least 1 tactical solution that would work16:02
luisgjust for completeness did u guys see problems with making Message unicode ?16:02
*** paragan has quit IRC16:03
luisgmrodden, also u mentioned above a library that "detects" encoding?16:03
mroddenchardet16:03
*** egallen has joined #openstack-dev16:03
luisgthat woud limit the change to the str() method16:03
*** Ruetobas has joined #openstack-dev16:04
luisgit's along the lines of the fix proposed by bnemec16:04
mroddenright16:04
luisgwe could explore that16:04
jswarrenI wouldn't call any changes to encoding as doable until tested.16:04
bnemec+116:04
luisgjswarren, yeah we would definitely need to test the changes regardless16:05
dhellmannluisg: I don't see a problem with making it a unicode, but is that still needed?16:05
dhellmannluisg: why would chardet be useful?16:05
luisgthat woudl fix the problem of the handler trying to str() it16:05
*** galstrom_zzz is now known as galstrom16:06
dhellmanntrying to str() the Message object?16:06
luisgyes..16:06
luisgi think because we can examine the bytes in .msg and we would be able to sort of dynamically adjust the encoding to those bytes16:06
luisginstead of hardcoding it like it currently is16:06
*** cdub has joined #openstack-dev16:07
*** FatDarrel has joined #openstack-dev16:07
dhellmannwhy is the data inside Message encoded at all?16:07
mroddeni think the worst case there is that the message comes out unreadable because we guess the encoding wrong16:07
jswarrenI tried a lot of things involving monkeying with the encoding...giving logging a unicode object (via an adapter or whatever), is the safest bet, IMHO.16:07
bnemecWell, or it fails because str.encode() can't handle characters in it.16:07
dhellmannyeah, we want Message to have unicode objects internally and we want to call unicode() on it to get a unicode string to pass to the logging code16:08
dansmithmordred: nicely put.16:08
dhellmannMessage itself doesn't need to be a unicode object16:08
luisgand we can return an encode('replace')16:08
mordreddansmith: thanks!16:08
fandikurnia01hi there16:08
*** Ruetobas has quit IRC16:08
dhellmannjswarren: right? ^^16:08
fandikurnia01has anyone try this16:08
fandikurnia012013-10-01 23:05:26 Installed /opt/stack/nova16:08
fandikurnia012013-10-01 23:05:26 Processing dependencies for nova==2013.1.4.a27.gfaabb9116:08
fandikurnia012013-10-01 23:05:26 error: Installed distribution pyparsing 1.5.7 conflicts with requirement pyparsing>=2.0.116:08
jswarrendhellman, yes.16:08
*** crank has joined #openstack-dev16:08
*** markwash has joined #openstack-dev16:08
luisgi agree on that adapter, was just a bit worried about how to ensure that it is always used16:09
dhellmannso nothing should pass encoded data to Message and expect it to handle that in any useful way (other than repr), and we shouldn't need to guess the encoding16:09
luisgnot sure how that was going to work if ppl uses their own loggingn.conf fior instance16:09
*** iartarisi has quit IRC16:09
*** blues-man has left #openstack-dev16:09
dhellmannhow does that work with the ContextAdapter now?16:10
mroddenyeah thats a good point...16:10
*** bdpayne has joined #openstack-dev16:10
bnemecDon't all of the projects use getLogger? https://github.com/openstack/oslo-incubator/blob/master/openstack/common/log.py#L45316:10
mroddenyeah16:11
mroddeni think we are okay16:11
mroddensince its an adapter16:11
dhellmannbnemec: yeah, that's how the ContextAdapter works16:11
mroddennot a handler16:11
bnemecI guess that doesn't guarantee anything, but as long as they're using the standard logging code we can enforce our adapter.16:11
dhellmannright16:11
*** sushils has joined #openstack-dev16:11
bnemecAnd if they're not using the standard logging code they probably shouldn't be using lazy translation either. :-)16:11
luisgah ok, so we can even do it there in CA16:11
dhellmannin CA?16:11
luisgContextAdapter16:12
mroddencontext adapter...16:12
dhellmannok16:12
*** boris-42 has joined #openstack-dev16:12
mroddenbut we may want another one to wrap that16:12
luisgerr Califronia :P16:12
dhellmannsorry, pre-caffeine :-)16:12
bnemecBlame Canada!16:12
bnemec:-D16:12
luisgha16:12
dhellmannyes, let's make a new adapter and wrap the ContextAdapter with it (or the other way, around)16:12
dhellmannseparation of concerns, etc.16:12
luisggot it, so that looks good to me16:12
mroddenok...16:13
dhellmannluisg: so you'll write up a quick summary of the agreed approach in the bug for us?16:13
mroddenso who wants to write it :)16:13
*** alop has joined #openstack-dev16:13
luisgfor sure16:13
dhellmanncool, thanks16:13
luisgnp16:13
bnemecSo where does this leave us for rc1?16:13
mroddenand thats the next Q16:13
dhellmannhave we come up with anything we think is low enough risk to enable in havana?16:13
bnemecAre we still trying to get this in or waiting for Icehouse?16:13
dhellmannI'm still leaning towards waiting16:14
luisgi think the Adapter approach is low risk enough, because it will only focus on Message objects16:14
luisgwhile logging16:14
dhellmannOTOH, it might break all of logging :-)16:14
bnemecI like the Adapter change, but we don't have an actual fix to review yet.16:14
dhellmannright16:14
*** adalbas has joined #openstack-dev16:15
*** Ruetobas has joined #openstack-dev16:15
dhellmannif we can get the adapter written, I'm still inclined to have it disabled by default (remove the calls to set up lazy evaluation from the other projects)16:15
*** Shaan7 has joined #openstack-dev16:15
luisgwe can take care of that fix16:15
luisgthe adapter is actually very low risk, if there is a Message objec,t we unicode it16:16
luisgso it should not really affect anything else16:16
bnemecIt's just so late in the cycle to be messing around with fundamental pieces of OpenStack.16:17
dhellmanndoes Message work correctly, without any changes, for uses other than logging?16:17
luisgit does, i think it has been tested, the issue was just that internal logging16:17
dhellmannagreed16:17
luisgfor everythign else it has worked16:17
luisgwell16:17
luisgi think it'd be a shame to drop the entire feature :(16:17
*** angdraug has joined #openstack-dev16:17
luisgespecially just b/c we have a very low risk solution16:18
*** mkoderer_ has joined #openstack-dev16:18
mroddenyes we test it internally16:18
mroddenit does work16:18
bnemecWe have a low-risk plan. ;-)16:18
dhellmannby "internally" you mean at your work on a deployment?16:18
mroddenyes16:18
dhellmannbut not with logging?16:18
bnemecI think that's how they found the logging issue, wasn't it?16:19
mroddenwe use a custom logging adapter that got dropped from the H release16:19
luisgbnemec, correct16:19
mroddenbut yeah16:19
dhellmannah16:19
mroddenwe did find it while debugging internally16:19
bnemecWhat kind of timeframe are we looking at here?16:19
luisgi think hours tbh, based on that approach16:19
bnemechttps://wiki.openstack.org/wiki/Havana_Release_Schedule is kind of vague on specific dates for this part of the cycle.16:20
dhellmannsome of that may be decided during the release meeting today, I'm not sure16:20
*** SergeyLukjanov has joined #openstack-dev16:20
dhellmanngo ahead and create the adapter16:20
bnemecI mean, even if everything goes perfectly we're looking at a couple of days minimum to get this into Oslo and synced to the other projects.16:20
*** DinaBelova has joined #openstack-dev16:20
*** DinaBelova has quit IRC16:20
dhellmannthat way we have something concrete to evaluate16:20
bnemec+116:21
dhellmannbnemec: right16:21
mrodden++16:21
dhellmannI don't want to rush things, but let's not wait until after the summit to move16:21
*** nermina has quit IRC16:21
luisgmakes sense16:21
*** flaper87 is now known as flaper87|afk16:21
luisgso let's get the adapter out there16:21
dhellmannright16:21
dhellmannwho's on that?16:21
luisgmrodden, is16:22
luisgi'll document and start testing mrodden change16:22
mroddensounds good16:22
dhellmannok, great16:23
bnemecdhellmann: You've got the release meeting covered?16:23
luisgdhellmann, bnemec thank you16:23
bnemecJust want to make sure we don't need to update Mark.16:23
*** terryw has joined #openstack-dev16:23
dhellmannbnemec: yeah, I'll be there16:23
bnemecCool.16:23
dhellmannI think markmc was in transit at that time16:24
bnemecSounds like we're good then.16:24
dhellmannyep, thank you all, this is going to be a great team to work with :-)16:24
bnemec+2!16:24
bnemec:-)16:24
*** djdeffjamz has joined #openstack-dev16:25
*** gimps_ has joined #openstack-dev16:25
*** otherwiseguy has quit IRC16:26
*** egallen has quit IRC16:26
luisg:) thx16:27
*** Ruetobas has quit IRC16:27
*** DennyZhang has joined #openstack-dev16:28
*** aditirav has joined #openstack-dev16:28
*** DennyZhang has quit IRC16:28
clouded_tuxHi.. all I just hit this issue with horizon https://lists.launchpad.net/openstack/msg21342.html   Can anyone provide me direction on how to debug16:30
*** egallen has joined #openstack-dev16:30
*** Ruetobas has joined #openstack-dev16:31
*** DennyZhang has joined #openstack-dev16:32
*** venkatesh has quit IRC16:33
clouded_tuxHi.. all I just hit this issue with horizon https://lists.launchpad.net/openstack/msg21342.html   Can anyone provide me direction on how to debug16:33
*** JordanP has quit IRC16:35
*** safchain_ has quit IRC16:35
*** Mandell has joined #openstack-dev16:36
*** shinylasers has quit IRC16:36
*** shinylasers has joined #openstack-dev16:37
*** shinylasers has quit IRC16:38
*** DinaBelova has joined #openstack-dev16:38
*** terryw is now known as otherwiseguy16:39
*** gyee has joined #openstack-dev16:40
*** ygbo has quit IRC16:42
*** garyk has quit IRC16:42
*** hemna has joined #openstack-dev16:45
bigmstoneBobBall: You around?16:47
*** devoid has joined #openstack-dev16:48
*** derekh has quit IRC16:52
*** tkammer has quit IRC16:52
crazedwhat's the status of keystone using ldap for identity and mysql for assignment?16:52
crazedas far as havana release goes16:52
*** mrunge has joined #openstack-dev16:53
dolphmcrazed: supported!16:53
crazeddolphm: is that the new preferred way?16:53
*** danpb has quit IRC16:53
dolphmcrazed: i think it will be a popular option, i don't know about preferred16:53
crazeddolphm: what does the config look like to get that going?16:53
crazedi'm trying out a beta release of havana16:54
crazedand noticed all the ldap stuff changed a bit16:54
crazedwith the asssignment api16:54
dolphmcrazed: just set the [assignment] driver and [identity] drivers appropriately16:54
shardydolphm, ayoung: I've been looking at this trusts tempest coverage issue16:54
crazeddolphm: i guess but how does the mysql table know what to lookup in ldap16:55
shardythere is no coverage for trusts at all, and IMHO it's not that reasonable to gate the client change on adding it16:55
*** emagana has quit IRC16:55
dolphmcrazed: the ldap configuration is otherwise in the same place ([ldap], i believe)16:55
*** lucasagomes has quit IRC16:55
shardydolphm, ayoung: I'm happy to help adding some during Icehouse however, if we can just raise some bugs and assign them to me?16:55
dolphmcrazed: choosing identity for ldap means that users and groups will always be pulled from ldap16:55
dolphmerr ldap for identity*16:56
*** o_petit has quit IRC16:56
*** rkukura has quit IRC16:56
crazeddolphm: but for example, how does a role get assigned if it exists in mysql?16:56
dolphmcrazed: the assignment is persisted in sql16:56
dolphmcrazed: as is the role definition16:57
*** eglynn has quit IRC16:58
crazeddolphm: well for example, does it use the ldap DN for the user_id in the mysql tables or?16:58
dolphmcrazed: that's configurable via [ldap] user_id_attribute16:59
*** chenxu has joined #openstack-dev16:59
crazedah17:00
*** Max__ has quit IRC17:00
dolphmcrazed: i don't think dn is the default, but we had a discussion recently that dn would be a more logical, useful default17:00
crazedokay17:00
*** emagana has joined #openstack-dev17:00
dolphmcrazed: (i think it defaults to cn)17:00
crazedyeah i have it set to uid17:00
dolphmcrazed: which may not play well in multi-domain deploys17:00
*** davidhadas has quit IRC17:00
crazedthis is single domain so that's okay17:00
*** mlavalle has quit IRC17:01
*** Ryan_Lane has quit IRC17:01
*** davidhadas has joined #openstack-dev17:01
*** JonnyNomad has quit IRC17:02
ayoungshardy, I've been in meetings...it must be Tuesday17:02
*** DennyZhang has quit IRC17:02
*** danwent has quit IRC17:02
crazeddolphm: so the keystoneclient does not have group commands or am i just running older version of the client17:03
ayoungdolphm, I had a lot of people push back against the DN as the userID attribute.  I think that will be a major discussion topic at the Summit17:03
*** xga_ has quit IRC17:03
*** mosulica has quit IRC17:04
dolphmcrazed: the keystoneclient library supports groups, but they're exposed on the CLI in python-openstackclient17:04
*** alunch_ has joined #openstack-dev17:04
ayoungcrazed, soundsl ike you are using LDAP.  I assume that you wnt LDAP in read-only mode?17:04
*** alunch has quit IRC17:04
*** alunch_ is now known as alunch17:04
dolphmayoung: interesting, what's the big reason why?17:04
ayoungdolphm, if it is read write, he can do the whole thing in LDAP...CERN wants to keep doing that17:05
*** afazekas_no_irq has quit IRC17:05
ayoungdolphm, but the majority wants LDAP read only, and I assume crazed wants that as well17:05
Javinbnemec: I can't reporeduce the issue you had yesterday with https://review.openstack.org/#/c/48386/17:05
dolphmayoung: my bad, i was referring to "why not DN?"17:06
ayoungdolphm, Ah...well, one rason they gave was that it was possible that an organization might reorgainzae and the DNs change.  that would break everything external17:06
crazedayoung: dolphm, I want ldap read/write for things like groups17:06
*** fbo is now known as fbo_away17:06
Javinbnemec: Without creating 2 interfaces with the same IP by hand. I'm not sure that is a valid configuration. Maybe just detecting that and producing a valid error is the right approach here?17:07
ayoungbut bascially, it is an implementation detail, and not necessarily something that should be tightly linked to keystone17:07
ayoungcrazed, that is fine...read/write works well17:07
crazedyeah i think i just figured it out17:07
*** danwent has joined #openstack-dev17:07
ayoungcrazed, so you have to chse whether to put the assignemtn s (roles, projects) in LDAP as well.  Users and Groups are in the Identity backend, and that is expected to be LDAP17:07
crazedthis makes sense17:07
bnemecJavin: That sounds reasonable.  I really don't know much about how this networking stuff works, so my setup may just be wrong. :-)17:07
bnemec(although it does seem to work fine)17:08
crazedayoung: i like roles,projects in mysql personally17:08
*** aditirav has quit IRC17:08
*** reed has joined #openstack-dev17:08
crazedespecially when i see things like "LDAP backend is being deprecated" in the code haha17:08
crazedfor the assignment backend at least17:08
ayoungcrazed, then explicitly set the assignments backend to SQL17:08
ayoungcrazed, yeah, but that is no longer true17:08
ayoungcrazed, we had a pretty big deployment come back and say "don't deprecate this"17:09
crazedah17:09
Javinbnemec: Take a look at http://openstack.redhat.com/Neutron_with_existing_external_network I think this is what you likely are trying to do. The real interface (em1) has no bootproto and doesn't get an IP, instead the normal IP is applied to br-ex (but I'm also a bit new at all of this)17:09
*** Dr_Who has joined #openstack-dev17:09
*** Dr_Who has joined #openstack-dev17:09
ayoungcrazed, their argument was that LDAP was the only thing that covered their scale, and they were OK with it being single domain17:09
crazedmy project/role size will always be fairly small17:10
Javinbnemec: Anyhow, I'll add a simple test there for 2 IPs and re-submit the change17:10
bnemecJavin: Yeah, that's how I configured this, but somehow em1 ended up with an IP too.  I have no idea how because I didn't do it intentionally.17:10
bnemecSounds good.17:10
ayoungshardy, can you talk  https://review.openstack.org/#/c/48462/  for a minute?17:11
*** cdub_ has quit IRC17:11
shardyayoung: definitely :)17:11
shardyayoung: I had a look at the tempest tests, and the problem is we need the v3 test support (to create the trust) before we can add the v2 consuming trust test17:12
crazedayoung: dolphm, thanks for talking over the ldap stuff with me, i think ldap for identity and mysql for assignment is what we want17:12
ayoungshardy, here's what I would like to see:  in the review, it needs to give a step by step how to test  it that someone else can reproduce17:12
shardyayoung: as mentioned, there's no coverage of trusts at all atm, which obviously would be good to fix :)17:12
ayoungshardy, code would be ideal17:13
ayoungshardy, there is unit test coverage, though17:13
ayoungshardy, trusts are tested inside of the keystone project, but we can't do that with the keystone client...until the keystone client itslef is commited17:13
shardyayoung: Ok, I can easily create a minimal reproducer and push it to a gist17:13
ayoungshardy, that would be a great first step17:13
*** chenxu has quit IRC17:13
dolphmcrazed: glad to help!17:14
shardyayoung: The code does work, and has been verified as working by those testing the heat change which requires it17:14
ayoungshardy, beyond that, we should push a test to tempest that exercises the client  trust functios,  same as that script.17:14
shardyayoung: As I said, I think we need the trusts v3 coverage first17:14
*** gyee has quit IRC17:14
shardyso the auth functions become trust aware and you can generate the trust_id to consume17:15
*** djoreilly has quit IRC17:15
ayoungshardy, I am working on moving some of the other Keystone tests into Tempest as well, especially the client tests.  As far as the Trust API goes, those are tested here...17:15
*** tellesnobrega has joined #openstack-dev17:15
tellesnobregadolphm: hey17:15
shardyayoung: I am happy to help with all of that, just during Icehouse rather than right now with the RC looming ;)17:16
*** AnilV4 has quit IRC17:16
ayounghttps://github.com/openstack/keystone/blob/master/keystone/tests/test_v3_auth.py#L179117:16
tellesnobregadolphm: i would like to ask you some questions about the bug https://bugs.launchpad.net/keystone/+bug/122091317:16
uvirtbotLaunchpad bug 1220913 in keystone "bp split-identity left unfinished" [Wishlist,Triaged]17:16
*** SumitNaiksatam has joined #openstack-dev17:16
*** networkstatic has joined #openstack-dev17:16
ayoungshardy, understood, but from a Keystone  perspective we would rather say no to a feature than have it in untested and broken.17:17
ayoungand there is a real risk of that17:17
ayoungso lets fill in the gaps17:17
shardyayoung: but you have no test coverage of any of the trusts feature in tempest?17:17
*** gyee has joined #openstack-dev17:17
*** dsantos_ is now known as demontiesantos17:17
dolphmtellesnobrega: o/17:17
shardyayoung: this is not a feature, it's just adding an interface to something which is already there, so tbh, I'm confused17:17
dolphmtellesnobrega: feel free to ask the channel, btw -- there's several people here familiar with the work17:18
ayoungshardy, the problem with the client is that it can't be tested in Keystone.  Trusts are tested in Keystone itself, against a live server17:18
tellesnobregadolphm: i started working on it, but there are some stuff that i didnt understand17:18
ayoungshardy, you are adding to the python library that is the primary interface into Keystone.  It is so a feature17:18
shardyayoung: https://github.com/openstack/keystone/blob/master/keystone/tests/test_auth.py#L58717:18
tellesnobregai changend the get_project_by_user and all worked nicelly, ran the tests and nothing broke17:19
ayoungshardy, we have keystoneclient tests in Keystone proper, (not test_auth.py)  but those are there for a different reason.  Those are there to make sure that Keystone doens't change away and break the client.  We can't do that, though, for a new function in the client17:20
ayoungits a chicken /egg thing..and Tempest is the solution17:20
ayoungbut the test doesn't need to be accepted into tempest to make me happy, just have it submitted17:20
shardyayoung: so basically you're saying we shouldn't have merged any of the keystoneclient trusts support due to lack of tempest coverage?17:21
shardynobody ever expressed that requirement to me during the review cycle17:21
ayoungshardy, yiou could, in theory, write an extension to the keystoneclient tests in the Keystone repo.  But that would not get accepted into Keystone at this late a date17:21
ayoungshardy, no no no17:21
ayoungI'm saying "Write me a test"17:21
ayoungI'm giving you the tools to do it17:21
*** sandywalsh has quit IRC17:23
ayounghttps://review.openstack.org/#/c/48462/1/keystoneclient/tests/v2_0/test_auth.py  just says that the code does what you think it should17:23
ayoungand that is what a unit test should be doing17:23
ayoungbut we need a functional test.17:23
ayoungIt doesn't need to be complete in order to pass that review, but I need to see that it is underway17:23
shardyayoung: can you clarify what the difference is between the test_token_from_trust* unit tests in test_auth and the test you previously linked?17:24
shardyhttps://github.com/openstack/keystone/blob/master/keystone/tests/test_auth.py#L75817:24
shardyAFAICS there is test coverage inside keystone, just not in tempest, which is the same as all of the trusts functionality17:24
ayoungshardy, yeah..one goes against a live server.  all of the test_v3 calls go through the whole wsgi stack17:25
shardyayoung: Ok, thanks, that's the detail I was missing17:25
*** mmagr has quit IRC17:25
ayoungshardy, yeah...understand, that much of the code in Keystone predates Tempest.  It wasn't possible to have an external test when test_keystoneclient.py was written17:26
ayoungshardy, so what I want to have is a way to test trusts from client to server...end to end integration.17:26
*** dperaza has joined #openstack-dev17:27
*** carl_baldwin has quit IRC17:27
shardyayoung: +1, we've invested a lot of time integrating Heat with trusts and I absolutely want us to ensure they're as well tested as possible17:28
shardyayoung: equally, I'd rather not have Havana Heat trusts functionality totally broken :(17:28
shardyayoung: I'll go back to looking at tempest, thanks17:28
*** prad has joined #openstack-dev17:29
*** jmontemayor has quit IRC17:29
*** jmontemayor has joined #openstack-dev17:29
*** Farooque has joined #openstack-dev17:29
dperazaLooking for oslo cores to help me figure out if going on right direction here: https://review.openstack.org/#/c/4873317:29
dperazais this the right channel for this?17:30
*** rkukura has joined #openstack-dev17:30
*** Farooque has left #openstack-dev17:31
*** nati_ueno has joined #openstack-dev17:33
shardyayoung: gist example https://gist.github.com/hardys/6435299#file-trust_pw_test_v2-py17:34
*** mrunge has quit IRC17:35
*** corXi has quit IRC17:37
bnemecdperaza: I'm not a database expert, but I don't see any major issues with that (other than the fact that it's failing all the tests ;-).17:37
ayoungshardy, um...getting redirecto login issues...let me try again, but can you fpaste that as well?17:38
offenfliegdoes anyone know if there is a list of supported s3 api commands for swift3 anywhere?17:38
*** nermina has joined #openstack-dev17:38
*** chenxu has joined #openstack-dev17:39
dperazabnemec yeah need this guy merged: https://review.openstack.org/#/c/4874517:39
*** sandywalsh has joined #openstack-dev17:39
dperazathen the theory is they all should pass17:39
ayoungshardy, ah, got it, thanks17:39
bnemecdperaza: Okay, sounds good.17:40
ayoungshardy, that will do, that will do very nicely.  dkranz how do we turn this https://gist.github.com/hardys/6435299#file-trust_pw_test_v2-py into a tempest test?17:41
*** martines has quit IRC17:42
*** neelashah has quit IRC17:42
bnemecLots of angry unicorns at Github today...17:42
*** nplanel has joined #openstack-dev17:42
ayoungbnemec, yeah...where's the Red Bull when you need him?17:43
*** sandywalsh has quit IRC17:43
bnemecayoung: :-)17:43
*** jmontemayor has quit IRC17:45
shardyayoung: similar example using curl not keystoneclient http://paste.fedoraproject.org/43444/49537138/17:46
*** Dr_Who has quit IRC17:46
*** amcrn has joined #openstack-dev17:47
dkranzayoung: Let me take a look...17:47
shardydkranz, ayoung: fpaste version of python example since github seems to be having some issues: http://paste.fedoraproject.org/43445/3806497117:49
dkranzayoung: I can't load that link. I think there is something wrong with github17:49
dkranzshardy: OK :)17:49
dkranzayoung: Is this supposed to be an api test or scenario?17:50
ayoungdkranz, keystone client tests cases...I'll fpaste the code17:50
*** rkukura has quit IRC17:51
dkranzayoung: Oh, ok.17:51
*** dstanek_ has joined #openstack-dev17:51
*** chenxu has quit IRC17:51
ayoungdkranz, shardy http://fpaste.org/43446/80649966/17:53
ayoungugly, but you should get the idea.  dkranz github is cranky today17:53
*** dstanek has quit IRC17:53
*** dstanek_ is now known as dstanek17:54
*** DinaBelova has quit IRC17:55
*** garyk has joined #openstack-dev17:56
shardydkranz, ayoung: I can obviously create some cleaner versions of that test code, just need a few pointers on the steps required to create the tempest test (and how to test it locally)17:56
*** tvb|afk has joined #openstack-dev17:57
dkranzshardy: I'm looking at it now and will put some ideas in a paste17:57
*** danwent has quit IRC17:57
shardydkranz: thanks!17:57
dkranzshardy: Should be straightforward17:57
*** chenxu has joined #openstack-dev17:58
*** topol has joined #openstack-dev17:58
ayoungThanks, guys.. shardy give me a ping when you have something to show...doesn't have to be perfect, but submit it as a review to Tempest as a WIP17:58
shardyayoung: Ok, will do, thanks!17:59
*** carl_baldwin has joined #openstack-dev17:59
*** Mandell has quit IRC17:59
*** chuckieb has joined #openstack-dev17:59
dkranzshardy: So this test is a little funky because it is creating lots of clients with different arguments.17:59
dkranzshardy: The place to start is with OfficialClientTest18:00
dkranzshardy: This instantiates many of the python clients and authenticates with the credentials in tempest.conf18:01
dkranzBut your subclass can make new clients as well18:01
*** jmontemayor has joined #openstack-dev18:01
*** neelashah has joined #openstack-dev18:01
tellesnobregacan anyone help me understand how the test workflow works, some tests are breaking but i dont understand how it gets to the things i changed18:02
*** chuckieb|2 has joined #openstack-dev18:02
*** fandikurnia01 has quit IRC18:02
dkranzshardy: If this is a prototype for more keystone tests I would put it in a client_lib/keystone dir parallel to scenario and cli18:02
*** isd has joined #openstack-dev18:03
shardydkranz: Ok, got it, thanks very much for the info! :)18:03
*** sarob has joined #openstack-dev18:03
dkranzshardy: If this moves forward we will want to move that scenario/manager.py file to official_client/manager.py or something18:04
*** DinaBelova has joined #openstack-dev18:04
dkranzshardy: Let me know if you need any other help.18:04
shardydkranz: are there any docs which describe how to run local tempest tests, prior to submitting them for review?18:04
*** chuckieb has quit IRC18:05
dkranzshardy: There are README files in tempest18:05
dkranzshardy: Are you going to run with local devstack?18:05
shardydkranz: yes, unless you suggest some other method18:06
*** danwent has joined #openstack-dev18:06
dkranzshardy: No. If you use devstack it installs and configures tempest18:06
*** Mandell has joined #openstack-dev18:06
shardydkranz: Ok, thanks for all the help, much appreciated18:07
dkranzshardy: THen you can do 'testr run tempest.your.module.here'18:07
dkranzshardy: Or you can use nose18:07
shardydkranz: awesome, I'll give it a try, thanks!18:08
dkranzshardy: You can also look at tox.ini for more ways to run and with better output if you are using testr18:08
dkranzshardy: Good luck18:08
*** networkstatic has quit IRC18:08
isdHey everybody, I'm about to try to get my feet wet with the openstack codebase, so I set up devstack and it seems to work - but it isn't clear to me where I'm supposed to find the sources that devstack is using, or more generally how to go about development. Am I missing something obvious?18:08
dkranzshardy: I would like to improve the README if you have any issues.18:09
*** shinylasers has joined #openstack-dev18:09
tellesnobregadolphm: can you help me understand how the test workflow works, some tests are breaking but i dont understand how it gets to the things i changed18:10
*** MaxV has joined #openstack-dev18:10
*** FatDarrel has quit IRC18:10
shardydkranz: Ok, np, I'll send some doc patches if I hit anything that's not documented18:10
*** gyee has quit IRC18:11
*** ericw has quit IRC18:11
mroddenbnemec: https://review.openstack.org/#/c/49230/18:12
mroddenit needs a test case ( think luis is gonna work on that ) and i need to bug out for a bit to grab food since i haven't had a chance to do that yet today...18:13
bnemecmrodden: Bah, eating. :-)18:13
bnemecdhellmann: ^ FYI18:13
dhellmannbnemec: thanks18:14
dhellmannmrodden: I'm taking a look now18:14
mroddenk18:14
*** MaxV has quit IRC18:14
*** gyee has joined #openstack-dev18:15
*** chuckieb has joined #openstack-dev18:16
*** alunch_ has joined #openstack-dev18:17
*** alunch has quit IRC18:18
*** alunch_ is now known as alunch18:18
*** davidhadas has quit IRC18:20
*** chuckieb|2 has quit IRC18:20
*** adjohn has joined #openstack-dev18:22
*** chenxu has quit IRC18:24
*** carl_baldwin has quit IRC18:26
*** adjohn has quit IRC18:27
isdAh nevermind, found stuff in /opt/stack.18:27
*** Lumiere has quit IRC18:27
*** cjellick has quit IRC18:28
*** rnirmal has joined #openstack-dev18:31
*** Lumiere has joined #openstack-dev18:31
*** novas0x2a|laptop has joined #openstack-dev18:31
*** chuckieb has quit IRC18:32
*** carl_baldwin has joined #openstack-dev18:34
*** mjb_ has joined #openstack-dev18:38
*** Ryan_Lane has joined #openstack-dev18:40
*** otherwiseguy has quit IRC18:43
*** DinaBelova has quit IRC18:44
*** jmontemayor has quit IRC18:47
*** neelashah has quit IRC18:47
*** cdub_ has joined #openstack-dev18:50
*** mlavalle has joined #openstack-dev18:51
*** neelashah has joined #openstack-dev18:51
*** avishay has quit IRC18:51
*** jmontemayor has joined #openstack-dev18:53
*** thingee_zzz is now known as thingee18:54
*** egallen has quit IRC18:55
*** Javin has quit IRC18:57
*** derekh has joined #openstack-dev18:58
*** pixelb has quit IRC18:59
ayounggyee, jamielennox it just means we use a consistent term.  External auth means authentication external to those methods controlled by Keystone itself.  REMOTE_USER  is the mechanism19:00
gyeejamielennox, ayoung, my patch is backward compatible btw19:00
gyeethat admin_token_auth_method is optional19:00
jamielennoxgyee: it's not backwards compatibility i'm worried about, it's forwards19:01
morganfainberghenrynash, are we planning on cleaning up the grant tables in Icehouse?19:01
jamielennoxgyee: if we can get keystoneclient into auth_token where it belongs i've no idea how to support that19:01
gyeeand its forward compatible too19:01
jamielennoxgyee: :)19:01
henrynashmorganfainberg: yep!19:01
morganfainberghenrynash, if so, i'll be coordinating to get caching enabled after that.19:01
morganfainberghenrynash, awesome.19:01
*** nachi1 has joined #openstack-dev19:01
henrynashhave bp arelady assigned to me!19:01
*** markwash has quit IRC19:01
ayounggyee, INstead of None, make it "external" and I think I can give my blessing, but I am a littel concerned about testing.  I'd like to have test cases for it submitted to tempest.  We can't put client tests in either keystone or keystone client .19:01
morganfainberghenrynash, nice, more caching! the behind-the-scenes interactions made it hard to cache.19:02
thingeesdague: ping19:02
gyeeayoung, sure, I can change it to external19:02
morganfainbergok, i'm going to go grab food.  back later today.19:02
gyeenot sure about the testing part though19:02
ayoungjamielennox, actually, it should probably be "token_request_auth_method" and not "admin..." and then the same option would bne useable from auth_token middleware and from CLI19:02
sdaguethingee: pong19:02
ayounggyee, also drop the admin from it19:02
ayoungit should be the token_request_auth_methdo19:03
gyeeayoung, sure19:03
ayoungjamielennox, does that make sense?19:03
gyeeayoung, service_token_request_auth_method?19:03
gyeeits really a service token19:03
gyeetechnically19:03
thingeesdague: wrt https://review.openstack.org/#/c/43045/2 I was following what nova has done to set a default version from line 8119:03
ayoungWhat we are specifying is how to authenticate when a particular client makes a request for a token19:03
*** otherwiseguy has joined #openstack-dev19:03
ayounggyee, just token_request_auth_method19:04
jamielennoxgyee: drop request19:04
ayoungtoken_auth_method?19:04
jamielennoxayoung: gyee's is better - token_request is confusing19:04
gyeebut that's really a service token, used to validate user tokens19:04
ayounggyee, in this case, yes, but the config option is more general19:04
jamielennoxservice_token_auth_method19:04
*** chenxu has joined #openstack-dev19:04
gyeejamielennox, we have a winner!19:05
ayoungjamielennox, why not make it general purpose19:05
ayounggyee, not yet you don't19:05
gyeedamn19:05
*** melwitt has joined #openstack-dev19:05
jamielennoxmmm, still not a fan of the approach, just giving out a config name19:05
jamielennoxayoung: because you need to distinguish between a validation token and a user token19:05
ayoungjamielennox, we need a way to tell the client which auth method to use when getting a token.19:05
jamielennoxand they don't necessarily want to authenticate in the same way19:05
sdaguethingee: so if that's not set that way.... how does nova decide what version of cinder client to use?19:06
ayoungjamielennox, no...because auth_token middleware is never going to get any other token19:06
gyeeayoung, you have a point there19:06
jamielennoxayoung: sure, but if you put a config option in auth_token that says token_request_method you are going to confuse people19:06
ayoungjamielennox, but, even if it did, why not use the same method?  Unless we do "token for a token"  we should specify, generically, "client use auth method X"  and we can be consistent with how we specify it19:06
ayoungjamielennox, how about just auth_method?19:07
jgriffiththingee: o/19:07
ayoungauthentication_method, really19:07
thingeesdague: v1 and v2 are available by default in devstack's keystone catalog. nova just needs to import the version they need from the client.19:07
thingeesdague: https://review.openstack.org/#/c/40446/19:07
gyeeayoung, auth_method then19:07
*** chenxu has quit IRC19:07
gyeeshort, and sweet19:07
jamielennoxok, auth_method19:07
ayounggyee, how about authn_method?  TO clarify it is for "who are you?" and not "what can you do?"19:08
sdaguethingee: ok, I was trying to understand gate implications19:08
gyeeayoung, now you're making me work19:08
jamielennoxayoung: the auth_ prefix is common enough19:08
ayounggyee, "...make one mistake and support it for the rest of your life."19:08
thingeesdague: gotcha. yeah other projects won't notice unless they specifically use it.19:08
jamielennoxauthn is technically more correct but i don't think anyone cares19:08
ayoungjamielennox, I know, but auth is genrally understaood to mean both authN and AuthZ.  AuthZ is token.  We really mean just authN19:09
gyeeayoung, nah, we'll deprecate in one release cycle :)19:09
ayoungI care.19:09
sdaguehonestly, right now with so many other things in flight I'd rather just let things sit until Havana releases. Can we pick it up again there?19:09
mroddendhellmann: so i found a bug i think19:09
jamielennoxknew i phrased that wrong19:09
thingeesdague: absolutely19:09
ayounggyee, no, I bet you that if we get this right, we won't have to.19:09
mroddenwhile re-writing the message adapter to wrap context adapter19:09
thingeesdague: I was just about to recommend that due to me being slow on getting back to ya19:09
sdaguethingee: cool, I'll promiss to give it more thought post release19:09
sdagueyeh, no worries19:09
mroddenmany other functions are looking at ContextAdapters self.logger property and expecting it to be an actual logger19:09
gyeeayoung, jamielennox, I am fine with either auth_method or authn_method19:10
mroddenthat doesnt work if i wrap an adapter in another adapter19:10
ayoungyou guys cool with authn_method, with an undertanding that we will extend this to be a general purpose config option for the clients?19:10
lbragstadalexpilotti: would you have a minute to discuss https://github.com/openstack/nova/commit/8f28ddd13a91eb25f0f2f3a312068223500ded97#diff-e3f97ae27f34d8632013e768c4bb652cR10119:10
ayoungextend in Icehouse, that is19:10
thingeesdague: marked wip19:10
jamielennoxgyee: ok, from the assumption that I can get keysonteclient into auth_token soon, how do we work with this auth_method?19:10
*** davidhadas has joined #openstack-dev19:10
gyeeayoung, +19:10
gyeejamielennox, load the auth plugin base on method name19:11
gyeesame way we does it on the server side19:11
alexpilottilbragstad: sude19:11
jamielennoxi can see if we have it set to 'password' then i need to look for user/pass from config and use that19:11
alexpilottiaka sure :-)19:11
*** DinaBelova has joined #openstack-dev19:11
gyeejamielennox, just password the conf object into the plugin19:12
jamielennoxgyee: ok - in which case 'external' is out19:12
gyeeplugin will look for the stuff it needs19:12
lbragstadalexpilotti: awesome! I just noticed that a check was added in the case of a compute node not having the image being launch, so it reads the headers of the file to determine the file type and then based on that returns the extention19:12
lbragstadlaunched*19:12
*** martines has joined #openstack-dev19:13
*** galstrom is now known as galstrom_zzz19:13
*** briancurtin has quit IRC19:13
mroddenbnemec: around?19:13
lbragstadso this now requires hyper-v to only use images with vhdxfile or conectix as the header of the image file19:13
bnemecmrodden: Yes19:14
jamielennoxgyee: actually whatever - i can make external work  as a plugin, it's just a noop plugin i just need to change my plugin architecture a little19:14
mroddenbnemec: running into issues with having one adapter wrap another19:14
mroddenbnemec: seems that some of the code in log.py is looking at the self.logger attribute of the adapter19:15
jamielennoxgyee: fine, auth_method = 'plugin' or 'external' and extend it later, i'll support it19:15
mroddenand expecting it to be an actual logger19:15
*** briancurtin has joined #openstack-dev19:15
mroddeni think i might have accidentally trained my brain to write IRC messages less than 80 chars now19:15
mrodden:(19:15
bnemecHeh19:15
*** troytoman is now known as troytoman-away19:15
bnemecSo this is an issue regardless of which adapter is wrapping the other?19:16
datsun180bthere are worse vices19:16
*** sgordon_ has quit IRC19:16
gyeejamielennox, cool, will make the changes19:16
mroddenbnemec: yeah19:16
*** dvarga has quit IRC19:16
jamielennoxgyee: technically we should have a 'token' option to which is what is used when you provide an auth_token19:16
mroddenbnemec: i *could* change the faulty code, but i don't know if that is the only code expecting the first inner .logger attribute to be a real logger19:16
*** eglynn has joined #openstack-dev19:16
mroddenso back to the inheritance thing19:17
jamielennoxgyee: ah, admin_token19:17
lbragstadalexpilotti: I have a .vhd that is returning something different when reading the beginning of the image file and I am hitting the HyperVException(_('Unsupported virtual disk format')). The image is originally transferred to the compute node becuase it is not found in the cache, but it is removed shortly after since the check fails, and Hyper-V cleans up the image. https://github.com/openstack/nova/blob/master/nova/virt/hyperv/vhdutils.py#L18219:17
gyeeright19:17
mroddeni reversed the inheritance, because it seems to make more sense tohave MessageAdapter extend ContextAdapter19:17
mroddenand just wrap ContextAdapter.process in MessageAdapter.process19:17
alexpilottilbragstad: interesting19:17
mroddenbusy channel today19:18
alexpilottilbragstad: can you send me what you have as a header?19:18
bnemecmrodden: Oh, so there's an alternative?19:18
lbragstadalexpilotti: yep19:18
bnemecI seem to have missed some discussion here.19:18
lbragstadlet me grab a pastebin19:18
alexpilottilbragstad: how did you generate the file?19:18
lbragstadgenereate the .vhd?19:18
mroddenbnemec: did you see dhellmann's comment about not doing inheritance19:18
mrodden?19:18
mroddenthat works19:18
alexpilottilbragstad: yes19:18
mroddenits just not... pretty19:18
bnemecI must not have.19:18
mroddenit makes sense IMO19:19
mroddenhttps://review.openstack.org/#/c/49230/1/openstack/common/log.py19:19
mroddenbnemec: ^19:19
*** locke1051 has joined #openstack-dev19:19
mroddenwell that way was kind of wonky19:19
mroddenMessageAdapter inherits from ContextAdapter now19:19
lbragstadalexpilotti: it was an existing .vhd that was being used, some rhel vhd I believ e19:19
*** rkukura has joined #openstack-dev19:19
*** nermina has quit IRC19:19
ayoungdripton, question for you.  I need to make a call to a third party service upon nova servce.create call...prior to actually creating a VM.  What is hte mechanism I need?19:19
mroddeni'll push up what i have19:20
ayoungI don't want this to be user-data19:20
driptonayoung: I'm not sure offhand.  Let me look19:20
*** VeggieMeat_ has joined #openstack-dev19:20
alexpilottilbragstad: ok, with the first 8 bytes "magic number" I should be able to do some research19:20
ayoungas I need to be able to do it from the Webui without user generating a custom user-data doc19:20
lbragstadalexpilotti: so, compute nodes that have the image cached can launch it if the scheduler assigns to those compute nodes. For other nodes however, it copies and then fails the detection19:20
*** rkukura has left #openstack-dev19:20
ayoungdripton, thanks.  dansmith ^^ same question to you in case you know the answer19:21
alexpilottilbragstad: the check is performed when the image is downloaded from Glance19:21
alexpilottilbragstad: so if you had it cached before upgrading the Nova code19:21
*** annegentle_ has joined #openstack-dev19:21
lbragstadalexpilotti: yep, right after the image.fetch19:21
bnemecmrodden: Yeah, I suppose the alternative would be to write a third Adapter that basically just calls the other two, but I don't know that there's any benefit to doing it that way over inheritance.19:21
*** jyhc_ has joined #openstack-dev19:22
alexpilottilbragstad: it'll not check it again19:22
mroddenbnemec: yeah19:22
*** jeevan_u1las has joined #openstack-dev19:22
dansmithayoung: not sure what you mean.. when we call to glance or cinder we use their client.. more context?19:22
*** jeblair_ has joined #openstack-dev19:22
*** iamben_t1 has joined #openstack-dev19:22
*** ivoks_ has joined #openstack-dev19:22
*** jrwren_ has joined #openstack-dev19:22
bnemecmrodden: Other than maybe code reuse, I suppose.19:22
*** sc68cal_ has joined #openstack-dev19:22
bnemecThat way both classes would be usable without the other.19:22
*** pmcg_ has joined #openstack-dev19:22
*** fbo has joined #openstack-dev19:23
bnemecGiven that context is pretty specific to OpenStack, I'm not sure that's a major consideration though.19:23
lbragstadalexpilotti: right, because we only grab the image from glance if the vhd_path is none, https://github.com/openstack/nova/blob/master/nova/virt/hyperv/imagecache.py#L11919:23
lbragstadalexpilotti: http://paste.openstack.org/show/47785/19:23
*** bcwaldon_ has joined #openstack-dev19:24
*** wink_ has joined #openstack-dev19:24
alexpilottilbragstad: unfortunately we need a way to be sure that people don't try to boot invalid images19:24
*** gyee has quit IRC19:24
*** jeblair has quit IRC19:24
*** DinaBelova has quit IRC19:24
alexpilottilbragstad: you can imagine how many people ask for support just to discover that they tray to boot Qcow2 or AMI images ;-)19:24
*** rgoodwin_ has joined #openstack-dev19:24
alexpilottilbragstad: so we need a way to validate them before19:24
*** jeblair_ is now known as jeblair19:24
*** vladan- has joined #openstack-dev19:24
driptonayoung: almost all of the service.create calls in nova are for glance.   I don't see any general way to hook them for a third-party service.19:25
*** GheRiver1 has joined #openstack-dev19:25
alexpilottilbragstad: if the magic number is not consistent, we need obviously to resort to another "heuristic"19:25
*** sgordon has joined #openstack-dev19:25
*** ttx` has joined #openstack-dev19:25
*** sgordon has quit IRC19:25
*** sgordon has joined #openstack-dev19:25
*** sgran_ has joined #openstack-dev19:26
alexpilottilbragstad: so far all the VHDs that we tested were fine, including using qemu-img convert19:26
*** CJM has joined #openstack-dev19:26
*** adam_g` has joined #openstack-dev19:26
*** CJM is now known as Guest6230919:26
*** rosmaita_ has joined #openstack-dev19:26
ayoungdansmith, we want to register the host with FreeIPA before booting the VM.19:26
mroddenbnemec: yeah its still re-usable,19:26
lbragstadalexpilotti: I tried doing the same thing to the original image before uploading it to glance and the result is the same. So I am going to need new images?19:27
*** dabo has joined #openstack-dev19:27
mroddenand even if it needs refactoring later, thats something for later19:27
*** zaitcev has quit IRC19:27
*** sc68cal has quit IRC19:27
*** mmoya has quit IRC19:27
*** locke105 has quit IRC19:27
*** wolfdreamer has quit IRC19:27
*** adam_g has quit IRC19:27
*** annegentle has quit IRC19:27
*** phschwartz has quit IRC19:27
*** edleafe has quit IRC19:27
*** GheRivero has quit IRC19:27
*** oubiwann has quit IRC19:27
*** bcwaldon has quit IRC19:27
*** rosmaita has quit IRC19:27
*** sgran has quit IRC19:27
*** galstrom_zzz has quit IRC19:27
*** iamben_tw has quit IRC19:27
*** troytoman-away has quit IRC19:27
*** pmcg has quit IRC19:27
*** rods` has quit IRC19:27
*** wink has quit IRC19:27
*** jdurgin1 has quit IRC19:27
*** markvoelker has quit IRC19:27
*** xBytez has quit IRC19:27
*** rackerjoe has quit IRC19:27
*** rgoodwin has quit IRC19:27
*** fbo_away has quit IRC19:27
*** dtroyer has quit IRC19:27
*** jkoelker has quit IRC19:27
*** sudorandom has quit IRC19:27
*** CrackerJackMack has quit IRC19:27
*** EmilienM has quit IRC19:27
*** vegarl has quit IRC19:27
*** Anticimex has quit IRC19:27
*** jrwren has quit IRC19:27
*** Guest58099 has quit IRC19:27
*** VeggieMeat has quit IRC19:27
*** jeevan_ullas has quit IRC19:27
*** ttx has quit IRC19:27
*** Adri2000 has quit IRC19:27
*** vladan has quit IRC19:27
*** jyhc has quit IRC19:27
*** ondergetekende has quit IRC19:27
*** ivoks has quit IRC19:27
*** vladan- is now known as vladan19:27
alexpilottilbragstad: head -c 8 yourdisk.vhd should do the trick to get the value19:27
ayoungdripton,  dansmith I can do it from the command line http://adam.younglogic.com/2013/09/register-vm-freeipa/19:27
*** rgoodwin_ is now known as rgoodwin19:27
alexpilotti19:27
*** phschwartz has joined #openstack-dev19:27
*** davidhadas has quit IRC19:27
dansmithayoung: does that really belong in nova? seems like not, to me19:27
alexpilottilbragstad: a dirty trick is to simply replace the first 8 bytes ;-)19:27
*** DinaBelova has joined #openstack-dev19:28
*** davidhadas has joined #openstack-dev19:28
ayoungdripton, dansmith it is custom integration, but, yes, it need to be in Nova19:28
*** ttx` is now known as ttx19:28
*** adam_g` is now known as adam_g19:28
alexpilottilbragstad: as soon as I see what you have I'm taking a look 19:28
bnemecmrodden: Yeah, works for me.  We'll see what dhellmann thinks I guess.19:28
*** ttx has quit IRC19:28
*** ttx has joined #openstack-dev19:28
mroddenk19:28
*** rackerjoe has joined #openstack-dev19:28
dhellmannI'm looking now, but also have a local conversation going on so it may be a few minutes19:28
*** oubiwann has joined #openstack-dev19:28
mroddenk19:28
*** galstrom_zzz has joined #openstack-dev19:28
*** galstrom_zzz is now known as galstrom19:28
*** oubiwann is now known as Guest4960019:29
mroddenstill needs a test case too... which i'm working on19:29
*** nachi1 has left #openstack-dev19:29
*** sudorandom has joined #openstack-dev19:29
*** leif has joined #openstack-dev19:29
*** nermina has joined #openstack-dev19:29
ayoungdansmith, it is an integration point, not something everyone one would need, but for people that are Using IPA, they need to autoregister the hosts.  You can do it with user-data, but that requires end user particiapltion, not automated19:29
*** leif is now known as Guest4460019:29
*** rods` has joined #openstack-dev19:29
ayoungdansmith, it belongs in nova to the same degree that putting an SSH key on the vm belongs in nova19:29
ayoungFreeIPA gets you kerberos and SSO19:29
dansmithayoung: end user, or the thing automating your deployments?19:29
dansmithayoung: are you injecting something into the instance that you get from FreeIPA?19:30
*** EmilienM has joined #openstack-dev19:30
ayoungdansmith, well, I would want it kicked off when the user created a new VM either via the command line or Horizon19:30
lbragstadhead -c 8 images/RHEL-6.4-X86-64.vhd -> �H��м19:30
ayoungdansmith, freeipa is not creating instnaces19:30
*** rkukura has joined #openstack-dev19:30
ayoungYou create the entriies in LDAP in FreeIPA19:30
lbragstadalexpilotti: ^^19:30
ayoungand get an OTP for registring the VMs19:30
ayoungone time password19:30
alexpilottilbragstad: hmmm19:31
ayoungso, at that point, yes, you are injecting something into the VM19:31
alexpilottilbragstad: it definitely does not look right :-)19:31
*** Guest62309 is now known as crackerjackmack19:31
lbragstadalexpilotti: lol yeah I didn't think so either19:31
*** dtroyer has joined #openstack-dev19:31
dansmithayoung: what specifically gets injected into the instance?19:31
alexpilottilbragstad: I suppose that you have access to a machine with Hyper-V19:31
lbragstadalexpilotti: yes sir19:31
ayoungdansmith, the One time password...short phrase used to confirm the registration of the instance19:32
alexpilottilbragstad: can you issue in Powershell: Get-VHD RHEL-6.4-X86-64.vhd19:32
alexpilotti?19:32
lbragstadalexpilotti: yep, let me hop on quick19:32
alexpilottilbragstad: this will return details about the image19:32
alexpilottilbragstad: or an error if it's not valid19:32
ayoungso create a host in FreeIPA with the option that saysd "freeIPA generates the OTP"  then take that OTP and pass it to the instance which calls ipa-client-install with the OTP as a parameter,19:32
dansmithayoung: well, you could propose an integration blueprint if you want, but IMHO, that belongs a layer up19:33
*** Javin has joined #openstack-dev19:33
ayoungdansmith, other Identity systems are going to have to do something comparable.  So, while I am solving a specific issue for FreeIPA integration, it will be a general approach for other integration19:33
ayoungdansmith, I thought there might be something already19:33
dansmithayoung: not that I know of19:33
*** FatDarrel has joined #openstack-dev19:33
dansmithayoung: other than file injection19:33
ayoungdansmith, yeah, this is something that would have to happen before File injection.  You want a trusted user to create the host record and pass off the OTP to the instance.19:34
ayoungonly the OTP could be handled via file injection19:34
*** ondergetekende has joined #openstack-dev19:34
dansmithayoung: before file injection? I'm confused19:35
*** vipul is now known as vipul-away19:35
*** davidhadas has quit IRC19:35
*** troytoman-away has joined #openstack-dev19:36
*** jrwren_ has quit IRC19:36
ayoungdripton, , where would a hook go in Nova to perform an operation comparable to the glance calls?19:36
*** dstanek has quit IRC19:36
*** davidhadas has joined #openstack-dev19:36
dhellmannmrodden: replied on the review19:37
*** Ryan_Lane has quit IRC19:37
*** sc68cal_ has quit IRC19:37
*** shinylasers has quit IRC19:37
ayoungdansmith, yeah, I need to create the file before injecting it into the instance.  The file is going to be specific to the instance19:37
ayoungdifferent for every vm,19:37
dansmithayoung: ...right19:37
driptonayoung: I don't see an obvious place.  We have nova.conductor.service_create but it's basically just a shim around nova.db.service_create, not really a good place to add more code.19:37
driptonayoung: I think we might want another API call rather than trying to shoehorn it in.19:38
dansmithdripton: service_create has nothing to do with instance creation, which is what he's concerned with, right?19:38
mroddendhellmann: yeah i suppose that works19:38
ayoungyes, it is instance creation19:38
*** FatDarrel_ has joined #openstack-dev19:38
*** FatDarrel has quit IRC19:38
*** FatDarrel_ is now known as FatDarrel19:38
dhellmannmrodden: you could also make a "multi-adapter" class that gets one of each of the others, but that feels a little over-engineered at this point19:39
driptonayoung dansmith: you want to register something that will run at later instance creation right?  Not attach it to an individual instance creation because then it's "too late"?19:39
*** metral has quit IRC19:39
ayoungdripton, actually, run it before instance creation19:39
driptonayoung: right s/at/just before/19:40
ayoungdripton, the order is:  ipa.host_create, nova.service.create19:40
ayounger make that19:40
ayoungnova.servers.create19:40
dansmith(which is why it should be done by something else, IMHO)19:40
*** yolanda has quit IRC19:40
dansmithwell, one of the reasons19:40
ayoungwhat is     @hooks.add_hook("create_instance")19:41
dansmithit registers a hook so you can run custom code before or after that19:41
ayoungdansmith, that sounds like what I am looking for19:41
dansmithayoung: for wedging in some really fragile out-of-tree code? yes :)19:42
*** jrwren has joined #openstack-dev19:42
*** sc68cal has joined #openstack-dev19:42
ayoungdansmith, that is exactly what I am trying to do.19:42
driptonayoung: what if it fails?19:42
ayoungat least, for Proof-of-concept19:43
ayoungdripton, the VM doesn't get regiwstered, and we can tear it down19:43
ayoungdansmith, out-of-tree, certainly19:43
*** metral has joined #openstack-dev19:43
ayounghopefully not-too-fragile19:43
*** metral has quit IRC19:43
dansmithayoung: next time you want help with something horrific, prefix with "out of tree" and I'll be much more helpful :P19:44
ayoungdansmith, why is that horrific?  What side effects should I be aware of?19:45
*** davidhadas has quit IRC19:45
*** davidhadas has joined #openstack-dev19:45
dansmithayoung: I should have s/horrific/proof-of-concept/, but I meant "jamming in an external service integration to the create process", which is what it sounds like you're looking to do, at least at the moment19:46
ayoungdansmith, yeah, but people need this kind of integration in their deployments.  I'm trying to figure out how to do it right..ad also how to do it right now if r"right" ain't available.19:49
*** metral has joined #openstack-dev19:49
ayoungdansmith, so, if I called a relatively slow process in that hook, would it tie up the whole API server?19:49
dansmithayoung: heh19:50
jamielennoxayoung: when you have a moment can you approve: https://review.openstack.org/#/c/44843/ it's basic and its up to 7 +1s19:50
*** alunch has quit IRC19:51
dansmithayoung: it would hang up one of the workers, yeah19:51
*** alunch has joined #openstack-dev19:52
*** Mandell has quit IRC19:53
*** emagana has quit IRC19:54
ayoungjamielennox, lookinfg now19:54
*** Mandell has joined #openstack-dev19:54
ayoungdansmith, so, how should long running tasks that need to happen in sequence be handled?19:55
dansmithayoung: in compute/manager19:55
ayoungjamielennox, done19:56
ayoungdansmith, ok let me look19:56
*** boris-42 has quit IRC19:58
*** dstanek has joined #openstack-dev19:58
*** boris-42 has joined #openstack-dev19:59
*** drewlander has quit IRC19:59
*** tellesnobrega has quit IRC19:59
ekarlsodolphm: / ayoung is there any guide for doing AD and keystone ?20:00
mroddendhellmann: so i see some problems with this approach again...20:00
*** stevemar has joined #openstack-dev20:00
mroddenContextAdapter is a public API that many methods expect to be available20:01
mroddenso it either has to be the outer Adapter20:01
*** markwash has joined #openstack-dev20:01
ayoungekarlso, you mean beyond the LDAP guide?20:01
*** vkmc has joined #openstack-dev20:01
*** vkmc has quit IRC20:01
*** vkmc has joined #openstack-dev20:01
ekarlsoayoung: where's that ? :)20:01
mroddenor i can extend it so everything falls through to ContextAdapter when my MessageAdapter doesn't provide all that API20:01
dolphmekarlso: this is certainly out of date, but worked once upon a time https://gist.github.com/dolph/548948520:01
*** DinaBelova has quit IRC20:01
*** venkatesh has joined #openstack-dev20:02
*** thingee is now known as thingee_zzz20:02
ayoungekarlso, in the docs subdir of keystone there is configuration.rst.20:02
ayoungThere is a section in there about LDAP20:02
*** gabrielhurley has joined #openstack-dev20:02
ekarlsowhat information is stored in LDAP20:03
ayounghttps://github.com/openstack/keystone/blob/master/doc/source/configuration.rst20:03
ayoungekarlso, https://github.com/openstack/keystone/blob/master/doc/source/configuration.rst#configuring-the-ldap-identity-provider20:03
*** eglynn has quit IRC20:03
*** otherwiseguy has quit IRC20:04
dhellmannmrodden: :-|20:04
dhellmannmrodden: what is using ContextAdapter directly?20:04
*** MaxV has joined #openstack-dev20:04
*** vegarl has joined #openstack-dev20:05
*** jdurgin1 has joined #openstack-dev20:05
*** Anticimex has joined #openstack-dev20:05
mroddendhellmann: everything from what i can tell20:05
mroddenits literally a front end that gets handed out with getLogger20:05
*** jvrbanac has quit IRC20:05
dhellmannbut everything should just be treating it like a logger, right?20:05
mroddentheoretically yes20:05
*** vipul-away is now known as vipul20:05
dhellmannmrodden: can you link me to an example use that's causing concern?20:06
*** tanisdl has joined #openstack-dev20:06
mroddenthe deprecated method20:06
*** enikanorov-w has quit IRC20:06
mroddendhellmann:  https://github.com/openstack/nova/blob/master/nova/openstack/common/log.py#L24420:07
mroddenonly had the nova one handy20:07
dhellmannah20:07
*** derekh has quit IRC20:07
mroddenthere is also the handlers property20:07
dhellmannso we've added new public methods that we pretend are part of the logger20:07
mroddenyeah20:07
dhellmannok20:08
*** enikanorov-w has joined #openstack-dev20:08
mroddenso that must be the outer adapter or i need to extend it20:08
*** rnirmal has quit IRC20:08
mroddenouter adapter would require me to change the process function20:08
mroddenwhich i dont really like that idea20:08
mroddentrying not to touch code that works20:08
*** wolfdreamer has joined #openstack-dev20:08
mroddenis known to work20:08
dhellmannmrodden: agreed20:09
* dhellmann thinks20:09
dhellmannok, it seems reasonable to me to have ContextAdapter do something like if not isinstance(msg, basestring): msg = unicode(msg)20:10
mroddenok20:10
mroddenso just add it there?20:10
dhellmannthat does 2 things: it doesn't tie ContextAdapter to Message, but it ensures that we're always going to pass unicode down into the logging module20:10
dhellmannyeah20:10
* bnemec catches up20:10
dhellmannwith a big comment explaining why :-)20:10
mroddenyeah lol20:10
mroddenextending would probably still be my preferred option20:10
mroddensince we are only replacing the process function with a wrapper essentially20:11
dhellmannmrodden: adding to the class hierarchy just feels like the "hard way" in this case20:11
mroddenyeah20:11
mroddenthere's already a couple layers in that file already20:11
dhellmannfwiw, it looks like that deprecated() method should go in BaseLoggerAdapter20:12
mroddendhellmann: yeah i think a lot of that could be moved up20:13
dhellmannif you did that, it would be safe to use composition instead of inheritance20:13
dhellmannyeah, the handlers() method, too20:13
dhellmanndoes anything else subclass BaseLoggerAdapter, though?20:14
mroddenlazylogger20:14
mroddensorry20:14
mroddenlazyadapter20:14
*** carl_baldwin has quit IRC20:14
dhellmannthere's no docstring on that class, what is it for?20:14
mroddenits passed back in getLazyLogger20:14
dhellmannand would it be a mistake for it to have those methods that we're talking about moving20:15
mroddenwhich then i think dynamically swaps out for contextadapter20:15
dhellmannoh, that's the thing where we don't create the loggers until they are being used20:16
mroddenyeah20:16
dhellmannok, so that shouldn't cause any trouble20:16
*** eharney has quit IRC20:16
mroddenhow about i fix the problem at hand first20:16
mroddenand we refactor later20:16
mroddenseems like that needs to happen anyways20:17
dhellmannmrodden: fair enough; let's just do the 2 line change in place, then20:17
*** carl_baldwin has joined #openstack-dev20:18
*** nachi has joined #openstack-dev20:19
mroddenyep20:19
mroddengot tests too...20:19
*** stevemar has quit IRC20:19
*** dmakogon_ has joined #openstack-dev20:20
dhellmannmrodden: cool20:20
*** johnthetubaguy has quit IRC20:20
*** otherwiseguy has joined #openstack-dev20:22
*** jkoelker has joined #openstack-dev20:24
*** vipul is now known as vipul-away20:24
*** vipul-away is now known as vipul20:25
*** f13o_ has joined #openstack-dev20:25
*** devoid has left #openstack-dev20:26
*** boden has quit IRC20:27
*** tmclaugh[work] has quit IRC20:27
*** angdraug has quit IRC20:28
*** dolphm has quit IRC20:28
*** angdraug has joined #openstack-dev20:29
*** tmclaugh[work] has joined #openstack-dev20:29
*** tvb|afk has quit IRC20:31
*** sarob has quit IRC20:31
*** sarob has joined #openstack-dev20:32
*** flaper87|afk is now known as flaper8720:32
*** angdraug has quit IRC20:36
*** gimps_ has quit IRC20:36
*** sarob has quit IRC20:36
*** mjb_ has quit IRC20:37
*** Ryan_Lane has joined #openstack-dev20:38
*** emagana has joined #openstack-dev20:40
*** thomasm has quit IRC20:40
*** venkatesh has quit IRC20:44
*** neoXsys has quit IRC20:44
*** angdraug has joined #openstack-dev20:45
*** thingee_zzz is now known as thingee20:47
*** cjellick has joined #openstack-dev20:47
bigmstoneBobBall: working with Havana now. Same error message as with grizzly.20:48
*** gyee has joined #openstack-dev20:50
*** markvoelker has joined #openstack-dev20:51
*** dabo has quit IRC20:51
*** angdraug has quit IRC20:51
*** sarob has joined #openstack-dev20:52
*** eharney has joined #openstack-dev20:53
*** edleafe has joined #openstack-dev20:54
*** demontiesantos has quit IRC20:55
*** termie has joined #openstack-dev20:55
*** termie has quit IRC20:55
*** termie has joined #openstack-dev20:55
mroddendhellmann, bnemec: got another patchset ready https://review.openstack.org/#/c/49230/320:56
*** Ryan_Lane has quit IRC20:56
*** angdraug has joined #openstack-dev20:57
*** donaldh has joined #openstack-dev20:59
*** thomasm has joined #openstack-dev21:02
*** harlowja has quit IRC21:02
*** eglynn has joined #openstack-dev21:03
*** darren0 has left #openstack-dev21:05
*** rfolco has quit IRC21:06
*** dolphm has joined #openstack-dev21:06
*** nermina has quit IRC21:08
*** gyee has quit IRC21:08
*** gyee has joined #openstack-dev21:11
*** sgran_ is now known as sgran21:11
*** eglynn has quit IRC21:12
*** sushils has quit IRC21:12
*** nermina has joined #openstack-dev21:13
*** martyntaylor has quit IRC21:16
*** egallen has joined #openstack-dev21:16
dhellmannmrodden, bnemec: are you going to be online much longer?21:19
mroddenprobably until the issue gets resolved...21:19
bnemecdhellmann: I should be around for a while21:19
*** jcoufal has joined #openstack-dev21:19
*** vladikr has quit IRC21:19
dhellmannttx would like us to start patching the other projects to disable the lazy translation stuff asap21:19
dhellmannI'm about to get in the car for a rather long commute, so I was hoping you would have time to help out21:20
*** jbresnah has joined #openstack-dev21:20
ttxdhellmann: or find volunteers to do that for you :)21:21
dimsdhellmann, mrodden - what needs to be done? i can pitch in21:21
bnemecdhellmann: Yeah, I can help with that.21:21
mroddenits a piece of cake really21:21
mroddenlazy=False21:21
mroddenwe made it easy to enable/disable21:21
*** jpich has quit IRC21:22
dhellmannwe also need to remove calls to gettestutils.enable_lazy()21:22
*** neelashah has quit IRC21:22
dhellmannmarkmc found a few of those this morning21:22
dimsbnemec, mrodden - you know where to find me if you guys need backup :)21:22
mroddenyeah21:22
*** venkatesh has joined #openstack-dev21:22
dhellmanndims, cool, thanks21:22
bnemecThanks dims21:22
dhellmannlet's start with an etherpad to list all of them, so we don't miss any21:22
mroddenk21:22
dhellmannthen we can tag team through the list21:22
mroddenwho's working on that?21:23
ttxdhellmann: jd__ willdo the ceilo one with your guidance21:23
dhellmannttx, ok good21:23
dhellmannmrodden: I'll create the etherpad, just a sec21:24
mroddenk21:24
*** zaitcev has joined #openstack-dev21:24
dhellmannhttps://etherpad.openstack.org/disable-lazy-translation21:24
dhellmannnow to grep...21:24
* dhellmann waits for his repos to update21:24
*** henrynash has quit IRC21:25
*** ayoung has quit IRC21:25
bnemecSo I'm looking at heat, and so far I only see changes to the files in bin/.21:27
bnemecDoes that sound reasonable?21:27
*** Adri2000 has joined #openstack-dev21:27
mroddenyeah21:28
mroddennova is in cmd/__init__21:28
mroddenthey are all at the main entry points21:28
mrodden(working on nova)21:28
bnemecOkay, I thought so, but figured I'd make sure.21:28
*** nermina has quit IRC21:30
*** vkmc has quit IRC21:30
*** flaper87 is now known as flaper87|afk21:30
*** radez is now known as radez_g0n321:31
dhellmannok, I think that may cover it21:32
*** eglynn has joined #openstack-dev21:32
dhellmannI used ack to search the openstack and stackforge repos21:33
*** dkranz has quit IRC21:33
bnemecdhellmann: Okay, I've done heat, mrodden was working on nova.21:34
dhellmannI'll look at cinder21:34
*** Javin has quit IRC21:35
bnemecHeh, of course I picked a project I don't have installed on this VM. :-)21:35
dhellmannif someone already has a patch up, let us know what change-id so we can all use the same one21:36
bnemecI haven't pushed anything yet.  Running tests just to sanity check.21:36
mroddenyeah unfortunately the tests were enabled as well21:36
dhellmannyeah21:36
dhellmannadd skips?21:37
mroddenthey shouldn't affect too much but yeah21:37
mroddensome might fail21:37
dhellmannor wait, are they testing the lazy translation itself or just turning them on21:37
dolphmmarkwash: glance's version bump just failed :-/21:37
mroddenwe can just skip21:37
dolphmmarkwash: https://jenkins01.openstack.org/job/gate-tempest-devstack-vm-postgres-full/16428/console21:37
*** isd has quit IRC21:38
markwashd'oh!21:38
bnemecdhellmann: mrodden: You know, it might be okay to leave lazy enabled for tests.21:38
bnemecAs long as they're passing it won't hurt anything.21:38
bnemecThe concern is unexpected unicode, which won't happen in unit tests.21:39
dhellmannbnemec: good point21:40
mroddenyeah21:40
mroddenthat is true21:40
*** FatDarrel has quit IRC21:40
*** salv-orlando has quit IRC21:41
bnemecOkay, about to push Ia934a7df9386baf6ae8eb9ff48c24386c47ecd2321:42
*** harlowja has joined #openstack-dev21:42
luisgbnemec, so we are turning off the t18n :(21:42
bnemecmrodden: dhellmann: Pushed ^21:43
*** changbl has quit IRC21:43
bnemecluisg: Afraid so.21:43
luisgdhellmann, what did u think of mrodden latest patch for the issue21:43
dhellmannluisg: I need to look again21:44
dhellmannbnemec: thanks21:44
dhellmannI added that changeset to the top of the etherpad for easy reference21:44
bnemecdhellmann: Cool, thanks.21:45
*** alunduil has joined #openstack-dev21:46
luisgdhellmann, i thought since the patch fixes the issue we were going to leave t18n on21:47
luisgand there are not really other issues with non-logging aspects of the class21:47
bnemecHuh, I think ceilometer was enabling this twice.21:48
*** Javin has joined #openstack-dev21:48
mroddenwhops21:48
bnemecThat's icky.21:48
dhellmannluisg: we either need to disable it, or get the new change to the logging adapter merged into all of the projects21:48
bnemecThey did install('ceilometer', True) without the lazy=.21:48
luisgdhellmann, i think we can do that, try to get those changes in across, instead of disabling21:48
luisgor we can disablet the ones that won't take the logger fix only21:49
mroddeni would actually be in favor of that... but i think ttx made up his mind?21:49
dhellmannluisg: let me look at the mrodden's change21:49
luisgdhellmann, k thx21:49
mroddenbnemec: totally borrowing your commit message :)21:50
bnemecmrodden: Then I demand co-author credit. :-P21:51
luisgha21:51
mroddendoes that really count/21:52
mrodden?21:52
mrodden:P21:52
Javinbnemec: Can you take a look at the updated pack stack commit when you have some time? https://review.openstack.org/#/c/48386/21:52
dhellmannmrodden: +221:52
*** salv-orlando has joined #openstack-dev21:52
*** FatDarrel has joined #openstack-dev21:52
mroddendhellmann: thanks21:52
luisgdhellmann, thx!21:52
bnemecJavin: Yeah, I glanced at it.  I assume the new if will cause it to fail if there are multiple interfaces?21:52
bnemecWill there be a message that explains why?21:52
luisgwe can take care of propagating it21:53
luisgif it gets in21:53
bnemecCrud.  ceilometer tox env doesn't want to build.21:54
*** venkatesh_ has joined #openstack-dev21:54
*** venkatesh has quit IRC21:54
*** SergeyLukjanov has quit IRC21:54
dhellmannbnemec: have a link to your change?21:54
Javinbnemec: Yes. It will fail in the same manner as the test right below it. There isn't a custom error yet.21:55
bnemecdhellmann: The heat one?21:55
dhellmannyeah21:55
*** johnthetubaguy has joined #openstack-dev21:55
bnemecdhellmann: https://review.openstack.org/#/c/49266/21:55
*** tmclaugh[work] has quit IRC21:55
*** mlavalle has quit IRC21:56
*** romcheg has joined #openstack-dev21:56
*** neelashah has joined #openstack-dev21:56
*** romcheg1 has joined #openstack-dev21:56
luisgbnemec, so we got +2 from dhellmann, should we hold on the lazy disabling, until later if we can't actually sync it?21:56
*** romcheg has quit IRC21:56
luisgin reference to the heat patch above21:57
*** topol has quit IRC21:57
bnemecluisg: I'm not sure that's what he was +2ing...21:57
*** burt has quit IRC21:57
dhellmannluisg: I don't want to slam this in at the last minute. I really feel much more comfortable disabling the feature and being careful about re-enabling it.21:57
bnemecJavin: Okay, but the line below will print out a message that the interface wasn't found.  This one will fail silently, won't it?21:58
luisgk maybe  i missed something, so what is the plan?21:58
bnemecJavin: Wait, maybe not.21:58
bnemecToo many conversations going on at once. :-)21:58
luisg:)21:58
*** SergeyLukjanov has joined #openstack-dev21:58
*** READ10 has quit IRC21:59
luisgdhellmann, could we add a cfg flag that would enable/disable lazy21:59
*** dolphm has quit IRC21:59
*** pcm_ has quit IRC22:00
*** eglynn has quit IRC22:00
dhellmannluisg: that would be an even more complex change than this22:00
bnemecJavin: Okay, I'm just going to +1.  If the error handling isn't acceptable I'm sure one of the packstack cores will shoot it down. :-)22:00
mroddenluisg: i already had that discussion with markmc, a config option doesn't really make sense, since that is user configurable22:00
Javinbnemec: I'll test the failure message tomorrow and ensure that it passes a useful message back.22:00
dhellmannthe other thing to keep in  mind is this adapter change moves the string lookup to a point where it is done for every log message, not just for the ones that will actually be written out22:00
*** edmund has quit IRC22:01
*** edmund1 has joined #openstack-dev22:01
*** johnthetubaguy has quit IRC22:01
*** SergeyLukjanov has quit IRC22:01
Javinbnemec: Thanks22:01
bnemecJavin: Sounds good, thanks.22:01
*** thomasm has quit IRC22:01
*** venkatesh_ has quit IRC22:02
*** nati_ueno has quit IRC22:02
mroddendhellmann: disabling lazy gettext will have the same affect22:03
mroddenall string lookups will be done immediately22:03
bnemecTis true22:03
*** ifarkas has quit IRC22:04
luisgit's a shame to disable it really, from what i know customers wanted their responses translated, and tbh i think it was expected we were going to hfnid bugs, we just needed to fix them22:04
luisg:/22:04
mroddeni dont know how much of a case we have to argue anymore22:05
jgriffithdhellmann: does that apply to the test_wsgi.py or do we care (https://review.openstack.org/#/c/49275/1)22:05
mroddenits probably not fair, as i have seen other individuals/groups shove things into openstack at the last minute that are sure to be problematic22:05
dhellmannmordred: good point22:05
dhellmanner, mrodden, I mean :-)22:06
mroddenbut if ttx or the PTLs decides to remove it then we should cooperate22:06
dhellmannjgriffith: we think leaving it enabled in tests is ok22:06
jgriffithdhellmann: works for me, seems like there's some reasoning there22:06
bnemecWell, if we merge mrodden's patch tomorrow and decide it's solid enough to keep in for Havana we can always push another change.22:06
jgriffithdhellmann: thanks22:06
bnemecWe'd have to anyway.22:06
dhellmannluisg: the issue is the schedule, unfortunately :-(22:07
mroddenthats the other thing22:07
bnemecSo the disable patch would be a bit of extra churn, but othewise we're no worse off.22:07
dhellmannbnemec: right22:07
bnemec*otherwise.22:07
luisgdhellmann, understand22:07
bnemecload average: 8.78, 8.20, 5.74 <-- Outstanding.  I knew I bought that 8 core box for a reason. :-)22:08
*** rudrarugge_ has joined #openstack-dev22:08
*** jecarey_ has quit IRC22:08
*** bknudson has left #openstack-dev22:08
*** boris-42 has quit IRC22:08
*** kbringard has quit IRC22:09
*** mriedem has left #openstack-dev22:09
*** mriedem has quit IRC22:09
mroddennova tests are slow...22:09
mrodden:(22:10
bnemecmrodden: Hence the 8 core box. :-)22:10
*** rudrarugge_ is now known as rudrarugge22:11
*** comay has quit IRC22:11
*** comay has joined #openstack-dev22:11
*** rudrarugge has left #openstack-dev22:11
*** insanidade has quit IRC22:11
*** Javin has quit IRC22:12
mroddeni could probably just push the change to something internal and let my jenkins build slaves do the heavy lifting22:12
* mrodden makes a mental note to look into that22:13
bnemecHmm, apparently I don't have everything installed to run ceilometer tests.22:13
mroddenyou need mongo22:13
bnemecSo I see22:13
mroddendon't ask me why that is required for unit tests...22:13
bnemecMaybe they actually test against their production backends. :-)22:14
*** nati_ueno has joined #openstack-dev22:15
*** Reapster_ is now known as Reapster22:16
*** romcheg1 has quit IRC22:16
*** rackerjoe has quit IRC22:16
*** angdraug has quit IRC22:16
mroddenbnemec: well for an integration test that makes sense...22:17
*** angdraug has joined #openstack-dev22:17
mroddenand don't get me started on DB2 as a production backend22:17
*** rcleere has quit IRC22:17
*** michchap has quit IRC22:17
*** shinylasers has joined #openstack-dev22:17
*** ondergetekende has quit IRC22:17
*** romcheg has joined #openstack-dev22:17
bnemecmrodden: People run that in production!?22:18
bnemec:-D22:18
mroddenlol22:18
mroddenapparently...22:18
mroddendo we want to track the review URLs in the etherpad?22:18
*** michchap has joined #openstack-dev22:18
bnemecShould be able to just click on the change id for one of yours, right?22:19
*** rackerjoe has joined #openstack-dev22:19
mroddenoh right22:19
*** ondergetekende has joined #openstack-dev22:19
dhellmannmrodden, bnemec : ceilometer uses mongo for unit tests because the in-memory version we used to use didn't have some of the features of the real server22:20
*** datsun180b has quit IRC22:20
* bnemec should have let dhellmann do those changes :-)22:20
mroddendid we find anything in glance?22:20
dhellmannbnemec: or jd__ :-)22:21
dhellmannmrodden: I didn't, but please feel free to look again in case I botched the search22:21
mroddenyeah i'll check it22:21
*** bpokorny has quit IRC22:21
bnemecIn any case the ceilo change is pushed.22:22
bnemecNeutron test cases just blew up, so I need to figure out what happened there.22:22
mroddenthat one is always a pita22:22
bnemecApparently 4 GB of RAM is not enough.22:23
mroddenoh yeah22:23
mroddenyou found that too?22:23
bnemecSeems that way.22:23
bnemecI have a bunch of OSError: [Errno 12] Cannot allocate memory22:23
mroddennormally i wouldn't run into it, but our jenkins builders only have 4G without any swap since they are VMs22:23
mroddenso we hit that a lot a few weeks ago22:23
* bnemec resizes his neutron VM22:24
*** thedodd has quit IRC22:25
dhellmannI have to go sit in traffic for a bit, but I'll check the etherpad when I get home22:25
dhellmann90-120 mins22:25
bnemecdhellmann: Okay.  I will likely be somewhere else by then, but I'll try to remember to check in later tonight.22:26
*** FunnyLookinHat has quit IRC22:26
*** galstrom is now known as galstrom_zzz22:26
*** flaper87|afk is now known as flaper8722:27
mroddenlooks like glance is clean22:28
*** xqueralt has joined #openstack-dev22:29
bnemecYeah, I don't see anything either22:29
*** dstanek has quit IRC22:29
bnemecHeh, there's a change named Do Not Merge in my dash.py check list22:30
*** alunduil has quit IRC22:30
mroddentest_admin_requires_adminness - my favorite keystone test22:30
*** emagana has quit IRC22:31
bnemecA good one, that22:31
*** dstanek has joined #openstack-dev22:31
*** anniec has joined #openstack-dev22:31
*** SumitNaiksatam has quit IRC22:31
bnemecSounds like a test Joss Whedon would write. :-)22:32
*** emagana has joined #openstack-dev22:32
*** armax has quit IRC22:32
bnemecHeh, I didn't even have to review https://review.openstack.org/#/c/49230/22:33
*** markmcclain has quit IRC22:33
*** xqueralt has left #openstack-dev22:33
*** xqueralt has joined #openstack-dev22:34
mroddenwhoa22:34
*** sgordon has quit IRC22:34
mroddenbnemec: so you have an openstack running ?22:35
*** gordc has quit IRC22:36
luisgi gotta step out, bnemec and dhellmann thx for spending time on this22:36
bnemecmrodden: Yeah, I managed to get Neutron working well enough to be useful.22:37
bnemecluisg: Have a good one.22:37
luisgthx22:37
mroddenluisg: cya, thanks for the help today22:38
*** amcrn is now known as amcrn[a]22:38
mroddenbnemec: is it grizzly or master?22:38
luisgnp ty later22:38
bnemecmrodden: Packstack Havana.22:38
mroddenok22:38
mroddenhavent played with that yet22:39
bnemecFigured that's a project I'm technically kind of working on so I oughta learn about it.22:39
mroddenhah, good point22:39
*** romcheg has quit IRC22:40
* bnemec should have resized his neutron vm to have more vcpus too :-/22:40
mroddenall the cpuz22:40
lifelessall the time22:40
bnemecHeh22:41
*** markwash has quit IRC22:41
bnemecTypeError: <MagicMock name='LinuxBridgeManager().local_ip' id='204068880'> is not JSON serializable22:41
bnemecHmm.22:41
bnemecThat seems unlikely to be related to the lazy translation change.22:42
mroddenodd22:42
mroddenit might be22:42
*** gmurphy_gone is now known as gmurphy22:42
bnemecPretty sure I got that last time too, but was hoping it was related to the memory issues.22:42
mroddenif something bubbled up in an exception that tried to get serialized22:42
mroddenthere was a fix for that in jsonutils22:42
bnemecYeah, when this run finishes I'll have to take a closer look.22:43
mroddenalthough usually its a  CircularReference issue22:44
mroddenyou know what is really amazing22:45
bnemec???22:45
mroddeni set my status to "in a meeting" all day and no one has interrupted me22:45
*** nati_ueno has quit IRC22:45
bnemecI just kept dropping off the VPN.  Sadly that didn't help with community IRC. :-)22:46
mroddenheh22:46
*** vipul is now known as vipul-away22:47
*** vipul-away is now known as vipul22:47
bnemecHmm, that may not be a fatal error for the tests.22:47
bnemecIt looks like a traceback in the logging code, but there's no test to be found.22:48
bnemecIf tox would ever finish I could find out...22:48
mroddenmight be some print output from a negative test22:49
*** jimfehlig has quit IRC22:49
*** henrynash has joined #openstack-dev22:50
*** dmakogon_ has quit IRC22:50
*** dstanek has quit IRC22:52
*** sarob_ has joined #openstack-dev22:54
*** neelashah has quit IRC22:54
*** cfriesen has joined #openstack-dev22:54
*** emagana has quit IRC22:55
*** shardy is now known as shardy_afk22:55
*** emagana has joined #openstack-dev22:55
*** jmontemayor has quit IRC22:57
*** danwent has quit IRC22:58
*** sarob has quit IRC22:58
*** sarob_ has quit IRC22:59
*** cfriesen has left #openstack-dev22:59
*** SumitNaiksatam has joined #openstack-dev22:59
*** emagana has quit IRC23:00
*** sarob has joined #openstack-dev23:01
mroddenkeystone is up23:02
*** danwent has joined #openstack-dev23:03
*** pmathews has quit IRC23:04
*** samuelbercovici has joined #openstack-dev23:04
*** jcoufal has quit IRC23:05
*** sthaha has joined #openstack-dev23:06
*** nati_ueno has joined #openstack-dev23:08
*** samuelbercovici has quit IRC23:08
*** jorisroovers has quit IRC23:10
*** dims has quit IRC23:13
*** reed has quit IRC23:13
*** sarob has quit IRC23:15
bnemecHooray!  Neutron didn't fail: Ran 18504 (+11156) tests in 1695.958s (-379.421s)23:15
bnemecPASSED (id=1, skips=319)23:15
mroddenimpressive23:15
*** sarob has joined #openstack-dev23:15
mroddendown 6 minutes even23:15
mrodden:)23:15
bnemecYeah, I'm a little confused by that, but whatever.23:16
mroddenthat should be all of them then23:17
bnemecYep, it's up.23:17
*** vartom15 has joined #openstack-dev23:18
mroddenthey all look good to me23:20
mroddenheat one looks like its going to merge already23:20
*** prad has quit IRC23:22
*** vartom15 has quit IRC23:22
*** colinmcnamara has quit IRC23:23
*** alexpilotti has quit IRC23:23
* bnemec +1s all the things23:23
bnemecYeah, only 7 hours and change left before the Heat change gets through the gate. :-)23:24
mroddenlol23:24
* bnemec will not be waiting for that one23:24
mroddenyeah i had two bug fixes for API message localization that were looking promising23:24
mroddenin fact one merged today23:24
*** tanisdl has quit IRC23:25
bnemecYeah, think I saw that.23:26
mroddenthat thing failed gate like 4 or 5 times23:26
mroddenit was done last week sometime...23:26
*** dims has joined #openstack-dev23:27
*** otherwiseguy has quit IRC23:27
bnemecThat's always fun. :-)23:27
bnemecBugger, the Cinder change failed Jenkins23:28
mroddenouch23:28
mroddentimeout23:28
mroddenprobably needs a recheck23:29
*** flaper87 is now known as flaper87|afk23:30
*** ctracey has quit IRC23:31
*** medberry is now known as med_23:31
*** donaldh has quit IRC23:32
*** nachi has left #openstack-dev23:32
*** briancurtin has quit IRC23:32
*** ctracey has joined #openstack-dev23:32
*** carl_baldwin has quit IRC23:32
*** MaxV has quit IRC23:34
mroddenbnemec: http://logs.openstack.org/75/49275/1/check/check-tempest-devstack-vm-postgres-full/8ae87da/logs/screen-g-api.txt.gz?level=AUDIT23:34
mroddenhmm23:34
bnemecHuh?23:35
bnemecWe didn't even touch Glance. :-)23:35
mroddeni know23:35
mroddenthats why its weird23:35
mroddenactually its a problem with swift it seems23:35
mroddensince it was the swift backing store to glance23:35
bnemecI don't see any errors in Swift though. :-/23:37
*** anniec has quit IRC23:37
mroddenyeah23:37
mroddenthat output seems strangely clean23:37
mroddenexcept for the proxy logs complaining that a request to object containers didn't work23:37
*** vipul is now known as vipul-away23:38
mroddenmaybe have someone in infra look?23:38
*** sarob has quit IRC23:38
bnemecYeah, I was just thinking that.  The collie error looks like an issue with the VM.23:39
*** sarob has joined #openstack-dev23:39
*** edmund1 has quit IRC23:40
mroddeni thnk that is always thrown23:40
mroddenits a special backend for glance that i'm not sure is tested or not23:41
*** vipul-away is now known as vipul23:41
mroddeni dont see anything in rechecks that is similar23:41
bnemecAh, guess I've never had to look at the Glance logs.23:41
bnemecYeah, I don't either.23:41
*** AlexF has joined #openstack-dev23:42
*** sarob has quit IRC23:43
*** rfolco has joined #openstack-dev23:47
*** faramir has joined #openstack-dev23:49
*** shinylasers has quit IRC23:50
bnemecmrodden: At this point I'm thinking just open a new bug against cinder and recheck against that.23:51
bnemecI don't know which service is at fault here, so we'll start with the one whose tests failed. :-)23:51
*** DennyZhang has joined #openstack-dev23:52
*** nati_ueno has quit IRC23:54
mroddensure23:54
mroddenlaunchpad bugs are easy to move later23:55
bnemecYeah, that's my thought, and they'll probably have a better idea what's going on.23:55
bnemecI'm completely lost. :-)23:55
mroddenyeah it goes from cinder to glance to swift23:56
*** rfolco has quit IRC23:56
*** adjohn has joined #openstack-dev23:56
mroddeni have to step away for awhile to do non-computer related thing23:56
mroddens23:56
*** anniec has joined #openstack-dev23:56
bnemecYeah, I'll get this rechecked and then I'm probably done for the night.23:56
*** henrynash has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!