Tuesday, 2012-02-07

*** littleidea has quit IRC00:01
*** zzed has quit IRC00:04
*** PotHix has quit IRC00:11
*** PotHix has joined #openstack-dev00:13
*** bengrue has quit IRC00:13
*** littleidea has joined #openstack-dev00:13
*** torgomatic has quit IRC00:13
*** Mandell has quit IRC00:14
*** justinsb has quit IRC00:14
*** justinsb has joined #openstack-dev00:14
*** torgomatic has joined #openstack-dev00:15
*** littleidea has quit IRC00:16
*** dtroyer has quit IRC00:17
*** bengrue has joined #openstack-dev00:17
*** littleidea has joined #openstack-dev00:18
mtaylortermie: hey! jeblair_ is on a plane flying back in and should be avail again in the morning ... is it ok to wait until then? or I should I go try to commando something?00:20
termiemtaylor: commando-ing would be pretty great if you can because we'd like to see if this gets it working before vish leaves00:23
termiehe's helping getting devstack stuff working since he knows it the best00:23
termieall these things that took my hours on friday have taken him like 15 mins00:24
termieand once it is owrking we can do our dev on gerrit (yay?) instead of girhub00:24
mtaylorawesome. okie, I'll go commando right now00:24
mtaylortermie: you expect 9dadf0162448151aaa769f2ef5555e36616b4b7d to be the tip revision in keystone now, yeah?00:27
termie....00:30
termietermie/keystonelight master00:30
termieis the tip for master00:30
termiein keystonelight00:30
mtaylork. just making sure I was grabbing the right thing00:30
mtaylor(and sorry, I meant in keystone redux)00:30
termieyeah, i'd like that to be redux also00:31
mtaylortermie: ok. gerrit should have termie/keystonelight/master as keystone/redux and cloudbuilders/devstack/ksl as devstack/redux00:35
termieawesommes00:35
*** torgomatic has quit IRC00:36
termieso... can i trigger a build manually somehow or should i make a small change and try to merge?00:36
mtaylorI was just about to send you a small change :)00:36
mtaylortermie: https://review.openstack.org/#change,383200:37
*** torgomatic has joined #openstack-dev00:37
*** PotHix has quit IRC00:38
jdgAnybody here have knowledge around how/where disks are added to libvirt.xml?00:40
jdgI'm interested in working on Bug: 884984, but need some education.  :)00:41
*** misheska has joined #openstack-dev00:41
mtaylortermie: ok, _something_ ran: ./stack.sh: line 656: cd: /opt/stack/python-keystoneclient: No such file or directory00:42
termieoh00:42
termiehey i have change for that ;)00:42
termieit never pushed it because iw as using gerrit00:42
termieso i can test it as my small change00:43
mtaylorw00t!00:44
mikaljdg: I haven't read the bug, but you want nova/virt/libvirt/connection.py almost certainly00:47
jdgmikal:  So I'm considering Vishy's suggestion of sorting the device paths for a short term fix.  Trying to figure out exactly where/when these are written.00:47
mikal_create_image in connection.py is where to start reading...00:48
termiebuild successful, heyooo00:48
jdg:)  see it.. thank you!00:48
mikalNP00:48
*** Mandell has joined #openstack-dev00:49
termiemtaylor: just saying "approve" again on your change should trigger another jenkins run, yea?00:52
termiethe devstack change landed successfully00:52
termieoh darn, this is the pstats error00:53
*** jakedahn has quit IRC00:54
termiedarn, without a solution to this python-profiler bug it looks like i am going to shred this library00:54
mtaylortermie: what's the python-profiler bug?00:55
mtaylortermie: I saw mention of it but haven't fully followed00:55
termiemtaylor: python-profiler doesn't install on oneiric00:55
mtaylorat all? GREAT00:55
termiemtaylor: it has some weird dependency problem that doesn't make a bunch of sense00:56
termiemtaylor: we can force install it with dpkg but it then makes future apt calls broken00:56
mtayloryup. looking at that right now. this is fun00:56
mtaylortermie: well - shall we make a non-broken package?00:56
termiemtaylor: if that is a possible solution, i don't know what the lead time on that is00:57
termieit may already be fixed?00:57
termieand just not in the repos00:57
termies/repos/apt repos00:57
mtaylorwell, here's the main issue:00:58
mtaylorpython2.7 : Conflicts: python-profiler (<= 2.7.1-2)00:58
termiehttp://pastebin.com/tsVKNdhk00:58
termiewith the info00:59
termiethat is the output from trying to install on the main system00:59
mtayloryup. that's what I got - I tried to force the issue slightly and got the info that python2.7 added a conflict on python-profiler00:59
mtaylortrying to track down why00:59
termiewell, pstats is a stdlib package, that got split out into this01:00
termietheoretically due to licensing01:00
termieone guess would be that they put it back in01:00
termieand therefore it conflicts01:00
termiebut at the same time, it can't find it01:00
termiepossible pstats did not get added back but one of the other profile.py files did01:01
*** torgomatic has quit IRC01:02
mtaylortermie: import pstats works on my oneiric system without installing anything01:02
*** bencherian has quit IRC01:02
mtaylorok. but not on the slaves. fascinating. how is it on my machine?01:04
termiemtaylor: https://jenkins.openstack.org/job/gate-keystone-unittests/372/console01:04
*** bencherian has joined #openstack-dev01:04
termierighto01:04
*** nati2 has joined #openstack-dev01:07
mtaylortermie: ok. SO - we have it on the oneiric builders, but not on the natty builders (we're just about done moving all of the slaves to be oneiric - I just swapped the keystone job over - checking to see if that makes it better)01:08
*** j05h has quit IRC01:08
mtaylortermie: awesome. https://jenkins.openstack.org/job/gate-keystone-unittests/374/console - much better01:09
*** j05h has joined #openstack-dev01:10
*** dolphm has joined #openstack-dev01:10
mtaylortermie: I'll finish the slave transition tomorrow- it's been lingering way too long01:10
*** bencherian has quit IRC01:12
*** jog0 has quit IRC01:13
*** jog0 has joined #openstack-dev01:13
mtaylorI have no solution for natty though01:14
andrewsmedinaany horizon developer here?01:16
*** dwalleck has quit IRC01:18
*** jdg has quit IRC01:20
termiecool, so we just need novaclient for the tests, or novaclient removed keystone or something01:27
termiemtaylor: thanks :)01:27
openstackgerritVerification of a change to openstack/nova failed: Implements blueprint heterogeneous-tilera-architecture-support  https://review.openstack.org/140201:28
*** maplebed has quit IRC01:32
termieyeah, looks like novaclient changed something01:34
termiemy code to pull new changes appears to not be the brightetst01:34
*** martine has joined #openstack-dev01:35
termiehrm, what did i do wrong... i cloned the keystonelight repo from gerrit, switched to the redux branch and tried to run git review -s01:42
termiebut it can't figure stuff out, and when i manually addedd git remote add gerrit git+ssh://termie@review.openstack.org/p/openstack/keystone i get a :hooks/commit-msg error01:43
termieoh maybe needs a port01:43
termiei'll make it look more like the gerritworkflow and try agian01:44
termieProblems encountered installing commit-msg hook01:44
termiecp: :hooks/commit-msg: No such file or directory01:44
ayoung   termie OK,  I've hacked the Fakeldap into KSL so that it returns the values that the test require,  but I'm a little unclear on the format.  The Keystone Heavy code is obtuse,  and the KSL code is a little light....01:46
ayoungit is basically a thin wrapper around a Dictionary, right?01:47
*** spiffxp has quit IRC01:50
termiemtaylor: http://pastebin.com/CGnNYm8R01:53
*** mnewby has quit IRC01:57
*** ohnoimdead has quit IRC02:00
*** Gordonz has joined #openstack-dev02:02
*** misheska has quit IRC02:06
*** HugoKuo_ has joined #openstack-dev02:07
*** Mandell has quit IRC02:08
*** HugoKuo__ has quit IRC02:10
*** misheska has joined #openstack-dev02:11
termieayoung: if you point me at code somewhere i can take a look tomorrow02:14
termieayoung: we are now green on jenkins and gerrit though02:15
termieso, woohoo02:15
termiewe are now condemned to jenkins's iron fist02:15
ayoungtermie, nice work02:15
ayoungtermie, my code is a lot of trial and error.  Not sure I feel comfortable showing it to anyone just yet :)02:17
termieayoung: i'll help, upload it somewhere and point me at it02:18
termietalking in abstract is hard02:18
openstackgerritVerification of a change to openstack/keystone failed: Fix a thinko: throwing away self.auth_xxxxx  https://review.openstack.org/379302:19
ayoungtermie, yeah.  I think the problem is that the code I need is in the sql directories.  Stuff for munging what codes back from the LDAP calls to the API  expected by Keystone02:19
ayoungtermie, I can commit what I have to my local git and post a patch.02:19
ayoungtermie, has redux been updated?  I was working on top of that02:21
ayoungok looks like it has.. I need to rebase.  one sec02:21
*** pyhole has quit IRC02:24
*** pyhole has joined #openstack-dev02:26
ayoungtermie, http://admiyo.fedorapeople.org/keystone-admiyo-0000-LDAP-code-trial-and-Error.patch02:26
ayoungtermie, specifically, I was working on the authenticate method.  Which calls the get_user,  and I need to figure out what to return from get_user02:28
*** stuntmachine has quit IRC02:29
*** littleidea has quit IRC02:38
*** spiffxp has joined #openstack-dev02:38
zaitcevTrying to figure out if a transient failure https://jenkins.openstack.org/job/gate-keystone-unittests/377/console02:38
*** ayoung has quit IRC02:39
*** dubsquared has quit IRC02:44
*** littleidea has joined #openstack-dev02:44
*** jdurgin has quit IRC03:04
*** jog0 has left #openstack-dev03:05
*** jog0_ has joined #openstack-dev03:06
*** novas0x2a|laptop has quit IRC03:07
*** Mandell has joined #openstack-dev03:10
*** jog0_ has quit IRC03:10
*** bsza has quit IRC03:10
*** maplebed has joined #openstack-dev03:22
*** littleidea has quit IRC03:26
*** littleidea has joined #openstack-dev03:27
*** gyee has quit IRC03:30
*** AlanClark has quit IRC03:33
*** AlanClark has joined #openstack-dev03:33
*** nati2_ has joined #openstack-dev03:36
*** adjohn has quit IRC03:38
*** nati2 has quit IRC03:38
*** dwalleck has joined #openstack-dev03:40
*** AlanClark has quit IRC03:47
*** Transformer has joined #openstack-dev03:47
*** dwalleck has quit IRC03:56
*** spiffxp has quit IRC03:57
*** deshantm has quit IRC04:03
*** novas0x2a|laptop has joined #openstack-dev04:05
*** Gordonz has quit IRC04:08
*** danwent has quit IRC04:09
*** shevek_ has quit IRC04:10
*** shevek_rs has quit IRC04:11
*** littleidea has quit IRC04:22
*** littleidea has joined #openstack-dev04:25
*** spiffxp has joined #openstack-dev04:31
*** misheska has quit IRC04:32
*** mjfork has quit IRC04:39
*** littleidea has quit IRC04:40
*** littleidea has joined #openstack-dev04:41
*** eglynn_ has joined #openstack-dev04:41
*** eglynn has quit IRC04:45
*** danwent has joined #openstack-dev04:54
*** spiffxp has quit IRC04:59
*** littleidea has quit IRC05:05
*** littleidea has joined #openstack-dev05:06
*** Yak-n-Yeti has quit IRC05:13
*** dolphm has quit IRC05:15
*** littleidea has quit IRC05:18
*** littleidea has joined #openstack-dev05:19
*** dolphm_ has joined #openstack-dev05:22
*** martine has quit IRC05:23
*** dolphm_ has quit IRC05:27
*** novas0x2a|laptop has quit IRC05:28
*** novas0x2a|laptop has joined #openstack-dev05:29
*** dolphm has joined #openstack-dev05:29
*** elasticdog has quit IRC05:37
*** elasticdog has joined #openstack-dev05:38
*** dolphm has quit IRC05:38
mtaylortermie: ah- I think we have an unreleased fix for the commit-msg thing in trunk of git-review ... lemme re-release05:58
mtaylortermie: fyi - you can always append -v to git review and it will tell you the git commands it's running (or trying to run in case of errors)05:59
*** Mandell has quit IRC06:08
*** hugokuo has joined #openstack-dev06:15
*** rajaram has joined #openstack-dev06:15
*** HugoKuo_ has quit IRC06:16
*** HugoKuo_ has joined #openstack-dev06:20
*** hugokuo has quit IRC06:20
*** mikal has quit IRC06:28
*** HugoKuo_ has quit IRC06:34
*** hugokuo has joined #openstack-dev06:37
*** mikal has joined #openstack-dev06:38
*** Mandell has joined #openstack-dev06:41
*** n0ano has joined #openstack-dev06:54
*** nati2 has joined #openstack-dev07:17
*** nati2_ has quit IRC07:20
*** novas0x2a|laptop has quit IRC07:24
*** novas0x2a|laptop has joined #openstack-dev07:35
*** nati2 has quit IRC07:39
*** adjohn has joined #openstack-dev07:55
*** littleidea has quit IRC08:05
*** reidrac has joined #openstack-dev08:10
*** shevek_ has joined #openstack-dev08:25
*** hugokuo has quit IRC08:26
*** hugokuo has joined #openstack-dev08:26
*** justinsb has quit IRC08:30
*** hashar has joined #openstack-dev08:42
*** bepernoot has joined #openstack-dev08:50
*** hashar has quit IRC08:53
*** hashar has joined #openstack-dev08:53
*** danwent_ has joined #openstack-dev08:56
*** danwent has quit IRC08:56
*** danwent_ is now known as danwent08:56
*** derekh has joined #openstack-dev09:02
*** darraghb has joined #openstack-dev09:05
*** oneiroi has joined #openstack-dev09:19
*** novas0x2a|laptop has quit IRC09:24
*** darraghb has quit IRC09:26
*** Remco_ has joined #openstack-dev09:35
*** pixelbeat has joined #openstack-dev09:41
*** Remco_ has quit IRC09:52
*** apevec has joined #openstack-dev09:54
*** hugokuo has quit IRC10:03
*** adjohn has quit IRC10:06
*** adjohn has joined #openstack-dev10:06
*** adjohn has quit IRC10:07
*** maplebed has quit IRC10:12
*** rajaram1 has joined #openstack-dev10:36
*** rajaram has quit IRC10:38
*** markmc has joined #openstack-dev10:46
*** Remco_ has joined #openstack-dev11:02
*** PaulMachTech has joined #openstack-dev11:02
*** PaulMachTech_ has joined #openstack-dev11:05
*** PaulMachTech has left #openstack-dev11:07
*** jeremy_ has joined #openstack-dev11:07
*** jeremy_ has joined #openstack-dev11:07
*** jeremy has quit IRC11:10
*** jeremy_ is now known as jeremy11:10
*** PaulMachTech__ has joined #openstack-dev11:17
*** ches- has quit IRC11:26
*** ches has joined #openstack-dev11:26
*** PaulMachTech__ has left #openstack-dev11:27
*** PaulMachTech_ has left #openstack-dev11:28
*** mjfork has joined #openstack-dev11:43
*** jeremy_ has joined #openstack-dev11:43
*** jeremy has quit IRC11:44
*** jeremy_ is now known as jeremy11:44
*** Remco_ has quit IRC11:48
*** andrewsmedina has quit IRC11:54
*** hashar has quit IRC12:11
*** rajaram has joined #openstack-dev12:15
*** rajaram1 has quit IRC12:17
*** lts has joined #openstack-dev12:21
*** bsza has joined #openstack-dev12:23
*** rkukura has quit IRC12:25
*** hashar has joined #openstack-dev12:26
*** tryggvil_ has joined #openstack-dev12:27
*** PaulMachTech has joined #openstack-dev12:28
PaulMachTechtest12:29
DavieyPaulMachTech: double fail12:29
PaulMachTechta :-)12:30
*** rajaram1 has joined #openstack-dev12:31
*** tryggvil__ has joined #openstack-dev12:31
*** tryggvil_ has quit IRC12:31
*** rajaram has quit IRC12:33
*** PaulMachTech has quit IRC12:37
*** ches has quit IRC12:38
*** ches has joined #openstack-dev12:38
*** andrewsmedina has joined #openstack-dev12:42
*** rajaram has joined #openstack-dev12:44
*** rajaram1 has quit IRC12:45
andrewsmedinaany horizon developer her?12:47
*** Remco_ has joined #openstack-dev12:48
*** Remco_ has quit IRC12:50
sorenandrewsmedina: They're (almost?) all on Pacific time. Don't expect them for another 4-5 hours.12:55
andrewsmedinasoren: thanks12:55
sorenandrewsmedina: Sure thing.12:55
andrewsmedinasoren: I'm writing some tests for horizon12:56
andrewsmedinafor improve your coverage12:56
*** rajaram1 has joined #openstack-dev12:56
*** rajaram has quit IRC12:56
sorenandrewsmedina: Cool!13:03
*** zigo has joined #openstack-dev13:18
*** j05h has left #openstack-dev13:32
*** ayoung has joined #openstack-dev13:35
*** sandywalsh has quit IRC13:35
*** sandywalsh has joined #openstack-dev13:37
sandywalshanyone run into this lately? AttributeError: 'module' object has no attribute 'MigrateDeprecationWarning'13:48
*** rajaram1 has quit IRC13:49
*** martine has joined #openstack-dev13:51
*** troytoman-away is now known as troytoman13:52
*** dolphm has joined #openstack-dev13:53
*** dayou has joined #openstack-dev13:55
*** stuntmachine has joined #openstack-dev13:57
sandywalshnm, got it. Old migrate conflicting with sqlalchemy-migrate14:03
*** mattray has joined #openstack-dev14:05
ttxnotmyname: Hi! would be good to update https://launchpad.net/swift/+milestone/1.4.6 before the meeting today... so that I know if there is anything left open in the queue (and so that people know what blueprints landed)14:09
ttxnotmyname: no need to target bugs to 1.4.6, that will be automatically done when I open the milestone-proposed branch14:10
ttx(for all FixCommitted things since 1.4.5)14:10
*** Remco_ has joined #openstack-dev14:10
notmynamettx: I'll try to get that done before the meeting14:18
ttxnotmyname: cool, thx14:18
*** mattray has quit IRC14:19
*** dolphm has quit IRC14:21
*** ncode has quit IRC14:27
*** eglynn_ has quit IRC14:28
*** mattray has joined #openstack-dev14:34
*** rkukura has joined #openstack-dev14:38
*** mattray has quit IRC14:38
*** Ryan_Lane has joined #openstack-dev14:43
*** mattray has joined #openstack-dev14:47
*** PotHix has joined #openstack-dev14:49
*** j05h has joined #openstack-dev14:51
*** j05h has quit IRC14:52
*** j05h has joined #openstack-dev14:52
*** Remco_ has quit IRC14:53
*** eglynn_ has joined #openstack-dev15:00
*** Ryan_Lane has quit IRC15:00
*** littleidea has joined #openstack-dev15:01
*** littleidea has quit IRC15:03
*** littleidea_ has joined #openstack-dev15:03
*** littleidea_ is now known as littleidea15:03
*** dtroyer has joined #openstack-dev15:03
*** andrewbogott[gon is now known as andrewbogott15:08
*** dwalleck_nova has joined #openstack-dev15:16
*** zigo has quit IRC15:16
*** oneiroi has quit IRC15:18
*** oneiroi has joined #openstack-dev15:19
*** oneiroi has joined #openstack-dev15:19
*** oneiroi has quit IRC15:19
*** oneiroi has joined #openstack-dev15:20
*** Yak-n-Yeti has joined #openstack-dev15:21
*** mattray has quit IRC15:22
*** Yak-n-Yeti has quit IRC15:27
*** dtroyer has quit IRC15:30
* soren concludes that the vcs-tarball-delta detection job in Jenkins must have gone the way of the dodo15:34
*** dwalleck_nova has quit IRC15:35
*** troytoman is now known as troytoman-away15:38
*** zns has joined #openstack-dev15:44
ttxsoren: yes. Filed as https://bugs.launchpad.net/openstack-ci/+bug/90122515:50
uvirtbotLaunchpad bug 901225 in openstack-ci "Need for a git/tarball diff Jenkins job" [Wishlist,Triaged]15:50
*** zzed has joined #openstack-dev15:50
ttxI should probably raise prio if I want it to get done soon.15:50
*** LinuxJedi has quit IRC15:52
*** LinuxJedi has joined #openstack-dev15:52
*** rnirmal has joined #openstack-dev15:54
*** deshantm has joined #openstack-dev16:00
*** Mandell has quit IRC16:00
*** danwent has quit IRC16:02
*** dolphm has joined #openstack-dev16:06
*** mattray has joined #openstack-dev16:07
*** dwalleck_nova has joined #openstack-dev16:07
*** AlanClark has joined #openstack-dev16:10
*** reidrac has quit IRC16:12
*** littleidea has quit IRC16:15
*** cp16net has joined #openstack-dev16:17
*** Mandell has joined #openstack-dev16:18
*** spiffxp has joined #openstack-dev16:23
*** heckj has joined #openstack-dev16:28
*** bepernoot has quit IRC16:29
*** dwalleck_nova has quit IRC16:32
*** apevec has quit IRC16:35
*** danwent has joined #openstack-dev16:35
*** Gordonz has joined #openstack-dev16:36
*** andrewbogott is now known as andrewbogott[gon16:37
*** Mandell has quit IRC16:38
*** hashar has quit IRC16:42
*** mancdaz has joined #openstack-dev16:44
jaypipeseglynn_: did you see comstud's comment on https://review.openstack.org/#change,3550?16:45
* eglynn_ looking ...16:46
eglynn_jaypipes: interesting ...16:47
eglynn_the reason for the os._exit() call is that sys.exit() simply raises an exception which is caught on a non-main thread16:47
eglynn_I'm not sure if the unreleased lock issue is a realistic possibility in this case16:48
eglynn_if it is, I could look at restructuring the code to avoid the forks from non-main threads16:48
*** darraghb has joined #openstack-dev16:49
eglynn_jaypipes: prolly best to continue the conversation on gerrit, I'll response to comstud there ...16:49
jaypipeseglynn_: :) ok16:50
*** j05h has left #openstack-dev16:51
*** Mandell has joined #openstack-dev16:53
*** deshantm_ has joined #openstack-dev16:54
*** darraghb has left #openstack-dev16:54
*** deshantm has quit IRC16:54
*** deshantm_ is now known as deshantm16:54
jaypipesdeshantm: mornin.16:56
ayoungtermie, I'm assuming that you haven't yet gotten to look at my patch.  Let me ask a simple question:  since KSL no longer has the models that specify the contract for each of the back end entities,  what is supposed to enforce the contract of what a backend entity is supposed to look like?16:56
deshantmjaypipes: hello16:56
*** darraghb has joined #openstack-dev16:57
*** dubsquared has joined #openstack-dev17:04
*** ghe_ has quit IRC17:06
*** ghe_ has joined #openstack-dev17:07
mtaylorjaypipes, markmc: hey, could I get a review from you on https://review.openstack.org/#change,380317:08
*** nati2 has joined #openstack-dev17:09
jaypipesmtaylor: done17:13
*** kbringard has joined #openstack-dev17:14
*** gyee has joined #openstack-dev17:15
*** elasticdog has quit IRC17:16
*** bepernoot has joined #openstack-dev17:18
*** bepernoot has quit IRC17:18
*** Ryan_Lane has joined #openstack-dev17:19
*** bepernoot has joined #openstack-dev17:19
*** maplebed has joined #openstack-dev17:21
*** maplebed has quit IRC17:21
*** markmc has quit IRC17:24
mtaylorjaypipes: thanks bro17:25
*** dolphm has quit IRC17:25
*** dwalleck_nova has joined #openstack-dev17:26
*** maplebed has joined #openstack-dev17:27
*** maplebed has joined #openstack-dev17:27
*** dtroyer has joined #openstack-dev17:28
*** hashar has joined #openstack-dev17:33
*** derekh has quit IRC17:34
*** shevek_ has quit IRC17:44
*** andrewbogott[gon is now known as andrewbogott17:47
*** darraghb has quit IRC17:53
*** jdurgin has joined #openstack-dev17:53
*** dolphm has joined #openstack-dev17:55
*** Ryan_Lane has quit IRC17:56
*** ohnoimdead has joined #openstack-dev17:58
*** stuntmachine has quit IRC17:58
*** dubsquared has quit IRC17:58
*** stuntmachine has joined #openstack-dev18:01
*** littleidea has joined #openstack-dev18:04
*** dwalleck_nova has quit IRC18:07
*** littleidea has quit IRC18:08
*** littleidea has joined #openstack-dev18:09
*** littleidea has left #openstack-dev18:09
mtaylorjkoelker: hey! I'm poking at your stuff again today...18:12
jkoelkerthe melange tox stuff?18:13
jkoelkeri was looking at that again earlier18:13
mtaylorjkoelker: yeah - and python-melangeclient18:13
jkoelkerah, well heads up, melangeclient needs a running melange server for the "tests" to run18:13
mtaylorjkoelker: I'm basically using you and quantum as guinea pigs so that I know the pattern for getting everything happy :)18:13
*** littleidea has joined #openstack-dev18:14
jkoelker;)18:14
mtaylorjkoelker: indeed - but the unittests don't need one of those18:14
jkoelkerexcellent18:14
mtaylorjkoelker: (you have a failing unittest by the way)18:14
mtaylorjkoelker: I've also been not using tissue ... although I'd like to chat with you at some point about how we could use tissue18:15
mtaylorjkoelker: currently using the pattern of having a tox builder for pep8 - because I need to be able to run a jenkins job that is only the pep8 tests ...18:15
jkoelkerrock on, yea, I want to add in plugin support, so we can easily add in HACKING checks18:15
jkoelkerah, yea18:16
mtaylorjkoelker: and I can't figure out how to do that with tissue18:16
jkoelkerhrm, I'll have to look if I can wipe out the test collection list so we can just do a pep8 run18:17
mtaylorjkoelker: in the mean time ...18:17
mtaylorjkoelker: here's python-melangeclient turned in to pretty much how the other things have been working out: https://review.openstack.org/385718:17
jkoelkerrock on i'll pull that in and then fix the test18:20
jkoelkerdamn _18:20
*** jdg has joined #openstack-dev18:21
*** oneiroi has quit IRC18:21
mtaylorjkoelker: let me know when you get the test fixed, and I'll add tox builders in jenkins18:22
sandywalshjaypipes, you'll be happy to know I've installed Thunderbird just for OS discussions. I've sold my soul and installed a fat client. Curse you pipes ... curse you. :p18:26
jaypipessandywalsh: anything but OWA or Outlook.18:26
*** hashar has quit IRC18:27
sandywalshjaypipes, OWA was the issue. Sad that the only solution is a fat client.18:27
jaypipessandywalsh: I use Thunderbird with Davmail to access my HP email... it's working out just fine, actually. I have access to HP LDAP, Calendar, etc...18:28
sandywalshjaypipes, so long as you have your laptop with you.18:28
*** spiffxp has quit IRC18:29
*** jog0 has joined #openstack-dev18:30
*** shevek_rs has joined #openstack-dev18:30
jkoelkermtaylor: ok should be good to go18:30
jaypipessandywalsh: as opposed to when? ;)18:33
sandywalshjaypipes, true. bad argument. Try: when your hard drive crashes.18:35
jaypipessandywalsh: ah :)18:35
mtaylorjkoelker: awesome18:38
jkoelkeri'm looking at the melange (server) one now, its not installing the test-requires for me18:39
*** shevek_rs has quit IRC18:40
*** spiffxp has joined #openstack-dev18:43
*** adjohn has joined #openstack-dev18:44
*** shevek_ has joined #openstack-dev18:44
*** tryggvil__ has quit IRC18:56
*** lloydde has joined #openstack-dev18:56
*** novas0x2a|laptop has joined #openstack-dev18:58
*** mattray has quit IRC18:58
mtaylorjkoelker: I have that fixed in a later commit18:59
jkoelkerrock on18:59
mtaylorjkoelker: it's entirely possible that I should just squash all of the outstanding melange commits...18:59
jkoelkerif you wan't i'll just push them though18:59
jkoelkerand then we can asses were we are19:00
mtaylorhehe19:00
mtaylorworks for me19:00
mtaylorbzr - python-melangeclient now has py26, py27 and pep8 jobs in jenkins19:00
mtaylornot bzr19:00
mtaylorbtw19:00
mtaylordamn hands19:01
jkoelkerall aproved19:02
mtaylorcool. we'll see how much havoc we've caused!19:02
*** dwalleck_nova has joined #openstack-dev19:02
*** stuntmachine has quit IRC19:03
*** j05h1 has joined #openstack-dev19:03
vishycomstud: can you weigh in on: https://review.openstack.org/#change,334319:07
*** stuntmachine has joined #openstack-dev19:09
rmkhow well does the dashboard function to control multiple AZs?19:11
*** j05h1 has left #openstack-dev19:11
rmkI'd assume the preferred deployment is not having a dash per az19:11
*** sleepsonthefloo has joined #openstack-dev19:12
comstudvishy: yep19:14
sleepsontheflooandrewbogott - Re: volumes, it turns out that the condition that I thought reproduced your error was actually due to misconfiguration.  So volumes are working for me in vbox, kvm, and bm :/19:14
andrewbogottok, I'm not sure if that's good new or bad :)19:15
sorentermie: I don't follow at all. pstats is in the base python packages.19:15
sorentermie: What is it specifically that you need that you don't have?19:15
mtaylorsoren: it's in base pyton on oneiric19:15
sorenmtaylor: Yes..19:16
andrewbogottsleepsonthefloo:  Are you making any other changes to your install other than adding n-vol to the script?19:16
mtaylorsoren: not on natty19:16
sorenmtaylor: And before then, they didn't conflict.19:16
sorenmtaylor: So he's clearly doing this on Oneiric.19:16
mtaylorsoren: anyhow - I think it's sorted, we're up and going with the builders19:16
mtaylornow19:16
sleepsontheflooandrewbogott - no, I'm not.  The only thing in my localrc is the specification of ENABLED_SERVICES (aside from passwords)19:16
andrewbogottSo, what was the configuration problem that you fixed?  (Presumably I have something similarly broken.)19:17
sorenmtaylor: The conflicts/breaks/whatevers were (naturally) added in the version where the python packages started shipping pstats.19:17
mtaylorsoren: yes. that makes sense now19:17
mtaylorsoren: python-profilers doesn't seem to exist on my natty slave though19:18
sleepsontheflooandrewbogott - it was simply that n-vol wasn't specified - I have two test dirs, and I was in the wrong one.  oops.19:18
*** ppradhan has joined #openstack-dev19:18
andrewbogottHm...19:19
vishyadam_g: ping19:19
sorenmtaylor: In multiverse.19:19
sorenmtaylor: Is multiverse enabled?19:19
mtaylorsoren: oh, probably not19:21
andrewbogottsleepsonthefloo:  For the sake of perfection, can you paste that exact localrc line here?  thanks19:21
mtaylorwell, I don't really care- we're moving to all oneiric slaves anyway19:21
sleepsontheflooandrewbogott: ENABLED_SERVICES=g-api,g-reg,key,n-api,n-crt,n-obj,n-cpu,n-net,n-sch,n-novnc,n-xvnc,n-cauth,horizon,mysql,rabbit,n-vol19:25
andrewbogottthanks19:25
vishyadam_g: so it looks like some versions of iscsiadm do return 255?  I've made a fix that handles both cases. Can you make sure it still works for you? https://bugs.launchpad.net/nova/+bug/92223219:26
uvirtbotLaunchpad bug 922232 in nova "Volumes fail to attach without discovery using tgt" [Undecided,In progress]19:26
sorenmtaylor: https://jenkins.openstack.org/job/nova-ppa/ <--- Eeeep!19:26
sorenmtaylor: Oh.19:27
sleepsontheflooandrewbogott - there is my log from a successful volume creation: http://pastie.org/pastes/3336343/text19:27
sorenmtaylor: Never mind. Not a Jenkins error.19:27
mtaylorsoren: I believe that's the launchpad fail19:27
mtayloroh! that's actually a real fail, neat19:28
andrewbogottsleepsonthefloo:  cool!  I'm starting a fresh install again, will compare my log to yours when I get there.19:28
mtaylorI've been ignoring that for forever because of launcphad upload sadness19:28
*** Remco_ has joined #openstack-dev19:28
*** hashar has joined #openstack-dev19:29
sorenmtaylor: It's not. It's packaging. I thought those things used to be announced here.19:29
*** mattray has joined #openstack-dev19:33
mtaylorsoren: packaging build failures? don't think so, but I could be wrong - build announcement sorting is certainly an open task19:34
vishymtaylor, jeblair_: any chance the commit parser in gerrit could be smart enough to pick this up: This bug fixes LP: #924601.19:37
*** hashar has quit IRC19:38
*** Mandell has quit IRC19:38
adam_gvishy: srsly? ill give it a shot, do you have version info on those initiators that give meangingful RCs?19:39
LinuxJedimtaylor: hmm... ever thought of plugins in git-review like bzr so that you can do --fixes lp:123456?19:39
vishyadam_g: I don't know what version he was using19:39
vishyadam_g: but from the traceback it is clearly returning 25519:39
mtaylorvishy: yes, totally19:40
vishyadam_g: I don't see any harm in handling both return codes, since we are checking the err msg anyway.  Although I am worried about internationalization19:40
mtaylorLinuxJedi: see vishy's request above?19:40
LinuxJedimtaylor: that is what sparked my thought process19:40
vishyadam_g: Do we need to pass an LC_ALL in there somewhere?19:41
mtaylorLinuxJedi: also, we _could_ - but we're starting to get heavyweight there, since there's not a meta-info place to store that data19:41
LinuxJedimtaylor: so that there is one way to do it instead of an expanding regex19:41
*** hashar has joined #openstack-dev19:41
LinuxJedimtaylor: ah, fair enough :)19:41
mtaylorLinuxJedi: I think just expanding the regex in the commit parser and the gerrit change display would be enough19:41
adam_gvishy: ah, looks like oneiric. in a meeting now, will tkae a look in a bit19:42
vishyadam_g: word19:42
mtaylorLinuxJedi: thing is, we don't want to _force_ people to use git review - everything it does should be merely convenience19:42
LinuxJedimtaylor: of course, I just think it may be easier for there to be one set way to put bugs :)19:44
*** pixelbeat has quit IRC19:44
LinuxJedimtaylor: I really liked that bzr could do --fixes (not that I had any idea what that did in the metadata)19:44
LinuxJedimtaylor: as for vishy's request, want me to file a bug?19:45
*** hashar has quit IRC19:45
*** andrewbogott is now known as andrewbogott[gon19:47
mtaylorLinuxJedi: yes please!19:47
*** hashar has joined #openstack-dev19:49
LinuxJedimtaylor: done and assigned to me19:50
mtaylorLinuxJedi: you rock19:56
*** joesavak has joined #openstack-dev19:58
*** retr0h has joined #openstack-dev20:03
*** retr0h has joined #openstack-dev20:03
*** Yak-n-Yeti has joined #openstack-dev20:06
*** retr0h has left #openstack-dev20:08
*** retr0h has joined #openstack-dev20:08
*** nati2_ has joined #openstack-dev20:10
*** andrewbogott[gon is now known as andrewbogott20:12
*** nati2 has quit IRC20:12
*** troytoman-away is now known as troytoman20:21
*** Mandell has joined #openstack-dev20:23
*** rkukura has quit IRC20:26
*** nati2 has joined #openstack-dev20:28
*** dwallec__ has joined #openstack-dev20:29
*** dwalleck_nova has quit IRC20:30
*** nati2_ has quit IRC20:31
*** rkukura has joined #openstack-dev20:32
*** davlap has joined #openstack-dev20:33
*** vincentricci has joined #openstack-dev20:35
*** littleidea has quit IRC20:36
*** littleidea has joined #openstack-dev20:37
*** dakranz has joined #openstack-dev20:39
ewindischZeroMQ - vm launching: success20:43
*** benner has quit IRC20:44
*** Remco_ has quit IRC20:44
*** cp16net has quit IRC20:45
znsayoung?20:47
ayoungzns, yep20:47
*** littleidea has quit IRC20:47
*** littleidea has joined #openstack-dev20:47
znsjust saw your bug for 'abstract classes'. Have you seen models.py in Keystone? Would love to know if it can be reused or, if not, how it could have been improved: https://github.com/openstack/keystone/blob/master/keystone/models.py20:48
ayoungzns, I think they can be reused.  The question is how to marry that to the SQL Alchemy approach in KSL20:49
ayoungzns  the short of it is that I think we look at the models structure and throwout anything we don't want20:49
znsmodels in models.py inherit from dict. KSL uses dicts, doesn't it?20:49
ayoungzns, not really20:49
*** benner has joined #openstack-dev20:50
znsthat must have changed from last time I looked closely at it then...20:50
ayoungthe KSL approach usese SQL alchemy to map the columns to the fields of the Python objects20:50
ayounglook at the sql.py code in keystone/identity/backends/.20:50
ayoungclass User(sql.ModelBase, sql.DictBase):20:51
ayoung    __tablename__ = 'user'20:51
ayoung    id = sql.Column(sql.String(64), primary_key=True)20:51
ayoung    name = sql.Column(sql.String(64), unique=True)20:51
ayoungthis object is,  AFAICT  what is used to generate the tables, as well as the sql/python marshalling20:51
termiesoren: mtaylor and i have sorted it20:52
ayoungIts really elegant if you only have to support one DB schema20:52
znsCould you replace  sql.DictBase with models.Class?20:52
ayoungzns, I think DicBase can go away20:52
termieayoung: i am now around but haven't read all your scrollback20:52
ayoungI'm not sure what it give you that you don't get in Resource20:52
termiei don20:53
termiet want to use anything named "models.Class"20:53
ayoungtermie heh20:53
ayoungI try to avoid using variables named after keywords mywself20:53
znsOh. OK. Using declartive_base(). declarative_base does some scaffolding/setting things up that you can do manually to customize that… but it's not easily done without a lot of familiarity with SQLAlchemy I think...20:53
termiezns: what are we talking about?20:54
ayoungtermie,  I think we need to keep some aspect of the models code from KS hEavy20:54
ayoungbut we can throw out the majority of it20:54
*** bepernoo1 has joined #openstack-dev20:54
termieayoung: what issues are you running into?20:54
ayoungwe need a canonical representation of user,  role,  etc that not only is not tied to SQL20:54
znstermie: wondering how much of https://github.com/openstack/keystone/blob/master/keystone/models.py could be used for https://bugs.launchpad.net/bugs/92844120:55
uvirtbotLaunchpad bug 928441 in keystone "create abstract base classes for key elements within Keystone API" [Medium,Confirmed]20:55
ayoungbut not tied to any one SQL or LDAP schema20:55
termieayoung: i vaguely agree, but i don't like keystone's models20:55
ayoungtermie:  OK,  need your Python Kung Fu to come up with a solution20:55
*** bepernoot has quit IRC20:55
znstermie: yep. How could we have done it better?20:56
termieayoung: the models as they are designed in ksl were designed with some eye for scalability20:56
ayoungtermie  the only place where I see them definied are in the SQL classes as I posted above20:56
ayoung class User(sql.ModelBase, sql.DictBase):20:56
termieayoung: there just isn't any class that is explicitly stating what they are20:56
ayoung    id = sql.Column(sql.String(64), primary_key=True)20:57
heckjtermie: I had a question out to you on this in another channel - wanted some ideas on how to define what a user is and must have (attributes  or whatever) that the service API's all interact with.20:57
heckji.e. token's having a expiration, for example20:57
termieheckj: yeah, i just walked into the office20:57
heckjdidn't know a good "pythonic" way of doing that20:57
termieheckj: trying to answer all your questions at once20:57
heckjtermie: np20:57
heckjSWEET! And… :-)20:57
termieanyway, we used to have model classes20:57
termieand we can do it again for definition purposes20:58
termiethey were subclasses of dict20:58
*** anotherjesse has joined #openstack-dev20:58
*** blamar has quit IRC20:58
termieright now i think the easiest approach to solve the problem (the problem being that people don't know what they should return) is just to document it in a keystone.common.models file20:59
ayoungtermie,  I think that is the right approach,  and also they should be agnostic of all technologies.  I want to cut out the to_xml and to_json functions among other things20:59
ayoungSO models would be pretty skinny20:59
termieayoung: that won't happen20:59
termieayoung: or rather i misread that21:00
ayoungtermie,  pull it out of models21:00
*** blamar has joined #openstack-dev21:00
termieayoung: there will still be "to_dict"21:00
termieor the equiv for backends21:00
termiebecause we don't want to return an sqlalchemy object21:00
ayoungtermie  dict <-> object is the only marshalling?21:00
termiethat's the marshalling that things need to provide on the backend, on the frontend making things into json and xml is fairly api specific21:00
termiebut as long as the objects returned from the backend are all dicts that look similar we're fine21:01
termieyou can see in the identity sql backend what we do with users due to having a blob to hold extra values21:01
ayoungtermie,  yeah...21:01
sorenAnother quick review on this one? https://review.openstack.org/#change,3868   Probably the easiest review you'll do today.21:02
ayoungnever been a fan of that particular hack.   Been burnt by it elsewhere21:02
termieayoung: i've had quite the opposite experience21:02
ayoungtoo specific of a schema?21:02
*** blamar has quit IRC21:02
termieayoung: the only hack part of it is making it look like there isn't an extra dict21:02
termieayoung: if the schema were designed flexibly to begin with that hack wouldn't be necessary21:03
ayoungtermie,  nah,  the problem is that it makes things easy for the coder,.  bu hell for the DBA21:03
termieayoung: aye, for adhoc queries21:03
ayoungmakes it nasty to integrate with other systems,  which is one thing Keystone is going to have to excell at21:03
ayoungtermie,  so I think this should be out position statement21:03
termieayoung: makes it easy to integrate with other systems, they don't all have to do the blob21:03
*** Yak-n-Yeti has quit IRC21:03
termieayoung: there are some set of indexed "important" properties21:04
termiein the current case the only things being searched on are name and id21:04
ayoung"we provide a default SQL and LDAP schema  but provide a clearcut mechanism for the implementor to tie in with a custom IdM schema"21:04
ayoungso we make the model objects explicit,  provide a  mapping to out SQL and LDAP schemas in stand along files21:04
ayoungand make it relatively straight forward to swap  keystone.identity.ldap.default for the RAX specifict file,  the Red Hat specific file,  the  AD  one....21:05
ayoungI think that is in keeping with your philosophy of how to architect  KSL, right?21:06
*** blamar has joined #openstack-dev21:06
termieayoung: in somehwat agreement21:07
znsayoung: multi-tasking with openstack-meeting team meeting…  FYI21:08
*** andrewsmedina has quit IRC21:08
termieyeah, sorry, multiconversing21:09
termieayoung: i think what we're not in full agreement on is which parts of the model should be explicit21:10
*** blamar has quit IRC21:10
ayoungtermie, we can hold until the meeting is over21:10
termieayoung: as it stands there are some existing stuff from keystone that i don't consider essential21:10
termieayoung: that i largely implemented by shoving into a dict21:10
*** blamar has joined #openstack-dev21:10
termieayoung: my goal was to drop the list of "explicit" properties to things that are actually relevant21:11
*** blamar has quit IRC21:12
termieayoung: that list may grow, but at the moment the only things actually used by the code are the things that are explicitly defined on the models21:12
*** Yak-n-Yeti has joined #openstack-dev21:13
*** hashar has quit IRC21:13
znstermie: any idea if there is a gap between what you consider essential and what the contract XSDs mark as required? Those would probably be the ones we'd have to agree on how to navigate until next rev of the API...21:13
*** blamar has joined #openstack-dev21:13
termiewhat does XSD mean?21:13
termiezns: my initial proposal for going over the list is to enumerate which of the features mentioned are in actual use by somebody21:14
*** blamar has quit IRC21:15
andrewbogottsleepsonthefloo:  Does this tell you anything?  http://pastie.org/3337041  <- looks to me like it's the same as yours, but then trails off for no apparent reason.21:15
znstermie: We have other teams to consider which use Java and other horrendous tools, but whom we need to support nonetheless. For them, they import the XSD contracts and that defines their object model, so they use 100% of the contract.21:16
*** blamar has joined #openstack-dev21:16
*** sandywalsh has quit IRC21:16
anotherjessezns: is that somethign needed for merge into core or something needed for release of E4?21:16
anotherjessehaving HIGH = required for E4, CRITICAL = required for merge to master21:17
*** blamar has quit IRC21:18
termiezns: are any of these teams using python keystone?21:18
sleepsontheflooandrewbogott - weird.  how large is your root image?  and how much ram?  Which hypervisors (for both the outer and inner clouds)?  And just to double check, this is oneiric?21:19
termiezns: if not i don't consider it a blocker for the merge21:19
*** dwallec__ has quit IRC21:19
termiezns: it is a feature we want to support, but it is not going to break anybody's workflow tomorrow21:19
*** blamar has joined #openstack-dev21:19
znstermie: python keystone is not the only client.21:19
termiezns: it isn't a client at all21:20
anotherjessezns: the point being - wouldn't they be using the XSD of the released version - not the developed version21:20
andrewbogottsleepsonthefloo:  oneiric, 20gig instance, 2g of ram21:20
termiezns: i am asking who is using keystone, the python version, that needs the features for their continued existence21:20
ayoungzns is the doc you posted before the cannoniucal XSD?21:20
andrewbogottAnd, I believe both clouds are KVM.  The inner one is whatever devstack defaults to.21:20
znsanotherjesse: definitely bE4. With regards to mergining into core, that's just a question of what approach we want to take. Wait for compatibility and then merge, or merge, break clients, and then file bugs to catch up. I prefer the safer approach, mainly because I am concerned by comments like termie's that bugs raised by people not using keystone will be deprioritized...21:21
znsI meant not using python21:21
ayoungzns termie is this the XSD http://keystone.openstack.org/backends.html21:21
heckjzns: I get your argument, but WHO are the folks using the client API?21:21
*** blamar has quit IRC21:22
znsThose are the docs in the master repo. Under keystone/content/common/xsd21:22
heckjit's a tad difficult to insure compatibility if we don't know who they are, and anything else is just a hypothetical21:22
*** dwalleck_nova has joined #openstack-dev21:22
termieheckj++21:22
heckjwe'll never make progress if we get stuck on "if … " and "maybe someone…"21:22
znsIt's not hypothetical - that's what the XSD provides. Certainty.21:22
heckjI didn't assert the XSD was hypothetical, I was asking (like termie) for a list of WHO is using that XSD that isn't using python-keystoneclient. That's the only client that we're actually aware of in use right now21:23
termiezns: XSD provides a lot of busywork, in my opinion, please answer the questions about users21:23
termies/users/clients/21:23
*** bepernoo1 has quit IRC21:24
znsI know of at least four teams at Rackspace that use Java and the WADL/XSD contracts. Including the QA team.21:24
znsI know there are teams outside of Rackspace that also do that.21:25
anotherjessebut do they use "keystone" or "global auth's" XSD/contract21:25
termiezns: and they are using the code located at github.com/openstack/keystone?21:25
znsThe contract does not cover JSON, however. SO maybe that's the gap. We can be flexible about JSON coverage if the XSD contracts are covered in the XML responses.21:25
mikalrun_tests is failing for me on a recently pulled master. Are other people suffering the same fate?21:26
termiezns: we can be flexible on quite a lot, i would imagine, are those teams using the code on github?21:26
*** bepernoot has joined #openstack-dev21:26
ayoungtermie, what fields or entities have you seen that you don't feel it is worthwhile to support?21:28
ayoungThe XSD for user looks like iti s really minimal21:28
termieayoung: email21:28
vishymtaylor, jeblair_: how do you guys feel about turning on volume.sh in the devstack tests?21:29
vishy* exercises21:29
termieayoung: maybe we want to support it as an indexed thing, but i'd prefer to make those decisions based on our use cases21:29
termieayoung: i'm not against adding some more things in there, but i don't want to build apis and data that we don't care about21:29
ayoungtermie,  who says it has to be indexed?21:30
termieayoung: things that are explicit properties of something are things that somebody is going to try to search on eventually21:30
termieif we make email a main property, we end up with things like "set_user_email" and then eventually "find_user_by_email"21:31
termieayoung: i don't trust the future, so i try to limit the holes it can try to throw the code down21:32
termieayoung: i'm all for working with you to provide what _you_ need21:33
*** bepernoot has quit IRC21:33
termieayoung: so far there has been very little insight into why anything has been done besides a somewhat amorphous definition of clients21:33
ayoungtermie,  well, lets start with the unit tests21:33
termieayoung: but as a real user, your use cases carry weight21:34
ayoungcurrently,  they do a dictionary compare beteen the sample data and what the user find returns21:34
ayoungtermie, I don't count as a real user...I'm a coder.21:34
termieayoung: you have a team that has real requirements21:34
termieayoung: or at least i hope you do ;)21:34
ayoungtermie, sorry, nope. I'm part of a Red Hat effort to contribute to Openstack.  I just have expereicne from working on FreeIPA21:35
termieayoung: so nobody on your end expects to use keystone?21:35
ayoungNow,  Red Hat does have custeomrs, but their reqs are all over the board.  I've been trying to mine them21:35
ayoungand the work we've done on IPA contributes to that21:36
termieayoung: we have, on my teams end, fairly clear broad requirements from various clients we work with currently or worked with in the past, and they are actually rather simple21:37
termieayoung: and they have so far seemed to match up pretty well with what nebula and the horizon team have seemed to want21:37
termieayoung: so that is the initial state of where ksl is coming from21:38
heckjayoung: so far our (Nebula) use cases have been really simple as well. I'm sure they'll get more complex in the future, but right now it's pretty limited.21:38
sleepsontheflooandrewbogott: can you pastie me the output of "select * from volumes;"?21:39
termieayoung: we expect to have to support additional things as other entities start using it, ideally if redhat had some plans for using it and had some specifics they wanted21:39
termieayoung: then i would be ecstatic to hear some of them21:39
termie:)21:39
termieayoung: as it is though i am fighting fairly hard to limit the requirements to concrete cases21:39
termieayoung: of which we still ahve plenty to work on21:40
andrewbogottsleepsonthefloo:  http://pastie.org/333721421:40
andrewbogottbtw, sleepsonthefloo, just ran the same test in a vmware-hosted devstack, and got the same behavior.21:41
andrewbogottThat suggests that I am making some sort of compulsive, consistent, dumb mistake.21:41
termieayoung: anyway, ldap is one of them21:41
andrewbogott(or devstack is broken)21:41
termieayoung: and you have way more experience with that than i21:41
termieayoung: so if you think there are requirements from an ldap point of view then i can cross-check those with the other people who want things out of ldap21:42
termieayoung: and we can come up with some answers as to what we should do (you've already done this a bunch in your email)21:42
termieayoung: (which i tried to point the other ldap people at)21:42
*** bepernoot has joined #openstack-dev21:42
vishyandrewbogott: are you sure n-vol is running?21:43
ayoungtermie, so I started with the fact that *someone*  made LDAP support work in the previous version of keystone21:43
mtaylorvishy: I feel great about it21:43
andrewbogottvishy:  Is that different from 'python /opt/stack/nova/bin/nova-volume'?  If so, how can I check?21:44
mtaylorvishy: does it work and stuff?21:44
*** thrawn01 has joined #openstack-dev21:44
ayoungand I noticed that this support was getting dropped when moving to KSL,  so I am really just trying to get back to feature parity21:44
ayoungI have talked with some community members (We had a meetup here in the Boston area last week) and I know that LDAP support is pretty baseline for a lot of organizations21:45
termieayoung: yup21:45
*** dolphm has quit IRC21:45
vishymtaylor: yes, it should automatically create the vg if it doesn't exist21:45
vishyandrewbogott: in devstack: ENABLED_SERVICES=n-vol,...21:45
andrewbogottoh, yeah, it's definitely enabled in devstack.21:45
vishyandrewbogott: any traceback in the volume window?21:46
thrawn01Running nova-manage from master results in config file errors " File contains no section headers." http://paste.openstack.org/show/4729/ any ideas?21:47
termieayoung: with your patch stuff, do you think it would be possible to have that work in a github fork?21:48
termieayoung: provides a slightly nicer viewing experience :)21:49
adam_gvishy: regarding Bug #922232, im embarassed to say it but the issue was never the volume driver but nova-rootwrap, it never collects the return code and returns 0 for anything that it executes21:49
uvirtbotLaunchpad bug 922232 in nova "Volumes fail to attach without discovery using tgt" [Undecided,In progress] https://launchpad.net/bugs/92223221:49
vishyadam_g: oh no21:50
adam_gvishy: the follow up isn't using the wrapper, hence the 25521:50
vishyadam_g: sounds like we need to fix nova-rootwrap and revert the change?21:50
ayoungtermie, I can.  I 'll do a little more cleanup tonight and push it21:50
adam_gvishy: yup. looking at that now21:50
termieayoung: what did you see as the issue in the unittests where it is comparing the dicts?21:52
termieayoung: i think our conversation rambled a lot (because i probably rambled a lot :p )21:52
termiealso: http://hyperboleandahalf.blogspot.com/2010/04/alot-is-better-than-you-at-everything.html21:52
*** bhall has joined #openstack-dev21:53
*** bhall has quit IRC21:53
*** bhall has joined #openstack-dev21:53
ayoungtermie, nice!21:53
ayoungtermie, http://adam.younglogic.com/2011/02/reviewing-patches-in-git/  if you are impatient to see my changes21:54
termieayoung: you're not allowed to push code to github?21:54
*** spiffxp has quit IRC21:55
*** stuntmachine has quit IRC21:55
*** kbringard has quit IRC21:55
ayoungtermie, I am,  I just haven't set up a fork on Github for keystone yet21:56
sorenttx: https://launchpadlibrarian.net/92225457/buildlog_ubuntu-oneiric-i386.nova_2012.1~e4~20120207.12509-0ubuntu0ppa1~oneiric1_BUILDING.txt.gz  <--- Search for "FAIL: test_KillFilter"    Any ideas why?21:57
ttxhmmm21:57
*** martine has quit IRC21:57
termienow here: https://github.com/cloudbuilders/keystone/tree/ldap_branch21:57
ttxsoren: just a sec, let me close the meeting first21:57
termiespecifically https://github.com/cloudbuilders/keystone/commit/313980aad615812120f2dcb4d8664caf288edaf821:58
sorenttx: sure21:58
sorenttx: That's the only failure I've not sorted out yet. On Oneiric, at least.21:58
*** mikeyp has joined #openstack-dev22:00
vishyttx: is /proc/pid not readable for some reason?22:00
vishysoren: ^^22:00
ttxvishy: could be on buildds22:00
*** sandywalsh has joined #openstack-dev22:00
ttxbut the test should be skipped on non-procfs platforms22:01
ttx(like it does on MacOS)22:01
vishyttx: perhaps the test is too slow22:02
sorenvishy: It's possible, I suppose. Seems unlikely, though.22:02
vishyttx: bin/sleep has finished by the time?22:02
vishyit only runs for 5 seconds22:02
mtaylorvishy: I think it's as simple as submitting a patch to openstack-ci - which itself should go through the gating check22:03
vishymtaylor: sounds good, will submit and see what happens22:03
mtaylorvishy: sweet - yeah, just remove it from the list of disabled exercises in devstack-vm-gate-host.sh22:03
vishymtaylor: and add n-vol to enabled services22:04
*** andrewbogott is now known as andrewbogott[gon22:04
mtaylorvishy: ++22:04
ttxvishy: extremely unlikely.22:04
ttxit runs in less than a microsecond locally. I can't see it taking 5 seconds somewhere else.22:05
*** Mandell_ has joined #openstack-dev22:05
ttxsoren: I'd rather think that buildds don't let you play with your own /proc/PID22:06
vishysoren: could be22:06
ttxos.readlink("/proc/%d/exe" % pid) probably fails22:06
sorenttx: Is it myown process?22:07
vishymtaylor: https://review.openstack.org/386922:07
ttxyes. It's the sleep you just started22:07
znstermie, ayoung, heckj: sorry I disappeared. I jumped on a call with Jesse to discuss and loop back on some conversations we had about E4 and Essex. I think we have a good path forward on E4. My main concern is that I do not know each and every deployment of Keystone out there, but I know that we published and committed to a contract and I have been hesitant to commit to breaking that contract without giving the community fair warning and an opportunity to s22:07
mtaylorvishy: cool. here goes nothing :)22:07
vishyttx: btw we just discovered nova-rootwrap is not passing up the exit code from the child process.  adam_g is looking at it22:07
termieLET THE PEOPLE S!22:07
znsindeed22:08
* mtaylor always likes s'ing22:08
ttxsoren: the trick is, that code is usually run as root. In the test it runs as unprivileged, so it looks at its own processes22:08
*** Mandell has quit IRC22:08
ttxsoren: but that might trigger issues in controlled envs like the buildds22:09
ayoungzns, do we have a sense of the bounds of that contract?22:09
*** andrewbogott[gon is now known as andrewbogott22:09
ttxvishy: hmmm. It should.22:09
ttxsys.exit(obj.returncode)22:09
andrewbogottyikes, network failure22:10
ttxvishy: there are cases where it doesn't, but that's when it doesn't execute the child.22:10
andrewbogottvishy:  The scrollback in the volume screen session looks just like the log.  One call to tgtadm and then just the steady heartbeat of 'Running periodic task...'22:10
ttxvishy: bug number ?22:10
vishyttx: argreed, it should, but for some reason it is returning 0 when runnin iscsiadm22:10
*** bepernoot has quit IRC22:11
vishyttx: this was the original bug22:11
vishyhttps://launchpad.net/bugs/92223222:11
uvirtbotLaunchpad bug 922232 in nova "Volumes fail to attach without discovery using tgt" [Undecided,In progress]22:11
znsayoung: yes. The core Keystone contract is described for XML users using a WADL and XSD. That's pretty clear and strictly defined. For JSON users, the contract has been less strictly defined and we've been using the samples and the implementation code for that. I actually think ksl probably provides very good coverage of anyone using JSON. The question is who is dependent on the XML contract and what would the impact to them be if we were XML-less for a mil22:11
vishyin precise iscsiadm was returning 0 on fail instead of 255, when investigating he discovered that it was actually nova-rootwrap returning 022:11
*** blamar has joined #openstack-dev22:11
*** blamar has quit IRC22:12
*** blamar has joined #openstack-dev22:12
ayoungzns, OK,  so the issue is not whether we support each of the attributes and entities in the xsd  then?22:12
vishyadam_g: he is investigating further, just wanted to give you hte heads up22:12
adam_gttx: er, yah.. authorizing /bin/false is a good test case22:12
*** mfer has joined #openstack-dev22:13
openstackgerritVerification of a change to openstack/openstack-ci failed: enable volume tests  https://review.openstack.org/386922:13
vishyttx: er that message was for you ^^22:13
*** nati2 has quit IRC22:13
ttxvishy, adam_g: OK. I remember testing that but the code has changed a bit, maybe tere is some corner case, though at first glance it should just work{tm]22:14
ttxvishy, adam_g: might have a look tomorrow if you don't nail it soon.22:14
znsayoung: there are multiple issues. One of them is what "authority" does the XSD have as a contract on the underlying implementation and agreeing on how important that is for interoperability between OpenStack and other implementations and/or clients.22:15
*** adjohn has quit IRC22:16
*** anotherjesse has quit IRC22:17
*** vincentricci has quit IRC22:17
ttxsoren: that test might need to be relaxed a bit, but I kinda liked trying to exercise the true /proc/PID check22:17
mtaylorvishy: hey! looks like some amount of testing may have worked properly?22:17
ayoungzns, so the concern is the Delta between what KSL does right now and what the XSD claims?  And I take it we are not yet sure what that Delta might be?22:17
*** sleepsonthefloo has quit IRC22:17
ayoungtermie, getting back to your questions,  the Unit tests check for the presense of the tenants in the user object,  but the simplisitic impls (PAM)  don't enumerate them22:19
ayoungThat is what go me started22:19
sorenttx: Understood. i've instrumented the test a bit and have sent it to PPA for testing. Will look more tomorrow.22:19
ayoungtermie, and the unit tests use the API to populate the data in the first place,  so I started working on the ability to add users etc22:20
*** pixelbeat has joined #openstack-dev22:20
znsayoung: the delta is 100%, since XSD defines the XML contracts and KSL does not yet respond in XML. But the conversation started today around what are the required fields in the models and there's a set of those defined in the XSDs which you'd need to support if you're going to honor the XSD contract.22:22
ayoungzns, Understood.22:22
*** littleidea has quit IRC22:26
*** dubsquared has joined #openstack-dev22:27
*** littleidea has joined #openstack-dev22:28
*** Yak-n-Yeti has quit IRC22:28
*** Yak-n-Yeti has joined #openstack-dev22:29
*** joesavak has quit IRC22:32
*** mattray has quit IRC22:34
*** markvoelker has quit IRC22:35
*** rkukura has quit IRC22:38
*** littleidea has quit IRC22:38
*** Gordonz has quit IRC22:39
*** sandywalsh has quit IRC22:39
*** littleidea has joined #openstack-dev22:40
*** sleepsonthefloo has joined #openstack-dev22:44
*** littleidea has quit IRC22:45
*** mattstep has quit IRC22:45
*** littleidea has joined #openstack-dev22:46
*** mattstep has joined #openstack-dev22:46
*** Yak-n-Yeti has quit IRC22:48
*** bhall has quit IRC22:51
*** sandywalsh has joined #openstack-dev22:51
termieayoung: the pam backend isn't currently being tested and is out of date, ftr22:52
ayoungtermie, OK22:53
termieayoung: what you are saying you ran into though is just the lack of definition of what a user _should_ be22:54
termieayoung: right?22:54
ayoungtermie, right22:54
ayoungtermie, I think that a stripped down models.py will be the right solution.22:54
ayoungI'm going to get authenticate to work with the current impl, and then post that22:54
termiecoolio22:55
ayoungthen we'll figure out what to hack off it22:55
ayoungI suspect most of it can go22:55
*** mfer has quit IRC22:58
ayoungtermie, ugh...except fro circular dependencies amongst entities....blergh22:59
ayoungtrying to simplify as I go,  but role needs tenant. and tenant needs role....22:59
termieayoung: you mean in ldap tree structure?23:00
ayoungtermie, nah,  just in thecode I'm pulling over from Keystone heavy23:00
*** davlap has quit IRC23:02
*** spiffxp has joined #openstack-dev23:04
*** mfer has joined #openstack-dev23:04
znsayoung: why/where does tenant need role?23:04
ayoungzns, you act like I'm supposed to actually have designed this.  I'm just hacking until I get a passed unit test23:05
ayoungthere is an API where you get users for tenants,  and it can pass back the assocaited roles as well.  I am just removeing that for now23:05
znsayoung: sorry about that. But I ask because I don't know where there is a dependency on roRole from Tenant in models.py and you seem to have just bumped up against it...23:06
ayoungzns, it is specifically in the LDAP code,  the call is23:06
znsayoung: got it. You're talking about models.py in one of the backends then...23:06
ayoungzns, well,  this is actually just the LDAP code,  not models.py,  but bascially, yes23:07
znsayoung: makes sense now.23:07
*** davlap has joined #openstack-dev23:07
ayoungit is role.py/RoleAPI and tenant.py/TenantAPI in the code I snagged from backends/ldap23:07
*** apevec has joined #openstack-dev23:08
vishymtaylor: well look it appears to be the exact error we were discussing with rootwrap earlier :)23:10
*** oneiroi has joined #openstack-dev23:11
*** oneiroi has joined #openstack-dev23:11
vishyadam_g: any luck figuring out why you are getting a 0 from nova-rootwrap?23:11
*** jog0 has quit IRC23:13
*** jog0 has joined #openstack-dev23:13
ayoungtermie, so far so good.  Unit test is now just choking on the get_metadata part,  which I have not yet implemented.23:15
adam_gvishy: yeah, its not wait()'ing on the subprocess obj23:15
adam_gvishy: im looking through other code to see if thats a mistake or by design23:16
adam_gvishy: any idea?23:16
ayoungtermie, zns does metatdata *have* to be there?23:16
vishyadam_g: i think that is a bug23:16
*** andrewsmedina has joined #openstack-dev23:16
vishyadam_g: perhaps I should change my code to check for 25523:17
adam_gvishy: yeah, im testing right now with my original patch reverted, seems to work as you had originally intended23:18
adam_gthat is, an exception is properly raised and discovery is setn23:18
znsayoung: it's not required by the 2.0 API contract. It's common in other OpenStack APIs and is highly useful, so it might show up soon… but I can't speak to if it is required in ksl. termie?23:20
ayoungzns, what is it?23:20
znsmetadata… does not *have* to be there by API spec.23:21
znsIn fact, spec does not allow for it...23:21
*** apevec has quit IRC23:21
ayoungHah.  OK...I'm going to go eat dinner.  I''l have something to post later on tonight.23:22
*** ayoung is now known as ayoung-afk23:22
znsayoung: bon apetit & thanks23:22
*** mdomsch has quit IRC23:24
*** apevec has joined #openstack-dev23:25
vishyadam_g: I think this is a bit better: https://review.openstack.org/#change,386523:27
vishyany core reviewers around? I think this one has enough +1s https://review.openstack.org/#change,377823:29
vishyin fact i have about 5 branches waiting on reviews23:30
*** littleidea has quit IRC23:33
*** vincentricci has joined #openstack-dev23:34
adam_gvishy: ill give that a shot with the rootwrapper fixed23:34
*** dwalleck_nova has quit IRC23:34
*** oneiroi has quit IRC23:37
vishyadam_g: if you do a bug report and prop for the rootwrapper fix, I will +2 it :)23:39
adam_gvishy: ack. im a bit terrified of fixing that, TBH. :)23:40
vishyadam_g: really? It clearly was supposed to wait for the result before returning23:42
vishyi'm sure it was just overlooked23:42
*** zns has quit IRC23:45
vishyadam_g: If you are really worried, I will throw the fix in :)23:45
adam_gvishy: no, kidding. im curious if that was masking other less obvious failures23:47
vishyadam_g: could be23:50
*** Mandell_ has quit IRC23:50
vishyi guess we will find out when we merge it23:50
vishyadam_g: yeah just verified with sleep 5, returns immediately23:50
*** adjohn has joined #openstack-dev23:50
*** nati2 has joined #openstack-dev23:51
vishyand false just returns 0 :)23:51
*** zzed has quit IRC23:52
*** dtroyer has quit IRC23:52
*** Yak-n-Yeti has joined #openstack-dev23:53
openstackgerritA change was merged to openstack/nova: Update cfg from openstack-common  https://review.openstack.org/372923:54
*** davlap has quit IRC23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!