Wednesday, 2011-08-17

openstackjenkinsProject burrow build #32: SUCCESS in 11 sec: https://jenkins.openstack.org/job/burrow/32/00:02
openstackjenkinsTarmac: Cleaned up WSGI frontend.00:02
*** bengrue has quit IRC00:03
*** zns has joined #openstack-dev00:06
*** zns1 has joined #openstack-dev00:11
*** zns has quit IRC00:13
mtaylorvishy: ok- that was pretty easy00:13
mtaylorvishy: lemme get this uploaded somewhere and fire off a bug00:14
vishycoolness00:14
mtaylorvishy: they may bitch about lack of manpages ...00:14
*** heckj has quit IRC00:23
mtaylorvishy: k. bug filed - cc'd you on it00:23
mtaylorvishy: do you need it in archive right now? or can I do that bit tomorrow?00:24
vishymtaylor: tomorrow is fine00:26
mtaylorcool. that allows for more beer00:26
*** donald650 has joined #openstack-dev00:26
*** mwhooker has quit IRC00:35
*** mwhooker has joined #openstack-dev00:36
*** donald650 has quit IRC00:39
*** chipc has joined #openstack-dev00:46
*** Tushar has joined #openstack-dev00:47
*** jakedahn has quit IRC00:48
*** anotherjesse_ has joined #openstack-dev00:51
*** anotherjesse_ has quit IRC00:51
*** anotherjesse has quit IRC00:55
*** anotherjesse has joined #openstack-dev00:56
*** anotherjesse has quit IRC01:00
*** martine has joined #openstack-dev01:02
openstackgerritVerification of a change to openstack/keystone failed: More contract changes  https://review.openstack.org/25201:06
*** chipc has quit IRC01:11
*** Tushar has quit IRC01:22
openstackgerritZiad Sawalha proposed a change to openstack/keystone: More contract changes  https://review.openstack.org/25201:25
*** vladimir3p has quit IRC01:25
*** mfer has joined #openstack-dev01:30
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Contract changes  https://review.openstack.org/25201:31
openstackgerritA change was merged to openstack/keystone: Contract changes  https://review.openstack.org/25201:34
*** jakedahn has joined #openstack-dev01:34
*** zns1 has quit IRC01:35
*** chipc has joined #openstack-dev02:28
*** hisaharu has quit IRC02:28
*** mfer has quit IRC02:45
*** jakedahn has quit IRC03:16
*** jakedahn has joined #openstack-dev03:18
openstackgerritMonty Taylor proposed a change to openstack/openstack-ci: Added a version of the rfc script from gluster.  https://review.openstack.org/23503:21
openstackgerritMonty Taylor proposed a change to openstack/openstack-ci: Added a version of the rfc script from gluster.  https://review.openstack.org/23503:22
*** dolphm_ has quit IRC03:30
*** jakedahn has quit IRC03:31
*** anotherjesse has joined #openstack-dev03:43
*** jakedahn has joined #openstack-dev03:51
*** martine_ has joined #openstack-dev03:59
*** zns has joined #openstack-dev04:00
*** martine_ has quit IRC04:00
*** martine_ has joined #openstack-dev04:00
*** nmistry has joined #openstack-dev04:01
*** martine_ has quit IRC04:01
*** chipc has quit IRC04:02
*** amccabe has joined #openstack-dev04:10
*** zul has quit IRC04:16
*** martine has quit IRC04:16
*** zaitcev has quit IRC04:22
*** nmistry has quit IRC04:28
*** anotherjesse has quit IRC04:35
*** anotherjesse has joined #openstack-dev04:50
*** anotherjesse has quit IRC04:58
*** reidrac has joined #openstack-dev06:55
*** toluene has joined #openstack-dev08:06
toluenehi!08:06
*** mnour has joined #openstack-dev08:30
*** amccabe has quit IRC08:38
*** rods has joined #openstack-dev09:56
*** progers has joined #openstack-dev10:01
openstackgerritYuriy Taraday proposed a change to openstack/keystone: Made all sample data loading in one script.  https://review.openstack.org/25510:26
*** progers has left #openstack-dev10:30
*** titaniumrain_ has joined #openstack-dev10:36
*** toluene has quit IRC11:11
*** markvoelker has joined #openstack-dev11:16
*** mfer has joined #openstack-dev11:38
*** bsza has joined #openstack-dev12:11
*** deshantm_laptop has joined #openstack-dev12:17
*** titaniumrain_ has quit IRC12:17
*** lorin1 has joined #openstack-dev12:19
*** lorin1 has left #openstack-dev12:21
*** zns has quit IRC12:38
*** lts has joined #openstack-dev12:43
sandywalshjaypipes, around?13:15
jaypipessandywalsh: nope.13:15
sandywalshphew13:15
jaypipessandywalsh: :) course I am.13:15
jaypipessandywalsh: what's new, Canadian?13:15
sandywalshjaypipes, I added some notes on the glance zone etherpad http://etherpad.openstack.org/GlanceZones13:16
sandywalshjaypipes, be interested on your $0.02 CDN13:16
jaypipessandywalsh: looking. :)13:16
*** zns has joined #openstack-dev13:18
jaypipessandywalsh: so, Glance now has support for shared image groups and keystone authentication (Vek's code was merged yesterday)13:18
jaypipeszns: ah, good morning fellow.13:18
*** joesavak has joined #openstack-dev13:19
*** ameade has joined #openstack-dev13:20
sandywalshjaypipes, cool ... wasn't sure how deep he had gone with it (beyond basic auth) ... I guess my larger concern is the potential single point of failure.13:21
*** dprince has joined #openstack-dev13:22
jaypipessandywalsh: I raised that concern as well..13:22
znsjaypipes: monin :-)13:23
sandywalshjaypipes, thoughts on the pubsubhubbub sync from the zone-specific registries back to the global registry? and using the keystone Service Catalog to find the set of endpoints?13:24
jaypipessandywalsh: I think that the idea we settled on was to have a single global glance registry for Rackspace that would house "golden" images or public images shared by partners like RightScale. Then have regional Glance registries that are essentially read-only slaves of the global registry. In addition, to provide redundancy and locality of data, introduce a set of image replica locations that regional glance API nodes13:25
jaypipes would use to find the "closest" image copy...13:25
sandywalshjaypipes, does that mean you can only restore a backup within the zone it was created in?13:26
jaypipessandywalsh: no. it would backup the image to the local zone glance API server, register it with the global registry database, then replicate itself to separate locations.13:26
jaypipessandywalsh: with a configurable setting for after X copies of the backup are stored, return success...13:27
jaypipessandywalsh: of course, if you are storing the backups in Swift, Swift handles that redundancy for you..13:28
sandywalshjaypipes, replicate the image or the metadata/registry entry?13:28
jaypipessandywalsh: just not currently across multiple zones...13:28
jaypipessandywalsh: replicate the image file itself. the metadata would go to the global registry and be "replicated" via standard MySQL replication...13:28
jaypipessandywalsh: in other words, there is no local read/write glance registries..13:29
sandywalshjaypipes, that was a real surprise for me in the design. I assume Swift did all that redundancy for us and that it would be deployed as a fabric underneath the nova zones (much like keystone is)13:29
sandywalsh*assumed13:29
jaypipessandywalsh: are you surprised that Swift doesn't do cross-zone replication or surprised with the global glance registry design?13:30
sandywalshjaypipes, well both, but that swift would only be deployed per-zone and not as a larger fabric13:30
jaypipessandywalsh: well, you will have to discuss the swift question with s1rp and pvo (I'm not familiar enough with the discussion on that... I *think* it has to do with limitations in Swift itself, but I may be wrong). For the global glance registry, the design decision was made mostly because of a desire by product management to have a single URI to refer to an image...13:32
sandywalshjaypipes, yeah, I can see the attraction of a single URI, but we could still take a DNS-like approach to resolving the final destination vs. assuming 1 large/stationary registry (I think). A set of registries that could resolve the URI.13:34
jaypipessandywalsh: sure, that is true I suppose. I think this route was taken because it was easier and faster, with the thought that we would tackle the scale-out concerns in a phase 2.13:37
jaypipessandywalsh: with "intermediate scale-out" resolved with the introduction of image replicas...13:37
sandywalshjaypipes, yeah, fair enough. I guess the only "critical" design feature would be to settle on UUID/URI vs. integer ID, for now.13:37
jaypipessandywalsh: I think that's a settled issue. It's just a matter of prioritizing that and making it happen...13:38
sandywalshjaypipes, ok, cool. thanks for the feedback sir!13:39
jaypipessandywalsh: any time! :)13:39
jaypipessandywalsh: Erik Carlin is a good person to talk to about this, too.13:39
sandywalshjaypipes, gotcha ... his notes in the etherpad do reflect more of the requirements that I'm perhaps not privy to13:40
jaypipessandywalsh: ya, no worries. Erik's always up for a chat about this stuff. Very approachable about it...13:41
sandywalshjaypipes, excellent, will do13:41
jaypipessandywalsh: the only thing I've been pushing back on in the design stuff is to make sure the design decisions we make are optional.. we cannot assume that Rackspace is the only use-case for Glance. So, things like a global registry must not be assumptions in the core architecture. They must be options...13:42
jaypipessandywalsh: and by "pushing back" I didn't mean to sound like I've been a negative Nancy. Just pointing out that making things configurable is the way to go..13:43
sandywalshjaypipes, understood. I'm really just focused on the issue where, let's say, ORD goes down and we have a black hole. The "optional" requirement is a valid one ... just as we're becoming more dependent on keystone.13:44
jaypipessandywalsh: well, *technically* Keystone is optional in Glance :) However, without *some* auth solution (Keystone or otherwise), you don't get a bunch of additional functionality (like shared image groups, attribute ownership, etc). But, that said, a Glance registry for a few global, public images doesn't need authentication at all...13:46
sandywalshjaypipes, right. So how would bursting (public/private clouds) work? Does the private cloud need to adopt the public clouds image registry?13:48
jaypipessandywalsh: totally depends on the specific requirements of the relationship. If the private cloud is attempting to boot an instance in a public cloud, and supplies an image ID that refers to a publically accessible image on their own auth-less Glance registry, absolutely nothing needs to change. If they supply an image ID to an auth-enabled private Glance registry, the public cloud's user/tenant would be used to dete13:49
jaypipesrmine if the supplied image ID is available to them.13:49
*** zul has joined #openstack-dev13:52
*** zul has quit IRC13:52
sandywalshjaypipes, yeah, that makes sense. They'd have to make their registry publicly available. However we could use federated auth so they don't have to depend on "auth-less" glance13:52
sandywalshjaypipes, I wouldn't want my backups to be publicly available13:52
jaypipessandywalsh: yes, once the oauth (and other) drivers are completed in Keystone.13:52
*** zul has joined #openstack-dev13:53
*** chipc has joined #openstack-dev13:58
openstackjenkinsProject nova build #1,260: SUCCESS in 3 min 35 sec: https://jenkins.openstack.org/job/nova/1260/14:00
openstackjenkinsTarmac: DB object was being casted to dict() in API code. This did not work as intended and logic has been updated to reflect a more accurate way of getting information out of DB objects.14:00
*** amccabe has joined #openstack-dev14:14
openstackgerritYuriy Taraday proposed a change to openstack/keystone: Made all sample data loading in one script.  https://review.openstack.org/25514:16
dolphm^^ awesome!14:16
uvirtbotdolphm: Error: "^" is not a valid command.14:16
dolphmuvirtbot: You only ever bark at me, and I don't even know what you're for.14:18
uvirtbotdolphm: Error: "You" is not a valid command.14:18
dolphmuvirtbot: :(14:18
uvirtbotdolphm: Error: ":(" is not a valid command.14:18
dolphmuvirtbot: sadness should be a command14:18
uvirtbotdolphm: Error: "sadness" is not a valid command.14:18
joesavakuvirbot: uvirbot sucks14:19
joesavakuvirtbot: uvirtbot sucks14:19
uvirtbotjoesavak: Error: "uvirtbot" is not a valid command.14:19
joesavakdamn right.14:19
dolphmuvirtbot: help me understand why you complain so much14:19
uvirtbotdolphm: Error: There is no command "me understand why you complain so much".14:19
dolphmuvirtbot: disconnect yourself14:20
uvirtbotdolphm: Error: "disconnect" is not a valid command.14:20
joesavakuvirtbot: quit()14:20
uvirtbotjoesavak: Error: "quit()" is not a valid command.14:20
joesavakdolph: quick q - "anp" is a new user to keystone and he's setting up the sample data in his install and using the dashboard to login. When loggin in he gets "class Roles has no attribute get_default_page"14:22
joesavakdolph: is this because keystone may be out of sync with dashboard?14:22
dolphmuvirtbot: eval('quit()')14:22
uvirtbotdolphm: Error: "eval('quit()')" is not a valid command.14:22
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Made all sample data loading in one script.  https://review.openstack.org/25514:23
dolphmjoesavak: i've never seen anything called "get_default_page" in keystone... let me look into it14:23
joesavakdolph: thanks14:23
dolphmjoesavak: it's got to be a dashboard issue... keystone sort of has a concept of pages, but not concept of 'default' pages14:26
joesavakdolph: thanks14:27
joesavakdolph: who do we go to for that?14:29
pvosandywalsh: re: multiple copies of an image in glanceā€¦.14:30
pvothe thinking was if you had an image in a dc in the US and you wanted to boot that image in the UK you wouldn't want to pay the bandwidth every time14:30
pvobut you would want to keep the same image id across all regions14:30
dolphmdevcamcar: jakedahn: ping ^^14:30
dolphmjoesavak: those are two of the top dashboard contributors in this channel (from https://launchpad.net/openstack-dashboard )14:31
*** cp16net has joined #openstack-dev14:31
pvoso you could have copies of that image nearby and the nova deployment would have a concept of regionality and try to pull the 'closest' copy of the image to save bandwidth.14:31
joesavakdolph: thanks14:31
zykes-&clea14:32
sandywalshpvo, makes sense. But it would have to be an explicit action by the user/sysadmin to place it in the optimal location, yes?14:32
pvoyes, its optional to do it that way.14:33
sandywalshpvo, otherwise the SP has to foot the bill of having a copy of the image in all locations14:33
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Minor fix to run_tests  https://review.openstack.org/25614:33
pvosandywalsh: yes, that is how I thought it would work. User moves it around and registers alternate locations.14:33
*** vladimir3p has joined #openstack-dev14:34
pvoI was wondering if we'd use something like mx preference or just let the zone try to match on dns.14:34
sandywalshmx?14:34
pvowhen you look up mail records in dns, there is a preferred order to try.14:35
sandywalshah, right ... was thinking some RS thing :)14:35
pvona, normal internet funtimes14:35
sandywalshI like the idea of the user setting their preference14:35
sandywalshwith possible overrides14:35
sandywalsh... less magic14:35
pvoyea, that would be my first iteration since it feels simpler.14:36
openstackgerritA change was merged to openstack/keystone: Minor fix to run_tests  https://review.openstack.org/25614:36
*** amccabe has quit IRC14:46
sandywalshhttp://www.colinhowe.co.uk/2011/aug/17/visualising-eventlet/14:46
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Made all sample data loading in one script.  https://review.openstack.org/25514:53
*** deshantm_laptop_ has joined #openstack-dev14:54
*** dragondm has joined #openstack-dev14:55
openstackgerritA change was merged to openstack/keystone: Made all sample data loading in one script.  https://review.openstack.org/25514:55
*** deshantm_laptop has quit IRC14:56
*** deshantm_laptop_ is now known as deshantm_laptop14:56
*** deshantm_laptop has quit IRC14:58
*** zul has quit IRC14:58
*** deshantm_laptop has joined #openstack-dev14:58
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Additional changes to fix minor service support stuff and increase test coverage. Also making validate token call available using service admin tokens  https://review.openstack.org/24214:59
openstackgerritVerification of a change to openstack/keystone failed: Additional changes to fix minor service support stuff and increase test coverage. Also making validate token call available using service admin tokens  https://review.openstack.org/24214:59
*** amccabe has joined #openstack-dev15:03
*** reidrac has quit IRC15:07
sandywalshjaypipes, if we have an image URL, why do we need the registry at all?15:16
*** martine has joined #openstack-dev15:16
pvosandywalsh: when you say image url, that is where the actual bits of the image are located?15:17
sandywalshpvo, I assume the only reason for the registry is to map "image name" or "unique image identifier" to a URL? So why not make the "unique image identifier" the URL and be done with it?15:18
*** mnour has quit IRC15:18
sandywalshpvo,  the payload from fetching the URL could be the metadata + another URL to the actual image15:18
sandywalshpvo, so the registry is nothing more than a static HTTP server15:19
*** mattray has joined #openstack-dev15:19
jaypipessandywalsh: the registry stores other information that is not in the URI (such as security creds) :)15:21
sandywalshjaypipes, what are the security creds? permissions on the image or something else?15:22
*** kbringard has joined #openstack-dev15:23
jaypipessandywalsh: such as user/key in Swift, accessky/secretkey in S3, etc. There is a "store URI" and the "image URI". The image URI might be http://glance.rackspace.com/images/1, but the store URI might be http://account:user:pass@ord1.rackspace.com/auth/v1/glance/1234515:23
*** deshantm_laptop has quit IRC15:23
jaypipessandywalsh: and when I mentioned image replicas earlier, what I was referring to is a single image URI being tied to multiple store URIs...15:24
*** dolphm_ has joined #openstack-dev15:24
sandywalshjaypipes, hmm, ok. I guess my confusion comes from assuming that swift was going to do all the heavy lifting and glance was just an API that made more sense to image management + metadata.15:25
sandywalshjaypipes, but it sounds like glance is also doing double duty on some things that swift does15:26
jaypipessandywalsh: no, it's not really...15:26
jaypipessandywalsh: what "things that swift does" is Glance doing?15:27
openstackgerritMonty Taylor proposed a change to openstack/openstack-ci-puppet: Prevent add-apt-repository from running every time  https://review.openstack.org/25715:27
notmynamejaypipes: sandywalsh: each storage URL is one logically autonomous cluster (with it's own replication). there are still use cases for storing soemthing in 2+ swift clusters. it's more costly to the user and/or deployer, but it can give you things like geographic redundancy15:27
sandywalshjaypipes, (again, excuse my ignorance here) ... does it also deal with image replication/movement/storage?15:27
openstackgerritVerification of a change to openstack/keystone failed: Additional changes to fix minor service support stuff and increase test coverage. Also making validate token call available using service admin tokens  https://review.openstack.org/24215:28
notmynamejaypipes: sandywalsh: at lest until we can solve wide geographic distribution in one logical swift cluster :-)15:28
jaypipessandywalsh: geographic redundancy is the only thing that Glance image replicas add15:29
sandywalshnotmyname, ah, ok, so swift doesn't deal with geographic replication15:29
jaypipessandywalsh: correct15:29
jaypipessandywalsh: yet, at least :)15:29
sandywalshgotcha ... I was assuming it did15:29
jaypipessandywalsh: I'm sure notmyname can code it up in a couple hours ;)15:29
sandywalshwouldn't that be the right place for it?15:30
notmynamejaypipes: np. I'll start by messing with changing c to lower latency so it doesn't cause any replication problems ;-)15:30
jaypipesexcellent :)15:30
*** zns1 has joined #openstack-dev15:31
notmynamesandywalsh: not necessarily. swift needs it (eventually). but not all deployers will be able to take advantage of it15:31
sandywalshheh, well glance would need to redefine C too wouldn't it? :)15:31
jaypipessandywalsh: what notmyname said ;)15:31
creihtI thought you just created a blueprint, then someone would come along and magically do it :)15:31
notmynamesandywalsh: for example, even if swift supports it, it would require big pipes between DCs.15:31
jaypipescreiht: the magic coding unicorn.15:31
sandywalshcreiht, yeah ... not the case?15:32
*** zns has quit IRC15:32
sandywalshnotmyname, but glance doing the replication has the same issue, no?15:32
sandywalshso, is the intention that the user explicitly dumps the images where desired so as to be fully aware of the added costs?15:33
notmynamesandywalsh: jaypipes: or, another cool implementation that would be totally in glance would be putting it in swift clusters provided by different deployers. (eg store in rackspace cloud files and internap and KT). each could be using swift's geographic features but still there is a use case for having it in glance15:33
notmynamein that example, rackspace could store it in DFW and ORD. but the use also stores in with KT for extra sooper dooper redundancy15:34
jaypipesnotmyname: that's definitely a cool feature, and something that the image replica functionality would address.15:34
sandywalshgotta step out for a bit ... tbc15:35
notmynameit's the big-scale version of glance storing it in 2 separate RAID volumes locally mounted.15:35
sandywalshnotmyname, any docs you would recommend on swift architecture?15:36
sandywalshor presentations?15:36
notmynamesandywalsh: what part?15:36
sandywalshredundancy, etc15:36
sandywalshnotmyname, no so much the api's, etc, but overall scalability, etc15:37
sandywalsh*not15:37
notmynamesandywalsh: swift.openstack.org is the best place to start. we may have a few presentations floating around, but I'm not sure if they would be detailed enough15:37
*** zul has joined #openstack-dev15:37
sandywalshnotmyname, cool ... I'll give them a look ... thanks15:37
notmynamesandywalsh: most of the knowledge sharing there involved a whiteboard and a few hours of one-on-one time :-)15:37
sandywalshnotmyname, summit is coming up!15:38
notmynamesandywalsh: indeed15:38
notmynameand it looks like I'll be talking at the bay area meetup in a couple of weeks too15:38
*** ohnoimdead has joined #openstack-dev15:40
*** rnirmal has joined #openstack-dev15:41
*** troytoman-away is now known as troytoman15:47
*** zul has quit IRC15:50
*** hisaharu has joined #openstack-dev15:58
*** dprince has quit IRC16:01
*** jsavak has joined #openstack-dev16:04
*** joesavak has quit IRC16:05
*** joesavak has joined #openstack-dev16:06
*** jsavak has quit IRC16:09
*** rnirmal has quit IRC16:12
*** rnirmal has joined #openstack-dev16:12
openstackgerritA change was merged to openstack/openstack-ci: Added a version of the rfc script from gluster.  https://review.openstack.org/23516:14
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Additional changes to fix minor service support stuff and increase test coverage. Also making validate token call available using service admin tokens  https://review.openstack.org/24216:16
openstackgerritA change was merged to openstack/keystone: Additional changes to fix minor service support stuff and increase test coverage. Also making validate token call available using service admin tokens  https://review.openstack.org/24216:18
openstackgerritDolph Mathews proposed a change to openstack/keystone: Tests running on in-memory sqlite db  https://review.openstack.org/25816:32
*** zns1 has quit IRC16:33
openstackgerritMonty Taylor proposed a change to openstack/openstack-ci-puppet: Added debian package building slave definition.  https://review.openstack.org/25916:41
openstackgerritMonty Taylor proposed a change to openstack/openstack-ci-puppet: Added debian package building slave definition.  https://review.openstack.org/25916:41
*** kbringard has quit IRC16:45
*** bengrue has joined #openstack-dev16:50
*** dprince has joined #openstack-dev16:50
openstackgerritMonty Taylor proposed a change to openstack/openstack-ci-puppet: Add rfc.sh.  https://review.openstack.org/26016:51
openstackgerritA change was merged to openstack/openstack-ci-puppet: Add rfc.sh.  https://review.openstack.org/26016:52
*** ohnoimdead_ has joined #openstack-dev16:52
*** ohnoimdead has quit IRC16:56
*** ohnoimdead_ is now known as ohnoimdead16:56
*** rnirmal has quit IRC16:56
openstackgerritA change was merged to openstack/openstack-ci-puppet: Added debian package building slave definition.  https://review.openstack.org/25916:58
openstackgerritDolph Mathews proposed a change to openstack/keystone: Keystone manage.py cleanup  https://review.openstack.org/26117:01
*** mnaser has joined #openstack-dev17:08
*** zns has joined #openstack-dev17:10
*** kbringard has joined #openstack-dev17:10
*** kbringard has left #openstack-dev17:10
*** Tushar has joined #openstack-dev17:11
*** anotherjesse has joined #openstack-dev17:12
openstackgerritJames E. Blair proposed a change to openstack/openstack-ci: Update blueprint script to add topic links.  https://review.openstack.org/26217:15
*** jakedahn has quit IRC17:16
*** jsavak has joined #openstack-dev17:18
*** joesavak has quit IRC17:21
*** ohnoimdead has quit IRC17:23
*** ohnoimdead has joined #openstack-dev17:23
*** glenc has joined #openstack-dev17:27
openstackgerritA change was merged to openstack/keystone: Tests running on in-memory sqlite db  https://review.openstack.org/25817:33
*** mgius has joined #openstack-dev17:36
openstackgerritA change was merged to openstack/keystone: Keystone manage.py cleanup  https://review.openstack.org/26117:37
*** dragondm has quit IRC17:39
*** anotherjesse_ has joined #openstack-dev17:43
*** anotherjesse has quit IRC17:46
*** anotherjesse_ is now known as anotherjesse17:46
*** kbringard has joined #openstack-dev17:52
*** kbringard has left #openstack-dev17:52
*** BK_man has joined #openstack-dev17:53
*** dprince has quit IRC17:58
openstackgerritJames E. Blair proposed a change to openstack/openstack-ci-puppet: Rename test repo on gerrit dev server.  https://review.openstack.org/26317:59
openstackgerritA change was merged to openstack/openstack-ci-puppet: Rename test repo on gerrit dev server.  https://review.openstack.org/26317:59
*** zns has quit IRC18:02
*** zns has joined #openstack-dev18:02
*** zns1 has joined #openstack-dev18:07
*** zns has quit IRC18:09
*** dfg has quit IRC18:19
*** sandywalsh has quit IRC18:20
*** rnirmal has joined #openstack-dev18:21
*** dfg has joined #openstack-dev18:21
*** jakedahn has joined #openstack-dev18:24
*** jakedahn has joined #openstack-dev18:24
*** sandywalsh has joined #openstack-dev18:24
*** rnirmal has quit IRC18:25
*** rnirmal has joined #openstack-dev18:26
*** _cerberus_ has quit IRC18:33
*** dragondm has joined #openstack-dev18:37
*** cp16net has quit IRC18:38
*** dprince has joined #openstack-dev18:43
*** bengrue has quit IRC18:43
*** mwhooker has quit IRC18:54
*** Gordonz has quit IRC18:55
*** Gordonz has joined #openstack-dev19:04
*** anotherjesse has quit IRC19:07
*** anotherjesse has joined #openstack-dev19:07
*** zns1 has quit IRC19:07
*** zns has joined #openstack-dev19:10
*** _cerberus_ has joined #openstack-dev19:21
*** ChanServ sets mode: +v _cerberus_19:21
*** yogirackspace has joined #openstack-dev19:23
*** mwhooker has joined #openstack-dev19:23
mwhookerHi all. If anyone has some time I'd appreciate a review of https://code.launchpad.net/~u-matt-h/nova/aws-api-validation I still need to do some functional testing, but it's a pretty good first draft. It resolves https://blueprints.launchpad.net/nova/+spec/aws-api-validation19:24
zykes-aws api ?19:27
*** lts has quit IRC19:31
mwhookerzykes-: how do you mean?19:32
openstackgerritDolph Mathews proposed a change to openstack/keystone: Admin WADL Revisions  https://review.openstack.org/26419:33
*** mszilagyi has joined #openstack-dev19:47
smoserif an instance goes to 'shutdown' is there a way to start it ?19:57
*** Guest77784 has quit IRC19:59
*** rnirmal has quit IRC20:00
*** dprince has quit IRC20:01
openstackgerritJames E. Blair proposed a change to openstack/openstack-ci-puppet: Add exim config to all servers.  https://review.openstack.org/26520:03
openstackgerritA change was merged to openstack/openstack-ci-puppet: Add exim config to all servers.  https://review.openstack.org/26520:05
*** BK_man has quit IRC20:05
openstackgerritA change was merged to openstack/openstack-ci: Update blueprint script to add topic links.  https://review.openstack.org/26220:06
vishydprince: ping20:07
openstackgerritMonty Taylor proposed a change to openstack/openstack-ci-puppet: Prevent add-apt-repository from running every time  https://review.openstack.org/25720:08
vishyblamar_: is dprince around?20:11
blamar_vishy: not for the moment, can I help out? I think he might be online later tonight, but out of the office20:12
*** jc_smith has left #openstack-dev20:12
vishyblamar_: i had some questions about smokestack.  Mostly, I'd like to know how one debugs a failure20:13
*** zul has joined #openstack-dev20:14
openstackgerritA change was merged to openstack/openstack-ci-puppet: Prevent add-apt-repository from running every time  https://review.openstack.org/25720:14
jaypipesvishy: look at the smokestacktrace? ;)20:14
vishyjaypipes: yeah the outuput is not incredibly useful... :)20:15
blamar_vishy: depends where/how it fails. you'll get some that say "failed to build packages", "OSAPI tests failed", "smoketests failed", and other messages which give you some information, otherwise you'll need to resort to stdout/stderr20:17
blamar_Finished in 71.498338 seconds.20:17
blamar_  1) Error:20:17
blamar_test_create_server(TestServers):20:17
blamar_RuntimeError: Timeout trying to ssh to server: 192.168.0.220:17
* blamar_ apologizes for non-paste20:18
*** kbringard has joined #openstack-dev20:18
jk0jaypipes: the def integer() comment made me LOL20:30
jk0good catch20:30
jaypipesjk0: :)20:30
kbringardhey jaypipes, have you seen this?20:31
kbringardhttp://paste.openstack.org/show/2191/20:31
kbringardmy migrate version is 720:32
*** zul has quit IRC20:37
*** Guest77784 has joined #openstack-dev20:37
jaypipeskbringard: yeah, nothing to do with migrate... add this to your glance-registry.conf, in the filter:context section:20:37
jaypipescontext_class = glance.registry.context.RequestContext20:38
jaypipeskbringard: should look like this:20:38
jaypipes[filter:context]20:38
jaypipescontext_class = glance.registry.context.RequestContext20:38
jaypipespaste.filter_factory = glance.common.context:filter_factory20:38
kbringardawesome, looks to be working again, thanks homie20:39
jaypipeskbringard: any time :)20:40
mtaylorjaypipes: the glance ppa has packages for python-gflags and python-greenlet - these are not in the nova ppa20:43
mtaylorjaypipes: does glance still need these (or special versions of them?)20:44
mtaylorjaypipes: oh - nevermind- those are lucid packages20:44
jaypipesmtaylor: not gflags. not sure about greenlet. whatever is in Swift for greenlet, Glance would need.20:44
jaypipesmtaylor: ah, l20:44
jaypipesk, even20:44
mtaylorjaypipes: let me re-phrase that question then - do we need to support lucid?20:44
jaypipesmtaylor: yes.20:45
mtaylorjaypipes: ok. great20:45
jaypipesmtaylor: :)20:45
dolphmif anyone is interested, i think the core keystone API has been pretty much nailed down: https://blueprints.launchpad.net/keystone/+spec/identity-api20:46
vladimir3pvishy: ping20:46
tr3buchethas anyone run into issue creating venv? import error no module named nose?20:47
vishyvladimir3p: pong20:47
vladimir3pvishy: are you aware of any plans to support PCI passthrough in nova?20:47
vladimir3pvishy: I will explain:20:47
vishytr3buchet: ubuntu, osx?20:47
vishyvladimir3p: no plans yet, but it would be cool to support it20:47
vladimir3pvishy: would like to create a new instance_type wth extra spec that will specify that particular instance will need to receive a PCI device of type X20:48
vladimir3pvishy: if this device supports SR-IOV we could find an non-used Virtual Function (VF) and assign it to it20:48
vishyadding pci passthrough would be awesome, it will be a little tricky at the driver layer20:48
vladimir3pvishy: it might be a NIC or SAS HBA, etc...20:48
vishysounds like a great addition20:49
vladimir3pvishy: ok, great. we will take a look20:49
vladimir3pvishy: as part of it we would like to create "plug-ins" for Cheetah templates ...20:49
vladimir3por if PCI passthrough will be part of nova we could just add some special code there20:50
vladimir3p(and avoid tricky plugins)20:50
DavieyWhat bug num was the reporting of all instances, even terminated ones since genisis?20:50
vishyblamar_: mostly i'm trying to figure out why my keystone-migration-ec2 branch is breaking20:50
Davieyit was reported recently20:51
vladimir3pDaviey: it was 82400820:51
Davieyvladimir3p: thanks!20:52
vishybug 824008 ...damn20:52
uvirtbotLaunchpad bug 824008 in nova "euca-describe-instances shows all instances in all states (even terminated)" [Undecided,In progress] https://launchpad.net/bugs/82400820:52
vladimir3pDaviey: pls recheck your code against latest nova ver. It might be already fixed by unrelated merge20:53
tr3buchetvishy: ubuntu20:54
*** Guest77784 has quit IRC20:55
vishytr3buchet: darn20:56
tr3buchetvishy: You were all set with a good osx answer?20:56
*** Guest77784 has joined #openstack-dev20:56
vishytr3buchet: i know pip-requires fails on lion because it can't install m2crypto20:56
*** ameade has quit IRC20:57
Davieyvladimir3p: Yeah, i just read the bug - thanks for tackling that so quickly20:57
vladimir3pDaviey: u r welcome. it affected us as well.20:58
tr3buchetah ok20:58
tr3buchetinstalled a couple of dev libraries i'll see if works now20:58
vishytr3buchet: has anyone else noticed that nova-api main process exits immediately after forking subprocesses.  This seems to be new...21:00
vishytr3buchet: that wasn't directed specifically to you, but since you are here...21:01
*** zul has joined #openstack-dev21:01
openstackgerritJames E. Blair proposed a change to openstack/openstack-ci-puppet: Add gitweb to gerrit servers.  https://review.openstack.org/26621:04
*** BK_man has joined #openstack-dev21:04
vishycurrently we are blaming python-kombu21:04
redboprobably something really complicated like photoshop21:04
redboack21:04
*** ohnoimdead_ has joined #openstack-dev21:05
vishyredbo: are you using the new openstack-photoshop plugin?21:05
*** BK_man has quit IRC21:05
Davieyvishy: kombu?  for nova?21:07
Davieyvishy: I have an initial patch to try to support that, has someone else taken it further?21:07
*** zul has quit IRC21:07
*** ohnoimdead has quit IRC21:08
*** ohnoimdead_ is now known as ohnoimdead21:08
redbovishy: it's very nice, but I'm not sure I agree with the architecture.  It put my image on a queue to a be handled by a gaussian blur worker.21:08
*** martine has quit IRC21:10
tr3buchetvishy: i hadn't noticed ;)21:12
vishyit is apparently a glance dep now21:13
openstackgerritJames E. Blair proposed a change to openstack/openstack-ci-puppet: Cleanup.  https://review.openstack.org/26721:14
jaypipesvishy: doesn't nova require kombu, too?21:14
vishynot yet21:15
vishyuses carrot21:15
Davieyjaypipes: no, there is a bug21:15
openstackgerritMonty Taylor proposed a change to openstack/keystone: Add run_tests.* to the MANIFEST.in.  https://review.openstack.org/26821:15
jaypipesDaviey: I see21:16
Davieyvishy / jaypipes: I did a first pass using the kombu compat with carrot module.. http://pb.daviey.com/Dx2d/21:16
Davieynot finished yet.21:16
openstackgerritA change was merged to openstack/openstack-ci-puppet: Add gitweb to gerrit servers.  https://review.openstack.org/26621:16
jaypipesk21:16
Davieyrequires a new version of kombu than is in Debian or Ubuntu, which in turn requires a newer ampqlib.. so started to get painful21:17
openstackgerritA change was merged to openstack/keystone: Add run_tests.* to the MANIFEST.in.  https://review.openstack.org/26821:17
mtaylordolphm: you are a god21:17
dolphmmtaylor:  /salute21:17
zykes-why use gitweb to gerrit ?21:18
jeblairzykes-: if gitweb is installed, gerrit will provide gitweb links to its internal repos21:19
ironcameli started to look at doing the carrot -> kombu switch. it got to be very hairy.21:19
ironcamelthere is a lot of seemingly overcomplicated things going on in amqp.py21:19
jeblairzykes-: can be useful for examining changes, looking at internal states, etc.21:19
mtaylorDaviey: I had started down the road of doing amqplib backports, but then stopped when glance didn't need _that_ new of a version of kombu21:19
ironcamelsuch as extending the carrot connection class, etc.21:19
Davieywell, i'd like to know if glance does work with the newer upstream version of kombu and ampq.21:20
DavieyI don't want to fix nova to break glance :)21:20
zykes-jeblair: meaning ?21:20
mtaylorDaviey: agree. I'd also spun up a node on which to install newer versions of things to test that ... but then did something else21:20
Davieyi did notice that kombu seems to have a richer fakerabbit.py.. so we might be able to drop the nova one21:21
Davieyironcamel: If you want to compare patches and keep working on it, i'd most appreciate it :)21:21
mtaylorvishy: we're hanging on jenkins/tarmac in nova test cases again21:23
mtaylorvishy: which is probably something that should be sorted out - is there anything I can do to help track down why/where we're hanging?21:23
jeblairzykes-: it's a feature gerrit provides with no effort on our part that allows you to view changes and tree history in context through the web (before or after being merged).  it's not a huge change, just a few gitweb links will show up next to changes.21:24
jeblairzykes-: you can see an example here: https://review-dev.openstack.org/#change,2521:24
mtaylordolphm: when I run run_tests.sh from a source tarball, I get: Starting test 1 of 2 with config: sql.conf.template ... [Errno 2] No such file or directory: keystone/test/etc/sql.conf.template21:30
anotherjessesoren: in a talk about training - will ping in an hour about the test stuff - sorry for delay21:31
mtaylordolphm: nevermind - typing it makes me see the issue21:31
dolphmmtaylor: that file should definitely be there? lol21:31
vishymtaylor: not sure21:32
vishymtaylor: tracking down another odd bug at the moment21:32
mtaylorvishy: ok. I'll try to poke at it myself in a bit21:32
sorenanotherjesse: I'm on my way to bed, so e-mail me instead :)21:33
*** mnaser has quit IRC21:34
anotherjessesoren: k21:34
vishywhy does everyone try to add multiprocessing in with eventlet :(21:37
*** jsavak has quit IRC21:38
*** chipc has quit IRC21:38
mtaylorvishy: because it'll make it just magically work without having to learn about anything? :)21:38
notmynameconcurrency is hard! let's add eventlet!21:39
zykes-vishy: what's bad with eventlet ?21:39
kbringardwe need to start a quote wall on the wiki21:40
*** yogirackspace has left #openstack-dev21:41
*** amccabe has quit IRC21:43
creihtzykes-: nothing, just the multiprocessing libs and eventlet don't play well together21:44
zykes-ah21:44
*** bengrue has joined #openstack-dev21:46
vishyeventlet is fine, just greenthreads + multiprocessing has bad issues21:47
vishyi spent weeks debugging it in twisted21:47
ironcamelDaviey: do you have a public branch for the kombu stuff?21:48
zykes-twisted vishy and eventlet ?21:50
vishytwisted + multiprocessing21:50
zykes-isn't twisted 1 thread ?21:50
Davieyironcamel: just the diff pasted above21:51
Davieyironcamel: I made some other changes to try and prod the test suite through, but nothing worth committing21:52
*** mfer has quit IRC21:54
openstackgerritMonty Taylor proposed a change to openstack/keystone: Add the files in keystone/test/etc.  https://review.openstack.org/26921:58
ironcamelDaviey: i don't see it. can you link to your patch again?21:58
*** mfer has joined #openstack-dev22:05
*** zns has quit IRC22:07
openstackgerritA change was merged to openstack/keystone: Add the files in keystone/test/etc.  https://review.openstack.org/26922:08
Davieyironcamel: it was a first pass, using the kombu compat with carrot module. http://pb.daviey.com/Dx2d/22:11
DavieyNote, it requires a newer upstream version of kombu than in debian or ubuntu. Which in turn requires ampqlib >= 1.0 IIRC22:12
Davieynewer upstream version, anyway22:12
*** kbringard has quit IRC22:16
*** mfer has quit IRC22:22
*** zns has joined #openstack-dev22:27
openstackgerritDolph Mathews proposed a change to openstack/keystone: Admin WADL Revisions  https://review.openstack.org/26422:34
*** dolphm has quit IRC22:37
ironcamelDaviey: i had assumed that the kombu carrot combat approach wouldn't work because of the crazy way we are using carrot22:37
ironcamels/combat/compat/22:37
*** ohnoimdead has quit IRC22:37
ironcameldid you have any luck with this?22:37
*** kbringard has joined #openstack-dev22:38
*** ohnoimdead has joined #openstack-dev22:40
*** mnaser has joined #openstack-dev22:40
*** zns has quit IRC22:41
openstackgerritA change was merged to openstack/keystone: Admin WADL Revisions  https://review.openstack.org/26422:41
vladimir3pvishy: ping22:41
vishysexified22:41
vladimir3pvishy: :-) any update on volume types/extra-data BP? Should we take it?22:42
*** mattray has quit IRC22:43
vishyvladimir3p: I am devoting all of tomorrow to it22:43
vishyvladimir3p: if you want to break off a chunk and do it it would be very helpful22:43
*** zns has joined #openstack-dev22:44
vishythe api layer stuff is basically just a straight copy from the instances stuff22:44
vladimir3pvishy: cool, thanks. I will check if we have any available resource or I will do it by myself. Just want to know if we should expect anything or just do it22:44
vladimir3pit seems like pretty straight-forward copy/paste, yeah22:44
vishyvladimir3p: I'm pairing with it on a guy from piston, but we have other cleanup related to volumes, so if you want to take some of it I'm all for it22:45
vladimir3pvishy: I've seen their branch for volume-cleanup ... currently it is mainly removal of AOE22:46
vladimir3pnot sure what eaxctly their plains WRT cleanup, so I will leave it up to them22:46
vladimir3pbut w ecan take types & extra-data22:46
vishythere is a blueprint showing the extra specs22:46
vladimir3pyep22:46
vishyi and there is one for changes as well22:47
vishyif you're curious what we are planning22:47
vishyclean up discovery / ips in the database / chap22:47
vishymosly22:47
vladimir3pvishy: ok22:47
vladimir3pvishy: pls let me know when you will have any update from Piston. If they've already started we can wait :-)22:48
vladimir3pvishy: also, when you will have a chance, can you pls send a summary of what we've discussed last week?22:49
*** ohnoimdead has quit IRC22:54
*** _cerberus_ has quit IRC22:55
mwhookeris there a quick & easy way to test the ec2 api? (perhaps without installing all of nova)22:56
*** kbringard has quit IRC22:59
*** mnaser has quit IRC23:01
*** mnaser has joined #openstack-dev23:01
vishyvladimir3p: they haven't started on that part yet23:02
vishytomorrow we are pairing on it23:02
vishymwhooker: test_cloud in unit tests?23:02
*** bsza has quit IRC23:02
mwhookervishy: I'm trying to go through the whole msgi middleware stack. doesn't look like this file does that23:05
mwhookerthinking functional tests23:05
*** troytoman is now known as troytoman-away23:07
*** ohnoimdead has joined #openstack-dev23:08
*** tushar_ has joined #openstack-dev23:10
*** Tushar has quit IRC23:11
*** mfer has joined #openstack-dev23:11
vishymwhooker: it goes through most of it23:12
vishysmoketests will use the api from the outside23:12
vishybut you need a full running install of nova to use them23:13
mwhookeryeah23:13
mwhookernot that far yet23:13
*** zns has quit IRC23:13
tushar_Hi All, Can some one please review my merge proposal at #link https://code.launchpad.net/~tpatil/nova/add-options-network-create-os-apis/+merge/68292. I would appreciate if you can give feedback ASAP because the merge proposal freeze dead line is approaching closer.23:14
mwhookerI think I'll just throw my patch over the wall with the caveat that it hasn't been functionally tested ;)23:15
*** mszilagyi has quit IRC23:19
vishyblamar_: https://code.launchpad.net/~vishvananda/nova/united-launch-strategy/+merge/7196423:44
vishyblamar_: I hacked up some of your code there, see my rationale in the merge prop23:45
Davieyironcamel: It seemed to work in principle, but there are bugs.23:45
*** mgius has quit IRC23:56
mwhookerif anyone has some suggested bugs for me to tackle, let me know23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!