Wednesday, 2011-06-22

sorenmtaylor: It'll only sometimes work.00:00
mtaylorhrm00:00
sorenanyjson prefers cjson over anything else.00:00
sorenSo if it finds cjson, it'll use it, even though simplejson is installed.00:00
mtaylorthen why doens't it use cjson on jenkins?00:00
sorenIt has a Depends: cjson | simpjejson00:00
mtaylorcan we conflict with cjson?00:00
sorenmtaylor: Because it's not installed.00:00
mtaylorgotcha00:00
sorenmtaylor: That's a good idea.00:00
sorenmtaylor: Let's do that.00:00
mtayloryay!00:00
* mtaylor had a good idea00:01
* mtaylor will now consider it useful that he got out of bed :)00:01
creihtsoren: you may want to test jasonlib and jsonlib2 as well, as a quick look at anyjson seems to also prefer those00:03
creihtsoren: or possibly can you use force_implementation in anyjson to force a specific json module?00:04
creihtI'm not sure how carrot is used, so not sure if that would be available00:05
sorencreiht: Ubuntu has no jasonlib nor jsonlib2, so we're in the clear there.00:05
sorencreiht: I could patch carrot.00:05
creihtsoren: while that is true, that doesn't prevent someone from pip install jsonlib00:06
mtaylorwe don't really test anything in a pip install environment00:06
sorenThey might also have pip installed carrot, so I can't fix it there for them.00:06
creihtI'm not saying continually test00:07
vishymore importantly, why is cjson broken?00:07
vishyshould we patch that?00:07
creihtjust test to see if it is compatible00:07
mtaylorprobably00:07
creihthah00:07
mtaylorI mean- just to be nice00:07
creihtcjson is broken in many ways00:07
sorenvishy: I couldn't even find an upstream bugtracker.00:07
mtaylorwell, if it's broken in many ways - perhaps we should get it removed from debian/ubuntu?00:07
vishyif cjson is broken why the hell does anyjson prefer it?00:07
mtaylorand patch anyjson to not prefer it?00:08
mtaylorvishy: people tend to like fast things even if they suck00:08
sorenor maybe noone noticed.00:08
mtaylorprobably the second thing00:08
vishymtaylor: :)00:08
creihtcjson is very fast00:09
creihtand for common cases it is probably reasonable00:09
creihtbut there are edge cases where most of the json implementations differ00:09
creihtespecially in the area of unicode00:09
sorenHaving a dict where one of the keys has a '/' doesn't seem wildly unreasonable.00:09
sorenEr... one of the values.00:09
sorenIt's probably the same for keys, but we're seeing it with values.00:09
creihthttp://garybernhardt.blogspot.com/2007/07/when-json-isnt-json.html00:11
creihtold post, but still seems to be true00:11
*** bcwaldon has quit IRC00:12
creihtthere was another post that did a similar comparison that focused on unicde a while back, but can't seem to find it00:12
sorenWhy the heck escape forward slashes anyway?00:13
creihthttp://deron.meranda.us/python/comparing_json_modules/unicode00:13
mtaylorsoren: looks like they just did re.escape('/dev/vdc')00:13
* creiht shrugs00:13
creihtI highly recommend settling on simplejson00:13
mtaylorwhich is probably someone not really being sure what they needed so deciding to 'escape' things to be 'safe'00:13
creihtand forcing things to just use that (if possible)00:13
sorenIt looks like a simple patch.00:14
soren*headdesk*00:18
sorenThere's even a unit test that verifies it does this correctly.00:18
sorenIt's commented out.00:18
creihtyou will fix that one problem, but you will only run into many others00:18
sorenThe lesson is: Never try.00:19
creihtsoren: yes that is exactly what I was saying00:19
*** adiantum has quit IRC00:20
sorenOh, it's not even an upstream bug. It's a patch that was added in Debian.00:20
*** adiantum has joined #openstack-dev00:20
*** heckj has quit IRC00:21
*** mszilagyi has quit IRC00:22
sorenhttp://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2009-492400:23
uvirtbotsoren: Dan Pascu python-cjson 1.0.5 does not properly handle a ['/'] argument to cjson.encode, which makes it easier for remote attackers to conduct certain cross-site scripting (XSS) attacks involving Firefox and the end tag of a SCRIPT element. (http://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2009-4924)00:23
sorenI don't think 2:30 AM is the right time to figure this out.00:24
soreng'night.00:24
*** Binbin has joined #openstack-dev00:43
*** cloudgroups has joined #openstack-dev00:43
*** adiantum has quit IRC00:49
*** RobertLaptop has quit IRC00:49
*** RobertLaptop has joined #openstack-dev00:53
*** cloudgroups has quit IRC00:55
*** markvoelker1 has joined #openstack-dev00:55
*** cloudgroups has joined #openstack-dev00:59
*** adiantum has joined #openstack-dev01:02
*** adiantum has quit IRC01:08
*** jdurgin has quit IRC01:14
*** jaypipes has quit IRC01:21
*** adiantum has joined #openstack-dev01:22
*** adiantum has quit IRC01:39
*** adiantum has joined #openstack-dev01:52
*** markvoelker1 has quit IRC01:52
*** nati has joined #openstack-dev01:59
*** mancdaz1203 has quit IRC02:00
*** mancdaz1203 has joined #openstack-dev02:02
*** jkoelker has quit IRC02:05
*** Binbin has quit IRC02:15
*** adiantum has quit IRC02:24
*** nati has quit IRC02:27
*** dragondm has quit IRC02:28
*** adiantum has joined #openstack-dev02:37
*** cloudgroups has left #openstack-dev02:49
*** adiantum has quit IRC02:53
*** adiantum has joined #openstack-dev02:59
*** adiantum has quit IRC03:09
*** adiantum has joined #openstack-dev03:14
*** libspeed has joined #openstack-dev03:27
*** adiantum has quit IRC03:37
*** adiantum has joined #openstack-dev03:51
*** bcwaldon has joined #openstack-dev03:59
*** bcwaldon has quit IRC04:12
*** adiantum has quit IRC04:21
*** Binbin has joined #openstack-dev04:27
*** adiantum has joined #openstack-dev04:34
*** adiantum has quit IRC05:08
*** adiantum has joined #openstack-dev05:14
*** zaitcev has quit IRC05:18
*** nati has joined #openstack-dev05:19
*** adiantum has quit IRC05:23
*** johnpur has quit IRC05:25
*** adiantum has joined #openstack-dev05:30
*** adiantum has quit IRC05:38
*** adiantum has joined #openstack-dev05:51
*** Binbin has quit IRC06:00
*** cloudgroups has joined #openstack-dev06:11
*** Binbin has joined #openstack-dev06:13
*** adiantum has quit IRC06:20
*** glenc_ has quit IRC06:25
*** glenc has joined #openstack-dev06:25
*** cloudgroups has left #openstack-dev06:35
*** reidrac has joined #openstack-dev07:02
*** nati has quit IRC07:10
*** gregm has joined #openstack-dev07:14
*** nati has joined #openstack-dev07:23
*** erik-s has quit IRC07:32
*** erik-s has joined #openstack-dev07:33
sorenttx: PPA builds are working again.07:45
*** nati has quit IRC08:00
*** gregm has quit IRC08:01
*** nati has joined #openstack-dev08:02
*** nati has quit IRC08:36
*** nsokolov has joined #openstack-dev09:02
ttxkewl.09:04
*** nsokolov has quit IRC09:15
*** nsokolov has joined #openstack-dev09:15
*** nsokolov is now known as chemikadze09:15
*** Binbin has quit IRC09:39
*** markvoelker has quit IRC11:02
*** markvoelker has joined #openstack-dev11:06
*** zul has quit IRC12:01
sandywalshfinally ... a review day where I don't a deadline looming over me :)12:02
*** dprince has joined #openstack-dev12:15
*** westmaas_ is now known as westmaas12:25
*** dprince has quit IRC12:25
*** dprince has joined #openstack-dev12:29
*** zul has joined #openstack-dev12:42
*** nati has joined #openstack-dev12:43
*** ameade has joined #openstack-dev12:56
*** agarwalla has joined #openstack-dev13:04
agarwalladoes the nova database have any key information to access the compute nodes ?13:05
sandywalshagarwalla, can you elaborate?13:06
agarwallasandywalsh: i need to access the compute nodes from the cloud controller node...i realised i can retrieve all the compute nodes from the "services" table but i need a way to get into the compute nodes...does nova create a default user/passwd for compute nodes or store keys to access the compute nodes13:08
sandywalshagarwalla, you need to send an AMQP message from nova.compute.api. This will get picked up by a Compute node for processing. You can specify which compute node in the "topic"13:10
agarwallasandywalsh: i would have chosen the rabbitmq channel to talk to the compte controller but i wish to run commands that the nova compute is not responsible13:10
sandywalshagarwalla, not sure what you mean by "not responsible"13:11
agarwallasandywalsh: ok i need to get information of the interfaces on the remote compute host...i cannot add a method on the nova compute side to do that right ?13:13
sandywalshagarwalla, yes, if that info doesn't exist in the database and there is no existing Compute call for getting that info, you can add a new method to nova.compute.manager to support it (and in the Virt layer as well, of course)13:15
agarwallaafaik, the compute host interfaces info is not present in the nova databases today...why would i need any implementation in the virt layer ? (i need the compute host interface info)13:22
sandywalshagarwalla, depends on if you're getting it from the hypervisor or just the Compute host. If it's just the Host then you don't need the Virt layer, correct.13:24
agarwallasandywalsh: yes, true. i'll try to implement the AMQP way then..thanks a bunch for the response..appreciate it... also do i open a bug or something to track this13:28
sandywalshagarwalla, np ... ideally a bug or blueprint to indicate what you're trying to accomplish.13:30
*** throughn1thing has quit IRC13:31
sandywalshttx, for a simple addition, is there something smaller than a blueprint? A bug almost doesn't seem appropriate.13:31
ttxsandywalsh: bug with "Wishlist" importance sounds like the solution here.13:32
sandywalshttx thanks ... agarwalla ^^13:32
agarwallagreat...thanks sandywalsh and ttx13:33
sandywalshnp13:33
*** throughnothing has joined #openstack-dev13:35
*** throughnothing has quit IRC13:36
*** throughnothing has joined #openstack-dev13:37
*** throughnothing has quit IRC13:39
*** throughnothing has joined #openstack-dev13:41
*** throughnothing has quit IRC13:41
*** bcwaldon has joined #openstack-dev13:44
*** throughnothing has joined #openstack-dev13:50
*** throughnothing has quit IRC13:51
*** jkoelker has joined #openstack-dev13:55
*** exlt_ has joined #openstack-dev13:58
*** throughnothing has joined #openstack-dev13:59
*** throughnothing has quit IRC13:59
*** exlt has quit IRC14:00
*** throughnothing has joined #openstack-dev14:01
*** throughnothing has quit IRC14:01
*** throughnothing has joined #openstack-dev14:01
*** throughnothing has quit IRC14:01
*** nati has quit IRC14:02
*** throughnothing has joined #openstack-dev14:04
*** throughnothing has quit IRC14:04
*** throughnothing has joined #openstack-dev14:05
*** nati has joined #openstack-dev14:19
*** markvoelker has quit IRC14:25
*** deshantm has quit IRC14:40
*** deshantm has joined #openstack-dev14:45
*** heckj has joined #openstack-dev15:20
*** nati has quit IRC15:24
*** jaypipes has joined #openstack-dev15:37
*** reidrac has quit IRC15:42
*** mattray has joined #openstack-dev15:45
*** jkoelker has quit IRC15:58
*** jkoelker has joined #openstack-dev16:11
*** johnpur has joined #openstack-dev16:11
*** ChanServ sets mode: +v johnpur16:11
*** jkoelker has quit IRC16:15
*** jkoelker has joined #openstack-dev16:16
*** chemikadze has quit IRC16:16
*** rnirmal has joined #openstack-dev16:20
*** jkoelker has quit IRC16:23
*** johnpur has quit IRC16:28
*** ohnoimdead has joined #openstack-dev16:29
*** bsa has joined #openstack-dev16:41
*** markvoelker has joined #openstack-dev16:43
*** mszilagyi has joined #openstack-dev16:55
*** jdurgin has joined #openstack-dev16:57
jaypipesohnoimdead: nice nick. :)17:20
ohnoimdeadjaypipes: :D17:21
*** pyhole has joined #openstack-dev17:37
*** jkoelker has joined #openstack-dev17:41
*** cp16net has joined #openstack-dev17:50
vishyjaypipes: ping17:53
jaypipesvishy: pong18:07
vishyjay: do you recall what the deal is with compute images api18:07
vishyare we getting rid of it?18:07
vishymarkwash, blamar, bwaldon: ping(s)18:07
markwash_o/18:08
*** blamar_ has joined #openstack-dev18:08
jaypipesvishy: hmm, yes, I think I remember that /images will be removed from the compute API.18:09
jaypipesvishy: just not sure whether the plan was for 1.1 or 2.0 to have the removal...18:09
vishyok18:10
westmaasright now /images on nova is not a straight proxy for glance, so probably not 1.1?18:10
vishyI noticed an issue in the compute images api and i want to verify and figure out the right fix18:10
*** dragondm has joined #openstack-dev18:10
*** dragondm has quit IRC18:11
vishythe href for an image that is returned in links is for the compute api18:11
*** dragondm has joined #openstack-dev18:11
vishybut if you try to launch an instance using that href it blows up because imageRef is expecting a glance href18:11
vishyso do we modify compute images api to return a glance href, or do we modify the instance create to allow compute hrefs as well?18:12
* markwash_ slowly backs away18:12
markwash_I guess I'm leaning towards allowing compute hrefs18:13
markwash_but maybe just to disagree with westmass18:14
vishyi think that makes more sense as well18:14
westmaassounds good.  disagree with that markwash_!18:15
markwash_the difficulty there is that right now all the drivers talk directly to glance for images18:16
markwash_:-(18:16
vishythat shouldn't be a problem18:16
vishyit is just allowing an additional option for imageRef18:17
vishyright now we support 3 and http://glance:port/image/318:17
markwash_so we could just translate http://nova:port/images/3 into http://glance:port/image/318:17
vishyso we just add support for http://compute:port/v.1.1/image/318:17
vishyright, basically we need a check to see if the server port matches the current flags and if so just turn it into a 3 and use the default glance server18:18
vishyas if just '3' was passed in18:18
markwash_sounds good to me18:18
jaypipesvishy: and to throw another wrench in the works, we'll likely be switching to UUID ids in Glance soon.18:20
vishydammit jaypipes18:21
vishy:)18:21
vishyjaypipes: also, didn't we discuss is_public at some point?18:21
vishyjaypipes: I thought that at some point the images details was returning all images and not just the public ones18:21
jaypipesvishy: well, with keystone integration, we have the concept of an owner of an image, so we can support finer-grained things like shared image groups. But... that said, Keystone integration will not be required in Glance, and if the auth middleware if not installed, we will continue the same behaviour of is_public that exists now.18:23
jaypipesvishy: of course, all subject to change if there is sufficient demand for it..18:24
vishyok I guess i just imagined it18:24
vishycurrently making an image private is broken in nova18:24
jaypipesvishy: perhaps you are remembering the bug (fixed now) that was not limiting the returned images in /images and /images/detail to only active status ones?18:24
jaypipesvishy: pls explain. what's broken about it? bug link?18:25
jaypipesvishy: is this a break on the Glance side or the Nova side?18:27
vishywell it is just a disconnect between is_public18:33
vishynova sets is_public false18:33
vishythen it can't see the images to display them to the user anymore18:33
vishy:)18:33
jaypipesvishy: ah!18:38
jaypipesvishy: but /images/<ID> works...18:38
jaypipesvishy: you're referring to listing images available in the Nova /images endpoint, I assume?18:38
jaypipesmarkwash_: got a sec?18:39
vishyjaypipes: the listing in euca-describe-images actually18:42
vishybut same for images endpoint18:42
vishyjaypipes: nova doesn't maintain a separate list of images so it doesn't know to request the id specifically18:43
jaypipesvishy: gotcha.18:43
openstackjenkinsProject swift build #283: SUCCESS in 27 sec: http://jenkins.openstack.org/job/swift/283/18:47
openstackjenkinsTarmac: This fixes the bug that drop_buffer_cache() doesn't work on systems where off_t isn't 64 bits.18:47
vishyjaypipes: i think the short term solution is to not use is_public but have a property for it properties['ec2_public'] or something18:48
jaypipesvishy: that would certainly work.18:49
vishyuntil flitering works18:49
vishyi actually did it that way initially, but we switched back to using is_public and I don't know why18:49
*** CatKiller has joined #openstack-dev18:59
CatKillerHi there,18:59
ameadeis there a good reason instance types have a flavorid column?19:06
vishybecause they are flavorids?19:08
vishy:)19:08
ameadecouldn't the id column just be used wherever that is used?19:09
vishyameade: flavor id is used by the openstack api to refer to an instance type19:09
markwash_jaypipes: I do now!19:10
vishyi think the reason for a second column is id is autoinc19:10
vishyso it can't be set by an administrator19:10
ameadevishy: so we just want admins to have the ability to set the id19:11
ameadevishy: something they cant do with autoinc19:11
vishyyes,19:11
vishythat is my assumption anyway :)19:11
jaypipesmarkwash_: hey :) was wondering if you'd be able to give your input on this MP: https://code.launchpad.net/~jshepher/glance/functional_tests_using_httplib2/+merge/65078. Specifically, Justin's last comment...19:11
markwash_onit19:12
*** dprince has quit IRC19:20
*** agarwalla_ has joined #openstack-dev19:36
*** agarwalla has quit IRC19:37
*** ohnoimdead has quit IRC20:11
*** jaypipes is now known as jaypipes-afk20:31
vishyjaypipes:  perhaps we could change image_get_all_public to image_get_all and put is_public in as a default filter?20:46
bcwaldonvishy: I would be all for that. I think we have to wait until we have authz to solve the 'public' problem correctly20:59
vishyright but we can fake it using filters for now21:00
vishy:)21:00
bcwaldonvishy: sure thing21:00
*** ameade has quit IRC21:21
*** exlt_ is now known as exlt21:37
*** zaitcev has joined #openstack-dev21:47
*** adiantum has joined #openstack-dev22:04
*** adiantum has quit IRC22:10
*** adiantum has joined #openstack-dev22:14
*** cp16net has quit IRC22:15
*** markvoelker has quit IRC22:26
openstackjenkinsProject swift build #284: SUCCESS in 27 sec: http://jenkins.openstack.org/job/swift/284/22:32
openstackjenkinsTarmac: removed stats/logging code from swift22:32
*** adiantum has quit IRC22:34
*** bcwaldon has quit IRC22:35
*** bsa has quit IRC22:39
*** mattray has quit IRC22:47
*** adiantum has joined #openstack-dev22:47
openstackjenkinsProject nova build #1,028: SUCCESS in 2 min 56 sec: http://jenkins.openstack.org/job/nova/1028/22:49
openstackjenkinsTarmac: Fixes issues with displaying exceptions regarding flavors in nova-manage22:49
*** adiantum has quit IRC22:54
*** rnirmal has quit IRC23:05
*** jaypipes-afk is now known as jaypipes23:06
*** adiantum has joined #openstack-dev23:06
*** adiantum has quit IRC23:18
*** adiantum has joined #openstack-dev23:31
*** adiantum has quit IRC23:40
*** adiantum has joined #openstack-dev23:45
*** adiantum has quit IRC23:52
*** adiantum has joined #openstack-dev23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!