Thursday, 2012-11-08

*** metral_ has joined #openstack-dev00:02
*** metral has quit IRC00:05
*** metral_ is now known as metral00:06
*** mrodden1 has quit IRC00:06
*** rnirmal has quit IRC00:12
*** ewindisch has quit IRC00:12
*** cp16net is now known as cp16net|away00:14
*** rpedde is now known as rpedde_away00:16
*** anniec has joined #openstack-dev00:19
*** maxiz has joined #openstack-dev00:19
*** mnewby_ has joined #openstack-dev00:21
*** anniec_ has joined #openstack-dev00:22
*** mnewby_ has quit IRC00:23
*** anniec has quit IRC00:24
*** anniec_ is now known as anniec00:24
*** winston-d has joined #openstack-dev00:24
*** mnewby has quit IRC00:25
*** metral has quit IRC00:25
*** metral has joined #openstack-dev00:27
*** mnewby has joined #openstack-dev00:27
*** mrodden has joined #openstack-dev00:28
*** maurosr has joined #openstack-dev00:28
*** mrodden1 has joined #openstack-dev00:29
*** mnewby_ has joined #openstack-dev00:29
*** clarkb has quit IRC00:32
*** mrodden has quit IRC00:32
*** maurosr has quit IRC00:33
*** mnewby has quit IRC00:33
*** mnewby_ is now known as mnewby00:33
*** sniperd has quit IRC00:36
*** maurosr has joined #openstack-dev00:37
*** epim_ has joined #openstack-dev00:37
*** hemna has quit IRC00:38
*** epim has quit IRC00:40
*** epim_ is now known as epim00:40
*** metral has quit IRC00:40
*** maurosr has quit IRC00:41
*** dims has quit IRC00:41
*** metral has joined #openstack-dev00:41
alexpilottimikal: hi!00:41
mikalalexpilotti: hi00:43
alexpilottimikal: I'm porting config drive v200:43
mikalAhhh, right. That email thread from yesterday.00:43
alexpilottimikal: there's a bug in nova\api\metadata\base.py00:43
alexpilottimikal: os.path.normpath(path) :-)00:44
mikalHmmm, you should fix that!00:44
alexpilottimikal: sure, np. The question is: we found a lot of places where URLs are normalized with os.path.normpath, which replaces "/" with "\" on Windows :-)00:45
mikalHmmmm00:46
mikalSo there are two things here00:46
mikalConfig drive, which writes ISO etc00:46
*** alunduil has joined #openstack-dev00:46
mikalAnd then the metadata server, which is another way of getting to the data00:46
*** esp2 has left #openstack-dev00:46
mikalThe config drive hooks into metadata server to reduce code duplication00:46
alexpilottimikal: this is code called by config drive00:46
mikalBut I didn't write much of the metadata server00:46
mikalYep, agreed00:47
alexpilottimikal: in:     def metadata_for_config_drive(self):00:47
mikalBut I guess I'm saying I'd be surprised if anyone has tried to run the metadata server on windows00:47
mikalAnd it might require cleanup00:47
mikalSounds like you should file a bug and either fix it or I can fix it00:47
mikalBut most of this code was written by smoser IIRC00:47
alexpilottimikal: sure, the question is: is there a way to warn about using os.path.normpath to normalize URLs?00:47
mikalHmmmm, that's hard right?00:48
alexpilottimikal: beside metadata, there's a LOT of places where we found this way of normalizing URLs00:48
mikalHow does the code know that its going to be used for a URL?00:48
*** sacharya1 has joined #openstack-dev00:48
mikalIt sounds like a lint check, but I don't know how to express it00:48
alexpilottimikal: the code not, but a dev should know when he's normalizing urls or paths00:48
mikalTrue00:49
mikalI guess I was going for an automated check here00:49
mikalOtherwise you're going to be fixing new occurrances of this for the rest of your life00:49
alexpilottimikal: one option could be to monkey patch os.path.normpath suring the tests00:49
*** matiu_ is now known as matiu00:49
mikalOr add unit tests to stop regressions every time you find an example...00:50
mikalBut that sounds laborious00:50
alexpilottimikal: other option is to have jenkins running on Windows as well00:50
*** sacharya has quit IRC00:50
alexpilottimikal: in that case the unit tests should fail00:50
mikalHmmm, that sounds like something we should talk to mordred about00:51
alexpilottimikal: cool00:51
mikalIf not jenkins, a smokestack style test00:51
mikalWhich would be a very good idea00:51
mikalEspecially if it could run hyper V tests against a real hyper V install instead of mocks00:51
alexpilottimikal: we are working with Microsoft to set up smokestack00:51
mikalYep. I think that's really important to get done.00:51
*** clarkb has joined #openstack-dev00:51
alexpilottimikal: cool, I'll get back in touch as soon as we start working on that00:52
alexpilottimikal: tx00:52
mikalSure, NP00:52
alexpilottimikal: changing subject:00:52
alexpilottimikal: the tool you used to generate the isos is genisoimage00:53
*** salv-orlando has quit IRC00:53
*** maurosr has joined #openstack-dev00:53
alexpilottimikal: we are using a port of mkisofs on Windows (the later non GPL one, compiled with mingw to avoid licensing issues)00:54
mikalYep, I saw you wanted to do that00:54
mikalI'm fine with that00:54
vishyQ310: cool00:54
mikalPerhaps add a flag which controls what is used?00:54
vishyQ310: feel free to propose it00:54
alexpilottimikal: that was exactly where I was heading ;-)00:54
*** dims has joined #openstack-dev00:54
alexpilottimikal: is it ok for you to specify in the flag the name / path of the command?00:55
mikalHmmm.00:55
* mikal ponders00:55
mikalHow do people install this stuff on windows?00:55
mikalWill the command always be in the same place because it is installed by the nova installer or something?00:55
alexpilottimikal: with our installer: http://www.cloudbase.it/openstack/openstack-compute-installer/00:56
alexpilottimikal: or manually of course if they prefer00:56
alexpilottimikal: we generate nova.conf suring the install process, so the user doesn't have to take care of anything00:57
mikalHmmm, so the binary should be in a known location right?00:57
alexpilottimikal: what I'd like to avoid, is to put mkisofs in th epath00:57
mikalI guess I'd prefer not to pass an entire path00:57
mikalBut I don't have a strong reason for why I prefer that00:57
mikalWell, if the flag was --use_mkisofs then the code could assume a full path?00:57
alexpilottimikal: by passing the name only, it will look for in in the PATH00:57
*** maurosr has quit IRC00:57
*** mnewby has quit IRC00:58
alexpilottimikal: so if we name it eg: mkfsiso_cmd00:58
mikalSure, ok00:58
mikalI think that is fine00:58
alexpilottimikal: great, no more questions so far :-) tx!00:59
*** lloydde_ has quit IRC01:00
*** maurosr has joined #openstack-dev01:00
mikalNP01:01
*** dolphm has joined #openstack-dev01:01
*** TerryH has quit IRC01:03
*** maurosr has quit IRC01:05
*** datsun180b has quit IRC01:08
*** sunilthaha has joined #openstack-dev01:08
*** sunilthaha has joined #openstack-dev01:09
*** sunilthaha has quit IRC01:10
*** rkukura has quit IRC01:12
*** mrodden1 has quit IRC01:12
*** gugl has quit IRC01:12
*** dprince has quit IRC01:13
*** danwent has joined #openstack-dev01:14
*** rkukura has joined #openstack-dev01:14
*** sunilthaha has joined #openstack-dev01:14
*** maurosr has joined #openstack-dev01:17
*** wenjianhn has joined #openstack-dev01:19
*** e1mer has quit IRC01:20
*** srn has joined #openstack-dev01:21
*** jog0 has quit IRC01:21
*** maurosr has quit IRC01:21
*** srn has quit IRC01:21
*** patelna__ has quit IRC01:22
*** e1mer has joined #openstack-dev01:24
*** lloydde has joined #openstack-dev01:25
*** rnirmal has joined #openstack-dev01:31
*** maurosr has joined #openstack-dev01:34
*** vipul has quit IRC01:35
*** dprince has joined #openstack-dev01:36
*** timello has joined #openstack-dev01:37
*** maurosr has quit IRC01:39
*** mnewby has joined #openstack-dev01:40
*** jcmartin has quit IRC01:40
*** slackguru has joined #openstack-dev01:42
*** Q310 has quit IRC01:42
*** mnewby has quit IRC01:43
*** littleidea has quit IRC01:44
*** slackguru has left #openstack-dev01:44
*** xchu has joined #openstack-dev01:46
*** cp16net|away is now known as cp16net01:48
*** s0mik has quit IRC01:48
*** maurosr has joined #openstack-dev01:52
*** metral_ has joined #openstack-dev01:53
*** dprince has quit IRC01:54
*** metral has quit IRC01:55
*** metral_ is now known as metral01:55
*** maurosr has quit IRC01:57
*** maurosr has joined #openstack-dev01:58
*** jaypipes has quit IRC01:59
*** esp1 has joined #openstack-dev01:59
*** SlickNik has quit IRC02:00
*** troytoman-away has quit IRC02:03
*** ayoung-afk is now known as ayoung02:03
ayoungdolphm, when you get the chance:  https://review.openstack.org/#/c/15429/ and https://review.openstack.org/#/c/15543/02:03
*** maurosr has quit IRC02:03
*** Apsu` has quit IRC02:03
dolphmayoung: sure02:04
*** networkstatic has joined #openstack-dev02:04
ayoungdolphm, also, let me know if any of yours need review.  AFAICT I have no reviews in my queue02:04
dolphmayoung: i put up one for v3 policies on keystone master this morning02:04
dolphmayoung: same review as what was pending on the feature branch, but cut out the endpoint_id association02:05
*** metral has quit IRC02:05
ayoungdolphm, looking.  Ialso see the extra-twice one.  I'll see if there is anything else on the watched list02:05
dolphmayoung: let me finish some v3 catalog stuff (working on your feedback from way back on that lol) before i poke at your reviews, i want to test them both on my machine02:06
*** eglynn_ has joined #openstack-dev02:06
*** troytoman-away has joined #openstack-dev02:07
ayoungdolphm, why user_ref['extra'].pop('tenants', None)02:07
*** lloydde_ has joined #openstack-dev02:07
ayoungdolphm, also, adding dkranz as reviewer on that one02:08
*** eglynn has quit IRC02:08
*** Apsu` has joined #openstack-dev02:09
dolphmayoung: tenant memberships used to be shoved into the 'extra' column, if they're still there, they shouldn't be returned02:09
*** littleidea has joined #openstack-dev02:09
dolphmayoung: coding for paranoia02:09
*** lloydde has quit IRC02:10
*** metral has joined #openstack-dev02:10
*** roadTripper has quit IRC02:10
*** tgall_foo has joined #openstack-dev02:11
*** tgall_foo has quit IRC02:11
*** tgall_foo has joined #openstack-dev02:11
*** darjeeling has quit IRC02:13
*** sunilthaha has quit IRC02:16
*** metral has quit IRC02:16
*** cp16net is now known as cp16net|away02:19
*** simonmcc1 has quit IRC02:19
*** metral has joined #openstack-dev02:19
*** lloydde_ has quit IRC02:19
*** cp16net|away is now known as cp16net02:21
*** littleidea has quit IRC02:22
metralquestions: can i use the set metadata to change the image_type to be something other than "base" or "server" or is that hardcoded by openstack02:22
*** Mandell_ has quit IRC02:22
*** mnewby has joined #openstack-dev02:25
*** littleidea has joined #openstack-dev02:27
*** sunilthaha has joined #openstack-dev02:29
*** metral has quit IRC02:31
*** timello has quit IRC02:33
*** rkukura has quit IRC02:35
*** tgall_foo has quit IRC02:36
*** epim_ has joined #openstack-dev02:42
*** epim has quit IRC02:43
*** epim_ is now known as epim02:43
ayoungdolphm, also https://review.openstack.org/#/c/15403/  THat is the authenticate refactoring.  It is not a 100% solution, but it is a step in the right direction, and we should finish this before tackiling the ec2 token issue02:43
*** novas0x2a|laptop has quit IRC02:43
dolphmayoung: ec2 token issue?02:43
*** epim has quit IRC02:44
*** tgall_foo has joined #openstack-dev02:47
*** tgall_foo has quit IRC02:47
*** tgall_foo has joined #openstack-dev02:47
*** zbitter has joined #openstack-dev02:48
ayoungdolphm, https://bugs.launchpad.net/keystone/+bug/106491402:49
uvirtbot`Launchpad bug 1064914 in keystone "Able to access ec2 resources with out a user-role" [Critical,Triaged]02:49
*** zaneb has quit IRC02:51
*** amotoki has joined #openstack-dev02:54
dolphmayoung: i wasn't aware of that bug ... do you know what's causing it?02:55
ayoungdolphm, yeah.  The authenticate method is not called in that case.  The code executed is under contrib.  heckj did a quick look at it and confirmed as well.02:59
openstackgerritA change was merged to openstack/nova: Decouple EC2 API from using instance id  https://review.openstack.org/1539102:59
dolphmayoung: no token validation?03:00
ayoungdolphm, https://github.com/openstack/keystone/blob/master/keystone/contrib/ec2/core.py#L14803:00
ayoungtoken with no roles, I think03:00
lifeless /win 5203:00
ayoungdolphm, so the authenticate refactoring happens first, and then we use common code for that and for all of the contrib tokens authenticates03:01
dolphmayoung: wow, i didn't know this code was even here03:02
*** dims has quit IRC03:02
ayoungdolphm, there are a couple in contrib03:04
dolphmayoung: :(03:04
*** markmcclain has joined #openstack-dev03:05
*** melwitt has quit IRC03:10
*** jimp has joined #openstack-dev03:12
*** anniec has quit IRC03:15
*** jcooley has joined #openstack-dev03:23
*** sniperd has joined #openstack-dev03:29
openstackgerritA change was merged to openstack/swift: Fixed swift-bench when using -b and a conf file  https://review.openstack.org/1560303:32
*** danwent has quit IRC03:35
*** PaulM has left #openstack-dev03:35
openstackgerritA change was merged to openstack/keystone: HACKING compliance: consistent use of 'except'  https://review.openstack.org/1541703:36
*** ayoung has quit IRC03:38
*** jimp has quit IRC03:41
*** gyee has joined #openstack-dev03:44
*** alexpilotti has quit IRC03:48
*** jcooley has quit IRC03:53
*** zhuadl has joined #openstack-dev03:54
*** mnewby has quit IRC03:57
openstackgerritA change was merged to openstack/keystone: monkeypatch cms Popen  https://review.openstack.org/1542903:59
openstackgerritA change was merged to openstack/keystone: SQL upgrade test.  https://review.openstack.org/1554303:59
*** jakedahn_zz is now known as jakedahn04:03
*** rkukura has joined #openstack-dev04:04
*** anniec72 has joined #openstack-dev04:05
*** anniec72 has quit IRC04:05
*** aeperezt has quit IRC04:07
*** e1mer has quit IRC04:10
*** e1mer has joined #openstack-dev04:11
*** winston-d has quit IRC04:19
*** sacharya has joined #openstack-dev04:21
*** sacharya1 has quit IRC04:23
*** danwent has joined #openstack-dev04:24
*** vipul_ has joined #openstack-dev04:28
openstackgerritA change was merged to openstack/keystone: Fixed typo in log message  https://review.openstack.org/1482704:37
*** arata has joined #openstack-dev04:40
*** Mandell has joined #openstack-dev04:42
*** mnewby has joined #openstack-dev04:46
*** mnewby has quit IRC04:50
openstackgerritA change was merged to openstack/nova: Corrects usage of db.api.network_get  https://review.openstack.org/1543404:56
*** diganta has joined #openstack-dev04:59
*** sacharya has quit IRC05:00
*** adjohn has quit IRC05:01
*** adjohn has joined #openstack-dev05:01
digantahi good morning  all05:02
*** markmcclain has quit IRC05:04
*** zaitcev has quit IRC05:05
*** jcooley has joined #openstack-dev05:05
*** zhuadl has quit IRC05:18
*** s0mik has joined #openstack-dev05:18
*** e1mer has quit IRC05:19
*** e1mer has joined #openstack-dev05:20
*** mikal has quit IRC05:22
*** vipul_ has quit IRC05:23
*** vipul has joined #openstack-dev05:24
*** jcooley has quit IRC05:25
*** mikal has joined #openstack-dev05:28
*** garyk has quit IRC05:31
*** wenjianhn has quit IRC05:31
*** dolphm has quit IRC05:37
*** wenjianhn has joined #openstack-dev05:38
*** e1mer has quit IRC05:41
*** jcooley has joined #openstack-dev05:41
*** nati_ueno has joined #openstack-dev05:43
*** lloydde has joined #openstack-dev05:43
*** e1mer has joined #openstack-dev05:46
*** jcooley has quit IRC05:49
*** jcooley has joined #openstack-dev05:49
*** darjeeling has joined #openstack-dev05:50
*** gyee has quit IRC05:50
*** sunilthaha has quit IRC05:51
*** vipuls has joined #openstack-dev05:55
*** vipul has quit IRC05:59
*** hattwick has quit IRC05:59
*** tgall_foo has quit IRC05:59
*** adjohn has quit IRC05:59
*** nati_ueno has quit IRC06:04
*** vipuls has quit IRC06:04
*** nati_ueno has joined #openstack-dev06:04
*** vipul has joined #openstack-dev06:05
*** Mandell has quit IRC06:05
*** vipul is now known as vipul|away06:07
*** vipul|away is now known as vipul06:07
*** nati_ueno_2 has joined #openstack-dev06:09
*** nati_ueno has quit IRC06:10
*** joearnold has quit IRC06:10
*** anderstj has quit IRC06:10
*** anderstj has joined #openstack-dev06:11
*** annegentle has quit IRC06:12
*** annegentf has joined #openstack-dev06:13
*** joearnold has joined #openstack-dev06:14
*** markwash has quit IRC06:14
*** Mandell has joined #openstack-dev06:15
*** Mandell has quit IRC06:18
*** Shrews has quit IRC06:24
*** Shrews has joined #openstack-dev06:26
*** Mandell has joined #openstack-dev06:27
*** jtran has quit IRC06:28
*** markwash has joined #openstack-dev06:30
*** jtran has joined #openstack-dev06:31
*** jtran has quit IRC06:34
*** nati_ueno_2 has quit IRC06:34
*** nati_ueno has joined #openstack-dev06:34
*** nati_ueno_2 has joined #openstack-dev06:37
*** nati_ueno has quit IRC06:37
*** rushiagr has joined #openstack-dev06:40
*** hattwick has joined #openstack-dev06:42
*** cmagina has quit IRC06:45
*** sunilthaha has joined #openstack-dev06:45
*** mrunge has joined #openstack-dev06:46
*** lloydde has quit IRC06:46
*** Mandell has quit IRC06:48
*** gongysh has quit IRC06:49
*** garyk has joined #openstack-dev06:50
openstackgerritA change was merged to openstack/nova: Switch from FLAGS to CONF in nova.console  https://review.openstack.org/1536106:51
*** sunilthaha has quit IRC06:55
*** wenjianhn has quit IRC06:56
openstackgerritA change was merged to openstack/nova: Switch from FLAGS to CONF in nova.virt  https://review.openstack.org/1536406:58
*** samkottler is now known as samkottler|out07:00
*** metral has joined #openstack-dev07:06
*** jcooley has quit IRC07:09
*** eglynn__ has joined #openstack-dev07:09
*** eglynn_ has quit IRC07:11
*** Mandell has joined #openstack-dev07:12
*** mindpixel has joined #openstack-dev07:12
*** metral has quit IRC07:16
openstackgerritA change was merged to openstack/cinder: Add admin only action for force detach  https://review.openstack.org/1485907:24
*** littleidea has quit IRC07:27
*** markwash has quit IRC07:40
*** Tross has joined #openstack-dev07:44
*** ndipanov has joined #openstack-dev07:48
*** littleidea has joined #openstack-dev07:49
*** AnilV4 has quit IRC07:50
*** AnilV4 has joined #openstack-dev07:52
*** eglynn__ has quit IRC07:54
*** eglynn__ has joined #openstack-dev07:55
*** lloydde has joined #openstack-dev07:57
*** FlaPer87 has joined #openstack-dev07:58
*** lloydde has quit IRC08:01
*** corXi has joined #openstack-dev08:03
*** salv-orlando has joined #openstack-dev08:04
*** EmilienM has joined #openstack-dev08:04
*** Tross has quit IRC08:09
*** darjeeling has quit IRC08:09
*** afazekas has joined #openstack-dev08:09
*** nati_ueno_2 has quit IRC08:09
ttxlifeless: that would not be arbitrary python, but predefined functions loaded from a trusted PYTHONPATH08:10
*** reidrac has joined #openstack-dev08:11
*** jakedahn is now known as jakedahn_zz08:11
*** eglynn__ has quit IRC08:12
*** nati_ueno has joined #openstack-dev08:15
ttxlifeless: that said, I still have to validate that model, so I certainly welcome your expertise :)08:16
lifelessttx: so for instance, any predefined function that permits arbitrary code execution (such as callbacks, closures, lambdas, pickles, json (default loader)08:17
lifelessttx: will be abusable08:17
ttxlifeless: rootwrap would still be the thing you execute as root, let me explain how I planned to do it08:18
ttxnova would call (as the nova user): sudo nova-rootwrap py function1 arg1 arg208:19
*** littleidea has quit IRC08:19
ttxsudo escalates that to root08:19
ttxnova-rootwrap has a dictionary mapping function1 to a specific module in its trusted PYTHONPATH08:19
ttxarg1 and arg2 would be passed as function arguments as strings08:19
ttxexample at end08:20
lifelessah08:20
ttxsudo nova-rootwrap py my_chown root /etc/moo08:20
ttxrootwrap maps "my_chown" to oslo.rootwrap.functions.my_$chown08:21
*** egallen has joined #openstack-dev08:21
ttxand call is like oslo.rootwrap.functions.my_chown(str(arg1), str(arg2))08:21
ttxthen it's up to my_chown to check parameters08:22
ttxit's not arbitrary python, it's predefined python functions (rather than predefined shell commands)08:22
*** Mandell has quit IRC08:22
lifelessso I dunno, it seems strictly redundant with a setup.py entrypoint that says 'oslo.rootwrap.functions:my_chown'08:22
*** diganta has quit IRC08:22
lifelesswhich will install into a stub binary08:23
ttxhmm, an entrypoint in... nova ?08:23
lifelessand its more complex because you're reinventing the marshalling issue (which distribute etc entry points offer)08:23
doudedanwent: ping08:24
lifelessttx: http://reinout.vanrees.org/weblog/2010/01/06/zest-releaser-entry-points.html seems like a reasonable quick primer08:24
ttxyou still need to escalate to root at one point, which is what sudo nova-rootwrap does08:24
ttx(or would that entrypoint just be on rootwrap side ?)08:25
ttxthx for pointer on entrypoints, will read08:25
ttxthe idea being, rootwrap is the only thing you allow to run as root via sudoers08:26
ttxif the function map within rootwrap can use entrypoints instead of a dictionary, sounds good08:27
doudedanwent: Oops, sorry. I wanted to ping dansmith, not you :$08:28
doudedansmith: ping08:28
*** zhuadl has joined #openstack-dev08:29
*** darjeeling has joined #openstack-dev08:30
*** apevec has joined #openstack-dev08:30
*** apevec has joined #openstack-dev08:30
lifelessttx: my point is that rootwrap doesn't need to special case python code08:31
*** eglynn__ has joined #openstack-dev08:31
lifelessttx: you can put the special case in setup.py with a one-liner, and keep rootwrap simpler.08:32
ttxlifeless: interesting. I'll definitely look into that! fwiw, I need to work on oslo-ification and a few other things first, so if it's in grizzly, will be late in grizzly.08:32
lifelesssure08:33
lifelessttx: for clarity, I'm saying, rootwrap still just calls binaries, but we can make it -super- simple to create those binaries08:33
*** pixelbeat has joined #openstack-dev08:36
*** salv-orlando has quit IRC08:36
*** Tross has joined #openstack-dev08:37
*** egallen has quit IRC08:37
jeblairI'm going to restart jenkins to make a configuration change08:38
*** openstackjenkins has quit IRC08:39
*** diganta has joined #openstack-dev08:41
*** openstackjenkins has joined #openstack-dev08:42
*** rburon has joined #openstack-dev08:43
*** Dorogs has joined #openstack-dev08:44
*** Gordonz has quit IRC08:45
*** danwent has quit IRC08:45
*** eglynn__ has quit IRC08:45
*** Gordonz has joined #openstack-dev08:46
jeblairJenkins is back up08:46
*** crandquist has quit IRC08:47
*** darjeeling has quit IRC08:49
*** rushiagr has quit IRC08:55
*** rushiagr has joined #openstack-dev08:56
*** Tross has quit IRC08:57
*** arosen1 has joined #openstack-dev08:58
arosen1hey garyk you there?08:58
garykarosen: hi08:59
arosen1I see you just +2'ed this (https://review.openstack.org/#/c/15609/) , I just added a comment i'm not sure we want to merge that yet08:59
garykarosen1: hi08:59
*** reed has quit IRC08:59
garykarosen1: give me a sec09:00
arosen1You can still remove your approved before it merges  though.09:00
arosen1k09:00
garykarosen1: i'll try09:01
garykarosen1: good cath. hope it is not too late. sorry\09:01
arosen1garyk: unless you think it's okay to merge. Though I don't think changing the perm on those files matter unless we have the #! at the top09:01
arosen1garyk:  no worries. I had +2 but then noticed that.09:01
*** egallen has joined #openstack-dev09:02
garykarosen1: i must be honest i did not see any reason for the patch as there are the binaries that invoke this code. i just thought that it is harmless.09:02
*** doude has quit IRC09:03
*** reed has joined #openstack-dev09:03
arosen1garyk:  I agree09:04
garykarosen1: how you keeping?09:05
*** doude has joined #openstack-dev09:05
arosen1garyk: pretty good. Just been really really busy working on a lot of internal stuff.09:07
arosen1garyk:  what about you?09:07
*** eglynn__ has joined #openstack-dev09:08
garykarosen1: sadly busy with bugs. trying to answer an email on the list which is taking me forever. in dire need of a vacation09:08
arosen1garyk: yup, thanksgiving is coming soon :)09:09
garykarosen1: not on our side of the world :)09:09
*** afazekas has quit IRC09:09
*** sagar_nikam has joined #openstack-dev09:10
arosen1that's to bad :P09:11
*** afazekas has joined #openstack-dev09:21
*** zhuadl has quit IRC09:22
*** ondergetekende has joined #openstack-dev09:25
*** darraghb has joined #openstack-dev09:26
*** reed has quit IRC09:27
*** nati_ueno_2 has joined #openstack-dev09:28
*** nati_ueno has quit IRC09:30
*** marcus has joined #openstack-dev09:30
*** marcus has left #openstack-dev09:32
*** eglynn__ has quit IRC09:32
*** marcus has joined #openstack-dev09:33
*** marcus has quit IRC09:33
*** marcus has joined #openstack-dev09:33
*** xchu has quit IRC09:33
*** Dorogs has quit IRC09:34
*** marcus has left #openstack-dev09:34
*** marcus has joined #openstack-dev09:34
*** Dorogs has joined #openstack-dev09:40
*** armaan has joined #openstack-dev09:42
*** eglynn__ has joined #openstack-dev09:42
*** armaan has left #openstack-dev09:42
*** reed has joined #openstack-dev09:43
marcushey everyone, i'm currently trying to setup a nova development environment on my machine. So, I followed the instructions on this website http://docs.openstack.org/developer/nova/devref/development.environment.html#mac-os-x-systems. I am using Mac OS X 10.8.2 but getting some unexpected problems during install process. the tools/install_env.py script stopped whens it's dealing with mysql; fatal error: 'my_config.h' file not fou09:43
marcusAfter that I installed mysql via mac ports but didn't help. Have someone an idea. thank u09:43
FlaPer87marcus have you tried to locate that header in your system? Did you installed development files?09:46
marcusthere is no my_config.h on my system, which development files do u mean? mysql-dev files?09:48
FlaPer87AFAIK, macports doesn't install lib's headers unless you explicitly do that (*-devel packages)09:48
FlaPer87(btw, brew is way cleaner than macports)09:48
*** afazekas has quit IRC09:49
*** jpich has joined #openstack-dev09:52
FlaPer87marcus ^09:53
marcusthank you, i'll install the mysql dev thing an than retry to install_env09:54
*** maploin has joined #openstack-dev09:55
*** maploin has quit IRC09:55
*** maploin has joined #openstack-dev09:55
*** marcus has quit IRC09:57
*** FlaPer87 has quit IRC09:58
digantacan anyone help me regarding Nova project , ?09:59
*** eglynn__ is now known as eglynn09:59
*** Tross has joined #openstack-dev10:01
*** darjeeling has joined #openstack-dev10:03
*** e1mer has quit IRC10:04
*** \etc\bin has joined #openstack-dev10:04
*** Tross has quit IRC10:09
*** \etc\bin is now known as e1mer10:10
digantai just want to know the column of volume table10:11
*** gongysh has joined #openstack-dev10:11
*** nati_ueno_2 has quit IRC10:12
*** winston-d has joined #openstack-dev10:13
*** nati_ueno has joined #openstack-dev10:13
*** afazekas has joined #openstack-dev10:13
digantazbitter:  r u there ?10:14
zbitteruh, yes10:15
rushiagrdiganta: are you talking about cinder?10:15
*** zbitter is now known as zaneb10:16
digantano actually i found a bug in Nova , i want to fix , but i need some info , column details of Volume table ,10:16
rushiagrdiganta: have a look at class Volume in nova/db/sqlalchemy/models.py10:18
rushiagri hope this is correct way to look at it. someone plz confirm10:18
*** mmagr has joined #openstack-dev10:18
*** arata has quit IRC10:24
digantaok rushiagr:  i am looking at Volume class as u told10:26
*** simonmcc has joined #openstack-dev10:30
*** nati_ueno has quit IRC10:30
*** arata has joined #openstack-dev10:31
*** nati_ueno has joined #openstack-dev10:31
*** mindpixel has quit IRC10:32
*** marcus has joined #openstack-dev10:32
*** maxiz has quit IRC10:36
*** ociuhandu has quit IRC10:38
*** corXi has quit IRC10:46
*** markmc has joined #openstack-dev10:48
*** armaan has joined #openstack-dev10:48
*** armaan has left #openstack-dev10:48
*** maurosr has joined #openstack-dev10:48
doudeHi all, I worked on bug correction for a few days. I wanted to commit my changes but meanwhile the master files had big modifications from another commit10:50
doudeand my code gets a lot of conflicts when it rebase with the master10:51
doudehow I can resolve that10:51
doude?10:51
doudeis it possible to abandon all my changes in branch and get the master code ?10:52
rushiagrdoude: http://wiki.openstack.org/GerritWorkflow10:52
rushiagrhave a look at this quick reference guide10:52
*** gongysh has quit IRC10:52
rushiagrit contains a solution to your problem10:53
*** openstack has joined #openstack-dev18:39
harlowjarussellb jaypipes look at line 210 of https://review.openstack.org/#/c/13166/16/nova/virt/images.py18:39
smoserbut as i said, i'll fix it. but its pain to SRU it.18:39
harlowjathen the same line in nova is still there :-p18:39
clarkbbasiclly devstack gate does insecure volumes, but that is probably ok18:39
alexpilottismoser: c.) teh code is in cloud-init since october, so we don't ghave images for Hyper-V now. Existing ones for other hypervisors require anyway work18:40
davidkranzclarkb: Yeah, that makes sense. Thanks for the update.18:40
alexpilottismoser: a.) I'd gladly provide the fix18:40
jgriffithdavidkranz: we may have quited the dd issue anyway (even without the disable patch)18:41
alexpilottismoser: b.) that could be an issue18:41
davidkranzjgriffith: Cool.18:41
jgriffithdavidkranz: clarkb although I haven't been able to confirm in the devstack gate runs that the disable is actually happening18:41
*** eglynn has joined #openstack-dev18:41
* jgriffith I should probably look into that18:41
harlowjajaypipes russellb nm, that code is on trunk18:41
*** gatuus has quit IRC18:43
*** kbringard has quit IRC18:43
harlowjajaypipes found it!18:43
harlowjai'm so smart18:43
harlowjalol18:43
jaypipeshehe18:43
*** Lumiere has quit IRC18:43
alexpilottismoser: tx for clarifying, I'm going to work on the VHD side18:44
*** kbringard has joined #openstack-dev18:44
*** Lumiere has joined #openstack-dev18:44
*** Lumiere has joined #openstack-dev18:44
smoseralexpilotti, SRU is not impossible.18:45
smoserits just aPITA18:45
alexpilottismoser: form what I read in your conversation with ociuhandu18:46
alexpilottismoser: also Xen would hit the same issue18:46
*** thovden has joined #openstack-dev18:46
alexpilottismoser: do you think that in that case we could go for the SRU?18:47
alexpilottismoser: it's not an urgent issue for us, as we are going to distribute a custom package for existing distros anyway18:48
harlowjajaypipes: https://review.openstack.org/1565518:49
harlowjabrb18:49
*** arbrandes has quit IRC18:49
*** rushiagr has left #openstack-dev18:50
*** thovden has quit IRC18:50
*** jcru|away is now known as jcru18:50
smoseralexpilotti, well xen just has the same issue as you i think. i honestly dont know though.18:51
smoseri will end up wanting to SRU config-drive-v2 support to 12.04 at some point also18:51
*** cp16net|away is now known as cp16net18:51
smoserso i cant completely avoid that pain.18:51
smoserbut i really do think its better for everyone if hypervisors provide consistent behavior where possible.18:52
alexpilottismoser: I can for sure guarantee a beer at the next summit :-)18:52
smosercan we just do both?18:52
*** m4xmr has joined #openstack-dev18:52
*** m4xmr has quit IRC18:53
*** s0mik has joined #openstack-dev18:53
alexpilottismoser: both as the "disk ISO" and "cdrom ISO" approach?18:53
*** tmishler has quit IRC18:54
smoseras in hyper-v would attach disk, but cloud-init would relax its insistance on disk.18:54
*** tmishler has joined #openstack-dev18:54
smoserso that in the future i can swear at myself for relaxing it, when it becomes a problem (i dont know why).18:54
*** eglynn has quit IRC18:55
*** m4xmr has joined #openstack-dev18:55
*** colinmcnamara has joined #openstack-dev18:55
*** m4xmr has quit IRC18:55
alexpilottismoser: what do you think if we commit the "cdrom" option now, adding the disk option later (e.g. g-2)?18:56
*** hemna has quit IRC18:57
*** esp2 has joined #openstack-dev18:58
smosersure. as long as "adding disk option later" != "get smoser to stop complaining"18:58
*** gatuus has joined #openstack-dev18:59
*** SlickNik has quit IRC19:00
alexpilottismoser: sure. We have only an issue to solve for that: dd'ing the iso to a VHD requires mounting the VHD as a loopback device. And that could create race condition issues, as there's no way to identify the mounted device beside iterating on teh volumes19:01
*** SlickNik has joined #openstack-dev19:01
*** danwent has quit IRC19:01
smoseralexpilotti, do you really not have any way to convert a "raw" file to a vhd ?19:01
smoseri'm genuinely asking.19:02
smoser'qemu-img convert' reports to support vhd19:02
alexpilottismoser: I'm thinking about qemu-img convert19:02
alexpilottismoser: but I have to check the licensing19:02
smoseri'm pretty sure it doesnt support all the new-fangled vhd goodness19:02
alexpilottismoser: it does indeed19:02
alexpilottismoser: we are using it in other projects to convert VMDKs to VHDs19:03
alexpilottismoser: the only pity is that it doesn't support AMI but that's another story19:03
*** mnewby_ has joined #openstack-dev19:03
*** mnewby_ has quit IRC19:03
*** networkstatic has quit IRC19:03
smoserwhat is "ami" ?19:04
*** mnewby_ has joined #openstack-dev19:04
alexpilottismoser: the AWS format19:04
smoseralexpilotti, also, there is a tool in virtualbox that can do this stuff.19:04
smoseri dont know what na aws format is.19:04
*** crandquist has joined #openstack-dev19:04
smoserits just 'raw' for them.19:04
*** spiffxp is now known as spiffxp-test19:05
*** gatuus has quit IRC19:05
alexpilottismoser: also we have to port quemu-img to Windows in that case19:05
*** mnewby has quit IRC19:06
*** kobier has joined #openstack-dev19:06
*** mnewby_ is now known as mnewby19:06
*** crandquist has quit IRC19:06
*** andrewbogott_afk is now known as andrewbogott19:07
*** maurosr has quit IRC19:10
*** maurosr has joined #openstack-dev19:10
*** metral has quit IRC19:10
alexpilottismoser: I checked, quemu is not supporting VHDs19:10
*** danwent has joined #openstack-dev19:10
*** networkstatic has joined #openstack-dev19:10
*** annashen has joined #openstack-dev19:12
*** saurabh__ has joined #openstack-dev19:13
*** saurabh__ has left #openstack-dev19:13
smoserit does support *something* called vhd19:14
smoser"vpc VirtualPC compatible image format (VHD)."19:14
smoserand also, check the virtualbox utility19:14
*** spiffxp-test is now known as spiffxp19:14
*** worldofmanish has quit IRC19:14
alexpilottismoser: yep, we use it to convert VMDKs to VHDs19:15
alexpilottismoser: but it doesn't support isos19:15
alexpilottismoser: I'm going to check the virtualbox tool19:16
alexpilottismoser: the problem there is that it might be impossible to package it with a separate product from a licensing perspective, I have to check19:16
*** hemna has joined #openstack-dev19:21
smoseralexpilotti, but an iso is just "raw" , no?19:22
*** gatuus has joined #openstack-dev19:22
alexpilottismoser: good point :-)19:23
*** saurabh_ has joined #openstack-dev19:23
jgriffithanybody from stable-maint-team available to approve https://review.openstack.org/#/c/15594/19:23
alexpilottismoser: I'm going to do a test right away19:23
notmynamejaypipes: commented on swift tests (tl;dr: -1 needs work)19:24
*** SlickNik has quit IRC19:25
smoseralexpilotti, i have to go now. i'll check back in later.19:25
*** SlickNik has joined #openstack-dev19:26
alexpilottismoser: ok tx!19:26
smoserthanks for being open to input.19:26
*** melwitt has joined #openstack-dev19:26
smoser:)19:26
jaypipesnotmyname: thx!19:28
*** egallen has quit IRC19:29
*** rkukura has quit IRC19:32
*** saurabh_ has quit IRC19:32
*** rgoodwin has joined #openstack-dev19:33
*** ayoung has quit IRC19:34
*** SlickNik has quit IRC19:35
*** colinmcnamara has quit IRC19:37
*** SlickNik has joined #openstack-dev19:37
*** openstack has joined #openstack-dev19:45
jaypipesdavidkranz: link to that successful run?19:45
*** arata has quit IRC19:45
davidkranzjaypipes: Look at https://jenkins.openstack.org/view/Bitrot/job/periodic-tempest-devstack-vm-full/7/console from yesterday.19:46
davidkranzjaypipes: Just the seven errors caused by the keystone bug, nova qemu bug and the one I just fixed.19:46
jaypipesdavidkranz: the image client timeouts are from the infinite loop bug, not qemu19:47
davidkranzjaypipes: Oh. Then there are two bugs affecting the same tests :(19:47
*** alexpilotti has quit IRC19:47
jaypipesdavidkranz: BTW, the KeyError: 'extra' failures... is that due to a change in Keystone?19:47
dolphmjaypipes: yes19:48
davidkranzjaypipes: Yes. I filed a bug and it was merged earlier today.19:48
jaypipesdolphm: k19:48
*** SlickNik has joined #openstack-dev19:49
bcwaldondavidkranz, jaypipes: I haven't been able to spend time on that bug yet - but you should be able to get around it by setting rabbit_durable_queues to match whatever your queue durability actually is19:50
*** echohead has joined #openstack-dev19:51
jaypipesbcwaldon: is that a new glance-api.conf setting?19:52
bcwaldonnope19:52
bcwaldonthis bug has been around for quite a while19:52
jaypipesbcwaldon: no, I mean is that a setting in glance-api.conf -- as opposed to a rabbit setting somewhere?19:52
davidkranzjaypipes: Note also that as recently as Nov 1, before the keystone and nova bugs were introduced, the only failure was the one I just fixed: http://logs.openstack.org/12485/3/check/gate-tempest-devstack-vm/16456/console.html.gz19:53
bcwaldonrabbit_durable_queues is the glance-api.conf setting19:53
jaypipesk, thx19:53
jaypipesdavidkranz: interesting...19:54
davidkranzjaypipes: I guess we will see for sure when the nova bug fix is merged and I reverify.19:54
*** vipul is now known as vipul|away19:54
*** vipul|away is now known as vipul19:54
jaypipesk19:55
*** novas0x2a|laptop has joined #openstack-dev19:57
*** novas0x2a|laptop has quit IRC19:58
*** novas0x2a|laptop has joined #openstack-dev19:58
*** jcooley has quit IRC20:00
*** alexpilotti has joined #openstack-dev20:00
*** metral has joined #openstack-dev20:03
BLZbubbais there an easy way to have one of the guest vm's boot up with the qemu CLI option "-std-vga" ?20:04
*** maurosr has quit IRC20:05
BLZbubbai wouldn't mind trying it for all vm's but it may break the existing ones20:06
*** danwent has quit IRC20:06
*** danwent has joined #openstack-dev20:07
jgriffithannegentle_: ping20:08
annegentle_jgriffith: hey20:08
jgriffithannegentle_: howdy20:08
annegentle_jgriffith: how goes it?20:09
jgriffithannegentle_: quick question....20:09
annegentle_jgriffith: shoot20:09
jgriffithannegentle_: good :)20:09
*** krtaylor has quit IRC20:09
jgriffithannegentle_: I'm now looking at http://docs.openstack.org/trunk/openstack-compute/admin/content/ch_volumes.html20:09
*** vipul is now known as vipul|away20:09
annegentle_jgriffith: okie20:09
jgriffithannegentle_: appropriate to just linkk "Install cinder" to the other doc?20:09
jgriffithannegentle_: know what I mean there?20:10
annegentle_jgriffith: might be best, yeah… really we need to figure out if we need a whole new "Volumes with Cinder" type of chapter?20:10
jgriffithannegentle_: I think we do (but not today) :)20:10
jgriffithannegentle_: that brings me to the next questionn20:10
annegentle_jgriffith: yeah is it a new chapter ? Yeah I think so.20:10
jgriffithannegentle_: yeah, I think it's a new chapter for sure20:11
jgriffithannegentle_: the other question....20:11
annegentle_jgriffith: ok20:11
annegentle_hey I should have asked, is the Storwize stuff for Folsom or only Grizzly?20:11
jgriffithannegentle_: Do we leave the nova-volume ref's in trunk for now or do I start switching those over?20:11
* annegentle_ needs to release folsom docs20:11
jgriffithannegentle_: Folsom20:11
*** datsun180b has joined #openstack-dev20:11
annegentle_jgriffith: ok, whew.20:12
jgriffith:)20:12
annegentle_jgriffith: so I need to cut a branch20:12
*** networkstatic has quit IRC20:12
annegentle_jgriffith: working on it this week20:12
annegentle_jgriffith: so, leave those in trunk for now and start a new chapter20:12
jgriffithannegentle_: alright coolio20:12
jgriffithannegentle_: thanks!20:12
annegentle_then in grizzly's new branch (the new trunk I'll make) we'll have a place to really dig in20:12
jgriffithannegentle_: Yup, sounds good20:12
jgriffithannegentle_: I'll hopefully do some doc work this afternoon, then work on some patches tonight20:13
annegentle_jgriffith: nice20:13
jgriffithannegentle_: Then I'm gone for a few days moving cattle :)20:13
jgriffithannegentle_: Thanks for the help20:14
*** roge has quit IRC20:14
*** rdo has quit IRC20:14
annegentle_jgriffith: really moving cattle?20:15
jgriffithannegentle_: Yup!  :)  One of my favorite things20:16
jgriffithannegentle_: once in the spring and once in the fall20:16
jgriffithannegentle_: couple days horseback, no phone, computer etc20:16
*** adjohn has quit IRC20:16
davidkranzannegentle_: api.openstack.org has two broken links. API Complete reference points to self, and API Specifications is as broken link20:18
*** jcru is now known as jcru|away20:19
annegentle_davidkranz: thanks - moving around some of the Jenkins jobs and source now20:19
annegentle_davidkranz: will fix asap!20:19
BLZbubbaok so there is no way to change the qemu-kvm command line options for vga?20:21
*** roge has joined #openstack-dev20:21
*** alop has joined #openstack-dev20:21
*** krtaylor has joined #openstack-dev20:21
*** aeperezt has quit IRC20:22
*** eglynn has joined #openstack-dev20:23
*** aeperezt has joined #openstack-dev20:26
*** roge has quit IRC20:28
*** jcru|away is now known as jcru20:29
*** Dorogs has joined #openstack-dev20:29
*** winston-d has quit IRC20:30
*** dhellmann has joined #openstack-dev20:33
*** FlaPer87 has quit IRC20:34
*** jcru is now known as jcru|away20:34
*** jcru|away is now known as jcru20:37
*** pixelbeat has quit IRC20:37
*** otherwiseguy has quit IRC20:44
*** armaan has left #openstack-dev20:45
jaypipesbcwaldon: how do I determine what the durability of my rabbit queues are if devstack if setting it all up?20:46
*** metral has quit IRC20:47
*** arata has joined #openstack-dev20:47
lifelessjaypipes: rabbitmq-ctl list_queues20:47
lifelessjaypipes: rabbitmq-ctl list_exchanges20:47
*** otherwiseguy has joined #openstack-dev20:47
*** hemna has quit IRC20:48
jaypipeslifeless: how does that help determine the durability?20:48
lifelessit should tell you20:48
lifelessits a flag on the queue / exchange20:48
lifelessmight need the admin cli; one sec20:49
*** danpb has joined #openstack-dev20:49
*** metral_ has joined #openstack-dev20:49
jaypipeslifeless: am I missing something here? http://paste.openstack.org/show/25089/20:49
*** Tross has joined #openstack-dev20:50
lifelesslist_queues name durable auto_delete messages consumers20:51
lifelesslist_exchanges name type durable auto_delete arguments20:52
lifelessjaypipes: ^20:52
*** egallen has joined #openstack-dev20:52
*** adjohn has joined #openstack-dev20:54
openstackgerritA change was merged to openstack/horizon: Flavor Extra Specs support.  https://review.openstack.org/1316920:54
bcwaldonjaypipes: well, this isn't an intelligent way to do it, but if you see that bug then invert the value of rabbit_durable_queues ;)20:54
jaypipesbcwaldon: yeah... just trying to figure out how to get devstack to do it...20:55
jaypipeslifeless: much appreciated... got it.20:55
jaypipeshttp://paste.openstack.org/show/25090/20:55
jaypipesso there's my problem :) just need to get devstack to write out True, not False..20:55
*** Ruetobas has quit IRC20:57
openstackgerritA change was merged to openstack/glance: Ensure authorization before deleting from store  https://review.openstack.org/1565820:57
*** egallen has quit IRC20:58
*** egallen has joined #openstack-dev20:58
mnewbydanwent: *ping*20:58
danwentmnewby: hey20:59
lifelessdanwent: hi, you are heavily involved in quantum, right ?20:59
mnewbydanwent: Hi Dan.20:59
danwentmnewby: hey20:59
danwentlifeless: yes, one could say that :)20:59
vishynova meeting about to start in #openstack-meeting20:59
mnewbydanwent: I'm looking at the quantum packaging for ubuntu and for some reason the ovs plugin package depends on openvswitch-switch.  Shouldn't that only be required for the agent?20:59
lifelessdanwent: If so, I have a somewhat random question for you - is anyone successfully running quantum w/openflow  on top of quantum w/openflow.21:00
lifelessdanwent: [also hi, pleased to meet you :)]21:00
danwentmnewby: yes, that would be more accurate21:00
mnewbydanwent: Ok, I'll follow up.21:00
mnewbydanwent: danke21:00
danwentmnewby: thx21:00
danwentlifeless: depends what you mean by "quantum on openflow".21:00
lifelessdanwent: I'm certain I have my terminology wrong. What I'm considering is this:21:01
danwentfor example, the nicira solution uses openflow as part of the solution, but there are other solutions that use openflow in a very different way.21:01
*** metral has joined #openstack-dev21:01
lifelessnova baremetal to deploy physical machines. Those machines running on a SDN managed by quantum, implemented by openflow hardware.21:01
*** Ruetobas has joined #openstack-dev21:02
*** hemna has joined #openstack-dev21:02
lifelessthen, those machines run nova compute, hosting VM's, and the VM networks are managed by quantum, with ovs on the host and tunnelling21:02
lifelessbetween compute hosts21:02
lifelessMy understanding of the theory is that this should all Just Work, but I'd love to know there is an existence proof out there :)21:02
*** jog0_ has joined #openstack-dev21:03
danwentlifeless: that is certainly conceptually possible.  however, the set of openflow enabled hardware is pretty limited right now, so I'm not aware of anyone with a production deployment doing that (not saying there aren't any, I am just not familiar with any of them).21:03
danwentmost people just run standard L3 router protocols, and tunnel over them, in my experience.21:04
lifelessok, thanks.21:04
*** nunosantos has joined #openstack-dev21:04
*** metral_ has quit IRC21:04
openstackgerritA change was merged to openstack/nova: Limit formatting routes when adding resources  https://review.openstack.org/1562321:05
zykes-danwent: openflow in production on hardware except the big G21:05
*** rburon has quit IRC21:05
*** jog0 has quit IRC21:05
*** jog0_ is now known as jog021:05
*** anniec has quit IRC21:06
danwentzykes-: hehe, yes, i was limiting myself to discussing openstack deployments.  What G did would be well beyond what most other companies could do.21:06
zykes-:p21:06
openstackgerritA change was merged to openstack/horizon: Wrap a project list call with exception handler.  https://review.openstack.org/1543921:07
*** egallen has quit IRC21:07
*** egallen has joined #openstack-dev21:07
*** egallen has quit IRC21:08
*** anniec has joined #openstack-dev21:10
*** metral has quit IRC21:10
*** epim has quit IRC21:15
*** dspano_ has joined #openstack-dev21:17
*** Dorogs has quit IRC21:18
*** boden has quit IRC21:19
*** s0mik has quit IRC21:19
*** littleidea has joined #openstack-dev21:19
*** s0mik has joined #openstack-dev21:22
*** radez is now known as radez_g0n321:24
*** gyee has joined #openstack-dev21:29
*** s0mik has quit IRC21:30
*** cp16net is now known as cp16net|away21:32
*** afazekas has quit IRC21:34
bcwaldonjeblair: ping21:36
*** vipul|away is now known as vipul21:37
zykes-mikal: around ?21:37
*** dolphm has quit IRC21:37
*** cp16net|away is now known as cp16net21:38
*** roge has joined #openstack-dev21:39
*** danpb has quit IRC21:44
*** ayoung has joined #openstack-dev21:47
*** juice has joined #openstack-dev21:47
*** corXi has quit IRC21:48
*** littleidea has quit IRC21:48
*** rnirmal has quit IRC21:51
*** epopt37 has joined #openstack-dev21:53
*** littleidea has joined #openstack-dev21:57
*** Dorogs has joined #openstack-dev21:58
*** Dorogs has quit IRC21:59
*** littleidea has quit IRC22:00
*** markmcclain1 has joined #openstack-dev22:01
*** jcooley has joined #openstack-dev22:01
*** markvoelker has quit IRC22:01
*** markmcclain has quit IRC22:02
*** jog0 has quit IRC22:02
*** jog0 has joined #openstack-dev22:03
*** littleidea has joined #openstack-dev22:03
*** anniec has quit IRC22:03
davidkranzsdague, dansmith : A new test was added to this https://review.openstack.org/#/c/15655/222:04
*** anniec has joined #openstack-dev22:04
clarkbbcwaldon: jeblair is in Europe so you probably won't hear from him for many hours. Anything the CI team can help with?22:05
dansmithdavidkranz: looking22:05
dansmithdavidkranz: done22:06
davidkranzdansmith: Thanks. Now we will see if this fixes the tempest problem.22:07
bcwaldonclarkb: yes, I never know which one of you guys to poke22:07
bcwaldonclarkb: this might need you to push a button on the backend - https://review.openstack.org/#/c/15142/22:07
bcwaldonclarkb: its cleared to land but it hasnt been merged22:07
clarkbbcwaldon: apparently it needs a recursive merge to get merged which gerrit won't do22:08
bcwaldonclarkb: should I just rebase it and re-approve?22:08
clarkbbcwaldon: yes, that should get it through22:08
bcwaldonk, thanks!22:08
clarkbif not poke me again and we'll dig into it more22:09
*** mtreinish has quit IRC22:10
*** dolphm has joined #openstack-dev22:11
openstackgerritA change was merged to openstack/python-novaclient: show help when calling without arguments  https://review.openstack.org/1566522:11
*** kbringard has quit IRC22:11
*** koolhead17 has joined #openstack-dev22:13
*** saurabhsurana_ has joined #openstack-dev22:13
*** PaulM has quit IRC22:14
*** PaulM has joined #openstack-dev22:16
*** e1mer has joined #openstack-dev22:17
vishyrussellb: that eventlet issue is interesting22:18
russellbvishy: it made me want to rage22:18
russellbi seriously saw select() saying a pipe was ready for reading when nothing had written to it22:18
russellbhad lots of logging to verify it22:19
russellbbut i can't reproduce it with simple test code22:19
*** tgall_foo has quit IRC22:25
vishyrussellb: gross22:25
vishyrussellb: I ran into a really annoying eventlet issue the other day22:25
vishywhere the return code from popen was incorrect22:25
russellbawesome..22:26
russellbdid you see my patch to wrap eventlet's select?  heh22:26
vishyrussellb: still didn't figure out how it was happening22:26
russellbi got the result from its select() then did a non-blocking call to the built-in select to sanity check the result22:26
russellb(i abandoned it, felt way too dirty about it)22:26
vishyrussellb: but apparently not monkeypatching os does it.22:26
russellbyeah, so you're not going through eventlet's version22:27
russellbsame with this bug, not patching select fixes it22:27
russellbthat's what we get for replacing core stdlib stuff, heh22:27
lifelessrandom question time22:28
lifelesswhy do we use eventlet ?22:28
russellbwatermelons!22:28
russellb(random answer time)22:28
lifelessit seems super fragile22:28
vishylifeless: alternative solution?22:29
lifelessvishy: to what problem definition ?22:29
vishylifeless: async code22:29
lifelessvishy: I'm not criticising the choice, I'm asking what problems we're solving w/eventlet I guess.22:29
russellbso what's wrong with regular threads?22:29
*** kgriffs has quit IRC22:29
vishyrussellb: locking is hard :)22:30
russellbha22:30
vishyrussellb: actually it is just another set of problems22:30
PaulMso we used eventlet. hah.22:30
*** metral has joined #openstack-dev22:30
PaulMnow we have 2 problems22:30
vishyPaulM: actually we started with twisted22:30
PaulMoh22:31
* russellb would rather have real threads and do locking22:31
PaulMwell, that might be an upgrade22:31
*** sniperd has quit IRC22:31
vishyand everyone was like, but eventlet is so much easier!22:31
russellbwe're not doing *that* much data sharing22:31
lifelessvishy: so, were they right ?22:31
vishyeasier to use, yes, by far22:31
vishyless buggy? questionable?22:31
PaulMrussellb: I agree. Eventlet is unnecessary22:31
lifelessvishy: :) 'better overall' I think is the metric I'm interested in.22:32
russellbbut who has "work on eventlet alternative" at the top of their todo list ...22:32
lifelessvishy: whats your take from that angle ?22:32
vishyI actually just think threads / eventlet / multiprocessing / twisted each comes with their own unique difficulties22:32
vishyconcurrency is hard in general22:32
lifelessmultiprocessing is terribly slow22:32
russellb+1 to that22:32
vishyeveryone just complains about the concurrency model they are currently using22:32
russellbto vishy's comment i mean.22:32
*** jcooley has quit IRC22:32
vishygrass is always greener22:32
PaulMsure, but how much data are we sharing? We're running a freakin' rest API, this should not be stateful inside our process22:32
russellbi wasn't nearly as angry until i hit this bug this week :)22:32
vishythe real solution is erlang obv.22:32
PaulMfor srs22:33
lifelessvishy: I'm not sure about that. There are lots of folk in various communities that are very happy to be there.22:33
lifeless[that == everyone complains]22:33
* russellb came from a heavily multi-threaded app before this, and definitely complained about it :-p22:33
vishylifeless: show me a project taht is using the number of different technologies we are using across multiple machines22:33
vishyand is happy with there concurrency model22:33
vishy:)22:33
vishy* their22:33
russellbI DON'T HEAR YOU22:34
russellbstop trying to be so reasonable22:34
lifelessvishy: Launchpad is similar in size and pretty happy, using a combination of tools - threads for application servers, twisted for custom network protocols / backend services.22:34
PaulMvishy: serious question: which parts of the stack are actually using features of eventlet that can't be trivially replicated by separate threaded workers?22:35
lifelessvishy: not to say that that would work elsewhere, just answering the qestion.22:35
vishyPaulM: unknown, but I know there are assumptions in various places that we aren't using real threads22:36
russellbi got flamed for pointing out one of those in a patch recently22:36
russellband the author told me that it wasn't worth fixing22:36
russellb:-(22:36
*** dhellmann has quit IRC22:36
PaulMvishy: interesting. so we're using eventlet because nobody knows why we can't22:37
*** sunilthaha has joined #openstack-dev22:37
openstackgerritA change was merged to openstack/horizon: Remove superfluous slash from admin usage.csv template  https://review.openstack.org/1514222:37
*** littleidea has quit IRC22:38
PaulM<sigh> ah well. At least most of the code I touch doesn't have to deal with eventlet22:38
russellbwell i don't know that it's that nobody knows22:39
russellbit's working well enough that it hasn't become a top priority for anyone to investigate changing22:39
nati_uen_+1 for erlang22:39
*** rbasak has quit IRC22:39
vishyPaulM: no we're using eventlet because writing things in threaded code is hard so no one has taken the time to try to rip it out :)22:39
*** littleidea has joined #openstack-dev22:40
* russellb likes the challenge!22:40
PaulMwhat things? I'm trying to understand an example where we'd be talking between threads22:40
vishyPaulM: although it has been suggested multiple times for the compute worker22:40
vishyPaulM: shared state in the scheduler22:40
vishyPaulM: shared state in the compute worker22:41
*** annegentle_ has quit IRC22:41
PaulMah, so we did actually write that in22:41
vishyPaulM: the api worker would be fine but on the other hand evented code is pretty good for api code22:41
* PaulM is in a war on stateful things22:41
russellbit's actually more the compute side that we have eventlet trouble22:41
*** epim has joined #openstack-dev22:42
vishyevery summit someone suggests turning it into a simple worker22:42
vishybut I still haven't seen code :)22:42
*** epim has quit IRC22:42
russellbheh22:42
*** epim has joined #openstack-dev22:42
russellbdansmith and I have been talking about a nova-compute-proxy that looks more like nova-sink at first, but slowly stuff starts moving up22:42
*** Tross has quit IRC22:42
russellbi don't think we'll get to this really nice think nova-compute some folks envision22:43
russellbbut we can set the track that direction22:43
russellbs/think/thin/22:44
russellbbut we'll have real code :)22:45
*** markmcclain1 has quit IRC22:47
*** koolhead17 has quit IRC22:49
vishyyay for real code22:50
*** cp16net is now known as cp16net|away22:53
*** cp16net|away is now known as cp16net22:53
*** thovden has joined #openstack-dev22:54
*** echohead has quit IRC22:54
*** thovden has left #openstack-dev22:55
*** echohead has joined #openstack-dev22:57
*** gatuus has quit IRC22:58
*** sunilthaha has quit IRC22:58
*** anniec has quit IRC23:01
*** anniec has joined #openstack-dev23:02
*** vipul is now known as vipul|away23:03
*** FlaPer87 has joined #openstack-dev23:04
*** arosen has left #openstack-dev23:08
*** dspano_ has quit IRC23:10
*** alunduil has quit IRC23:10
russellbvishy: so, i'm concerned about this patch ... https://review.openstack.org/#/c/15594/23:12
vishyrussellb: that is the one i was talking about! :)23:13
russellbyeah :)23:13
russellbbut when i looked it, i realized that preventing eventlet from switching on read() and write() is a little worrying23:13
russellbsince those are going to get used a lot23:13
russellband all the sudden we've removed it23:13
russellbbased on the commit message ... is this as simple as doing a file presence check before calling openssl?23:14
russellbguess i need to pull up keystone23:14
*** aeperezt has quit IRC23:14
*** gatuus has joined #openstack-dev23:15
*** echohead has quit IRC23:15
jaypipesdavidkranz: yeah, so I fixed the rabbit durable shit and yeah, still getting those errors (timeout) for any test using services/compute/json/images_client.py :(23:16
*** hattwick has quit IRC23:16
vishyrussellb: we could change it to do that but i'm worried about the underlying issue23:17
russellbi certainly understand that23:17
russellbtempting to not patch select() either for the same reason, heh'23:17
russellbbut ... we're going to kill our threads23:18
russellbi don't have a good answer i guess23:18
russellbcan fix this one place where the error occurred, but for the general case, we're in trouble either way23:18
russellbbut hurting thread scheduling, or dealing with knowing that eventlet might lie to us23:18
russellbsigh.23:18
*** nati_uen_ has quit IRC23:19
*** hattwick has joined #openstack-dev23:19
*** nati_uen_ has joined #openstack-dev23:19
*** jergerber has quit IRC23:19
*** jergerber has joined #openstack-dev23:21
*** aeperezt has joined #openstack-dev23:21
*** sacharya has quit IRC23:21
*** markwash has quit IRC23:22
*** datsun180b has quit IRC23:23
*** imsplitbit has quit IRC23:23
*** matiu has quit IRC23:23
*** zaitcev has quit IRC23:23
*** Hien has quit IRC23:23
*** fungi has quit IRC23:23
*** pixelbeat has joined #openstack-dev23:24
vishyrussellb: I have repro case!23:24
*** Hien has joined #openstack-dev23:24
russellb\o/23:24
*** fungi has joined #openstack-dev23:26
*** zaitcev has joined #openstack-dev23:27
*** gatuus has quit IRC23:27
*** Gordonz has quit IRC23:29
*** jaypipes has quit IRC23:30
vishyrussellb: http://paste.openstack.org/show/25123/23:30
vishyi think it has to do with openssl closing file handles23:30
vishytrying to repro with a different binary23:30
*** jimfehlig has quit IRC23:31
russellbso here's a question ... why does the code open pipes for stdin and stdout, it doesn't make use of it23:32
russellbdoes read stderr i guess, so it can log it if it fails23:32
*** maurosr has joined #openstack-dev23:32
*** roadTripper has quit IRC23:33
*** sniperd has joined #openstack-dev23:33
dolphmayoung: ^23:33
*** stevebake has quit IRC23:33
*** sstent has quit IRC23:34
*** sstent has joined #openstack-dev23:34
vishyrussellb: it gets output and err with process.communicate23:34
russellbdoesn't do anything with output23:35
vishyrussellb: i just tested with cat and cat foobar and it works fine23:35
*** jcru is now known as jcru|away23:35
vishyrussellb: that is true23:35
russellbanyway, that's unrelated ...23:35
russellbnice, i reproduced it with your test code23:35
russellbfirst few times anyway ... now it's working every time23:36
russellbstill happens occasionally ...23:36
*** markwash has joined #openstack-dev23:38
*** sniperd has quit IRC23:38
*** cp16net is now known as cp16net|away23:39
russellbvishy: so check this out ... when that happens, there is a zombie openssl process left around23:43
russellbotherwiseguy: ^23:43
vishyrussellb: ah interesting23:43
russellbi verified it putting a sleep at the end of your test code23:43
vishyrussellb: if you update the loop to do like 10023:43
*** nati_ueno has quit IRC23:43
vishyit will start failing23:43
russellbyeah i did23:43
vishysleep does what?23:44
*** jergerber has quit IRC23:44
russellbwell nothing ... just so i can look at 'ps' output and see the zombie processes23:44
*** nati_ueno has joined #openstack-dev23:44
*** esheffield has quit IRC23:44
vishystrace shows a rt_sigaction(SIGPIPE, {SIG_IGN, [PIPE], SA_RESTORER|SA_RESTART, 0x7f46011984a0}, {SIG_IGN, [PIPE], SA_RESTORER|SA_RESTART, 0x7f46011984a0}, 8) = 023:44
*** nati_ueno has quit IRC23:44
*** nati_ueno has joined #openstack-dev23:45
*** samkottler is now known as samkottler|food23:46
lifelessarata: around? Would like to chat about the initrd builder a little23:48
aratalifeless: hello23:49
lifelessarata: hi!23:49
vishyrussellb: interesting if you set trace in the last loop and hit c each time23:49
vishyit works23:49
openstackgerritA change was merged to openstack/swift: charset for default responses  https://review.openstack.org/1568623:49
vishybut if you put a sleep in there it still fails23:49
lifelessarata: so, two things I'd like to chat about; shared github project - like, is it possible for me and the folk I'm working with to [eventually] get commit and review rights to the initrd builder tree where it is, or should we have a shared organisation that both ntt & hp and anyone else that collaborates on this can become members of ?23:50
lifelessarata: [one answer to this might be: "you can become a member of the nttdocomo-openstack github organisation']23:51
*** networkstatic has joined #openstack-dev23:51
lifelessarata: I assume long term it would become part of openstack with openstack-CI etc, but in the medium term having something we can scale out the development of - and do more granular review and evolving of, would be good.23:52
russellbvishy: been at my desk too long ... need to step away, at least for a bit.  :-)  good luck23:52
aratalifeless: we can register you as a collabolater23:52
vishyrussellb: much simplified repro23:52
arataso that you can push freely23:53
*** dolphm has quit IRC23:56
lifelessarata: ok cool. Whenever you feel we're ready for that, that would be great.23:56
*** sniperd has joined #openstack-dev23:56
lifelessarata: the second question is this - we have a bunch of code that is in the same basic space: making images - disk images of openstack, ready to run. I'd like to consolidate all of this stuff.23:57
otherwiseguyvishy, link to the new repro?23:57
lifelessarata: my proposal is that we:23:57
lifeless - put all the image building logic in the initrd-builder tree23:57
*** tmishler has quit IRC23:57
lifeless - this would be initrd, *and* operating-system image code23:58
lifeless - we include in this tree baseline stuff, but may in future want to have a tree that is just the executable code, and a separate tree that is just configurations.23:58
*** rpedde is now known as rpedde_away23:58
vishyotherwiseguy: http://paste.openstack.org/show/25134/23:59
lifelessarata: if that sounds good to you, I'll start moving stuff around and send you pull requests.23:59
otherwiseguyvishy: thanks23:59
lifelessarata: I'd like to have something that is packagable by distributions, or at least someting folk can install in /usr/local/bin/*23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!