Tuesday, 2012-04-10

*** rkukura has joined #openstack-dev00:04
*** sleepsonzzz is now known as sleepsonthefloor00:04
*** _adjohn has joined #openstack-dev00:12
*** adjohn has quit IRC00:15
*** _adjohn is now known as adjohn00:15
*** andrewsben is now known as andrewsben_zz00:16
*** Ryan_Lane has quit IRC00:16
*** Ryan_Lane1 has joined #openstack-dev00:17
*** sleepsonthefloor is now known as sleepsonzzz00:17
*** issackel_ has quit IRC00:19
*** Ryan_Lane1 is now known as Ryan_Lane00:19
*** Ryan_Lane has joined #openstack-dev00:19
*** sandywalsh has quit IRC00:32
*** asdfasdf has quit IRC00:35
*** nati has joined #openstack-dev00:35
*** kindaopsdevy has quit IRC00:36
*** spiffxp has quit IRC00:36
*** jakedahn is now known as jakedahn_zz00:37
*** crobinso has quit IRC00:39
*** mnewby has joined #openstack-dev00:42
*** sandywalsh has joined #openstack-dev00:46
*** EntropyWorks has joined #openstack-dev00:51
*** EntropyWorks has quit IRC00:54
*** reed has quit IRC00:55
*** jdurgin has quit IRC00:58
*** sandywalsh has quit IRC00:58
*** mdomsch has joined #openstack-dev01:04
*** adjohn has quit IRC01:04
*** maplebed has quit IRC01:04
*** sandywalsh has joined #openstack-dev01:14
*** vincentricci has quit IRC01:15
*** mattray has joined #openstack-dev01:19
*** heckj has quit IRC01:33
*** roge has joined #openstack-dev01:35
*** fsouza has quit IRC01:40
*** novas0x2a|laptop has quit IRC01:44
*** Mandell has quit IRC01:44
*** devananda has quit IRC01:51
*** dtroyer_zzz is now known as dtroyer02:01
*** Ryan_Lane has quit IRC02:11
*** davlaps has quit IRC02:12
*** thickskin has joined #openstack-dev02:14
*** fsouza has joined #openstack-dev02:19
*** winston-d has joined #openstack-dev02:19
winston-djaypipes, around?02:19
*** adjohn has joined #openstack-dev02:24
*** bsas has joined #openstack-dev02:27
*** ayoung has quit IRC02:27
bsasheya, I am trying to build a devstack box02:28
bsasSo I installed Ubuntu 11.10 and executed the http://devstack.org/ script02:28
bsasand everything was working but after I rebooted the machine Keystone is not working anymore.02:28
bsasAnyone had that issue?02:28
bsasI just did the basic install, no change...02:28
*** thickskin has left #openstack-dev02:28
*** mjfork has quit IRC02:31
*** thickskin has joined #openstack-dev02:32
*** devananda has joined #openstack-dev02:32
*** bsas has left #openstack-dev02:39
*** slyphon has joined #openstack-dev02:47
*** shang has joined #openstack-dev02:53
*** fsouza has quit IRC03:03
andrewbogottbsas:  Devstack installs aren't persistent; as soon as you reboot your machine all is lost.  If you rerun stack.sh the old state will be wiped and a new install created and started.03:08
andrewbogottI think there is a pathway for changing a devstack run into an actual system setup, but I haven't done it.03:08
andrewbogottbsas has long since left the room :(03:10
*** thickskin has left #openstack-dev03:12
*** AlanClark has quit IRC03:15
*** fsouza has joined #openstack-dev03:15
winston-dandrewbogott, what do you mean by 'all is lost'?  Devstack is persistent I think.03:15
*** lloydde has joined #openstack-dev03:16
*** paulstallworth has joined #openstack-dev03:17
*** roge has quit IRC03:19
*** winston-d has quit IRC03:22
*** lloydde has quit IRC03:23
*** lloydde has joined #openstack-dev03:24
*** littleidea has quit IRC03:24
*** lloydde has quit IRC03:24
*** Mandell has joined #openstack-dev03:27
paulstallworthwhy might i be getting an "Invalid OpenStack Identity credentials" on keystone endpoint-list but not service-list?03:27
paulstallwortherm meant that for general not -dev03:28
*** dwalleck has quit IRC03:30
*** winston-d has joined #openstack-dev03:37
*** fsouza has quit IRC03:37
*** kindaopsdevy has joined #openstack-dev03:49
*** kindaopsdevy_ has joined #openstack-dev03:50
*** kindaopsdevy has quit IRC03:53
*** kindaopsdevy_ is now known as kindaopsdevy03:53
*** sleepsonzzz is now known as sleepsonthefloor04:02
*** lloydde has joined #openstack-dev04:22
*** littleidea has joined #openstack-dev04:25
*** adjohn has quit IRC04:25
*** paulstallworth has quit IRC04:26
*** littleidea has quit IRC04:33
*** littleidea has joined #openstack-dev04:35
*** dtroyer is now known as dtroyer_zzz04:37
*** mdrnstm has quit IRC04:40
*** sniperd has quit IRC04:43
*** sniperd has joined #openstack-dev04:43
*** asalkeld has quit IRC04:45
*** akscram has quit IRC04:45
*** asalkeld has joined #openstack-dev04:45
*** hattwick has quit IRC05:02
*** RobertLaptop has joined #openstack-dev05:04
*** RobertLaptop has left #openstack-dev05:04
*** mnewby has quit IRC05:08
*** dhellmann has joined #openstack-dev05:14
*** dhellmann_ has quit IRC05:14
*** mattray has quit IRC05:14
*** zaitcev has quit IRC05:16
*** seats has quit IRC05:18
*** shiju has joined #openstack-dev05:19
*** kindaopsdevy has quit IRC05:21
*** btorch_ has joined #openstack-dev05:24
*** btorch_ has quit IRC05:31
*** bepernoot has joined #openstack-dev05:34
*** nati has quit IRC05:36
*** vincentricci has joined #openstack-dev05:39
*** dwalleck has joined #openstack-dev05:39
*** mnewby has joined #openstack-dev05:46
*** mnewby_ has joined #openstack-dev05:47
*** bepernoot has quit IRC05:48
*** mnewby has quit IRC05:51
*** mnewby_ is now known as mnewby05:51
*** koolhead11 has joined #openstack-dev05:54
*** littleidea has quit IRC05:57
*** lloydde has quit IRC06:00
*** lloydde has joined #openstack-dev06:01
*** lloydde has quit IRC06:01
*** dwalleck has quit IRC06:10
bodepdcan someone point me to a doc that explains how to validate a nova installation?06:15
*** dachary has quit IRC06:17
koolhead11bodepd, http://www.hastexo.com/resources/docs/installing-openstack-essex-4-ubuntu-1204-precise-pangolin  see if it helps06:20
*** Mandell_ has joined #openstack-dev06:24
bodepdkoolhead11: going through that now. thanks!06:27
*** Mandell has quit IRC06:27
koolhead11bodepd, np :)06:28
bodepdits actually really close, but it fails complaining that it cannot find an image when I run a nova boot06:34
bodepdit finds the first references images, but it fails trying to find the kernel for that image06:34
*** journeeman has joined #openstack-dev06:34
*** pmyers has quit IRC06:38
*** pmyers has joined #openstack-dev06:39
*** Ryan_Lane has joined #openstack-dev06:39
*** sleepsonthefloor is now known as sleepsonzzz06:43
mikalHow do I kick jenkins to see if a test failure was real?06:44
*** akscram has joined #openstack-dev06:46
ttxmikal: you get someone to reaccept it06:49
*** pmyers has quit IRC06:50
*** pmyers has joined #openstack-dev06:51
*** mnewby has quit IRC06:54
*** mnewby has joined #openstack-dev06:54
*** shang has quit IRC06:58
*** Mkenneth has joined #openstack-dev07:04
*** bepernoot has joined #openstack-dev07:06
*** devcamcar has quit IRC07:08
*** devcamcar has joined #openstack-dev07:08
*** shang has joined #openstack-dev07:11
*** shang has quit IRC07:16
mikalReaccept? You mean reapprove?07:17
mikalhttps://review.openstack.org/#change,6341 would apparently love a new approval then.07:17
*** dachary has joined #openstack-dev07:19
*** shang has joined #openstack-dev07:19
*** shiju has quit IRC07:30
*** pixelbeat has joined #openstack-dev07:45
*** corXi has joined #openstack-dev07:51
*** hattwick has joined #openstack-dev07:59
*** rbasak has joined #openstack-dev07:59
*** fc__ has joined #openstack-dev08:03
*** darraghb has joined #openstack-dev08:05
*** derekh has joined #openstack-dev08:12
*** hashar has joined #openstack-dev08:16
*** Mandell_ has quit IRC08:32
*** vishy has quit IRC08:32
*** hugokuo has joined #openstack-dev08:33
*** vishy has joined #openstack-dev08:34
*** berendt has joined #openstack-dev08:51
*** eglynn has joined #openstack-dev08:59
*** vincentricci has quit IRC09:01
*** paulormg has joined #openstack-dev09:08
*** winston-d has quit IRC09:13
*** vivek has joined #openstack-dev09:46
*** LinuxJedi has quit IRC09:58
*** LinuxJedi has joined #openstack-dev10:02
*** LinuxJedi has quit IRC10:08
*** LinuxJedi has joined #openstack-dev10:08
*** mjfork has joined #openstack-dev10:12
*** shang has quit IRC10:39
*** hashar has quit IRC10:45
*** bsza has joined #openstack-dev10:47
*** bepernoot has quit IRC10:48
*** bepernoot has joined #openstack-dev10:49
*** mnewby has quit IRC10:57
*** roge has joined #openstack-dev11:05
*** roge has quit IRC11:14
*** milner has joined #openstack-dev11:15
sandywalshttx how do I get the status on https://review.openstack.org/#change,5399 back from "abandoned"  ... I was waiting for Folsom to start.11:27
mikalCan a nova core please kick https://review.openstack.org/#change,6341 for me? I think jenkins is a liar.11:27
mikalAnd all I want for Christmas is for someone with a strong digestion to review https://review.openstack.org/#change,6354 please11:29
*** philr has joined #openstack-dev11:31
*** sandywalsh has quit IRC11:31
philrHi I have a keystone question I can't find reference to ssl configuration on Essex for port 5000 connections11:33
*** tryggvil_ has joined #openstack-dev11:43
*** rods has joined #openstack-dev11:43
*** sandywalsh has joined #openstack-dev11:45
*** tryggvil_ has quit IRC11:47
*** markvoelker has joined #openstack-dev11:48
*** alaski has joined #openstack-dev11:52
*** philr has quit IRC11:55
*** shiju has joined #openstack-dev12:04
*** pmyers has quit IRC12:08
*** pmyers has joined #openstack-dev12:08
*** pmyers has joined #openstack-dev12:11
shijuHi, any idea on how to put 'v1.1/<tenant_id>/os-floating-ip-dns/<domain>/entries?ip=<ip>' in .wadl ?12:12
*** hashar has joined #openstack-dev12:16
*** user has joined #openstack-dev12:26
*** user has quit IRC12:26
*** armaan has joined #openstack-dev12:42
*** mattray has joined #openstack-dev12:46
*** roge has joined #openstack-dev12:46
ttxcomstud: ping12:48
sandywalshttx how do I get the status on https://review.openstack.org/#change,5399 back from "abandoned"  ... I was waiting for Folsom to start.12:49
ttxsandywalsh: you should have some button to resurrect it12:50
ttxsandywalsh: what do you have where "review" usually stands ?12:50
sandywalshttx, review/restore change/diff12:50
ttxlet me try +0ing it12:51
sandywalshttx tried to push the branch again, tried a review, no joy12:51
ttxhmm, looks like my Lazarus spell needs some polish12:51
ttxsandywalsh: ask mtaylor/jeblair12:52
sandywalshI say that every morning12:52
sandywalshk ... thanks12:52
ttxthey told me it was pretty simple, but I don't remember.12:52
*** fsouza has joined #openstack-dev12:52
sandywalshmtaylor, jeblair:  how do I get the status on https://review.openstack.org/#change,5399 back from "abandoned"  ... I was waiting for Folsom to start.12:52
ttxsomething like "the submitter can resurrect it", but apparently not12:52
ttxsandywalsh: pushing the branch again with the changeid edited out should probably do it too12:53
sandywalshbut then I'll lose the review history no?12:53
ttxsandywalsh: unless gerrit is conscious.12:53
ttxsandywalsh: indeed.12:53
sandywalshhmm12:53
*** armaan has left #openstack-dev12:54
ttxsandywalsh: wait for the Ci pair, I think they have the power to revive the dead.12:54
sandywalshttx agreed12:54
sandywalshttx, see ya in a week!12:54
ttxcheers12:54
*** AlanClark has joined #openstack-dev12:57
*** stuntmachine has joined #openstack-dev12:57
*** littleidea has joined #openstack-dev13:00
*** fsouza has quit IRC13:04
comstudttx: pong13:05
ttxhave 5 min. to discuss the Nova scaling track ?13:05
ttxcomstud: ^13:05
comstudyeah13:06
ttxok, see pm13:06
comstudit's 6am, so i'm only somewhat conscious13:06
comstud:)13:06
*** dprince has joined #openstack-dev13:07
*** crobinso has joined #openstack-dev13:08
*** dneary has joined #openstack-dev13:09
*** dneary has quit IRC13:09
*** dneary has joined #openstack-dev13:09
*** vincentricci has joined #openstack-dev13:10
*** vincentricci has quit IRC13:10
*** tryggvil has joined #openstack-dev13:14
*** oneiroi has joined #openstack-dev13:20
*** ayoung has joined #openstack-dev13:25
*** dtroyer_zzz is now known as dtroyer13:28
*** roge has quit IRC13:32
*** roge has joined #openstack-dev13:34
*** rgoodwin_away has joined #openstack-dev13:36
*** dneary has quit IRC13:38
*** rgoodwin has quit IRC13:38
*** rgoodwin_away is now known as rgoodwin13:38
*** slyphon has quit IRC13:43
*** kbringard has joined #openstack-dev13:50
*** dneary has joined #openstack-dev13:52
*** dneary has quit IRC13:53
*** dneary has joined #openstack-dev13:53
*** ayoung has quit IRC13:55
*** slyphon has joined #openstack-dev13:57
*** paulstallworth has joined #openstack-dev14:00
*** dneary has quit IRC14:01
*** GheRivero has joined #openstack-dev14:03
*** blamar has joined #openstack-dev14:10
*** shiju has quit IRC14:10
*** ayoung has joined #openstack-dev14:12
*** slyphon has quit IRC14:16
*** Mandell has joined #openstack-dev14:17
*** dneary has joined #openstack-dev14:18
*** dtroyer is now known as dtroyer_zzz14:23
*** jog0 has joined #openstack-dev14:25
*** journeeman has quit IRC14:26
*** winston-d has joined #openstack-dev14:27
*** lloydde has joined #openstack-dev14:28
*** deshantm has joined #openstack-dev14:28
*** dneary has quit IRC14:30
*** blamar has quit IRC14:30
*** blamar has joined #openstack-dev14:33
*** dwalleck has joined #openstack-dev14:35
*** lloydde has quit IRC14:42
*** lloydde has joined #openstack-dev14:42
*** GheRivero has quit IRC14:44
*** dneary has joined #openstack-dev14:45
*** rnirmal has joined #openstack-dev14:50
jeblairsandywalsh: click "restore change"14:52
sandywalshjeblair, that doesn't unwind a commit?14:53
winston-djaypipes : ping14:53
jeblairnope, you're probably thinking of 'revert', and that's only available after it's merged14:53
jaypipeswinston-d: pong!14:53
*** lloydde has quit IRC14:53
sandywalshjeblair, cool, thanks. I was afraid to try that button.14:54
jeblairno problem!14:54
jaypipessandywalsh: don't be afraid of the Big Red Button, my friend.14:54
*** slyphon has joined #openstack-dev14:54
* jaypipes brings out Ren and Stimpy reference... yeah, that's right.14:54
winston-djaypipes : :) I have some questions about glance and tempest.14:55
* sandywalsh is afraid of jaypipes let loose again in San Fran14:55
jaypipeswinston-d: fire away14:55
jeblairmikal: you should also be able to retrigger a test in jenkins14:55
jaypipessandywalsh: lol :)14:55
*** Mandell has quit IRC14:55
*** deshantm_ has joined #openstack-dev14:57
*** lorin1 has joined #openstack-dev14:57
*** deshantm has quit IRC14:58
*** jog0 has quit IRC14:59
jaypipeswinston-d: did you have a question for me?14:59
*** deshantm_ is now known as deshantm14:59
winston-djaypipes : first, about glance.  I tried the latest glance (trunk), set worker > 1, then started glance-api with log output to stdout. when i stopped it with ctrl-c, glance-api would end-up in a endless loop, keep poping error like 'Bad file descriptor'.  this symptom is exactly the same as my multiprocess version keystone.15:00
winston-djaypipes : have you seen that before?15:01
jaypipeswinston-d: I have not :(15:01
winston-djaypipes : let me see if i can reproduce it on another server.15:01
jaypipeswinston-d: but then again, I usually start it with the glance-control executable15:01
jaypipeswinston-d: which manages the daemon process group15:02
*** kindaopsdevy has joined #openstack-dev15:02
jaypipeswinston-d: that said, if it's reproducible then we need to fix it!15:02
winston-djaypipes : well, glance-control works well.15:02
*** dwalleck_ has joined #openstack-dev15:04
*** dolphm has joined #openstack-dev15:05
*** dwalleck has quit IRC15:06
*** bsza has quit IRC15:07
*** hashar has quit IRC15:07
*** davlaps has joined #openstack-dev15:09
winston-djaypipes : yes, i reproduced the 'bug'15:09
winston-djaypipes : the output when i press ctrl-c is like: http://paste.openstack.org/show/12630/15:11
winston-djaypipes : same issue is happening to the multiprocess Nova API and Keystone too.15:13
jaypipeswinston-d: got it. please do file a bug. we'll get right on that.15:13
jaypipeswinston-d: Ahmad brought up a similar issue when chatting with him offline about it. Hopefully he will add some commentary to your review15:13
jaypipeswinston-d: my guess is that this has been a hidden issue since Swift (and Glance, which has very similar code) uses the swift-init (glance-control) daemon wrapper15:14
*** dolphm has quit IRC15:15
winston-djaypipes : yeah, i guess so.  i don't have a swift to test right now.  but i did look over Swift source code, didn't find any special treatment to avoid such issue.15:15
jaypipeswinston-d: I wish more HPers hung out on IRC... going to try and grab Ahmad to come and chat about this... bear with me.15:16
jeblairanotherjesse_zz: https://jenkins.openstack.org/job/gate-integration-tests-devstack-vm/3365/console15:16
winston-djaypipes : sure. i'd fire a bug first.15:17
jeblairanotherjesse_zz: that failure is interesting; i logged into the host, and it appears that the screen window for g-api was never created, even though the console log has "screen -S stack -X screen -t g-api"15:17
jeblairanotherjesse_zz: have you ever seen an error like that?15:17
jeblairanotherjesse_zz: (you can also see that the g-api screen log file also wasn't created, which i think helps confirm that command didn't work)15:18
*** zaitcev has joined #openstack-dev15:18
*** negronjl has quit IRC15:19
jaypipeswinston-d: cool. sent an email to ahmad and phil day to hop on IRC.15:19
*** nati has joined #openstack-dev15:20
*** dolphm has joined #openstack-dev15:23
*** reed has joined #openstack-dev15:24
*** kindaopsdevy has left #openstack-dev15:24
*** dwalleck_ has quit IRC15:25
*** lloydde has joined #openstack-dev15:25
mtaylorjeblair: jeez - we have to account for _screen_ failures now?15:25
*** dwalleck has joined #openstack-dev15:26
*** bepernoot has quit IRC15:27
*** Ahmad_HP has joined #openstack-dev15:29
sdaguejeblair: you didn't happen to fill up the disk or anything did you?15:29
Ahmad_HPHi Jay,15:29
Ahmad_HPsorry just check your email15:29
jeblair/dev/vda              9.9G  2.0G  7.4G  22% /15:30
winston-d:)15:30
jeblairsdague: nope, good idea though.  i'd expect to see some kind of error message in the console log though.  afaict, there was none, and the screen command exited with success.15:30
*** dolphm has quit IRC15:31
sdagueyeh, that screen fail seems really odd, though I guess if the glance command didn't work at all, it may not have created the log file. I kind of think the screen fail is a red herring15:32
jaypipesAhmad_HP: hi!15:32
jaypipeswinston-d: Ahmad_HP is here :)15:32
winston-dhi Ahmad_HP15:32
jaypipesAhmad_HP: thx for popping on IRC. so the reason we are comparing with Glance is because the code Huang proposed for merging is very similar to Glance+Swift15:33
*** spiffxp has joined #openstack-dev15:34
jeblairsdague: stack.sh creates a screen window, turns on logging, then runs the glance command.  i'm pretty sure creating the window failed because (1) it wasn't there when i logged into the host and resumed the screen, and (2) the log file was never created.  i think if the window wasn't created properly, that explains why there was no log file, and g-api didn't start.  it could be that it was created and then closed, but i see no reason why15:35
Ahmad_HPNo problem Jay. I am glad that @winton-d has noticed this thing early15:35
Ahmad_HPI think we slightly differ from glance...15:35
Ahmad_HPbecause we have a  Grand parent - Parent - CHILD WORKERS model15:36
Ahmad_HPwhere as glance would have Parent - Child works model15:36
*** ecarlin has joined #openstack-dev15:36
*** ecarlin has quit IRC15:36
jaypipesAhmad_HP: yes, that sounds correct15:37
jaypipeswinston-d: when Ahmad says "we", he is referring to HPCS' internal Nova branch that has multiprocessing nova-api...15:37
*** negronjl has joined #openstack-dev15:37
Ahmad_HP@winston-d, can you please point me to your feature branch on gerrit please?15:37
jaypipesAhmad_HP: are you familiar with the glance-control daemon control script?15:37
*** ayoung has quit IRC15:38
Ahmad_HPNo Jay, I have very limited knowledge of glance code base, But I have backported quite a few things from glance i.e. multiprocessing concept and sqlalchemy db api sessions handling15:38
jaypipesAhmad_HP: https://review.openstack.org/#change,576215:39
Ahmad_HPThanks Jay15:39
winston-djaypipes, Ahmad_HP yes, the reason why I added one grand parent (aka master_worker in the code) is to be able to pass the unittest, because if parent-child worker mode like glance, the stop() method of WSGI service would not only kill the service but also the unittest itself by 'os.killpg(0...)'15:39
jaypipesAhmad_HP: no prob. the glance-control daemon wrapper is essentially what does the Grandparent -> Parent -> Children model in Glance.15:39
jaypipesAhmad_HP: but if you start glance-api directly (without using glance-control wrapper), you get the hanging file descriptors...15:40
*** issackelly has joined #openstack-dev15:40
jaypipesAhmad_HP: when you SIGTERM the glance-api process.15:40
Ahmad_HPso yes. in @winston-d branch, The grand parent is the main process which spawns the service............It then invokes start method in WSGI class......which creates the master process. The master process then create workers15:40
Ahmad_HPso it has 3 layers15:40
jaypipesright.15:40
winston-dcorrect15:41
jaypipesAhmad_HP: for reference... here is Glance server forking code: https://github.com/openstack/glance/blob/master/glance/common/wsgi.py15:42
*** dolphm has joined #openstack-dev15:42
Ahmad_HPWhen I backported the change from Glance in to HP nova, then we had this serious problem of Zombi processes left over, especially when CHEF deploys the services15:42
*** markmc has joined #openstack-dev15:42
jaypipesAhmad_HP: gotcha. and your solution had to do with manually catching SIGTERM/SIGINT inside the parent... is that correct?15:42
Ahmad_HPThere might be a clean and quick way to address this problem, but I implemented that resilient layer in the following way:15:42
winston-dAhmad_HP : i've seen similar issue too.15:43
Ahmad_HPWhen any parent proecess gets killed, then it should clear out all the child process groups and it's own process group15:43
Ahmad_HPIf child detects that its parent has been died, then it kills itself15:43
Ahmad_HPyeah right, Jay15:44
openstackgerritVerification of a change to openstack/nova failed: migration_get_all_unconfirmed() now uses lowercase "finished" Fixes bug 977719  https://review.openstack.org/640215:44
uvirtbotLaunchpad bug 977719 in nova "migration_get_all_unconfirmed() should use lower case "finished"" [Undecided,In progress] https://launchpad.net/bugs/97771915:44
Ahmad_HP@winston-d. Please verify your code both with kill -9 and kill -1515:44
jaypipesAhmad_HP: See this line here: https://github.com/openstack/glance/blob/master/glance/common/wsgi.py#L15315:45
Ahmad_HPIn openstack, we want to recover the whole api if the SIGKILL or SIGTERM was raised on any process with in whole process group15:45
jaypipesAhmad_HP: are you suggesting that the call in that block to killpg(0, ...) is at fault?15:45
jaypipesAhmad_HP: that instead the server should signal to kill each child separastely?15:45
Ahmad_HPkillpg(0, ...)  is fine. 0 means killing the whole process group..................which kills the children as well15:46
annegentledolphm: around?15:46
dolphmannegentle: yes15:46
jaypipesAhmad_HP: ah! I see now... in the child process itself, the child needs to check the parent is killed...15:46
Ahmad_HPActually, when CHEF kills the process, according to my understanding it only send the SIGTERM to main process...15:47
annegentledolphm: do you have a minute to look at bug 973477 with me?15:47
uvirtbotLaunchpad bug 973477 in openstack-manuals "Difficulties with keystone docs with mysql" [Medium,Confirmed] https://launchpad.net/bugs/97347715:47
jaypipesAhmad_HP: well that *seems* to be handled correctly in the current code, no? SIGTERM is caught in the parent and in each child AFAICT...15:47
annegentledolphm: I've got a VM running where I'm still getting an error, Access denied for user 'keystone'@'localhost' (using password: YES)15:48
dolphmannegentle: sure, reading15:48
Ahmad_HPThe use of sys.exit(1) is very bad.... I was using this in my code intially and this lead us to ZOMBIE process scnarios 'rarely'15:48
jaypipesAhmad_HP: or perhaps you are saying that this block: https://github.com/openstack/glance/blob/master/glance/common/wsgi.py#L215 also needs a SIGTERM (non-default) handler?15:48
annegentledolphm: it has to be something wrong with either the GRANT or that mysql isn't configured for localhost?15:48
Ahmad_HPwe got rid of sys.exit from our HP nova implementation15:48
mtaylorAhmad_HP: what do you use instead of sys.exit?15:49
dolphmannegentle: what's the result of the two commands i suggested?15:49
jaypipesAhmad_HP: ok. so here: https://github.com/openstack/glance/blob/master/glance/common/wsgi.py#L197 we should just let the KeyboardInterrupt block exit normallY?15:49
dolphmannegentle: that should verify if grant is working correctly15:49
jaypipesAhmad_HP: or should we return 1 or something?15:49
dolphmannegentle: and that the user issuing the grant has *permission* to issue the grant15:49
Ahmad_HP@mtaylor: We didn't use sys.exit for killing the process becaue it has child process tree underneath15:50
Ahmad_HPinstead, we raise SIGTERM on all the process group and let the process gets stopped cleanly15:50
jaypipesAhmad_HP: understood. OK, I'll make some quick changes to my local branch and test if removing the sys.exit -- and re-raising the KeyboardInterrupt -- solves the issue.15:51
annegentledolphm: ok, in the Host column for the User with keystone, it shows %15:51
annegentledolphm: so there must be something wrong with the GRANT command?15:51
dolphmannegentle: i think that's fine -- it means 'any host'15:51
annegentledolphm: GRANT ALL ON keystone.* TO 'keystone'@'%' IDENTIFIED BY 'yourpassword';15:52
annegentledolphm: ok15:52
dolphmannegentle: what's the error from db_sync? is that the access denied for user 'keystone'@'localhost'?15:52
Ahmad_HP@jaypiples Does SIGTERM raises that keyboardinterrupt exception? I doubt it would?15:52
winston-di need a reboot to my devstack environment to verify that with my nova patch too.15:52
annegentledolphm: yep15:52
winston-dbrb15:52
annegentledolphm: my my.cnf file for mysql uses bind_address 0.0.0.015:53
dolphmannegentle: try to start a mysql session with the expected credentials: mysql -u keystone -p yourpassword15:53
sdagueis there an easy way to run just one unit test in the nova/tests/ dir?15:53
annegentledolphm: same error15:53
*** winston-d has quit IRC15:53
annegentledolphm: I can start mysql with root15:53
annegentledolphm: but not with the keystone user15:53
jaypipesAhmad_HP: hmm, no, I think that is SIGHUP...15:53
jaypipesAhmad_HP: but who knows.. :) I'll research and play around with it.15:53
dolphmannegentle: as root, can you list all users with: select * from mysql.user;15:53
annegentledolphm: and in the keystone user row, there's a bunch of N15:54
dolphmannegentle: and 'keystone' does appear?15:54
jaypipesAhmad_HP: thx very much for hopping on to discuss! Very much appreciated!15:54
dolphmN?15:54
annegentledolphm: here you go: http://paste.openstack.org/show/12631/15:54
Ahmad_HPOk @jaypipes. Having said that, I would suggest that we test this rigorously. In our HP source, I tested with both kill -9 and kill -15 and everything was working fine...15:54
*** winston-d has joined #openstack-dev15:54
annegentledolphm: it's as if that GRANT command doesn't actually grant15:54
annegentledolphm: and I'm not sure how to fix it15:55
Ahmad_HPbut when we deployed through chef then occassionaly we weree seeing the zombies15:55
Ahmad_HPso then I debugged further and removed sys.exits.15:55
Ahmad_HPuntil now, it works awesome15:55
dolphmannegentle: what version of mysql?15:55
dolphmannegentle: to make sure i'm looking at the correct docs15:55
Ahmad_HP'Zombie' was pretty famous in our QA team last month :)15:56
*** ayoung has joined #openstack-dev15:56
jaypipesAhmad_HP: rock on. :) I will do my best to bring your knowledge into Glance and winston-d15:56
jaypipes's patches.15:56
jaypipesAhmad_HP: ty!15:56
*** armaan has joined #openstack-dev15:56
annegentledolphm: Ver 14.14 Distrib 5.5.2215:57
Ahmad_HP@jaypipes. thanks15:57
jaypipesAhmad_HP: of course, if you could wave your magic wand and get me 8 more hours in a day, that would be awesome too! ;)15:57
jaypipesAhmad_HP: or ask QA to do that ;)15:57
Ahmad_HPhaha15:57
dolphmannegentle: ALL is definitely valid then, according to http://dev.mysql.com/doc/refman/5.5/en/grant.html15:58
Ahmad_HP'Zombies' were really annoying in our case, because they used to appear randomly and very rarely15:58
winston-d:)15:58
annegentledolphm: I also know this command to work when using Ubuntu 11.10 base.15:59
annegentledolphm: hm.15:59
Ahmad_HPand we changed init.d script to respawn the service, so if zombies appear then service respawns every 3 minute in our case and eventually all the cloud goes does :)15:59
annegentledolphm: well I need to head to a meeting but wanted to see if I can troubleshoot this further.16:00
annegentledolphm: it's quite a mystery to me right now16:00
*** ghe has joined #openstack-dev16:01
*** ghe is now known as Guest2527416:01
jaypipesAhmad_HP: but since you refactored the daemonization stuff, the zombies have disappeared, correct?16:02
*** dolphm has quit IRC16:02
Ahmad_HPwe don't see any zombies since last 3 weeks.....things looking good16:02
jaypipesawesome.16:03
*** ayoung has quit IRC16:03
Ahmad_HPand we have around 2000 nodes16:03
*** rkukura has quit IRC16:04
Ahmad_HPinfact 3k I guess16:04
winston-d2000 nodes for testing? impressive!16:04
jaypipesAhmad_HP: that's all? ;)16:04
openstackgerritVerification of a change to openstack/nova failed: Standardize quota flag format  https://review.openstack.org/640616:04
*** andrewsben_zz is now known as andrewsben16:04
jaypipeswinston-d: production, not testing :)16:04
jaypipeswinston-d: HP Cloud :)16:04
*** LinuxJedi has quit IRC16:04
winston-djaypipes, that's not trycloud.org, right?16:04
jaypipeswinston-d: now... if ONLY we could have a nice little 2K node cluster for TryStack! :)16:05
jaypipeswinston-d: no, definitely not!16:05
*** LinuxJedi has joined #openstack-dev16:05
Ahmad_HPnot for testing only. For various things i.e. staging and testing. But yeah testing nodes are a lot16:05
jaypipeswinston-d: we have 60 nodes provisioned for TryStack, though. Which is still excellent.16:05
jaypipeswinston-d: 60 nodes across 2 zones -- HP and Dell.16:05
*** ncode has joined #openstack-dev16:06
*** ayoung has joined #openstack-dev16:06
winston-di see.  we only have like ~40 nodes.16:06
Ahmad_HPwe needed more nodes to test db load in real time scenarios16:06
winston-dAhmad_HP, what's ratio of API nodes vs. compute nodes if it's ok to share?16:08
winston-dAhmad_HP, you must also have a separate cloud to generate pressure for those 3K node production cloud.16:09
Ahmad_HPI don't think I can share this publicly. But it is very configurable.16:09
winston-dwow16:09
Ahmad_HPWe have real clones of production systems, so we do one part of testing there... Rest of testing infrastructure is separate16:11
winston-dno problem.  i just wonder how good can API services be if multprocess is enabled.16:11
Ahmad_HPTesting has got prettty matured here16:11
winston-dnice~16:12
*** eglynn has quit IRC16:12
Ahmad_HPMultiprocessing works awesome. Ahhhh I remember now...16:12
jaypipesAhmad_HP: testing is matured, yes, but unfortunately a lot of it is a black hole that hasn't been contributed upstream... getting better about that over time, though :)16:13
Ahmad_HP@Jay: As you introduce multiprocessing, we got issue with security groups. Because API routes requests very fast and then compute managers fails to handle that many....16:13
Ahmad_HPso we had to fix that as well16:13
*** Mandell has joined #openstack-dev16:13
Ahmad_HPbut you might not see that in essex16:13
Ahmad_HP'might'16:13
jaypipesAhmad_HP: is this a race condition you are describing? Where security groups are tried to be created before, say, other work in instance launch has completed?16:14
Ahmad_HP@jaypipes. Yeah agree. It bacame really hard to push some things because essex moved away from diablo massively16:15
jaypipeswinston-d: note that I added a comment on your code review about needing to update the random seed generation for generate_uid() in nova/utils.py. Ahmad_HP ran into that one too :)16:15
Ahmad_HPI am not sure about this security bug thing. It was a bug before, but it was not obvious.......When API got faster, it bacame obvious16:15
Ahmad_HPI will double check with the guy who worked on that16:15
winston-djaypipes, yeah, i noticed that.  will work on that very soon, maybe during design summit. :)16:16
jaypipesAhmad_HP: cool. thx :)16:16
winston-dAhmad_HP, do you guys use tempest to test your production cloud?16:17
Ahmad_HPI am not familiar with testing team. They might use it.16:17
winston-dAhmad_HP, :) thx16:18
*** oneiroi is now known as Oneiroi^gone16:21
winston-djaypipes, about the glance bug I just fired, is removing 'sys.exit' going to fix it?16:23
*** dtroyer_zzz is now known as dtroyer16:24
jaypipeswinston-d: not sure. I'm going to test that this afternoon (or if you have time, you can do so...) I am working on a design summit proposal at this time... probably going to be another hour until I get to the testing16:24
jaypipeswinston-d: yes, HP QA team is actively involved in the Temepst project. They've contributed about 50-60% of the Compute API tests to date.16:25
*** Ryan_Lane has quit IRC16:25
winston-djaypipes, i can do a quick test before i fell asleep. :)16:25
jaypipeswinston-d: ok, that would be great. thx!16:25
*** ayoung has quit IRC16:26
*** dneary has quit IRC16:29
*** corXi has quit IRC16:30
markmcmtaylor, jeblair, hey16:32
markmcmtaylor, jeblair, can we get some help getting https://review.openstack.org/#change,5956 merged ? (nova security fix for diablo)16:32
markmcmtaylor, jeblair, some *more* help, rather :)16:33
winston-djaypipes, replacing sys.exit in wait_on_children with os.killpg(0, signal.SIGTERM) is working.16:33
jaypipeswinston-d: good news :)16:34
*** cdub has quit IRC16:34
markmcmtaylor, jeblair, looks like glance is still broken too :( https://review.openstack.org/#change,615216:34
*** cdub has joined #openstack-dev16:35
Ahmad_HP@winston-d Awesome16:35
Ahmad_HPwinston-d: can you do one more check please............16:36
Ahmad_HPps axf | grep nova-api16:36
Ahmad_HPgrab the process id of  process starting with 'su'16:36
Ahmad_HPthen kill -9   and kill -15 on that16:37
winston-dAhmad_HP, ah, i was looking at glance-api.  but i guess you also want to apply same check to glance too?16:37
Ahmad_HPyes definitely16:38
jaypipeswinston-d: glance-registry, not glance :) glance is the CLI tool :)16:38
*** vincentricci has joined #openstack-dev16:39
winston-dAhmad_HP, hmm, i see zombie processes.16:40
*** armaan has left #openstack-dev16:41
Ahmad_HPso this means, you need to put code in the child to check the state of the parent16:41
Ahmad_HPThat's how we did in HP source16:41
winston-dthe SIGTERM handler in parent process should have done killpg(0, SIGTERM). why doesn't it work?16:41
*** maplebed has joined #openstack-dev16:46
smoservishy, ping16:50
smoserbug 97776516:51
uvirtbotLaunchpad bug 977765 in nova "Image registration (ec2) is broken using deprecated auth" [High,New] https://launchpad.net/bugs/97776516:51
smoserwe are fully aware of the string "deprecated" there, but my feeling is that "deprecated" and "will break 2 weeks before release" are different things.16:51
*** heckj has joined #openstack-dev16:52
smoserso i'm asking if you or someone else could take a look at what adam_g came up with as to whether its reasonable, or suggest something more-so16:52
vishysmoser: sup?16:52
*** nati has quit IRC16:52
*** ayoung has joined #openstack-dev16:53
vishysmoser: is glance deployed without auth?16:53
smoserhm.. probably.16:54
smoseradam_g, knows more, and reproduced on devstack.16:54
vishysmoser: fyi, deprecated auth is not supported in essex16:54
vishywe only left it in to allow people to migrate16:54
smoserbut, eyah, we're using deprecated auth, and i do not believe glance is exposed api wise at all.16:54
smoservishy, right, but you didn't leave it16:54
smoser:)16:54
smoserits not there right now to migrate.16:55
vishysmoser: the plan is upgrade to essex, migrate16:55
vishyactually it is16:55
vishyit was supposed to be gone in essex16:55
vishybut we had to leave the code in to allow for migrations16:55
*** derekh has quit IRC16:55
smoserhm.. well, if it werent' functional up until 2 weeks ago, we would proably be off of it.16:55
smoserand i doubt in 3 months time the oepnstack installation that is using it will continue.16:56
*** Ryan_Lane has joined #openstack-dev16:56
smoserbut something regressed when they upgraded last friday to release from another snapshot (of un-determined version at the moment, but reasonably recent)16:56
smoseri suspect that that regression was non intended.16:57
smoseranyway, vishy if you could take a quick gander there, we'd appreciate it.16:58
smoserright now, my testing grounds of many many things is broken.16:58
*** AlanClark is now known as AlanClark_away16:58
vishysmoser: yeah i know the commit that broke it16:58
*** Guest25274 has quit IRC17:02
*** darraghb has quit IRC17:02
*** jdurgin has joined #openstack-dev17:04
*** slyphon is now known as slyphon_away17:05
*** stuntmachine has quit IRC17:06
vishysmoser: a6ac8af69351cb39aa07f53e3327ff29b90383bc17:06
bodepdI am having trouble booting a vm with an image that refers to another image (like a disk image with a separate kernel)17:07
vishysmoser: with glance using no auth it doesn't have an owner field17:07
bodepdis this still supported?17:07
*** shiju has joined #openstack-dev17:07
vishyso it needs to switch back to properties project id17:07
winston-dAhmad_HP, how do you check parent process's status?  by checking ppid is 1 or prctl()?17:08
*** heckj has quit IRC17:09
*** ayoung has quit IRC17:09
Ahmad_HPi check through:17:09
Ahmad_HPtry:17:09
Ahmad_HPos.kill(pid, 0)17:10
Ahmad_HPexcept OSError17:10
Ahmad_HPif it throws OSError, then it means process is dead17:10
Ahmad_HPotherwise process is alive17:10
*** Mkenneth has quit IRC17:11
winston-dgreat, thanks for the tip, i tried checking ppid==1, but seemed not work as expected.17:12
*** cdub has quit IRC17:12
winston-dAhmad_HP, os.kill(pid, 0)  'pid' here is pid for parent?17:13
Ahmad_HPany process id that you want to check.............17:14
Ahmad_HPin that case, yes it will be parent17:14
winston-dbut when do you do the checking?  I assume child should do checking when received SIGTERM?17:15
vishysmoser: is this really high priority for you guys? Seems like a terrible idea to stay on deprecated auth with nova-objectstore17:15
vishysmoser: anyway I posted how to fix in the bug17:15
smoservishy, its high priority in that its broken. i can't publish new  images.17:16
smoserno one thinks they're going to be on deprecated auth in 3 months.17:17
smoserbut they're there now.17:17
vishysmoser: but why did they upgrade then?17:17
vishy!17:17
smoserand it was unexpected and significat breakage.17:17
*** rohit404 has joined #openstack-dev17:17
smoserif it failed on the upgrade, then we wouldn't be here.17:17
smoserie, they upgraded to essex long ago.17:17
vishysmoser: upgrade should be install essex/migrate to keystone17:17
vishysmoser: essex w/o keystone == not ok17:18
vishysmoser: but anyway as i said in the bug report it is a pretty easy fix17:18
smoserk. thanks.17:18
vishysmoser: I suspect image owner is broken as well17:18
vishyso make sure to take care of both places17:18
smoseryeah, adam_g pointed that out.17:18
smoser(there was a patch on that bug)17:18
*** adjohn has joined #openstack-dev17:19
*** cdub has joined #openstack-dev17:19
smoseroh wait. did you mena something other than user_id and nnproject_id ?17:19
*** mdrnstm has joined #openstack-dev17:20
*** bepernoot has joined #openstack-dev17:22
*** alaski has quit IRC17:22
*** nati has joined #openstack-dev17:23
*** markvoelker has quit IRC17:23
*** alaski has joined #openstack-dev17:24
smoservishy, so you think the patch there is reasonable for us to at least carry?17:25
jaypipesdprince: hi dan! hoping you might be able to look into the Torpedo failure on this review: https://review.openstack.org/640717:25
smoserhttp://paste.ubuntu.com/922918/17:25
jaypipesdprince: basically, all the patch does is remove an invalid section in the glance-api-paste.ini file for cachemanage (without keystone).17:25
vishysmoser: a) user_id isn't necessary b) i'm not totally sure that is the best place for it, but i guess i don't mind. c) you also need to fix the display of ImageOwnerId17:25
jaypipesdprince: I'm wondering if the SmokeStack creates the API server with flavor = cachemanage?17:26
smoservishy, ok. thanks.17:26
jaypipesdprince: if so, that will need to be changed to flavor = keystone+cachemanage (as cachemanage middleware requries keystone...)17:26
vishysmoser: i also wouldn't mind that going into stable/essex mentioning that it isn't needed in master because deprecated auth will be gone17:27
*** andrewsben is now known as andrewsben_zz17:31
rohit404vishy: http://paste.openstack.org/show/12637/ (bad idea ?)17:35
*** dolphm has joined #openstack-dev17:35
vishyjeblair mtaylor : do we have a plan for publishing clients to pypi?17:35
*** Ahmad_HP has quit IRC17:36
vishyrohit404: It might work in vlan mode17:36
rohit404rohit404: using quantum manager17:36
rohit404vishy: ^17:36
jeblairvishy: i believe the current process is poke mtlayor; to be revised at summit.17:36
vishyrohit404:  hmm, that i don't know17:36
vishyrohit404: you can definitely run to dnsmasqs in different vlans although there are issues17:37
dprincejaypipes: yes.17:39
*** armaan has joined #openstack-dev17:39
*** andrewsben_zz is now known as andrewsben17:40
dtroyermtaylor jeblair:  Are you the guys who can make a stable/essex branch for DevStack for me?17:40
dprincejaypipes: I'll take a look and if that is the way we are going we can adjust the configs accordingly.17:40
*** Oneiroi^gone is now known as oneiroi17:40
jaypipesdprince: ty Dan~!17:41
jk0any keystone cowboys available to check this out for me? https://review.openstack.org/#change,638717:42
jk0also a devstack core? https://review.openstack.org/#change,638817:42
jk0fixes all keystone unit test/devstack issues17:43
vishytr3buchet: I don't think we ever finished the discussion on this one https://review.openstack.org/#change,636617:43
*** koolhead11 has quit IRC17:44
*** dolphm has quit IRC17:45
*** andrewsben is now known as andrewsben_zz17:46
rohit404vishy: yeah, i have run two dnsmasq's on different vlans succesfully but they were for different subnets...i'm not clear if dnsmasq worked fine for one vm network why not for the second vm network...17:47
*** alaski has quit IRC17:47
vishyrohit404: so dnsmasq doesn't support bind to device17:47
openstackgerritVerification of a change to openstack/nova failed: Improved localization testing.  https://review.openstack.org/449917:47
vishyrohit404: but i would think the broadcast request would still work as long as the two devices are layer2 isolated17:48
*** heckj has joined #openstack-dev17:48
rohit404vishy: its binding to the bridge interfaces for the two networks, which have interfaces on different vlans17:48
rohit404vishy: yes, the broadcast is going thru...DHCPDISCOVERY messsage..but the DHCPOFFER doesnt get to the second vm17:49
rohit404which is a unicast i think17:49
vishyoutgoing unicast should work17:50
vishyso i suspect a different issue17:50
*** GheRivero has joined #openstack-dev17:51
rohit404the dhcp gateway conf file also gets updated with the mac, ip address17:51
rohit404i also tried to launch the vm's without the instance iptable rules (incase they were dropping) but that didnt help17:53
*** lloydde has quit IRC17:53
*** Ryan_Lane has quit IRC17:54
*** Ryan_Lane has joined #openstack-dev17:54
*** slyphon_away is now known as slyphon17:55
winston-djaypipes, just want to confirm if my understanding is correct: child process needs to check parent process status once in a while (say, every 10 secs) to handle the case when parent is killed.17:56
jaypipeswinston-d: exactly.17:56
jaypipeswinston-d: one sec, lemme pull some code for you from the HPCS branch...17:57
jk0c17:57
jk0er, excuse me. trouble seeing with this corneal abrasion :)17:57
winston-djaypipes, ok.  so timer is needed.17:57
*** mnewby has joined #openstack-dev17:58
tr3buchetvishy: true17:58
*** andrewsben_zz is now known as andrewsben18:03
*** Ahmad_HP has joined #openstack-dev18:05
*** lloydde has joined #openstack-dev18:06
winston-djaypipes, Ahmad_HP see if this works for you.  http://paste.openstack.org/show/12639/18:07
vishytr3buchet: so the question was should both calls go through compute?18:07
jaypipeswinston-d: I think that solution may be more than what is needed... gimme a few more seconds to paste an alternative.18:08
dprinceWhere do we stand on the Nova Diablo gating? I'd like this branch to land: https://review.openstack.org/#change,595618:09
*** vricci has joined #openstack-dev18:09
dprinceAs I understand it the issue is blocked because of a bad python-novaclient build that is in PyPi....18:10
dprincejeblair: ^^18:11
dprinceGive its been a week I'd like to consider the option that we 'ungate' diablo...18:11
*** vincentricci has quit IRC18:12
*** oneiroi is now known as Oneiroi^gone18:12
sdaguewinston-d: the children aren't getting SIGCHILD?18:13
*** vincentricci has joined #openstack-dev18:13
*** bepernoot has quit IRC18:14
*** vricci has quit IRC18:14
winston-dsdague, you mean the parent aren't getting SIGCHILD?18:15
sdagueoh, you're right, I was thinking about this in reverse. Never mind18:15
*** novas0x2a|laptop has joined #openstack-dev18:16
sdaguetime for afternoon coffee18:16
rmkAre there specifics anywhere around the requirements to get boot from volume working?18:16
openstackgerritVerification of a change to openstack/keystone failed: Fix "it's" grammar errors.  https://review.openstack.org/641818:17
*** bepernoot has joined #openstack-dev18:18
tr3buchetvishy: i'm not sure why it would need to..18:21
tr3buchetvishy: this works for now until we finish the decorator18:21
*** shiju has quit IRC18:21
tr3buchetvishy: once the decorator is upstream, we can just decorate network_api.associate_floating_ip(...) and it will automatically update the cache18:22
tr3buchetwithout having to call get_instance_nw_info elsewhere18:22
*** bepernoot has quit IRC18:23
novas0x2a|laptopdoes anyone have an opinion on presence or absence of the "Conflicts" block when backporting a patch? (i.e. leave it in? take it out? i usually leave it in, jerdfelt prefers not, and i think I've seen both from others)18:25
jeblairdprince: alternately, we could fix the underlying problem.  stable/diablo nova depends on an unversioned python-novaclient.  it could be updated to depend on a particular version.  and if that particular version is broken, it could be updated to be fixed.18:27
dprincejeblair: I'd love to do that. Is there anything I can do to help?18:27
winston-djaypipes, i need to get some sleep.  will check your solution when i wake up... bye18:28
dprincejeblair: The git tag for python-novaclient 2.6.0 doesn't even seem to exist?18:28
jeblairdprince: sure, make a patch to pip-requires in nova setting the version of python-novaclient it requires.18:28
*** danishman has joined #openstack-dev18:28
jaypipeswinston-d: no probs18:28
jeblairdprince: i'm not sure the version of python-novaclient on pypi ever existed in git.18:29
dprincejeblair: There are only 2 version of python-novaclient in Pypi.18:29
*** asdfasdf has joined #openstack-dev18:29
dprincehttp://pypi.python.org/pypi/python-novaclient18:29
dprinceThat is where it is pulling it from.18:29
dprincejeblair: bzr maybe then?18:30
jeblairactually, it's getting a version called 2012.1 that glance specifies from launchpad...18:30
*** dachary has quit IRC18:30
jeblairit really is kind of a mess.18:30
dprincejeblair: Yes. I know.18:31
* mtaylor injets into conversation18:31
dprincejeblair: Diablo is looking specifically for python-novaclient==2.6.018:31
dprinceAnd there is a file in that tarball from PyPi that is patched incorrectly.18:31
dprinceFix that patch... post a 2.6.1 and we may be Okay here.18:31
*** nati has quit IRC18:32
mtaylordprince: alternately, can we just have diablo use current python-novaclient?18:32
dprincemtaylor: That won't work.18:32
dprincemtaylor: API's have changed.18:32
mtaylordprince: epic fail18:32
mtaylorok18:32
dprincemtaylor: Diablo is old school. Uses image ID's, flavor ID's. All the old time goodies.18:32
jeblairdprince: yes, sorry, you're right about requiring 2.6.0 specifically.  then yes, i agree the right solution is to fix 2.6.0 or release 2.6.0.1 on pypi.18:33
mtaylorI think 2.6.0.118:33
mtaylordprince: can you make the 2.6.0.1 patch?18:34
dprinceOkay. The offending file is novaclient/v1_1/servers.py in that tarball.18:34
dprincemtaylor: Sure.18:34
dprincemtaylor: I suppose I wanted to go at it from the sources... and have this refer to a proper Git tag.18:34
mtaylordprince: awesome. if you get me a thing that will work, I'll upload that as 2.6.0.1 - and then we'll all sit down and make a real client library process next week18:34
mtaylordprince: yes, I think that's sensible ... we don't really have a stable/diablo branch of novaclient (since we weren't doing multi client lib versions)18:35
russellbso i downloaded 2.6.0 ... i don't know how it ever worked.  it has merge conflicts in it18:35
dprincerussellb: yes. The merge conflicts in novaclient/v1_1/servers.py are the problem.18:35
mtaylordprince: but perhaps we should make one given the breakage involved here18:35
vishytr3buchet: ok so you are ok with the code as is?18:36
mtaylorjeblair: ^^ ?18:36
russellbdprince: ah, k  :-)18:36
tr3buchetvishy: this merge prop?18:36
dprincemtaylor: I'd say lets fix this and then push it to a branch. For reference.18:36
dprincemtaylor: It sounds like Diablo will hang around until we cut Folsom.18:37
mtaylordprince: ok18:37
jeblairwell, problem is, we did not intend to have multiple branches of client libraries.18:37
jeblairbecause the client libraries are always supposed to work with all versions of the software18:37
jeblairexcept, apparently, diablo18:37
dprinceThat just isn't the case.18:38
jeblairwhich never really existed in the eyes of some people.18:38
dprinceWell. The Nova v1.1 API was a moving target across the Diablo Essex releases. So that is what causes the pain here.18:38
jeblairyep18:38
jeblairat any rate, creating a 'stable/diablo' branch of novaclient may have unintented consequences, since several other processes in play weren't designed for it.18:40
jeblairwe could create it, and see if things work18:40
vishytr3buchet: yes the one for updating the cache in two places18:41
vishytr3buchet: also can you review this one: https://review.openstack.org/#change,6396,patchset=318:41
*** bepernoot has joined #openstack-dev18:41
jeblairor we could create another branch, push the 2.6.0.1 commit to it, tag it, delete it, release to pypi and call it done until the summit.18:41
*** berendt has quit IRC18:41
dprincejeblair: I'm fine w/ that sir. Let me have a look at a patch...18:42
*** bepernoot has quit IRC18:43
jeblairmtaylor: ^ sound good?18:43
jeblairdprince: what's the sha1 you want to base your patch on?18:44
dprincejeblair: I get to decide!18:45
dprincejeblair: I suppose I was just going to download the tarball and diff the files...18:45
mtaylorjeblair: yes18:45
dprincejeblair: I have no idea what Git hash 2.6.0 came from.18:46
jeblairokay, so two things we can do:18:46
*** pixelbeat has quit IRC18:46
dprincejeblair: I'm going to look in LP too... if I can find it.18:46
dprincethe hash that is...18:47
jeblair1) if we want to get this into the git history, pick the closest sha1 to 2.6.0, i'll make a branch, and you can submit a change to gerrit for it; then we'll cut a release, tag that branch 2.6.0.1 and delete it.18:47
jeblair2) we can just go along with the mysterious 2.6.0, patch it, email that to monty and he can upload 2.6.0.1 to pypi.18:47
dprincehttps://launchpad.net/ubuntu/oneiric/+source/python-novaclient18:47
sdagueI'm trying to test the nova migration code on mysql, but the mysql driver isn't put in the venv it seems. What's the correct way to get that added so that this will run?18:48
*** davlaps has quit IRC18:48
jeblairsdague: add it to pip-requires if it's needed to run, or test-requires if it's only needed for testing, but, um, mysql seems like it's a pretty basic dependency and should already be there..?18:50
mtaylorjeblair: we do sqlite in the normal test runs18:51
sdaguejeblair: yeh, it's not18:51
sdaguemtaylor: on the jenkins server do you enable the mysql driver?18:51
mtaylorsdague: pip install python-mysqldb into your venv18:51
mtaylorsdague: no18:51
mtaylorsdague: we just run the test suite as is in the tree18:52
sdaguemtaylor: can we get that changed? I was about to put in a unit test to ensure the mysql tables are all innodb, but if it never gets run, it's not very effective18:52
jeblairmtaylor: ah, gotcha.18:52
mtaylorsdague: nope18:52
mtaylorsdague: we use sqlite in the unittests because using mysql involves a bunch of setup/auth stuff18:53
jeblairsdague: then nevermind about the -requires files.18:53
*** kindaopsdevy_ has joined #openstack-dev18:53
jeblairdprince, mtaylor: going to grab lunch; let me know if you want to make that branch, or just email monty a patch if you want to go the other way.18:54
*** ncode has quit IRC18:54
sdaguemtaylor: the way I solved that in another project was to have some default mysql testing user / db, and just skip test if that didn't match on the environment18:54
mtaylorsdague: for the most part, mysql gets tested via the devstack runs (which do buld on top of mysql)18:55
sdaguemtaylor: there are enough parts of the migration that are mysql specific, and mysql is the database people are running with, I'd be really wary of not having that part of standard testing18:55
sdaguemtaylor: right, but that won't catch and stop a bad migration until it's already in the tree18:56
mtaylorsdague: thats not true18:56
mtaylorsdague: we run devstack integration testing before every commit lands18:56
mtaylorsdague: however, I think you're pointing out that we need to test upgrades18:56
mtaylorsdague: also, don't get me wrong - I agree with your sentiment :)18:56
sdaguemtaylor: :)18:56
mtaylorsdague: we need to test postgres as well, which is getting no love at the moment18:56
sdaguemtaylor: well, what are your thoughts on the skip test approach?18:57
jeblairhey, this reminded me we have an openstack-ci meeting starting in 3 minutes18:57
sdagueshould I just take this over ther?18:57
mtaylorsdague: I'm not opposed in principle to the skip test approach - although making sure that we don't accidentally bork someone's db would be important18:57
mtayloryeah18:57
sdagueok, cool, lets just continue in that meeting.18:58
*** Ahmad_HP has quit IRC18:59
dprincemtaylor/jeblair: I sent Monty the email w/ a patch.19:01
*** hashar has joined #openstack-dev19:01
mtaylordprince: thanks!19:03
*** bsza has joined #openstack-dev19:06
*** sandywalsh has quit IRC19:07
*** vincentricci has quit IRC19:08
zulmtaylor: i know there are some users who really like to use postgresql rather than mysql19:14
tr3buchetvishy: 6396 is good19:15
tr3buchetvishy: i don't think i understand why it has to be updated from two places..19:16
tr3buchetvishy: why not just update it for both associate and disassociate in the compute api19:16
vishytr3buchet: um… that is what i was asking you about from the beginning19:18
*** andrewsben is now known as andrewsben_zz19:19
vishytr3buchet: disassociate doesn't go through the compute api19:19
tr3buchetvishy: ah! makes sense. they are both called through the network api... seems like it should be done there...19:19
*** dachary has joined #openstack-dev19:19
vishytr3buchet: well i guess that is ok.  Officially it should be computes job since it is computes cache19:20
vishybut if we want to put both updates there for consistency/small set of changes that seems fine19:20
*** sandywalsh has joined #openstack-dev19:20
vishytr3buchet: commented suggesting we do it in network_api19:23
vishytr3buchet: thanks19:23
*** andrewsben_zz is now known as andrewsben19:23
tr3buchetvishy: i see what you mean...19:24
tr3buchetvishy: that gets screwy multi-cell19:24
tr3buchetvishy: this may need to  be revisited later, but for now, the network api will update the cache in whatever cell the caller is in19:27
*** dprince has quit IRC19:28
*** andrewsben is now known as andrewsben_zz19:28
*** armaan has left #openstack-dev19:30
*** bepernoot has joined #openstack-dev19:31
*** bepernoot has quit IRC19:35
mtaylorzul: yes - but postgres is not getting any love in the gating19:36
zulmtaylor: i would love to see that changed19:36
*** asdfasdf has quit IRC19:37
*** andrewsben_zz is now known as andrewsben19:37
mtaylorzul: I'd also love to see maas written in such a way that it could run on multiple database backends :)19:39
mtaylorzul: you know, using something standard, like sqlalchemy? :)19:40
zulmtaylor: it can apparently19:40
mtaylorzul: great. then i'd like to see the packaging fixed so that it doens't install postgres on my laptop when I try to check i tout19:40
zulmtaylor: submit a bug then :)19:40
mtaylorzul: should I file a bug? :)19:40
zulmtaylor:  yes19:40
*** tryggvil has quit IRC19:40
mtaylorzul: also - fwiw, it doesn't work on laptops running network-manager very well19:41
zulmtaylor:  submit a bug please :)19:41
mtaylorzul: and current network-manager on desktop has taken over dnsmasq in such a way that using one desktop laptop to netboot another one which does not have a cd drive is now way harder19:41
mtaylorzul: I will19:41
mtaylorzul: but it's more fun to just tell you :)19:41
adam_gis glance backed by swift known to be working? seems i can't get it to function properly without doing some hacking to configure and use a tenant associated with swift_store_user when setting up its swift client19:42
adam_gjaypipes: ^19:42
*** danwent has joined #openstack-dev19:46
jaypipesadam_g: yes, Glance + Swift has long been working...19:47
jaypipesadam_g: pastebin your conf...19:47
jaypipesadam_g: redact your sensitive parts :)19:47
openstackgerritVerification of a change to openstack/nova failed: Fix errors in os-networks extension  https://review.openstack.org/639619:49
adam_gjaypipes: ive just basically used devstack, set default_store = swift, and populated the credentials with those set by devstack + set it to create the container. i get this when trying to do a glance add: http://paste.ubuntu.com/923870/19:49
adam_gjaypipes: quickly adding a tenant config option and passing it to swift client during instantiation seems to get everything working19:50
*** bepernoot has joined #openstack-dev19:51
jaypipesadam_g: I think this may be a bug in devstack then... mind submitting the above for devstack?19:53
jaypipesadam_g: just mention in the bug report about tenant needing to be set by devstack's writing the glance-api.conf19:53
adam_gjaypipes: how is it set in glance-api.conf? i dont see an option, and had to add one myself?19:55
adam_gand also didn't see it being passed to swift client at all19:56
*** eglynn has joined #openstack-dev19:56
*** misheska has joined #openstack-dev19:57
openstackgerritVerification of a change to openstack/python-novaclient failed: Fixed the subcommand error message for nova shell.  https://review.openstack.org/581919:59
*** Ryan_Lane has quit IRC20:07
*** Ryan_Lane has joined #openstack-dev20:08
dtroyeradam_g: could you check out https://review.openstack.org/5988 against a current devstack and let me know if it solves your problem?20:08
*** maplebed is now known as maplebedAFK20:09
*** rkukura has joined #openstack-dev20:09
dtroyeradam_g:  hmmm…looking closer it may need to be rebased since we changed how glance is configured.  but the idea is sound20:10
adam_gdtroyer: i can try, but im curious to know if swift store is expected to work with no use of tenant20:10
adam_gdtroyer: ah20:11
adam_gdtroyer: nvm, i see the delta in how ive configured it. one sec20:11
adam_g(more interested in seeing this work without devstack)20:11
adam_gdtroyer: still, seems the tenant is not parsed and correctly passed to swift client20:15
zykes-anyopne here from dell ?20:18
*** rkukura has quit IRC20:18
*** bepernoot has quit IRC20:18
*** novas0x2a|laptop has quit IRC20:19
*** Ryan_Lane has quit IRC20:21
*** Ryan_Lane has joined #openstack-dev20:21
*** bepernoot has joined #openstack-dev20:22
*** utlemming has quit IRC20:23
*** utlemming has joined #openstack-dev20:27
*** danishman has quit IRC20:31
*** markwash has joined #openstack-dev20:31
*** paulormg has quit IRC20:33
*** andrewsben is now known as andrewsben_zz20:33
*** markwash has joined #openstack-dev20:34
vishycomstud: https://review.openstack.org/#change,639620:34
*** novas0x2a|laptop has joined #openstack-dev20:34
comstudlookin20:35
comstudvishy: ahhh20:38
annegentleanyone know how do you get the aggregate_id needed for the os_aggregates extension?20:40
openstackgerritVerification of a change to openstack/glance failed: Skip test depending on sqlite3 if unavailable  https://review.openstack.org/626120:40
rmkSo, boot from volume works, so long as I populate the volume with a bootable OS first20:41
rmkI'm guessing that's by design, in that there's no integration yet with glance20:41
*** dwalleck has quit IRC20:43
*** bepernoot has quit IRC20:45
*** jakedahn_zz is now known as jakedahn20:45
*** joesavak has joined #openstack-dev20:45
chmoueladam_g: what swift version are you using ?20:46
*** andrewsben_zz is now known as andrewsben20:50
mikalvishy: any chance I could get you to take a look at https://review.openstack.org/#change,6354 sometime?20:56
*** gabrielhurley has joined #openstack-dev21:00
*** hashar has quit IRC21:00
*** dolphm has joined #openstack-dev21:00
*** andrewsben is now known as andrewsben_zz21:06
*** vincentricci has joined #openstack-dev21:08
*** rkukura has joined #openstack-dev21:10
adam_gchmouel: trunk of master21:10
chmoueladam_g: what do you have in your glance configuration for swift?21:10
adam_gchmouel: http://paste.ubuntu.com/923983/21:13
adam_gcomstud: ah, s/35357/5000/ on that config snippet. traceback here http://paste.ubuntu.com/923985/21:15
adam_gchmouel: which is supposed to be responsible for parsing tenant from user:tenant, swift or glance?21:16
chmouelswift client.py21:17
*** maplebedAFK is now known as maplebed21:18
chmoueladam_g: I'm checking your error you are getting21:18
chmoueladam_g: oh my review was integrated21:19
chmoueladam_g: i'll fix glance21:20
*** Ryan_Lane has quit IRC21:20
*** Ryan_Lane1 has joined #openstack-dev21:20
chmoueljaypipes, bcwaldon: this doesn't affect the release only trunk21:21
adam_gchmouel: huh?21:21
*** gabrielhurley has quit IRC21:21
*** gabrielhurley1 has joined #openstack-dev21:21
adam_gchmouel: so using essex/stable of swift + glance is expected to work?21:22
chmoueladam_g: this patch https://github.com/openstack/swift/commit/208b8e85a80e46ddb49dc2035cb292570a20c7db was merged21:22
chmoueladam_g: yes21:22
*** joesavak has quit IRC21:22
adam_gah, i see21:22
adam_gthanks chmouel21:22
chmoueladam_g: just point your stackrc to stable21:22
markmcvishy, hmm, looks like stable-maint can't approve essex nominations for nova21:22
markmcvishy, intentional? we can for glance21:22
chmoueladam_g: and get that other devstack review for glance and swift+keystone support21:23
*** gabrielhurley has joined #openstack-dev21:23
adam_gyup21:23
chmoueladam_g: cool! ping me if that's broken21:23
vishymarkmc: probably not intentional21:23
jaypipesadam_g: sorry, went to pay my taxes... :(21:25
*** pixelbeat has joined #openstack-dev21:25
*** gabrielhurley1 has quit IRC21:25
adam_gjaypipes: np21:26
*** Ryan_Lane1 has quit IRC21:26
*** Ryan_Lane has joined #openstack-dev21:26
*** utlemming has quit IRC21:26
dtroyermtaylor: are you the guys who can make a stable/essex branch for devstack?21:27
*** kindaopsdevy_ has quit IRC21:28
*** dwalleck has joined #openstack-dev21:30
*** utlemming has joined #openstack-dev21:31
adam_gspeaking of which, is there going to be a stable/essex branch of tempest?21:33
*** rkukura has quit IRC21:34
*** rkukura has joined #openstack-dev21:34
*** rkukura has quit IRC21:35
*** rkukura has joined #openstack-dev21:39
*** jakedahn is now known as jakedahn_zz21:40
jaypipesdtroyer: yes, or jeblair21:43
*** PaulM has joined #openstack-dev21:45
*** lorin1 has quit IRC21:46
mtaylordtroyer: I am - but jeblair is smarter than I am21:47
mtaylordtroyer: btw - I'm excited about your one-client thoughts21:47
dtroyermtaylor: thx;  I think it'll be interesting next week…21:51
mtaylordtroyer: I almost hacked together a proof of concept this weekend, but then realized I had better things to do with my time21:52
*** markmc has quit IRC21:52
*** slyphon has quit IRC22:00
*** paulstallworth has quit IRC22:02
*** nati has joined #openstack-dev22:02
*** jakedahn_zz is now known as jakedahn22:03
*** jakedahn is now known as jakedahn_zz22:05
*** dolphm has quit IRC22:06
*** lloydde has quit IRC22:07
*** rkukura has quit IRC22:07
*** novas0x2a|lapto1 has joined #openstack-dev22:08
*** novas0x2a|lapto1 has quit IRC22:08
*** novas0x2a|lapto1 has joined #openstack-dev22:09
*** novas0x2a|laptop has quit IRC22:09
*** rkukura has joined #openstack-dev22:10
*** novas0x2a|lapto1 has quit IRC22:10
*** novas0x2a|laptop has joined #openstack-dev22:14
*** crobinso has quit IRC22:14
*** bsza has quit IRC22:14
*** asdfasdf has joined #openstack-dev22:20
*** nati has quit IRC22:21
jeblairdtroyer: yes, can do stable/essex for devstack.  what sha1 would you like for that?22:27
jeblair(curren master?)22:28
jeblaircurrent, even22:28
dtroyerjeblair: yes, current.22:28
jeblairdtroyer: done22:29
*** kbringard has quit IRC22:29
dtroyerjeblair: I'll have one commit to add to it to change the branches in stackrc…how do I target that?22:29
jeblair'git review stable/essex'22:29
dtroyercool, thanks22:29
jeblairthat answer your question?22:29
dtroyeryup22:29
*** asdfasdf has quit IRC22:31
*** rkukura has quit IRC22:31
*** aswin has joined #openstack-dev22:34
*** aswin has left #openstack-dev22:34
*** dwalleck has quit IRC22:34
*** Ryan_Lane1 has joined #openstack-dev22:37
*** Ryan_Lane has quit IRC22:37
*** Ryan_Lane1 has quit IRC22:37
*** Ryan_Lane1 has joined #openstack-dev22:37
*** Ryan_Lane1 is now known as Ryan_Lane22:37
*** Shrews has quit IRC22:46
*** nati has joined #openstack-dev22:47
*** nati has quit IRC22:47
*** Shrews has joined #openstack-dev22:48
*** mattray has quit IRC22:48
*** pixelbeat has quit IRC22:50
*** novas0x2a|laptop has quit IRC22:50
*** novas0x2a|laptop has joined #openstack-dev22:50
*** dtroyer is now known as dtroyer_zzz22:55
*** GheRivero has quit IRC23:05
*** rnirmal has quit IRC23:08
*** Ryan_Lane has quit IRC23:12
*** Ryan_Lane has joined #openstack-dev23:12
*** roge has quit IRC23:21
*** dtroyer_zzz is now known as dtroyer23:27
*** Ryan_Lane has quit IRC23:39
*** Ryan_Lane has joined #openstack-dev23:39
*** heckj has quit IRC23:40
*** paulstallworth has joined #openstack-dev23:44
*** slyphon has joined #openstack-dev23:47
*** lloydde has joined #openstack-dev23:48
*** winston-d has quit IRC23:49
*** dachary has quit IRC23:52
*** Ryan_Lane has quit IRC23:58
*** Ryan_Lane has joined #openstack-dev23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!