Friday, 2011-07-08

*** winston-d has quit IRC00:03
*** winston-d has joined #openstack-dev00:12
*** heckj has quit IRC00:23
*** vladimir3p has quit IRC00:44
*** HP_ has quit IRC00:50
*** bcwaldon has joined #openstack-dev01:18
*** jdurgin has quit IRC01:21
*** bcwaldon has quit IRC01:34
*** richardkaufmann has joined #openstack-dev01:37
*** dragondm has quit IRC02:45
*** mdomsch has joined #openstack-dev03:06
*** jmckenty has joined #openstack-dev03:21
jmckentyhi03:21
jmckentysecret RCB deployment docs: http://cloudbuilders.github.com/deploy.sh/03:21
_0x44Ugh... who invited jmckenty?03:22
* jmckenty smacks _0x44 in the face with a fish03:22
*** ewanmellor has joined #openstack-dev03:23
creihtjmckenty: since you are here, where is that github of your swift enhancements?03:26
jmckentycreiht: it's still password protected, I had an argument with my marketing guys today, but I think I won it03:27
creihthah03:27
creiht:)03:27
jmckentywe're hacking at the OpenStack meetup at my office right now03:27
jmckentymay push some changes later tonight03:28
creihtjmckenty: if you don't mind, let some of the swift guys know when they drop, as I know they would be interested in seeing them03:28
jmckentyI've been keeping Dickinson up to speed03:29
creihtcool03:29
*** John1234 has joined #openstack-dev03:29
John1234hi all03:29
*** rficcaglia has joined #openstack-dev03:32
*** tomdiz has joined #openstack-dev03:33
jmckentyevenin03:45
jmckentySo the newer developers have pointed out, as is typical, that the error messages are "cryptic"03:45
jmckentyAnyone else want to help with https://blueprints.launchpad.net/nova/+spec/friendly-error-messages ?03:45
_0x44Also https://blueprints.launchpad.net/swift/+spec/friendly-error-messages03:47
*** openpercept_ has joined #openstack-dev03:51
*** chomping has quit IRC03:51
creihtthose are a bit vague :)04:00
creihtany stacktrace in logs should be reported as a bug :)04:00
openstackjenkinsProject nova build #1,074: SUCCESS in 3 min 19 sec: http://jenkins.openstack.org/job/nova/1074/04:00
jmckentycreiht: I don't think "friendly" is vague at all04:07
creihtnot the friendly part so much04:08
John1234admittedly I fubared my install, using the github installer of trunk gave me 2011.3-dev (2011.3-workspace:tarmac-20110701154733-jg5n4tcpox68d4o5)04:08
John1234I couldn't quite get the network component to work (Instance would go through "networking" to "shutdown")04:08
creihtJust saying that it is a lot easier to implement if the devs know what stack traces people are seeing04:09
John12342011-07-05 18:19:46,665 CRITICAL nova [-] create() takes exactly 2 arguments (1 given)04:09
John1234(nova): TRACE: Traceback (most recent call last):04:09
John1234(nova): TRACE:   File "/usr/bin/nova-manage", line 1276, in <module>04:09
John1234(nova): TRACE:     main()04:09
John1234(nova): TRACE:   File "/usr/bin/nova-manage", line 1265, in main04:09
John1234(nova): TRACE:     fn(*argv)04:09
John1234(nova): TRACE: TypeError: create() takes exactly 2 arguments (1 given)04:09
John1234(nova): TRACE:04:10
John12342011-07-05 18:19:59,253 DEBUG nova.utils [-] backend <module 'nova.db.sqlalchemy.api' from '/usr/lib/pymodules/python2.6/nova/db/sqlalchemy/api.pyc'> from (pid=8283) __get_backend /usr/lib/pymodules/python2.6/nova/utils.py:41704:10
John12342011-07-05 18:20:49,569 DEBUG nova.utils [-] backend <module 'nova.db.sqlalchemy.api' from '/usr/lib/pymodules/python2.6/nova/db/sqlalchemy/api.pyc'> from (pid=8881) __get_backend /usr/lib/pymodules/python2.6/nova/utils.py:41704:10
John12342011-07-07 21:06:54,573 DEBUG nova.utils [-] backend <module 'nova.db.sqlalchemy.api' from '/usr/lib/pymodules/python2.6/nova/db/sqlalchemy/api.pyc'> from (pid=5164) __get_backend /usr/lib/pymodules/python2.6/nova/utils.py:41704:10
John12342011-07-07 21:07:15,707 CRITICAL nova [-] (OperationalError) (2003, "Can't connect to MySQL server on '10.10.10.206' (110)") None None04:10
creihtJohn1234: paste.openstack.org next time please :)04:10
John1234So the key here is that unfortunately the error from the cli04:10
*** mdomsch has quit IRC04:10
jmckentycreiht: we'll file a ton of related bugs as we go04:11
John1234sorry, will put the rest of it in the paste.openstack.org04:11
creihtjmckenty: indeed04:11
jmckentycreiht: see, John1234 's bug above is a great example04:12
jmckentythis is a simple case of missing an argument, if I'm not mistaken04:12
jmckentyOR, the mysql server isn't running / accessible04:12
creihtjmckenty: I don't think we are disagreeing at all04:12
jmckentyright04:12
John1234yup, misconfiguration of the MySQL (hardcoded to a static ip that doesn't exist)... easy to see in the stack trace but might be easier from the command line04:12
creihtI'm just saying that any stack trace like that should be logged as a bug04:12
jmckentyI agree04:13
creihtblindly going through the code trying to find those is only going to get you so far04:13
jmckentywho said anything about blinding trolling code?04:14
* creiht shrugs04:14
creihtI guess I just misinterpreted04:14
jmckentyI'm just going to camp out in here and file bugs based on people's pastes :)04:14
creihtI was just trying to say from experience the best way to accomplish what you want in that blueprint, is to start logging bugs for every traceback04:15
creihtWe did that a while back for swift04:16
*** rficcaglia has quit IRC04:27
John1234thanks, I'll try to continue working through my installation issues and contribute to the wiki (and pasting into bugs)04:37
*** John1234 has quit IRC04:39
*** ewanmellor has quit IRC04:52
*** tomdiz has quit IRC05:09
*** jmckenty has quit IRC05:39
openstackjenkinsProject nova build #1,075: SUCCESS in 3 min 11 sec: http://jenkins.openstack.org/job/nova/1075/05:52
openstackjenkinsProject nova build #1,076: SUCCESS in 3 min 7 sec: http://jenkins.openstack.org/job/nova/1076/05:55
*** richardkaufmann has quit IRC06:20
*** richardkaufmann has joined #openstack-dev06:20
*** zaitcev has quit IRC06:34
*** reidrac has joined #openstack-dev06:57
*** Vasichkin has joined #openstack-dev08:07
ttxsoren: you should be able to reapprove https://code.launchpad.net/~chemikadze/nova/gracefull-shutdown/+merge/66873 -- now with updated Authors09:12
*** mrmartin has joined #openstack-dev09:32
ttxsoren: also in the cleanup area, https://code.launchpad.net/~todd-deshane/nova/working/+merge/67114 can be set to rejected by its own author admission09:33
*** ewanmellor has joined #openstack-dev10:02
*** ewanmellor has quit IRC10:55
*** markvoelker has joined #openstack-dev10:58
*** markvoelker has quit IRC11:33
openstackjenkinsProject nova build #1,077: SUCCESS in 3 min 13 sec: http://jenkins.openstack.org/job/nova/1077/11:34
openstackjenkinsTarmac: Fixes bug #805604 "Multiprocess nova-api does not handles SIGTERM correctly."11:34
uvirtbotLaunchpad bug 805604 in nova "Multiprocess nova-api does not handles SIGTERM correctly." [Medium,In progress] https://launchpad.net/bugs/80560411:34
*** bcwaldon has joined #openstack-dev11:47
*** bcwaldon has quit IRC11:54
*** rods has joined #openstack-dev12:03
*** markvoelker has joined #openstack-dev12:08
*** zul has joined #openstack-dev12:55
ttxmtaylor: error 500 from jenkins.openstack.org ?13:02
ttxnm, works now13:02
*** ameade has joined #openstack-dev13:27
*** bcwaldon has joined #openstack-dev13:42
*** kbringard has joined #openstack-dev13:50
*** openpercept_ has quit IRC14:03
*** cp16net has joined #openstack-dev14:21
*** mdomsch has joined #openstack-dev14:58
*** jkoelker has joined #openstack-dev15:01
*** dragondm has joined #openstack-dev15:07
*** mrmartin has quit IRC15:13
*** reidrac has left #openstack-dev15:21
*** heckj has joined #openstack-dev15:33
*** vladimir3p has joined #openstack-dev15:34
*** kbringard has quit IRC15:36
*** kbringard_ has joined #openstack-dev15:36
*** deshantm_laptop has joined #openstack-dev15:43
*** bcwaldon has quit IRC15:50
*** bcwaldon has joined #openstack-dev15:51
*** bcwaldon has quit IRC15:56
*** negronjl has quit IRC15:56
*** zul has quit IRC16:01
*** dragondm has quit IRC16:11
*** jaypipes has quit IRC16:11
*** John24816 has joined #openstack-dev16:14
heckjvishy: you around for a question?16:23
*** jaypipes has joined #openstack-dev16:25
annegentleother thing I didn't think about from a hotel in Arkansas: no spaces in Jenkins job names.16:27
*** deshantm_laptop has quit IRC16:32
*** jdurgin has joined #openstack-dev16:40
*** jkoelker has quit IRC16:41
*** ohnoimdead has joined #openstack-dev16:43
*** zaitcev has joined #openstack-dev16:45
*** lorin1 has joined #openstack-dev16:50
*** mszilagyi has joined #openstack-dev16:53
*** kbringard_ has quit IRC16:58
*** kbringard has joined #openstack-dev16:59
*** cp16net_ has joined #openstack-dev17:04
*** zul has joined #openstack-dev17:05
*** cp16net has quit IRC17:06
*** cp16net_ is now known as cp16net17:06
jaypipeszul: around?17:14
zuljaypipes: yep whats up?17:14
jaypipeszul: vishy and I were wondering whether the fix for https://bugs.launchpad.net/glance/+bug/784837 should also be done for nova?17:14
uvirtbotLaunchpad bug 784837 in glance "glance-api.log permission error when using upstart script" [High,Fix released]17:14
zuljaypipes: i havent seen it with nova yet17:16
*** HP has joined #openstack-dev17:18
*** technicool has joined #openstack-dev17:27
*** jtran has joined #openstack-dev17:30
*** Vasichkin has quit IRC17:31
*** cp16net has quit IRC17:54
*** cp16net has joined #openstack-dev17:55
*** mgius has quit IRC17:58
s1rpjaypipes: ping18:00
*** lorin1 has quit IRC18:12
*** mrmartin has joined #openstack-dev18:22
*** lorin1 has joined #openstack-dev18:22
*** lorin1 has left #openstack-dev18:23
jaypipess1rp: pong18:29
* jaypipes suckerpunches Unity shell for not notifying me any more in the top-bar about XChat messages...18:29
kbringardhaha18:33
*** mvoelker has joined #openstack-dev18:35
*** mvoelker has quit IRC18:36
*** bcwaldon has joined #openstack-dev19:15
cp16netseems like unity has a plethora of issues i've decided against using it and going back to classic19:18
jk0launchpad must be taking a vacation from updating merge prop diffs today19:20
jaypipescp16net: ya... I'm almost there myself...19:23
jaypipesjk0: no crap. just noticed that myself...19:23
jk0mine's going on 3 hours now19:23
jaypipesjk0: yep. I just saw a notification of a comment I made a couple hours ago...19:25
jaypipescp16net: https://bugs.launchpad.net/ubuntu/+source/xchat/+bug/77452119:25
uvirtbotLaunchpad bug 774521 in xchat "xchat disappears when minisied to tray with unity running" [Undecided,Confirmed]19:25
jk0apparently the ML is having similar problems19:25
jaypipesjk0: yup19:27
*** technicool has quit IRC19:28
cp16netjaypipes:  i noticed that unity doesnt support multiple monitors so i bailed on it quickly.19:29
*** zul has quit IRC19:30
*** jaypipes has quit IRC19:30
*** jaypipes has joined #openstack-dev19:31
*** jaypipes has quit IRC19:31
*** dprince has joined #openstack-dev19:33
*** rnirmal has joined #openstack-dev19:35
*** jaypipes has joined #openstack-dev19:39
HPdoes the nova.api.ec2 call anything in nova.api.openstack? I thought those are two independent APIs, but i might be wrong19:47
*** technicool has joined #openstack-dev19:49
*** markvoelker has quit IRC19:53
*** johnpur has joined #openstack-dev19:55
*** ChanServ sets mode: +v johnpur19:55
jaypipesHP: not right now they don't, no.20:07
*** heckj_ has joined #openstack-dev20:07
kbringardhttp://paste.openstack.org/show/1867/20:08
kbringardanyone seen this yet?20:08
*** heckj_ has quit IRC20:08
*** heckj has quit IRC20:09
*** mszilagyi has quit IRC20:09
*** mszilagyi has joined #openstack-dev20:12
kbringardah, as it turns out, that's just a bad error, because of how it's parsing20:20
*** dragondm has joined #openstack-dev20:44
*** ameade has quit IRC20:49
*** dprince has quit IRC20:57
jaypipesjk0: looks like LP is past its email backlog...21:13
jk0of course. it's nearing the end of the work day ;)21:13
jk0always perfect timing with LP21:14
jaypipes:)21:15
*** mdomsch has quit IRC21:16
vishyheckj: here now21:24
vishysoren: ping21:27
*** technicool has quit IRC21:42
sorenvishy: 'sup.21:44
sorenWow. Punctuation fail.21:44
vishysoren: just wanted to say that I'm glad you are back from vacation!21:44
sorenHeh :)21:45
sorenvishy: It's good to be back!21:45
vishysomeone has to whip the lazy proprietary coders into shape!21:45
*** mrmartin has quit IRC21:46
sorenI learned something while on holiday: Being on unreliable internet connections for extended periods of time will completely cancel out any attempts to becomme un-stressed-out.21:47
sorenI ended up squibbling notes by hand. It took most of a day to type everything in when I got back.21:47
jk0they still sell paper for physically writing on?21:49
jk0weird21:49
sorenStuff just kept piling up in my head. I was about to burn out while on holiday trying to not forget it all.21:49
sorenjk0: They give it out for free at conferences.21:49
sorenThankfully!21:49
sorenOtherwise I wouldn't have known where to find any.21:49
jk0:P21:50
sorenSo yeah. Thinly sliced, bleached wood saved the holiday.21:50
vishysoren: haha nice21:52
sorenI'm not very good at holidays :)21:56
*** johnpur has quit IRC22:04
jk0vishy, soren, while you're here, can I have you look at https://code.launchpad.net/~jk0/nova/lp807749/+merge/67399 :)22:14
sorenjk0: I actually thought you could disable them by fiddling with the paste config.22:15
sorenjk0: I've never tried, though :)22:15
jk0antonym mentioned that, but it was never confirmed. this seems like another reasonable approach too though22:15
jk0IMHO22:15
sorenjk0: Yeah, I can't see how to do it with the paste conf either.22:16
antonymyeah, i thought you might be able to do it there but wasn't sure22:16
jk0even if you *can* in paste, this way seems cleaner from a large prod env perspective22:16
jk0when deploying thousands of conf files22:16
sorenI just fixed python-novaclient builds, by the way.22:19
jk0sweet, thanks22:19
jk0thanks thnx for the review22:19
sorenIt's not as awesome as it sounds. It'd be more accurate to say that I stopped being an idiot and unbroke it.22:20
jk0vishy: thnx22:20
jk0soren: the first way sounded better :)22:20
*** technicool has joined #openstack-dev22:21
vishysoren: you used to be able to22:23
*** rods has quit IRC22:23
sorenvishy: Ah.22:23
vishysoren: i think one of the brians made a change to start the apis in two separate processes22:23
vishywhich probably stopped that from working22:24
jk0ah, that might have been in the wsgi refactor22:24
jk0recently22:24
*** cp16net has quit IRC22:24
*** rnirmal has quit IRC22:34
*** kbringard has quit IRC22:35
openstackjenkinsProject nova build #1,078: SUCCESS in 3 min 20 sec: http://jenkins.openstack.org/job/nova/1078/22:37
openstackjenkinsTarmac: Add a flag to disable ec2 or osapi.22:37
vishytr3buchet: here?22:43
openstackjenkinsProject nova build #1,079: SUCCESS in 3 min 13 sec: http://jenkins.openstack.org/job/nova/1079/22:44
openstackjenkinsTarmac: Make the instance migration calls available via the API.22:44
*** bcwaldon has quit IRC22:59
*** Eric_o2 has joined #openstack-dev23:00
*** rnirmal has joined #openstack-dev23:01
*** rnirmal has quit IRC23:16
tr3buchetvishy: yeah whats up?23:29
vishytr3buchet: I'm trying to figure out why you removed the call to set_network_host23:29
vishytr3buchet: and have the periodic callback do it...23:29
tr3buchetvishy: i'm actually working on a solution to that now23:30
vishyoh, i'm heavily editing that code23:30
vishy:)23:30
tr3buchetvishy: i'm going to make host an optional parameter to network create23:30
tr3buchetand then then add a "configured" column to the network table23:30
vishyi don't understand what the problem was with having a call to set a network host if it isn't set?23:31
tr3buchetit's a race condition23:31
vishytr3buchet: that doesn't really work for multi_host networks23:31
vishywhat is the race condition?23:31
tr3buchetsay you set the host after a network host has picked it up as part of its periodic task23:32
tr3buchetunless you set it to the same host that randomly grabbed it it would be incorrect23:32
vishybut there is logic in set network host to handle it23:33
tr3buchetso you're saying when you go to set it, it just fails?23:33
tr3buchetthen you can't configure it as you wish23:33
tr3buchetit's why that field needs to be set when the network row is created in the db23:33
vishyperhaps the race condition is it comes back with a locked table?23:34
vishyseems like we could just solve that with a retry23:34
tr3buchetwell not even that, say you create it, a network host picks it up and configures it, then you set the host to something else23:34
tr3bucheti guess we could just put a check in there that only allows setting the host if it's unconfigured23:35
vishywhy would you do that?23:35
vishyset_network_host already checks to see if there is host set23:35
vishyand returns the old host if it is23:35
tr3buchetah i see23:35
tr3buchetthat should just raise or something23:36
vishythe purpose of that method call was to ensure each network gets a host23:36
vishyand when it does it does the setup23:36
tr3buchetthe problem then would be that the network hosts would relentlessly be grabbing these networks23:36
vishyfor the network on that host23:36
tr3bucheti thought it would be nice to just spin up a new network host and the load would slowly move onto that host23:37
vishyset network host used to be called before messages were passed23:37
tr3buchetall messages?23:37
tr3buchetare you talking about the network api function?23:38
vishyallocate fixed ip23:38
tr3buchetah ok23:38
vishyif the network didn't have a host it would get one23:38
vishythen the allocate would be sent to that host23:38
tr3buchetright23:38
vishynow you have to wait...23:38
vishyuntil a host has grabbed it23:38
tr3buchetright. if you can set the host as a part of network creation there wouldn't be a wait23:38
vishyor everything breaks23:38
tr3buchetoh i see23:39
tr3bucheteven still23:39
tr3buchetyou can't use it immediately23:39
vishyright but then you have to automatically determine whether the host has been set up properly23:39
tr3buchetalright, then the network creation should pick a host and make the call to configure it right there23:39
vishywhich is exactly what the set network host was supposed to be doing23:39
tr3buchetwhat if your project has 2 networks on two hosts23:40
tr3buchetwhich topic do you write to?23:40
tr3bucheti moved determining that into the network code and out of compute. compute just uses the default network topic23:41
vishygood point.  In this case it needs to do a set_network_host on both23:41
tr3buchetthen network will make calls to specific topics if necessary at the time when it is specifically necessary23:41
vishythat is fine, but is it doing that?23:41
tr3buchetyes23:41
tr3buchettake a look at the RPC mixin23:41
tr3buchetand the same for the way floating IPs are handled23:42
vishythen can't we just move all of the setup into the allocate_fixed_ip method23:42
vishy?23:42
vishywhy not do it there?23:42
tr3buchetwell i wanted to move away from having the network configured only upon first use23:42
vishythat is fine, but it is a separate issue23:42
tr3buchetso you add a network, it gets configured, and then it's utilized23:42
vishythere are a lot of times when you need to make sure the network has been set up23:43
tr3buchetbut yeah i can see if in allocate, or in _get_networks_for_instance, it checked to ensure the networks were configured23:43
vishyso i think we should make sure that it is set up in that method.  It doesn't stop you from pre-setting it up23:43
tr3buchetsure yeah23:43
tr3buchetadd that to _get_networks_for_instance23:43
tr3buchetif you like i can do that as a part of the bug fix?23:43
tr3buchetin flat it would basically ensure that the networks returned are all configured23:45
tr3buchetdifferent story for vlans23:45
vishytr3buchet I think i got this right23:55
vishyneed to test23:55
tr3buchetcool23:55
tr3buchetis that in your ha-net branch?23:55
tr3buchetor will it be?23:55
vishyi added a check in rpc to call out23:55
vishyyes just testing then i will push23:55
tr3buchetcool23:55
tr3buchetyou add to the call in the network api?23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!