Wednesday, 2011-07-06

*** mgius has quit IRC00:09
vishyha flatdhcp appears to work00:27
vishy:)00:27
openstackjenkinsProject nova build #1,069: SUCCESS in 3 min 11 sec: http://jenkins.openstack.org/job/nova/1069/00:29
openstackjenkinsTarmac: Silence warning in case tests.sqlite doesn't exist00:29
kpepplevishy: woot00:30
vishyneeds some testing00:34
vishykpepple: I haven't tried it on  multiple boxes yet so there may be bugs00:34
vishykpepple: lp:~vishvananda/nova/ha-net00:36
kpepplevishy: not a worry ... the network availability / scalability problem is holding a lot of people back. if this fixes at least one of them, thats a win.00:36
kpepplevishy: will try ...00:36
vishykpepple: there is a new flag on networks00:36
vishymulti_host00:36
vishyyou can set during create with nova-manage create private 10.0.0.0/8 1 32 T00:37
vishyor default it with a flag00:37
vishy--multi_host=True00:37
vishybut if you do you have to run nova-network on all of the compute hosts00:37
vishyyou can just use one per compute host, no separate network node00:38
vishyanyway I'm off, let me know if you try it out00:39
kpepplevishy: thx, will so00:39
vishy(btw it will give a different ip to each compute host)00:39
*** vladimir3p_ has quit IRC00:47
*** stevezd has quit IRC00:49
*** mszilagyi has quit IRC00:49
*** jdurgin has quit IRC01:00
*** HugoKuo has quit IRC01:00
*** HugoKuo has joined #openstack-dev01:07
*** ohnoimdead has quit IRC01:07
*** lorin1 has quit IRC01:13
*** lorin1 has joined #openstack-dev01:14
*** johnpur has quit IRC02:50
*** openpercept has joined #openstack-dev03:18
*** mdomsch has joined #openstack-dev03:20
*** chomping has joined #openstack-dev03:30
*** chomping has quit IRC03:35
*** chomping has joined #openstack-dev03:35
*** chomping has quit IRC03:36
*** chomping_ has joined #openstack-dev03:36
*** chomping_ has joined #openstack-dev03:36
*** lorin1 has left #openstack-dev03:39
*** mszilagyi has joined #openstack-dev03:52
*** negronjl_ has joined #openstack-dev04:13
*** negronjl has quit IRC04:15
*** mszilagyi has quit IRC04:50
*** vladimir3p_ has joined #openstack-dev05:07
*** vladimir3p_ has quit IRC05:31
*** zaitcev has quit IRC05:59
*** po has joined #openstack-dev06:40
*** dragondm has joined #openstack-dev06:45
*** reidrac has joined #openstack-dev07:02
*** reidrac has left #openstack-dev07:03
*** reidrac has joined #openstack-dev07:03
*** reidrac has left #openstack-dev07:03
*** reidrac has joined #openstack-dev07:04
*** BK_man has quit IRC07:13
*** BK_man_ is now known as BK_man07:13
*** mancdaz1203 has quit IRC07:32
*** mancdaz has joined #openstack-dev07:33
*** mancdaz has quit IRC08:04
*** mancdaz has joined #openstack-dev08:05
*** dragondm has quit IRC08:19
ttxsoren: so, feedback from D2 release automation last week08:27
ttxsoren: reupload_with_new_version.py is a bit brittle08:28
sorenttx: Yes!08:28
ttxlike uscan seems to randomly fail08:28
sorenFascinating. On reliably networks?08:28
soren*reliable08:28
ttxon slow but reliable networks08:28
sorena.k.a. rural France ADSL? :)08:28
ttxrandomly being FAIl PASS FAIL PASS PASS FAIL08:28
sorenOk.08:29
ttxlike on the same tarball08:29
sorenThat particluar bit has lots of room for improvement for sure.08:29
ttxI thought it was "time for it to show up" but it sounds a bit more tricky08:29
sorenAh.08:29
*** Vasichkin has joined #openstack-dev08:30
ttxmaybe some timeout08:30
sorenI kind of like that it pulls it frmo Launchpad. That way, we're sure we don't cheat and use a different tarball.08:30
ttxtarball upload is a bit slow with my upload speed, and it does it 4 times08:30
sorenWell, that's an artefact of this process being new.08:31
sorenAS soon as we're confident it's in good shape, it needs to happen on the Jenkins box.08:31
ttxsoren: hmm, with GPG keys being stored there ?08:32
sorenThat's already the case.08:32
sorenWe upload to the trunk ppa's from there.08:32
sorenAnd the milestone-proposed ppa's.08:32
ttxok08:32
ttxis there a way for reupload_with_new_version.py to only upload the tarball to the PPA once ?08:33
ttxit really needs to happen one time for each series ?08:33
sorenStrictly speaking, no.08:34
ttxthe whole "reupload_with_new_version.py nova-core/milestone-proposed nova 2011.3~d2" took 30 min.08:34
sorenTHere's a catch, though.08:34
ttxit would obviously go faster from Jenkins than from my home, but...08:34
sorenIf we're only to upload it once, we need to upload the first one, wait for its source to be published and then upload the rest (so that they can find the orig.tar.gz from the first upload).08:35
sorenAT least I think that's the case.08:35
sorenLet me ask around a bit.08:35
ttxhmm, might just be faster to reupload them from a fast location08:35
ttxsoren: it's probably better for the script to reupload them, rather than poll for source code08:36
sorenttx: Yeah.08:38
ttxsoren: ftr here is what I did: http://paste.openstack.org/show/1844/08:40
ttxsoren: I'm working on automating the middle part now08:41
sorenwait!08:41
soren:)08:41
sorenttx: Before you do, take a look at lp-project-upload in ubuntu-dev-tools.08:42
sorenttx: I've never used it, but it sounds like just what we need.08:42
* ttx took a look at TheKraken, the release automation tool from Aaron Bentley08:42
ttxI'll compare now :)08:42
ttxsoren: how do you want to handle the "# wait for stuff to build and be published" wait ? Poll for package publication ? Or have a two-step process with human verification in between ?08:44
ttxeverything else can actually be done in one shot... especially if it's simple to trigger parameterized Jenkins jobs from other jobs08:44
sorenttx: Just checked with bigjools. No need to wait for the first package to get published. We can just include the tarball in the first upload and skip it on the rest.08:47
sorenttx: I think making the "wait for stuff" a manual step is the right choice.08:49
sorenttx: And not just because a technical implementation will be quite awkward.08:49
sorenttx: ...but that too :)08:49
ttxright08:49
sorenttx: I think it's a good idea to have a human actually see that it went as expected.08:50
sorenttx: You know..08:50
sorenttx: I don't like that "reupload with new version" thing.08:50
sorenttx: Not just the implementation, but the idea.08:50
ttxso lp-project-upload is quite close, except that you can't set a description08:50
sorenIt's wrong for all the reasons I stated in my EP2011 talk.08:51
ttxand my script would also take care of downloading and verifying the tarball... the actual "create-release" part is 5 lines of code so simple there is no good reason to reuse it08:52
ttxhmm08:52
ttxsoren: but how would you avoid that ?08:52
sorenNo clue.08:53
sorenoh, brb.08:53
*** chemikadze has quit IRC08:55
*** chemikadze has joined #openstack-dev08:57
sorenback08:58
sorenttx: Yeah, no clue.08:59
sorenttx: Admittedly, a lot of the stuff we're doing is making sure that this will work as expected, but still.09:00
*** mancdaz has quit IRC09:18
*** mancdaz has joined #openstack-dev09:19
*** chemikadze has quit IRC10:22
*** chemikadze has joined #openstack-dev10:28
*** chomping_ has quit IRC10:37
*** chomping has joined #openstack-dev11:04
*** chomping has quit IRC11:09
*** markvoelker has joined #openstack-dev12:02
*** HugoKuo_ has joined #openstack-dev12:44
*** HugoKuo has quit IRC12:48
*** mdomsch has quit IRC13:06
*** jaypipes has joined #openstack-dev13:13
*** kbringard has joined #openstack-dev13:24
*** kbringard has quit IRC13:26
*** kbringard has joined #openstack-dev13:27
*** kbringard has quit IRC13:41
*** kbringard has joined #openstack-dev13:41
*** openpercept has quit IRC13:48
*** vladimir3p_ has joined #openstack-dev13:49
*** openpercept_ has joined #openstack-dev13:50
*** openpercept_ has quit IRC13:50
*** vladimir3p_ has quit IRC13:51
*** dprince has joined #openstack-dev14:05
*** cweidenk1ller is now known as cweidnekeller14:15
*** cweidnekeller is now known as cweidenkeller14:16
*** cweidenkeller has quit IRC14:18
*** jkoelker has joined #openstack-dev14:19
*** cweidenkeller has joined #openstack-dev14:20
*** bcwaldon has joined #openstack-dev14:28
*** cp16net_ has joined #openstack-dev14:31
*** cweidenkeller has quit IRC14:39
*** cweidenkeller has joined #openstack-dev14:39
*** vladimir3p has joined #openstack-dev14:40
pohi ! can someone explain me why vm need to contact 169.254.169.254 when launched ?14:53
ttxpo: that's how the EC2 metadata server works14:54
kbringardthat's where it gets stuff like, the ssh keys and whatnot14:54
kbringardhah, ttx beat me to it14:54
pottx:  169.254.169.254 is nated to the controler ip, isn't it ?14:54
ttxpo: so a vm that is designed to run on EC2-like envs (like ubuntu cloud images) will try to get data from 169.254.169.25414:54
ttxit's nated to the nova-api, yes14:54
ttxthough we might simplify in the future so that it actually points to the host.14:55
pocan't it be disabled ?14:55
poi mean, if i pack my own vm image14:56
ttxpo: of course it can.14:56
ttxpo: hrm.14:56
ttxpo: depend on what you mean by "it" I guess14:56
ttxthe calls to 169.254.169.254 can definitely not be sent from your VM and the thing will continue to work14:57
ttxunless your VM actually depends on that data (like the Ubuntu cloud images do)14:57
pook, that's why my ubuntu server image can't boot14:58
*** dragondm has joined #openstack-dev15:03
*** reidrac has quit IRC15:12
tr3buchetvishy: I was out yesterday. What did you need?15:29
*** mancdaz has quit IRC15:31
kbringardinteresting, it looks like cloud-config supports using multiple metadata urls (back to po's question)15:32
*** mancdaz has joined #openstack-dev15:35
mtaylorttx, soren: I looked at TheKraken a while back - but unfortunatley it's designed to make a release from a branch - and not using setup.py sdist, IIRC, which made me want to kill someone15:56
ttxmtaylor: yes, I just ripped from it15:57
*** KAM has joined #openstack-dev15:59
*** cp16net_ has quit IRC16:09
*** bcwaldon has quit IRC16:14
*** mdomsch has joined #openstack-dev16:16
*** peads has joined #openstack-dev16:20
*** cp16net_ has joined #openstack-dev16:24
*** cp16net_ has quit IRC16:27
vishytr3buchet: I was trying to understand a few things in the networking refactor16:36
vishyi think i figured it out16:36
vishytr3buchet: I'm not convinced by the use of super in the flatdhcp mixin16:37
vishy* FloatingIp mixin16:37
vishyalso the check on auto_assign_floating_ip was a little messed up16:37
vishytr3buchet I have a branch up for ha-networking lp:~vishvananda/nova/ha-net16:39
vishytesting it today on multiple machines16:39
tr3buchetvishy: hmm16:39
tr3buchethow are you not convinced by the use of super?16:40
*** jdurgin has joined #openstack-dev16:40
*** KAM has left #openstack-dev16:41
*** zaitcev has joined #openstack-dev16:44
*** zul has quit IRC16:52
*** bcwaldon has joined #openstack-dev16:55
*** lorin1 has joined #openstack-dev16:57
vishythe super call in FloatingIp mixin depends on inheritance structure and ordering16:57
vishywhich i think is very fragile16:57
*** mdomsch has quit IRC17:02
comstudthe mro is kinda interesting17:07
*** ohnoimdead has joined #openstack-dev17:08
comstudwe had played around double inheritance in standalone test programs to verify it17:08
comstudalthough I'm not familiar with the code that actually landed17:08
*** deshantm_laptop has joined #openstack-dev17:09
*** mdomsch has joined #openstack-dev17:12
*** erik-s has quit IRC17:13
comstudtaking a look, the super() in FloatingIp works fine as long as you've got a class that inherits from FloatingIp along with another class... and FloatingIp is first in the inheritance list.17:13
*** erik-s has joined #openstack-dev17:14
comstudI guess I should say: s/first/not last/17:15
comstudi can't argue about it being 'fragile', tho :)17:17
*** CatKiller has quit IRC17:17
*** AhmedSoliman has joined #openstack-dev17:20
*** po has quit IRC17:21
*** AhmedSoliman has quit IRC17:22
*** AhmedSoliman has joined #openstack-dev17:23
*** CatKiller has joined #openstack-dev17:23
*** jaypipes has quit IRC17:30
*** jaypipes has joined #openstack-dev17:31
*** CatKiller has quit IRC17:37
*** CatKiller has joined #openstack-dev17:49
*** CatKiller has quit IRC17:50
*** CatKiller has joined #openstack-dev17:51
*** negronjl_ has quit IRC17:54
vishyjaypipes: IOError: [Errno 13] Permission denied: '/var/log/glance/api.log'17:58
vishyin apt-get.  Perhaps this is the error that chuck reported17:59
jaypipesvishy: https://bugs.launchpad.net/glance/+bug/78483717:59
uvirtbotLaunchpad bug 784837 in glance "glance-api.log permission error when using upstart script" [High,Fix released]17:59
vishyjaypipes: hmm, i wonder if we need matching fixes in nova18:00
jaypipesvishy: likely. zul will be back on channel later. he's taking care of his kid right now...18:01
jaypipesvishy: let's hit him up on this.18:01
*** mgius has joined #openstack-dev18:03
*** mdomsch has quit IRC18:07
*** AhmedSoliman has quit IRC18:16
heckjtr3buchet - got a sec? Ran into an issue with multi-nic in trunk18:57
vishyheckj: what is it?19:04
vishyI've been fooling19:04
vishy\me cheers!19:04
heckjheh19:04
* vishy cheers!19:04
vishythat is19:04
vishyha-networking works19:04
heckjRan into an issue with positional arguments while invoking "network create" with nova-manage19:05
vishyyeah they changed19:05
vishyyou need to add a private19:05
vishyor 'label'19:05
heckjShould we be adding a label in there to work around?19:05
vishyyes19:05
heckjso adding "label" up front on that method was intentional. Ok - wasn't 100% sure19:05
heckjWhat's the implication of a label? If I just make it something stupid for an all-in-one setup, will that bite me later?19:06
heckj(already sent a note to the openstack list - so you'll see this question there too...()19:06
vishydoesn't matter19:10
vishythe label is just so you can tell the different networks apart19:11
vishyit will bridge the vm into all the networks you have defined19:11
heckjvishy: thanks - got it. Made a tweak to my copy of nova.sh and it's installing cleanly now19:11
vishyyeah i just updated nova.sh btw19:11
vishy(well the novascript one)19:12
vishythe cloudbuilders one is unmodified19:12
* heckj looks19:12
heckjI've been riffing off the cloudbuilders on19:12
heckjone19:12
*** scotticus has left #openstack-dev19:16
tr3buchetheckj: yes19:17
tr3buchetlooks like vish set you straight19:18
heckjtr3buchet: vishy answered my Q - didn't know about the network create command change needed19:18
heckjYep!19:18
*** mrmartin has joined #openstack-dev19:18
tr3buchetgood deal19:18
vladimir3pvishy: is there any quick doc/spec on ha-networking?19:44
vishyvladimir3p: it is actually pretty simple19:44
vishyvladimir3p: but it won't work on windows yet19:44
vishyvladimir3p: there is an extra flag on networks called multi_host19:45
vishyyou set it to true and then you run a nova-network on every compute host19:45
vishyall of the compute hosts will get an ip on the network19:45
vladimir3pvishy: will you assign IPs from fixed range to nodes similarly to how it is done for single networking node?19:47
vishyyes19:48
vishyeverything else works the same19:48
vladimir3pvishy: today config of br100 on CloudCtr/networking is slightly different from br100 on other nodes19:48
vladimir3pah, ok19:48
vishyall computes gateway for their own vms19:48
vishythat way there is no spof for network19:48
vishyin fact, in my current testing I'm running all services on all hosts19:49
vladimir3pvishy: got you. in this case it is not really HA, but more like a multi-node network19:49
vishyWell it is HA for the cluster19:50
vladimir3pvishy: we can probably call it HA, because failure on single node will not affect others (from netw perspective)19:50
heckjvishy: is that in trunk, or in a branch you're working on? Went to look for multi_host flag and didn't find it.19:50
vishyheckj: branch19:50
vishyproposing it for review19:50
heckjAh, grazie19:50
vishyhttps://code.launchpad.net/~vishvananda/nova/ha-net/+merge/6707819:52
vishyi think with a little tweaking to dnsmasq, you can also make all of the vms use a hardware gateway for fixed ips19:52
vishyit means floating ips and fixed ips will have asymmetric routes to the vms, but I think it will work.  Testing that on a real cluster sometime soon19:53
*** jtran has joined #openstack-dev20:06
*** dprince has quit IRC20:26
*** jtran has quit IRC20:28
*** winston-d has quit IRC20:37
*** lorin1 has quit IRC21:04
*** mrmartin has quit IRC21:18
*** kbringard has quit IRC21:35
*** bcwaldon has quit IRC21:45
*** bcwaldon has joined #openstack-dev21:47
*** bcwaldon has quit IRC21:52
heckjvishy: I'm being dense. Where is the code assigning an IP address per network host into the database for each network?22:00
heckjvishy: nevermind. Just had to ask the question to see it22:01
*** nati has joined #openstack-dev22:28
jaypipesmtaylor: ping22:28
devcamcarcan anyone provide details about the current level of keystone integration into nova?22:30
*** markvoelker has quit IRC22:32
vishyheckj: you got it?22:33
*** jaypipes has quit IRC22:33
vishydevcamcar: the only integration is the middleware at the moment22:33
vishywhich just automatically creates keystone users in nova22:33
devcamcarvishy: i'm basically running trunk right now just trying to get up to speed on this stuff22:33
devcamcarvishy: is it even possible to add projects and users with nova-manage right now?22:34
*** jkoelker has quit IRC22:34
vishyno22:36
vishywell yes if you don't use keystone22:36
vishywith keystone you add them via keystone22:36
vishythen the middleware automatically creates them in nova22:36
devcamcarvishy: using your latest nova.sh, what does this mean: echo 'no openstack cli automation yet'22:37
vishyuh...22:37
vishyyou meant he cloudbuilders one?22:37
heckjvishy: yeah, thanks - just took soem time to read through your ha-net branch and figured out what all it was doing. Got lost a few times on the way22:37
devcamcarvishy: yea22:37
vishydevcamcar: I think it is because we removed the rc exporting and stuff22:38
vishyheckj: could probably use a little cleanup and refactoring.  I was just trying to make it work first of all22:39
heckjvishy: more like I'm just not familiar with all the twisty passages in that code22:39
vishyheckj: this is one of the issues with adding new features but trying not to break the existing usage.22:40
vishyheckj: it started out pretty clean and simple (well as clean as simple as networking can be, which is pretty dirty and complicated :) )22:40
*** jaypipes has joined #openstack-dev22:45
*** AhmedSoliman has joined #openstack-dev22:47
*** jaypipes has quit IRC22:51
*** lorin1 has joined #openstack-dev22:52
*** nati has quit IRC22:58
*** nati has joined #openstack-dev22:58
*** jaypipes has joined #openstack-dev23:01
*** Vasichkin has quit IRC23:19
*** AhmedSoliman has quit IRC23:21
*** nati has quit IRC23:24
*** deshantm_laptop has quit IRC23:26

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!