Friday, 2012-01-20

*** adjohn has joined #openstack-dev00:00
*** _adjohn has quit IRC00:00
comstudvishy: i have a client to communicate with the guest agent that does DH without m2crypto or any crypto modules.  If it's important to remove it from nova, I can prop something00:01
*** mikeyp has joined #openstack-dev00:02
*** dtroyer has quit IRC00:03
*** jeffjapan has joined #openstack-dev00:21
openstackgerritBrian Waldon proposed a change to openstack/glance: Add policy checking for basic image operations  https://review.openstack.org/313000:23
openstackgerritsleepsonthefloor proposed a change to openstack-dev/devstack: Add nova's new vnc support to devstack  https://review.openstack.org/319500:24
*** bencherian has joined #openstack-dev00:25
*** sdake has quit IRC00:25
*** sdake has joined #openstack-dev00:26
*** bcwaldon_ has joined #openstack-dev00:31
*** bcwaldon has quit IRC00:31
*** bcwaldon_ is now known as bcwaldon00:31
*** CarlosM has quit IRC00:32
*** lloydde has quit IRC00:37
*** deshantm has quit IRC00:50
*** shevek_ has joined #openstack-dev00:53
*** bengrue has quit IRC01:00
*** vladimir3p has quit IRC01:02
*** vladimir3p has joined #openstack-dev01:08
*** vladimir3p has quit IRC01:09
*** ayoung has quit IRC01:14
*** jog0 has left #openstack-dev01:15
*** ayoung has joined #openstack-dev01:18
*** jakedahn has quit IRC01:18
*** bencherian has quit IRC01:21
*** sleepsonthefloo has quit IRC01:24
*** dwalleck_nova has joined #openstack-dev01:25
*** dtroyer has joined #openstack-dev01:26
*** pixelbeat has quit IRC01:26
*** lloydde has joined #openstack-dev01:30
*** zns has joined #openstack-dev01:30
*** reed has quit IRC01:34
openstackgerritVish Ishaya proposed a change to openstack/nova: Create nova cert extension for x509 support  https://review.openstack.org/319901:38
openstackgerritVish Ishaya proposed a change to openstack/nova: Adds extension for retrieving certificates  https://review.openstack.org/320001:38
openstackgerritA change to openstack/nova has been rejected: Adds extension for retrieving certificates  https://review.openstack.org/320001:39
openstackgerritVish Ishaya proposed a change to openstack-dev/devstack: Add cert worker to devstack  https://review.openstack.org/319401:40
vishysmoser: got it euca-upload-bundle working again with the above ^^01:41
vishysmoser: once we have it all in, we can add a button to dashboard allowing people to download their euca credentials01:42
openstackgerritVerification of a change to openstack/keystone failed: Fix LDAP Schema Syntax (bug 904380)  https://review.openstack.org/314001:42
uvirtbotLaunchpad bug 904380 in keystone ""Duplicate option" error when adding the LDAP schema to OpenLDAP" [Medium,Incomplete] https://launchpad.net/bugs/90438001:42
smoservishy, woot!01:43
*** andrewbogott has quit IRC01:43
*** crobinso has joined #openstack-dev01:43
openstackgerritVerification of a change to openstack/keystone failed: Bug #916199: keystone-manage service list fails with AttributeError on Service.description  https://review.openstack.org/304701:52
uvirtbotLaunchpad bug 916199 in keystone "keystone-manage service list fails with AttributeError on Service.description" [Undecided,In progress] https://launchpad.net/bugs/91619901:52
*** lloydde has quit IRC01:52
*** dtroyer has quit IRC01:53
*** dtroyer has joined #openstack-dev01:53
*** dwalleck_nova has quit IRC01:59
*** lloydde has joined #openstack-dev01:59
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Pre-staging pip requires  https://review.openstack.org/320101:59
*** maplebed has quit IRC02:00
*** CarlosM has joined #openstack-dev02:02
znsttx, mtaylor, jeblair: anyone here? Anyone that can help with the OpenStack Jenkins servers?02:02
*** CarlosM1 has joined #openstack-dev02:03
*** CarlosM has quit IRC02:06
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Fixes 918535: time not properly parsed in auth_token middleware  https://review.openstack.org/318502:11
*** dwalleck_nova has joined #openstack-dev02:16
*** jdurgin has quit IRC02:17
*** misheska has quit IRC02:21
*** bengrue has joined #openstack-dev02:24
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Prestage fix - fixed requirement name; python-dateutil, not dateutil  https://review.openstack.org/320302:24
*** dwalleck_nova has quit IRC02:25
*** davlap has joined #openstack-dev02:27
*** davlap has quit IRC02:28
openstackgerritVerification of a change to openstack/keystone failed: Fixes 918535: time not properly parsed in auth_token middleware  https://review.openstack.org/318502:30
*** CarlosM1 has quit IRC02:33
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Fixes 918535: time not properly parsed in auth_token middleware  https://review.openstack.org/318502:38
*** Lumiere has quit IRC02:38
*** Lumiere has joined #openstack-dev02:39
openstackgerritVerification of a change to openstack/keystone failed: Prestage fix - fixed requirement name; python-dateutil, not dateutil  https://review.openstack.org/320302:39
*** zns has quit IRC02:41
*** zns has joined #openstack-dev02:41
*** Ryan_Lane has quit IRC02:47
*** gyee has quit IRC02:47
*** hugokuo has joined #openstack-dev02:48
*** rajaram has joined #openstack-dev02:53
*** crobinso has quit IRC02:56
*** adjohn has quit IRC03:00
*** shevek_ has quit IRC03:07
mtaylorzns: sorry - just got back online. looking now03:16
openstackgerritVerification of a change to openstack/keystone failed: Fixes 918535: time not properly parsed in auth_token middleware  https://review.openstack.org/318503:20
znsmtaylor: np. thanks for looking.03:21
znsjust would like to get this fixed (or have a workaround) before we go into the weekend to get these in for next week.03:22
openstackgerritChuck Short proposed a change to openstack/nova: Fixes LP: #919034  https://review.openstack.org/320403:31
mtaylorzns: ++03:33
mtaylorzns: still trying to figure out why it's borking - I've put in some sleeps to see if it's a concurrency issue03:33
mtaylorzns: looks like it's a thread pool issue ... the sleeps I put in shoud alleviate it for now, we'll get the config fixed asap03:38
znsmtaylor: tx. I'll push a few in now and see how it goes...03:38
mtaylorzns: thanks!03:38
mtaylorzns: and sorry it's been kicking you today03:39
*** Ryan_Lane has joined #openstack-dev03:42
zaitcevI have a silly question, guys. How is this made:  http://launchpad.net/glance/diablo/2011.3.1/+download/glance-2011.3.1.tar.gz03:44
*** andrewsmedina has joined #openstack-dev03:45
zaitcevFor example, in typical projects with GNU toolchain and autoconf, one runs "make dist" and this produces the tarball. And in our case?03:45
zaitcevDoes setuptools do it, and it yes, how?03:47
*** andrewsmedina has quit IRC03:47
*** dolphm has joined #openstack-dev03:48
openstackgerritVerification of a change to openstack/keystone failed: Fixes 918535: time not properly parsed in auth_token middleware  https://review.openstack.org/318503:48
*** Ryan_Lane1 has joined #openstack-dev03:50
*** mdomsch has joined #openstack-dev03:51
znsmtaylor: still happening :-( https://jenkins.openstack.org/job/gate-keystone-unittests/280/console03:52
mtaylorzns: that makes me sad - but thanks03:52
*** Ryan_Lane has quit IRC03:54
openstackgerritVerification of a change to openstack/keystone failed: fix bug lp:843064  https://review.openstack.org/283503:58
*** jog0 has joined #openstack-dev04:03
*** adjohn has joined #openstack-dev04:03
mtaylorzns: ok. the workaround I put in was, well, not a good one. :) according to the thread I emailed you, it's potentially an https vs. ssh behavior issue, combined with a queue length issue04:05
*** dwalleck_nova has joined #openstack-dev04:05
mtaylorzns: for now, we've set jenkins to use ssh rather than https to pull the changes, so that at least we won't get disconnected quickly (which the https handler is doing currently0-04:06
*** jog0 has quit IRC04:06
mtaylorzns: we're also looking at gerrit tuning parameters to help deal with the internal operation queue04:06
znsmtaylor: OK. Will try again.04:15
mtaylorzns: I resubmitted that one change04:15
mtaylorzns: we've isolated the cause - mainly working on solid solutions long term atm04:15
openstackgerritVerification of a change to openstack/keystone failed: fix bug lp:843064  https://review.openstack.org/283504:16
zaitcevAaaw screw it all. I'll just run diff -ur -X dontdiff ../rpms/BUILD/glance-2011.3 glance-wk, then apply as a patch with rpmbuild, FTW.04:16
mtaylorzaitcev: sorry - didn't see your question before04:17
mtaylorzaitcev: the command is "python setup.py sdist"04:17
mtaylorzaitcev: and then the output goes in to the dist dir04:18
mtaylorzaitcev: as a tarball04:18
zaitcevmtaylor: thanks!04:18
znsmtaylor: can you bump the timeout up to 15 minutes for https://jenkins.openstack.org/job/gate-keystone-unittests/configure?04:20
mtaylorzns: I can - are we hitting it?04:22
mtaylorzns: AH - I se it04:22
mtaylorzns: done04:23
mtaylorzns: and re-triggered04:23
znsmtaylor: we'll put some focus on speeding things up once we're done getting features in for E3...04:23
znstx04:23
znsmtaylor: dunno if I missed your response earlier. Is there a way to retrigger one failed job and pass the review or do we have to go back and re-approve in Gerrit?04:24
*** dolphm has quit IRC04:25
mtaylorzns: right now re-approve is the easiest way - I need to get a good way to give approvers re-trigger rights directly in jenkins04:25
znsok04:25
openstackgerritVerification of a change to openstack/keystone failed: Fixes 918535: time not properly parsed in auth_token middleware  https://review.openstack.org/318504:27
*** dolphm has joined #openstack-dev04:31
*** sleepsonthefloo has joined #openstack-dev04:32
*** andrewsmedina has joined #openstack-dev04:34
*** dolphm has quit IRC04:50
openstackgerritJames E. Blair proposed a change to openstack/openstack-ci-puppet: Tune gerrit parameters.  https://review.openstack.org/320604:50
jeblairmtaylor: ^04:50
mtaylorjeblair: thanks!04:51
*** shevek_ has joined #openstack-dev04:52
*** andrewsmedina has quit IRC04:52
vishycomstud: ping04:57
comstudvishy: pong04:58
vishycomstud: hey, we are hacking on scheduler stuff, making some new filters04:58
comstudvishy: Ok.04:58
vishycomstud: unfortunately we have no context in the filter04:58
vishycomstud: so I can't do special filtering for admins04:58
comstudvishy: I do have some other minor changes coming in an hour or 204:58
vishycomstud: do you think I should pass the context?04:58
comstudvishy: Ah, perhaps store it in HostState?04:59
comstudin my private branch, I add other things like 'project_id'04:59
comstudbut wasn't sure that was useful for trunk.. maybe it is04:59
vishycomstud: it really is part of the schedule request04:59
vishyI'm worried about shared state04:59
comstudpassing as an explicit argument makes sense to me then05:00
vishyis there some object that is unique to the schedule request?05:00
vishythat I can store it in?05:00
comstudfilter_properties05:00
comstudif you look at distributed scheduler05:00
comstudlook at what we build right now for filter_properties05:00
comstudyou probably want to do something similar05:00
comstudyou could add context or project_id in there05:00
comstudor whatever you need05:00
comstudthat gets passed all of the way down to the filters05:01
vishycomstud: good idea, I will pass it in properties05:02
comstudthat's essentially its purpose05:02
comstudbtw, i have a patch coming that'll touch things slightly05:02
comstud'service' is not set with HostState and it's needed05:02
comstudi'm moving service_is_up() from driver.Scheduler into utils05:02
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Fixes 918535: time not properly parsed in auth_token middleware  https://review.openstack.org/318505:03
comstudbecause ec2 API essentially does the same check05:03
comstudand we need to be able to use service_is_up in the filters.05:03
comstudi'm working on the tests right now, then it'll be propped05:03
_0x44https://gist.github.com/c25ccfa2eea0418b46f705:11
*** jog0 has joined #openstack-dev05:11
*** dwalleck_nova has quit IRC05:14
openstackgerritdeepak garg proposed a change to openstack/nova: bp/xenapi-provider-firewall and bug/915403  https://review.openstack.org/320705:15
vishycomstud: cool05:16
jog0comstud, Vishy tells me you have been working on the scheduler05:16
comstudjog0: yep05:16
vishycomstud, all: here is where I am so far https://github.com/vishvananda/nova/compare/master...scheduler-clean05:17
vishyadding an availability zone filter next05:17
jog0whats the logic behind allowing the filters (default_host_filters flag) being overridden by a scheduler?05:17
openstackjenkinsProject nova-docs build #1986: SUCCESS in 2 min 54 sec: https://jenkins.openstack.org/job/nova-docs/1986/05:18
openstackjenkinsjogo: aws/ec2 api validation05:18
comstudmissing 'context' added to 'def filter_properties()' in dist scheduler05:19
comstudbut that makes sense05:19
jog0instead of just having the chosen filters set by a flag (and resulting in it being set in nova.conf05:19
jog0instead of hiding what filters are being used inside of the scheduler05:19
*** novas0x2a|laptop has quit IRC05:20
comstudjog0: We're going to want the ability to be able to modify filters and rules and weights and so forth without having to restart the service...  there's a json options file that's currently unused.  i suspect we'll want to use that to add support to be able to specify filter rules, etc, at some point.  You probably notice we're not using the ability to override the default rules right now05:20
*** novas0x2a|laptop has joined #openstack-dev05:20
comstudjog0: That sorta lives because at one point we might want filters to come in with a build request...05:21
vishycomstud: where in filter_properties might i find instance parameters?05:21
comstudperhaps in a bursting architecture05:21
vishylike which availability zone was specified?05:21
comstudvishy: They'll need added05:21
comstudrather than shove a bunch of stuff in there, I left it mostly empty for now in dist scheduler05:22
comstudin the dist scheduler...05:22
vishycomstud: it doesn't pass in everything from the compute create command?05:22
vishylike instance_opts dict?05:22
comstudoh05:23
comstudnevermind, it's there05:23
jog0comstud, thanks so its fur the future05:23
comstudrequest_spec['instance_properties']05:23
vishyok cool05:23
vishycomstud: and stuff from the services table is in host_state.service?05:23
comstudi suppose that gives you the project_id too05:23
comstudvishy: It will be, yes05:23
comstudalmost done with that05:24
vishyseems like we might as well pass the entire request_spec into the filter05:25
vishybut for now I will add availability_zone from it manually05:25
comstudi thought we did05:25
comstudmaybe not05:25
comstudi guess not05:25
*** jog0 has quit IRC05:25
*** jog0 has joined #openstack-dev05:26
comstudi agree with adding it05:26
*** jog0_ has joined #openstack-dev05:27
*** jog0 has quit IRC05:27
*** jog0_ is now known as jog005:27
vishyshould i just do a merge? or stick it in filter_properties['request_spec'] ?05:27
comstudi would put it as filter_properties['request_spec']05:27
vishyk05:28
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Implemented bp keystone-manage2  https://review.openstack.org/312305:29
*** novas0x2a|laptop has quit IRC05:31
comstudthere's a bug in the json filter with 'not'..  just going to ignore it05:33
openstackgerritChris Behrens proposed a change to openstack/nova: scheduler host_manager needs service for filters  https://review.openstack.org/320805:38
*** zns1 has joined #openstack-dev05:40
*** jog0 has left #openstack-dev05:41
*** jog0 has joined #openstack-dev05:41
*** zns has quit IRC05:42
openstackgerritChris Behrens proposed a change to openstack/nova: scheduler host_manager needs service for filters  https://review.openstack.org/320805:44
vishycomstud: nice looks good05:45
vishycomstud: my az filter is here: https://github.com/vishvananda/nova/commit/6ee798c1301bc231cac09681188cf966c8c2696805:45
comstudstill cleaning up stuff i see in the diff05:46
openstackgerritChris Behrens proposed a change to openstack/nova: scheduler host_manager needs service for filters  https://review.openstack.org/320805:46
comstudalright05:47
comstudthat should do it05:47
comstuddangit, left an unused import05:47
*** jaypipes-afk has quit IRC05:55
*** jaypipes-afk has joined #openstack-dev05:55
comstudi need to get my scheduler refactor branch up too05:57
comstudscheduler tests take too long05:57
comstuder05:57
comstudscheduler unit tests05:57
comstudbranch05:57
comstudcuts from 30-40s -> 3s05:57
comstudor something.05:58
openstackgerritjustinsb proposed a change to openstack/nova: Support filter based on CPU core (over)allocation  https://review.openstack.org/320905:58
_0x44vishy: https://gist.github.com/c25ccfa2eea0418b46f705:58
comstudah, Bro filters.05:59
openstackgerritChris Behrens proposed a change to openstack/nova: scheduler host_manager needs service for filters  https://review.openstack.org/320806:00
vishyhehe06:00
comstud_0x44, vishy: if you guys can take 5 minutes to review ^^06:00
comstudthen you can merge06:00
bcwaldonno06:00
comstudor waldon06:00
bcwaldonnot a chance06:00
comstudhe doesn't do anything06:00
comstudcome on man06:00
comstud<306:00
openstackgerritChris Behrens proposed a change to openstack/nova: scheduler host_manager needs service for filters  https://review.openstack.org/320806:02
comstudthe longer you guys wait, the more i change it.06:02
_0x44Dammit, stop doing that.06:03
comstudi'm done06:03
_0x44I had just hit the review button06:03
comstudyeah06:03
comstudit's funny06:03
comstudi got an email about a comment you made06:03
comstudthat was blank06:04
comstudand i look at the review and it's not there06:04
vishydammit comstud06:04
comstudi re-added a test i accidentally removed.. sue me06:05
comstud:)06:05
comstudthnx!06:05
openstackgerritZhongyue Luo proposed a change to openstack/nova: nova flags list tool  https://review.openstack.org/321006:12
*** Ryan_Lane1 has quit IRC06:12
comstuddropping off for a bit06:13
comstudbbiab, you kids have fun.06:13
openstackgerritJoe Gordon proposed a change to openstack/nova: Pull out ram_filter into a separate filter  https://review.openstack.org/321106:18
*** zaitcev has quit IRC06:19
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Implemented bp keystone-manage2  https://review.openstack.org/312306:20
openstackgerritChristopher MacGown proposed a change to openstack/nova: Add simple affinity filters, bro  https://review.openstack.org/321206:20
openstackgerritChristopher MacGown proposed a change to openstack/nova: Add simple affinity filters, bro  https://review.openstack.org/321206:23
comstudi'm really not sure I can approve filters with 'Bro' in them.06:23
openstackgerritVerification of a change to openstack/nova failed: scheduler host_manager needs service for filters  https://review.openstack.org/320806:25
comstudwhhat06:25
comstuddev stack, come on06:25
comstudBuild timed out (after 20 minutes). Marking the build as failed.06:27
comstudhmm.06:27
*** sleepsonthefloo has quit IRC06:30
openstackgerritChristopher MacGown proposed a change to openstack/nova: Add simple affinity filters, bro  https://review.openstack.org/321206:31
comstudvishy: Is there any reason checking service['disabled'] in simple scheduler would cause devstack to fail?06:31
vishycomstud: hmm, perhaps06:32
comstudvishy: Why would you have a service set to disabled?06:32
comstudor is it somehow NULL in the db?06:32
vishycomstud: depends on if they start disabled by default06:32
vishycomstud: there is a flag iirc06:32
comstudhm i don't think they start disabled06:32
vishycomstud: oh06:32
vishycomstud: simple scheduler already checked the disabled flag06:33
vishycomstud: i think06:33
comstudnope06:33
comstudit checked service_is_up()06:33
vishycomstud: possible it is running before report_state has updated stuff?06:33
comstudwhich only checks the down_time06:33
comstudthis comes from the DB06:33
comstudservices table06:33
comstuddb.service_get*06:34
vishycomstud: disabled == 0 for all of mine06:34
vishyin devstack06:34
comstudthen that should be okay06:34
comstud83             if utils.service_is_up(service) and not service['disabled']: 84                 return service['host']06:35
comstudi added that 'disabled' check there06:35
comstudso that should still be true06:35
comstudso, i see no other reason why devstack would fail with a build timeout06:35
comstudunless it's an environmental issue06:35
comstudapparently I need to start using devstack06:36
comstudi'm going to try pushing this again to see if it was transient06:37
*** rmkdroid has joined #openstack-dev06:39
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Fixed PEP8 violations and disallowed them  https://review.openstack.org/318906:39
openstackgerritjustinsb proposed a change to openstack/nova: Support filter based on CPU core (over)allocation  https://review.openstack.org/320906:47
openstackgerritVerification of a change to openstack/nova failed: scheduler host_manager needs service for filters  https://review.openstack.org/320806:58
vishyerror: RPC failed; result=22, HTTP code = 50306:58
vishycomstud: ^^06:58
comstudwhat is RPC in that case?06:58
openstackgerritBrian Waldon proposed a change to openstack/python-novaclient: Match create_image on server object and manager  https://review.openstack.org/321307:00
vishyit is gerrit failing to download your changeset...07:01
vishy:o07:01
comstudinteresting07:01
comstudi saw the git cmd right before it07:01
comstudbut wasn't sure07:01
*** Ryan_Lane has joined #openstack-dev07:02
vishyat least, that is how i read it07:03
comstudwell, that puts a cramp in the hackathon!07:03
vishycomstud: got my az filter working07:04
comstudgreat!07:04
vishywe are working on pulling all of the checks into compute into separate filters07:04
vishythe ram filter just bit me in the ass07:04
vishywould be nice to be able to turn it off07:04
comstudyou could separate it into its own filter class07:05
vishycomstud: yup that is what we are doing07:05
comstudperhaps we should bea ble to list individual methods to run07:05
comstudinstead of classes07:05
comstudso you don't have to have a million classes07:05
vishycomstud: interesting thought.  I don't mind the class based version too much right now07:06
comstudgo with it for now07:06
vishymtaylor, jeblair: either of you here?07:06
comstudi'm curious what case you don't want to check ram07:06
comstud?07:06
comstudi can think of overcommiting as being desired on an appropriate hypervisor that supports it07:07
vishymy devstack vm doesn't have enough free ram to allocate 51207:07
vishywhich means i can't test a vm launch07:07
vishyso basically just turning it off for dev...07:07
comstudahhh07:08
comstudyou could just set the compute_node table appropriately07:08
vishycomstud: fetch worked this time so I would expect your branch to merge07:08
comstudok07:08
comstudgotta drop off07:09
comstudhot tub time07:09
* comstud & bbiab07:09
*** hugokuo has quit IRC07:14
*** adjohn has quit IRC07:16
*** lloydde has quit IRC07:23
jog0heres an early version of our boto/EC2  stress tester for nova https://github.com/cloudscaling/tarkin07:24
*** anotherjesse has quit IRC07:24
* ttx yawns07:25
openstackgerritVish Ishaya proposed a change to openstack/nova: Adds Availability Zone Filter  https://review.openstack.org/321407:30
*** cp16net_ has joined #openstack-dev07:33
openstackjenkinsProject nova-docs build #1987: SUCCESS in 2 min 37 sec: https://jenkins.openstack.org/job/nova-docs/1987/07:33
openstackjenkinsChris Behrens: scheduler host_manager needs service for filters07:33
*** LinuxJedi has joined #openstack-dev07:34
*** cp16net has quit IRC07:36
openstackgerritChristopher MacGown proposed a change to openstack/nova: Add simple affinity filters, bro Update the filter so that context is part of the filter_properties, bro. Add todo to change instance_id get when filter_properties is solidified  https://review.openstack.org/321507:36
*** jog0 has quit IRC07:36
*** Ryan_Lane has quit IRC07:48
*** bepernoot has joined #openstack-dev07:56
*** bepernoot has joined #openstack-dev07:56
*** n0ano has quit IRC07:58
*** jog0 has joined #openstack-dev07:59
*** sdake has quit IRC08:00
*** jog0 has quit IRC08:00
*** jog0 has joined #openstack-dev08:10
*** rmkdroid has quit IRC08:14
*** reidrac has joined #openstack-dev08:17
*** jog0 has left #openstack-dev08:20
*** rmkdroid has joined #openstack-dev08:20
*** corrigac has joined #openstack-dev08:31
openstackgerritGabriel Hurley proposed a change to openstack/horizon: Auto-remove auto-generated .rst files for deleted .py files.  https://review.openstack.org/321608:33
openstackgerritGabriel Hurley proposed a change to openstack/horizon: Added a contributing guide to the Horizon docs.  https://review.openstack.org/321708:33
*** ccorrigan has quit IRC08:34
openstackgerritGabriel Hurley proposed a change to openstack/horizon: Tooltip implementation cleanup.  https://review.openstack.org/321808:37
openstackgerritHengqing Hu proposed a change to openstack/nova: Respect availability_zone in nova-volume  https://review.openstack.org/295608:50
*** pixelbeat has joined #openstack-dev08:51
openstackgerritJoe Gordon proposed a change to openstack/nova: Add HACKING compliance testing to run_test.sh  https://review.openstack.org/321908:52
openstackgerritVish Ishaya proposed a change to openstack/nova: Adds Availability Zone Filter  https://review.openstack.org/321408:57
vishycomstud: did we ever fix schedule_start_instance ?08:59
vishycomstud: I'm still not sure why it would need to go through the scheduler at all08:59
comstudvishy: Because the instance has already been built09:02
comstudit's just shut down09:02
comstudand lives on a spefific host09:03
comstudAlthough i guess that's not quite true.09:03
comstudhmm09:03
*** mikal has quit IRC09:03
comstudthe host must still be assigned, even though it's destroyed from virt layer09:03
comstudwhich means we do account for its resources when scheduling09:04
comstudand starting it back up on the same host is ok09:04
comstudi think it could make sense to completely re-schedule it09:05
comstudthough it doesn't appear necessary right now09:05
*** mikal has joined #openstack-dev09:07
comstudlooks like we never unassign instance['host']09:11
comstudafaict09:11
comstud(even for deletes, which I guess can be useful for debugging)09:12
*** mikal has quit IRC09:13
*** jeffjapan has quit IRC09:13
*** Mandell has quit IRC09:14
*** derekh has joined #openstack-dev09:15
*** mikal has joined #openstack-dev09:17
comstudvishy: ^09:17
*** mikal has quit IRC09:22
*** mikal has joined #openstack-dev09:26
*** mikal has quit IRC09:32
*** mikal has joined #openstack-dev09:36
*** rmkdroid has quit IRC09:39
*** maploin has joined #openstack-dev09:40
*** maploin has quit IRC09:40
*** maploin has joined #openstack-dev09:40
*** darraghb has joined #openstack-dev09:52
*** rajaram has left #openstack-dev09:54
*** rajaram has joined #openstack-dev09:55
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Handle EC2 Credentials on /tokens  https://review.openstack.org/322010:13
openstackgerritThierry Carrez proposed a change to openstack/nova: Add a specific filter for kill commands  https://review.openstack.org/314210:53
openstackgerritkavan-patil proposed a change to openstack/tempest: Added Keypair extension (os-keypairs) client and tests LP#900139  https://review.openstack.org/317911:09
*** bepernoot has quit IRC11:12
*** Tribaal has joined #openstack-dev11:20
*** tryggvil_ has joined #openstack-dev11:35
*** bsza has joined #openstack-dev11:44
*** markvoelker has joined #openstack-dev12:01
openstackgerritJenkins proposed a change to openstack/nova: Imported Translations from Launchpad  https://review.openstack.org/322112:33
openstackgerritRajaram Mallya proposed a change to openstack/melange: fixes bug 919055 allowing interfaces to be retrieved without device id  https://review.openstack.org/322212:48
uvirtbotLaunchpad bug 919055 in melange "exception on interface create" [Medium,New] https://launchpad.net/bugs/91905512:48
*** zigo has joined #openstack-dev12:50
openstackgerritRajaram Mallya proposed a change to openstack/melange: fixes bug 919155 by tracking deallocated macs in the allocatable_macs table  https://review.openstack.org/322313:19
uvirtbotLaunchpad bug 919155 in melange "mac addressess are not being reallocated" [Medium,New] https://launchpad.net/bugs/91915513:19
*** rajaram has quit IRC13:19
*** misheska has joined #openstack-dev13:22
openstackgerritSandy Walsh proposed a change to openstack/nova: ComputeNode Capacity support  https://review.openstack.org/246013:47
*** rods has joined #openstack-dev13:53
*** rods has quit IRC14:01
*** dprince has joined #openstack-dev14:01
*** rods has joined #openstack-dev14:02
*** sdake has joined #openstack-dev14:02
smoseranyone know where this thread ended up: http://www.mail-archive.com/openstack@lists.launchpad.net/msg06148.html14:16
smoseri didn't see a clear conclusion unfortunately.14:16
*** lts has joined #openstack-dev14:21
*** misheska has quit IRC14:34
*** rajaram has joined #openstack-dev14:37
*** betodalas_ has joined #openstack-dev14:38
betodalas_Hello all, does anybody have installed Windows in Xen with Openstack?14:39
*** kbringard has joined #openstack-dev14:40
*** jaypipes-afk is now known as jaypipes14:42
betodalas_Hello14:54
*** sgd has joined #openstack-dev14:56
ttxsmoser: let me see14:58
ttxsmoser: ISTR you all violently agreed, and just waited for someone to actually do the work ? Maybe vishy has another conclusion.15:00
ttxit was a bit derailed by the DHCP vs. stupid company policies discussion.15:01
smoseryeah, so is anyone working on that ?15:02
smoseri'd like to make cloud-init do whatever it is its supposed to do15:02
smoserbut i'm not sure what that is15:02
ttxsmoser: not that I know of. You should confirm with Vish15:03
smoservishy,15:03
*** benner has quit IRC15:05
*** benner has joined #openstack-dev15:06
*** dtroyer has quit IRC15:06
smoserjaypipes, around ?15:13
jaypipessmoser: briefly before I run and get coffee :) whatup?15:13
smoserjaypipes, wanted to talk about the "glance.ubuntu.com" thingy15:14
smoseryou can get coffee and ping me back15:14
jaypipessmoser: :) np!15:14
jaypipessmoser: how about giving me a call around 11:15? I'll /query you my cell15:15
smoserk15:16
*** ahale has quit IRC15:17
*** CarlosM has joined #openstack-dev15:20
*** dtroyer has joined #openstack-dev15:20
*** ahale has joined #openstack-dev15:23
*** zzed has joined #openstack-dev15:23
*** rods has quit IRC15:24
openstackgerritDolph Mathews proposed a change to openstack/keystone: Implemented subparsers (bp keystone-manage2)  https://review.openstack.org/322415:26
*** zns has joined #openstack-dev15:27
*** zns1 has quit IRC15:30
*** zns has quit IRC15:30
*** sgd has quit IRC15:32
*** zns has joined #openstack-dev15:33
*** andrewsmedina has joined #openstack-dev15:41
*** dubsquared has joined #openstack-dev15:46
openstackgerritDan Prince proposed a change to openstack/glance: Set url's on AuthBadRequest exceptions.  https://review.openstack.org/322516:17
openstackgerritTres Henry proposed a change to openstack/horizon: Adds ID to flavors list.  https://review.openstack.org/322616:18
vishycomstud: that we don't need to reschedule and can just go directly to the host16:19
vishycomstud: but we don't16:19
vishycomstud: 935                  FLAGS.scheduler_topic,16:19
vishy 936                  {"method": "start_instance",16:19
vishycomstud: so sounds like that is a bug16:19
vishysmoser: let me ask jesse about the disk config stuff16:20
vishysmoser: I will get back to you later16:20
betodalas_Hello all, does anybody have installed Windows in Xen with Openstack?16:21
*** cp16net has joined #openstack-dev16:22
*** lloydde has joined #openstack-dev16:24
*** lloydde has quit IRC16:28
*** adjohn has joined #openstack-dev16:29
comstudvishy: oh16:29
comstudvishy: Looks like I misread the other day16:29
comstudvishy: I think I saw the FLAGS.compute_topic on 937 when I looked quickly :)16:30
_0x44comstud: What would you rather the filters be called?16:34
comstud:)16:34
comstudsomething more professional would be nice16:34
comstudbut I'd be willing to just abstain if you don't really want to change it :)16:35
_0x44comstud: They're not exposed to the requestor are they? It's just something that the ops guys would see, right?16:35
_0x44comstud: I'm not really invested in the names.16:36
comstudit's something anyone can see, because this is open source16:36
comstud:)16:36
*** rnirmal has joined #openstack-dev16:37
_0x44Bah, that's not important :)16:37
comstuddon't worry, i still love you16:38
_0x44comstud: BehrensStillLovesMeBroFilter? ;)16:45
comstudif you remove 'Bro', it's good.16:45
_0x44affinity_filter.ComeAtMeFilter is fine?16:46
*** Mandell has joined #openstack-dev16:50
*** deshantm has joined #openstack-dev16:51
*** rnirmal_ has joined #openstack-dev16:53
openstackgerritChristopher MacGown proposed a change to openstack/nova: Add simple affinity filters, bro Update the filter so that context is part of the filter_properties, bro. Add todo to change instance_id get when filter_properties is solidified  https://review.openstack.org/321516:53
johan_-_who would i talk to about problems with the devstack integration tests in jenkins?16:54
johan_-_i guess jeblair?16:55
*** markmc has quit IRC16:55
*** rnirmal has quit IRC16:55
*** rnirmal_ is now known as rnirmal16:55
openstackgerritChristopher MacGown proposed a change to openstack/nova: Add simple affinity filters, bro Update the filter so that context is part of the filter_properties, bro. Remove the Bro, get instance_id out of filter_properties['request_spec']['instance_properties']  https://review.openstack.org/321516:55
*** adjohn has quit IRC16:57
*** reidrac has quit IRC16:58
*** maploin has quit IRC16:59
*** rmkdroid has joined #openstack-dev17:00
*** zaitcev has joined #openstack-dev17:02
*** maplebed has joined #openstack-dev17:03
*** ewindisch has quit IRC17:03
openstackgerritA change to openstack/nova has been rejected: Add simple affinity filters, bro Update the filter so that context is part of the filter_properties, bro. Remove the Bro, get instance_id out of filter_properties['request_spec']['instance_properties'] Fixed whitespace.  https://review.openstack.org/321517:06
*** mikeyp has left #openstack-dev17:06
jaypipesVek: would you mind looking into this bug and providing your opinion on it? https://bugs.launchpad.net/glance/+bug/91924017:07
uvirtbotLaunchpad bug 919240 in glance "Glance API returns 401 response when disabled user's token is provided" [Undecided,New]17:07
_0x44comstud: replied17:08
openstackgerritA change to openstack/nova has been rejected: Add simple affinity filters, bro Update the filter so that context is part of the filter_properties, bro. Remove the Bro, get instance_id out of filter_properties['request_spec']['instance_properties'] Fixed whitespace.  https://review.openstack.org/321517:08
comstud_0x44: replied twice17:09
*** ewindisch has joined #openstack-dev17:10
*** deshantm_ has joined #openstack-dev17:10
_0x44comstud: replied now17:11
bcwaldonso meta17:12
*** deshantm has quit IRC17:12
comstud_0x44: Ok.  I think instance_id goes in filter_properties vs instance_properties then17:12
*** heckj has joined #openstack-dev17:13
_0x44comstud: It doesn't, it's in the instance_properties of the request_spec of the filter_properties.17:13
comstud_0x44: It doesn't exist right now, so it's not anywhere17:13
comstud_0x44: is this the instance id of the instanc ebeing scheduled?17:13
comstud_0x44: Or *another* instance?17:13
_0x44No, it's the instance_id of another instance17:13
comstud_0x44: Then it definitely doesn't belong in instance_properties17:14
comstudthat's the dict for the new instance17:14
comstudI'd add it to filter_properties17:14
comstudand I'd use 'uuid' if you're going to pass an id17:14
comstud:)17:14
*** rmkdroid has quit IRC17:14
comstudbut i can live with 'id' for now17:14
_0x44Damn, that's where it was in patchset1&2... but vishy suggested it get moved to the request_spec17:15
comstudrequest_spec should be things tied to the scheduled instance, really17:15
_0x44What's in filter_properties['request_spec']?17:15
_0x44Ok17:15
comstudthe instance_type for new instance17:15
comstudthe new instance's model (instance_properties)17:15
comstud(although the model is a dict at this point)17:16
comstudthe number of instances to build (which needs to be removed)17:16
comstudand things like that17:16
comstudhmm17:16
comstudI guess I can see it being okay to put in request_spec17:16
comstudbecause we put things like 'original_host' in there17:16
comstudfor resize17:17
_0x44I'll just put it into filter-properties for now17:17
comstudbut I'd name it something other than just "instance_id"17:17
comstudmake it clear it's for another instance17:17
_0x44"+        instance_uuid = filter_properties['affinity_instance_uuid']"17:17
comstudthat works!17:17
*** ewindisch has quit IRC17:17
*** Tribaal has quit IRC17:17
comstudmaybe we should add 'filter_properties' to the cast to the sheduler so the compute manager can populate some of it first before the scheduler does17:18
comstudi think that might make some sense17:19
_0x44I think that was part of what vishy was planning bcwaldon to do17:19
*** shevek_ has quit IRC17:19
_0x44But I only recall vishy telling bcwaldon to do everything17:19
comstudgood man17:19
comstudi could probably prop that real quick right now tho17:20
comstudto help out with this filter stuff17:20
bcwaldon_0x44: it really was on my plate, but it doesn't bother me to let someone else do it17:20
comstudgood, another thing I get to do for bcwaldon.17:20
jaypipes_0x44: nice work bro.17:20
_0x44jaypipes: Thanks bro :P17:21
jaypipespronounced "brah"17:21
comstudi was going to suggest using 'brah' :)17:21
jaypipes:)17:21
jaypipescomstud: us old fuddy-duddies may not have "gotten it" :)17:21
comstudhaha17:21
comstudtrue17:21
_0x44jaypipes: Why were you in jk0's closet?17:21
jaypipeslol17:21
bcwaldonbroseph, guys17:22
*** mdomsch has quit IRC17:22
jaypipescomstud, bcwaldon: hey, want your opinion on these bugs: https://bugs.launchpad.net/glance/+bug/919257 and https://bugs.launchpad.net/glance/+bug/91924017:22
uvirtbotLaunchpad bug 919257 in glance "Glance Add Image API returns 400 response if storage is inaccessible" [Undecided,New]17:22
jaypipescomstud, bcwaldon: not sure if I buy the 500 server return...17:23
comstud?17:23
openstackgerritChristopher MacGown proposed a change to openstack/nova: Add simple affinity filters, bro Update the filter so that context is part of the filter_properties, bro. Remove the Bro, get instance_id out of filter_properties['request_spec']['instance_properties'] Fixed whitespace.  https://review.openstack.org/321517:23
jaypipescomstud: do you think a 500 is the correct code to return there?17:23
comstudoh, missed the links17:23
comstudlooking17:23
jaypipescomstud: maybe a 413 Request Entity Too Large?17:24
jaypipesfor the first...17:24
comstudi disagree with a 500 on that first one17:24
comstudfor sure17:24
bcwaldonjaypipes: why doesn't 401 make sense for the first bug?17:25
jaypipescomstud: when I see 500, I instinctively think the server is entirely kaput.17:25
jaypipesbcwaldon: not sure about that either... :) that's why I'm asking.17:25
comstudjaypipes: exactly re: 50017:26
jaypipesbcwaldon: and I remember asking Vek about 401 vs 403 when he did that code... just can't remember what his response was17:26
jaypipescomstud: would you agree with a 413?17:26
comstudjaypipes: I'm not sure a '400' is correct response, either, though.  'Bad Request'17:26
*** rnirmal has quit IRC17:26
_0x44jaypipes: I think the first one is really two bugs. If the storage is unavailable, it should be possibly 500?17:26
jaypipes_0x44: yeah, but a small image request may succeed, which is why I think a 413 is better...17:26
jaypipes_0x44: I mean, if I try and upload a 200G image to a server with 100G left for storage, a 500 would seem wrong...17:27
comstudif anything, it should be a 503 not a 50017:27
_0x44jaypipes: That's three bugs then? Storage _unavailable_ -> Oh shit what happened? Storage full -> 413. Permissions wrong -> 50017:27
comstudif you're going with a 5xx error code17:27
jaypipescomstud: right, but the service itself is not necessarily unavailable... you could still GET or even POST with a smaller image..17:28
comstudyeah17:28
jaypipes_0x44: dealing with this one right now: https://bugs.launchpad.net/glance/+bug/91925717:28
uvirtbotLaunchpad bug 919257 in glance "Glance Add Image API returns 400 response if storage is inaccessible" [Undecided,New]17:29
comstudthat's why I don't like 5xx17:29
* jaypipes wants a way to distinguish between "you can't use this server for anything" and "this server is full"17:29
_0x44jaypipes: He's documenting two error modes there.17:30
_0x44jaypipes: Three if you're including no space left on the device.17:30
_0x44comstud: I uploaded patchset 4 to that, or should I resubmit?17:31
jaypipes_0x44: sorry, wrong bug link... https://bugs.launchpad.net/glance/+bug/91925517:31
uvirtbotLaunchpad bug 919255 in glance "Glance Add Image API returns 400 response for disk full scenario" [Medium,Triaged]17:31
jaypipescomstud: ^^17:31
comstud_0x44: I'll look...17:32
_0x44jaypipes: Do you really want to expose the storage limit to the user?17:32
jaypipes_0x44: not sure...17:33
jaypipes_0x44: this is a bit of a group brainstorming session :)17:33
*** andrewbogott has joined #openstack-dev17:35
*** andrewbogott has joined #openstack-dev17:35
*** reed has joined #openstack-dev17:35
comstudjaypipes: Well, i'm with you in that I view a 5xx as a "shit, the server is broken" situation17:36
comstudstore not available *might* fall into that, but not the others17:36
smoserjaypipes, ok...17:37
smoserhm... hld on a minute17:38
comstudmaybe '412' for store not available17:38
comstudi dunno17:38
smoseri'm waiting for utlemming to join17:39
jaypipescomstud: meh, but 412 is really about a *client* precondition has failed, not a server condition..17:39
jaypipessmoser: utlemming?17:40
_0x44jaypipes: Add a client precondition "X-SHIT-WORKS"17:40
*** eglynn_ has quit IRC17:40
Davieycomstud: 5XX doesn't always mean the server is broken.17:40
comstudclient sent the request under the assumption the store was available, but it's not?17:40
comstud:)17:40
*** eglynn_ has joined #openstack-dev17:40
*** deshantm_ is now known as deshantm17:40
comstudbut yeah, i know17:40
jaypipes_0x44: lmao17:40
smoserjaypipes, utlemming is the other "ubuntu cloud images" guy17:40
smoserie, 'smoser2'17:41
smoser:)17:41
jaypipes:)17:41
smoseror 2.017:41
comstudDaviey: Yeah, it's probably just a mindset issue for me... which I'm willing to change17:41
jaypipesDaviey: I was just remarking that a 500 specifically is something I've always considered "shit is fucked"17:41
comstudstore not available could be 'shit is fucked'17:42
jaypipesprobably a leftover from my days of having to deal with IIS...17:42
jaypipescomstud: indeed17:42
openstackgerritVerification of a change to openstack/nova failed: Remove deprecated extension code.  https://review.openstack.org/319017:42
Davieyjaypipes: 4XX = i've done something wrong, 5XX they are broken, 2XX is full of win.17:43
Daviey:)17:43
jaypipes:)17:43
kbringardlol, shit is fucked17:44
kbringardthat's the technical term?17:44
kbringard:-p17:44
*** betodalas_ has quit IRC17:45
Vekanyone looking into a devstack problem?17:45
*** bencherian_ has joined #openstack-dev17:45
DavieyVek: many people are looking into the problem that is devstack.17:46
VekHow about the specific problem that "git fetch" fails?  :P17:46
Kialli think Vek is talking about the devstack gate, and not devstack itself17:46
comstudVek: that's the one... appears transient17:46
comstudit's gerrit17:47
Vekso, retry?17:47
comstudor jenkins17:47
comstudyea17:47
*** andrea_ has quit IRC17:47
comstudi had to retry a couple times last night17:47
Vek'k.17:48
*** Tribaal has joined #openstack-dev17:48
Vekjaypipes: got a second?  Need a little more detail on 91924417:48
Vekspecifically, is the error coming from api or registry?17:48
*** utlemming has joined #openstack-dev17:49
jaypipesVek: not sure :) that's why I tagged that one with verification-needed ;)17:49
jaypipesVek: I imagine adding a test case with the invalid request body included in the bug report will lead to the predicated fail...17:50
smoserok.17:50
smoserjaypipes, now.. utlemming (aka smoser 2.0) arrives17:51
utlemminglol17:51
smoserso.. i was talking to utlemming, and if the only issue (it was my primary issue) with the public glance api server17:51
openstackgerritZiad Sawalha proposed a change to openstack/python-keystoneclient: Support for version discovery  https://review.openstack.org/264117:51
Vekjaypipes: yeah, but the registry does the json deserialize after verification of authorization17:51
smoserwas that it would not cache locally, he and i considered that we could just use a transparent (or configured on the nodes) squid proxy17:51
VekI suspect the problem is in the API17:52
*** rajaram has quit IRC17:52
*** rajaram1 has joined #openstack-dev17:52
smoserso that each node's request to glance.ubuntu.com/images (or what ever) would get proxied and downloaded and locally cached that way.17:52
jaypipessmoser: right.17:52
smoserdoes that seem like a reasonable solution?17:52
jaypipessmoser: yes. isn't that what we discussed earlier on the phone?17:52
Kiallhumm, does anyone know if there is a bug in the diablo block migration code that prevents the libvirt nwfilter file from being moved with the instance?17:53
* Vek ponders further17:53
Kiall(and deleted if its copied over manually)17:53
smoserthe only issue that i saw as that we'd need for the nodes to  be able to choose a proxy based on url i think (or some how mitigate the likelyhood that there are 2 glance servers)17:53
smoserjaypipes, i must have missed something then.17:53
smoseri'm just saying, that a simple http_proxy variable would need to be added to the nova nodes so they would proxy image downloads through something centralized.17:54
smoserbut possibly a *simple* value wouldn't be enough... they might have to know "oh, for things to that local glance server, i should get them directly, but for intarweb stuff, i need to proxy" (to avoid a local proxy of a local resource... which might be able to be resolved elsewhere).17:55
*** derekh has quit IRC17:55
jaypipessmoser: but I thought that we agreed that the nova compute nodes would *only* point to local glance nodes, and that we'd write a "uec-get-base-images" script that would pull images from glance.ubuntu.com/images and populate local glance nodes with copies of those images?17:55
smoserjaypipes, right. thats what you and i came to.17:56
jaypipessmoser: and the squid servers would be in front of glance.ubuntu.com17:56
smoserah... see i'm not explaining myself right.17:56
jaypipessorry :( I'm a bit thick.17:56
smoserthe "local cloud provider" (ie, smoser's basement) would just configure th enova nodes to do their image downloads via 'smoser-local-squidproxy:3128'17:57
smoserand then we could do the full glance server thing17:57
smoserbut the download from glance.ubutnu.com would only happen once17:58
smoserbecause squid would be caching it locally17:58
smoserwhere locally means "smoser's basement" not "the node"17:58
jaypipesI see17:58
smoserthat seemed to me to transparently solve the "I want to avoid external bandwidth usage" issue17:59
jaypipesbut why wouldn't we just modify the "uec-get-base-images" script to point to smoser-local-squidproxy:3128 instead of glance.ubuntu.com?17:59
smoserah.17:59
jaypipessmoser: not modify the script, but add a CLI option for the source ...17:59
jaypipesyou know what I mean...17:59
smoserso we could do that, yes.17:59
smoseri was thinking that with "uec-get-base-images", you'd just pull the images (from cloud-images.ubuntu.com), populate local glance, and never again need cloud-images.ubuntu.com18:00
smoser*nor* would we actually need a glance server18:00
smoseron glance.ubuntu.com18:00
openstackgerritA change to openstack/nova has been rejected: Add simple affinity filters, bro. Update the filter so that context is part of the filter_properties, bro. Changed the instance_id -> affinity_instance_uuid so it's clear  https://review.openstack.org/321518:01
jaypipessmoser: I see.18:01
smoseras we have reasonable data at http://cloud-images.ubuntu.com/query18:01
smoserie, that'd not be a glance client, just an http client.18:01
smoserbut i see how you mistook tat.18:01
jaypipessure18:01
utlemmingwhere I think having the glance server is beneficial is that it means that a cloud can consume the images as needed, instead of having to syncronize every so often18:01
*** adjohn has joined #openstack-dev18:01
jaypipesutlemming: yes18:01
smoserbut the glance.ubutnu.com has nicities18:01
kbringardjust setup torrents and write a handler for glance to connect to the swarm and pull down the images the user specifies in their script ;-)18:01
smosernice-ities ?18:01
smoseranyway.18:01
*** ewindisch has joined #openstack-dev18:01
jaypipeskbringard: yeah, yeah, we discussed that too :)18:02
utlemmingmy concern is that when we publish new images (i.e. new release or spin new images), then there will be a delta between cloud providers18:02
kbringardsorry, late to the party18:02
jaypipeskbringard: but first step is getting UEC base images into the local glance nodes as efficiently as possible :)18:02
utlemmingit would be nice to enable cloud-providers the ability to do nothing to get the latest and greatest18:02
smoserright. and the glance server, with multi-glance-server function in horizon would immediately *show* the images, although the first would be slow to boot.18:02
*** bencherian_ has quit IRC18:03
smoserthe one thing i fear in the glance.ubuntu.com server is its reliability18:03
smoserif we go down, then possibly your horizon doesn't work that well, and/or you can't boot a new image.18:03
jaypipesya18:03
utlemmingand slow to boot for the first is better than waiting for a cron job or worse, waiting for a manual sync18:03
_0x44comstud: host is an ip address, and so is h2. We build a cidr network that contains host using the cidr suffix. If h2 is in that network it returns true.18:03
smoserand the full "mirror it local" removes that.18:03
smoserso anyway...18:04
comstud_0x44: Huh.  'host' is the compute host the instance is on18:04
smoseri'll try to write this all down more clearly and send a mail18:04
comstud_0x44: Are you naming your compute hosts by IP address?18:04
jaypipessmoser: yeah, but "mirror it local" has the issue utlemming brought up about cache staleness when a new base image is pushed.18:04
comstud_0x44: Seems like a strange hostname18:04
smoserbut i wanted to get your feeling as to how absurd/reasonable it would be to have nova-compute instances proxied downloads.18:04
smoserjaypipes, absolutely.18:04
kbringardhave each glance server be a seeder… so the user specifies a torrent to import into one of their glance servers, at which point all the servers in the glance clusters, wherever they may be start distributing the image across the private "client" torrent network18:04
_0x44comstud: possibly...18:04
smoserthere are benefits to both.18:05
_0x44comstud: Can make that do a db request there, but we don't have to do a cidr lookup on h2.18:05
utlemmingjaypipes: I'm not sure I follow -- each image is named uniquely, which would prevent stale images18:05
_0x44Just get two ip addresses18:05
jaypipeskbringard: yes, that is how antonym and s1rp did it inside RAX IIRC..18:05
*** eglynn__ has joined #openstack-dev18:05
jaypipesutlemming: an image is not named uniquely, no.18:05
smoserutlemming, s/stale images/stale data/18:05
jaypipesutlemming: it has a unique ID18:05
smoserour images are named uniquely18:05
comstud0x44: I guess I just need more information on what you're trying to accomplish.  You're trying to look at the IP address assigned to the instance, no?18:05
_0x44comstud: NO.18:05
smoserwe'd populate them with a well defined (and used on EC2) naming convention18:06
comstud0x44: What's the IP address of?  compute host?18:06
_0x44comstud: It's trying to find a host that's in the same cidr range as the compute host of your affinity instance18:06
jaypipessmoser: you have to remember that once an image is in glance, it is immutable.18:06
jaypipessmoser: the only thing you can do is the following:18:06
smoserthats fine.18:06
smoserwe consider images immutable on ec218:07
jaypipessmoser: a) "tag" an image in glance.ubuntu.com with a custom property like "latest 11.10" or similar18:07
smoseri never re-publish something under the same name18:07
comstud0x44: ah ok.  then I guess if you have FLAGS.host on your compute workers set to an IP address, this would work.18:07
comstud0x44: Seems like a strange assumption for the filter, though18:07
jaypipessmoser: b) have the "uec-get-base-images" script poll the glance.ubuntu.com registry for the image IDs for images tagged with the "latest XXX" properties18:07
*** eglynn_ has quit IRC18:07
openstackgerritVerification of a change to openstack/nova failed: Remove deprecated extension code.  https://review.openstack.org/319018:08
_0x44comstud: It's _simple_...18:08
smoserjaypipes, yeah..18:08
jaypipessmoser: have that script compare some local cache of those base image IDs, and if anything changed, pull the "updated" image18:08
_0x44comstud: It's a reasonable assumption that a host on the same /28 are close to each other.18:08
smoserso one benefit of the glance.ubutnu.com is that you can then write a glance client that determines which image-id you need to launch.18:08
_0x44comstud: at least for a simple affinity scheduler18:08
comstud0x44: i don't argue the value18:09
smoserwel..18:09
smoseranyway.18:09
jaypipessmoser: I suppose you could also do that with the name of the image, like utlemming suggested, but there isn't any uniqueness enforced in the DB for name (in fact, Name can be None!)18:09
comstud0x44: I'm just saying this only works if you've set FLAGS.host on your compute instances to an IP address.18:09
comstud0x44: Which seems like a strange assumption18:09
comstud0x44: Since the default in nova for FLAGS.host is the hostname of the host... which I doubt is an IP address for 99.9% of people18:09
smoserwell, i do like the tag, it makes things easier, and i like that glance.ubuntu.com makes that easy to get a global unique glance id that you can then say "launch this"18:09
smoserwhich means the smae thing on my cloud and yours18:10
smoser(since they both know aobut glance.ubuntu.com)18:10
_0x44comstud: So are you suggesting a DNS lookup?18:11
comstud0x44: In which case, I'd say the filter doesn't belong in nova and should be packaged by whomever needs it.  I think there must be a better way to do this generically.18:11
comstud0x44: I'd love to avoid that, too! ;)18:11
comstudHm.18:11
*** Gordonz has joined #openstack-dev18:11
*** Gordonz has quit IRC18:12
*** jdurgin has joined #openstack-dev18:12
_0x44comstud: I think _an_ affinity filter better than "install on the same host" and "don't install on the same host" is useful for nova.18:13
jaypipessmoser: so, we good? got enough to move forward?18:13
smoserjaypipes, yeah, i think so.18:13
smoseri'll send a mail.18:13
*** Gordonz has joined #openstack-dev18:13
smoserso now i'm on the path of glance.ubutnuc.om18:13
kbringardsmoser: it would also allow the glance-pruner to key off of something to know if an image has been updated18:13
smoserand ii'mk going to need someone to do some horizen work18:13
smoserfor multiple glance servers in it.18:13
comstud0x44: Perhaps we can brainstorm with vish..  I know that at some point here I'm going to be adding an 'affinity ID' which would solve this18:13
_0x44comstud: This seems like the simplest way that doesn't require any assumptions about "nearness"18:13
jaypipessmoser: well, cool then :)18:13
kbringardso you don't end up with 20 iterations of the same image as it gets updated18:13
*** mjfork has quit IRC18:13
jaypipessmoser: I can do the Horizon work I think.18:14
comstud0x44: affinity ID will be a unique ID which will map to a set of hosts (or really, in our case, a zone)18:14
_0x44comstud: That requires that you expose hosts to the user.18:14
comstud0x44: If we have that, then this check is extremely simple18:14
openstackgerritZiad Sawalha proposed a change to openstack/python-keystoneclient: Support for version and extension discovery  https://review.openstack.org/264118:15
comstudHow is that any different than what you have here?18:15
comstudit's just comparing a unique ID vs a CIDR18:15
*** zns has quit IRC18:17
*** pixelbeat has quit IRC18:17
_0x44comstud: This isn't intended to be the end-all affinity filter.18:17
_0x44comstud: It's a stupid simple one that takes two instances and compares some value of their hosts that just happens to be ip addresses.18:17
comstudyeah, in your specific case18:17
comstudwhich is probably not the norm18:17
comstudin which case, it feels like it doesn't belong in nova.  it's something specific to your environment.18:18
_0x44comstud: This isn't for my use-case18:18
*** mjfork has joined #openstack-dev18:19
comstudIf it's vish's, I can discuss with him later18:19
_0x44comstud: I haven't implemented anything in nova that is specific to Piston Cloud.18:19
_0x44comstud: Actually, _everything_ I've written for OpenStack is wholly separate from Piston Cloud's needs.18:19
_0x44The use-case for that filter was, "There needs to be something more complex than the first two but not so complex that people try to use it"18:20
comstudSure, i have no worries there18:20
comstudno need to get defensive ;)18:20
_0x44No worries there, but you still assume that I'm trying to sneak code in that is only useful to my company?18:20
comstudi'm just saying that this filter would only work under a very specific configuration of nova that I suspect only .001% of the people using it would do18:21
_0x44Unless I change it so that it does a DNS lookup for things that aren't IPs, you mean.18:21
comstudso I'm trying to figure out something that satisifies the use case for more than that percentage18:21
comstud:)18:21
_0x44Which I've already suggested doing because it keeps the simplicity.18:21
_0x44And I can change the name to SimpleExpensiveAffinityFilter or something18:21
comstudi mean, a DNS query would work, as long as you have resolv.conf set up properly and you entered the hosts names in DNS18:22
comstudresolv.conf would need search domain18:22
comstudyou could also call to the compute manager and ask it for its IP address18:22
comstudwhich it could probably figure out more easily18:22
_0x44That makes sense, I'll do that.18:23
comstudi'm not sure i like either of those, but i guess they'd satisfy my concerns18:23
comstudeven if it slows the filter.18:23
comstudthen we can fix it all when there is a larger affinity solution18:24
comstudwhich is on our list18:24
_0x44Right, that was the idea.18:24
comstudyeah, i get it.  i'd have a different opinion about the current patch if FLAGS.host defaulted to the host's IP address.18:25
comstudbecause then it would work out of the box18:26
openstackgerritVerification of a change to openstack/glance failed: Swallow exception on unsupported image deletion.  https://review.openstack.org/319218:27
comstudi realize i'm being picky, but I have opinions about what should and shouldn't be in nova.  I don't think we want 1000 filters that only a small select group use...  when it can be a filter packaged separately outside of nova.18:28
*** _adjohn has joined #openstack-dev18:32
*** _adjohn has quit IRC18:33
*** adjohn has quit IRC18:33
*** adjohn has joined #openstack-dev18:33
*** rajaram1 has quit IRC18:34
*** pixelbeat has joined #openstack-dev18:35
openstackgerritDean Troyer proposed a change to openstack/nova: Fix nova-manage floating list (fixes bug 919288)  https://review.openstack.org/322718:35
uvirtbotLaunchpad bug 919288 in devstack "nova-manage floating list fails" [Undecided,New] https://launchpad.net/bugs/91928818:36
*** bencherian has joined #openstack-dev18:37
*** stuntmachine has joined #openstack-dev18:38
*** zns has joined #openstack-dev18:39
*** Ryan_Lane has joined #openstack-dev18:39
*** kyriakos has left #openstack-dev18:40
*** CarlosM has left #openstack-dev18:44
*** rbasak has quit IRC18:47
openstackjenkinsProject nova-docs build #1988: SUCCESS in 3 min 23 sec: https://jenkins.openstack.org/job/nova-docs/1988/18:49
openstackjenkinsnaveedm9: Validating image id for rebuild.18:49
*** novas0x2a|laptop has joined #openstack-dev18:50
ayoungDo we have a good example of where we have to wrap a blocking IO call to make it work with Eventlet?18:57
*** stuntmachine has quit IRC18:58
*** stuntmachine has joined #openstack-dev18:59
*** darraghb has quit IRC19:03
openstackjenkinsProject nova-docs build #1989: SUCCESS in 3 min 32 sec: https://jenkins.openstack.org/job/nova-docs/1989/19:04
openstackjenkins* Chuck Short: Drop FK constraint if it exists in migration 06419:04
openstackjenkins* Vishvananda Ishaya: Fix missing imports and bad call caught by pyflakes19:04
Kiallam I right in thinking diablo block migration does not work correctly when using keystone?19:06
*** lloydde has joined #openstack-dev19:06
*** pixelbeat has quit IRC19:08
*** rkukura has quit IRC19:16
openstackjenkinsProject nova-docs build #1990: SUCCESS in 3 min 27 sec: https://jenkins.openstack.org/job/nova-docs/1990/19:19
openstackjenkinsjason: Allow Quantum Manager to run in "Flat" mode.19:19
*** andrewsben has joined #openstack-dev19:19
*** jog0 has joined #openstack-dev19:25
*** mdomsch_ has joined #openstack-dev19:25
openstackgerritKevin L. Mitchell proposed a change to openstack/glance: Return 400 if registry returns 400.  https://review.openstack.org/322819:32
Vekjaypipes: that should fix the problem19:32
jaypipesVek: cheerio19:32
*** crobinso has joined #openstack-dev19:33
openstackjenkinsProject nova-docs build #1991: SUCCESS in 3 min 43 sec: https://jenkins.openstack.org/job/nova-docs/1991/19:34
openstackjenkinsIsaku Yamahata: nova/network: pass network_uuid to linuxnet_interface_driver and vif driver19:34
Vekcan I get mtaylor or jeblair to look at https://review.openstack.org/#change,3190 please?  devstack keeps failing to git fetch19:34
openstackgerritVerification of a change to openstack/nova failed: Remove deprecated extension code.  https://review.openstack.org/319019:37
VekOK, this time it fetched, but claims nova-api failed to start.  A failure I cannot replicate.  And of course the error messages are singularly unhelpful.19:39
openstackgerritDean Troyer proposed a change to openstack/nova: Fix nova-manage floating list (fixes bug 919288)  https://review.openstack.org/322719:41
uvirtbotLaunchpad bug 919288 in nova "nova-manage floating list fails (dup-of: 918804)" [Undecided,In progress] https://launchpad.net/bugs/91928819:41
uvirtbotLaunchpad bug 918804 in nova "'nova-manage floating list' calls undefined method 'floating_ip_get_all'" [Medium,In progress] https://launchpad.net/bugs/91880419:41
openstackgerritDean Troyer proposed a change to openstack/nova: Fix nova-manage floating list (fixes bug 919288)  https://review.openstack.org/322719:42
uvirtbotLaunchpad bug 919288 in nova "nova-manage floating list fails (dup-of: 918804)" [Undecided,In progress] https://launchpad.net/bugs/91928819:42
uvirtbotLaunchpad bug 918804 in nova "'nova-manage floating list' calls undefined method 'floating_ip_get_all'" [Medium,In progress] https://launchpad.net/bugs/91880419:42
openstackgerritZhongyue Luo proposed a change to openstack/nova: nova flags list tool  https://review.openstack.org/321019:44
*** bencherian has quit IRC19:48
jaypipesVek: you're a stubborn mule aren't ya. ;P19:49
* Vek plants his cleats19:51
jk0lol19:52
*** andrewsben has quit IRC19:53
*** adjohn has quit IRC19:53
jaypipes:)19:59
*** zzed has quit IRC20:00
*** rkukura has joined #openstack-dev20:00
*** lloydde has quit IRC20:04
*** lloydde has joined #openstack-dev20:05
openstackgerritDavid Kranz proposed a change to openstack/tempest: Don't set multiple images if image_ref_alt is the same as image_ref. Fix typo in skip_unless_addr.  https://review.openstack.org/318320:07
*** sleepsonthefloo has joined #openstack-dev20:07
adam_glooking at the glance-{registry, api}-paste.ini files for the first time... is the idea that you just specify the corresponding flavor in glance-{registry, api}.conf and not need to worry about messing around with pipeline configuration in the .ini files anymore?20:08
adam_gjaypipes: ^ ?20:08
*** stuntmachine has quit IRC20:08
jaypipesadam_g: yep.20:09
openstackgerritDavid Kranz proposed a change to openstack/tempest: Don't set multiple images if image_ref_alt is the same as image_ref. Fix typo in skip_unless_addr.  https://review.openstack.org/318320:10
jaypipesadam_g: eglynn__ is a good person to talk with about that new functionality20:10
adam_gjaypipes: ah, cool20:10
openstackgerritZhongyue Luo proposed a change to openstack/nova: nova flags list tool  https://review.openstack.org/321020:10
eglynn__adam_g: new glance functionality, or?20:10
eglynn__yep that would be jay20:10
smoseranyone have a link to how to use "config drive" ?20:11
eglynn__a-ha, I see you mean the paste config split?20:11
eglynn__that would be me ...20:11
adam_gim wondering (from a packaging POV), if it'd make sense to have a seperate place to configure keystone details/credentials.. then, the api paste flavors can be updated with package upgrades based on whats is currently supported20:12
adam_geglynn__: yeah, we're updating ubuntu packaging ATM and just ran into the split for the first time20:12
dprinceadam_g: I like the idea of that....20:12
eglynn__yeah that was the idea, to avoid the need for users to directly edit the paste config in order to select a particular pipeline20:13
adam_gi like it20:13
eglynn__(and be aware of ordering, what filters map on to whatever QoS etc.)20:13
openstackgerritZhongyue Luo proposed a change to openstack/nova: nova flags list tool  https://review.openstack.org/321020:13
dprinceeglynn: I'm a big fan of the Glance split. But taking it a step further and splitting out keystone creds might be even better.20:13
adam_geglynn__: the issue is, if i've editted the keystone credentials in those files and packaging installs a new version of glance with updated pipelines, packaging will not write the updated config.20:14
openstackgerritsleepsonthefloor proposed a change to openstack-dev/devstack: Downcase Admin user role to support nova's new policy engine  https://review.openstack.org/322920:14
dprinceeglynn/adam_g: This isn't just a glance thing though. We should do the same for nova as well.20:14
eglynn__yeah, the auth token being embedded in the paste config is not nice20:14
smoser_0x44, ? how can i use config-drive ? is it exposed at all through nova-client ?20:14
adam_gdprince: is nova-api is the only consumer of the keystone credentials currently?20:15
*** adjohn has joined #openstack-dev20:16
*** stuntmachine has joined #openstack-dev20:16
dprinceadam_g: nova-api is the only consumer of nova-api.ini.20:16
eglynn__adam_g: by consumer of keystone credentials, do you mean client of keystone to verify auth tokens?20:16
adam_geglynn__: yes. the only package that would potentially need the paste config installed20:17
dprinceadam_g: which is where the keystone creds are we are talking about. Keystone auth tokens however get passed around to other services in nova.20:17
eglynn__adam_g: glance is also a keystone client20:17
adam_gfor glance i'd think there would need to be 2 files with keysotne information, one for glance-api and one for glance-registry.20:18
eglynn__right20:18
eglynn__(that's the current setup)20:18
adam_gwhich sorta sucks, but is better than having packaging unable to keep paste deploy pipelines up to date20:18
dprinceadam_g/eglynn__: its also important to keep in mind Glance API and Glance Registry may not always run on the same node. A larger deployment will typically have many API servers for a single registry.20:20
eglynn__the pipelines are not currently sufficiently common to share across glance-api and glance-registry20:20
eglynn__(app endpoint differs)20:20
eglynn__dprince: true that20:21
adam_gdprince: right20:21
openstackgerritAnne Gentle proposed a change to openstack/openstack-manuals: Fixes build failure on epub build  https://review.openstack.org/323020:21
openstackgerritDolph Mathews proposed a change to openstack/keystone: Added Vary header to support caching (bug 913895)  https://review.openstack.org/323120:22
uvirtbotLaunchpad bug 913895 in keystone "Return HTTP Vary header" [Wishlist,Confirmed] https://launchpad.net/bugs/91389520:22
*** kbringard has quit IRC20:23
*** kbringard has joined #openstack-dev20:24
*** LinuxJedi has quit IRC20:25
*** eglynn__ has quit IRC20:29
*** eglynn__ has joined #openstack-dev20:30
*** jakedahn has joined #openstack-dev20:30
*** gregburek has joined #openstack-dev20:32
_0x44smoser: It isn't exposed through nova client20:39
smoserso in order to use i have to write a nova client ?20:40
openstackgerritDan Prince proposed a change to openstack/openstack-chef: Updates to support glance paste changes.  https://review.openstack.org/323320:41
_0x44smoser: It's exposed through the API, novaclient wasn't part of nova when I wrote the code.20:41
smoserthats fine. do you have any example code, justso i can not re-write it?20:42
*** dprince has quit IRC20:42
_0x44curl -i -X POST -d '{"server" : {…, "config_drive":"true"}}' host -H 'X-Auth-token: <t>'20:44
_0x44curl -i -X POST -d '{"server" : {…, "config_drive":"image-ref"}}' …20:44
*** lloydde has quit IRC20:45
openstackgerritsleepsonthefloor proposed a change to openstack-dev/devstack: Fix test that checks whether insances from previous runs need to be removed  https://review.openstack.org/323420:46
*** gyee has joined #openstack-dev20:49
*** dubsquared has quit IRC20:50
sleepsonthefloocrobinso - hey anthony here.  just want to say hello, and let you know that I'm working on openstackx servers calls today  I think we should be able to have the dep removed by e320:52
*** byeager has quit IRC20:54
crobinsosleepsonthefloo: hi! yeah sounds good. gonna try and get the novaclient usage bits submitted then going to do another rev of the nova flavors patch20:54
*** rnirmal has joined #openstack-dev20:55
sleepsonthefloocrobinso - coolio - I'll keep an eye out for that branch and give a try at plugging it into horizon.20:57
openstackgerritEmma Grace Steimann proposed a change to openstack/horizon: Added specific style for error box. * fixes bug 900432  https://review.openstack.org/323520:58
uvirtbotLaunchpad bug 900432 in horizon "keypair name text box on create keypair screen goes into description text" [Low,Confirmed] https://launchpad.net/bugs/90043220:58
crobinsosleepsonthefloo: unfortunately the usage bits in horizon seem to be a bit in flux so its hard to see it all at work. currently trying to view an individual tenants usage doesn't do much useful in horizon20:58
crobinsosleepsonthefloo: before or after my patch. but I assume it's on someones radar20:59
openstackgerritBrian Waldon proposed a change to openstack/nova: Remove admin_only ext attr in favor of authz  https://review.openstack.org/323620:59
*** _adjohn has joined #openstack-dev20:59
*** adjohn has quit IRC21:02
*** _adjohn is now known as adjohn21:02
openstackgerritKiall Mac Innes proposed a change to openstack/nova: Fixes bug #919390 - Block Migration fails when keystone is un use.  https://review.openstack.org/323721:03
uvirtbotLaunchpad bug 919390 in nova "Block migration fails when keystone is in use." [Undecided,New] https://launchpad.net/bugs/91939021:03
openstackgerritChmouel Boudjnah proposed a change to openstack/swift: PEP8 fixes.  https://review.openstack.org/323821:07
openstackgerritKiall Mac Innes proposed a change to openstack/nova: Fixes bug #919390 - Block Migration fails when keystone is un use.  https://review.openstack.org/323721:12
uvirtbotLaunchpad bug 919390 in nova "Block migration fails when keystone is in use." [Undecided,In progress] https://launchpad.net/bugs/91939021:12
openstackgerritJay Pipes proposed a change to openstack/glance: Bug#911599 - Location field wiped on update  https://review.openstack.org/295221:16
openstackgerritGabriel Hurley proposed a change to openstack/horizon: Auto-remove auto-generated .rst files for deleted .py files.  https://review.openstack.org/321621:19
openstackgerritGabriel Hurley proposed a change to openstack/horizon: Added a contributing guide to the Horizon docs.  https://review.openstack.org/321721:19
*** markvoelker has quit IRC21:21
openstackgerritGabriel Hurley proposed a change to openstack/horizon: Tooltip implementation cleanup.  https://review.openstack.org/321821:22
*** _adjohn has joined #openstack-dev21:23
openstackgerritVerification of a change to openstack/nova failed: Fix nova-manage floating list (fixes bug 918804)  https://review.openstack.org/322721:23
uvirtbotLaunchpad bug 918804 in nova "'nova-manage floating list' calls undefined method 'floating_ip_get_all'" [Medium,In progress] https://launchpad.net/bugs/91880421:23
*** _adjohn has quit IRC21:24
*** adjohn has quit IRC21:24
*** adjohn has joined #openstack-dev21:24
*** deshantm has quit IRC21:29
*** bencherian has joined #openstack-dev21:33
openstackgerritVerification of a change to openstack/nova failed: Support filter based on CPU core (over)allocation  https://review.openstack.org/320921:33
*** zul has quit IRC21:36
sleepsonthefloocrobinso - yes i see that.  there has been some refactoring in horizon that has munged some of the admin features.  I was going to do a quick pass to try to bring some of it back, but them again, to some extent missing features make our job easier right now21:37
*** david-kranz has joined #openstack-dev21:40
*** kbringard has quit IRC21:43
sleepsonthefloocrobinso - one example of that is that the admin instance list no longer shows host (which is very useful for admins) - but I think I may bug that for e4 - it requires a nova extension21:43
openstackgerritJay Pipes proposed a change to openstack/glance: Bug #909574: Glance does not sanity-check given image size on upload  https://review.openstack.org/272721:43
uvirtbotLaunchpad bug 909574 in glance "Glance does not sanity-check given image size on upload" [Medium,In progress] https://launchpad.net/bugs/90957421:43
openstackgerritVerification of a change to openstack/glance failed: Bug#911599 - Location field wiped on update  https://review.openstack.org/295221:43
openstackgerritJay Pipes proposed a change to openstack/tempest: Adds Images API tests  https://review.openstack.org/288421:49
*** bencherian has quit IRC21:51
*** _adjohn has joined #openstack-dev21:52
*** bencherian has joined #openstack-dev21:54
*** adjohn has quit IRC21:54
*** LinuxJedi has joined #openstack-dev21:55
*** eglynn has joined #openstack-dev21:55
openstackgerritVish Ishaya proposed a change to openstack/nova: Create nova cert extension for x509 support  https://review.openstack.org/319921:55
openstackgerritVish Ishaya proposed a change to openstack/nova: Adds extension for retrieving certificates  https://review.openstack.org/320021:55
*** bencherian has quit IRC21:56
*** _adjohn has quit IRC21:56
*** adjohn has joined #openstack-dev21:56
vishycomstud: quick question if you got a sec21:57
*** eglynn__ has quit IRC21:57
comstudvishy: sure21:58
*** jaypipes is now known as jaypipes-afk21:58
vishycomstud: so the part of az-scheduler which allows an admin to specify a host21:58
vishyi realized should be separate21:59
vishybecause if an admin specifies a host, it should just skip all of the filters entirely21:59
*** stuntmachine has quit IRC21:59
vishyso I'm thinking of doing something like ignored_host where we add a required_host to the request spec21:59
vishyand if it is set, it short circuits all the filtering and weighing and goes directly to that host22:00
vishydoes that seem reasonable? ^^22:00
openstackgerritVish Ishaya proposed a change to openstack/nova: Adds extension for retrieving certificates  https://review.openstack.org/320022:00
comstudvishy: I think so.  I'm in the middle of adding filter_properties as being passed to run_instance from compute manager22:00
vishycomstud: about _0x44's patch22:01
comstudIn which case, I think that's the spot to add that?22:01
comstudvishy: Yeah, I wanted to ask you about that, too22:01
vishycomstud: the idea is that we have some arbitrary data passed in by the user that makes it to the scheduler22:01
vishyand this data can be interpreted by the filter or weighter22:01
comstudi assume that mostly that's admin-only22:02
_0x44Not all of it should be admin-only22:02
vishynova boot --scheduler_hints = "{'different_host': 'instance:<uuid>'}'22:02
vishyi.e. make sure it is on a different host than this other instance22:03
*** lloydde has joined #openstack-dev22:03
vishyif the filter is enabled it would make sure you got a different host22:03
comstudOkay, right22:03
vishyin this case it would be a user facing feature22:03
vishythe affinity one was just kind of experimental22:03
vishyi don't know if same_host is useful22:03
comstudwell, we have affinity on our list22:03
vishybut different_host is for sure22:04
openstackgerritVerification of a change to openstack/glance failed: Bug #909574: Glance does not sanity-check given image size on upload  https://review.openstack.org/272722:04
uvirtbotLaunchpad bug 909574 in glance "Glance does not sanity-check given image size on upload" [Medium,In progress] https://launchpad.net/bugs/90957422:04
comstudbut affinity essentially maps toa  zone for us22:04
comstudnot a host22:04
comstudas far as host, i get it22:04
vishycomstud: yeah i would think host_aggregates might get you there22:04
vishycomstud: if availability zones don't work for some reason22:04
Vekcan I get mtaylor or jeblair to look at https://review.openstack.org/#change,3190 please?  devstack keeps failing to start nova-api, but I can't replicate and need more information.22:05
vishycomstud: anyway, bcwaldon was going to add the extension to allow scheduler hints22:05
comstudyou coming to SAT 2/1 ?22:05
vishycomstud: it appears so22:05
comstudthis might be a topic for discussion22:05
vishycomstud: I need the different_host scheduler in prior to that, hence the rewrite work22:05
vishycomstud: but for the larger affinity question, for sure22:06
comstudnod22:06
comstudyea22:06
comstudwell, i was going to take care of part of waldon's work22:06
comstudhe can do the extension22:06
comstudI can get the framework in place22:06
*** lts has quit IRC22:06
comstudi have part of it done22:07
*** zigo has quit IRC22:08
comstudin fact, I think i just have tests to fix22:09
*** david-kranz has quit IRC22:09
bcwaldoncomstud: feel free to do it22:10
comstudwhat I'm doing is passing filter_properties dict to scheduler from compute22:10
comstudyou can add what you need there22:10
comstudwhen i'm done22:10
bcwaldonok22:11
bcwaldonjust give me your branch so I can see what you're doing22:11
comstudyeah22:11
comstudi'll push something up22:11
*** bencherian has joined #openstack-dev22:12
bcwaldoncomstud: weren't you supposed to be off today?22:13
comstudno22:13
bcwaldonyes?22:14
comstudno22:15
comstudoriginally i was going to take a few days off22:15
comstudbut decided I didn't need to right now22:15
comstudfg22:15
comstudoops22:15
*** byeager has joined #openstack-dev22:17
bcwaldonbg22:18
*** adjohn has quit IRC22:19
openstackgerritFlorian Hines proposed a change to openstack/swift: swift-recon cli cleanup  https://review.openstack.org/292822:19
*** adjohn has joined #openstack-dev22:19
comstudbcwaldon: https://github.com/comstud/nova/commit/639f912d1e79d70cf5aae56e9a38030fd3d99a9922:20
*** mdomsch_ has quit IRC22:21
bcwaldoncomstud: ok, and you want a dictionary from the user to update the defaults you have set?22:21
comstudi would add new entries into filter_properties22:22
comstudlike:22:22
comstud'desired_host': <whatever>22:22
bcwaldonok, but you've got some already defined, like local_zone_only22:22
bcwaldonare those mutable by the user?22:22
comstudthat should not be22:22
comstudthat'll be going away22:22
comstudignore the zones stuff22:23
*** bsza has quit IRC22:23
comstudignore_hosts right now is only set by the compute manager for a resize based on a flag22:23
comstudit's empty for an initial build, so you could use it22:23
bcwaldonok, I'll see what I can do22:23
comstudhow are you going to handle rebuilds and resizing which do re-scheduling?22:23
comstudI guess you'll have to support that in extension too22:24
bcwaldonyeah, same interface I use for create22:24
bcwaldonyou buy that?22:24
comstudyeah22:24
bcwaldonis the branch 'filter_changes'?22:24
comstudfeel free to use ignore_hosts22:24
comstudyeah22:25
comstudi think this is ready for review22:25
bcwaldonhow would I 'use' it?22:25
Vekcan I get mtaylor or jeblair to look at https://review.openstack.org/#change,3190 please?  devstack keeps failing to start nova-api, but I can't replicate and need more information.22:25
*** rnirmal has quit IRC22:25
bcwaldoncomstud: not sure what you mean22:25
comstudif you find that you want to allow a user to ignore certian hosts, feel free to take advantage of the current 'ignore_hosts' entry in the filter properties22:25
bcwaldonok, I'm not going to do any validation22:26
bcwaldonthe keys need to be open so any scheduler implementation can get what it needs22:26
*** cp16net has quit IRC22:26
comstudif you want to add a 'build only on this host' thing, you'll need to add a new key to the filter_properties dict22:26
comstudyes22:26
bcwaldonso the keys will be defined by the scheduler22:26
bcwaldonor whatever filters are supported22:27
comstudyeah, filters typically22:27
bcwaldonbut I won't worry about that at my level22:27
comstudthe only hard coded one is 'ignore_hosts' (and 'local_zone_only' for zone stuff)22:27
comstudi could move that into a filter22:27
bcwaldonsure, they'r hard-coded in the compute layer, but I'm still going to treat them as arbitrary keys in the api22:27
comstudnod22:28
openstackgerritVerification of a change to openstack/keystone failed: Implement Secure Token Auth  https://review.openstack.org/288922:29
*** bencherian has quit IRC22:30
comstudfixed tests.. running now to make sure22:36
*** bencherian has joined #openstack-dev22:38
openstackgerritVerification of a change to openstack/keystone failed: Addresses bug 918608  https://review.openstack.org/320222:40
openstackgerritsleepsonthefloor proposed a change to openstack/horizon: Port quotas to novaclient  https://review.openstack.org/324022:41
openstackgerritChris Behrens proposed a change to openstack/nova: pass filter_properties into scheduling requests for run_instance  https://review.openstack.org/324122:41
comstudbcwaldon: ^^22:42
bcwaldoncomstud: kk, working on the extension meow22:42
bcwaldoncomstud: vg break22:42
comstudvg break?22:42
bcwaldonvideo game22:42
bcwaldonor is it22:42
comstudi see22:43
openstackgerritsleepsonthefloor proposed a change to openstack/horizon: Port servers calls to novaclient  https://review.openstack.org/324222:44
Vekcan I get mtaylor or jeblair to look at https://review.openstack.org/#change,3190 please?  devstack keeps failing to start nova-api, but I can't replicate and need more information.22:46
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Restore Console Info Logging - bp keystone-logging  https://review.openstack.org/324322:47
openstackgerritAaron Lee proposed a change to openstack/melange: Adding pip install instructions to readme.  https://review.openstack.org/324422:49
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Implement Secure Token Auth  https://review.openstack.org/288922:49
openstackgerritJoe Gordon proposed a change to openstack/nova: Pull out ram_filter into a separate filter  https://review.openstack.org/321122:53
*** adjohn has quit IRC22:56
*** adjohn has joined #openstack-dev22:56
openstackgerritVerification of a change to openstack/keystone failed: Implement Secure Token Auth  https://review.openstack.org/288923:00
openstackgerritZiad Sawalha proposed a change to openstack/keystone: Addresses bug 918608  https://review.openstack.org/320223:00
*** bencherian has quit IRC23:01
*** troytoman-away is now known as troytoman23:03
openstackgerritdlapsley proposed a change to openstack/nova: bug 917397  https://review.openstack.org/324523:08
uvirtbotLaunchpad bug 917397 in nova/essex "Quantum Manager configuration sanity checks" [Undecided,New] https://launchpad.net/bugs/91739723:08
*** bencherian has joined #openstack-dev23:13
Vekcan I get mtaylor or jeblair to look at https://review.openstack.org/#change,3190 please?  devstack keeps failing to start nova-api, but I can't replicate and need more information.23:14
*** LinuxJedi has quit IRC23:18
openstackgerritJake Dahn proposed a change to openstack/python-novaclient: Implementing client for new x509 support in nova.  https://review.openstack.org/324623:20
openstackgerritDave Lapsley proposed a change to openstack/nova: bug 917397  https://review.openstack.org/324523:22
uvirtbotLaunchpad bug 917397 in nova/essex "Quantum Manager configuration sanity checks" [Undecided,New] https://launchpad.net/bugs/91739723:22
openstackgerritRick Harris proposed a change to openstack/nova: Fix xenapi rescue without swap.  https://review.openstack.org/324723:23
*** crobinso has quit IRC23:25
comstudvishy: ping23:26
comstudvishy: I'm going to push up test fixes for your branch, and rebase it off another review... i think it can go in and you can move some things around.  nice to get it in so request_spec, context, etc is there.23:29
comstudlet's see if this works23:29
openstackgerritChris Behrens proposed a change to openstack/nova: Adds Availability Zone Filter  https://review.openstack.org/321423:30
vishycomstud: i'm just splitting it into multiple patches23:31
comstudhm, it didn't grab my changes anyway23:31
comstudok23:31
vishytrying to remember how to get git to stage part of a file23:31
*** jakedahn has quit IRC23:32
comstudno idea, i'm not a git person23:32
*** jakedahn has joined #openstack-dev23:32
comstudvishy: If it saves you time, you can steal this: https://github.com/comstud/nova/commit/5aa8bd4ac7f25d42912f7cf897fa6df3e8a14995#diff-423:35
comstudthe dist sched test fixes23:35
comstudif it doesn't save you time, no big deal23:35
comstud:)23:35
Vekvishy: for staging parts of files, I usually use git gui.  There is a command-line way of doing it, but I'm not sure what; check "git help add" maybe?23:36
vishygit add --patch23:37
vishyor git add -i23:37
vishypretty awesome23:37
Vek*nod* I use that feature in git gui all the time.23:38
openstackgerritRick Harris proposed a change to openstack/nova: ERROR out instance if unrescue fails.  https://review.openstack.org/324823:40
Vekvishy: btw, one more patch for the extension-refactor blueprint, but I can't get it past devstack and I can't figure out why.23:41
openstackgerritVish Ishaya proposed a change to openstack/nova: Add option to force hosts to scheduler  https://review.openstack.org/324923:41
comstudvishy: Hm... your patch would be much nicer after mine goes in23:46
comstudvishy: see: https://review.openstack.org/#change,324123:46
comstudvishy: You don't need to add a new argument to run_instance().  You can just add force_hosts to filter_properties23:47
vishyhmm23:47
vishythat would be nicer23:47
comstudtake a look, approve, and rebase!23:47
comstud;)23:47
openstackgerritVish Ishaya proposed a change to openstack/nova: Add context and request spec to filter_properties  https://review.openstack.org/325023:48
comstudthat will need a rebase if we can get an Approved on mine as well23:49
comstudand then you can ditch populate_filter_properties completely23:49
vishyok those are my three patches23:50
openstackgerritVish Ishaya proposed a change to openstack/nova: Adds availability zone filter  https://review.openstack.org/325123:50
vishyall separate and tests passing isolated on each one23:50
vishywell except for pep8 of course23:50
vishy:(23:50
comstudhah23:50
openstackgerritVish Ishaya proposed a change to openstack/nova: Adds availability zone filter  https://review.openstack.org/325123:51
openstackgerritandrewbogott proposed a change to openstack/nova: Explicitly encode string to utf8 before passing to ldap.  https://review.openstack.org/325223:51
vishycool23:52
vishyi can add it in to filter properties instead.23:52
comstudyeah, it's a bit more clean if compute passes it in23:53
comstudthen waldon can do his extension work23:53
comstudand your force_hosts work is easy23:54
comstudsorry, kinda stomped on each other here, but easy to resolve23:54
*** troytoman is now known as troytoman-away23:54
vishyok just approved yours23:54
comstudthnx23:54
vishywill rebase once it merges23:54
vishyi think az filter doesn't need a rebase23:54
comstudlooking23:55
vishycomstud: hmm but it probably needs one of my other branches to actually work23:56
*** Gordonz has quit IRC23:56
comstudyeah it will23:56
comstudi approved anyway.. i guess i should not have since you added it to default filter list23:57
comstuder23:57
comstud+2'd23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!