Monday, 2012-05-14

*** adalbas has joined #openstack-dev00:30
*** adalbas has quit IRC00:36
*** jeblair has joined #openstack-dev00:53
*** littleidea has joined #openstack-dev01:12
*** pixelbeat has quit IRC01:36
hugokuo2morning01:54
*** ywu has quit IRC02:51
*** andresambrois has joined #openstack-dev02:56
*** andresambrois is now known as aa02:56
*** rkukura has quit IRC03:18
nvezIf I want to upload a draft, who should I add in Gerrit for them to check?03:34
*** shang has joined #openstack-dev03:35
*** edygarcia has joined #openstack-dev03:39
*** bhuvan_ has joined #openstack-dev03:47
*** edygarcia has quit IRC04:10
*** edygarcia has joined #openstack-dev04:23
*** dtroyer is now known as dtroyer_zzz04:26
*** edygarcia has quit IRC04:29
*** ncode has joined #openstack-dev04:30
*** ncode has joined #openstack-dev04:30
*** novas0x2a|laptop has quit IRC04:31
*** littleidea has quit IRC04:33
*** sdake has joined #openstack-dev04:39
*** garyk has quit IRC04:41
*** dachary has joined #openstack-dev04:42
*** vincentricci has joined #openstack-dev04:50
*** eglynn_ has joined #openstack-dev04:53
*** eglynn has quit IRC04:53
*** dachary has quit IRC04:59
*** eglynn__ has joined #openstack-dev04:59
*** dachary has joined #openstack-dev04:59
*** ncode has quit IRC04:59
*** eglynn_ has quit IRC05:01
*** hugokuo has joined #openstack-dev05:05
*** nvez is now known as mnaser05:07
*** hugokuo2 has quit IRC05:08
*** anderstj has joined #openstack-dev05:16
*** shang has quit IRC05:32
*** SQLStud has joined #openstack-dev05:34
*** SQLStud has left #openstack-dev05:39
*** trapni has joined #openstack-dev05:46
* trapni waves05:46
*** davidha has joined #openstack-dev05:47
*** mrunge has joined #openstack-dev05:58
*** garyk has joined #openstack-dev05:59
*** pmezard has joined #openstack-dev06:01
*** hattwick has quit IRC06:01
*** mindpixel has joined #openstack-dev06:06
*** anderstj has quit IRC06:07
*** vincentricci has quit IRC06:09
*** dachary has quit IRC06:12
*** hugokuo1 has joined #openstack-dev06:15
*** hugokuo has quit IRC06:19
*** longhudou has joined #openstack-dev06:30
*** reidrac has joined #openstack-dev07:07
*** jakedahn is now known as jakedahn_zz07:21
*** dachary has joined #openstack-dev07:21
*** berendt has joined #openstack-dev07:29
*** Stackops-Jorge has joined #openstack-dev07:31
*** davidha has quit IRC07:33
*** sdake has quit IRC07:39
*** apevec has joined #openstack-dev07:55
*** hattwick has joined #openstack-dev07:58
*** berendt1 has joined #openstack-dev08:02
*** bhuvan_ has quit IRC08:02
*** berendt has quit IRC08:02
*** davidha has joined #openstack-dev08:04
*** mancdaz has joined #openstack-dev08:04
*** pixelbeat has joined #openstack-dev08:08
*** Chuanyong has joined #openstack-dev08:16
*** darraghb has joined #openstack-dev08:18
*** Chuanyong has quit IRC08:18
*** Chuanyong has joined #openstack-dev08:18
*** fc__ has joined #openstack-dev08:25
*** azbarcea has joined #openstack-dev08:36
*** journeeman has joined #openstack-dev08:44
journeemanIs there any other by which I could query which extensions a Quantum plugin supports apart from the plugin mentioning it in the list, supported_extension_aliases?08:46
*** Ryan_Lane has quit IRC08:53
*** davidha has quit IRC08:56
*** davidha has joined #openstack-dev08:56
*** davidha_who_took has joined #openstack-dev09:08
*** davidha has quit IRC09:08
*** danpb has joined #openstack-dev09:11
*** GheRivero has joined #openstack-dev09:21
*** shang has joined #openstack-dev09:32
*** mancdaz has quit IRC09:50
*** mancdaz has joined #openstack-dev09:50
*** hugokuo1 has quit IRC09:56
*** hugokuo has joined #openstack-dev10:00
*** mcclurmc_ has joined #openstack-dev10:11
*** mjfork has joined #openstack-dev10:16
*** longhudou has quit IRC10:18
*** koolhead17 has quit IRC10:35
*** berendt1 has quit IRC10:42
*** Mkenneth has joined #openstack-dev10:55
davidha_who_tookHi11:10
*** davidha_who_took is now known as davidha11:11
davidhaIn swift and in openstack in general, can one run multiple instances of teh same component on teh same server node?11:13
*** milner has joined #openstack-dev11:14
davidhaE.g. run multiple Container Servers all serving teh same node (unlike SAIO example where different container servers serve different 'virtual' nodes)11:14
davidhaI.e. they would all have the same "devices" config parameter (yet different "bind_port" config parameter)11:17
*** journeeman has quit IRC11:25
*** azbarcea has quit IRC11:30
*** andresambrois has joined #openstack-dev11:45
*** bsza has joined #openstack-dev11:47
*** aa has quit IRC11:49
*** mrunge has quit IRC11:51
*** heyho has joined #openstack-dev11:55
*** salgado has joined #openstack-dev12:03
*** salgado has quit IRC12:03
*** salgado has joined #openstack-dev12:03
*** apevec has quit IRC12:03
*** markvoelker has joined #openstack-dev12:09
*** alaski has joined #openstack-dev12:10
*** rbasak has joined #openstack-dev12:27
*** ogelbukh has quit IRC12:29
*** akscram has quit IRC12:30
*** Mkenneth has quit IRC12:30
*** ogelbukh has joined #openstack-dev12:30
*** akscram has joined #openstack-dev12:30
*** berendt has joined #openstack-dev12:34
*** markmc has joined #openstack-dev12:34
*** koolhead17 has joined #openstack-dev12:34
*** alaski has quit IRC12:35
*** alaski has joined #openstack-dev12:36
*** dolphm has joined #openstack-dev12:36
*** dprince has joined #openstack-dev12:37
*** adalbas has joined #openstack-dev12:45
russellbgaryk: hello!  so i hear you're working on quantum rpc :)12:45
garykrussellb: ping12:45
russellbwhat's the current issue?12:46
garykrussellb: hi, yes, i have encountered some problems (which i am certain are in the code that i have writte). i have a rpc.cast from the agent to the plugin.12:46
garykon the plugin i do not see the method "callback" being called.12:47
*** sdake has joined #openstack-dev12:47
garyki captured the traffic and see that the TCP connection receives the ACK's for the cast.12:47
russellbok, so let's take a look at 2 lines of code ... the code doing create_consumer() on one side, and the rpc.cast() on the other.  can you paste those somewhere?12:47
*** sdake has quit IRC12:48
russellbpaste.openstack.org12:48
russellbor your pastebin of choice12:48
*** sdake has joined #openstack-dev12:48
garykrussellb: tx. in 212:48
russellbk12:48
garykrussellb: http://fpaste.org/Chwk/ (please note i had to chnage the rpc.register - this was due to the fact that quantum does not make use of a large amount of common libraries from openstack)12:51
garykrussellb: the rpc backend is qpid12:54
russellbi would s/context, value/self, context/12:54
russellbbut that shouldn't cause an error at this point12:54
russellbi think the code might require args in the message, even if you don't have any args so ... {'method': 'hello_world', 'args': {}}12:55
russellbif that was the problem, i'd expect an exception on the receiving side though12:56
russellbyou have logging on the receiving side?12:56
garykrussellb: did not solve. no, i do not have logging enabled. . i'll give that a bash.12:57
*** derekh_ has joined #openstack-dev12:58
*** derekh_ is now known as derekh12:59
russellbok, let me know if you get anything in the log12:59
*** dolphm has quit IRC13:00
*** blamar has joined #openstack-dev13:01
garykrussellb: ++1 http://fpaste.org/AF1X/13:03
russellbah ha13:03
russellbfrom openstack.common import local13:03
*** Mkenneth has joined #openstack-dev13:03
garykrussellb: great thanks!13:04
russellbnp, let me know what happens after you get the local piece in there13:05
russellbjust need to copy that file in from openstack-common13:05
*** yazirian has quit IRC13:05
garykthanks. at the moment i have copied all of the necessary files to a openstack/common directory that i have. at the moment this is part of the quantum code. it would certainly be better to import it from the common openstack project. i understand that the specifics of this library are stil in debate.13:06
*** yazirian has joined #openstack-dev13:06
russellbgaryk: right now each project is just copying in the pieces that they need13:07
russellbthere is a script in openstack-common to help you copy in stuff to keep it up to date ... and a config file in each project that says which bits to copy in13:07
*** littleidea has joined #openstack-dev13:07
garykrussellb: ok. this is what i have done. the problem is that we have to tweak the code. i have yet to understand this13:07
russellbyou shouldn't have to tweak anything that comes from openstack-common.  if you do, we should talk about it13:09
russellbyou'll have to tweak rpc, because it's not ready for common yet13:09
russellbo13:09
russellbi'll probably work on that some more this week13:09
*** dolphm has joined #openstack-dev13:10
garykrussellb: yup, this is what i have done. i made two chnages - the first was just updating the imports so that they are not using nova and the second was just to chnage the api for the register function (quantum did not use the cfg format)13:12
*** cdub has joined #openstack-dev13:12
russellbok.  if you create an openstack-common.conf and use the update.py script from openstack-common to do the copying for you, it will set up the imports for you automatically13:13
*** kbringard has joined #openstack-dev13:13
garykrussellb: great! would have saved me a few hours :)13:14
russellbheh, sorry13:14
russellbtake a look at the .conf file in nova as an example13:14
garykrussellb: i should have asked.13:14
garykrussellb: can you please take a peak at - http://fpaste.org/ONxD/ - exception solved - still no callback13:14
cdubgaryk: ping13:15
*** roge has joined #openstack-dev13:16
garykcdub: pong13:16
trapnimy nova.projects table got corrupted just within the last 1-2 hours. this happened weeks ago, too. what can cause this?13:16
*** asalkeld is now known as asalkeld_zzz13:16
*** mancdaz has quit IRC13:16
cdubgaryk: i vaguely recall you having an issue w/ dnsmasq not responding some time back13:17
trapnisince there're only two sql tables being affected, I don't think of any disk I/O error.13:17
*** mancdaz has joined #openstack-dev13:17
*** Mkenneth has quit IRC13:17
*** sandywalsh has joined #openstack-dev13:18
garykcdub: correct. i'll check my sent mail to see if i can find it.13:18
cdubgaryk: thanks13:18
*** hattwick has quit IRC13:21
*** dtroyer_zzz is now known as dtroyer13:23
garykcdub: on fedora 17 I had problems with a dormant: dnsmasq process and Additional instance launching failed: (nova.rpc.common): TRACE: Stderr: '\ndnsmasq: failed to create listening socket for 10.0.0.1: Address already in use\n'13:24
garyk. in addition to this i saw: https://bugs.launchpad.net/nova/+bug/953712 and https://bugs.launchpad.net/nova/+bug/953708.13:24
uvirtbotLaunchpad bug 953712 in nova "force_dhcp_release is currently unsupported on Fedora" [Undecided,Invalid]13:24
russellbgaryk: take a look in rpc/amqp.py, ProxyCallback.__call__13:24
russellbgaryk: we are seeing the "received ..." log message, and the one that comes from unpack_context()13:25
cdubgaryk: hmm, ok...not what's happening here.  i'll dig in.  thanks13:25
russellbso maybe there is a problem when it tries to hand it off to the thread pool13:25
russellbmaybe the thread pool is busted?13:25
russellbis the code doing eventlet.monkey_patch() ?13:26
russellbit needs to13:26
garykrussellb: i'll check13:26
russellbwhen it first starts up13:26
garykcdub: i think that killing the process was a work around.13:26
russellball of the nova binaries do "import eventlet ; eventlet.monkey_patch()" as the very first thing, before importing anything else13:27
cdubgaryk: yeah, that's not the issue here13:27
koolhead17hi all13:27
garykrussellb: no the code did not call eventlet.monkey_patch() [is this my monkey business?]13:29
russellb:)13:30
russellbtry adding that ...13:30
garykok, will do13:30
*** Mkenneth has joined #openstack-dev13:31
*** mestery has quit IRC13:33
*** hattwick has joined #openstack-dev13:34
*** blamar has quit IRC13:35
*** blamar has joined #openstack-dev13:36
*** hub_cap has joined #openstack-dev13:36
*** lts has joined #openstack-dev13:37
*** rkukura has joined #openstack-dev13:38
garykrussellb: sadly it did not solve the issue. when a message is received it calls <quantum.openstack.common.rpc.amqp.ProxyCallback object at 0x2251290>. silly question - how/when is the callback stored on the proxy callback?13:39
russellbgaryk: it is done by create_consumer13:40
russellbcan you do some digging / add some logging to see if the code gets to where it passes off to the thread pool, and then see if that code ever runs?13:40
garykrussellb: ok, i'll try13:40
*** yazirian has quit IRC13:45
zykes-Daviey: Is quantum-agent-openvswitch missing dependencies of quantum-rootwrap and sudoers ?13:48
Davieyzykes-: quite possibly.. :/13:49
*** yazirian has joined #openstack-dev13:49
garykrussellb: thanks! you have solved the problems. 1. my bad regarding the eventlet monkey (when I added this I saw the callback was being called) 2. the logging helped - saw that the function was not called with the correct parameters. when you have some time i would like to pick your brain regarding the openstack common and quantum.13:49
*** yazirian has quit IRC13:50
*** edygarcia has joined #openstack-dev13:50
russellbgaryk: great!  glad it's working!  :)13:51
zykes-Daviey: where do I file a bug ? )13:51
russellbgaryk: pick away, now is as good of a time as any13:51
* koolhead17 points zykes- to launchpad13:51
zykes-quantum-rootwrap - should be packages with quantum-common13:51
* koolhead17 kicks zykes- at same time 4 asking13:51
zykes-and also common should have sudoers.d, agents should have upstart jobs13:52
*** yazirian has joined #openstack-dev13:52
zykes-Should it be filed under Quantum or Ubuntu ?13:52
garykrussellb: is there any document or reference on making the use of openstack common code. for the RPC it would be great to use this in quantum instead of duplicating every thing. i did have one or 2 minor problems with the usage of the RPC code - more specifically - there were some flags that were defined in the nova configuration and not in the RPC configuration.13:53
koolhead17zykes-, are you testing it on ubuntu?13:54
russellbgaryk: rpc isn't in openstack-common yet13:54
garykrussellb: i know :)13:54
zykes-koolhead17: yeh, gave up on Centos for now ;)13:54
zykes-but on ubuntu you face new issues :p13:54
russellbgaryk: http://wiki.openstack.org/CommonLibrary13:54
* koolhead17 gives evil laugh13:54
russellbthat's the doc13:54
Davieyzykes-: run, "ubuntu-bug quantum"13:54
garykrussellb: i'll be happy to help and/test13:55
russellbgaryk: k, i also just pushed a patch series to nova for review that will change how you use rpc a bit ... https://review.openstack.org/7386 through 739113:56
zykes-garyk: can't you get a command like that for fedora / rh as well ? Would be so nice13:56
russellbdoesn't change it conceptually13:56
garykrussellb: tx13:57
garykzykes: not sure i understand13:57
zykes-garyk: the ubuntu-bug common is ok to have to collect info :)13:58
garykok14:00
*** markmcclain has joined #openstack-dev14:01
zykes-Daviey: do you know why there's: quantum-plugin-openvswitch quantum-plugin-openvswitch-agent ?14:01
*** yazirian has quit IRC14:02
*** yazirian has joined #openstack-dev14:03
Davieyzykes-: I do not.. zul, might be more familiar.14:07
zulwhat am i familar with?14:07
zykes-Seems I'm hitting https://bugs.launchpad.net/ubuntu/+source/quantum/+bug/979190 as well as missing sudoers / roowrap stuff14:08
uvirtbotLaunchpad bug 979190 in quantum "Missing upstart scripts" [High,Fix released]14:08
*** Mkenneth has quit IRC14:09
*** dtroyer is now known as dtroyer_zzz14:09
zulzykes-: yeah that should be fixed in an sru14:10
Davieyzul: can you jump on that soonly? :)14:11
*** mnaser has quit IRC14:11
zulDaviey: yeah its on the plan for this week14:11
*** mnaser has joined #openstack-dev14:11
Davieyzul: superb14:11
zykes-zul: I deployed it like a few days ago to ubuntu - didn't seem to be fixed.14:12
zykes-SRU ?14:12
zulyes....it will be done in an SRU14:12
zykes-ok, so until the remedy is to fix stuff manually ?14:13
zulzykes-: yes14:13
zykes-does anyone have some presentational material for openstack as a whole I can use as an example ?14:13
*** lts has quit IRC14:14
koolhead17zykes-, umm. probably slideshare can help you else in case you need any help you can poke me14:15
zykes-done quantum yet koolhead17 o?14:17
koolhead17zykes-, http://www.slideshare.net/search/slideshow?searchfrom=header&q=openstack+essex14:17
koolhead17zykes-, from coming week all on quantum :D14:17
koolhead17zul, how are you now sir?14:17
*** berendt has quit IRC14:18
*** mestery has joined #openstack-dev14:18
zulkoolhead17: jetlagged you?14:18
koolhead17zul,   same here. but i was more concerned about the karaoke stunt :)14:18
zuloh its fine14:18
koolhead17aah glad to know. :)14:19
*** dtroyer_zzz is now known as dtroyer14:23
*** lts has joined #openstack-dev14:23
*** Mkenneth has joined #openstack-dev14:26
*** eglynn has joined #openstack-dev14:27
*** shang has quit IRC14:28
*** eglynn__ has quit IRC14:29
*** eglynn_ has joined #openstack-dev14:31
mnaserCan someone please review this and let me know (first non-bug-fix feature change) if there's anything to do on it? https://review.openstack.org/#/c/7376/14:32
bcwaldoneglynn: updated this for you: https://review.openstack.org/#/c/7251/14:32
*** berendt has joined #openstack-dev14:33
*** mindpixel has quit IRC14:33
ttxnotmyname: around ?14:33
*** berendt has quit IRC14:33
*** eglynn has quit IRC14:34
*** lloydde has joined #openstack-dev14:34
*** lloydde has quit IRC14:35
*** shang has joined #openstack-dev14:35
eglynn_bcwaldon: cool, thanks ... #7251 approved14:39
bcwaldoneglynn_: blame jaypipes14:39
bcwaldoneglynn_: https://review.openstack.org/#/c/7251/14:39
bcwaldoneglynn_: approve it again!14:39
bcwaldonjaypipes: ^14:40
notmynamettx: ya14:40
ttxnotmyname: there is currently a swift-bugs team which controls who can edit swift bug status (contains swift-core and the vulnerability management team).14:40
ttxnotmyname: There is a bug subscription for swift-bugs that makes all members receive all bugmail about swift14:40
ttxnotmyname: I'd like to seperate the right to edit Swift bugs from the obligation to receive all bugmail about Swift, so I'd like to remove swift-bugs subscription14:40
ttxnotmyname: Currently all swift-core receives all Swift bug activity due to the swift-bugs subscription. We can preserve that by recreating the subscription at swift-core level14:40
ttx(if you want)14:40
ttxnotmyname: or we can simply remove it... and let people subscribe manually if they want to.14:41
*** crobinso has joined #openstack-dev14:41
ttxnotmyname: what's your preferred option ?14:41
notmynamettx: I'd like swift-core to still get the emails14:43
ttxnotmyname: ok, I'll preserve that. Will add myself temporarily to swift-core to fix that for you.14:44
notmynamettx: ok14:44
eglynn_bcwaldon, vishy: wrt the discussion on S3 image IDs on https://review.openstack.org/7302, what are your thoughts on explicitly exposing the image ID mapping via a new API extension?14:44
eglynn_bacwaldon, vishy: e.g. https://blueprints.launchpad.net/nova/+spec/expose-s3-image-id-mapping14:44
zykes-garyk: do you know what part in the Quantum network manager that reserves / allocates ip's ?14:45
eglynn_bcwaldon ^^^14:45
garykzykes-: at the moment quantum does not do the IPAM. this is done by melange. It is currently being merged into Quantum.14:45
*** yazirian has quit IRC14:46
zykes-garyk: I'm not using Melange, just nova_ipam14:46
ttxnotmyname: oh. actually swift-core is already subscribed (I can see that now that I added myself to the team). So I'll just remove the swift-bugs subscription.14:46
zykes-but I think I'm hitting an issue where it looks for an allocated ip before updating the config file for dnsmasq but there's no ip allocated but it's reserved14:46
ttxnotmyname: done, and removed me.14:47
garykzykes-: sorry but i am not familiar with this yet. when i played with devstack today i encountered a few issues here too. i have yet to try and resolved them.14:48
notmynamettx: cool, thanks14:50
*** Gordonz has joined #openstack-dev14:51
*** renier has joined #openstack-dev14:53
*** rnirmal has joined #openstack-dev14:53
*** jgriffith has joined #openstack-dev14:57
mnaserVek: re the fixed ips quota patch, what do you prefer we do in this case?  I know a week ago a patch got merged for key pair quotas (https://review.openstack.org/#/c/6709/)14:59
*** byeager has quit IRC15:00
*** Gordonz has quit IRC15:01
*** Gordonz has joined #openstack-dev15:02
*** lloydde has joined #openstack-dev15:02
*** eglynn__ has joined #openstack-dev15:07
*** eglynn_ has quit IRC15:09
*** apevec has joined #openstack-dev15:14
*** byeager has joined #openstack-dev15:16
*** zaitcev has joined #openstack-dev15:17
*** reidrac has quit IRC15:20
*** heckj has joined #openstack-dev15:21
*** kbringard has quit IRC15:24
*** shang has quit IRC15:26
jaypipesbcwaldon: morning.15:27
jaypipesbcwaldon: approved.15:28
*** epim has joined #openstack-dev15:30
eglynn__bcwaldon: I'm slight confused by patch set 7: https://review.openstack.org/#/c/7251/7/glance/schema.py15:33
eglynn__(i.e. the removal of the intersecting custom/schema properties check)15:33
bcwaldoneglynn__: le sigh15:34
bcwaldoneglynn__: apparently I dont play well with gerrit :(15:34
bcwaldoneglynn__ and jaypipes: https://review.openstack.org/#/c/7251/815:36
bcwaldonI'm getting tired of this15:36
jaypipesbcwaldon: approved (again)15:37
eglynn__bcwaldon: unleash the Jenkins ;)15:38
jaypipesbcwaldon: so, additionalProperties is definitely not intended to provide a *user* of the schema the ability to add properties to a schema. It is intended to allow creators of subclassed schemas to add their own properties...15:38
bcwaldonjaypipes: define *user* of the schema15:39
jaypipesbcwaldon: a user of the API... i.e. Joe Schmoe.15:39
bcwaldonjaypipes: ok, so this isn't allowing those users to provide new schemas15:39
jaypipesbcwaldon: hmm... then perhaps I am not understanding the code...15:40
bcwaldonjaypipes: additionalProperties can do one of three things15:40
bcwaldonjaypipes: or even two!15:40
jaypipesbcwaldon: because it looks like a "properties" list is being returned in the main image dict.15:40
bcwaldonjaypipes: it most certainly is not :)15:40
bcwaldonjaypipes: there is a properties list in the database15:40
jaypipesbcwaldon: ok, then. I'm fully aware of the difference between {}. False, and {<some_set_of_things>}15:41
bcwaldonjaypipes: and there is a properties list defined in the schemas15:41
bcwaldonjaypipes: the test you commented on was the controller, which the serializer follows up on15:41
bcwaldonjaypipes: converting the 'properties' list into top-level attributes15:41
jaypipesbcwaldon: hmm..15:41
bcwaldonjaypipes: ...depending on how the schema is defined15:41
bcwaldonjaypipes: possibly limiting the list15:41
jaypipesbcwaldon: ok, lemme go back and look... it seemed to me that the properties list resembled the v1 properties K/V list.15:42
bcwaldonjaypipes: the db api does, which the v2 controller passes on to the serializer15:43
jaypipesbcwaldon: btw, if you go to https://review.openstack.org/#/c/7316/, do you see the dependency in red, with the word [OUTDATED]?15:43
bcwaldonjaypipes: I think you just missed that last bit in the serializer where it gets converted15:43
bcwaldonjaypipes: yep15:43
*** lloydde has quit IRC15:43
jaypipesbcwaldon: do we know what that's all about?15:43
bcwaldonjaypipes: I'm tired of trying to keep these chains up to date at all times15:43
bcwaldonjaypipes: yes, the second branch in the series depends on an older patchset of the first branch15:44
jaypipesbcwaldon: how to resolve?15:44
bcwaldonjaypipes: and jenkins wont merge it until its rebased15:44
jaypipesbcwaldon: ah15:44
bcwaldonjaypipes: if we had multi-commit reviews, we wouldnt have this problem15:44
jaypipesbcwaldon: ok, Glancelot, I'm going to do another pass at review for the deployer properties patchset... sorry for the confusion.15:45
bcwaldonjaypipes: I'm glad you'r ebringing this up, I want to make sure I'm not doing anything dumb and if I'm not, that it is communicated effectively15:45
jaypipesbcwaldon: I think it would be good to remove the user- specified part of the commit message :)15:46
*** jemartin has joined #openstack-dev15:47
bcwaldonjaypipes: maybe that's a miscommunication, then15:48
bcwaldonjaypipes: so the 'allow_arbitary_attributes' option is designed to allows users to pass in arbitrary properties, but not to change the spec in any way15:48
bcwaldonjaypipes: its basically enabling a form of the 'properties' from the v1 spec15:48
jaypipesbcwaldon: hope you like my last review on https://review.openstack.org/#/c/7321/15:49
bcwaldonexcellent15:49
bcwaldonbut you're going to have to review it YET AGAIN now that I have to update branch 2 in that series15:49
jaypipesbcwaldon: hmm, so the arbitrary properties IS like the custom K/V pairs in the v1 API?! :(15:50
bcwaldonjaypipes: yes, but it doesn't define a separate container!15:50
bcwaldonjaypipes: top-level attributes, my friend15:50
jaypipesbcwaldon: ok, so what DOES it do then?15:50
bcwaldonjaypipes: its basically a switch for changing additionalProperties from {} to false15:50
jaypipesbcwaldon: so a user can change the schema then! That's what I've been saying is a bad thing...15:50
bcwaldonjaypipes: no!15:50
jaypipesugh...15:51
jaypipesbcwaldon: phone call?15:51
bcwaldonjaypipes: fine!15:51
jaypipes:)15:51
*** davidha has quit IRC15:52
*** lts has quit IRC15:53
*** jemartin has left #openstack-dev15:54
notmynamechmouel: I don't think setting the replica count to 1 for devstack is the best way to solve the problem15:54
*** jakedahn_zz is now known as jakedahn15:54
chmouelnotmyname: the high CPU on replication problem?15:55
notmynamechmouel: ya. why not set it with only one device to start with?15:58
andrewbogott_dtroyer:  When I launch 'openstack' I get TypeError: initialize_app() takes exactly 2 arguments (1 given)16:00
andrewbogott_Would you guess that that's because /I/ broke something, or because it's broken in git?16:00
*** issackelly has joined #openstack-dev16:00
andrewbogott_(I haven't tinkered with the code, I'm just trying to add an entrypoint.)16:00
*** lloydde has joined #openstack-dev16:00
chmouelnotmyname: three replicas on the same device, so using the vm_mode?16:01
dtroyerandrewbogott_: hmmm…not sure.  what command were you trying?16:01
notmynamechmouel: no, 3 replicas with one device will only end up with one copy thanks to sam's recent as-unique-as-possible patch16:01
notmynamechmouel: I'd suggest testing that config on devstack before lowering the replica count16:02
andrewbogott_I get it for everything, including a naked 'openstack'16:02
andrewbogott_Maybe I have an out-of-date cliff?16:02
chmouelnotmyname: oh I forgot about that new addition, will give it a try16:02
dtroyerpossibly.16:02
* andrewbogott_ doesn't know how to update cliff :(16:04
andrewbogott_Oh, wait, I guess it's just 'pip install update cliff'16:04
andrewbogott_...or not :(16:05
*** jdurgin has joined #openstack-dev16:05
*** lts has joined #openstack-dev16:05
jgriffithandrewbogot: Isn't it "-U"16:05
dtroyer-U or --upgrade16:06
*** issackelly has quit IRC16:06
*** kbringard has joined #openstack-dev16:07
* andrewbogott_ is, for some reason, forgetting that there is such a thing as 'man'16:07
jgriffithandrewbogott_: man shman16:07
jgriffith:)16:07
mnaserheckj: can you please provide a bit of insight on this? https://bugs.launchpad.net/keystone/+bug/99772516:10
uvirtbotLaunchpad bug 997725 in keystone "Role name is not required" [Undecided,Confirmed]16:10
heckjmnaser: lookiun16:10
heckjmnaser: your comment is dead on - little to no validation, and there should be some on all three of those areas (role names, user names, and tenant names). Additionally, user names generally need to be unique (I think that's already in there, at least with the SQL identity backend)16:12
*** salgado is now known as salgado-lunch16:13
mnaserheckj: yep, but any idea where to handle the checking so I can take care of it?  I could just modify the from_dict calls or so, but that would only mean fixing it for SQL backend16:13
mnaserheckj: Maybe make that change in the models.py to raise an exception?  Let me know if you have an idea of how you're looking to address it and I can take care of that bug16:14
heckjmnaser: I think the fix will need to be in each of the backends, with a general test around the driver API to verify it's working for all backends16:14
andrewbogott_dtroyer:  Updating cliff helped, although interactive mode seems to still be broken.16:15
zykes-someone here from nicira ?16:15
dtroyerandrewbogott_: yeah, it is for me too; I hadn't tried it in a while16:16
mnaserheckj: what do you think about instead adding it https://github.com/openstack/keystone/blob/master/keystone/identity/core.py -- so that the checking happens before we hit the backends?  I looked aronud and in Nova it seems there is no checking for emptyness on the DB side of things, only at the API end16:23
*** spiffxp has joined #openstack-dev16:23
heckjThe controllers would certainly be a reasonable place to put that code.16:25
heckjmnaser: ^^16:25
mnaserheckj: cool, i'll look into it soon16:25
mnaserAlso, gerrit related question.. if I want to submit a patch set that is dependent on a patchset in review, should I just git pull that patch and branch off it then when i'll submit a review, it'll set it up as a dependency?16:26
dtroyerandrewbogott_: Doug beat me to a fix: https://review.openstack.org/739416:26
andrewbogott_Ah, cool.16:27
heckjmnaser: that'll definitely make it a dependency. Try to avoid those as much as possible (sometimes you can't)16:28
mnaserheckj: ok good, well I made af fix in something that was refactored so i'll make teh fix under the refactored code.. should be OK16:28
*** openstack has joined #openstack-dev16:30
*** issackelly has joined #openstack-dev16:30
*** timello has quit IRC16:30
andrewbogott_dtroyer, dhellman_:  In other news... it looks like all the existing Create implementations have a get_data method but not a run method.  And yet, when I make my own Create command it seems like get_data() isn't getting called.  Am I missing something? (And, is creation really supposed to happen in get_data()?)16:31
*** maplebed has joined #openstack-dev16:31
*** garyk has quit IRC16:32
*** rbasak has quit IRC16:33
*** sdake has quit IRC16:34
*** danpb has quit IRC16:34
*** Chuanyong has quit IRC16:34
*** rods has joined #openstack-dev16:36
*** eglynn has joined #openstack-dev16:36
*** sdake has joined #openstack-dev16:37
*** dubsquared has joined #openstack-dev16:37
*** andresambrois has quit IRC16:37
*** eglynn__ has quit IRC16:37
*** davidha has joined #openstack-dev16:39
dtroyerandrewbogott_: the difference is due to the mixing classes being used for displaying output.  TBH I'm not clear why Doug split it up that way; I'd like to have the command patters match a little better.16:39
bcwaldonjaypipes and eglynn: https://review.openstack.org/#/c/7316/ can land meow16:39
jaypipesbcwaldon: alrready ahead of you :)16:40
*** vincentricci has joined #openstack-dev16:40
bcwaldonjaypipes: thanks a billion16:40
jaypipesbcwaldon: welcome a trillion.16:40
rnirmaljgriffith: https://review.openstack.org/#/c/7357/16:41
*** gael has quit IRC16:42
*** derekh has quit IRC16:44
jgriffithrnirmal: I'll look at it now...16:44
rnirmaljgriffith: ok... just wanted to point it out16:45
cp16netjgriffith: thanks for looking at it16:46
jgriffithcp16net: NP16:46
*** AlanClark has joined #openstack-dev16:47
*** timello has joined #openstack-dev16:48
andrewbogott_dtroyer:  I still don't understand.  Is it on purpose that get_data is not called for Create commands?  And, if so, why is get_data implemented for all of those commands?16:48
jaypipesdtroyer: if you get a chance... https://review.openstack.org/#/c/7308/ :) Thanks in advance!16:49
*** ayoung_afk has quit IRC16:50
vishyeglynn_: not sure the rationale behind exposing it16:50
*** ayoung has quit IRC16:50
dtroyerjaypipes: +216:50
*** ayoung has joined #openstack-dev16:50
jaypipesdtroyer: thx mate16:51
vishyrmk: the reason for the short lease is if you use force_dhcp_release then the lease only gets dropped by dnsmasq when it times out. The default value is 2 minutes btw.16:51
dtroyerandrewbogott_: get_data() is called by run() from the mixing classes (Lister, Show). Because of how run() is structured, overriding it and calling the ancestor just isn't going to work, so for those commands everything has to go into get_data()16:52
rmkvishy: I'm not sure I follow.16:52
vishyblamar, jk0, pvo, comstud: do any of you know why we do a memory check on resize?16:53
vishyrmk: dnsmasq only expires the lease when the lease is up16:53
andrewbogott_dtroyer:  so you're saying I should put my code in get_data and not override run() and all, right?16:53
vishyrmk: so the ip address would be tied up forever16:53
rmkOK makes sense.16:53
jaypipesdolphm: https://bugs.launchpad.net/keystone/+bug/99921916:53
uvirtbotLaunchpad bug 999219 in keystone "Deleting a user returns IntegrityError" [Undecided,New]16:53
vishyrmk: if you use force_dhcp_release it gets around it by forcing a release packet16:53
ayoungtermie, I'm looking at https://review.openstack.org/#/c/6716/  and trying to decide if it matches what the SQL driver does.16:54
dtroyerandrewbogott_: don't override run() if you're using get_data().  Look at the tenant commands for a working pattern...16:54
rmkDoesn't nova have control over the dhcp leases file anyway?  Why send a packet?16:54
andrewbogott_dtroyer:  That's what I did first, but I put debug lines in get_data() and it was never called...16:54
andrewbogott_But, anyway, I will tinker further.16:54
vishyrmk: so longish leases and force_dhcp_release would be fine (and recommended). Just make sure that fixed_ip_disassociate_timeout is longer than the lease time16:55
rmkThe reason I am asking is we've had dhcp issues and I'm trying to mitigate them to some extent by increasing the lease time, while trying to understand the implications before we do.16:55
vishyrmk: question: are you using vlan mode?16:55
rmkYes\16:55
*** salgado-lunch is now known as salgado16:55
vishyi can explain your dhcp issues and give you a fix :)16:55
zykes-vishy: isn't fixed_ips supposed to be deleted if you delete a ip ?16:55
zykes-ehm, network16:55
rmkvishy: Even better :)16:55
vishyrmk: i do recommend you up the lease time though, the two minute default is excessive for a large deployment16:56
rmkYeah it's leaving no margin for error, especially for guests which give up after one attempt.16:56
vishyrmk: Ok i was going to draft an email to the list about it, I was just waiting for a user to confirm that it actually fixes their problem before drafting16:56
vishybut i will do it now16:56
rmkSo I suspect we're not the only ones seeing this.16:56
vishyrmk: the quick answer is to use the version of dnsmasq that was just released16:56
mnaserCan anyone give me a bit of help on how to add create a patchset that is dependent on another one?  Do I just run the "git fetch" command that's listed there, do my changes and do a git review?16:57
vishyrmk: I will draft the email now which will explain why16:57
rmk2.61 - ok16:57
vishymnaser: yes, make sure your changes are in a separate commit16:57
vishymnaser: and you will probably need to do git-review -R16:58
vishy(no-rebase)16:58
rmkvishy: Thanks - you're saving me a lot of research time.  This has been a pretty big issue for us. :)16:58
vishyrmk: no worries, writing the email now16:58
mnaservishy: so my workflow is, git fetch from gerrit, <fixfixfix>, git commit -a, git-review -R ?16:58
*** anderstj has joined #openstack-dev16:58
vishymnaser: easier would bi git-review -d <review_num>16:59
vishy(rather than git fetch)16:59
vishyit pulls the review into a new branch16:59
vishymnaser: otherwise yes16:59
mnaservishy: I see, I was using the git fetch to get the codebase that I need from the dependent patchset, is there another way?17:00
mtaylormnaser: yeah, git review -d <review_num> will do the fetch for you into a nice new branch17:00
mtaylormnaser: for instance, if you want to make a change on top of https://review.openstack.org/#/c/7382/17:01
mtaylormnaser: just run "git review -d 7382, <fixfixfix, git commit -a, git review -R"17:01
mnasermtaylor: sweet, that makes things easier.  I will do that, thanks to vishy too17:02
vishyzykes-: it is after the patch went in that fixed it, although I recently saw a bug report that there is still an issue with it17:03
rmkvishy: I see the changelog entry in dnsmasq specific to your suggestion and Openstack.17:04
vishyrmk: :)17:10
zykes-vishy: I can confirm that :)17:10
eglynnvishy: sorry, missed your response a while back17:17
eglynnvishy: the rationale behind exposing the image mapping is to (a) enable proxies map from EC2 RunInstances to the native API call to boot the server17:17
jgriffithcp16net: Very minor nit pick17:17
eglynnvishy: & (b) allow image replication tools discover the new ami-* style ID in the destination region17:17
vishyeglynn: I guess I'm thinking of the ec2 component as separate (even though it is still in the core code base)17:18
vishyeglynn: those mapping tables belong to the ec2 layer in my mind, not core nova17:18
eglynnvishy: a-ha, so you're thinking the s3_images moves out of the nova DB?17:19
vishyeglynn: ultimately yes17:19
eglynngotcha17:19
cp16netjgriffith: thanks i dont know why that was commented out actually..17:19
vishyeglynn: I wonder if it might be better to expose the uuid as a tag or something in the ec2 layer instead17:19
*** mcclurmc_ has quit IRC17:19
cp16netjgriffith: i can fix those easily17:19
jgriffithcp16net: I do that all the time... just that and the size17:19
jgriffithcp16net: Great!!17:20
cp16net:)17:20
jgriffithcp16net: The worst is when I live a bunch of debug statements :(17:20
jgriffiths/live/leave/17:20
cp16netheh yeah or unnecessary prints17:21
*** markmcclain has quit IRC17:21
zykes-vishy: do you know why nova-network is only logging "Using DHCP for network blah" ?17:21
zykes-when I create a new VM17:21
mnaserVek: around?17:22
*** harlowja has joined #openstack-dev17:22
*** jkyle has joined #openstack-dev17:24
jgriffithcp16net: check your pep8 on the test file17:25
*** sniperd_ has quit IRC17:25
*** sniperd has joined #openstack-dev17:25
cp16netok17:25
*** Ryan_Lane has joined #openstack-dev17:30
*** markmcclain has joined #openstack-dev17:31
*** darraghb has quit IRC17:36
mnaservishy: I'm doing work on fixed IP quotas and going through the allocate_fixed_ip code, there seems to be alot of copy/pasted code between the FLAT and VLAN manager (https://github.com/openstack/nova/blob/master/nova/network/manager.py#L1187 AND https://github.com/openstack/nova/blob/master/nova/network/manager.py#L1801) --- seeing as they both are under RPCAllocateFixedIP -- do you think its ok if I create a17:38
mnaser _allocate_fixed_ip and put in the repeated code?17:38
*** davidha has quit IRC17:38
*** davidha has joined #openstack-dev17:38
vishymnaser: sure, be careful though, there might be some differences (for example the vpn handling)17:40
mnaservishy: yep, ill leave the vpn stuff alone, just the allocation part that is repeated, ill leave that in17:40
*** andresambrois has joined #openstack-dev17:44
mnaservishy: in allocate_fixed_ip flat model, if no address is specificed, it requires an elevated context to associate ip with pool ( address = self.db.fixed_ip_associate_pool(context.elevated(), ) where as in vlan, it does not ( address = self.db.fixed_ip_associate_pool(context, ) -- is that a bug or what is it supposed to be?17:45
mnaserhttps://github.com/openstack/nova/blob/master/nova/network/manager.py#L1201 and https://github.com/openstack/nova/blob/master/nova/network/manager.py#L1817 for context17:46
jkyleare there any "gotchas" with the current vishy HA configuration? the last time we deployed, there were some minor bugs like missing snat rules on vm's with floating ips.17:47
vishymnaser: it has to be elevated, but my guess is that it is actually elevated earlier somewhere17:48
vishyjkyle: the only known issue with multi_host is that you should manually disassociate and re-associate a floating ip if you are going to migrate the vm17:49
vishyrmk: email sent, should be showing up soon.17:50
rmkvishy: awesome thanks17:50
vishyzykes-: as opposed to what?17:50
jkylevishy: awesome! good to know.17:50
harlowjabcwaldon: will summit another attempt at this plugabble store stuff today, haha, pain in the butt17:51
bcwaldonharlowja: kk17:51
*** reed has joined #openstack-dev17:52
harlowjabcwaldon: think i know why the opt was saying it was duplicated, there is a check in _is_opt_registered that does this17:55
harlowjaif opts[opt.dest]['opt'] is not opt:17:55
harlowjathat is doing reference equality checking, not == checking, so when u define an opt in a function, its not going to be the same opt that it was the last time that function was called17:55
*** johnpostlethwait has joined #openstack-dev17:57
harlowjamakes me wonder about any opt defined in a function (since it will have the same problem)17:58
*** johnpostlethwait has quit IRC17:58
harlowjaor in a local class...17:58
*** johnpostlethwait has joined #openstack-dev17:58
vishymnaser: quick question, what is the use case for fixed ip quotas?17:59
vishymnaser: are you optionally giving multiple fixed ips to each vm?17:59
*** johnpostlethwait has quit IRC17:59
mnaservishy: hosting provider, fixed ips are public, customers pay $x per IP address, i want to limit them to x IPs total -- and yes, using multinic18:00
mnaservishy: so if a customer does add-fixed-ip and ran out of ips (or tries to create a server but doesnt have enough IPs) then it would stop him18:00
vishymnaser: ok, because otherwise you could just limit the instance quota18:01
vishymnaser: are you using multinic with flatdhcp?18:01
blamarvishy: was at lunch, did you get an answer to your question about memory checks on resize? Are you talking about the scheduler?18:01
vishyblamar: i didn't18:01
vishyblamar: it is in nova/compute/api.py18:01
blamarchecking18:02
vishyblamar: you were one of the people that modified the code at some point, I didn't go back and see who wrote it originally18:02
mnaseryes, however cant limit how much they can add extra ips, and no, multinic with flatmanager18:02
*** GheRivero has quit IRC18:02
*** dubsquared has quit IRC18:02
*** dolphm has quit IRC18:03
blamarvishy: I guess we just thought resizing to the same size instance didn't make sense? that seems to be the only checking I see at a glance18:04
*** issackelly has quit IRC18:04
vishyblamar: I agree that it doesn't make sense, but why on earth would we check ram for that18:04
vishyblamar: i would think we should be checking instance_type_id18:04
vishyblamar: it is perfectly reasonable to have two different flavors with the same ram...18:05
blamarvishy: yup, makes sense, I'm sold18:05
vishyblamar: but I wanted to make sure there wasn't some hidden xen reason for that check18:05
*** issackelly has joined #openstack-dev18:05
blamarwestmaas: ^^18:05
*** mrunge has joined #openstack-dev18:07
*** dolphm has joined #openstack-dev18:08
*** garyk has joined #openstack-dev18:08
vishyjgriffith: looks like we missed one https://bugs.launchpad.net/nova/+bug/99904318:09
uvirtbotLaunchpad bug 999043 in nova "Unable to retrieve details for instance due to volumes KyeError " [Undecided,New]18:09
mnaservishy: sorry for q's, hope you bear with me, is there a reason in the regular network manager that we create dns entries but not in the vpn manager, missing code or it doesnt do it if using vlan manager?18:09
mnaservishy: https://github.com/openstack/nova/blob/master/nova/network/manager.py#L1215 / https://github.com/openstack/nova/blob/master/nova/network/manager.py#L180118:10
jgriffithvishy: bummer... I'll grab it when I get back from lunch.18:10
jgriffithvishy: if it's just one I'll still be happy18:10
*** Stackops-Jorge has quit IRC18:10
zykes-vishy: what can one use for HA for instance storage ?18:11
vishymnaser: I assume it was just left out by accident but andrewbogott_ may have another explanation18:12
vishyzykes-: SAN or ceph or sheepdog i would say18:12
bcwaldoneglynn: https://review.openstack.org/#/c/7316/ could use your approval18:12
vishymnaser: I'm curious about your use of multi_nic. Are you doing flat or flatdhcp?18:14
mnaservishy: still not deploying in production but in testing, flat + public IPs as fixed IPs, i hope that makes sense, we don't want to use NAT for floating ips/etc18:15
mnaserthough we've considered flatdhcp, your input might be good to hear too?18:15
bcwaldonjaypipes and eglynn: maybe the last time we need to approve this guy: https://review.openstack.org/#/c/7321/18:16
vishymnaser: i gotcha, how are you configuring the interfaces in the guest?18:16
zykes-vishy: volume storage then ?18:17
mnaservishy: still something that we're thinking about, however, right now we have our own proprietary platform and we have a "rebuild network" that shuts down the server, builds the appropriate network file and boots it again18:17
vishyzykes-: oh sorry i misread your question18:17
mnaservishy: but thinking more flatdhcp might make things easier if it configures itself automatically18:17
zykes-vishy: I know I can use SAN yeah18:17
zykes-but could you have like a SAN in addition to say ISCSI for data storage ?18:17
eglynnbcwaldon: looking ...18:18
bcwaldoneglynn: thanks for sticking with me through this :/18:19
*** andresambrois is now known as aa18:20
vishymnaser: that sounds nasty.  :) We are looking at making cloud-init set up interfaces properly18:21
vishyzykes-: if you just want to do HA instances, you can just back the instances dir to san / gluster / ceph /etc18:21
mnaservishy: it is hell, esp on windows… I can see how cloud-init can come in very useful, and the agents too.. is cloud-init mostly for flatmanager or used for dhcp too?18:22
zykes-vishy: but does it do "locks" then so it doesn't do duplicates ?18:22
hub_caphey does python-novaclient have a way to override the service catalog like python-glanceclient?18:24
hub_capif i want to specify an endpoint and a authtoken (again, like glanceclient)18:24
hub_capif not ill code it up if no one is opposed to it18:25
hub_capvishy: ^ ^18:28
*** adjohn has joined #openstack-dev18:29
*** dachary has quit IRC18:31
*** Mkenneth has quit IRC18:33
*** maoy has joined #openstack-dev18:33
vishyzykes-: you will need to set base_dir flag18:34
*** alaski has quit IRC18:34
*** Mkenneth has joined #openstack-dev18:34
vishyhub_cap: you specify a specific endpoint yes.  Horizon uses it that way18:34
rmkvishy: which list did you send that email to?18:35
zykes-does that apply for sheepdogg as well ?18:36
*** davidha has quit IRC18:36
vishyzykes-: something like base_dir_name=_base_$host18:36
vishyzykes-: sheepdogg is for volume storage18:36
vishyrmk: openstack list18:37
*** davidha has joined #openstack-dev18:37
rmkYou could do sheepdog with a clustered fs18:37
rmkfor instance storage18:37
*** alaski has joined #openstack-dev18:37
mnaserrmk: isnt sheepdog block storage itself18:37
mnaser?18:37
rmkyes18:37
mnaserwhy add a clustered fs over it to store instances on it?18:37
rmkdistributed block storage18:37
vishyrmk: https://lists.launchpad.net/openstack/msg11696.html18:38
rmkbecause block storage != clustered filesystem18:38
rmkIf you intend to make the same block device available to multiple nodes, you need a clustered filesystem18:38
mnaseroh, you're looking for some file system that's shared between instances?18:38
rmkI'm responding to zykes- :)18:39
rmkHe's looking for HA storage solutions for instances18:39
mnaseroh, i see18:39
mnaserwasnt sure by storage = data or actaul vm drives18:39
mnaseranyways back to running tests :<18:39
rmkYeah the term "clustered filesystem" can be misleading.18:40
*** tryggvil_ has joined #openstack-dev18:41
rmkvishy: Thanks -- odd I didn't see it, I'm on that list.18:41
rmkGmail has been having problems this morning.18:41
hub_capvishy: do u have an example or the parameter to do that? i dont see how to do it in the current python-novaclient18:42
hub_capit seems to _always_ auth / use service catalog18:43
vishyhub_cap: are you talking about the command line or the library?18:43
hub_caplibrary, but also built out on the shell tool18:43
hub_capbut for my purposes the library18:43
hub_capmaybe its cuz im starting at the shell.py18:43
*** justinsb has quit IRC18:44
hub_capeven the v1_1/client.py does not have something i can pass it to specify the endpoint18:44
rmkzykes-: If you can go in any direction, I recommend ditching SANs and going the full commodity route with Ceph.18:49
*** johnpostlethwait has joined #openstack-dev18:49
rmkOr better yet, convince people to use root disks as ephemeral devices and use Swift + Volumes for anything which needs to persist.18:50
*** alaski has quit IRC18:50
*** alaski has joined #openstack-dev18:50
zykes-rmk: got a guide on Ceph?18:51
*** justinsb has joined #openstack-dev18:52
rmkzykes-: Their docs are pretty good -- http://ceph.com/docs/master/18:52
zykes-docs for it with openstack ?18:52
rmkNothing I'm aware of -- there isn't anything specific to openstack about this though.18:53
*** andrewsben_zz is now known as andrewsben18:53
*** kbringard1 has joined #openstack-dev18:54
zykes-but doesn't Ceph require images to be stored as well ? I think I read something about that18:57
*** justinsb has quit IRC18:57
*** tryggvil_ has quit IRC18:57
hub_capvishy: who can i ping on how to custom craft that url and bypass the service_catalog? Id like to get down to the bottom of this :D18:58
*** justinsb has joined #openstack-dev18:59
*** eglynn_ has joined #openstack-dev18:59
hub_capand i dont want to waste more of your time when i can waste someone elses!18:59
*** dubsquared has joined #openstack-dev18:59
*** novas0x2a|laptop has joined #openstack-dev18:59
westmaasblamar, vishy: yep agreed19:00
*** eglynn has quit IRC19:01
*** edygarcia has quit IRC19:01
*** tserong has quit IRC19:02
vishyhub_cap: look at the horizon code19:03
hub_capk19:03
*** PotHix has joined #openstack-dev19:03
zykes-rmk: how you you suggest then ?19:03
vishyhub_cap: https://github.com/openstack/horizon/blob/master/horizon/api/nova.py#L19619:04
vishypass in auth_url directly looks like19:04
hub_capsweet thx19:05
zykes-should one do ceph and then mount it or use the volume driver vishy ?19:07
rmkWe really need a way to force operations via Nova.19:07
hub_capAhh so its not something they put in the actual init() code, its just magic params u have to pass thru. thx vishy19:07
rmkI'm finding myself directly modifying database data way too often.19:07
*** vincentricci has quit IRC19:07
*** andrewsben is now known as andrewsben_zz19:08
rmkMost of the disagreements between what Nova believes and actual state surrounds volumes and/or floating IPs.19:08
*** andrewbogott_ has quit IRC19:08
*** torgomatic has joined #openstack-dev19:08
*** andrewbogott_ has joined #openstack-dev19:08
*** davidha has quit IRC19:10
*** davidha has joined #openstack-dev19:10
*** edygarcia has joined #openstack-dev19:10
*** andrewbogott_ has quit IRC19:11
*** andrewbogott_ has joined #openstack-dev19:11
*** mnewby has joined #openstack-dev19:11
*** joesavak has joined #openstack-dev19:17
*** dubsquared has quit IRC19:18
*** dachary has joined #openstack-dev19:20
davidhaHi,  does openstack support multiprocessing when running on a multi-core machien?19:21
davidhamachine19:21
devcamcardavidha: can you be more specific? there are ways to accomplish that for various components19:23
devcamcarapi services can be configured to run and make use of multiple cores19:24
devcamcarswift services can easily be configured to make use as well19:26
*** ryant has joined #openstack-dev19:30
*** katell has joined #openstack-dev19:33
*** ryant has quit IRC19:35
*** ryant has joined #openstack-dev19:35
davidhadevcamcar, lets talk about Swift as an example19:36
davidhadevcamcar, can I have multiple container servers (or account servers or object servers) serving the same directory structure?19:37
davidha(Not like SAIO where multiple nodes are mimiced by each server receiving its own seperate space)19:37
davidhaIn the devcamcar, in SAIO, each server has its own  they would all have the same "devices" config parameter (yet different "bind_port" config parameter)19:39
*** katell has left #openstack-dev19:39
*** ryant has quit IRC19:40
davidhaIn the devcamcar, in SAIO, each server has its own "devices" param  - so it is serving his own devices - this is not multiprocessing  -  all servers shold have the same "devices" config parameter which should include all devices on that node19:41
harlowjabcwaldon: https://review.openstack.org/#/c/7258/ when u get a chance19:41
davidha(ignore the previous sentance, it was sent as I was editing it)19:41
bcwaldonharlowja: I want to see what jaypipes says before I review it19:42
harlowjanp19:42
harlowjajaypipes: https://review.openstack.org/#/c/7258/19:42
harlowjashould of fixed your comments19:42
*** ryant has joined #openstack-dev19:42
devcamcardavidha: configuring multiprocessing for SAIO seems a bit pointless :)19:47
devcamcardavidha: but you can choose the number of processes to run for object/proxy/container server and make use of multiple processors19:47
annegentleten minutes until the Doc Team meeting in #openstack-meeting19:51
*** spidersddd has joined #openstack-dev19:54
*** spidersddd has left #openstack-dev19:54
*** heyho has quit IRC19:55
*** rgoodwin has joined #openstack-dev19:57
davidhadevcamcar, so one can configure a second server to run on the same set of devices? Is this a config parameter or do I need to simply create a second config file and run a second process?20:00
jaypipesharlowja: reviewed. :)20:00
*** Gordonz has quit IRC20:01
harlowjaha, sir glancelot20:02
harlowjanice20:02
devcamcardavidha: hm, i'm not sure i fully follow what you're trying to accomplish20:02
davidhadevcamcar: Lets say an 8 core machine with 24 disks serice as a full blown swift node (proxy + the three servers, object container and account) - Lets also assume I decided to run 8 object severs and a similar number of container servers, account servers and proxy servers - how do I accomplish that?20:05
devcamcardavidha: if i understand correctly, you'll want to set the "workers" option in the corresponding config files20:07
devcamcardavida: for example, https://github.com/openstack/swift/blob/master/etc/object-server.conf-sample#L520:07
devcamcardavidha: that will let you set the number of processes spawned by server type20:07
devcamcarso if you set that to 8, you'll get 8 object-server processes20:07
davidhadevcamcar: I did not notice this param - thanks, I will have a look and trace it in the code to see what it does. This is good news though :)20:09
*** andrewsben_zz is now known as andrewsben20:09
devcamcardavidha: cool, that will get you what you want20:09
davidhagreat20:09
zykes-rmk: ping, should I use ceph volumes or as a mount ?20:09
*** alaski has quit IRC20:14
*** alaski has joined #openstack-dev20:15
*** timello has quit IRC20:16
*** tryggvil_ has joined #openstack-dev20:16
*** timello has joined #openstack-dev20:17
*** mancdaz has quit IRC20:19
*** jtran has joined #openstack-dev20:24
koolhead17annegentle, around20:24
jtranhey all.   i tried submitting a bug fix and git review complained that i didn't have an individual CLA, which I thought I had a long while ago... anyway I submitted the individual CLA, got the email replies etc and i'm still getting that error when i do git review20:25
sorenallow_same_net_traffic unconditionally defaults to True. Am I missing something or won't that render security groups entirely useless when using flat (dhcp) networking? With flat networking, networks aren't specific for a project are they?20:28
sorenvishy: You probably know this without even looking ^20:28
vishysoren: you are correct20:29
vishysoren: it is leftover from when vlan was default20:29
sorenI figured as much.20:29
vishysoren: (which is still the default)20:30
vishysoren: i would like to default to multi_host flatdhcp, since that is the most common install know afaik20:30
vishy* now20:30
vishysoren: unfortunately changing defaults is a little scary :)20:30
* soren laughs in the face of danger20:31
*** stuntmachine has joined #openstack-dev20:32
*** vincentricci has joined #openstack-dev20:34
*** mrunge has quit IRC20:34
maoyjtran: you need to join the openstack-cla group on Launchpad20:35
maoyjtran: and wait until it's manually approved20:36
maoyjtran: http://wiki.openstack.org/HowToContribute20:36
*** dprince has quit IRC20:38
*** apevec has quit IRC20:43
*** openstackjenkins has quit IRC20:45
*** openstackjenkins has joined #openstack-dev20:46
*** sleepsonzzz is now known as sleepsonthefloor20:50
*** asalkeld_zzz is now known as asalkeld20:55
*** edygarcia_ has joined #openstack-dev20:56
*** apevec has joined #openstack-dev20:57
jtranmaoy, i did join that group and i think you're right i got approved by vish but i think i need one more20:58
*** andrewsben is now known as andrewsben_zz20:58
vishyjtran: most likely your emails don't match20:59
vishyjtran: your git email and launchpad email need to be the same20:59
*** edygarcia has quit IRC20:59
*** edygarcia_ is now known as edygarcia20:59
jgriffithvishy: Caught a similar miss in the ec2 version (instance foreign key still reference)21:01
jtranvishy, ok i'll double check that.  i did change my email address lately due to company migration21:01
jgriffithvishy: only other thing I saw was smoketest...21:01
vishyjgriffith: nice21:01
jgriffithvishy: Tempted to just put a fixme in smoketest for now since it's all faked21:01
jgriffithvishy: agree/disagree?21:02
vishyjgriffith: smoketest is using the api21:02
vishyjgriffith: how does it make a difference?21:02
jgriffithvishy: Hmmm...21:02
*** rkukura has quit IRC21:02
vishyjgriffith: it is talking through boto, so you shouldn't have to change anything there21:02
vishyjgriffith: as long as ec2_api is still returning the correct values21:02
jgriffithvishy: Yeah, everything runs...  Let me run smoketest to make sure21:03
jgriffithI guess that's not part of the the usual "run_tests.sh"21:03
vishyjgriffith: don't think you'll be able to run it easily :)21:03
jgriffithvishy: I was afraid of that21:04
vishyjgriffith: you'll have to source ec2 credentials21:04
vishyand then run the smoketests from the smoketests dir21:04
cp16netdragondm: could you review this please? https://review.openstack.org/#/c/7357/21:05
jgriffithvishy: Ok, I'll try it... another "new" thing for me to learn :)21:05
dragondmcp16net: will do.21:05
cp16netthanks!21:05
vishyjgriffith: ok should be able to source the euca creds through devstack21:05
vishyjgriffith: then there should be a separate run_tests in the smoketests directory (i can't remember if there is a .sh or just a .py)21:06
jgriffithvishy: great!  Thanks for the tips, starting up devstack now21:06
mnaseralmost done fixed ip quotas under the new refactored quota system, woo.21:08
*** joesavak has quit IRC21:10
*** justinsb has quit IRC21:13
*** alaski has quit IRC21:14
*** mdomsch has joined #openstack-dev21:14
*** alaski has joined #openstack-dev21:14
*** hub_cap has quit IRC21:15
*** lts has quit IRC21:16
*** alaski has quit IRC21:20
*** ywu has joined #openstack-dev21:21
dragondmcp16net: change looks good. There is one confusing comment (it was copied from instance-usage, and it's wrong there too :-> )  Fix that, and I will approve.21:25
cp16netdragondm: should i remove it from instance-audit-usage as well in this review?21:26
dragondmIf you like.21:27
cp16netdragondm: ok i updated both of the comments in instance and volume audit usage scripts21:29
cp16netdragondm: can you +2 it if you approve?21:29
dragondmya, will, do...21:31
dragondmMinor nit again, tho:21:31
cp16netdoh21:31
cp16netwhats up?21:31
dragondmis should be "for volumes|instances *existing* during the audit period."21:32
cp16netwell its a different script for each21:32
cp16netthe same script is not for both volumes and instances21:32
dragondmyes, I know.  I mean that the comment needs to be changes in each21:33
dragondmit currently says "for $item created or destroyed..." which isn't correct.21:33
cp16netahh21:33
cp16netok updated again.21:34
dragondmnit, I know, but confusing for anyone who reads the code : P21:34
dragondmthx21:34
*** sleepsonthefloor is now known as sleepsonzzz21:34
*** dubsquared has joined #openstack-dev21:35
cp16netdragondm: thanks for reviewing i thought you would be happy this is being added :)21:35
dragondmno prob. approved.21:36
jgriffithcp16net: Congrats!21:37
cp16netWOOT21:37
cp16neti will add it to that page although its on http://wiki.openstack.org/SystemUsageDataEvol21:37
jgriffithcp16net: Feel free to add to Cinder :)21:39
cp16netthat should be easy enough.21:40
jgriffith:)21:40
rnirmalcp16net: use this bp https://blueprints.launchpad.net/cinder/+spec/cinder-notifications21:40
cp16netok sounds good21:41
*** crobinso has quit IRC21:45
*** mcclurmc_ has joined #openstack-dev21:46
*** stuntmachine has quit IRC21:47
*** maoy has left #openstack-dev21:47
*** apevec has quit IRC21:53
*** maoy has joined #openstack-dev21:59
*** kbringard has quit IRC22:02
*** mcclurmc_ has quit IRC22:02
andrewbogott_dtroyer:  I'm not done with the dumb questions yet!  Where should I be looking for my openstackclient log file?22:04
dtroyerandrewbogott_: it'll be in the current directory where you run 'openstack'22:05
andrewbogott_Well, I did say it was a dumb question.22:05
andrewbogott_thank you22:05
maoyvishy: around to talk about the check_instance_lock code?22:05
dtroyerandrewbogott_: NP.  if you get a minute can you have a look at a couple of reviews: https://review.openstack.org/#/c/7394/ and https://review.openstack.org/#/c/7358/22:06
andrewbogott_yep, hoping to get to that as soon as get past my current blockage22:06
dtroyerthx22:06
vishymaoy: I"m here yes22:06
maoyvishy: great. i'm wondering what's the best behavior when there is a lock pending22:07
*** salgado is now known as salgado-afk22:08
vishymaoy: explain22:08
maoyvishy: if the request comes from the user, is a busy-doing-sth-else response more natural?22:08
maoyvishy: and some special task like terminate instance should never get the busy response22:09
vishymaoy: i think a busy response makes sense in most cases yes22:09
*** cmagina_ has joined #openstack-dev22:10
maoyvishy: i haven't looked at the periodic tasks to see which one (busy error vs wait) is better22:10
comstudWe return 409s when things aren't in an appropriate state22:10
comstudSo that might be appropriate, depending.22:10
maoycomstud: is that check in n-api?22:10
comstudMost (all?) of the current locking happens in the background on a worker.22:11
*** jtran has quit IRC22:11
comstudyea, if you raise InstanceInvalidState22:11
comstudthe API will turn it into a 40922:11
comstudIf this is all worker side.. and the API doesn't need to wait for a response, it's okay to just lock..22:11
comstudThe API really shouldn't wait for long running tasks22:11
comstudthey should be somehow made asynch22:12
maoyin theory it's possible that two API servers make conflicting decisions concurrently, right?22:12
comstudyes22:12
comstudthere are currently race conditions22:13
comstudthat we need to solve22:13
vishycomstud, maoy, I think we should pass all requests on to the worker and let the worker resolve them22:13
*** cmagina has quit IRC22:13
*** ayoung has quit IRC22:13
comstudfor instance, right now API will check if instance is ina  state that allows 'resize'.  if it is, it'll set the state to resize.  but the check and set is not atomic and it should be.22:14
comstudvishy, nod22:14
vishycomstud, maoy: api shouldn't try to figure things out because its state information may be out of date.22:14
maoyvishy: that will make the code simpler.22:14
maoyvishy: but right now the lock in worker seems to be wait by default, not fail with busy error.22:15
comstudvishy: agree, although that's not currently the case.22:15
vishycomstud: it should pass the request to the worker and the worker can decide if it is allowed and then return (starting a greenthread or some such to do the work)22:15
comstud:)22:15
*** pvo-away is now known as pvo22:15
comstudyeah, that's a decent solution22:15
comstudalthough that kind of becomes nasty w/ cells22:16
maoyhow so?22:16
vishycomstud: the alternative is distributed locking which adds a bunch of complexity that i don't think we really need.22:17
comstudmaybe not 'nasty'.  i'd like to avoid 'call's to workers as much as possible22:17
comstudUgh, no no no!22:17
comstud:)22:17
comstudI think you make the API be okay with race conditions22:17
comstudLet things fail later..22:18
comstudit'd be nice to somehow be able to check for those failures, though.22:18
*** Mkenneth has quit IRC22:20
comstudmaybe calls to cells is okay.. just need to deal with a cell potentially being unreachable at the time...22:20
comstudbecause it's on the other side of the country and someone got a little too crazy with a backhoe.22:20
maoyright now is there any call instead of cast from api to worker?22:21
comstudthere are a few calls22:21
maoyor scheduler22:21
comstudthe console calls come to mind22:22
vishycomstud: if the calls are actually async you can do that, accept the call and just update the status to failed later when the worker is reachable and says hell no22:22
*** lifeless has quit IRC22:22
comstudvishy: That's my preference long term22:22
comstudI think :)22:22
vishycomstud: although I question whether that is actually more user friendly22:22
comstudIt's not22:23
maoyi see. the console calls are sync mode anyway.22:23
vishycomstud: does a user want a 0.1 second call and a later poll for results, or a 0.2 second call with the results?22:23
*** anderstj has quit IRC22:23
comstudvishy: Yeah, I know. :)  As an API user, I'd prefer a single call for most things.  However, we do have cases right now for needing some polling mechanism.. and I think those will always be there.22:24
*** AlanClark has quit IRC22:24
comstudvishy: Like a new instance creation22:24
*** spiffxp has quit IRC22:24
vishycomstud: yes, I think the same architecture works for both, it is just whether you background the call on the api side22:25
vishycomstud: it should still be a call on the api side so it can recover from failure, it is just whether it happens in the background or inline in the user greentrhead22:25
comstudusing queues for calls is also somewhat problematic22:25
comstudsince you can later get a request.. but the API connection is long gone22:26
*** bsza has quit IRC22:26
comstudbut we definitely need queues for general work22:27
comstudanyway, kind of digressing. ;)22:27
russellbi wonder if amqp supports message expiration ...22:28
comstudi think i read something recently that it does22:29
comstudbut I might have been dreaming22:29
maoylet me try to repeat what i heard: both api and worker check for VM state. API servers might have a race condition, but the workers will serialize those calls with check_instance_lock22:29
maoythe VM state machine runs on both API and worker I guess?22:30
russellbif not, we could do expiration at the application layer, assuming clocks are synchronized ...22:30
maoyrussellb: we can always add app layer timestamps..22:30
russellbyeah, that's what i mean22:30
comstudmaoy: Mostly right.. although I'm not sure the workers really do double check the state after acquiring lock22:31
*** tryggvil_ has quit IRC22:31
comstudmaoy: There's a problem right now in that API and workers share the same state data... and they really should not.22:31
comstudalthough API state data should be based on compute state data, etc22:32
vishymaoy: check_instance_lock does not serialize calls22:32
comstudya, serialize is a bad word too22:32
vishymaoy: the serialization is only on 4 calls  649         @utils.synchronized(instance_uuid)22:32
comstudor well22:32
vishymaoy: and looks like that ^^22:33
comstudthere's no order preservation.22:33
vishymaoy: check_instance_lock just makes sure the instance hasn't been locked by an administrator before executing a command22:33
maoyvishy: got you. i misunderstood that get_lock call22:34
*** rafaduran has joined #openstack-dev22:34
vishyVek: looks like mnaser accidentally reuploaded your changesets22:34
vishyVek: when he tried to make a dependent change22:34
russellbto continue my aside, looks like Qpid and RabbitMQ both support setting a TTL on messages so they can be automatically removed from a queue once the TTL is hit.22:34
maoyvishy: so every checked_instance_lock call triggers a db call. didn't notice that..22:37
*** andrewsben_zz is now known as andrewsben22:37
*** markmc has quit IRC22:38
maoyfishy, com stud: do we allow user to terminate instance no matter what state it's in right now? sorry i haven't read much of the api code..22:39
maoyvishy, com stud: sorry.. damn the auto correction feature22:40
*** cdub has quit IRC22:40
vishymaoy: we don't but we should22:40
vishymaoy: and we should track user termination status separately from vm status22:41
vishymaoy: i believe it works in almost all states22:41
maoyvishy: why separate?22:42
vishymaoy: user experience, If a user terminates an instance it should be instantly gone imo22:43
vishymaoy: or at least instantly marked as terminated22:43
maoyvishy: sounds like power off vs shutdown?22:43
vishymaoy: power_off is different22:44
maoyvishy: some users might want clean shutdown in normal case22:44
vishymaoy: terminate means i'm done with this guest and i never want to see it again, stop billing me22:44
*** dhellmann_ is now known as dhellmann22:45
maoyvishy: got it.22:45
maoyvishy: i wonder if anyone is working on this. Phil Day's proposal is kind of closely related22:46
vishymaoy: there are lots of people working on it in different ways22:46
*** rnirmal has quit IRC22:47
*** spiffxp has joined #openstack-dev22:47
*** pixelbeat has quit IRC22:47
maoyvishy: whoever got +2 from code review wins? :)22:47
vishymaoy: well hopefully people are working together :)22:48
vishymaoy: phil's team is backlogged on their upgrade, so they won't be doing anything for a while22:48
maoyrussellb: is there a similar feature in zeroMQ for TTL? or it's so different wthat i'm speaking nonsense.22:48
vishymaoy: so it is you and johannes primarily22:48
*** pmezard has quit IRC22:49
maoyvishy: got it.22:49
vishymaoy: zeromq uses direct connections, so ttl for a message doesn't makes sense, there is already a timeout on making the connection though22:49
andrewbogott_dtroyer:  What does it mean to enable or disable a tenant for a given user?22:50
*** dubsquared has quit IRC22:51
dtroyerandrewbogott_: I'm not certain of all of the effects of disabling a tenant, but it isn't user-specific.22:51
andrewbogott_In https://review.openstack.org/#/c/7364/1/openstackclient/identity/v2_0/user.py you have args marked 'enable/disable tenant'.  Is that a copy/paste error?22:52
dtroyeryup, s/tenant/user/22:53
maoyvishy, comstud: thx!22:54
mnaservishy: i may have fixed my little blunder, i was on the wrong branch, i switched back to the branch that i was on and doing a git diff between the last two commits only show my changes..22:54
*** blamar has quit IRC22:54
vishymnaser: nice22:55
vishymaoy: yw22:55
mnaservishy: also just did a git commit ammend and not the git log has my latest one with a change id (unique to it) and git diff shows my added changes.. git-review -R is what i should try to do?22:56
*** curryboy has joined #openstack-dev22:56
andrewbogott_dtroyer, dhellmann_:  I spent the morning at the DMV, so everyone gets -1's today22:57
*** asalkeld has quit IRC22:58
*** pvo is now known as pvo-away22:58
dtroyerandrewbogott_: at least you're not in KS where the lines have been >6 hours after their new computer system went online last week...22:58
*** akscram has quit IRC22:58
andrewbogott_True!22:58
*** mdomsch has quit IRC22:58
*** asalkeld has joined #openstack-dev23:03
*** dtroyer is now known as dtroyer_zzz23:03
*** dubsquared has joined #openstack-dev23:06
*** andrewsben is now known as andrewsben_zz23:08
*** lloydde has quit IRC23:08
jgriffithvishy: Good news is I was able to get the smoketests running... bad news is they all seem to have problems (including my instance key)23:10
jgriffithvishy: I'll pick through this a bit before submitting anything for the bug23:10
*** roge has quit IRC23:10
*** dtroyer_zzz is now known as dtroyer23:13
*** gyee has joined #openstack-dev23:15
*** edygarcia has quit IRC23:26
*** salgado-afk has quit IRC23:30
*** lloydde has joined #openstack-dev23:31
*** kbringard has joined #openstack-dev23:45
*** lloydde has quit IRC23:49
*** kbringard has quit IRC23:51

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!