*** colinmcnamara has quit IRC | 00:00 | |
*** colinmcnamara has joined #openstack-meeting | 00:01 | |
*** dwcramer has joined #openstack-meeting | 00:02 | |
*** jcooley is now known as jcooley_afk | 00:06 | |
*** colinmcnamara1 has joined #openstack-meeting | 00:08 | |
*** colinmcnamara has quit IRC | 00:08 | |
*** KurtMartin has joined #openstack-meeting | 00:09 | |
*** KurtMartin has quit IRC | 00:10 | |
*** krtaylor has joined #openstack-meeting | 00:20 | |
*** colinmcnamara has joined #openstack-meeting | 00:22 | |
*** colinmcnamara1 has quit IRC | 00:24 | |
*** colinmcnamara has quit IRC | 00:27 | |
*** lloydde has quit IRC | 00:34 | |
*** lloydde has joined #openstack-meeting | 00:34 | |
*** colinmcnamara has joined #openstack-meeting | 00:36 | |
*** lloydde has quit IRC | 00:39 | |
*** hemna has joined #openstack-meeting | 00:41 | |
*** colinmcnamara has quit IRC | 00:43 | |
*** colinmcnamara has joined #openstack-meeting | 00:43 | |
*** mikal has quit IRC | 00:44 | |
*** KurtMartin has joined #openstack-meeting | 00:45 | |
*** gyee has quit IRC | 00:46 | |
*** salv-orlando_ has joined #openstack-meeting | 00:52 | |
*** salv-orlando has quit IRC | 00:52 | |
*** salv-orlando_ is now known as salv-orlando | 00:52 | |
*** sarob has joined #openstack-meeting | 00:55 | |
*** colinmcnamara has quit IRC | 01:00 | |
*** sarob has quit IRC | 01:01 | |
*** sarob has joined #openstack-meeting | 01:02 | |
*** ryanpetr_ has joined #openstack-meeting | 01:03 | |
*** lloydde has joined #openstack-meeting | 01:04 | |
*** mnewby has quit IRC | 01:06 | |
*** ryanpetrello has quit IRC | 01:06 | |
*** vipul is now known as vipul|away | 01:07 | |
*** roadTripper has quit IRC | 01:08 | |
*** lloydde has quit IRC | 01:09 | |
*** markwash has quit IRC | 01:09 | |
*** lloydde has joined #openstack-meeting | 01:09 | |
*** lloydde has quit IRC | 01:14 | |
*** vishy is now known as vishy_zz | 01:18 | |
*** ryanpetr_ has quit IRC | 01:20 | |
*** ywu_ has joined #openstack-meeting | 01:21 | |
*** dendrobates has joined #openstack-meeting | 01:23 | |
*** spiffxp-away has joined #openstack-meeting | 01:26 | |
*** vipul|away is now known as vipul | 01:32 | |
*** jcooley_afk is now known as jcooley | 01:39 | |
*** metral_ has joined #openstack-meeting | 01:42 | |
*** metral has quit IRC | 01:47 | |
*** metral_ is now known as metral | 01:47 | |
*** sarob has quit IRC | 01:47 | |
*** markmcclain has quit IRC | 01:48 | |
*** metral_ has joined #openstack-meeting | 01:52 | |
*** salv-orlando has quit IRC | 01:54 | |
*** KeithT has quit IRC | 01:55 | |
*** metral has quit IRC | 01:56 | |
*** metral_ is now known as metral | 01:56 | |
*** alexpilotti has quit IRC | 01:58 | |
*** jcooley is now known as jcooley_afk | 02:04 | |
*** jhenner has joined #openstack-meeting | 02:04 | |
*** cp16net is now known as cp16net|away | 02:09 | |
*** cp16net|away is now known as cp16net | 02:10 | |
*** blamar has quit IRC | 02:18 | |
*** jog0 has quit IRC | 02:26 | |
*** milner has quit IRC | 02:29 | |
*** dwcramer has quit IRC | 02:38 | |
*** ywu_ has quit IRC | 02:44 | |
*** ywu_ has joined #openstack-meeting | 02:44 | |
*** jhenner has quit IRC | 02:44 | |
*** ywu_ has quit IRC | 02:49 | |
*** dwcramer has joined #openstack-meeting | 02:52 | |
*** blamar has joined #openstack-meeting | 03:01 | |
*** arata has joined #openstack-meeting | 03:02 | |
*** ryanpetrello has joined #openstack-meeting | 03:15 | |
*** colinmcnamara has joined #openstack-meeting | 03:25 | |
*** blamar has quit IRC | 03:32 | |
*** bitblt has joined #openstack-meeting | 03:51 | |
*** jcooley_afk is now known as jcooley | 03:55 | |
*** maurosr has quit IRC | 03:59 | |
*** martine has joined #openstack-meeting | 04:01 | |
*** danwent has quit IRC | 04:02 | |
*** markmcclain has joined #openstack-meeting | 04:04 | |
*** redthrux has joined #openstack-meeting | 04:06 | |
*** colinmcnamara has quit IRC | 04:10 | |
*** KurtMartin has quit IRC | 04:15 | |
*** colinmcnamara has joined #openstack-meeting | 04:24 | |
*** ryanpetrello has quit IRC | 04:30 | |
*** redthrux_is_miss has joined #openstack-meeting | 04:37 | |
*** redthrux_is_miss is now known as Guest36929 | 04:37 | |
*** Guest36929 has quit IRC | 04:40 | |
*** zbitter has joined #openstack-meeting | 04:40 | |
*** redthrux has quit IRC | 04:41 | |
*** hemna_ has joined #openstack-meeting | 04:43 | |
*** zaneb has quit IRC | 04:43 | |
*** blamar has joined #openstack-meeting | 04:44 | |
*** hemna has quit IRC | 04:47 | |
*** stevebake has quit IRC | 04:49 | |
*** redthrux has joined #openstack-meeting | 04:51 | |
*** redthrux has quit IRC | 04:52 | |
*** ryanpetrello has joined #openstack-meeting | 04:56 | |
*** samkottler is now known as samkottler|out | 05:00 | |
*** blamar has quit IRC | 05:06 | |
*** stevebake has joined #openstack-meeting | 05:07 | |
*** martine has quit IRC | 05:13 | |
*** bitblt has quit IRC | 05:14 | |
*** adjohn has quit IRC | 05:18 | |
*** arata has quit IRC | 05:26 | |
*** maoy has quit IRC | 05:35 | |
*** lloydde has joined #openstack-meeting | 05:40 | |
*** lloydde has quit IRC | 05:43 | |
*** colinmcnamara has quit IRC | 05:45 | |
*** colinmcnamara has joined #openstack-meeting | 05:50 | |
*** jcooley is now known as jcooley_afk | 06:27 | |
*** ryanpetrello has quit IRC | 06:32 | |
*** markmcclain has quit IRC | 06:35 | |
*** jcooley_afk is now known as jcooley | 06:36 | |
*** colinmcnamara has quit IRC | 06:51 | |
*** ociuhandu has quit IRC | 06:54 | |
*** adjohn has joined #openstack-meeting | 07:18 | |
*** dendrobates has quit IRC | 07:20 | |
*** garyk has joined #openstack-meeting | 07:23 | |
*** ociuhandu has joined #openstack-meeting | 07:31 | |
*** mnewby has joined #openstack-meeting | 07:48 | |
*** dendrobates has joined #openstack-meeting | 08:11 | |
*** dendrobates has quit IRC | 08:11 | |
*** dendrobates has joined #openstack-meeting | 08:11 | |
*** ttrifonov_zZzz is now known as ttrifonov | 08:13 | |
*** dendrobates has quit IRC | 08:16 | |
*** rafaduran has joined #openstack-meeting | 08:42 | |
*** rafaduran has left #openstack-meeting | 08:43 | |
*** flaper87 has joined #openstack-meeting | 08:46 | |
*** garyk has quit IRC | 08:59 | |
*** jcooley is now known as jcooley_afk | 09:01 | |
*** afazekas has joined #openstack-meeting | 09:01 | |
*** garyk has joined #openstack-meeting | 09:01 | |
*** afazekas has quit IRC | 09:06 | |
*** salv-orlando has joined #openstack-meeting | 09:09 | |
*** garyk has quit IRC | 09:12 | |
*** derekh has joined #openstack-meeting | 09:16 | |
*** mnewby has quit IRC | 09:19 | |
*** afazekas has joined #openstack-meeting | 09:21 | |
*** garyk has joined #openstack-meeting | 09:27 | |
*** darraghb has joined #openstack-meeting | 09:30 | |
*** adjohn has quit IRC | 09:32 | |
*** garyk has quit IRC | 09:38 | |
*** garyk has joined #openstack-meeting | 09:42 | |
*** garyk has quit IRC | 09:48 | |
*** garyk has joined #openstack-meeting | 09:49 | |
*** almaisan-away is now known as al-maisan | 10:34 | |
*** al-maisan is now known as almaisan-away | 10:37 | |
*** dendrobates has joined #openstack-meeting | 10:49 | |
*** dendrobates has quit IRC | 10:54 | |
*** jhenner has joined #openstack-meeting | 11:09 | |
*** maurosr has joined #openstack-meeting | 11:09 | |
*** saschpe has joined #openstack-meeting | 11:13 | |
*** flaper87 has quit IRC | 11:13 | |
*** garyk has quit IRC | 11:15 | |
*** garyk has joined #openstack-meeting | 11:30 | |
*** maurosr has quit IRC | 11:37 | |
*** maurosr has joined #openstack-meeting | 11:42 | |
*** rkukura has quit IRC | 11:44 | |
*** salv-orlando_ has joined #openstack-meeting | 11:46 | |
*** salv-orlando has quit IRC | 11:46 | |
*** salv-orlando_ is now known as salv-orlando | 11:46 | |
*** salv-orlando_ has joined #openstack-meeting | 11:46 | |
*** salv-orlando has quit IRC | 11:46 | |
*** salv-orlando_ is now known as salv-orlando | 11:46 | |
*** maurosr has quit IRC | 11:51 | |
*** maurosr has joined #openstack-meeting | 11:52 | |
*** alexpilotti has joined #openstack-meeting | 12:00 | |
*** garyk has quit IRC | 12:14 | |
*** jhenner has quit IRC | 12:18 | |
*** milner has joined #openstack-meeting | 12:21 | |
*** roadTripper has joined #openstack-meeting | 12:27 | |
*** dhellmann-afk has quit IRC | 12:39 | |
*** jrd has quit IRC | 12:52 | |
*** martine has joined #openstack-meeting | 12:58 | |
*** salv-orlando_ has joined #openstack-meeting | 13:02 | |
*** salv-orlando has quit IRC | 13:02 | |
*** salv-orlando_ is now known as salv-orlando | 13:02 | |
*** markvoelker has joined #openstack-meeting | 13:04 | |
*** blamar has joined #openstack-meeting | 13:11 | |
*** blamar_ has joined #openstack-meeting | 13:12 | |
*** krtaylor has quit IRC | 13:15 | |
*** krtaylor has joined #openstack-meeting | 13:15 | |
*** blamar has quit IRC | 13:15 | |
*** blamar_ is now known as blamar | 13:15 | |
*** samkottler|out is now known as samkottler | 13:20 | |
*** maoy has joined #openstack-meeting | 13:22 | |
*** sandywalsh has joined #openstack-meeting | 13:24 | |
*** arbrandes has joined #openstack-meeting | 13:25 | |
*** garyk has joined #openstack-meeting | 13:27 | |
*** dolphm has joined #openstack-meeting | 13:28 | |
*** martine has quit IRC | 13:29 | |
*** arbrandes has quit IRC | 13:40 | |
*** martine has joined #openstack-meeting | 13:41 | |
*** jhenner has joined #openstack-meeting | 13:43 | |
*** flaper87 has joined #openstack-meeting | 13:43 | |
*** sandywalsh has quit IRC | 13:46 | |
*** flaper87 has quit IRC | 13:46 | |
*** maoy has quit IRC | 13:47 | |
*** jrd has joined #openstack-meeting | 13:48 | |
*** samkottler is now known as samkottler|bbl | 13:55 | |
*** jhenner has quit IRC | 13:56 | |
*** jhenner has joined #openstack-meeting | 13:58 | |
*** jhenner has quit IRC | 14:04 | |
*** jhenner has joined #openstack-meeting | 14:05 | |
*** dprince has joined #openstack-meeting | 14:09 | |
*** milner has quit IRC | 14:09 | |
*** milner has joined #openstack-meeting | 14:11 | |
*** primeministerp has joined #openstack-meeting | 14:18 | |
*** dhellmann has joined #openstack-meeting | 14:27 | |
*** jaypipes has joined #openstack-meeting | 14:38 | |
*** annegentle_ has joined #openstack-meeting | 14:39 | |
*** ayoung has joined #openstack-meeting | 14:40 | |
*** jcru has joined #openstack-meeting | 14:43 | |
*** yjiang51 has joined #openstack-meeting | 14:44 | |
*** yjiang51 is now known as yjiang5_away | 14:45 | |
*** markmcclain has joined #openstack-meeting | 14:45 | |
*** markmcclain has quit IRC | 14:46 | |
*** dhellmann has quit IRC | 14:47 | |
*** rkukura has joined #openstack-meeting | 14:48 | |
*** n0ano has joined #openstack-meeting | 14:49 | |
*** mattray has joined #openstack-meeting | 14:49 | |
*** mtreinish has joined #openstack-meeting | 14:51 | |
*** jcooley_afk is now known as jcooley | 14:51 | |
*** eglynn has joined #openstack-meeting | 14:53 | |
*** mestery has quit IRC | 14:55 | |
*** Pete_ has joined #openstack-meeting | 14:59 | |
nijaba | #startmeeting Ceilometer | 15:00 |
---|---|---|
nijaba | #meetingtopic Ceilometer | 15:00 |
nijaba | #chair nijaba | 15:00 |
nijaba | #link http://wiki.openstack.org/Meetings/MeteringAgenda | 15:00 |
openstack | Meeting started Thu Nov 29 15:00:02 2012 UTC. The chair is nijaba. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
*** openstack changes topic to " (Meeting topic: Ceilometer)" | 15:00 | |
openstack | The meeting name has been set to 'ceilometer' | 15:00 |
*** openstack changes topic to " (Meeting topic: Ceilometer)" | 15:00 | |
openstack | Current chairs: nijaba | 15:00 |
nijaba | ATTENTION: please keep discussion focussed on topic until we reach open discussion topic | 15:00 |
nijaba | Hello everyone! Show of hands, who is around for the ceilometer meeting? | 15:00 |
nijaba | o/ | 15:00 |
yjiang5_away | o/ | 15:00 |
eglynn | o/ | 15:00 |
n0ano | o/ | 15:00 |
nijaba | #topic actions from previous meeting | 15:01 |
nijaba | #topic eglynn drive fleshing out of nova-virt API to completion | 15:01 |
*** openstack changes topic to "actions from previous meeting (Meeting topic: Ceilometer)" | 15:01 | |
*** openstack changes topic to "eglynn drive fleshing out of nova-virt API to completion (Meeting topic: Ceilometer)" | 15:01 | |
eglynn | So lots of circular discussion on the upstream ML | 15:01 |
Pete_ | o/ | 15:01 |
eglynn | and we discussed this further on #openstack-metering yesterday | 15:01 |
eglynn | the new preferred approach is to code directly to the underlying hypervisor layer | 15:01 |
eglynn | (e.g. the libvirt API) | 15:01 |
eglynn | so as to avoid the release mgmt / versioning complexities of nova releasing a separate library | 15:02 |
nijaba | how does this differ from what we have today? | 15:02 |
eglynn | we currently code to the hypervisor driver in nova | 15:02 |
eglynn | (not to the libvirt-python API) | 15:02 |
*** dhellmann has joined #openstack-meeting | 15:03 | |
nijaba | ah, k | 15:03 |
eglynn | the latter is packaged as a separate library | 15:03 |
eglynn | (independently versioned etc.) | 15:03 |
dhellmann | o/ | 15:03 |
nijaba | but would we be able to retrieve openstack context that way (ie meta-data)? | 15:03 |
eglynn | we only use a tiny chunk of the nova hypervisor driver | 15:03 |
n0ano | does libvirt control Xen & qemu VMs in addition to KVM? | 15:03 |
eglynn | n0ano: it can do | 15:03 |
*** davidf_76 has joined #openstack-meeting | 15:04 | |
eglynn | so the idea would be also take a similar approach with xenapi etc. | 15:04 |
n0ano | does that mean it doesn't right now? | 15:04 |
eglynn | no | 15:04 |
nijaba | n0ano: it's one of 2 possibilities for xen, and it is the case for lxc | 15:04 |
n0ano | OK, but what about qemu? | 15:04 |
eglynn | it can do, if configured to do so | 15:04 |
nijaba | eglynn: not sure you got to answer my q: | 15:05 |
eglynn | yeah qemu too | 15:05 |
nijaba | but would we be able to retrieve openstack context that way (ie meta-data)? | 15:05 |
eglynn | nijaba: so that's one wrinkle | 15:05 |
nijaba | a big one... | 15:05 |
eglynn | the libvirt domain representation doesn't give us the flavor or display name | 15:05 |
dhellmann | those are pretty important details for billing | 15:06 |
eglynn | (both of which we need for metering, certainly the flavor for the instance.<type> meter is needed, display name could be dropped maybe...) | 15:06 |
nijaba | hmmm... important as in essential, yes | 15:06 |
eglynn | so we'll still have to call out to nova-api to get this info | 15:06 |
eglynn | (though we may not have to call out to it on every polling cycle) | 15:06 |
dhellmann | otoh, if we query nova for a list of instances first we wouldn't have to worry about the formula for vm names, right? | 15:06 |
eglynn | i.e. only when we see a new instance UUID | 15:06 |
nijaba | eglynn: ah, and then we could retrieve the info through standard api calls? | 15:07 |
dhellmann | how would we see that? through notifications? | 15:07 |
eglynn | nijaba: standard API, as in nova public API? | 15:07 |
yjiang5_away | dhellmann: Through novaclient or notification, either way | 15:07 |
*** andrewbogott_afk is now known as andrewbogott | 15:07 | |
nijaba | eglynn: yep? | 15:07 |
eglynn | nijaba: sure | 15:07 |
eglynn | nijaba: (that's how we list the instances currently) | 15:08 |
dhellmann | does the nova api allow queries for instances on a given host? | 15:08 |
eglynn | (i.e. we no longer go direct to the nova DB as before) | 15:08 |
yjiang5_away | dhellmann: that's curent method, nova client to get all instance on given host | 15:08 |
dhellmann | yjiang5_away: current where? in ceilometer? | 15:08 |
dhellmann | I thought we were using an internal API to talk to nova now. | 15:09 |
eglynn | yep it does | 15:09 |
yjiang5_away | dhellmann: yes, I remember we get instance for one host through novaclient? | 15:09 |
eglynn | dhellman not to grab the instance list, that goes thru the public nova API | 15:09 |
eglynn | dhellmann ^^^ | 15:09 |
dhellmann | eglynn: ah, I thought everything was internal | 15:09 |
dhellmann | ok, so we have a way to get the data without relying on internals, we just need to work out how often | 15:09 |
eglynn | so it used to be grabbed via the nova DB, but that changed recently | 15:09 |
eglynn | dhellmann: so I'm thinking every time we see a new instance UUID | 15:10 |
dhellmann | I suggest we start simple and continue to ask every time we start to poll, then optimize as a separate step after we have the libvirt wrapper built | 15:10 |
eglynn | yep reasonable | 15:10 |
dhellmann | eglynn: I don't know what you mean by "see a new instance UUID", though | 15:10 |
*** shardy has joined #openstack-meeting | 15:10 | |
dhellmann | what bit of code is seeing it? | 15:10 |
eglynn | dhellmann: when libvirt reports an instance UUID that wasn't included in the instances described by the *last* call to the public nova API | 15:11 |
dhellmann | aha, so libvirt knows the uuid? | 15:11 |
nijaba | right, we don't currently maintain any list, IIRC... | 15:11 |
dhellmann | I thought it only had a "name" or something | 15:11 |
eglynn | dhellmann: yep | 15:11 |
eglynn | dhellmann: nova uuid, and a libvirt ID, and a formated instance-000000%x tyep name | 15:12 |
dhellmann | easy, then, we can just ask libvirt for instances and then ask nova for details as we discover new ones | 15:12 |
eglynn | exactomundo! | 15:12 |
yjiang5_away | eglynn: we need check nova code invoked by ceilometer currently, to see if any thing nova added after they got information from libvirt? | 15:12 |
n0ano | so, if I understand this, we're now requiring libvirt for things to work, if you configure to use xenapi you won't get this info | 15:12 |
nijaba | ok, so who takes the action to transform the agent that way? | 15:12 |
eglynn | n0ano the idea to do the same for xenapi also | 15:13 |
nijaba | n0ano: it's already like this anyway. we currently only spport libvirt | 15:13 |
eglynn | now this may not be quite as neat with the xenapi version | 15:13 |
eglynn | (where there's some RRD file parsing needed to get the hypervisor stats reliably) | 15:13 |
*** markmcclain has joined #openstack-meeting | 15:13 | |
* eglynn needs to look into that in more detail | 15:13 | |
eglynn | yjiang5_away: I didn't understand the question | 15:13 |
n0ano | just so long as we don't forget the hypervisor APIs | 15:14 |
n0ano | s/hypervisor/other hypervisor | 15:14 |
eglynn | so I have a prototype of this working for libvirt, need to polish a bit more before proposing for review | 15:14 |
*** gpernot has joined #openstack-meeting | 15:14 | |
eglynn | n0ano: agree | 15:14 |
eglynn | should have a patch tmrw | 15:14 |
yjiang5_away | eglynn: currently we invoke nova code to fetch libvirt information,right? Did nova added anything before return to ceilometer? If yes, that added stuff should be handled by ceilometer then. | 15:14 |
nijaba | eglynn: cool, thanks. should you action yourself on this, of you may need more than a week? | 15:14 |
dhellmann | n0ano: yep, we want to support the other hypervisors, eventually | 15:14 |
jd__ | hi | 15:15 |
nijaba | hey jd__! | 15:15 |
jd__ | :) | 15:15 |
eglynn | yjiang5_away: so I've removed the direct nova usage, instead calling libvirt API directly, but based on the original nova code (the v. small subset we use...) | 15:15 |
dhellmann | eglynn: is there a blueprint for this stuff? that may make more sense than an action item | 15:15 |
eglynn | yjiang5_away: so I don't think I've missed any nova "secret sauce" | 15:16 |
nijaba | dhellmann: true | 15:16 |
eglynn | dhellmann: I'll file a BP | 15:16 |
yjiang5_away | eglynn: great. | 15:16 |
nijaba | thanks | 15:16 |
dhellmann | eglynn: cool, thanks | 15:16 |
eglynn | np! | 15:16 |
nijaba | shall we move on? | 15:16 |
eglynn | cool | 15:16 |
dhellmann | also, eglynn, double extra plus thanks for taking the lead on this. I'm *so* tired of nova breaking us. | 15:16 |
eglynn | yeah, I hear ya! | 15:16 |
nijaba | #topic yjiang5 to start a thread on transformer | 15:17 |
*** openstack changes topic to "yjiang5 to start a thread on transformer (Meeting topic: Ceilometer)" | 15:17 | |
* nijaba thanks eglynn warmly too | 15:17 | |
yjiang5_away | nijaba: yes, send mail to ML for discussion | 15:17 |
nijaba | any conclusion to report? | 15:17 |
jd__ | I think we now have a good overview of what we want | 15:18 |
yjiang5_away | no objection to the transfomer method, only concern is dhellmann think it's too flexible | 15:18 |
jd__ | yeah, how "too flexible" can be a concern, really, dhellmann ;) | 15:18 |
nijaba | dhellmann: really ? ;) | 15:18 |
dhellmann | I'm still a little worried about the notion of chaining transformers, and the complexity of configuring that. But I'm content to wait for a patch. | 15:18 |
yjiang5_away | I plan to use this method to finish CW publisher and then sent out for discussion. At that time, we will have a solid base patch for future discussion. | 15:19 |
jd__ | works for me | 15:19 |
dhellmann | the more complicated it is, the more likely someone will have trouble setting it up | 15:19 |
eglynn | yjiang5_away: cool | 15:19 |
dhellmann | yjiang5_away: excellent | 15:19 |
yjiang5_away | dhellmann: yes, so I think mostly they should use default one. | 15:20 |
nijaba | yjiang5_away: action? | 15:20 |
dhellmann | yjiang5_away: right. but then what's the point of building a configuration system? :-) | 15:20 |
yjiang5_away | dhellmann: some advanced user, or someone may want to add special metrics themselves through configuration | 15:20 |
jd__ | dhellmann: evolution! :) | 15:20 |
yjiang5_away | nijaba: yes, my action to send patches for transformer | 15:21 |
dhellmann | yjiang5_away: OK. I just prefer to add features one at a time. Multiple publishers first, then deployer configuration for them. | 15:21 |
nijaba | #action yjiang5_away to send patches for transformer | 15:21 |
eglynn | so in terms of configuration, should be mostly pre-canned right? | 15:21 |
nijaba | #topic eglynn to report on synaps' decision | 15:21 |
*** openstack changes topic to "eglynn to report on synaps' decision (Meeting topic: Ceilometer)" | 15:21 | |
eglynn | the synaps guys have come to a conclusion | 15:22 |
eglynn | and they want to come on board | 15:22 |
eglynn | w00t! | 15:22 |
nijaba | \o/ | 15:22 |
dhellmann | +1 | 15:22 |
shardy | +1 :) | 15:22 |
eglynn | but have limited bandwidth initially (other internal demands on their time) | 15:22 |
jd__ | great :) | 15:22 |
dhellmann | don't we all | 15:22 |
eglynn | so I'm proposing to have the conversation now on the upstream ML | 15:22 |
nijaba | that's fine. Let's make sure we help them feel "at home" | 15:23 |
eglynn | (re-)invite them on board and discuss the mechanics of bringing their code under the ceilo umbrella | 15:23 |
yjiang5_away | dhellmann: yes, I'm now working on multiple publisher | 15:23 |
eglynn | so we'll have a good starting point I think for a standalone monitoring solution | 15:23 |
eglynn | I have a lundry list of initial tasks that I'll translate to blueprints | 15:23 |
eglynn | #action eglynn kick off Synaps discussion on upstream ML | 15:24 |
nijaba | #topic nijaba to get rid of roadmap page content to point to lp | 15:24 |
nijaba | This was done, see: | 15:24 |
nijaba | #link http://wiki.openstack.org/EfficientMetering/RoadMap | 15:24 |
*** openstack changes topic to "nijaba to get rid of roadmap page content to point to lp (Meeting topic: Ceilometer)" | 15:24 | |
nijaba | #topic dhellmann test more lenient anyjson support for folsom and grizzly compatibility | 15:25 |
*** openstack changes topic to "dhellmann test more lenient anyjson support for folsom and grizzly compatibility (Meeting topic: Ceilometer)" | 15:25 | |
nijaba | I think this was done and merged | 15:25 |
dhellmann | yes, that's in now | 15:25 |
nijaba | dhellmann: correct? | 15:25 |
dhellmann | or at least up for review | 15:25 |
nijaba | perfect, thanks! | 15:25 |
nijaba | #topic dhellmann update user-api blueprint | 15:25 |
*** openstack changes topic to "dhellmann update user-api blueprint (Meeting topic: Ceilometer)" | 15:25 | |
dhellmann | just checked and it has merged | 15:25 |
dhellmann | I did update that blue print with a link to a wiki page where I described the work a bit | 15:26 |
nijaba | dhellmann: http://wiki.openstack.org/spec-ceilometer-user-api? | 15:26 |
dhellmann | yes | 15:26 |
nijaba | #link http://wiki.openstack.org/spec-ceilometer-user-api | 15:26 |
*** samkottler|bbl is now known as samkottler | 15:27 | |
nijaba | any action, appart from coding, left? | 15:27 |
dhellmann | no, I don't think so | 15:27 |
dhellmann | I'm waiting to start coding until my WSME conversion is completed | 15:27 |
nijaba | thanks! | 15:27 |
dhellmann | baby steps... | 15:27 |
nijaba | #topic dhellmann update pecan port blueprint | 15:27 |
*** openstack changes topic to "dhellmann update pecan port blueprint (Meeting topic: Ceilometer)" | 15:27 | |
dhellmann | I've updated the blueprint with some details | 15:28 |
nijaba | dhellmann: you had a lot of action! | 15:28 |
dhellmann | I have the port to pecan complete, but ran into an issue with WSME so haven't finished that part yet | 15:28 |
dhellmann | I hope to have that done before I go on vacation next weekend | 15:28 |
nijaba | #link http://wiki.openstack.org/spec-ceilometer-api-server-pecan-wsme | 15:28 |
dhellmann | then we can look at asalkeld's ideas for changes to the API and terminology (most of which I really like) | 15:29 |
nijaba | sounds good | 15:29 |
eglynn | cool | 15:29 |
jd__ | "action week" | 15:29 |
nijaba | #topic zykes to report status on Bufunfa / BillingStack port | 15:29 |
*** openstack changes topic to "zykes to report status on Bufunfa / BillingStack port (Meeting topic: Ceilometer)" | 15:29 | |
*** mestery has joined #openstack-meeting | 15:29 | |
* dhellmann is cramming work in before going out for 2 weeks | 15:29 | |
eglynn | zykes- there? | 15:30 |
* nijaba think dhellmann won't be able to do any work after having dinner with jd and him | 15:30 | |
nijaba | does not look like he is around, let's move on | 15:30 |
* dhellmann wasn't planning on it | 15:30 | |
nijaba | #topic Bug squashing day | 15:30 |
nijaba | It was proposed to organize a bug squashing day, or bugfest... | 15:30 |
*** openstack changes topic to "Bug squashing day (Meeting topic: Ceilometer)" | 15:30 | |
nijaba | so, when should this be? | 15:31 |
eglynn | what's our bug queue length like? | 15:31 |
nijaba | just before g2 release? | 15:31 |
dhellmann | just before g2, during g3, both? | 15:31 |
eglynn | it's good to have a pre-prepared list of low hanging fruit | 15:31 |
eglynn | (for noobs who happen upon the bug squshing day ...) | 15:32 |
nijaba | eglynn: 64 open bugs of all sorts | 15:32 |
jd__ | nijaba: :)) | 15:32 |
eglynn | so we should triage this queue and try to identify some nice self-contained fixes | 15:32 |
jd__ | a first one I think before g2 would be good idea | 15:32 |
eglynn | (and resist the temptation to fix them ourselves!) | 15:33 |
eglynn | jd__ agree | 15:33 |
nijaba | eglynn: only 9 of them need triaging (new) | 15:33 |
eglynn | cool | 15:34 |
nijaba | 30 are either new, confirmed or triaged, quite a few of them wishlist | 15:34 |
eglynn | so at least two things we can acheive with such a bug day: 1. drive quality 2. find some new active contributors | 15:34 |
eglynn | for #2, wishlist low-priority bugs are fine | 15:35 |
dhellmann | 12 are effort-s, too | 15:35 |
nijaba | ok, so g2 is jan 10. bug day on jan 7th (monday)? | 15:35 |
eglynn | hmmm, that seems a bit tight | 15:35 |
eglynn | maybe late on the week before? | 15:36 |
dhellmann | 3rd or 4th? | 15:36 |
nijaba | eglynn: I am afraid of hangover or vacations if we do that the week before | 15:36 |
eglynn | (otherwise we may be getting jumpy about regressions) | 15:36 |
eglynn | nijaba: a-ha, Ok, forgot about that ;) | 15:36 |
jd__ | oh I think 3rd or 4th should be almost hangover free | 15:37 |
jd__ | not sure about vacations though | 15:37 |
nijaba | ok, let's vote then ;) | 15:37 |
jd__ | anyway, both are fine for me | 15:37 |
eglynn | so if we go with the 7th, some of the bug day fixes will prolly miss g2 | 15:37 |
eglynn | (but maybe that's OK) | 15:37 |
eglynn | (g3 will be along soon enough...) | 15:38 |
yjiang5_away | eglynn: agree | 15:38 |
nijaba | #startvote when to do bugday? jan4, jan7 | 15:38 |
openstack | Begin voting on: when to do bugday? Valid vote options are jan4, jan7. | 15:38 |
openstack | Vote using '#vote OPTION'. Only your last vote counts. | 15:38 |
nijaba | #vote jan7 | 15:38 |
yjiang5_away | #vote jan7 | 15:38 |
eglynn | #vote jan4 | 15:38 |
n0ano | #vote jan4 | 15:38 |
dhellmann | #vote jan4 | 15:38 |
jd__ | #vote jan4 | 15:38 |
nijaba | 20 sec countdown | 15:38 |
nijaba | #endvote | 15:39 |
openstack | Voted on "when to do bugday?" Results are | 15:39 |
openstack | jan4 (4): jd__, n0ano, dhellmann, eglynn | 15:39 |
openstack | jan7 (2): yjiang5_away, nijaba | 15:39 |
*** ryanpetrello has joined #openstack-meeting | 15:39 | |
jd__ | eat that January 7th! | 15:39 |
nijaba | #agreed bugday on jan 4th | 15:39 |
* n0ano we have a mandate :-) | 15:39 | |
nijaba | ok, I guess we'll define the date for g3 later? | 15:40 |
nijaba | based on our experience? | 15:40 |
eglynn | yep makes sense | 15:40 |
dhellmann | nijaba: +1 | 15:40 |
dhellmann | maybe not so close to the deadline next time :-) | 15:40 |
nijaba | let's move on then | 15:40 |
nijaba | #topic Review blueprints and progress | 15:40 |
*** openstack changes topic to "Review blueprints and progress (Meeting topic: Ceilometer)" | 15:40 | |
nijaba | so, I think we should define a close date for blueprint validation | 15:41 |
nijaba | g2 and g3 are coming up fast | 15:41 |
*** rohitk has joined #openstack-meeting | 15:41 | |
nijaba | so I think if we have not agreed on a bp fore dec 15th, we should probably can it.... | 15:41 |
dhellmann | that seems reasonable | 15:41 |
dhellmann | what's the process for "agreeing"? | 15:42 |
dhellmann | discusson the list? | 15:42 |
jd__ | I guess | 15:42 |
eglynn | that's a deadline for g2 only? (or for grizzly in general?) | 15:42 |
nijaba | we don't have a formal agreement process, but consensus on the features and how to achve it is what we have done bfore | 15:42 |
nijaba | eglynn: in general | 15:42 |
eglynn | k | 15:42 |
dhellmann | ok, I just want to make sure I get the agreements I need | 15:43 |
nijaba | #startvote agree on dec 15th for bluprint "freeze"? yes, no, abstain | 15:44 |
openstack | Begin voting on: agree on dec 15th for bluprint "freeze"? Valid vote options are yes, no, abstain. | 15:44 |
openstack | Vote using '#vote OPTION'. Only your last vote counts. | 15:44 |
nijaba | #vote yes | 15:44 |
dhellmann | #vote yes | 15:44 |
eglynn | #vote yes | 15:44 |
jd__ | #vote yes | 15:44 |
n0ano | #vote yes | 15:44 |
yjiang5_away | #vote yes | 15:44 |
nijaba | #endvote | 15:44 |
openstack | Voted on "agree on dec 15th for bluprint "freeze"?" Results are | 15:44 |
openstack | yes (6): n0ano, jd__, nijaba, eglynn, yjiang5_away, dhellmann | 15:44 |
*** jcru is now known as jcru|away | 15:45 | |
nijaba | #agreed blueprint freeze on dec 15th | 15:45 |
nijaba | #topic Discuss suggested re-narrowing of project scope for grizzly versus user-oriented monitoring | 15:45 |
*** openstack changes topic to "Discuss suggested re-narrowing of project scope for grizzly versus user-oriented monitoring (Meeting topic: Ceilometer)" | 15:45 | |
eglynn | so this topic was motivated by markmc's observations on the ML: http://lists.openstack.org/pipermail/openstack-dev/2012-November/003348.html | 15:45 |
nijaba | I think this was proposed by someone outside of the project | 15:45 |
nijaba | I am currently not too afraid of this | 15:45 |
nijaba | what do you guys think? | 15:46 |
nijaba | specially now that we have a bp freeze | 15:46 |
*** alexpilotti has quit IRC | 15:46 | |
dhellmann | I think some of this was brought about by the "thrashing" of the discussion of how to handle monitoring | 15:46 |
eglynn | well Synaps will give us a (user-oriented) monitoring service, and multi-publish will give the ability to push metrics into that | 15:47 |
dhellmann | yes, so now we have a more defined direction | 15:47 |
eglynn | but I agree that extending ourselves to also cover system oriented monitoring / instrumentation now would be a bridge too far | 15:47 |
*** dendrobates has joined #openstack-meeting | 15:47 | |
*** dendrobates has joined #openstack-meeting | 15:47 | |
eglynn | (for grizzly anyway) | 15:47 |
nijaba | eglynn: on this I tend to agree, but we don't even have the start of a bp for it | 15:48 |
eglynn | by system oriented monitoring I mean cloud-operator-focussed | 15:48 |
dhellmann | yes, I think we need to start differentiating between short term and long term goals for these new features | 15:48 |
nijaba | so I was seeing it as dicussions for h | 15:48 |
n0ano | I'm more interested in system monitoring but I'm more than willing to address that post-grizzly | 15:48 |
eglynn | cool | 15:48 |
nijaba | but we should definitily continue the discussion | 15:48 |
dhellmann | agreed | 15:48 |
eglynn | yep | 15:48 |
nijaba | ok, cool!!! | 15:49 |
n0ano | discussion - yes, actively push code upstream - not just yet | 15:49 |
jd__ | agreed | 15:49 |
nijaba | #topic multi-publisher blueprint | 15:49 |
*** openstack changes topic to "multi-publisher blueprint (Meeting topic: Ceilometer)" | 15:49 | |
jd__ | until there's any code, that's just kind of useless discussion anyway :) | 15:49 |
yjiang5_away | I'm working on the patch now | 15:49 |
nijaba | I think we are getting close to have an agreement on this on right? | 15:49 |
eglynn | cool | 15:49 |
yjiang5_away | nijaba: yes | 15:49 |
jd__ | yeah, yjiang5_away is doing the grunt work :) | 15:49 |
nijaba | thanks yjiang5_away | 15:50 |
yjiang5_away | :) | 15:50 |
eglynn | seconded! | 15:50 |
nijaba | #topic multi-dimensions bp | 15:50 |
*** openstack changes topic to "multi-dimensions bp (Meeting topic: Ceilometer)" | 15:50 | |
dhellmann | link? | 15:50 |
nijaba | so this is a new one that jd and I came up with | 15:50 |
*** jcru|away is now known as jcru | 15:50 | |
*** maoy has joined #openstack-meeting | 15:51 | |
dhellmann | #link http://wiki.openstack.org/Ceilometer/blueprints/multi-dimensions | 15:51 |
nijaba | #link https://blueprints.launchpad.net/ceilometer/+spec/multi-dimensions | 15:51 |
nijaba | hehe | 15:51 |
*** cp16net is now known as cp16net|away | 15:51 | |
*** grapex1 has joined #openstack-meeting | 15:51 | |
nijaba | so the question left on this one is wether we need to express complex dimension with & nd | or not | 15:51 |
nijaba | I think we could propose only & for a first version | 15:52 |
jd__ | I think too | 15:52 |
eglynn | agreed | 15:52 |
dhellmann | nijaba: +1 | 15:52 |
nijaba | and extend it later if needed | 15:52 |
jd__ | or can be achieved with multiple request easily for now | 15:52 |
dhellmann | I don't care for the syntax described, but the intent is good | 15:52 |
nijaba | #action nijaba to update the bp to specify complex request in a future version | 15:53 |
nijaba | dhellmann: feel free to prppose a syntax :) | 15:53 |
dhellmann | nijaba: something more closely resembling a regular GET request would be easier to handle | 15:53 |
nijaba | dhellmann: that reminds me of what jd was suggesting | 15:54 |
nijaba | &key=string&key=string.... | 15:54 |
dhellmann | nijaba: right. let me work up an example using a syntax WSME supports :-) | 15:55 |
nijaba | ok, I'll wait for your example then. thanks | 15:55 |
dhellmann | the controller method would get an array of dimension objects as an argument if we do it right | 15:55 |
nijaba | perfect | 15:55 |
nijaba | that was the idea | 15:55 |
*** cp16net|away is now known as cp16net | 15:55 | |
dhellmann | #action dhellmann to prepare example of dimension query syntax that will work with WSME | 15:56 |
nijaba | #topic Discuss adopting asalkeld's client implementation officially | 15:56 |
*** openstack changes topic to "Discuss adopting asalkeld's client implementation officially (Meeting topic: Ceilometer)" | 15:56 | |
nijaba | I am actually all for this proposal | 15:57 |
nijaba | anything blocking? | 15:57 |
jd__ | what's asalkeld version? | 15:57 |
eglynn | so when zykes- asked about CLIs a few days ago, I was surprised there were so many | 15:57 |
* dhellmann looks for link | 15:57 | |
jd__ | I though dhellmann had one under its foot | 15:57 |
dhellmann | #link https://github.com/asalkeld/python-ceilometerclient | 15:57 |
*** hemna_ has quit IRC | 15:57 | |
dhellmann | jd__: ours is much more primitive | 15:57 |
dhellmann | asalkeld used the "standard" client model | 15:58 |
dhellmann | much more complete | 15:58 |
dhellmann | we really need a client lib | 15:58 |
jd__ | ok :) | 15:58 |
eglynn | sounds like the one to row in behind | 15:58 |
nijaba | anyone against? | 15:58 |
eglynn | nope | 15:59 |
jd__ | didn't look at the code, but I'm probably not against anyway | 15:59 |
* nijaba needs to run to deliver a speech, sorry to be in a hurry | 15:59 | |
dhellmann | I'm obviously in favor | 15:59 |
jd__ | can we put that into openstack'core/incubated? | 15:59 |
dhellmann | that's the idea, to have another git repo setup for it with CI integration, etc. | 15:59 |
yjiang5_away | jd__: normally client is a seperated project? | 15:59 |
jd__ | yjiang5_away: yes | 15:59 |
nijaba | #agreed adopt asalkeld's client officially | 15:59 |
jd__ | dhellmann: perfect, what do we have to do for that? | 15:59 |
dhellmann | jd__: dunno | 16:00 |
eglynn | yjiang5: seperate repo, but same overall project? | 16:00 |
dhellmann | talk to the infra team, I guess | 16:00 |
jd__ | #action move asalkeld's client into openstack incubation/core | 16:00 |
nijaba | do you guys mind to continue the discussion on our chan? I need to run :/ | 16:00 |
dhellmann | that needs an owner | 16:00 |
jd__ | #action jd__ move asalkeld's client into openstack incubation/core | 16:00 |
jd__ | nijaba: #chair me I'll finish | 16:00 |
dhellmann | nijaba: I think we're done | 16:00 |
nijaba | #chair jd__ | 16:00 |
dhellmann | or maybe not | 16:00 |
openstack | Current chairs: jd__ nijaba | 16:00 |
jd__ | run nijaba! run! | 16:00 |
nijaba | jd__: thanks, did not know I could do that during the meeting | 16:00 |
* nijaba waves and run | 16:01 | |
* eglynn wonders if we've any sharable presentation collateral? | 16:01 | |
eglynn | (giving a talk to an Irish openstack user group next week on ceilo/monitoring etc.) | 16:01 |
jd__ | #topic open discussion | 16:02 |
*** openstack changes topic to "open discussion (Meeting topic: Ceilometer)" | 16:02 | |
eglynn | http://www.meetup.com/OpenStack-Ireland/events/92413652/ | 16:02 |
yjiang5_away | eglynn: I remmeber jd__ sent some in IRC before | 16:02 |
jd__ | eglynn: I've the ones we used with nijaba a few weeks ago | 16:02 |
jd__ | https://docs.google.com/presentation/d/1i30roVZp00Wvo46F4k5CT98sw2uMgaf5Lh3bSfiQ-Cg/edit#slide=id.p | 16:02 |
eglynn | jd__, yjiang5: cool | 16:02 |
eglynn | thanks, I may borrow liberally ;) | 16:03 |
yjiang5_away | jd__: can we put into ceilometer launchpad? | 16:03 |
dhellmann | yjiang5_away: good idea | 16:04 |
jd__ | sure | 16:04 |
yjiang5_away | jd__: thanks. | 16:04 |
dhellmann | yjiang5_away: even better, let's add a link to our docs | 16:05 |
yjiang5_away | dhellmann: yep, and eglynn can add his new one after finish the talking :) | 16:05 |
dhellmann | speaking of docs, the jenkins job to build them is now working | 16:05 |
eglynn | yjiang5: yep, will do! | 16:05 |
dhellmann | #link http://docs.openstack.org/developer/ceilometer/ | 16:05 |
dhellmann | I opened a bug to fix the styling | 16:06 |
jd__ | awesome | 16:06 |
dhellmann | does someone have time to talk to the doc team about whether something will link to us? | 16:06 |
dhellmann | I don't know what we have to do to get a link on the project list, for example | 16:07 |
jd__ | bribe someone I guess | 16:07 |
jd__ | somebody for some #action ? | 16:07 |
yjiang5_away | dhellmann: So basically contacct with doc team? | 16:08 |
dhellmann | yjiang5_away: yes, we need someone to email them and ask what to do next | 16:08 |
yjiang5_away | dhellmann: I'm glad to help | 16:08 |
dhellmann | great! want to take an #action item? | 16:09 |
yjiang5_away | dhellmann: yes, but I don't know how to #action yet :$ | 16:09 |
dhellmann | just type it out :-) | 16:09 |
eglynn | yjiang5_away: #action yjiang description | 16:09 |
dhellmann | yep | 16:09 |
yjiang5_away | #action talk with doc team to link to ceilometer docs | 16:10 |
*** dolphm has quit IRC | 16:10 | |
jd__ | you forgot your nickname after #action I think :) | 16:10 |
yjiang5_away | #action yjiang5 talk with doc team to link to ceilometer docs | 16:10 |
dhellmann | +1 | 16:10 |
jd__ | that's one seems right! | 16:10 |
jd__ | anything else for today? | 16:10 |
yjiang5_away | :) | 16:11 |
*** redthrux has joined #openstack-meeting | 16:11 | |
jd__ | last call! | 16:11 |
eglynn | and that's a wrap I think ... | 16:11 |
dhellmann | I'm done | 16:11 |
jd__ | #endmeeting | 16:11 |
*** openstack changes topic to "OpenStack meetings || Development in #openstack-dev || Help in #openstack" | 16:11 | |
openstack | Meeting ended Thu Nov 29 16:11:49 2012 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:11 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/ceilometer/2012/ceilometer.2012-11-29-15.00.html | 16:11 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/ceilometer/2012/ceilometer.2012-11-29-15.00.txt | 16:11 |
openstack | Log: http://eavesdrop.openstack.org/meetings/ceilometer/2012/ceilometer.2012-11-29-15.00.log.html | 16:11 |
jd__ | thanks guys! | 16:11 |
n0ano | tnx | 16:12 |
eglynn | yep thanks all, productive as usual ... | 16:12 |
dhellmann | thanks, everyone | 16:12 |
*** jrodom has joined #openstack-meeting | 16:13 | |
*** jrodom has quit IRC | 16:13 | |
*** jrodom has joined #openstack-meeting | 16:13 | |
*** yjiang5_away has quit IRC | 16:13 | |
*** afazekas has quit IRC | 16:16 | |
*** dolphm has joined #openstack-meeting | 16:17 | |
*** alexpilotti has joined #openstack-meeting | 16:17 | |
*** mnewby has joined #openstack-meeting | 16:18 | |
*** ryanpetrello has quit IRC | 16:20 | |
*** ryanpetrello has joined #openstack-meeting | 16:21 | |
*** openstack_newbe2 has quit IRC | 16:22 | |
*** cbaeseman has joined #openstack-meeting | 16:24 | |
*** samkottler is now known as samkottler|out | 16:24 | |
*** sandywalsh has joined #openstack-meeting | 16:25 | |
*** grapex1 has quit IRC | 16:27 | |
*** Pete_ has quit IRC | 16:32 | |
*** Mandell has quit IRC | 16:38 | |
*** torandu has joined #openstack-meeting | 16:40 | |
*** chunwang has joined #openstack-meeting | 16:41 | |
*** mestery has quit IRC | 16:43 | |
*** ryanpetrello has quit IRC | 16:47 | |
*** jrodom has quit IRC | 16:47 | |
*** spiffxp-away has left #openstack-meeting | 16:51 | |
*** ravkumar_hp has joined #openstack-meeting | 16:55 | |
*** jcru has quit IRC | 16:56 | |
*** jcooley is now known as jcooley_afk | 16:58 | |
*** donaldngo has joined #openstack-meeting | 16:58 | |
*** jcru has joined #openstack-meeting | 16:58 | |
*** donaldngo has quit IRC | 17:00 | |
*** donaldngo has joined #openstack-meeting | 17:00 | |
*** markvan has joined #openstack-meeting | 17:00 | |
sdague | davidkranz: qa meeting time? | 17:01 |
davidkranz | Any other QA'ers here? | 17:01 |
ravkumar_hp | Ravi here | 17:01 |
*** openstack_newbe1 has joined #openstack-meeting | 17:01 | |
krtaylor | o/ | 17:01 |
chunwang | Chun Wang (English name is April) here. | 17:02 |
davidkranz | #startmeeting qa | 17:02 |
openstack | Meeting started Thu Nov 29 17:02:34 2012 UTC. The chair is davidkranz. Information about MeetBot at http://wiki.debian.org/MeetBot. | 17:02 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 17:02 |
*** openstack changes topic to " (Meeting topic: qa)" | 17:02 | |
openstack | The meeting name has been set to 'qa' | 17:02 |
donaldngo | Donald here | 17:02 |
*** jrodom has joined #openstack-meeting | 17:03 | |
sdague | <- here | 17:03 |
*** dwalleck has joined #openstack-meeting | 17:03 | |
davidkranz | jaypipes, dwalleck: You guys here? | 17:03 |
*** TheEstablishment has joined #openstack-meeting | 17:03 | |
dwalleck | just got here | 17:03 |
*** rax-sam has joined #openstack-meeting | 17:04 | |
davidkranz | Looks like the tempest swift tests will be part of the gate as soon as the devstack fix is approved. | 17:04 |
*** rax-Jose has joined #openstack-meeting | 17:04 | |
*** danwent has joined #openstack-meeting | 17:04 | |
dwalleck | nice | 17:04 |
ravkumar_hp | davidkranz: that would be grat | 17:05 |
sdague | davidkranz: which devstack fix is that? | 17:05 |
sdague | I can take a look | 17:05 |
ravkumar_hp | we are working on some new test for Swift | 17:05 |
davidkranz | sdague: Any progress on the "instances go to ERROR" issue? | 17:05 |
*** blogan-RAX has joined #openstack-meeting | 17:05 | |
sdague | davidkranz: mtreinish is looking into it today, the problem is it's hard to reproduce | 17:05 |
sdague | I expect our systems are too fast | 17:06 |
davidkranz | sdague: https://review.openstack.org/#/c/17119/ | 17:06 |
sdague | so he was going to try to run it in a kvm guest to slow it down | 17:06 |
sdague | which is the way ci is run anyway | 17:06 |
davidkranz | sdague: Yeah, this is probably acting as a lame stress test in the ci setup. | 17:07 |
davidkranz | sdague: I would really like to get some stress tests in the nightly build. | 17:07 |
sdague | ok, devstack patch approved | 17:07 |
dwalleck | I'm going to kick a merge prop in today that should add the reason for a server going into error status into the logging as well, should help wiht debugging | 17:07 |
*** jrodom has quit IRC | 17:07 | |
davidkranz | sdague: Thanks. We'll see if anything blows up :) | 17:07 |
*** longshot has joined #openstack-meeting | 17:07 | |
sdague | dwalleck: great | 17:07 |
*** jrd has quit IRC | 17:07 | |
sdague | davidkranz: well that devstack patch was just adding another variable to config tempest, so I hope not :) | 17:08 |
*** TheEstablishment has quit IRC | 17:08 | |
davidkranz | sdague: Yeah. I just meant that those tests will now start running in all project gates. | 17:08 |
*** jrodom has joined #openstack-meeting | 17:08 | |
sdague | davidkranz: cyeoh on my team is starting to look at the blueprint for converting tempest to testr/testtools. So expect to start to see some activity on that one in the next week or so. | 17:09 |
*** openstack_newbe1 has quit IRC | 17:09 | |
davidkranz | chunwang put in a blueprint for customized-test-launcher script | 17:10 |
*** rkukura has quit IRC | 17:10 | |
*** krtaylor has quit IRC | 17:10 | |
*** dwcramer has quit IRC | 17:10 | |
*** lifeless has quit IRC | 17:10 | |
*** ndipanov has quit IRC | 17:10 | |
*** cp16net has quit IRC | 17:10 | |
*** radez_g0n3 has quit IRC | 17:10 | |
*** radez_g0n3 has joined #openstack-meeting | 17:10 | |
*** dwcramer has joined #openstack-meeting | 17:11 | |
*** lifeless has joined #openstack-meeting | 17:11 | |
*** rkukura has joined #openstack-meeting | 17:11 | |
*** krtaylor has joined #openstack-meeting | 17:11 | |
davidkranz | I think that blueprint needs some more information about how it integrates with parallel execution and what the main purpose is. | 17:11 |
*** ndipanov has joined #openstack-meeting | 17:11 | |
*** cp16net has joined #openstack-meeting | 17:11 | |
chunwang | yes, the blueprint is a work around and improvement based on the issues currently we found during tempest execution... | 17:11 |
dwalleck | do we know yet if a testtools solution is viable? I thought someone was going to do a prototype | 17:12 |
chunwang | Actually I think it's not parallel execution, but a batch run of the tempest cases, and with the customized test case list and environment clean module | 17:12 |
*** ociuhandu_ has joined #openstack-meeting | 17:12 | |
sdague | dwalleck: that will be cyeoh | 17:13 |
sdague | going to assume that it's workable, and if not, he'll flag that as an issue :) | 17:13 |
ravkumar_hp | sdague: cyeoh wil analyze testtools for parallel execution also . right? | 17:13 |
sdague | yes | 17:13 |
sdague | chunwang: url for your blueprint? | 17:14 |
chunwang | https://blueprints.launchpad.net/tempest/+spec/customized-test-launcher-script | 17:15 |
*** samkottler|out is now known as samkottler | 17:15 | |
dwalleck | I'm just a bit wary of diving into a solution without a full plan of attack. I'm curious though if any of this will tie us to testtools. It'd be nice if in the stripping away of nose any standard unittest test runner just worked | 17:15 |
*** enikanorov has joined #openstack-meeting | 17:16 | |
sdague | dwalleck: fair, though I think in reality you can't really know unless you try | 17:16 |
chunwang | why the parallel exeution is so important? May I know how long will the whole tempest test cases take in your environment? | 17:17 |
sdague | if it's not any good we won't force it in just because it's on the list. :-) But this will at least make it possible to evaluate | 17:17 |
sdague | davidkranz: you have the timings for the gate? | 17:18 |
dwalleck | sdague: True. I guess what I was thinking was to perhaps start with converting say one project's tests first before doing the whole lot | 17:18 |
*** ociuhandu has quit IRC | 17:18 | |
*** ociuhandu_ is now known as ociuhandu | 17:18 | |
sdague | dwalleck: from the experience I've seen in the folks working on converting nova here, you more or less have to just do it in one batch | 17:18 |
*** jcooley_afk is now known as jcooley | 17:18 | |
dwalleck | chunwang: Because in a Devstack environment the tests take about 45 minutes. In a full deployed environment, especially using Windows images, it might almost take a day | 17:19 |
davidkranz | sdague: The last hourly run took just under 1000 seconds for the full part. | 17:19 |
rohitk | chunwang: I think in the longer term parallelism would prove more beneficial | 17:19 |
*** mestery has joined #openstack-meeting | 17:19 | |
ravkumar_hp | dwalleck: yes. but convert one test before converting project's all tests | 17:19 |
*** rick_rax has joined #openstack-meeting | 17:19 | |
sdague | anyway, cyeoh is in australia, so I'll proxy his updates here, because it's some ungoddly hour of the night | 17:19 |
dwalleck | The goal is to just to get more done quickly so folks are more inclined to run them | 17:19 |
davidkranz | sdague: and 200s for the smoke tests | 17:20 |
dwalleck | All fair points. I'm just a cautious one :-) | 17:20 |
sdague | dwalleck: right, which is why we've got a good review process :-) | 17:20 |
*** colinmcnamara has joined #openstack-meeting | 17:20 | |
dwalleck | yup, good point | 17:20 |
chunwang | Simlar with your time...in our environemnt, it will take about 25 hours to finish the whole tests... | 17:21 |
*** shardy has left #openstack-meeting | 17:21 | |
*** colinmcnamara1 has joined #openstack-meeting | 17:21 | |
sdague | chunwang: 25 hours? what environment is that? | 17:22 |
dwalleck | But in parallel, I'm running my Tempest tests (with real Linux/Windows images) in < 45 min, so getting there is the goal | 17:22 |
chunwang | a Essex version Openstack, with 16 cn, 1 cc... | 17:22 |
*** dwalleck has quit IRC | 17:22 | |
*** dwalleck has joined #openstack-meeting | 17:23 | |
*** dwalleck has quit IRC | 17:23 | |
*** dwalleck has joined #openstack-meeting | 17:23 | |
davidkranz | dwalleck: When we get parallelism for devstack gate we will likely run into https://bugs.launchpad.net/nova/+bug/1016633 | 17:24 |
uvirtbot | Launchpad bug 1016633 in nova "Bad performance problem with nova.virt.firewall" [Medium,Incomplete] | 17:24 |
chunwang | but it may not similar with normal environment, becasue some of the OS image will take about 20 min to boot up at 1st time boot | 17:24 |
*** colinmcnamara2 has joined #openstack-meeting | 17:24 | |
*** colinmcnamara has quit IRC | 17:24 | |
sdague | chunwang: gotcha | 17:24 |
davidkranz | Firing up a bunch of instances on a single compute node is slow. | 17:24 |
davidkranz | I guess we will deal with that when it happens. | 17:25 |
sdague | agreed | 17:25 |
dwalleck | Hmm, interesting. | 17:25 |
sdague | for the gate, were you going to also make it error if there were stack traces in the daemons? | 17:25 |
davidkranz | sdague: I really want to do that but there are still errors in the nova logs as far as I know. | 17:26 |
sdague | davidkranz: yes, there are. | 17:26 |
*** colinmcnamara1 has quit IRC | 17:26 | |
sdague | it would be great to get each one of those distinct stack traces as a nova bug | 17:26 |
davidkranz | sdague: As soon as they are clean I would go for it. | 17:26 |
sdague | seperately they are solvable, I did fix one a couple weeks ago, which was serious enough to be a folsom backport as well | 17:27 |
*** Gordonz has joined #openstack-meeting | 17:28 | |
*** Gordonz has quit IRC | 17:28 | |
*** dhellmann has quit IRC | 17:28 | |
davidkranz | sdague: Yeah. It would be best if the nova team as a whole made this higher priority. | 17:28 |
*** Gordonz has joined #openstack-meeting | 17:28 | |
*** markmcclain has quit IRC | 17:29 | |
sdague | davidkranz: yeh sure, just saying that if they get broken up as discreet issues, I can probably get folks looking at them | 17:29 |
*** eglynn has quit IRC | 17:29 | |
davidkranz | sdague: I agree. I can do look at the latest logs and do that. | 17:30 |
*** colinmcnamara2 has quit IRC | 17:30 | |
sdague | that would be great | 17:30 |
*** primeministerp has quit IRC | 17:30 | |
*** colinmcnamara has joined #openstack-meeting | 17:31 | |
dwalleck | I need to duck out folks. I have some updates, but I'll send those in an email this afternoon. Adios! | 17:31 |
*** dwalleck has quit IRC | 17:31 | |
davidkranz | I am going to take a look at the multi-node-testing blueprint. | 17:32 |
*** jcooley is now known as jcooley_afk | 17:32 | |
davidkranz | Any one know if anything is happening with fuzz testing? | 17:32 |
chunwang | May I know when will the quantum scripts be ready for use? | 17:32 |
rohitk | I will be jumping onto some quantum tests next week too | 17:33 |
davidkranz | chunwang: Not sure. I think Nachi Ueno is the lead ono that. | 17:33 |
*** colinmcnamara1 has joined #openstack-meeting | 17:34 | |
davidkranz | chunwang: https://blueprints.launchpad.net/tempest/+spec/quantum-tempest | 17:34 |
*** milner has quit IRC | 17:34 | |
davidkranz | rohitk: Great. Make sure to touch base with Nachi to avoid duplication. | 17:34 |
rohitk | davidkranz: yup :), mnewby was working on a patch I believe | 17:35 |
davidkranz | Any other topics for today? | 17:35 |
rax-Jose | ravkumar_hp: What features are you targeting w/ your latest swift tests? | 17:35 |
*** colinmcnamara has quit IRC | 17:35 | |
rax-Jose | Just curious | 17:35 |
rohitk | davidkranz: I can't see the fuzz testing/randgen coming in anytime soon | 17:35 |
rohitk | what's the strategy to accept more negative tests? | 17:36 |
ravkumar_hp | rax-Jose: tempurl + https://blueprints.launchpad.net/tempest/+spec/add-some-functional-swift-tests | 17:36 |
ravkumar_hp | https://blueprints.launchpad.net/tempest/+spec/add-swift-security-tests | 17:36 |
rax-Jose | coolbeans, thanks. | 17:36 |
sdague | davidkranz: nothing more from me | 17:37 |
davidkranz | rohitk: Is some one working on fuzz testing at all? There isn o assignee for the blueprint. | 17:37 |
rohitk | davidkranz: I don't think so, but the old style negative API validation tests were not being accepted as they slowed down the runtime | 17:38 |
*** gyee has joined #openstack-meeting | 17:38 | |
*** colinmcnamara1 has quit IRC | 17:38 | |
chunwang | if there is any scripts need help, I will try to help on that... | 17:38 |
davidkranz | rohitk: That is still a problem. It is also a problem that they take much longer to write than if using a negative test-generator. | 17:38 |
davidkranz | rohitk: But there is the up-front, non-distributed cost of doing that. | 17:39 |
rohitk | davidkranz: Agreed, I don't think we should afford that | 17:39 |
davidkranz | chunwang: Is proposing and creating a negative test runner something you could do? | 17:39 |
davidkranz | chunwang: There are some tools out there that do this kind of thing. | 17:39 |
sdague | rohitk: I think the important thing to is that the negative tests do more than just test fail, they need to get fails the way they expect | 17:40 |
davidkranz | sdague: A negative test runner would take care of that if you specify the space of parameters and the expected result. | 17:40 |
rohitk | sdague: Yes, more to do around bad input | 17:40 |
chunwang | ok, currently I didn't proposing more negative test myself, but if there is any existing requirement there, I will try to look into it... | 17:40 |
*** jhenner has quit IRC | 17:42 | |
sdague | davidkranz: oh, that's the last thing. The coverage reporting for tempest is actually coming along by mtreinish. He's got a nova extension in final stages of review that will let us get nova coverage from an external test runner | 17:42 |
davidkranz | sdague: Great. | 17:42 |
sdague | so I'm hoping that's available in a couple of weeks as part of normal tempest runs | 17:42 |
rohitk | sdague: Sounds good! | 17:43 |
davidkranz | Last call for new issues... | 17:43 |
sdague | it doesn't really add much to the test runs time wise, so it should be something we can enable in the default runs | 17:43 |
chunwang | sdague: Good news, we also need this kind of data | 17:43 |
*** colinmcnamara has joined #openstack-meeting | 17:45 | |
davidkranz | OK, see you all next week. | 17:46 |
sdague | see you then | 17:46 |
davidkranz | #endmeeting | 17:47 |
*** openstack changes topic to "OpenStack meetings || Development in #openstack-dev || Help in #openstack" | 17:47 | |
chunwang | see you | 17:47 |
openstack | Meeting ended Thu Nov 29 17:47:00 2012 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:47 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/qa/2012/qa.2012-11-29-17.02.html | 17:47 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/qa/2012/qa.2012-11-29-17.02.txt | 17:47 |
openstack | Log: http://eavesdrop.openstack.org/meetings/qa/2012/qa.2012-11-29-17.02.log.html | 17:47 |
*** donaldngo has quit IRC | 17:47 | |
*** rax-sam has quit IRC | 17:47 | |
*** blogan-RAX has quit IRC | 17:47 | |
*** longshot has quit IRC | 17:47 | |
*** rax-Jose has left #openstack-meeting | 17:47 | |
*** annegentle_ has quit IRC | 17:48 | |
*** ravkumar_hp has quit IRC | 17:48 | |
*** eglynn has joined #openstack-meeting | 17:49 | |
*** colinmcnamara has quit IRC | 17:50 | |
*** rohitk has quit IRC | 17:50 | |
*** colinmcnamara has joined #openstack-meeting | 17:52 | |
*** rick_rax has quit IRC | 17:53 | |
*** jcru is now known as jcru|away | 17:56 | |
*** chunwang has quit IRC | 17:56 | |
*** davidf_76 has quit IRC | 17:57 | |
*** andrewbogott is now known as andrewbogott_afk | 17:58 | |
*** jcru|away is now known as jcru | 18:01 | |
*** eglynn has quit IRC | 18:05 | |
*** hemna has joined #openstack-meeting | 18:08 | |
*** derekh has quit IRC | 18:14 | |
*** cp16net is now known as cp16net|away | 18:16 | |
*** jcru is now known as jcru|away | 18:17 | |
*** garyk has quit IRC | 18:23 | |
*** eglynn has joined #openstack-meeting | 18:26 | |
*** jrd has joined #openstack-meeting | 18:27 | |
*** Mandell has joined #openstack-meeting | 18:29 | |
*** colinmcnamara has quit IRC | 18:31 | |
*** colinmcnamara has joined #openstack-meeting | 18:32 | |
*** sarob has joined #openstack-meeting | 18:36 | |
*** ryanpetrello has joined #openstack-meeting | 18:40 | |
*** dhellmann has joined #openstack-meeting | 18:41 | |
*** esp1 has joined #openstack-meeting | 18:41 | |
*** esp1 has left #openstack-meeting | 18:41 | |
*** vishy_zz is now known as vishy | 18:42 | |
*** devananda has quit IRC | 18:42 | |
*** devananda has joined #openstack-meeting | 18:43 | |
*** markmcclain has joined #openstack-meeting | 18:44 | |
*** milner has joined #openstack-meeting | 18:45 | |
*** darraghb has quit IRC | 18:53 | |
*** colinmcnamara has quit IRC | 18:57 | |
*** colinmcnamara has joined #openstack-meeting | 18:58 | |
*** colinmcnamara1 has joined #openstack-meeting | 18:59 | |
*** rkukura has quit IRC | 19:00 | |
*** cp16net|away is now known as cp16net | 19:00 | |
*** adjohn has joined #openstack-meeting | 19:01 | |
*** dhellmann_ has joined #openstack-meeting | 19:01 | |
*** colinmcnamara2 has joined #openstack-meeting | 19:02 | |
*** colinmcnamara has quit IRC | 19:02 | |
*** colinmcnamara1 has quit IRC | 19:04 | |
*** jrd has quit IRC | 19:05 | |
*** dhellmann has quit IRC | 19:05 | |
*** dhellmann_ is now known as dhellmann | 19:05 | |
*** colinmcnamara2 has quit IRC | 19:06 | |
*** colinmcnamara has joined #openstack-meeting | 19:07 | |
*** andrewbogott_afk is now known as andrewbogott | 19:09 | |
*** milner has quit IRC | 19:09 | |
*** colinmcnamara has quit IRC | 19:13 | |
*** novas0x2a|laptop has quit IRC | 19:13 | |
*** colinmcnamara has joined #openstack-meeting | 19:14 | |
*** jcru|away is now known as jcru | 19:16 | |
*** devananda has quit IRC | 19:16 | |
*** TheEstablishment has joined #openstack-meeting | 19:16 | |
*** devananda has joined #openstack-meeting | 19:16 | |
*** jrodom has quit IRC | 19:19 | |
*** colinmcnamara1 has joined #openstack-meeting | 19:20 | |
*** jrd has joined #openstack-meeting | 19:20 | |
*** colinmcnamara1 has quit IRC | 19:21 | |
*** colinmcnamara has quit IRC | 19:21 | |
*** jog0 has joined #openstack-meeting | 19:23 | |
*** markvoelker has quit IRC | 19:26 | |
*** annegentle_ has joined #openstack-meeting | 19:31 | |
*** devananda has quit IRC | 19:31 | |
*** vipul is now known as vipul|away | 19:31 | |
*** devananda has joined #openstack-meeting | 19:31 | |
*** mdomsch has joined #openstack-meeting | 19:32 | |
*** lloydde has joined #openstack-meeting | 19:33 | |
*** dwcramer has quit IRC | 19:35 | |
*** TheEstablishment has quit IRC | 19:37 | |
*** jrodom has joined #openstack-meeting | 19:41 | |
*** stevebake has quit IRC | 19:44 | |
*** dwcramer has joined #openstack-meeting | 19:47 | |
*** novas0x2a|laptop has joined #openstack-meeting | 19:49 | |
*** jrd has quit IRC | 19:56 | |
*** stevebake has joined #openstack-meeting | 19:57 | |
*** dani4571 has joined #openstack-meeting | 20:01 | |
*** zbitter has left #openstack-meeting | 20:02 | |
*** cp16net is now known as cp16net|away | 20:04 | |
*** cp16net|away is now known as cp16net | 20:05 | |
*** annegentle__ has joined #openstack-meeting | 20:05 | |
*** krtaylor has quit IRC | 20:07 | |
*** jrodom has quit IRC | 20:09 | |
*** jrodom has joined #openstack-meeting | 20:09 | |
*** annegentle_ has quit IRC | 20:09 | |
*** markmcclain1 has joined #openstack-meeting | 20:11 | |
*** cp16net is now known as cp16net|away | 20:12 | |
*** markmcclain2 has joined #openstack-meeting | 20:14 | |
*** markmcclain2 has joined #openstack-meeting | 20:14 | |
*** markmcclain2 has joined #openstack-meeting | 20:15 | |
*** markmcclain has quit IRC | 20:15 | |
*** alexpilotti has quit IRC | 20:16 | |
*** markmcclain1 has quit IRC | 20:17 | |
*** garyk has joined #openstack-meeting | 20:25 | |
*** salv-orlando_ has joined #openstack-meeting | 20:26 | |
*** salv-orlando has quit IRC | 20:26 | |
*** salv-orlando_ is now known as salv-orlando | 20:26 | |
*** dprince has quit IRC | 20:26 | |
*** jrd has joined #openstack-meeting | 20:30 | |
*** alexpilotti has joined #openstack-meeting | 20:37 | |
*** garyk has quit IRC | 20:39 | |
*** jcru has left #openstack-meeting | 20:44 | |
*** dwcramer has quit IRC | 20:44 | |
*** dprince has joined #openstack-meeting | 20:49 | |
*** annegentle__ has quit IRC | 20:50 | |
*** annegentle_ has joined #openstack-meeting | 20:55 | |
*** annegentle__ has joined #openstack-meeting | 20:56 | |
*** dwcramer has joined #openstack-meeting | 20:57 | |
*** Vek has joined #openstack-meeting | 20:57 | |
*** ayoung has quit IRC | 20:57 | |
*** vishy is now known as vishy_zz | 20:58 | |
*** eglynn has quit IRC | 20:58 | |
*** annegentle_ has quit IRC | 21:00 | |
*** dkehn has joined #openstack-meeting | 21:00 | |
russellb | nnnnnnnnnnnova meeting time | 21:01 |
*** markmc has joined #openstack-meeting | 21:01 | |
russellb | #startmeeting nova | 21:01 |
openstack | Meeting started Thu Nov 29 21:01:42 2012 UTC. The chair is russellb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:01 |
*** danwent has quit IRC | 21:01 | |
*** openstack changes topic to " (Meeting topic: nova)" | 21:01 | |
markmc | yo | 21:01 |
openstack | The meeting name has been set to 'nova' | 21:01 |
* Vek yawns | 21:01 | |
* dansmith snorts | 21:01 | |
russellb | Here's the agenda: http://wiki.openstack.org/Meetings/Nova | 21:02 |
jog0 | o/ | 21:02 |
russellb | everyone here and awake?! | 21:02 |
sdague | o/ | 21:02 |
alexpilotti | yep | 21:02 |
russellb | cool, comstud, around? | 21:02 |
*** afazekas has joined #openstack-meeting | 21:02 | |
russellb | or how about devananda ? | 21:02 |
sdague | he and vishy_zz were road tripping, but it sounded like they'd be back on by now | 21:03 |
russellb | k | 21:03 |
* Vek is trying to grab comstud's attention | 21:03 | |
dansmith | really? road tripping? | 21:03 |
*** carlp-away has quit IRC | 21:03 | |
russellb | well we'll skip to bugs for now | 21:03 |
russellb | #topic bugs | 21:03 |
*** openstack changes topic to "bugs (Meeting topic: nova)" | 21:03 | |
russellb | #link http://webnumbr.com/untouched-nova-bugs | 21:03 |
russellb | not terrible, 25 not touched yet | 21:04 |
russellb | if everyone could triage a couple that'd help get us back down really low, so please do | 21:04 |
dansmith | I did a couple last week I think | 21:04 |
russellb | nice | 21:04 |
russellb | i don't have mikal's nifty script so we can give out gold stars for triage | 21:04 |
dansmith | er, I mean I did 20 | 21:04 |
russellb | dansmith gets a gold star! | 21:05 |
russellb | anyway, any other bugs we need to cover? | 21:05 |
russellb | really important stuff that has popped up? | 21:05 |
*** eglynn has joined #openstack-meeting | 21:05 | |
*** carlp-away has joined #openstack-meeting | 21:05 | |
*** vishy_zz is now known as vishy | 21:05 | |
* russellb would know had he been doing more triage before 20 minutes ago :-/ | 21:05 | |
alexpilotti | russellb: I have a question for a bug that I still have to file up | 21:05 |
russellb | ok | 21:05 |
alexpilotti | it's related to porting the full nova stack to Windows | 21:06 |
russellb | alexpilotti: and we can do your topic next | 21:06 |
dansmith | REJECTED | 21:06 |
dansmith | oh, sorry, go on | 21:06 |
dansmith | :D | 21:06 |
alexpilotti | lol | 21:06 |
russellb | #topic hyper-v testing, windows support | 21:06 |
*** openstack changes topic to "hyper-v testing, windows support (Meeting topic: nova)" | 21:06 | |
alexpilotti | simply put: in nova-api there'a large use of fork()s | 21:06 |
russellb | go ahead, and then we can talk hyper-v unit tests next | 21:06 |
russellb | so windows should add fork() ? | 21:06 |
alexpilotti | as you probably know fork() is not implemented on Windows | 21:07 |
*** krtaylor has joined #openstack-meeting | 21:07 | |
russellb | is it just for the multi-process API stuff? or is it always required? | 21:07 |
alexpilotti | I'm pretty close to have a working implementation on fork(9 but I still need some low level things sorted out | 21:07 |
alexpilotti | russellb: yep | 21:07 |
markmc | alexpilotti, btw, that code is moving to oslo-incubator | 21:07 |
alexpilotti | the problem is that cpython dosn't really offer alternatives due to the lock | 21:07 |
markmc | alexpilotti, so might be better fixing it there | 21:08 |
*** salv-orlando has quit IRC | 21:08 | |
alexpilotti | interesting | 21:08 |
vishy | russellb: you want to lead this? | 21:08 |
alexpilotti | anyway, the 2 way out are: rewriting it to avoid locks | 21:08 |
vishy | my connection is being flaky | 21:08 |
markmc | https://blueprints.launchpad.net/oslo/+spec/service-infrastructure | 21:08 |
russellb | vishy: sure | 21:08 |
alexpilotti | an the other is spawning a process instead of a fork | 21:08 |
russellb | vishy: we hit bugs already, not much there, now talking windows support / hyper-v | 21:09 |
comstud | woot, i'm here | 21:09 |
alexpilotti | what do you guys think? | 21:09 |
*** danwent has joined #openstack-meeting | 21:09 | |
markmc | alexpilotti, which lock is this? | 21:09 |
russellb | alexpilotti: might be worth an openstack-dev thread so we can dive into details | 21:09 |
*** eglynn has quit IRC | 21:09 | |
markmc | yeah, agree | 21:09 |
alexpilotti | http://wiki.python.org/moin/GlobalInterpreterLock ;-) | 21:09 |
*** eglynn has joined #openstack-meeting | 21:10 | |
*** dwcramer has quit IRC | 21:10 | |
russellb | #action alexpilotti to start a -dev list thread on dealing with usage of fork() in nova for Windows | 21:10 |
russellb | so the other topic we wanted to cover was the hyper-v unit tests | 21:10 |
alexpilotti | russellb: ok | 21:10 |
russellb | there seems to have been confusion around how they work, and what impact they have on development | 21:11 |
*** ttrifonov is now known as ttrifonov_zZzz | 21:11 | |
russellb | so i wanted alexpilotti to give an overview of what it's doing, and what the plans are for improving it | 21:11 |
alexpilotti | sure | 21:11 |
alexpilotti | first, I still don't get what issue came up with the latest live migration tests fix | 21:12 |
alexpilotti | https://review.openstack.org/#/c/17090/ | 21:12 |
alexpilotti | it's a 2 lines fix, just adding a lambda and that's it | 21:12 |
dansmith | alexpilotti: there was no issue with the patch itself | 21:12 |
dansmith | alexpilotti: sdague just raised the issue there, which is part of the confusion | 21:12 |
alexpilotti | dansmith: no, that's the patch to the bug | 21:13 |
alexpilotti | https://bugs.launchpad.net/nova/+bug/1083018 | 21:13 |
uvirtbot | Launchpad bug 1083018 in nova "HyperV compute "resume" tests need to be fixed" [High,Fix committed] | 21:13 |
alexpilotti | not the sdague comment | 21:13 |
vishy | alexpilotti: I think the problem is the fix isn't obvious | 21:14 |
russellb | so I think the stubs just scare people off and we've been assuming that we can't fix your unit tests, heh | 21:14 |
alexpilotti | anyway, the hyper-v tests have nothing to do with the driver's interface changes | 21:14 |
alexpilotti | I understand that | 21:14 |
alexpilotti | we also want to get rid of them | 21:15 |
alexpilotti | the reason we have them is that this was the only way to get the test the pre-Folsom code | 21:15 |
russellb | also worth noting nova/tests/hyperv/README.rst (which I just now discovered) | 21:15 |
*** markvan has quit IRC | 21:15 | |
alexpilotti | yes, I added that readme to explain the architecture | 21:16 |
russellb | so sdague did you have any other questions or issues with it you wanted to discuss? | 21:16 |
dansmith | well, I don't feel as strongly as he does I think, | 21:17 |
sdague | alexpilotti: ok, so you said you are getting rid of the tests, what's coming to replace them | 21:17 |
vishy | maybe a simple example in the readme involving adding a parameter to an interface | 21:17 |
vishy | would help | 21:17 |
sdague | and when? it's definitely a little weird to be constantly trying to grok reviews that have 50 changed .gz files in them :) | 21:17 |
alexpilotti | vishy: adding a parameter to the interface doesn't need any changes in the stubs | 21:17 |
dansmith | but I really would like to see a different implementation for those so we don't have 20 changed pickle files for small fixes | 21:17 |
alexpilotti | sdague: I agree on that | 21:18 |
sdague | I think it was rmk that hit the actual issue | 21:18 |
alexpilotti | this happens when we change code that affect all the tests internally | 21:18 |
alexpilotti | it happened quite often lately due to the type of features that we are adding | 21:18 |
russellb | so nobody else can fix actual driver code then? | 21:18 |
vishy | alexpilotti: why did his change break the hyperv tests then? | 21:18 |
*** Mr_T has joined #openstack-meeting | 21:18 | |
alexpilotti | vishy: I don't think that it did. that's the point | 21:19 |
sdague | alexpilotti: it did, the unit tests wouldn't pass | 21:19 |
alexpilotti | vishy: if you look here: https://review.openstack.org/#/c/17090/1/nova/tests/test_hypervapi.py | 21:19 |
alexpilotti | you'll see that the only code that I changed is adding a couple of lambdas in the tests to handle that extra parameter in the tests | 21:20 |
dansmith | alexpilotti: are you saying that changing the actual driver code would have broken the sub matching? | 21:20 |
alexpilotti | in test_hypervapi.py and that's it | 21:20 |
russellb | dansmith: that's what i'm getting ... | 21:20 |
*** eglynn_ has joined #openstack-meeting | 21:20 | |
dansmith | alexpilotti: meaning, if rmk had changed it to match the other drivers he was changing, would the stubs fail? | 21:21 |
alexpilotti | russellb: only when it affects the WMI calls | 21:21 |
*** eglynn has quit IRC | 21:21 | |
*** ndipanov has quit IRC | 21:21 | |
dansmith | I don't understand why he would have broken the stubs with that change, is my point | 21:21 |
dansmith | so I wonder if it was a knee-jerk reaction, thinking he couldn't without updating the gz files | 21:21 |
vishy | alexpilotti: this was the original patch: https://review.openstack.org/#/c/13251/ | 21:21 |
russellb | ok, so stubs only have to change when WMI calls change? | 21:21 |
dansmith | russellb: right | 21:22 |
alexpilotti | since rmk didn't change anything except the driver's interface, I don't see how could that be possible | 21:22 |
vishy | alexpilotti: right but that isn't obvious | 21:22 |
russellb | well that sounds better than what i thought | 21:22 |
dansmith | russellb: that's what *I* have been trying to get at :) | 21:22 |
vishy | alexpilotti: I'm saying just add a section to the doc showing what needs to be done | 21:22 |
alexpilotti | so, here's the patch: https://review.openstack.org/#/c/13251/7/nova/virt/hyperv/driver.py | 21:22 |
alexpilotti | he changed only the line with the parameter | 21:22 |
russellb | i honestly think this was a case of not everyone understanding what layer the stubs came in | 21:23 |
vishy | alexpilotti: so you added a lambda to only pass the first param | 21:23 |
alexpilotti | vishy: there's nothing that needs to be done, as those patches are showing | 21:23 |
alexpilotti | vishy: correct | 21:23 |
sdague | so I think the issue here is that the hyperv test layer is very different because it doesn't use the stubs model that other drivers use | 21:23 |
sdague | and instead uses a different indirection mechanism | 21:23 |
alexpilotti | vishy: to pass the lambda to a utility method in the tests that expects a callable | 21:23 |
vishy | alexpilotti, sdague: which means an example of that would be useful | 21:24 |
sdague | which makes it harder for people to match a change in it, because it's different. | 21:24 |
alexpilotti | sdague: it uses also those stubs | 21:24 |
russellb | so, anything in the works to change how this works? | 21:24 |
alexpilotti | sdague: I understand | 21:24 |
alexpilotti | russellb: it is | 21:24 |
dansmith | but just so we're clear, | 21:24 |
dansmith | this stub approach is still required at some layer to verify anything that would normally be calling WMI stuff | 21:25 |
russellb | makes sense | 21:25 |
sdague | right, that's actually what I'm most interested in, how do we make it better, and not so different | 21:25 |
dansmith | the improvement that could/should be made, is so that not all of the testing depends on that being there | 21:25 |
*** salv-orlando has joined #openstack-meeting | 21:25 | |
russellb | #note stubs only have to change if WMI interaction changes (driver internals) | 21:25 |
sdague | because there is a huge mental cost in it being different in the tree | 21:25 |
alexpilotti | I discussed this in SD and we came up with the idea to replace the stubs with serialized json instead of pickled files as a first step | 21:25 |
russellb | #action alexpilotti to add an example to the README of making a driver interface change and updating the tests to reflect it | 21:26 |
*** eglynn__ has joined #openstack-meeting | 21:26 | |
dansmith | russellb: I don't think that makes sense | 21:26 |
alexpilotti | russellb: but, if there' snothing to change, what example can I add? :-) | 21:26 |
russellb | #undo | 21:26 |
openstack | Removing item from minutes: <ircmeeting.items.Action object at 0x2179a90> | 21:26 |
russellb | heh | 21:26 |
*** eglynn_ has quit IRC | 21:26 | |
dansmith | russellb: there's nothing different about making that sort of change in hyperv vs. libvirt | 21:26 |
alexpilotti | correct | 21:26 |
dansmith | actually, | 21:26 |
dansmith | when you think about this, | 21:26 |
dansmith | they are testing *more* than the other drivers, | 21:26 |
dansmith | because they're actually simulating the _libvirt.so | 21:27 |
dansmith | it's just that they don't have a FakeHyperV to sit between there, | 21:27 |
dansmith | so that most stuff gets tested against FakeHyperV (like FakeLibvirt) | 21:27 |
*** ndipanov has joined #openstack-meeting | 21:27 | |
dansmith | and then just use the stubs to test the interaction with WMI | 21:27 |
russellb | yeah, ok, i at least understand what's happening in the tests better now | 21:28 |
dansmith | I've modified their driver interface several times, | 21:28 |
dansmith | with no ill-effects, or hand-editing WMI pickled gz files :) | 21:28 |
russellb | :) | 21:28 |
alexpilotti | this type of tests have some great advantages | 21:28 |
russellb | any other questions/actions/notes before we wrap this topic up? have a number of other things to hit | 21:28 |
vishy | hmm | 21:28 |
russellb | i'm not sure that we came to any sort of conclusion necessarily, but hopefully some folks understand it better (I do) | 21:29 |
vishy | it appears a little different to me | 21:29 |
alexpilotti | adding the json files will let anybody edit manually the stubs | 21:29 |
dansmith | alexpilotti: that is a good thing, IMHO | 21:29 |
vishy | usually with the other drivers you go in and add the extra param to the interface | 21:29 |
dansmith | not enough, because I think you still need a FakeHyperV, but better | 21:30 |
sdague | alexpilotti: yeh, I agree with dansmith, we really need a FakeHyperV layer in the tree | 21:30 |
alexpilotti | vishy: that's what has been done here as well! | 21:30 |
sdague | because I don't think it's obvious to anyone that adding lambdas would have been the fix :) | 21:30 |
vishy | alexpilotti: fair enough, i think it is just the _test method that is confusing | 21:31 |
alexpilotti | sdague: adding the lambda was just a "styly" way to solve this with two lines | 21:31 |
dansmith | alexpilotti: it was the wrong way, IMHO | 21:31 |
alexpilotti | the alternative, would have been an "if" in the tests | 21:31 |
*** ewindisch has joined #openstack-meeting | 21:31 | |
dansmith | alexpilotti: and I know that, because I don't understand what the right way is yet | 21:31 |
dansmith | but regardless, | 21:31 |
dansmith | this is really not indicative of the WMI snapshots keeping people from making interface changes | 21:32 |
vishy | ok it isn't as confusing as i expected | 21:32 |
alexpilotti | vishy: the "_" was marking it as private | 21:32 |
vishy | _test_vm_state_change doesn't accept extra parameters | 21:32 |
alexpilotti | vishy: teh last parameter is a callable | 21:32 |
alexpilotti | that method is there because there are a gazillion of tests that look the same: | 21:32 |
alexpilotti | suspend, resume, start, etc etc | 21:33 |
vishy | gotcha | 21:33 |
vishy | they all just pass the instance data | 21:33 |
alexpilotti | they all have the same signature | 21:33 |
alexpilotti | they all HAD the same signature :-) | 21:33 |
vishy | :) | 21:33 |
alexpilotti | until the resume got that extra param | 21:33 |
dansmith | so, CELLS, huh? | 21:33 |
russellb | onward? | 21:34 |
alexpilotti | so, since tha actual method to test was passed as a callable | 21:34 |
russellb | comstud: still around? | 21:34 |
comstud | yes | 21:34 |
russellb | #topic cells | 21:34 |
*** openstack changes topic to "cells (Meeting topic: nova)" | 21:34 | |
russellb | comstud: what's up | 21:34 |
comstud | had some other things to take care of the last week... but I'm about done moving some stuff around with the main cells code | 21:34 |
*** devananda has quit IRC | 21:34 | |
comstud | I'm hoping tomorrow is the day for updated reviews | 21:34 |
russellb | cool, i'm going to make myself go heads down in that code once you update it ... | 21:34 |
comstud | yep, appreciate it | 21:35 |
*** devananda has joined #openstack-meeting | 21:35 | |
comstud | should be less ugly | 21:35 |
russellb | who else is going to review? | 21:35 |
comstud | and i've noticed some things that weren't structured correctly with respect to pluggable communication that I meant to have | 21:35 |
comstud | (rpc vs something else0 | 21:35 |
comstud | so that'll all be fixed and should hopefully be easier to understand | 21:35 |
russellb | awesome | 21:35 |
*** cp16net|away is now known as cp16net | 21:35 | |
russellb | well i'll be watching for the updates ... | 21:36 |
comstud | might be late tomorrow :) or Saturday.. depends on how much I partcipate in this meetup:) | 21:36 |
*** torandu has quit IRC | 21:36 | |
sdague | so there was still the open discussion of the cells adds to nova-manage | 21:36 |
comstud | ah right | 21:36 |
*** vipul|away is now known as vipul | 21:36 | |
*** enikanorov has quit IRC | 21:36 | |
comstud | my argument is that it seems silly to have to start an unconfigured service to configure it. | 21:36 |
comstud | i wouldn't want to start something that's unconfigured | 21:37 |
russellb | s/nova-manage/nova-bootstrap/ ? :) | 21:37 |
comstud | but honestly I don't really care. | 21:37 |
comstud | I have the code in an extension as well | 21:37 |
russellb | (i'm not really suggesting renaming it) | 21:37 |
sdague | comstud: could things go in a config file? or are they too dynamic? | 21:37 |
comstud | well, i mean, i do care. i'm just not going to fight hard over it | 21:37 |
comstud | better things to worrya bout :) | 21:38 |
comstud | sdague: it's a lot to configure for a .conf file | 21:38 |
comstud | each parent cell | 21:38 |
comstud | each child cell | 21:38 |
*** enikanorov has joined #openstack-meeting | 21:38 | |
comstud | the Rabiit broker credentials for each | 21:38 |
comstud | etc | 21:38 |
sdague | comstud: does it tend to be dynamic? or staticly defined? | 21:38 |
russellb | how is it too much for a config file, but not too much for a bunch of calls to nova-manage ? | 21:38 |
comstud | ConfigParser doesn't really work well for this | 21:38 |
vishy | comstud: you don't have to start the cells service do you? You can just start nova-api and configure first? | 21:39 |
comstud | i'm not sure what i'd name the config options | 21:39 |
comstud | yeah, nova-api | 21:39 |
vishy | comstud: I have secret plans to make db-sync into an extension | 21:39 |
comstud | lol | 21:39 |
comstud | not a secret anymore! | 21:40 |
vishy | nova-api can currently start without the db migrations | 21:40 |
vishy | comstud: doh | 21:40 |
comstud | can/can't ? | 21:40 |
*** eglynn__ has quit IRC | 21:40 | |
russellb | did we lose you guys? | 21:41 |
sdague | comstud: if it's mostly static, what about a json file to config it? | 21:41 |
comstud | i guess it can.. it's just hosed until the DB is upgraded | 21:41 |
vishy | * can | 21:41 |
rmk | sorry guys I am here now | 21:41 |
rmk | I was tied up in meetings | 21:42 |
comstud | if you add a new column in the model code | 21:42 |
comstud | but don't update the DB... | 21:42 |
dansmith | rmk: we voted you as the new hyperv maintainer | 21:42 |
comstud | nova-api starts spewing failures | 21:42 |
comstud | until the DB is upgraded | 21:42 |
comstud | cuz sqlalchemy starts querying those new columns | 21:42 |
*** ayoung has joined #openstack-meeting | 21:42 | |
rmk | dansmith: Oh cool! | 21:42 |
dansmith | :D | 21:43 |
*** eglynn__ has joined #openstack-meeting | 21:43 | |
comstud | (which is annoying that sqlalchemy explicity asks for the columns by name for *) | 21:43 |
rmk | I feel bad for people using my newly inherited driver | 21:43 |
russellb | #note give your opinion on the cells nova-manage additions on the associated -dev list thread | 21:43 |
sdague | #link http://lists.openstack.org/pipermail/openstack-dev/2012-November/003298.html | 21:43 |
russellb | sdague: thanks | 21:43 |
russellb | anything else, or can we move on? | 21:44 |
comstud | i'm done | 21:44 |
russellb | thanks! | 21:44 |
comstud | ty | 21:44 |
russellb | devananda: around for a quick baremetal chat? | 21:44 |
russellb | or anyone else that has been working on it | 21:44 |
*** sandywalsh has quit IRC | 21:44 | |
* dansmith resists the urge to say something sarcastic | 21:44 | |
russellb | heh | 21:44 |
russellb | skip it then | 21:45 |
russellb | #topic project name mapping | 21:45 |
*** openstack changes topic to "project name mapping (Meeting topic: nova)" | 21:45 | |
russellb | vishy: take it away sir | 21:45 |
vishy | ok! | 21:45 |
*** dolphm has quit IRC | 21:45 | |
vishy | there are many cases in nova where we know the project_id / tenant_id of an object | 21:46 |
vishy | but we have no way of telling the name | 21:46 |
vishy | which forces users / services to go look them up in keystone | 21:46 |
vishy | since humans generally use names vs long uuid strings | 21:46 |
vishy | I wanted to see how people felt about keeping a mapping of names to ids in nova | 21:46 |
russellb | where do we need the name in nova? | 21:46 |
vishy | well there are a number of places where it would be useful | 21:47 |
vishy | nova list --all-tenants | 21:47 |
vishy | nova list --all-tenants --tenant= <name> | 21:47 |
vishy | for example | 21:47 |
dansmith | where are the names kept, keystone? | 21:48 |
vishy | I would also like our default dhcp hostnames to include tenant name | 21:48 |
vishy | yup | 21:48 |
jog0 | what about doing the lookups in the nova client? | 21:48 |
vishy | we get the name in the context for every api command | 21:48 |
dansmith | couldn't the cli query the list first? | 21:48 |
russellb | i was about to ask about novaclient, yeah | 21:48 |
vishy | dansmith: assuming that the nova admin is also a keystone admin yeah | 21:48 |
dansmith | ah | 21:48 |
comstud | should a nova admin who is not a keystone admin see the mapping tho? | 21:48 |
vishy | unless keystone decides to make the mapping public | 21:48 |
comstud | :) | 21:48 |
dansmith | is it an information leak if they're not and we give them that info? | 21:48 |
comstud | dansmith: +1 | 21:48 |
vishy | I'm mainly coming from a usability perspective | 21:49 |
*** dwcramer has joined #openstack-meeting | 21:49 | |
vishy | the name is far more useful imo | 21:49 |
dansmith | definitely nice from the dhcpd hostnames thing tho | 21:49 |
rmk | This is a general problem with how decoupled keystone is from everything. | 21:49 |
rmk | It's not just tenant names. | 21:49 |
sdague | it seems a little weird to dup the data though | 21:49 |
comstud | i don't really mind about the idea in general.. but it can be a decent sized table for large OS deployments. | 21:50 |
vishy | if we add it to nova it would just be more like a cache. | 21:50 |
rmk | One problem we frequently encounter and have built custom scripts around is reconciling tenant deletion with reclaiming resources | 21:50 |
rmk | It's probably a different class of issue than this though | 21:50 |
sdague | vishy: right, but then we need a cache management for it | 21:50 |
*** eglynn__ has quit IRC | 21:50 | |
*** eglynn has joined #openstack-meeting | 21:50 | |
vishy | i recognize that it isn't exactly an easy addition | 21:50 |
rmk | Are we talking about regularly pulling tenant lists from keystone to have an id:name mapping? | 21:51 |
comstud | please no | 21:51 |
vishy | that's why I'm bringing it up | 21:51 |
comstud | not a regular pulling | 21:51 |
comstud | of everything | 21:51 |
vishy | no, cache would be populated via normal nova requests | 21:51 |
comstud | (that would not scale) | 21:51 |
rmk | Yeah I wasn't proposing an architecture | 21:51 |
vishy | you could theoretically have an external service to resync every so often (or if a tenant name changes in keystone) | 21:51 |
sdague | can we solve the information leak with getting keystone to return only the mapping data the user could see? I guess I don't see how it's an information leak if we can get it from keystone, but not if we can get it from nova. | 21:52 |
comstud | you'd have to cache permissions in table along with the tenant name | 21:52 |
rmk | I've got an environment with over a hundred tenants and I can't tell you what a nightmare it is to deal with the lack of keystone association | 21:52 |
sdague | vishy: sweet, you created active directory! | 21:52 |
comstud | i'd think | 21:52 |
dansmith | sdague: that doesn't help the --all-tenants thing | 21:52 |
vishy | if the solution here is to just make keystone expose an api for getting a mapping | 21:53 |
rmk | vishy: yes | 21:53 |
vishy | i guess i can handle that | 21:53 |
jog0 | what about bringing this to the -dev ML so the keystone guys can get involved in the discussion? | 21:53 |
rmk | It would be nice to make a single bulk request of which IDs need to resolve, and get a single response back with the mapping | 21:53 |
vishy | horizon must be doing this already | 21:53 |
dansmith | jog0: easier to make the decision with out them,... duh | 21:53 |
rmk | vishy: It does it very inefficiently | 21:53 |
sdague | rmk: agreed, a bulk operation would be a must | 21:53 |
rmk | Each mapping is a request and it's terrible | 21:54 |
sdague | so it's one wire burst | 21:54 |
*** cbaeseman has quit IRC | 21:54 | |
rmk | Horizon as it exists today does not scale | 21:54 |
vishy | ok lets take that to keystone | 21:54 |
sdague | so it would help horizon as well, which should make it even more valuable | 21:54 |
comstud | +1 on bulk | 21:54 |
rmk | There's a lot of requests which need to be made bulkable in keystone, this is one of them | 21:54 |
russellb | vishy: you going to start a thread on it? | 21:54 |
vishy | sure | 21:54 |
russellb | #action vishy to start a thread on this topic on the -dev ML so that keystone devs can get involved, too | 21:54 |
russellb | #topic grizzly-2 status | 21:55 |
*** openstack changes topic to "grizzly-2 status (Meeting topic: nova)" | 21:55 | |
vishy | i expect I will need to cache for performance, but I can just do that in memory | 21:55 |
russellb | grizzly-2 is still a ways out, but it's our next milestone | 21:55 |
jog0 | if nova is going to cache the mapping how will it handle deletions? | 21:55 |
russellb | #link https://launchpad.net/nova/+milestone/grizzly-2 | 21:55 |
russellb | scheduled for January 10th | 21:55 |
vishy | jog0: just a performance cache, deletions shouldn't matter | 21:55 |
rmk | vishy: I don't know if you'd cache the response in Nova or just expect keystone to be sane about caching itself so you can just ask it again | 21:55 |
russellb | vishy: any grizzly-2 planning stuff you want to hit? | 21:55 |
vishy | russellb: not really | 21:56 |
rmk | Having every service maintain its own cache of the others data seems like a recipe for pain. | 21:56 |
jog0 | vishy: if a tenant is renamed or deleted nova won't know right away right? | 21:56 |
russellb | cool ... so ... keep hacking! | 21:56 |
rmk | jog0: By right away, you mean never | 21:56 |
russellb | #topic Open Discussion | 21:56 |
*** openstack changes topic to "Open Discussion (Meeting topic: nova)" | 21:56 | |
russellb | 4 minutes left | 21:56 |
jog0 | rmk: yes | 21:56 |
rmk | Nothing gets reclaimed | 21:56 |
vishy | jog0: The cache would be temporary just to avoid making requests for every instance launch | 21:56 |
rmk | So if you have network associated to deleted tenants, its up to you to clean them up | 21:56 |
vishy | jog0: like only one request every 5 minutes per node or something | 21:57 |
jog0 | vishy: I like rmk 's idea about keystone doing sane caching itself instead of us dealing with it | 21:57 |
alexpilotti | sdague: can I ask you to remove the -1 from https://review.openstack.org/#/c/16843/ ? unless there are other reasons for teh -1 of course :-) | 21:58 |
sdague | alexpilotti: I'll do you one better | 21:58 |
dansmith | sdague: technically that's three better | 21:58 |
sdague | oh, last item for open discussion | 21:59 |
alexpilotti | sdague: tx ;-) | 21:59 |
sdague | tempest gate is close to being ready, but even when it's successful there are a lot of nova stack traces | 21:59 |
sdague | https://bugs.launchpad.net/nova/+bug/1079210/comments/3 | 21:59 |
uvirtbot | Launchpad bug 1079210 in nova "Successful full gate jobs show ERRORs and stacktraces" [Medium,Confirmed] | 21:59 |
russellb | yeah i was just looking at those | 21:59 |
sdague | those are mostly real bugs, the 413 explosion that I fixed a couple weeks ago was one of those | 22:00 |
russellb | there are some that are just noise in the log that we need to silence | 22:00 |
russellb | we often pass back exceptions over rpc to the caller | 22:00 |
russellb | and we log every single one on the manager (server) side | 22:00 |
sdague | so more eyes on those would be great, as the hope was to get the tempest gate to also check for exceptions in the logs, and fail if they were found | 22:00 |
sdague | but obviously can't do that until those get cleaned up | 22:00 |
russellb | but for most cases, we really shouldn't, and we should let the client side decide what to do with it | 22:01 |
*** patelna has joined #openstack-meeting | 22:01 | |
russellb | makes sense | 22:01 |
sdague | anyway, more eyes would help | 22:01 |
*** jhenner has joined #openstack-meeting | 22:01 | |
*** danwent has quit IRC | 22:01 | |
russellb | alright, we're a bit over | 22:02 |
russellb | thanks everyone! | 22:02 |
russellb | #endmeeting | 22:02 |
*** openstack changes topic to "OpenStack meetings || Development in #openstack-dev || Help in #openstack" | 22:02 | |
openstack | Meeting ended Thu Nov 29 22:02:06 2012 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 22:02 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/nova/2012/nova.2012-11-29-21.01.html | 22:02 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/nova/2012/nova.2012-11-29-21.01.txt | 22:02 |
openstack | Log: http://eavesdrop.openstack.org/meetings/nova/2012/nova.2012-11-29-21.01.log.html | 22:02 |
*** markmc has left #openstack-meeting | 22:02 | |
*** Mr_T has left #openstack-meeting | 22:02 | |
jog0 | for anyone staying around for the db meeting | 22:03 |
dripton_ | hi | 22:03 |
jog0 | lets take a 7 min break | 22:03 |
dripton_ | ok | 22:03 |
*** Vek has left #openstack-meeting | 22:03 | |
jog0 | so start at :10 after | 22:03 |
russellb | dripton_: hey | 22:03 |
russellb | dripton_: didn't get a chance to sync up with you before that meeting | 22:03 |
russellb | didn't see the patch up though, right? | 22:03 |
*** jkyle has joined #openstack-meeting | 22:03 | |
*** jrodom has quit IRC | 22:04 | |
jkyle | is there an announce list for team meetings? | 22:05 |
dripton_ | russellb: my alembic branch is still buggy so wasn't ready to drop on the nova team | 22:06 |
russellb | dripton_: cool no worries, just wanted to check in | 22:06 |
russellb | jkyle: http://wiki.openstack.org/Meetings | 22:06 |
russellb | jkyle: that page also has a link to an ical feed | 22:06 |
russellb | jkyle: and some teams post reminders to the mailing list(s) | 22:06 |
jkyle | ah, must have missed the feed | 22:06 |
russellb | but best not to rely on it | 22:06 |
russellb | (rely on ML reminders i mean) | 22:07 |
*** dkehn has quit IRC | 22:07 | |
jkyle | calendar feed sounds perfect | 22:07 |
russellb | cool | 22:07 |
jog0 | ok lets start | 22:11 |
jkyle | I must be blind, missing the calendar subscribe | 22:11 |
jog0 | #startmeeting db | 22:11 |
openstack | Meeting started Thu Nov 29 22:11:11 2012 UTC. The chair is jog0. Information about MeetBot at http://wiki.debian.org/MeetBot. | 22:11 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 22:11 |
*** openstack changes topic to " (Meeting topic: db)" | 22:11 | |
openstack | The meeting name has been set to 'db' | 22:11 |
*** krtaylor has quit IRC | 22:11 | |
russellb | jkyle: very top of that wiki page | 22:11 |
jog0 | I am sitting in for devananda who is on a plane | 22:11 |
* jkyle got it | 22:11 | |
jog0 | who's here? | 22:12 |
russellb | \o sorta | 22:12 |
dripton_ | here | 22:12 |
*** vishy is now known as vishy_zz | 22:13 | |
jog0 | #link http://wiki.openstack.org/Meetings/DBTeamMeeting | 22:14 |
jog0 | thats the agenda | 22:14 |
jog0 | lets start with last weeks action items | 22:14 |
jog0 | were any of the HP guys able to release the db-archive code for mysql? | 22:15 |
jog0 | dripton_: ? | 22:15 |
dripton_ | I didn't hear anything from devananda about that. | 22:16 |
*** danwent has joined #openstack-meeting | 22:16 | |
jog0 | ok, we will put that back up for next week | 22:16 |
jog0 | #action devananda to find and post existing db-archive code for MySQL | 22:16 |
*** dripton_ is now known as dripton | 22:16 | |
jog0 | russellb: it looks like you had some more blueprints to create | 22:17 |
russellb | orly | 22:17 |
jog0 | db blueprints #8 and 9 it looks like :) | 22:17 |
russellb | oh yes | 22:17 |
russellb | and in fact the patch already went in | 22:17 |
russellb | sooooo | 22:17 |
russellb | comstud wrote it and i think it's merged | 22:18 |
jog0 | link to the merge? | 22:18 |
russellb | looking | 22:18 |
russellb | https://review.openstack.org/#/c/16596/ | 22:18 |
jog0 | excellent | 22:19 |
jog0 | #topic thread pool | 22:19 |
*** openstack changes topic to "thread pool (Meeting topic: db)" | 22:19 | |
russellb | done! \o/ | 22:20 |
jog0 | #link https://review.openstack.org/#/c/16596/ | 22:20 |
russellb | so yeah, i'll put a blueprint up for it | 22:20 |
russellb | so it's on the record | 22:20 |
jog0 | #info done! | 22:20 |
jog0 | #action russellb put up blueprint for record keeping | 22:20 |
jog0 | #topic db-unique-key | 22:20 |
*** openstack changes topic to "db-unique-key (Meeting topic: db)" | 22:20 | |
jog0 | you had this blueprint creation as well | 22:21 |
dripton | that's devananda's BP, right? | 22:21 |
jog0 | I think so, but russellb volunteered to create it | 22:21 |
russellb | i did? | 22:21 |
* russellb doesn't know what that is | 22:21 | |
dripton | I thought devananda volunteered to create it. | 22:22 |
* jog0 going over http://eavesdrop.openstack.org/meetings/db/2012/db.2012-11-15-22.05.log.html again | 22:22 | |
jog0 | ohh my mistake | 22:22 |
russellb | btw, link to non-blocking-db blueprint - https://blueprints.launchpad.net/nova/+spec/non-blocking-db | 22:23 |
jog0 | #action devananda to post db-unique-key blueprint | 22:23 |
sdague | so the existing db-unique-key review I've seen has issues - https://review.openstack.org/#/c/16940/ because mysql is sloppy :) | 22:23 |
sdague | but postgresql isn't | 22:23 |
sdague | deleted=False is a type error in postgresql unless the column is a boolean | 22:24 |
jog0 | #link https://blueprints.launchpad.net/nova/+spec/non-blocking-db | 22:24 |
dripton | So that non-blocking-db blueprint is only for mysql. Do we need to add a parallel one for postgres? | 22:25 |
jog0 | ahh devananda did create the blueprint, just hasn't been approved | 22:25 |
*** dwcramer has quit IRC | 22:25 | |
jog0 | dripton: lets come back to that in a minute, and finish unique-keys first | 22:26 |
jog0 | sdague: it sounds like we need to keep working on this one | 22:27 |
jog0 | sdague: https://blueprints.launchpad.net/nova/+spec/db-unique-keys has no assignee, do you want to take it on? | 22:28 |
*** annegentle__ has quit IRC | 22:28 | |
jog0 | it also needs approval, russellb | 22:28 |
sdague | jog0: yeh, the reality is that False != 0 thing actually caught us other places in tempest trying to get postgresql up | 22:28 |
russellb | jog0: ack | 22:28 |
sdague | jog0: I wasn't actually trying to take it on, I was hoping who ever was working the review would be on so I could help explain things | 22:28 |
russellb | thoughts on the priority? | 22:29 |
dripton | it's a prereq for db-archiving, so fairly high priority | 22:29 |
*** reed has quit IRC | 22:29 | |
russellb | grizzly-2? | 22:30 |
jog0 | dripton: I thought doing the unique delete column gets around the prereq part | 22:30 |
dripton | jog0: ok, I must be mixing up the blueprints | 22:30 |
*** reed has joined #openstack-meeting | 22:30 | |
jog0 | dripton: I may be as well, we do have something like 9 bps now | 22:30 |
jog0 | sdague: do know if boris is around? | 22:31 |
sdague | I do not | 22:31 |
jog0 | so should we just give him the bp anyay? | 22:32 |
dripton | I agree with jog0; db-unique-keys is no longer a prereq for db-archiving. | 22:32 |
jog0 | so Devananda, has the bp for now. Lets move on… or rather back to db pool | 22:33 |
jog0 | #topic db pool | 22:33 |
*** openstack changes topic to "db pool (Meeting topic: db)" | 22:33 | |
jog0 | dripton: you pointed out the current patch only works for mysql | 22:33 |
jog0 | so do we still need a postrgres solution? | 22:34 |
*** eglynn has quit IRC | 22:34 | |
dripton | The current blueprint only mentions mysql. I haven't tested the patch on postgres. | 22:34 |
russellb | i looked at the patch, it is indeed mysql specific | 22:34 |
*** eglynn has joined #openstack-meeting | 22:34 | |
jog0 | would a postgres solution be completely different or can it reuse part of the code? | 22:35 |
*** vipul is now known as vipul|away | 22:36 | |
*** vipul|away is now known as vipul | 22:36 | |
sdague | I think at this point as long as we don't break postgresql it's ok, people that care can optimize there | 22:36 |
*** jrd has quit IRC | 22:37 | |
jog0 | sdague: works for me | 22:37 |
*** reed has quit IRC | 22:37 | |
dripton | ok, I'll take a look at whether it's easy to port to postgres | 22:37 |
dripton | It's hacking around in the mysql driver, and it's possible that the parallel hack is possible in psycopg2 | 22:38 |
jog0 | #action dripton explore dbp pool for postgres | 22:38 |
jog0 | if you want to pursue that option we can just generalize the current blueprint to cover postgres as well | 22:38 |
jog0 | moving on ... | 22:38 |
dripton | Let me look first, and if it's practical we can edit the BP | 22:38 |
jog0 | anyone here from db-common? | 22:39 |
jog0 | ewindisch: ? | 22:39 |
jog0 | #topic no-db-compute | 22:40 |
*** openstack changes topic to "no-db-compute (Meeting topic: db)" | 22:40 | |
jog0 | russellb: it looks like things are moving along nicely | 22:40 |
russellb | yes | 22:40 |
*** afazekas_ has joined #openstack-meeting | 22:40 | |
russellb | making good progress, hard to say what percentage we're at | 22:41 |
russellb | we've started moving things to nova-conductor, and we're exposing some issues here and there along the way | 22:41 |
*** reed has joined #openstack-meeting | 22:41 | |
russellb | hopefully it will speed up once we understand the types of issues we're going to hit while doing it | 22:41 |
russellb | we need to be on the lookout for property-style access for db models in the compute code | 22:41 |
russellb | i know there's more still in there | 22:42 |
jog0 | yeah, I am working on attribute access for my bp as well | 22:42 |
russellb | and they're going to turn into bugs either when we move db access, or you stop model leaks | 22:42 |
russellb | yeah, saw a patch for that | 22:42 |
russellb | i guess we just hope for good test coverage to expose it | 22:42 |
jog0 | I am using my PoC no sqlalchemy leaks to detect the attribute accesses | 22:43 |
russellb | cool | 22:43 |
russellb | very helpful | 22:43 |
jog0 | I have another patch I am working right now | 22:43 |
jog0 | what happens to nova-conductor if its not finished by Grizzly release? | 22:44 |
jog0 | as in still db writes from nova-compute? | 22:44 |
*** sarob has quit IRC | 22:44 | |
russellb | depends how far along we are | 22:45 |
russellb | if we stopped right where we are today | 22:45 |
russellb | we'd probably just change the default config so [conductor] use_local=True is the default | 22:45 |
russellb | which would make it so you don't have to run nova-conductor | 22:45 |
jog0 | cool | 22:45 |
russellb | since it wouldn't provide much value | 22:45 |
jog0 | with 15 min to go we have a bunch of BPs to cover so lets move on | 22:46 |
russellb | ack | 22:46 |
jog0 | #topic db-api-cleanup | 22:46 |
*** openstack changes topic to "db-api-cleanup (Meeting topic: db)" | 22:46 | |
jog0 | as I just said, this one is moving along nicely | 22:46 |
jog0 | hope to have the whole thing done by g3 but targeting nova.db.api only returning primitives by Grizzly-2 | 22:46 |
jog0 | leaving db.api consolidation for G3 | 22:47 |
jog0 | #topic db-archive | 22:47 |
*** openstack changes topic to "db-archive (Meeting topic: db)" | 22:47 | |
jog0 | dripton: take it away | 22:47 |
dripton | Not started on db-archive yet. | 22:47 |
dripton | I'll have something for you next week | 22:47 |
jog0 | can you target it to a milestone | 22:47 |
jog0 | is this G2 or G3? | 22:47 |
dripton | G3 is safer for now. I think it's easy enough that we'll probably hit G2, but I don't want to promise yet. | 22:48 |
jog0 | sounds good | 22:49 |
*** alexpilotti has quit IRC | 22:49 | |
jog0 | #action dripton target db-archive for G3, with goal of hitting G2 | 22:49 |
jog0 | #topic db-reconnect | 22:49 |
*** openstack changes topic to "db-reconnect (Meeting topic: db)" | 22:49 | |
jog0 | it looks like this one hasn't been started either | 22:49 |
jog0 | #action devananda target db-reconnect | 22:50 |
jog0 | #topic db-session-cleanup | 22:50 |
*** openstack changes topic to "db-session-cleanup (Meeting topic: db)" | 22:50 | |
jog0 | looks like this one is moving along nicely, anyone have any comments? | 22:50 |
*** vipul is now known as vipul|away | 22:51 | |
jog0 | #action devananda target db-session-cleanup to milestone | 22:51 |
*** sarob has joined #openstack-meeting | 22:51 | |
jog0 | #topic backportable-db-migrations | 22:51 |
*** openstack changes topic to "backportable-db-migrations (Meeting topic: db)" | 22:51 | |
jog0 | dripton: any comments on this one | 22:51 |
jog0 | you talked about working on it and alembic last time | 22:52 |
dripton | I have a work in progress alembic conversion but have not submitted to the dev list yet. | 22:52 |
dripton | I want to make sure it passes all tests first since it will be controversial. | 22:52 |
dripton | It's currently failing a couple. When it works I will send mail to openstack-dev asking for comments. | 22:52 |
jog0 | ETA on that? | 22:52 |
dripton | Monday of next week | 22:53 |
jog0 | #action dripton prepare alembic patch to discuss on openstack-dev | 22:53 |
*** mtreinish has quit IRC | 22:53 | |
jog0 | I think that brings us to the end | 22:55 |
jog0 | #open discussion | 22:55 |
jog0 | #action open discussion | 22:55 |
jog0 | #undo | 22:55 |
openstack | Removing item from minutes: <ircmeeting.items.Action object at 0x2351dd0> | 22:55 |
jog0 | #topic open discussion | 22:55 |
*** openstack changes topic to "open discussion (Meeting topic: db)" | 22:55 | |
jog0 | anything else? | 22:55 |
dripton | I guess we're done. | 22:57 |
jog0 | thank you everyone | 22:57 |
dripton | thanks dog0 | 22:57 |
dripton | jog0 | 22:57 |
jog0 | #endmeeting | 22:57 |
*** openstack changes topic to "OpenStack meetings || Development in #openstack-dev || Help in #openstack" | 22:57 | |
openstack | Meeting ended Thu Nov 29 22:57:24 2012 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 22:57 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/db/2012/db.2012-11-29-22.11.html | 22:57 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/db/2012/db.2012-11-29-22.11.txt | 22:57 |
openstack | Log: http://eavesdrop.openstack.org/meetings/db/2012/db.2012-11-29-22.11.log.html | 22:57 |
*** dripton has quit IRC | 22:57 | |
*** dripton has joined #openstack-meeting | 22:58 | |
*** almaisan-away has quit IRC | 22:59 | |
*** almaisan-away has joined #openstack-meeting | 23:01 | |
*** almaisan-away is now known as al-maisan | 23:01 | |
*** vishy_zz is now known as vishy | 23:02 | |
*** colinmcnamara has joined #openstack-meeting | 23:02 | |
*** vipul|away is now known as vipul | 23:03 | |
*** newptone has joined #openstack-meeting | 23:04 | |
*** devananda has quit IRC | 23:07 | |
*** devananda has joined #openstack-meeting | 23:08 | |
*** dhellmann has quit IRC | 23:12 | |
*** markmcclain2 has quit IRC | 23:16 | |
*** andrewbogott is now known as andrewbogott_afk | 23:17 | |
*** al-maisan is now known as almaisan-away | 23:18 | |
*** vipul is now known as vipul|away | 23:18 | |
*** eglynn has quit IRC | 23:23 | |
*** vipul|away is now known as vipul | 23:23 | |
*** annegentle_ has joined #openstack-meeting | 23:25 | |
*** reed has quit IRC | 23:26 | |
*** annegentle_ has quit IRC | 23:26 | |
*** lifeless has quit IRC | 23:27 | |
*** ryanpetrello has quit IRC | 23:29 | |
*** ryanpetrello has joined #openstack-meeting | 23:30 | |
*** jrodom has joined #openstack-meeting | 23:32 | |
*** jrodom has quit IRC | 23:35 | |
*** reed has joined #openstack-meeting | 23:38 | |
*** mattray has quit IRC | 23:40 | |
*** Gordonz has quit IRC | 23:41 | |
*** newptone has quit IRC | 23:42 | |
*** cp16net is now known as cp16net|away | 23:44 | |
*** dkehn has joined #openstack-meeting | 23:46 | |
*** ryanpetrello has quit IRC | 23:46 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!