| eglynn | jogo: "just about to push" ==> to nova-specs? | 00:01 |
|---|---|---|
| *** flwang_ has joined #openstack-ceilometer | 00:01 | |
| *** fnaval has quit IRC | 00:01 | |
| *** fnaval has joined #openstack-ceilometer | 00:01 | |
| openstackgerrit | Pradeep Kilambi proposed a change to openstack/ceilometer: Support for per disk volume measurements https://review.openstack.org/111038 | 00:02 |
| *** fnaval has quit IRC | 00:06 | |
| prad | eglynn: ^^ incorporated the changes discussed. Please review | 00:08 |
| eglynn | prad: thanks for the quick turnaround, will probably be tmrw by the time I get to it (~1am here now) | 00:08 |
| prad | ah np | 00:10 |
| *** Qiming has quit IRC | 00:10 | |
| prad | eglynn: have a good night :).. talk to you tomorrow | 00:10 |
| eglynn | prad: cool, you too! | 00:11 |
| *** Dafna has joined #openstack-ceilometer | 00:11 | |
| *** flwang_ has quit IRC | 00:14 | |
| *** drjones has quit IRC | 00:20 | |
| *** _cjones_ has joined #openstack-ceilometer | 00:21 | |
| *** itisit has quit IRC | 00:29 | |
| *** sbfox has joined #openstack-ceilometer | 00:29 | |
| *** eglynn has quit IRC | 00:30 | |
| openstackgerrit | A change was merged to openstack/pycadf: Debug env for tox https://review.openstack.org/109903 | 00:37 |
| *** amalagon_ has joined #openstack-ceilometer | 00:44 | |
| *** dmsimard is now known as dmsimard_away | 00:50 | |
| *** raymondr has joined #openstack-ceilometer | 01:01 | |
| *** Qiming has joined #openstack-ceilometer | 01:04 | |
| *** raymondr has quit IRC | 01:05 | |
| *** _cjones_ has quit IRC | 01:09 | |
| *** _cjones_ has joined #openstack-ceilometer | 01:09 | |
| *** _cjones_ has quit IRC | 01:15 | |
| *** ddieterly has joined #openstack-ceilometer | 01:24 | |
| *** flwang_ has joined #openstack-ceilometer | 01:39 | |
| *** atan8 has joined #openstack-ceilometer | 01:43 | |
| *** nosnos has joined #openstack-ceilometer | 01:45 | |
| *** flwang_ has quit IRC | 01:48 | |
| *** thomasem has joined #openstack-ceilometer | 01:59 | |
| *** thomasem has quit IRC | 02:04 | |
| *** raymondr has joined #openstack-ceilometer | 02:08 | |
| *** flwang_ has joined #openstack-ceilometer | 02:11 | |
| *** dmsimard_away is now known as dmsimard | 02:12 | |
| *** atan8 has quit IRC | 02:12 | |
| *** fnaval has joined #openstack-ceilometer | 02:23 | |
| *** flwang_ has quit IRC | 02:28 | |
| *** mitz has joined #openstack-ceilometer | 02:30 | |
| *** sbfox has quit IRC | 02:44 | |
| *** fnaval has quit IRC | 02:50 | |
| *** fnaval has joined #openstack-ceilometer | 02:50 | |
| *** dmsimard is now known as dmsimard_away | 02:52 | |
| *** fnaval has quit IRC | 02:55 | |
| *** raymondr has quit IRC | 02:59 | |
| *** nosnos has quit IRC | 03:04 | |
| *** sbfox has joined #openstack-ceilometer | 03:17 | |
| *** fnaval has joined #openstack-ceilometer | 03:28 | |
| openstackgerrit | Mike Spreitzer proposed a change to openstack/ceilometer: Documented Stevedore usage and source details https://review.openstack.org/111907 | 03:31 |
| samm | eglynn: thanks for the ceilo.config file , but in this what is use of rabbit?. Is it necessary to use that? do we need to install rabbit? | 03:43 |
| *** dmsimard_away is now known as dmsimard | 03:59 | |
| *** dmsimard is now known as dmsimard_away | 04:04 | |
| *** nosnos has joined #openstack-ceilometer | 04:08 | |
| *** _nadya_ has joined #openstack-ceilometer | 04:10 | |
| *** fnaval has quit IRC | 04:16 | |
| *** fnaval has joined #openstack-ceilometer | 04:16 | |
| samm | Hey all, can you please tell me is there any need to use rabbit in order to use ceilometer? | 04:19 |
| *** flwang_ has joined #openstack-ceilometer | 04:29 | |
| *** flwang_ has quit IRC | 04:33 | |
| *** ildikov has quit IRC | 04:36 | |
| *** jogo has left #openstack-ceilometer | 04:43 | |
| *** _cjones_ has joined #openstack-ceilometer | 04:45 | |
| *** atan8 has joined #openstack-ceilometer | 04:45 | |
| *** amalagon_ has quit IRC | 04:48 | |
| *** _cjones_ has quit IRC | 04:57 | |
| *** _cjones_ has joined #openstack-ceilometer | 04:57 | |
| *** drjones has joined #openstack-ceilometer | 04:58 | |
| *** drjones has quit IRC | 04:59 | |
| *** drjones has joined #openstack-ceilometer | 05:00 | |
| *** _cjones__ has joined #openstack-ceilometer | 05:01 | |
| *** atan8_ has joined #openstack-ceilometer | 05:01 | |
| *** atan8 has quit IRC | 05:01 | |
| *** _cjones_ has quit IRC | 05:02 | |
| *** atan8_ has quit IRC | 05:03 | |
| *** atan8- has joined #openstack-ceilometer | 05:03 | |
| *** atan8- has quit IRC | 05:04 | |
| *** Longgeek has joined #openstack-ceilometer | 05:04 | |
| *** drjones has quit IRC | 05:04 | |
| *** _cjones__ has quit IRC | 05:07 | |
| *** _cjones_ has joined #openstack-ceilometer | 05:08 | |
| *** _cjones_ has quit IRC | 05:20 | |
| *** _cjones_ has joined #openstack-ceilometer | 05:21 | |
| *** flwang_ has joined #openstack-ceilometer | 05:23 | |
| *** fnaval has quit IRC | 05:24 | |
| *** fnaval has joined #openstack-ceilometer | 05:25 | |
| *** _cjones_ has quit IRC | 05:26 | |
| *** fnaval has quit IRC | 05:30 | |
| *** flwang_ has quit IRC | 05:30 | |
| samm | Hi All, I hav eproblem in ceilometer when running command: ceilometer-agent-notification It gives error: AMQP server on localhost:5672 is unreachable | 05:32 |
| *** Longgeek has quit IRC | 05:54 | |
| *** Longgeek has joined #openstack-ceilometer | 05:54 | |
| *** Longgeek_ has joined #openstack-ceilometer | 05:55 | |
| *** _nadya_ has quit IRC | 05:57 | |
| *** Longgeek has quit IRC | 05:59 | |
| *** k4n0 has joined #openstack-ceilometer | 06:02 | |
| *** ildikov has joined #openstack-ceilometer | 06:13 | |
| *** _nadya_ has joined #openstack-ceilometer | 06:27 | |
| *** Titilambert has quit IRC | 06:32 | |
| *** ildikov has quit IRC | 06:33 | |
| *** flwang_ has joined #openstack-ceilometer | 06:38 | |
| *** idegtiarov_ has joined #openstack-ceilometer | 06:44 | |
| openstackgerrit | Hisashi Osanai proposed a change to openstack/ceilometer: enable to get swift's service type from configuration file https://review.openstack.org/112771 | 06:44 |
| *** idegtiarov has quit IRC | 06:46 | |
| *** idegtiarov_ has quit IRC | 06:46 | |
| *** idegtiarov has joined #openstack-ceilometer | 06:46 | |
| *** ildikov has joined #openstack-ceilometer | 06:50 | |
| *** ildikov has quit IRC | 06:50 | |
| *** ildikov has joined #openstack-ceilometer | 06:51 | |
| *** safchain has joined #openstack-ceilometer | 06:52 | |
| *** _nadya_ has quit IRC | 07:03 | |
| *** _nadya_ has joined #openstack-ceilometer | 07:17 | |
| *** arezmerita has joined #openstack-ceilometer | 07:27 | |
| *** Dafna has quit IRC | 07:35 | |
| *** Dafna has joined #openstack-ceilometer | 07:37 | |
| *** flwang_ has quit IRC | 07:47 | |
| *** nosnos has quit IRC | 07:52 | |
| *** eglynn has joined #openstack-ceilometer | 07:53 | |
| *** nosnos has joined #openstack-ceilometer | 07:54 | |
| *** IvanBerezovskiy has joined #openstack-ceilometer | 08:03 | |
| *** flwang_ has joined #openstack-ceilometer | 08:13 | |
| *** sbfox has quit IRC | 08:15 | |
| *** flwang_ has quit IRC | 08:18 | |
| *** Longgeek_ has quit IRC | 09:11 | |
| *** Longgeek has joined #openstack-ceilometer | 09:11 | |
| *** promulo has quit IRC | 09:12 | |
| *** promulo has joined #openstack-ceilometer | 09:13 | |
| *** Longgeek has quit IRC | 09:16 | |
| *** Longgeek has joined #openstack-ceilometer | 09:23 | |
| *** claudiub has joined #openstack-ceilometer | 09:34 | |
| *** _nadya_ has quit IRC | 09:39 | |
| *** Longgeek has quit IRC | 09:43 | |
| *** Longgeek has joined #openstack-ceilometer | 09:44 | |
| *** Longgeek has quit IRC | 09:47 | |
| *** cdent has joined #openstack-ceilometer | 09:50 | |
| *** Qiming has quit IRC | 09:54 | |
| *** pnascimento has joined #openstack-ceilometer | 10:11 | |
| *** nosnos has quit IRC | 10:16 | |
| *** nosnos has joined #openstack-ceilometer | 10:17 | |
| *** flwang_ has joined #openstack-ceilometer | 10:18 | |
| *** ccrouch1 has joined #openstack-ceilometer | 10:21 | |
| *** alexpilotti has joined #openstack-ceilometer | 10:22 | |
| *** flwang_ has quit IRC | 10:22 | |
| *** promulo has quit IRC | 10:23 | |
| *** rwsu has quit IRC | 10:23 | |
| *** ccrouch has quit IRC | 10:23 | |
| *** promulo has joined #openstack-ceilometer | 10:25 | |
| *** nosnos has quit IRC | 10:26 | |
| *** rwsu has joined #openstack-ceilometer | 10:27 | |
| *** pnascimento has quit IRC | 10:45 | |
| *** _nadya_ has joined #openstack-ceilometer | 10:49 | |
| *** Qiming has joined #openstack-ceilometer | 10:52 | |
| *** renatoarmani has joined #openstack-ceilometer | 11:49 | |
| *** Longgeek has joined #openstack-ceilometer | 11:56 | |
| *** julim has joined #openstack-ceilometer | 12:01 | |
| *** vrovachev has joined #openstack-ceilometer | 12:03 | |
| *** _nadya_ has quit IRC | 12:06 | |
| *** flwang_ has joined #openstack-ceilometer | 12:19 | |
| *** flwang_ has quit IRC | 12:24 | |
| *** eglynn is now known as eglynn-lunch | 12:29 | |
| *** prad has quit IRC | 12:33 | |
| *** _nadya_ has joined #openstack-ceilometer | 12:37 | |
| *** thomasem has joined #openstack-ceilometer | 12:44 | |
| *** thomasem has quit IRC | 12:44 | |
| *** eglynn-lunch has quit IRC | 12:44 | |
| *** thomasem has joined #openstack-ceilometer | 12:45 | |
| samm | eglynn: Hi ceilometer problem is resolved to some extent, I think. | 12:46 |
| *** dhellmann_ is now known as dhellmann | 12:47 | |
| *** _nadya_ has quit IRC | 12:48 | |
| *** _nadya_ has joined #openstack-ceilometer | 12:49 | |
| openstackgerrit | Ilya Tyaptin proposed a change to openstack/ceilometer: Improve performance of libvirt inspector requests https://review.openstack.org/98377 | 12:50 |
| *** promulo has quit IRC | 12:51 | |
| *** gordc has joined #openstack-ceilometer | 12:56 | |
| *** ddieterl_ has joined #openstack-ceilometer | 13:04 | |
| *** ddieterly has quit IRC | 13:04 | |
| *** _nadya_ has quit IRC | 13:04 | |
| *** fnaval has joined #openstack-ceilometer | 13:04 | |
| *** ddieterl_ has quit IRC | 13:17 | |
| *** ddieterly has joined #openstack-ceilometer | 13:18 | |
| gordc | 3 | 13:22 |
| *** promulo has joined #openstack-ceilometer | 13:31 | |
| *** eglynn-lunch has joined #openstack-ceilometer | 13:32 | |
| *** renatoar_ has joined #openstack-ceilometer | 13:32 | |
| *** renatoarmani has quit IRC | 13:34 | |
| *** _nadya_ has joined #openstack-ceilometer | 13:35 | |
| gordc | ityaptin: do you know what the the profile_collector_performance command would look like if i ran it against a default devstack? | 13:37 |
| *** dmsimard_away is now known as dmsimard | 13:40 | |
| ityaptin | gordc: Hi! | 13:40 |
| *** ddieterly has quit IRC | 13:44 | |
| ityaptin | gordc: command will look the same as command it example. But you have to prepare config file and db urls for normal test running. | 13:44 |
| ityaptin | gordc: sorry, "command it example" -> "command in example" :) | 13:45 |
| eglynn-office | samm: good news! :( | 13:46 |
| eglynn-office | samm: good news! :) | 13:46 |
| * eglynn-office doesn't know his smiles from his frowns ;) | 13:47 | |
| gordc | ityaptin: hmm. i'll give that a try. | 13:47 |
| gordc | can you also expand on step3. regarding venv? | 13:48 |
| *** russellb is now known as rustlebee | 13:50 | |
| ityaptin | gordc: it's venv with installed my fork of ceilometer. I'll add it to doc. | 13:51 |
| *** jasondotstar has joined #openstack-ceilometer | 13:52 | |
| ityaptin | gordc: Oh, I only reply phrase in doc. What kind of info about venv you want to see? | 13:53 |
| *** jasondotstar has quit IRC | 13:54 | |
| *** jasondotstar has joined #openstack-ceilometer | 13:54 | |
| gordc | ityaptin: i'm not sure what it means... could you like example commands i should run? (it's friday, so my brain is off) | 13:55 |
| ityaptin | gordc: give me a minute :) | 13:56 |
| gordc | awesome. no rush. | 13:57 |
| samm | egylnn:Can you please tell me is it necessary to use rabbitMQ with celiometer | 13:57 |
| *** eglynn-lunch is now known as eglynn | 13:59 | |
| eglynn | samm: it isn't, you could use qpid instead | 14:00 |
| eglynn | samm: (but of course you do need *some* AMQP provider ... almost nothing in OpenStack will work without AMQP) | 14:01 |
| *** prad has joined #openstack-ceilometer | 14:02 | |
| *** fnaval has quit IRC | 14:02 | |
| *** Longgeek has quit IRC | 14:04 | |
| openstackgerrit | gordon chung proposed a change to openstack/ceilometer: normalise resource data https://review.openstack.org/111313 | 14:05 |
| ityaptin | gordc: Please, create file /tmp/ceilometer.conf with this: http://paste.openstack.org/show/92086/. Also be accurate with credentials of your keystone and rabbit. Please, change it in file if they are different. | 14:06 |
| ityaptin | gordc: 2 step: Create file /tmp/db_urls with your backend urls. http://paste.openstack.org/show/92088/ for example | 14:08 |
| ityaptin | gordc: Install ceilometer for with "python setup.py install" and run command from http://paste.openstack.org/show/92087/ | 14:09 |
| prad | Hello _nadya_ , could you please give your opinion on this discussion https://review.openstack.org/#/c/111038/2/ceilometer/compute/pollsters/disk.py | 14:09 |
| prad | _nadya_, eglynn and gordc agree on the latest approach, just want to make sure you're cool with it as well | 14:10 |
| *** flwang_ has joined #openstack-ceilometer | 14:20 | |
| *** vrovachev has quit IRC | 14:24 | |
| *** flwang_ has quit IRC | 14:25 | |
| *** fnaval has joined #openstack-ceilometer | 14:26 | |
| *** mspreitz has joined #openstack-ceilometer | 14:26 | |
| *** Titilambert has joined #openstack-ceilometer | 14:30 | |
| *** arezmerita has quit IRC | 14:35 | |
| *** k4n0 has quit IRC | 14:39 | |
| cdent | eglynn: new version of https://review.openstack.org/#/c/102354/ (javelin) is up. I think this gets the closest I'm going to be able to get | 14:40 |
| eglynn | cdent: thanks! ... looking | 14:42 |
| *** _nadya_ has quit IRC | 14:45 | |
| *** _nadya_ has joined #openstack-ceilometer | 14:45 | |
| *** raymondr_ has joined #openstack-ceilometer | 14:46 | |
| _nadya_ | prad: sorry, I was afk. I will take a look in 2-3 hours, is it ok? | 14:46 |
| prad | _nadya_, sure, that would be great | 14:46 |
| openstackgerrit | Pradeep Kilambi proposed a change to openstack/ceilometer: Support for per disk volume measurements https://review.openstack.org/111038 | 14:47 |
| prad | eglynn: addressed rest of your concerns ^^ | 14:48 |
| *** mspreitz has quit IRC | 14:52 | |
| *** raymondr_ has quit IRC | 14:53 | |
| gordc | ityaptin: have you seen this? http://paste.openstack.org/show/92113/ | 14:55 |
| *** sbfox has joined #openstack-ceilometer | 14:56 | |
| *** ildikov has quit IRC | 14:56 | |
| *** sbfox has quit IRC | 14:59 | |
| *** sbfox has joined #openstack-ceilometer | 14:59 | |
| *** _cjones_ has joined #openstack-ceilometer | 15:01 | |
| *** raymondr_ has joined #openstack-ceilometer | 15:02 | |
| *** IvanBerezovskiy has left #openstack-ceilometer | 15:02 | |
| *** renatoar_ has quit IRC | 15:02 | |
| *** renatoarmani has joined #openstack-ceilometer | 15:02 | |
| *** sbfox has quit IRC | 15:03 | |
| eglynn | cdent: just reviewed that, a few suggestions inline | 15:05 |
| cdent | thanks | 15:05 |
| eglynn | prad: thanks, will look shortly | 15:06 |
| *** Qiming has quit IRC | 15:10 | |
| *** _cjones_ has quit IRC | 15:10 | |
| *** _cjones_ has joined #openstack-ceilometer | 15:10 | |
| *** _cjones_ has quit IRC | 15:15 | |
| openstackgerrit | Eugeniya Kudryashova proposed a change to openstack/python-ceilometerclient: Add endpoint opt into auth_plugin https://review.openstack.org/112943 | 15:24 |
| *** jaypipes has joined #openstack-ceilometer | 15:31 | |
| *** ddieterly has joined #openstack-ceilometer | 15:32 | |
| *** jaypipes is now known as leakypipes | 15:32 | |
| boris-42 | eglynn hi | 15:33 |
| eglynn | boris-42: yo | 15:34 |
| boris-42 | eglynn ^ recently there were bug merged in ceilometer python client | 15:34 |
| boris-42 | eglynn that killed rally gaes=) | 15:34 |
| boris-42 | gates* | 15:34 |
| boris-42 | eglynn here is the fix https://review.openstack.org/112943 | 15:34 |
| prad | eglynn: sorry little confused with your new comments https://review.openstack.org/#/c/111038/4/ceilometer/tests/compute/pollsters/test_diskio.py ... dint i already do that? | 15:34 |
| eglynn | boris-42: is that related to https://bugs.launchpad.net/ceilometer/+bug/1350533 ? | 15:35 |
| boris-42 | eglynn lemme see | 15:35 |
| *** raymondr_ has quit IRC | 15:36 | |
| *** andreykurilin has joined #openstack-ceilometer | 15:36 | |
| eglynn | prad: you left in the unnecessary "if expected_device:" (line 62) | 15:36 |
| boris-42 | eglynn it's differnt | 15:37 |
| boris-42 | eglynn http://paste.openstack.org/show/92128/ | 15:38 |
| prad | eglynn: aha | 15:38 |
| eglynn | boris-42: can a bug be filed for this issue and then linked in the commit message? | 15:38 |
| boris-42 | eglynn sure thing | 15:38 |
| *** _cjones_ has joined #openstack-ceilometer | 15:39 | |
| openstackgerrit | Pradeep Kilambi proposed a change to openstack/ceilometer: Support for per disk volume measurements https://review.openstack.org/111038 | 15:39 |
| boris-42 | eglynn oh need this one http://cs616731.vk.me/v616731295/17595/N-96vcb3oK4.jpg | 15:40 |
| eglynn | :) | 15:41 |
| *** claudiub has quit IRC | 16:00 | |
| openstackgerrit | Eugeniya Kudryashova proposed a change to openstack/python-ceilometerclient: Add endpoint opt into auth_plugin https://review.openstack.org/112943 | 16:03 |
| *** safchain has quit IRC | 16:04 | |
| *** _nadya_ has quit IRC | 16:10 | |
| *** fabiog has joined #openstack-ceilometer | 16:11 | |
| *** flwang_ has joined #openstack-ceilometer | 16:21 | |
| *** itisit has joined #openstack-ceilometer | 16:23 | |
| *** raymondr_ has joined #openstack-ceilometer | 16:23 | |
| eglynn-office | lsmola: are you around? | 16:24 |
| eglynn-office | lsmola: (related to that dupe'd sample issue you reported on IRC earlier in the week) | 16:25 |
| *** flwang_ has quit IRC | 16:25 | |
| *** sbfox has joined #openstack-ceilometer | 16:48 | |
| cdent | gordc: you around? | 16:55 |
| *** sbfox has quit IRC | 16:58 | |
| *** renatoarmani has quit IRC | 17:02 | |
| *** fnaval has quit IRC | 17:06 | |
| *** fnaval has joined #openstack-ceilometer | 17:07 | |
| *** sbfox has joined #openstack-ceilometer | 17:10 | |
| *** samm has quit IRC | 17:11 | |
| *** fnaval has quit IRC | 17:11 | |
| *** fnaval has joined #openstack-ceilometer | 17:29 | |
| openstackgerrit | Eoghan Glynn proposed a change to openstack/ceilometer: Avoid duplication of discovery for multi-sink sources https://review.openstack.org/112980 | 17:30 |
| *** sbfox1 has joined #openstack-ceilometer | 17:33 | |
| *** eglynn-office is now known as eglynn-officeafk | 17:34 | |
| gordc | cdent: stepped out for lunch. | 17:34 |
| cdent | no worries gordc, just been poking at get_meters on your branch | 17:35 |
| gordc | cool! find anything interesting? | 17:35 |
| cdent | I'm trying to speed up my tests for my experiments: What's the best way to say "only run db related tests against mysql"? | 17:35 |
| *** sbfox has quit IRC | 17:35 | |
| gordc | cdent: well you can pass in the list of tests... something like 'tox -epy27 ceilometer.tests.storage'... not sure if it's possible to select only sql tests though | 17:37 |
| gordc | you might need to do some modifications. | 17:37 |
| cdent | okay | 17:38 |
| cdent | next question: | 17:38 |
| cdent | when you run `ceilometer meter-list` what is that we are actually expecting back: a list of unique meter names, or a list of unique meter/resource-id/user-id/project-id tuples? | 17:39 |
| gordc | cdent: that's what i was trying to figure out yesterday... it's somewhat convoluted... | 17:41 |
| *** eglynn has quit IRC | 17:41 | |
| cdent | If it is the latter, I think the query can be simplified by quite a lot | 17:42 |
| gordc | as i understand it. it should return back a list of unique meter/resource | 17:42 |
| gordc | but not user/project | 17:42 |
| gordc | the best way to figure it out would be to see how mongodb backend gets meter data | 17:42 |
| cdent | yeah, that's what I'm planning to do | 17:43 |
| cdent | I'll likely post up my changes as not-be-merged patchset dependent on yours, for sake of comparison. Is that good, or would you prefer something different? | 17:43 |
| gordc | i probably stared at the query for too long but all the simpler solutions i could think of didn't satisfy the tests we have written. | 17:43 |
| cdent | Ha, yeah, that's part of why I ask, I'm not sure the tests are necessarily right... | 17:44 |
| gordc | that's fine. there's better way but i'm not sure how to do it... :) | 17:45 |
| *** _nadya_ has joined #openstack-ceilometer | 17:45 | |
| gordc | cdent: does your patch involve rewriting tests? | 17:45 |
| cdent | not yet, no | 17:45 |
| cdent | I'm just struggling to understand a failure I'm seeing | 17:45 |
| gordc | ok... yeah, i wouldn't mind hashing out a more logic backend design... but i think we may need to push changes involving test changes to v3 | 17:46 |
| gordc | "I'm just struggling to understand a failure I'm seeing" that was me the past two days. | 17:46 |
| cdent | :) | 17:46 |
| *** raymondr_ has quit IRC | 17:46 | |
| *** fnaval has quit IRC | 17:55 | |
| *** alexpilotti has quit IRC | 17:55 | |
| *** fnaval has joined #openstack-ceilometer | 17:56 | |
| nealph | dhellmann: are there any reference materials to go to for dealing with how to deploy pecan in a multi-threaded way? | 17:58 |
| *** sbfox1 has quit IRC | 17:58 | |
| *** sbfox has joined #openstack-ceilometer | 17:59 | |
| ryanpetrello | nealph: http://pecan.readthedocs.org/en/latest/deployment.html | 17:59 |
| ryanpetrello | tl;dr use uwsgi, gunicorn, or apache+mod_wsgi | 18:00 |
| *** fnaval has quit IRC | 18:00 | |
| nealph | ryanpetrello: thx...one concern is that we're seeing a performance hit when adding Apache, so now we're looking for thread-handling options that would allow us to avoid the apache+mod_wsgi approach... | 18:02 |
| ryanpetrello | yea, I generally *do not* recommend Apache to folks deploying WSGI apps (if they can help it) | 18:03 |
| nealph | performance hit = increase in api response time. | 18:03 |
| ryanpetrello | I think you’ll be much happier w/ uwsgi or dunicorn | 18:03 |
| ryanpetrello | *gunicorn | 18:03 |
| nealph | cool..but if I'm trying to avoid adding package dependancies is there any tuning that can be done? | 18:05 |
| * nealph is being a bit difficult :) | 18:05 | |
| cdent | you can add more workers and more threads to the wsgidaemon (if you're running in that mode) nealph | 18:08 |
| cdent | are you getting latency under load, or just plain latency | 18:09 |
| nealph | cdent: latency under load...good question. | 18:10 |
| *** ssakhamuri has joined #openstack-ceilometer | 18:10 | |
| cdent | because if it is just plain slow per request, I've got no useful advice :) | 18:10 |
| *** eglynn has joined #openstack-ceilometer | 18:11 | |
| nealph | cdent: curious about adding more threads...via wsgi config or some other methodology (feel free to punt me to docs at this point) | 18:12 |
| cdent | I suspect some of this stuff is out of date but: https://code.google.com/p/modwsgi/wiki/ProcessesAndThreading and | 18:13 |
| cdent | https://code.google.com/p/modwsgi/wiki/ConfigurationGuidelines | 18:14 |
| *** jasondotstar has quit IRC | 18:15 | |
| nealph | and with that, we're back with apache. :D Does Nova api use mod_wsgi? | 18:15 |
| * nealph starts to dig through code... | 18:16 | |
| cdent | nealph: I thought you want to stick with apache? | 18:16 |
| cdent | what thing that is running pecan are you making go? | 18:18 |
| *** _nadya_ has quit IRC | 18:21 | |
| nealph | cdent: well, no, Apache introduces latency on a per-request basis. Now, you might be thinking "you'll have to trade horizontal scalability for a bit of per-request latency"...maybe so. This is in support of a scaled-out ceilometer-api. | 18:21 |
| *** flwang_ has joined #openstack-ceilometer | 18:22 | |
| cdent | mount ceilometer/api/app.wsgi under whatever wsgi server you like? uwsgi is my choice these days. | 18:23 |
| cdent | biab, must dine | 18:24 |
| *** flwang_ has quit IRC | 18:26 | |
| eglynn | gordc: hola! ... quick question about bigger-data-sql https://review.openstack.org/101009 | 18:45 |
| eglynn | gordc: does it feel like there's enough consensus now to get the spec landed? | 18:46 |
| eglynn | (assuming a fresh spec patchset, updated to line up the etherpad and the WIP patch) | 18:46 |
| *** rbowen has quit IRC | 18:49 | |
| *** rbowen has joined #openstack-ceilometer | 18:49 | |
| *** _cjones_ has quit IRC | 18:54 | |
| *** drjones has joined #openstack-ceilometer | 18:55 | |
| gordc | eglynn: sorry about that. was in a meeting... i think i'm ok with the current design. i'll refresh the spec to reflect the latest patchset. | 18:58 |
| eglynn | gordc: great, thank you sir! | 19:02 |
| cdent | eglynn, did you see the conversation including this question earlier: when you run `ceilometer meter-list` what is that we are actually expecting back: a list of unique meter names, or a list of unique meter/resource-id/user-id/project-id tuples? | 19:02 |
| cdent | [6:41pm] | 19:02 |
| eglynn | cdent: sorry missed that, on the bike home | 19:03 |
| cdent | the more I look at the code the more I think that earlier optimizations done to reduce size of the samples being joined against resource info has lead to weird tests or expectations | 19:03 |
| eglynn | cdent: IIUC it would be, unique (meter, resource-id) pairs | 19:03 |
| *** ccrouch1 has quit IRC | 19:03 | |
| cdent | That's my guess too, but that's not what this test verifies: | 19:03 |
| cdent | https://github.com/openstack/ceilometer/blob/9936b3469c833e88d8e39de4919d51b6bb21ff0b/ceilometer/tests/storage/test_storage_scenarios.py#L386 | 19:04 |
| * eglynn looks | 19:05 | |
| cdent | it wants a result of 1 | 19:05 |
| cdent | but the availble results that match 'user-id' are: | 19:05 |
| cdent | [(u'instance', u'resource-id', u'user-id'), (u'instance', u'resource-id-alternate', u'user-id')] | 19:05 |
| cdent | this subquery: https://github.com/openstack/ceilometer/blob/9936b3469c833e88d8e39de4919d51b6bb21ff0b/ceilometer/storage/impl_sqlalchemy.py#L427 | 19:06 |
| cdent | limits the results | 19:06 |
| eglynn | hmmm, I'm missing something here obviously | 19:07 |
| gordc | cdent: iiuc, it's because mongo doesn't store all unique resources (unlike sql)... it only stores the latest instance of resource. | 19:07 |
| eglynn | so the pairs in this case being (instance, resource-id) and (instance, resource-id-alternate), or? | 19:07 |
| cdent | (at least I think so, I get the results above when I turn the SQL into something much more simple) | 19:07 |
| eglynn | cdent: what values did you expect to see? | 19:08 |
| cdent | the answer I expect, given your expression of "unique (meter, resource-id) paris" is the list I've pasted above | 19:09 |
| cdent | To get the results that mongo presents you have to do some perilously complex SQL | 19:09 |
| cdent | and the only reason mongo presents the results it does it because it doesn't keep as much data around | 19:09 |
| cdent | (evidently)( | 19:10 |
| *** fnaval has joined #openstack-ceilometer | 19:10 | |
| gordc | cdent: i actually ran down this path yesterday... it's because of above reason... it only keeps latest record of resource. so in mongodb, the resource-id-alternate resource exists... but it doesn't have that user-id (because a later sample changes it) | 19:11 |
| * cdent nods | 19:11 | |
| gordc | i guess you're asking if that is right or wrong? | 19:11 |
| eglynn | yeah just looking at how the test sets up the data | 19:11 |
| eglynn | that's the artificial thing I think | 19:11 |
| cdent | It seems.... unfair... to expect the sql side to bend over backwards to produce what is in fact incorrect results | 19:11 |
| eglynn | as in, artificial == "not reflecting reality" | 19:12 |
| eglynn | https://github.com/openstack/ceilometer/blob/9936b3469c833e88d8e39de4919d51b6bb21ff0b/ceilometer/tests/storage/test_storage_scenarios.py#L90 | 19:12 |
| cdent | especially when the sql side could be much simpler | 19:12 |
| eglynn | https://github.com/openstack/ceilometer/blob/9936b3469c833e88d8e39de4919d51b6bb21ff0b/ceilometer/tests/storage/test_storage_scenarios.py#L96 | 19:12 |
| eglynn | ^^^ same resource-id, different user-id ==> I don't think that can happen in reality in openstack | 19:12 |
| eglynn | i.e. there's no mechanism I know of to reassign ownership of an existing resource | 19:13 |
| *** _nadya_ has joined #openstack-ceilometer | 19:13 | |
| gordc | eglynn: i'm not sure it can either.. but we do have a lot of tests that are written to test this. | 19:13 |
| cdent | is that a bug in the tests we ought to fix before trying to fix the database? | 19:13 |
| cdent | because if we are trying to fix the database to bad tests, we're going to go through unnecessary hoops | 19:13 |
| eglynn | cdent: I think mongo is doing the realistic thing, just storing the latest resource representation | 19:14 |
| cdent | the sql I've got going reverses the join, so we are only pulling stuff out of the Sample table as needed, rather than needing to use the Sample as a starting point | 19:14 |
| cdent | eglynn: that's the long term goal for the sql side too, but for the sake of incremental changes... | 19:15 |
| gordc | cdent: i'm not sure it's a code bug becasue mongo/hbase backends explicitly support it (through column updates)... it might be a design bug for 'realworld' case. | 19:15 |
| cdent | with my sql there explain shows three simple steps instead of 5 primary or derived tables | 19:15 |
| cdent | s/there/the/ | 19:16 |
| eglynn | cdent: so your sql change is to stop producing the "incorrect results" that match what mongo produces? | 19:16 |
| cdent | my sql change returns "unique (meter, resource-id) pairs" | 19:17 |
| gordc | cdent: i know what you're talking about... i could've built a much simpler query... but it just wouldn't work with tests so i figured i'd leave it for v3 | 19:17 |
| gordc | i think the current query matches current performance... but i can't verify with hard numbers because i can't run ilya's tests. | 19:18 |
| cdent | gordc: I figured that was the case and I was probably beating on already beaten walls... | 19:18 |
| eglynn | cdent: so without your change the test produces: [(u'instance', u'resource-id', u'user-id'), (u'instance', u'resource-id-alternate', u'user-id')] amiright? | 19:18 |
| cdent | gordc: But just looking at the generated queries it seems rather too obvious the ways in which things are broken it is hard to not want to fix it...now! | 19:18 |
| gordc | cdent: hopefully you find a different path... i kept trying to simplify query... then i got tired | 19:18 |
| eglynn | cdent: whereas with your change the test produces what exactly? | 19:19 |
| cdent | eglynn: the opposite, without my change, the test produces just one result, with my change it produces the list | 19:19 |
| gordc | eglynn: it would just produce first item | 19:19 |
| gordc | the second item exists with different user id in mongo/(probably hbase) | 19:20 |
| cdent | given what is stored in the database, and definition of "meter-list", my results are "correct" | 19:20 |
| gordc | https://github.com/openstack/ceilometer/blob/9936b3469c833e88d8e39de4919d51b6bb21ff0b/ceilometer/tests/storage/test_storage_scenarios.py#L96-L101 this sample overwrites | 19:20 |
| cdent | (by some strange definition of "correct") | 19:20 |
| eglynn | cdent: I don't follow, are (instance, resource-id) & (instance, resource-id-alternate) not unique pairs? | 19:21 |
| gordc | cdent: i think the issue is that mongo/hbase only store latest... but to do that in sql would be bad for performance because of all the updates | 19:21 |
| cdent | they are unique paris, they are a list of two items, the _original_ code demands 1 | 19:21 |
| cdent | the original code, for sql, achieves the result of "1" by trimming the available data in a subquery | 19:22 |
| cdent | in order to get results that mirror mongo | 19:22 |
| eglynn | ok, got it ... finally ;) | 19:23 |
| cdent | my contention is that that subquery is actually resulting in incorrect results, if you take the whole database into account | 19:23 |
| gordc | eglynn: it took me 2 days to get to where you are. | 19:23 |
| cdent | _and_ is also really expensive | 19:23 |
| eglynn | TBH this is a highly artificial situation, if it can't happen in the wild | 19:23 |
| *** raymondr_ has joined #openstack-ceilometer | 19:23 | |
| cdent | I've done manual tests (making some instances, listing some meters) and the results are sensible | 19:24 |
| * eglynn wonders if we shouldn't just strip out all those multi-{user|project|source}-per-resource tests? | 19:24 | |
| eglynn | ... seeing as they're costing us in terms of confusion and complexity in the tests | 19:24 |
| gordc | eglynn: i wondered same thing... thought it be safer as part of v3. | 19:25 |
| eglynn | ... yet seem to add no value, since those scenarios can't occur | 19:25 |
| eglynn | gordc: yeah, fair point | 19:25 |
| cdent | meh! :) | 19:26 |
| eglynn | ... a typical Friday evening suggestion :) | 19:26 |
| cdent | :) | 19:26 |
| *** ildikov has joined #openstack-ceilometer | 19:28 | |
| *** eglynn has quit IRC | 19:32 | |
| cdent | for my own sense of friday evening edification I'm going to keep traveling down my current path, just to see what I can learn | 19:32 |
| gordc | cdent: can you make note how many tests need to be changed? | 19:35 |
| cdent | yes, will do | 19:35 |
| cdent | just made one change just now, and am running again | 19:35 |
| *** ildikov has quit IRC | 19:41 | |
| openstackgerrit | gordon chung proposed a change to openstack/ceilometer-specs: 'big-data' sql part 2 https://review.openstack.org/101009 | 19:44 |
| boris-42 | gordc hi | 19:46 |
| *** renatoarmani has joined #openstack-ceilometer | 19:54 | |
| *** julim has quit IRC | 20:06 | |
| *** openstackgerrit has quit IRC | 20:20 | |
| *** flwang_ has joined #openstack-ceilometer | 20:23 | |
| *** renatoarmani has quit IRC | 20:25 | |
| *** promulo has quit IRC | 20:26 | |
| *** flwang_ has quit IRC | 20:27 | |
| cdent | gordc: https://review.openstack.org/#/c/113014/ | 20:33 |
| cdent | That's as far as I'm going to get today. Hard to say, yet, if it will be promising. | 20:34 |
| *** cdent has quit IRC | 20:34 | |
| *** _nadya_ has quit IRC | 20:36 | |
| *** robsparker has quit IRC | 20:42 | |
| *** dmsimard is now known as dmsimard_away | 20:46 | |
| *** robsparker has joined #openstack-ceilometer | 21:00 | |
| *** itisit has left #openstack-ceilometer | 21:06 | |
| *** gordc has quit IRC | 21:07 | |
| *** thomasem has quit IRC | 21:24 | |
| *** atan8 has joined #openstack-ceilometer | 21:49 | |
| *** fnaval has quit IRC | 21:55 | |
| *** fnaval has joined #openstack-ceilometer | 21:56 | |
| *** ddieterly has quit IRC | 21:58 | |
| *** fnaval has quit IRC | 22:00 | |
| *** raymondr_ has quit IRC | 22:05 | |
| *** fnaval has joined #openstack-ceilometer | 22:13 | |
| *** raymondr has joined #openstack-ceilometer | 22:17 | |
| *** flwang_ has joined #openstack-ceilometer | 22:24 | |
| *** prad has quit IRC | 22:24 | |
| *** drjones has quit IRC | 22:26 | |
| *** _cjones_ has joined #openstack-ceilometer | 22:26 | |
| *** flwang_ has quit IRC | 22:29 | |
| *** openstackgerrit has joined #openstack-ceilometer | 22:38 | |
| *** jdonalds has joined #openstack-ceilometer | 22:44 | |
| *** raymondr has quit IRC | 22:46 | |
| *** jdonalds has quit IRC | 22:50 | |
| *** _cjones_ has quit IRC | 22:51 | |
| *** _cjones_ has joined #openstack-ceilometer | 22:51 | |
| *** flwang_ has joined #openstack-ceilometer | 23:00 | |
| *** _cjones_ has quit IRC | 23:17 | |
| *** _cjones_ has joined #openstack-ceilometer | 23:18 | |
| *** flwang_ has quit IRC | 23:27 | |
| *** _nadya_ has joined #openstack-ceilometer | 23:37 | |
| *** _nadya_ has quit IRC | 23:41 | |
| *** promulo has joined #openstack-ceilometer | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
