Wednesday, 2015-02-04

harlowjanikhil_k hopefully answered your quetions on https://review.openstack.org/#/c/85211/ :)00:00
*** TravT has joined #openstack-glance00:03
*** dkingshott has quit IRC00:04
*** annashen has joined #openstack-glance00:07
*** sigmavirus24 is now known as sigmavirus24_awa00:07
*** jasondotstar has joined #openstack-glance00:16
*** alex_xu_ has quit IRC00:23
*** flwang2 has left #openstack-glance00:30
*** flwang2 has joined #openstack-glance00:38
*** jasondotstar has quit IRC00:41
*** annashen has quit IRC00:53
*** david-lyle is now known as david-lyle_afk00:57
*** nellysmitt has joined #openstack-glance01:11
*** nellysmitt has quit IRC01:16
*** jasondotstar has joined #openstack-glance01:24
*** jamielennox is now known as jamielennox|away01:33
*** TravT has quit IRC01:34
flwang2zhiyan: ping01:36
*** jasondotstar has quit IRC01:50
*** ericpeterson has joined #openstack-glance02:01
*** ericpeterson has quit IRC02:05
*** rwsu is now known as rwsu-afk02:11
*** haomaiwang has joined #openstack-glance02:20
*** ericpeterson has joined #openstack-glance02:22
*** sigmavirus24_awa is now known as sigmavirus2402:26
*** sigmavirus24 is now known as sigmavirus24_awa02:27
*** diegows has quit IRC02:33
*** ericpeterson has quit IRC02:37
*** spzala has quit IRC03:01
*** nellysmitt has joined #openstack-glance03:12
zhiyanflwang2: pong03:14
*** nellysmitt has quit IRC03:16
*** harlowja is now known as harlowja_away03:28
*** annashen has joined #openstack-glance03:29
openstackgerritSabari proposed openstack/glance_store: Check VMware session before uploading image  https://review.openstack.org/14166503:42
*** mitz_ has quit IRC03:56
*** mitz has joined #openstack-glance03:56
*** TravT has joined #openstack-glance03:58
*** TravT has quit IRC04:02
*** annashen has quit IRC04:12
*** flwang2 has quit IRC04:13
*** annashen has joined #openstack-glance04:15
*** jyoti-ranjan has joined #openstack-glance04:23
*** julim has quit IRC04:27
*** annashen has quit IRC04:31
*** mgagne has joined #openstack-glance04:53
*** changbl has joined #openstack-glance04:57
*** annashen has joined #openstack-glance05:09
*** david-lyle_afk has quit IRC05:11
*** david-lyle_afk has joined #openstack-glance05:11
*** nellysmitt has joined #openstack-glance05:13
*** nellysmitt has quit IRC05:17
*** harlowja_away has quit IRC05:19
*** test2222 has joined #openstack-glance05:23
*** alex_xu has joined #openstack-glance05:24
*** test2222 has quit IRC05:27
*** sgotliv has joined #openstack-glance05:30
*** mtreinish has quit IRC05:40
*** TravT has joined #openstack-glance05:55
*** mtreinish has joined #openstack-glance05:56
*** annashen has quit IRC05:59
*** annashen has joined #openstack-glance06:01
openstackgerritOpenStack Proposal Bot proposed openstack/glance: Imported Translations from Transifex  https://review.openstack.org/14676506:02
*** nlevinki has joined #openstack-glance06:13
*** nlevinki has quit IRC06:14
*** nlevinki has joined #openstack-glance06:15
*** annashen has quit IRC06:17
*** sgotliv has quit IRC06:22
*** flwang has joined #openstack-glance06:29
*** sgotliv has joined #openstack-glance06:40
*** sgotliv has quit IRC06:52
openstackgerritJun Hong Li proposed openstack/glance-specs: Add spec for https support in glance-replicator  https://review.openstack.org/15280907:04
*** chlong has joined #openstack-glance07:06
openstackgerritJun Hong Li proposed openstack/glance-specs: Add spec for https support in glance-replicator  https://review.openstack.org/15280907:08
*** abhishekk has joined #openstack-glance07:09
*** nellysmitt has joined #openstack-glance07:13
*** groen692 has joined #openstack-glance07:14
*** nellysmitt has quit IRC07:18
*** chlong has quit IRC07:28
*** belmoreira has joined #openstack-glance07:36
*** nellysmitt has joined #openstack-glance07:42
*** tshefi has joined #openstack-glance08:14
*** markus_z has joined #openstack-glance08:23
*** TravT has quit IRC08:24
*** jistr has joined #openstack-glance08:29
*** sgotliv has joined #openstack-glance08:29
*** TravT has joined #openstack-glance08:39
*** TravT has quit IRC08:43
*** TravT has joined #openstack-glance08:52
*** TravT has quit IRC08:58
*** jyoti-ranjan has quit IRC09:04
*** pdb has joined #openstack-glance09:09
*** takedakn has joined #openstack-glance09:12
*** TravT has joined #openstack-glance09:15
*** mfedosin has quit IRC09:20
*** belmoreira has quit IRC09:21
*** TravT has quit IRC09:22
*** belmoreira has joined #openstack-glance09:22
*** takedakn has quit IRC09:29
nikhil_kativelkov: back yet?09:35
*** boris-42 has joined #openstack-glance09:39
*** lakshmiS has joined #openstack-glance09:42
*** lakshmiS has quit IRC09:47
*** lakshmiS has joined #openstack-glance09:47
*** MattMan has joined #openstack-glance09:49
*** TravT has joined #openstack-glance09:56
*** TravT has quit IRC10:01
abhishekkhi all, I am getting error pkg_resources.DistributionNotFound: glance==2015.1.dev87, while starting the glance api, registry service10:06
abhishekkdoes any one know how to resolve this issue?10:06
nikhil_kwhere abhishekk ?10:20
abhishekknikhil_k: on screen10:21
nikhil_kdevstack you mean?10:21
abhishekkI have installed using devstack10:21
abhishekkafter installation services are running, but when I try to restart the service it gives ^^ error10:21
nikhil_kabhishekk: check your pkg info and see if matches10:29
nikhil_kyou may not have installed after changing (with appropriate permissions)10:29
* nikhil_k afk10:30
abhishekknikhil_k: ok, thank you for the pointer10:30
*** TravT has joined #openstack-glance10:32
*** TravT has quit IRC10:37
*** jasondotstar has joined #openstack-glance10:46
*** belmoreira has quit IRC10:48
*** TravT has joined #openstack-glance10:50
*** haomaiwang has quit IRC10:51
nikhil_kflaper87: zhiyan: kragniz sigmavirus24_awa : anyone seeing metadef, tasks etc commands on the client cli?10:53
*** Longgeek has joined #openstack-glance10:55
*** TravT has quit IRC10:55
*** jyoti-ranjan has joined #openstack-glance10:55
*** lakshmiS has quit IRC11:03
*** TravT has joined #openstack-glance11:27
*** tnurlygayanov has joined #openstack-glance11:27
*** lakshmiS has joined #openstack-glance11:30
*** TravT has quit IRC11:31
*** Longgeek has quit IRC11:33
openstackgerritYusuke Ide proposed openstack/glance: Add detail description of image_cache_max_size  https://review.openstack.org/15252311:34
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts API  https://review.openstack.org/13662911:36
*** lakshmiS_ has joined #openstack-glance11:43
*** lakshmiS has quit IRC11:46
*** TravT has joined #openstack-glance11:49
*** TravT has quit IRC11:53
*** diegows has joined #openstack-glance11:57
*** david-lyle_afk is now known as david-lyle12:01
*** abhishekk has quit IRC12:03
*** abhishekk has joined #openstack-glance12:03
*** TravT has joined #openstack-glance12:04
openstackgerritLakshmi N Sampath proposed openstack/glance: Synchronising oslo-incubator service module and its dependencies to enable openstack common service launcher within glance. This will be used as the framework for event notifiers and listeners.  https://review.openstack.org/15287212:10
*** TravT has quit IRC12:10
*** abhishekk has quit IRC12:11
openstackgerritLakshmi N Sampath proposed openstack/glance: Synchronising oslo-incubator service module  https://review.openstack.org/15287212:13
*** hemanth has joined #openstack-glance12:14
*** jyoti-ranjan has quit IRC12:15
*** rodrigod` has joined #openstack-glance12:18
*** jasondotstar has quit IRC12:20
*** hemanth_ has quit IRC12:20
*** zul has quit IRC12:20
*** rodrigods has quit IRC12:20
*** TravT has joined #openstack-glance12:21
*** rodrigod` is now known as rodrigods12:22
*** rodrigods has quit IRC12:22
*** rodrigods has joined #openstack-glance12:22
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts Repository - DB  https://review.openstack.org/11599812:27
*** EmilienM|afk is now known as EmilienM12:27
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts plugin loader  https://review.openstack.org/13430012:28
openstackgerritInessa Vasilevskaya proposed openstack/glance: A mixin for jsonpatch requests validation  https://review.openstack.org/14858812:28
*** zul has joined #openstack-glance12:28
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts API  https://review.openstack.org/13662912:32
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts Domain  https://review.openstack.org/13289812:32
*** david-lyle is now known as david-lyle_afk12:36
*** david-lyle_afk is now known as david-lyle12:36
*** david-lyle is now known as david-lyle_afk12:44
*** david-lyle_afk is now known as david-lyle12:45
*** takedakn has joined #openstack-glance12:47
openstackgerritTravis Tripp proposed openstack/glance: Softare Metadata Definitions  https://review.openstack.org/14800712:47
*** jyoti-ranjan has joined #openstack-glance12:54
kragniznikhil_k: they all look fine to me12:57
*** aix has joined #openstack-glance13:01
*** TravT has quit IRC13:12
*** TravT has joined #openstack-glance13:16
*** tshefi has quit IRC13:22
*** tshefi has joined #openstack-glance13:22
*** TravT has quit IRC13:26
*** mjturek has joined #openstack-glance13:28
*** lakshmiS_ has quit IRC13:49
*** lakshmiS_ has joined #openstack-glance13:49
*** TravT has joined #openstack-glance13:51
*** TravT has quit IRC13:58
*** krykowski has joined #openstack-glance13:59
*** takedakn has quit IRC14:07
*** jyoti-ranjan has quit IRC14:09
*** belmoreira has joined #openstack-glance14:11
*** julim has joined #openstack-glance14:19
*** julim has quit IRC14:21
kragnizfriendly reminder for you all to unleash the openstack lizards14:22
*** julim has joined #openstack-glance14:24
nikhil_kkragniz: is this what you see http://paste.openstack.org/show/166831/ ?14:25
kragniznikhil_k: you need $ glance --os-image-api-version 2 help for them to appear14:27
kragniznikhil_k: since they're part of the v2 api14:27
*** TravT has joined #openstack-glance14:29
nikhil_kv2 should be default no?14:32
kragniznot on the client14:33
kragnizwe were talking about making that switch, but it hasn't happened yet14:33
*** Longgeek has joined #openstack-glance14:33
nikhil_kkragniz: got it, I was looking in the code in thw wrong place. sorry. and thanks!14:34
kragnizyou're welcome!14:34
*** Longgeek has quit IRC14:35
*** peristeri has joined #openstack-glance14:38
*** TravT has quit IRC14:42
*** andrearo1 has joined #openstack-glance14:43
*** andrearosa has quit IRC14:45
*** sgotliv has quit IRC14:47
nikhil_kzhiyan: flaper87 : need your oslo experience a bit here https://review.openstack.org/#/c/85211/14:51
*** andrearo1 is now known as andrearosa14:52
nikhil_kativelkov: we've around 9 hours for fixing https://review.openstack.org/#/c/148574/ . I think we'd plan for this in early k314:52
kragniznikhil_k: I'll help with looking into the taskflow patch14:54
kragniznikhil_k: give me a few minutes for a clean devstack14:54
nikhil_kkragniz: appreciate it14:54
*** sigmavirus24_awa is now known as sigmavirus2415:00
* sigmavirus24 is looking into taskflow issue15:03
sigmavirus24*too15:03
*** TravT has joined #openstack-glance15:03
*** esheffield has joined #openstack-glance15:04
kragnizsigmavirus24: I hope you've voted lizard15:04
*** thangp has joined #openstack-glance15:04
sigmavirus24lol15:04
* sigmavirus24 knows what you're talking about but hasn't read his ML threads yet15:04
* sigmavirus24 knows because he observed the TC meeting and earlier ML threads15:05
* kragniz thinks sigmavirus24 knows too much15:05
* sigmavirus24 is only functioning because he has already had a large quantity of coffee this morning15:06
* nikhil_k bbiab15:08
*** peristeri has quit IRC15:08
*** zz_jgrimm is now known as jgrimm15:09
*** peristeri has joined #openstack-glance15:10
*** EmilienM has quit IRC15:14
*** julim has quit IRC15:15
*** EmilienM has joined #openstack-glance15:16
*** cpallares has joined #openstack-glance15:16
*** julim has joined #openstack-glance15:18
*** peristeri has quit IRC15:23
nikhil_kkragniz: I meant to be afk, did not yet. Any luck so far?15:23
* nikhil_k afk15:25
kragniznikhil_k: a few minutes for a clean devstack was optimistic15:25
sigmavirus24nikhil_k: the reason is that the option should be set to taskflow15:27
sigmavirus24nikhil_k: we do https://github.com/openstack/glance/blob/90a9cc3cc8d7ba350db013a127a65b03cd6c0d2f/glance/domain/__init__.py#L464 to load the module15:27
sigmavirus24so by using "taskflow_executor" it tries to import "glance.async.taskflow_executor_executor"15:28
sigmavirus24the exception message is really bad though15:28
sigmavirus24kragniz: ^15:28
kragnizheh, that message sucks15:28
sigmavirus24YEP15:29
nikhil_ksigmavirus24: I did not set as that15:30
sigmavirus24Ah, was thinking of your second attempt to make it work15:31
sigmavirus24So that's coming from https://github.com/openstack/oslo.utils/blob/master/oslo_utils/importutils.py#L27 and rpartition is working as expected as far as I can tell15:33
*** krykowski has quit IRC15:34
*** nlevinki has quit IRC15:34
*** sgotliv has joined #openstack-glance15:35
*** EmilienM is now known as EmilienM|afk15:35
sigmavirus24hm15:37
sigmavirus24nikhil_k: can you look in /usr/local/lib/python2.7/{dist,site}-packages/glance/async/ to see what's in there?15:44
*** diegows has quit IRC15:44
*** TravT has quit IRC15:44
*** vijendar has joined #openstack-glance15:47
*** tshefi has quit IRC16:00
*** diegows has joined #openstack-glance16:05
*** sgotliv has quit IRC16:06
*** TravT has joined #openstack-glance16:09
nikhil_k$ ls /usr/local/lib/python2.7/dist-packages/glance/async/taskflow_executor.py16:09
nikhil_k/usr/local/lib/python2.7/dist-packages/glance/async/taskflow_executor.py16:09
nikhil_ksigmavirus24: ^16:09
sigmavirus24hm, so it should be able to import it16:09
sigmavirus24from teh commandline, if you do import oslo_utils; oslo_utils.import_class('glance.async.taskflow_executor.TaskExecutor') what happens?16:10
zhiyanSeems sigmavirus24 already got answer16:11
nikhil_kzhiyan: ??16:11
nikhil_kzhiyan: welcome back!16:11
nikhil_kzhiyan: how are you doing now?16:11
sigmavirus24zhiyan: not quite16:11
*** TravT has quit IRC16:11
zhiyanSo what about to change taskfow_executor to just taskfow?16:12
*** TravT has joined #openstack-glance16:12
zhiyanHi nikhil_k! I feel I'm better now.16:13
nikhil_kzhiyan: ah glad to hear!16:13
nikhil_ksigmavirus24: zhiyan : AttributeError: 'module' object has no attribute 'import_object'16:13
sigmavirus24zhiyan: nikhil_k wasn't doing that16:13
nikhil_kand16:13
nikhil_kAttributeError: 'module' object has no attribute 'import_class'16:13
sigmavirus24nikhil_k: sorry, import oslo_utils.importutils and oslo_utils.importutils.import_class(...)16:14
nikhil_ksigmavirus24: zhiyan : I tried 2 values16:14
sigmavirus24so import object is what I think we should be using here anyway, but that's besides the point =P16:14
zhiyanSo I was thinking 23:27:45 <sigmavirus24> nikhil_k: we do https://github.com/openstack/glance/blob/90a9cc3cc8d7ba350db013a127a65b03cd6c0d2f/glance/domain/__init__.py#L464 to load the module is the point no?16:14
nikhil_ktaskflow and glance.async.taskflow16:14
sigmavirus24nikhil_k: the difference is oslo_utils versus oslo_utils**.importutils**16:14
nikhil_ksigmavirus24: right, flaper87 was against it as it was sup to be deprecated16:14
sigmavirus24nikhil_k: ah okay16:14
* sigmavirus24 didn't have that context16:14
zhiyanHumm I'm taking with you on my ip6 hard to do some try16:15
*** EmilienM|afk is now known as EmilienM16:18
nikhil_k>>> oslo_utils.importutils.import_class('glance.async.taskflow_executor.TaskExecutor')16:23
nikhil_k<class 'glance.async.taskflow_executor.TaskExecutor'>16:23
nikhil_k(in a meeting to availability is limited)16:23
nikhil_ks/to/so/16:23
sigmavirus24nikhil_k: is this a cloud server that I could ssh into?16:27
nikhil_ksigmavirus24: umm, you seem like a hacker kind of a person :P16:27
* nikhil_k means that in a good way16:27
sigmavirus24So you want me to write a gui in VB to track your IP address back to the cloudserver?16:28
sigmavirus24Done.16:28
nikhil_kVB :P16:29
sigmavirus24Reference: http://youtu.be/hkDD03yeLnU16:29
sigmavirus24I keep forgetting openstack uses rfc3986 so everytime I see it installed I giggle16:34
*** rwsu-afk is now known as rwsu16:40
*** diegows has quit IRC16:41
*** groen692 has quit IRC16:46
*** belmoreira has quit IRC16:52
*** TravT has quit IRC16:54
*** diegows has joined #openstack-glance16:57
*** annegent_ has joined #openstack-glance16:58
zhiyanseems i can create taskflow executor now successfully now.. i set "task_executor = taskflow" in glance-api.conf and do a replace on glance/async/taskflow_executor.py L109 , replace 'llistener.DynamicLogListener(engine, logger=LOG)' to 'llistener.DynamicLoggingListener(engine, log=LOG)" (base on16:59
zhiyanhttps://github.com/openstack/taskflow/blob/master/taskflow/listeners/logging.py#L114 )16:59
zhiyannikhil_k: sigmavirus24 ^16:59
*** esheffield has quit IRC17:00
sigmavirus24zhiyan: why would that cause the import error?17:00
zhiyani just used 'taskflow' for task_executor option in config, then DynamicLogListener not found raised up.17:02
sigmavirus24We're not seeing that17:03
*** ericpeterson has joined #openstack-glance17:04
zhiyansigmavirus24: any exception still there in you env ?17:06
sigmavirus24yes. I'm digging in17:07
zhiyanin my local env, the task import task can be create correctly, and state of it turned/worked well currently.17:09
zhiyan..with taskflow executor17:10
sigmavirus24so here's the weird thing, if I debug into the running api server, the import fails, outside of that it passes17:12
zhiyanweird17:14
sigmavirus24I think I might see the problem17:15
sigmavirus24also that taskflow stuff is just fine in the local copy zhiyan17:15
zhiyansigmavirus24: which is fine?17:15
sigmavirus24the taskflow logging information17:15
zhiyanyou mean my comment about change DynamicLogListener to DynamicLoggingListener?17:16
zhiyanor the logging out about taskflow...actually i found a wield logging in taskflow side and glance-api..17:17
*** esheffield has joined #openstack-glance17:17
zhiyan.. which it's a 'failed' import image task, but taskflow says task (its concept) just successful ..17:18
sigmavirus24I know what's' going on17:18
*** TravT has joined #openstack-glance17:19
sigmavirus24the version of glance being run is coming out of /opt/stack/glance/glance17:19
sigmavirus24now the question is to find out why17:20
zhiyanneed to sleep. can talk later if needed..also can direct to add comments on gerrit. at least, ify, it works for me locally.17:20
sigmavirus24zhiyan: yeah this is an installation problem =P17:21
zhiyanbtw, i just tested in my devstack env as well..not in /opt/stack however.17:21
sigmavirus24yep17:21
zhiyani think so sigmavirus2417:21
* sigmavirus24 scolds nikhil_k 17:21
sigmavirus24now to fixit17:21
*** TravT_ has joined #openstack-glance17:22
*** TravT has quit IRC17:22
zhiyansigmavirus24: and we def need to change DynamicLogListener to DynamicLoggingListener to make it work17:22
sigmavirus24I believe you. I would guess we're not seeing that yet because of the installation issue.17:23
zhiyanotherwise two exceptions raise up: AttributeError: 'module' object has no attribute 'DynamicLogListener' and TypeError: __init__() got an unexpected keyword argument 'logger'17:24
zhiyansigmavirus24: yep, just share my info here17:25
sigmavirus24thanks zhiyan17:25
*** jistr has quit IRC17:25
zhiyansigmavirus24: np. i'm just interested in why i didn't met that installation issue..17:26
sigmavirus24perhaps zhiyan you ran devstack from a clean machine?17:26
zhiyansigmavirus24: i think it's not really :) it's really 'old'.17:27
*** annashen has joined #openstack-glance17:27
zhiyansigmavirus24: so you verified patch on a clean devstack dev successfully ?17:28
sigmavirus24No I was being super lazy17:28
sigmavirus24I'll devstack now17:29
zhiyansigmavirus24: ok. i need to get some sleep, ttly, or direct add comments in gerrit if needed. thanks for your efforts.17:29
sigmavirus24yep17:29
sigmavirus24have a good night17:30
zhiyanhave a good one too17:30
*** pdb has quit IRC17:40
*** annegent_ has quit IRC17:53
*** groen692 has joined #openstack-glance17:58
*** aix has quit IRC18:05
*** harlowja has joined #openstack-glance18:11
*** jasondotstar has joined #openstack-glance18:11
*** jasondotstar has quit IRC18:14
*** groen692 has quit IRC18:25
*** ericpete_ has joined #openstack-glance18:34
*** ericpeterson has quit IRC18:37
*** lakshmiS_ has quit IRC18:38
*** ericpeterson has joined #openstack-glance18:42
*** ericpete_ has quit IRC18:46
*** annegent_ has joined #openstack-glance18:54
*** annegent_ has quit IRC18:59
*** annegent_ has joined #openstack-glance19:00
*** sgotliv has joined #openstack-glance19:15
*** markus_z has quit IRC19:17
*** flwang has quit IRC19:21
nikhil_ksigmavirus24: back19:23
nikhil_ksigmavirus24: so, I installed it from /home/nikhil/glance19:23
nikhil_kand that's an issue, why?19:23
sigmavirus24nikhil_k: if you look at the logs, things are being used from /opt/stack/glance/*19:32
sigmavirus24So the question may be better asked, why is it using that?19:32
sigmavirus24The first suspect (as is always the case is pbr) =P19:32
nikhil_ksigmavirus24: gotcha, well I'm detached from the screen now19:34
sigmavirus24I think -x will allow us to both be attached19:34
*** ericpeterson has quit IRC19:34
nikhil_knot bad, screens sizes match :)19:34
nikhil_kto some extent19:34
sigmavirus24need me to make mine bigger?19:35
sigmavirus24nikhil_k: and now we're at the problem that zhiyan mentioned earlier19:37
*** annashen has quit IRC19:37
nikhil_ksigmavirus24: nah, it looks good. thanks19:37
*** annashen has joined #openstack-glance19:38
nikhil_knice19:39
nikhil_kit worked, so devstack problem and not the code19:39
nikhil_kthis will make it to k2 hopefully !19:39
nikhil_kok, I'm gunna push up a PS19:39
nikhil_ksigmavirus24: or do you want to?19:39
sigmavirus24nikhil_k: after you19:39
sigmavirus24I have lots on my plate you and I need to fix jeepyb because I doubt anyone's going to fix it for us19:40
* sigmavirus24 logged off your cloudserver19:40
nikhil_ksigmavirus24: appreciate your help on this. Makes a ton of difference esp if this lands in k219:41
*** ericpeterson has joined #openstack-glance19:41
sigmavirus24nikhil_k: happy to help19:41
nikhil_kand with the productive meeting I'd about k319:41
*** diegows has quit IRC19:41
*** harlowja is now known as harlowja_away19:50
*** EmilienM is now known as EmilienM|afk19:53
*** peristeri has joined #openstack-glance19:53
*** ericpete_ has joined #openstack-glance19:58
*** annegent_ has quit IRC19:58
*** diegows has joined #openstack-glance19:59
*** foobloo has joined #openstack-glance20:01
foobloodoes policy.json restrict public images too?20:01
*** ericpeterson has quit IRC20:01
*** annashen has quit IRC20:02
fooblooi tried both is_admin and role:admin for image(s) get, but can still list them as a non-privileged user20:02
openstackgerritnikhil komawar proposed openstack/glance: Add Support for TaskFlow Executor  https://review.openstack.org/8521120:02
foobloosame for delete, et al20:02
*** annegent_ has joined #openstack-glance20:04
nikhil_kflaper87: flwang1 zhiyan ativelkov : https://review.openstack.org/#/c/85211/20:06
nikhil_kand https://review.openstack.org/#/c/148007/20:10
sigmavirus24foobloo: what version of glance20:17
sigmavirus24nikhil_k: btw, any word about the drivers group on launchpad?20:17
nikhil_knothing yet, let me try again20:17
flwang1nikhil_k: yes, sir20:21
nikhil_khello sir20:21
nikhil_kflwang1: need your help with a couple of reviews20:22
nikhil_khttps://review.openstack.org/#/c/85211/ and https://review.openstack.org/#/c/148007/20:22
nikhil_kthey'd be pretty straightforward20:22
nikhil_kI'm happy to chat if you need more info20:22
*** flwang has joined #openstack-glance20:23
*** TravT_ has quit IRC20:23
nikhil_ksigmavirus24: what do you think about postponing https://review.openstack.org/#/c/148574/ ? (if you are busy, we can talk later)20:23
*** TravT has joined #openstack-glance20:23
kragnizsigmavirus24: nikhil_k: sorry, got pulled away for other things20:23
nikhil_kkragniz: no issues, we got it resolved20:23
kragnizall is happy with the taskflow patch now?20:23
kragnizawesome20:24
nikhil_kit was some weird installation problem20:24
kragnizokay - just devstack being itself?20:24
sigmavirus24nikhil_k: No I think that's devstack's fault20:24
sigmavirus24kragniz: yes20:24
sigmavirus24there seems to be a link dropped to /opt/stack/glance so that seems to override dist-packages and I suspect now that it might be a PYTHONPATH thing20:25
* sigmavirus24 didn't think of this before20:25
sigmavirus24nikhil_k: I have no strong opinions about postponing the Cooperative Reader stuff20:25
sigmavirus24I think it makes sense to postpone it even though it is a high priority bug20:25
sigmavirus24It just isn't ready to merge and putting off fixing it up doesn't make a whole lot of sense to me. Plus we threw the idea around to see if any members of the OSSG wanted to give us opinions about the security impact it might have20:26
nikhil_ksigmavirus24: ah ok, I was just curious about that. Did you hear whispers floating in other places?20:27
flwang1nikhil_k: I'm happy to review the taskflow patch, but i'm not really familiar with the metadata def code20:27
nikhil_kin any case, thanks for the reassurance. We'd postpone!20:27
sigmavirus24Ah, I haven't pinged anyone specifically to look at it nikhil_k20:27
nikhil_kflwang1: do ask TravT or me if you need more info on the metadef patch. It's not a big change20:28
nikhil_ksigmavirus24: ahk20:28
* sigmavirus24 puts it on the meeting notes for the next OSSG meeting20:28
flwang1nikhil_k: yep, seems only some db, service definitions20:28
flwang1ok, I will ask if i see some questions20:28
nikhil_kyeah20:28
nikhil_kcool, ty20:29
TravTnikhil_k: flwang1: yep, let me know if you have questions20:29
flwang1TravT: cool, cheers20:29
*** harlowja_away is now known as harlowja20:33
*** IlyaE has joined #openstack-glance20:34
flwang1TravT: ping20:35
flwang1TravT: in https://review.openstack.org/#/c/148007/7/glance/tests/etc/test-metadefs.json i saw the 'protected' attribute value is false, but in all the json files you're adding, it's true20:36
flwang1so i'm wondering if this case can be covered by test20:37
TravTpong20:38
TravTlet me look20:38
TravTok, so that is the difference between where they are located20:39
TravTthat particular file is in test data.20:39
TravTthe other ones are deployed in etc/metadefs20:39
TravTand get loaded by default20:40
flwangyep, I know20:40
TravTin devstack / etc20:40
*** IlyaE has quit IRC20:40
*** IlyaE has joined #openstack-glance20:40
TravTthose particular test metadefs aren't used by an automated test yet20:40
flwangTravT: so does the test-metadefs is used for metadata def testing?20:40
TravTand I could drop them20:40
TravTbut, I created them for testing out some things in the Horizon UI20:40
TravTand decided to contribute them here20:41
flwangso which file will call this test-metadef.json?20:41
flwangin glance20:41
TravTnone of them.20:41
TravTwhich is why I could drop it if you want20:41
TravTbut I have found it useful20:42
TravTfor testing from command line20:42
TravTmanually20:42
nikhil_kIt would be hard to test that in Glance, no?20:42
flwangTravT: may i know how?20:42
TravTlet me type it up in a terminal and copy over20:42
TravTjust a sec20:42
flwangTravT: cool, cheers20:43
*** annashen has joined #openstack-glance20:43
TravTjust FYI, i've got some guys here talking to me, so trying to keep my brain from splitting in half20:44
TravTflwang: here's the first way20:49
TravT glance --os-image-api-version 2 md-namespace-import --file /opt/stack/glance/glance/tests/etc/test-metadefs.json20:49
flwangok20:53
flwangso it's most like a sample file to help you verify something, right?20:53
TravTyeah20:53
TravTmaybe if anything it should be under glance/tests/etc/metadefs though20:53
TravTyou can also do it from glance-manage db_load_metadefs20:54
TravTbut my VM is not responding right now20:55
flwangTravT: if that's the case, personally i prefer to place it in doc and embedded in a file about how to test20:55
flwangbut it's not a real blocker20:55
TravTi think I put it to sleep 1 to many times20:55
foobloosigmavirus24, sorry, got pulled away. I'm using glance-2014.1.320:55
flwangnikhil_k: thoughts?20:55
TravTI could put it in doc if needed.20:56
*** nellysmitt has quit IRC20:56
nikhil_kflwang: I'm okay with moving (if you will be around a bit) :)20:56
nikhil_kand thanks for that extra check20:56
nikhil_kTravT: let's DOIT20:56
TravTHTTP 1.2 DOIT20:56
flwangnikhil_k: I will be here for next 8 hours :D20:56
TravT200 (OK)20:57
nikhil_kflwang: ah ok, cool20:57
TravTso, you want me to put in doc in this patch?20:57
TravTor just drop it out of this patch20:57
nikhil_kninja (OK)20:57
TravTI can drop it in this patch instantly20:57
TravTif in doc, are you wanting it in an RST file?20:57
flwangTravT: how about let's drop it for now20:57
TravTI have another doc change that nikhil wants anyway20:57
flwangand you can post another patch when you're free ;)20:57
nikhil_keither works20:58
openstackgerritTravis Tripp proposed openstack/glance: Softare Metadata Definitions  https://review.openstack.org/14800720:58
TravT^20:58
nikhil_k(dropping now and adding later or changing now)20:58
TravTask an ye shall receive20:59
nikhil_kwe can wait for jenkins20:59
sigmavirus24TravT: what other things can we ask for? =P20:59
nikhil_kgold21:00
TravTSounds like I was asking for it21:00
TravTlol21:00
nikhil_k;)21:00
*** eglynn has quit IRC21:00
*** IlyaE has quit IRC21:02
*** IlyaE has joined #openstack-glance21:02
*** IlyaE has quit IRC21:06
*** zul has quit IRC21:08
*** zul has joined #openstack-glance21:08
*** IlyaE has joined #openstack-glance21:08
sigmavirus24nikhil_k: regarding your feedback on https://review.openstack.org/#/c/148387/, do we really want the very verbose details every time?21:09
sigmavirus24It's seems like that may occasionally have more details than the user cares about21:09
*** foobloo_ has joined #openstack-glance21:09
*** foobloo_ is now known as foobloo221:09
*** IlyaE has quit IRC21:10
*** annegent_ has quit IRC21:10
nikhil_ksigmavirus24: it seems to give the details on xml21:11
foobloo2sigmavirus24, sorry got kicked. the version i mentioned is what rh osp5 installs, 2014.1.321:11
nikhil_kwhy not json?21:11
nikhil_kerr, html not xml21:11
nikhil_ktrying to do multiple things at once, does not help21:11
*** foobloo has quit IRC21:12
sigmavirus24The HTML is only returned if we're using webob's default messages which typically return very little detail in the first place though21:12
sigmavirus24(Assuming they return detail at all ;)21:12
openstackgerritIan Cordasco proposed openstack/glance: Fix for CooperativeReader to properly process read length  https://review.openstack.org/14857421:17
nikhil_kit was a nit anyway21:18
nikhil_kI dont want another session of bikeshedding21:19
nikhil_ksee things like these people should just fix21:20
nikhil_kanyways, +2 there21:20
kragniznikhil_k: it's still better than it was21:21
kragnizeven if it's a little inconsistant21:21
nikhil_kyep21:22
*** IlyaE has joined #openstack-glance21:22
*** TravT has quit IRC21:26
*** IlyaE has quit IRC21:30
*** IlyaE has joined #openstack-glance21:34
*** IlyaE has quit IRC21:36
*** TravT has joined #openstack-glance21:36
sigmavirus24to be fair, I really think there needs to be an associated bug in glance for that glanceclient issue21:37
sigmavirus24I don't think we should ever be returning HTML from glance-api21:38
*** TravT has quit IRC21:41
*** TravT has joined #openstack-glance21:41
*** sgotliv has quit IRC21:41
*** TravT has quit IRC21:42
*** julim has quit IRC21:45
mgagnenikhil_k: do you have any update on this subject? https://etherpad.openstack.org/p/havana-image-cloning-to-other-regions21:45
*** EmilienM|afk is now known as EmilienM21:45
nikhil_kmgagne: So, the only thing I can mention to you is that it is planned and being prioritized. However, it being a complex issue has minimal chance of getting in Kilo. The blockers are glance_store refactor to support user tokens.21:47
*** foobloo2 is now known as foobloo21:47
nikhil_kAnd the preceeding BPs21:47
*** d34dh0r53 is now known as blarnath21:48
nikhil_kwe can chat if you need more info or have devs interested in contributing21:48
mgagnenikhil_k: thanks. we are facing the same challenges here and was looking for existing tools instead of reinventing one of my own =)21:48
*** belmoreira has joined #openstack-glance21:48
*** TravT has joined #openstack-glance21:49
nikhil_khaha ok. Yeah, across DC will be a real challenge. We've discussed it lot and I will be happy to point you to someone who is eager to get this in.21:49
mgagnenikhil_k: I found https://github.com/hep-gc/glint which looks to be promising but it feels (IMO) like killing a fly with a bazooka. And the bazooka requires heavy assembly and uses non-standard rockets.21:52
*** TravT has quit IRC21:55
*** thangp has quit IRC21:57
*** IlyaE has joined #openstack-glance22:00
nikhil_kmgagne: hmm yeah. I've heard of it. BTW, I'm planning to chat with the person who impl squid proxy stuff for CERN later this week22:01
mgagnenikhil_k: cool, his presentation was great.22:02
nikhil_kmgagne: Glint has a lot of potential however, it won't scale for all the use caes22:03
nikhil_kthe way I remember, it deals with a tiny image and if that's what you want to do replicate across DC then it's a good one22:04
*** annegent_ has joined #openstack-glance22:04
*** ericpeterson has joined #openstack-glance22:04
*** ericpete_ has quit IRC22:04
mgagnenikhil_k: are you referring to glint?22:04
nikhil_khowever, people might want to close multiple gigs of data and that too of a proprietary image! And there we need some challenging engg22:05
nikhil_kmgagne: yes, glint22:05
*** blarnath is now known as d34dh0r5322:05
*** annegent_ has quit IRC22:05
nikhil_kat least that's what the person told us. I haven't looked through the docs.22:05
nikhil_k(hope this glint is from UBC group)22:06
mgagnenikhil_k: IIC, there is a "master" glance where "golden" images are stored and a mapping of openstack installations is done in glint. You add/remove them to the list of destinations. The "trick" is the image is created and points to the actual image URL, the image itself is not "copied" to the installation.22:07
mgagnenikhil_k: but each provider has its own use cases. We version our images, cache images in Cinder for faster cloning, etc. and this tool would have to support it in some way.22:07
mgagnenikhil_k: because everyone is special =)22:08
*** IlyaE has quit IRC22:08
*** TravT has joined #openstack-glance22:13
*** TravT has quit IRC22:14
*** TravT_ has joined #openstack-glance22:14
*** TravT_ has quit IRC22:15
nikhil_kmgagne: ah gotcha. cache images in cinder huh, nice22:27
nikhil_ksigmavirus24: (just curious) Don't they get a auto email? And thanks for sending the same.22:28
sigmavirus24nikhil_k: they do, but I think most people ignore those unless it piques their interest. So I replied to it to beg them for input =P22:29
nikhil_ksigmavirus24: haha ok. I think we can have another (secret) backdoor.22:31
nikhil_kLet me try that tomorrow ;)22:31
sigmavirus24Super secret backdoors are the best hideouts22:32
kragnizdoes glance-replicator need to be bundled with glance?22:34
kragnizmight it be more natural for it to live with glanceclient?22:34
kragnizsigmavirus24: ^22:34
sigmavirus24kragniz: Idk22:35
kragnizidk either22:35
mgagnekragniz: glance-replicator is more related to an app than a client library22:35
* sigmavirus24 thought so22:36
sigmavirus24=P22:36
mgagnekragniz: I can only see the same story repeating itself just like keystonemiddleware: moved to keystoneclient and than move to its own repository.22:36
* sigmavirus24 didn't really have any opinions22:36
nikhil_kyeah, it does store related stuff22:36
kragnizmgagne: this is true22:37
kragnizmgagne: it would be much easier if it used glanceclient, though22:37
sigmavirus24nikhil_k: mgagne context is https://review.openstack.org/#/c/149467/22:37
kragnizthanks sigmavirus2422:37
mgagnesigmavirus24: thanks for context. even without context, I still think it would be a bad idea to move it to glanceclient =)22:38
sigmavirus24It would seem that using glanceclient from glance-replicator would be convenient, of course, that makes glance dependent glanceclient which seems odd22:38
ndoneganglance-replicator needs a lot of love.22:43
ndoneganWaiting for "legal" to confirm here that I'm covered by Corporate CLA thingy, and I'll be be pushing up a few small fixes.22:45
kragnizndonegan: cool!22:46
kragnizndonegan: what company?22:47
ndoneganWorkday.22:47
ndoneganUsing glane-replicator in anger between DCs, and found a whole load of small little things, some probably due to our abuse of meta-data.22:48
*** mjturek has quit IRC22:48
mgagnendonegan: tell me more about your abuse :D22:55
*** nellysmitt has joined #openstack-glance22:57
ndoneganmgagne: The custom properties are being used to track what QA etc. images have gone through along with other data used for deciding where an image is allowed to be deployed.22:57
mgagnendonegan: this is relevant to my interests =)22:57
ndoneganWhere we've run into fun is with ha-proxy's max header size.22:58
ndoneganSo QA did some magic to restric the max amount of properties associated with the images.22:59
mgagneoh yea, that one22:59
ndoneganThis works grand locally now. However then I hit it again with glance-replicator :)22:59
mgagnendonegan: I think we tweaked tune.maxrewrite to allow more room for the header values23:00
ndoneganThe only change I've made so far is to catch and handle the socket error thrown by ha-proxy's behaviour.23:00
*** esheffield has quit IRC23:00
*** jaypipes has quit IRC23:00
ndoneganmgagne: Looked at that, however the HA-Proxy seem to thing the sky will fall down if that's done!23:00
mgagnendonegan: running 1.5 ?23:00
ndoneganI'm sort of half tempted to look at LVS rather than ha-proxy for the duty.23:01
ndoneganmgagne: Yup.23:01
*** nellysmitt has quit IRC23:01
mgagnendonegan: yea, we used to use LVS quite extensively before. can't say anything wrong about it. but haproxy is the new trend so. =)23:02
ndoneganmgagne: I'm not all that trendy :)23:02
mgagnendonegan: getting the job done is more trendy =)23:02
ndoneganActually, related to https://review.openstack.org/#/c/149467/ from a security standpoint is token expiry.23:02
*** IlyaE has joined #openstack-glance23:02
ndoneganSecurity don't seem to like long living tokens.23:03
sigmavirus24metadata really doesnt' belong in the headers23:03
ndoneganAnd glance-replicator tends to be fairly long running, at least during the initial dumes or loads.23:03
* sigmavirus24 starts considering a spec to fix tht23:03
ndonegansigmavirus24: A PUT/POST option for the metadata json would be nice.23:04
sigmavirus24ndonegan: can you start an etherpad with this and email it to me?23:04
sigmavirus24or just ping me in here with it23:04
ndonegansigmavirus24: Can do.23:04
sigmavirus24I feel like glance-replicator needs some love but there will be glance improvements necessary23:04
ndonegansigmavirus24: I have a whole load of Jira's open internall which I'm slogging though on an internal fork.23:05
ndoneganWould really prefer it upstream.23:05
*** IlyaE has quit IRC23:05
sigmavirus24heh23:06
sigmavirus24We'll see what we can get upstream23:06
sigmavirus24I think metadata as headers is such a bad idea given the typical limit on header values23:06
ndoneganTHe other fun one is an equivilent of "rsync --delete". That one I'm a bit more scared off, but there's a PoC working internally which hasn't done anything stupid yet.23:06
sigmavirus24FWIW, this is why we're arguing with swift folks over on the API-WG because metadata in headers is such a bad idea and they don't want to give that up23:06
sigmavirus24ndonegan: /yet/ ;)23:07
ndonegansigmavirus24: I'm with you on the meta-data as headers.23:07
sigmavirus24It's currently being proposed as a guideline23:07
*** echevemaster has joined #openstack-glance23:08
ndoneganOh, the other thing implemented internally is the adding the --property-filter from glance client to glance-replicator.23:08
ndoneganNo point having images which haven't passed QA heading out to PROD.23:09
sigmavirus24ndonegan: you're adding fuel to kragniz's fire =P23:09
ndonegansigmavirus24: Good :)D23:09
sigmavirus24So we're going to vendor glanceclient =P23:09
* sigmavirus24 writes new spec23:09
sigmavirus24We'll hide it in glance/openstack/common/ so the packagers don't notice it =P23:10
*** IlyaE has joined #openstack-glance23:11
mgagnendonegan: is glance-replicator running in a while(True) loop or is it triggered from a workflow/pipeline in the QA process?23:11
ndoneganCurrently croned to run fairly regularly.23:12
ndoneganThe images are small enough, and the network fast enough, that for the most part token rotation is not too much of an issue.23:12
kragnizsigmavirus24: I'm warming to the idea of a glance-tools repo23:13
kragnizI doubt anyone else will, though :P23:13
ndoneganIt's only on full dumps or initial population of new glance installs that it "while true" is pulled out of the tool box.23:13
mgagnetrying to fuel ideas around image replication here. I have to deploy images for yesterday :-/23:13
ndoneganOh, another really fun one...23:14
mgagnefor now, dumping a bucket of water onto the fuel will be enough but soon I'll need a bigger bucket23:14
mgagnefire*23:14
sigmavirus24kragniz: github.com/sigmavirus24/glance-toolbelt23:15
ndoneganHaven't checked this past Havanna yet, but when a snapshot of an image is created, the kernel_id and some other properties are set to NULL in MySQL.23:15
kragniz~github.com/sigmavirus24/glance-toolbelt23:15
kragniz23:15:30 < ndonegan> Haven't checked this past Havanna yet, but when a snapshot of an image is created, the kernel_id and  some other properties are set to NULL in MySQL.23:15
ndoneganglance-replicator dumps these out as None in the json.23:15
kragnizwoops23:15
sigmavirus24ndonegan: weird23:16
ndoneganOn load, that None is populated as a string containing 'None' in Mysql.23:16
sigmavirus24oh wait, you haven't checked it after havanna23:16
ndoneganCauses ALL sorts of fun issues.23:16
sigmavirus24ndonegan: ouch23:16
ndonegansigmavirus24: Yet23:16
sigmavirus24yeah I get that23:17
sigmavirus24that's a painful bug though, regardless of series23:17
ndoneganMeh, the fix was fairly handy.23:18
*** g4rg4m3|_ has quit IRC23:18
*** jasondotstar has joined #openstack-glance23:19
kragnizndonegan: you're using HP public cloud, right?23:19
*** IlyaE has quit IRC23:19
*** belmoreira has quit IRC23:20
ndoneganNo idea, possiblly some team is. I've only been working on an internal one.23:20
kragnizah, okay23:20
*** annashen has quit IRC23:22
*** IlyaE has joined #openstack-glance23:23
*** peristeri has quit IRC23:31
*** vijendar has quit IRC23:33
*** cpallares has quit IRC23:39
openstackgerritMerged openstack/python-glanceclient: Add validation to --property-filter in v1 shell  https://review.openstack.org/13026423:40
openstackgerritMerged openstack/python-glanceclient: Disable progress bar if image is piped into client  https://review.openstack.org/14217623:41
sigmavirus24nikhil_k: reminder: API-WG meeting in 15 minutes ish23:46
*** flwang has quit IRC23:48
*** annegent_ has joined #openstack-glance23:55
*** ericpeterson has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!