Monday, 2015-03-23

*** echevemaster has joined #openstack-glance00:02
*** julim has joined #openstack-glance00:17
*** bkopilov has quit IRC00:24
*** bkopilov has joined #openstack-glance00:29
*** bkopilov has quit IRC00:48
*** julim has quit IRC00:53
*** bkopilov has joined #openstack-glance00:54
*** sdake has joined #openstack-glance01:00
*** sdake__ has quit IRC01:04
*** Longgeek has joined #openstack-glance01:08
*** vilobhmm has quit IRC01:34
*** bkopilov has quit IRC01:40
*** sdake__ has joined #openstack-glance02:18
*** sdake has quit IRC02:22
*** ccrouch has joined #openstack-glance02:25
*** takedakn has joined #openstack-glance02:44
*** haomaiwang has joined #openstack-glance02:46
*** ccrouch is now known as ccrouch-afk03:02
*** sdake has joined #openstack-glance03:09
*** sdake__ has quit IRC03:12
*** Longgeek has quit IRC03:30
*** buzztroll has quit IRC03:38
*** bkopilov has joined #openstack-glance03:46
*** cpallares has joined #openstack-glance04:00
*** vilobhmm has joined #openstack-glance04:06
*** bkopilov has quit IRC04:25
*** buzztroll has joined #openstack-glance04:27
*** bkopilov has joined #openstack-glance04:28
*** Longgeek has joined #openstack-glance04:30
*** cpallares has quit IRC04:33
*** sdake__ has joined #openstack-glance04:40
*** sdake has quit IRC04:44
*** echevemaster has quit IRC04:47
*** sdake has joined #openstack-glance04:52
*** sdake__ has quit IRC04:55
*** pcaruana has quit IRC05:07
*** sdake__ has joined #openstack-glance05:18
*** sdake has quit IRC05:22
*** sdake__ has quit IRC05:33
*** bkopilov has quit IRC05:33
*** sdake has joined #openstack-glance05:34
*** bkopilov has joined #openstack-glance05:34
*** vilobhmm has quit IRC05:50
*** bkopilov has quit IRC05:50
*** sdake has quit IRC05:51
*** ishant has joined #openstack-glance05:54
*** bkopilov has joined #openstack-glance06:03
*** ankit_ag has joined #openstack-glance06:04
*** alanf-mc has joined #openstack-glance06:10
*** alanf-mc_ has joined #openstack-glance06:13
*** nlevinki has joined #openstack-glance06:14
*** alanf-mc has quit IRC06:16
*** alanf-mc_ has quit IRC06:24
*** jamielennox is now known as jamielennox|away06:28
*** bkopilov is now known as bkopilov_wfh06:37
*** simon-AS559 has joined #openstack-glance06:41
*** simon-AS559 has quit IRC06:45
*** simon-AS559 has joined #openstack-glance06:50
*** pcaruana has joined #openstack-glance06:58
*** sgotliv_ has quit IRC07:01
*** gberginc has joined #openstack-glance07:26
*** bkopilov_wfh has quit IRC07:37
*** bkopilov_wfh has joined #openstack-glance07:44
*** bkopilov has joined #openstack-glance07:51
*** bkopilov_wfh has quit IRC07:52
*** ParsectiX has joined #openstack-glance07:53
*** chlong has quit IRC07:58
*** mfedosin_ has joined #openstack-glance08:00
*** markus_z has joined #openstack-glance08:14
*** bkopilov has quit IRC08:19
*** sgotliv has joined #openstack-glance08:21
*** junhongl has quit IRC08:25
*** buzztroll has quit IRC08:43
*** tshefi has joined #openstack-glance08:48
*** sgotliv has quit IRC08:53
*** sgotliv has joined #openstack-glance08:54
*** tshefi has quit IRC09:01
*** jistr has joined #openstack-glance09:02
*** tshefi has joined #openstack-glance09:03
*** mfedosin_ has quit IRC09:11
*** simon-AS5591 has joined #openstack-glance09:31
*** simon-AS559 has quit IRC09:34
*** sgotliv has quit IRC09:39
*** sgotliv has joined #openstack-glance09:52
*** krykowski has joined #openstack-glance10:00
*** freerunner has quit IRC10:14
*** freerunner has joined #openstack-glance10:14
*** simon-AS5591 has quit IRC10:15
*** takedakn has quit IRC10:25
*** GB21 has joined #openstack-glance10:28
*** ashishjain has joined #openstack-glance10:30
*** junhongl has joined #openstack-glance10:31
*** junhongl has quit IRC10:35
*** simon-AS559 has joined #openstack-glance10:35
*** simon-AS5591 has joined #openstack-glance10:37
*** haomaiwang has quit IRC10:38
*** ank2090 has joined #openstack-glance10:39
ank2090hello all :)10:39
*** simon-AS559 has quit IRC10:40
*** GB21 has quit IRC10:40
*** GB21 has joined #openstack-glance10:41
ank2090when i am running this command >> "glance image-create --name new-volume2  --disk-format qcow2 --container-format bare --file /dev/cinder-volumes/volume-42e15b98-4d04-4050-96ac-fd6d550e068b"...it is creating image from volume and its active...but the file size is same as volume...how can i convert to original image size??10:43
*** bkopilov has joined #openstack-glance10:44
*** kaisers has joined #openstack-glance10:49
*** kaisers has left #openstack-glance10:49
*** krykowski has quit IRC10:51
*** krykowski_ has joined #openstack-glance10:51
*** junhongl has joined #openstack-glance10:51
*** junhongl has quit IRC10:56
*** mclaren has quit IRC10:58
openstackgerritInessa Vasilevskaya proposed openstack/glance: Glance Artifact's API documentation  https://review.openstack.org/16428311:00
*** ivasilevskaya has quit IRC11:07
*** ivasilevskaya has joined #openstack-glance11:09
ashishjainh11:12
openstackgerritAshish proposed openstack/glance: Update documentation for glance-manage  https://review.openstack.org/16659711:12
ank2090anyone have any idea?11:14
*** zul has joined #openstack-glance11:32
*** bkopilov has quit IRC11:34
*** bkopilov has joined #openstack-glance11:34
*** Longgeek has quit IRC11:46
*** GB21 has quit IRC11:56
*** krykowski_ has quit IRC12:00
*** krykowski has joined #openstack-glance12:01
*** stpierre has joined #openstack-glance12:07
*** gberginc has quit IRC12:16
openstackgerritAndreas Jaeger proposed openstack/glance: Fix requirements to unbreak pbr  https://review.openstack.org/16679612:17
*** bkopilov has quit IRC12:19
*** mjturek1 has joined #openstack-glance12:20
*** ishant has quit IRC12:27
*** gberginc has joined #openstack-glance12:30
*** bkopilov has joined #openstack-glance12:45
*** ayoung has joined #openstack-glance12:51
*** AJaeger has joined #openstack-glance12:56
*** gberginc has quit IRC13:06
*** mjturek1 has quit IRC13:11
*** leakypipes has quit IRC13:13
*** annegentle has joined #openstack-glance13:14
*** peristeri has joined #openstack-glance13:23
*** ParsectiX has quit IRC13:27
*** ParsectiX has joined #openstack-glance13:30
*** bkopilov has quit IRC13:32
*** cdelatte has quit IRC13:32
*** delattec has quit IRC13:32
zigo_When trying to build Glance, I get:13:33
zigo_# python setup.py build13:33
zigo_error in setup command: 'install_requires' must be a string or list of strings containing valid project/version requirement specifiers13:33
zigo_What's going on?!?13:33
*** bkopilov has joined #openstack-glance13:33
*** mjturek1 has joined #openstack-glance13:33
kragnizzigo_: see https://review.openstack.org/#/c/166796/13:35
zigo_kragniz: It's down, but thanks !13:35
kragnizgerrit's down?13:36
kragnizit seems happy to me!13:37
openstackgerritMartin Kletzander proposed openstack/glance: Fix common misspellings  https://review.openstack.org/16682413:37
*** bkopilov has quit IRC13:39
zigo_kragniz: What's the meaning of ~= btw?13:41
zigo_I fixed that already as a debian/patches thing already, but it's not enough.13:41
*** bkopilov has joined #openstack-glance13:42
AJaegerzigo_, https://review.openstack.org/#/c/166796/13:50
AJaegerzigo_, but let me update that patch first...13:50
zigo_AJaeger: Thanks, now it builds with that patch.13:51
zigo_AJaeger: Add me to the review (ie: Thomas Goirand), and I'll +1 ...13:51
openstackgerritAndreas Jaeger proposed openstack/glance: Fix requirements to unbreak pbr  https://review.openstack.org/16679613:52
AJaegerzigo_, down13:53
zigo_AJaeger: We don't need this kinds of upper caps13:53
zigo_Like this, I'm doing -113:54
AJaegerGlance Cores, could you approve  https://review.openstack.org/166796 to unblock glance jobs, please? flaper87 ping13:54
AJaegerzigo_, you missed the policy discussion on openstack-dev about this, we do use caps everywhere in OpenStack now13:54
zigo_1/ You should fix that issue, and that issue only13:54
zigo_2/ You shouldn't put an upper bound unless this fixes something13:54
zigo_Yes, I may have missed it then.13:55
AJaegerzigo_, wrong forum here - read the archives please13:55
zigo_From a distribution perspective that's wrong though.13:55
*** thangp has joined #openstack-glance13:56
openstackgerritAndreas Jaeger proposed openstack/glance: Fix requirements to unbreak pbr  https://review.openstack.org/16679613:57
*** sdake has joined #openstack-glance13:57
zigo_AJaeger: Also, it's normally too late to "fix" requirements.txt this way after b3 is released. It should be just set as it was the day b3 was released.13:58
AJaegerzigo_, this is the sync with what should have been in the package...13:58
*** ericpeterson has joined #openstack-glance13:59
*** sdake__ has joined #openstack-glance13:59
AJaegerzigo_, I meant: Should have been in b3 but was not in there due to the usage of ~= ;(14:00
*** sdake has quit IRC14:01
*** bkopilov has quit IRC14:04
*** ankit_ag has quit IRC14:05
AJaegernikhil_k, thanks for the review!14:05
nikhil_kthanks too, AJaeger !14:06
*** julim has joined #openstack-glance14:07
*** zz_jgrimm- is now known as jgrimm14:12
*** sigmavirus24_awa is now known as sigmavirus2414:16
*** sdake has joined #openstack-glance14:16
*** ccrouch-afk is now known as ccrouch14:17
AJaegernikhil_k, do you know why this fails: https://jenkins01.openstack.org/job/gate-glance-python27/4858/consoleFull - that's from 16679614:17
ashishjainhello14:18
*** ericpeterson has quit IRC14:19
ashishjainAjaeger: It failed for me too and I just submitted a doc patch14:19
*** sdake__ has quit IRC14:20
AJaegerashishjain, which one?14:20
*** ericpeterson has joined #openstack-glance14:20
ashishjainhttps://review.openstack.org/16659714:20
AJaegerashishjain, I misparsed you ;(14:20
ashishjainAJaeger, I didn't get you14:21
ashishjainwhat is misparsed?14:21
AJaegerashishjain, I was confused and now everything is fine.14:21
ashishjainokay14:21
*** ericpeterson has quit IRC14:22
ashishjainI am all set to submit my first code fix14:22
*** bkopilov has joined #openstack-glance14:22
AJaegerashishjain, great, welcome!14:22
ashishjainjust wanted to know if I need to run some sort of build locally14:22
ashishjainto make sure if there is any issue with the code change14:23
ashishjainI made and may impact anything else14:23
AJaegerashishjain, running tox locally is always good14:23
ashishjainHow shall I go about this14:23
AJaegerashishjain, we're in feature freeze now, so better discuss whether your code will land...14:23
AJaegerashishjain, I'm not a glance expert, hope others can chime in.14:23
*** smc7 has joined #openstack-glance14:24
ashishjainits okay whether the code lands or not14:24
ashishjainI am just keen to maintain a constant supply of patches :)14:25
AJaeger;)14:26
*** vijendar has joined #openstack-glance14:26
ashishjainjust started having fun with git,python and open stack ( all new for me) ....so don't want to stop that fun for any reason14:26
ashishjainbtw came to know from vkmc that I can use tox command14:27
ashishjainI think this is what has to be read https://wiki.openstack.org/wiki/Testr14:27
AJaegerashishjain, I hope you read http://docs.openstack.org/infra/manual/developers.html before that14:28
*** annegentle has quit IRC14:29
krykowski<ashishjain>: yup, tox is the answer. Just remember to run tox -e pep8 additionally to check if there are no pep8 issues14:29
ashishjainAJaeger, thanks read that couple of times :)14:30
ashishjainkrykowski: thanks a lot for this and for your review too. I read the link which you have shared and have resubmitted another patch today. All set to submit now a code change.14:31
ashishjainhttps://review.openstack.org/16659714:32
krykowski<ashishjain>: sure, no problem. Will definitely look at yours changes when got some free time :)14:33
ashishjainsure thanks :)14:33
*** annegentle has joined #openstack-glance14:34
*** sdake__ has joined #openstack-glance14:34
*** annegentle has quit IRC14:34
*** sdake has quit IRC14:37
*** cpallares has joined #openstack-glance14:38
ashishjainHello14:43
nikhil_khi14:44
ashishjainthere is one run_test.sh in glance root directory14:44
ashishjainwhat is that for?14:44
sigmavirus24ashishjain: to run the tests on Python 2.714:44
nikhil_krunning tests, it's similar command to tox14:44
ashishjainso if I make a code change I can use that to test if my code changes break anything?14:45
sigmavirus24ashishjain: ye14:45
sigmavirus24*yes14:45
nikhil_ksigmavirus24: g'morning!14:45
ashishjainsigmavirus24, thanks nikhil_k, thanks14:45
sigmavirus24good morning nikhil_k !14:45
nikhil_k:)14:46
*** junhongl has joined #openstack-glance14:46
nikhil_ksigmavirus24: fyi, https://review.openstack.org/16679614:46
sigmavirus24you're welcome ashishjain14:46
nikhil_kashishjain: you're welcome, thanks for contributing to Glance!14:46
sigmavirus24nikhil_k: yeah I was going to -1 the Workflow on that but it's not worth the fight14:46
nikhil_k:)14:46
sigmavirus24~= is the correct operator but people insist on using ancient versions of setuptools so let them14:46
ashishjainsigmavirus24,  thanks14:47
ashishjainnikhil_k, thanks14:47
ashishjainbtw once you start the script it prompts to create a virtual environment, its okay to let it create a virt environment14:47
sigmavirus24ashishjain: I think I might prevent your doc patch from being accepted only because we're currently under a string freeze and no one has clarified if that includes the docs in doc/source/*14:47
sigmavirus24ashishjain: it's preferable to create a virtual environment14:47
sigmavirus24ashishjain: otherwise it will try to install them globally on your machine and you likely don't want taht14:48
sigmavirus24*that14:48
kragnizsigmavirus24: I don't think it does, since the docs are not translated14:48
sigmavirus24kragniz: I didn't think so either, but I know some of the command-line docs are lifted from our documentation into the more formal openstack docs14:48
sigmavirus24There's currently a discussion to drop keystone's cli docs since it's been deprecated in favor of openstackcli14:48
ashishjainsigmavirus24: thanks for this information on running the tests.14:49
kragnizokay, interesting14:49
sigmavirus24Since the formal docs are translated and they seem to use the project's documentation as a basis, I would think these docs would be affected14:49
sigmavirus24I still have to check with Anne though14:49
sigmavirus24ashishjain: you're welcome14:49
*** r-daneel has joined #openstack-glance14:49
nikhil_kkragniz: sigmavirus24 ashishjain : I'm not sure if they translate the docs for glancemanage (however they do for installations). Please create a ML thread with appropriate tags for Glance, Doc, all etc14:49
*** junhongl has quit IRC14:50
*** annegentle has joined #openstack-glance14:51
ashishjainkilo is going to be released on 30th april14:51
ashishjainIs this all freeze for kilo?14:51
nikhil_kashishjain: https://wiki.openstack.org/wiki/Kilo_Release_Schedule14:52
ashishjainya it says 30th apr14:52
ashishjainnikhil_k, do you want me to send a mail to openstack-dev?14:53
ashishjainohh ya the feature freeze is listed there14:53
nikhil_kashishjain: yes please14:56
sigmavirus24ashishjain: you can /send/ patches, we just won't be able to accept them right away14:57
*** junhongl has joined #openstack-glance14:59
ashishjainnikhil_k: somehow I am trying to understand what has to be the content of the mail.15:00
ashishjainsigmavirus24: it is okay to not merge the patches with the kilo release, I was looking more from correctness of the submitted patch. I hope that should not be a problem.15:01
sigmavirus24ashishjain: not at all15:02
sigmavirus24Just wanted to help set your expectations appropriately15:02
nikhil_kashishjain: 1. Reference your patch, 2. add a small section for what's in the patch (what file changes, what are the general changes), 3. ask question if that would be okay to be merged in the string freeze, 4. ensure you're all the right tags so that it does not get filtered (in inboxes you need reply from)15:02
ashishjainnikhil_k: sure I will do it.15:03
ashishjainsigmavirus24: thanks for this15:03
*** junhongl has quit IRC15:04
*** ParsectiX has quit IRC15:04
AJaegersigmavirus24, we would need to update the CI infrastructure for supporting ~=  - and that will take a bit longer ;(15:14
AJaegersigmavirus24, docs in doc/source/ are excluded from string freeze, they are not translated at all15:15
sigmavirus24AJaeger: this seems to be  a perpetual infra problem in that half of the nodes receive updates15:15
sigmavirus24I found a couple nodes a week or two ago that had the puppet agent disabled on them and were using old project-config copies15:15
AJaegersigmavirus24, yeah, that was fixed ;(15:16
sigmavirus24yeah I know15:16
sigmavirus24still was annoying since there were transient failures that multiple projects ran into due to that15:16
AJaegersigmavirus24, and the other information we import verbatim into the manuals is help strings and help output from cli commands - so doc/* is not part of string freeze15:17
AJaegernikhil_k, sigmavirus24 do you know why the python27 tests fail currently on head?15:17
sigmavirus24AJaeger: haven't looked at it15:18
sigmavirus24link to a failing job?15:18
AJaegerhttps://review.openstack.org/#/c/166597/ -> http://logs.openstack.org/97/166597/2/check/gate-glance-python27/67163cb/console.html15:18
AJaegerand http://logs.openstack.org/96/166796/3/check/gate-glance-python27/73697fc/console.html15:18
sigmavirus24http://logs.openstack.org/97/166597/2/check/gate-glance-python27/67163cb/testr_results.html.gz seems to indicate that metadefs' model(s) and its migrations aren't correct15:21
sigmavirus24nikhil_k: did we merge those metadefs changes last week that dealt with upgrading/migrating metadefs?15:21
mfedosinfolks, migrations are broken with new alembic15:24
mfedosin0.7.515:24
AJaegersigmavirus24, https://review.openstack.org/#/c/119824/ ?15:25
sigmavirus24mfedosin: oh that's awesome15:25
mfedosinexactly because of this http://alembic.readthedocs.org/en/latest/changelog.html#change-40b43f94dca3aeee601dd90579335cb615:25
sigmavirus24AJaeger: that's one of the ones I was thinking of15:25
mfedosinthey fixed the bug and we have a workaround that is not compatible with 0.7.515:26
AJaegersigmavirus24, that merged but mfedosin might be undo something, the log shows we use " alembic==0.7.5.post2 "15:26
AJaegers/undo/on to/15:27
mfedosineverything is alright when we use 0.7.415:27
mfedosinlet me show you what exactly happens15:27
sigmavirus24don't you love it when dependencies break us in patch releases like that?15:27
mfedosinhttps://github.com/openstack/glance/blob/master/glance/db/sqlalchemy/migrate_repo/versions/039_add_changes_to_satisfy_models_metadef.py#L7815:28
*** GB21 has joined #openstack-glance15:29
sigmavirus24AJaeger: so it was a combination of both it seems =P15:30
AJaegersigmavirus24, thanks15:30
nikhil_ksigmavirus24: AJaeger : I think the bug related to the breaking migrations was filed by ashishjain last week15:30
nikhil_khttps://bugs.launchpad.net/glance/+bug/143476115:31
openstackLaunchpad bug 1434761 in Glance "glance-manage db load_metadefs does not load all resource_type_associations" [Undecided,In progress] - Assigned to Wayne (wayne-okuma)15:31
nikhil_k(that's different though)15:31
nikhil_khttps://bugs.launchpad.net/glance/+bug/143423715:31
openstackLaunchpad bug 1434237 in Glance "glance-manage db_export_metadefs fails with NoSuchColumnError" [High,Triaged] - Assigned to Ashish (ashish-jain14)15:31
nikhil_kthat one15:31
sigmavirus24ashishjain: is this the bug you were working on today?15:32
mfedosinthe easiest way to fix all problems is to add additionally 'alembic<=0.7.4' to requirements15:35
mfedosinand then to find out how to rewrite the migrations :)15:37
sigmavirus24mfedosin: migrations aren't changed once commited. new migrations are added is all15:37
mfedosinI'm going to ping Oleksii, he is the author of it15:39
openstackgerritDolph Mathews proposed openstack/glance: Manually update requirements from openstack/requirements  https://review.openstack.org/16689415:41
*** jaypipes has joined #openstack-glance15:42
openstackgerritDolph Mathews proposed openstack/glance: Manually update oslo.policy requirement  https://review.openstack.org/16689715:43
ashishjainsigmavirus24:yes15:44
ashishjainthat is the one which I was working on today15:45
ashishjainthe fix is just one word change probably :)15:45
ashishjainran the tests looks like nothing broke15:45
ashishjainare all the results in run_tests.log15:46
ashishjainis there any other log too15:46
sigmavirus24ashishjain: they should all be there15:47
ashishjainokay15:47
ashishjainshall I propose the change for https://bugs.launchpad.net/glance/+bug/143476115:48
openstackLaunchpad bug 1434761 in Glance "glance-manage db load_metadefs does not load all resource_type_associations" [Undecided,In progress] - Assigned to Wayne (wayne-okuma)15:48
ashishjainsorry not this one15:48
ashishjainhttps://bugs.launchpad.net/glance/+bug/143423715:48
openstackLaunchpad bug 1434237 in Glance "glance-manage db_export_metadefs fails with NoSuchColumnError" [High,Triaged] - Assigned to Ashish (ashish-jain14)15:48
*** bkopilov has quit IRC15:51
mfedosin040 will be the dumbest migration ever :D15:51
sigmavirus24ashishjain: it's a separate migration, right?15:51
ashishjainseparate migration?15:52
* sigmavirus24 guessed you were fixing the problem with the migration15:55
sigmavirus24Just submit it and we'll see how it works15:56
ashishjainyes exporting the metadefs16:00
ashishjainI thought loading the metadefs was migration16:01
ashishjainI am working on exporting the metadefs16:01
ashishjainI will submit it16:01
ashishjainthanks16:01
*** nlevinki has quit IRC16:02
mfedosinDo you know about this spec? https://review.openstack.org/#/c/152337/16:06
mfedosinIt says that we have to remove all downgrades from all migrations16:07
*** nlevinki has joined #openstack-glance16:10
*** TravT has quit IRC16:13
*** buzztroll has joined #openstack-glance16:15
openstackgerritAshish proposed openstack/glance: Fixes glance-manage exporting meta definitions issue  https://review.openstack.org/16690916:19
*** TravT has joined #openstack-glance16:23
*** GeetikaBatra_ has joined #openstack-glance16:23
*** GeetikaBatra__ has joined #openstack-glance16:27
*** GB21 has quit IRC16:27
*** GeetikaBatra_ has quit IRC16:29
ashishjainkrykowski: Thanks for the review16:29
ashishjainkrykowski: shall I submit a new patch for that typo16:29
ashishjainkrykowski: The patch shall have all the changes including the metadefs right?16:30
krykowskiThat would be great, but as I mentioned - it's out of the scope so you free to ignore it16:30
ashishjainor just the typo16:30
krykowskinaah, I wanted you to fix that typo in your current patch. as a extra gift for the community :)16:31
sigmavirus24mfedosin: your summary isn't correct16:31
ashishjainhaha :)16:31
ashishjainkrykowski: sure16:31
sigmavirus24mfedosin: it says we need to remove the abilities from tooling to use downgrades but not to remove them from existing migrations16:32
sigmavirus24mfedosin: further to not add them to new migrations16:32
mfedosinsigmavirus24, this is a great relief!16:33
mfedosinI just gave words of Oleksii16:33
*** GeetikaBatra__ is now known as GB2116:34
*** junhongl has joined #openstack-glance16:34
*** peristeri has quit IRC16:35
sigmavirus24yeah16:35
sigmavirus24you had me worried for a second there mfedosin16:35
sigmavirus24=P16:35
mfedosinI was surprised too when I hear that :P16:37
*** junhongl has quit IRC16:38
openstackgerritAshish proposed openstack/glance: Update documentation for glance-manage  https://review.openstack.org/16659716:40
openstackgerritStuart McLaren proposed openstack/glance: Zero downtime config reload (socket handling)  https://review.openstack.org/12348216:42
*** junhongl has joined #openstack-glance16:46
*** nlevinki has quit IRC16:52
*** junhongl has quit IRC16:53
openstackgerritStuart McLaren proposed openstack/glance: Zero downtime config reload (log handling)  https://review.openstack.org/12993616:57
openstackgerritStuart McLaren proposed openstack/glance: Zero downtime config reload (glance-control)  https://review.openstack.org/13022216:58
*** vilobhmm has joined #openstack-glance16:58
*** vilobhmm has quit IRC16:58
*** vilobhmm has joined #openstack-glance16:58
*** annegentle has quit IRC16:59
*** vilobhmm1 has joined #openstack-glance16:59
*** GB21 has quit IRC17:00
*** sgotliv has quit IRC17:02
*** GB21 has joined #openstack-glance17:02
*** vilobhmm has quit IRC17:03
*** alanf-mc has joined #openstack-glance17:07
*** ashishjain has quit IRC17:09
*** annashen has joined #openstack-glance17:09
*** annegentle has joined #openstack-glance17:10
*** pdb has quit IRC17:13
*** pdb has joined #openstack-glance17:14
*** max_lobur has joined #openstack-glance17:15
max_loburHi All. Did anybody ever had problems uploading large images/snapshots in glance?17:19
max_loburwe're using glance + swift backend17:20
max_lobursnapshots are up to 50 gb17:20
max_loburthe problem is that the whole image is transferred from nova via single post request17:20
max_loburand there's no connection drop handle17:21
max_loburwondering if glance have blueprints or even patches to enhance that. Or there's another way to make it work (upload directly to backend?)17:21
sigmavirus24max_lobur: there's been talk of providing a way to have other services upload directly to the backend but no one has acted upon it17:23
sigmavirus24also this sounds like news to me17:23
max_loburusually when network is reliable ehough you can upload flawlessly. But if connection drops, there's no retries and nothing like chunks. Image passed as a solid piece, binary stream. So all you can do is to re-do snapshot, e.g. upload from the beginning17:26
max_lobur@sigmavirus24 do you have a ref to that talk?17:26
max_loburor remember the name17:26
sigmavirus24no but there was also a spec to retry uploads to swift on network problems that kragniz was working on but didn't make it into Kilo17:27
mfedosinyeah! I fixed migrations17:27
sigmavirus24I can find that for you quickly17:27
*** harlowja has joined #openstack-glance17:27
sigmavirus24max_lobur: https://review.openstack.org/#/c/146437/17:28
sigmavirus24mfedosin: git-review or it didn't happen. =P17:28
mfedosingive me a minute to write a CM17:29
max_lobur@sigmavirus2417:29
* sigmavirus24 starts stop watch17:29
sigmavirus24@max_lobur17:29
max_loburswift is fine as we see17:29
max_loburwe need retries/chunks between glanceclient -> glance-api17:29
sigmavirus24So you see an exception in Nova's logs or does it just hang?17:30
max_loburbecause if that streams breaks in the middle the only way is to restart from scratch17:30
max_loburthere's a trace in nova, something like "connection reset"17:31
sigmavirus24more details than that would be greatly appreciated17:31
* stevelle imagines another solution entirely from what max_lobur is suggesting17:32
max_loburlemme get it17:32
*** spzala has joined #openstack-glance17:33
*** junhongl has joined #openstack-glance17:33
openstackgerritMike Fedosin proposed openstack/glance: Fix metadef tags migrations  https://review.openstack.org/16694117:35
sigmavirus24max_lobur: reminder, please use paste.openstack.org17:36
max_loburhehe, okay17:37
*** annegentle has quit IRC17:37
*** junhongl has quit IRC17:37
*** cdelatte has joined #openstack-glance17:39
*** delattec has joined #openstack-glance17:39
*** jdurgin has joined #openstack-glance17:41
sabarimax_lobur: I understand what you are talking about. It would be great if we could support resumable upload to glance-api.17:49
sabariI see that we had some bp's in the past to supported partial downloads.17:50
sabariIt will be great it someone could point to any discussion around resuming uploads, if any.17:50
nikhil_ksabari: look for that in v2 api17:53
sigmavirus24sabari: that's significantly harder to do17:53
nikhil_kand when we port Nova to use v2, we _may_ be able to support17:53
*** jistr has quit IRC17:54
*** bkopilov has joined #openstack-glance17:55
sabarinikhil_k: yeah I got that we implemented partial downloads in v2.17:55
sabarijust looked up17:55
nikhil_kcool17:55
sabarisigmavirus24: I understand that, I was looking at dropbox api for resumable upload. Seems a bit tricky!17:56
sigmavirus24sabari: uh partial downloads in v2 don't exactly work correctly anyway17:57
sigmavirus24there's still work necessary in the glance_store for that iirc17:57
*** simon-AS5591 has quit IRC17:57
sabarisigmavirus24: I tried it and it doens't work. I saw the bug is assigned to you :P17:57
sigmavirus24sabari: yeah that's a lie17:57
sigmavirus24I tried working on it and was told I was doing it at the wrong level by zhiyan who already had patches in progress so that should be reassigned =P17:58
sabarisigmavirus24: Looks like we don't support the right semantics as defined in rfc723317:58
sabari^ hope I got the rfc right.17:58
sigmavirus24for uploads or downloads?17:59
max_loburI was thinking about similar transfer like between glance swift now. 1. glance client splits image to chunks. 2. Every chunk is passed via separate POST, with retries. 3. Chunks assembled on glance. 4. Passed to backend.17:59
sabarisigmavirus24: for downloads17:59
*** bkopilov has quit IRC17:59
sigmavirus24right that was the bug I created and assigned to myself17:59
sabarisigmavirus24: Range in header should be supported. But we look for 'Content-Range'17:59
max_loburthis doubles upload time of course17:59
*** bkopilov has joined #openstack-glance17:59
sigmavirus24max_lobur: so you said something that alarmed me18:00
sigmavirus24(earlier)18:00
sigmavirus24does nova really say "here's all the data as a blob now upload it"?18:00
max_loburadvanced implementation might start streaming to backend once the first chunk received18:00
sigmavirus24Or does it give it a file-like object to upload?18:00
sigmavirus24max_lobur: except that the chunks could be received out of order18:00
max_loburnova creates a temp file with image18:00
max_loburand then does18:00
sabariafk..ah, the stand up time at work.18:00
max_loburglance image-update --file18:01
max_lobur- starts streaming the file to glance18:01
sigmavirus24which means that some will have to be stored for some time until the correct chunk is uploaded18:01
max_loburyeah18:01
max_loburbut I assume we won't transfer chunks concurrently18:02
max_loburtherefore until 1st chunk is not POSTed with 200, 2nd is not sent18:02
stevelleThere is a CR up to use Range sabari if you haven't seen it18:03
*** AJaeger_ has joined #openstack-glance18:03
stevellemax_lobur: you're just relying on glance-client, correct?18:05
sigmavirus24stevelle: nova is18:07
*** krykowski has quit IRC18:07
max_lobur@stevelle: chunked transfer between glanceclient and glance-api will require changes in both18:08
max_loburnova relies on glanceclient, right18:08
stevelleI'm wondering if maybe that is putting an implementation detail in front of the problem spec18:08
openstackgerritMike Fedosin proposed openstack/glance: Fix metadef tags migrations  https://review.openstack.org/16694118:09
max_loburit is an implementation of course :)18:09
max_loburthe problem is simple18:09
max_loburyou can't reliably upload 50 gb image18:09
max_loburbecause u can't be sure the connection will last 30 minutes or more18:10
*** bkopilov has quit IRC18:12
*** harlowja has quit IRC18:18
*** harlowja has joined #openstack-glance18:21
*** vilobhmm11 has joined #openstack-glance18:22
*** peristeri has joined #openstack-glance18:23
*** vilobhmm1 has quit IRC18:23
*** smc7 has quit IRC18:36
*** ParsectiX has joined #openstack-glance18:37
sabaristevelle: Were you referring to zhiyan's CR ? https://review.openstack.org/#/c/165024/1.18:38
sabari^ I think that's only for the http store to fetch partial content from external source.18:38
*** ParsectiX has quit IRC18:39
sabariglance-api still needs to honor 'Range' header for client requests, in order to send offset information to glance_store.18:39
*** ParsectiX has joined #openstack-glance18:40
stevellesabari: yes, it's a step in that direction18:40
*** ParsectiX has quit IRC18:40
stevellehave to add to storage drivers before you can justify adding to api18:40
*** peristeri has quit IRC18:42
*** ericpeterson has joined #openstack-glance18:46
sabariThanks stevelle. I was looking at filesystem store which already supports offsets and but didn't work because the api didn't support the right header.18:51
stevellesabari: I think seeing the implementation there may be helpful for a Glance API change as well.18:52
stevellefilesystem store is a bit more particular iirc18:53
*** peristeri has joined #openstack-glance18:57
sabariyeah, it's clear now on how the work is shaping up. thanks stevelle.19:01
*** ericpeterson has quit IRC19:03
*** raginbajin has quit IRC19:04
*** mfedosin has quit IRC19:04
*** frickler has quit IRC19:04
*** raginbajin has joined #openstack-glance19:04
*** nikhil_k has quit IRC19:04
*** frickler has joined #openstack-glance19:04
*** nikhil_k has joined #openstack-glance19:04
*** mfedosin has joined #openstack-glance19:04
*** smc7 has joined #openstack-glance19:05
*** smcginnis has joined #openstack-glance19:13
*** GB21 has quit IRC19:14
*** ericpeterson has joined #openstack-glance19:14
*** markus_z has quit IRC19:16
*** alanf-mc has quit IRC19:19
*** gberginc has joined #openstack-glance19:22
*** ericpeterson has quit IRC19:24
*** mfedosin_ has joined #openstack-glance19:26
*** alanf-mc has joined #openstack-glance19:35
*** ericpeterson has joined #openstack-glance19:35
smcginnisignore #openstack-glance MODES JOINS PARTS QUITS19:38
smcginnisoops19:38
*** annashen has quit IRC19:39
*** annashen has joined #openstack-glance19:42
*** sdake has joined #openstack-glance19:46
*** vilobhmm11 has left #openstack-glance19:46
*** sdake__ has quit IRC19:49
*** sgotliv has joined #openstack-glance19:49
sigmavirus24smcginnis: I see how it is19:51
* sigmavirus24 gets teary eyed19:51
*** smc7 has quit IRC19:52
*** AJaeger_ has quit IRC19:53
smcginnissigmavirus24: :)19:56
sigmavirus24No it's okay. Ignore us. We'll survive.19:57
smcginnissigmavirus24: I only ignore you if you leave. :D19:57
*** simon-AS559 has joined #openstack-glance19:57
* sigmavirus24 knows.19:57
* sigmavirus24 is only kidding19:57
smcginnissigmavirus24: I know. You gotta give someone a hard time when they type client commands wrong. ;)19:57
*** alanf-mc has quit IRC20:00
*** simon-AS5591 has joined #openstack-glance20:00
*** simon-AS559 has quit IRC20:02
*** alanf-mc has joined #openstack-glance20:03
*** jgrimm is now known as zz_jgrimm20:05
*** annegentle has joined #openstack-glance20:11
*** flwang1 has joined #openstack-glance20:17
*** annashen has quit IRC20:18
*** annashen has joined #openstack-glance20:18
*** TravT has quit IRC20:19
*** smc7 has joined #openstack-glance20:20
*** alanf-mc has quit IRC20:20
*** TravT has joined #openstack-glance20:25
*** bkopilov has joined #openstack-glance20:31
*** alanf-mc has joined #openstack-glance20:36
*** peristeri has quit IRC20:44
*** stpierre has quit IRC20:46
*** jaypipes has quit IRC20:47
*** stpierre has joined #openstack-glance20:48
*** stpierre has quit IRC20:48
*** stpierre has joined #openstack-glance20:48
*** jaypipes has joined #openstack-glance20:52
*** fesp has joined #openstack-glance20:56
*** simon-AS5591 has quit IRC20:56
*** sgotliv has quit IRC20:59
*** annegentle has quit IRC20:59
*** mfedosin_ has quit IRC21:00
*** simon-AS559 has joined #openstack-glance21:01
*** simon-AS559 has quit IRC21:01
*** jamielennox|away is now known as jamielennox21:02
*** thangp has quit IRC21:13
*** annegentle has joined #openstack-glance21:14
*** simon-AS559 has joined #openstack-glance21:16
*** simon-AS5591 has joined #openstack-glance21:17
*** smc7 has quit IRC21:20
*** simon-AS559 has quit IRC21:20
*** mfedosin_ has joined #openstack-glance21:21
*** sdake__ has joined #openstack-glance21:22
*** sdake has quit IRC21:26
*** simon-AS5591 has quit IRC21:26
*** smc7 has joined #openstack-glance21:33
*** stpierre has quit IRC21:35
*** sdake__ has quit IRC21:54
*** sdake has joined #openstack-glance21:57
*** tshefi has quit IRC21:58
max_lobur@sigmavirus24 u there?22:06
*** sigmavirus24 is now known as sigmavirus24_awa22:07
*** julim has quit IRC22:09
*** vijendar has quit IRC22:34
*** annegentle has quit IRC22:53
*** spzala has quit IRC23:17
*** ericpeterson has quit IRC23:26
*** chlong has joined #openstack-glance23:31
*** mfedosin_ has quit IRC23:39
*** cpallares has quit IRC23:40
*** smc7 has quit IRC23:41
*** annegentle has joined #openstack-glance23:41
*** smc7 has joined #openstack-glance23:43
*** smc7 has quit IRC23:44
*** flwang1 has quit IRC23:45
*** annashen has quit IRC23:46
*** annashen has joined #openstack-glance23:47

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!