*** AlexeyAbashkin has joined #openstack-glance | 00:10 | |
*** catintheroof has joined #openstack-glance | 00:11 | |
*** burgerk has joined #openstack-glance | 00:13 | |
*** AlexeyAbashkin has quit IRC | 00:14 | |
*** rcernin has joined #openstack-glance | 00:21 | |
*** catintheroof has quit IRC | 00:32 | |
*** burgerk has quit IRC | 00:36 | |
*** catintheroof has joined #openstack-glance | 00:38 | |
*** gyee has quit IRC | 00:40 | |
*** reedip_ has joined #openstack-glance | 00:41 | |
reedip_ | rosmaita : ping | 00:41 |
---|---|---|
rosmaita | reedip_: pong | 00:41 |
reedip_ | hi | 00:41 |
reedip_ | sorry, it was late, so I had to sleep | 00:41 |
rosmaita | np, what TZ are you in? | 00:42 |
reedip_ | UTC +5:#0 | 00:42 |
reedip_ | 5:30 | 00:42 |
reedip_ | its 6 am right now :P | 00:42 |
rosmaita | bright and early | 00:42 |
rosmaita | i am in UTC-4 | 00:42 |
*** catintheroof has quit IRC | 00:42 | |
rosmaita | give me a few minutes to read back through our earlier discussion | 00:43 |
reedip_ | so its late for you also I guess ? | 00:43 |
*** catintheroof has joined #openstack-glance | 00:44 | |
*** AlexeyAbashkin has joined #openstack-glance | 00:46 | |
rosmaita | yeah, the day is moving along | 00:50 |
rosmaita | ok, just to answer two of your earlier questions | 00:50 |
rosmaita | first, your question about running memcached on the baremetal machine | 00:50 |
rosmaita | check with someone in keystone | 00:50 |
rosmaita | the keystone middleware uses a cache so that it doesn't have to contact keystone every time glance checks whether a token is valid | 00:51 |
rosmaita | so it's probably better for the cache to be local | 00:51 |
*** AlexeyAbashkin has quit IRC | 00:51 | |
reedip_ | ok rosmaita | 00:51 |
rosmaita | but, as you saw with the config file, you can put the memcache servers anywhere | 00:51 |
reedip_ | yes | 00:51 |
rosmaita | you can maybe ask on the operators list for best practices | 00:51 |
rosmaita | second | 00:51 |
rosmaita | the original problem you had where there was an ImportError | 00:51 |
rosmaita | that meant that the python memcache code wasn't installed | 00:52 |
rosmaita | (not memcached itself, this is just python bindings that make it easy to work with memcached) | 00:52 |
reedip_ | yes, but I think I have an update... I emailed you some hours back , before I went to sleep | 00:52 |
reedip_ | I got your ID from launchpad | 00:52 |
reedip_ | :) | 00:52 |
rosmaita | ah, i didn't look at my email | 00:52 |
reedip_ | hope thats ok ? | 00:52 |
rosmaita | sure, i will go look | 00:52 |
reedip_ | Or I can mention it right now ?? :) | 00:53 |
rosmaita | ok, just read it | 00:53 |
reedip_ | :0 | 00:53 |
rosmaita | so with v2, you can create images and upload the data, so v2 seems to be working ok with memcache enabled | 00:54 |
reedip_ | yes | 00:54 |
*** catintheroof has quit IRC | 00:55 | |
rosmaita | so when you try to create an image in v1, do you get an image stuck in 'queued' state, or does the entire operation fail? | 00:55 |
*** catintheroof has joined #openstack-glance | 00:56 | |
reedip_ | the entire operation fails ( CLI gives error ) , and the log shows 503 error for glance-registry , and subsequently for glance-api | 00:56 |
rosmaita | ok, something to check in your glance-api.conf file | 00:57 |
reedip_ | hmm ... ? | 00:58 |
rosmaita | enable_v1_registry should be either missing or = true | 00:58 |
reedip_ | its missing | 00:58 |
rosmaita | bummer | 00:58 |
rosmaita | that's ok, the default is true | 00:58 |
reedip_ | I mean I checked it and I it wasnt there | 00:58 |
*** zzzeek has quit IRC | 00:58 | |
reedip_ | yeah, I checked it last night from the docs ... | 00:59 |
rosmaita | when you see the 503 in the api log, what's in the registry log? | 01:00 |
reedip_ | 503 error | 01:00 |
*** zzzeek has joined #openstack-glance | 01:00 | |
rosmaita | can you give me an example of the CLI statement you're using to create a v1 image? | 01:01 |
reedip_ | glance image-create --name="CirrOS 0.3.0" --disk-format=qcow2 --container-format=bare < dump.img | 01:06 |
reedip_ | I set the OS_IMAGE_VERSION as 1 in the environment variables | 01:08 |
rosmaita | ok | 01:09 |
rosmaita | try that command, but don't pass the image data as part of the call | 01:09 |
rosmaita | that should just create an image record in 'queued' status | 01:09 |
rosmaita | if it's not too late, give it a different name to make it easy to find | 01:10 |
reedip_ | same error with v1 | 01:13 |
reedip_ | 2017-10-27 01:12:29.190 4067 ERROR glance.registry.client.v1.client raise exception.ServiceUnavailable(retry=_retry(res)) | 01:13 |
reedip_ | 2017-10-27 01:12:29.190 4067 ERROR glance.registry.client.v1.client ServiceUnavailable: The request returned 503 Service Unavailable. This generally occurs on service overload or other transient outage. | 01:13 |
rosmaita | do you have enable_v2_registry set in your glance-api.conf? | 01:15 |
reedip_ | lemme check | 01:16 |
reedip_ | nope | 01:17 |
reedip_ | This is the configuration info : http://paste.openstack.org/show/624735/ | 01:17 |
rosmaita | thanks | 01:19 |
*** catintheroof has quit IRC | 01:20 | |
*** namnh has joined #openstack-glance | 01:21 | |
*** catintheroof has joined #openstack-glance | 01:21 | |
rosmaita | reedip_: can you follow the glance api log while you do the image-create with v1 and make a paste for me? | 01:24 |
rosmaita | the image-create you did earlier, without data | 01:24 |
*** catintheroof has quit IRC | 01:24 | |
reedip_ | rosmaita : http://paste.openstack.org/show/624765/ | 01:25 |
rosmaita | thanks | 01:25 |
reedip_ | rosmaita : I think this would help http://paste.openstack.org/show/624766/ This is the glance-registry.log for the same time | 01:27 |
rosmaita | cool | 01:27 |
rosmaita | can you do the same thing, but this time add --os-image-api-version 2 to the call | 01:29 |
reedip_ | rosmaita : just realized that registry is not Looked at, with v2 | 01:33 |
reedip_ | http://paste.openstack.org/show/624767/ is the output | 01:33 |
reedip_ | since registry doesnt play a role in V2, api doesnt report an error and creates the image | 01:33 |
rosmaita | reedip_ yes, the registry is optional with v2, but i thought it was on by default in newton | 01:34 |
rosmaita | but i guess you're not seeing the api contact the registry in the log when you make the image-create call? | 01:34 |
reedip_ | yep , in V2, it isnt | 01:35 |
reedip_ | so I think we need to check the glance-registry, because the API is working fine | 01:35 |
rosmaita | well that actually helps | 01:35 |
rosmaita | it looks like keystone doesn't like the glance credentials you are passing it | 01:35 |
reedip_ | seems to me as well, basically whatever is sent from the Glance baremetal back to Controller | 01:36 |
reedip_ | in V2, the Call seems to go only once , from controller to glance server , so there is no issue | 01:36 |
reedip_ | is my understanding correct? | 01:37 |
rosmaita | well, with v2, the api service is contacting keystone to validate the user token, and then going ahead and creating the image and updating the database directly | 01:40 |
rosmaita | with v1, the api service is contacting keystone to validate the user token, then passing it on to the registry service who also wants to validate the token, and that's where the failure is occurring | 01:41 |
rosmaita | are both the api and the registry running on the baremetal node? | 01:41 |
reedip_ | yes | 01:42 |
*** rcernin has quit IRC | 01:43 | |
rosmaita | this is pretty weird, and it's getting late enough here that my brain is not functioning at full capacity | 01:43 |
reedip_ | I can see the error in keystone logs ... it is trying to access the DEFAULT domain , which exists, but it is saying that it doesnt | 01:43 |
reedip_ | rosmaita : Yeah, UTC -4 , I know ... thanks a lot for your help to identify the issue though | 01:44 |
*** rcernin has joined #openstack-glance | 01:44 | |
reedip_ | :) | 01:44 |
rosmaita | i guess the best thing is to follow up with someone in the keystone channel | 01:44 |
rosmaita | but definitely let me know waht you find out | 01:44 |
reedip_ | rosmaita : sure, I will, thanks :) | 01:46 |
rosmaita | np, have a good day! | 01:47 |
reedip_ | rosmaita: thanks , have a great day | 01:48 |
*** catintheroof has joined #openstack-glance | 01:55 | |
*** reedip_ has quit IRC | 01:55 | |
*** catintheroof has quit IRC | 02:00 | |
*** dalgaaf has quit IRC | 02:07 | |
*** dalgaaf has joined #openstack-glance | 02:08 | |
*** gcb has joined #openstack-glance | 02:16 | |
*** catintheroof has joined #openstack-glance | 02:28 | |
*** catintheroof has quit IRC | 02:33 | |
*** AlexeyAbashkin has joined #openstack-glance | 02:47 | |
*** AlexeyAbashkin has quit IRC | 02:52 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/glance master: Updated from global requirements https://review.openstack.org/511104 | 03:01 |
*** AlexeyAbashkin has joined #openstack-glance | 03:08 | |
*** AlexeyAbashkin has quit IRC | 03:12 | |
*** nicolasbock has quit IRC | 03:30 | |
*** markvoelker has quit IRC | 03:43 | |
*** udesale has joined #openstack-glance | 03:58 | |
*** catintheroof has joined #openstack-glance | 04:01 | |
*** catintheroof has quit IRC | 04:05 | |
*** pdeore has joined #openstack-glance | 04:08 | |
*** bhagyashri_s has joined #openstack-glance | 04:15 | |
*** bhagyashris has quit IRC | 04:17 | |
*** rosmaita has quit IRC | 04:18 | |
*** bhagyashri_s is now known as bhagyashris | 04:24 | |
*** rmcallis has quit IRC | 04:27 | |
*** bhagyashris has quit IRC | 04:46 | |
*** cburgess has quit IRC | 04:51 | |
*** rmcallis has joined #openstack-glance | 04:53 | |
*** rmcallis has quit IRC | 04:58 | |
*** gabor_antal_km has quit IRC | 04:59 | |
*** rmcallis has joined #openstack-glance | 04:59 | |
*** cburgess has joined #openstack-glance | 05:03 | |
openstackgerrit | wangxiyuan proposed openstack/glance master: Scrubber refactor https://review.openstack.org/510449 | 05:06 |
*** masuberu has joined #openstack-glance | 05:15 | |
*** masber has quit IRC | 05:18 | |
*** masber has joined #openstack-glance | 05:20 | |
*** masuberu has quit IRC | 05:23 | |
*** newmember has joined #openstack-glance | 05:31 | |
*** markvoelker has joined #openstack-glance | 05:43 | |
*** mosulica has joined #openstack-glance | 06:00 | |
*** ratailor has joined #openstack-glance | 06:03 | |
*** arcolife has joined #openstack-glance | 06:15 | |
*** markvoelker has quit IRC | 06:18 | |
*** spectr has joined #openstack-glance | 06:22 | |
*** ratailor has quit IRC | 06:24 | |
*** bhagyashris has joined #openstack-glance | 06:26 | |
*** ratailor has joined #openstack-glance | 06:37 | |
*** ratailor has quit IRC | 06:56 | |
*** ratailor has joined #openstack-glance | 06:57 | |
*** markvoelker has joined #openstack-glance | 07:14 | |
*** tesseract has joined #openstack-glance | 07:22 | |
*** namnh has quit IRC | 07:34 | |
*** ratailor has quit IRC | 07:41 | |
*** e0ne has joined #openstack-glance | 07:45 | |
*** markvoelker has quit IRC | 07:48 | |
*** trungnv has quit IRC | 07:49 | |
*** ratailor has joined #openstack-glance | 07:54 | |
*** AlexeyAbashkin has joined #openstack-glance | 07:56 | |
*** rcernin has quit IRC | 07:58 | |
*** gcb has quit IRC | 08:00 | |
*** gcb has joined #openstack-glance | 08:03 | |
*** trungnv has joined #openstack-glance | 08:09 | |
openstackgerrit | Merged openstack/glance master: Updated from global requirements https://review.openstack.org/511104 | 08:27 |
*** udesale has quit IRC | 08:35 | |
*** rmcallis has quit IRC | 08:44 | |
*** markvoelker has joined #openstack-glance | 08:45 | |
*** arcolife has quit IRC | 08:45 | |
*** rmcallis has joined #openstack-glance | 08:46 | |
*** namnh has joined #openstack-glance | 08:51 | |
*** udesale has joined #openstack-glance | 08:53 | |
*** rmcallis has quit IRC | 08:53 | |
*** pdeore has quit IRC | 08:59 | |
*** markvoelker has quit IRC | 09:18 | |
*** pdeore has joined #openstack-glance | 09:22 | |
*** gcb has quit IRC | 09:37 | |
*** links has quit IRC | 09:42 | |
*** ratailor is now known as rtailor | 09:45 | |
*** dpawlik has joined #openstack-glance | 09:52 | |
*** danpawlik has quit IRC | 09:55 | |
*** mosulica has quit IRC | 10:10 | |
*** markvoelker has joined #openstack-glance | 10:15 | |
*** mosulica has joined #openstack-glance | 10:26 | |
*** namnh has quit IRC | 10:36 | |
*** markvoelker has quit IRC | 10:49 | |
*** rtailor has quit IRC | 10:49 | |
*** rmcallis has joined #openstack-glance | 10:49 | |
*** rmcallis has quit IRC | 10:54 | |
*** trungnv has quit IRC | 10:57 | |
*** rtailor has joined #openstack-glance | 11:02 | |
*** robcresswell has quit IRC | 11:03 | |
*** rtailor has quit IRC | 11:15 | |
*** rtailor has joined #openstack-glance | 11:34 | |
*** rtailor has quit IRC | 11:37 | |
*** ratailor has joined #openstack-glance | 11:37 | |
*** nicolasbock has joined #openstack-glance | 11:43 | |
*** belmoreira has joined #openstack-glance | 11:45 | |
*** markvoelker has joined #openstack-glance | 11:46 | |
*** rosmaita has joined #openstack-glance | 11:50 | |
*** mosulica has quit IRC | 11:51 | |
*** ratailor has quit IRC | 11:58 | |
*** ratailor has joined #openstack-glance | 11:58 | |
*** dillaman has joined #openstack-glance | 12:03 | |
*** abhishek_k has joined #openstack-glance | 12:08 | |
*** abhishekk has quit IRC | 12:09 | |
*** bhagyashris has quit IRC | 12:10 | |
*** pdeore has quit IRC | 12:11 | |
*** ratailor has quit IRC | 12:17 | |
*** markvoelker has quit IRC | 12:20 | |
*** markvoelker has joined #openstack-glance | 12:27 | |
*** marst has joined #openstack-glance | 13:01 | |
*** catintheroof has joined #openstack-glance | 13:04 | |
*** udesale has quit IRC | 13:08 | |
*** catintheroof has quit IRC | 13:34 | |
*** catintheroof has joined #openstack-glance | 13:42 | |
*** abhishek_k has quit IRC | 13:48 | |
*** spectr has quit IRC | 13:49 | |
*** Dinesh_Bhor has quit IRC | 14:04 | |
*** d0ugal_ has joined #openstack-glance | 14:04 | |
*** d0ugal has quit IRC | 14:05 | |
*** spectr has joined #openstack-glance | 14:09 | |
openstackgerrit | wangxiyuan proposed openstack/glance master: Scrubber refactor https://review.openstack.org/510449 | 14:14 |
*** McClymontS has joined #openstack-glance | 14:16 | |
*** ratailor has joined #openstack-glance | 14:17 | |
*** McClymontS has quit IRC | 14:26 | |
*** spectr has quit IRC | 14:39 | |
*** e0ne has quit IRC | 14:45 | |
*** e0ne has joined #openstack-glance | 14:53 | |
*** e0ne has quit IRC | 14:53 | |
*** e0ne has joined #openstack-glance | 14:54 | |
*** e0ne has quit IRC | 14:54 | |
*** e0ne has joined #openstack-glance | 14:55 | |
*** e0ne has quit IRC | 14:56 | |
*** e0ne has joined #openstack-glance | 14:56 | |
*** e0ne has quit IRC | 14:57 | |
*** marst has quit IRC | 15:06 | |
*** marst has joined #openstack-glance | 15:06 | |
*** belmoreira has quit IRC | 15:09 | |
*** AlexeyAbashkin has quit IRC | 15:13 | |
*** newmember has quit IRC | 15:15 | |
*** links has joined #openstack-glance | 15:19 | |
*** McClymontS has joined #openstack-glance | 15:45 | |
*** McClymontS has quit IRC | 15:47 | |
*** ratailor has quit IRC | 16:06 | |
*** robcresswell has joined #openstack-glance | 16:19 | |
*** e0ne has joined #openstack-glance | 16:21 | |
*** catintheroof has quit IRC | 16:23 | |
*** catintheroof has joined #openstack-glance | 16:27 | |
*** catintheroof has quit IRC | 16:35 | |
*** catintheroof has joined #openstack-glance | 16:36 | |
*** links has quit IRC | 16:38 | |
*** catintheroof has quit IRC | 16:39 | |
*** catintheroof has joined #openstack-glance | 16:39 | |
*** AlexeyAbashkin has joined #openstack-glance | 16:53 | |
*** AlexeyAbashkin has quit IRC | 16:57 | |
*** rmcallis has joined #openstack-glance | 17:07 | |
*** aarefiev is now known as aarefiev_afk | 17:21 | |
*** newmember has joined #openstack-glance | 17:58 | |
*** harlowja has quit IRC | 18:05 | |
*** harlowja has joined #openstack-glance | 18:05 | |
*** e0ne has quit IRC | 18:15 | |
*** catintheroof has quit IRC | 19:29 | |
*** e0ne has joined #openstack-glance | 19:29 | |
*** e0ne has quit IRC | 19:30 | |
*** tesseract has quit IRC | 19:33 | |
*** catintheroof has joined #openstack-glance | 19:41 | |
*** catintheroof has quit IRC | 19:45 | |
*** rcernin has joined #openstack-glance | 19:57 | |
*** McClymontS has joined #openstack-glance | 20:39 | |
*** marst has quit IRC | 21:15 | |
*** McClymontS has quit IRC | 21:27 | |
*** rcernin has quit IRC | 21:28 | |
*** newmember has quit IRC | 21:33 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!