Friday, 2017-10-27

*** AlexeyAbashkin has joined #openstack-glance00:10
*** catintheroof has joined #openstack-glance00:11
*** burgerk has joined #openstack-glance00:13
*** AlexeyAbashkin has quit IRC00:14
*** rcernin has joined #openstack-glance00:21
*** catintheroof has quit IRC00:32
*** burgerk has quit IRC00:36
*** catintheroof has joined #openstack-glance00:38
*** gyee has quit IRC00:40
*** reedip_ has joined #openstack-glance00:41
reedip_rosmaita : ping00:41
rosmaitareedip_: pong00:41
reedip_hi00:41
reedip_sorry, it was late, so I had to sleep00:41
rosmaitanp, what TZ are you in?00:42
reedip_UTC +5:#000:42
reedip_5:3000:42
reedip_its 6 am right now :P00:42
rosmaitabright and early00:42
rosmaitai am in UTC-400:42
*** catintheroof has quit IRC00:42
rosmaitagive me a few minutes to read back through our earlier discussion00:43
reedip_so its late for you also I guess ?00:43
*** catintheroof has joined #openstack-glance00:44
*** AlexeyAbashkin has joined #openstack-glance00:46
rosmaitayeah, the day is moving along00:50
rosmaitaok, just to answer two of your earlier questions00:50
rosmaitafirst, your question about running memcached on the baremetal machine00:50
rosmaitacheck with someone in keystone00:50
rosmaitathe keystone middleware uses a cache so that it doesn't have to contact keystone every time glance checks whether a token is valid00:51
rosmaitaso it's probably better for the cache to be local00:51
*** AlexeyAbashkin has quit IRC00:51
reedip_ok rosmaita00:51
rosmaitabut, as you saw with the config file, you can put the memcache servers anywhere00:51
reedip_yes00:51
rosmaitayou can maybe ask on the operators list for best practices00:51
rosmaitasecond00:51
rosmaitathe original problem you had where there was an ImportError00:51
rosmaitathat meant that the python memcache code wasn't installed00:52
rosmaita(not memcached itself, this is just python bindings that make it easy to work with memcached)00:52
reedip_yes, but I think I have an update... I emailed you some hours back , before I went to sleep00:52
reedip_I got your ID from launchpad00:52
reedip_:)00:52
rosmaitaah, i didn't look at my email00:52
reedip_hope thats ok ?00:52
rosmaitasure, i will go look00:52
reedip_Or I can mention it right now ?? :)00:53
rosmaitaok, just read it00:53
reedip_:000:53
rosmaitaso with v2, you can create images and upload the data, so v2 seems to be working ok with memcache enabled00:54
reedip_yes00:54
*** catintheroof has quit IRC00:55
rosmaitaso when you try to create an image in v1, do you get an image stuck in 'queued' state, or does the entire operation fail?00:55
*** catintheroof has joined #openstack-glance00:56
reedip_the entire operation fails ( CLI gives error ) , and the log shows 503 error for glance-registry , and subsequently for glance-api00:56
rosmaitaok, something to check in your glance-api.conf file00:57
reedip_hmm ... ?00:58
rosmaitaenable_v1_registry should be either missing or = true00:58
reedip_its missing00:58
rosmaitabummer00:58
rosmaitathat's ok, the default is true00:58
reedip_I mean I checked it and I it wasnt there00:58
*** zzzeek has quit IRC00:58
reedip_yeah, I checked it last night from the docs ...00:59
rosmaitawhen you see the 503 in the api log, what's in the registry log?01:00
reedip_503 error01:00
*** zzzeek has joined #openstack-glance01:00
rosmaitacan you give me an example of the CLI statement you're using to create a v1 image?01:01
reedip_glance image-create --name="CirrOS 0.3.0" --disk-format=qcow2 --container-format=bare < dump.img01:06
reedip_I set the OS_IMAGE_VERSION as 1 in the environment variables01:08
rosmaitaok01:09
rosmaitatry that command, but don't pass the image data as part of the call01:09
rosmaitathat should just create an image record in 'queued' status01:09
rosmaitaif it's not too late, give it a different name to make it easy to find01:10
reedip_same error with v101:13
reedip_2017-10-27 01:12:29.190 4067 ERROR glance.registry.client.v1.client     raise exception.ServiceUnavailable(retry=_retry(res))01:13
reedip_2017-10-27 01:12:29.190 4067 ERROR glance.registry.client.v1.client ServiceUnavailable: The request returned 503 Service Unavailable. This generally occurs on service overload or other transient outage.01:13
rosmaitado you have enable_v2_registry set in your glance-api.conf?01:15
reedip_lemme check01:16
reedip_nope01:17
reedip_This is the configuration info : http://paste.openstack.org/show/624735/01:17
rosmaitathanks01:19
*** catintheroof has quit IRC01:20
*** namnh has joined #openstack-glance01:21
*** catintheroof has joined #openstack-glance01:21
rosmaitareedip_: can you follow the glance api log while you do the image-create with v1 and make a paste for me?01:24
rosmaitathe image-create you did earlier, without data01:24
*** catintheroof has quit IRC01:24
reedip_rosmaita : http://paste.openstack.org/show/624765/01:25
rosmaitathanks01:25
reedip_rosmaita : I think this would help http://paste.openstack.org/show/624766/ This is the glance-registry.log for the same time01:27
rosmaitacool01:27
rosmaitacan you do the same thing, but this time add --os-image-api-version 2 to the call01:29
reedip_rosmaita : just realized that registry is not Looked at, with v201:33
reedip_http://paste.openstack.org/show/624767/ is the output01:33
reedip_since registry doesnt play a role in V2, api doesnt report an error and creates the image01:33
rosmaitareedip_ yes, the registry is optional with v2, but i thought it was on by default in newton01:34
rosmaitabut i guess you're not seeing the api contact the registry in the log when you make the image-create call?01:34
reedip_yep , in V2, it isnt01:35
reedip_so I think we need to check the glance-registry, because the API is working fine01:35
rosmaitawell that actually helps01:35
rosmaitait looks like keystone doesn't like the glance credentials you are passing it01:35
reedip_seems to me as well, basically whatever is sent from the Glance baremetal back to Controller01:36
reedip_in V2, the Call seems to go only once , from controller to glance server , so there is no issue01:36
reedip_is my understanding correct?01:37
rosmaitawell, with v2, the api service is contacting keystone to validate the user token, and then going ahead and creating the image and updating the database directly01:40
rosmaitawith v1, the api service is contacting keystone to validate the user token, then passing it on to the registry service who also wants to validate the token, and that's where the failure is occurring01:41
rosmaitaare both the api and the registry running on the baremetal node?01:41
reedip_yes01:42
*** rcernin has quit IRC01:43
rosmaitathis is pretty weird, and it's getting late enough here that my brain is not functioning at full capacity01:43
reedip_I can see the error in keystone logs ... it is trying to access the DEFAULT domain , which exists, but it is saying that it doesnt01:43
reedip_rosmaita : Yeah, UTC -4 , I know ... thanks a lot for your help to identify the issue though01:44
*** rcernin has joined #openstack-glance01:44
reedip_:)01:44
rosmaitai guess the best thing is to follow up with someone in the keystone channel01:44
rosmaitabut definitely let me know waht you find out01:44
reedip_rosmaita : sure, I will, thanks :)01:46
rosmaitanp, have a good day!01:47
reedip_rosmaita: thanks , have a great day01:48
*** catintheroof has joined #openstack-glance01:55
*** reedip_ has quit IRC01:55
*** catintheroof has quit IRC02:00
*** dalgaaf has quit IRC02:07
*** dalgaaf has joined #openstack-glance02:08
*** gcb has joined #openstack-glance02:16
*** catintheroof has joined #openstack-glance02:28
*** catintheroof has quit IRC02:33
*** AlexeyAbashkin has joined #openstack-glance02:47
*** AlexeyAbashkin has quit IRC02:52
openstackgerritOpenStack Proposal Bot proposed openstack/glance master: Updated from global requirements  https://review.openstack.org/51110403:01
*** AlexeyAbashkin has joined #openstack-glance03:08
*** AlexeyAbashkin has quit IRC03:12
*** nicolasbock has quit IRC03:30
*** markvoelker has quit IRC03:43
*** udesale has joined #openstack-glance03:58
*** catintheroof has joined #openstack-glance04:01
*** catintheroof has quit IRC04:05
*** pdeore has joined #openstack-glance04:08
*** bhagyashri_s has joined #openstack-glance04:15
*** bhagyashris has quit IRC04:17
*** rosmaita has quit IRC04:18
*** bhagyashri_s is now known as bhagyashris04:24
*** rmcallis has quit IRC04:27
*** bhagyashris has quit IRC04:46
*** cburgess has quit IRC04:51
*** rmcallis has joined #openstack-glance04:53
*** rmcallis has quit IRC04:58
*** gabor_antal_km has quit IRC04:59
*** rmcallis has joined #openstack-glance04:59
*** cburgess has joined #openstack-glance05:03
openstackgerritwangxiyuan proposed openstack/glance master: Scrubber refactor  https://review.openstack.org/51044905:06
*** masuberu has joined #openstack-glance05:15
*** masber has quit IRC05:18
*** masber has joined #openstack-glance05:20
*** masuberu has quit IRC05:23
*** newmember has joined #openstack-glance05:31
*** markvoelker has joined #openstack-glance05:43
*** mosulica has joined #openstack-glance06:00
*** ratailor has joined #openstack-glance06:03
*** arcolife has joined #openstack-glance06:15
*** markvoelker has quit IRC06:18
*** spectr has joined #openstack-glance06:22
*** ratailor has quit IRC06:24
*** bhagyashris has joined #openstack-glance06:26
*** ratailor has joined #openstack-glance06:37
*** ratailor has quit IRC06:56
*** ratailor has joined #openstack-glance06:57
*** markvoelker has joined #openstack-glance07:14
*** tesseract has joined #openstack-glance07:22
*** namnh has quit IRC07:34
*** ratailor has quit IRC07:41
*** e0ne has joined #openstack-glance07:45
*** markvoelker has quit IRC07:48
*** trungnv has quit IRC07:49
*** ratailor has joined #openstack-glance07:54
*** AlexeyAbashkin has joined #openstack-glance07:56
*** rcernin has quit IRC07:58
*** gcb has quit IRC08:00
*** gcb has joined #openstack-glance08:03
*** trungnv has joined #openstack-glance08:09
openstackgerritMerged openstack/glance master: Updated from global requirements  https://review.openstack.org/51110408:27
*** udesale has quit IRC08:35
*** rmcallis has quit IRC08:44
*** markvoelker has joined #openstack-glance08:45
*** arcolife has quit IRC08:45
*** rmcallis has joined #openstack-glance08:46
*** namnh has joined #openstack-glance08:51
*** udesale has joined #openstack-glance08:53
*** rmcallis has quit IRC08:53
*** pdeore has quit IRC08:59
*** markvoelker has quit IRC09:18
*** pdeore has joined #openstack-glance09:22
*** gcb has quit IRC09:37
*** links has quit IRC09:42
*** ratailor is now known as rtailor09:45
*** dpawlik has joined #openstack-glance09:52
*** danpawlik has quit IRC09:55
*** mosulica has quit IRC10:10
*** markvoelker has joined #openstack-glance10:15
*** mosulica has joined #openstack-glance10:26
*** namnh has quit IRC10:36
*** markvoelker has quit IRC10:49
*** rtailor has quit IRC10:49
*** rmcallis has joined #openstack-glance10:49
*** rmcallis has quit IRC10:54
*** trungnv has quit IRC10:57
*** rtailor has joined #openstack-glance11:02
*** robcresswell has quit IRC11:03
*** rtailor has quit IRC11:15
*** rtailor has joined #openstack-glance11:34
*** rtailor has quit IRC11:37
*** ratailor has joined #openstack-glance11:37
*** nicolasbock has joined #openstack-glance11:43
*** belmoreira has joined #openstack-glance11:45
*** markvoelker has joined #openstack-glance11:46
*** rosmaita has joined #openstack-glance11:50
*** mosulica has quit IRC11:51
*** ratailor has quit IRC11:58
*** ratailor has joined #openstack-glance11:58
*** dillaman has joined #openstack-glance12:03
*** abhishek_k has joined #openstack-glance12:08
*** abhishekk has quit IRC12:09
*** bhagyashris has quit IRC12:10
*** pdeore has quit IRC12:11
*** ratailor has quit IRC12:17
*** markvoelker has quit IRC12:20
*** markvoelker has joined #openstack-glance12:27
*** marst has joined #openstack-glance13:01
*** catintheroof has joined #openstack-glance13:04
*** udesale has quit IRC13:08
*** catintheroof has quit IRC13:34
*** catintheroof has joined #openstack-glance13:42
*** abhishek_k has quit IRC13:48
*** spectr has quit IRC13:49
*** Dinesh_Bhor has quit IRC14:04
*** d0ugal_ has joined #openstack-glance14:04
*** d0ugal has quit IRC14:05
*** spectr has joined #openstack-glance14:09
openstackgerritwangxiyuan proposed openstack/glance master: Scrubber refactor  https://review.openstack.org/51044914:14
*** McClymontS has joined #openstack-glance14:16
*** ratailor has joined #openstack-glance14:17
*** McClymontS has quit IRC14:26
*** spectr has quit IRC14:39
*** e0ne has quit IRC14:45
*** e0ne has joined #openstack-glance14:53
*** e0ne has quit IRC14:53
*** e0ne has joined #openstack-glance14:54
*** e0ne has quit IRC14:54
*** e0ne has joined #openstack-glance14:55
*** e0ne has quit IRC14:56
*** e0ne has joined #openstack-glance14:56
*** e0ne has quit IRC14:57
*** marst has quit IRC15:06
*** marst has joined #openstack-glance15:06
*** belmoreira has quit IRC15:09
*** AlexeyAbashkin has quit IRC15:13
*** newmember has quit IRC15:15
*** links has joined #openstack-glance15:19
*** McClymontS has joined #openstack-glance15:45
*** McClymontS has quit IRC15:47
*** ratailor has quit IRC16:06
*** robcresswell has joined #openstack-glance16:19
*** e0ne has joined #openstack-glance16:21
*** catintheroof has quit IRC16:23
*** catintheroof has joined #openstack-glance16:27
*** catintheroof has quit IRC16:35
*** catintheroof has joined #openstack-glance16:36
*** links has quit IRC16:38
*** catintheroof has quit IRC16:39
*** catintheroof has joined #openstack-glance16:39
*** AlexeyAbashkin has joined #openstack-glance16:53
*** AlexeyAbashkin has quit IRC16:57
*** rmcallis has joined #openstack-glance17:07
*** aarefiev is now known as aarefiev_afk17:21
*** newmember has joined #openstack-glance17:58
*** harlowja has quit IRC18:05
*** harlowja has joined #openstack-glance18:05
*** e0ne has quit IRC18:15
*** catintheroof has quit IRC19:29
*** e0ne has joined #openstack-glance19:29
*** e0ne has quit IRC19:30
*** tesseract has quit IRC19:33
*** catintheroof has joined #openstack-glance19:41
*** catintheroof has quit IRC19:45
*** rcernin has joined #openstack-glance19:57
*** McClymontS has joined #openstack-glance20:39
*** marst has quit IRC21:15
*** McClymontS has quit IRC21:27
*** rcernin has quit IRC21:28
*** newmember has quit IRC21:33

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!