Wednesday, 2018-02-07

*** r-daneel has quit IRC00:23
*** Dinesh__Bhor has joined #openstack-glance00:28
*** Dinesh__Bhor has quit IRC00:31
*** zhurong has joined #openstack-glance00:42
*** wxy has joined #openstack-glance01:08
*** dalgaaf has quit IRC01:13
*** dalgaaf has joined #openstack-glance01:15
*** links has joined #openstack-glance01:28
*** links has quit IRC01:29
*** Dinesh__Bhor has joined #openstack-glance01:38
*** Dinesh__Bhor has quit IRC01:40
*** openstackgerrit has joined #openstack-glance01:55
openstackgerritXianjin Shao proposed openstack/glance master: Description about the parmeters 'op', 'path' and 'value' when update image property or metadata  https://review.openstack.org/54150801:55
*** masber has quit IRC01:59
*** gyee has quit IRC02:01
*** links has joined #openstack-glance02:12
*** itlinux has joined #openstack-glance02:14
openstackgerritwangdequn proposed openstack/glance master: correct grammar, duplicate a found  https://review.openstack.org/54151402:19
*** Dinesh__Bhor has joined #openstack-glance02:23
*** Dinesh__Bhor has quit IRC02:23
*** Dinesh__Bhor has joined #openstack-glance02:28
*** Dinesh__Bhor has quit IRC02:29
openstackgerritwangdequn proposed openstack/glance master: correct grammar, duplicate the found  https://review.openstack.org/54151802:39
*** Supun has joined #openstack-glance02:45
*** Supun has quit IRC02:48
*** Supun has joined #openstack-glance02:48
*** gaurangt has quit IRC02:57
*** gaurangt has joined #openstack-glance03:00
*** namnh has joined #openstack-glance03:18
*** itlinux has quit IRC03:25
*** pdeore has joined #openstack-glance03:38
*** Supun has quit IRC03:42
*** bkopilov has quit IRC03:51
*** udesale has joined #openstack-glance03:56
*** openstackgerrit has quit IRC04:04
*** abhishekk has joined #openstack-glance04:06
*** mine0901 has quit IRC04:06
*** pdeore has quit IRC04:07
*** itlinux has joined #openstack-glance04:08
*** rosmaita has quit IRC04:14
*** mvk has quit IRC04:21
*** harlowja has quit IRC04:32
*** nicolasbock has quit IRC04:32
*** pgadige__ has joined #openstack-glance04:38
*** namnh has quit IRC04:42
*** aniketh has quit IRC04:46
*** pooja-jadhav is now known as neha_alhat04:49
*** ratailor has joined #openstack-glance05:03
*** pdeore has joined #openstack-glance05:04
*** itlinux has quit IRC05:06
*** bkopilov has joined #openstack-glance05:33
Shilpaabhishek: hi05:37
abhishekkShilpa, hi05:37
*** harlowja has joined #openstack-glance05:37
ShilpaKindly go through Alan's comment on https://review.openstack.org/#/c/433934/05:38
Shilpawhat i understood is during exit, expects either 0 or 1 as status05:38
Shilpa0 for success and 1 for failure05:39
Shilpaif exit with message, it considering as failure case05:39
*** zhurong has quit IRC05:39
abhishekkShilpa, I guess he is right05:42
abhishekkthis exit message triggers as failure but in actual its not a failure case05:43
abhishekkto get rid of this you need to submit a new patch05:43
abhishekkand add this bug as related-bug tag https://bugs.launchpad.net/tripleo/+bug/174769005:44
openstackLaunchpad bug 1747690 in tripleo "master promotion: Failed to call refresh: glance-manage db_sync" [Critical,Triaged]05:44
abhishekkinstead using sys.exit you should print that message and return from their05:45
Shilpaso we need to print the user friendly message and need to return 0 for sucess and 1 for failure05:46
abhishekkShilpa, no just print that messge as it is instead of sys.exit() and add return statement (without 0 or 1)05:48
abhishekkI guess that would be sufficient05:49
abhishekkand after pushing that patch, add Alen as a reviewer05:49
abhishekkShilpa, push that patch as early as possible, even it is trivial for glance it's critical for tripleO05:52
Shilpayes05:52
*** zhurong has joined #openstack-glance05:53
Shilpaone more thing05:53
Shilpawe have sys.exit for expand / migrate and contract also05:53
Shilpathere also we need to handle this05:53
abhishekkyes05:55
abhishekkbut don't make change in _validate_engine05:55
Shilpathere are some failure case, so there we should exit with 1, right05:55
abhishekkShilpa, that's not required05:56
abhishekkif you are exiting with error message then it considered as it is exited with 105:56
Shilpaok, understood05:56
Shilpaso in Success case, we need to return and print the message05:57
abhishekkbut the problem is then line pointed out by Alen it's not a failure so it should not exit with 1 or error message05:57
abhishekkcorrect05:57
Shilpagot it, will push the patch ASAP, thanks05:57
abhishekkso in expand, migrate and contract wherever you are exiting with message 'Database is up to date. No migrations needed.' you should print that message and return from their05:58
abhishekkShilpa, just do one thing, print the message and instead of return just use system.exit()06:00
Shilpawith 0?06:00
Shilparight06:00
*** openstackgerrit has joined #openstack-glance06:03
openstackgerritMerged openstack/glance master: Adds 'web-download' import method  https://review.openstack.org/53250106:03
abhishekkShilpa, sys.exit() is equivalent to sys.exit(0)06:04
*** e0ne has joined #openstack-glance06:11
*** e0ne has quit IRC06:17
*** mosulica has joined #openstack-glance06:36
*** e0ne has joined #openstack-glance06:48
*** harlowja has quit IRC06:52
*** e0ne has quit IRC06:54
openstackgerritXianjin Shao proposed openstack/glance master: show the default value of limit with the description of API when we use this API to show the information of image but the count of images is more than 25 and we don't know the default limit from API information.  https://review.openstack.org/54157706:57
*** udesale has quit IRC07:02
*** udesale has joined #openstack-glance07:05
*** udesale has quit IRC07:06
*** udesale has joined #openstack-glance07:06
*** alexchadin has joined #openstack-glance07:10
*** AlexeyAbashkin has joined #openstack-glance07:22
*** AlexeyAbashkin has quit IRC07:42
*** udesale_ has joined #openstack-glance07:48
*** rcernin has quit IRC07:48
*** udesale has quit IRC07:51
*** pliu has quit IRC07:51
*** AlexeyAbashkin has joined #openstack-glance07:54
openstackgerritShilpa Devharakar proposed openstack/glance master: Exiting with user friendly message and SystemExit()  https://review.openstack.org/54160107:59
*** pliu has joined #openstack-glance08:03
*** alexchadin has quit IRC08:04
*** alexchadin has joined #openstack-glance08:16
*** threestrands has quit IRC08:22
*** tesseract has joined #openstack-glance08:24
*** zhurong has quit IRC08:25
*** zhurong has joined #openstack-glance08:26
Shilpaabhishek: Hi08:35
ShilpaKindly review https://review.openstack.org/#/c/541601/, pused for LP bug https://bugs.launchpad.net/glance/+bug/1747690 (master promotion: Failed to call refresh: glance-manage db_syn)08:36
openstackLaunchpad bug 1747690 in Glance "master promotion: Failed to call refresh: glance-manage db_sync" [Undecided,In progress] - Assigned to Shilpa Devharakar (shilpasd)08:36
*** tshefi_ has joined #openstack-glance08:37
*** pcaruana has joined #openstack-glance08:38
*** alexchadin has quit IRC08:39
rabelhey there. could we merge https://review.openstack.org/#/c/534863/ ? it's just an indentation fix for the docs08:40
ShilpaThank you Abhishek for reviewing https://review.openstack.org/#/c/541601/08:40
*** ratailor has quit IRC08:49
*** ratailor has joined #openstack-glance08:49
*** e0ne has joined #openstack-glance09:26
*** neha_alhat is now known as pooja_jadhav09:27
*** pcaruana has quit IRC09:57
*** namnh has joined #openstack-glance09:57
*** alexchadin has joined #openstack-glance10:00
*** pcaruana has joined #openstack-glance10:13
*** krypto has joined #openstack-glance10:19
kryptohi all is there a way to see all the config values used by running glance process10:20
*** dtantsur|afk is now known as dtantsur10:26
*** gcb has quit IRC10:29
*** zhurong has quit IRC10:35
*** mosulica has quit IRC10:40
*** abhishekk has quit IRC10:41
*** udesale_ is now known as udesale10:41
*** mosulica has joined #openstack-glance10:42
pbourkekrypto: vi /etc/kolla/glance/*10:51
kryptoits not running as docker process , started as " python /usr/bin/glance-api --config-file=/etc/glance/glance-api.conf --log-file=/var/log/glance/glance-api.log" is there a way to find out the variables its using .10:55
*** aniketh has joined #openstack-glance10:58
anikethyay! I was successful in setting up devstack. I wanted to know, like do we pull and update the code every time with master while developing with devstack? Also, can I be pointed towards some beginner level bugs that I could dig into?11:01
anikethclarkb: ^11:02
rabelkrypto: wouldnt that be just to have a look into /etc/glance/glance-api.conf ? in addition you could have a look at the config reference in the docs to see the default values for parameters not explicitly mentioned11:02
*** pcaruana has quit IRC11:09
*** namnh has quit IRC11:28
*** udesale has quit IRC11:30
*** pdeore has quit IRC11:35
*** mvk has joined #openstack-glance11:36
*** nicolasbock has joined #openstack-glance11:41
*** ratailor has quit IRC11:43
kryptoThanks rabel i was looking for default values of glance,config reference documentation helped11:45
*** bkopilov has quit IRC11:55
*** edmondsw has joined #openstack-glance12:02
*** pcaruana has joined #openstack-glance12:13
*** alexchadin has quit IRC12:16
*** alexchadin has joined #openstack-glance12:16
*** alexchadin has quit IRC12:21
*** alexchadin has joined #openstack-glance12:21
*** AlexeyAbashkin has quit IRC12:25
jokke_aniketh: cool ... so yes rebasing to the master and cherrypicking you own change on top of that + glance restart would be the correct workflow to test your changes manually12:37
jokke_aniketh: I would advice not to work on the devstack's repo when you are actually doing your work, as you might need/want to blow that every now and then to get fresh devstack12:38
*** AlexeyAbashkin has joined #openstack-glance12:40
jokke_aniketh: I for example have local repo on my laptop I do the development on and I have 2-3 devstacks running in containers on headless workstation I push the changes into. Obviously how and where you run your devstacks is matter of preference, just remember that you might want to blow that up every now and then :P12:40
Shilpajokke: Hi12:41
jokke_Shilpa: \o12:41
ShilpaThank you for reviewing https://review.openstack.org/#/c/541601/12:41
jokke_np, it was pretty straight forward and made lots of sense within it's scope12:41
jokke_I'd have been way more hesitant on approving that if those calls were introduced year ago :D12:42
Shilpaok12:44
*** pgadige__ has left #openstack-glance12:49
jokke_it's one of those things that even if it's wrong, but it's established behaviour that people's workflows might be depending on12:51
jokke_but in this case it was pretty clear that no-one should be depending on those cases returning 1 so lets fix it while we still can :D12:51
*** alexchadin has quit IRC12:53
*** alexchadin has joined #openstack-glance12:54
bhagyashrisjokke_, Hi, I just want guidance regarding the Add hooks or to make task configurable (reference: https://review.openstack.org/#/c/528754/) as in configuration file we are giving the plugin module name to load that task so is it possible we can give the class name or class path of tasks.12:54
bhagyashrisjokke_, Actually I am trying to achive is like under plugins dir there are separate modules for each task so i want to define multiple task in one module and as per the user choice if he/she want to excute or load specific task with the help of configuration option then is it possible we can configure that by giving the class path etc like that12:56
*** udesale has joined #openstack-glance12:58
*** alexchadin has quit IRC12:58
jokke_bhagyashris: so it should be the name defined for it in the setup.cfg12:58
jokke_not exactly sure I do understand your question12:58
jokke_the plugin config option is list of the plugins defined in the setup.cfg12:59
jokke_unless I messed something seriously up12:59
bhagyashrisjokke_, yeah that are the list of plugins defined in setup.cfg13:02
bhagyashris: get_flow method13:03
jokke_and the get_import_plugins in glance/async/flows/plugins/__init__ takes that list and returns the flows of those ones defined in that config opt list13:04
bhagyashrisyeah13:05
jokke_did that answer your question or did I miss something?13:05
*** rosmaita has joined #openstack-glance13:06
bhagyashrisjokke_, actually what exactly my question is for example there is no_op.py module in that there is only one _Noop task so to load that task user will need to give the no_op but if in no_op.py there are 3 different task for example _Noop1, _Noop2 and _Noop3 then user want to configure only _Noop1 and _Noop2 and not _Noop3 then is it possible we can load first to task only using the configuration option13:23
bhagyashriss/to/two13:24
bhagyashrisi mean to say is it possible we can load task by giving the class name in the configuration13:29
anikethjokke_: Oh, okay! So you have Glance setup in your host system itself to do your work? and Use devstack just for functional testing?13:33
*** AlexeyAbashkin has quit IRC13:34
*** AlexeyAbashkin has joined #openstack-glance13:35
*** bkopilov has joined #openstack-glance13:35
rosmaitajokke_ do we need to do 14.0.1 and 15.0.1 releases from the stable branches? I am thinking that the changes in the glance/cmd files make this not simply a testing issue13:37
*** AlexeyAbashkin has quit IRC13:40
*** Supun has joined #openstack-glance13:41
openstackgerritMerged openstack/glance_store master: Imported Translations from Zanata  https://review.openstack.org/53816213:44
bhagyashrisrosmaita, Hi Good morning! want to discuss regarding comments given on patch https://review.openstack.org/#/c/455837/ by you and some replies given by abhishekk so i would like to see your opinion on it.13:46
rosmaitabhagyashris sure, looking now13:48
bhagyashrisrosmaita: ok thank you :)13:48
*** alexchadin has joined #openstack-glance13:54
*** alexchadin has quit IRC13:55
*** AlexeyAbashkin has joined #openstack-glance13:55
*** alexchadin has joined #openstack-glance13:56
*** alexchadin has quit IRC13:56
*** alexchadin has joined #openstack-glance13:56
*** markvoelker has joined #openstack-glance13:57
*** alexchadin has joined #openstack-glance13:57
*** alexchadin has quit IRC13:57
*** alexchadin has joined #openstack-glance13:58
*** alexchadin has quit IRC13:58
*** alexchadin has joined #openstack-glance13:59
*** alexchadin has quit IRC13:59
jokke_bhagyashris: ahh, now I got you ... so you will put the ones that needs to be separate, to separate files and configure them individually14:01
*** alexchadin has joined #openstack-glance14:02
jokke_bhagyashris: that way they stay properly decomposable and clear14:02
jokke_rosmaita: i think we should14:03
rosmaitajokke_ ok, i will get patches up14:03
rosmaitajokke_ not sure if this is relevant to bhagyashris '14:03
rosmaitas question or not, but https://review.openstack.org/#/c/527635/12/glance/opts.py@3314:03
jokke_rosmaita: btw, thanks for the web-download merge ...looks like gate is behaving as well finally :D14:03
rosmaitai'm still wondering about that14:03
rosmaitajokke_ the 'check' queue got up to around 500 yesterday14:04
*** r-daneel has joined #openstack-glance14:04
rosmaitainfra must have really speeded things up for everything to get through14:04
rosmaitai didn't expect it to have merged yet!14:04
jokke_yeah14:05
rosmaitamriedem did a really thorough review of the stable backports yesterday evening, btw14:05
jokke_I guess they finally found the reason what was slowing everything down14:05
jokke_I saw14:05
jokke_rosmaita: so answer to that question, that's unfortunately what is needed for the plogin engine to work properly ... I guess we could build up some hack that will import and create those entries dynamically, but it would be really messy to read and try to follow14:07
rosmaitayeah, and i was also wondering about how operators modify setup.cfg to tell stevedore about their custom plugins?14:08
jokke_I'm not exactly worried that a person who needs to write a taskflow specifically interacting with glance stuff in a specific format needs to add import and couple of definitions for it in 2 other files as well14:08
rosmaitawell, it means that you must patch glance, can't just drop in your files14:09
jokke_we could obviously move those plugin entries from opts.py to their own file to make that easier and cleaner14:09
*** links has quit IRC14:09
rosmaitayeah, so do you think it's possible to say 2.6 is current, but the plugin backend is experimental in Queens?14:09
rosmaitathe plugin backend doesn't have a defined api14:10
jokke_the mechanism is integrated to the import flow14:10
jokke_and that14:10
jokke_it's not part of the API per se14:10
jokke_so those are kind of interlocked and same time decoupled14:11
jokke_I'm currently working on documentation for all that plugin stuff. Also changing how those plugins are enabled in future will not change the API14:11
*** r-daneel has quit IRC14:12
rosmaitayeah, so i was thinking we can say that the end-user-facing API is locked down, but the operator-facing-plugin interface is open for a comment period14:12
jokke_I'd say even that is not really gonna change per se as even if we introduce dynamic importing for those plugins the current model will still work14:13
jokke_as said, I was looking into it and it just gets very messy very quickly when you start doing dynamic imports and is really breaking all the principles what PEP8 lays down for imports14:15
rosmaitaok, i'll put up a draft of releasenotes in a bit14:15
openstackgerritMerged openstack/glance master: Exiting with user friendly message and SystemExit()  https://review.openstack.org/54160114:15
jokke_that was quick14:15
rosmaitayeah, about the dynamic plugin imports, maybe we can grab dhellmann at the PTG and get some ideas14:16
jokke_that could be good option14:16
jokke_I'd be also more than happy to get a bug up and separate those definitions from opts.py so that there is dedicated file for the stuff possible 3rd party plugin deployer needs to touch having none of the glance internals coupled in it14:17
*** e0ne has quit IRC14:17
jokke_if you are ok with that approach/it makes you sleeping better?14:17
rosmaitathat's exactly what i'd like to shoot for14:18
jokke_rosmaita: ok, let me look into that and get it done14:19
jokke__should_ be super trivial refactoring14:19
rosmaitabefore you do that, do you have an opinion on https://review.openstack.org/#/c/455837/11 ?14:19
bhagyashrisrosmaita, jokke_, i got idea after reading the comment https://review.openstack.org/#/c/527635/12/glance/opts.py@33 so i will try experimenting on my best14:22
bhagyashrisrosmaita, jokke_, yeah waiting for the opinions on https://review.openstack.org/#/c/455837/11 :)14:23
rosmaitabhagyashris if i am reading abhishek's comments correctly, we have broken postgresql support (not in your patch, in the other one)?14:25
bhagyashrisrosmaita, yeah14:26
bhagyashrisrosmaita, that is also one important point that my patch https://review.openstack.org/#/c/455837/11 is not breaking14:27
jokke_rosmaita: I haven't revied the implementation yet ... will look through it today14:31
*** r-daneel has joined #openstack-glance14:31
rosmaitabhagyashris i'd like you to update the release note14:33
rosmaitasince your feature isn't necessarily tied to rolling upgrades, you can remove "rolling"14:33
rosmaitajokke_ my question about https://review.openstack.org/#/c/455837/11 is whether the deviation from the spec-lite is ok14:35
rosmaita(i think it is)14:35
bhagyashrisrosmaita, ok i will update soon and thank you for review :)14:36
rosmaitabhagyashris ty14:36
jokke_rosmaita: bug 1747926 I targeted it to RC114:36
openstackbug 1747926 in Glance "Import plugins requires deployer to poke Glance code with internal details " [Critical,New] https://launchpad.net/bugs/1747926 - Assigned to Erno Kuvaja (jokke)14:36
jokke_I'd assume having patch ready today14:36
rosmaitaok14:36
jokke_feel free to triage :D14:36
rosmaitawe release RC-1 tomorrow, is that right?14:37
jokke_I think it should be tomorrow, yes14:37
*** shilpa_ has joined #openstack-glance14:37
jokke_and that will be the point of cutting the branch so anything we can get in before means we don't need to backport14:37
rosmaitaok, let's be optimistic about targeting that bug for rc-114:37
rosmaitabhagyashris add your idea to https://bugs.launchpad.net/glance/+bug/1747926 if you have some time before erno starts working on it14:39
openstackLaunchpad bug 1747926 in Glance "Import plugins requires deployer to poke Glance code with internal details " [Critical,Triaged] - Assigned to Erno Kuvaja (jokke)14:39
*** alexchadin has quit IRC14:44
bhagyashrisrosmaita: sure, Just one question as the review comments or we can say it as a concern on patch https://review.openstack.org/#/c/455837/11 so is it bug that glance will not support postgresql14:46
*** shilpa_ has quit IRC14:46
rosmaitabhagyashris your patch does not care what the db engine is, am i right about that?14:47
rosmaitayou just need to know what scripts exist and what the alembic_version is in the db14:48
bhagyashrisrosmaita: yes14:48
rosmaitaok, i will put a comment clarifying that the comments about postgres don't apply to your patch (even though they are important)14:49
bhagyashrisrosmaita: just for curiosity i mean is it bug? yeah definitely my patch is not the cause of this14:49
bhagyashrisrosmaita: ok thank you :)14:49
rosmaitabhagyashris oh yes, definitely a bug, we will discuss at meeting tomorrow14:50
anikethjokke_, rosmaita : Really sorry to ping you once in a while with similar doubts. Like, I'm confused right now. Let me break down things myself and see.14:50
rosmaitaaniketh don't worry about pinging me, that's fine, just be patient as it's release candidate time and i may not get back to you right away14:51
bhagyashrisrosmaita: ok sure will discussed tomorrow's meeting14:51
anikethSo, basically we use Devstack for functional testing alone right? For developing and changing the code - we have the direct clone of the Glance from the Git mirror right?14:51
anikethrosmaita: Thanks! Yes, I will be :)14:52
openstackgerritBhagyashri Shewale proposed openstack/glance master: Implementation of db check command  https://review.openstack.org/45583714:53
rosmaitaaniketh you can change the code in your devstack installation to see what happens "live" (after you restart whatever service you have modified) ... i think jokke_ 's point is that occasionally you may want to throw out a devstack and start over, so you may want to have your local code repository outside of your devstack machine14:55
rosmaitabut everyone has different development workflows, you just need to experiment and see what works best for you14:55
bhagyashrisjokke_, rosmaita : just push patch https://review.openstack.org/455837 after fixing review comments. thank you for review :)14:55
*** e0ne has joined #openstack-glance14:56
anikethrosmaita: Yes, Even I'm a bit comfortable more on having codebase in my Host system rather than working on the VM where the VM tends to be sloppy at times. Could you help me with building Glance locally?14:58
openstackgerritErno Kuvaja proposed openstack/glance master: Decouple Image Import Plugin Opts  https://review.openstack.org/54174015:02
jokke_rosmaita: bhagyashris ^^15:02
rosmaitajokke_ that was quick15:03
jokke_aniketh: literally my local where I initially do my changes is `git clone git://github.com/openstack/glance` and then the needed configs by your own preference15:04
jokke_I have it clone under ~/src/openstack.org/ and I do have git config at the root there having my openstack details so when ever I do clone repo I haven't touched before I don't need to setup everything again to get `git review` working15:05
jokke_rosmaita: I told you I had pretty good idea what it should need to decouple :P15:06
*** krypto has quit IRC15:07
jokke_rosmaita: and it's even documented :P15:07
*** krypto has joined #openstack-glance15:07
*** Supun has quit IRC15:14
anikethjokke_: Alright! So, did that - all those you told. Now what is the change to be made in the config files and stuff?15:14
anikethjokke_: Also, Should I install Tox and it's dependencies?15:15
rosmaitajokke_ got a grammar nit on your patch15:16
rosmaitaaniketh yes, you'll need tox so that you can run the tests, build the docs, etc15:16
anikethrosmaita: Alright!15:17
anikethrosmaita, jokke_: Just putting out, the basic thing what I understood, about the whole Glance/ OpenStack as such - We are making dev changes in the local repo, we do code tests there with tox. I'm guessing that there is no provision for functional testing from the local clone itself. So, for that, we are using Devstack. We cherrypick the commit from Gerrit and test it out within the devstack. Please do15:20
anikethcorrect me if I'm wrong somewhere or I'm missing out on certain things?15:20
rosmaitaaniketh actually glance does have functional tests independent of devstack15:21
anikethAlso, we are following python3 right?15:22
rosmaitawe do both py2 and py315:22
anikethrosmaita: Oh, how? I would like to follow that. Or maybe try to find which is better for me.15:22
anikethrosmaita: Alright! Encountered an error while running tox command on my local repo - just to build the docs and check things out.15:23
anikethhttps://www.irccloud.com/pastebin/7NlhnLxB/15:23
rosmaitaaniketh devstack has 2 primary uses: it gives you a contained openstack installation to experiment with, and it is also used for testing in the CI gate15:24
*** AlexeyAbashkin has quit IRC15:24
*** AlexeyAbashkin has joined #openstack-glance15:24
rosmaitaaniketh what kind of system are you running that command on ?15:25
*** jdillaman has quit IRC15:26
anikethrosmaita: Kubuntu 17.1015:30
aniketh>> aniketh devstack has 2 primary uses: it gives you a contained openstack installation to experiment with, and it is also used for testing in the CI gate15:31
anikethrosmaita Alright, So how we are using it and how it helps us?15:31
openstackgerritErno Kuvaja proposed openstack/glance master: Decouple Image Import Plugin Opts  https://review.openstack.org/54174015:32
rosmaitaaniketh you are using it mostly as an experimental environment15:32
jokke_rosmaita: fixed those and the misleading part referring to gonfiggen15:32
anikethrosmaita: Oh okay!15:33
jokke_aniketh: 1) you can use devstack to just learn using Glance & OpenStack in general 2) you can use it to experiment your changes, reproducing bugs and ensuring your changes behave as you want them to before submitting them 3) you can use it to verify the code you're reviewing that it actually behaves as it claims/intended15:35
*** jdillaman has joined #openstack-glance15:36
jokke_aniketh: it's just lightweight environment to tinker around that is easy to throw away and restart from clean when needed15:36
rosmaitaaniketh looks like you need to install python3-dev (I guess kubuntu uses same package names as ubuntu?)15:37
jokke_aniketh: https://docs.openstack.org/infra/manual/developers.html should help you get started with the actual repos, gerrit etc.15:37
jokke_aniketh: then I just moved from glance/.git/config the [user] section to ~src/openstack.org/.gitconfig file so I don't need to run those git config commands every time (I don't use the --global) flag15:39
anikethrosmaita: Yes - It is just another Ubuntu distro :)15:41
anikethrosmaita: It is already installed15:42
anikethThe version my system is using is 2.715:42
anikethI might to use the alternative15:43
rosmaitai'm not sure why tox can't find it15:43
anikethI believe it is basically the system python version conflict - I will google that up. It is not a problem :D15:44
anikethjokke_: So, this is the reference{https://docs.openstack.org/infra/manual/developers.html } to be used to build a project in OpenStack locally right?15:45
*** idlemind has quit IRC15:46
*** idlemind has joined #openstack-glance15:47
jokke_aniketh: no, that's just fairly simple guide how to setup your dev environment with all the needed accounts etc, to make your first commit15:56
anikethjokke_: Okay! That is almost done. Is there something specific to Glance?15:57
jokke_https://docs.openstack.org/glance/pike/contributor/index.html15:58
jokke_if you find any inconsistencies there, please let us know16:00
anikethjokke_: Yea! Sure16:03
*** pcaruana has quit IRC16:03
*** Supun has joined #openstack-glance16:09
*** mosulica has quit IRC16:09
*** tshefi_ has quit IRC16:10
*** krypto has quit IRC16:12
jokke_rosmaita: so what do we _need_ to get in before tomorrow?16:13
rosmaitajust looking at the buglist to make sure i'm not missing what kairat mentioned16:14
rosmaitapretty sure it was the ovf thing16:14
rosmaitaso we need to get your 2.6 patch in16:15
rosmaitawhich i am about to approve16:15
anikethjokke_: I will go through the links given and google some stuff up and see what I can come up with. If I am stuck - I will ping you by then16:16
rosmaitajokke_ this just got filed16:16
rosmaitahttps://bugs.launchpad.net/glance/+bug/174786916:17
openstackLaunchpad bug 1747869 in Glance "./stack.sh doesn't work with postgres" [Critical,Triaged] - Assigned to Brian Rosmaita (brian-rosmaita)16:17
rosmaitai am going to put up a quick fix patch in a few minutes16:17
rosmaitawe can talk in glance meeting tomorrow about longer term fix16:17
kukaczrosmaita: Hi, we had a chat about changing glance backend last week. I'm in the phase now attempting to add a new location url (the new backend = swift) to an existing image. failing here though - Invalid location error16:18
kukaczI've enabled debug and can see this error in glance-api.log: " Store glance_store._drivers.swift.store.SingleTen16:19
kukaczantStore doesn't support updating dynamic storage capabilities. Please overwrite 'update_capabilities'"16:19
kukaczI wonder if these features (location-add, location-update) are actually implemented in the swift store?16:20
rosmaitathey should be16:20
rosmaitayou said you are using ocata?16:20
kukaczyes16:20
kukaczthe current store is "file" and I'm trying to add "swift+config" (with v3 auth) as an additional url record to existing image16:21
kukaczeg. grepping "update_capabilities" in my python glance_store path finds no occurences in the _drivers directory16:22
kukaczneither I could find it on github master branch though, so maybe my thinking in this way is wrong16:23
rosmaitakukacz it's defined in glance_store/capabilities.py and is inherited by the Store class in driver.py, and then the drivers in _drivers inherit from that Store class16:26
kukaczyes, I expected I should find then the "update_capabilities" implementation somewhere in the _drivers/swift/store.py which I did not16:29
rosmaitai dont' know if any of the drivers support that, actually16:32
rosmaitawhat that's for is if you want to change your swift from read-write to read-only, something like that16:32
rosmaitahow are you adding the location?16:33
kukaczok, maybe I don't need that. it's just an error in the log when trying to add the url as additional location16:33
kukaczusing curl patch call16:33
kukaczcan paste an example16:34
rosmaitathat would be helpful16:34
kukaczhttps://gist.github.com/kukacz/3506af03d46c40e7e21dd722ad7ee45116:35
kukaczalso here are some lines from the log: https://gist.github.com/kukacz/87f6d0b6b18b3685bc13dd5810eff7f016:41
rosmaitaty16:41
*** gyee has joined #openstack-glance16:45
*** Supun has quit IRC16:45
rosmaitakukacz here's your problem: http://git.openstack.org/cgit/openstack/glance/tree/glance/common/store_utils.py?h=stable/ocata#n12416:46
*** markvoelker_ has joined #openstack-glance16:47
rosmaitait's a security risk to allow users to set a swift+config:// location16:47
*** itlinux has joined #openstack-glance16:49
rosmaitaand i don't think there are any policy checks around there to see if you're an admin or anything like that16:49
*** e0ne has quit IRC16:49
*** markvoelker has quit IRC16:49
kukaczhmm, ok. I've justed used this form (prefix) because I've seen it created so by glance itself - I've created one image using the "new" config to see how the location records look like16:49
rosmaitayes, and i think that is probably the correct thing to do16:50
rosmaitai'm not sure how to address this.  can you come to the glance meeting tomorrow at 1400 UTC?16:51
rosmaitaor if that's a bad time i can bring it up and see if anyone has any ideas16:52
kukaczthe time is ok, I will be happy to join. just would be grateful for your guidance16:53
rosmaitai have an idea, but am hoping someone else has a better one.  my idea is that since you're adding the locations on an isolated glance that only an admin can use, you can hack the code to remove swift+config from the restricted schemas at http://git.openstack.org/cgit/openstack/glance/tree/glance/common/store_utils.py?h=stable/ocata#n3116:55
rosmaitabut only on that restricted node16:56
jokke_ouch, that does sound hacky ... likely also the only option to actually do that16:56
rosmaitamake sure you read through that bug so you understand the implications16:56
rosmaitajokke_ yeah, was hoping you might have a better idea16:57
openstackgerritMatthew Treinish proposed openstack/glance master: Specify a python executable for prlimits when using uwsgi  https://review.openstack.org/53149816:57
kukaczrosmaita: sounds great, love these hacks :-)16:57
rosmaitakukacz just be careful!16:58
jokke_rosmaita: kukacz: one can always also circumvent all the fences and poke the db directly :P16:58
kukaczI will. perhaps this is still better than doing it by database record update16:58
kukacz:-)16:58
kukaczI'll collect votes which one is less "hacky"16:59
jokke_kukacz: tbh, as long as you understand what you are doing, patching that one node to go around artificial restriction is lots safer17:00
kukaczjokke_: it's also my preferrence, to rely on the validations you great guys have already put into the code17:02
kukaczI'll try this method17:03
rosmaitalooks like maybe we overdid the validations :P17:03
*** pbourke has quit IRC17:04
*** pbourke has joined #openstack-glance17:05
jokke_rosmaita: that's always the double edged sword with security. There is always legit usecases for something you want to prevent to plug a hole17:06
rosmaitajokke_ about https://bugs.launchpad.net/glance/+bug/1747869 ... short term fix is to put a 'pass' right at the beginning of https://github.com/openstack/glance/blob/master/glance/cmd/manage.py#L146-L156 (though i don;'t know if that would pass pep8, but you know what i mean)17:08
openstackLaunchpad bug 1747869 in Glance "./stack.sh doesn't work with postgres" [Critical,Triaged] - Assigned to Brian Rosmaita (brian-rosmaita)17:08
rosmaitaor is that too stupid?17:08
jokke_oh my17:09
rosmaitai think we need to get a patch up right away17:09
jokke_so we just did glance manage to always use EMC and we still have that condition existing :o17:09
jokke_now if we drop that check we will push EMC to the DBs that are actually not supported17:10
*** harlowja has joined #openstack-glance17:11
rosmaita  yeah17:11
rosmaitai think its not a problem for the offline migrations17:11
rosmaitabut i am not 100% sure17:12
jokke_so I think either we admit that devstack won't work with postgre or ...17:12
rosmaitaexactly17:13
jokke_we rever the patch that caused it and back to the table to figure out how we do this the right way17:13
*** udesale has quit IRC17:13
*** markvoelker_ has quit IRC17:14
jokke_so clearly there was valid reason why it had not been made such as default17:14
*** markvoelker has joined #openstack-glance17:14
jokke_clearly we do not test on postgre so I'd be actually fine either way (hurst to say)17:14
jokke_but I really do not like just bypassing validation and hoping the world does not explode bocause of it17:15
rosmaitaagree17:15
rosmaitaok, i will put up a revert patch, and we'll figure out what to do for RC-217:16
jokke_so why fixing postgre on devstack is such high importance when we do not test it (as in it's fundamentally broken)17:17
jokke_do we officially state that we still support postgre?17:17
*** harlowja has quit IRC17:17
rosmaitalooking to see17:18
rosmaita(asking in the tc channel)17:21
kukaczrosmaita, jokke_: the "hack" worked! I got 2 locations at my image now17:21
kukaczone thing i still don't understand: the "direct_url" parameter now points to the "file" backend which I'm about to remove. do I need to take care of updating this parameter too or is it just dynamically constructed?17:25
*** AlexeyAbashkin has quit IRC17:26
jokke_I can't remember out of my head how that gets done17:26
*** tesseract has quit IRC17:27
jokke_rosmaita: I do not understand wtf is going on here http://logs.openstack.org/40/541740/2/check/build-openstack-sphinx-docs/ec83d77/job-output.txt.gz#_2018-02-07_15_36_29_343487 as the sphinx run is the only one failing17:28
rosmaitakukacz i believe the direct_url is generated17:28
rosmaitait's the one indicated by the location strategy17:29
jokke_rosmaita: and that import works just fine17:30
rosmaitais it glance.async.flows.plugins ?17:31
rosmaitahttp://git.openstack.org/cgit/openstack/glance/tree/glance/async/flows/plugins17:31
openstackgerritErno Kuvaja proposed openstack/glance master: Decouple Image Import Plugin Opts  https://review.openstack.org/54174017:32
*** dtantsur is now known as dtantsur|afk17:33
jokke_it was17:35
rosmaitaok17:35
rosmaitabased on dicsussion in tc channel, i think the thing to do is revert the change and reconsider how to handle this17:35
rosmaitai don't think it's going to be a clean revert17:38
rosmaitamaybe we just keep it in rc-1 and acknowledge the bug17:38
jokke_ouch, there was something merged that was based on it?17:39
rosmaitayeah, i think the system(exit) thing that got merged this morning17:40
jokke_I'd say lets acknowledge it, keep it in rc1 and buy few more days to figure out why that's the case17:40
jokke_oh yeah it was direct patch against that so they would need both to go17:41
rosmaitaok, will go with the keep-and-acknowledge for now17:41
jokke_++17:41
jokke_the docs build worked at least locally once I fixed that path17:42
rosmaitacool17:42
jokke_so unless you hate the change that should be good to go :P17:42
jokke_then hopefully abhishek is ok with it at the morn17:43
jokke_rosmaita: another thing I'm bit worried about is that the requirements change does not merge17:45
rosmaitawhich requirements change?17:46
jokke_53704517:46
rosmaitathat's weird, so tempest-full passed on check but failed on gate17:47
jokke_and that was second time in  row17:49
rosmaitatimeout during a volume test17:50
rosmaitai gave it another recheck, let's see what happens17:52
jokke_would be good to have them up to date for branching17:54
*** Supun has joined #openstack-glance17:59
*** cfriesen has left #openstack-glance18:02
openstackgerritErno Kuvaja proposed openstack/glance master: Add validation to check if E-M-C is already in sync  https://review.openstack.org/54073618:04
*** e0ne has joined #openstack-glance18:04
jokke_just rebase ^^18:07
*** harlowja has joined #openstack-glance18:11
*** Supun has quit IRC18:11
*** harlowja has quit IRC18:18
*** r-daneel_ has joined #openstack-glance18:28
*** Supun has joined #openstack-glance18:28
*** r-daneel has quit IRC18:29
*** r-daneel_ is now known as r-daneel18:29
openstackgerritMerged openstack/glance master: Enable Image Import per default and make current  https://review.openstack.org/53250218:36
*** Supun has quit IRC18:38
*** Supun has joined #openstack-glance18:38
*** Supun has quit IRC18:57
*** e0ne has quit IRC18:59
*** Supun has joined #openstack-glance19:00
*** Supun has quit IRC19:09
*** e0ne has joined #openstack-glance19:10
*** r-daneel_ has joined #openstack-glance19:13
*** r-daneel has quit IRC19:14
*** r-daneel_ is now known as r-daneel19:14
*** Supun has joined #openstack-glance19:28
*** aniketh has quit IRC19:32
*** markvoelker has quit IRC19:33
*** markvoelker_ has joined #openstack-glance19:33
*** AlexeyAbashkin has joined #openstack-glance19:37
*** pcaruana has joined #openstack-glance19:52
*** Supun has quit IRC20:04
*** pcaruana has quit IRC20:07
*** AlexeyAbashkin has quit IRC20:33
*** mvk_ has joined #openstack-glance20:34
*** mvk has quit IRC20:36
openstackgerritMerged openstack/glance master: Updated from global requirements  https://review.openstack.org/53704520:57
openstackgerritBrian Rosmaita proposed openstack/glance master: Regenerate sample configuration files  https://review.openstack.org/54189721:02
openstackgerritMatthew Treinish proposed openstack/glance master: Specify a python executable for prlimits when using uwsgi  https://review.openstack.org/53149821:10
*** e0ne has quit IRC21:23
*** e0ne has joined #openstack-glance21:27
*** threestrands has joined #openstack-glance21:39
*** Sukhdev has joined #openstack-glance21:59
*** pdr_ has quit IRC22:07
*** r-daneel has quit IRC22:08
openstackgerritBrian Rosmaita proposed openstack/glance master: Release note for Queens metadefs changes  https://review.openstack.org/54192322:10
*** rcernin has joined #openstack-glance22:25
*** pdr_ has joined #openstack-glance22:35
*** e0ne has quit IRC22:47
*** itlinux has quit IRC22:50
*** Sukhdev has quit IRC23:23
*** masber has joined #openstack-glance23:27
*** Sukhdev has joined #openstack-glance23:36
*** edmondsw has quit IRC23:37
*** MattMan has quit IRC23:37
*** MattMan has joined #openstack-glance23:38
*** itlinux has joined #openstack-glance23:43
*** markvoelker_ has quit IRC23:45

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!