Thursday, 2018-04-26

*** gildub has joined #openstack-sdks00:13
*** slaweq has joined #openstack-sdks00:20
*** slaweq has quit IRC00:25
*** shu-mutow-AWAY is now known as shu-mutow00:59
*** kmalloc has quit IRC01:10
*** salv-orlando has joined #openstack-sdks01:26
*** salv-orl_ has quit IRC01:29
*** yolanda__ has joined #openstack-sdks01:40
*** yolanda_ has quit IRC01:44
adriantmordred: it's not that I keep re-solving them, I just get curious how stuff works and then dig into it myself :P I need to get better at checking for existing patches and bug reports :/01:50
adriantalthough, mordred, I'm tempted to look at adding swift object chunking support to the SDK itself. We probably want to share that code, so either we find a common place for it, or the proxy uses the shade code, or we move that code into the service code. No clue what's nicer.01:52
adriantthat said, there is also the issue that shade doesn't let you pass in an open file stream so if the file NEEDS to be opened as binary to send it to swift... you can't: https://pastebin.com/BHMNUPF402:12
*** tv1 has quit IRC02:12
*** mordred has quit IRC02:12
*** d0ugal has quit IRC02:12
*** ianw_pto has quit IRC02:12
*** tv2 has joined #openstack-sdks02:13
adriantand doing it with the sdk is 3 lines...02:13
*** ianw has joined #openstack-sdks02:13
*** mordred has joined #openstack-sdks02:13
adrianttrying to upload a gzip'd tar file with shade throws: UnicodeDecodeError: 'utf-8' codec can't decode byte 0x8b in position 1: invalid start byte02:13
*** d0ugal has joined #openstack-sdks02:13
adriantwill file a bug with a easy step by step guide to reproduce.02:17
*** edmondsw has joined #openstack-sdks02:20
*** gkadam has joined #openstack-sdks02:26
adriantmordred: https://storyboard.openstack.org/#!/story/200191802:36
*** bobh has joined #openstack-sdks02:47
*** annp has joined #openstack-sdks03:39
*** edmondsw has quit IRC03:50
*** bobh has quit IRC04:00
*** edmondsw has joined #openstack-sdks04:18
*** edmondsw has quit IRC04:21
*** edmondsw has joined #openstack-sdks04:21
*** edmondsw has quit IRC04:21
*** edmondsw has joined #openstack-sdks04:22
*** slaweq has joined #openstack-sdks04:22
*** edmondsw has quit IRC04:26
*** slaweq has quit IRC04:26
*** gkadam has quit IRC04:45
*** e0ne has joined #openstack-sdks05:16
*** gkadam has joined #openstack-sdks05:29
*** e0ne has quit IRC05:43
*** e0ne has joined #openstack-sdks05:44
*** yolanda__ is now known as yolanda05:45
*** d0ugal has quit IRC05:46
*** shu-mutow is now known as shu-mutow-AWAY06:01
*** d0ugal has joined #openstack-sdks06:13
*** slaweq has joined #openstack-sdks06:22
*** e0ne_ has joined #openstack-sdks06:27
*** e0ne has quit IRC06:30
*** gildub has quit IRC06:41
*** gildub has joined #openstack-sdks06:55
*** ralonsoh has joined #openstack-sdks07:20
*** jpena|off is now known as jpena07:35
*** jpich has joined #openstack-sdks07:54
*** gkadam has quit IRC07:56
*** gildub has quit IRC07:57
*** gildub has joined #openstack-sdks08:01
*** gkadam has joined #openstack-sdks08:20
*** dtruong_ has joined #openstack-sdks08:27
*** dtruong has quit IRC08:28
*** e0ne_ has quit IRC09:33
*** jpich_ has joined #openstack-sdks09:38
*** dtantsur|afk is now known as dtantsur09:38
*** jpich has quit IRC09:39
*** mtreinish has quit IRC09:41
*** mtreinish has joined #openstack-sdks09:47
*** sdague has joined #openstack-sdks09:58
*** cdent has joined #openstack-sdks10:01
*** gildub has quit IRC10:47
*** cdent has quit IRC10:47
*** cdent has joined #openstack-sdks10:48
*** yolanda_ has joined #openstack-sdks10:53
*** yolanda__ has joined #openstack-sdks10:54
*** yolanda has quit IRC10:56
*** yolanda_ has quit IRC10:58
*** jpena is now known as jpena|lunch11:00
mordredadriant: *awesome*11:03
mordredadriant: re: chunking - (and other similar things where we have an advanced version of something in shade layer) - I've been thinking we should move the shade call into the sdk proxy layer and turn the shade call into a passthrough11:04
mordredadriant: but I agree on no clue what's nicer - I figured trying one or two of them and seeing what we like ...11:05
*** e0ne has joined #openstack-sdks11:11
mordredadriant: hrm. looking at your bug - that's really weird - we use the shade code in nodepool to upload qcow images to rackspace ...11:12
*** openstackgerrit has joined #openstack-sdks11:22
openstackgerritMonty Taylor proposed openstack/keystoneauth master: Turn normalize_status into a class  https://review.openstack.org/56411011:22
openstackgerritMonty Taylor proposed openstack/keystoneauth master: Infer version from old versioned service type aliases  https://review.openstack.org/56429911:22
openstackgerritMonty Taylor proposed openstack/keystoneauth master: Make VersionData class  https://review.openstack.org/56446911:22
*** purplerbot has quit IRC11:32
*** purplerbot has joined #openstack-sdks11:33
*** halbbalda has quit IRC11:34
*** halbbalda has joined #openstack-sdks11:34
*** e0ne has quit IRC11:35
*** rm_work has quit IRC11:39
*** dtantsur has quit IRC11:39
*** rm_work has joined #openstack-sdks11:39
*** dtantsur has joined #openstack-sdks11:44
*** dtantsur has quit IRC11:44
*** dtantsur has joined #openstack-sdks11:44
*** dtantsur has quit IRC11:44
*** dtantsur has joined #openstack-sdks11:49
*** dtantsur has quit IRC11:49
*** dtantsur has joined #openstack-sdks11:49
*** dtantsur has quit IRC11:49
*** e0ne has joined #openstack-sdks11:49
*** dtantsur has joined #openstack-sdks11:54
*** edmondsw has joined #openstack-sdks11:57
*** edmondsw_ has joined #openstack-sdks11:58
*** edmondsw has quit IRC12:02
*** edmondsw_ is now known as edmondsw12:08
*** ralonsoh has quit IRC12:23
*** jpena|lunch is now known as jpena12:24
*** dave-mccowan has joined #openstack-sdks12:32
*** thrash|g0ne is now known as thrash12:33
*** e0ne has quit IRC12:37
*** dave-mcc_ has joined #openstack-sdks12:42
*** dave-mccowan has quit IRC12:43
*** jpich_ is now known as jpich12:52
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Don't assume a full config dict  https://review.openstack.org/56449313:03
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Defer all endpoint discovery to keystoneauth  https://review.openstack.org/56449413:03
openstackgerritMonty Taylor proposed openstack/keystoneauth master: Infer version from old versioned service type aliases  https://review.openstack.org/56429913:04
openstackgerritMonty Taylor proposed openstack/keystoneauth master: Allow tuples and sets in interface list  https://review.openstack.org/56449513:04
*** tosky has joined #openstack-sdks13:08
*** edmondsw has quit IRC13:12
*** edmondsw has joined #openstack-sdks13:12
pabelangermordred: mind looking at https://review.openstack.org/564247/ again, volume limits for shade13:12
*** edmondsw has quit IRC13:16
mordredpabelanger: NO! NO REVIEW FOR YOU13:16
mordredpabelanger: jk. +A13:18
pabelangerYay13:18
mordredpabelanger: thanks for that13:23
umbSublime_when using the sdk's compute proxy compute.servers() method. Is there a way to get the count returned in the generator object without iterating over it ?13:23
mordredumbSublime_: not really - the generator itself doesn't known a total count because of server-side pagination13:24
umbSublime_ahh I see13:24
mordredumbSublime_: it would be a nice thing to have if it was possible :)13:24
umbSublime_indeed!13:25
pabelangermordred: np, the other issue we might need to do is some process to check for leaked volumes, like we did for FIPs in nodepool. I am sure you might have ideas on how to handle that13:31
mordredpabelanger: I havethe beginnings of some13:32
pabelangercool13:32
mordredpabelanger: do you know if our leaked volumes in vexxhost are still there?13:33
pabelangermordred: I think so, I haven't cleaned them up yet13:33
*** crunchengine has joined #openstack-sdks13:34
mordredpabelanger: awesome. let me look at them as examples13:37
mordredpabelanger: my biggest question is whetheror not they still show the old server id in their metadata13:38
mordredpabelanger: (figuring out how to identify volumes that are safe to automatically delete is ... terrifying13:38
mordredpabelanger: cause, you know, get that wrong and you could give someone a giant foot-cannon13:38
pabelangerAgree, I too am hoping for some sort of metadata13:40
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Add get_volume_limits() support  https://review.openstack.org/56450713:42
mordredpabelanger: ^^ there, that's cherry-picked to sdk13:42
*** crunchengine has quit IRC13:42
*** crunchengine has joined #openstack-sdks13:42
*** ediardo has quit IRC13:44
pabelangermordred: ah, right. Development on openstack-infra/shade is ending?13:45
mordredpabelanger: wel - not quite yet - but yeah, for now we're cherry-picking patches13:48
mordredpabelanger: hopefully we'll be able to get far enough along this cycle to make shade a thin wrapper13:48
pabelangerack13:48
*** e0ne has joined #openstack-sdks13:55
umbSublime_I remember talking here a few months ago about making a cutsom api request not supported by the SDK, at the time the work-around was to use the <ressource>._action method and pass the connection.session object. I was discussed that new standard way would be eventualy implemented in the SDK. Was this added since ?13:59
mugsieis there any easy way to take a path to openstack-client-config file in openstack-sdk?13:59
mugsie(not using a env var)13:59
*** e0ne has quit IRC14:06
*** e0ne has joined #openstack-sdks14:11
*** e0ne has quit IRC14:14
*** chenyb4 has joined #openstack-sdks14:17
*** edmondsw has joined #openstack-sdks14:19
*** e0ne has joined #openstack-sdks14:20
*** e0ne has quit IRC14:25
mordredmugsie: you want to override the location of the clouds.yaml file?14:33
mugsieyeah - I am writing a certbot plugin, and the location of the clouds.yaml file may be $RANDOM_DIR14:34
mordredmugsie: the config_files parameter to openstack.config.loader.OpenStackConfig is what you want14:34
mordredmugsie: there's some examples of usage in the test suite - one sec, lemme find you a reference14:35
mugsiemordred: sweet - thanks14:35
mordredmugsie: actualy - openstack/cloud/inventory.py and look for config_files=14:35
mordredmugsie: but you;ll need to do config = loader.OpenStackConfig( ... then cloud_region = config.get_one( ... then conn = connection.Connection(config=cloud_region)14:37
mugsieyup, looks doable - thanks :)14:37
openstackgerritMerged openstack/openstacksdk master: Fix openstack-inventory  https://review.openstack.org/56375414:50
*** edmondsw has quit IRC14:54
*** edmondsw has joined #openstack-sdks14:54
mordredsamP: remote:   https://review.openstack.org/564527 Release openstacksdk 0.13.014:58
Shrewspabelanger: did you ping someone about the bifrost jobs fix? can't merge your shade change w/o it15:00
mordredShrews: oh - I thought I saw that was fixed - do we need to get something landed?15:00
Shrewsmordred: yeah. https://review.openstack.org/56427915:01
mordreddtantsur, TheJulia: ^^ have a sec to land a bifrost patch to unstick shade?15:05
-openstackstatus- NOTICE: We've successfully troubleshooted the issue that prevented paste.openstack.org from loading and it's now back online, thank you for your patience.15:06
*** bobh has joined #openstack-sdks15:14
dtantsurmordred: looking15:19
crunchenginehello mordred: with version 0.12.0, code like server = "conn.compute.get_server("db323e83-8913-4016-9d8e-7d452a3577f2")" then "server.get_console_output(conn.session)" does not work15:24
crunchengineit fails with keystoneauth1.exceptions.catalog.EndpointNotFound: Could not find requested endpoint in Service Catalog.15:24
crunchenginecompute URL is not prepended to request URL, so it can't work, do you know why ?15:24
*** thrash is now known as thrash|biab15:27
*** thrash|biab is now known as thrash15:50
*** gkadam has quit IRC15:53
*** d0ugal has quit IRC16:03
mordredcrunchengine: looking16:03
*** d0ugal has joined #openstack-sdks16:04
mordredcrunchengine: oh - don't use conn.session - use conn.compute16:04
crunchenginealready tried :/16:04
mordredcrunchengine: server.get_console_output(conn.compute)16:04
mordredyeah?16:04
* mordred goes to poke16:05
crunchengineoooh it working!16:06
crunchenginelet me try with _action :)16:06
mordred\o/16:06
mordredthe session parameter to resource ethods is currently very porrly named16:07
pabelangerShrews: oh, forgot about that16:22
openstackgerritMerged openstack/api-wg master: Add guidance on needing cache-control headers  https://review.openstack.org/55046816:24
*** edmondsw has quit IRC16:31
openstackgerritMonty Taylor proposed openstack/keystoneauth master: Infer version from old versioned service type aliases  https://review.openstack.org/56429916:41
*** jpich has quit IRC16:41
openstackgerritMonty Taylor proposed openstack/keystoneauth master: Allow tuples and sets in interface list  https://review.openstack.org/56449516:42
*** fbaca has quit IRC16:42
*** jpena is now known as jpena|off16:45
elmikocdent edleafe dtantsur ready for publish, https://etherpad.openstack.org/p/api-sig-newsletter16:51
dtantsurLGTM16:53
cdentelmiko: " elmiko as mentioned" not sure what you're after there16:54
elmikocdent: fixed, thanks16:54
*** ediardo has joined #openstack-sdks16:55
cdentlgtm16:55
elmikocool, gonna ship it unless edleafe tells me to pump the brakes16:57
edleafeelmiko: hold on16:57
elmikoyup yup, i see you changing things16:57
edleafeyeah, the wording was a little awkward, so I changed it up a bit16:59
edleafeIf you agree with the chages, ship it!17:00
elmikolooks good to me, thanks for the clarity edleafe =)17:00
elmikosent!17:01
*** lbragstad[m] has joined #openstack-sdks17:04
cdentI thought that lack of clarity was just elmiko's inimitable style17:06
cdentwhich I took as artistry17:06
*** lbragstad has quit IRC17:07
*** dtantsur is now known as dtantsur|afk17:10
elmikocdent: pretty much XD17:10
*** olaph has joined #openstack-sdks17:17
*** chenyb4 has quit IRC17:31
*** e0ne has joined #openstack-sdks17:35
*** e0ne has quit IRC18:00
*** lbragstad has joined #openstack-sdks18:22
*** e0ne has joined #openstack-sdks18:22
*** harlowja has joined #openstack-sdks18:46
*** JPL has joined #openstack-sdks18:49
*** cdent has quit IRC18:53
JPLHi.  I just started using shade to connect to our private cloud instances, and am having some issues switching projects (`connect_as_project`).Ref: https://docs.openstack.org/shade/latest/user/usage.html18:53
JPLhttps://gist.github.com/jplindquist/acb4ddfb00f9e412563fb26343b138a218:53
harlowjaya, i've been trying that same thing with JPL18:55
JPLI can connect to my user-project, list servers, etc, all without issue, but if I attempt to connect_as_project to another project, I receive an error: `os_client_config.exceptions.OpenStackConfigException: Cloud defaults was not found.`18:55
harlowjaJPL u also put in a 'defaults:{}' and 'default:{}' in your clouds.yaml right18:55
harlowjawith no luck with those right?18:55
JPLCorrect18:56
JPLLooks like it's trying to combine defaults here when it does connect_as: https://github.com/openstack-infra/shade/blob/master/shade/openstackcloud.py#L366-L36918:57
*** e0ne has quit IRC19:14
Shrewsthat code is *really* new. a bug there does not surprise me19:19
*** e0ne has joined #openstack-sdks19:21
*** e0ne has quit IRC19:21
JPLYeah, I wouldn't be surprised, wasn't sure if anybody else had used it successfully or not :/19:23
*** ediardo has quit IRC19:23
Shrewsso it looks like OCC is supposed to give you a 'defaults' cloud if you have none defined. If you do have some defined, you don't get that.19:26
Shrewsso yeah, i think that's a bug19:26
Shrewsmay need to confer with mordred on how to handle that19:26
Shrewsi wonder why our tests didn't catch it though19:27
ShrewsJPL: out of curiosity, what is your OCC version?19:36
JPLos-client-config (1.29.0)19:36
mordredShrews, JPL: I believe that's fixed in master - but I need to check19:37
mordred(and sorry)19:37
JPLAll good, thanks for checking, I appreciate your help19:38
Shrewsi do not see a fix in master19:38
mordredShrews: maybe you're not squinting hard enough?19:38
Shrewsentirely possible19:38
JPLrofl19:39
Shrewsit also might help if i were not looking at the occ git log19:39
mordredwell19:40
mordredso - it's fixed in sdk master and I'm a bad person and didn't cherry-pick it back into shade master19:40
Shrewslol19:42
* Shrews stops squinting so hard as it is hurting his eyes19:42
JPLaaah19:42
openstackgerritMonty Taylor proposed openstack-infra/shade master: Backport connect_as fix from openstacksdk  https://review.openstack.org/56460419:43
mordredShrews, JPL I'm pretty sure that will fix it - and it's no wonder it didn't get backported, it was hidden inside of a patch for using oslotest's base class19:44
mordredsigh19:44
mordredShrews: with the release of sdk I put in apatch for today, we should be able to land the patch to make occ a shim and at least remove that layer of confusion - and then I think it'll be time to do the same thing with shade - the two-parallel-codebases thing is too much for my brain19:45
JPL* highfive19:45
Shrewstoo much for anyone's brain19:46
harlowjamordred so how much of openstacksdk vs shade going forward?19:54
harlowjamerging? maybe/19:54
harlowja?19:54
harlowjasomeday?, soon? never?19:54
JPLI tried updating my local copy with that diff, got this nwo:AttributeError: 'OpenStackCloud' object has no attribute 'config'19:54
mordredJPL: ok. darn. I'll have to work slighly harder :)19:55
JPLTraceback (most recent call last):   File "shade-test.py", line 22, in <module>     project_cloud = default_cloud.connect_as_project(project=project_name)   File "/usr/local/lib/python2.7/site-packages/shade/openstackcloud.py", line 411, in connect_as_project     return self.connect_as(**auth)   File "/usr/local/lib/python2.7/site-packages/shade/openstackcloud.py", line 328, in connect_as     if self.config._openstack_config: Att19:56
JPLThat's really ugly copy/paste, womp19:56
mordredharlowja: the shade and os-client-config code is already merged into sdk - the next step (which is the really tricky one) is to remove the shade code from shade and make it a very thin compat layer on top of the equiv code in sdk19:57
harlowjamordred gotcha19:57
harlowjaTIL, lol19:57
mordredharlowja: right now we're playing the 'keep both in sync with each other while we get that all done so that it doesn't break anybody' - which sucks19:57
harlowjaagreed19:57
mordredJPL: change config = self.config._openstack_config to config = self.cloud_config._openstack_config20:00
mordredJPL: copy-pasta error :)20:00
openstackgerritMonty Taylor proposed openstack-infra/shade master: Backport connect_as fix from openstacksdk  https://review.openstack.org/56460420:01
mordredShrews: ^ had to update because I'm a terrible person20:02
JPLAlso        if self.config._openstack_config: ?20:02
JPLsame thing, otherwise I think this will do the trick20:03
JPLYay, working20:03
JPLif self.cloud_config._openstack_config:             config = self.cloud_config._openstack_config20:03
mordred\o/20:05
melwittamotoki: hi, your review would be appreciated on this change we're trying to get in to make stable/queens novaclient work together with stable/queens openstackclient so that we may update the queens novaclient constraint to 10.x https://review.openstack.org/538070 so that users can use the multi-attach feature with queens out-of-the-box20:05
openstackgerritMonty Taylor proposed openstack-infra/shade master: Backport connect_as fix from openstacksdk  https://review.openstack.org/56460420:05
melwittamotoki: forgot to link the change, of course https://review.openstack.org/56284020:06
JPLThank you all for your help20:06
mordredJPL: thanks for trying out the fixes! that first one really didn't fix anything did it? :)20:06
JPLlol, any time20:06
JPLLast question, assuming everything passes and makes it in, how long usually before a new release with that?20:07
openstackgerritMonty Taylor proposed openstack/keystoneauth master: Infer version from old versioned service type aliases  https://review.openstack.org/56429920:10
*** salv-orl_ has joined #openstack-sdks20:11
*** salv-orlando has quit IRC20:11
mordredJPL: should have one today or tomorrow - assuming I can get TheJulia to land https://review.openstack.org/#/c/564279/ :)20:11
mordred(basically, as soon as that patch lands, we can land the fix for your issue and a patch pabelanger needs and cut a release20:12
JPLawesomesauce20:12
* mordred promises TheJulia a basket of things that probably aren't badgers20:13
*** bobh has quit IRC20:25
*** chenyb4 has joined #openstack-sdks20:35
*** yolanda__ has quit IRC20:38
*** bobh has joined #openstack-sdks20:39
*** crunchengine has quit IRC20:42
*** yolanda__ has joined #openstack-sdks20:43
*** chenyb4 has quit IRC20:59
openstackgerritMonty Taylor proposed openstack/keystoneauth master: Infer version from old versioned service type aliases  https://review.openstack.org/56429921:01
*** crunchengine has joined #openstack-sdks21:14
*** JPL has quit IRC21:18
*** crunchengine has quit IRC21:18
*** slaweq has quit IRC22:00
*** dave-mcc_ has quit IRC22:02
adriantmordred: Putting the code in the SDK layer was my first thought too. I think moving the advanced logic into the SDK layer makes sense if it's still part of that service, and shade just uses it as passthrough, but multi-project workflow type stuff should always stay in shade22:11
adriantif that makes sense22:11
adriantat least then we have some sort of consistency for where to put stuff22:12
*** salv-orl_ has quit IRC22:45
*** salv-orlando has joined #openstack-sdks22:45
*** salv-orlando has quit IRC22:50
*** bobh has quit IRC23:09
*** annp has quit IRC23:13
*** annp has joined #openstack-sdks23:14
*** sdague has quit IRC23:36
*** salv-orlando has joined #openstack-sdks23:46
*** olaph1 has joined #openstack-sdks23:46
*** olaph has quit IRC23:49
*** tosky has quit IRC23:49
*** salv-orlando has quit IRC23:51
*** gildub has joined #openstack-sdks23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!