Monday, 2023-08-28

opendevreviewMridula Joshi proposed openstack/openstacksdk master: Adding support for image upload  https://review.opendev.org/c/openstack/openstacksdk/+/88193908:07
opendevreviewArtem Goncharov proposed openstack/openstacksdk master: [DNM] Experiment with OpenAPI schema  https://review.opendev.org/c/openstack/openstacksdk/+/89216108:28
opendevreviewsuzhengwei proposed openstack/openstacksdk master: support notification vmoves for masakari  https://review.opendev.org/c/openstack/openstacksdk/+/87208010:04
opendevreviewMerged openstack/openstacksdk master: cloud: Remove dead code  https://review.opendev.org/c/openstack/openstacksdk/+/89277010:22
opendevreviewMerged openstack/openstacksdk master: Encode type of 'links' for Extension objects  https://review.opendev.org/c/openstack/openstacksdk/+/88513310:55
opendevreviewMerged openstack/openstacksdk master: volume: Add Extension to volume v2 API  https://review.opendev.org/c/openstack/openstacksdk/+/88513411:03
opendevreviewMerged openstack/ansible-collections-openstack master: Image filters should be dict not set  https://review.opendev.org/c/openstack/ansible-collections-openstack/+/88938811:04
opendevreviewMerged openstack/openstacksdk master: block storage: Add support for services  https://review.opendev.org/c/openstack/openstacksdk/+/88988611:08
opendevreviewMerged openstack/openstacksdk master: tests: Migrate tests from os-hosts to os-services  https://review.opendev.org/c/openstack/openstacksdk/+/88988711:27
opendevreviewMerged openstack/openstacksdk master: tests: Move cloud-layer service tests to their own file  https://review.opendev.org/c/openstack/openstacksdk/+/89121712:12
opendevreviewBaek Seung Ju proposed openstack/openstacksdk master: Implemented heat 'stack suspend' and 'stack resume' function  https://review.opendev.org/c/openstack/openstacksdk/+/89215612:21
opendevreviewYeJun, Jung proposed openstack/openstacksdk master: Add support for other metadef property operations  https://review.opendev.org/c/openstack/openstacksdk/+/85772712:38
opendevreviewYeJun, Jung proposed openstack/openstacksdk master: Add support for other metadef property operations  https://review.opendev.org/c/openstack/openstacksdk/+/85772712:43
opendevreviewStephen Finucane proposed openstack/python-openstackclient master: Migrate 'availability zone list' to SDK  https://review.opendev.org/c/openstack/python-openstackclient/+/88513512:52
opendevreviewStephen Finucane proposed openstack/python-openstackclient master: Migrate 'extension list' to SDK  https://review.opendev.org/c/openstack/python-openstackclient/+/88513912:52
opendevreviewStephen Finucane proposed openstack/python-openstackclient master: Remove project purge image commands  https://review.opendev.org/c/openstack/python-openstackclient/+/88552812:52
opendevreviewStephen Finucane proposed openstack/python-openstackclient master: tests: Remove FakeNetworkV2Client  https://review.opendev.org/c/openstack/python-openstackclient/+/88552612:52
opendevreviewStephen Finucane proposed openstack/python-openstackclient master: tests: Use consistent shortcut to fake network client  https://review.opendev.org/c/openstack/python-openstackclient/+/89278812:52
opendevreviewStephen Finucane proposed openstack/python-openstackclient master: tests: Add network v2 FakeClientMixin  https://review.opendev.org/c/openstack/python-openstackclient/+/88552712:52
opendevreviewStephen Finucane proposed openstack/python-openstackclient master: tests: Remove FakeImagev1Client, FakeImagev2Client  https://review.opendev.org/c/openstack/python-openstackclient/+/88552912:52
opendevreviewStephen Finucane proposed openstack/python-openstackclient master: tests: Use consistent shortcut to fake image client  https://review.opendev.org/c/openstack/python-openstackclient/+/89278912:52
opendevreviewStephen Finucane proposed openstack/python-openstackclient master: tests: Add image v1, v2 FakeClientMixin  https://review.opendev.org/c/openstack/python-openstackclient/+/88553012:52
opendevreviewkim woo seok proposed openstack/openstacksdk master: Implement stack export in openstacksdk  https://review.opendev.org/c/openstack/openstacksdk/+/89124913:56
opendevreviewYeJun, Jung proposed openstack/openstacksdk master: Add support for other metadef property operations  https://review.opendev.org/c/openstack/openstacksdk/+/85772714:22
chris218Hey so I'm using openstacksdk to manage servers through objects that persist for long time in my app, should I create Connection with openstack.connect() on demand when I want to interact with Openstack or can I save it as an attribute and close in for example __del__? 14:27
opendevreviewSongSuheon proposed openstack/openstacksdk master: Implement heat 'stack event list'  https://review.opendev.org/c/openstack/openstacksdk/+/89283614:40
rladntjr4Hello! i want to contribute python-openstackcli. i have a few question. Is this the right place to ask questions?15:07
opendevreviewMerged openstack/openstacksdk master: identity: Add support for domain config  https://review.opendev.org/c/openstack/openstacksdk/+/89168115:16
opendevreviewStephen Finucane proposed openstack/openstacksdk master: block storage: Add query string params for many APIs  https://review.opendev.org/c/openstack/openstacksdk/+/89297415:18
opendevreviewStephen Finucane proposed openstack/python-openstackclient master: volume: Migrate 'volume group snapshot' commands to SDK  https://review.opendev.org/c/openstack/python-openstackclient/+/89297515:19
opendevreviewArtem Goncharov proposed openstack/openstacksdk master: [DNM] Experiment with OpenAPI schema  https://review.opendev.org/c/openstack/openstacksdk/+/89216115:22
gtemastephenfin: I have updated openapi experiment with few more calls and few random server actions to show how it can be looking like15:23
stephenfinack, it's on my list to look at before EOD else tomorrow morning15:24
stephenfinrladntjr4: it is15:24
stephenfinjust be aware that delays can be slow15:24
gtemathanks stephenfin. I think it is now more then experiment and looks really reasonable in my eyes15:25
stephenfinchris218: tbh, I don't think we have any guidance on that. However, many of the OpenStack services create a session once on start up and then generate a new client each time they need one15:28
stephenfinMy gut would suggest opening on demand would likely be more reliable and take you less off the beaten track that saving it and opening/closing manually15:28
stephenfinbut maybe gtema has more ideas15:28
gtemawell, I think it depends on the "how long". In principle it is ok to keep session open and I have an app that runs in the container with a session pretty much endless, but I do not manage servers this way.15:30
gtemaanother example would be Zuul which also keeps the session and does activity pretty much permanently with no issues15:30
gtemaso I would rather first try to open session on demand and keep it open forever15:31
gtemaif you start facing issues - closing session should be also not a problem, but remember every re-connection is causing a new API call to the Keystone (auth_token), so there is additional "overhead" in that15:32
gtemastephenfin - any urgent change to be included in the release? I am going to update release change once stack_export merges and it can be released today/tomorrow15:33
chris218so if I understand it correctly session != connection, right? so how can I create session with openstacksdk?15:34
stephenfinfor sdk? https://review.opendev.org/c/openstack/openstacksdk/+/892974 would be nice15:34
gtemachris218: in principle it is equal, technically not, but highlevel it is15:34
stephenfinoh, maybe also https://review.opendev.org/c/openstack/openstacksdk/+/889984 so I can continue with that work15:34
gtemarojer15:35
rladntjr4i found some  happen in 'server list -c ' command. The code contains a case that handles lowercase, but it does not work.15:42
rladntjr4so i fix it. https://review.opendev.org/c/openstack/python-openstackclient/+/89283015:42
rladntjr4i wonder if this is the way you want.15:43
rladntjr4i think only 'server list -c ' support this features.15:44
opendevreviewkim woo seok proposed openstack/openstacksdk master: Implement stack export in openstacksdk  https://review.opendev.org/c/openstack/openstacksdk/+/89124915:51
opendevreviewArtem Goncharov proposed openstack/openstacksdk master: [WIP] Add OpenAPI invokation interface  https://review.opendev.org/c/openstack/openstacksdk/+/89216116:05
opendevreviewArtem Goncharov proposed openstack/openstacksdk master: [WIP] Add OpenAPI invocation interface  https://review.opendev.org/c/openstack/openstacksdk/+/89216116:09
andrewbogott_Before I start writing patches, I would like someone to read https://storyboard.openstack.org/#!/story/2010784 and confirm or deny that the problem I'm describing is an actual problem. I think in theory I'm supposed to ping gtema with this question but so far haven't had any luck with that so I'd appreciate comments from basically anyone else.16:48
andrewbogott_The short version of that task is: adopting clouds.yaml as the source of auth truth breaks a whole lot of admin-account-based workflows16:48
opendevreviewStephen Finucane proposed openstack/openstacksdk master: docs: Add missing docs for identity resources  https://review.opendev.org/c/openstack/openstacksdk/+/89168217:06
opendevreviewStephen Finucane proposed openstack/openstacksdk master: docs: Add missing docs for compute resources  https://review.opendev.org/c/openstack/openstacksdk/+/89168317:06
opendevreviewStephen Finucane proposed openstack/openstacksdk master: docs: Add missing docs for block storage resources  https://review.opendev.org/c/openstack/openstacksdk/+/89168417:06
opendevreviewStephen Finucane proposed openstack/openstacksdk master: compute: Add missing docstrings  https://review.opendev.org/c/openstack/openstacksdk/+/89168517:06
opendevreviewStephen Finucane proposed openstack/openstacksdk master: block storage: Add missing docstrings  https://review.opendev.org/c/openstack/openstacksdk/+/89168617:06
opendevreviewStephen Finucane proposed openstack/openstacksdk master: baremetal: Add missing docstrings  https://review.opendev.org/c/openstack/openstacksdk/+/89168717:06
opendevreviewStephen Finucane proposed openstack/openstacksdk master: docs: Document various warnings  https://review.opendev.org/c/openstack/openstacksdk/+/89168817:06
opendevreviewStephen Finucane proposed openstack/openstacksdk master: docs: Add exception documentation  https://review.opendev.org/c/openstack/openstacksdk/+/89168917:06
opendevreviewStephen Finucane proposed openstack/openstacksdk master: WIP: tox: Add coverage docs builder  https://review.opendev.org/c/openstack/openstacksdk/+/89169017:06
stephenfingtema: It would be good to get those doc patches in also, but they're not urgent17:08
stephenfinthey are, however, quite useful17:08
stephenfin...if I do say so myself :)17:08
stephenfinandrewbogott_: looking17:08
andrewbogott_thank you!17:08
stephenfinOkay, so suggestion is that environment variables should trump cloud variables. This is complicated because of how much the options can potentially layer over each other17:10
andrewbogott_Can you give me an example?17:10
andrewbogott_(Or, maybe better to discuss on the task)17:10
andrewbogott_mostly I want the --os-<whatever> args to trump, but maybe in code that's the same thing as the env variables17:12
stephenfinauth types would be the first thing that jumps to mind because it's been a source of bugs17:13
andrewbogott_I'm not sure I know what 'auth types' means17:13
stephenfinah, the 'auth_types' setting in cloud.conf / 'OS_AUTH_TYPE' envvar lets us determine which keystone authentication type to use17:14
andrewbogott_you mean like admin/public/internal?17:14
stephenfinv3password, v3token, v3applicationcredential etc.17:14
andrewbogott_oh, I see17:14
stephenfinSetting 'clouds.$cloud.auth_type' completely changes what we look for in 'clouds.$cloud.auth'17:14
stephenfiniirc if it's 'auth_type=v3applicationcredential' but a user sets 'OS_PASSWORD', then we try passing passwords also17:15
andrewbogott_huh... that seems wrong to me but probably you've already had that conversation :)17:16
stephenfinIt is. Unfortunately keystoneauth is a rats nest :)17:16
andrewbogott_That I know from experience17:16
opendevreviewSongSuheon proposed openstack/openstacksdk master: Implement heat 'stack event list'  https://review.opendev.org/c/openstack/openstacksdk/+/89283617:17
stephenfinhowever, that's kind of tangential to what you're asking17:17
andrewbogott_So what instead of saying 'env variables trump clouds variables' we say 'select env variables trump clouds variables'17:17
andrewbogott_and start with project/domain being part of that select17:17
andrewbogott_Sorry, that was confusing, I'll try again:  What if the task is "Allow CLI and env to override the project specified in clouds.yaml"?  That would fix /my/ workflows I think.17:19
andrewbogott_hm. The fact that the same variable OS_PROJECT is used for auth and also used to affect what the command does seems broken either way :(17:20
stephenfinwhat do you mean?17:21
stephenfinbtw, the commands that allow you to specify '--project' rely on server-side support. OSC is merely exposing that. I would guess that those will not be usable by users with standard project-scoped tokens in the future but I can't say for sure17:22
andrewbogott_Eh, I guess that isn't really right, if you don't have auth in a project you shouldn't be able to do things there anyway.17:22
stephenfin'--os-project' is the keystone thing17:23
* andrewbogott_ nods17:23
andrewbogott_sorry, had to answer the phone and got confused :)17:24
opendevreviewSongSuheon proposed openstack/openstacksdk master: Implement heat 'stack event list'  https://review.opendev.org/c/openstack/openstacksdk/+/89283617:24
stephenfinI have no issues with allowing overriding of clouds.yaml config with CLI args and env vars17:24
andrewbogott_But yeah, I realize that the --project thing is only selectively implemented for some commands.17:24
andrewbogott_stephenfin: ok then :)  I will try to write a patch, and see how lost I get.17:25
andrewbogott_Do you think the change should be for /all/ CLI args and env vars, or only for a limited list?17:25
stephenfinI would just ask that we provide a mechanism to disable the env var aspect or set the env var prefix to something other than 'OS_' (if that doesn't exist already)17:25
andrewbogott_hm...17:26
andrewbogott_a mechanism other than "Don't set that in your env if you don't want it in your env"?17:26
gtemaI was thinking quite some time about that. I think what should always win is "--os-XX" argument.17:26
gtemaI would personally even kill the whole env part as such17:26
gtemathis is simply terrible stuff from my pov (OS_CLOUD is the only exception)17:27
stephenfinYes, I know it's ridiculous _but_ we've had bugs in some k8s components because of this (Gophercloud already behaves the way you're suggesting)17:27
* stephenfin gets a link17:27
andrewbogott_Yeah, I agree that ideally clouds.yaml is a full substitute for ready-made env files.  But that might not be a simple migration path.17:27
andrewbogott_Some days you're the guy wishing that there weren't existing silly workflows, and some days you're the guy complaining about your existing silly workflow being broken. I guess today I'm the second guy :(17:28
gtemaheh, maybe. I the guy not using ENVs in OpenStack context at all and happy17:30
andrewbogott_that sounds nice17:30
stephenfinokay, no rational attached but here's on example https://github.com/kubernetes/cloud-provider-openstack/pull/733/files17:32
stephenfinSee the `EnvPrefix` attribute in `pkg/cloudprovider/providers/openstack/openstack.go`17:32
* andrewbogott_ discovers that he can't edit storyboard comments17:33
stephenfingtema: Alas, I am afraid we are stuck with environment variables for the long-term. TripleO still deploys rc files everywhere, and internally I note all our QE and many field engineers still use them17:33
gtemaI know, it is just my opinion that it should have not been existing17:33
stephenfinon that we can agree17:34
stephenfinthe mistakes of (project) youth17:34
gtemabut wrt CPO - another param to disable/enable ENVs sounds even more crazy17:34
gtemalets see whether the new OSC (;-) can get this addressed17:35
andrewbogott_Thank you for your thoughts! I will work on a strawman/minimal patch (assuming that's even possible) and then we can see if we want to get more ambitious.17:35
opendevreviewSuyeon Cha proposed openstack/openstacksdk master: reset_state, force_delete for Share, ShareSnapshot  https://review.opendev.org/c/openstack/openstacksdk/+/88831118:07
opendevreviewArtem Goncharov proposed openstack/openstacksdk master: [WIP] Add OpenAPI invocation interface  https://review.opendev.org/c/openstack/openstacksdk/+/89216118:43
opendevreviewStephen Finucane proposed openstack/openstacksdk master: block storage: Add query string params for many APIs  https://review.opendev.org/c/openstack/openstacksdk/+/89297419:27
opendevreviewPavlo Shchelokovskyy proposed openstack/cliff master: Autofit table output if stdout is a tty  https://review.opendev.org/c/openstack/cliff/+/89299119:42
chris218Hi again so when I try to stop server through conn.compute.start_server(server) it works but when trying to do it with server.start(conn) it errors with AttributeError 'Connection' object has no attribute 'default_microversion'20:37
opendevreviewMerged openstack/openstacksdk master: docs: Add missing docs for identity resources  https://review.opendev.org/c/openstack/openstacksdk/+/89168221:45
opendevreviewMerged openstack/openstacksdk master: docs: Add missing docs for compute resources  https://review.opendev.org/c/openstack/openstacksdk/+/89168321:48
opendevreviewMerged openstack/openstacksdk master: docs: Add missing docs for block storage resources  https://review.opendev.org/c/openstack/openstacksdk/+/89168421:56
chris218also wanted to note that being able to use OpenAPI spec for openstack sounds supper exciting kudos to you guys :)22:15
opendevreviewMerged openstack/openstacksdk master: openstack.format: Remove 'serialize' classmethod  https://review.opendev.org/c/openstack/openstacksdk/+/88998323:15
opendevreviewMerged openstack/openstacksdk master: mypy: Address issues with top-level files  https://review.opendev.org/c/openstack/openstacksdk/+/88998423:15
opendevreviewMerged openstack/openstacksdk master: Run mypy as pre-commit  https://review.opendev.org/c/openstack/openstacksdk/+/88998523:15
opendevreviewMerged openstack/openstacksdk master: block storage: Add query string params for many APIs  https://review.opendev.org/c/openstack/openstacksdk/+/89297423:24
opendevreviewMerged openstack/openstacksdk master: compute: Add missing docstrings  https://review.opendev.org/c/openstack/openstacksdk/+/89168523:24
opendevreviewMerged openstack/openstacksdk master: block storage: Add missing docstrings  https://review.opendev.org/c/openstack/openstacksdk/+/89168623:24
opendevreviewMerged openstack/openstacksdk master: baremetal: Add missing docstrings  https://review.opendev.org/c/openstack/openstacksdk/+/89168723:27
chris218I figured it out!! needed to pass connection.compute instead of just connection23:45

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!