Friday, 2020-07-31

*** senrique_ has quit IRC00:54
*** dave-mccowan has quit IRC03:14
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-sdks04:33
*** slaweq has joined #openstack-sdks07:02
*** nightmare_unreal has joined #openstack-sdks07:16
*** tosky has joined #openstack-sdks07:19
*** ralonsoh has joined #openstack-sdks07:33
*** jpena|off is now known as jpena07:56
*** ianw has quit IRC08:01
*** ianw has joined #openstack-sdks08:02
*** ccamel has joined #openstack-sdks08:02
*** camelCaser has quit IRC08:03
*** stingrayza has quit IRC08:45
*** stingrayza has joined #openstack-sdks08:46
*** yolanda has quit IRC09:06
*** yolanda has joined #openstack-sdks09:16
*** dtantsur|afk is now known as dtantsur09:19
openstackgerritDmitry Tantsur proposed openstack/keystoneauth master: Correct major version discovery for non-keystone plugins  https://review.opendev.org/74328209:32
dtantsurmordred, cmurphy, a short version, also seems to work for us ^^^10:53
*** jpena is now known as jpena|afk10:56
*** jpena|afk is now known as jpena11:20
*** tkajinam has quit IRC11:36
*** jpena is now known as jpena|lunch11:48
*** mgariepy has quit IRC11:52
*** mgariepy has joined #openstack-sdks11:53
*** lbragstad_ has joined #openstack-sdks12:00
*** mgariepy has quit IRC12:01
*** lbragstad has quit IRC12:03
*** mgariepy has joined #openstack-sdks12:15
*** enriquetaso has joined #openstack-sdks12:48
*** nightmare_unreal has quit IRC12:48
*** dave-mccowan has joined #openstack-sdks12:58
*** jpena|lunch is now known as jpena12:59
mordreddtantsur: awesome14:11
*** lbragstad_ is now known as lbragstad14:58
openstackgerritRodolfo Alonso Hernandez proposed openstack/openstacksdk master: Add "numa_affinity_policy" attribute to "port"  https://review.opendev.org/74042215:03
openstackgerritRodolfo Alonso Hernandez proposed openstack/python-openstackclient master: Add NUMA affinity policy parameter to "port"  https://review.opendev.org/74050115:19
*** irclogbot_1 has quit IRC15:56
*** irclogbot_2 has joined #openstack-sdks15:58
*** irclogbot_2 has quit IRC16:15
*** irclogbot_1 has joined #openstack-sdks16:17
dtantsurcmurphy, mordred, thank you for approving https://review.opendev.org/#/c/743282/ ! Would it be possible to have a release in the near future?16:40
cmurphydtantsur: sure, propose it and have knikolla +1 it16:41
dtantsurokie. I'm leaving for a day, so I guess on Monday.16:42
dtantsur(unless it merges really soon)16:42
*** jpena is now known as jpena|off17:01
openstackgerritMerged openstack/openstacksdk master: Add compute microversion 2.6 and 2.8  https://review.opendev.org/74167417:29
openstackgerritMerged openstack/openstacksdk master: baremetal-introspection: allow fetching unprocessed data  https://review.opendev.org/74351717:29
*** dtantsur is now known as dtantsur|afk17:33
*** artom has joined #openstack-sdks17:45
artomo/17:45
artomIn the context of fixing server rebuild parameters and bring them in line with the actual Nova API (https://review.opendev.org/#/c/741688/) - what's the difference between rebuild_server() in openstack/cloud/_compute.py and openstack/compute/v2/_proxy.py?17:46
*** ralonsoh has quit IRC17:52
openstackgerritMerged openstack/keystoneauth master: Correct major version discovery for non-keystone plugins  https://review.opendev.org/74328217:59
mordredartom: openstack/cloud/_compute.py is the layer that used to be shade. it's the layer where we do a bunch of extra business logic for people. If you have a Connection called conn - you'd call that one like conn.rebuild_server - amongst the things it does is hide even which service a particular action comes from (a design that was more important back in the day of nova-image and nova-network alongside glance and neutron)18:19
mordredartom: openstack/compute/v2/_proxy.py is a layer down - we have an eventual goal to have the shade layer use the resource layer instead of making direct rest calls18:20
mordredartom: so - you know - all sorts of good history there :)18:20
artommordred, so no one is expected to call stuff in openstack/compute/v2/_proxy.py directly?18:21
mordredartom: nah - either are actually fine - that both exist is a historical oddity at this point - with a few things we've gotten all the way to the shade layer being just a backwards compat shim over the other layer18:22
mordredI personally just use the shade layer because it's less typing18:22
artommordred, so specifically in my rebuild case, shade doesn't actually call the compute proxy, it does the REST request directly18:23
mordredat one point I was thiking that the proxy/resource layer should be the thing that more closely tracks the rest api and the cloud layer is where we do extra things - but it turns out we have to deviate from the rest api at the proxy/resource layer anyway in many cases, so the distinction is one that I think ultimately is not useful18:24
artomWhich means if I want to "fix" the rebuild_server args, I'd have to add **kwargs there as well, because there's a whole bunch of stuff that's in the API that's currently impossible with shade18:24
mordredyeah - also, wow that's a terrible signature in that rebuild_server call in the sahde layer :(18:25
artomTell me about it :(18:25
mordredI almost think we might be better off making the shade layer use your updated resource layer and just figure out how to make the backwards compat not totally suck. I hate that we called the image parameter image_id though :(18:26
artomAh, I see18:28
artomYeah, that's a really bizarre method signature18:29
artomSome args are for the rebuild itself, others for when you show the server after18:29
artomCan we burn and start over? :)18:29
mordredat least the shade layer requires image as a parameter! ;)18:30
artomHehe, true18:31
artomUgh, I wasn't planning on thinking this much on a Friday afternoon18:31
mordredso - I'm ok with breaking compat in the resource layer for this - like you said the current thing is pretty broken18:31
mordredI think we can do the "update shade layer to use resource layer" as a followon - and we should be able to do it without breaking the shade layer's contract18:32
mordredsince we'll just be adding a **kwargs or something similar18:32
artomShovel down the line, future me can deal with it. I like how you think :)18:32
mordredit'll just be lame that the parameter name is image_id - but if that's the worst thing that happens18:33
mordred(I think we can improve that paramter to take image objects too and just document it - if people don't like the name they can pass it positionally :) )18:33
mordredfuture me is always smarter than today me anyway18:33
artomWords of wisdom right there.18:35
*** dave-mccowan has quit IRC18:46
mordredartom: so - I'm +2 on that once there's a release note - probably with someting in the upgrade section18:51
artommordred, cool, I have that locally, need to fix the test on top of it, then push18:51
mordredcool.18:52
mordredI might take a stab at the shade patch once you do18:52
mordredor I might leave that for tomorrow us18:52
artomHehe18:55
*** efried1 has joined #openstack-sdks19:01
*** efried has quit IRC19:02
*** efried1 is now known as efried19:02
openstackgerritArtom Lifshitz proposed openstack/openstacksdk master: Fix rebuild_server named argument  https://review.opendev.org/74168819:43
openstackgerritArtom Lifshitz proposed openstack/openstacksdk master: Func test for compute microversion 2.9  https://review.opendev.org/74168919:43
*** smcginnis has quit IRC20:12
*** smcginnis has joined #openstack-sdks20:13
mnasermordred: so i think https://github.com/openstack/openstacksdk/commit/75ae5bf4aadedf47e26264f278c19adb64871735 might actually break every single OSA deployment out there :(20:37
mnaserbecause by default the 'supports image import' is always enabled, even when we were deploying via uwsgi20:38
mordredmnaser: well that's bad20:38
mnaserdansmith pushed a patch to 'autodisable' that flag which was sadly -2d20:38
mordredmnaser: well ... we default to false20:38
mordredyou have to opt-in to using import20:38
mnasermordred: https://review.opendev.org/#/c/741497/20:38
mnaseroh?  well20:38
mnaseri'm a little confused then because20:38
mnaserhttps://de5fd82ca097fe66eeac-be64ab2c1211c8399b7ac2efe4751a63.ssl.cf5.rackcdn.com/744212/2/check/openstack-operator:functional/4959c4e/docker/k8s_glance_glance-zsvzl_openstack_71c819a2-2401-44f6-bbd7-6f222940b4c0_0.txt clearly makes /import calls20:39
mnaserhttps://de5fd82ca097fe66eeac-be64ab2c1211c8399b7ac2efe4751a63.ssl.cf5.rackcdn.com/744212/2/check/openstack-operator:functional/4959c4e/job-output.txt but devstack is just doing openstack image create20:39
mordredI mean - it shouldn't use import unless you explicitly request import - because even if it is there based on our discussion it's a less advantageous upload mechanism due to need for local things20:39
mordredhrm20:39
mnaserand --import is not actually being used20:39
mnaserin the cli calls20:40
mnaseri.e. `openstack --os-cloud=devstack-admin --os-region-name=RegionOne image create cirros-0.5.1-x86_64-disk --public --container-format bare --disk-format qcow2 --property hw_rng_model=virtio`20:40
mordredyeah. did we get the osc patch wrong?20:41
mnaserthis is like... weirdly recent20:41
mnaseri dont know what changed..20:41
mordredyeah - I don't see any code that should make that happen20:41
mnasergmann: ^ any ideas?  this just recently surfaced20:42
mnaserand there isnt much merged into osc lately20:42
mnaseror openstacksdk20:42
mnaserand i don't see anything tagged recently?20:42
mordrednope.20:43
mordredand I don't think we have any support to declaring that a cloud wants to default to import in clouds.yaml20:43
mordredmnaser:20:45
mordred        if stores or all_stores or all_stores_must_succeed:20:45
mordred            use_import = True20:45
gmannmnaser: it is enabled with GLANCE_USE_IMPORT_WORKFLOW flag in devstack case and that is false by default20:45
mnasergmann: yeah and in devstack, i don't see it using --import20:45
mnaserbut i think mordred is onto something, we're enabling import if we're specifying a store?20:45
mordredwe have to - apparently you can't specify stores without import20:46
mordredI mean ... I don't see any stores listed in that command20:46
mordredbut maybe osc is passing al_stores by default?20:46
mnaseryeah this is it: openstack --os-cloud=devstack-admin --os-region-name=RegionOne image create cirros-0.5.1-x86_64-disk --public --container-format bare --disk-format qcow2 --property hw_rng_model=virtio20:46
mordrednope - osc doesn't have any support for stores20:47
mnaserhttps://github.com/openstack/python-openstackclient/blob/8aed5feab8a5ae65658ea03fe1f2c238f6ffd908/openstackclient/image/v2/image.py#L399-L40020:47
mnaseryeah20:47
mnaserhttps://github.com/openstack/python-openstackclient/blob/8aed5feab8a5ae65658ea03fe1f2c238f6ffd908/openstackclient/image/v2/image.py#L327-L33420:47
mordredmnaser: dude. that's weird20:47
mnaserdo we have to put a default=false or something?20:47
* mnaser goes to look at other devstack jobs20:48
mnaserand i dont think this has to do with my operator stuff cause the cli invocations dont change20:48
mordredmnaser: zomg, having to put default=False would be super lame20:49
mordredbut - would be the best explanation20:49
mnaserbut normal devstack would have broken then no?20:49
mnaseri think devstack uses uwsgi too20:50
gmannmnaser: is it tempest-ful-py3 based job? becasue i enabled the import in that20:50
mnasergmann: i don't think its based off that BUT searching devstack logs shows `GLANCE_USE_IMPORT_WORKFLOW=False` so20:50
gmannyeah it is parent with devstack-tempest20:51
mnaserwth, a more recent change that ran -- https://review.opendev.org/#/c/668668/ -- did not have the same issue20:52
mnaserthat is 25 hours ago and i've noticed this surfaced very recently20:52
mnaserlike a cople hours ago20:52
mordredmnaser: o_O20:53
mnaserthis change 5 hours ago was ok https://review.opendev.org/#/c/743943/20:56
gmannmnaser: devstack is default to standalone glance (not under uwsgi) and in your jobs also20:56
mnaserah well i run under uwsgi (the devstack portion is largely noop for glance at that point)20:57
mnaserbut even then looking at logs20:57
mnaserits doing post /file20:57
mnaserohhhh20:57
mnaseri wonder if https://review.opendev.org/#/c/743943/3/devstack/lib/glance is the reason20:57
mnaserthis further pushes the theory of enabled_import_methods mattering to the CLI20:58
mordredmnaser: but how?20:59
mnasermordred: AH21:01
mnaserTHE UPLOAD MUST HAVE FAILD!21:01
mnaserand supports_import is still being 'announced'21:01
mordredaroo?21:01
mnaserhttps://opendev.org/openstack/openstacksdk/src/branch/master/openstack/image/v2/_proxy.py#L291-L30121:01
mnaserraise Exception + supports_import=True => runs use_import code21:02
mordredAH21:02
mordredmaybe that's a bad logic21:02
mordredgiven what we've learned I'm thinking that opting in to import should always be conscious now21:02
mnaserLOW AND BEHOLD21:03
mnaserthere is a traceback21:03
mnaserhttps://www.irccloud.com/pastebin/cl6vW461/21:03
mnaseryeah because its possible that you end up in a queued image21:03
mordredmnaser: neat!21:03
mnaserthat will never upoad21:03
mordredyeah21:03
mordredyou wanna remove that logic or want me to?21:04
mnasermordred: could you?  i'm in the middle of six different things21:04
* mnaser was supposed to have had glance ussuri everywhere today21:04
mordredyup21:04
mnaseryeah21:11
gmanndifferent things but we should support other import method (web-dowload or copy-image) also and check it correctly before we calculate supports_import21:11
gmann https://opendev.org/openstack/openstacksdk/src/branch/master/openstack/image/v2/_proxy.py#L28121:11
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Stop falling back to image import  https://review.opendev.org/74425421:12
mordredmnaser: ^^21:12
gmannotherwise it will say not supported if image_import_methods['web-download']21:12
mordredyah21:12
openstackgerritArtom Lifshitz proposed openstack/openstacksdk master: Fix rebuild_server named argument  https://review.opendev.org/74168821:40
openstackgerritArtom Lifshitz proposed openstack/openstacksdk master: Func test for compute microversion 2.9  https://review.opendev.org/74168921:40
openstackgerritArtom Lifshitz proposed openstack/openstacksdk master: compute: give server actions proper microversion support  https://review.opendev.org/74425821:40
artomFuuuun21:43
openstackgerritArtom Lifshitz proposed openstack/openstacksdk master: compute: give server actions proper microversion support  https://review.opendev.org/74425821:44
openstackgerritArtom Lifshitz proposed openstack/openstacksdk master: Fix rebuild_server named argument  https://review.opendev.org/74168821:44
openstackgerritArtom Lifshitz proposed openstack/openstacksdk master: Func test for compute microversion 2.9  https://review.opendev.org/74168921:44
artomAccidentally a word in the commit message21:44
openstackgerritArtom Lifshitz proposed openstack/openstacksdk master: compute: give server actions proper microversion support  https://review.opendev.org/74425821:46
openstackgerritArtom Lifshitz proposed openstack/openstacksdk master: Fix rebuild_server named argument  https://review.opendev.org/74168821:46
openstackgerritArtom Lifshitz proposed openstack/openstacksdk master: Func test for compute microversion 2.9  https://review.opendev.org/74168921:46
*** tosky has quit IRC22:10
*** slaweq has quit IRC22:17
*** slaweq has joined #openstack-sdks22:30
*** enriquetaso has quit IRC23:08

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!