Thursday, 2019-12-12

pmatulisdansmith, yeah, i'm going to change a nova policy to make that available to non-admins00:01
*** zhanglong has joined #openstack-nova00:01
*** slaweq has joined #openstack-nova00:03
*** slaweq has quit IRC00:08
*** slaweq has joined #openstack-nova00:11
*** mriedem has quit IRC00:11
*** jangutter has quit IRC00:13
*** jangutter has joined #openstack-nova00:13
efrieddansmith: here's a weird one: If I shelve my instance, and then my compute goes down, would a subsequent offload "succeed"?00:16
efriedThe virt driver's destroy() would have to happen when the compute came back up later, just like we reap instances that are deleted when their compute is down.00:16
efriedBut do we do that, or do we just fail the offload and ERROR the instance?00:16
*** slaweq has quit IRC00:16
*** tbachman has quit IRC00:16
*** TxGirlGeek has joined #openstack-nova00:18
dansmithefried: offload should succeed when it comes back up, but would fail while the compute is down with just an rpc failure type thing00:28
efriedokay. thanks.00:29
dansmithO dpm00:29
dansmithwow.00:29
dansmithI don't think there's a local delete sort of thing for offload00:29
*** brault has quit IRC00:29
dansmithyeah, there's not00:29
*** brault has joined #openstack-nova00:30
efriedokay.00:30
efrieddansmith: typos courtesy of "shift right"?00:30
dansmithyep00:30
dansmithefried: also, shelve_offload() is a cast, so no error result or moving instance to ERROR if it fails due to a down compute00:30
efriedI use dvorak00:30
efriedso if I shift right, I just look like I'm having a stroke.00:31
dansmithheh00:31
efrieddansmith: that was my next question: offload kinda happens "later" sometimes, right?00:31
efriedso... does it still have the context (auth etc) of the user who did the original shelve?00:31
dansmithit can be requested via the API, or via periodic after a timeout yeah00:32
dansmithefried: no it could be the operator via the API, or no context via periodic00:32
efriedugh00:32
dansmithin fact, I can't think of any reason a regular user would ever manually offload00:32
efriedmake space?00:33
efriedbut anyway, it's another monkey wrench for me.00:33
dansmithshelve is what causes them to start saving money, offload is the cache purge for the operator so something else can go there, but shouldn't really impact the user, other than to make unshelve take longer00:33
*** brinzhang has quit IRC00:33
dansmithright, the user doesn't care to make space, they're already saving the money00:33
efriedoh, yeah, I guess the space is reclaimed at shelve time.00:33
*** brinzhang has joined #openstack-nova00:33
dansmiththe operator might offload a shelved instance to get the space back before the timer00:33
dansmithwell, not really,00:34
efriedshitballs, I need to go back and rewrite this rewrite.00:34
dansmiththe user doesn't get any space (quota) back, but they do get charged less (theoretically)00:34
dansmiththe operator doesn't get space (i.e. room for another instance on that host) until the offload00:34
efriedoh00:35
efriedallocations etc only go away at offload?00:35
dansmithI would think.. the virt driver doesn't know a shelve has happened until the offload00:35
efriedso yeah, that's what I meant by "make space". But again yeah, that's something the operator cares about, not the user.00:35
dansmithright00:35
efriedthe virt driver just gets told to snapshot(). I guess they could figure it out from a task state?00:35
efriedbut yeah, they don't.00:35
dansmithwell, it would be super problematic if they did,00:36
*** brinzhang_ has joined #openstack-nova00:36
efriedWell, on that note...00:36
efriedwhat's the task state during the virt driver's destroy() during the offload?00:36
dansmithbecause the point of the shelved state is that it is still ready to be powered back on, which means that like POWERED_OFF state, it still takes the same amount of resources as ACTIVE00:36
efried(I'm going to have to find out anyway, but if you know off the top...)00:36
dansmithI dunno, but why? the virt driver shouldn't be implying anything from task_state during an op like that00:37
dansmiththe only time virt should ever really look at that stuff is when it's recovering and trying to figure out if something should be deleted or ignored or something like that00:37
efriedI was going to save the vTPM backing file during the offload. But that has to be done by the virt driver, so the virt driver was going to have to have some way of knowing it needed to do that.00:37
efriedBut the fact that the offload is ever (usually) done with no (or admin?) context blows that out of the water.00:38
efriedI'm going to have to do it during shelve.00:38
dansmithtask_state is really a lock for the api and downstream services to avoid taking two simultaneous actions on an instance00:38
dansmiththen you need to tell the virt driver to do it,00:38
*** tbachman has joined #openstack-nova00:38
efriedWhich means similarly the virt driver needs to be able to know it should do that during snapshot00:38
dansmithnot have the virt driver imply that it needs to do it from the state00:38
dansmithbecause, for example, shelve is used under the covers for cross-cell-migration00:38
efriedso add a kwarg to snapshot()?00:38
efriedor a new virt driver method, prep_shelve()?00:39
dansmithyeah, but also, shouldn't that be the job of the compute manager anyway?00:39
dansmithlike "give me the tpm so I can save it for you"00:39
efriedno, can't be.00:39
efriedoh, that could work, yeah.00:39
efriedbut obv we can't have the compute manager knowing libvirt internals00:39
*** brinzhang has quit IRC00:39
efriedi.e. where that file lives.00:40
dansmithno, of course not, but it can ask for the tpm in a portable form00:40
efriedlike... an IMAGE!!! (not)00:40
dansmithor even "give me things I should stash for you during a shelve-like snapshot"00:40
* efried checks the contract for snapshot()'s :return:...00:41
efriedoo, nothing today.00:41
dansmiththen you let compute manager decide whether it is going to save or "lose" those things, because compute manager knows what high-level operation is happening00:41
dansmithvirt does not really00:41
efriedSo could that be a file-like that compute manager is responsible for streaming from?00:42
dansmithand, you let compute manager decide *how* to save those things, instead of teaching every virt driver about all the ways things can be saved (swift, glance, etc)00:42
dansmithefried: I would call it a BytesIO yeah00:43
efriedokay, that can work.00:43
dansmithor IOBase or whatever the right bytes-based primitive is00:43
efriedThat's what I meant: "the appropriate streamable thing that I'm going to have to go learn about cause I clearly don't know it yet"00:44
dansmithBytesIO for your unit test00:44
dansmithfile(name, 'rb') for your libvirt from-file implementation00:45
dansmither, open(name, 'rb')00:45
efriedThat's gonna be a tarball that I need to clean up afterward. How do I do that?00:46
dansmithwhich is an io.BufferedReader00:46
efried(Musing to self)00:46
dansmiththen just spawn tar and read from the tar pipe, don't create it on disk first00:46
efriedI imagine there must be a way to just create the ... yeah, pipe.00:46
dansmithp = subprocess.Popen('tar c - file1 file2', stdout=subprocess.PIPE)00:47
dansmithreturn p.stdout00:47
openstackgerritEric Fried proposed openstack/nova-specs master: Spec: Ussuri: Encrypted Emulated Virtual TPM  https://review.opendev.org/68680400:48
efrieddansmith: thanks for the help, this is gonna make some (more) things easier, again.00:49
efriedor at least simpler00:49
efriedAnd with that, I'm outta here.00:50
efriedo/00:50
*** zhanglong has quit IRC00:55
melwittTheJulia: around?00:55
*** zhanglong has joined #openstack-nova00:57
*** Liang__ has joined #openstack-nova01:01
*** mriedem has joined #openstack-nova01:01
*** mriedem has quit IRC01:01
*** mriedem has joined #openstack-nova01:01
*** abaindur has quit IRC01:05
mriedemefried: fwiw reading scrollback, the libvirt driver does check task_state to flatten rbd images while unshelving i think01:05
*** abaindur has joined #openstack-nova01:06
mriedemhttps://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L924601:06
*** TxGirlGeek has quit IRC01:06
mriedemefried: also btw, immediate shelve offload is the default behavior and there is a context01:06
mriedemthe periodic or shelveOffload api only kick in if you've configured the computes to not immediately offload01:07
*** artom has quit IRC01:07
mriedemhttps://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.shelved_poll_interval01:07
openstackgerritEric Xie proposed openstack/nova master: Report trait 'COMPUTE_IMAGE_TYPE_PLOOP'  https://review.opendev.org/69813201:07
mriedemdansmith: btw, "because, for example, shelve is used under the covers for cross-cell-migration" is not true - it was for the original poc, but not what i have now01:08
mriedemparts are similar though01:08
dansmithmriedem: well, yeah, sorry I'm collapsing shelve-like snapshot behavior into it01:09
dansmithmriedem: and the task_state check down in the rbd stuff is just a total hack, I hope you'd agree01:09
dansmithbecause of the layers of plumbing that would be required01:10
mriedemit is01:10
mriedemwe're the ones that approved it too :)01:11
dansmithmriedem: given that a snapshot for migration would be very shelve-like, but a task-state check for shelving to save the tpm would be the exact kind of guessing the virt driver shouldn't be doing because composite operations on top of the primitives can't rely on predictable behavior01:11
mriedemyup, case in point https://review.opendev.org/#/c/691991/01:12
dansmithvery shelve-like, meaning it would *need* to store the tpm, but wouldn't if the task_state wasn't shelving, so migrations that happened to cross cells would end up with an empty tpm01:12
dansmithwhich is exactly my point01:12
dansmithha yeah01:12
dansmiththis marks my 12th hour behind the keyboard today01:13
* dansmith &01:14
* mriedem thinks of pretzels01:14
*** zhanglong has quit IRC01:16
*** zhanglong has joined #openstack-nova01:21
mriedemdansmith: for tomorrow - a compute rpc api method that didn't return anything but now does - version bump? i would think so at least for the behavior change.01:24
*** zhanglong has quit IRC01:33
openstackgerritMatt Riedemann proposed openstack/nova master: DNM: debug cross-cell resize  https://review.opendev.org/69830401:33
*** mriedem has quit IRC01:40
*** zhanglong has joined #openstack-nova01:40
*** gyee has quit IRC01:45
openstackgerritsean mooney proposed openstack/nova master: Sync ImageMetaPropsPayload fields  https://review.opendev.org/69861301:48
sean-k-mooneygibi: efried ^ wanted to get that done before i went to sleep there are only 3 fields that were missing01:50
sean-k-mooneyanyway night o/01:50
*** larainema has joined #openstack-nova01:57
*** mdbooth has quit IRC02:04
*** Sundar has joined #openstack-nova02:04
*** mdbooth has joined #openstack-nova02:05
*** boxiang has joined #openstack-nova02:06
*** abaindur has quit IRC02:30
pmatuliswhen implementing a policy override does one need to place /etc/nova/policy.json on just a single compute node?02:30
*** mdbooth has quit IRC02:32
*** tbachman has quit IRC02:35
*** zhanglong has quit IRC02:37
melwittpmatulis: not the compute node, the controller (where nova-api process is running)02:45
melwittpolicies are an api thing02:46
pmatulismelwitt, ah ha right02:48
*** tbachman has joined #openstack-nova02:48
*** Sundar49 has joined #openstack-nova02:50
pmatulismelwitt, this works but do you see anything wrong with it?02:54
pmatulishttps://paste.ubuntu.com/p/jcq7znKczd/02:54
pmatulisi left the default as a comment02:54
melwittpmatulis: I think you can't have a comment in a json file (but you said it works?). the new entry looks fine to me02:56
pmatulismelwitt, yeah works :)02:57
*** Dinesh_Bhor has joined #openstack-nova02:58
melwittkewl02:58
*** Sundar49 has left #openstack-nova02:59
*** mkrai has joined #openstack-nova03:00
pmatulismelwitt, so this is odd. i removed /etc/nova/policy.json (it did not exist prior) and now i get error (log: "...stacktrace...cannot find policy.json). i put it back and error goes away03:15
pmatulisconfirm i can just drop a file in w/o stopping the service?03:16
melwittpmatulis: yeah, it shouldn't need it (all defaults are in the code). I would have thought you could drop it without restarting the service but I haven't tried it before. did you have to restart for it to notice it when you added it or no?03:16
melwittwhen you added it the first time I mean03:17
pmatulismelwitt, no, i did not03:19
pmatulisi read that it wasn't necessary03:19
melwittyeah, I do know it tries to read the file each policy check (if it is there) and you are meant to be able to change it on the fly03:20
melwittI don't know why it would error when you remove it. if you pastebin the stacktrace we can at least see where in the code it fails03:21
openstackgerritGuo Jingyu proposed openstack/nova master: Define and catch InstanceAgentNotRunning for set-password failure  https://review.opendev.org/66146603:22
*** psachin has joined #openstack-nova03:35
pmatulismelwitt, http://paste.ubuntu.com/p/YBVThgRWDh/03:38
*** TxGirlGeek has joined #openstack-nova03:43
*** udesale has joined #openstack-nova03:45
melwittah, built in caching in oslo.policy https://github.com/openstack/oslo.policy/blob/master/oslo_policy/policy.py#L548. guess we have a bug, need to handle that somehow in nova03:46
melwittI didn't find a bug already open for this03:46
*** Sundar has left #openstack-nova03:49
melwittopened this https://bugs.launchpad.net/nova/+bug/185611903:53
openstackLaunchpad bug 1856119 in OpenStack Compute (nova) "FileNotFoundError: [Errno 2] No such file or directory: '/etc/nova/policy.json' when policy file removed" [Undecided,New]03:53
pmatulissweet03:54
*** nweinber has joined #openstack-nova04:00
*** bbowen has quit IRC04:09
*** bbowen has joined #openstack-nova04:10
*** bhagyashris has joined #openstack-nova04:22
*** nweinber has quit IRC04:46
*** bhagyashris has quit IRC05:06
*** brault has quit IRC05:13
*** bhagyashris has joined #openstack-nova05:13
*** brault has joined #openstack-nova05:13
*** bbowen has quit IRC05:14
*** bbowen has joined #openstack-nova05:14
*** links has joined #openstack-nova05:41
*** TxGirlGeek has quit IRC05:41
*** tetsuro has quit IRC05:42
*** awalende has joined #openstack-nova05:48
*** awalende has quit IRC05:52
*** tetsuro has joined #openstack-nova05:57
*** damien_r has quit IRC06:16
*** damien_r has joined #openstack-nova06:17
*** pcaruana has joined #openstack-nova06:18
*** mkrai has quit IRC06:23
*** mkrai_ has joined #openstack-nova06:24
*** brinzhang has joined #openstack-nova07:03
*** damien_r has quit IRC07:06
*** brinzhang_ has quit IRC07:06
*** awalende has joined #openstack-nova07:15
*** awalende has quit IRC07:21
*** lpetrut has joined #openstack-nova07:21
*** boxiang has quit IRC07:35
*** bhagyashris has quit IRC07:43
*** maciejjozefczyk has joined #openstack-nova07:47
*** damien_r has joined #openstack-nova07:55
*** tesseract has joined #openstack-nova07:59
*** dpawlik has joined #openstack-nova08:02
*** tkajinam has quit IRC08:04
*** brinzhang_ has joined #openstack-nova08:05
*** brinzhang has quit IRC08:07
gibisean-k-mooney: attaching ports with resource request is still not supported. https://docs.openstack.org/api-guide/compute/port_with_resource_request.html08:10
gibisean-k-mooney: for ussuri on my todolist in priority order: live migration, unshelve, cross cell resize and saying something about heal port allocation CLI usage on Stein with train nova-manage in a venv08:12
*** bhagyashris has joined #openstack-nova08:12
gibisean-k-mooney: so no, I don't have port attach on my ussuri TODO list08:12
*** slaweq has joined #openstack-nova08:15
*** awalende has joined #openstack-nova08:23
*** tosky has joined #openstack-nova08:27
*** mkrai_ has quit IRC08:32
brinzhang_gibi: hello, do you know this spec http://specs.openstack.org/openstack/nova-specs/specs/train/approved/numa-aware-live-migration.html08:32
brinzhang_gibi: I have a question, if the destination server's NUMA topology (e.g. nume_node=2) < source server's NUMA topology (e.g. numa_noed=4) in a instance. If I am living *this* instance, what will be happend?08:35
*** bhagyashris has quit IRC08:36
*** slaweq has quit IRC08:36
brinzhang_gibi: Context in "Proposed change" the "Third" aspect. "Third, information about the instance’s new NUMA characteristics needs to be generated on the destination (an InstanceNUMATopolgy object is not enough, more on that later)"08:36
*** corvus has quit IRC08:40
brinzhang_And efried completed it's status in Train release. notartom works on it.08:41
*** mkrai_ has joined #openstack-nova08:41
*** ralonsoh has joined #openstack-nova08:46
*** ircuser-1 has quit IRC08:56
*** tonyb has quit IRC08:56
*** tonyb has joined #openstack-nova08:56
*** ircuser-1 has joined #openstack-nova08:57
*** slaweq has joined #openstack-nova08:59
*** corvus has joined #openstack-nova08:59
*** rpittau|afk is now known as rpittau09:00
*** martinkennelly has joined #openstack-nova09:08
*** jcosmao has joined #openstack-nova09:08
*** jcosmao has left #openstack-nova09:08
*** dpawlik has quit IRC09:11
*** bhagyashris has joined #openstack-nova09:12
*** dpawlik has joined #openstack-nova09:13
openstackgerritLee Yarwood proposed openstack/nova master: Remove 'nova-xvpvncproxy'  https://review.opendev.org/68790909:13
*** derekh has joined #openstack-nova09:19
*** iurygregory has joined #openstack-nova09:31
*** ccamacho has joined #openstack-nova09:35
stephenfingibi: Morning o/ I've a couple of functional test rework patches here you might be interested in, if you have some free time today https://review.opendev.org/#/c/689181/09:40
*** ccamacho is now known as ccamacho|pto09:48
openstackgerritStephen Finucane proposed openstack/nova master: functional: Add unified '_(build|create)_flavor' helper functions  https://review.opendev.org/69753809:48
openstackgerritStephen Finucane proposed openstack/nova master: functional: Add '_delete_server' to 'InstanceHelperMixin'  https://review.opendev.org/69753909:48
openstackgerritStephen Finucane proposed openstack/nova master: WIP: functional: Add '_create_server' helper  https://review.opendev.org/69754009:48
*** dtantsur|afk is now known as dtantsur09:52
*** martinkennelly has quit IRC10:01
*** Liang__ has quit IRC10:02
*** mmethot has quit IRC10:03
*** mmethot has joined #openstack-nova10:04
openstackgerritMerged openstack/nova master: Add ConfirmResizeTask  https://review.opendev.org/63707010:13
*** mkrai_ has quit IRC10:22
*** martinkennelly has joined #openstack-nova10:26
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove unused 'stub_out_db_network_api'  https://review.opendev.org/69715110:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove db methods for ProviderMethod  https://review.opendev.org/69715010:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Convert remaining unit tests to neutron  https://review.opendev.org/69651010:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove 'is_neutron_security_groups' function  https://review.opendev.org/69651110:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove nova-network security group driver  https://review.opendev.org/69651210:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Correct some broken VIF tests  https://review.opendev.org/69651310:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove firewall support  https://review.opendev.org/69651410:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Copy shared utils from nova-net module  https://review.opendev.org/69651510:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove final references to nova-network  https://review.opendev.org/69651610:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove 'MetadataManager'  https://review.opendev.org/69674810:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Add TODOs to remove security group-related objects  https://review.opendev.org/69651710:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove dependency on nova-net from fake cache  https://review.opendev.org/69674910:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Kill it  https://review.opendev.org/69651810:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove unused exceptions  https://review.opendev.org/69714910:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove unnecessary 'neutronv2' prefixes  https://review.opendev.org/69677610:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Rename 'nova.network.neutronv2' -> 'nova.network'  https://review.opendev.org/69674510:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Make the security group API a module  https://review.opendev.org/69674610:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove remaining nova-network quotas  https://review.opendev.org/69715210:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove use of legacy 'FloatingIP' object  https://review.opendev.org/69715310:29
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove use of legacy 'Network' object  https://review.opendev.org/69715410:29
*** avolkov has joined #openstack-nova10:33
*** mmethot has quit IRC10:34
*** mmethot has joined #openstack-nova10:42
*** larainema has quit IRC10:50
*** salmankhan has joined #openstack-nova10:53
*** salmankhan has joined #openstack-nova10:54
*** rcernin has quit IRC10:56
*** pcaruana has quit IRC11:03
*** pcaruana has joined #openstack-nova11:06
*** dtantsur is now known as dtantsur|brb11:09
*** shilpasd has joined #openstack-nova11:10
*** udesale has quit IRC11:14
gibistephenfin: ack, added to my queue11:16
*** mkrai has joined #openstack-nova11:35
*** dviroel has joined #openstack-nova11:47
*** tbachman has quit IRC11:47
*** mmethot has quit IRC11:52
*** mmethot has joined #openstack-nova11:52
openstackgerritStephen Finucane proposed openstack/nova master: trivial: Remove dead code  https://review.opendev.org/69870311:56
openstackgerritStephen Finucane proposed openstack/nova master: db: Drop cells v1 tables  https://review.opendev.org/69870411:56
openstackgerritStephen Finucane proposed openstack/nova master: db: Drop snapshots table  https://review.opendev.org/69870511:56
openstackgerritStephen Finucane proposed openstack/nova master: db: Drop tables that were moved to API DB  https://review.opendev.org/69870611:56
openstackgerritStephen Finucane proposed openstack/nova master: db: Remove placement tables  https://review.opendev.org/69870711:56
*** mmethot has quit IRC11:58
*** belmoreira has joined #openstack-nova12:02
*** mkrai has quit IRC12:04
*** zhanglong has joined #openstack-nova12:04
*** mkrai_ has joined #openstack-nova12:04
*** nicolasbock has joined #openstack-nova12:06
*** zhanglong has quit IRC12:09
*** mmethot has joined #openstack-nova12:09
*** mgariepy has joined #openstack-nova12:14
*** dpawlik has quit IRC12:22
sean-k-mooneygibi: ok good to know. i need to work on a bug with attch port for numa aware vswitchs12:28
sean-k-mooneygibi: being able to attach an sriov port has been a long standing desire, when i fix the numa awareness checking i might look into sriov and port request since they both would have to check and claim resouces although that will have to wait till febuary for me to figure out.12:30
sean-k-mooneyim planning on spending january finishing the image metatdata prefilter and working on ci so i wont be starting anything new in january12:30
gibisean-k-mooney: ack. if you happen to start port request part of the interface attach, then let me know and I will try to keep a close eye on that commit12:36
sean-k-mooneywell i dont want anything i do to conflcit with your work12:36
sean-k-mooneybut if im working on the attachment code anyway ill take a look and see how invovled it would be to do12:37
gibisean-k-mooney: sthanks12:43
*** dpawlik has joined #openstack-nova12:46
*** mkrai_ has quit IRC12:57
*** dtantsur|brb is now known as dtantsur12:58
*** nweinber has joined #openstack-nova13:07
*** bhagyashris has quit IRC13:08
openstackgerritMerged openstack/nova master: functional: Unify '_wait_until_deleted' implementations  https://review.opendev.org/68918113:11
openstackgerritMerged openstack/nova master: functional: Unify '_build_minimal_create_server_request' implementations  https://review.opendev.org/69502413:11
*** belmorei_ has joined #openstack-nova13:12
*** belmorei_ has quit IRC13:13
*** belmoreira has quit IRC13:13
*** belmoreira has joined #openstack-nova13:13
*** tbachman has joined #openstack-nova13:14
openstackgerritMerged openstack/nova master: functional: Remove 'get_invalid_image'  https://review.opendev.org/69745413:17
*** FlorianFa has joined #openstack-nova13:22
*** mriedem has joined #openstack-nova13:23
*** mmethot has quit IRC13:24
efriedbrinzhang_: That one might be a better question for stephenfin13:29
efriedsince artom doesn't appear to be here?13:29
*** mmethot has joined #openstack-nova13:30
efriedsean-k-mooney: thanks for that sync-up patch, will review today (barring unforseen)13:30
efriedmriedem: ah, gtk about the task_state, I'm going to make use of that.13:31
sean-k-mooneyefried: it has one bug which ill fix shortly. dealing with a customer issue at the momemnt but there were not many filed missing13:32
mriedemefried: in the case of the libvirt driver flattening the image on unshelve it's actually checking the vm_state but similar idea13:32
mriedemand as discussed with dan in here last night it's also a hack13:32
mriedemefried: while you're about, and i know you've got a full plate, but this is a 7 LOC FUP that if you will approve will help unblock several other approved changes in the series https://review.opendev.org/#/c/698028/13:34
efriedmriedem: done.13:36
mriedemthanks13:36
openstackgerritMerged openstack/nova master: functional: Remove 'api' parameter  https://review.opendev.org/69769413:37
*** mkrai has joined #openstack-nova13:42
openstackgerritMatt Riedemann proposed openstack/nova master: DNM: debug cross-cell resize  https://review.opendev.org/69830413:42
*** jangutter has quit IRC13:51
efriedNova meeting in 7 minutes in -meeting13:53
shilpasdefried: (y)13:54
*** pcaruana has quit IRC13:57
*** CeeMac has joined #openstack-nova13:58
*** dpawlik has quit IRC13:58
*** nweinber has quit IRC14:03
*** jangutter has joined #openstack-nova14:05
mriedemstephenfin: do you have a py38 system? https://bugs.launchpad.net/nova/+bug/185549314:05
openstackLaunchpad bug 1855493 in OpenStack Compute (nova) "py38 unit test failure - test_validate_patternProperties_fails" [Undecided,New]14:05
mriedemi know you love bleeding edge fedora14:06
sean-k-mooneykasyap like bleeding edge fedora14:07
sean-k-mooneymriedem: stephenfin and i tend to use an alternitive operating system for dev although i think stephenfin still runs fedora on his laptop14:08
mriedemalternative, like early 90s R.E.M.?14:09
sean-k-mooneythat is one way do describe ubuntu 18.0414:10
sean-k-mooneywhich happens to have python 3.8 in its packages becasue i just installed it14:10
sean-k-mooneyill run the test and see what happens14:11
sean-k-mooneyfrom the bug report it like like this a byte string vs text string issue if im reading that right14:13
shilpasdstephenfin: where i can get team photo during shanghai PTG?14:15
sean-k-mooneymriedem: so yes it fails as reported14:15
sean-k-mooneythere are some other warning too14:16
mriedemshilpasd: there was a link in the ML14:16
shilpasdmriedem: ok, sure will check, thanks14:17
mriedemshilpasd: https://www.dropbox.com/sh/1my6wdtuc1hf58o/AACU49pjWxzFNzcZJgjLG8n1a?dl=014:18
shilpasdmriedem: thanks14:19
luyaostephenfin: Are you around?14:22
gmannmriedem: stephenfin FYI. there is plan to add py38 unit test job in ussuri testing runtime. - https://review.opendev.org/#/c/693401/14:26
gmannthis is hold till V cycle name is decided14:26
luyaosean-k-mooney: could you review vpmem live migration spec if you get time, you are familiar with the  vpmem feature, so do stephenfin, but he seems not here :)  https://review.opendev.org/#/c/695863/14:27
*** pmatulis has left #openstack-nova14:30
luyaostephenfin, sean-k-mooney : FYI.  the spec is short, an initial patch based on spec is also submitted, I has verified its function on hardware env, still need further polishing14:32
stephenfinmriedem: I do. Will try reproduce now14:34
stephenfinluyao: I'll try hit that before EOD14:34
stephenfinshilpasd: You should ask Kendall Nelson but I've forgotten her IRC nick /o\14:35
*** pcaruana has joined #openstack-nova14:36
luyaostephenfin: thanks :D14:36
*** links has quit IRC14:36
efriedstephenfin: it's diablo_rojo. But mriedem found them for shilpasd.14:36
stephenfinefried: whoops, missed that14:37
stephenfincool cool14:37
efriedstephenfin: diablo rojo is spanish for diabhal dearg14:37
efried(how's your gaelic :P)14:37
shilpasdefried: thanks14:37
shilpasdstephenfin: i got it14:38
shilpasdthanks14:38
efriedlyarwood: this is currently the oldest patch on the review dashboard (http://status.openstack.org/reviews/#nova)14:39
efriedhttps://review.opendev.org/#/c/27028914:39
efriedIs it still a thing?14:39
efriedoh, I see you restored it recently, so I guess it must be.14:39
lyarwoodefried: yeah the spec has landed, I was going to ask if I should use a fresh change-id given this is so old and crusty14:39
lyarwoodefried: hopefully pushing things for review later today once I've worked on some issues with the tempest tests14:40
openstackgerritGuo Jingyu proposed openstack/nova master: Make scheduling more debuggable  https://review.opendev.org/69842114:40
efriedlyarwood: is there anything useful in the history?14:40
efriedI assume the rebase will be a train wreck14:40
lyarwoodefried: not really tbh14:40
lyarwoodefried: yeah it was14:40
efriedThen meh, use a new change-id but ref the old one in the commit message14:41
lyarwoodack will do14:41
dansmithmriedem: for sure14:43
dansmithmriedem: theoretically you could handle it in rpcapi but definitely should have a bump imho14:44
openstackgerritBalazs Gibizer proposed openstack/nova master: Move _get_request_group_mapping() to RequestSpec  https://review.opendev.org/69654114:44
openstackgerritBalazs Gibizer proposed openstack/nova master: Move _update_pci_request_spec_with_allocated_interface_name  https://review.opendev.org/69657414:44
openstackgerritBalazs Gibizer proposed openstack/nova master: Support live migration with qos ports  https://review.opendev.org/69590514:46
huaqiangstephenfin: morning14:47
huaqiangstephenfin: for https://review.opendev.org/#/c/668656/, can you make a review when you have time14:48
gibiefried, mriedem: fixed up your comments in the qos live migration series14:48
stephenfinmriedem: Yeah. I can reproduce that too. Will try root out a fix, assuming sean-k-mooney hasn't fixed it yet14:48
sean-k-mooneyluyao: left a few comments but more or less i think the direction of the spec is good. just grabing something to eat so i wont be around for a the next 30 mins or so14:49
mriedemgibi: thanks, much better14:49
sean-k-mooneystephenfin: nope havent started was going to take a look later today but have a few other thing to get done first14:49
*** tbachman has quit IRC14:50
*** davee_ has joined #openstack-nova14:50
luyaosean-k-mooney: thanks for your comments:)14:54
*** ccamacho|pto has quit IRC14:54
openstackgerritStephen Finucane proposed openstack/nova master: Keep pre-commit inline with hacking and fix whitespace  https://review.opendev.org/67405714:56
stephenfinsean-k-mooney: Cool14:57
stephenfinalso, "foo is 'string'" raises a syntax deprecation warning in Python 3, so we should probably merge https://review.opendev.org/#/c/695732/ sooner rather than later14:57
*** nweinber has joined #openstack-nova14:58
huaqiang:xa14:59
*** huaqiang has quit IRC14:59
*** huaqiang has joined #openstack-nova15:00
efriedstephenfin: +215:01
stephenfinta15:02
stephenfinhuaqiang: I've a few other things ahead of it, but I'll try15:02
*** lbragstad has joined #openstack-nova15:04
huaqiangstephenfin: I see. I especially need comments for if we need to create 'mixed' instance through 'resources:PCPU' and 'resources:VCPU' and specifying the count of dedicated vCPU number in flavor/image or using a CPU mask for them15:05
openstackgerritStephen Finucane proposed openstack/nova master: Don't hardcore Python versions in test  https://review.opendev.org/69873215:05
stephenfinefried, mriedem, sean-k-mooney: ^15:05
stephenfinhardcore. FML15:06
efriedlove it15:06
mriedemstephenfin: efried: what's wrong with the dict usage for urlencode here? https://review.opendev.org/#/c/695732/2/nova/tests/unit/api/openstack/compute/test_volumes.py15:06
huaqiangstephenfin: I know we have had some discussion on these two questions, but there are some other opionions on them15:06
efriedmriedem: URLs allow repetition of keys; dicts don't.15:06
efriedmriedem: querystrings are also ordered.15:06
mriedemoh guh15:06
mriedemdidn't even think about the duplicate keys15:06
efriedSo old encoders just kinda went with it15:06
efriedbut good code should be explicit15:07
*** KeithMnemonic has joined #openstack-nova15:07
huaqiangstephenfin: so I want to reach consitency on these two questions.15:07
*** henriqueof has quit IRC15:08
*** henriqueof1 has joined #openstack-nova15:08
KeithMnemonicHello mridem. Do you think there will be any movement on the queens/pike cherry picks of your "marker" fix? https://review.opendev.org/#/c/690725/2. I know those are EOL but since the patches were created was not sure if you thought they could still get in?15:08
KeithMnemonicargh mriedem:15:09
awalendeAnyone knows what nova-compute wants to tell me when trying to attach a volume to a new instance on a freshly deployed ubuntu 18.04 compute node?: unable to execute QEMU command 'device_add': Property 'virtio-blk-device.drive' can't find value 'drive-virtio-disk1'15:09
*** dtantsur is now known as dtantsur|brb15:10
mriedemKeithMnemonic: you have to ask stable cores15:11
KeithMnemonicok thanks15:11
mriedemthose branches aren't EOL either,15:11
mriedemthey are EM = extended maintenance15:11
mriedemhttps://review.opendev.org/#/admin/groups/540,members15:11
*** jangutter has quit IRC15:15
*** artom has joined #openstack-nova15:15
openstackgerritStephen Finucane proposed openstack/nova master: Don't hardcore Python versions in test  https://review.opendev.org/69873215:15
KeithMnemonicmriedem is there a preferred way to ping the "stable cores"15:15
efriedstephenfin: I thought you were going to fix that commit title?15:16
KeithMnemonicshould i attend the next IRC meeting?15:16
openstackgerritBalazs Gibizer proposed openstack/nova master: Use reasonable name for provider mapping  https://review.opendev.org/69873515:16
openstackgerritStephen Finucane proposed openstack/nova master: Don't hardcode Python versions in test  https://review.opendev.org/69873215:16
efriedKeithMnemonic: you might be waiting a while. bauzas dansmith melwitt lyarwood15:16
stephenfinefried: yeah, done15:16
efriedstephenfin: though I rather liked it the way it was before.15:16
*** huaqiang is now known as huaqiang_15:17
* stephenfin had an unrelated patch on master and wanted to rebase to avoid the dependency on said patch15:17
efriedah15:17
dansmithKeithMnemonic: I've reviewed the other backports of this15:17
dansmithmriedem: any concern about the queens one to keep me from slamming this?15:18
mriedemstephenfin: "hardcore"15:18
mriedemfilthy15:18
KeithMnemonicthanks efried:15:18
efriedyahyoubetcha15:18
*** tbachman has joined #openstack-nova15:18
mriedemIntel OpenStack CI is failing on merge conflicts - it must be patching something into the CI15:20
mriedemisn't that the one asking for vpmem live migration support?15:21
stephenfinmriedem: Can you restore this for me? https://review.opendev.org/#/c/685756/15:21
efriedluyao: ---^15:21
mriedemstephenfin: done15:21
stephenfin(Gerrit won't let me backport the fixes otherwise)15:21
stephenfinta15:21
openstackgerritStephen Finucane proposed openstack/nova stable/train: Also enable iommu for virtio controllers and video in libvirt  https://review.opendev.org/68575615:21
openstackgerritStephen Finucane proposed openstack/nova stable/train: Switch to uses_virtio to enable iommu driver for AMD SEV  https://review.opendev.org/69873815:21
openstackgerritStephen Finucane proposed openstack/nova stable/train: Create a controller for qga when SEV is used  https://review.opendev.org/69873915:21
mriedemdansmith: when is the last time we actually dropped old tables? https://review.opendev.org/#/q/topic:db-cleanup+(status:open+OR+status:merged)15:23
bbobrovoh nice15:23
dansmithtables?15:23
bbobrovso we backport the fixes to train15:23
dansmithnever?15:23
mriedemthat's what i thought15:23
stephenfinbbobrov: You mean you (SUSE) have done it already15:23
stephenfindansmith: You sit on a throne of LIES15:23
stephenfinSearch for 'assertTableNotExists'15:25
mriedemi guess there are some old migrations that dropped really old tables15:25
stephenfinin 'nova/tests/unit/db/test_migrations.py'15:25
mriedem232, 23315:25
dansmithmriedem: what were the tables?15:25
stephenfin34615:25
stephenfinhttps://review.opendev.org/#/c/698705/1/nova/tests/unit/db/test_migrations.py@23415:25
mriedemdump_*, compute_node_stats, instance_group_metadata15:25
mriedemiscsi_targets, volumes15:26
mriedem292 was the most recent table drop migration15:26
dansmithoh, gosh of course, from glance and cinder splits15:26
mriedemhttps://review.opendev.org/#/c/166214/ being the most recent15:26
dansmithstephenfin: 346 was a column15:26
*** tbachman has quit IRC15:26
mriedemliberty, 201515:27
stephenfinah, that explains why it told me I wasn't allowed drop a column when I was dropping a table. Same heuristic, I guess15:27
mriedemthe wild west of yore15:27
stephenfinI assume there's a reason not to drop tables?15:28
dansmithmriedem: liberty was the 292?15:28
mriedemdansmith: yeah15:28
dansmithmriedem: if so, those tables must've been unused for longer than that15:28
stephenfinThe big scary comments say don't do it but not why15:28
mriedemdansmith: likely since grizzly/folsom after the cinder split15:28
dansmithstephenfin: for the same reasons as not dropping columns, but if the code is gone it's different15:29
dansmithstephenfin: so the only thing that worries me is doing the models and the migrations at the same time15:29
dansmithi.e. I worry about applying the migrations from U to T at runtime (which we should be able to do) and then introspection being mad15:30
mriedemhttps://review.opendev.org/#/c/698705/ (snapshots table) should have likely gone with the 292 migration since it's related to volume snapshots15:30
dansmithstephenfin: so if you can do the migrations first and the model drops after and not have anything complain, that'd be a good test15:30
stephenfinI'll give that a lash15:31
stephenfinNeed some TLC anyway, clearly15:31
stephenfin*needs15:31
mriedemstephenfin: in case you're taking notes, quota tables are in the api db too https://review.opendev.org/#/c/698706/115:31
dansmithstephenfin: also, I know you're just going for stats, but there's no reason to add a bunch of new migrations each to drop a thing15:31
dansmithstephenfin: so, it'd be better if you put the drops all in one patch ahead of these, and then you can remove the models character by character in the following patches if you want15:31
dansmitheach migration slows down the process of building the schema on a new machine15:32
*** dave-mccowan has joined #openstack-nova15:32
stephenfinKewl. I was trying to separate them logically15:32
stephenfindidn't think about perf15:32
stephenfindo we need to still care about placement-related tables?15:33
*** bhagyashris has joined #openstack-nova15:33
stephenfini.e. will the separate placement service ever use nova's DB?15:33
dansmithwell, I was going to say no,15:33
dansmithbut... people could easily have just pointed placement at nova and kept going, until some point15:34
dansmithhas placement had a db migration since they left?15:34
mriedemthe cutover was stein, you'd use the nova api db during the upgrade, but yeah..that15:34
mriedemi think so15:34
dansmitheither way, probably worth a healthy warning15:34
mriedemplacement added a couple of blocker migrations15:35
dansmithand tbh, if we're being very responsible, we might want a nova-manage delete-old-placement-stuff, which empties the tables and then drop the tables in the next release, contingent on them being empty15:35
stephenfinyour call15:35
TheJuliamelwitt: to your cpu arch question, I suspect you can rip out shipping the cpu arch from nova to ironic. Most of the code seems to rely upon stated properties of the machine's cpuarch and not the instance_info's cpu arch which makes sense from a deployment standpoint.15:36
TheJuliamelwitt: worth trying and making sure ironic doesn't explode with a test change?15:36
mriedemdansmith: and what happens if someone doesn't run delete-old-placement-stuff? does the drop migration in V become a blocker migration until delete-old-placement-stuff is run?15:36
dansmithmriedem: yeah, the drop just fails because we check for emptiness and raise15:37
mriedemand is delete-old-placement-stuff checking for anything or just deleting records?15:37
dansmithmriedem: no, just deleting.. figure if you're running a command like that you're opting in15:37
mriedemso it's purely a signal to say yes i've migrated the placement tables from nova_api to placement back in stein (or whenever i upgraded) and i'm good to go,15:38
mriedemand if not, i can't get to V15:38
dansmithright15:40
dansmithwe could just nuke and drop and say "well, you should have known"15:40
mriedemand in V+3 releases someone will be like, "wtf bro!"15:40
dansmithbut given the original prescription was to use this db as the way to migrate, it'd be super easy for people to have not moved15:40
mriedemthough thankfully you can rebuild the basic placement db stuff pretty easily as long as you're not using qos ports of cyborg thingies15:41
mriedem*or cyborg thingies15:41
mriedem...or blazar...15:41
mriedemor whatever VIO hacks into it for out of tree unicorns15:42
mriedemit's all very stable15:42
openstackgerritStephen Finucane proposed openstack/nova stable/train: Revert "docs: Highlight the current broken state of SEV" (partially)  https://review.opendev.org/69874615:43
*** TxGirlGeek has joined #openstack-nova15:45
mriedemTheJulia: while you're about, i've marked this as incomplete but does it make any sense to you? https://bugs.launchpad.net/nova/+bug/185338915:49
openstackLaunchpad bug 1853389 in OpenStack Compute (nova) "The ipv6 address in network_data.json within configdrive is wrong when using IronicDriver to deploy BM" [Undecided,Incomplete] - Assigned to Eric Lei (leiyashuai)15:49
mriedemok i guess they call https://docs.openstack.org/api-ref/baremetal/#attach-a-vif-to-a-node while creating a server15:51
mriedemi'd think ironic would disallow attaching a vif while a node is being provisioned15:51
mriedemoh i can't add ironic to this....storyboard15:51
*** dtantsur|brb is now known as dtantsur15:52
*** bhagyashris_ has joined #openstack-nova15:54
*** bhagyashris has quit IRC15:55
*** Sundar has joined #openstack-nova15:55
mriedemeandersson: i've left some comments in https://bugs.launchpad.net/nova/+bug/1854992 but marked it incomplete15:58
openstackLaunchpad bug 1854992 in OpenStack Compute (nova) "Frequent instances stuck in BUILD with no apparent failure" [Undecided,Incomplete]15:58
mriedemit's not clear to me what you think nova could do besides changing rpc casts to calls and i'm not sure what that would help if rabbit is dead15:58
*** davee__ has joined #openstack-nova15:58
mriedeme.g. let's say rabbit is f'ed and the compute gets an error back, it needs to use rabbit to update the instance status to ERROR, so you have a chicken and egg problem15:58
*** bhagyashris_ has quit IRC15:59
mriedemif it's conductor that notices it has direct access to the db so then we could update, but i don't think we're going to be changing the build_and_run_instances cast to a call...15:59
mriedemdansmith: maybe you have ideas ^15:59
mriedemconductor could grow a threaded poll per instance that's building or something with a hard timeout? idk16:00
dansmithconductor should definitely not imply some instance state like that16:00
dansmithif rabbit is effed then all bets are off16:01
*** mlavalle has joined #openstack-nova16:01
sean-k-mooneymriedem: woudl a reset-state command not just update the statis in the db. i did not think that need to do an rpc to set the instance state16:01
mriedemright any attempts here seem like hacks16:01
mriedemreset state from the api is direct to the db16:01
mriedemso yeah you can reset the state to error or just delete the instance16:01
mriedembut they want the instances to automatically go to error when rabbit is down16:01
sean-k-mooneyya so woudl that not bypass your chicken and egg problem16:01
mriedemor at least have nova log something16:02
sean-k-mooneyoh right16:02
mriedemsean-k-mooney: the admin would still have to manually do the needful16:02
sean-k-mooneydid i look at this last week. i this for blizzard?16:02
mriedemthey could have an external background service/script/whatever that polls the servers that are building and if they pass some timeout they just reset to error or nuke them and try again16:02
mriedemyes16:03
*** maciejjozefczyk has quit IRC16:03
sean-k-mooneyok so we were talking about the mandatory flag for rabbitmq16:03
mriedemif rabbit is dead b/c it can't keep up though, constantly hammering it is probably not the solution16:03
sean-k-mooneyright so the mandatory flag woudl raise an error on our side if we could not enqueue the packet which woudl allows us to detect the failure and then either retry with a different host if rabbit was up but the compute node queue was not found or error16:04
dansmithtrying to work around dead rabbit is like saying nova should be able to do something smart if the db is down16:04
sean-k-mooneydansmith: right but there are cases where rabbit is fine but the compute agent topic queue is not present16:05
*** gyee has joined #openstack-nova16:05
dansmithsean-k-mooney: how is that not a rabbit failure?16:05
mriedemdansmith: hear me out, if the db is down, auto switch to etcd and then when the db is back up, just like merge all the etcd stuff back into mysql16:05
dansmithI don't mean a failure where we can point to rabbit as the sole responsible party, but for something that causes us to not be able to use rabbit for whatever reason16:06
dansmithmriedem: obviously that's the proper solution16:06
mriedem\o/16:06
mriedemnow we're cooking with robusto!16:06
sean-k-mooneydansmith: it has to do with how oslo.messaging works. if rabbit dide or was restarted the way we curretly do a retry of sending the message to rabbit will recreate teh connection to the exchange but not the topic queue16:07
sean-k-mooneyso when the compute agent reconnect it does not always recreate it queue16:07
sean-k-mooneyyou can fix it by restarting the compute agent16:07
dansmithsean-k-mooney: I'm all for fixing bugs in oslo.messaging, but that has nothing to do with us trying to hack around a stuck instance state16:07
*** dave-mccowan has quit IRC16:07
sean-k-mooneythe mandaotry flag woudl allow the conductor to detect that the queue was not present and we could make the compute node as down16:07
dansmithjesus lord, pelase no16:08
sean-k-mooneydansmith: https://bugs.launchpad.net/oslo.messaging/+bug/166151016:08
openstackLaunchpad bug 1661510 in oslo.messaging "topic_send may loss messages if the queue not exists" [Medium,In progress] - Assigned to Gabriele Santomaggio (gsantomaggio)16:08
sean-k-mooneydansmith: well we dont have to mark it as down but it would be nice to at least log the fact16:08
dansmithrabbit  has split brain, one conductor thinks the compute queue is gone, and starts marking computes down?16:08
sean-k-mooneyya marking as down is proably an over reaction16:09
dansmithlog what we know, not what we guess.. so sure, "hmm, seems like there should be a compute queue here..."16:09
sean-k-mooneyanyway the oslo change have merged but we are not using them in nova yet16:11
*** irclogbot_1 has quit IRC16:14
*** irclogbot_2 has joined #openstack-nova16:15
*** lbragstad has quit IRC16:16
*** tbachman has joined #openstack-nova16:17
*** tbachman_ has joined #openstack-nova16:19
*** tbachman has quit IRC16:21
*** tbachman_ is now known as tbachman16:21
mriedemoof https://review.opendev.org/#/c/697694/ ruins my life16:27
gibithere is no progress without pain ;)16:29
mriedemyeah yeah16:30
gibiI will feel the pain when I have to backport functional tests16:30
mriedemthis is the cross cell thing, so no pain for you there16:30
mriedembut i've got a lot of patches to sift through and update16:30
gibiyeah I figured out that you now have a nice big merge conflict16:31
efrieddansmith: we finally got a grenade fail here https://review.opendev.org/69240216:31
efriedIt was my magic touch16:31
mriedemgibi: the merge conflict is trivial, it's the behavior/interface change16:31
efried(hopefully it was for the issue we care about)16:31
melwittsean-k-mooney: I read the backscroll about the rabbit thing and I'm wondering, was there not a way that oslo.messaging could have recreated the missing queue? I wonder why restarting our service is the only way?16:33
mriedemgibi: after https://review.opendev.org/#/c/695905/ isn't there supposed to be a patch to enable live migration with qos ports in the api?16:34
mriedemwith a release note and docs update and such?16:35
*** lbragstad has joined #openstack-nova16:35
mriedemoh nvm i see, "subsequent patches will add support for migration with target host and other edge case like reschedule."16:35
gibimriedem: that patch only supporst the happy path. I'm working on the re-schedule cases16:35
mriedemack16:35
gibimriedem: yeah16:35
gibistay tuned :)16:35
sean-k-mooneymelwitt: it proably could although we coudl also proably try to do it if we got the error that it was not deliverable16:36
sean-k-mooneymelwitt: i think they would prefer if we as the client of oslo.messaging did that since they dont want to assume it is correct16:36
dansmithefried: okay, did you look for any juiciness?16:37
dansmithefried: I can try to look through there later, but I barely even remember what the deal was16:38
*** damien_r has quit IRC16:38
*** Sundar has quit IRC16:38
efrieddansmith: I didn't look at all, just continue to be very interested in making that f'in bug go away.16:38
efriedbut I never really understood the original issue, so not sure it would do anybody much good for me to dig.16:38
*** TxGirlGeek has quit IRC16:45
*** tesseract has quit IRC16:48
openstackgerritEric Fried proposed openstack/nova-specs master: Spec: Ussuri: Encrypted Emulated Virtual TPM  https://review.opendev.org/68680416:52
*** TxGirlGeek has joined #openstack-nova16:52
efriedstephenfin, gibi: That's ready for your (hopefully final) nod ^16:53
gibiefried: ack16:53
stephenfincool16:53
efriedThis iteration is simpler in terms of weirdnesses16:53
efriedand fleshes out some of the interplay necessary for object store16:53
efriedjroll: ^16:53
efriedTxGirlGeek: Spec: Ussuri: Encrypted Emulated Virtual TPM  https://review.opendev.org/68680416:53
*** bhagyashris has joined #openstack-nova16:55
TxGirlGeek@efried Check17:00
*** Sundar has joined #openstack-nova17:01
*** lpetrut has quit IRC17:07
*** lpetrut has joined #openstack-nova17:08
* efried back in ~3h17:08
*** efried is now known as efried_afk17:08
*** ociuhandu has joined #openstack-nova17:10
*** ociuhandu has quit IRC17:10
*** ociuhandu has joined #openstack-nova17:10
*** iurygregory has quit IRC17:11
*** peeejayz has joined #openstack-nova17:12
mriedemstephenfin: so your change to _build_minimal_create_server_request17:13
mriedemto remove the API that's passed in,17:13
mriedemthat's a problem for any testing doing multi-tenant testing17:13
mriedemlike https://review.opendev.org/#/c/697331/4/nova/tests/functional/test_scheduler.py17:13
mriedem*any test17:13
mriedemso to avoid temporarily mutating the self.api in these types of tests we're going to have to add an api kwarg or something17:14
stephenfinI thought I did, no?17:14
stephenfinlooking17:14
mriedemnope https://review.opendev.org/#/c/697694/1/nova/tests/functional/integrated_helpers.py@a9817:15
stephenfinokay, that's a good point. Can you -1 that and I'll respin with the api parameter17:16
stephenfinI had it for some of the helpers to deal with that but clearly missed this one17:16
stephenfin*missed some17:16
mriedemsame https://review.opendev.org/#/c/694179/2/nova/tests/functional/test_external_networks.py17:17
mriedemyour change is merged,17:17
mriedemwhich is why i'm in rebase hell17:17
mriedemi'll add it when i move onto reworking one of these17:18
mriedemhttps://review.opendev.org/#/q/path:%255Enova/tests/functional/.*+status:open+owner:self+branch:master :(17:18
mriedemi guess that won't work for others...17:18
mriedemthere we go https://review.opendev.org/#/q/path:%255Enova/tests/functional/.*+status:open+owner:mriedem+branch:master17:18
stephenfin /o\ sorry17:19
stephenfinyou're gonna hate https://review.opendev.org/#/c/697537/ so17:19
stephenfinI can respin those for you, if you want17:19
stephenfinseeing as I broke em17:19
mriedemi'll do it17:19
mriedemi realize to make an omelette you have to break a few eggs17:19
mriedembut these are my faberge eggs17:20
*** lpetrut has quit IRC17:20
*** pmatulis has joined #openstack-nova17:25
pmatulishow do i know what command will provide a known attribute, such as 'OS-EXT-SRV-ATTR:kernel_id'? the 'server show' command does not show this17:26
mriedemyou're likely not using a high enough microversion17:27
mriedemyou need >= 2.3 for that17:28
mriedemopenstack --os-compute-api-version 2.3 server show <server>17:28
mriedemhttps://docs.openstack.org/api-ref/compute/?expanded=show-server-details-detail#show-server-details17:28
mriedemtells you the response params and required min versions17:28
*** peeejayz has quit IRC17:29
pmatulismriedem, wow ok, i've never encountered that option before. thank you17:30
*** sapd1 has joined #openstack-nova17:30
melwittTheJulia: sorry, what did you mean about the cpu_arch? it17:30
*** iurygregory has joined #openstack-nova17:32
melwittTheJulia: *it's the opposite, we take the cpu_arch from the ironic node properties to use as an advertised capability of a compute, for scheduling. what is the correct thing for us to do if an ironic node has _no_ cpu_arch in it's node properties? today we are advertising no cpu_arch in that case, which means any glance image with arch specified will not match an arch-less host17:32
sean-k-mooneymelwitt: do you need a filter to get that behavior?17:34
melwittsean-k-mooney: yeah it's the ImagePropertiesFilter17:34
sean-k-mooneyoh i assumeed the computecapablitys filter17:34
melwittwhich is enabled by default17:34
sean-k-mooneythe reason i was asking is that shoudl move to placemnt at some point17:35
sean-k-mooneycpu architure is the perfect thing to model as a trait17:35
melwittI'm having a really hard time finding out what we should do in the case when an ironic node has no cpu_arch specified in it17:35
sean-k-mooneywell if the value is not set in the hoststate object we could just allow the host17:36
melwittwe've been doing the "no match" thing forever, since the ironic driver code was first added. but recently it seems to be a problem17:36
sean-k-mooneyit may fail but if we dont have the info we cant really do the right thing either way17:36
melwittyeah, that's what I was wondering if we should use arch.ALL if there's nothing in the ironic node17:36
*** KeithMnemonic has quit IRC17:36
sean-k-mooneywell maybe a .ANY would be better17:36
sean-k-mooneyits a arch is a feild object  so .ALL would be the list of all arches17:37
*** dtantsur is now known as dtantsur|afk17:37
melwittI thought that's how we would get an "any" behavior is by saying "this node supports all archs"17:37
*** ociuhandu has quit IRC17:37
sean-k-mooneyyes but .ALL is a list not a singel value17:38
sean-k-mooneyso the types would not match17:38
sean-k-mooneywell maybe not https://github.com/openstack/nova/blob/master/nova/objects/fields.py#L17217:39
*** ociuhandu has joined #openstack-nova17:39
melwittI was thinking that based on this https://github.com/openstack/nova/blob/master/nova/scheduler/filters/image_props_filter.py#L48 but maybe I'm missing something17:40
sean-k-mooneylook like . all is https://github.com/openstack/nova/blob/master/nova/virt/arch.py#L5717:40
*** salmankhan has quit IRC17:42
sean-k-mooney yes so that function just returns a single value17:42
sean-k-mooneyi think17:43
*** bhagyashris has quit IRC17:43
sean-k-mooneyoh no you are right17:44
sean-k-mooneyits arch.ALL https://github.com/openstack/nova/blob/master/nova/conf/scheduler.py#L552-L56617:44
melwittno, I think you're right. it's choices=arch.ALL so you have to pick one17:44
sean-k-mooneyoh yes17:44
sean-k-mooneyits choice not default17:44
melwittyou have to set the default, there's no default. which confused me xD17:45
sean-k-mooneyya me too, so looking at how its used https://github.com/openstack/nova/blob/master/nova/scheduler/filters/image_props_filter.py#L52-L5417:45
sean-k-mooneyif you dont set the config option and its not in the image image_arch will be teh empty stirng or None so it will be Falsy17:46
melwittthe thing that's bugging me is, the glance images must have arch set in this NoValidHost case. and I was thinking, if you want anything to match, shouldn't you just not put arch on the glance image props? but I don't know that much about glance images and whether or not that is thing that could make sense17:46
sean-k-mooneyand we would bailout on line 6417:46
*** ociuhandu has quit IRC17:46
*** ociuhandu has joined #openstack-nova17:46
sean-k-mooneymelwitt: although perhaps that is being done automatically by inspection of the image17:47
sean-k-mooneyi think with the new image import workflow in glance you can have hooks to add metadta automatically17:47
sean-k-mooneyso maybe that is what is happening17:47
melwittohhh.. hm17:47
sean-k-mooneyi dont know if that is one of the things that can be set by the way17:48
sean-k-mooneyits just a guess17:48
melwittdownstream they were saying that in queens this same scenario worked fine and starting in rocky it fails17:48
*** rpittau is now known as rpittau|afk17:49
melwittand I don't find anything changed in the code in like 5 years. so it feels like it has to be a difference in the image props17:49
stephenfinlyarwood: It's late now, but think you could hit [1] tomorrow? [1] https://review.opendev.org/#/q/topic:bp/amd-sev-libvirt-support+(status:open+OR+status:merged)+branch:stable/train17:49
lyarwoodstephenfin: yeah, I might even hit it tonight while watching the results come in.17:49
sean-k-mooneymelwitt: ya do you know what code path they are hitting is it the return False on line 75 or 10417:50
sean-k-mooneymelwitt: i assume 75?17:50
melwittsean-k-mooney: no I don't. I'd have to see if the sosreport is still around to look17:51
*** lbragstad has quit IRC17:52
melwitt(if debug logging is enabled)17:52
sean-k-mooneywell from inspection if the image had an arch request and the ironci node did not have detail i think it would fail as written17:52
sean-k-mooneyremoving the metadata form the image should work if they do not set the config option17:53
sean-k-mooneybut im kind of wondering if https://github.com/openstack/nova/blob/master/nova/scheduler/filters/image_props_filter.py#L75 shoudl be configurable17:53
melwittthat was my conclusion as well. but I don't have an answer yet about what is going on with the images they're using17:53
melwittconfigurable ... I don't like the sound of that.17:55
sean-k-mooneymelwitt: i was thinking a workaround config option for backports only17:56
*** ircuser-1 has quit IRC17:56
sean-k-mooneyincase they need the arch for some other reason to be set in the image17:56
sean-k-mooneybut i think the correct thing to do would be for them to update the ironic nodes with the arch in that case17:57
sean-k-mooneyan arm image wont work on an x86 host after all so really we should always know the arch of a compute node17:58
dansmithstephenfin: I might have gotten out of sync, but .. is the qga thing just "also broken" in addition to the scsi device one?17:58
*** ircuser-1 has joined #openstack-nova17:58
melwittsean-k-mooney: yeah ... I don't really get the use case. it's a scsi deploy and they say it's single arch so for simplicity they don't want to specify the arch17:59
*** TxGirlGeek has quit IRC17:59
melwittand apparently they used to be able to prior to rocky, which I don't know how that's possible unless the images had no arch metadata before18:00
sean-k-mooneyya i think that is the most likely reason18:00
*** derekh is now known as derekh_afk18:00
dansmithokay I see the qga was in the original note about being broken too, I had just always thought it was the virtio-scsi thing that was the big deal18:00
sean-k-mooneyim just going to check my local openstack install18:01
sean-k-mooneyvirtio scisi virtio gpu and qga18:01
stephenfindansmith: Yeah, it was multiple things18:02
sean-k-mooneybut yes all virtio devices just need the iommu driver opt and they orginally missed a few18:02
dansmithstephenfin: yeah I see now18:02
sean-k-mooneythose patches all meged this moring right18:02
stephenfincool18:02
sean-k-mooneymelwitt: i just checked my home deployment and by default it looks like the arch does not get added18:03
sean-k-mooneymelwitt: glance is added os_hash_value and os_hash_algo by default now18:03
melwittsean-k-mooney: arch does not get added to images automatically you're saying?18:04
sean-k-mooneycorrect, so its doing some things on import by default but adding the arch is not one of them18:04
sean-k-mooneyyou might be able to confgiure it but that does not seem to be the defualt upstream behavior18:05
melwittgah, I wonder what happened then18:05
melwittthe bug was opened several months ago but was already marked Triaged so we didn't see it until recently. gonna be hard to get answers this far later18:06
sean-k-mooneyso i was assuming that it might be somethin like https://docs.openstack.org/glance/latest/admin/interoperable-image-import.html#the-image-property-injection-plugin18:07
*** pmatulis has left #openstack-nova18:08
sean-k-mooneybut they would have had to enable it and specyif the arch18:08
*** psachin has quit IRC18:09
sean-k-mooneyi dont see one that use libguestfs or soemthing else to inspec the image and add things like teh arch but it might exists18:09
*** awalende_ has joined #openstack-nova18:09
*** martinkennelly has quit IRC18:09
sean-k-mooneythe plugin interfce was added so operators could do things like that or scan for vulnerablity on import ectra18:09
sean-k-mooneybut its much simpler to assume a human did it18:10
*** mkrai has quit IRC18:12
*** awalende has quit IRC18:13
*** awalende_ has quit IRC18:13
*** awalende has joined #openstack-nova18:14
*** awalende has quit IRC18:15
*** awalende has joined #openstack-nova18:15
*** aloga has quit IRC18:15
*** awalende has quit IRC18:20
*** igordc has joined #openstack-nova18:21
openstackgerritGhanshyam Mann proposed openstack/nova master: Pass the target in os-services APIs policy  https://review.opendev.org/67668818:22
*** ralonsoh has quit IRC18:24
*** ociuhandu has quit IRC18:25
*** ociuhandu has joined #openstack-nova18:26
dansmithmriedem: yesterday I asked if there was anything worrying about this queens version such that I shouldn't just fast approve: https://review.opendev.org/#/c/690725/218:28
*** TxGirlGeek has joined #openstack-nova18:30
*** ociuhandu has quit IRC18:31
mriedemthere is a test below it which needed a simple mod, but the change linked there doesn't have merge conflicts so i don't think so18:33
mriedemwould have been nice for KeithMnemonic, who has been asking for reviews on these backports for weeks, to have actually reviewed them himself18:33
mriedemdansmith: unrelated, but i'd like your 2nd opinion on https://review.opendev.org/#/c/696574/10/nova/objects/instance.py@123918:34
mriedemit's a refactor but i'm not sure i'm comfortable with where the method is moving *to*18:34
mriedemnote that "NeutronFixture sugar" is what i add to my xmas cookies to give them a little something extra18:38
*** awalende has joined #openstack-nova18:38
dansmithmriedem: commented18:39
mriedemthanks18:41
*** awalende has quit IRC18:43
sean-k-mooneyefried_afk: gibi stephenfin will ye be able to review https://review.opendev.org/#/c/674072/17 today or tomorrow. artom will likely take this over form me after that as ill be gone.18:46
sean-k-mooneyor ill pick it back up in the new year but it would be cool to wrap that up before i go on PTO18:47
*** ociuhandu has joined #openstack-nova18:49
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in Admin Action API policies  https://review.opendev.org/67668218:49
*** ociuhandu has quit IRC18:51
gmannjohnthetubaguy: ^^ trying without deprecating the rule which should fail the project admin token tests which is why i thought of deprecating the rule. I might not be understanding your comment clearly but I will read it again with fresh mind.18:52
*** gmann is now known as gmann_afk18:53
mriedemhaleyb: do you think there is anything for nova to do with this? https://bugs.launchpad.net/nova/+bug/182748918:55
openstackLaunchpad bug 1827489 in neutron "Wrong IPV6 address provided by openstack server create" [Low,In progress] - Assigned to Brian Haley (brian-haley)18:55
*** ociuhandu has joined #openstack-nova18:59
openstackgerritsean mooney proposed openstack/nova master: Sync ImageMetaPropsPayload fields  https://review.opendev.org/69861318:59
haleybmriedem: no, it's really a config issue in the guest19:00
sean-k-mooneymriedem: this seam ver config specific. when you enable ipv6 in neutron you have several option includign stateful dhcp619:00
sean-k-mooneyi use dhcp6 for my home cluster and the ip that my vms get are not related to the back at all as far as i can see19:01
mriedemok, invalidated, thanks19:02
sean-k-mooney*mac19:03
*** ociuhandu has quit IRC19:03
openstackgerritStephen Finucane proposed openstack/nova master: db: Drop tables for removed services, features  https://review.opendev.org/69870619:07
openstackgerritStephen Finucane proposed openstack/nova master: WIP: db: Remove placement tables  https://review.opendev.org/69870719:07
openstackgerritMatt Riedemann proposed openstack/nova master: Follow up to I5b9d41ef34385689d8da9b3962a1eac759eddf6a  https://review.opendev.org/69802819:08
openstackgerritMatt Riedemann proposed openstack/nova master: Add confirm_snapshot_based_resize conductor RPC method  https://review.opendev.org/63707519:08
openstackgerritMatt Riedemann proposed openstack/nova master: Confirm cross-cell resize from the API  https://review.opendev.org/63731619:08
openstackgerritMatt Riedemann proposed openstack/nova master: Add revert_snapshot_based_resize_at_dest compute method  https://review.opendev.org/63763019:08
openstackgerritMatt Riedemann proposed openstack/nova master: Deal with cross-cell resize in _remove_deleted_instances_allocations  https://review.opendev.org/63945319:08
openstackgerritMatt Riedemann proposed openstack/nova master: Add finish_revert_snapshot_based_resize_at_source compute method  https://review.opendev.org/63764719:08
openstackgerritMatt Riedemann proposed openstack/nova master: Add RevertResizeTask  https://review.opendev.org/63804619:08
openstackgerritMatt Riedemann proposed openstack/nova master: Flesh out RevertResizeTask.rollback  https://review.opendev.org/69533419:08
openstackgerritMatt Riedemann proposed openstack/nova master: Add revert_snapshot_based_resize conductor RPC method  https://review.opendev.org/63804719:08
openstackgerritMatt Riedemann proposed openstack/nova master: Revert cross-cell resize from the API  https://review.opendev.org/63804819:08
openstackgerritMatt Riedemann proposed openstack/nova master: Add functional cross-cell revert test with detached volume  https://review.opendev.org/69533519:08
openstackgerritMatt Riedemann proposed openstack/nova master: Confirm cross-cell resize while deleting a server  https://review.opendev.org/63826819:08
openstackgerritMatt Riedemann proposed openstack/nova master: Add archive_deleted_rows wrinkle to cross-cell functional test  https://review.opendev.org/65165019:08
openstackgerritMatt Riedemann proposed openstack/nova master: Add CrossCellWeigher  https://review.opendev.org/61435319:08
openstackgerritMatt Riedemann proposed openstack/nova master: Add test_resize_cross_cell_weigher_filtered_to_target_cell_by_spec  https://review.opendev.org/69533619:08
openstackgerritMatt Riedemann proposed openstack/nova master: Add functional test for anti-affinity cross-cell migration  https://review.opendev.org/66185919:08
openstackgerritMatt Riedemann proposed openstack/nova master: Support cross-cell moves in external_instance_event  https://review.opendev.org/65847819:08
openstackgerritMatt Riedemann proposed openstack/nova master: libvirt: flatten rbd image during cross-cell move spawn at dest  https://review.opendev.org/69199119:08
*** mgariepy has quit IRC19:08
stephenfinThanks for the reviews, dansmith19:09
stephenfinsean-k-mooney: I can take a look tomorrow, sure (y)19:09
*** ociuhandu has joined #openstack-nova19:09
dansmithstephenfin: -1ing the fsck out of that right now19:09
stephenfinI was talking about the backports :D19:10
stephenfinbut do your worst19:10
stephenfinI like the pain19:10
* stephenfin -> 🏠19:10
dansmithah, well, then, sure :)19:10
mriedemthat doesn't render for me but i hope it's a studded paddle19:10
sean-k-mooneyit is not :( its a boaring house19:12
mriedemstephenfin: when you're back about, i had to rebase https://review.opendev.org/#/c/637316/ because of the great api-removeninig of 2019 in the functional tests so can you re-approve that when you get a chance19:13
dansmithwhat is a boaring house?19:14
mriedemsomething that elon musk created19:14
dansmithsome sort of pig farming facility?19:14
*** ociuhandu has quit IRC19:14
sean-k-mooney:) you know what i ment19:14
dansmithI don't, but I didn't see whatever he was referring to19:15
sean-k-mooneystephens unicode house  🏠19:15
* dansmith is totes confused19:16
sean-k-mooneywhich you proably didnt also see there because i just copy pasted it19:16
dansmithI see the house, I just don't know what a boaring house is..or what a studded paddle has to do with it19:16
dansmithbut whatevs19:16
mriedemstephen said he liked the pain,19:17
mriedemi made an S&M joke19:17
mriedemand now we're here19:17
dansmithand a boaring house is like a S&M dungeon?19:17
sean-k-mooneyno its just me misspelling boring19:17
dansmithoh19:18
mriedemalternative to me waiting for stephen or the gib in the morning to re-approve, if someone else wants to eyeball PS56 to PS57 here and confirm that the only things i changed are what i called out https://review.opendev.org/#/c/637316/57 i'll re-approve and unblock the other 4 or so approved changes after that in the gate19:18
mriedemsince it takes a couple of days to merge code i'd like to start the recheck bus now19:19
*** ganso has quit IRC19:19
dansmith57 was just changes due to rebase?19:20
mriedemyes19:21
sean-k-mooneyim looking at it now so far it looks identical19:21
mriedemcaused by this https://review.opendev.org/#/c/697694/119:21
*** tosky has quit IRC19:21
*** iurygregory has quit IRC19:22
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: Add --instance option to heal_allocations  https://review.opendev.org/69852919:22
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: Add BFV wrinkle to TestNovaManagePlacementHealAllocations  https://review.opendev.org/69853119:22
*** iurygregory has joined #openstack-nova19:23
sean-k-mooneymriedem: ya so i dont see any change other then the ones you noted19:24
mriedemack thanks sean-k-mooney and dansmith19:24
mriedembottom 6 cross-cell changes are on their way which is nice19:25
sean-k-mooneyyep it is19:25
sean-k-mooneyok im goign to get dinner and likely call it a day. o/19:27
openstackgerritMatt Riedemann proposed openstack/nova master: Do not reschedule on ExternalNetworkAttachForbidden  https://review.opendev.org/69417919:28
*** ociuhandu has joined #openstack-nova19:30
*** artom has quit IRC19:30
openstackgerritMatt Riedemann proposed openstack/nova master: Create instance action when burying in cell0  https://review.opendev.org/69416519:30
*** ociuhandu has quit IRC19:34
*** efried_afk is now known as efried19:38
efriedsean-k-mooney: I'll try to get to it in the next couple hours.19:38
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Add NodeOwnerFilter  https://review.opendev.org/69733119:38
*** mmethot has quit IRC19:40
mriedemdansmith: in order to avoid a compute service version check workaround thing, what do you think about just checking for vcenter here in U and remove in V? https://review.opendev.org/#/c/695220/3/nova/compute/api.py@388119:44
dansmithmriedem: seriously?19:44
mriedemwon't work for any out of tree cluster driver that supports same-host cold migration but....so what?19:44
mriedemwell, what's the alternative? get the compute service version and if old, fallback to existing behavior?19:45
mriedemthat was my original thought19:45
dansmithI definitely don't want to start a trend of putting virt-specific hacks into upper layers19:45
mriedemok so do what i have documented there as the todo19:45
mriedemcheck service versoin, if old fallback to use the config19:46
mriedemremove that in V19:46
dansmithyes19:46
mriedemalright then19:46
* mriedem slinks away in shame19:46
dansmithas you should19:46
dansmithlet it be remembered for all time, the last thing mriedem tried to do was an api-level hack for vmware19:47
* mriedem borrows the paddle19:47
dansmithcan you self paddle?19:47
mriedemcan a bear shit in the woods?19:47
dansmithnevermind, don't answer19:47
dansmithheh19:47
sean-k-mooneyhehe if only this was archive publicly for al time20:00
sean-k-mooney*all20:00
*** ganso has joined #openstack-nova20:08
*** iurygregory has quit IRC20:08
*** KeithMnemonic has joined #openstack-nova20:09
*** tbachman has quit IRC20:11
KeithMnemonicmriedem do you have a few to help me with a different marker issue. this one is in master as well and easily reproducible20:11
KeithMnemonicnot sure if it is just how horizon handles it or is it something in nova. under instances, there is not a prev/next button that came from this patch https://review.opendev.org/#/c/498018/3420:12
KeithMnemonics/not/now20:12
KeithMnemonicso that patch added a prev button, prior there was only next. but if you jump forward and back a few times you see it does not work as expected20:13
KeithMnemonicseems to be due to the original list is not sorted or the sort is not maintained after doing 'next' than 'prev'20:14
KeithMnemonicfor example i have 5 instances test-1 through test-5.  i set the "items per page" under admin settings to 220:15
KeithMnemonicif i jump fresh to instances i see test-5, test-4, if i click next i get test-2, test-1. if i click prev, i get test test-3 and test-120:17
KeithMnemonicso horizon is using marker= and prev_marker= and that seems to not work well20:17
KeithMnemonichas anyone else seen this?20:18
mriedemprev_marker isn't a thing in nova20:18
KeithMnemonicso something horizon bonked?20:18
mriedemmaybe they aren't providing the full query params to maintain a consistent sort order, i.e. not passing the sort_key/sort_dir params when paging?20:18
*** pcaruana has quit IRC20:19
*** abaindur has joined #openstack-nova20:21
KeithMnemoniccould be maybe somewhere in here https://opendev.org/openstack/horizon/src/branch/master/horizon/tables/base.py#L69920:23
*** abaindur has quit IRC20:24
*** abaindur has joined #openstack-nova20:24
mriedemidk20:25
*** abaindur has quit IRC20:25
mriedemdon't really have time to dig into that20:25
*** abaindur has joined #openstack-nova20:25
KeithMnemonicno problem let me go bother horizon, thanks for confirming20:26
mriedembut it does look like they are losing the sort key/dir20:26
*** belmoreira has quit IRC20:27
efriedsean-k-mooney: https://review.opendev.org/#/c/674072/ +A, nice work on those tests. (See inline though.)20:29
mriedema couple of low-hanging bugs if someone wants something to play with20:31
mriedemhttps://bugs.launchpad.net/nova/+bug/185624120:31
openstackLaunchpad bug 1856241 in OpenStack Compute (nova) "Compute API in nova - servers_links should link to paging doc" [Undecided,New]20:31
mriedemhttps://bugs.launchpad.net/nova/+bug/185624020:31
openstackLaunchpad bug 1856240 in OpenStack Compute (nova) "wait_for_versioned_notifications gives unhelpful error message "ValueError: Not a text type application/octet-stream" on timeout" [Undecided,Confirmed]20:31
*** abaindur has quit IRC20:41
*** abaindur has joined #openstack-nova20:42
*** abaindur has quit IRC20:44
*** lvbin01 has quit IRC20:47
*** lvbin01 has joined #openstack-nova20:47
*** derekh_afk has quit IRC20:48
*** damien_r has joined #openstack-nova20:53
jrollmelwitt: re https://bugzilla.redhat.com/show_bug.cgi?id=1688838 - I feel like cpu_arch used to be required, but not 100%. looks like we intentionally made it not required here, at least: https://review.opendev.org/#/c/620634/20:57
openstackbugzilla.redhat.com bug 1688838 in openstack-nova "Ironic should not treat cpu_arch as mandatory" [Medium,New] - Assigned to mwitt20:57
*** damien_r has quit IRC20:59
*** damien_r has joined #openstack-nova20:59
openstackgerritEric Fried proposed openstack/nova master: DRY: Build ImageMetaPropsPayload from ImageMetaProps  https://review.opendev.org/69880320:59
efrieddansmith: question in here ^ for you20:59
efriedsean-k-mooney: that ^ passes tests :)21:00
dansmithefried: if the question is whether they need to be instances or classes, they need to be the former21:01
dansmiththe instance is what contains things like nullable=, default=, etc21:02
dansmithand just because those don't have any of those set (currently) doesn't affect what the rest of the code is expecting21:02
efriedThe question is whether they need to be discrete instances for every field of every object, or whether I could just copy in the instances from the other class.21:02
efriedlike, could I theoretically do this:21:03
efriedf = IntegerField()21:03
efriedclass MyObj(...):21:03
efried   fields = {21:03
efried       int1: f,21:03
efried       int2: f,21:03
efried   }21:03
dansmithoh, well, I'll have to go look,21:03
dansmithbut the convention is obviously for each to be new21:03
dansmithI can't remember if we stash any object-specific state in the field21:04
efriedOkay. Then prolly leave the code as it is now21:04
efriedthanks21:05
openstackgerritEric Fried proposed openstack/nova master: DRY: Build ImageMetaPropsPayload from ImageMetaProps  https://review.opendev.org/69880321:06
efrieddone, and changed the TODO to a NOTE21:06
*** ganso has quit IRC21:09
*** ircuser-1 is now known as netlensbot21:24
sean-k-mooneyefried: oh i forgot the has. i just ran the test i added21:27
sean-k-mooney*hash21:27
*** netlensbot is now known as ircuser-121:28
*** tbachman has joined #openstack-nova21:28
efriedsean-k-mooney: yahbut, see my fup21:28
efriedwas going to say maybe you want to squash; but really they are quite different things, so let's keep them separate.21:28
efriedplus I don't want to lose the ability to +2 yours :P21:28
sean-k-mooneyyep i did i was wondering about that21:29
sean-k-mooneyif we do the follow up then we might as well nuke the object21:29
sean-k-mooneywell21:29
sean-k-mooneywe could replace the ImageMetaPayload  'properties': fields.ObjectField('ImageMetaPropsPayload') definition21:31
sean-k-mooneywith another filed that just reference the other object21:32
melwittjroll: thanks. I'm trying to figure out what's the correct thing to do in the nova ironic driver if ironic is not filling in a cpu_arch in a node. should we choose a default arch to report for ironic scheduling? if so, how should we choose it? a new config option? those are the kind of questions I'm trying to find answers about21:32
*** lvbin02 has joined #openstack-nova21:33
sean-k-mooneyefried: ok just read your comments on the patch below. ill create a fup to add the last combination and move the comments to doc strings afat i fix the Sync patch21:35
sean-k-mooneyand ya the ddt module is really nice to use. ill try to use it more often when it makes sense21:35
*** lvbin01 has quit IRC21:36
*** lvbin02 is now known as lvbin0121:36
efriedsean-k-mooney: ++21:37
efriedsean-k-mooney: Reasons not to nuke the object: it would make version boundaries weird; and I'm not sure what happens with SCHEMA.21:38
efriedIt may be possible. But I'd leave it up to gibi21:38
sean-k-mooneywell with your follow up patch every time we add a filed to the normal nova object the notificaiton object fileds and schema will auto update chaning the hash21:39
sean-k-mooneyso if we apply that patch we need to rememebr to bump the notificion object version and document the new filed even though we are not modifying the class21:40
efriedohhh, good point, the version. That needs a -1.21:40
sean-k-mooneythat is still less work then today however. ya i can put that in a review comment21:40
efriedYeah, we at least need to make a note in the class with that instruction.21:41
efriedthe test will fail, but you could get around it by just updating the hash without bumping the version.21:41
sean-k-mooneyyep21:41
efriedan astute reviewer ought to notice, but...21:41
jrollmelwitt: it feels like it should be a required field for an ironic node21:42
jrollthere's no way to guess at it21:42
*** eharney has quit IRC21:43
*** ircuser-1 is now known as chasmo_21:52
sean-k-mooneyjroll: the cpu architecture21:56
sean-k-mooneyya i mean some hyperisors can emulate other archs but that is kind of true for all virt drivers21:57
*** dviroel has quit IRC21:58
mriedemironic != hypervisor22:00
sean-k-mooneyalso true22:00
*** dosaboy has quit IRC22:01
sean-k-mooneyi was makeing the point that most of the virt driver only support one archtecture at a time so you amost always want to know the cpu architecture if you care about check the image for compatablity22:01
*** TxGirlGeek has quit IRC22:03
sean-k-mooneythere was that project denvor chip that nviad wanted to make but then never closed the license agreement with intel for x8622:03
*** TxGirlGeek has joined #openstack-nova22:04
sean-k-mooneyiwas going to be an arm architecture chip with native traslation of x86 to arm opcode in hardware allowing them to run code comiled for either achtecture22:04
sean-k-mooneyim sure that would have been a pain to debug but it would have been cool if it ever worked22:05
*** henriqueof1 has quit IRC22:08
openstackgerritsean mooney proposed openstack/nova master: Sync ImageMetaPropsPayload fields  https://review.opendev.org/69861322:11
*** awalende has joined #openstack-nova22:15
openstackgerritMatt Riedemann proposed openstack/nova master: Use COMPUTE_SAME_HOST_COLD_MIGRATE trait during migrate  https://review.opendev.org/69522022:15
*** awalende has quit IRC22:20
sean-k-mooneyefried: actully my brain has already switched off today so ill do the FUP tomorrow the other FUP i promised is https://review.opendev.org/#/c/698260/ but there is no really rush with reviewing that22:23
efriedack22:24
openstackgerritMerged openstack/nova master: trivial: Resolve (most) flake8 3.x issues  https://review.opendev.org/69573222:24
*** gmann_afk is now known as gmann22:29
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Add NodeOwnerFilter  https://review.opendev.org/69733122:41
openstackgerritMatt Riedemann proposed openstack/nova master: Allow overriding self.api in _build_minimal_create_server_request  https://review.opendev.org/69881322:41
*** nweinber has quit IRC22:51
openstackgerritMerged openstack/nova master: Don't hardcode Python versions in test  https://review.opendev.org/69873222:51
*** mriedem is now known as mriedem_away23:01
*** tkajinam has joined #openstack-nova23:06
*** mriedem_away has quit IRC23:10
*** chasmo_ has quit IRC23:10
*** mriedem has joined #openstack-nova23:11
*** irclogbot_2 has quit IRC23:11
*** irclogbot_0 has joined #openstack-nova23:12
*** TxGirlGeek has quit IRC23:14
*** ircuser-1 has joined #openstack-nova23:15
*** dosaboy has joined #openstack-nova23:23
*** dosaboy has quit IRC23:29
*** slaweq has quit IRC23:30
*** slaweq has joined #openstack-nova23:35
openstackgerritMerged openstack/nova master: Keep pre-commit inline with hacking and fix whitespace  https://review.opendev.org/67405723:39
openstackgerritMerged openstack/nova stable/queens: Add functional regression test for bug 1849409  https://review.opendev.org/69072423:42
openstackbug 1849409 in OpenStack Compute (nova) queens "openstack server list --deleted --limit -1 hangs" [High,In progress] https://launchpad.net/bugs/1849409 - Assigned to Matt Riedemann (mriedem)23:42
*** nicolasbock has quit IRC23:42
*** tbachman has quit IRC23:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!