| *** ivve has quit IRC | 00:00 | |
| *** macz has quit IRC | 00:04 | |
| *** luksky has quit IRC | 00:04 | |
| *** kisahm has quit IRC | 00:05 | |
| *** takashin has quit IRC | 00:15 | |
| *** gyee has quit IRC | 00:27 | |
| *** JamesBenson has joined #openstack-nova | 00:28 | |
| *** TxGirlGeek has quit IRC | 00:30 | |
| *** JamesBenson has quit IRC | 00:33 | |
| *** slaweq has joined #openstack-nova | 00:36 | |
| *** slaweq_ has joined #openstack-nova | 00:42 | |
| *** slaweq has quit IRC | 00:43 | |
| donnyd | sean-k-mooney: ioni Would love to see some action in the LXC department. LXC is A awesome and B super useful and C much lighter weight than a full vm... but I also understand it will take a bit to get there | 00:44 |
|---|---|---|
| donnyd | Happy to anything I can to help move the ball forward on it | 00:44 |
| *** slaweq_ is now known as slaweq | 00:49 | |
| *** takashin has joined #openstack-nova | 00:50 | |
| *** ricolin has joined #openstack-nova | 01:01 | |
| *** takashin has quit IRC | 01:15 | |
| *** spatel has joined #openstack-nova | 01:18 | |
| *** maciejjozefczyk has joined #openstack-nova | 01:20 | |
| *** artom has quit IRC | 01:21 | |
| *** spatel has quit IRC | 01:22 | |
| *** slaweq has quit IRC | 01:22 | |
| *** bnemec has quit IRC | 01:23 | |
| *** slaweq has joined #openstack-nova | 01:24 | |
| *** xek has quit IRC | 01:32 | |
| *** mdbooth has joined #openstack-nova | 01:35 | |
| *** spsurya has joined #openstack-nova | 01:36 | |
| openstackgerrit | Merged openstack/nova stable/train: Revert "openstack server create" to "nova boot" in nova docs https://review.opendev.org/693241 | 01:54 |
| *** dave-mccowan has joined #openstack-nova | 02:03 | |
| *** bnemec has joined #openstack-nova | 02:04 | |
| *** dave-mccowan has quit IRC | 02:04 | |
| *** mdbooth has quit IRC | 02:16 | |
| *** dave-mccowan has joined #openstack-nova | 02:19 | |
| *** abaindur has quit IRC | 02:22 | |
| *** mdbooth has joined #openstack-nova | 02:23 | |
| *** macz has joined #openstack-nova | 02:28 | |
| *** bnemec has quit IRC | 02:30 | |
| *** macz has quit IRC | 02:30 | |
| *** bnemec has joined #openstack-nova | 02:41 | |
| *** bnemec has quit IRC | 02:46 | |
| *** mdbooth has quit IRC | 02:47 | |
| *** mkrai has joined #openstack-nova | 02:47 | |
| *** macz has joined #openstack-nova | 02:48 | |
| *** macz has quit IRC | 02:52 | |
| *** mdbooth has joined #openstack-nova | 02:54 | |
| *** takashin has joined #openstack-nova | 02:58 | |
| *** dave-mccowan has quit IRC | 03:01 | |
| *** davee__ has joined #openstack-nova | 03:05 | |
| openstackgerrit | Merged openstack/nova master: Improve error log when snapshot fails https://review.opendev.org/356020 | 03:07 |
| *** antonym has quit IRC | 03:09 | |
| *** antonym has joined #openstack-nova | 03:11 | |
| *** ileixe has quit IRC | 03:13 | |
| *** psachin has joined #openstack-nova | 03:14 | |
| *** ileixe has joined #openstack-nova | 03:14 | |
| *** ileixe has quit IRC | 03:15 | |
| *** ileixe has joined #openstack-nova | 03:20 | |
| *** nicholas has quit IRC | 03:27 | |
| *** tkajinam has joined #openstack-nova | 03:29 | |
| *** bhagyashris has joined #openstack-nova | 03:33 | |
| *** udesale has joined #openstack-nova | 03:33 | |
| *** bnemec has joined #openstack-nova | 03:38 | |
| *** ileixe has quit IRC | 03:46 | |
| *** dviroel has quit IRC | 04:04 | |
| *** mkrai has quit IRC | 04:11 | |
| *** mkrai has joined #openstack-nova | 04:11 | |
| *** udesale has quit IRC | 04:11 | |
| *** udesale has joined #openstack-nova | 04:12 | |
| *** bnemec has quit IRC | 04:14 | |
| *** bnemec has joined #openstack-nova | 04:16 | |
| *** udesale has quit IRC | 04:17 | |
| *** udesale has joined #openstack-nova | 04:18 | |
| *** udesale has quit IRC | 04:21 | |
| *** ileixe has joined #openstack-nova | 04:21 | |
| *** udesale has joined #openstack-nova | 04:22 | |
| *** ricolin has quit IRC | 04:25 | |
| *** udesale has quit IRC | 04:26 | |
| *** bnemec has quit IRC | 04:27 | |
| *** maciejjozefczyk has quit IRC | 04:31 | |
| *** slaweq has quit IRC | 04:35 | |
| *** mdbooth has quit IRC | 04:35 | |
| *** tkajinam has quit IRC | 04:37 | |
| *** ileixe has quit IRC | 04:52 | |
| *** abhishekk has joined #openstack-nova | 04:53 | |
| *** slaweq has joined #openstack-nova | 05:02 | |
| *** JamesBenson has joined #openstack-nova | 05:12 | |
| *** JamesBenson has quit IRC | 05:16 | |
| *** mdbooth has joined #openstack-nova | 05:21 | |
| *** takashin has quit IRC | 05:30 | |
| *** bhagyashris has quit IRC | 05:32 | |
| *** slaweq has quit IRC | 05:32 | |
| *** tkajinam has joined #openstack-nova | 05:34 | |
| *** slaweq has joined #openstack-nova | 05:34 | |
| *** mdbooth has quit IRC | 05:40 | |
| *** maciejjozefczyk has joined #openstack-nova | 05:40 | |
| *** mdbooth has joined #openstack-nova | 05:42 | |
| *** mdbooth_ has joined #openstack-nova | 05:43 | |
| *** mdbooth has quit IRC | 05:47 | |
| *** Xuchu has joined #openstack-nova | 05:48 | |
| *** macz has joined #openstack-nova | 05:49 | |
| *** abhishekk has quit IRC | 05:51 | |
| *** pcaruana has joined #openstack-nova | 05:53 | |
| *** macz has quit IRC | 05:54 | |
| *** ratailor has joined #openstack-nova | 05:55 | |
| *** links has joined #openstack-nova | 05:56 | |
| *** macz has joined #openstack-nova | 06:09 | |
| *** takashin has joined #openstack-nova | 06:11 | |
| *** macz has quit IRC | 06:14 | |
| *** mdbooth has joined #openstack-nova | 06:14 | |
| *** mdbooth_ has quit IRC | 06:17 | |
| *** ricolin has joined #openstack-nova | 06:36 | |
| *** mkrai has quit IRC | 06:46 | |
| *** bhagyashris has joined #openstack-nova | 06:47 | |
| *** sapd1_x has joined #openstack-nova | 06:51 | |
| *** rcernin has quit IRC | 07:01 | |
| *** takashin has left #openstack-nova | 07:01 | |
| *** tssurya has joined #openstack-nova | 07:02 | |
| *** mdbooth has quit IRC | 07:02 | |
| *** dpawlik has joined #openstack-nova | 07:03 | |
| *** mdbooth has joined #openstack-nova | 07:03 | |
| *** dpawlik has quit IRC | 07:10 | |
| *** mkrai has joined #openstack-nova | 07:21 | |
| *** maciejjozefczyk has quit IRC | 07:28 | |
| *** jawad_axd has joined #openstack-nova | 07:28 | |
| *** Xuchu has quit IRC | 07:31 | |
| *** Xuchu has joined #openstack-nova | 07:31 | |
| *** brault has joined #openstack-nova | 07:33 | |
| *** ricolin has quit IRC | 07:37 | |
| *** dpawlik has joined #openstack-nova | 07:38 | |
| *** ralonsoh has joined #openstack-nova | 07:39 | |
| *** ricolin has joined #openstack-nova | 07:39 | |
| *** ricolin_ has joined #openstack-nova | 07:43 | |
| *** luksky has joined #openstack-nova | 07:44 | |
| *** ricolin has quit IRC | 07:46 | |
| *** maciejjozefczyk has joined #openstack-nova | 07:47 | |
| openstackgerrit | Merged openstack/nova master: Remove unused 'nova-dsvm-base' job https://review.opendev.org/688389 | 07:47 |
| *** tesseract has joined #openstack-nova | 07:52 | |
| *** tssurya has quit IRC | 07:52 | |
| *** tssurya has joined #openstack-nova | 07:53 | |
| openstackgerrit | Merged openstack/nova master: cleanup to objects.fields https://review.opendev.org/688600 | 07:54 |
| *** ricolin_ has quit IRC | 07:58 | |
| *** damien_r has joined #openstack-nova | 07:58 | |
| openstackgerrit | Adit Sarfaty proposed openstack/nova master: Avoid fetching metadata when no subnets found https://review.opendev.org/679247 | 08:00 |
| gibi_ptg | #nova now Cinder cross project at Cinder's table | 08:01 |
| mnaser | mdbooth: feel free to ping me if you end up starting to discuss the flavors thing today | 08:01 |
| *** mdbooth has quit IRC | 08:04 | |
| gibi_ptg | mnaser: I will try not to forget to ping you | 08:04 |
| mnaser | gibi_ptg: thanks, do you think it might be today or is it likely going tobe moved onto tomorrow? | 08:04 |
| *** tssurya has quit IRC | 08:05 | |
| *** sapd1_x has quit IRC | 08:06 | |
| *** mdbooth has joined #openstack-nova | 08:07 | |
| *** bhagyashris has quit IRC | 08:09 | |
| gibi_ptg | mnaser: it seems we have one topic for cinder cross project so there is still chance to have the flavor discussion today | 08:15 |
| mnaser | gibi_ptg: ok cool, im around | 08:16 |
| mnaser | gibi_ptg: looks like it shuts down here at 4:30 so probably tomorrow thing | 08:19 |
| *** tssurya has joined #openstack-nova | 08:28 | |
| *** maciejjozefczyk has quit IRC | 08:38 | |
| *** slaweq has quit IRC | 08:39 | |
| *** pcaruana has quit IRC | 08:43 | |
| *** tkajinam has quit IRC | 08:44 | |
| *** tssurya has quit IRC | 08:45 | |
| *** mdbooth has quit IRC | 08:45 | |
| *** bhagyashris has joined #openstack-nova | 08:47 | |
| *** bhagyashris_ has joined #openstack-nova | 08:52 | |
| *** bhagyashris has quit IRC | 08:54 | |
| *** bhagyashris_ is now known as bhagyashris | 08:59 | |
| *** zbr has joined #openstack-nova | 09:12 | |
| *** dpawlik has quit IRC | 09:31 | |
| *** kisahm has joined #openstack-nova | 09:36 | |
| kisahm | hi, i'm using openstack queens on ubuntu bionic and i see this error messges in my horizon error log: Forbidden (CSRF token missing or incorrect.): /api/policy/does someone knows this problem? i see this if horizon tries to connect to nova api | 09:36 |
| *** dtantsur|afk is now known as dtantsur | 09:37 | |
| *** pcaruana has joined #openstack-nova | 09:38 | |
| *** dpawlik has joined #openstack-nova | 09:38 | |
| *** derekh has joined #openstack-nova | 09:38 | |
| *** sapd1_x has joined #openstack-nova | 09:42 | |
| *** kisahm has quit IRC | 09:45 | |
| *** sapd1_x has quit IRC | 09:53 | |
| *** mkrai has quit IRC | 09:55 | |
| *** Xuchu has quit IRC | 09:56 | |
| *** spsurya has quit IRC | 10:06 | |
| *** gshippey has joined #openstack-nova | 10:19 | |
| *** dviroel has joined #openstack-nova | 10:40 | |
| *** xek has joined #openstack-nova | 10:50 | |
| *** mkrai has joined #openstack-nova | 10:55 | |
| *** jaosorior has joined #openstack-nova | 10:56 | |
| *** ivve has joined #openstack-nova | 11:03 | |
| *** luksky has quit IRC | 11:10 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: Revert "nova shared storage: rbd is always shared storage" https://review.opendev.org/682523 | 11:11 |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Rename _is_storage_shared_with to _is_instance_path_shared_with https://review.opendev.org/693337 | 11:11 |
| sean-k-mooney | efried: by the way if its a completely clean node i found out you dont need the symlink and reboot | 11:12 |
| sean-k-mooney | efried: basicaly apparmor does not ship with a libvirt profile and the way its compiled currently we dont install one so it just works | 11:13 |
| sean-k-mooney | so you only need to disable it if you have previously installed libvirt form the package manager | 11:13 |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Rename _is_storage_shared_with to _is_instance_path_shared_with https://review.opendev.org/693337 | 11:19 |
| *** xek has quit IRC | 11:30 | |
| *** kisahm has joined #openstack-nova | 11:33 | |
| *** tbachman has quit IRC | 11:35 | |
| *** ratailor has quit IRC | 11:36 | |
| *** awalende has joined #openstack-nova | 11:49 | |
| *** luksky has joined #openstack-nova | 11:52 | |
| *** HagunKim has joined #openstack-nova | 11:57 | |
| *** dpawlik has quit IRC | 12:07 | |
| sean-k-mooney | gibi_ptg: quick question what move operations did you land for ports with bandwith requests in train. was it resize+cold migrate? live migrate and shelve are still pending right? | 12:07 |
| *** dpawlik has joined #openstack-nova | 12:09 | |
| *** links has quit IRC | 12:18 | |
| *** eharney has quit IRC | 12:28 | |
| *** bhagyashris_ has joined #openstack-nova | 12:34 | |
| *** bhagyashris has quit IRC | 12:36 | |
| *** mriedem has joined #openstack-nova | 12:39 | |
| *** ociuhandu has joined #openstack-nova | 12:45 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/stein: Revert "openstack server create" to "nova boot" in nova docs https://review.opendev.org/693242 | 12:45 |
| mriedem | pretty easy fix for the qos stuff when using a non-admin user https://review.opendev.org/#/c/691900/ | 12:54 |
| mriedem | that whole series has to go back to stein | 12:54 |
| *** ociuhandu has quit IRC | 13:00 | |
| *** ociuhandu has joined #openstack-nova | 13:02 | |
| *** Xuchu has joined #openstack-nova | 13:05 | |
| *** tbachman has joined #openstack-nova | 13:06 | |
| *** derekh has quit IRC | 13:16 | |
| *** jaosorior has quit IRC | 13:24 | |
| *** bhagyashris__ has joined #openstack-nova | 13:28 | |
| *** bhagyashris_ has quit IRC | 13:30 | |
| *** mdbooth has joined #openstack-nova | 13:32 | |
| *** bhagyashris__ has quit IRC | 13:40 | |
| sean-k-mooney | mriedem: ya that seriese looks sane to me. i did not really see anything that would be abackport issue either so stien should be doable without too much headache | 13:40 |
| mriedem | sean-k-mooney: nova-next is a zuulv3 job | 13:43 |
| mriedem | the post_test_hook is just a script run in a post-run task | 13:44 |
| sean-k-mooney | ok ok so its already been converted and that works cool | 13:44 |
| sean-k-mooney | we had a question about if that would work downstream so i can say yes | 13:44 |
| mriedem | yes, it's also likely how the remaining legacy jobs need to be converted to zuulv3 | 13:45 |
| mriedem | since they run the nova/tests/functional/live_migration hook scripts | 13:45 |
| mriedem | and those scripts themselves should probably be broken down into proper ansible tasks, but that's a bigger job | 13:45 |
| mriedem | *gate/live_migration/hooks | 13:46 |
| sean-k-mooney | sure but it give us an easy way to achive the comunity goal and then we can break them donw later | 13:46 |
| mriedem | ^ runs remove ansible commands on the subnode to set it up which we could just do with proper tasks that run on the subnode | 13:46 |
| mriedem | s/remove/remote/ | 13:47 |
| *** priteau has joined #openstack-nova | 13:47 | |
| sean-k-mooney | when you say set up the subnode you are refering to thing that need to be change post install right | 13:49 |
| sean-k-mooney | e.g. not running devstack | 13:49 |
| sean-k-mooney | if it was runnign devstack that can obviroulsy be done with the native devstack multinode supprot but im guessing they are doing other stuff | 13:50 |
| mriedem | post-install, | 13:50 |
| mriedem | the hook runs some live migration tests post default devstack deploy, | 13:51 |
| mriedem | and then re-configures the controller and subnode for ceph using the devstack-plugin-ceph repo | 13:51 |
| mriedem | that's the part that should probably be converted to proper ansible tasks | 13:51 |
| sean-k-mooney | ah ok | 13:51 |
| mriedem | alternatively we could just ditch that part and have a ceph and non-ceph version of those jobs | 13:52 |
| mriedem | the job used to also configure the nodes for nfs, but then it broke and no one cared to ever fix it | 13:52 |
| mriedem | the pita now is the ceph parts in those jobs aren't working properly when trying to make them run with py3 | 13:52 |
| sean-k-mooney | i kind of prefer that option of having two jobs but there is obviously the tradeoof of gate time | 13:52 |
| mriedem | https://review.opendev.org/#/c/692374/ | 13:53 |
| mriedem | well, it'd be 4 jobs | 13:53 |
| mriedem | b/c the nova-grenade-multinode and nova-live-migration jobs both use the same scripts | 13:53 |
| sean-k-mooney | right so block migrate and shared storage migthation for both | 13:54 |
| *** mkrai has quit IRC | 13:55 | |
| sean-k-mooney | i need to get back to the nvf job too. to test the numa/pinning/hugepages stuff | 13:56 |
| sean-k-mooney | at the moment i have 3 jobs that i need to complete. the nfv job, a ovs-dpdk job and a libvirt/qemu job | 13:56 |
| sean-k-mooney | although we proably wont run them all on each patch to nova | 13:57 |
| *** ociuhandu has quit IRC | 13:58 | |
| *** ociuhandu has joined #openstack-nova | 13:58 | |
| sean-k-mooney | mriedem: regarding greade it would be nice if we could use https://review.opendev.org/#/c/548936/ | 13:59 |
| *** mdbooth_ has joined #openstack-nova | 14:01 | |
| *** mdbooth has quit IRC | 14:02 | |
| *** gouthamr has quit IRC | 14:02 | |
| *** gouthamr has joined #openstack-nova | 14:04 | |
| *** HagunKim has quit IRC | 14:06 | |
| *** spsurya has joined #openstack-nova | 14:10 | |
| *** ociuhandu has quit IRC | 14:13 | |
| *** kisahm has quit IRC | 14:14 | |
| *** ociuhandu has joined #openstack-nova | 14:15 | |
| efried | sean-k-mooney: gtk | 14:17 |
| *** ociuhandu has quit IRC | 14:20 | |
| *** derekh has joined #openstack-nova | 14:23 | |
| *** ociuhandu has joined #openstack-nova | 14:24 | |
| *** jmlowe has quit IRC | 14:24 | |
| *** eharney has joined #openstack-nova | 14:32 | |
| sean-k-mooney | im just going for lunch but just wanted to highlight https://review.opendev.org/#/c/683174/4/specs/ussuri/approved/vm-scoped-sriov-numa-affinity.rst | 14:39 |
| sean-k-mooney | that has been up for about a month now with no review. | 14:39 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Convert nova-live-migration job to zuulv3 https://review.opendev.org/693364 | 14:40 |
| sean-k-mooney | i have it already implemented https://review.opendev.org/#/c/674072/4 and would like to wrap it up before we hit holiday season so if people coudl review that would be awsome | 14:40 |
| *** nanzha has joined #openstack-nova | 14:46 | |
| *** jawad_axd has quit IRC | 14:47 | |
| *** derekh has quit IRC | 14:47 | |
| *** nanzha has quit IRC | 14:50 | |
| *** jawad_axd has joined #openstack-nova | 14:51 | |
| *** amodi has quit IRC | 14:51 | |
| *** slaweq has joined #openstack-nova | 14:52 | |
| *** mdbooth_ has quit IRC | 14:53 | |
| *** ociuhandu has quit IRC | 14:53 | |
| *** ociuhandu has joined #openstack-nova | 14:54 | |
| *** jawad_axd has quit IRC | 14:56 | |
| *** ociuhandu has quit IRC | 14:59 | |
| *** Xuchu has quit IRC | 15:00 | |
| *** gonzalez86 has joined #openstack-nova | 15:05 | |
| *** davee_ has quit IRC | 15:08 | |
| *** slaweq has quit IRC | 15:08 | |
| efried | sean-k-mooney: would you be offended if I posted a new PS with just spelling corrections before I review? | 15:12 |
| *** mkrai has joined #openstack-nova | 15:12 | |
| *** jmlowe has joined #openstack-nova | 15:13 | |
| dansmith | efried: sean-k-mooney _can_ actually write english prose if he puts his mind to it | 15:14 |
| dansmith | I've seen it happen | 15:15 |
| efried | I've seen it done, I know it's true. This is closer than usual, but there's no sense putting up a review with a hundred typo comments. | 15:15 |
| dansmith | a hundred typos is closer than usual? ouch :D | 15:15 |
| *** dpawlik has quit IRC | 15:16 | |
| *** macz has joined #openstack-nova | 15:20 | |
| *** mmethot_ has quit IRC | 15:20 | |
| *** macz has quit IRC | 15:20 | |
| *** tbachman has quit IRC | 15:22 | |
| *** davee_ has joined #openstack-nova | 15:23 | |
| mriedem | people must be working b/c the gate is load failing a bit again today | 15:23 |
| *** tbachman has joined #openstack-nova | 15:24 | |
| openstackgerrit | ya.wang proposed openstack/nova-specs master: Re-propose expose-auto-converge-post-copy spec for Ussuri https://review.opendev.org/687199 | 15:25 |
| mriedem | lyarwood: the long term solution to crap like https://review.opendev.org/682523 is i think https://review.opendev.org/#/c/650188/ | 15:27 |
| mriedem | the imagebackend tells us about shared or not for the root disk storage, | 15:27 |
| mriedem | placement tells us if the local host disk is on shared storage | 15:28 |
| mriedem | no more trying to guess based on imagebackend (wrongly), | 15:28 |
| mriedem | no more trying to create temp files to see if we can on the remote host | 15:28 |
| mriedem | no more shared ssh keys if you're using shared storage, | 15:28 |
| mriedem | and we could schedule within a shared storage pool for things like live migration if you don't use shared ssh keys | 15:29 |
| mriedem | god everybody wins! | 15:29 |
| *** munimeha1 has joined #openstack-nova | 15:31 | |
| lyarwood | mriedem: ack yeah agreed, the question about a refactor was actually to mdbooth but yeah ultimatley that spec is going to solve alot of this. | 15:31 |
| mriedem | oh, the *other* matt | 15:35 |
| lyarwood | yup my bad sorry | 15:36 |
| *** TxGirlGeek has joined #openstack-nova | 15:36 | |
| openstackgerrit | Eric Fried proposed openstack/nova-specs master: Add spec for VM-scoped SR-IOV NUMA affinity https://review.opendev.org/683174 | 15:37 |
| efried | sean-k-mooney: done ^ | 15:37 |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Rename _is_storage_shared_with to _is_path_shared_with https://review.opendev.org/693337 | 15:38 |
| openstackgerrit | Merged openstack/nova stable/stein: Revert "openstack server create" to "nova boot" in nova docs https://review.opendev.org/693242 | 15:39 |
| mriedem | easy cross-cell-resize change here at the bottom of the stack to keep the series moving https://review.opendev.org/#/c/669012/ | 15:41 |
| *** artom has joined #openstack-nova | 15:42 | |
| *** amodi has joined #openstack-nova | 15:44 | |
| *** mmethot has joined #openstack-nova | 15:52 | |
| efried | mriedem: question there, but generally makes sense to me. | 15:53 |
| sean-k-mooney | efried: thanks are you generally ok with it? | 15:56 |
| efried | sean-k-mooney: I didn't actually read it; I'm doing that now. Note that I'm pretty weak on things involving NUMA, SR-IOV, and PCI so I probably won't be able to do more than +1 anyway. | 15:57 |
| jamesdenton | sean-k-mooney I have some hardware here to kick the tires on that, but it may be next week before i have a chance | 15:58 |
| efried | yeah, sorry, when I said "done" I just ment the copy edit | 15:58 |
| dansmith | efried: gave you my answer on mriedem's patch at least (and +2d) | 15:58 |
| efried | ack | 15:58 |
| sean-k-mooney | jamesdenton: cool, 99% is just using code that was already there | 15:58 |
| dansmith | actually had a tab open with a +2 on that from yesterday that I never hit go on | 15:58 |
| efried | dansmith: +A, thanks for confirming. | 15:59 |
| efried | jamesdenton: are you in operator-land? Is sean-k-mooney's use case a thing you care about? | 16:00 |
| mriedem | efried: replied with the big details | 16:02 |
| jamesdenton | i am in operator-land. The use-case doesn't directly impact me, but i try to stay tuned to what's happening with SRIOV for our customers that do use it | 16:03 |
| *** ociuhandu has joined #openstack-nova | 16:03 | |
| mriedem | efried: dansmith: thanks | 16:04 |
| mriedem | tell me when my asking for reviews on this series gets too annoying | 16:04 |
| mriedem | also, my wife and daughter just left for disney world (meeting up with my mother in law), you know what that means! | 16:05 |
| efried | mriedem: squeaky wheel and all that. Keep spoonfeeding me the easy ones and I'll keep reviewing them. Still haven't made it all the way through the review guide to hit the heavier ones | 16:05 |
| dansmith | mriedem: eating raw brownie batter shirtless over the sink time! | 16:05 |
| mriedem | close! | 16:06 |
| mriedem | let's just say i still haven't showered or put contacts in yet today | 16:06 |
| efried | I can smell you from here | 16:06 |
| dansmith | get some brownie batter and you've got a party! | 16:06 |
| mriedem | efried: yeah i've been trying to front-load as much of the simpler mechanical and test-only things for that reason | 16:06 |
| mriedem | pants of dance off! | 16:06 |
| mriedem | *off | 16:06 |
| efried | dansmith: I'll take my slice of humble pie from you, but you've got some nerve disagreeing with jacky06 on https://review.opendev.org/#/c/688122/ | 16:08 |
| *** jawad_axd has joined #openstack-nova | 16:08 | |
| *** ociuhandu has quit IRC | 16:09 | |
| openstackgerrit | Eric Fried proposed openstack/nova-specs master: Add spec for VM-scoped SR-IOV NUMA affinity https://review.opendev.org/683174 | 16:11 |
| efried | d'oh, forgot to save my last batch of edits sean-k-mooney ^ | 16:11 |
| *** jawad_axd has quit IRC | 16:12 | |
| *** ociuhandu has joined #openstack-nova | 16:13 | |
| *** tssurya has joined #openstack-nova | 16:17 | |
| *** jaosorior has joined #openstack-nova | 16:18 | |
| *** tbachman has quit IRC | 16:20 | |
| *** mkrai has quit IRC | 16:22 | |
| dansmith | efried: my finger quivered with nerves as I hit the submit button on that one for sure | 16:24 |
| *** tbachman has joined #openstack-nova | 16:24 | |
| *** jmlowe has quit IRC | 16:26 | |
| *** sapd1_x has joined #openstack-nova | 16:27 | |
| *** jmlowe has joined #openstack-nova | 16:28 | |
| *** tbachman has quit IRC | 16:29 | |
| *** ociuhandu has quit IRC | 16:33 | |
| *** ociuhandu has joined #openstack-nova | 16:35 | |
| *** tssurya has quit IRC | 16:39 | |
| *** luksky has quit IRC | 16:40 | |
| *** ociuhandu has quit IRC | 16:40 | |
| *** bnemec has joined #openstack-nova | 16:50 | |
| *** tbachman has joined #openstack-nova | 16:52 | |
| efried | sean-k-mooney: reviewed, +2 | 16:54 |
| sean-k-mooney | efried: thanks. | 16:56 |
| *** TxGirlGeek has quit IRC | 16:59 | |
| *** TxGirlGeek has joined #openstack-nova | 17:00 | |
| *** TxGirlGeek has quit IRC | 17:01 | |
| *** gonzalez86 has quit IRC | 17:01 | |
| *** tesseract has quit IRC | 17:03 | |
| *** TxGirlGeek has joined #openstack-nova | 17:04 | |
| *** psachin has quit IRC | 17:05 | |
| *** jmlowe has quit IRC | 17:05 | |
| *** damien_r has quit IRC | 17:06 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Convert nova-live-migration job to zuulv3 https://review.opendev.org/693364 | 17:07 |
| *** jmlowe has joined #openstack-nova | 17:10 | |
| *** henriqueof has joined #openstack-nova | 17:14 | |
| *** dtantsur is now known as dtantsur|afk | 17:15 | |
| *** gyee has joined #openstack-nova | 17:26 | |
| *** ociuhandu has joined #openstack-nova | 17:33 | |
| *** ociuhandu has quit IRC | 17:38 | |
| *** henriqueof1 has joined #openstack-nova | 17:42 | |
| *** henriqueof has quit IRC | 17:42 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Add emulated TPM support to Nova https://review.opendev.org/631363 | 17:45 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Add support for resize and cold migration of emulated TPM files https://review.opendev.org/639934 | 17:45 |
| openstackgerrit | Eric Fried proposed openstack/nova master: WIP: vTPM request_filter https://review.opendev.org/678325 | 17:45 |
| *** TxGirlGeek has quit IRC | 17:51 | |
| *** JamesBenson has joined #openstack-nova | 17:53 | |
| *** TxGirlGeek has joined #openstack-nova | 17:58 | |
| *** eharney has quit IRC | 17:59 | |
| sean-k-mooney | efried: by the way are you taking over teh vTPM stuff in general this cycle | 18:00 |
| sean-k-mooney | i have added them to my review list in anycase | 18:02 |
| efried | sean-k-mooney: yes. It's actually the whole reason I'm trying to get a devstack with modern libvirt/qemu. It's a nontrivial delta from the previously approved spec as it has to include the encryption bits. | 18:03 |
| efried | and I still don't know wtf that means yet. | 18:03 |
| efried | so, experimenting. | 18:03 |
| sean-k-mooney | oh so the vTPM will actully encrypt its contence on the hsot | 18:03 |
| sean-k-mooney | *host | 18:03 |
| *** priteau has quit IRC | 18:03 | |
| efried | yes, via a virsh "secret" | 18:04 |
| sean-k-mooney | ya that would be a good improvment. | 18:04 |
| efried | but I don't know how the "secret" gets to nova, and I don't know how the VM unlocks it. | 18:04 |
| efried | the docs are pretty sparse | 18:04 |
| efried | so, experimenting. | 18:04 |
| * efried <== errandn/nick efried_afk | 18:05 | |
| efried | nice | 18:05 |
| *** efried is now known as efried_afk | 18:05 | |
| efried_afk | dansmith: local buffering fail --^ | 18:05 |
| dansmith | efried_afk: boo local buffering | 18:05 |
| *** ociuhandu has joined #openstack-nova | 18:07 | |
| *** igordc has joined #openstack-nova | 18:09 | |
| *** sapd1_x has quit IRC | 18:16 | |
| *** xek has joined #openstack-nova | 18:16 | |
| *** ociuhandu has quit IRC | 18:17 | |
| *** awalende has quit IRC | 18:17 | |
| *** awalende has joined #openstack-nova | 18:18 | |
| *** awalende has quit IRC | 18:22 | |
| *** awalende has joined #openstack-nova | 18:23 | |
| *** awalende has quit IRC | 18:24 | |
| *** tbachman has quit IRC | 18:27 | |
| *** tbachman has joined #openstack-nova | 18:32 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Use openstack server create --boot-from-volume in test_evacuate.sh https://review.opendev.org/693406 | 18:35 |
| *** mgariepy has quit IRC | 18:35 | |
| *** mgariepy has joined #openstack-nova | 18:40 | |
| *** ociuhandu has joined #openstack-nova | 18:48 | |
| artom | mriedem, maybe a stupid question on ^^ | 18:48 |
| mriedem | sob | 18:48 |
| mriedem | get your downvote in while it's hot | 18:51 |
| artom | OK :) | 18:51 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Use openstack server create --boot-from-volume in test_evacuate.sh https://review.opendev.org/693406 | 18:52 |
| *** efried_afk is now known as efried | 18:54 | |
| *** pcaruana has quit IRC | 18:54 | |
| artom | mriedem, did we also not change the devstack default disk size to be 2 to help with the gate? | 18:56 |
| artom | I suppose size was 1 before, it can stay 1 | 18:56 |
| mriedem | this? https://review.opendev.org/#/c/690991/ | 18:57 |
| artom | Yeah | 18:57 |
| mriedem | i don't think that's going anywhere anytime soon | 18:58 |
| artom | Fair enough | 18:58 |
| openstackgerrit | Merged openstack/nova master: Use admin neutron client to query ports for binding https://review.opendev.org/690999 | 18:59 |
| openstackgerrit | Merged openstack/nova master: Use admin neutron client to gather port resource requests https://review.opendev.org/691005 | 18:59 |
| *** jawad_axd has joined #openstack-nova | 19:01 | |
| *** ociuhandu has quit IRC | 19:02 | |
| artom | \o/ | 19:05 |
| artom | Actually had some of the tests in https://review.opendev.org/#/c/691062/ pass | 19:05 |
| artom | Meaning the basics for a whitebox Zuul job are in place | 19:06 |
| artom | sean-k-mooney's probably the only one who groked that, but hopefully whitebox will become more of a thing with time | 19:06 |
| sean-k-mooney | i should proably add that to my review list | 19:08 |
| sean-k-mooney | also how is that on ps34 already | 19:09 |
| artom | I was going to ask anyways | 19:09 |
| artom | I suck at Zuul | 19:09 |
| artom | And Devstack | 19:09 |
| artom | And... in general :( | 19:09 |
| sean-k-mooney | there is a joke there :) | 19:09 |
| artom | There are jokes everywhere | 19:10 |
| artom | The question is. Who's laughing. | 19:10 |
| artom | *dun dun dun* | 19:10 |
| * sean-k-mooney assigns artom extra docs bugs | 19:11 | |
| artom | Wrong channel, but sure | 19:11 |
| sean-k-mooney | im sure i can find upstream ones | 19:13 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove super old br-<uuid> neutron network id compat code https://review.opendev.org/693411 | 19:15 |
| *** ccstone has joined #openstack-nova | 19:15 | |
| *** jaosorior has quit IRC | 19:15 | |
| efried | mriedem: question on --boot-from-volume | 19:17 |
| mriedem | efried: looks like you answered your own question | 19:18 |
| mriedem | oh wait, | 19:18 |
| mriedem | " The root volume will not be deleted when the server is deleted." | 19:18 |
| efried | no, the docs say "the volume is ... | 19:18 |
| efried | yeah | 19:18 |
| mriedem | i thought it did remove it by default | 19:19 |
| efried | I would say "this is CI which will clean up your mess anyway"... | 19:19 |
| efried | but not sure how CI does cinder | 19:19 |
| efried | I guess it would make sense for it to be a local cinder somehow, but I don't know | 19:20 |
| mriedem | we'd be orphaning the volume. if this were tempest it would make sure to clean up the volume at the end of the test. | 19:20 |
| efried | oh, my comments published backwards, wtf? | 19:20 |
| mriedem | i'd add a volume delete after openstack server delete --wait evacuate-bfv-test | 19:20 |
| efried | they make more sense read the other way around. | 19:20 |
| efried | I thought there was an option to make it delete the volume when the instance goes away. But I guess that's still just in novaclient, not in osc yet? | 19:21 |
| sean-k-mooney | efried: you can set it in the block device mappings | 19:22 |
| mriedem | you can do it in osc if using the --block-device-mapping option, | 19:22 |
| sean-k-mooney | but i dont know if you can do that with osc | 19:22 |
| mriedem | which used to not allow passing id as a source image, | 19:22 |
| sean-k-mooney | oh ok | 19:22 |
| mriedem | but when i added --boot-from-volume i think i fixed that as well | 19:22 |
| mriedem | yeah so i just need to change to use --block-device-mapping | 19:22 |
| mriedem | updating | 19:23 |
| efried | mmkay | 19:23 |
| efried | those docs for --block-device-mapping could stand to be formatted a bit better. Now that we're generating them, you only have to update one place in osc... | 19:24 |
| efried | :P | 19:24 |
| mriedem | god now i have to look at the osc source code to see what it passes for boot_index | 19:26 |
| mriedem | because you can't specify a boot index and if it doesn't pass one it defaults to None (not root) | 19:26 |
| efried | so add that to the docs while you're in there reformatting | 19:27 |
| efried | cause I know you were already doing that | 19:27 |
| mriedem | i'm about to abandon this gd turd | 19:28 |
| artom | *snerk* | 19:29 |
| artom | I mean, the novaclient isn't getting EOL'ed anytime soon, what's wrong with keeping it? | 19:29 |
| mriedem | ok so if you use --block-device-mapping you have to specify one of --image|--image-property|--volume and if you use --image, that's an ephemeral root disk and the bdm is just a non-root volume attachment | 19:31 |
| mriedem | artom: i try as much as possible to use osc for new things so we can stop using nova cli | 19:32 |
| efried | so much for "I can just *" | 19:32 |
| sean-k-mooney | artom: the main blockers to killing the nova client is we dont have a good way to update osc and lack of people working on closing the gaps | 19:32 |
| mriedem | --boot-from-volume preserves the volume by default b/c that's the default in the api for bdm.delete_on_termination (false) | 19:32 |
| artom | sean-k-mooney, well, osc is a moving target as well | 19:32 |
| artom | Now it's moving to openstacksdk, right? So we should be updating that as well? | 19:33 |
| openstackgerrit | Dustin Cowles proposed openstack/nova-specs master: Spec: Provider config YAML file https://review.opendev.org/693414 | 19:33 |
| artom | And it was/is missing basic microversion support | 19:33 |
| sean-k-mooney | artom: the intent is we woudl jsut update the sdk for the api changes and then have a thin wrapper in osc | 19:33 |
| sean-k-mooney | but yes its moving slowly to the sdk | 19:33 |
| *** awalende_ has joined #openstack-nova | 19:33 | |
| artom | mriedem, I agree with the sentiment :) It often comes up downstream - clients or whoever will say "I can't do this with osc [which is the recommended client for interaction with our OSP product]" and we'll come back with "use novaclient instead" | 19:34 |
| sean-k-mooney | artom: we only do that if there is no other choice | 19:35 |
| sean-k-mooney | but yes | 19:35 |
| *** luksky has joined #openstack-nova | 19:35 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove the TODO about using OSC for BFV in test_evacuate.sh https://review.opendev.org/693406 | 19:35 |
| efried | hahaha | 19:36 |
| sean-k-mooney | although we really should file a bug downstream to fix the osc gap everytime we do that | 19:36 |
| efried | wasn't there a spec to allow you to flip the 'remove on instance deletion' flag after the instance was created? | 19:37 |
| mriedem | yes | 19:37 |
| sean-k-mooney | efried: i think they wanted to set it as part of the attachment or somthing | 19:37 |
| mriedem | that would be a pretty crappy workaround here | 19:37 |
| efried | https://review.opendev.org/#/c/580336/ | 19:37 |
| artom | *snerk* | 19:37 |
| efried | mriedem: but eventually we'll want osc support for setting that option initially, right? | 19:37 |
| mriedem | i just loudly audibly sighed | 19:38 |
| efried | so like, instead of removing the TODO, you should *expand* it to explain all of that. | 19:38 |
| *** awalende_ has quit IRC | 19:38 | |
| mriedem | making the --boot-from-volume optional more customizable like the --block-device-mapping option is not what we want, it defeats the purpose of a simple boot from volume option, | 19:39 |
| efried | right | 19:39 |
| mriedem | so that likely means adding bootindex= to --block-device-mapping | 19:39 |
| sean-k-mooney | honestly the default shoudl proably be delete on instnace terminate | 19:39 |
| mriedem | but that has implications for how the command currently requires you to specify --image|--image-property|--volume | 19:39 |
| efried | you need a new option, --remove-volume-on-instance-deletion, which is only allowed with --boot-from-volume | 19:39 |
| mriedem | i don't think that's much better ux | 19:40 |
| efried | I'm not serious. | 19:40 |
| mriedem | heh, ok | 19:40 |
| efried | I know it's tough to tell with my rbf and deadpan humor style. | 19:40 |
| artom | --boot-from-volume size=1,cleanup=plz | 19:40 |
| mriedem | sean-k-mooney: if you have a dumb ass old app which stores data in the root volume, then deleting that by default is likely not what you want | 19:40 |
| mriedem | artom: f and no | 19:40 |
| mriedem | see what i just said above | 19:41 |
| artom | Conversly, --boot-from-volume size=1,cleanup=nowai | 19:41 |
| mriedem | no | 19:41 |
| mriedem | no | 19:41 |
| artom | Hahaha | 19:41 |
| mriedem | that's what --block-device-mapping is for | 19:41 |
| sean-k-mooney | mriedem: proably but we have had customer complain about this before | 19:41 |
| sean-k-mooney | mainly because they expected it to delete by default | 19:41 |
| mriedem | well they were wrong | 19:41 |
| mriedem | bug report closed | 19:41 |
| efried | OS_DELETE_VOLUME_WITH_INSTANCE=true openstack server create .... | 19:41 |
| sean-k-mooney | yep and they acepted that | 19:41 |
| efried | (the env var solution is just for dtroyer) | 19:41 |
| mriedem | "please delete my data by default thanks!" | 19:42 |
| artom | efried, we need to find a way to use /proc and or /sys for this | 19:42 |
| efried | lol | 19:42 |
| mriedem | or, | 19:42 |
| efried | I'm sure we could develop a hardware module | 19:42 |
| mriedem | read in yaml support for the osc commands like kubectrl | 19:42 |
| mriedem | *kubectl | 19:42 |
| artom | efried, oh oh oh! Cyborg with FPGAs | 19:42 |
| mriedem | then you could define your block_device_mapping_v2 in yaml! | 19:42 |
| efried | you mean a yaml front end to the REST API? | 19:42 |
| mriedem | efried: just osc to start | 19:43 |
| mriedem | i'm kidding | 19:43 |
| mriedem | again | 19:43 |
| sean-k-mooney | have we intoduced them to this thing call curl | 19:43 |
| artom | Ya man, it's what I do in the squat rack every Friday | 19:43 |
| sean-k-mooney | they can pass a json payload and be as declaritvie as they like | 19:43 |
| eandersson | btw the Rescheduling Exceptions we saw were most likely due to missing records in placement. | 19:43 |
| mriedem | hear me out, bring back xml support in the rest api | 19:44 |
| mriedem | who's with me?! | 19:44 |
| eandersson | We just didn't know until we deployed https://github.com/openstack/nova/commit/a5269012a3b442a9e4055a7d523faff45f105f2b | 19:44 |
| sean-k-mooney | eandersson: missing compute node resouce providers? | 19:44 |
| eandersson | Since we did a major jump (Mitaka -> Rocky) something went wrong when we first ran heal_allocations | 19:45 |
| eandersson | So a lot of VMs were missing | 19:45 |
| sean-k-mooney | oh ok | 19:45 |
| sean-k-mooney | so it was missing the allocations not the RPs | 19:45 |
| eandersson | Yea | 19:45 |
| eandersson | We ran it, but not sure why we didn't notice that it failed. | 19:45 |
| eandersson | --dry-run will help A LOT with this | 19:45 |
| sean-k-mooney | eandersson: while your here is https://blueprints.launchpad.net/nova/+spec/config-tsc-freq something you care about | 19:47 |
| eandersson | We have probably 200 "bad" vms overall that is prevening heal_allocations from finishing, and currently fixing them one by one. | 19:47 |
| eandersson | Interesting | 19:47 |
| sean-k-mooney | i need to go update that based on some irc converstation but we are suggesting adding 2 extraspcs/image properties | 19:47 |
| mriedem | eandersson: don't forget to report a bug against heal_allocations for whatever you ran into re the ML thread from last night | 19:48 |
| eandersson | Yea - started writing the bug reports | 19:48 |
| sean-k-mooney | hw:inv_tsc=true|false and hw:tsc_freq_mhz=<frequency> | 19:48 |
| mriedem | brb | 19:48 |
| *** mriedem has quit IRC | 19:48 | |
| eandersson | but a lot of these issues are so specific to us I feel stupid writing the reports lol | 19:48 |
| eandersson | like some of these "bad vms" are from like Juno | 19:49 |
| sean-k-mooney | did any of the vms "disapear" after upgrading | 19:49 |
| eandersson | or maybe even due to bad database surgery at some point | 19:49 |
| eandersson | none disapeared | 19:50 |
| *** mriedem has joined #openstack-nova | 19:50 | |
| eandersson | I think because we run NUMA a lot of issues are hidden from us. | 19:50 |
| sean-k-mooney | ok there was a change around rocky where we start cleaning up falid evaucted instnace | 19:50 |
| eandersson | Like the above would have been a major issue if it wasn't for NUMA, because when it fails due to the above it just reschedules. | 19:50 |
| eandersson | We only notice it when it hits like 10+ failed reschedules and throws an exception | 19:51 |
| eandersson | and ironically we bumped it from 10 -> 20 failures because we didn't realize that placement was in an inconsistent state. | 19:51 |
| sean-k-mooney | so numa made it better or worse? | 19:51 |
| eandersson | well it prevented computes from unintentially getting oversubscribed | 19:51 |
| sean-k-mooney | i think that is a first. numa making the failure mode better :) | 19:52 |
| sean-k-mooney | but ya the addtional tracking in the numa toplogy blob in the db would help with that | 19:52 |
| *** amodi has quit IRC | 20:00 | |
| *** brault has quit IRC | 20:01 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove service_uuids_online_data_migration https://review.opendev.org/693421 | 20:02 |
| *** brault has joined #openstack-nova | 20:02 | |
| *** spsurya has quit IRC | 20:02 | |
| *** awalende has joined #openstack-nova | 20:04 | |
| *** eharney has joined #openstack-nova | 20:10 | |
| *** abaindur has joined #openstack-nova | 20:10 | |
| *** ociuhandu has joined #openstack-nova | 20:11 | |
| *** abaindur has joined #openstack-nova | 20:11 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove dead HostAPI.service_delete code https://review.opendev.org/693422 | 20:12 |
| *** francoisp has joined #openstack-nova | 20:14 | |
| *** ociuhandu has quit IRC | 20:16 | |
| *** threestrands has quit IRC | 20:17 | |
| *** henriqueof1 has quit IRC | 20:19 | |
| *** tbachman has quit IRC | 20:26 | |
| *** jawad_axd has quit IRC | 20:28 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Use named kwargs in compute.API.resize https://review.opendev.org/693425 | 20:35 |
| mriedem | god py38 non-voting talk already? | 20:36 |
| mriedem | can we just skip to py500 already | 20:36 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove now invalid TODO from ComputeManager._confirm_resize https://review.opendev.org/693427 | 20:45 |
| *** jmlowe has quit IRC | 20:45 | |
| openstackgerrit | Merged openstack/nova master: Execute CrossCellMigrationTask from MigrationTask https://review.opendev.org/635668 | 20:54 |
| openstackgerrit | Merged openstack/nova master: Refresh instance in MigrationTask.execute Exception handler https://review.opendev.org/669012 | 20:54 |
| *** xek_ has joined #openstack-nova | 21:01 | |
| *** xek has quit IRC | 21:02 | |
| *** jmlowe has joined #openstack-nova | 21:05 | |
| *** tbachman has joined #openstack-nova | 21:11 | |
| *** xek has joined #openstack-nova | 21:15 | |
| *** xek_ has quit IRC | 21:16 | |
| *** eharney has quit IRC | 21:16 | |
| *** amodi has joined #openstack-nova | 21:19 | |
| mriedem | man test_detach_volume_shelved_or_offload_server seems to fail a lot | 21:24 |
| openstackgerrit | François Palin proposed openstack/nova master: Add retry to cinder api calls related to volume detach https://review.opendev.org/669674 | 21:26 |
| eandersson | Interesting - a VM without an allocation that is migrated also does not get an allocation | 21:28 |
| eandersson | Would expected it to get "repaired" :p | 21:28 |
| openstackgerrit | Merged openstack/nova stable/stein: Add regression test for bug 1824435 https://review.opendev.org/692906 | 21:28 |
| openstack | bug 1824435 in OpenStack Compute (nova) stein "fill_virtual_interface_list migration fails on second attempt" [Medium,In progress] https://launchpad.net/bugs/1824435 - Assigned to melanie witt (melwitt) | 21:28 |
| openstackgerrit | Merged openstack/nova stable/stein: Remove redundant call to get/create default security group https://review.opendev.org/692907 | 21:28 |
| * melwitt faints | 21:28 | |
| eandersson | melwitt, is that a bug in rocky as well? | 21:31 |
| melwitt | no, stein is the earliest it shows up | 21:31 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Implement update_provider_tree for mocked driver in test_resource_tracker https://review.opendev.org/693431 | 21:36 |
| *** mdbooth has joined #openstack-nova | 21:36 | |
| mriedem | eandersson: you should see this in the conductor logs https://github.com/openstack/nova/blob/stable/rocky/nova/conductor/tasks/migrate.py#L51 | 21:37 |
| mriedem | i would expect the scheduler to create allocations for the instance against the dest node | 21:38 |
| mriedem | and those to stick if the migration completes successfully | 21:38 |
| eandersson | We basically moved a site from one DC to another | 21:38 |
| eandersson | and migrated all VMs | 21:38 |
| ccstone | we didn't have nova in debug so we wouldn't have seen that message :/ | 21:39 |
| eandersson | all of them was "healed" using the heal_allocations | 21:39 |
| *** eharney has joined #openstack-nova | 21:40 | |
| mriedem | ok, i don't know what would be going on there, but i'd expect the migration to heal the instance allocations as well | 21:40 |
| mriedem | s/heal/recreate on dest node/ | 21:40 |
| eandersson | Of course we are basing this on the heal_allocations output | 21:41 |
| *** mdbooth has quit IRC | 21:41 | |
| *** awalende has quit IRC | 21:43 | |
| *** brault has quit IRC | 21:44 | |
| openstackgerrit | François Palin proposed openstack/nova master: Add retry to cinder api calls related to volume detach https://review.opendev.org/669674 | 21:45 |
| mriedem | so the vm didn't have allocations, you migrated it successfully (and confirmed the migration), and ran heal allocations and it healed it rather than saying there was nothing to do? | 21:46 |
| *** takashin has joined #openstack-nova | 21:46 | |
| *** mtreinish has quit IRC | 21:46 | |
| eandersson | pretty much yes | 21:47 |
| mriedem | fake news! | 21:47 |
| eandersson | haha | 21:47 |
| eandersson | ignorance is probably the leading factor to fake news :p | 21:47 |
| mriedem | no dude it's all ukraine | 21:48 |
| eandersson | lol | 21:48 |
| mriedem | so i wonder if on confirm we're doing something dumb and wiping out the allocations that the scheduler created | 21:49 |
| mriedem | do you see any messages in the compute logs for that operation? | 21:49 |
| *** jawad_axd has joined #openstack-nova | 21:49 | |
| mriedem | so i bet you don't get here https://github.com/openstack/nova/blob/stable/rocky/nova/compute/manager.py#L4143 | 21:50 |
| mriedem | which means you'd see this in the logs i think (on the source node) | 21:50 |
| mriedem | https://github.com/openstack/nova/blob/stable/rocky/nova/compute/manager.py#L4143 | 21:50 |
| mriedem | and i bet we drop the allocations here https://github.com/openstack/nova/blob/stable/rocky/nova/compute/manager.py#L4143 | 21:50 |
| mriedem | it's a guess, but i'd expect to see some messages in the compute logs related to that | 21:51 |
| *** mtreinish has joined #openstack-nova | 21:52 | |
| eandersson | I would have to dig in our logs as this was probably a month ago | 21:53 |
| eandersson | when we actually performed the migrations | 21:53 |
| *** jawad_axd has quit IRC | 21:54 | |
| *** luksky has quit IRC | 21:54 | |
| mriedem | do your logs go that far back? | 21:54 |
| mriedem | and do you have debug enabled on the compute service? | 21:54 |
| eandersson | We never got debug enabled :'( | 21:55 |
| mriedem | ok, it might not be something at debug, i'd expect to see log messages about how it expected to find allocations but found none, doing old style thingies | 21:55 |
| mriedem | would probably also be pretty easy to recreate with a test vm, just create it, drop its allocations in placement, migrate and confirm and then check if the allocations are still gone | 21:56 |
| eandersson | It's probably one of those things that only affect users that do crazy things like upgrade from mitaka to rocky :p | 21:56 |
| *** xek has quit IRC | 21:57 | |
| *** xek has joined #openstack-nova | 21:57 | |
| *** JamesBenson has quit IRC | 22:01 | |
| efried | sean-k-mooney: for some reason n-cpu still thinks I'm using libvirt 4.0.0. How do I get it to pick up the thing I built? | 22:02 |
| mriedem | efried: you likely need to recompile libvirt-python | 22:02 |
| efried | I've got a recent libvirt-python | 22:02 |
| efried | uhh | 22:02 |
| mriedem | but is it built against the version of libvirt you're running now? | 22:02 |
| efried | yeah | 22:03 |
| efried | what do you mean 'built against'? | 22:03 |
| efried | I didn't build it locally against the libvirt I built locally. | 22:03 |
| efried | But the version matches. | 22:03 |
| mriedem | the package version on libvirt python != the version of libvirt it thinks you have | 22:03 |
| mriedem | it's just a python shim over the libvirt c api | 22:03 |
| mriedem | so from what i remember you have to make sure your libvirt-python is built from the same libvirt source as the service | 22:04 |
| mriedem | otherwise you think you're using x but you're getting y | 22:04 |
| mriedem | and it's confusing | 22:04 |
| efried | Hm. When I was trying to install libvirt-python 5.7 with libvirt 5.8 on my system, it wouldn't even install, complaining of symbols. I had to have libvirt-python >= libvirt for it to work. | 22:05 |
| efried | So *something* was checking that I had the right libvirt. | 22:05 |
| mriedem | ok at this point you're going to have to phone a red hat friend | 22:07 |
| *** brault has joined #openstack-nova | 22:10 | |
| efried | I have a thing to try. | 22:11 |
| efried | I restacked because I needed a newer nova branch and it wasn't working to just pull and restart services | 22:11 |
| efried | and I wanted to clean because the problem was in the db | 22:11 |
| efried | but I didn't want to have to recompile libvirt/qemu again | 22:11 |
| efried | so I disabled sean-k-mooney's plugin before unstack, clean, stack | 22:11 |
| efried | so I suspect the `stack` installed and set up stock libvirt again | 22:11 |
| efried | so I'm going to re-enable the plugin and restack (without cleaning)... | 22:11 |
| efried | yeesh, it's probably as simple as `make install` in those dirs, but too late, I already unstacked... | 22:12 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Implement update_provider_tree for mocked driver in test_resource_tracker https://review.opendev.org/693431 | 22:17 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Drop compat for non-update_provider_tree code paths https://review.opendev.org/693435 | 22:17 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Drop compat for non-update_provider_tree code paths https://review.opendev.org/693435 | 22:20 |
| *** rcernin has joined #openstack-nova | 22:23 | |
| *** takashin has quit IRC | 22:24 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Delete _normalize_inventory_from_cn_obj https://review.opendev.org/693436 | 22:25 |
| efried | that was it | 22:31 |
| efried | oooo, I just saw those last few patch titles mriedem, I'm excited. | 22:32 |
| mriedem | i knew you would be | 22:33 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Move compute_node_to_inventory_dict to test-only code https://review.opendev.org/693438 | 22:35 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove get_minimum_version mocks from test_resource_tracker https://review.opendev.org/693439 | 22:38 |
| *** jawad_axd has joined #openstack-nova | 22:50 | |
| *** jawad_axd has quit IRC | 22:54 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Use named kwargs in compute.API.resize https://review.opendev.org/693425 | 22:54 |
| *** mriedem has quit IRC | 22:58 | |
| *** davee_ has quit IRC | 23:00 | |
| *** xek has quit IRC | 23:02 | |
| *** xek_ has joined #openstack-nova | 23:02 | |
| *** xek_ has quit IRC | 23:10 | |
| *** xek_ has joined #openstack-nova | 23:10 | |
| *** jawad_axd has joined #openstack-nova | 23:11 | |
| *** jawad_axd has quit IRC | 23:15 | |
| *** munimeha1 has quit IRC | 23:15 | |
| *** macz has joined #openstack-nova | 23:20 | |
| *** xek_ has quit IRC | 23:28 | |
| *** xek_ has joined #openstack-nova | 23:28 | |
| *** ociuhandu has joined #openstack-nova | 23:31 | |
| *** jawad_axd has joined #openstack-nova | 23:31 | |
| *** ociuhandu has quit IRC | 23:35 | |
| *** jawad_axd has quit IRC | 23:36 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!