| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (22) https://review.openstack.org/576712 | 00:03 |
|---|---|---|
| openstackgerrit | melanie witt proposed openstack/nova master: Update api-guide and api-ref to be clear about forced-down https://review.openstack.org/492533 | 00:04 |
| openstackgerrit | melanie witt proposed openstack/nova master: Update contributor process doc for stein https://review.openstack.org/592766 | 00:13 |
| *** brinzhang has joined #openstack-nova | 00:26 | |
| openstackgerrit | melanie witt proposed openstack/nova master: Update contributor docs for stein https://review.openstack.org/592766 | 00:29 |
| *** tbachman has joined #openstack-nova | 00:29 | |
| *** tbachman has quit IRC | 00:33 | |
| *** tbachman has joined #openstack-nova | 00:36 | |
| *** nicolasbock has quit IRC | 00:36 | |
| *** liuyulong has joined #openstack-nova | 00:51 | |
| *** mriedem has joined #openstack-nova | 00:52 | |
| mriedem | o/ | 00:52 |
| melwitt | mriedem: I resurrected this old docs patch from sdague based on a bug I closed today. you used to be +2 on it https://review.openstack.org/492533 I'd +2 it but I rebased it out of merge conflict | 00:55 |
| mriedem | yeah...that got caught up in committee | 00:56 |
| melwitt | yeah. maybe it's not perfect but it's definitely a big improvement over the docs we currently have | 00:57 |
| melwitt | I was thinking, "we should add more info to the docs" and then I stumbled upon the abandoned patch while looking for something else | 00:58 |
| *** dave-mccowan has joined #openstack-nova | 00:58 | |
| mriedem | yeah, there are a couple of small things we can improve from PS2 comments so i'll mark those | 00:59 |
| mriedem | but yes i was +2 before because it's a big improvement over nothing | 00:59 |
| melwitt | ok | 00:59 |
| melwitt | yup ++ | 00:59 |
| *** hongbin has joined #openstack-nova | 01:04 | |
| *** slaweq has joined #openstack-nova | 01:06 | |
| mriedem | melwitt: ok comments inline | 01:14 |
| *** sambetts has quit IRC | 01:14 | |
| melwitt | thanks | 01:14 |
| *** slaweq has quit IRC | 01:16 | |
| *** mhen has quit IRC | 01:17 | |
| *** sambetts_ has joined #openstack-nova | 01:17 | |
| *** mhen has joined #openstack-nova | 01:17 | |
| *** mriedem has quit IRC | 01:20 | |
| *** ileixe has joined #openstack-nova | 01:23 | |
| openstackgerrit | fupingxie proposed openstack/nova master: Support list for alias in pci section in nova.conf https://review.openstack.org/592243 | 01:31 |
| *** r-daneel has quit IRC | 01:35 | |
| openstackgerrit | melanie witt proposed openstack/nova master: Update api-guide and api-ref to be clear about forced-down https://review.openstack.org/492533 | 01:42 |
| *** tetsuro has joined #openstack-nova | 01:44 | |
| *** tetsuro has quit IRC | 01:44 | |
| openstackgerrit | Brin Zhang proposed openstack/nova-specs master: Add support specify volume type when boot instance https://review.openstack.org/579520 | 01:47 |
| ileixe | Hi guys, Does anybody have optimal solution for nova-schedulers' race condition? I just tried to increase try attempts but wonder how others do.. | 01:49 |
| openstackgerrit | Brin Zhang proposed openstack/nova-specs master: Support deleting data volume when destroy instance https://review.openstack.org/580336 | 01:50 |
| *** Dinesh_Bhor has joined #openstack-nova | 01:51 | |
| *** luzC has quit IRC | 01:52 | |
| *** luzC has joined #openstack-nova | 01:55 | |
| *** mriedem has joined #openstack-nova | 01:55 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add zvm admin intro and hypervisor information https://review.openstack.org/533125 | 02:05 |
| openstackgerrit | Tao Li proposed openstack/nova master: Rollback instance vm_state to original where instance claims failed https://review.openstack.org/592252 | 02:08 |
| mriedem | efried: powervm supports snapshot right? if so, it should be able to claim shelve support https://review.openstack.org/#/c/533512/14/doc/source/user/feature-matrix-gp.ini | 02:09 |
| mriedem | which is just snapshot, destroy and spawn from snapshot elsewhere | 02:09 |
| melwitt | ileixe: you mean race with parallel requests? are you using an older version of nova? as of the pike version, the scheduler is claiming resources with placement, which solves the parallel requests race | 02:09 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add zvm CI information https://review.openstack.org/533512 | 02:09 |
| melwitt | ileixe: if you are using an older version than pike, you can increase the retries (max_attempts) the way you have. you can also use the scheduler_host_subset_size config option to randomize the selection of compute host during scheduling, if you are OK with spreading instances rather than packing them https://docs.openstack.org/ocata/config-reference/compute/schedulers.html | 02:12 |
| *** liuyulong has quit IRC | 02:12 | |
| ileixe | melwitt: Yes, exactly. We did not upgrade the placement api yet, and I also expect the api solve the synchronize problem but I could not find the related logic in master branch. | 02:12 |
| ileixe | Thanks for the answer, I will try to find the logic if it solve the problem. | 02:13 |
| melwitt | ileixe: this is the spec for the work https://specs.openstack.org/openstack/nova-specs/specs/pike/implemented/placement-claims.html and the blueprint https://blueprints.launchpad.net/nova/+spec/placement-claims where you can find links to related patches | 02:13 |
| ileixe | melwitt: Thanks! | 02:14 |
| melwitt | if you are on a version older than pike, I would increase the scheduler_host_subset_size option to reduce the chances of collisions with parallel requests | 02:14 |
| melwitt | yw | 02:14 |
| ileixe | Yes actually we increased the configs exactly what you mentioned. And it still sometime happens so I tried to alternatives :) | 02:15 |
| melwitt | oh, I see. got it | 02:15 |
| *** gcb_ has joined #openstack-nova | 02:19 | |
| mriedem | ileixe: are you using the CachingScheduler or FilterScheduler? | 02:23 |
| mriedem | and are you running multiple scheduler workers? | 02:24 |
| ileixe | Yes 4 FilterScheduler | 02:24 |
| mriedem | ok, that's normal, | 02:24 |
| mriedem | then yes host_subset_size will need to be >1, which you've done | 02:24 |
| mriedem | maybe check your weigher configuration? | 02:25 |
| ileixe | 10 we've been used | 02:26 |
| ileixe | and default for retry attempt | 02:26 |
| ileixe | So I was going to increase try attepmts. | 02:27 |
| ileixe | But placement api seems to be optimal solution. :) | 02:27 |
| openstackgerrit | Merged openstack/nova master: Add zvm admin intro and hypervisor information https://review.openstack.org/533125 | 02:27 |
| *** HW_Peter has quit IRC | 02:36 | |
| mriedem | ileixe: yes placement will do an atomic claim on vcpu,ram,disk in the scheduler rather than the late racy claim on the compute host | 02:36 |
| mriedem | you can still race to fail claims for things like numa/pci since we don't model that in placement yet | 02:36 |
| mriedem | but maybe that's not your major issue | 02:36 |
| ileixe | mriedem: Greate. Oh, I found now resources are updated in scheduler itself. | 02:39 |
| ileixe | Thanks guys. Lovely change. | 02:40 |
| *** Nel1x has joined #openstack-nova | 02:49 | |
| *** erlon has quit IRC | 02:54 | |
| *** Cardoe has quit IRC | 02:55 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add zvm CI information https://review.openstack.org/533512 | 02:58 |
| mriedem | melwitt: final zvm docs change is approved | 02:59 |
| mriedem | should be able to cut rc2 after that merges | 02:59 |
| mriedem | +2 on that forced_down docs change as well | 03:01 |
| *** Cardoe has joined #openstack-nova | 03:04 | |
| *** sapd1 has quit IRC | 03:09 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Update contributor guide for Stein https://review.openstack.org/591258 | 03:10 |
| *** Nel1x has quit IRC | 03:11 | |
| openstackgerrit | Merged openstack/nova master: Add zvm CI information https://review.openstack.org/533512 | 03:21 |
| Kevin_Zheng | mriedem just came to my head, another thing that strict project to cells won't help much for us is that, we have admin softwares that queries with --all_tenants | 03:24 |
| *** trungnv has joined #openstack-nova | 03:25 | |
| mriedem | Kevin_Zheng: well, it wouldn't help that specific software, but it would help user server list response timem | 03:26 |
| mriedem | *time | 03:26 |
| mriedem | CERN obviously would have the same issue for admin tooling | 03:26 |
| Kevin_Zheng | yeah I know | 03:26 |
| *** dave-mccowan has quit IRC | 03:45 | |
| *** udesale has joined #openstack-nova | 03:47 | |
| *** Dinesh_Bhor has quit IRC | 03:52 | |
| *** Dinesh_Bhor has joined #openstack-nova | 03:56 | |
| *** hongbin has quit IRC | 03:57 | |
| *** vivsoni_ has quit IRC | 03:59 | |
| *** Dinesh_Bhor has quit IRC | 04:04 | |
| *** Bhujay has joined #openstack-nova | 04:06 | |
| *** vivsoni has joined #openstack-nova | 04:25 | |
| *** janki has joined #openstack-nova | 04:39 | |
| *** abhishekk has joined #openstack-nova | 04:49 | |
| *** jamesdenton has quit IRC | 04:51 | |
| *** Dinesh_Bhor has joined #openstack-nova | 04:59 | |
| *** ratailor has joined #openstack-nova | 05:16 | |
| *** ShilpaSD_ has joined #openstack-nova | 05:28 | |
| *** takashin has left #openstack-nova | 05:31 | |
| *** sapd1 has joined #openstack-nova | 05:44 | |
| *** josecastroleon has joined #openstack-nova | 05:51 | |
| openstackgerrit | Tao Li proposed openstack/nova master: Rollback instance vm_state to original where instance claims failed https://review.openstack.org/592252 | 05:54 |
| *** nehaalhat has joined #openstack-nova | 06:04 | |
| *** mriedem has quit IRC | 06:05 | |
| *** Tahvok has quit IRC | 06:06 | |
| *** Bhujay has quit IRC | 06:07 | |
| *** Tahvok has joined #openstack-nova | 06:11 | |
| *** skatsaounis has quit IRC | 06:18 | |
| nehaalhat | stephenfin: Hi do you know any periodic task that will update the aggregates list in Nova? | 06:21 |
| *** Dinesh_Bhor has quit IRC | 06:34 | |
| *** links has joined #openstack-nova | 06:37 | |
| *** Dinesh_Bhor has joined #openstack-nova | 06:41 | |
| *** pcaruana has joined #openstack-nova | 06:54 | |
| *** alexchadin has joined #openstack-nova | 06:54 | |
| *** rcernin has quit IRC | 06:55 | |
| *** abhishekk has quit IRC | 06:56 | |
| *** slaweq has joined #openstack-nova | 06:57 | |
| *** skatsaounis has joined #openstack-nova | 07:03 | |
| *** gibi is now known as giblet | 07:03 | |
| *** tssurya has joined #openstack-nova | 07:07 | |
| *** sahid has joined #openstack-nova | 07:07 | |
| *** dpawlik has joined #openstack-nova | 07:08 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Remove the deprecated API extensions policies https://review.openstack.org/586872 | 07:11 |
| *** dpawlik has quit IRC | 07:13 | |
| *** dpawlik has joined #openstack-nova | 07:14 | |
| *** Bhujay has joined #openstack-nova | 07:16 | |
| *** cz2 has left #openstack-nova | 07:23 | |
| *** josecastroleon has quit IRC | 07:26 | |
| *** rha has joined #openstack-nova | 07:41 | |
| *** jpena|off is now known as jpena | 07:46 | |
| *** jaosorior has quit IRC | 07:47 | |
| *** zhenguo has joined #openstack-nova | 07:50 | |
| *** davidsha has joined #openstack-nova | 07:51 | |
| openstackgerrit | Merged openstack/nova master: Update api-guide and api-ref to be clear about forced-down https://review.openstack.org/492533 | 07:58 |
| *** mvkr has quit IRC | 08:08 | |
| *** ejat has joined #openstack-nova | 08:12 | |
| *** josecastroleon has joined #openstack-nova | 08:12 | |
| *** Dinesh_Bhor has quit IRC | 08:18 | |
| *** gcb_ has quit IRC | 08:20 | |
| *** Dinesh_Bhor has joined #openstack-nova | 08:21 | |
| *** luksky has joined #openstack-nova | 08:23 | |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Merge extended_status extension response into server view builder https://review.openstack.org/592092 | 08:26 |
| *** derekh has joined #openstack-nova | 08:35 | |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Add get_by_cell_and_project() method to InstanceMappingList https://review.openstack.org/591656 | 08:40 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: API microversion bump for handling-down-cell https://review.openstack.org/591657 | 08:40 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Return a minimal construct for nova list when a cell is down https://review.openstack.org/567785 | 08:41 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Return a minimal construct for nova show when a cell is down https://review.openstack.org/591658 | 08:41 |
| openstackgerrit | Surya Seetharaman proposed openstack/nova master: Return a minimal construct for nova service-list when a cell is down https://review.openstack.org/584829 | 08:41 |
| openstackgerrit | Tao Li proposed openstack/nova master: Rollback instance vm_state to original where instance claims failed https://review.openstack.org/592252 | 08:50 |
| *** mvkr has joined #openstack-nova | 08:55 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova-specs master: Placement: any traits in allocation_candidate query https://review.openstack.org/565730 | 09:04 |
| *** alexchadin has quit IRC | 09:07 | |
| *** panda|off is now known as panda | 09:08 | |
| *** alexchadin has joined #openstack-nova | 09:09 | |
| *** Bhujay has quit IRC | 09:13 | |
| *** Bhujay has joined #openstack-nova | 09:15 | |
| *** sambetts_ is now known as sambetts | 09:25 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova-specs master: Placement: support mixing required traits with any traits https://review.openstack.org/565741 | 09:25 |
| *** udesale has quit IRC | 09:31 | |
| kosamara | efried: about trait "ownership": Given RP ownership, the only issue that I see trait ownership addressing is the separation of generated and user-provided traits. I see your discussion with Sundar (https://review.openstack.org/#/c/579359/10/doc/source/specs/rocky/device-passthrough.rst@173), but is this actually an issue if RPs are owned by the drivers? | 09:39 |
| kosamara | efried: And for separating user and generated traits, I would also like to hear your argument. When you say "conflict" between the 2, you imply a set of rules that make some traits mutually exclusive? | 09:44 |
| sean-k-mooney | kosamara: we promised operators the ablitiy to add traits to any resouce provider in the past | 09:47 |
| sean-k-mooney | so there is a confilt in that the virt drivers would like to fully own the traits on the resouces they create and the fact that we said operator can add traits to resouce provirers that the virt driver may not be able to determin itself | 09:48 |
| sean-k-mooney | kosamara: also some traits could be multally inclusive such as a disk can both be an ssd and mechanical | 09:51 |
| sean-k-mooney | kosamara: we dont model the compatiablity of traits anyehere and curerntly assume the entity adding the traits will do the right thing | 09:52 |
| sean-k-mooney | for standard traits we might be able to handel that in os-tratis but in general it a problem that we cant fix directly. | 09:53 |
| sean-k-mooney | at least in the CUSTOM_ case | 09:53 |
| kosamara | sean-k-mooney: ok, so the namespacing addresses the operator vs generated part. What I actually don't understand is why the driver *must* fully own the traits, over the operator. If we accept that, then namespacing makes sense, so please explain to me that. | 09:57 |
| *** zhenguo has quit IRC | 10:00 | |
| sean-k-mooney | well im not sure how namespacing is proposed to work. my understanind is that prevent both the operator and virt drivers form both using stadard traits as such i do not see that as a viable option | 10:00 |
| sean-k-mooney | e.g. either the operator or the virt direver would be able to use the un namespaced standard tratis | 10:01 |
| *** Dinesh_Bhor has quit IRC | 10:04 | |
| *** josecastroleon has quit IRC | 10:06 | |
| kosamara | sean-k-mooney: See here the traits sections of my 2nd PS draft: https://etherpad.openstack.org/p/device-placement-passthrough-2 | 10:06 |
| kosamara | sean-k-mooney: exactly, that could be an issue. But still I'm not clear on this, let's wait for efried's input | 10:07 |
| sean-k-mooney | kosamara: i would be stongly opposed to having a CUSTOM_%(virt_driver)_ prefix if i ever need to set that in a flavor to match against it | 10:09 |
| sean-k-mooney | well that depends | 10:09 |
| *** sapd1 has quit IRC | 10:09 | |
| sean-k-mooney | if the driver ever generated a CUSTOM_%(virt_driver)_ trait for something that was a standard trait then i think that is a very bad design | 10:10 |
| sean-k-mooney | e.g. i should be able to jsut say HW_CPU_X86_AVX not CUSTOM_LIBVIRT_HW_CPU_X86_AVX | 10:11 |
| sean-k-mooney | if a virt driver has a capablity that is truely unique to it, then i can see it useing a CUSTOM_%(virt_driver) trait that siad i would still prefer them to standarise it in os-tratis | 10:13 |
| *** alexchadin has quit IRC | 10:15 | |
| *** trungnv has quit IRC | 10:19 | |
| *** Dinesh_Bhor has joined #openstack-nova | 10:21 | |
| sean-k-mooney | kosamara: i have added a potentally dumb alternitive to https://etherpad.openstack.org/p/device-placement-passthrough-2 | 10:23 |
| *** cdent has joined #openstack-nova | 10:23 | |
| *** ileixe_ has joined #openstack-nova | 10:27 | |
| *** udesale has joined #openstack-nova | 10:31 | |
| *** ileixe_ has quit IRC | 10:32 | |
| *** ociuhandu has joined #openstack-nova | 10:32 | |
| *** ociuhandu has quit IRC | 10:34 | |
| *** nicolasbock has joined #openstack-nova | 10:35 | |
| *** claudiub has joined #openstack-nova | 10:45 | |
| *** alexchadin has joined #openstack-nova | 10:45 | |
| *** alexchadin has quit IRC | 10:51 | |
| *** dklyle has quit IRC | 10:55 | |
| *** david-lyle has joined #openstack-nova | 10:55 | |
| *** tikitavi has joined #openstack-nova | 11:02 | |
| *** jpena is now known as jpena|lunch | 11:04 | |
| *** cdent_ has joined #openstack-nova | 11:07 | |
| *** cdent has quit IRC | 11:07 | |
| *** cdent_ is now known as cdent | 11:07 | |
| *** maciejjozefczyk has quit IRC | 11:21 | |
| *** josecastroleon has joined #openstack-nova | 11:22 | |
| *** alexchadin has joined #openstack-nova | 11:24 | |
| *** udesale has quit IRC | 11:26 | |
| *** alexchadin has quit IRC | 11:29 | |
| *** Dinesh_Bhor has quit IRC | 11:33 | |
| *** brinzhang has quit IRC | 11:36 | |
| *** maciejjozefczyk has joined #openstack-nova | 11:37 | |
| *** alexchadin has joined #openstack-nova | 11:38 | |
| *** jamesdenton has joined #openstack-nova | 11:47 | |
| *** breton has left #openstack-nova | 11:51 | |
| *** cdent has quit IRC | 11:51 | |
| *** erlon has joined #openstack-nova | 11:53 | |
| *** mdbooth has quit IRC | 11:56 | |
| *** jpena|lunch is now known as jpena | 12:00 | |
| *** jaypipes has quit IRC | 12:16 | |
| *** maciejjozefczyk has quit IRC | 12:17 | |
| *** dpawlik has quit IRC | 12:18 | |
| *** eharney has joined #openstack-nova | 12:22 | |
| *** ratailor has quit IRC | 12:23 | |
| *** dpawlik has joined #openstack-nova | 12:25 | |
| kosamara | sean-k-mooney I think any custom trait is suboptimal to standard ones, therefore I'll explicitly say that the drivers must use a standard trait for a capability if it exists. What's the point otherwise. | 12:28 |
| *** efried has quit IRC | 12:28 | |
| *** mchlumsky has joined #openstack-nova | 12:29 | |
| *** efried has joined #openstack-nova | 12:29 | |
| *** dpawlik has quit IRC | 12:29 | |
| *** jamesdenton has quit IRC | 12:48 | |
| openstackgerrit | Jose Castro Leon proposed openstack/nova master: Fix get_device_path from network mounted volume https://review.openstack.org/590188 | 12:48 |
| *** jamesdenton has joined #openstack-nova | 12:49 | |
| *** josecastroleon has quit IRC | 12:52 | |
| *** jamesdenton has quit IRC | 12:52 | |
| *** alexchadin has quit IRC | 12:52 | |
| *** TheJulia is now known as needssleep | 12:55 | |
| *** tikitavi has quit IRC | 12:55 | |
| *** edleafe has joined #openstack-nova | 12:56 | |
| *** jamesdenton has joined #openstack-nova | 12:57 | |
| *** maciejjozefczyk has joined #openstack-nova | 12:58 | |
| *** dpawlik has joined #openstack-nova | 12:58 | |
| *** janki has quit IRC | 13:08 | |
| *** cdent has joined #openstack-nova | 13:09 | |
| *** janki has joined #openstack-nova | 13:12 | |
| *** efried is now known as fried_rice | 13:12 | |
| fried_rice | mriedem: I thought there was a reason we don't claim shelve support. edmondsw? | 13:13 |
| fried_rice | kosamara, sean-k-mooney: It would not be for something like CUSTOM_LIBVIRT_HW_CPU_X86_AVX. The purpose of the separation is so that an operator doesn't attempt to "spoof" some capability that the compute doesn't really have. (Or, easier to manage, if the operator removes a trait the compute really does have - by accident or on purpose - the driver should restore it.) | 13:17 |
| fried_rice | Namespacing is an easy way to do it with custom traits, but I agree having the driver name in there is potentially problematic. The reason I did that was exactly so that it wouldn't conflict with traits we standardized later on. | 13:18 |
| fried_rice | Because I was implementing in an OOT driver :) | 13:18 |
| fried_rice | So if I start with CUSTOM_POWERVM_IOSLOT_VENDOR_ID_XXXX and then we integrate into nova where it becomes POWERVM_DEVICE_VENDOR_ID_XXXX they can both coexist, and when we've had enough time for people to migrate over to the new one, we can remove the old one. | 13:19 |
| fried_rice | But I agree this is also problematic for standard traits. | 13:20 |
| fried_rice | The other obvious way to do it is for the driver to maintain a comprehensive list of all the traits it owns - i.e. all the traits it could *ever* decide to set. | 13:20 |
| fried_rice | And on every iteration, it needs to go through that list and unset any of those traits that shouldn't be set, and set the ones that should. | 13:21 |
| edmondsw | fried_rice mriedem I think we can change that to say shelve is supported | 13:25 |
| *** awaugama has joined #openstack-nova | 13:26 | |
| fried_rice | edmondsw: Cool, you going to propose? | 13:26 |
| edmondsw | fried_rice sure | 13:26 |
| openstackgerrit | Matthew Edmonds proposed openstack/nova master: comment correction for libvirt multiattach https://review.openstack.org/593050 | 13:29 |
| *** derekh has quit IRC | 13:38 | |
| *** imacdonn has quit IRC | 13:42 | |
| *** imacdonn has joined #openstack-nova | 13:42 | |
| openstackgerrit | Matthew Edmonds proposed openstack/nova master: Doc: PowerVM does support shelve https://review.openstack.org/593052 | 13:44 |
| edmondsw | fried_rice mriedem ^ | 13:44 |
| fried_rice | ack | 13:44 |
| fried_rice | edmondsw: Do we have a way to test that in the CI? | 13:45 |
| fried_rice | edmondsw: Or at least a local run? | 13:45 |
| *** erlon has quit IRC | 13:49 | |
| edmondsw | fried_rice I presume there are tempest tests for this... | 13:51 |
| fried_rice | edmondsw: I presume that too, but have not investigated. Guessing we could grep our blacklist? | 13:51 |
| openstackgerrit | Chen proposed openstack/nova master: Fix evacuate logging https://review.openstack.org/593055 | 13:53 |
| *** derekh has joined #openstack-nova | 13:53 | |
| *** dansmith is now known as steelydan | 13:58 | |
| *** steelydan is now known as SteelyDan | 13:58 | |
| *** Bhujay has quit IRC | 13:59 | |
| *** hoonetorg has quit IRC | 14:02 | |
| *** hoonetorg has joined #openstack-nova | 14:03 | |
| melwitt | . | 14:04 |
| *** cdent has quit IRC | 14:05 | |
| fried_rice | ō/ melwitt | 14:07 |
| *** gbarros has joined #openstack-nova | 14:09 | |
| *** hoonetorg has quit IRC | 14:09 | |
| *** derekh has quit IRC | 14:11 | |
| *** giblet is now known as gibi_off | 14:11 | |
| *** josecastroleon has joined #openstack-nova | 14:21 | |
| SteelyDan | sean-k-mooney: you confirmed that the new approach works for LB right? If so, can you comment on this patch? https://review.openstack.org/#/c/591735 | 14:30 |
| SteelyDan | *the new waiting during live migration approach | 14:30 |
| *** hoonetorg has joined #openstack-nova | 14:34 | |
| *** maciejjozefczyk has quit IRC | 14:43 | |
| *** r-daneel has joined #openstack-nova | 14:44 | |
| *** janki has quit IRC | 14:46 | |
| *** jamesdenton has quit IRC | 14:46 | |
| *** rpittau has quit IRC | 14:54 | |
| *** r-daneel has quit IRC | 15:00 | |
| *** cburgess has quit IRC | 15:02 | |
| *** dpawlik has quit IRC | 15:02 | |
| *** cburgess has joined #openstack-nova | 15:03 | |
| *** cdent has joined #openstack-nova | 15:05 | |
| *** josecastroleon has quit IRC | 15:06 | |
| *** cburgess has quit IRC | 15:08 | |
| *** cburgess has joined #openstack-nova | 15:09 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP Add regression for bug 1787606 https://review.openstack.org/593073 | 15:14 |
| openstack | bug 1787606 in OpenStack Compute (nova) "Multi instance creation rescheduling fails due to a lack of alternates" [Undecided,New] https://launchpad.net/bugs/1787606 | 15:14 |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP scheduler: Only skip the selected host when finding alternates https://review.openstack.org/593074 | 15:14 |
| cdent | melwitt, SteelyDan: Do either of you recall if this be taken back to ocata standalone or the whole stack associated with topic is needed? | 15:18 |
| cdent | melwitt, SteelyDan https://review.openstack.org/#/c/580498/ | 15:19 |
| SteelyDan | cdent: needs to be taken? was taken? | 15:19 |
| melwitt | cdent: if that can be taken standalone? | 15:20 |
| cdent | can be, sorry | 15:20 |
| cdent | looks like probably not, but the commit message kind of implies maybe it could | 15:20 |
| SteelyDan | I dunno, I'd have to look pretty closely, because ocata had very different allocation behavior | 15:21 |
| SteelyDan | so in general I would expect few things that applied to pike to apply directly to ocata | 15:21 |
| cdent | yeah. | 15:21 |
| melwitt | yeah, that's what I wasn't sure about, since a lot of foundational stuff was done in pike, whether this does the right thing on its own without other pike changes in placement | 15:22 |
| SteelyDan | placement didn't change as a result of this, | 15:23 |
| *** erlon has joined #openstack-nova | 15:23 | |
| SteelyDan | it was the difference in how/where nova does the allocations in placement in ocata vs. pike | 15:23 |
| melwitt | that is, why wasn't this proposed to ocata along with pike, if there was a reason for that | 15:23 |
| SteelyDan | like, the doubling of the allocations for a migation | 15:23 |
| melwitt | usually things get backported to all applicable places at the same time | 15:24 |
| SteelyDan | although I guess if you're deleting an instance you should delete both | 15:24 |
| SteelyDan | cdent: are you in a hurry such that waiting to ask matt isn't reasonable? | 15:24 |
| SteelyDan | not sure he'll remember more, but.. | 15:25 |
| cdent | SteelyDan: no, not in a super rush, just happened to cross my radar because of some internal flim flammery | 15:25 |
| cdent | i'm going to see what happens if I try to pick just it | 15:25 |
| SteelyDan | in ocata the compute node is authoritative over the allocations, | 15:26 |
| SteelyDan | but even post pike it will be for deleted instances only, | 15:26 |
| SteelyDan | so I'm not positive why this was even a thing on pike | 15:26 |
| *** slaweq has quit IRC | 15:27 | |
| melwitt | what do you mean? the compute node will remove allocations for a local deleted instance on pike? | 15:27 |
| melwitt | via auto-heal or something? | 15:27 |
| SteelyDan | yes, | 15:28 |
| SteelyDan | it used to always auto-heal everything, | 15:28 |
| SteelyDan | but as of pike it should only do it for deleted instances once all the ocata computes are gone | 15:28 |
| cdent | looking a bit more closely, it seems the real issue on the internal discussion is this part of the bug fix: https://review.openstack.org/#/c/580499/ , for cleaning up host mappings | 15:28 |
| SteelyDan | let me see if I an find that | 15:28 |
| melwitt | I see | 15:28 |
| openstackgerrit | melanie witt proposed openstack/nova stable/rocky: add zvm into support matrix https://review.openstack.org/593079 | 15:28 |
| openstackgerrit | melanie witt proposed openstack/nova stable/rocky: Add zvm admin intro and hypervisor information https://review.openstack.org/593080 | 15:28 |
| openstackgerrit | melanie witt proposed openstack/nova stable/rocky: Add zvm CI information https://review.openstack.org/593081 | 15:28 |
| SteelyDan | melwitt: https://github.com/openstack/nova/blob/stable/pike/nova/compute/resource_tracker.py#L1249-L1258 | 15:29 |
| SteelyDan | melwitt: prior to pike, the other conditions in that heal/check loop would heal things, but as of pike only the instance.deleted one would | 15:29 |
| SteelyDan | because as of pike the scheduler/conductor/api are authoritative for allocations | 15:30 |
| melwitt | a-ha, thanks | 15:30 |
| cdent | le sigh. it seems the root cause of the internal problem is: we messed various database tables and now things don't look like they should | 15:31 |
| * cdent flips table | 15:32 | |
| cdent | doctor it hurts when I punch myself! | 15:32 |
| *** tbachman has quit IRC | 15:32 | |
| fried_rice | Choke yourself instead. Self-limiting. | 15:35 |
| cdent | what you do in the privacy of your own home... | 15:39 |
| SteelyDan | hehe, thanks I was looking for how to acknowledge the kink | 15:40 |
| *** ShilpaSD_ has quit IRC | 15:42 | |
| cdent | said SteelyDan | 15:49 |
| SteelyDan | :) | 15:49 |
| *** tbachman has joined #openstack-nova | 15:59 | |
| *** r-daneel has joined #openstack-nova | 16:04 | |
| *** gbarros has quit IRC | 16:05 | |
| *** luksky has quit IRC | 16:06 | |
| *** jamesdenton has joined #openstack-nova | 16:20 | |
| *** macza has joined #openstack-nova | 16:23 | |
| *** fried_rice is now known as efried_pto | 16:29 | |
| *** sahid has quit IRC | 16:29 | |
| *** erlon has quit IRC | 16:34 | |
| SteelyDan | sean-k-mooney: did you see my query here earlier? | 16:35 |
| sean-k-mooney | oh am no ill scoll back | 16:35 |
| SteelyDan | (repeat) sean-k-mooney: you confirmed that the new approach works for LB right? If so, can you comment on this patch? https://review.openstack.org/#/c/591735 | 16:36 |
| sean-k-mooney | i confimed that the current code on master works. this is the queens backport of the same? | 16:37 |
| SteelyDan | sean-k-mooney: you don't need to confirm it separately for queens | 16:37 |
| SteelyDan | but if you could comment there I'd appreciate it | 16:37 |
| sean-k-mooney | yes ill just triple check i have the commit in question on the relevent nodes | 16:38 |
| *** tssurya has quit IRC | 16:38 | |
| SteelyDan | I think we've already established when the event is sent from neutron in the LB case, so it really shouldn't even be an issue, but... | 16:38 |
| sean-k-mooney | yep i have the master change on both linux bidge node an the conf change. ill comment to that effect | 16:39 |
| *** jpena is now known as jpena|off | 16:40 | |
| *** pas-ha has quit IRC | 16:41 | |
| *** pas-ha has joined #openstack-nova | 16:42 | |
| *** links has quit IRC | 16:43 | |
| sean-k-mooney | speaking of LM testing i should work on that email to the list. | 16:47 |
| *** davidsha has quit IRC | 16:48 | |
| *** gyee has joined #openstack-nova | 16:52 | |
| melwitt | SteelyDan: docs changes for rc2 proposed starting here https://review.openstack.org/593079 if you could pls take a look | 16:57 |
| melwitt | backports | 16:57 |
| SteelyDan | ugh okay, I'll add it to the list | 16:57 |
| melwitt | thanks | 16:57 |
| *** sambetts is now known as sambetts|afk | 17:09 | |
| SteelyDan | melwitt: don't we know that zvm doesn't support rebuild? | 17:11 |
| melwitt | SteelyDan: mriedem asked them to change it from missing => unknown because since they support spawn and destroy, it sounds like it could work https://review.openstack.org/#/c/532720/8/doc/source/user/support-matrix.ini@378 | 17:14 |
| melwitt | but they aren't testing that path, so "unknown" | 17:15 |
| SteelyDan | it's not implemented in the driver, and untested, which sounds a lot more like "unsupported" than "maybe it'll work if code we wrote long ago to handle it for normal hypervisors, which zvm is not" | 17:17 |
| SteelyDan | but.. okay | 17:17 |
| melwitt | yeah, I think that's why they put "missing" initially | 17:18 |
| SteelyDan | ...yeah | 17:18 |
| SteelyDan | so glad we added this | 17:18 |
| SteelyDan | so are we looking for fast approvals on these I assume? | 17:19 |
| SteelyDan | or do you want to wait for another stabler on monday? | 17:19 |
| melwitt | I was thinking mriedem could get them on monday | 17:19 |
| melwitt | I wanted them to be ready to go. I wasn't sure if we need to fast approve | 17:20 |
| melwitt | I guess I could ask smcginnis | 17:20 |
| SteelyDan | you know better than I at this point when rc2 will be, which is why I'm asking | 17:21 |
| melwitt | final RCs are due Aug 23, so AFAIK we are fine until then | 17:22 |
| *** luksky has joined #openstack-nova | 17:26 | |
| *** dpawlik has joined #openstack-nova | 17:36 | |
| SteelyDan | ack | 17:37 |
| *** dpawlik has quit IRC | 17:40 | |
| *** awaugama has quit IRC | 17:47 | |
| *** awaugama has joined #openstack-nova | 17:56 | |
| * smcginnis looks around | 18:07 | |
| *** r-daneel_ has joined #openstack-nova | 18:07 | |
| *** r-daneel has quit IRC | 18:08 | |
| *** r-daneel_ is now known as r-daneel | 18:08 | |
| smcginnis | melwitt: The question was whether to do another RC? | 18:08 |
| melwitt | smcginnis: no, question was, should we be looking at fast-approving doc backports to stable/rocky for RC2 today (other stable cores are not around) or is it fine to wait until monday? | 18:14 |
| melwitt | my understanding is final RCs are due Aug 23, so there isn't a rush. but please correct me if I'm wrong | 18:15 |
| smcginnis | melwitt: That's correct. You have until next Thursday if there is a need to do another RC. | 18:18 |
| melwitt | ok thank you | 18:19 |
| smcginnis | melwitt: So if there isn't a need to get that proposed RC2 out right away, and you know there's likely to be more, it might make sense to hold off on that for now and just do the RC2 next week. | 18:19 |
| smcginnis | melwitt: But if there is a need to get the commits since RC1 out there right away, we can definitely do RC2 now and another RC3 next week. | 18:19 |
| smcginnis | In general we just like to minimize the number of RCs, but practically it doesn't really matter too much. | 18:20 |
| melwitt | I see. thanks, that's helpful | 18:20 |
| mnaser | super unrelated, but have you seen 'sh: write error: No space left on device' in console logs for cirros in tempest much? | 18:24 |
| mnaser | i'm having problems with the (i think) last issue to get centos passing on openstack ansible, it's failing to ssh to the floating ip with a timeout .. http://logs.openstack.org/78/590778/6/check/openstack-ansible-deploy-aio_metal-centos-7/fdd9d28/logs/openstack/aio1-utility/stestr_results.html | 18:24 |
| mnaser | the console logs seem to show that it fails to add teh default route and out of space writing things on disk | 18:24 |
| melwitt | anecdotally, I've run out of disk space using ubuntu cloud images with devstack + ceph because the devstack-plugin-ceph defaults to 8GB disk space and the ubuntu xenial cloud image comes with 10GB disk space by default | 18:26 |
| melwitt | not sure where you're getting your images from but it could be something like that? I dunno | 18:26 |
| mnaser | we're using cirros qcow2 images, so i think it shouldn't be too wildly different | 18:27 |
| mnaser | xenial works fine which makes me a bit curious | 18:27 |
| melwitt | oh, right I see, you're saying image is same, host OS is different | 18:28 |
| mnaser | yes | 18:28 |
| melwitt | yeah, I haven't heard about that before | 18:28 |
| mnaser | i can see the floating ip getting assigned successfully too, ill dig in some more | 18:29 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Batch results per cell when doing cross-cell listing https://review.openstack.org/592698 | 18:32 |
| openstackgerrit | Dan Smith proposed openstack/nova master: WIP: Make instance_list perform per-cell batching https://review.openstack.org/593131 | 18:32 |
| *** eharney has quit IRC | 18:33 | |
| SteelyDan | melwitt: ^ split that patch and also put ideas for how to configure this in the second one | 18:33 |
| SteelyDan | which you might want to opine on | 18:33 |
| melwitt | coolness, adding to my list | 18:36 |
| *** cseader has joined #openstack-nova | 18:39 | |
| *** josecastroleon has joined #openstack-nova | 18:40 | |
| *** gyee has quit IRC | 18:43 | |
| *** r-daneel_ has joined #openstack-nova | 18:43 | |
| *** r-daneel has quit IRC | 18:44 | |
| *** r-daneel_ is now known as r-daneel | 18:44 | |
| *** r-daneel has quit IRC | 18:46 | |
| *** josecastroleon has quit IRC | 18:49 | |
| * melwitt will bbl | 19:02 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Batch results per cell when doing cross-cell listing https://review.openstack.org/592698 | 19:06 |
| openstackgerrit | Dan Smith proposed openstack/nova master: WIP: Make instance_list perform per-cell batching https://review.openstack.org/593131 | 19:06 |
| *** cdent has quit IRC | 19:13 | |
| *** r-daneel has joined #openstack-nova | 19:15 | |
| *** owalsh_ has joined #openstack-nova | 19:16 | |
| *** owalsh has quit IRC | 19:20 | |
| *** owalsh_ has quit IRC | 19:20 | |
| *** owalsh has joined #openstack-nova | 19:21 | |
| *** owalsh_ has joined #openstack-nova | 19:32 | |
| *** owalsh has quit IRC | 19:35 | |
| *** owalsh has joined #openstack-nova | 19:36 | |
| *** owalsh_ has quit IRC | 19:37 | |
| *** jamesdenton has quit IRC | 19:46 | |
| *** erlon has joined #openstack-nova | 19:47 | |
| *** nicolasbock has quit IRC | 19:50 | |
| *** eharney has joined #openstack-nova | 19:51 | |
| *** nicolasbock has joined #openstack-nova | 19:55 | |
| openstackgerrit | Joshua Harlow proposed openstack/nova master: Add exact match aggregate image properties matcher/filter https://review.openstack.org/593167 | 20:17 |
| openstackgerrit | Joshua Harlow proposed openstack/nova master: Add exact match aggregate image properties matcher/filter https://review.openstack.org/593167 | 20:18 |
| openstackgerrit | Joshua Harlow proposed openstack/nova master: Add exact match aggregate image properties matcher/filter https://review.openstack.org/593167 | 20:18 |
| openstackgerrit | Joshua Harlow proposed openstack/nova master: Add exact match aggregate image properties matcher/filter https://review.openstack.org/593167 | 20:27 |
| *** awaugama has quit IRC | 20:37 | |
| *** erlon has quit IRC | 20:41 | |
| needssleep | Out of curiosity, have any changes merged to resource tracking in say the last couple days? | 20:51 |
| needssleep | on the current state of master branch | 20:51 |
| needssleep | http://logs.openstack.org/87/592387/1/check/ironic-inspector-tempest-dsvm-python3/3aba945/logs/screen-n-cpu.txt.gz#_Aug_16_14_31_27_527100 is why I'm curious | 20:51 |
| *** erlon has joined #openstack-nova | 20:56 | |
| openstackgerrit | Joshua Harlow proposed openstack/nova master: Add exact match aggregate image properties matcher/filter https://review.openstack.org/593167 | 20:57 |
| *** marvin_mhg has joined #openstack-nova | 21:00 | |
| *** gbarros has joined #openstack-nova | 21:04 | |
| *** masayukig has quit IRC | 21:10 | |
| *** jianghuaw_ has quit IRC | 21:20 | |
| openstackgerrit | Dmitry Sutyagin proposed openstack/nova-specs master: Allow disabling KSM / mem-merge via extra spec https://review.openstack.org/593197 | 21:25 |
| mnaser | ok, managed to resolve that first issue but now | 21:36 |
| mnaser | http://logs.openstack.org/78/590778/7/gate/openstack-ansible-deploy-aio_metal-opensuse-423/a4388cf/logs/openstack/aio1-nova/nova-compute.log.txt.gz (warning, large log file as usual) | 21:36 |
| mnaser | the instance gets setup, started paused, resumes (twice?) and pauses again | 21:36 |
| mnaser | afaik.. normal behaviour is that it just goes paused => resumed ? | 21:37 |
| mnaser | instance id 51f86e01-8372-4a6f-b9aa-4af75b6d9bf8 if it helps looking at logs | 21:37 |
| mnaser | http://logs.openstack.org/78/590778/7/gate/openstack-ansible-deploy-aio_metal-opensuse-423/a4388cf/logs/openstack/aio1-nova/nova-compute.log.txt.gz#_2018-08-17_21_05_55_514 | 21:37 |
| mnaser | well, libvirt logs show it going from paused to resumed to paused http://paste.openstack.org/show/728337/ | 21:41 |
| mnaser | http://logs.openstack.org/78/590778/7/gate/openstack-ansible-deploy-aio_metal-opensuse-423/a4388cf/logs/host/libvirt/qemu/instance-00000001.log.txt.gz hmm | 21:41 |
| *** erlon has quit IRC | 21:42 | |
| *** gbarros_ has joined #openstack-nova | 21:43 | |
| *** gbarros has quit IRC | 21:44 | |
| *** nicolasbock has quit IRC | 21:59 | |
| *** gbarros_ has quit IRC | 22:16 | |
| *** gbarros has joined #openstack-nova | 22:16 | |
| *** gbarros has quit IRC | 22:17 | |
| *** macza has quit IRC | 22:56 | |
| *** r-daneel has quit IRC | 23:01 | |
| *** luksky has quit IRC | 23:25 | |
| openstackgerrit | Merged openstack/nova master: comment correction for libvirt multiattach https://review.openstack.org/593050 | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!