| fzzf[m] | hi folks. I use nodepool connect openstack provider. in openstack, nova build instance failed. and nova list show instance is in BUILD state. and I can't delete it.... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/JmBToOhokPkttSFIalLvbSEy) | 01:00 |
|---|---|---|
| opendevreview | Jorhson Deng proposed openstack/nova master: Reset the instance's task_state to None when the status is error https://review.opendev.org/c/openstack/nova/+/838991 | 01:33 |
| fzzf[m] | * hi folks. I use nodepool connect openstack provider. in openstack, nova build instance failed. and nova list show instance is in BUILD state. and I can't delete it.... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/nhRIVjZthAjNvxgkNkdUczzV) | 03:28 |
| *** mfo is now known as Guest2832 | 05:39 | |
| *** mfo_ is now known as mfo | 05:39 | |
| *** amoralej|off is now known as amoralej | 07:11 | |
| Uggla | Good morning. o/ | 07:18 |
| bauzas | Uggla: good morning | 07:37 |
| gibi | o/ | 08:31 |
| sean-k-mooney | gmann: dansmith care to readd your +w for moving the fips job to c9s https://review.opendev.org/c/openstack/nova/+/831844/7 | 08:56 |
| fzzf[m] | hi folks. I use nodepool connect openstack provider. nova build instance failed. and nova list show instance is in BUILD state like follow. I delete it prompt No server with a name or ID. and in dashboard show have use these two instance, 8 vcpu, 16g memory, openstack is packstack train ,nova is 15.1.1... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/cXVvKGZbhOphiZZcinYshnCe) | 09:30 |
| opendevreview | Balazs Gibizer proposed openstack/nova stable/train: Reproduce bug 1953359 https://review.opendev.org/c/openstack/nova/+/839353 | 10:30 |
| opendevreview | Balazs Gibizer proposed openstack/nova stable/train: Extend the reproducer for 1953359 and 1952915 https://review.opendev.org/c/openstack/nova/+/839354 | 10:30 |
| opendevreview | Balazs Gibizer proposed openstack/nova stable/train: [rt] Apply migration context for incoming migrations https://review.opendev.org/c/openstack/nova/+/839355 | 10:30 |
| gibi | bauzas: I'm not when you clean up the nova meeting agenda but I now added a topic for Open Discussion for this week's meeting | 11:03 |
| gibi | * I'm not sure | 11:03 |
| sean-k-mooney | artom: by the way while you are fixing revert if you feel like updating https://review.opendev.org/c/openstack/nova/+/750217/2 i would not object. i should really get back to that but have not had the time | 11:10 |
| opendevreview | Andrew Bonney proposed openstack/nova master: Fix segment-aware scheduling permissions error https://review.opendev.org/c/openstack/nova/+/839361 | 11:22 |
| sean-k-mooney | woot! just tested cold migration with vdpa on real hardware with my WIP patch and it indeed worked as the func tests said it should | 11:57 |
| sean-k-mooney | i need to test every thing else and then reivew the logs but this is a good sign | 11:58 |
| sean-k-mooney | shelve and resize work too | 12:01 |
| *** dasm|off is now known as dasm | 12:04 | |
| *** amoralej is now known as amoralej|lunch | 12:05 | |
| sean-k-mooney | evacuate works too and the device is correctly released if/when the source host is started after the evac | 12:09 |
| sean-k-mooney | so that is all the move ops that should work exluding live-migration which qemu does not support | 12:10 |
| sean-k-mooney | ok suspend is broken but that fine that is going to be split into another patch anyway and i am pretty sure i know why that is broken anyway. im using the generic pci device detach function and i shoudl be using the interface detach version since vdpa devices ues the interface not host dev elements like normal sriov vfs | 12:12 |
| gibi | sean-k-mooney: nice! | 12:14 |
| sean-k-mooney | im really happy i was able to more or less prove this out with the functional tests ahead of time | 12:16 |
| sean-k-mooney | i kindof expected suspend to fail too which is why i wanted to test this on real hardware | 12:16 |
| Uggla | sean-k-mooney, I guess you manage to install ceph on top of Centos Stream. Any hints to fix that: nothing provides "libpython3.6m.so.1.0()(64bit) needed by ceph-mgr-2:16.2.7-0.el8.x86_64" | 12:25 |
| sean-k-mooney | Uggla: how are you isntalling ceph? with the devstack plugin or by hand? | 12:32 |
| sean-k-mooney | by the way that looks like you are just missin python3-devel | 12:33 |
| sean-k-mooney | also are you using centos stream 8 | 12:34 |
| sean-k-mooney | that is not supported anymore | 12:34 |
| Uggla | sean-k-mooney, devstack plugin (from manila local.conf example : https://docs.openstack.org/manila/latest/_downloads/e31f39ce83daac60c4348fde522cee1e/cephfs_local.conf) | 12:34 |
| sean-k-mooney | you should be using centos stream 9 | 12:34 |
| sean-k-mooney | openstack nolonger support python 3.6 | 12:34 |
| Uggla | sean-k-mooney, it is a stream9 | 12:34 |
| sean-k-mooney | libpython3.6 is python 3.6 | 12:34 |
| sean-k-mooney | centos stream 9 uses 3.9 | 12:35 |
| Uggla | for anyreason it seems the plugin is trying to install a pkg from centos 8 | 12:35 |
| Uggla | Problem: package ceph-2:16.2.7-0.el8.x86_64 requires ceph-mgr = 2:16.2.7-0.el8 but it is clearly a stream 9. I'm gonna have a look where the ceph package comes from. | 12:37 |
| sean-k-mooney | i dont think they have added centos stream 9 support to the devstack plugin yet | 12:38 |
| sean-k-mooney | just looking at the code | 12:38 |
| sean-k-mooney | i was using ubutnu 20.04 for my ceph testing | 12:38 |
| sean-k-mooney | you can set CEPH_CONTAINERIZED=True in your local.conf | 12:39 |
| sean-k-mooney | that might fix the issue for you | 12:39 |
| Uggla | sean-k-mooney, it install this repo : https://download.ceph.com/rpm-pacific/el8/$basearch | 12:39 |
| sean-k-mooney | yes | 12:40 |
| sean-k-mooney | https://opendev.org/openstack/devstack-plugin-ceph/src/branch/master/devstack/lib/ceph#L31 | 12:40 |
| sean-k-mooney | that is contolled by that ^ | 12:40 |
| sean-k-mooney | Uggla: you should have hit this check https://opendev.org/openstack/devstack-plugin-ceph/src/branch/master/devstack/lib/ceph#L271-L28 | 12:41 |
| sean-k-mooney | you ar enot running a supported os | 12:41 |
| Uggla | sean-k-mooney, yep I had to add FORCE_CEPH_INSTALL=yes | 12:43 |
| sean-k-mooney | ya that is why this is failing | 12:43 |
| sean-k-mooney | so the repo config is contoled by https://opendev.org/openstack/devstack-plugin-ceph/src/branch/master/devstack/lib/ceph#L913-L943 | 12:43 |
| bauzas | gibi: ack, thanks | 12:43 |
| sean-k-mooney | Uggla: that is currently hardcoded to el8 | 12:44 |
| sean-k-mooney | https://opendev.org/openstack/devstack-plugin-ceph/src/branch/master/devstack/lib/ceph#L1144 | 12:44 |
| Uggla | sean-k-mooney, yep but in the repo there is no el9. | 12:44 |
| sean-k-mooney | ya i see that | 12:45 |
| Uggla | sean-k-mooney, CEPH_CONTAINERIZED=True, will install ceph in a container ? | 12:46 |
| sean-k-mooney | yep | 12:46 |
| sean-k-mooney | https://opendev.org/openstack/devstack-plugin-ceph/src/branch/master/devstack/lib/ceph#L157-L174 | 12:46 |
| Uggla | sean-k-mooney, do you think it will work ? | 12:47 |
| sean-k-mooney | so it will install ceph in a container and dinstall just the ceph client on the host form ceph_common | 12:47 |
| Uggla | sean-k-mooney, I'm going to try... | 12:47 |
| sean-k-mooney | i think it will be the only way to install ceph currently on centos 9 stream | 12:47 |
| sean-k-mooney | Uggla: they are currently in the process or rewriting this plugin to use cephadm by the way | 12:48 |
| sean-k-mooney | that might add centos 9 support as a result | 12:48 |
| Uggla | sean-k-mooney, centos stream9 is currently a bit too more bleeding edge. :) | 12:49 |
| sean-k-mooney | that is generally not a good thing | 12:49 |
| sean-k-mooney | am so the way to work around this for centos 9 stream would be to use ceph form disto packages instead fo from upstream ceph | 12:49 |
| sean-k-mooney | https://buildlogs.centos.org/centos/9-stream/storage/x86_64/ceph-quincy/ | 12:49 |
| Uggla | sean-k-mooney, require docker of course any preference in between docker or podman ? | 12:50 |
| sean-k-mooney | it will install it | 12:51 |
| sean-k-mooney | it will use docker | 12:52 |
| sean-k-mooney | the simplest thing to do might be to implemtn centos 9 stream support int he plugin | 12:52 |
| Uggla | sean-k-mooney, I don't really like your "simplest" solution. :D | 12:53 |
| sean-k-mooney | Uggla: well we all maintian devstack together :) but ill talk to the devstack/qa folk and see if i can find time to add centos 9 support | 12:55 |
| sean-k-mooney | Uggla: must people dont use centos by the way | 12:55 |
| sean-k-mooney | so if a feature does not work on centos it generally falls to use to add it if we want to use it | 12:56 |
| Uggla | sean-k-mooney, I was kidding. That could be an interesting thing to do and learn. But not the simplest I think. | 12:57 |
| Uggla | sean-k-mooney, at least for me. | 12:57 |
| sean-k-mooney | try usign it form contianer for now | 12:59 |
| sean-k-mooney | manilla does not strictly need ceph and you do not need ceph for your manilla share work | 13:00 |
| sean-k-mooney | so you can go back to just using cinder lvm for now until you ahve the basic supprot working | 13:00 |
| sean-k-mooney | and look at using ceph later | 13:00 |
| sean-k-mooney | i.e. deploy manila with cinder lvm and use nfs shares initally | 13:01 |
| sean-k-mooney | then when we figure out how to deploy ceph on centos 9 and add supprot to devstack we can then extend the nova supprot to work with cephfs although that really should not need much code change in nova just mounting the share | 13:02 |
| Uggla | sean-k-mooney, yes and no. So for I focus on NFS. There are still things to fix but it seems I manage to mount the share into the VM using virtiofs + NFS. | 13:03 |
| Uggla | sean-k-mooney, I wanted to do the same for CEPHFS. | 13:03 |
| sean-k-mooney | ack | 13:04 |
| Uggla | sean-k-mooney, and yes from nova perspective, that sounds like not a major change. | 13:05 |
| Uggla | sean-k-mooney, however I'm not blocked. | 13:06 |
| fzzf[m] | > <@fzzfh:matrix.org> hi folks. I use nodepool connect openstack provider. nova build instance failed. and nova list show instance is in BUILD state like follow. I delete it prompt No server with a name or ID. and in dashboard show have use these two instance, 8 vcpu, 16g memory, openstack is packstack train ,nova is 15.1.1... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/oDINtdoeiJnrakEWVAWwmwho) | 13:11 |
| *** amoralej|lunch is now known as amoralej | 13:15 | |
| * Uggla root@demo2:/nene# mount | grep virtiofs | 13:39 | |
| Uggla | 44bf4c5e-b6ae-463d-9ed2-3d0177c1ee80 on /nene type virtiofs (rw,relatime) \o/ (I still have to fix stuff, but that's a milestone for me) | 13:39 |
| artom | *snerk* /nene | 13:41 |
| bauzas | gibi: good idea of creating an etherpad for https://etherpad.opendev.org/p/nova-bug-triage-20220419 | 14:05 |
| bauzas | gibi: do you want to discuss about this on the meeting ? | 14:05 |
| gibi | bauzas: I planned to link that to on the meeting for reference | 14:44 |
| bauzas | ok | 14:44 |
| gibi | bauzas: and I will ask if we want to make it a mail or keep it an etherpad | 14:45 |
| bauzas | mho is that etherpad is just enough | 14:45 |
| gibi | yeah I'm OK with this being a pads | 14:47 |
| *** lbragstad8 is now known as lbragstad | 15:05 | |
| bauzas | gentle reminder : nova meeting in 45 mins by now here at #openstack-nova | 15:16 |
| *** xek_ is now known as xek | 15:23 | |
| opendevreview | ribaudr proposed openstack/nova master: [WIP] Attach Manila shares via virtiofs (db) https://review.opendev.org/c/openstack/nova/+/831193 | 15:30 |
| opendevreview | ribaudr proposed openstack/nova master: [WIP] Attach Manila shares via virtiofs (manila abstraction) https://review.opendev.org/c/openstack/nova/+/831194 | 15:30 |
| opendevreview | ribaudr proposed openstack/nova master: [WIP] Attach Manila shares via virtiofs (drivers) https://review.opendev.org/c/openstack/nova/+/833090 | 15:30 |
| opendevreview | ribaudr proposed openstack/nova master: [WIP] Attach Manila shares via virtiofs (api) https://review.opendev.org/c/openstack/nova/+/836830 | 15:30 |
| opendevreview | ribaudr proposed openstack/nova master: [WIP] Attach Manila shares via virtiofs (objects) https://review.opendev.org/c/openstack/nova/+/839401 | 15:30 |
| bauzas | Uggla: bravo ^ | 15:40 |
| * bauzas needs to do a review round | 15:40 | |
| Uggla | bauzas, still work to do... but I'm slowly progressing. ;) | 15:41 |
| gibi | Uggla: it is not slow at all :D | 15:42 |
| gibi | this is a major feature | 15:42 |
| bauzas | gibi: I may need to leave at 6:30pm our time, ie. 30 mins after the beginning of the meeting | 15:50 |
| bauzas | gibi: are you ok if I can pass you the meeting baton if I need to quit ? | 15:51 |
| gibi | sure I can take it | 15:52 |
| Uggla | gibi, thanks to reassure me. | 15:58 |
| bauzas | gibi: thanks | 15:59 |
| bauzas | gosh, forgot the 2nd reminder for the meeting | 15:59 |
| bauzas | too late | 15:59 |
| bauzas | #startmeeting nova | 16:00 |
| opendevmeet | Meeting started Tue Apr 26 16:00:04 2022 UTC and is due to finish in 60 minutes. The chair is bauzas. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| opendevmeet | The meeting name has been set to 'nova' | 16:00 |
| gibi | o/ | 16:00 |
| bauzas | ehlo compute-ers | 16:00 |
| bauzas | #link https://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting | 16:00 |
| Uggla | o/ | 16:01 |
| elodilles | o/ | 16:01 |
| bauzas | okay, let's start, people could come, once they're undragged from some internal big meeting :) | 16:03 |
| gmann | o/ | 16:03 |
| bauzas | #topic Bugs (stuck/critical) | 16:03 |
| bauzas | damn | 16:03 |
| bauzas | #topic Bugs (stuck/critical) | 16:03 |
| bauzas | #info No Critical bug | 16:03 |
| bauzas | #link https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New 28 new untriaged bugs (-7 since the last meeting) | 16:03 |
| bauzas | kudos to gibi for this hard work | 16:03 |
| bauzas | #link https://storyboard.openstack.org/#!/project/openstack/placement 26 open stories (0 since the last meeting) in Storyboard for Placement | 16:03 |
| bauzas | #info Add yourself in the team bug roster if you want to help https://etherpad.opendev.org/p/nova-bug-triage-roster | 16:04 |
| bauzas | gibi: wanted to discuss about the bugs you triaged before we look at next week bug baton owner ? | 16:04 |
| gibi | just a small link | 16:04 |
| gibi | https://etherpad.opendev.org/p/nova-bug-triage-20220419 | 16:04 |
| gibi | I collected the triaged bugs here | 16:04 |
| gibi | I think the only interesting information is the bugs in triaged state without assignee | 16:04 |
| bauzas | as I said before, this is a good idea to keep some references, mostly about the incomplete | 16:05 |
| gibi | we have one this week | 16:05 |
| gibi | [Needs Assignee] Concurrent migration of vms with the same multiattach volume fails https://bugs.launchpad.net/nova/+bug/1968645 | 16:05 |
| bauzas | well, we have around 950 open bugs | 16:05 |
| gibi | yeah, but at least this is a fresh one :) | 16:05 |
| gibi | probably the reporter is still around if we have questions :) | 16:05 |
| bauzas | gibi: what we could agree on is to find some volunteer for only high bugs that just got triaged | 16:06 |
| gibi | I think it is worth to advertise these bugs but I agree that we don't have to forcefully assign it | 16:06 |
| bauzas | sounds a low hanging fruit | 16:06 |
| bauzas | if this is about adding a retry loop | 16:07 |
| gibi | yeah, it does not seem super hard | 16:07 |
| gibi | yepp it is a retry loop | 16:07 |
| gibi | for cinder attachment create | 16:07 |
| gibi | anyhow we can move on :) | 16:07 |
| gibi | I'm ready to pass the baton | 16:08 |
| bauzas | gibi: I'll then add the low-hanging-fruit tag | 16:08 |
| gibi | bauzas: works of me | 16:08 |
| bauzas | this may help | 16:08 |
| gibi | *for | 16:09 |
| bauzas | gibi: nah, it worked *of* you as you proposed the solution :) | 16:10 |
| bauzas | anyway, this leads to the last point | 16:10 |
| bauzas | melwitt: around ? | 16:10 |
| melwitt | yes | 16:11 |
| bauzas | melwitt: you're next in the bug triage roster | 16:11 |
| bauzas | melwitt: do you feel brave enough to get the bug baton ? | 16:11 |
| melwitt | bauzas: haha, yes. sounds cool | 16:12 |
| bauzas | as a reminder for everyone, this baton doesn't imply any matter of ownership or responsibility | 16:12 |
| bauzas | anyone wanting to help is welcome, based on his or her free time | 16:12 |
| bauzas | and others may help if they want | 16:13 |
| bauzas | melwitt: which leads to me saying you can ping me if you need help for upstream triage | 16:13 |
| melwitt | cool, thanks | 16:13 |
| bauzas | #info Next bug baton is passed to melwitt | 16:13 |
| bauzas | melwitt: thanks, very much appreciated | 16:13 |
| bauzas | next topic then, | 16:13 |
| bauzas | #topic Gate status | 16:14 |
| bauzas | #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs | 16:14 |
| bauzas | #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs | 16:14 |
| bauzas | #link https://zuul.openstack.org/builds?project=openstack%2Fplacement&pipeline=periodic-weekly Placement periodic job status | 16:14 |
| bauzas | #link https://zuul.opendev.org/t/openstack/builds?job_name=nova-emulation&pipeline=periodic-weekly&skip=0 Emulation periodic job runs | 16:14 |
| bauzas | #info Please look at the gate failures and file a bug report with the gate-failure tag. | 16:14 |
| bauzas | that's been a while we got a new gate failure | 16:14 |
| gibi | I saw some intermittent one but had not time to dig in | 16:15 |
| gmann | for centos-8-stream, non voting job is failing 100% now. | 16:15 |
| gmann | As testing runtime for Zed is centos-9-stream and in QA we agreed to drop the c8s support in devstack as well as in Tempest, I have proposed the changes there and will notify it on ML also. also moving c8s job to c9s, please review it - https://review.opendev.org/c/openstack/nova/+/839275 | 16:15 |
| bauzas | thanks gmann | 16:15 |
| gmann | this series #link https://review.opendev.org/q/topic:drop-c8s-testing | 16:15 |
| bauzas | gmann: on my list, will vote on it later today or tomorrow | 16:16 |
| gmann | thanks, meanwhile I will get tempest depends-on merge | 16:16 |
| bauzas | cool | 16:17 |
| bauzas | I have to sit down and consider all the implications but your patch seems good to me | 16:17 |
| bauzas | and either way, ship is sailed | 16:17 |
| bauzas | centos9 is targeted for zed | 16:17 |
| gmann | yeah | 16:17 |
| bauzas | do we have any tracking LP bug about the centos8 failures ? | 16:18 |
| bauzas | ideally, I'd want those to be wontfix if we decide we move on | 16:18 |
| gmann | no bug as of now, we are going as per the testing runtime. and as we drop the py36 from projects then it is broken like for nova as of now | 16:19 |
| bauzas | ok | 16:19 |
| bauzas | then no paperwork to fill in | 16:19 |
| gmann | it is failing as in nova we made nova require >=py3.8 and other projects will do the same | 16:19 |
| bauzas | :) | 16:19 |
| bauzas | oh | 16:19 |
| bauzas | right | 16:19 |
| bauzas | anyway, I guess we can continue | 16:20 |
| gmann | yeah | 16:20 |
| bauzas | #info STOP DOING BLIND RECHECKS aka. 'recheck' https://docs.openstack.org/project-team-guide/testing.html#how-to-handle-test-failures | 16:21 |
| bauzas | just as a weekly periodic reminder (which includes me, stupid bias) | 16:21 |
| bauzas | next topic, | 16:21 |
| bauzas | #topic Release Planning | 16:21 |
| bauzas | #link https://releases.openstack.org/zed/schedule.html | 16:22 |
| bauzas | #info Zed-1 is due in 3 weeks | 16:22 |
| bauzas | tick-tock | 16:22 |
| artom | ♫ on the clock ♫ | 16:22 |
| * melwitt knows the reference and feels embarrassed :) | 16:22 | |
| bauzas | I said last week I should ask this week for a spec review day, but do people feel good about considering it for in two weeks ? | 16:23 |
| gibi | bah, I have to allocate some time to the placement PCI tracking spec | 16:23 |
| artom | No shame, those pop songs are earworms by design | 16:23 |
| bauzas | artom: but the party don't stop | 16:23 |
| artom | gibi, you have sean-k-mooney's original spec to work from, so not starting from scratch | 16:23 |
| gibi | artom: true true | 16:24 |
| * bauzas appreciates the english grammar mistake, btw. | 16:24 | |
| gibi | bauzas: I'm OK to have a review day next week or the week after | 16:24 |
| melwitt | :) | 16:24 |
| bauzas | gibi: I have to write some spec for deprecating the keypair generation, you know | 16:24 |
| bauzas | so | 16:24 |
| gibi | :) | 16:24 |
| bauzas | maybe saying a spec review day not next tuesday, but tuesday after that ? | 16:25 |
| bauzas | ie. May 10th ? | 16:25 |
| sean-k-mooney | the 10 ya that would be ok i think | 16:25 |
| bauzas | I see no objections | 16:26 |
| gibi | good for me | 16:26 |
| bauzas | #agreed first spec review day will happen on May 10th, bauzas to communicate thru the mailing list | 16:26 |
| bauzas | this leaves 2 weeks for people writing specs, you are warned | 16:27 |
| bauzas | (again, this includes me) | 16:27 |
| * gibi feels warned | 16:27 | |
| * bauzas feels gibi overfeels more than he should :) | 16:27 | |
| bauzas | we'll have another round of spec reviews, as we agreed last PTG, either way | 16:28 |
| bauzas | ok, next | 16:28 |
| bauzas | #topic Review priorities | 16:29 |
| bauzas | #link https://review.opendev.org/q/status:open+(project:openstack/nova+OR+project:openstack/placement+OR+project:openstack/os-traits+OR+project:openstack/os-resource-classes+OR+project:openstack/os-vif+OR+project:openstack/python-novaclient+OR+project:openstack/osc-placement)+label:Review-Priority%252B1 | 16:29 |
| bauzas | the vIOMMU change probably needs paperwork | 16:29 |
| bauzas | tl;dr: https://review.opendev.org/c/openstack/nova/+/830646 requires at least a blueprint, and maybe a spec | 16:30 |
| sean-k-mooney | ya i started to review it i kind of think it shoudl have a mini spec | 16:30 |
| melwitt | +1 | 16:30 |
| bauzas | I can use my hammer | 16:31 |
| bauzas | but I could soften it | 16:31 |
| bauzas | explaining we require a blueprint and some discussion at a nova meeting before we can pursue reviewing it | 16:31 |
| bauzas | ricolin: are you around ? | 16:31 |
| sean-k-mooney | im not againt the proposaly in fact i have wanted to add supprot for a while but we need to agree on the extra_specs/image propeties and define the scope | 16:32 |
| sean-k-mooney | i was recommening keeping it small for now | 16:32 |
| bauzas | yeah, and that's why we need a debate | 16:32 |
| bauzas | not about which paper stamp we should use | 16:32 |
| sean-k-mooney | there is viommu supprot with the limited chagne required for there acclerator to work | 16:33 |
| bauzas | but whether we all agree on the design | 16:33 |
| sean-k-mooney | and then there is full supprot with security and isolation | 16:33 |
| bauzas | correct, that's why we need to discuss this correctly and address the design scope | 16:33 |
| sean-k-mooney | i would suggest we split it like that and only do the former this cycle | 16:33 |
| bauzas | sean-k-mooney: well, we need a owner, at first :) | 16:34 |
| bauzas | even if we agree on the direction, we need gears | 16:34 |
| sean-k-mooney | yep mnaser also expressed interest. im not sure that stephenfin will work on it this cycle | 16:34 |
| bauzas | I'm sure stephenfin said he was okay to leave it for others to continue :) | 16:35 |
| bauzas | hence the gerrit hammer | 16:35 |
| bauzas | this may help people to react and assign some time for this | 16:35 |
| bauzas | I'll also drop the review-prio flag which is meaningless in this case as we can't merge it as it is | 16:36 |
| bauzas | ok, moving on if nobody yells | 16:37 |
| bauzas | #topic Stable Branches | 16:38 |
| bauzas | elodilles: your turn | 16:38 |
| elodilles | #info ussuri and older branches are blocked until 'l-c drop' patches merge - https://review.opendev.org/q/I514f6b337ffefef90a0ce9ab0b4afd083caa277e | 16:38 |
| elodilles | #info other branches should be OK | 16:38 |
| elodilles | #info nova projects' stable/victoria transitioned to Extended Maintenance - no further releases will be produced from victoria, but branch remains open to accept bug fixes | 16:38 |
| elodilles | and that's all I think ^^^ | 16:38 |
| melwitt | we need second core wink wink | 16:39 |
| elodilles | :] | 16:39 |
| gibi | I would be happy to approve... ;) | 16:39 |
| gibi | (has some blocked train backports :D) | 16:39 |
| bauzas | I can do things | 16:40 |
| bauzas | my brain fsck'd me | 16:40 |
| gibi | bauzas: ask elodilles to add me into the stable-core group | 16:40 |
| gibi | then I can help | 16:40 |
| bauzas | gibi: I think we said at the PTG I should propose your name against the stable team | 16:40 |
| gibi | yeah I think so | 16:41 |
| gibi | so lets do it :D | 16:41 |
| bauzas | so, | 16:41 |
| bauzas | #1 I'll do my homework and review such l-c patches | 16:41 |
| bauzas | #2 I'll do my duty and engage discussions about reconciling the nova team and the nova-stable team in some intelligent manner | 16:41 |
| bauzas | last topic in the agenda, | 16:43 |
| bauzas | #topic Open discussion | 16:43 |
| bauzas | (gibi) Allow claiming PCI PF if child VF is unavailable https://review.opendev.org/c/openstack/nova/+/838555 | 16:43 |
| bauzas | gibi: take the mic | 16:43 |
| gibi | thanks | 16:43 |
| gibi | so | 16:43 |
| gibi | it is a bug | 16:43 |
| gibi | we saw DB inconsistencies at customers | 16:43 |
| gibi | the pci_devices table contains available PF and unavailable children VF rows | 16:44 |
| gibi | this basically an impossible situation | 16:44 |
| gibi | the VF should be available if the PF is available | 16:44 |
| gibi | or the VF should be allocated | 16:45 |
| gibi | anyhow | 16:45 |
| gibi | I propsed a fix https://review.opendev.org/c/openstack/nova/+/838555 | 16:45 |
| gibi | it removes some of the strictness of the state check during the PCI claim | 16:45 |
| gibi | basically allows allocating the available PF if the children VFs are unavailable | 16:45 |
| gibi | this would heal the inconsistent DB state | 16:46 |
| gibi | artom had a good point in the review | 16:46 |
| gibi | that we tend to handle DB healing via nova-manage CLI instead | 16:46 |
| bauzas | not true | 16:46 |
| sean-k-mooney | we heal some things on object load form the db | 16:46 |
| bauzas | we had db healing made thru data migrations | 16:47 |
| artom | Right, but those fixes are from "we had thing X a long time ago, and it might still be in the DB, so now when we load it we convert to thing X" | 16:47 |
| sean-k-mooney | we do have the heal allcoation type commands but i think healing this on agent start is the right thing | 16:47 |
| bauzas | we only heal things thru the CLI if this is for example something due to some relationship between two DBs | 16:48 |
| artom | vs examples like placement-audit and Lee's connection_info update | 16:48 |
| sean-k-mooney | as we are also fixing the in memroy representation | 16:48 |
| bauzas | sean-k-mooney: correct, because two DBs were involved | 16:48 |
| artom | My other point was - the DB somehow got into an inconsistent state, wouldn't it be wiser to at least let the operator know, vs siltently fixing it? | 16:48 |
| bauzas | in the case of placement audit, this was about reconciling two datastores kept from two different projects | 16:48 |
| sean-k-mooney | artom: i dont think so | 16:49 |
| bauzas | I agree with sean-k-mooney | 16:49 |
| bauzas | we could log such thing | 16:49 |
| sean-k-mooney | artom: i think this happened beacue of how the custoemr recreated the compute node after the hdd died | 16:49 |
| bauzas | but no need to claim it loud | 16:49 |
| artom | OK :) Not a hill I want to die on, but wanted to at least raise the question | 16:49 |
| gibi | I've added a WARNING log in the patch | 16:49 |
| sean-k-mooney | i dont think this is something that most operators would hit | 16:49 |
| artom | Seems like I'm outnumbered :) | 16:49 |
| bauzas | artom: I won't ask you how many divisions you have | 16:50 |
| gibi | sean-k-mooney: one more thing, you said it should be fixed at agent restart. Now my patch fixes it during PCI claim | 16:50 |
| artom | bauzas, divisions o_O? | 16:50 |
| bauzas | gibi: I like the pci claim approach | 16:50 |
| sean-k-mooney | i have not reviewd the third patch yet | 16:51 |
| gibi | sean-k-mooney: and I have a separate patch for the agent restart + remove VF + inconsistent state case | 16:51 |
| gibi | sean-k-mooney: ahh, OK, let me know you opininon once you reviewed it | 16:51 |
| bauzas | artom: sorry, I'll DM you the reference :) | 16:51 |
| sean-k-mooney | ack we can proceed on the gerrit review | 16:51 |
| artom | It's going to be an obscure French thing, isn't it :P | 16:51 |
| gibi | artom, sean-k-mooney, bauzas: thanks, we can move on | 16:52 |
| bauzas | ++ | 16:52 |
| bauzas | sounds we got a consensus : review gibi's patch | 16:52 |
| gibi | I will comment on the patch linking to the meeting logs | 16:52 |
| bauzas | #agreed let's continue to review gibi's work with pci claims fixing the inconstitency | 16:53 |
| bauzas | that's all we had for the meeting | 16:53 |
| bauzas | any last minute item people wanna raise ? | 16:53 |
| bauzas | looks not, | 16:54 |
| gibi | - | 16:54 |
| bauzas | thanks all ! | 16:54 |
| gibi | thanks! | 16:54 |
| bauzas | #endmeeting | 16:54 |
| opendevmeet | Meeting ended Tue Apr 26 16:54:46 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:54 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/nova/2022/nova.2022-04-26-16.00.html | 16:54 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/nova/2022/nova.2022-04-26-16.00.txt | 16:54 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/nova/2022/nova.2022-04-26-16.00.log.html | 16:54 |
| elodilles | thanks o/ | 16:54 |
| gibi | bauzas: I hope you did not forget to leave around 18:30 :) | 16:54 |
| bauzas | gibi: well, I chose to stay :) | 16:55 |
| artom | He replaced himself with a very small shellscript | 16:55 |
| bauzas | Sophie will stare at me when I go off the office room | 16:55 |
| artom | Turns out we was getting bash'ed this whole time | 16:56 |
| gibi | artom: lol | 16:56 |
| bauzas | artom: I wish I could | 16:56 |
| bauzas | artom: but I've been told any IA bot turns crazy after you let people discussing with it | 16:57 |
| gibi | it is our, humans, fault to make AI bots crazy | 16:58 |
| artom | So we're to AIs what demons are to us, The Corruptors? | 16:58 |
| sean-k-mooney | lol | 16:58 |
| sean-k-mooney | but yes | 16:58 |
| gibi | at least the naming sounds badass | 16:58 |
| artom | "I'm a Corruptor" "What does that mean?" "Oh I make chatbots says rude words and stuff" | 16:59 |
| * bauzas leaves by now | 17:02 | |
| bauzas | or I could sleep on the couch | 17:02 |
| opendevreview | Merged openstack/nova master: Move centos stream testing to centos-9-stream https://review.opendev.org/c/openstack/nova/+/839275 | 20:36 |
| melwitt | bauzas: could you also add https://review.opendev.org/c/openstack/nova/+/821348 to your stable review list please? the -2 from zuul is bc I accidentally voted on it earlier | 21:15 |
| *** dasm is now known as dasm|off | 21:40 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!