Wednesday, 2022-10-05

opendevreviewMerged openstack/nova master: Remove the periodic Centos 8 job  https://review.opendev.org/c/openstack/nova/+/85827204:58
opendevreviewribaudr proposed openstack/nova master: Default Nova persistent objects without soft delete.  https://review.opendev.org/c/openstack/nova/+/85435508:13
Ugglastephenfin, if you have some time can you have a look at https://review.opendev.org/c/openstack/openstacksdk/+/85394908:22
Ugglagibi, bauzas , Hi so if you can have a look at https://review.opendev.org/c/openstack/nova/+/854355.08:55
bauzasUggla: I'll try, a bit busy today due to some late stuff 08:56
Ugglagibi, if you are motivated, then you can continue the review of manila/virtiofs all patches are under this new topic bp/manila_shares_attachments_v208:57
Ugglabauzas, I know, there is no hurry.08:58
opendevreviewSahid Orentino Ferdjaoui proposed openstack/nova master: compute: enhance compute evacuate instance to support target state  https://review.opendev.org/c/openstack/nova/+/85838308:58
opendevreviewSahid Orentino Ferdjaoui proposed openstack/nova master: api: extend evacuate instance to support target state  https://review.opendev.org/c/openstack/nova/+/85838408:58
bauzasUggla: so, I'll look at your patch, but I'll also like to have dansmith to dent it https://review.opendev.org/c/openstack/nova/+/85435509:37
gibiUggla: yes. I would like to keep reviewing the manila work. It is a bit hard for me to balance my time at the moment. So I would like to ask you to be peristent asking for review :) I won't be offended if you keep pinging me all the time with the manial stuff :)09:46
gibidansmith: if you have time when you are up we need your ovo experties here https://review.opendev.org/c/openstack/nova/+/854355/3..4#message-90730ecb520b41d974a8d64c7f7cd0bb0f56356c 10:05
gibiUggla: ^^ I see the problem but I don't see the imediate solution10:06
gibiand I don't like duplicating created_at10:06
gibiIt might turn out that what I want is not possible with ovo10:07
sean-k-mooney i feel like what you want should be possible10:12
sean-k-mooneybut i have not looked at the review properly10:12
sean-k-mooneyi might pull it locally quickly and play with it for a bit and see if we can drop those fields10:13
opendevreviewStephen Finucane proposed openstack/nova master: conf: Add '[database] enable_soft_delete' flag  https://review.opendev.org/c/openstack/nova/+/86040111:33
stephenfinI've been thinking about that for years 👆 Maybe it belongs in oslo.db but the idea is what's relevant. Would welcome input (particularly melwitt)11:34
sean-k-mooneystephenfin: you were not in some of our interal team calls but we were discussign coudl we move to remvoing shaddow tables11:51
sean-k-mooneysoft delete i dont have a probalem with honestly11:51
sean-k-mooneyi dont like shadown tables11:52
sean-k-mooneymy only concern with the conf approch is it change api behavior11:52
sean-k-mooneyspecificly for soft deleteing instance as we can use the restore api action to undelete them11:52
sean-k-mooneythere is no api impact to remvoe shadow tables however since once we have archive the rows there is no going back11:53
sean-k-mooneyso that seam less in vasive to me11:53
sean-k-mooneystephenfin: but yes removing softdelete is someting to consider. we could for example use the soft delete timout as the config option instead11:54
sean-k-mooneyso if its not enable dthen just delete thing fully11:54
sean-k-mooneyif we had already disabeld shadow tabels or remvoe them i think we could do that11:55
stephenfinsean-k-mooney: Aren't those different things?11:55
sean-k-mooneythere are 3 things11:55
stephenfinsoft-deleting an instance vs soft-deleteable tables11:55
sean-k-mooneysoft deleteing an instnace marks the row as deelte but does not actully delete it until the soft delete timeout expires11:56
stephenfinI don't think it does11:56
*** blarnath is now known as d34dh0r5311:56
sean-k-mooneyi woudl have to check but as far as im aware it at least updates teh state so that it nolonger shows up in insntace list11:56
sean-k-mooneyunless you add --deleted11:56
sean-k-mooneyif it truely is independed and not marking it as delete in the db11:57
stephenfinhttps://github.com/openstack/nova/blob/master/nova/compute/manager.py#L3363-L337711:57
sean-k-mooneythen yes the 3 things (shadown tabels, soft deletable instance and soft deletable rows) would be independent11:57
stephenfinit seems to be setting power_state, vm_state and task_state fields. It's not setting 'deleted' or 'deleted_at'11:58
sean-k-mooney ok so its via a vm state11:58
stephenfinyup11:58
stephenfinwhich this doesn't touch11:58
sean-k-mooneyok then ya no api impact so11:58
*** tbachman_ is now known as tbachman11:58
sean-k-mooneyadd it as a ptg topic11:58
sean-k-mooneyso long term i like to remvoe nova-manage acive_delete_rows and make pruge act like purge in other project11:59
sean-k-mooneyin other projects purge  it deletes the soft deleted rows12:00
sean-k-mooneybut if we can also remvoe those (optionally or eventually permently) i woudl be happy to do that too12:00
sean-k-mooneystephenfin: i think i have mentioned this to you before but i woudl prefer if we mvoed to recommendign peole use https://github.com/ovh/osarchiver/12:01
sean-k-mooneyso if they have audit usecases they woudl enable  soft-delete but use osarchiver to move them to there archival storage and out of our db12:02
sean-k-mooneyif you can do that we dont need shadow tabels. if you dont have that usecase then you can disabel the soft-delete feature12:03
sean-k-mooneyand upstream in B or C we could defautl to disabling it.12:04
stephenfinadded to the agenda12:05
sean-k-mooneycool im goign to summeries my toughts on the gerrit commit12:08
sean-k-mooneyok done https://review.opendev.org/c/openstack/nova/+/860401/1#message-6ff04f04d84a33ff65f08e6c3956ea194a2a915c hopefully that makes sense12:16
stephenfinlgtm12:24
sean-k-mooneyi like the idea of doing this in oslo too by the way but ya either could work12:43
*** kopecmartin is now known as kopecmartin|sick12:56
*** dasm|off is now known as dasm13:43
stephenfinUggla: I figured out what was wrong with https://review.opendev.org/c/openstack/nova/+/854355/ Do you mind if I push my changes?15:32
stephenfinI'm leaving a comment now too15:32
Ugglastephenfin, cool, no pb.15:33
Ugglastephenfin, btw did you have time to the openstacksdk patch ?15:33
stephenfinYeah, I think I +2d it15:34
Uggla\o/15:34
opendevreviewStephen Finucane proposed openstack/nova master: objects: Add NovaSoftDeleteObject mixin  https://review.opendev.org/c/openstack/nova/+/85435515:40
stephenfinUggla: lmk what you think ^15:40
Ugglastephenfin, i'll have a look after our meeting.15:46
opendevreviewStephen Finucane proposed openstack/nova master: rpc: Mark attributes as private  https://review.opendev.org/c/openstack/nova/+/79280315:47
melwittkashyap: the "abort live migration if monitoring fails" patch was to fail in a proper way when the error is encountered, there is another patch that needs review that will do the actual ignoring of the particular error https://review.opendev.org/c/openstack/nova/+/85200215:55
melwittkashyap: there was an issue with the patch I had proposed to workaround it, so I abandoned it. ^ is the new one from another contributor15:59
Ugglastephenfin, what you did in https://review.opendev.org/c/openstack/nova/+/854355/4..5, sounds good to me. Thank you. Now let's check if gibi, dansmith, bauzas agree.16:02
* bauzas looks when we deprecated16:02
bauzasI thought we said we haven't wanted to have API tables to be soft-deletable16:03
bauzasbut, we haven't said "yeah, we should deprecate the other tables"16:03
dansmithyeah16:05
dansmithI don't agree with the use of "deprecated" here16:05
dansmith"not recommended for everything by default" makes sense16:05
bauzasat least I'm afraid of saying "we deprecate instance record soft-deletion"16:07
dansmithwas there some decision to deprecate and actually remove this stuff? because I think I disagree with that16:07
*** labedz is now known as labedz_16:07
dansmithand if not, we should change the wording in the patch I think16:07
bauzasUggla: I looked at your patch16:11
kashyapmelwitt: Thanks for jogging my memory!  I now recall16:11
bauzassounds quite good to me if you say 'we need to formally name which tables do softdelete"16:12
bauzaswhich is what you code16:12
kashyapmelwitt: I thought this one from Brett has already merged...but apparently not yet.  Is it waiting on something still?16:12
melwittkashyap: just needs a second reviewer16:12
kashyapAh, nod.  I thought something else besides it.16:13
melwittI already +2ed it16:13
melwittnah16:13
kashyapgibi: or any other core who's not Mel, can you please put this through? - https://review.opendev.org/c/openstack/nova/+/85200216:14
kashyapmelwitt: Also thank you for - https://review.opendev.org/c/openstack/nova/+/859358/116:14
melwitt:)16:15
kashyapOften these unit tests take a ton of time (at least for me), and I keep duking around them16:15
gibikashyap: I added to my queue but no promises when I get to it16:15
kashyapgibi: What?  I thought you'd attach a promiese-to-be-executed-on-this-date to all your reviews!16:16
melwittkashyap: they take a ton of time for me, pretty much never goes smoothly 😆 16:17
kashyapmelwitt: Good to know; I feel particularly low when a unit test that I'm struggling with takes so long that a hen will develop teeth, but the test won't come out right.16:18
melwittkashyap: "hen develop teeth" haha I've never heard that before16:19
kashyapI recently learnt the expression, "as rare as hen's teeth" -- https://en.wiktionary.org/wiki/rare_as_hen%27s_teeth  :P16:21
melwittit's funny :)16:22
kashyapOn that note, /me goes to make "non-hen" dinner 16:24
melwitto/16:25
gibikashyap: :)16:33
opendevreviewStephen Finucane proposed openstack/nova master: objects: Remove unnecessary type aliases, exceptions  https://review.opendev.org/c/openstack/nova/+/73824016:36
opendevreviewStephen Finucane proposed openstack/nova master: objects: Use imports instead of type aliases  https://review.opendev.org/c/openstack/nova/+/73801816:36
opendevreviewStephen Finucane proposed openstack/nova master: objects: Remove wrappers around ovo mixins  https://review.opendev.org/c/openstack/nova/+/73801916:36
opendevreviewStephen Finucane proposed openstack/nova master: objects: Remove 'NovaObjectDictCompat' from 'Service'  https://review.opendev.org/c/openstack/nova/+/83559516:36
opendevreviewStephen Finucane proposed openstack/nova master: WIP: add ovo-mypy-plugin to type hinting o.vos  https://review.opendev.org/c/openstack/nova/+/75885116:36
opendevreviewStephen Finucane proposed openstack/nova master: objects: Add NovaSoftDeleteObject mixin  https://review.opendev.org/c/openstack/nova/+/85435517:29
sean-k-mooneystephenfin: to be clear the goal of ^ shoudl be the minimal possible change to allow Uggla to create teh manilla share object models without delete/deleted at in the db or ovo17:30
stephenfinYup, I think that's doing that? I suspect dansmith and bauzas had missed part of the commit message that explained that17:33
stephenfin"Currently, the NovaPersistentObject mixin includes fields required by the soft delete feature - deleted and deleted_at - even if the backing SQLAlchemy model isn't using soft delete."17:34
stephenfin👆 that bit17:34
sean-k-mooneyright but other way to do that is for the manilla object to inherit form the timestamed one17:35
sean-k-mooneyand make no change to anything else17:35
sean-k-mooneyso instead of inheriting form NovaPersistentObject the manila share ones could  inherit form ovoo_base.TimestampedObject which is also called NovaTimestampObject17:36
sean-k-mooneywe dont need to add the mixin for the orgianl usecse17:36
stephenfinSame thing, different approach. If I was Uggla, I'd probably do that to avoid this blocking things17:36
sean-k-mooneygibi: Uggla  did i miss why we are not just doing that17:36
sean-k-mooneystephenfin: thats basically what i suggested a month ago https://review.opendev.org/c/openstack/nova/+/854355/5#message-839b7637eabf1d6dcf4e95050e9244c954dc105617:37
sean-k-mooneyat that time i did not see that we had NovaTimestampObject17:37
sean-k-mooneyand did not need ot intoduce a new class at all17:38
stephenfinThat change does still make sense though. As unlikely as it is that anyone will bump those major versions, it is confusing and the TODOs are helpful to highlight that17:38
sean-k-mooneyi dont dissagree that we might also want to do this17:39
sean-k-mooneybut i dont think we want to do this in the manilla share seriese17:39
stephenfinagreed17:39
sean-k-mooneywhich si why i ask Uggla to not do this when i first reviewed17:39
gibiI cannot recall the reason we went that way17:40
gibiprobably to fix the other ovos where we can fix17:40
sean-k-mooneygibi: Uggla orgingial patch alredy had updated all the other objects17:41
Ugglasean-k-mooney, stephenfin I tried to make objects without soft delete the default behavior to avoid future misused. I also started with a less intrusive patch, but gibi wanted to extend it.17:41
sean-k-mooneyUggla: ya but if we did that it shoudl be a sperate blueprint/spec not mixed into your share work17:41
sean-k-mooneybauzas: melwitt when i mentioned stpehens change in the bug call by the way i ment https://review.opendev.org/c/openstack/nova/+/86040117:43
sean-k-mooneynot https://review.opendev.org/c/openstack/nova/+/85435517:43
sean-k-mooneyi just saw that stephen updated that also17:44
melwittsean-k-mooney: thanks17:44
Ugglasean-k-mooney, ok if it is needed.17:51
*** adia is now known as abdi18:09
*** abdi is now known as adia18:15
*** adia is now known as abdi18:53
*** dasm is now known as dasm|off21:34
atmarkI messed up nova cells and now computes states are down. I corrected the cells but they still show as down. How can I reregister the computes?22:17
atmarkThis is a new deployment 22:17
atmark`openstack compute service delete id` won't let me delete 22:18

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!