Monday, 2023-09-18

opendevreviewDr. Jens Harbott proposed openstack/oslo.db stable/2023.2: Revert "Use SQLAlchemy native pre-ping"  https://review.opendev.org/c/openstack/oslo.db/+/89562109:20
opendevreviewDr. Jens Harbott proposed openstack/oslo.db stable/2023.2: Revert "Remove dead code"  https://review.opendev.org/c/openstack/oslo.db/+/89562209:20
opendevreviewDr. Jens Harbott proposed openstack/oslo.db stable/2023.2: Revert "Remove sqlalchemy-migrate"  https://review.opendev.org/c/openstack/oslo.db/+/89562309:20
opendevreviewDr. Jens Harbott proposed openstack/oslo.db stable/2023.2: Add back imports in sqlalchemy/utils.py  https://review.opendev.org/c/openstack/oslo.db/+/89562409:20
opendevreviewDr. Jens Harbott proposed openstack/oslo.db stable/2023.2: Revert "Get test suite to full pass with SQLAlchemy 2.0"  https://review.opendev.org/c/openstack/oslo.db/+/89562509:20
fricklerstephenfin: ^^ I think I messed up a rebase in between, pushing anyway now so we can run some depends-on testing09:21
opendevreviewStephen Finucane proposed openstack/oslo.db master: Temporarily re-add autocommit support  https://review.opendev.org/c/openstack/oslo.db/+/89562609:22
opendevreviewStephen Finucane proposed openstack/oslo.db master: Temporarily re-add autocommit support  https://review.opendev.org/c/openstack/oslo.db/+/89562609:31
fricklerstephenfin: note that you'd only need to patch 2023.2, the plan is to enforce newer oslo.db for caracal unless you have some objection to that09:36
stephenfinack09:51
opendevreviewStephen Finucane proposed openstack/oslo.db master: Temporarily re-add migration helpers, tests  https://review.opendev.org/c/openstack/oslo.db/+/89563009:58
opendevreviewStephen Finucane proposed openstack/oslo.db stable/2023.2: Temporarily re-add autocommit support  https://review.opendev.org/c/openstack/oslo.db/+/89563109:59
opendevreviewStephen Finucane proposed openstack/oslo.db stable/2023.2: Temporarily re-add migration helpers, tests  https://review.opendev.org/c/openstack/oslo.db/+/89563209:59
stephenfinfrickler: Let's see how that performs10:00
opendevreviewDr. Jens Harbott proposed openstack/oslo.db stable/2023.2: Revert "Remove sqlalchemy-migrate"  https://review.opendev.org/c/openstack/oslo.db/+/89562310:02
opendevreviewDr. Jens Harbott proposed openstack/oslo.db stable/2023.2: Revert "Get test suite to full pass with SQLAlchemy 2.0"  https://review.opendev.org/c/openstack/oslo.db/+/89562510:02
stephenfinfrickler: Okay, the combo of my two patches in enough to get heat fixed. Now testing with Manila10:34
stephenfinmanila UTs pass also10:44
fricklerstephenfin: that sounds good, I'm just wondering whether the use of "temporarily" is correct, since these changes will be permanent for the stable/2023.2 series11:35
stephenfinfair point11:36
frickleralso, do you want to make testing patches for this from the integrated projects or do you think unit tests have enough coverage? let me know if you want help with creating patches11:36
stephenfinif we're only proposing those for 2023.2, we probably want to mark them as stable-only also11:37
frickleryes, in particular since I saw that you also started work on heat now, I think it would seem feasible to get sqla 2.0 into caracal finally?11:38
fricklers/started work on/uploaded patches for/11:39
stephenfinOh, I'd already done a lot of work on Heat but it is unfortunately still using autocommit. That's the remaining piece11:50
stephenfinand I've done all the work for masakari but no ones reviewed it yet :(11:50
stephenfin*one has11:50
stephenfinmasakari UTs pass too11:54
opendevreviewStephen Finucane proposed openstack/oslo.db stable/2023.2: [stable-only] Re-add autocommit support  https://review.opendev.org/c/openstack/oslo.db/+/89563112:02
opendevreviewStephen Finucane proposed openstack/oslo.db stable/2023.2: [stable-only] Re-add migration helpers, tests  https://review.opendev.org/c/openstack/oslo.db/+/89563212:02
stephenfinfrickler, hberaud: Okay, I'm relatively confident with those. I'd much rather go with that than the revert given it's more focused and less likely to break the new oslo.db-tips jobs we've been adding all over the place. What other tests do we need to do before merging and cutting a release?12:03
fricklerstephenfin: I agree with your patches being the preferred path. regarding testing as I said above, maybe do depends-on patches on nova, neutron, cinder maybe just to ensure there are no regressions?12:30
fricklerbut I'd also be fine with doing a release first, since it can't get much worse anyway, and then test the released version12:31
frickleralso not sure which other oslo cores would need to get involved?12:31
stephenfiniiurc the nova gate is borked rn due to a testtools issues, so I'd be for merging and releasing12:31
stephenfinas you say, it can't get worse12:31
fricklerand doing yet another bug fix release on top if needed also wouldn't hurt12:33
fricklerstephenfin: speaking of bug, do you think adding a bug report and referencing that in the release notes would be helpful?12:34
stephenfinI think "other oslo cores" == {hberaud} :)12:34
stephenfinthat depends on whether oslo.db is using launchpad or storyboard12:35
fricklerhttps://bugs.launchpad.net/oslo.db12:38
stephenfintbh, i don't know what the bug would say. "oslo.db didn't work with loads of projects and now it (temporarily) does again, but you won't have seen because we never merged the upper-constraint bump to include it"?12:40
fricklerhmm, good point. on one hand the u-c bump failing could be seen as CI issue, otoh releasing a version of oslo.db in bobcat that doesn't work with multiple other project's bobcat release could be seen as release bug12:51
fricklerhberaud: ^^ maybe we want to discuss this in the release team context? is there a release team bugtracker at all? would it make sense to cover both castellan and oslo.db together?12:53
hberaudstephenfin: ack, thanks. I'll have a look to your patches soon14:23
hberaudfrickler: yeah it can't hurt to discuss this in a release team context, but we don't have a release team bugtracker.... however you can add notes there => https://etherpad.opendev.org/p/bobcat-relmgt-tracking (around line 449)14:24
hberaudthat's our tasks for our next release meeting (next friday)14:25
hberaudfrickler: you should notice that this etherpad section is already covering castellan and oslo.db together14:27
fricklerhberaud: yes, I was more thinking of a bug reference that could be added in a release note, I don't think the etherpad is good for that14:52
zzzeek@stephenfin: hi17:22
zzzeek@stephenfin: have not been watching IRC since <employer> as you know moved to slack17:22
zzzeek@stephenfin: to track transaction starts use the event hooks as always: https://docs.sqlalchemy.org/en/20/core/events.html#sqlalchemy.events.ConnectionEvents.begin  https://docs.sqlalchemy.org/en/20/core/events.html#sqlalchemy.events.ConnectionEvents.commit etc17:23
zzzeek@stephenfin: then you can put a traceback.dump_stack() in there or whatever you need17:23
zzzeekthats core level transactions.  there are separate hooks for the Session's notion of a transaction which encloses zero or more connection-level transactions17:24
stephenfinzzzeek: I figured :) All good17:31
zzzeekstephenfin: looks like things have fallen apart a bit, oops17:32
stephenfinHmm, okay, that's what I was trying but stestr's capturing of logs and stderr was screwing up my output so I couldn't built a clear timeline of transactions being started and completed (rollback or commit). I'll try with pytest instead and see if I can get something more readable17:33
zzzeekstephenfin: just so you know we're getting pretty close to ready to start 2.1, which means we'd slow down 1.4 releases to basically none17:33
stephenfinYes, it's fallen apart a little bit. I didn't get Manila closed out and there wasn't enough traction on many of my patches nor anyone picking up the work in the other projects that I didn't get to. Very disappointing :(17:36
stephenfinzzzeek: Didn't know 2.1 was coming out so soon though, not that that's surprising. That's more fuel for the "We must do this in C" fire17:37
zzzeekit's not coming out that soon, we just are going to shift new dev work to 2.1, since we have to sunset python 3.7 and deal with some other compat things that are better for 2.117:38

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!