| opendevreview | Merged openstack/nova stable/2023.1: enable validations in nova-lvm https://review.opendev.org/c/openstack/nova/+/887674 | 00:25 |
|---|---|---|
| bauzas | good morning nova | 07:22 |
| kashyap | gibi: Morning | 07:41 |
| kashyap | gibi: So, here's the one failure: from my patch : https://zuul.opendev.org/t/openstack/build/a151d31cbcf74a648e1948986686d08a | 07:41 |
| kashyap | "Something" seems off | 07:41 |
| gibi | looking | 07:47 |
| gibi | kashyap: left a comment, I think the test case can be removed | 08:08 |
| kashyap | gibi: You read my mind! | 08:08 |
| kashyap | I was thinking the same thing | 08:09 |
| gibi | it is ceartanly easier to read others mind if they are looking at the same ~10 lines of code :) | 08:19 |
| bauzas | gibi: kashyap: do I understand there is a CI failure ? | 08:22 |
| kashyap | gibi: Haha | 08:23 |
| kashyap | bauzas: We were talking about a specific patch change - https://review.opendev.org/c/openstack/nova/+/887255 | 08:23 |
| kashyap | (The failure there is expected due to a now-invalid test) | 08:23 |
| bauzas | ah oooof, ok :) | 08:24 |
| * bauzas tries to catch up after a long weekend | 08:24 | |
| opendevreview | Kashyap Chamarthy proposed openstack/nova master: Bump MIN_{LIBVIRT,QEMU} for "Bobcat" https://review.opendev.org/c/openstack/nova/+/887255 | 08:37 |
| kashyap | gibi: --^ Fixed | 09:04 |
| gibi | added some cleanup requests inline but other than that it looks good | 09:25 |
| kashyap | Ah, I missed a few more; good catch! I will fix them too | 10:03 |
| kashyap | Thank you. | 10:03 |
| opendevreview | Amit Uniyal proposed openstack/nova master: Added context manager for instance lock https://review.opendev.org/c/openstack/nova/+/873648 | 10:12 |
| opendevreview | Amit Uniyal proposed openstack/nova master: Added context manager for instance lock https://review.opendev.org/c/openstack/nova/+/873648 | 10:14 |
| opendevreview | Amit Uniyal proposed openstack/nova master: Added context manager for instance lock https://review.opendev.org/c/openstack/nova/+/873648 | 10:33 |
| opendevreview | Amit Uniyal proposed openstack/nova master: Disconnecting volume from the compute host https://review.opendev.org/c/openstack/nova/+/877446 | 10:33 |
| stephenfin | bauzas: sean-k-mooney: gibi: Think one of you could add https://review.opendev.org/c/openstack/nova/+/880669/ and https://review.opendev.org/c/openstack/nova/+/886230/ to your review list? | 12:15 |
| sean-k-mooney | stephenfin: im +2w on the first patch im not sure about the job | 12:22 |
| sean-k-mooney | im ok wiht addign it but im not sure it should be voting | 12:22 |
| sean-k-mooney | since we are ignoring upper constraits by using both oslo.db and sqlachemy form master/main | 12:22 |
| gibi | yeah I agree with sean-k-mooney on both patch | 12:46 |
| opendevreview | Kashyap Chamarthy proposed openstack/nova master: Bump MIN_{LIBVIRT,QEMU} for "Bobcat" https://review.opendev.org/c/openstack/nova/+/887255 | 13:03 |
| stephenfin | sean-k-mooney: gibi: The issue is that we are currently SQLAlchemy 2.x compatible and don't want to regress. However, people don't look at non-voting jobs so they're effectively useless for anti-regression purposes IMO | 13:49 |
| stephenfin | There is of course a risk that SQLAlchemy could introduce a breaking change but if we're serious about being ready for SQLA 2.x by C then we'll need to handle those issues. Also, SQLA is super mature so the chances of that seem minute, while we can simply toggle it to non-voting if they inadvertently introduce a bug | 13:50 |
| stephenfin | Also also, I've proposed the same thing for ironic, cinder, placement, and a few others. Neutron are running all their functional tests with sqlalchemy master for some time now. I think the benefits outweigh the concerns | 13:52 |
| bauzas | sean-k-mooney: I quite agree with stephenfin, let's KISS | 13:56 |
| bauzas | we also have other jobs | 13:56 |
| bauzas | but -1 b/c of the gate | 13:58 |
| dansmith | could we not just make the 310 job SA 2.0 and leafve the 3.9 one as it is? having another job seems excessive to me | 13:59 |
| sean-k-mooney | i would prefer to just raise our min version to 2.0 | 14:00 |
| auniyal | hi dansmith, sorry for not responding on your question on time before new revision, yes as you mentioned in comment, on melwitt suggestion, I passed the context from caller and did not created new context and I added the assert. as per suggestion. Actually I had the reply on draft but was waiting for CI job to pass that time. | 14:00 |
| sean-k-mooney | but ya i can also live with dansmith suggestion i guess | 14:00 |
| gibi | yeah, if we want to track 2.0 then lets bump now to 2.0 | 14:01 |
| dansmith | we're really running three functional jobs and it seems like we could just re-use one to move forward | 14:01 |
| sean-k-mooney | could we bump the uc for py3.10 specificaly to 2.0 | 14:01 |
| sean-k-mooney | then we could follow the same pattern in all project | 14:01 |
| dansmith | can we do that? if so that'd also work I suppose | 14:02 |
| sean-k-mooney | or as i said just move nova to 2.0 | 14:02 |
| dansmith | I mean I know requirements.txt can do it, but will a bot complain? | 14:02 |
| sean-k-mooney | dansmith: we can we used ot do it for py2.7 vs py 3 | 14:02 |
| dansmith | sean-k-mooney: we can't move nova to *require* 2.0 right now | 14:02 |
| dansmith | because it would mean nova can't be installed on the same machine as keystone, for example | 14:02 |
| stephenfin | we can't bump to 2.0 in requirements.txt - the requirements check job won't let us (co-installability) | 14:03 |
| stephenfin | i.e. what dansmith said | 14:03 |
| sean-k-mooney | i ment in the reqiuremetns repo | 14:03 |
| sean-k-mooney | can we increases the cap to 2.0 for py3.10 | 14:04 |
| dansmith | yeah, can't do that until everyone can use 2.0 but we're not ready for that | 14:04 |
| sean-k-mooney | i guess that could break devstack jobs | 14:04 |
| sean-k-mooney | ack | 14:04 |
| stephenfin | sean-k-mooney: manila still isn't compatible, nor is masakari and a few other projects | 14:04 |
| dansmith | nor keystone, last I checked | 14:04 |
| sean-k-mooney | ok so i guess looping back to dansmith suggestion of just doing this in one of the existing job | 14:04 |
| sean-k-mooney | its that prefer or having the extra job | 14:04 |
| bauzas | ok cool with me too | 14:05 |
| gibi | OK with me to force py310 to run with 2.0 | 14:05 |
| dansmith | I just think the actual likelihood of breakages between 3.9 and 3.10 is minor, so using 3.10 as our 2.0 job makes frugal sense, | 14:05 |
| stephenfin | Also, we can't just reuse a job unless we want to get rid of our use of job templates | 14:05 |
| dansmith | and we can probably spot the difference between SA problems and some python base issue | 14:05 |
| dansmith | stephenfin: ah, you're right | 14:05 |
| dansmith | fine, fine, just stack another job I guess | 14:06 |
| stephenfin | because it's the job templates that specifies our use of openstack-tox-whatever | 14:06 |
| * dansmith makes the dolla' bills gesture | 14:06 | |
| dansmith | yup | 14:06 |
| bauzas | ~o~ | 14:06 |
| stephenfin | ack, with any luck it should be gone in 3 months or so 🤞 hopefully sooner but definitely in C | 14:07 |
| sean-k-mooney | ok | 14:07 |
| sean-k-mooney | so we will proceed with the patch as is | 14:07 |
| dansmith | I will bet you one unit of currency that it will not be gone in three months :P | 14:07 |
| stephenfin | I value my currency and will not take that bet | 14:08 |
| dansmith | hehe | 14:08 |
| gibi | :) | 14:09 |
| bauzas | reminder : nova meeting in 45 mins here | 15:14 |
| opendevreview | Merged openstack/nova stable/wallaby: Reproducer for bug 1983753 https://review.opendev.org/c/openstack/nova/+/853273 | 15:36 |
| dansmith | sean-k-mooney: got another guest panic this morning: https://27abb73f6979e2fd6932-3e445c1a5b8a8c84f71b5a61cff5a09b.ssl.cf1.rackcdn.com/879499/10/check/nova-multi-cell/5c92eb8/testr_results.html | 15:48 |
| dansmith | looks like *very* early in kernel boot | 15:50 |
| gibi | its smells like APIC https://bugs.launchpad.net/nova/+bug/1939108 | 15:55 |
| dansmith | gibi: I dunno that bug trace made it much farther than mine did.. note all the kernel timestamps are 0.0 | 15:57 |
| dansmith | but yeah I guess the timer failed messages before the crash look the same | 15:58 |
| dansmith | so maybe it's just a difference in the kernel from then to now | 15:58 |
| dansmith | and in check_timer() where we panic, so okay yeah | 15:59 |
| dansmith | and another report from 2022 at the end of that report that looks more like mine | 16:00 |
| bauzas | starting the meeting now folks | 16:00 |
| gibi | both calls setup_IO_APIC that was my matching point | 16:00 |
| dansmith | kashyap: I wonder if it might be worth chasing a kernel bug with that now | 16:00 |
| bauzas | let's discuss this gate failure in a sec | 16:00 |
| bauzas | #startmeeting nova | 16:00 |
| opendevmeet | Meeting started Tue Jul 18 16:00:50 2023 UTC and is due to finish in 60 minutes. The chair is bauzas. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| opendevmeet | The meeting name has been set to 'nova' | 16:00 |
| bauzas | hey folks | 16:00 |
| gibi | o/ | 16:01 |
| bauzas | #link https://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting | 16:01 |
| elodilles | o/ | 16:01 |
| bauzas | who's around ? | 16:01 |
| bauzas | okay, we can softly start | 16:02 |
| bauzas | #topic Bugs (stuck/critical) | 16:03 |
| bauzas | #info No Critical bug | 16:03 |
| bauzas | #link https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New 40 new untriaged bugs (+1 since the last meeting) | 16:03 |
| bauzas | thanks melwitt for the triaging | 16:03 |
| bauzas | any bug to discuss ? | 16:04 |
| Uggla | o/ | 16:04 |
| bauzas | looks not, moving on | 16:05 |
| bauzas | #info Add yourself in the team bug roster if you want to help https://etherpad.opendev.org/p/nova-bug-triage-roster | 16:05 |
| bauzas | IIRC, artom is on PTO this week, so he can't take the baton | 16:05 |
| bauzas | Uggla: wants to have it ? | 16:05 |
| Uggla | yes it is ok | 16:06 |
| bauzas | cool thanks | 16:06 |
| bauzas | #info bug baton is being passed to Uggla | 16:06 |
| bauzas | next topic | 16:06 |
| bauzas | #topic Gate status | 16:06 |
| bauzas | #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs | 16:06 |
| bauzas | #link https://etherpad.opendev.org/p/nova-ci-failures | 16:07 |
| bauzas | gibi: wants to discuss the kernel panic bug you found ? | 16:07 |
| gibi | that is dansmith finding | 16:07 |
| gibi | I just matched it to an older report | 16:07 |
| gibi | I guess we can try the apic debug kernel param | 16:08 |
| bauzas | ack | 16:08 |
| gibi | as the kernel error message suggests | 16:08 |
| gibi | Kernel panic - not syncing: IO-APIC + timer doesn't work! Boot with apic=debug and send a report. Then try booting with the 'noapic' option. | 16:08 |
| bauzas | any link to share . | 16:09 |
| bauzas | ? | 16:09 |
| gibi | https://bugs.launchpad.net/nova/+bug/1939108 that is the old bug I found. And this is the fresh repro https://27abb73f6979e2fd6932-3e445c1a5b8a8c84f71b5a61cff5a09b.ssl.cf1.rackcdn.com/879499/10/check/nova-multi-cell/5c92eb8/testr_results.html | 16:10 |
| bauzas | cool | 16:10 |
| bauzas | #link https://bugs.launchpad.net/nova/+bug/1939108 | 16:10 |
| gibi | I have nothing more to add | 16:10 |
| bauzas | #link https://27abb73f6979e2fd6932-3e445c1a5b8a8c84f71b5a61cff5a09b.ssl.cf1.rackcdn.com/879499/10/check/nova-multi-cell/5c92eb8/testr_results.html | 16:10 |
| bauzas | gibi: ack, thanks dansmith and you for the bone | 16:10 |
| bauzas | continuing | 16:11 |
| bauzas | #link https://zuul.openstack.org/builds?project=openstack%2Fnova&project=openstack%2Fplacement&pipeline=periodic-weekly Nova&Placement periodic jobs status | 16:11 |
| bauzas | so we have a failing periodic job, nova-emulation | 16:11 |
| bauzas | #link https://zuul.openstack.org/build/5964ceeb42594a06acdaf5b561229d16 | 16:11 |
| bauzas | seems related to a neutron bug we know | 16:12 |
| bauzas | we'll see if next week, it continues to fail | 16:13 |
| bauzas | moving on | 16:13 |
| bauzas | #info Please look at the gate failures and file a bug report with the gate-failure tag. | 16:13 |
| bauzas | any other gate failure to discuss ? | 16:14 |
| bauzas | - | 16:15 |
| bauzas | #topic Release Planning | 16:15 |
| bauzas | #link https://releases.openstack.org/bobcat/schedule.html | 16:15 |
| bauzas | #info Nova deadlines are set in the above schedule | 16:15 |
| bauzas | should I start to tell the ticker ? :) | 16:15 |
| bauzas | #info Feature Freeze in 6 weeks | 16:16 |
| bauzas | #info Nova Feature Review Day on July 25th | 16:16 |
| bauzas | oh, and now, the most important for reviewers I guess | 16:17 |
| bauzas | #link https://etherpad.opendev.org/p/nova-bobcat-blueprint-status Etherpad for tracking blueprints status | 16:17 |
| bauzas | you'll find *ALL* patch series for the approved blueprints | 16:18 |
| bauzas | I've chewed all the dirty work, you just need to click on the gerrit series :) | 16:18 |
| gibi | thanks bauzas ! | 16:19 |
| bauzas | anything to say ? | 16:19 |
| bauzas | looks not again | 16:19 |
| bauzas | so, now we have the tracking etherpad, feel free to review the patches in advance of the feature review day which will be on July 25th | 16:20 |
| bauzas | moving on now | 16:20 |
| bauzas | #topic Review priorities | 16:20 |
| bauzas | #link https://review.opendev.org/q/status:open+(project:openstack/nova+OR+project:openstack/placement+OR+project:openstack/os-traits+OR+project:openstack/os-resource-classes+OR+project:openstack/os-vif+OR+project:openstack/python-novaclient+OR+project:openstack/osc-placement)+(label:Review-Priority%252B1+OR+label:Review-Priority%252B2) | 16:20 |
| bauzas | #info As a reminder, people eager to review changes can +1 to indicate their interest, +2 for asking cores to also review | 16:21 |
| bauzas | sean-k-mooney: better phrasing ? ^ | 16:21 |
| sean-k-mooney | yes | 16:22 |
| bauzas | cool, will persist it in the wikipage | 16:23 |
| bauzas | moving on | 16:23 |
| bauzas | #topic Stable Branches | 16:23 |
| Uggla | bauzas, that's more clear has before I thought only cores could do it. | 16:23 |
| bauzas | elodilles: your turn :) | 16:23 |
| elodilles | ack o7 | 16:23 |
| elodilles | so my part: | 16:23 |
| elodilles | #info stable/2023.1 gate is fixed (nova-lvm / nova-ceph-multistore job failure), stable/zed and stable/yoga is still waiting for the backports to merge | 16:23 |
| elodilles | thanks \o/ | 16:24 |
| elodilles | (for the reviews on stable/2023.1 :)) | 16:24 |
| elodilles | #info stable/victoria gate is broken (due to latest virtualenv release) workaround: https://review.opendev.org/c/openstack/nova/+/888681 | 16:24 |
| elodilles | this is a new issue ^^^ | 16:25 |
| elodilles | otherwise | 16:25 |
| elodilles | #info train, ussuri, wallaby, xena gates should be OK | 16:25 |
| bauzas | elodilles: ack | 16:25 |
| elodilles | #info stable branch status / gate failures tracking etherpad: https://etherpad.opendev.org/p/nova-stable-branch-ci | 16:25 |
| elodilles | that's all from me | 16:25 |
| bauzas | thanks | 16:26 |
| elodilles | np | 16:26 |
| bauzas | #info train-eol patch proposed https://review.opendev.org/c/openstack/releases/+/885365 | 16:26 |
| bauzas | seems like there is a consensus | 16:26 |
| bauzas | so we're just waiting for the release cores to chime in | 16:26 |
| elodilles | ack, then i'll review with my rel mgr hat on :) | 16:27 |
| bauzas | sean-k-mooney: want me to provide a devstack patch on stable/train ? | 16:27 |
| sean-k-mooney | for what? | 16:28 |
| sean-k-mooney | to pin nova to the tag? | 16:28 |
| bauzas | I'm referring to your comment on https://review.opendev.org/c/openstack/releases/+/885365/comment/f2edcb27_5a399b18/ | 16:29 |
| bauzas | which is to override train-eol in the base devstack job in the train branch | 16:29 |
| sean-k-mooney | where i explianed you do not need to do anything since we use python-novaclient form py release by default | 16:29 |
| bauzas | override w/ | 16:29 |
| sean-k-mooney | not branchs | 16:30 |
| bauzas | ok, I misinterpreted | 16:30 |
| bauzas | will see anyway | 16:30 |
| sean-k-mooney | i was saying that if a job currently was not using the pypi release | 16:30 |
| bauzas | elodilles: your hat will be indeed appreciated | 16:30 |
| sean-k-mooney | then they woudl need to be updated via override-checkout | 16:30 |
| sean-k-mooney | to use the eol tag | 16:30 |
| bauzas | sean-k-mooney: ack | 16:30 |
| sean-k-mooney | but the base job should be fine as is | 16:31 |
| bauzas | moving on then | 16:31 |
| bauzas | auniyal: wanted to add anything ? | 16:31 |
| auniyal | #info Please review these backport patches of stable 2023.1, zed and yoga for next minor release | 16:31 |
| auniyal | #info most of these already have one +2 and need only one +2 and +W | 16:31 |
| auniyal | #link https://etherpad.opendev.org/p/release-liaison-PatchesToReview | 16:32 |
| sean-k-mooney | zed and yoga are currently blocked. (zed need the devstack-ceph-plugin patch to be merged) and yoga is waitign on the 3 patches to be backported for teh rebuild test | 16:32 |
| bauzas | yeah see elodilles's comments previously | 16:32 |
| bauzas | I just +2d/Wd the zed patch which fixes nova | 16:33 |
| sean-k-mooney | i coudl premtivley propsoe the yoga backports | 16:33 |
| elodilles | thanks in advance sean-k-mooney \o/ | 16:33 |
| sean-k-mooney | but we need to followup with the devstack-ceph-pluging folks and devstack | 16:33 |
| sean-k-mooney | ack i ll do that now while i think of it | 16:33 |
| elodilles | sean-k-mooney: i think devstack-ceph-pluging patch is not needed for yoga | 16:34 |
| elodilles | sean-k-mooney: only nova-lvm is broken in yoga, afaik | 16:34 |
| sean-k-mooney | yoga should be using unpinned tempest | 16:34 |
| sean-k-mooney | so it shoudl need both | 16:34 |
| sean-k-mooney | but we can see i guess | 16:35 |
| elodilles | hmmm, OK | 16:35 |
| elodilles | i saw it passing | 16:35 |
| sean-k-mooney | perhaps validation are enabeld on yoga already? | 16:35 |
| sean-k-mooney | for ceph | 16:35 |
| elodilles | good question | 16:35 |
| sean-k-mooney | we can check after the meeting | 16:36 |
| elodilles | yepp | 16:36 |
| bauzas | cool | 16:36 |
| bauzas | can we move on ? | 16:36 |
| auniyal | bauzas, I targeted to do minor release tomorrow 19th July, but most of them are not merged yet, so will wait till next wednesday | 16:37 |
| auniyal | thats all from my side thanks | 16:37 |
| bauzas | ack | 16:37 |
| bauzas | #topic Open discussion | 16:38 |
| bauzas | nothing on the agenda | 16:38 |
| bauzas | anything anyone ? | 16:38 |
| bauzas | ok, let's give you back 20 mins | 16:40 |
| bauzas | thanks all | 16:40 |
| bauzas | #endmeeting | 16:40 |
| opendevmeet | Meeting ended Tue Jul 18 16:40:33 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:40 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/nova/2023/nova.2023-07-18-16.00.html | 16:40 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/nova/2023/nova.2023-07-18-16.00.txt | 16:40 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/nova/2023/nova.2023-07-18-16.00.log.html | 16:40 |
| elodilles | thanks o/ | 16:40 |
| elodilles | auniyal: thanks for dealing with the release, ping me if i can help with anything about it! | 16:41 |
| gibi | o/ | 16:42 |
| auniyal | ack elodilles, only thing we need is more reviews, most of the +2 are from you only, thanks | 16:42 |
| sean-k-mooney | elodilles: ill pull https://review.opendev.org/c/openstack/nova/+/888230 back without any deps and we can see if it passes on yoga | 16:43 |
| sean-k-mooney | if not ill add the devstack and devstack-plugin-ceph pathces too | 16:43 |
| elodilles | sean-k-mooney: ack, sounds like a plan! thanks :) | 16:43 |
| opendevreview | sean mooney proposed openstack/nova stable/yoga: enable validations in nova-lvm https://review.opendev.org/c/openstack/nova/+/888784 | 16:55 |
| opendevreview | Merged openstack/nova master: Drop Fedora support https://review.opendev.org/c/openstack/nova/+/886596 | 17:49 |
| opendevreview | Merged openstack/nova stable/victoria: [stable-only] Cap virtualenv/setuptools https://review.opendev.org/c/openstack/nova/+/888681 | 18:25 |
| opendevreview | Merged openstack/nova stable/zed: enable validations in nova-lvm https://review.opendev.org/c/openstack/nova/+/888230 | 18:52 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!