| opendevreview | melanie witt proposed openstack/nova master: nova-manage: Add flavor scanning to migrate_to_unified_limits https://review.opendev.org/c/openstack/nova/+/924110 | 00:02 |
|---|---|---|
| opendevreview | Koya Watanabe proposed openstack/placement master: Add memcached packages https://review.opendev.org/c/openstack/placement/+/935576 | 00:54 |
| opendevreview | Ghanshyam proposed openstack/nova master: Update gate jobs as per the 2025.1 cycle testing runtime https://review.opendev.org/c/openstack/nova/+/932648 | 01:12 |
| opendevreview | Ghanshyam proposed openstack/nova master: Testing doc job on Ubuntu Noble https://review.opendev.org/c/openstack/nova/+/935577 | 01:15 |
| opendevreview | Ghanshyam proposed openstack/os-resource-classes master: Update python classifier as per the 2025.1 cycle testing runtime https://review.opendev.org/c/openstack/os-resource-classes/+/935578 | 01:33 |
| opendevreview | Ghanshyam proposed openstack/osc-placement master: Update python classifier as per the 2025.1 cycle testing runtime https://review.opendev.org/c/openstack/osc-placement/+/935579 | 01:33 |
| opendevreview | Ghanshyam proposed openstack/os-vif master: Update gate jobs as per the 2025.1 cycle testing runtime https://review.opendev.org/c/openstack/os-vif/+/935580 | 01:33 |
| opendevreview | Ghanshyam proposed openstack/placement master: Update gate jobs as per the 2025.1 cycle testing runtime https://review.opendev.org/c/openstack/placement/+/935581 | 01:34 |
| opendevreview | Ghanshyam proposed openstack/os-traits master: Update python classifier as per the 2025.1 cycle testing runtime https://review.opendev.org/c/openstack/os-traits/+/935582 | 01:35 |
| opendevreview | Ghanshyam proposed openstack/python-novaclient master: DNM: Testing ubuntu noble https://review.opendev.org/c/openstack/python-novaclient/+/935583 | 01:50 |
| opendevreview | Ghanshyam proposed openstack/osc-placement master: Update python classifier as per the 2025.1 cycle testing runtime https://review.opendev.org/c/openstack/osc-placement/+/935579 | 02:24 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: Detect AMD SEV-ES support https://review.opendev.org/c/openstack/nova/+/925685 | 02:42 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: Add hw_mem_encryption_model image property https://review.opendev.org/c/openstack/nova/+/927706 | 02:42 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: libvirt: Launch instances with SEV-ES memory encryption https://review.opendev.org/c/openstack/nova/+/926106 | 02:43 |
| opendevreview | melanie witt proposed openstack/nova-specs master: Re-propose config option for behavior of unset unified limits https://review.opendev.org/c/openstack/nova-specs/+/934391 | 04:29 |
| opendevreview | Ghanshyam proposed openstack/os-vif master: Update gate jobs as per the 2025.1 cycle testing runtime https://review.opendev.org/c/openstack/os-vif/+/935580 | 04:31 |
| opendevreview | melanie witt proposed openstack/nova-specs master: Re-propose config option for behavior of unset unified limits https://review.opendev.org/c/openstack/nova-specs/+/934391 | 05:14 |
| zigo | tkajinam: sean-k-mooney: Please reconsider your review after reading my comments at https://review.opendev.org/c/openstack/nova/+/935512 | 07:32 |
| *** __ministry is now known as Guest163 | 07:34 | |
| *** elodilles_pto is now known as elodilles | 08:03 | |
| opendevreview | zhou zhong proposed openstack/nova master: ESFIX: Add auto_converge parameters for invoking the migration https://review.opendev.org/c/openstack/nova/+/935614 | 09:14 |
| opendevreview | zhou zhong proposed openstack/nova master: ESFIX: Add auto_converge parameters for invoking the migration https://review.opendev.org/c/openstack/nova/+/935614 | 09:15 |
| opendevreview | zhou zhong proposed openstack/nova master: Add auto_converge parameters for invoking the migration https://review.opendev.org/c/openstack/nova/+/935614 | 09:17 |
| opendevreview | zhou zhong proposed openstack/nova master: Add auto_converge parameters for invoking the migration https://review.opendev.org/c/openstack/nova/+/935614 | 09:23 |
| zigo | 25 test failures for Nova under Python 3.13: https://bugs.launchpad.net/nova/+bug/2088999 | 10:21 |
| zigo | 24 are flavor related, one must be my own patch failing. | 10:31 |
| frickler | zigo: trying to run this locally I'm seeing "TypeError: 'PipeMutex' object does not support the context manager protocol" during discovery, does that ring a bell for you? do you have more fixes than just 935512? | 11:15 |
| zigo | frickler: The patch from tkajinam https://review.opendev.org/c/openstack/oslo.log/+/935620 fixed it for me. | 11:17 |
| zigo | Also, I may have the fix for the issue I just reported ! :) | 11:18 |
| zigo | (my patch repaired at least one unit tests, running them all now...) | 11:18 |
| opendevreview | Thomas Goirand proposed openstack/nova master: Python 3.13: Repair fake_flavor_get_by_id https://review.opendev.org/c/openstack/nova/+/935631 | 11:25 |
| frickler | zigo: ah, tkajinam ftw, thx | 11:26 |
| zigo | This looks like failing under Py 3.13 as well: | 11:39 |
| zigo | msg = _('User %(username)s not found in password file.') | 11:39 |
| zigo | raise exception.NovaException(msg % username) | 11:39 |
| zigo | with: | 11:39 |
| zigo | TypeError: format requires a mapping | 11:39 |
| zigo | Anyone got a clue? | 11:39 |
| sean-k-mooney | i think its saying that the right hand side need to be a dict | 11:41 |
| sean-k-mooney | i guess in the past named parmatere i.e. %(username)s could take postional replacements and they got stricter about that in 3.13 | 11:41 |
| sean-k-mooney | so its expexting (msg % {'username': username}) | 11:42 |
| sean-k-mooney | but i would just replace %(username)s with %s | 11:42 |
| zigo | Ok, so I should just replace username by {'username': username} ? | 11:43 |
| zigo | I can try ... :P | 11:43 |
| sean-k-mooney | that or update msg = _('User %(username)s not found in password file.') to msg = _('User %s not found in password file.') | 11:43 |
| sean-k-mooney | either both should be useing named paramaters or both should be postional | 11:43 |
| sean-k-mooney | its unhappy that we are mixing them | 11:43 |
| zigo | I'm trying the first solution, so it doesn't break translations. | 11:45 |
| zigo | Do we still care about these btw? I thought we were to just stop translating error messages ... | 11:45 |
| zigo | sean-k-mooney: Fixed ! :) | 11:49 |
| zigo | Now I'm worried we have this type of raise all over the place ... | 11:50 |
| zigo | Hum... doesn't look like it. | 11:51 |
| sean-k-mooney | im kind of surprised that this was never flagged by a linter | 11:52 |
| sean-k-mooney | some projects have been more agressive with replacing percent strings with fstring so that woudl also remove that issue | 11:52 |
| opendevreview | Thomas Goirand proposed openstack/nova master: Fix exception raising in inject_data https://review.opendev.org/c/openstack/nova/+/935640 | 11:54 |
| opendevreview | Thomas Goirand proposed openstack/nova master: Fix exception raising in _set_passwd() https://review.opendev.org/c/openstack/nova/+/935640 | 11:55 |
| sean-k-mooney | zigo: did you hit yappi/_yappi.c:1288:5: error: implicit declaration of function ‘_PyEval_SetProfile’; did you mean ‘PyEval_SetProfile’? [-Wimplicit-function-declaration] | 11:56 |
| sean-k-mooney | i was trying to run the unit test with 3.13 locally | 11:57 |
| zigo | sean-k-mooney: Yeah, I fixed that one, you need a local rebuild of yappi probably (since it's a .so based module). | 11:58 |
| zigo | Debian Unstable is already fixed for that. | 11:58 |
| sean-k-mooney | ack im using testing so i guess i need to wait or clone and buidl that myslef | 11:58 |
| sean-k-mooney | i can test this in a vm instead | 11:58 |
| zigo | I used version 1.6.10 instead of 1.6.<something>. | 11:59 |
| zigo | Maybe just bump it? | 11:59 |
| sean-k-mooney | you mean bump the distro packages or the python dep in a requirements file | 12:00 |
| zigo | Whatever you're using, yeah ... :P | 12:00 |
| sean-k-mooney | i need to hop on a 1:1 but i can do a ful dist upgrade after the call | 12:00 |
| sean-k-mooney | oh thats not for 30 mins | 12:00 |
| sean-k-mooney | sorry im using sid which is unstable so ok hopefuly that will fix that | 12:02 |
| sean-k-mooney | zigo: do you know if the version of yappi you used is allwod by uc? | 12:09 |
| sean-k-mooney | that would be a no | 12:10 |
| sean-k-mooney | yappi===1.6.0 | 12:10 |
| sean-k-mooney | ok so thats why its failign localy i can overried with a different version | 12:10 |
| sean-k-mooney | im not sure why that has not been bumpted recently | 12:12 |
| zigo | Thanks for taking care of it. | 12:52 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: Migrate MEM_ENCRYPTION_CONTEXT from root provider https://review.opendev.org/c/openstack/nova/+/921814 | 13:24 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: Detect AMD SEV-ES support https://review.opendev.org/c/openstack/nova/+/925685 | 13:24 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: Add hw_mem_encryption_model image property https://review.opendev.org/c/openstack/nova/+/927706 | 13:25 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: Add hw_mem_encryption_model image property https://review.opendev.org/c/openstack/nova/+/927706 | 13:26 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: libvirt: Launch instances with SEV-ES memory encryption https://review.opendev.org/c/openstack/nova/+/926106 | 13:26 |
| opendevreview | sean mooney proposed openstack/os-vif master: address test stablity under load https://review.opendev.org/c/openstack/os-vif/+/935653 | 13:30 |
| sean-k-mooney | zigo: tkajinam im hoping ^ will fix the intermitent os-vif ci failure | 13:40 |
| tkajinam | sean-k-mooney, ah, thanks ! | 13:44 |
| sean-k-mooney | oh pep8 failure because we have not merged the pre-commit change yet... | 13:48 |
| sean-k-mooney | im way to used to using pre-commit to run linting at this point | 13:48 |
| sean-k-mooney | on the plus side it passed ci https://zuul.opendev.org/t/openstack/build/e2c5522cfee741dd89a731afc9c8b19e | 13:48 |
| sean-k-mooney | so ill fix that locally and push again | 13:48 |
| sean-k-mooney | although it passed with a short exectuion time so this also ran on a fast worker vif_plug_ovs.tests.functional.ovsdb.test_ovsdb_lib.TestOVSDBLib.test_create_ovs_vif_port_with_default_qos(native) [0.746099s] ... ok | 13:50 |
| opendevreview | sean mooney proposed openstack/os-vif master: address test stablity under load https://review.opendev.org/c/openstack/os-vif/+/935653 | 13:52 |
| tkajinam | Can I ask for 2nd +2 to https://review.opendev.org/c/openstack/nova/+/930726 ? this removes eventlet related code. | 15:03 |
| tkajinam | and there are a few trivial cleanups pending on 2nd +2s and I appreciate any feedback https://review.opendev.org/c/openstack/nova/+/934517 https://review.opendev.org/c/openstack/nova/+/931146 | 15:04 |
| sean-k-mooney | i think im already +2 on all of those but yes i think those are all easy wins | 15:12 |
| tkajinam | sean-k-mooney, yeah, and thanks for these +2s :-) | 15:26 |
| gibi | tkajinam: I'm +A both. Thanks for the cleanup | 15:41 |
| bauzas | reminder: nova meeting in 5 mins | 15:55 |
| bauzas | #startmeeting nova | 16:00 |
| opendevmeet | Meeting started Tue Nov 19 16:00:13 2024 UTC and is due to finish in 60 minutes. The chair is bauzas. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| opendevmeet | The meeting name has been set to 'nova' | 16:00 |
| bauzas | hello everyone | 16:00 |
| bauzas | #link https://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting | 16:00 |
| bauzas | who's around ? | 16:01 |
| elodilles | o/ | 16:01 |
| bauzas | let's wait for a few more | 16:01 |
| bauzas | if we don't have quorum, I'll skip the meeting | 16:01 |
| s3rj1k | hi all | 16:01 |
| tkajinam | o/ | 16:02 |
| gibi | o/ | 16:02 |
| sean-k-mooney | o/ | 16:03 |
| bauzas | okay we can start | 16:03 |
| sean-k-mooney | i have one quick topic for the end of the meetign but i could also ask on the list. just an fyi | 16:04 |
| bauzas | ack | 16:04 |
| bauzas | let's have this meeting being quick | 16:04 |
| bauzas | my whole day was already packed with meetings | 16:04 |
| bauzas | #topic Bugs (stuck/critical) | 16:04 |
| bauzas | #info No Critical bug | 16:04 |
| bauzas | #info Add yourself in the team bug roster if you want to help https://etherpad.opendev.org/p/nova-bug-triage-roster | 16:04 |
| bauzas | nothing about bugs ? | 16:05 |
| bauzas | okay, let's move on | 16:05 |
| tkajinam | sean-k-mooney has proposed the fix for os-vif issue I raised last week | 16:05 |
| tkajinam | https://review.opendev.org/c/openstack/os-vif/+/935653 | 16:05 |
| bauzas | ah cool | 16:05 |
| tkajinam | if we can merge this quickly that would be nice | 16:06 |
| bauzas | sean-k-mooney++ | 16:06 |
| bauzas | I'm not sure I can review that patch but I'll try | 16:06 |
| tkajinam | I'll propose a new release of os-vif once that is merged to unblock bump of oslo.utils | 16:06 |
| sean-k-mooney | i just bumpt the timeout for the retry loop | 16:06 |
| sean-k-mooney | and made it configurable | 16:07 |
| sean-k-mooney | the test only fails under high load | 16:07 |
| sean-k-mooney | so the ohter way to fix itw as reduce concurancy but this seamed ok | 16:07 |
| sean-k-mooney | if we have issues in the future ill reduce the concurancy instead | 16:07 |
| bauzas | noted | 16:07 |
| bauzas | ok moving on then | 16:09 |
| bauzas | #topic Gate status | 16:09 |
| bauzas | #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs | 16:09 |
| bauzas | #link https://etherpad.opendev.org/p/nova-ci-failures-minimal | 16:09 |
| bauzas | #link https://zuul.openstack.org/builds?project=openstack%2Fnova&project=openstack%2Fplacement&branch=stable%2F*&branch=master&pipeline=periodic-weekly&skip=0 Nova&Placement periodic jobs status | 16:09 |
| bauzas | #info Please look at the gate failures and file a bug report with the gate-failure tag. | 16:09 |
| Uggla | o/ | 16:09 |
| bauzas | #info Please try to provide meaningful comment when you recheck | 16:09 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: Detect AMD SEV-ES support https://review.opendev.org/c/openstack/nova/+/925685 | 16:09 |
| bauzas | all periodics are green | 16:09 |
| bauzas | and fwiw, the CI seems in good shape, I was recently reviewing a lot of patches and I found no massive CI failures | 16:10 |
| bauzas | anything else to mention ? | 16:10 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: Add hw_mem_encryption_model image property https://review.opendev.org/c/openstack/nova/+/927706 | 16:10 |
| opendevreview | Takashi Kajinami proposed openstack/nova master: libvirt: Launch instances with SEV-ES memory encryption https://review.opendev.org/c/openstack/nova/+/926106 | 16:11 |
| bauzas | looks not | 16:12 |
| bauzas | #topic Release Planning | 16:12 |
| bauzas | #link https://releases.openstack.org/epoxy/schedule.html | 16:12 |
| bauzas | #action bauzas to add Epoxy nova deadlines in the schedule | 16:12 |
| sean-k-mooney | i have a minor request related to that | 16:13 |
| bauzas | shoot | 16:13 |
| sean-k-mooney | bauzas: can we put the etherpad back in the topic? | 16:13 |
| sean-k-mooney | i.e. https://etherpad.opendev.org/p/nova-2025.1-status | 16:13 |
| bauzas | in the channel topic ? | 16:13 |
| sean-k-mooney | yes | 16:13 |
| bauzas | I can try but I don't have op rights AFAIK | 16:13 |
| sean-k-mooney | ok i tought we had it there before but its fine | 16:14 |
| sean-k-mooney | its in my browser history anyway but it can be nice for visiablity since we are using that as part of our release plannign/tracking | 16:14 |
| sean-k-mooney | we can move on | 16:15 |
| bauzas | cool | 16:15 |
| bauzas | I really need to provide the release patch to add the deadlines, as we told about a review round by mid-Dec | 16:15 |
| bauzas | #topic Review priorities | 16:16 |
| bauzas | #link https://etherpad.opendev.org/p/nova-2025.1-status | 16:16 |
| bauzas | I updated it with a few blueprints that got approved | 16:16 |
| bauzas | but I still need to curate it | 16:16 |
| tkajinam | gibi, looks like all patches for igb vif model have been merged ? | 16:17 |
| gibi | tkajinam: yes indeed | 16:17 |
| gibi | tkajinam: I marked the bp implemented | 16:17 |
| tkajinam | (then we can move it to the upper section, just fyi) | 16:17 |
| tkajinam | :-) | 16:17 |
| bauzas | I'll curate that list | 16:18 |
| bauzas | tkajinam: ack, will do | 16:18 |
| gibi | I will update the etherpad... | 16:18 |
| bauzas | done :) | 16:18 |
| gibi | thanks bauzas | 16:18 |
| bauzas | moving on | 16:18 |
| bauzas | #topic Stable Branches | 16:18 |
| gibi | you were like 0.5 sec faster to cuting it :) | 16:18 |
| bauzas | elodilles: welcome back: ) | 16:18 |
| elodilles | o/ | 16:19 |
| elodilles | #info stable/202*.* gates seem to be OK | 16:19 |
| bauzas | gibi: I'm closer to my keyboard than you :p | 16:19 |
| elodilles | unmaintained/2023.1 was cut already and now stable/2023.1 is deleted, too | 16:19 |
| gibi | :) | 16:19 |
| elodilles | #info stable/2024.2, stable/2024.1 and stable/2023.2 are the maintained branches from now on | 16:19 |
| elodilles | for nova :) | 16:19 |
| elodilles | #info stable branch status / gate failures tracking etherpad: https://etherpad.opendev.org/p/nova-stable-branch-ci | 16:19 |
| elodilles | and that's all from me about stable branches | 16:20 |
| bauzas | thanks | 16:21 |
| bauzas | #topic vmwareapi 3rd-party CI efforts Highlights | 16:21 |
| bauzas | fwiesel: available ? | 16:21 |
| fwiesel | o/ | 16:21 |
| fwiesel | Hi, no update from my side. | 16:21 |
| bauzas | thanks | 16:22 |
| bauzas | #topic Open discussion | 16:22 |
| bauzas | there was one item in the agenda | 16:22 |
| bauzas | https://blueprints.launchpad.net/nova/+spec/allow-scp-ip-operations (s3rj1k) | 16:22 |
| bauzas | s3rj1k: around ? | 16:22 |
| s3rj1k | here | 16:22 |
| s3rj1k | I think this one is obsolete, as revert mentioned in comments works fine | 16:23 |
| sean-k-mooney | s3rj1k: so that should not be needed after our testing last week correct if we land https://review.opendev.org/c/openstack/nova/+/909122 | 16:23 |
| s3rj1k | sean-k-mooney: yes | 16:23 |
| sean-k-mooney | then i would like to ask for another core to review ^ | 16:23 |
| bauzas | ah cok | 16:24 |
| bauzas | ok | 16:24 |
| bauzas | then moving on | 16:24 |
| s3rj1k | I think we did not update agenda page from last week :) | 16:24 |
| sean-k-mooney | and elodilles it would be nice if you could weigh in on if you think that is backportable | 16:24 |
| elodilles | sean-k-mooney: ACK, will check that | 16:24 |
| bauzas | sean-k-mooney: you had one thing to discuss | 16:24 |
| sean-k-mooney | bauzas: yes. i would like to add ralonsoh to the os-vif core team | 16:24 |
| * bauzas opens gerrit to see the list of os-vif cores :) | 16:25 | |
| sean-k-mooney | rodolfo has helpped maintained that repo on and off over the years and as a neuton core they have an invested interest in keeping it helaty as they also consume it | 16:25 |
| bauzas | https://review.opendev.org/admin/groups/c113c882e5906f1b4ec806509ae59f0d363375c0,members | 16:26 |
| sean-k-mooney | with watcher takeing some of my time ill have a little less time to look at issue in os-vif and i thikn they choudl be a good addtion to that team | 16:26 |
| gibi | having a neutron core on the os-vif core team is not a bad idea | 16:26 |
| bauzas | yeah | 16:26 |
| bauzas | procedure-wise, it's a lib | 16:26 |
| bauzas | and looking at the existing cores of os-vif, that's basically sean and the nova team | 16:27 |
| sean-k-mooney | more or less jan moshe and sahid are mostly inative | 16:27 |
| gibi | yeah | 16:27 |
| sean-k-mooney | although sahid has beeen around a little more lately | 16:27 |
| bauzas | the usual process would to request os-vif cores to accept this nomination | 16:27 |
| bauzas | thru openstack-discuss | 16:28 |
| sean-k-mooney | correct i ment ot send the mail to the list last week | 16:28 |
| sean-k-mooney | and then bring it up today but i didnt get arond ot sending the mail | 16:28 |
| bauzas | if you did and had no argument, then I'm cool | 16:28 |
| bauzas | ah | 16:28 |
| sean-k-mooney | so i can send it this week | 16:28 |
| sean-k-mooney | and we can loop back next week | 16:28 |
| bauzas | sean-k-mooney: please do so we respect the current policy | 16:28 |
| sean-k-mooney | i just said i would ask ot see if there was any objection | 16:29 |
| bauzas | I don't expect any controversy but I'd like to continue doing things the normal way | 16:29 |
| sean-k-mooney | ok thats all form me then | 16:29 |
| bauzas | cool then we can end this meeting | 16:29 |
| bauzas | thanks all ! | 16:30 |
| bauzas | #endmeeting | 16:30 |
| opendevmeet | Meeting ended Tue Nov 19 16:30:06 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:30 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/nova/2024/nova.2024-11-19-16.00.html | 16:30 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/nova/2024/nova.2024-11-19-16.00.txt | 16:30 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/nova/2024/nova.2024-11-19-16.00.log.html | 16:30 |
| elodilles | thanks o/ | 16:30 |
| tkajinam | thank you | 16:30 |
| gibi | thanks folks | 16:30 |
| s3rj1k | thanks | 16:30 |
| tkajinam | gibi, thanks for reviewing these (sorry for my late reply but I wanted to avoid congestion) ! | 16:31 |
| tkajinam | gibi, and may I ask you a favor, to review https://review.opendev.org/c/openstack/nova/+/930726 , too? | 16:31 |
| luca_ | hello, we are experimenting with GPU passtrough with nova and placement, we incurred in a strange issue, we have 2 hosts with 8 GPUs each, we managed to run VMs with 5 GPU, but as soon as we try to schedule a VM with 6 or more GPUs placement times out because of the many candidates yields (40320), i was wondering if you can help checking our configuration for fixes. | 16:31 |
| gibi | tkajinam: sure | 16:32 |
| tkajinam | gibi, thanks ! | 16:33 |
| tkajinam | luca_, which version of nova/placement are you using ? | 16:33 |
| luca_ | we are using kolla-ansible 2024.1 quay.io/openstack.kolla/placement-api:2024.1-ubuntu-jammy and quay.io/openstack.kolla/nova-api:2024.1-ubuntu-jammy | 16:34 |
| gibi | tkajinam: done. Thanks for all the cleanups. I really appreciate your commitment to make nova a cleaner place | 16:34 |
| gibi | luca_: this is a known issue, let me find the bug | 16:35 |
| bauzas | do you have T4s ? | 16:35 |
| sean-k-mooney | t4s would not really impact this | 16:35 |
| gibi | luca_: https://review.opendev.org/c/openstack/nova/+/855885 | 16:36 |
| tkajinam | gibi, honor to hear it :-) | 16:36 |
| sean-k-mooney | bauzas: this is related to the combinitorial explaiton that happens with many nestted resouce providers | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Amend ShareMappingStatus due to asynchronous call https://review.opendev.org/c/openstack/nova/+/908864 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Amend DB model add a unique constraint. https://review.opendev.org/c/openstack/nova/+/912518 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Attach Manila shares via virtiofs (manila abstraction) https://review.opendev.org/c/openstack/nova/+/831194 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Use client token when talking to manila https://review.opendev.org/c/openstack/nova/+/925277 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Attach Manila shares via virtiofs (drivers and compute manager part) https://review.opendev.org/c/openstack/nova/+/833090 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Mounting the shares as part of the initialization process https://review.opendev.org/c/openstack/nova/+/880075 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Deletion of associated share mappings on instance deletion https://review.opendev.org/c/openstack/nova/+/881472 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Add metadata for shares https://review.opendev.org/c/openstack/nova/+/850500 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Add share_info parameter to reboot method for each driver (driver part) https://review.opendev.org/c/openstack/nova/+/854823 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Support rebooting an instance with shares (compute manager part) https://review.opendev.org/c/openstack/nova/+/854824 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Add share_info parameter to resume method for each driver (driver part) https://review.opendev.org/c/openstack/nova/+/860284 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Support resuming an instance with shares (compute manager part) https://review.opendev.org/c/openstack/nova/+/860285 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Add helper methods to rescue/unrescue shares https://review.opendev.org/c/openstack/nova/+/860286 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Support rescuing an instance with shares https://review.opendev.org/c/openstack/nova/+/860287 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Allow to mount manila share using Cephfs protocol https://review.opendev.org/c/openstack/nova/+/883862 | 16:36 |
| opendevreview | ribaudr proposed openstack/nova master: Check shares support (compute manager) https://review.opendev.org/c/openstack/nova/+/885751 | 16:37 |
| opendevreview | ribaudr proposed openstack/nova master: Attach Manila shares via virtiofs (API) https://review.opendev.org/c/openstack/nova/+/836830 | 16:37 |
| opendevreview | ribaudr proposed openstack/nova master: Add helper methods to attach/detach shares https://review.opendev.org/c/openstack/nova/+/885753 | 16:37 |
| opendevreview | ribaudr proposed openstack/nova master: Add instance.share_attach notification https://review.opendev.org/c/openstack/nova/+/850501 | 16:37 |
| opendevreview | ribaudr proposed openstack/nova master: Add instance.share_detach notification https://review.opendev.org/c/openstack/nova/+/851028 | 16:37 |
| opendevreview | ribaudr proposed openstack/nova master: Add shares to InstancePayload https://review.opendev.org/c/openstack/nova/+/851029 | 16:37 |
| opendevreview | ribaudr proposed openstack/nova master: Add instance.share_attach_error notification https://review.opendev.org/c/openstack/nova/+/860282 | 16:37 |
| opendevreview | ribaudr proposed openstack/nova master: Add instance.share_detach_error notification https://review.opendev.org/c/openstack/nova/+/860283 | 16:37 |
| opendevreview | ribaudr proposed openstack/nova master: Reports instance events to the DB regarding attaching and detaching a share https://review.opendev.org/c/openstack/nova/+/927088 | 16:37 |
| opendevreview | ribaudr proposed openstack/nova master: Add libvirt test to ensure metadata are working. https://review.opendev.org/c/openstack/nova/+/852086 | 16:37 |
| opendevreview | ribaudr proposed openstack/nova master: Add virt/libvirt error test cases https://review.opendev.org/c/openstack/nova/+/852087 | 16:37 |
| opendevreview | ribaudr proposed openstack/nova master: Manila shares admin guide documentation https://review.opendev.org/c/openstack/nova/+/871642 | 16:37 |
| bauzas | sean-k-mooney: ah I was doing too many things at once, I just briefly looked and saw GPU passthrough" | 16:37 |
| sean-k-mooney | luca_: gibi: i tought we had a diffent one but https://bugs.launchpad.net/placement/+bug/2070257 is the same porblem | 16:37 |
| opendevreview | Merged openstack/nova stable/2024.2: Route shared storage RPC to evac dest at startup https://review.opendev.org/c/openstack/nova/+/934302 | 16:37 |
| sean-k-mooney | there is an older one on the nova side somewhere | 16:37 |
| sean-k-mooney | related to amd cpus? and numa? | 16:38 |
| gibi | luca_: sean-k-mooney: yeah that bug seems to report the same thing | 16:38 |
| luca_ | i see, by any chanche using the old PciPasstroughFilter in the scheduler instead of using placement will solve this issue? | 16:38 |
| sean-k-mooney | it will work around it yes | 16:39 |
| sean-k-mooney | at the cost of the inablity to have quota | 16:39 |
| sean-k-mooney | to do do some more advanced schduilgn | 16:39 |
| sean-k-mooney | if you disable pci in placmenement then it will remove the nested resouce providers | 16:39 |
| gibi | this is GPU so GPU is using placement without the PCI in Placement feature enabled | 16:40 |
| sean-k-mooney | and the allcoation candiate epxlotion will be mitigated | 16:40 |
| gibi | so this logic cannot be turned on I think | 16:40 |
| gibi | turned off | 16:40 |
| sean-k-mooney | is it gpu or vgpu | 16:40 |
| luca_ | GPU | 16:40 |
| sean-k-mooney | gpu passthough is just pci passthough | 16:40 |
| luca_ | yeah i am passing pci-devices | 16:40 |
| tkajinam | gibi, sorry for asking a favor again but do you mind adding +a, too ? | 16:41 |
| gibi | luca_: did you enabled pci_in_placement ? | 16:41 |
| luca_ | yes | 16:41 |
| gibi | luca_: ahh I see. | 16:41 |
| tkajinam | I wonder if adding an option to limit maximum candidates to placement resolves the issue ? | 16:41 |
| gibi | luca_: then yes, turning off pci_in_placement will help | 16:41 |
| luca_ | wwhich i read is not possible to disable after enabling it :D | 16:41 |
| tkajinam | (I don't have full context, though) | 16:41 |
| sean-k-mooney | luca_: this is the main reason that is tech preview downstream for what its worth | 16:41 |
| sean-k-mooney | luca_: kind of not with workload at least | 16:42 |
| luca_ | iyeah no problem this is a testing enviroment we can rebuild it if it is needed | 16:42 |
| gibi | luca_: not out of the box, you probably need to hack around I'm affraid | 16:42 |
| gibi | tkajinam: done, sorry I missed it | 16:42 |
| tkajinam | gibi, np and thanks again ! | 16:42 |
| sean-k-mooney | luca_: you can do a few things | 16:42 |
| gibi | luca_: wondering about the limit tkajinam suggests | 16:42 |
| sean-k-mooney | gibi: that kind of works but not well | 16:43 |
| tkajinam | one downside of that limit is that it may not work well with randomize_allocation_candidates | 16:43 |
| sean-k-mooney | if you reduce the limit you will likely only get one or two chosts | 16:43 |
| tkajinam | yeah | 16:43 |
| sean-k-mooney | tkajinam: i think by defualt we generate all the permutiaon on a per host basis | 16:43 |
| sean-k-mooney | we have a downstream issue to optimise this in the future where we woudl do a barbar pole stirp | 16:44 |
| gibi | luca_: this is the limit config https://docs.openstack.org/nova/latest/configuration/config.html#scheduler.max_placement_results but maybe it limits after the candidates are generated :/ | 16:44 |
| sean-k-mooney | i.e. take the first candate for each host until we get to the limit in a round robbing fashion | 16:44 |
| sean-k-mooney | the default limti is 1000 canidates i belive | 16:45 |
| tkajinam | gibi, it is used to determine the limit query parameter in HTTP Request | 16:45 |
| tkajinam | so the limit may be applied in placement (if I read the code correctly) | 16:45 |
| gibi | tkajinam: yeah applied in placement but maybe after all the permutation is generated :/ | 16:45 |
| tkajinam | yeah | 16:45 |
| sean-k-mooney | luca_: so what i would do is the following if this is a test env, deleate any insances usign pci devices, remove all pci devices form the pci devspec, restart the comptue agents and then disble the config oprtion for pci in placmeent after they have remove the nested resouce providers | 16:46 |
| sean-k-mooney | then add the pci devspecs back | 16:47 |
| gibi | tkajinam: I don't see the limit applied directly in the permutation generaton in https://github.com/openstack/placement/blob/723da65faf66cc9b8d02f3756387dc58437e62af/placement/objects/allocation_candidate.py#L371 | 16:47 |
| sean-k-mooney | and try again | 16:47 |
| luca_ | since i am asking, is it normale that a single resource provider is generated for each GPU? | 16:47 |
| sean-k-mooney | gibi i think its later | 16:48 |
| luca_ | sean-k-mooney_ thanks for the possible solution i will try it | 16:48 |
| sean-k-mooney | but to fix this properly we need to adjust the nestign of those loops | 16:48 |
| ishanwar | Hi Team, | 16:48 |
| tkajinam | gibi, yeah, I see limit_results applies the limit but it is applied to the full list... | 16:49 |
| sean-k-mooney | luca_: yes becasue we create 1 RP per PF | 16:49 |
| sean-k-mooney | ishanwar: o/ | 16:49 |
| sean-k-mooney | tkajinam: gibi we basically need to make the permuation generateion lazy using generators | 16:49 |
| gibi | luca_: as you can assign different traits to different PFs via the dev_spec we need to model them separately | 16:49 |
| tkajinam | sean-k-mooney, yeah I totally agree | 16:50 |
| sean-k-mooney | ya that or use diffent resouce classes, physnets ectra | 16:50 |
| luca_ | i see, does this mean that if the device type is type-PCI instead of type-PF you just create 1 rp per kind? | 16:50 |
| ishanwar | I currently facing some issue with the dev stack setup for nova. | 16:50 |
| gibi | luca_: we create one RP for each device basically where the name of the PR contains the PCI address of the device | 16:51 |
| sean-k-mooney | luca_: no if tis type-PF or type-PCI we create on resouce provider per phasical device | 16:51 |
| luca_ | oh ok | 16:51 |
| sean-k-mooney | luca_: for type-VF they are all on a single RP based on the parent PF | 16:51 |
| gibi | https://specs.openstack.org/openstack/nova-specs/specs/zed/approved/pci-device-tracking-in-placement.html#modeling-pci-devices-in-placement | 16:51 |
| gibi | details are here ^^ | 16:51 |
| ishanwar | ./stack.sh gets stuck here. LOGS: +functions:wait_for_compute:504 [[ 124 != 0 ]] +functions:wait_for_compute:505 echo 'Didn'\''t find service registered by hostname after 60 seconds' Didn't find service registered by hostname after 60 seconds +functions:wait_for_compute:506 openstack --os-cloud devstack-admin --os-region RegionOne compute service list | 16:54 |
| gibi | luca_: that remainds me that you can trick nova to allow disabling pci_in_placement by stoping nova-compute and removing COMPUTE_MANAGED_PCI_DEVICE traits from the rsource providers | 16:54 |
| sean-k-mooney | ishanwar: that typically means that there was an error that shoudl be visable in "journalctl -u devstack@n-cpu" | 16:55 |
| luca_ | i see, tomorrow we wil try to disable pci in plcaement as sean-k-mooney_ suggested, hopefully it will work, thanks for the help guys! | 16:55 |
| gibi | luca_: keep us posted. | 16:55 |
| gibi | and good luck | 16:55 |
| luca_ | sure, will let you know! thanks! | 16:55 |
| ishanwar | sean-k-mooney: let me check. Can I ping you directly ? The docs seems to lack troubleshooting | 16:56 |
| * gibi drops | 16:56 | |
| sean-k-mooney | ishanwar: so devstack pings are proably better in #openstack-qa | 16:57 |
| opendevreview | Stephen Finucane proposed openstack/nova master: Fix typo in release note https://review.opendev.org/c/openstack/nova/+/935681 | 16:57 |
| opendevreview | Stephen Finucane proposed openstack/nova master: zuul: Add missing context comments for nova-next https://review.opendev.org/c/openstack/nova/+/935682 | 16:57 |
| sean-k-mooney | ishanwar: devstack is written in bash so that its easy to read and debug. it does require some knolage of openstack but for the most part it ties ot keep the code readable and simple | 16:57 |
| bauzas | well, devstack is clearly intended for dev purposes | 16:59 |
| ishanwar | sean-k-mooney: I see. thanks. another question. Are ppl active on #openstack-* channels only during the meetings, or are there people active during other times as well ? | 16:59 |
| bauzas | people are expected to have a bit of knowledge about the services already | 16:59 |
| sean-k-mooney | ishanwar: we generally hang out here most of the time | 16:59 |
| bauzas | and that error self-explains : the nova-compute service didn't show up in time | 17:00 |
| sean-k-mooney | most of use will hae irc open in a window while working on other stuff and check in perodically | 17:00 |
| bauzas | which means that something prevented that service to register itself | 17:00 |
| bauzas | and as a reminder, this channel is not intended for debugging purposes | 17:00 |
| ishanwar | bauzas: Thanks I see. I have some knowledge of nova only from the operational side. I am still figuring out the openstack community, as I am used to slack channels and zoom meetings for opensource in general. Will not use this channel for debugging purposes. Thanks | 17:02 |
| bauzas | tbc we're here to help, for sure | 17:04 |
| bauzas | so, for example, some operators discuss with us their pain points | 17:05 |
| bauzas | sometimes, someone is stuck installing a devstack env and we try to also give him some help | 17:05 |
| bauzas | but here, you should first look at nova-compute logs and see, most of the time, this is a config issue :) | 17:06 |
| bauzas | ishanwar : HTH : https://docs.openstack.org/devstack/latest/systemd.html | 17:06 |
| opendevreview | Merged openstack/nova master: Drop remaining logic for websockify < 0.9.0 https://review.opendev.org/c/openstack/nova/+/934517 | 17:55 |
| opendevreview | Merged openstack/nova master: Replace deprecated constant_time_compare https://review.opendev.org/c/openstack/nova/+/931146 | 17:55 |
| opendevreview | Antony Messerli proposed openstack/nova master: docs: Corrects a typo on a placement audit command https://review.opendev.org/c/openstack/nova/+/922850 | 18:45 |
| yuriy | Please correct me if I'm wrong; In a scenario where an LVM ephemeral based instance needs more ram... there doesn't seem to be a way to do that other than remake the entire VM with a flavor that has more ram. Resizing doesn't appear to be supported for LVM based instances. | 19:01 |
| gmann | bauzas: sean-k-mooney: on Noble migration, this is set of things we need to review. they will be merged after base jobs are migrated (I added depends-on) but advance review will be nice https://etherpad.opendev.org/p/migrate-to-noble#L64 | 19:01 |
| gmann | tested all repo under Nova | 19:01 |
| bauzas | okay, I'll add it to my TODO list | 19:02 |
| * bauzas stops for the day, his 7 hours of meetings killed himself | 19:02 | |
| gmann | thanks | 19:02 |
| gmann | bauzas: I thought I only made Tuesday full of meetings (upstream + downstream total 7) :) | 19:03 |
| bauzas | tomorrow will be better : 6 hours of meetings \o/ | 19:04 |
| bauzas | call it a productive week | 19:04 |
| gmann | take rest then :) | 19:04 |
| bauzas | I should consider myself becoming a MD, I'm soon about to have a 3-month delay for a meeting request :) | 19:05 |
| gmann | good promotion I would say. ask for it. :) | 19:09 |
| gmann | sean-k-mooney: gibi: I could not find right package for nova doc job failure 'pcre.h missing" , if you do feel free to update/test here https://review.opendev.org/c/openstack/nova/+/935577 | 19:09 |
| gmann | as per ubuntu noble package info libpcre3-dev should be enough (tried libpcre2-dev latest one) which is already in our bindep.txt but it fail | 19:10 |
| sean-k-mooney | ill see if i can get to that tomorrow i belive you can use apt-cache to query which package provdies a file | 19:12 |
| sean-k-mooney | dpkg -S appreently works too | 19:13 |
| sean-k-mooney | sorry not apt-cache apt-file | 19:15 |
| sean-k-mooney | libpcre3-dev: /usr/include/pcre.h | 19:16 |
| gmann | yeah, it gives the same | 19:17 |
| sean-k-mooney | ya so the doc issue must be seperate ill see fi i can repoduce that localy in my ubuntu 24.04 devstack env | 19:18 |
| gmann | thanks | 19:18 |
| sean-k-mooney | but ya just finishing for today ping me later in the week if i have not looked at this tomorrow | 19:19 |
| opendevreview | Ghanshyam proposed openstack/nova master: Testing doc job on Ubuntu Noble https://review.opendev.org/c/openstack/nova/+/935577 | 19:43 |
| opendevreview | melanie witt proposed openstack/nova stable/2024.1: nova-manage: modify image properties in request_spec https://review.opendev.org/c/openstack/nova/+/935709 | 19:51 |
| opendevreview | melanie witt proposed openstack/nova stable/2023.2: nova-manage: modify image properties in request_spec https://review.opendev.org/c/openstack/nova/+/935711 | 19:52 |
| melwitt | dansmith, sean-k-mooney: fyi I updated the flavor scanning patch to split it into helper functions and do resource requests. note that there is an unrelated bug with hw:mem_encryption that is mentioned in a try-except comment and also shown in a func test | 20:28 |
| gmann | melwitt dansmith gibi can you check this easy one https://review.opendev.org/c/openstack/nova/+/934578 | 20:35 |
| melwitt | gmann: +2 | 20:37 |
| gmann | thanks | 20:38 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!