Tuesday, 2022-03-29

*** seebaer is now known as seba00:14
*** dasm is now known as dasm|off01:06
opendevreviewTakashi Natsume proposed openstack/python-novaclient master: Add Python3 zed unit tests  https://review.opendev.org/c/openstack/python-novaclient/+/83536802:26
opendevreviewTakashi Natsume proposed openstack/python-novaclient master: Add openssl in bindep.txt  https://review.opendev.org/c/openstack/python-novaclient/+/83537002:26
opendevreviewTakashi Natsume proposed openstack/osc-placement master: Change minversion of tox to 3.18.0  https://review.opendev.org/c/openstack/osc-placement/+/79197202:36
*** abhishekk is now known as akekane|home04:54
*** akekane|home is now known as abhishekk04:54
opendevreviewMerged openstack/nova master: Move FIPS jobs to experimental and periodic queue  https://review.opendev.org/c/openstack/nova/+/83343106:23
opendevreviewStephen Finucane proposed openstack/nova master: objects: Remove 'NovaObjectDictCompat' from 'Service'  https://review.opendev.org/c/openstack/nova/+/83559508:55
opendevreviewStephen Finucane proposed openstack/nova master: objects: Don't use generic 'Field' container  https://review.opendev.org/c/openstack/nova/+/73823908:59
opendevreviewStephen Finucane proposed openstack/nova master: objects: Remove unnecessary type aliases, exceptions  https://review.opendev.org/c/openstack/nova/+/73824008:59
opendevreviewStephen Finucane proposed openstack/nova master: objects: Use imports instead of type aliases  https://review.opendev.org/c/openstack/nova/+/73801808:59
opendevreviewStephen Finucane proposed openstack/nova master: objects: Remove wrappers around ovo mixins  https://review.opendev.org/c/openstack/nova/+/73801908:59
opendevreviewStephen Finucane proposed openstack/nova master: objects: Remove 'NovaObjectDictCompat' from 'Service'  https://review.opendev.org/c/openstack/nova/+/83559508:59
opendevreviewStephen Finucane proposed openstack/nova master: WIP: add ovo-mypy-plugin to type hinting o.vos  https://review.opendev.org/c/openstack/nova/+/75885108:59
*** dasm|off is now known as dasm13:11
bauzasfolks, I have a problem with the nova meeting today13:37
bauzassince Europe is now on DST, our meeting will be at 4pm UTC but 6pm for me13:37
bauzasbut I need to go to someway by 7pm 13:37
sean-k-mooneyack we coudl just cancel it since the ptg is next week13:38
bauzasso either we have a small meeting until 4.15pm UTC or someone else could continue to discuss it13:38
dansmith++13:38
sean-k-mooneyunless there is imporant topics that cant wait13:38
dansmithTC also canceled this week13:38
bauzasI have a small agenda at the time13:39
bauzasat least for asking folks to provide their PTG topics13:39
bauzashttps://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting13:39
sean-k-mooneyok do you want to just skip the normal standing itmes then and have a short meetign to cover that topic and wrap early13:39
bauzassean-k-mooney: we could do this13:40
bauzassean-k-mooney: just opening the meeting for the PTG13:40
bauzasand then I'll provide a email thread 13:40
noonedeadpunkhey there! I was wondering - any reason we do this https://opendev.org/openstack/nova/src/branch/master/nova/virt/libvirt/driver.py#L986 ?13:45
noonedeadpunkWhy I'm asking is bassically after talk in #virt regarding MPX flag, that makes IceLake CPUs being identified as Broadwell.....13:47
noonedeadpunkI mean - there's masking of flags being already implemented13:47
noonedeadpunkso technically comparing provided model to virsh capabilities is not needed13:48
sean-k-mooney if you have configured a cpu model that is not compatibale with the host the agent shoudl refuse to start13:50
sean-k-mooneyso we have to check cpu compatiabity on agent start up13:50
sean-k-mooneynoonedeadpunk: we have some patches in flight to use the newer libvirt api to do this which takes into account which flags are masked or emulated13:50
noonedeadpunkSo I have intel xeon gold 6338 and trying to provide Icelake, but only Broadwell is available for it13:51
noonedeadpunkoh13:51
sean-k-mooneypresumable icelake reference cpu feature flags that are not present on the host correct13:51
sean-k-mooneyperhaps tsk13:52
sean-k-mooney*tsz13:52
sean-k-mooney... tsx13:52
noonedeadpunkwell, the only "streight" way is to add dozen of extra flags to cover difference...13:52
noonedeadpunksean-k-mooney: so the falg that is missing is MPX which is sunset since 2019... But #virt said they can't jsut drop it for $reasons 13:53
noonedeadpunkand they just suggested to mask it as they don't have other option13:53
sean-k-mooneyya https://paste.opendev.org/show/bmfNxhnzVYp54W9LQK0J/ so mpx is listed in the cpu model13:55
noonedeadpunkand I mean - https://lore.kernel.org/lkml/tip-eb012ef3b4e331ae479dd7cd9378041d9b7f851c@git.kernel.org/ and Intel also said that since 2019 no CPU will have it13:55
noonedeadpunkso I'm kind of... either use cpu model from 2014 or have dozens of flags specified in extras...13:56
noonedeadpunkor manually edit cpu_map which is too bad13:57
sean-k-mooneywell that is a abi break on intels part which libvirt could accoutn for by adding a no_MPX verison of the cpu model13:57
sean-k-mooneybut looking at https://opendev.org/openstack/nova/src/branch/master/nova/virt/libvirt/driver.py#L982-L100813:57
sean-k-mooneywe coudl rework this os that we apply the extra cpu flags to the model before we do the compat test13:57
sean-k-mooneythat woudl allow you to add cpu_model_extra_flags=-mpx13:58
sean-k-mooneyand provide that combination was valid it would proceed13:59
noonedeadpunkwell, self._get_cpu_info() is jsut `virsh capabilities`?13:59
sean-k-mooneyright now it checks that the each model is valid on its own and then the default mode + the extra flags is valid13:59
noonedeadpunkand `virsh capabilities` falls back to Broadwell13:59
noonedeadpunkbecause all else have that damn MPX14:00
sean-k-mooneyyes again its an abi break by intel effectivly14:00
sean-k-mooneythis might be address by the new cpu compare api that we are moving too14:00
sean-k-mooneybut if not we can rework that validation14:01
sean-k-mooneythe curertn two pahse apprch is not really correct14:01
sean-k-mooneyit predates the ablity to remove flags14:01
sean-k-mooneywhen we added the ability to remove flags this shoudl have been factored into one loop14:01
sean-k-mooneyfor now yes your only option is to ude broadwall and add the missing flags14:02
noonedeadpunksean-k-mooney: ok, thanks a lot for help)14:04
noonedeadpunkhopefully it will be better soon )14:04
sean-k-mooneywell the currnt patch has been draging on for 3 cycle it might be betere to just rework this check as a simple backportable bugfix14:04
noonedeadpunktbh that would be perfect but I can't say I see easy way how to re-work it14:05
sean-k-mooneysomething like this https://paste.opendev.org/show/b6PI9EzL6ucJUN7FKIBL/14:07
sean-k-mooneythat would allow you to set cpu_model=Icelake cpu_model_extra_flags=-mpx14:08
sean-k-mooneyat least i think that would work14:08
sean-k-mooneythe important thing is we apply the flag modification to the model before we ask libvirt to see if its compatible14:09
sean-k-mooneythat quick refactor woudl loose some granualrity in the error message but i think it would allow better flexiblity14:11
* noonedeadpunk reading it through14:11
sean-k-mooneywe could just print the requested feature and the host features and let it to the reader to do the intersection to get back most of the the previously useful info form the error14:12
noonedeadpunkBut I think it won't affect _get_cpu_info result?14:13
noonedeadpunkas libvirt still would provide Broadwell as an aswer to that14:14
noonedeadpunkand we're comparing flags requested vs cpu model provided but virsh capabilities iirc14:14
sean-k-mooney_get_cpu_info i think shoudl provide the host cpu info14:15
noonedeadpunknot really I guess14:18
noonedeadpunkant least not on Xena14:18
noonedeadpunksean-k-mooney: I added some logging https://paste.opendev.org/show/b0AFUQdxdydGrXHQHn6o/14:21
noonedeadpunkso _get_cpu_info for me looks exactly as `virsh capabilities` output14:21
sean-k-mooneyyes we use libvirt as our interface to collect host infomation14:22
noonedeadpunkor welll14:22
noonedeadpunkflags are not from broadwell14:22
sean-k-mooneythe flags should be the same or simlar to lscpu14:23
noonedeadpunkok, yes, then your suggestion can make sense14:23
sean-k-mooneythe model that is listed is the closet model that matches the cpu if i undersand correctly14:24
noonedeadpunkyeah, I think you're right here14:25
ade_leedansmith, so what changed to make https://review.opendev.org/c/openstack/nova/+/831844 pass?14:53
dansmithade_lee: the wait-for-sshable I think14:53
ade_leeah ok14:54
dansmiththere were a number of changes to various tests to make that work, but that seemed to be the problem with the quick boot-attach-detach workflow which was in a number of places14:54
ade_leedansmith, excellent - we're going to run the cinder and glance fips tests again now to see if they pass14:56
dansmithI was seeing those qemu crashes in cs8, so I'm interested to see if those still pop up in cs9 now that this always-fail stuff is resolved15:01
gmannade_lee: dansmith device tag test also is now ssh-able so may be that making it pass.15:13
gmannrecently ssh-able15:13
bauzasreminder (special for EU folks) : nova meeting in 25 mins here15:36
bauzaswe'll have a very short meeting15:36
bauzas#startmeeting nova16:00
opendevmeetMeeting started Tue Mar 29 16:00:06 2022 UTC and is due to finish in 60 minutes.  The chair is bauzas. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
opendevmeetThe meeting name has been set to 'nova'16:00
bauzashola everybody16:00
gmanno/16:00
bauzaslet's do a very quick meeting (up to 15 mins) as I need to move on 16:00
elodilleso/16:00
gmannsure16:00
bauzasDST change here, lovely16:00
gibio/16:00
bauzasif someone wants to continue discussing, I can pass the chair baton16:00
bauzasbut given next week will be PTG, I don't think we have a lot of things to discuss16:01
bauzaslet's start then16:01
gmannah its already 29. not DST is in sync in EU and USA :)16:01
bauzas#link https://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting16:01
gmann*now16:01
bauzas#topic Bugs (stuck/critical) 16:01
bauzas#info No Critical bug16:02
bauzas#link https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New 31 new untriaged bugs (+3 since the last meeting)16:02
bauzas#help Nova bug triage help is appreciated https://wiki.openstack.org/wiki/Nova/BugTriage16:02
bauzas#link https://storyboard.openstack.org/#!/project/openstack/placement 26 open stories (0 since the last meeting) in Storyboard for Placement 16:02
bauzasnothing to say16:02
* gibi is distracted by16:02
bauzasmoving on16:02
bauzas#topic Gate status 16:02
bauzas#link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs 16:02
bauzas#link https://zuul.openstack.org/builds?project=openstack%2Fplacement&pipeline=periodic-weekly Placement periodic job status 16:02
bauzas#info Please look at the gate failures and file a bug report with the gate-failure tag.16:02
bauzasmoving on too16:02
bauzas#topic Release Planning 16:02
bauzas#link https://releases.openstack.org/yoga/schedule.html#y-final Yoga GA is planned on Wed16:02
bauzas#info no RC2 was needed16:02
bauzasthere, we go to the main meat16:03
bauzas#topic PTG preparation 16:03
bauzas#link https://etherpad.opendev.org/p/nova-zed-ptg Nova Zed PTG etherpad16:03
bauzas#action all please add your topics before Thursday EOB16:03
bauzasas you can see, we don't have a lof of topics16:03
bauzas#action bauzas to provide a mailing thread for asking for topics16:03
bauzasso, please add the topics before end of this week so I can plan the agenda16:04
bauzasand in case we need other teams for cross-project discussions, I could ping the other PTLs16:04
bauzasthanks to the folks who already provided some topics16:05
*** EugenMayer4 is now known as EugenMayer16:05
bauzasremind, hopefully this PTG would be the last virtual \o/16:05
bauzasany questions about the PTG ?16:05
bauzasas you can see in the etherpad, we'll have the same room, the newton one16:06
bauzasfor the whole PTG16:06
bauzasthat's basically it for this16:06
bauzascan we move ?16:07
bauzas(punting review priorities for this meeting)16:07
bauzas#topic Stable Branches 16:07
bauzaselodilles: ?16:07
elodilles#info xena branch is blocked (by nova-tox-functional-centos8-py36 job): agreed to set the job non-voting, patch: https://review.opendev.org16:07
gmannupdates on centos8-py36 on stable/xena: now suds-jurko version conflict is happening #link https://zuul.opendev.org/t/openstack/build/4cb6ee2b453149998f8a489cfac9b0da16:07
elodilles#info pike branch is blocked - fix: https://review.opendev.org/c/openstack/nova/+/83366616:07
elodillesreminder: Victoria Extended Maintenance transition is due ~ in a month (2022-04-27)16:08
gmannwe discussed it in openinfra channel and  we need these two backports #link https://review.opendev.org/c/openstack/oslo.vmware/+/835672 #link https://review.opendev.org/c/openstack/requirements/+/83567116:08
elodillesgmann: but that's in the same job, right?16:08
gmannelodilles: same job , failure can be seen in https://review.opendev.org/c/openstack/nova/+/83476516:08
gmannsuds-jurko version conflict is consistent there from oslo/vmware which was fixed in yoga16:09
elodillesgmann: yes, thanks for that DNM patch16:09
gmannI was trying those mirror issue and traced to this issue which actually need to be fixed16:10
elodillesjust for the record, we could unblock the gate via this patch: https://review.opendev.org/c/openstack/nova/+/83485416:10
elodilles(the correct link)16:10
gmannelodilles: bauzas if we think req and oslo.vmware backport and then oslo.vmware release for stable/xena and then u-c update can take time then we can go with n-v for now and then revert 16:10
bauzasok16:11
elodillesgmann: ack16:11
bauzashow can I help ?16:11
elodillesthanks for the info16:11
elodillesbauzas: by reviewing the n-v patch (linked above ^^^) o:)16:12
bauzaselodilles: cool, thanks16:12
bauzasoh done then16:13
gmannyeah, I will add these info there and will propsoe revert once all backport and u-c are in place16:13
elodillesthanks gmann !16:13
elodillesi'll also try to look at the vmware and req patches after Yoga release :)16:13
bauzasok, moving on ?16:14
gmannelodilles: ack, thanks16:14
bauzas#topic Open discussion 16:14
bauzasany item to discuss ?16:15
bauzasor can I end the meeting ?16:15
gmannnothing from me.16:15
bauzasthanks all then for this quick meeting and seeing hopefully all of you next week :)16:15
bauzas#endmeeting16:15
opendevmeetMeeting ended Tue Mar 29 16:15:40 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:15
opendevmeetMinutes:        https://meetings.opendev.org/meetings/nova/2022/nova.2022-03-29-16.00.html16:15
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/nova/2022/nova.2022-03-29-16.00.txt16:15
opendevmeetLog:            https://meetings.opendev.org/meetings/nova/2022/nova.2022-03-29-16.00.log.html16:15
* bauzas rushes off the keyboard16:15
elodilleso/16:16
gibio/16:16
*** sfinucan is now known as stephenfin16:31
opendevreviewkiran pawar proposed openstack/nova master: VMware: Early fail spwan if memory is not multiple of 4.  https://review.opendev.org/c/openstack/nova/+/83573917:31
*** dasm is now known as dasm|afk17:33
opendevreviewmelanie witt proposed openstack/nova-specs master: Move implemented specs for the Yoga release  https://review.opendev.org/c/openstack/nova-specs/+/83527220:08
opendevreviewmelanie witt proposed openstack/nova-specs master: Remove setup.py and setup.cfg  https://review.opendev.org/c/openstack/nova-specs/+/83575920:08
melwittbauzas: rebased your change on top of a change meant to fix the docs and pep8 jobs in nova-specs ^20:25
melwittgmann: these two reviews have been sitting for awhile, they're about the perfload jobs that run on the placement repo, if you might be interested in reviewing https://review.opendev.org/q/topic:perfload-error21:14
opendevreviewmelanie witt proposed openstack/nova master: Fix pre_live_migration rollback  https://review.opendev.org/c/openstack/nova/+/81532421:29

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!