Thursday, 2021-01-14

« Wednesday, 2021-01-13 Index Friday, 2021-01-15 »
*** macz_ has quit IRC00:22
*** tosky has quit IRC00:36
brinzhang_gmann: hi are you around?00:41
brinzhang_gmann: what's your mean of this https://review.opendev.org/c/openstack/nova/+/729563/26/nova/api/openstack/compute/shelve.py#5900:42
brinzhang_gmann: do we need to merge your fix into the shelve/unshelve patch?00:42
*** LinPeiWen94 has quit IRC00:45
*** songwenping__ has joined #openstack-nova00:49
*** songwenping_ has quit IRC00:53
*** sapd1 has quit IRC00:55
*** chengsheng has quit IRC01:19
openstackgerritBrin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from List/Show usage APIs  https://review.opendev.org/c/openstack/nova/+/76850901:34
*** hoonetorg has joined #openstack-nova01:42
*** sapd1 has joined #openstack-nova01:47
*** songwenping_ has joined #openstack-nova01:51
*** songwenping__ has quit IRC01:55
*** xinranwang has joined #openstack-nova02:00
*** dklyle has quit IRC02:01
*** david-lyle has joined #openstack-nova02:01
openstackgerritBrin Zhang proposed openstack/nova master: Replace tenants* with projects* of policies  https://review.opendev.org/c/openstack/nova/+/76531502:14
*** zenkuro has quit IRC02:18
*** david-lyle has quit IRC02:18
*** mlavalle has quit IRC02:34
openstackgerritBrin Zhang proposed openstack/nova master: Replace os-simple-tenant-usage with os-simple-project-usage  https://review.opendev.org/c/openstack/nova/+/76885202:47
*** LinPeiWen28 has joined #openstack-nova03:01
*** rcernin has quit IRC03:04
*** rcernin has joined #openstack-nova03:25
*** rcernin has quit IRC03:27
*** brinzhang0 has joined #openstack-nova03:27
*** brinzhang0 has quit IRC03:29
*** brinzhang0 has joined #openstack-nova03:29
*** brinzhang_ has quit IRC03:30
*** brinzhang0 has quit IRC03:30
*** brinzhang0 has joined #openstack-nova03:31
*** rcernin has joined #openstack-nova03:31
*** rcernin has quit IRC03:36
*** rcernin has joined #openstack-nova03:37
*** rcernin has quit IRC03:38
*** rcernin has joined #openstack-nova03:38
*** rcernin has quit IRC03:39
*** rcernin has joined #openstack-nova03:39
*** psachin has joined #openstack-nova03:57
*** whoami-rajat__ has joined #openstack-nova04:22
*** artom has quit IRC04:24
openstackgerritBrin Zhang proposed openstack/nova master: Replace tenant_id with project_id in os-quota-sets path  https://review.opendev.org/c/openstack/nova/+/76885104:32
*** amotoki has quit IRC04:44
*** amotoki has joined #openstack-nova04:44
*** ociuhandu has joined #openstack-nova05:14
*** sapd1 has quit IRC05:19
*** ociuhandu has quit IRC05:19
*** xinranwang has quit IRC05:19
*** dave-mccowan has quit IRC05:43
*** CeeMac has quit IRC05:53
*** ratailor has joined #openstack-nova05:55
*** nightmare_unreal has joined #openstack-nova06:02
openstackgerritWenping Song proposed openstack/nova-specs master: Libvirt supports composing cyborg owned vGPU accelerator into domain XML  https://review.opendev.org/c/openstack/nova-specs/+/75011606:05
openstackgerritBrin Zhang proposed openstack/nova master: Replace tenant_id with project_id in Limits API  https://review.opendev.org/c/openstack/nova/+/76886206:08
openstackgerritBrin Zhang proposed openstack/nova master: Replace tenant* with project* in codes  https://review.opendev.org/c/openstack/nova/+/76932906:08
*** sapd1 has joined #openstack-nova06:17
*** brinzhang_ has joined #openstack-nova06:25
*** brinzhang0 has quit IRC06:28
*** gyee has quit IRC06:31
*** xek has joined #openstack-nova06:42
*** sapd1 has quit IRC06:54
*** rcernin has quit IRC07:40
*** rpittau|afk is now known as rpittau07:47
*** belmoreira has joined #openstack-nova07:49
*** ralonsoh has joined #openstack-nova07:51
*** ralonsoh_ has joined #openstack-nova07:56
*** rcernin has joined #openstack-nova07:56
*** sapd1 has joined #openstack-nova07:58
*** ralonsoh has quit IRC07:59
*** rcernin has quit IRC08:01
*** slaweq has joined #openstack-nova08:03
*** zoharm has joined #openstack-nova08:13
*** andrewbonney has joined #openstack-nova08:17
*** spatel has joined #openstack-nova08:17
*** tesseract has joined #openstack-nova08:18
*** spatel has quit IRC08:22
*** rcernin has joined #openstack-nova08:26
*** ralonsoh has joined #openstack-nova08:28
*** ralonsoh_ has quit IRC08:28
*** zzzeek has quit IRC08:28
*** zzzeek has joined #openstack-nova08:31
openstackgerritBrin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from Rebuild Server API  https://review.opendev.org/c/openstack/nova/+/76638008:39
openstackgerritBrin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from List SG API  https://review.opendev.org/c/openstack/nova/+/76672608:39
*** brinzhang0 has joined #openstack-nova08:45
*** brinzhang_ has quit IRC08:48
*** tosky has joined #openstack-nova08:49
*** slaweq has quit IRC08:55
*** slaweq has joined #openstack-nova09:00
gibigood morning09:06
*** ociuhandu has joined #openstack-nova09:16
*** zenkuro has joined #openstack-nova09:22
*** ircuser-1 has quit IRC09:25
openstackgerritBalazs Gibizer proposed openstack/nova stable/ussuri: Warn when starting services with older than N-1 computes  https://review.opendev.org/c/openstack/nova/+/77076409:25
openstackgerritBalazs Gibizer proposed openstack/nova stable/ussuri: Add upgrade check about old computes  https://review.opendev.org/c/openstack/nova/+/77076509:25
*** ociuhandu has quit IRC09:26
lyarwoodsean-k-mooney: https://review.opendev.org/q/topic:spec/libvirt-default-machine-type - when you're around and have time can we have a chat about the direction of this series before I finish things up and write docs etc?09:44
*** derekh has joined #openstack-nova09:50
openstackgerritBalazs Gibizer proposed openstack/nova stable/ussuri: Reproduce bug 1896463 in func env  https://review.opendev.org/c/openstack/nova/+/77076809:56
openstackbug 1896463 in OpenStack Compute (nova) rocky "evacuation failed: Port update failed : Unable to correlate PCI slot " [Low,In progress] https://launchpad.net/bugs/189646309:56
openstackgerritBalazs Gibizer proposed openstack/nova stable/ussuri: Set instance host and drop migration under lock  https://review.opendev.org/c/openstack/nova/+/77076909:56
*** ociuhandu has joined #openstack-nova09:57
*** zzzeek has quit IRC10:02
*** zzzeek has joined #openstack-nova10:02
*** Mamduhala has joined #openstack-nova10:04
*** ociuhandu has quit IRC10:05
*** rcernin has quit IRC10:14
*** Mamduhala has quit IRC10:15
*** ociuhandu has joined #openstack-nova10:19
*** rcernin has joined #openstack-nova10:23
*** ociuhandu has quit IRC10:23
*** lpetrut has joined #openstack-nova10:33
*** rcernin has quit IRC10:40
*** ociuhandu has joined #openstack-nova10:44
*** dtantsur|afk is now known as dtantsur10:56
*** brinzhang has joined #openstack-nova10:57
*** brinzhang has quit IRC10:58
*** brinzhang has joined #openstack-nova10:58
*** brinzhang0 has quit IRC10:59
*** songwenping__ has joined #openstack-nova11:07
*** songwenping_ has quit IRC11:10
*** sapd1 has quit IRC11:12
*** brinzhang has quit IRC11:25
*** spatel has joined #openstack-nova11:25
*** brinzhang has joined #openstack-nova11:25
*** brinzhang_ has joined #openstack-nova11:26
*** songwenping_ has joined #openstack-nova11:28
*** brinzhang_ has quit IRC11:28
*** brinzhang_ has joined #openstack-nova11:29
*** spatel has quit IRC11:29
*** brinzhang has quit IRC11:30
*** songwenping__ has quit IRC11:30
sean-k-mooneylyarwood: https://review.opendev.org/c/openstack/nova/+/767533/4/nova/virt/libvirt/driver.py#577511:31
openstackgerritStephen Finucane proposed openstack/nova master: utils: Remove periods from instance hostnames  https://review.opendev.org/c/openstack/nova/+/76448211:33
sean-k-mooneylyarwood: over all that pathch looks good to me be the precidence relationship is wrong in my view11:34
sean-k-mooneylyarwood: im going to go grab coffee and ill be back in a minute but after that im free to talk whenever suits11:34
lyarwoodsean-k-mooney: cool thanks, image, sysmeta and then config. I'll respin this afternoon.11:41
*** jangutter has quit IRC11:45
lyarwoodstephenfin: https://review.opendev.org/c/openstack/openstacksdk/+/767526 sorry about the spam on here btw, I'm using gibi's tampermonkey script to display zuul results and got confused when I saw failures from a previous run.11:47
*** rcernin has joined #openstack-nova11:55
stephenfinlyarwood: heh, nw :)11:57
*** eharney has quit IRC11:57
*** rcernin has quit IRC11:58
*** e0ne has joined #openstack-nova12:00
*** brinzhang0 has joined #openstack-nova12:03
*** brinzhang_ has quit IRC12:05
sean-k-mooneystephenfin: https://review.opendev.org/c/openstack/python-openstackclient/+/765366 and the other osc changes faild the gate by the way12:08
sean-k-mooneythat one seams to have pagination issues for list servers which you did not change12:08
sean-k-mooneyit had a bunch of json decode errors12:08
*** eharney has joined #openstack-nova12:09
sean-k-mooneyoh you have a recheck going12:09
sean-k-mooneylooks like the same error on all of them12:10
*** ociuhandu has quit IRC12:11
*** eharney has quit IRC12:28
*** eharney has joined #openstack-nova12:29
*** ratailor has quit IRC12:31
openstackgerritsean mooney proposed openstack/nova stable/victoria: only wait for plugtime events in pre-live-migration  https://review.opendev.org/c/openstack/nova/+/77074412:35
*** ociuhandu has joined #openstack-nova12:35
openstackgerritsean mooney proposed openstack/nova stable/ussuri: only wait for plugtime events in pre-live-migration  https://review.opendev.org/c/openstack/nova/+/77074512:37
*** psachin has quit IRC12:39
openstackgerritsean mooney proposed openstack/nova stable/ussuri: only wait for plugtime events in pre-live-migration  https://review.opendev.org/c/openstack/nova/+/77074512:45
*** ociuhandu has quit IRC12:55
*** e0ne has quit IRC13:12
*** spatel has joined #openstack-nova13:13
*** brinzhang0 has quit IRC13:13
*** brinzhang0 has joined #openstack-nova13:14
*** spatel has quit IRC13:18
*** macz_ has joined #openstack-nova13:19
*** macz_ has quit IRC13:24
*** ociuhandu has joined #openstack-nova13:25
*** ociuhandu has quit IRC13:27
*** ociuhandu has joined #openstack-nova13:27
*** artom has joined #openstack-nova13:30
*** nweinber has joined #openstack-nova13:54
*** spatel has joined #openstack-nova14:00
gibilyarwood: I'm wondering if I should do the cleanup MIN_LIBVIRT_VERSION >= 4.1.0 before I change the detach logic as that cleanup would simplyfy the code that I have to handle14:03
gibihttps://github.com/openstack/nova/blob/e6f5e814050a19d6f027037424556b2889514ec3/nova/virt/libvirt/guest.py#L41814:03
lyarwoodgibi: hey sorry, so that's all part of https://review.opendev.org/q/topic:%22bump-libvirt-qemu-wallaby%22 if I ever get around to it14:16
lyarwoodgibi: which actually came up downstream earlier today14:16
lyarwoodgibi: I can refresh that and try to remove that logic for you later today if you'd like14:16
lyarwoodgibi: avoid adding another thing to your plate14:16
stephenfinsean-k-mooney: Sorry, missed the ping. Yeah, the functional tests for OSC aren't great. They're not fully isolated which means running them in parallel can produce all kinds of weird results, depending on the speed on the CI node14:16
sean-k-mooneyah i see14:17
stephenfinsean-k-mooney: so rechecking is the only thing to do until I've time to rework them all14:17
sean-k-mooneywell that or run the serially but that proably will be too long14:17
stephenfinyeah, and that just masks the problem14:18
sean-k-mooneyyep14:18
openstackgerritMerged openstack/nova master: tests: Clean up 'test_hypervisors'  https://review.opendev.org/c/openstack/nova/+/76990314:18
sean-k-mooneyit need to do what tempest does and create seperate tenant per senario when its doing things like testing list instnaces14:18
stephenfinyes, exactly14:18
stephenfinbut I just haven't had time to write a fixture or whatever to do that14:19
*** dave-mccowan has joined #openstack-nova14:19
lyarwoodjust dumping this here while I work on something downstream14:20
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Bump MIN_{LIBVIRT,QEMU}_VERSION and NEXT_MIN_{LIBVIRT,QEMU}_VERSION  https://review.opendev.org/c/openstack/nova/+/75470014:20
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_{LIBVIRT,QEMU}_BLOCKDEV  https://review.opendev.org/c/openstack/nova/+/75470114:20
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_LIBVIRT_VIR_ERR_DEVICE_MISSING  https://review.opendev.org/c/openstack/nova/+/75470214:20
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_LIBVIRT_VTPM  https://review.opendev.org/c/openstack/nova/+/75470314:20
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_LIBVIRT_S390X_CPU_COMPARE  https://review.opendev.org/c/openstack/nova/+/75470414:20
lyarwood.. git-review really is slow since the update to gerrit ..14:20
stephenfinI find it varies14:21
stephenfinIt's usually fast after a restart14:21
stephenfin*feels fast14:21
stephenfinI've no data to back up that assertion :-\14:21
stephenfinWe're getting close to API microversion 2.100. It could be another cycle or two, but that's coming14:23
sean-k-mooneyat some point we might go to nova v414:30
*** takamatsu has joined #openstack-nova14:35
*** CeeMac has joined #openstack-nova14:39
dansmithlyarwood: has seemed painfully slow to me as well14:41
dansmithlyarwood: has seemed painfully slow to me as well14:41
dansmithlonger for multi-patch uploads14:41
*** ociuhandu has quit IRC14:45
gmannbrinzhang0: no, your patch is all ok as it is and fixed the 500 ->403, mine is to improve it as general when other API use this exception further with unit tests14:47
gmannbrinzhang0: to avoid conflict I made mine depends on top of your otherwise they both can go independent also14:48
sean-k-mooneydansmith: i havent really noticed much of a change but i havent done many multi patch updates recently14:54
gibilyarwood: thanks for https://review.opendev.org/c/openstack/nova/+/754702 I will review that and rebase the libvirt event patch top of that14:59
*** jangutter has joined #openstack-nova15:00
lyarwoodgibi: I'll clean that series up later once I'm done with something downstream15:00
lyarwoodand np :)15:00
gibilyarwood: ack15:01
artomstephenfin, when you have time, mind taking another look at https://review.opendev.org/c/openstack/nova-specs/+/765551 ? It feels awefully short to me, but I think I've covered everything...?15:29
gibilyarwood: as far as I see https://review.opendev.org/c/openstack/nova/+/754702 does not need to depend on the libvirt bump as our current minimum libvirt (5.0.0) already bigger than what is needed (4.1.0) for this patch15:29
*** lpetrut has quit IRC15:33
*** hoonetorg has quit IRC15:35
*** macz_ has joined #openstack-nova15:36
*** hoonetorg has joined #openstack-nova15:40
*** mtreinish has joined #openstack-nova15:41
*** andrewbogott has joined #openstack-nova15:42
*** hoonetorg has quit IRC15:43
andrewbogottmelwitt: on the offhand chance that you are around… I'm in the midst of a db migration from rocky to stein and the migration is stuck in a loop.  the stuck phase seems to be from your patch https://review.opendev.org/c/openstack/nova/+/633351  (which I can see you refactored quite a lot in T so I'm wondering if this is a known issue)15:44
openstackgerritBalazs Gibizer proposed openstack/nova master: DNM try to replace retry with libvirt event in detach  https://review.opendev.org/c/openstack/nova/+/77024615:44
andrewbogottobviously you're under no obligation to provide me with tech support :)15:44
sean-k-mooneyandrewbogott: do you have an error15:47
andrewbogottsean-k-mooney: stdout says this, forever: "50 rows matched query populate_user_id, 18 migrated"15:47
andrewbogotterror log says...15:47
andrewbogotthttps://www.irccloud.com/pastebin/pNsHlrU0/15:48
andrewbogott^ also forever15:48
andrewbogotthm, which doesn't seem to be from the same migration phase as stdout is reporting15:48
*** arturo has joined #openstack-nova15:48
sean-k-mooneyya that for keypairs15:48
andrewbogottseems so, although I don't know what gives with stdout logging a different phase15:49
sean-k-mooneyso it kind of sounds like it was not in a consitent stae when you start the online migrations15:49
andrewbogottIt does15:50
gibinova meeting starts in 10 minutes in #openstack-meeting-315:50
andrewbogottAlthough I've no idea how it got here, this is a cloud that's been running since Mitaka15:51
andrewbogottIs the 'keypair' referred to there the user-defined keypairs for ssh access?15:52
andrewbogottBecause our setup doesn't use those at all, I'd expect it to be unset in all cases.15:52
andrewbogott(we have a PAM setup for ssh)15:52
andrewbogottsean-k-mooney: any chance that we're just a use case that wasn't anticipated by that code?15:53
*** dklyle has joined #openstack-nova15:53
lyarwoodgibi: ah sorry, it's likely left over from the previous bump cleanup and I rebased it into this series by mistake15:59
lyarwoodgibi: feel free to pull that out and rebase it under your changes15:59
gibilyarwood: ack16:00
gibilyarwood: I think I will do it but not today16:00
lyarwoodgibi: np16:00
sean-k-mooneyandrewbogott: its the user keypair yes16:06
sean-k-mooneynot an unique constratint or forien key at the db level16:06
andrewbogottand yet the migration fails if it's unset :/16:06
andrewbogottI don't see keypairs in my db though, I see mostly NULLS and some json elsewhere16:07
andrewbogotthttps://www.irccloud.com/pastebin/CIh6rCTi/16:07
sean-k-mooneyyep so it looke like you missed a previous migration to populate tehm16:07
andrewbogottmaybe.  My test cloud has the same weird state.  Lots of nulls, a few json objects.16:09
andrewbogottanyway I can insert the empty json object into my null records16:10
andrewbogottok, I've confirmed that the keypair issue is not the thing that's breaking my migration.  It fails gracefully if there are no keypairs, as it should.16:13
*** efried has quit IRC16:20
*** efried has joined #openstack-nova16:21
*** gyee has joined #openstack-nova16:22
*** ganso has quit IRC16:24
*** dosaboy has quit IRC16:24
*** dosaboy has joined #openstack-nova16:25
*** ganso has joined #openstack-nova16:26
*** mlavalle has joined #openstack-nova16:29
lyarwoodmelwitt: https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/711625 - so this works if I enable c-bak and c-vol on the subnode, fun.16:29
sean-k-mooneybauzas: so lookign that the cyborg vgpu spec the last version i reviewd was version 916:43
sean-k-mooneybauzas: what was your outstanding issue16:43
bauzassean-k-mooney: the 'other deployer impact' section, starting PS12 AFAICR16:43
sean-k-mooneyit looks like many of my comments were adress but i need to review it porperly16:44
sean-k-mooneyah the advataghes stuff16:44
bauzasand the fact that they weren't using the same methods for modifying the XML, but eventually the last revision fixes it16:44
sean-k-mooneyya16:44
sean-k-mooneythat is one of the the thigns i rememebred16:45
bauzasanyway, /me needs to stop working early16:45
sean-k-mooneyi porably would just drop the comparison form the spec16:45
*** hoonetorg has joined #openstack-nova16:45
sean-k-mooneyin the other deployer impact section16:45
sean-k-mooneyand jsut leave the note about not configuring the same device in both services16:45
bauzassean-k-mooney: that's my point indeed16:45
bauzasyeah16:45
sean-k-mooneyok ill leave the same comment after i do a full review16:46
bauzasmy other concern would be to maybe use the same module for creating both inventories16:46
bauzasbut we could do it as a follow-up16:46
bauzaslike, creating a common package16:46
bauzasfor both the cyborg agent and the nova-libvirt code16:47
bauzasthis way, gibi's concerns about maintenance would be fixed16:47
bauzasif both services would eventually share the same code16:47
bauzasanyway, /me needs to run16:47
sean-k-mooneyas in a shared lib16:48
sean-k-mooneywe could but im not sure we want to create a new repo at this point in the cycle16:48
sean-k-mooneygiven the pacakging work that would entail16:49
openstackgerritLee Yarwood proposed openstack/nova master: WIP zuul: Add nova-live-migration-ceph job  https://review.opendev.org/c/openstack/nova/+/76846616:49
sean-k-mooneybauzas: i tought gibis main concern in relation to code duplciation was the rest of the code for tracking and assigning mdevs16:50
sean-k-mooneyalthough i may have misread that16:50
sean-k-mooneyandrewbogott: by the way did you do the normal db migration before running the online ones?16:52
sean-k-mooneyandrewbogott: e.g. nova-manage db sync16:52
andrewbogottI did16:52
andrewbogottsean-k-mooney: I've now determined that the keypair errors were a red herring.  It might be that the whole thing was a red herring and stdout was just overly verbose but I need to circle back.16:53
andrewbogottthe keypair migration throws a log warning about missing keypairs but moves on as it should16:53
sean-k-mooneyandrewbogott: so it might be related to this16:53
sean-k-mooneyhttps://review.opendev.org/c/openstack/nova/+/633351/31/nova/objects/instance_mapping.py#25016:53
sean-k-mooneywe skipi instance that dont have instance cell mappings16:54
sean-k-mooneyso before you run that you need to ensure all instance have the cell mappings set16:54
andrewbogottyeah, I think that's likely the issue.  I need to get out of my deployment window and then I'll circle back and debug :)16:54
andrewbogotthm, I thought that the cell mapping thing was handled by an upgrade script many versions ago16:55
andrewbogottbut since I only have one cell it should be easy to fix by hand in the db16:55
sean-k-mooneyit could be deleted but unachived/purged isntances16:56
sean-k-mooneywhich is why it suggest nova-manage db archive_deleted_rows --purge16:56
andrewbogottyeah, I ran that but it didn't do anything (didn't report anything on stdout and also didn't affect behavior of the migration)16:57
*** zzzeek has quit IRC16:58
*** zzzeek has joined #openstack-nova17:00
sean-k-mooneyya so i would guess you jsut need to add the mappings and hopefully it will correct the isseu you have17:01
*** belmoreira has quit IRC17:04
*** ganso has quit IRC17:07
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Remove MIN_LIBVIRT_VIR_ERR_DEVICE_MISSING  https://review.opendev.org/c/openstack/nova/+/75470217:19
lyarwoodgibi: ^ fixed, sorry about that.17:19
*** tesseract has quit IRC17:19
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Remove MIN_LIBVIRT_VIR_ERR_DEVICE_MISSING  https://review.opendev.org/c/openstack/nova/+/75470217:24
lyarwooddoes anyone recall where we list the supported distros for a release?17:36
openstackgerritStephen Finucane proposed openstack/nova-specs master: Add spec for configurable-instance-hostnames  https://review.opendev.org/c/openstack/nova-specs/+/77084217:37
stephenfinlyarwood: that was in the wiki17:37
stephenfinactually, no - I'm thinking of the libvirt version matrix17:37
lyarwoodhttps://github.com/openstack/governance/blob/2bdd9cff00fb40b2f95b66cad47ae1cfd14a2f1b/reference/project-testing-interface.rst#linux-distributions is all I can find17:38
stephenfinartom: Looking at your spec now, but just FYI I've a super low priority proposal for a '--hostname' parameter here https://review.opendev.org/c/openstack/nova-specs/+/770842 Had a look earlier and it's pretty easy17:38
lyarwoodand yeah our distro matrix in the wiki just lists versions17:38
* lyarwood wants to move that in tree btw17:38
stephenfinlyarwood: fungi would probably know17:38
stephenfinlyarwood++ good call17:38
fungiit's in governance, getting it now17:38
fungihttps://governance.openstack.org/tc/reference/runtimes/wallaby.html17:39
lyarwoodoh sorry I see the runtime link at the bottom now, helps if I view the hosted page instead of the source17:39
lyarwoodfungi: many thanks17:39
fungiyw17:40
*** raildo has quit IRC17:42
sean-k-mooneyfungi: that does not cover libvirt verions17:42
sean-k-mooneyor qemu17:42
*** rpittau is now known as rpittau|afk17:42
sean-k-mooneywe manage that seperatly17:43
lyarwoodI didn't need that, just the distros17:43
* lyarwood just wanted to check the version of SLES17:43
lyarwoodor openSUSE sorry17:43
sean-k-mooneyah then ya latest lts of ubuntu centos and suse17:43
sean-k-mooneyfungi: has there been any moemente on updating centos 8 sot centos 8 stream17:44
sean-k-mooneyfungi: i assume we will change that in X17:44
fungisean-k-mooney: i'm not aware of any tc level decision around that yet. discussions were that we only needed to solve it for the cycle in which 8 becomes eol17:45
sean-k-mooneyok so i guess technialy Y then17:45
sean-k-mooneyEOL is decemebr17:46
fungithough i'm not entirely sure what it means for stable branches which supported 8 and how we choose to test them17:46
sean-k-mooneyya17:46
fungisince opendev doesn't usually continue to provide images for eol distro versions for very long17:46
sean-k-mooneyone option might be to use rocky linux or one of the repelacement for centos17:46
sean-k-mooneyi guess we will see how things play out17:47
sean-k-mooneycentos 8 stream should sablise once centos 9 stream is a thing but no idea when that will be a thing or how long centos 8 stream will be supported when its released17:48
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Bump MIN_{LIBVIRT,QEMU}_VERSION and NEXT_MIN_{LIBVIRT,QEMU}_VERSION  https://review.opendev.org/c/openstack/nova/+/75470317:58
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Remove MIN_{LIBVIRT,QEMU}_BLOCKDEV  https://review.opendev.org/c/openstack/nova/+/75470117:58
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Remove MIN_LIBVIRT_S390X_CPU_COMPARE  https://review.opendev.org/c/openstack/nova/+/75470417:58
*** derekh has quit IRC18:04
openstackgerritsean mooney proposed openstack/nova stable/train: only wait for plugtime events in pre-live-migration  https://review.opendev.org/c/openstack/nova/+/77084418:05
*** dtantsur is now known as dtantsur|afk18:10
stephenfinlyarwood: Seeing as you're looking at DB stuff at the moment, think you could take a look at these, my two oldest outstanding patches? :) https://review.opendev.org/c/openstack/nova/+/530905/ https://review.opendev.org/c/openstack/nova/+/530487/18:11
openstackgerritsean mooney proposed openstack/nova master: use psycopg2 binary instead of source package  https://review.opendev.org/c/openstack/nova/+/77047318:12
*** zzzeek has quit IRC18:16
sean-k-mooneystephenfin: why do we need uuid in the pci devices table?18:16
*** zzzeek has joined #openstack-nova18:16
*** andrewbonney has quit IRC18:17
sean-k-mooneyoh its for tracking them in placment18:18
sean-k-mooneyso its not used currently18:18
sean-k-mooney+1 on both but its also strictly speaking not needed currently unless i missed where its beign used18:21
sean-k-mooneyin anycase time for dinner18:21
*** dosaboy has quit IRC18:21
*** raildo has joined #openstack-nova18:26
*** slaweq has quit IRC18:38
*** ralonsoh has quit IRC18:41
*** nightmare_unreal has quit IRC19:04
*** ganso has joined #openstack-nova19:11
*** dosaboy has joined #openstack-nova19:11
*** whoami-rajat__ has quit IRC19:20
artommelwitt, so, for the record, I am looking at https://review.opendev.org/c/openstack/nova/+/769614 :)19:35
artomBut it's in an area of hardware.py that I'm not really familiar with, so there's a learning curve19:35
* artom has to taxi kids around for a bit19:36
*** raildo has quit IRC19:37
*** raildo_ has joined #openstack-nova19:37
dansmithlyarwood: since you've brought it up a couple times, I think this is going to fix the multistore test hang/fail: https://review.opendev.org/c/openstack/tempest/+/77085019:38
dansmithalso gibi ^19:38
*** qqmber has joined #openstack-nova19:55
qqmberhi there19:56
*** qqmber has quit IRC20:03
*** lpetrut has joined #openstack-nova20:10
*** zoharm has quit IRC20:12
*** slaweq has joined #openstack-nova20:19
*** slaweq has quit IRC20:27
*** dosaboy has quit IRC21:00
*** dosaboy has joined #openstack-nova21:02
*** lpetrut has quit IRC21:07
*** raildo_ has quit IRC21:15
*** hamalq has joined #openstack-nova21:22
*** jrosser has quit IRC21:29
*** fnordahl has quit IRC21:30
*** jrosser has joined #openstack-nova21:31
*** fnordahl has joined #openstack-nova21:31
*** nweinber has quit IRC21:42
*** xek has quit IRC21:44
*** rcernin has joined #openstack-nova22:05
*** eharney has quit IRC22:12
*** spatel has quit IRC22:27
openstackgerritGhanshyam proposed openstack/nova master: Reuse code from oslo lib for JSON policy migration  https://review.opendev.org/c/openstack/nova/+/76348722:41
*** markguz_ has quit IRC22:43
openstackgerritGhanshyam proposed openstack/placement master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/placement/+/76439422:46
dansmithmelwitt: replied22:54
melwittdansmith: danke22:55
melwittI was coincidentally looking at some different gate failures involving presumable stress on node resources and wanted to see if there are similarities22:55
dansmithwell, this was a pretty standard OOM once I realized that,22:56
dansmithbut it's unusual that the OOM is caused by the test runner, so I hadn't seen an OOM manifest itself as a killing of one worker before22:57
melwittI see now, in syslog of the example you linked. literal oom-killer messages. what I've been looking at today is different22:58
dansmiththis one blows up so fast that it doesn't even register in dstat,23:00
dansmithwhich is what took me a bit to realize it was an oom23:00
dansmithit goes from like 45M to 1.5g in a couple seconds locally23:00
melwittwow23:00
melwitthow were you able to tell it's the test runner? something in the logs?23:01
dansmithwell, the oom was a python process, and one worker (which is python) just never reports its results,23:01
dansmiththen reproing locally (with plenty of memory) I see one test runner blip to 1.5g, before exiting normally, which is the same size as the victim from the killer23:02
dansmithI don't oom because I have lots of memory locally, but I could see that balloon, and if it happens at the wrong time in the gate, it'll trigger and die23:02
melwittI see, thanks23:03
melwittnice find. I've been looking at a lot of gate failures lately that seem to be outside of openstack and trying to find hints about what could be causing them23:05
*** nweinber has joined #openstack-nova23:08
*** nweinber has quit IRC23:11
openstackgerritmelanie witt proposed openstack/nova stable/stein: Change default num_retries for glance to 3  https://review.opendev.org/c/openstack/nova/+/76496323:21
openstackgerritmelanie witt proposed openstack/nova stable/stein: Use fair locks in resource tracker  https://review.opendev.org/c/openstack/nova/+/77065723:24
sean-k-mooneymelwitt: actully regarding ^23:49
sean-k-mooneyi realised that while the upper-constatis allows it im not sure lower constartis on stien does23:50
sean-k-mooneyhttps://github.com/openstack/nova/blob/stable/stein/lower-constraints.txt#L79 oslo.concurrency==3.26.023:50
sean-k-mooneyit need 3.29.023:51
sean-k-mooneyare we allowed to bump it like that in a backport?23:51
sean-k-mooneyfor what its worth i think its a good thing to backport just dont know what stable policy allows23:54
melwittoh yeah, we aren't. so I guess I was right originally, that it couldn't be backported23:54
melwittsigh23:54
sean-k-mooneywell with the patch on gerrit if peopel want to use it it should be eaiser for them23:55
sean-k-mooneyto do the backport you would have to add the fair lock form oslo to noava23:56
sean-k-mooneyand just use that instead23:56
melwittyeah, I doubt it's worth going that far23:57
sean-k-mooneyya23:57
« Wednesday, 2021-01-13 Index Friday, 2021-01-15 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!