Friday, 2023-05-12

*** dmellado9 is now known as dmellado04:21
opendevreviewAmit Uniyal proposed openstack/nova master: WIP: Delete dangling bdms  https://review.opendev.org/c/openstack/nova/+/88228406:32
opendevreviewAmit Uniyal proposed openstack/nova master: WIP: Reproducer for dangling volumes  https://review.opendev.org/c/openstack/nova/+/88145707:14
opendevreviewAmit Uniyal proposed openstack/nova master: WIP: Delete dangling bdms  https://review.opendev.org/c/openstack/nova/+/88228407:14
opendevreviewMerged openstack/nova stable/yoga: CI: fix backport validator for new branch naming  https://review.opendev.org/c/openstack/nova/+/88296608:29
opendevreviewDanylo Vodopianov proposed openstack/nova master: Packed virtqueue support was added.  https://review.opendev.org/c/openstack/nova/+/87607508:32
opendevreviewAlexey Stupnikov proposed openstack/nova stable/xena: Remove deleted projects from flavor access list  https://review.opendev.org/c/openstack/nova/+/88301409:48
SvenKieskehey there, we're currently implementing changes in kolla-ansible so nova uses service-tokens to talk to cinder, to address the vuln released 2 days ago. we hit an 500 Server Error during volume attachment. Should I report a bug, or might this just be a spurious failure?09:52
SvenKieskeour change: https://review.opendev.org/c/openstack/kolla-ansible/+/882893  the logged error: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_11b/882893/3/check/kolla-ansible-rocky9-cephadm/11b1baf/primary/logs/ansible/test-core-openstack09:53
SvenKieskeCommand is: "openstack server add volume kolla_boot_test test_volume --device /dev/vdb"09:54
SvenKieskeError: HttpException: 500: Server Error for url: http://192.0.2.10:8774/v2.1/servers/2177019c-a915-4bda-a898-4fa806901144/os-volume_attachments, Unexpected API Error.09:54
opendevreviewAmit Uniyal proposed openstack/nova master: WIP: Reproducer for dangling volumes  https://review.opendev.org/c/openstack/nova/+/88145709:55
opendevreviewAmit Uniyal proposed openstack/nova master: WIP: Delete dangling bdms  https://review.opendev.org/c/openstack/nova/+/88228409:55
bauzasSvenKieske: what's saying the nova-api log ?10:53
SvenKieskebauzas: I'll take a look10:54
bauzas 2023-05-11 16:15:22.782 25 DEBUG nova.compute.api [None req-92ee72e6-a5e8-47b1-8428-47a71835f010 6ffc4ae1295442999283b4c88ba497e9 a6ca4c77593c46a2b5e6c3c651e7e436 - - default default] Failed to fetch instance by id kolla_boot_test get /var/lib/kolla/venv/lib64/python3.9/site-packages/nova/compute/api.py:2983 2023-05-11 16:15:22.782 25 INFO nova.api.openstack.wsgi [None req-92ee72e6-a5e8-47b1-8428-47a71835f010 6ffc4ae12954429992810:54
bauzas3b4c88ba497e9 a6ca4c77593c46a2b5e6c3c651e7e436 - - default default] HTTP exception thrown: Instance kolla_boot_test could not be found.10:54
bauzasI don't see any instance creation in the nova-api.txt log10:59
bauzasyeah, as well here https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_11b/882893/3/check/kolla-ansible-rocky9-cephadm/11b1baf/primary/logs/kolla/nova/nova-api-access.txt11:02
bauzasand I don't see in the nova-api logs where os-volume_attachments is called :(11:04
SvenKieskebauzas: I think I got an error/stacktrace, preparing a pastebin..12:15
SvenKieskebauzas: https://paste.opendev.org/show/819994/12:22
SvenKieskewhat's interesting is that it throws a 401 in the first few lines but what I get at the high level cli command is a 500 server error..mhm let me double check if this is really correlated12:25
bauzasSvenKieske: yeah ok, so that's indeed due to https://review.opendev.org/c/openstack/kolla-ansible/+/88289312:27
SvenKieskeyeah, but I see there are even more errors in keystone... it can't find the service project..  I'll circle back with my fellow kolla contributors who know more than me about our test setup, thanks so far!12:29
bauzasack12:33
opendevreviewDanylo Vodopianov proposed openstack/nova master: Packed virtqueue support was added.  https://review.opendev.org/c/openstack/nova/+/87607512:54
spatelsean-k-mooney morning! I have question if you around13:19
bauzasspatel: all RH folks (except me) are on PTO today13:26
bauzascall me the highlander for today13:26
spatelbauzas haha! Thanks.. I had question related hugepage. I have compute nodes with 256GB memory and does it worth enable hugepage on compute nodes? 13:27
spatelcan i do memory overcommit with hugepage? 13:27
bauzasspatel: hugepages are set by using numa nodes13:28
bauzasspatel: oh, you shouldn't (overcommit memory with hugepages)13:28
spatelhmm! 13:28
bauzaslike, playing with cpu pinning with overcommitted vCPUs (albeit this one, I'm sure it won't work)13:29
spatelI don't want cpu-pinning. all i want no OOM so thinking to set hugepage13:29
bauzasspatel: I have another internal prio now, so I can't really dig into code, but I think you need to respect MEMORY_MB with care13:30
spatelbauzas okk13:31
spatelThank you bauzas 13:32
bauzasspatel: sorry to not able to help you more13:33
bauzasspatel: but have you looked at our upstream docs for hugepages ?13:33
spatelYes! I am running hugepages on one of my cloud with cpu-pinning with numa scheduling 13:34
spatelThis is new cloud where thinking to not use pinning but just hugepage 13:34
sahidsean-k-mooney: o/ regarding https://review.opendev.org/c/openstack/os-vif/+/881751, based on the bug report you wanted to backport it, right?13:59
bauzassahid: yes, sean-k-mooney in on PTO but yeah14:00
opendevreviewJay Faulkner proposed openstack/nova-specs master: Re-Propose "Ironic Shards" for Bobcat/2023.2  https://review.opendev.org/c/openstack/nova-specs/+/88164314:00
sahidbauzas: ok, give me a moment I will cherry-pick them, thank you14:02
opendevreviewSahid Orentino Ferdjaoui proposed openstack/os-vif stable/2023.1: set default qos policy  https://review.opendev.org/c/openstack/os-vif/+/88301514:02
opendevreviewSahid Orentino Ferdjaoui proposed openstack/os-vif stable/zed: set default qos policy  https://review.opendev.org/c/openstack/os-vif/+/88301614:03
JayFbauzas: sean-k-mooney: Updated the Ironic shards spec as requested, thank you!14:03
bauzasJayF: fast-approved14:03
JayF\o/14:04
opendevreviewMerged openstack/nova-specs master: Re-Propose "Ironic Shards" for Bobcat/2023.2  https://review.opendev.org/c/openstack/nova-specs/+/88164314:18
opendevreviewSahid Orentino Ferdjaoui proposed openstack/os-vif stable/yoga: set default qos policy  https://review.opendev.org/c/openstack/os-vif/+/88307114:21
BobZAnnapolis__Hey folks, do you know of / have a documentatiuon location where i can find a detailed ERD for the NOVA dbs, the relations / fields defined, hopefully the purpose for each field, limitations, etc, something more than a "describe table" ? tia14:25
-opendevstatus- NOTICE: The Gerrit service on review.opendev.org will be offline briefly for a patchlevel update, but should return to service in a few minutes20:41

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!