Wednesday, 2025-06-25

*** mhen_ is now known as mhen01:52
opendevreviewGhanshyam proposed openstack/tempest master: Test project manager role for server migration  https://review.opendev.org/c/openstack/tempest/+/95326502:57
opendevreviewGhanshyam proposed openstack/tempest master: Test project manager role for server migration  https://review.opendev.org/c/openstack/tempest/+/95326502:59
stephenfinfrickler: gmaan: Could you take a look at this backport when possible? It's causing failures for us in Gophercloud https://review.opendev.org/c/openstack/devstack/+/95028908:21
opendevreviewStephen Finucane proposed openstack/devstack stable/2024.2: Remove libvirt apparmor workaround  https://review.opendev.org/c/openstack/devstack/+/95328308:21
opendevreviewStephen Finucane proposed openstack/devstack stable/2024.1: Remove libvirt apparmor workaround  https://review.opendev.org/c/openstack/devstack/+/95328408:23
opendevreviewStephen Finucane proposed openstack/devstack master: Revert "Pin tox<4.0.0 for <=stable/zed branch testing"  https://review.opendev.org/c/openstack/devstack/+/93696308:27
opendevreviewStephen Finucane proposed openstack/tempest master: tox: Migrate to v4 configuration  https://review.opendev.org/c/openstack/tempest/+/95328708:39
opendevreviewStephen Finucane proposed openstack/tempest master: tox: Remove deprecated env  https://review.opendev.org/c/openstack/tempest/+/95328808:39
opendevreviewStephen Finucane proposed openstack/tempest master: tox: Remove unnecessary tox sitepackages definition  https://review.opendev.org/c/openstack/tempest/+/95328908:39
opendevreviewStephen Finucane proposed openstack/tempest master: tox: Speed up bindep target  https://review.opendev.org/c/openstack/tempest/+/95329008:39
opendevreviewStephen Finucane proposed openstack/devstack master: Revert "Pin tox<4.0.0 for <=stable/zed branch testing"  https://review.opendev.org/c/openstack/devstack/+/93696308:39
fricklergmaan: tkajinam: second time this week that I see this failure on etcd startup. any idea how to debug it? https://zuul.opendev.org/t/openstack/build/2b5b978a4bde4afa913491107676f42212:00
tkajinamlisten tcp 65.17.193.77:2379: bind: cannot assign requested address12:10
tkajinamhmm12:10
tkajinamI initially suspect unstable network ip assignment but the same interface may be used for ssh.12:11
frickleryes, if there was some general network instability, I'd expect us to see more similar looking issues at other locations in devstack, too12:17
opendevreviewTakashi Kajinami proposed openstack/devstack master: Allow installing etcd3gw from source  https://review.opendev.org/c/openstack/devstack/+/93608912:18
frickleroh, bence also created a bug now https://bugs.launchpad.net/bugs/211533812:25
tkajinamI wonder if we should just try bumping etcd for now https://review.opendev.org/c/openstack/devstack/+/95275512:39
tkajinamas 3.24.x is already EOL and see if that improves the stability12:40
tkajinamif we dig into the failure we may probably have to grab the node or get some debug info (like ip a + ss -lnap)12:41
*** haleyb_ is now known as haleyb13:48
clarkbfrickler: tkajinam: you're trying to bind to the floating ip which isn't present on the test node15:11
clarkbyou need to bind to an address that is actually on the node or 0.0.0.0/::15:11
frickleroh, so it would fail only on raxflex. still unclear why this would only be happening for a couple of days15:13
tkajinamI wonder if it's expected that SERVICE_HOST is set to the floating ip rather than the fixed ip15:13
fricklerI don't think it should15:14
fricklerwe have HOST_IP: "{{ hostvars['controller']['nodepool']['private_ipv4'] }}" , but it ends up as the public IP15:17
fricklerclarkb: ^^ looks like this might be a regression in zuul?15:17
tkajinamI can probably direct --listen-client-urls to 0.0.0.0 (or ::) to avoid the bind failure while we may want to know why the private_ipv4 is not really a private one.15:19
fricklerhttps://c4d77360c4f137c70770-625a0eb0440aa527fbdb216e8991f5a6.ssl.cf1.rackcdn.com/openstack/2b5b978a4bde4afa913491107676f422/zuul-info/inventory.yaml confirms this15:19
clarkbfrickler: that behavior has been there forever beacuse some clouds don't have a private ip15:20
clarkbhowever this cloud does so maybe?15:21
opendevreviewTakashi Kajinami proposed openstack/devstack master: etcd3: Bind all interfaces  https://review.opendev.org/c/openstack/devstack/+/95332915:21
fricklerhmm, trying now to find an older raxflex build to compare to15:23
clarkbbasically if there is no private ip nodepool sets the value to the public ip value as a shortcut. To me that implies nodepool thought the server didn't have a private ip for some reason15:24
opendevreviewTakashi Kajinami proposed openstack/devstack master: etcd: Bind all interfaces  https://review.opendev.org/c/openstack/devstack/+/95332915:24
opendevreviewTakashi Kajinami proposed openstack/devstack master: etcd: Bind all interfaces  https://review.opendev.org/c/openstack/devstack/+/95332915:25
fricklerso https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_900/openstack/9002bca23bf34476bdcaa7ee2b79c981/zuul-info/inventory.yaml has the proper private IP15:26
fricklerlet's continue in #opendev to involve corvus15:27
opendevreviewRajesh Tailor proposed openstack/tempest master: Add response schema for nova microversion v2.101  https://review.opendev.org/c/openstack/tempest/+/95333115:27
opendevreviewRajesh Tailor proposed openstack/tempest master: use intance action events to wait for detach  https://review.opendev.org/c/openstack/tempest/+/90513015:29
opendevreviewGhanshyam proposed openstack/tempest master: Test project manager role for server migration  https://review.opendev.org/c/openstack/tempest/+/95326515:59
gmaanmeeting time18:01
gmaan#startmeeting qa18:01
opendevmeetMeeting started Wed Jun 25 18:01:24 2025 UTC and is due to finish in 60 minutes.  The chair is gmaan. Information about MeetBot at http://wiki.debian.org/MeetBot.18:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.18:01
opendevmeetThe meeting name has been set to 'qa'18:01
gmaan#link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours18:01
gmaantoday agenda ^^18:02
opendevreviewMerged openstack/devstack stable/2025.1: Remove libvirt apparmor workaround  https://review.opendev.org/c/openstack/devstack/+/95028918:03
gmaanlet's start18:03
gmaan#topic Announcement and Action Item (Optional)18:03
gmaanone action item - gmaan to start end of support for stable/2023.2 from Tempest18:04
gmaanI proposed the changes for tempest new tag as well as for plugins18:04
gmaan#link https://review.opendev.org/q/topic:%222023-2-last%2218:04
gmaana few plugins releases not merged yet but tempest tag is released to mark the end of support18:05
gmaanand removed the stable/2023.2 testing from tempest master gate18:05
gmaan#link https://review.opendev.org/c/openstack/tempest/+/95240318:05
gmaanI will mark this done and remaining plugins releases changes can be tracked separatly 18:06
gmaan#topic Priority Items progress18:06
gmaan#link https://etherpad.opendev.org/p/qa-2025-2-priority18:07
gmaansome progress on 'Move tempest tests to new SRBAC defaults'18:07
gmaanI started testing the project manager role on nova policy18:07
gmaanalso fixing the bug we have for project manager user creation18:07
gmaan#link https://review.opendev.org/c/openstack/tempest/+/94953418:08
gmaanRocky Linux and Centos Stream testing: - this one is fixed now at least with workaround so marking it close in tracker18:09
gmaanno updates on pre-provisioned  and fips testing item18:10
gmaan#topic Gate Status / Fix Checks18:10
gmaanGate Blocker Fix / Urgent Change18:10
gmaan#link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)18:10
gmaan2 are waiting for author and one new one is not reviewed 18:11
gmaan#link https://review.opendev.org/c/openstack/devstack/+/94906618:11
gmaanI would like to see horixon core +1 here18:12
gmaan#topic Changes with Review-Priority == +118:13
gmaan#link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)18:13
gmaanreviewing those 18:14
gmaanI did review most of them, a few pending on author response or either zuul -118:22
gmaan#topic Periodic jobs Status Checks18:22
gmaanPeriodic stable full18:22
gmaan#link https://zuul.openstack.org/builds?job_name=tempest-full-2023-2&job_name=tempest-full-2024-1&job_name=tempest-full-2024-2&job_name=tempest-full-2025-1&pipeline=periodic-stable&skip=018:23
gmaanlast run of tempest-full-2024-1 failed18:23
gmaan#link https://zuul.openstack.org/build/165695c796424530b8eaddd63771727918:23
gmaanetcd issue18:23
gmaanPeriodic stable slow18:23
gmaan#link https://zuul.openstack.org/builds?job_name=tempest-slow-2024-2&job_name=tempest-slow-2024-1&job_name=tempest-slow-2023-2&job_name=tempest-slow-2025-1&skip=018:24
gmaanlast run of tempest-slow-2024-2 failed18:24
gmaan#link https://zuul.openstack.org/build/89ac8284f86d42d1b7b503f6b41b2b6e18:24
gmaansame issue18:25
gmaanPeriodic extra tests18:25
gmaan#link https://zuul.openstack.org/builds?job_name=tempest-full-2024-2-extra-tests&job_name=tempest-full-2024-1-extra-tests&job_name=tempest-full-2023-2-extra-tests&job_name=tempest-full-2025-1-extra-tests&skip=018:25
gmaanall green18:25
gmaanPeriodic master18:25
gmaan#link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic18:26
gmaanlast run for 3 jobs failing18:26
gmaantempest-full-test-account-no-admin-py3  is known issue which I did not get time to debug/fix18:26
gmaanlet me add action item to me so that it will remind me more closely than biweekly checks18:27
gmaan#action gmaan to debug the tempest-full-test-account-no-admin-py3  failure 18:27
gmaanrocky linux also hitting etcd issue18:28
gmaansame with devstack-no-tls-proxy  job18:28
gmaan#topic Distros check:18:28
gmaanCentos 918:28
gmaan#link https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=018:29
gmaanone failure in between but almost passing18:29
gmaanDebian18:29
gmaan#link https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bookworm&skip=018:29
gmaansame18:29
gmaanRocky Linux18:29
gmaan#link https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx&job_name=tempest-full-rocky&skip=018:30
gmaanthis also mix of passing and failing (some tests on volume status)18:30
gmaan#topic Open Discussion18:31
gmaannothing here18:31
gmaanclosing the meeting18:31
gmaan#endmeeting18:31
opendevmeetMeeting ended Wed Jun 25 18:31:21 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)18:31
opendevmeetMinutes:        https://meetings.opendev.org/meetings/qa/2025/qa.2025-06-25-18.01.html18:31
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/qa/2025/qa.2025-06-25-18.01.txt18:31
opendevmeetLog:            https://meetings.opendev.org/meetings/qa/2025/qa.2025-06-25-18.01.log.html18:31
opendevreviewGhanshyam proposed openstack/tempest master: Fix project manager user to be created in samae project  https://review.opendev.org/c/openstack/tempest/+/94953420:17
opendevreviewGhanshyam proposed openstack/tempest master: Test project manager role for server migration  https://review.opendev.org/c/openstack/tempest/+/95326520:18
opendevreviewMerged openstack/devstack master: Drop logic for Python < 3  https://review.opendev.org/c/openstack/devstack/+/95309920:20
opendevreviewGhanshyam proposed openstack/tempest master: Test project manager role for server migration  https://review.opendev.org/c/openstack/tempest/+/95326520:50
opendevreviewGhanshyam proposed openstack/tempest master: Add force delete test for project manager  https://review.opendev.org/c/openstack/tempest/+/94866922:07
opendevreviewGhanshyam proposed openstack/tempest master: Add force delete test for project manager  https://review.opendev.org/c/openstack/tempest/+/94866922:08

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!