*** mhen_ is now known as mhen | 01:52 | |
opendevreview | Ghanshyam proposed openstack/tempest master: Test project manager role for server migration https://review.opendev.org/c/openstack/tempest/+/953265 | 02:57 |
---|---|---|
opendevreview | Ghanshyam proposed openstack/tempest master: Test project manager role for server migration https://review.opendev.org/c/openstack/tempest/+/953265 | 02:59 |
stephenfin | frickler: gmaan: Could you take a look at this backport when possible? It's causing failures for us in Gophercloud https://review.opendev.org/c/openstack/devstack/+/950289 | 08:21 |
opendevreview | Stephen Finucane proposed openstack/devstack stable/2024.2: Remove libvirt apparmor workaround https://review.opendev.org/c/openstack/devstack/+/953283 | 08:21 |
opendevreview | Stephen Finucane proposed openstack/devstack stable/2024.1: Remove libvirt apparmor workaround https://review.opendev.org/c/openstack/devstack/+/953284 | 08:23 |
opendevreview | Stephen Finucane proposed openstack/devstack master: Revert "Pin tox<4.0.0 for <=stable/zed branch testing" https://review.opendev.org/c/openstack/devstack/+/936963 | 08:27 |
opendevreview | Stephen Finucane proposed openstack/tempest master: tox: Migrate to v4 configuration https://review.opendev.org/c/openstack/tempest/+/953287 | 08:39 |
opendevreview | Stephen Finucane proposed openstack/tempest master: tox: Remove deprecated env https://review.opendev.org/c/openstack/tempest/+/953288 | 08:39 |
opendevreview | Stephen Finucane proposed openstack/tempest master: tox: Remove unnecessary tox sitepackages definition https://review.opendev.org/c/openstack/tempest/+/953289 | 08:39 |
opendevreview | Stephen Finucane proposed openstack/tempest master: tox: Speed up bindep target https://review.opendev.org/c/openstack/tempest/+/953290 | 08:39 |
opendevreview | Stephen Finucane proposed openstack/devstack master: Revert "Pin tox<4.0.0 for <=stable/zed branch testing" https://review.opendev.org/c/openstack/devstack/+/936963 | 08:39 |
frickler | gmaan: tkajinam: second time this week that I see this failure on etcd startup. any idea how to debug it? https://zuul.opendev.org/t/openstack/build/2b5b978a4bde4afa913491107676f422 | 12:00 |
tkajinam | listen tcp 65.17.193.77:2379: bind: cannot assign requested address | 12:10 |
tkajinam | hmm | 12:10 |
tkajinam | I initially suspect unstable network ip assignment but the same interface may be used for ssh. | 12:11 |
frickler | yes, if there was some general network instability, I'd expect us to see more similar looking issues at other locations in devstack, too | 12:17 |
opendevreview | Takashi Kajinami proposed openstack/devstack master: Allow installing etcd3gw from source https://review.opendev.org/c/openstack/devstack/+/936089 | 12:18 |
frickler | oh, bence also created a bug now https://bugs.launchpad.net/bugs/2115338 | 12:25 |
tkajinam | I wonder if we should just try bumping etcd for now https://review.opendev.org/c/openstack/devstack/+/952755 | 12:39 |
tkajinam | as 3.24.x is already EOL and see if that improves the stability | 12:40 |
tkajinam | if we dig into the failure we may probably have to grab the node or get some debug info (like ip a + ss -lnap) | 12:41 |
*** haleyb_ is now known as haleyb | 13:48 | |
clarkb | frickler: tkajinam: you're trying to bind to the floating ip which isn't present on the test node | 15:11 |
clarkb | you need to bind to an address that is actually on the node or 0.0.0.0/:: | 15:11 |
frickler | oh, so it would fail only on raxflex. still unclear why this would only be happening for a couple of days | 15:13 |
tkajinam | I wonder if it's expected that SERVICE_HOST is set to the floating ip rather than the fixed ip | 15:13 |
frickler | I don't think it should | 15:14 |
frickler | we have HOST_IP: "{{ hostvars['controller']['nodepool']['private_ipv4'] }}" , but it ends up as the public IP | 15:17 |
frickler | clarkb: ^^ looks like this might be a regression in zuul? | 15:17 |
tkajinam | I can probably direct --listen-client-urls to 0.0.0.0 (or ::) to avoid the bind failure while we may want to know why the private_ipv4 is not really a private one. | 15:19 |
frickler | https://c4d77360c4f137c70770-625a0eb0440aa527fbdb216e8991f5a6.ssl.cf1.rackcdn.com/openstack/2b5b978a4bde4afa913491107676f422/zuul-info/inventory.yaml confirms this | 15:19 |
clarkb | frickler: that behavior has been there forever beacuse some clouds don't have a private ip | 15:20 |
clarkb | however this cloud does so maybe? | 15:21 |
opendevreview | Takashi Kajinami proposed openstack/devstack master: etcd3: Bind all interfaces https://review.opendev.org/c/openstack/devstack/+/953329 | 15:21 |
frickler | hmm, trying now to find an older raxflex build to compare to | 15:23 |
clarkb | basically if there is no private ip nodepool sets the value to the public ip value as a shortcut. To me that implies nodepool thought the server didn't have a private ip for some reason | 15:24 |
opendevreview | Takashi Kajinami proposed openstack/devstack master: etcd: Bind all interfaces https://review.opendev.org/c/openstack/devstack/+/953329 | 15:24 |
opendevreview | Takashi Kajinami proposed openstack/devstack master: etcd: Bind all interfaces https://review.opendev.org/c/openstack/devstack/+/953329 | 15:25 |
frickler | so https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_900/openstack/9002bca23bf34476bdcaa7ee2b79c981/zuul-info/inventory.yaml has the proper private IP | 15:26 |
frickler | let's continue in #opendev to involve corvus | 15:27 |
opendevreview | Rajesh Tailor proposed openstack/tempest master: Add response schema for nova microversion v2.101 https://review.opendev.org/c/openstack/tempest/+/953331 | 15:27 |
opendevreview | Rajesh Tailor proposed openstack/tempest master: use intance action events to wait for detach https://review.opendev.org/c/openstack/tempest/+/905130 | 15:29 |
opendevreview | Ghanshyam proposed openstack/tempest master: Test project manager role for server migration https://review.opendev.org/c/openstack/tempest/+/953265 | 15:59 |
gmaan | meeting time | 18:01 |
gmaan | #startmeeting qa | 18:01 |
opendevmeet | Meeting started Wed Jun 25 18:01:24 2025 UTC and is due to finish in 60 minutes. The chair is gmaan. Information about MeetBot at http://wiki.debian.org/MeetBot. | 18:01 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 18:01 |
opendevmeet | The meeting name has been set to 'qa' | 18:01 |
gmaan | #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours | 18:01 |
gmaan | today agenda ^^ | 18:02 |
opendevreview | Merged openstack/devstack stable/2025.1: Remove libvirt apparmor workaround https://review.opendev.org/c/openstack/devstack/+/950289 | 18:03 |
gmaan | let's start | 18:03 |
gmaan | #topic Announcement and Action Item (Optional) | 18:03 |
gmaan | one action item - gmaan to start end of support for stable/2023.2 from Tempest | 18:04 |
gmaan | I proposed the changes for tempest new tag as well as for plugins | 18:04 |
gmaan | #link https://review.opendev.org/q/topic:%222023-2-last%22 | 18:04 |
gmaan | a few plugins releases not merged yet but tempest tag is released to mark the end of support | 18:05 |
gmaan | and removed the stable/2023.2 testing from tempest master gate | 18:05 |
gmaan | #link https://review.opendev.org/c/openstack/tempest/+/952403 | 18:05 |
gmaan | I will mark this done and remaining plugins releases changes can be tracked separatly | 18:06 |
gmaan | #topic Priority Items progress | 18:06 |
gmaan | #link https://etherpad.opendev.org/p/qa-2025-2-priority | 18:07 |
gmaan | some progress on 'Move tempest tests to new SRBAC defaults' | 18:07 |
gmaan | I started testing the project manager role on nova policy | 18:07 |
gmaan | also fixing the bug we have for project manager user creation | 18:07 |
gmaan | #link https://review.opendev.org/c/openstack/tempest/+/949534 | 18:08 |
gmaan | Rocky Linux and Centos Stream testing: - this one is fixed now at least with workaround so marking it close in tracker | 18:09 |
gmaan | no updates on pre-provisioned and fips testing item | 18:10 |
gmaan | #topic Gate Status / Fix Checks | 18:10 |
gmaan | Gate Blocker Fix / Urgent Change | 18:10 |
gmaan | #link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade) | 18:10 |
gmaan | 2 are waiting for author and one new one is not reviewed | 18:11 |
gmaan | #link https://review.opendev.org/c/openstack/devstack/+/949066 | 18:11 |
gmaan | I would like to see horixon core +1 here | 18:12 |
gmaan | #topic Changes with Review-Priority == +1 | 18:13 |
gmaan | #link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade) | 18:13 |
gmaan | reviewing those | 18:14 |
gmaan | I did review most of them, a few pending on author response or either zuul -1 | 18:22 |
gmaan | #topic Periodic jobs Status Checks | 18:22 |
gmaan | Periodic stable full | 18:22 |
gmaan | #link https://zuul.openstack.org/builds?job_name=tempest-full-2023-2&job_name=tempest-full-2024-1&job_name=tempest-full-2024-2&job_name=tempest-full-2025-1&pipeline=periodic-stable&skip=0 | 18:23 |
gmaan | last run of tempest-full-2024-1 failed | 18:23 |
gmaan | #link https://zuul.openstack.org/build/165695c796424530b8eaddd637717279 | 18:23 |
gmaan | etcd issue | 18:23 |
gmaan | Periodic stable slow | 18:23 |
gmaan | #link https://zuul.openstack.org/builds?job_name=tempest-slow-2024-2&job_name=tempest-slow-2024-1&job_name=tempest-slow-2023-2&job_name=tempest-slow-2025-1&skip=0 | 18:24 |
gmaan | last run of tempest-slow-2024-2 failed | 18:24 |
gmaan | #link https://zuul.openstack.org/build/89ac8284f86d42d1b7b503f6b41b2b6e | 18:24 |
gmaan | same issue | 18:25 |
gmaan | Periodic extra tests | 18:25 |
gmaan | #link https://zuul.openstack.org/builds?job_name=tempest-full-2024-2-extra-tests&job_name=tempest-full-2024-1-extra-tests&job_name=tempest-full-2023-2-extra-tests&job_name=tempest-full-2025-1-extra-tests&skip=0 | 18:25 |
gmaan | all green | 18:25 |
gmaan | Periodic master | 18:25 |
gmaan | #link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic | 18:26 |
gmaan | last run for 3 jobs failing | 18:26 |
gmaan | tempest-full-test-account-no-admin-py3 is known issue which I did not get time to debug/fix | 18:26 |
gmaan | let me add action item to me so that it will remind me more closely than biweekly checks | 18:27 |
gmaan | #action gmaan to debug the tempest-full-test-account-no-admin-py3 failure | 18:27 |
gmaan | rocky linux also hitting etcd issue | 18:28 |
gmaan | same with devstack-no-tls-proxy job | 18:28 |
gmaan | #topic Distros check: | 18:28 |
gmaan | Centos 9 | 18:28 |
gmaan | #link https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=0 | 18:29 |
gmaan | one failure in between but almost passing | 18:29 |
gmaan | Debian | 18:29 |
gmaan | #link https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bookworm&skip=0 | 18:29 |
gmaan | same | 18:29 |
gmaan | Rocky Linux | 18:29 |
gmaan | #link https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx&job_name=tempest-full-rocky&skip=0 | 18:30 |
gmaan | this also mix of passing and failing (some tests on volume status) | 18:30 |
gmaan | #topic Open Discussion | 18:31 |
gmaan | nothing here | 18:31 |
gmaan | closing the meeting | 18:31 |
gmaan | #endmeeting | 18:31 |
opendevmeet | Meeting ended Wed Jun 25 18:31:21 2025 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 18:31 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/qa/2025/qa.2025-06-25-18.01.html | 18:31 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/qa/2025/qa.2025-06-25-18.01.txt | 18:31 |
opendevmeet | Log: https://meetings.opendev.org/meetings/qa/2025/qa.2025-06-25-18.01.log.html | 18:31 |
opendevreview | Ghanshyam proposed openstack/tempest master: Fix project manager user to be created in samae project https://review.opendev.org/c/openstack/tempest/+/949534 | 20:17 |
opendevreview | Ghanshyam proposed openstack/tempest master: Test project manager role for server migration https://review.opendev.org/c/openstack/tempest/+/953265 | 20:18 |
opendevreview | Merged openstack/devstack master: Drop logic for Python < 3 https://review.opendev.org/c/openstack/devstack/+/953099 | 20:20 |
opendevreview | Ghanshyam proposed openstack/tempest master: Test project manager role for server migration https://review.opendev.org/c/openstack/tempest/+/953265 | 20:50 |
opendevreview | Ghanshyam proposed openstack/tempest master: Add force delete test for project manager https://review.opendev.org/c/openstack/tempest/+/948669 | 22:07 |
opendevreview | Ghanshyam proposed openstack/tempest master: Add force delete test for project manager https://review.opendev.org/c/openstack/tempest/+/948669 | 22:08 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!