| opendevreview | Matt Anson proposed openstack/kolla-ansible master: Fix RabbitMQ version check logic https://review.opendev.org/c/openstack/kolla-ansible/+/943090 | 07:29 |
|---|---|---|
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: ansible-lint: Make roles passable with shared profile https://review.opendev.org/c/openstack/kolla-ansible/+/920159 | 07:58 |
| mnasiadka | frickler, yuval : I believe the current neutron issues are this: https://bugs.launchpad.net/neutron/+bug/2101840 | 08:03 |
| frickler | mnasiadka: yes, I just saw that in the neutron bug report, too. not sure how we could easily work around that, though, except essentially stopping all testing :( | 08:04 |
| mnasiadka | frickler: I guess we could switch to OVN by default, if somebody has time to work on https://review.opendev.org/c/openstack/kolla-ansible/+/904959 ;-) | 08:05 |
| opendevreview | Pierre Riteau proposed openstack/kolla-ansible master: CI: Fix openstack-tox-docs job https://review.opendev.org/c/openstack/kolla-ansible/+/944632 | 08:06 |
| frickler | yeah, that would still imply giving up on all OVS testing. but then I'm only running OVN downstream, so I likely wouldn't object too hard. I'm going to nag neutron folks a bit, too | 08:07 |
| priteau | Good morning. Hopefully the patch above fixes CI. | 08:08 |
| frickler | oh, more failures? great | 08:09 |
| priteau | The docs job was migrated to Noble last week by gmann | 08:10 |
| opendevreview | Pierre Riteau proposed openstack/kolla master: [DNM] Test doc build https://review.opendev.org/c/openstack/kolla/+/944633 | 08:11 |
| frickler | priteau: yes, I know, I just had missed that failure amoung all the others | 08:12 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: mariadb: Use mysql_query instead of command https://review.opendev.org/c/openstack/kolla-ansible/+/944411 | 08:14 |
| mnasiadka | frickler: let's say the others are more visible ;-) | 08:16 |
| priteau | Success! Please review https://review.opendev.org/c/openstack/kolla-ansible/+/944632 | 08:16 |
| mnasiadka | priteau: other jobs probably won't pass until Neutron fixes dhcp | 08:17 |
| priteau | :-( | 08:17 |
| yuval | got it, Thanks | 08:41 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: DNM: Test Neutron DHCP eventlet drop revert https://review.opendev.org/c/openstack/kolla-ansible/+/944635 | 08:45 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: mariadb: Use mysql_query instead of command https://review.opendev.org/c/openstack/kolla-ansible/+/944411 | 08:58 |
| mnasiadka | frickler: What is interesting, the k-a jobs started failing miserably yesterday - https://zuul.openstack.org/builds?job_name=kolla-ansible-debian&skip=0 | 09:53 |
| frickler | mnasiadka: well Friday evening first, but yes. I haven't found anything merged in neutron at that time that looks related | 09:58 |
| frickler | but also nothing merged in kolla/k-a | 09:58 |
| mnasiadka | yes, but that DHCP change was from 1st of March | 09:59 |
| mnasiadka | we would see that sooner | 09:59 |
| mnasiadka | Nothing in oslo.service | 09:59 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: DNM: Try to switch to 2025.1 sources https://review.opendev.org/c/openstack/kolla/+/944672 | 10:04 |
| mnasiadka | let's try this | 10:04 |
| priteau | Could it be caused by https://review.opendev.org/c/openstack/neutron/+/926497 | 10:12 |
| priteau | It merged late on Friday | 10:12 |
| frickler | mnasiadka: looks like the revert-test patch is still failing the same way :( | 10:13 |
| mnasiadka | yup | 10:13 |
| mnasiadka | that's not the patch that is causing it | 10:13 |
| mnasiadka | looking through gerrit for anything that is relevant, but can't find anything | 10:13 |
| priteau | Looking at Zuul builds, it was working with neutron-dhcp-agent version 26.0.0.0b3.dev299 but failing with neutron-dhcp-agent version 26.0.0.0b3.dev303 | 10:13 |
| priteau | It think that could fit with the IPv6 patch? | 10:14 |
| frickler | priteau: I had skipped that patch based on the commit message, but timing would match and it does indeed touch dhcp agent code | 10:15 |
| priteau | Can we test a revert? | 10:18 |
| mnasiadka | frickler: do you have time testing the revert? | 10:19 |
| priteau | It is being backported to Dalmatian too: https://review.opendev.org/c/openstack/neutron/+/944496 | 10:19 |
| opendevreview | Dr. Jens Harbott proposed openstack/kolla-ansible master: DNM: Test Neutron DHCP eventlet drop revert https://review.opendev.org/c/openstack/kolla-ansible/+/944635 | 10:21 |
| frickler | ^^ testing combination of both reverts now, just in case | 10:21 |
| mnasiadka | thanks | 10:22 |
| priteau | Thanks | 10:22 |
| mnasiadka | need to drop out for an hour | 10:22 |
| frickler | actually I have a held node now, testing there might be faster, let me see | 10:24 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: mariadb: Use mysql_query instead of command https://review.opendev.org/c/openstack/kolla-ansible/+/944411 | 12:27 |
| mnasiadka | frickler: does that mean devstack runs without ipv6? ;-) | 12:35 |
| frickler | frickler: there are also IPv6 jobs, but by default yes | 12:37 |
| frickler | but also part of the issue seems to be that the metadata address isn't available in kolla in the dhcp container | 12:38 |
| frickler | or maybe some bind-nonlocal flag missing? | 12:41 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: mariadb: Use mysql_query instead of command https://review.opendev.org/c/openstack/kolla-ansible/+/944411 | 12:43 |
| priteau | The issue seems to show up when IPv6 is enabled in Linux, but there are no IPv6 Neutron subnets. Maybe Neutron CI disables IPv6 when not used? | 12:45 |
| frickler | hmm, that would sound like a surprise to me | 12:58 |
| mnasiadka | hmm, maybe the problem is in docker and podman - we'd need to assign that address first to the host, to make it available to the container | 13:02 |
| mnasiadka | well, we run the dhcp agent in privileged mode, so that should work | 13:12 |
| opendevreview | Pierre Riteau proposed openstack/kolla-ansible master: DNM: Test Neutron DHCP fix https://review.opendev.org/c/openstack/kolla-ansible/+/944776 | 13:14 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: mariadb: Use mysql_query instead of command https://review.opendev.org/c/openstack/kolla-ansible/+/944411 | 14:24 |
| frickler | seems there's also something wrong with our ipv6 job, though I can't see why the pull would fail because of that change https://zuul.opendev.org/t/openstack/build/85a1674dd4dd4219bc28e51499e1e8fb | 14:50 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: mariadb: Use mysql_query instead of command https://review.opendev.org/c/openstack/kolla-ansible/+/944411 | 14:51 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: mariadb: Use mysql_query instead of command https://review.opendev.org/c/openstack/kolla-ansible/+/944411 | 15:07 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: debian: Use Dalmatian extrepo release https://review.opendev.org/c/openstack/kolla/+/944316 | 15:10 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: mariadb: Use mysql_query instead of command https://review.opendev.org/c/openstack/kolla-ansible/+/944411 | 15:40 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: mariadb: Use mysql_query instead of command https://review.opendev.org/c/openstack/kolla-ansible/+/944411 | 15:40 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: mariadb: Use mysql_query instead of command https://review.opendev.org/c/openstack/kolla-ansible/+/944411 | 16:09 |
| frickler | well the pull fails because we didn't build the image we need. seems we need to add prometheus to the default list, since ipv6 doesn't have any scenario tag | 17:46 |
| mnasiadka | frickler: I think a colleague of mine did some work with that, will find that tomorrow | 18:16 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: DNM: Test Neutron DHCP fix https://review.opendev.org/c/openstack/kolla-ansible/+/944776 | 19:12 |
| mnasiadka | frickler: that should do it for testing | 19:16 |
| mnasiadka | frickler: ipv6 jobs passing now | 20:09 |
| frickler | thx, will take a closer look tomorrow | 21:08 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Fix docs rendering errors. https://review.opendev.org/c/openstack/kolla-ansible/+/944184 | 23:49 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!