| opendevreview | Yoshi Kadokawa proposed openstack/project-config master: Add Cinder Huawei charm https://review.opendev.org/c/openstack/project-config/+/867589 | 03:10 |
|---|---|---|
| *** akekane is now known as abhishekk | 04:25 | |
| *** yadnesh|away is now known as yadnesh | 04:27 | |
| *** blarnath is now known as d34dh0r53 | 06:54 | |
| *** Tengu_ is now known as Tengu | 07:01 | |
| *** jpena|off is now known as jpena | 08:38 | |
| ykarel | any infra core around? looking for autohold on patch https://review.opendev.org/867609, job neutron-tempest-plugin-ovn-1 and neutron-tempest-plugin-ovn-2 | 08:52 |
| *** yadnesh is now known as yadnesh|afk | 11:04 | |
| *** dviroel|out is now known as dviroel|rover | 11:12 | |
| *** rlandy|out is now known as rlandy | 11:12 | |
| *** yadnesh|afk is now known as yadnesh | 11:42 | |
| *** dasm|off is now known as dasm | 12:18 | |
| opendevreview | Mariusz Karpiarz proposed openstack/project-config master: Add the "api-ref-jobs" template to CloudKitty https://review.opendev.org/c/openstack/project-config/+/867651 | 12:31 |
| fungi | ykarel: i've added two autoholds for that change, one for each of the mentioned jobs | 12:43 |
| ykarel | fungi, Thanks, we are seeing issues with specific provider vexxhost-ca-ymq-1 related to nested virt https://bugs.launchpad.net/neutron/+bug/1999249 | 12:47 |
| ykarel | randomly after we switched master jobs to ubuntu jammy | 12:47 |
| fungi | ykarel: it's not surprising. nested virt stability tends to depend a lot on what kernel version you have on the hypervisor host, on the first level guest, and on the nested guest. if you change one of those you may uncover new bugs in the kernel | 12:50 |
| ykarel | fungi, yes :( | 12:53 |
| ykarel | fungi, so may be issue is with only few compute nodes as we seeing the issue randomly | 12:55 |
| ykarel | or anycase to get root cause need to check from hypervisor side | 12:56 |
| Tengu | fungi: heya! apparently there's something broken somewhere: https://zuul.opendev.org/t/openstack/build/d57b0d57b5b947b3937a179f47969f5c - this failed the build for the networkmanager patch that was nudged to gate yesterday :/ | 13:02 |
| fungi | Tengu: known problem, there was a block storage outage in rackspace impacting a cinder volume for one of our builders (nb02.opendev.org) | 13:27 |
| fungi | we also redeploy that configuration at least daily if there's not another change which triggers an update of it sooner | 13:27 |
| Tengu | fungi: so nothing to do then? | 13:31 |
| fungi | Tengu: yeah, it should be fine. according to the image build logs it's copying that file from /opt/project-config/nodepool/elements/nodepool-base/finalise.d/89-boot-settings and even on nb02 that file says last modified today at 13:07 utc | 13:44 |
| fungi | so a little more than half an hour ago | 13:44 |
| fungi | and seems to contain the routine from that change | 13:45 |
| Tengu | perfect then | 13:45 |
| fungi | since we don't set -x in that script it's hard to observe it getting run in the image build logs, but we could check on a test node | 13:46 |
| Tengu | fungi: and I'll try to get some more time in order to check that galaxy proxy issue again. pretty sure there are some checks on the s3 bucket policy or the like. | 13:46 |
| fungi | i wouldn't be surprised | 13:47 |
| Tengu | yeah..... well. I'll see. | 13:50 |
| Tengu | iirc we can pass some nice headers to the backend using mod_proxy, so maybe there's a chance. | 13:50 |
| fungi | yes, we can add, modify or pass through headers | 13:51 |
| clarkb | Tengu: fungi we reapply the nodepool configs hourly so that would've eventually acught up automatically | 14:48 |
| fungi | yep, and indeed it did | 14:53 |
| Tengu | so new images will get the config | 14:59 |
| fungi | yes | 15:15 |
| *** dviroel|rover is now known as dviroel|rover|lunch | 15:52 | |
| *** dviroel|rover|lunch is now known as dviroel|rover | 16:38 | |
| opendevreview | Jeremy Stanley proposed openstack/project-config master: Add the "api-ref-jobs" template to CloudKitty https://review.opendev.org/c/openstack/project-config/+/867651 | 16:41 |
| *** yadnesh is now known as yadnesh|away | 17:27 | |
| *** jpena is now known as jpena|off | 17:35 | |
| *** rlandy is now known as rlandy|dr_appt | 19:46 | |
| *** tosky_ is now known as tosky | 21:12 | |
| *** dasm is now known as dasm|off | 21:26 | |
| *** dviroel|rover is now known as dviroel|out | 21:31 | |
| *** rlandy|dr_appt is now known as rlandy | 21:51 | |
| *** rlandy is now known as rlandy|bbl | 22:29 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!