| rdogerrit | rdo-trunk rdo-trunk proposed rdoinfo master: Bump rdoinfo caracal-uc tags to latest upper-constraints or latest Puppetfile https://review.rdoproject.org/r/c/rdoinfo/+/51946 | 00:25 |
|---|---|---|
| rdogerrit | rdo-trunk rdo-trunk proposed rdoinfo master: Promote CBS tags update for antelope-9s-testing https://review.rdoproject.org/r/c/rdoinfo/+/51427 | 00:42 |
| rdogerrit | rdo-trunk rdo-trunk proposed rdoinfo master: Promote CBS tags update for zed-9s-testing https://review.rdoproject.org/r/c/rdoinfo/+/51977 | 00:43 |
| rdogerrit | rdo-trunk rdo-trunk proposed rdoinfo master: Promote CBS tags update for wallaby-8s-testing https://review.rdoproject.org/r/c/rdoinfo/+/51282 | 00:44 |
| opendevreview | Takashi Kajinami proposed x/packstack master: Clean up unnecessary workaround related to puppetlabs-apache https://review.opendev.org/c/x/packstack/+/905059 | 04:52 |
| opendevreview | Merged x/packstack stable/2023.1: Add enable-chassis-as-gw option for OVN CMS cluster https://review.opendev.org/c/x/packstack/+/910605 | 06:08 |
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for zed-9s-testing https://review.rdoproject.org/r/c/rdoinfo/+/51977 | 07:15 |
| rdogerrit | Merged rdoinfo master: Bump proliantutils and scciclient to latest releases https://review.rdoproject.org/r/c/rdoinfo/+/51954 | 07:27 |
| rdogerrit | Joel Capitao proposed rdoinfo master: Remove CloudSIG GA repo definition for X and W https://review.rdoproject.org/r/c/rdoinfo/+/48016 | 07:28 |
| rdogerrit | Joel Capitao proposed rdoinfo master: Pin the packages falling back to master in Bobcat https://review.rdoproject.org/r/c/rdoinfo/+/51667 | 07:31 |
| rdogerrit | Karolina Kula proposed rdoinfo master: Bump rdoinfo caracal-uc tags to latest upper-constraints or latest Puppetfile https://review.rdoproject.org/r/c/rdoinfo/+/51946 | 08:10 |
| rdogerrit | Karolina Kula proposed rdoinfo master: Bump rdoinfo caracal-uc tags to latest upper-constraints or latest Puppetfile https://review.rdoproject.org/r/c/rdoinfo/+/51946 | 08:14 |
| rdogerrit | Karolina Kula proposed rdoinfo master: Bump rdoinfo caracal-uc tags to latest upper-constraints or latest Puppetfile https://review.rdoproject.org/r/c/rdoinfo/+/51978 | 08:29 |
| jcapitao[m] | amoralej karolinku : can you add your approval in https://gitlab.com/redhat/centos-stream/rpms/go-rpm-macros/-/merge_requests/10 please ? | 08:55 |
| jcapitao[m] | to increase chance to have it merged soon | 08:56 |
| jcapitao[m] | I tested it locally | 08:56 |
| amoralej | lemme try | 08:56 |
| jcapitao[m] | I can't see you karolinku actually | 09:02 |
| jcapitao[m] | I mean as member of redhat gitlab namespace | 09:03 |
| karolinku[m] | let me check | 09:06 |
| karolinku[m] | I dont have an account there, that's why | 09:08 |
| jcapitao[m] | okk the account is created while authenticating the first time with SAML for CentOS or RedHat IdP | 09:16 |
| rdogerrit | Joel Capitao proposed openstack/os-diff-distgit rpm-master: Add os-diff specfile for rdo-package https://review.rdoproject.org/r/c/openstack/os-diff-distgit/+/51560 | 09:33 |
| rdogerrit | Joel Capitao proposed rdo-infra/example-distgit rpm-master: Add golang-example spec file https://review.rdoproject.org/r/c/rdo-infra/example-distgit/+/51974 | 09:39 |
| rdogerrit | Joel Capitao proposed rdo-infra/example-distgit rpm-master: Add golang-example spec file https://review.rdoproject.org/r/c/rdo-infra/example-distgit/+/51974 | 09:40 |
| rdogerrit | Joel Capitao proposed rdo-infra/example-distgit rpm-master: Add golang-example spec file https://review.rdoproject.org/r/c/rdo-infra/example-distgit/+/51974 | 09:40 |
| rdogerrit | rdo-trunk rdo-trunk proposed openstack/horizon-distgit zed-rdo: python-django-horizon-23.0.1-1 https://review.rdoproject.org/r/c/openstack/horizon-distgit/+/51979 | 09:50 |
| rdogerrit | Merged openstack/horizon-distgit zed-rdo: python-django-horizon-23.0.1-1 https://review.rdoproject.org/r/c/openstack/horizon-distgit/+/51979 | 10:12 |
| rdogerrit | Alfredo Moralejo proposed config master: Add support to latest ruamel.yaml in create-project script https://review.rdoproject.org/r/c/config/+/51945 | 11:23 |
| rdogerrit | Merged rdo-infra/example-distgit rpm-master: Add golang-example spec file https://review.rdoproject.org/r/c/rdo-infra/example-distgit/+/51974 | 11:28 |
| rdogerrit | Merged rdo-website master: Move from bugzilla to jira as reporting tool https://review.rdoproject.org/r/c/rdo-website/+/51871 | 11:32 |
| rdogerrit | Merged rdoinfo master: Bump rdoinfo caracal-uc tags to latest upper-constraints or latest Puppetfile https://review.rdoproject.org/r/c/rdoinfo/+/51946 | 12:21 |
| rdogerrit | Alfredo Moralejo proposed rdo-infra/weirdo master: Exclude ruby 3.1 https://review.rdoproject.org/r/c/rdo-infra/weirdo/+/51980 | 13:12 |
| amoralej | jcapitao[m], apevec ^ | 13:12 |
| amoralej | tkajinam ^ it will probably hit upstream soon | 13:12 |
| rdogerrit | Alfredo Moralejo proposed rdo-infra/weirdo master: Exclude ruby 3.1 https://review.rdoproject.org/r/c/rdo-infra/weirdo/+/51980 | 13:15 |
| apevec | sigh, I really want to see RCA for this | 13:15 |
| rdogerrit | Alfredo Moralejo proposed rdo-infra/weirdo master: Exclude ruby 3.1 https://review.rdoproject.org/r/c/rdo-infra/weirdo/+/51980 | 13:15 |
| rdogerrit | Alfredo Moralejo proposed rdo-infra/weirdo master: Exclude ruby 3.1 https://review.rdoproject.org/r/c/rdo-infra/weirdo/+/51980 | 13:23 |
| rdogerrit | Alfredo Moralejo proposed rdo-infra/weirdo master: Exclude ruby 3.1 https://review.rdoproject.org/r/c/rdo-infra/weirdo/+/51980 | 13:40 |
| tkajinam | amoralej, :-( | 13:44 |
| tkajinam | amoralej, so they enabled different modules accidentally ? | 13:44 |
| tkajinam | like they did for mariadb | 13:45 |
| tkajinam | I feel like we are adding workaround for different problems every single week this year. /me sighs | 13:46 |
| amoralej | tkajinam, nop, this time is different | 13:46 |
| tkajinam | ok | 13:46 |
| jcapitao[m] | tkajinam: https://issues.redhat.com/browse/RHEL-28082 | 13:46 |
| amoralej | the module is not enabled, but it seems like it sees the packages as non-modular but then it complains that is missing module metadata | 13:46 |
| tkajinam | hmm. sounds like something is wrong with repodata | 13:47 |
| amoralej | yes, i'd say so | 13:47 |
| amoralej | tkajinam, btw, at least watcher and murano are failing with latest oslo.db | 13:47 |
| amoralej | related to autocommit parameter and all that | 13:48 |
| tkajinam | yeah | 13:48 |
| amoralej | wdyt of removing coverage of p-o-i until it's fixed ? | 13:48 |
| amoralej | it's blocking promotion | 13:48 |
| tkajinam | I guess there are a few more projects currently broken since the last mass bump. I saw some unit test failures in trove as well, though it was unrelated to autocommit | 13:48 |
| amoralej | i tried the easy fixes but didn't work | 13:49 |
| tkajinam | yeah. let me push a change to drop it. actually it's being marked inactive now and will not be part of caracal release so we may retire the module completely | 13:49 |
| tkajinam | https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/message/VHE6WWZKOTTKBLUVMABAAQKBN2QSEED4/ | 13:50 |
| tkajinam | this is what I've sent last week | 13:50 |
| amoralej | ah, right | 13:50 |
| amoralej | i didn't remember murano is also inactive | 13:50 |
| amoralej | but watcher is not, right? | 13:50 |
| amoralej | i've reported the issue, https://bugs.launchpad.net/watcher/+bug/2056181 we will see | 13:51 |
| amoralej | karolinku[m] ^ forget about murano issue | 13:52 |
| tkajinam | watcher is not marked inactive but we'll see how they react on the problem | 13:53 |
| amoralej | yep | 13:53 |
| tkajinam | murano was not part of the first batch but was later added. | 13:54 |
| amoralej | tkajinam, good news is that mariadb issue is fixed :) | 13:54 |
| tkajinam | ah, ok | 13:54 |
| tkajinam | is it already released ? I may try reverting the change if the fixed version is available | 13:54 |
| amoralej | yes, it's released, i'm not sure if it's in AFS mirrors | 13:54 |
| tkajinam | ok | 13:55 |
| amoralej | the same release that broke ruby, fixed mariadb | 13:55 |
| tkajinam | lol | 13:55 |
| amoralej | :) | 13:55 |
| tkajinam | the released which fixed libvirt broke mariadb, then the new release fixes mariadb and then breaks ruby :-) | 13:55 |
| amoralej | yes, i know ... | 13:55 |
| tkajinam | we are in very nice break-fix practice, or probably it's called fix-break :-P | 13:56 |
| rdogerrit | Takashi Kajinami proposed rdoinfo master: Remove Senlin from Caracal https://review.rdoproject.org/r/c/rdoinfo/+/51910 | 13:58 |
| tkajinam | amoralej jcapitao[m] by the way, do you agree with removing inactive projects from caracal ? | 14:01 |
| tkajinam | the patch to remove senlin is up for review ^^^ . I'll submit ones for murano and sahara if that makes sense to you | 14:01 |
| tkajinam | monscaclient is required by heat atm but we'll deprecate the implementation this cycle so will be able to remove it in D | 14:02 |
| tkajinam | (we have to get https://review.opendev.org/c/x/packstack/+/904896 in to remove sahara. just fyi | 14:02 |
| jcapitao[m] | personally I'd remove them to reflect upstream status, but we can ask the community before final removal, so I guess you can propose the patches | 14:05 |
| jcapitao[m] | also sahara-image-elements then | 14:05 |
| tkajinam | yeah | 14:06 |
| amoralej | we discussed if we should maintain the packages in the repo with a note in release notes, even if they have no ci coverage | 14:29 |
| amoralej | wait, or we said we'd only include if they passed ci? | 14:29 |
| amoralej | for me, if it's known bad, we should remove | 14:29 |
| rdogerrit | Alfredo Moralejo proposed config master: Make yoga p-o-i jobs non-voting in weirdo gates https://review.rdoproject.org/r/c/config/+/51982 | 14:35 |
| amoralej | jcapitao[m] karolinku[m] ^ required for https://review.rdoproject.org/r/c/rdo-infra/weirdo/+/51980 | 14:35 |
| rdogerrit | Marios Andreou proposed rdo-jobs master: Adds overcloud os-net-config and ssh setup for new data plane adoption job https://review.rdoproject.org/r/c/rdo-jobs/+/51916 | 14:39 |
| rdogerrit | Merged config master: Make yoga p-o-i jobs non-voting in weirdo gates https://review.rdoproject.org/r/c/config/+/51982 | 14:44 |
| jcapitao[m] | amoralej: https://lists.rdoproject.org/archives/list/dev@lists.rdoproject.org/thread/I564TWSOOQJ3B47YKGLBBNMOQLU244FD/ | 14:47 |
| jcapitao[m] | I forgot about that | 14:47 |
| amoralej | - If projects fail CI jobs in RDO CI, we will retire the packages. | 14:47 |
| amoralej | so .... | 14:48 |
| jcapitao[m] | ok but there is exception | 14:49 |
| jcapitao[m] | like sahara-image-elements | 14:49 |
| jcapitao[m] | it's inactive since a while now | 14:49 |
| amoralej | you mean we should retire it? | 14:49 |
| jcapitao[m] | I don't think there are tests in RDO CI | 14:49 |
| amoralej | i think support from p-o-i was also removed | 14:49 |
| jcapitao[m] | it's still pulling dib-utils which is retired | 14:50 |
| jcapitao[m] | but as per "- If projects are retired in Dalmata release, we will retire them from RDO." | 14:51 |
| jcapitao[m] | we'll do it after Caracal release | 14:51 |
| amoralej | if it fails CI, we will retire it in caracal | 14:51 |
| amoralej | if there is no ci at all ... | 14:51 |
| amoralej | sahara-image-elements should go with sahara | 14:51 |
| amoralej | we can remove dib-utils dep is needed | 14:52 |
| jcapitao[m] | amoralej: you mean we should treat projects with no CI to be handled as they failed CI ? | 14:54 |
| amoralej | I'm wondering it | 14:55 |
| amoralej | i'm not sure, tbh | 14:55 |
| tkajinam | afaik sahara hasn't been passing CI. some people volunteered to maintain it but they eventually just disable all tests, even unit tests | 14:56 |
| tkajinam | so is tests have been broken for long and I tend to vote on retiring it in C | 14:57 |
| tkajinam | and if sahara is retired then there is no reason to keep sahara-image-elements | 14:57 |
| amoralej | wrt scenario001, it's failing with db connections limits after new oslo.db. i see aodh-evaluator has +30 connections | 14:58 |
| amoralej | there are still patches inflight for aodh related to db | 14:58 |
| tkajinam | hmm | 14:58 |
| amoralej | project:openstack/aodh topic:sqlalchemy-20 | 14:59 |
| tkajinam | there are still some open patches but my understanding was that there are for sqla2 and is not very necessary for the oslo.db in caracal. | 14:59 |
| tkajinam | though I might be wrong | 14:59 |
| tkajinam | afaik all telemetry patches are no blocked by https://review.opendev.org/c/openstack/telemetry-tempest-plugin/+/910572?tab=change-view-tab-header-zuul-results-summary (with a few exceptions) which is currently failing. I've not yet dig into it to find the cause. no one from telemetry core has been available in irc for some time so I don't know if they have any plan to fix it | 15:00 |
| amoralej | we may increase max_connections | 15:01 |
| tkajinam | yeah we can try it | 15:01 |
| tkajinam | amoralej, do you mind sharing the link for the job result ? | 15:01 |
| amoralej | tkajinam, https://logserver.rdoproject.org/84/51784/3/check/weirdo-caracal-promote-puppet-scenario001-centos-stream-9/1403315/logs/ | 15:02 |
| amoralej | i have also a live reproducer | 15:02 |
| tkajinam | hmm that's strange | 15:09 |
| tkajinam | https://33ee7f1e30d6ddf8b635-e44509a4e2cdd0df87d44b1b5e050fc0.ssl.cf2.rackcdn.com/911102/1/check/puppet-openstack-integration-7-scenario001-tempest-centos-9-stream/ff6d89a/job-output.txt | 15:11 |
| tkajinam | ok now upstream poi jobs are all knocked down by that ruby package bug | 15:11 |
| amoralej | tkajinam, https://review.rdoproject.org/etherpad/p/problem-scenario001-oslo-db that's number of connections by process (by name and then by pid) | 15:13 |
| amoralej | max is 151 | 15:14 |
| tkajinam | amoralej, may I login to that server ? | 15:15 |
| amoralej | yep | 15:15 |
| amoralej | your key ? | 15:15 |
| tkajinam | https://github.com/kajinamit.keys | 15:15 |
| tkajinam | hmm I checked oslo.db diff but could not find anything suspicious | 15:17 |
| amoralej | tkajinam, https://lists.centos.org/pipermail/centos-devel/2024-March/165567.html | 15:28 |
| amoralej | fix should be soon in the repos | 15:28 |
| tkajinam | hmm so I checked the vm but could not find any package version diff which is suspicious | 15:33 |
| amoralej | it started since oslo-db update | 15:33 |
| amoralej | tkajinam, https://review.rdoproject.org/zuul/builds?job_name=weirdo-caracal-promote-puppet-scenario001-centos-stream-9&project=rdoinfo | 15:34 |
| amoralej | unfortunatelly, i think we don't have a good way to get the number of db connections per proccess from the logs | 15:35 |
| rdogerrit | Karolina Kula proposed openstack/os-refresh-config-distgit zed-rdo: Dummy commit to force rebuild https://review.rdoproject.org/r/c/openstack/os-refresh-config-distgit/+/51983 | 15:36 |
| tkajinam | amoralej, hm | 15:36 |
| tkajinam | amoralej, I wonder if vitrage is causing something bad. even in the last successful run I see tons of db errors including "too many connections" https://logserver.rdoproject.org/openstack-periodic-daily/review.rdoproject.org/rdoinfo/master/weirdo-caracal-promote-puppet-scenario001-centos-stream-9/0b64b54/logs/weirdo-project/logs/vitrage/persistor.txt.gz | 15:37 |
| rdogerrit | Karolina Kula proposed openstack/os-refresh-config-distgit wallaby-rdo: Dummy commit to force rebuild https://review.rdoproject.org/r/c/openstack/os-refresh-config-distgit/+/51984 | 15:37 |
| amoralej | yeah, vitrage is also suspicious | 15:38 |
| rdogerrit | Karolina Kula proposed openstack/novaclient-distgit rpm-master: Limit setuptools version https://review.rdoproject.org/r/c/openstack/novaclient-distgit/+/51985 | 16:02 |
| rdogerrit | Karolina Kula proposed rdoinfo master: Bump rdoinfo caracal-uc tags to latest upper-constraints or latest Puppetfile https://review.rdoproject.org/r/c/rdoinfo/+/51978 | 16:19 |
| rdogerrit | Karolina Kula proposed openstack/ironicclient-distgit rpm-master: Limit setuptools version https://review.rdoproject.org/r/c/openstack/ironicclient-distgit/+/51986 | 16:22 |
| jcapitao[m] | karolinku: ^ you can put those as depend-on https://review.rdoproject.org/r/c/rdoinfo/+/51978 to test | 16:25 |
| karolinku[m] | I just did, for novaclient | 16:25 |
| jcapitao[m] | ah right ! | 16:26 |
| rdogerrit | Karolina Kula proposed openstack/ironic-inspector-client-distgit rpm-master: Limit setuptools version https://review.rdoproject.org/r/c/openstack/ironic-inspector-client-distgit/+/51987 | 16:34 |
| jcapitao[m] | amoralej tkajinam : ruby issue is fixed now | 16:38 |
| amoralej | cool | 16:38 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!