| opendevreview | Neil Hanlon proposed openstack/kolla master: Change from PackageCloud.io to CloudSmith mirrors for rabbitmq/erlang https://review.opendev.org/c/openstack/kolla/+/884572 | 00:46 |
|---|---|---|
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Change from PackageCloud.io to CloudSmith mirrors for rabbitmq/erlang https://review.opendev.org/c/openstack/kolla/+/884572 | 04:53 |
| opendevreview | Mathias Fechner proposed openstack/kolla-ansible master: opensearch: fix the missing config mount and set permissions add missing volume path for opensearch-dashboard https://review.opendev.org/c/openstack/kolla-ansible/+/884649 | 05:53 |
| opendevreview | Mathias Fechner proposed openstack/kolla-ansible master: opensearch: fix the missing config mount and set permissions add missing volume path for opensearch-dashboard https://review.opendev.org/c/openstack/kolla-ansible/+/884649 | 07:10 |
| opendevreview | Merged openstack/kayobe-config master: 2023.1 RC1 - Sync defaults with Kayobe https://review.opendev.org/c/openstack/kayobe-config/+/884473 | 08:01 |
| opendevreview | Verification of a change to openstack/kayobe master failed: Use OpenStack 2023.1 release https://review.opendev.org/c/openstack/kayobe/+/884472 | 08:37 |
| grami[m] | frickler: Hi any chance I can get this merged for zed it's a backport and already in master https://review.opendev.org/c/openstack/kolla-ansible/+/883915 | 08:54 |
| opendevreview | Merged openstack/kayobe-config-dev master: 2023.1 RC1 - Sync defaults with Kayobe https://review.opendev.org/c/openstack/kayobe-config-dev/+/884477 | 08:54 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/2023.1: Fix the fluentd regexp to collect the logs https://review.opendev.org/c/openstack/kolla-ansible/+/884539 | 09:10 |
| mnasiadka | grami[m]: forgot antelope, just cherry picked ;) | 09:10 |
| grami[m] | mnasiadka: yeah when I created this antelope branch didn't exist as it's only been created from master after this was merged into master antelope already has it. | 09:11 |
| mnasiadka | antelope branch hasn't been created with this patch | 09:12 |
| grami[m] | it does just checked the code you can see but the git blame it's in https://opendev.org/openstack/kolla-ansible/blame/branch/master/ansible/roles/common/templates/conf/input/00-global.conf.j2 | 09:14 |
| grami[m] | mnasiadka: Sorry you are right | 09:14 |
| opendevreview | Graeme Moss proposed openstack/kolla-ansible stable/2023.1: Fix the fluentd regexp to collect the logs https://review.opendev.org/c/openstack/kolla-ansible/+/884539 | 09:15 |
| grami[m] | mnasiadka: Thanks for pointing that out I thought I was going crazy but on double take it didn't get in. so yeah going to need that to be merged too please :) | 09:19 |
| opendevreview | Verification of a change to openstack/kolla master failed: mariadb-clustercheck: ensure /var/log/kolla/mariadb exists https://review.opendev.org/c/openstack/kolla/+/884208 | 10:14 |
| mnasiadka | seems we have some problem with rabbitmq and putting the node to maintenance on restart - https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_0c3/884208/2/gate/kolla-ansible-rocky9/0c38c86/primary/logs/ansible/reconfigure | 10:22 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: rabbitmq: pin to 3.11.16 https://review.opendev.org/c/openstack/kolla/+/884677 | 10:45 |
| mnasiadka | let's see if ^^ helps | 10:48 |
| opendevreview | Merged openstack/kolla stable/yoga: CI: Fix centos9 builds and drop unnecessary zuul vars https://review.opendev.org/c/openstack/kolla/+/884487 | 11:14 |
| opendevreview | Merged openstack/kolla-ansible stable/zed: Fix the fluentd regexp to collect the logs https://review.opendev.org/c/openstack/kolla-ansible/+/883915 | 11:14 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Add node to RMQ drain https://review.opendev.org/c/openstack/kolla-ansible/+/884679 | 11:20 |
| NeilHanlon | mnasiadka: not sure what happened here https://review.opendev.org/c/openstack/kolla/+/884572 - the failures almost look like the jobs got terminated by zuul? | 11:53 |
| opendevreview | Merged openstack/kayobe master: Use OpenStack 2023.1 release https://review.opendev.org/c/openstack/kayobe/+/884472 | 12:05 |
| frickler | NeilHanlon: at least for ubuntu the failure looks like what mnasiadka mentioned earlier and wants to fix with https://review.opendev.org/c/openstack/kolla/+/884677 | 12:21 |
| frickler | see the end of https://5fd5e74cdeb26ed32d55-9d697031d66865af8e6eba8e2a3ea98e.ssl.cf5.rackcdn.com/884572/4/check/kolla-ansible-ubuntu/89b30ec/primary/logs/ansible/reconfigure for the failure | 12:21 |
| NeilHanlon | frickler: ah. thank you. i missed that log file when I was looking | 12:37 |
| frickler | NeilHanlon: yes, interpreting kolla jobs failures is one of the advanced arts ;) | 12:39 |
| opendevreview | Mark Goddard proposed openstack/kayobe stable/zed: Limit interface names to 15 characters https://review.opendev.org/c/openstack/kayobe/+/884540 | 12:39 |
| opendevreview | Mark Goddard proposed openstack/kayobe stable/yoga: Limit interface names to 15 characters https://review.opendev.org/c/openstack/kayobe/+/884541 | 12:39 |
| opendevreview | Mark Goddard proposed openstack/kayobe stable/xena: Limit interface names to 15 characters https://review.opendev.org/c/openstack/kayobe/+/884542 | 12:39 |
| NeilHanlon | hehe.. i'll add it to my arsenal over time. :) | 12:40 |
| mnasiadka | frickler: yes, in a meeting now, but will have a look later today - probably I'm bad at pinning in ubuntu/debian :) | 12:58 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: rabbitmq: pin to 3.11.16 https://review.opendev.org/c/openstack/kolla/+/884677 | 13:10 |
| mnasiadka | ok, pinning should be better now | 13:10 |
| frickler | ah, that nasty -1, yes, I've stumbled about that a couple of times already, too ;) | 13:11 |
| grami[m] | Did something happen to the zuul I see a cherrypick has failed but was fine on the other two. looks like the connection just closed. https://zuul.opendev.org/t/openstack/build/63176691850a4946a6377d3a7c1897d9 this is for https://review.opendev.org/c/openstack/kolla-ansible/+/884539 | 13:13 |
| frickler | grami[m]: the failure is unrelated, it is the rabbitmq issue we are talking about. the ansible tasks log into dedicated files, in this case see https://625729d1ed0d8393a278-a652dfde2626cf7f56c641f7d1ec9aa2.ssl.cf2.rackcdn.com/884539/2/check/kolla-ansible-debian/6317669/primary/logs/ansible/reconfigure | 13:15 |
| frickler | mnasiadka: did you check for an upstream bug report yet? I don't like us pinning with at least a reference | 13:15 |
| grami[m] | Ah ok thanks. that makes sense. | 13:15 |
| frickler | *withou | 13:15 |
| frickler | t | 13:15 |
| frickler | meh | 13:16 |
| mnasiadka | frickler: it wasn't there couple of hours ago, but will raise one | 13:16 |
| opendevreview | Alex Welsh proposed openstack/kayobe master: Update gitignore for .vscode/ configuration files https://review.opendev.org/c/openstack/kayobe/+/884694 | 13:16 |
| opendevreview | Neil Hanlon proposed openstack/kolla master: Change from PackageCloud.io to CloudSmith mirrors for rabbitmq/erlang https://review.opendev.org/c/openstack/kolla/+/884572 | 13:27 |
| opendevreview | Matt Crees proposed openstack/kolla-ansible master: Correct [pci] syntax in Nova SRIOV documentation https://review.opendev.org/c/openstack/kolla-ansible/+/884708 | 14:21 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Pass through kolla inventories as is https://review.opendev.org/c/openstack/kayobe/+/802864 | 15:15 |
| opendevreview | Matt Crees proposed openstack/kolla-ansible master: Correct [pci] syntax in Nova SRIOV documentation https://review.opendev.org/c/openstack/kolla-ansible/+/884708 | 15:30 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: rabbitmq: pin to 3.11.16 https://review.opendev.org/c/openstack/kolla/+/884677 | 15:35 |
| mnasiadka | frickler: updated ^^ | 15:39 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Change from PackageCloud.io to CloudSmith mirrors for rabbitmq/erlang https://review.opendev.org/c/openstack/kolla/+/884572 | 15:41 |
| mnasiadka | frickler: seems we're not copying logs on failures... | 15:44 |
| mnasiadka | ah, the job timed out | 15:45 |
| mnasiadka | so not all logs are there | 15:45 |
| opendevreview | Neil Hanlon proposed openstack/kolla master: Change from PackageCloud.io to CloudSmith mirrors for rabbitmq/erlang https://review.opendev.org/c/openstack/kolla/+/884572 | 15:48 |
| frickler | mnasiadka: yes, for timeout I don't think we have an option to collect logs. holding a node would be the best option if it is reproducible | 15:49 |
| mnasiadka | naah, let's fix this rmq problem | 15:49 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: mariadb-clustercheck: ensure /var/log/kolla/mariadb exists https://review.opendev.org/c/openstack/kolla/+/884208 | 15:50 |
| mnasiadka | frickler: basically thursday is final release deadline - should we try to get the MariaDB/RMQ Ansible rework patch in, or do we prefer to hold a bit on it and backport it later? | 15:52 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Pass through kolla inventories as is https://review.opendev.org/c/openstack/kayobe/+/802864 | 15:52 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Use merge_configs and merge_yaml to generate Kolla custom config https://review.opendev.org/c/openstack/kayobe/+/782749 | 15:52 |
| mmalchuk | mnasiadka please review https://review.opendev.org/c/openstack/kolla-ansible/+/882100 | 15:54 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Use merge_configs and merge_yaml to generate Kolla custom config https://review.opendev.org/c/openstack/kayobe/+/782749 | 15:54 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Change from PackageCloud.io to CloudSmith mirrors for rabbitmq/erlang https://review.opendev.org/c/openstack/kolla/+/884572 | 15:57 |
| mnasiadka | mmalchuk: will do, but rather end of this week after the release madness | 15:58 |
| mmalchuk | principial action, Mark propose not use umask() but IMHO we shouldn't give the user choice to controll umask in bashrc for example | 16:00 |
| frickler | mnasiadka: I'd rather see some more testing, also not sure we'd want to release with that pin? or do we need that anyway? | 16:00 |
| mnasiadka | frickler: well, for now we have rmq pin and ansible-core pin - I have no influence over RMQ - so I would release that way, that's not really problematic | 16:03 |
| mnasiadka | frickler: for the ansible pin - I have a feeling people will come and complain sooner or later, we don't have a mechanism for kolla-ansible CLI to tell them they have wrong version of Ansible | 16:04 |
| mnasiadka | I would prefer to do the release on time, and backport fixes instead of delaying the release | 16:05 |
| mmalchuk | mgoddard please review https://review.opendev.org/c/openstack/kayobe/+/881679 | 16:05 |
| mmalchuk | need to unblock https://review.opendev.org/q/topic:user-provided-repos-yaml | 16:07 |
| frickler | mnasiadka: hmm? the kolla-ansible does just that, doesn't it? | 16:30 |
| mnasiadka | frickler: it currently checks if your version is 2.13 or 2.14 | 16:31 |
| mnasiadka | and everything after 2.14.2 blows out with mariadb and rabbitmq | 16:31 |
| mnasiadka | well, prechecks will fail on 2.14.3 and beyond | 16:33 |
| mnasiadka | https://review.opendev.org/c/openstack/kolla-ansible/+/883525 | 16:33 |
| mnasiadka | so basically we can release | 16:34 |
| mnasiadka | but first let's get this rmq pin in | 16:34 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Change from PackageCloud.io to CloudSmith mirrors for rabbitmq/erlang https://review.opendev.org/c/openstack/kolla/+/884572 | 16:35 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Change from PackageCloud.io to CloudSmith mirrors for rabbitmq/erlang https://review.opendev.org/c/openstack/kolla/+/884572 | 16:36 |
| mnasiadka | ok, now this should pass | 16:36 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Pass through kolla inventories as is https://review.opendev.org/c/openstack/kayobe/+/802864 | 16:38 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Pass through kolla inventories as is https://review.opendev.org/c/openstack/kayobe/+/802864 | 16:40 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Pass through kolla inventories as is https://review.opendev.org/c/openstack/kayobe/+/802864 | 16:42 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Use merge_configs and merge_yaml to generate Kolla custom config https://review.opendev.org/c/openstack/kayobe/+/782749 | 16:47 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: CI: drop ceph jobs ulimit config for EL9 https://review.opendev.org/c/openstack/kolla-ansible/+/884488 | 16:53 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Change from PackageCloud.io to CloudSmith mirrors for rabbitmq/erlang https://review.opendev.org/c/openstack/kolla/+/884572 | 17:13 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: rabbitmq: ensure Ranch ETS tables are populated before draining node https://review.opendev.org/c/openstack/kolla-ansible/+/884759 | 17:45 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: rabbitmq: ensure Ranch ETS tables are populated before draining node https://review.opendev.org/c/openstack/kolla-ansible/+/884759 | 17:46 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: rabbitmq: ensure Ranch ETS tables are populated before draining node https://review.opendev.org/c/openstack/kolla-ansible/+/884759 | 17:55 |
| opendevreview | Merged openstack/kayobe stable/wallaby: Show an error when *_bridge_ports is not a list https://review.opendev.org/c/openstack/kayobe/+/884245 | 18:40 |
| opendevreview | Merged openstack/kayobe stable/xena: Show an error when *_bridge_ports is not a list https://review.opendev.org/c/openstack/kayobe/+/884244 | 19:12 |
| opendevreview | Mark Goddard proposed openstack/kayobe master: Add cached plugin https://review.opendev.org/c/openstack/kayobe/+/803064 | 19:18 |
| opendevreview | Mark Goddard proposed openstack/kayobe master: Kayobe environment dependencies https://review.opendev.org/c/openstack/kayobe/+/802865 | 19:20 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: rabbitmq: ensure Ranch ETS tables are populated before draining node https://review.opendev.org/c/openstack/kolla-ansible/+/884759 | 20:35 |
| opendevreview | Merged openstack/kayobe master: Pass through kolla inventories as is https://review.opendev.org/c/openstack/kayobe/+/802864 | 22:27 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!