opendevreview | Yamato Tanaka proposed openstack/tripleo-common stable/train: [Train only] make --timeout of ScaleDown work https://review.opendev.org/c/openstack/tripleo-common/+/852226 | 00:27 |
---|---|---|
opendevreview | Yamato Tanaka proposed openstack/tripleo-common stable/train: [Train only] make --timeout of ScaleDown work https://review.opendev.org/c/openstack/tripleo-common/+/852226 | 00:28 |
opendevreview | Masayoshi Mizuma proposed openstack/tripleo-validations master: Fix to check the result of undercloud_debug validation https://review.opendev.org/c/openstack/tripleo-validations/+/848529 | 02:51 |
*** pojadhav is now known as pojadhav|ruck | 04:22 | |
opendevreview | Yamato Tanaka proposed openstack/tripleo-common stable/train: [Train only] make --timeout of ScaleDown work https://review.opendev.org/c/openstack/tripleo-common/+/852226 | 05:30 |
*** marios is now known as marios|ruck | 05:44 | |
tkajinam | jpodivin, this one should be reported to cliff instead of tripleo IMO https://bugs.launchpad.net/tripleo/+bug/1983593 | 05:46 |
tkajinam | https://storyboard.openstack.org/#!/project/openstack/cliff | 05:47 |
tkajinam | the fix was already merged so it might be too late to fix it now | 05:47 |
tkajinam | if you report a bug to a wrong tracker then gerrit won't update its status | 05:50 |
tkajinam | gerrit/zuul | 05:50 |
*** pojadhav|ruck is now known as pojadhav|rover | 05:54 | |
*** amoralej|off is now known as amoralej | 06:13 | |
*** bhagyashris|ruck is now known as bhagyashris | 06:27 | |
opendevreview | chandan kumar proposed openstack/tripleo-common master: Include required files for tripleo-ansible-ee container https://review.opendev.org/c/openstack/tripleo-common/+/852239 | 07:17 |
*** bhagyashris_ is now known as bhagyashris | 07:39 | |
*** jpena|off is now known as jpena | 07:59 | |
opendevreview | chandan kumar proposed openstack/tripleo-common master: Add an Ansible execution environment to our Build https://review.opendev.org/c/openstack/tripleo-common/+/776674 | 08:00 |
opendevreview | Damien Ciabrini proposed openstack/tripleo-common stable/wallaby: Clustercheck healthcheck with socat and ipv6 https://review.opendev.org/c/openstack/tripleo-common/+/852098 | 08:26 |
opendevreview | Rabi Mishra proposed openstack/tripleo-heat-templates master: Fix TRIPLEO_CONFIG_HASH generation https://review.opendev.org/c/openstack/tripleo-heat-templates/+/852242 | 08:31 |
opendevreview | chandan kumar proposed openstack/tripleo-ansible master: Ship inventory as a part of tripleo_ansible package https://review.opendev.org/c/openstack/tripleo-ansible/+/847929 | 08:38 |
opendevreview | Archana Singh proposed openstack/tripleo-upgrade stable/train: Ensure fencing is correctly handled during update https://review.opendev.org/c/openstack/tripleo-upgrade/+/850967 | 09:06 |
opendevreview | chandan kumar proposed openstack/tripleo-common master: Add an Ansible execution environment to our Build https://review.opendev.org/c/openstack/tripleo-common/+/776674 | 09:19 |
opendevreview | chandan kumar proposed openstack/tripleo-common master: Add an Ansible execution environment to our Build https://review.opendev.org/c/openstack/tripleo-common/+/776674 | 09:22 |
opendevreview | chandan kumar proposed openstack/tripleo-common master: [DNM] Build tripleo-ansible-ee container https://review.opendev.org/c/openstack/tripleo-common/+/850458 | 09:44 |
opendevreview | chandan kumar proposed openstack/tripleo-common master: [DNM] Build tripleo-ansible-ee container https://review.opendev.org/c/openstack/tripleo-common/+/850458 | 10:12 |
marios|ruck | wallaby gate should be green again folks fyi https://lists.openstack.org/pipermail/openstack-discuss/2022-August/029865.html [tripleo] gate blocker - tripleo-ci-centos-9-content-provider-wallaby | 10:21 |
marios|ruck | let me or pojadhav|rover know if you see something further thank you | 10:22 |
marios|ruck | thanks amoralej++ | 10:22 |
*** rlandy|out is now known as rlandy | 10:27 | |
opendevreview | chandan kumar proposed openstack/tripleo-ci master: Move tripleo-tox-molecule job definition to base-upstream.yaml https://review.opendev.org/c/openstack/tripleo-ci/+/849856 | 10:31 |
*** frenzyfriday|rover is now known as frenzyfriday|no_longer_rover | 10:32 | |
*** frenzyfriday|no_longer_rover is now known as frenzyfriday | 10:33 | |
opendevreview | Merged openstack/puppet-tripleo stable/train: Support mariabackup as a galera SST method https://review.opendev.org/c/openstack/puppet-tripleo/+/850994 | 10:53 |
opendevreview | Merged openstack/puppet-tripleo master: Ironic: Manage [disk_utils] parameters by puppet https://review.opendev.org/c/openstack/puppet-tripleo/+/850997 | 10:53 |
opendevreview | Merged openstack/tripleo-quickstart master: Node configuration settings documentation realignment https://review.opendev.org/c/openstack/tripleo-quickstart/+/851499 | 10:53 |
*** dviroel|out is now known as dviroel | 11:14 | |
opendevreview | Martin Schuppert proposed openstack/tripleo-heat-templates master: Fix net_cidr_map in environments/deployed-network-environment.j2.yaml https://review.opendev.org/c/openstack/tripleo-heat-templates/+/852257 | 11:32 |
opendevreview | Martin Schuppert proposed openstack/tripleo-heat-templates master: Set host_routes in environments/deployed-network-environment.j2.yaml https://review.opendev.org/c/openstack/tripleo-heat-templates/+/852258 | 11:32 |
*** jpena is now known as jpena|off | 11:39 | |
opendevreview | chandan kumar proposed openstack/tripleo-common master: Add an Ansible execution environment to our Build https://review.opendev.org/c/openstack/tripleo-common/+/776674 | 11:56 |
opendevreview | chandan kumar proposed openstack/tripleo-common master: [DNM] Build tripleo-ansible-ee container https://review.opendev.org/c/openstack/tripleo-common/+/850458 | 11:57 |
shyamb | mwhahaha: ykarel: Tengu: We would like to update heat resource type names for trilio services. | 12:01 |
shyamb | Like from OS::TripleO::Services::TrilioDatamover to OS::TripleO::Services::TriliovaultDatamover | 12:02 |
shyamb | Does that breaks upgrade from old triliovault to the latest one? | 12:02 |
shyamb | How is the behaviour for any other openstack service like glance? | 12:03 |
shyamb | If it breaks upgrade, can we create some kind of aliases? | 12:03 |
opendevreview | Martin Schuppert proposed openstack/tripleo-heat-templates master: Set host_routes in environments/deployed-network-environment.j2.yaml https://review.opendev.org/c/openstack/tripleo-heat-templates/+/852258 | 12:38 |
opendevreview | Martin Schuppert proposed openstack/tripleo-heat-templates master: Add ipv6 support in environments/deployed-network-environment.j2.yaml https://review.opendev.org/c/openstack/tripleo-heat-templates/+/852267 | 13:08 |
*** amoralej is now known as amoralej|lunch | 13:26 | |
marios|ruck | Tengu: can you please check when you have time https://bugs.launchpad.net/tripleo/+bug/1983718 the firewalls bit is taking over 40 mins causing timeout | 13:50 |
marios|ruck | cc rlandy pojadhav|rover ^^ | 13:51 |
Tengu | marios|ruck: let's move to nft :) | 13:51 |
Tengu | marios|ruck: finishing some admin things, I'll check that in a few. | 13:53 |
marios|ruck | ok ship it Tengu ;) on nft... ack thanks when you next have time please add to your list thank you | 13:55 |
marios|ruck | Tengu: did we already wire it up in some jobs ? | 13:56 |
Tengu | marios|ruck: it's still WIP, but we're close to an overall success with ysandeep|PTO. | 13:57 |
Tengu | marios|ruck: basically, we've tested different jobs, and analysed the DROPped packets to see if they were legitimate or not, and added/updated some rules in order to make it better. | 13:57 |
Tengu | while the rule updates are now in, I don't see any reason for that to change the time taken to apply the rules with iptables. Most of the changes were related to the "state" parameter of the rule, so nothing really terrible. | 13:58 |
marios|ruck | k thanks Tengu | 13:58 |
Tengu | there's also a small change in the tripleo_iptables action plugin, allowing to filter out nftables dedicated rules, but here, it's pure python, basically removing dict entries based on the key name (if it startswith(nft_)) | 13:59 |
opendevreview | Jiri Podivin proposed openstack/tripleo-heat-templates master: DNM Force chrony sources online https://review.opendev.org/c/openstack/tripleo-heat-templates/+/852270 | 13:59 |
Tengu | so again, I really don't think THIS has any actual impact on the perfs. | 13:59 |
*** amoralej|lunch is now known as amoralej | 14:00 | |
opendevreview | Jiri Podivin proposed openstack/tripleo-heat-templates master: Use tripleo_mysql_client standalone ansible role https://review.opendev.org/c/openstack/tripleo-heat-templates/+/840322 | 14:01 |
opendevreview | Jiri Podivin proposed openstack/tripleo-heat-templates master: Use standalone playbooks from tripleo-ansible https://review.opendev.org/c/openstack/tripleo-heat-templates/+/840510 | 14:01 |
opendevreview | Jiri Podivin proposed openstack/tripleo-heat-templates master: Use standalone bootstrap playbook from tripleo-ansible https://review.opendev.org/c/openstack/tripleo-heat-templates/+/840674 | 14:01 |
opendevreview | Jiri Podivin proposed openstack/tripleo-heat-templates master: Move some tripleo_podman tasks to ansible role https://review.opendev.org/c/openstack/tripleo-heat-templates/+/842005 | 14:01 |
opendevreview | Jiri Podivin proposed openstack/tripleo-heat-templates master: Use tripleo_logrotate_crond standalone ansible role https://review.opendev.org/c/openstack/tripleo-heat-templates/+/842006 | 14:01 |
opendevreview | Jiri Podivin proposed openstack/tripleo-heat-templates master: Updates for chrony role https://review.opendev.org/c/openstack/tripleo-heat-templates/+/842439 | 14:01 |
Tengu | marios|ruck: wow... err... the system logs are scary actually.... we can see how slow the rule application is. | 14:13 |
Tengu | marios|ruck: if you check https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-scenario001-standalone-master/2a01470/logs/undercloud/var/log/extra/journal.txt.gz | 14:13 |
marios|ruck | looking | 14:13 |
Tengu | marios|ruck: looking for ansible-ansible.builtin.iptables - first one: 17:37:31 - last one 18:19:39 | 14:13 |
Tengu | but we can also see A LOT of things in-between | 14:14 |
marios|ruck | Tengu: yeah i see | 14:14 |
marios|ruck | Tengu: well its like 43 mins in both cases, last 2 runs | 14:14 |
marios|ruck | don't think its a transient thing | 14:14 |
marios|ruck | thanks for looking | 14:14 |
Tengu | weird... I really don't see what could cause this. | 14:14 |
marios|ruck | its already late i know but any info you add will be helpful | 14:14 |
marios|ruck | worst case we will pickup monday, master is out 4 days now ... would be nice to promote today but that clearly not gonna happen so | 14:15 |
marios|ruck | next week it is... | 14:15 |
*** dasm|off is now known as dasm | 14:23 | |
Tengu | marios|ruck: added a comment with what I changed in the tripleo-ansible related roles. | 14:23 |
Tengu | though I'm pretty sure none of the changes are at fault... | 14:23 |
Tengu | buuuttt.... we can see "zuul" is connecting multiple times via SSH between rule application. | 14:25 |
Tengu | it reminds me of the behavior we had when cloudnull dropped some of the ansible configuration back then. The changed was locking us out of the OC because ansible was disconnecting during the rule application, before the last one was inserted (the one allowing ssh...). | 14:26 |
Tengu | maybe it's something like that again? | 14:26 |
Tengu | marios|ruck: added one more comment with some more digging. | 14:32 |
Tengu | imho, it's not directly tripleo_iptables/tripleo_firewall. | 14:32 |
Tengu | marios|ruck: we can pair next week if you want? for now... I have to leave, I'm melting on my chair, and am not in shape to do more debugging... | 14:33 |
marios|ruck | thank you Tengu | 14:46 |
marios|ruck | enjoy your weekend o/ | 14:46 |
marios|ruck | Tengu: apologies i was chasing some train issue | 14:47 |
marios|ruck | Tengu: will check | 14:47 |
opendevreview | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/wallaby: WIP: FFWD3: container-tools will probably have to be bumped to latest https://review.opendev.org/c/openstack/tripleo-heat-templates/+/852273 | 14:53 |
*** dviroel is now known as dviroel|lunch | 15:26 | |
*** pojadhav|rover is now known as pojadhav|out | 15:34 | |
*** marios|ruck is now known as marios|out | 15:52 | |
*** amoralej is now known as amoralej|off | 16:10 | |
opendevreview | Merged openstack/tripleo-ansible stable/wallaby: [wallaby-only] Ability to skip create_ceph_ansible_remote_tmp command https://review.opendev.org/c/openstack/tripleo-ansible/+/849278 | 16:24 |
*** dviroel|lunch is now known as dviroel | 16:30 | |
opendevreview | Merged openstack/tripleo-ci master: Add new fips jobs and create template for periodic https://review.opendev.org/c/openstack/tripleo-ci/+/850689 | 16:53 |
opendevreview | Merged openstack/python-tripleoclient master: Removing TODO lacking sufficient description https://review.opendev.org/c/openstack/python-tripleoclient/+/850748 | 19:23 |
opendevreview | Merged openstack/python-tripleoclient master: Removing Popen object return from utils.run_command_and_log https://review.opendev.org/c/openstack/python-tripleoclient/+/850749 | 19:23 |
*** dviroel is now known as dviroel|brb | 19:40 | |
*** dviroel|brb is now known as dviroel | 20:56 | |
*** dviroel is now known as dviroel|out | 21:12 | |
*** dasm is now known as dasm|off | 22:01 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!