| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server master: Add molecule testing to the role https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/939902 | 08:01 |
|---|---|---|
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Add jmespath to test-requirements https://review.opendev.org/c/openstack/openstack-ansible/+/939824 | 08:30 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Add multi-AZ deployment configuration sample https://review.opendev.org/c/openstack/openstack-ansible/+/939609 | 08:33 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Add multi-AZ deployment configuration sample https://review.opendev.org/c/openstack/openstack-ansible/+/939609 | 08:34 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2023.1: Remove ansible-role-qdrouterd from zuul required-projects https://review.opendev.org/c/openstack/openstack-ansible/+/939941 | 08:35 |
| jrosser | ^ is that possible with the branch renamed? | 08:38 |
| noonedeadpunk | it is not yet | 08:38 |
| jrosser | for the roles, sorry | 08:38 |
| noonedeadpunk | for tests repo - yeah, we need | 08:39 |
| noonedeadpunk | crap.... | 08:52 |
| noonedeadpunk | https://opendev.org/openstack/openstack-ansible/blame/branch/stable/2023.1/inventory/group_vars/swift_all/source_git.yml | 08:52 |
| noonedeadpunk | seems swift on 2023.1 was always on master.... | 08:52 |
| jrosser | ewwww | 09:08 |
| jrosser | i guess its difficult to spot that one has been missed now those are all in different files | 09:13 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2023.1: Swith roles/services to 2023.1-eom tag https://review.opendev.org/c/openstack/openstack-ansible/+/939944 | 09:36 |
| opendevreview | Merged openstack/ansible-role-uwsgi unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/ansible-role-uwsgi/+/939836 | 10:51 |
| opendevreview | Merged openstack/openstack-ansible-rabbitmq_server unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/939892 | 10:52 |
| opendevreview | Merged openstack/openstack-ansible-haproxy_server unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/939843 | 10:52 |
| opendevreview | Merged openstack/openstack-ansible-os_adjutant unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/939850 | 10:53 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible version to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939949 | 10:53 |
| opendevreview | Merged openstack/ansible-role-zookeeper unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/ansible-role-zookeeper/+/939837 | 10:53 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Update ssh connection plugin paramters to match upstream https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/939899 | 10:53 |
| opendevreview | Merged openstack/openstack-ansible-openstack_hosts unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/939847 | 10:55 |
| opendevreview | Merged openstack/ansible-hardening unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/ansible-hardening/+/939838 | 10:57 |
| opendevreview | Merged openstack/openstack-ansible-os_ceilometer unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/939855 | 10:59 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2023.1: Swith roles/services to 2023.1-eom tag https://review.opendev.org/c/openstack/openstack-ansible/+/939944 | 11:01 |
| opendevreview | Merged openstack/ansible-role-systemd_mount unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/ansible-role-systemd_mount/+/939833 | 11:03 |
| opendevreview | Merged openstack/ansible-role-systemd_service unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/ansible-role-systemd_service/+/939835 | 11:05 |
| opendevreview | Merged openstack/openstack-ansible-os_octavia unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/939879 | 11:07 |
| opendevreview | Merged openstack/openstack-ansible-os_cloudkitty unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/939858 | 11:09 |
| opendevreview | Merged openstack/ansible-role-systemd_networkd unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/939834 | 11:09 |
| opendevreview | Merged openstack/openstack-ansible-ceph_client unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/939840 | 11:10 |
| opendevreview | Merged openstack/openstack-ansible-os_cinder unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/939857 | 11:11 |
| opendevreview | Merged openstack/openstack-ansible-memcached_server unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-memcached_server/+/939846 | 11:11 |
| opendevreview | Merged openstack/openstack-ansible-lxc_container_create unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-lxc_container_create/+/939844 | 11:12 |
| opendevreview | Merged openstack/openstack-ansible-os_glance unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/939860 | 11:14 |
| opendevreview | Merged openstack/openstack-ansible-tests unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939894 | 11:20 |
| opendevreview | Merged openstack/ansible-role-qdrouterd unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/ansible-role-qdrouterd/+/939830 | 11:25 |
| opendevreview | Merged openstack/openstack-ansible-openstack_openrc unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-openstack_openrc/+/939848 | 11:25 |
| noonedeadpunk | and also it's quite easy to miss it | 11:26 |
| opendevreview | Merged openstack/openstack-ansible-os_mistral unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_mistral/+/939875 | 11:27 |
| opendevreview | Merged openstack/openstack-ansible-os_aodh unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_aodh/+/939851 | 11:27 |
| opendevreview | Merged openstack/openstack-ansible-os_zun unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/939889 | 11:27 |
| noonedeadpunk | probably we can evolve shatest to verify swift_git_track_branch against current zuul_branch or smth... | 11:27 |
| opendevreview | Merged openstack/openstack-ansible-os_barbican unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_barbican/+/939853 | 11:27 |
| opendevreview | Merged openstack/openstack-ansible-os_manila unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_manila/+/939871 | 11:27 |
| opendevreview | Merged openstack/openstack-ansible-os_tacker unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_tacker/+/939884 | 11:28 |
| opendevreview | Merged openstack/openstack-ansible-os_keystone unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/939868 | 11:28 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server master: Add molecule testing to the role https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/939902 | 11:28 |
| birbilakos | hello, I just did a fresh install of 2024.2 OSA and hit this error: | 11:29 |
| opendevreview | Merged openstack/openstack-ansible-os_blazar unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_blazar/+/939854 | 11:29 |
| birbilakos | fatal: [infra1-galera-container-90b5793f]: FAILED! => {"changed": false, "msg": "Please set the galera_root_password variable prior to applying the\ngalera role.\n"} | 11:29 |
| noonedeadpunk | birbilakos: have you populated user_secrets.yml? | 11:29 |
| opendevreview | Merged openstack/openstack-ansible-os_designate unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_designate/+/939859 | 11:29 |
| opendevreview | Merged openstack/openstack-ansible-os_horizon unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/939865 | 11:29 |
| opendevreview | Merged openstack/openstack-ansible-os_tempest unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/939886 | 11:30 |
| opendevreview | Merged openstack/openstack-ansible-lxc_hosts unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/939845 | 11:31 |
| opendevreview | Merged openstack/openstack-ansible-galera_server unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/939842 | 11:31 |
| opendevreview | Merged openstack/openstack-ansible-os_octavia unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/939880 | 11:31 |
| opendevreview | Merged openstack/openstack-ansible-os_horizon unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/939866 | 11:31 |
| opendevreview | Merged openstack/openstack-ansible-os_swift unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/939883 | 11:31 |
| opendevreview | Merged openstack/openstack-ansible-os_manila unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_manila/+/939872 | 11:31 |
| opendevreview | Merged openstack/openstack-ansible-os_trove unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/939887 | 11:32 |
| opendevreview | Merged openstack/openstack-ansible-plugins unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/939891 | 11:32 |
| opendevreview | Merged openstack/openstack-ansible-os_nova unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/939878 | 11:32 |
| opendevreview | Merged openstack/openstack-ansible-os_heat unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_heat/+/939864 | 11:33 |
| opendevreview | Merged openstack/openstack-ansible-os_zun unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/939890 | 11:33 |
| opendevreview | Merged openstack/openstack-ansible-ceph_client unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/939841 | 11:33 |
| opendevreview | Merged openstack/ansible-role-pki unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/ansible-role-pki/+/939831 | 11:33 |
| opendevreview | Merged openstack/openstack-ansible-os_masakari unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/939873 | 11:34 |
| opendevreview | Merged openstack/openstack-ansible-os_trove unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/939888 | 11:34 |
| opendevreview | Merged openstack/openstack-ansible-os_magnum unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/939869 | 11:34 |
| birbilakos | totally forgot about the user secrets - that's embarasing... | 11:34 |
| opendevreview | Merged openstack/openstack-ansible-os_rally unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_rally/+/939882 | 11:34 |
| opendevreview | Merged openstack/openstack-ansible-os_gnocchi unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/939862 | 11:35 |
| opendevreview | Merged openstack/openstack-ansible-os_tacker unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_tacker/+/939885 | 11:35 |
| opendevreview | Merged openstack/openstack-ansible-os_neutron unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/939876 | 11:35 |
| opendevreview | Merged openstack/openstack-ansible-os_neutron unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/939877 | 11:35 |
| opendevreview | Merged openstack/openstack-ansible-os_magnum unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/939870 | 11:35 |
| opendevreview | Merged openstack/openstack-ansible-repo_server unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-repo_server/+/939893 | 11:35 |
| opendevreview | Merged openstack/openstack-ansible-os_ironic unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/939867 | 11:36 |
| opendevreview | Merged openstack/openstack-ansible-os_ceilometer unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/939856 | 11:36 |
| opendevreview | Merged openstack/openstack-ansible-os_glance unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/939861 | 11:40 |
| opendevreview | Merged openstack/ansible-role-python_venv_build unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/939832 | 11:40 |
| opendevreview | Merged openstack/openstack-ansible-apt_package_pinning unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-apt_package_pinning/+/939839 | 11:40 |
| opendevreview | Merged openstack/openstack-ansible-os_gnocchi unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/939863 | 11:40 |
| opendevreview | Merged openstack/openstack-ansible-os_placement unmaintained/2023.1: Update .gitreview for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_placement/+/939881 | 11:45 |
| birbilakos | next issue is the following: TASK [Get list of repo packages] ******************************************************************************************************************************************************************************************************************************************************* fatal: [infra1-utility-container-4a33b0a1]: FAILED! => {"changed": false, "content": "", "elapsed": 3, "msg": "Status code was -1 and | 11:45 |
| birbilakos | 172.29.236.254 is my internal_lb_vip_address which I have also added in the used_ips | 11:46 |
| birbilakos | used_ips: - "172.29.236.254,172.29.236.200" - "172.29.240.254,172.29.240.200" - "172.29.244.254,172.29.244.200" global_overrides: cidr_networks: *cidr_networks internal_lb_vip_address: 172.29.236.254 external_lb_vip_address: 10.222.55.254 management_bridge: br-mgmt tunnel_bridge: br-vxlan | 11:46 |
| noonedeadpunk | well, I don't see error as IRC cut content | 11:47 |
| birbilakos | fatal: [infra1-utility-container-4a33b0a1]: FAILED! => {"changed": false, "content": "", "elapsed": 3, "msg": "Status code was -1 and not [200]: Request failed: <urlopen error [Errno 113] No route to host>", "redirected": false, "status": -1, "url": "http://172.29.236.254:8181/constraints/upper_constraints_cached.txt"} | 11:47 |
| noonedeadpunk | but I assume it's on upper-constrainst fetch | 11:47 |
| noonedeadpunk | yes | 11:47 |
| noonedeadpunk | ok, so then you pretty much need to check br-mgmt wiring :) | 11:47 |
| noonedeadpunk | and ensure that keepalived has announced an IP on the interface | 11:48 |
| noonedeadpunk | as that's IP is assumed to be VIP added to interface by keepalived | 11:48 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server master: Add molecule testing to the role https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/939902 | 11:49 |
| birbilakos | strange, I don't see keepalived running in my one controller node | 11:51 |
| noonedeadpunk | on any or only on single one? | 11:51 |
| noonedeadpunk | as if it's present and running on others - that shouldn't be an issue | 11:52 |
| birbilakos | i only have one controller - this is a small lab | 11:52 |
| birbilakos | looks like keepalived is not even installed | 11:53 |
| noonedeadpunk | ah | 11:53 |
| noonedeadpunk | yes, it is not installed then | 11:53 |
| noonedeadpunk | there's logic to install it only when having >1 controllers | 11:53 |
| noonedeadpunk | unless you say explicitly to do so | 11:54 |
| birbilakos | aha | 11:54 |
| birbilakos | how do I overcome this then? | 11:54 |
| opendevreview | Merged openstack/openstack-ansible-os_aodh unmaintained/2023.1: Update TOX_CONSTRAINTS_FILE for unmaintained/2023.1 https://review.opendev.org/c/openstack/openstack-ansible-os_aodh/+/939852 | 11:54 |
| noonedeadpunk | so you can set haproxy_use_keepalived: true to install keepalived anyway | 11:54 |
| noonedeadpunk | or, you jsut add VIPs (internal and external) as aliases to interfaces on your own | 11:55 |
| noonedeadpunk | ike with netplan or whatever | 11:55 |
| birbilakos | haproxy_use_keepalived: true seems to be working | 11:56 |
| birbilakos | but yea it's an overkill :) | 11:56 |
| noonedeadpunk | I guess depends on your plans for the environemnt | 11:57 |
| birbilakos | btw, is it possible to use the same node both as a controler and compute ? | 11:57 |
| noonedeadpunk | yup, why not | 11:57 |
| birbilakos | or are there going to be any conficts.. | 11:57 |
| noonedeadpunk | if you have enough resources on it :) | 11:57 |
| noonedeadpunk | just make sure to reserve good chunk of ram/cpus in nova.conf | 11:57 |
| noonedeadpunk | and probably reduce amount of workers/threads for services | 11:58 |
| noonedeadpunk | but other then fighting for resources - it should be fine | 12:01 |
| birbilakos | strangely, this failed again: TASK [Get list of repo packages] ******************************************************************************************************************************************************************************************************************************************************* fatal: [infra1-utility-container-4a33b0a1]: FAILED! => {"changed": false, "content": "", "elapsed": 0, "msg": "Status code was -1 an | 12:01 |
| birbilakos | even though keepalived got installed and is running this time | 12:01 |
| noonedeadpunk | and assigned expected ip on expected interface? | 12:02 |
| noonedeadpunk | I don't see error though | 12:02 |
| noonedeadpunk | is it same "No route to host"? | 12:02 |
| birbilakos | I see the ipterface having the ip assigned | 12:03 |
| birbilakos | $ wget http://172.29.236.254:8181/constraints/upper_constraints_cached.txt --2025-01-23 12:01:01-- http://172.29.236.254:8181/constraints/upper_constraints_cached.txt Connecting to 172.29.236.254:8181... failed: Connection refused. | 12:03 |
| noonedeadpunk | and haproxy is listening on it? | 12:03 |
| birbilakos | looks like it | 12:05 |
| birbilakos | I see it configured in it's config and the process is running | 12:05 |
| noonedeadpunk | and you've completed repo_server playbook without issues? | 12:06 |
| birbilakos | nothing is listening on 8181 it seems | 12:06 |
| noonedeadpunk | I wonder if we have some logic which would prevent repo from deployment in this usecase... | 12:07 |
| birbilakos | how do I check the repo_server playbook output? | 12:07 |
| noonedeadpunk | you can try smth cat /openstack/log/ansible-logging/ansible.log | grep repo_server -C 3 | 12:08 |
| noonedeadpunk | or just run it again :D | 12:08 |
| birbilakos | don't see any error in the log for repo_server | 12:10 |
| noonedeadpunk | do you see anything actually executed? | 12:10 |
| birbilakos | yes, there are references | 12:10 |
| noonedeadpunk | can you paste it? | 12:10 |
| birbilakos | yes, sec | 12:10 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Automatically import ssh connection plugin options from the base class https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/939957 | 12:12 |
| birbilakos | https://drive.google.com/file/d/1GAj1UPARkVIUHvReiIvF-AFsiKmRabFs/view?usp=sharing | 12:14 |
| jrosser | paste.opendev.org :) | 12:14 |
| noonedeadpunk | yeah.... | 12:14 |
| birbilakos | it won't take the full log :( | 12:15 |
| noonedeadpunk | ok, yeah, you included full log | 12:15 |
| noonedeadpunk | so, it looks like haproxy is actually configured | 12:15 |
| jrosser | you can check with netstat for what ports are being listened on | 12:16 |
| birbilakos | k | 12:16 |
| noonedeadpunk | as "'haproxy_service_name': 'repo_all', 'haproxy_backend_nodes': ['infra1-repo-container-f20c051f']" is changed | 12:16 |
| jrosser | thats a good step if you get connection refused | 12:16 |
| noonedeadpunk | so it should work | 12:16 |
| noonedeadpunk | or `ss -nlp` | 12:16 |
| noonedeadpunk | as I think you should have /etc/haproxy/conf.d/repo_all and then this content is also present in /etc/haproxy/haproxy.cfg | 12:20 |
| birbilakos | found this in the haproxy logs: https://paste.opendev.org/show/be5H5xNYBn0hsEF0W5Kv/ | 12:21 |
| noonedeadpunk | um | 12:21 |
| noonedeadpunk | it's weird | 12:22 |
| birbilakos | i can see the files that you mention | 12:22 |
| noonedeadpunk | as haproxy should be having sysctl setting to allow it binding everywhere | 12:22 |
| jrosser | you have different IP for internal and external endpoints? | 12:22 |
| birbilakos | I restarted haproxy and got some progress | 12:22 |
| birbilakos | https://paste.opendev.org/show/b7USQsGu8PE4Oc9m6bkY/ | 12:23 |
| birbilakos | should I retry the playbook? | 12:23 |
| noonedeadpunk | oh | 12:23 |
| noonedeadpunk | add also `haproxy_bind_on_non_local: true` :) | 12:23 |
| noonedeadpunk | it's same logic as avoids keepalived isntallation | 12:23 |
| noonedeadpunk | literally 2 lines: https://opendev.org/openstack/openstack-ansible/src/branch/master/inventory/group_vars/haproxy/haproxy.yml#L16-L17 | 12:24 |
| birbilakos | but the ip is local | 12:25 |
| birbilakos | so shouldn't be needed right? | 12:25 |
| noonedeadpunk | well, it's "not really" with keepalived | 12:25 |
| birbilakos | ok | 12:26 |
| noonedeadpunk | as then you don't want to have strict ordering dependency on keepalived/haproxy startup | 12:26 |
| noonedeadpunk | it would be local if you added it as alias to interface directly :) | 12:26 |
| birbilakos | got it | 12:26 |
| birbilakos | Trrying with both of these set now.. | 12:27 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Automatically import ssh connection plugin options from the base class https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/939957 | 12:27 |
| birbilakos | playbook openstack.osa.setup_infrastructure completed successfully! | 12:36 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server master: Add molecule testing to the role https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/939902 | 12:49 |
| noonedeadpunk | fun one: https://opendev.org/openstack/openstack-ansible-rabbitmq_server/src/commit/b09ac39cbca11f7a5a14731e583246fe6a6c420e/tasks/rabbitmq_pre_install.yml#L82-L83 | 12:50 |
| andrewbonney | Ha, oops | 12:56 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible version to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939949 | 13:31 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update host python installation to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939963 | 13:31 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update host python installation to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939963 | 13:43 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible version to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939949 | 13:43 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update host python installation to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939963 | 13:48 |
| jrosser | noonedeadpunk: i think that the nfs module in ceph-mgr requires it to be using cephadm to spin up the ganesha containers in the ceph nodes? | 13:51 |
| jrosser | https://docs.ceph.com/en/quincy/mgr/nfs/ | 13:55 |
| jrosser | also more reason to deprecate the tests repo, it's using pip to install things into the host python which we wont be able to do on noble | 13:59 |
| noonedeadpunk | one things about tests repo - is that we have a sync script there | 14:02 |
| noonedeadpunk | which we probably don't need... | 14:02 |
| noonedeadpunk | but | 14:02 |
| noonedeadpunk | I start thinking if we can use that approach to sync requirement versions | 14:03 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible version to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939949 | 14:03 |
| noonedeadpunk | https://opendev.org/openstack/openstack-ansible-tests/src/branch/master/sync-test-repos.sh | 14:04 |
| jrosser | and idea what might be breaking here on centos? https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/939898/4?tab=change-view-tab-header-zuul-results-summary | 14:05 |
| noonedeadpunk | just a crazy idea, but.. absence of sudo? | 14:06 |
| noonedeadpunk | as I can recall rocky/centos being different about that | 14:06 |
| jrosser | hmm | 14:06 |
| noonedeadpunk | (like oob images) | 14:07 |
| jrosser | let me just try again locally | 14:07 |
| noonedeadpunk | or some other basic binary... | 14:08 |
| noonedeadpunk | but yeah, not sure | 14:09 |
| noonedeadpunk | just usually when rocky works and centos not - it's smth really stupid going on | 14:09 |
| noonedeadpunk | as what I don't like about the output, is `Connection closed by 10.1.0.100 port 22`. which assumes that it was established, but kinda of broken/finished unexpected | 14:14 |
| jrosser | rather unhelpfully it is working locally | 14:14 |
| noonedeadpunk | huh | 14:14 |
| noonedeadpunk | ok, let me try that | 14:14 |
| noonedeadpunk | oh, wow, tox doesn't behave as I'd expect... | 14:17 |
| noonedeadpunk | why does it install role requirements in to roles folder? | 14:18 |
| noonedeadpunk | but I also can't reproduce fwiw | 14:18 |
| noonedeadpunk | recheck? | 14:20 |
| noonedeadpunk | ah, already | 14:20 |
| noonedeadpunk | then only hold I guess | 14:21 |
| noonedeadpunk | or at least try to add verbosity | 14:21 |
| noonedeadpunk | but why does it install roles inside of the repo rather then temp location like always | 14:24 |
| jrosser | oh that is odd isnt it | 14:51 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update host python installation to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939963 | 15:08 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible version to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939949 | 15:08 |
| birbilakos | team, isn't skyline by default the UI of 2024.2? | 15:14 |
| birbilakos | seems like not in my deployment - I used branch 30.0.0 as per the instructions here: https://docs.openstack.org/project-deploy-guide/openstack-ansible/2024.2/deploymenthost.html | 15:15 |
| birbilakos | noonedeadpunk: seems like with a fresh install (and one controller node) doesn't have files under /etc/neutron so neutron-l3-agent and neutron-metadata-agent are crashing | 15:28 |
| birbilakos | so basically only the ovs agent got deployed. No L3, dhcp or metering agents, even though they are defined in my config | 15:57 |
| noonedeadpunk | birbilakos: skyline is not default. it's, as everything, depend on your generated inventory | 15:59 |
| birbilakos | no errors in the playbooks. Just run openstack.osa.neutron | 15:59 |
| birbilakos | skyline is the least of my issues :) | 15:59 |
| noonedeadpunk | so if you have not defined `skyline_dashboard_hosts` - it won't be installed | 15:59 |
| noonedeadpunk | have you defined `neutron_plugin_type: 'ml2.ovs'` ? | 16:01 |
| noonedeadpunk | as default is ovn, not ovs | 16:01 |
| noonedeadpunk | so just double-checking what you're trying to do | 16:01 |
| noonedeadpunk | as with ovn neutron-l3-agent should not even exist, for instance | 16:02 |
| noonedeadpunk | but missing /etc/neutron usually tells that venv build has failed.... | 16:04 |
| birbilakos | neutron_plugin_type: ml2.ovs neutron_ml2_drivers_type: "flat,vlan,vxlan" neutron_plugin_base: - router - metering | 16:11 |
| birbilakos | yes, I'm using ovs - same config as in my other clouds | 16:12 |
| birbilakos | only difference here is that I have 1 controller/network node | 16:12 |
| noonedeadpunk | ok, yes, just checking, you know | 16:12 |
| birbilakos | ofc :) | 16:12 |
| birbilakos | seems like the servces are installed | 16:13 |
| birbilakos | its just the /etc/neutron folder missing in the controller | 16:13 |
| noonedeadpunk | so /etc/neutron is a symlink from venv | 16:13 |
| noonedeadpunk | which is created via handler as a last step | 16:13 |
| birbilakos | https://paste.opendev.org/show/bjH0Z60udZb0gWzfrIjo/ | 16:14 |
| noonedeadpunk | try running `openstack-ansible os-neutron-install.yml -e venv_rebuild=true` | 16:14 |
| noonedeadpunk | also you can check for presence of /openstack/venvs/neutron-30.0.0/etc folder | 16:14 |
| birbilakos | failed quickly at: openstack-ansible os-neutron-install.yml -e venv_rebuild=true | 16:16 |
| birbilakos | https://paste.opendev.org/show/bXo3TWz5OZL1iGOv72Fq/ | 16:16 |
| jrosser | NeilHanlon: are you around? | 16:16 |
| birbilakos | this /openstack/venvs/neutron-30.0.0/etc/neutron/ exists | 16:17 |
| noonedeadpunk | wait, what | 16:18 |
| birbilakos | apologies, I forgot to sudo in the playbook before | 16:18 |
| birbilakos | running again now | 16:18 |
| birbilakos | btw, these agents are supposed to be bare metal, right? | 16:21 |
| noonedeadpunk | yeah | 16:21 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update host python installation to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939963 | 16:27 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible version to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939949 | 16:32 |
| birbilakos | noonedeadpunk: once again, you saved the day. venv_rebuild did the trick | 16:38 |
| jrosser | birbilakos: having some test environment where you can rinse/repeat this over and over is very useful | 16:40 |
| jrosser | then also being able to practice upgrades in a low risk way is very handy as well | 16:40 |
| birbilakos | absolutely - this is my plan | 16:42 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update host python installation to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939963 | 16:45 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible version to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939949 | 16:45 |
| birbilakos | trying skyline playbook now,(os-skyline-install.yml) fails with this error: | 16:45 |
| birbilakos | https://paste.opendev.org/show/bsojuHBYfB2tHQBWO1Ad/ | 16:46 |
| noonedeadpunk | birbilakos: have you spawned a container for it? | 16:46 |
| noonedeadpunk | as you need to run openstack-ansible lxc-container-create.yml --limit skyline_all,lxc_hosts | 16:47 |
| noonedeadpunk | before running os-skyline | 16:47 |
| birbilakos | yes yes | 16:47 |
| birbilakos | forgot it, of course | 16:47 |
| noonedeadpunk | and potenitally haproxy-server as well | 16:47 |
| noonedeadpunk | as you'd need to re-configre base service (potentially) | 16:48 |
| jrosser | yes there is some decision to make if you already deployed horizon | 16:48 |
| jrosser | did we default skyline to port 443 if horizon is absent? | 16:48 |
| birbilakos | looks like it still defaults to horizon | 16:57 |
| birbilakos | even after running playbooks/haproxy-install.yml | 16:58 |
| noonedeadpunk | so both are on 443 | 16:58 |
| noonedeadpunk | just horizon moved to /horizon | 16:58 |
| noonedeadpunk | if both are deployed | 16:59 |
| noonedeadpunk | and skyline is on / | 16:59 |
| birbilakos | doesn't seem like it | 17:00 |
| birbilakos | hitting the vip, I just get the horizon interface | 17:01 |
| birbilakos | i can see the backend of skyline in haproxy.cfg | 17:01 |
| NeilHanlon | jrosser: sorry i missed that. yeah i'm around now | 17:04 |
| birbilakos | see this also in the config: use_backend %[path,map_reg(/etc/haproxy/base_regex.map)] | 17:04 |
| jrosser | NeilHanlon: i was wondering if you have an idea about how wrong or right this is https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939963/6/run_tests_common.sh | 17:05 |
| jrosser | the use of `alternatives` specifically | 17:05 |
| birbilakos | looks like base_regex.map had: / horizon-back / skyline-back | 17:05 |
| birbilakos | commenting out the horizon-back line does the trick | 17:05 |
| birbilakos | strangely, skyline is in chinese! | 17:06 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update host python installation to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939963 | 17:13 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible version to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939949 | 17:13 |
| noonedeadpunk | birbilakos: well. it is :D | 17:22 |
| noonedeadpunk | you can change language in there | 17:22 |
| noonedeadpunk | but yeah - default is chineese as it's developed by chinese companies | 17:22 |
| NeilHanlon | jrosser: looks good aside the one comment I added. alternatives use is normal for managing multiple pythons, sadly | 17:30 |
| jrosser | excellent thankyou | 17:32 |
| jrosser | there si some difference with alternatives between 8 and 9 becasue the --install step was not needed bfore | 17:32 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update host python installation to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939963 | 17:35 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible version to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939949 | 17:35 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update host python installation to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939963 | 17:36 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible version to match integrated repo https://review.opendev.org/c/openstack/openstack-ansible-tests/+/939949 | 17:36 |
| jrosser | ^ noonedeadpunk all this tests repo work is so that we can have the functional and molecule jobs in parallel, before getting rid of the functional ones | 17:37 |
| jrosser | unfortunately getting the molecule ones working means fixing the connection plugin, and that in turn needs to functional tests to work to validate that | 17:37 |
| birbilakos | strangely 2024.2 skyline does not allow you to not boot from volume? This menu doesn't appear to exist any more? https://pasteboard.co/BUTEEFDu5AoU.png | 18:55 |
| jrosser | birbilakos: so it’s either a bug in skyline or some missing config in the newer version that tells it that’s possible, or it fails somehow to auto detect it | 18:58 |
| jrosser | but really you need to dig into the skyline code for that rather than osa | 18:59 |
| *** tosky_ is now known as tosky | 21:41 | |
| -opendevstatus- NOTICE: The Gerrit service on review.opendev.org will be offline momentarily while we reboot for a patch version upgrade of the software, but should return again within a few minutes | 22:44 | |
| *** promethe- is now known as prometheanfire | 23:25 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!
