| yoctozepto | welcome to new gerrit | 06:37 |
|---|---|---|
| yoctozepto | new week, new gerrit | 06:37 |
| jeeva | my kolla openstack deploy fails with - FAILED! => {"action": "mysql_user", "changed": false, "msg": "invalid privileges string: Invalid privileges specified: frozenset({'REPLICATION CLIENT'})"} | 06:39 |
| jeeva | just finding some old reference from 2015 about how ansible handles mysql module | 06:39 |
| yoctozepto | jeeva: which branch? which image distro? | 06:44 |
| *** amoralej|off is now known as amoralej | 07:00 | |
| jeeva | i have nothing in openstack_Release so i assume the latest ? | 07:01 |
| jeeva | with ubuntu 18 | 07:16 |
| jeeva | 12.1.0.dev367 | 07:16 |
| jeeva | kolla 12.1.0.dev202 | 07:16 |
| jeeva | kolla-ansible 12.1.0.dev367 | 07:16 |
| jeeva | yoctozepto,^ | 07:32 |
| mnasiadka | morning | 07:50 |
| mnasiadka | I guess that's master - to be Xena | 07:50 |
| yoctozepto | yeah, that seems so | 07:51 |
| yoctozepto | and ubuntu 18 is not supported nowadays either | 07:52 |
| mnasiadka | why isn't it failing on prechecks? | 07:52 |
| jeeva | i had the same issue with unbuntu 20 | 07:54 |
| jeeva | reason why im trying ubuntu 18 now (since our production cluster is running ussuri + ubuntu 18) so i know that works | 07:55 |
| opendevreview | Boxiang Zhu proposed openstack/kolla master: Skyline: Add skyline dockerfile https://review.opendev.org/c/openstack/kolla/+/810796 | 08:38 |
| opendevreview | Boxiang Zhu proposed openstack/kolla master: Skyline: Add skyline dockerfile https://review.opendev.org/c/openstack/kolla/+/810796 | 09:17 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Tidy up renos before Xena release https://review.opendev.org/c/openstack/kolla/+/812723 | 09:24 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: Add api_workers for each service to defaults https://review.opendev.org/c/openstack/kolla-ansible/+/813193 | 09:29 |
| osmanlicilegi | morning | 09:37 |
| mgoddard | hi osmanlicilegi | 09:40 |
| kevko | morning \o/ | 09:41 |
| osmanlicilegi | long time no see. I'm having crazy times. hoping everything goes well with the koalas :] | 09:49 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: Trivial but necessary fix - loadbalancer weight https://review.opendev.org/c/openstack/kolla-ansible/+/813403 | 10:03 |
| opendevreview | Boxiang Zhu proposed openstack/kolla master: Skyline: Add skyline dockerfile https://review.opendev.org/c/openstack/kolla/+/810796 | 10:08 |
| yoctozepto | osmanlicilegi: :-) crazy here too as well; good to see you around | 10:08 |
| yoctozepto | (proof that it's really crazy; I said both "too" and "as well" lol) | 10:09 |
| osmanlicilegi | :] | 10:12 |
| mgoddard | osmanlicilegi: will you make the PTG? | 10:29 |
| opendevreview | Merged openstack/kolla-ansible stable/train: CI: Remove ara integration https://review.opendev.org/c/openstack/kolla-ansible/+/813171 | 10:34 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: Do not create haproxy and swift log dirs needlessly https://review.opendev.org/c/openstack/kolla-ansible/+/812958 | 10:34 |
| jingvar | Who knows how to determine wich OVN component in active state on the node? | 10:35 |
| mnasiadka | What component do you have on your mind? DB? | 10:36 |
| jingvar | yes, for example | 10:43 |
| jingvar | RH uses peacemaker, but Kolla has another way as I see | 10:44 |
| jingvar | I try to make helper script to run ovn-sbctl,ovn-nbctl etc commands from kayobe control host | 10:46 |
| mnasiadka | It's not for example, there are different commands to check database status, and different commands to check e.g. router status. | 10:47 |
| mnasiadka | there's cluster/status subcommand in ovs-appctl for databases | 10:48 |
| jingvar | somthing like pssh -P -h ~/.pssh_hosts_files "sudo docker exec ovn_sb_db ovn-sbctl show" | 10:50 |
| jingvar | but I have to determine wich host is active for an service | 10:51 |
| mnasiadka | you can pass all hosts to ovn-sbctl, and it will work out which one is active | 10:52 |
| mnasiadka | ovn-sbctl --db= | 10:53 |
| jingvar | how determine --db? | 10:54 |
| mnasiadka | our CI script can help you a bit (https://github.com/openstack/kolla-ansible/blob/master/tests/test-ovn.sh) | 10:55 |
| opendevreview | Merged openstack/kolla-ansible master: Do not set net.ipv4.ip_forward sysctl https://review.opendev.org/c/openstack/kolla-ansible/+/809977 | 10:55 |
| jingvar | mnasiadka: Great | 10:58 |
| opendevreview | Maksim Malchuk proposed openstack/kolla master: Fix KOLLA_LEGACY_IPTABLES workaround https://review.opendev.org/c/openstack/kolla/+/813304 | 11:01 |
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: Do not create haproxy and swift log dirs needlessly https://review.opendev.org/c/openstack/kolla-ansible/+/812956 | 11:02 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: Do not create haproxy and swift log dirs needlessly https://review.opendev.org/c/openstack/kolla-ansible/+/812957 | 11:02 |
| opendevreview | Merged openstack/kolla-ansible master: Fix privileges for MariaDB 10.5 https://review.opendev.org/c/openstack/kolla-ansible/+/812677 | 11:15 |
| opendevreview | Maksim Malchuk proposed openstack/kolla master: Fix KOLLA_LEGACY_IPTABLES workaround https://review.opendev.org/c/openstack/kolla/+/813304 | 11:23 |
| opendevreview | Merged openstack/kayobe master: Update Kolla images namespace to openstack.kolla https://review.opendev.org/c/openstack/kayobe/+/812947 | 11:25 |
| *** amoralej is now known as amoralej|lunch | 11:49 | |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/wallaby: Do not set net.ipv4.ip_forward sysctl https://review.opendev.org/c/openstack/kolla-ansible/+/813334 | 12:07 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/victoria: Do not set net.ipv4.ip_forward sysctl https://review.opendev.org/c/openstack/kolla-ansible/+/813335 | 12:07 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/ussuri: Do not set net.ipv4.ip_forward sysctl https://review.opendev.org/c/openstack/kolla-ansible/+/813336 | 12:07 |
| yoctozepto | osmanlicilegi: hey, the reno is not missing on https://review.opendev.org/c/openstack/kolla-ansible/+/810086 :P | 13:00 |
| opendevreview | Maksim Malchuk proposed openstack/kolla stable/ussuri: neutron: Fix update-alternatives on CentOS https://review.opendev.org/c/openstack/kolla/+/813305 | 13:06 |
| opendevreview | Maksim Malchuk proposed openstack/kolla stable/ussuri: Fix KOLLA_LEGACY_IPTABLES workaround https://review.opendev.org/c/openstack/kolla/+/813423 | 13:06 |
| opendevreview | Maksim Malchuk proposed openstack/kolla master: Add missing reno https://review.opendev.org/c/openstack/kolla/+/813304 | 13:14 |
| opendevreview | Maksim Malchuk proposed openstack/kolla stable/ussuri: Add missing reno https://review.opendev.org/c/openstack/kolla/+/813423 | 13:20 |
| opendevreview | Maksim Malchuk proposed openstack/kolla stable/ussuri: Add missing reno https://review.opendev.org/c/openstack/kolla/+/813423 | 13:21 |
| *** amoralej|lunch is now known as amoralej | 13:25 | |
| opendevreview | Maksim Malchuk proposed openstack/kolla stable/wallaby: Add missing reno https://review.opendev.org/c/openstack/kolla/+/813427 | 13:25 |
| opendevreview | Maksim Malchuk proposed openstack/kolla stable/victoria: Add missing reno https://review.opendev.org/c/openstack/kolla/+/813428 | 13:26 |
| opendevreview | Maksim Malchuk proposed openstack/kolla-ansible master: Correctly create the dhcp_agent.ini and l3_agent.ini https://review.opendev.org/c/openstack/kolla-ansible/+/813306 | 13:38 |
| OpenstackThun | Hello Team, I am trying to deploy openstack Victoria | 13:39 |
| OpenstackThun | Before I install kolla-ansible on the deployment server , I first clone the * git clone --branch stable/victoria https://opendev.org/openstack/kolla-ansible* but when I run the deployment without uncommenting openstack_release .. By default it deploys wallaby | 13:40 |
| OpenstackThun | And when I uncomment and type victoria ...Some of the containers keep restarting esp Horizon, Even the kolla content that I use for deployment, I get it from the kolla-ansible directory that I cloned | 13:40 |
| OpenstackThun | Any idea on how to resolve this ? | 13:40 |
| opendevreview | Merged openstack/kolla-ansible master: Trivial but necessary fix - loadbalancer weight https://review.opendev.org/c/openstack/kolla-ansible/+/813403 | 14:02 |
| opendevreview | Merged openstack/kolla master: Tidy up renos before Xena release https://review.opendev.org/c/openstack/kolla/+/812723 | 14:02 |
| jingvar | OpenstackThun: grep -r wallaby into globals.yaml ..etc | 14:15 |
| holtgrewe | Hi. Is this a good place to ask questions? I'm trying to deploy with kayobe. I want to use Ceph on my bare metal hosts for block and object storage. For this, I want to use a dedicated network. So I put `swift_storage_net_name: ceph_backend_net` into my `networks.yaml` file. I defined an interface in the appropriate group for my compute hosts. Now `kayobe seed host configure` is complaining that I configured no interface in this network on | 14:20 |
| holtgrewe | the seed host. I don't want this host to have an interface in the network. What do I do? | 14:20 |
| jingvar | remove extra networks for seed | 14:24 |
| opendevreview | Merged openstack/kolla master: Fix GitHub tarball URL for monasca-thresh https://review.opendev.org/c/openstack/kolla/+/813252 | 14:27 |
| jingvar | you have a defined network for seed but don't have interface for this network in inventory/group_vars/seed/network-interfaces | 14:28 |
| holtgrewe | @jingvar, thanks for the reply. The network is defined in etc/kayobe/networks.yml. How can I remove the network from the seed? | 14:30 |
| osmanlicilegi | mgoddard: I will try to join the PTG sessions. There are some conflicting meetings on same hours. | 14:37 |
| osmanlicilegi | yoctozepto: did +2 | 14:37 |
| OpenstackThun | jingvar there is no wallaby in the file .. Its only victoria | 14:44 |
| holtgrewe | @jingvar, OK, I think I found my mistake... the seed is also set as the controller and thus gets more networks than expected. | 14:44 |
| holtgrewe | An I probably can just define the network not globally but simply on the baremetal hosts only... neat. | 14:47 |
| jingvar | OpenstackThun: how do you install openstack via kayobe? | 14:57 |
| OpenstackThun | I am not installing via Kayobe | 15:00 |
| OpenstackThun | I am using kolla-ansible | 15:00 |
| OpenstackThun | Its a test Environment so I am using this guide | 15:02 |
| OpenstackThun | https://kifarunix.com/deploy-all-in-one-openstack-with-kolla-ansible-on-ubuntu-18-04/ | 15:02 |
| OpenstackThun | Just that before the *pip install kolla-ansible* | 15:02 |
| OpenstackThun | I clone this the Victoria repositories | 15:02 |
| OpenstackThun | git clone --branch stable/victoria https://opendev.org/openstack/kolla-ansible | 15:02 |
| OpenstackThun | Is there anyting I need to do beyond there ? | 15:21 |
| holtgrewe | I'm now getting a problem when trying to deploy the seed service. The `[bifrost : Bootstrap bifrost (this may take several minutes)]` step fails (https://pastebin.com/qcu9eNNW). I think the relevant problem from /var/log/mariadb/mariadb.log is `Can't start server: Bind on TCP/IP port. Got error: 98: Address already in use`/`Do you already have another mysqld server running on port: 3306 ?`. Has anyone ever seen this? I'm running docker | 15:36 |
| holtgrewe | community edition 20.10.9 on CentOS 8 Stream, kernel 4.18.0-338.el8.x86_64 with latest updates applied via dnf. `bootstrap_deploy` image is `sha256:5c254d8055a9c311add15505a9b2a71e0c9d52a3f26d4c59570dcd5a74472d8d`. | 15:36 |
| holtgrewe | I'm a bit surprised. When running `ansible-playbook -vvvv -i /bifrost/playbooks/inventory/target /bifrost/playbooks/install.yaml -e @/etc/bifrost/bifrost.yml -e @/etc/bifrost/dib.yml -e skip_package_install=true` then systemd is used for restarting mysql... | 15:41 |
| holtgrewe | But of course kayobe deploys bifrost as a container (I'm running the bifrost ansible playbook in the same way as kayobe/kolla do). | 15:44 |
| opendevreview | Merged openstack/kolla-ansible master: Do not load br_netfilter https://review.opendev.org/c/openstack/kolla-ansible/+/810086 | 15:50 |
| jingvar | holtgrewe: openstack realease? bifrost container was stoped ? | 16:02 |
| holtgrewe | @jingvar, wallaby. Let me get comprehensive log output to pastebin. | 16:03 |
| holtgrewe | Full logs are here. https://controlc.com/3ce9a01d | 16:08 |
| holtgrewe | I'm doing `kayobe seed service deploy -vvv` which turns out to run `ansible-playbook -vvvv -i /bifrost/playbooks/inventory/target /bifrost/playbooks/install.yaml -e @/etc/bifrost/bifrost.yml -e @/etc/bifrost/dib.yml -e skip_package_install=true` inside of the `bifrost_deploy` container. This fails because it wants to run `systemctl restart mysql`. | 16:12 |
| jingvar | Victoria (bifrost-deploy)[root@kayobe-kvm02 bifrost-9.0.2.dev26]# systemctl status mysql | 16:27 |
| jingvar | ● mariadb.service - MariaDB 10.3 database server Active: active (running) | 16:28 |
| holtgrewe | Here, it cannot start. On the host I see mariadb and mariadb_clustercheck in `docker ps`. | 16:30 |
| holtgrewe | And they sit on port 3306. Do you also see them in `docker ps | egrep 'mariadb|mysql'`? | 16:30 |
| jingvar | no | 16:30 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/wallaby: Do not load br_netfilter https://review.opendev.org/c/openstack/kolla-ansible/+/813343 | 16:31 |
| jingvar | we talk about seed? i dp think that there should be maria cluster check | 16:32 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/victoria: Do not load br_netfilter https://review.opendev.org/c/openstack/kolla-ansible/+/813344 | 16:32 |
| opendevreview | Radosław Piliszek proposed openstack/kolla-ansible stable/ussuri: Do not load br_netfilter https://review.opendev.org/c/openstack/kolla-ansible/+/813345 | 16:32 |
| jingvar | Seed node hase 2 containers - registry and bifrost | 16:32 |
| holtgrewe | OK, I think I get it now. I deployed as all in one, IOW controller+seed+compute on the same host. | 16:33 |
| holtgrewe | This apparently does not play well with bifrost. Probably there must be a mysql container on the compute hosts. | 16:34 |
| holtgrewe | So I think I'll start over with a fresh seed VM. Thanks! | 16:35 |
| jingvar | We did some changes to place seed on control host, but I don't remember what exectly :) | 16:35 |
| holtgrewe | fg | 16:39 |
| holtgrewe | Sorry wrong window. Thanks for your patience. I think I'm getting closer... | 16:40 |
| *** amoralej is now known as amoralej|off | 16:51 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!