| *** cloudnull has quit IRC | 00:14 | |
| *** xinliang has joined #openstack-kolla | 00:56 | |
| *** spsurya has quit IRC | 02:03 | |
| *** k_mouza has quit IRC | 02:30 | |
| *** cloudnull has joined #openstack-kolla | 02:54 | |
| *** xinliang has quit IRC | 04:03 | |
| *** goldyfruit has joined #openstack-kolla | 04:54 | |
| *** skramaja has joined #openstack-kolla | 04:57 | |
| osmanlicilegi | morning | 05:31 |
|---|---|---|
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-kolla | 05:33 | |
| *** shyamb has joined #openstack-kolla | 06:23 | |
| yoctozepto | morning | 06:51 |
| *** shyamb has quit IRC | 07:17 | |
| *** shyamb has joined #openstack-kolla | 07:19 | |
| *** xinliang has joined #openstack-kolla | 07:24 | |
| *** cah_link has joined #openstack-kolla | 07:29 | |
| *** shyamb has quit IRC | 07:31 | |
| yoctozepto | mgoddard: here a failure without the "master"-changing patch: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_069/699172/10/check/kolla-ansible-ubuntu-source-upgrade-ceph/069271d/secondary1/logs/kolla/mariadb/mariadb.txt.gz | 07:42 |
| yoctozepto | again, it did not notice friends going down one-by-one | 07:42 |
| yoctozepto | I should be able to deliver something today, I just need to get some other things done first | 07:42 |
| *** shyamb has joined #openstack-kolla | 08:01 | |
| *** shyamb has quit IRC | 08:05 | |
| osmanlicilegi | yoctozepto: can you edit blueprints on launchpad? if so could you please change the status of https://blueprints.launchpad.net/kolla-ansible/+spec/ansible-max-version to needs code review. | 08:06 |
| yoctozepto | osmanlicilegi: done | 08:08 |
| osmanlicilegi | thanks! | 08:08 |
| yoctozepto | osmanlicilegi: almost there, please consider my general note | 08:12 |
| osmanlicilegi | got it | 08:14 |
| openstackgerrit | Dincer Celik proposed openstack/kolla-ansible master: Adds maximum supported version check for Ansible https://review.opendev.org/699333 | 08:18 |
| osmanlicilegi | yoctozepto: you mean a helper script like validate-ansible-version.sh right? | 08:25 |
| yoctozepto | osmanlicilegi: we run the playbooks via kolla-ansible | 08:26 |
| yoctozepto | which is in bash | 08:26 |
| yoctozepto | it's the only reliable place to check ansible version if anything ansiblish is already b0rken | 08:26 |
| yoctozepto | this script requires a fix to check if ansible is installed the same venv | 08:26 |
| yoctozepto | you can take care of that as well, this part needs to go to train so it might be wise to do it two-step | 08:27 |
| yoctozepto | see https://bugs.launchpad.net/kolla-ansible/+bug/1856346 | 08:27 |
| openstack | Launchpad bug 1856346 in kolla-ansible ussuri "check for kolla_ansible being installed does not take into account it's ansible that has to see it" [Medium,Triaged] | 08:27 |
| *** shyamb has joined #openstack-kolla | 08:30 | |
| *** pcaruana has joined #openstack-kolla | 08:35 | |
| *** rpittau|afk is now known as rpittau | 08:41 | |
| *** shyam89 has joined #openstack-kolla | 08:52 | |
| *** shyamb has quit IRC | 08:52 | |
| mgoddard | morning all | 09:13 |
| mnasiadka | morning | 09:13 |
| mgoddard | r3ap3r: you need to have an interface on the aio host with an IP in the external net subnet, and L2 connectivity to it | 09:15 |
| *** xinliang has quit IRC | 09:40 | |
| hrw | morning | 09:40 |
| hrw | ecec327f7 (HEAD -> master) Revert "Revert "Add AArch64 publisher for Debian/source"" | 09:48 |
| hrw | now can continue ;D | 09:48 |
| hrw | ok, I will need your help with zuul stuff | 10:19 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: WIP: Make MariaDB deployment great again https://review.opendev.org/701010 | 10:24 |
| yoctozepto | mgoddard: ^ | 10:24 |
| yoctozepto | surely needs some refactoring | 10:25 |
| *** k_mouza has joined #openstack-kolla | 10:25 | |
| yoctozepto | I guess the blocks in handlers may fail so I might be forced to do the include_tasks trick anyway | 10:25 |
| mnasiadka | Galera again? geez | 10:27 |
| mgoddard | yoctozepto: can't loop over a block | 10:27 |
| mgoddard | it's just a way of applying things to a bunch of tasks | 10:27 |
| mgoddard | and some basic exception handling | 10:27 |
| yoctozepto | mgoddard: yeah, felt I am force to do the include_tasks trick | 10:27 |
| yoctozepto | so it's back to rewriting again | 10:28 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: Add AArch64 publisher for Debian/source https://review.opendev.org/701011 | 10:28 |
| mgoddard | yoctozepto: you assume that volume exists == mariadb is running? | 10:30 |
| mgoddard | in terms of quorum it is the latter we care about | 10:30 |
| mgoddard | nice approach with group_by | 10:31 |
| *** shyam89 has quit IRC | 10:34 | |
| yoctozepto | mgoddard: yeah, it's another issue of our previous approach is checking only volume, thanks for reminding | 10:36 |
| yoctozepto | I'm trying to tackle at least one issue with this change | 10:36 |
| mgoddard | yoctozepto: I may have a simpler approach | 10:51 |
| mgoddard | use serial | 10:52 |
| mgoddard | 2 plays | 10:52 |
| mgoddard | first play generates config, writes out a file if changed | 10:53 |
| mgoddard | second play (serial) removes file, restarts mariadb if changed or container not running | 10:53 |
| mgoddard | possibly we do two handler runs in the second play - first start where not running, next restart when changed | 10:54 |
| hrw | mgoddard: is there a way publish job gets branch name? | 11:02 |
| mgoddard | hrw: zuul.branch in playbook | 11:02 |
| hrw | ok | 11:02 |
| mgoddard | yoctozepto: hmm, maybe we went through this yesterday - problem is if the serial picks hosts that are running first | 11:06 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: CI: Add Ceph-Ansible jobs https://review.opendev.org/676376 | 11:06 |
| *** shyamb has joined #openstack-kolla | 11:06 | |
| mnasiadka | yoctozepto: I'm all in for +w this: https://review.opendev.org/#/c/699172/10 - but what the heck happened with neutron-server in the multinode-ipv6 job? :) | 11:12 |
| patchbot | patch 699172 - kolla-ansible - Fix MariaDB galera IPv6 deployment on CentOS 7 - 10 patch sets | 11:12 |
| yoctozepto | mgoddard: yeah, it's more complicated unfortunately | 11:12 |
| yoctozepto | delaying still by some other priorities | 11:12 |
| yoctozepto | mnasiadka: WSREP replication failed | 11:13 |
| yoctozepto | what can I say | 11:13 |
| yoctozepto | our mariadb deployment is luck-dependent :-) | 11:13 |
| mnasiadka | yoctozepto: and that's why neutron-server config template does not exist? it's getting better and better I see :) | 11:14 |
| yoctozepto | on proper, fast machines this is not reproducible | 11:14 |
| yoctozepto | look up previous errors | 11:14 |
| yoctozepto | see the BIG IMAGE | 11:14 |
| mnasiadka | I'm just laughing | 11:14 |
| yoctozepto | follow the LEADERS | 11:14 |
| yoctozepto | :D | 11:14 |
| mnasiadka | blindly? no thanks | 11:15 |
| yoctozepto | mnasiadka: open yer eyes and see ;D | 11:15 |
| mnasiadka | Well, the problem is I don't like what I see :D | 11:15 |
| yoctozepto | mnasiadka: neither do I | 11:15 |
| hrw | ansible... zillion of filters. no simple | replace('stable/', '') | 11:23 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: Add AArch64 publisher for Debian/source https://review.opendev.org/701011 | 11:34 |
| hrw | mgoddard: most of your comments done/replied | 11:35 |
| hrw | mgoddard: once changes look good I may move publish-multiarch jobs to check/check-arm64 so we can check does it work | 11:36 |
| hrw | mgoddard: it is also my 3rd playbook iirc | 11:38 |
| *** shyamb has quit IRC | 11:45 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: Add AArch64 publisher for Debian/source https://review.opendev.org/701011 | 11:54 |
| hrw | mgoddard: sorted out tag part | 11:54 |
| *** tonythomas has joined #openstack-kolla | 12:05 | |
| *** kplant has joined #openstack-kolla | 12:06 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: WIP: Test control plane deployment using tenks https://review.opendev.org/620074 | 12:16 |
| *** shyamb has joined #openstack-kolla | 12:27 | |
| *** skramaja has quit IRC | 12:30 | |
| mnasiadka | hrw: welcome to ansible world :) | 12:50 |
| r3ap3r | mgoddard: Good morning, so do you mean I have to have three network interfaces configured in my globals.yml file? I already have eth0 as my internal interface and eth1 configured as my extrnal interface. | 12:59 |
| r3ap3r | And thank you for responding. | 13:00 |
| hrw | mnasiadka: review! | 13:01 |
| openstackgerrit | Merged openstack/kolla master: Docs: add new rules regarding release notes usage https://review.opendev.org/699129 | 13:05 |
| hrw | hm. yoctozepto did not reviewd my patch so I do not have 'write release note' with -1 there | 13:07 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: CI: Add Ceph-Ansible jobs https://review.opendev.org/676376 | 13:10 |
| *** shyamb has quit IRC | 13:21 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN Support https://review.opendev.org/696841 | 13:29 |
| *** kplant has quit IRC | 13:38 | |
| mgoddard | r3ap3r: your external interface would work, except that it gets plugged into the OVS bridge | 13:47 |
| mgoddard | r3ap3r: what I normally do is create a linux bridge, then a veth pair, and plug the veth pair into the linux bridge and the OVS bridge | 13:48 |
| mgoddard | then the linux bridge can have an IP | 13:48 |
| yoctozepto | hrw: tell me if you want some -1 | 14:02 |
| r3ap3r | mgoddard: hmm, never done that before. I will try to give that a shot after work and see how it goes. Thank you for the information. | 14:10 |
| hrw | 14:48 < AJaeger> hrw: the Zuul part of your change is fine, I don't know whether all the variables in the playbook will have proper values. | 14:21 |
| hrw | 15:21 < hrw> AJaeger: that's for my team to check ;D | 14:21 |
| hrw | mgoddard, mnasiadka, yoctozepto: 14:48 < AJaeger> hrw: the Zuul part of your change is fine, I don't know whether all the variables in the playbook will have proper values. | 14:22 |
| hrw | 15:21 < hrw> AJaeger: that's for my team to check ;D | 14:22 |
| hrw | ops | 14:22 |
| hrw | https://review.opendev.org/701011 | 14:22 |
| patchbot | patch 701011 - kolla - Add AArch64 publisher for Debian/source - 3 patch sets | 14:22 |
| * hrw out - see you monday | 14:25 | |
| openstackgerrit | Merged openstack/kolla master: CentOS 8: work around mod_ssl certificate issue https://review.opendev.org/698445 | 14:35 |
| mgoddard | have a nice weekend hrw | 14:40 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: Fix IPA builds without packages specified https://review.opendev.org/701031 | 14:47 |
| *** henriqueof has joined #openstack-kolla | 14:57 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: Fix IPA builds without packages specified https://review.opendev.org/701031 | 14:57 |
| *** henriqueof has quit IRC | 15:03 | |
| *** henriqueof has joined #openstack-kolla | 15:03 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: CI: Add Ceph-Ansible jobs https://review.opendev.org/676376 | 15:12 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN Support https://review.opendev.org/696841 | 15:15 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: Fix overcloud provisioning due to Bifrost IPA rename https://review.opendev.org/701032 | 15:17 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: WIP: Test control plane deployment using tenks https://review.opendev.org/620074 | 15:18 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: Fix IPA builds without packages specified https://review.opendev.org/701031 | 15:20 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: WIP: Make MariaDB deployment great again https://review.opendev.org/701010 | 15:57 |
| openstackgerrit | LEDUC Florian proposed openstack/kolla-ansible master: Add ability to use the neutron logging framework https://review.opendev.org/701040 | 16:08 |
| *** shyamb has joined #openstack-kolla | 16:13 | |
| *** k_mouza has quit IRC | 16:37 | |
| *** kplant has joined #openstack-kolla | 16:44 | |
| *** henriqueof has quit IRC | 16:44 | |
| *** shyamb has quit IRC | 16:46 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: WIP: Test control plane deployment using tenks https://review.opendev.org/620074 | 16:58 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: WIP: Make MariaDB deployment great again https://review.opendev.org/701010 | 17:08 |
| openstackgerrit | LEDUC Florian proposed openstack/kolla-ansible master: Add ability to use the neutron logging framework https://review.opendev.org/700895 | 17:10 |
| *** cah_link has quit IRC | 17:16 | |
| *** rpittau is now known as rpittau|afk | 17:18 | |
| jonmasters | hrw: ok I have a mixed node environment up now - x86 control node is using train images from github/kolla while Arm compute node is using github/linaro | 17:21 |
| openstackgerrit | Merged openstack/kolla master: Add '--quiet' switch https://review.opendev.org/700888 | 17:21 |
| jonmasters | main problem I'm finding is that the openvswitch config isn't working for a provider network - arp traffic passes but ICMP is being dropped. I suspect an iptables issue on the compute node | 17:22 |
| jonmasters | I would say that currently deploying on any arm64 hosts is incredibly difficult and not documented. But I'd like to help with that | 17:23 |
| *** evrardjp has quit IRC | 17:33 | |
| *** evrardjp has joined #openstack-kolla | 17:33 | |
| mgoddard | jonmasters: interesting. I was discussing a setup just like that this morning | 17:35 |
| mgoddard | jonmasters: it's not a security group issue is it? | 17:36 |
| jonmasters | well the default group allows ICMP | 17:37 |
| *** jonaspaulo has joined #openstack-kolla | 17:38 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: WIP: Make MariaDB deployment great again https://review.opendev.org/701010 | 17:57 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: WIP: CentOS 8 spec https://review.opendev.org/699472 | 17:59 |
| r3ap3r | mgoddard: do you normally do what you mentioned above witht the linux bridge, veth pair, etc.. after Openstack is deployed or do you do it beforehand and then deploy Openstack with the appropriate setup withing the globals.yml file? Thanks. | 18:04 |
| *** tonythomas has quit IRC | 18:53 | |
| *** rphillips has quit IRC | 19:03 | |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Configure services to use Certificate Authority https://review.opendev.org/699312 | 19:09 |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Copy CA into containers. https://review.opendev.org/699888 | 19:09 |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Configure disabling verification of CA certificates. https://review.opendev.org/701056 | 19:09 |
| *** cah_link has joined #openstack-kolla | 19:17 | |
| *** iniazi has quit IRC | 19:18 | |
| *** iniazi has joined #openstack-kolla | 19:18 | |
| *** vmixor has joined #openstack-kolla | 19:20 | |
| *** henriqueof has joined #openstack-kolla | 19:21 | |
| *** dave-mccowan has quit IRC | 19:52 | |
| *** dciabrin__ has joined #openstack-kolla | 19:57 | |
| *** dciabrin_ has quit IRC | 20:00 | |
| *** dave-mccowan has joined #openstack-kolla | 20:11 | |
| *** cah_link has quit IRC | 20:12 | |
| jonmasters | mgoddard: so the problem is in iptables | 20:34 |
| jonmasters | mgoddard: the ovs container with rules allows the forwarding across the bridge from the instance tap to the bridge but the host docker rules eat it | 20:34 |
| jonmasters | mgoddard: changing the default iptables forwarding policy on the host to accept works around it but obviously isn't what I want to do | 20:35 |
| jonmasters | something is weird with docker user iptables rules | 20:35 |
| *** rphillips has joined #openstack-kolla | 20:53 | |
| jonmasters | the default in/out rules added by ovs in the container don't include an ACCEPT so we go back up the chain and ultimately hit the default in the host | 20:54 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: OVN Support https://review.opendev.org/696841 | 21:00 |
| *** kplant has quit IRC | 21:03 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: CI: Add Ceph-Ansible jobs https://review.opendev.org/676376 | 21:04 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: CI: Add Ceph-Ansible jobs https://review.opendev.org/676376 | 21:17 |
| *** cah_link has joined #openstack-kolla | 21:55 | |
| *** vmixor has quit IRC | 22:05 | |
| *** cah_link has quit IRC | 22:07 | |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Configure services to use Certificate Authority https://review.opendev.org/699312 | 22:14 |
| *** pcaruana has quit IRC | 22:59 | |
| *** factor has quit IRC | 23:14 | |
| *** factor has joined #openstack-kolla | 23:15 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!