| opendevreview | wu.chunyang proposed openstack/kolla-ansible master: Modernize the swift role https://review.opendev.org/c/openstack/kolla-ansible/+/797498 | 02:52 |
|---|---|---|
| opendevreview | Merged openstack/kolla-ansible stable/wallaby: Add missing region_name in keystoneauth sections https://review.opendev.org/c/openstack/kolla-ansible/+/797477 | 02:55 |
| opendevreview | wu.chunyang proposed openstack/kolla-ansible master: Remove unused region_name option https://review.opendev.org/c/openstack/kolla-ansible/+/797560 | 04:55 |
| opendevreview | wu.chunyang proposed openstack/kolla-ansible master: Modernize the swift role https://review.opendev.org/c/openstack/kolla-ansible/+/797498 | 05:00 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: horizon: Support custom themes https://review.opendev.org/c/openstack/kolla-ansible/+/761364 | 05:48 |
| *** rpittau|afk is now known as rpittau | 07:07 | |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: horizon: Support custom themes https://review.opendev.org/c/openstack/kolla-ansible/+/761364 | 07:14 |
| jingvar_ | I've added # Server inventory for Bifrost. and have servers.yaml into Bifrost container, but I don't have automatic enroll this nodes, barematal node list is empty - if run manual enroll as described in Bifrost docs - nodes appear | 07:19 |
| lichun | excuse me, I ask one question. | 08:06 |
| lichun | when I run "kolla-ansible deploy", the target host report "Not continuing with pull after error: context canceled" | 08:08 |
| lichun | then, The pull session cancelled. how do I fix it? | 08:09 |
| opendevreview | Mark Goddard proposed openstack/kolla stable/wallaby: tox: Use allowlist_externals instead of whitelist_externals https://review.opendev.org/c/openstack/kolla/+/797574 | 08:09 |
| opendevreview | wu.chunyang proposed openstack/kolla-ansible master: Modernize the swift role https://review.opendev.org/c/openstack/kolla-ansible/+/797498 | 08:15 |
| mgoddard | hi lichun, I haven't seen that error before | 08:18 |
| mgoddard | lichun: you could check docker logs | 08:18 |
| lichun | mgoddard: there is no container yet. | 08:21 |
| mgoddard | lichun: I mean logs for the docker daemon | 08:21 |
| mgoddard | jingvar_: I have found someone who recently had this working | 08:22 |
| mgoddard | jingvar_: they will join shortly | 08:23 |
| jingvar_ | great news | 08:25 |
| lichun | mgoddard: docker daemon no complaints anything. Could it be a internet problem? | 08:25 |
| lichun | mgoddard: I was wrong, dockerd complained "Pull session cancelled" and "Not continuing with pull after error: context canceled" | 08:29 |
| luk4s | Hi jingvar_ | 08:30 |
| jingvar_ | Hi luk4s | 08:31 |
| luk4s | Are you looking for some examples on using static inventory in bifrost? | 08:32 |
| jingvar_ | yes | 08:32 |
| luk4s | Let me dig out the config and commands. Give me couple of minutes | 08:33 |
| jingvar_ | i have coorrect servers.yaml and can manully use it for enreoll inside bifrost | 08:34 |
| jingvar_ | do you know what is command prompt - tc@box ? storage node has this strange message | 08:36 |
| jingvar_ | it looks like tine.core but it happens in deploy phase | 08:39 |
| luk4s | jingvar_, please see https://gist.github.com/m4ge/2d4070889a51d08ca5a98ec151dd6c9a for sample configuration. | 08:51 |
| jingvar_ | I have something like that , but without unnecessary parameters | 08:55 |
| jingvar_ | uuid, properties, ipv4_address, | 08:57 |
| jingvar_ | question is why it doesnt work with bootstrp bifrost | 08:58 |
| jingvar_ | to enroll baremetal you need driver=ipmi, ipmi_user, ipmi_password, ipmi_ip, and probably boot_mac | 09:05 |
| luk4s | jingvar_, are you getting errors importing the servers.yml into bifrost? | 09:10 |
| jingvar_ | Sorry, which step do you mean? | 09:11 |
| opendevreview | Mark Goddard proposed openstack/kolla-ansible master: Allow user to set sysctl_net_ipv4_tcp_retries2 https://review.opendev.org/c/openstack/kolla-ansible/+/777772 | 09:12 |
| jingvar_ | I have no errors | 09:12 |
| luk4s | So you can import the static inventory into bifrost without any issue? | 09:12 |
| jingvar_ | yes | 09:12 |
| mgoddard | sorry luk4s, I must have been behind on the state of jingvar_'s deployment | 09:13 |
| luk4s | mgoddard, no worries :) | 09:13 |
| mgoddard | luk4s: at least you're setup on OFTC now :) | 09:14 |
| jingvar_ | I't turn back few minutes | 09:15 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: Add missing region_name in keystoneauth sections https://review.opendev.org/c/openstack/kolla-ansible/+/797478 | 09:16 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: Add missing region_name in keystoneauth sections https://review.opendev.org/c/openstack/kolla-ansible/+/797479 | 09:16 |
| opendevreview | Merged openstack/kolla stable/wallaby: tox: Use allowlist_externals instead of whitelist_externals https://review.opendev.org/c/openstack/kolla/+/797574 | 09:16 |
| opendevreview | Mark Goddard proposed openstack/kolla-ansible master: Allow user to set sysctl_net_ipv4_tcp_retries2 https://review.opendev.org/c/openstack/kolla-ansible/+/777772 | 09:16 |
| luk4s | mgoddard, yup all reconfigured and ready to go from now on | 09:17 |
| opendevreview | Mark Goddard proposed openstack/kolla-ansible master: magnum: Add CA certificate configuration for internal TLS https://review.opendev.org/c/openstack/kolla-ansible/+/781062 | 09:19 |
| opendevreview | Merged openstack/kayobe stable/wallaby: Fix url to ansible site in kolla-ansible.rst https://review.opendev.org/c/openstack/kayobe/+/797392 | 09:33 |
| opendevreview | Merged openstack/kayobe master: Remove outdated upgrade step https://review.opendev.org/c/openstack/kayobe/+/796848 | 09:35 |
| opendevreview | Mark Goddard proposed openstack/kolla-ansible master: Use ansible_facts to reference facts https://review.opendev.org/c/openstack/kolla-ansible/+/791276 | 09:39 |
| opendevreview | Mark Goddard proposed openstack/kolla-ansible master: CI: Don't generate certificates before upgrade https://review.opendev.org/c/openstack/kolla-ansible/+/792793 | 09:40 |
| jingvar_ | I'm here | 10:00 |
| jingvar_ | I have correct servers.yaml (bacaue it works by manual run inside Befrost), but I don't have automatic enroll via kayobe seed service deploy, only deliverivng servers.yaml to Befrost | 10:03 |
| jingvar_ | I will remove container and restart service deploy and collect logs | 10:05 |
| wuchunyang | hi, i refactored the swift role In the last few days, And now, the CI all pass. need cores to review. | 10:10 |
| yoctozepto | wuchunyang: hi; did you test upgrades? | 10:15 |
| wuchunyang | yoctozepto : yes, just smoke test. run passed. i am not very sure the logic of rolling_upgrade | 10:19 |
| jingvar_ | service deploy full log here http://paste.openstack.org/show/806879/ | 10:21 |
| opendevreview | Merged openstack/kolla-ansible stable/victoria: Fix host bootstrap pkg removal on Debian https://review.opendev.org/c/openstack/kolla-ansible/+/797393 | 10:22 |
| opendevreview | Merged openstack/kolla-ansible stable/ussuri: Fix host bootstrap pkg removal on Debian https://review.opendev.org/c/openstack/kolla-ansible/+/797394 | 10:23 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: Allow user to set sysctl_net_ipv4_tcp_retries2 https://review.opendev.org/c/openstack/kolla-ansible/+/777772 | 10:27 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: Allow user to set sysctl_net_ipv4_tcp_retries2 https://review.opendev.org/c/openstack/kolla-ansible/+/777772 | 10:30 |
| opendevreview | Mark Goddard proposed openstack/kolla-ansible master: Allow user to set sysctl_net_ipv4_tcp_retries2 https://review.opendev.org/c/openstack/kolla-ansible/+/777772 | 10:32 |
| opendevreview | Mark Goddard proposed openstack/kolla-ansible master: Allow user to set sysctl_net_ipv4_tcp_retries2 https://review.opendev.org/c/openstack/kolla-ansible/+/777772 | 10:34 |
| jingvar_ | manual enroll is here http://paste.openstack.org/show/806880/ | 10:43 |
| mgoddard | jingvar_: seed service deploy should not enroll nodes | 10:55 |
| mgoddard | jingvar_: possibly we need a new command to do it | 10:55 |
| jingvar_ | hmm, but it brings servers.yaml | 11:00 |
| jingvar_ | starnge | 11:00 |
| mgoddard | jingvar_: yes. This whole flow has not really been designed | 11:02 |
| mgoddard | jingvar_: I would suggest that you work around the shortcomings of this approach and make it work. If you decide to go with kayobe we can look at how to improve it. It's on the backlog anyway | 11:03 |
| jingvar_ | I ready to try your way with autodiscovery | 11:04 |
| mgoddard | ok | 11:04 |
| jingvar_ | could someone explain how do you do this | 11:05 |
| mgoddard | jingvar_: use ipmitool to boot from PXE & power on nodes | 11:10 |
| jingvar_ | how to enable autodicovery mode | 11:30 |
| jingvar_ | and what I'll see in baremetal node list? random names? | 11:31 |
| jingvar_ | like MAAS do | 11:31 |
| mgoddard | jingvar_: the nodes will have no name by default, but we often setup inspector to use the switch LLDP port description to set node names | 11:34 |
| mgoddard | jingvar_: tbh, we are considering moving to an enrollment approach | 11:34 |
| jingvar_ | After inspection, Are you manually rename nodes related to ansible inventory (controller0 , etc) | 11:36 |
| mgoddard | jingvar_: no, we use the approach I just mentioned | 11:37 |
| opendevreview | Mark Goddard proposed openstack/kayobe master: Support Ansible collections https://review.opendev.org/c/openstack/kayobe/+/797497 | 11:37 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible stable/wallaby: Make rabbitmq cluster_partition_handling configurable https://review.opendev.org/c/openstack/kolla-ansible/+/797576 | 11:37 |
| jingvar_ | do you have some deployment sricpt? | 11:37 |
| jingvar_ | i don't undertand how works kayobe overcloud inventory discover | 11:38 |
| mgoddard | jingvar_: https://www.stackhpc.com/ironic-idrac-ztp.html | 11:38 |
| jingvar_ | it should link barematal node and ansible host | 11:39 |
| mgoddard | some info about it there | 11:39 |
| jingvar_ | I've read it. Thanks | 11:51 |
| opendevreview | wu.chunyang proposed openstack/kolla-ansible master: Repalce auth_uri with www_authenticate_uri https://review.opendev.org/c/openstack/kolla-ansible/+/797625 | 12:10 |
| opendevreview | wu.chunyang proposed openstack/kolla-ansible master: Replace auth_uri with www_authenticate_uri https://review.opendev.org/c/openstack/kolla-ansible/+/797625 | 12:11 |
| opendevreview | Mark Goddard proposed openstack/kayobe master: Ubuntu: add upgrade jobs in CI https://review.opendev.org/c/openstack/kayobe/+/797626 | 12:12 |
| opendevreview | Pierre Riteau proposed openstack/kolla-ansible master: Replace auth_uri with www_authenticate_uri https://review.opendev.org/c/openstack/kolla-ansible/+/797625 | 12:23 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/wallaby: Remove outdated upgrade step https://review.opendev.org/c/openstack/kayobe/+/797578 | 12:25 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/victoria: CI: Move to centos-8-stream https://review.opendev.org/c/openstack/kolla-ansible/+/797017 | 12:26 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/victoria: Remove outdated upgrade step https://review.opendev.org/c/openstack/kayobe/+/797579 | 12:26 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/victoria: CI: Add centos-8-stream jobs https://review.opendev.org/c/openstack/kolla-ansible/+/797017 | 12:26 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/ussuri: Remove outdated upgrade step https://review.opendev.org/c/openstack/kayobe/+/797629 | 12:28 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/victoria: Fix url to ansible site in kolla-ansible.rst https://review.opendev.org/c/openstack/kayobe/+/797580 | 12:30 |
| opendevreview | Mark Goddard proposed openstack/kayobe master: Ubuntu: add upgrade jobs in CI https://review.opendev.org/c/openstack/kayobe/+/797626 | 12:55 |
| opendevreview | Merged openstack/kolla-ansible master: Make it possible to override automatic fluentd version detection https://review.opendev.org/c/openstack/kolla-ansible/+/771260 | 13:02 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: Do not try to get container facts on localhost https://review.opendev.org/c/openstack/kolla-ansible/+/797646 | 13:33 |
| kevko | ^trivial | 13:33 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: Do not try to get container facts on deployment host https://review.opendev.org/c/openstack/kolla-ansible/+/797646 | 13:47 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible stable/wallaby: Do not try to get container facts on deployment host https://review.opendev.org/c/openstack/kolla-ansible/+/797584 | 13:52 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/train: baremetal: Don't start Docker after install on Debian/Ubuntu https://review.opendev.org/c/openstack/kolla-ansible/+/791582 | 13:55 |
| opendevreview | Merged openstack/kolla-ansible master: Allow user to set sysctl_net_ipv4_tcp_retries2 https://review.opendev.org/c/openstack/kolla-ansible/+/777772 | 13:57 |
| born2bake | Hey guys, I am trying to run - kolla-ansible octavia-certificates & getting "ERROR: Ansible version should be between 2.9 and 2.9. Current version is which is not supported."; pip seems to be fine - http://paste.openstack.org/show/806883/ | 14:10 |
| born2bake | Actually, I cant use kolla-ansible at all | 14:12 |
| born2bake | Basically, following docs - 2001 source kolla/bin/activate | 14:18 |
| born2bake | 2002 pip install -U pip | 14:18 |
| born2bake | 2003 pip install 'ansible<3.0' | 14:18 |
| born2bake | 2004 pip install kolla-ansible | 14:18 |
| born2bake | You get - ERROR: Ansible version should be between 2.9 and 2.9. Current version is which is not supported. | 14:18 |
| mgoddard | born2bake: which release, which docs? | 14:27 |
| born2bake | mgoddard I think my bad cause I was using "latest" docs rather than victoria one. Wallaby is not supported yet, right? | 14:29 |
| mgoddard | born2bake: wallaby should be released today or tomorrow | 14:29 |
| born2bake | oh wow so then I am just on time lol ; I will wait then | 14:30 |
| mgoddard | born2bake: always use a version constraint to install kolla-ansible | 14:30 |
| mgoddard | born2bake: you can use 12.0.0.0rc2 for now | 14:30 |
| born2bake | mgoddard I also wanted to ask one more question related to Octavia networking https://docs.openstack.org/kolla-ansible/wallaby/reference/networking/octavia.html#networking ; In case if my network setup does not have vlan configured, and I have 2 flat network cables connected therefore, I am going to use eth0 for "network_interface" & eth1 for "neutron_external_interface"; Can I use the same eth0 or eth1 for "octavia_network_interface"? (for | 14:40 |
| born2bake | eth1 pref) | 14:40 |
| mgoddard | born2bake: would recommend against it | 14:46 |
| mgoddard | born2bake: you can use a vxlan in wallaby, although we don't really recommend it for production | 14:47 |
| born2bake | so eth0 then; what could be a reason of not using it this way? I am not planning to use it in prod though | 14:47 |
| opendevreview | Merged openstack/kayobe-config-dev stable/ussuri: Sync configs with kayobe @ cf8869eecd669df411696e78bd90d0b9a02f429f https://review.opendev.org/c/openstack/kayobe-config-dev/+/795526 | 14:49 |
| mgoddard | mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi bbezak parallax Fl1nt | 14:54 |
| mgoddard | ^ meeting in 6 | 14:54 |
| jingvar_ | born2bake: I had the same error, have found some variables like min_version and changed it | 14:59 |
| mgoddard | those variables are there for a reason :) | 14:59 |
| mgoddard | #startmeeting kolla | 15:00 |
| opendevmeet | Meeting started Wed Jun 23 15:00:10 2021 UTC and is due to finish in 60 minutes. The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'kolla' | 15:00 |
| mgoddard | #topic rollcall | 15:00 |
| yoctozepto | \o/ | 15:00 |
| mgoddard | \o/ | 15:00 |
| headphoneJames | o/ | 15:00 |
| ohorecny2 | Hi all, I am first time on this meeting so in case that I am doing something wrong please correct me. | 15:02 |
| yoctozepto | welcome ohorecny2 | 15:02 |
| headphoneJames | welcome | 15:02 |
| mgoddard | welcome ohorecny2, thanks for joining | 15:03 |
| mgoddard | #topic agenda | 15:04 |
| mgoddard | * Roll-call | 15:04 |
| mgoddard | * Agenda | 15:04 |
| mgoddard | * Announcements | 15:04 |
| mgoddard | * Review action items from the last meeting | 15:04 |
| mgoddard | * CI status | 15:04 |
| mgoddard | * Wallaby release planning | 15:04 |
| mgoddard | ** libvirt/OVMF bug | 15:04 |
| mgoddard | * Xena cycle planning | 15:04 |
| mgoddard | ** podman (ohorecny) | 15:04 |
| mgoddard | * Open discussion | 15:04 |
| mgoddard | #topic Announcements | 15:04 |
| yoctozepto | that agenda needed updating | 15:04 |
| mgoddard | #info Kolla Wallaby should be released this week | 15:05 |
| yoctozepto | \o/ | 15:05 |
| mgoddard | closer to the deadline than I'd hoped, but alas it always ends up this way | 15:05 |
| yoctozepto | it's actually just going through the release team | 15:05 |
| yoctozepto | yeah | 15:05 |
| yoctozepto | let's try better next time | 15:05 |
| mgoddard | the main blockers have been out of our control, as usual | 15:06 |
| yoctozepto | yeah, sadly | 15:07 |
| mgoddard | one problem is that we hold new releases to a higher standard than existing ones | 15:07 |
| mgoddard | anyway | 15:07 |
| mgoddard | #topic Review action items from the last meeting | 15:07 |
| yoctozepto | that is a quality of ours | 15:08 |
| mgoddard | There were none | 15:08 |
| mgoddard | #topic CI status | 15:08 |
| yoctozepto | kolla and kolla ansible fully green | 15:09 |
| mgoddard | Ussuri fails sporadically on Ubuntu due to Neutron migrations failing | 15:09 |
| yoctozepto | yeah, it somehow got more common recently; and only affects ubuntu | 15:09 |
| mgoddard | weird | 15:09 |
| yoctozepto | no idea what changed; some lib? kernel? | 15:09 |
| mgoddard | some difference in mariadb? | 15:09 |
| yoctozepto | i checked mariadb and neutron | 15:09 |
| yoctozepto | and no version coincidence | 15:10 |
| yoctozepto | no | 15:10 |
| yoctozepto | we even have the same mariadb in centos8 | 15:10 |
| yoctozepto | it just started popping | 15:10 |
| yoctozepto | looks like a race condition | 15:10 |
| mnasiadka | Late again, eh | 15:10 |
| yoctozepto | I updated the description | 15:11 |
| mgoddard | k | 15:11 |
| yoctozepto | it should be "upgrades to Ussuri fail..." | 15:11 |
| yoctozepto | clean deploys do not | 15:11 |
| mgoddard | is it multinode only? | 15:11 |
| yoctozepto | no, singlenode too | 15:12 |
| yoctozepto | that's why we got so many gate rechecks | 15:12 |
| mgoddard | kk | 15:12 |
| mgoddard | #topic Wallaby release planning | 15:12 |
| mgoddard | libvirt/OVMF bug now fixed | 15:13 |
| yoctozepto | yeah, and libvirt 7.4.0 in stream | 15:13 |
| yoctozepto | 7.0 in non-stream | 15:13 |
| mgoddard | wallaby on its way out of the door | 15:13 |
| yoctozepto | therefore we got 7.0 in stable branches too | 15:13 |
| yoctozepto | mind that | 15:13 |
| mgoddard | does that break them? | 15:14 |
| yoctozepto | no, they work | 15:14 |
| mgoddard | goood | 15:14 |
| yoctozepto | just watch out in production | 15:14 |
| mgoddard | so we can just leave wallaby alone until we need to add support for CentOS stream 9 :D | 15:14 |
| yoctozepto | I actually had a thought about it | 15:15 |
| mgoddard | please share | 15:15 |
| yoctozepto | and I think we should not follow rdo steps since we containerise | 15:15 |
| yoctozepto | just apply the trick we do with debuntu | 15:15 |
| yoctozepto | check if it works | 15:15 |
| yoctozepto | and live happily | 15:15 |
| mgoddard | I had a similar thought | 15:15 |
| yoctozepto | then it's sealed | 15:15 |
| mgoddard | well | 15:16 |
| yoctozepto | it depends on whether it works | 15:16 |
| yoctozepto | I just want to avoid the backporting circus | 15:16 |
| mgoddard | actually mine was about CentOS Linux to CentOS stream, where there is an in-place upgrade | 15:16 |
| mgoddard | there won't necessarily be one for CS8 to CS9 | 15:16 |
| yoctozepto | ahm | 15:16 |
| mgoddard | in which case we're back to a rolling reinstall | 15:17 |
| yoctozepto | I meant more like allowing Xena to deploy on CentOS Stream 8 still | 15:17 |
| yoctozepto | and have 9 in containers | 15:17 |
| yoctozepto | that's what we allow on debuntu, except for a slight version reversal | 15:17 |
| mgoddard | could do that | 15:17 |
| yoctozepto | but then you could tell | 15:17 |
| yoctozepto | cs8 + wallaby -> cs8 + xena -> cs9 + xena | 15:18 |
| yoctozepto | roll as you wish | 15:18 |
| mgoddard | although I think ideally containers should be ahead of hosts | 15:18 |
| yoctozepto | yeah, they will be | 15:18 |
| mgoddard | sorry, other way around | 15:18 |
| yoctozepto | I think we are fine | 15:18 |
| mgoddard | https://access.redhat.com/support/policy/rhel-container-compatibility | 15:19 |
| yoctozepto | people been running focal on bionic for a year now | 15:19 |
| mgoddard | maybe | 15:19 |
| mgoddard | we can speculate | 15:19 |
| yoctozepto | tier 3 is fine for what we don't have anyway | 15:19 |
| mgoddard | but it needs to be tested | 15:19 |
| yoctozepto | yes, that's the goal | 15:19 |
| yoctozepto | test - if it works, go with it | 15:19 |
| yoctozepto | if not - cry and adapt | 15:20 |
| mgoddard | perhaps centos will have imploded by then | 15:20 |
| yoctozepto | that could work too | 15:20 |
| mnasiadka | Wonder if stream Victoria gives us 7.4 as well | 15:20 |
| yoctozepto | mnasiadka: yes, it does imho | 15:20 |
| yoctozepto | because it's just adv virt repo for stream | 15:20 |
| yoctozepto | but yeah, check it please | 15:21 |
| mgoddard | let us move on | 15:21 |
| mgoddard | #topic podman (ohorecny) | 15:21 |
| yoctozepto | ohorecny2, the floor is yours | 15:21 |
| ohorecny2 | hi all again | 15:21 |
| ohorecny2 | ok, thanks | 15:21 |
| yoctozepto | hi ohorecny2 again | 15:21 |
| ohorecny2 | mayve I can quickly introduce myself | 15:21 |
| yoctozepto | please go ahead | 15:21 |
| ohorecny2 | my name is Oliver and I am working in TietoEvry. In our company we are interested in support of Podman in kolla-ansible. | 15:22 |
| ohorecny2 | The main reason is that docker isn't supported by RedHat since Rhel8. | 15:22 |
| ohorecny2 | In our company we decided to invest some time for implementation of this support. | 15:23 |
| ohorecny2 | I am leader of this project and for now we are in stage that we are able to deploy basic all-in-one deployment based on Podman containers. | 15:24 |
| ohorecny2 | These containers are running as services and it seems that OpenStack is functional (we are able to spawn new VM, etc.) | 15:24 |
| ohorecny2 | For now we are testing only on CentOS 8 | 15:25 |
| ohorecny2 | Regarding code we are using master og kolla-ansible, where we added new option to globals.yml fro user to choose contaner engine (Docker / Podman). | 15:26 |
| ohorecny2 | So each service has its own tasks for Docker and also for Podman. | 15:26 |
| ohorecny2 | This means that whole change is quite big. | 15:26 |
| ohorecny2 | The biggest challenge was replacement of kolla-docker module, which is mostly replaced by existing ansible modules for Podman. | 15:27 |
| ohorecny2 | Unfortunately it was not possible to replace everything and we needed to use also podman-py library for API calls (for getting some container facts) | 15:28 |
| ohorecny2 | I guess that this can be replaced somehow in future. | 15:28 |
| ohorecny2 | We would like to propose this change for review as soon as possible. We need to firstly do some internal review and do squash of commits. | 15:29 |
| ohorecny2 | I just want to know what do you think about it and few other questions. | 15:30 |
| mgoddard | Thank you for the overview ohorecny2 | 15:30 |
| mgoddard | I think people will want to see the code to get a feel for the approach | 15:30 |
| yoctozepto | ++ | 15:30 |
| mgoddard | are you using systemd to run the containers? | 15:30 |
| ohorecny2 | sure, as I mentioned we would like to propose this change in next few days. But it is quite big so reviewing will be so complicated. Also CI checks will be needed to adapt for this. | 15:31 |
| yoctozepto | btw, debian now supports podman with systemd natively as well, ubuntu will in 22.04 | 15:32 |
| ohorecny2 | mgoddard: yes, each container has its own service file | 15:32 |
| mgoddard | ohorecny2: did you see this PoC? https://github.com/stackhpc/kolla-ansible/commit/e44d4b028e3aa24955dd12271783287ae43a5603 | 15:32 |
| yoctozepto | I think we might be able to save some complexity by applying some refactoring we have in proposals | 15:32 |
| ohorecny2 | yoctozepto: yes that is right, we did not consider Ubuntu or Debian yet | 15:34 |
| yoctozepto | no problem | 15:34 |
| ohorecny2 | mgoddard: yes, I saw it some time ago | 15:34 |
| mgoddard | ok | 15:35 |
| yoctozepto | just mentioning we could test portability with debian | 15:35 |
| mgoddard | ohorecny2: it is possible to push a patch chain to gerrit. If the commits are already cleanly separated then no need to squash them | 15:35 |
| ohorecny2 | mgoddard: by that way how it is possible to start / restart containers during some actions, but not possible to create new containers. | 15:36 |
| ohorecny2 | so, ansible modules for podman are used for container creatin | 15:36 |
| ohorecny2 | *creation | 15:36 |
| mgoddard | L20 of the unit file does a docker/podman run | 15:37 |
| mgoddard | which creates a container | 15:37 |
| mgoddard | I did not test it very much | 15:38 |
| mgoddard | I just wanted to get the concept into a commit | 15:38 |
| mnasiadka | Ceph uses the same approach for a long time, so I guess not a lot of testing needed | 15:39 |
| mgoddard | mnasiadka: LOL | 15:39 |
| mgoddard | just chuck it in | 15:39 |
| mnasiadka | mgoddard: I mean just running docker/podman run --rm from a systemd unit, not the whole functionality :D | 15:40 |
| yoctozepto | lol | 15:40 |
| yoctozepto | meh | 15:40 |
| ohorecny2 | mgoddard: right, but what about pulling images and etc? | 15:40 |
| mnasiadka | Can't wait to see the proposal, and then we can discuss :) | 15:40 |
| mgoddard | ohorecny2: yeah, there will be cases where systemd is not enough | 15:41 |
| mgoddard | I would like to see a short spec on this | 15:41 |
| ohorecny2 | mgoddard: yes, there are several cases, that it is not possible to do by that way I think | 15:41 |
| ohorecny2 | mnasiadka: sure, as I mentioned, it is on the way :) | 15:42 |
| mgoddard | it is a large enough change that we should do some up front thinking/design | 15:42 |
| mgoddard | so I would suggest this as a rough plan | 15:42 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/train: baremetal: Don't start Docker after install on Debian/Ubuntu https://review.opendev.org/c/openstack/kolla-ansible/+/791582 | 15:42 |
| mnasiadka | mgoddard: agree, we don't normally do specs - but that's core functionality | 15:42 |
| mgoddard | 1. ohorecny2 to share current state of code with community via gerrit | 15:43 |
| mgoddard | 2. community reads code and does some thinking | 15:43 |
| ohorecny2 | mgoddard: yes, exactly, this change is huge I think. For few basic services it was more than 255 files changed and around 9000 insertions | 15:43 |
| mgoddard | 3. community discusses the approach and agrees a rough direction | 15:43 |
| mgoddard | 4. ohorecny2 & colleagues write a spec describing the agreed direction | 15:44 |
| mgoddard | 5.adapt code to spec & iterate | 15:44 |
| yoctozepto | ++ | 15:45 |
| mgoddard | what I would like to know is, do ohorecny2 & team have the capacity to drive this through to completion? | 15:45 |
| ohorecny2 | regarding #5 yes, when this will be in review we will definitely need to adapt it, because we have there some workarounds which needs to be changed | 15:46 |
| mgoddard | we are very limited on review resources, and I would hate to see us put in a *lot* of review time for this patch then not see it completed | 15:46 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/victoria: CI: Fix nfv job with kolla dependency https://review.opendev.org/c/openstack/kolla-ansible/+/797698 | 15:47 |
| ohorecny2 | mgoddard: yes, I discussed this with management and we would like to finish this till end. It is agreed at least till end of this year. | 15:47 |
| mgoddard | great! | 15:48 |
| ohorecny2 | I hope that it is possible to finalize. | 15:48 |
| ohorecny2 | we would like to even adapt kolla to image build base on podman | 15:48 |
| mgoddard | it will be important to find out answers to important questions early | 15:49 |
| ohorecny2 | yes that is right | 15:49 |
| ohorecny2 | that is the reason why I am here :D | 15:49 |
| mgoddard | in particular, do all distros supported by kolla have support for podman | 15:49 |
| ohorecny2 | maybe also, which version of ansible is planned for next release | 15:50 |
| mgoddard | probably min 2.10, max 2.11 | 15:50 |
| mnasiadka | around podman - remember each distro basically has a different version | 15:50 |
| mnasiadka | mgoddard: there is no 2.11, unless you're speaking about ansible-base :) | 15:51 |
| mgoddard | yes | 15:51 |
| yoctozepto | I think we want to go ansible-2.11 and choose the installed modules | 15:51 |
| yoctozepto | need to discuss that | 15:51 |
| ohorecny2 | so far we are testing with ansible 2.9 | 15:51 |
| mnasiadka | I think we discussed that already on the PTG, and agreed we start with that approach with kolla-toolbox, and see how it goes. | 15:52 |
| mnasiadka | yoctozepto: ^^ | 15:52 |
| yoctozepto | something like that indeed | 15:52 |
| yoctozepto | yes, I am here | 15:52 |
| mnasiadka | sorry, too many calls today discussing network packet processing ;) | 15:52 |
| yoctozepto | mnasiadka: did you mention "encapsulation"? | 15:53 |
| mnasiadka | yoctozepto: I even started that, but then we also need to move to FQCNs most probably | 15:53 |
| mgoddard | does anyone have any more questions for ohorecny2 ? | 15:53 |
| yoctozepto | mnasiadka: we should; I think there is a tool to migrate that | 15:53 |
| yoctozepto | mgoddard: I need to see the code; and test on debian | 15:54 |
| yoctozepto | I can help with CI | 15:54 |
| mgoddard | ok, then let's move on | 15:55 |
| mnasiadka | nevermind the podman versions, seems now it's 3.0 everywhere | 15:55 |
| mnasiadka | so we should be ok | 15:56 |
| mgoddard | Thanks ohorecny2 that was a helpful discussion | 15:56 |
| yoctozepto | ++ | 15:56 |
| mgoddard | If you'd like to discuss again, feel free to ping one of us or add an item to the agenda on the wiki | 15:56 |
| ohorecny2 | thank you too | 15:56 |
| mgoddard | #topic Open discussion | 15:56 |
| mgoddard | Does anyone have anything today? | 15:56 |
| yoctozepto | I believe podman is able to be less problematic than docker | 15:56 |
| yoctozepto | but we will see | 15:56 |
| headphoneJames | yes - I have a basic question | 15:56 |
| yoctozepto | I have a lot of local stuff atm | 15:57 |
| headphoneJames | It seems like DevStack and tripleo use cloud.yaml to define the initial openstack users with scope. | 15:57 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/victoria: [CI] Fix the NFV scenario https://review.opendev.org/c/openstack/kolla-ansible/+/797702 | 15:57 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/victoria: CI: Fix nfv job with kolla dependency https://review.opendev.org/c/openstack/kolla-ansible/+/797698 | 15:58 |
| headphoneJames | KA creates users using OpenStack Ansible modules like "os_user" - those modules do not accept scope as an argument. | 15:58 |
| mgoddard | headphoneJames: users for what purpose? | 15:58 |
| headphoneJames | initial roles + users | 15:58 |
| headphoneJames | to admin the cloud | 15:58 |
| mnasiadka | headphoneJames: have you checked if ansible collection does? https://github.com/openstack/ansible-collections-openstack/ | 15:59 |
| headphoneJames | mnasiadka: not yet - so I can start there | 15:59 |
| mgoddard | headphoneJames: do you mean for tasks using the kolla_toolbox module to register endpoints, users, etc? | 16:00 |
| headphoneJames | yes | 16:00 |
| mgoddard | the downside of that is that you have to put some full admin creds on disk | 16:00 |
| yoctozepto | we can use a ramdisk | 16:01 |
| mgoddard | whereas we specify them on demand | 16:01 |
| opendevreview | Mark Goddard proposed openstack/kayobe master: Ubuntu: add upgrade jobs in CI https://review.opendev.org/c/openstack/kayobe/+/797626 | 16:01 |
| mgoddard | we could use a ramdisk, but it's still accessible always | 16:02 |
| headphoneJames | however, we may not be able to specify the scope of a user/role using kolla_toolbox approach? | 16:02 |
| mgoddard | ah, openstack modules don't provide the option? | 16:02 |
| headphoneJames | or really I'm just not sure how we do that | 16:02 |
| mnasiadka | they don't provide the option, even the latest ones in the collection | 16:03 |
| mnasiadka | so first it would need to be added there | 16:03 |
| headphoneJames | it didn't look that way from my initial digging, but I haven't looked at the code in https://github.com/openstack/ansible-collections-openstack/ | 16:03 |
| headphoneJames | so the first step is to update the ansible modules for openstack? | 16:04 |
| mnasiadka | we already update the Ansible modules for OVS, so you can follow the approach | 16:04 |
| mgoddard | it might be worth looking into - now the modules are in a collection we could potentially pull in a newer version in the kolla-toolbox image | 16:04 |
| mnasiadka | headphoneJames: https://review.opendev.org/c/openstack/kolla/+/782906 | 16:05 |
| mgoddard | anyways, we should wrap up | 16:05 |
| mgoddard | thanks all | 16:05 |
| mnasiadka | thanks mgoddard | 16:05 |
| mgoddard | #endmeeting | 16:05 |
| opendevmeet | Meeting ended Wed Jun 23 16:05:44 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:05 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/kolla/2021/kolla.2021-06-23-15.00.html | 16:05 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/kolla/2021/kolla.2021-06-23-15.00.txt | 16:05 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/kolla/2021/kolla.2021-06-23-15.00.log.html | 16:05 |
| yoctozepto | thanks mgoddard | 16:06 |
| headphoneJames | thanks | 16:07 |
| *** rpittau is now known as rpittau|afk | 16:08 | |
| opendevreview | Merged openstack/kayobe stable/ussuri: Update seed VM image to CentOS 8.4 https://review.opendev.org/c/openstack/kayobe/+/796670 | 16:30 |
| opendevreview | Verification of a change to openstack/kayobe failed: Prevent matching unrelated images https://review.opendev.org/c/openstack/kayobe/+/795831 | 16:30 |
| *** gfidente is now known as gfidente|afk | 16:34 | |
| *** samcat11_ is now known as samcat116_ | 18:09 | |
| opendevreview | Albert Braden proposed openstack/kolla-ansible master: Added upgrade note for separate nova and cinder keys. https://review.opendev.org/c/openstack/kolla-ansible/+/796948 | 18:50 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/train: baremetal: Don't start Docker after install on Debian/Ubuntu https://review.opendev.org/c/openstack/kolla-ansible/+/791582 | 19:25 |
| *** gilou_ is now known as Gilou | 22:48 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!