Tuesday, 2025-01-07

opendevreviewFarbod Saghafi proposed openstack/openstack-ansible-lxc_container_create master: Solving naming issue of OVS ports for lxc  https://review.opendev.org/c/openstack/openstack-ansible-lxc_container_create/+/93842407:06
jrossero/ morning08:18
noonedeadpunko/08:25
jrosseri was just looking at your molecule tests for networkd - which bits were troublesome?08:27
noonedeadpunkso networkd doesn't bring interfaces up in docker08:28
jrosserlocally here it seems also to need https://review.opendev.org/c/openstack/ansible-config_template/+/93850708:28
jrosser`ERROR! Unexpected Exception, this is probably a bug: No module named 'distutils'`08:28
noonedeadpunkit feels that networkd misses some requirement for that... as `ip link` works nicely08:29
noonedeadpunkand it creates interfaces...08:29
jrosseri was trying to reproduce that https://paste.opendev.org/show/blq6VfiPvDUv1Rjlu42U/08:30
noonedeadpunkum... I didn't have such issue08:32
noonedeadpunkit passes nicely for me up to tests08:33
noonedeadpunk* to verify08:33
noonedeadpunkand fails on first assert, as DOWN interfaces do not end up in facts08:34
jrosseri am on a noble vm if that makes any difference08:35
noonedeadpunkI'm on noble laptop....08:35
noonedeadpunkand you run `tox -e molecule` ?08:36
jrosseri had exactly the same trouble with molecule in the config_template repo too08:36
jrosseryes08:36
noonedeadpunkoh, well. I think I know - I have venv with python3.11 for tox08:37
noonedeadpunk:D08:37
jrosserthe cleanup in config_template feels legit - its for very very old stuff08:38
noonedeadpunkpython3.11 is available on noble and as I was upgrading from jammy - venv left on it...08:38
noonedeadpunkyeah. true08:38
noonedeadpunkbut then the role is pulling master config_template08:38
noonedeadpunkas part of requirements08:39
jrosserso thats an interesting thing - we can't really depends-on the config-template change08:39
noonedeadpunknope..08:41
noonedeadpunkbut also there's a problem with noble docker image kind of08:42
jrosserthat two seperate things, host OS vs image?08:45
noonedeadpunkyeah08:45
jrosserhrrm so to make working on any of this less painful we need to patch to openstack-ansible and config_template landing08:46
jrosserthis https://review.opendev.org/c/openstack/openstack-ansible/+/93822008:47
jrosserand https://review.opendev.org/c/openstack/ansible-config_template/+/93850708:47
noonedeadpunkok, so networkd working on ubuntu - not debian... doh08:52
noonedeadpunkubuntu jammy though08:52
noonedeadpunkso it's obviously missing some parts08:53
noonedeadpunkwhich are shipped with normal image08:53
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Do not try to configure resolved when it's not available  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851208:57
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Don't run systemd task in async  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851508:57
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851708:57
opendevreviewJonathan Rosser proposed openstack/ansible-config_template master: Remove support for python2 and ansible < 2.9  https://review.opendev.org/c/openstack/ansible-config_template/+/93850708:59
opendevreviewJonathan Rosser proposed openstack/ansible-config_template master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-config_template/+/93851308:59
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Do not try to configure resolved when it's not available  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851209:19
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Don't run systemd task in async  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851509:19
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851709:19
noonedeadpunkcentos also fails.... so only ubuntu jammy is passing networkd right now09:32
noonedeadpunkjrosser: have you seen that? https://www.phoronix.com/news/Fedora-Maybe-Retire-GlusterFS09:40
jrosseroh, no i had not09:41
noonedeadpunkhuge part is - `CentOS Storage SIG decided to not build GlusterFS packages for CentOS Stream 10` 09:41
noonedeadpunksounds like time to replace gluster....09:42
jrosserthat is indeed an interesting choice of what to use09:43
noonedeadpunkthe only idea I have right now - is minio....09:46
noonedeadpunkand it could replace apache as well I guess09:46
jrosseri wonder if thats sufficient to make pip install from it09:47
jrosseras S3 is not exactly the same as web browser -> directory of files09:47
noonedeadpunkit's s3 kinda... 09:47
noonedeadpunkbut it very close to it? as it also can allow listings if bucket is public?09:48
jrosserbut yes minio probably has good life in it as it's used a lot as stand-in for real S3 in lots of cases09:48
noonedeadpunkand it seems to have bucket replication in it09:50
noonedeadpunkwell, we can do s3fs mount at worst :D09:50
noonedeadpunkI wonder how bad is lustre....09:59
noonedeadpunkgit looks alive at least: https://git.whamcloud.com/?p=fs/lustre-release.git;a=shortlog10:00
noonedeadpunkbut probably minio is easier, as at least it stores data as regaular files on the storage, so we likely can even preserve current repo server layout completely10:09
noonedeadpunkgot systemd debug logs for networkd: https://paste.openstack.org/show/bGrUfpjnV2vyQ8QhCH3r/11:36
noonedeadpunkI wonder if that's requiring udev11:38
noonedeadpunk"link pending udev initialization"11:40
noonedeadpunkyeah. it's udev...11:58
jrosserwe probably have clues to this in the lxc hosts role when preparing the lxc images12:01
jrosserhuh https://github.com/openstack/openstack-ansible-lxc_hosts/commit/ee28a80de0ff81ddc96b9bb8a82806bce417cf4f12:02
noonedeadpunkwell. it somehow feels that container restart is required on udev installation12:07
noonedeadpunkor maybe not12:07
noonedeadpunkok, we'd need to discuss if we want to do all that in-role or specifically in molecule script...12:10
noonedeadpunkI'll push an update now...12:10
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851712:27
noonedeadpunkok, so basically question - what we do with these? https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/938517/4/tests/prepare.yml12:29
noonedeadpunkand I think it's better to change in a follow-up anyway12:30
jrosserthats not obvious somehow12:36
jrosseras one way we add quite some more tasks to a role thats used many times12:36
jrosserand how much we actually support the role inside docker for real use is another question12:37
noonedeadpunkthe thing is that these requirements of role are not obvious at all either12:37
noonedeadpunkpolicycoreutils needed only for this for instance https://opendev.org/openstack/ansible-role-systemd_networkd/src/branch/master/tasks/main.yml#L4812:38
noonedeadpunkand could be that better to add condition `ansible_facts['selinux']['status'] == 'enabled'` instead12:39
jrosserwe already have systemd_networkd_distro_packages tbh, so maybe extending those lists with the mandatory dependancies is not so bad12:40
noonedeadpunknow when I have mlecule passing - I can play with this 12:43
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851712:59
opendevreviewMerged openstack/ansible-config_template master: Remove support for python2 and ansible < 2.9  https://review.opendev.org/c/openstack/ansible-config_template/+/93850713:03
jrossernoonedeadpunk: i think you need ansible.utils in the systemd_networkd requirements.yml13:18
jrosser(for ansible.utils.ipaddr)13:19
noonedeadpunkah, yes, good catch14:18
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851714:19
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851714:20
opendevreviewMerged openstack/openstack-ansible master: Add centralized defenition for molecule jobs  https://review.opendev.org/c/openstack/openstack-ansible/+/93822014:27
opendevreviewJonathan Rosser proposed openstack/ansible-config_template master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-config_template/+/93851314:39
jrosserthere is some unusual behaviour with diff: true for config_template ^14:41
jrosserthat passes locally but i'm not sure if the tests i've "fixed" are particularly valid14:42
noonedeadpunkiirc diff doesn't really work for config_template14:42
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Install role pre-requisite packages  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93856014:48
noonedeadpunkok, so installation packages is not too bad ^14:48
opendevreviewJonathan Rosser proposed openstack/ansible-config_template master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-config_template/+/93851314:50
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Do not try to configure resolved when it's not available  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851214:51
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Don't run systemd task in async  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851514:51
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851714:51
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Install role pre-requisite packages  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93856014:51
jrossersmall typo in the commit message "hanled"14:52
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Install role pre-requisite packages  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93856014:52
* noonedeadpunk looking at config_template14:59
spatelnoonedeadpunk hey! morning 14:59
spateldid you ever use GPU with Magnum k8s stuff?14:59
noonedeadpunknope, I did not14:59
spatelMy developer wants to do some AI stuff on k8s and asking for GPU :)14:59
opendevreviewJonathan Rosser proposed openstack/ansible-config_template master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-config_template/+/93851315:00
noonedeadpunk#startmeeting openstack_ansible_meeting15:00
opendevmeetMeeting started Tue Jan  7 15:00:41 2025 UTC and is due to finish in 60 minutes.  The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'openstack_ansible_meeting'15:00
noonedeadpunk#topic rollcall15:00
jrossero/15:01
noonedeadpunko/15:01
* jrosser will be 5 mins15:01
noonedeadpunk#topic office hours15:04
noonedeadpunkso we're having a good progress for migration from tests repo to molecule testing15:05
noonedeadpunk#link https://review.opendev.org/q/topic:%22osa/molecule%2215:05
noonedeadpunkI've just issued re-checks for failing ones, as patch to integrsated repo was merged15:06
jrosserit looks pretty reasonable tbh15:06
noonedeadpunkthere're were hiccups, like I have no idea how to run swapon inside docker, so commented out that test at all15:07
jrosserthough some things will be harder/impossible to test in docker15:07
noonedeadpunkyeah, quite some time went down the pipe for systemd-networkd15:07
noonedeadpunkfrom other side - we can run multiple containers and connect them with multiple networks15:07
noonedeadpunkso technically - we can do some kind of mnaio in the future....15:08
noonedeadpunkanother thing that had a progress - httpd role15:09
noonedeadpunk#link https://review.opendev.org/q/topic:%22osa/httpd_role%2215:09
NeilHanlono/ 15:10
noonedeadpunkrepo server does have a circular dependency with integrated repo15:10
noonedeadpunkand some small portion of love needed for skyline and centos/rocky15:10
noonedeadpunkNeilHanlon: o/ - good that you've joined :)15:11
NeilHanlonheyo :) happy new year15:11
noonedeadpunkI didn't look for httpd role wrt horizon and keystone yet. But I think a base is relatively solid now15:11
noonedeadpunkchallanges there would be installing extra packages which provides extra modules (federation)15:12
noonedeadpunkand next thing we need to start thinking about is EL1015:13
noonedeadpunkjust today I've found out, that Storage SIG decided not to build gluster for centos, which is kind of a biggie for us15:14
noonedeadpunkwith that I was thinking, if NeilHanlon maybe you can make some kind of copr repo for gluster for now?:)15:14
NeilHanlonah yes.. i saw that as well. i think I saw a fedora packager that I am friendly with picked it up in Fedora (as RH disbanded from it there, too...)15:15
NeilHanlonmaybe i am misremembering though15:15
NeilHanlonmy brain still waking up15:15
NeilHanlonnope... https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org/thread/D4QN2OFKQWN66HVKUG4CG4XPRW5ON62Z/#7JR2A5XTBFMQU2B6TW7XBEORF5O6OCXA15:15
NeilHanlonanyways. yes, i will come up with a plan :) 15:15
noonedeadpunkwhile we're thinking on a more long-term solution... like minio or smth....15:16
NeilHanloni feel like it's probably not going away any time soon15:17
noonedeadpunkbut I'd really prefer not to do that this cycle while having EL10 support in15:17
NeilHanlonyeah we have enough with modular libvirt and such15:18
noonedeadpunkindeed15:18
noonedeadpunkbtw, any idea about rocky timeline for 10? 15:19
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-repo_server master: Use FQCN for modules  https://review.opendev.org/c/openstack/openstack-ansible-repo_server/+/93827215:20
NeilHanlonright now the only blockers are that we have to redo some stuff on how we sign secureboot artifacts because EL10 ripped out OpenSSL "Engine" support15:20
NeilHanlonand our signing relies on pkcs11 stuff15:20
noonedeadpunkwait, what?15:21
NeilHanlonhttps://discussion.fedoraproject.org/t/f41-change-proposal-disable-openssl-engine-support-system-wide/10751115:21
noonedeadpunkI kind of wonder if that affects our pki role 15:23
opendevreviewJonathan Rosser proposed openstack/ansible-config_template master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-config_template/+/93851315:23
NeilHanloni don't think it should15:23
NeilHanlonbut, maybe15:24
noonedeadpunkbut probably not... not sure about things like barbican with HSM though15:24
noonedeadpunkas it;s mainly relying on PKCS#11 as well15:24
NeilHanlonyeah I think that is more the possible problematic points. we're at the intersection of HSM for signing which I don't even know that RH has an answer for at this point15:24
noonedeadpunkbut ok, I see. thanks for the update!15:24
noonedeadpunkand I don't think they're willing to help either...15:25
NeilHanlonof course! and I'm also still wanting to get mirrors setup of the content for opendev this year.. i took on too much the end of last year15:25
noonedeadpunkbtw, as we've switched from mirrorlist to the baseurl - we don't see broken mirrors anymore :)15:26
jrosserfwiw barbican will talk directly to the vendor pkcs11 .so file, there should not be any openssl involved there15:29
jrosserits a python <> C interface15:30
noonedeadpunkyeah, right15:30
noonedeadpunkok, then I think it's good15:30
noonedeadpunkNeilHanlon: btw, another question related to our molecule efforts. you publish rocky docker images only on dockerhub?15:33
noonedeadpunkah, I found on quay already, lol15:34
noonedeadpunk#link https://quay.io/repository/rockylinux/rockylinux?tab=tags15:34
noonedeadpunkI wonder if we actually can just install systemd there at prepare step....15:36
jrosserdoesnt it need to be the entrypoint15:36
* jrosser handwaves15:36
noonedeadpunkwell, I'm doing docker describe right now, and it seems that entrypath is `/sbin/init`15:38
noonedeadpunkbut I think you're right and regular one may just not startup15:41
jrosserhttps://github.com/eniocarboni/docker-rockylinux-systemd/blob/main/Dockerfile15:43
noonedeadpunkyeah, I see15:43
NeilHanlonif you need systemd you can maybe use the ubi image?15:43
NeilHanlonhttps://github.com/rocky-linux/sig-cloud-instance-images/blob/main/Containerfile-init15:44
noonedeadpunkwell, we want to test debian, ubuntu and some el15:44
noonedeadpunkaha15:44
noonedeadpunklet me check that :)15:44
NeilHanloninteresting, looks like we aren't publishing a 9.5-ubi-init. i will have to check on that...15:45
NeilHanlonor maybe we don't, i forget. need to redo all this soon lol15:45
noonedeadpunkthere is 9-ubi-init15:46
NeilHanlonyeah i think we just don't publish the ubi variants with a minor rev15:47
NeilHanlonbecause they're descendants of the 9.5.20241118-ubi15:47
NeilHanlonanyways yea that image should work alright for applications15:49
opendevreviewJonathan Rosser proposed openstack/ansible-config_template master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-config_template/+/93851315:51
noonedeadpunkdoh, there's no sudo even inside :D15:51
noonedeadpunkbut yes, otherwise it's working nicely!15:52
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-pki master: Add molecule testing  https://review.opendev.org/c/openstack/ansible-role-pki/+/83123615:53
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Add RockyLinux to molecule testing  https://review.opendev.org/c/openstack/openstack-ansible/+/93857115:57
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93851715:59
noonedeadpunk#nedmeeting16:00
noonedeadpunk#endmeeting16:00
opendevmeetMeeting ended Tue Jan  7 16:00:48 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:00
opendevmeetMinutes:        https://meetings.opendev.org/meetings/openstack_ansible_meeting/2025/openstack_ansible_meeting.2025-01-07-15.00.html16:00
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/openstack_ansible_meeting/2025/openstack_ansible_meeting.2025-01-07-15.00.txt16:00
opendevmeetLog:            https://meetings.opendev.org/meetings/openstack_ansible_meeting/2025/openstack_ansible_meeting.2025-01-07-15.00.log.html16:00
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_mount master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-role-systemd_mount/+/93848916:02
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_service master: Replace functional tests with molecule  https://review.opendev.org/c/openstack/ansible-role-systemd_service/+/93849216:04
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd master: Install role pre-requisite packages  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/93856016:05
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-frrouting master: Use centralized requirements for molecule testing  https://review.opendev.org/c/openstack/ansible-role-frrouting/+/93822216:07
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-frrouting master: Use centralized requirements for molecule testing  https://review.opendev.org/c/openstack/ansible-role-frrouting/+/93822216:39
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-pki master: Add molecule testing  https://review.opendev.org/c/openstack/ansible-role-pki/+/83123616:40
noonedeadpunkseems like config_template is fixed?16:43
jrosseryes i had quite a big fight with it :)16:45
noonedeadpunkwould be interesting to look into diff part kinda16:45
jrosserit might be a bit rough in places as a pushed what i had to avoid some accident and losing it16:45
jrossermy suspicion is that the old tests ran localhost/connection: local and that made some special behaviour16:46
jrosserthat does not occur with an actual remote target16:46
noonedeadpunkyeah, could be, but we also do trigger service restarts on config changes, so idempotency there kind of important16:47
jrosserthe config_template code has some conditional open('file') vs. calling slurp which would certainly behave differently16:47
jrosserand i think that is the root cause of the failure to evaulate {{ baz }}16:47
jrosserwith -vvvvv it was failing in the use of slurp rather than in config_template itself but it is exceedingly hard to debug it16:48
jrosserthe other one was this https://github.com/openstack/ansible-config_template/blob/master/tests/templates/test.ini#L616:50
jrosserthat is descrbied as being removed by the diff output, making the task be changed16:50
jrosserbut without diff it is not changed16:50
jrosserso there is something odd happening there, but i did not investigate further yet16:51
noonedeadpunk> with -vvvvv it was failing in the use of slurp rather than in config_template - ah, that would make sense, yes16:51
jrosser^ yes so I think that test failure is triggered by the not local connection16:51
noonedeadpunkbut test.ini#L6 s kind of more concerning... but I think it can be followed-up later on16:52
jrosserright - i did not know what the expectation was - if the empty section should be preserved or removed16:53
noonedeadpunkas we don't see anything too obvious being wrong wrt idempotency with config_template right now anyway16:53
noonedeadpunkthat's a good question... Not sure either, but it should not result in changed task if nothing is actually changed16:54
noonedeadpunkand if it always removing section, then result is not changed consistently16:54
jrosserwe can WIP this for now and take a closer look?16:55
noonedeadpunkany fixes to module still should be in follow-ups, imo16:55
jrosserthough tbh we do not change the code/behaviour, just that the test before did not test idempotence at all16:55
noonedeadpunkyeah16:56
noonedeadpunkso it's not getting different from current state. just indicator that we have potenitally fishy behaviour in module16:56
jrosseryep16:56
noonedeadpunkso we can land this and interate over16:56
mgariepykleini, https://github.com/prometheus-community/ansible/pull/474 look at : https://github.com/prometheus-community/ansible/pull/50719:13

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!