Tuesday, 2022-11-08

gokhanihi folks, 08:14
damiandabrowskihi!08:42
jrossermorning09:11
*** dviroel|afk is now known as dviroel09:48
mathlinif i replace br-vlan with a openvswitch bridge in a AIO, do i get mandatory extra bridges br-tun and br-int? If not, how do i remove them, can't seem to find them in the configuration files11:58
jrossermathlin: i'm not sure i can follow the question totally there12:42
jrosserif you dont get the bridges then then you would not be able to remove them? <- i'm confused12:43
dokeeffe85Hi all, not an OSA question so if I need to ask somewhere else please let me know. We have a current openstack cluster and we can create snapshots of vm's no problem. We had to make a 200GB flavour for an instance and when we try to snapshot it it fails but we don't see much in the logs. Is there a timeout or size limit that need to be adjusted? We have more than 450GB free and it seems to use about 300GB of that space and fails. All other 12:53
dokeeffe85volumes snap successfully just not the 200GB12:53
jrosserdokeeffe85: are those snapshots created using temporary space on one of your infra nodes? It's not clear where you have >450G free.....13:09
dokeeffe85We have a /mnt/nova-boot on all computes. that's where our nova boot instances are stored. We can see the space being used and all of a sudden it stops13:11
mathlinjrosser: i removed the lxbr br-vlan, and created the ovs br-vlan bridge and changed user_variables and openstack_user_variables to use openvswitch instead. Ran the playbooks and now i have openvswitch br-tun adn br-int. If i remove them they return somehow13:35
jrossermathlin: is this controllers or computes?13:35
mathlinboth its only one server13:38
jrosserok so you need those bridges don't you?14:01
mathlinno and they get my trunk tests interfaces 14:21
mathlinits in the agents table in the neutron database, not synced with whats in the config files then. I ran the neutron playbook, but that might not remove things14:45
jrosseri thought those bridges were required by neutron, but best asking jamesdenton i think14:58
noonedeadpunk#startmeeting openstack_ansible_meeting15:01
opendevmeetMeeting started Tue Nov  8 15:01:34 2022 UTC and is due to finish in 60 minutes.  The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
opendevmeetThe meeting name has been set to 'openstack_ansible_meeting'15:01
noonedeadpunk#topic rollcall15:01
jrossero/ hello15:01
damiandabrowskihi! I'm back from vacation15:01
noonedeadpunko\ I'm sema-around today, unfortunatelly15:02
noonedeadpunk#chair jrosser15:02
opendevmeetCurrent chairs: jrosser noonedeadpunk15:02
noonedeadpunkWill give chair if need to run or get distracted15:02
noonedeadpunkI'm on business trip this week so will be sem-around until friday (15:03
noonedeadpunk#topic office hours15:04
noonedeadpunkactually, we likely have a bug to discuss as well... I wanted to play with it but was short on time 15:04
noonedeadpunkIt was already discussed one day though15:04
noonedeadpunk#link https://bugs.launchpad.net/openstack-ansible/+bug/199357515:05
jrosserhmm15:07
jrosserthe searching for variable names to use kind of has to work15:08
jrosseras thats the only way that things like _pki_ca_defs get populated at all15:09
noonedeadpunkyeah, true15:09
noonedeadpunkmaybe it was some misusage ofc, so I wanted to test this out one more time15:10
noonedeadpunkAs I believe it should work indeed15:10
noonedeadpunkdamiandabrowski: do you want to share you recent finding about mariadbbackup?15:14
damiandabrowskiyeah, turns out that mariadb 10.6.8(used in some Xena tags) is affected by a mariabackup bug: https://jira.mariadb.org/browse/MDEV-2875815:15
damiandabrowskii'll bump 10.6.8 to 10.6.9 later(10.6.9 is fixed)15:16
damiandabrowskithere's one more thing: is it possible to merge this patch before Zed release?15:17
damiandabrowskihttps://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/86217115:17
noonedeadpunk+115:17
damiandabrowskidependent patch is already merged but it broke horizon direct image upload. We need to merge the above one to get it back working15:18
noonedeadpunkWe have to release Zed before by 15 of December15:18
noonedeadpunk*1615:19
noonedeadpunkAnd we should at least sort out glance image fully before that. What I mean - we should have full clearance if we should have 2 api spawned or not15:20
damiandabrowskiah ok, so i guess even we already created changes like this one: https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/860551 we're not going to release soon15:20
noonedeadpunkMaybe we should do that regardless, but make it configurable15:20
noonedeadpunkYes. So we need some reviews/rechecks as well15:21
noonedeadpunkAlso, Wallaby EM is coming15:21
noonedeadpunkI wanted to make final release based on https://review.opendev.org/c/openstack/openstack-ansible/+/861601 before EM-ing15:22
damiandabrowskiregarding 2 separate glance apis: in my opinion we don't have to that that, but let me copy paste my statement from some previous meeting:15:23
damiandabrowskiregarding glacnce OSSN-0090: I've read it once again and things are pretty clear for me now.15:23
damiandabrowskiI think the most important paragraph for us is: https://wiki.openstack.org/wiki/OSSN/OSSN-0090#:~:text=This%20brings%20us,the%20image%20data.15:23
damiandabrowskiSo actually we've made a huge improvement by disabling show_multiple_locations - it was a real threat.15:23
damiandabrowskishow_image_direct_url is just a potential issue. There is no confirmed attack vector. It's only about exposing image location which may help attackers.15:23
damiandabrowskiOn the other hand if we take RBD backend as an example, I believe most of the deployments have default config so direct URL isn't hard to guess(images/<image_id>/snap).15:23
damiandabrowskiSo is it worth to increase complexity of os_glance role because of this? I'm not sure...15:23
damiandabrowskiEspecially when I really hope it will be fixed properly at some point. Maybe mentioning it in docs like kolla did is enough. I leave it for discussion.15:23
noonedeadpunkMy patches for zookeeper/skyline are still not merged fwiw. I've made a mistake in them and updated jsut yestarday. Will ping infra during the week15:23
noonedeadpunkI think I more meant if you was able to talk to glance folks :)15:30
damiandabrowskii was going to talk to them because i didn't fully understand OSSN-0090 but after reading it once again i realized it's not needed anymore because everything is clear for me now15:31
noonedeadpunkum. ok. Then maybe we can just add comment on show multistore variable to the role?15:32
noonedeadpunkTbh why I'm concerned a bit, is that we might need to have to have and show multiple URLs for one of our projects...15:33
damiandabrowskiwhat comment do you have in mind? just an information saying that this option is unsafe? yeah, that would be good15:37
damiandabrowskiadditionally, I just realized I probably made a mistake in my changes...glance_show_multiple_locations should be disabled by default but it's not really15:38
damiandabrowskiI'll fix it tomorrow15:38
damiandabrowskibut regarding making use of `show_multiple_locations`, please be aware of what glance docs say nowadays: 'This option is deprecated for removal since Newton. Its value may be silently ignored in the future.'15:40
damiandabrowski'silently ignored' scares me a bit15:40
noonedeadpunkyeah, but it's obviously not...15:41
noonedeadpunkI have in mind AZ usecase15:42
noonedeadpunkthat if you have 3 ceph clusters and want to have image uploaded once but available in all AZs - you might need to show multiple urls15:44
damiandabrowskiyeah it's ok, i just wanted us to be aware that it can be silently ignored in the future without any release note :D at least that's how I understand it15:45
damiandabrowskibut I guess we don't have any other option anyway15:45
noonedeadpunkWell, there're set of nasty solutions that available :D15:46
noonedeadpunkbut yes, you're right about that15:46
damiandabrowskithere's one more thing: as I promised on PTG, I'll start work on internal TLS soon15:54
*** dviroel is now known as dviroel|lunch15:58
noonedeadpunk#endmeeting16:00
opendevmeetMeeting ended Tue Nov  8 16:00:57 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:00
opendevmeetMinutes:        https://meetings.opendev.org/meetings/openstack_ansible_meeting/2022/openstack_ansible_meeting.2022-11-08-15.01.html16:00
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/openstack_ansible_meeting/2022/openstack_ansible_meeting.2022-11-08-15.01.txt16:00
opendevmeetLog:            https://meetings.opendev.org/meetings/openstack_ansible_meeting/2022/openstack_ansible_meeting.2022-11-08-15.01.log.html16:00
opendevreviewMerged openstack/openstack-ansible-os_tacker master: Add deployment of tacker-scheduler  https://review.opendev.org/c/openstack/openstack-ansible-os_tacker/+/86187016:36
UltraHi folks! Any tips to install OSA `master` on Alma 9? Maybe a recursive `sed` should do the trick?16:40
*** dviroel|lunch is now known as dviroel16:59
opendevreviewMerged openstack/openstack-ansible-openstack_hosts master: Switch codename to Zed  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/86055117:01
jrosserUltra: have you tried it?17:06
opendevreviewMerged openstack/openstack-ansible-os_neutron master: Enable experimental execution of LXB if required  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/86259417:09
jrosserUltra: when investigating new/different OS for openstack-ansible you should use this in a VM https://docs.openstack.org/openstack-ansible/latest/user/aio/quickstart.html17:12
opendevreviewMerged openstack/openstack-ansible master: Make Ubuntu Jammy voting  https://review.opendev.org/c/openstack/openstack-ansible/+/86286917:43
opendevreviewMerged openstack/openstack-ansible master: [doc] Mark Victoria as EM  https://review.opendev.org/c/openstack/openstack-ansible/+/86228117:43
opendevreviewMerged openstack/openstack-ansible master: [doc] Mark Ocata/Pike/Queens as EOL  https://review.opendev.org/c/openstack/openstack-ansible/+/86228317:43
opendevreviewMerged openstack/openstack-ansible master: Mark Zaqar as deprecated in role matrix  https://review.opendev.org/c/openstack/openstack-ansible/+/86188417:43
opendevreviewMerged openstack/openstack-ansible master: Add release note about used ansible and ceph versions  https://review.opendev.org/c/openstack/openstack-ansible/+/86188917:43
opendevreviewDamian DÄ…browski proposed openstack/openstack-ansible-galera_server stable/xena: Bump mariadb version.  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/86405217:49
Ultrajrosser, I haven't tested on Alma 9 yet! I do have OSA AOI ready in hands... I'll try!18:40
*** dviroel is now known as dviroel|afk19:23
opendevreviewMerged openstack/openstack-ansible stable/wallaby: Bump OpenStack-Ansible Wallaby  https://review.opendev.org/c/openstack/openstack-ansible/+/86160119:48
opendevreviewMerged openstack/openstack-ansible stable/yoga: Switch Ceph for Ubuntu Jammy to distro  https://review.opendev.org/c/openstack/openstack-ansible/+/86299420:04
prometheanfirezed is still 20.04 for ceph?20:44
jrosserprometheanfire: maybe best to read this https://review.opendev.org/c/openstack/openstack-ansible/+/86267622:12
jrosserand this https://review.opendev.org/c/openstack/openstack-ansible/+/86249922:14
jrosserimho you are very wise to separate out your openstack and ceph22:15
prometheanfirejrosser: fair, maybe we should do that now before it's too late...22:38
jrosserprometheanfire: i think you have to be really clear about where you want to install ceph from22:40
jrosserbecasue in an OSA+ceph setup you've got the distro itself, UCA and download.ceph.com repos all installed22:40
jrosserand which do you use...... and unless you take some actual steps to prevent it then over time they move ahead / behind each other concerning which has the "latest" version which is what will get installed22:41
jrosserand depending where you want to install them from you don't get complete coverage of all OS releases vs. all ceph versions22:42
jrosserand then for UCA the Q release of ceph was dropped in without warning22:44
opendevreviewMerged openstack/openstack-ansible master: Switch master branch to track stable/zed  https://review.opendev.org/c/openstack/openstack-ansible/+/86054922:44
jrosserso my advice is to use apt pinning to constrain the repo and also the version you want22:44
jrosserexample of part of that being here https://github.com/openstack/openstack-ansible-openstack_hosts/blob/master/defaults/main.yml#L190-L19522:46
prometheanfireack22:46
jrosserbeware also that lxc and libvirt have dependancies on rbd, so you can get surprise "early" installation of ceph before the actual OSA ceph_client role has run and dropped its own apt pins22:47
jrosserconsider setting up the apt pins for ceph as part of your host provisioning long before OSA stuff is run22:49
prometheanfireI do an ansible run across hosts before osa, so there's that22:49
prometheanfireya22:49

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!