Thursday, 2023-07-27

noonedeadpunkdamiandabrowski: sleeping over with this keystone thing, I now think that this is real regression in keystone that should not have happened06:55
noonedeadpunklike you wrote, while we indeed can deal with services, we can't deal with users and that's real threat for upgrades atm06:56
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add openstack_resources role skeleton  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/87879407:04
damiandabrowskitrue, i also agree that's a weird decision to trim passwords to 54 chars. Trimming to 72 would be way more reasonable.07:16
noonedeadpunkAnd I kinda still think that our default should be crypt... as otherwise you sooner or later get to weird situation, when you realize that supplied password is not actually what is used, and worse if users discover that as well07:18
noonedeadpunkthat can be really akward 07:18
noonedeadpunkI'll reach keystone folks and have some talk with them07:18
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add openstack_resources role skeleton  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/87879407:47
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_tempest master: Adopt for usage openstack_resources role  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/88974107:47
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add openstack_resources role skeleton  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/87879407:47
anskiyI'm running compute nodes for poor^W^Whyperconverged with Ceph OSDs and ceph.conf on them changes between running ceph-install and os-nova-install (ceph-client role) like this: https://paste.opendev.org/show/b9vjBbYN8kweFa51ByX5/. Which leads to restarting all OSDs :)08:38
anskiyOne option, as was suggested by noonedeadpunk was setting `ceph_conf_file` in user_variables, but after careful considiration it looks like it's the worst one, because I lock myself from standard overrides to ceph.conf via `ceph_conf_overrides_custom` and would have to do them in two places. 08:38
anskiyThe other option was patching config_template to attach section-less comments to virtual section, which is kinda okay, along with removing some sections from generated ceph.conf, like this: https://paste.opendev.org/show/bEKCiuvVsg5AQz9Hucin/, so this patch does not fully work around this issue, especially because ceph.conf owner and group differ too between the roles.08:38
anskiyThe quick fix thing on which I've settled for now is removing unnecessary sections via user_variables and patching ceph-ansible to fix owner/group.08:39
anskiyWhat I think could be the proper way to fix this is changing ceph_client role somehow to either do nothing if ceph.conf (with ceph.conf only, as it still needs to provide keys to libvirt) is already present, or if ceph-ansible is part of deployment (not sure how to detect the later one tho). 08:39
noonedeadpunkanskiy: to be frank, the only thing that  needs to be in ceph.conf on clients is cluster fsid and definition of monitors08:41
noonedeadpunkso ceph_conf_file should be really minimal and should not require overrides08:42
noonedeadpunkas you have both these things in context/inventory08:42
noonedeadpunkthere's no reason to have default crush rule for clients - they even should not have permissions to leverage that08:43
noonedeadpunkI think we have it as short as 3-4 lines tops08:45
anskiybut you probably don't use integrated ceph-ansible: which results in two roles trying to manage one ceph.conf file, do you? :)08:46
noonedeadpunkbut does ceph-ansible try to manage ceph.conf on clients? Why?08:47
noonedeadpunkah, hyperconverged08:47
noonedeadpunkwe don't have that :D08:47
anskiyyeah08:47
* noonedeadpunk hates HCI08:48
anskiyI totally get, that this is only my problem and such, but I was thinking about some solution that could be upstreamed08:48
noonedeadpunkwell, technically you could run *everything* with --skip-tags ceph-config, but that's quite unrealistic I would say08:51
anskiyI can't -- secrets are deployed with this tag too08:51
anskiyfrom the separate task-file tho08:51
noonedeadpunksecrets you mean - ceph auth?08:52
anskiyyeah08:52
noonedeadpunkor `virsh secret-define`?08:52
noonedeadpunkyeah, ceph-auth as well08:53
anskiyceph_auth.yml which is secret-define08:53
anskiyhttps://opendev.org/openstack/openstack-ansible-ceph_client/src/branch/master/tasks/ceph_auth.yml#L6808:53
anskiyofftopic: so HCI case is the only requirement for ceph-install to be included in setup-infrastructure08:55
noonedeadpunk"changing ceph_client role somehow to either do nothing if ceph.conf is already present" -> you can't really do that. As once role will place ceph.conf once, it will stop managing it afterwards, as "it exists". So maybe we can have some variable to skip  ceph_config.yml but then it makes sense to skip keyrings (maybe)? as well.08:57
noonedeadpunkAlso this solution won't satisfy you in a year08:57
noonedeadpunkas in a year you won't have all computes running ceph, so you will want to still ceph_client role to distribute ceph.conf somewhere08:57
anskiynoonedeadpunk: this "in a year" POV sounds valid. And is kinda up for the quick fix route via ceph-ansible patch. Thank you!09:07
noonedeadpunkthat's how all HCI end up after some time - being desynced and impossible to plan hardware purchases and then rack becomes a mess as well09:09
anskiynoonedeadpunk: well, that's kinda why I named it "compute nodes for poor" (as opposed to real HCI), as this is what I've had in here under the control of in-house "cloud" solution prior to deploying openstack09:21
anskiyanyways, thanks!09:21
noonedeadpunkanskiy: hm, I know that clusters are going to be depercated, but you still can try to leverage them09:21
noonedeadpunkthen, ceph.conf will be placed under different name, and services will consume it (or original one)09:22
noonedeadpunkhttps://opendev.org/openstack/openstack-ansible-ceph_client/src/branch/master/tasks/ceph_config.yml#L4809:22
noonedeadpunkby ceph_client rol09:22
anskiyyeah, and I think that while prototyping multi-AZ ceph clusters I was probably using it09:23
anskiyso that would be another point in time where this thing would be reconsidered09:23
noonedeadpunkyup, me to...09:24
noonedeadpunkbut that should kinda solve your usecase, as ceph.conf will be jsut 2 independant files09:24
noonedeadpunknot conflicting with each other09:24
damnthem gridthis1009:26
* noonedeadpunk almost hear how someone is rotating passwords09:28
* anskiy hears it loudly as damnthem sits next to him09:31
halaliHi, on 24.6.1 https://paste.openstack.org/show/bNTmYiye5SArceHhOmEs/ and 27.0.1 https://paste.openstack.org/show/bQ3V9oOJvi6HMfDBZkfX/ utility complaining on metadata-generation-failed09:44
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_tempest master: Adopt for usage openstack_resources role  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/88974109:47
anskiyhalali: hey! The fix for that got merged after the release of 27.0.1: https://review.opendev.org/c/openstack/openstack-ansible-os_rally/+/887679 (so bootstrapping from stable/2023.1 should fix that problem), and for Xena there was no backport at all.10:17
halalianskiy thanks :)10:45
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add openstack_resources role skeleton  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/87879411:20
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_tempest master: Adopt for usage openstack_resources role  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/88974111:20
opendevreviewDanila Balagansky proposed openstack/openstack-ansible stable/yoga: Restore an ability for HAProxy to bind on interal IP  https://review.opendev.org/c/openstack/openstack-ansible/+/88757711:23
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/yoga: Pin version of setuptools  https://review.opendev.org/c/openstack/openstack-ansible/+/88902211:40
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/yoga: Restore an ability for HAProxy to bind on interal IP  https://review.opendev.org/c/openstack/openstack-ansible/+/88757711:41
noonedeadpunkanskiy: we shouldn't merge anything with CI jobs being completely off11:42
noonedeadpunkat least to maintained branches11:42
anskiynoonedeadpunk: sorry, I guess, I've missed that thing11:54
noonedeadpunknah, no worries, was mostly saying why I've rebased it again11:57
anskiyit looks like when neutron-server is being run from within uwsgi, it doesn't produce any debug logs13:05
* anskiy was poking around the possibility of moving pyargv into uwsgi conf13:06
halalianskiy did not help 13:10
anskiyhalali: could you please link the error again?13:11
noonedeadpunkhalali: on top of that you'd need to pin setuptools I guess13:11
noonedeadpunkhttps://review.opendev.org/c/openstack/openstack-ansible/+/88833213:12
halalianskiy https://paste.openstack.org/show/bkBbS8CPPTHLzoYuqHil/13:12
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add openstack_resources role skeleton  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/87879413:35
damiandabrowskiour rally-openstack patch got merged today \o/14:00
damiandabrowskihttps://review.opendev.org/c/openstack/rally-openstack/+/88753014:00
noonedeadpunksweet14:05
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add openstack_resources role skeleton  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/87879414:17
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Adopt for usage openstack_resources role  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/88987915:11
*** cloudnull4 is now known as cloudnull17:58

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!