Wednesday, 2021-06-23

fridtjof[m]noonedeadpunk: almost got it set up completely today, so (given i don't forget about it) i might bring up my first patch tomorrow then :)01:57
*** odyssey4me is now known as Guest27305:55
jrossermorning07:05
jrossernoonedeadpunk: interesting thing with this ssl stuff is that it gets as far as cinder, i.e past keystone/glance/...07:05
*** rpittau|afk is now known as rpittau07:07
jrossernoonedeadpunk: this has got me past the trouble with cinder http://paste.openstack.org/show/806876/07:41
noonedeadpunkjrosser: yeah urllib3 somehow fails with cionder07:43
jrossermy paste fixes it07:44
noonedeadpunkbut when I was checking urllib3 manually, it was absolutely happy with system trusted certs even in venv...07:44
noonedeadpunkah07:44
jrosserif you look at /proc/<pid-of-cinder>/environ then the content of /etc/environment is not present for that process07:44
noonedeadpunkah, I see...07:45
jrosserso what is proper fix.....07:45
noonedeadpunkshould we just add that to uwsgi role by default?07:45
jrosserwe can add setting `env` to the template, and it's still overridable with config_template anyway07:46
noonedeadpunkie throw it somewhere here https://opendev.org/openstack/ansible-role-uwsgi/src/branch/master/templates/uwsgi.ini.j2#L607:46
noonedeadpunk(as we need it only for venvs?07:46
jrosserand take the paths you put into openstack_hosts into vars/ so it picks the right ones for each distro07:47
noonedeadpunkyeah07:47
jrosseri'm not really sure its to do with venvs / not venvs07:47
jrosseri'll put a patch together07:47
noonedeadpunkshould I think of better way to patch openstack-ansible-openstack_hosts ?07:49
noonedeadpunkor you already did that?07:50
jrosseroh i just did a big hack for the moment07:50
noonedeadpunkok, gotcha07:50
jrosseri split the lineinfile task in two, one part for centos/systemd, and put another unconditionally in tasks/main.yml for requests ca07:51
jrosseri wonder if that env var stuff is still needed for centos-stream, felt like that really was a packaging bug07:52
noonedeadpunkwe can try dropping it as follow-up08:05
opendevreviewJonathan Rosser proposed openstack/ansible-role-uwsgi master: Use the system trust store for python requests rather than certifi  https://review.opendev.org/c/openstack/ansible-role-uwsgi/+/79760008:11
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Don't set keystone URI as unsecure  https://review.opendev.org/c/openstack/openstack-ansible/+/79680908:12
jrosseri guess not everything runs under uwsgi, so theres more to check08:15
jrosserah yes neutron is one of those08:22
noonedeadpunkuh... I wonder why neutron actually fails, as in CI of neutron it runs as uwsgi afaik08:35
jrosserdid we ever switch that over?08:42
jrosserhttps://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/48615608:42
noonedeadpunkI meant for neutron CI itself, sorry https://zuul.opendev.org/t/openstack/build/c99eb7f07d8840e0a4fa807af3cbcbe808:52
noonedeadpunkwell, loocking at logs, I have no idea how uwsgi is used/configured, considering that apache is installed...08:53
noonedeadpunkit's most likely not used though, but dunno...08:54
noonedeadpunkthey don't really bother themselves with gathering configs for ci...08:55
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-openstack_hosts master: Set REQUESTS_CA_BUNDLE env var  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/79712909:07
noonedeadpunkdidn't come up to anything really decent :(09:07
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-openstack_hosts master: Drop CentOS overrides for systemd version  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/79761009:10
jrossernot sure on what is decent for neutron either, maybe like http://paste.openstack.org/show/806877/09:30
jrosseri get it as far as tempest running and failing now09:31
noonedeadpunkI think we can follow the way of _neutron_rootwrap_conf_overrides ?09:41
jrosserhrrm we are going to need this *everywhere*09:50
jrossernova-api is fine with the uwsgi patch09:50
jrosserbut scheduler/conductor/.... are not09:51
jrosseran alternative approach is to set it system wide with DefaultEnvironment https://www.freedesktop.org/software/systemd/man/systemd-system.conf.html09:52
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron master: Implement uWSGI for neutron-api  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/48615610:01
jrosserok so this fixes nova-conductor http://paste.openstack.org/show/806878/10:05
noonedeadpunkI like approach with system-wide env more tbh10:06
noonedeadpunkand we can do that with openstack-hosts10:06
noonedeadpunknot sure if makes much sense to add tasks to systemd_service role though10:06
noonedeadpunkexcept add and not include anywhere (run just with tasks_from in openstak_hosts)10:08
noonedeadpunkbut too complex imo10:08
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-openstack_hosts master: Set REQUESTS_CA_BUNDLE env var  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/79712910:35
noonedeadpunkdoes this look okeyish? ^ didn't want really to introduce config_template into the role, but it's cleanest way of doing...10:35
jrosseri had to create system.conf.d directory, so we probably need to handle that too10:43
noonedeadpunkyeah, fair11:33
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-openstack_hosts master: Set REQUESTS_CA_BUNDLE env var  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/79712911:34
noonedeadpunkdoh, buster starts failing with lxc :(11:50
noonedeadpunkat least several patches failed with apparmor profile issue11:50
noonedeadpunkhttps://zuul.opendev.org/t/openstack/build/a094100b93f7467391230dc182f7b126/log/job-output.txt#707311:51
jrosserwe could use this merging https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/78698213:06
opendevreviewJames Gibson proposed openstack/openstack-ansible-haproxy_server master: Add variable to disable stick-table  https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/79764213:11
opendevreviewJonathan Heathcote proposed openstack/openstack-ansible-os_tempest stable/victoria: Install py3-dev when not building wheels  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/79703113:14
jrossernoonedeadpunk: evrardjp you wouldnt happen to know why a stick-table was introduced here would you? https://github.com/openstack/openstack-ansible-haproxy_server/commit/e86139506d87e0c797f2449835dd5418571fde8f#diff-ec1d0842e4fa06a711e64e4bf992eaab4e962c0247193639a082fd78f601ed45R71-R7213:21
noonedeadpunkI'd say that maybe not to switch between servers during some big requests, like image upload process?13:24
noonedeadpunknow we balance based on ip source for glance, but it was not the case these days13:30
jrosseri mean, i guess i see the definition of the stick table and that it is to store src ip13:30
jrosserbut not sure about where it says to use it13:31
jrosserunless that is implicit13:31
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-openstack_hosts master: Set REQUESTS_CA_BUNDLE env var  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/79712913:33
noonedeadpunkpersonally I never used it, so have nothing to say here...13:34
noonedeadpunkit might be that it's just useless/not fully implemented atm13:34
opendevreviewJonathan Heathcote proposed openstack/openstack-ansible-os_tempest stable/victoria: Install py3-dev when not building wheels  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/79703113:48
opendevreviewJames Gibson proposed openstack/openstack-ansible-haproxy_server master: Add variable to disable stick-table  https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/79764213:55
opendevreviewFridtjof Mund proposed openstack/openstack-ansible master: [doc] Fix compatability -> compatibility  https://review.opendev.org/c/openstack/openstack-ansible/+/79767315:05
fridtjof[m]\o/ noonedeadpunk i think i did it15:06
noonedeadpunkawesome work, thanks!15:07
noonedeadpunkjrosser: we're seeing that as well :( https://discuss.linuxcontainers.org/t/lxc-attach-lsm-lsm-c-lsm-process-label-set-at-174-operation-not-permitted-failed-to-set-apparmor-label-lxc-nginx-debian-var-lib-lxc-lxc-nginx-debian-var-lib-lxc-unconfined/1139215:21
noonedeadpunkhttps://www.mail-archive.com/debian-bugs-dist@lists.debian.org/msg1809195.html15:22
noonedeadpunkwell, seems we should set buster lxc jobs to nv...15:23
mgariepyhttps://github.com/lxc/lxc/issues/3872#issuecomment-86499358715:26
mgariepynv until we have the new kernel?15:27
noonedeadpunkI mean we can try to use workaround with unprivileged attach... but feels like might be simpler to wait for the new kernel that fixes the issue15:32
noonedeadpunkconsidering everybody is aware about it15:32
mgariepyi agree\15:32
evrardjpjrosser: it was because I had a bug with federation IIRC15:35
evrardjpso I needed the clients to reach always the same nodes 15:35
evrardjpbut that's long ago ... so I am wondering if it wasn't a mariadb issue now.15:36
opendevreviewJonathan Heathcote proposed openstack/openstack-ansible-os_tempest stable/victoria: Install py3-dev when not building wheels  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/79703115:39
evrardjp(from internal service reaching LB to get mariadb, and you want to have a relatively stable load )15:39
*** rpittau is now known as rpittau|afk16:08
*** frenzy_friday is now known as anbanerj|rover16:19
noonedeadpunkI think for masriadb it's high time to replace haproxy with proxysql imo16:29
noonedeadpunkas there're all sort of weird stuff and nasty hooks with xinetd that's not as reliable as native proxy16:30
mgariepydo you have some patches around for that ?16:33
noonedeadpunknope, not yet (16:33
*** sshnaidm is now known as sshnaidm|afk16:35
noonedeadpunkjrosser: hm, setting `env = REQUESTS_CA_PATH=/etc/ssl/certs/ca-certificates.crt` for `/etc/uwsgi/cinder-api.ini` didn't helped in my case for some reason...16:46
jrossernoonedeadpunk: REQUESTS_CA_BUNDLE :)16:49
noonedeadpunkdoh16:50
jrosserargh16:51
noonedeadpunkah, well, I have `env = REQUESTS_CA_PATH=/etc/ssl/certs/ca-certificates.crt` dunne where I took REQUESTS_CA_PATH from16:51
noonedeadpunkI missed it again lol16:52
opendevreviewJonathan Rosser proposed openstack/ansible-role-uwsgi master: Use the system trust store for python requests rather than certifi  https://review.opendev.org/c/openstack/ansible-role-uwsgi/+/79760016:52
jrosseri messed up the patch totally :(16:54
noonedeadpunkwell, I haven't spotted difference actually as well :(16:55
noonedeadpunkeven after you told me  ;(16:55
opendevreviewMerged openstack/openstack-ansible-os_nova stable/victoria: Use version from repo_packages for SPICE HTML5  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/79727116:56
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-nspawn_hosts master: Deprecate OpenStack-Ansible nspawn repositories  https://review.opendev.org/c/openstack/openstack-ansible-nspawn_hosts/+/79772417:17
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-nspawn_hosts master: Deprecate OpenStack-Ansible nspawn repositories  https://review.opendev.org/c/openstack/openstack-ansible-nspawn_hosts/+/79772417:23
opendevreviewMerged openstack/openstack-ansible-os_tempest stable/victoria: Set tempestconf centos-8 jobs as NV  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/78698217:24
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-nspawn_container_create master: Deprecate OpenStack-Ansible nspawn repositories  https://review.opendev.org/c/openstack/openstack-ansible-nspawn_container_create/+/79772617:24
opendevreviewMerged openstack/openstack-ansible-os_heat master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_heat/+/78151620:36
_jralbertI've been working on getting keystone and horizon OpenID Connect web SSO integration working on centos 7 with OSA, and there are a few changes I've had to make that I'd like to figure out how to integrate with the project21:32
_jralbertin particular, the mod_auth_openidc that's available from the centos repos is really old (1.8.8) and doesn't work. I ended up manually installing it and its dependency cjose from https://github.com/zmartzone/mod_auth_openidc21:34
_jralberthow could we resolve that dependency gap? It seems less than ideal for OSA to refer directly to the packages from github, but I gather they're not conveniently available in a repo21:35
*** gilou_ is now known as Gilou22:48

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!