Thursday, 2022-10-06

*** ysandeep|out is now known as ysandeep05:17
jrosser_noonedeadpunk: i think we are pretty close on 778396 - last thing is the `bird` role, but that maybe asks the question if/why we still support calico.....07:12
noonedeadpunkjrosser_: I'm fine with dropping calico07:44
noonedeadpunkbtw I guess we need to switch our services to stable/zed, but we're blocked with memcached thing07:44
noonedeadpunkwe need smth like https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/859054 everywhere I guess07:45
noonedeadpunkOr at very least for services that explicitly use memcache_pool07:45
noonedeadpunkwhich is only nova :D07:46
*** ysandeep is now known as ysandeep|afk07:53
*** ysandeep|afk is now known as ysandeep08:25
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Bump mariadb version to 10.6.10  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/85855508:35
noonedeadpunkjrosser_: btw I've jsut rebased https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/858939 but -CR was not reset by that09:23
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Improve way of cache backend selection  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/86054009:38
opendevreviewMerged openstack/openstack-ansible-rabbitmq_server master: Update rabbitmq to 3.10.7-1  https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/85598510:23
opendevreviewMerged openstack/openstack-ansible-rabbitmq_server stable/xena: Upgrade erlang version  https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/86020810:26
*** ysandeep is now known as ysandeep|afk10:42
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Switch master branch to track stable/zed  https://review.opendev.org/c/openstack/openstack-ansible/+/86054911:21
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-openstack_hosts master: Switch codename to Zed  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/86055111:22
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/xena: Bump OpenStack-Ansible Xena  https://review.opendev.org/c/openstack/openstack-ansible/+/85973011:24
anskiynoonedeadpunk: I've added a comment here (and it got absolutely chewed upon): https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/855829. If you have any questions, I'm happy to explain.11:31
*** dviroel|afk is now known as dviroel11:31
noonedeadpunkI was about to ask TL;DR version lol11:37
noonedeadpunkyeah, will check it out11:37
noonedeadpunkcan't promise that today though...11:55
*** ysandeep|afk is now known as ysandeep12:04
anskiynoonedeadpunk: TLDR is: three versions and each one is uglier than previous. I can re-post it to paste (I can't even select the whole comment on gerrit now) if that would help a little bit. No worries, I'm not in a hurry, ping me whenever you'll have some time.12:10
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-os_ironic master: Allow ironic inspector callback URL to be overridden  https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/86056012:33
jrosser_ThiagoCMC: ^ this might help you12:33
gokhanisihi folks, I am trying to use one of my infra node both infra an compute node. when I try to launch vm on this machine, I am getting "failed to activate service 'org.freedesktop.machine1': timed out". it seems this failure is about systemd. I want to know may be this is a bug and it is resolved. My environment is osa 22.1.0.  12:57
jrosser_noonedeadpunk: what do you think about this? https://opendev.org/openstack/openstack-ansible-os_nova/src/branch/master/defaults/main.yml#L25313:02
noonedeadpunkthat it will break in container?13:05
noonedeadpunkeventually I'd rather set that to container_address13:05
noonedeadpunkgokhanisi: ha! there was recent thread in ML with the same issue13:06
noonedeadpunktry to re-run containers-lxc-host.yml playbook13:07
noonedeadpunkjrosser_: yeah, seems we indeed need to backport that change13:07
noonedeadpunkas sounds like ubuntu has launched some unattended upgrade 13:08
jrosser_noonedeadpunk: yes i also think it should be container_address, in our case ansible_host is an out-of-band interface, not br-mgmt13:10
noonedeadpunkgokhanisi: and then re-start systemd-machined.service iirc13:10
noonedeadpunkI'd say we should check for ansible_host usage and think twice if that should be left. As it's quite an assumption that mgmt_address is what you define in openstack_user_config13:12
jrosser_yes13:12
gokhanisinoonedeadpunk, ok thanks it seems it is about filesystem in the file /lib/systemd/system/var-lib-machines.mount. it was brtfs instead of ext4 . I will try your suggestion. 13:13
noonedeadpunkyeah, exactly. var-lib-machines.mount provided by some package and in case of it update it get's overwritten. And the fix we have landed only on Yoga13:13
gokhanisinoonedeadpunk, is fix you have landed is on lxc_hosts role ?13:19
noonedeadpunkyup13:19
noonedeadpunkgokhanisi:  https://opendev.org/openstack/openstack-ansible-lxc_hosts/commit/337ddf87802c7597b7c51a071eb9829a4b87defa13:20
gokhanisinoonedeadpunk, thanks a lot :) 13:21
noonedeadpunkthat is bad :( https://review.opendev.org/c/openstack/openstack-ansible/+/86054915:07
noonedeadpunkhm, still fails with dogpile.cache.exception.PluginNotFound: Couldn't find cache plugin to load: oslo_cache.memcache_pool15:08
noonedeadpunkweird...15:08
anskiy`No module named 'bmemcached': ModuleNotFoundError: No module named 'bmemcached'` missing dep?15:11
anskiythat's from stevedore15:12
noonedeadpunkYeah, well, https://opendev.org/openstack/openstack-ansible-os_keystone/commit/1add87ad2fb1ca7ba7ba7974cd20bd1b6957951f was supposed to fix it15:27
anskiyit looks, like it should install https://pypi.org/project/python-binary-memcached/ this thing, which provides `bmemcached`15:34
*** dviroel is now known as dviroel|afk15:35
*** ysandeep is now known as ysandeep|dinner15:36
anskiybut I don't see it as a dependency in dogpile.cache itself, so it should be in global-requirements/constraints/etc (or how does that thing called)15:37
noonedeadpunkwell it's supposed to install oslo.cache[dogpile] which would bring https://github.com/openstack/oslo.cache/blob/master/setup.cfg#L38-L40 yes15:39
noonedeadpunkBut maybe that's not happening...15:39
anskiyI can only see python-binary-memcached here: https://opendev.org/openstack/oslo.cache/src/branch/master/test-requirements.txt, but that's test-requirements15:39
anskiynoonedeadpunk: yeah, true.15:40
* noonedeadpunk needs to spawn aio to see15:43
anskiythere is no python-binary-memcached dependency in this version: https://github.com/openstack/oslo.cache/blob/3.1.0/setup.cfg15:45
anskiywhich gets installed in keystone venv15:46
anskiynoonedeadpunk: this commit https://github.com/openstack/oslo.cache/commit/7c6effd10e7c09f75fe0c644dab418ada4dc5e8a is not tagged yet15:48
noonedeadpunkanskiy: good catch :(15:48
anskiynoonedeadpunk: https://6afc0ec476a3d9ae35ae-597ff148d0ea9164d11e7cb764cf9b04.ssl.cf2.rackcdn.com/860549/1/check/openstack-ansible-deploy-aio_metal-ubuntu-focal/c1fb7e6/logs/host/python_venv_build.log.txt this log is super useful15:49
noonedeadpunkyeah, I 've opened it but on meeting now so didn't really read it15:50
noonedeadpunkwhy I even assumed it is tagged....15:54
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Improve way of cache backend selection  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/86054016:01
*** ysandeep|dinner is now known as ysandeep|out16:06
jrosser_noonedeadpunk: do you have any deployments where your inventory ip in openstack_user_config are different from the br-mgmt ip, i.e seperate OOB network for ansible/ssh?16:22
noonedeadpunknope16:22
jrosser_hmm16:23
jrosser_i am suspecting inventory script problems when you do that16:23
jrosser_container_address becomes the ssh address not the br-mgmt address for hosts, but is as expected in LXCs16:23
noonedeadpunkouch16:24
noonedeadpunkFor some reason I though that container_address must be from container network16:25
noonedeadpunkAnd if oob =! container network - it will set one...16:26
noonedeadpunkBut not sure about last...16:26
jrosser_yes i thought that too that container_address should always be container_network16:27
jrosser_and looking at out deployments it seems pretty much luck that it's not broken anything16:27
jrosser_mainly because it's all LXC so the address is correct there, and anything on metal is using MQ rather than binding to local ports16:28
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-os_nova master: Clarify nova serial proxy bind address  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/86059316:40
*** dviroel|afk is now known as dviroel17:09
ThiagoCMCjrosser_, you're fast!  :-D19:01
*** dviroel is now known as dviroel|afk20:32
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-os_ironic master: Allow ironic inspector callback URL to be overridden  https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/86056021:48

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!