Wednesday, 2021-06-16

*** rpittau|afk is now known as rpittau07:15
noonedeadpunkmorning08:25
*** sshnaidm|afk is now known as sshnaidm08:50
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Enable senlin tempest plugin when senlin is deployed  https://review.opendev.org/c/openstack/openstack-ansible/+/75410509:05
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_senlin master: DNM - test patch for senlin tempest testing  https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/75404509:07
opendevreviewFurkan Çelik proposed openstack/openstack-ansible-os_monasca master: Re-activate Monasca role for Openstack-Ansible Monasca role has been retired for a while. I want to activate and maintain this role. Now that Monasca can be installed by OSA.  https://review.opendev.org/c/openstack/openstack-ansible-os_monasca/+/79661609:42
opendevreviewFurkan Çelik proposed openstack/openstack-ansible-os_monasca master: Re-activate Monasca role for Openstack-Ansible  https://review.opendev.org/c/openstack/openstack-ansible-os_monasca/+/79661609:45
furkanceLets add Monasca :)09:46
opendevreviewFurkan Çelik proposed openstack/openstack-ansible-os_monasca master: Re-activate Monasca role for Openstack-Ansible  https://review.opendev.org/c/openstack/openstack-ansible-os_monasca/+/79661609:47
opendevreviewFurkan Çelik proposed openstack/openstack-ansible-os_monasca-agent master: Re-activate Monasca Agent role for Openstack-Ansible  https://review.opendev.org/c/openstack/openstack-ansible-os_monasca-agent/+/79662009:51
opendevreviewMerged openstack/openstack-ansible-galera_server master: Prevent mariadb from OOM killing  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/79042611:03
snadgetempest neutron plugin wont install on ussuri with centos 7, because it depends on python 3 and 2.7 is installed11:04
toskyI would be surprised if ussuri worked at all on centos 711:05
snadgeit is the last version that is supported11:06
toskysnadge: https://governance.openstack.org/tc/reference/runtimes/ussuri.html11:07
toskythe last version of the operating system or of openstack?11:07
snadgethe last version of openstack-ansible that is supported on centos 711:07
snadgethats what I thought anyway11:08
snadgeCentOS 7 supports only source installs, installation of OpenStack with distro packages is not supported.11:08
toskyI'm not really into openstack-ansible, but I guess it can be at most train: https://governance.openstack.org/tc/reference/runtimes/train.html11:09
snadgei think im trying to do a distro install11:09
snadgehttps://docs.openstack.org/project-deploy-guide/openstack-ansible/ussuri/overview.html11:09
toskyplease note that while openstack-ansible itself may deploy an ussuri system on CentOS Linux 7, various services may not work later as they have not been tested on that environment11:10
snadgeso far it is only this tempest neutron plugin11:14
snadgeso i am electing to just not install tempest11:14
snadgedefault is source install via pip .. so it is technically supported, but yes i understand it is pushing it a bit11:14
snadgewe are having problems with drivers on EL811:15
jrosserhold on11:18
jrosserOSA supports a full python3 deployment on centos-711:19
jrosserin fact we had full support for centos-7 / python3 for ussuri11:20
snadgeyeah so that plugin is probably just a bug11:20
jrossernoonedeadpunk: do you see this for stable/victoria? https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/79415811:21
jrosseron focal11:21
opendevreviewFurkan Çelik proposed openstack/openstack-ansible-os_monasca-agent master: Re-activate Monasca Agent role for Openstack-Ansible  https://review.opendev.org/c/openstack/openstack-ansible-os_monasca-agent/+/79662011:22
noonedeadpunkjrosser: um, can't really recall, but wasn't running tempest against V lately...11:23
jrossersnadge: if you have an example for whats failing with your neutron plugin please make a paste11:25
noonedeadpunkbut I can imagine it's applicable11:25
jrossernoonedeadpunk:  i was a bit unsure with the commit message if it was fixing something in or out of CI tbh11:27
snadgejrosser: https://pastebin.com/JcG7JLfS11:28
jrosserbecasue we see it out if CI here, but the commit suggests that its fixing it *in* CI11:28
jrossersnadge: which branch?11:28
noonedeadpunkjrosser: iirc it was more ci thing, as it happened only in aio/single controller with lxc11:29
noonedeadpunkah, well, aio outside of the ci was also affected11:29
snadgei swear it was 21.2.611:30
snadgebut git describe is showing train-em11:31
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-haproxy_server master: Replace whitelist with allowlist naming  https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/79662911:40
admin1where do I set the live_migration_downtime override 11:58
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Rename black/white list variables  https://review.opendev.org/c/openstack/openstack-ansible/+/79663612:05
noonedeadpunkadmin1: I think it's supposed to be in nova.conf?12:05
noonedeadpunkin libvirt section...12:05
noonedeadpunkso should be smth like this http://paste.openstack.org/show/806690/12:06
jrossersnadge: see this patch for Train https://github.com/openstack/openstack-ansible-os_tempest/commit/eeb3c4285768f2d575d6da5ba692afd685bf307512:10
jrosserquite possible the same thing sort of thing is needed for Ussuri to cover Centos-7?12:11
noonedeadpunkebbex: if you around can you kindly vote on https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/796163 ?12:25
*** anbanerj|rover is now known as anbanerj|lunch12:25
opendevreviewMerged openstack/openstack-ansible master: Remove NV distro centos 8 stream job from gates  https://review.opendev.org/c/openstack/openstack-ansible/+/79596212:38
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Replace systemd unit overrides with role  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/79604112:40
*** anbanerj|lunch is now known as anbanerj|rover13:24
*** Jonathan[m]5 is now known as mossblaser13:28
yoctozeptonoonedeadpunk: hi; you might want to answer http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023104.html14:28
noonedeadpunkyoctozepto: oh, thanks, I'm sure want!)14:29
* noonedeadpunk should stop filtering ML without tags14:32
jrossernoonedeadpunk: html email-fail i think to the ML14:39
noonedeadpunkdoh :(14:39
jrosserwierdly only on the archive though - it's readable in my mail client copy14:39
noonedeadpunkand it's 503 now when I try to access my mailbox (14:40
jrossersort of relatedly i was surprised by the reply here http://lists.openstack.org/pipermail/openstack-discuss/2021-June/022982.html14:44
noonedeadpunk`no upgrade path from any of those releases` o_O14:45
noonedeadpunkthat's so weird discussion...14:46
jrosseri had similarly wierd conversation with $vendor who told me no-one really used centos for production environments14:50
jrosserwhich seems to be the same kind of thinking14:50
noonedeadpunkhave it been after Stream announced to be a replacement or before?:)14:51
jrosseroh just afterwards :)14:52
noonedeadpunkbut yeah, it's weird statements... why you even publish this if it's not supposed to be used in prod by anybody... or at least without huge warning at the beginnig of the README...14:53
noonedeadpunkand eventually, wasn't ooo designed to solve upgrades problem with underclouds?14:54
mgariepyhello spatel 15:24
fricklerfunny reference, confirms my choice to stay away from ooo, rhel and centos as much as possible15:27
fricklerand I should also answer to the first mail and mention openstack-chef and make sure it secures the bottom seat :D15:27
mgariepyspatel, http://paste.openstack.org/show/806696/15:30
mgariepyspatel, with the haproxy config, and the way ovn seems to work what does happen if the leader is not the first server ?15:36
spatelsorry i was dealing with some production issue 15:37
mgariepyno worries :) haha15:38
spatelhaproxy doesn't care who is leader, if you make request to follower it will send request to leader for write or modification 15:38
spateljust like rabbitMQ doing 15:38
spatelif you tell your compute node to use ptcp:1.1.1.1:6641,ptcp:2.2.2.2:6641,ptcp:3.3.3.3:6641 then client will automatically figure out who is leader and they will talk to leader only (just like rabbitMQ)15:39
spatelthere is two way to deal here, tell client to use haproxy or give client list of IP address of ovn15:40
spateli like haproxy way so i can add / remove ip and no need to tell client about that15:41
mgariepyi think i would prefer the multiple ips in the config files.15:41
mgariepylol15:41
spatelsure! either way is fine :)15:42
spatelgive list of ips to client or handover single haproxy ip15:42
mgariepyif the first one listen but is out of the cluster for random reason the client will fallback to the other (i suppose)15:42
spatelor write smart haproxy script to detect leader and set that in top list 15:42
mgariepyif haproxy is not configured to look a the service correctly it might cause issues.15:43
spatel+1 agreed 15:43
mgariepywrite a script .. another point that can fail here.. lol15:43
jrosserfeels a bit how we use haproxy/tcp currently for galera15:45
mgariepyyes15:45
jrosserit's not really the right tool and does introduce some oddness15:45
mgariepymax scale would be better :D15:45
mgariepybut well if the config option support multiple ips, i think we should use it. just like we do for rabbit or memcache15:46
jrosserit does feel more of a native solution15:46
mgariepyindeed.15:47
noonedeadpunkfrickler: oh, I clean forgot about puppet as well...16:05
noonedeadpunkmgariepy: we can't use max scale due to wierd license, that prohibits it's free usage in production system16:06
spatelmgariepy jrosser this is what you need to tell your compute and give all 3 IP address of ovn - http://paste.openstack.org/show/806699/16:07
noonedeadpunkso we'd use proxysql I guess16:07
*** rpittau is now known as rpittau|afk16:11
mgariepysad about maxscale.16:16
noonedeadpunkyeah, me too :(16:17
noonedeadpunk`The Licensor hereby grants you the right to copy, modify, create derivative works, redistribute, and make non-production use of the Licensed Work`16:19
noonedeadpunkhttps://mariadb.com/bsl11/16:19
spateljrosser or mgariepy can we get some +2 here so we can have this in master - https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/79426616:50
spateljamesdenton you too :)16:51
mgariepyhere you go. :)16:52
spatelwe can cut the patch to update client with multiple IPs so it will not depend on haproxy 16:55
spatelnoonedeadpunk do you think we should add small section of OVN cluster documentation here, like validation and removing dirty node etc.. - https://docs.openstack.org/openstack-ansible-os_neutron/latest/app-ovn.html16:57
spatelor any short of clustering related doc for awareness 16:58
jamesdentonmore docs the better. and nice work on this@17:10
jrosserspatel: you could use your blog content as a really good starting point17:10
jrosserand add in more practical things like you mention about validating the setup17:10
spatelsure i can put reference doc in that page 17:11
mgariepyalso add the ssl stuff :D17:18
mgariepywith the pki role it wouldn't be too difficult i think.17:18
spatelmgariepy sure! i will verify that and patch it out 17:21
mgariepyi also wonder if we need to pin the version of ovsdb.17:27
mgariepyhttps://docs.openvswitch.org/en/latest/ref/ovsdb.7/#upgrading-from-version-2-14-and-earlier-to-2-15-and-later17:27
mgariepyanyway let's cross that bridge when we get there.17:27
mgariepywow. i wish the manual repair wouln't be needed .. lol18:02
snadgeim still getting this strange configuration related issue which I haven't been able to pinpoint, maybe it is inventory related, here is the log though: https://pastebin.com/7gGLqKRs23:05
snadgethats from running setup_infrastructure.yml23:10
snadgeoh dear.. i forgot to bootstrap which installs python 3.. its just been a bit like that lately23:21
snadgeso i was still running from the old bootstrap.. whoops23:22
snadgethis is why we don't skip steps ;)23:22
snadgeit could have bailed out and said.. hey we need python 3.. and it did that last night when the tempest neutron plugin failed to install23:36

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!