Monday, 2023-03-20

jrossergood morning08:52
jrosserlooks like the compatibility matix is not totally accurate for centos9-stream https://docs.openstack.org/openstack-ansible/latest/admin/upgrades/compatibility-matrix.html09:22
jrosserperhaps we should be starting another table below the existing one for antelope onward, to clear out the old columns that will never be supported again09:23
noonedeadpunko/09:32
noonedeadpunkYeah, might be we need to create archive page, but we then should be moving only maintained releases09:32
jrosserwe could keep the old one - just the useless data > useful data now09:33
jrosserand it hurts my eyes :)09:33
jrosserwe've been looking at ironic consoles more as well09:34
jrosserand what vars like `nova_console_type` is actually for is really a big mess09:35
* jrosser would like to hugely simplify this09:36
noonedeadpunkBtw, what is inaccuracy for c9s?09:36
jrosserstein/train?09:38
noonedeadpunkah lol09:38
jrosseryeah, thats what i mean about needing to tidy the table up a bitr09:39
jrosserno matter how hard you look its still invisible :)09:39
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Fix compatability matrix wrt CentOS 9 Stream  https://review.opendev.org/c/openstack/openstack-ansible/+/87794010:11
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Fix compatability matrix wrt CentOS 9 Stream  https://review.opendev.org/c/openstack/openstack-ansible/+/87794010:22
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Fix compatability matrix wrt CentOS 9 Stream and Rocky 9  https://review.opendev.org/c/openstack/openstack-ansible/+/87794010:23
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Fix compatability matrix wrt CentOS 9 Stream and Rocky 9  https://review.opendev.org/c/openstack/openstack-ansible/+/87794010:29
admin1\o10:32
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Split compatability matrix for legacy releases  https://review.opendev.org/c/openstack/openstack-ansible/+/87794110:44
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Split compatability matrix for legacy releases  https://review.opendev.org/c/openstack/openstack-ansible/+/87794110:48
*** arxcruz is now known as arxcruz|rover10:57
admin1checking if anyone already done ovs -> ovn  in prod/or have notes 12:01
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Add documentation for multi-architecture deployments.  https://review.opendev.org/c/openstack/openstack-ansible/+/87795412:44
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Split compatability matrix for legacy releases  https://review.opendev.org/c/openstack/openstack-ansible/+/87794113:11
LosraioHello15:25
LosraioAfter fixing some problems with the user_config.yml, I now get the following error after running the setup-infrastructure.yml:15:25
Losraiohttps://paste.openstack.org/show/bn74XZR4VS0BNZgT3wdA/15:25
LosraioThe setup-hosts.yml has ran successfully though15:26
jrosserLosraio: have you done any debugging on that yet?15:45
LosraioI don't even know where to begin tbh15:45
jrosserwell me neither from those log lines :)15:46
LosraioI checked inside the container, there is indeed no such file15:46
jrosseri don't even know which playbook that is.....15:46
LosraioIt is the setup-infrastructure15:46
jrosserright - but look inside that, it calls a squence of others15:46
LosraioI'm looking at it, but it's not clear which playbook is causing the error15:52
LosraioOr which playbook is called, even15:52
jrosseryou can run them one by one yourself, very easily15:52
jrosser`openstack-ansible playbooks/<playbook-name.yml>`15:53
jrosserthere is no need at all to run them using the higher level setup-*.yml in order to do specific things15:53
Losraiohmm15:53
jrosserthis is very useful for applying a config change only to one service, and will save you huge amounts of time in the future15:53
LosraioAh yes, here it is15:54
LosraioIt;s the repo-setup.yml15:54
LosraioIdk how it came to this, I have gotten numerous errors before but none like that15:55
jrosserso here? https://github.com/openstack/openstack-ansible/blob/master/playbooks/repo-install.yml#L33-L3615:57
LosraioYes15:57
LosraioThe only thing I changed before deploying from scratch is declaring a different load balancer15:58
jrosserso look at the error - you have `Destination /var/lib/lxc/hua-openstack-controller_repo_container-93aa6afd/config does not exist`15:58
jrosseris that there?15:58
LosraioThat will have to wait15:59
LosraioI am running the deployment again15:59
LosraioAnd some things are changing by Ansible already,16:00
Losraiooh well16:00
jrosserdid you build an all-on-one yet for testing?16:00
LosraioYes, the AIO works normally16:00
LosraioBut I need a production cloud16:01
LosraioEven the bare minimum one16:01
jrosserso you should be able to compare16:01
jrosseri am guessing that you do not have a repo container for some reason16:01
LosraioYeah I'm on the process of doing so16:01
jrosserif the config file is missing it would be a surprise if the container was existing properly16:01
LosraioWell, it should exist without a problem, because the setup_hosts.yml ran normally16:02
jrosserif you have a problem in openstack_user_config, it might be missing16:03
LosraioLet me paste it here, but I don't think there's a problem there16:03
Losraiohttps://paste.openstack.org/show/bkfNxhIaiYHNFUBRK4ds/16:04
Losraiohttps://paste.openstack.org/show/bPXgr1ihIYQVb09qnwl4/16:05
LosraioThe latter is the correct one16:05
LosraioOther than the fact that the haproxy_hosts configuration is dumb but functional, I don't see any other problem16:05
jrosser  - "10.3.0.32,10.2.0.34" <- this looks like a typo16:06
LosraioOh16:06
LosraioLet me correct it16:06
jrosserin fact anything in used_ips which is not in cidr_networks is unnecessary16:06
jrosserwhich is a bunch of it16:06
Losraioright16:07
jrosserthere is also bad indentation after `haproxy_hosts:`16:07
jrosserwell maybe, i'm not sure what that is16:07
LosraioWeid, the linter shows no such thing16:07
jrosserhow many haproxy hosts do you want?16:08
LosraioThree16:09
LosraioI have also configured keepalived according to the docs16:09
jrosserright - i see you have used the same ip for a VIP as for one of the hosts16:10
jrosserthats not going to be great with keepalived16:10
LosraioYeah16:10
jrosseryou know that keepalived is VRRP - and how that works?16:11
LosraioSort of16:11
jrosseri would make the `internal_lb_vip_address` unique16:12
jrosserit is dynamically assigned to an interface on one of the three haproxy nodes16:12
jrosserso if you also manually assign it to one of those i don't know whats going to happen16:12
Losraioright16:12
LosraioOh well, it seems like I should start from scratch16:17
jrosserthats probably not necessary in this case, but its really worth being able to rinse/repeat deployments easily in the early days16:22
admin1what is the better way to do  ..  24 -> 25  and after that upgrade from ubuntu20-22, or    upgrade from 20-22 first and then upgrade from 24 -25/latest  tags16:45
jrosseradmin1: best consult the compatibility matrix https://docs.openstack.org/openstack-ansible/latest/admin/upgrades/compatibility-matrix.html17:31
noonedeadpunkif both releases do support OS - doesn't matter17:33
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Add documentation for multi-architecture deployments.  https://review.opendev.org/c/openstack/openstack-ansible/+/87795417:43
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Add documentation for multi-architecture deployments.  https://review.opendev.org/c/openstack/openstack-ansible/+/87795417:54
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Add documentation for multi-architecture deployments.  https://review.opendev.org/c/openstack/openstack-ansible/+/87795417:57
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Split compatability matrix for legacy releases  https://review.opendev.org/c/openstack/openstack-ansible/+/87794118:47
noonedeadpunkNeilHanlon: Hey! I was wondering what were reasons behind dependency on dockerhub for rocky-container element? Or well - were there reasons not to do that like centos with dnf? 19:07
noonedeadpunkAs we're building images for our clouds, including rocky, and in isolated regions we've faced with issue that we'd need to maintain dockerhub mirror or smth to build rocky images which sounds like overkill...19:08
NeilHanlondoesn't need to be from docker hub19:09
NeilHanlonThey're on quay.io, too19:09
NeilHanlonor, I guess... are you asking why it's built from a container vs from qcow19:09
noonedeadpunkWell. We don't have internet connection somewhere :)19:09
noonedeadpunkI think it's more from container image downloaded from somewhere vs smth like https://opendev.org/openstack/openstack-ansible-lxc_hosts/src/branch/master/vars/redhat.yml#L2219:10
noonedeadpunkAs centos-minimal in infra seems doing smth like that as well19:11
NeilHanlonyeah i can add some context... finding the Change19:11
noonedeadpunkand at least with lxc dnf-download approach seems working nicely for us at least...19:11
NeilHanlonhrm. i can't find it in the change, annoyingly. the advice/direction i got from ianw and other dib folks at the time was to go the container route instead of the dnf download/qcow2-based direction19:14
NeilHanloni could swear it was recorded in a comment somewhere19:14
noonedeadpunk++ I will go and bug them then :)19:14
NeilHanlonhttps://review.opendev.org/c/openstack/diskimage-builder/+/805800 was recently abandoned as https://review.opendev.org/c/openstack/diskimage-builder/+/825957 implemented the rocky-container element19:15
NeilHanlonah. i found my IRC logs19:16
NeilHanlonhttps://paste.opendev.org/show/bVA79Y8NtV5m4aMShEh0/ noonedeadpunk19:17
NeilHanlonboils down to compatibility of DNF in ubuntu, i guess19:17
noonedeadpunkmeh... but yes19:18
noonedeadpunkthanks for the context. I will go annoy ianw then :D19:18
NeilHanlonOTOH - i am looking to potentially use diskimage builder to generate more of our Rocky images instead of the stuff I am doing today with Anaconda...19:18
NeilHanlonso you might just have my ear for making it work :P 19:18

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!