*** djhankb has joined #openstack-ansible | 00:07 | |
*** gyee has quit IRC | 00:51 | |
*** spatel has quit IRC | 01:16 | |
*** spatel_ has joined #openstack-ansible | 01:19 | |
*** spatel_ is now known as spatel | 01:19 | |
*** macz_ has joined #openstack-ansible | 01:21 | |
*** macz_ has quit IRC | 01:25 | |
*** macz_ has joined #openstack-ansible | 01:32 | |
*** macz_ has quit IRC | 01:36 | |
*** evrardjp has quit IRC | 02:33 | |
*** evrardjp has joined #openstack-ansible | 02:33 | |
*** spatel has quit IRC | 03:05 | |
*** zul has quit IRC | 03:15 | |
*** macz_ has joined #openstack-ansible | 03:33 | |
*** macz_ has quit IRC | 03:37 | |
*** snapdeal has joined #openstack-ansible | 05:02 | |
*** snapdeal has quit IRC | 05:17 | |
*** ChiTo has quit IRC | 05:21 | |
*** shyamb has joined #openstack-ansible | 05:54 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: Use global service variables https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/769935 | 06:13 |
---|---|---|
*** shyam89 has joined #openstack-ansible | 06:35 | |
noonedeadpunk | spatel: want this to be inlcuded for 22.1.2 as well https://review.opendev.org/c/openstack/openstack-ansible/+/786107 | 06:37 |
*** tinwood has quit IRC | 06:37 | |
*** shyamb has quit IRC | 06:38 | |
noonedeadpunk | I would be greatful for having a look on some of my patches https://review.opendev.org/q/is:open+-is:wip+owner:noonedeadpunk%2540ya.ru+-label:Verified-1+-label:Workflow-1+-topic:debian_bullseye | 06:40 |
*** tinwood has joined #openstack-ansible | 06:40 | |
*** zbr has quit IRC | 06:56 | |
*** luksky has joined #openstack-ansible | 06:58 | |
*** zbr has joined #openstack-ansible | 06:59 | |
jrosser | noonedeadpunk: barbican-ui is branchless - was wondering if that was spatel trouble on V with that yesterdat | 07:06 |
noonedeadpunk | no tags either :( | 07:09 |
noonedeadpunk | So we kind of need to have fixed bumps somehow I guess | 07:09 |
*** jbadiapa has joined #openstack-ansible | 07:14 | |
*** andrewbonney has joined #openstack-ansible | 07:15 | |
*** rpittau|afk is now known as rpittau | 07:32 | |
*** tosky has joined #openstack-ansible | 07:39 | |
openstackgerrit | Andrew Bonney proposed openstack/openstack-ansible-os_nova master: WIP: Add definitions for database pool sizes in global parameters https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/786592 | 07:51 |
openstackgerrit | Andrew Bonney proposed openstack/openstack-ansible-os_nova master: WIP: Add definitions for database pool sizes in global parameters https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/786592 | 07:58 |
*** shyam89 has quit IRC | 08:13 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Add custom user-agent for git clones from opendev.org https://review.opendev.org/c/openstack/openstack-ansible/+/786596 | 08:20 |
jrosser | noonedeadpunk: related to that ^ i am wondering if we should add an assert somewhere that if the deployment is greater than some $size and python_venv_build decides to build wheels on the target when groups['repo_all']|length>0 then it should just fail | 08:25 |
jrosser | with a -e really_build_wheels_on_target_host=true to carry on | 08:26 |
jrosser | |length>0 i mean | 08:29 |
noonedeadpunk | I believe there might be a deployers, who just disabled building wheels in user_variables.yml | 08:35 |
noonedeadpunk | but I adding header won't help for python_venv_build... | 08:38 |
jrosser | i did a AIO install of keystone yesterday which did pick up the custom user-agent all the way through python_venv_build | 08:39 |
jrosser | though of course my patch right now does not address anything except the host itself | 08:39 |
jrosser | disabling wheel builds is going to DOS opendev.org, unfortunately | 08:40 |
noonedeadpunk | well yeah, aio will probably work. Btw I had a patch to use wheels build for aio even in CI, but it was failing as was missing some libs in lxc to properly build things | 08:41 |
noonedeadpunk | but I guess you did metal aio... | 08:41 |
jrosser | no i did LXC | 08:42 |
jrosser | modified the /etc/gitconfig in the repo container, and it did the right thing | 08:42 |
noonedeadpunk | ah | 08:42 |
jrosser | so thats totally missing from my patch at the moment, dealing with all the hosts other than the deploy host gitconfig | 08:42 |
noonedeadpunk | add that to lxc_hosts? | 08:43 |
jrosser | or maybe openstack_hosts, i wasnt sure really | 08:43 |
noonedeadpunk | yeah, might be... | 08:43 |
noonedeadpunk | was thinking about https://opendev.org/openstack/openstack-ansible-lxc_hosts/src/branch/master/vars/ubuntu-20.04.yml#L24 so that images have config set... | 08:44 |
noonedeadpunk | but agree that openstack_hosts will be required anyway, to set the config on hosts themselves... | 08:44 |
jrosser | i've made it distinguish between aio and deploy host | 08:44 |
jrosser | was trying to think of a smart way to put something useful for all the other hosts in the string | 08:45 |
jrosser | without just leaking out the actual hostname which i think wouldnt be a good idea | 08:45 |
noonedeadpunk | yeah, I wouldn't like that :) | 08:45 |
noonedeadpunk | anyway hostname should be in connection to git anyway | 08:46 |
jrosser | original hostname even if the connection comes from a NAT for example? | 08:46 |
noonedeadpunk | well, no, not original ne | 08:46 |
noonedeadpunk | but I mean that should be enough to find who made that anyway | 08:47 |
noonedeadpunk | we might add component type I guess. Like group_name | 08:48 |
jrosser | right, yes that was my thought | 08:48 |
jrosser | just to be able to say "why is it all the nodes of type <foo> are doinf this?" | 08:48 |
noonedeadpunk | yep, exactly. | 08:49 |
noonedeadpunk | the thing is that same container is part of many groups... | 08:49 |
jrosser | yup :) | 08:49 |
noonedeadpunk | and things got even worse for metal... | 08:49 |
jrosser | the hosts for metal similar | 08:50 |
noonedeadpunk | but I mean we use env.d for creating container name? So might use the same? | 08:50 |
noonedeadpunk | but yeah, we're using that in dynamic_inventory... | 08:52 |
jrosser | there is `component` there | 08:53 |
jrosser | which i think is kind of messed up for metal | 08:53 |
noonedeadpunk | yeah, was just looking at it | 08:53 |
noonedeadpunk | super weird for metal | 08:53 |
jrosser | it's "whatever we processed last" | 08:53 |
jrosser | came across this with zun actually | 08:54 |
jrosser | where all the compute components turned from nova to zun when we deployed it on the same hosts | 08:54 |
noonedeadpunk | for aio I guess it wold be just `utility` | 08:55 |
noonedeadpunk | at least that is only component I see in the inventory | 08:55 |
jrosser | wierdly mine here is "component": "nova_compute" | 08:56 |
noonedeadpunk | container_name kind of exposing hostname I guess? | 08:56 |
jrosser | maybe component actually is a good compromise | 08:57 |
jrosser | this is kind of meaningless concept for an AIO anyway | 08:57 |
noonedeadpunk | physical_host_group ? | 08:57 |
jrosser | thats kind of odd too | 08:59 |
noonedeadpunk | but seems like the same thing as with component | 08:59 |
jrosser | utility ends up as shared-infra_hosts in physical_host_group | 08:59 |
noonedeadpunk | yeah, probably component is really good enough | 09:00 |
jrosser | cool, thanks for helping there i was a bit stuck wondering what to do with all the group_names :) | 09:01 |
noonedeadpunk | shouldn't you enjoy your weekends instead?:) | 09:02 |
jrosser | knowing what the answer is stops it bugging me :) | 09:10 |
*** macz_ has joined #openstack-ansible | 09:35 | |
*** macz_ has quit IRC | 09:39 | |
*** shyamb has joined #openstack-ansible | 09:42 | |
noonedeadpunk | well, who will then?:) In City we Care, so... xD | 10:18 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_horizon master: Implement WEBSSO redirect https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/786467 | 10:44 |
*** cloudnull has quit IRC | 11:09 | |
*** cloudnull7 has joined #openstack-ansible | 11:09 | |
*** dave-mccowan has joined #openstack-ansible | 11:13 | |
*** macz_ has joined #openstack-ansible | 12:19 | |
*** macz_ has quit IRC | 12:24 | |
strattao | o/ Hi OSA folks. Been a while, I see a lot has changed here in the last while. Just got through reading the last couple weeks of messages, been a couple years I think since posting. I'm just getting back into the swing of things after a big break. so @jrosser, you pretty much running things these days? | 12:34 |
noonedeadpunk | o/ | 12:39 |
noonedeadpunk | Well yeah, things going forward, but a bit more slow than wanted | 12:41 |
jrosser | o/ hi strattao! certainly a team effort here these days | 12:41 |
strattao | Nice to see at least a few familiar faces still around! So, rather than reading the last couple years of unread messages, can you help get me up to speed on where things are at with you guys? | 12:43 |
noonedeadpunk | well, I guess we can:) just depends on what you're interested in | 12:45 |
noonedeadpunk | or at least since when you've missed things at least:) | 12:46 |
noonedeadpunk | We also are having PTG next week, so feel free to join us! | 12:48 |
*** poopcat has quit IRC | 12:52 | |
strattao | Definitely want to join the PTG next week! I was looking for a link and the last one I could find was for Train... | 12:53 |
jrosser | strattao: things are really still very familiar with OSA, so if you're on Train or newer then theres no massive surprises | 12:54 |
noonedeadpunk | I'd say even stein | 12:54 |
*** poopcat has joined #openstack-ansible | 12:54 | |
noonedeadpunk | strattao: here's schedule http://ptg.openstack.org/ptg.html | 12:55 |
jrosser | theres quite a few helpful new things with managing local forks of ansible roles and openstack git repos | 12:55 |
noonedeadpunk | and pressing on the os-ansible will lead you to the correct zoom room | 12:55 |
*** spatel_ has joined #openstack-ansible | 12:55 | |
*** spatel_ is now known as spatel | 12:55 | |
noonedeadpunk | We have 2h session on Tuesday and Wednesday | 12:56 |
strattao | jrosser: you have no idea, things are a bit of a mess where we're at - just getting back into things, but long story short, production is still running on queens | 12:56 |
strattao | And "running", but not running very well... Jumping back in to see the best way to move forward and help get things awesome again | 12:56 |
strattao | thx @noonedeadpunk! | 12:57 |
jrosser | strattao: we met in denver right? did you have the air-gapped environment? | 12:57 |
strattao | jrosser: you got it! Great memory | 12:58 |
jrosser | hah yeah its been a while :) | 12:58 |
noonedeadpunk | from queens things changed more. The main thing is that we've dropped repo-build thing. And wheels are not pre-build but managed with https://opendev.org/openstack/ansible-role-python_venv_build | 12:59 |
strattao | wow! that's a big change | 12:59 |
noonedeadpunk | well, they actually are build, but during role run. So it's easier to perform minor upgrades without the need to wait for everything get into place | 13:00 |
noonedeadpunk | and more reliable I think | 13:01 |
noonedeadpunk | we did that change during R-S just in case | 13:02 |
*** shyamb has quit IRC | 13:04 | |
jrosser | strattao: i guess the other elephant in the room is centos - whats your OS? | 13:04 |
noonedeadpunk | oh, well :) | 13:04 |
strattao | yeah, everything is still running on xenial :( | 13:08 |
strattao | That is going to be the heavy lift for sure. Also, the decision was made to use ovs+dvr everywhere, because our workloads have a lot of pets that require a lot of north+south traffic. The performance and stability has not been great. | 13:08 |
noonedeadpunk | I think xenial-bionic ugrade is performed on Rocky if you're looking for upgrade env and not re-setup | 13:11 |
noonedeadpunk | https://docs.openstack.org/openstack-ansible/rocky/admin/upgrades/distribution-upgrades.html | 13:11 |
noonedeadpunk | And from Rocky I think you can just jump to the train | 13:13 |
jrosser | it would also be totally valid to consider building a new environment | 13:15 |
jrosser | especially if OVN was on the cards to address the dvr-like requirement | 13:15 |
strattao | Doing some digging into OVN, I think that is the right approach, but I didn't much documentation in OSA for it. | 13:17 |
strattao | And I'm not sure if we're going to get new hardware to build a new environment :( | 13:18 |
noonedeadpunk | there's a tooling to migrate between clouds https://os-migrate.github.io/os-migrate/ | 13:19 |
noonedeadpunk | never tested it myself, but used to work for ppl afaik | 13:19 |
noonedeadpunk | and eventually, you can even map same storage to the new deployment. the only new hardware you need - controller (or maybe several) and compute to start migration | 13:20 |
strattao | noonedeadpunk: I haven't seen os-migrate before! That looks really interesting and might be an option for us. Thank you! | 13:25 |
strattao | Okay, you guys have my wheels turning. I hope you don't mind if I start bugging you for more details soon ;) | 13:34 |
strattao | I do see a big ol' warning in the OVN scenario: https://docs.openstack.org/openstack-ansible-os_neutron/latest/app-ovn.html | 13:36 |
strattao | Can you highlight what may not be production ready? | 13:36 |
spatel | strattao OVN is great :) | 13:40 |
strattao | o/ spatel! How are you? | 13:41 |
spatel | strattao i did some testing with OVN using OSA but still some work need to be done - https://satishdotpatel.github.io/openstack-ansible-ovn-deployment-part1/ | 13:41 |
spatel | we had same issue we need high performance N+S traffic and we used SRIOV + VLAN provider (we are running private cloud) | 13:42 |
spatel | 3 year ago DVR was mess so i decided to go with VLAN provider | 13:42 |
spatel | There is a talk going on to make OVN default backend for devstack so soon its coming for you.. :) | 13:44 |
strattao | Thank you for your awesome write up, this is great! We were running into the upper limit of vlan provisioning and needed to move to a vxlan overlay. Otherwise I would much prefer to use straight vlan. Hopefully, OVN will be the answer. If OVN is so great and you've done the work testing it out already, how come you haven't moved over to it then? ;) | 13:45 |
spatel | We have massive production cloud more than 500 compute nodes.. all running on SRIOV ( Soon my next cloud will be on OVN trust me :) ) all i need some more testing like DPDK etc.. (I hate SRIOV) | 13:47 |
*** kukacz has quit IRC | 13:47 | |
spatel | Just matter of time.. and we will be on OVN.. | 13:47 |
spatel | I can't migrate existing cloud to OVN its generating revenue for us and i don't want to put myself in trouble trying new tech... | 13:49 |
strattao | Hahaha, yeah makes sense! | 13:52 |
spatel | also there is some work need from OVN side to be done to make it more production ready like clustering etc.. | 13:52 |
spatel | noonedeadpunk if you have time, I am doing minor upgrade and hit this bug during running os-horizon-install.yml playbook - http://paste.openstack.org/show/804530/ | 13:59 |
spatel | any idea | 13:59 |
noonedeadpunk | well, yes | 14:05 |
noonedeadpunk | we backported master wrongly | 14:05 |
spatel | :D | 14:06 |
spatel | so what is the good way to move forward | 14:07 |
spatel | next week i am planning to upgrade on production so want to make sure my lab pass all test | 14:08 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_horizon stable/victoria: Fix barbican-ui installation https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/786662 | 14:08 |
noonedeadpunk | spatel: ^ | 14:09 |
spatel | :) applying now | 14:09 |
noonedeadpunk | well, let me update it a bit | 14:10 |
spatel | standby | 14:10 |
noonedeadpunk | doh, why so long... | 14:11 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_horizon stable/victoria: Fix barbican-ui installation https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/786662 | 14:11 |
spatel | going to apply now | 14:15 |
spatel | noonedeadpunk is this correct? - https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/786662/2/defaults/main.yml#124 | 14:18 |
spatel | - -- ? | 14:18 |
*** rpittau is now known as rpittau|afk | 14:18 | |
*** macz_ has joined #openstack-ansible | 14:20 | |
spatel | getting error related some YAML formatting | 14:20 |
spatel | may be my issue.. let me check | 14:20 |
spatel | like 126 has some issue in that patch | 14:22 |
noonedeadpunk | doh, yeah | 14:23 |
*** macz_ has quit IRC | 14:24 | |
spatel | " is missing | 14:24 |
noonedeadpunk | sorry, ruined it ) | 14:24 |
spatel | i have comment on patch | 14:24 |
noonedeadpunk | update already flying | 14:24 |
spatel | perfect | 14:24 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_horizon stable/victoria: Fix barbican-ui installation https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/786662 | 14:25 |
spatel | All looking good after patch.. lets merge as soon as Zuul pass :) | 14:27 |
*** jamesdenton has quit IRC | 14:36 | |
noonedeadpunk | zbr: fwiw, yaml-shcema check is not really helpful. `Missing property "action"` looks like super obsoleted by ansible | 15:06 |
*** jamesdenton has joined #openstack-ansible | 15:13 | |
zbr | noonedeadpunk: afaik, action was never obsoleted, only the "action: string" bit. | 15:16 |
zbr | but as i said, the schema is highly experimental, and i was not able to find time to improve it recently | 15:16 |
zbr | but if someone is proposing a fix, i can find time to review and release a patch for sure. | 15:17 |
noonedeadpunk | zbr: gotcha. would be nice just having an option to disable it just in case... | 15:21 |
strattao | wait, does jamesdenton still come around here?!? | 15:21 |
noonedeadpunk | it happens :) | 15:21 |
strattao | !! | 15:21 |
openstack | strattao: Error: "!" is not a valid command. | 15:21 |
*** kukacz has joined #openstack-ansible | 15:23 | |
zbr | noonedeadpunk: that is quite a problem because there is no code to do that. all the code is inside redhat-yaml extension. | 15:30 |
zbr | look at https://github.com/ansible-community/vscode-ansible/blob/master/package.json#L103-L162 | 15:30 |
zbr | basically am only informing that extension what schemas to use, nothing else. | 15:31 |
noonedeadpunk | ah, gotcha | 15:31 |
zbr | you could override them in your user config, but I doubt I can add a checkbox for it. | 15:31 |
zbr | i am now asking yaml extension maintainers.... | 15:31 |
openstackgerrit | Merged openstack/openstack-ansible stable/victoria: Return PyMySQL installation for distro installs https://review.opendev.org/c/openstack/openstack-ansible/+/786107 | 15:35 |
jamesdenton | strattao from time to time | 15:36 |
strattao | Good to see you still around! Got any opinions on OVN? (Looking at the possibility of replacing our ovs+dvr setup) | 15:38 |
jamesdenton | hmm | 15:42 |
jamesdenton | TBH we are not using it in production, yet, but will be soon for some OSP 16 deploys. I don't have a good handle on any issues/caveats. The OSA implementation could use some love | 15:43 |
noonedeadpunk | strattao: just ensure that feature gap is ok for you https://docs.openstack.org/neutron/latest/ovn/gaps.html | 15:44 |
noonedeadpunk | as for me ipv6 and bgp are kind of crucial | 15:45 |
jamesdenton | thanks noonedeadpunk i was looking for that | 15:45 |
openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Use template URLs in Cell Mappings https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/786258 | 16:30 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Bump MariaDB version to 10.5.9 https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/777088 | 16:39 |
noonedeadpunk | jrosser: jsut in case, came up with that now ^ but needs more testing in multinode env | 16:46 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master https://review.opendev.org/c/openstack/openstack-ansible/+/785800 | 16:47 |
*** gyee has joined #openstack-ansible | 17:04 | |
spotz | noonedeadpunk: Just to be sure we have not released Wallaby as we're trailing? Only Tripleo is showing in the Wallaby deployment guide | 17:59 |
*** andrewbonney has quit IRC | 18:05 | |
noonedeadpunk | spotz: nope, we have not yet. and not even branched | 18:08 |
noonedeadpunk | and have so much stuff to do before we will be able to | 18:08 |
spotz | Ok I didn't want to go try to fix it if we weren't releeased yet as that would make no sense:) | 18:09 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-haproxy_server master: Fix haproxy logging https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/786703 | 18:35 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_adjutant master: Move adjutant pip package from a constraint to a requirement https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/784551 | 18:41 |
*** jralbert has joined #openstack-ansible | 18:42 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Bump MariaDB version to 10.5.9 https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/777088 | 18:43 |
*** spatel has quit IRC | 19:18 | |
*** jralbert has quit IRC | 19:47 | |
*** fanfi has joined #openstack-ansible | 20:13 | |
fanfi | hello all, could I set OVS instead of Linux bridge for LXC container ? | 20:17 |
jrosser | fanfi: i guess the answer is yes, but 99% of people with OVS for neutron keep standard bridges for the controller containers | 20:32 |
jrosser | do you have a specific requirement for OVS there? | 20:33 |
jrosser | really so long as the bridges exist and packets go to the right places, br-mgmt, br-(lbaas,dbaas) etc, it doesnt really matter how they are created or managed | 20:35 |
fanfi | yes, i would like to set octavia service, but when octavaia container is connected to the br-lbaas linux bridge is unable to communicate with amphora instacnes on compute nodes. | 20:39 |
fanfi | os is there any trick ? | 20:40 |
fanfi | if i connect the phisycal interface to the linux bridge i able to communicate but dhcp agent on infra host unable to comunicate with amphora instance | 20:42 |
jrosser | fanfi: there is an example here https://docs.openstack.org/openstack-ansible-os_neutron/latest/app-openvswitch.html#configuring-bridges-open-vswitch | 20:57 |
jrosser | i've never done this though, so some experimentation will be needed | 20:59 |
fanfi | thx, i wil try it and are you using octavia ? | 21:07 |
*** admin0 has quit IRC | 21:16 | |
jrosser | fanfi: yes, but with neutron linuxbridge | 21:16 |
fanfi | waw, and are you recomend neutronLinuxbridge insted OVS ? | 21:18 |
*** luksky has quit IRC | 21:39 | |
*** poopcat has quit IRC | 21:53 | |
*** poopcat has joined #openstack-ansible | 21:56 | |
openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Switch tempestconf centos-8-stream nodes and set as NV https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/784019 | 22:27 |
*** gyee has quit IRC | 22:37 | |
*** tosky has quit IRC | 23:38 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!