Friday, 2021-04-16

*** djhankb has joined #openstack-ansible00:07
*** gyee has quit IRC00:51
*** spatel has quit IRC01:16
*** spatel_ has joined #openstack-ansible01:19
*** spatel_ is now known as spatel01:19
*** macz_ has joined #openstack-ansible01:21
*** macz_ has quit IRC01:25
*** macz_ has joined #openstack-ansible01:32
*** macz_ has quit IRC01:36
*** evrardjp has quit IRC02:33
*** evrardjp has joined #openstack-ansible02:33
*** spatel has quit IRC03:05
*** zul has quit IRC03:15
*** macz_ has joined #openstack-ansible03:33
*** macz_ has quit IRC03:37
*** snapdeal has joined #openstack-ansible05:02
*** snapdeal has quit IRC05:17
*** ChiTo has quit IRC05:21
*** shyamb has joined #openstack-ansible05:54
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: Use global service variables  https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/76993506:13
*** shyam89 has joined #openstack-ansible06:35
noonedeadpunkspatel: want this to be inlcuded for 22.1.2 as well https://review.opendev.org/c/openstack/openstack-ansible/+/78610706:37
*** tinwood has quit IRC06:37
*** shyamb has quit IRC06:38
noonedeadpunkI would be greatful for having a look on some of my patches https://review.opendev.org/q/is:open+-is:wip+owner:noonedeadpunk%2540ya.ru+-label:Verified-1+-label:Workflow-1+-topic:debian_bullseye06:40
*** tinwood has joined #openstack-ansible06:40
*** zbr has quit IRC06:56
*** luksky has joined #openstack-ansible06:58
*** zbr has joined #openstack-ansible06:59
jrossernoonedeadpunk: barbican-ui is branchless - was wondering if that was spatel trouble on V with that yesterdat07:06
noonedeadpunkno tags either :(07:09
noonedeadpunkSo we kind of need to have fixed bumps somehow I guess07:09
*** jbadiapa has joined #openstack-ansible07:14
*** andrewbonney has joined #openstack-ansible07:15
*** rpittau|afk is now known as rpittau07:32
*** tosky has joined #openstack-ansible07:39
openstackgerritAndrew Bonney proposed openstack/openstack-ansible-os_nova master: WIP: Add definitions for database pool sizes in global parameters  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/78659207:51
openstackgerritAndrew Bonney proposed openstack/openstack-ansible-os_nova master: WIP: Add definitions for database pool sizes in global parameters  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/78659207:58
*** shyam89 has quit IRC08:13
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Add custom user-agent for git clones from opendev.org  https://review.opendev.org/c/openstack/openstack-ansible/+/78659608:20
jrossernoonedeadpunk: related to that ^ i am wondering if we should add an assert somewhere that if the deployment is greater than some $size and python_venv_build decides to build wheels on the target when groups['repo_all']|length>0 then it should just fail08:25
jrosserwith a -e really_build_wheels_on_target_host=true to carry on08:26
jrosser|length>0 i mean08:29
noonedeadpunkI believe there might be a deployers, who just disabled building wheels in user_variables.yml08:35
noonedeadpunkbut I adding header won't help for python_venv_build...08:38
jrosseri did a AIO install of keystone yesterday which did pick up the custom user-agent all the way through python_venv_build08:39
jrosserthough of course my patch right now does not address anything except the host itself08:39
jrosserdisabling wheel builds is going to DOS opendev.org, unfortunately08:40
noonedeadpunkwell yeah, aio will probably work. Btw I had a patch to use wheels build for aio even in CI, but it was failing as was missing some libs in lxc to properly build things08:41
noonedeadpunkbut I guess you did metal aio...08:41
jrosserno i did LXC08:42
jrossermodified the /etc/gitconfig in the repo container, and it did the right thing08:42
noonedeadpunkah08:42
jrosserso thats totally missing from my patch at the moment, dealing with all the hosts other than the deploy host gitconfig08:42
noonedeadpunkadd that to lxc_hosts?08:43
jrosseror maybe openstack_hosts, i wasnt sure really08:43
noonedeadpunkyeah, might be...08:43
noonedeadpunkwas thinking about https://opendev.org/openstack/openstack-ansible-lxc_hosts/src/branch/master/vars/ubuntu-20.04.yml#L24 so that images have config set...08:44
noonedeadpunkbut agree that openstack_hosts will be required anyway, to set the config on hosts themselves...08:44
jrosseri've made it distinguish between aio and deploy host08:44
jrosserwas trying to think of a smart way to put something useful for all the other hosts in the string08:45
jrosserwithout just leaking out the actual hostname which i think wouldnt be a good idea08:45
noonedeadpunkyeah, I wouldn't like that :)08:45
noonedeadpunkanyway hostname should be in connection to git anyway08:46
jrosseroriginal hostname even if the connection comes from a NAT for example?08:46
noonedeadpunkwell, no, not original ne08:46
noonedeadpunkbut I mean that should be enough to find who made that anyway08:47
noonedeadpunkwe might add component type I guess. Like group_name08:48
jrosserright, yes that was my thought08:48
jrosserjust to be able to say "why is it all the nodes of type <foo> are doinf this?"08:48
noonedeadpunkyep, exactly.08:49
noonedeadpunkthe thing is that same container is part of many groups...08:49
jrosseryup :)08:49
noonedeadpunkand things got even worse for metal...08:49
jrosserthe hosts for metal similar08:50
noonedeadpunkbut I mean we use env.d for creating container name? So might use the same?08:50
noonedeadpunkbut yeah, we're using that in dynamic_inventory...08:52
jrosserthere is `component` there08:53
jrosserwhich i think is kind of messed up for metal08:53
noonedeadpunkyeah, was just looking at it08:53
noonedeadpunksuper weird for metal08:53
jrosserit's "whatever we processed last"08:53
jrossercame across this with zun actually08:54
jrosserwhere all the compute components turned from nova to zun when we deployed it on the same hosts08:54
noonedeadpunkfor aio I guess it wold be just `utility`08:55
noonedeadpunkat least that is only component I see in the inventory08:55
jrosserwierdly mine here is "component": "nova_compute"08:56
noonedeadpunkcontainer_name kind of exposing hostname I guess?08:56
jrossermaybe component actually is a good compromise08:57
jrosserthis is kind of meaningless concept for an AIO anyway08:57
noonedeadpunkphysical_host_group ?08:57
jrosserthats kind of odd too08:59
noonedeadpunkbut seems like the same thing as with component08:59
jrosserutility ends up as shared-infra_hosts in physical_host_group08:59
noonedeadpunkyeah, probably component is really good enough09:00
jrossercool, thanks for helping there i was a bit stuck wondering what to do with all the group_names :)09:01
noonedeadpunkshouldn't you enjoy your weekends instead?:)09:02
jrosserknowing what the answer is stops it bugging me :)09:10
*** macz_ has joined #openstack-ansible09:35
*** macz_ has quit IRC09:39
*** shyamb has joined #openstack-ansible09:42
noonedeadpunkwell, who will then?:) In City we Care, so... xD10:18
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_horizon master: Implement WEBSSO redirect  https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/78646710:44
*** cloudnull has quit IRC11:09
*** cloudnull7 has joined #openstack-ansible11:09
*** dave-mccowan has joined #openstack-ansible11:13
*** macz_ has joined #openstack-ansible12:19
*** macz_ has quit IRC12:24
strattaoo/ Hi OSA folks. Been a while, I see a lot has changed here in the last while. Just got through reading the last couple weeks of messages, been a couple years I think since posting. I'm just getting back into the swing of things after a big break. so @jrosser, you pretty much running things these days?12:34
noonedeadpunko/12:39
noonedeadpunkWell yeah, things going forward, but a bit more slow than wanted12:41
jrossero/ hi strattao! certainly a team effort here these days12:41
strattaoNice to see at least a few familiar faces still around! So, rather than reading the last couple years of unread messages, can you help get me up to speed on where things are at with you guys?12:43
noonedeadpunkwell, I guess we can:) just depends on what you're interested in12:45
noonedeadpunkor at least since when you've missed things at least:)12:46
noonedeadpunkWe also are having PTG next week, so feel free to join us!12:48
*** poopcat has quit IRC12:52
strattaoDefinitely want to join the PTG next week! I was looking for a link and the last one I could find was for Train...12:53
jrosserstrattao: things are really still very familiar with OSA, so if you're on Train or newer then theres no massive surprises12:54
noonedeadpunkI'd say even stein12:54
*** poopcat has joined #openstack-ansible12:54
noonedeadpunkstrattao: here's schedule http://ptg.openstack.org/ptg.html12:55
jrossertheres quite a few helpful new things with managing local forks of ansible roles and openstack git repos12:55
noonedeadpunkand pressing on the os-ansible will lead you to the correct zoom room12:55
*** spatel_ has joined #openstack-ansible12:55
*** spatel_ is now known as spatel12:55
noonedeadpunkWe have 2h session on Tuesday and Wednesday12:56
strattaojrosser: you have no idea, things are a bit of a mess where we're at - just getting back into things, but long story short, production is still running on queens12:56
strattaoAnd "running", but not running very well... Jumping back in to see the best way to move forward and help get things awesome again12:56
strattaothx @noonedeadpunk!12:57
jrosserstrattao: we met in denver right? did you have the air-gapped environment?12:57
strattaojrosser: you got it! Great memory12:58
jrosserhah yeah its been a while :)12:58
noonedeadpunkfrom queens things changed more. The main thing is that we've dropped repo-build thing. And wheels are not pre-build but managed with https://opendev.org/openstack/ansible-role-python_venv_build12:59
strattaowow! that's a big change12:59
noonedeadpunkwell, they actually are build, but during role run. So it's easier to perform minor upgrades without the need to wait for everything get into place13:00
noonedeadpunkand more reliable I think13:01
noonedeadpunkwe did that change during R-S just in case13:02
*** shyamb has quit IRC13:04
jrosserstrattao: i guess the other elephant in the room is centos - whats your OS?13:04
noonedeadpunkoh, well :)13:04
strattaoyeah, everything is still running on xenial :(13:08
strattaoThat is going to be the heavy lift for sure. Also, the decision was made to use ovs+dvr everywhere, because our workloads have a lot of pets that require a lot of north+south traffic. The performance and stability has not been great.13:08
noonedeadpunkI think xenial-bionic ugrade is performed on Rocky if you're looking for upgrade env and not re-setup13:11
noonedeadpunkhttps://docs.openstack.org/openstack-ansible/rocky/admin/upgrades/distribution-upgrades.html13:11
noonedeadpunkAnd from Rocky I think you can just jump to the train13:13
jrosserit would also be totally valid to consider building a new environment13:15
jrosserespecially if OVN was on the cards to address the dvr-like requirement13:15
strattaoDoing some digging into OVN, I think that is the right approach, but I didn't much documentation in OSA for it.13:17
strattaoAnd I'm not sure if we're going to get new hardware to build a new environment :(13:18
noonedeadpunkthere's a tooling to migrate between clouds https://os-migrate.github.io/os-migrate/13:19
noonedeadpunknever tested it myself, but used to work for ppl afaik13:19
noonedeadpunkand eventually, you can even map same storage to the new deployment. the only new hardware you need - controller (or maybe several) and compute to start migration13:20
strattaonoonedeadpunk: I haven't seen os-migrate before! That looks really interesting and might be an option for us. Thank you!13:25
strattaoOkay, you guys have my wheels turning. I hope you don't mind if I start bugging you for more details soon ;)13:34
strattaoI do see a big ol' warning in the OVN scenario: https://docs.openstack.org/openstack-ansible-os_neutron/latest/app-ovn.html13:36
strattaoCan you highlight what may not be production ready?13:36
spatelstrattao OVN is great :)13:40
strattaoo/ spatel! How are you?13:41
spatelstrattao i did some testing with OVN using OSA but still some work need to be done - https://satishdotpatel.github.io/openstack-ansible-ovn-deployment-part1/13:41
spatelwe had same issue we need high performance N+S traffic and we used SRIOV + VLAN provider (we are running private cloud)13:42
spatel3 year ago DVR was mess so i decided to go with VLAN provider13:42
spatelThere is a talk going on to make OVN default backend for devstack so soon its coming for you.. :)13:44
strattaoThank you for your awesome write up, this is great! We were running into the upper limit of vlan provisioning and needed to move to a vxlan overlay. Otherwise I would much prefer to use straight vlan. Hopefully, OVN will be the answer. If OVN is so great and you've done the work testing it out already, how come you haven't moved over to it then? ;)13:45
spatelWe have massive production cloud more than 500 compute nodes.. all running on SRIOV ( Soon my next cloud will be on OVN trust me :) ) all i need some more testing like DPDK etc.. (I hate SRIOV)13:47
*** kukacz has quit IRC13:47
spatelJust matter of time.. and we will be on OVN..13:47
spatelI can't migrate existing cloud to OVN its generating revenue for us and i don't want to put myself in trouble trying new tech...13:49
strattaoHahaha, yeah makes sense!13:52
spatelalso there is some work need from OVN side to be done to make it more production ready like clustering etc..13:52
spatelnoonedeadpunk if you have time, I am doing minor upgrade and hit this bug during running os-horizon-install.yml playbook - http://paste.openstack.org/show/804530/13:59
spatelany idea13:59
noonedeadpunkwell, yes14:05
noonedeadpunkwe backported master wrongly14:05
spatel:D14:06
spatelso what is the good way to move forward14:07
spatelnext week i am planning to upgrade on production so want to make sure my lab pass all test14:08
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_horizon stable/victoria: Fix barbican-ui installation  https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/78666214:08
noonedeadpunkspatel: ^14:09
spatel:) applying now14:09
noonedeadpunkwell, let me update it a bit14:10
spatelstandby14:10
noonedeadpunkdoh, why so long...14:11
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_horizon stable/victoria: Fix barbican-ui installation  https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/78666214:11
spatelgoing to apply now14:15
spatelnoonedeadpunk is this correct? - https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/786662/2/defaults/main.yml#12414:18
spatel- -- ?14:18
*** rpittau is now known as rpittau|afk14:18
*** macz_ has joined #openstack-ansible14:20
spatelgetting error related some YAML formatting14:20
spatelmay be my issue.. let me check14:20
spatellike 126 has some issue in that patch14:22
noonedeadpunkdoh, yeah14:23
*** macz_ has quit IRC14:24
spatel" is missing14:24
noonedeadpunksorry, ruined it )14:24
spateli have comment on patch14:24
noonedeadpunkupdate already flying14:24
spatelperfect14:24
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_horizon stable/victoria: Fix barbican-ui installation  https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/78666214:25
spatelAll looking good after patch.. lets merge as soon as Zuul pass :)14:27
*** jamesdenton has quit IRC14:36
noonedeadpunkzbr: fwiw, yaml-shcema check is not really helpful. `Missing property "action"` looks like super obsoleted by ansible15:06
*** jamesdenton has joined #openstack-ansible15:13
zbrnoonedeadpunk: afaik, action was never obsoleted, only the "action: string" bit.15:16
zbrbut as i said, the schema is highly experimental, and i was not able to find time to improve it recently15:16
zbrbut if someone is proposing a fix, i can find time to review and release a patch for sure.15:17
noonedeadpunkzbr: gotcha. would be nice just having an option to disable it just in case...15:21
strattaowait, does jamesdenton still come around here?!?15:21
noonedeadpunkit happens :)15:21
strattao!!15:21
openstackstrattao: Error: "!" is not a valid command.15:21
*** kukacz has joined #openstack-ansible15:23
zbrnoonedeadpunk: that is quite a problem because there is no code to do that. all the code is inside redhat-yaml extension.15:30
zbrlook at https://github.com/ansible-community/vscode-ansible/blob/master/package.json#L103-L16215:30
zbrbasically am only informing that extension what schemas to use, nothing else.15:31
noonedeadpunkah, gotcha15:31
zbryou could override them in your user config, but I doubt I can add a checkbox for it.15:31
zbri am now asking yaml extension maintainers....15:31
openstackgerritMerged openstack/openstack-ansible stable/victoria: Return PyMySQL installation for distro installs  https://review.opendev.org/c/openstack/openstack-ansible/+/78610715:35
jamesdentonstrattao from time to time15:36
strattaoGood to see you still around! Got any opinions on OVN? (Looking at the possibility of replacing our ovs+dvr setup)15:38
jamesdentonhmm15:42
jamesdentonTBH we are not using it in production, yet, but will be soon for some OSP 16 deploys. I don't have a good handle on any issues/caveats. The OSA implementation could use some love15:43
noonedeadpunkstrattao: just ensure that feature gap is ok for you https://docs.openstack.org/neutron/latest/ovn/gaps.html15:44
noonedeadpunkas for me ipv6 and bgp are kind of crucial15:45
jamesdentonthanks noonedeadpunk i was looking for that15:45
openstackgerritMerged openstack/openstack-ansible-os_nova master: Use template URLs in Cell Mappings  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/78625816:30
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Bump MariaDB version to 10.5.9  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/77708816:39
noonedeadpunkjrosser: jsut in case, came up with that now ^ but needs more testing in multinode env16:46
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master  https://review.opendev.org/c/openstack/openstack-ansible/+/78580016:47
*** gyee has joined #openstack-ansible17:04
spotznoonedeadpunk: Just to be sure we have not released Wallaby as we're trailing? Only Tripleo is showing in the Wallaby deployment guide17:59
*** andrewbonney has quit IRC18:05
noonedeadpunkspotz: nope, we have not yet. and not even branched18:08
noonedeadpunkand have so much stuff to do before we will be able to18:08
spotzOk I didn't want to go try to fix it if we weren't releeased yet as that would make no sense:)18:09
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-haproxy_server master: Fix haproxy logging  https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/78670318:35
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_adjutant master: Move adjutant pip package from a constraint to a requirement  https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/78455118:41
*** jralbert has joined #openstack-ansible18:42
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Bump MariaDB version to 10.5.9  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/77708818:43
*** spatel has quit IRC19:18
*** jralbert has quit IRC19:47
*** fanfi has joined #openstack-ansible20:13
fanfihello all, could I set OVS instead of Linux bridge for LXC container ?20:17
jrosserfanfi: i guess the answer is yes, but 99% of people with OVS for neutron keep standard bridges for the controller containers20:32
jrosserdo you have a specific requirement for OVS there?20:33
jrosserreally so long as the bridges exist and packets go to the right places, br-mgmt, br-(lbaas,dbaas) etc, it doesnt really matter how they are created or managed20:35
fanfiyes, i would like to set octavia service, but when octavaia container is connected to the br-lbaas linux bridge is unable to communicate with amphora instacnes on compute nodes.20:39
fanfios is there any trick ?20:40
fanfiif i connect the phisycal interface to the linux bridge i able to communicate but dhcp agent on infra host unable to comunicate with amphora instance20:42
jrosserfanfi: there is an example here https://docs.openstack.org/openstack-ansible-os_neutron/latest/app-openvswitch.html#configuring-bridges-open-vswitch20:57
jrosseri've never done this though, so some experimentation will be needed20:59
fanfithx, i wil try it and are you using octavia ?21:07
*** admin0 has quit IRC21:16
jrosserfanfi: yes, but with neutron linuxbridge21:16
fanfiwaw, and are you recomend neutronLinuxbridge insted OVS ?21:18
*** luksky has quit IRC21:39
*** poopcat has quit IRC21:53
*** poopcat has joined #openstack-ansible21:56
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Switch tempestconf centos-8-stream nodes and set as NV  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/78401922:27
*** gyee has quit IRC22:37
*** tosky has quit IRC23:38

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!