Friday, 2020-12-04

*** klamath_atx has quit IRC00:09
*** nurdie_ has joined #openstack-ansible00:16
*** sshnaidm|afk has joined #openstack-ansible00:20
*** sshnaidm|afk is now known as sshnaidm|off00:20
*** nurdie_ has quit IRC00:21
*** nurdie_ has joined #openstack-ansible00:49
*** spatel has joined #openstack-ansible00:52
*** nurdie_ has quit IRC00:53
*** guilhermesp has quit IRC00:56
*** jungleboyj has quit IRC00:56
*** jungleboyj has joined #openstack-ansible00:57
*** gouthamr has quit IRC00:57
*** nicolasbock has quit IRC00:57
*** bl0m1 has quit IRC00:57
*** gundalow has quit IRC00:57
*** guilhermesp has joined #openstack-ansible00:58
*** bl0m1 has joined #openstack-ansible00:58
*** nicolasbock has joined #openstack-ansible00:58
*** gouthamr has joined #openstack-ansible00:58
*** gundalow has joined #openstack-ansible01:00
*** tosky has quit IRC01:01
*** rfolco has joined #openstack-ansible01:02
*** cshen has quit IRC01:04
*** macz_ has quit IRC01:05
*** waverider has quit IRC01:10
*** rfolco has quit IRC01:18
*** openstackgerrit has quit IRC01:38
*** spatel has quit IRC01:54
*** macz_ has joined #openstack-ansible02:10
*** macz_ has quit IRC02:15
*** snadge has joined #openstack-ansible02:29
*** spatel has joined #openstack-ansible02:37
*** nurdie_ has joined #openstack-ansible02:50
*** nurdie_ has quit IRC02:55
*** nurdie_ has joined #openstack-ansible04:12
*** nurdie_ has quit IRC04:14
*** nurdie_ has joined #openstack-ansible04:14
*** nurdie_ has quit IRC04:15
*** lemko has quit IRC04:26
*** lemko has joined #openstack-ansible04:26
dmsimardnoonedeadpunk, jrosser: I investigated and created this issue for the sqlite database lock issue: https://github.com/ansible-community/ara/issues/19504:28
dmsimardfor now you can workaround by pinning to 1.5.1 or export ARA_ARGUMENT_LABELS=""04:28
dmsimardI need to spend more time on it but it won't be tonight :)04:32
*** nurdie_ has joined #openstack-ansible04:50
*** nurdie_ has quit IRC04:56
*** spatel has quit IRC05:16
*** nurdie_ has joined #openstack-ansible05:29
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-ansible05:33
*** nurdie_ has quit IRC05:35
*** spatel has joined #openstack-ansible06:33
*** spatel has quit IRC06:37
*** miloa has joined #openstack-ansible06:39
*** cshen has joined #openstack-ansible07:11
*** pto has quit IRC07:29
*** nurdie_ has joined #openstack-ansible07:30
*** nurdie_ has quit IRC07:35
*** luksky has joined #openstack-ansible07:55
noonedeadpunkdmsimard: ok, thanks for having a look!08:07
*** pcaruana has joined #openstack-ansible08:35
*** waverider has joined #openstack-ansible08:43
admin0morning \o08:50
*** tosky has joined #openstack-ansible09:05
noonedeadpunk\o09:06
*** nurdie_ has joined #openstack-ansible09:32
*** nurdie_ has quit IRC09:37
*** spatel has joined #openstack-ansible10:05
*** waverider has quit IRC10:08
*** waverider has joined #openstack-ansible10:09
*** spatel has quit IRC10:11
*** pto has joined #openstack-ansible10:26
ptoThe linux bridge agent i broken in ussuri 21.2.0 on Ubuntu 20.04 LTS: http://paste.openstack.org/show/800728/10:27
ptoDoes the os_neutron role link to neutron/master?10:35
*** cshen has quit IRC10:45
*** cshen has joined #openstack-ansible10:47
*** cshen has quit IRC10:56
*** cshen has joined #openstack-ansible11:00
ptoAparently the change have not been merged into neutron ussuri/stable yet - I guess it needs reviewers: https://review.opendev.org/c/openstack/neutron/+/76540811:15
ptoIs it possible to cherry pick the fix?11:15
*** nurdie_ has joined #openstack-ansible11:33
*** waverider has quit IRC11:35
*** waverider has joined #openstack-ansible11:35
*** rfolco has joined #openstack-ansible11:36
*** nurdie_ has quit IRC11:38
*** waverider has quit IRC11:41
kleiniHow can grafana, prometheus and elk_mectrics_7x be integrated into OSA setup or what is the best way to integrate that somehow?11:49
admin0i use graylog, zabbix+grafana11:52
admin0i would like to see a howto of what you are trying kleini11:53
*** spatel has joined #openstack-ansible11:54
kleiniI try to get the prometheus node exporter deployed on every host11:55
kleinito collect host metrics. I am not providing a public cloud but a private one, where we need to squeeze every little bit of resource out of the hosts and we need to see resource bottlenecks11:57
kleiniI do setup-hosts, setup-infrastructure, setup-openstack and then what for getting prometheus node exporters every where deployed from openstack-ansible-ops?11:58
*** pto has quit IRC11:58
*** pto_ has joined #openstack-ansible11:58
*** spatel has quit IRC11:58
jrosserhere we have two sets of ansible, one for “before osa” to get all the hosts sorted out, then we run osa11:58
kleinioh, my initial question is missing this openstack-ansible-ops repository. sorry for that11:59
jrosserin the “before osa” ansibke we do all the Prometheus exporter stuff11:59
kleiniI have "before OSA", too. But e.g. Grafana should run in infra container, so I have dependency to OSA inventory12:00
kleiniand setup-hosts, of course12:00
jrosseronly if you do it that way.... our elk stack is so significant now it’s treated as a separate thing12:01
jrosserso not deployed on the infra hosts at all12:01
jrosserbut we use all the tooling from openstack-ansible-ops still12:01
kleiniand the tooling from OSA regarding LXC containers is very useful but it is hard for me to use OSA inventory stuff12:02
jrosserimho for something more than trivial you will be looking for dedicated elasticseach nodes anyway, the cpu and memory requirements can be large12:02
jrosseryou don’t have to use the inventory, and in fact the openstack-ansible-ops elk deployment is decoupled from the OSA inventory12:03
jrosseragain you can choose how that works by using an “integration inventory”12:03
jrosserwe have a separate inventory for the elk cluster which is nothing to do with OSA, then import the OSA json with a python script to allow elk beats to be deployed to things that only exist in the OSA dynamic inventory12:06
kleiniokay, so a lot of integration work is necessary12:06
jrosseryes, the ops repo is a suggestion really12:06
jrosseryou can follow the recipie in the ops repo docs and you should get a tightly coupled OSA/elk setup12:07
jrosserbut as you’ve seen that can then be difficult if you want to add Prometheus and more things as well12:08
jrosserthis is a bit similar to the integrated/separate ceph cluster question12:08
kleinibut at some point ceph cluster was integrated, too, and to be honest, this helped me a lot initially12:12
kleinitoday I separate it, as we already have a productive Ceph cluster, that OSA deployment re-uses12:13
jrossersure, everyone has different needs... our elk stack currently gathers from two clouds for example12:13
jrosserwhich was another reason to break it out separately12:14
kleinimakes sense12:14
jrosserI did loads of work on the ops repo elk code in my lab, just like you say with everything on the infra/log nodes12:15
jrosserbut that’s not really scaled when things got bigger and more complicated12:15
jrosserso depending on the use case, doing it all with OSA, lxc fully integrate could be just fine12:16
*** pto_ has quit IRC12:20
*** nurdie_ has joined #openstack-ansible12:45
*** nurdie_ has quit IRC12:59
*** spatel has joined #openstack-ansible13:00
*** spatel has quit IRC13:05
*** macz_ has joined #openstack-ansible13:08
kleiniI would like to contribute, too, but mostly I still get not further than deploying things and testing reviews13:08
kleiniHopefully I can gain the knowledge to contribute.13:09
*** macz_ has quit IRC13:12
admin0when i use br-lbaas on only containers, the lbaas containers fail to start saying: Failed to attach "br-lbaas" to openvswitch bridge "c865e4e3_eth14"14:07
admin0but i am not using openvswitch14:07
*** miloa has quit IRC14:08
*** fanfi has quit IRC14:19
*** spatel has joined #openstack-ansible14:28
spatelwhere is my victoria!!!14:29
ThiagoCMCLOL14:29
noonedeadpunkspatel: ʘ︵ʘ14:29
noonedeadpunkany core around for reviews?14:30
spatelSilence is painful :)14:30
spatelnoonedeadpunk: what is blocking us to release victoria ?14:30
spatelany specific issue or gate?14:30
noonedeadpunknot much tbh14:30
noonedeadpunkhttps://review.opendev.org/q/(project:%2522%255Eopenstack/(openstack-ansible%257Cansible-).*%2522)+NOT+project:openstack/ansible-role-openstack-operations+NOT+project:openstack/ansible-role-chrony+NOT+project:%2522%255Eopenstack/ansible-role-.*-hsm%2522+NOT+project:%2522%255Eopenstack/ansible-role-(k8s%257Ctripleo).*%2522+NOT+project:%2522%255Eopenstack/(ansible-collections-openstack).*%2522+NOT+project:%2522%255Eopenstack/(ansible-role-14:31
noonedeadpunkcollect-logs).*%2522+status:open+++NOT+label:Workflow%253C%253D-1+NOT+label:Workflow%253E%253D1+label:Verified%253E%253D1+NOT+label:Code-Review%253C%253D-1+label:Code-Review%253E%253D2+branch:master+14:31
noonedeadpunkooops14:31
admin0:014:31
noonedeadpunkhttps://bit.ly/39PqDDc14:31
noonedeadpunkcores another vote would be awesome ^14:32
noonedeadpunkspatel: jsut trying to get merged as much as possible14:33
noonedeadpunkthe only thing that is broken in terms of ci is openstack-ansible-plugins I guess but it's ok I think14:34
spatelnoonedeadpunk: we can cut the beta release right and coming week add remaining stuff.14:34
noonedeadpunkthe annoying stuff that we will need to backport all of that14:34
spatelhmm14:34
*** nurdie_ has joined #openstack-ansible14:35
noonedeadpunkmgariepy: you you're around, would be awesome if you could look through patches in https://bit.ly/39PqDDc14:35
spatelIn that list some of commit are very tiny and can merge easily like this one - https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/76535114:37
spatelsorry wrong copy paste14:37
spatelI meant this one - https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/76532014:37
noonedeadpunkwe can even avoid mergning that tbh14:37
spateltotally14:38
spatelhow do i rebase this patch - https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/76535114:38
spatelI am not git ninja :(14:38
noonedeadpunk`git review -d 765351; git rebase origin/master; solve conflicts; git rebase --continue; git review -f14:39
noonedeadpunkI can help you out with it if you wish14:39
spateljust copy paste that command in my git checkout right?14:40
noonedeadpunkexcept solving conflicts part :p14:41
spatelgo ahead..do it :) noonedeadpunk14:41
*** openstackgerrit has joined #openstack-ansible14:44
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Removing spare_amphora_pool_size option  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/76535114:44
spatelThanks14:50
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Fix stackviz for failed tempest runs  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/76405514:51
noonedeadpunkyou're welcome!14:51
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Add Octavia SSH key creation test  https://review.opendev.org/c/openstack/openstack-ansible/+/76554414:54
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Removing spare_amphora_pool_size option  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/76535114:55
*** jbadiapa has joined #openstack-ansible15:00
mgariepynoonedeadpunk, reviewing15:11
openstackgerritSatish Patel proposed openstack/openstack-ansible-os_nova master: Support for virtio-net rx/tx queue sizes  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/76554715:11
mgariepythe new gerrit..15:12
mgariepyit's strange..15:12
mgariepyand.. slow.15:12
spatelnoonedeadpunk: wish we can merge this one at some point in victoria - https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/76554715:18
mgariepyhaving a +2 code review would be nice to have directly in the page.15:26
*** spatel has quit IRC15:47
*** spatel has joined #openstack-ansible15:48
jamesdentonspatel i added a comment to that, btw15:52
*** odyssey4me has quit IRC15:52
spatel+1 totally valid point15:53
noonedeadpunkjamesdenton: you read my thoughts for sure - going to place there -2 tbh15:58
noonedeadpunkmgariepy: thanks a lot! yep, it's super slow...16:00
*** macz_ has joined #openstack-ansible16:05
*** macz_ has joined #openstack-ansible16:06
noonedeadpunkspatel: does https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/765348 works for you after I "adjusted" it?16:06
*** gyee has joined #openstack-ansible16:07
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone master: Move openstack-ansible-uw_apache centos job to centos-8  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/75412216:07
spatelnoonedeadpunk: i didn't run build yet but just download tar to verify.. give me few min to re-run build and verify16:07
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone master: Add openstack-ansible-uw_apache focal job  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/75412316:08
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-tests master: Bump ansible-base to match integrated repo  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/76556516:14
noonedeadpunkI really want to branch badly....16:14
openstackgerritMerged openstack/openstack-ansible-os_nova master: Fix templating issue due to conditional  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/76533216:21
spatelnoonedeadpunk: re-running hatop build soon let you know result16:22
noonedeadpunksure, no hurry I guess:)16:23
*** ajg20 has joined #openstack-ansible16:24
ajg20Hello, I just setup my first openstack ansible AIO. Any pointers for setting up my first instance and get it accessible to internet?16:24
ajg20I was able to create a private 10.0.0.0/8 subnet  for an instance and connected 10.0.0.0/8 network to the default public  172.29.248.0/2216:26
ajg20but the instance cannot get out to the internet16:26
spatelnoonedeadpunk: it ran successfully but didn't update /usr/local/bin/hatop file, looking into logs16:33
spatelthis looks strange -  command: "install -m 755 bin/hatop /usr/local/bin"16:33
noonedeadpunkwhy so?16:34
spatelwhy it doesn't have full path?16:34
spatelwhere is this located bin/hatop ?16:34
noonedeadpunkthere's chdir as argument16:35
spatelhm16:35
spatellet me debug and see..16:35
noonedeadpunkajg20: well we did not make real public network there. I think you might want to create another network which will be public one, but all depends on where you run aio16:35
noonedeadpunkspatel: does it fail?16:35
noonedeadpunkchdir for command does `cd` into the provided directory and run command afterwards16:36
spatelno it didn't fail, ran successful but didn't change original file located at /usr/local/bin/hatop16:36
noonedeadpunkah, well16:36
noonedeadpunkit's probably because of creates argument....16:36
ajg20noonedeadpunk Thanks, I will look at making a new public network and connect the private to it; to see if the instance can get out to the internet then.16:37
noonedeadpunkit means that command won't run in case there's a file under /usr/local/bin/hatop16:37
spatellet me remove it and re-run16:38
openstackgerritMerged openstack/openstack-ansible-os_swift master: Stop to use the __future__ module.  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/73288316:38
spatelnoonedeadpunk: it works after removing /usr/local/bin/hatop :)16:40
noonedeadpunkwell, removal of the current hatop might be an idea for ajustment of the upgrade script16:43
spatelwe should change logic to force upgrade16:44
spatelwhat action we take commit like this - https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/76554716:47
*** chandankumar is now known as raukadah16:47
spatelabandon ?16:47
noonedeadpunkif you don't want to reflect docs - yes16:56
openstackgerritMerged openstack/openstack-ansible-os_nova master: Fix use of deprecated image_cache_manager_interval  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/76533816:58
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Reduce number of processes on small systems  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/76464717:01
openstackgerritMerged openstack/openstack-ansible-os_swift master: Use synchronize module for rings distribution  https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/76535417:32
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Install sysctl package in container for debian  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/76557317:37
noonedeadpunkjrosser: mgariepy we super need this patch ^ otherwise we get https://zuul.opendev.org/t/openstack/build/cdef505dd8cd44e1b00235d24e08d77d/log/job-output.txt#418617:38
jrosserdone - i expect thats something i removed in cleaning up the lxc image packages18:02
openstackgerritJames Denton proposed openstack/openstack-ansible-os_neutron master: Make VLAN ranges option when defining provider networks  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/76558118:16
openstackgerritJames Denton proposed openstack/openstack-ansible-os_neutron master: Make VLAN ranges option when defining provider networks  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/76558118:21
openstackgerritMerged openstack/openstack-ansible master: Do not print btrfs error in log  https://review.opendev.org/c/openstack/openstack-ansible/+/76531818:21
openstackgerritMerged openstack/openstack-ansible master: Do not warn about incorrect group naming  https://review.opendev.org/c/openstack/openstack-ansible/+/76095218:21
openstackgerritMerged openstack/openstack-ansible master: Set reasonable default for octavia_ceilometer_enabled  https://review.opendev.org/c/openstack/openstack-ansible/+/76516718:21
noonedeadpunkyeah it was indeed removed previously during cleanup18:40
noonedeadpunkonce it merge I hope https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/763041 will be passing which unlock role18:41
noonedeadpunkso would be greate to vote for it as well :p18:41
*** jbadiapa has quit IRC18:51
ajg20I need some advice, I am using a local virtual machine that has openstack ansible installed with all defaults for AIO and it runs well. I am running into issues with networking for instances to get out to the internet. My external VIP is 192.168.1.99, and to get to the internet the default gateway is 192.168.1.1.   I am not sure what to set my19:08
ajg20Openstack public subnet to, I am assuming it was 192.168.1.0/24 using virtual machine ethernet interface of ens160 but this does not allow me to create it. I "receive Error: Failed to create network External network"19:08
ajg20I want to make sure i am going down the right path or not, any advice will help19:09
*** yann-kaelig has joined #openstack-ansible19:10
*** yann-kaelig has quit IRC19:11
ajg20If I can figure out network. I plan to have one phyiscal server(64 CPU with 187GB memory) using one network directly connected to the Internet. I was looking at deploying openstack-ansible to it and have instances use SNAT and floating point IP's addresses since i have a range of 8 public IP paddresses.19:11
ajg20local vm test networks19:17
ajg20 IPv4 address for br-dbaas:   172.29.232.10019:17
ajg20192.168.1.9919:17
*** pcaruana has quit IRC19:22
*** luksky has quit IRC19:46
*** luksky has joined #openstack-ansible19:46
spatelajg20: you have to create router and attach it to your physical LAN19:58
spateland add floating IP to assign your AIO vms to use them to get out19:58
ajg20What should I use for public "physical network"?20:01
spatelyou do have physical IP on AIO right just use that20:03
ajg20Creating a new "Networks" from admin area with ens160 which is the external network provides an error "Failed to create network". Where would i see the error for this? in the container?20:06
jrosserajg20: it would help to put some more detailed output at paste.openstack.org20:07
jrosseri'm also a bit confused between your current AIO and wanting instances to get to the internet via probably an external router/NAT20:08
ajg20Not a problem, I will add details there.20:08
jrosserand then also asking about what to do with your 8 public IP addresses, not sure what context this is20:09
spatelajg20: These are good notes to just understand process - https://gist.github.com/lbragstad/133dc2ddb1e8a8051e25f7cfde893ac720:11
ajg20I am working in a local virtual machine with openstack ansible setup to test before setting it up on our production server.20:17
ajg20AIO is development local vm20:18
ajg20production is 64 CPU with 187GB memory with 8 public addresses using one physicals network interface.20:18
ajg20I am only working on my development only right now.20:19
ajg20The development AIO works as expected until it comes to network then i am confused between container networks and host network to get to the internet for instances.20:21
ThiagoCMCajg20, let's say that your 8 public IP is in a flat ethernet, no VLANs, plugged at the eth4 of your server, then, our openstack_user_config.yml can have:20:23
ThiagoCMC    # Flat Network20:24
ThiagoCMC    - network:20:24
ThiagoCMC        container_bridge: "eth4"20:24
ThiagoCMC        type: "flat"20:24
ThiagoCMC        net_name: "lan"20:24
ThiagoCMC        group_binds:20:24
ThiagoCMC          - neutron_linuxbridge_agent20:24
ThiagoCMCOops, sorry about the flood! pastebin next time20:24
ThiagoCMCThen, in OpenStack, you refer to this network as "lan", its name.20:25
ThiagoCMCSo you can create a "network" and a "subnet" on top of it.20:25
ajg20I am putting more detail into the paste.openstack.org20:26
ThiagoCMCLiek this: http://paste.openstack.org/show/800755/20:27
ThiagoCMCI'm using "os_network" and "os_subnet" because of Ansible but, the names are the same if you use the `openstack network / subnet` command20:28
ThiagoCMCajg20, don't be confused by the var name "container_bridge"! It isn't actually a container bridge.20:32
ThiagoCMCSince the neutron linuxbridge agent runs on metal.20:32
*** waverider has joined #openstack-ansible20:33
ThiagoCMCHey guys, after an sucessiful OSA+Ceph deployment, I go to my ceph-mon to change the Ceph `pg_num` of my pools. However, in a second run of OSA playbooks, it change back the pg_num to 8! Like this:20:37
ThiagoCMCTASK [ceph-osd : create openstack pool(s)] = changed: [cosstor-4 -> 10.232.197.89] => (item={'name': 'images', 'pg_num': '8', 'pgp_num': '8', 'rule_name': 'replicated_rule', 'type': 1, 'erasure_profile': '', 'expected_num_objects': '', 'application': 'rbd', 'size': '3', 'min_size': '0', 'pg_autoscale_mode': False})20:37
ThiagoCMCWhere is this configured!? It's nowhere within my /etc/openstack_deploy20:37
ThiagoCMCMust be hidden somewhere... Is it the `/etc/ansible/roles/ceph-ansible/roles/ceph-defaults/defaults/main.yml` file?20:38
ajg20http://paste.openstack.org/show/800756/20:40
*** waverider has quit IRC20:47
*** waverider has joined #openstack-ansible20:47
*** jamesdenton has quit IRC20:51
*** jamesdenton has joined #openstack-ansible20:52
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Install sysctl package in container for debian  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/76557321:04
*** rfolco has quit IRC21:07
*** cshen has quit IRC21:14
masterpeWe are doing our galera backups with mariabackup with only the --backup --target-dir options. But this locks the database21:17
masterpeAnd so so it fails for example octavia21:17
jrosserThiagoCMC: OSA just is a thin wrapper around ceph-ansible for the ceph components21:18
jrosserso the defaults in ceph-ansible will be used, unless you override or provide config_template variables that ceph-ansible understands21:19
*** cshen has joined #openstack-ansible21:19
ThiagoCMCjrosser, but it also provides a lot of default vars for ceph, right?21:19
jrosseri wouldnt say a lot really21:19
ThiagoCMCFor example, to create the openstack pools, pg_num, not install the Ceph's dashboard, not use docker and etc...21:20
jrosserthose are overrides of defaults set in ceph-ansible21:20
ThiagoCMCHmm... I see21:20
jrosserand some probably are there to make things work out right for all OS and the AIO21:20
masterpeWhen I use --no-lock I don't get any consistence databases21:21
spatelI have question related octavia21:21
spatelOn horizon LB section i am not seeing option to select flavor21:22
ThiagoCMCjrosser, let's say that I have a ceph deployed somewhere else, with just ceph-ansible (no OSA). Which files do I have to copy from my OSA deployment server, into this isolated ceph, to make it deploy just like running from openstack-ansible?21:22
jrossernothing at all21:23
jrosserif the deploy host can ssh into the mon of the external ceph the only thing you have to provide to OSA is the ip addresses of the mon nodes21:23
jrosserif the deploy host cannot do that, you have to put the contents of ceph.conf and the required keyrings into the OSA deploy host21:23
ThiagoCMCSure21:24
ThiagoCMCBut I would like to fully isolate those two, and today I can't, because my isolated Ceph doesn't create the OpenStack pools, like images, vms, backups and etc, it comes "empty"... So I would like to copy the files from my OSA deployment server, into the ceph deployment ceph, to make it behave just like when "under" OSA umbrella21:25
jrosserceph-ansible can create the openstack pools21:25
jrosserdefined here https://github.com/ceph/ceph-ansible/blob/master/tests/functional/all_daemons/group_vars/all#L12-L2521:27
jrosseroh sort of21:28
jrossersorry here https://github.com/ceph/ceph-ansible/blob/master/group_vars/all.yml.sample#L58921:29
openstackgerritMerged openstack/openstack-ansible-os_ironic master: Define condition for the first play host one time  https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/75634021:33
ThiagoCMCjrosser, right, thanks! So, in OSA, this is pre-configured here: `/etc/ansible/roles/ceph-ansible/roles/ceph-defaults/defaults/main.yml`, correct?21:34
jrosserOSA enables the pool creation here https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/user_variables.yml.prod-ceph.example#L22-L2321:34
ThiagoCMCHmmm21:35
ThiagoCMCOk21:35
jrosserwell no, thats part of ceph-ansible21:35
ThiagoCMCdamn lol21:35
ThiagoCMCok21:35
jrosserOSA clones ceph-ansible into /etc/ansible/roles and just calls the same roles21:35
ThiagoCMCGot it... It doesn't do anything inside of `/etc/ansible/roles/ceph-ansible` ?21:35
jrosserso really what you need to do is make sure that the things that get set/enabled in OSA group vars which are relevant to ceph-ansible are also set when you do that seperate deployment21:36
jrosserbut they would be in the group_vars for your seperate ceph-ansible setup instead21:36
jrosserso really all OSA does is have some playbooks which call the ceph-ansible roles21:37
jrosserand it sets a very small number of vars that ceph-ansible understands21:37
ThiagoCMCPerfect!21:37
ThiagoCMCI'll try to deploy my isolated Ceph and make it behave like when under OSA umbrella!   :-D21:38
ThiagoCMCThank you!21:38
jrosserno problem :) openstack_config: true will get you most of the way there i think21:38
ThiagoCMCNiiice!21:38
jrosserif you allow ssh into a mon then there almost nothing else to do21:38
ThiagoCMCSounds easier than I though!  lol21:39
jrosserwhen you have OSA deploy ceph you define a group in the OSA inventory for the mons, osd, rgw and so on21:39
ThiagoCMCyep21:39
jrosserwhen you have an external ceph none of that is needed in the OSA side21:40
ThiagoCMCgot it21:40
jrosserinstead you pass a list of where the monitors are, like this https://docs.openstack.org/openstack-ansible-ceph_client/latest/configure-ceph.html#monitors21:40
ThiagoCMCI also have to give the Ceph keys to OSA, right?21:40
ThiagoCMCI think I have this page somewhere here in my thousand tabs lol21:41
jrosseryou only have to do that yourself if the OSA deployment host cannot ssh to the mon21:41
ThiagoCMCYes, I don't want to allow OSA to do that.21:41
jrosserit will retrieve ceph.conf and the keys automatically if you allow that21:41
jrosserif you don't want to do that then you need more variables on the OSA side, like this https://docs.openstack.org/openstack-ansible-ceph_client/latest/config-from-file.html21:42
jrosseryou must provide the content for ceph.conf and the keyrings manually21:42
ThiagoCMCAmazing!21:44
jrosserthis is the OSA side config to prevent it trying to use ssh to the mon https://github.com/openstack/openstack-ansible-ceph_client/blob/master/defaults/main.yml#L63-L7221:47
spatelAny idea why octavia not showing flavor list here - https://ibb.co/LpjrQnX21:47
spatelDo you guys can see drop-down list of its just me21:48
ThiagoCMCHmm... Okdok21:49
jrosserspatel: i have a flavor listed there21:49
spateljrosser: did you create flavor different way?21:52
spatelI meant using this method - https://docs.openstack.org/octavia/latest/admin/flavors.html21:53
jrosserspatel: http://paste.openstack.org/show/800760/21:57
spatelhmm21:58
spateljohanssone: my list is empty  "openstack loadbalancer flavor list"21:58
spatelso what is this "m1.amphora" which OSA created?21:58
jrosserh well loadbalancer flavor != instance flavor iirc21:58
jrosserisn't it more like "ha loadbalancer" flavor vs. "non-ha loadbalancer"21:59
jrosserrahter than instance size21:59
spatelhmm22:00
spatelthat is where i got confused22:00
spatelcan i create loadbalancer flavor with HugePage property or CPUpinning?22:01
jrosserfor me m1.amphora corresponds to the flavor is given in octavia.conf/amp_flavor_id22:01
jrosseri guess you set whatever parameters you need on m1.amphora22:02
* jrosser late here, done for today22:02
spateljrosser: Thank you!!!22:03
spatelenjoy your weekend22:03
jrosseryou too22:03
ThiagoCMCJust out of curiosity... Does Octavia needs QEMU to create load balancers?!  O_O22:05
ThiagoCMCDo the whole network traffic pass thought the Ocatavia instances?!22:06
johnsomThe Amphora driver creates instances via nova. Yes, tenant traffic passes through the service vm instances.22:07
spateljohnsom: i have one more question if you have time22:12
*** ajg20 has quit IRC22:12
spatellets saying i reboot my compute node and while its rebooting amphora think VM is dead and start rebuilding one on other compute node in that case how it will handle22:12
johnsomSure ansible related or should we chat in the lbaas channel?22:12
spatellets talk in lbaas22:13
johnsomCool22:13
admin0with br-lbaas in compute/network nodes, octavia refused to even install .. when the playbooks ran succesfully, it created network etc .. it gives this error: https://gist.githubusercontent.com/a1git/2adeb761200b4c9a49674a906cf7b69e/raw/dc6a7403d8bac4446144de2bbdd82a65652d9621/gistfile1.txt22:13
admin0which is cannot enslave bridge to a bridge22:13
admin0without br-lbaas in compute/network node*22:14
openstackgerritMerged openstack/openstack-ansible-plugins master: Fix linters  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/76304122:20
*** spatel has quit IRC22:22
masterpeadmin0: we are using a neutron_agent.yml  in the group_vars with a neutron_linuxbridge_agent_ini_overrides22:26
admin0masterpe, is it possible to paste your configs22:27
admin0i have been stuck with this for days now22:27
masterpehttps://gist.github.com/mpiscaer/03c5a212a51abd05ce889abda7f9390e22:30
admin0masterpe, 2nd question .. in what servers do you have your br-lbaas ?22:30
admin0only in controllers ?22:30
admin0is your controller also your network node ?22:31
masterpeAnd don't for get to create a neutron network for the lbaas.22:33
admin0masterpe, yours and mine look identical .. https://gist.github.com/a1git/6ddcb0d3c0a274fd031b16a7babf725822:33
masterpeneutron net-create lbaas-mgmt --provider:network_type flat --provider:physical_network lbaas22:34
masterpeand a subnet for that lbaas network22:34
masterpeThe amphora loadbalancer is a is a instance. So you also need a amphora image in glane.22:35
admin0actually in my case, the playbook created it automatically22:35
masterpeok22:35
admin0it created it correctly: https://gist.githubusercontent.com/a1git/439682c98334bd1952b41d0f6f7f2361/raw/e1d929d4605b34a498edf205bc3307bc39dbccc1/gistfile1.txt22:36
admin0the amphora image is also built and is there22:36
admin0because br-lbaas alrady exists in my network/compute nodes, i get an error saying cannot add bridge to bridge22:36
admin0so which is the most imp qustion .. where do you have br-lbaas created22:37
masterpeWe had to remove the br-lbaas bridge from the compute nodes.22:37
admin0in controllers and  in network nodes ? but not in compute nodes ?22:37
admin0but that will make neutron give an error saying lbaas not found22:37
admin0as its listed in the physical mapping22:37
admin0oh oh22:38
admin0insead of physical interface mapping  lbaas:br-lbaas, yours is under bridge mapping22:38
admin0meaning you are saying its already a bridge ?22:38
masterpeThat is why we use neutron_linuxbridge_agent_ini_overrides22:38
admin0so br-lbaas is only in your network and in controllers22:39
masterpeThe physical_interface_mappings is our neurton vlan bridge. br-vlan22:39
masterpeon the compute nodes22:39
masterpeand so br-lbaas is only on the controllers and network.22:39
*** jamesdenton has quit IRC22:40
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Move keystone sp_idp setup to it's own tasks file  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/76042922:40
*** jamesdenton has joined #openstack-ansible22:40
admin0masterpe, in my case, my compute node is also a network node :)22:41
admin0so i have to now split up a few nodes to be only network and check those22:41
masterpeah, in our case the controller is also a network node.22:42
admin0what does this bridge overrride do .. it tells the system that the bridge is already exists, so don't bother to create it, just plug stuff in this bridge ?22:42
masterpeGood question. Guilherme Steinmüller from Vexxhosts configured this for use.22:45
masterpeWe also had to patch amphora with https://review.opendev.org/#/c/761805/ & https://review.opendev.org/#/c/756597/22:47
admin0masterpe, i will try your setup and check22:48
admin0one final question ..  how does an amphora instance look into the compute node ( in terms of brctl )22:48
admin0to which networks does it connect to22:48
admin0one ext-net and one lbaas-mgmt ?22:48
masterpeamphora image will boot up as a instance with octavia_spare_amphora_pool_size you have a number of instances standby. That instance gets a nic interface in lbaas-mgmt.22:50
masterpefor the provisioning communication and when the user creates a loadbalancer, it will also create a nic in the external network and interal network.22:51
*** macz_ has quit IRC22:51
masterpeThe only thing is what I encounter is that I backup the galera database with mariabackup, but that does a locked backup. En the Octavia service did not like that.22:54
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Define condition for the first play host one time  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/75441123:01
*** rfolco has joined #openstack-ansible23:01
*** rfolco has quit IRC23:06
admin0masterpe, thanks23:11
admin0i am trying to implement it here23:11
admin0how long more are you online for ?23:11
masterpeWas planning in going to bed soon.23:12
admin0then its fine .. i will update tomorrow23:12
admin0host_bind_override: "bond0.812"  - your br-lbaas is on top of this right ?23:13
admin0in network/controllers23:13
admin0and none in computes23:13
admin0but computes also will need access to bond0.812 ( just not have the br-lbaas)23:13
masterpeyes23:14
masterpeNeurton creates a brides on top of bond0.81223:16
masterpeon the compute23:16
admin0masterpe, thank you .. i will report/update tomorrow on success/failure23:17
admin0thank you and have a nice weekend23:17
*** luksky has quit IRC23:20
masterpeyou too23:21
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Fix magnum_service_user_domain_name  https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/76532023:39
*** cshen has quit IRC23:46
*** tosky has quit IRC23:54
*** cshen has joined #openstack-ansible23:57

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!