Friday, 2020-07-17

*** gyee has quit IRC00:33
*** cshen has joined #openstack-ansible00:49
*** cshen has quit IRC01:23
*** markvoelker has joined #openstack-ansible02:13
*** markvoelker has quit IRC02:18
*** rh-jelabarre has quit IRC02:20
*** also_stingrayza has joined #openstack-ansible03:06
*** stingrayza has quit IRC03:09
*** markvoelker has joined #openstack-ansible03:48
*** markvoelker has quit IRC03:53
*** KeithMnemonic has quit IRC04:55
*** udesale has joined #openstack-ansible04:57
*** cshen has joined #openstack-ansible05:05
*** yasemind has joined #openstack-ansible05:21
*** shyamb has joined #openstack-ansible05:29
*** shyamb has quit IRC05:45
*** markvoelker has joined #openstack-ansible05:49
*** shyamb has joined #openstack-ansible05:53
*** markvoelker has quit IRC05:54
*** shyam89 has joined #openstack-ansible06:03
*** cshen has quit IRC06:03
*** shyamb has quit IRC06:06
CeeMacmorning06:17
*** arkan has joined #openstack-ansible06:38
*** arkan has quit IRC06:50
*** arkan has joined #openstack-ansible06:50
*** markPilon has joined #openstack-ansible06:52
*** this10nly has joined #openstack-ansible06:53
*** cshen has joined #openstack-ansible07:05
*** cshen has quit IRC07:09
*** shyam89 has quit IRC07:17
*** udesale has quit IRC07:17
*** tosky has joined #openstack-ansible07:33
*** arkan has quit IRC07:50
*** andrewbonney has joined #openstack-ansible07:51
*** udesale has joined #openstack-ansible07:57
openstackgerritHervé Beraud proposed openstack/openstack-ansible master: Use unittest.mock instead of mock  https://review.opendev.org/73445207:57
*** also_stingrayza is now known as stingrayza08:08
*** jbadiapa has joined #openstack-ansible08:18
*** shyamb has joined #openstack-ansible08:24
*** shyam89 has joined #openstack-ansible08:36
*** shyamb has quit IRC08:39
*** spatel has joined #openstack-ansible08:49
*** arkan has joined #openstack-ansible08:51
*** spatel has quit IRC08:53
*** aedc has joined #openstack-ansible08:53
arkanhi08:58
arkanjrosser: I'm making progress with magnum08:58
arkanjust I want to ask, right now it passed 11 min.08:59
arkankube-master status - Create In Progress08:59
arkanis this normal ?08:59
arkanin magnum logs, I don't see errors08:59
*** cshen has joined #openstack-ansible09:02
*** cshen has quit IRC09:06
*** shyamb has joined #openstack-ansible09:24
*** shyam89 has quit IRC09:25
*** shyam89 has joined #openstack-ansible09:41
*** shyamb has quit IRC09:44
*** aedc has quit IRC09:54
*** aedc has joined #openstack-ansible09:54
*** shyamb has joined #openstack-ansible09:56
*** shyam89 has quit IRC10:00
*** udesale_ has joined #openstack-ansible10:01
*** udesale has quit IRC10:04
*** shyamb has quit IRC10:12
*** sshnaidm|afk is now known as sshnaidm|off10:16
*** markPilon has quit IRC10:25
*** shyamb has joined #openstack-ansible10:32
*** shyamb has quit IRC10:47
*** arkan has quit IRC10:49
*** mgariepy has quit IRC10:58
*** cshen has joined #openstack-ansible11:03
*** cshen has quit IRC11:07
*** shyamb has joined #openstack-ansible11:20
*** pcaruana has quit IRC11:33
*** pcaruana has joined #openstack-ansible11:44
*** mgariepy has joined #openstack-ansible12:02
*** rh-jelabarre has joined #openstack-ansible12:07
*** sakharkar has joined #openstack-ansible12:08
sakharkarOpenstack ansible train support ubuntu 20?12:09
*** shyamb has quit IRC12:13
admin0quick question .. is my br-vxlan is on diffrent subnets, will openstack/neutron work ?12:37
admin0say i have servers in 3 racks, and each rack has its own subnet  .. ( not a layer2 but a layer3) .. would openstack/osa still work fine ?12:38
admin0how does vxlan/vtep discovery work ? say instance1 (in rack1) wants to talk to a newly created instance on server10 on rack10 ..12:38
admin0i do know how this works .. question is if the router forwards multicast, can those vxlan ips be on l3 and not l312:43
admin0not l212:44
watersjadmin0, not expert, your switches will need to support bxvlan. You'll need to configure and allow similar vlans. Nicest thing about bxvlan its allows network segemnt to extend across layer 3 which is just your case.12:44
watersjadmin0, mistyped, vxlan (not bvxlan)12:45
*** spatel has joined #openstack-ansible12:50
jrosseradmin0: if you set up subnets in each rack, make sure they all route, use PIM for multicast and add routes on the computer/network nodes to the whole tunnel cidr then it works fine. I have a deployment like that.12:51
jrosserthere is a “pod” example config in openstack-ansible/etc which will give you some ideas12:53
jrosseryou do not need vxlan support in your switches to make that work because the vtep are all on the hosts12:55
*** spatel has quit IRC12:55
watersjjrosser, they can cross different subnets?12:55
jrosserthe vtep ip can be in deifferent subnets12:56
jrosserso long as those subnets can route between themselves, and the hosts have a static route added to the entire L3 cidr via the local TOR gateway ip12:57
jrosseryou need multicast routing as well to make the Mac learning work12:57
jrosserwatersj: what you say about needing vxlan on the switches is right though if you ever need a L2 service/provider network like might be needed for octavia or trove12:59
jrosserbut I guess you could also do that as extra Linux vtep, lots of options really13:00
*** cshen has joined #openstack-ansible13:04
*** cshen has quit IRC13:10
*** spatel has joined #openstack-ansible14:01
watersjwhen you create you masakari segment hosts, should you use mgmt ip assigned to compute node (br-mgmt)14:06
watersjor hostname?14:07
watersjHost with name 172.29.236.33 could not be found14:08
watersjwhich exists14:08
watersjguess not, Hypervisor with name 172.29.236.33 could not be found14:10
*** this10nly has quit IRC14:12
*** aedc_ has joined #openstack-ansible14:28
*** npalladium has joined #openstack-ansible14:29
*** npalladium has quit IRC14:29
*** npalladium has joined #openstack-ansible14:29
*** aedc has quit IRC14:31
* npalladium Having an issue with Openstack-Ansible. Not quite sure if I can ask here; please let me know if there is a better place.14:46
* npalladium the TASK [lxc_hosts : Ensure that the LXC cache has been prepared] is failing on Ubuntu 18.04. I'm not the first person with this error and someone else seems to have gotten it on 16.04.14:47
* npalladium it fails at the cmd": "chroot /var/lib/machines/ubuntu-bionic-amd64 /opt/cache-prep-commands.sh > /var/log/lxc-cache-prep-commands.log 2>&1"14:48
* npalladium That probably corresponds to "chroot {{ lxc_image_cache_path }} /opt/cache-prep-commands.sh > /var/log/lxc-cache-prep-commands.log 2>&1" in lxc_cache_preparation.yml.14:49
*** aedc_ has quit IRC14:49
* npalladium the log file ends with E: The repository 'https://download.ceph.com/debian-octopus bionic Release' does not have a Release file .14:49
* npalladium Any help on this would be appreciated.14:50
*** pcaruana has quit IRC14:58
*** cshen has joined #openstack-ansible15:06
*** pcaruana has joined #openstack-ansible15:11
*** cshen has quit IRC15:11
admin0jrosser, thanks ..  i understood the pods now :)15:12
*** gyee has joined #openstack-ansible15:26
*** hwoarang has quit IRC15:27
npalladiumHeya. Just realised all the messages were prepended with me. Do I send them again? (Apologies for the spam, but I do require help :D )15:30
*** udesale_ has quit IRC15:37
watersjwow, that was an easier fix. change /etc/masakarimonitors/masakarimonitors.conf host = ip to fqdn15:37
jrossernpalladium: I guess it is failing to “apt update” in the chroot, you can always paste the log file at paste.openstack.org if necessary15:49
jrosserhowever this really is just a case of old fashioned debugging, I think that repo config has been copied from your host15:49
jrosserso first check that the host can apt update15:50
jrossermaybe then enter the choot manually and try the same thing until you find what is broken15:51
npalladiumThe host can indeed apt update. Manually running the command fails too with the same error.15:53
jrosserdid you chroot and poke around in a shell or just run the script?15:55
npalladiumJust ran script. Oops. Legwork it is. Thanks!15:55
jrosserperhaps the apt key is missing, something like that, will need some detective work15:56
npalladiumI guess so too. Either a missing apt key or some utility like gnupg missing; but something like the latter should've been caught by someone else too I guess.15:57
jrosseris this a straightforward AIO build?15:58
npalladiumNot AIO but close enough; all infra on one host and compute on another. I'm using the example openstack_user_config.yml without changing much.16:03
jrosserI would recommend having an AIO handy because it is an excellent reference for issues like this16:10
jrosser8core/8G ram VM and a couple of hours to set up are time well invested16:11
admin0jrosser, +116:11
admin0an AIO is always handy to test a lot of stuff16:11
jrosserexport  SCENARIO=aio_lxc_ceph and you’ll get something identical to what we run CI tests on multiple times a day16:12
*** mgariepy has quit IRC16:13
*** jbadiapa has quit IRC16:21
jrosseradmin0: another thing with pods is you need to think very carefully about where infra and network nodes go16:33
jrosserbecasue they are running vrrp (keepalived) for haproxy and neutron so need a L2 adjacency somehow16:33
*** yolanda has quit IRC16:39
npalladiumjrosser: Noted about the AIO with thanks. Currently a bit constrained (I'm an undergrad deploying it for my uni), but will try to have one setup in the near future.16:47
*** markvoelker has joined #openstack-ansible16:59
*** cshen has joined #openstack-ansible17:07
*** mgariepy has joined #openstack-ansible17:09
*** cshen has quit IRC17:12
*** owalsh has quit IRC17:21
*** andrewbonney has quit IRC17:36
* prometheanfire has an odd thing where ovs wants to create a bridge and attach the networkd created bridge of the same name to it, the bridge is defined in provider_networks as the only place so not sure why ovs is trying to use the same name17:37
prometheanfirehttps://gist.github.com/prometheanfire/6c63397edca59d071a8735385e6cccbb for the ouc.yml stanza17:38
*** owalsh has joined #openstack-ansible17:42
npalladiumQuick update on the chache prep in the chroot issue: Couldn't reproduce the issue upon trying again now; I don't know what parameters have changed though as I haven't changed anything. The play now reached almost the end before erroring out. I'll try to reproduce it later after getting the current setup working. jrosser, thanks a lot!17:47
jrossergood to hear it’s got further :)17:49
*** arkan has joined #openstack-ansible17:50
*** chandankumar is now known as raukadah18:02
*** NobodyCam has quit IRC18:12
*** NobodyCam has joined #openstack-ansible18:12
jamesdentonprometheanfire the question is.. why a networkd-managed bridge?18:15
npalladiumjrosser: Haha thanks again! On a completely different note, any place a newbie to Openstack but with some Python and Ansible experience can contribute? :P18:17
prometheanfirejamesdenton: because I need the host to be on that network, it's my understanding that provider networks should be created outside of OSA's control18:17
prometheanfirejamesdenton: I see that os_neutron creates the ovs networks using that same name18:18
jamesdentonprometheanfire at some point a decision was made to assist in creating the actual OVS provider bridges because it was often a missed step.18:18
jamesdentonand in most deployments you wouldn't also need a bridge with the same name at the host level18:18
jamesdentonwe solved for the 99% not the 1% :D18:18
prometheanfirewooo, I'm the 1%18:19
jamesdentoni'm curious, what does the host need with an IP on br-4009? Using the host as a gateway for that network w/ masquerade?18:19
prometheanfirejamesdenton: I guess the question I have is, should I just name the network diferent in (the container_bridge value)?18:19
prometheanfireya, that's the outside access18:20
jamesdentonthe value of container_bridge is ultimately what will be used to create the OVS bridge, and thus is used in neutron config files18:20
jrossernpalladium: if you like what you see with openstack-ansible we are always looking out for new contributors to help maintain18:20
prometheanfirejrosser: right, I see that, what's confusing is that it's not using network_interface for the neutron config file18:21
jamesdentonit will connect the interface specified as network_interface to the bridge specified by container_bridge18:22
prometheanfirebridge_mappings = vlan-4009:br-4009 (same value as net_name) and then container_bridge and not network_interface18:22
prometheanfirebut it also seems to want to connect the container_bridge value18:22
jamesdentonif networkd is creating the bridge as an 'ovs' bridge, then the task should be OK. if a linuxbridge, then you may have issue18:22
jrossernpalladium: for something with more python there is a set of ansible modules for interacting with the openstack api, to create vm/networks and so on. those modules were recently spun out out of ansible itself18:23
jamesdentonright, provider label:provider bridge. in 'ovs-vsctl show' you'll see network_interface connected to container_bridge18:23
prometheanfirejamesdenton: https://gist.github.com/prometheanfire/6c63397edca59d071a8735385e6cccbb18:23
jamesdentonwhat does 'ip link show br-4009' provide?18:23
prometheanfire13: br-4009: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 100018:24
prometheanfireI didn't specify it to be a ovs bridge18:24
*** johnsom has quit IRC18:24
*** johnsom has joined #openstack-ansible18:25
jamesdentonright. that's why you have an error. So you could just rename either bridge, since i'm guessing the idea is to cross connect w/ a veth?18:25
prometheanfireyep18:25
prometheanfireya, I'll rename the ovs one as either ovs or osa18:25
prometheanfiresee what happens :D18:25
jamesdentonthere ya go18:25
npalladiumjrosser: That sounds interesting and I like the project in general too. That said Openstack itself seems daunting. (Also I'm not quite sure of netiquette on a large IRC channel; I seem to be interrupting other threads. Please let me know if I should change something or shift the discussion elsewhere.)18:26
prometheanfirejamesdenton: it seems like we are overloading the variable18:27
jamesdentonmeh18:27
prometheanfirealso, https://github.com/systemd/systemd/issues/2613 heh18:28
jrossernpalladium: don’t worry, it’s fine. etiquette is “just ask”18:28
jamesdentonreinventing the wheel. always fun.18:28
prometheanfirejamesdenton: you see that systemd added sr-iov support?18:28
jamesdentonyes, you pointed that out. haven't had time to play with it though18:28
prometheanfireah, cool18:28
prometheanfirejamesdenton: thanks for puting a pad between my head and the wall :D18:42
jamesdentoni'm here for you18:43
*** cshen has joined #openstack-ansible19:08
*** cshen has quit IRC19:12
towjrosser: after overcoming the repo_hosts issue, the deployment is pretty smooth (20.1.3) but for the central logging, rsyslog containers are created, but nothing else seems to have been configured, as far as we understand defining log_hosts is all it takes, correct?19:16
jrossertow: rsyslog is pretty much all replaced with systemd journals now19:17
jrosserthere is some config to do journal forwarding over http to one of the log hosts perhaps? systemd-journal-remote iirc19:20
*** owalsh has quit IRC19:20
*** cshen has joined #openstack-ansible19:20
*** owalsh has joined #openstack-ansible19:29
*** mloza has quit IRC19:35
*** mloza has joined #openstack-ansible19:36
towjrosser: oh it looks like it is forced disabled even if log_hosts are defined: journald_remote_enabled19:39
jrosseryou should check the git history for that, I think there is a related systemd bug19:40
towyeah, there is a comment in the playbook, journalctl vacuum issue, long standing bug... okay thanks19:44
*** mloza has quit IRC20:27
*** spatel has quit IRC20:29
*** markvoelker has quit IRC20:42
*** arkan has quit IRC20:49
admin0new openstack/train install .. there is no openstack in the utility container20:57
*** rpittau has quit IRC21:12
*** rpittau has joined #openstack-ansible21:13
*** jonmasters has quit IRC21:36
*** jonmasters has joined #openstack-ansible21:36
*** gyee has quit IRC21:40
*** gyee has joined #openstack-ansible21:45
*** also_stingrayza has joined #openstack-ansible21:49
*** melwitt is now known as jgwentworth21:49
*** stingrayza has quit IRC21:52
*** rh-jelabarre has quit IRC22:06
*** markvoelker has joined #openstack-ansible22:22
*** markvoelker has quit IRC22:27
*** markvoelker has joined #openstack-ansible22:47
*** markvoelker has quit IRC22:52
*** tosky_ has joined #openstack-ansible22:52
*** tosky has quit IRC22:53
*** gyee has quit IRC23:01
*** tosky_ is now known as tosky23:01
*** tosky has quit IRC23:38

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!