Monday, 2021-10-25

em_I'am not sure this is a neutron questions, or yet a kolla. I have 3 ethernet devices, 1 for management [eth1], 1 for provider network 'self service'[eth2] and one for provider network (wan/floating ips) [eth3] - thus during the deployment i use https://github.com/EugenMayer/openstack-lab/blob/master/config/group_vars/compute/compute.yml#L4 to assign eth2 to br-lan and eth3 to br-wan, which then creates physnet1 and physnet2. When i 05:45
em_then create a network in openstack (flat) mappigng on physnet1, the network of the VM never comes up. Is there anything inproper configured?05:45
em_currently trying to use ovs-vsctl show to understand if the acual bridges have been created correctly (on controller/compute), but i'am not an OVS guy yet, rather used to linux bridge. hard to understand what i'am looking a there05:55
jingvarI 'm not having an env with ovs06:00
em_looking at that output, it seems like it is configured correctly https://gist.github.com/EugenMayer/2a8329361fb2638203fc36561b66545906:00
em_jingvar, are you using OVN already?06:00
jingvaryep06:01
*** amoralej|off is now known as amoralej06:06
eugenmayerdoes it actually make any sense to use OVS with a new stack at all? OVN is the successor of OVS AFAIU, right?06:07
jingvarit depends on usecase -  for example ovs+dvr=+1additional float IP per compute node06:18
jingvarif cloud is private - in makes no sense06:19
jingvarOVN does'nt have VPNaaS (only dev in Xena)06:19
eugenmayeri do not need vpnaas06:20
jingvarRabbitMQ sometimes painfull,  OVN don't use Rabbit06:21
eugenmayeradditional float IP .. i get that, would be an issue for me too. I would rather avoid that. So you use a network node for all floating ips (1) and then route all the traffic to the actual instances, right06:21
jingvarOVN uses direct links(datapaths)  between  instances and network node for external06:23
jingvaras OVN+DVR without additional FIP per compute node06:23
eugenmayerbut OVN still uses OVS under the hood, right?06:25
jingvaryes but defferean approach06:26
jingvarlike Docker - Kubernetes06:27
eugenmayerwhat guide/docs did you follow during the setup? there are the main docs https://docs.openstack.org/neutron/latest/admin/ovn/index.html , then a setup guide https://docs.ovn.org/en/stable/tutorials/ovn-openstack.html and somewhat short section in kolla https://docs.ovn.org/en/stable/tutorials/ovn-openstack.html on how to enable ovn06:30
eugenmayeranything in particular you would guide to use here?06:30
eugenmayerinteresting, when setting up (for xena) with kolla, when using debian as a target for the docker images, i get https://gist.github.com/EugenMayer/d9b717e66b8424bf8953ea9ca7d744bc06:32
eugenmayertrying to switch to ubuntu then06:32
jingvarI use Centos/Rocky06:32
jingvarRedHat has an tutorial of OVN06:33
eugenmayeri see. Are you avoiding enable_neutron_provider_networks: yes with OVN setups? The point is (as in my lab) i already have setup a vswitch provider based network in my DC to create a shared 'self service' network between my computes. Does this contradicts how ovn wants to operate?06:34
eugenmayeri will have 3 vswitches in the DC: management network (that seems just fine), self-service (vm lan) and WAN (floating ips). all 3 are based on the main nic of the bare bone, vlan based06:35
jingvarYou can't use flat network on common interface06:43
eugenmayerjingvar, not sure what you mean. You mean instead of pre-creating my interface for compute/controll 06:44
jingvarkayobe-config/etc/kayobe/kolla.yml:kolla_enable_neutron_provider_networks: yes06:45
eugenmayeri rather do this inside ovn?06:45
jingvarTime to draw a schema06:46
eugenmayershould i draw one - i surely can. I try right now to simulate the DC setup i have (even though dc is with vswitches / vlans) in the home lab using vbox interfaces06:47
jingvarI think we have an miscommunication,I think we have an miscommunication, probably my English is not good enough :)06:55
mnasiadkamorning06:57
eugenmayerno worries06:57
jingvarmorning06:59
mnasiadkajingvar: you're using Rocky with Kayobe?07:06
jingvaryep07:10
mnasiadkawith centos stream Kolla containers?07:12
eugenmayermnasiadka, morning07:13
jingvaraaa, I use victoria/stable - Rocky  just host OS07:22
*** MikeCTZA_ is now known as MikeCTZA07:23
jingvarRocky on Kayobe control host and seed ( in my case seed and kayobe the same host)07:24
jingvarfew dirty hack around ansible and it works07:24
eugenmayerjingvar, could you explain why flat will not work with OVN?07:53
eugenmayeri deployed the stack with OVN now with the same result. All instances i start on the flat provider network i created, cannot access the network (stuck on network up)07:53
jingvarwhat the interfaces you  have on computes08:03
*** mazzy5096 is now known as mazzy50908:10
opendevreviewMark Goddard proposed openstack/kolla-ansible master: Revert "Do not load br_netfilter"  https://review.opendev.org/c/openstack/kolla-ansible/+/81494908:16
opendevreviewMark Goddard proposed openstack/kayobe stable/wallaby: Remove stale config dump from seed hypervisor host configure  https://review.opendev.org/c/openstack/kayobe/+/81523008:17
opendevreviewMark Goddard proposed openstack/kayobe stable/victoria: Remove stale config dump from seed hypervisor host configure  https://review.opendev.org/c/openstack/kayobe/+/81523108:18
mnasiadkamgoddard: you made my day with "reason for revert" ;-)08:18
opendevreviewMark Goddard proposed openstack/kayobe stable/ussuri: Remove stale config dump from seed hypervisor host configure  https://review.opendev.org/c/openstack/kayobe/+/81523208:18
*** mazzy5098 is now known as mazzy50908:23
eugenmayerjingvar, eth2 for 'self service' and eth3 for 'wan', see https://github.com/EugenMayer/openstack-lab/blob/master/config/group_vars/compute/compute.yml#L408:25
eugenmayeri can see those br-wan / br-lan bridges online on the computes / controller08:25
eugenmayeron compute1: https://gist.github.com/EugenMayer/81747df977e15f2d7dd284af75fb474708:26
jingvarkayobe-config/etc/kolla/inventory/overcloud/host_vars/cmp01:neutron_bridge_name: "bond0-ovs" 08:27
jingvarneutron_external_interface: "bond0"08:28
mgoddardmnasiadka: I aim to please08:31
opendevreviewMerged openstack/kayobe stable/wallaby: Add the missing documentation for mariadb recovery  https://review.opendev.org/c/openstack/kayobe/+/81507408:37
opendevreviewMerged openstack/kayobe stable/victoria: Add the missing documentation for mariadb recovery  https://review.opendev.org/c/openstack/kayobe/+/81507508:37
eugenmayerjingvar, what does that mean?08:37
eugenmayeri mean yes, that is similar, but how did you create the network in openstack?08:38
kevko\o/ morning08:39
opendevreviewMerged openstack/kayobe stable/ussuri: Add the missing documentation for mariadb recovery  https://review.opendev.org/c/openstack/kayobe/+/81507608:39
eugenmayergood morning kevko 08:41
eugenmayerjingvar, https://ibb.co/bFFhJBR that is the point, so after having configured physnet1/physnet2 how to create an openstack networking utilizing those08:41
eugenmayerAFAIU the type i'am looking for is flat, i properly configured the subnet, but when spawning an instance, it has no connectivity at all08:42
jingvarohh - web UI08:46
jingvarHave you created a Router?08:47
jingvaropenstack network create --external --provider-physical-network physnet1 --provider-network-type flat  public108:47
eugenmayerno - no router. It is a flat network and i wanted to test network inter communication08:48
eugenmayeryour cli variant is basically the same, isnt it?08:48
jingvarit was about external08:49
jingvaropenstack network create demo-net08:49
jingvaropenstack subnet create --subnet-range 10.0.0.0/24 --network demo-net --gateway 10.0.0.1 --dns-nameserver 8.8.8.8 demo-subnet08:49
jingvarfor local-self network08:49
kevkoeugenmayer: it's simple - if you want to have IP on external network, you have to create network as jingvar adviced, then run instance and wuala - it's working 08:51
kevkoeugenmayer: if it is not working , you should check ovs-vsctl show - and check if port providing external l2 connection is added to openvswitch bridge providing physnet for openstacj08:52
jingvarand default network type - I think08:52
kevkodefault network type ? 08:53
eugenmayerkevko, i did use ovs-vsctl: https://gist.github.com/EugenMayer/81747df977e15f2d7dd284af75fb474708:58
eugenmayerjingvar, i cannot see any difference to my setup in yours right now08:59
kevkoeugenmayer: hmm, i'm not using ovn ..but ovs ..my setup 09:02
eugenmayerdid not work with ovs either, same setup kevko 09:03
kevkoeugenmayer: https://paste.opendev.org/show/810190/09:03
eugenmayerkevko, looked the same for me with ovs https://gist.github.com/EugenMayer/2a8329361fb2638203fc36561b66545909:12
eugenmayerso i think both should work - and do not09:12
kevkokolla in default is operating with br-int, br-tun etc.. how you changed the names ? 09:13
opendevreviewWill Szumski proposed openstack/kayobe master: Do not fail when admin openrc file does not exist  https://review.opendev.org/c/openstack/kayobe/+/81525909:15
eugenmayerhttps://github.com/EugenMayer/openstack-lab/blob/master/config/group_vars/control/control.yml#L409:24
eugenmayerkevko, ^^09:24
opendevreviewVerification of a change to openstack/kolla stable/xena failed: openstack-base: drop anyjson  https://review.opendev.org/c/openstack/kolla/+/81493609:49
opendevreviewOpenStack Release Bot proposed openstack/kayobe stable/xena: Update .gitreview for stable/xena  https://review.opendev.org/c/openstack/kayobe/+/81526710:02
opendevreviewOpenStack Release Bot proposed openstack/kayobe master: Update master for stable/xena  https://review.opendev.org/c/openstack/kayobe/+/81526810:02
opendevreviewOpenStack Release Bot proposed openstack/kayobe master: Add Python3 yoga unit tests  https://review.opendev.org/c/openstack/kayobe/+/81526910:02
opendevreviewOpenStack Release Bot proposed openstack/kayobe-config stable/xena: Update .gitreview for stable/xena  https://review.opendev.org/c/openstack/kayobe-config/+/81527010:02
opendevreviewOpenStack Release Bot proposed openstack/kayobe-config stable/xena: Update TOX_CONSTRAINTS_FILE for stable/xena  https://review.opendev.org/c/openstack/kayobe-config/+/81527110:02
opendevreviewOpenStack Release Bot proposed openstack/kayobe-config-dev stable/xena: Update .gitreview for stable/xena  https://review.opendev.org/c/openstack/kayobe-config-dev/+/81527210:02
opendevreviewOpenStack Release Bot proposed openstack/kayobe-config-dev stable/xena: Update TOX_CONSTRAINTS_FILE for stable/xena  https://review.opendev.org/c/openstack/kayobe-config-dev/+/81527310:02
eugenmayerjingvar, using your cli commands the type is not flat but geneve, that is the main difference here. User your setup but the box still cannot brin up the network10:03
eugenmayerok it works vm to vm now10:03
eugenmayerso now i need to ensure the connectivity for the internet (yet not floating ip). I guess that is what the router are for10:12
kevkoeugenmayer: how many physnets do you have ? 10:17
eugenmayerright now, i have two. One for the self-service(1), one for wan (2). I could get self-service work, so spawning 2 VMs in the same project, the VMs can talk10:20
eugenmayerthough, other non-openstack boxes, e.g. from the compute box itself, cannot talk to the VMs (so it is not really flat, its geneve, thus an isolated lan10:21
kevkohmm, it looks like you have two external networks 10:39
kevkoeugenmayer: if you want to use self-service networks, you don't need to add second bridge and interface to it 10:40
eugenmayerconsulting the actual OVN provider network docs, it seems to be the case, isn't it? : https://docs.openstack.org/networking-ovn/latest/admin/refarch/provider-networks.html10:44
opendevreviewMerged openstack/kolla stable/xena: centos: switch to RDO final release of Xena  https://review.opendev.org/c/openstack/kolla/+/81485711:06
opendevreviewMerged openstack/kolla stable/xena: update information about unbuildable images  https://review.opendev.org/c/openstack/kolla/+/81494411:06
eugenmayernet network group in kolla, when using OVN - what will it stand for, for the gateway nodes or where the neutron-server is deployed to?11:51
jingvarin my case controllers and network nodes it the same group12:09
*** amoralej is now known as amoralej|lunch12:12
eugenmayerjingvar, network nodes - with OVN, are those the gateway-nodes?12:49
*** amoralej|lunch is now known as amoralej12:54
opendevreviewEgon Rijpkema proposed openstack/kolla-ansible master: keep X-Forwarded-Proto of exterbal ssl termination.  https://review.opendev.org/c/openstack/kolla-ansible/+/75836113:05
opendevreviewMark Goddard proposed openstack/kolla-ansible master: nova: don't fail all hosts on service registration failures  https://review.opendev.org/c/openstack/kolla-ansible/+/80559913:15
jingvareugenmayer: I have 3 controller and fwe computes nodes13:50
opendevreviewMerged openstack/kolla stable/xena: openstack-base: drop anyjson  https://review.opendev.org/c/openstack/kolla/+/81493614:00
*** amoralej is now known as amoralej|off15:09
eugenmayerjingvar, i dropped the idea of using a provider network for self-service when using OVN. i use one for the cluster/managemeent network and then create a vlan based self-service network with OVN - it jsut makes more sense and simplifies what OVN should have simplified in the first place15:27
jingvareugenmayer: I think being near to real network topology is good idea15:29
eugenmayerjingvar, IMHO using OVN does exactly the opposite, don't you htink?15:31
eugenmayerit abstracts from the physical topology (for the cost of performance)15:31
jingvarI'm not sure than understood16:00
jingvarovn and ovs as ml2 plugin have similar functionality 16:01
jingvarthere is defferenet approcach how traffic should be switched 16:03
jingvarfrom my perspective OVN looks like OpenContrail16:04
eugenmayerjingvar, OVN tries to tunnel nearly all networks (i guess as OVS does), so it nests any network inside any other network - by design. This means (for me, IMHO) that the physical network / topology is just a the base network to offer the transport layer for any other nested network (l3 and even l2, if i understood it right).16:21
eugenmayerjingvar, OVN (and ovs) are build to not expose or limit by physical topology to offer way more flexebility and encapsulation. If find it similar to LVM somehow - abstracting away and encapsulating boundaries of physical drives16:22
eugenmayerBut honestly, i'am new to all this. At least what i can see, the OVN deployment ref does use VXLAN or geneve for the self-service network, while OVS/Linux bridge use provider networks for the same int the ref. 16:23
eugenmayerSo there is, at least for the openstack guys, a difference in the 'strategy' 16:24
eugenmayerbig fat huge IMHO :)16:24
opendevreviewMark Goddard proposed openstack/kolla-ansible master: nova: don't fail all hosts on service registration failures  https://review.opendev.org/c/openstack/kolla-ansible/+/80559916:25
opendevreviewMark Goddard proposed openstack/kolla-ansible master: nova: use any_errors_fatal for once-per-cell tasks  https://review.opendev.org/c/openstack/kolla-ansible/+/81533516:25
opendevreviewMark Goddard proposed openstack/kayobe master: infra VMs: use wait_for rather than wait_for_connection  https://review.opendev.org/c/openstack/kayobe/+/81321216:33
opendevreviewMark Goddard proposed openstack/kayobe-config-dev master: Define infra VMs for testing  https://review.opendev.org/c/openstack/kayobe-config-dev/+/80523916:42
opendevreviewMark Goddard proposed openstack/kayobe master: CI: add Infra VM jobs  https://review.opendev.org/c/openstack/kayobe/+/81304819:12

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!