Wednesday, 2016-02-10

*** yamamoto_ has quit IRC00:03
*** armax has quit IRC00:17
*** aginwala has quit IRC00:53
*** aginwala has joined #openstack-neutron-ovn00:57
*** armax has joined #openstack-neutron-ovn01:02
*** aginwala has quit IRC02:09
*** yamamoto has joined #openstack-neutron-ovn02:12
*** armax has quit IRC02:18
*** aginwala has joined #openstack-neutron-ovn02:20
*** yamamoto has quit IRC02:31
*** aginwala has quit IRC02:31
openstackgerritMerged openstack/networking-ovn: testing: Remove comment about looking at patch ports.  https://review.openstack.org/27798502:40
*** gangil1 has quit IRC03:02
*** yamamoto has joined #openstack-neutron-ovn03:29
*** gangil has joined #openstack-neutron-ovn03:41
*** gangil has joined #openstack-neutron-ovn03:41
*** jckasper has quit IRC04:01
*** jckasper has joined #openstack-neutron-ovn04:01
*** jckasper_ has joined #openstack-neutron-ovn04:03
*** jckasper has quit IRC04:03
*** jckasper_ has quit IRC04:06
*** jckasper has joined #openstack-neutron-ovn04:06
*** jckasper_ has joined #openstack-neutron-ovn04:07
*** jckasper has quit IRC04:11
*** jckasper_ has quit IRC04:12
*** jckasper has joined #openstack-neutron-ovn04:13
*** brad_behle has quit IRC04:17
*** jckasper has quit IRC04:32
*** salv-orlando has joined #openstack-neutron-ovn04:41
*** salv-orl_ has quit IRC04:43
*** aginwala has joined #openstack-neutron-ovn04:45
*** aginwala has quit IRC04:55
*** armax has joined #openstack-neutron-ovn05:31
*** allan_h has joined #openstack-neutron-ovn05:47
*** aginwala has joined #openstack-neutron-ovn06:23
*** armax has quit IRC06:48
*** aginwala_ has joined #openstack-neutron-ovn06:58
*** aginwal__ has joined #openstack-neutron-ovn06:59
*** aginwala has quit IRC07:02
*** aginwala_ has quit IRC07:03
*** otherwiseguy has quit IRC07:34
*** openstackgerrit has quit IRC07:47
*** openstackgerrit has joined #openstack-neutron-ovn07:47
*** aginwala has joined #openstack-neutron-ovn08:01
*** aginwal__ has quit IRC08:04
*** palexster has joined #openstack-neutron-ovn08:14
*** palexster has quit IRC08:14
*** salv-orlando has quit IRC08:44
openstackgerritNuman Siddique proposed openstack/networking-ovn: Refactor ovn_nb_sync.OvnNbSynchronizer  https://review.openstack.org/27779209:02
*** numans has joined #openstack-neutron-ovn09:02
*** aginwala has quit IRC09:05
*** aginwala has joined #openstack-neutron-ovn09:07
*** aginwala has quit IRC09:17
openstackgerritBabu Shanmugam proposed openstack/networking-ovn: DPDK support for OVN  https://review.openstack.org/27510309:48
*** salv-orlando has joined #openstack-neutron-ovn10:41
*** yamamoto has quit IRC12:20
*** rtheis has joined #openstack-neutron-ovn12:24
*** roeyc has joined #openstack-neutron-ovn12:33
*** jckasper has joined #openstack-neutron-ovn12:40
*** jckasper has quit IRC12:44
*** roeyc has quit IRC12:49
*** roeyc has joined #openstack-neutron-ovn12:50
*** roeyc has joined #openstack-neutron-ovn12:50
*** palexster has joined #openstack-neutron-ovn13:23
*** yamamoto has joined #openstack-neutron-ovn13:29
*** brad_behle has joined #openstack-neutron-ovn13:29
*** jckasper has joined #openstack-neutron-ovn13:42
*** palexster has quit IRC15:08
openstackgerritKyle Mestery proposed openstack/networking-ovn: devstack: Add devstackgatekuryrrc file for OVN + kuryr job  https://review.openstack.org/27843415:22
*** palexster has joined #openstack-neutron-ovn15:24
russellbmestery: 2 reviews already, heh15:24
mesteryrussellb: heh :)15:24
openstackgerritKyle Mestery proposed openstack/networking-ovn: devstack: Add devstackgatekuryrrc file for OVN + kuryr job  https://review.openstack.org/27843415:27
*** regXboi has joined #openstack-neutron-ovn15:30
gsagiemestery: https://review.openstack.org/#/c/278434/2, you forgot also q-l3 and q-dhcp15:35
gsagieand q-svc15:35
mesterygsagie: The default is OVN L3 mode now, so I didn't :)15:35
mesteryBut q-svc, yes, that one is valid15:35
gsagie:)15:35
*** yamamoto has quit IRC15:35
russellband q-dhcp presumably15:36
openstackgerritKyle Mestery proposed openstack/networking-ovn: devstack: Add devstackgatekuryrrc file for OVN + kuryr job  https://review.openstack.org/27843415:36
mesteryyup15:36
mestery^^^15:36
russellband you need to set OVN_L3_MODE15:36
mesteryCrap15:36
mestery:(15:36
russellbit's not the default ... by default15:36
mesterylol15:37
russellbit's the default in our devstack sample config only15:37
openstackgerritKyle Mestery proposed openstack/networking-ovn: devstack: Add devstackgatekuryrrc file for OVN + kuryr job  https://review.openstack.org/27843415:37
mesteryYes15:37
mesteryOne more time15:37
russellb-1 sorry15:38
russellbi might be wrong though15:38
openstackgerritNuman Siddique proposed openstack/networking-ovn: Neutron ovn northbound db sync tool  https://review.openstack.org/27780515:39
gsagieif OVN L3 is the default, why its not the actual default? :)15:40
russellbblame mestery ?15:40
mesteryWe should fix that15:40
openstackgerritKyle Mestery proposed openstack/networking-ovn: devstack: Add devstackgatekuryrrc file for OVN + kuryr job  https://review.openstack.org/27843415:42
openstackgerritGal Sagie proposed openstack/networking-ovn: Change OVN_L3_MODE default to True  https://review.openstack.org/27846515:46
*** numans has quit IRC15:51
*** palexster has quit IRC15:52
gsagierussellb : why https://review.openstack.org/#/c/278465/ will break the tempest? you just mentioned its is the default?15:54
*** yamamoto has joined #openstack-neutron-ovn15:54
gsagieor its not enabled in the gate right now? (tempest)15:54
russellbnot enabled in the gate right now15:54
russellbl3 agent needed for the gate15:55
russellbmuch of tempest assumes floating IP support is available15:55
*** gangil has quit IRC15:57
*** palexster has joined #openstack-neutron-ovn15:57
openstackgerritGal Sagie proposed openstack/networking-ovn: Change OVN_L3_MODE default to True  https://review.openstack.org/27846516:00
gsagieif it wont work i will change project-config16:01
*** salv-orlando has quit IRC16:01
gsagieohh saw what Kyle did16:02
mestery:)16:02
openstackgerritGal Sagie proposed openstack/networking-ovn: Change OVN_L3_MODE default to True  https://review.openstack.org/27846516:03
Sam-I-Amuhhh16:04
Sam-I-Am^ pretty sure this will break all the things16:04
Sam-I-Amunless i missed something, l3 doesnt work yet?16:05
mesterySam-I-Am: FIPs don't work, and tempest relies on FIPs, so in a way, yes it will break16:07
Sam-I-Amlast i checked, routing from a provider to private net didnt ork16:07
mesterySam-I-Am: I thought I tired that? Maybe not, will try again. You're likely right :)16:09
Sam-I-Ammestery: the vagrant multi-node sets the bits up to make it work16:09
Sam-I-Amthere's a route on the host back to the private net via the provider net16:09
*** azbiswas has joined #openstack-neutron-ovn16:10
Sam-I-Amonly way i could get into a private net was the workaround/hack in the docs16:10
Sam-I-Ammestery: what we probably need is a separate non-voting job that checks native l316:11
mesterySam-I-Am: We do16:13
russellbmake it happen, captain16:14
Sam-I-Amthen we wouldnt mess with the working job16:14
Sam-I-Amquestion is do we try to disable/workaround things that arent implemented yet, or let the job fail until it works like the other neutron tempest jobs16:15
mesterySam-I-Am: Lets get the job up first, non-voting, then we can see what fails and make the call16:16
mesteryWe may want to fix some of what's broken and defer other things in the short term perhaps16:17
mesterySam-I-Am: https://review.openstack.org/#/c/278434/16:18
mesteryThat will help us get the "ovn+kuryr" job rolling16:18
Sam-I-Ammestery: +2ified16:21
mesterySam-I-Am: Rock on my friend :)16:21
Sam-I-Amtime to re-vagrant16:22
Sam-I-Amafter the git/devstack problems16:22
russellbSam-I-Am: disable tests that will fail16:22
russellblet's just run the tests we expect to work, but use a sane config16:23
Sam-I-Amrussellb: i wish the existing gate jobs supported instances on provider nets16:25
Sam-I-Amright right now the neutron config is br0ked16:25
Sam-I-Amit shouldnt even work as-is16:26
*** otherwiseguy has joined #openstack-neutron-ovn16:26
Sam-I-Amrussellb: aight, i'll try to figure it out16:29
Sam-I-Amsupposedly tempest has provider net support, so maybe we'll start by booting VMs there16:29
*** roeyc has quit IRC16:30
Sam-I-Amrussellb: can you love https://review.openstack.org/#/c/276866/ ?16:32
Sam-I-Ammestery: also https://review.openstack.org/#/c/276411/ ?16:33
mesterySam-I-Am: Done!16:34
Sam-I-Amthx.16:34
Sam-I-Amone more step toward un-breaking mtu16:34
mesterylol16:34
Sam-I-Amwhich brings me back to mtu in ovn...16:35
Sam-I-Amall of those things are in ml2, so we sort of need to duplicate stuff... which might get better if/when we use neutron-lib16:35
mesterySam-I-Am: We definitely need to make that happen16:36
mesteryThe neutron-lib part, I mean16:36
Sam-I-Ammestery: why doesnt ovn use ml2?16:38
mesterySam-I-Am: Because building another control plane (ML2) on top of OVN (also a control plane) blows my mind :)16:40
Sam-I-Amok, right... makes sense. we're not really dealing with ovs directly.16:41
mesteryYes16:41
Sam-I-Ami'm trying to get the mtu changes up into neutron itself, or maybe the base plugin16:42
Sam-I-Amso other plugins dont have to reinvent the wheel.16:42
Sam-I-Ammtu is pretty universal16:42
Sam-I-Amright now advertise_mtu is in neutron, but path_mtu is ML216:42
Sam-I-Amas are the calculations for the ml2 driver overhead16:43
Mic22Hi guys, just to be sure routing between provider network and private networks still don't work16:43
Mic22?16:43
mesteryMic22: That's what Sam-I-Am indicated, he's working on an upstream job to test this out in patches I believe :)16:44
Mic22ok good I was getting crazy in configs thanks16:44
mestery:)16:44
mesteryMic22: I'd *like* it to work, and also I'd like to understand how we can tie it into the address scopes stuff which merged in Mitaka ...16:45
mesterySo. Much. To. Do.16:45
Sam-I-AmMic22: the vagrant configs would support routing from provider to private networks (no nat) if the native l3 worked.16:45
Sam-I-Amwhen nat happens, we just disable the host route to the private network16:45
Mic22my problem is easier, from a vm i cannot ping the interface on provider network attached to br-provider16:46
Mic22I'm still not trying to nat16:46
Mic22but it seems even this is not properly working16:47
mesteryMic22: Now that has worked before, it's not a SG issue is it?16:47
Sam-I-AmMic22: where is the vm?16:47
Mic22in the same box16:47
Mic22SG?16:47
Sam-I-Amwell, what type of neutron network - provider or private16:48
Mic22(inside vm) PRIVATE_NET(ip 10.0.0.10) -> ROUTER(10.0.0.1,172.16.0.1) -> PROVIDER(172.16.0.2) (inside br_provider)16:49
Mic22this is the path I'm trying to get working16:49
mesterySG is security group, but I think based on what you just showed, that's the scenario that doesn't work according to Sam-I-Am16:50
*** salv-orlando has joined #openstack-neutron-ovn16:50
Mic22SG allow all16:50
Mic22so it appears that I'm not the only one having this problem :)16:51
*** gangil has joined #openstack-neutron-ovn16:52
*** gangil has joined #openstack-neutron-ovn16:52
Sam-I-AmMic22: routing does not work16:53
Sam-I-Amyou either have to put the vm on the provider net, or if you put it on the public net, use the hack in the docs to access the private net directly16:54
Sam-I-Amthe vm still wont see 'out' though16:54
Mic22Yes I know, I practically cooperate in defining the trick :) I just wanted to try routing. It's not a big deal for now16:55
Mic22have to go, thynks and have a nice day16:55
Sam-I-Amsure16:55
russellbrouting between "private" networks should be working17:00
Sam-I-Amyeah, that worked last i checked17:01
openstackgerritlitong01 proposed openstack/networking-ovn: Vagrant: make provider network creation configurable  https://review.openstack.org/27647517:04
*** armax has joined #openstack-neutron-ovn17:09
*** aginwala has joined #openstack-neutron-ovn17:20
*** thumpba has joined #openstack-neutron-ovn17:21
*** Mic22 has quit IRC17:26
*** Mic22 has joined #openstack-neutron-ovn17:27
*** aginwala has quit IRC17:27
*** aginwala has joined #openstack-neutron-ovn17:57
*** armax has quit IRC18:01
openstackgerritNuman Siddique proposed openstack/networking-ovn: (WIP) Support port security API extension  https://review.openstack.org/26921918:06
*** aginwala has quit IRC18:06
*** numans has joined #openstack-neutron-ovn18:06
openstackgerritNuman Siddique proposed openstack/networking-ovn: (WIP) Support Allowed address pairs  https://review.openstack.org/26953518:13
*** aginwala has joined #openstack-neutron-ovn18:14
*** yamamoto has quit IRC18:19
*** gangil has quit IRC18:22
*** azbiswas has quit IRC18:37
*** azbiswas has joined #openstack-neutron-ovn18:37
*** aginwala has quit IRC18:39
*** aginwala has joined #openstack-neutron-ovn18:42
*** azbiswas has quit IRC18:42
*** palexster has quit IRC18:43
*** armax has joined #openstack-neutron-ovn18:44
*** yamamoto has joined #openstack-neutron-ovn18:50
*** aginwala has quit IRC18:56
*** gangil has joined #openstack-neutron-ovn18:59
*** gangil has joined #openstack-neutron-ovn18:59
*** aginwala has joined #openstack-neutron-ovn19:00
*** aginwala has quit IRC19:00
*** thumpba has quit IRC19:04
*** aginwala has joined #openstack-neutron-ovn19:05
*** thumpba has joined #openstack-neutron-ovn19:10
regXboirussellb: ping19:12
regXboirussellb: does the networking-ovn plugin handle multiple neutron servers well?19:12
russellb               |   .·´¯`°Q(•_• )19:12
russellbregXboi: i'm not aware of any issues with it19:13
Sam-I-Ammultiple api services?19:13
Sam-I-Amor sql databases?19:13
russellbthere is one bug fix in the python ovs code though that you need19:13
russellbso check what version you have installed from pip19:13
regXboirussellb: does that fix solve getting referential integrity errors?19:13
regXboifrom OVS?19:13
russellbno19:14
russellbi'd have to see the error19:14
regXboilet me see if I can get a bug filed19:14
* russellb has a guess about what it is though19:14
regXboiI'd entertain the guess19:14
russellbi'd rather see your report first heh19:14
regXboiwell.. I *personally* am not seeing the error, so I'll be reporting second hand19:15
*** aginwala has quit IRC19:16
*** aginwala has joined #openstack-neutron-ovn19:17
Sam-I-Amrussellb: arent those the errors were seeing in q-svc logs?19:17
russellbmayyyyyyyybe19:17
Sam-I-Amrussellb: love? https://review.openstack.org/#/c/276866/19:18
openstackgerritMerged openstack/networking-ovn: Vagrant: make provider network creation configurable  https://review.openstack.org/27647519:20
*** azbiswas has joined #openstack-neutron-ovn19:22
russellbwhat am i loving now?19:23
russellbSam-I-Am: does vagrant use the devstack sample configs?19:28
mesteryrussellb: yes19:28
mesteryAnd it modifies them a bit too19:29
russellbk19:29
russellbSam-I-Am: looks like arosen already approved that one19:29
russellbbut i read it :)19:29
Sam-I-Amrussellb: i'm trying to move things in a more generic fashion to the devstack config file samples, and stuff specific to vagrant to the vagrant mods for those files19:31
Sam-I-Amlike the dhcp stuff was in vagrant... now some of the bits moved to devstack and are enabled by vagrant19:32
openstackgerritMerged openstack/networking-ovn: Refactor ovn_nb_sync.OvnNbSynchronizer  https://review.openstack.org/27779219:58
openstackgerritMerged openstack/networking-ovn: Vagrant: Generify post-config options for DevStack  https://review.openstack.org/27686619:59
*** aginwala has quit IRC20:01
*** aginwala has joined #openstack-neutron-ovn20:03
*** aginwala has quit IRC20:03
*** aginwala has joined #openstack-neutron-ovn20:04
mesteryLooks like we have a new gate issue which I'm not even sure is OVN's fault20:44
mesterySee https://review.openstack.org/#/c/278434/20:44
mesteryIt's failed twice, and all it's doign is adding a new devstackgatekuryrrc file :)20:44
mesterySame DHCP test failure,20:44
mesteryIPv6 related20:44
russellbi've been seeing IPv6 failures in the last week20:45
russellbin the neutron meeting, sounded like neutron is having the same sort of failures20:45
russellbi haven't dug into it at all though20:45
mesteryThat's what I thought, thanks for confirming russellb20:45
*** aginwala has quit IRC20:58
*** aginwala has joined #openstack-neutron-ovn21:08
Sam-I-Amwell this is discouraging, i created a second private net and cant boot a vm on it21:18
Sam-I-Amanyone else here running a devstack multinode?21:22
mesterySam-I-Am: I am :)21:22
Sam-I-Ammestery: stock system has 1 provider net and 1 private net. each has 1 vm. create another private net, try to boot vm on it... get 'no valid host was found'21:24
Sam-I-Amthis is a vagrant deployment21:24
mesterySam-I-Am: Let me try that, I have that default config with one net created thanks to armax and GMAN21:24
* mestery tries it21:24
Sam-I-Amthat error tells me neither of the compute nodes have access to that network21:25
mesteryWhat does "ovs-sbctl show" indicate?21:25
mesterySam-I-Am: Same error for me!21:25
Sam-I-Amhey, i'm not crazy!21:26
Sam-I-Amwell, i am.21:26
*** aginwala has quit IRC21:27
* russellb reads and tries to parse21:37
russellb"no valid host" is from nova21:38
russellband nova has no idea about network access21:38
russellbthere are *lots* of things that can cause that error21:38
russellbWE CAN DEBUG IT21:39
Sam-I-Amlol21:39
russellb(sound effects here)21:39
*** salv-orl_ has joined #openstack-neutron-ovn21:39
russellbyou may have an error in the nova-scheduler or nova-compute logs21:39
Sam-I-Amwell, 9/10 that happens because none of the nodes can attach vms to that network21:39
russellb9/10 that happens because you're out of RAM on your compute nodes :-p21:40
Sam-I-Ami see it with ml2 when people have config errors, or try to boot vms on networks owned by someone else21:40
* russellb nods21:40
Sam-I-Amrussellb: hmm... using cirros instances.21:40
Sam-I-Ami hope i'm not out of ram, but let me look21:40
russellbwhat flavor21:40
russellbnova flavor21:40
Sam-I-Amm1.tiny21:41
russellbk, so you should have enough RAM for another 1 of those then i take it?21:41
russellbjust a simple first check ...21:41
Sam-I-Ammy compute nodes have a gig of ram and 8 gigs of swap21:42
Sam-I-Amwill libvirt not write into swap?21:42
russellbdefault behavior does not take swap into account IIRC21:43
russellbso they're looking at your 1 GB of RAM to see what can fit21:43
Sam-I-Amok, let me ditch an instance and boot one on this other network21:43
*** aginwala has joined #openstack-neutron-ovn21:44
Sam-I-Amrussellb: i sure hope this isn't it... because then i'm just going to jump off a building21:45
russellbi'd rather you didn't21:45
*** aginwala has quit IRC21:45
russellbwhen devstack has tempest enabled, it creates some super tiny flavors, like 64 MB of RAM21:46
russellbthat's what I typically use :)21:46
*** aginwala has joined #openstack-neutron-ovn21:46
russellbdon't need much for a cirros image to respond to ping and let you ssh into it21:46
Sam-I-Amme too21:46
* russellb can't remember what m1.tiny was21:46
*** HenryG_ has joined #openstack-neutron-ovn21:47
russellbah right, tiny is 512 MB21:47
* russellb bets that was it then21:48
Sam-I-Amrussellb: yeah. you know what... i think moving dhcp and metadata agents to the compute nodes did this21:48
Sam-I-Ambecause this did work. i remember doing it21:48
*** salv-orlando has quit IRC21:48
*** HenryG has quit IRC21:48
Sam-I-Ami can run at most 2 VMs, one per compute node right now21:48
Sam-I-Amsoooooo21:48
*** HenryG_ is now known as HenryG21:48
Sam-I-Ami think i need to up the compute node default ram to 2 gigs... ish.21:48
russellbuse m1.nano :)21:48
Sam-I-Amthats not a default flavor21:49
russellbcreate it!21:50
Sam-I-Amlol21:50
Sam-I-Ami think i'm going to crawl into a corner now21:51
Sam-I-Amor open a donut shop.21:51
russellb. openrc admin21:51
russellbnova flavor-create --is-public True m1.nano 42 64 0 121:51
Sam-I-Amjust rub it in, sir21:51
russellbi worked on nova longer than i've been working on networking :)21:52
*** HenryG has quit IRC21:52
Sam-I-Amrussellb: well, now i know who to ask my nova questions21:52
Sam-I-Amyou're welcome?21:52
russellbnot me21:52
russellbi forgot most of it21:52
Sam-I-Ambut this is openstack. everyone know everything all the time.21:53
*** HenryG has joined #openstack-neutron-ovn21:56
*** aginwala has quit IRC22:01
mesterySam-I-Am: I think that's it! On my Vagrant compute nodes, with nothing running but the services, I have < 100MB free :(22:03
mesterySam-I-Am: I think we want 2GB on those comptue boxes22:03
* mestery tests22:03
mesterySam-I-Am: Or even 1.5 GB on those22:05
Sam-I-Ammestery: yarp. and maybe add the m1.nano22:05
*** rtheis has quit IRC22:05
* mestery nods22:06
Sam-I-Ammestery: definitely think moving dhcp/md over is whats causing this22:06
mesteryI agree22:06
Sam-I-Amwelp, blame me!22:06
Sam-I-Amit wont be the first time :)22:07
mestery:)22:09
russellbmeh, it's impressive it ever worked at all in 1 GB22:10
russellbdon't be so hard on yourself22:10
Sam-I-Amlol22:10
Sam-I-Amok, i need to go charge into a headwind back home. back in a bit.22:10
* russellb headed out too22:11
Sam-I-Ambut its 65 out, so hard to complain22:11
* mestery waves bye-bye to russellb 22:12
*** regXboi has quit IRC22:15
*** armax has quit IRC22:19
*** armax has joined #openstack-neutron-ovn22:27
*** aginwala has joined #openstack-neutron-ovn22:31
*** aginwala has quit IRC22:32
*** aginwala has joined #openstack-neutron-ovn22:32
*** salv-orlando has joined #openstack-neutron-ovn22:42
*** brad_behle has quit IRC22:42
*** jckasper has quit IRC22:43
*** jckasper has joined #openstack-neutron-ovn22:43
*** aginwala has quit IRC22:44
*** salv-orl_ has quit IRC22:44
*** jckasper has quit IRC22:48
*** aginwala has joined #openstack-neutron-ovn23:00
*** aginwala has quit IRC23:01
*** aginwala has joined #openstack-neutron-ovn23:01
*** armax has quit IRC23:02
*** jckasper has joined #openstack-neutron-ovn23:09
*** jckasper has quit IRC23:14
openstackgerritMerged openstack/networking-ovn: devstack: Add devstackgatekuryrrc file for OVN + kuryr job  https://review.openstack.org/27843423:26
*** dlundquist has quit IRC23:45
*** aginwala has quit IRC23:50
*** aginwala has joined #openstack-neutron-ovn23:51
*** thumpba has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!