Thursday, 2016-09-15

*** jamielennox|away is now known as jamielennox00:00
*** banix has joined #openstack-neutron00:01
*** lnicolas has quit IRC00:04
openstackgerritKevin Benton proposed openstack/neutron: Add common way to extend standard attribute models  https://review.openstack.org/36468100:05
*** wu_ng has quit IRC00:06
*** wu_ng has joined #openstack-neutron00:06
*** lnicolas has joined #openstack-neutron00:07
*** lujinluo has joined #openstack-neutron00:08
liuyulong_haleyb, kevinbenton, garyk, hi, guys, https://review.openstack.org/#/c/369846/ and https://review.openstack.org/#/c/312849/, Jenkins has +1 on them, can we get them in ?00:08
openstackgerritKevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to retry  https://review.openstack.org/36999200:10
liuyulong_haleyb, thank you for adding the bug 1607746 to rc1. : )00:10
openstackbug 1607746 in neutron "Update floating IP extra attributes will unexpectedly disassociate it" [Medium,In progress] https://launchpad.net/bugs/1607746 - Assigned to LIU Yulong (dragon889)00:10
*** lucas-dinner has quit IRC00:10
*** hieulq has joined #openstack-neutron00:13
*** lucasagomes has joined #openstack-neutron00:16
*** thorst has joined #openstack-neutron00:17
*** liuyulong_ has quit IRC00:17
*** mfuruta has joined #openstack-neutron00:18
*** Swami__ has joined #openstack-neutron00:19
*** abhiraut has quit IRC00:19
*** Swami_ has quit IRC00:22
*** thorst has quit IRC00:24
*** hoangcx has joined #openstack-neutron00:26
*** ivar-laz_ has joined #openstack-neutron00:26
*** ivar-laz_ has quit IRC00:27
*** banix has quit IRC00:28
openstackgerritKevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to retry  https://review.openstack.org/36999200:29
*** ivar-lazzaro has quit IRC00:30
*** Swami__ has quit IRC00:36
*** Swami__ has joined #openstack-neutron00:37
*** jlvillal has quit IRC00:41
*** vishwanathj has quit IRC00:43
*** abhiraut has joined #openstack-neutron00:45
*** rkrum has joined #openstack-neutron00:46
*** jlvillal has joined #openstack-neutron00:46
openstackgerritKevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to retry  https://review.openstack.org/36999200:47
*** jlvillal has quit IRC00:47
*** jlvillal has joined #openstack-neutron00:47
*** jlvillal has quit IRC00:47
*** jlvillal has joined #openstack-neutron00:47
openstackgerritJamie Lennox proposed openstack/neutron: Use to_policy_values for policy enforcement  https://review.openstack.org/37049900:48
openstackgerritSindhu Devale proposed openstack/neutron-lib: [WIP] api-ref: Fix api-ref for port-binding  https://review.openstack.org/36457900:50
openstackgerritKevin Benton proposed openstack/neutron: Mark CRUD methods in agent schedulers DB as retriable  https://review.openstack.org/36718300:50
*** akshai has joined #openstack-neutron00:51
*** akshai has quit IRC00:53
*** gongysh has joined #openstack-neutron00:55
*** rkrum has quit IRC01:02
*** azbiswas has joined #openstack-neutron01:04
*** hoangcx has quit IRC01:05
*** abhiraut has quit IRC01:08
*** namnh has joined #openstack-neutron01:08
*** itsuugo has quit IRC01:08
*** itsuugo has joined #openstack-neutron01:10
openstackgerritMerged openstack/neutron: Implementation of vlan-aware-vms for Linux Bridge  https://review.openstack.org/34637701:10
*** mmedvede has joined #openstack-neutron01:13
*** pramod has quit IRC01:13
*** bana_k has quit IRC01:14
openstackgerritBrian Haley proposed openstack/neutron: Fix migration of legacy router to DVR  https://review.openstack.org/37043001:14
*** itsuugo has quit IRC01:15
*** itsuugo has joined #openstack-neutron01:16
*** ijw has quit IRC01:17
openstackgerritKevin Benton proposed openstack/neutron: Include timezone in timestamp fields  https://review.openstack.org/36868201:17
openstackgerritKevin Benton proposed openstack/neutron: Add common way to extend standard attribute models  https://review.openstack.org/36468101:17
*** thorst has joined #openstack-neutron01:21
*** itsuugo has quit IRC01:22
*** itsuugo has joined #openstack-neutron01:22
*** ijw has joined #openstack-neutron01:25
*** chandanc__ has joined #openstack-neutron01:26
*** kevo has quit IRC01:27
*** EinstCrazy has joined #openstack-neutron01:27
*** itsuugo has quit IRC01:27
*** itsuugo has joined #openstack-neutron01:28
*** thorst has quit IRC01:29
*** hoangcx has joined #openstack-neutron01:30
*** s3wong has quit IRC01:31
*** EinstCrazy has quit IRC01:33
*** gvrangan has quit IRC01:33
*** thorst has joined #openstack-neutron01:35
*** bana_k has joined #openstack-neutron01:35
*** Leom has quit IRC01:36
*** mickeys has quit IRC01:36
*** Sukhdev has quit IRC01:37
*** baoli has joined #openstack-neutron01:39
*** baoli has quit IRC01:41
*** salv-orlando has joined #openstack-neutron01:41
*** baoli has joined #openstack-neutron01:41
*** john-davidge has joined #openstack-neutron01:42
*** chandanc__ has quit IRC01:42
openstackgerritKevin Benton proposed openstack/neutron: Add common way to extend standard attribute models  https://review.openstack.org/36468101:42
*** salv-orl_ has quit IRC01:43
*** thorst has quit IRC01:45
openstackgerritKevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to retry  https://review.openstack.org/36999201:46
openstackgerritKevin Benton proposed openstack/neutron: Don't raise RetryRequest for port in delete_subnet  https://review.openstack.org/37050801:46
*** baoli has quit IRC01:46
*** john-davidge has quit IRC01:46
*** gongysh has quit IRC01:47
*** jckasper has quit IRC01:48
openstackgerritKevin Benton proposed openstack/neutron: Include timezone in timestamp fields  https://review.openstack.org/36868201:48
*** itsuugo has quit IRC01:48
*** itsuugo has joined #openstack-neutron01:50
*** tflynn_ has joined #openstack-neutron01:52
*** itsuugo has quit IRC01:55
*** tflynn has quit IRC01:55
*** ijw has quit IRC01:56
*** tflynn_ has quit IRC01:56
*** itsuugo has joined #openstack-neutron01:57
*** hoangcx has quit IRC02:00
*** wolverineav has joined #openstack-neutron02:01
*** rmcall has quit IRC02:02
*** rmcall has joined #openstack-neutron02:03
*** ijw has joined #openstack-neutron02:05
*** marun has quit IRC02:06
*** itsuugo has quit IRC02:08
*** itsuugo has joined #openstack-neutron02:09
*** iyamahat has quit IRC02:09
*** itsuugo has quit IRC02:16
*** bkopilov has quit IRC02:16
*** itsuugo has joined #openstack-neutron02:17
*** wolverin_ has joined #openstack-neutron02:19
*** wolverineav has quit IRC02:21
*** itsuugo has quit IRC02:22
*** namnh has quit IRC02:22
*** itsuugo has joined #openstack-neutron02:23
*** michchap has quit IRC02:26
*** michchap has joined #openstack-neutron02:26
*** marun has joined #openstack-neutron02:28
*** itsuugo has quit IRC02:29
*** itsuugo has joined #openstack-neutron02:30
*** absubram has quit IRC02:31
*** marun has quit IRC02:32
openstackgerritMerged openstack/neutron: Refactor for floating IP updating checks  https://review.openstack.org/36984602:33
openstackgerritMerged openstack/neutron: Correct floating IP extra attributes updating issues  https://review.openstack.org/31284902:33
*** itsuugo has quit IRC02:35
*** itsuugo has joined #openstack-neutron02:36
*** shangxdy has joined #openstack-neutron02:36
*** itsuugo has quit IRC02:43
*** itsuugo has joined #openstack-neutron02:44
*** iyamahat has joined #openstack-neutron02:46
*** thorst has joined #openstack-neutron02:47
*** yuanying has quit IRC02:47
*** itsuugo has quit IRC02:48
*** mriedem has quit IRC02:49
openstackgerritbin proposed openstack/neutron: Add routed network scenario test cases  https://review.openstack.org/34718802:49
*** itsuugo has joined #openstack-neutron02:50
*** gongysh has joined #openstack-neutron02:50
openstackgerritHirofumi Ichihara proposed openstack/neutron: [WIP] Add QoS minimum egress bandwidth rule into ovs-agent  https://review.openstack.org/31853102:50
*** hoangcx has joined #openstack-neutron02:54
*** thorst has quit IRC02:56
*** rmcall has quit IRC02:59
*** rmcall has joined #openstack-neutron02:59
*** shangxdy has quit IRC03:00
*** itsuugo has quit IRC03:01
*** sdake has joined #openstack-neutron03:01
*** Leo_ has joined #openstack-neutron03:03
*** itsuugo has joined #openstack-neutron03:03
*** ijw has quit IRC03:04
*** ijw has joined #openstack-neutron03:05
*** itsuugo has quit IRC03:08
*** fnaval has quit IRC03:09
*** SKipp has quit IRC03:09
*** chandanc__ has joined #openstack-neutron03:10
*** itsuugo has joined #openstack-neutron03:10
*** iyamahat has quit IRC03:10
*** yamahata has quit IRC03:11
*** marun has joined #openstack-neutron03:13
*** ijw has quit IRC03:13
*** itsuugo has quit IRC03:17
*** itsuugo has joined #openstack-neutron03:18
*** gouthamr has quit IRC03:19
*** namnh has joined #openstack-neutron03:19
*** gongysh has quit IRC03:21
*** marun has quit IRC03:22
*** itsuugo has quit IRC03:23
*** marst has joined #openstack-neutron03:23
*** namnh has quit IRC03:24
*** itsuugo has joined #openstack-neutron03:24
*** marun has joined #openstack-neutron03:24
*** fnaval has joined #openstack-neutron03:25
*** gongysh has joined #openstack-neutron03:25
*** namnh has joined #openstack-neutron03:25
*** namnh has joined #openstack-neutron03:25
*** namnh has quit IRC03:26
*** namnh has joined #openstack-neutron03:27
*** baojg has joined #openstack-neutron03:27
*** namnh has quit IRC03:27
*** chandanc__ has quit IRC03:27
*** namnh has joined #openstack-neutron03:27
*** hoangcx has quit IRC03:28
*** fzdarsky has joined #openstack-neutron03:29
*** hoangcx has joined #openstack-neutron03:31
*** bkopilov has joined #openstack-neutron03:33
*** itsuugo has quit IRC03:33
*** vishwanathj_ has joined #openstack-neutron03:35
*** itsuugo has joined #openstack-neutron03:36
*** namnh has quit IRC03:39
*** namnh has joined #openstack-neutron03:40
*** namnh has quit IRC03:40
*** itsuugo has quit IRC03:41
*** namnh has joined #openstack-neutron03:41
*** namnh has quit IRC03:41
*** namnh has joined #openstack-neutron03:42
*** itsuugo has joined #openstack-neutron03:42
*** namnh has quit IRC03:43
*** namnh has joined #openstack-neutron03:44
*** thorst has joined #openstack-neutron03:44
*** thorst has quit IRC03:46
*** jckasper has joined #openstack-neutron03:48
*** ijw_ has joined #openstack-neutron03:49
*** yuanying has joined #openstack-neutron03:51
*** itsuugo has quit IRC03:51
*** itsuugo has joined #openstack-neutron03:52
*** hoangcx has quit IRC03:53
*** ijw_ has quit IRC03:54
*** jckasper has quit IRC03:54
*** chandanc__ has joined #openstack-neutron03:55
*** kevo has joined #openstack-neutron03:58
*** itsuugo has quit IRC03:59
*** itsuugo has joined #openstack-neutron04:00
*** hoangcx has joined #openstack-neutron04:05
*** phschwartz has quit IRC04:07
*** mordred has quit IRC04:08
*** iyamahat has joined #openstack-neutron04:09
*** mordred has joined #openstack-neutron04:10
*** itsuugo has quit IRC04:10
*** phschwartz has joined #openstack-neutron04:11
*** itsuugo has joined #openstack-neutron04:12
*** fzdarsky has quit IRC04:13
*** ratailor has joined #openstack-neutron04:14
*** mtaylor22 has joined #openstack-neutron04:14
*** iyamahat has quit IRC04:15
*** itsuugo has quit IRC04:16
*** itsuugo has joined #openstack-neutron04:18
*** Swami__ has quit IRC04:21
*** yushiro has joined #openstack-neutron04:23
*** itsuugo has quit IRC04:23
*** yamamoto_ has joined #openstack-neutron04:24
*** itsuugo has joined #openstack-neutron04:24
*** ociuhandu has joined #openstack-neutron04:24
*** Alex_Stef has joined #openstack-neutron04:26
*** itsuugo has quit IRC04:29
*** thorst has joined #openstack-neutron04:29
*** fragatin_ has joined #openstack-neutron04:29
*** itsuugo has joined #openstack-neutron04:29
*** iyamahat has joined #openstack-neutron04:32
*** fragatina has quit IRC04:32
*** fragatin_ has quit IRC04:33
*** itsuugo has quit IRC04:34
*** itsuugo has joined #openstack-neutron04:35
*** jhershbe has joined #openstack-neutron04:35
*** abregman has joined #openstack-neutron04:38
*** thorst has quit IRC04:39
*** itsuugo has quit IRC04:40
*** adriant has quit IRC04:40
*** itsuugo has joined #openstack-neutron04:41
*** mkolesni has joined #openstack-neutron04:42
*** shausy has joined #openstack-neutron04:45
*** thorst has joined #openstack-neutron04:45
*** aswadr_ has joined #openstack-neutron04:49
*** itsuugo has quit IRC04:53
*** itsuugo has joined #openstack-neutron04:54
*** gvrangan has joined #openstack-neutron04:56
*** thorst has quit IRC04:58
*** thorst has joined #openstack-neutron04:58
*** Jeffrey4l__ has joined #openstack-neutron05:00
*** donghao has quit IRC05:01
*** sdake has quit IRC05:03
*** thetrav has joined #openstack-neutron05:03
*** itsuugo has quit IRC05:03
thetravso I've got an external network here that has the implicit "everyone has access" rbac wildcard05:03
thetravit's used by one project right now05:03
thetravI want to change the rbac so only that project can access it05:04
thetravI trued adding a new rbac that specified that project and then deleting the wildcard, however it appears to be unhappy with that05:04
*** Jeffrey4l_ has quit IRC05:04
thetravit assumes because there's a router, that the wildcard rbac is necessary05:04
*** itsuugo has joined #openstack-neutron05:04
thetravis there an alternative I can make use of?05:04
thetravsome "skip validation" or "force" or "no really, I know what I'm doing" argument?05:05
*** thorst has quit IRC05:07
*** kevo has quit IRC05:07
*** yamamoto_ has quit IRC05:07
*** slaweq_ has joined #openstack-neutron05:08
*** ivar-lazzaro has joined #openstack-neutron05:08
*** yamamoto_ has joined #openstack-neutron05:09
*** thorst has joined #openstack-neutron05:09
*** itsuugo has quit IRC05:10
*** itsuugo has joined #openstack-neutron05:10
*** ivar-laz_ has joined #openstack-neutron05:12
*** vikram has joined #openstack-neutron05:12
*** jprovazn has joined #openstack-neutron05:13
*** iyamahat has quit IRC05:13
*** iyamahat_ has joined #openstack-neutron05:13
*** thorst has quit IRC05:13
*** ganeshnalawade has joined #openstack-neutron05:14
*** ivar-lazzaro has quit IRC05:14
*** thorst has joined #openstack-neutron05:15
*** pgadiya has joined #openstack-neutron05:16
*** rcernin has joined #openstack-neutron05:17
*** yamamoto_ has quit IRC05:19
*** thorst has quit IRC05:19
*** itsuugo has quit IRC05:20
*** ivar-laz_ has quit IRC05:20
*** ganeshnalawade has quit IRC05:20
*** dane_leblanc has quit IRC05:21
*** itsuugo has joined #openstack-neutron05:21
*** ganeshnalawade has joined #openstack-neutron05:22
*** sdake has joined #openstack-neutron05:22
*** bzhao has quit IRC05:25
*** john-davidge has joined #openstack-neutron05:25
*** bzhao has joined #openstack-neutron05:25
*** itsuugo has quit IRC05:26
*** itsuugo has joined #openstack-neutron05:28
*** adriant has joined #openstack-neutron05:29
*** john-davidge has quit IRC05:29
*** gouthamr has joined #openstack-neutron05:31
*** fragatina has joined #openstack-neutron05:32
*** thorst has joined #openstack-neutron05:34
*** vishwanathj_ has quit IRC05:36
openstackgerritKevin Benton proposed openstack/neutron: Stop olso_messaging from error logging CallbackNotFound  https://review.openstack.org/37054305:37
*** fragatina has quit IRC05:37
*** itsuugo has quit IRC05:37
*** itsuugo has joined #openstack-neutron05:38
*** gvrangan has quit IRC05:38
*** markvoelker has quit IRC05:41
*** Leo_ has quit IRC05:41
*** iwamoto has joined #openstack-neutron05:42
*** thorst has quit IRC05:42
*** itsuugo has quit IRC05:43
*** itsuugo has joined #openstack-neutron05:43
*** thorst has joined #openstack-neutron05:44
*** hynekm has joined #openstack-neutron05:44
*** vishwanathj has joined #openstack-neutron05:47
*** azbiswas has quit IRC05:47
*** ganeshnalawade has quit IRC05:48
*** gvrangan has joined #openstack-neutron05:48
*** donghao has joined #openstack-neutron05:48
*** thorst has quit IRC05:49
*** oshvartz has joined #openstack-neutron05:49
*** thorst has joined #openstack-neutron05:50
*** itsuugo has quit IRC05:51
*** itsuugo has joined #openstack-neutron05:51
*** s3wong has joined #openstack-neutron05:52
*** ganeshnalawade has joined #openstack-neutron05:52
*** lihi has joined #openstack-neutron05:55
*** thorst has quit IRC05:55
*** itsuugo has quit IRC05:56
*** oanson has joined #openstack-neutron05:56
*** thorst has joined #openstack-neutron05:56
*** mosulica has joined #openstack-neutron05:57
*** itsuugo has joined #openstack-neutron05:58
*** thorst has quit IRC06:01
*** nherciu has joined #openstack-neutron06:02
*** thorst has joined #openstack-neutron06:02
*** itsuugo has quit IRC06:03
*** yamamoto_ has joined #openstack-neutron06:03
*** itsuugo has joined #openstack-neutron06:03
*** pcaruana has joined #openstack-neutron06:04
*** karthiks has joined #openstack-neutron06:06
*** thorst has quit IRC06:07
*** tflynn has joined #openstack-neutron06:08
*** thorst has joined #openstack-neutron06:08
*** tflynn has quit IRC06:09
*** tflynn has joined #openstack-neutron06:09
*** karthiks has quit IRC06:10
*** kobis has joined #openstack-neutron06:13
*** pcaruana is now known as pcaruana|afk|06:13
*** claudiub has joined #openstack-neutron06:15
openstackgerritKevin Benton proposed openstack/neutron: Don't warn in VLAN Plumber on tagless children  https://review.openstack.org/37055106:16
*** ushkalim has quit IRC06:16
*** thorst has quit IRC06:17
*** itsuugo has quit IRC06:18
*** thorst has joined #openstack-neutron06:19
*** itsuugo has joined #openstack-neutron06:19
*** itzkb_ has joined #openstack-neutron06:20
*** electrocucarach- has joined #openstack-neutron06:22
*** thorst has quit IRC06:24
*** karthiks has joined #openstack-neutron06:24
*** thetrav has quit IRC06:25
*** thorst has joined #openstack-neutron06:25
*** kobis has quit IRC06:25
*** absubram has joined #openstack-neutron06:26
*** absubram_ has joined #openstack-neutron06:28
*** kobis has joined #openstack-neutron06:28
*** itsuugo has quit IRC06:28
openstackgerritKevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to retry  https://review.openstack.org/36999206:30
openstackgerritKevin Benton proposed openstack/neutron: Lock DHCP port impacting operations on network_id  https://review.openstack.org/37025106:30
*** thorst has quit IRC06:30
*** andreas_s has joined #openstack-neutron06:30
*** ganeshnalawade has quit IRC06:30
*** itsuugo has joined #openstack-neutron06:30
*** wolverin_ has quit IRC06:31
*** wolverineav has joined #openstack-neutron06:31
*** absubram has quit IRC06:31
*** adriant has quit IRC06:32
*** thorst has joined #openstack-neutron06:32
openstackgerritKevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to SubnetNotFound  https://review.openstack.org/36999206:32
*** absubram_ has quit IRC06:34
*** ganeshnalawade has joined #openstack-neutron06:34
*** sdake has quit IRC06:36
*** thorst has quit IRC06:36
*** itsuugo has quit IRC06:37
*** absubram has joined #openstack-neutron06:38
*** itsuugo has joined #openstack-neutron06:38
*** wolverineav has quit IRC06:39
*** pcaruana|afk| is now known as pcaruana06:40
*** nyechiel has joined #openstack-neutron06:41
*** wolverineav has joined #openstack-neutron06:41
*** gouthamr has quit IRC06:41
*** iranzo has joined #openstack-neutron06:42
*** iranzo has joined #openstack-neutron06:42
*** itsuugo has quit IRC06:44
*** thorst has joined #openstack-neutron06:44
*** jamielennox is now known as jamielennox|away06:45
*** itsuugo has joined #openstack-neutron06:45
*** wolverineav has quit IRC06:45
*** donghao has quit IRC06:47
*** bana_k has quit IRC06:49
*** salv-orlando has quit IRC06:50
*** salv-orlando has joined #openstack-neutron06:51
*** thorst has quit IRC06:52
*** sridharg has joined #openstack-neutron06:54
*** thorst has joined #openstack-neutron06:54
*** hoangcx has quit IRC06:55
*** azbiswas has joined #openstack-neutron06:56
*** hoangcx has joined #openstack-neutron06:56
openstackgerritKevin Benton proposed openstack/neutron: Stop olso_messaging from error logging CallbackNotFound  https://review.openstack.org/37054306:57
*** azbiswas has quit IRC06:58
*** azbiswas has joined #openstack-neutron06:58
*** absubram has quit IRC06:58
*** thorst has quit IRC06:59
*** itsuugo has quit IRC07:00
*** thorst has joined #openstack-neutron07:00
*** ushkalim has joined #openstack-neutron07:01
*** iyamahat_ has quit IRC07:01
*** iyamahat_ has joined #openstack-neutron07:02
*** itsuugo has joined #openstack-neutron07:02
*** thorst has quit IRC07:05
*** tmorin has joined #openstack-neutron07:05
*** ganeshnalawade has quit IRC07:06
*** obondarev has joined #openstack-neutron07:07
*** bjolo_ is now known as bjolo07:08
iwamotoyamamoto_: ping07:08
yamamoto_iwamoto: pong07:08
iwamotoabout bug/162264407:08
iwamotowhy did you set native of_interface to OF1.3 only?07:09
*** sleviim has joined #openstack-neutron07:09
yamamoto_just because it uses that version07:09
iwamotoso you didn't care third-party flow modifiers ATM?07:11
*** tflynn has quit IRC07:11
yamamoto_right07:11
*** thorst has joined #openstack-neutron07:11
yamamoto_i don't think it's reasonable to provide flow-level compat07:11
yamamoto_but i guess it doesn't hurt to accept other versions.07:13
iwamotojust allow OF1.0 and hide the issue deep seems to be the way to go. :)07:15
*** rubasov has quit IRC07:15
*** ganeshnalawade has joined #openstack-neutron07:16
*** itsuugo has quit IRC07:17
*** thorst has quit IRC07:17
*** ekuris has joined #openstack-neutron07:17
*** thorst has joined #openstack-neutron07:18
*** itsuugo has joined #openstack-neutron07:18
yamamoto_iwamoto: no need to hide.  it's better to make it clear flow-level things are internal details which external entities should not rely on.07:20
*** thorst_ has joined #openstack-neutron07:21
iwamotoyamamoto_: and disallow external entities to use add_flows etc?07:22
*** nmagnezi_ has joined #openstack-neutron07:22
*** nmagnezi_ has quit IRC07:22
*** thorst has quit IRC07:23
*** itsuugo has quit IRC07:23
yamamoto_iwamoto: i don't claim we should disallow. my claim is that if they rely on the intenal details, it's their responsibility to catch up with incompatibilities.07:23
*** nmagnezi has joined #openstack-neutron07:24
*** jpena|off is now known as jpena07:24
*** matrohon has joined #openstack-neutron07:24
yamamoto_ie. do not expect ovs-agent to provide compatibility at that level07:24
*** itsuugo has joined #openstack-neutron07:24
iwamotoyamamoto_: something like "you can call if you want but I make no promise"?07:25
*** thorst_ has quit IRC07:25
yamamoto_iwamoto: exactly07:25
yamamoto_iwamoto: hopefully l2 extension flow management effort might make some promise07:27
*** akamyshnikova_ has joined #openstack-neutron07:27
*** abregman_ has joined #openstack-neutron07:28
*** itsuugo has quit IRC07:29
*** jlanoux has joined #openstack-neutron07:29
*** rubasov has joined #openstack-neutron07:30
*** abregman has quit IRC07:30
*** itsuugo has joined #openstack-neutron07:30
*** abregman_ has quit IRC07:30
*** abregman has joined #openstack-neutron07:32
*** iwamoto has quit IRC07:33
openstackgerritMathieu Rohon proposed openstack/neutron: Send a callback before attaching a subnet to a router  https://review.openstack.org/36922107:33
*** jlibosva has joined #openstack-neutron07:34
*** itsuugo has quit IRC07:35
*** itsuugo has joined #openstack-neutron07:35
*** hichihara has joined #openstack-neutron07:36
openstackgerritAnh Tran proposed openstack/neutron-lib: api-ref: Refactoring parameters in Networks APIs  https://review.openstack.org/35577307:37
*** obondarev has quit IRC07:38
*** obondarev has joined #openstack-neutron07:38
*** abregman is now known as abregman|mtg07:39
openstackgerritKevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to SubnetNotFound  https://review.openstack.org/36999207:40
openstackgerritKevin Benton proposed openstack/neutron: Lock DHCP port impacting operations on network_id  https://review.openstack.org/37025107:40
*** gongysh has quit IRC07:40
*** tobasco has quit IRC07:40
*** salv-orl_ has joined #openstack-neutron07:40
*** chandanc__ has quit IRC07:41
*** ushkalim has quit IRC07:41
*** markvoelker has joined #openstack-neutron07:42
*** salv-orlando has quit IRC07:43
*** jlanoux has quit IRC07:46
*** jlanoux_ has joined #openstack-neutron07:46
*** itsuugo has quit IRC07:47
*** neiljerram has quit IRC07:48
*** markvoelker has quit IRC07:48
*** eezhova has joined #openstack-neutron07:49
fricklerthis looks like a regression to me, as it did work for mitaka, can anyone try to confirm? https://bugs.launchpad.net/neutron/+bug/162381307:49
openstackLaunchpad bug 1623813 in OpenStack Compute (nova) "IPv6 address not shown in metadata" [Undecided,New]07:49
*** itsuugo has joined #openstack-neutron07:49
*** gvrangan has quit IRC07:50
*** jckasper has joined #openstack-neutron07:50
*** Alex_Stef has quit IRC07:53
*** jckasper has quit IRC07:55
*** hoangcx has quit IRC07:56
*** jamielennox|away is now known as jamielennox07:57
*** iyamahat_ has quit IRC07:58
*** zzzeek has quit IRC08:00
*** bks has joined #openstack-neutron08:00
*** zzzeek has joined #openstack-neutron08:00
*** basilAB has quit IRC08:03
*** azbiswas has quit IRC08:04
*** basilAB has joined #openstack-neutron08:05
*** yamahata has joined #openstack-neutron08:13
*** amotoki has joined #openstack-neutron08:14
*** Alex_Stef has joined #openstack-neutron08:15
*** s3wong has quit IRC08:16
openstackgerritHynek Mlnarik proposed openstack/neutron: API tests: Check MTU sanity of trunk/subport  https://review.openstack.org/36420808:19
*** itsuugo has quit IRC08:32
*** chandanc__ has joined #openstack-neutron08:32
*** itsuugo has joined #openstack-neutron08:34
*** hoangcx has joined #openstack-neutron08:35
*** devvesa has joined #openstack-neutron08:36
*** iyamahat has joined #openstack-neutron08:36
*** eezhova has quit IRC08:37
*** korzen has joined #openstack-neutron08:39
*** roeyc has joined #openstack-neutron08:41
*** ushkalim has joined #openstack-neutron08:42
*** moshele has joined #openstack-neutron08:44
*** itsuugo has quit IRC08:46
*** Alex_Stef has quit IRC08:46
*** itsuugo has joined #openstack-neutron08:46
*** ushkalim has quit IRC08:47
*** mtaylor22 has quit IRC08:48
*** mickeys has joined #openstack-neutron08:49
openstackgerritMerged openstack/neutron: Add release note for blueprint vlan-aware-vms  https://review.openstack.org/36008908:49
*** hoangcx has quit IRC08:50
*** itsuugo has quit IRC08:51
*** itsuugo has joined #openstack-neutron08:52
openstackgerritMerged openstack/neutron: tests: don't override base object test class attributes  https://review.openstack.org/37003708:52
*** neiljerram has joined #openstack-neutron08:54
*** mickeys has quit IRC08:55
*** ihrachys has joined #openstack-neutron08:55
*** hoangcx has joined #openstack-neutron08:55
*** ratailor has quit IRC08:57
*** abregman_ has joined #openstack-neutron08:59
*** john-davidge has joined #openstack-neutron08:59
*** mfuruta has quit IRC09:00
*** john-dav_ has joined #openstack-neutron09:02
*** john-davidge has quit IRC09:02
*** efoley has joined #openstack-neutron09:02
*** abregman|mtg has quit IRC09:02
*** hichihara has quit IRC09:04
*** azbiswas has joined #openstack-neutron09:04
*** ganeshnalawade has quit IRC09:05
*** itsuugo has quit IRC09:06
*** ganeshnalawade has joined #openstack-neutron09:06
*** ganeshnalawade has quit IRC09:08
*** itsuugo has joined #openstack-neutron09:08
*** watanabe_isao has joined #openstack-neutron09:08
*** azbiswas has quit IRC09:09
*** Alex_Stef has joined #openstack-neutron09:11
*** fzdarsky has joined #openstack-neutron09:16
*** itsuugo has quit IRC09:18
*** vijaykc4 has joined #openstack-neutron09:18
*** rossella_ has quit IRC09:18
*** itsuugo has joined #openstack-neutron09:19
*** pmannidi has quit IRC09:19
*** rossella_ has joined #openstack-neutron09:19
*** ganeshnalawade has joined #openstack-neutron09:19
*** Alex_Stef has quit IRC09:19
*** mvk has quit IRC09:20
*** gabor_antal has joined #openstack-neutron09:21
*** rvasilets__ has joined #openstack-neutron09:22
*** hieulq has quit IRC09:22
*** hieulq has joined #openstack-neutron09:22
*** devvesa has quit IRC09:25
*** sambetts|afk is now known as sambetts09:25
*** alex_xu has quit IRC09:26
*** alex_xu has joined #openstack-neutron09:27
openstackgerritThomas Morin proposed openstack/neutron: ovs agent, native ARP response: set Eth src/dst  https://review.openstack.org/37063909:28
*** jlanoux_ has quit IRC09:30
*** jlanoux has joined #openstack-neutron09:30
matrohonihrachys, tmorin : hi09:31
ihrachysmatrohon: ^ ?09:31
tmorinhi matrohon09:31
matrohonihrachys, tmorin : what about targeting this bug as a rc candidate? https://bugs.launchpad.net/neutron/+bug/162384909:31
openstackLaunchpad bug 1623849 in neutron "openvswitch native agent, ARP responder response has wrong Eth headers" [Undecided,In progress] - Assigned to Thomas Morin (tmmorin-orange)09:31
matrohonihrachys, just reported by tmorin09:31
tmorintmorin: I think this is simple/obvious enough, but of course, other's opinion would be needed09:32
ihrachysmatrohon: done09:33
matrohonihrachys, thanks!09:33
ihrachysmatrohon: we have some other bugs that fix difference between flows for those drivers.09:33
ihrachysmatrohon: I wonder whether we could catch diverge in some automated way09:33
ihrachyslike set a bunch of resources, then dump and compare09:33
*** john-dav_ is now known as john-davidge09:35
evrardjplook at what we have here john-davidge09:35
evrardjpWARNING neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [req-aeb126a7-2cb3-4771-b3fb-6bc6cac3f728 e63b79858e8c46d5b2c4c7070df6232e b19cdf8acf14406ba1faeee6b3ae8af5 - - -] Unable to schedule network 409e1273-da1a-472d-9556-77d99c309642: no agents available; will retry on subsequent port and subnet creation events.09:35
evrardjpsorry for the long paste the others :)09:35
matrohonihrachys, sounds interesting, tmorin : thoughs?09:36
evrardjpand good morning everyone09:36
matrohonihrachys, sound like an interesting topic to discuss with ryu guys during the summit09:36
*** thorst has joined #openstack-neutron09:38
*** wolverineav has joined #openstack-neutron09:38
tmorinihrachys, matrohon: yes, indeed, the idea sounds interesting09:39
*** eezhova has joined #openstack-neutron09:39
*** devvesa has joined #openstack-neutron09:41
*** wolverineav has quit IRC09:43
*** markvoelker has joined #openstack-neutron09:44
*** ganeshnalawade has quit IRC09:46
*** iyamahat has quit IRC09:47
*** Trident has joined #openstack-neutron09:48
*** yamahata has quit IRC09:49
*** markvoelker has quit IRC09:49
*** mvk has joined #openstack-neutron09:50
*** ganeshnalawade has joined #openstack-neutron09:50
*** yushiro has quit IRC09:55
*** lujinluo has quit IRC09:57
*** itsuugo has quit IRC10:00
*** salv-orl_ has quit IRC10:01
*** itsuugo has joined #openstack-neutron10:01
openstackgerritMathieu Rohon proposed openstack/neutron: Send a callback before attaching a subnet to a router  https://review.openstack.org/36922110:04
*** moshele has quit IRC10:06
*** moshele has joined #openstack-neutron10:06
*** efoley has quit IRC10:07
*** efoley has joined #openstack-neutron10:09
*** hoangcx has quit IRC10:09
*** roeyc has quit IRC10:09
*** gongysh has joined #openstack-neutron10:10
openstackgerritKevin Benton proposed openstack/os-vif: Add MTU to Network model and use it in plugging  https://review.openstack.org/37066710:10
*** itsuugo has quit IRC10:11
*** itsuugo has joined #openstack-neutron10:12
*** clsqwerty_ has joined #openstack-neutron10:14
*** clsqwerty_ has quit IRC10:15
*** vijaykc4 has quit IRC10:16
*** ganeshnalawade has quit IRC10:16
*** ganeshnalawade has joined #openstack-neutron10:17
*** mbirru has quit IRC10:19
*** fzdarsky has quit IRC10:24
*** itsuugo has quit IRC10:25
*** itsuugo has joined #openstack-neutron10:27
*** itsuugo has quit IRC10:32
*** ramishra has quit IRC10:32
*** itsuugo has joined #openstack-neutron10:32
*** ganeshnalawade has quit IRC10:32
*** ganeshnalawade has joined #openstack-neutron10:33
*** ramishra has joined #openstack-neutron10:33
*** boden has joined #openstack-neutron10:34
*** fzdarsky has joined #openstack-neutron10:35
*** itsuugo has quit IRC10:39
*** moshele has quit IRC10:39
*** itsuugo has joined #openstack-neutron10:41
*** moshele has joined #openstack-neutron10:42
*** ganeshnalawade has quit IRC10:43
*** itsuugo has quit IRC10:46
*** itsuugo has joined #openstack-neutron10:46
*** ratailor has joined #openstack-neutron10:47
openstackgerritKevin Benton proposed openstack/neutron: Lock DHCP port impacting operations on network_id  https://review.openstack.org/37025110:48
openstackgerritKevin Benton proposed openstack/neutron: [test]: expire_all() on session for retries  https://review.openstack.org/37068610:48
*** rtheis has joined #openstack-neutron10:48
*** hieulq has quit IRC10:51
*** hieulq has joined #openstack-neutron10:51
*** vijaykc4 has joined #openstack-neutron10:54
*** anilvenkata has joined #openstack-neutron10:56
*** vijaykc4 has quit IRC11:00
*** sdague has joined #openstack-neutron11:01
*** baojg has quit IRC11:01
*** chandanc__ has quit IRC11:01
*** yamamoto_ has quit IRC11:01
*** salv-orlando has joined #openstack-neutron11:02
*** obondarev has quit IRC11:02
*** donghao has joined #openstack-neutron11:05
*** lucasagomes is now known as lucas-hungry11:06
*** dave-mccowan has joined #openstack-neutron11:06
*** roeyc has joined #openstack-neutron11:06
*** salv-orlando has quit IRC11:06
*** Alex_Stef has joined #openstack-neutron11:06
kevinbentonihrachys: btw, the MTU thing may be a reason for our grenade failures11:07
ihrachyskevinbenton: do we have failures there? I haven't heard about any lately11:08
openstackgerritThomas Morin proposed openstack/neutron: ovs agent, native ARP response: set Eth src/dst  https://review.openstack.org/37063911:08
kevinbentonihrachys: it's hit on a few of my patches11:08
kevinbentonihrachys: test network basic ops fails at SSH after successful ping11:08
ihrachysok would be nice to have a bug reported with links and all so that we can track11:08
*** bkopilov has quit IRC11:08
ihrachysyeah, that's a symptom you would see11:08
kevinbentonihrachys: well the bug i filed agains nova would probably cover it11:10
*** efoley_ has joined #openstack-neutron11:10
openstackgerritKengo Hobo proposed openstack/neutron: Add check that external gw port exist in metering-agent  https://review.openstack.org/36882311:12
ihrachyskevinbenton: ack11:12
ihrachyskevinbenton: I have a test that uses the unfragmented pings, just polishing the code.11:12
*** vijaykc4 has joined #openstack-neutron11:12
kevinbentonihrachys: the link i put in the bug report is to one of our grenade failures11:13
kevinbentonihrachys: where the mtu is 1500 on compute and 1450 on neutron11:13
ihrachyskevinbenton: but how does it fail then? 1500 should allow anything <=1450 in without an issue11:13
*** efoley has quit IRC11:13
ihrachyskevinbenton: and instances use dhcp advertised mtu from dhcp agent11:13
ihrachysso there should be no functional problem11:13
kevinbentonihrachys: true, it's probably completely unrelated :)11:14
kevinbentonihrachys: it's a good thing i misdiagnosed...11:14
*** jlanoux has quit IRC11:14
ihrachysyeah, it means that we have a limited scope of people affected.11:14
*** jlanoux has joined #openstack-neutron11:15
kevinbentonihrachys: yeah, that actually means your ping test wouldn't detect this either...11:15
kevinbentonihrachys: unless network_device_mtu is set to something really low11:15
ihrachyskevinbenton: it will if nova.conf configures network_device_mtu = 140011:15
ihrachysyeap11:15
kevinbentonihrachys: ack11:15
ihrachyswhich we can trigger with a simple depends-on11:15
*** jlanoux has quit IRC11:17
*** jlanoux has joined #openstack-neutron11:17
*** baojg has joined #openstack-neutron11:18
*** vijaykc4 has quit IRC11:19
*** sridharg has quit IRC11:19
*** ganeshnalawade has joined #openstack-neutron11:20
*** vijaykc4 has joined #openstack-neutron11:21
*** ganeshnalawade has quit IRC11:23
*** itsuugo has quit IRC11:23
*** itsuugo has joined #openstack-neutron11:25
*** roeyc has quit IRC11:26
*** thorst has quit IRC11:27
*** ganeshnalawade has joined #openstack-neutron11:27
*** salv-orlando has joined #openstack-neutron11:28
*** roeyc has joined #openstack-neutron11:29
*** vijaykc4 has quit IRC11:30
*** fragatina has joined #openstack-neutron11:30
*** karthiks has quit IRC11:30
*** karthiks has joined #openstack-neutron11:32
*** fragatina has quit IRC11:34
*** ccard has joined #openstack-neutron11:34
*** pgadiya has quit IRC11:35
*** yamamoto has joined #openstack-neutron11:38
ccard(Apologies if this is the wrong channel) we are seeing an issue where broadcast udp messages > 1500 bytes are sometimes getting thrown away by (we assume) the iptables rules on the qbrxxxxxxxx-xx linux bridge, but single cast udp messages of any size and broadcast udp messages <= 1500 bytes are ok. Is this a known issue? (we are on CentOS 7, OpenStack Juno, but just about to upgrade to Liberty)11:40
*** fzdarsky has quit IRC11:41
*** ganeshnalawade has quit IRC11:41
*** yamamoto has quit IRC11:41
*** edmondsw has joined #openstack-neutron11:42
*** ganeshnalawade has joined #openstack-neutron11:42
*** jckasper has joined #openstack-neutron11:43
*** jckasper has quit IRC11:43
*** itsuugo has quit IRC11:43
*** jckasper has joined #openstack-neutron11:44
*** itsuugo has joined #openstack-neutron11:44
*** ganeshnalawade has quit IRC11:44
*** ftersin has joined #openstack-neutron11:44
reedipccard : I think the mtu has the max limit of 150011:45
*** markvoelker has joined #openstack-neutron11:45
*** andrey-mp has joined #openstack-neutron11:45
reedipkevinbenton , ihrachys : can you confirm  ( this is what I recall )  ^^11:45
ihrachysreedip: ?? no11:45
ihrachysccard: I don't think we support Juno or even Kilo these days.11:46
*** obondarev has joined #openstack-neutron11:46
ihrachysccard: there were significant mtu related fixes starting from Liberty.11:46
reedipihrachys : so the mtu is modifiable ??11:47
*** yamamoto has joined #openstack-neutron11:47
ccardreedip: yes, the mtu is 1500, but it should still cope with UDP messages > 1500, and indeed does except for broadcast messages11:47
ihrachysreedip: yes, depending on infrastructure11:48
ihrachysccard: how come should it?11:48
ihrachysccard: if it's larger than MTU, fullstop, the frame is dropped11:48
reedipihrachys : okay, didnt know that . Thanks :)11:48
ihrachysccard: if it's not that a bug ;)11:48
ccardihrachys: I don't think it's directly related to the mtu, since singlecast udp works fine11:48
ccardmtu is at layer 3 isn't it, while udp is layer 4?11:49
*** ganeshnalawade has joined #openstack-neutron11:49
*** baoli has joined #openstack-neutron11:49
*** markvoelker has quit IRC11:50
ccardso I would expect a udp message > 1500 to be split into multiple frames11:50
ihrachysccard: oh, so your endpoint that generates the oversized udp packet supports higher mtu11:51
ihrachysccard: then indeed assuming you cross L3 boundary, your router should fragment11:51
*** yamamoto has quit IRC11:51
ihrachysccard: unless you set 'don't fragment' in the header11:51
*** yamamoto has joined #openstack-neutron11:52
openstackgerritKevin Benton proposed openstack/os-vif: Add MTU to Network model and use it in plugging  https://review.openstack.org/37066711:52
ihrachysccard: this is the first time I hear about such particular scenario of failure11:52
ihrachysccard: anyhow, I suggest to retest on something supported by upstream first before getting deeper into debugging the issue11:53
ccardihrachys: the application is sending broadcast UDP packets (to 255.255.255.255) which are typically around 1600 bytes11:53
ihrachysccard: do you cross l3 boundary?11:53
ccardwe think that an iptables rule on the linux bridge is dropping some of them because it thinks they are INVALID. We see the packets on the qvb interface with tcpdump, but not on the qbr.11:54
*** jhershbe has quit IRC11:55
ccardif we disable the filtering (so the iptables rules are not used), everything works fine11:55
openstackgerritKevin Benton proposed openstack/neutron: [test]: expire_all() on session for retries  https://review.openstack.org/37068611:56
openstackgerritSlawek Kaplonski proposed openstack/neutron: Metadata agent HA for nova-api services  https://review.openstack.org/37072711:56
openstackgerritKevin Benton proposed openstack/neutron: Lock DHCP port impacting operations on network_id  https://review.openstack.org/37025111:56
anilvenkataobondarev, shz I am on PTO for past 2 weeks, and will be back on monday11:56
anilvenkataobondarev, shz will look into https://review.openstack.org/#/c/352440/ on monday11:56
anilvenkataobondarev, shz thanks for the review11:57
obondarevanilvenkata: np, thanks11:57
*** yamamoto has quit IRC11:57
*** jckasper has quit IRC11:58
*** anilvenkata has quit IRC11:58
*** baoli_ has joined #openstack-neutron11:58
andrey-mphi, I found a bug that recently was merged with review https://bugs.launchpad.net/neutron/+bug/1623800  Can someone check it and make a desicion - revert or fix?11:58
openstackLaunchpad bug 1623800 in neutron "Can't add exact count of fixed ips to port (regression)" [Undecided,New]11:58
*** jckasper has joined #openstack-neutron11:58
*** obondarev has quit IRC11:58
ihrachysccard: seems related https://bugs.launchpad.net/neutron/+bug/146391111:59
openstackLaunchpad bug 1463911 in linux (Ubuntu) "IPV6 fragmentation and mtu issue" [Medium,Confirmed] - Assigned to Jay Vosburgh (jvosburgh)11:59
ihrachysccard: there seems to be a kernel fix for that11:59
ihrachysccard: do you have it in your setup?11:59
*** pgadiya has joined #openstack-neutron11:59
openstackgerritReedip proposed openstack/neutron-fwaas: [WIP]Add firewall_policy_id in FWaaS v2  https://review.openstack.org/37073112:00
*** baoli has quit IRC12:01
openstackgerritThomas Morin proposed openstack/neutron: ovs agent, native ARP response: set Eth src/dst  https://review.openstack.org/37063912:01
*** obondarev has joined #openstack-neutron12:02
*** jpena is now known as jpena|lunch12:02
*** jckasper has quit IRC12:03
*** jkraj has joined #openstack-neutron12:04
*** ivc_ has joined #openstack-neutron12:06
fricklerccard: if the packets get indeed fragmented, only the first packet will contain the UDP port information. so depending on what the iptables rules look like, the other fragments may get discarded because they effectively target UDP port 012:07
ccardihrachys: we are on 3.10.0-327.13.1.el7 at the moment, so we won't have that kernel fix. But thanks for the pointer12:07
ihrachysfrickler: ideally they are captured as RELATED12:07
ihrachysfrickler: but apparently sometimes they are not :)12:08
ccardfrickler: we don't lose all the UDP messages, only some12:08
ihrachysccard: not sure the patch will help though, it talks about ipv6 only12:09
ihrachysbut generally, this sounds like a kernel isuse12:09
*** namnh has quit IRC12:09
ihrachys*issue12:09
ccardit does mention ipv4 too12:09
*** jlanoux has quit IRC12:09
ftersincarl_baldwin: hi, are you around?12:12
*** gongysh has quit IRC12:12
*** pradk has joined #openstack-neutron12:13
*** claudiub has quit IRC12:16
*** chandanc__ has joined #openstack-neutron12:17
*** lucas-hungry is now known as lucasagomes12:17
*** pgadiya has quit IRC12:19
*** amuller has joined #openstack-neutron12:22
*** itsuugo has quit IRC12:23
*** ratailor has quit IRC12:23
*** itsuugo has joined #openstack-neutron12:23
*** obondarev has quit IRC12:24
openstackgerritHirofumi Ichihara proposed openstack/neutron: [WIP] Add QoS minimum egress bandwidth rule into ovs-agent  https://review.openstack.org/31853112:25
*** wu_ng has quit IRC12:27
*** obondarev has joined #openstack-neutron12:27
*** itsuugo has quit IRC12:28
*** itsuugo has joined #openstack-neutron12:29
*** yamamoto has joined #openstack-neutron12:30
*** yamamoto has quit IRC12:31
*** yamamoto has joined #openstack-neutron12:31
*** ganeshnalawade has quit IRC12:31
*** bkopilov has joined #openstack-neutron12:32
*** vijaykc4 has joined #openstack-neutron12:33
ihrachyskevinbenton: sigh, no -M do support for ping in cirros12:33
* ihrachys hates cirros12:33
kevinbentonihrachys: i suppose just having nova set a tiny mtu and doing ssh should be enough12:34
ihrachysso I can ping FIP from outside, but not validate ping from inside the instance12:34
kevinbentonihrachys: well if you can ping the instance with a larger frame and it doens't get dropped in the veth, that's pretty good12:35
ihrachyskevinbenton: well, at least I can validate FIP side. assuming it's -M do it should be same either way12:35
ihrachyskevinbenton: right, I need to cover three cases: ping -M do -sMTU (pass), ping -M do -sMTU+1 (fail), ping -sMTU+1 (pass)12:36
ihrachysthe latter, I can do both ways, including from inside the remote client12:36
*** yamamoto has quit IRC12:37
*** sdake has joined #openstack-neutron12:38
*** markvoelker has joined #openstack-neutron12:38
*** yamamoto has joined #openstack-neutron12:38
*** ganeshnalawade has joined #openstack-neutron12:38
*** jhershbe has joined #openstack-neutron12:39
*** bks has quit IRC12:39
andrey-mpkevinbenton - hi! can you say something about this bug - https://bugs.launchpad.net/neutron/+bug/1623800  is it a new bug or new feature?12:40
openstackLaunchpad bug 1623800 in neutron "Can't add exact count of fixed ips to port (regression)" [Undecided,New]12:40
*** azbiswas has joined #openstack-neutron12:41
kevinbentonandrey-mp: yes, that looks like a regression12:41
andrey-mpok, thank you. will it be reverted or new fix will be?12:42
andrey-mp(or I need to ask Carl about it?)12:42
kevinbentonandrey-mp: i think we will need to revert12:43
andrey-mpgood news for us )12:44
andrey-mpkevinbenton: thanks, will wait.12:44
*** mriedem has joined #openstack-neutron12:44
kevinbentonandrey-mp: i'm quite surprised we don't have a test for this12:45
kevinbentonandrey-mp: what is the port payload for the update?12:45
*** itsuugo has quit IRC12:45
*** ganeshnalawade has quit IRC12:45
*** cbouch has joined #openstack-neutron12:45
*** azbiswas has quit IRC12:46
*** ganeshnalawade has joined #openstack-neutron12:46
*** itsuugo has joined #openstack-neutron12:46
andrey-mpkevinbenton: it's just a test in ec2-api project to check that our ec2-api is compatible with Amazon API. (if I correctly understood what means 'port payload' in the context)12:47
kevinbentonandrey-mp: yeah, i was wondering if you had the request that was sent to neutron to add the IPs12:47
kevinbentonandrey-mp: oh, i see it there12:47
andrey-mpyeah, it's there12:48
*** vijaykc4 has quit IRC12:48
*** jamesdenton has joined #openstack-neutron12:48
*** zkassab_ has joined #openstack-neutron12:51
openstackgerritJakub Libosvar proposed openstack/neutron: fullstack: VLAN aware VMs test  https://review.openstack.org/36900112:51
*** banix has joined #openstack-neutron12:52
*** ekuris has quit IRC12:55
*** ranjithd has joined #openstack-neutron12:55
*** yamamoto has quit IRC12:56
*** reedip has quit IRC12:56
*** mosulica has quit IRC12:57
*** jprovazn has quit IRC12:58
*** yamamoto has joined #openstack-neutron12:58
*** jprovazn has joined #openstack-neutron12:58
fricklerihrachys: kevinbenton: jschwarz|ooo: I've started a writeup outlining the plan and motivation for building custom cirros-based images, please have a look: https://etherpad.openstack.org/p/cirros-respin12:59
*** chandanc__ has quit IRC12:59
*** ganeshnalawade has quit IRC12:59
*** ganeshnalawade has joined #openstack-neutron12:59
ihrachysfrickler: oh that's nice!13:00
*** ftersin has left #openstack-neutron13:00
*** ociuhandu has quit IRC13:01
*** itsuugo has quit IRC13:01
*** jpena|lunch is now known as jpena13:02
*** itsuugo has joined #openstack-neutron13:02
*** wolverineav has joined #openstack-neutron13:03
*** SKipp has joined #openstack-neutron13:05
*** oanson has quit IRC13:06
*** fzdarsky has joined #openstack-neutron13:06
*** yamamoto has quit IRC13:07
*** yamamoto has joined #openstack-neutron13:07
openstackgerritKevin Benton proposed openstack/neutron: Revert "Don't allocate IP on port update when existing subnet specified"  https://review.openstack.org/37080113:07
openstackgerritKevin Benton proposed openstack/neutron: Add API test to ensure IPs can be added by subnet  https://review.openstack.org/37080213:07
kevinbentonihrachys, HenryG ^^13:07
kevinbentonneed to get those two patches in13:07
kevinbentonwell the revert mostly13:07
kevinbentonthe test just prevents another regression13:08
*** wolverineav has quit IRC13:08
*** reedip has joined #openstack-neutron13:08
*** devvesa has quit IRC13:10
*** akshai has joined #openstack-neutron13:10
*** DaveJ__ has joined #openstack-neutron13:11
*** mkolesni has quit IRC13:13
*** sdake_ has joined #openstack-neutron13:14
*** wolverineav has joined #openstack-neutron13:15
*** salv-orlando has quit IRC13:15
*** DaveJ__ is now known as DaveJ13:15
*** sdake has quit IRC13:16
openstackgerritKevin Benton proposed openstack/os-vif: Add MTU to Network model and use it in plugging  https://review.openstack.org/37066713:16
*** krtaylor has joined #openstack-neutron13:18
*** rossella_ has quit IRC13:18
openstackgerritRyan Moats proposed openstack/neutron-vpnaas: [WIP] Add scheduler support for VPN service.  https://review.openstack.org/36846813:19
*** rossella_ has joined #openstack-neutron13:19
*** wolverineav has quit IRC13:19
*** ltomasbo has joined #openstack-neutron13:19
*** crose has joined #openstack-neutron13:22
*** yamahata has joined #openstack-neutron13:23
haleybkevinbenton: just a nit, but is it better to hit the revert button in the original change?  that way they're linked together and the bug will be tagged13:23
*** jckasper has joined #openstack-neutron13:23
*** vijaykc4 has joined #openstack-neutron13:24
kevinbentonhaleyb: oh, i'll do it manually13:24
*** vijaykc4 has quit IRC13:24
kevinbentonhaleyb: i had done it locally to confirm with that API test before proposing the revert13:24
*** gouthamr has joined #openstack-neutron13:24
kevinbentonhaleyb: didn't want to cry wolf :)13:24
haleybbut that button is so easy :)13:24
*** SKipp has quit IRC13:25
*** devvesa has joined #openstack-neutron13:25
kevinbentonhaleyb: i was just thinking, this regression could have interferred with the dhcp agent...13:26
haleybkevinbenton: everything interferes with the dhcp agent :(13:27
kevinbentonhaleyb: oh, nevermind. it requests different subnets13:27
kevinbentonthis is particular to a single subnet13:27
kevinbentonfrom what i can tell13:27
*** jhershbe has quit IRC13:27
*** edand has joined #openstack-neutron13:28
*** karad has joined #openstack-neutron13:28
*** mriedem has quit IRC13:29
*** wolverineav has joined #openstack-neutron13:29
*** chandanc__ has joined #openstack-neutron13:30
*** ganeshnalawade has quit IRC13:30
*** lnicolas has quit IRC13:32
carl_baldwinkevinbenton: thanks for the new test.13:34
*** crose has quit IRC13:34
openstackgerritThomas Morin proposed openstack/neutron: ovs agent, native ARP response: set Eth src/dst  https://review.openstack.org/37063913:36
*** wolverineav has quit IRC13:36
*** kbringard has joined #openstack-neutron13:36
*** yamamoto has quit IRC13:38
kevinbentoncarl_baldwin: no prob13:38
ihrachyshaleyb: do you plan to respin https://review.openstack.org/#/c/366291/ today?13:40
*** kriskend has joined #openstack-neutron13:41
ihrachysbeagles: where do we stand with https://review.openstack.org/#/c/368553/ ? I see your -1 but I am not sure it's still valid considering the latest comments from you?13:42
*** dane_leblanc has joined #openstack-neutron13:43
beaglesihrachys: I haven't retested yet. I started redeploying that env this morning. I should be able to lift the -1 a bit later today.13:44
*** akshai has quit IRC13:44
*** cleong has joined #openstack-neutron13:44
*** vijaykc4 has joined #openstack-neutron13:44
*** devvesa has quit IRC13:45
ihrachysbeagles: ok cool. it may trigger rc2 though.13:45
beaglesihrachys: ack13:45
beaglesihrachys: what's the actual time deadline there?13:45
beaglesihrachys: the thing it is competing with in terms of processing power for testing can take a back burner if a few hours will make a difference13:46
*** itsuugo has quit IRC13:46
ihrachysbeagles: we land rc1 today I suspect13:47
ihrachysdeadline is tomorrow13:47
*** kobis has quit IRC13:47
ihrachysbut then we may produce more RCs13:47
ihrachyswhich we usually do :)13:47
*** akshai has joined #openstack-neutron13:48
*** itsuugo has joined #openstack-neutron13:48
beaglesihrachys: okay. I'll give it more of a push just in case there's only the one RC13:48
*** EinstCrazy has joined #openstack-neutron13:48
haleybihrachys: yes, i do have some more questions, ping you in a few minutes13:50
ihrachyskevinbenton: re https://review.openstack.org/#/c/369992/11 I see that rally test patch failed. does it indicate the problem? no logs available though for some reason.13:50
*** akshai has quit IRC13:50
*** kriskend has quit IRC13:50
ihrachyskevinbenton: hm, weird, now the link to logs worked for me. some glitch I guess.13:51
*** dane_leblanc has quit IRC13:51
*** gongysh has joined #openstack-neutron13:51
kevinbentonihrachys: quota error?13:51
*** tonytan4ever has joined #openstack-neutron13:51
kevinbentonihrachys: oh, you mean the one in the rally gate?13:51
*** Esha has joined #openstack-neutron13:52
*** chandanc__ has quit IRC13:52
ihrachyskevinbenton: that one, yes13:52
ihrachyskevinbenton: though it's some different thing it seems13:52
kevinbentonihrachys: yeah, i just changed it back13:52
ihrachyskevinbenton: see though this http://logs.openstack.org/17/369417/11/check/gate-rally-dsvm-neutron-rally/9135215/logs/screen-q-svc.txt.gz?level=TRACE#_2016-09-15_11_15_52_77313:52
kevinbentonihrachys: wait for another test run13:52
ihrachys"TypeError: can only concatenate tuple (not "list") to tuple"13:52
EshaHi, I wanted to check about MTU setting for a neutron network. Is it possible to edit it to a value different than 1500.Default always gets set to 150013:53
kevinbentonihrachys: was testing something13:53
ihrachysdoesn't look right :P13:53
ihrachyskevinbenton: ok, so that TypeError from your experiments? not a bug in neutron?13:53
kevinbentonihrachys: yeah13:53
ihrachysok13:53
ihrachysI feel relieved13:53
*** lbrune has joined #openstack-neutron13:53
kevinbentonihrachys: from the first version of this https://review.openstack.org/#/c/370686/13:54
*** chandanc__ has joined #openstack-neutron13:54
ihrachysgood13:54
Esha1618025 was raised for same - MTU issue13:54
*** baoli has joined #openstack-neutron13:54
*** akshai has joined #openstack-neutron13:55
Eshahttps://bugs.launchpad.net/neutron/+bug/161802513:55
openstackLaunchpad bug 1618025 in neutron "MTU specified during neutron network create is not honored, always set to 1500" [Undecided,Incomplete] - Assigned to ramesram (ramesh.rayapureddi)13:55
*** vijaykc4 has quit IRC13:55
*** gongysh has quit IRC13:55
ihrachysEsha: it's calculated by neutron, you can't set it13:56
*** tonytan_brb has joined #openstack-neutron13:56
*** wolverineav has joined #openstack-neutron13:56
Eshaok, then how do we edit it?13:56
ihrachysEsha: but it will calculate it as per your config options13:56
ihrachysEsha: global_physnet_mtu and such13:56
*** baoli__ has joined #openstack-neutron13:56
ihrachysEsha: there is a separate page in user guide for MTU13:56
*** jckasper has quit IRC13:56
*** janzian has joined #openstack-neutron13:57
*** akshai has quit IRC13:57
Eshaso via neutron net-update or REST API its not possible..cause I checked the parameters and it didnt have MTU13:57
kevinbentoncarl_baldwin: would like to know your thoughts on https://review.openstack.org/#/c/369992/13:57
*** baoli_ has quit IRC13:57
Eshaneutron ipsec-site-connection-update is the only cli I could see MTU as a parameter13:58
*** ganeshnalawade has joined #openstack-neutron13:58
*** dane_leblanc has joined #openstack-neutron13:58
*** akshai has joined #openstack-neutron13:58
*** tonytan4ever has quit IRC13:58
*** yamamoto has joined #openstack-neutron13:59
*** baoli has quit IRC13:59
Eshaihrachys - Is this the reference page for MTU in Newton13:59
Eshahttp://docs.openstack.org/draft/networking-guide/config-mtu.html13:59
ihrachysEsha: yes14:00
carl_baldwinkevinbenton: will look in a few minutes14:00
ihrachysEsha: MTU is returned in network payload though14:00
*** devvesa has joined #openstack-neutron14:00
ihrachysEsha: assuming your plugin supports net-mtu API extension14:00
Eshasure, but that is a GET only? POST wont work14:01
*** akshai has quit IRC14:01
*** ramishra has quit IRC14:01
EshaSo1618025 can be closed with the doc as reference as edit of MTU is not allowed directly14:01
Eshaihrachys: Right?14:02
ihrachysEsha: yea14:03
*** mriedem has joined #openstack-neutron14:03
*** akshai has joined #openstack-neutron14:03
ihrachysEsha: we could in theory allow to request MTUs that are lower than plugin calculated14:03
ihrachysEsha: so you could look at it as a feature request14:03
ihrachysEsha: but I struggle to see why you may want to lower your MTU14:03
ihrachysEsha: maybe for some obsolete apps?14:03
*** wolverineav has quit IRC14:04
Eshayes, depending on the network config14:04
*** chandanc__ has quit IRC14:05
ihrachyskevinbenton: re https://review.openstack.org/#/c/367340/ do we insist on not reusing/not moving the code and instead hardcoding names in the sanity checks?14:05
*** jckasper has joined #openstack-neutron14:05
*** roeyc has quit IRC14:07
*** gouthamr has quit IRC14:07
kevinbentonihrachys: no, i'm okay with moving it14:07
*** ramishra has joined #openstack-neutron14:08
ihrachysarmax: can you revisit https://review.openstack.org/#/c/367340/ ? I wonder what's the course of action14:09
*** korzen has quit IRC14:09
*** claudiub has joined #openstack-neutron14:09
*** jckasper has quit IRC14:10
ihrachyskevinbenton: re https://review.openstack.org/#/c/369250/ is it just logging though?14:11
ihrachyskevinbenton: looks more like a filter not being applied because of it14:11
*** oshvartz has quit IRC14:11
ihrachyswhich would bump the importance of the bug from Low14:11
*** Leo_ has joined #openstack-neutron14:12
*** lbrune has left #openstack-neutron14:12
*** mlavalle has joined #openstack-neutron14:13
kevinbentonihrachys: i'm not sure filtering is failing to be applied14:13
kevinbentonihrachys: i think it's just tracebacks in the agent14:13
ihrachyskevinbenton: well at least first process_network_devices attempt crashes, though it will probably catch up next time because we set that True flag before trying to set the options14:14
kevinbentonihrachys: yep14:14
ihrachysok, agreed it's Low.14:14
*** jckasper has joined #openstack-neutron14:15
*** wolverineav has joined #openstack-neutron14:15
*** nmagnezi has quit IRC14:16
*** wolverineav has quit IRC14:20
*** moshele has quit IRC14:21
*** ltomasbo has quit IRC14:22
*** rajinir has joined #openstack-neutron14:23
*** trevormc has joined #openstack-neutron14:23
carl_baldwinkevinbenton: what were you saying above about "interfering with the DHCP agent" with haleyb . I feel like I'm missing some context there.14:25
*** marst has quit IRC14:26
kevinbentoncarl_baldwin: oh, when the dhcp agent serves multiple subnets on a network14:26
kevinbentoncarl_baldwin: it requests additional IPs for its existing port14:26
kevinbentoncarl_baldwin: but they are for different subnets, so i don't think that was impacted by this14:26
kevinbentoncarl_baldwin: this bug was multiple ips, same subnet14:27
carl_baldwinkevinbenton: Was there an issue that you and Brian were looking at or were you just speculating?14:27
*** jheroux has joined #openstack-neutron14:27
kevinbentoncarl_baldwin: was just speculating14:27
*** wolverineav has joined #openstack-neutron14:27
*** rubasov has quit IRC14:27
carl_baldwinkevinbenton: ah, ok14:27
*** john-davidge has quit IRC14:27
*** null0 has joined #openstack-neutron14:28
carl_baldwinkevinbenton: When I saw your revert, I knew immediately what was wrong. Wish I would have foreseen that.14:28
*** carlos__ has joined #openstack-neutron14:28
*** yamamoto has quit IRC14:28
kevinbentoncarl_baldwin: i was just surprised that we didn't have a test for it14:29
kevinbentoncarl_baldwin: luckily we have some watching users :)14:29
carl_baldwinkevinbenton: yeah, me too.14:29
*** yamamoto has joined #openstack-neutron14:29
kevinbentoncarl_baldwin: btw. i think i just realized why delete_subnet is having so much trouble14:29
*** yamamoto has quit IRC14:30
*** null0 has quit IRC14:30
kevinbentoncarl_baldwin: or at least something that will contribute a lot to it14:30
carl_baldwinkevinbenton: What are you thinking?14:30
kevinbentoncarl_baldwin: it (and delete_network) use this glorious while True loop14:30
kevinbentoncarl_baldwin: it starts a transaction each time14:30
kevinbentoncarl_baldwin: but as we've learned, if a db object is in the session, we won't get the latest data even if we query for it14:31
carl_baldwinkevinbenton: I was thinking about the same time. I noticed in the logs from yesterday that when the transaction got restarted, some of the port deletes stuck.14:31
*** shausy has quit IRC14:31
kevinbentoncarl_baldwin: about to propose a patch putting in expires14:31
carl_baldwins/time/thing/14:31
kevinbentoncarl_baldwin: this code was clearly written assuming a fresh start on each iteration14:32
*** wolverineav has quit IRC14:32
carl_baldwinkevinbenton: Oh, I see14:32
*** vijaykc4 has joined #openstack-neutron14:33
*** edand has quit IRC14:33
kevinbentoncarl_baldwin: in particular it's going to keep trying to bump a stale revision number for the network14:34
*** yamamoto has joined #openstack-neutron14:34
kevinbentoncarl_baldwin: confirming right now with some well placed pdb and mysql fiddling14:34
*** yamamoto has quit IRC14:35
carl_baldwinkevinbenton: You think that is causing excessive retries?14:35
kevinbentoncarl_baldwin: possibly14:35
*** marst has joined #openstack-neutron14:36
*** wolverineav has joined #openstack-neutron14:36
carl_baldwinI saw a lot of retries but I didn't look hard enough to know what was causing the retries.14:37
njohnstonHi, could I get a neutron infra liason to look at https://review.openstack.org/#/c/368945/ please, at your convenience?14:37
*** watanabe_isao has quit IRC14:39
*** Trident has quit IRC14:41
*** Trident has joined #openstack-neutron14:41
*** jckasper has quit IRC14:42
*** pradk has quit IRC14:42
*** rubasov has joined #openstack-neutron14:43
*** wolverineav has quit IRC14:43
*** jckasper has joined #openstack-neutron14:43
*** thiagolib has joined #openstack-neutron14:44
*** EinstCrazy has quit IRC14:44
*** wolverineav has joined #openstack-neutron14:44
*** pradk has joined #openstack-neutron14:45
*** obondarev has quit IRC14:45
*** eezhova has quit IRC14:45
kevinbentoncarl_baldwin: yep, just reproduced the failure14:46
kevinbentoncarl_baldwin: this is a bad bug14:46
kevinbenton:)14:46
kevinbentoncarl_baldwin: the network gets in the session either because of the subnet or the ports held down below14:46
*** eezhova has joined #openstack-neutron14:46
openstackgerritBrian Haley proposed openstack/neutron: Fix metering-agent iptables restore failure  https://review.openstack.org/37090214:46
kevinbentoncarl_baldwin: so if something else updates the network revision at that point, it's stuck14:47
kevinbentoncarl_baldwin: unless it's lucky enough to throw a deadlock error14:47
kevinbentoncarl_baldwin: or find a new port and throw a retryrequest14:47
kevinbentoncarl_baldwin: at which point those vars go out of scope and are garbage collected14:47
carl_baldwinkevinbenton: sounds bad14:48
openstackgerritNakul Dahiwade proposed openstack/neutron: OVO for NetworkDhcpAgentBinding  https://review.openstack.org/37045214:48
*** wolverineav has quit IRC14:48
*** akshai has quit IRC14:49
*** yb has joined #openstack-neutron14:51
*** akshai has joined #openstack-neutron14:51
*** donghao has quit IRC14:51
*** akshai has quit IRC14:51
*** wolverineav has joined #openstack-neutron14:52
*** absubram has joined #openstack-neutron14:52
*** andrey-mp has left #openstack-neutron14:53
EshaThere is a bug 1616357 https://bugs.launchpad.net/neutron/+bug/1616357 which I had opened as the response of GET/POST networks API is not getting translated and always returns english. I saw that https://github.com/openstack/neutron-lib/blob/master/neutron_lib/exceptions.py NetworkNotFound at line 115 does the translation by _.14:53
openstackLaunchpad bug 1616357 in neutron "The Error Response REST API GET/POST on networks is not translated" [Undecided,New]14:53
*** akshai has joined #openstack-neutron14:53
EshaHowever the API Response always returns English14:53
*** absubram_ has joined #openstack-neutron14:53
*** baoli has joined #openstack-neutron14:54
EshaI have updated defect with required latest info. Why is the translation already done for the message working?14:55
*** baoli__ has quit IRC14:55
Esha*not working14:55
openstackgerritPushkar Umaranikar proposed openstack/os-vif: os-vif pollute test output  https://review.openstack.org/37090814:56
*** tonytan_brb is now known as tonytan4ever14:57
*** itzkb_ has quit IRC14:57
*** tidwellr has joined #openstack-neutron14:57
*** absubram has quit IRC14:57
*** absubram_ is now known as absubram14:57
*** azbiswas has joined #openstack-neutron14:58
*** Esha has quit IRC15:02
*** Esha has joined #openstack-neutron15:02
openstackgerritAnindita Das proposed openstack/neutron: OVO for RouterL3AgentBinding  https://review.openstack.org/36090815:03
openstackgerritKevin Benton proposed openstack/neutron: Expire DB objects in ML2 infinity loops  https://review.openstack.org/37092015:04
kevinbentoncarl_baldwin: ^^15:04
*** lihi has quit IRC15:04
kevinbentonarmax: ^^~115:04
*** tri2sing has joined #openstack-neutron15:05
*** yamahata has quit IRC15:06
*** regXboi has joined #openstack-neutron15:07
*** regXboi has quit IRC15:07
*** slaweq_ has quit IRC15:07
*** baoli_ has joined #openstack-neutron15:07
*** regXboi has joined #openstack-neutron15:07
carl_baldwinkevinbenton: ack15:07
*** slaweq_ has joined #openstack-neutron15:08
*** mickeys has joined #openstack-neutron15:08
*** yb has quit IRC15:09
*** wolverineav has quit IRC15:09
ihrachysarmax:  amuller: I am puzzled by https://review.openstack.org/#/c/370918/ and related bugs15:09
ihrachyspuzzled as in 'why the heck gate passes'?15:09
armaxthat’s the first time I see this patch15:10
*** sleviim has quit IRC15:10
armaxI am as puzzled as you are15:10
*** baoli has quit IRC15:10
jlibosvaihrachys: from functional tests it seems br_netfilter is not needed15:10
* jlibosva looks for a link15:10
kevinbentonno negative security groups tests?15:10
ihrachysjlibosva: but how come if the official page for the thing says without it filtering is not avail15:11
ihrachysarmax: the patch is mine of 5 mins ago, that's not a surprise15:12
ihrachysarmax: the surprise is gate passing15:12
jlibosvaihrachys: yeah, that's weird. also the fact that module is called br_netfilter which sounds like you need it for haing netfilter on the bridge15:12
*** slaweq_ has quit IRC15:12
ihrachysjlibosva: I also found some red hat bugzilla bugs discussing that that suggest you need the module loaded15:12
beaglesihrachys: just +1'd https://review.openstack.org/#/c/368553/ - seems to do the job in my env15:13
*** Esha_ has joined #openstack-neutron15:13
ihrachysjlibosva: https://bugzilla.redhat.com/show_bug.cgi?id=1182105 that one15:13
openstackbugzilla.redhat.com bug 1182105 in systemd "sysctl.conf / sysctl.conf.d settings should be applied after bridge is added" [High,Closed: errata] - Assigned to systemd-maint15:13
jlibosvaihrachys: http://logs.openstack.org/74/363474/2/experimental/gate-neutron-dsvm-functional-ubuntu-xenial/0ee2238/testr_results.html.gz - look at test_firewall15:13
*** Esha has quit IRC15:14
ihrachysjlibosva: could it be that some firewall functionality is available irrespective of the module, it's just for SOME frames (as in "bridged IPv4/IPv6/ARP packets, even when encapsulated in an 802.1Q VLAN or PPPoE header")15:14
*** Esha_ is now known as Esha15:15
*** akamyshnikova_ has quit IRC15:15
openstackgerritAnindita Das proposed openstack/neutron: OVO for VxlanAllocation and VxlanEndpoints  https://review.openstack.org/36250815:15
*** gouthamr has joined #openstack-neutron15:15
*** brad_behle has joined #openstack-neutron15:15
armaxihrachys: btw: http://lists.openstack.org/pipermail/openstack-dev/2016-September/103779.html15:16
EshaThere is a bug 1616357 https://bugs.launchpad.net/neutron/+bug/1616357 which I had opened as the response of GET/POST networks API is not getting translated and always returns english. I saw that https://github.com/openstack/neutron-lib/blob/master/neutron_lib/exceptions.py NetworkNotFound at line 115 does the translation by _.15:16
openstackLaunchpad bug 1616357 in neutron "The Error Response REST API GET/POST on networks is not translated" [Undecided,New]15:16
EshaHowever the API Response always returns English15:16
EshaI have updated defect with required latest info. Why is the translation not working for the message NetworkNotFound15:16
Esha?15:16
*** akamyshnikova_ has joined #openstack-neutron15:17
*** gouthamr has quit IRC15:17
*** gouthamr has joined #openstack-neutron15:17
*** HoloIRCUser2 has joined #openstack-neutron15:18
ihrachysarmax: ack. I haven't tried to respin because the shape of the dashboard is not great yet.15:18
*** wolverineav has joined #openstack-neutron15:18
*** tflynn has joined #openstack-neutron15:18
armaxihrachys: good man15:18
armaxit would not be a classic RC time if we did not have a crisis15:18
*** pcaruana has quit IRC15:19
*** salv-orlando has joined #openstack-neutron15:19
ihrachysnah, it's just a crisis during RC is a special one.15:19
ihrachysyou are just used to them in other times15:19
*** andreas_s has quit IRC15:19
armaxdifferent words, same concept :)15:19
ihrachysarmax: kevinbenton also caught today nova broke MTU setup. not sure you are aware; there are patches though15:20
armaxhe mentioned15:20
armaxnot aware of the patches though15:20
ihrachyshttps://review.openstack.org/#/q/status:open+topic:bug/162387615:20
armaxI am still scratching my eyes15:20
kevinbentonihrachys: armax and i secretly communicate in parseltongue :15:20
kevinbenton:)15:20
*** jhershbe has joined #openstack-neutron15:21
ihrachysthat explains a lot15:22
*** salv-orlando has quit IRC15:22
armaxkevinbenton, ihrachys do you guys think that it might be related to bug 1623732?15:22
openstackbug 1623732 in neutron "failed: route add -net "0.0.0.0/0" gw "10.1.0.1" leads to test_network_basic_ops to fail with SSHTimeout" [Critical,Confirmed] https://launchpad.net/bugs/162373215:22
*** slaweq_ has joined #openstack-neutron15:22
ihrachysarmax: it == mtu?15:22
*** wolverineav has quit IRC15:22
kevinbentonarmax: unfortunately probably not15:22
armaxok15:23
ihrachysyeah, probably not mtu15:23
ihrachyshm, seems like the error just indicates that the same route is already set by something in the instance15:24
ihrachyswhich may be fine15:24
clarkbis that mtu issue also potentially causing all of these grenade job failures: http://logs.openstack.org/39/370639/4/check/gate-grenade-dsvm-neutron-ubuntu-trusty/4a61dcb/console.html ?15:24
ihrachysor not, if it's another default route with wrong gateway. not sure what else could set it.15:25
ihrachysclarkb: there is no known mtu *gate failure* I believe15:27
*** moshele has joined #openstack-neutron15:27
armaxihrachys, kevinbenton: do you think bug 1623876 will get a requirement freeze exception?15:27
openstackbug 1623876 in OpenStack Compute (nova) "nova is not setting the MTU provided by Neutron" [Critical,In progress] https://launchpad.net/bugs/1623876 - Assigned to Kevin Benton (kevinbenton)15:27
clarkbihrachys: ok, that grenade job is super flaky right now at least and its having trouble sshing and its single node so no weird overlays in the job infrastructure15:27
kevinbentonarmax: that's up to the nova overlords15:28
armaxok15:29
*** wolverineav has joined #openstack-neutron15:29
kevinbentonclarkb: in grenade are the agents left in the old version or is everything upgraded?15:29
ihrachysarmax: we have a backup plan with a nova only fix.15:30
clarkbkevinbenton: in that job everythign is upgraded I think. its the single node grenade job where the entire cloud is tyurned off, upgraded, then started again15:30
kevinbentonclarkb: right, and for this basic_ops test that keeps bombing it's freshly created VMs and networks15:31
kevinbentonclarkb: IIUC15:31
clarkbthat I don't know. Not sure if the resoruces are preserved through the upgrade or not15:32
*** wolverineav has quit IRC15:34
*** tflynn has quit IRC15:35
*** tflynn has joined #openstack-neutron15:35
*** yamamoto has joined #openstack-neutron15:35
pc_mkevinbenton: ping15:39
kevinbentonpc_m: pong15:39
pc_mkevinbenton: Is there info somewhere on how to update a project from using keystoneclient v2 to v3?15:40
*** tflynn has quit IRC15:40
*** nyechiel has quit IRC15:41
kevinbentonpc_m: i would check with HenryG or dasm15:41
kevinbentonpc_m: they did a lot of that for neutron15:41
pc_mkevinbenton: thanks15:41
*** jckasper has quit IRC15:42
*** yamamoto has quit IRC15:42
*** jckasper has joined #openstack-neutron15:42
*** jckasper has quit IRC15:43
*** jckasper has joined #openstack-neutron15:43
*** jckasper has quit IRC15:45
*** jckasper has joined #openstack-neutron15:46
pc_mwondering what is involved to switch.15:46
*** jckasper has quit IRC15:46
pc_mkevinbenton: Do you know what release Neutron switched to v3?15:46
dasmpc_m: this release. newton15:47
*** Esha has quit IRC15:47
*** wolverineav has joined #openstack-neutron15:47
pc_mdasm: Is there any info, on what is entailed in switching to a new client version?15:47
dasmpc_m: let me explain it.. so, initial keystone v3 work was done earlier. i don't recall the date/release, but cleanup and most of leftovers we did in this release.15:48
*** itsuugo has quit IRC15:48
dasmpc_m: could you describe your use-case? what are you trying to do?15:48
*** salv-orlando has joined #openstack-neutron15:49
pc_mdasm: have a vendor project that is using v2 of the client. I think mostly to just get the tenant ID. Wonder what is entailed in updating to v3 client.15:49
dasmpc_m: btw. kuryr is currently doing keystone v3 change15:49
*** itsuugo has joined #openstack-neutron15:49
openstackgerritCarl Baldwin proposed openstack/neutron: Raise level of message to info  https://review.openstack.org/37096415:50
pc_mdasm: If running v3 client, should we be able to call the v2 API (backward compatible)?15:50
apuimedodasm: we already merged it ;-)15:50
apuimedothanks again for the help the other day15:51
dasmapuimedo: i've seen it. congrats15:51
dasmapuimedo: pc_m is trying to do the same. rewrite v2 into v315:51
*** jckasper has joined #openstack-neutron15:52
*** wolverineav has quit IRC15:52
dasmpc_m: if you'll use v3, you will still have all features provided. you don't need to any longer get v2 info, because everything is there.15:52
apuimedodasm: for which project?15:52
dasmapuimedo: 15:48:51            pc_m | dasm: have a vendor project that is using v2 of the client.15:53
pc_mdasm: Looks like our project is using v2 API and calling keystoneclient to get tenant ID and the request is failing (404).15:53
apuimedoaha15:53
apuimedopc_m: keystoneauth is your friend15:53
apuimedo:-)15:53
apuimedoit will make it easy to keep v2+v3 compatible15:53
dasmpc_m: yes. keystoneclient is deprecated. you should use keystoneauth15:53
pc_mIs it possible that it's a change from tenant to project ID?15:53
apuimedoso your vendor can serve customers that are slow to upgrade15:53
*** obondarev has joined #openstack-neutron15:53
*** vijaykc4 has quit IRC15:54
dasmpc_m: hmm.. if you have 404, i would suggest that something is wrong with authorization.15:54
pc_mdasm: apuimedo: Cool. Where can I find info on how to switch from keystoneclient to keystoneauth?15:54
apuimedoone sec15:54
dasmpc_m: one of the sources: http://docs.openstack.org/developer/keystone/http-api.html15:54
apuimedopc_m: http://docs.openstack.org/developer/keystoneauth/migrating.html15:55
*** moshele has quit IRC15:55
apuimedothat's exactly what you want to do, probably15:55
pc_mThanks!!!15:55
dasmapuimedo: ++15:55
apuimedodepends of it is a client (this url) or a service (check how nova/neutron/kuryr do it)15:55
pc_mdasm: The 404 says "The resource could not be found." on a  get request for specific tenant ID (that exists)15:56
dasmpc_m: often, if user is unauthorized, then you'll get 404, instead of 403, to secure info about resources.15:57
apuimedoyes, that happened to me15:57
apuimedopc_m: is this a devstack env?15:58
*** iyamahat has joined #openstack-neutron15:58
*** jkraj has quit IRC15:58
pc_mdasm: It was on a working setup, where keystoneclient was updated to v3 recently.15:58
pc_mapuimedo: no, on an openstack installation.15:59
apuimedopc_m: plesae, check the endpoints15:59
apuimedoI was getting that when using the wrong url for v315:59
*** ltomasbo has joined #openstack-neutron16:00
*** thumpba has joined #openstack-neutron16:00
openstackgerritAnindita Das proposed openstack/neutron: OVO Gre Allocation Endpoints  https://review.openstack.org/36128916:00
*** abregman__ has joined #openstack-neutron16:00
*** ltomasbo has quit IRC16:00
pc_mapuimedo: So, there are 3 endpoint entries for keystone identity that are v316:00
*** abregman_ has quit IRC16:00
*** ltomasbo has joined #openstack-neutron16:00
pc_mapuimedo: But, I know that the project accessing keystoneclient is using v2_0 api16:01
*** abregman__ has quit IRC16:01
*** abregman has joined #openstack-neutron16:01
openstackgerritKevin Benton proposed openstack/neutron: Revert "Removes host file contents from DHCP agent logs"  https://review.openstack.org/37097416:02
*** nmagnezi has joined #openstack-neutron16:03
*** wolverineav has joined #openstack-neutron16:04
apuimedopc_m: do a curl in the terminal to those16:04
pc_mapuimedo: So if I call the v2 API, with a v3 client running, it'll just fail?16:04
apuimedoand do a paste.openstack.org16:04
apuimedoof what they return16:04
*** devvesa has quit IRC16:04
*** sbelous__ has joined #openstack-neutron16:04
*** sbelous__ has quit IRC16:05
pc_mapuimedo: Just did. With v2, I get 404 resource not found. With v3 I get output.16:05
*** Esha has joined #openstack-neutron16:05
carl_baldwinkevinbenton: I'm looking through those "while True" loops. They are a piece of work.16:05
sbelousdasm, hichihara, Hi. About this one https://bugs.launchpad.net/neutron/+bug/1623390 I can't to reproduce it locally :( there is only one of many test runs, that was failed with same error (http://paste.openstack.org/show/576185/ should be two Quota exceeded errors instead of three). Can't imagine what's wrong in quota management. May be, that problem is related to concurrent tasks running in rally…16:06
openstackLaunchpad bug 1623390 in neutron "Wrong calculation of quotas " [Undecided,New] - Assigned to Sergey Belous (sbelous)16:06
apuimedopc_m: and you tried the keystoneauth library with that working v3 output?16:06
*** abregman has quit IRC16:06
apuimedopc_m: can you paste the content?16:06
kevinbentoncarl_baldwin: aren't they? :)16:06
*** abregman has joined #openstack-neutron16:06
kevinbentoncarl_baldwin: i like how it takes a while to even get the control flow16:07
pc_mapuimedo: no, the project is using keystoneclient and not keystoneauth.16:07
kevinbentoncarl_baldwin: the commit and break is in the commit16:07
kevinbentoncarl_baldwin: and it's surrounded by the things that have to happen 1st16:07
*** vijaykc4 has joined #openstack-neutron16:07
kevinbentoncarl_baldwin: i like to call it the ML2 commit sandwich16:07
pc_mapuimedo: http://paste.openstack.org/show/577662/16:08
*** wolverineav has quit IRC16:08
carl_baldwinkevinbenton: "if not to_allocate: .... break (commits) ... for a in to_deallocate"16:08
carl_baldwinlol16:08
apuimedopc_m: so this is what you are using keystoneclient with "http://10.87.49.50:5000/v3/" ?16:08
pc_mapuimedo: no. that's the issue AFAICT.16:09
kevinbentoncarl_baldwin: that's due for some refactoring :)16:09
apuimedoso try with this address16:09
*** gvrangan has joined #openstack-neutron16:09
pc_mapuimedo: The project is trying to use v2 and not v3, but keystoneclient has been updated to v3.16:09
carl_baldwinkevinbenton: "This approach should be revisited when the API layer is reworked during icehouse"16:09
kevinbentonsounds about right :)16:09
carl_baldwinkevinbenton: +116:09
pc_mapuimedo: Is the API backward compatible (hoping it is)?16:10
apuimedopc_m: you mean REST?16:10
pc_mapuimedo: IOW, is it just as simple as changing v2 to v3 in the URL usage in this project?16:10
apuimedoif you have a python client that abstracts you from the REST yes16:11
apuimedoif you have a custom client...16:11
apuimedoyou are trying to talk only to keystone or it's just getting token for talking to a service like neutron?16:11
*** tmorin has quit IRC16:11
HoloIRCUser2njohnston : ping16:12
*** HoloIRCUser2 is now known as reedip-home16:12
pc_mapuimedo: It's a controller that is trying to get tenant info from keystone.16:12
apuimedopc_m: I think that part is changed16:12
kevinbentoncarl_baldwin: https://github.com/openstack/neutron/blob/master/neutron/agent/securitygroups_rpc.py#L35-L4516:12
pc_mapuimedo: It is currently using v2 in the URL, when talking to keystone.16:13
kevinbentoncarl_baldwin: speaking of old horrors16:13
carl_baldwinkevinbenton: what's not to understand there? ;)16:13
pc_mapuimedo: Wondering if it is as easy as just changing URI to have v3 instead.16:13
sdagueanyone have theories about why we might be regressing on neutron grenade job passing - http://tinyurl.com/zdpx7rh16:13
kevinbentonsdague: not yet16:13
sdagueit would be a change in the last 24 hours16:14
sdaguethat's when we start drifting up16:14
apuimedopc_m: is this a production system?16:14
apuimedootherwise just try16:14
njohnstonHoloIRCUser2: pong16:14
kevinbentonsdague: i was digging into that when i discovered the mtu issue and got distracted16:14
kevinbentonsdague: looking at it again now16:14
*** absubram has quit IRC16:14
sdaguekevinbenton: ok, cool, as long as folks are aware16:14
sdaguekevinbenton: thanks16:14
pc_mapuimedo: development. So I can give it a try. I'm hoping the returned info is the same or at least backward compatible.16:14
*** yamahata has joined #openstack-neutron16:15
pc_mapuimedo: In the future though, sounds like we should move to keystoneauth.16:15
*** obondarev has quit IRC16:16
apuimedopc_m: if possible, you should move to it right now16:16
pc_mapuimedo: Yeah, will likely make that change, as the permanent change, instead of just changing to v3.16:17
pc_mapuimedo: Thanks for the help!16:17
apuimedopc_m: you're welcome16:18
*** ivar-lazzaro has joined #openstack-neutron16:18
*** jhershbe has quit IRC16:19
*** matrohon has quit IRC16:19
dasmapuimedo: thank you for the help provided to pc_m. i was in the meeting, but i see you made some progress :)16:20
dasmpc_m | apuimedo: In the future though, sounds like we should move to keystoneauth.16:20
apuimedoI'm in a meeting and baby sitting, but was easy enough16:20
dasmpc_m: yes, it's the best possible way to be compliant with keystone16:20
dasmapuimedo: :D16:20
pc_mdasm: yeah. I'm going to hack the code to v3 URI now, and then look at using keystoneauth for the solution.16:21
dasmpc_m: ok.16:21
*** trevormc has quit IRC16:21
*** lucasagomes is now known as lucas-dinner16:24
*** rcernin has quit IRC16:26
*** fzdarsky has quit IRC16:26
*** obondarev has joined #openstack-neutron16:26
*** wolverineav has joined #openstack-neutron16:28
*** bkopilov has quit IRC16:30
*** absubram has joined #openstack-neutron16:31
*** itsuugo has quit IRC16:32
*** ltomasbo has quit IRC16:32
*** ltomasbo has joined #openstack-neutron16:32
armaxhaleyb: bug 1623958 is not happening in the gate is it?16:32
openstackbug 1623958 in neutron "Metering-agent fails to restore iptables with 'Bad argument'" [Critical,In progress] https://launchpad.net/bugs/1623958 - Assigned to Brian Haley (brian-haley)16:32
njohnstonsc68cal: Quick devstack question for you.  There are a bunch of devstack setup functions for neutron in https://github.com/openstack/neutron/tree/master/devstack/lib - can things out of tree take advantage of them?  For example in the l2_agent file is a function plugin_agent_add_l2_agent_extension, can a *-aas project use that file, or should they copy the logic to their own tree?16:32
mriedemkevinbenton: armax: i checked logstash for http://logs.openstack.org/09/368709/3/check/gate-grenade-dsvm-neutron-ubuntu-trusty/dc9b80f/logs/new/screen-q-l3.txt.gz#_2016-09-15_01_17_49_874 and it's pretty common, and not a 100% failure scenario16:33
*** itzkb_ has joined #openstack-neutron16:33
*** tflynn has joined #openstack-neutron16:33
mriedemhttps://goo.gl/wzYulq but spikes recently16:33
*** itsuugo has joined #openstack-neutron16:34
armaxmriedem: http://grafana.openstack.org/dashboard/db/neutron-failure-rate?panelId=6&fullscreen16:34
armaxwhat’s puzzling me is that it’s particularly bad with grenade runs16:34
armaxmriedem: there’s gotta be a clue in there16:34
*** jhershbe has joined #openstack-neutron16:34
*** baoli_ has quit IRC16:34
*** wolverineav has quit IRC16:35
armaxall of the grenade flavors are spiking with different gradients16:35
*** moshele has joined #openstack-neutron16:36
haleybarmax: i don't know16:37
armaxmriedem: for what I can tell those traces pertain a router that’s connecting an ipv6 private network with the external network16:39
armaxmriedem: it doesn’t seem like it might be related16:39
*** itzkb_ has quit IRC16:39
*** wolverineav has joined #openstack-neutron16:40
carl_baldwinkevinbenton: armax: anything I can help out with today?16:40
openstackgerritKevin Benton proposed openstack/neutron: Expire DB objects in ML2 infinity loops  https://review.openstack.org/37092016:40
*** gouthamr has quit IRC16:40
*** obondarev has quit IRC16:41
armaxcarl_baldwin: right now I am trying to find out the root cause of bug 162373216:41
openstackarmax: Error: Could not gather data from Launchpad for bug #1623732 (https://launchpad.net/bugs/1623732). The error has been logged16:41
kevinbentoncarl_baldwin, armax: needed to respin ^^ to fix a l3_ha referring to a relationship to a network it just deleted16:41
armaxbug 162373216:41
sc68calnjohnston: you do that at your own risk16:41
kevinbentonarmax: i wonder if this is just a different manifestation of the ovs port disappearing on us for vacation time16:41
carl_baldwinkevinbenton: ack16:42
armaxkevinbenton: at this point I am happy to entertain any possibility16:42
njohnstonsc68cal: OK, so probably better to copy the logic over I suppose, and note it's provenance.16:42
armaxI just wish we could get hold of a node from infra and see if we can repro16:42
*** tonytan4ever has quit IRC16:42
kevinbentonsc68cal: did you see mriedem secretly tried to undo our MTU work? ;)16:42
mriedemwat?!16:43
sc68calwat16:43
armaxclarkb: https://review.openstack.org/#/c/341098/ is failing with taht error, is it too late to get hold of the node?16:43
kevinbentonsc68cal: they switched to using os-vif to plug the interfaces16:43
mriedemi thought like half the os-vif core team was neutron people?16:43
kevinbentonsc68cal: which didn't have any of our nova fixes yet16:43
*** gouthamr has joined #openstack-neutron16:43
kevinbentonmriedem: no, we were banished up front for lude behavior16:43
armaxthough this is different actually16:43
clarkbarmax: I am on a phone the genral rule is its too late if the job has reported but if still running you can catch it16:43
armaxnever mind16:43
mriedemlet's just revert os-vif integration, there is still time!16:43
armaxclarkb: ack16:44
armaxthanks16:44
armaxnow I see modprobe: module virtio_blk not found in modules.dep16:44
armaxmodprobe: module virtio_net not found in modules.dep16:44
kevinbentonmriedem: nah, either johnthetubaguy's fix or the os-vif one should work16:44
armaxkevinbenton: http://logs.openstack.org/98/341098/7/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/6c4ef6c/logs/testr_results.html.gz16:44
*** yamamoto has joined #openstack-neutron16:44
*** regXboi has quit IRC16:44
armaxthis time we failed to get dhcp16:44
*** yamamoto has quit IRC16:44
sc68calsorry, tried to help with os-vif integration for mtu but the patch got bogged down in bikeshedding16:45
armaxanother one16:45
armaxin the gate16:45
armaxhttp://logs.openstack.org/09/350809/3/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/76ebe73/logs/testr_results.html.gz16:45
kevinbentonarmax: see how strange this is http://logs.openstack.org/98/341098/7/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/6c4ef6c/logs/testr_results.html.gz16:45
kevinbentonarmax: first vm got dhcp, floating ip and all16:45
kevinbentonarmax: and the other whithered on the vine16:45
mriedemkevinbenton: let's blame it on a lack of integration testing, which it looks like ihar has a fix for16:46
kevinbentonmriedem: yeah, will be nice to have something exercising that16:46
mriedemhttps://review.openstack.org/#/c/370804/16:48
*** thumpba has quit IRC16:48
*** thumpba has joined #openstack-neutron16:49
*** vhosakot has joined #openstack-neutron16:49
kevinbentonihrachys: we don't compile OVS for grenade do we16:49
*** wolverineav has quit IRC16:49
sc68calgod please don't.16:50
openstackgerritAnkur proposed openstack/neutron: Update & Consolidate Neutron Test Coverage Devref  https://review.openstack.org/37100016:50
ihrachyskevinbenton: no16:50
ihrachyskevinbenton: just functional and fullstack16:50
amullerno grenade on xenial?16:51
amulleralso uses ovs 2.5...16:51
*** Alex_Stef has quit IRC16:53
armaxkevinbenton: http://logs.openstack.org/30/370430/6/check/gate-tempest-dsvm-neutron-dvr-ubuntu-xenial/c853e94/logs/testr_results.html.gz16:54
*** thumpba has quit IRC16:54
armaxkevinbenton: that confirms your comment on the route warning being a red-herring?16:54
armaxit looks like the networking stack being set up fine16:55
armaxand the vm being able to get to metadata16:55
haleybarmax: the only way that addrt warning is valid is if the existing default route isn't pointing at the neutron router, but it is most likely a red herring16:57
armaxhaleyb: aye16:57
*** reedip-home has left #openstack-neutron16:57
*** yamahata has quit IRC16:58
*** yamahata has joined #openstack-neutron16:58
haleybihrachys: couple of questions about dhcp.filters16:59
*** fragatina has joined #openstack-neutron16:59
haleyb1) how did this happen - http://logs.openstack.org/30/370430/6/check/gate-grenade-dsvm-neutron-multinode/408dfc3/logs/etc/neutron/rootwrap.d/dhcp.filters.txt.gz16:59
*** tflynn has quit IRC16:59
*** azbiswas has quit IRC16:59
haleyban upgrade and it didn't get upgraded16:59
*** tflynn has joined #openstack-neutron17:00
*** fragatina has quit IRC17:00
*** moshele has quit IRC17:00
*** fragatina has joined #openstack-neutron17:01
haleybarmax: btw, i don't see that metering agent failure in the gate, i'm hoping the bug submitter can help a little, don't have a test env running it at the moment17:01
armaxhaleyb: ok17:01
*** azbiswas_ has joined #openstack-neutron17:01
*** nmagnezi has quit IRC17:03
*** itlinux has joined #openstack-neutron17:03
*** jhershbe has quit IRC17:03
*** Fdaisuke has quit IRC17:04
ihrachyshaleyb: I think rootwrap filters are considered config files by grenade17:05
ihrachysso you may need to copy them in grenade17:05
haleybihrachys: there is a "from-juno" directory where that is done, wondering if i need another, which would be silly17:06
*** hynekm has quit IRC17:06
ihrachyshaleyb: exactly17:06
openstackgerritNate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2  https://review.openstack.org/37027417:08
haleybguess i have a from-mitaka patch in my future :(17:08
*** tflynn has quit IRC17:08
haleybihrachys: the other question - i don't think i need to catch NoFilterMatched, as running dhcp_release6 --help as non-root shouldn't trigger that17:09
ihrachyshaleyb: but why would you call --help at all? :)17:10
*** jpena is now known as jpena|off17:10
*** s3wong has joined #openstack-neutron17:10
haleybihrachys: this is a better discussion then... i didn't want to continuously call dhcp-release6 if it's not there17:11
*** efoley_ has quit IRC17:13
ihrachyshaleyb: yeah, though we consider it a broken setup17:17
*** thumpba has joined #openstack-neutron17:17
openstackgerritNate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2  https://review.openstack.org/37027417:17
haleybihrachys: well, if it's not easily fixable how many log.info messages do we want? :)17:18
*** rossella_ has quit IRC17:18
*** rossella_ has joined #openstack-neutron17:19
*** eezhova has quit IRC17:20
*** abhiraut has joined #openstack-neutron17:21
*** abregman has quit IRC17:23
*** ganeshnalawade has quit IRC17:24
*** mbirru has joined #openstack-neutron17:25
*** carlos__ has quit IRC17:26
*** john-davidge has joined #openstack-neutron17:28
*** sambetts is now known as sambetts|afk17:30
*** mvk has quit IRC17:32
*** boden has quit IRC17:35
*** fragatina has quit IRC17:36
ihrachyshaleyb: ack. but you could capture it when it happens?17:37
*** tonytan4ever has joined #openstack-neutron17:37
*** SumitNaiksatam has joined #openstack-neutron17:38
*** obondarev has joined #openstack-neutron17:42
*** itlinux has quit IRC17:43
*** ihrachys has quit IRC17:43
*** trevormc has joined #openstack-neutron17:44
*** ltomasbo has quit IRC17:45
*** yamamoto has joined #openstack-neutron17:45
*** chandanc__ has joined #openstack-neutron17:45
*** akamyshnikova_ has quit IRC17:47
*** azbiswas_ has quit IRC17:47
openstackgerritNate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2  https://review.openstack.org/37027417:49
openstackgerritSindhu Devale proposed openstack/neutron: Integration of RouterRoute OVO  https://review.openstack.org/36707117:49
*** bana_k has joined #openstack-neutron17:50
*** yamamoto has quit IRC17:52
*** itlinux has joined #openstack-neutron17:53
*** moshele has joined #openstack-neutron17:54
*** ivar-lazzaro has quit IRC17:55
*** obondarev has quit IRC17:55
*** ivar-lazzaro has joined #openstack-neutron17:56
*** tidwellr has quit IRC17:59
*** ankur-gupta-f has quit IRC18:00
*** brad_behle has quit IRC18:01
*** ivar-lazzaro has quit IRC18:01
*** brad_behle has joined #openstack-neutron18:01
*** fragatina has joined #openstack-neutron18:04
openstackgerritKevin Benton proposed openstack/neutron: Retry setting mac address on new OVS port 10 times  https://review.openstack.org/37103218:05
*** tflynn has joined #openstack-neutron18:07
*** bana_k has quit IRC18:08
openstackgerritMerged openstack/neutron: Catch RPC errors in trunk skeleton  https://review.openstack.org/36870918:09
*** iyamahat has quit IRC18:11
*** mvk has joined #openstack-neutron18:12
*** yamahata has quit IRC18:13
dasmsbelous: just noticed info about https://bugs.launchpad.net/neutron/+bug/1623390 added extra findings.. it looks strange to me.18:16
openstackLaunchpad bug 1623390 in neutron "Wrong calculation of quotas " [Undecided,New] - Assigned to Sergey Belous (sbelous)18:16
*** vijaykc4 has quit IRC18:17
*** vijaykc4 has joined #openstack-neutron18:17
*** vijaykc4 has quit IRC18:18
mriedemdamn ihar left18:19
mriedemkevinbenton: have you looked at johnthetubaguy's workaround patch in nova for the mtu bug? https://review.openstack.org/#/c/370681/18:19
mriedemi've got a bunch of questions in there18:19
mriedemihar's test passed but that is i think only with ovs, doesn't test linuxbridge18:19
mriedemsince we don't run the lb job on d-g changes18:19
*** bana_k has joined #openstack-neutron18:21
*** s3wong has quit IRC18:21
*** rodrigods has quit IRC18:22
*** rodrigods has joined #openstack-neutron18:22
*** ivar-lazzaro has joined #openstack-neutron18:22
*** pcaruana has joined #openstack-neutron18:22
*** alraddarla_ has quit IRC18:25
*** sdake_ is now known as sdake18:26
*** iyamahat has joined #openstack-neutron18:27
dasmkevinbenton: any progress with this bug? any extra findings?18:27
kevinbentondasm: i did trace one of the failures directly to the disappearing ovs port issue18:35
kevinbentondasm: waiting for feedback on https://review.openstack.org/371032 from gate18:35
dasmkevinbenton: ack. looking, thanks18:35
*** Esha_ has joined #openstack-neutron18:35
kevinbentonmriedem: yes, i checked out his patch18:35
kevinbentonmriedem: tested locally with ovs and it seemed to be doing things sanely18:35
*** tidwellr has joined #openstack-neutron18:35
kevinbentonmriedem: haven't with linux bridge though18:36
*** Esha has quit IRC18:36
kevinbentonmriedem: can you propose a depends-on with his patch to neutron to trigger a linuxbridge run?18:36
rtheishi folks, networking-ovn gate is starting to show signs of trouble. Curious what are the critical neutron issues being worked so I can check if related18:36
*** Esha_ is now known as Esha18:36
kevinbentonrtheis: big one is grenade failures18:36
kevinbentonrtheis: failing on network_basic_ops tests18:37
mriedemkevinbenton: yup18:37
*** ivar-lazzaro has quit IRC18:37
*** moshele has quit IRC18:38
*** chandanc__ has quit IRC18:38
dasmrtheis: https://bugs.launchpad.net/neutron/+bug/162373218:39
openstackLaunchpad bug 1623732 in neutron "failed: route add -net "0.0.0.0/0" gw "10.1.0.1" leads to test_network_basic_ops to fail with SSHTimeout" [Critical,Confirmed]18:39
*** tongli has joined #openstack-neutron18:39
openstackgerritMatt Riedemann proposed openstack/neutron: DNM: Test os-vif/mtu/linuxbridge fix  https://review.openstack.org/37105118:39
mriedemkevinbenton: ^18:39
*** mkolesni has joined #openstack-neutron18:39
rtheisthanks, will take a look18:39
kevinbentonmriedem: danke18:39
mriedemgah i need to update the regex here https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L205518:41
*** itsuugo has quit IRC18:42
*** fragatina has quit IRC18:43
*** fragatina has joined #openstack-neutron18:43
*** itsuugo has joined #openstack-neutron18:44
*** yamahata has joined #openstack-neutron18:45
clarkbarmax: kevinbenton do you all still want a test instance held?18:47
armaxclarkb: that would be good18:47
clarkbI am back home now from running errands and can do that if you point out one that is goign to fail to me18:47
clarkb(I will try to keep my eyes open too)18:47
*** ivar-lazzaro has joined #openstack-neutron18:49
openstackgerritNate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2  https://review.openstack.org/37027418:49
*** abhiraut has quit IRC18:49
*** abhiraut1 has joined #openstack-neutron18:49
*** fzdarsky has joined #openstack-neutron18:51
armaxhttps://github.com/openstack/neutron/blob/master/neutron/services/trunk/drivers/openvswitch/agent/trunk_manager.py#L9618:51
armaxsorry wrong window18:52
*** baoli has joined #openstack-neutron18:52
*** dane_leblanc has quit IRC18:52
*** dane_leblanc has joined #openstack-neutron18:53
kevinbentonarmax: i suspect my fix should limp us by. check this out http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22%2C%20in%20set_address%5C%2218:54
armaxso you think the underlying issue is https://bugs.launchpad.net/neutron/+bug/1618987 all along?18:56
openstackLaunchpad bug 1618987 in neutron "test_connection_from_diff_address_scope intermittent "Cannot find device" errors" [Critical,Confirmed]18:56
kevinbentonarmax: i think so18:56
kevinbentonarmax: i suspect my dhcp may have made the dhcp agent busier18:57
kevinbentonarmax: and ovs is experiencing difficulties18:57
armaxpoor ovs18:57
kevinbentonso far my patch has passed regular grenade18:57
kevinbentonwaitng on dvr grenade18:57
kevinbentonmultinode18:58
armaxjlibosva: ^18:58
*** ivc_ has quit IRC18:59
*** fzdarsky has quit IRC18:59
*** hynekm has joined #openstack-neutron19:00
*** john-davidge has quit IRC19:01
*** absubram has quit IRC19:01
*** hynekm has quit IRC19:01
*** ankur-gupta-f has joined #openstack-neutron19:02
dasmkevinbenton: one thing about your patch: https://review.openstack.org/#/c/371032/1/neutron/agent/linux/interface.py if you'll respin, could you add extra info to Exception and comment, regarding bug number?19:03
*** ijw has joined #openstack-neutron19:03
dasmkevinbenton: just, for future reference (or simpler debugging)19:03
kevinbentondasm: will do, waiting for results and then respin with new commit19:03
dasmkevinbenton: sure, understandable.19:03
dasmzuul, so far, so good.19:04
*** azbiswas has joined #openstack-neutron19:04
*** baojg has quit IRC19:05
*** eezhova has joined #openstack-neutron19:05
*** baojg has joined #openstack-neutron19:05
kevinbentondasm, armax: got passes on all voting grenade jobs. going to respin so we get another run started19:06
armaxkevinbenton: ack19:06
openstackgerritKevin Benton proposed openstack/neutron: Retry setting mac address on new OVS port 10 times  https://review.openstack.org/37103219:07
armaxtalking to jlibosva, it looks like the port glitch may cause the metadata proxy to be spawned19:07
*** krtaylor has quit IRC19:07
armaxthat would explain why this happens on grenade more often19:07
*** salv-orlando has quit IRC19:07
*** matrohon has joined #openstack-neutron19:07
armaxas grenade is the only job that still uses metadata19:07
armaxclarkb: ^ correct?19:07
*** abregman has joined #openstack-neutron19:08
armaxkevinbenton: errata corrige: may cause the metadata proxy failing to spawn19:08
kevinbentonarmax: grenade may be more contentious for ovs as well, since the agents are starting with pre-existing resources server side that they wire up very quickly19:09
*** akshai has quit IRC19:09
rtheisnetworking-ovn is seeing key errors on "ERROR neutron.agent.dhcp.agent     subnet_dhcp_ip = subnet_to_interface_ip[subnet.id]"19:09
rtheisis this a known issue?19:09
openstackgerritNate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2  https://review.openstack.org/37027419:09
armaxrtheis: probably caused by kevinbenton’s attempt to break dhcp for good19:10
rtheis:)19:10
armaxrtheis: this one went in recently https://review.openstack.org/#/c/355117/19:10
armaxI am surprsied those are seen on the ovn gate only thought19:11
clarkbarmax: that sounds right? I think we also use it in the live migration jobs too19:11
*** akshai has joined #openstack-neutron19:11
armaxclarkb: ack19:11
*** fzdarsky has joined #openstack-neutron19:11
kevinbentonrtheis: looks like it's been lurking for a while http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22subnet_dhcp_ip%20%3D%20subnet_to_interface_ip%5Bsubnet.id%5D%5C%2219:11
kevinbentonrtheis: is it causing failures?19:12
*** john-davidge has joined #openstack-neutron19:12
rtheiskevinbenton: not entirely sure yet19:12
kevinbentonrtheis: it should get a fix either way19:12
rtheisnetworking-ovn native services job appears to run fine19:12
openstackgerritAnkur proposed openstack/neutron: Update & Consolidate Neutron Test Coverage Devref  https://review.openstack.org/37100019:12
rtheisrunning neutron agents is were we are failing various tempest tests19:13
rtheisstill looking into it ...19:13
*** rkukura_ has joined #openstack-neutron19:14
kevinbentonrtheis: yeah, i see a bad assumption in there19:15
kevinbentonrtheis: that leads to that keyerror19:16
*** rkukura has quit IRC19:16
*** rkukura_ is now known as rkukura19:16
*** fragatina has quit IRC19:17
*** fragatina has joined #openstack-neutron19:18
*** john-davidge has quit IRC19:19
*** fragatina has quit IRC19:19
*** fragatina has joined #openstack-neutron19:19
*** john-davidge has joined #openstack-neutron19:19
*** boden has joined #openstack-neutron19:20
*** abregman has quit IRC19:21
*** fzdarsky has quit IRC19:22
*** mhickey has joined #openstack-neutron19:23
openstackgerritBrian Haley proposed openstack/neutron: Fix dhcp_release6 error when not supported  https://review.openstack.org/36629119:23
*** john-davidge has quit IRC19:23
*** ametts has joined #openstack-neutron19:26
kevinbentonrtheis: well can you file a bug for that keyerror?19:26
rtheiskevinbenton: I will.  Sorry, busy with another meeting19:27
rtheisdoing it now19:27
kevinbentonrtheis: oh, no worries19:27
kevinbentonrtheis: i didn't mean to make it sound like i was waiting19:27
rtheisnp19:28
kevinbentonrtheis: that was the sound of me realizing it wasn't as obvious as i hoped19:28
amullerotherwiseguy: https://review.openstack.org/#/c/371032/19:29
*** ivar-lazzaro has quit IRC19:29
otherwiseguyamuller: see it. I'm thinking that the underlying issue is eventlet + ovsdb native = badness since my initial test script didn't catch it and it only seems to happen with l3 stuff and not ovs agent.19:30
amulleruhum19:30
otherwiseguynaively modifying my test script to use eventlet pools caused the same kind of error, but I need to modify the script to be slightly less dumb to be sure.19:31
otherwiseguyin process.19:31
otherwiseguykevinbenton: ^19:31
rtheiskevinbenton: https://bugs.launchpad.net/neutron/+bug/162407919:31
openstackLaunchpad bug 1624079 in neutron "KeyError on "subnet_dhcp_ip = subnet_to_interface_ip[subnet.id]"" [Undecided,New]19:31
*** aswadr_ has quit IRC19:32
*** fragatina has quit IRC19:32
*** pcaruana has quit IRC19:32
openstackgerritKevin Benton proposed openstack/neutron: Expire DB objects in ML2 infinity loops  https://review.openstack.org/37092019:32
kevinbentoncarl_baldwin: addressed comments ^19:33
kevinbentonrtheis: thx19:33
*** davidlenwell has quit IRC19:34
kevinbentonotherwiseguy: do you think it could be from the multiple ovsdb connections from the different agents?19:34
*** Esha has quit IRC19:34
kevinbentonotherwiseguy: i.e. in your test script do you have two processes doing bad evil?19:34
*** fzdarsky has joined #openstack-neutron19:34
kevinbentonotherwiseguy: (in case you want more logs to look at. 500 occurences over 7 days http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22%2C%20in%20set_address%5C%22)19:37
openstackgerritBrian Haley proposed openstack/neutron: Fix metering-agent iptables restore failure  https://review.openstack.org/37090219:37
*** donghao has joined #openstack-neutron19:38
*** tongli has quit IRC19:38
*** fragatina has joined #openstack-neutron19:38
*** donghao has quit IRC19:39
*** itlinux has quit IRC19:39
*** fragatin_ has joined #openstack-neutron19:40
*** fragatina has quit IRC19:40
*** jprovazn has quit IRC19:40
*** david-lyle has quit IRC19:40
*** david-lyle has joined #openstack-neutron19:40
kevinbentonHenryG: around?19:42
*** fragatin_ has quit IRC19:44
*** korzen has joined #openstack-neutron19:45
*** davidlenwell has joined #openstack-neutron19:47
*** ivar-lazzaro has joined #openstack-neutron19:48
*** itlinux has joined #openstack-neutron19:48
*** fzdarsky_ has joined #openstack-neutron19:48
*** sdake has quit IRC19:49
*** sdake_ has joined #openstack-neutron19:49
*** fzdarsky has quit IRC19:49
otherwiseguykevinbenton: ugly script that seems to recreate the issue for me: http://paste.fedoraproject.org/428631/69109147/19:52
*** rcernin has joined #openstack-neutron19:53
otherwiseguy(it could be much smaller, but has a bunch of stuff from trying to figure out wtf was going on)19:53
*** itsuugo has quit IRC19:53
*** itsuugo has joined #openstack-neutron19:55
openstackgerritSindhu Devale proposed openstack/neutron: Integration of FlatAllocation OVO  https://review.openstack.org/36849919:55
*** baoli has quit IRC19:56
*** manjeets__ has joined #openstack-neutron19:56
*** baoli has joined #openstack-neutron19:56
*** krtaylor has joined #openstack-neutron19:56
kevinbentonotherwiseguy: cool19:59
*** ametts has quit IRC20:01
*** fragatina has joined #openstack-neutron20:01
openstackgerritSindhu Devale proposed openstack/neutron: Integration of FlatAllocation OVO  https://review.openstack.org/36849920:04
*** fragatina has quit IRC20:05
rtheiskevinbenton: some of the networking-ovn gate failures are related to vif binding timeout.  The logs show OVN reporting the port up and then networking-ovn marking the provisioning status complete but that doesn't make its way to nova.20:05
*** mhickey has quit IRC20:06
openstackgerritArmando Migliaccio proposed openstack/neutron: Add metadata router_update handler  https://review.openstack.org/37108520:07
armaxkevinbenton, carl_baldwin: ^ some WIP to amuller on20:07
armax:)20:07
armaxjlibosva: ^20:07
armaxmull over I mean20:07
amullerarmax: I don't understand... if process_router fails mid-way, a bunch of stuff won't work, including spawning the metadata proxy20:08
armaxcorrect20:08
amullerwhy do we want to handle that particular thing20:08
armaxbut then a router update may come along, which might sanitize things20:09
armaxand yet the metadata proxy is forgotten20:09
armaxbecause there’s no update callback for it20:09
amullergotcha20:09
amullerI agree we need to able to recover in subsequent updates20:09
*** absubram has joined #openstack-neutron20:09
armaxhttp://logs.openstack.org/24/369824/1/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/4df9eb1/logs/new/screen-q-l3.txt.gz?#_2016-09-15_17_39_48_40820:10
*** mkolesni has quit IRC20:10
*** gvrangan has quit IRC20:10
*** fragatina has joined #openstack-neutron20:10
armaxmy patch surely is not perfect now, don’t get me wrong20:10
amullerso when it encounters an error it resyncs the router but doesn't spawn the proxy?20:10
armaxbut i can see here the router create fails20:10
armaxhttp://logs.openstack.org/24/369824/1/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/4df9eb1/logs/new/screen-q-l3.txt.gz?#_2016-09-15_17_39_48_41120:10
armaxthere’s no resync afaik20:10
armaxhttp://logs.openstack.org/24/369824/1/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/4df9eb1/logs/new/screen-q-l3.txt.gz?#_2016-09-15_17_39_48_41420:10
armaxbut an update straight away20:11
*** ijw has quit IRC20:11
*** ijw has joined #openstack-neutron20:11
armaxcould be that by the time the resync is processed the router might be gone already?20:12
*** korzen has quit IRC20:12
*** iranzo has quit IRC20:12
amullercould be20:12
amullerI would expect a resync on a failure to config a router interface20:12
amullerlooking at the log20:13
*** itlinux has quit IRC20:13
armaxamuller: yeah, still going through the log20:13
*** ametts has joined #openstack-neutron20:13
amullerarmax: do you see that the next 'update' has a priority of 1?20:14
amullerarmax: that's code for PRIORITY_SYNC_ROUTERS_TASK20:14
*** fragatina has quit IRC20:15
armaxI do now yeah20:15
amullerso yeah it resyncs20:15
armaxsure20:16
*** ijw has quit IRC20:16
armaxbut does that lead to a process_router_created call?20:16
amullerno I don't think so20:17
armaxI see it being processed in http://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n47120:17
armaxperhaps the problem lies here:20:18
armaxhttp://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n44220:18
armaxwe fail here:20:19
armaxhttp://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n45120:19
armaxwe should probably catch the exception, remove the router from the dict and reraise?20:19
armaxbut that’s probably more awkward20:19
armaxwe fail at line 45120:19
armaxand thus the created event is not emitted20:19
amulleryou may be right, if we fail to add a router initially we should delete all traces of it20:19
armaxamuller: now on resync20:20
amullerso it's considered a "new" router on resync20:20
armaxwe go in the update branch20:20
amullerright20:20
amullerthat's the issue, you're right20:20
armaxthus the clusterfudge20:20
armaxamuller: dunno20:20
armaxtell me what’s best20:20
armaxcarl_baldwin: ^20:20
* carl_baldwin reading back...20:20
armaxthe router should be removed though20:21
armaxhttp://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n51520:21
armaxunless things interleave?20:21
armaxah20:22
openstackgerritNate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2  https://review.openstack.org/37027420:22
armaxhttp://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n51620:23
armaxwe go in this block of the except20:23
armaxamuller: thus we don’t remove the router from the dict20:23
amullerarmax: there's a function called _resync_router20:23
amullerarmax: that should also delete the local cached copy of the router20:23
armaxamuller: it doesn’t as far as I can tell20:23
armaxI mean20:24
amullerit should be patched to so do :)20:24
amullerdo so*20:24
armaxthe router is not removed from self.router_info20:24
armaxif we fail badly here20:24
armaxhttp://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n50820:24
openstackgerritOpenStack Proposal Bot proposed openstack/os-vif: Updated from global requirements  https://review.openstack.org/37111620:24
*** tbachman has quit IRC20:25
openstackgerritOpenStack Proposal Bot proposed openstack/python-neutronclient: Updated from global requirements  https://review.openstack.org/37112420:26
armaxnot sure what’s the best course of action here20:26
armaxamuller: I could see that we’d want to do a safe remove unconditionally here?20:27
armaxhttp://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n50920:27
amullera patch specifically for the metadata proxy leaves us open to other, similar issues where the router is not considered "new" on resync20:27
armaxamuller: I’ll let this simmer for a bit20:27
amullerso I would go for a more general fix20:27
armaxthat’s probably outside my area of comfort20:27
armaxand time I could spend on this20:27
*** jckasper has quit IRC20:28
armaxI leave this in the capable hands of the L3 team20:28
*** abregman has joined #openstack-neutron20:28
armaxcarl_baldwin: ^20:28
*** jckasper has joined #openstack-neutron20:28
carl_baldwinarmax: Let me pull up the log and see the error.20:29
*** fragatina has joined #openstack-neutron20:29
*** ivar-laz_ has joined #openstack-neutron20:29
*** jlibosva has quit IRC20:30
armaxamuller: so ideally we’d have a two pronged appraoch20:30
armaxkevinbenton’s stop-gap20:30
armaxhttps://review.openstack.org/#/c/371032/20:30
armaxand a variant of https://review.openstack.org/#/c/371085/20:30
armaxamuller: do you concur?20:30
amullercarl_baldwin: A summary would be that there's an issue when configuring a router interface during process_router, the agent catches the exception and resyncs the router. When it configures it again everything succeeds. However, the metadata proxy is not spawned. This is because when the agent resyncs a router it doesn't consider it a "new" router (it already exists in self.router_info), and the metadata proxy is20:31
amullerspawned only for new routers.20:31
amullerarmax: agreed it's two totally different bugs20:31
armaxsame root cause though20:31
amulleryup20:31
amullerwell20:31
amullersame reproducer :)20:31
*** ivar-lazzaro has quit IRC20:32
armaxcarl_baldwin: so my half-assed fix is trying to addind an update listener on the metadata20:32
armaxand leave the existing l3 agent logic untouched20:32
*** jckasper has quit IRC20:32
carl_baldwinGive me a few minutes. Have to talk to someone at my desk. ....20:32
amulleran alternative approach armax and I discussed is for the agent to consider resynced routers as "new" routers20:33
*** ijw has joined #openstack-neutron20:33
*** abregman has quit IRC20:33
amullerto prevent similar issues in the future20:33
openstackgerritManjeet Singh Bhatia proposed openstack/neutron: Introduce OVO for quotas  https://review.openstack.org/33862520:33
armaxamuller: perhaps we should always assume new routers every time we face an error20:34
amullerright20:34
armaxthough I am not sure why it was done the way it has20:34
amullerit also means that the "new routers" code path needs to be idempotent to resources already on the system20:34
armaxhence I was hesitant to touch the existing error handling l3 agent side20:34
*** zzzeek has quit IRC20:35
armaxI figured an update callback on the metadata proxy was a nice addition either way20:35
armaxand it has far fewer remifications20:35
armaxramifications*20:35
rtheisI believe that DHCP or a retry mechanism is marking port provisioning complete prematurely20:35
*** ranjithd has quit IRC20:36
rtheisOVN marks that port down yet something is indicating that it is up20:36
openstackgerritShashank Kumar Shankar proposed openstack/neutron: Integration of OVO Provisioning Block  https://review.openstack.org/36130320:37
*** fzdarsky_ has quit IRC20:37
*** ijw has quit IRC20:38
*** jckasper has joined #openstack-neutron20:38
*** jckasper has quit IRC20:38
*** jckasper has joined #openstack-neutron20:39
*** ranjithd has joined #openstack-neutron20:39
*** zzzeek has joined #openstack-neutron20:39
*** eezhova has quit IRC20:39
*** wolverineav has joined #openstack-neutron20:40
*** baoli has quit IRC20:41
*** baoli has joined #openstack-neutron20:41
*** ametts has quit IRC20:42
armaxamuller, carl_baldwin: I posted a comment here: https://bugs.launchpad.net/neutron/+bug/1623732/comments/1420:43
openstackLaunchpad bug 1623732 in neutron "test_network_basic_ops to fail with SSHTimeout" [Critical,In progress] - Assigned to Armando Migliaccio (armando-migliaccio)20:43
armaxI’ll be afk for a bit20:43
*** jckasper has quit IRC20:43
openstackgerritNate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2  https://review.openstack.org/37027420:44
openstackgerritAnindita Das proposed openstack/neutron: OVO Gre Allocation Endpoints  https://review.openstack.org/36128920:46
*** itsuugo has quit IRC20:47
*** itsuugo has joined #openstack-neutron20:50
*** baoli has quit IRC20:53
*** ijw has joined #openstack-neutron20:53
*** akshai has quit IRC20:54
*** gouthamr has quit IRC20:54
*** baoli has joined #openstack-neutron20:55
* carl_baldwin back20:56
carl_baldwinarmax: amuller: sorry for the interruption.20:57
*** nherciu has quit IRC20:57
openstackgerritMerged openstack/neutron-lib: Updated from global requirements  https://review.openstack.org/36811920:57
*** s3wong has joined #openstack-neutron20:58
*** ijw has quit IRC20:58
*** wolverineav has quit IRC20:58
*** thumpba has quit IRC20:59
*** thumpba has joined #openstack-neutron20:59
openstackgerritBrian Haley proposed openstack/neutron: Fix dhcp_release6 error when not supported  https://review.openstack.org/36629121:00
*** gvrangan has joined #openstack-neutron21:00
*** zkassab_ has quit IRC21:00
carl_baldwinarmax: I'm not sure yet what the best thing to do is. Maybe it is a combination of things.21:01
carl_baldwinarmax: On one hand, avoiding the failure in the first place would be ideal. I think this is what kevinbenton is after, right?21:02
openstackgerritAradhana Singh proposed openstack/neutron: OVO for Tag  https://review.openstack.org/35682521:03
carl_baldwinarmax: On the other hand, when/if there are failures in creating a router, it seems right to tear the router down and try again.21:04
*** cbouch has quit IRC21:04
*** banix has quit IRC21:05
*** matrohon has quit IRC21:05
carl_baldwinBut, at that point, how do we know what kind of retry will result in success the next time? Can we just try again assuming its an intermittent failure like this one? Or, should we kick it back to the scheduler to try on another host?21:05
carl_baldwinarmax: Then, there's your proposed fix. If we're in the middle of an update and we notice the metadata service is not running, why not restart it?21:06
*** ivc_ has joined #openstack-neutron21:07
carl_baldwinarmax: The L3, as far as I remember, has always worked in a "whatever isn't right, fix it" kind of mentality.21:08
*** gouthamr has joined #openstack-neutron21:09
openstackgerritKevin Benton proposed openstack/neutron: Retry setting mac address on new OVS port 10 times  https://review.openstack.org/37103221:09
*** ijw has joined #openstack-neutron21:09
*** gvrangan_ has joined #openstack-neutron21:09
*** thumpba has quit IRC21:10
*** akshai has joined #openstack-neutron21:10
*** salv-orlando has joined #openstack-neutron21:11
*** gvrangan has quit IRC21:11
openstackgerritNate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2  https://review.openstack.org/37027421:13
*** ivar-laz_ has quit IRC21:13
*** ivar-lazzaro has joined #openstack-neutron21:13
amullercarl_baldwin: we already do retries though... we grab the information fresh from the server and try to configure it again21:14
amullercarl_baldwin: seems correct to treat the router as new in the resync21:15
*** catintheroof has joined #openstack-neutron21:15
amullercarl_baldwin: it's possibly not a trivial change though to get it right21:15
*** ivar-lazzaro has quit IRC21:15
*** krtaylor has quit IRC21:17
*** salv-orlando has quit IRC21:18
*** rossella_ has quit IRC21:18
carl_baldwinamuller: I know we do a retry treating it as an update. Since the original new router processing didn't succeed it doesn't make sense to treat it as an update.21:18
*** absubram has quit IRC21:19
carl_baldwinamuller: But, if it failed, should it be torn down until the retry or just left there hobbling along.21:19
*** rossella_ has joined #openstack-neutron21:19
amullercarl_baldwin: if you get errors during the cleanup?21:20
amullerI don't see the point in a clean up21:20
amullerthe agent is designed for operations to be idempotent21:20
carl_baldwinamuller: Then we don't need to differentiate between add and update.21:21
openstackgerritKevin Benton proposed openstack/neutron: Don't raise RetryRequest for port in delete_subnet  https://review.openstack.org/37050821:21
*** salv-orlando has joined #openstack-neutron21:22
amullercarl_baldwin: that would be simpler21:22
amulleralso a huge change21:22
amullerin code, not in functionality21:22
armaxcarl_baldwin: the problem is that the metadata proxy is setup at all21:24
*** janzian has quit IRC21:24
armax*is not21:24
*** absubram has joined #openstack-neutron21:24
armaxbecause during a resync the router is processed as if it were updated21:24
armaxand the metadata driver does not handle update events21:25
*** gvrangan_ has quit IRC21:25
*** ijw has quit IRC21:25
armaxmetadata proxy life cycle is delegated to the metadata driver21:25
*** banix has joined #openstack-neutron21:26
armaxI think the crux of the matter is this piece of code21:27
armaxhttp://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n50921:27
armaxfor random exceptions we’re leaving the router in router_info21:27
armaxand thus on resync we treat the recovery by means of an update21:28
openstackgerritAradhana Singh proposed openstack/neutron: [WIP] Integration for Tag OVO  https://review.openstack.org/36972021:28
*** adriant has joined #openstack-neutron21:28
carl_baldwinarmax: I understand that.21:28
armaxand that does not make metadata proxy recover21:28
armaxcarl_baldwin: ok21:29
carl_baldwinarmax: Hence your proposal to add a router_update handler.21:29
carl_baldwinarmax: I'm just thinking through it.21:29
armaxcarl_baldwin: understood21:29
armaxcarl_baldwin: :)21:30
carl_baldwinarmax: I think some variation on your patch (with varnish and polish) would be fine.21:30
armaxcarl_baldwin: I need to go to the store and get some though21:31
carl_baldwinarmax: I was just thinking about if there is some better long-term fix.21:31
armaxcarl_baldwin: I think so too21:31
armaxcarl_baldwin: my mindset right now is the last impactful fix for RC21:32
armaxcarl_baldwin: but kevinbenton’s might as well be a decent stop gap21:32
armaxthough I don’t like the idea of leaving a hole in the l3 logic because we may fail for whatever other reason21:32
*** rvasilets___ has joined #openstack-neutron21:32
carl_baldwinarmax: my thoughts exactly. We should fix that shy port syndrome failure21:33
openstackgerritArmando Migliaccio proposed openstack/neutron: Add metadata router_update handler  https://review.openstack.org/37108521:33
armaxcarl_baldwin: would you still want to proceed with ^ in time for RC?21:34
openstackgerritSindhu Devale proposed openstack/neutron: Relocate router route DB model  https://review.openstack.org/35479721:34
openstackgerritSindhu Devale proposed openstack/neutron: OVO for Router Route  https://review.openstack.org/35622321:34
armaxclarkb: btw I think we have a lead on bug 162373221:35
openstackbug 1623732 in neutron "test_network_basic_ops to fail with SSHTimeout" [Critical,In progress] https://launchpad.net/bugs/1623732 - Assigned to Armando Migliaccio (armando-migliaccio)21:35
armaxclarkb: I think we don’t need access to a faulty run21:35
carl_baldwinarmax: I think we should proceed even of not in time for rc121:35
carl_baldwinI think update should probably do anything add does. Hence my suggestion that maybe they shouldn't be different.21:37
armaxcarl_baldwin: indeed they hardly are21:37
*** janzian has joined #openstack-neutron21:37
armaxhttps://review.openstack.org/#/c/371085/2/neutron/agent/metadata/driver.py@16921:37
armaxcarl_baldwin: I was not 100% sure if calling the created handler on update too21:38
armaxcarl_baldwin: it felt a bit naughty21:38
openstackgerritNakul Dahiwade proposed openstack/neutron-lib: api-ref: Fix api-ref for subnetpools  https://review.openstack.org/37117221:38
carl_baldwinYeah, I see where you're coming from21:38
carl_baldwinkevinbenton: have you had much rally mileage on https://review.openstack.org/#/c/370920/ ?21:42
kevinbentonyeah, it did quite a bit better on the one runi tried. there were some errors solved by the other fix i sent to the gate21:44
kevinbentonthen you're bug :)21:44
kevinbentonyour*21:44
*** xagent has joined #openstack-neutron21:44
*** boden has quit IRC21:44
*** karad has quit IRC21:44
*** vaidy has quit IRC21:45
*** 1JTAAIELL has quit IRC21:45
*** scottda has quit IRC21:45
*** sweston has quit IRC21:45
*** adam_g has quit IRC21:45
*** knikolla has quit IRC21:45
*** kuromagi^ has joined #openstack-neutron21:46
*** wasmum has quit IRC21:46
*** quade has quit IRC21:46
*** banix has quit IRC21:46
*** kuromagi has quit IRC21:46
*** cargonza has quit IRC21:46
*** puck has quit IRC21:46
*** rm_work has quit IRC21:46
*** jamielennox has quit IRC21:46
*** mhayden has quit IRC21:46
*** amit213 has quit IRC21:47
*** dkehn has quit IRC21:47
*** gus has quit IRC21:47
*** mrhillsman has quit IRC21:47
*** vkmc has quit IRC21:47
*** pradk has quit IRC21:48
*** gus has joined #openstack-neutron21:48
*** scottda has joined #openstack-neutron21:49
*** sweston has joined #openstack-neutron21:49
*** wolverineav has joined #openstack-neutron21:50
*** saisrikiran has joined #openstack-neutron21:51
*** adam_g has joined #openstack-neutron21:51
*** adam_g has quit IRC21:51
*** adam_g has joined #openstack-neutron21:51
*** puck has joined #openstack-neutron21:51
*** amit213 has joined #openstack-neutron21:51
*** rm_work has joined #openstack-neutron21:51
*** cargonza has joined #openstack-neutron21:52
*** ijw has joined #openstack-neutron21:52
*** knikolla has joined #openstack-neutron21:52
*** vaidy has joined #openstack-neutron21:52
*** wasmum has joined #openstack-neutron21:54
*** wolverineav has quit IRC21:55
*** jheroux has quit IRC21:57
*** ivar-lazzaro has joined #openstack-neutron21:57
*** vkmc has joined #openstack-neutron21:57
*** mriedem has quit IRC21:58
*** gvrangan has joined #openstack-neutron21:59
*** quade has joined #openstack-neutron21:59
*** dkehn has joined #openstack-neutron21:59
*** mrhillsman has joined #openstack-neutron22:00
*** mhayden has joined #openstack-neutron22:00
*** jamielennox has joined #openstack-neutron22:01
njohnstondrivers meeting?22:01
dougwigNot today22:02
njohnstonok, cool22:02
*** absubram has quit IRC22:02
dougwigOnwards to rc122:02
*** yamamoto has joined #openstack-neutron22:02
*** akshai has quit IRC22:02
*** yamamoto has quit IRC22:02
*** rtheis has quit IRC22:03
*** xagent has quit IRC22:03
*** krtaylor has joined #openstack-neutron22:04
*** kbringard has quit IRC22:05
*** cleong has quit IRC22:05
openstackgerritAssaf Muller proposed openstack/neutron: Add fullstack test with OVS arp_responder  https://review.openstack.org/37118322:05
*** absubram has joined #openstack-neutron22:08
openstackgerritAssaf Muller proposed openstack/neutron: Add fullstack test with OVS arp_responder  https://review.openstack.org/37118322:08
*** amuller has quit IRC22:08
*** abhiraut1 has quit IRC22:11
*** yamamoto has joined #openstack-neutron22:13
openstackgerritArmando Migliaccio proposed openstack/neutron: Add metadata router_update handler  https://review.openstack.org/37108522:14
*** edmondsw has quit IRC22:14
*** itsuugo has quit IRC22:15
*** itsuugo has joined #openstack-neutron22:17
armaxhaleyb: ping22:18
*** yamamoto has quit IRC22:18
*** jkraj has joined #openstack-neutron22:19
*** ijw has quit IRC22:19
*** vhosakot has quit IRC22:20
*** ijw has joined #openstack-neutron22:22
*** marst has quit IRC22:22
*** marst has joined #openstack-neutron22:23
*** absubram has quit IRC22:23
*** absubram has joined #openstack-neutron22:23
*** yamamoto has joined #openstack-neutron22:24
*** yamamoto has quit IRC22:24
*** yamamoto has joined #openstack-neutron22:24
*** marst has quit IRC22:26
*** tonytan4ever has quit IRC22:27
*** abhiraut has joined #openstack-neutron22:27
*** yamamoto has quit IRC22:28
*** salv-orlando has quit IRC22:32
*** iyamahat_ has joined #openstack-neutron22:34
*** iyamahat has quit IRC22:34
*** itsuugo has quit IRC22:34
*** azbiswas has quit IRC22:35
*** azbiswas has joined #openstack-neutron22:35
*** itsuugo has joined #openstack-neutron22:37
*** azbiswas has quit IRC22:40
*** thumpba has joined #openstack-neutron22:41
*** marst has joined #openstack-neutron22:41
*** itsuugo has quit IRC22:41
*** brad_behle has quit IRC22:42
*** brad_behle has joined #openstack-neutron22:42
*** itsuugo has joined #openstack-neutron22:42
*** mriedem has joined #openstack-neutron22:44
carl_baldwinkevinbenton: I don't quite understand.22:44
*** SKipp has joined #openstack-neutron22:45
*** salv-orlando has joined #openstack-neutron22:46
*** brad_behle has quit IRC22:46
*** baojg_ has joined #openstack-neutron22:47
*** baoli has quit IRC22:48
*** iyamahat_ has quit IRC22:49
*** yamahata has quit IRC22:49
*** baojg has quit IRC22:49
*** ijw has quit IRC22:50
*** sdague has quit IRC22:52
*** manjeets__ has quit IRC22:53
carl_baldwinkevinbenton: what did better than what?22:55
*** jamesdenton has quit IRC22:56
*** banix has joined #openstack-neutron22:56
*** absubram has quit IRC22:59
*** absubram has joined #openstack-neutron23:03
*** claudiub has quit IRC23:06
*** itsuugo has quit IRC23:08
*** tidwellr has quit IRC23:09
*** itsuugo has joined #openstack-neutron23:09
*** ijw has joined #openstack-neutron23:11
kevinbentoncarl_baldwin: with the expire calls in there23:11
kevinbentoncarl_baldwin: there were much fewer failures23:11
*** banix has quit IRC23:12
openstackgerritManjeet Singh Bhatia proposed openstack/neutron: WIP QUOTA OVO implementation  https://review.openstack.org/37121223:12
*** jkraj has quit IRC23:13
*** ijw has quit IRC23:16
carl_baldwinkevinbenton: I think I'm okay doing this. I've been trying to think of any downside. The only one I can think of is more DB round-trips.23:16
*** liuyulong_ has joined #openstack-neutron23:16
*** Leo_ has quit IRC23:17
*** pmannidi has joined #openstack-neutron23:17
*** catintheroof has quit IRC23:21
*** ivar-laz_ has joined #openstack-neutron23:21
*** itsuugo has quit IRC23:23
*** itsuugo has joined #openstack-neutron23:24
*** ivar-lazzaro has quit IRC23:25
openstackgerritArmando Migliaccio proposed openstack/neutron: Add metadata router_update handler  https://review.openstack.org/37108523:25
*** banix has joined #openstack-neutron23:28
*** lujinluo has joined #openstack-neutron23:30
*** thumpba has quit IRC23:30
*** SKipp has quit IRC23:30
*** trevormc has quit IRC23:31
*** itsuugo has quit IRC23:35
*** itsuugo has joined #openstack-neutron23:37
*** armax has quit IRC23:37
*** hoonetorg has quit IRC23:37
*** rvasilets___ has quit IRC23:37
*** markvoelker has quit IRC23:39
*** Jeffrey4l__ is now known as Jeffrey4l23:40
*** karad has joined #openstack-neutron23:41
*** djan has joined #openstack-neutron23:42
*** rmcall has quit IRC23:47
*** itsuugo has quit IRC23:49
*** ijw has joined #openstack-neutron23:50
*** itsuugo has joined #openstack-neutron23:51
*** tri2sing has quit IRC23:53
*** armax has joined #openstack-neutron23:54
*** hoonetorg has joined #openstack-neutron23:55
*** thumpba has joined #openstack-neutron23:57
*** yamamoto_ has joined #openstack-neutron23:58
*** ijw has quit IRC23:58
*** yb has joined #openstack-neutron23:58
*** banix has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!