Friday, 2015-08-14

HenryGGood morning yushiro :)00:00
*** SumitNaiksatam has quit IRC00:01
*** padkrish has quit IRC00:01
openstackgerritHenry Gessau proposed openstack/neutron: Rename args for alembic 0.8.0  https://review.openstack.org/21285300:02
yushiroHenryG, would you tell me about driver-team's IRC meeting result? Has there been any progress about my spec?00:03
HenryGyushiro: the meeting was canceled00:04
HenryGyushiro: mestery does not think there is enough reviewer time to land in L-300:05
HenryGyushiro: sorry to bring the bad news :(00:05
*** jamielennox is now known as jamielennox|away00:05
*** annegentle has joined #openstack-neutron00:05
openstackgerritKevin Benton proposed openstack/neutron: Break down _bind_port_if_needed in ML2  https://review.openstack.org/21285400:05
yushiroHenryG: Indeed...  anyway,  I'll do my best until L-3 as much as I can :)  Thank you for your information.00:07
*** jamielennox|away is now known as jamielennox00:07
*** achanda_ has joined #openstack-neutron00:07
HenryGyushiro: I have been through such situations in many cycles, I know the pain00:07
*** nlahouti has quit IRC00:08
HenryGyushiro: The good thing is it gives us time to plan the logging API properly00:08
HenryGyushiro: In fact I suggest splitting it into two specs00:09
*** abhiraut has joined #openstack-neutron00:09
HenryGyushiro: One for the "grand design" of a generic logging API that is extensible00:09
*** mickeys has quit IRC00:09
*** jamielennox is now known as jamielennox|away00:10
HenryGyushiro: One for using the logging API for SG and FW rules00:10
*** slaweq has joined #openstack-neutron00:10
*** spandhe has quit IRC00:10
*** yamamoto has joined #openstack-neutron00:11
HenryGSomething like that, depending on input from other reviewers like amotoki, salv-orlando, russellb00:11
*** achanda has quit IRC00:11
*** achanda_ has quit IRC00:12
*** salv-orlando has quit IRC00:13
yushiroHenryG: Wow! It may be can collaborate with you and me :)  Specially, I'd like to know about your "grand design".00:13
*** merooney has joined #openstack-neutron00:13
yushiros/may be can/may be able to/00:13
HenryGyushiro: perhaps I should have said "properly designed"00:14
HenryGyushiro: It must take into account other possible uses than just SG and FW00:15
*** armax has joined #openstack-neutron00:15
*** suresh12_ has quit IRC00:16
*** yamamoto has quit IRC00:16
*** baoli has joined #openstack-neutron00:16
HenryGyushiro: Also consider things like policies: Who can use it? Do we need to allow per-feature access control? etc.00:16
*** minwang2 has quit IRC00:17
*** mitchjameson has quit IRC00:17
HenryGyushiro: Also the question of enable/disable logging: Provide an API for it? Allow to enable/disable per-feature?00:18
HenryGyushiro: etc. :)00:18
*** slaweq has quit IRC00:18
HenryGyushiro: There may be examples of logging APIs out there in other software. I have not looked.00:19
*** slaweq has joined #openstack-neutron00:20
*** madhu_ak has quit IRC00:20
openstackgerritKevin Benton proposed openstack/neutron: Use a conntrack zone per port in OVS  https://review.openstack.org/20746400:20
*** baoli has quit IRC00:21
*** merooney has quit IRC00:21
yushiroHenryG: I see.  Thank you for your explaination :)00:21
yushiro....now writing the reply to HenryG.... (45%)00:22
*** shadower has quit IRC00:23
*** shadower has joined #openstack-neutron00:23
*** jamiec has quit IRC00:23
openstackgerritMiguel Lavalle proposed openstack/neutron: External DNS driver reference implementation  https://review.openstack.org/21221300:24
*** haigang has joined #openstack-neutron00:26
*** Sukhdev has quit IRC00:27
*** mlavalle has quit IRC00:29
*** johnbelamaric has joined #openstack-neutron00:30
*** jamiec has joined #openstack-neutron00:30
*** _cjones_ has quit IRC00:31
yushiroHenryG: Definitely it's necessary the feature that can control enable/disable per-feature.  And, it's also necessary the enable/disable logging.00:31
*** slaweq has quit IRC00:33
*** johnbelamaric has left #openstack-neutron00:34
*** killer_prince has quit IRC00:35
*** ivar-lazzaro has joined #openstack-neutron00:36
yushiroHenryG: Anyway, I've already updated my spec.  Would you please review it again?  FWaaS team will also review my spec :) https://review.openstack.org/#/c/203509/00:37
*** thorst has quit IRC00:37
HenryGyushiro: yes, I will look at it tomorrow00:38
*** jobewan has joined #openstack-neutron00:39
*** oomichi has joined #openstack-neutron00:39
yushiroHenryG: Thank you!00:39
*** yushiro is now known as yushiro_afk00:46
*** moha_hunt has joined #openstack-neutron00:46
*** zhenguo has joined #openstack-neutron00:49
*** gildub has quit IRC00:50
*** haigang has quit IRC00:50
*** tiswanso has joined #openstack-neutron00:51
*** markvoelker has joined #openstack-neutron00:51
*** suresh12 has joined #openstack-neutron00:52
*** bharath has quit IRC00:53
*** tiswanso has quit IRC00:53
*** dsneddon has quit IRC00:54
*** tiswanso has joined #openstack-neutron00:54
*** aranjan has quit IRC00:55
*** markvoelker has quit IRC00:56
openstackgerritMerged openstack/neutron-fwaas: Updated from global requirements  https://review.openstack.org/21226000:59
openstackgerritMerged openstack/neutron-fwaas: Use oslo_log.helpers.log_method_call  https://review.openstack.org/20231400:59
*** topshare has joined #openstack-neutron01:00
*** SourabhP has joined #openstack-neutron01:00
*** sthillma_ has joined #openstack-neutron01:00
*** sthillma has quit IRC01:01
*** aranjan has joined #openstack-neutron01:03
*** sthillma has joined #openstack-neutron01:03
*** daneyon_ has quit IRC01:03
*** sthillma_ has quit IRC01:05
*** vivek-ebay has quit IRC01:05
*** mickeys has joined #openstack-neutron01:06
*** johnbelamaric1 has joined #openstack-neutron01:07
*** patrickeast has quit IRC01:09
*** gildub has joined #openstack-neutron01:11
*** mickeys has quit IRC01:12
*** jwy has quit IRC01:13
openstackgerritshihanzhang proposed openstack/neutron: Rename function '_update_port_down'  https://review.openstack.org/21192001:13
openstackgerritshihanzhang proposed openstack/neutron: Support distributed dhcp agent  https://review.openstack.org/18442301:15
*** SourabhP has quit IRC01:16
*** hichihara has joined #openstack-neutron01:18
*** cdl has joined #openstack-neutron01:19
*** aranjan has quit IRC01:20
*** cdl has quit IRC01:23
*** johnbelamaric1 has quit IRC01:29
*** erkules_ has joined #openstack-neutron01:29
*** bharath_ has joined #openstack-neutron01:32
*** erkules has quit IRC01:32
*** jckasper has joined #openstack-neutron01:33
*** suresh12 has quit IRC01:35
*** suresh12 has joined #openstack-neutron01:36
*** lyanchih has joined #openstack-neutron01:38
*** haigang has joined #openstack-neutron01:39
*** zhhuabj has joined #openstack-neutron01:40
*** bharath_ has quit IRC01:41
openstackgerritIsaku Yamahata proposed openstack/neutron: l3: not use L2 plugin _get_subnet unnecessarily  https://review.openstack.org/20235901:41
openstackgerritIsaku Yamahata proposed openstack/neutron: l3_db: not use L2 plugin _get_port unnecessarily  https://review.openstack.org/20235801:41
openstackgerritAbhishek Raut proposed openstack/neutron: Remove Cisco Meta and N1KV monolithic plugins  https://review.openstack.org/21220901:42
*** yalie has joined #openstack-neutron01:42
*** bharath_ has joined #openstack-neutron01:43
*** cgoncalves has quit IRC01:43
*** markvoelker has joined #openstack-neutron01:43
*** jwy has joined #openstack-neutron01:44
*** minwang2 has joined #openstack-neutron01:44
*** markvoelker has quit IRC01:48
*** yushiro_afk has quit IRC01:48
*** liudong has joined #openstack-neutron01:49
*** erkules_ has quit IRC01:52
*** crc32 has quit IRC01:53
*** abhiraut has quit IRC01:53
*** erkules_ has joined #openstack-neutron01:53
openstackgerritMerged openstack/neutron: Fix update_subnet for prefix delegation  https://review.openstack.org/20997801:56
*** haigang has quit IRC01:56
openstackgerritMerged openstack/neutron: Add test that checks external tables are not changed  https://review.openstack.org/21044901:58
openstackgerritMerged openstack/neutron: db_base_plugin_v2: Avoid creating another session  https://review.openstack.org/19842001:59
*** haigang has joined #openstack-neutron01:59
*** shivrao has quit IRC02:01
*** nplanel has joined #openstack-neutron02:03
openstackgerritMerged openstack/neutron: Add configurable options for HA networks  https://review.openstack.org/21201702:03
*** topshare has quit IRC02:05
*** topshare has joined #openstack-neutron02:07
*** jamielennox|away is now known as jamielennox02:08
*** mikeymeitbual has quit IRC02:08
*** bharath_ has quit IRC02:09
*** bharath_ has joined #openstack-neutron02:11
*** redbeard has joined #openstack-neutron02:12
*** kun_huang has joined #openstack-neutron02:14
kun_huangguys, what's the different in code under neutron_lbaas/drivers/ and neutron_lbaas/services/loadbalance/drivers/ ?02:15
kun_huangit seems lbaas v1 and v2 codes, but why put those in different paths?02:16
*** ijw_ has quit IRC02:18
*** boris-42 has quit IRC02:20
*** jobewan has quit IRC02:21
*** achanda has joined #openstack-neutron02:22
*** salv-orlando has joined #openstack-neutron02:24
*** claudiub has quit IRC02:25
*** achippa has joined #openstack-neutron02:26
*** bharath_ has quit IRC02:27
*** tsg has quit IRC02:28
*** salv-orlando has quit IRC02:32
*** shwetaap has joined #openstack-neutron02:36
*** annegentle has quit IRC02:38
*** zzzeek has joined #openstack-neutron02:41
*** jwy has quit IRC02:43
*** annegentle has joined #openstack-neutron02:45
*** fedexo has joined #openstack-neutron02:46
*** annegentle has quit IRC02:46
*** zzzeek has quit IRC02:48
*** yamamoto has joined #openstack-neutron02:48
*** topshare has quit IRC02:48
*** topshare has joined #openstack-neutron02:50
*** topshare has quit IRC02:50
*** sthillma has quit IRC02:51
*** saksham has quit IRC02:52
*** hakimo has joined #openstack-neutron02:53
*** hakimo_ has quit IRC02:55
*** markvoelker has joined #openstack-neutron02:55
*** aranjan has joined #openstack-neutron02:55
*** enikanorov2 has quit IRC02:55
*** topshare has joined #openstack-neutron02:55
*** fedexo has quit IRC02:56
*** tflynn_ has joined #openstack-neutron02:56
*** Marga_ has joined #openstack-neutron02:56
*** Marga_ has quit IRC02:57
*** Marga_ has joined #openstack-neutron02:58
*** tflynn has quit IRC02:59
*** tflynn_ has quit IRC03:00
*** piyanai has joined #openstack-neutron03:02
*** julim has quit IRC03:03
*** aranjan has quit IRC03:05
*** neophy has joined #openstack-neutron03:11
*** suresh12 has quit IRC03:12
*** gangil has joined #openstack-neutron03:12
*** yushiro has joined #openstack-neutron03:12
*** saksham has joined #openstack-neutron03:14
*** saksham has quit IRC03:16
*** yushiro has quit IRC03:17
*** neophy has quit IRC03:20
*** achanda has quit IRC03:21
*** azbiswas has quit IRC03:21
*** tsg has joined #openstack-neutron03:24
*** achanda has joined #openstack-neutron03:25
*** achanda has quit IRC03:25
openstackgerritCao Xuan Hoang proposed openstack/neutron-specs: Logging API for security group and firewall rules  https://review.openstack.org/20350903:25
openstackgerritMike Dorman proposed openstack/neutron: Add API extension for reporting IP address usage statistics  https://review.openstack.org/21295503:25
*** gberginc has joined #openstack-neutron03:25
*** crc32 has joined #openstack-neutron03:28
*** tiswanso has quit IRC03:29
*** gsagie_ has joined #openstack-neutron03:30
*** shashank_hegde has joined #openstack-neutron03:32
*** crc32 has quit IRC03:36
*** shivrao has joined #openstack-neutron03:37
*** annegentle has joined #openstack-neutron03:38
*** azbiswas has joined #openstack-neutron03:40
*** crc32 has joined #openstack-neutron03:40
openstackgerrityalei wang proposed openstack/neutron: Replace internal calls of create_{network, subnet, port}  https://review.openstack.org/12977303:40
*** azbiswas has quit IRC03:41
*** azbiswas has joined #openstack-neutron03:41
*** achanda has joined #openstack-neutron03:44
*** crc32 has quit IRC03:44
*** shivrao has quit IRC03:44
*** shivrao has joined #openstack-neutron03:45
*** piyanai has quit IRC03:46
*** vthapar has joined #openstack-neutron03:46
openstackgerritMerged openstack/neutron: Add parent_id to _item calling from _handle_action  https://review.openstack.org/18083403:47
*** shwetaap has quit IRC03:49
*** shivrao has quit IRC03:50
*** redbeard has quit IRC03:53
*** bharath has joined #openstack-neutron03:54
*** Sukhdev has joined #openstack-neutron03:57
*** annegentle has quit IRC03:58
*** bharath has quit IRC03:58
*** tflynn has joined #openstack-neutron03:59
*** sambetts has joined #openstack-neutron03:59
*** tflynn_ has joined #openstack-neutron04:00
*** lyanchih has quit IRC04:02
*** jamielennox is now known as jamielennox|away04:02
*** tflynn has quit IRC04:03
*** banix has joined #openstack-neutron04:04
*** fedexo has joined #openstack-neutron04:05
*** enikanorov2 has joined #openstack-neutron04:10
*** vthapar has quit IRC04:11
*** vthapar has joined #openstack-neutron04:12
openstackgerritKevin Benton proposed openstack/neutron: Use a conntrack zone per port in OVS  https://review.openstack.org/20746404:12
*** salv-orlando has joined #openstack-neutron04:16
*** salv-orlando has quit IRC04:19
*** vivek-ebay has joined #openstack-neutron04:19
*** vivek-ebay has quit IRC04:21
*** yamamoto has quit IRC04:21
*** vthapar has quit IRC04:25
*** vthapar_ has joined #openstack-neutron04:25
*** yamamoto has joined #openstack-neutron04:25
*** markvoelker has quit IRC04:26
*** vivek-ebay has joined #openstack-neutron04:27
*** vikram has joined #openstack-neutron04:27
vikramyamamoto: ping04:28
yamamotohi04:28
vikrami have few question about Ryu04:28
vikramBGP speaker functionality04:28
vikramcan you help me?04:28
*** shwetaap has joined #openstack-neutron04:28
yamamotosure04:28
vikramhttps://review.openstack.org/20763504:29
vikramActually, I can to get the BGP speaker state and BGP neighbor state..04:29
vikramfor display purposes.. What interface I can use?04:29
*** ivar-lazzaro has quit IRC04:32
*** vthapar_ has quit IRC04:32
*** lori|away is now known as lori04:34
*** vthapar has joined #openstack-neutron04:34
*** trinaths has joined #openstack-neutron04:34
yamamotovikram: i'm not sure if there's a convenient method for it04:36
vikramhmmm04:37
vikramActually we require it..04:37
*** vthapar has quit IRC04:37
yamamotoi guess you can get better answer on ryu-devel@ :-)04:37
*** pradipta has joined #openstack-neutron04:38
vikramok.. thanks.. BTW, can you please review the link04:38
vikramjust to make sure we are doing right :-)04:38
yamamotosure i will.04:38
vikramis there any IRC for ryu-devel04:39
vikramor i got to send mail04:39
yamamotono irc afaik04:39
vikramohhh....04:39
yamamotoonly mailing list04:39
*** kun_huang has left #openstack-neutron04:39
vikramok.. i will drop a mail then. thanks a lot for your help04:39
*** vthapar has joined #openstack-neutron04:41
*** inara has quit IRC04:42
*** morgan_404 is now known as morgan_20404:42
*** pradipta has quit IRC04:44
*** morgan_204 is now known as morgan_20604:44
*** morgan_206 is now known as morgan_50304:45
*** shadower has quit IRC04:45
*** jamielennox|away is now known as jamielennox04:46
*** coolsvap has quit IRC04:46
*** marios has quit IRC04:46
*** bharath_ has joined #openstack-neutron04:48
*** coolsvap has joined #openstack-neutron04:48
*** sthillma has joined #openstack-neutron04:49
openstackgerritTakashi NATSUME proposed openstack/neutron-vpnaas: Rename a test method in test_ipsec.py  https://review.openstack.org/21098904:49
*** sthillma_ has joined #openstack-neutron04:50
*** fedexo has quit IRC04:51
*** marios has joined #openstack-neutron04:52
*** vthapar has quit IRC04:53
*** sthillma has quit IRC04:53
*** sthillma_ is now known as sthillma04:53
*** vikram has quit IRC04:54
*** yamamoto has quit IRC04:54
*** vthapar has joined #openstack-neutron04:54
*** fedexo has joined #openstack-neutron04:55
*** SridharG has joined #openstack-neutron04:56
*** inara has joined #openstack-neutron04:58
*** bharath_ has quit IRC04:59
*** vthapar has quit IRC04:59
*** yamamoto has joined #openstack-neutron05:00
*** banix has quit IRC05:00
*** killer_prince has joined #openstack-neutron05:00
*** numan has joined #openstack-neutron05:01
*** fedexo has quit IRC05:02
*** fedexo has joined #openstack-neutron05:03
*** boris-42 has joined #openstack-neutron05:06
*** bharath_ has joined #openstack-neutron05:06
*** tsg has quit IRC05:10
*** shivrao has joined #openstack-neutron05:12
*** lazy_prince has joined #openstack-neutron05:12
*** dave-mccowan has quit IRC05:14
*** vivek-ebay has quit IRC05:14
*** killer_prince has quit IRC05:15
*** diga_ has joined #openstack-neutron05:17
*** sdake_ has quit IRC05:17
*** SumitNaiksatam has joined #openstack-neutron05:21
*** vivek-ebay has joined #openstack-neutron05:23
*** lajos-katona has joined #openstack-neutron05:23
*** yamamoto has quit IRC05:25
*** moha_hunt has quit IRC05:26
*** gsagie_ has quit IRC05:26
*** yamamoto has joined #openstack-neutron05:29
*** iwamoto has joined #openstack-neutron05:32
*** bharath_ has quit IRC05:32
*** fedexo has quit IRC05:34
*** azbiswas has quit IRC05:37
*** azbiswas has joined #openstack-neutron05:37
*** chlong has quit IRC05:41
*** azbiswas has quit IRC05:42
*** salv-orlando has joined #openstack-neutron05:43
*** shwetaap has quit IRC05:43
*** minwang2 has quit IRC05:43
*** spandhe has joined #openstack-neutron05:43
*** vivek-ebay has quit IRC05:43
*** vivek-ebay has joined #openstack-neutron05:44
*** azbiswas has joined #openstack-neutron05:44
*** chlong has joined #openstack-neutron05:44
*** haigang has quit IRC05:45
*** haigang has joined #openstack-neutron05:46
*** liudong has quit IRC05:46
*** haigang has quit IRC05:47
*** haigang has joined #openstack-neutron05:47
*** fawadkhaliq has joined #openstack-neutron05:48
*** vivek-ebay has quit IRC05:48
*** jprovazn has joined #openstack-neutron05:48
*** minwang2 has joined #openstack-neutron05:48
*** salv-orlando has quit IRC05:53
*** azbiswas has quit IRC05:56
*** Sukhdev has quit IRC05:57
*** yog_ has joined #openstack-neutron05:58
*** baoli has joined #openstack-neutron06:00
*** oomichi has quit IRC06:00
*** fifieldt_ has quit IRC06:00
*** coolsvap has quit IRC06:00
*** shivrao has quit IRC06:02
*** coolsvap has joined #openstack-neutron06:03
*** Rynn has joined #openstack-neutron06:04
*** baoli has quit IRC06:05
*** minwang2 has quit IRC06:05
*** bharath_ has joined #openstack-neutron06:05
*** shashank_hegde has quit IRC06:08
*** azbiswas has joined #openstack-neutron06:08
*** nplanel has quit IRC06:09
*** lazy_prince has quit IRC06:09
*** sam_s has joined #openstack-neutron06:09
*** lazy_prince has joined #openstack-neutron06:09
*** SourabhP has joined #openstack-neutron06:10
*** Rynn has quit IRC06:12
*** davidjc has quit IRC06:13
*** SourabhP_ has joined #openstack-neutron06:13
*** lazy_prince has quit IRC06:14
*** SourabhP has quit IRC06:16
*** SourabhP_ is now known as SourabhP06:16
*** ddepaoli has joined #openstack-neutron06:16
*** trinaths has quit IRC06:21
*** gangil has quit IRC06:23
*** azbiswas has quit IRC06:23
*** Murali_ has joined #openstack-neutron06:23
*** ildikov has quit IRC06:25
*** SridharG has left #openstack-neutron06:25
*** lyanchih has joined #openstack-neutron06:33
*** scheuran has joined #openstack-neutron06:34
openstackgerritArmando Migliaccio proposed openstack/neutron-fwaas: Reduce contention between update and delete  https://review.openstack.org/21281106:37
openstackgerritArmando Migliaccio proposed openstack/neutron: Unskip this test to lure out the bug  https://review.openstack.org/21214506:38
*** achippa has quit IRC06:41
*** achippa_ has joined #openstack-neutron06:41
*** jprovazn has quit IRC06:42
*** nlahouti has joined #openstack-neutron06:43
*** SridharG has joined #openstack-neutron06:45
*** achippa_ has quit IRC06:46
*** anshul has joined #openstack-neutron06:48
*** kawa2014 has joined #openstack-neutron06:56
*** nlahouti has quit IRC07:00
*** sthillma has quit IRC07:01
*** sthillma has joined #openstack-neutron07:02
*** ildikov has joined #openstack-neutron07:02
*** devvesa has joined #openstack-neutron07:08
*** nfedotov has joined #openstack-neutron07:15
*** jamielennox is now known as jamielennox|away07:17
*** numan has quit IRC07:17
*** achanda has quit IRC07:19
*** yamahata has quit IRC07:19
*** jpena has joined #openstack-neutron07:20
*** haigang has quit IRC07:21
*** afazekas_ has joined #openstack-neutron07:24
openstackgerritArmando Migliaccio proposed openstack/neutron-fwaas: Reduce contention between update and delete  https://review.openstack.org/21281107:27
openstackgerritArmando Migliaccio proposed openstack/neutron: Unskip this test to lure out the bug  https://review.openstack.org/21214507:27
*** armax has quit IRC07:29
*** itzikb has joined #openstack-neutron07:30
*** itzikb has quit IRC07:31
*** itzikb has joined #openstack-neutron07:31
*** itzikb has quit IRC07:34
*** chlong has quit IRC07:36
openstackgerritMathieu Rohon proposed openstack/neutron: Add an empty policy.d in UT to satisfy oslo_policy requirement  https://review.openstack.org/21257107:37
*** matrohon has joined #openstack-neutron07:39
*** chlong has joined #openstack-neutron07:39
*** bharath__ has joined #openstack-neutron07:40
*** itzikb has joined #openstack-neutron07:43
*** spandhe has quit IRC07:46
*** SourabhP has quit IRC07:47
*** sbelous has quit IRC07:51
*** jlanoux has joined #openstack-neutron07:51
*** skraynev has quit IRC07:51
*** gampel has joined #openstack-neutron07:52
*** eezhova has quit IRC07:52
*** obondarev has quit IRC07:52
*** akamyshnikova has quit IRC07:52
*** ilyashakhat has quit IRC07:52
*** erkules_ is now known as erkules07:54
*** erkules has joined #openstack-neutron07:54
*** shivrao has joined #openstack-neutron07:54
*** salv-orlando has joined #openstack-neutron07:54
openstackgerritAmit Saha proposed openstack/neutron: Minor typo fix  https://review.openstack.org/21301908:01
*** rossella_ has joined #openstack-neutron08:03
*** salv-orlando has quit IRC08:05
*** jlibosva has joined #openstack-neutron08:07
*** shivrao has quit IRC08:10
*** jistr has joined #openstack-neutron08:13
*** gildub has quit IRC08:17
openstackgerritOpenStack Proposal Bot proposed openstack/neutron: Updated from global requirements  https://review.openstack.org/21274908:18
*** tflynn_ has quit IRC08:22
*** alex_klimov has joined #openstack-neutron08:24
*** sthillma has quit IRC08:25
*** lyanchih has quit IRC08:26
*** sthillma has joined #openstack-neutron08:26
*** ilyashakhat has joined #openstack-neutron08:27
*** akamyshnikova has joined #openstack-neutron08:27
*** eezhova has joined #openstack-neutron08:27
*** skraynev has joined #openstack-neutron08:28
openstackgerritYAMAMOTO Takashi proposed openstack/neutron: test_db_base_plugin_v2: Avoid failures on OSX  https://review.openstack.org/21303208:28
*** krypto has joined #openstack-neutron08:28
kryptohi all is there a way to update dns name of instance.I can see that simply renaming instance will not change to new hostname08:29
openstackgerritMadhu Mohan proposed openstack/neutron: Redundant tests removed from ovs-lib unit tests:  https://review.openstack.org/20886008:32
*** numan has joined #openstack-neutron08:33
*** ferest has joined #openstack-neutron08:37
*** claudiub has joined #openstack-neutron08:41
*** tfukushima has joined #openstack-neutron08:42
*** yalie has left #openstack-neutron08:43
*** mickeys has joined #openstack-neutron08:43
*** ferest has quit IRC08:45
*** mickeys has quit IRC08:50
*** sbelous has joined #openstack-neutron08:53
*** ihrachyshka has joined #openstack-neutron08:53
*** sakaYK has joined #openstack-neutron08:53
*** iwamoto has quit IRC09:04
*** sthillma has quit IRC09:06
*** itzikb has quit IRC09:06
*** salv-orlando has joined #openstack-neutron09:07
*** salv-orlando has quit IRC09:11
openstackgerritshihanzhang proposed openstack/neutron: Enable list-networks support paginating with provider attribute  https://review.openstack.org/21304709:15
*** sam_s has quit IRC09:15
openstackgerritOpenStack Proposal Bot proposed openstack/neutron: Updated from global requirements  https://review.openstack.org/21274909:16
openstackgerritOpenStack Proposal Bot proposed openstack/neutron-fwaas: Updated from global requirements  https://review.openstack.org/21305209:17
openstackgerritOpenStack Proposal Bot proposed openstack/neutron-vpnaas: Updated from global requirements  https://review.openstack.org/21226209:17
*** apuimedo has joined #openstack-neutron09:17
*** liudong has joined #openstack-neutron09:23
*** diga has quit IRC09:26
*** matrohon has quit IRC09:29
*** tfukushima has quit IRC09:31
openstackgerritSridhar Gaddam proposed openstack/neutron: Avoid stacktrace when dhcp port is deleted  https://review.openstack.org/20510109:31
*** tfukushima has joined #openstack-neutron09:33
*** salv-orlando has joined #openstack-neutron09:36
openstackgerritCedric Brandily proposed openstack/neutron: Python 3: use a hash to sort dictionaries  https://review.openstack.org/20479209:37
*** msno has joined #openstack-neutron09:39
*** hichihara has quit IRC09:45
*** alex_klimov has quit IRC09:47
*** scheuran has quit IRC09:47
*** scheuran has joined #openstack-neutron09:47
*** ildikov has quit IRC09:49
*** ex-parrot has quit IRC09:49
openstackgerritAnn Kamyshnikova proposed openstack/neutron: Graceful ovs-agent restart  https://review.openstack.org/18292009:52
*** tfukushima has quit IRC09:53
*** ddepaoli has quit IRC09:54
*** lyanchih has joined #openstack-neutron09:54
*** tfukushima has joined #openstack-neutron09:55
*** ex-parrot has joined #openstack-neutron09:55
*** ex-parrot has joined #openstack-neutron09:55
*** haigang has joined #openstack-neutron09:56
*** sakaYK has quit IRC09:59
*** numan has quit IRC10:00
ihrachyshkajlibosva, shouldn't we proceed with fullstack on master already? rebased on the merge patch.10:00
*** gongysh has quit IRC10:01
*** haigang has quit IRC10:03
*** gampel has quit IRC10:05
*** baojg has joined #openstack-neutron10:07
*** gongysh has joined #openstack-neutron10:07
*** stanzgy_ has quit IRC10:09
*** stanzgy_ has joined #openstack-neutron10:09
*** sbelous has quit IRC10:12
*** sbelous has joined #openstack-neutron10:14
*** tfukushima has quit IRC10:15
*** numan has joined #openstack-neutron10:16
*** tfukushima has joined #openstack-neutron10:17
openstackgerritYAMAMOTO Takashi proposed openstack/neutron: ml2: _commit_port_binding: Don't use None to mean False  https://review.openstack.org/21307310:18
*** sakaYK has joined #openstack-neutron10:18
*** kawa2014 has quit IRC10:18
*** kawa2014 has joined #openstack-neutron10:18
*** arif-ali has quit IRC10:19
*** matrohon has joined #openstack-neutron10:20
*** numan has quit IRC10:20
openstackgerritYAMAMOTO Takashi proposed openstack/neutron: ml2: Remove a redundant assignment in _bind_port_level  https://review.openstack.org/21307510:20
*** sakaYK has quit IRC10:23
*** alex_klimov has joined #openstack-neutron10:23
*** sakaYK has joined #openstack-neutron10:24
*** lajos-katona has quit IRC10:26
*** sakaYK has quit IRC10:26
*** zhenguo has quit IRC10:26
*** baojg has quit IRC10:27
openstackgerritMerged openstack/neutron: Validate local_ip for OVS tunnel  https://review.openstack.org/15404310:27
*** baojg has joined #openstack-neutron10:27
*** SridharG has left #openstack-neutron10:29
*** piyanai has joined #openstack-neutron10:29
openstackgerritZhaoBo proposed openstack/python-neutronclient: Fix return inappropriate message when run net-list -F {fields}  https://review.openstack.org/21307910:29
*** lajos-katona has joined #openstack-neutron10:29
*** sakaYK has joined #openstack-neutron10:29
*** baoli has joined #openstack-neutron10:31
*** baojg has quit IRC10:32
*** numan has joined #openstack-neutron10:32
openstackgerritZhaoBo proposed openstack/python-neutronclient: Fix return inappropriate message when run net-list -F {fields}  https://review.openstack.org/21307910:34
*** sakaYK has quit IRC10:35
*** bharath_ has quit IRC10:35
*** diga_ has quit IRC10:35
*** baoli has quit IRC10:35
*** sakaYK has joined #openstack-neutron10:36
*** rdo has quit IRC10:36
ihrachyshkasc68cal, hi10:37
ihrachyshkare devstack qos plugin10:37
*** sakaYK has quit IRC10:38
*** rdo has joined #openstack-neutron10:38
*** john-davidge has joined #openstack-neutron10:39
*** numan has quit IRC10:40
*** arif-ali has joined #openstack-neutron10:40
*** bharath__ has quit IRC10:41
*** john-davidge_ has joined #openstack-neutron10:42
*** rdo has quit IRC10:43
*** john-davidge has quit IRC10:43
*** john-davidge_ is now known as john-davidge10:43
*** sakaYK has joined #openstack-neutron10:43
*** yamamoto has quit IRC10:44
*** sakaYK has quit IRC10:45
jlibosvaihrachyshka: Once we have feature branch merged, I will move it to master10:46
*** yamamoto has joined #openstack-neutron10:46
*** rdo has joined #openstack-neutron10:50
*** diga has joined #openstack-neutron10:51
*** numan has joined #openstack-neutron10:53
*** pc_m has joined #openstack-neutron10:53
*** haigang has joined #openstack-neutron10:55
*** ildikov has joined #openstack-neutron10:56
*** rdo has quit IRC10:57
*** rdo has joined #openstack-neutron10:59
*** diga has quit IRC11:00
*** jianyong2 has joined #openstack-neutron11:01
*** jianyong has quit IRC11:02
*** topshare has quit IRC11:04
*** mwagner_lap has joined #openstack-neutron11:07
*** nyechiel has joined #openstack-neutron11:07
*** rossella_ has quit IRC11:09
*** tfukushima has quit IRC11:10
*** tfukushima has joined #openstack-neutron11:11
*** yamamoto has quit IRC11:11
*** achanda has joined #openstack-neutron11:11
*** gongysh has quit IRC11:13
*** jianyong2 has quit IRC11:14
*** achanda has quit IRC11:15
*** devvesa has quit IRC11:20
matrohonsalv-orlando : hi11:22
*** sambetts has quit IRC11:24
*** krypto has quit IRC11:24
*** nyechiel has quit IRC11:24
*** SridharG has joined #openstack-neutron11:29
*** sambetts has joined #openstack-neutron11:29
*** nyechiel has joined #openstack-neutron11:29
*** tfukushima has quit IRC11:32
*** tfukushima has joined #openstack-neutron11:32
*** tfukushima has quit IRC11:34
*** numan has quit IRC11:35
*** shaohe_robot has quit IRC11:36
*** Kennan2 has joined #openstack-neutron11:36
*** Kennan has quit IRC11:37
ihrachyshkaajo, see amuller's comment in etherpad11:40
ihrachyshka(amuller) I applied the policy.json changes to my setup. As a non-admin I can create policies and rules but I can't attach them to networks or ports, this is... Weird.11:40
ajoyeah, what I found last day about policy.json11:40
ajowe need to adjust that11:40
ajofor attach, we need to allow when "shared"11:41
ajoand for creation/rules , we need to set admin only11:42
ajoI'll look at it right now11:42
*** bharath_ has joined #openstack-neutron11:42
ihrachyshkaajo, base on top of merge I guess, I don't believe it a reason to block merge11:43
ihrachyshkasince default behaves as we expected11:43
*** thorst has joined #openstack-neutron11:43
ajoOk, adding it on top of merge11:44
*** lyanchih has quit IRC11:45
*** rushil has joined #openstack-neutron11:46
*** liudong has quit IRC11:46
*** afazekas_ has quit IRC11:47
*** bharath_ has quit IRC11:47
ajoihrachyshka, where's the etherpad?11:47
ajoihrachyshka, I will add it after the API-test re-enable11:50
ajoso we can be sure we don't break anything11:50
ajobut that depends on the infra change11:51
ihrachyshkaajo, https://etherpad.openstack.org/p/qos-merge-back-review11:52
*** nyechiel has quit IRC11:52
*** lyanchih has joined #openstack-neutron11:53
*** shadower has joined #openstack-neutron11:56
*** shadower has quit IRC11:58
*** shadower has joined #openstack-neutron11:59
ihrachyshkakevinbenton, just caught that one: http://logs.openstack.org/51/204551/4/gate/gate-neutron-dsvm-functional/28a8356/testr_results.html.gz11:59
*** yamamoto has joined #openstack-neutron12:03
*** haigang has quit IRC12:05
*** lajos-katona has quit IRC12:05
*** sdake_ has joined #openstack-neutron12:11
*** gsagie_ has joined #openstack-neutron12:15
*** Murali__ has joined #openstack-neutron12:15
*** rpothier has joined #openstack-neutron12:16
*** dr_gogeta86 has joined #openstack-neutron12:17
*** dr_gogeta86 has joined #openstack-neutron12:17
*** Murali_ has quit IRC12:18
*** SridharG has left #openstack-neutron12:18
*** SridharG has joined #openstack-neutron12:19
*** yamamoto has quit IRC12:20
*** markvoelker has joined #openstack-neutron12:21
*** gampel has joined #openstack-neutron12:21
openstackgerritNguyen Phuong An proposed openstack/neutron-fwaas: [WIP] Support logging configuration feature for FWaaS  https://review.openstack.org/20448412:22
*** lajos-katona has joined #openstack-neutron12:22
*** tfukushima has joined #openstack-neutron12:23
*** jianyong has joined #openstack-neutron12:24
*** rossella_ has joined #openstack-neutron12:24
*** lazy_prince has joined #openstack-neutron12:27
*** rushil has quit IRC12:28
*** tfukushima has quit IRC12:29
*** edmondsw has joined #openstack-neutron12:29
*** killer_prince has joined #openstack-neutron12:30
*** Murali__ has quit IRC12:30
*** tfukushima has joined #openstack-neutron12:31
*** britthouser has joined #openstack-neutron12:33
*** gildub has joined #openstack-neutron12:33
*** lazy_prince has quit IRC12:33
*** britthou_ has joined #openstack-neutron12:34
*** rushil has joined #openstack-neutron12:36
*** gampel has quit IRC12:37
*** sdake_ has quit IRC12:37
*** britthouser has quit IRC12:38
openstackgerritCyril Roelandt proposed openstack/neutron: Python 3: fix test_utils  https://review.openstack.org/21312812:41
*** jpena is now known as jpena|lunch12:43
*** rushil has quit IRC12:43
openstackgerritCyril Roelandt proposed openstack/neutron: Python 3: fix test_utils  https://review.openstack.org/21312812:46
*** baoli has joined #openstack-neutron12:47
openstackgerritLajos Katona proposed openstack/neutron: Trunk port: Unit tests for trunk port feature  https://review.openstack.org/21254912:47
openstackgerritGal Sagie proposed openstack/neutron: Add lieutenants contact for kuryr  https://review.openstack.org/21313312:48
*** erlarese has joined #openstack-neutron12:49
*** Murali_ has joined #openstack-neutron12:50
*** yamamoto has joined #openstack-neutron12:51
*** pc_m has quit IRC12:51
*** baoli has quit IRC12:51
*** dave-mccowan has joined #openstack-neutron12:52
*** zhhuabj has quit IRC12:53
*** SridharG has left #openstack-neutron12:55
*** pc_m has joined #openstack-neutron12:55
*** sdake has joined #openstack-neutron12:55
*** regXboi has joined #openstack-neutron12:56
*** britthou_ has quit IRC12:57
*** britthouser has joined #openstack-neutron12:58
*** merooney has joined #openstack-neutron12:58
*** sdake_ has joined #openstack-neutron12:59
*** lindycoder has joined #openstack-neutron13:00
*** sdake has quit IRC13:02
*** zhhuabj has joined #openstack-neutron13:04
salv-orlandohi matrohon13:04
salv-orlandosorry about the delay, was afk for lunch13:05
matrohonsalv-orlando : hi, np13:05
matrohonsalv-orlando : I was wondering if it was possible to create an extension that only loads an action in the action map of the router controller13:06
*** eezhova has quit IRC13:08
*** Murali_ has quit IRC13:09
*** eezhova has joined #openstack-neutron13:09
*** lazy_prince has joined #openstack-neutron13:11
*** killer_prince has quit IRC13:13
*** rodrigods has quit IRC13:13
*** kbringard has joined #openstack-neutron13:14
*** julim has joined #openstack-neutron13:16
ihrachyshkaajo, cool video ;)13:16
ihrachyshkahave you posted it already?13:17
salv-orlandomatrohon: let me think about it. I'm not sure it's possible.13:17
*** sdake has joined #openstack-neutron13:17
ajoihrachyshka, I'm putting the setup instructions together13:17
ajoand posting it in 10 minutes..13:17
ihrachyshkacool. you can refer to devstack patch for easier configuration, but for stock devstack, the'll need a bit of post-config magic to enable agent extension13:18
matrohonsalv-orlando : I'm trying to code it, I'll tell you where I'm stuck13:18
*** tfukushima has quit IRC13:18
*** jobewan has joined #openstack-neutron13:19
*** sdake_ has quit IRC13:20
*** gildub has quit IRC13:21
*** tiswanso has joined #openstack-neutron13:21
ihrachyshkamestery, howdy! It's that time of a day when I ask what's the plan for qos merge :) we collected some feedback, mostly from amuller, in the etherpad, but there seems to be nothing that would stand for a critical thing.13:22
mesteryihrachyshka: Bear with me, I'm replying to your email on the list about core reviewers and such, but in general, the plan of record stands: Lets merge that baby back.13:23
mesteryihrachyshka: dougwig had some concerns on some of the infra patches you had, but it wasn't clear if they were related directly to QoS13:23
ihrachyshkamestery, I guess it was about skip-if filtering, there was some mess invoked by me where we disabled some testing for a while. but now it seems closed.13:24
mesteryihrachyshka: Thanks sir, I saw that last night and it was on my list of things to follow up on this morning13:25
*** alaski is now known as lascii13:25
*** jlibosva has quit IRC13:25
ajoihrachyshka: published to the list: http://www.ajo.es/post/126667247769/neutron-qos-service-plugin ;)13:26
*** piyanai has quit IRC13:26
ajoihrachyshka, sorry, I missed the devstack patch comment here, let me look at it13:27
openstackgerritRyan Moats proposed openstack/neutron: Add dashboard folder and graphite dashboard to doc  https://review.openstack.org/21314113:27
regXboimestery: ^^^^^^13:27
ihrachyshkaajo++13:27
*** dansmith is now known as superdan13:27
*** vivek-ebay has joined #openstack-neutron13:28
*** zhenguo has joined #openstack-neutron13:28
*** Murali_ has joined #openstack-neutron13:28
matrohonihrachyshka, salv-orlando, amuller : I had some troubles running tests locally in neutron, and submitted a patch : https://review.openstack.org/#/c/212571/13:29
matrohonihrachyshka, salv-orlando, amuller : maybe I missed something13:29
*** amuller has joined #openstack-neutron13:29
*** fifieldt has joined #openstack-neutron13:30
*** nyechiel has joined #openstack-neutron13:31
*** bharath has joined #openstack-neutron13:31
*** crose has joined #openstack-neutron13:32
ajoihrachyshka, how did you set the feature/qos branch in local.conf ?13:33
ajoNEUTRON_BRANCH ?13:33
ajoi will include that in the post, and remove it once merged..13:33
*** jaypipes has joined #openstack-neutron13:33
ihrachyshkamathyes13:33
ihrachyshkaajo, yes13:33
*** sdake_ has joined #openstack-neutron13:34
*** Murali__ has joined #openstack-neutron13:35
*** bharath has quit IRC13:36
ajoihrachyshka: updated, are the stacking steps correct? http://www.ajo.es/post/126667247769/neutron-qos-service-plugin13:37
*** Murali_ has quit IRC13:37
*** sdake has quit IRC13:38
openstackgerritOleg Bondarev proposed openstack/neutron: DVR: do not reschedule router for down agents on compute nodes  https://review.openstack.org/19800913:38
salv-orlandomatrohon: never seen that error. afaict oslo policy should just ignore policy.d if missing?13:38
ihrachyshkaajo, yes13:39
*** jaypipes has quit IRC13:39
ihrachyshkasalv-orlando, yeah, I'll reply in the patch, seems like it should not fail like that unless there is already a directory13:39
salv-orlandomatrohon: what version of oslo_policy are you running? It's not clear from the bug report13:39
salv-orlandoihrachyshka: that makes more sense indeed13:40
matrohonsalv-orlando, ihrachyshka : thanks for looking. I'm running test in venv with oslo 0.9.013:41
*** jaypipes has joined #openstack-neutron13:42
*** jaypipes is now known as leakypipes\13:43
*** nyechiel has quit IRC13:43
matrohonsalv-orlando, ihrachyshka : I re-run the test and force the creation of the .venv13:45
*** nyechiel has joined #openstack-neutron13:45
ihrachyshkamatrohon, which oslo library is 0.9.0?13:46
matrohonihrachyshka : oslo_policy13:46
matrohonihrachyshka : did you run the test I mentioned in the bug report?13:46
*** jpena|lunch is now known as jpena13:47
matrohonihrachyshka : I'm curious to know if it only fails in my config13:47
ihrachyshkamatrohon, I did, without your patch and with it13:47
ihrachyshkano difference, both pas13:47
ihrachyshkano difference, both pass13:47
*** leakypipes\ is now known as leakypipes13:47
*** lyanchih has quit IRC13:48
ajosalv-orlando, do you know if we have any docs related to policy.json? :)13:49
ajoI'm fixing some issues amuller found in the policies, but making slow progress13:50
matrohonihrachyshka : ok thanks... so there is probably an issue in my setup....13:50
amullerajo: there is a nice doc in the oslo policy dev docs13:50
ajohmmm13:50
amullerajo: but what you're looking for is simple I think? what is the desired behavior you're looking for?13:51
ajoamuller: admin only creation of rules/policies within the qos "service"13:51
ajoand, admin / or tenant if shared attachment to ports/networks13:51
ajoand admin only update/list/show, etc..13:51
ajoamuller: for example, following the lbaas entries, I wrote: "create_qos-policy": "rule:admin_only",13:52
amullerok13:52
amullerthat didn't work?13:52
ajobut it's totally ignored13:52
amullerdid you restart server?13:53
*** nyechiel_ has joined #openstack-neutron13:53
ajoyes13:53
amullerdid you restart your router?13:53
ajolet me double check I'm not admin ;)13:53
ajolol13:53
*** breitz has quit IRC13:53
*** breitz has joined #openstack-neutron13:53
ajoyes13:54
ajoI'm not admin13:54
* ajo looks at oslo docs..13:54
openstackgerritOleg Bondarev proposed openstack/neutron: Ensure l3 agent receives notification about added router  https://review.openstack.org/21037813:54
matrohonihrachyshka : thanks you're right, I was having a policy.d in /etc/neutron. I didn't noticed that oslo_policy was looking outside the venv for conf files13:55
ihrachyshkaamuller, yeah, but note that neutron hacked oslo.policy syntax around and has additional semantics to apply policy to subattrs13:56
ihrachyshkaso that won't be documented in oslo.policy docs13:56
amullerah ha13:56
ihrachyshkaI feel we need it documented in devref, but I hardly am in the position now to be able to do it properly.13:56
*** nyechiel has quit IRC13:57
*** nyechiel has joined #openstack-neutron13:57
* ihrachyshka winks at salv-orlando13:57
*** nyechiel_ has quit IRC13:58
ihrachyshkamatrohon, well, if it indeed looks outside, then it should be fixed13:58
ihrachyshkaI thought I did before, let me check the base test class13:58
openstackgerritMadhu Mohan proposed openstack/neutron: Redundant tests removed from ovs-lib unit tests:  https://review.openstack.org/20886013:58
*** johnbelamaric has joined #openstack-neutron13:59
ihrachyshkamatrohon, yeah, so neutron/tests/etc/neutron.conf is enforced in master: http://git.openstack.org/cgit/openstack/neutron/tree/neutron/tests/base.py#n25313:59
*** achippa has joined #openstack-neutron14:00
ihrachyshkamatrohon, and my understanding is that default policy_dir is relative to the root where neutron.conf is found14:01
ihrachyshkaso unless the test adds more config options, it should work14:02
*** arajagopal has joined #openstack-neutron14:02
ihrachyshkalet me experiment locally though :)14:02
*** jecarey has joined #openstack-neutron14:02
matrohonihrachyshka : ok thanks. If you create a policy.d in  /etc/neutron, it should fail14:03
ihrachyshkamatrohon, it doesn't for me14:04
*** nyechiel has quit IRC14:04
matrohonihrachyshka : ho!14:04
ihrachyshkamatrohon, does your tree include 54fc39308277d4aedc3e399286714d719ecacfbb ?14:04
openstackgerritKyle Mestery proposed openstack/neutron: lieutenants: Add Neutron infra lieutenants  https://review.openstack.org/21263814:04
*** shwetaap has joined #openstack-neutron14:04
matrohonihrachyshka : yep14:05
*** achippa has quit IRC14:05
ihrachyshkamatrohon, no idea :) but it works here locally, it should not attempt to read anything outside the neutron source tree14:06
*** dmartin has joined #openstack-neutron14:06
*** merooney has quit IRC14:07
openstackgerritAndreas Scheuring proposed openstack/neutron: [WIP] Refactored configuration option to look more like OVS  https://review.openstack.org/21316314:09
openstackgerritAnn Kamyshnikova proposed openstack/neutron-vpnaas: Test change for template of test_migrations in for out-of-tree plugin/driver  https://review.openstack.org/20994314:09
*** pc_m has quit IRC14:09
openstackgerritRyan Moats proposed openstack/neutron: Add dashboard folder and graphite dashboard to doc  https://review.openstack.org/21314114:10
matrohonihrachyshka : I recreated the policy.d in my /etc/neutron, and test passed !14:10
*** pc_m has joined #openstack-neutron14:10
regXboi salv-orlando: I'll give you one good comment out of the set :)14:11
ihrachyshkamatrohon, meh.14:11
regXboithe rest are ones I'll happily ignore or push back on :)14:11
matrohonihrachyshka : I wonder if there is an issue with the oslo_policy cache14:11
ihrachyshkacould be, I'll check the code14:11
*** itzikb has joined #openstack-neutron14:12
*** garyk has quit IRC14:12
*** merooney has joined #openstack-neutron14:13
*** dmartin is now known as dmartls114:14
*** itzikb has quit IRC14:14
*** itzikb has joined #openstack-neutron14:14
amullerajo: there's one question I had that I didn't have time to check myself yet14:15
*** dmartls1 has quit IRC14:16
*** dmartls1 has joined #openstack-neutron14:16
amullerajo: is it possible for the OVS agent to start, then have the QoS driver receive a notification about a port<-->policy binding, before that port is plugged?14:16
amullerajo: is that case handled correctly?14:16
ihrachyshkamatrohon, ok, I think I see a gap in test isolation14:16
*** dmartls1 has joined #openstack-neutron14:16
*** prad_ has joined #openstack-neutron14:16
*** prad_ is now known as pradk14:17
*** gsagie_ has quit IRC14:17
matrohonihrachyshka : oh, cool!14:17
*** garyk has joined #openstack-neutron14:17
*** baoli has joined #openstack-neutron14:17
matrohonihrachyshka : I'm not sure a lot of project are using the policy.d, but we do : https://review.openstack.org/#/c/207914/14:18
ihrachyshkamatrohon, do you know it's deprecated?14:18
matrohonihrachyshka : oh didn't noticed!!14:19
ihrachyshkamatrohon, see https://bugs.launchpad.net/oslo.policy/+bug/142833214:19
openstackLaunchpad bug 1428332 in oslo.policy "remove the policy_dirs option" [Medium,Confirmed]14:19
*** chlong has quit IRC14:19
*** vivek-eb_ has joined #openstack-neutron14:20
ihrachyshkabut maybe it will be revisited not to remove, see comments14:20
ihrachyshkamatrohon, are you able to reproduce it now?14:20
matrohonihrachyshka : I re run devstack with the bgpvpn project that adds a file in policy.d, but tests in neutron keep passing...14:21
scheuransc68cal, FYI, I pushed up another patchset adapting the configuration options to look more like ovs: https://review.openstack.org/#/c/213163/14:22
*** baoli has quit IRC14:22
*** fawadkhaliq has quit IRC14:22
ihrachyshkamatrohon, I think I am at least able to get a failure due to wrong content in policy.d in /etc/neutron14:22
*** vivek-ebay has quit IRC14:22
ihrachyshkamatrohon, so I'll fix it and will assume it will fix your issue too :)14:22
*** itzikb has quit IRC14:23
*** numan has joined #openstack-neutron14:23
matrohonihrachyshka : great. the policy_dirs option is deprecated, but what I understood on the ML is that oslo_policy will keep on searching files in the policy.d of each project, am I wrong14:23
ihrachyshkaah right, sorry14:24
HenryGihrachyshka: ping14:24
salv-orlandomatrohon: correct, the option is deprecated, but the concept of policy directory stays14:24
ihrachyshkaHenryG, hey14:25
salv-orlandoand ihrachyshka yes I will document that thing. Eventually.14:25
*** kawa2014 has quit IRC14:26
*** kawa2014 has joined #openstack-neutron14:27
*** yamahata has joined #openstack-neutron14:27
HenryGihrachyshka: regarding the contract alembic branch. I am trying '... upgrade liberty_contract@head' and it does not seem to work?14:27
HenryGihrachyshka: at least for this one: https://review.openstack.org/21220914:27
ihrachyshkahow does it fail?14:28
HenryGIt runs no scripts14:28
pc_mdougwig: mestery: ping14:28
*** absubram has joined #openstack-neutron14:30
HenryGihrachyshka: history shows only expand branch14:30
*** stanzgy_ has quit IRC14:30
*** yog_ has quit IRC14:30
openstackgerritAnn Kamyshnikova proposed openstack/neutron-vpnaas: Add model for 'cisco_csr_identifier_map' table  https://review.openstack.org/21317414:32
ihrachyshkaHenryG, let me check14:32
*** bharath has joined #openstack-neutron14:32
HenryGihrachyshka: oops, never mind14:33
ihrachyshkaworks forme14:33
ajoamuller, in that case, when the port is reprocessed, the policy will be pulled from server14:33
ajo(at ovs agent restart I mean)14:33
ihrachyshkaand the rule applies fine too14:33
HenryGihrachyshka: too many git review branches, all alike :(14:33
ajoyep14:34
amullerajo: is it possible that the port won't be in the OVSDB and that the qos driver will fail to set attributes on the port?14:34
ihrachyshkaHenryG, :) I stopped keeping stuff locally, and use git review -d only14:34
HenryGihrachyshka: That's what I am doing. I still get mixed up :(14:34
ajoamuller, what do you mean?14:35
ajoif we get a port update, but the port is gone?14:35
HenryGihrachyshka: yep it works fine14:35
amullerajo: you got a port update on a port that wasn't plugged by the agent yet14:35
amullerajo: I don't think this matters though because you probably can't get a port update before nova plugged qvo in to br-int14:35
amullerI hopew14:36
amullerhope*14:36
ajoamuller, it's a good question, I may need to re-look at the extension manager code/ovs plug point.14:36
ajoamuller: 1 min14:36
amullerajo: the reason I'm asking is because the qos driver and the main ovs agent rpc loop are separate14:36
amullerso that's where this question is coming from14:36
ajoamuller, I found neutron.policy throwing an exception due to bad code :)14:36
ajoin log_rule_list14:36
ajologging doesn't seem to have "DEBUG" anymore14:37
*** annegentle has joined #openstack-neutron14:37
openstackgerritMike Dorman proposed openstack/neutron: Add API extension for reporting IP address usage statistics  https://review.openstack.org/21295514:37
*** bharath has quit IRC14:37
ajowe look up for oslo_logging.DEBUG14:37
ajoamuller, but the port updates arrive via the main agent rpc loop14:37
amullerajo: what if the update was because you added a rule?14:38
amullerand not changed the port14:38
amullersay you have a policy attached to a port and now you added/removed a rule14:38
*** minwang2 has joined #openstack-neutron14:38
ajoyes, but that's not a port update, it's a policy update :)14:38
amullerok, yes :)14:38
amullerso, that14:38
ajoat that point, the port won't be "known" to the qos extension,14:38
*** absubram has quit IRC14:38
ajoso it won't be processed14:39
ajobecause it didn't still get the port event from the main loop14:39
amullerajo: are you 100% that case is processed correctly?14:39
amullerand doesn't get a keyerror or something?14:39
openstackgerritfumihiko kakuma proposed openstack/neutron: Python 3: encode or decode i/o data of Popen.communicate()  https://review.openstack.org/20884814:39
*** absubram has joined #openstack-neutron14:41
ajoamuller, 99%, the 1% extra would be adding testing for it, but let me re-read the code to make sure that what I'm saying is correct14:41
*** lajos-katona has left #openstack-neutron14:42
*** alejandrito has joined #openstack-neutron14:44
ajoamuller, now I'm 100% sure you're right ;)14:44
ajothere's a bug14:44
*** stanzgy_ has joined #openstack-neutron14:44
*** scheuran has quit IRC14:44
amulleryay I did something useful today heh14:44
ajoamuller: _process_updated_policy will fail14:44
amullerajo: do you just wanna add it to the etherpad?14:44
amullerajo: handle it later14:45
ajobecause we look into our self.qos_policy_ports[qos_policy.id]14:45
ajowithout having retrieved such policy first...14:45
ajoamuller: yes, we need to handle that14:45
ajothanks!!! :)14:45
openstackgerritAnn Kamyshnikova proposed openstack/neutron-vpnaas: Add index for tenant_id for 'cisco_csr_identifier_map' table  https://review.openstack.org/21317414:45
amullerajo: I'll add it to the pad14:45
*** Murali__ has quit IRC14:46
*** bharath has joined #openstack-neutron14:47
openstackgerritAnn Kamyshnikova proposed openstack/neutron-vpnaas: Test change for template of test_migrations in for out-of-tree plugin/driver  https://review.openstack.org/20994314:48
*** yamamoto has quit IRC14:48
ajoamuller, I found how the policy works, but without referencing the service:     "get_policy": "rule:admin_only",14:48
*** numan has quit IRC14:49
ajoI'd prefer the get_qos-policy notation, if that worked14:49
alejandritohi, we have a KILO cloud under ubuntu, after a total power off of the cloud after restarting rabbitmq, mysql databases and every service, half of the instances (on the compute nodes) dont have the tap interfaces on their XML's and the linux interfaces tap - qvo - qvbe never gets created, doing hard reboots, etc doesnt recreate the taps, someone ran into this problem ?14:51
*** cdl has joined #openstack-neutron14:52
*** yamamoto has joined #openstack-neutron14:52
*** zzzeek has joined #openstack-neutron14:54
*** cdl has left #openstack-neutron14:54
*** r-daneel has joined #openstack-neutron14:55
*** piyanai has joined #openstack-neutron14:55
*** flaviof has joined #openstack-neutron14:57
*** vthapar has joined #openstack-neutron14:57
*** absubram has quit IRC14:57
*** carl_baldwin has joined #openstack-neutron14:57
*** anshul has quit IRC14:58
*** yapeng has joined #openstack-neutron14:59
*** liudong has joined #openstack-neutron15:02
*** lyanchih has joined #openstack-neutron15:03
*** TrevorV has joined #openstack-neutron15:05
*** jobewan has quit IRC15:06
*** absubram has joined #openstack-neutron15:06
*** agireud has joined #openstack-neutron15:09
*** mlavalle has joined #openstack-neutron15:10
*** annegentle has quit IRC15:11
*** armax has joined #openstack-neutron15:11
*** moha_hunt has joined #openstack-neutron15:12
*** annegentle has joined #openstack-neutron15:12
*** merooney has quit IRC15:12
openstackgerritRossella Sblendido proposed openstack/neutron: OVS agent rename variable in get_peer_name method  https://review.openstack.org/21319115:13
*** abregman has joined #openstack-neutron15:13
*** banix has joined #openstack-neutron15:14
*** dannywilson has joined #openstack-neutron15:15
*** baojg has joined #openstack-neutron15:15
openstackgerritGal Sagie proposed openstack/neutron: Add lieutenants contact for kuryr  https://review.openstack.org/21313315:16
*** dannywilson has quit IRC15:16
*** dannywilson has joined #openstack-neutron15:17
*** Piet has quit IRC15:19
openstackgerritAnn Kamyshnikova proposed openstack/neutron: Template for ModelMigrationTest  https://review.openstack.org/21319415:20
*** jobewan has joined #openstack-neutron15:21
*** prad_ has joined #openstack-neutron15:21
*** ihrachyshka has quit IRC15:22
*** madhu_ak has joined #openstack-neutron15:22
pc_mmestery: ping15:22
*** crose has quit IRC15:23
mesterypc_m: pongalongdingdong15:23
pc_mmestery: So the stable/kilo patch is upstreamed. Looks like that is all set.15:24
* pc_m Yaya15:24
pc_mmestery: There are two other steps needed... one is a devstack plugin fix, and one is a neutronclient fix.15:24
*** yamamoto has quit IRC15:25
pc_mmestery: For the latter, I talked to mtreinish and the suggestion is to create a new job for neutronclient that tests the VPN APIs (only).15:25
mtreinishpc_m: that's a suggestion for everything btw. If there is vpn usage somewhere its a separate job (except on the vpnaas repo's in tree tests)15:26
*** ritesh has quit IRC15:26
pc_mmestery: I'll start working on that change to the commits I have.15:27
*** ritesh has joined #openstack-neutron15:27
*** abregman is now known as abregman|afk15:27
*** jistr is now known as jistr|mtg15:29
*** prad_ has quit IRC15:29
pc_mmestery: For devstack, I have a bug out right now, where two agent processes are being started. It can be solved in two different ways.15:29
pc_mmestery: One is to rename the service to neutron-vpnaas in plugin, and change devstack script to not start up q-vpn service, if neutron-vpnaas is enabled (a 3 line change).15:30
*** jlibosva has joined #openstack-neutron15:31
kfox1111DVR question. Say I have two vm's, both with floating ip's on an external network, and they are on different physical hosts and different tenants. If one contacts the floating ip of the other, does the traffic go over the tunnel network or the external network?15:31
*** openstackgerrit has quit IRC15:31
pc_mmestery: The other is to remove VPN setup from devstack script (and still rename the plugin service to get away from q-vpn).15:31
*** openstackgerrit has joined #openstack-neutron15:32
pc_mmestery: The latter is a bigger change obviously.  I have patches for both paths. Which should I pursue at this time?15:32
*** absubram has quit IRC15:32
*** yamamoto has joined #openstack-neutron15:35
*** lazy_prince has quit IRC15:36
*** leitan has joined #openstack-neutron15:36
*** SourabhP has joined #openstack-neutron15:38
*** nlahouti has joined #openstack-neutron15:38
*** absubram has joined #openstack-neutron15:38
amullermestery: please see my comment on https://review.openstack.org/#/c/212170/15:39
*** SourabhP_ has joined #openstack-neutron15:39
*** redbeard has joined #openstack-neutron15:40
openstackgerritMichael Bayer proposed openstack/neutron: Implement expand/contract autogenerate extension  https://review.openstack.org/20384215:40
*** rkukura has quit IRC15:41
*** nfedotov has quit IRC15:41
mesteryamuller: Thanks for that :)15:42
openstackgerritMichael Bayer proposed openstack/neutron: Implement expand/contract autogenerate extension  https://review.openstack.org/20384215:42
pc_mmestery: question ^^15:42
*** SourabhP has quit IRC15:43
*** SourabhP_ is now known as SourabhP15:43
mesterypc_m: Looking, your's requires a bit more thinking15:43
*** zhenguo has quit IRC15:43
mesterypc_m: IF the former (the smaller fix) is easiest, perhaps we pursue that one first.15:44
*** alex_klimov has quit IRC15:44
mesterypc_m: I think dougwig should be online in a little while, lets get that one out, add dougwig and me to it, and see what we can do15:44
pc_mmestery: ok. Will do.15:45
openstackgerritOleg Bondarev proposed openstack/neutron: Ensure l3 agent receives notification about added router  https://review.openstack.org/21037815:45
*** abregman_ has joined #openstack-neutron15:45
HenryGWhy are there two 'Routes' in requirements.txt?15:45
HenryGlifeless: ping15:48
kfox1111DVR question. Say I have two vm's, both with floating ip's on an external network, and they are on different physical hosts and different tenants. If one contacts the floating ip of the other, does the traffic go over the tunnel network or the external network?15:48
*** abregman|afk has quit IRC15:48
*** armax has quit IRC15:48
*** amuller is now known as amuller_afk15:48
*** obondarev has joined #openstack-neutron15:49
*** rushil has joined #openstack-neutron15:49
*** piyanai has quit IRC15:49
*** dsneddon has joined #openstack-neutron15:53
mesteryI need a second core to look at this one: https://review.openstack.org/#/c/211760/15:54
mesteryIt is needed to resolve the vpnaas issues happening now15:54
mesteryHenryG: ^^^15:54
* HenryG looks ...15:55
pc_mmestery: What failures are seen?15:55
*** ivar-lazzaro has joined #openstack-neutron15:55
mesterypc_m: dougwig indicated we need this one and the dependent VPN change merged today to finish the cleanup15:56
*** piyanai has joined #openstack-neutron15:56
mesteryDependent VPN change is here: https://review.openstack.org/#/c/211758/15:56
pc_mmestery: I thought this was a fallback for potential stable/kilo failure and that was resolved with a different commit.15:57
mesterypc_m: I'm just going by what dougwig indicated to me this morning :)15:57
pc_mmestery: Guess I'm missing something then. Do you have an example of a failing API test?15:58
*** jprovazn has joined #openstack-neutron15:58
mesterypc_m: The revert for https://review.openstack.org/#/c/211642/ was what fixed the failing API tests I think15:58
*** vthapar has left #openstack-neutron15:59
*** arajagopal has quit IRC16:00
pc_mmestery: Guess I'm lost.16:01
*** jprovazn has quit IRC16:01
mesterypc_m: Me too perhaps, I'm just going by what dougwig indicated in a cryptic message to me this morning :)16:02
pc_mmestery: I don't understand what tests are failing, on which branch, and why the existing plugin enable does not resolve it.16:02
*** jistr|mtg is now known as jistr16:03
mesteryMe either pc_m16:03
*** baoli has joined #openstack-neutron16:03
pc_mmestery: Maybe after the original issue with stable/kilo, I'm being overly cautious, but for the moment, I'll sit on the sidelines on this change as I don't understand it enough.16:04
*** mitchjameson has joined #openstack-neutron16:04
*** matrohon has quit IRC16:04
*** jlibosva has quit IRC16:04
*** arajagopal has joined #openstack-neutron16:04
pc_mmestery: I thought all tests are currently working - excepted skipped tests in neutronclient.16:04
*** armax has joined #openstack-neutron16:05
*** kawa2014 has quit IRC16:06
dougwigThe reviews above fix grenade in stable due to a neutron big, not Vpnaas16:07
*** baoli has quit IRC16:08
dougwigBug16:08
*** SourabhP has quit IRC16:08
*** banix has quit IRC16:09
pc_mthanks dougwig. Is there a plan to clean that up latter and remove it, once LB/VPN confs are commented out?16:09
* pc_m if my understanding of .conf files causing issue.16:09
*** merooney has joined #openstack-neutron16:09
*** gsagie_ has joined #openstack-neutron16:11
openstackgerritMike Dorman proposed openstack/neutron: Add API extension for reporting IP address usage statistics  https://review.openstack.org/21295516:11
pc_mdougwig: Is the issue because of the issue I saw with grenade not handling nested upgrades, when I tried to do VPN grenade plugin?16:11
*** rossella_ has quit IRC16:12
*** banix has joined #openstack-neutron16:13
openstackgerritMatthew Treinish proposed openstack/neutron: Fix some issues around tempest in fullstack testing doc  https://review.openstack.org/21322516:15
mtreinishmestery: ^^^ should be a fairly quick review16:16
mesterymtreinish: Looking at it now16:16
mesteryamuller_afk: Also look at the above once you return16:17
mtreinishEnglish is barely my first language, so I'm sure I screwed some wording up16:17
mesterylol16:18
*** enikanorov2 has quit IRC16:20
*** gangil has joined #openstack-neutron16:21
*** merooney has quit IRC16:21
*** jlanoux has quit IRC16:21
*** Sukhdev has joined #openstack-neutron16:22
*** arajagopal has quit IRC16:23
openstackgerritRoman Podoliaka proposed openstack/neutron: wip: debug lp 1480698  https://review.openstack.org/21322916:23
openstackLaunchpad bug 1480698 in oslo.db "MySQL error - too many connections" [Undecided,New] https://launchpad.net/bugs/148069816:23
*** baojg has quit IRC16:23
*** daneyon has joined #openstack-neutron16:23
*** baojg has joined #openstack-neutron16:24
Sukhdevkevinbenton: Here is the updated spec based upon our discussion yesterday - https://review.openstack.org/#/c/212857/16:24
*** abregman_ has quit IRC16:25
*** merooney has joined #openstack-neutron16:25
*** suresh12 has joined #openstack-neutron16:25
*** enikanorov2 has joined #openstack-neutron16:26
*** baojg has quit IRC16:28
*** SumitNaiksatam has quit IRC16:28
*** baojg has joined #openstack-neutron16:29
*** dsneddon has quit IRC16:29
*** SumitNaiksatam has joined #openstack-neutron16:30
*** madhu_ak has quit IRC16:31
*** piyanai has quit IRC16:31
*** madhu_ak has joined #openstack-neutron16:31
*** spandhe has joined #openstack-neutron16:31
*** jpena has quit IRC16:32
*** jistr has quit IRC16:32
openstackgerritHenry Gessau proposed openstack/neutron: Remove Cisco Meta and N1KV monolithic plugins  https://review.openstack.org/21220916:32
*** rkukura has joined #openstack-neutron16:33
*** Piet has joined #openstack-neutron16:33
*** spandhe has quit IRC16:35
*** baojg has quit IRC16:35
*** spandhe_ has joined #openstack-neutron16:35
*** krypto has joined #openstack-neutron16:36
banixkevinbenton: I asked you a question about router update the other day. So it turns out this is what happens: When a router gets created, the l3 agent receives and update router call astart processing; Then nothing happens that I can see in the logs, systems is not loaded (even though there are hundreds of routers) and then after 10 minutes or so which happens to be the rpc response timeout time on the server side l3 starts doin16:36
banixwhat it has to do, create namespace add rules, etc. Not sure if the rpc response time out is related but that is what i have on the system. Any thoughts?16:36
*** rushil has quit IRC16:37
*** minwang2 has quit IRC16:37
kryptois there any way to change hostname of instance by changing its instance name?16:37
*** abregman_ has joined #openstack-neutron16:38
*** rushil has joined #openstack-neutron16:38
*** apuimedo has quit IRC16:39
*** yamamoto has quit IRC16:41
*** amuller_afk is now known as amuller16:41
*** yamamoto has joined #openstack-neutron16:41
*** abregman_ has quit IRC16:41
*** regXboi has quit IRC16:41
*** salv-orlando has quit IRC16:42
*** abregman has joined #openstack-neutron16:42
*** abregman has quit IRC16:42
*** jecarey has quit IRC16:42
*** aranjan has joined #openstack-neutron16:42
*** yamamoto has quit IRC16:42
*** lazy_prince has joined #openstack-neutron16:45
*** bharath has quit IRC16:46
*** piyanai has joined #openstack-neutron16:48
amullermestery: mtreinish: done16:49
mesteryamuller: Awesome, thanks :)16:50
*** aranjan has quit IRC16:51
mtreinishamuller: thanks, I'll respin it after I get some food16:51
*** aranjan has joined #openstack-neutron16:51
*** aranjan has quit IRC16:51
*** aranjan has joined #openstack-neutron16:52
*** gsagie_ has quit IRC16:52
*** rushil_ has joined #openstack-neutron16:53
*** madhu_ak_ has joined #openstack-neutron16:55
*** rushil has quit IRC16:56
banixamuller: do you have any thought on the l3 agent issue I have:. Repeating it from earlier here: it turns out this is what happens: When a router gets created, the l3 agent receives an update router call sating start processing; Then nothing happens that I can see in the logs, systems is not loaded (even though there are hundreds of routers) and then after 10 minutes or so which happens to be the rpc response timeout time on the16:57
banixserver side l3 starts doing what it has to do, create namespace add rules, etc. Not sure if the rpc response time out is related but that is what i have on the system. Any thoughts?16:57
*** madhu_ak has quit IRC16:57
*** davidjc has joined #openstack-neutron16:57
amullerbanix: never really seen anything like that before16:58
amullerbanix: if you enable verbose and debug, do you have an idea of when does the agent hang?16:58
*** padkrish has joined #openstack-neutron16:58
banixamuller: thanks for the response. i have the debug on; agent doesnt hang; says start processing and does nothing. continues by reporting back its health and receiving other requests16:59
*** suresh12 has quit IRC16:59
amullerbanix: but that specific routing processing does hang on some line16:59
*** mickeys has joined #openstack-neutron17:00
banixamuller: so this is the last i get from this particular router:17:00
*** _cjones_ has joined #openstack-neutron17:00
banix2015-08-14 02:34:10.417 13051 DEBUG neutron.agent.l3_agent [req-6fceeee4-84ce-4778-b98d-520992edbdcd None] Got routers updated notification :[u'bb1a2593-cb72-494c-a98f-dd2225dc892b'] routers_updated /usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py:174717:00
banixthis is with Juno17:00
banixnext thing i see is 10 minutes later:17:01
banix2015-08-14 02:44:25.775 13051 DEBUG neutron.agent.linux.utils [-] Running command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-bb1a2593-cb72-494c-a98f-dd2225dc892b', 'ip', '-o', '-d', 'link', 'list'] create_process /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:4617:01
banixand eventually:17:01
*** yapeng has quit IRC17:01
banix2015-08-14 02:44:28.501 13051 DEBUG neutron.agent.l3_agent [-] Finished a router update for bb1a2593-cb72-494c-a98f-dd2225dc892b _process_router_update /usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py:183517:01
amullerbanix: I'd try sticking in a bunch of DEBUG level logs in there to narrow down when does it hang17:03
banixthe above is from adding a new fip, I see the same pattern when the router gets created. I see the first line above and saying start processing router update. Then several minutes later i see the namespace getting created17:03
dougwigmestery: indeed, the infra patch thing was not related to qos.17:03
dougwigpc_m: ack17:03
*** sthillma has joined #openstack-neutron17:03
openstackgerritMerged openstack/neutron: Setup reference service providers for API test runs  https://review.openstack.org/21176017:03
banixamuller: sure. thanks. I think it hangs at the rpc call getting resync_router17:04
openstackgerritPaul Michali proposed openstack/neutron-vpnaas: VPNaaS: Use new service name for devstack plugin  https://review.openstack.org/21325317:04
*** madhu_ak has joined #openstack-neutron17:04
mesterydougwig: I'm balancing a lot of things and doing most of them poorly. I apologize :(17:05
*** Kennan2 has quit IRC17:05
*** madhu_ak_ has quit IRC17:05
mesterydougwig armax: Your blessing is required here: https://review.openstack.org/#/c/212638/17:05
*** suresh12 has joined #openstack-neutron17:05
spandhe_kevinbenton: hey, are you coming in today for Ironic mid-cycle?17:05
*** liudong has quit IRC17:06
*** park_ has quit IRC17:06
armaxmestery: may the force be with you17:07
*** sthillma_ has joined #openstack-neutron17:07
mesteryarmax: I'm working on getting you the pager you requested, bear with me17:07
*** yamahata has quit IRC17:07
armaxmestery: so only +1 until I get that paper17:08
mesteryarmax: You run a tight ship and have always been a tough negotiator17:08
*** liudong has joined #openstack-neutron17:09
armaxmestery: oh yeah17:09
*** madhu_ak_ has joined #openstack-neutron17:09
*** sthillma has quit IRC17:10
*** sthillma_ is now known as sthillma17:10
dougwigarmax: i'll send you a virtual page every second, if it makes you feel better.17:10
*** madhu_ak has quit IRC17:10
armaxdougwig: no thanks, I am not fooled17:10
*** crc32 has joined #openstack-neutron17:11
mesterydougwig: I think armax wants a fancy-pants pager rather than virtual17:11
armaxmestery: I am old fashioned17:12
*** crc32 has quit IRC17:13
*** minwang2 has joined #openstack-neutron17:13
mesteryarmax: http://liquor.s3.amazonaws.com/wp-content/uploads/2012/09/bourbon-old-fashioned.jpg17:13
*** ivar-lazzaro has quit IRC17:15
*** ivar-lazzaro has joined #openstack-neutron17:16
*** achanda has joined #openstack-neutron17:16
*** 17SADBVNB has joined #openstack-neutron17:17
*** david-lyle is now known as cbrown17:17
dhellmanndougwig: I understand from markmcclain that you're working on a devstack-gate issue with neutron, and we're getting reports of odd failures in oslo.messaging jobs where devstack thinks neutron isn't running, but the service log seems to indicate that it is. Do those symptoms match the problem you're working on?17:17
dhellmanndougwig: for example, this innocuous patch: https://review.openstack.org/#/c/210664/17:18
*** cdl has joined #openstack-neutron17:18
*** park_ has joined #openstack-neutron17:18
*** cdl has left #openstack-neutron17:19
markmcclainarmax, mestery: does that mean 212638 can be approved?17:20
*** Kennan has joined #openstack-neutron17:21
mesterymarkmcclain: From my perspective, yup. From armax's, it depends on how many old fashion's he's ingested this afternoon ;)17:21
* markmcclain send armax bottle of bourbon17:21
*** 17SADBVNB has quit IRC17:21
mesterylol17:21
*** salv-orlando has joined #openstack-neutron17:22
mesterydhellmann: That sounds like a separate issue than what dougwig is working on. The one he's working on is a failure in grenade.17:22
mesterydhellmann: You've identified another separate issue here I believe17:22
armaxdesdain17:22
dhellmannmestery: what do I win?17:22
armaxI am going to take this out of the queu17:23
armaxe17:23
mesterydhellmann: You can share an old fashioned with armax :)17:23
dhellmannmestery: no fruit in min, please17:23
dhellmann*mine17:23
*** achanda has quit IRC17:23
*** geekinutah has quit IRC17:23
mestery:)17:23
openstackgerritShraddha Pandhe proposed openstack/neutron: Propose ISC-DHCPD Driver for Neutron DHCP Agent  https://review.openstack.org/21283617:23
armaxoh btw, mestery: can I get a job description?17:24
armaxmestery: not sure what the work involves17:24
armax‘interactions' seems a big vague17:24
mesteryarmax: Yes: You will be known as "Counter Manager, DMV Office of License Approvals"17:25
*** banix has quit IRC17:25
pc_mmestery: dougwig: ushed up fix for VPN devstack plugin -> https://review.openstack.org/#/c/213228 and https://review.openstack.org/#/c/213253/17:25
armaxok, then I want a rubber stamp too besides the pager17:26
dhellmannmestery: hmm, looking at the times in these logs it appears neutron isn't even started until after devstack gives up and times out. Do you know if there were changes in the way neutron is started in devstack recently?17:26
*** krypto has quit IRC17:26
mesteryarmax: With pleasure17:26
armaxmestery: and a 1G coffee mug17:26
mesterydhellmann: I'm afraid I'm not aware of that recently, I'm wondering if dougwig may know of anything there.17:26
*** abhiraut has joined #openstack-neutron17:26
mesterydhellmann: Let me look at some recent merges and see17:26
*** crc32 has joined #openstack-neutron17:27
*** rushil_ has quit IRC17:27
*** rushil has joined #openstack-neutron17:28
*** ivar-lazzaro has quit IRC17:28
*** ivar-lazzaro has joined #openstack-neutron17:28
*** piyanai has quit IRC17:29
*** ircuser-1 has quit IRC17:30
*** cdl has joined #openstack-neutron17:30
*** madhu_ak has joined #openstack-neutron17:32
dhellmannmestery: oh, nevermind, I can't read timestamps. Neutron is starting, but the wget to check it is failing for some reason.17:33
*** ajmiller_ has joined #openstack-neutron17:33
*** piyanai has joined #openstack-neutron17:33
dhellmannmestery, dougwig : did the neutron API change its behavior if you hit the base URL?17:33
mesterydhellmann: Not that I'm aware of, no. Is this a sporadic issue, or does it happen all the time?17:34
*** baoli has joined #openstack-neutron17:34
dhellmannmestery: it looks like all of the open patches to oslo.messaging are failing. I'm checking to see if they have the same symptoms now.17:34
*** sthillma has quit IRC17:34
mesterydhellmann: Ack on that. Just FYI, I'm in meetings for the next 1.5 hours, so may be a bit async here.17:35
*** madhu_ak_ has quit IRC17:35
*** madhu_ak has quit IRC17:35
*** yamahata has joined #openstack-neutron17:35
*** madhu_ak has joined #openstack-neutron17:36
*** ajmiller has quit IRC17:36
*** jwy has joined #openstack-neutron17:36
dhellmannmestery: I've found at least one case where it did start and then was not responsive later ("Unable to establish connection to http://127.0.0.1:9696/v2.0/networks.json") so I wonder if it's dying quietly somehow17:36
*** jobewan has quit IRC17:37
*** mickeys has quit IRC17:37
mesterydhellmann: Looking here http://logs.openstack.org/64/210664/3/check/gate-tempest-dsvm-neutron-src-oslo.messaging/939ca47/logs/screen-q-svc.txt.gz17:37
mesterydhellmann: That's from the log you mentioned above, it looks like it's running at least17:37
dhellmannmestery: another patch failed a little further on: http://logs.openstack.org/95/194295/8/check/gate-tempest-dsvm-neutron-src-oslo.messaging/d61e835/logs/devstacklog.txt.gz17:37
*** madhu_ak_ has joined #openstack-neutron17:38
*** baoli has quit IRC17:39
mesterydhellmann: Ack on that, this one failed creating a network17:39
dhellmannmestery: and neutron-server doesn't seem to be running at the time the job is cleaning up http://logs.openstack.org/95/194295/8/check/gate-tempest-dsvm-neutron-src-oslo.messaging/d61e835/logs/ps.txt.gz17:40
mesterydhellmann: I was just looking there as well17:40
mesterydhellmann: So, for some reason, neutron is exiting17:40
openstackgerritCarol Bouchard proposed openstack/neutron: Final decomposition of ML2 Nexus Driver  https://review.openstack.org/21326617:41
*** geekinutah has joined #openstack-neutron17:41
*** madhu_ak has quit IRC17:41
dhellmannmestery: was it something I said? :-)17:42
*** yamamoto has joined #openstack-neutron17:43
*** abhiraut has quit IRC17:44
*** patrickeast has joined #openstack-neutron17:44
mesterylol17:45
*** bharath has joined #openstack-neutron17:47
*** yamamoto has quit IRC17:48
*** sdake has joined #openstack-neutron17:48
dhellmannmestery: I don't feel like I know enough about that service to be much help debugging. Do you have anyone on the team available to lend a hand? If only oslo.messaging is seeing this it is like to be in the unreleased library code, but it would help to have an app expert involved.17:49
*** sdake_ has quit IRC17:49
*** boris-42 has quit IRC17:50
mesterydhellmann: Let me ping some folks here, otherwise I'm available once these meetings are onde.17:50
*** davidjc has quit IRC17:50
mestery*done17:50
*** sdake_ has joined #openstack-neutron17:50
*** jobewan has joined #openstack-neutron17:50
mesteryHenryG amuller kevinbenton: Any time available to help dhellmann debug a neutron issue with the latest oslo.messaging above?17:51
amullermestery: I'm available in exactly 60 seconds17:51
mesteryamuller: Thanks, dhellmann, we've found your helper ;)17:52
*** aranjan has quit IRC17:52
leitanHi guys im having a really weird issue, after a total reboot of a two nodes Kilo dvr deployment, theres a couple of servers that doesnt recover their networking information, tap and veth pair is not creating on OVS, and of course not get defined on the xml, instance doesnt get any ip address17:52
leitanand theres no way to recover the taps17:52
*** bharath has quit IRC17:52
leitannew instances are created ok, tap and veth created ok, tap tagged17:52
leitanget ip, flow ok17:53
leitanbut i can see while hard rebooting that old instances, that the neetwork information its empty,17:53
leitananyone can lend me a hand ? first time i see this17:53
*** sdake has quit IRC17:53
dhellmannmestery, amuller : thanks!17:53
*** msno has quit IRC17:54
*** lyanchih has quit IRC17:54
HenryGamuller: let me know if I can help. I'll peek at the logs while eating lunch17:54
leitanif i delete the port from neutron, and create a new port from the subnet (same fixed ip)  , and attach it manually to nova, it recreate the taps, veths and everything (of course with a different id)17:55
*** Piet has quit IRC17:55
*** achanda has joined #openstack-neutron17:55
amullerdhellmann: I'll read scrollback, do you have any links for me to look at in the mean time?17:55
*** john-davidge has quit IRC17:58
*** crose has joined #openstack-neutron17:58
amullerdhellmann: so all open patches to oslo messaging are seeing this failure, where we currently believe neutron is basically crashing?17:58
amullerdhellmann: is this happening on any other job?17:58
*** bharath has joined #openstack-neutron17:59
dhellmannamuller: let me put together an etherpad17:59
dhellmannamuller: https://etherpad.openstack.org/p/wm2D6UGZbf17:59
*** annegentle has quit IRC18:00
*** aranjan has joined #openstack-neutron18:00
*** madhu_ak_ has quit IRC18:01
amullerdhellmann: I'm looking at the open oslo messaging patches to try and pinpoint the first failure18:08
*** abhiraut has joined #openstack-neutron18:08
*** padkrish has quit IRC18:09
*** padkrish has joined #openstack-neutron18:09
pc_mHey! Anyone know how to run "tox -e functional" in python-neutronclient repo? Is there some special setup needed first?18:09
*** jecarey has joined #openstack-neutron18:10
*** salv-orlando has quit IRC18:11
*** ivar-lazzaro has quit IRC18:12
openstackgerritAbhishek Raut proposed openstack/neutron: NSX: Move DB models as part of core vendor decomposition  https://review.openstack.org/21137018:13
*** ivar-lazzaro has joined #openstack-neutron18:13
*** shivrao has joined #openstack-neutron18:13
*** padkrish has quit IRC18:14
*** lilynn has joined #openstack-neutron18:15
*** saksham has joined #openstack-neutron18:15
dhellmannamuller: good idea18:15
*** SumitNaiksatam has quit IRC18:15
amullerdhellmann: last success was on the 5th, first failure on the 10th18:15
amullerdhellmann: looking at merged devstack, devstack-gate patches between those dates18:15
*** Piet has joined #openstack-neutron18:16
amullerdhellmann: failing that we can merge a patch to neutron that improves logging then rerun the job in oslo messaging18:16
dhellmannamuller: do you think the api-workers setting is relevant? 0 seems like an odd value there :-)18:16
*** suresh12 has quit IRC18:16
amullerdhellmann: it failed with both 4 and 0 so I dunno if that's the cause but I'm looking for the patch that fiddled with that18:17
amullerdhellmann: since it's only that oslo messaging src tempest job that's running, I'm guessing there might be something different about the job definition? might be worth looking in project-config18:17
amullerthat's failing* I mean18:17
*** ijw has joined #openstack-neutron18:19
*** cbouch has joined #openstack-neutron18:19
amullerdhellmann: can that job and the neutron tempest job use a different version of oslo_service?18:19
*** padkrish has joined #openstack-neutron18:19
dhellmannamuller: yeah, I'll dig up the job configuration18:19
dhellmannamuller: I don't believe it is possible for the 2 jobs to use a different version of a library, with the constraints in place18:20
amulleris the oslo messaging job using oslo libs from source while the neutron tempest job using libs from pip? If so a change in oslo_service HEAD would explain all of this18:20
dhellmannamuller: only oslo.messaging should be installed from source18:20
amullerdhellmann: damn :)18:20
dhellmannsorry :-)18:20
amullerdhellmann: we should diff the neutron tempest and oslo messaging tempest jobs, there must be something different18:20
*** vivek-eb_ has quit IRC18:21
*** Sukhdev has quit IRC18:22
dhellmannamuller: I don't see an obvious tempest job for neutron, based on scanning the jobs run for https://review.openstack.org/#/c/212571/18:24
openstackgerritMerged openstack/neutron: l3_db: not use L2 plugin _get_port unnecessarily  https://review.openstack.org/20235818:24
amullerdhellmann: look here for example https://review.openstack.org/#/c/212209/18:25
amullergate-tempest-dsvm-neutron-full18:25
dhellmannweird that those 2 patches have different jobs reporting18:25
amullerdhellmann: we have filters on the files changed in the patch18:25
dhellmanntricky18:26
amullerneutron always has to be special18:26
dhellmannI don't see any obvious differences in the variables set by the jobs18:27
dhellmannI don't think any other projects are seeing this, I wonder what we have unreleased in oslo.messaging18:27
*** tflynn has joined #openstack-neutron18:28
*** fawadkhaliq has joined #openstack-neutron18:30
openstackgerritMerged openstack/neutron: l3: not use L2 plugin _get_subnet unnecessarily  https://review.openstack.org/20235918:31
*** amtux has joined #openstack-neutron18:31
dhellmannthere are only 2 code patches, I'll submit reverts and see if either passes18:32
*** arajagopal has joined #openstack-neutron18:32
amullerdhellmann: thanks18:33
*** achanda has quit IRC18:33
*** suresh12 has joined #openstack-neutron18:35
amullerdhellmann: I compared pip freeze output of a neutron tempest run and an oslo messaging tempest run, nothing different in oslo libs apart from oslo messaging18:38
dhellmannamuller: good idea to confirm that18:39
openstackgerritCarol Bouchard proposed openstack/neutron: Final decomposition of ML2 Nexus Driver  https://review.openstack.org/21326618:40
*** gampel has joined #openstack-neutron18:41
amullerdhellmann: I'm gonna try and reproduce the issue on neutron master (try to crash without any logging)18:43
amulleraround the rpc initialization18:43
dhellmannamuller: sounds good, I'm going to work on something else for a bit while those reverts run, and I'll come back to this when I have logs to look at18:44
amullerdhellmann: roger that18:44
haleybkfox1111: regarding your question much earlier today, communication using FIPs with DVR will go via the external network as it needs to go throught NAT in both directions18:46
*** ijw has quit IRC18:47
openstackgerritMichael Bayer proposed openstack/neutron: Add non-model index names to autogen exclude filters  https://review.openstack.org/21330318:47
*** ijw has joined #openstack-neutron18:48
*** padkrish has quit IRC18:48
*** padkrish has joined #openstack-neutron18:48
amtuxhey guys! I am trying to deploy OS::Neutron::SecurityGroups via heat template. The model security rules I'm following have the protocol set as Integer(not TCP/ICMP/UDP/None). I am wondering if it is possible to replicate this with a heat template.18:51
dougwigdhellmann: when i look yesterday, it didn't look related.  sorry, traveling today. did you need one of us to dig deeper?18:52
dhellmanndougwig: amuller has been really helpful, thanks!18:52
dougwigdhellmann: ok, good.18:52
dhellmanndougwig: safe travels, and I'll see you at the meetup next week18:53
amtuxWhenever we try to deploy, it says that we cannot use an Integer for the protocol. Wondering if anyone ran into similar issues here?18:53
*** johnbelamaric1 has joined #openstack-neutron18:54
*** johnbelamaric has quit IRC18:57
kfox1111haleyb: Thats what I was thinking but wanted to double check. Thanks. :)18:58
*** rushil has quit IRC18:59
*** johnbelamaric has joined #openstack-neutron19:01
*** abhiraut has quit IRC19:02
*** agireud has quit IRC19:03
*** ijw has quit IRC19:04
*** sthillma has joined #openstack-neutron19:04
*** johnbelamaric1 has quit IRC19:04
*** carl_baldwin has quit IRC19:06
*** vivek-ebay has joined #openstack-neutron19:08
*** amtux has quit IRC19:14
*** fawadkhaliq has quit IRC19:14
*** padkrish has quit IRC19:15
*** padkrish has joined #openstack-neutron19:16
openstackgerritMatthew Treinish proposed openstack/neutron: Fix some issues around tempest in fullstack testing doc  https://review.openstack.org/21322519:16
mtreinishmestery, amuller, markmcclain: ^^^19:16
*** carl_baldwin has joined #openstack-neutron19:16
kevinbentonajo: ping19:17
pc_mdougwig: hi19:17
*** suresh12 has quit IRC19:18
*** gampel has quit IRC19:19
*** erlarese has quit IRC19:19
*** gampel1 has joined #openstack-neutron19:19
ajohi kevinbenton  pong19:20
ajohow're you doing?, can I help with something?19:20
kevinbentonajo: yeah, this passed tests, https://review.openstack.org/#/c/207464/19:20
kevinbentonajo: are you good with it now?19:20
ajokevinbenton, oh, yes it was looking good already a few patches ago, let me check the last diff19:21
ajokevinbenton: lol, I missed the double sad face change for the zone exhaustion19:23
ajoXDD19:23
openstackgerritSean M. Collins proposed openstack/neutron-fwaas: Add oslotest dependency to test-requirements  https://review.openstack.org/21130219:23
*** amtux has joined #openstack-neutron19:23
amullerdhellmann: we're not catching baseexception in the api server19:23
amullerdhellmann: so raising a systemexit in the right place, for example, results in the silent exit exactly like in the oslo messaging tempest job logs19:24
*** slaweq has joined #openstack-neutron19:24
*** boris-42 has joined #openstack-neutron19:24
amullerdhellmann: trying to figure out what's the right way to go about this19:25
dhellmannamuller: oh, fun!19:25
*** crc32 has quit IRC19:25
dhellmannI wonder which exception is really being raised19:26
amullerdhellmann: we can't really know without catching it19:26
dhellmannamuller: sys.excepthook might be the best solution here: http://pymotw.com/2/sys/exceptions.html#unhandled-exceptions19:26
kevinbentonajo: :)19:27
amullerdhellmann: I'll look in to it19:27
amullerdhellmann: thanks19:27
kevinbentonajo: i thought about putting a unicode crying face in there but I'm sure that would have made something explode19:27
*** minwang2 has quit IRC19:28
*** ajmiller_ has quit IRC19:28
*** aranjan has quit IRC19:28
*** minwang2 has joined #openstack-neutron19:28
kevinbentonamuller: isn't not catching baseexception intentional so it does exit?19:28
*** ajmiller has joined #openstack-neutron19:29
*** aranjan has joined #openstack-neutron19:29
amullerkevinbenton: take a look here http://logs.openstack.org/09/210909/4/check/gate-tempest-dsvm-neutron-src-oslo.messaging/fb90e77/logs/screen-q-svc.txt.gz19:29
kevinbentonamuller: or do we still have logic to handle regular exceptions19:29
kevinbentonamuller: and exit19:29
amullerkevinbenton: I was trying to locally reproduce that symptom19:29
amullerof a silent exit19:29
amullerkevinbenton: I ended up here: https://github.com/openstack/neutron/blob/master/neutron/server/__init__.py19:29
amullerkevinbenton: if you stick a raise systemexit() in say, line 58, you get exactly the logs I linked earlier19:30
*** amtux has quit IRC19:30
amullerkevinbenton: if you change line 62 to catch BaseException you log the systemexit exception, and exit19:31
kevinbentonamuller: that's catching way more than it should though19:32
kevinbentonamuller: like keyerrors, valueerrors, etc19:32
*** pc_m has quit IRC19:32
kevinbentonamuller: or is everything inheriting from that19:32
dhellmannamuller: if you submit a patch to neutron that reports the exception, I could recheck one of the patches in oslo.messaging that is failing and set it to depend on your patch19:33
amullerhmm I don't think that catching BaseException is correct19:33
*** aranjan has quit IRC19:33
amullerlet me try the unhandled exceptions hook19:33
kevinbentonamuller: +119:34
*** geekinutah has quit IRC19:34
kevinbentonamuller: or just catch SystemExit directly19:34
*** salv-orlando has joined #openstack-neutron19:35
*** ijw has joined #openstack-neutron19:35
*** enikanorov2 has quit IRC19:35
dhellmannamuller: this revert in oslo.messaging passed: https://review.openstack.org/#/c/213299/19:35
amullerkevinbenton: I don't think we're really interested in SystemExit specifically. We don't know why the server is exiting in the log I attached above, so I think we want to log *something*19:35
amullerkevinbenton: no matter why the process exit19:35
kevinbentonamuller: makes sense, exception hook sounds like a good idea19:35
amullerdhellmann: that's great news :)19:36
*** liudong has quit IRC19:36
dhellmannamuller: I would still like to see exactly what's failing, and then put something in place in neutron so we can revert this patch and test the un-revert properly19:36
dhellmannso let's continue with updating neutron to report the exception completely19:37
kevinbentonamuller: i can't tell from that log, is it exiting or deadlocking?19:37
amullerdhellmann: aye19:37
*** slaweq has quit IRC19:37
dhellmannkevinbenton: the ps log shows that the process has exited19:37
amullerkevinbenton: ps output in the failing jobs shows that neutron-server is not there19:37
kevinbentonack19:37
*** padkrish has quit IRC19:38
*** padkrish has joined #openstack-neutron19:38
kevinbentondhellmann: so if the revert fixes it, there must have been something on the neutron side that recently changed that broke it19:39
amullerdhellmann: kevinbenton: So the three exceptions that don't inherit from 'Exception' but do inherit from BaseException don't seem to be logged by the 'sys.excepthook = my_excepthook' approach either19:39
*** padkrish has quit IRC19:39
kevinbentondhellmann: since the original commit passed tests19:39
dhellmannkevinbenton: that patch isn't released in oslo.messaging, so only the messaging gate is blocked right now19:39
dhellmannkevinbenton: yeah, it must be a combination of the two, true19:40
*** padkrish has joined #openstack-neutron19:40
dhellmannamuller: :-/19:40
kevinbentonamuller: ugh, just add another 'except BaseException' and then log manually then19:40
dhellmannamuller: how about a WIP patch that catches BaseException so we can see what's happening, and then decide what to do based on what exception it is19:40
amullerpushing now19:42
ajokevinbenton, done.19:43
kevinbentonajo: thx19:43
ajoThank you for the patch :) more granularity for security groups.. :)19:43
kevinbentonajo: yeah, i wonder if it has an improvement on performance a bit for tracking connections19:44
kevinbentonajo: now that conntrack only has one VMs worth of connections in a zone19:44
ajokevinbenton, I haven't checked for iptables itself, but I remember ovsct having issues as you added more zones19:45
ajobecause of what it was looking like a bug in the zones lookup code from ovs...19:45
kevinbentonajo: ugh, what caused that?19:46
kevinbentonajo: oh19:46
*** achanda has joined #openstack-neutron19:46
ajoiptables was only affected very lightly19:46
ajokevinbenton: sec, I'll look for an email where I was discussing the issue, I barely remember19:46
*** lindycoder has quit IRC19:47
*** amtux has joined #openstack-neutron19:47
openstackgerritAssaf Muller proposed openstack/neutron: WIP: Catch BaseException  https://review.openstack.org/21331619:47
amullerdhellmann: kevinbenton: ^19:49
amullerdhellmann: so next step is to submit an empty patch to oslo messaging that depends on that patch ya?19:49
*** enikanorov2 has joined #openstack-neutron19:49
dhellmannamuller: https://review.openstack.org/#/c/213297/19:49
kevinbentonnow we wait!19:50
amullerdhellmann: awesome thanks19:50
*** crc32 has joined #openstack-neutron19:50
amullerkevinbenton: I have to say I don't understand why that WIP patch I submitted is correct in the general case19:50
amullersorry why it isn't correct19:50
dhellmannamuller: if I had written that exception handling block, I would have caught Exception instead of RuntimeError. My guess is this is a TypeError or something like that.19:52
amullerdhellmann: yeah at the very least19:52
amullerwhy would you not want to print the trace? I feel like I'm missing something basic19:52
dhellmannI think you do always want to print the trace19:53
*** yamahata has quit IRC19:53
ajokevinbenton, grr, I'm feeling bad for not having remembered this before, let me tell you the story about zones... still some missing pieces...19:53
kevinbentondhellmann: if it were a typeerror i think we would see the traceback anyway19:53
kevinbentonq-svc.log is from the screen session that proc is running in, right?19:54
kevinbentonajo: story time!19:54
*** ijw has quit IRC19:54
ajokevinbenton: at some point in the OVSCT test, we found that an specific netperf test TCP_CRR, was behaving much worse in OVSCT19:54
ajoTCP_CRR means: 1) open connection, send data, recv data, close connection19:54
*** piyanai has quit IRC19:54
ajoyou keep running 1, and count how many of those you do per second19:54
*** piyanai has joined #openstack-neutron19:55
*** padkrish has quit IRC19:55
dhellmannkevinbenton: yes, that file should be the screen log19:55
kevinbentonmakes sense so far19:55
ajothat stresses out conntrack, because you push a new entry for every connection.19:55
kevinbentondhellmann: right, so i think it must be a systemexit then for it to be silent19:55
*** padkrish has joined #openstack-neutron19:55
ajokevinbenton: they kept investigating, and they found, that the reason was that we started filling up the conntrack table with old (to expire connections)19:55
kevinbentonamuller: your patch does seem right to me as well19:55
kevinbentonajo: right19:56
ajo"time_wait timeout" tcp sysctl parameter19:56
ajorelated19:56
kevinbentonyep, but that happens for regular iptables as well19:56
ajothe default is 120s, we tried with 1s -> and it matched the iptables connections per second19:56
ajoyes19:56
ajoI didn't follow up in the investigation, I need to sync back to them,19:56
dhellmannkevinbenton: could be. I do see some SystemExit exceptions being raised and sys.exit() calls in neutron in places that look odd19:57
ajobut it looked to me like either 1) they had a bug on how they talk to conntrack, 2) iptables sets that parameter to a lower value19:57
dhellmannkevinbenton: "git grep -i exit"19:57
ajobut 2 doesn't make too much sense, why would yo do such thing having the sysctl parameter?19:57
*** nlahouti has quit IRC19:57
kevinbentonajo: yeah, i think iptables is 120 seconds19:57
*** padkrish_ has joined #openstack-neutron19:58
*** padkrish has quit IRC19:58
ajook, may be iptables does some handling at connection closure...19:58
ajobut it wasn't suffering the issue...19:58
ajothen19:58
ajowe realized that I was using zones for CT19:58
ajomatching what we planned to do for iptables19:58
openstackgerritMerged openstack/neutron: Remove unneeded shebangs  https://review.openstack.org/20344719:59
*** amtux has quit IRC19:59
ajoand if they stopped using zones, it started behaving better...19:59
*** achanda has quit IRC19:59
ajonow, the question is...19:59
ajois iptables affected by this too?19:59
openstackgerritMerged openstack/neutron: Remove 'action' argument from _handle_fip_nat_rules()  https://review.openstack.org/21279420:00
kevinbentonajo: interesting, if so, we should see it already20:00
kevinbentonajo: unless it depends on a higher number of zones20:00
ajokevinbenton: this was for OVSCT:20:01
ajo1 zone (zone=0, shared with local stack) has mean 5174cps20:01
ajo2 zone has mean 2981cps20:01
ajo3 zone has mean 2056cps20:01
ajo4 zone has mean 1806cps20:01
ajo5 zone has mean 1295cps20:01
ajo(averaged across 30 runs)20:01
openstackgerritMerged openstack/neutron: lieutenants: Add Neutron infra lieutenants  https://review.openstack.org/21263820:01
*** lindycoder has joined #openstack-neutron20:01
openstackgerritMerged openstack/neutron: Add lieutenants contact for kuryr  https://review.openstack.org/21313320:01
ajokevinbenton, I can test it20:01
kevinbentonajo: so if it affects iptables, we should already be impacted then20:01
kevinbentonajo: because we have one zone per network20:02
kevinbentonajo: that would be awesome20:02
ajotrue...20:02
cbouchhi.  I'm trying to cherry-pick a change into stable/kilo and it's failing on 'error: Commit 9e24314bb14cdbc16186bc367a815d3325c87884 is a merge but no -m option was given'.  I haven't seen this until now.  Any ideas?20:02
ajowe would already be impacted20:02
*** daneyon_ has joined #openstack-neutron20:02
ajokevinbenton, I guess I can try a pre-zones version, and a post-zones version20:02
kevinbentoncbouch: don't cherry-pick the merge commit20:02
kevinbentoncbouch: cherry-pick the original commit20:03
*** merooney has quit IRC20:03
cbouchkevinbenton:  Thank you.  I guess I shouldn't have tried the other BUT the error message isn't very obvious.20:03
ajokevinbenton: let's proceed with the zone-per-port, understand how iptables behaves, and if it looked bad, we can set a knob in the agent to not do zones20:03
ajohow does that sound?20:03
ajobtw, how can you multitask so many conversations? :P :D20:03
kevinbentonajo: sounds good20:04
kevinbentonajo: i'm in IRC mode, not doing anything else at the moment20:04
kevinbentonajo: waiting for a meeting to start shortly20:04
ajo:)20:04
*** alejandrito has quit IRC20:04
*** daneyon has quit IRC20:05
ajokevinbenton: I will ping you back during the start of next week, I hope I will have some results by then , and I'm going to ping the ovs/ct guys to see how's the thing going20:05
kevinbentonajo: sounds like a plan. have a good weekend!20:05
ajohave a good weekend too ;)20:05
*** vivek-ebay has quit IRC20:06
mestery kevinbenton: Can you help me merge this to stable: https://review.openstack.org/#/c/213256/20:08
mesteryWe need that to get things rolling htere again /cc dougwig20:08
dougwigmonitor this, and you can see if stable goes green: https://review.openstack.org/#/c/213320/20:08
mesteryamuller HenryG markmcclain: Also ^^^^20:09
kevinbentonmestery: ack20:09
openstackgerritSean M. Collins proposed openstack/neutron: [WIP] Revert "Skip FwaaS test that is failing due to race condition"  https://review.openstack.org/21332620:10
kevinbentondougwig: so should i wait for that?20:11
kevinbentondougwig: or can i merge 213256?20:11
*** abhiraut has joined #openstack-neutron20:11
kevinbentondougwig: also, what is 213320 telling us that 213256 won't?20:11
dougwigkevinbenton: 213256 is correct regardless (correctly sets up api job)20:11
*** rushil has joined #openstack-neutron20:12
kevinbentondougwig: 213320 is just an empty patch so the results will be the same as 21325620:12
mesterythanks kevinbenton and dougwig20:12
dougwigkevinbenton: no, the depends on is loading something from vpnaas.20:13
HenryGdougwig: why can't gerrit find Ia979fa2fdf25f3c1dbe9e7160d6dde2df51c305f ?20:14
kevinbentondougwig: Ia979fa2fdf25f3c1dbe9e7160d6dde2df51c305f is 21325620:14
*** gampel1 has quit IRC20:14
kevinbentondougwig: oh man, you got a mess going :)20:14
kevinbentondougwig: the change id in the commit message for 213256 isn't the one gerrit has for it20:15
*** slaweq has joined #openstack-neutron20:16
*** slaweq has quit IRC20:16
*** madhu_ak has joined #openstack-neutron20:16
* HenryG suspects dougwig is on a plane with a bad connection trying to code this up on his phone20:18
*** slaweq has joined #openstack-neutron20:20
*** rushil has quit IRC20:21
*** rushil has joined #openstack-neutron20:22
kevinbentoni will fix up the commit message20:24
kevinbentonmestery: can you re-approve https://review.openstack.org/#/c/213256/20:25
kevinbentonmestery: i fixed the commit message20:25
mesterykevinbenton: yes sir20:25
*** jecarey has quit IRC20:25
*** jwy has quit IRC20:27
*** sdake has joined #openstack-neutron20:27
*** tiswanso has quit IRC20:28
dougwigkevinbenton: ha, I didn't know that was in two places.   Can you reconcile?20:29
*** cbouch has quit IRC20:29
dougwigElse I'll sort it out in about 8 hours.20:29
*** aranjan has joined #openstack-neutron20:30
kevinbentondougwig: i fixed the commit message20:30
dougwigThe same I'd on master and stable is ok?20:30
kevinbentondougwig: i still don't know what vpnaas patch the other was supposed to depend on20:30
*** sdake_ has quit IRC20:31
dougwigAdd a digit or two to chamgenum.20:32
dougwigDrat this tiny screen.20:32
*** aranjan has quit IRC20:34
*** baoli has joined #openstack-neutron20:35
openstackgerritAbhishek Raut proposed openstack/neutron: NSX: Move DB models as part of core vendor decomposition  https://review.openstack.org/21137020:36
*** ijw has joined #openstack-neutron20:37
*** vivek-ebay has joined #openstack-neutron20:37
*** baoli has quit IRC20:39
*** vivek-eb_ has joined #openstack-neutron20:40
dhellmannamuller, kevinbenton : the messaging patch failed, but there's no traceback? http://logs.openstack.org/97/213297/3/check/gate-tempest-dsvm-neutron-src-oslo.messaging/e0567b0/logs/screen-q-svc.txt.gz20:41
*** vivek-ebay has quit IRC20:41
amullerdhellmann: =/20:41
*** jwy has joined #openstack-neutron20:42
*** ijw has quit IRC20:44
*** arajagopal has quit IRC20:44
*** abhiraut has quit IRC20:44
kevinbentonstrange20:44
*** cdl has quit IRC20:44
*** achanda has joined #openstack-neutron20:44
kevinbentondoes the gate run these in screen sessions?20:44
dhellmannafaik20:45
kevinbentoni noticed that screen is not in the ps output20:45
dhellmannwhat's the current method of turning on neutron in devstack?20:46
*** abhiraut has joined #openstack-neutron20:47
kevinbentonwell by default everything runs in screen20:47
kevinbentonbut i see in the devstack logs it's calling _run_process20:48
dhellmannI want to run devstack myself, but don't usually run neutron, how do I turn it on?20:48
kevinbentonoh20:48
*** lori is now known as lori|away20:49
kevinbentondhellmann: https://wiki.openstack.org/wiki/NeutronDevstack20:49
dhellmannkevinbenton: thanks20:49
*** TrevorV has quit IRC20:50
*** achanda has quit IRC20:51
*** amtux has joined #openstack-neutron20:55
*** padkrish_ has quit IRC20:57
*** padkrish has joined #openstack-neutron20:57
*** nlahouti has joined #openstack-neutron20:58
*** padkrish has quit IRC21:02
*** achanda has joined #openstack-neutron21:04
*** pradk has quit IRC21:04
*** padkrish has joined #openstack-neutron21:05
*** yamamoto has joined #openstack-neutron21:06
*** zzzeek has quit IRC21:09
spandhe_kevinbenton: hey.. I updated the devref for isc dhcpd according to your comments. whenever you get a chance.. no hurry.. https://review.openstack.org/#/c/212836/ .. also, did you head back yesterday itself?21:09
*** padkrish has quit IRC21:10
*** padkrish has joined #openstack-neutron21:10
*** lascii is now known as alaski21:11
*** echirivella has joined #openstack-neutron21:11
*** yamamoto has quit IRC21:11
*** slaweq has quit IRC21:11
echirivellahi21:12
*** geekinutah has joined #openstack-neutron21:13
*** amtux has quit IRC21:14
*** padkrish has quit IRC21:14
*** padkrish_ has joined #openstack-neutron21:14
*** padkrish_ has quit IRC21:17
*** padkrish has joined #openstack-neutron21:18
*** cbrown is now known as david-lyle21:20
*** SourabhP has joined #openstack-neutron21:22
*** crose has quit IRC21:22
*** padkrish has quit IRC21:22
*** jerrygb has joined #openstack-neutron21:23
*** padkrish has joined #openstack-neutron21:26
*** vivek-eb_ has quit IRC21:26
*** vivek-ebay has joined #openstack-neutron21:26
*** amtux has joined #openstack-neutron21:27
*** rushil has quit IRC21:27
mlavallearmax: ping21:27
*** padkrish has quit IRC21:28
dhellmannamuller, kevinbenton : when I run devstack & neutron myself, I see this in the screen output: http://paste.openstack.org/show/414861/21:28
*** padkrish has joined #openstack-neutron21:28
*** rushil has joined #openstack-neutron21:29
*** jerrygb has quit IRC21:30
*** aranjan has joined #openstack-neutron21:31
*** amtux has quit IRC21:31
*** pc_m has joined #openstack-neutron21:34
*** aranjan has quit IRC21:35
*** sdake_ has joined #openstack-neutron21:35
*** ijw has joined #openstack-neutron21:37
*** piyanai has quit IRC21:37
*** sdake has quit IRC21:39
*** piyanai has joined #openstack-neutron21:39
*** vivek-eb_ has joined #openstack-neutron21:41
*** aranjan has joined #openstack-neutron21:41
*** thorst has quit IRC21:42
*** ijw has quit IRC21:42
*** ijw has joined #openstack-neutron21:43
*** vivek-ebay has quit IRC21:44
*** johnbelamaric has quit IRC21:48
openstackgerritPaul Michali proposed openstack/python-neutronclient: Enabling neutron-vpnaas DevStack Plugin for test  https://review.openstack.org/21002121:50
amullerdhellmann: what's api_workers and rpc_workers for you in neutron.conf?21:56
amullerdhellmann: this is just neutron master and oslo messaging HEAD?21:56
dhellmannamuller: yeah, head on both -- I didn't set the number of workers to anything explicitly21:57
*** padkrish has quit IRC21:57
kevinbentondhellmann: set api_workers to 0 and see if it still happens21:57
dhellmannhttp://paste.openstack.org/show/41501221:57
amullerkevinbenton: although the gate does set to 0 and 0 explicitly21:57
amullerI'll check out oslo messaging HEAD so I can play with this locally as well21:57
*** piyanai has quit IRC21:57
dhellmannamuller: ok. I believe it is related to https://review.openstack.org/#/c/213299/1 (or the patch that is reverting, I guess)21:58
dhellmannwhen I run without that patch locally it works, too21:58
kevinbentonamuller: no21:58
kevinbentonamuller: it's now cpu /221:59
amullerno it isn't: http://logs.openstack.org/33/181633/2/check/check-tempest-dsvm-neutron-full/8c80461/logs/screen-q-svc.txt.gz21:59
dhellmannamuller: there's no exception being raised at the neutron level, all of the service code exits "cleanly"21:59
dhellmannexcept the children all say "Parent process has died unexpectedly" so *something* weird is going on22:00
*** abhiraut has quit IRC22:00
amullerkevinbenton: that's a recent neutron tempest run, api_workers = rpc_workers = 022:00
*** padkrish_ has joined #openstack-neutron22:00
dhellmannwhere do I set that variable? which section of local.conf?22:00
amullerdhellmann: default22:00
amullerdhellmann: oh sorry22:00
amullerdhellmann: I just set /etc/neutron/neutron.conf directly22:00
kevinbentonamuller: something just changed then22:01
dhellmannsetting the number of workers to 0 explicitly had no effect22:01
kevinbentondhellmann: ack, try setting it to 2 then22:01
dhellmannah, setting it to 2 did!22:01
kevinbentonamuller, dhellmann: so something that messed up the workers recently must be the source22:02
amullerI'm running with api_workers, rpc_workers = 0. running oslo messaging from pip works fine. then I got oslo messaging HEAD and neutron crashes22:03
kevinbentonamuller: right, does setting it to 2 work okay?22:03
amullerno22:03
kevinbentondhellmann: or what is the difference you are seeing?22:03
dhellmannsetting api_workers = 2 in neutron.conf seemed to make it work, let me verify22:04
dhellmannsorry, rpc_workers22:04
amullercrashes for me with api_workers = 0 or 222:04
amullerah ha, lemme try rpc22:04
kevinbentonamuller: https://github.com/openstack-dev/devstack/blob/master/stackrc#L640 https://github.com/openstack-dev/devstack/blob/master/lib/neutron-legacy#L46922:05
amullerno, no combination works for me22:05
*** pc_m has quit IRC22:05
kevinbentonamuller: is the gate job overriding those somewhere?22:05
amullerkevinbenton: yes22:05
*** shwetaap has quit IRC22:05
amullerkevinbenton: I'll find it 1 sec22:05
amullerkevinbenton: https://review.openstack.org/#/c/211853/3/devstack-vm-gate.sh22:06
amullerkevinbenton: we're back to api_workers = 0 and the old mysql driver22:06
*** kbringard has quit IRC22:07
kevinbentonamuller: oh, i didn't realize that was reverted22:07
kevinbentonamuller: why?22:07
amullerfwaas22:07
amullerthat issue might have been solved by now I'm not sure, you'll have to sync with armax and sc68cal22:07
amullerwe definitely want to go back22:07
kevinbentonamuller: ack22:09
kevinbentondhellmann, amuller: the timing of this doesn't line up quite right with the oslo messaging break22:09
amullerkevinbenton: no it's not that change22:09
kevinbentonwasn't merged until aug 12th22:09
kevinbentonright, since it was rpc_workers22:10
amullerdhellmann: kevinbenton: It's something with our RPC code22:10
amullerif I comment out the RPC initialization we don't crash22:10
*** yamahata has joined #openstack-neutron22:10
kevinbentonamuller: if you can reproduce locally, a bisect should be pretty fast22:10
amullerwell I should have guessed that since the crash is oslo messaging related =D22:10
kevinbentonamuller: only like 5 days of commits, right?22:10
*** zhhuabj has quit IRC22:10
amullerkevinbenton: yeah around aug 5 to aug 1022:10
kevinbentonamuller: or 10 to be safe22:10
*** zhhuabj has joined #openstack-neutron22:11
kevinbentonamuller: do you have time to bisect it?22:12
amullerkevinbenton: I don't see any patch that looks relevant merged to neutron on aug 5 to 1022:12
kevinbentonamuller: yeah, i looked through and didn't notice anything either22:12
amullerI can try to git bisect22:12
kevinbentonamuller: probably some stupid import order change22:12
*** padkrish_ has quit IRC22:13
*** dannywilson has quit IRC22:13
dhellmannamuller, kevinbenton : the 0 workers case is going through a different start path, and results in "Wait called after thread killed. Cleaning up." from oslo.service22:14
*** abhiraut has joined #openstack-neutron22:15
dhellmannso I think you're right that it's something about the way the server is started in that mode22:15
*** lindycoder has quit IRC22:15
*** padkrish has joined #openstack-neutron22:15
*** markvoelker has quit IRC22:15
amullerkevinbenton: dhellmann: I went back to neutron HEAD from the 4th of august and it's still crashing22:16
amullerwhile I got a successful oslo messaging tempest run on the 5th...22:16
dhellmannamuller: are you still using oslo.messaging master?22:16
amullerso I conclude that the offending change in oslo messaging *somehow* slipped by and it is not related to a neutron change22:16
amullerdhellmann: yep22:16
dhellmannyeah, https://review.openstack.org/#/c/210649/ merged on the 10th22:17
dhellmannoh, no, that's the wrong one22:17
dhellmannhttps://review.openstack.org/#/c/192437/ merged on the 3rd22:17
dhellmannI think the problem is in the 0 worker path wait() is being called before stop() and now oslo.messaging is rejecting that22:18
dhellmannwhen was the default for the number of workers changed again?22:19
amullerwhat still concerns me is why is nothing being logged22:19
kevinbenton12th22:19
amullerdhellmann: the 12th22:19
*** rushil_ has joined #openstack-neutron22:20
kevinbentonamuller: do you see things locally like on dhellmann's?22:21
amullerI think so yes. any combination crashes but the logging looks different22:22
amullerI'm trying to debug it no with api/rpc set to 022:22
amullernow*22:22
kevinbentoni wonder if it's somehow killing itself22:22
*** rushil has quit IRC22:22
kevinbentonno exception to catch there, right?22:22
*** leitan has quit IRC22:22
kevinbentonor actually that will show as a keyboardinterrupt22:23
kevinbentonif it's sigint IIRC22:23
kevinbentonwhich we silently pass on22:23
kevinbentonamuller: can you add a log to keyboardinterrupt except?22:24
amulleryeah22:24
amullernay, not that22:24
*** salv-orlando has quit IRC22:25
amullerkevinbenton: so, it's crashing sometime after this line https://github.com/openstack/neutron/blob/master/neutron/server/__init__.py#L5722:26
amullerI put a log line after that waitall and I do see it22:26
kevinbentonoh, if you see it then nothing is actually throwing an exception22:27
kevinbentonamuller: that would explain why your except statements aren't being hit22:27
*** salv-orlando has joined #openstack-neutron22:27
amullermaybe strace can help?22:27
kevinbentonfunction main just plain ol' returns22:27
amullerkevinbenton: yeah putting a log after all of the 'except' clauses prints22:29
amuller*sigh*22:29
*** dmartls1 has quit IRC22:29
mlavallearmax: ping22:30
*** nlahouti has quit IRC22:31
lifelessHenryG: pong22:31
openstackgerritDoug Hellmann proposed openstack/neutron: Add logging to debug oslo.messaging failure  https://review.openstack.org/21336022:33
lilynnCarl_baldwin: ping22:35
dhellmannamuller, kevinbenton : ^^ shows me locally what oslo.messaging is complaining about in the neutron code where rpc_workers=022:35
carl_baldwinlilynn: pong22:35
*** aranjan has quit IRC22:36
amullerdhellmann: good work22:37
lilynn Carl_baldwin:  Assaf responsed your comments on https://review.openstack.org/#/c/178880 and I added more functional test cases. Can any +2 people review and provide comments, if any ?22:37
*** nlahouti has joined #openstack-neutron22:37
amullerdhellmann: kevinbenton: I think we made good progress, but I gotta get going22:38
amullerI'll check back Monday22:38
carl_baldwinlilynn: ack22:39
dhellmannamuller: thanks, I think I'm going to hand this off to sileht to deal with next week22:39
lilynnCarl_baldwin: Thanks.22:39
*** amuller has quit IRC22:40
openstackgerritAdolfo Duarte proposed openstack/neutron: HA for DVR - Neutron Server side code changes  https://review.openstack.org/14316922:41
*** aranjan has joined #openstack-neutron22:41
HenryGlifeless: original question answered, but I have another one...22:42
*** vivek-eb_ has quit IRC22:42
*** vivek-ebay has joined #openstack-neutron22:42
*** ajmiller_ has joined #openstack-neutron22:45
HenryGlifeless: is there a good way to "sub-divide" the requirements in a package, so that that a subset of the requirements can be specified when installing?22:46
HenryGlifeless: Short of splitting a repo up into separate ones.22:47
*** ajmiller has quit IRC22:49
*** baoli has joined #openstack-neutron22:50
*** edmondsw has quit IRC22:51
*** nlahouti has quit IRC22:51
*** banix has joined #openstack-neutron22:51
*** banix has quit IRC22:52
*** jobewan has quit IRC22:54
*** baoli has quit IRC22:55
*** nlahouti has joined #openstack-neutron22:55
*** yamahata has quit IRC22:55
*** rpothier has quit IRC23:00
*** achippa has joined #openstack-neutron23:00
*** r-daneel has quit IRC23:01
*** padkrish has quit IRC23:04
*** padkrish has joined #openstack-neutron23:05
*** gangil has quit IRC23:06
*** echirivella has quit IRC23:07
*** johnbelamaric has joined #openstack-neutron23:08
*** padkrish has quit IRC23:09
*** patrickeast has quit IRC23:15
*** johnbelamaric has quit IRC23:17
openstackgerritPengtao Huang proposed openstack/neutron: delete the redundant 'if len(network_ids) == 1'  https://review.openstack.org/21337223:18
*** rushil_ has quit IRC23:18
lifelessHenryG: optional dependencies23:19
lifelessHenryG: aka extras23:19
lifelessHenryG: this is covered in the pbr docs23:19
lifelesswe have some polish to do in the syncing tools around this but its basically all tere23:20
*** rushil has joined #openstack-neutron23:20
HenryGthanks lifeless, I'll read up on it23:20
*** carl_baldwin has quit IRC23:24
*** padkrish has joined #openstack-neutron23:26
*** julim has quit IRC23:30
*** rushil_ has joined #openstack-neutron23:31
*** markvoelker has joined #openstack-neutron23:31
*** spandhe_ has quit IRC23:32
*** kutija has quit IRC23:32
*** agireud has joined #openstack-neutron23:33
*** rushil has quit IRC23:34
*** ijw has quit IRC23:34
*** ijw has joined #openstack-neutron23:34
*** markvoelker has quit IRC23:35
*** ijw_ has joined #openstack-neutron23:36
*** yamahata has joined #openstack-neutron23:38
*** breitz has quit IRC23:39
*** breitz has joined #openstack-neutron23:39
*** ijw has quit IRC23:39
*** ijw has joined #openstack-neutron23:42
*** ijw_ has quit IRC23:42
*** ijw_ has joined #openstack-neutron23:43
*** mitchjameson has quit IRC23:44
*** ijw has quit IRC23:47
*** killer_prince has joined #openstack-neutron23:49
*** lazy_prince has quit IRC23:53
*** killer_prince has quit IRC23:53
*** ajmiller_ has quit IRC23:54
*** agireud has quit IRC23:54
*** abhiraut has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!