Monday, 2018-02-19

« Sunday, 2018-02-18 Index Tuesday, 2018-02-20 »
*** masaki has joined #openstack-neutron00:01
*** lujinluo has joined #openstack-neutron00:09
*** mriedem has joined #openstack-neutron00:11
*** armax has quit IRC00:13
*** lbragstad has joined #openstack-neutron00:20
*** lbragstad has quit IRC00:27
*** claudiub has quit IRC00:55
*** psahoo has joined #openstack-neutron01:15
*** slaweq has joined #openstack-neutron01:15
*** slaweq has quit IRC01:20
*** SumitNaiksatam has quit IRC01:35
openstackgerritMiguel Lavalle proposed openstack/neutron master: Multiple port binding for ML2  https://review.openstack.org/41425101:36
*** hongbin has joined #openstack-neutron01:36
*** SumitNaiksatam has joined #openstack-neutron01:37
*** itlinux has quit IRC02:02
*** yamahata has joined #openstack-neutron02:03
*** SumitNaiksatam has quit IRC02:11
*** links has joined #openstack-neutron02:11
*** lbragstad has joined #openstack-neutron02:15
*** r-daneel has joined #openstack-neutron02:24
*** masaki_ has joined #openstack-neutron02:30
*** r-daneel has quit IRC02:32
*** qzo has quit IRC02:36
*** qzo has joined #openstack-neutron02:42
*** salv-orl_ has joined #openstack-neutron02:45
*** salv-orlando has quit IRC02:48
*** jhershbe has joined #openstack-neutron03:04
*** yamamoto_ has joined #openstack-neutron03:08
*** yamamoto has quit IRC03:12
*** itzikb has joined #openstack-neutron03:18
*** lbragstad has quit IRC03:29
*** itzikb has quit IRC03:31
*** itzikb has joined #openstack-neutron03:32
*** cshastri has joined #openstack-neutron03:32
*** lujinluo has quit IRC03:35
*** r-daneel has joined #openstack-neutron03:40
*** kbaegis1 has joined #openstack-neutron03:56
*** kbaegis1 has quit IRC03:56
*** kbaegis has quit IRC03:59
*** jhershbe has quit IRC04:00
*** lujinluo has joined #openstack-neutron04:01
*** masaki has quit IRC04:01
*** rmcall has quit IRC04:02
*** rmcall has joined #openstack-neutron04:12
*** moshele has joined #openstack-neutron04:18
*** moshele has quit IRC04:23
*** gcheresh has joined #openstack-neutron04:24
openstackgerritIWAMOTO Toshihiro proposed openstack/neutron master: Pull in ubuntu cloud archive openvswitch pkg  https://review.openstack.org/53984704:26
openstackgerritIWAMOTO Toshihiro proposed openstack/neutron master: of_interface: Implement bundled() method  https://review.openstack.org/45125704:26
openstackgerritIWAMOTO Toshihiro proposed openstack/neutron master: WIP: ovsfw: use install_instruction  https://review.openstack.org/46039504:26
*** sridharg has joined #openstack-neutron04:28
*** gcheresh has quit IRC04:29
openstackgerritMerged openstack/networking-ovn master: Updated from global requirements  https://review.openstack.org/54427304:31
*** trinaths has joined #openstack-neutron04:47
*** lujinluo has quit IRC04:48
*** lujinluo has joined #openstack-neutron04:48
*** dave-mccowan has quit IRC04:53
*** itzikb has quit IRC04:59
*** anilvenkata has joined #openstack-neutron05:10
*** slaweq has joined #openstack-neutron05:17
*** slaweq has quit IRC05:22
*** itzikb has joined #openstack-neutron05:24
*** claudiub has joined #openstack-neutron05:27
*** lajoskatona has joined #openstack-neutron05:29
*** Alex_Staf has joined #openstack-neutron05:29
*** jafeha__ has joined #openstack-neutron05:30
*** moshele has joined #openstack-neutron05:33
*** jafeha has quit IRC05:33
*** yamamoto has joined #openstack-neutron05:34
*** lujinluo has quit IRC05:36
*** lujinluo has joined #openstack-neutron05:36
*** janki has joined #openstack-neutron05:38
*** yamamoto_ has quit IRC05:38
*** mdnadeem has joined #openstack-neutron05:47
*** ramishra has joined #openstack-neutron05:50
*** hongbin has quit IRC05:53
*** mdih has joined #openstack-neutron06:01
*** mohankumar has joined #openstack-neutron06:07
*** threestrands has quit IRC06:10
*** gcheresh_ has joined #openstack-neutron06:14
*** threestrands has joined #openstack-neutron06:23
*** jhershbe has joined #openstack-neutron06:27
*** psahoo has quit IRC06:36
*** psahoo has joined #openstack-neutron06:52
*** mosulica has joined #openstack-neutron06:53
*** jafeha__ is now known as jafeha06:58
*** threestrands has quit IRC07:00
*** pgadiya has joined #openstack-neutron07:02
*** psahoo has quit IRC07:08
*** rcernin has quit IRC07:11
*** armaan has joined #openstack-neutron07:15
*** psahoo has joined #openstack-neutron07:20
*** maciejjozefczyk has quit IRC07:23
*** vthapar has joined #openstack-neutron07:25
*** andreas_s has joined #openstack-neutron07:27
*** kobis has joined #openstack-neutron07:28
*** lujinluo has quit IRC07:28
*** hoonetorg has quit IRC07:30
*** Alex_Staf has quit IRC07:32
*** jhershbe has quit IRC07:33
*** yamamoto has quit IRC07:33
*** yamamoto has joined #openstack-neutron07:41
*** slaweq has joined #openstack-neutron07:43
*** slaweq_ has joined #openstack-neutron07:45
*** horms has joined #openstack-neutron07:45
*** yamamoto has quit IRC07:46
*** hoonetorg has joined #openstack-neutron07:46
*** pcaruana has joined #openstack-neutron07:47
*** slaweq has quit IRC07:48
*** links has quit IRC07:55
*** AlexeyAbashkin has joined #openstack-neutron07:56
*** slaweq has joined #openstack-neutron08:03
*** vijaykc4 has joined #openstack-neutron08:03
*** links has joined #openstack-neutron08:07
*** gcheresh has joined #openstack-neutron08:09
*** gcheresh has quit IRC08:10
*** slaweq has quit IRC08:10
*** matrohon has joined #openstack-neutron08:14
*** tesseract has joined #openstack-neutron08:15
*** lujinluo has joined #openstack-neutron08:21
*** ragiman has joined #openstack-neutron08:22
openstackgerritmelissaml proposed openstack/networking-ovn master: Use plain ASCII characters  https://review.openstack.org/54551508:28
*** ralonsoh has joined #openstack-neutron08:30
*** rmcall has quit IRC08:31
*** JudeC has joined #openstack-neutron08:32
*** tmorin has joined #openstack-neutron08:33
*** JudeC has quit IRC08:34
*** itzikb_ has joined #openstack-neutron08:34
*** itzikb has quit IRC08:34
*** oidgar has joined #openstack-neutron08:35
*** Eran_Kuris has joined #openstack-neutron08:38
*** yamamoto has joined #openstack-neutron08:39
*** nplanel__ has joined #openstack-neutron08:40
*** Eran_Kuris has quit IRC08:40
*** jpena|off is now known as jpena08:43
*** jhershbe has joined #openstack-neutron08:45
openstackgerritDaniel Alvarez proposed openstack/networking-ovn master: Remove kuryr job from networking-ovn  https://review.openstack.org/54576608:49
*** gcheresh has joined #openstack-neutron08:56
*** ushkalim has joined #openstack-neutron08:59
*** Alex_Staf has joined #openstack-neutron08:59
*** tmorin1 has joined #openstack-neutron09:00
*** tmorin has quit IRC09:01
*** gcheresh has quit IRC09:03
*** gcheresh has joined #openstack-neutron09:03
*** gcheresh has quit IRC09:05
*** lpetrut has joined #openstack-neutron09:06
openstackgerritYannick Thomas proposed openstack/networking-bagpipe master: bagpipe-bgp: Correct default route handling  https://review.openstack.org/54536909:11
*** itzikb_ has quit IRC09:15
*** itzikb_ has joined #openstack-neutron09:15
*** itzikb_ has quit IRC09:22
*** mrch has joined #openstack-neutron09:22
*** itzikb has joined #openstack-neutron09:23
*** horms has quit IRC09:23
mrchcan i make foreman pxeboot one host via 10G SFP interface and after the installations 2 10G Ports should be bonded together and should be used as public interface with a vlan and totally different ip?!09:24
*** lajoskatona has quit IRC09:25
*** fzdarsky has joined #openstack-neutron09:26
openstackgerritSlawek Kaplonski proposed openstack/neutron master: DNM Debugging fullstack l2 agent restart tests  https://review.openstack.org/54524309:28
*** r-daneel has quit IRC09:28
*** oidgar has quit IRC09:28
*** fzdarsky has quit IRC09:31
openstackgerritSlawek Kaplonski proposed openstack/neutron master: DNM test fullstack; patch 21  https://review.openstack.org/54577409:31
openstackgerritSlawek Kaplonski proposed openstack/neutron master: DNM test fullstack; patch 22  https://review.openstack.org/54577509:31
openstackgerritSlawek Kaplonski proposed openstack/neutron master: DNM test fullstack; patch 23  https://review.openstack.org/54577609:31
openstackgerritSlawek Kaplonski proposed openstack/neutron master: DNM test fullstack; patch 24  https://review.openstack.org/54577709:32
openstackgerritSlawek Kaplonski proposed openstack/neutron master: DNM test fullstack; patch 25  https://review.openstack.org/54577809:32
*** links has quit IRC09:32
*** nplanel_ has joined #openstack-neutron09:41
*** oidgar has joined #openstack-neutron09:43
*** nplanel__ has quit IRC09:44
*** links has joined #openstack-neutron09:45
*** r-daneel has joined #openstack-neutron09:46
*** oidgar has quit IRC09:47
*** SmearedBeard has joined #openstack-neutron09:47
*** mrch has quit IRC09:51
*** Eran_Kuris has joined #openstack-neutron09:54
*** Eran_Kuris has quit IRC09:55
*** Eran_Kuris has joined #openstack-neutron09:55
openstackgerritJens Harbott (frickler) proposed openstack/neutron-dynamic-routing master: WIP: Fix failure when adding a speaker to an agent  https://review.openstack.org/54578309:56
openstackgerritvenkata anil proposed openstack/networking-ovn master: Schedule gateway on chassis from ovn-cms-options  https://review.openstack.org/53784409:57
*** salv-orl_ has quit IRC10:02
*** salv-orlando has joined #openstack-neutron10:03
*** r-daneel has quit IRC10:06
*** salv-orlando has quit IRC10:07
*** salmankhan has joined #openstack-neutron10:10
*** mdnadeem has quit IRC10:11
*** vijaykc4 has quit IRC10:15
*** vijaykc4 has joined #openstack-neutron10:17
openstackgerritvenkata anil proposed openstack/networking-ovn master: l3ha: Update router port bindings  https://review.openstack.org/51256010:17
*** vthapar has quit IRC10:21
*** r-daneel has joined #openstack-neutron10:22
*** mrch has joined #openstack-neutron10:26
*** mdnadeem has joined #openstack-neutron10:27
*** mdnadeem_ has joined #openstack-neutron10:30
*** mdnadeem has quit IRC10:32
*** lajoskatona has joined #openstack-neutron10:33
*** moshele has quit IRC10:33
*** rmart04 has joined #openstack-neutron10:34
*** Eran_Kuris has quit IRC10:38
*** gkadam has joined #openstack-neutron10:39
*** lajoskatona has quit IRC10:40
openstackgerritMerged openstack/networking-bgpvpn master: remove use of RESOURCE_ATTRIBUTE_MAP  https://review.openstack.org/54544010:44
*** mrch has quit IRC10:54
*** vijaykc4 has quit IRC10:59
*** vijaykc4 has joined #openstack-neutron11:00
*** salmankhan has quit IRC11:00
openstackgerritLujin Luo proposed openstack/neutron master: Integration of (Distributed) Port Binding OVO  https://review.openstack.org/54420611:01
*** vijaykc4 has quit IRC11:01
*** vijaykc4 has joined #openstack-neutron11:02
*** salmankhan has joined #openstack-neutron11:05
*** AlexeyAbashkin has quit IRC11:07
openstackgerritLujin Luo proposed openstack/neutron master: Ensure _get_changed_synthetic_fields() return updatable fields  https://review.openstack.org/54579911:09
*** lujinluo has quit IRC11:10
*** ragiman has quit IRC11:13
*** ragiman has joined #openstack-neutron11:18
*** lucas-afk is now known as lucasagomes11:18
*** dtantsur|afk is now known as dtantsur11:23
*** salv-orlando has joined #openstack-neutron11:25
*** moshele has joined #openstack-neutron11:26
*** AlexeyAbashkin has joined #openstack-neutron11:32
*** bnemec is now known as bnemec-pto11:41
*** horms has joined #openstack-neutron11:46
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Switch ip addr add/del/flush commands to use pyroute2  https://review.openstack.org/54535511:56
*** vijaykc4 has quit IRC11:56
*** psahoo has quit IRC11:57
*** masber has joined #openstack-neutron11:58
*** mrch has joined #openstack-neutron12:01
*** slaweq has joined #openstack-neutron12:07
*** anilvenkata has quit IRC12:10
*** slaweq has quit IRC12:12
*** dave-mccowan has joined #openstack-neutron12:16
*** trinaths has quit IRC12:19
*** yamamoto has quit IRC12:21
*** yamamoto has joined #openstack-neutron12:25
*** dmellado has quit IRC12:26
*** mrch has quit IRC12:28
openstackgerritSlawek Kaplonski proposed openstack/neutron master: [Fullstack] Respawn dhclient process in case of error  https://review.openstack.org/54582012:34
*** vpickard has quit IRC12:34
*** mohankumar has quit IRC12:36
*** vpickard has joined #openstack-neutron12:36
*** bfernando has joined #openstack-neutron12:37
*** links has quit IRC12:37
*** jpena is now known as jpena|lunch12:39
openstackgerrityatin proposed openstack/neutron master: [DNM] Testing https://review.openstack.org/#/c/540077/  https://review.openstack.org/54582112:40
*** vijaykc4 has joined #openstack-neutron12:43
*** ajo\pto is now known as ajo12:55
ajodalvarez: lucasagomes numans http://logs.openstack.org/60/512560/9/check/networking-ovn-dsvm-functional/735c45c/job-output.txt.gz#_2018-02-19_10_33_42_137895 I suspect something we reuse from neutron on the functional side has broken our functional12:56
* lucasagomes looks12:56
dalvarezajo:12:56
dalvarez2018-02-19 10:33:41.829181 | primary | 2018-02-19 10:33:41.828 |         res = self._create_subnet(self.fmt, net['network']['id'], cidr)12:56
dalvarez2018-02-19 10:33:41.839191 | primary | 2018-02-19 10:33:41.836 |     KeyError: 'network'12:56
dalvarezlucasagomes,  ^12:56
ajoyeah, xactly12:56
dalvarezajo lucasagomes should it be just net['id'] ?12:57
dalvareznet['network'] seems odd :D12:57
ajodalvarez: yeah, but it was working before, may be the helpers changed12:57
ajoand now return what you say12:57
lucasagomesdalvarez, usually after parsing the request you get a {'network': {'id': ...} json12:57
dalvarezyeah those are in neutron12:57
* lucasagomes check the funtional tests logs12:58
lucasagomesdalvarez, ajo http://logs.openstack.org/60/512560/9/check/networking-ovn-dsvm-functional/735c45c/logs/dsvm-functional-logs/networking_ovn.tests.functional.test_ovn_db_resources.TestDNSRecords.test_dns_records.txt.gz#_2018-02-19_10_33_06_17313:00
dalvarezcrap13:00
dalvarezotherwiseguy, ^ :p13:00
lucasagomesprobably after that the response of the request was an error and after parsed we tried to access the 'network' bits13:00
lucasagomeswhich wasn't there13:00
lucasagomesdalvarez, 5s seems a bit short based on the port tests too13:01
lucasagomes:-/13:01
*** boden has joined #openstack-neutron13:02
dalvarezlucasagomes, otherwiseguy it is for production as we see that in like 800 ports setup but should be enough for tests. I agree we need to change it tho :)13:02
lucasagomesdalvarez, yeah true13:03
openstackgerritSlawek Kaplonski proposed openstack/neutron master: [Fullstack] Respawn dhclient process in case of error  https://review.openstack.org/54582013:04
*** dmellado has joined #openstack-neutron13:07
*** tmorin1 has quit IRC13:07
dalvarezlucasagomes, ajo: https://github.com/openstack/neutron/blob/635d256a30b28b6acc0e881e31eb242672b985c4/neutron/tests/unit/db/test_db_base_plugin_v2.py#L327 i dont see any recent changes there13:08
dalvarezoh wait13:08
dalvarezit's in the net creation sry13:08
dalvarezand it's because it failed13:08
dalvarezdisregard :)13:08
*** edmondsw has joined #openstack-neutron13:12
lucasagomesdalvarez, maybe it was just a temporary failure13:12
openstackgerritMerged openstack/networking-ovn master: Use plain ASCII characters  https://review.openstack.org/54551513:17
*** mchlumsky has joined #openstack-neutron13:17
*** amuller has joined #openstack-neutron13:20
dalvarezcould be13:21
*** mrch has joined #openstack-neutron13:21
openstackgerritThomas Morin proposed openstack/neutron-specs master: Initiate Rocky specs  https://review.openstack.org/54582513:25
openstackgerritThomas Morin proposed openstack/neutron-specs master: Neutron-Neutron Interconnections  https://review.openstack.org/54582613:25
*** horms has quit IRC13:25
*** horms has joined #openstack-neutron13:26
*** oidgar has joined #openstack-neutron13:28
numansajo, oh13:30
*** gkadam has quit IRC13:31
*** jpena|lunch is now known as jpena13:31
*** mrch has quit IRC13:32
*** anilvenkata has joined #openstack-neutron13:33
*** mchlumsky has quit IRC13:35
*** mchlumsky has joined #openstack-neutron13:38
*** dmellado has quit IRC13:38
*** pgadiya has quit IRC13:38
*** itzikb has quit IRC13:41
*** cshastri has quit IRC13:51
*** masuberu has joined #openstack-neutron13:54
*** vijaykc4 has quit IRC13:57
*** masber has quit IRC13:58
openstackgerrityatin proposed openstack/neutron master: [DNM] Testing https://review.openstack.org/#/c/540077/  https://review.openstack.org/54582113:59
*** janzian has joined #openstack-neutron14:01
*** armaan has quit IRC14:01
*** armaan has joined #openstack-neutron14:02
*** horms has quit IRC14:02
*** vijaykc4 has joined #openstack-neutron14:04
*** armaan has quit IRC14:08
*** mmichelson has quit IRC14:09
*** moshele has quit IRC14:09
*** mmichelson has joined #openstack-neutron14:09
*** mrch has joined #openstack-neutron14:12
*** mrch has left #openstack-neutron14:13
fricklerneutron cores: chandankumar: I finally got round to updating the zuul patches for n-d-r stable branches, please review: https://review.openstack.org/528990 https://review.openstack.org/52899214:13
*** bobmel has joined #openstack-neutron14:14
*** mohankumar has joined #openstack-neutron14:15
*** armax has joined #openstack-neutron14:16
*** bobmel_ has quit IRC14:17
*** esberglu has joined #openstack-neutron14:20
*** kstev has joined #openstack-neutron14:20
*** fnaval has joined #openstack-neutron14:21
*** lbragstad has joined #openstack-neutron14:23
*** kstev has quit IRC14:25
*** jafeha__ has joined #openstack-neutron14:26
*** kstev has joined #openstack-neutron14:27
*** jafeha has quit IRC14:29
*** ramishra has quit IRC14:31
*** jistr is now known as jistr|mtg14:31
*** njohnston has quit IRC14:33
*** njohnston has joined #openstack-neutron14:34
*** njohnston has quit IRC14:35
*** njohnston has joined #openstack-neutron14:36
*** rmart04 has quit IRC14:40
*** links has joined #openstack-neutron14:41
*** rmart04 has joined #openstack-neutron14:43
*** dmellado has joined #openstack-neutron14:44
*** njohnston has quit IRC14:45
*** njohnston has joined #openstack-neutron14:45
*** armaan has joined #openstack-neutron14:46
*** lnicolas has quit IRC14:47
*** armaan has quit IRC14:48
*** links has quit IRC14:49
*** hjensas has quit IRC14:50
*** lbragstad has quit IRC14:53
*** lbragstad has joined #openstack-neutron14:55
*** yamahata has quit IRC14:58
*** yamahata has joined #openstack-neutron14:58
*** tidwellr has joined #openstack-neutron15:00
*** dtantsur is now known as dtantsur|brb15:01
*** links has joined #openstack-neutron15:01
*** dmellado has quit IRC15:02
*** jistr|mtg is now known as jistr15:02
*** rmart04_ has joined #openstack-neutron15:08
*** salmankhan has quit IRC15:08
*** rmart04 has quit IRC15:08
*** rmart04_ is now known as rmart0415:08
openstackgerritrajiv proposed openstack/networking-odl master: Enabling ML2 for new full sync and recovery mechanism  https://review.openstack.org/52739115:11
*** oidgar has quit IRC15:12
-openstackstatus- NOTICE: Zuul has been restarted to pick up latest memory fixes. Queues were saved however patches uploaded after 14:40UTC may have been missed. Please recheck if needed.15:15
slaweq_ihrachys: hi, I think I found "reason" of issue with fullstack and dhclient: https://bugs.launchpad.net/neutron/+bug/172894815:17
openstackLaunchpad bug 1728948 in neutron "fullstack: test_connectivity fails due to dhclient crash" [High,In progress] - Assigned to Slawek Kaplonski (slaweq)15:17
slaweq_ihrachys: can You take a look at https://review.openstack.org/#/c/545820/2 if You will have few minutes? thx in advance15:17
*** crlb has joined #openstack-neutron15:18
*** armaan has joined #openstack-neutron15:19
*** mlavalle has joined #openstack-neutron15:20
*** mdnadeem_ has quit IRC15:20
*** rmart04 has quit IRC15:20
*** rmart04 has joined #openstack-neutron15:21
*** salmankhan has joined #openstack-neutron15:22
ihrachysslaweq_, ok15:23
*** slaweq has joined #openstack-neutron15:26
ihrachysslaweq, so the 'reason' is in quotes because you don't know why the hell it crashes?15:26
slaweq_more or less15:27
slaweq_I know that it crashes because there is "None" returned from dhclient output15:28
slaweq_as first "line"15:28
slaweq_but I don't know why it it like that15:28
ihrachys+ copyright bs15:28
*** gieldops has joined #openstack-neutron15:29
slaweq_because after that there is also "normal" lines on stdout/stderr15:29
ihrachysdo they issue copyright notes on stderr?15:29
slaweq_it looks that whole output from dhclient is on stderr15:29
slaweq_and e.g. on http://logs.openstack.org/78/545778/1/check/neutron-fullstack/050ba41/logs/dsvm-fullstack-logs/TestUninterruptedConnectivityOnL2AgentRestart.test_l2_agent_restart_LB,Flat-network_.txt.gz#_2018-02-19_09_59_44_177 there is example of such halted and respawned dhclient15:30
slaweq_it looks that it helps because test was passed fine then15:30
ihrachysslaweq_, I believe we can also assume that it returned non-zero code since we log it in red15:31
slaweq_not exactly15:31
slaweq_it is logged in red because it is stderr output15:31
*** slaweq has quit IRC15:31
*** sridharg has quit IRC15:31
slaweq_please check https://github.com/openstack/neutron/blob/master/neutron/agent/linux/async_process.py#L24515:31
slaweq_it is logged an error level always15:32
ihrachysI see15:32
ihrachysand nothing in syslog that would suggest it crashed15:33
slaweq_and as in my example, in line: http://logs.openstack.org/78/545778/1/check/neutron-fullstack/050ba41/logs/dsvm-fullstack-logs/TestUninterruptedConnectivityOnL2AgentRestart.test_l2_agent_restart_LB,Flat-network_.txt.gz#_2018-02-19_09_59_44_176 You can see "None" as output from dhclient15:33
slaweq_I couldn't find nothing15:33
slaweq_I also added "set -x" in dhclient script in this test and I checked whole output of it - nothing wrong there15:33
slaweq_IMO it is stopped only because of this "None" on output15:34
slaweq_but after that it also print few lines on stderr before it is killed15:34
*** lucasagomes is now known as lucas-hungry15:34
slaweq_and all those lines are exactly the same like in "good run"15:34
*** caowei has quit IRC15:35
slaweq_BTW: I did at least 25 DNM patches to find this (and few other) issues in fullstack tests during weekend :)15:36
ihrachysslaweq_, you should put off your superman cap once in a while, at least on weekends.15:37
slaweq_ihrachys: I try :)15:37
slaweq_but it is really hard sometimes :P15:37
ihrachyslooking at async_process code to understand when we decide to bail out of process15:37
*** nirmoy has joined #openstack-neutron15:41
*** mdih has quit IRC15:43
*** vpickard is now known as vpickard_15:44
*** tmorin has joined #openstack-neutron15:45
openstackgerritThomas Morin proposed openstack/networking-bagpipe master: bgpvpn: take admin_state_up into account  https://review.openstack.org/54585815:45
ihrachysslaweq_, https://github.com/openstack/neutron/blob/master/neutron/agent/linux/async_process.py#L208-L21615:46
ihrachyswhen output is None, it doesn't seem like we bail out15:46
slaweq_ihrachys: https://github.com/openstack/neutron/blame/master/neutron/agent/linux/async_process.py#L21115:47
slaweq_for me it is like that in this line15:47
slaweq_no?15:48
slaweq_and "output" is what is returned from stderr/stdout of process15:48
ihrachysah right. sorry it's too early here :)15:48
*** mohankumar has quit IRC15:49
slaweq_:)15:49
ihrachysok and it means that stream.readline returned None15:49
slaweq_yes, it looks like that for me15:49
slaweq_so I proposed this "respawn" of dhclient process as it is only in fullstack tests IMHO it could be fine15:49
slaweq_but I want to know Your opinion about it15:50
slaweq_ok, I have to leave now, thx for looking on that ihrachys :)15:51
ihrachysslaweq_, it makes sense. I will dig some more readline() itself to understand why None returned.15:52
slaweq_ihrachys: thx15:52
slaweq_see You later on neutron-meeting :)15:53
*** slaweq_ has quit IRC15:53
*** gcheresh_ has quit IRC15:54
*** dtantsur|brb is now known as dtantsur15:54
*** slaweq has joined #openstack-neutron15:54
*** hjensas has joined #openstack-neutron15:55
*** atoth has quit IRC15:57
*** slaweq has quit IRC15:58
*** chyka has joined #openstack-neutron15:58
*** salv-orlando has quit IRC15:59
mlavallezzzeek: This past Friday afternoon I had some time available and took a shot at removing all the old engine facade calls from Neutron by simple substitution: https://review.openstack.org/#/c/545501/. If you have any comments, please leave them in the review. No rush whatsoever. Since we are finished delivering Queens and we haven't started Rocky yet I thought this is the perfect time to try to move16:02
mlavallequickly with the new engina facade adoption, if that is possible16:02
zzzeekmlavalle: can you add me to the review16:03
openstackgerritJay Pipes proposed openstack/os-vif master: zuul: Enable functional tests in gate  https://review.openstack.org/53096116:03
zzzeekmlavalle: today is not going well16:03
mlavallezzzeek: as I said, not rush whatsoever. I'll add you to the review16:03
mlavalleThanks!16:04
*** mohankumar has joined #openstack-neutron16:04
mlavalleihrachys: any comments from you are also very welcome ^^^^^16:05
*** vijaykc4 has quit IRC16:05
*** jhershbe has quit IRC16:07
*** pcaruana has quit IRC16:07
*** idlemind has joined #openstack-neutron16:09
*** lpetrut has quit IRC16:09
*** mdnadeem_ has joined #openstack-neutron16:12
*** mosulica has quit IRC16:12
openstackgerritMichael Bayer proposed openstack/neutron master: Use oslo_db.sqlalchemy.test_fixtures  https://review.openstack.org/54586816:13
*** yamamoto has quit IRC16:16
openstackgerritJens Harbott (frickler) proposed openstack/neutron-dynamic-routing master: WIP: Testing  https://review.openstack.org/54587016:17
fricklermlavalle: I finally got round to updating the zuul patches for n-d-r stable branches, please review: https://review.openstack.org/528990 https://review.openstack.org/52899216:19
mlavallefrickler: Thanks!16:19
fricklermlavalle: also an update to DNS integration docs: https://review.openstack.org/54171216:19
*** wolverineav has joined #openstack-neutron16:19
mlavallefrickler: ok, thank you!16:19
*** masuberu has quit IRC16:21
*** mdnadeem_ has quit IRC16:22
*** slaweq has joined #openstack-neutron16:23
*** kobis has quit IRC16:23
*** r-daneel has quit IRC16:23
*** kobis has joined #openstack-neutron16:24
*** kobis has quit IRC16:24
*** rmart04 has quit IRC16:26
*** slaweq has quit IRC16:27
*** slaweq has joined #openstack-neutron16:27
*** slaweq has quit IRC16:29
*** lucas-hungry is now known as lucasagomes16:30
*** mohankumar has quit IRC16:30
*** slunkad_ has quit IRC16:31
*** yamamoto has joined #openstack-neutron16:32
openstackgerritMerged openstack/neutron master: Updated from global requirements  https://review.openstack.org/54427416:33
*** kstev has quit IRC16:34
*** yamamoto has quit IRC16:37
*** moshele has joined #openstack-neutron16:42
openstackgerritMerged openstack/neutron-lib master: Updated from global requirements  https://review.openstack.org/54554816:42
openstackgerritMerged openstack/neutron-lib master: Remove repeated parameter from floatingip  https://review.openstack.org/54469716:42
*** jpena is now known as jpena|brb16:42
*** slaweq has joined #openstack-neutron16:42
*** armaan has quit IRC16:44
*** slaweq has quit IRC16:48
openstackgerritYannick Thomas proposed openstack/networking-bagpipe master: bagpipe-bgp: Add FlowSpec routes readvertisement  https://review.openstack.org/54588016:48
*** kstev has joined #openstack-neutron16:50
*** AlexeyAbashkin has quit IRC16:50
*** tmorin has quit IRC16:54
*** Alex_Staf has quit IRC16:56
*** hjensas has quit IRC16:59
*** slaweq has joined #openstack-neutron17:00
*** trinaths has joined #openstack-neutron17:01
*** slaweq_ has joined #openstack-neutron17:01
*** yamamoto has joined #openstack-neutron17:02
*** matrohon has quit IRC17:02
*** mdih has joined #openstack-neutron17:02
*** chyka has quit IRC17:02
*** armaan has joined #openstack-neutron17:03
*** ragiman has quit IRC17:05
*** slaweq_ has quit IRC17:06
*** yamamoto has quit IRC17:06
*** bfernando has quit IRC17:07
*** andreas_s has quit IRC17:08
*** moshele has quit IRC17:08
*** andreas_s has joined #openstack-neutron17:09
*** links has quit IRC17:09
*** chyka has joined #openstack-neutron17:09
*** dmellado has joined #openstack-neutron17:10
*** kbringard has joined #openstack-neutron17:13
*** andreas_s has quit IRC17:14
*** felipemonteiro has joined #openstack-neutron17:18
openstackgerritSlawek Kaplonski proposed openstack/neutron master: [Fullstack] Respawn dhclient process in case of error  https://review.openstack.org/54582017:19
*** itlinux has joined #openstack-neutron17:21
*** jpena|brb is now known as jpena17:22
*** slaweq_ has joined #openstack-neutron17:25
*** cfriesen has joined #openstack-neutron17:28
*** slaweq_ has quit IRC17:29
*** rmart04 has joined #openstack-neutron17:34
*** lpetrut has joined #openstack-neutron17:35
*** lpetrut has quit IRC17:36
*** lpetrut has joined #openstack-neutron17:36
*** ijw has joined #openstack-neutron17:37
*** ijw has quit IRC17:38
*** ijw has joined #openstack-neutron17:39
*** tidwellr has quit IRC17:42
*** nirmoy has quit IRC17:46
*** slaweq_ has joined #openstack-neutron17:46
*** yamamoto has joined #openstack-neutron17:47
*** slaweq_ has quit IRC17:51
*** yamamoto has quit IRC17:52
*** felipemonteiro has quit IRC17:54
*** felipemonteiro has joined #openstack-neutron17:54
*** felipemonteiro has quit IRC17:59
*** anilvenkata has quit IRC18:00
*** ralonsoh has quit IRC18:02
openstackgerritMerged openstack/os-vif master: Configure privsep binary  https://review.openstack.org/53135818:05
*** armaan has quit IRC18:05
*** slaweq_ has joined #openstack-neutron18:07
*** hongbin has joined #openstack-neutron18:07
*** wolverineav has quit IRC18:08
*** salv-orlando has joined #openstack-neutron18:08
*** yamamoto has joined #openstack-neutron18:08
*** yamamoto has quit IRC18:08
*** slaweq_ has quit IRC18:12
*** AlexeyAbashkin has joined #openstack-neutron18:15
*** rmart04 has quit IRC18:16
*** openstackgerrit has quit IRC18:18
*** jpena is now known as jpena|away18:19
*** AlexeyAbashkin has quit IRC18:20
*** hjensas has joined #openstack-neutron18:23
*** hjensas has quit IRC18:23
*** hjensas has joined #openstack-neutron18:23
*** hjensas has quit IRC18:27
*** tesseract has quit IRC18:30
*** vpickard_ is now known as vpickard18:31
*** r-daneel has joined #openstack-neutron18:39
*** hjensas has joined #openstack-neutron18:44
*** hjensas has quit IRC18:44
*** hjensas has joined #openstack-neutron18:44
*** moshele has joined #openstack-neutron18:45
*** mvk_ has quit IRC18:48
*** cfriesen has quit IRC18:50
*** armax has quit IRC18:50
crlbmlavalle: Hi, I didn't see your response last week. can we talk now?18:53
*** edmondsw has quit IRC18:55
*** edmondsw has joined #openstack-neutron18:56
*** lucasagomes is now known as lucas-brb18:57
*** edmondsw has quit IRC19:00
*** felipemonteiro has joined #openstack-neutron19:02
*** wolverineav has joined #openstack-neutron19:02
*** harlowja has joined #openstack-neutron19:03
*** yamamoto has joined #openstack-neutron19:09
*** dtantsur is now known as dtantsur|afk19:10
*** jafeha has joined #openstack-neutron19:10
*** Alex_Staf has joined #openstack-neutron19:10
*** esberglu has quit IRC19:11
*** jafeha__ has quit IRC19:11
*** salmankhan has quit IRC19:12
*** salmankhan has joined #openstack-neutron19:13
*** jpena|away is now known as jpena|off19:14
*** slaweq_ has joined #openstack-neutron19:16
*** slaweq_ has quit IRC19:21
*** Alex_Staf has quit IRC19:21
*** ijw has quit IRC19:23
*** yamamoto has quit IRC19:26
*** salmankhan has quit IRC19:28
*** esberglu has joined #openstack-neutron19:29
*** mriedem has quit IRC19:34
*** mriedem has joined #openstack-neutron19:35
*** moshele has quit IRC19:36
*** moshele has joined #openstack-neutron19:38
*** openstackgerrit has joined #openstack-neutron19:38
openstackgerritIhar Hrachyshka proposed openstack/neutron master: DNM WIP testing async_process change for EOF indication  https://review.openstack.org/54596419:38
*** moshele has quit IRC19:42
openstackgerritSlawek Kaplonski proposed openstack/neutron master: [Fullstack] Respawn dhclient process in case of error  https://review.openstack.org/54582019:47
*** amuller has quit IRC19:47
*** matrohon has joined #openstack-neutron19:50
*** andrewd has joined #openstack-neutron19:52
*** slaweq_ has joined #openstack-neutron19:52
*** armax has joined #openstack-neutron19:56
*** slaweq_ has quit IRC19:57
*** lucas-brb is now known as lucasagomes19:58
*** mvk_ has joined #openstack-neutron19:59
*** hongbin_ has joined #openstack-neutron20:01
*** hongbin has quit IRC20:03
*** aojeagarcia has joined #openstack-neutron20:04
*** ushkalim has quit IRC20:12
*** dave-mccowan has quit IRC20:14
*** lucasagomes is now known as lucas-afk20:14
*** ushkalim has joined #openstack-neutron20:14
*** wolverineav has quit IRC20:19
openstackgerritMerged openstack/neutron master: Windows: fix exec calls  https://review.openstack.org/49210720:20
*** moshele has joined #openstack-neutron20:22
openstackgerritMerged openstack/os-vif master: zuul: Enable functional tests in gate  https://review.openstack.org/53096120:22
openstackgerritSlawek Kaplonski proposed openstack/neutron master: DNM Test fullstack fails due to VM not boot  https://review.openstack.org/54597020:24
*** janki has quit IRC20:28
*** aojea_ has joined #openstack-neutron20:30
*** edmondsw has joined #openstack-neutron20:30
*** aojea_ has quit IRC20:30
*** armaan has joined #openstack-neutron20:31
*** armaan has quit IRC20:31
*** felipemonteiro_ has joined #openstack-neutron20:32
*** felipemonteiro has quit IRC20:35
*** itlinux has quit IRC20:36
*** moshele has quit IRC20:40
*** Alex_Staf has joined #openstack-neutron20:45
*** tidwellr has joined #openstack-neutron20:48
*** wolverineav has joined #openstack-neutron20:50
*** armax has quit IRC20:50
*** Alex_Staf has quit IRC20:50
*** wolverineav has quit IRC20:54
*** ushkalim has quit IRC20:58
*** mvk_ has quit IRC21:01
*** wolverineav has joined #openstack-neutron21:03
*** slaweq_ has joined #openstack-neutron21:07
*** wolverineav has quit IRC21:08
*** slaweq_ has quit IRC21:12
*** moshele has joined #openstack-neutron21:18
*** salmankhan has joined #openstack-neutron21:19
*** wolverineav has joined #openstack-neutron21:20
*** wolverineav has quit IRC21:24
mlavalleihrachys: you are bugs deputy this week21:24
ihrachysyay!21:24
mlavalleLOL21:26
mlavalleboden: you attending this weeks meeting?21:26
mlavalleweek's^^^^21:26
*** andreas_s has joined #openstack-neutron21:26
*** AlexeyAbashkin has joined #openstack-neutron21:26
*** clayton has quit IRC21:28
*** hongbin has joined #openstack-neutron21:29
*** moshele has quit IRC21:30
*** hongbin_ has quit IRC21:30
*** AlexeyAbashkin has quit IRC21:31
*** andreas_s has quit IRC21:31
*** matrohon has quit IRC21:34
*** rcernin has joined #openstack-neutron21:36
*** threestrands has joined #openstack-neutron21:37
crlbmlavalle: hello21:38
mlavallecrlb: in a meeting right now21:38
mlavalleI'll ping you21:39
crlbmlavalle: thanks.21:39
mlavallecrlb: ping21:41
slaweqihrachys: ping21:41
slaweqihrachys: I found one more reason why fullstack tests (like restart_l2_agent) are often failing21:41
*** salv-orl_ has joined #openstack-neutron21:42
crlbmlavalle: ihrachys (16Jan) said I should contact you. Have you looked at #1743017?21:42
slaweqihrachys: I was trying to describe it in https://bugs.launchpad.net/neutron/+bug/1750337 - please take a look if You will have few minutes :)21:42
openstackLaunchpad bug 1750337 in neutron "Fullstack tests fail due to "block_until_boot" timeout" [High,Confirmed]21:42
*** salv-orlando has quit IRC21:44
*** felipemonteiro_ has quit IRC21:45
*** felipemonteiro_ has joined #openstack-neutron21:45
*** tidwellr has quit IRC21:46
mlavallecrlb: no I hadn't looked looked at it21:48
ihrachysslaweq, show subnet taking 49 secs?21:49
ihrachysthat's insane :)21:49
slaweqyes21:49
slaweqbut because of that there was timeout when asking for port's status21:49
slaweqand test failed21:49
slaweqI don't know yet why it took so long21:49
crlbmlavalle: Can you take a look, and then we can talk. The diagram (second attachment) sums up the situation.21:49
slaweqI only checked that load on host was above 20 so it was quite loaded IMO21:50
mlavallecrlb: ok I will take a look. This week and next are very tight with the prepartions for the PTG21:50
slaweqbut maybe there is also some bug in neutron, I don't know yet21:50
mlavalleI understand you have a workaound for the time being, correct?21:50
ihrachysslaweq, and port get took 88 secs21:51
ihrachysthen delete port - 62 secs21:51
ihrachysthat's not good21:51
crlbmlavalle: were you asking me? The answer is no. I'm dead in the water.21:51
*** armaan has joined #openstack-neutron21:52
slaweqyes but port get was "delayed" with this subnet get call21:52
slaweqthere is only one worker configured in fullstack tests for neutron-server21:52
*** wolverineav has joined #openstack-neutron21:53
*** felipemonteiro__ has joined #openstack-neutron21:53
ihrachysslaweq, oh I see. see server log, req-66490311-2539-4a03-a786-a4aa2cb72080 - taking 5mins+21:53
ihrachyshere: http://logs.openstack.org/81/545681/1/check/neutron-fullstack/8285bf3/logs/dsvm-fullstack-logs/TestOvsConnectivitySameNetworkOnOvsBridgeControllerStop.test_controller_timeout_does_not_break_connectivity_sigterm_VLANs,openflow-native_/neutron-server--2018-02-18--20-31-43-830810.txt.gz#_2018-02-18_20_32_06_19521:54
slaweqyes, and there is a lot of "not existing" ports there21:56
ihrachysactually I am confused about something else21:56
mlavallecrlb: why is Liberty your point of reference? are you migrating from Liberty to Pike?21:56
ihrachyssee here: http://logs.openstack.org/81/545681/1/check/neutron-fullstack/8285bf3/logs/dsvm-fullstack-logs/TestOvsConnectivitySameNetworkOnOvsBridgeControllerStop.test_controller_timeout_does_not_break_connectivity_sigterm_VLANs,openflow-native_/neutron-server--2018-02-18--20-31-43-830810.txt.gz#_2018-02-18_20_31_45_60721:56
ihrachyswhy do we initialize ml2 with some context?21:56
ihrachysI mean, with request id21:56
*** felipemonteiro_ has quit IRC21:57
slaweqI don't know21:57
*** wolverineav has quit IRC21:58
ihrachysslaweq, do you have a link to place where we configure 1 worker?21:59
slaweq1 minute21:59
slaweqihrachys: it looks that default value is used, there is no such config option configured in fullstack's neutron config fixture22:01
slaweqihrachys: and default is: https://github.com/openstack/neutron/blob/49d614895f44c44f9e1735210498facf1886c404/neutron/conf/service.py22:01
slaweqihrachys: yes, api_workers are set to None: http://logs.openstack.org/81/545681/1/check/neutron-fullstack/8285bf3/logs/dsvm-fullstack-logs/TestOvsConnectivitySameNetworkOnOvsBridgeControllerStop.test_controller_timeout_does_not_break_connectivity_sigterm_VLANs,openflow-native_/neutron-server--2018-02-18--20-31-43-830810.txt.gz?#_2018-02-18_20_31_51_94522:02
slaweqihrachys: so it's my bad probably22:02
slaweqI saw earlier log like http://logs.openstack.org/81/545681/1/check/neutron-fullstack/8285bf3/logs/dsvm-fullstack-logs/TestOvsConnectivitySameNetworkOnOvsBridgeControllerStop.test_controller_timeout_does_not_break_connectivity_sigterm_VLANs,openflow-native_/neutron-server--2018-02-18--20-31-43-830810.txt.gz?#_2018-02-18_20_31_51_83722:02
slaweqand I thought that there is 1 worker only22:03
slaweqbut it looks that there is 8 api workers started22:03
ihrachysok makes sense. I was thinking I am missing something since grep worker -r neutron/tests/fullstack doesn't reveal much22:04
slaweqso maybe it is just overload of server - if there is 8 test workers and each of them spawns 8 workers in neutron-server22:05
*** lpetrut has quit IRC22:05
ihrachys+ rpc workers right?22:06
slaweqyes22:06
slaweqin neutron server there is also one rpc_worker and one rpc_state_report_worker: http://logs.openstack.org/81/545681/1/check/neutron-fullstack/8285bf3/logs/dsvm-fullstack-logs/TestOvsConnectivitySameNetworkOnOvsBridgeControllerStop.test_controller_timeout_does_not_break_connectivity_sigterm_VLANs,openflow-native_/neutron-server--2018-02-18--20-31-43-830810.txt.gz#_2018-02-18_20_31_51_89322:07
ihrachysyeah. maybe we can actually try to reduce the number of workers then. the default for regular deployment is usually num_of_cpus but in case of multiple test threads, maybe we should reduce up to 1?22:07
slaweqI was thinking about 2 to make some "parallel" workers in neutron-server22:07
slaweqI will try tomorrow morning22:08
ihrachysgreat22:08
slaweqthx for help ihrachys and have a nice afternoon :)22:08
ihrachysslaweq, have a good one22:08
*** slaweq_ has joined #openstack-neutron22:13
*** slaweq_ has quit IRC22:18
*** openstackgerrit has quit IRC22:18
*** armax has joined #openstack-neutron22:21
*** mvk_ has joined #openstack-neutron22:22
*** wolverineav has joined #openstack-neutron22:22
*** masber has joined #openstack-neutron22:23
*** wolverineav has quit IRC22:27
*** kbringard has quit IRC22:31
*** slaweq has quit IRC22:36
*** dave-mccowan has joined #openstack-neutron22:38
*** armaan has quit IRC22:44
*** slaweq has joined #openstack-neutron22:45
*** armaan has joined #openstack-neutron22:46
*** slaweq has quit IRC22:50
*** jafeha__ has joined #openstack-neutron22:56
*** jafeha has quit IRC22:59
*** dave-mccowan has quit IRC23:05
*** salmankhan has quit IRC23:06
*** AlexeyAbashkin has joined #openstack-neutron23:06
*** wolverineav has joined #openstack-neutron23:07
*** AlexeyAbashkin has quit IRC23:10
*** wolverineav has quit IRC23:12
*** SmearedBeard has quit IRC23:12
*** pmannidi has joined #openstack-neutron23:19
*** mlavalle has quit IRC23:24
*** felipemonteiro__ has quit IRC23:25
*** mmichelson has quit IRC23:26
*** hongbin has quit IRC23:27
*** kstev has quit IRC23:30
*** trinaths has quit IRC23:32
*** wolverineav has joined #openstack-neutron23:33
*** masber has quit IRC23:34
*** r-daneel has quit IRC23:36
*** masber has joined #openstack-neutron23:37
*** wolverineav has quit IRC23:39
*** fnaval has quit IRC23:39
*** boden has quit IRC23:42
*** slaweq has joined #openstack-neutron23:53
*** masber has quit IRC23:57
*** slaweq has quit IRC23:58
*** chyka has quit IRC23:58
*** chyka has joined #openstack-neutron23:59
« Sunday, 2018-02-18 Index Tuesday, 2018-02-20 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!