Wednesday, 2015-09-09

crc32pfft. Ok I'll just use RPC since the emit method is on a LoggingNotificationHandler object. Which calls emit when the logging module logs a message. (Probably via an interceptor or something).00:01
crc32I don't know how to wire that up and I'm not using logging for this so I'll just use RPC and transports00:01
*** Aish has quit IRC00:12
openstackgerritmin wang proposed openstack/octavia: Increase connection_max_retries to be 300  https://review.openstack.org/21861300:22
openstackgerritAdam Harwell proposed openstack/octavia: Increase connection_max_retries to be 300  https://review.openstack.org/21861300:24
*** tiny-hands has joined #openstack-lbaas00:30
rm_workminwang2: https://gist.github.com/rm-you/f7585ca4932b3ee1eed900:37
openstackgerritMichael Johnson proposed openstack/octavia: Adding amphora failover flows  https://review.openstack.org/20233600:48
openstackgerritMichael Johnson proposed openstack/octavia: health manager service  https://review.openstack.org/16006100:49
openstackgerritMichael Johnson proposed openstack/octavia: Implement UDP heartbeat sender and receiver  https://review.openstack.org/20188200:49
*** sbalukoff has quit IRC00:49
openstackgerritMichael Johnson proposed openstack/octavia: Adds the NO_MONITOR operational status for members  https://review.openstack.org/22023200:50
*** clev-away has quit IRC00:50
*** rm_work has quit IRC00:50
*** sbalukoff has joined #openstack-lbaas00:53
*** rm_work has joined #openstack-lbaas00:53
*** rm_work has quit IRC00:53
*** rm_work has joined #openstack-lbaas00:53
*** clev has joined #openstack-lbaas00:54
*** Aish has joined #openstack-lbaas00:55
*** minwang2 has quit IRC01:03
*** ganeshna has joined #openstack-lbaas01:04
*** bana_k has quit IRC01:05
*** bharath has quit IRC01:05
*** pai15 has joined #openstack-lbaas01:08
*** Aish has quit IRC01:08
*** mlavalle has quit IRC01:09
openstackgerritMichael Johnson proposed openstack/octavia: Implement UDP heartbeat sender and receiver  https://review.openstack.org/20188201:10
*** ganeshna has quit IRC01:13
openstackgerritMichael Johnson proposed openstack/octavia: health manager service  https://review.openstack.org/16006101:16
openstackgerritMichael Johnson proposed openstack/octavia: Implement UDP heartbeat sender and receiver  https://review.openstack.org/20188201:16
openstackgerritMichael Johnson proposed openstack/octavia: Adds the NO_MONITOR operational status for members  https://review.openstack.org/22023201:17
*** madhu_ak has quit IRC01:23
openstackgerritMichael Johnson proposed openstack/octavia: Implement UDP heartbeat sender and receiver  https://review.openstack.org/20188201:42
openstackgerritMichael Johnson proposed openstack/octavia: Adds the NO_MONITOR operational status for members  https://review.openstack.org/22023201:42
*** tiny-hands has quit IRC01:45
openstackgerritBrandon Logan proposed openstack/octavia: Adding amphora failover flows  https://review.openstack.org/20233601:56
openstackgerritBrandon Logan proposed openstack/octavia: Plug vip and networks by port mac address  https://review.openstack.org/22074701:58
*** ganeshna has joined #openstack-lbaas01:58
pai15bana_k: is lbaas v2 agent installed?02:03
*** ganeshna has quit IRC02:12
*** clev is now known as clev-away02:15
openstackgerritJian LI proposed openstack/neutron-lbaas: Support schedule loadbalancer manually  https://review.openstack.org/20148302:16
*** Aish has joined #openstack-lbaas02:22
*** amotoki has joined #openstack-lbaas02:38
*** woodster_ has quit IRC02:39
*** vivek-ebay has quit IRC02:42
*** albertom has quit IRC02:56
*** albertom has joined #openstack-lbaas02:58
*** pai15 has quit IRC03:09
*** clev-away is now known as clev03:16
*** KunalGandhi has quit IRC03:25
*** clev is now known as clev-away03:36
*** ajmiller has joined #openstack-lbaas03:43
*** ajmiller has quit IRC03:54
*** bharath has joined #openstack-lbaas03:55
*** Aish has quit IRC03:59
*** bharath has quit IRC04:00
*** Aish has joined #openstack-lbaas04:11
*** minwang2 has joined #openstack-lbaas04:32
*** vivek-ebay has joined #openstack-lbaas04:36
*** Alex_Stef has joined #openstack-lbaas04:44
*** bana_k has joined #openstack-lbaas05:10
*** minwang2 has quit IRC05:18
*** minwang2 has joined #openstack-lbaas05:20
*** ganeshna has joined #openstack-lbaas05:30
*** crc32 has quit IRC05:32
*** bana_k has quit IRC05:37
*** ganeshna has quit IRC05:42
*** sbalukoff has quit IRC05:45
*** Aish has quit IRC05:52
*** rm_work has quit IRC05:59
*** rm_work has joined #openstack-lbaas05:59
*** rm_work has quit IRC06:00
*** rm_work has joined #openstack-lbaas06:00
*** rm_work has quit IRC06:02
*** rm_work has joined #openstack-lbaas06:03
*** crc32 has joined #openstack-lbaas06:03
*** rm_work has quit IRC06:04
openstackgerritCarlos Garza proposed openstack/octavia: Adding amphora failover flows  https://review.openstack.org/20233606:04
*** rm_work has joined #openstack-lbaas06:04
openstackgerritCarlos Garza proposed openstack/octavia: Implementing EventStreamer  https://review.openstack.org/21873506:06
*** rm_work has quit IRC06:06
*** rm_work has joined #openstack-lbaas06:06
*** Varun_Lodaya has quit IRC06:15
*** numans has joined #openstack-lbaas06:17
*** vivek-ebay has quit IRC06:32
*** vivek-ebay has joined #openstack-lbaas06:32
*** vivek-ebay has quit IRC06:32
openstackgerritCarlos Garza proposed openstack/octavia: health manager service  https://review.openstack.org/16006106:32
*** sbalukoff has joined #openstack-lbaas06:32
*** minwang2 has quit IRC06:35
*** Varun_Lodaya has joined #openstack-lbaas06:35
*** sballe has quit IRC06:46
openstackgerritCarlos Garza proposed openstack/octavia: Implement UDP heartbeat sender and receiver  https://review.openstack.org/20188206:48
rm_worki really hope we break 10006:48
openstackgerritCarlos Garza proposed openstack/octavia: Implementing EventStreamer  https://review.openstack.org/21873507:01
*** Varun_Lodaya has quit IRC07:25
*** jschwarz has joined #openstack-lbaas07:38
*** evgenyf has joined #openstack-lbaas07:39
*** crc32 has quit IRC07:49
*** apuimedo has joined #openstack-lbaas07:51
*** ganeshna has joined #openstack-lbaas09:29
*** ganeshna has quit IRC09:34
*** amotoki has quit IRC09:46
*** f13o has joined #openstack-lbaas09:50
*** ganeshna has joined #openstack-lbaas09:58
openstackgerritMatsumoto Yoshihide proposed openstack/octavia: Fix the shebang line and permission of webserver.sh  https://review.openstack.org/22167509:59
*** f13o has quit IRC10:02
*** yuanying_ is now known as yuanying10:02
*** logan2 has quit IRC10:24
*** logan2 has joined #openstack-lbaas10:28
*** bradjones has quit IRC10:55
*** ganeshna has quit IRC11:05
*** sballe has joined #openstack-lbaas11:22
*** logan2 has quit IRC11:38
*** logan2 has joined #openstack-lbaas11:40
*** logan2 has quit IRC11:50
*** logan2 has joined #openstack-lbaas11:54
*** woodster_ has joined #openstack-lbaas12:06
*** logan2 has quit IRC12:17
*** logan2 has joined #openstack-lbaas12:20
*** tiny-hands has joined #openstack-lbaas12:25
*** amotoki has joined #openstack-lbaas12:37
*** logan2 has quit IRC12:41
*** logan2 has joined #openstack-lbaas12:42
*** clev-away is now known as clev12:45
*** Aish has joined #openstack-lbaas13:00
*** Aish has quit IRC13:00
*** clev is now known as clev-away13:04
*** Alex_Stef has quit IRC13:30
*** apuimedo has quit IRC13:46
*** pai15 has joined #openstack-lbaas14:08
*** vivek-ebay has joined #openstack-lbaas14:27
*** pai15 has quit IRC14:30
*** pai15 has joined #openstack-lbaas14:31
*** pai15 has quit IRC14:35
*** ajmiller has joined #openstack-lbaas14:36
*** Alex_Stef has joined #openstack-lbaas14:44
*** vivek-ebay has quit IRC14:45
*** bradjones has joined #openstack-lbaas14:52
*** bradjones has quit IRC14:52
*** bradjones has joined #openstack-lbaas14:52
*** KunalGandhi has joined #openstack-lbaas15:09
*** Varun_Lodaya has joined #openstack-lbaas15:10
*** Aish has joined #openstack-lbaas15:14
*** apuimedo has joined #openstack-lbaas15:17
*** ganeshna has joined #openstack-lbaas15:24
*** Alex_Stef has quit IRC15:30
*** pai15 has joined #openstack-lbaas15:30
openstackgerritPhillip Toohill proposed openstack/neutron-lbaas: Adding barbican to gate hook Adds barbican to the build environment to allow for testing of TLS  https://review.openstack.org/21637415:38
*** numans has quit IRC15:39
openstackgerritPhillip Toohill proposed openstack/neutron-lbaas: Adding barbican to gate hook  https://review.openstack.org/21637415:40
*** TrevorV has joined #openstack-lbaas15:41
*** TrevorV has quit IRC15:42
*** TrevorV has joined #openstack-lbaas15:44
*** evgenyf has quit IRC15:44
*** mlavalle has joined #openstack-lbaas15:45
*** minwang2 has joined #openstack-lbaas15:45
*** ganeshna has quit IRC15:55
*** Varun_Lodaya has quit IRC15:57
*** diogogmt has joined #openstack-lbaas15:57
*** KunalGandhi has quit IRC15:59
openstackgerritPhillip Toohill proposed openstack/neutron-lbaas: Adding barbican to gate hook  https://review.openstack.org/21637415:59
*** vivek-ebay has joined #openstack-lbaas16:00
ajmillervivek-ebay Hi Vivek.  Aish and I have looked at https://review.openstack.org/#/c/206797/  Can you please give some instructions on installing it into horizon so we can test it, and also address the test failures?16:02
openstackgerritMichael Johnson proposed openstack/neutron-lbaas: Set up LBaas V2 tempest test gate against Octavia.  https://review.openstack.org/20967516:02
vivek-ebayajmiller: please followup with evgeny. i was working with him and he is currently active on it16:03
ajmillervivek-ebay OK, thanks16:03
*** jschwarz has quit IRC16:09
*** pai15_ has joined #openstack-lbaas16:18
*** pai15 has quit IRC16:21
*** pai15_ has quit IRC16:28
*** pai15 has joined #openstack-lbaas16:28
*** bharath has joined #openstack-lbaas16:28
*** KunalGandhi has joined #openstack-lbaas16:32
*** Aish has quit IRC16:32
*** pai15 has quit IRC16:32
*** Varun_Lodaya has joined #openstack-lbaas16:33
*** minwang2 has quit IRC16:35
*** pai15 has joined #openstack-lbaas16:38
*** apuimedo is now known as apuimedo|away16:40
*** amotoki has quit IRC16:43
*** vivek-ebay has quit IRC16:48
*** minwang2 has joined #openstack-lbaas17:04
*** pai15 has quit IRC17:13
*** pai15 has joined #openstack-lbaas17:14
*** madhu_ak has joined #openstack-lbaas17:20
xgermanblogan: https://wiki.openstack.org/wiki/Octavia/Weekly_Meeting_Agenda#Meeting_2015-09-0917:23
*** sbalukoff has quit IRC17:25
*** devlaps has joined #openstack-lbaas17:32
*** bana_k has joined #openstack-lbaas17:33
*** pai15 has quit IRC17:38
*** pai15 has joined #openstack-lbaas17:38
*** pai15 has quit IRC17:41
*** pai15 has joined #openstack-lbaas17:41
bloganxgerman: "failover, heartbeat, oh my" lol18:00
*** vivek-ebay has joined #openstack-lbaas18:05
openstackgerritMichael Johnson proposed openstack/octavia: Increase connection_max_retries to be 300  https://review.openstack.org/21861318:13
johnsom^^ re-+2ing since it didn't merge this morning18:15
openstackgerritmin wang proposed openstack/octavia: Increase connection_max_retries to be 300  https://review.openstack.org/21861318:16
*** crc32 has joined #openstack-lbaas18:21
ptoohillhttps://review.openstack.org/#/c/220654/18:21
openstackgerritPhillip Toohill proposed openstack/octavia: Updates for containers functionality  https://review.openstack.org/19995418:28
*** pai15 has quit IRC18:30
*** pai15 has joined #openstack-lbaas18:30
*** pai15 has quit IRC18:30
*** pai15 has joined #openstack-lbaas18:31
openstackgerritSherif Abdelwahab proposed openstack/octavia: Amphora Flows and Service Drivers for Active Standby  https://review.openstack.org/20625218:31
*** pai15 has quit IRC18:35
*** sbalukoff has joined #openstack-lbaas18:38
openstackgerritPhillip Toohill proposed openstack/octavia: Adding new network driver for containers  https://review.openstack.org/19785818:42
openstackgerritPhillip Toohill proposed openstack/octavia: Updates for containers functionality  https://review.openstack.org/19995418:42
TrevorVHey johnsom thanks for pushing the patch for the unit tests... I neglected them :(18:43
johnsomTrevorV Not a problem.  I didn't make sure we had them all, I just got the few that were failing cleaned up18:46
TrevorVThanks again johnsom18:46
*** bharath has quit IRC18:57
*** pai15 has joined #openstack-lbaas19:03
*** pai15 has quit IRC19:04
*** pai15 has joined #openstack-lbaas19:05
*** pai15 has quit IRC19:09
openstackgerritMerged openstack/octavia: Increase connection_max_retries to be 300  https://review.openstack.org/21861319:09
*** fnaval_ has joined #openstack-lbaas19:09
*** kiran-r has joined #openstack-lbaas19:17
*** pai15 has joined #openstack-lbaas19:22
*** kiran-r has quit IRC19:29
*** fnaval_ has quit IRC19:30
*** pai15 has quit IRC19:30
*** pai15 has joined #openstack-lbaas19:31
*** bharath has joined #openstack-lbaas19:35
*** bharath is now known as bharathm19:35
*** pai15 has quit IRC19:35
*** devlaps has quit IRC19:43
*** abdelwas has joined #openstack-lbaas19:45
*** Varun_Lodaya has quit IRC19:50
*** Varun_Lodaya has joined #openstack-lbaas19:54
*** KunalGandhi has quit IRC19:55
*** KunalGandhi has joined #openstack-lbaas20:05
*** Aish has joined #openstack-lbaas20:26
rm_workanywho20:53
rm_workanyone staying after the thing? I *am* looking for someone to maybe share an airbnb with or just to hang out with and tourist together20:53
rm_workmore fun in groups of at least 220:54
rm_workI can semi-tourguide in some parts of Tokyo, as I have been there before for a bit20:54
johnsom*IF* approved to go, I probably can't stay longer (even though that would be great).  I also don't have enough vacation left to extend that one.20:54
xgermanjohnsom you can work out of Tokyo :-)20:55
openstackgerritMichael Johnson proposed openstack/octavia: Adds the NO_MONITOR operational status for members  https://review.openstack.org/22023220:59
*** pai15 has joined #openstack-lbaas21:01
rm_workblogan: are you trying to spin up a devstack VM with my script yet?21:03
*** tiny-hands has quit IRC21:03
ajmillerI just filed a launchpad bug https://bugs.launchpad.net/neutron/+bug/149400321:05
openstackLaunchpad bug 1494003 in neutron "Floating IPs don't work with LBaaS V2 Loadbalancers" [Undecided,New]21:05
*** tiny-hands has joined #openstack-lbaas21:05
*** tiny-hands has quit IRC21:05
rm_workajmiller: is that for the subnet issue or something else21:06
*** TrevorV has quit IRC21:07
ajmillerrm_work I *think* it is something else.21:07
rm_workk21:07
rm_workworking on getting some logs of the issue21:07
ajmillerIt looks like something is out of whack in the order that FIPs are plugged, but I haven't looked into the details yet.  Just know its busted.21:08
johnsomHmmm21:11
johnsomFile "/opt/stack/neutron-lbaas/neutron_lbaas/db/migration/alembic_migrations/versions/liberty/expand/3345facd0452_initial.py", line 29, in <module>21:11
johnsombranch_labels = (cli.EXPAND_BRANCH,)21:11
johnsomAttributeError: 'module' object has no attribute 'EXPAND_BRANCH'21:11
johnsomAh, nevermind, updated neutron code.21:11
rm_worki'm spinning a new instance now21:17
rm_work~15m left21:17
rm_workand then ~10m until i get the test data to paste to blogan21:17
johnsomYeah, I'm re-stacking to switch off of lbaasv2 namespace driver (from the benchmarking) to the latest octavia to test fail over21:19
johnsomThis run is still going for the gate stuff: https://jenkins07.openstack.org/job/gate-neutron-lbaasv2-octavia-dsvm-api/11/console21:19
minwang2it is finished, the resources is used out, therefore it cannot create lb in the latter testing cases21:25
johnsomYeah, the deletes failed as rm_work noted21:25
*** abdelwas has quit IRC21:28
rm_workjohnsom: not seeing the subnet/port delete failure in that log21:30
rm_workminwang2: is it in that log?21:31
rm_workoh there it is21:31
rm_workdidn't click "full log21:31
minwang2rm_work 2015-09-09 17:25:56.176 29246 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 084720dc-73fe-450b-b413-d3109dfcfd27 will not be deleted by Octavia as it was not created by Octavia.21:31
minwang2http://logs.openstack.org/75/209675/44/experimental/gate-neutron-lbaasv2-octavia-dsvm-api/86efedb/logs/screen-o-cw.txt.gz21:32
rm_work2015-09-09 20:01:17.482 | 2015-09-09 20:01:16.575 |     Details: {u'message': u'Unable to complete operation on subnet 762137ba-79ae-4972-8bff-b79380461787. One or more ports have an IP allocation from this subnet.', u'type': u'SubnetInUse', u'detail': u''}21:32
rm_workyep21:32
rm_workfound it21:32
*** pai15 has quit IRC21:32
rm_workblogan: ^^ take a look at that log linked above -- click "full log" at the top and search for the text I just pasted21:32
*** mestery has quit IRC21:41
openstackgerritSherif Abdelwahab proposed openstack/octavia: Amphora Flows and Service Drivers for Active Standby  https://review.openstack.org/20625221:42
*** mestery has joined #openstack-lbaas21:42
*** abdelwas has joined #openstack-lbaas21:43
bloganhmm well that UnavailableException is the problem it looks like, but since that errored bc that exception doesn't exist we dont see the real exception21:43
rm_workblogan: the root is the subnet delete thing21:44
rm_workthat i pasted21:44
rm_worklook waaaay higher up in the log21:44
rm_workoops, about to land21:44
blogani must not be looking at hte rgiht long then21:44
rm_workblogan: have to click "full log" at the top21:45
rm_workor it cuts it way down21:45
rm_workhttps://jenkins07.openstack.org/job/gate-neutron-lbaasv2-octavia-dsvm-api/11/console21:45
bloganno link21:45
minwang2blogan https://jenkins07.openstack.org/job/gate-neutron-lbaasv2-octavia-dsvm-api/11/console21:45
bloganah okay21:45
rm_workohh21:45
rm_workhttps://jenkins07.openstack.org/job/gate-neutron-lbaasv2-octavia-dsvm-api/11/consoleFull21:45
rm_worktis21:45
rm_work^^this21:45
rm_workanywho, landing, bbl21:46
bloganis that o-cw log the log for this test?21:46
bloganit could be the reverts are not deleting the port21:46
blogansince it looks like the o-cw had an error21:46
bloganon a provisioning21:46
bloganjust a veyr early guess21:47
johnsomThe provisioning stuff happens way after the main issue.  It isn't able to clean up (the issue) so later provisioning fails21:47
johnsomI don't know what is going on with Jenkins.  Here is the directory, but it hasn't finished archiving the logs: http://logs.openstack.org/75/209675/44/experimental/gate-neutron-lbaasv2-octavia-dsvm-api/06f0b3f/21:48
bloganthis happens if run locally though right?21:49
johnsomAh, no logs because: Build timed out (after 125 minutes). Marking the build as failed.21:49
johnsomblogan yeah, rm_work has reproduced locally21:50
*** bana_k has quit IRC21:50
*** bradjones is now known as bradjones|away22:09
*** bana_k has joined #openstack-lbaas22:12
*** bana_k has quit IRC22:12
*** bana_k has joined #openstack-lbaas22:13
*** abdelwas has quit IRC22:13
*** KunalGandhi has quit IRC22:30
*** KunalGandhi has joined #openstack-lbaas22:30
openstackgerritDivya ChanneGowda proposed openstack/neutron-lbaas: Add device_id when a loadbalancer is created instead of at listener create  https://review.openstack.org/22198522:43
openstackgerritMichael Johnson proposed openstack/octavia: Adds the NO_MONITOR operational status for members  https://review.openstack.org/22023222:43
openstackgerritMichael Johnson proposed openstack/octavia: Adds the NO_MONITOR operational status for members  https://review.openstack.org/22023222:43
*** Aish has quit IRC22:45
*** Aish has joined #openstack-lbaas22:54
*** mlavalle has quit IRC22:56
*** amit213 has quit IRC23:22
*** amit213 has joined #openstack-lbaas23:22
openstackgerritBrandon Logan proposed openstack/neutron-lbaas: Wait for lb delete on tempest resource_cleanup  https://review.openstack.org/22199223:26
*** diogogmt has quit IRC23:26
openstackgerritBrandon Logan proposed openstack/neutron-lbaas: Wait for lb delete on tempest resource_cleanup  https://review.openstack.org/22199223:27
rm_workminwang2 / johnsom ^^ blogan figured it out in like 5 seconds once i pointed him directly at the error23:28
rm_workthat patch fixes it23:28
rm_workxgerman: need a +223:28
johnsomNice!23:28
xgermanblogan is amazing23:28
minwang2great23:28
*** TrevorV has joined #openstack-lbaas23:29
xgermanI can only +2 Octavia we need ajmiller for the +223:29
rm_workoh i thought you were nlbaas23:29
rm_workajmiller: ^^23:29
xgermanI am Octavia and FWaaS23:29
rm_workwho else is neutron-lbaas... dougwig?23:29
xgermanyep23:29
ajmillerrm_work I'm here23:29
rm_workajmiller / dougwig: https://review.openstack.org/#/c/221992/223:29
xgermanand TrevorV23:29
rm_work+2s plz23:29
dougwigrm_work: looking23:29
dougwigrm_work: +223:30
rm_workfixes the tempest cleanup to actually wait for the LBs to delete before cleaning up subnet resources23:30
rm_workso it doesn't break23:30
TrevorVxgerman, sorry just jumped on, what's up?23:30
rm_workheh23:30
xgermanaren’t you a LBaaS +223:30
rm_workTrevorV: xgerman thinks you're a neutron-lbaas core I think? :P23:30
TrevorVPfff NOPE23:31
rm_worklol23:31
xgermanpothole?23:31
rm_workptoohill is yeah23:31
rm_workbut we should be good if ajmiller +2/+A23:31
xgermansorry for the confusion23:31
ajmillerjust did23:31
rm_workcoolbeans23:31
rm_workjohnsom / minwang2 so now we should be able to at least have a finishing gate (if it doesn't time out)23:32
rm_workwe may have to adjust the "gate timeout"?23:32
johnsomI will fire it off once that merges23:32
blogangranted i only tested it with the one test after reproducing the error23:32
rm_worki mean, if other tests have issues, those will still break, but this is the overall cleanup issue that prevents most of the tests from even being able to run23:33
*** TrevorV has quit IRC23:34
*** sballe has quit IRC23:36
openstackgerritmin wang proposed openstack/neutron-lbaas: Set up LBaas V2 tempest test gate against Octavia.  https://review.openstack.org/20967523:45
*** Varun_Lodaya has quit IRC23:53
*** ajmiller has quit IRC23:56
*** apuimedo|away has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!