Tuesday, 2019-09-17

*** goldyfruit_ has joined #openstack-lbaas00:00
openstackgerritMichael Johnson proposed openstack/octavia master: Fix openstack port show content handling  https://review.opendev.org/68232700:08
johnsomThere is an awk script for you..... lol00:09
johnsomOk, not only is that backward compatible with the old OSC, it gets us one step closer to devstack working with IPv6 lb-mgmt-net00:09
johnsomHere is the awk script version of it which is easier to read:00:11
johnsomhttps://www.irccloud.com/pastebin/PSV7QZwv/00:11
openstackgerritMichael Johnson proposed openstack/octavia master: Fix the amphora no-op driver  https://review.opendev.org/68242000:13
johnsomI wonder if our backport vote counts towards stackalytics..... https://review.opendev.org/#/c/68217100:17
johnsomIt looks like the answer is no, which is good00:19
openstackgerritAdam Harwell proposed openstack/octavia master: WIP: fix plugging member subnets on existing networks  https://review.opendev.org/66540200:27
rm_worklol well that's a thing00:28
rm_worknice awk00:28
johnsomThanks00:28
rm_worki thought I handled that in one of my scripts a simpler way tho >_>00:28
rm_workbut i guess that's fine00:28
rm_workerr i mean, in one of my ipv6 related patches00:28
johnsomWell, OSC just changed the output format, so half that is being backwards compatible.00:29
rm_workhttps://review.opendev.org/#/c/665103/400:29
johnsomI can't wait to hear everyone scream over this change....  So many scripts are going to break00:29
* rm_work shrugs00:30
rm_workdid you know i had that patch up for a while? :D00:30
rm_workit might have gotten lost00:30
johnsomI knew someone was looking at the IPv6 goal. I was potentially going to poke at it this week.00:30
rm_workwhich is funny because it's after you mentioned i should be using dustin's patch :D00:30
rm_workthey changed how `-f value` displays?00:32
johnsomrm_work https://review.opendev.org/#/c/594078/00:32
johnsomYes00:33
johnsomhttps://www.irccloud.com/pastebin/R5QfYUzr/00:33
johnsomThe old output:00:34
johnsomhttps://www.irccloud.com/pastebin/UNEsKcET/00:34
rm_workis that OSC or is that neutron?00:34
johnsomOSC00:34
rm_workbecause i thought that *is* the value from OSC, but because that's how neutron formats it inside the json value00:34
rm_workand it's not "double parsing" it00:34
rm_workdid OSC decide to like, detect that and double-parse the neutron responses? lol00:35
johnsomThis patch changed it:  https://review.opendev.org/#/c/657907/00:35
rm_workoh nm00:35
johnsomGreg found this issue...00:35
johnsomLike I said, pretty big change to the OSC output00:35
rm_worki see, it's changed from print('\n'.join(fixed_ips)) to print(fixed_ips)00:36
rm_workoh, no, even more complex00:36
rm_workthey've parsed it?00:36
rm_workor ... are we sure that's not neutron's return structure changing? lol00:36
rm_workbecause it's a sub-field thing00:36
rm_worki don't know if neutron used to return it as a \n joined string, and now they're returning it as a real structure? or what00:37
rm_worki always thought it was odd before00:37
rm_workwhat does it look like if you use `-f json`?00:37
johnsomhttps://www.irccloud.com/pastebin/c9qSPURQ/00:38
johnsomNot sure how the version of OSC I have installed in the venv would change the neutron API format.....00:39
rm_workhuh.00:39
rm_workyeah00:39
johnsomPretty sure this is OSC change....00:39
rm_workbut notice00:39
rm_workin the old one, "fixed_ips" is the field, and that whole thing is the value00:39
rm_work\n separated (from neutron)00:39
rm_workso in the new version, OSC must actually be parsing the field and json-ifying it magically00:40
rm_workwhich is ... GREAT. but, breaking >_<00:40
johnsomYep, well, with the above awk magic, our devstack plugin will parse both....00:42
rm_workk. well, there's way more stuff that needs to be fixed too -- see my patch00:42
rm_workare we going to do them one-off or try to batch some of them?00:42
johnsomUmm, which patch?00:43
rm_workit might be good to just merge them as we go I guess, since otherwise we just get what has continued to happen, which is patches doing the same thing piling up but none of them merging because they don't handle "EVERYTHING"00:43
rm_workthe one I linked00:43
rm_workhttps://review.opendev.org/#/c/665103/00:43
johnsomAh, ipv600:43
rm_worki guess this isn't an ipv6-related one technically00:44
johnsomI will try to poke at that and consolidate on yours unless you are motivated00:44
rm_workIDC, abandon mine and dustins and add the important bits to yours00:44
rm_workas long as they're all captured00:44
rm_workwant to get those things merged ASAP00:44
rm_workcloser and closer to IPv600:44
johnsomWell, mine is an OSC gate fix that just happens to handle IPv6 better. It's not intended to be the "ipv6" patch00:44
rm_workkk then I can +2 that when I see it pass00:45
rm_workand you can do more on the one i put up, which was really just a newer version of dustin's00:45
johnsomYeah, I was thinking I would work on the IPv6 goal a bit this week.00:45
rm_workor you can backport my changes to dustin's :D00:45
rm_worki think i just decided to start over because his was going to be confusing to rebase...00:45
rm_workor i just forgot00:45
rm_workbut i am also pretty sure i pulled some stuff from his so *shrug*00:45
rm_worki personally give zero shits about LoC credit :D00:46
johnsomlol, well, it is easy enough to be polite too....00:46
rm_workah yeah, i mean personally00:46
rm_workI generally try to be polite to *others*00:47
johnsomDid you see this: https://review.opendev.org/#/c/68217100:47
rm_workbut do whatever you want with my stuff here00:47
rm_workdid not see it yet00:47
rm_workneed to go through and look for new reviews sometime this week, maybe tomorrow00:47
johnsom+1 to backport the master release notes....00:47
rm_worklolol00:47
rm_workyeah ... maybe it shouldn't have been at the top00:48
rm_worki wonder if we can control the order00:48
rm_worki've seen people do it by accident and catch it and remove it00:48
rm_workbut some prolly don't notice00:48
johnsomIt is alphabetical00:48
johnsomI think00:48
rm_workok so...00:48
rm_workzBackport-Candidate00:48
rm_work:D00:48
rm_worki am pretty sure that person meant to +1 the patch not the backport00:48
rm_workit's caught *me* before00:49
johnsomReally I think that was just a "backport the world" action as I saw a few of those recently00:49
rm_worki give benefit of the doubt here00:49
rm_workbecause i really have seen it catch people up, including myself00:49
johnsomhttps://review.opendev.org/#/c/667249/00:49
rm_workOR it could be +1 scripts that aren't smart so they just pick the first field :D00:49
johnsomThat could be00:50
rm_workcould make a field "aIMABot"00:51
rm_workand see who +1s it00:51
johnsomThat would be fun00:55
*** hongbin has joined #openstack-lbaas01:03
*** baffle has quit IRC02:18
lxkongjohnsom: may i know how do you trigger the job `publish-openstack-octavia-amphora-image-bionic`?02:20
lxkongrm_work ^^02:20
johnsomIt is periodic, it runs once a day02:21
lxkongjohnsom: where is that defined?02:21
johnsomOctavia/zuul/jobs.yaml02:22
lxkongjohnsom: yeah, i can only see the job definition itself, i mean where `runs once a day` is defined?02:23
lxkongis it the behavior of `publish-openstack-artifacts` job?02:23
johnsomOh, projects.yaml, it is at the bottom02:23
lxkongah, i see02:23
lxkongjohnsom: ta02:25
johnsomNp02:25
*** baffle has joined #openstack-lbaas02:29
openstackgerritMerged openstack/python-octaviaclient master: Update master for stable/train  https://review.opendev.org/68217103:04
rm_workcgoncalves: you around to +A https://review.opendev.org/#/c/682327/ ?03:12
rm_workwould like gates working :D03:12
rm_workor johnsom if he wants ;)03:12
johnsomSince the PTL told me too03:16
johnsomrm_work On https://review.opendev.org/#/c/682420/ Are you sure those aren't in the "client" part of the REST driver? or are you arguing we change all of them?03:18
*** psachin has joined #openstack-lbaas03:22
*** ricolin has joined #openstack-lbaas03:22
*** ramishra has joined #openstack-lbaas03:33
rm_workwell you're changing:03:36
rm_workoctavia/amphorae/drivers/driver_base.py03:36
rm_workoctavia/amphorae/drivers/noop_driver/driver.py03:36
rm_workand this is03:36
rm_workoctavia/amphorae/drivers/haproxy/rest_api_driver.py03:36
rm_workbut03:37
rm_workwithin that file...03:37
rm_workhmm, maybe you're right, maybe that's why it got conflated to begin with?03:37
rm_workbut it might not be a bad idea to update03:38
rm_workjust to make things less confusing03:38
rm_workupdate_agent_config is called from update_amphora_agent_config lol03:38
rm_workyeah I might vote to update them all, but technically yours is the only one that needs to be updated to fix the bug, so I'll +203:39
*** hongbin has quit IRC04:01
*** hongbin has joined #openstack-lbaas04:08
*** hongbin has quit IRC04:10
openstackgerritMerged openstack/octavia master: Fix openstack port show content handling  https://review.opendev.org/68232705:15
*** pcaruana has joined #openstack-lbaas05:16
*** goldyfruit_ has quit IRC05:19
*** gcheresh has joined #openstack-lbaas05:23
*** pcaruana has quit IRC05:29
*** gcheresh has quit IRC05:45
*** ccamposr has joined #openstack-lbaas06:06
*** sapd1_x has joined #openstack-lbaas06:19
*** mjozefcz has joined #openstack-lbaas06:21
*** eandersson has quit IRC06:28
*** gcheresh has joined #openstack-lbaas06:34
*** eandersson has joined #openstack-lbaas06:38
*** gcheresh has quit IRC06:44
cgoncalvessuch a beautiful awk line07:03
openstackgerritMaciej Józefczyk proposed openstack/octavia master: Validate supported LB algorithm in Amphora provider drivers  https://review.opendev.org/67247707:05
*** gtema has joined #openstack-lbaas07:19
gtemaHey Octavia guys. Since few days devstack jobs in OpenStackSDK with octavia enabled are failing with following devstack setup message: argument --bind_ip: Invalid IPAddress value:07:20
gtemai.e. https://zuul.opendev.org/t/openstack/build/00faec04eed849ae85995325cc135fc3/log/job-output.txt#3624307:20
gtemaany ideas why could this happen? I do not see any recent suspicious changes07:21
gthiemongegtema: a fix was merged 2h ago: https://review.opendev.org/#/c/682327/07:21
*** ivve has joined #openstack-lbaas07:21
gtemaoj, that's great. Thanks a lot07:21
*** trident has quit IRC07:22
*** rpittau|afk is now known as rpittau07:28
*** trident has joined #openstack-lbaas07:31
*** trident has quit IRC07:36
*** trident has joined #openstack-lbaas07:46
*** gcheresh has joined #openstack-lbaas07:47
*** rcernin has quit IRC07:47
*** gcheresh has quit IRC08:03
*** tkajinam has quit IRC08:03
*** ataraday has joined #openstack-lbaas08:20
*** luksky has joined #openstack-lbaas08:44
*** frickler has joined #openstack-lbaas08:50
*** sapd1_x has quit IRC08:53
*** pcaruana has joined #openstack-lbaas09:19
openstackgerritMerged openstack/octavia stable/stein: Fixed pool and members status with UDP loadbalancers  https://review.opendev.org/67536209:57
openstackgerritGregory Thiemonge proposed openstack/octavia master: Fix healthmonitor message v2 for UDP listeners  https://review.opendev.org/68236509:57
openstackgerritMerged openstack/octavia stable/stein: Fixed down server issue after reloading keepalived  https://review.opendev.org/67536309:58
*** ramishra_ has joined #openstack-lbaas10:07
*** pcaruana has quit IRC10:07
*** ramishra has quit IRC10:08
openstackgerritGregory Thiemonge proposed openstack/octavia-tempest-plugin master: Added tests for creation of listeners on same port  https://review.opendev.org/66817610:08
openstackgerritGregory Thiemonge proposed openstack/octavia-tempest-plugin master: Add tests for mixed IP networks UDP members  https://review.opendev.org/66861910:08
openstackgerritGregory Thiemonge proposed openstack/octavia-tempest-plugin master: Add UDP test scenario  https://review.opendev.org/65651510:08
*** gtema has left #openstack-lbaas10:10
*** sapd1_x has joined #openstack-lbaas10:25
*** luksky has quit IRC10:29
lxkonghi octavia-core, anyone could please review https://review.opendev.org/682240?10:31
*** pcaruana has joined #openstack-lbaas10:55
*** luksky has joined #openstack-lbaas11:05
*** goldyfruit_ has joined #openstack-lbaas11:07
*** rouk has quit IRC11:14
*** sapd1_x has quit IRC11:15
*** boden has joined #openstack-lbaas11:45
*** Conqueror has joined #openstack-lbaas11:49
*** takamatsu has joined #openstack-lbaas11:53
*** goldyfruit_ has quit IRC12:02
*** pcaruana has quit IRC12:27
*** openstackstatus has quit IRC12:28
*** openstack has joined #openstack-lbaas12:32
*** ChanServ sets mode: +o openstack12:32
*** pcaruana has joined #openstack-lbaas12:59
*** goldyfruit_ has joined #openstack-lbaas13:09
*** yamamoto has joined #openstack-lbaas13:20
*** pcaruana has quit IRC13:28
*** goldyfruit_ has quit IRC13:39
*** psachin has quit IRC13:43
*** gthiemonge has quit IRC13:55
*** gthiemonge has joined #openstack-lbaas13:55
*** goldyfruit_ has joined #openstack-lbaas13:59
*** pcaruana has joined #openstack-lbaas13:59
*** rpittau is now known as rpittau|afk14:10
*** goldyfruit___ has joined #openstack-lbaas14:17
*** goldyfruit_ has quit IRC14:20
*** Vorrtex has joined #openstack-lbaas14:27
*** pcaruana has quit IRC14:55
cgoncalveshelp needed reviewing backport patches: https://review.opendev.org/#/q/status:open+project:openstack/octavia+NOT+branch:master+AND+Workflow%253E%253D014:57
openstackgerritCarlos Goncalves proposed openstack/octavia stable/rocky: Fix l7rule API handling of None updates  https://review.opendev.org/67855115:01
openstackgerritCarlos Goncalves proposed openstack/octavia stable/queens: Fix l7rule API handling of None updates  https://review.opendev.org/67855715:03
*** Vorrtex has quit IRC15:09
*** luksky has quit IRC15:11
*** sapd1 has quit IRC15:14
*** sapd1 has joined #openstack-lbaas15:15
*** ivve has quit IRC15:27
*** nmagnezi has joined #openstack-lbaas15:35
*** goldyfruit_ has joined #openstack-lbaas15:50
*** goldyfruit___ has quit IRC15:53
*** boden has quit IRC16:09
*** AustinR has quit IRC16:11
*** AustinR has joined #openstack-lbaas16:12
*** yamamoto has quit IRC16:14
*** boden has joined #openstack-lbaas16:23
*** goldyfruit___ has joined #openstack-lbaas16:40
*** goldyfruit_ has quit IRC16:43
*** luksky has joined #openstack-lbaas16:50
*** pcaruana has joined #openstack-lbaas16:55
*** ramishra_ has quit IRC17:08
*** yamamoto has joined #openstack-lbaas17:40
*** yamamoto has quit IRC17:48
openstackgerritMichael Johnson proposed openstack/octavia master: Allow IPv6 health network in devstack  https://review.opendev.org/66510318:00
openstackgerritMichael Johnson proposed openstack/octavia master: Allow IPv6 health network in devstack  https://review.opendev.org/66510318:07
openstackgerritMerged openstack/octavia stable/stein: Prevent UDP LBs to use different IP protocol versions in amphora driver  https://review.opendev.org/67536418:07
openstackgerritMerged openstack/octavia stable/rocky: Add support for monitor_{address,port} in UDP members  https://review.opendev.org/67535118:07
openstackgerritMerged openstack/octavia stable/rocky: Fixed pool and members status with UDP loadbalancers  https://review.opendev.org/67557518:07
openstackgerritMerged openstack/octavia stable/rocky: Fixed down server issue after reloading keepalived  https://review.opendev.org/67557618:07
openstackgerritMerged openstack/octavia stable/rocky: Prevent UDP LBs to use different IP protocol versions in amphora driver  https://review.opendev.org/67557718:07
johnsomLooks like we got through some of those backport reviews....18:08
*** ccamposr has quit IRC18:24
*** ccamposr has joined #openstack-lbaas18:27
*** ricolin has quit IRC18:28
*** Vorrtex has joined #openstack-lbaas18:30
*** goldyfruit___ has quit IRC18:31
*** henriqueof has joined #openstack-lbaas18:38
cgoncalvesstill 12 to go18:41
*** mjozefcz has quit IRC19:05
openstackgerritGhanshyam Mann proposed openstack/octavia-tempest-plugin master: [train][goal] Define new 'octavia-v2-dsvm-noop-api-ipv6-only' job  https://review.opendev.org/68272619:37
*** gmann has joined #openstack-lbaas19:39
*** dtruong has quit IRC19:40
*** goldyfruit___ has joined #openstack-lbaas19:40
*** dtruong has joined #openstack-lbaas19:40
openstackgerritGhanshyam Mann proposed openstack/octavia-tempest-plugin master: [train][goal] Define new 'octavia-v2-dsvm-noop-api-ipv6-only' job  https://review.opendev.org/68272619:41
johnsomWell, that was a collision in work...19:42
gmannjohnsom: if you have patch ready and it take time to rebase or merge with mine then I can abandon mine. whatever easy for you19:45
johnsomgmann I can run with this, no problem.  The base_vars is new to me though. It looks like zuul doesn't like them either.19:46
gmannok. i thought that can work but we can copy paste the *base_vars_2 and*base_vars_319:48
openstackgerritMichael Johnson proposed openstack/octavia master: Allow IPv6 health network in devstack  https://review.opendev.org/66510319:49
colin-was i mistaken about the health monitor api supporting a string search for HTTP type checks?19:51
johnsomcolin- Correct, not implemented yet19:51
colin-understood19:51
*** goldyfruit_ has joined #openstack-lbaas20:15
*** goldyfruit___ has quit IRC20:18
*** boden has quit IRC20:20
*** mjozefcz has joined #openstack-lbaas20:43
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: [train][goal] Define new 'octavia-v2-dsvm-noop-api-ipv6-only' job  https://review.opendev.org/68272620:44
zigoHi.20:47
zigoWill there be a train release of octavia-lib ?20:47
zigoI'm currently going through all the Train libs pacakging for Debian...20:48
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: [train][goal] Define new 'octavia-v2-dsvm-noop-api-ipv6-only' job  https://review.opendev.org/68272620:48
*** trident has quit IRC20:48
johnsomzigo It is already out, 1.4.0: https://releases.openstack.org/train/index.html#octavia-lib20:48
zigojohnsom: It's not mirrored in github, then?20:48
johnsomShould be20:49
johnsomzigo https://github.com/openstack/octavia-lib/tree/1.4.020:49
johnsomIt is there20:49
johnsompypi too: https://pypi.org/project/octavia-lib/#history20:50
zigoOh, I did it already in fact ! :)20:51
zigoJust didn't upload ...20:51
zigoI got to tell, we learned how to love Octavia in our company.20:54
zigoThanks for it !20:54
zigoIt's really convenient ...20:54
openstackgerritMerged openstack/octavia stable/stein: Add support for oslo_middleware http_proxy_to_wsgi  https://review.opendev.org/67446720:55
*** mjozefcz has quit IRC20:55
*** luksky has quit IRC20:55
zigoJust one thing, I don't get why our load balancers never leave operating_status OFFLINE ...20:55
zigoThough it does work ...20:55
zigoWe're still on Rocky in production though.20:56
zigoIs this a known bug?20:56
zigojohnsom: ^20:57
*** pcaruana has quit IRC20:58
*** trident has joined #openstack-lbaas21:00
johnsomzigo No, that likely means your lb-mgmt-net is not working. The health heartbeat messages are not getting back to the controllers for some reason.21:02
zigojohnsom: The network is ok, the load balancer system does work ...21:03
johnsomCheck this config setting: https://docs.openstack.org/octavia/latest/configuration/configref.html#health_manager.controller_ip_port_list21:03
johnsomThen check that the health manager is getting the heartbeat packets on UDP 555521:03
zigoOh...21:04
zigojohnsom: Typically, that'd be the IP of the API ?21:04
johnsomzigo You can still load balance if the lb-mgmt-net is not getting it's heartbeats. We just won't update stats, status, or be able to do failovers21:04
zigoOk, good to know.21:05
johnsomNo, it's a list of the health manager endpoints on the lb-mgmt-net21:05
zigoHum...21:05
zigoSo, the health manager needs to have a network interface on the lb-mgnt-net then?21:05
johnsomYes21:05
johnsomTechnically the worker, health manager, and housekeeping should have an interface on that network21:06
johnsomAPI does not need it21:06
zigoThat's not how I designed it ... :(21:06
zigoWhy can't it just be the API IP ?21:06
johnsomWell, for one thing, the amphroa don't have access to keystone for a token21:06
zigoOur workers don't have an IP on the lb-mgmt-net, and it still works ...21:07
zigoOn our setup, the amphora could ...21:07
zigoIt's routed.21:07
zigoProbably we shouldn't do that.21:07
zigoBut I got the point.21:08
zigoThanks.21:08
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: [train][goal] Define new 'octavia-v2-dsvm-noop-api-ipv6-only' job  https://review.opendev.org/68272621:14
johnsomSorry for the patch noise, need to figure out this ansible/yaml syntax. As always, ansible is "lightly documented"21:14
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: [train][goal] Define new 'octavia-v2-dsvm-noop-api-ipv6-only' job  https://review.opendev.org/68272621:16
openstackgerritMerged openstack/octavia stable/stein: Fix template that generates vrrp check script  https://review.opendev.org/67975321:16
*** Vorrtex has quit IRC21:21
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: [train][goal] Define new 'octavia-v2-dsvm-noop-api-ipv6-only' job  https://review.opendev.org/68272621:23
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: [train][goal] Define new 'octavia-v2-dsvm-noop-api-ipv6-only' job  https://review.opendev.org/68272621:24
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: [train][goal] Define new 'octavia-v2-dsvm-noop-api-ipv6-only' job  https://review.opendev.org/68272621:29
*** ccamposr has quit IRC21:34
*** ccamposr has joined #openstack-lbaas21:38
lxkongjohnsom, rm_work may i have your review to the patch https://review.opendev.org/#/c/682240/? We need that in our scenario test22:04
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: [train][goal] Define new 'octavia-v2-dsvm-noop-api-ipv6-only' job  https://review.opendev.org/68272622:06
johnsomlxkong I saw you mention last night. I need to understand the issue22:11
lxkongjohnsom: it's in our prod, when running that test case, i found the VIP port `device_owner ` was changed to `compute:None`22:13
johnsomYeah, I guess that is a nova / neutron race condition.22:14
lxkongand we are using old version for both Nova and Neutron22:15
lxkong:-(22:15
openstackgerritMichael Johnson proposed openstack/octavia master: Allow IPv6 health network in devstack  https://review.opendev.org/66510322:19
*** ccamposr__ has joined #openstack-lbaas22:23
*** ccamposr has quit IRC22:26
rm_workYeah I'll look lxkong22:58
*** tkajinam has joined #openstack-lbaas23:04
lxkongrm_work: ty23:14
*** goldyfruit_ has quit IRC23:17
openstackgerritMichael Johnson proposed openstack/octavia master: Allow IPv6 health network in devstack  https://review.opendev.org/66510323:29
*** rcernin has joined #openstack-lbaas23:44
*** yamamoto has joined #openstack-lbaas23:46
*** yamamoto has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!