| *** yamamoto has quit IRC | 00:04 | |
| *** nmagnezi has quit IRC | 00:09 | |
| *** logan- has quit IRC | 00:12 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Change amphora logging to dedicated socket https://review.opendev.org/674961 | 00:13 |
|---|---|---|
| *** logan- has joined #openstack-lbaas | 00:13 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Re-enable the py36 tox environment https://review.opendev.org/674962 | 00:15 |
| *** mkuf_ has joined #openstack-lbaas | 00:16 | |
| *** mkuf has quit IRC | 00:18 | |
| *** ivve has quit IRC | 00:21 | |
| *** hongbin has joined #openstack-lbaas | 00:34 | |
| *** yamamoto has joined #openstack-lbaas | 00:52 | |
| *** ricolin has joined #openstack-lbaas | 01:02 | |
| *** ricolin_ has joined #openstack-lbaas | 01:17 | |
| *** ricolin has quit IRC | 01:20 | |
| *** pcaruana has quit IRC | 01:26 | |
| *** ricolin_ is now known as ricolin | 02:27 | |
| openstackgerrit | Merged openstack/octavia-tempest-plugin master: Sync enabled_provider_drivers config help message https://review.opendev.org/672799 | 02:34 |
| *** yamamoto has quit IRC | 02:44 | |
| *** yamamoto has joined #openstack-lbaas | 02:45 | |
| *** ramishra has joined #openstack-lbaas | 03:27 | |
| *** psachin has joined #openstack-lbaas | 03:36 | |
| *** ianychoi_ has joined #openstack-lbaas | 03:38 | |
| *** ianychoi has quit IRC | 03:42 | |
| *** pcaruana has joined #openstack-lbaas | 03:44 | |
| *** ajay33 has joined #openstack-lbaas | 03:45 | |
| ajay33 | @rm_work I get out from the error after restarting the octavia services. | 03:47 |
| ajay33 | Thank you very much for you help !!! | 03:47 |
| *** hongbin has quit IRC | 03:49 | |
| *** abaindur has joined #openstack-lbaas | 05:07 | |
| *** abaindur has quit IRC | 05:11 | |
| *** abaindur has joined #openstack-lbaas | 05:11 | |
| *** gcheresh_ has joined #openstack-lbaas | 05:27 | |
| *** ramishra has quit IRC | 06:12 | |
| *** AlexStaf has joined #openstack-lbaas | 06:21 | |
| *** maciejjozefczyk has joined #openstack-lbaas | 06:25 | |
| *** ltomasbo has joined #openstack-lbaas | 06:29 | |
| *** abh0 has joined #openstack-lbaas | 06:33 | |
| *** AlexStaf has quit IRC | 06:34 | |
| abh0 | Hello everyone, | 06:45 |
| abh0 | octavia doesnt talk with it. | 06:45 |
| abh0 | by the way i want any advice except updating the version. | 06:47 |
| *** mkuf has joined #openstack-lbaas | 06:54 | |
| *** mkuf_ has quit IRC | 06:56 | |
| *** yamamoto has quit IRC | 07:00 | |
| *** rcernin has quit IRC | 07:03 | |
| *** rpittau|afk is now known as rpittau | 07:07 | |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia-tempest-plugin master: Enable overcommit_memory in test server VMs https://review.opendev.org/674846 | 07:07 |
| *** ramishra has joined #openstack-lbaas | 07:08 | |
| *** yamamoto has joined #openstack-lbaas | 07:09 | |
| *** tesseract has joined #openstack-lbaas | 07:26 | |
| dulek | cgoncalves: Seems like the presentation haven't been accepted. At least the Summit is going to be a bit less stressful. | 07:27 |
| openstackgerrit | Merged openstack/octavia master: Add missing lib dependencies to requirements.txt https://review.opendev.org/673359 | 07:30 |
| *** ivve has joined #openstack-lbaas | 07:34 | |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia master: Add unit test for failover of spare amphorae https://review.opendev.org/674798 | 07:45 |
| cgoncalves | dulek, I'm okay with that | 07:49 |
| dulek | cgoncalves: Yeah, it's always a bit of relieve, isn't it? | 07:50 |
| openstackgerrit | Maciej Józefczyk proposed openstack/octavia master: Add new algorithm SOURCE_IP_PORT https://review.opendev.org/672463 | 07:51 |
| openstackgerrit | Maciej Józefczyk proposed openstack/octavia master: Validate supported LB algorithm in Amphora provider drivers https://review.opendev.org/672477 | 07:51 |
| cgoncalves | yeah :) | 07:54 |
| cgoncalves | dulek, the schedule page isn't loading the presentation list. does it open fine for you? | 07:55 |
| dulek | cgoncalves: Yes, it does. | 07:56 |
| cgoncalves | it doesn't for me on chrome and firefox | 07:57 |
| *** cgoncalves has quit IRC | 08:04 | |
| *** cgoncalves has joined #openstack-lbaas | 08:04 | |
| *** abaindur has quit IRC | 08:05 | |
| *** abh0 has quit IRC | 08:06 | |
| *** mauro|call has quit IRC | 08:13 | |
| *** mauro|call has joined #openstack-lbaas | 08:14 | |
| *** AlexStaf has joined #openstack-lbaas | 08:21 | |
| *** lemko has joined #openstack-lbaas | 08:43 | |
| *** mauro|call has quit IRC | 08:58 | |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia stable/stein: Fix listener deletion in ACTIVE/STANDBY topology https://review.opendev.org/675063 | 08:59 |
| *** mauro|call has joined #openstack-lbaas | 09:00 | |
| ajay33 | Hi | 09:01 |
| *** tkajinam has quit IRC | 09:02 | |
| ajay33 | My loadbalancer is going into ERROR state. | 09:04 |
| ajay33 | Below is the error message I am getting from octavia-worker.log: | 09:04 |
| ajay33 | 2019-08-07 06:02:04.904 31795 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: requests.exceptions.ConnectionError: HTTPSConnectionPool(host='172.16.1.204', port=9443): Max retries exceeded with url: /0.5/info (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f4f0d6b0390>: Failed to establish a new connection: [Errno 113] No | 09:04 |
| ajay33 | route to host',)) | 09:04 |
| ajay33 | 172.16.0.0/12 is my subnet of my lb-mgmt-subnet | 09:05 |
| ajay33 | More specifically below is my error log: | 09:09 |
| ajay33 | 2019-08-07 07:38:15.319 32660 ERROR octavia.amphorae.drivers.haproxy.exceptions [-] Amphora agent returned unexpected result code 404 with response {'error': '404 Not Found: The requested URL was not found on the server. If you entered the URL manually please check your spelling and try again.', 'http_code': 404} | 09:09 |
| *** mauro|call is now known as takamatsu | 09:14 | |
| *** mkuf__ has joined #openstack-lbaas | 09:27 | |
| *** mkuf has quit IRC | 09:29 | |
| *** mkuf____ has joined #openstack-lbaas | 09:30 | |
| *** mkuf__ has quit IRC | 09:32 | |
| *** mkuf____ has quit IRC | 09:34 | |
| *** mkuf____ has joined #openstack-lbaas | 09:35 | |
| *** mkuf____ has quit IRC | 09:40 | |
| *** mkuf____ has joined #openstack-lbaas | 09:46 | |
| *** mkuf____ has quit IRC | 09:49 | |
| *** sapd1_x has joined #openstack-lbaas | 09:54 | |
| *** ricolin_ has joined #openstack-lbaas | 10:01 | |
| *** ricolin has quit IRC | 10:03 | |
| *** nmagnezi has joined #openstack-lbaas | 10:05 | |
| *** yamamoto has quit IRC | 10:18 | |
| *** spatel has joined #openstack-lbaas | 10:27 | |
| *** spatel has quit IRC | 10:31 | |
| *** gcheresh_ has quit IRC | 10:39 | |
| *** gcheresh has joined #openstack-lbaas | 10:40 | |
| *** yamamoto has joined #openstack-lbaas | 10:41 | |
| *** yamamoto has quit IRC | 10:45 | |
| openstackgerrit | Ann Taraday proposed openstack/octavia master: Transition amphora flows to dicts https://review.opendev.org/668898 | 10:53 |
| *** yamamoto has joined #openstack-lbaas | 10:59 | |
| *** AlexStaf has quit IRC | 11:06 | |
| *** AlexStaf has joined #openstack-lbaas | 11:20 | |
| *** lemko has quit IRC | 11:23 | |
| openstackgerrit | Merged openstack/octavia master: Fix wrong package names or versions for centos-minimal images https://review.opendev.org/674087 | 11:48 |
| *** AlexStaf has quit IRC | 11:57 | |
| *** AlexStaf has joined #openstack-lbaas | 11:58 | |
| openstackgerrit | Maciej Józefczyk proposed openstack/octavia master: Add new algorithm SOURCE_IP_PORT https://review.opendev.org/672463 | 12:01 |
| openstackgerrit | Maciej Józefczyk proposed openstack/octavia master: Validate supported LB algorithm in Amphora provider drivers https://review.opendev.org/672477 | 12:01 |
| henriqueof | Hello there, my load balancers only show empty response on browser, can someone help me debug it? | 12:47 |
| *** lemko has joined #openstack-lbaas | 12:48 | |
| *** ricolin_ is now known as ricolin | 12:48 | |
| openstackgerrit | Ann Taraday proposed openstack/octavia master: [WIP] Lb flows to dicts https://review.opendev.org/671725 | 13:09 |
| henriqueof | The haproxy services show all servers are down, how can I check it? | 13:29 |
| *** tesseract has quit IRC | 13:56 | |
| *** tesseract has joined #openstack-lbaas | 13:57 | |
| *** tesseract has quit IRC | 14:00 | |
| *** tesseract has joined #openstack-lbaas | 14:01 | |
| *** mkuf has joined #openstack-lbaas | 14:13 | |
| *** mkuf has quit IRC | 14:15 | |
| *** spatel has joined #openstack-lbaas | 14:20 | |
| openstackgerrit | Anqi Li proposed openstack/octavia master: Implements notifications for octavia https://review.opendev.org/674432 | 14:39 |
| *** Vorrtex has joined #openstack-lbaas | 14:43 | |
| *** altlogbot_1 has quit IRC | 14:46 | |
| *** altlogbot_3 has joined #openstack-lbaas | 14:47 | |
| *** yamamoto has quit IRC | 14:48 | |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia master: Fixed typos and bad markup style in maintenance guide https://review.opendev.org/675132 | 14:51 |
| *** ianychoi_ is now known as ianychoi | 14:54 | |
| *** yamamoto has joined #openstack-lbaas | 14:54 | |
| *** gcheresh has quit IRC | 14:55 | |
| *** yamamoto has quit IRC | 15:21 | |
| *** yamamoto has joined #openstack-lbaas | 15:21 | |
| *** sapd1_x has quit IRC | 15:42 | |
| *** ataraday_ has joined #openstack-lbaas | 15:45 | |
| rm_work | cgoncalves / johnsom : https://review.opendev.org/#/c/661309/ | 15:56 |
| *** AlexStaf has quit IRC | 15:58 | |
| *** tesseract has quit IRC | 15:58 | |
| johnsom | rm_work Meeting time? | 16:01 |
| colin- | we missed it by one minute :\ | 16:01 |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Change amphora logging to dedicated socket https://review.opendev.org/674961 | 16:02 |
| *** tesseract has joined #openstack-lbaas | 16:02 | |
| *** henriqueof has quit IRC | 16:02 | |
| johnsom | #startmeeting Octavia | 16:03 |
| openstack | Meeting started Wed Aug 7 16:03:48 2019 UTC and is due to finish in 60 minutes. The chair is johnsom. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:03 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:03 |
| *** openstack changes topic to " (Meeting topic: Octavia)" | 16:03 | |
| openstack | The meeting name has been set to 'octavia' | 16:03 |
| ataraday_ | hi | 16:04 |
| johnsom | I am not exactly sure what is going on, but I will start the meeting | 16:04 |
| johnsom | Hi everyone | 16:04 |
| gthiemonge | Hi | 16:04 |
| colin- | \o | 16:04 |
| ajay33 | Hi | 16:04 |
| cgoncalves | hi | 16:05 |
| *** yamamoto has quit IRC | 16:05 | |
| johnsom | Our PTL was just commenting, but then disappeared | 16:05 |
| rm_work | ah | 16:05 |
| colin- | gottem! | 16:05 |
| rm_work | yeah whoops missed the time :D | 16:05 |
| rm_work | was reviewing the patch you just updated about the log socket lol | 16:05 |
| rm_work | go ahead, you're doing good :) | 16:06 |
| rm_work | eiddccidnvgenbjjunkgnkburcikcijfetrlvreflbc | 16:06 |
| johnsom | Ha, well, I don't have an agenda, do you? | 16:06 |
| *** yamamoto has joined #openstack-lbaas | 16:06 | |
| rm_work | ^^ my yubikey wants you to know the meeting is going well | 16:06 |
| *** yamamoto has quit IRC | 16:06 | |
| johnsom | lol, yubikey? | 16:06 |
| johnsom | #topic Announcements | 16:07 |
| *** openstack changes topic to "Announcements (Meeting topic: Octavia)" | 16:07 | |
| *** yamamoto has joined #openstack-lbaas | 16:07 | |
| johnsom | Anybody have anything this week? | 16:07 |
| johnsom | The Shanghai summit schedule is posted | 16:08 |
| johnsom | Ok, moving on then | 16:08 |
| johnsom | #topic Brief progress reports / bugs needing review | 16:08 |
| *** openstack changes topic to "Brief progress reports / bugs needing review (Meeting topic: Octavia)" | 16:08 | |
| *** maciejjozefczyk has quit IRC | 16:09 | |
| johnsom | I have been busy working on octavia-lib provider related things recently. That main work is done, but I have some patch cleanup to do still. | 16:09 |
| rm_work | lots of merging going on! woo! | 16:10 |
| rm_work | great turnaround from a week ago when i was saying i was super concerned about review velocity | 16:10 |
| johnsom | I am going to start work on a better failover flow. | 16:10 |
| johnsom | Yes, it looks like we have burned through 60+ patches since I setup the review list. That is awesome | 16:11 |
| colin- | wow | 16:11 |
| *** yamamoto has quit IRC | 16:11 | |
| ataraday_ | I posted some comments on https://review.opendev.org/#/c/662791/ about issues with retry tasks - usage of redis jobboard, will try to find something else, for now concluding refactor of db object - dicts... | 16:11 |
| openstackgerrit | Anqi Li proposed openstack/octavia master: Implements notifications for octavia https://review.opendev.org/674432 | 16:11 |
| ataraday_ | johnsom, I will need to get your change https://review.opendev.org/#/c/660236/ updated, do you mind if I rebase it? | 16:12 |
| johnsom | ataraday_ Please do, I keep forgetting to look at that. It's going to be a hard one to do. | 16:13 |
| ataraday_ | johnsom, OK, thanks! | 16:13 |
| johnsom | Ah, the data too long for column. I might have some ideas on how to fix that. | 16:14 |
| johnsom | Any other updates? | 16:16 |
| *** lemko has quit IRC | 16:17 | |
| johnsom | #topic Open Discussion | 16:17 |
| *** openstack changes topic to "Open Discussion (Meeting topic: Octavia)" | 16:17 | |
| johnsom | Other topics this week? | 16:18 |
| ataraday_ | johnsom, if you have time, may be you left some comments on change? My only idea to try notify taskflow listener that task is in progress, though not sure it is possible... | 16:18 |
| johnsom | Ok | 16:20 |
| colin- | i realize the original authors of the active-active L3 spec are not present to answer this but wanted to ask anyway because i was curious; when looking at the changes https://review.opendev.org/#/c/453005/15 i don't see any mention of VRRP being used and was curious if anybody knew why not? it appears in haproxy's active-active guidelines is why i was wondering | 16:20 |
| johnsom | VRRP for the top of rack switches or for the amphora? | 16:21 |
| *** maciejjozefczyk has joined #openstack-lbaas | 16:22 | |
| colin- | for the amphora | 16:22 |
| johnsom | cd | 16:22 |
| johnsom | Opps, wrong window. lol | 16:22 |
| colin- | trying to go home so soon :)? | 16:22 |
| *** ricolin_ has joined #openstack-lbaas | 16:23 | |
| johnsom | Well, in active-active the amphora are all equal, they don't need to pass a VIP between amphora, the L3 layer is holding the VIP | 16:23 |
| *** ivve has quit IRC | 16:23 | |
| colin- | i think this might be a mistake on my part, i think the VRRP refers just to their Aloha virtual appliance that i'm actually unfamiliar with | 16:23 |
| johnsom | In the non-L3 ToR active/active, the distributor component will use VRRP to pass the VIP around | 16:23 |
| colin- | so maybe disregard heh, quesiton might be half-baked | 16:23 |
| colin- | ok | 16:24 |
| *** ricolin has quit IRC | 16:26 | |
| johnsom | Ok, anything else? | 16:26 |
| johnsom | ataraday_ That DataError, was that when you were using Redis for persistence? | 16:26 |
| johnsom | Must have lost her. | 16:29 |
| johnsom | Any other topics today? | 16:29 |
| *** ricolin_ is now known as ricolin | 16:29 | |
| *** psachin has quit IRC | 16:30 | |
| johnsom | Ok, thanks everyone | 16:30 |
| johnsom | #endmeeting | 16:30 |
| *** openstack changes topic to "Discussions for OpenStack Octavia | Priority bug review list: https://etherpad.openstack.org/p/octavia-priority-reviews" | 16:30 | |
| openstack | Meeting ended Wed Aug 7 16:30:39 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:30 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/octavia/2019/octavia.2019-08-07-16.03.html | 16:30 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/octavia/2019/octavia.2019-08-07-16.03.txt | 16:30 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/octavia/2019/octavia.2019-08-07-16.03.log.html | 16:30 |
| ataraday_ | johnsom, Redis as jobboard, mysql as persistence | 16:30 |
| johnsom | Ah, ok, thanks. | 16:31 |
| rm_work | woo, nice and short | 16:31 |
| ataraday_ | johnsom, redis need retry for claimning job, tasks info in written in mysql persistence backend | 16:32 |
| johnsom | Yeah, I found the code. It looks like taskflow is using a "Text" column for that. Which holds up to 64k | 16:32 |
| johnsom | We may just need to do a migration and bump that to a "MEDIUMTEXT" column | 16:33 |
| johnsom | Or get taskflow to truncate and not try to store so much | 16:33 |
| ataraday_ | yeah, I filed a bug to taskflow about this, but I want to fix it on our side, so we won't depend on taskflow latest version... | 16:35 |
| johnsom | Ok. We may need to fix that ourselves in taskflow. | 16:35 |
| ataraday_ | I will check your idea with "MEDIUMTEXT" if it worked - probably send change to taskflow | 16:37 |
| ataraday_ | johnsom, thanks a lot for looking into it! | 16:39 |
| *** tesseract has quit IRC | 16:39 | |
| *** ricolin has quit IRC | 16:40 | |
| johnsom | NP | 16:40 |
| *** rpittau is now known as rpittau|afk | 16:56 | |
| *** ramishra has quit IRC | 16:57 | |
| *** maciejjozefczyk has quit IRC | 16:57 | |
| *** gthiemonge has quit IRC | 17:10 | |
| *** altlogbot_3 has quit IRC | 17:17 | |
| *** altlogbot_2 has joined #openstack-lbaas | 17:23 | |
| *** gthiemonge has joined #openstack-lbaas | 17:30 | |
| *** altlogbot_2 has quit IRC | 17:31 | |
| *** henriqueof has joined #openstack-lbaas | 17:32 | |
| henriqueof | My load balancer haproxy says all the servers are down, can someone help me debug it? | 17:33 |
| *** altlogbot_1 has joined #openstack-lbaas | 17:35 | |
| johnsom | henriqueof Hi, What does "openstack loadbalancer status show <lb_id>" show? | 17:44 |
| johnsom | You can use paste.openstack.org to share output | 17:44 |
| henriqueof | johnsom: http://paste.openstack.org/show/755631/ | 17:48 |
| henriqueof | The haproxy logs inside the amphora says all the servers are down, the servers and their respective security groups are created by magnum. | 17:49 |
| openstackgerrit | Merged openstack/octavia master: Fixed pool and members status with UDP loadbalancers https://review.opendev.org/661309 | 17:52 |
| johnsom | henriqueof Ok, first thing is your lb-mgmt-net is not working correctly or the https://docs.openstack.org/octavia/latest/configuration/configref.html#health_manager.controller_ip_port_list setting is not correct for your controllers | 17:54 |
| johnsom | I can see that the heartbeat messages from the amphora instance is not getting back to the controller | 17:54 |
| johnsom | This will not impact traffic flowing through the load balancer however, just the status, stats, and health monitoring. | 17:56 |
| henriqueof | johnsom: I am using the controller's interface I on that setting, will put the management IP. | 17:56 |
| henriqueof | johnsom: I have used this same setting on another OS deployment and it works. :/ | 17:57 |
| *** spatel has quit IRC | 17:57 | |
| johnsom | Something is configured incorrectly as I can see you have health monitors, but the member still shows "NO_MONITOR" on it. This is a clear sign that the controller is not getting the messages from the amphora. | 17:58 |
| openstackgerrit | Merged openstack/octavia master: Fixed down server issue after reloading keepalived https://review.opendev.org/661310 | 17:59 |
| henriqueof | Does this affect the internal haproxy, I mean it can't see the servers? | 18:00 |
| johnsom | No, as I said above, it will not impact the traffic through the load balancer. | 18:01 |
| johnsom | For that issue, are you sure the service is reachable on IP 10.0.0.104 port 32429? Can you reach that from outside the amphora? | 18:02 |
| johnsom | The other thing to check is that 10.0.0.104 is reachable from the subnet you selected when creating the member. | 18:05 |
| henriqueof | Will double check it, one moment. | 18:06 |
| henriqueof | johnsom: just found something very odd, the nodes are connected to the same network and router, one can ping to the internet and the other can't, I added a security group allowing all traffic but still uncapable of going t the internet. | 18:39 |
| henriqueof | Anyway, thanks very much for your help! | 18:39 |
| johnsom | Sure, good luck | 18:39 |
| *** abaindur has joined #openstack-lbaas | 19:00 | |
| *** vesper11 has quit IRC | 19:37 | |
| openstackgerrit | Merged openstack/octavia master: Prevent UDP LBs to use different IP protocol versions in amphora driver https://review.opendev.org/668617 | 19:53 |
| *** ivve has joined #openstack-lbaas | 20:15 | |
| *** ajay33 has quit IRC | 20:29 | |
| *** yamamoto has joined #openstack-lbaas | 21:03 | |
| *** yamamoto has quit IRC | 21:08 | |
| *** Vorrtex has quit IRC | 21:19 | |
| *** vesper11 has joined #openstack-lbaas | 21:25 | |
| *** henriqueof has quit IRC | 21:33 | |
| *** rcernin has joined #openstack-lbaas | 22:15 | |
| rm_work | johnsom: https://review.opendev.org/#/c/672732/ | 22:31 |
| rm_work | johnsom: https://review.opendev.org/#/c/673783/ | 22:31 |
| rm_work | smallish and have +2 from me | 22:31 |
| johnsom | Ok | 22:32 |
| *** ivve has quit IRC | 22:45 | |
| *** yamamoto has joined #openstack-lbaas | 23:08 | |
| abaindur | hey johnsom: did something change for octavia with loadbalancer topology? we're nnot using flavors. and we definitely have loadbalancer_topology = ACTIVE_STANDBY in the config file for worker/health-manager/housekeeping | 23:34 |
| abaindur | but only 1 amphora VM is spun up | 23:34 |
| abaindur | LB shows as ACTIVE | 23:34 |
| abaindur | amphora table in octavia DB is showing it as STANDALONE: | 23:35 |
| abaindur | | 1cd6ae3d-cbba-4525-b52b-bc7418b9c21e | 009721c5-5baf-45ee-83ae-c174212994b9 | ALLOCATED | 4834c6c9-b80a-4147-a93d-ac8509c5accd | 10.73.40.4 | 192.168.60.10 | 192.168.60.22 | 253e3af0-6a90-4b32-a8a8-94bc5ddefbf8 | 94e4e516-fa61-41ec-95d2-8a10c27a071e | STANDALONE | 2021-08-06 23:32:01 | 0 | NULL | 1 | NULL | nova | 2019-08-07 23:32:02 | 2019-08-07 23:34:03 | | 23:35 |
| johnsom | No, without a flavor defined, the loadbalancer_topology setting is what is used. | 23:35 |
| abaindur | fc3e5dc6-01d1-b7ad-ed6e-1935810c8aad | 2 | 23:35 |
| abaindur | yes i definitly have loadbalancer_topology = ACTIVE_STANDBY in [controller_worker] section | 23:36 |
| johnsom | Check your worker log, on startup it dumps the running configuration, is it ACTIVE_STANDBY in there? | 23:37 |
| johnsom | It's a debug message though: | 23:38 |
| johnsom | Jul 30 10:52:23 devstack octavia-worker[19646]: DEBUG cotyledon.oslo_config_glue [-] controller_worker.loadbalancer_topology = SINGLE {{(pid=20380) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2585}} | 23:38 |
| johnsom | What does the load_balancer table in the DB show for it? | 23:39 |
| abaindur | 2019-08-07 16:26:18.216 20671 DEBUG cotyledon.oslo_config_glue [-] controller_worker.loadbalancer_topology = ACTIVE_STANDBY log_opt_values /opt/pf9/pf9-octavia/lib/python2.7/site-packages/oslo_config/cfg.py:2575 | 23:39 |
| abaindur | here are worker logs during start of LB create | 23:40 |
| abaindur | https://gist.github.com/xagent003/bf98f86cf02c14e9934d8b115c272d0f | 23:40 |
| abaindur | yes its showing SINGLE: | 23:40 |
| abaindur | | ccc6c00ce08a4e8794bfe692be87d802 | 4834c6c9-b80a-4147-a93d-ac8509c5accd | lb1 | NULL | ACTIVE | OFFLINE | 1 | SINGLE | NULL | 2019-08-07 23:31:58 | 2019-08-07 23:34:11 | amphora | NULL | | 23:40 |
| abaindur | (and amphora table shows STANDALONE as pasted above) | 23:41 |
| johnsom | So that SINGLE means somehow the API process was configured for SINGLE and not ACTIVE_STANDBY | 23:41 |
| abaindur | yea as i mentioned this config isnt set in the file used by api service - that is located on a different node | 23:42 |
| johnsom | There is no code that can change that after LB create. | 23:42 |
| abaindur | since this was in the [controller_worker] section, i thought it was only used by worker process? | 23:42 |
| johnsom | Ah, that is why then. The API makes the call on that at creation time. | 23:42 |
| johnsom | Yeah, this is a odd ball setting. We really haven't documented which settings are used by which processes. | 23:43 |
| abaindur | so then out of these configs, can you tell me whether its used by API service, or worker/health-manager/housekeeping? | 23:43 |
| abaindur | enable_anti_affinity | 23:44 |
| abaindur | spare_amphora_pool_size | 23:44 |
| colin- | https://docs.openstack.org/octavia/latest/configuration/configref.html#nova.enable_anti_affinity | 23:44 |
| johnsom | spare_amphora_pool_size is not used by they api | 23:44 |
| colin- | https://docs.openstack.org/octavia/latest/configuration/configref.html#house_keeping.spare_amphora_pool_size | 23:45 |
| colin- | the first is a parameter in [nova], the second in the [house_keeping] | 23:45 |
| johnsom | Neither is enabled_anti_affinity | 23:45 |
| abaindur | who uses that then? | 23:46 |
| johnsom | Those are needed by the backend processes however | 23:46 |
| johnsom | enable_anti_affinity should be on worker, HM, and housekeeping. | 23:47 |
| abaindur | Basically we have octavia-api service running on one host, and we have worker, health-manager, and housekeeping running on the other. So we have 2 sets of config files being used depending on which host | 23:47 |
| johnsom | Yeah, same with pool size, it really should be set on all three, but primarily HK uses it | 23:48 |
| johnsom | Yeah, that is a common pattern. | 23:48 |
| abaindur | ok so it looks like we just need to move the loadbalancer_topology config over to the host where api is running | 23:48 |
| abaindur | everything else under [controller_worker] can be left on host where worker/hm/hk run? | 23:48 |
| johnsom | I would have to go through them one by one and look them up. | 23:51 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!