| *** goldyfruit_ has joined #openstack-lbaas | 00:05 | |
| rm_work | <_< | 00:35 |
|---|---|---|
| *** ricolin has joined #openstack-lbaas | 01:57 | |
| *** psachin has joined #openstack-lbaas | 04:02 | |
| *** ramishra has joined #openstack-lbaas | 04:06 | |
| *** ajay33 has joined #openstack-lbaas | 04:35 | |
| *** pcaruana has joined #openstack-lbaas | 04:37 | |
| *** tkajinam has quit IRC | 05:04 | |
| *** gcheresh_ has joined #openstack-lbaas | 05:11 | |
| *** pcaruana has quit IRC | 05:14 | |
| *** tkajinam has joined #openstack-lbaas | 05:42 | |
| *** pcaruana has joined #openstack-lbaas | 06:13 | |
| *** gcheresh_ has quit IRC | 06:44 | |
| *** maciejjozefczyk has joined #openstack-lbaas | 07:03 | |
| *** takamatsu has joined #openstack-lbaas | 07:08 | |
| *** tesseract has joined #openstack-lbaas | 07:12 | |
| *** tesseract has quit IRC | 07:14 | |
| *** tesseract has joined #openstack-lbaas | 07:14 | |
| *** ivve has joined #openstack-lbaas | 07:19 | |
| *** trident has quit IRC | 07:27 | |
| *** trident has joined #openstack-lbaas | 07:31 | |
| *** rpittau|afk is now known as rpittau | 08:12 | |
| *** gcheresh_ has joined #openstack-lbaas | 08:13 | |
| *** tkajinam has quit IRC | 08:16 | |
| *** takamatsu has quit IRC | 08:21 | |
| *** takamatsu has joined #openstack-lbaas | 08:36 | |
| *** gcheresh_ has quit IRC | 08:38 | |
| *** ramishra has quit IRC | 08:43 | |
| *** ramishra has joined #openstack-lbaas | 09:00 | |
| f0o | is train coming out today or will it be postponned? | 09:07 |
| cgoncalves | f0o, it is scheduled to be released this week: https://releases.openstack.org/train/schedule.html | 09:12 |
| f0o | just referring to https://releases.openstack.org/train/schedule.html#train-release together with https://releases.openstack.org/train/index.html - the Schedule advertises today as release day but the release summary lists a lot of RCs - just curious I guess | 09:14 |
| cgoncalves | my understanding is that https://review.opendev.org/#/c/687991/ is the go/no-go for final release | 09:18 |
| f0o | thanks :) | 09:19 |
| cgoncalves | reading backlog of #openstack-release, it all seems the train is on track to leave on schedule and today | 09:20 |
| f0o | awesome | 09:21 |
| *** gcheresh_ has joined #openstack-lbaas | 09:25 | |
| *** rcernin has quit IRC | 09:54 | |
| frickler | nlbaas cores please have a look at this fix, mainly to support py3, but also resolving a long standing bug for py2 https://review.opendev.org/688391 | 09:58 |
| cgoncalves | reviewed. thank you for the patch | 10:10 |
| *** gcheresh_ has quit IRC | 10:40 | |
| openstackgerrit | Jens Harbott (frickler) proposed openstack/neutron-lbaas stable/stein: Fix lb stats model https://review.opendev.org/688391 | 11:05 |
| frickler | cgoncalves: ^^ added a reno, but IIUC with the master branch being dead, release notes aren't updated/published anymore. at least there is no job for it I can find | 11:06 |
| *** maciejjozefczyk has quit IRC | 11:07 | |
| cgoncalves | frickler, thanks. hmm, now that you mention it I think we were sort of forced to disable release notes jobs due to some CI related issues | 11:20 |
| cgoncalves | +2 | 11:21 |
| *** maciejjozefczyk has joined #openstack-lbaas | 11:21 | |
| *** rcernin has joined #openstack-lbaas | 11:30 | |
| *** sapd1 has joined #openstack-lbaas | 12:00 | |
| *** ivve has quit IRC | 12:03 | |
| openstackgerrit | Ann Taraday proposed openstack/octavia master: Convert Lb flows to use provider dicts https://review.opendev.org/671725 | 12:09 |
| openstackgerrit | Ann Taraday proposed openstack/octavia master: Jobboard based controller https://review.opendev.org/647406 | 12:09 |
| *** sapd1 has quit IRC | 12:12 | |
| *** AlexStaf has quit IRC | 12:18 | |
| *** ivve has joined #openstack-lbaas | 12:18 | |
| *** AlexStaf has joined #openstack-lbaas | 12:18 | |
| *** AlexStaf has quit IRC | 12:28 | |
| *** AlexStaf has joined #openstack-lbaas | 12:28 | |
| *** AustinR has joined #openstack-lbaas | 12:32 | |
| *** gcheresh_ has joined #openstack-lbaas | 13:04 | |
| *** lxkong has joined #openstack-lbaas | 13:07 | |
| *** lemko has joined #openstack-lbaas | 13:25 | |
| lemko | Hi, which database does octavia directly use? Only octavia? or also neutron, nova? | 13:26 |
| cgoncalves | lemko, only the octavia database | 13:27 |
| lemko | thanks | 13:27 |
| cgoncalves | all interactions with neutron happen via Neutron API | 13:28 |
| lemko | because I've some problem with some slow databases running on slow ceph : health message was processed too slowly: 14.0596139431s! The system may be overloaded or otherwise malfunctioning. This heartbeat has been ignored and no update was made to the amphora health entry | 13:33 |
| lemko | This means the update to Octavia db only was too slow? | 13:33 |
| lemko | I don't want to migrate all my database to some other storage | 13:34 |
| lemko | but if it's only Octavia, I would not be too sad. | 13:34 |
| *** gcheresh_ has quit IRC | 13:37 | |
| cgoncalves | lemko, correct. I'd recommend you to fix the DB slowdown rather than moving the octavia database elsewhere, especially if that is a production environment | 13:40 |
| johnsom | lemko: that db transaction that is taking your system 14+ seconds normally only takes hundredths of a second to complete. | 13:55 |
| *** rcernin has quit IRC | 13:57 | |
| *** ajay33 has quit IRC | 13:58 | |
| *** spatel has joined #openstack-lbaas | 14:30 | |
| *** spatel has quit IRC | 14:45 | |
| *** tobias-urdin has joined #openstack-lbaas | 14:58 | |
| tobias-urdin | got an amphora that failed when reprovisioning a new image, so the active_standby load balancer is degraded now | 15:01 |
| tobias-urdin | only one amphora instance exists, the backup one is status ERROR in the database and octavia doesn't seem to want to try rebuilding it again | 15:01 |
| tobias-urdin | how can i force it to try to spawn a new backup amphora? | 15:02 |
| *** ataraday_ has joined #openstack-lbaas | 15:02 | |
| johnsom | The amphora failover API is not working for you? | 15:03 |
| tobias-urdin | hm what do you mean? one amphora is gone but octavia doesn't seem to want to spawn a new one | 15:05 |
| *** ivve has quit IRC | 15:05 | |
| tobias-urdin | the master is alive so traffic is flowing, just that there is no standby because it failed the last spawn and now it has stopped trying | 15:05 |
| johnsom | If the failed amphora is still associated with the load balancer, but listed in ERROR you can try: https://docs.openstack.org/api-ref/load-balancer/v2/index.html#failover-amphora | 15:05 |
| johnsom | If not, there is the LB failover that may work: https://docs.openstack.org/api-ref/load-balancer/v2/index.html#failover-a-load-balancer | 15:06 |
| lemko | cgoncalves and johnsom, the DB's performance are not possible to improve. It can happen that under some specific circumstances (that I cannot affect ) that the storage gets really slow. It doesn't matter too much for other openstack components, but only for Octavia and its health checks. | 15:07 |
| tobias-urdin | johnsom: just want it to spawn a the standby and not be a single amphora | 15:09 |
| tobias-urdin | openstack loadbalancer failover <id> | 15:09 |
| tobias-urdin | Invalid state ERROR of loadbalancer resource 1f40457d-059c-4ce6-bd91-5c1b26d28539 | 15:09 |
| tobias-urdin | provisioning_status is ERROR on the loadbalancer | 15:10 |
| tobias-urdin | the master amphora is ALLOCATED, the standby is ERROR (and does not exist) | 15:10 |
| tobias-urdin | the master is alive and traffic is flowing | 15:10 |
| *** maciejjozefczyk has quit IRC | 15:10 | |
| tobias-urdin | rocky btw so not sure if i have the amphora failover api, i dont have the openstackclient command atleast | 15:12 |
| johnsom | I am wondering if you have an old version of Rocky too, as failover should work with LB in ERROR. | 15:13 |
| *** trident has quit IRC | 15:13 | |
| *** trident has joined #openstack-lbaas | 15:17 | |
| openstackgerrit | Jens Harbott (frickler) proposed openstack/neutron-lbaas stable/rocky: Fix lb stats model https://review.opendev.org/688959 | 15:20 |
| openstackgerrit | Jens Harbott (frickler) proposed openstack/neutron-lbaas stable/rocky: Fix lb stats model https://review.opendev.org/688959 | 15:21 |
| tobias-urdin | johnsom: running 3.0.1 and latest is 3.2.0 can see the _test_lb_status or where it's called in load_balancer controller that would allow ERROR state to failover | 15:25 |
| tobias-urdin | *can't see | 15:25 |
| *** lxkong has quit IRC | 15:39 | |
| *** AustinR has quit IRC | 15:40 | |
| *** maciejjozefczyk has joined #openstack-lbaas | 15:46 | |
| *** maciejjozefczyk is now known as mjozefcz|afk | 15:47 | |
| *** AustinR has joined #openstack-lbaas | 15:56 | |
| johnsom | blah, late, just a sec | 16:02 |
| johnsom | #startmeeting Octavia | 16:02 |
| openstack | Meeting started Wed Oct 16 16:02:54 2019 UTC and is due to finish in 60 minutes. The chair is johnsom. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:02 |
| *** openstack changes topic to " (Meeting topic: Octavia)" | 16:02 | |
| openstack | The meeting name has been set to 'octavia' | 16:03 |
| johnsom | Hi folks, sorry for the delay.... | 16:03 |
| colin- | hello octavians | 16:03 |
| ataraday_ | hi | 16:03 |
| gthiemonge | Hi | 16:03 |
| cgoncalves | hi | 16:03 |
| haleyb | hi | 16:03 |
| johnsom | cgoncalves Thanks for the poke. | 16:03 |
| johnsom | #topic Announcements | 16:03 |
| *** openstack changes topic to "Announcements (Meeting topic: Octavia)" | 16:03 | |
| johnsom | Train released today! | 16:03 |
| johnsom | #link https://releases.openstack.org/train/highlights.html | 16:04 |
| johnsom | Thank you to everyone for your contributions. Code, reviews, otherwise! | 16:04 |
| johnsom | In our patch review push we merged 106 patches. | 16:05 |
| xgerman | Congrats!! | 16:06 |
| cgoncalves | many more patches were merged. those 106 patches were the ones we at some point prioritized :) | 16:06 |
| johnsom | Right, absolutely correct. There was more than just the 106, but the 106 was our priority list. | 16:07 |
| amotoki | johnsom: congrats! how did you calculate it? just from my curiosity. | 16:07 |
| johnsom | amotoki We created a "priority review list" around MS2: | 16:08 |
| johnsom | #link https://etherpad.openstack.org/p/octavia-priority-reviews | 16:08 |
| *** tesseract has quit IRC | 16:08 | |
| amotoki | wow! | 16:08 |
| johnsom | It helps us stay on top of patch dependency ordering and priority for the release. | 16:08 |
| openstackgerrit | Ann Taraday proposed openstack/octavia master: Convert Lb flows to use provider dicts https://review.opendev.org/671725 | 16:08 |
| amotoki | cool | 16:09 |
| johnsom | Looking forward, the PTG is coming up in a few weeks. | 16:09 |
| johnsom | We have an etherpad up to gather topics: | 16:09 |
| johnsom | #link https://etherpad.openstack.org/p/octavia-shanghai-U-ptg | 16:10 |
| cgoncalves | $ git rev-list --count 4.0.0..5.0.0 -> 258 patches merged between Stein GA and Train GA | 16:10 |
| johnsom | Nice. | 16:10 |
| johnsom | We are a small team, but we can get stuff done. lol | 16:10 |
| johnsom | Please add any topics to the list that you think the team should discuss at the PTG. | 16:11 |
| johnsom | There will be three Octavia cores attending, so a good quorum. | 16:11 |
| johnsom | If you are interested in other project team etherpads for the PTG, the list is being managed here: | 16:12 |
| johnsom | #link http://ptg.openstack.org/etherpads.html | 16:12 |
| johnsom | Octavia is booked to have a room/table for two and a half days. | 16:13 |
| johnsom | (it sounds like there may not be rooms at this PTG) | 16:13 |
| johnsom | Any other announcements today? | 16:14 |
| johnsom | #topic Brief progress reports / bugs needing review | 16:15 |
| *** openstack changes topic to "Brief progress reports / bugs needing review (Meeting topic: Octavia)" | 16:15 | |
| johnsom | I have been working on a bug around barbican outages/secrets being deleted. I have a patch up for review on that. There is one more part of the bug I'm trying to reproduce. I should have that wrapped up today/tomorrow-ish. | 16:16 |
| *** sapd1 has joined #openstack-lbaas | 16:16 | |
| ataraday_ | I created this #link https://storyboard.openstack.org/#!/story/2006627 some time ago, and pushed one patch, look forward some thoughts on this | 16:17 |
| johnsom | I also took a mental break and put up some docs patches updating the cookbook for some of the new TLS capabilities we added. | 16:17 |
| johnsom | I had the devstack already setup for barbican, so it seemed like a good time to check those off the list. | 16:17 |
| ataraday_ | Jobboard is in progress, convert patches are ready, working on the main change #link https://review.opendev.org/#/c/647406/ | 16:18 |
| cgoncalves | ataraday_, thanks for working on that! I have a question/ask for feedback if that is okay | 16:18 |
| johnsom | ataraday_ Ah, yes! Adding ciphers and protocols was on my short-term wish list. I will take a look and give feedback. I have put some thought into this as well. | 16:18 |
| cgoncalves | should it be set in the configuration file or made available to LB owners via API? | 16:18 |
| johnsom | I assumed we were adding it to the listener API | 16:19 |
| ataraday_ | I proposed adding default cipher setting via config, and one change will add setting specific cipher on each listener | 16:20 |
| ataraday_ | via listener API | 16:20 |
| johnsom | Ok, so a default in config and then optional listener API setting. Yeah, that aligns to my idea as well. | 16:20 |
| cgoncalves | what if the admin wants to limit ciphers? e.g. not permit SSL v1 and v2? | 16:21 |
| *** mjozefcz|afk has quit IRC | 16:21 | |
| johnsom | I also think our default should follow: | 16:22 |
| johnsom | #link https://cheatsheetseries.owasp.org/cheatsheets/TLS_Cipher_String_Cheat_Sheet.html | 16:22 |
| johnsom | I was leaning towards suite B | 16:23 |
| johnsom | Yeah, it probably is valid to have a way for an operator to set a required "minimum" protocol level. Maybe even a blacklist for ciphers | 16:23 |
| colin- | agreed | 16:23 |
| ataraday_ | via API or via config? | 16:24 |
| johnsom | Those are all separate requests/patches however. They don't all need to be in this initial patch. | 16:24 |
| johnsom | I think the minimum and blacklist would be config file settings that the API input is validated against. | 16:25 |
| colin- | for our use cases a minimum protocol level would satisfy most concerns, fwiw | 16:25 |
| ataraday_ | sounds good! | 16:25 |
| cgoncalves | nice, we are all in agreement \o/ | 16:26 |
| johnsom | ataraday_ If you don't mind, after the meeting I can capture my thoughts in the storyboard story. | 16:26 |
| johnsom | We can break it down into different tasks | 16:27 |
| ataraday_ | johnsom, It is highly appreciated! | 16:27 |
| johnsom | Cool. | 16:27 |
| ataraday_ | thanks! | 16:27 |
| johnsom | After I wrap up this barbican story, I'm back to working on the failover flow I started before my vacation. | 16:28 |
| johnsom | Still a lot of work to do there. | 16:28 |
| cgoncalves | nothing to report from my side. reviewing patches and working on tripleo | 16:28 |
| *** psachin has quit IRC | 16:29 | |
| johnsom | Any other updates? If not I will move on to open discussion | 16:30 |
| colin- | mostly sharing for visibility but did open this and may take a stab at an implementation for you folks to review if i can get it working https://storyboard.openstack.org/#!/story/2006653 | 16:30 |
| johnsom | colin- Cool, thanks for working on that. Let us know if we can answer questions, etc.... | 16:31 |
| cgoncalves | nice! | 16:31 |
| colin- | appreciate it, the links to the existing bodies of work where other timeouts were implented was super helpful | 16:31 |
| johnsom | #topic Open Discussion | 16:32 |
| *** openstack changes topic to "Open Discussion (Meeting topic: Octavia)" | 16:32 | |
| johnsom | One thing I would like us to start thinking about is how we currently handle TLS offload listeners. | 16:32 |
| johnsom | The existing implementation is protocol "TERMINATED_HTTPS" | 16:33 |
| johnsom | However, we can support other protocols wrapped in TLS. | 16:33 |
| *** ramishra has quit IRC | 16:34 | |
| johnsom | I have been thinking about should we add a "tls_enabled" boolean and move away from long lists of protocols, or just add more "TERMINATED_*" protocols. | 16:34 |
| johnsom | Not something I can work on any time soon, but something to think about for a future discussion. | 16:35 |
| johnsom | For example, we could support "TERMINATED_TLS_TCP" now if we added it.... | 16:35 |
| johnsom | Anyway, any other topics for today? | 16:36 |
| colin- | fair point, not sure which i prefer but certainly worth noodling on | 16:36 |
| colin- | i do kind of like the idea of a boolean | 16:36 |
| cgoncalves | what would be the benefit of adding a boolean? protocols would still need to be added to the list | 16:36 |
| colin- | abstracting that characteristic away from the listener protocol i guess | 16:37 |
| johnsom | True, but we wouldn't be adding two for each. I.e. SMTP and TERMINATED_TLS_SMTP (bogus example, but...) | 16:37 |
| colin- | so then an HTTPS type listener would either terminate or pass-through their HTTPS traffic based on that, if i am conceptualizing it correctly | 16:37 |
| johnsom | Right, we would need to come up with a "how to do the right thing with the legacy protocol list" | 16:38 |
| cgoncalves | would users be allowed to update "tls_enabled"? I think there would be some amount of implications we would need to take care of in the server side | 16:38 |
| colin- | hm yeah that would be difficult to make mutable | 16:39 |
| cgoncalves | right now to be it seems easier to both users and devs to keep adding TERMINATED_* protocols to the list | 16:39 |
| johnsom | I think it could be possible to update to a tls_enabled state. As long as the validation passes, i.e. certs exist, etc. | 16:39 |
| cgoncalves | mutating that boolean flag would incur anyway in short downtime and breakage of open connections, no? | 16:40 |
| johnsom | Yeah, changing protocols underneath a connection is going to break it. for sure.... | 16:41 |
| *** AustinR has quit IRC | 16:42 | |
| cgoncalves | right. so I am not certain of the value it would bring. I'd need to understand this better, I guess | 16:42 |
| johnsom | I just wanted to raise the discussion. Like I said, not on my short term roadmap at the moment | 16:43 |
| colin- | yeah it's a good thing to start considering | 16:44 |
| johnsom | Any other topics today? | 16:45 |
| johnsom | Ok then, thank you! Nice work on Train. We did some great work there. | 16:46 |
| openstackgerrit | Merged openstack/octavia master: Add client authentication to the LB cookbook https://review.opendev.org/688776 | 16:47 |
| johnsom | #endmeeting | 16:47 |
| *** openstack changes topic to "Discussions for OpenStack Octavia | Priority bug review list: https://etherpad.openstack.org/p/octavia-priority-reviews" | 16:47 | |
| openstack | Meeting ended Wed Oct 16 16:47:06 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:47 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/octavia/2019/octavia.2019-10-16-16.02.html | 16:47 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/octavia/2019/octavia.2019-10-16-16.02.txt | 16:47 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/octavia/2019/octavia.2019-10-16-16.02.log.html | 16:47 |
| cgoncalves | thanks johnsom | 16:47 |
| openstackgerrit | Merged openstack/octavia master: Add backend re-encryption to the LB cookbook https://review.opendev.org/688824 | 16:49 |
| gthiemonge | johnsom: I have script that reads worker's logs (from stdin) and outputs a csv that contains flows and tasks duration: https://gist.github.com/gthiemonge/3ea1c33ba21f895d502e14dca1e6bf58 | 16:49 |
| gthiemonge | (not sure about the date parser, but it works for me on devstack and tripleo) | 16:50 |
| *** rpittau is now known as rpittau|afk | 16:50 | |
| cgoncalves | really good stuff that script! | 16:54 |
| cgoncalves | colin-, would you be interested in testing ^? we were wondering last week's meeting what would be a sane graceful shutdown period | 16:56 |
| cgoncalves | same goes to any other Octavia operator out there :) | 16:56 |
| gthiemonge | it would be nice to get feedback on the duration of octavia-create-loadbalancer-flow | 16:56 |
| johnsom | Maybe we should remove the name field to protect privacy | 16:59 |
| gthiemonge | johnsom: the name field is the name of the flow/task | 17:01 |
| johnsom | Ah, ok | 17:01 |
| colin- | cgoncalves: testing gthiemonge's script you mean, right? sure will make some time for that later on and share any feedback | 17:02 |
| johnsom | mnaser Maybe you could also help us out with some real-world stats by running the above script. | 17:02 |
| colin- | do i ineed to induce a certain condition while it's watching? | 17:02 |
| *** goldyfruit has joined #openstack-lbaas | 17:03 | |
| johnsom | It should be just scraping the times from the log for normal LB creates, etc. | 17:03 |
| colin- | sounds good | 17:03 |
| colin- | looks handy, thanks gthiemonge | 17:04 |
| *** goldyfruit_ has quit IRC | 17:05 | |
| gthiemonge | colin-: thank you, ping me if you have any issues | 17:06 |
| *** AustinR has joined #openstack-lbaas | 17:09 | |
| *** ataraday_ has quit IRC | 17:23 | |
| *** sapd1 has quit IRC | 17:27 | |
| cgoncalves | colin-, thank you!! | 17:33 |
| *** ricolin has quit IRC | 17:36 | |
| *** lemko has quit IRC | 17:55 | |
| *** gcheresh_ has joined #openstack-lbaas | 17:58 | |
| *** TrevorV has joined #openstack-lbaas | 18:05 | |
| openstackgerrit | Brian Haley proposed openstack/octavia master: Stop testing python 2 https://review.opendev.org/687370 | 18:29 |
| openstackgerrit | Merged openstack/neutron-lbaas stable/stein: Fix lb stats model https://review.opendev.org/688391 | 18:52 |
| *** gcheresh_ has quit IRC | 18:58 | |
| openstackgerrit | Merged openstack/octavia-dashboard master: Update master for stable/train https://review.opendev.org/685162 | 19:41 |
| *** gcheresh_ has joined #openstack-lbaas | 20:04 | |
| rm_work | good meeting today :D | 20:26 |
| rm_work | thanks for running it again johnsom | 20:27 |
| johnsom | lol | 20:27 |
| rm_work | I'm still debating whether I should propose a different time again | 20:27 |
| rm_work | could torture carlos's girlfriend with Octavia Date Night again ;) | 20:27 |
| *** pcaruana has quit IRC | 20:28 | |
| *** gcheresh_ has quit IRC | 20:30 | |
| johnsom | Yeah, found an old centos7 image that had devstack on it, figured I could just install queens there. Nope. Devstack used to pull in some bogus version of mariadb so keystone blows up doing a db migration. blah, harder than it should be to run this old version.... | 20:55 |
| johnsom | Fresh VM here I come | 20:55 |
| johnsom | https://bugs.launchpad.net/devstack/+bug/1833696 | 20:59 |
| openstack | Launchpad bug 1833696 in Manila "Devstack installs version-less rdo-release package" [High,Fix released] - Assigned to Goutham Pacha Ravi (gouthamr) | 20:59 |
| colin- | cgoncalves: worked with gthiemonge to produce these in support of the change we discussed earlier. the scenario was a two-controller setup of octavia workers and a terraform job i have that sets up two ordinary web backends and an octavia LB, HTTP/S listeners, pools, members, and HMs. ran it three times: create, destroy // create, destroy // create, failover, destroy | 21:03 |
| colin- | results can be found here: https://gist.github.com/itsc0lin/ea03d7841634ec3495b88d48c0704ddb lmk if anything is out of order | 21:03 |
| johnsom | colin- Thank you for helping us out with that | 21:08 |
| colin- | always happy to run a strange script with little scrutiny on my controllers :o) | 21:08 |
| johnsom | lol, noted... | 21:13 |
| *** TrevorV has quit IRC | 21:24 | |
| rm_work | now we need something to turn that into useful graphs | 22:01 |
| rm_work | I could try to whip out some R.... | 22:01 |
| johnsom | It's not that many data points really. All of the boots are under 1:30 | 22:03 |
| *** AustinR has quit IRC | 22:17 | |
| *** AustinR has joined #openstack-lbaas | 22:30 | |
| johnsom | rm_work You know a bit about kolla ansible for Octavia. Any chance you can go figure out why it's installing old versions of Octavia? Someone on the mailing list is again having trouble with an old version of stable/stein getting installed. | 22:37 |
| rm_work | hmm | 22:37 |
| rm_work | yeah i can take a peek in a minute | 22:37 |
| johnsom | It's like the third or fourth person having the trouble with kolla | 22:37 |
| rm_work | k-a should just be grabbing the tag for whatever version the user specifies | 22:38 |
| rm_work | but i'll check it out | 22:38 |
| johnsom | Cool, thanks | 22:38 |
| rm_work | currently reviewing internal doc proposals >_> | 22:38 |
| johnsom | Fun... I'm fighting with installing old versions of stuff.... | 22:38 |
| rm_work | also i've yet to stand up today since I woke up, so i should do that really quick | 22:39 |
| johnsom | InternalError: Nova requires QEMU version 2.1.0 or greater. | 22:39 |
| rm_work | lol | 22:39 |
| rm_work | yeah bitrot makes some of that a crapshoot | 22:39 |
| johnsom | Seems I need to pull in hacky repos for centos 7 | 22:39 |
| johnsom | qemu is provided by two different repos qemu-ev and EPEL. libvert only sees qemu version installed by epel repository. so removing epel repo and restarting libvirt service should fix the issue | 22:43 |
| johnsom | sudo yum remove qemu-system-x86 | 22:43 |
| johnsom | wow | 22:43 |
| cgoncalves | johnsom, I know that keystone bug! I think I fixed it in devstack, check https://review.opendev.org/#/q/Icb07dcb4c9a3950a3c31a3a8dcb8d0b4c713fdb1 | 23:29 |
| cgoncalves | oh, you found the launchpad # I created :) | 23:30 |
| johnsom | Yeah, it is "fixed" but not if you are already on the newer mariadb.... | 23:30 |
| johnsom | I finally got a queens devstack to boot on centos7. | 23:31 |
| cgoncalves | well... | 23:31 |
| johnsom | Still can't reproduce your "PENDING_UPDATE" state other than when it should be in that state. I'm going to try act/standby next as I see you had that enabled. | 23:31 |
| cgoncalves | colin-, thank you! | 23:31 |
| *** tkajinam has joined #openstack-lbaas | 23:31 | |
| cgoncalves | johnsom, shame on me. I stacked today but haven't touched it | 23:32 |
| johnsom | Funny, even the second TCP listener came up fine. It threw errors in the logs for sure, but it completed. | 23:33 |
| johnsom | Well, something to look at tomorrow. I'm about to call it for the day. | 23:35 |
| rm_work | o/ | 23:42 |
| rm_work | just finished doc reviews, taking a glance at k-a | 23:42 |
| rm_work | i'll let you know | 23:42 |
| rm_work | so k-a basically just uses a tag, and it's set up for octavia just like everything else | 23:47 |
| rm_work | but all it's doing is looking up that tag in your configured docker-repository, so it depends on what docker image you built and uploaded using "kolla" (k-a is in the kolla umbrella but that's a different project) | 23:48 |
| rm_work | and there's binary mode and source mode for that -- so if it's using binaries, that's up to whatever centos/debian/etc have released, so if the distros don't keep up, then stuff will be old | 23:49 |
| rm_work | if it's source mode, it's again just pulling from a tag, and it's all consistent with the way other projects are built | 23:50 |
| openstackgerrit | Merged openstack/python-octaviaclient master: Drop netifaces from requirements.txt https://review.opendev.org/684301 | 23:55 |
| rm_work | i wonder if they're using an old version of kolla-ansible? | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!