Wednesday, 2021-06-16

*** gthiemon1e is now known as gthiemonge08:23
opendevreviewGregory Thiemonge proposed openstack/octavia master: Disable conntrack for TCP flows in the amphora  https://review.opendev.org/c/openstack/octavia/+/79660808:47
spateljohnsom hey! morning14:27
spatelwhat is the good way to restart haproxy without dropping connection? inshort reloading config14:27
johnsomspatel Hello. Yeah, online early for a training session. sigh14:27
spatelno worry! 14:28
johnsomspatel This might help: https://www.haproxy.com/blog/truly-seamless-reloads-with-haproxy-no-more-hacks/14:29
johnsomBut, basically yes, you use reload14:29
spatelthat doc is very complicated to understand..14:31
spateli read and didn't understand if any single liner14:32
johnsomYeah, it goes into the history behind the zero downtime config reload14:32
johnsomSummary, use the systemd reload command14:32
johnsomhttp://git.haproxy.org/?p=haproxy-2.4.git;a=blob;f=admin/systemd/haproxy.service.in;h=05fc595796c479b444a804119235388142decab9;hb=HEAD14:33
johnsomObviously you can't use that file directly, you should use the one provided with your distribution package14:34
*** gthiemon1e is now known as gthiemonge14:37
spateljohnsom that works!!!! 14:44
spateli have 1 million connection so worried :)14:44
johnsomYeah, just be aware, during the transition you may be using a lot more RAM, so plan accordingly14:44
gthiemonge#startmeeting Octavia16:00
opendevmeetMeeting started Wed Jun 16 16:00:50 2021 UTC and is due to finish in 60 minutes.  The chair is gthiemonge. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
opendevmeetThe meeting name has been set to 'octavia'16:00
gthiemongeHi16:00
johnsomo/16:01
haleybhi16:01
gthiemonge#topic Announcements16:01
gthiemongefunctional tests are broken on octavia master - related to sqlachemy 1.4?16:01
gthiemonge#link https://zuul.opendev.org/t/openstack/build/76fb5298a6b54152bc67722a10e18a2316:02
rm_worko/16:02
rm_workHmm maybe16:02
gthiemongeI'm going to take a look after the meeting, unless someone has an idea16:02
rm_workI put up a patch that I think is also related, with duplicate member creation error handling16:02
johnsom"Deferred loader for attribute 'pool_id' failed to populate correctly" lol16:03
rm_workWhere's zzzeek lol16:03
gthiemongethere are a bunch of other errors in the same job16:03
gthiemongeTypeError: unsupported operand type(s) for +: 'ImmutableColumnCollection' and 'list'16:03
haleybDatabase health check failed due to: boom.: Exception: boom16:04
haleybthat's a nice exception16:04
johnsomThanks16:05
rm_workXD16:05
rm_workYeah that one was probably typed into the test data16:05
rm_workMocked exception ;)16:05
johnsomI used that for an expected failur16:05
rm_work^^ yeah in a bunch of places16:05
* johnsom is in a parallel meeting, so slightly distracted16:06
gthiemongenext announcement/topic is:16:07
gthiemongelower-constraints jobs are broken on python-octaviaclient stable branches (<=victoria)16:07
gthiemongeanother one!16:07
gthiemonge#link https://zuul.opendev.org/t/openstack/build/a2ae26e5c9e9442caa04ac5e1addeccd16:07
gthiemongeThere are at least 3 stable branches affected:16:08
gthiemonge#link https://review.opendev.org/q/project:openstack%252Fpython-octaviaclient+status:open16:08
gthiemongeand I can see other errors on train16:09
haleybwere we going to drop those jobs from stable branches?  i think other components did16:09
haleyboh, we did in octavia too16:10
gthiemongeYeah we can drop the lower-constraints job on stable branches, I think we already did it in the past for similar reason16:10
johnsomNo. we decided not to as our tests, unlike some other projects, actually test lower constraints16:10
johnsomYeah, I think we agreed that stable could go16:10
gthiemongeok16:11
gthiemongeI'll take a look at those patches as well16:11
haleybjohnsom: so was that a yes or a no?16:11
rm_workyes for stable-branches, no for master branch16:12
rm_workAFAIU16:12
johnsomYes for stable. No we are not going to remove it for the main branch16:12
johnsomRight16:12
gthiemongerm_work: Yes, that was our agreement from a previous meeting16:12
rm_workthen we're all agreed! again! :D16:12
haleybagreed, can do like we did for octavia repo then16:13
gthiemongeyep16:13
gthiemongegreat!16:13
gthiemongeany other announcements?16:13
gthiemongeok16:14
gthiemonge#topic Brief progress reports / bugs needing review16:15
gthiemongenot such much upstream work for this week, I've been focusing on downstream tasks.16:15
gthiemongebut I proposed a commit to disable conntrack for TCP connections in the amphora16:16
gthiemonge#link https://review.opendev.org/c/openstack/octavia/+/79660816:16
johnsomYeah, all I have is the client patch for large cloud improvements and the associated backports16:16
gthiemongeconntrack is always enabled in Octavia but we should use it only for LVS-based listeners (UDP/SCTP)16:17
johnsom+1 to that16:17
johnsomWish we could just remove that kernel module again, but at least we can bypass it for non-UDP based traffic16:17
gthiemongeI heard people complaining about the kernel messages that are logged when the conntrack table is full, and then an haproxy with a high maxconn was killed by the oom-killer.16:17
rm_workbleh :/16:18
rm_workoh, so probably (maybe?) related to SQLAlchemy upgrade: https://review.opendev.org/c/openstack/octavia/+/79563716:18
rm_worki should update the title to mention it's also for listeners, pre-emptively16:18
gthiemonge#topic Open Discussion16:22
gthiemongeAny other topics today?16:22
haleybcan we decide on an irc channel? :-p16:22
haleybhttps://review.opendev.org/c/openstack/project-config/+/79399916:22
gthiemongejohnsom: rm_work: should we propose a pytohn-octaviaclient release for Xena?16:22
haleybthat way i can update the contributor doc16:23
gthiemongehaleyb: yeah sorry I was a bit lazy on that one16:23
johnsomYes, if it's not broken. grin16:23
gthiemongeI'll fix the commit and re-propose it16:23
gthiemongejohnsom: master is broken?16:23
gthiemongejohnsom: I'll check what you did :D16:23
johnsomI don't know16:23
opendevreviewAdam Harwell proposed openstack/octavia master: Make duplicate constraint checks more generic  https://review.opendev.org/c/openstack/octavia/+/79563716:24
gthiemongeso the next meeting will probably be held in openstack-octavia16:25
rm_workI wish we could do channel redirects... ... can we do that?16:25
gthiemongeif my commit passes the CI :D16:25
rm_workI still don't particularly like switching the channel name16:25
gthiemongerm_work: I don't think OFTC supports it16:26
johnsomRight, I don't think OFTC supports it16:26
rm_worki think it's 50/50, maybe some people are looking for the "openstack-octavia" channel and can't find it? but I think once we switch it's just going to be some people failing to find the lbaas channel <_<16:26
gthiemongewe will be in the lbaas channel, redirecting people to octavia ;-)16:26
haleybshould i flip a coin?16:26
rm_workmy followup for that is, if it's a coin flip, why bother changing16:27
rm_workwe have like 8 years of people knowing where this channel is :D16:27
rm_workand docs showing it is here, etc16:27
haleybok, thumb war then16:27
rm_worklol16:27
gthiemongeYeah you have a point here16:28
rm_worki mean whatever, if you're set on changing the name, i guess that's fine... it just seems pointless to me16:28
rm_workgo sit in #openstack-octavia and set the topic to "head over to #openstack-lbaas"16:29
rm_work;)16:29
johnsomWe can easily make openstack-octavia disappear as well.16:29
haleybi proposed it just as we were moving, pendulum never swung far enough i guess16:29
rm_worki mean there's two ways to look at that -- we're moving, so lets rip the bandaid and do all the change at once; or: we're already doing one change, lets upset things as little as possible16:30
rm_workbut wasting too much time discussing this is just bikeshedding :D16:30
rm_workI'm +016:31
rm_workso if the change is merging, i'll see you over there :P16:31
gthiemongeok, I'll abandon the change, we will stay on #openstack-lbaas16:31
gthiemongechange is still WIP-1 and 2xCR-116:32
gthiemongeso that would be extra work for me16:32
haleybok, i'll update by contrib doc patch then to point to OFTC16:32
gthiemongehaleyb: thanks, rm_work will review that change16:32
rm_workI will :P16:32
rm_workping me!16:32
haleyboh, and while we're on the simple patch wagon, https://review.opendev.org/c/openstack/python-octaviaclient/+/795902 fits the bill16:33
gthiemongehaleyb: I'll review it thanks16:34
gthiemongeOk guys, anything else?16:34
gthiemongeOk thank you!16:36
gthiemonge#endmeeting16:36
opendevmeetMeeting ended Wed Jun 16 16:36:43 2021 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:36
opendevmeetMinutes:        https://meetings.opendev.org/meetings/octavia/2021/octavia.2021-06-16-16.00.html16:36
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/octavia/2021/octavia.2021-06-16-16.00.txt16:36
opendevmeetLog:            https://meetings.opendev.org/meetings/octavia/2021/octavia.2021-06-16-16.00.log.html16:36
opendevreviewBrian Haley proposed openstack/octavia master: Update contributor documentation  https://review.opendev.org/c/openstack/octavia/+/79321616:36
haleybrm_work: there you go ^^16:37
johnsomThanks Greg16:37
rm_work+216:38

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!