*** ccamposr has quit IRC | 00:01 | |
*** PagliaccisCloud has joined #openstack-lbaas | 00:41 | |
*** sapd1 has joined #openstack-lbaas | 00:45 | |
*** PagliaccisCloud has quit IRC | 00:48 | |
*** abaindur has quit IRC | 00:53 | |
*** abaindur has joined #openstack-lbaas | 00:54 | |
*** sapd1 has quit IRC | 01:20 | |
*** colby_ has quit IRC | 01:45 | |
rm_work | johnsom: does building an amp image really require root? <_< | 01:49 |
---|---|---|
rm_work | i never really noticed | 01:50 |
rm_work | i guess it has to mount stuff | 01:51 |
openstackgerrit | Merged openstack/octavia master: Change openstack-dev to openstack-discuss https://review.openstack.org/622005 | 01:57 |
*** dayou has quit IRC | 01:59 | |
johnsom | I want to say it didn’t originally, that it used the userspace tools, but I guess DIB has changed. | 02:03 |
*** sapd1 has joined #openstack-lbaas | 02:04 | |
*** dayou has joined #openstack-lbaas | 02:06 | |
*** sapd1 has quit IRC | 02:09 | |
openstackgerrit | Merged openstack/octavia-tempest-plugin master: Adds a mixed IPv4/IPv6 members traffic test https://review.openstack.org/611405 | 02:14 |
*** colby_ has joined #openstack-lbaas | 02:17 | |
rm_work | hmmm | 02:20 |
rm_work | i wonder if there's a way around that | 02:20 |
*** psachin has joined #openstack-lbaas | 02:57 | |
*** yangjianfeng has joined #openstack-lbaas | 03:11 | |
*** yangjianfeng has quit IRC | 03:14 | |
*** yamamoto has quit IRC | 03:34 | |
*** yamamoto has joined #openstack-lbaas | 03:34 | |
*** yamamoto has quit IRC | 03:36 | |
*** hongbin has joined #openstack-lbaas | 03:51 | |
*** sapd1 has joined #openstack-lbaas | 04:07 | |
*** beno12345 has joined #openstack-lbaas | 04:26 | |
beno12345 | hi, just updated from 2.0.1 to 2.0.2 (queens) and previously had 3 health-manager processes...now theres 11 and its making repeated connections to rabbitmq as the neutron user which dont seem to close.....we idled at 400 rabbitmq connections previously...now its hitting 1100...restart health manager drops them all but they quickly come back....any changes that could be related? | 04:27 |
openstackgerrit | German Eichberger proposed openstack/octavia master: Amphora logging https://review.openstack.org/624835 | 04:49 |
xgerman | beno12345: the only thing I know which is messing with the queue is the event streamer (see https://github.com/openstack/octavia/blob/master/etc/octavia.conf#L100) this should be noop | 04:52 |
xgerman | not sure how you would end up with 11 processes since we only start the number defined in the configs + had/backported the process patch for a long while | 04:53 |
beno12345 | zgerman...yeah, just noticed we had it set to queue_event_streamer...changed tov noop and not it doesnt make the rabbitmq connections (guess this is no longer needed and not using neutron-lbaas) | 05:04 |
beno12345 | which config option to set the number of health-manager processes....i couldnt find anything that looked related | 05:05 |
*** hongbin has quit IRC | 05:40 | |
*** dims has quit IRC | 06:27 | |
*** dims has joined #openstack-lbaas | 06:28 | |
*** gcheresh has joined #openstack-lbaas | 06:32 | |
*** dims has quit IRC | 06:33 | |
*** dims has joined #openstack-lbaas | 06:34 | |
*** celebdor has joined #openstack-lbaas | 06:38 | |
*** yboaron has joined #openstack-lbaas | 06:39 | |
*** PagliaccisCloud has joined #openstack-lbaas | 06:55 | |
*** beno12345 has quit IRC | 07:10 | |
*** etp has joined #openstack-lbaas | 07:35 | |
*** celebdor has quit IRC | 07:41 | |
*** sapd1 has quit IRC | 07:49 | |
*** pcaruana has joined #openstack-lbaas | 08:03 | |
*** rpittau has joined #openstack-lbaas | 08:04 | |
*** sapd1 has joined #openstack-lbaas | 08:06 | |
*** yboaron has quit IRC | 08:15 | |
*** pcaruana has quit IRC | 08:24 | |
*** pcaruana has joined #openstack-lbaas | 08:33 | |
*** pcaruana has quit IRC | 08:41 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/octavia-dashboard master: Imported Translations from Zanata https://review.openstack.org/626115 | 08:42 |
*** velizarx has joined #openstack-lbaas | 08:50 | |
*** rcernin has quit IRC | 08:51 | |
*** celebdor has joined #openstack-lbaas | 08:54 | |
*** yboaron has joined #openstack-lbaas | 09:00 | |
*** ccamposr has joined #openstack-lbaas | 09:13 | |
*** abaindur has quit IRC | 09:25 | |
*** sapd1 has quit IRC | 09:34 | |
*** sapd1 has joined #openstack-lbaas | 09:35 | |
openstackgerrit | Carlos Goncalves proposed openstack/octavia master: Set same debug log level as per DevStack local.conf https://review.openstack.org/626132 | 09:56 |
nmagnezi | cgoncalves, how did we live without ^^ ?? :D | 10:08 |
cgoncalves | we never had to debug octavia. it is so perfect and flawless | 10:09 |
nmagnezi | True. | 10:09 |
*** salmankhan has joined #openstack-lbaas | 10:15 | |
*** salmankhan1 has joined #openstack-lbaas | 10:23 | |
*** salmankhan has quit IRC | 10:24 | |
*** salmankhan1 is now known as salmankhan | 10:24 | |
openstackgerrit | Merged openstack/octavia-dashboard master: Imported Translations from Zanata https://review.openstack.org/626115 | 10:26 |
*** psachin has quit IRC | 10:29 | |
openstackgerrit | Carlos Goncalves proposed openstack/octavia master: Fixing data model to_dict() recursive function https://review.openstack.org/605382 | 10:30 |
*** sapd1 has quit IRC | 11:10 | |
*** sapd1 has joined #openstack-lbaas | 11:17 | |
*** salmankhan has quit IRC | 11:35 | |
*** phuoc_ has joined #openstack-lbaas | 11:43 | |
*** phuoc has quit IRC | 11:47 | |
*** phuoc_ has quit IRC | 11:47 | |
*** phuoc_ has joined #openstack-lbaas | 11:47 | |
*** rpittau is now known as rpittau|lunch | 12:19 | |
*** celebdor has quit IRC | 12:27 | |
*** hogepodge has quit IRC | 12:29 | |
*** hogepodge has joined #openstack-lbaas | 12:30 | |
*** velizarx has quit IRC | 12:31 | |
*** velizarx has joined #openstack-lbaas | 12:48 | |
*** salmankhan has joined #openstack-lbaas | 12:50 | |
*** sapd1 has quit IRC | 13:03 | |
*** rpittau|lunch is now known as rpittau | 13:19 | |
*** celebdor has joined #openstack-lbaas | 13:27 | |
openstackgerrit | ZhaoBo proposed openstack/octavia master: Support Host header inject for healthmonitor HTTP 1.1 health check https://review.openstack.org/626183 | 14:52 |
*** amuller has joined #openstack-lbaas | 15:14 | |
openstackgerrit | ZhaoBo proposed openstack/python-octaviaclient master: Add new options to HealthMonitor CLI https://review.openstack.org/626190 | 15:15 |
*** gcheresh has quit IRC | 15:32 | |
*** velizarx has quit IRC | 15:42 | |
openstackgerrit | Joe Talerico proposed openstack/octavia master: Fix config options https://review.openstack.org/626227 | 16:03 |
*** yboaron_ has joined #openstack-lbaas | 16:11 | |
*** yboaron has quit IRC | 16:14 | |
*** ccamposr has quit IRC | 16:32 | |
dulek | Hey folks, do you have a minimum supported protocol set to consider an Octavia driver valid? | 16:52 |
johnsom | Hmmm, interesting question. Currently no. | 16:53 |
*** yboaron_ has quit IRC | 16:55 | |
dulek | johnsom: Okay, just for context - we simply don't want to maintain this: https://github.com/openstack/kuryr-kubernetes/blob/8f871ee23476ddfe009c5c25fda07a8a01379669/kuryr_kubernetes/controller/drivers/lbaasv2.py#L40-L43 | 16:55 |
dulek | johnsom: Especially if someone uses some homegrown driver. ;) | 16:55 |
dulek | johnsom: At least TCP seems to be lowest common denominator? | 16:56 |
johnsom | Typically yes. | 16:56 |
*** rpittau has quit IRC | 17:06 | |
xgerman | johnsom: https://review.openstack.org/#/c/624835/ | 17:26 |
xgerman | in my devstack: | 17:26 |
xgerman | stack@octavia:~$ ls -l /var/log/octavia-amphora.log | 17:26 |
xgerman | -rw-r----- 1 syslog adm 1209 Dec 19 12:24 /var/log/octavia-amphora.log | 17:26 |
xgerman | stack@octavia:~$ | 17:26 |
xgerman | so maybe I need to touch that before I let it loose | 17:27 |
xgerman | ? | 17:27 |
xgerman | never mind | 17:33 |
openstackgerrit | German Eichberger proposed openstack/octavia master: Amphora logging https://review.openstack.org/624835 | 17:33 |
*** gcheresh has joined #openstack-lbaas | 17:39 | |
*** salmankhan has quit IRC | 18:05 | |
*** gcheresh has quit IRC | 18:08 | |
openstackgerrit | Carlos Goncalves proposed openstack/octavia-tempest-plugin master: Fix dependency on requests library version https://review.openstack.org/625836 | 18:12 |
openstackgerrit | Carlos Goncalves proposed openstack/octavia-tempest-plugin master: Fix dependency on requests library version https://review.openstack.org/625836 | 18:40 |
cgoncalves | how many PS do I need for a one-liner patch -_- | 18:41 |
amuller | cgoncalves: certainly you intended to file a story and attach it to the commit message :) | 18:53 |
cgoncalves | amuller, psssst! I thought of that on PS2. I AM sure no one cares for the tempest plugin | 18:59 |
amuller | bad habit | 19:00 |
openstackgerrit | Carlos Goncalves proposed openstack/octavia-tempest-plugin master: Fix dependency on requests library version https://review.openstack.org/625836 | 19:09 |
cgoncalves | you win | 19:09 |
*** yboaron_ has joined #openstack-lbaas | 19:12 | |
amuller | it's a good story :) | 19:38 |
*** yboaron_ has quit IRC | 19:43 | |
*** gcheresh has joined #openstack-lbaas | 19:45 | |
johnsom | #startmeeting Octavia | 20:00 |
openstack | Meeting started Wed Dec 19 20:00:04 2018 UTC and is due to finish in 60 minutes. The chair is johnsom. Information about MeetBot at http://wiki.debian.org/MeetBot. | 20:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 20:00 |
*** openstack changes topic to " (Meeting topic: Octavia)" | 20:00 | |
openstack | The meeting name has been set to 'octavia' | 20:00 |
johnsom | Hi all | 20:00 |
xgerman | o/ | 20:00 |
nmagnezi | o/ | 20:00 |
johnsom | This might be it this week. I know some folks are out. | 20:00 |
johnsom | #topic Announcements | 20:01 |
*** openstack changes topic to "Announcements (Meeting topic: Octavia)" | 20:01 | |
johnsom | Denver Summit call-for-papers is now open, deadline January 23rd. | 20:01 |
johnsom | #link http://lists.openstack.org/pipermail/openstack-discuss/2018-December/001091.html | 20:01 |
johnsom | Time to start thinking about sessions we would like to propose | 20:01 |
xgerman | logging ;-) | 20:01 |
xgerman | flavors ;-) | 20:01 |
johnsom | I hope to be there, so I am willing to help with presentations as well. | 20:02 |
nmagnezi | What not to log.. :D | 20:02 |
*** PagliaccisCloud has quit IRC | 20:02 | |
xgerman | +1 | 20:02 |
johnsom | We should still have the option for project update and on boarding sessions. | 20:03 |
xgerman | yeah, I hope qulaity of talks goes up now as it’s co-located with the PTG again | 20:04 |
johnsom | The other announcement I have is I am cancelling next weeks meeting as many folks are on holiday. | 20:04 |
johnsom | +1 for that | 20:04 |
nmagnezi | Weeks? | 20:04 |
nmagnezi | Not just one week? | 20:04 |
johnsom | One week | 20:04 |
johnsom | Octavia weekly IRC meeting is cancelled for December 26th. | 20:04 |
nmagnezi | oh, I read this wrong | 20:04 |
nmagnezi | Ignore me | 20:04 |
xgerman | yeah, I am back 1/2 | 20:04 |
johnsom | I probably wrote it wrong, so all fair | 20:05 |
johnsom | Yeah me too. | 20:05 |
johnsom | I'm off Friday through the 2nd. But I should be reachable if there is something important. | 20:05 |
johnsom | Any other announcements this week? | 20:05 |
johnsom | #topic Brief progress reports / bugs needing review | 20:06 |
nmagnezi | Nothing on my end. Mostly focusing on pushing reviews so we can shrink the list one that etherpad | 20:06 |
*** openstack changes topic to "Brief progress reports / bugs needing review (Meeting topic: Octavia)" | 20:06 | |
johnsom | Yeah, my week has been all about reviews, fixing patches, rebasing, and gate work. | 20:07 |
johnsom | Thanks folks for working on the patch list! I feel like we are making progress | 20:07 |
xgerman | https://review.openstack.org/#/c/624835/ - works ok in devstack now trying to make gates give us amp logs | 20:07 |
xgerman | please review | 20:07 |
nmagnezi | xgerman, will do. Please also add it here | 20:08 |
nmagnezi | #link https://etherpad.openstack.org/p/octavia-priority-reviews | 20:08 |
nmagnezi | ppl mostly look there | 20:08 |
xgerman | yeah, will do once it does the amp logs in the gate | 20:08 |
johnsom | We also released stable branch packages this week. | 20:09 |
johnsom | I also updated OSA to pull those SHAs. | 20:09 |
xgerman | +1000 | 20:09 |
nmagnezi | yup | 20:09 |
nmagnezi | #link https://review.openstack.org/#/c/625144/ | 20:09 |
nmagnezi | Thanks for that | 20:09 |
johnsom | Not that I can get an OSA AIO install to work, but that is a different issue. | 20:10 |
xgerman | while you are there: https://review.openstack.org/#/c/603228/ | 20:10 |
xgerman | otherwise it’s a wasteland | 20:10 |
johnsom | Any other updates this week? | 20:11 |
johnsom | I am still planning to try to have the base flavors stuff done by the end of the week | 20:11 |
xgerman | yeah | 20:11 |
johnsom | #topic Open Discussion | 20:12 |
*** openstack changes topic to "Open Discussion (Meeting topic: Octavia)" | 20:12 | |
johnsom | Ok, any other topics for this week? | 20:12 |
xgerman | don’t think so but we have seen bizarre errors lately - must be the season | 20:12 |
xgerman | mostly nova though ;-) | 20:13 |
johnsom | Yeah, I have seen some strange things from a bunch of services recently | 20:13 |
*** brtknr has quit IRC | 20:13 | |
xgerman | +1 | 20:14 |
nmagnezi | We had strange breakages in our downstream CI, stuff like https://review.openstack.org/#/c/625836/ | 20:14 |
johnsom | I need to figure out what is up with the bionic gate all of sudden. It's dying on an rsyslog package issue that doesn't make any sense. | 20:14 |
xgerman | yeah, hope we don’t come back from the holidays and everyhting is red | 20:15 |
johnsom | Well, it's good we are finding things. It means the testing is working.... grin | 20:15 |
johnsom | Ok, anything else today? | 20:16 |
nmagnezi | One question | 20:16 |
johnsom | Sure | 20:16 |
nmagnezi | About the centos gate | 20:16 |
nmagnezi | Which is currently non voting | 20:17 |
nmagnezi | I'm not up to speed with this, what do we have left to do in order for it to vote again? | 20:17 |
johnsom | Right as it's broken again | 20:17 |
nmagnezi | yeah I just didn't follow this recently as cgoncalves did | 20:17 |
nmagnezi | But he's not here at the moment | 20:17 |
johnsom | Yeah, so for us to consider it back to voting, I would like to see a good track record for it passing here: http://zuul.openstack.org/builds?job_name=octavia-v2-dsvm-py2-scenario-centos-7 | 20:18 |
nmagnezi | ack. Will keep an eye on that. thanks! | 20:19 |
nmagnezi | No further questions | 20:19 |
johnsom | Yeah, I would hope that we would have some code contributors that are supporting that gate. For example figuring out what is wrong with it now. | 20:20 |
nmagnezi | Definitely the reason I asked this :) | 20:20 |
johnsom | Sadly I don't have cycles to focus there.... Just to much going on | 20:20 |
johnsom | Ok, any other topics? | 20:21 |
johnsom | Ok, thanks folks! enjoy the week without an IRC meeting next week. | 20:22 |
johnsom | #endmeeting | 20:22 |
*** openstack changes topic to "Discussions for Octavia | Stein priority review list: https://etherpad.openstack.org/p/octavia-priority-reviews" | 20:22 | |
openstack | Meeting ended Wed Dec 19 20:22:49 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:22 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/octavia/2018/octavia.2018-12-19-20.00.html | 20:22 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/octavia/2018/octavia.2018-12-19-20.00.txt | 20:22 |
openstack | Log: http://eavesdrop.openstack.org/meetings/octavia/2018/octavia.2018-12-19-20.00.log.html | 20:22 |
*** PagliaccisCloud has joined #openstack-lbaas | 20:41 | |
*** gcheresh has quit IRC | 20:48 | |
rm_work | oh whoops | 21:23 |
johnsom | Morning | 21:44 |
johnsom | grin | 21:44 |
xgerman | :-) | 22:04 |
xgerman | anyone knows why this https://review.openstack.org/#/c/624835/10/zuul.d/jobs.yaml ain’t work - or is enough friends with the infra people that they answer questions ;-) | 22:05 |
*** rcernin has joined #openstack-lbaas | 22:19 | |
lxkong | guys, any suggsetion to deal with lbs in immutable status(e.g. pending_update)? I think the lbs will be left in pending_update status when being failed over but suddenly the octavia-worker is restarted or killed. | 22:30 |
johnsom | Yes, if the control plane processes are killed via -9 and not gracefully shutdown you can end up with objects stuck in pending_* states. | 22:31 |
johnsom | Best option is to modify their state to ERROR in the DB and fire a failover API call | 22:33 |
lxkong | johnsom: will gracefully shutdown give any help? | 22:34 |
lxkong | the process will wait until the failover is done? | 22:34 |
johnsom | Yes, if you do a graceful shutdown (-15) it will finish open actions prior to shutting down and will not leave things in odd states | 22:35 |
openstackgerrit | Michael Johnson proposed openstack/octavia-tempest-plugin master: Add traffic tests using an IPv6 VIP https://review.openstack.org/611980 | 22:35 |
*** rcernin has quit IRC | 22:36 | |
lxkong | johnsom: ok, thanks for the suggestion | 22:37 |
*** rcernin has joined #openstack-lbaas | 22:37 | |
xgerman | and it turns out I am blind: http://logs.openstack.org/35/624835/10/check/octavia-v2-dsvm-scenario/2993dba/ has the amp-logs but we also will need it for the non-legacy jobs. | 22:53 |
johnsom | Yeah, you really shouldn't mess with the legacy jobs. They are only there for v1 api, etc. | 22:54 |
xgerman | also #infra says we should labe our jobs legacy and non-legacy to be less ocnfusing | 22:54 |
johnsom | Well, they are in two completely different repos, so.... | 22:55 |
xgerman | I went with https://review.openstack.org/#/c/612622/16/zuul.d/jobs.yaml — but there was only legacy | 22:56 |
johnsom | Our jobs are all in tempest-plugin | 22:56 |
xgerman | well, I shall, make change there, too, then | 22:57 |
*** rcernin has quit IRC | 22:57 | |
*** rcernin has joined #openstack-lbaas | 22:58 | |
*** rcernin has quit IRC | 22:59 | |
openstackgerrit | German Eichberger proposed openstack/octavia-tempest-plugin master: Save amphora logs in gate https://review.openstack.org/626406 | 23:02 |
xgerman | ^^ and here it is | 23:02 |
*** rcernin has joined #openstack-lbaas | 23:07 | |
*** PagliaccisCloud has quit IRC | 23:16 | |
*** rcernin has quit IRC | 23:38 | |
*** rcernin has joined #openstack-lbaas | 23:41 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!