| openstackgerrit | Jude Cross proposed openstack/neutron-lbaas master: [WIP] Remove unnecessary lazy-loaded queries https://review.openstack.org/477698 | 00:06 |
|---|---|---|
| *** salmankhan has joined #openstack-lbaas | 00:53 | |
| openstackgerrit | Jude Cross proposed openstack/neutron-lbaas master: [WIP] Remove unnecessary lazy-loaded queries https://review.openstack.org/477698 | 01:37 |
| *** salmankhan has quit IRC | 01:58 | |
| openstackgerrit | ZhaoBo proposed openstack/octavia master: Add VIP qos into our cookbook https://review.openstack.org/530318 | 02:40 |
| openstackgerrit | Jude Cross proposed openstack/neutron-lbaas master: [WIP] Remove unnecessary lazy-loaded queries https://review.openstack.org/477698 | 04:25 |
| *** yamamoto has joined #openstack-lbaas | 05:10 | |
| *** gans has joined #openstack-lbaas | 06:02 | |
| openstackgerrit | ZhaoBo proposed openstack/octavia master: Add VIP qos into our cookbook https://review.openstack.org/530318 | 06:17 |
| *** armax has quit IRC | 06:30 | |
| *** armax has joined #openstack-lbaas | 06:30 | |
| *** armax has quit IRC | 06:31 | |
| *** armax has joined #openstack-lbaas | 06:32 | |
| *** armax has quit IRC | 06:32 | |
| *** armax has joined #openstack-lbaas | 06:33 | |
| *** armax has quit IRC | 06:34 | |
| *** yamamoto has quit IRC | 06:49 | |
| *** pcaruana has joined #openstack-lbaas | 07:09 | |
| *** rcernin has quit IRC | 07:25 | |
| *** yamamoto has joined #openstack-lbaas | 07:38 | |
| *** yamamoto has quit IRC | 07:49 | |
| openstackgerrit | Ganpat Agarwal proposed openstack/octavia master: [WIP] Add provider Implementation https://review.openstack.org/484325 | 08:07 |
| *** medy has joined #openstack-lbaas | 08:15 | |
| *** medy has quit IRC | 08:16 | |
| *** medy has joined #openstack-lbaas | 08:16 | |
| *** medy has quit IRC | 08:18 | |
| *** medy has joined #openstack-lbaas | 08:18 | |
| *** medy has quit IRC | 08:19 | |
| *** medy has joined #openstack-lbaas | 08:19 | |
| *** medy has quit IRC | 08:21 | |
| *** medy has joined #openstack-lbaas | 08:21 | |
| *** medy has quit IRC | 08:22 | |
| *** medy has joined #openstack-lbaas | 08:22 | |
| *** medy has quit IRC | 08:24 | |
| *** medy has joined #openstack-lbaas | 08:24 | |
| *** medy has quit IRC | 08:25 | |
| *** medy has joined #openstack-lbaas | 08:25 | |
| *** medy has quit IRC | 08:27 | |
| *** medy has joined #openstack-lbaas | 08:27 | |
| *** medy has quit IRC | 08:28 | |
| *** medy has joined #openstack-lbaas | 08:28 | |
| *** medy has quit IRC | 08:29 | |
| *** yamamoto has joined #openstack-lbaas | 08:49 | |
| *** yamamoto has quit IRC | 08:57 | |
| *** yamamoto has joined #openstack-lbaas | 09:53 | |
| openstackgerrit | Carlos Goncalves proposed openstack/octavia master: Fix exception when querying for non-existing items https://review.openstack.org/530886 | 09:59 |
| *** pcaruana has quit IRC | 10:09 | |
| *** pcaruana has joined #openstack-lbaas | 10:10 | |
| openstackgerrit | Carlos Goncalves proposed openstack/octavia master: Fix exception when querying for non-existing items https://review.openstack.org/530886 | 10:19 |
| rm_work | i'll be back today :) in like 8 hours | 10:21 |
| rm_work | finally, sorry, loooong vacation ^_^ | 10:22 |
| *** gans has quit IRC | 11:20 | |
| *** salmankhan has joined #openstack-lbaas | 12:12 | |
| *** yamamoto has quit IRC | 12:24 | |
| *** yamamoto has joined #openstack-lbaas | 12:56 | |
| *** yamamoto has quit IRC | 12:56 | |
| *** yamamoto has joined #openstack-lbaas | 13:28 | |
| *** yamamoto has quit IRC | 13:33 | |
| *** yamamoto has joined #openstack-lbaas | 14:28 | |
| *** yamamoto has quit IRC | 14:32 | |
| *** yamamoto has joined #openstack-lbaas | 14:46 | |
| *** yamamoto has quit IRC | 14:46 | |
| *** ianychoi has quit IRC | 14:53 | |
| openstackgerrit | Kobi Samoray proposed openstack/neutron-lbaas master: Database models timestamps https://review.openstack.org/530939 | 15:04 |
| *** armax has joined #openstack-lbaas | 15:19 | |
| *** armax has quit IRC | 15:23 | |
| *** salmankhan has quit IRC | 15:28 | |
| *** yamamoto has joined #openstack-lbaas | 15:46 | |
| *** shanemhansen has quit IRC | 15:53 | |
| *** yamamoto has quit IRC | 15:54 | |
| *** armax has joined #openstack-lbaas | 15:57 | |
| *** jniesz has joined #openstack-lbaas | 15:57 | |
| *** dims has quit IRC | 16:09 | |
| *** dims has joined #openstack-lbaas | 16:11 | |
| *** openstackgerrit has quit IRC | 16:19 | |
| *** salmankhan has joined #openstack-lbaas | 16:29 | |
| *** pcaruana has quit IRC | 16:35 | |
| *** openstackgerrit has joined #openstack-lbaas | 16:35 | |
| openstackgerrit | Erik Olof Gunnar Andersson proposed openstack/neutron-lbaas master: [WIP] Remove unnecessary lazy-loaded queries https://review.openstack.org/477698 | 16:35 |
| *** salmankhan has quit IRC | 16:44 | |
| *** eandersson has joined #openstack-lbaas | 17:13 | |
| *** yamamoto has joined #openstack-lbaas | 17:16 | |
| *** yamamoto has quit IRC | 17:21 | |
| *** yamamoto has joined #openstack-lbaas | 17:29 | |
| *** yamamoto has quit IRC | 17:34 | |
| openstackgerrit | Jude Cross proposed openstack/neutron-lbaas master: [WIP] Remove unnecessary lazy-loaded queries https://review.openstack.org/477698 | 17:37 |
| *** yamamoto has joined #openstack-lbaas | 17:59 | |
| johnsom | Agenda for today: https://wiki.openstack.org/wiki/Octavia/Weekly_Meeting_Agenda#Meeting_2018-01-03 | 18:00 |
| *** yamamoto has quit IRC | 18:04 | |
| *** yamamoto has joined #openstack-lbaas | 18:16 | |
| *** yamamoto has quit IRC | 18:16 | |
| *** yamamoto has joined #openstack-lbaas | 18:46 | |
| *** yamamoto has quit IRC | 18:54 | |
| *** armax has quit IRC | 19:14 | |
| openstackgerrit | Jude Cross proposed openstack/neutron-lbaas master: [WIP] Remove unnecessary lazy-loaded queries https://review.openstack.org/477698 | 19:36 |
| *** pcaruana has joined #openstack-lbaas | 19:45 | |
| *** longstaff has joined #openstack-lbaas | 19:53 | |
| *** yamamoto has joined #openstack-lbaas | 19:56 | |
| *** cgoncalves has joined #openstack-lbaas | 19:57 | |
| *** pcaruana has quit IRC | 19:59 | |
| johnsom | #startmeeting Octavia | 20:00 |
| openstack | Meeting started Wed Jan 3 20:00:06 2018 UTC and is due to finish in 60 minutes. The chair is johnsom. Information about MeetBot at http://wiki.debian.org/MeetBot. | 20:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 20:00 |
| *** openstack changes topic to " (Meeting topic: Octavia)" | 20:00 | |
| openstack | The meeting name has been set to 'octavia' | 20:00 |
| johnsom | Hi folks | 20:00 |
| jniesz | Hi | 20:00 |
| cgoncalves | hi | 20:00 |
| xgerman_ | hi | 20:00 |
| longstaff | hi | 20:00 |
| nmagnezi | Hi | 20:00 |
| johnsom | #topic Announcements | 20:01 |
| *** openstack changes topic to "Announcements (Meeting topic: Octavia)" | 20:01 | |
| johnsom | Happy New Year! | 20:01 |
| xgerman_ | +1 | 20:01 |
| nmagnezi | +2 :) | 20:01 |
| johnsom | Reminder, feature freeze - Queens MS3 is coming January 22nd | 20:02 |
| johnsom | #link https://releases.openstack.org/queens/schedule.html | 20:02 |
| johnsom | Once we cut milestone 3 no new feature patches can be merged. Only bug fixes and docs update, etc. | 20:03 |
| johnsom | Features that do not make this milestone will become Rocky release features | 20:03 |
| johnsom | Also, along those lines heat support for Octavia v2 API planned for Queens MS3 | 20:04 |
| johnsom | #link https://bugs.launchpad.net/heat/+bug/1737567 | 20:04 |
| openstack | Launchpad bug 1737567 in OpenStack Heat "Direct support for Octavia LBaaS API" [Medium,In progress] - Assigned to Rabi Mishra (rabi) | 20:04 |
| johnsom | The heat team is working to update for the new API endpoint. | 20:04 |
| johnsom | Any other announcements today? | 20:05 |
| johnsom | #topic Brief progress reports / bugs needing review | 20:05 |
| *** openstack changes topic to "Brief progress reports / bugs needing review (Meeting topic: Octavia)" | 20:05 | |
| xgerman_ | I need some eyes on #link https://review.openstack.org/#/c/529688/2 | 20:06 |
| johnsom | I have not made a bunch of progress as I had last week off. I have been catching up on emails and bugs while working on internal end/new year activities. | 20:06 |
| johnsom | My plan is to get back into implementing the amphora API updates for Active/Active that I started before the break. | 20:06 |
| johnsom | Any other progress updates? | 20:08 |
| johnsom | #topic Specs under review | 20:08 |
| *** openstack changes topic to "Specs under review (Meeting topic: Octavia)" | 20:08 | |
| johnsom | Just a reminder, we have two specs open for review: | 20:08 |
| johnsom | Provider driver | 20:08 |
| johnsom | #link https://review.openstack.org/509957 | 20:08 |
| johnsom | UDP load balancing | 20:08 |
| johnsom | #link https://review.openstack.org/503606 | 20:09 |
| johnsom | Please review and vote if you have not already. | 20:09 |
| johnsom | Both are very close to done from my perspective | 20:09 |
| johnsom | #topic Bugs that could use owners | 20:09 |
| *** openstack changes topic to "Bugs that could use owners (Meeting topic: Octavia)" | 20:09 | |
| johnsom | We have a few bugs that came in right before or over the break that we could use some eyes on: | 20:10 |
| cgoncalves | longstaff: do you plan to update your spec soon? I noticed recent implementation activity around it | 20:10 |
| nmagnezi | indeed | 20:10 |
| nmagnezi | #link https://review.openstack.org/#/c/484325/ | 20:10 |
| johnsom | QoS patch broke Session Persistence | 20:11 |
| johnsom | #link https://storyboard.openstack.org/#!/story/2001419 | 20:11 |
| longstaff | cgoncalves: yes I can make sure the updates are completed | 20:11 |
| cgoncalves | longstaff: thanks! it's indeed close to get accepted and merged by cores ;-) | 20:12 |
| johnsom | I have triaged that bug and attached comments about where the problem came in. | 20:12 |
| johnsom | L7rule causes lost responses | 20:12 |
| johnsom | #link https://storyboard.openstack.org/#!/story/2001425 | 20:12 |
| johnsom | I have not had time to look into this one yet. | 20:12 |
| johnsom | Can't create load balancer with ML2 OVS firewall driver | 20:13 |
| johnsom | #link https://storyboard.openstack.org/#!/story/2001426 | 20:13 |
| xgerman_ | I have confirmed but I would blame Neutron ;-) | 20:13 |
| johnsom | I think xgerman_ is currently looking into the OVS firewall issue | 20:13 |
| johnsom | If any of you have some time I would appreciate it if you could adopt one of these bugs and see if we can get a fix put together. | 20:14 |
| rm_work | o/ | 20:14 |
| johnsom | The session persistence one is a regression (we need to get those tempest tests rolling) | 20:14 |
| xgerman_ | +1 | 20:14 |
| johnsom | Ok, I will stop begging for help with bugs... | 20:15 |
| johnsom | #topic Open Discussion | 20:15 |
| *** openstack changes topic to "Open Discussion (Meeting topic: Octavia)" | 20:15 | |
| johnsom | Other topics today? | 20:16 |
| johnsom | I know I am still getting back into work mode and catching up, so maybe it will be quiet today.... | 20:16 |
| xgerman_ | same — | 20:17 |
| johnsom | Plus it's end of year paperwork and compliance training season | 20:17 |
| rm_work | yep | 20:17 |
| johnsom | Ok... Going once.... | 20:18 |
| johnsom | Twice... | 20:18 |
| johnsom | Have a great week back | 20:18 |
| johnsom | #endmeeting | 20:18 |
| *** openstack changes topic to "Welcome to LBaaS / Octavia - Queens development is now open." | 20:18 | |
| openstack | Meeting ended Wed Jan 3 20:18:22 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:18 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/octavia/2018/octavia.2018-01-03-20.00.html | 20:18 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/octavia/2018/octavia.2018-01-03-20.00.txt | 20:18 |
| rm_work | who is taking that SP bug? that needs to be fixed ASAP | 20:18 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/octavia/2018/octavia.2018-01-03-20.00.log.html | 20:18 |
| johnsom | rm_work no one volunteered yet. I triaged and commented on where the problem came in | 20:18 |
| rm_work | k | 20:18 |
| johnsom | But I won't have cycles for a day or two to get back to it. | 20:19 |
| xgerman_ | rm_work nmagnezi https://review.openstack.org/#/c/529688/2 | 20:19 |
| rm_work | yeah same | 20:19 |
| xgerman_ | please with sugar on top | 20:19 |
| rm_work | yeah this looks fine | 20:19 |
| nmagnezi | xgerman_, sorry I was off today, will make sure to visit this | 20:19 |
| xgerman_ | either one of you is fine — johnsom didn’t want to do it ;-) | 20:20 |
| rm_work | got it | 20:20 |
| johnsom | I wrote it.... | 20:20 |
| rm_work | +A | 20:20 |
| xgerman_ | Hooray!!! | 20:20 |
| xgerman_ | finally we can get patches into Pike again!! | 20:20 |
| johnsom | Ok, grabbing lunch, back in a few | 20:21 |
| rm_work | kk | 20:24 |
| rm_work | xgerman_: I still need eyes on https://review.openstack.org/#/c/525302/ and the subsequent patches as well (or at least, that and the actual failover api patch) | 20:24 |
| rm_work | and https://review.openstack.org/#/c/504175/ is getting higher priority, we REALLY need to get that in time for queens... | 20:25 |
| rm_work | it's been ready for review since September <_< | 20:26 |
| rm_work | too much high priority stuff <_< | 20:26 |
| xgerman_ | often I wait a year for reviews… but will look ;-) | 20:28 |
| openstackgerrit | Adam Harwell proposed openstack/octavia master: Minimize the effect overloaded Health Manager processes https://review.openstack.org/531006 | 20:38 |
| rm_work | ^^ feedback on this is welcomed, not sure if this is the right approach or not for overloaded HMs | 20:39 |
| jniesz | I think validating the time of the hb message and ensuring it is not > than the poll interval makes a lot of sense | 20:52 |
| jniesz | otherwise I agree it can quickly get out of control | 20:54 |
| jniesz | and you are acting on stale state | 20:54 |
| *** armax has joined #openstack-lbaas | 20:59 | |
| openstackgerrit | Jude Cross proposed openstack/neutron-lbaas master: Remove unnecessary lazy-loaded queries https://review.openstack.org/477698 | 21:38 |
| *** mwynne has joined #openstack-lbaas | 21:41 | |
| mwynne | Hi. After installing lbaasv2 I get the following error when neutron-server attempts to start: http://paste.openstack.org/show/637545/ | 21:42 |
| mwynne | Is anyone able to take a look at that? | 21:42 |
| mwynne | xgerman_: Migration gone bad? | 21:46 |
| mwynne | How can I recover from that? | 21:46 |
| mwynne | This is a clean installation :S | 21:46 |
| johnsom | mwynee Yeah, the alembic migration for the neutron database is incomplete somehow | 21:56 |
| mwynne | johnsom: Can I re-do that somehow? | 21:56 |
| johnsom | Use the neutron-db-manage tool to "upgrade head" the migrations here: https://github.com/openstack/neutron-lbaas/tree/master/neutron_lbaas/db/migration/alembic_migrations | 21:57 |
| johnsom | I have not seen anyone having trouble with their migrations on a fresh install, but I guess it's possible | 21:58 |
| mwynne | johnsom: http://paste.openstack.org/show/637551/ | 21:58 |
| mwynne | johnsom: I'm in the process of updating my puppet deployment scripts from ocata to pike, and from what I can tell nothing LBAAS related should have changed (at least not with the puppet modules) | 21:59 |
| johnsom | Ugh, ok, so is your neutron lbaas running master or a WIP patch? | 21:59 |
| mwynne | johnsom: How can I tell that? | 22:00 |
| johnsom | Yeah, not much changed in neutron-lbaas either. | 22:00 |
| johnsom | Go into your neutron-lbaas directory and do a "git log" | 22:00 |
| johnsom | paste the first block | 22:00 |
| mwynne | johnsom: Where would that directory be? | 22:01 |
| johnsom | So, to get out of this.... Ugh, trying to remember off my head as I don't have a VM running right now. | 22:01 |
| johnsom | Well, is it a devstack? It doesn't sound like it since you are using puppet | 22:01 |
| mwynne | puppet | 22:02 |
| mwynne | not devstack | 22:02 |
| mwynne | neutron-lbaasv2-agent 11.0.2 (if that's useful) | 22:02 |
| johnsom | So latest Pike. It doesn't really tell me if it's a un merged patch version, but I am assuming not. | 22:05 |
| *** rcernin has joined #openstack-lbaas | 22:05 | |
| johnsom | So, to get you back on track we need to see what migration your database has, it should be neutron-db-manage history or something similar | 22:06 |
| mwynne | johnsom: http://paste.openstack.org/show/637553/ | 22:07 |
| johnsom | Frankly I have never used puppet for a neutron-lbaas install. I'm also a bit rusty with neutron-lbaas as I don't typically run it anymore, just native octavia | 22:07 |
| johnsom | Ok, yeah, it looks like you have multiple heads from the neutron migrations... | 22:08 |
| johnsom | So the neutron migrations never finished, thus you didn't get all of the neutron-lbaas migrations. | 22:09 |
| mwynne | Ah, ok. I might know why that happened, but is there a way for me to re-run the migration? | 22:09 |
| mwynne | I wonder if the migration timed out | 22:10 |
| johnsom | Your install logs should show what happened during the migration | 22:10 |
| mwynne | johnsom: where are the logs for the migration? | 22:11 |
| mwynne | I couldn't find them anywhere obvious | 22:11 |
| johnsom | In general the "upgrade head" should pick up where it left off, you may need to chain some config files together to get them all to run. | 22:11 |
| johnsom | Sadly that is up to puppet which I haven't used. | 22:11 |
| johnsom | They go to console | 22:12 |
| johnsom | Since you need to finish the neutron migrations, it might be best to ask in the openstack-neutron channel, they may be able to help you better with those | 22:12 |
| mwynne | johnsom: Exec[neutron-db-sync]: Command exceeded timeout | 22:13 |
| mwynne | Puppet didn't report that error at the end of the run though :( | 22:13 |
| mwynne | ugh | 22:13 |
| johnsom | Ugh, new one to me | 22:13 |
| johnsom | Ping folks in openstack-neutron, I bet they can help you get the right command line to have it pick up | 22:13 |
| mwynne | johnsom: Thanks for all your help :) | 22:15 |
| johnsom | Sure, good luck! | 22:16 |
| johnsom | If you don't get an answer come back and I can try to dig through some neutron code and find the command line | 22:16 |
| mwynne | johnsom: No worries. I'm going to try to just do a quick re-deploy with increased timeouts. | 22:31 |
| mwynne | I think my system is under heavy load, and taking longer than the timeout that I've set. | 22:32 |
| mwynne | johnsom: Out of curiosity, what do you use to deploy? | 22:32 |
| johnsom | Well, daily devstack, but for production installs OpenStack Ansible | 22:35 |
| johnsom | mwynne Here is the two commands I see neutron usually run: | 22:35 |
| johnsom | https://www.irccloud.com/pastebin/AYA5N42J/ | 22:35 |
| mwynne | Ah, ok, interesting. | 22:37 |
| johnsom | is/are ugh, one of those days, three conversations at once. grin | 22:38 |
| mwynne | :) | 22:40 |
| *** longstaff has quit IRC | 23:25 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!