| *** rcernin has joined #openstack-meeting | 00:05 | |
| *** ykatabam has joined #openstack-meeting | 00:11 | |
| *** gyee has quit IRC | 00:18 | |
| *** jamesmcarthur has joined #openstack-meeting | 00:20 | |
| *** dviroel has quit IRC | 00:20 | |
| *** yamamoto has quit IRC | 00:34 | |
| *** jamesmcarthur has quit IRC | 00:48 | |
| *** yamamoto has joined #openstack-meeting | 00:55 | |
| *** ekcs has quit IRC | 00:59 | |
| *** Liang__ has joined #openstack-meeting | 01:04 | |
| *** nanzha has joined #openstack-meeting | 01:14 | |
| *** macz has joined #openstack-meeting | 01:17 | |
| *** tetsuro has joined #openstack-meeting | 01:20 | |
| *** Liang__ has quit IRC | 01:40 | |
| *** ociuhandu has joined #openstack-meeting | 02:06 | |
| *** ociuhandu has quit IRC | 02:12 | |
| *** ykatabam has quit IRC | 02:31 | |
| *** macz has quit IRC | 02:32 | |
| *** macz has joined #openstack-meeting | 02:34 | |
| *** nanzha has quit IRC | 02:36 | |
| *** macz has quit IRC | 02:37 | |
| *** nanzha has joined #openstack-meeting | 02:38 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:42 | |
| *** markvoelker has quit IRC | 02:45 | |
| *** ricolin has joined #openstack-meeting | 03:16 | |
| *** jamesmcarthur has quit IRC | 03:16 | |
| *** yamamoto has quit IRC | 03:33 | |
| *** radeks_ has joined #openstack-meeting | 03:36 | |
| *** radeks_ has quit IRC | 03:41 | |
| *** radeks has joined #openstack-meeting | 03:42 | |
| *** rfolco|rover has quit IRC | 04:04 | |
| *** hyunsikyang__ has joined #openstack-meeting | 04:07 | |
| *** hyunsikyang has quit IRC | 04:10 | |
| *** macz has joined #openstack-meeting | 04:11 | |
| *** yamamoto has joined #openstack-meeting | 04:22 | |
| *** ociuhandu has joined #openstack-meeting | 04:31 | |
| *** ociuhandu has quit IRC | 04:35 | |
| *** markvoelker has joined #openstack-meeting | 04:46 | |
| *** markvoelker has quit IRC | 04:51 | |
| *** macz has quit IRC | 04:52 | |
| *** yamamoto has quit IRC | 05:05 | |
| *** yamamoto has joined #openstack-meeting | 05:08 | |
| *** ociuhandu has joined #openstack-meeting | 05:35 | |
| *** andyzon has joined #openstack-meeting | 05:35 | |
| *** ociuhandu has quit IRC | 05:39 | |
| *** ralonsoh has joined #openstack-meeting | 05:47 | |
| *** hyunsikyang has joined #openstack-meeting | 05:57 | |
| *** igordc has joined #openstack-meeting | 05:58 | |
| *** yamamoto has quit IRC | 06:01 | |
| *** hyunsikyang__ has quit IRC | 06:01 | |
| *** hyunsikyang__ has joined #openstack-meeting | 06:02 | |
| *** hyunsikyang has quit IRC | 06:02 | |
| *** igordc has quit IRC | 06:03 | |
| *** hyunsikyang has joined #openstack-meeting | 06:12 | |
| *** yamamoto has joined #openstack-meeting | 06:14 | |
| *** andyzon has quit IRC | 06:16 | |
| *** hyunsikyang__ has quit IRC | 06:16 | |
| *** yamamoto has quit IRC | 06:26 | |
| *** belmoreira has joined #openstack-meeting | 06:27 | |
| *** yamamoto has joined #openstack-meeting | 06:37 | |
| *** rcernin has quit IRC | 06:37 | |
| *** andyzon has joined #openstack-meeting | 06:43 | |
| *** links has joined #openstack-meeting | 06:44 | |
| *** markvoelker has joined #openstack-meeting | 06:48 | |
| *** andyzon has quit IRC | 06:48 | |
| *** andyzon_ has joined #openstack-meeting | 06:48 | |
| *** yamamoto has quit IRC | 06:49 | |
| *** andyzon has joined #openstack-meeting | 06:49 | |
| *** markvoelker has quit IRC | 06:53 | |
| *** andyzon_ has quit IRC | 06:53 | |
| *** yamamoto has joined #openstack-meeting | 06:55 | |
| *** trident has quit IRC | 06:55 | |
| *** slaweq has joined #openstack-meeting | 06:58 | |
| *** trident has joined #openstack-meeting | 07:00 | |
| *** nanzha has quit IRC | 07:04 | |
| *** nanzha has joined #openstack-meeting | 07:04 | |
| *** ttsiouts has joined #openstack-meeting | 07:09 | |
| *** rubasov has quit IRC | 07:21 | |
| *** yamamoto has quit IRC | 07:24 | |
| *** ttsiouts has quit IRC | 07:25 | |
| *** ttsiouts has joined #openstack-meeting | 07:26 | |
| *** ttsiouts has quit IRC | 07:30 | |
| *** rsimai_away is now known as rsimai | 07:35 | |
| *** yamamoto has joined #openstack-meeting | 07:36 | |
| *** nanzha has quit IRC | 07:41 | |
| *** brault has quit IRC | 07:44 | |
| *** nanzha has joined #openstack-meeting | 07:48 | |
| *** apetrich has quit IRC | 07:49 | |
| *** apetrich has joined #openstack-meeting | 07:51 | |
| *** ttsiouts has joined #openstack-meeting | 07:53 | |
| *** yamamoto has quit IRC | 07:55 | |
| *** kopecmartin|off is now known as kopecmartin | 07:56 | |
| *** yamamoto has joined #openstack-meeting | 07:57 | |
| *** e0ne has joined #openstack-meeting | 07:57 | |
| *** belmoreira has quit IRC | 07:58 | |
| *** ykatabam has joined #openstack-meeting | 07:59 | |
| *** rpittau|afk is now known as rpittau | 08:07 | |
| *** yamamoto has quit IRC | 08:17 | |
| *** yamamoto has joined #openstack-meeting | 08:20 | |
| *** e0ne has quit IRC | 08:22 | |
| *** yamamoto has quit IRC | 08:26 | |
| *** yamamoto has joined #openstack-meeting | 08:26 | |
| *** apetrich has quit IRC | 08:29 | |
| *** yamamoto has quit IRC | 08:32 | |
| *** yamamoto has joined #openstack-meeting | 08:33 | |
| *** yamamoto has quit IRC | 08:37 | |
| *** yamamoto has joined #openstack-meeting | 08:38 | |
| *** ttsiouts has quit IRC | 08:40 | |
| *** ttsiouts has joined #openstack-meeting | 08:41 | |
| *** ttsiouts has quit IRC | 08:41 | |
| *** ttsiouts_ has joined #openstack-meeting | 08:41 | |
| *** apetrich has joined #openstack-meeting | 08:48 | |
| *** markvoelker has joined #openstack-meeting | 08:49 | |
| *** ttsiouts_ has quit IRC | 08:52 | |
| *** ttsiouts has joined #openstack-meeting | 08:53 | |
| *** markvoelker has quit IRC | 08:53 | |
| *** ttsiouts has quit IRC | 08:53 | |
| *** ttsiouts has joined #openstack-meeting | 08:53 | |
| *** pcaruana has joined #openstack-meeting | 09:02 | |
| *** yamamoto has quit IRC | 09:14 | |
| *** yamamoto has joined #openstack-meeting | 09:14 | |
| *** e0ne has joined #openstack-meeting | 09:16 | |
| *** nanzha has quit IRC | 09:21 | |
| *** nanzha has joined #openstack-meeting | 09:21 | |
| *** rcernin has joined #openstack-meeting | 09:23 | |
| *** psachin has joined #openstack-meeting | 09:46 | |
| *** psachin has quit IRC | 09:52 | |
| *** nanzha has quit IRC | 09:56 | |
| *** nanzha has joined #openstack-meeting | 09:57 | |
| *** tssurya has joined #openstack-meeting | 10:03 | |
| *** yamamoto has quit IRC | 10:17 | |
| *** nanzha has quit IRC | 10:18 | |
| *** macz has joined #openstack-meeting | 10:19 | |
| *** macz has quit IRC | 10:24 | |
| *** nanzha has joined #openstack-meeting | 10:25 | |
| *** ttsiouts has quit IRC | 10:25 | |
| *** ttsiouts has joined #openstack-meeting | 10:26 | |
| *** ttsiouts has quit IRC | 10:30 | |
| *** jraju__ has joined #openstack-meeting | 10:40 | |
| *** pcaruana has quit IRC | 10:41 | |
| *** links has quit IRC | 10:41 | |
| *** yaawang_ has quit IRC | 10:51 | |
| *** yaawang_ has joined #openstack-meeting | 10:52 | |
| *** janders has joined #openstack-meeting | 10:53 | |
| *** belmoreira has joined #openstack-meeting | 10:54 | |
| *** ttsiouts has joined #openstack-meeting | 10:58 | |
| *** oneswig has joined #openstack-meeting | 11:12 | |
| oneswig | hello? | 11:12 |
|---|---|---|
| janders | g'day Stig | 11:16 |
| *** oneswig has quit IRC | 11:19 | |
| *** macz has joined #openstack-meeting | 11:23 | |
| *** macz has quit IRC | 11:27 | |
| *** dviroel has joined #openstack-meeting | 11:47 | |
| *** raildo has joined #openstack-meeting | 11:49 | |
| *** yaawang_ has quit IRC | 11:58 | |
| *** ttsiouts has quit IRC | 12:01 | |
| *** ttsiouts has joined #openstack-meeting | 12:02 | |
| *** markvoelker has joined #openstack-meeting | 12:05 | |
| *** yamamoto has joined #openstack-meeting | 12:05 | |
| *** ttsiouts has quit IRC | 12:06 | |
| *** yamamoto has quit IRC | 12:08 | |
| *** belmoreira has quit IRC | 12:09 | |
| *** links has joined #openstack-meeting | 12:12 | |
| *** jraju__ has quit IRC | 12:12 | |
| *** rfolco|rover has joined #openstack-meeting | 12:21 | |
| *** nanzha has quit IRC | 12:25 | |
| *** nanzha has joined #openstack-meeting | 12:27 | |
| *** enriquetaso has joined #openstack-meeting | 12:33 | |
| *** ttsiouts has joined #openstack-meeting | 12:45 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:47 | |
| *** yamamoto has joined #openstack-meeting | 12:48 | |
| *** takamatsu has joined #openstack-meeting | 12:48 | |
| *** belmoreira has joined #openstack-meeting | 12:51 | |
| *** vishalmanchanda has joined #openstack-meeting | 12:52 | |
| *** pcaruana has joined #openstack-meeting | 12:53 | |
| *** liuyulong_ has joined #openstack-meeting | 13:01 | |
| *** liuyulong has joined #openstack-meeting | 13:01 | |
| *** yamamoto has quit IRC | 13:02 | |
| *** janders has quit IRC | 13:04 | |
| *** jamesmcarthur has quit IRC | 13:11 | |
| *** radeks has quit IRC | 13:16 | |
| *** radeks has joined #openstack-meeting | 13:18 | |
| *** rcernin has quit IRC | 13:24 | |
| *** belmoreira has quit IRC | 13:25 | |
| *** whoami-rajat has quit IRC | 13:27 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:29 | |
| *** mriedem has joined #openstack-meeting | 13:30 | |
| *** jamesmcarthur has quit IRC | 13:31 | |
| *** eharney has quit IRC | 13:34 | |
| *** liuyulong has quit IRC | 13:40 | |
| *** liuyulong_ has quit IRC | 13:41 | |
| *** liuyulong has joined #openstack-meeting | 13:50 | |
| *** liuyulong_ has joined #openstack-meeting | 13:50 | |
| liuyulong_ | 1 | 13:58 |
| liuyulong | test | 13:58 |
| liuyulong_ | test | 13:58 |
| *** liuyulong_ has quit IRC | 13:58 | |
| *** liuyulong_ has joined #openstack-meeting | 13:59 | |
| liuyulong | #startmeeting neutron_l3 | 14:00 |
| openstack | Meeting started Wed Oct 23 14:00:12 2019 UTC and is due to finish in 60 minutes. The chair is liuyulong. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| *** openstack changes topic to " (Meeting topic: neutron_l3)" | 14:00 | |
| openstack | The meeting name has been set to 'neutron_l3' | 14:00 |
| liuyulong | #chair liuyulong_ | 14:00 |
| openstack | Current chairs: liuyulong liuyulong_ | 14:00 |
| liuyulong | #chair haleyb | 14:00 |
| openstack | Current chairs: haleyb liuyulong liuyulong_ | 14:00 |
| liuyulong | #chair slaweq | 14:00 |
| openstack | Current chairs: haleyb liuyulong liuyulong_ slaweq | 14:00 |
| haleyb | hi | 14:00 |
| liuyulong | hi | 14:00 |
| liuyulong | Just in case... | 14:00 |
| liuyulong | #topic Announcements | 14:01 |
| *** openstack changes topic to "Announcements (Meeting topic: neutron_l3)" | 14:01 | |
| liuyulong | I received the QR code of the Shanghai Summit ticket on Tuesday. | 14:02 |
| liuyulong | Maybe you guys may also have that now. | 14:02 |
| liuyulong | So only one important thing is see you guys in Shanghai. | 14:03 |
| liuyulong | And I'd like to cancel the L3 meeting next week, because we will have totally three day times to discuss things in the PTG meetings. | 14:04 |
| haleyb | +1 from me | 14:04 |
| *** jamesmcarthur has joined #openstack-meeting | 14:04 | |
| liuyulong | OK, that's all from me about the announcement. | 14:05 |
| liuyulong | OK, let's move on. | 14:06 |
| liuyulong | #topic Bugs | 14:07 |
| *** openstack changes topic to "Bugs (Meeting topic: neutron_l3)" | 14:07 | |
| liuyulong | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010249.html | 14:07 |
| liuyulong | Hongbin was our bug deputy last week, and thanks. | 14:07 |
| liuyulong | First one | 14:08 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1848187 | 14:08 |
| openstack | Launchpad bug 1848187 in neutron "DHCP agent timing out spawning dnsmasq" [Medium,In progress] - Assigned to Will Szumski (willjs) | 14:08 |
| * slaweq is just lurking here | 14:09 | |
| liuyulong | The patch is abandoned, https://review.opendev.org/#/c/688693/ | 14:09 |
| liuyulong | Seems the root cause is still unclear. | 14:10 |
| *** andyzon has quit IRC | 14:10 | |
| *** andyzon has joined #openstack-meeting | 14:11 | |
| *** andyzon has quit IRC | 14:11 | |
| *** belmoreira has joined #openstack-meeting | 14:11 | |
| *** andyzon has joined #openstack-meeting | 14:11 | |
| liuyulong | So let's wait to see if the bug reporter can supply more details as slaweq requested. | 14:12 |
| slaweq | IMO this bug can be closed now, it was the issue with ulimits in containers AFAIU | 14:13 |
| slaweq | I don't think we should do anything with that on Neutron's side | 14:13 |
| liuyulong | One interesting thing is that we disable the root-wrapper-deamon for DHCP-agent also, it will have a better performance during processing networks. | 14:16 |
| *** andyzon has quit IRC | 14:16 | |
| liuyulong | slaweq, so you have the right to disable it right now, :) | 14:16 |
| liuyulong | next | 14:16 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1848738 | 14:16 |
| openstack | Launchpad bug 1848738 in neutron "Sometimes dnsmasq may not be restarted after adding new subnet" [Medium,In progress] - Assigned to Slawek Kaplonski (slaweq) | 14:16 |
| liuyulong | https://review.opendev.org/#/c/689515/ | 14:16 |
| liuyulong | The fix is getting merged. | 14:17 |
| liuyulong | So thank you slaweq for the fix. | 14:17 |
| slaweq | liuyulong: about which fix You are now talking about? | 14:17 |
| liuyulong | slaweq, this one 1848738 | 14:18 |
| slaweq | ahh, it's still in the gate | 14:18 |
| slaweq | not merged yet | 14:18 |
| slaweq | and it is only partial fix | 14:18 |
| slaweq | I will still have to investigate why this happens sometimes that dnsmasq isn't restarted when it should be | 14:18 |
| *** markvoelker has quit IRC | 14:20 | |
| *** diablo_rojo has joined #openstack-meeting | 14:21 | |
| liuyulong | we met some DHCP agent issues locally in stable/queens. There will be one race condition between R/W of the DHCP agent resource cache. | 14:21 |
| *** priteau has joined #openstack-meeting | 14:21 | |
| liuyulong | And finally cause the port processint timeout, or the IP/mac info of the dnsmasq config failed to install. | 14:22 |
| liuyulong | s/processing | 14:23 |
| *** andyzon has joined #openstack-meeting | 14:23 | |
| liuyulong | I mean the DHCP related processing, aka config the dnsmasq for DHCP. | 14:23 |
| *** efried1 has joined #openstack-meeting | 14:24 | |
| *** efried has quit IRC | 14:24 | |
| *** efried1 is now known as efried | 14:24 | |
| liuyulong | use_helper_for_ns_read = False and root_helper_daemon= can also be used for DHCP agent. | 14:24 |
| liuyulong | OK, let's scan the LP bug list. | 14:25 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1849392 | 14:25 |
| openstack | Launchpad bug 1849392 in neutron "Neutron - Stein - Having two external networks will prevent the router from being created." [Undecided,New] | 14:25 |
| slaweq | that one is confusing me as I though we already fixed it some time ago | 14:26 |
| slaweq | so I plan to take a look into that ASAP | 14:26 |
| liuyulong | slaweq, cool | 14:26 |
| liuyulong | slaweq, master branch does not have such issue, right? | 14:27 |
| slaweq | liuyulong: I don't know | 14:27 |
| *** eharney has joined #openstack-meeting | 14:27 | |
| slaweq | if so, it would mean that we just missed some backport | 14:27 |
| slaweq | I will check that | 14:27 |
| liuyulong | slaweq, Exactly | 14:28 |
| liuyulong | Next | 14:30 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1847763 | 14:30 |
| openstack | Launchpad bug 1847763 in neutron "cannot reuse floating IP as port's fixed-ip" [Undecided,Incomplete] | 14:30 |
| liuyulong | This looks like not the Neutron bug. | 14:31 |
| liuyulong | The new port was using that floating IP address. | 14:31 |
| *** markvoelker has joined #openstack-meeting | 14:32 | |
| liuyulong | More like a guest DHCP client config issue, something like NetworkManager, Cloud-init or network-scripts. | 14:32 |
| *** yamamoto has joined #openstack-meeting | 14:33 | |
| liuyulong | One more strange thing we noticed locally is, the external network is have a empty DHCP schedule entry in the DB no matter the enable-dhcp is True or False. | 14:34 |
| liuyulong | And this bug is more like that, the DHCP is enabled for external network floating IP subnet. | 14:35 |
| haleyb | liuyulong: the DB entry for the network has dhcp blank? | 14:35 |
| *** yamamoto has quit IRC | 14:35 | |
| *** ykatabam has quit IRC | 14:35 | |
| liuyulong | haleyb, yes, in stable/queens we noticed that. | 14:36 |
| *** artom has quit IRC | 14:36 | |
| liuyulong | neutron dhcp-agent-list-hosting-net <external-network-id>, you will see an schedule instance. | 14:37 |
| *** artom has joined #openstack-meeting | 14:37 | |
| *** artom has quit IRC | 14:37 | |
| liuyulong | no matter enable dhcp or not. | 14:38 |
| liuyulong | I'd like to ask if we could add some config to disable such DHCP behavior for external network by default. | 14:39 |
| *** kopecmartin is now known as kopecmartin|off | 14:39 | |
| haleyb | i guess that should be Ok | 14:39 |
| *** martinkennelly has joined #openstack-meeting | 14:40 | |
| liuyulong | If someone wants to enable, or boot VM in external network, they should change that config to clearly know what they are doing. | 14:40 |
| liuyulong | OK, that's all bugs from me. | 14:41 |
| ralonsoh | I have one moew | 14:41 |
| liuyulong | Any additions? | 14:41 |
| ralonsoh | (one sec) | 14:42 |
| liuyulong | ralonsoh, sure, please go ahead. | 14:42 |
| ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/1849502 | 14:42 |
| openstack | Launchpad bug 1849502 in neutron "[DHCP] Check the dnsmasq process status after enabling the process" [Undecided,New] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 14:42 |
| ralonsoh | just a heads-up | 14:42 |
| ralonsoh | filled 10 mins ago | 14:42 |
| ralonsoh | but I think I have the solution | 14:42 |
| ralonsoh | I'll push the patch today | 14:42 |
| ralonsoh | that's all | 14:42 |
| * liuyulong reading... | 14:42 | |
| ralonsoh | long story short: dnsmasq started with 1 subnet | 14:43 |
| ralonsoh | network updated with 2 more subnets | 14:43 |
| ralonsoh | the dhcp agent do not find the process (when stopping it) and then, when starting it, the process is active (so the agent do not start ir again) | 14:44 |
| *** Garyx_ has quit IRC | 14:44 | |
| *** Garyx_ has joined #openstack-meeting | 14:44 | |
| liuyulong | looks a bit like the race condition I just mentioned in the meeting. ^^^ | 14:45 |
| liuyulong | data inconsistence between agent and neutron DB. : ) | 14:45 |
| ralonsoh | kind of | 14:46 |
| haleyb | ralonsoh: is this related to the other bug slaweq was fixing with tags too? | 14:46 |
| ralonsoh | the DB is ok in this case | 14:46 |
| ralonsoh | haleyb, not exactly | 14:46 |
| ralonsoh | IMO, the tags patch is not needed | 14:46 |
| ralonsoh | but I left a comment on it | 14:46 |
| ralonsoh | maybe i'm missing something in this patch | 14:46 |
| *** slaweq has quit IRC | 14:47 | |
| liuyulong | "Sometimes dnsmasq may not be restarted after adding new subnet" this is the bug title reported by slaweq. | 14:48 |
| liuyulong | bug 1848738 | 14:48 |
| openstack | bug 1848738 in neutron "Sometimes dnsmasq may not be restarted after adding new subnet" [Medium,In progress] https://launchpad.net/bugs/1848738 - Assigned to Slawek Kaplonski (slaweq) | 14:48 |
| ralonsoh | yes | 14:48 |
| haleyb | the tags patch makes things a little simpler, with the subnet-id in the tag | 14:48 |
| ralonsoh | I know, but I don't think the patch solves this problem | 14:48 |
| ralonsoh | at least the one described in my bug | 14:48 |
| ralonsoh | the problem I found is not related with the tags | 14:49 |
| ralonsoh | but with detecting or not the status of the dnsmasq process (running or not) | 14:49 |
| haleyb | ack | 14:49 |
| liuyulong | OK, so you have any reproduce steps? | 14:50 |
| ralonsoh | kind of | 14:50 |
| ralonsoh | we have an automated deployment system, using tripleo | 14:51 |
| liuyulong | I could not open the site pastebin.test.redhat.com | 14:51 |
| liuyulong | May you use the paste.openstack.org? | 14:51 |
| ralonsoh | When using several subnets (and segments), this bug occurs | 14:51 |
| ralonsoh | sure, I'll change the links | 14:51 |
| *** dklyle has quit IRC | 14:52 | |
| *** mattw4 has joined #openstack-meeting | 14:53 | |
| liuyulong | ralonsoh, we are running out of time, so please add some reproduce step in the bug or pastebin, we can test it locally. | 14:54 |
| liuyulong | Next topic | 14:54 |
| liuyulong | #topic On demand agenda | 14:54 |
| *** openstack changes topic to "On demand agenda (Meeting topic: neutron_l3)" | 14:54 | |
| *** andyzon has quit IRC | 14:54 | |
| liuyulong | I'd like to update some IPv6 test status. | 14:54 |
| liuyulong | One thing is that we will not use SLAAC for ipv6 subnets. | 14:55 |
| liuyulong | Because for multiple ipv6 subnets in one network | 14:55 |
| liuyulong | The created port will have all IPv6 subnets address automatically by default. | 14:56 |
| *** dklyle has joined #openstack-meeting | 14:56 | |
| liuyulong | We can change the neutron DB code to let it have one IP only, but the router RA advise will send out randomly. | 14:57 |
| liuyulong | So the IPv6 prefix may be wrong with the port real IPv6 address. | 14:57 |
| haleyb | liuyulong: the RA should have both prefixes, correct? | 14:57 |
| *** pcaruana has quit IRC | 14:57 | |
| liuyulong | Inside the VM | 14:58 |
| *** nanzha has quit IRC | 14:58 | |
| liuyulong | haleyb, yes, it will | 14:58 |
| *** mattw4 has quit IRC | 14:59 | |
| haleyb | i guess i don't understand the issue yet | 14:59 |
| haleyb | but we are out of time | 15:00 |
| *** lseki has joined #openstack-meeting | 15:00 | |
| liuyulong | OK, I will create a bug for detail. | 15:00 |
| liuyulong | #endmeeting | 15:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:00 | |
| openstack | Meeting ended Wed Oct 23 15:00:26 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-10-23-14.00.html | 15:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-10-23-14.00.txt | 15:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-10-23-14.00.log.html | 15:00 |
| *** nanzha has joined #openstack-meeting | 15:00 | |
| ralonsoh | bye | 15:00 |
| *** links has quit IRC | 15:06 | |
| *** yamamoto has joined #openstack-meeting | 15:07 | |
| *** ttsiouts has quit IRC | 15:09 | |
| *** ttsiouts has joined #openstack-meeting | 15:09 | |
| *** tssurya has quit IRC | 15:10 | |
| *** yamamoto has quit IRC | 15:11 | |
| *** ttsiouts has quit IRC | 15:14 | |
| *** liuyulong has quit IRC | 15:19 | |
| *** liuyulong_ has quit IRC | 15:20 | |
| *** rosmaita has joined #openstack-meeting | 15:20 | |
| *** belmoreira has quit IRC | 15:24 | |
| *** macz has joined #openstack-meeting | 15:26 | |
| *** gyee has joined #openstack-meeting | 15:26 | |
| *** macz has quit IRC | 15:27 | |
| *** macz has joined #openstack-meeting | 15:27 | |
| *** andyzon has joined #openstack-meeting | 15:30 | |
| *** tosky has joined #openstack-meeting | 15:33 | |
| *** rsimai is now known as rsimai_away | 15:36 | |
| *** e0ne has quit IRC | 15:44 | |
| *** woojay has joined #openstack-meeting | 15:50 | |
| *** igordc has joined #openstack-meeting | 15:51 | |
| *** yamamoto has joined #openstack-meeting | 15:52 | |
| *** raghavendrat has joined #openstack-meeting | 15:56 | |
| rosmaita | jungleboyj whoami-rajat rajinir lseki carloss pots woojay erlon geguileo eharney rosmaita enriquetaso e0ne smcginnis davidsha walshh_ xyang hemna _hemna tosky sfernand | 15:59 |
| geguileo | hi! o/ | 16:00 |
| rosmaita | #startmeeting cinder | 16:00 |
| openstack | Meeting started Wed Oct 23 16:00:03 2019 UTC and is due to finish in 60 minutes. The chair is rosmaita. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: cinder)" | 16:00 | |
| openstack | The meeting name has been set to 'cinder' | 16:00 |
| rosmaita | #topic roll call | 16:00 |
| *** openstack changes topic to "roll call (Meeting topic: cinder)" | 16:00 | |
| smcginnis | o/ | 16:00 |
| davee__ | o/ | 16:00 |
| woojay | o/ | 16:00 |
| *** thgcorrea has joined #openstack-meeting | 16:00 | |
| eharney | hey | 16:00 |
| geguileo | rosmaita: hi there :-) | 16:00 |
| *** sfernand has joined #openstack-meeting | 16:00 | |
| rosmaita | hello! | 16:00 |
| enriquetaso | o/ | 16:00 |
| jungleboyj | @! | 16:00 |
| _pewp_ | jungleboyj (◍˃̶ᗜ˂̶◍)ﾉ” | 16:00 |
| sfernand | Hi | 16:00 |
| *** anastzhyr has joined #openstack-meeting | 16:01 | |
| rosmaita | looks like a good turnout! | 16:01 |
| tosky | o/ | 16:01 |
| eharney | https://wiki.openstack.org/wiki/CinderMeetings needs an update (this is still how i find the etherpad half the time) | 16:01 |
| rosmaita | #link https://etherpad.openstack.org/p/cinder-ussuri-meetings | 16:01 |
| *** yamamoto has quit IRC | 16:01 | |
| *** mattw4 has joined #openstack-meeting | 16:01 | |
| lseki | hi | 16:01 |
| rosmaita | i thought i had updated that | 16:01 |
| *** davidsha has joined #openstack-meeting | 16:02 | |
| rosmaita | well, speaking of updates | 16:02 |
| rosmaita | #topic updates | 16:02 |
| *** openstack changes topic to "updates (Meeting topic: cinder)" | 16:02 | |
| eharney | er.. Ussuri is there. maybe i found a very old browser tab... | 16:02 |
| smcginnis | :) | 16:02 |
| rosmaita | just a few announcements | 16:02 |
| rosmaita | the final releases from stable/queens happen sometime between now and tomorrow | 16:03 |
| rosmaita | and then stable/queens goes into 'extended maintenance' status, which means no more releases, but we can backport fixes | 16:03 |
| jungleboyj | Sounds good. | 16:03 |
| *** macz has quit IRC | 16:04 | |
| rosmaita | the idea is that some distros/packagers may want to do releases including new bugfixes, even if we (opensatck) aren't committed to doing it | 16:04 |
| rosmaita | also, we had talked about doing monthly releases from the stable branches | 16:04 |
| rosmaita | over the past half year, it's looking like every 2 months is fine | 16:04 |
| rosmaita | (and we can always do a release at any time if there's a critical/security bugfix) | 16:05 |
| smcginnis | extended maintenance ends up being pretty close to our driverfixes branches. | 16:05 |
| smcginnis | Sounds good to me on the stable release cadence. | 16:05 |
| rosmaita | yes, and on that note, here's a picture of what we've got open branch-wise: https://launchpad.net/cinder/+series | 16:06 |
| rosmaita | i don't have anything to say, other than it's a lot of open branches! | 16:06 |
| rosmaita | ok, two final things | 16:06 |
| eharney | mitaka is still "Supported" :) | 16:06 |
| rosmaita | yes, i wonder if we should think about unsupporting some of those | 16:07 |
| jungleboyj | Is anything before Mitaka actually still hopen? | 16:07 |
| rosmaita | no, i think that's the earliest open branch | 16:07 |
| jungleboyj | Ok. Maybe we should update that then. | 16:07 |
| smcginnis | I think because that's where we started the driverfixes thing. | 16:07 |
| eharney | smcginnis: right | 16:08 |
| smcginnis | I think it's been long enough. I'd like to get rid of M and N at least. | 16:08 |
| jungleboyj | smcginnis: ++ | 16:08 |
| smcginnis | I think we could even decide to EOL ocata and maybe pike. | 16:08 |
| eharney | M, sure. N... i dunno | 16:08 |
| rosmaita | that's what i was going to ask, what do we need to do to EOL a branch? | 16:08 |
| smcginnis | Realistically, I don't think we will be paying much attention past queens. | 16:09 |
| smcginnis | rosmaita: We would need to make sure all open reviews are closed. Then propose a $series-eol tag to the branch. | 16:09 |
| rosmaita | i wonder if we should convert to driverfixes only for n and o ? | 16:10 |
| smcginnis | I think we may need to also ask infra to delete the stable/$series branch too, just to make it clear. | 16:10 |
| *** andyzon has quit IRC | 16:10 | |
| *** raghavendrat has left #openstack-meeting | 16:10 | |
| eharney | N is already eol, so i think it is already driverfixes only | 16:11 |
| smcginnis | I think we're better staying at -em than adding a driverfixes branch. It's more "understood" now. | 16:11 |
| jungleboyj | smcginnis: ++ | 16:11 |
| rosmaita | eharney: you are right about N | 16:12 |
| smcginnis | Well, N isn't tagged eol and the status is still set as Supported in Launchpad. | 16:12 |
| eharney | there's a newton-eol tag in git.. | 16:12 |
| smcginnis | Ah, ok. | 16:12 |
| rosmaita | well, the supported status is just me, i left that so we could target bugs to the driverfixes branch | 16:13 |
| eharney | makes sense | 16:13 |
| rosmaita | so with o & p, we could eol or we could have a stable-maint driverfixes only policy for those branches | 16:14 |
| rosmaita | the drivers don't seem to change so much (not as much as cinder itself), so backports wouldn't be too bad for serious bugs | 16:15 |
| smcginnis | The tricky part with these is keeping tests going. | 16:15 |
| smcginnis | I think Mitaka and Newton might actually be effectively broken at this point. | 16:16 |
| rosmaita | that';s true | 16:16 |
| tosky | at least ocata would be good (it's harder to maintain, as it was caught in the early extended maintenance process and some zuul v3 jobs-related improvements can't be applied there) | 16:16 |
| eharney | we're still actively supporting OSP10 so we have an interest in Newton fixes... i'm not sure if anyone is going to consume fixes for ocata & pike or not | 16:16 |
| tosky | it would be good to switch it to unmaintained, I mean | 16:16 |
| smcginnis | Actually... | 16:16 |
| eharney | er s/OSP10/Newton/ | 16:16 |
| smcginnis | I think with driverfixes we said just pep8 and py27. That just requires tox based jobs, so I think we can drop any legacy jobs there. | 16:17 |
| smcginnis | Probably any extended maintenance branches if we really need to. | 16:17 |
| jungleboyj | Makes sense. | 16:17 |
| rosmaita | ok, that's good to keep in mind | 16:18 |
| smcginnis | But good to keep broader testing around for the newer branches if/when we can. | 16:18 |
| *** nanzha has quit IRC | 16:18 | |
| rosmaita | so would it look weird if we kept driverfixes/newton but eol'd o and p? | 16:18 |
| smcginnis | Yeah | 16:19 |
| rosmaita | that's what i thought | 16:19 |
| jungleboyj | Yeah, because we shouldn't be backporting to Newton without hitting O and P. Right? | 16:20 |
| smcginnis | Yeah. Even for just driver fixes. | 16:20 |
| eharney | that's questionable if we decide O&P don't exist anymore | 16:20 |
| smcginnis | If we do that, then N goes too. | 16:20 |
| tosky | what about moving o (and maybe p) to driverfix for now, and think more about it? | 16:21 |
| rosmaita | well, we'd be hitting all open branches if we skip o & p and backport to N | 16:21 |
| smcginnis | We can't drop newer ones and keep older ones. | 16:21 |
| smcginnis | Either we keep through to the older one we want, or we cut them off. | 16:21 |
| rosmaita | ok, but we could adopt the "driverfixes only" policy for them | 16:22 |
| smcginnis | Yes | 16:23 |
| rosmaita | i think what i'd like to do is circulate something on the ML [cinder][ops] and see what people are using | 16:23 |
| rosmaita | and we can make a decision at the ptg | 16:23 |
| rosmaita | basically, what tosky said | 16:24 |
| smcginnis | ++ | 16:24 |
| rosmaita | good segue to the next announcement | 16:24 |
| rosmaita | #link https://etherpad.openstack.org/p/cinder-ussuri-ptg-planning | 16:25 |
| enriquetaso | ++ | 16:25 |
| rosmaita | i'll add possible eol to the etherpad | 16:25 |
| rosmaita | but if anyone has a topic they'd like to see addressed, please add it! | 16:25 |
| rosmaita | and it looks like i skipped something | 16:26 |
| rosmaita | i just wanted to mention the U community goals proposals, in case anyone has a strong feeling | 16:26 |
| rosmaita | #link https://etherpad.openstack.org/p/PVG-u-series-goals | 16:26 |
| smcginnis | There are mailing list threads looking for goal champions for some of these. If anyone really wants to work on any of that. | 16:27 |
| rosmaita | i think that's all, except a reminder about adding yourself to the courtesy ping list at the top of the agenda if you want a ping at meeting time | 16:27 |
| jungleboyj | rosmaita: ++ The new ping list is rather small right now. | 16:27 |
| rosmaita | yeah, tbh, i was mentioning it mainly in case anyone saw a community goal that would be a real PITA for cinder! | 16:27 |
| *** andyzon has joined #openstack-meeting | 16:28 | |
| rosmaita | #topic leftover file locks | 16:28 |
| *** openstack changes topic to "leftover file locks (Meeting topic: cinder)" | 16:28 | |
| rosmaita | geguileo: this is you | 16:28 |
| geguileo | rosmaita: thanks | 16:28 |
| geguileo | mostly I just wanted to confirm that everyone was onboard with the proposed solution in the ML | 16:29 |
| geguileo | this is about how cinder ends up leaving a lot of lock files | 16:29 |
| geguileo | even when they are no longer necessary | 16:29 |
| smcginnis | Sounded like you had most scenarios covered that we could cover. | 16:29 |
| eharney | that solution being, having cinder code selectively remove the more commonly leaked files? or cleaning it on node startup? | 16:30 |
| geguileo | both | 16:30 |
| geguileo | well, Cinder wouldn't clean them up on start | 16:30 |
| geguileo | but like you say it would be on node startup | 16:30 |
| jungleboyj | The safest thing to do is cleanup on startup. Right? | 16:30 |
| geguileo | and that would be the responsibility of the deployment tool | 16:30 |
| geguileo | jungleboyj: yeah, but not Cinder (in case we are sharing the location) | 16:30 |
| jungleboyj | geguileo: ++ | 16:30 |
| geguileo | so the idea is that the installer creates a service unit that cleans up the directory | 16:31 |
| geguileo | and makes all openstack services depend on that one | 16:31 |
| geguileo | that way there are no races between removal and services using them | 16:31 |
| tosky | uhm, would it work if you restart just one service? | 16:31 |
| geguileo | and in cinder we do our best to do the clean | 16:31 |
| geguileo | tosky: no, because systemd would not retrigger the other unit | 16:32 |
| geguileo | for example, the cinder-volume service would depend on the remove-locks unit having run before | 16:32 |
| geguileo | and since it run at the start of the node | 16:32 |
| geguileo | there is no problem and won't be retriggered | 16:32 |
| *** andyzon has quit IRC | 16:32 | |
| geguileo | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010129.html | 16:33 |
| geguileo | ^ that's the ML thread | 16:33 |
| *** markvoelker has quit IRC | 16:33 | |
| geguileo | and this is a wip patch for the Cinder side of things | 16:33 |
| geguileo | #link https://review.opendev.org/#/c/689486/ | 16:33 |
| geguileo | the cinder side basically uses oslo's lock removal feature to remove them when deleting volumes or snapshots | 16:33 |
| geguileo | and if the create volume from source fails as well | 16:34 |
| rosmaita | so this is a dumb question, but why don't we stop using file locks and use etcd-backed-tooz all the time, not just for active-active? | 16:34 |
| geguileo | that's slower | 16:35 |
| *** martinkennelly has quit IRC | 16:35 | |
| eharney | just the cinder patch will cover most of these files, right, even without the other cleanup? | 16:35 |
| geguileo | and etcd is not a requirement to run cinder | 16:35 |
| rosmaita | ok | 16:35 |
| geguileo | eharney: yes, it should, but not for existing files | 16:35 |
| *** tobiash has quit IRC | 16:35 | |
| eharney | that's not so bad since the main issue these cause is admins saying "why are all these files in here?" | 16:35 |
| geguileo | so the cleanup on node start is kind of a failsafe | 16:35 |
| geguileo | lol | 16:35 |
| geguileo | in case we missed something it would be good to have the cleanup on start as well | 16:36 |
| eharney | yeah | 16:36 |
| geguileo | but I think this patch would be a reasonable compromise | 16:36 |
| geguileo | it may not fix everything, but at least is better than nothing XD | 16:37 |
| jungleboyj | It would at least slow the future growth in the number of files. | 16:37 |
| geguileo | yup | 16:37 |
| rosmaita | well, it's definitely better than fixing too much (and breaking something) | 16:37 |
| jungleboyj | So, I agree that it is better than nothing. | 16:37 |
| geguileo | I wanted to confirm that we all agreed on this solution | 16:37 |
| geguileo | ok | 16:37 |
| *** tobiash has joined #openstack-meeting | 16:37 | |
| eharney | it sounds good to me | 16:37 |
| geguileo | then I'll write the unit tests and all that stuff | 16:37 |
| smcginnis | Thanks geguileo | 16:38 |
| rosmaita | it sounds good to me | 16:38 |
| jungleboyj | geguileo: Sounds good. Thank you! | 16:38 |
| geguileo | great, then that's all I had to say :-) | 16:38 |
| geguileo | smcginnis: jungleboyj np | 16:38 |
| rosmaita | thanks, geguileo | 16:38 |
| geguileo | np | 16:38 |
| rosmaita | #topic request to change weekly meeting time | 16:39 |
| *** openstack changes topic to "request to change weekly meeting time (Meeting topic: cinder)" | 16:39 | |
| enriquetaso | :o | 16:39 |
| rosmaita | i pulled this from the PTG etherpad, since i think it needs discussion beyond people who will be in shanghai | 16:39 |
| jungleboyj | *sad_trombone.wav* | 16:39 |
| rosmaita | the request is to move the meeting 1 to 2 hours earlier | 16:39 |
| smcginnis | That would make it worse for west coast folks. | 16:40 |
| smcginnis | But I'd be curious to see if we would actually get more participation from APAC. | 16:40 |
| rosmaita | right | 16:40 |
| rosmaita | we don't need to decide this now | 16:40 |
| *** ekcs has joined #openstack-meeting | 16:40 | |
| rosmaita | but i wanted people to give it some thought | 16:40 |
| jungleboyj | Who was it that requested this? | 16:40 |
| rosmaita | and also about how we would best decide | 16:41 |
| rosmaita | Liang Fang | 16:41 |
| jungleboyj | Ok. Well, I am open to it if there is enough additional participation. | 16:41 |
| geguileo | for Europe I think it would be probably better | 16:41 |
| *** jamesmcarthur has quit IRC | 16:41 | |
| rosmaita | other than hemna part-time, do we have any west coast US people these days? | 16:42 |
| smcginnis | I know other teams have done alternating times, but I'm honestly not a big fan of that. | 16:42 |
| eharney | abishop | 16:42 |
| jungleboyj | woojay: | 16:42 |
| rosmaita | apologies to abishop, if forgot he moved | 16:42 |
| jungleboyj | smcginnis: Yeah, that ends up being a mess. I hate to say it. | 16:42 |
| woojay | yes | 16:42 |
| jungleboyj | oh, I didn't know abishop was west coast now. | 16:42 |
| enriquetaso | for Latin America it would be better too. | 16:43 |
| woojay | I'm ok w/ earlier though. | 16:43 |
| smcginnis | rosmaita: Have you checked if the channel is open earlier? | 16:43 |
| rosmaita | yeah, we tried the alternating times with Glance a few years ago, and what happened was that everyone always had the week wrong | 16:43 |
| *** markvoelker has joined #openstack-meeting | 16:43 | |
| jungleboyj | rosmaita: ++ | 16:43 |
| rosmaita | smcginnis: i wasn't worried about that, figured we could use the cinder channel if we have to | 16:43 |
| jungleboyj | Or things had to be repeated twice. That was the way it was for Swift. | 16:43 |
| rosmaita | woojay: how much earlier could you comfortably go? | 16:44 |
| rosmaita | namely, 1 or 2 hours | 16:44 |
| jungleboyj | I am more likely to have clashes because that is when China schedules meeting wtih me. :-) But since I am not running things that is less concerning. | 16:45 |
| rosmaita | i am guessing 1 because once daylight savings time is over, it will be 2 hours | 16:45 |
| *** davidsha has quit IRC | 16:45 | |
| *** jamesmcarthur has joined #openstack-meeting | 16:45 | |
| woojay | 2 hours no problem. | 16:45 |
| jungleboyj | woojay: Is an early riser? | 16:45 |
| smcginnis | Reminder for everyone that the time shifts in two weeks if you are in the US. | 16:46 |
| woojay | my boys get up early... 8-) | 16:46 |
| rosmaita | and in 1 week for most of europe | 16:46 |
| smcginnis | And not in one of those enlightened sections that actually doesn't observe DST. :) | 16:46 |
| *** andyzon has joined #openstack-meeting | 16:46 | |
| tosky | and next week if you are in Europe | 16:46 |
| smcginnis | Sunday it would appear. | 16:47 |
| rosmaita | ok, well i just wanted to float that ... sounds like at least for the people here today, it's possible | 16:47 |
| rosmaita | should i send out an email for comments? | 16:48 |
| jungleboyj | Yeah. Could make it work. Do it on a trial basis maybe. | 16:48 |
| davee__ | +1 | 16:48 |
| geguileo | rosmaita: an email for comments would be good | 16:48 |
| rosmaita | ok, i'll put out an email and figure that anyone violently opposed will respond | 16:48 |
| jungleboyj | Ok. Sounds good. | 16:49 |
| rosmaita | #action rosmaita email about possibly changing weekly meeting time | 16:49 |
| rosmaita | #action rosmaita email about possible EOL of some branches | 16:49 |
| rosmaita | (before i forget) | 16:49 |
| rosmaita | #topic open discussion | 16:49 |
| *** openstack changes topic to "open discussion (Meeting topic: cinder)" | 16:49 | |
| abishop | rosmaita, et al: yeah I'm on US west coast, but work east coast hours so I'm OK if mtg moves | 16:50 |
| rosmaita | abishop: ty, good to know | 16:50 |
| *** igordc has quit IRC | 16:50 | |
| jungleboyj | Cool. | 16:50 |
| jungleboyj | Oh, do you want to mention the Cinder Dinner? | 16:50 |
| *** rpittau is now known as rpittau|afk | 16:50 | |
| rosmaita | sure | 16:50 |
| rosmaita | what day were we thinking? | 16:50 |
| jungleboyj | Thursday I think? | 16:51 |
| jungleboyj | There is talk of an RDO event Wednesday night now. | 16:51 |
| rosmaita | ok, we are going to plan to have a cinder team dinner in Shanghai | 16:51 |
| smcginnis | Wouldn't it break tradition if we didn't schedule our team dinner at the same time as a Red Hat company party? | 16:51 |
| rosmaita | :) | 16:51 |
| jungleboyj | smcginnis: ++ | 16:52 |
| geguileo | lol | 16:52 |
| rosmaita | we are still working on time/location, but expect around dinnertime and in Shanghai | 16:52 |
| * jungleboyj laughs | 16:52 | |
| davee__ | I will get Chinese Takeout and wish I was there | 16:52 |
| smcginnis | Hah | 16:52 |
| jungleboyj | davee__: He he | 16:52 |
| rosmaita | davee__: ++ | 16:52 |
| jungleboyj | I forgot to e-mail my co-workers yesterday for ideas. | 16:53 |
| jungleboyj | I will do that now. | 16:53 |
| smcginnis | Maybe in exchange for moving the meeting earlier, Liang Fang could make a dinner reservation for us. :D | 16:53 |
| rosmaita | ok, we will keep the PTG etherpad updated | 16:53 |
| jungleboyj | :-) | 16:53 |
| rosmaita | smcginnis: that is not a bad idea | 16:53 |
| jungleboyj | smcginnis: No Quid Pro Quo ! | 16:53 |
| davee__ | lol | 16:53 |
| smcginnis | Haha, was just going to say something like that jungleboyj ;) | 16:53 |
| *** andyzon has quit IRC | 16:54 | |
| rosmaita | what good is a quid if you don't have a quo? | 16:54 |
| jungleboyj | https://gph.is/g/ZyPyOXb | 16:54 |
| rosmaita | also, you don't have to be at the PTG to attend, just need to be constructively interested in Cinder and in Shanghai | 16:54 |
| jungleboyj | rosmaita: ++ | 16:54 |
| rosmaita | jungleboyj: i am not going to look, your gphs are always a time sink | 16:55 |
| geguileo | rosmaita: ++ | 16:55 |
| jungleboyj | Bwah ha ha! | 16:55 |
| rosmaita | anything else on anyone's mind? | 16:55 |
| davee__ | that jungleboyj staged that for the giphy! | 16:56 |
| jungleboyj | rosmaita: You are planning that I will do the project onboarding again? | 16:56 |
| rosmaita | jungleboyj: yes, i was, though i may be confusing that with the upstream institute | 16:57 |
| rosmaita | are we supposed to schedule project onboarding as part of PTG time? | 16:57 |
| jungleboyj | It is the Cinder specific part of the Upstream Institute. | 16:57 |
| jungleboyj | rosmaita: Yes, so I was going to plan to do that early on Thursday as I will be in TC meetings on Friday. | 16:57 |
| rosmaita | yes, then i am definitely counting on you, i don't arrive until late monday | 16:57 |
| jungleboyj | rosmaita: But it does happen as part of the PTG. | 16:58 |
| rosmaita | let's talk about this real quick in the cinder channel after the meeting | 16:58 |
| jungleboyj | rosmaita: ++ | 16:58 |
| rosmaita | final minute ... any last concerns? | 16:59 |
| rosmaita | ok, thanks everyone! see you next week | 16:59 |
| geguileo | thanks everyone! | 16:59 |
| tosky | o/ | 16:59 |
| jungleboyj | Thanks! Talk to you all later. | 17:00 |
| smcginnis | Thanks! | 17:00 |
| rosmaita | i lost my etherpad tab and forgot the end meeting thing | 17:00 |
| rosmaita | #endmeeting | 17:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 17:00 | |
| openstack | Meeting ended Wed Oct 23 17:00:17 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-10-23-16.00.html | 17:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-10-23-16.00.txt | 17:00 |
| rosmaita | ah! | 17:00 |
| *** woojay has left #openstack-meeting | 17:00 | |
| openstack | Log: http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-10-23-16.00.log.html | 17:00 |
| *** tosky has left #openstack-meeting | 17:00 | |
| *** enriquetaso has quit IRC | 17:09 | |
| *** artom has joined #openstack-meeting | 17:29 | |
| *** enriquetaso has joined #openstack-meeting | 17:45 | |
| *** jamesmcarthur has quit IRC | 17:45 | |
| *** jamesmcarthur has joined #openstack-meeting | 17:46 | |
| *** jamesmcarthur has quit IRC | 17:51 | |
| *** whoami-rajat has joined #openstack-meeting | 17:52 | |
| *** ricolin has quit IRC | 17:55 | |
| *** vishalmanchanda has quit IRC | 17:59 | |
| *** ricolin has joined #openstack-meeting | 18:03 | |
| *** benj_ has joined #openstack-meeting | 18:10 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:21 | |
| *** igordc has joined #openstack-meeting | 18:24 | |
| *** ricolin has quit IRC | 18:25 | |
| *** anastzhyr has quit IRC | 18:30 | |
| *** jamesmcarthur has quit IRC | 18:31 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:32 | |
| *** igordc has quit IRC | 18:32 | |
| *** pcaruana has joined #openstack-meeting | 18:38 | |
| *** rosmaita has left #openstack-meeting | 18:39 | |
| *** jamesmcarthur has quit IRC | 18:39 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:39 | |
| *** pcaruana has quit IRC | 18:44 | |
| *** efried has quit IRC | 18:45 | |
| *** ralonsoh has quit IRC | 18:45 | |
| *** efried has joined #openstack-meeting | 18:48 | |
| *** thgcorrea has quit IRC | 19:10 | |
| *** jamesmcarthur has quit IRC | 19:17 | |
| *** jamesmcarthur has joined #openstack-meeting | 19:18 | |
| *** slaweq_ has joined #openstack-meeting | 19:18 | |
| *** sfernand has quit IRC | 19:20 | |
| *** jamesmcarthur has quit IRC | 19:22 | |
| *** ekcs has quit IRC | 19:24 | |
| *** ekcs has joined #openstack-meeting | 19:25 | |
| *** eharney has quit IRC | 19:27 | |
| *** slaweq_ is now known as slaweq | 19:28 | |
| *** ociuhandu has joined #openstack-meeting | 19:30 | |
| *** ociuhandu has quit IRC | 19:35 | |
| *** radeks has quit IRC | 19:35 | |
| *** eharney has joined #openstack-meeting | 19:40 | |
| *** priteau has quit IRC | 19:40 | |
| *** gouthamr has quit IRC | 19:43 | |
| *** enriquetaso has quit IRC | 19:45 | |
| *** ociuhandu has joined #openstack-meeting | 19:45 | |
| *** gouthamr has joined #openstack-meeting | 19:46 | |
| *** igordc has joined #openstack-meeting | 19:47 | |
| *** artom has quit IRC | 19:48 | |
| *** jamesmcarthur has joined #openstack-meeting | 19:48 | |
| *** ociuhandu has quit IRC | 19:50 | |
| *** anastzhyr has joined #openstack-meeting | 19:53 | |
| *** gouthamr_ has joined #openstack-meeting | 19:54 | |
| *** markvoelker has quit IRC | 20:07 | |
| *** e0ne has joined #openstack-meeting | 20:12 | |
| *** jamesmcarthur has quit IRC | 20:20 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:21 | |
| *** gouthamr has quit IRC | 20:23 | |
| *** jamesmcarthur has quit IRC | 20:24 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:26 | |
| *** bbowen_ has quit IRC | 20:30 | |
| *** bbowen_ has joined #openstack-meeting | 20:30 | |
| *** jamesmcarthur has quit IRC | 20:35 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:36 | |
| *** e0ne has quit IRC | 20:43 | |
| *** markvoelker has joined #openstack-meeting | 20:44 | |
| *** e0ne has joined #openstack-meeting | 20:45 | |
| *** slaweq has quit IRC | 20:51 | |
| *** jamesmcarthur has quit IRC | 20:52 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:53 | |
| *** eharney has quit IRC | 20:54 | |
| timburke | #startmeeting swift | 21:00 |
| openstack | Meeting started Wed Oct 23 21:00:05 2019 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: swift)" | 21:00 | |
| openstack | The meeting name has been set to 'swift' | 21:00 |
| timburke | who's here for the swift meeting? | 21:00 |
| kota_ | hello~ | 21:00 |
| mattoliverau | o/ | 21:00 |
| rledisez | o/ | 21:01 |
| timburke | i know tdasilva won't be able ot make it | 21:01 |
| rledisez | alecuyer won't be present neither | 21:02 |
| timburke | and i'm guessing clayg won't either | 21:02 |
| timburke | so let's begin! | 21:02 |
| timburke | i can make it quick so mattoliverau and kota_ can get on with breakfast ;-) | 21:02 |
| mattoliverau | :) | 21:02 |
| timburke | agenda's at https://wiki.openstack.org/wiki/Meetings/Swift | 21:02 |
| kota_ | :) | 21:03 |
| timburke | #topic Shanghai | 21:03 |
| *** openstack changes topic to "Shanghai (Meeting topic: swift)" | 21:03 | |
| timburke | #link https://etherpad.openstack.org/p/swift-ptg-shanghai | 21:03 |
| timburke | it's getting so close now! | 21:03 |
| timburke | i know clay's got his visa squared away, and i got mine a couple weeks ago | 21:03 |
| timburke | rledisez and kota_, can't wait to see you guys there! mattoliverau, you will be missed! | 21:04 |
| mattoliverau | Sorry I won't make it. | 21:04 |
| timburke | no worries -- if there's anything you'd like us to talk about, feel free to put it on the etherpad and i'll do my best to represent you (short of doing voices) | 21:05 |
| mattoliverau | Lol | 21:05 |
| *** jamesmcarthur has quit IRC | 21:05 | |
| *** raildo has quit IRC | 21:06 | |
| timburke | main thing for this was to just keep highlighting the etherpad | 21:06 |
| timburke | #topic stable release | 21:06 |
| *** openstack changes topic to "stable release (Meeting topic: swift)" | 21:06 | |
| timburke | we have a new swift! | 21:07 |
| timburke | #link http://lists.openstack.org/pipermail/release-announce/2019-October/008047.html | 21:07 |
| mattoliverau | \o/ | 21:07 |
| kota_ | nice | 21:07 |
| *** e0ne has quit IRC | 21:08 | |
| timburke | this is to make sure that our py3 support is the best we can make it. this cycle in particular, i'm going to try to be aggressive in backporting, *especially* for py3 fixes | 21:08 |
| *** jamesmcarthur has joined #openstack-meeting | 21:08 | |
| kota_ | sounds good | 21:08 |
| timburke | but having said that, i'm also working on getting stable releases together for stein, rocky, and even queens if i can hurry up ;-) | 21:09 |
| timburke | hence the flurry of patches i've proposed lately | 21:09 |
| timburke | i think stein is about ready; if anyone wants to take a look at the authors/changelog and check that i didn't miss anything, i'd appreciate it | 21:10 |
| timburke | #link https://review.opendev.org/#/c/690699/ | 21:10 |
| timburke | on to updates! | 21:11 |
| timburke | #topic object versioning | 21:11 |
| *** openstack changes topic to "object versioning (Meeting topic: swift)" | 21:11 | |
| timburke | quick recap: we've got three patches we're working on: one to add the null namespace, one to add a new versioning mode, and one to get s3api to use it | 21:12 |
| *** ekcs has quit IRC | 21:13 | |
| timburke | the s3api patch had fallen behind for a while, but we recently got it rebased on top of the new versioning mode -- with all the functests passing! | 21:13 |
| timburke | probably means we need to write more tests ;-) | 21:14 |
| mattoliverau | Lol | 21:14 |
| timburke | clay's recently gotten the versioning patch rebased on the null-namespace one | 21:14 |
| timburke | i'm pretty sure by shanghai we'll have a pretty solid patch chain with tests passing and everything | 21:15 |
| timburke | which should be handy reference as we discuss the design and implementation with kota_ and rledisez :-) | 21:15 |
| kota_ | thx | 21:16 |
| timburke | one of the recent developments with the namespace patch is that we decided that any reserved name must start with a null byte -- effectively partitioning the namespace so we've got all reserved names, followed by "normal" user names | 21:17 |
| timburke | this allows us to avoid a lot of the problems with delimiters and figuring out whether a "subdir" entry ought to appear when there's a mix of reserved and user-accessible names | 21:18 |
| timburke | that's the main news there -- any questions or feedback? | 21:19 |
| rledisez | you mean something like <null>versionning_AUTH_xxx ? | 21:19 |
| kota_ | \u0000 seems null | 21:19 |
| timburke | yeah -- though we aren't currently using it at the account level | 21:19 |
| * kota_ is looking at https://etherpad.openstack.org/p/swift-null-namespace | 21:19 | |
| rledisez | ok, I should re-read the etherpad | 21:20 |
| timburke | there would be URLs like /v1/AUTH_test/%00versioning%00<client-container>/%00<client-object>%00<timestamp> | 21:20 |
| timburke | part of the reason for wanting the null namespace was so we could roll up the usage stats in the existing account DB | 21:21 |
| kota_ | ic | 21:22 |
| timburke | all right -- losf! | 21:22 |
| kota_ | the objects exist in the user namespace as possible | 21:22 |
| timburke | yeah, kinda :-) | 21:23 |
| timburke | #topic lots of small files | 21:23 |
| *** openstack changes topic to "lots of small files (Meeting topic: swift)" | 21:23 | |
| timburke | rledisez, how's it going? | 21:23 |
| rledisez | nothing new on our side. alecuyer was busy on other topics | 21:23 |
| rledisez | he worked on the leveldb state patch (detecting if leveldb is corrupted or not) | 21:24 |
| rledisez | it seems it's not as easy as he though, there is not method in leveldb to get that information | 21:24 |
| timburke | interesting. and a bit annoying, i suppose :-/ | 21:25 |
| *** mriedem is now known as mriedem_afk | 21:26 | |
| timburke | all right. i'll keep an eye out for more patches, and *some day* i'll actually find time to get this going in my dev environent | 21:27 |
| timburke | i feel like i'm not doing your work justice -- i keep saying i'll look at it but have hardly started :-( | 21:28 |
| mattoliverau | does leveldb support any time of checking/scrubbing. might be a good feature request for them. Then we can work on a workaround and hopefully get someone upstream to fix it long term ;) | 21:28 |
| rledisez | timburke: don't worry, there is plenty of time to do it. And alecuyer will sit next to you in shangai until you try it ;) | 21:28 |
| mattoliverau | lol | 21:29 |
| timburke | it'll be great :D | 21:29 |
| timburke | all right | 21:29 |
| timburke | #topic open discussion | 21:29 |
| *** openstack changes topic to "open discussion (Meeting topic: swift)" | 21:29 | |
| rledisez | mattoliverau: I can't answer, alecuyer may know that | 21:29 |
| mattoliverau | nps, just thinking out load :) | 21:29 |
| timburke | mattoliverau, sorry, i dropped the sharding status updating -- figured you probably wouldn't mind too much though ;-) | 21:30 |
| mattoliverau | lol, nps, sorry, I haven't been to active. I was away last week. And this week ramping up in a new role. | 21:30 |
| rledisez | I have one topic for open discussion today: I noted recently that on our proxy servers (doing only proxy) we will be CPU-bound before we will be network-bound. our proxies are 16 cores Xeon E5-2630 at 2.40GHz, connected in 10Gbps | 21:30 |
| rledisez | I made some profiling (only on PUT for now) and found that the "with SomeTimeout()" around read/write on sockets are really consuming a lot of CPU | 21:31 |
| *** rfolco|rover has quit IRC | 21:31 | |
| rledisez | just for the test, I removed them and was able to reduce the CPU usage by about 35% while increasing the speed of the upload by ~20% (on an other configuration with smaller CPU) | 21:31 |
| timburke | mattoliverau, glad the job's still safe :-) | 21:31 |
| rledisez | I worked a bit this afternoon on a possible alternative implementation, the idea is to get a "watchdog" greenthread that will kill a socket if nothing happened in a $timeout delay. It seems it's viable | 21:32 |
| rledisez | BTW, the second most consuming part is the one the enqueue/dequeue chunk for the putters. I have no idea how to patch that for now :) | 21:32 |
| timburke | huh -- interesting... | 21:32 |
| rledisez | is CPU usage a concern for somebody else? | 21:32 |
| kota_ | not to me but curious. | 21:33 |
| mattoliverau | Still trying to figure out what the new role is, hopefully I'll still get to spend some of my time upstream on any project. Just not sure how much. (obvious I plan to make that Swift).. although that also means I'm not sure how much openstack releated travel support would be included (I'm assuming none) :( | 21:33 |
| timburke | i'll ask around for sure -- i don't remember off hand. i *thought* we'd usually get network-bound, but maybe that's more for larger objects... | 21:34 |
| mattoliverau | this is where a Mark would be handy. He'd keep an eye on things via getput and find bottle necks. But he's retired now. | 21:34 |
| timburke | mattoliverau, sounds like i need to try to get an LCA talk now ;-) | 21:34 |
| mattoliverau | yeah!! maybe we could add some basic perf test in ci/cd so we can get a baseline | 21:35 |
| mattoliverau | then we could at least see any regressions. | 21:35 |
| mattoliverau | again I'm just brain storming :) | 21:35 |
| rledisez | I'll write in an ehterpad the methodolgy I followed for that test, so everyone can check if I didn't make mistake | 21:36 |
| *** ekcs has joined #openstack-meeting | 21:36 | |
| timburke | sounds good, thanks for mentioning it! | 21:36 |
| mattoliverau | rledisez: good idea, if there is something we can do we should do it. we don't want no stinkin bottlenecks ;) | 21:37 |
| kota_ | perhaps, the info what's version of eventlet might be helpful. | 21:37 |
| timburke | and object size for the PUT | 21:37 |
| kota_ | we're using thread switching around the chunk putter. | 21:38 |
| rledisez | eventlet 0.25, it was 4G so the test was long enough | 21:38 |
| kota_ | ok | 21:38 |
| rledisez | kota_: exactly, every read or write is wrapped in a with Timeout that trigger an eventlet scheduling & co… (I'm not an eventlet expert) | 21:39 |
| timburke | yeah, gotta schedule the callback around https://github.com/eventlet/eventlet/blob/v0.25.0/eventlet/timeout.py#L65-L70 | 21:41 |
| timburke | rledisez, what are your object_chunk_size and client_chunk_size? | 21:42 |
| rledisez | defaults (64K) | 21:43 |
| timburke | might try increasing that... fwiw, i think we default to 1MB (and just tell customers to buy more RAM :P) | 21:43 |
| timburke | anyway, maybe this is best left for #openstack-swift :-) | 21:44 |
| rledisez | sure :) | 21:44 |
| kota_ | to fit the size of ec chunk? | 21:44 |
| timburke | and we can let kota_ and mattoliverau get on with their mornings | 21:44 |
| kota_ | :P | 21:44 |
| timburke | thank you all for coming, and thank you for working on swift! | 21:44 |
| timburke | #endmeeting | 21:44 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:44 | |
| openstack | Meeting ended Wed Oct 23 21:44:56 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:44 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-10-23-21.00.html | 21:44 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-10-23-21.00.txt | 21:45 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-10-23-21.00.log.html | 21:45 |
| mattoliverau | thanks timburke | 21:45 |
| *** yamamoto has joined #openstack-meeting | 21:59 | |
| *** whoami-rajat has quit IRC | 22:01 | |
| *** zaneb has quit IRC | 22:02 | |
| *** yamamoto has quit IRC | 22:03 | |
| *** zaneb has joined #openstack-meeting | 22:17 | |
| *** markvoelker has quit IRC | 22:22 | |
| *** jamesmcarthur has quit IRC | 22:24 | |
| *** rcernin has joined #openstack-meeting | 22:33 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:38 | |
| *** diablo_rojo has quit IRC | 22:44 | |
| *** diablo_rojo has joined #openstack-meeting | 22:45 | |
| *** jamesmcarthur has quit IRC | 23:08 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:10 | |
| *** anastzhyr has quit IRC | 23:13 | |
| *** jamesmcarthur has quit IRC | 23:14 | |
| *** ekcs has quit IRC | 23:20 | |
| *** igordc has quit IRC | 23:23 | |
| *** ykatabam has joined #openstack-meeting | 23:23 | |
| *** yamamoto has joined #openstack-meeting | 23:26 | |
| *** mattw4 has quit IRC | 23:38 | |
| *** artom has joined #openstack-meeting | 23:41 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!