*** mlavalle has quit IRC | 00:03 | |
*** tosky has quit IRC | 00:09 | |
*** macz_ has joined #openstack-meeting | 00:42 | |
*** macz_ has quit IRC | 00:47 | |
*** timburke__ has quit IRC | 00:47 | |
*** timburke__ has joined #openstack-meeting | 00:48 | |
*** jmasud has quit IRC | 01:01 | |
*** manpreet has quit IRC | 01:02 | |
*** rcernin has quit IRC | 01:34 | |
*** baojg has joined #openstack-meeting | 01:34 | |
*** rcernin has joined #openstack-meeting | 01:45 | |
*** rcernin has quit IRC | 01:46 | |
*** rcernin has joined #openstack-meeting | 01:46 | |
*** rh-jelabarre has quit IRC | 02:05 | |
*** rcernin has quit IRC | 02:45 | |
*** rcernin has joined #openstack-meeting | 02:57 | |
*** rcernin has quit IRC | 02:57 | |
*** rcernin has joined #openstack-meeting | 02:58 | |
*** manpreet has joined #openstack-meeting | 03:14 | |
*** rcernin has quit IRC | 03:31 | |
*** evrardjp has quit IRC | 03:33 | |
*** evrardjp has joined #openstack-meeting | 03:33 | |
*** rcernin has joined #openstack-meeting | 03:38 | |
*** udesale has joined #openstack-meeting | 03:42 | |
*** rcernin has quit IRC | 03:52 | |
*** rcernin has joined #openstack-meeting | 03:52 | |
*** rcernin has quit IRC | 03:53 | |
*** rcernin has joined #openstack-meeting | 03:54 | |
*** jamesdenton has quit IRC | 04:30 | |
*** jamesden_ has joined #openstack-meeting | 04:31 | |
*** armax has joined #openstack-meeting | 04:31 | |
*** armax has quit IRC | 04:33 | |
*** macz_ has joined #openstack-meeting | 04:41 | |
*** vishalmanchanda has joined #openstack-meeting | 04:42 | |
*** macz_ has quit IRC | 04:46 | |
*** jamesden_ has quit IRC | 04:55 | |
*** jamesdenton has joined #openstack-meeting | 04:56 | |
*** macz_ has joined #openstack-meeting | 05:02 | |
*** macz_ has quit IRC | 05:06 | |
*** jamesdenton has quit IRC | 05:32 | |
*** Luzi has joined #openstack-meeting | 05:40 | |
*** jamesdenton has joined #openstack-meeting | 05:42 | |
*** jmasud has joined #openstack-meeting | 05:44 | |
*** jamesdenton has quit IRC | 05:52 | |
*** psachin has joined #openstack-meeting | 05:52 | |
*** jamesdenton has joined #openstack-meeting | 05:53 | |
*** jmasud has quit IRC | 05:58 | |
*** psachin has quit IRC | 06:01 | |
*** zbr|rover has quit IRC | 06:08 | |
*** zbr|rover has joined #openstack-meeting | 06:11 | |
*** jmasud has joined #openstack-meeting | 06:27 | |
*** ralonsoh has joined #openstack-meeting | 06:38 | |
*** baojg has quit IRC | 06:43 | |
*** baojg has joined #openstack-meeting | 06:44 | |
*** dklyle has quit IRC | 06:49 | |
*** psachin has joined #openstack-meeting | 06:50 | |
*** jmasud has quit IRC | 06:55 | |
*** jmasud has joined #openstack-meeting | 07:00 | |
*** lpetrut has joined #openstack-meeting | 07:06 | |
*** jmasud has quit IRC | 07:10 | |
*** cgoncalves has quit IRC | 07:18 | |
*** cgoncalves has joined #openstack-meeting | 07:20 | |
*** cgoncalves has quit IRC | 07:20 | |
*** cgoncalves has joined #openstack-meeting | 07:21 | |
*** csatari has quit IRC | 07:25 | |
*** csatari has joined #openstack-meeting | 07:28 | |
*** rcernin has quit IRC | 08:09 | |
*** rpittau|afk is now known as rpittau | 08:19 | |
*** dsariel has joined #openstack-meeting | 08:21 | |
*** ricolin has quit IRC | 08:27 | |
*** ricolin has joined #openstack-meeting | 08:32 | |
*** tosky has joined #openstack-meeting | 08:41 | |
*** rcernin has joined #openstack-meeting | 08:52 | |
*** rcernin has quit IRC | 08:57 | |
*** vishalmanchanda has quit IRC | 09:01 | |
*** abhishekk is now known as abhishekk|away | 09:03 | |
*** macz_ has joined #openstack-meeting | 09:04 | |
*** ociuhandu has joined #openstack-meeting | 09:06 | |
*** rcernin has joined #openstack-meeting | 09:08 | |
*** macz_ has quit IRC | 09:09 | |
*** ociuhandu has quit IRC | 09:10 | |
*** ociuhandu has joined #openstack-meeting | 09:17 | |
*** e0ne has joined #openstack-meeting | 09:19 | |
*** e0ne has quit IRC | 09:22 | |
*** ociuhandu has quit IRC | 09:22 | |
*** e0ne has joined #openstack-meeting | 09:24 | |
*** e0ne has quit IRC | 09:24 | |
*** ociuhandu has joined #openstack-meeting | 09:27 | |
*** rcernin has quit IRC | 09:32 | |
*** ociuhandu has quit IRC | 09:36 | |
*** vishalmanchanda has joined #openstack-meeting | 09:42 | |
*** ociuhandu has joined #openstack-meeting | 09:42 | |
*** ociuhandu has quit IRC | 09:48 | |
*** dsariel has quit IRC | 09:54 | |
*** e0ne has joined #openstack-meeting | 09:56 | |
*** rcernin has joined #openstack-meeting | 09:57 | |
*** strigazi has joined #openstack-meeting | 09:58 | |
*** ociuhandu has joined #openstack-meeting | 10:01 | |
*** rcernin has quit IRC | 10:02 | |
*** ociuhandu has quit IRC | 10:02 | |
*** ociuhandu has joined #openstack-meeting | 10:03 | |
*** e0ne has quit IRC | 10:09 | |
*** rcernin has joined #openstack-meeting | 10:12 | |
*** baojg has quit IRC | 10:16 | |
*** rcernin has quit IRC | 10:22 | |
*** dsariel has joined #openstack-meeting | 10:42 | |
*** ociuhandu has quit IRC | 10:46 | |
*** ociuhandu has joined #openstack-meeting | 10:47 | |
*** ociuhandu has quit IRC | 10:54 | |
*** oneswig has joined #openstack-meeting | 10:56 | |
oneswig | #startmeeting scientific-sig | 11:01 |
---|---|---|
openstack | Meeting started Wed Mar 24 11:01:18 2021 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. | 11:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 11:01 |
*** openstack changes topic to " (Meeting topic: scientific-sig)" | 11:01 | |
openstack | The meeting name has been set to 'scientific_sig' | 11:01 |
*** rcernin has joined #openstack-meeting | 11:01 | |
*** ociuhandu has joined #openstack-meeting | 11:01 | |
*** rcernin has quit IRC | 11:01 | |
oneswig | hi | 11:03 |
oneswig | No set agenda for today, alas | 11:04 |
*** rcernin has joined #openstack-meeting | 11:04 | |
*** ociuhandu has quit IRC | 11:07 | |
eliaswimmer | hi | 11:08 |
oneswig | Hi eliaswimmer, welcome | 11:08 |
oneswig | I didn't set any agenda alas :-( | 11:08 |
oneswig | Small update, have a contact about Magic Castle which I'm hoping to involve to present their JupyterHub approach soon | 11:09 |
oneswig | (nothing set yet) | 11:09 |
oneswig | Any news from you eliaswimmer? | 11:13 |
oneswig | OK - lets close for today, and plan ahead for items for next time | 11:17 |
eliaswimmer | Not really, sorry. | 11:17 |
oneswig | Nice to see you anyway :-) until next time | 11:17 |
oneswig | #endmeeting | 11:18 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 11:18 | |
openstack | Meeting ended Wed Mar 24 11:18:21 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 11:18 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2021/scientific_sig.2021-03-24-11.01.html | 11:18 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2021/scientific_sig.2021-03-24-11.01.txt | 11:18 |
openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2021/scientific_sig.2021-03-24-11.01.log.html | 11:18 |
*** ociuhandu has joined #openstack-meeting | 11:18 | |
*** oneswig has quit IRC | 11:20 | |
*** martial_ has joined #openstack-meeting | 11:20 | |
*** baojg has joined #openstack-meeting | 11:29 | |
*** baojg has quit IRC | 11:29 | |
*** baojg has joined #openstack-meeting | 11:30 | |
*** baojg has quit IRC | 11:30 | |
*** baojg has joined #openstack-meeting | 11:31 | |
*** baojg has quit IRC | 11:31 | |
*** baojg has joined #openstack-meeting | 11:31 | |
*** baojg has quit IRC | 11:32 | |
*** baojg has joined #openstack-meeting | 11:32 | |
*** baojg has quit IRC | 11:33 | |
*** baojg has joined #openstack-meeting | 11:33 | |
*** ociuhandu has quit IRC | 11:33 | |
*** baojg has quit IRC | 11:33 | |
*** macz_ has joined #openstack-meeting | 11:41 | |
*** macz_ has quit IRC | 11:45 | |
*** verdurin has joined #openstack-meeting | 11:48 | |
*** rcernin has quit IRC | 11:58 | |
*** macz_ has joined #openstack-meeting | 12:01 | |
*** ociuhandu has joined #openstack-meeting | 12:03 | |
*** ociuhandu has quit IRC | 12:04 | |
*** ociuhandu has joined #openstack-meeting | 12:05 | |
*** macz_ has quit IRC | 12:06 | |
*** rcernin has joined #openstack-meeting | 12:06 | |
*** ociuhandu has joined #openstack-meeting | 12:11 | |
*** dsariel has quit IRC | 12:17 | |
*** rh-jelabarre has joined #openstack-meeting | 12:20 | |
*** rcernin has quit IRC | 12:22 | |
*** ociuhandu has quit IRC | 12:23 | |
*** ociuhandu has joined #openstack-meeting | 12:32 | |
*** ociuhandu has quit IRC | 12:39 | |
*** ociuhandu has joined #openstack-meeting | 12:40 | |
*** psachin has quit IRC | 12:50 | |
*** ociuhandu has quit IRC | 12:55 | |
*** ociuhandu has joined #openstack-meeting | 13:01 | |
*** ociuhandu has quit IRC | 13:02 | |
*** ociuhandu has joined #openstack-meeting | 13:02 | |
*** macz_ has joined #openstack-meeting | 13:03 | |
*** macz_ has quit IRC | 13:08 | |
*** dsariel has joined #openstack-meeting | 13:09 | |
*** jamesdenton has quit IRC | 13:13 | |
*** jamesdenton has joined #openstack-meeting | 13:13 | |
*** ociuhandu has quit IRC | 13:16 | |
*** e0ne has joined #openstack-meeting | 13:18 | |
*** ociuhandu has joined #openstack-meeting | 13:25 | |
*** belmoreira has joined #openstack-meeting | 13:27 | |
*** ociuhandu has quit IRC | 13:30 | |
*** dansmith has quit IRC | 13:31 | |
*** ociuhandu has joined #openstack-meeting | 13:35 | |
*** dansmith has joined #openstack-meeting | 13:38 | |
*** ociuhandu has quit IRC | 13:41 | |
*** ociuhandu has joined #openstack-meeting | 13:53 | |
*** martial_ has quit IRC | 14:00 | |
*** lajoskatona has joined #openstack-meeting | 14:00 | |
*** liuyulong has joined #openstack-meeting | 14:01 | |
lajoskatona | liuyulong: Hi, do we have l3 meeting today? | 14:01 |
liuyulong | Hi | 14:02 |
liuyulong | yes | 14:02 |
lajoskatona | liuyulong: cool | 14:02 |
liuyulong | #startmeeting neutron_l3 | 14:02 |
openstack | Meeting started Wed Mar 24 14:02:24 2021 UTC and is due to finish in 60 minutes. The chair is liuyulong. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:02 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:02 |
*** openstack changes topic to " (Meeting topic: neutron_l3)" | 14:02 | |
openstack | The meeting name has been set to 'neutron_l3' | 14:02 |
liuyulong | Sorry, a bit late. | 14:02 |
lajoskatona | liuyulong: I was late ~8 mins yesterday from all meetings :-) | 14:03 |
liuyulong | lajoskatona, lol | 14:03 |
liuyulong | OK, let's start. | 14:03 |
liuyulong | #topic Announcements | 14:04 |
*** openstack changes topic to "Announcements (Meeting topic: neutron_l3)" | 14:04 | |
liuyulong | #link https://etherpad.opendev.org/p/neutron-xena-ptg | 14:04 |
*** ociuhandu has quit IRC | 14:04 | |
*** ociuhandu has joined #openstack-meeting | 14:04 | |
liuyulong | We are at the end of W dev cycle. Now we hve the X ptg on the way. | 14:04 |
liuyulong | #link https://doodle.com/poll/cc2ste3emzw7ekrh?utm_source=poll&utm_medium=link | 14:05 |
liuyulong | This is the time slot for neutron Xena PTG. | 14:06 |
liuyulong | So two things here: | 14:06 |
liuyulong | 1. add your topic to the etherpad | 14:06 |
*** armax has joined #openstack-meeting | 14:09 | |
*** liuyulong_ has joined #openstack-meeting | 14:10 | |
liuyulong_ | Sorry, I lost the connection... | 14:10 |
*** liuyulong has quit IRC | 14:10 | |
liuyulong_ | 1. add your topic to the etherpad | 14:11 |
liuyulong_ | 2. choose the time available based on your time zone | 14:11 |
slaweq | hi | 14:11 |
slaweq | sorry for being late | 14:11 |
liuyulong_ | Two things (repeated...) | 14:11 |
liuyulong_ | It's a virtual PTG again. | 14:12 |
liuyulong_ | Hope to see you guys face to face someday. : ) | 14:12 |
liuyulong_ | slaweq, Hi | 14:12 |
liuyulong_ | OK, no more announcement from me now. | 14:12 |
liuyulong_ | Let's move on. | 14:12 |
*** liuyulong_ is now known as liuyulong | 14:12 | |
liuyulong | #topic Bugs | 14:13 |
*** openstack changes topic to "Bugs (Meeting topic: neutron_l3)" | 14:13 | |
liuyulong | #link http://lists.openstack.org/pipermail/openstack-discuss/2021-March/020903.html | 14:13 |
liuyulong | #link http://lists.openstack.org/pipermail/openstack-discuss/2021-March/021064.html | 14:14 |
* haleyb wanders in late | 14:14 | |
liuyulong | The first one | 14:15 |
liuyulong | Sorry, wrong link | 14:15 |
liuyulong | #link http://lists.openstack.org/pipermail/openstack-discuss/2021-March/021230.html | 14:15 |
liuyulong | #link http://lists.openstack.org/pipermail/openstack-discuss/2021-March/021064.html | 14:16 |
liuyulong | These two are the last two weeks bug list. | 14:16 |
liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1919107 | 14:16 |
openstack | Launchpad bug 1919107 in neutron "[L3][L2 pop] Is it necessary to enforce enabling the option arp_responder and l2_population?" [High,Confirmed] | 14:16 |
liuyulong | This is a real long story. | 14:17 |
liuyulong | #link https://review.opendev.org/c/openstack/neutron/+/778820 | 14:17 |
liuyulong | These two config are enforced for the patch https://review.opendev.org/c/openstack/neutron/+/601336 | 14:18 |
liuyulong | But as we can see in the 601336, it will not be a good approch to fix the problem in that way. So it will not be merged. | 14:18 |
liuyulong | But, we have done some pre works. | 14:19 |
liuyulong | Some of them casues the bug of https://bugs.launchpad.net/neutron/+bug/1916761 | 14:19 |
openstack | Launchpad bug 1916761 in Ubuntu Cloud Archive ussuri "[dvr] bound port permanent arp entries never deleted" [High,Fix committed] | 14:19 |
liuyulong | So, we need to revert them since the final approch 601336 will not be accepted. | 14:20 |
liuyulong | In the revert patch https://review.opendev.org/c/openstack/neutron/+/778820, I put all the work together. | 14:20 |
haleyb | liuyulong: i was just writing a comment in that one, just noticed something with the release note, otherwise fine | 14:21 |
liuyulong | The import thing is on this https://review.opendev.org/c/openstack/neutron/+/752248. | 14:21 |
liuyulong | haleyb, Sure, I will update | 14:21 |
liuyulong | It has some conflicts on that 752248. | 14:22 |
liuyulong | #link https://review.opendev.org/c/openstack/neutron/+/778820/7/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_dvr_neutron_agent.py | 14:22 |
liuyulong | #link https://review.opendev.org/c/openstack/neutron/+/752248/14/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_dvr_neutron_agent.py | 14:23 |
liuyulong | Hope my change is in the right way. | 14:23 |
liuyulong | IMO, we should not rush to merge this patch. I will run "check experimental" for the neutron-tempest-plugin-dvr-multinode-scenario job. | 14:25 |
liuyulong | To verify the east-west traffic of DVR. | 14:26 |
liuyulong | It is failed now, but it's not the DVR case. | 14:26 |
liuyulong | #link https://497849cb3a7ea1ef6b00-cfc9a6b6175848be06351d4fb9f59b07.ssl.cf5.rackcdn.com/778820/7/experimental/neutron-tempest-plugin-dvr-multinode-scenario/58d1c94/testr_results.html | 14:26 |
lajoskatona | it failed now, not sure if related (test_dns_domain_and_name failed ) | 14:26 |
lajoskatona | https://497849cb3a7ea1ef6b00-cfc9a6b6175848be06351d4fb9f59b07.ssl.cf5.rackcdn.com/778820/7/experimental/neutron-tempest-plugin-dvr-multinode-scenario/58d1c94/testr_results.html | 14:26 |
lajoskatona | ok, sorry, seems my irc client delayed things... | 14:27 |
liuyulong | lajoskatona, np, maybe it was my message just running slowly on the internet... | 14:29 |
liuyulong | Another thing related to this is the flows for the l2pop and arp responder. | 14:30 |
liuyulong | #link https://bugs.launchpad.net/networking-bagpipe/+bug/1919104 | 14:30 |
openstack | Launchpad bug 1919104 in BaGPipe "[bagpipe_bgpvpn] restart ovs agent only will lose flows" [Undecided,In progress] - Assigned to LIU Yulong (dragon889) | 14:30 |
liuyulong | This ovs-agent extension bagpipe_bgpvpn will handle the l2pop tunnel direct flow and arp responder flow. | 14:31 |
liuyulong | But if arp_responder and l2_population are enforced, then [bagpipe_bgpvpn] actually just do things duplicated to the ovs-agent built-in functions. | 14:32 |
liuyulong | So, after the revert, we can disable the arp_responder and l2_population for ovs-agent. | 14:33 |
*** ociuhandu has quit IRC | 14:33 | |
liuyulong | But, one more thing is ovs-agent will clean the flows not installed by it. Another conflict with [bagpipe_bgpvpn]. | 14:34 |
liuyulong | #link https://review.opendev.org/c/openstack/neutron/+/782345/ | 14:34 |
liuyulong | So I created this patch for the bug 1919104, which will skip the l2pop and arp responder stale flow clean during ovs-agent restart if they are not enabled. | 14:35 |
openstack | bug 1919104 in BaGPipe "[bagpipe_bgpvpn] restart ovs agent only will lose flows" [Undecided,In progress] https://launchpad.net/bugs/1919104 - Assigned to LIU Yulong (dragon889) | 14:35 |
liuyulong | OK, the final thing about this is I will take some time to consider the alternative of the patch 601336. | 14:37 |
liuyulong | Maybe we can discuss it in the X ptg. | 14:38 |
*** lpetrut has quit IRC | 14:39 | |
liuyulong | Next | 14:39 |
liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1920975 | 14:39 |
openstack | Launchpad bug 1920975 in neutron "neutron dvr should lower proxy_delay when using proxy_arp" [Undecided,In progress] - Assigned to Edward Hope-Morley (hopem) | 14:39 |
liuyulong | #link https://review.opendev.org/c/openstack/neutron/+/782570 | 14:39 |
liuyulong | I see the patch here. | 14:39 |
liuyulong | With some comments, maybe the kernel config tunning can workaround this problem. https://review.opendev.org/c/openstack/neutron/+/782570/2/neutron/agent/l3/dvr_fip_ns.py#196 | 14:40 |
liuyulong | Next | 14:41 |
liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1920001 | 14:41 |
openstack | Launchpad bug 1920001 in neutron "Creation of floating ip with new rbac policies fails" [High,In progress] - Assigned to Slawek Kaplonski (slaweq) | 14:41 |
liuyulong | It's in the deputy's list. | 14:42 |
liuyulong | And the patch was merged. | 14:42 |
liuyulong | #link https://review.opendev.org/c/openstack/neutron-lib/+/781625 | 14:42 |
liuyulong | This is proper fix we can see in the LP comments from slaweq. | 14:43 |
*** Luzi has quit IRC | 14:43 | |
slaweq | yes, it's all related to the new policies | 14:43 |
liuyulong | Looks simple, but a new version of neutron-lib should be added for neutron to get the fix work. That will take some time. :) | 14:44 |
liuyulong | Alright, no more bugs from me now. | 14:45 |
liuyulong | OK, let's move on. | 14:47 |
liuyulong | #topic On demand agenda | 14:47 |
*** openstack changes topic to "On demand agenda (Meeting topic: neutron_l3)" | 14:47 | |
lajoskatona | If you have a few minute please check https://review.opendev.org/c/openstack/neutron-specs/+/767337 | 14:48 |
lajoskatona | the spec for BFD | 14:48 |
lajoskatona | I run into several issues with os-ken BFD, and to make it work I had to "move" it to an l2 extension which starts os-ken app | 14:48 |
lajoskatona | I tried to summarize the thing in the spec's backend part | 14:49 |
liuyulong | Maybe this can be a new agent which is not only for "L3 routes", but also for internal connection detect, pr neutron router to physical router. | 14:51 |
liuyulong | s/pr/or | 14:51 |
lajoskatona | possible | 14:51 |
*** ociuhandu has joined #openstack-meeting | 14:51 | |
liuyulong | Could the command "ovs-vsctl" work to control the ovsdb for BFD? | 14:52 |
lajoskatona | the main issue with os/ken bfd is that it needs to connect to ovsdb to fetch some dp related thing so even in new agent it need a new bridge to add ports dedicated to BFD as can't connect to the same bridge with 2 controller | 14:53 |
lajoskatona | not sure if this is os-ken limitation os vsdb limitation | 14:53 |
lajoskatona | BFD in os-ken sends packet independently from ovs, but for administration it uses dp information | 14:54 |
liuyulong | #link https://review.opendev.org/c/openstack/neutron-specs/+/767337/13/specs/wallaby/bfd_support.rst@547 | 14:54 |
lajoskatona | but as I had now a more or less working PoC I realized that the code has strange conditionals, so another option is that I can totally clean dp related things from it, I think nobody uses BFd in openstack | 14:55 |
liuyulong | For the spec here, my idea is to add the ovs command line examples which is equal to os-ken "app" to explain the real usage. | 14:55 |
lajoskatona | yeah I checked that "manually" and checked ovs' BFD implementation, perhaps that can be simpler | 14:57 |
lajoskatona | but even in that way touching ovs from l3-agent can be strange | 14:58 |
*** ociuhandu has quit IRC | 14:58 | |
liuyulong | Give you some clue, maybe the BFD implementation in the OVN can help. : ) | 14:58 |
*** dklyle has joined #openstack-meeting | 14:58 | |
*** dklyle has quit IRC | 14:59 | |
liuyulong | OK, time is up. | 14:59 |
liuyulong | Let's end here. | 14:59 |
lajoskatona | liuyulong: I can check | 14:59 |
lajoskatona | thanks | 14:59 |
liuyulong | Thank you guys for attending. | 14:59 |
liuyulong | #endmeeting | 14:59 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:59 | |
openstack | Meeting ended Wed Mar 24 14:59:43 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:59 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_l3/2021/neutron_l3.2021-03-24-14.02.html | 14:59 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2021/neutron_l3.2021-03-24-14.02.txt | 14:59 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_l3/2021/neutron_l3.2021-03-24-14.02.log.html | 14:59 |
lajoskatona | Bye | 14:59 |
liuyulong | Bye | 14:59 |
*** liuyulong has quit IRC | 15:00 | |
*** ociuhandu has joined #openstack-meeting | 15:04 | |
*** ociuhandu has quit IRC | 15:08 | |
*** macz_ has joined #openstack-meeting | 15:09 | |
*** macz_ has quit IRC | 15:09 | |
*** macz_ has joined #openstack-meeting | 15:10 | |
*** dklyle has joined #openstack-meeting | 15:10 | |
*** ociuhandu has joined #openstack-meeting | 15:22 | |
*** ociuhandu has quit IRC | 15:26 | |
*** stand has joined #openstack-meeting | 15:29 | |
*** mlavalle has joined #openstack-meeting | 15:39 | |
*** jmasud has joined #openstack-meeting | 15:46 | |
*** markmcclain has joined #openstack-meeting | 15:53 | |
*** ociuhandu has joined #openstack-meeting | 16:03 | |
*** gyee has joined #openstack-meeting | 16:23 | |
*** ociuhandu has quit IRC | 16:26 | |
*** timburke_ has joined #openstack-meeting | 16:39 | |
*** timburke__ has quit IRC | 16:42 | |
*** ociuhandu has joined #openstack-meeting | 16:52 | |
*** ociuhandu_ has joined #openstack-meeting | 16:57 | |
*** jmasud has quit IRC | 16:59 | |
*** ociuhandu has quit IRC | 17:00 | |
*** ociuhandu_ has quit IRC | 17:01 | |
*** ociuhandu has joined #openstack-meeting | 17:07 | |
*** ociuhandu has quit IRC | 17:11 | |
*** jmasud has joined #openstack-meeting | 17:13 | |
*** udesale has quit IRC | 17:19 | |
*** jmasud has quit IRC | 17:21 | |
*** rpittau is now known as rpittau|afk | 17:24 | |
*** jmasud has joined #openstack-meeting | 17:29 | |
*** jmasud has quit IRC | 17:37 | |
*** jamesdenton has quit IRC | 18:04 | |
*** jamesdenton has joined #openstack-meeting | 18:05 | |
*** rcernin has joined #openstack-meeting | 18:19 | |
*** rcernin has quit IRC | 18:23 | |
*** timburke_ has quit IRC | 18:35 | |
*** timburke__ has joined #openstack-meeting | 18:35 | |
*** ralonsoh has quit IRC | 19:07 | |
*** jmasud has joined #openstack-meeting | 19:11 | |
*** jmasud has quit IRC | 19:18 | |
*** e0ne has quit IRC | 19:51 | |
*** belmoreira has quit IRC | 20:14 | |
*** lajoskatona has quit IRC | 20:29 | |
*** ociuhandu has joined #openstack-meeting | 20:43 | |
*** ociuhandu has quit IRC | 20:48 | |
*** jamesdenton has quit IRC | 20:52 | |
*** jamesden_ has joined #openstack-meeting | 20:52 | |
timburke__ | #startmeeting swift | 21:00 |
openstack | Meeting started Wed Mar 24 21:00:03 2021 UTC and is due to finish in 60 minutes. The chair is timburke__. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
*** openstack changes topic to " (Meeting topic: swift)" | 21:00 | |
openstack | The meeting name has been set to 'swift' | 21:00 |
timburke__ | who's here for the swift meeting? | 21:00 |
seongsoocho | o/ | 21:00 |
kota_ | o/ | 21:00 |
*** acoles has joined #openstack-meeting | 21:00 | |
rledisez | o/ | 21:01 |
*** rcernin has joined #openstack-meeting | 21:01 | |
mattoliverau | o/ | 21:01 |
*** rcernin has quit IRC | 21:01 | |
*** rcernin has joined #openstack-meeting | 21:02 | |
acoles | o/ | 21:03 |
timburke__ | as usual, the agenda's at https://wiki.openstack.org/wiki/Meetings/Swift | 21:03 |
timburke__ | first up | 21:03 |
timburke__ | #topic PTG | 21:03 |
*** openstack changes topic to "PTG (Meeting topic: swift)" | 21:03 | |
timburke__ | if you haven't yet, please register and respond on the doodle poll for meeting times | 21:04 |
timburke__ | #link https://april2021-ptg.eventbrite.com/ | 21:04 |
timburke__ | #link https://doodle.com/poll/cnr3qb7y2afiad9v | 21:04 |
*** jmasud has joined #openstack-meeting | 21:05 | |
timburke__ | and we've got an etherpad for gathering topics | 21:05 |
timburke__ | #link https://etherpad.opendev.org/p/swift-ptg-xena | 21:05 |
timburke__ | i really ought to book (virtual) rooms and such today | 21:06 |
mattoliverau | then doodle poll needs to be a priority.. so please do it if you haven't yet! | 21:06 |
timburke__ | any questions or comments on it? less than a month away now! | 21:08 |
*** jmasud has quit IRC | 21:08 | |
*** zaitcev has joined #openstack-meeting | 21:08 | |
*** jmasud has joined #openstack-meeting | 21:10 | |
timburke__ | all right then | 21:11 |
timburke__ | on to some updates! | 21:11 |
timburke__ | #topic relinker | 21:11 |
*** openstack changes topic to "relinker (Meeting topic: swift)" | 21:11 | |
timburke__ | so we did another part power at nvidia! just finished up this morning | 21:11 |
timburke__ | went better than the last time -- we're definitely getting better at it | 21:12 |
timburke__ | but there are still some rough edges | 21:12 |
*** jmasud has quit IRC | 21:12 | |
timburke__ | notably, we saw a bunch of extra (empty) handoff partitions getting created because we ran the relinker more than once, and it'd want to do a rehash on a partition that never got any links put in it | 21:14 |
*** jmasud has joined #openstack-meeting | 21:14 | |
timburke__ | i think https://review.opendev.org/c/openstack/swift/+/781908 should deal with it -- basically, if we call get_hashes for a partition that doesn't exist, we should be able to return early | 21:14 |
*** jmasud has quit IRC | 21:16 | |
timburke__ | since last week, we had a bunch of great stuff land -- operators can now target specific policies and even partitions, and we've merged acoles's great refactoring to make relink and cleanup reuse a lot of the same code | 21:16 |
*** jmasud has joined #openstack-meeting | 21:18 | |
timburke__ | still to come, mattoliverau has some more improvements to progress visibility, and i rebased my patch to parallelize the relinker | 21:18 |
mattoliverau | nice | 21:18 |
timburke__ | if you're interested in part power increases, those are likely the best places to jump in! | 21:19 |
seongsoocho | cool. the relinker is getting better | 21:19 |
zaitcev | So how high are you now? | 21:19 |
zaitcev | And I don't mean marijuana | 21:19 |
timburke__ | only 18. we've done it twice, and intend to do at least two more | 21:19 |
acoles | we also learnt some stuff doing this increase after a previous one. For example, we discovered we had some tombstones that had not been cleaned up in their original partitions, so during this relink we had *two* locations trying to create a link in the same new location | 21:19 |
zaitcev | Hmm. So even 18 is not enough for you? | 21:20 |
acoles | we just love doing it :D | 21:20 |
timburke__ | (speaking of, https://review.opendev.org/c/openstack/swift/+/781591 is a first crack at being able to step by more than one) | 21:20 |
zaitcev | That's like 262000 partitions | 21:20 |
*** jmasud has quit IRC | 21:20 | |
timburke__ | if you assume 10k disks, that's still only 26/disk ;-) | 21:20 |
mattoliverau | oh cool, jump more then 1, interesting | 21:21 |
seongsoocho | one question for relink. in my case, I forgot to increase reclaim age before the relink, so there are a lots of cleanup job is failed.. | 21:22 |
seongsoocho | I fi | 21:22 |
timburke__ | as long as the failures are for tombstones (.ts files) i expect it should be mostly fine | 21:23 |
seongsoocho | I finished the part power job and the object replicator is running again. The failed diskfiles will be delete? Most of diskfiles are .data and it was deleted in other node during relink | 21:24 |
*** jamesden_ has quit IRC | 21:25 | |
*** jamesdenton has joined #openstack-meeting | 21:25 | |
timburke__ | the .datas -- are the objects still in listings? | 21:27 |
seongsoocho | nop. It is not in list | 21:27 |
timburke__ | i think those will need to be manually cleaned up :-( | 21:28 |
timburke__ | though zaitcev's dark data audit watcher could come in handy when you upgrade | 21:28 |
zaitcev | It does not reattach them though | 21:30 |
zaitcev | Can only delete | 21:30 |
zaitcev | But what the heck happened? Relinker misfired, or they were orphans even before partition power increase? | 21:30 |
timburke__ | fwiw, newer versions also make it so the relinker can respect the cluster's reclaim_age by pointing it at object-server.conf | 21:30 |
zaitcev | Oh, n/m I see the comment about reclaim age. | 21:31 |
mattoliverau | sounds like they were deletes that weren't propergated fully so delete makes sense. | 21:31 |
timburke__ | i'm guessing there was a delete after the increased ring went out but before the cleanup processed the partition. then a reclaim age passed. cleanup finally got to it, went to open the diskfile in the new location -- and cleaned up the tombstone before erroring | 21:32 |
timburke__ | ...makes me think the relinker (when not given a config file) should use a reclaim_age that's intentionally longer than anyone would likely have it configured... | 21:33 |
zaitcev | That's going to be the first time ever watcher got useful to anyone then. | 21:33 |
zaitcev | If seongsoocho uses it. | 21:33 |
seongsoocho | yes. during the relink , the object was deleted in other 2 nodes but not deleted in one node (because relinker use that disk too heavy , so object server return error) | 21:33 |
timburke__ | peace of mind is still a valid use-case ;-) | 21:33 |
seongsoocho | zaitcev: cool. | 21:33 |
timburke__ | all right | 21:34 |
timburke__ | #topic sharding and shrinking | 21:34 |
*** openstack changes topic to "sharding and shrinking (Meeting topic: swift)" | 21:34 | |
*** jmasud has joined #openstack-meeting | 21:35 | |
timburke__ | i know mattoliverau and acoles have continued working on this | 21:35 |
mattoliverau | I've been playing with al's repair and anaylze chain, and it's pretty awesome. | 21:35 |
timburke__ | and mattoliverau, you put together an etherpad about how to tell that a shard is old enough to consider shrinking, yeah? | 21:36 |
timburke__ | #link https://etherpad.opendev.org/p/swift-shrinking-active-age | 21:36 |
mattoliverau | oh yeah. The current shrinking blocker is ^ | 21:36 |
acoles | zaitcev pulled me up on some __hash__ kludge in that for which I am grateful - made it better | 21:36 |
acoles | I finally got some ideas about tombstone reporting up https://review.opendev.org/c/openstack/swift/+/782832 - very much WIP though | 21:37 |
mattoliverau | there is an edge case that one primary is small and shards before the others, the new shards ranges become active and then being pretty empty will be considered candidates for shrinking. The etherpad explains current progress, problems, pain points. | 21:38 |
mattoliverau | turns out what we thought should be an easy fix seems to get more and more complicated :P | 21:39 |
acoles | mattoliverau: thanks for starting the etherpad | 21:39 |
mattoliverau | So if your interested, read, ask questions and comment in the etherpad. | 21:40 |
acoles | mattoliverau: that's ditributed systems for you! ;) | 21:40 |
mattoliverau | lol yeah :) | 21:40 |
mattoliverau | in the meantime I wanted to give Als' repair stuff some love, because they'd also be great to have and have been up a long time. | 21:40 |
mattoliverau | I plugged them into my WIP shard graph visualiser tool and now you can get a green path for the best path. Which is nice when testing als changes. | 21:41 |
timburke__ | sounds good. we'll be able to fix up busted sharding yet! | 21:41 |
timburke__ | #topic open discussion | 21:41 |
*** openstack changes topic to "open discussion (Meeting topic: swift)" | 21:41 | |
timburke__ | what else should we bring up this week? | 21:41 |
kota_ | ah | 21:42 |
kota_ | one thing, it is not actually related to Swift | 21:42 |
kota_ | before a week from PTG, NVIDIA GTC will be held at online and I have a session to introduce my recent work. | 21:43 |
kota_ | just FYI. | 21:43 |
acoles | kota_: great! | 21:43 |
timburke__ | cool! congrats! | 21:43 |
seongsoocho | kota_: cool!!!! | 21:43 |
acoles | do you have a link / date/ time ? | 21:43 |
mattoliverau | nice! | 21:43 |
kota_ | it's free so you can watch the pre-recorded video | 21:43 |
kota_ | the registration is at https://gtc21.event.nvidia.com/ | 21:44 |
*** jmasud has quit IRC | 21:44 | |
kota_ | it looks like the direct link to the video is not work unless someone registered to see. | 21:45 |
acoles | kota_: thanks for sharing that | 21:45 |
kota_ | :D | 21:45 |
zaitcev | kota_: thanks | 21:45 |
mattoliverau | +1 | 21:45 |
zaitcev | Although I'm a little sick of everything remote. | 21:45 |
kota_ | exactly, I like the face to face meeting we did in the past. | 21:46 |
timburke__ | yeah, me too. with a little luck, maybe we'll be able to actually see each other in person the next time | 21:46 |
mattoliverau | yeah. but at least it makes it easier to attend conferences you might not be able to convince someone to send you too.. esp if your on the otherside of the world :) | 21:46 |
mattoliverau | but +100 for missing going to f2f conferences | 21:47 |
timburke__ | all right, i think i'll call it then | 21:49 |
timburke__ | thank you all for coming, and thank you for working on swift! | 21:49 |
timburke__ | #endmeeting | 21:49 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:49 | |
openstack | Meeting ended Wed Mar 24 21:49:29 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:49 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2021/swift.2021-03-24-21.00.html | 21:49 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2021/swift.2021-03-24-21.00.txt | 21:49 |
openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2021/swift.2021-03-24-21.00.log.html | 21:49 |
*** zaitcev has left #openstack-meeting | 21:49 | |
*** acoles has left #openstack-meeting | 21:49 | |
*** rcernin has quit IRC | 22:11 | |
*** jmasud has joined #openstack-meeting | 22:12 | |
*** rcernin has joined #openstack-meeting | 22:26 | |
*** rcernin has quit IRC | 22:31 | |
*** jmasud has quit IRC | 22:32 | |
*** rcernin has joined #openstack-meeting | 22:32 | |
*** ganso has quit IRC | 22:41 | |
*** vishalmanchanda has quit IRC | 22:41 | |
*** ganso has joined #openstack-meeting | 22:44 | |
*** slaweq has quit IRC | 23:02 | |
*** jmasud has joined #openstack-meeting | 23:05 | |
*** macz_ has quit IRC | 23:15 | |
*** stand has quit IRC | 23:20 | |
*** jamesdenton has quit IRC | 23:32 | |
*** jamesdenton has joined #openstack-meeting | 23:33 | |
*** gyee has quit IRC | 23:35 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!