Thursday, 2021-05-20

« Wednesday, 2021-05-19 Index Friday, 2021-05-21 »
*** openstack has joined #openvswitch00:24
*** acidfoo has joined #openvswitch00:35
*** JStoker has quit IRC00:38
*** JStoker has joined #openvswitch00:39
*** tfherbert has quit IRC01:13
*** ricolin_ is now known as ricolin02:05
*** ricolin_ has joined #openvswitch02:27
*** ricolin has quit IRC02:27
*** ricolin_ is now known as ricolin02:32
*** ricolin_ has joined #openvswitch02:37
*** ricolin has quit IRC02:39
*** blahdodo has quit IRC02:41
*** blahdodo has joined #openvswitch02:46
*** spinningmonkey has joined #openvswitch03:01
*** acidfoo has quit IRC03:03
*** acidfoo has joined #openvswitch03:04
*** djbalrog has joined #openvswitch03:07
*** acidfoo has quit IRC03:08
*** ricolin_ has quit IRC03:53
*** ricolin has joined #openvswitch03:55
*** djbalrog has quit IRC04:35
*** djbalrog has joined #openvswitch04:37
*** djbalrog has quit IRC04:56
*** djbalrog has joined #openvswitch04:58
*** anilvenkata has joined #openvswitch05:05
*** ralonsoh has joined #openvswitch05:14
*** djbalrog has quit IRC05:44
*** djbalrog has joined #openvswitch05:45
*** djbalrog has quit IRC06:01
*** djbalrog has joined #openvswitch06:04
*** eelco has joined #openvswitch06:09
*** dholler has joined #openvswitch06:12
*** slaweq has joined #openvswitch06:26
*** djbalrog has quit IRC06:37
*** djbalrog has joined #openvswitch06:39
*** djbalrog has quit IRC06:51
*** djbalrog has joined #openvswitch06:53
*** thaller has quit IRC07:02
*** thaller has joined #openvswitch07:03
*** mdgray has joined #openvswitch07:14
*** djbalrog has quit IRC07:27
*** djbalrog has joined #openvswitch07:29
*** elvira has joined #openvswitch07:30
*** panda has quit IRC07:34
*** fkautz has quit IRC07:35
*** edwarnicke has quit IRC07:35
*** fkautz has joined #openvswitch07:37
*** edwarnicke has joined #openvswitch07:38
*** elvira has quit IRC07:49
*** elvira has joined #openvswitch07:50
*** rcernin has quit IRC07:52
*** echaudron has joined #openvswitch08:27
*** mishiran- is now known as mishiranu08:28
*** eelco has quit IRC08:28
*** istokes has joined #openvswitch08:59
*** psahoo has joined #openvswitch09:00
*** rcernin has joined #openvswitch09:04
*** djbalrog has quit IRC09:21
*** djbalrog has joined #openvswitch09:23
*** djbalrog has joined #openvswitch09:24
*** djbalrog has joined #openvswitch09:25
*** djbalrog has joined #openvswitch09:26
*** djbalrog has joined #openvswitch09:27
*** djbalrog has joined #openvswitch09:29
*** djbalrog has joined #openvswitch09:30
*** djbalrog has joined #openvswitch09:31
*** jangutter has quit IRC09:32
*** thaller has quit IRC09:33
*** djbalrog has joined #openvswitch09:33
*** thaller has joined #openvswitch09:33
*** djbalrog has joined #openvswitch09:35
*** djbalrog has joined #openvswitch09:35
*** djbalrog has joined #openvswitch09:36
*** rcernin has quit IRC09:38
*** dceara has joined #openvswitch09:40
*** dceara has quit IRC09:46
*** dceara has joined #openvswitch09:46
*** rcernin has joined #openvswitch09:53
*** djbalrog has joined #openvswitch09:54
*** links has joined #openvswitch11:25
*** panda has joined #openvswitch11:58
*** dcbw has joined #openvswitch11:59
*** anilvenkata has quit IRC12:07
*** bostondriver has joined #openvswitch12:12
*** rcernin has quit IRC12:14
*** djbalrog has quit IRC12:27
*** djbalrog has joined #openvswitch12:28
*** psahoo_ has joined #openvswitch12:31
*** psahoo has quit IRC12:35
*** anilvenkata has joined #openvswitch12:47
*** anilvenkata has quit IRC12:49
*** anilvenkata has joined #openvswitch12:49
*** tbachman has quit IRC12:53
*** tbachman has joined #openvswitch12:56
*** panda has quit IRC12:56
*** acidfoo has joined #openvswitch13:05
*** ralonsoh has quit IRC13:26
*** ralonsoh has joined #openvswitch13:27
*** djbalrog has quit IRC13:31
*** djbalrog has joined #openvswitch13:33
*** jangutter has joined #openvswitch14:03
*** jangutter has quit IRC14:04
*** jangutter has joined #openvswitch14:04
*** jangutter has quit IRC14:08
*** jangutter has joined #openvswitch14:12
*** jangutter has quit IRC14:14
*** jangutter has joined #openvswitch14:14
*** jangutter_ has joined #openvswitch14:15
*** jangutter has quit IRC14:16
*** jangutter has joined #openvswitch14:16
*** jangutter_ has quit IRC14:20
*** djbalrog has quit IRC14:22
*** djbalrog has joined #openvswitch14:24
*** jangutter has quit IRC14:25
*** jangutter has joined #openvswitch14:25
*** tbachman_ has joined #openvswitch14:30
*** tbachman has quit IRC14:30
*** tbachman_ is now known as tbachman14:30
*** anilvenkata has quit IRC14:36
*** anilvenk_ has joined #openvswitch14:44
*** panda has joined #openvswitch14:54
*** djbalrog has quit IRC15:11
*** djbalrog has joined #openvswitch15:14
*** echaudron has quit IRC15:19
*** acidfoo has quit IRC15:25
*** acidfoo has joined #openvswitch15:26
*** jangutter has quit IRC15:33
*** jangutter has joined #openvswitch15:33
*** acidfoo has quit IRC16:24
*** acidfu_ has joined #openvswitch16:24
*** psahoo_ has quit IRC16:41
*** istokes has quit IRC16:50
*** djbalrog has quit IRC16:51
*** tfherbert has joined #openvswitch16:53
*** djbalrog has joined #openvswitch16:53
*** mdgray has quit IRC16:58
*** dholler has quit IRC17:07
*** donhw has quit IRC17:13
mmichelsonI'm trying to watch the membership here and at libera to figure out where the meeting today should be held.17:14
mmichelsonSo far, it seems like this is the better option17:14
*** dholler has joined #openvswitch17:14
imaximetsmmichelson, at least, openstack bot is here.17:15
mmichelsonimaximets, true17:15
mmichelsonIn fact17:15
mmichelson#startmeeting ovn_community_development_discussion17:15
openstackMeeting started Thu May 20 17:15:31 2021 UTC and is due to finish in 60 minutes.  The chair is mmichelson. Information about MeetBot at http://wiki.debian.org/MeetBot.17:15
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.17:15
openstackThe meeting name has been set to 'ovn_community_development_discussion'17:15
mmichelsonHi everyone!17:15
imaximetsHi.17:15
ihrachyso/17:16
mmichelsonTomorrow is supposed to be our date to branch 21.06. However, looking at patchwork, there's still a good number of patches up that were put up before the soft freeze and that need review.17:16
numansHello17:16
mmichelsonI'm thinking that delaying branching by a week might be a good idea. Does anyone object?17:16
numansI'm fine with that.17:16
numansI'm hoping I'll contribute to the reviews next week.17:17
mmichelsonYep, I'm planning to spend basically the rest of today doing reviews, and probably some amount of time tomorrow, too.17:17
mmichelsonAlso, those of you that have privileges on patchwork, please be sure to mark patches as accepted, rejected, etc. as the state changes. That way we can have a more accurate view of things.17:18
mmichelsonAs for what I've been working on, I've more-or-less rewritten my ARP FIP fix from scratch. The new approach seeks to program logical flows directly in ovn-northd instead of creating MAC Bindings in ovn-controller.17:19
mmichelsonI'm planning to create an option that will allow for routing flows to be created automatically for NAT and LB addresses on routers one hop away.17:19
*** blp has joined #openvswitch17:19
blpHi!17:20
mmichelsonThis can prevent having to create static routes in routers for typical E-W traffic17:20
blpSorry I'm late.17:20
mmichelsonblp, hi!17:20
mmichelsonCurrent status is that I have the code written in ovn-northd.c but need to tackle ddlog still.17:20
mmichelsonETA is some time next week, I think.17:20
mmichelsonAnd that's all from me for the moment.17:20
*** zhouhan has joined #openvswitch17:20
mmichelsonActually before I give up the floor, blp and zhouhan have joined since I started, so I'll repeat what I led with17:21
mmichelsonTomorrow is supposed to be our date to branch 21.06. However, looking at patchwork, there's still a good number of patches up that were put up before the soft freeze and that need review.17:21
mmichelsonzhouhan, blp, do you have strong opinions about delaying branching for a week?17:21
zhouhanI am ok with it17:21
blpI'm OK with it. I hope it will give some time for folks to look at my series.17:22
mmichelsonblp, yep, I'm planning to look at it and _lore_'s CoPP series today17:22
_lore_mmichelson: thx17:22
mmichelsonblp, and once that series is merged, I think we'll do a round of scale testing with DDLog again. Hopefully we'll be in a better position than before.17:22
mmichelsonAnd now I'm really done :)17:23
blpmmichelson: Sounds good!17:23
blpI haven't rebased my series in a while. I wouldn't be surprised if there was a conflict (probably in NEWS, at least).17:23
mmichelsonProbably. But it should still be reviewable17:23
numansblp, thanks to ovsrobot, it can be easily rebased - https://github.com/ovsrobot/ovn/tree/series_24258317:24
blpnumans: Great!17:24
blpOK, it seems quiet, so I'll bring up the choice of IRC server.17:27
blpfreenode is undergoing some turmoil. The staff have almost all quit.17:28
blpThe successor is libera.chat. I've started an #openvswitch channel there.17:28
blpI hope that everyone here can create a nick on libera.chat17:28
numans+1 to move over there.17:28
blpand that starting next week we can have the meeting there instead.17:28
numansI'd support that.17:29
mmichelsonYep, that's fine. I set myself up over there this morning17:29
blpI'm going to try to be in both places for a few weeks to make sure that we get everyone.17:29
blpI don't know whether the meeting bot is available there yet.17:30
imaximetssounds good to me.  another option is oftc, but I don't know much about it and therefore have no preferences.17:30
mmichelsonSounds good. Also update the topic to point to the new location17:30
mmichelsonblp, I think we can ask some openstack people about entering the bot there. Hopefully it's not a pain to do.17:30
blpI've tried "/invite openstack" but no response currently. I *think* that's how we got the bot in here.17:30
*** ChanServ sets mode: +o blp17:31
*** blp changes topic to "Open vSwitch, a Linux Foundation Collaborative Project || The #openvswitch channel is moving to libera.chat! Please visit us there."17:31
*** ChanServ sets mode: -o blp17:31
numanswe may need to reach out to dalvarez for some help17:31
zhouhanmmichelson: seems the bot didn't work for last meeting on 5/13?17:32
blpIt's possible that the bot just hasn't been moved yet.17:32
zhouhanI didn't see meeting record here: http://eavesdrop.openstack.org/meetings/ovn_community_development_meeting/2021/17:32
ihrachysI can dig on how to get it on libra and what's the status of probably openstack migration17:32
blpThe log is here: http://eavesdrop.openstack.org/meetings/ovn_community_development_discussion/2021/ovn_community_development_discussion.2021-05-13-17.15.log.html17:32
mmichelsonzhouhan, oh, that's because I changed it back to the name in the topic17:33
blp(from 5/13)17:33
mmichelsons/meeting/discussion/17:33
zhouhanok :)17:33
mmichelsonIt's quiet again. Anyone who wants to share,  please go ahead.17:35
numansI can go real quick17:35
numansMark Gray and I've been looking into addressing issues in offloading datapath flows when the pkt hits conntrack of router pipeline.17:35
numansThere is some asymmetry there. I'm hoping to submit the patch to fix these issues tomorrow.17:35
numansI couldn't do much reviews this week and hoping to catch up next week. That's it from me.17:36
_lore_can I go next?17:36
*** ralonsoh has quit IRC17:37
mmichelson_lore_, go for it17:37
_lore_this week I worked to add support for check_packet_larger for ingress traffic17:37
_lore_for traffic entering the cluster through a gw router17:37
*** donhw has joined #openvswitch17:38
_lore_ddlog part is missing17:38
_lore_moreover I had some pending patch for reivews17:38
blp_lore_: Do you need help on the ddlog part? Or just haven't had time for it?17:39
_lore_- CoPP series http://patchwork.ozlabs.org/project/ovn/list/?series=24140017:39
_lore_- localport - localnetport issue: http://patchwork.ozlabs.org/project/ovn/list/?series=24140017:40
_lore_sorry wrong link: http://patchwork.ozlabs.org/project/ovn/patch/e2df86ba8357477e7c54cf4d99f4659edd3633ce.1621265763.git.lorenzo.bianconi@redhat.com/17:40
_lore_this is the link for ingress check_packet_larger series: http://patchwork.ozlabs.org/project/ovn/list/?series=24472917:41
zhouhan_lore_: the localport fix has been merged 2-3 days ago17:41
_lore_zhouhan: it is a different patch17:41
_lore_it is for dropping traffic from localport to a localnet one17:41
*** djbalrog has quit IRC17:41
zhouhan_lore_: at least the link you provided is merged :)17:42
_lore_zhouhan: sorry, I put the wrong link17:42
_lore_one sec17:42
_lore_http://patchwork.ozlabs.org/project/ovn/patch/8008fa9867d210cf18ad31f912535f2c14e85c43.1620151078.git.lorenzo.bianconi@redhat.com/17:43
*** zhouhan has quit IRC17:43
*** tfherbert has quit IRC17:43
_lore_sorry for the noise17:43
_lore_blp: I have not time to look at it yet, thanks for the help..I will get back to you :)17:43
*** djbalrog has joined #openvswitch17:43
*** zhouhan has joined #openvswitch17:43
_lore_zhouhan: maybe you missed the link for the patch I was referring to17:44
_lore_http://patchwork.ozlabs.org/project/ovn/patch/8008fa9867d210cf18ad31f912535f2c14e85c43.1620151078.git.lorenzo.bianconi@redhat.com/17:44
zhouhanyes, sorry I was disconnect17:44
_lore_that's all from me, sorry for the confusion :(17:44
zhouhannow I see it, thanks!17:44
*** thaller has quit IRC17:44
*** thaller has joined #openvswitch17:45
ihrachysI can do next?17:45
mmichelsonsure hting ihrachys17:45
ihrachysspent time fixing some embarrasing bugs with the new allow-stateless, here's the result: https://patchwork.ozlabs.org/project/ovn/list/?series=24428817:45
ihrachyshoping we can squeeze them into 21.0617:45
zhouhanihrachys: thanks. I am reviewing it17:46
ihrachysit's mostly around proper handling priority/direction of other acls17:46
ihrachyszhouhan: thanks!17:46
ihrachysalso, thanks blp for fixing that ddlog relation bug, it was over the top of my abilities :)17:46
ihrachysthat's it for me17:47
mmichelsonYeah I would never have figured that one out17:47
*** links has quit IRC17:48
zhouhanI have a quick one: mmichelson: please take a look at v2 of the ssl patch series: http://patchwork.ozlabs.org/project/ovn/list/?series=24481317:48
mmichelsonzhouhan, can and will do17:49
blpihrachys: That was a wild bug.17:49
mmichelsoncall me Review Man17:49
mmichelsonBecause that's all I'm going to do for a bit.17:49
zhouhanthanks mmichelson!17:49
zhouhanblp: just curious do you expect more such kind of issues that require debugging in ddlog itself?17:51
mmichelsonzhouhan, I think that's an impossible question to answer :)17:52
blpzhouhan: I don't, but... even GCC has bugs.17:52
zhouhanOr, maybe better to ask: can we easily tell if it is bug in the northd-ddlog code or in ddlog itself?17:53
zhouhanI guess the answer is that if we are familiar enough with ddlog then it is easier to tell :D17:54
blpEasily? It's a matter of debugging until there's a contradiction. That's what I ended up with.17:55
blpI don't normally suspect my tools either.17:55
zhouhanThat's fair :)17:56
ihrachysin this case it was probably slightly easier since we knew the two commits that interacted badly; in the future we may not have that privilege of scoping the issue to particular relations / definitions. correct?17:56
blpSome kinds of bugs will probably never end up blamed on ddlog itself. Since it's in Rust, I wouldn't expect to ever see a memory error, or if there is one it's probalby due to the C code.17:56
blpihrachys: That's correct, but you can usually reduce it to one or two commits, which does tend to focus the search.17:57
ihrachysthat's if it doesn't happen in the wild on a customer machine :)17:58
ihrachys"my northdb is empty, please help; what did you do? I dunno"17:59
imaximetsif you have a prefect tool, you, probably, didn't test it enough. :)18:00
imaximets*perfect18:01
mmichelsonis there anyone left that hasn't gone yet?18:01
imaximetsI'm here, but I don't really have much to say.18:01
mmichelsonimaximets, :)18:02
mmichelsonOK, I guess that's everyone then. Thanks!18:03
mmichelson#endmeeting18:03
openstackMeeting ended Thu May 20 18:03:49 2021 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)18:03
openstackMinutes:        http://eavesdrop.openstack.org/meetings/ovn_community_development_discussion/2021/ovn_community_development_discussion.2021-05-20-17.15.html18:03
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/ovn_community_development_discussion/2021/ovn_community_development_discussion.2021-05-20-17.15.txt18:03
openstackLog:            http://eavesdrop.openstack.org/meetings/ovn_community_development_discussion/2021/ovn_community_development_discussion.2021-05-20-17.15.log.html18:03
ihrachysblp: except adding Inspect()s in the code, are there some online / patch-less ways to inspect what's going on in northd-ddlog?18:04
ihrachyslike maybe flipping some kind of debug/verbose switch to get more logs for internal calculations18:05
blpihrachys: I use the replay feature a lot. It works well for that.18:05
ihrachysblp: thanks, that's helpful! afaiu that requires process restart. anything to avoid that? thinking about scenario where you have to jump into a live cluster and check what's going on there without intrusive actions.18:08
blpProcess restart to start the replay logging?18:09
ihrachysyes. it's enabled with a cli option, right?18:10
blpYes, that's right.18:10
blpHmm.18:10
blpMaybe we could make it possible to enable it without restarting. I think that would require doing a full recomputation at the time that we enable it. Would that be valuable?18:11
ihrachysmaybe slightly yes, at least no need to change scripts managing the service to enable the option.18:13
ihrachyswill northd still serve new updates while recalculation happening?18:13
blpI think there would be a delay.18:14
blpLet's take it from a different angle. What would be your ideal way to inspect?18:14
zhouhanIf we think about that the C northd is always doing recomputing, that one-time delay is not a big deal, right?18:16
blpzhouhan: That's my theory too.18:16
*** djbalrog has quit IRC18:17
ihrachysideally I would be able to deduce which part of computation triggered removal of my objects from db. though we already have transactions logged there so that's good. if that's not possible to have logged proactively, then maybe triggering (duplicate?) recalculation on demand with something resembling "Inspect() after every line" and giving me the output, while the main thread is still processing18:17
ihrachysupdates.18:17
ihrachysthe process could recalculate in background and dump into a file and forget the results? not affecting the main thread.18:18
*** djbalrog has joined #openvswitch18:19
blpihrachys: If you just want "recalculate snapshot into file" then we could make an ovn-northd-ddlog command-line option to do that. When you run it, it grabs everything from the databases, runs it through ddlog once, and dumps the replay to a file.18:19
blpIt wouldn't need the running daemons to do anything, then.18:20
ihrachyssounds fair18:20
ihrachysas long as it doesn't touch db18:20
blpWe could add a --dry-run option to ovn-northd-ddlog that just never sends updates to the databases.18:22
blpShouldn't be hard, I think.18:22
ihrachys++ sounds nice18:22
ihrachysI haven't yet looked into replay, just skimmed through a doc. does it contain weights and all that you used to nail that bug down?18:22
blpYes.18:23
ihrachysthen it seems like a good idea to me18:25
*** djbalrog has quit IRC18:32
*** djbalrog has joined #openvswitch18:34
blpihrachys: I think it's trivial. The "paused" state for ovn-northd-ddlog is the same as a --dry-run. We can implement --dry-run as starting out paused.18:35
ihrachysblp: do you want me to take a look into it? I can't guarantee next weeks, but next months yes.18:38
*** vdasari has joined #openvswitch18:38
*** tbachman has quit IRC18:42
blpihrachys: Into a --dry-run? I'm hacking that up now, I think it's easy.18:44
ihrachysok, thanks, just wanted to make sure I don't put more stuff on your plate without your consent :)18:45
blpihrachys: No worries (in this case)18:46
*** dceara has quit IRC18:56
*** blp has left #openvswitch19:00
*** djbalrog has quit IRC19:07
*** djbalrog has joined #openvswitch19:09
*** tbachman has joined #openvswitch19:12
*** tbachman has quit IRC19:14
*** tbachman_ has joined #openvswitch19:14
*** ihrachys has quit IRC19:22
*** djbalrog has quit IRC19:22
*** tbachman has joined #openvswitch19:22
*** tbachman_ has joined #openvswitch19:23
*** djbalrog has joined #openvswitch19:23
*** tbachman has quit IRC19:26
*** ihrachys has joined #openvswitch19:27
*** ihrachys has quit IRC19:28
*** ihrachys has joined #openvswitch19:28
*** tbachman_ has quit IRC19:29
*** ihrachys has quit IRC19:30
*** ihrachys has joined #openvswitch19:31
*** ihrachys has quit IRC19:32
*** ihrachys has joined #openvswitch19:33
*** ihrachys has quit IRC19:33
*** ihrachys has joined #openvswitch19:33
*** djbalrog has quit IRC19:57
*** djbalrog has joined #openvswitch19:58
*** rcernin has joined #openvswitch20:07
*** rcernin has quit IRC20:13
*** slaweq has quit IRC20:20
*** slaweq has joined #openvswitch20:22
*** tbachman has joined #openvswitch20:26
*** slaweq has quit IRC20:29
*** rcernin has joined #openvswitch20:50
*** djbalrog has quit IRC21:02
*** djbalrog has joined #openvswitch21:04
*** acidfu_ has quit IRC21:14
*** rcernin has quit IRC21:49
*** hexa- has quit IRC21:52
*** djbalrog has quit IRC21:52
*** TwPeter has quit IRC21:53
*** hexa- has joined #openvswitch21:53
*** djbalrog has joined #openvswitch21:54
*** tfherbert has joined #openvswitch21:55
*** bostondriver has quit IRC22:04
vanczsee yall on libera22:36
*** vancz has left #openvswitch22:36
*** djbalrog has quit IRC22:41
*** rcernin has joined #openvswitch22:42
*** djbalrog has joined #openvswitch22:44
*** djbalrog has quit IRC23:17
*** djbalrog has joined #openvswitch23:18
*** djbalrog has quit IRC23:37
*** djbalrog has joined #openvswitch23:38
« Wednesday, 2021-05-19 Index Friday, 2021-05-21 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!