| *** bobh has joined #openstack-oslo | 00:28 | |
| *** Liang__ has joined #openstack-oslo | 00:35 | |
| *** bobh has quit IRC | 01:54 | |
| *** bobh has joined #openstack-oslo | 01:54 | |
| *** bobh has quit IRC | 02:10 | |
| *** bobh has joined #openstack-oslo | 02:31 | |
| *** bobh has quit IRC | 03:39 | |
| *** bobh has joined #openstack-oslo | 04:05 | |
| *** zaneb has quit IRC | 04:17 | |
| *** bobh has quit IRC | 04:35 | |
| *** hoonetorg has joined #openstack-oslo | 06:22 | |
| *** Luzi has joined #openstack-oslo | 06:55 | |
| *** jbadiapa has joined #openstack-oslo | 07:04 | |
| *** e0ne has joined #openstack-oslo | 07:23 | |
| *** toabctl has joined #openstack-oslo | 07:26 | |
| *** plestang has joined #openstack-oslo | 07:47 | |
| *** e0ne has quit IRC | 07:47 | |
| *** e0ne has joined #openstack-oslo | 08:00 | |
| *** e0ne has quit IRC | 08:05 | |
| *** jaosorior has joined #openstack-oslo | 08:23 | |
| *** moguimar has joined #openstack-oslo | 08:29 | |
| *** hberaud|gone is now known as hberaud | 08:46 | |
| *** finucannot is now known as stephenfin | 08:51 | |
| *** tosky has joined #openstack-oslo | 08:54 | |
| *** bnemec-pto has quit IRC | 08:57 | |
| *** bnemec has joined #openstack-oslo | 08:59 | |
| *** shardy has joined #openstack-oslo | 09:04 | |
| *** Liang__ has quit IRC | 09:14 | |
| *** a-pugachev has joined #openstack-oslo | 10:09 | |
| *** yan0s has joined #openstack-oslo | 10:23 | |
| *** aojea has joined #openstack-oslo | 10:50 | |
| *** lxkong has joined #openstack-oslo | 11:34 | |
| lxkong | hi there, please anyone from oslo team review this patch for openstack/castellan https://review.openstack.org/#/c/633921/? | 11:34 |
|---|---|---|
| *** sum12 has quit IRC | 11:44 | |
| *** hberaud is now known as hberaud|lunch | 11:44 | |
| *** sum12 has joined #openstack-oslo | 11:44 | |
| *** chhagarw has joined #openstack-oslo | 12:01 | |
| *** raildo has joined #openstack-oslo | 12:01 | |
| *** hberaud|lunch is now known as hberaud | 12:10 | |
| *** a-pugachev_ has joined #openstack-oslo | 12:35 | |
| *** a-pugachev has quit IRC | 12:37 | |
| *** a-pugachev_ is now known as a-pugachev | 12:37 | |
| *** yan0s has quit IRC | 12:57 | |
| *** yan0s has joined #openstack-oslo | 12:57 | |
| *** Luzi has quit IRC | 13:02 | |
| *** Luzi has joined #openstack-oslo | 13:08 | |
| *** yan0s has quit IRC | 13:21 | |
| *** yan0s has joined #openstack-oslo | 13:34 | |
| *** edmondsw has quit IRC | 13:46 | |
| *** edmondsw has joined #openstack-oslo | 14:27 | |
| *** lbragstad has joined #openstack-oslo | 14:31 | |
| *** a-pugachev has quit IRC | 14:32 | |
| *** agopi has joined #openstack-oslo | 14:42 | |
| bnemec | #startmeeting oslo | 15:03 |
| openstack | Meeting started Mon Feb 11 15:03:11 2019 UTC and is due to finish in 60 minutes. The chair is bnemec. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:03 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:03 |
| *** openstack changes topic to " (Meeting topic: oslo)" | 15:03 | |
| openstack | The meeting name has been set to 'oslo' | 15:03 |
| bnemec | courtesy ping for amotoki, amrith, ansmith, bnemec, dansmith, dhellmann, dims | 15:03 |
| bnemec | courtesy ping for dougwig, e0ne, electrocucaracha, flaper87, garyk, gcb, haypo | 15:03 |
| bnemec | courtesy ping for hberaud, jd__, johnsom, jungleboyj, kgiusti, kragniz, lhx_ | 15:03 |
| bnemec | courtesy ping for moguimar, njohnston, raildo, redrobot, sileht, sreshetnyak, stephenfin | 15:03 |
| bnemec | courtesy ping for stevemar, therve, thinrichs, toabctl, zhiyan, zxy, zzzeek | 15:03 |
| stephenfin | o/ | 15:03 |
| redrobot | ol | 15:03 |
| redrobot | o/ | 15:03 |
| redrobot | \o | 15:03 |
| moguimar | xD | 15:03 |
| jungleboyj | o/ | 15:03 |
| moguimar | I was waiting in the wrong channel | 15:03 |
| bnemec | My previous meeting ran over a bit. | 15:03 |
| bnemec | #link https://wiki.openstack.org/wiki/Meetings/Oslo#Agenda_for_Next_Meeting | 15:04 |
| johnsom | o/ | 15:04 |
| bnemec | #topic Red flags for/from liaisons | 15:05 |
| *** openstack changes topic to "Red flags for/from liaisons (Meeting topic: oslo)" | 15:05 | |
| bnemec | I've been kind of out of touch for the past two weeks, so if there's anything going on let me know. | 15:05 |
| johnsom | Nothing to report here. | 15:05 |
| * jungleboyj has been out of touch as well. :-) | 15:06 | |
| bnemec | jungleboyj: Yours involved a lot more bbq than mine. :-) | 15:07 |
| jungleboyj | He he he. Yeah, and the scale shows it this morning. :-( | 15:07 |
| *** snapiri has quit IRC | 15:08 | |
| bnemec | Okay, as always you don't have to wait for the meeting to bring up issues, so if there is anything just let the Oslo team know. | 15:08 |
| bnemec | #topic Releases | 15:08 |
| *** openstack changes topic to "Releases (Meeting topic: oslo)" | 15:08 | |
| bnemec | I released oslo.utils before I left on PTO so we could get the EventletEvent fix out there. | 15:09 |
| bnemec | Skimming my emails this morning I didn't see that it made anything explode. | 15:09 |
| bnemec | I'll do the usual set of releases today. | 15:09 |
| *** hoonetorg has quit IRC | 15:09 | |
| bnemec | #topic Action items from last meeting | 15:10 |
| *** openstack changes topic to "Action items from last meeting (Meeting topic: oslo)" | 15:10 | |
| bnemec | "kgiusti to try to reproduce https://bugs.launchpad.net/oslo.messaging/+bug/1800957 with higher thread count" | 15:10 |
| openstack | Launchpad bug 1800957 in oslo.messaging "Upgrading to pike version causes rabbit timeouts with ssl" [High,Confirmed] - Assigned to Ken Giusti (kgiusti) | 15:10 |
| bnemec | I believe this is done. | 15:10 |
| bnemec | And IIRC there was even a fix posted to the bug. | 15:10 |
| bnemec | And that was it for action items. | 15:11 |
| bnemec | #topic Privsep and code that forks | 15:11 |
| *** openstack changes topic to "Privsep and code that forks (Meeting topic: oslo)" | 15:11 | |
| bnemec | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-January/001831.html | 15:11 |
| bnemec | This came up because the Neutron team was having another issue with the threaded privsep change. | 15:12 |
| bnemec | It turns out that the library they called had a fork in it. | 15:13 |
| johnsom | I think we ran into this as well. Someone was attempting to add privsep to our agent but was having problems. | 15:13 |
| bnemec | This very much does not play nicely with threads, as you can see from the links in my email. | 15:13 |
| bnemec | I added this to the agenda because I don't have a great answer to it. | 15:14 |
| bnemec | We may just need to come up with a way to make a fork-safe privsep call (whether that's running in the main thread or a completely separate daemon) and deal with these issues as we find them. | 15:15 |
| bnemec | But if anyone has a better idea please share. :-) | 15:15 |
| dhellmann | is the fork happening inside secure side of the privsep call? | 15:16 |
| bnemec | dhellmann: Yes | 15:16 |
| bnemec | It was in a library called by the privileged function. | 15:16 |
| * stephenfin tends to bury his head in the sand when it comes to all things privsep and is of absolutely no help :( | 15:16 | |
| dhellmann | what is the fork doing? | 15:16 |
| bnemec | stephenfin: This is why "privsep expert" is high on my list of wants in every Oslo project update. ;-) | 15:16 |
| dhellmann | is it the ssh that triggers the failure? | 15:17 |
| bnemec | It was something to do with netns management: https://github.com/svinota/pyroute2/blob/master/pyroute2/netns/nslink.py#L146-L147 | 15:18 |
| bnemec | Ah: https://github.com/svinota/pyroute2/blob/master/pyroute2/netns/nslink.py#L108 | 15:18 |
| dhellmann | ok, well, the whole point of privsep is to avoid having to do forks | 15:18 |
| gsantomaggio | about : https://bugs.launchpad.net/oslo.messaging/+bug/1800957 | 15:18 |
| gsantomaggio | we fixed the problem here: https://github.com/celery/py-amqp/pull/247 | 15:18 |
| openstack | Launchpad bug 1800957 in oslo.messaging "Upgrading to pike version causes rabbit timeouts with ssl" [High,Confirmed] - Assigned to Ken Giusti (kgiusti) | 15:18 |
| bnemec | That's why it's forking. | 15:18 |
| bnemec | gsantomaggio: Yep, thanks for looking into that! | 15:19 |
| dhellmann | it sounds like maybe the privsep API needs an "init hook" to set stuff like this up | 15:19 |
| bnemec | The problem is it isn't our code. | 15:19 |
| dhellmann | well, it's the structure | 15:20 |
| dhellmann | we need to give the secure side of the privsep api a chance to do some setup before we start making threads | 15:20 |
| bnemec | I'm not sure this is something that could be done ahead of time though. | 15:20 |
| dhellmann | oh, no? | 15:20 |
| bnemec | Neutron doesn't have a complete list of netns's at startup. | 15:20 |
| dhellmann | ah | 15:21 |
| bnemec | At least I don't think so, since they can be created by new networks and such. | 15:21 |
| dhellmann | oh, sure | 15:21 |
| dhellmann | I guess we need to give the secure functions a way to do something in the "main" thread then | 15:22 |
| dhellmann | or maybe we just say this is not a good candidate for privsep, I don't know | 15:22 |
| *** Luzi has quit IRC | 15:22 | |
| bnemec | Yeah, it seems like we could add an in-process command to the privsep protocol. | 15:23 |
| dhellmann | I guess the trick is that the secure code in the thread has to be able to trigger it | 15:23 |
| bnemec | Alternatively, neutron got around this by just synchronizing all of the privileged calls in this module. | 15:23 |
| dhellmann | that seems like a reasonable approach, too | 15:23 |
| dhellmann | at least as a stop-gap | 15:23 |
| bnemec | I don't know whether that's entirely safe either, but it at least keeps multiple calls from stepping on each other. | 15:24 |
| * dhellmann shrugs | 15:24 | |
| bnemec | Okay, sounds like adding in-process execution is probably our best bet here. | 15:25 |
| bnemec | #action Investigate adding main thread execution to privsep | 15:26 |
| bnemec | in-process really isn't the right term since all the calls run in the same process, just different threads. | 15:26 |
| dhellmann | oh, maybe we can just flag certain privsep functions to run in process instead of in threads | 15:26 |
| dhellmann | that might be simpler than having something in the main thread that the other threads can communicate with | 15:26 |
| dhellmann | sorry, flag them to run in the main thread instead of a worker | 15:27 |
| *** hoonetorg has joined #openstack-oslo | 15:27 | |
| bnemec | Yeah, I'm wondering if we could add a privileged_synchronous decorator or something to indicate that we can't run the call asynchronously. | 15:28 |
| dhellmann | right, I think that's likely to be the simplest approach | 15:28 |
| dhellmann | I was thinking originally we'd have something the worker thread could do to cause work to happen in the main thread, but that's silly | 15:28 |
| dhellmann | at some point we'd be building an operating system scheduler | 15:28 |
| bnemec | Yeah, I _think_ we can do it this way, but I don't know the privsep code well enough to say for sure. | 15:29 |
| dhellmann | it should just be an if statement at the point where we dispatch the work to a thread on the secure side | 15:29 |
| dhellmann | either do the work immediately, or throw it into a thread | 15:30 |
| bnemec | Yeah | 15:30 |
| bnemec | Okay, sounds like we have a plan then. | 15:31 |
| bnemec | I'll reply to the mailing list thread too for visibility. | 15:31 |
| bnemec | #action bnemec to update openstack-discuss about privsep/fork issue | 15:31 |
| bnemec | #topic Weekly Wayward Review | 15:32 |
| *** openstack changes topic to "Weekly Wayward Review (Meeting topic: oslo)" | 15:32 | |
| bnemec | #link https://review.openstack.org/579186 | 15:32 |
| bnemec | Slightly different this week. | 15:33 |
| dhellmann | it looks like we need a recheck there to build new versions of the docs, since the old logs have expired | 15:33 |
| bnemec | We need someone to take this patch over and eliminate the duplication in the docs. | 15:33 |
| dhellmann | also that, yes | 15:33 |
| bnemec | Basically it's a good change that needs a bit of massaging. I've been meaning to do that but I keep not having time, so I'm putting out a call for help. :-) | 15:34 |
| moguimar | o/ | 15:35 |
| moguimar | I can take it dhellmann | 15:36 |
| bnemec | moguimar: Thanks! | 15:36 |
| dhellmann | thanks, moguimar ! | 15:36 |
| bnemec | #action moguimar to take over https://review.openstack.org/579186 | 15:36 |
| bnemec | #topic Open discussion | 15:37 |
| *** openstack changes topic to "Open discussion (Meeting topic: oslo)" | 15:37 | |
| bnemec | Anything else? | 15:37 |
| moguimar | yep | 15:37 |
| moguimar | I spoke about oslo.config last week at FOSDEM | 15:37 |
| moguimar | https://fosdem.org/2019/schedule/event/python_application_configuration/ | 15:37 |
| * dhellmann still has that video queued up to watch | 15:37 | |
| bnemec | Nice | 15:38 |
| moguimar | it is basically the same talk I gave at Python Brasil | 15:38 |
| moguimar | I thought that I had enought reharsal but it was in portuguese | 15:38 |
| moguimar | so I kinda translated on the fly and next time will do some english reharsal too | 15:39 |
| bnemec | :-) | 15:39 |
| dhellmann | :-) | 15:39 |
| *** agopi has quit IRC | 15:39 | |
| bnemec | Any other topics? | 15:41 |
| moguimar | not on my end | 15:41 |
| bnemec | Okay, we'll give everyone 15 minutes back then. | 15:43 |
| bnemec | Thanks for joining! | 15:43 |
| bnemec | #endmeeting | 15:43 |
| *** openstack changes topic to "OpenStack Common Libraries | https://wiki.openstack.org/wiki/Oslo" | 15:43 | |
| openstack | Meeting ended Mon Feb 11 15:43:19 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:43 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/oslo/2019/oslo.2019-02-11-15.03.html | 15:43 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/oslo/2019/oslo.2019-02-11-15.03.txt | 15:43 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/oslo/2019/oslo.2019-02-11-15.03.log.html | 15:43 |
| plestang | Hi guys, is there anyone available to review this fix : https://review.openstack.org/#/c/635869/ | 15:49 |
| *** sahid has joined #openstack-oslo | 15:58 | |
| *** a-pugachev has joined #openstack-oslo | 16:01 | |
| *** njohnston_ has joined #openstack-oslo | 16:03 | |
| *** e0ne has joined #openstack-oslo | 16:04 | |
| *** e0ne has quit IRC | 16:17 | |
| *** e0ne has joined #openstack-oslo | 16:21 | |
| *** e0ne has quit IRC | 16:26 | |
| *** e0ne has joined #openstack-oslo | 16:36 | |
| *** yan0s has quit IRC | 16:37 | |
| *** aojea has quit IRC | 17:03 | |
| *** a-pugachev has quit IRC | 17:19 | |
| *** e0ne has quit IRC | 17:20 | |
| *** shardy has quit IRC | 17:43 | |
| *** moguimar has quit IRC | 17:55 | |
| *** moguimar has joined #openstack-oslo | 18:00 | |
| *** moguimar has quit IRC | 18:05 | |
| *** moguimar has joined #openstack-oslo | 18:10 | |
| *** moguimar has quit IRC | 18:14 | |
| *** moguimar has joined #openstack-oslo | 18:19 | |
| openstackgerrit | Merged openstack/oslo.db master: exc_filters: fix deadlock detection for MariaDB/Galera cluster https://review.openstack.org/635869 | 18:23 |
| *** moguimar has quit IRC | 18:23 | |
| *** moguimar has joined #openstack-oslo | 18:28 | |
| *** sahid has quit IRC | 18:33 | |
| *** moguimar has quit IRC | 18:33 | |
| *** moguimar has joined #openstack-oslo | 18:37 | |
| *** chhagarw has quit IRC | 18:41 | |
| *** moguimar has quit IRC | 18:42 | |
| *** moguimar has joined #openstack-oslo | 18:46 | |
| *** hberaud is now known as hberaud|gone | 18:49 | |
| *** moguimar has quit IRC | 18:51 | |
| *** openstackgerrit has quit IRC | 18:51 | |
| *** moguimar has joined #openstack-oslo | 18:55 | |
| *** moguimar has quit IRC | 18:59 | |
| *** moguimar has joined #openstack-oslo | 19:04 | |
| *** moguimar has quit IRC | 19:09 | |
| *** moguimar has joined #openstack-oslo | 19:13 | |
| *** moguimar has quit IRC | 19:18 | |
| *** moguimar has joined #openstack-oslo | 19:22 | |
| *** moguimar has quit IRC | 19:28 | |
| *** moguimar has joined #openstack-oslo | 19:32 | |
| *** moguimar has quit IRC | 19:36 | |
| *** moguimar has joined #openstack-oslo | 19:41 | |
| *** e0ne has joined #openstack-oslo | 19:41 | |
| *** moguimar has quit IRC | 19:45 | |
| *** zaneb has joined #openstack-oslo | 19:48 | |
| *** moguimar has joined #openstack-oslo | 19:50 | |
| *** moguimar has quit IRC | 19:55 | |
| *** moguimar has joined #openstack-oslo | 19:59 | |
| *** moguimar has quit IRC | 20:04 | |
| *** e0ne has quit IRC | 20:08 | |
| *** moguimar has joined #openstack-oslo | 20:08 | |
| *** moguimar has quit IRC | 20:12 | |
| *** moguimar has joined #openstack-oslo | 20:17 | |
| *** moguimar has quit IRC | 20:23 | |
| *** moguimar has joined #openstack-oslo | 20:28 | |
| *** moguimar has quit IRC | 20:33 | |
| *** moguimar has joined #openstack-oslo | 20:37 | |
| *** dmellado has quit IRC | 20:39 | |
| *** moguimar has quit IRC | 20:42 | |
| *** moguimar has joined #openstack-oslo | 20:46 | |
| *** moguimar has quit IRC | 20:51 | |
| *** moguimar has joined #openstack-oslo | 20:55 | |
| *** moguimar has quit IRC | 21:00 | |
| *** moguimar has joined #openstack-oslo | 21:04 | |
| *** moguimar has quit IRC | 21:09 | |
| *** moguimar has joined #openstack-oslo | 21:14 | |
| *** moguimar has quit IRC | 21:18 | |
| *** moguimar has joined #openstack-oslo | 21:23 | |
| *** raildo has quit IRC | 21:26 | |
| *** moguimar has quit IRC | 21:28 | |
| *** openstackgerrit has joined #openstack-oslo | 21:31 | |
| openstackgerrit | Merged openstack/oslo.service master: Profile Oslo Service processes https://review.openstack.org/627414 | 21:31 |
| *** moguimar has joined #openstack-oslo | 21:32 | |
| *** e0ne has joined #openstack-oslo | 21:34 | |
| *** moguimar has quit IRC | 21:36 | |
| *** e0ne has quit IRC | 21:41 | |
| *** moguimar has joined #openstack-oslo | 21:41 | |
| *** dmellado has joined #openstack-oslo | 21:43 | |
| *** moguimar has quit IRC | 21:45 | |
| *** harlowja has joined #openstack-oslo | 21:46 | |
| *** harlowja has quit IRC | 21:47 | |
| *** moguimar has joined #openstack-oslo | 21:50 | |
| *** moguimar has quit IRC | 21:54 | |
| *** moguimar has joined #openstack-oslo | 21:59 | |
| *** moguimar has quit IRC | 22:04 | |
| *** moguimar has joined #openstack-oslo | 22:08 | |
| *** moguimar has quit IRC | 22:13 | |
| *** moguimar has joined #openstack-oslo | 22:17 | |
| *** moguimar has quit IRC | 22:22 | |
| *** moguimar has joined #openstack-oslo | 22:26 | |
| *** moguimar has quit IRC | 22:31 | |
| *** moguimar has joined #openstack-oslo | 22:35 | |
| *** moguimar has quit IRC | 22:40 | |
| *** moguimar has joined #openstack-oslo | 22:44 | |
| *** moguimar has quit IRC | 22:51 | |
| *** stephenfin_ has joined #openstack-oslo | 23:45 | |
| *** rha has quit IRC | 23:46 | |
| *** stephenfin has quit IRC | 23:46 | |
| *** coreycb has quit IRC | 23:46 | |
| *** purplerbot has quit IRC | 23:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!