| *** yamamoto has joined #openstack-kuryr | 00:05 | |
| *** gouthamr has joined #openstack-kuryr | 00:19 | |
| *** kiennt26 has joined #openstack-kuryr | 00:40 | |
| *** salv-orlando has joined #openstack-kuryr | 00:43 | |
| *** limao has joined #openstack-kuryr | 00:44 | |
| *** limao has quit IRC | 00:44 | |
| *** limao has joined #openstack-kuryr | 00:44 | |
| *** salv-orlando has quit IRC | 00:47 | |
| *** salv-orlando has joined #openstack-kuryr | 01:44 | |
| *** salv-orlando has quit IRC | 01:49 | |
| *** hongbin has joined #openstack-kuryr | 01:54 | |
| *** wangbo has joined #openstack-kuryr | 01:57 | |
| *** wangbo has quit IRC | 01:59 | |
| *** wangbo has joined #openstack-kuryr | 02:00 | |
| *** caowei has joined #openstack-kuryr | 02:13 | |
| *** salv-orlando has joined #openstack-kuryr | 02:45 | |
| *** salv-orlando has quit IRC | 02:49 | |
| *** gouthamr has quit IRC | 02:57 | |
| *** c00281451 has joined #openstack-kuryr | 03:28 | |
| *** c00281451 is now known as zengchen | 03:28 | |
| *** hongbin has quit IRC | 03:43 | |
| *** jgriffith_ has joined #openstack-kuryr | 03:44 | |
| *** salv-orlando has joined #openstack-kuryr | 03:46 | |
| *** jgriffith_ is now known as jgriffith | 03:47 | |
| *** salv-orlando has quit IRC | 03:50 | |
| *** kiennt26 has quit IRC | 04:46 | |
| *** salv-orlando has joined #openstack-kuryr | 04:47 | |
| *** wangbo has quit IRC | 04:51 | |
| *** salv-orlando has quit IRC | 04:51 | |
| *** aojea has joined #openstack-kuryr | 04:53 | |
| *** aojea has quit IRC | 04:57 | |
| *** salv-orlando has joined #openstack-kuryr | 05:03 | |
| *** c00281451_ has joined #openstack-kuryr | 05:09 | |
| *** zengchen has quit IRC | 05:13 | |
| *** jdavis has joined #openstack-kuryr | 05:22 | |
| *** jdavis has quit IRC | 05:27 | |
| *** wangbo has joined #openstack-kuryr | 05:32 | |
| *** irenab has joined #openstack-kuryr | 05:43 | |
| *** wangbo has quit IRC | 05:55 | |
| *** wangbo has joined #openstack-kuryr | 05:56 | |
| *** limao has quit IRC | 06:24 | |
| *** salv-orlando has quit IRC | 06:26 | |
| *** limao has joined #openstack-kuryr | 06:26 | |
| *** salv-orlando has joined #openstack-kuryr | 06:26 | |
| *** salv-orlando has quit IRC | 06:30 | |
| *** kiennt26 has joined #openstack-kuryr | 06:51 | |
| *** pcaruana has joined #openstack-kuryr | 06:55 | |
| *** karimb has joined #openstack-kuryr | 07:10 | |
| *** yboaron_ has joined #openstack-kuryr | 07:20 | |
| *** salv-orlando has joined #openstack-kuryr | 07:26 | |
| *** salv-orlando has quit IRC | 07:31 | |
| *** salv-orlando has joined #openstack-kuryr | 07:42 | |
| *** garyloug has joined #openstack-kuryr | 08:21 | |
| *** yamamoto has quit IRC | 08:32 | |
| *** aojea has joined #openstack-kuryr | 08:59 | |
| *** aojea has quit IRC | 09:03 | |
| *** wangbo has quit IRC | 09:08 | |
| *** openstackgerrit has joined #openstack-kuryr | 09:09 | |
| openstackgerrit | Merged openstack/kuryr-kubernetes master: Update dragonflow devstack local.conf https://review.openstack.org/512232 | 09:09 |
|---|---|---|
| *** wangbo has joined #openstack-kuryr | 09:10 | |
| *** yamamoto has joined #openstack-kuryr | 09:13 | |
| *** salv-orlando has quit IRC | 09:21 | |
| *** salv-orlando has joined #openstack-kuryr | 09:22 | |
| openstackgerrit | Merged openstack/kuryr-kubernetes master: Fix ports pool documentation https://review.openstack.org/512495 | 09:25 |
| *** salv-orlando has quit IRC | 09:27 | |
| openstackgerrit | Merged openstack/kuryr-kubernetes master: Eliminate wrong ERROR report when service of type LoadBalancer type is deleted https://review.openstack.org/512670 | 09:36 |
| *** limao has quit IRC | 09:49 | |
| *** yamamoto has quit IRC | 09:49 | |
| *** limao has joined #openstack-kuryr | 09:50 | |
| *** limao has quit IRC | 09:52 | |
| *** limao has joined #openstack-kuryr | 09:53 | |
| *** limao has quit IRC | 09:54 | |
| *** limao has joined #openstack-kuryr | 09:55 | |
| *** limao has quit IRC | 09:59 | |
| *** wangbo has quit IRC | 10:04 | |
| *** kiennt26 has quit IRC | 10:04 | |
| *** lihi has quit IRC | 10:20 | |
| *** lihi has joined #openstack-kuryr | 10:20 | |
| *** salv-orlando has joined #openstack-kuryr | 10:21 | |
| *** caowei has quit IRC | 10:34 | |
| *** wangbo has joined #openstack-kuryr | 10:48 | |
| *** yamamoto has joined #openstack-kuryr | 10:50 | |
| *** yamamoto has quit IRC | 10:53 | |
| *** yamamoto has joined #openstack-kuryr | 10:53 | |
| *** yamamoto has quit IRC | 10:53 | |
| dulek | apuimedo: I think I'm observing another anomaly. | 10:55 |
| dulek | apuimedo: https://github.com/openstack/kuryr-kubernetes/blob/f2f695ad105e4298f10af490b7ed21d875d41fec/kuryr_kubernetes/cni/handlers.py#L80-L82 | 10:55 |
| dulek | apuimedo: This is just checking if VIF is active on WATCH event. What if it wasn't and no more events will get fired? The watcher thread will just hang. | 10:56 |
| *** limao has joined #openstack-kuryr | 10:58 | |
| *** limao has quit IRC | 10:58 | |
| *** limao has joined #openstack-kuryr | 10:58 | |
| *** yamamoto has joined #openstack-kuryr | 11:02 | |
| *** jdavis has joined #openstack-kuryr | 11:11 | |
| *** wangbo has quit IRC | 11:39 | |
| *** wangbo has joined #openstack-kuryr | 11:39 | |
| *** salv-orlando has quit IRC | 11:54 | |
| openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: CNI split - introducing CNI daemon https://review.openstack.org/480028 | 12:06 |
| openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: Add error handling and logging to CNI daemon https://review.openstack.org/511518 | 12:06 |
| openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: DNM: Trying to run gate tests with CNI Daemon https://review.openstack.org/509765 | 12:08 |
| openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: CNI Daemon documentation https://review.openstack.org/509380 | 12:08 |
| *** salv-orlando has joined #openstack-kuryr | 12:15 | |
| *** phuoc_ has quit IRC | 12:19 | |
| irenab | dulek, what was the issue with ipdb binging? | 12:22 |
| irenab | binding | 12:23 |
| dulek | irenab: IPDB object doesn't like to be used by multiple threads. | 12:23 |
| dulek | irenab: And previously we were caching them. Which isn't a bad thing in case of single-threaded CNI-process, but fails in case of multi-threaded CNI daemon. | 12:24 |
| irenab | dulek, got it. Thanks! | 12:25 |
| dulek | irenab: Besides - we've had a timeout issue (now I think SocketServer.ThreadingMixIn doesn't go well with BaseHTTPServer.HTTPServer) | 12:25 |
| dulek | irenab: And this uncovered the fact that connect operation isn't idempotent. | 12:25 |
| dulek | irenab: I've tried to fix that by adding this try-except block in binding.base, but I'll need to investigate that a bit more. | 12:26 |
| irenab | dulek, how stable is the implementation kuryr have now ? | 12:27 |
| dulek | irenab: In case of CNI timeout kubelet will retry the call and that will fail on master as well. | 12:28 |
| dulek | irenab: apuimedo and ltomasbo experienced that when doing scale testing. | 12:28 |
| dulek | irenab: I guess I need to file a bug. :) | 12:28 |
| irenab | dulek, eventually pod is up or stuck in failed state? | 12:29 |
| dulek | irenab: I think that eventually CNI calls start to fail, so kubelet sets itself into NotReady state. | 12:29 |
| irenab | dulek, yes :-) doesn't seem trivial | 12:29 |
| dulek | irenab: At least that's what we've experienced. | 12:29 |
| apuimedo | dulek: "I think I'm observing another anomaly." | 12:30 |
| apuimedo | This sounds like the beginning of a Star Trek episode :-) | 12:30 |
| dulek | apuimedo: :D | 12:30 |
| dulek | apuimedo: I think that was false alarm. | 12:31 |
| dulek | apuimedo: It might have been related to that broken SocketServer.ThreadingMixIn. It causes requests are not getting answered, just the first. Deadlock probably. | 12:32 |
| *** yboaron__ has joined #openstack-kuryr | 12:32 | |
| apuimedo | dulek: regarding the socketserver... Did you try running it in a socket file based on a uwsgi or something? | 12:33 |
| dulek | apuimedo: Nope, I've only experimented with those Python builtins. | 12:33 |
| apuimedo | those are trash | 12:34 |
| apuimedo | :-) | 12:34 |
| apuimedo | we experienced that with kuryr-libnetwork | 12:34 |
| dulek | … | 12:34 |
| *** yboaron_ has quit IRC | 12:34 | |
| irenab | apuimedo, experienced what? | 12:34 |
| apuimedo | dulek: in the kuryr-libnetwork case, the performance was much better when using uwsgi in threaded config than with the default flask server | 12:35 |
| apuimedo | It's not what we're using now though | 12:35 |
| apuimedo | so it's not apples to apples | 12:35 |
| apuimedo | but yeah, the builtin is probably not production ready | 12:35 |
| apuimedo | more of an example | 12:35 |
| irenab | dulek, I think you can mark https://review.openstack.org/#/c/508106/ as abandoned | 12:36 |
| dulek | irenab: Please go on, I can't as I'm not the owner of the patch. | 12:36 |
| irenab | dulek, sure, will do | 12:36 |
| dulek | irenab: Thanks! | 12:36 |
| openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: CNI split - introducing CNI daemon https://review.openstack.org/480028 | 12:55 |
| openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: Add error handling and logging to CNI daemon https://review.openstack.org/511518 | 12:55 |
| *** atoth has joined #openstack-kuryr | 12:56 | |
| openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: CNI Daemon documentation https://review.openstack.org/509380 | 12:56 |
| openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: DNM: Trying to run gate tests with CNI Daemon https://review.openstack.org/509765 | 12:56 |
| *** jdavis has quit IRC | 13:06 | |
| *** yboaron__ has quit IRC | 13:06 | |
| *** yboaron__ has joined #openstack-kuryr | 13:29 | |
| *** wangbo has quit IRC | 13:44 | |
| *** hongbin has joined #openstack-kuryr | 14:03 | |
| *** limao has quit IRC | 14:07 | |
| *** limao has joined #openstack-kuryr | 14:14 | |
| *** limao has quit IRC | 14:15 | |
| *** gouthamr has joined #openstack-kuryr | 14:20 | |
| openstackgerrit | Yossi Boaron proposed openstack/kuryr-kubernetes master: Fix KeyError exception upon service/deployment deletion https://review.openstack.org/512636 | 14:28 |
| *** aojea has joined #openstack-kuryr | 14:39 | |
| *** yamamoto has quit IRC | 14:54 | |
| *** limao has joined #openstack-kuryr | 15:32 | |
| *** limao_ has joined #openstack-kuryr | 15:37 | |
| *** limao has quit IRC | 15:38 | |
| *** yboaron__ has quit IRC | 15:41 | |
| *** yamamoto has joined #openstack-kuryr | 15:55 | |
| *** jgriffith is now known as groot | 16:03 | |
| *** groot is now known as jgriffith | 16:04 | |
| *** jgriffith is now known as groot | 16:05 | |
| *** yamamoto has quit IRC | 16:11 | |
| *** salv-orl_ has joined #openstack-kuryr | 16:11 | |
| *** salv-orlando has quit IRC | 16:14 | |
| *** pcaruana has quit IRC | 16:18 | |
| *** aojea has quit IRC | 16:29 | |
| *** kiennt26 has joined #openstack-kuryr | 16:35 | |
| *** yamamoto has joined #openstack-kuryr | 16:39 | |
| *** limao_ has quit IRC | 16:47 | |
| *** yamamoto has quit IRC | 16:53 | |
| *** aojea has joined #openstack-kuryr | 16:59 | |
| *** garyloug has quit IRC | 17:05 | |
| *** aojea has quit IRC | 17:14 | |
| *** aojea has joined #openstack-kuryr | 17:14 | |
| *** aojea has quit IRC | 17:15 | |
| *** aojea has joined #openstack-kuryr | 17:15 | |
| *** aojea has joined #openstack-kuryr | 17:16 | |
| *** aojea has quit IRC | 17:19 | |
| *** salv-orlando has joined #openstack-kuryr | 17:25 | |
| *** salv-orl_ has quit IRC | 17:29 | |
| *** salv-orlando has quit IRC | 17:30 | |
| *** kiennt26 has quit IRC | 17:38 | |
| *** groot is now known as jgriffith | 17:38 | |
| *** ivc_ has quit IRC | 17:43 | |
| *** deepika has quit IRC | 17:43 | |
| *** nhlfr has quit IRC | 17:43 | |
| *** kzaitsev_pi has quit IRC | 17:44 | |
| *** kzaitsev_pi has joined #openstack-kuryr | 17:45 | |
| *** ivc_ has joined #openstack-kuryr | 17:48 | |
| *** c00281451_ has quit IRC | 18:13 | |
| *** c00281451_ has joined #openstack-kuryr | 18:13 | |
| *** salv-orlando has joined #openstack-kuryr | 19:05 | |
| *** jdavis has joined #openstack-kuryr | 19:05 | |
| *** salv-orl_ has joined #openstack-kuryr | 19:46 | |
| *** salv-orlando has quit IRC | 19:49 | |
| *** aojea has joined #openstack-kuryr | 20:50 | |
| *** aojea has quit IRC | 21:08 | |
| *** gouthamr has quit IRC | 21:15 | |
| *** hongbin has quit IRC | 21:38 | |
| *** yamamoto has joined #openstack-kuryr | 21:50 | |
| *** deepika has joined #openstack-kuryr | 21:58 | |
| *** deepika is now known as Guest38590 | 21:58 | |
| *** jdavis has quit IRC | 22:04 | |
| *** nhlfr has joined #openstack-kuryr | 22:06 | |
| *** jdavis has joined #openstack-kuryr | 22:25 | |
| *** jdavis has quit IRC | 23:26 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!