| *** dougbtv_ has quit IRC | 00:05 | |
| *** salv-orlando has quit IRC | 00:07 | |
| *** salv-orlando has joined #openstack-kuryr | 00:08 | |
| *** salv-orl_ has joined #openstack-kuryr | 01:07 | |
| *** salv-orlando has quit IRC | 01:10 | |
| *** atoth has quit IRC | 01:12 | |
| *** phuoc_ has joined #openstack-kuryr | 01:12 | |
| *** hongbin has joined #openstack-kuryr | 01:26 | |
| *** wangbo has joined #openstack-kuryr | 01:39 | |
| *** limao has joined #openstack-kuryr | 01:59 | |
| *** caowei has joined #openstack-kuryr | 02:02 | |
| *** kiennt26 has joined #openstack-kuryr | 02:08 | |
| *** c00281451 has joined #openstack-kuryr | 02:22 | |
| *** salv-orl_ has quit IRC | 02:25 | |
| *** salv-orlando has joined #openstack-kuryr | 02:25 | |
| *** c00281451_ has quit IRC | 02:25 | |
| *** ivc_ has quit IRC | 02:29 | |
| *** ivc_ has joined #openstack-kuryr | 02:40 | |
| *** salv-orlando has quit IRC | 02:43 | |
| *** salv-orlando has joined #openstack-kuryr | 02:44 | |
| *** wangbo has quit IRC | 02:58 | |
| *** wangbo has joined #openstack-kuryr | 03:00 | |
| *** wangbo has quit IRC | 03:07 | |
| *** aojea has joined #openstack-kuryr | 03:15 | |
| *** aojea has quit IRC | 03:19 | |
| *** wangbo has joined #openstack-kuryr | 03:20 | |
| *** wangbo has quit IRC | 03:27 | |
| *** wangbo has joined #openstack-kuryr | 03:35 | |
| *** wangbo has quit IRC | 03:36 | |
| *** wangbo has joined #openstack-kuryr | 03:41 | |
| *** wangbo has quit IRC | 03:46 | |
| *** wangbo has joined #openstack-kuryr | 03:51 | |
| *** wangbo has quit IRC | 03:54 | |
| *** wangbo has joined #openstack-kuryr | 03:57 | |
| *** limao has quit IRC | 04:10 | |
| *** hongbin has quit IRC | 04:12 | |
| *** yamamoto has joined #openstack-kuryr | 04:16 | |
| *** limao has joined #openstack-kuryr | 04:18 | |
| *** pmannidi has joined #openstack-kuryr | 04:21 | |
| *** janki has joined #openstack-kuryr | 04:22 | |
| *** limao has quit IRC | 04:23 | |
| *** limao has joined #openstack-kuryr | 05:01 | |
| *** yboaron__ has joined #openstack-kuryr | 05:17 | |
| *** yboaron__ has quit IRC | 05:38 | |
| *** phuoc_ has quit IRC | 06:17 | |
| *** yamamoto has quit IRC | 06:33 | |
| *** yamamoto has joined #openstack-kuryr | 06:52 | |
| *** pcaruana has joined #openstack-kuryr | 07:00 | |
| *** yamamoto_ has joined #openstack-kuryr | 07:11 | |
| *** yamamoto has quit IRC | 07:13 | |
| *** aojea has joined #openstack-kuryr | 07:16 | |
| *** aojea has quit IRC | 07:20 | |
| *** karimb has joined #openstack-kuryr | 07:21 | |
| *** yamamoto_ has quit IRC | 07:29 | |
| *** yamamoto has joined #openstack-kuryr | 07:29 | |
| *** yamamoto has quit IRC | 07:43 | |
| *** salv-orlando has quit IRC | 07:50 | |
| *** salv-orlando has joined #openstack-kuryr | 07:50 | |
| *** salv-orl_ has joined #openstack-kuryr | 07:55 | |
| *** yamamoto has joined #openstack-kuryr | 07:57 | |
| *** salv-orlando has quit IRC | 07:58 | |
| *** wangbo has joined #openstack-kuryr | 07:59 | |
| *** wangbo has quit IRC | 08:02 | |
| *** yamamoto has quit IRC | 08:03 | |
| *** edisonxiang has joined #openstack-kuryr | 08:07 | |
| *** limao has quit IRC | 08:08 | |
| *** limao has joined #openstack-kuryr | 08:10 | |
| *** limao has quit IRC | 08:10 | |
| *** limao has joined #openstack-kuryr | 08:10 | |
| *** wangbo has joined #openstack-kuryr | 08:13 | |
| *** wangbo has quit IRC | 08:18 | |
| *** pmannidi is now known as pmannidi|AFK | 08:20 | |
| *** wangbo has joined #openstack-kuryr | 08:21 | |
| *** garyloug has joined #openstack-kuryr | 08:26 | |
| *** yamamoto has joined #openstack-kuryr | 08:36 | |
| *** wangbo has quit IRC | 08:38 | |
| *** yamamoto has quit IRC | 08:38 | |
| *** wangbo has joined #openstack-kuryr | 08:39 | |
| *** limao has quit IRC | 08:45 | |
| *** yamamoto has joined #openstack-kuryr | 08:50 | |
| *** edisonxiang_ has joined #openstack-kuryr | 08:58 | |
| *** edisonxiang has quit IRC | 09:01 | |
| *** yamamoto has quit IRC | 09:03 | |
| *** edisonxiang_ is now known as edisonxiang | 09:06 | |
| *** yamamoto has joined #openstack-kuryr | 09:13 | |
| *** janki has quit IRC | 09:21 | |
| *** salv-orl_ has quit IRC | 09:36 | |
| *** salv-orlando has joined #openstack-kuryr | 09:37 | |
| *** salv-orlando has quit IRC | 09:41 | |
| *** yamamoto has quit IRC | 09:58 | |
| *** yamamoto has joined #openstack-kuryr | 09:59 | |
| *** kiennt26 has quit IRC | 10:05 | |
| *** yamamoto has quit IRC | 10:06 | |
| *** yamamoto has joined #openstack-kuryr | 10:06 | |
| *** wangbo has quit IRC | 10:12 | |
| *** aojea has joined #openstack-kuryr | 10:16 | |
| *** aojea has quit IRC | 10:20 | |
| *** caowei has quit IRC | 10:20 | |
| *** yamamoto_ has joined #openstack-kuryr | 10:37 | |
| *** janki has joined #openstack-kuryr | 10:40 | |
| *** yamamoto has quit IRC | 10:40 | |
| *** yamamoto_ has quit IRC | 10:48 | |
| *** yamamoto has joined #openstack-kuryr | 10:50 | |
| *** yamamoto has quit IRC | 10:55 | |
| *** yamamoto has joined #openstack-kuryr | 10:55 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 11:01 |
|---|---|---|
| *** atoth has joined #openstack-kuryr | 11:02 | |
| *** atoth has quit IRC | 11:07 | |
| *** atoth has joined #openstack-kuryr | 11:07 | |
| *** wangbo has joined #openstack-kuryr | 11:17 | |
| *** yamamoto_ has joined #openstack-kuryr | 11:30 | |
| *** yamamoto_ has quit IRC | 11:31 | |
| *** yamamoto has quit IRC | 11:32 | |
| *** yamamoto has joined #openstack-kuryr | 11:32 | |
| *** edisonxiang has quit IRC | 11:33 | |
| *** edisonxiang has joined #openstack-kuryr | 11:34 | |
| *** janki has quit IRC | 11:44 | |
| *** yamamoto has quit IRC | 11:52 | |
| *** yamamoto has joined #openstack-kuryr | 11:53 | |
| *** yamamoto has quit IRC | 11:58 | |
| *** c00281451_ has joined #openstack-kuryr | 12:01 | |
| *** c00281451 has quit IRC | 12:04 | |
| *** salv-orlando has joined #openstack-kuryr | 12:04 | |
| *** c00281451__ has joined #openstack-kuryr | 12:24 | |
| *** c00281451_ has quit IRC | 12:28 | |
| *** yamamoto has joined #openstack-kuryr | 12:36 | |
| *** c00281451__ has quit IRC | 12:40 | |
| *** pcaruana has quit IRC | 12:41 | |
| *** c00281451__ has joined #openstack-kuryr | 12:41 | |
| *** yamamoto has quit IRC | 12:46 | |
| *** wangbo has quit IRC | 12:54 | |
| *** pcaruana has joined #openstack-kuryr | 12:57 | |
| *** wangbo has joined #openstack-kuryr | 12:59 | |
| *** pcaruana has quit IRC | 13:01 | |
| *** yamamoto has joined #openstack-kuryr | 13:02 | |
| *** wangbo has quit IRC | 13:13 | |
| *** salv-orl_ has joined #openstack-kuryr | 13:15 | |
| *** salv-orlando has quit IRC | 13:16 | |
| *** salv-orl_ has quit IRC | 13:17 | |
| *** salv-orlando has joined #openstack-kuryr | 13:18 | |
| *** edisonxiang has quit IRC | 13:43 | |
| *** c00281451__ has quit IRC | 13:43 | |
| *** salv-orl_ has joined #openstack-kuryr | 13:44 | |
| *** salv-orlando has quit IRC | 13:45 | |
| *** hongbin has joined #openstack-kuryr | 13:56 | |
| dulek | Meeting time? | 14:00 |
| *** gouthamr has joined #openstack-kuryr | 14:20 | |
| *** salv-orl_ has quit IRC | 14:20 | |
| *** salv-orlando has joined #openstack-kuryr | 14:20 | |
| openstackgerrit | Merged openstack/kuryr-kubernetes master: Fix KeyError exception upon service/deployment deletion https://review.openstack.org/512636 | 14:29 |
| janonymous | dulek: hey! you got everything covered about cni daemon? anything i can look into :D | 14:40 |
| dulek | janonymous: Logging, unit tests and docs are done. I've struggled last week with bug irenab's found. | 14:41 |
| janonymous | dulek: which bug? netlink? | 14:41 |
| dulek | janonymous: It was related to SocketServer+ThreadingMixIn - looks like using those two make server unable to answer multiple requests. | 14:42 |
| dulek | janonymous: Netlink was caused by this first issue - netlink was happening when some requests were partially processed and CNI retried doing ADD operation., | 14:42 |
| dulek | (at least I think it was that). | 14:42 |
| janonymous | dulek: have you got a chance to find out why's that ? | 14:43 |
| janonymous | socketserver + threadmixing | 14:43 |
| dulek | janonymous: I don't know why it happened, but I've fixed that by switching to BaseHTTPServer and using normal networking socket instead of unix socket. | 14:43 |
| janonymous | any comments related to that? | 14:44 |
| dulek | janonymous: apuimedo suggests using some real WSGI server instead. And I think we'll be forced to go that route. | 14:44 |
| janonymous | i cannot find comments on the patch about socketserver + threadmixing | 14:45 |
| dulek | janonymous: Ah, right, because irenab just mentioned it on IRC. | 14:45 |
| dulek | janonymous: Starts here: http://eavesdrop.openstack.org/irclogs/%23openstack-kuryr/%23openstack-kuryr.2017-10-17.log.html#t2017-10-17T08:35:42 | 14:46 |
| janonymous | thanks | 14:46 |
| dulek | I was investigating that through all the day - so you can see my later discussions as well. | 14:46 |
| janonymous | this was netlink error | 14:46 |
| dulek | janonymous: Yes, but it happened because of lost requests: | 14:47 |
| dulek | 1. Multiple requests are sent to kuryr-daemon. | 14:47 |
| *** garyloug has quit IRC | 14:47 | |
| dulek | 2. Kuryr daemon does respond only to one (caused by ThreadingMixIn, I don't know exactly why). | 14:47 |
| janonymous | threadmixing should ideally handle that.. | 14:48 |
| dulek | 3. But all the requests are fulfilled - i.e. ports are wired. | 14:48 |
| janonymous | is it stuck on response? | 14:48 |
| dulek | 4. CNI doesn't get a response for one pod, so it retries. | 14:48 |
| dulek | 5. CNI daemon tries to wire the pod again and fails with EEXIST (this netlink error)> | 14:48 |
| janonymous | strange, but why does cni does not gets response? | 14:49 |
| janonymous | timeout? | 14:49 |
| dulek | janonymous: No, just response were lost sometimes. | 14:49 |
| dulek | janonymous: I was surprised as well and I wasn't been able to find the root cause. | 14:49 |
| janonymous | lost.. | 14:50 |
| janonymous | seems a strange behaviour, i will check that too | 14:50 |
| dulek | janonymous: If you'll be able to debug it - it'll be cool.l | 14:51 |
| dulek | Patchset #31 has the issue. | 14:51 |
| janonymous | i'm just afraid that eventlet is not coming in the way.... because of pyroute | 14:51 |
| janonymous | it spawns a new process, and might be a case there.. | 14:52 |
| *** garyloug has joined #openstack-kuryr | 14:52 | |
| janonymous | but will try to reproduce the issue and check | 14:52 |
| dulek | janonymous: Great! | 14:54 |
| dmellado | Folks, lost the meeting | 15:07 |
| dmellado | But disregard Jenkins | 15:07 |
| dmellado | There's only zuul xD | 15:07 |
| *** kiennt26 has joined #openstack-kuryr | 15:17 | |
| *** salv-orlando has quit IRC | 15:19 | |
| *** salv-orlando has joined #openstack-kuryr | 15:20 | |
| *** kiennt26 has quit IRC | 16:12 | |
| *** garyloug has quit IRC | 16:37 | |
| *** salv-orlando has quit IRC | 17:09 | |
| *** salv-orlando has joined #openstack-kuryr | 17:10 | |
| *** salv-orlando has quit IRC | 17:14 | |
| *** aojea has joined #openstack-kuryr | 18:24 | |
| *** jgriffith has quit IRC | 18:51 | |
| *** jgriffith_ has joined #openstack-kuryr | 18:52 | |
| *** jgriffith_ has quit IRC | 19:06 | |
| *** aojea has quit IRC | 19:16 | |
| *** atoth has quit IRC | 19:17 | |
| *** aojea has joined #openstack-kuryr | 19:31 | |
| *** aojea has quit IRC | 19:33 | |
| *** aojea has joined #openstack-kuryr | 19:34 | |
| *** aojea has quit IRC | 19:43 | |
| *** karimb has quit IRC | 19:52 | |
| *** salv-orlando has joined #openstack-kuryr | 20:33 | |
| *** salv-orlando has quit IRC | 20:37 | |
| *** salv-orlando has joined #openstack-kuryr | 20:37 | |
| *** pmannidi|AFK has quit IRC | 22:06 | |
| *** pmannidi has joined #openstack-kuryr | 22:31 | |
| *** salv-orlando has quit IRC | 22:34 | |
| *** salv-orlando has joined #openstack-kuryr | 22:34 | |
| *** salv-orlando has quit IRC | 22:39 | |
| *** c00281451 has joined #openstack-kuryr | 22:53 | |
| *** janki has joined #openstack-kuryr | 22:57 | |
| *** c00281451 has quit IRC | 22:58 | |
| *** janki has quit IRC | 23:02 | |
| *** jgriffith has joined #openstack-kuryr | 23:08 | |
| *** hongbin has quit IRC | 23:39 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!