Thursday, 2017-07-13

*** limao has joined #openstack-kuryr00:26
*** ivc has quit IRC00:31
*** ivc has joined #openstack-kuryr00:36
*** rwallner has joined #openstack-kuryr00:39
*** kiennt has joined #openstack-kuryr00:47
*** gouthamr has quit IRC01:05
*** yedongcan has joined #openstack-kuryr01:21
*** rwallner has quit IRC01:25
*** hongbin has joined #openstack-kuryr01:59
*** wangbo has joined #openstack-kuryr02:19
*** hongbin_ has joined #openstack-kuryr02:37
*** hongbin has quit IRC02:39
hongbin_limao: hi liping02:44
*** yedongcan has quit IRC02:48
*** aojea has joined #openstack-kuryr02:53
*** aojea has quit IRC02:58
*** hongbin_ has quit IRC03:16
*** limao has quit IRC03:16
*** limao has joined #openstack-kuryr03:16
*** limao has quit IRC03:19
*** limao has joined #openstack-kuryr03:19
*** hongbin has joined #openstack-kuryr03:32
*** hongbin has quit IRC03:41
*** limao has quit IRC03:59
*** limao has joined #openstack-kuryr04:00
*** limao has quit IRC04:04
*** limao has joined #openstack-kuryr04:31
*** limao has quit IRC04:36
*** wangbo has quit IRC04:37
*** limao has joined #openstack-kuryr04:51
*** limao has quit IRC05:06
*** limao has joined #openstack-kuryr05:07
limaohongbin_: sorry for the delay, I update in launchpad : https://bugs.launchpad.net/kuryr-libnetwork/+bug/170369805:24
openstackLaunchpad bug 1703698 in kuryr-libnetwork "Couldn't get docker plugin to work" [Undecided,New]05:24
*** aojea has joined #openstack-kuryr05:28
*** wangbo has joined #openstack-kuryr05:28
*** gouthamr has joined #openstack-kuryr05:34
*** kiennt has quit IRC05:50
*** aojea has quit IRC05:53
*** kiennt has joined #openstack-kuryr05:58
*** yedongcan has joined #openstack-kuryr06:00
*** wangbo has quit IRC06:11
*** wangbo has joined #openstack-kuryr06:13
*** yboaron_ has joined #openstack-kuryr06:15
*** limao has quit IRC06:28
*** limao has joined #openstack-kuryr06:29
*** limao has quit IRC06:33
*** yedongcan has left #openstack-kuryr06:43
*** limao has joined #openstack-kuryr06:46
*** wangbo has quit IRC06:47
*** kzaitsev_ws has joined #openstack-kuryr06:48
*** wangbo has joined #openstack-kuryr06:52
*** pcaruana has joined #openstack-kuryr06:52
*** yedongcan has joined #openstack-kuryr07:09
*** yedongcan has quit IRC07:10
*** yedongcan has joined #openstack-kuryr07:11
*** roeyc has joined #openstack-kuryr07:12
*** janki has joined #openstack-kuryr07:16
*** aojea has joined #openstack-kuryr07:17
*** gouthamr has quit IRC07:22
*** garyloug has joined #openstack-kuryr07:41
*** garyloug has quit IRC07:42
*** egonzalez has joined #openstack-kuryr07:47
openstackgerritKirill Zaitsev proposed openstack/kuryr-kubernetes master: Allow passing multiple VIFs to CNI  https://review.openstack.org/47101207:55
*** wangbo has quit IRC08:02
*** wangbo has joined #openstack-kuryr08:05
*** vikasc has quit IRC08:28
ltomasbohi apuimedo08:30
apuimedoltomasbo: hi08:31
ltomasbowhy do you create_k8s_router_fake_service in https://review.openstack.org/#/c/467241/8/devstack/plugin.sh?08:32
ltomasbowhy do you need08:32
apuimedoltomasbo: this is defensive programming :-)08:33
apuimedoImagine you create a lot of services08:33
apuimedowith each service you create, you increase the chance of K8s API deciding to use the IP/clusterIP of the router interface of the services network08:34
ltomasbobut it gets and IP in a different subnet08:36
apuimedoltomasbo: how so?08:36
apuimedoLet's say we have a deployment with three subnets08:36
ltomasboI see the k8s_service-subnet is 10.0.0.64/2608:36
ltomasboand the svc/kuberentes gets the 10.0.0.6508:37
ltomasbobut the svc/kuryr-svc-router gets the 10.0.0.12608:37
apuimedoVM subnet 10.0.0.0/24, pod subnet 10.10.0.0/24 and services subnet 10.20.0.0/2408:37
ltomasboahh, 126, not 12808:37
*** wangbo has quit IRC08:37
apuimedoright08:38
ltomasbonot in devstack08:38
ltomasbosubnet is 10.0.0.0/2608:38
ltomasbo and the service is 10.0.0.64/2608:38
apuimedopod subnet is 10.0.0.0/26 which means 10.0.0.1-10.0.0.6308:39
apuimedoand service subnet is 10.0.0.64/26 which means 10.0.0.64-10.0.0.12708:39
apuimedo127 is broadcast08:39
apuimedoso the router goes on 12608:40
apuimedowhich is what we tell to the fake service08:40
ltomasboyep, I missed 126 by 12808:40
ltomasbook, but the lbaas is complaining in the kuryr-kubernetes logs08:40
dmelladoabout a missing endpoint, actually08:40
ltomasboyep08:40
dmelladoso you're gonna end up without fuet, apuimedo08:41
*** vikasc has joined #openstack-kuryr08:41
*** wangbo has joined #openstack-kuryr08:44
*** garyloug has joined #openstack-kuryr08:45
apuimedoI know08:46
apuimedothat complaint is because we have a bug08:47
apuimedoI thought I already reported it08:47
apuimedowe don't support well endpointless services08:47
apuimedowhich are allowed in k8s08:47
ltomasbook, so that should be a modification to the lbaas support, right?08:48
kzaitsev_wsltomasbo: right, I can even point you to exact place in the code that does that08:50
ltomasbo:D08:52
ltomasboI'm taking a look...08:52
kzaitsev_wshttps://github.com/openstack/kuryr-kubernetes/blob/master/kuryr_kubernetes/controller/handlers/lbaas.py#L23008:52
apuimedoyup08:58
apuimedothe assumption that services have endpoints is wrong08:58
apuimedokzaitsev_ws: ltomasbo: maybe if we just check if the service lacks a selector as a basis to skip it08:59
*** limao has quit IRC09:12
ltomasboI quickly included this:09:12
*** limao has joined #openstack-kuryr09:12
ltomasbo  230     def _should_ignore(self, endpoints, lbaas_spec):09:12
ltomasbo  231         return not(lbaas_spec and09:12
ltomasbo  232                    self._has_pods(endpoints) and09:12
ltomasbo~ 233                    self._is_lbaas_spec_in_sync(endpoints, lbaas_spec) and09:12
ltomasbo+ 234                    endpoints['metadata']['name'] != 'kuryr-svc-router')09:12
dmelladooh, kzaitsev_ws so ltomasbo was cheating when he showed me xD09:12
*** limao has quit IRC09:14
*** limao has joined #openstack-kuryr09:14
*** huats has joined #openstack-kuryr09:15
apuimedodmellado: when he showed you what?09:17
dmelladoapuimedo: kzaitsev_ws's link09:17
apuimedoltomasbo: that's too specific09:17
dmelladodon't think bad xD09:17
ltomasbojust testing if it fix the problem09:18
dmelladoapuimedo: btw, will tell you afterwards but I was thinking about having some kind of code walk-through sessions for new contributors09:18
dmelladorecorded and so on09:18
*** vikasc has quit IRC09:18
dmelladoand I was wondering if you had something like that already09:18
dmelladothere's an 'upcoming' guy who I'd really like to attend09:18
dmelladoI'd do the same for the tempest plugin09:18
apuimedodmellado: we don't09:19
apuimedobut it is a nice idea09:19
kzaitsev_wsI managed to have lbaas for podless services some time ago09:19
apuimedokzaitsev_ws: you don't need lbaas for podless services, do you?09:21
kzaitsev_wsI can dig out the patch, but it should be rather easy to replicate that anywat09:21
dmelladokzaitsev_ws: would you be up also for that session? I'll be having a to-be-mentored guy joining soon xD09:21
kzaitsev_wsapuimedo: well I wanted kubernetes service to be handled correctly =)09:22
kzaitsev_wsbut in the end it turned out I did not need that =)09:23
kzaitsev_wsdmellado: which session, where? =)09:23
apuimedoneed to move to a place with better internet09:23
apuimedodmellado: I'll join the meeting with you asap09:23
openstackgerritKirill Zaitsev proposed openstack/kuryr-kubernetes master: Add SR-IOV capabilities to VIF handler  https://review.openstack.org/46245509:24
dmelladokzaitsev_ws: we were thinking about hosting some sessions for code walk-thru for new contributors09:24
*** limao has quit IRC09:24
dmelladofor both kuryr-kubernetes and the testing part09:24
dmelladoapuimedo: ack, heading to the meeting room09:25
kzaitsev_wsdmellado: when and where? I think I can contribute if I don't have concurrent meetings (which I might but should not have)09:26
dmelladokzaitsev_ws: TBD09:26
kzaitsev_wsah =) ok09:26
dmelladowe'll discuss it and sort out dates :D09:26
kzaitsev_wsI actually wanted to draw my own diagram of the controll-flow of kuryr-k8s. Similar to the ones I use to draw on the whiteboards when explaining how things work09:27
kzaitsev_wswill get to that sometime09:27
ltomasboapuimedo, not a good solution, and not working either...09:28
dmelladoapuimedo: chapucero09:32
dmelladoxD09:32
kzaitsev_wsltomasbo: I found my services_without_pods commit. its dirty and hacky +)09:33
kzaitsev_wscan share it if you want to though09:33
kzaitsev_wsbtw, folks. Can I kill LOG.debug("%s handler(s) available", len(handlers)) pleeeeeeease?09:34
*** vikasc has joined #openstack-kuryr09:35
kzaitsev_wsI can spend some time adding better debugging output. but will only do that if we agree to kill `1 handler(s) available` log avalanche. =)09:35
dmelladolol, that's fine for me xD09:36
dmelladoscooby doo, err apuimedo where are you?09:38
openstackgerritKirill Zaitsev proposed openstack/kuryr-kubernetes master: Add SR-IOV binding driver to CNI  https://review.openstack.org/46245609:40
kzaitsev_wshm10:06
kzaitsev_wsdoes anyone have a master installation and can check smth for me?10:06
*** kiennt has quit IRC10:09
apuimedokzaitsev_ws: ltomasbo prolly has10:15
apuimedoI could have one in a little hilw10:15
apuimedo*while10:15
apuimedokzaitsev_ws: yeah, you can kill it10:15
irenabltomasbo, dmellado, apuimedo did someone ran nested setup lately, have an issue that pod cannot be created with some wierd error, that host side interface is not created10:15
apuimedoirenab: you mean that pyroute2 fails to create the vlan device?10:16
irenabyes10:16
kzaitsev_wsapuimedo: I see that during pod deletion the CNI is called up to 3 times. it's by design idempotent and doesn't crash, but that's weird. I wanted to confirm if it's I or if everyone get's the same behaviour10:17
ltomasbokzaitsev_ws, I have a setup, let me know what to try10:18
apuimedokzaitsev_ws: I did not notice that10:19
apuimedobut that's bad10:19
kzaitsev_wsltomasbo: one thing is I can probably mishandle the moment when to let the handler go10:19
kzaitsev_wsin the CNI side10:20
apuimedokzaitsev_ws: did you check if it didn't just retry due to some resource not ready or somethign?10:20
apuimedois it really the kubelet doing multiple calls?10:20
apuimedoor just the handler going more than once10:20
kzaitsev_wsapuimedo: that's what I'm trying to understand. actually for resource deletion (even in unmodified code) the interface will get deleted on the first event10:24
kzaitsev_wshttps://github.com/openstack/kuryr-kubernetes/blob/master/kuryr_kubernetes/cni/handlers.py#L40 and https://github.com/openstack/kuryr-kubernetes/blob/master/kuryr_kubernetes/cni/handlers.py#L8710:24
apuimedokzaitsev_ws: if it find the annotation10:26
apuimedos/find/finds/10:26
apuimedokzaitsev_ws: we should be able to tear down a pod without going to the K8s API10:26
apuimedoI had a proposal for storing the vif information of a pod in /var/run/kuryr10:27
apuimedoto avoid such things and speed it up10:27
apuimedobut didn't get down to implementing it10:27
*** yamamoto has quit IRC10:31
*** wangbo has quit IRC10:39
kzaitsev_wsapuimedo: yeah. so I suppose, that I get the same annotation several times10:46
apuimedoright, same event several times10:50
*** atoth has joined #openstack-kuryr10:55
*** wangbo has joined #openstack-kuryr10:58
*** aojea has quit IRC11:04
*** aojea has joined #openstack-kuryr11:06
*** aojea has quit IRC11:09
*** yamamoto has joined #openstack-kuryr11:13
*** yamamoto has quit IRC11:18
*** yamamoto has joined #openstack-kuryr11:21
*** yedongcan has left #openstack-kuryr11:23
*** yamamoto has quit IRC11:26
*** yamamoto has joined #openstack-kuryr11:36
*** yamamoto has quit IRC11:40
*** yamamoto has joined #openstack-kuryr11:50
*** yamamoto has quit IRC11:54
*** yamamoto has joined #openstack-kuryr12:17
*** yboaron_ has quit IRC12:22
*** mattmceuen has quit IRC12:58
*** aojea has joined #openstack-kuryr13:24
*** wangbo has quit IRC13:24
*** aojea has quit IRC13:25
*** aojea has joined #openstack-kuryr13:25
*** deep-book-gk_ has joined #openstack-kuryr13:27
*** deep-book-gk_ has left #openstack-kuryr13:28
*** mattmceuen has joined #openstack-kuryr13:33
*** roeyc has quit IRC13:56
*** hongbin has joined #openstack-kuryr14:06
openstackgerritKirill Zaitsev proposed openstack/kuryr-kubernetes master: Allow passing multiple VIFs to CNI  https://review.openstack.org/47101214:08
openstackgerritKirill Zaitsev proposed openstack/kuryr-kubernetes master: [DRAFT] Allow requesting additional VIFs via annotation  https://review.openstack.org/48254414:08
openstackgerritKirill Zaitsev proposed openstack/kuryr-kubernetes master: Add SR-IOV binding driver to CNI  https://review.openstack.org/46245614:08
openstackgerritKirill Zaitsev proposed openstack/kuryr-kubernetes master: Add SR-IOV capabilities to VIF handler  https://review.openstack.org/46245514:08
apuimedokzaitsev_ws: rebase?14:15
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-tempest-plugin master: Updated from global requirements  https://review.openstack.org/48341114:15
kzaitsev_wsyeah, sorry =)14:18
kzaitsev_wsI found a small bug in the very 1st commit. or rather it was always there14:18
kzaitsev_wsprobably, but the very 1st in a chain is a good place to fix. when asking for `subnet.gateway` of the ovo if there is no gateway it would raise a NotImplemented exception14:19
kzaitsev_wsif there is no gateway here https://github.com/openstack/kuryr-kubernetes/blob/master/kuryr_kubernetes/os_vif_util.py#L72 it's never set and ovo raises an exception here https://github.com/openstack/oslo.versionedobjects/blob/master/oslo_versionedobjects/base.py#L6714:24
*** gouthamr has joined #openstack-kuryr14:37
kzaitsev_wsand yeah, only found it 'cause I added 2 subnets to the pod and one did not have a gateway =)14:37
*** janki has quit IRC15:17
*** kzaitsev_ws has quit IRC15:24
openstackgerritJaivish Kothari(janonymous) proposed openstack/kuryr-kubernetes master: [DRAFT] CNI Daemon template  https://review.openstack.org/48002815:35
*** pcaruana has quit IRC15:38
janonymousapuimedo irenab kzaitsev_pi dmellado ltomasbo:  i have uploaded initial draft version for review ^^ , please check. i was facing some issue with response body from daemon which i will check tommorrow, maybe something related to content-type..review comments would be helpful :)15:39
*** aojea has quit IRC15:55
*** aojea has joined #openstack-kuryr16:02
*** aojea has quit IRC16:07
*** aojea has joined #openstack-kuryr16:12
*** aojea has quit IRC16:16
*** saneax has quit IRC16:18
*** aojea has joined #openstack-kuryr16:21
*** aojea has quit IRC16:25
*** aojea has joined #openstack-kuryr16:30
*** aojea has quit IRC16:36
*** aojea has joined #openstack-kuryr16:39
*** gouthamr has quit IRC16:41
*** gouthamr has joined #openstack-kuryr16:41
*** aojea has quit IRC16:44
*** aojea has joined #openstack-kuryr16:48
*** egonzalez has quit IRC16:50
*** aojea has quit IRC16:52
*** aojea has joined #openstack-kuryr16:57
*** aojea has quit IRC17:02
*** aojea has joined #openstack-kuryr17:06
*** aojea has quit IRC17:10
*** aojea has joined #openstack-kuryr17:15
*** aojea has quit IRC17:20
*** aojea has joined #openstack-kuryr17:24
*** aojea has quit IRC17:29
*** tonanhngo has joined #openstack-kuryr17:36
*** roeyc has joined #openstack-kuryr18:06
*** roeyc has quit IRC18:10
*** garyloug has quit IRC18:12
*** pcaruana has joined #openstack-kuryr18:38
openstackgerritOpenStack Proposal Bot proposed openstack/fuxi master: Updated from global requirements  https://review.openstack.org/48352219:29
*** yboaron_ has joined #openstack-kuryr19:33
*** pcaruana has quit IRC19:52
*** rwallner has joined #openstack-kuryr19:59
*** rwallner has quit IRC20:03
*** aojea has joined #openstack-kuryr20:35
*** aojea has quit IRC20:41
*** rwallner has joined #openstack-kuryr21:07
*** limao has joined #openstack-kuryr21:26
*** rwallner has quit IRC21:31
*** limao_ has joined #openstack-kuryr21:33
*** limao has quit IRC21:33
*** gouthamr has quit IRC21:47
*** gouthamr has joined #openstack-kuryr21:49
*** saneax has joined #openstack-kuryr22:01
*** mattmceuen has quit IRC22:05
*** limao_ has quit IRC22:08
*** limao has joined #openstack-kuryr22:08
*** gouthamr has quit IRC22:10
*** rwallner has joined #openstack-kuryr22:28
*** rwallner has quit IRC22:32
*** aojea has joined #openstack-kuryr23:28
*** limao has quit IRC23:29
*** aojea has quit IRC23:33
*** hongbin has quit IRC23:34
*** aojea has joined #openstack-kuryr23:37
*** aojea has quit IRC23:41
*** aojea has joined #openstack-kuryr23:46
*** aojea has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!