Monday, 2017-07-03

*** hongbin has quit IRC00:15
*** yedongcan has joined #openstack-kuryr00:57
*** hongbin has joined #openstack-kuryr01:11
*** kiennt has joined #openstack-kuryr01:18
openstackgerritMerged openstack/kuryr-tempest-plugin master: Updated from global requirements  https://review.openstack.org/47715901:30
openstackgerritMerged openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/46948901:40
*** longfei_zhang has joined #openstack-kuryr01:52
openstackgerritMerged openstack/fuxi master: Updated from global requirements  https://review.openstack.org/45447401:56
*** kiennt has quit IRC01:58
openstackgerritHongbin Lu proposed openstack/fuxi master: Upgrade from docker-py to docker  https://review.openstack.org/47589502:00
*** caowei has joined #openstack-kuryr02:03
*** yamamoto has joined #openstack-kuryr02:49
*** reedip has quit IRC03:09
*** yedongcan has quit IRC03:20
*** yedongcan has joined #openstack-kuryr03:21
*** hongbin has quit IRC03:30
*** yamamoto has quit IRC03:50
*** yamamoto has joined #openstack-kuryr03:53
*** hongbin has joined #openstack-kuryr03:55
*** vikasc has joined #openstack-kuryr03:57
*** kiennt has joined #openstack-kuryr04:10
vikascapuimedo, kzaitsev1pi ltomasbo irenab ivc_ dmellado janonymous : so multus has also been converted to a controller, cni kind of plugin like kuryr and just started supporting tpr based multi-neworks, https://github.com/Intel-Corp/multus-cni#usage-with-kubernetes-tpr-based-network-objects04:11
vikascmultus network object also seems to be having similar details as i proposed here,https://review.openstack.org/#/c/477066/ . Though format seems to be a little different.04:15
*** hongbin has quit IRC04:21
openstackgerritKien Nguyen proposed openstack/kuryr master: Add Apache License Content in index.rst  https://review.openstack.org/45522904:26
*** longfei_zhang has quit IRC04:30
janonymousvikasc: +105:29
openstackgerritMerged openstack/kuryr-kubernetes master: Clarify _is_pending function use  https://review.openstack.org/47782405:29
*** kiennt has quit IRC05:40
openstackgerritMerged openstack/fuxi master: Upgrade from docker-py to docker  https://review.openstack.org/47589505:47
*** kiennt has joined #openstack-kuryr06:06
*** reedip has joined #openstack-kuryr06:13
ltomasbothanks vikasc! nice finding!06:21
vikascltomasbo, noticed on sig-network so thought of sharing06:22
ltomasbogreat!06:23
*** sridhar_ram has joined #openstack-kuryr06:23
vikascltomasbo, thanks!06:30
ltomasboapuimedo, FYI: https://review.openstack.org/#/c/442496/06:35
*** yboaron has joined #openstack-kuryr06:41
openstackgerritMerged openstack/kuryr-tempest-plugin master: Skip test_list_pods  https://review.openstack.org/47852406:43
*** kzaitsev_ws has joined #openstack-kuryr06:55
openstackgerritKirill Zaitsev proposed openstack/kuryr master: Use openstackdocstheme over oslosphinx  https://review.openstack.org/47886806:57
*** pcaruana has joined #openstack-kuryr06:59
*** pcaruana has quit IRC07:03
*** pcaruana has joined #openstack-kuryr07:05
*** lihi has joined #openstack-kuryr07:21
*** aojea has joined #openstack-kuryr07:24
*** openstackgerrit has quit IRC07:48
ltomasbohi again vikasc07:57
ltomasboI just read your multi-network support spec07:57
vikaschi ltomasbo07:57
vikascdoes it make sense a bit :)07:58
ltomasbojust one to double check with you07:58
ltomasboyes, it does!07:58
vikascsure, please go ahead07:58
ltomasboso, your idea is to use a network object to create the networks in neutron from kuberentes, right?07:58
ltomasboand then, something similar to my PoC patch to allow pods to choose those networks, right?07:59
vikascno, network object represents a nic on k8s side07:59
vikascso IMO, subnet will be the entity on neutron side07:59
vikascthats how i was thinking08:00
ltomasboso, then, the idea is to have a pod spec08:00
ltomasbowhich includes that Network object too?08:00
ltomasboor you create that in a two step process?08:00
vikascsince k8s scheduler does not understand networkobjects08:01
ltomasboI just want to make sure I got the step by step actions (create network, create container in that network)08:01
vikascso for now, i am thinking to represent/request network object by OIR in pod spec08:01
ltomasboyes, that I get, that for sr-iov and these type of resources, you need to account where they are08:02
ltomasbobut, for standard neutron subnets/networks08:02
ltomasbowhere we can take for granted they are present in any node (so, no special scheduling)08:02
ltomasbowhat will be the steps?08:02
ltomasboI understood from your spec that you use the network objects to create the networks08:03
vikasccan it be a case when even for standard neutron subnets, all nodes might not have all the subnets?08:04
vikascis this a valid case?08:04
vikasci am just thinking08:04
ltomasbowell, I guess there may be such a case08:05
ltomasboI was just interested in the other part now, not focusing on the OIR08:05
vikasci am sorry if i was not clear enough in spec and gave impression that network objects are used to create neutron networks.08:05
ltomasbobut I agree the OIR has a role here (and it is being used already by the SR-IOV supporT)08:05
ltomasboso, network objects only create the network from the kuberentes point of view, right?08:06
ltomasboand the kuryr controller will be in charge of creating them (if they do not exist already)08:06
vikascyes08:06
vikasccreating subnets08:06
*** openstackgerrit has joined #openstack-kuryr08:06
openstackgerritKirill Zaitsev proposed openstack/kuryr-libnetwork master: Use openstackdocstheme over oslosphinx  https://review.openstack.org/47930808:07
vikascif matching cidr subnet is not present08:07
vikascso your optional subnet driver will come into picture08:07
kzaitsev_wsltomasbo: vikasc: folks, can you please explain me the role of OIR there? =)08:07
ltomasbobut, a pod creation will just have an annotation of the kuberentes networks, right? like the name08:07
ltomasboand then, the subnet kuryr driver need to map that with the network objects (handler) and then use/create the neutron subnet08:08
vikasckzaitsev_ws, assuming you asking about standar subnets, there OIR max available can be a neutron port quota. still thinking on this08:09
ltomasbokzaitsev_ws, as I understood it, it is needed to perform the scheduling, as for instance, for the SR-IOV case, not all the nodes may support it, and you need to schedule the pods where there are VFs available08:09
vikascltomasbo, yes08:09
ltomasbovikasc, now that you mention, that could be used in conjuntion with ports pools08:09
kzaitsev_wsltomasbo: yes, but OIR is quantitive, i.e. there are X OIRs08:10
ltomasboto allocate the pods where there is already existing ports in the pool08:10
kzaitsev_wsso it feels very much like per-node quota, yes08:10
vikascltomasbo, i am thinking on same lines but dont have refines thoughts yet08:10
vikascs/refined08:10
ltomasbokzaitsev_ws, yep, it is qunatitative, but if you define to be 0 VFs, then you will not schedule pods there, right?08:10
vikascltomasbo, makes senses to me08:11
ltomasboI still need to give it a second thought, but just wanted to double check with you vikasc that I understood waht you suggested on the spec08:12
vikascltomasbo, ports pool can be mapped to OIR counts and this will be applicable to all vif types08:12
kzaitsev_wsltomasbo: the workflow is the following from k8s side. You advertise that node-1 has 4 OIR-x. and node-2 has 3 OIR-x08:12
kzaitsev_wsthen a Pod requests 2 OIR-x and get's scheduled to node-2 (for example.)08:12
kzaitsev_wsso node-2 only has 1 OIR-x left and another Pod, that wants 2 OIR-xs would not get scheduled there08:13
vikascand the controller will figure out network object naame from OIR on the node08:13
vikascs/then08:13
kzaitsev_wsso yeah if we call it a per-node quota that fits08:13
kzaitsev_wsltomasbo: (not sure what you mean by define 0VFs, that's in the request or on the node?)08:14
vikascand controller will fetch network object from apiserver to get network metadata and accordingly other handlers will be invoked08:14
kzaitsev_wsafk for 2 mins, gotta get a delivery08:14
ltomasbokzaitsev_ws, node I assume08:15
*** yboaron_ has joined #openstack-kuryr08:15
*** aojea has quit IRC08:15
*** aojea has joined #openstack-kuryr08:16
vikascmulti-network seems a misnomer. It is multi-nic to be precise. But somehow community around sig-network calls is multi-network :)08:21
kzaitsev_wsback )08:21
kzaitsev_wsltomasbo: then the node would not have these OIRs and the Pods, that request these OIRs would never get scheduled on it08:22
kzaitsev_wsmy point is that OIRs map real nice to SRIOV, since you only have that much VFs on a node (say your nic supports 63 VFs — you only have 63 physnet-x OIRs on that node)08:23
kzaitsev_wsbut for general admission/scheduling it looks like a misuse of a feature, and taints/toleraqtions would be more fit08:24
kzaitsev_wsvikasc: sorry for whining about the thing again )08:24
kzaitsev_wsvikasc: true about multi-network. multi-interface would be better maybe?08:25
apuimedohttps://review.openstack.org/#/c/442496/ is really good news08:25
apuimedoI'm sick and tired of the hook hack08:25
kzaitsev_wshowever some of the docs you've shared mention, that multi-network does not always mean multiple interfaces. they might mean multiple addresses, routes for the same interface, so in the end it might be ok-ish08:26
ltomasboapuimedo, I knew you would like it!08:27
ltomasbokzaitsev_ws, yep, you are right08:28
kzaitsev_wsabout OIR? =)08:28
ltomasboit feels right for SR-IOV as it is actually a node feature08:28
ltomasboyep08:28
ltomasboI was mainly asking vikasc about the other parts of the spec08:28
vikasckzaitsev_ws, even in standard subnets case, OIR will be used to get k8s scheduler working roght08:28
vikascs/right08:28
ltomasbobut need to get a little bit more information about taints/tolerations to set my mind about this08:29
vikasckzaitsev_ws, in case a node does not have a particular subnet requested by pod08:29
kzaitsev_wsvikasc: I'm ok with using them there, I just want to understand what they would represent08:29
vikasckzaitsev_ws, neutron port pool quota per node08:30
kzaitsev_wsyeah, that fits08:30
vikasckzaitsev_ws, and ultimately sriov will also come through port pools08:30
kzaitsev_wsa bit annoying, that you can't set -1 (unlimited), but probably ok08:30
vikasckzaitsev_ws, that if needed, in future, we can implement by keep patching OIR for such case08:31
vikascand dont let it decrease08:31
kzaitsev_wsvikasc: agree. basically it is a port-pool-quota anyway08:32
vikasckzaitsev_ws, i might be saying absurd and it might not be needed at all08:32
vikasckzaitsev_ws, i mean we have ways to dealt with it08:32
apuimedovikasc: I'd rather not use OIR for normal subnets08:35
apuimedounless the sig-net implementations want to use it08:35
vikascapuimedo, suppose a pod wants to have two nic in two normal neutron subnets and in the cluster not all nodes have both of these subnets. Either OIR can be used to request each network or requested networks can be marked as pod annotations and taints/tolerations will be used08:39
vikascAre you suggesting the later one or any other option?08:39
apuimedovikasc: you're talking about physical networks?08:40
*** garyloug has joined #openstack-kuryr08:41
vikascapuimedo, i meant network objects(TPR) that a pod can attach to. And network object would map to a neutron subnet08:42
vikascapuimedo, talking in context to this write-up, https://review.openstack.org/#/c/477066/08:46
apuimedovikasc: where's the upstream doc on these attachable network objects?08:47
apuimedoas in, how do you attach them?08:47
vikascapuimedo, you mean how to refer these in pod object?08:48
vikascapuimedo, not sure if i understood what you meant by 'attach'?08:49
vikascapuimedo,  upstream dont support these objects natively and multi-nic is to supported using CRD (TPR successor)08:52
vikascapuimedo, plus annotations08:52
*** yboaron_ has quit IRC08:58
openstackgerritvikas choudhary proposed openstack/kuryr-kubernetes master: Add support to install Kuryr as a network addon  https://review.openstack.org/46667509:03
vikascapuimedo, ^09:03
apuimedoyou said "attachable"09:03
vikascapuimedo, sorry, not able to find where i used attachable. nevermind09:06
vikascapuimedo, does my reply answer your question?09:06
vikascapuimedo, ok "attach to" i used09:07
apuimedovikasc: right09:07
*** dimak_ has joined #openstack-kuryr09:08
vikascapuimedo, so to attach them, those will be requested as OIR in pod spec09:08
vikascapuimedo, thats the approach in the patch. Alternate approach would be to use annotations and tanits/tolerations(to create dedicated clusters since k8s scheduler doesnt understand network objects and cant schedule for them).09:10
vikascapuimedo,  i prefered first one because:09:10
vikasc1. OIR already accepeted with sriov vif09:11
vikasc2. OIR approach is resource efficient compared with taints/tolerations09:11
*** vikasc is now known as vikasc|lunch09:13
openstackgerritDanil Golov proposed openstack/kuryr-kubernetes master: Allow setting specific ports for SRIOV handler  https://review.openstack.org/47849409:16
*** dimak_ has quit IRC09:17
openstackgerritDanil Golov proposed openstack/kuryr-kubernetes master: Allow setting specific ports for SRIOV handler  https://review.openstack.org/47849409:17
*** openstackgerrit has quit IRC09:18
*** yamamoto has quit IRC09:20
*** sridhar_ram has quit IRC09:20
*** yamamoto has joined #openstack-kuryr09:22
*** vikasc|lunch is now known as vikasc09:31
*** garyloug has quit IRC09:33
*** garyloug has joined #openstack-kuryr09:33
*** kural has joined #openstack-kuryr09:36
apuimedovikasc: which approach is the community taking?09:55
vikascapuimedo, there are couple of pocs at different stages of development which i observed on sig-network googlr-group channel. multus cni is latest one to use tpr. Still need to look deeper to see handling of specific use cases09:59
apuimedook10:00
apuimedoI'd rather we go for the same approach10:01
apuimedoand I doubt that's going to be OIR10:01
apuimedoI'd probably even rather have a scheduler extender10:01
vikascyes, scheduler extender can help avoiding OIRs10:02
vikasci was thinking how devicePlugins/ResourceClasses effort at sig-node would relate to this10:03
vikascthis new functionality would replace OIRs10:04
vikascand it could be possible to have rich metadata about devices natively (which is being solved by network objects currently)10:06
vikascofcourse these functionalities will take a bit , ~1.9 or 1.010:07
vikasc1.1010:07
apuimedoyeah10:07
apuimedothat's why I said that we should check closely what others are doing10:07
vikascfor the interim, we can have scheduler externder10:07
vikasci am part of this effort10:07
vikascresourceclasses specifically and keeping an eye on deviceplugin progress10:08
irenabvikasc,  OIR?10:09
vikascopaque-integer-resources10:09
*** atoth has quit IRC10:09
irenabvikasc,  I will try to catch up on your spec by today's meeting10:10
vikascirenab, thanks!10:10
vikascirenab, intention behind pushing spec was only to have a placeholder for discussions.10:11
irenabvikasc, cool, this is better than keeping it on the channel only10:12
vikascirenab, exactly, thats what i was thinking10:12
vikascirenab, so i just quickly wrote-up whatever i had in mind without bothering much on format or validation. So not strict on anything which i proposed there.10:14
*** dims has quit IRC10:14
*** dims has joined #openstack-kuryr10:15
irenabvikasc, should we proceed with usual review process or you plan to abandon it once discussion if over?10:15
vikascirenab, lets start with review process and see if that spec makes sense a bit and how we all feel about it.10:16
vikascirenab, if finally we feel that overall direction is fine10:16
vikascirenab, i will reiterate to improve it otherwise abandon it10:17
irenabvikasc, sounds good10:18
vikascirenab, thanks!10:19
*** kiennt has quit IRC10:23
*** yamamoto has quit IRC10:45
*** yamamoto has joined #openstack-kuryr10:46
*** yamamoto has quit IRC10:46
*** caowei has quit IRC10:47
*** atoth has joined #openstack-kuryr10:57
*** kural has quit IRC11:14
*** kural has joined #openstack-kuryr11:21
*** mestery has quit IRC11:22
*** mestery has joined #openstack-kuryr11:26
*** aojea_ has joined #openstack-kuryr11:31
*** aojea has quit IRC11:34
*** openstackgerrit has joined #openstack-kuryr11:37
openstackgerritKirill Zaitsev proposed openstack/kuryr master: Use openstackdocstheme over oslosphinx  https://review.openstack.org/47886811:37
openstackgerritKirill Zaitsev proposed openstack/kuryr-libnetwork master: Use openstackdocstheme over oslosphinx  https://review.openstack.org/47930811:38
openstackgerritKirill Zaitsev proposed openstack/kuryr-kubernetes master: Use openstackdocstheme over oslosphinx  https://review.openstack.org/47885611:42
kzaitsev_wsirenab: sorry for the annoying docs patches %)11:43
irenabkzaitsev_ws, its great that you are keeping kuryr aligned with the rest of the openstack projects11:43
kzaitsev_wsthose are still usually annoying =)11:44
irenabyea..11:44
*** yamamoto has joined #openstack-kuryr11:46
kzaitsev_wsone of these evenings I'll prbably do the same for fuxi11:47
kzaitsev_wsirenab: how was your trip to China? =)11:47
openstackgerritMerged openstack/kuryr-libnetwork master: Support tagging existing subnetpool  https://review.openstack.org/47064011:47
irenabkzaitsev_ws, had very intensive agenda, but overall was good11:48
*** yamamoto has quit IRC11:50
*** yamamoto has joined #openstack-kuryr11:50
*** yamamoto has quit IRC11:53
kzaitsev_wsheh, nice that you're all back12:00
kzaitsev_wsand I can start pinging you with review requests =))12:00
*** aojea_ has quit IRC12:05
*** aojea has joined #openstack-kuryr12:05
*** aojea has quit IRC12:09
*** yamamoto has joined #openstack-kuryr12:10
*** yamamoto has quit IRC12:19
*** yamamoto has joined #openstack-kuryr12:23
*** yamamoto has quit IRC12:28
irenabkzaitsev_ws, :-) you always can12:28
*** rwallner has joined #openstack-kuryr12:31
*** ApheleiaS has joined #openstack-kuryr12:38
*** yamamoto has joined #openstack-kuryr12:59
*** aojea has joined #openstack-kuryr13:06
*** mattmceuen has joined #openstack-kuryr13:08
*** aojea has quit IRC13:10
*** kzaitsev_ws has quit IRC13:24
*** kzaitsev_ws has joined #openstack-kuryr13:24
kzaitsev_wsactually would appreciate some reviews to https://review.openstack.org/#/c/471012/ all of my sriov things are based on it, so before I'll jump into updating any of those, I'd love to get some feedback here13:37
kzaitsev_wsapuimedo: btw. we ran a meeting last mon with dmellado %)13:45
kzaitsev_wswanted to ping and warn you when you're back from Boston, but <insert excuse here>13:46
irenabkzaitsev_ws: I will review the set of patches related to multi vifs, sr-iov by tomorrow13:48
kzaitsev_wshope it's ok (= we had garyloug come by and ask about DPDK work he is doing13:48
kzaitsev_wsirenab: awesome =) looking forward to it )13:48
irenabapuimedo: sorry, cannot attend weekly today, will follow up afterwards13:59
apuimedoirenab: very well13:59
*** aojea has joined #openstack-kuryr14:00
*** mchiappe1o is now known as mchiappero14:07
*** zengchen1 has joined #openstack-kuryr14:11
openstackgerritMerged openstack/kuryr-kubernetes master: Use openstackdocstheme over oslosphinx  https://review.openstack.org/47885614:24
*** yedongcan has left #openstack-kuryr14:30
openstackgerritMerged openstack/kuryr-libnetwork master: Use openstackdocstheme over oslosphinx  https://review.openstack.org/47930814:33
openstackgerritMerged openstack/kuryr-kubernetes master: Enable some off-by-default checks  https://review.openstack.org/47642414:37
*** zengchen1 has quit IRC14:47
*** atoth has quit IRC14:50
*** hongbin has joined #openstack-kuryr15:09
*** yboaron has quit IRC15:27
*** yamamoto has quit IRC15:28
*** yamamoto has joined #openstack-kuryr15:31
*** yamamoto has quit IRC15:36
*** aojea has quit IRC15:48
kzaitsev_wsvikasc: about https://review.openstack.org/#/c/466675/14/k8s_client.patch can we use six.b there instead?15:56
kzaitsev_wsI'm commenting on the patch, but gerrit seems to hang15:56
*** hongbin_ has joined #openstack-kuryr16:19
*** kzaitsev_ws has quit IRC16:19
*** hongbin has quit IRC16:21
*** pc_m has quit IRC16:29
*** pc_m has joined #openstack-kuryr16:30
*** atoth has joined #openstack-kuryr16:33
*** yamamoto has joined #openstack-kuryr16:33
*** pcaruana has quit IRC16:35
*** pc_m has quit IRC16:37
*** yamamoto has quit IRC16:39
*** garyloug has quit IRC17:23
*** pc_m has joined #openstack-kuryr17:32
*** hongbin_ has quit IRC18:06
*** rwallner has quit IRC18:13
*** kural has quit IRC18:41
*** aojea has joined #openstack-kuryr18:41
*** rwallner has joined #openstack-kuryr19:18
*** aojea has quit IRC19:29
*** aojea has joined #openstack-kuryr19:33
*** hongbin has joined #openstack-kuryr20:11
*** aojea has quit IRC20:13
*** pc_m has quit IRC20:20
*** aojea has joined #openstack-kuryr20:21
*** aojea has quit IRC20:25
*** kzaitsev_mb has joined #openstack-kuryr20:27
*** kzaitsev_mb has quit IRC20:33
*** aojea has joined #openstack-kuryr20:33
*** kzaitsev_mb has joined #openstack-kuryr20:37
*** kzaitsev_mb has quit IRC20:54
*** kzaitsev_mb has joined #openstack-kuryr21:03
*** pc_m has joined #openstack-kuryr21:03
*** kzaitsev_mb has quit IRC21:22
*** kural has joined #openstack-kuryr21:22
*** kural_ has joined #openstack-kuryr21:22
*** kzaitsev_mb has joined #openstack-kuryr21:22
*** pmannidi has joined #openstack-kuryr21:39
*** neiljerram has quit IRC21:41
*** rwallner has quit IRC21:45
*** aojea has quit IRC22:03
*** pmannidi has quit IRC22:19
*** hongbin has quit IRC22:27
*** hongbin has joined #openstack-kuryr22:28
*** neiljerram has joined #openstack-kuryr22:30
*** pmannidi has joined #openstack-kuryr22:32
*** neiljerram has quit IRC22:51
*** kzaitsev_mb has quit IRC22:57
*** kural_ has quit IRC22:58
*** kural has quit IRC22:59
*** kural has joined #openstack-kuryr23:00
*** kural_ has joined #openstack-kuryr23:00
*** kural_ has quit IRC23:05
*** kural_ has joined #openstack-kuryr23:05
*** hongbin has quit IRC23:17
*** kural_ has quit IRC23:27
*** kural_ has joined #openstack-kuryr23:27
*** s1061123 has quit IRC23:57
*** s1061123 has joined #openstack-kuryr23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!