Monday, 2019-09-30

*** pcaruana has joined #openstack-kuryr05:24
*** pcaruana has quit IRC05:30
*** janki has joined #openstack-kuryr05:35
*** gdwornicki has quit IRC06:36
*** pcaruana has joined #openstack-kuryr06:41
*** ccamposr has joined #openstack-kuryr07:19
*** jchhatbar has joined #openstack-kuryr07:23
*** janki has quit IRC07:25
*** gdwornicki has joined #openstack-kuryr08:00
openstackgerritMaysa de Macedo Souza proposed openstack/kuryr-kubernetes master: Ensure no LBaaS SG update is triggered for SVCs without selectors and ports  https://review.opendev.org/68562608:08
openstackgerritMerged openstack/kuryr-kubernetes master: Ensure pod IP is retrieved from annotation  https://review.opendev.org/68511408:57
*** mrostecki has quit IRC09:39
*** mrostecki has joined #openstack-kuryr09:41
openstackgerritMaysa de Macedo Souza proposed openstack/kuryr-kubernetes master: Ensure no LBaaS SG update is triggered for SVCs without selectors and ports  https://review.opendev.org/68562609:41
*** gcheresh_ has joined #openstack-kuryr09:55
dulekgdwornicki: What do you mean by "bad port"?09:56
dulekgdwornicki: Any logs we can take a look at?09:56
gdwornickiI will send them to you next time user will deploy. I will be a matter of time today. They deploy from helm like ~10 pod and services and never they had a clean deployment.09:59
gdwornickiHowever if you do I in steps like 2-4 smaller deployment it works10:00
gdwornickiUsually error is ResourceNotReady and it is not catched10:01
gdwornickiOther problem I can point out is that users tent to forgot about the address space and they try to deploy more ports than address space of the ns. If they would get error it would be OK. But kontroler fails and is not serving new requests10:02
gdwornickiThis second is easy to reproduce10:02
gdwornickiJust create two ns with namespace driver. Fill one out of the address space and try to deploy something on the good one10:03
gdwornickiSry for my spelling wring from phone in hurry10:04
dulekgdwornicki: Are you using nested vif driver? The first issue sounds a bit like the problem with Neutron subports that we faced a while ago.10:12
dulekLemme try to find the bugreport.10:12
gdwornickiYes we are using vlan nested driver10:12
dulekhttps://bugs.launchpad.net/neutron/+bug/1828375 - this thing.10:13
openstackLaunchpad bug 1828375 in neutron "Bulk creation of subports fails with StaleDataError" [Low,In progress] - Assigned to Bence Romsics (bence-romsics)10:13
gdwornickiAnd if I may ask. Will it work with vxlan networks? We are going to migrate.10:14
dulekgdwornicki: Please check if this could be it.10:14
gdwornickiOk10:14
dulekgdwornicki: And about the second issue - what would be the expected behavior on subnet exhaustion?10:14
gdwornickiYes in case of first ns10:15
gdwornickiThat what is filled up10:15
gdwornickiBut second should work as it has free addresses. But the controller throws exceptions and crashes10:16
dulekgdwornicki: Ah, I get it, it affects a "good" namespace as well. Can you file a bug then? We'll take a look.10:16
gdwornickiMaking cni useless - each restart fails due to the filled up ns. The operator needs to clean up the bad ns to make cluster useful10:16
gdwornickiOk. I have logs on it I shall post it later on leave here bug number ok?10:17
gdwornickiI don't have access to my computer now10:17
dulekgdwornicki: Sure, please ping me once it's filed.10:27
*** jchhatbar has quit IRC11:00
*** gdwornicki has quit IRC11:19
*** gcheresh_ has quit IRC12:40
*** gcheresh_ has joined #openstack-kuryr12:50
*** aperevalov has joined #openstack-kuryr13:06
aperevalovdulek, ltomasbo hi, could we make a sync (meeting today) at 3 p.m. UTC today?13:14
dulekaperevalov: Sure!13:15
aperevalovhere in this channel?13:15
dulekaperevalov: Yeah, that would be best.13:20
*** gcheresh_ has quit IRC13:47
openstackgerritMerged openstack/kuryr-kubernetes master: Ensure no LBaaS SG update is triggered for SVCs without selectors and ports  https://review.opendev.org/68562613:55
openstackgerritLuis Tomas Bolivar proposed openstack/kuryr-kubernetes stable/train: Ensure pod IP is retrieved from annotation  https://review.opendev.org/68571814:05
openstackgerritLuis Tomas Bolivar proposed openstack/kuryr-kubernetes stable/train: Ensure no LBaaS SG update is triggered for SVCs without selectors and ports  https://review.opendev.org/68571914:05
*** pcaruana has quit IRC14:18
*** brault has joined #openstack-kuryr14:50
*** gdwornicki has joined #openstack-kuryr14:54
aperevalovI was not able to participate in #openstack-meeting-4 at 2p.m. UTC.14:56
dulekaperevalov: Hello! So what's up?14:57
dulekPinging ltomasbo as well.14:57
aperevalovabout optimization task, I told about implementation of direct RPC instead of using k8s, but I measured again and found neither kubernetes is a bottle neck nor kuryr-kuberntes, just my previous measurement was incorrect.14:59
dulekaperevalov: So what's the bottleneck?15:00
aperevalovdulek, latest measurement shows there is no bottleneck here.  Regarding improvement in pool (precreated net namespace), we don't still use port pool, so it's not our use case, and we postponed this task.15:01
dulekaperevalov: Okay! That's rather a good news, right?15:01
aperevalovyes ;) next topic is SR-IOV. Now we a going to move to sriovdp 3.0. Right before we used 2.1.0 and 2.0.0.  As I remember Danil did not mention in doc (required version). BUT15:02
dulekaperevalov: sriovdp is a library?15:03
aperevalovit implemented as k8s device-plugin, and runs in the pod in kube-system namespace. But it also implement k8s hooks to add env variable and mount points into user pod.  kuryr-kubernetes binding driver's behaviour depends on sriovdp version, especially in part of vfio driver. Danil now in vacation, but I hope when he will return back we'll make it15:05
aperevalovup.15:05
dulekOkay, very well.15:06
dulekaperevalov: You're probably aware that Train release is close now. We might not be able to get it into this release.15:06
dulekaperevalov: Does it matter for you? At RH we're already maintaining a fork that we release along with OpenShift releases.15:07
dulekSo we don't really care about OpenStack releases that much anymore.15:07
aperevalovYes, I know, about code freeze. I don't think it's important for us.Integration tests for SRIOV: you are using tempest framework, but our CI/CD team've preferred sonobuoy. I already implemented tempest, but need to finish it. So I'll publish it soon.15:07
aperevalovfork of kuryr-kubernetes?15:08
dulekaperevalov: Okay, very well. Also please note that we're not constrained to tempest in the gate and had already experimented with running Kubernetes upstream tests.15:09
dulekaperevalov: Yup, there: https://github.com/openshift/kuryr-kubernetes15:09
dulekBut don't worry, we still develop on OpenStack, that fork is only required for procedural reasons - OpenShift requires code to live on github.com/openshift.15:10
aperevalovthanks for link )15:10
dulekSo we only rebase it with new code.15:10
aperevalovwe also have a fork of kuryr-kuberntes, and the main difference, from my point of view in multi vif driver, we don't use NPWG driver for it, we're using our own driver.15:11
dulekaperevalov: Okay, so you don't really care about OpenStack releases either. This is good.15:12
aperevalovOur collogue from Suwon wanted to visit Open Infrastructure summit to discuss the reason we're doing it in our own way and possibilities to upstream it )15:12
aperevalovalso last time (before latest summit) Daniel asked me about sriov works.15:13
dulekaperevalov: Ah, I've seen the email from Yash. I replied, but haven't heard from him yet.15:13
aperevalovok, this time I'm 100% sure I'll wil not attend at summit. But for the next summit I hope to prepare presentation about optimized network in containers managed by neutron.15:15
dulekaperevalov: I would be really willing to hear about that. :)15:16
aperevalovgreat, that's all what I wanted to say.15:18
dulekThank you!15:18
aperevalovthank you too!15:19
openstackgerritSarka Scavnicka proposed openstack/kuryr-kubernetes master: [WIP] Add a loadbalancer CRD  https://review.opendev.org/68573715:44
*** pcaruana has joined #openstack-kuryr15:46
*** gdwornicki has quit IRC16:08
openstackgerritLuis Tomas Bolivar proposed openstack/kuryr-kubernetes master: Ensure lb sg rules are updated upon namespace label updates  https://review.opendev.org/68575416:23
*** pcaruana has quit IRC20:50
*** irclogbot_1 has quit IRC20:54
*** irclogbot_3 has joined #openstack-kuryr20:56
*** irclogbot_3 has quit IRC21:01
*** irclogbot_0 has joined #openstack-kuryr21:02
*** irclogbot_0 has quit IRC21:07
*** irclogbot_1 has joined #openstack-kuryr21:08
*** irclogbot_1 has quit IRC21:13
*** irclogbot_0 has joined #openstack-kuryr21:14
*** irclogbot_0 has quit IRC21:19
*** irclogbot_3 has joined #openstack-kuryr21:20
*** irclogbot_3 has quit IRC21:25
*** irclogbot_3 has joined #openstack-kuryr21:26
*** irclogbot_3 has quit IRC21:33
*** irclogbot_0 has joined #openstack-kuryr21:36
*** irclogbot_0 has quit IRC21:41
*** irclogbot_0 has joined #openstack-kuryr21:42
*** irclogbot_0 has quit IRC21:47
*** irclogbot_0 has joined #openstack-kuryr21:48
*** irclogbot_0 has quit IRC21:53
*** irclogbot_2 has joined #openstack-kuryr21:54
*** irclogbot_2 has quit IRC21:59
*** irclogbot_2 has joined #openstack-kuryr22:00
*** irclogbot_2 has quit IRC22:05
*** irclogbot_1 has joined #openstack-kuryr22:06
*** irclogbot_1 has quit IRC22:15
*** irclogbot_1 has joined #openstack-kuryr22:16

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!