Friday, 2017-11-17

*** pmannidi_2 has joined #openstack-kuryr00:10
*** s1061123_ has quit IRC00:26
*** s1061123 has joined #openstack-kuryr00:30
*** gouthamr has quit IRC00:31
*** yuanying has joined #openstack-kuryr00:32
*** yamamoto_ has quit IRC00:57
*** yamamoto has joined #openstack-kuryr01:03
*** yamamoto has quit IRC01:08
*** gouthamr has joined #openstack-kuryr01:10
*** hongbin has quit IRC01:35
*** caowei has joined #openstack-kuryr01:41
*** yamamoto has joined #openstack-kuryr01:48
*** yamamoto has quit IRC01:53
*** wangbo has joined #openstack-kuryr02:01
*** salv-orlando has joined #openstack-kuryr02:02
*** salv-orl_ has quit IRC02:05
*** kiennt26 has joined #openstack-kuryr02:09
*** yamamoto has joined #openstack-kuryr02:14
*** salv-orl_ has joined #openstack-kuryr03:00
*** salv-orlando has quit IRC03:02
*** hongbin has joined #openstack-kuryr03:22
*** yamamoto has quit IRC03:23
*** yamamoto has joined #openstack-kuryr03:25
*** yamamoto has quit IRC03:28
*** yamamoto has joined #openstack-kuryr03:40
*** yamamoto has quit IRC03:45
*** yamamoto has joined #openstack-kuryr04:10
*** yamamoto has quit IRC04:10
*** wangbo has quit IRC04:10
*** wangbo has joined #openstack-kuryr04:12
*** janonymous has joined #openstack-kuryr04:38
*** aojea has joined #openstack-kuryr04:46
*** pmannidi has quit IRC04:48
*** apuimedo has quit IRC04:48
*** aojea has quit IRC04:52
*** wangbo has quit IRC04:53
*** apuimedo has joined #openstack-kuryr04:54
*** kiennt26 has quit IRC05:01
*** caowei has quit IRC05:02
*** yamamoto has joined #openstack-kuryr05:10
*** wangbo has joined #openstack-kuryr05:16
*** yamamoto has quit IRC05:17
*** janki has joined #openstack-kuryr05:22
*** hongbin has quit IRC05:23
*** caowei has joined #openstack-kuryr05:25
*** gouthamr has quit IRC05:34
*** aojea has joined #openstack-kuryr05:53
*** aojea has quit IRC05:58
*** wangbo has quit IRC06:05
*** kiennt26 has joined #openstack-kuryr06:14
*** pmannidi_2 has quit IRC06:47
*** aojea has joined #openstack-kuryr06:54
*** aojea has quit IRC06:58
*** pcaruana has joined #openstack-kuryr07:04
*** yamamoto has joined #openstack-kuryr07:29
*** yamamoto has quit IRC07:34
*** yamamoto has joined #openstack-kuryr07:36
*** aojea has joined #openstack-kuryr07:54
*** vikasc has quit IRC07:55
*** aojea has quit IRC08:00
*** vikasc has joined #openstack-kuryr08:17
*** wangbo has joined #openstack-kuryr08:22
*** yamamoto has quit IRC08:34
openstackgerritMerged openstack/kuryr-tempest-plugin master: Updated from global requirements  https://review.openstack.org/51978208:39
*** yamamoto has joined #openstack-kuryr08:44
*** yamamoto has quit IRC08:49
*** aojea has joined #openstack-kuryr08:56
*** garyloug has joined #openstack-kuryr08:59
*** aojea has quit IRC09:01
*** garyloug_ has joined #openstack-kuryr09:03
*** garyloug has quit IRC09:03
openstackgerritAndreas Jaeger proposed openstack/fuxi master: Remove setting of version/release from releasenotes  https://review.openstack.org/52101709:12
*** yamamoto has joined #openstack-kuryr09:14
openstackgerritAndreas Jaeger proposed openstack/kuryr-libnetwork master: Remove setting of version/release from releasenotes  https://review.openstack.org/52102509:17
*** wangbo has quit IRC09:18
openstackgerritAndreas Jaeger proposed openstack/kuryr master: Remove setting of version/release from releasenotes  https://review.openstack.org/52102609:18
*** yamamoto has quit IRC09:19
*** yamamoto has joined #openstack-kuryr09:19
*** wangbo has joined #openstack-kuryr09:22
*** wangbo has quit IRC09:24
*** kiennt26 has quit IRC09:39
openstackgerritAndreas Jaeger proposed openstack/fuxi master: Remove setting of version/release from releasenotes  https://review.openstack.org/52101709:46
*** wangbo has joined #openstack-kuryr09:55
*** aojea has joined #openstack-kuryr09:57
*** aojea has quit IRC10:01
*** wangbo has quit IRC10:28
*** caowei has quit IRC10:33
*** yamamoto has quit IRC10:36
dmelladoapuimedo: irenab ping10:44
dmelladocould you please approve this blueprint?10:44
dmelladohttps://blueprints.launchpad.net/kuryr-kubernetes/+spec/enhance-upstream-gates10:44
*** wangbo has joined #openstack-kuryr10:47
ltomasbodmellado, today is Friday, so no irenab... :D10:48
*** yamamoto has joined #openstack-kuryr10:50
dmelladoyeah, but as the bouncer stays I'd be more than happy to have her reading this on Sun xD10:54
*** aojea has joined #openstack-kuryr10:58
*** yamamoto has quit IRC10:59
ltomasboxD10:59
*** aojea has quit IRC11:02
*** danil has joined #openstack-kuryr11:23
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Prevent pyroute2.IPDB threads leaking  https://review.openstack.org/51740611:32
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: CNI split - introducing CNI daemon  https://review.openstack.org/51518611:32
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Support kuryr-daemon when running containerized  https://review.openstack.org/51802411:32
dulekltomasbo: I think I've figured out containerized daemon issue ^.11:35
ltomasboohh, great!11:35
ltomasbolet me see11:35
ltomasboI'm fighting with heat...11:35
dulekltomasbo: Lucky you, it's only cold in Poland this time of the year. :D11:36
ltomasboxD11:36
ltomasbonot that kind of heat though... openstack-heat11:36
ltomasbodulek, umm, so it was another privsep issue...11:40
ltomasbogoing to test it!11:40
ltomasbodulek, but that is due to the daemonized deployment, right?11:42
ltomasboahh, I checked the last patch set, not the previous 211:43
dulekltomasbo: Yeah. Without CNI daemon we're not spawning too much processes.11:43
dulekltomasbo: And for each process we need to repeat the hack.11:43
dulekI should have figured that our earlier.11:43
*** yamamoto has joined #openstack-kuryr11:44
ltomasbonice finding! I'll test it and let you know if it works for me11:44
dulekAnyway I think I'll try to push apuimedo os_vif patches a bit, maybe we'll find a way to make that configurable in a less-hacky way.11:44
*** wangbo has quit IRC11:58
*** wangbo has joined #openstack-kuryr11:58
*** aojea has joined #openstack-kuryr11:59
apuimedodmellado: approved11:59
apuimedodulek: that would be nice12:00
apuimedodulek: ltomasbo: has anybody tried the openshift patch?12:00
apuimedodulek: you did yesterday right?12:00
ltomasboapuimedo, I did yesterday12:00
ltomasbowith lbaasV2 though12:00
apuimedoltomasbo: it worked right?12:01
ltomasboit did yes12:01
*** aojea has quit IRC12:03
apuimedoltomasbo: could you +12:03
apuimedo+1 and report your results12:04
apuimedocause it's gonna have to be merged with only irena's +212:04
ltomasboshould it work with octavia now?12:04
apuimedoso we'd better have r+1s12:04
apuimedoltomasbo: the octavia breakage seems unrelated12:04
apuimedo:/12:04
ltomasboapuimedo, ok12:04
ltomasboI'm deploying dulek patch12:05
apuimedoas you can see the octavia gate puts +112:05
ltomasboand after that I'll do the same with yours and comment12:05
apuimedook12:05
apuimedobut I thought you already ran it12:05
ltomasboI'm getting a bit crazy with openstack-heat12:06
apuimedoltomasbo: why?12:06
ltomasboI think the trunk support can be a bit broken..12:06
ltomasbotrying to use it to precreate X amount of subports12:06
ltomasbobut the depends_on on the trunk seems to not work, and it does not wait for the subports to be created, therefore it fails12:07
apuimedommm12:07
ltomasbofunny enough, by removing one of the checks, it re-tries, and it works12:07
apuimedoshow me a paste of how you have the worker VM definition12:07
ltomasboapuimedo, I'm not even creating a VM12:07
ltomasbojust the trunk with the parent + subports12:08
apuimedoand what fails?12:08
ltomasboand making the trunk wait for the subports to be created12:08
ltomasbolet me paste the template12:08
apuimedoltomasbo: why should it wait?12:08
ltomasbohttp://paste.openstack.org/show/626608/12:09
ltomasboapuimedo, due to the seg_ids not being automatically assigned by neutron, I need to create the trunk with the subports12:09
ltomasboand the repeat heat structure does not wait to get the subports ids12:10
ltomasbotherefore, the first time it is parsed, it received []12:10
ltomasboand then, the repeat heat has a checking that all the variables in the for_each, should be a list, with the same length12:10
*** janki has quit IRC12:11
ltomasboI see other modules in heat (such as ports.py) have a function add_dependencies to wait for other resources on the heat template (such as the subnets within the same network for the ports case)12:11
ltomasbobut that is lucking for the trunks...12:11
ltomasboso I guess the depends_on is not being enforced12:11
*** yamamoto has quit IRC12:13
apuimedoltomasbo: what is seg_id?12:21
ltomasboapuimedo, segmentation id12:21
apuimedoah right12:22
apuimedoI didn't know the for_each could go through two lists at once12:23
ltomasboyep, but you need to add permutations: false if you want 1-1 matching12:23
ltomasbootherwise it gets all the permutations12:23
ltomasbobut then it is required to have same length, and fails due to the checking as get_attr gets nothing12:24
ltomasboI've used for_each for the first time in my life yesterday...12:25
apuimedoin your template12:26
apuimedowhy is the resourcegroup count 2 ?12:26
ltomasboI12:26
ltomasboI'm just testing it12:26
ltomasboto create it with 2 ports12:26
apuimedomost likely the issue has to do with the resourcegroup12:27
ltomasbolater, when moved to openshift-ansible, it will be a variable/param12:27
apuimedowhy don't you define a type?12:27
ltomasbofor subport you mean?12:27
apuimedoyes12:28
apuimedoiike here https://github.com/danielmellado/kuryr_heat/blob/master/hot/parameters.yml12:28
apuimedofor the PodInVMNetworking12:28
ltomasbook, I can try that12:28
ltomasboI thought of doing that later, but maybe the problem as you say comes from resourcegroup12:29
ltomasboI'll try12:29
* dulek catches up with scrollback…12:31
ltomasboapuimedo, do you now if I can define that inside the template?12:31
ltomasboor have to be in environmental file?12:31
dulekapuimedo: I haven't tried last version of the patch (with rm's).12:32
dulekapuimedo: If you worry about verification I can send another patch that enables openshift in the gate.12:32
dulekapuimedo: We can see what breaks then. :D12:33
*** yamamoto has joined #openstack-kuryr12:33
apuimedoltomasbo: I don't recall12:34
apuimedoxD12:34
apuimedodulek: that's a good idea12:34
apuimedo!12:34
dulekapuimedo: Okay, I have it drafted somewhere. I'll need to rebase your patch, I hope it's not a problem?12:35
apuimedoI already rebased it yesterday12:36
apuimedodidn't I?12:36
apuimedoI did12:37
dulekapuimedo: Let's see. :)12:37
*** yamamoto has quit IRC12:37
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Do not merge: Running OpenShift on gates  https://review.openstack.org/52107712:39
dulekapuimedo: Okay, looks like I haven't touched your patch.12:39
dulekBTW - I love this new zuulv3 format. It adds some responsibilities for the team, but at least we have control on what we run.12:40
* apuimedo -> lunch12:42
*** wangbo has quit IRC12:43
*** janonymous has quit IRC12:57
*** aojea has joined #openstack-kuryr12:59
*** yamamoto has joined #openstack-kuryr13:01
*** yamamoto has quit IRC13:01
*** yamamoto has joined #openstack-kuryr13:04
*** aojea has quit IRC13:04
*** atoth has quit IRC13:10
dmelladoDulek, +1 but with some caveats13:11
dmelladoXD13:11
*** atoth has joined #openstack-kuryr13:18
dulekdmellado: Ah, sorry, I thought you'll follow up with caveats. :P13:27
*** janki has joined #openstack-kuryr13:30
dulekapuimedo: Should we close this blueprint: https://blueprints.launchpad.net/kuryr-kubernetes/+spec/kubeadminstallable ?13:31
*** garyloug_ has quit IRC13:36
dulekapuimedo: Plus I've added this one: https://blueprints.launchpad.net/kuryr-kubernetes/+spec/daemon-pool-port-choice13:36
dulekapuimedo: I've used your explanation - I like "In the crusade to" phrasing. :D13:36
apuimedo:-)13:48
apuimedodulek: I closed it13:49
dulekapuimedo: Thanks. Patch with tests failed, looks like Tempest cannot copy /opt/stack/new/.kube13:49
apuimedodulek: I guess having devstack use kubeadm or something to give 1.7 would help a lot with the crd thing, eh?13:50
dulekapuimedo: Which is strange as I've just run DevStack and .kube got created in /home/stack…13:50
dulekapuimedo: Hm, yes, I wanted to start my work with that.13:50
dulekapuimedo: Although I wanted to try new hyperkube first. :)13:51
apuimedodulek: it seems openshift has them https://docs.openshift.org/latest/admin_guide/custom_resource_definitions.html13:52
apuimedoso maybe you can use the openshift support13:52
dulekapuimedo: Ah, I haven't thought of that. Makes perfect sense!13:52
dulekapuimedo: Any idea why this happens: http://logs.openstack.org/77/521077/1/check/tempest-kuryr-kubernetes-lbaasv2-openshift/b646232/logs/devstacklog.txt.gz#_2017-11-17_13_01_23_261 ?13:53
apuimedodulek: that path does not look right13:54
apuimedoit should be in /opt/stack/.kube13:54
dulekapuimedo: Okay, I'll check why /new gets appended.13:55
apuimedook13:55
apuimedoltomasbo: ping13:56
ltomasbopong13:59
ltomasboapuimedo,13:59
apuimedoltomasbo: which openstack deployment are you testing on?14:00
apuimedowhich sdn does it use?14:00
ltomasbotesting what?14:00
*** aojea has joined #openstack-kuryr14:00
apuimedoltomasbo: these heat changes14:00
ltomasboapuimedo, I'm doing a few things on parallel14:01
ltomasboahh, those are in a VM with basic kuryr-kubernetes + heat14:01
ltomasboml2/ovs14:01
ltomasboapuimedo, and it did not matter the OS::Heat:ResourceGroup, with the registry it does not work either14:02
apuimedoltomasbo: did you try talking to the heat folks?14:04
*** yamamoto has quit IRC14:04
*** aojea has quit IRC14:05
ltomasboapuimedo, heat channel? do you know who can I ping?14:05
apuimedoI'll go there and try to look at the names to remember who I talked to last time14:07
ltomasboI asked this morning without pinging anyone, but did not get any reply14:08
apuimedook14:09
dulekltomasbo: zaneb was helpful last time I've had a problem.14:10
apuimedoexactly!14:10
apuimedothat's it14:10
ltomasbothanks dulek! I'll try!14:10
apuimedozane!14:10
apuimedothat's who I talked to14:10
*** gouthamr has joined #openstack-kuryr14:11
*** yamamoto has joined #openstack-kuryr14:15
openstackgerritDanil Golov proposed openstack/kuryr-kubernetes master: Add VIF-Handler And Drivers Design approach  https://review.openstack.org/51371514:20
ltomasbodulek, you were right, that is the right guy to ask!14:37
apuimedo:-)14:41
ltomasboand yes, it is a heat problem... I was getting crazy...14:41
openstackgerritAntoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: add openshift support  https://review.openstack.org/49793314:42
apuimedodulek: I fixed 'the sudo thing'14:42
*** yamamoto has quit IRC14:44
*** hongbin has joined #openstack-kuryr14:48
*** yamamoto has joined #openstack-kuryr14:50
*** yamamoto has quit IRC14:54
ltomasbodulek, testing your last patch for containerized + daemon14:56
ltomasboprocesses wise seems ok, and containers are running14:56
ltomasbo...but...14:56
ltomasbo kubectl get pods -o wide | awk '{print "ping -c 1 " $6}' | sed 1d | sh | grep received14:56
ltomasbo1 packets transmitted, 0 received, 100% packet loss, time 0ms14:56
ltomasbo1 packets transmitted, 0 received, 100% packet loss, time 0ms14:56
ltomasbo1 packets transmitted, 0 received, 100% packet loss, time 0ms14:56
ltomasbo1 packets transmitted, 0 received, 100% packet loss, time 0ms14:56
ltomasbo1 packets transmitted, 0 received, 100% packet loss, time 0ms14:56
ltomasbo1 packets transmitted, 0 received, 100% packet loss, time 0ms14:56
ltomasbo1 packets transmitted, 0 received, 100% packet loss, time 0ms14:56
*** garyloug_ has joined #openstack-kuryr15:00
*** janki has quit IRC15:00
*** aojea has joined #openstack-kuryr15:01
*** aojea has quit IRC15:05
*** janonymous has joined #openstack-kuryr15:12
dulekltomasbo: Ha… Checking…15:32
*** yamamoto has joined #openstack-kuryr15:35
*** yamamoto has quit IRC15:39
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: Do not merge: Running OpenShift on gates  https://review.openstack.org/52107715:42
*** aojea has joined #openstack-kuryr16:02
*** aojea has quit IRC16:06
dulekltomasbo: Aaaah, it's happening again… :(16:10
apuimedodulek: what is?16:10
dulekapuimedo: After scaling ~50 pods some of them have IP, but are unpingable.16:11
dulekapuimedo: I've fought that last week and thought I've succeeded.16:11
apuimedodulek: what do you think is the issue?16:12
dulekapuimedo: Last time it was related to CNI sending ADD-DEL-ADD-DEL. ADD, DEL, and last DEL were related to CONTAINERID A, while successful second ADD was related to CONTAINERID B.16:13
dulekI think I've fixed that, so let's see if that's that happens here…16:13
dulekYeah, it's exactly that, even though I see from the logs that my solution is running. It's just… losing data.16:18
dulekI have a hypothesis… Okay, let's check it.16:19
*** yamamoto has joined #openstack-kuryr16:20
*** yamamoto has quit IRC16:25
*** jistr has quit IRC16:39
*** jistr has joined #openstack-kuryr16:43
dulekapuimedo: Do you have an example on how https://review.openstack.org/#/c/476489/ can be used?16:46
apuimedoyou need to add the method=FORK16:57
apuimedoin the config file16:57
dulekapuimedo: Sure, but do I need to import the options into Kuryr or anything?16:58
dulekapuimedo: And what's the config section the option should be put in?16:59
apuimedoI think it should work to have them in kuryr.conf in the [privsep] section16:59
dulekapuimedo: Okay, let's check it out…16:59
apuimedoI did try it16:59
apuimedobut I don't remember any more16:59
apuimedoxD16:59
dulek:)17:00
dulekI'm trying to modify helper_command option that is already there.17:01
dulekI want to remove "sudo" from there.17:01
*** aojea has joined #openstack-kuryr17:03
*** aojea has quit IRC17:07
apuimedosudo won't be used in fork mode17:07
*** yamamoto has joined #openstack-kuryr17:18
*** yamamoto has quit IRC17:19
dulekapuimedo: Yeah, I know, but I'm looking for an other way to work around it. FORK mode doesn't work too well in container for me…17:21
dulekapuimedo: Those "broken pipe" errors, I don't know why those happen.17:22
*** dougbtv_ has joined #openstack-kuryr17:22
dulekapuimedo: But I think those exceptions are killing multiprocessing.manager threads, so changes to registry dict do not propagate to the rest of the processes. :(17:23
*** janonymous has quit IRC17:38
*** salv-orlando has joined #openstack-kuryr17:46
*** salv-orl_ has quit IRC17:46
*** dougbtv_ has quit IRC17:51
*** aojea has joined #openstack-kuryr18:03
*** aojea has quit IRC18:07
*** yamamoto has joined #openstack-kuryr18:19
*** yamamoto has quit IRC18:27
*** yboaron__ has joined #openstack-kuryr18:48
*** aojea has joined #openstack-kuryr18:51
*** aojea has quit IRC18:51
*** aojea has joined #openstack-kuryr18:51
*** aojea has quit IRC19:02
*** garyloug_ has quit IRC19:26
*** gouthamr has quit IRC19:35
*** danil has quit IRC20:01
*** salv-orl_ has joined #openstack-kuryr21:32
*** salv-orlando has quit IRC21:35
*** yamamoto has joined #openstack-kuryr23:04
*** yamamoto has quit IRC23:05
*** yamamoto has joined #openstack-kuryr23:11
*** yamamoto has quit IRC23:16
*** vikasc has quit IRC23:21
*** yboaron__ has quit IRC23:28
*** gouthamr_ has joined #openstack-kuryr23:35
*** vikasc has joined #openstack-kuryr23:42
*** vikasc has quit IRC23:49
*** pcaruana has quit IRC23:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!