Monday, 2017-10-30

*** salv-orlando has joined #openstack-kuryr00:46
*** salv-orlando has quit IRC00:51
*** kiennt26 has joined #openstack-kuryr01:09
*** wangbo has joined #openstack-kuryr01:28
*** caowei has joined #openstack-kuryr01:41
*** wangbo has quit IRC01:56
*** dougbtv has quit IRC01:56
*** wangbo has joined #openstack-kuryr01:57
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978102:08
*** wangbo has quit IRC02:09
*** wangbo has joined #openstack-kuryr02:11
*** salv-orlando has joined #openstack-kuryr02:47
*** salv-orlando has quit IRC02:51
*** wangbo has quit IRC03:33
*** wangbo has joined #openstack-kuryr03:43
*** janki has joined #openstack-kuryr04:35
*** wangbo has quit IRC04:36
*** atoth_ has quit IRC04:40
*** atoth_ has joined #openstack-kuryr04:41
*** salv-orlando has joined #openstack-kuryr04:48
*** salv-orlando has quit IRC04:52
*** pmannidi is now known as pmannidi|bomgar04:53
*** pmannidi|bomgar is now known as pmannidi04:53
*** apuimedo has joined #openstack-kuryr05:17
*** atoth_ has quit IRC05:24
*** wangbo has joined #openstack-kuryr05:25
*** atoth has joined #openstack-kuryr05:40
*** salv-orlando has joined #openstack-kuryr06:08
*** pc_m has quit IRC06:41
*** salv-orlando has quit IRC06:46
*** pc_m has joined #openstack-kuryr06:48
*** salv-orlando has joined #openstack-kuryr06:48
*** eqzceetuuq has joined #openstack-kuryr07:03
*** ukvnceuiij has joined #openstack-kuryr07:04
*** pmannidi has quit IRC07:13
*** salv-orlando has quit IRC07:35
*** salv-orlando has joined #openstack-kuryr07:36
*** yamamoto has quit IRC07:55
*** salv-orlando has quit IRC07:59
*** salv-orlando has joined #openstack-kuryr08:00
*** salv-orl_ has joined #openstack-kuryr08:02
*** wangbo has quit IRC08:04
*** wangbo has joined #openstack-kuryr08:04
*** salv-orlando has quit IRC08:04
*** wangbo_ has joined #openstack-kuryr08:13
*** wangbo has quit IRC08:14
openstackgerritDaniel Mellado proposed openstack/kuryr-kubernetes master: Add icmp sg rules to k8s project  https://review.openstack.org/51535708:30
*** salv-orl_ has quit IRC08:32
*** salv-orlando has joined #openstack-kuryr08:33
*** salv-orlando has quit IRC08:33
*** salv-orlando has joined #openstack-kuryr08:33
openstackgerritLuis Tomas Bolivar proposed openstack/kuryr-kubernetes master: Avoid neutron calls at recovering precreated ports  https://review.openstack.org/51015708:46
ltomasbohi apuimedo, dulek, I tested the devstack openshift patch set08:49
ltomasboafter moving to lbaasv2 instead of octavia, the stack completed, however, there is no available nodes to deploy the pods08:50
dulekltomasbo: Is it just my env, or does it fail on duplicated kuryr-k8s-pod subnet being duplicated?08:50
dulekltomasbo: Okay, my env… :(08:50
ltomasbodulek, , it is not duplicated for me08:51
ltomasboperhaps you had some leftovers from previous stacks08:51
*** yamamoto has joined #openstack-kuryr08:55
openstackgerritDaniel Mellado proposed openstack/kuryr-kubernetes master: [WIP] Add icmp sg rules to k8s project  https://review.openstack.org/51535708:57
*** yamamoto has quit IRC09:04
dmelladothat could probably be09:11
dmelladodulek: even if painful I'd try to recreate the vm while testing this09:11
dmellado:\09:11
dulekdmellado: One last try, I've came up with an idea about the cause.09:13
* dulek haven't drank enough coffee last Friday, probably.09:13
*** yamamoto has joined #openstack-kuryr09:13
dmelladodulek: if it makes you feel good enough I'm testing a patch against devstack which is trivial itself but I'm having to restack to test it09:14
dmelladoand it takes a ton of time! xD09:14
* dmellado sighs09:14
dulekltomasbo: Do openshift-master and openshift-node services stop on your DevStack?09:17
dulekltomasbo: I see those 2 left over after doing unstack.09:17
ltomasbodulek, let me check09:18
ltomasbodulek, no, they are stopped09:20
dulekltomasbo: You mean after unstack or by doing systemctl stop openshift-master?09:20
ltomasboI had it running, check systemctl status devstack@openshift-master (and node) and they were running09:21
ltomasbothen did unstack and checked again09:21
ltomasboand they are: inactive (dead)09:21
ltomasbodulek, ^^09:23
dulekltomasbo: Oh, right. That works, but process is still running in "ps aux".09:24
ltomasbolet me check that09:24
dulekltomasbo: And I can confirm that `kubectl get nodes` is empty after successful installation.09:25
ltomasbodulek, yep09:25
ltomasboroot      8311  3.3  2.4 947440 400192 ?       Sl   08:30   1:48 ./openshift start master --config=/opt/stack/data/openshift/master-config.yaml09:25
ltomasboroot      8822  1.0  0.5 831412 90036 ?        Sl   08:30   0:35 ./openshift start node --kubeconfig=/opt/stack/data/openshift/master.kubelet-client.kubeconfig --enable=kubelet,plugins --network-plugin=cni09:25
ltomasbook, so something is missing/misconfigured09:25
dulekltomasbo: I see what - openshift is stasrted by /usr/local/bin/openshift script. I guess killing just the script isn't enough to kill the actual process which is ./openshift.09:27
dulek./openshift = /opt/stack/openshift09:27
dulekltomasbo: "Failed to list *v1.Node: User "system:anonymous" cannot list all nodes in the cluster"09:28
dulekThat I've found in node logs.09:28
dulekltomasbo: I guess it should have different user in the config?09:29
*** danil has joined #openstack-kuryr09:29
ltomasbodulek, umm, probably09:31
ltomasboI remember having some issues with the system:anonymous a while ago, but don't remember what was it09:32
ltomasboI think I had to create a default user or something like that09:32
ltomasbodmellado, I think this was what we found a couple of months (or more) ago, right?09:33
danilhello, folks. I have one question. I have 2 nodes (k8s-master and k8s-minion). I have installed kuryr-cni on minion but I still have kube-dns pod with error "Error syncing pod". I think it is typical error. How to resolve it?09:35
*** janonymous has joined #openstack-kuryr09:40
dmelladoltomasbo: yep, it kinda rings a bell09:43
openstackgerritDaniel Mellado proposed openstack/kuryr-kubernetes master: [WIP] Add icmp sg rules to k8s project  https://review.openstack.org/51535709:45
openstackgerritDaniel Mellado proposed openstack/kuryr-kubernetes master: [WIP] Add icmp sg rules to k8s project  https://review.openstack.org/51535709:49
openstackgerritKien Nguyen proposed openstack/kuryr-libnetwork master: Support shared kuryr subnetpool  https://review.openstack.org/51622809:50
*** yamamoto has quit IRC09:54
*** yboaron has joined #openstack-kuryr09:58
*** kiennt26 has quit IRC10:10
*** yamamoto has joined #openstack-kuryr10:16
*** wangbo_ has quit IRC10:16
*** caowei_ has joined #openstack-kuryr10:20
*** caowei has quit IRC10:21
*** caowei_ is now known as caowei10:21
*** yamamoto has quit IRC10:24
*** caowei has quit IRC10:24
apuimedoltomasbo: that is strange10:26
apuimedoabout the node not registering10:26
apuimedoI'll start again10:27
*** atoth has quit IRC10:30
ltomasboapuimedo, yep, but same happens to dulek10:31
ltomasboso I guess there is something missing10:31
apuimedook10:31
dulekapuimedo: I had commented on the review with logs.10:32
ltomasboI re-stacked again just in case, but still the same10:32
dulekapuimedo: Maybe that'll ring a bell for you.10:32
ltomasboapuimedo, btw, you told me to guide you for reviewing this one: https://review.openstack.org/#/c/510157/10:33
ltomasboapuimedo, if you have time, we can have a short BJ10:33
apuimedoltomasbo: sure10:35
ltomasboapuimedo, do you have time now?10:36
apuimedosure10:37
ltomasbohttps://bluejeans.com/465661800410:37
ltomasboapuimedo, ^^10:38
*** pcaruana has joined #openstack-kuryr10:57
*** wangbo_ has joined #openstack-kuryr11:00
openstackgerritDaniel Mellado proposed openstack/kuryr-kubernetes master: Add icmp sg rules to k8s project  https://review.openstack.org/51535711:18
ltomasbodulek, I'm testing your cni-split now (it is noticeable faster!)11:20
ltomasbobut I see too many kuryr-daemon-server workers11:20
ltomasbohttp://paste.openstack.org/show/624955/11:20
dulekltomasbo: Finally it does what it's supposed to be.11:20
dulekltomasbo: Hm, can you elaborate? Are threads not dying?11:20
ltomasboeven after deleting the pods11:20
ltomasboeverytime a new pods is created 4 or 5 more are created11:21
ltomasboand then, after the pod gets removed, they are note cleaned up11:22
dulekltomasbo: That might be specific of the webserver, that it pools workers. But I've enabled thread mode in the werkzeug webserver, so those shouldn't be processes…11:23
dulekI'll take a look at that.11:23
ltomasbodulek, ok, let me know if I can help (or if you want access to the env)11:23
dulekltomasbo: Nah, that doesn't sound like env specific thing.11:24
ltomasboI don't think so either, it is a standard centos VM11:24
*** yamamoto has joined #openstack-kuryr11:25
*** salv-orlando has quit IRC11:28
*** salv-orlando has joined #openstack-kuryr11:29
*** atoth has joined #openstack-kuryr11:30
*** yamamoto has quit IRC11:32
openstackgerritDaniel Mellado proposed openstack/kuryr-kubernetes master: Add icmp sg rules to k8s project  https://review.openstack.org/51535711:38
*** yamamoto has joined #openstack-kuryr11:39
*** janonymous has quit IRC11:50
*** salv-orlando has quit IRC11:59
yboaronapuimedo, dulek : for the devstack openshift deployment - tried to deploy ( https://review.openstack.org/#/c/497933/ ) , my deployment is stuck at https://pastebin.com/zpi1uXwc12:13
yboaronthe default/kubernetes loadbalancer stucked at PENDING_CREATE12:14
yboaronapuimedo, dulek : Did u use some other patch ? or just  https://review.openstack.org/#/c/497933/12:15
dulekyboaron: Only this patch, but you also need latest version of devstack-plugin-container.12:20
dulekyboaron: Aaaah, but I've disabled Octavia.12:20
yboarondulek: so I assume it's the OCTAVIA12:21
ltomasboyep, I had to disable octavia too12:21
yboarondulek, ltomasbo : 10x , I'll disable OCTAVIA and restack12:22
yboarondulek, as per  devstack-plugin-container , do you mean the following commit   https://github.com/openstack/devstack-plugin-container/commit/f3c2d301fb2555ea7a50ed2fc2a016971da5432a ?12:24
dulekyboaron: Yes12:24
yboarondulek, 10x ,it's included in latest master devstack12:25
*** yamamoto has quit IRC12:43
*** salv-orlando has joined #openstack-kuryr13:00
*** salv-orlando has quit IRC13:06
*** janki has quit IRC13:06
*** wangbo_ has quit IRC13:07
*** salv-orlando has joined #openstack-kuryr13:30
*** yamamoto has joined #openstack-kuryr13:39
*** kiennt26 has joined #openstack-kuryr13:40
*** hongbin has joined #openstack-kuryr14:00
dmelladofolks, meeting?14:01
*** salv-orlando has quit IRC14:02
ltomasboapuimedo, irenab ^^14:02
dmelladohongbin: kiennt26  yboaron14:04
hongbino/14:04
kiennt26o/14:05
yboarondmellado, yep14:05
*** salv-orlando has joined #openstack-kuryr14:24
dulekdmellado: You know that New Zealand is exactly on the other side of the globe from Madrid? So it could be worse than Sydney. :D14:56
ltomasboxD14:56
dmelladodulek: well... so,so xD14:56
dulekdmellado: https://www.freemaptools.com/tunnel-to-other-side-of-the-earth.htm - it was fun to check. At least as long I'm not the one flying. :D14:57
dmelladodulek: we can still get you to do a talk there xD14:58
irenabdmellado: are you doing any talk?14:59
dmelladoirenab: yeah, I guess two and perhaps tree14:59
dmelladothree14:59
dmelladoxD14:59
dmelladoI'll be doing the kuryr project updates talk alongside toni14:59
dulekdmellado: Oh please no, my girlfriend would kill me. By being jealous. ;)15:00
dmelladothen we need to check what do we do with the 'nfv ready containers...'15:00
dmelladoand I had a third one regarding upstream workflows15:00
dmelladoso I still need to do some slides this week xD15:00
dulekdmellado: Won't you have enough time on the plane?15:01
dmelladodulek: yeah, probably15:01
dmelladobut my plan is to get my bags ready and then go party with some friends15:01
dmelladoso I don't get any sleep prior to getting into the flight15:02
dmelladoxD15:02
irenabdmellado: wow, a lot of preparation. You can loop me in for the project update prep.15:02
dmelladoirenab: oh, thanks! I've a meeting tomorrow with toni15:02
dulekdmellado: Nice plan!15:02
dmelladolet me invite you as well15:02
irenabdmellado: fine, will be glad to help (and I still feeling guilty to not doing it with toni …)15:03
dmelladoirenab: I know! xD15:03
dmelladoyou owe me a beer! xD15:03
dmelladobut I'll have toni pay for it15:04
*** salv-orlando has quit IRC15:04
dmelladoso no worries15:04
irenabdmellado:  :)15:04
dmelladoirenab: sent! let me know if it collides with anything from your side and I'll try changing it15:04
irenabdmellado: I can do till 14:30 my time15:05
dmelladoirenab: I guess it'll be enough, so no worries ;)15:05
irenabI received it to 16:0015:05
dmelladooh, I was thinking *my time*15:06
irenabnot sure about current time difference15:06
dmelladolet me check15:06
*** salv-orlando has joined #openstack-kuryr15:06
dmelladoirenab: check now xD15:07
* dmellado has nothing but meetings tomorrow!!!15:07
dmelladoxD15:07
irenabdmellado: perfect15:08
dmelladoirenab: awesome, thanks!15:08
*** salv-orl_ has joined #openstack-kuryr15:23
*** salv-orlando has quit IRC15:27
*** kiennt26 has quit IRC15:30
*** yamamoto has quit IRC15:40
*** yamamoto has joined #openstack-kuryr15:41
*** yamamoto has quit IRC15:45
*** yamamoto has joined #openstack-kuryr15:45
dulekdmellado: ping16:19
openstackgerritDaniel Mellado proposed openstack/kuryr-kubernetes master: Add icmp sg rules to k8s project  https://review.openstack.org/51535716:20
dmelladodulek: pong16:20
dulekdmellado: So you've said you have experience with uwsgi?16:20
dmelladodulek: I touched some stuff back there, yeah16:20
dulekdmellado: So I have this cotyledon-based app now - it runs 2 child-services.16:21
dulekdmellado: I wanted one to be watcher and second to be HTTP server. They communicate over multiprocessing.Queue (watcher puts (pod, vif) tuples in there).16:22
dmelladogot it16:22
dulekdmellado: Can I run that under uwsgi? I mean - I'd want second child process to run a server.16:22
dmelladohmmm dulek I'd need to check that16:23
dulekdmellado: I see that uwsgi tutorials require application being the global module, so I don't really know how to approach it.16:23
dmelladotoo much of a context switch now xD16:23
dulekOkay, sure.16:23
dmelladodo you have any ongoing patches that I could take a look to?16:23
dulekdmellado: https://review.openstack.org/#/c/51518616:24
dmelladodulek: ?16:24
dmelladodulek: ack, will have a look and get back to you tomorrow ;)16:24
dulekdmellado: The app is here: https://review.openstack.org/#/c/515186/2/kuryr_kubernetes/cni/daemon/service.py16:24
dmelladobtw, in case anyone's interested I found out the error on my patch16:24
dmelladoand basically its a IDoNeedMoreCoffeeError16:24
dmelladoxD16:24
apuimedodulek: did you check how we do it in kuryr-libnetwork?16:25
*** danil has quit IRC16:26
dulekapuimedo: Yes, kuryr-libnetwork is written like classic WSGI app, no elaborate signal handling or forking like cotyledon does.16:26
apuimedook, just checking16:26
dmelladooh, I see16:27
dulekapuimedo: I mean I can get my WSGI application out into the global var or module, but where do I do CotyledonService.run() to make sure it'll cooperate with WSGI.16:27
dmelladofolks, need to drop to the market or I'll die of starvation16:27
dmelladodulek: I'll take a look at your patch and questions and I'll ping you back ;)16:28
apuimedodmellado: fasting is trendy now16:28
dmelladolol16:28
apuimedodulek: I don't know16:28
apuimedodid you ask the octavia folks?16:28
apuimedomaybe they'll know16:28
dulekapuimedo: Oh, not a bad idea I haven't looked at their code. Thanks!16:29
apuimedo;-)16:31
apuimedothere was another project using it16:31
apuimedoI don't remember which now16:31
*** yboaron has quit IRC16:35
dulekapuimedo: Most likely you mean Aodh and Ceilometer. They're using Pecan.16:40
*** gouthamr has joined #openstack-kuryr16:40
apuimedodulek: "Why Cotyledon16:41
apuimedoThis library is mainly used in OpenStack Telemetry projects, in replacement of oslo.service."16:41
apuimedobut I don't know which telemetry projects it means16:41
dulekapuimedo: Yes, yes, I mean they're using Pecan for their webservers. Other services are running using cotyledon.16:42
apuimedooh16:42
dulekAnd as I want to do a mix… That doesn't help. :D16:42
apuimedoright16:42
dulekAnd I don't really want to split Watcher and API here…16:42
ltomasbodulek, what was the IDoNeedMoreCoffeeError?16:43
apuimedodulek: would using pecan be worth it? (instead of flask) I don't know Pecan at all16:43
dulekltomasbo: It was dmellado.16:43
dulekltomasbo: I mean dmellado mentioned IDoNeedMoreCoffeeError.16:43
ltomasboups, I read it too fast...16:43
apuimedomodels/controllers in the documentation16:43
apuimedoI'm already scared16:44
apuimedois this django or what?16:44
apuimedoxD16:44
ltomasboyep yep, I though you found the threads not being killed issue16:44
dulekapuimedo: I doubt it really, Pecan is just another framework. And our API is simple, so no need for anything elaborate.16:44
apuimedoagreed16:44
*** salv-orlando has joined #openstack-kuryr18:52
*** salv-orl_ has quit IRC18:55
*** atoth has quit IRC19:09
*** yamamoto has quit IRC19:16
*** dimak has quit IRC20:08
*** lihi has quit IRC20:08
*** leyal has quit IRC20:08
*** irenab has quit IRC20:08
*** oanson has quit IRC20:08
*** salv-orlando has quit IRC20:17
*** yamamoto has joined #openstack-kuryr20:17
*** salv-orlando has joined #openstack-kuryr20:17
*** salv-orlando has quit IRC20:21
*** yamamoto has quit IRC20:26
*** pcaruana has quit IRC21:15
*** salv-orlando has joined #openstack-kuryr21:18
*** salv-orlando has quit IRC21:22
*** dougbtv has joined #openstack-kuryr21:29
*** dougbtv has quit IRC21:32
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978121:41
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978122:02
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978122:02
*** leyal has joined #openstack-kuryr22:09
*** oanson has joined #openstack-kuryr22:09
*** irenab has joined #openstack-kuryr22:09
*** dimak has joined #openstack-kuryr22:09
*** lihi has joined #openstack-kuryr22:10
*** salv-orlando has joined #openstack-kuryr22:19
*** salv-orlando has quit IRC22:23
*** salv-orlando has joined #openstack-kuryr22:26
*** yamamoto has joined #openstack-kuryr23:17
*** hongbin has quit IRC23:23

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!