*** salv-orlando has joined #openstack-kuryr | 00:46 | |
*** salv-orlando has quit IRC | 00:51 | |
*** kiennt26 has joined #openstack-kuryr | 01:09 | |
*** wangbo has joined #openstack-kuryr | 01:28 | |
*** caowei has joined #openstack-kuryr | 01:41 | |
*** wangbo has quit IRC | 01:56 | |
*** dougbtv has quit IRC | 01:56 | |
*** wangbo has joined #openstack-kuryr | 01:57 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 02:08 |
---|---|---|
*** wangbo has quit IRC | 02:09 | |
*** wangbo has joined #openstack-kuryr | 02:11 | |
*** salv-orlando has joined #openstack-kuryr | 02:47 | |
*** salv-orlando has quit IRC | 02:51 | |
*** wangbo has quit IRC | 03:33 | |
*** wangbo has joined #openstack-kuryr | 03:43 | |
*** janki has joined #openstack-kuryr | 04:35 | |
*** wangbo has quit IRC | 04:36 | |
*** atoth_ has quit IRC | 04:40 | |
*** atoth_ has joined #openstack-kuryr | 04:41 | |
*** salv-orlando has joined #openstack-kuryr | 04:48 | |
*** salv-orlando has quit IRC | 04:52 | |
*** pmannidi is now known as pmannidi|bomgar | 04:53 | |
*** pmannidi|bomgar is now known as pmannidi | 04:53 | |
*** apuimedo has joined #openstack-kuryr | 05:17 | |
*** atoth_ has quit IRC | 05:24 | |
*** wangbo has joined #openstack-kuryr | 05:25 | |
*** atoth has joined #openstack-kuryr | 05:40 | |
*** salv-orlando has joined #openstack-kuryr | 06:08 | |
*** pc_m has quit IRC | 06:41 | |
*** salv-orlando has quit IRC | 06:46 | |
*** pc_m has joined #openstack-kuryr | 06:48 | |
*** salv-orlando has joined #openstack-kuryr | 06:48 | |
*** eqzceetuuq has joined #openstack-kuryr | 07:03 | |
*** ukvnceuiij has joined #openstack-kuryr | 07:04 | |
*** pmannidi has quit IRC | 07:13 | |
*** salv-orlando has quit IRC | 07:35 | |
*** salv-orlando has joined #openstack-kuryr | 07:36 | |
*** yamamoto has quit IRC | 07:55 | |
*** salv-orlando has quit IRC | 07:59 | |
*** salv-orlando has joined #openstack-kuryr | 08:00 | |
*** salv-orl_ has joined #openstack-kuryr | 08:02 | |
*** wangbo has quit IRC | 08:04 | |
*** wangbo has joined #openstack-kuryr | 08:04 | |
*** salv-orlando has quit IRC | 08:04 | |
*** wangbo_ has joined #openstack-kuryr | 08:13 | |
*** wangbo has quit IRC | 08:14 | |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-kubernetes master: Add icmp sg rules to k8s project https://review.openstack.org/515357 | 08:30 |
*** salv-orl_ has quit IRC | 08:32 | |
*** salv-orlando has joined #openstack-kuryr | 08:33 | |
*** salv-orlando has quit IRC | 08:33 | |
*** salv-orlando has joined #openstack-kuryr | 08:33 | |
openstackgerrit | Luis Tomas Bolivar proposed openstack/kuryr-kubernetes master: Avoid neutron calls at recovering precreated ports https://review.openstack.org/510157 | 08:46 |
ltomasbo | hi apuimedo, dulek, I tested the devstack openshift patch set | 08:49 |
ltomasbo | after moving to lbaasv2 instead of octavia, the stack completed, however, there is no available nodes to deploy the pods | 08:50 |
dulek | ltomasbo: Is it just my env, or does it fail on duplicated kuryr-k8s-pod subnet being duplicated? | 08:50 |
dulek | ltomasbo: Okay, my env… :( | 08:50 |
ltomasbo | dulek, , it is not duplicated for me | 08:51 |
ltomasbo | perhaps you had some leftovers from previous stacks | 08:51 |
*** yamamoto has joined #openstack-kuryr | 08:55 | |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-kubernetes master: [WIP] Add icmp sg rules to k8s project https://review.openstack.org/515357 | 08:57 |
*** yamamoto has quit IRC | 09:04 | |
dmellado | that could probably be | 09:11 |
dmellado | dulek: even if painful I'd try to recreate the vm while testing this | 09:11 |
dmellado | :\ | 09:11 |
dulek | dmellado: One last try, I've came up with an idea about the cause. | 09:13 |
* dulek haven't drank enough coffee last Friday, probably. | 09:13 | |
*** yamamoto has joined #openstack-kuryr | 09:13 | |
dmellado | dulek: if it makes you feel good enough I'm testing a patch against devstack which is trivial itself but I'm having to restack to test it | 09:14 |
dmellado | and it takes a ton of time! xD | 09:14 |
* dmellado sighs | 09:14 | |
dulek | ltomasbo: Do openshift-master and openshift-node services stop on your DevStack? | 09:17 |
dulek | ltomasbo: I see those 2 left over after doing unstack. | 09:17 |
ltomasbo | dulek, let me check | 09:18 |
ltomasbo | dulek, no, they are stopped | 09:20 |
dulek | ltomasbo: You mean after unstack or by doing systemctl stop openshift-master? | 09:20 |
ltomasbo | I had it running, check systemctl status devstack@openshift-master (and node) and they were running | 09:21 |
ltomasbo | then did unstack and checked again | 09:21 |
ltomasbo | and they are: inactive (dead) | 09:21 |
ltomasbo | dulek, ^^ | 09:23 |
dulek | ltomasbo: Oh, right. That works, but process is still running in "ps aux". | 09:24 |
ltomasbo | let me check that | 09:24 |
dulek | ltomasbo: And I can confirm that `kubectl get nodes` is empty after successful installation. | 09:25 |
ltomasbo | dulek, yep | 09:25 |
ltomasbo | root 8311 3.3 2.4 947440 400192 ? Sl 08:30 1:48 ./openshift start master --config=/opt/stack/data/openshift/master-config.yaml | 09:25 |
ltomasbo | root 8822 1.0 0.5 831412 90036 ? Sl 08:30 0:35 ./openshift start node --kubeconfig=/opt/stack/data/openshift/master.kubelet-client.kubeconfig --enable=kubelet,plugins --network-plugin=cni | 09:25 |
ltomasbo | ok, so something is missing/misconfigured | 09:25 |
dulek | ltomasbo: I see what - openshift is stasrted by /usr/local/bin/openshift script. I guess killing just the script isn't enough to kill the actual process which is ./openshift. | 09:27 |
dulek | ./openshift = /opt/stack/openshift | 09:27 |
dulek | ltomasbo: "Failed to list *v1.Node: User "system:anonymous" cannot list all nodes in the cluster" | 09:28 |
dulek | That I've found in node logs. | 09:28 |
dulek | ltomasbo: I guess it should have different user in the config? | 09:29 |
*** danil has joined #openstack-kuryr | 09:29 | |
ltomasbo | dulek, umm, probably | 09:31 |
ltomasbo | I remember having some issues with the system:anonymous a while ago, but don't remember what was it | 09:32 |
ltomasbo | I think I had to create a default user or something like that | 09:32 |
ltomasbo | dmellado, I think this was what we found a couple of months (or more) ago, right? | 09:33 |
danil | hello, folks. I have one question. I have 2 nodes (k8s-master and k8s-minion). I have installed kuryr-cni on minion but I still have kube-dns pod with error "Error syncing pod". I think it is typical error. How to resolve it? | 09:35 |
*** janonymous has joined #openstack-kuryr | 09:40 | |
dmellado | ltomasbo: yep, it kinda rings a bell | 09:43 |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-kubernetes master: [WIP] Add icmp sg rules to k8s project https://review.openstack.org/515357 | 09:45 |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-kubernetes master: [WIP] Add icmp sg rules to k8s project https://review.openstack.org/515357 | 09:49 |
openstackgerrit | Kien Nguyen proposed openstack/kuryr-libnetwork master: Support shared kuryr subnetpool https://review.openstack.org/516228 | 09:50 |
*** yamamoto has quit IRC | 09:54 | |
*** yboaron has joined #openstack-kuryr | 09:58 | |
*** kiennt26 has quit IRC | 10:10 | |
*** yamamoto has joined #openstack-kuryr | 10:16 | |
*** wangbo_ has quit IRC | 10:16 | |
*** caowei_ has joined #openstack-kuryr | 10:20 | |
*** caowei has quit IRC | 10:21 | |
*** caowei_ is now known as caowei | 10:21 | |
*** yamamoto has quit IRC | 10:24 | |
*** caowei has quit IRC | 10:24 | |
apuimedo | ltomasbo: that is strange | 10:26 |
apuimedo | about the node not registering | 10:26 |
apuimedo | I'll start again | 10:27 |
*** atoth has quit IRC | 10:30 | |
ltomasbo | apuimedo, yep, but same happens to dulek | 10:31 |
ltomasbo | so I guess there is something missing | 10:31 |
apuimedo | ok | 10:31 |
dulek | apuimedo: I had commented on the review with logs. | 10:32 |
ltomasbo | I re-stacked again just in case, but still the same | 10:32 |
dulek | apuimedo: Maybe that'll ring a bell for you. | 10:32 |
ltomasbo | apuimedo, btw, you told me to guide you for reviewing this one: https://review.openstack.org/#/c/510157/ | 10:33 |
ltomasbo | apuimedo, if you have time, we can have a short BJ | 10:33 |
apuimedo | ltomasbo: sure | 10:35 |
ltomasbo | apuimedo, do you have time now? | 10:36 |
apuimedo | sure | 10:37 |
ltomasbo | https://bluejeans.com/4656618004 | 10:37 |
ltomasbo | apuimedo, ^^ | 10:38 |
*** pcaruana has joined #openstack-kuryr | 10:57 | |
*** wangbo_ has joined #openstack-kuryr | 11:00 | |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-kubernetes master: Add icmp sg rules to k8s project https://review.openstack.org/515357 | 11:18 |
ltomasbo | dulek, I'm testing your cni-split now (it is noticeable faster!) | 11:20 |
ltomasbo | but I see too many kuryr-daemon-server workers | 11:20 |
ltomasbo | http://paste.openstack.org/show/624955/ | 11:20 |
dulek | ltomasbo: Finally it does what it's supposed to be. | 11:20 |
dulek | ltomasbo: Hm, can you elaborate? Are threads not dying? | 11:20 |
ltomasbo | even after deleting the pods | 11:20 |
ltomasbo | everytime a new pods is created 4 or 5 more are created | 11:21 |
ltomasbo | and then, after the pod gets removed, they are note cleaned up | 11:22 |
dulek | ltomasbo: That might be specific of the webserver, that it pools workers. But I've enabled thread mode in the werkzeug webserver, so those shouldn't be processes… | 11:23 |
dulek | I'll take a look at that. | 11:23 |
ltomasbo | dulek, ok, let me know if I can help (or if you want access to the env) | 11:23 |
dulek | ltomasbo: Nah, that doesn't sound like env specific thing. | 11:24 |
ltomasbo | I don't think so either, it is a standard centos VM | 11:24 |
*** yamamoto has joined #openstack-kuryr | 11:25 | |
*** salv-orlando has quit IRC | 11:28 | |
*** salv-orlando has joined #openstack-kuryr | 11:29 | |
*** atoth has joined #openstack-kuryr | 11:30 | |
*** yamamoto has quit IRC | 11:32 | |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-kubernetes master: Add icmp sg rules to k8s project https://review.openstack.org/515357 | 11:38 |
*** yamamoto has joined #openstack-kuryr | 11:39 | |
*** janonymous has quit IRC | 11:50 | |
*** salv-orlando has quit IRC | 11:59 | |
yboaron | apuimedo, dulek : for the devstack openshift deployment - tried to deploy ( https://review.openstack.org/#/c/497933/ ) , my deployment is stuck at https://pastebin.com/zpi1uXwc | 12:13 |
yboaron | the default/kubernetes loadbalancer stucked at PENDING_CREATE | 12:14 |
yboaron | apuimedo, dulek : Did u use some other patch ? or just https://review.openstack.org/#/c/497933/ | 12:15 |
dulek | yboaron: Only this patch, but you also need latest version of devstack-plugin-container. | 12:20 |
dulek | yboaron: Aaaah, but I've disabled Octavia. | 12:20 |
yboaron | dulek: so I assume it's the OCTAVIA | 12:21 |
ltomasbo | yep, I had to disable octavia too | 12:21 |
yboaron | dulek, ltomasbo : 10x , I'll disable OCTAVIA and restack | 12:22 |
yboaron | dulek, as per devstack-plugin-container , do you mean the following commit https://github.com/openstack/devstack-plugin-container/commit/f3c2d301fb2555ea7a50ed2fc2a016971da5432a ? | 12:24 |
dulek | yboaron: Yes | 12:24 |
yboaron | dulek, 10x ,it's included in latest master devstack | 12:25 |
*** yamamoto has quit IRC | 12:43 | |
*** salv-orlando has joined #openstack-kuryr | 13:00 | |
*** salv-orlando has quit IRC | 13:06 | |
*** janki has quit IRC | 13:06 | |
*** wangbo_ has quit IRC | 13:07 | |
*** salv-orlando has joined #openstack-kuryr | 13:30 | |
*** yamamoto has joined #openstack-kuryr | 13:39 | |
*** kiennt26 has joined #openstack-kuryr | 13:40 | |
*** hongbin has joined #openstack-kuryr | 14:00 | |
dmellado | folks, meeting? | 14:01 |
*** salv-orlando has quit IRC | 14:02 | |
ltomasbo | apuimedo, irenab ^^ | 14:02 |
dmellado | hongbin: kiennt26 yboaron | 14:04 |
hongbin | o/ | 14:04 |
kiennt26 | o/ | 14:05 |
yboaron | dmellado, yep | 14:05 |
*** salv-orlando has joined #openstack-kuryr | 14:24 | |
dulek | dmellado: You know that New Zealand is exactly on the other side of the globe from Madrid? So it could be worse than Sydney. :D | 14:56 |
ltomasbo | xD | 14:56 |
dmellado | dulek: well... so,so xD | 14:56 |
dulek | dmellado: https://www.freemaptools.com/tunnel-to-other-side-of-the-earth.htm - it was fun to check. At least as long I'm not the one flying. :D | 14:57 |
dmellado | dulek: we can still get you to do a talk there xD | 14:58 |
irenab | dmellado: are you doing any talk? | 14:59 |
dmellado | irenab: yeah, I guess two and perhaps tree | 14:59 |
dmellado | three | 14:59 |
dmellado | xD | 14:59 |
dmellado | I'll be doing the kuryr project updates talk alongside toni | 14:59 |
dulek | dmellado: Oh please no, my girlfriend would kill me. By being jealous. ;) | 15:00 |
dmellado | then we need to check what do we do with the 'nfv ready containers...' | 15:00 |
dmellado | and I had a third one regarding upstream workflows | 15:00 |
dmellado | so I still need to do some slides this week xD | 15:00 |
dulek | dmellado: Won't you have enough time on the plane? | 15:01 |
dmellado | dulek: yeah, probably | 15:01 |
dmellado | but my plan is to get my bags ready and then go party with some friends | 15:01 |
dmellado | so I don't get any sleep prior to getting into the flight | 15:02 |
dmellado | xD | 15:02 |
irenab | dmellado: wow, a lot of preparation. You can loop me in for the project update prep. | 15:02 |
dmellado | irenab: oh, thanks! I've a meeting tomorrow with toni | 15:02 |
dulek | dmellado: Nice plan! | 15:02 |
dmellado | let me invite you as well | 15:02 |
irenab | dmellado: fine, will be glad to help (and I still feeling guilty to not doing it with toni …) | 15:03 |
dmellado | irenab: I know! xD | 15:03 |
dmellado | you owe me a beer! xD | 15:03 |
dmellado | but I'll have toni pay for it | 15:04 |
*** salv-orlando has quit IRC | 15:04 | |
dmellado | so no worries | 15:04 |
irenab | dmellado: :) | 15:04 |
dmellado | irenab: sent! let me know if it collides with anything from your side and I'll try changing it | 15:04 |
irenab | dmellado: I can do till 14:30 my time | 15:05 |
dmellado | irenab: I guess it'll be enough, so no worries ;) | 15:05 |
irenab | I received it to 16:00 | 15:05 |
dmellado | oh, I was thinking *my time* | 15:06 |
irenab | not sure about current time difference | 15:06 |
dmellado | let me check | 15:06 |
*** salv-orlando has joined #openstack-kuryr | 15:06 | |
dmellado | irenab: check now xD | 15:07 |
* dmellado has nothing but meetings tomorrow!!! | 15:07 | |
dmellado | xD | 15:07 |
irenab | dmellado: perfect | 15:08 |
dmellado | irenab: awesome, thanks! | 15:08 |
*** salv-orl_ has joined #openstack-kuryr | 15:23 | |
*** salv-orlando has quit IRC | 15:27 | |
*** kiennt26 has quit IRC | 15:30 | |
*** yamamoto has quit IRC | 15:40 | |
*** yamamoto has joined #openstack-kuryr | 15:41 | |
*** yamamoto has quit IRC | 15:45 | |
*** yamamoto has joined #openstack-kuryr | 15:45 | |
dulek | dmellado: ping | 16:19 |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-kubernetes master: Add icmp sg rules to k8s project https://review.openstack.org/515357 | 16:20 |
dmellado | dulek: pong | 16:20 |
dulek | dmellado: So you've said you have experience with uwsgi? | 16:20 |
dmellado | dulek: I touched some stuff back there, yeah | 16:20 |
dulek | dmellado: So I have this cotyledon-based app now - it runs 2 child-services. | 16:21 |
dulek | dmellado: I wanted one to be watcher and second to be HTTP server. They communicate over multiprocessing.Queue (watcher puts (pod, vif) tuples in there). | 16:22 |
dmellado | got it | 16:22 |
dulek | dmellado: Can I run that under uwsgi? I mean - I'd want second child process to run a server. | 16:22 |
dmellado | hmmm dulek I'd need to check that | 16:23 |
dulek | dmellado: I see that uwsgi tutorials require application being the global module, so I don't really know how to approach it. | 16:23 |
dmellado | too much of a context switch now xD | 16:23 |
dulek | Okay, sure. | 16:23 |
dmellado | do you have any ongoing patches that I could take a look to? | 16:23 |
dulek | dmellado: https://review.openstack.org/#/c/515186 | 16:24 |
dmellado | dulek: ? | 16:24 |
dmellado | dulek: ack, will have a look and get back to you tomorrow ;) | 16:24 |
dulek | dmellado: The app is here: https://review.openstack.org/#/c/515186/2/kuryr_kubernetes/cni/daemon/service.py | 16:24 |
dmellado | btw, in case anyone's interested I found out the error on my patch | 16:24 |
dmellado | and basically its a IDoNeedMoreCoffeeError | 16:24 |
dmellado | xD | 16:24 |
apuimedo | dulek: did you check how we do it in kuryr-libnetwork? | 16:25 |
*** danil has quit IRC | 16:26 | |
dulek | apuimedo: Yes, kuryr-libnetwork is written like classic WSGI app, no elaborate signal handling or forking like cotyledon does. | 16:26 |
apuimedo | ok, just checking | 16:26 |
dmellado | oh, I see | 16:27 |
dulek | apuimedo: I mean I can get my WSGI application out into the global var or module, but where do I do CotyledonService.run() to make sure it'll cooperate with WSGI. | 16:27 |
dmellado | folks, need to drop to the market or I'll die of starvation | 16:27 |
dmellado | dulek: I'll take a look at your patch and questions and I'll ping you back ;) | 16:28 |
apuimedo | dmellado: fasting is trendy now | 16:28 |
dmellado | lol | 16:28 |
apuimedo | dulek: I don't know | 16:28 |
apuimedo | did you ask the octavia folks? | 16:28 |
apuimedo | maybe they'll know | 16:28 |
dulek | apuimedo: Oh, not a bad idea I haven't looked at their code. Thanks! | 16:29 |
apuimedo | ;-) | 16:31 |
apuimedo | there was another project using it | 16:31 |
apuimedo | I don't remember which now | 16:31 |
*** yboaron has quit IRC | 16:35 | |
dulek | apuimedo: Most likely you mean Aodh and Ceilometer. They're using Pecan. | 16:40 |
*** gouthamr has joined #openstack-kuryr | 16:40 | |
apuimedo | dulek: "Why Cotyledon | 16:41 |
apuimedo | This library is mainly used in OpenStack Telemetry projects, in replacement of oslo.service." | 16:41 |
apuimedo | but I don't know which telemetry projects it means | 16:41 |
dulek | apuimedo: Yes, yes, I mean they're using Pecan for their webservers. Other services are running using cotyledon. | 16:42 |
apuimedo | oh | 16:42 |
dulek | And as I want to do a mix… That doesn't help. :D | 16:42 |
apuimedo | right | 16:42 |
dulek | And I don't really want to split Watcher and API here… | 16:42 |
ltomasbo | dulek, what was the IDoNeedMoreCoffeeError? | 16:43 |
apuimedo | dulek: would using pecan be worth it? (instead of flask) I don't know Pecan at all | 16:43 |
dulek | ltomasbo: It was dmellado. | 16:43 |
dulek | ltomasbo: I mean dmellado mentioned IDoNeedMoreCoffeeError. | 16:43 |
ltomasbo | ups, I read it too fast... | 16:43 |
apuimedo | models/controllers in the documentation | 16:43 |
apuimedo | I'm already scared | 16:44 |
apuimedo | is this django or what? | 16:44 |
apuimedo | xD | 16:44 |
ltomasbo | yep yep, I though you found the threads not being killed issue | 16:44 |
dulek | apuimedo: I doubt it really, Pecan is just another framework. And our API is simple, so no need for anything elaborate. | 16:44 |
apuimedo | agreed | 16:44 |
*** salv-orlando has joined #openstack-kuryr | 18:52 | |
*** salv-orl_ has quit IRC | 18:55 | |
*** atoth has quit IRC | 19:09 | |
*** yamamoto has quit IRC | 19:16 | |
*** dimak has quit IRC | 20:08 | |
*** lihi has quit IRC | 20:08 | |
*** leyal has quit IRC | 20:08 | |
*** irenab has quit IRC | 20:08 | |
*** oanson has quit IRC | 20:08 | |
*** salv-orlando has quit IRC | 20:17 | |
*** yamamoto has joined #openstack-kuryr | 20:17 | |
*** salv-orlando has joined #openstack-kuryr | 20:17 | |
*** salv-orlando has quit IRC | 20:21 | |
*** yamamoto has quit IRC | 20:26 | |
*** pcaruana has quit IRC | 21:15 | |
*** salv-orlando has joined #openstack-kuryr | 21:18 | |
*** salv-orlando has quit IRC | 21:22 | |
*** dougbtv has joined #openstack-kuryr | 21:29 | |
*** dougbtv has quit IRC | 21:32 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 21:41 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 22:02 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 22:02 |
*** leyal has joined #openstack-kuryr | 22:09 | |
*** oanson has joined #openstack-kuryr | 22:09 | |
*** irenab has joined #openstack-kuryr | 22:09 | |
*** dimak has joined #openstack-kuryr | 22:09 | |
*** lihi has joined #openstack-kuryr | 22:10 | |
*** salv-orlando has joined #openstack-kuryr | 22:19 | |
*** salv-orlando has quit IRC | 22:23 | |
*** salv-orlando has joined #openstack-kuryr | 22:26 | |
*** yamamoto has joined #openstack-kuryr | 23:17 | |
*** hongbin has quit IRC | 23:23 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!