| *** pmannidi is now known as pmannidi|AFK | 07:27 | |
| *** pmannidi|AFK is now known as pmannidi | 07:49 | |
| *** pmannidi is now known as pmannidi|AFK | 09:40 | |
| opendevreview | Sunday Mgbogu proposed openstack/kuryr-kubernetes master: wip: KuryrLoadBalancer Listener Reconciliation https://review.opendev.org/c/openstack/kuryr-kubernetes/+/814077 | 10:11 |
|---|---|---|
| digitalsimboja | gryf: Any reason kuryr could get stuck on ContainerCreating mode for the past one hour? | 11:29 |
| digitalsimboja | See.. | 11:29 |
| digitalsimboja | dulek, https://paste.opendev.org/show/810832/ | 11:32 |
| gryf | digitalsimboja, kubectl describe demo-6cb99dfd4d-fmhpt | 11:33 |
| gryf | there should be some hints. | 11:34 |
| digitalsimboja | Here is the log: https://paste.opendev.org/show/810833/ | 11:34 |
| gryf | hm. aren't you ran out of disk space and/or ram? | 11:35 |
| digitalsimboja | let me check | 11:35 |
| digitalsimboja | https://paste.opendev.org/show/810835/ | 11:36 |
| digitalsimboja | I have still got | 11:36 |
| dulek | digitalsimboja: Try printing the logs with --no-pager, they're ellipsized now, so something might be missing. | 11:36 |
| digitalsimboja | ok | 11:36 |
| gryf | also, free -h would tell you more regarding memory. | 11:37 |
| digitalsimboja | https://paste.opendev.org/show/810836/ | 11:37 |
| dulek | Yeah, this seems to never get into a CNI ADD really, just like kubelet has no way of creating the netns. | 11:38 |
| digitalsimboja | gryf, Here is the memory: https://paste.opendev.org/show/810837/ | 11:38 |
| digitalsimboja | This was immediately after freshly deployed devstack | 11:38 |
| dulek | Oh wait, Resource not ready… | 11:38 |
| dulek | digitalsimboja: What's in kuryr-controller logs? | 11:39 |
| digitalsimboja | so I wonder what could make CNI get stuck | 11:39 |
| digitalsimboja | dulek, how do I access the kuryr-controller logs please? | 11:46 |
| dulek | `journalctl -u devstack@kuryr-kubernetes` most likely. | 11:48 |
| digitalsimboja | dulek, Here : https://paste.opendev.org/show/810839/ | 11:52 |
| digitalsimboja | This before the above: https://paste.opendev.org/show/810840/ | 11:54 |
| digitalsimboja | dulek ^ | 11:54 |
| dulek | #1 - Octavia seems to be down? | 11:55 |
| dulek | #2 - Syntax error is clearly a coding error. | 11:56 |
| gryf | right. | 11:56 |
| dulek | digitalsimboja: Yeah, looks like you've missed a ", " in that line 144. | 11:56 |
| dulek | Anyway next step will be to check status of devstack@octavia-api service and maybe restarting it. | 11:57 |
| digitalsimboja | syntax is my error yeaj | 12:01 |
| digitalsimboja | I have fixed the syntax error so let me check octavia status and then see if its down | 12:02 |
| digitalsimboja | by the way seems kuryr-controller service is down somehow: | 12:02 |
| digitalsimboja | dulek, here: https://paste.opendev.org/show/810841/ | 12:03 |
| gryf | digitalsimboja, just start it :) | 12:12 |
| digitalsimboja | Done that :) | 12:12 |
| digitalsimboja | Thanks | 12:12 |
| gryf | and check its status again after. | 12:12 |
| digitalsimboja | `running` | 12:13 |
| digitalsimboja | lets see | 12:13 |
| gryf | try to deploy something. | 12:13 |
| digitalsimboja | Fresh? | 12:17 |
| digitalsimboja | I just did and its on containerCreating | 12:18 |
| digitalsimboja | gryf, https://paste.opendev.org/show/810843/ | 12:19 |
| gryf | try kubectl describe, to see what's happening. | 12:21 |
| digitalsimboja | gryf, here: https://paste.opendev.org/show/810844/ | 12:25 |
| gryf | kubectl describe pod pod-name | 12:26 |
| digitalsimboja | https://paste.opendev.org/show/810845/ | 12:53 |
| gryf | kubectl get pod -A -o wode | 13:01 |
| gryf | *wide | 13:01 |
| opendevreview | Sunday Mgbogu proposed openstack/kuryr-kubernetes master: wip: KuryrLoadBalancer Listener Reconciliation https://review.opendev.org/c/openstack/kuryr-kubernetes/+/814077 | 14:04 |
| simboja | gryf, dulek: https://paste.opendev.org/show/810847/ | 14:09 |
| *** pmannidi|AFK is now known as pmannidi | 14:21 | |
| gryf | definitely there is an issue. btw, for using describe (or any other kubectl command) resources in other namespaces than default, you need to switch to that namespace or use '-n namespace-name'. | 15:29 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!