Tuesday, 2018-05-01

*** sfilatov has quit IRC00:02
*** sfilatov has joined #openstack-containers00:20
*** sfilatov has quit IRC00:24
*** sfilatov has joined #openstack-containers00:29
*** jmlowe has quit IRC00:43
*** jmlowe has joined #openstack-containers00:44
*** sfilatov has quit IRC00:46
*** sfilatov has joined #openstack-containers01:30
*** sfilatov has quit IRC01:34
*** spsurya has joined #openstack-containers01:43
*** gsimondo1 has quit IRC01:58
*** flwang1 has quit IRC02:08
*** fragatina has quit IRC02:08
*** fragatina has joined #openstack-containers02:09
*** fragatina has quit IRC02:09
*** sfilatov has joined #openstack-containers02:10
*** dave-mccowan has joined #openstack-containers02:11
*** sfilatov has quit IRC02:18
openstackgerritMerged openstack/magnum master: k8s_fedora: Add admin user  https://review.openstack.org/56367602:20
openstackgerritFeilong Wang proposed openstack/magnum stable/queens: k8s_fedora: Add admin user  https://review.openstack.org/56367902:21
*** armaan has joined #openstack-containers02:34
*** flwang1 has joined #openstack-containers02:38
*** sfilatov has joined #openstack-containers02:48
*** hongbin has joined #openstack-containers02:53
*** sfilatov has quit IRC02:54
*** itlinux has joined #openstack-containers02:57
*** fragatina has joined #openstack-containers03:23
*** sfilatov has joined #openstack-containers03:25
*** ianychoi has quit IRC03:28
*** sfilatov has quit IRC03:30
openstackgerritXiaojueGuan proposed openstack/python-magnumclient master: Trivial: Update pypi url to new url  https://review.openstack.org/56539003:30
*** ianychoi has joined #openstack-containers03:31
*** itlinux has quit IRC03:32
*** fragatina has quit IRC03:34
*** sfilatov has joined #openstack-containers04:00
*** yamamoto has quit IRC04:01
*** yamamoto has joined #openstack-containers04:04
*** yamamoto has quit IRC04:05
*** ricolin has joined #openstack-containers04:06
*** hongbin has quit IRC04:08
*** sfilatov has quit IRC04:12
*** yamamoto has joined #openstack-containers04:15
*** yamamoto has quit IRC04:20
*** yamamoto has joined #openstack-containers04:31
*** fragatina has joined #openstack-containers04:33
*** yamamoto has quit IRC04:34
*** yamamoto has joined #openstack-containers04:34
*** fragatina has quit IRC04:40
*** fragatina has joined #openstack-containers04:43
*** dave-mccowan has quit IRC04:43
*** fragatina has quit IRC04:49
*** flwang1 has quit IRC04:58
*** fragatina has joined #openstack-containers05:07
*** fragatina has quit IRC05:12
*** sfilatov has joined #openstack-containers05:17
*** fragatina has joined #openstack-containers05:29
*** sfilatov has quit IRC05:31
*** fragatina has quit IRC05:51
*** rado_ has joined #openstack-containers06:03
*** sfilatov has joined #openstack-containers06:03
*** fragatina has joined #openstack-containers06:04
*** sfilatov has quit IRC06:08
*** ramishra has joined #openstack-containers06:11
*** janki has joined #openstack-containers06:21
*** pcichy has joined #openstack-containers06:22
*** ricolin has quit IRC06:25
*** janki has quit IRC06:26
*** sfilatov has joined #openstack-containers06:29
*** ramishra has quit IRC06:31
*** sfilatov has quit IRC06:47
*** armaan has quit IRC06:58
*** sfilatov has joined #openstack-containers07:02
*** rcernin has quit IRC07:06
*** sfilatov has quit IRC07:06
*** sfilatov has joined #openstack-containers07:40
*** sfilatov has quit IRC07:47
*** sfilatov has joined #openstack-containers07:52
*** livelace-link has quit IRC07:56
*** livelace-link has joined #openstack-containers07:56
*** sfilatov has quit IRC07:57
*** livelace-link has quit IRC07:58
*** mdnadeem has joined #openstack-containers08:00
*** mgoddard has joined #openstack-containers08:04
*** sfilatov has joined #openstack-containers08:14
*** armaan has joined #openstack-containers08:16
*** sfilatov has quit IRC08:22
*** sfilatov has joined #openstack-containers08:26
*** sfilatov has quit IRC08:30
*** belmoreira has joined #openstack-containers08:33
*** sfilatov has joined #openstack-containers08:36
*** salmankhan has joined #openstack-containers08:37
*** pcichy has quit IRC08:38
*** belmoreira has quit IRC08:42
*** sfilatov has quit IRC08:52
*** armaan has quit IRC08:59
*** armaan has joined #openstack-containers09:00
*** armaan has quit IRC09:04
*** salmankhan has quit IRC09:06
*** salmankhan has joined #openstack-containers09:10
*** armaan has joined #openstack-containers09:19
*** sfilatov has joined #openstack-containers09:22
*** gsimondon has joined #openstack-containers09:24
*** sfilatov has quit IRC09:26
*** rado_ has quit IRC09:29
*** rado_ has joined #openstack-containers09:31
*** flwang1 has joined #openstack-containers09:46
*** rado_ has quit IRC09:51
*** rado_ has joined #openstack-containers09:55
flwang1strigazi: meeting?09:56
*** sfilatov has joined #openstack-containers09:56
strigazi#startmeeting containers09:59
openstackMeeting started Tue May  1 09:59:34 2018 UTC and is due to finish in 60 minutes.  The chair is strigazi. Information about MeetBot at http://wiki.debian.org/MeetBot.09:59
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.09:59
*** openstack changes topic to " (Meeting topic: containers)"09:59
openstackThe meeting name has been set to 'containers'09:59
strigazi#topic Roll Call10:00
*** openstack changes topic to "Roll Call (Meeting topic: containers)"10:00
strigaziHello flwang110:00
*** rado_ has quit IRC10:00
flwang1o/10:00
strigazi#topic Blueprints/Bugs/Ideas10:02
*** openstack changes topic to "Blueprints/Bugs/Ideas (Meeting topic: containers)"10:02
strigazistrigazi: Add label to Disable the cloud provider on kubernetes clusters10:02
strigaziRecently we upgraded Nova to Queens \o/10:02
flwang1strigazi: why do we need it?10:03
flwang1Nova on Queens? That's amazing10:03
strigaziThe architecture of nova changed significantly and the load increased10:03
flwang1we're still on an old version which i can't tell you ;(10:03
flwang1"Add label to Disable the cloud provider on kubernetes clusters" what's the background?10:04
strigaziWe noticed that the kubernetes nodes create quite some load on the nova apis10:04
strigaziAnd the controller manager queries frequently the nova API through the metadata service.10:05
flwang1isn't it a "bug" of the openstack cloud provider?10:05
flwang1blame dims10:05
strigaziWe have to investigate what is the root cause, but the load is big and the benefit, at least in our cloud is little.10:06
flwang1strigazi: ok, i got the point.10:07
flwang1i'm just wondering the root cause10:07
strigaziHaving more than 1500 vms doing a scalability test to the nova api is not great.10:07
strigaziWe will change to the out of tree cloud provider anyway, we investigate there.10:07
strigazis/we/we can/10:08
strigaziMakes sense?10:08
flwang1strigazi: ok10:08
strigaziOh, also10:08
flwang1fair enough10:08
*** sfilatov has quit IRC10:09
strigazicsi-cinder csi-cephfs and csi-manila can be used without the cloud provider, I think10:09
strigazicsi-manila I don't know if it is a valid name, but we have someone working on integrating manila with kubernetes10:10
flwang1cool10:10
brtknrHello everyone, I have a question re enabling RDMA when mounting a volume using GlusterFS via Infiniband on fedora atomic 27. Has anyone tried soemthing similar?10:10
flwang1brtknr: can we talk about it offline?10:10
flwang1we're in the weekly meeting, welcome to join10:11
brtknrflwang1: sure, apologies10:11
strigaziAnd one more note since the queens upgrade. Heat needs to be in queens to be able to mount cinder volumes10:12
flwang1brtknr: that's ok, pls join us10:12
flwang1strigazi: that's good to know10:12
flwang1as you know, we have to upgrade to heat10:12
strigaziyes, we have nova  in queens but not heat :)10:12
flwang1and finally, we have decided to upgrade it to queens10:12
strigazicool10:12
strigaziwe did mitaka -> ocata a few months ago, it was uneventful10:13
strigaziWe'll do ocata -> queens soon10:13
flwang1nice10:13
strigaziOne more thing from my side, is about the dashboard.10:14
strigaziWe have memory and cpu usage But, we don't see some metrics in the node panel10:15
strigaziflwang1: have you noticed?10:15
*** rado_ has joined #openstack-containers10:15
strigazicpu rqs and memory requests are missing10:15
flwang1strigazi: oh? i didn't notice that10:16
*** gsimondo1 has joined #openstack-containers10:16
flwang1because now i generally take care magnum and k8s from a higher level10:16
flwang1make sure everything works, but not every corner10:16
flwang1any finding?10:16
strigaziI'm following it, no solution yet, I'll ask helo in #atomic10:17
*** gsimondon has quit IRC10:17
strigazis/helo/help10:17
flwang1and where did you check the cpu/memory requests on dashboard?10:17
flwang1so that i can try to reproduce it10:18
strigazigive me a sec10:18
strigazihttp://localhost:8001/api/v1/namespaces/kube-system/services/https:kubernetes-dashboard:/proxy/#!/node/strigazi-kube-pdwec3q4ukyd-minion-0?namespace=default10:19
strigaziThis is the path to a node in your cluster10:20
strigazimy node is "strigazi-kube-pdwec3q4ukyd-minion-0"10:20
strigaziA have a few things more to try10:21
strigaziBut no solution yet.10:21
*** serlex has joined #openstack-containers10:22
flwang1ok, i will test it on my local and let you know10:23
strigazithanks10:23
flwang1no problem10:23
flwang1strigazi: i will show you the screenshot later10:26
flwang1anything else from your side?10:26
openstackgerritMerged openstack/magnum stable/queens: k8s_fedora: Add admin user  https://review.openstack.org/56367910:26
*** rado_ has quit IRC10:27
openstackgerritMerged openstack/magnum stable/queens: Make DNS pod autoscale  https://review.openstack.org/56534510:28
strigaziThat's it, I'm trying to finish upgrades for the summit. No complete patch yet10:28
*** sfilatov has joined #openstack-containers10:29
flwang1ok, i was in vacation last week, so no progress for the keystone integration and monitoring stuff :(10:29
flwang1btw, thanks for review my patches10:30
strigaziflwang1: For monitoing,10:30
strigaziIt would be nice to have the kubelet logs somewhere self hosted10:30
flwang1strigazi: you mean fluentd?10:31
strigaziAs an operator, that would help a lot10:31
flwang1or any self hosted solution?10:31
strigazifluentd collects only10:32
flwang1strigazi: yep, i know10:32
flwang1i mean similar combinations10:32
flwang1are you talking about this?10:32
strigaziwe could find a way to give access to the current logs to the user10:32
strigaziPushing the logs somewhere centrally is one thing10:33
flwang1strigazi: yep, i see your point10:33
strigaziI'm talking about using the kube api or a service that runs in the cluster to see the logs10:33
*** sfilatov has quit IRC10:34
flwang1strigazi: yep, i see. are you aware of any popular solution for this?10:34
flwang1otherwise, i will do some research10:34
strigaziI can't think of anything without a db10:34
*** gsimondo1 has quit IRC10:34
strigaziit would be fluentd plus something that I'm missing right now10:35
flwang1i see.10:35
flwang1btw, are for the cpu request issue, are you talking about this https://pasteboard.co/Hj9ezts.png ?10:36
strigaziyes memory is empty and I think CPU should have more data10:37
flwang1strigazi: i will check my college's cluster which built by kubeadm10:38
strigaziok, thanks10:40
strigaziAnything else on your side?10:41
flwang1nope10:41
flwang1strigazi: ah, btw, i replied your email about the white paper10:42
strigaziyes, I saw it, thanks10:42
flwang1thank you for offering that10:43
strigaziThe paper will be out this month10:44
strigaziLet's wrap the meeting?10:45
flwang1strigazi: ok, thanks10:45
strigaziThanks flwang110:46
strigazi#endmeeting10:46
*** openstack changes topic to "OpenStack Containers Team"10:46
openstackMeeting ended Tue May  1 10:46:11 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)10:46
openstackMinutes:        http://eavesdrop.openstack.org/meetings/containers/2018/containers.2018-05-01-09.59.html10:46
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/containers/2018/containers.2018-05-01-09.59.txt10:46
openstackLog:            http://eavesdrop.openstack.org/meetings/containers/2018/containers.2018-05-01-09.59.log.html10:46
dimsflwang1 : hey!!!10:47
flwang1dims: hah, i was kidding ;)10:47
flwang1dims: strigazi said there could be something can be improved to mitigate the workload of openstack api10:48
dimsflwang1 : no really, i need help tracking down which API's are getting called10:48
dimsi have a bug report somewhere, just not getting enough with actual problem (i don't want to guess)10:49
strigazidims: with kube we do a constant scale test to nova, you have an issue on github?10:49
flwang1sure, i'm pretty sure strigazi will do10:49
dimsstrigazi : one sec, finding it10:49
dimsstrigazi : flwang1 : https://github.com/kubernetes/kubernetes/issues/6114410:50
dimsstrigazi : there are 2 scenarios - before node gets registered and after ... want to be sure we cover both cases10:51
dimswe can coordinate on that issue and on the #sig-openstack slack channel if you are ok with that ... i gotta step out for a little bit10:52
strigaziok10:52
strigazithanks dims10:52
flwang1dims: thanks10:54
*** sfilatov has joined #openstack-containers10:56
*** sfilatov has quit IRC11:01
*** sfilatov has joined #openstack-containers11:04
*** sfilatov has quit IRC11:18
DimGRhi11:26
*** yamamoto has quit IRC11:45
*** yamamoto has joined #openstack-containers11:55
*** yamamoto has quit IRC11:55
*** armaan has quit IRC11:56
*** armaan has joined #openstack-containers11:56
*** armaan has quit IRC11:57
*** armaan has joined #openstack-containers11:57
*** armaan has quit IRC12:06
*** dave-mccowan has joined #openstack-containers12:08
*** pcichy has joined #openstack-containers12:15
*** yamamoto has joined #openstack-containers12:24
*** sfilatov has joined #openstack-containers12:35
*** sfilatov has quit IRC12:39
*** sfilatov has joined #openstack-containers12:44
*** pcichy has quit IRC12:48
*** sfilatov has quit IRC13:01
*** armaan has joined #openstack-containers13:07
*** ianychoi has quit IRC13:09
*** ianychoi has joined #openstack-containers13:10
*** armaan has quit IRC13:10
*** armaan_ has joined #openstack-containers13:10
*** sfilatov has joined #openstack-containers13:27
*** sfilatov has quit IRC13:32
*** openstackgerrit has quit IRC13:34
*** hongbin has joined #openstack-containers13:59
*** armaan_ has quit IRC14:13
*** armaan has joined #openstack-containers14:14
*** openstackgerrit has joined #openstack-containers14:15
openstackgerritAkihiro Motoki proposed openstack/magnum-ui master: Follow the new PTI for document build  https://review.openstack.org/56344014:15
openstackgerritAkihiro Motoki proposed openstack/magnum-ui master: Follow the new PTI for document build  https://review.openstack.org/56344014:18
*** sfilatov has joined #openstack-containers14:27
*** armaan has quit IRC14:33
*** sfilatov has quit IRC14:44
*** salmankhan has quit IRC14:48
*** ricolin has joined #openstack-containers14:57
*** sfilatov has joined #openstack-containers14:58
*** sfilatov has quit IRC15:02
*** yamamoto has quit IRC15:03
*** pcichy has joined #openstack-containers15:05
*** serlex has quit IRC15:16
*** yamamoto has joined #openstack-containers15:16
*** yamamoto has quit IRC15:21
*** fragatina has quit IRC15:23
*** fragatina has joined #openstack-containers15:24
*** yamamoto has joined #openstack-containers15:31
*** salmankhan has joined #openstack-containers15:34
*** sfilatov has joined #openstack-containers15:35
*** yamamoto has quit IRC15:36
openstackgerritXiaojueGuan proposed openstack/python-magnumclient master: Trivial: Update pypi url to new url  https://review.openstack.org/56539015:41
*** itlinux has joined #openstack-containers15:42
*** yamamoto has joined #openstack-containers15:44
*** yamamoto has quit IRC15:44
*** sfilatov has quit IRC15:46
*** sfilatov has joined #openstack-containers15:47
*** sfilatov has quit IRC15:52
*** ianychoi has quit IRC16:09
*** ianychoi has joined #openstack-containers16:11
*** ricolin has quit IRC16:24
*** armaan has joined #openstack-containers16:28
*** spsurya has quit IRC16:31
*** salmankhan has quit IRC16:36
*** armaan has quit IRC16:38
*** armaan has joined #openstack-containers16:39
*** sfilatov has joined #openstack-containers16:39
*** yamamoto has joined #openstack-containers16:44
*** yamamoto has quit IRC16:50
*** sfilatov has quit IRC16:56
*** armaan has quit IRC17:01
*** armaan has joined #openstack-containers17:02
*** mgoddard has quit IRC17:06
*** mdnadeem has quit IRC17:27
*** itlinux has quit IRC17:28
*** sfilatov has joined #openstack-containers17:32
*** mgoddard has joined #openstack-containers17:34
*** itlinux has joined #openstack-containers17:41
*** pcichy has quit IRC17:44
*** sfilatov has quit IRC17:45
*** yamamoto has joined #openstack-containers17:47
*** pcichy has joined #openstack-containers17:51
*** pcichy has quit IRC17:52
*** yamamoto has quit IRC17:52
*** pcichy has joined #openstack-containers17:53
*** sfilatov has joined #openstack-containers18:14
*** sfilatov has quit IRC18:18
*** pcichy has quit IRC18:18
*** pcichy has joined #openstack-containers18:18
*** sfilatov has joined #openstack-containers18:27
*** flwang1 has quit IRC18:42
*** fragatina has quit IRC18:44
*** sfilatov has quit IRC18:44
*** yamamoto has joined #openstack-containers18:48
*** flwang1 has joined #openstack-containers18:48
*** mgoddard has quit IRC18:52
*** yamamoto has quit IRC18:53
*** sfilatov has joined #openstack-containers19:03
*** sfilatov has quit IRC19:07
*** mgoddard has joined #openstack-containers19:23
*** flwang1 has quit IRC19:26
*** flwang1 has joined #openstack-containers19:27
*** mgoddard has quit IRC19:28
*** flwang1 has quit IRC19:30
*** yamamoto has joined #openstack-containers19:49
*** sfilatov has joined #openstack-containers19:53
*** yamamoto has quit IRC19:55
*** sfilatov has quit IRC20:03
*** sfilatov has joined #openstack-containers20:06
*** fragatina has joined #openstack-containers20:07
*** ianychoi has quit IRC20:13
*** sfilatov has quit IRC20:24
*** itlinux has quit IRC20:39
*** itlinux has joined #openstack-containers20:41
*** yamamoto has joined #openstack-containers20:51
*** yamamoto has quit IRC20:57
*** flwang1 has joined #openstack-containers21:07
*** sfilatov has joined #openstack-containers21:21
*** sfilatov has quit IRC21:32
*** itlinux has quit IRC21:34
*** pcichy has quit IRC21:49
*** pcichy has joined #openstack-containers21:50
*** yamamoto has joined #openstack-containers21:53
*** pcichy has quit IRC21:54
*** sfilatov has joined #openstack-containers21:58
*** yamamoto has quit IRC21:59
*** sfilatov has quit IRC22:02
*** jmlowe has quit IRC22:13
*** rcernin has joined #openstack-containers22:36
*** sfilatov has joined #openstack-containers22:37
*** jmlowe has joined #openstack-containers22:43
*** sfilatov has quit IRC22:52
*** yamamoto has joined #openstack-containers22:55
*** hongbin has quit IRC22:55
*** yamamoto has quit IRC23:00
*** sfilatov has joined #openstack-containers23:11
*** sfilatov has quit IRC23:15
*** itlinux has joined #openstack-containers23:34
*** itlinux has quit IRC23:39
*** sfilatov has joined #openstack-containers23:46
*** yamamoto has joined #openstack-containers23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!