Wednesday, 2018-03-14

*** oikiki has quit IRC01:07
*** zhubingbing has joined #openstack-containers01:11
*** hongbin has joined #openstack-containers01:12
*** itlinux has quit IRC01:12
*** zhubingbing has quit IRC01:15
*** harlowja has quit IRC01:20
*** pcichy has quit IRC02:28
*** AlexeyAbashkin has joined #openstack-containers02:36
*** AlexeyAbashkin has quit IRC02:40
*** hongbin_ has joined #openstack-containers02:42
*** hongbin has quit IRC02:43
*** fragatina has quit IRC02:46
*** fragatina has joined #openstack-containers02:51
*** fragatina has quit IRC02:51
*** shu-mutou has joined #openstack-containers03:13
*** AlexeyAbashkin has joined #openstack-containers03:36
*** AlexeyAbashkin has quit IRC03:40
*** ykarel|afk has joined #openstack-containers03:51
*** flwang has quit IRC03:57
*** hongbin_ has quit IRC04:02
*** janki has joined #openstack-containers04:02
*** udesale has joined #openstack-containers04:05
*** fragatina has joined #openstack-containers04:08
*** fragatina has quit IRC04:09
*** fragatina has joined #openstack-containers04:10
*** harlowja has joined #openstack-containers04:12
*** ianychoi_ has joined #openstack-containers04:12
*** zhubingbing has joined #openstack-containers04:13
*** ianychoi has quit IRC04:15
*** dave-mccowan has quit IRC04:17
*** zhubingbing has quit IRC04:18
*** ricolin has joined #openstack-containers04:20
*** harlowja has quit IRC04:40
*** ramishra has quit IRC04:51
*** ramishra has joined #openstack-containers04:58
*** shu-mutou is now known as shu-mutow05:16
*** dpawar has joined #openstack-containers05:17
*** mdnadeem has joined #openstack-containers05:31
*** sidx64 has joined #openstack-containers05:32
openstackgerritOpenStack Proposal Bot proposed openstack/magnum master: Updated from global requirements  https://review.openstack.org/53388405:35
openstackgerritOpenStack Proposal Bot proposed openstack/magnum-tempest-plugin master: Updated from global requirements  https://review.openstack.org/53631305:35
*** yasemin has joined #openstack-containers05:43
*** ykarel|afk is now known as ykarel05:47
*** sidx64 has quit IRC05:49
*** sidx64 has joined #openstack-containers05:51
*** ramishra has quit IRC05:51
*** masber has quit IRC05:53
*** ramishra has joined #openstack-containers05:58
*** sidx64 has quit IRC05:59
*** sidx64 has joined #openstack-containers06:00
*** kiennt26__ has quit IRC06:14
*** kiennt26 has joined #openstack-containers06:14
*** pcichy has joined #openstack-containers06:21
*** mdnadeem_ has joined #openstack-containers06:32
*** mdnadeem has quit IRC06:33
*** sidx64_ has joined #openstack-containers06:38
*** mdnadeem_ has quit IRC06:39
*** sidx64 has quit IRC06:40
*** trinaths has joined #openstack-containers06:41
*** dims has quit IRC06:41
*** sidx64 has joined #openstack-containers06:42
*** dims has joined #openstack-containers06:43
*** ianychoi__ has joined #openstack-containers06:43
*** sidx64_ has quit IRC06:45
*** ianychoi_ has quit IRC06:46
openstackgerritOpenStack Proposal Bot proposed openstack/magnum-ui master: Imported Translations from Zanata  https://review.openstack.org/55280206:48
*** dims has quit IRC06:48
*** dims has joined #openstack-containers06:49
*** mdnadeem_ has joined #openstack-containers06:50
*** ianychoi__ is now known as ianychoi06:51
*** pcichy has quit IRC06:52
*** mjura has joined #openstack-containers06:55
*** pcaruana has joined #openstack-containers07:04
openstackgerritMerged openstack/magnum-ui master: Imported Translations from Zanata  https://review.openstack.org/55280207:11
*** sidx64_ has joined #openstack-containers07:11
*** sidx64 has quit IRC07:13
*** DimGR has quit IRC07:14
*** zhubingbing has joined #openstack-containers07:15
*** sidx64_ has quit IRC07:17
*** sidx64 has joined #openstack-containers07:17
*** DimGR has joined #openstack-containers07:20
*** zhubingbing has quit IRC07:20
*** masber has joined #openstack-containers07:32
*** armaan has quit IRC07:36
*** armaan has joined #openstack-containers07:36
*** trinaths has quit IRC07:38
*** dpawar has quit IRC07:41
*** dpawar has joined #openstack-containers07:48
*** mnasiadka has joined #openstack-containers07:50
*** AlexeyAbashkin has joined #openstack-containers07:57
*** mdnadeem has joined #openstack-containers08:02
*** gsimondon has joined #openstack-containers08:04
*** mdnadeem_ has quit IRC08:05
*** gsimondon has quit IRC08:08
*** gsimondon has joined #openstack-containers08:09
*** dsariel has quit IRC08:11
*** olivenwk has joined #openstack-containers08:22
*** mjura has quit IRC08:35
*** mjura has joined #openstack-containers08:37
*** kiennt26 has quit IRC08:55
*** flwang has joined #openstack-containers08:57
flwangstrigazi: ping re security group rules of minion nodes08:58
*** sidx64 has quit IRC09:03
*** shu-mutow has quit IRC09:14
*** zhubingbing has joined #openstack-containers09:17
*** yamamoto_ has joined #openstack-containers09:18
*** zhubingbing has quit IRC09:21
*** trinaths has joined #openstack-containers09:21
*** yamamoto has quit IRC09:22
*** mgoddard_ has joined #openstack-containers09:24
strigaziflwang: hi09:25
flwangstrigazi: hello09:25
flwangmind having a chat about the security groups rules?09:26
strigazisure09:26
strigaziWhat's the problem, what do you propose to do?09:27
*** udesale_ has joined #openstack-containers09:27
flwangstrigazi: i'd like to get your comments if we can add a new config like 'enabled_restricted_security_for_minions_security_group'09:28
flwangso that we can close all ports for minion nodes for external09:29
flwangand only expose services by LB or ingress09:29
*** udesale__ has joined #openstack-containers09:29
*** udesale has quit IRC09:29
flwangas I mentioned last time, GKE is doing that09:30
strigaziif we close all ports how ingress is going to work?09:31
*** udesale_ has quit IRC09:32
flwangsorry, i mean only expose by LB09:33
strigazifyi, we (CERN) don't have security groups, so you will not get feedback from us09:33
flwangor just open some very common port, like 8009:33
strigazidocs to GKE for which ports they have open?09:33
flwangwait a sec, let me show you09:33
strigazihow are we going to make security groups configurable?09:33
*** lpetrut has joined #openstack-containers09:34
flwangstrigazi: https://imgur.com/a/lNvkE09:35
flwangstrigazi: i don't know now, that's the thing we may need input from ricolin09:35
flwangstrigazi: FWIW, opening all ports for all sources is not a secure way, isn't it?09:36
strigaziMy only concern is changing a lot the templates from what people are used to.09:36
strigaziit is not, but09:36
strigazia more secure way is to not have fips on the worker nodes09:36
flwangstrigazi: agree09:37
flwangwould you mind reminding me the work/blueprint about that?09:38
strigaziWe can do that first. Having fips and all ports closed at the same time, doesn't make a lot of sense09:38
strigaziflwang:  let me find it09:38
strigaziflwang: https://review.openstack.org/#/c/395095/09:39
flwangstrigazi: ah, yes09:39
flwangthat's the thing i have claimed ;)09:39
flwangi will take a further look about the two directions09:40
strigaziflwang: i think this one is much more important and useful for public clouds09:41
flwangyep, i agree09:41
strigazior all clouds09:41
flwang+109:41
flwangi'm happy with this topic now, let's move to next one09:41
flwangas for the work of cotyledon investigation, i started it today09:42
strigazihow that goes?09:42
flwangbased on my understanding, the main purpose of the replacement is for periodic task, right?09:42
flwangor, we want to replace all the oslo.service we're using?09:42
strigaziget rid of eventlet09:43
strigazioslo.service depends on it09:43
strigazieventlet is incompatible with the kubernetes client09:43
flwangoslo.service is actually written on top of eventlet to provide two main features:  periodic tasks and workers processes management  The first feature was replaced by another library called futurist and the second feature is superseded by Cotyledon.09:44
strigaziyes, from cotyledon docs09:44
flwangbased on above statement, if we want to totally remove oslo.service, we may need both of futurist and cotyledon09:44
strigaziyes09:44
flwangthat's not a minor change i would say09:45
strigaziI am not sure if it is the right thing to do09:45
flwangdo we have a bug to track that?09:45
strigaziyes09:45
strigazihttps://bugs.launchpad.net/magnum/+bug/174651009:46
openstackLaunchpad bug 1746510 in Magnum "Kubernetes client is incompatible with evenlet and breaks the periodic tasks" [Undecided,New]09:46
*** ktibi has joined #openstack-containers09:46
*** dsariel has joined #openstack-containers09:46
strigaziThe other options is to use our own kubernetes client implementation with python requests09:46
strigaziwe don't have one09:47
strigaziit means, write one09:47
strigaziOr we fix eventlet :)09:47
flwangyep, like i mentioned last time09:47
strigaziit's clear that writing again the client is far from optimal09:48
flwangwrite a simple wrapper on top of our own 'requests' based client and k8s client, could be the better way09:48
strigaziisn't it?09:48
flwangi know, but totally replace oslo.service is a big change, i'm just not sure if it worth the benefit09:49
strigazii'm not saying it is worth it. That's why asked for someone to investigate :)09:50
flwangi saw qinling is using cotyledon to address this issue, so maybe we can try09:53
flwangthe ptl of qinling is my colleague09:54
flwangi'm going to take this bug, but please don't expect it can be fix in short term, i hope i can fix it in Rocky09:55
strigaziok, it's not very high at the moment09:55
flwangcool09:56
flwangso let's move to next one? ;)09:56
strigaziok09:56
flwangsorry for so many questions09:56
flwangas I mentioned yesterday, i'm testing prometheus, and I found some issues09:57
strigazidon't think about it, questions are good :)09:57
flwang1. prometheus doesn't work with kube-proxy, because https://github.com/prometheus/prometheus/issues/1583  are you aware of that?09:58
strigaziCan you try move it from kube-system to prometheus-monitoring namespace? I don't know about this bug. We had it wotking until we moved to kube 1.9 and the kubernetes-dashboard09:59
strigaziwith nodeport it was working for me10:00
flwangthe short summary is https://camo.githubusercontent.com/360e0d525ecdabb7bee23370f00f72734ee91c53/687474703a2f2f692e696d6775722e636f6d2f4762494643555a2e706e67 the file is 404 because proxy10:00
flwangyes, that's the #2 i'm gonna ask10:01
flwang2. with node port10:01
flwangi'm getting error like "time="2018-03-14T03:17:36Z" level=error msg="github.com/prometheus/prometheus/discovery/kubernetes/kubernetes.go:182: Failed to list *v1.Service: services is forbidden: User "system:serviceaccount:kube-system:default" cannot list services at the cluster scope" component="kube_client_runtime" source="kubernetes.go:76"10:01
flwangseems it's a RBAC issue, and I can't see any RBAC config for prometheus, am i missing anything?10:02
flwangi think we need to create this https://github.com/prometheus/prometheus/blob/master/documentation/examples/rbac-setup.yml for prometheus?10:03
strigaziyes, after RBAC we need to add roles10:05
strigaziAre you going to offer both options?10:05
flwangstrigazi: ok, i will open a bug10:05
flwangboth means prometheus and heapster?10:05
strigazikube-dash and prom?10:05
strigaziyes10:05
flwangi'm not sure, TBH10:05
strigaziWe stopped advertising prometheus10:05
flwangbut we would like to make sure everything we're providing works10:06
flwangwe=cern or magnum?10:06
strigazicern10:06
flwangok10:06
flwangfair enough10:06
flwangbut as a open source project10:06
*** mnasiadka has quit IRC10:07
flwangwe still need to make sure what we're delivering work, no?10:07
strigazias a open source project was had zero feedback on it so far10:07
flwanghaha10:07
strigaziNot a single user10:07
strigaziyou are the first asking about it10:07
flwangthat means Catalyst Cloud is doing serious contribution ;)10:08
strigaziyes10:08
flwanganyway, i will open a bug to fix it10:08
strigaziok10:08
flwangand in the future, i may contribute back a user doc about it10:09
strigazibe sure to also move it to another namespace10:09
flwanglike default?10:09
strigaziI was working on this patch but I abandoned it since there was no interest from us and anyone else.10:09
flwangcould you please share the link?10:10
strigaziflwang: https://review.openstack.org/#/c/508172/10:10
flwangis there any evidence users are going to heapster than prometheus?10:10
strigaziFrom the kube community, I think for monitoing kube itself yes, but for monitoing apps they use prometheus10:11
strigaziOur prom deployment though targets to monitor the cluster10:12
flwangstrigazi: makes sense for me10:12
strigazinot the applications10:12
flwanggood to know10:12
flwangi will dig into this area and bring feedback if you're still interested in10:13
*** rcernin has quit IRC10:13
strigazisounds good10:16
strigaziI have one for you10:16
*** sidx64 has joined #openstack-containers10:17
strigaziAnd maybe kong10:17
strigaziI saw that you worked a bit on the keystone authn and authz with kubernetes. I would like to add in magnum10:18
strigazi*to add it in magnum10:18
strigaziflwang: thoughts ^^10:18
flwanghah, yep, we tested the keystone integration before10:19
flwanghow did you know that?10:19
strigazimailing list10:19
strigazihe was asking questions10:19
flwangyes10:19
flwangi don't think there are two much to do in magnum10:20
flwangwhat do you mean 'add in magnum'?10:20
flwangs/two/too10:20
strigazihave an option to enable the webhooks10:20
flwangstrigazi: that's good idea10:21
flwangthen run it on the master node?10:21
strigaziit is a standalone patch and easy to do, ye10:21
strigaziyes10:21
flwangcool, i will open a bug to track the work10:22
flwangenable_keystone_integration?10:22
strigazikong: is not around atm, can you ask him if he is interested to do it, since he worked on it?10:23
strigazienable_keystone_authz10:23
strigazior enable_keystone_authorization10:23
flwangok10:24
strigaziintegration is a bit vague, we can work the name :)10:24
flwangi will talk with him, technically, i'm his manager, so shouldn't be a big problem ;)10:24
*** sidx64 has quit IRC10:24
strigaziI thought since he worked on it, we would duplicate the effort if one of us started looking from scratch10:25
flwangso it will be a new config and introduce db schema change, or you just want to see a label?10:25
strigazionly one label10:26
flwangstrigazi: fair enough10:26
flwangstrigazi: ok10:26
*** vijaykc4 has joined #openstack-containers10:27
flwangstrigazi: just to be clear, you just say authz, how about auth?10:29
*** jmlowe has quit IRC10:30
flwangand if we use authz of keystone for k8s, based on my knowledge, it may break the existing rbac for all the service we're providing, is it?10:31
flwangor we have to update the role for each service when we enabling keystone authz10:32
*** salmankhan has joined #openstack-containers10:33
strigaziWe can give the cluster project the clusterrole10:40
strigaziit won't break anything10:41
strigaziWe will test anyway :)10:41
*** sidx64 has joined #openstack-containers10:44
*** flwang has quit IRC10:47
*** sidx64 has quit IRC10:48
*** trinaths has quit IRC10:49
*** mikal_ has joined #openstack-containers10:52
*** mikal has quit IRC10:53
*** huzhengchuan has joined #openstack-containers10:55
*** sidx64 has joined #openstack-containers10:55
*** belmoreira has joined #openstack-containers10:56
*** sidx64 has quit IRC10:58
*** sidx64 has joined #openstack-containers11:02
*** flwang has joined #openstack-containers11:03
flwangstrigazi: cool11:06
*** ianychoi has quit IRC11:07
flwangstrigazi: btw, is rochapor1o around?11:07
*** sidx64 has quit IRC11:09
*** janki has quit IRC11:10
strigaziflwang: no11:11
*** zhubingbing has joined #openstack-containers11:11
*** sidx64 has joined #openstack-containers11:11
flwangstrigazi: wouldn't you happen to have tested the traefik before, would you?11:12
strigaziflwang: we did test it11:12
flwangwhy don't we have traefic ui as well?11:13
strigaziwe do11:13
strigaziport 8080 where traefik is running11:13
flwangoh, really? maybe i missed it11:13
*** ianychoi has joined #openstack-containers11:13
flwangi will check it again, is it reachable by proxy?11:14
strigazinodeport11:14
flwanginteresting11:14
*** serlex has joined #openstack-containers11:16
*** jmlowe has joined #openstack-containers11:23
*** armaan has quit IRC11:25
*** jmlowe has quit IRC11:27
*** janki has joined #openstack-containers11:43
*** udesale__ has quit IRC11:45
*** vijaykc4 has quit IRC11:48
*** dsariel has quit IRC11:50
*** armaan has joined #openstack-containers11:53
*** salmankhan has quit IRC12:02
*** salmankhan has joined #openstack-containers12:02
*** armaan has quit IRC12:05
*** dsariel has joined #openstack-containers12:05
*** armaan has joined #openstack-containers12:06
*** armaan has quit IRC12:10
*** yamamoto_ has quit IRC12:17
*** yamamoto has joined #openstack-containers12:18
*** vijaykc4 has joined #openstack-containers12:18
*** armaan has joined #openstack-containers12:24
*** armaan has quit IRC12:24
*** armaan_ has joined #openstack-containers12:29
*** mdnadeem_ has joined #openstack-containers12:31
*** dave-mccowan has joined #openstack-containers12:32
*** mdnadeem has quit IRC12:35
*** olivenwk has quit IRC12:36
*** yamamoto has quit IRC12:38
*** dsariel has quit IRC12:39
*** yamamoto has joined #openstack-containers12:39
*** yamamoto has quit IRC12:44
*** huzhengchuan has quit IRC12:49
*** dsariel has joined #openstack-containers12:52
*** armaan_ has quit IRC12:53
*** armaan has joined #openstack-containers12:53
*** yamamoto has joined #openstack-containers12:55
*** yamamoto has quit IRC12:59
*** zhubingbing has quit IRC13:01
*** zhubingb_ has joined #openstack-containers13:01
*** vijaykc4 has quit IRC13:03
*** yamamoto has joined #openstack-containers13:10
*** ktibi_ has joined #openstack-containers13:12
*** yamamoto has quit IRC13:15
*** ktibi has quit IRC13:16
*** yamamoto has joined #openstack-containers13:25
*** mdnadeem has joined #openstack-containers13:29
*** yamamoto has quit IRC13:29
*** sidx64 has quit IRC13:31
*** mdnadeem_ has quit IRC13:32
*** sidx64 has joined #openstack-containers13:32
*** dpawar has quit IRC13:38
*** yamamoto has joined #openstack-containers13:40
*** dsariel has quit IRC13:41
*** zhubingb_ has quit IRC13:43
*** ykarel is now known as ykarel|afk13:43
*** zhubingbing has joined #openstack-containers13:43
*** yamamoto has quit IRC13:44
*** zhubingbing has quit IRC13:53
*** zhubingbing has joined #openstack-containers13:54
*** yamamoto has joined #openstack-containers13:54
*** yamamoto has quit IRC13:55
*** yamamoto has joined #openstack-containers13:55
*** yamamoto has quit IRC13:55
*** dsariel has joined #openstack-containers13:56
*** vijaykc4 has joined #openstack-containers13:58
*** zhubingbing has quit IRC14:00
*** zhubingbing has joined #openstack-containers14:01
*** ktibi_ has quit IRC14:03
*** sidx64 has quit IRC14:10
*** ktibi has joined #openstack-containers14:11
*** zhubingbing has quit IRC14:12
*** ykarel|afk has quit IRC14:12
*** dsariel has quit IRC14:13
*** sidx64 has joined #openstack-containers14:14
*** dsariel has joined #openstack-containers14:26
*** salmankhan has quit IRC14:38
*** salmankhan has joined #openstack-containers14:49
*** yamamoto has joined #openstack-containers14:55
*** hongbin has joined #openstack-containers14:55
*** ykarel|afk has joined #openstack-containers14:58
*** ykarel|afk is now known as ykarel14:58
*** yamamoto has quit IRC15:02
*** mdnadeem has quit IRC15:02
*** huzhengchuan has joined #openstack-containers15:02
*** olivenwk has joined #openstack-containers15:06
*** itlinux has joined #openstack-containers15:12
*** salmankhan has quit IRC15:20
*** salmankhan has joined #openstack-containers15:20
*** huzhengchuan has quit IRC15:33
*** vijaykc4 has quit IRC15:37
*** ykarel is now known as ykarel|afk15:39
*** vijaykc4 has joined #openstack-containers15:40
*** vijaykc4 has quit IRC15:41
*** lpetrut has quit IRC15:42
*** sidx64 has quit IRC15:43
openstackgerritMerged openstack/magnum-tempest-plugin master: Fix links to build docs  https://review.openstack.org/52825415:53
*** yamamoto has joined #openstack-containers15:58
*** dsariel has quit IRC15:59
*** huzhengchuan has joined #openstack-containers15:59
*** mjura has quit IRC16:04
*** yamamoto has quit IRC16:04
*** huzhengchuan has quit IRC16:09
*** gsimondon has quit IRC16:10
*** masber has quit IRC16:10
*** vijaykc4 has joined #openstack-containers16:19
*** udesale has joined #openstack-containers16:20
*** udesale has quit IRC16:26
*** vijaykc4 has quit IRC16:26
*** masber has joined #openstack-containers16:29
*** ykarel|afk has quit IRC16:30
*** AlexeyAbashkin has quit IRC16:30
*** masber has quit IRC16:44
*** janki has quit IRC16:47
*** vijaykc4 has joined #openstack-containers16:50
*** vijaykc4 has quit IRC16:50
*** masber has joined #openstack-containers16:51
*** flwang has quit IRC16:51
*** armaan has quit IRC16:59
*** yamamoto has joined #openstack-containers16:59
*** sapd_ has joined #openstack-containers17:01
*** sapd has quit IRC17:05
*** yamamoto has quit IRC17:05
*** ktibi is now known as ktibi_away17:08
*** armaan has joined #openstack-containers17:13
*** zhubingbing has joined #openstack-containers17:16
*** pcaruana has quit IRC17:18
*** zhubingbing has quit IRC17:25
*** serlex has quit IRC17:32
*** olivenwk has quit IRC17:41
*** itlinux has quit IRC17:50
*** flwang has joined #openstack-containers17:52
*** itlinux has joined #openstack-containers17:58
*** yamamoto has joined #openstack-containers18:01
*** yamamoto has quit IRC18:06
*** mgoddard_ has quit IRC18:07
*** AlexeyAbashkin has joined #openstack-containers18:07
*** harlowja has joined #openstack-containers18:11
*** AlexeyAbashkin has quit IRC18:11
*** salmankhan has quit IRC18:13
*** fragatina has quit IRC18:15
*** fragatina has joined #openstack-containers18:16
*** lpetrut has joined #openstack-containers18:28
*** mgoddard_ has joined #openstack-containers18:48
*** itlinux has quit IRC18:57
*** itlinux_ has joined #openstack-containers18:57
*** fragatina has quit IRC19:01
*** yamamoto has joined #openstack-containers19:02
*** yamamoto has quit IRC19:07
*** flwang has quit IRC19:31
*** ricolin has quit IRC19:33
*** itlinux_ has quit IRC19:40
*** mgoddard_ has quit IRC19:48
*** itlinux has joined #openstack-containers19:53
*** yamamoto has joined #openstack-containers20:03
*** yamamoto has quit IRC20:08
*** sidx64 has joined #openstack-containers20:10
*** sidx64 has quit IRC20:15
*** sidx64 has joined #openstack-containers20:16
*** zhubingbing has joined #openstack-containers20:23
*** mgoddard_ has joined #openstack-containers20:25
*** zhubingbing has quit IRC20:27
*** gsimondon has joined #openstack-containers20:31
*** jmlowe has joined #openstack-containers20:35
*** AlexeyAbashkin has joined #openstack-containers20:36
*** fragatina has joined #openstack-containers20:39
*** AlexeyAbashkin has quit IRC20:40
*** flwang has joined #openstack-containers20:44
*** yamamoto has joined #openstack-containers21:04
*** rcernin has joined #openstack-containers21:08
*** yamamoto has quit IRC21:10
*** ktibi_away has quit IRC21:14
*** lpetrut has quit IRC21:22
*** sidx64 has quit IRC21:22
*** dave-mccowan has quit IRC21:26
*** dave-mccowan has joined #openstack-containers21:33
*** itlinux has quit IRC21:40
*** belmoreira has quit IRC21:45
pwdwhen starting kubernetes cluster, I can see the master and minion instances up and running, running "heat stack-list -n" show all stack_status in CREATE_COMPLETE, but running "openstack coe cluster list" shows CREATE_IN_PROGRESS and does not move to CREATE_COMPLETE state, where can it go wrong?21:51
*** yamamoto has joined #openstack-containers22:06
*** yamamoto has quit IRC22:12
flwangpwd: I would suggest enable the debug mode, and then check code here  https://github.com/openstack/magnum/blob/master/magnum/service/periodic.py#L6522:14
*** mgoddard_ has quit IRC22:14
flwangpwd: and here https://github.com/openstack/magnum/blob/master/magnum/drivers/heat/driver.py#L8622:14
flwangso generally, there is a poller. it will check the stack status and then update cluster status accordingly22:15
flwangif the cluster status can't be updated, that probably means the poller is not working correctly22:15
flwanghope that helps22:16
*** fragatina has quit IRC22:23
*** fragatina has joined #openstack-containers22:24
pwdflwang: you mean set debug=true in /etc/magnum/magnum.conf and check the log file? which location does the log write to ? my /var/log/magnum directory is empty22:24
*** gsimondo1 has joined #openstack-containers22:24
*** gsimondon has quit IRC22:27
*** fragatina has quit IRC22:29
pwdflwang: I restarted openstack-magnum-api.service and openstack-magnum-conductor.service and now the cluster changed to CREATE_COMPLETE state22:35
*** fragatina has joined #openstack-containers22:36
*** fragatina has quit IRC22:36
*** fragatina has joined #openstack-containers22:38
pwdflwang: running "kubectl -n kube-system get po" results in error message: Error from server (Forbidden): pods is forbidden: User "Magnum User" cannot list pods in the namespace "kube-system"22:39
*** fragatina has quit IRC22:40
*** fragatina has joined #openstack-containers22:46
*** dave-mccowan has quit IRC22:47
flwangpwd: where are you running the kubectl command?22:55
flwanglunch time, brb22:55
*** masber has quit IRC22:57
pwdflwang: from controller22:57
*** hongbin has quit IRC22:59
DimGRhi strigazi23:00
*** masber has joined #openstack-containers23:00
*** gsimondon has joined #openstack-containers23:02
*** gsimondo1 has quit IRC23:05
*** yamamoto has joined #openstack-containers23:07
*** armaan has quit IRC23:11
*** yamamoto has quit IRC23:12
flwangpwd: did you run the 'eval' command?23:20
*** gsimondon has quit IRC23:20
*** zhubingbing has joined #openstack-containers23:25
*** zhubingbing has quit IRC23:30
*** itlinux has joined #openstack-containers23:47

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!