Tuesday, 2018-02-06

*** haint has quit IRC00:01
*** haint has joined #openstack-containers00:02
*** dave-mccowan has joined #openstack-containers00:43
*** pengdake has joined #openstack-containers01:16
*** dardelean has joined #openstack-containers01:44
*** dardelean has quit IRC01:48
*** hongbin has joined #openstack-containers01:49
*** oikiki has quit IRC01:58
*** vijaykc4 has joined #openstack-containers02:04
*** itlinux has joined #openstack-containers02:13
*** harlowja has quit IRC02:18
*** shu-mutou-AWAY is now known as shu-mutou02:19
*** askb has quit IRC02:21
*** askb has joined #openstack-containers02:24
*** askb has quit IRC02:29
*** askb has joined #openstack-containers02:29
*** askb has quit IRC02:31
*** askb has joined #openstack-containers02:31
*** askb has quit IRC02:31
*** askb has joined #openstack-containers02:32
*** vijaykc4 has quit IRC02:32
*** askb has quit IRC02:36
*** itlinux has quit IRC02:43
*** askb has joined #openstack-containers02:45
*** dave-mccowan has quit IRC02:48
*** askb has quit IRC02:49
*** askb_ has joined #openstack-containers02:52
*** askb_ has quit IRC03:01
*** flwang has quit IRC03:02
*** dave-mccowan has joined #openstack-containers03:09
*** flwang has joined #openstack-containers03:14
*** dave-mccowan has quit IRC03:33
*** ricolin has joined #openstack-containers03:35
*** pengdake has quit IRC03:38
*** pengdake_ has joined #openstack-containers03:38
*** ramishra has joined #openstack-containers03:43
*** pengdake_ has quit IRC03:46
*** askb_ has joined #openstack-containers03:49
*** hongbin has quit IRC03:55
*** askb_ has quit IRC03:55
*** askb_ has joined #openstack-containers03:56
*** askb_ has quit IRC04:06
*** askb has joined #openstack-containers04:06
*** askb has quit IRC04:07
*** askb has joined #openstack-containers04:07
*** askb has quit IRC04:09
*** askb has joined #openstack-containers04:09
*** askb has quit IRC04:12
*** askb has joined #openstack-containers04:13
*** pgadige__ has joined #openstack-containers04:22
*** dsariel has quit IRC04:28
*** yamamoto has joined #openstack-containers04:35
*** lpetrut has joined #openstack-containers04:41
*** pgadige__ has left #openstack-containers04:43
*** harlowja has joined #openstack-containers04:46
*** rajivk has joined #openstack-containers04:56
*** rajivk has left #openstack-containers04:57
*** pengdake_ has joined #openstack-containers04:57
*** trinaths has joined #openstack-containers05:02
*** pengdake_ has quit IRC05:03
*** lpetrut has quit IRC05:08
*** dpawar has joined #openstack-containers05:10
*** harlowja has quit IRC05:11
*** janki has joined #openstack-containers05:15
*** lpetrut has joined #openstack-containers05:16
*** itlinux has joined #openstack-containers05:17
*** askb has quit IRC05:18
*** askb has joined #openstack-containers05:18
*** armaan has quit IRC05:25
*** daidv has quit IRC05:26
*** armaan has joined #openstack-containers05:28
*** vijaykc4 has joined #openstack-containers05:29
*** sdake_ is now known as sdake05:30
*** lpetrut has quit IRC05:32
*** mdnadeem has joined #openstack-containers05:44
*** itlinux has quit IRC05:55
*** pengdake_ has joined #openstack-containers06:01
*** vijaykc4 has quit IRC06:05
*** vijaykc4 has joined #openstack-containers06:06
*** jchhatbar has joined #openstack-containers06:06
*** janki has quit IRC06:06
*** askb has quit IRC06:09
*** askb has joined #openstack-containers06:10
*** lpetrut has joined #openstack-containers06:11
*** lpetrut has quit IRC06:18
*** threestrands has quit IRC06:40
*** oikiki has joined #openstack-containers06:42
*** shu-mutou has quit IRC06:43
*** yolanda has joined #openstack-containers06:43
*** ianychoi_ has quit IRC06:47
*** ianychoi_ has joined #openstack-containers06:48
oikikistrigazi: i just saw that the meeting time is now changed. i have been having some problems with my devstack. swarm & kube were failing to create clusters. then my whole ubuntu vm crashed. =( that never happened before & im trying to troubleshoot it. im on my second restart and hoping devstack will stack.sh without an error before i go to bed.06:49
*** olivierbourdon38 has quit IRC07:06
*** jchhatba_ has joined #openstack-containers07:20
*** b_bezak has joined #openstack-containers07:21
*** mjura has joined #openstack-containers07:22
*** jchhatbar has quit IRC07:23
*** lpetrut has joined #openstack-containers07:24
*** b_bezak has quit IRC07:25
*** AlexeyAbashkin has joined #openstack-containers07:32
*** oikiki has quit IRC07:36
*** rcernin has quit IRC07:37
*** AlexeyAbashkin has quit IRC07:39
*** vijaykc4 has quit IRC07:40
*** vijaykc4 has joined #openstack-containers07:41
*** gbialas has joined #openstack-containers07:41
*** vijaykc4 has quit IRC07:41
*** olivierbourdon38 has joined #openstack-containers07:42
*** AlexeyAbashkin has joined #openstack-containers07:48
*** vijaykc4 has joined #openstack-containers07:58
*** vijaykc4 has quit IRC08:00
*** pcichy has joined #openstack-containers08:03
*** b_bezak has joined #openstack-containers08:11
*** jchhatba_ has quit IRC08:12
*** pcichy has quit IRC08:12
*** jchhatba_ has joined #openstack-containers08:12
*** pcaruana has joined #openstack-containers08:14
*** askb has quit IRC08:19
*** askb_ has joined #openstack-containers08:20
*** vijaykc4 has joined #openstack-containers08:25
*** ianychoi_ has quit IRC08:27
*** ianychoi_ has joined #openstack-containers08:28
*** askb_ has quit IRC08:31
*** abelur_ has joined #openstack-containers08:32
*** armaan has quit IRC08:37
*** armaan has joined #openstack-containers08:37
*** dardelean has joined #openstack-containers08:45
*** dardelean has quit IRC08:47
*** dardelean has joined #openstack-containers08:47
*** frti has joined #openstack-containers08:48
*** mgoddard_ has joined #openstack-containers08:54
*** abelur_ has quit IRC08:55
*** abelur_ has joined #openstack-containers08:55
openstackgerritSpyros Trigazis (strigazi) proposed openstack/magnum master: k8s: Fix kubelet, add RBAC and pass e2e tests  https://review.openstack.org/53359309:05
*** threestrands has joined #openstack-containers09:06
*** dsariel has joined #openstack-containers09:15
*** threestrands has quit IRC09:21
*** frti_ has joined #openstack-containers09:21
*** frti_ has quit IRC09:25
*** frti has quit IRC09:25
strigazi@all and slunkad: flwang1 ricolin we will have the magnum meeting in 25 minutes09:34
ricolinstrigazi, cool!09:41
*** pcichy has joined #openstack-containers09:46
strigaziricolin: is it possible to move the meeting to this channel?09:50
ricolinstrigazi, yes09:51
ricolinhttps://review.openstack.org/54121009:51
ricolinheat been doing so for a cycle now, the policy was officially changed since last cycle09:52
ricolinstrigazi, I just propose this patch:)09:53
*** salmankhan has joined #openstack-containers09:53
ricolinwhat we have to do is change the wiki and maybe a ML out and we're good to go09:53
ricolinwe can do it for this meeting as well09:54
strigazithe patch needs to get merged first right?09:54
ricolinstrigazi, not necessary if you can get all to know that we're doing in here09:55
ricolinbut for long term, yes that patch needs to land09:55
strigazivabada: slunkad  flwang1 we will do the  meeting in this channel09:57
flwang1im ok09:58
strigazi#startmeeting containers10:00
openstackMeeting started Tue Feb  6 10:00:22 2018 UTC and is due to finish in 60 minutes.  The chair is strigazi. Information about MeetBot at http://wiki.debian.org/MeetBot.10:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.10:00
*** openstack changes topic to " (Meeting topic: containers)"10:00
openstackThe meeting name has been set to 'containers'10:00
strigazi#topic Roll Call10:00
*** openstack changes topic to "Roll Call (Meeting topic: containers)"10:00
ricolino/10:00
flwang1o/10:00
strigazio/10:00
slunkadhi10:00
*** salmankhan has quit IRC10:00
*** salmankhan has joined #openstack-containers10:01
strigaziThanks for joining the meeting folks10:01
strigazi#link https://wiki.openstack.org/wiki/Meetings/Containers#Agenda_for_2018-02-06_1000_UTC10:01
strigazi#topic Announcements10:01
*** openstack changes topic to "Announcements (Meeting topic: containers)"10:01
strigazithis week on Thursday we will branch, push for your changes, we can still push to the branch, but it is better to push this week10:02
strigaziwe can discuss this later in the meetning if you have questions10:03
strigazi#topic Review Action Items10:03
*** openstack changes topic to "Review Action Items (Meeting topic: containers)"10:03
strigazistrigazi to look for a new meeting time APAC friendly [DONE]10:03
flwang1strigazi: thanks10:03
ricolinstrigazi, I think it's better to send a ML to let all know we change the time and location10:04
strigaziflwang1: you are welcome, it is great to have you and ricolin here10:04
strigaziI sent the email for the time last week10:04
strigazino. yesterday10:04
strigaziWe send one more for the time10:05
ricolinstrigazi, cool!10:05
*** trinaths has quit IRC10:05
strigaziWe send one more for the place10:05
ricolinlol10:05
strigazi#topic Blueprints/Bugs/Reviews/Ideas10:05
*** openstack changes topic to "Blueprints/Bugs/Reviews/Ideas (Meeting topic: containers)"10:05
strigaziCalico network driver for kubernetes, flwang1 do you want to say a few things about this faeture for ricolin slunkad and for the meeting record? :)10:06
*** janki has joined #openstack-containers10:06
flwang1strigazi: yes10:06
flwang1catalyst cloud is trying to deploy magnum into production10:07
flwang1but to get a production ready k8s, we would like to have the network policy support10:07
flwang1which currently Flannel can't support10:07
*** jchhatba_ has quit IRC10:07
flwang1so we'd like to upstream the Calico driver to achieve that10:07
flwang1https://review.openstack.org/540352 here is the patch i'm working on10:08
ricolin#link https://review.openstack.org/54035210:08
flwang1we'd like to get it in Queens if it's possible10:09
strigaziflwang1: we will try to get it in10:09
flwang1strigazi: thank you for all the support10:09
strigaziflwang1: do you need help for the software deployment?10:10
strigazime and ricolin can help10:10
ricolinstrigazi, yes boss!10:10
flwang1strigazi: i will push a patch tomorrow and please review it and feel free to post a patch set10:10
strigaziflwang1: cool10:11
strigazibtw, here are some slides for best practices on security for kubernetes10:11
strigazi#link https://fosdem.org/2018/schedule/event/containers_kubernetes_security/10:11
strigazi#link https://speakerdeck.com/ianlewis/kubernetes-security-best-practices10:11
flwang1strigazi: thanks for sharing10:12
strigazithe above two, is a talk at a conference in europe this weekend describing best practices on kubernetes security, it describes RBAC, calico and more10:12
strigaziI also found a slide deck from a conference yesterday, again on kubernetes security, I found them useful10:13
flwang1strigazi: great10:13
strigazi#link https://docs.google.com/presentation/d/e/2PACX-1vQwQkF4MjGebZoWqBaJ1F_Nf3HSYS-tjX13JMND0aJ92dXw1flSwAgTIoekHumUuX7LAgBkv3rQS-qp/pub?start=false&loop=false&delayms=3000&slide=id.SLIDES_API1559816053_010:13
*** vijaykc4 has quit IRC10:14
strigazispeaking of the heat-agent, ricolin what about that patch on passing the public_url?10:14
ricolinwas stuck by releases job, but hope I can get it out these two days10:16
*** pengdake_ has quit IRC10:16
strigaziricolin the patchset that is up now, is it working?10:16
ricolinstrigazi, which one you mean?10:16
strigaziI though you pushed a  patch already10:17
strigaziI thought you pushed a patch already10:17
ricolinstrigazi, I sould, but not yet10:17
strigaziricolin :) ok10:17
ricolinIt will help if we can use k8s gate in upstream10:18
strigaziricolin: what do you mean?10:18
strigaziI think the our k8s job should work now10:18
ricolinstrigazi, maybe some plan in PTG to discuss how we can do with magnum-functional-k8s?10:19
strigaziricolin there is nothing we can do on openstack-infra10:19
strigazithe five only m1.large vms but most importantly they don't give us nested virtualization10:20
strigaziA reasonable environament needs to have, 15GB ram, 8 or 16 cores at least 100 GB disk and *nested* virtualization10:21
strigazimultinode would work as well but we still need nested virtualization10:21
ricolinstrigazi, is current infra even get any environment that can do nested virtualization?10:22
strigaziricolin: no10:22
strigaziI asked multiple times10:22
ricolinokay:(10:22
*** trinaths has joined #openstack-containers10:22
strigaziI tried to do smth in centos-ci but I was stuck and didn't have more time for it10:23
strigazilet's move on10:23
strigazikubernetes python client and eventlet incompatibility https://github.com/eventlet/eventlet/issues/14710:23
strigaziI'm repeating this, and I will add to the release notes10:23
strigazithe periodic task to collect metrics from the cluster is broken10:24
strigaziand it also breaks the task that syncs the cluster status with heat10:24
strigaziflwang1: this is the task (the metrics one) that we want to use for cluster healing10:24
flwang1strigazi: ok10:25
strigaziBut most importantly, it breaks the sync with heat, so cluster are in create_in_progress forever10:25
strigaziwe will have a parameter to disable that task, so magnum will continue to work normally10:26
slunkadis there a patch for this already?10:26
strigazislunkad for the parameter yes10:27
flwang1strigazi: is it only impacting master branch? or Pike as well?10:27
flwang1can we bump the eventlet version?10:27
strigaziflwang1: master only. Eventlet hasn't fix the problem yet10:28
strigaziflwang1: by disabling the task, magnum works fine. At the moment you only lose the send to ceilometer metrics part10:29
flwang1strigazi: ok. can't we bump(skip) that eventlet version in requirements?10:29
-openstackstatus- NOTICE: Our Zuul infrastructure is currently experiencing some problems and processing jobs very slowly, we're investigating. Please do not approve or recheck changes for now.10:29
flwang1strigazi: i see.10:29
strigazithe problem is in kubernetes 4.0.010:29
flwang1can you paste the link of the patch disabling the task?10:29
strigazi#link https://review.openstack.org/#/c/529098/10:30
*** vijaykc4 has joined #openstack-containers10:30
flwang1strigazi: cheers10:30
strigaziflwang1: olso.messaging depends on eventlet10:31
strigaziflwang1: kubernetes depends on multiproccsing10:31
strigazieventlet and multiproccsing are incompatible10:32
flwang1ok, thanks for the clarification10:32
strigaziwe can use python requests directly, but this way we re-write the kuberntes client10:33
*** vijaykc4 has quit IRC10:33
*** vijaykc4 has joined #openstack-containers10:33
strigazior we can use kubectl, the binary. that is even worse10:33
flwang1strigazi: TBH, i don't think magnum has to send metrics to ceilometer10:34
strigaziit doesn't10:34
flwang1i mean the function even shouldn't be a part of magnum ;)10:34
strigazihistory10:34
flwang1history10:34
strigaziin any case, we will need the client at some point for cluster healing and monitoring from magnum server to the clusters10:35
strigazinext,10:35
strigaziCluster Federation  https://review.openstack.org/#/q/status:open+project:openstack/magnum+branch:master+topic:bp/federation-api I'm tesing this and I'll try to take it as experimental api10:36
flwang1yep, agree10:36
strigaziand I'll try to do the same with cluster upgrades10:37
ricolin+1 on that10:37
strigaziI'll ping you for testing10:37
strigazifor upgrades mostly10:37
strigaziI'm trying to clean my patches10:37
strigaziFinally, to move to f2710:38
strigazithere is a patch to run etcd in a container:10:38
strigazi#link https://review.openstack.org/#/c/524116/10:38
strigaziI'm also finishing the patch for flanneld10:38
strigazif27 doesn't have flanneld and etcd installed10:39
strigazido you have any questions?10:39
strigaziok, let's move on10:41
strigazi#topic Open Discussion10:41
*** openstack changes topic to "Open Discussion (Meeting topic: containers)"10:41
flwang1i'd like to get you guys opinion on this bug https://bugs.launchpad.net/magnum/+bug/1746961 \10:41
openstackLaunchpad bug 1746961 in Magnum "Support enabled drivers" [Undecided,New] - Assigned to Feilong Wang (flwang)10:41
*** trinaths has quit IRC10:42
flwang1as I mentioned above, Catalyst Cloud would like to deploy magnum, but we just want to support k8s for now10:42
flwang1so we don't want to receive any support ticket about any other driver10:42
flwang1so we have a way to do that now?10:42
strigaziat the moment, you can update the magnum python egg and remove the entrypoints10:43
*** trinaths has joined #openstack-containers10:43
ricolinwondering will it work if we replace the template:)10:43
strigaziricolin: which template?10:43
slunkaddoes it make sense to have config options that disables the drivers?10:44
flwang1strigazi: which is hard for us because we're building virtual env for different services10:44
flwang1slunkad: that's the thing i'm trying to propose10:45
ricolinstrigazi, I mean remove the templates under each driver10:45
strigaziricolin that is also possible,10:45
strigaziflwang1: we can do this as well10:45
flwang1ricolin: but that way also need to change source code10:46
strigazihave enable_drivers or use the definitions10:46
ricolinflwang1, yes10:46
flwang1strigazi: yep, https://github.com/openstack/magnum/blob/master/magnum/conf/cluster.py#L2510:46
flwang1should we reuse the existing config option or create a new one?10:46
strigaziflwang1 let's do new one10:48
ricolinIMO better a new one if that's for disable drivers10:48
strigaziflwang1: enabled_definitions is there but unsued anyway10:48
ricolinyou will need to keep the backward consist10:48
strigazino, enable drivers10:48
flwang1so you all happy to have a config option for this user case?10:48
strigaziricolin it is silently ignored already10:48
strigaziricolin: since ocatra10:49
strigaziricolin: since ocata10:49
ricolinstrigazi, okay, then it will be fine10:49
strigaziflwang1: yes, we can add enable_drivers10:49
slunkad+110:49
flwang1strigazi: cool, thanks10:49
slunkadstrigazi: this is building locally now https://review.openstack.org/#/c/520063/1310:51
slunkadbut I need some +1s on https://review.openstack.org/#/c/539619/ so it is merged and we can test it in gating10:51
strigazislunkad ok10:52
slunkadalso if you have some time can you give this https://review.openstack.org/#/c/507522/ a code review?10:52
strigazislunkad: I'll have a look10:52
slunkadstrigazi: and ofc we still need the kubernetes elements in the image..10:53
slunkadthanks!10:53
strigazislunkad I know :)10:53
strigazislunkad: if you have a working image we can take https://review.openstack.org/#/c/507522/ , you will be the ones that will mostly use it initially10:54
slunkadstrigazi: I do have a SLES based image which I uses for testing which I can't make public10:55
strigaziok10:55
slunkadstrigazi: not sure if everyone is comfortable merging it for now without the image..10:56
strigaziit's a start, I think if we build an image even locally and publish it, we can start10:57
flwang1slunkad: i'm sorry, but if that's the case, do we really need to move the driver into main tree?10:57
slunkadstrigazi: ok then I will try that, thanks10:58
slunkadflwang1: we are working on a opensuse based image so we will have a image soonish10:58
strigaziflwang1: with a working image published we can start10:58
strigaziflwang1: we zero options avaialble publicly we can't10:59
strigaziwith zero options avaialble publicly we can't10:59
flwang1strigazi: thanks, that makes sense for me10:59
*** yamamoto has quit IRC10:59
strigazithe time is up folks, thanks for coming10:59
strigazi#endmeeting11:00
*** openstack changes topic to "OpenStack Containers Team"11:00
openstackMeeting ended Tue Feb  6 11:00:00 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)11:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/containers/2018/containers.2018-02-06-10.00.html11:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/containers/2018/containers.2018-02-06-10.00.txt11:00
openstackLog:            http://eavesdrop.openstack.org/meetings/containers/2018/containers.2018-02-06-10.00.log.html11:00
slunkadthanks was an informative meeting!11:00
strigazislunkad: :)11:00
ricolinthx11:00
* strigazi is going for lunch11:01
*** flwang1 has quit IRC11:02
* ricolin is going for dinner11:03
*** yamamoto has joined #openstack-containers11:03
*** gsimondon has joined #openstack-containers11:07
*** mnasiadka has joined #openstack-containers11:27
*** salmankhan has quit IRC11:38
*** salmankhan has joined #openstack-containers11:40
*** trinaths has quit IRC11:40
*** pcichy has quit IRC11:48
*** salmankhan has quit IRC11:48
*** salmankhan has joined #openstack-containers11:51
*** vijaykc4 has quit IRC11:53
*** olivierbourdon38 has quit IRC12:11
*** absubram has joined #openstack-containers12:25
*** b_bezak has quit IRC12:30
vabada sorry I missed the meeting. Reading the minutes now!12:32
*** salmankhan has quit IRC12:54
*** takamatsu has joined #openstack-containers12:54
*** AlexeyAbashkin has quit IRC12:59
*** AlexeyAbashkin has joined #openstack-containers13:01
*** salmankhan has joined #openstack-containers13:04
*** AlexeyAbashkin has quit IRC13:25
*** AlexeyAbashkin has joined #openstack-containers13:27
*** dave-mccowan has joined #openstack-containers13:29
*** dave-mcc_ has joined #openstack-containers13:34
*** dave-mccowan has quit IRC13:35
*** AlexeyAbashkin has quit IRC13:38
*** pengdake_ has joined #openstack-containers13:43
*** pengdake_ has quit IRC13:43
*** janki has quit IRC13:44
*** udesale has joined #openstack-containers13:50
*** jmlowe has quit IRC13:55
openstackgerritSpyros Trigazis (strigazi) proposed openstack/magnum master: Deprecate usage of tenant and user in context  https://review.openstack.org/53246314:00
openstackgerritSpyros Trigazis (strigazi) proposed openstack/magnum master: Deprecate usage of tenant and user in context  https://review.openstack.org/53246314:00
*** b_bezak has joined #openstack-containers14:25
DimGRstrigazi14:25
DimGRhiiii14:25
*** dpawar has quit IRC14:33
*** AlexeyAbashkin has joined #openstack-containers14:35
*** tiswanso has joined #openstack-containers14:36
*** salmankhan has quit IRC14:46
*** mdnadeem has quit IRC14:52
*** lpetrut has quit IRC14:53
*** salmankhan has joined #openstack-containers14:54
*** derekjhyang has quit IRC14:55
*** derekjhyang has joined #openstack-containers14:56
*** jmlowe has joined #openstack-containers14:57
*** mnaser has quit IRC15:11
*** mnasiadka has quit IRC15:11
*** mnaser has joined #openstack-containers15:12
*** gbialas has quit IRC15:22
*** mnasiadka has joined #openstack-containers15:22
*** gbialas has joined #openstack-containers15:23
vabadastrigazi: in patch https://review.openstack.org/#/c/533593, in file kube-apiserver-to-kubelet-role.sh, can I ask why apiVersion: apiVersion: rbac.authorization.k8s.io/v1beta115:24
*** mnasiadka has quit IRC15:27
tiswansoHi, I'm new to magnum (not new to openstack or k8s) and following the quick-start guide.  The instructions work pretty much exactly for stable/ocata and I'm able to deploy pods/etc to k8s after creating a cluster per the example.  For stable/pike (with fedora-atomic 26), the cluster creates with no errors but kubectl doesn't see the minion nodes and I'm unable to create deployments.  Is there some extra RBAC st15:27
tiswansouff needed to get going?15:27
*** gbialas has quit IRC15:28
*** lpetrut has joined #openstack-containers15:34
*** mnasiadka has joined #openstack-containers15:37
*** yamamoto has quit IRC15:39
*** armaan has quit IRC15:40
*** armaan has joined #openstack-containers15:41
*** mnasiadka has quit IRC15:41
*** yamamoto has joined #openstack-containers15:42
strigaziDimGR: hello15:46
strigazivabada: i guess you ask why beta right?15:46
strigazivabada: i did it for 1.7 which was beta15:47
strigazitiswanso: is cluster status CREATE_COMPLETE?15:47
strigazitiswanso: check in the node if kubelet is running15:48
strigazitiswanso: I think we have a bug and you need to add --requure-kubeconfig to fix it15:48
strigazitiswanso: the patch is coming15:48
*** pcaruana has quit IRC15:51
*** mnasiadka has joined #openstack-containers15:52
*** yamamoto has quit IRC15:53
*** mnasiadka has quit IRC15:57
*** b_bezak has quit IRC16:01
vabadastrigazi ok thanks. so this way we keep backwards compatibility? so it works with 1.8 as well? And in addition, if you let me know some useful testing I could do for that patch, that'd be great16:02
tiswansostrigazi:  yep... everything from cluster create looks good (CREATE_COMPLETE)16:02
tiswansoI'll read about require-kubeconfig16:03
*** gsimondon has quit IRC16:03
strigazitiswanso check in the kubeminions in /etc/kubernetes/kubelet16:04
*** v1k0d3n has quit IRC16:04
*** v1k0d3n has joined #openstack-containers16:05
*** mnasiadka has joined #openstack-containers16:07
*** armaan has quit IRC16:07
*** armaan has joined #openstack-containers16:08
tiswansostrigazi:  just add --require-kubeconfig or change --kubeconfig to require-kubeconfig?16:08
*** mjura has quit IRC16:08
tiswansothx for your help, btw16:09
strigazitiswanso add --require-kubeconfig16:09
*** trinaths has joined #openstack-containers16:10
*** mnasiadka has quit IRC16:12
*** mnasiadka has joined #openstack-containers16:17
*** yamamoto has joined #openstack-containers16:18
*** trinaths has quit IRC16:19
*** yamamoto has quit IRC16:19
tiswansostrigazi  added it and did 'systemctl restart kubelet'.  Still exiting16:20
*** yamamoto has joined #openstack-containers16:20
strigazitiswanso sudo runc list16:22
tiswanso[root@k8s-cluster-5ibc6pt6avhz-minion-0 kubernetes]# runc list16:22
tiswansoID           PID         STATUS      BUNDLE                                                                        CREATED                          OWNER16:22
tiswansokube-proxy   2084        running     /sysroot/ostree/deploy/fedora-atomic/var/lib/containers/atomic/kube-proxy.0   2018-02-06T03:06:08.186508617Z   root16:22
strigazitiswanso so kubelet stopped,16:23
*** pcichy has joined #openstack-containers16:23
strigazitiswanso: try to do system restart kubelet again16:23
strigazitiswanso: try to do systemctl restart kubelet again16:23
tiswansosame...    Active: failed (Result: exit-code) since Tue 2018-02-06 16:23:57 UTC; 3s ago16:24
tiswansosystemctl status kubelet  not showing great info16:24
tiswanso Process: 20587 ExecStart=/bin/runc --systemd-cgroup run kubelet (code=exited, status=1/FAILURE)16:25
tiswansojournalctl -t kubelet has no entries16:25
strigazitry to start it now16:25
*** yamamoto has quit IRC16:25
*** ricolin has quit IRC16:26
*** ricolin_ has joined #openstack-containers16:26
*** trinaths has joined #openstack-containers16:28
*** mnasiadka has quit IRC16:29
*** yamamoto has joined #openstack-containers16:30
tiswansostrigazi:  still no luck -- https://gist.github.com/tiswanso/459f78f5156639c69f70182fe987236216:32
strigazitiswanso fedora atomic 26?16:33
strigaziatomic --version16:34
strigaziis it 1.18.x ?16:34
*** itlinux has joined #openstack-containers16:34
strigazitiswanso: I would try to reboot the vm :)16:34
tiswanso1.18.116:34
strigazigood version16:34
tiswansoPRETTY_NAME="Fedora 26 (Atomic Host)"16:34
tiswansosure16:35
*** ricolin_ has quit IRC16:35
*** mnasiadka has joined #openstack-containers16:37
*** ricolin has joined #openstack-containers16:38
tiswansostrigazi still no luck after vm reboot :-(16:42
*** mnasiadka has quit IRC16:42
*** dsariel has quit IRC16:42
strigazigrep -i kube_tag /etc/sysconfig/heat-params16:42
tiswansoKUBE_TAG="v1.7.4"16:43
strigazips aux | grep kubelet there is probably a process somewhere hanging16:44
tiswansodon't see one.  with grep kube, just see kube-proxy, flaneld16:45
strigazido systemctl stop kubelet16:45
strigazithen systemctl cat kubelet and execute the execstart command16:46
tiswansoI added a comment to that gist with the output:  https://gist.github.com/tiswanso/459f78f5156639c69f70182fe987236216:50
tiswansoopenstack cloud-provider issue?16:51
strigaziError: failed to run Kubelet: could not init cloud provider "openstack": Resource not found16:51
strigaziyes16:51
strigazitiswanso: it a bug in the cloudprovider16:51
*** mnasiadka has joined #openstack-containers16:52
strigaziyou can disable the provider if you want or do some changes in your env16:52
tiswansostrigazi is cloud-provider built into the cluster image?16:52
strigaziare you in devstack?16:53
tiswansoyes... devstack16:53
strigaziyou can add redirection for the keystone endpoints16:53
*** jmlowe has quit IRC16:53
strigazicentos or ubuntu?16:53
*** gsimondon has joined #openstack-containers16:53
*** jmlowe has joined #openstack-containers16:53
tiswansocould I just pull a known good fedora-atomic image?16:53
strigazitiswanso the problem is not in the image16:54
tiswansomy devstack base is ubuntu xenial16:54
tiswansostrigazi ok cool16:54
strigazitiswanso: https://github.com/openstack/magnum/commit/674b90548d35b0f311b7c1f39cb5b5a6fd085eeb16:54
strigazitiswanso: you need to add redirection from v3 to /identity/v316:55
strigazitiswanso: then it will work16:55
tiswansook great... I'll do that, thanks!16:55
*** dsariel has joined #openstack-containers16:57
*** mnasiadka has quit IRC16:57
*** ramishra has quit IRC17:01
*** derekjhyang has quit IRC17:05
*** mnasiadka has joined #openstack-containers17:07
*** dardelean has quit IRC17:07
*** dardelean has joined #openstack-containers17:08
*** gabrielvinha has quit IRC17:11
*** mnasiadka has quit IRC17:11
*** dardelean has quit IRC17:12
*** mnasiadka has joined #openstack-containers17:22
*** dpawar has joined #openstack-containers17:23
*** dpawar has quit IRC17:24
*** AlexeyAbashkin has quit IRC17:25
*** AlexeyAbashkin has joined #openstack-containers17:25
*** udesale has quit IRC17:25
*** mnasiadka has quit IRC17:26
*** AlexeyAbashkin has quit IRC17:29
*** mnasiadka has joined #openstack-containers17:37
*** dsariel has quit IRC17:37
*** mnasiadka has quit IRC17:42
*** dpawar has joined #openstack-containers17:47
*** dsariel has joined #openstack-containers17:50
*** mnasiadka has joined #openstack-containers17:52
*** oikiki has joined #openstack-containers17:54
*** dardelean has joined #openstack-containers17:55
*** ricolin has quit IRC17:56
*** mnasiadka has quit IRC17:56
*** yamamoto has quit IRC17:59
*** dardelean has quit IRC17:59
*** yamamoto has joined #openstack-containers18:00
*** absubram has quit IRC18:03
*** mnasiadka has joined #openstack-containers18:07
*** lpetrut has quit IRC18:25
*** flwang1 has joined #openstack-containers18:32
*** lpetrut has joined #openstack-containers18:33
*** harlowja has joined #openstack-containers18:35
*** olivierbourdon38 has joined #openstack-containers18:36
flwang1strigazi: still around?18:38
*** flwang1 has quit IRC18:51
*** mnasiadka has quit IRC18:57
*** AlexeyAbashkin has joined #openstack-containers19:00
*** yamamoto has quit IRC19:08
*** dsariel has quit IRC19:08
*** oikiki has quit IRC19:33
*** oikiki has joined #openstack-containers19:33
*** mgoddard_ has quit IRC19:47
*** lpetrut has quit IRC19:48
*** salmankhan has quit IRC19:53
*** absubram has joined #openstack-containers20:01
*** mgoddard_ has joined #openstack-containers20:25
*** mgoddard_ has quit IRC20:38
*** flwang1 has joined #openstack-containers20:39
*** dsariel has joined #openstack-containers20:44
*** olivierbourdon38 has quit IRC20:50
*** hongbin has joined #openstack-containers20:50
*** takamatsu has quit IRC21:01
*** tiswanso has quit IRC21:06
*** dpawar_ has joined #openstack-containers21:17
*** dpawar has quit IRC21:19
*** dpawar_ has quit IRC21:21
*** AlexeyAbashkin has quit IRC21:21
*** threestrands has joined #openstack-containers21:32
*** threestrands has quit IRC21:32
*** threestrands has joined #openstack-containers21:32
*** dave-mcc_ has quit IRC21:41
*** jmlowe has quit IRC21:42
*** itlinux has quit IRC21:50
*** oikiki has quit IRC21:54
*** oikiki has joined #openstack-containers21:54
*** itlinux has joined #openstack-containers21:55
*** openstackgerrit has quit IRC22:16
*** jmlowe has joined #openstack-containers22:28
*** rcernin has joined #openstack-containers22:28
*** flwang has quit IRC22:46
*** itlinux has quit IRC22:53
*** flwang has joined #openstack-containers22:53
*** openstackgerrit has joined #openstack-containers23:08
openstackgerritMerged openstack/magnum master: Deprecate usage of tenant and user in context  https://review.openstack.org/53246323:08
*** armaan has quit IRC23:27
*** absubram has quit IRC23:38
*** gsimondon has quit IRC23:40
*** absubram has joined #openstack-containers23:51
*** absubram has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!