Thursday, 2018-12-20

*** hongbin has quit IRC00:04
*** itlinux has quit IRC01:02
openstackgerritYang Le proposed openstack/magnum master: Change docker image pulling policy from Always to IfNotPresent  https://review.openstack.org/62641701:24
*** sapd1 has joined #openstack-containers01:30
*** sapd1 has quit IRC01:54
*** sapd1_x has joined #openstack-containers01:54
*** ykarel|away has joined #openstack-containers02:12
*** ykarel|away has quit IRC02:24
*** ykarel|away has joined #openstack-containers02:25
*** ykarel|away has quit IRC02:29
*** rcernin has quit IRC02:31
*** Bhujay has joined #openstack-containers02:40
*** Bhujay has quit IRC02:47
*** ricolin has joined #openstack-containers02:47
*** Bhujay has joined #openstack-containers02:47
*** Bhujay has quit IRC02:48
*** sapd1_x has quit IRC02:48
*** Bhujay has joined #openstack-containers02:49
*** Bhujay has quit IRC02:50
*** Bhujay has joined #openstack-containers02:50
*** Bhujay has quit IRC02:51
*** Bhujay has joined #openstack-containers02:52
*** Bhujay has quit IRC02:53
*** Bhujay has joined #openstack-containers02:53
*** Bhujay has quit IRC02:54
*** Bhujay has joined #openstack-containers02:55
*** rcernin has joined #openstack-containers02:55
*** Bhujay has quit IRC02:56
*** Bhujay has joined #openstack-containers02:56
*** Bhujay has quit IRC02:57
*** Bhujay has joined #openstack-containers02:58
*** Bhujay has quit IRC02:59
*** PagliaccisCloud has joined #openstack-containers02:59
*** Bhujay has joined #openstack-containers02:59
*** Bhujay has quit IRC03:00
*** Bhujay has joined #openstack-containers03:01
*** Bhujay has quit IRC03:02
*** Bhujay has joined #openstack-containers03:02
*** Bhujay has quit IRC03:03
*** Bhujay has joined #openstack-containers03:04
*** Bhujay has quit IRC03:05
*** Bhujay has joined #openstack-containers03:05
*** Bhujay has quit IRC03:06
*** Bhujay has joined #openstack-containers03:07
*** Bhujay has quit IRC03:08
*** Bhujay has joined #openstack-containers03:08
*** Bhujay has quit IRC03:09
*** Bhujay has joined #openstack-containers03:10
*** ykarel|away has joined #openstack-containers03:14
*** Bhujay has quit IRC03:15
*** ykarel|away has quit IRC03:18
*** ykarel|away has joined #openstack-containers03:18
*** hongbin has joined #openstack-containers03:22
*** ykarel|away has quit IRC03:29
*** ykarel has joined #openstack-containers03:41
*** Bhujay has joined #openstack-containers03:41
*** Bhujay has quit IRC03:46
openstackgerritErik Olof Gunnar Andersson proposed openstack/magnum master: Removed admin_* from devstack config  https://review.openstack.org/61403404:00
*** rcernin has quit IRC04:05
*** sapd1_x has joined #openstack-containers04:07
*** hongbin has quit IRC04:08
*** rcernin has joined #openstack-containers04:12
*** hongbin has joined #openstack-containers04:43
*** sapd1_x has quit IRC04:55
*** Bhujay has joined #openstack-containers05:02
*** sapd1_x has joined #openstack-containers05:07
*** ykarel has quit IRC05:10
*** hongbin has quit IRC05:24
*** ykarel has joined #openstack-containers05:36
*** fragatina has quit IRC05:42
*** fragatina has joined #openstack-containers05:43
*** janki has joined #openstack-containers05:55
*** fragatina has quit IRC06:00
*** fragatina has joined #openstack-containers06:00
*** fragatina has quit IRC06:03
*** fragatina has joined #openstack-containers06:04
*** fragatina has quit IRC06:04
*** fragatina has joined #openstack-containers06:06
*** fragatina has quit IRC06:07
*** fragatina has joined #openstack-containers06:07
*** fragatina has quit IRC06:09
*** fragatina has joined #openstack-containers06:10
*** fragatina has quit IRC06:10
*** fragatina has joined #openstack-containers06:11
*** fragatina has quit IRC06:12
*** fragatina has joined #openstack-containers06:12
*** fragatina has quit IRC06:19
*** fragatina has joined #openstack-containers06:20
*** fragatina has quit IRC06:30
*** fragatina has joined #openstack-containers06:30
*** fragatina has quit IRC06:31
*** fragatina has joined #openstack-containers06:31
*** fragatina has quit IRC06:33
*** fragatina has joined #openstack-containers06:34
*** fragatina has quit IRC06:35
*** fragatina has joined #openstack-containers06:35
*** fragatina has quit IRC06:37
*** fragatina has joined #openstack-containers06:38
*** fragatina has quit IRC06:38
*** fragatina has joined #openstack-containers06:39
*** rcernin has quit IRC06:56
*** Bhujay has quit IRC07:13
*** ricolin has quit IRC07:14
*** PagliaccisCloud has quit IRC07:18
*** Bhujay has joined #openstack-containers07:23
*** Bhujay has quit IRC07:24
*** Bhujay has joined #openstack-containers07:24
*** pcaruana has joined #openstack-containers07:25
*** Bhujay has quit IRC07:26
*** Bhujay has joined #openstack-containers07:26
*** Bhujay has quit IRC07:27
*** Bhujay has joined #openstack-containers07:27
*** Bhujay has quit IRC07:29
*** Bhujay has joined #openstack-containers07:29
*** Bhujay has quit IRC07:30
*** Bhujay has joined #openstack-containers07:30
*** Bhujay has quit IRC07:32
*** Bhujay has joined #openstack-containers07:32
*** Bhujay has quit IRC07:33
*** Bhujay has joined #openstack-containers07:33
*** Bhujay has quit IRC07:35
*** Bhujay has joined #openstack-containers07:35
*** Bhujay has quit IRC07:36
*** Bhujay has joined #openstack-containers07:36
*** Bhujay has quit IRC07:38
*** Bhujay has joined #openstack-containers07:38
*** Bhujay has quit IRC07:39
*** Bhujay has joined #openstack-containers07:39
*** Bhujay has quit IRC07:41
*** Bhujay has joined #openstack-containers07:41
*** Bhujay has quit IRC07:42
*** Bhujay has joined #openstack-containers07:42
*** Bhujay has quit IRC07:44
*** jonaspaulo_ has joined #openstack-containers07:44
*** Bhujay has joined #openstack-containers07:44
*** Bhujay has quit IRC07:45
*** Bhujay has joined #openstack-containers07:45
*** Bhujay has quit IRC07:47
*** Bhujay has joined #openstack-containers07:47
*** Bhujay has quit IRC07:48
*** Bhujay has joined #openstack-containers07:48
*** Bhujay has quit IRC07:50
*** Bhujay has joined #openstack-containers07:50
*** Bhujay has quit IRC07:51
*** Bhujay has joined #openstack-containers07:51
*** Bhujay has quit IRC07:53
*** Bhujay has joined #openstack-containers07:53
*** Bhujay has quit IRC07:54
*** Bhujay has joined #openstack-containers07:54
openstackgerritDebo Zhang proposed openstack/magnum master: Correct path of environment file for flannel-docker-bridge service  https://review.openstack.org/61317707:54
openstackgerritDebo Zhang proposed openstack/magnum master: Correct path of environment file for flannel-docker-bridge service  https://review.openstack.org/61317707:55
*** Bhujay has quit IRC07:56
*** Bhujay has joined #openstack-containers07:56
*** Bhujay has quit IRC07:57
*** Bhujay has joined #openstack-containers07:57
*** Bhujay has quit IRC07:59
*** Bhujay has joined #openstack-containers07:59
*** Bhujay has quit IRC08:00
*** Bhujay has joined #openstack-containers08:00
*** Bhujay has quit IRC08:02
*** Bhujay has joined #openstack-containers08:02
*** Bhujay has quit IRC08:03
*** Bhujay has joined #openstack-containers08:03
*** Bhujay has quit IRC08:05
*** Bhujay has joined #openstack-containers08:05
*** Bhujay has quit IRC08:06
*** Bhujay has joined #openstack-containers08:07
*** ykarel is now known as ykarel|lunch08:11
*** Bhujay has quit IRC08:46
*** ykarel|lunch is now known as ykarel08:59
*** ricolin has joined #openstack-containers09:12
*** PagliaccisCloud has joined #openstack-containers09:16
*** ttsiouts has joined #openstack-containers09:26
*** brtknr has joined #openstack-containers09:37
*** mkuf_ has joined #openstack-containers09:56
*** mkuf has quit IRC09:59
*** PagliaccisCloud has quit IRC10:19
*** Bhujay has joined #openstack-containers10:23
brtknrstrigazi: whats responsible for generating /etc/kubernetes/kubelet? mine is not being generated either on the master or the minion..10:34
brtknras a result, magnum/drivers/common/templates/kubernetes/fragments/configure-kubernetes-master.sh fails to execute10:35
*** ignaziocassano1 has joined #openstack-containers10:39
ignaziocassano1hello, anyone installed magnum kubernetes on queens with kuberneted dashboard ?10:40
*** ignaziocassano1 has quit IRC10:44
*** salmankhan has joined #openstack-containers10:46
*** mkuf has joined #openstack-containers10:46
*** mkuf_ has quit IRC10:49
*** vabada has quit IRC10:58
*** vabada has joined #openstack-containers11:00
*** zufar has joined #openstack-containers11:09
zufarhi i get stuck when creating kubernetes multi master.11:09
zufar`master_count must be 1 when master_lb_enabled is False`11:10
zufari have create coe template with `--master-lb-enabled` option.11:10
zufarand have octavia installed.11:10
*** ttsiouts has quit IRC11:10
*** ttsiouts has joined #openstack-containers11:11
*** ttsiouts has quit IRC11:15
yankcrimelol11:16
yankcrimethat's timely11:16
yankcrimehttps://storyboard.openstack.org/#!/story/2003034 is your problem11:16
zufaryankcrime: its for me?11:19
zufari check and i think it is difference problem11:19
yankcrimeyes11:19
zufarmy cluster is not starting yes because this problem11:20
zufarmaster_count must be 1 when master_lb_enabled is False (HTTP 400)11:20
zufarit give 400 error code.11:20
zufarbut my master_lb_enabled is true. `master_lb_enabled     | True`11:21
yankcrimeoh, that's something slightly different11:21
yankcrimebut you'll hit this problem anyway11:21
zufarare magnum is not able to create multi master cluster?11:22
*** fragatina has quit IRC11:37
*** fragatina has joined #openstack-containers11:37
*** fragatina has quit IRC11:38
*** fragatina has joined #openstack-containers11:38
*** salmankhan has quit IRC11:41
*** salmankhan has joined #openstack-containers11:42
*** dave-mccowan has quit IRC11:42
*** dave-mccowan has joined #openstack-containers11:43
*** salmankhan has quit IRC11:46
*** salmankhan has joined #openstack-containers11:50
*** ttsiouts has joined #openstack-containers11:52
yankcrimeit can, but it doesn't apply the right security group to the loadbalancer interface that's created11:54
yankcrimewell, it doesn't apply any security group - the loadbalancer inherits the default sg11:55
yankcrimeif you do that manually after the loadbalancer has been created then the cluster builds successfully11:55
*** udesale has joined #openstack-containers11:56
yankcrimei don't know about the problem you have with master_lb_enabled though - i haven't seen that11:58
*** udesale has quit IRC12:11
*** udesale has joined #openstack-containers12:12
*** udesale has quit IRC12:15
*** udesale has joined #openstack-containers12:16
*** udesale has quit IRC12:21
*** udesale has joined #openstack-containers12:21
*** mkuf_ has joined #openstack-containers12:42
*** sapd1_x has quit IRC12:44
*** mkuf has quit IRC12:45
*** udesale has quit IRC12:49
*** udesale has joined #openstack-containers12:50
*** udesale has quit IRC12:52
*** udesale has joined #openstack-containers12:52
*** udesale has quit IRC12:53
*** udesale has joined #openstack-containers12:53
*** udesale has quit IRC12:54
*** janki has quit IRC12:54
*** udesale has joined #openstack-containers12:55
*** jonaspaulo_ has quit IRC13:08
*** mkuf has joined #openstack-containers13:24
*** salmankhan has quit IRC13:27
*** mkuf_ has quit IRC13:27
*** Bhujay has quit IRC13:31
yankcrimei've just updated that bug with a workaround - adding a single rule to the default SG fixes the problem13:31
yankcrimemagnum could do this by default but it does have a security implication that needs a bit more discussion13:32
brtknrSo you mananged to solve the issue by opening port 2379 on default SG?13:38
*** mcegiel has joined #openstack-containers13:48
yankcrimeyeah13:50
*** janki has joined #openstack-containers13:57
*** janki has quit IRC13:59
*** janki has joined #openstack-containers14:00
mcegielHi. I installed k8s cluster with default version (coe  v1.11.1, container_version 1.12.6) with calico which is quite old: v2.6.7. Are there plans to have newer version ?14:00
*** udesale has quit IRC14:05
*** udesale has joined #openstack-containers14:06
*** ykarel is now known as ykarel|away14:07
mcegielQuestion2: in calico-node daemonset  the CALICO_IPV4POOL_IPIP:off. Is there any way to enable and change encapsulation ?14:16
*** salmankhan has joined #openstack-containers14:22
*** ykarel|away has quit IRC14:26
*** ttsiouts has quit IRC14:33
*** ttsiouts has joined #openstack-containers14:34
*** ttsiouts has quit IRC14:38
*** fragatina has quit IRC14:42
*** fragatina has joined #openstack-containers14:42
*** ttsiouts has joined #openstack-containers14:43
*** janki has quit IRC14:47
*** fragatina has quit IRC14:50
*** fragatina has joined #openstack-containers14:51
*** ykarel|away has joined #openstack-containers14:55
*** hongbin has joined #openstack-containers14:55
*** mkuf_ has joined #openstack-containers14:58
*** jackivanov has joined #openstack-containers14:58
*** mkuf has quit IRC15:01
*** fragatina has quit IRC15:03
*** fragatina has joined #openstack-containers15:03
*** kaiokmo has quit IRC15:16
zufaryankcrime: sorry this error happen because im using wrong template.15:22
yankcrimezufar: no worries - you'll hit the problem i mentioned next with a multi-master deployment15:23
zufaryankcrime: haha i have 2 stack failed, etcd_lb and api_lb15:24
zufarbut i think the problem is difference. i get this error15:25
zufarOctaviaClientException: resources.etcd_lb.resources.loadbalancer: Validation failure: Missing project ID in request where one is required. (HTTP 400)15:25
*** PagliaccisCloud has joined #openstack-containers15:27
zufari think this error is from [octavia_client] section in magnum.conf. previously i dont have [octavia_client] section. i try to add this15:31
brtknranyone know whats responsible for creating /etc/kubernetes/kubelet  configuration file? is it a heat script?15:36
zufari try to add [octavia_client] section in magnum.conf but still with the same error.15:59
zufaranyone know with this problem : OctaviaClientException: resources.etcd_lb.resources.loadbalancer: Validation failure: Missing project ID in request where one is required. (HTTP 400)?15:59
zufarmy octavia is running well. and magnum can deploy single master without problem.16:00
zufarhttp://lists.openstack.org/pipermail/openstack-discuss/2018-December/001208.html16:00
yankcrimezufar: i'm not using octavia, sorry16:01
brtknrzufar: im in the process of trying to bring devstack up with octavia enabled... will test and let you know when i get there16:02
brtknrzufar: how did you deploy your openstack services?16:03
*** munimeha1 has joined #openstack-containers16:11
*** udesale has quit IRC16:11
zufarbrtknr: I deploy from my ansible (created by my team).16:13
zufarnot using ansible-openstack.16:13
zufarall the step following the documentation.16:13
zufaryankcrime: thank you, no problem.16:14
brtknrzufar: interesting... then lots of things that could be at fault...16:14
brtknrzufar: *lots of possible things16:14
*** PagliaccisCloud has quit IRC16:15
zufarbrtknr: yes i think, but my octavia is running well. i think the problem is in magnum configration files. if you have test the octavia and magnum, share to me the magnum configuration please.16:15
*** zufar_ has joined #openstack-containers16:21
*** mkuf_ has quit IRC16:27
*** mkuf_ has joined #openstack-containers16:27
*** mkuf has joined #openstack-containers16:28
*** mkuf_ has quit IRC16:32
*** fragatina has quit IRC16:39
*** fragatina has joined #openstack-containers16:39
*** fragatina has quit IRC16:40
*** fragatina has joined #openstack-containers16:41
*** fragatina has quit IRC16:46
*** fragatina has joined #openstack-containers16:47
*** mcegiel has quit IRC16:47
*** fragatina has quit IRC16:51
*** fragatina has joined #openstack-containers16:51
*** fragatina has quit IRC16:52
*** fragatina has joined #openstack-containers16:52
*** fragatina has quit IRC16:52
*** fragatina has joined #openstack-containers16:53
*** roukoswarf has joined #openstack-containers16:58
*** fragatina has quit IRC16:59
roukoswarfhello, i am attempting to deploy a k8 cluster with atomic images and it doesnt seem to get past kube_master and theres no errors or anything, heat just sits there.16:59
*** fragatina has joined #openstack-containers16:59
*** fragatina has quit IRC17:01
*** fragatina has joined #openstack-containers17:01
roukoswarfseems to be overlay fighting overlay2...17:04
zufarcan you share the stack list?17:04
zufar`openstack stack list` and `openstack stack resource list`17:04
roukoswarfwell, i have a failed systemd service, the docker storage setup, failing with storage already being configured with overlay when trying to overlay217:05
roukoswarfbut, yes, moment17:05
*** fragatina has quit IRC17:05
*** fragatina has joined #openstack-containers17:06
*** ricolin has quit IRC17:09
*** fragatina has quit IRC17:10
*** fragatina has joined #openstack-containers17:10
roukoswarf| kube_masters                | 9f043bbb-149e-4681-b93f-11624d5c1d9c | OS::Heat::ResourceGroup                                                                             | CREATE_IN_PROGRESS | 2018-12-20T16:30:40Z |17:11
roukoswarfno weird status or anything, its just silent fail, ill try and resolve this storage error...17:11
*** fragatina has quit IRC17:13
*** fragatina has joined #openstack-containers17:14
*** fragatina has quit IRC17:16
*** fragatina has joined #openstack-containers17:17
yankcrimeany output on the master's console?17:27
zufarcan you ssh into the master instance and check the cloud-init-output log?17:29
roukoswarfwhat am i looking for? it looks to have gracefully completed17:32
roukoswarfmaster's tty just shows the tail end of the cloud init and the ssh key setup, no other node comes up, just master, as its stuck waiting there17:35
roukoswarfthe only "error" anywhere i can think of is the systemd service for the storage failing.17:37
*** fragatina has quit IRC17:38
*** ttsiouts has quit IRC17:50
*** ttsiouts has joined #openstack-containers17:51
*** ttsiouts has quit IRC17:55
*** ykarel|away has quit IRC18:11
*** ianychoi has quit IRC18:22
*** salmankhan has quit IRC18:27
roukoswarfwhy would heat not continue after the kube master node sends the signal?18:29
openstackgerritMerged openstack/magnum master: fix bug link in readme  https://review.openstack.org/59754819:26
*** jackivanov has quit IRC19:54
*** jackivanov has joined #openstack-containers19:54
*** pcaruana has quit IRC19:57
*** jackivanov has quit IRC19:59
*** jackivanov has joined #openstack-containers20:06
*** jackivanov has quit IRC20:09
*** jackivanov has joined #openstack-containers20:09
*** jackivanov has quit IRC20:14
*** fragatina has joined #openstack-containers20:14
*** fragatina has quit IRC20:15
*** jackivanov has joined #openstack-containers20:22
*** jackivanov has quit IRC20:23
*** jackivanov has joined #openstack-containers20:24
*** jackivanov has quit IRC20:26
*** jackivanov has joined #openstack-containers20:27
*** jackivanov has quit IRC20:31
openstackgerritAndreas Jaeger proposed openstack/python-magnumclient master: Use template for lower-constraints  https://review.openstack.org/62673620:48
*** roukoswarf has quit IRC21:17
*** fragatina has joined #openstack-containers21:25
*** fragatina has quit IRC21:26
*** fragatina has joined #openstack-containers21:26
*** fragatina has quit IRC21:27
*** fragatina has joined #openstack-containers21:27
*** fragatina has quit IRC21:30
*** fragatina has joined #openstack-containers21:30
*** zufar has quit IRC21:30
*** zufar_ is now known as zufar21:30
*** fragatina has quit IRC21:42
*** fragatina has joined #openstack-containers21:42
*** PagliaccisCloud has joined #openstack-containers21:44
*** fragatina has quit IRC21:44
*** fragatina has joined #openstack-containers21:45
*** fragatina has quit IRC21:47
*** fragatina has joined #openstack-containers21:47
*** munimeha1 has quit IRC21:50
flwangstrigazi: hello, around?21:59
brtknrflwang: he's not been around today... probably on holiday...22:02
*** itlinux has joined #openstack-containers22:04
flwangbrtknr: no problem, thanks22:05
flwangbrtknr: btw, did you test the cloud provider patch?22:05
*** fragatina has quit IRC22:05
*** fragatina has joined #openstack-containers22:06
brtknrI wanted to but since our cloud doesnt support cinder, ive been trying to get devstack up and running but having issues with it...22:06
brtknrflwang: do you know by any chance whats responsible for creating /etc/kubernetes/kubelet file?22:07
brtknrflwang: mine is missing so the setup script fails on master22:07
brtknrflwang: magnum doesnt use kubeadm does it?22:08
*** ivve has quit IRC22:08
flwangare you talking about this https://github.com/openstack/magnum/blob/master/magnum/drivers/common/templates/kubernetes/fragments/configure-kubernetes-minion.sh#L180 ?22:08
flwangmagnum is not using kubeadm22:09
brtknrflwang: also, i'd like to see what k8s yaml spec you used to create your cinder pvc22:10
brtknrhttps://github.com/openstack/magnum/blob/master/magnum/drivers/common/templates/kubernetes/fragments/configure-kubernetes-master.sh#L20022:10
brtknri was talking about this^22:10
brtknrbut same thing22:11
brtknri dont have /etc/kubernetes/kubelet in my minion either22:11
flwangwhat's the image you're using?22:13
brtknrFedora-Atomic-27-20180419.0.x86_6422:15
brtknrim doing a standard devstack deployment22:15
brtknron ubuntu 18.0422:15
brtknrhttp://paste.openstack.org/show/737809/22:16
brtknrthats what my local.conf looks like22:16
brtknrthe weird thing is ive used the same settting to successfully deploy before22:17
*** ivve has joined #openstack-containers22:20
flwangcan you see any error in cloud-init-output.log?22:22
flwangare you using barbican as cert manager?22:23
*** fragatina has quit IRC22:23
*** fragatina has joined #openstack-containers22:24
*** fragatina has quit IRC22:32
*** fragatina has joined #openstack-containers22:33
brtknryes barbican i think22:45
brtknryes error in cloud init about not finding /etc/kubernetes/kubelet22:46
*** rcernin has joined #openstack-containers22:50
brtknrflwang: appears to be working on a clean vm... must have been a configuration clash23:08
brtknrcould you share your pvc and sc yaml files?23:08
brtknrfor cinder?23:08
brtknrill test in the morning23:09
brtknrgnite23:09
flwangbrtknr: wait a sec23:10
flwangi have found the root cause, but i'm trying to figure out why23:10
flwanghttp://paste.openstack.org/show/737811/23:10
*** itlinux has quit IRC23:11

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!