Thursday, 2017-10-05

kfox1111helm to java? fun...00:01
jascott1nice guy but better him than me :)00:03
jascott1kfox1111 have you used k8s 1.7.7? my beautiful automated install is all broken and i think thats why00:03
kfox1111hehe.00:06
kfox1111no, not yet.00:06
kfox1111k8s 1.8 patches just merged. when did you try it last?00:07
jascott1using terraform and playbook to rebuild and has been working great but just started blowing up. i think its 1.7.7 but not sure00:07
kfox1111know what its blowing up on?00:09
jascott1kubeadm init00:10
jascott1i wasnt specifying the version and I am using config file (alpha) so still digging00:10
*** mrunge has quit IRC00:12
*** jdg has joined #openstack-kolla00:12
kfox1111if not specifying the version, then its 1.8.00:13
kfox1111have a look at: https://review.openstack.org/#/c/508682/00:13
kfox1111I'm guessing its one of those things.00:14
*** mrunge has joined #openstack-kolla00:14
*** jtriley has joined #openstack-kolla00:16
jascott1hmm kubeadm was saying 1.7.700:17
bkeroSo I want to add a custom policy file for glance in my kolla-deployed cloud00:18
bkeroDo I add those to "{{ node_custom_config }}" (/etc/kolla/config) as /etc/kolla/config/glance/policy.json?00:18
kfox1111weird. 1.8 has been in the repo for a few days now.00:19
jascott1kfox1111 oh i think the apt kube deps being 1.7.5 and kubeadm not being specified was the prob. veryifying00:28
kfox1111ah. could be.00:29
jascott1kfox1111 btw I got dynamic storage with openstack provisioner working00:33
jascott1since then tho it seems Tiller needs to restarted after install00:34
jascott1not sure if related00:34
jascott1that prometheus-operator is vert slick also :)00:34
kfox1111cool. :)00:34
kfox1111I've been meaning to try the prometheus-operator. I've only used the helm chart so far.00:34
kfox1111and have been itching to heavily rework the prometheus helm chart.00:34
kfox1111its too monolithic.00:35
jascott1for a dev cluster its the bees knees00:35
jascott1(prometheus-operator)00:35
kfox1111:)00:35
jascott1still working on the galera one, it looks like im going to fork the etcd one00:35
jascott1its has 90% of same needs00:35
kfox1111yeah. I thought it might be pretty similar.00:36
kfox1111I think the main difference is recovery strategy.00:36
jascott1right00:36
jascott1the interface is very similar, backup/restore, TLS etc00:37
kfox1111not sure how reasonable it is or not, but if it is very very similar except for that one part,00:37
kfox1111maybe it can be abstracted.00:37
jascott1does the helm prometheus setup grafana and all?00:37
kfox1111then stuff like postgresql cluster operators and things might be easier in the future. :)00:37
kfox1111no, but there is a grafana chart too.00:37
jascott1yeah i saw they wanted to abstract their backup storage providers00:37
kfox1111between the two, its not too bad to startup an instance.00:38
jascott1go can do .so like things now, i wonder if anyone is doing that00:38
kfox1111hmm... yeah, that might be another way to solve it.00:38
jascott1that prometheus operator is a one liner and gets a bunch of dashboards setup for cluster health etc00:39
jascott1def check it out, its a great UX installing it00:39
jascott1casue it works without any bs (at least for me)00:39
kfox1111ok. will do. thanks for the recommendation. :)00:39
kfox1111not sure I told you....00:40
kfox1111I got kube-dashboard + dex authentication working.00:40
jascott1cool00:40
jascott1whats dex? :)00:40
kfox1111can authenticate the dashboard against ldap, github, google account, etc.00:40
jascott1ah woot!00:41
kfox1111kind of hard to explain. oidc bridge to other authentication mechanisms.00:41
kfox1111https://github.com/coreos/dex00:41
kfox1111the charts are in progress here:00:42
kfox1111https://github.com/kfox1111/charts/tree/dex/stable/dex00:42
kfox1111and:00:42
kfox1111https://github.com/kfox1111/charts/tree/oidc/stable/kubernetes-dashboard00:42
kfox1111and got a good stab at instructions here:00:42
kfox1111https://github.com/kfox1111/charts/blob/oidc/stable/kubernetes-dashboard/MiniKubeOIDC.md00:42
kfox1111its very rough, but it is repeatable. at least on my box. :)00:43
kfox1111with a slight variant was able to launch github based auth to my local minikube. :)00:43
kfox1111gotta head out. talk to you later.00:44
jascott1nice. yeah have a good one00:44
kfox1111if you end up playing with the dex/dashboard stuff, please let me know how it goes.00:44
jascott1hope to at some point but busy atm. might roll it into playbook at some point :)00:45
kfox1111cool.00:45
kfox1111I'm hoping to figure it out a little bit more, then role in the oidc proxy into things like prometheus so it has some form of auth on it.00:46
kfox1111also would allow to single sign on to all the things then too.00:46
kfox1111ok. really heading out this time. have a good one. :)00:47
*** tovin07_ has joined #openstack-kolla00:48
*** hrw has quit IRC00:51
*** hrw has joined #openstack-kolla00:53
*** Sean-md has joined #openstack-kolla00:59
*** jdg has quit IRC00:59
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/50944301:02
*** jtriley has quit IRC01:11
*** erlon has quit IRC01:22
*** duonghq has joined #openstack-kolla01:27
duonghqmorning guys01:36
*** Guest1487 has quit IRC01:55
*** dave-mcc_ has quit IRC01:57
*** livelace-link has quit IRC01:59
*** mcnanci has quit IRC02:00
*** unicell has quit IRC02:07
*** unicell has joined #openstack-kolla02:08
*** unicell has quit IRC02:13
openstackgerritJeffrey Zhang proposed openstack/kolla master: Moving jobs to kolla repo  https://review.openstack.org/50866102:14
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/50944302:35
*** jgriffith_ has joined #openstack-kolla02:42
*** mdnadeem has joined #openstack-kolla02:49
*** mcnanci has joined #openstack-kolla02:58
spsuryamorning all03:02
spsuryaduonghq: sup03:02
duonghqsup spsurya03:06
*** jgriffith_ has quit IRC03:08
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/50944303:27
*** gkadam has joined #openstack-kolla03:37
*** tonyb has quit IRC03:42
*** dardelean_ has joined #openstack-kolla03:55
*** tonyb has joined #openstack-kolla03:56
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/50944303:57
*** dardelean_ has quit IRC03:59
*** vhosakot has quit IRC04:03
*** silva_ has quit IRC04:07
*** jgriffith has quit IRC04:11
*** jgriffith has joined #openstack-kolla04:11
*** skramaja has joined #openstack-kolla04:27
*** coolsvap has joined #openstack-kolla04:33
*** cocakolla has quit IRC04:45
*** jtriley has joined #openstack-kolla04:48
*** lpetrut has joined #openstack-kolla05:30
*** janki has joined #openstack-kolla05:43
*** genek has joined #openstack-kolla05:44
*** unicell has joined #openstack-kolla05:45
*** unicell1 has joined #openstack-kolla05:48
*** unicell has quit IRC05:50
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/50944306:04
*** lpetrut has quit IRC06:10
*** jbadiapa has joined #openstack-kolla06:19
*** jtriley has quit IRC06:20
*** hachi_ has joined #openstack-kolla06:28
*** jascott1_ has joined #openstack-kolla06:31
*** jascott1 has quit IRC06:31
*** dardelean_ has joined #openstack-kolla06:38
*** dardelean_ has quit IRC06:55
*** mewald has joined #openstack-kolla06:59
*** unicell1 has quit IRC07:02
openstackgerritDuong Ha-Quang proposed openstack/kolla master: kolla: do not mention arch specific images in --help  https://review.openstack.org/50892207:05
*** jtriley has joined #openstack-kolla07:08
*** pcaruana has joined #openstack-kolla07:08
*** dardelean_ has joined #openstack-kolla07:14
*** dardelean_ has quit IRC07:16
*** Zophar has left #openstack-kolla07:27
*** jmccarthy has quit IRC07:27
*** Zophar has joined #openstack-kolla07:27
*** jmccarthy has joined #openstack-kolla07:27
*** jmccarthy has left #openstack-kolla07:28
*** jascott1_ has quit IRC07:41
*** jascott1 has joined #openstack-kolla07:41
*** genek has quit IRC07:43
*** jascott1 has quit IRC07:46
*** dardelean_ has joined #openstack-kolla07:48
*** genek has joined #openstack-kolla07:51
*** egonzalez has joined #openstack-kolla07:58
*** pmisiak has joined #openstack-kolla08:13
pmisiakhey08:14
pmisiakcould you tell me please why neutron-l3-agent is disabled when neutron-vpnaas is enabled?08:14
pmisiakhttps://github.com/openstack/kolla-ansible/commit/be0fcb5b99107e846f53cba2fa649f7d7d622077#diff-14f07297fe222150ddb6334461a6d45eR24608:15
pmisiakline 24608:15
*** shardy has joined #openstack-kolla08:19
pmisiakberendt: looks like its your commit08:19
*** serlex has joined #openstack-kolla08:22
*** hieulq has quit IRC08:26
*** duonghq has quit IRC08:26
*** duonghq has joined #openstack-kolla08:27
*** hieulq has joined #openstack-kolla08:27
*** jemcevoy has quit IRC08:28
*** daidv has quit IRC08:29
openstackgerritJames McCarthy proposed openstack/kolla-ansible master: Update container_proxy with configurable proxy settings  https://review.openstack.org/50971308:29
*** daidv has joined #openstack-kolla08:30
*** jmccarthy has joined #openstack-kolla08:30
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Fix deployment with public TLS enabled  https://review.openstack.org/50918608:36
*** jemcevoy has joined #openstack-kolla08:38
*** hachi_ has quit IRC08:42
*** jbadiapa has quit IRC09:03
*** inc0 has quit IRC09:13
*** jemcevoy has quit IRC09:13
*** gfidente|afk is now known as gfidente09:13
*** jbadiapa has joined #openstack-kolla09:17
*** genek has quit IRC09:20
*** jemcevoy has joined #openstack-kolla09:28
*** jemcevoy has quit IRC09:34
*** rob_d_ has joined #openstack-kolla09:34
*** inc0 has joined #openstack-kolla09:35
*** jemcevoy has joined #openstack-kolla09:35
openstackgerritJames McCarthy proposed openstack/kolla-ansible master: Update container_proxy with configurable proxy settings  https://review.openstack.org/50971309:43
*** jascott1 has joined #openstack-kolla09:45
openstackgerritVladislav Belogrudov proposed openstack/kolla-ansible master: Add Barbican section in Nova and Cinder to use disk encryption  https://review.openstack.org/50952909:51
openstackgerritJames McCarthy proposed openstack/kolla-ansible master: Update container_proxy with configurable proxy settings  https://review.openstack.org/50971309:51
openstackgerritJames McCarthy proposed openstack/kolla-ansible master: Update container_proxy with configurable proxy settings  https://review.openstack.org/50971309:59
*** pbourke has quit IRC10:00
*** pbourke has joined #openstack-kolla10:01
*** tovin07_ has quit IRC10:09
jmccarthyegonzalez: quick question about comments in 509713 - re: the three properties - not sure I understand ? I wanted them to be individual properties for the user to (optionally) set10:13
*** duonghq has quit IRC10:14
egonzalezjmccarthy, i dont mind in that comment, just saw that docker settings are the same way https://github.com/openstack/kolla-ansible/blob/master/ansible/group_vars/all.yml#L9210:15
egonzalezbut containers does not have idempotency due lack of checks in config.yml10:15
jmccarthyI missed some of your comments - looking at that now10:15
jmccarthyAlso I didn't want to add it into common, then all would get it ? I have it for magnum conductor only because it needs to reach http:/etcd.io or some such10:16
egonzalezjmccarthy, common is an example of how is done10:17
egonzalezin defaults set the var, handlers read defaults value and config.yml evaluates if value changed10:17
jmccarthykk will look closer at that now10:17
egonzalezjmccarthy, those proxy setting cannot be configured in docker_common_options? https://github.com/openstack/kolla-ansible/blob/master/ansible/group_vars/all.yml#L92 just question10:18
jmccarthyegonzalez: Well they can, but not sure we need/want all the containers to get the proxy settings ?10:19
jmccarthyegonzalez: Martin has extra stuff in the bug (loops over hosts, fqdn) - but I'm not clear all of that is really needed ?10:24
*** genek has joined #openstack-kolla10:27
*** genek has quit IRC10:31
pbourkeegonzalez: I dont think we want these in all containers10:33
pbourkeegonzalez: just the ones that need it such as magnum10:33
egonzalezpbourke, docker module does not allow empty environment, a fake environment value need to be added https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/common/defaults/main.yml#L3610:35
egonzalezso, conductor set needed environment and api set a dummy environment values10:35
pbourkeits not empty though?10:35
egonzaleznope, it fails in https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/common/tasks/config.yml#L21710:36
*** magicboiz has quit IRC10:39
*** rob_d_ has quit IRC10:40
pbourkewe're not seeing this for common services though10:40
pbourkeonly magnum10:40
jmccarthyNot sure I follow, I don't think api needs anything ?10:42
egonzalezcommon is an example of role using environment10:42
egonzalezif set an environment to conductor in same way as common role does, when reaching checking containers step will fail10:43
*** lvdombrkr has joined #openstack-kolla10:44
pbourkeso you're saying if we do 'kolla-ansible reconfigure --tags magnum' with this patch it should fail?10:44
lvdombrkrhello folks, i need to stop webserver (Horizon) on kolla to renew letsencrypt certeficate, and than start again, how can i do that?10:45
*** rob_d_ has joined #openstack-kolla10:46
egonzalezno, if change any value in the var wont change in container10:48
egonzalezbecause is not handled in "Check containers" task10:48
egonzalezif apply same behaviour as `common` role and not set environment to all containers, also will fail10:49
egonzalezthe fix is add a useless environment to containers who not need them10:49
pbourkeok I think I get you now10:50
pbourkeegonzalez: thanks for explaining :)10:52
lvdombrkrhello folks, i need to stop webserver (Horizon) on kolla to renew letsencrypt certeficate, and than start again, how can i do that?10:56
*** genek has joined #openstack-kolla10:58
pbourkelvdombrkr: 'docker stop horizon' ?11:00
*** dave-mccowan has joined #openstack-kolla11:04
lvdombrkrpbourke: tried but same error: Attempting to renew cert from /etc/letsencrypt/renewal/openktt.conf produced an unexpected error: Could not bind TCP port 443 because it is already in use by another process on this system (such as a web server). Please stop the program in question and then try again.. Skipping.11:07
pbourkelvdombrkr: something must be bound to that port then... maybe check 'netstat -altpn' ?11:08
lvdombrkrpbourke: http://paste.openstack.org/show/622743/11:11
lvdombrkrpbourke: thats means i need stop haproxy container?11:12
pbourkelvdombrkr: ah, yes, my bad :)11:13
*** ansmith has quit IRC11:18
*** Sean-md has quit IRC11:25
jmccarthyegonzalez: Should I add the dummy one to the magnum defaults for both api and conductor ?11:26
lvdombrkrpbourke: ha, interesting after that i get Attempting to renew cert from /etc/letsencrypt/renewal/k.conf produced an unexpected error: Failed authorization procedure. kratt-openstack-dev.makonix.com (tls-sni-01): urn:acme:error:connection :: The server could not connect to the client to verify the domain :: Error getting validation data. Skipping.11:29
*** zhubingbing has joined #openstack-kolla11:29
zhubingbinghi guys11:29
openstackgerritJames McCarthy proposed openstack/kolla-ansible master: Update container_proxy with configurable proxy settings  https://review.openstack.org/50971311:40
*** dardelean_ has quit IRC12:04
*** dardelean_ has joined #openstack-kolla12:05
egonzalezhey zhubingbing sup12:10
zhubingbinghi  egonzalez12:11
openstackgerritJames McCarthy proposed openstack/kolla-ansible master: Update container_proxy with configurable proxy settings  https://review.openstack.org/50971312:13
*** seanmurphy has joined #openstack-kolla12:15
seanmurphyhi guys - are there any public containers out there for ocata point releases or even pike? (ideally for centos)12:16
egonzalezseanmurphy, nope, only thing published are registry tarballs at tarballs.openstack.org  but is not recommended usage, is only for kolla CI12:17
seanmurphywe thought that might be the case - thanks egonzalez12:18
egonzalezsome people has published their own images to dockerhub, maybe can find someone with public images to use12:20
*** lpetrut has joined #openstack-kolla12:23
jmccarthyegonzalez: pbourke: Thanks for the great feedback, I tested locally, with reconfigure, looking much better12:24
pbourkejmccarthy: lgtm but will let egonzalez check first ;)12:25
openstackgerritMerged openstack/kolla master: Make plugins optional in opendaylight & ovn  https://review.openstack.org/50782512:29
*** genek has quit IRC12:29
*** ansmith has joined #openstack-kolla12:43
*** zhubingbing has quit IRC12:45
*** gkadam has quit IRC12:54
*** gkadam has joined #openstack-kolla12:57
*** magicboiz has joined #openstack-kolla12:57
*** dardelean_ has quit IRC13:00
*** magicboiz has quit IRC13:02
*** gkadam has quit IRC13:02
*** genek has joined #openstack-kolla13:03
*** dardelean_ has joined #openstack-kolla13:06
*** magicboiz has joined #openstack-kolla13:09
*** jtriley has quit IRC13:10
*** magicboiz has quit IRC13:20
*** magicboiz has joined #openstack-kolla13:20
*** goldyfruit has joined #openstack-kolla13:21
*** vbel has joined #openstack-kolla13:28
*** erlon has joined #openstack-kolla13:28
vbelhello, from https://docs.openstack.org/kolla-ansible/latest/reference/designate-guide.html it is unclear how to configure designate interface. It has to be public for mdns part and at the same time it runs on network nodes where we have public interface with unassigned IP (bridge for instances). To follow the logic of the guide I need to create two external interfaces on such nodes. Won't be such designate interface a security concern? Usual13:32
vbelly we had neutron_external_interfaces with no IP so one could not connect to the hosts from outside. I use external router to manage external fqdn13:32
*** jaosorior has quit IRC13:35
*** coolsvap has quit IRC13:36
egonzalezvbel, network nodes still can connect to HAproxy as is the only external node in kolla13:39
egonzalezdns interface can be the same as network/api/cluster interface13:39
egonzalezbut if need dns from inside VMs, will need connectivity to it13:40
*** jtriley has joined #openstack-kolla13:41
*** skramaja has quit IRC13:42
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/50944313:42
vbelegonzalez, thanks, my use case is that I don't allow external VIP, external clients only connect to neutron_external_interface (network nodes or computes) or to a router which redirects external address to internal vip13:43
egonzalezhrm, do the same for dns interface then13:43
egonzalezthe separate interface is to allow admins secure only the dns traffic, as is a public accessible service13:44
vbelyes, that's possible, thanks!13:44
egonzalezcould even use api interface used for internal vip13:45
vbelI use api interface and internal vip runs on it13:45
vbelI have interfaces for every traffic type :)13:46
egonzalezyeah, i mean, set dns interface to {{ api_interface }}, and only have to configure one net13:46
vbelok, thanks13:46
egonzalezmuch better that :)13:46
*** ansmith has quit IRC13:50
*** zhubingbing_ has joined #openstack-kolla13:51
*** dardelean_ has quit IRC13:56
openstackgerritMerged openstack/kolla-ansible master: Update container_proxy with configurable proxy settings  https://review.openstack.org/50971313:57
*** hongbin has joined #openstack-kolla13:59
*** shardy has quit IRC14:00
*** shardy has joined #openstack-kolla14:00
*** janki has quit IRC14:08
*** janki has joined #openstack-kolla14:08
*** jaosorior has joined #openstack-kolla14:10
*** dardelean_ has joined #openstack-kolla14:10
*** jheroux has joined #openstack-kolla14:16
*** serlex has quit IRC14:17
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Revert "Remove show_multiple_locations in glance-api"  https://review.openstack.org/50979214:18
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Revert "Remove show_multiple_locations in glance-api"  https://review.openstack.org/50979214:20
*** lpetrut_ has joined #openstack-kolla14:25
*** mdnadeem has quit IRC14:25
*** dardelea_ has joined #openstack-kolla14:26
*** lpetrut has quit IRC14:27
*** dardelean_ has quit IRC14:28
*** janki has quit IRC14:28
*** trozet has quit IRC14:33
*** vhosakot has joined #openstack-kolla14:34
openstackgerritPierre Hanselmann proposed openstack/kolla-ansible master: Enable image http source on Horizon  https://review.openstack.org/50978414:41
*** magicboiz has quit IRC14:43
*** magicboiz has joined #openstack-kolla14:44
*** jamesbenson has joined #openstack-kolla14:45
openstackgerritPierre Hanselmann proposed openstack/kolla-ansible master: Enable image http source on Horizon  https://review.openstack.org/50978414:45
openstackgerritPierre Hanselmann proposed openstack/kolla-ansible master: Enable image http source on Horizon  https://review.openstack.org/50978414:48
*** magicboiz has quit IRC14:49
*** magicboiz has joined #openstack-kolla14:55
*** dardelea_ has quit IRC14:57
*** dardelean_ has joined #openstack-kolla14:58
*** dardelean_ has quit IRC14:58
*** dardelean_ has joined #openstack-kolla14:58
*** jaosorior has quit IRC15:07
*** noVNC has joined #openstack-kolla15:10
*** trozet has joined #openstack-kolla15:10
*** ssurana has joined #openstack-kolla15:11
*** dardelean_ has quit IRC15:13
openstackgerritPierre Hanselmann proposed openstack/kolla-ansible master: Enable image http source on Horizon  https://review.openstack.org/50978415:13
*** Zophar has quit IRC15:15
*** ssurana has left #openstack-kolla15:15
*** zhubingbing_ has quit IRC15:17
*** gfidente is now known as gfidente|pto15:18
noVNCanyone seen this error https://pastebin.com/raw/DBcx4VSh performing an upgrade ???15:18
*** lrensing has joined #openstack-kolla15:21
*** ntpttr_laptop has joined #openstack-kolla15:24
*** pmisiak has quit IRC15:29
egonzaleznoVNC, likely some missing group in inventory file15:31
*** lrensing has quit IRC15:31
jmccarthyDoes a magnum error like this ring a bell with anyone ?15:31
jmccarthymagnum-conductor.log:2017-10-05 16:24:55.945 22 ERROR oslo.service.loopingcall [req-205359d1-7054-4fc8-b2a5-613c1104a44d - - - - -] Fixed interval looping call 'magnum.service.periodic.ClusterUpdateJob.update_status' failed: ValueError: Field `master_addresses[0]' cannot be None15:31
*** mewald has quit IRC15:36
*** ansmith has joined #openstack-kolla15:37
noVNCegonzalez, have an idea which one?15:38
egonzalezcould be any, compare your inventory with new release inventory15:39
noVNCegonzalez, ok15:39
*** pcaruana has quit IRC15:39
*** jbadiapa has quit IRC15:45
*** lrensing has joined #openstack-kolla15:48
seanmurphyvbel: just a heads up - we encountered this issue when trying to use designate with ocata/stable containers (the ones on dockerhub) on centos - https://bugs.launchpad.net/neutron/+bug/1696889 - we decided to defer the designate deployment to a later date15:57
openstackLaunchpad bug 1696889 in neutron "external_dns_driver causes floating ip association to fail" [Undecided,Fix released] - Assigned to Daniel Russell (danielr-2)15:57
vbelseanmurphy, thanks a million! I will write that down15:58
*** hrw has quit IRC15:59
kfox1111morning.15:59
kfox1111https://review.openstack.org/#/c/507252/ is ready.16:00
*** egonzalez has quit IRC16:00
*** vhosakot has quit IRC16:09
*** mewald has joined #openstack-kolla16:11
*** seanmurphy has quit IRC16:12
jmccarthyJust wondering, has anyone tried out magnum recently ? :)16:16
*** noVNC has quit IRC16:28
*** jascott1 has quit IRC16:32
*** jascott1 has joined #openstack-kolla16:32
kfox1111jmccarthy: not in over a year. :/16:36
jmccarthykfox1111: kk probably (hopefully!) I'm doing something wrong :}16:37
jmccarthyI think I'm missing some volume config ?16:41
jmccarthymagnum-conductor.log:2017-10-05 17:33:38.282 25 ERROR oslo_messaging.rpc.server     docker_volume_type = cluster.labels.get(16:41
jmccarthymagnum-conductor.log:2017-10-05 17:33:38.282 25 ERROR oslo_messaging.rpc.server AttributeError: 'NoneType' object has no attribute 'get'16:41
bkeroHi all. I'm trying to do a stable/pike all-in-one kolla deployment. "Running Neutron bootstrap container" is failing, says the container exited with non-zero return code. Running 'docker logs $CONTAINER' I can see that it can't write to /var/log/kolla/neutron because it does not exist.16:55
bkeroDoes anyone know where the task create those log directories would be?16:55
*** kolla-slack has quit IRC17:08
*** kolla-slack has joined #openstack-kolla17:08
*** kolla-slack has quit IRC17:09
*** kolla-slack has joined #openstack-kolla17:09
kolla-slack<egonzalez> bkero, check docker logs bootstrap_neutron17:10
bkeroegonzalez: I did, it told me Permission Denied17:11
bkeroto /var/log/kolla/neutron/neutron.log17:12
*** jascott1 has quit IRC17:18
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/50944317:22
*** dardelean_ has joined #openstack-kolla17:26
*** jmccarthy has left #openstack-kolla17:26
*** markmcclain has quit IRC17:26
*** markmcclain has joined #openstack-kolla17:29
*** dardelean_ has quit IRC17:30
*** dardelean_ has joined #openstack-kolla17:33
*** noVNC has joined #openstack-kolla17:36
*** seanmurphy has joined #openstack-kolla17:37
*** lpetrut_ has quit IRC17:41
*** dardelean_ has quit IRC17:47
*** noVNC has quit IRC17:47
*** dardelean has joined #openstack-kolla17:54
*** silva has joined #openstack-kolla17:56
silvahello, I installed Horizon using Kolla. When I try to access the web interface, i get error 500. So i tried to find in the httpd logs any error, and i cant find anythin. I notice that the folder /var/www/cgi-bin is empty. Is that the problem?17:56
inc0silva: on host, it will be empty18:12
inc0check /var/lib/docker/volumes/kolla_logs18:12
inc0this is where all service logs are stored18:12
*** dardelean_ has joined #openstack-kolla18:13
*** dardelean_ has quit IRC18:13
*** dardelean_ has joined #openstack-kolla18:20
*** dardelean_ has quit IRC18:20
silvainc0: [core:error] [pid 64] [client xxxxx:4115] End of script output before headers: django.wsgi18:29
inc0silva: hmm I never seen that one18:29
inc0might want to check with horizon community18:29
*** lpetrut_ has joined #openstack-kolla18:29
*** sambetts|afk has quit IRC18:33
kfox1111 /var/www/cgi-bin isn't used by horizon.18:35
kfox1111check under /var/log/kolla/*  for logs?18:35
*** sambetts_ has joined #openstack-kolla18:36
inc0kfox1111: I assume that's "end of script output before headers"18:36
silvakfox1111: yeah18:36
kfox1111ah.18:36
kfox1111hmm...18:36
kfox1111I think the horizon config file is pulled in directly as python code.18:37
kfox1111so if there is a typo/formatting issue in it, I think it could cause that message.18:37
silvakfox1111: how can I check that18:37
kfox1111not sure the easiest way to do that.18:38
silvahttps://bugs.launchpad.net/horizon/+bug/157348818:39
openstackLaunchpad bug 1573488 in OpenStack Dashboard (Horizon) "Openstack Mitaka: can not access dashboard(internal server 500)" [Undecided,Expired]18:39
silvahow can I restart apache inside the docker?18:40
inc0docker restart horizon18:41
*** hachi_ has joined #openstack-kolla18:44
silvasolved: added this line WSGIApplicationGroup %{GLOBAL} to the conf file: /etc/httpd/conf.d/openstack-dashboard.conf18:45
*** jascott1 has joined #openstack-kolla18:50
kfox1111inc0: we may need that in genconfig?18:50
robcresswellIt looks like that is already in Horizon master. https://github.com/openstack/horizon/blob/master/openstack_dashboard/management/commands/apache_vhost.conf.template#L2318:50
kfox1111jascott1: https://groups.google.com/forum/#!topic/kubernetes-sig-apps/d_zV4esoNF818:50
jascott1haha i came here to say 'nice comment' to you sir!18:51
kfox1111ah. cool. :)18:51
jascott1hopefully we will have some active discussion18:52
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/50944318:52
kfox1111please +1 it or something so they know I'm not the only crazy one. :)18:52
jascott1i will do something. hard for me to speak authoritatively since I havent had to deal with this (i dont run PRD clusters)18:53
kfox1111sure. but you could comment from the helm perspective maybe.18:53
kfox1111I think having a configmap uploaded by helm and then being deleted by not helm feels really antihelm.18:54
jascott1yup :)18:54
kfox1111technically what they are talking about would save a little bit of memory in etcd.18:54
jascott1i think we are about to start mailing list for Helm18:54
kfox1111but I don't think that savings is really worht it.18:54
kfox1111oh, that would be nice.18:54
kfox1111please ping me if they do. I'd like to lurk. :)18:55
*** mewald has quit IRC18:55
jascott1i am going to propose some kind of interaction with Helm community to get input on pain points, what they need etc18:55
kfox1111+118:55
jascott1prob just a mass survey18:56
kfox1111I can think of a few things.18:57
jascott1Helm 3.0 meetup in January isnt too far off, it would be great to seed discussion now18:57
kfox1111oh. was wondering about that.18:57
kfox1111are they meeting anywhere or is its virutal?18:57
jascott1sounds like its going to be In Portland18:57
jascott1come on down!18:57
kfox1111hmm.... I might be able to do that. :)18:58
jascott1yeah I will let you know when the details are finalized but *might* be at the Crystal Ballroom18:59
kfox1111cool. thanks. :)18:59
jascott1which is a nice little music venue but I didnt realize they hosted business events there18:59
jascott1they do have a stage it would be great to have a little jam for all the musicians :) but I am probably expecting too much19:00
kfox1111know how long they are planning on having it?19:00
jascott1i think its just 1 day afaik19:00
kfox1111hehe.19:00
kfox1111k. yeah, I think I could probably swing that...19:00
jascott1nice19:00
*** vhosakot has joined #openstack-kolla19:02
jascott1btw if you are needing some contemporary Dune references in pop culture the new Mystery Science Theatere 3000 episode "Chrismas that almost wasnt" makes three of them :D19:02
vhosakotinc0, jamesbenson: I wrote a blog about how to deploy ceph with OpenStack Ocata in case you guys or anyone wants to refer - https://communities.cisco.com/community/developer/openstack/blog/2017/10/04/how-to-deploy-ceph-with-openstack-ocata19:05
kfox1111jascott1: hehe. nice.19:06
*** MasterOfBugs has joined #openstack-kolla19:11
*** hrw has joined #openstack-kolla19:16
*** Suicky has joined #openstack-kolla19:18
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP: shared netns support.  https://review.openstack.org/50543619:19
*** aagate has quit IRC19:26
*** Suicky has quit IRC19:31
*** mewald has joined #openstack-kolla19:32
*** mewald has quit IRC19:34
*** seanmurphy has quit IRC19:54
jamesbensonthanks vhosakot!  I'm writing something up as well on my side... will admit that I'm having issues with Pike though.20:02
openstackgerritCharlie Kang proposed openstack/kolla-ansible master: ovs-dpdkctl.sh function list_dpdk_nics only grabs the first nic  https://review.openstack.org/50531920:03
jamesbensonvhosakot, wow! Impressive ceph.conf... I keep mine simple.  :-). I'm might dig more into that and borrow parts :-)20:03
*** vhosakot has quit IRC20:04
kfox1111https://review.openstack.org/#/c/507252/ is ready for reviews20:14
*** vhosakot has joined #openstack-kolla20:15
*** dardelean_ has joined #openstack-kolla20:21
*** dardelean_ has quit IRC20:25
jascott1vhosakot nice work on the blog20:26
vhosakotjascott1: haha, thanks! yeah, wanted to write a ceph blog since many months :)20:28
*** gfidente|pto has quit IRC20:30
*** jtriley has quit IRC20:32
*** jtriley has joined #openstack-kolla20:32
*** unicell has joined #openstack-kolla20:34
*** ansmith has quit IRC20:42
jamesbensonvhosakot: Is ceph in your blog L or prior?  I noticed the xfs as mkfs type20:49
vhosakotjamesbenson: yes, mkfs type is xfs.  It is ceph hammer (0.94) with OpenStack Ocata.  why do you ask?20:52
SamYaplevhosakot: hammer is EOL :O20:54
SamYapleyou gotta upgrade man20:54
vhosakotSamYaple: yes, I know.. we are upgrading now :)20:54
SamYaplehaha cool20:54
*** lpetrut_ has quit IRC20:55
jamesbensonI asked because of bluestore....20:57
*** dardelean_ has joined #openstack-kolla21:01
*** dardelean_ has quit IRC21:01
*** dardelean_ has joined #openstack-kolla21:01
vhosakotjamesbenson: yeah, I haven't played with bluestore.  it's in ceph Luminous right?21:02
jamesbensonyes, required21:02
vhosakotcool21:03
jamesbensonvhosakot: http://docs.ceph.com/docs/luminous/rados/configuration/bluestore-config-ref/21:05
vhosakotjamesbenson: cool, thanks for the link21:05
*** dardelean_ has quit IRC21:06
kolla-slack<britthouser> It always made me scratch my head that Ceph was providing virtual block devices, on top of object store (XFS), on top of physical block devices.  And even squirrelier when you had object store (rados gw) on top of that!21:09
kfox1111hehe.21:11
*** jheroux has quit IRC21:11
SamYaple@britthouser yea but we are in the future now. its virtual block devices on top of physical block devices directly now21:14
kfox1111I'll go a step farther...21:14
SamYaplepls no21:14
kfox1111your storage, has an os, which is making a physical block layer into a virtual block layer with a whole remapping/wearleveling /journaling leayer in there... ;)21:14
kfox1111ssd's and even hd's do it now.21:15
SamYapleheh yea21:15
kfox1111I had one of those moments a couple weeks ago....21:15
kfox1111we upgraded motherboard firmware on a box.21:15
kfox1111and the power supplies behavior changed. the power supplies even have its own firmware now.21:15
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: Remove the resolv.conf workaround  https://review.openstack.org/50725221:17
*** hachi_ has quit IRC21:42
jamesbensonkfox1111 yeah, I've noticed that too with the power supplies... I find that so odd!21:43
kfox1111yeah.21:43
jamesbensonbut that's tech, always changing and always evolving..21:43
*** bmace has joined #openstack-kolla21:43
kfox1111I wonder just how many os's are in a modern computer.21:43
jamesbensonI'm waiting for a PS trojan or something...21:43
kfox1111hehe. yeah.21:43
jamesbensonthey make motherboard firmware ones... just waiting...21:44
kfox1111yeah.21:44
kfox1111so....21:45
kfox1111for shared mouont namespaces in docker....21:45
kfox1111do you have to tweak docker flags to support that?21:45
*** MasterOfBugs has quit IRC21:46
*** MasterOfBugs has joined #openstack-kolla21:46
kfox1111oh.... wait. the kubelet change I saw was probably only for /var/lib/kubelet to make it shared. not /run/netns...21:46
kfox1111hmm....21:46
vhosakotnice description Britt! :)  SamYaple, jamesbenson: so, in the new design (virtual block devices on top of physical block devices directly) in bluestore, what is the mkfs type?21:47
jamesbenson:-/. I don't expressly define one...21:49
vhosakotah got it.21:50
*** jamesbenson has quit IRC21:51
*** jtriley has quit IRC21:54
SamYaplevhosakot: bluestore21:54
vhosakotSamYaple: I see, thanks.21:55
SamYaplevhosakot: bluestore is data written directly to the blockdevice, no posix filesystem. there is a xfs metadat partition of ~100mb though for keys and otherbits21:55
SamYapleand bluestore is *technically* a filesystem, but its all internal to ceph code21:55
vhosakotcool, xfs holds just the metadata21:55
SamYapleyea, but not metadata for the bluestore partition, but like metadata for the ceph cluster (keys, uuid, etc)21:56
vhosakotcool21:57
*** pramodrj07 has joined #openstack-kolla22:04
*** MasterOfBugs has quit IRC22:07
*** signed8bit has joined #openstack-kolla22:11
kfox1111whatss: [Service] MountFlags=shared EOF22:21
kfox1111does that change the default mount flag?22:21
*** jtriley has joined #openstack-kolla22:22
*** ansmith has joined #openstack-kolla22:25
kfox1111inc0: ping22:34
kfox1111anyone awake thats familior with how the shared mounts in kolla-ansible works?22:38
*** lrensing has quit IRC22:44
*** dardelean_ has joined #openstack-kolla22:48
*** dardelean has quit IRC22:50
kfox1111the MountFlags was already on my system...22:56
kfox1111something still seems to need to bind mount shared /run/netns...22:56
kfox1111I'm not sure how kolla-ansible is doing it.22:56
kfox1111hmmm... I might have setup the shared option a while ago....22:57
*** erlon has quit IRC23:01
*** mrunge has quit IRC23:06
*** hongbin has quit IRC23:07
*** mrunge has joined #openstack-kolla23:07
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP: shared netns support.  https://review.openstack.org/50543623:14
*** ntpttr_laptop has quit IRC23:31
*** ntpttr_laptop has joined #openstack-kolla23:38
*** dardelean_ has quit IRC23:45
*** vhosakot has quit IRC23:52
*** pramodrj07 has quit IRC23:56
*** kbyrne has quit IRC23:57
openstackgerritKevin Fox proposed openstack/kolla-kubernetes master: WIP: shared netns support.  https://review.openstack.org/50543623:58
*** kbyrne has joined #openstack-kolla23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!