Friday, 2018-01-05

*** yangyapeng has joined #openstack-kolla00:09
*** jistr has quit IRC00:11
*** yangyapeng has quit IRC00:14
*** goldyfruit has joined #openstack-kolla00:14
*** zhurong has joined #openstack-kolla00:15
*** jistr has joined #openstack-kolla00:16
*** yangyapeng has joined #openstack-kolla00:20
*** yangyapeng has quit IRC00:25
*** EmilienM has quit IRC00:30
*** markmcclain has quit IRC00:30
*** markmcclain has joined #openstack-kolla00:32
*** goldyfruit has quit IRC00:36
*** tovin07_ has joined #openstack-kolla00:43
*** dave-mccowan has joined #openstack-kolla00:48
*** dardelean has joined #openstack-kolla00:58
*** dardelean has quit IRC00:58
*** dardelean has joined #openstack-kolla00:59
*** mrunge has quit IRC00:59
*** mrunge has joined #openstack-kolla01:01
*** dardelean has quit IRC01:03
*** markmcclain has quit IRC01:05
*** markmcclain has joined #openstack-kolla01:13
*** pengdake has joined #openstack-kolla01:14
*** zhangfei has joined #openstack-kolla01:17
*** kiennt26 has joined #openstack-kolla01:18
*** caowei has joined #openstack-kolla01:18
openstackgerritDai Dang Van proposed openstack/kolla-ansible master: Support policy.yaml file for Aodh  https://review.openstack.org/51456501:20
*** pengdake has quit IRC01:39
kfox1111got elasticsearch to support tailing logs from pods. :)01:45
*** dardelean has joined #openstack-kolla01:46
*** ManoX has quit IRC01:54
*** hieulq has quit IRC01:55
*** hieulq has joined #openstack-kolla01:55
*** daidv has quit IRC01:57
*** daidv has joined #openstack-kolla01:57
*** ljjjustin has joined #openstack-kolla02:04
*** genek has quit IRC02:10
*** yangyapeng has joined #openstack-kolla02:11
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Try to fix deploy jobs in kolla side  https://review.openstack.org/53127702:13
*** threestrands_ has joined #openstack-kolla02:14
*** threestrands_ has quit IRC02:14
*** threestrands_ has joined #openstack-kolla02:14
*** pengdake has joined #openstack-kolla02:15
openstackgerritJeffrey Zhang proposed openstack/kolla master: [DNM]Testing kolla-ansible change which fix the deploy jobs  https://review.openstack.org/53127902:16
*** threestrands has quit IRC02:16
*** zzzeek has quit IRC02:19
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible master: Try to fix deploy jobs in kolla side  https://review.openstack.org/53127702:20
*** zzzeek has joined #openstack-kolla02:20
*** zzzeek has quit IRC02:20
*** zzzeek has joined #openstack-kolla02:21
*** dardelean has quit IRC02:24
inc0Jeffrey4l: I already submitted deploy gate fix02:28
Jeffrey4linc0, yeah. i just saw. and +w for your patches.02:28
inc0cool02:28
inc0so that should be good02:28
inc0https://review.openstack.org/#/c/531028/ check this out too02:29
inc0simplifies things;)02:29
*** markmcclain has quit IRC02:29
openstackgerritMerged openstack/kolla-ansible master: Fix kolla gates  https://review.openstack.org/53103102:30
*** markmcclain has joined #openstack-kolla02:34
Jeffrey4lcool02:34
*** harlowja has quit IRC02:36
*** pengdake has quit IRC02:36
*** dardelean has joined #openstack-kolla02:40
*** pengdake has joined #openstack-kolla02:40
*** markmcclain has quit IRC02:43
*** dardelean has quit IRC02:44
*** markmcclain has joined #openstack-kolla02:45
*** genek has joined #openstack-kolla02:49
*** xinliang has quit IRC02:52
*** markmcclain has quit IRC02:53
*** markmcclain has joined #openstack-kolla02:55
*** scheuk has quit IRC02:58
*** unicell has quit IRC03:02
*** xinliang has joined #openstack-kolla03:04
*** xinliang has joined #openstack-kolla03:04
*** genek has quit IRC03:05
chasoninc0 around?03:11
*** genek has joined #openstack-kolla03:20
*** unicell has joined #openstack-kolla03:24
openstackgerritQi Peng proposed openstack/kolla-ansible master: Start ntp service  https://review.openstack.org/53128503:32
*** zhurong has quit IRC03:34
*** genek has quit IRC03:45
*** markmcclain has quit IRC03:45
*** markmcclain has joined #openstack-kolla03:47
*** zhangfei has quit IRC03:50
*** genek has joined #openstack-kolla03:55
*** janonymous has joined #openstack-kolla03:56
*** genek has quit IRC04:00
*** zhangfei has joined #openstack-kolla04:03
*** pengdake has quit IRC04:04
*** genek has joined #openstack-kolla04:04
*** mdnadeem has joined #openstack-kolla04:15
daidvJeffrey4l, could you review this for me again: https://review.openstack.org/#/c/514565/04:20
Jeffrey4ldaidv, LGTM +204:23
*** goldyfruit has joined #openstack-kolla04:30
*** spsurya has joined #openstack-kolla04:33
spsuryamorning04:33
daidvJeffrey4l, thanks.04:33
*** opstack has joined #openstack-kolla04:34
*** opstack has left #openstack-kolla04:38
*** mdorman has joined #openstack-kolla04:42
openstackgerritJustin Scott proposed openstack/kolla-kubernetes master: Deploy with ansible inside orchestration container  https://review.openstack.org/52084704:43
*** pengdake has joined #openstack-kolla04:46
*** dardelean has joined #openstack-kolla04:56
*** mdorman has quit IRC05:00
*** dardelean has quit IRC05:00
*** dave-mccowan has quit IRC05:06
*** dmsimard has quit IRC05:09
*** skramaja has joined #openstack-kolla05:09
openstackgerritJustin Scott proposed openstack/kolla-kubernetes master: Deploy with ansible inside orchestration container  https://review.openstack.org/52084705:10
*** markmcclain has quit IRC05:12
*** markmcclain has joined #openstack-kolla05:15
*** janki has joined #openstack-kolla05:24
*** unicell1 has joined #openstack-kolla05:39
*** unicell has quit IRC05:39
*** pengdake has quit IRC05:50
*** pengdake has joined #openstack-kolla05:51
*** goldyfruit has quit IRC05:53
*** pengdake has quit IRC05:56
*** pengdake has joined #openstack-kolla05:57
*** zhangfei has quit IRC06:03
*** pengdake has quit IRC06:05
*** pengdake has joined #openstack-kolla06:05
*** zhangfei has joined #openstack-kolla06:06
*** magicboiz has joined #openstack-kolla06:07
*** threestrands_ has quit IRC06:13
*** magicboiz has quit IRC06:14
*** billp has quit IRC06:15
*** magicboiz has joined #openstack-kolla06:17
*** magicboiz has quit IRC06:18
*** billp has joined #openstack-kolla06:27
*** masber has quit IRC06:43
*** cah_link has joined #openstack-kolla06:52
*** masuberu has joined #openstack-kolla06:54
*** caowei has quit IRC06:55
*** egonzalez has joined #openstack-kolla06:56
openstackgerritJustin Scott proposed openstack/kolla-kubernetes master: Deploy with ansible inside orchestration container  https://review.openstack.org/52084706:59
openstackgerritMerged openstack/kolla-ansible master: Support policy.yaml file for Aodh  https://review.openstack.org/51456507:07
*** ArminderSingh has joined #openstack-kolla07:12
openstackgerritMerged openstack/kolla-ansible master: Fix ironic inspector public endpoint  https://review.openstack.org/52827807:12
*** lvdombrkr has joined #openstack-kolla07:14
*** caowei has joined #openstack-kolla07:20
*** magicboiz has joined #openstack-kolla07:28
*** magicboiz has quit IRC07:28
*** wojdec has joined #openstack-kolla07:31
*** wojdec1 has joined #openstack-kolla07:33
*** wojdec has quit IRC07:35
openstackgerritJuan Badia Payno proposed openstack/kolla master: Fluentd plugins rpm installation on CentOS  https://review.openstack.org/52980607:46
*** zhurong has joined #openstack-kolla07:48
*** kristaps_ has joined #openstack-kolla07:48
*** b_bezak has joined #openstack-kolla07:49
*** lvdombrkr has quit IRC07:51
*** shardy has joined #openstack-kolla07:57
*** shardy has quit IRC08:01
*** shardy has joined #openstack-kolla08:03
*** yangyapeng has quit IRC08:15
*** yangyapeng has joined #openstack-kolla08:15
*** zhurong has quit IRC08:16
*** masuberu has quit IRC08:21
*** root___ has joined #openstack-kolla08:25
*** zhurong has joined #openstack-kolla08:27
*** zhangfei has quit IRC08:29
*** zhangfei has joined #openstack-kolla08:41
*** root___ is now known as zhouya08:45
* zhouya 08:45
*** mrunge has quit IRC08:50
*** mrunge has joined #openstack-kolla08:52
*** mgoddard has joined #openstack-kolla08:54
*** ktibi has joined #openstack-kolla08:59
openstackgerritChason Chan proposed openstack/kolla-ansible master: Quickstart rewrite  https://review.openstack.org/52620009:08
openstackgerritChason Chan proposed openstack/kolla-ansible master: Quickstart rewrite  https://review.openstack.org/52620009:15
*** johnthetubaguy has quit IRC09:17
*** johnthetubaguy has joined #openstack-kolla09:18
*** lpetrut has joined #openstack-kolla09:31
*** cristicalin has joined #openstack-kolla09:34
*** cristicalin has quit IRC09:39
*** dardelean has joined #openstack-kolla09:42
*** jascott1 has quit IRC09:43
*** jascott1 has joined #openstack-kolla09:43
*** jascott1 has quit IRC09:48
*** dardelean has quit IRC09:49
hrwcan some look at https://review.openstack.org/#/c/530897/ patch? It is simple check in kolla-ansible init-runonce script for openstack client 3.12+10:06
*** sgordon has quit IRC10:08
*** pengdake has quit IRC10:09
*** pbourke has joined #openstack-kolla10:11
*** caowei has quit IRC10:12
openstackgerritDuong Ha-Quang proposed openstack/kolla master: Apply Cinder rolling upgrade  https://review.openstack.org/52954410:16
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Apply Cinder rolling upgrade  https://review.openstack.org/52954610:16
*** tovin07_ has quit IRC10:18
*** daidv has quit IRC10:22
*** kiennt26 has quit IRC10:22
*** zhangfei has quit IRC10:24
*** ljjjustin has quit IRC10:27
*** shardy has quit IRC10:35
*** sambetts|afk is now known as sambetts10:37
*** vskilet_ has joined #openstack-kolla10:42
*** shardy has joined #openstack-kolla10:42
*** dardelean has joined #openstack-kolla10:46
*** mgoddard has quit IRC10:47
*** zhurong has quit IRC10:57
*** pcaruana has joined #openstack-kolla11:02
*** sgordon has joined #openstack-kolla11:03
skramajacould some take a look at - https://review.openstack.org/#/c/526332/?11:12
*** mgoddard has joined #openstack-kolla11:13
*** DosIK has joined #openstack-kolla11:21
*** egonzalez has quit IRC11:36
*** wojdec has joined #openstack-kolla11:50
*** wojdec1 has quit IRC11:53
*** egonzalez has joined #openstack-kolla11:58
*** egonzalez90 has joined #openstack-kolla12:07
*** masuberu has joined #openstack-kolla12:08
openstackgerritChason Chan proposed openstack/kolla master: Add vitrage dashbord into horizon image  https://review.openstack.org/53045312:08
*** egonzalez has quit IRC12:09
*** egonzalez90 has quit IRC12:12
*** skramaja has quit IRC12:14
*** kong has quit IRC12:23
*** tomzo6 has joined #openstack-kolla12:23
*** numans has quit IRC12:24
openstackgerritChason Chan proposed openstack/kolla master: Add vitrage dashbord into horizon image  https://review.openstack.org/53045312:24
*** numans has joined #openstack-kolla12:24
*** rhallisey has joined #openstack-kolla12:25
*** numans has quit IRC12:25
*** strgout has joined #openstack-kolla12:28
strgouthowdy all.. just wondering.. following the install docs. Am i missing where something says install "kolla"? I see where stuff says install ansible and kolla-ansible and lots of things .. but am i missing something here?12:29
*** numans has joined #openstack-kolla12:30
*** tomzo6 has quit IRC12:30
kolla-slack1<aslancimbom100> strgout, I think quick-start guide is pretty accurate, give it a go and ping here if you get stuck12:49
*** DosIK has quit IRC12:49
*** janki has quit IRC12:50
*** wojdec1 has joined #openstack-kolla12:51
strgoutcan you show me where the quick start guide says to install kolla? I've been working through it for 4 days now. :)12:51
strgouti'm building images post pip install kolla, which doesn't seem to show up anywhere.12:52
strgouti put in 5 bug reports for kolla and kolla-ansible docs this morning also.12:53
*** wojdec has quit IRC12:53
*** janonymous has quit IRC12:55
*** mdnadeem has quit IRC12:57
kolla-slack1<aslancimbom100> Not sure if those are necessary,  if you are building your own kolla images then use kolla-ansible to deploy them12:58
kolla-slack1<aslancimbom100> not sure what you mean by installing kolla, I think you should have more trust on the documentation :slightly_smiling_face:12:58
*** egonzalez has joined #openstack-kolla12:59
strgoutHave you read the quick start guide?13:02
strgoutquick start for kolla-ansible i mean13:03
vskilet_hi !13:21
vskilet_kolla-slack1 : I work on kolla-kubernetes13:22
vskilet_and I have so much bug too ^^13:22
*** dave-mccowan has joined #openstack-kolla13:23
vskilet_kolla-slack1 : do you use this command at any moment ? sudo kolla-ansible genconfig13:24
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible master: Add v3 to tacker's keystone endpoints  https://review.openstack.org/53137413:26
vskilet_ kolla-slack1 : because there is a pull-request which propose a way which works :13:34
vskilet_https://git.openstack.org/cgit/openstack/kolla-kubernetes/commit/doc/source/deployment-guide.rst?h=refs/changes/25/524125/613:34
vskilet_sorry it's for strgout :)13:35
*** lebauce_ has quit IRC13:48
*** tonyb has quit IRC13:49
*** lebauce has joined #openstack-kolla13:50
*** tonyb has joined #openstack-kolla13:50
*** jistr is now known as jistr|biab13:51
*** genek has quit IRC14:03
*** genek has joined #openstack-kolla14:03
strgoutoh sorry did know. I've been working through the docker based one.14:09
rwellumvskilet_: Feel free to try this as well for kolla-k8s: curl https://raw.githubusercontent.com/RichWellum/k8s/master/ko.py | python - ens3 ens4 --image_version pike14:10
rwellumvskilet_: replace with your interfaces of course.14:10
strgoutens3 being mgmt/api/etc and ens4 being neutron external?14:12
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Add networking-sfc package to tacker images  https://review.openstack.org/53137914:13
rwellumstrgout: after you build images, what do the logs say? What are you doing with the images - basically 3 options: 1. local, 2. local docker registry, 3. push them to dockerhub/equiv14:13
rwellumstrgout: yes - correct - but note this is kolla-k8s14:14
strgoutalso the quick start guide walks through how to install kolla-ansible then hits a section about building images and then fails to point out that kolla needs to be installed (pip install kolla). My build host is a bit poky so i'm guessing its going to be a little while.14:18
strgoutBTW openstack_release: "pike" <- does this me latest pike or 5.0.0?14:19
egonzalezstrgout building is optional, just set pike and leave registry setting in globals by default and will use dockerhub images14:19
egonzalezLatest pike14:19
strgoutmeaning comment out the registy lines in global?14:20
egonzalezKeep as default, comment will work too14:21
egonzalezWhy dont we merge https://github.com/Juniper/contrail-docker/wiki/OpenContrail-Kolla into main kolla codebase?14:24
*** ljjjustin has joined #openstack-kolla14:32
*** egonzalez90 has joined #openstack-kolla14:32
sbezverkHappy New Year !!14:32
sbezverkrwellum have you seen Helm hooks?14:32
rwellumHNY sbezverk :)14:33
sbezverkit looks like with them you do not need any ansible or anything at all14:33
*** genek has quit IRC14:33
rwellumYes - the pre-install, post-install hooks? https://github.com/kubernetes/helm/blob/master/docs/charts_hooks.md14:34
sbezverkyep14:34
sbezverkit looks like they were added not too long ago.14:34
inc0good early morning:)14:35
rwellumsbezverk: very cool14:35
sbezverkrwellum any plans to use them in kolla-k8s?14:35
inc0sbezverk: I don't think it will replace ansible14:35
*** egonzalez has quit IRC14:35
sbezverkinc0 of course ;)14:35
*** genek has joined #openstack-kolla14:36
inc0modelling of this kind of orch would be hard with helm alone14:36
*** kbaegis has joined #openstack-kolla14:36
*** goldyfruit has joined #openstack-kolla14:37
sbezverkinc0 I cannot say for sure since I just learned about them, but based on what I saw, they provide enough to be self sufficient..14:37
inc0I think one big missing feature is "wait till x is ready"14:38
*** DosIK has joined #openstack-kolla14:39
*** kolla-slack1 has quit IRC14:40
*** kolla-slack has joined #openstack-kolla14:40
sbezverkinc0 hmm, check this out: Tiller loads the resulting resources into Kubernetes. Note that if the --wait flag is set, Tiller will wait until all resources are in a ready state and will not run the post-install hook until they are ready.14:40
sbezverkthat is from the helm doc14:41
sbezverkalso all pre-install hooks need to be completed before the main chart14:41
sbezverkwill be pushed14:41
inc0question is if that will work for jobs and everything else too - if yes then we might be able to work it out14:42
*** goldyfruit has quit IRC14:42
sbezverkinc0 exactly all pre-install things are wrapped into jobs14:42
*** kolla-slack has quit IRC14:44
*** kolla-slack has joined #openstack-kolla14:44
*** kolla-slack has quit IRC14:44
*** kolla-slack has joined #openstack-kolla14:44
sbezverkinc0 anyway I do not want to derail you from ansible, just thought to share, since I think it could be a good alternative..14:44
inc0that's cool, maybe something to look forward to14:45
rwellumFor kolla-k8s, we use ansible to generate configmaps, then what else?14:46
rwellumother than future playbook to deploy14:46
*** robbbe has joined #openstack-kolla14:47
openstackgerritJuan Badia Payno proposed openstack/kolla master: Fluentd plugins rpm installation on CentOS  https://review.openstack.org/52980614:48
*** gfidente has joined #openstack-kolla14:48
*** gfidente has quit IRC14:48
*** gfidente has joined #openstack-kolla14:48
*** mdorman has joined #openstack-kolla14:52
inc0rwellum: nothing:)14:52
*** kbaegis1 has joined #openstack-kolla14:52
inc0just these 2 things14:52
kbaegis1Morning everyone14:53
*** kbaegis has quit IRC14:53
*** robbbe has quit IRC14:55
*** kbaegis has joined #openstack-kolla14:56
*** robbbe has joined #openstack-kolla14:59
*** kbaegis1 has quit IRC15:00
*** caowei has joined #openstack-kolla15:01
rwellumSo sbezverk what are you proposing an alternative too?15:02
*** goldyfruit has joined #openstack-kolla15:02
*** mdorman has quit IRC15:03
*** ljjjustin has quit IRC15:04
*** jistr|biab is now known as jistr15:04
sbezverkrwellum I think using hooks, kolla-k8s can be deployed with just helm and using a single  command end without using entrypoint :)15:06
*** caowei has quit IRC15:11
*** ljjjustin has joined #openstack-kolla15:17
*** robbbe has quit IRC15:20
*** robbbe has joined #openstack-kolla15:20
*** kbyrne has quit IRC15:23
vskilet_rwellum: Thx, I know your script (which is really good !!) but it don't works for me so I do all the process by step15:29
rwellumsbezverk: worth a shot for sure. But there's some loading and installing of packages etc - how would we do that?15:31
vskilet_rwellum : maybe you have an idea ... ?15:34
*** robbbe has quit IRC15:35
*** robbbe has joined #openstack-kolla15:36
strgout"msg": "There was an issue creating /etc/kolla//haproxy as requested: [Errno 13] Permission denied: '/etc/kolla//haproxy'", "path": "/etc/kolla//haproxy", "state": "absent"15:37
strgoutthat should be inside the docker image right?15:37
sbezverkrwellum I am not sure, there is a good chance that using hooks would require a bit of re-architecture...15:39
strgouthttps://pastebin.com/uRdfvaQA <- full barf msg15:40
strgout-v -v -v -v15:40
*** robbbe has quit IRC15:40
*** b_bezak has quit IRC15:41
strgoutoh.... maybe this didn't sudo..15:42
*** robbbe has joined #openstack-kolla15:46
*** zhouya has quit IRC15:46
*** zhouya has joined #openstack-kolla15:47
*** gfidente has quit IRC15:48
strgoutyup that was is. ansible_become=True15:49
*** robbbe has quit IRC15:52
*** gfidente has joined #openstack-kolla15:56
*** kristaps__ has joined #openstack-kolla15:57
*** kbaegis1 has joined #openstack-kolla15:57
*** kbaegis has quit IRC15:58
*** kristaps_ has quit IRC16:00
*** gfidente has quit IRC16:00
*** kbaegis has joined #openstack-kolla16:03
*** kbaegis1 has quit IRC16:04
*** cah_link has quit IRC16:04
rwellumvskilet_: and idea why my script didn't work?16:10
rwellum(an)16:10
*** robbbe has joined #openstack-kolla16:13
*** masuberu has quit IRC16:14
kfox1111morning.16:20
*** mdorman has joined #openstack-kolla16:20
*** mdorman has quit IRC16:21
kfox1111hooks are not so good I think.16:23
kfox1111they will work well when they work. its when they don't that scares me.16:23
kfox1111I think they will have a harder time with the iterative, keep fixing things when they are broken aproach.16:24
kfox1111the operator path will be much cleaner there. and have many more upgrade options.16:24
*** kristaps__ has quit IRC16:25
*** robbbe has quit IRC16:27
*** b_bezak has joined #openstack-kolla16:36
*** openstackstatus has quit IRC16:40
*** openstackstatus has joined #openstack-kolla16:41
*** ChanServ sets mode: +v openstackstatus16:41
*** ManoX has joined #openstack-kolla16:41
*** mikal has quit IRC16:43
*** mikal has joined #openstack-kolla16:45
*** jaosorior has quit IRC16:45
*** wojdec1 has quit IRC16:51
strgoutis there any point to using ceph over iscsi if i only have 1 storage host?16:51
strgoutwith  a single raid 10 disk16:51
vskilet_rwellum: I don't known ...16:51
*** masuberu has joined #openstack-kolla16:56
*** masuberu has quit IRC16:59
*** robbbe has joined #openstack-kolla17:01
*** robbbe has quit IRC17:05
*** dardelean has quit IRC17:06
*** dardelean has joined #openstack-kolla17:07
*** nathharp has joined #openstack-kolla17:08
*** ljjjustin has quit IRC17:08
nathharphi all - quick question before I have to logoff17:09
nathharpis anyone else having issues with prechecks and checking docker version?17:10
nathharpI’m getting funnies with tab spacing parsing issues17:10
*** dardelean has quit IRC17:11
nathharphttp://paste.openstack.org/show/639261/17:11
*** nathharp has quit IRC17:16
*** markmcclain has quit IRC17:20
kfox1111strgout: ceph can add nodes to the cluster easily. so if you never want to scale that out, then lvm is probably fine. but if you ever might want to scale out, ceph still might be a good choice.17:21
*** markmcclain has joined #openstack-kolla17:21
kfox1111or easily replace one node with another rather then add.17:21
*** pcaruana has quit IRC17:21
*** lpetrut has quit IRC17:31
SamYaplelets also not forget that lvm means single-point-of-failure if the lvm host goes down17:40
SamYaplethats my biggest concern17:40
strgoutthis is sitting in my house.17:41
strgoutand like i said i only have a single storage server.. so if it goes down i'm pretty much toast anyway.17:41
*** semoac has joined #openstack-kolla17:42
*** dardelean has joined #openstack-kolla17:43
SamYapleprobably finethen17:44
kfox1111could do a little raspberry pi ceph cluster. :)17:45
*** egonzalez90 has quit IRC17:45
*** egonzalez has joined #openstack-kolla17:45
*** kbyrne has joined #openstack-kolla17:47
strgoutwell.. i was wondering.. if we want to get stupid..17:47
*** dardelean has quit IRC17:48
strgouti have 12 disks.. could i make 3 ceph nodes pointing each to a chunk of lvm space of the box?17:48
strgoutall running on the same box17:48
*** robbbe has joined #openstack-kolla17:48
*** nathharp has joined #openstack-kolla17:48
*** masuberu has joined #openstack-kolla17:51
strgoutwow.. so i backed out all the "helpful" stuff from the quickstart guide for local registery and i'm getting things working in mins.17:51
strgoutwhich is super cool btw.17:51
strgouti've installed openstack by hand 5 or 6 times. This is waaaay cool.17:51
SamYaplestrgout: ifyou are single node, you can absoultely still use ceph17:52
SamYapleyou can set the replication (redudnacy) rule to be per OSD (single disk) rather than per host17:53
SamYapleonly need one mon too in that situation17:53
*** shardy is now known as shardy_afk17:53
*** jascott1 has joined #openstack-kolla17:53
*** jascott1 has quit IRC17:54
strgoutwell so like i said currently OS and Openstack are installing onto a single raid10 MD raid.17:55
kfox1111yeah. using ceph single node but split data across spindles works well.17:56
strgoutso i should pull disk out of the raid 10?17:56
kfox1111lets you plop in a new drive and automatically sync data across it easily, or pull/replace a drive easily.17:56
kfox1111a couple disks is probably better.17:57
*** dave-mccowan has quit IRC17:57
kfox1111its best if you can give it whole drives.17:57
*** masuberu has quit IRC17:57
strgout:/17:57
strgouti guess i could move the OS drives down to 6. then have 6 drives for ceph?17:58
strgoutand then i would use the ceph drives for booting VMs right?17:58
SamYaplestrgout: being completely honest, 2 disks in a raid1 is probably more than enough for the OS18:01
SamYaple4 in a raid 10 if you are feeling fancy18:01
SamYaplethe rest should go to storage18:01
*** lpetrut has joined #openstack-kolla18:02
*** mgoddard has quit IRC18:06
*** nathharp has quit IRC18:06
rwellumvskilet_: If you run the tool with "-v" you'll get a lot more info - feel free to share if you do.18:06
*** sean-k-mooney has joined #openstack-kolla18:07
*** nathharp has joined #openstack-kolla18:07
sean-k-mooneyinc0: o/18:07
sean-k-mooneyinc0: if you are about would you mind abandoning https://review.openstack.org/#/c/440834/ its been impmented for 3? releases now. also hi back form vacation18:08
strgoutwell i don't want mysql getting poky on me.18:08
vskilet_rwellum: ok :)18:09
strgoutand before i was going to do iscsi so i though ld make it fast as possible.18:09
*** harlowja has joined #openstack-kolla18:09
strgoutbbl wife demands tacos.18:09
strgoutthanks for all the input everyone!18:09
*** DosIK has quit IRC18:09
vskilet_rwellum: do you known why openvswitch is in the init state everytime18:10
SamYaplevskilet_: can you provide more info?18:11
*** nathharp has quit IRC18:11
inc0hey sean-k-mooney abandoned:) welcome back!18:12
sean-k-mooneyinc0: just cleaning up my inbound reviews for the start of a new year. how are things18:13
inc0I should do it too..it's good thanks!18:14
inc0did you get koala stickers I passed over to you?18:14
sean-k-mooneyinc0: yes emma gave it to me on her return thank you.18:14
inc0cool:)18:15
sean-k-mooneywill you be in dublin in a few weeks?18:15
inc0not sure tbh18:15
inc0I'll try but can't tell yet18:15
rwellumvskilet_: not without logs etc :)18:17
sean-k-mooneywell if you are ill buy you a beer. am im not sure if ill get to spend much time on kolla stuff between now and then but if i can make some time to be around more im going to try18:17
*** jascott1 has joined #openstack-kolla18:19
inc0would be cool to meet you:)18:19
sean-k-mooneyinc0: was there any progress made in the path to publising to docker hub form the gate since denver?18:23
inc0it's there:)18:23
vskilet_rwellum : but exactly, I've a problem to see then ^^18:23
inc0https://hub.docker.com/r/kolla/centos-binary-ceph-mon/tags/18:23
*** unicell1 has quit IRC18:24
inc0now I'm working on adding a bit of deployment testing before publishing18:24
rwellumvskilet_: you can get some info from: kubectl logs <pod name> -n kolla and kubectl describe pod <pod name> -n kolla18:24
sean-k-mooneyinc0: oh congrats :) i checked back in november but i think 4.0.0 was the newest available18:25
inc0yeah we managed to get it in around nov18:25
inc0so you might've missed it by days18:25
rwellumvskilet_: if that doesn't help then we have to get the logs from the container. 'sudo docker ps | grep openvswitch' - grab the ID of the pod that contains kolla_start, then: 'docker exec -tu root -ti <id> bash'18:26
sean-k-mooneyi was checking around the sydney summit since i guessed ye would want to show it off if ye had it working18:26
rwellumThen logs in /var/log/kolla/...18:26
vskilet_rwellum : no log in /var/log/kolla18:33
rwellumvskilet_: on the container?18:35
*** kbaegis has quit IRC18:35
vskilet_i search in openvswitch18:35
*** kbaegis has joined #openstack-kolla18:35
*** kbaegis has joined #openstack-kolla18:35
rwelluminc0: you should advertise it more as it's freaken awesome18:35
inc0dockerhub images you mean?18:36
rwellumyeah18:36
*** nathharp has joined #openstack-kolla18:36
inc0yeah I hope we'll get it all over docs soon18:36
rwellumvskilet_: sorry my bad you said it's in init state - so I wouldn't expect it. Can you show/share the output of the other commands I sent above?18:36
*** sambetts is now known as sambetts|afk18:37
*** genek has quit IRC18:38
*** genek has joined #openstack-kolla18:40
rwelluminc0: maybe an announcement to the openstack alias?18:40
*** nathharp has quit IRC18:41
*** egonzalez90 has joined #openstack-kolla18:41
vskilet_rwellum : yep i try to understand and make them18:41
*** egonzalez has quit IRC18:44
inc0rwellum: good idea, I'll do it when pre-publish deployment testing gets merged18:44
rwellumCool18:45
inc0this will be milestone because our images will be objectivelly better than those people would build locally for most part18:45
inc0as they'll go through testing vs usually build and straight to prod18:45
vskilet_rwellum : is there a way to share with you logs ?18:46
rwellumYeah the only reason to build is to a. test a specific patch locally or b. you control your own source code.18:46
inc0vskilet_: try paste.openstack.org18:46
sean-k-mooneyinc0: it could be cool to show off at the vancour summit later this year too. the last few kolla talks used really old images.18:46
sean-k-mooneyrwellum: c use weird neutron plugins18:46
rwellumsean-k-mooney: ahahaha yeah :)18:47
vskilet_inc0: thanks18:47
inc0yeah, funny enough if I'd be in Sydney and talk about it there, I wanted to start talk with "I'm PTL of Kolla and I want people to stop using Kolla";)18:47
rwellum:)18:47
*** jbrooks has quit IRC18:48
rwellumIt's like a snake eating it's own tail until there is nothing left..18:48
sean-k-mooneyinc0: well you mariadb container form upstream is a big step in that direction :P18:48
sean-k-mooneyinc0: e.g. https://review.openstack.org/#/c/427931/118:48
inc0yeah18:49
inc0but I'm not sure if it'll ever be this18:49
inc0maybe rather loci + kolla-ansible18:49
vskilet_rwellum : http://paste.openstack.org/show/639277/18:50
inc0that being said there will be some gimmicks that would need to happen18:50
*** numans has quit IRC18:50
sean-k-mooneyi take it in the end ian's fastbuild script ended up slower or on par with our current build system18:50
inc0yeah18:50
inc0well maybe it could be optimized further18:50
inc0but I kinda lost interest;)18:51
sean-k-mooneythats a shame. it could be better if you have locall mirrors or cahces but in the general case what we have is pretty fast if a little larger then we would like.18:51
*** mdorman has joined #openstack-kolla18:51
*** numans has joined #openstack-kolla18:51
sean-k-mooneyanyway i better head home for the evening. catach ye monday18:52
vskilet_rwellum : no kolla_start in my container18:52
inc0have a great weekend Sean18:52
rwellumvskilet_: can you also send 'docker logs neutron-openvswitch-agent-network-7n8r2 -n kolla'18:52
inc0vskilet_: hmmm...that's...interesting:)18:52
inc0where did you get your images from18:53
*** unicell has joined #openstack-kolla18:53
rwellumFirst thing I notice is it's 4.0.0 - that's an old, old image right inc0 ?18:53
inc0?18:53
inc0yes18:53
inc0old old image18:53
inc0use :ocata instead18:53
sean-k-mooneyinc0: not pike?18:53
inc0pike is 5.018:53
inc0queens will be 6.018:53
*** jbrooks has joined #openstack-kolla18:54
sean-k-mooneyinc0: sure i just assumed vskilet_ was deploying latest stable.18:54
sean-k-mooneyany got to run18:54
inc0well kolla-k8s should work with both18:55
vskilet_It's the image in the documentation18:55
vskilet_rwrellum : kubectl logs neutron-openvswitch-agent-network-7n8r2 -n kolla >>18:55
vskilet_nothing18:55
vskilet_http://paste.openstack.org/show/639278/18:57
*** masuberu has joined #openstack-kolla18:58
inc0hmm kubectl logs nova-compute-d2wx8 please18:58
vskilet_sudo: unknown uid 42436: who are you?19:01
vskilet_and with sudo19:01
vskilet_The connection to the server localhost:8080 was refused - did you specify the right host or port?19:01
*** cah_link has joined #openstack-kolla19:01
kfox1111anyone play with buildah yet?19:02
kfox1111looks promicing.19:02
vskilet_inc0 and kwellum : docker exec -it 20977f71e4b3 bash (20977f71e4b3 is the nova-compute)19:03
vskilet_rpc error: code = 13 desc = invalid header field value "oci runtime error: exec failed: container_linux.go:247: starting container process caused \"exec: \\\"bash\\\": executable file not found in $PATH\"\n"19:03
kfox1111try /bin/sh instead19:04
kfox1111oh. or /bin/bash19:04
*** masuberu has quit IRC19:04
vskilet_same19:06
kfox1111are you trying to exec into the pause container?19:07
vskilet_kfox1111 : you're right sorry ...19:07
*** cah_link has quit IRC19:08
kfox1111using kubectl to exec in is easier then using docker to for those kinds of reasons.19:09
vskilet_but i think that all container are link so which one of this need I debug ?19:09
*** openstack has joined #openstack-kolla21:16
*** ChanServ sets mode: +o openstack21:16
kfox1111yeah. quite useful. :)21:19
*** tonyb has quit IRC21:21
*** vskilet_ has joined #openstack-kolla21:23
*** vskilet_ has quit IRC21:23
inc0we will need to polish this quickstart and put it in place of current qs in docs21:24
*** kbaegis has quit IRC21:25
kfox1111polishing involves fixing the archetecture.21:25
kfox1111I wouldn't polish it as is.21:25
kfox1111like, this should push up the prebuilt container to the hub.21:25
kfox1111and we provide a prebuilt helm chart for it.21:25
*** numans has quit IRC21:25
kfox1111so it would be almost completely different?21:25
kfox1111but much easier on the user.21:26
kfox1111jascott1: how does that etherpad look?21:26
inc0well we can do it further on the way21:27
inc0but I want to get rid of what we have today asap21:27
kfox1111I mostly agree.21:27
inc0maybe add registry chart thing to it before we get hub image21:27
kfox1111bleh.21:27
inc0well it's working solution21:27
kfox1111so would be just publishing this thing.21:28
*** numans has joined #openstack-kolla21:28
inc0I guess21:28
inc0well21:28
kfox1111it will be more work polishing the doc to be usable then it would be to just fix publish it.21:28
inc0ok let me play with gates on this21:28
jascott1kfox1111 looking great21:28
kfox1111inc0: thanks.21:29
*** lpetrut has quit IRC21:29
kfox1111jascott1: does that cluster/cloud definition work?21:29
*** lpetrut has joined #openstack-kolla21:30
jascott1we could just use oscluster and k8scluster?21:30
kfox1111its rather fortunate that openstack has traditionally called their "cluster" a "cloud" instead. but k8s sticks to the name cluster21:31
inc0first tho we need to move our jobs to repo...21:31
kfox1111so in kolla-kubernetes, you could have multiple clouds per cluster21:31
kfox1111inc0: jobs to repo?21:31
jascott1oh didnt realize openstack used that21:31
kfox1111jascott1: yeah. they bucked the cluster name for some reason. kind of handy now.21:32
inc0kfox1111: .zuul.yml21:32
inc0we still run on legacy jobs21:32
kfox1111oh. you can push jobs to the repos themselves?21:33
inc0https://github.com/openstack-infra/openstack-zuul-jobs/blob/master/zuul.d/zuul-legacy-jobs.yaml#L145021:33
inc0I mean move this to kolla repo21:33
kfox1111ah. I know htey were calling them legacy jobs, but never saw an explination on what lagacy "ment"21:33
jascott1is my update with s/cluster/cloud correct?21:33
kfox1111jascott1: yeah. good catch.21:34
inc0legacy is effect of some nifty bashscript that mordred wrote to turn zuulv2 gates to zuulv321:34
kfox1111yeah. had to fix a lot of that generated code. :(21:35
kfox1111dropped a lot of important bits. :(21:35
kfox1111but was good that I didn't have to rewrite everything. :)21:35
inc0I'm wondering - can we drop things like iscsi for now while we're at it?21:37
kfox1111sbezverk worked long and hard to keep that working.21:38
openstackgerritChristopher Nipper proposed openstack/kolla-ansible master: Add support for Neutron SRIOV agent container  https://review.openstack.org/48761021:38
inc0uhh but nobody fixed it now...21:38
kfox1111thought it was working.21:38
openstackgerritChristopher Nipper proposed openstack/kolla-ansible master: Add details about SRIOV enablement to the networking guide  https://review.openstack.org/49811221:39
kfox1111I think ironic's broke?21:39
*** egonzalez90 has quit IRC21:39
kfox1111as the gate env changed slightly during v3.21:39
inc0about 50% of gates are broken in recent patches21:39
inc0including ironic21:40
kfox1111the big one is multi.21:40
kfox1111for now we can just turn off iptables and it will return to working.21:40
kfox1111just haven't had time to debug it further to get good iptables rules.21:40
inc0yeah I went through this excersise for k-ans21:40
kfox1111their firewall changed drastically in v3.21:40
kfox1111i confirmed it works with iptables off though.21:40
inc0iptables -F done the trick21:41
kfox1111yuip.21:41
inc0another thing is we need to move to master images sooner or later21:41
kfox1111we need a 5.x gate set.21:41
kfox1111we dont even test it right now. :(21:42
kfox1111much rather see 5 then t at the moment. :/21:42
inc0while we test EOL'd stuff..21:42
kfox1111its not hard. its just getting time to do it.21:42
openstackgerritChristopher Nipper proposed openstack/kolla-ansible master: Add support for Neutron SRIOV agent container  https://review.openstack.org/48761021:43
kfox1111testing old is easy. we dont have to do anything. its keeping up with all the openstack changes in other projects that is hard.21:43
inc0what worries me is that we want kolla-k8s to work with 2, 3, 4 and 521:43
inc0and we won't provide proper upgrade path21:43
kfox1111I have a mostly baked upgrade gate.21:43
kfox1111in review.21:43
inc0between which versions?21:43
kfox1111the code between 2,3, and 4 is basically the same.21:43
kfox1111jsut one extra service I think in 4.21:44
inc03->4 was placement api21:44
kfox1111yeah.21:44
kfox1111so its trivial to suport 2 and 3.21:44
kfox1111as they are just almost complete subsets of 4.21:44
jascott1whats the max we should support tho?21:45
kfox1111number is less imporant I think then amount of effort put in.21:45
kfox1111once it becomes hard, then we cut a bunch loose.21:45
kfox1111if it costs us nothing to carry, but allows somone to easily get off of an older openstack and over to kolla-kubernetes, then win.21:46
jascott1fair enough21:46
kfox1111if it prevents us from moving forward, then we stop.21:46
jascott1on the operator, where does source of truth for config (initially values.yaml) live after installation?21:46
jascott1i know we have configmaps21:47
kfox1111the crd is the source of through for the cluster.21:47
kfox1111truth21:47
jascott1then CRD will have a field that essentially contains values.yaml?21:47
kfox1111the operator breaks that up and builds all the smaller pieces from it.21:47
kfox1111yeah.21:47
jascott1ok thats what I assumed21:48
kfox1111the crd is the request from the user for "give me a cloud that looks like this"21:48
jascott1sure21:48
kfox1111the operator takes whatever is in k8s and keeps prodding it until whats in k8s looks like what the user requested.21:48
*** dave-mccowan has quit IRC21:50
jascott1so user will still do a helm build and paste the values into their CRD21:50
jascott1then magic happens21:50
kfox1111I think the final instructions are something like:21:50
kfox1111helm repo add kollacommon http://tarballs.o.o/kolla-kubernetes/kolla-common21:51
kfox1111helm install kollacommon/computekit-operator21:51
kfox1111wget http://tarballs.o.o/kolla-kubernetes/examples/all-in-one.yaml21:51
kfox1111vim all-in-one.yaml21:51
kfox1111kubectl create -f all-in-one.yaml21:52
kfox1111#proffit. :)21:52
kfox1111no git. no building.21:53
kfox1111unless you want to. :)21:53
jascott1so operator will have to build and get values and user CRD values get merged (wining any conflicts)21:54
jascott1so CRD doesnt have to contain all the defaults. is that correct?21:54
kfox1111yeah.21:54
jascott1iirc there is CRD validation mechanism but I think we would have to put all the fields in there which sounds daunting21:55
kfox1111same way you don't have to specify every value in a pod description.21:55
kfox1111yeah. some day we might tighten up the schema with validation, but for now, we have no clue what it should look like.21:55
kfox1111best not to try yet.21:55
kfox1111at least not until much closer to 1.021:55
jascott1ok im going to jot some of this in the etherpad21:56
kfox1111kk21:56
kfox1111looks good. I added a bit more ui.22:03
kfox1111not sure how to format it though.22:03
kfox1111jascott1: ok, here's one for the helm team....22:04
kfox1111I very often launch singletons.22:05
kfox1111so, like in a namespace say I launch a prometheus.22:05
kfox1111helm install prometheus.22:05
kfox1111out of the box it gives it a random uglyl name.22:05
kfox1111so I do: helm install -n prometheus stable/prometheus22:05
kfox1111but a lot of the pods are always <namespace>-<thingy> so most things are anoyingly redundant like:22:06
kfox1111promethus-prometheus-server22:06
kfox1111or in the case we are talking about in the etherpad,22:06
kfox1111computekit-operator-compute-kit-operator-424234234-24224 for the pod name.22:07
kfox1111would like to see the default _name templates do something like skip prepending on the release name if it is the same as the chart name.22:10
jascott1that seems like easy fix22:10
kfox1111yeah. but the file is f orked into every chart. :(22:11
kfox1111instead of just being included as some kind of library chart. or a built in function.22:11
kfox1111would be a huge lift to go fix all the existing charts. :_(22:11
kfox1111but we could at least fix it for new stufff.22:11
kfox1111crio doesn't seem to honor mount namespaces yet. :(22:24
inc0so kfox1111 rwellum jascott1 if you're ok with it, I'll get on moving kk8s gates to zuulv322:26
inc0that means quite a bit of gate refactoring22:26
kfox1111what do you mean by refactor?22:26
inc0try to move common gate code to ansible - as this is what's running in gates22:28
inc0stuff like setup_kubernetes22:28
inc0I'll work on [WIP] one for ansible orch soon22:28
kfox1111thats what I was afraid you were going to say.22:29
kfox1111a lot of more important stuff needs to be done before that I think.22:29
kfox1111your time is your own so ou can do what you want though.22:29
kfox1111but that stuff works.22:29
kfox1111genconfig, is half baked.22:29
kfox1111we still have kollakube which should die,22:29
kfox1111no operator yet.22:29
inc0right, but we also need ansible-orch gates22:30
kfox1111need all the ansible logic for deployment in the operator, etc.22:30
kfox1111adding an asnible-orch gate to the existing stuff is pretty trivial.22:30
inc0and putting another shellscript on this pile is making me cry a bit22:30
kfox1111its one shell if and a new bash script. not the best for sure, but super super simple.22:31
inc0not really, I mean all the vars are so tangled with each other that it makes me cringe when I'm trying to figure out where to put it22:32
inc0not to mention we need to do this work anyway, we can't land another legacy job22:32
kfox1111inc0: setup_gate_ceph.sh,22:33
kfox1111look for:22:33
kfox1111if [ "x$CONFIG" == "xhelm-entrypoint" ]; then22:33
kfox1111add your thingy there.22:33
kfox1111done. :)22:34
kfox1111and I guess, wrap the two previous chunks in an if if you want to do that in the operator initially.22:34
kfox1111and really, don't rewrite k8s deployment in ansible. I'm sure there is existsing stuff that would work for that too.22:36
kfox1111but simple first. just a couple line change should get a working gate.22:37
kfox1111we can refactor it all later, when we have more to show.22:37
kfox1111right now, we would be just spending a lot more time on "fixing" something that works today. (not saying it is pretty. but it is reliable)22:37
kfox1111it will take new code a while to become reliable again.22:38
kfox1111time better spent elsewhere imo.22:38
kfox1111we've already spent a huge amount of time/energy "fixing" working stuff. like the ansible->helm transition. :(22:39
*** vskilet_ has joined #openstack-kolla22:40
*** mchlumsky has quit IRC22:41
vskilet_hi !22:42
jascott1hello22:43
kfox1111hu22:44
kfox1111hi22:44
vskilet_I tested different things to understand the Crashloopback problem but ... nothing works and logs are not really verbose22:46
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-kubernetes master: Move kolla-k8s jobs to kolla repo  https://review.openstack.org/53151522:46
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-kubernetes master: Add ansible-org gates  https://review.openstack.org/53151622:46
jascott1vskilet_ are you getting logs from /var/log/kolla/whatever in each container?22:47
jascott1cause the kuebctl logs ones are indeed mostly useless22:47
kfox1111inc0: that just a direct dump from whats in the other repo?22:49
kfox1111jascott1: I have a patch to fix that in review btw.22:49
inc0kfox1111: pretty much22:49
inc0if it passes, let's merge it really qickly and I'll remove this stuff from infra repo22:50
vskilet_jascott1 : No log in /var/log because a lot of containers are in init mode and logs disapears22:50
vskilet_Maybe is the CNI driver but I don't understand where I can search ...22:51
kfox1111does kubectl get pods -n kube-system look all ok?22:53
kfox1111hmm.. well, I guess it probabl does if helm even works.22:53
vskilet_kfox1111 : yes all kube-system are ok23:04
*** david-lyle has joined #openstack-kolla23:04
*** dalvarez has quit IRC23:11
*** amoralej|off has quit IRC23:16
jascott1probably not CNI then23:16
vskilet_ho ...23:19
*** lpetrut has quit IRC23:19
*** lpetrut has joined #openstack-kolla23:20
vskilet_how and where can I investigate so ?23:26
*** lpetrut has quit IRC23:28
jascott1vskilet_ how did you install?23:32
kfox1111kubectl get pods -n kolla23:33
kfox1111plese stick it in a pastebin23:33
*** vskilet_ has quit IRC23:38
*** vskilet_ has joined #openstack-kolla23:42
*** Masber has joined #openstack-kolla23:45
vskilet_jascott1 : I follow this : https://git.openstack.org/cgit/openstack/kolla-kubernetes/commit/doc/source/deployment-guide.rst?h=refs/changes/25/524125/623:46
vskilet_kfox1111 : http://paste.openstack.org/show/639290/23:47
jascott1prettier version of docs https://docs.openstack.org/kolla-kubernetes/latest/deployment-guide.html23:48
jascott1sorry that link is outdated23:49
jascott1i think23:49
kfox1111kubectl describe pod keystone-6b75955498-jspl2 -n kolla23:53
*** jascott1 has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!