Wednesday, 2016-09-07

sdakemnaser its all good00:00
mnaserso im just as excited to see this go up00:00
sdakemnaser tbh i have never ued ansible00:00
sdakewell that partis true00:00
sdakei meant ceilometer00:00
sdakesorry just woke up from a nap :)00:00
mnaserit's going to be interesting, we're going to deploy kolla and move service by service by migrating dbs and running db syncs afterwards00:00
mnasernp :) but yeah, we're given ceilometer many tries (we've been running openstack since bexar)00:01
sdakewow long time - been in the pain house :)00:01
mnaserwe'll probably run it with like... 10-30 minute retention time to allow heat autoscaling to work00:01
sdakewould love to pick your brain about top 3 pain points of kolla00:01
*** tonanhngo has joined #openstack-kolla00:01
mnaseri will be around more often here and part of us moving to kolla is: it fits with where we want to go, so we'll be part of it00:02
sdakenice00:02
mnasersame reason why we ended up in openstack a few years ago00:02
sdakemay i ask how many ndoes?00:02
mnaserwe're deploying it for a private cloud of one of our customers as a pilot which is around 40 nodes00:02
sdakecool thats no problem00:03
mnaserit'll be a upgrade to mitaka from liberty and switch to kolla a the same time00:03
sdakethat part will be tricky00:03
mnaseri plan to fully install and setup kolla then move the dbs over00:03
sdakei'd separate the two operations persoanlly :)00:03
mnaserwe've done migrations from nova-network to neutron in our public cloud00:03
sdakecan you handle vm or dataplane downtimem?00:03
mnaserwith 1 reboot as a downtime, we've seen some shit :-P00:03
mnaserthere will be dataplane downtime only00:04
sdakehow handling the vm migration?00:04
mnaserceph ephermal = live migration00:04
sdakeusing external ceph feture then?00:04
mnaserwe haven't gotten that far yet, i WOULD like us to do the kolla one00:05
mnaserwe do converged compute/storage00:05
sdakethat shouldbe fine as long asyou don't have  ton of overcommit00:05
sdakebut ymmv00:05
sdakeew have not done a greenfield migration in kolla as of yet00:05
sdakerather brownfield00:05
sdakerather time to go back to bed ;-)00:06
*** tonanhngo has quit IRC00:06
*** yingjun has joined #openstack-kolla00:06
mnaserwe've planned for that00:06
mnaserwe overprovision memory and reserve cpu cores for ceph00:06
*** yingjun has quit IRC00:06
mnaserhave a good night!00:06
openstackgerritSteven Dake proposed openstack/kolla: DNM: Turn off bindep  https://review.openstack.org/36632800:09
sdakenight mnaser00:10
*** yingjun has joined #openstack-kolla00:17
openstackgerritSteven Dake proposed openstack/kolla: DNM: Turn off bindep  https://review.openstack.org/36632800:18
sdakeso close - no matter how far00:18
sdakecouldn't be much more from the heart00:19
sdakeforever trust in who we are00:19
openstackgerritSteven Dake proposed openstack/kolla: DNM: Turn off bindep  https://review.openstack.org/36632800:23
*** tonanhngo has joined #openstack-kolla00:30
*** tonanhngo has quit IRC00:34
*** diogogmt has joined #openstack-kolla00:37
kfox1111sdake: and nothing else matters. :)00:40
sdakekfox1111 you finally caught up;)00:41
* kfox1111 chuckles00:41
*** daneyon has joined #openstack-kolla00:45
*** Jeffrey4l has joined #openstack-kolla00:47
*** daneyon has quit IRC00:50
*** vhosakot has joined #openstack-kolla00:50
*** hieulq has quit IRC01:00
*** hieulq has joined #openstack-kolla01:00
*** ssurana has quit IRC01:03
*** vhosakot has quit IRC01:05
openstackgerritHui Kang proposed openstack/kolla: Add etcd ansible role  https://review.openstack.org/36466201:06
*** vhosakot has joined #openstack-kolla01:06
openstackgerritSteven Dake proposed openstack/kolla: TEST OF MASTER GATE  https://review.openstack.org/36643001:08
openstackgerritMerged openstack/kolla: Update destroy include images arg to LONGOPT  https://review.openstack.org/36498301:08
*** caowei has joined #openstack-kolla01:08
openstackgerritMerged openstack/kolla: Comment some lines in globals.yml  https://review.openstack.org/36608301:08
*** fguillot_ has quit IRC01:10
*** phuongnh has joined #openstack-kolla01:12
*** fguillot_ has joined #openstack-kolla01:13
*** zhubingbing has joined #openstack-kolla01:22
*** duonghq has joined #openstack-kolla01:22
duonghqmorning01:22
*** vhosakot has quit IRC01:22
*** zhurong has joined #openstack-kolla01:32
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Reverse arg order on resource and resource-template  https://review.openstack.org/36643701:45
openstackgerritHui Kang proposed openstack/kolla: Fix mariadb bootstrap error  https://review.openstack.org/36021801:51
openstackgerritHui Kang proposed openstack/kolla: Fix mariadb bootstrap error  https://review.openstack.org/36021801:52
openstackgerritzhubingbing proposed openstack/kolla: Add sahara ansible role  https://review.openstack.org/35129401:59
openstackgerritzhubingbing proposed openstack/kolla: Implement Ansible rally role  https://review.openstack.org/36345602:07
zhubingbingping Mathias02:08
duonghqsdake: are you there?02:08
sdakeas always02:08
duonghqfor the gate setup: should we call bootstrap-servers before prechecks and deploy?02:10
duonghqdue to user setup,... is in bootstrap phase02:10
sdakewe probably should02:10
sdakethe code that is there was pre-bootstrap-seervers02:11
duonghqsdake: you mean we should place something like pre-bootstrap-servers?02:12
duonghqput it in setup_gate.sh02:12
sdakesorry pre bootstrap-servers implementation02:12
duonghqbut why pre-bootstrap?02:12
sdakethat gate code that does bootstrapping was written prior to us having bootstrapping02:12
duonghqgot your point, sdake02:13
*** unicell has quit IRC02:14
*** inc0 has joined #openstack-kolla02:16
inc0good evening02:16
duonghqmorning inc002:17
inc0duonghq, interesting, I just learned that in Polish we actually call China "a land of the center" which seems to be literal name in Chineese right?02:20
sdakeduonghq arent you japanese? :)02:20
inc0I don't think there is equivalent phrase in English tho02:20
inc0duonghq, if you're Japanese, then I apologize02:21
duonghqinc0, sdake: I'm Vietnamese :)02:23
sdakewe both fail02:24
sdakeJeffrey4l ping re your patch to rework the gating - i don't really like it02:24
sdakei think your after getting mirroring working in build.py02:24
sdakewhich is good02:24
sdakebut i am not keen to get rid of available.d dirctory02:25
*** mtaylor22 has joined #openstack-kolla02:25
inc0duonghq, yeah, I should recognize it, I'm terribly sorry02:25
duonghqI have never image that my name is like Japanese one02:25
mtaylor22Jeffrey4l: alive?02:25
duonghqinc0: np02:25
mtaylor22duonghq: 日本人?02:26
mtaylor22sdake: are you around mate?02:26
inc0mtaylor22, what's up? maybe I can help02:27
mtaylor22one moment, just getting a link02:27
sdakewound me02:28
mtaylor22lol.02:28
mtaylor22https://bugs.launchpad.net/kolla/+bug/1617902 -- can this be backported to mitaka?02:28
openstackLaunchpad bug 1617902 in kolla liberty "nova resize not working with KVM" [High,Triaged]02:28
*** dcwangmit01 has quit IRC02:28
*** dcwangmit01 has joined #openstack-kolla02:29
sdakemtaylor22 its targeted as such02:29
inc0mtaylor22, let me take a look at code, if it won't break anything02:29
mtaylor22ahh ok, was just curious because it has liberty/newton listed02:29
sdakeinc0 that ship has sailed already been backported to mitaka02:29
inc0I'm not sure if we had ssh container back in Mitaka02:29
mtaylor22thanks sdake :)02:29
inc0well I guess we had02:29
*** salv-orlando has joined #openstack-kolla02:30
duonghqmtaylor22: must put in google translate, haha02:30
sdakemtaylor22 all yours :) feel ffree to do the backport02:30
inc0yeah we had02:30
inc0so there shouldn't be problem02:31
sdakeinc0 i already looked at tht before it ws proposed as a backport02:31
inc0sooo....rpm don't know how to install ceph deps02:31
inc0how fun02:31
mtaylor22thanks!02:32
mtaylor22ill see if i get a chance to poke around with this02:33
*** salv-orl_ has quit IRC02:33
mtaylor22just need to poke Jeffrey4l in regards to https://bugs.launchpad.net/kolla/+bug/161626802:33
openstackLaunchpad bug 1616268 in kolla mitaka "Stale namespace removal causing "RTNETLINK answers: Invalid argument" errors" [Critical,Confirmed]02:33
*** dave-mccowan has quit IRC02:33
mtaylor22from what  Ross and I had found so far02:33
inc0mtaylor22, so docker doesn't clean after itself?02:34
inc0sdake, omfg...so remember how I sweared about centos people for not adding jewel repos?02:36
sdakethey just got added?02:37
inc0http://mirror.centos.org/centos/7/storage/x86_64/ look what created couple hrs ago02:37
sdakelike magic irc works ;)02:37
inc0I guess somebody was watching, or I'm just lucky02:37
inc0regardless, let's try if that works02:37
mtaylor22hmm pretty much. it seems like the docker containers are locking, or holding on to the namespaces02:38
mtaylor22we're able to remove them outside of docker02:38
mtaylor22well, once the containers are stopped02:38
mtaylor22ill asses Jeffrey4l's question later today (had no chance to touch since he asked)02:39
mtaylor22oh02:40
mtaylor22what's a decent irc client for osx? currently using limechat.. ?02:40
*** vhosakot has joined #openstack-kolla02:41
inc0mtaylor22, I use xchat02:42
inc0xchat azure I think is full name02:43
mtaylor22ah interesting, thanks.02:43
*** vhosakot has quit IRC02:44
openstackgerritSteven Dake proposed openstack/kolla: Turn off bindep  https://review.openstack.org/36632802:46
duonghqanybody success with kubernetes's kube-deploy?02:47
inc0duonghq, I had success with kargo - ansible deploy of k8s02:51
duonghqinc0: tyvm02:54
*** banix has joined #openstack-kolla02:54
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Cleanup patch  https://review.openstack.org/36645002:55
inc0soo, good news and bad news - good news is that this repo works and ceph installs well02:56
inc0bad news is that cinder can't build and I have no idea why02:56
*** lulei has joined #openstack-kolla02:56
openstackgerritHui Kang proposed openstack/kolla: Fix mariadb bootstrap error  https://review.openstack.org/36021802:57
inc0http://logs.openstack.org/30/366230/4/check/gate-kolla-dsvm-build-centos-binary-centos-7-nv/45d731c/console.html#_2016-09-06_21_19_26_712799 any centos experts around?02:58
sdakemtaylor22 textual is best02:58
sdakemtaylor22 it costs 5 bucks however02:59
sdakeinc0 did you change the version pins02:59
mtaylor22eh thats fine02:59
mtaylor22looks god tho02:59
mtaylor22good even02:59
inc0sdake, where are they?02:59
sdakeSTEP THROUGH THAT GATE02:59
sdakeand your in a zero G environment02:59
sdakeinc0 base image iirc03:00
mtaylor22I used to use https://www.bitlbee.org/ with limechat for simplicity back in the day03:00
sdakehttps://github.com/openstack/kolla/blob/master/docker/base/versionlock.list03:00
mtaylor22brb03:00
sdakeinc0 fwiw i think its probably safe to remove version pins at this point03:01
sdakei'm not sure why they were added in the fifrst place03:02
sdakei think sam was concerned the ceph nerds would release non-lts stuf in the hammer repo03:02
duonghqinc0: has you tried kargo with pre-download binary (etc, flanneld,...)? I do not see any related-settings in kargo.yml03:03
*** fguillot_ has quit IRC03:03
sdakehey guys - i'm starting a new project03:04
sdakeits called "serveless stackless container openstack"03:04
inc0sdake, you want to run openstack without servers? like, put it on cloud?03:04
inc0and install stackless python inside?03:05
*** mdnadeem has joined #openstack-kolla03:05
sdakeya calling it serverless tupperware03:05
sdake"there is too much at take to let your unfiltered thoughts to leave this facility."03:06
sdaketake/stake03:06
sdakewtb new keyboard03:06
rbergeronstackless tuppervaporware03:07
sdakeand its all based on kubernetes and docker and rancher and coreos03:08
inc0I know03:08
sdakeand atomic and ansible and openstack03:08
inc0let's put coreos inside docker and run it on k8s which runs on...you guessed right! coreos03:08
sdakebasically its a super mashup of evereything antastic03:09
kfox1111sdake: hah. I think there's real money there. ;)03:09
rbergeronif you forget ansible, then you have dinnerless sdake03:09
sdakethanks kfox1111 !03:09
rbergeron:p03:09
inc0let's put rkt into docker and laugh the evil laghter03:09
sdakekfox1111 with your validation I am pinging my network now to find funding :)03:09
* kfox1111 chuckles03:10
kfox1111find the right venture capitalist, and your in. :)03:10
sdakeif only i was good friends with people that are now vcs ;)03:10
rbergeronlol03:10
sdakehipstack03:11
inc0ok I have no idea why do we even have these pins03:11
inc0in fact I think this is horrible03:11
sdakeinc0 me either dude me either03:11
inc0since security patches will be hard to keep track of and so on03:11
sdakeso how about versionlock serveless ansiblized dockerized containerized hyperkubed square rooted03:12
sdakeanswer = 203:12
rbergeronsdake: i might say no on that trademark abuse03:12
sdakedocker is a verb03:13
sdakethose cats fucked up their trademark alrady03:13
rbergeroni was talking about ansible03:13
rbergeronthe verb is cattle-ized03:13
inc0fun fact, we had ceph pinned in centos but not ubunut03:13
rbergeronso you know :p03:13
inc0kolla trivia vol 103:14
sdakei dont think ubuntu has version pins03:14
inc0it can03:14
inc0anyway, I hereby remove version pins from centos, hate me all you wish03:14
openstackgerritzhubingbing proposed openstack/kolla: Add cloudkitty ansible role  https://review.openstack.org/34930503:14
openstackgerritHui Kang proposed openstack/kolla: Fix mariadb bootstrap error  https://review.openstack.org/36021803:14
sdakemake sure to remove th versionlock plugin plz03:15
sdakehey folks - i optimized the gate run time by 3 minutes03:15
zhubingbinghi03:15
sdakevictory :)03:15
zhubingbingsnake03:15
inc0by plugin you mean package?03:15
zhubingbingsnake03:16
sdakeinc0 bingo03:16
sdakezhubingbing steak dude steak03:16
zhubingbingsdake,03:16
sdakei dont eat snake or dinner03:16
zhubingbing--03:16
zhubingbingcan you help me review barbican role and contaier03:17
sdakeyour wish is my command03:17
sdakehave a link03:17
zhubingbingok03:17
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add namespace and test  https://review.openstack.org/36583603:17
zhubingbinghttps://review.openstack.org/#/c/351822/03:18
zhubingbinghttps://review.openstack.org/#/c/352515/03:18
*** akscram has quit IRC03:19
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Change ceph version to Jewel  https://review.openstack.org/36623003:20
sdakezhubingbing where is the release note in tehe first patch?03:20
kfox1111my patch set dependencies are starting to get pretty deep. if there are any kolla-kubernetes reviewers available to help, I'd appreciate it. :)03:20
zhubingbingbarbican container ?03:21
*** akscram has joined #openstack-kolla03:21
zhubingbingsorry i should add release note03:21
zhubingbingbarbican role have release note03:21
sdakezhubingbing - need to wait for containe to merge so we can recheck barbican03:21
sdakezhubingbing don't sweat it03:21
zhubingbingok03:22
sdakethe barbican role that is03:22
zhubingbingi add it for barbican container03:22
zhubingbing1 min03:22
sdakeits already in the merge queue03:22
sdakedont worry about it03:22
kfox1111inc0: oh, I think there was some weirdnes with ceph back in the hammer days on redhat. that might be why they were pinned.03:22
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Change ceph version to Jewel  https://review.openstack.org/36623003:22
*** tonanhngo has joined #openstack-kolla03:22
kfox1111I think it was fixed in infernalis.03:23
zhubingbingwow03:23
zhubingbingok thanks03:23
inc0kfox1111, entirely possible03:23
inc0btw we have an excuse why we waited so long with ceph bump03:24
inc0kfox1111, look at date modified (or added rather) http://mirror.centos.org/centos/7/storage/x86_64/03:24
kfox1111inc0: looking good.03:25
kfox1111tomorrow? :)03:25
openstackgerritMerged openstack/kolla: Add Barbican container dockerfile  https://review.openstack.org/35182203:25
inc0this is what I call good timing03:25
kfox1111I'd guess that is continuously rebuilt.03:25
kfox1111or they just happend to cut a release at a perfect time. :)03:25
inc0kfox1111, no, it wasn't there today morning03:25
kfox1111oh. then great timeing. :)03:26
inc0yup03:26
*** tonanhngo has quit IRC03:27
*** daneyon has joined #openstack-kolla03:28
inc0sdake, we don't have good bp to pin ceph to03:28
duonghqinc0: can I undeploy the Kargo deploy cluster?03:29
sdakeinc0 make one?03:29
inc0duonghq, no idea03:29
inc0sdake, I can, sure, do we need it tho?03:29
*** akscram has quit IRC03:29
sdakeinc0 ya we need it for ugrades03:29
sdakeand release note might help too03:29
inc0release note is there03:29
sdakeoh i missed that03:29
*** zhiwei has joined #openstack-kolla03:29
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add namespace and test  https://review.openstack.org/36583603:30
sdakei thought i reviewed the whoel thing03:30
*** wuhg has joined #openstack-kolla03:31
*** akscram has joined #openstack-kolla03:31
*** sdake_ has joined #openstack-kolla03:32
*** daneyon has quit IRC03:33
kfox1111sdake_: you know whats realy going to be fun?03:33
kfox1111extending the kubernetes cluster your using to deploy openstack,03:33
kfox1111using that openstack's vm's. :)03:33
sdake_inc0 is there an upgrade role work needing work here?03:35
*** sdake has quit IRC03:35
sdake_inc0 if so I'd say so03:35
sdake_ya i looked at review saw release note03:35
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Change ceph version to Jewel  https://review.openstack.org/36623003:35
Jeffrey4lmtaylor22, ping03:35
Jeffrey4lmtaylor22, do u try reproduce this issue after the dumb-init is merged?03:36
kfox1111I've already tried a hybrid kube with both bare metal and vms in openstack. it works well. :)03:36
inc0ok I'm off, have a good day/night/afternoon guys03:37
Jeffrey4lmtaylor22, i think it may be the root cause.03:37
Jeffrey4lgood night :)03:37
openstackgerritHui Kang proposed openstack/kolla: Fix mariadb bootstrap error  https://review.openstack.org/36021803:37
*** tonanhngo has joined #openstack-kolla03:38
Jeffrey4lsdake_, about this https://review.openstack.org/36572103:38
Jeffrey4lwhere is more detail about mirrors.availble.d?03:39
Jeffrey4li have no idea about this folder.03:39
Jeffrey4lsdake_, ^03:39
sdake_Jeffrey4l i'm sure its documented omehre in infra manuals03:39
sdake_Jeffrey4l that is the cp command03:40
sdake_it copies from that directroy to the local repo locations03:40
Jeffrey4lwhat's wrong with nodepool/provider?03:40
Jeffrey4lok.03:40
sdake_Jeffrey4l personally i find that sed hard to read03:40
sdake_cp from mirrors location is easier03:41
sdake_and cp from mirrors location is guaranteed to be correct03:41
sdake_because other people use that03:41
sdake_that is the standard wayt o include mirrors in openstack03:41
*** inc0 has quit IRC03:41
Jeffrey4lsdake_, but 1. it is in the docker file. in current customize implementation, it is hard to use COPY03:41
Jeffrey4l2. we are using one source.lists file which container all source url.03:42
sdake_but it is already working03:42
Jeffrey4lhmm what happen if i add a two different url for ceph? ( no idea about this)03:42
sdake_Jeffrey4l what problem are ou tyring to solve03:42
Jeffrey4lthe PS? url the ci provider's source mirror to build the docker image.03:43
*** fragatin_ has joined #openstack-kolla03:44
sdake_i thoguth youwere also trying to add external mirroring03:44
sdake_maybe i read into the patch too much03:44
sdake_with the change to build.py03:44
Jeffrey4lno. just changed the setup_gate.sh script.03:44
Jeffrey4lsdake_, check this https://github.com/openstack-infra/project-config/blob/master/nodepool/scripts/configure_mirror.sh#L16503:44
Jeffrey4lthe sources.list.available.d come from the nodepool/provider too.03:45
sdake_yes and is much more understandable then a bunch of magic  sed ;)03:46
*** fragatin_ has quit IRC03:46
sdake_Jeffrey4l need to lower barrier to working in ci not increase it03:46
sdake_in/with03:46
*** fragatina has quit IRC03:46
Jeffrey4lsdake_, hmm means simplify?03:47
sdake_Jeffrey4l right on03:47
sdake_https://review.openstack.org/#/c/365721/8/kolla/image/build.py03:47
sdake_maybe that was an extra artifact?03:47
sdake_my main concern is nodepool will somehow change and break our gating coupled with complexity of the gate implementation03:48
Jeffrey4lsdake_, it is a bug. the customization in Ubuntu not work now.03:48
sdake_Jeffrey4l can you break that out separately03:49
Jeffrey4lthe use the ci provided mirror is the best solution right? if so, we have to use the nodepool/provider.  the sources.list.available.d come from it, too.03:49
Jeffrey4lnp. I will push another PS>03:49
*** coolsvap_ has joined #openstack-kolla03:50
sdake_hey coolsvap_03:51
coolsvap_sdake_: hi :)03:51
sdake_Jeffrey4l yes we want to use mirrors03:51
sdake_we are using now with the sources.available.d logic03:51
*** fragatina has joined #openstack-kolla03:53
Jeffrey4lya. i will fix this.03:53
Jeffrey4ltry to use sources.avail.d03:53
sdake_thx03:54
openstackgerritHui Kang proposed openstack/kolla: Fix mariadb bootstrap error  https://review.openstack.org/36021803:57
*** huikang has joined #openstack-kolla03:57
*** Marcellin__ has quit IRC03:57
*** fragatina has quit IRC03:57
*** banix has quit IRC03:57
*** jascott1_ has joined #openstack-kolla04:00
mtaylor22Jeffrey4l: will play with it soon, have a few BAU things to sort out first. :)04:00
*** jascott1 has quit IRC04:01
Jeffrey4lok. thank04:02
*** zhubingbing has quit IRC04:09
*** unicell has joined #openstack-kolla04:11
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add namespace and test  https://review.openstack.org/36583604:17
*** unicell1 has joined #openstack-kolla04:20
*** unicell has quit IRC04:20
*** senk has joined #openstack-kolla04:26
openstackgerritHui Kang proposed openstack/kolla: Fix mariadb bootstrap error  https://review.openstack.org/36021804:27
sdake_3) To join a non-profit organization.  Like Khan Academy, or Google Dot Org, or Yahoo!04:32
sdake_lol04:32
sdake_time for 30004:36
sdake_nothing like 300 at 9:36 pm04:37
sdake_can't believe kolla is up to 5k commits04:46
sdake_http://img0.joyreactor.com/pics/post/funny-pictures-auto-birds-this-is-sparta-466890.jpeg04:51
*** senk has quit IRC04:55
*** Jeffrey4l_ has joined #openstack-kolla05:00
*** mtaylor22 has quit IRC05:02
*** mtaylor22 has joined #openstack-kolla05:02
openstackgerritHui Kang proposed openstack/kolla: Fix mariadb bootstrap error  https://review.openstack.org/36021805:04
*** Jeffrey4l has quit IRC05:04
*** harlowja_at_home has joined #openstack-kolla05:18
*** openstackgerrit has quit IRC05:18
*** openstackgerrit has joined #openstack-kolla05:18
*** bdaca has joined #openstack-kolla05:22
openstackgerritHui Kang proposed openstack/kolla: Fix mariadb bootstrap error  https://review.openstack.org/36021805:28
*** senk has joined #openstack-kolla05:29
*** zhubingbing_ has joined #openstack-kolla05:30
sdake_huikang do you need the pid file checking in that patch?05:33
huikangsdake_, any suggestion; still debugging the gate05:33
sdake_huikang whts happening with the gate tht is problematic?05:34
sdake_no suggestions other then would like a backport asap ;)05:34
huikangchecking the existence of the pid file is not sufficient05:34
sdake_i know, why even have that05:34
sdake_is my quetion05:35
huikangif the cluster is in primary mode, we do not need checking the pid file05:35
*** unicell has joined #openstack-kolla05:38
*** unicell1 has quit IRC05:38
huikanghowever, querying the database in primary mode needs both the socket file and the pid file. sdake_05:38
sdake_roger05:39
sdake_if it is needed it is needed05:39
sdake_a note to that affect would be helpful05:40
huikangk, will do. Thanks05:40
*** wuhg has quit IRC05:41
*** huikang has quit IRC05:43
*** sdake_ is now known as sdake05:46
*** harlowja_at_home has quit IRC05:54
*** daneyon has joined #openstack-kolla06:11
*** daneyon has quit IRC06:15
*** sdake has quit IRC06:18
*** shardy has joined #openstack-kolla06:19
zhubingbing_hello06:25
zhubingbing_guys06:25
*** egonzalez90 has joined #openstack-kolla06:26
*** neilus has joined #openstack-kolla06:31
*** b_bezak has joined #openstack-kolla06:38
*** Serlex has joined #openstack-kolla06:44
*** tonanhngo has quit IRC06:46
*** jrich523 has quit IRC06:51
*** jrich523 has joined #openstack-kolla06:53
*** zhubingbing_ has quit IRC06:59
*** zhubingbing_ has joined #openstack-kolla06:59
*** tonanhngo has joined #openstack-kolla07:00
*** tonanhngo has quit IRC07:02
*** sdake has joined #openstack-kolla07:03
*** jascott1_ has quit IRC07:04
*** jascott1 has joined #openstack-kolla07:05
*** berendt has joined #openstack-kolla07:05
berendtmorning guys07:06
*** mtaylor22 has quit IRC07:07
*** shardy is now known as shardy_afk07:08
egonzalez90morning berendt07:10
*** matrohon has joined #openstack-kolla07:16
openstackgerritMerged openstack/kolla: Implement Ansible rally role  https://review.openstack.org/36345607:26
openstackgerritzhubingbing proposed openstack/kolla: Added grafana container  https://review.openstack.org/34644707:28
*** egonzalez90 has quit IRC07:29
*** jascott1 has quit IRC07:33
openstackgerritzhubingbing proposed openstack/kolla: Add sahara ansible role  https://review.openstack.org/35129407:36
zhubingbing_hello07:38
zhubingbing_who can help me review it07:40
zhubingbing_https://review.openstack.org/#/c/349305/07:40
openstackgerritMerged openstack/kolla: Add cloudkitty containers for type source  https://review.openstack.org/34929507:42
*** egonzalez90 has joined #openstack-kolla07:47
*** egonzalez90 has quit IRC07:48
*** mbound has joined #openstack-kolla07:51
*** Serlex has quit IRC07:54
*** shardy_afk is now known as shardy07:57
*** daneyon has joined #openstack-kolla07:59
berendtzhubingbing_ have you already changed to gnocchi as backend?07:59
zhubingbing_yes07:59
zhubingbing_no07:59
zhubingbing_i have no change it07:59
zhubingbing_you can change it08:00
berendtI do not have the time to work on it at the moment :(08:00
*** daneyon has quit IRC08:03
*** prithiv has joined #openstack-kolla08:04
zhubingbing_ok08:05
zhubingbing_i change  it08:05
prithivHi. Can anyone take a look at https://review.openstack.org/#/c/366082/ please. Cheers :)08:06
*** Serlex has joined #openstack-kolla08:06
sdakegroan failing gates08:06
sdakepbourke around?08:08
*** prithiv has quit IRC08:09
berendtprithiv I am missing the ceilometer integration of collectd, is this part of an other review?08:09
openstackgerritTakashi Sogabe proposed openstack/kolla: Keepalived leaves VIP on the host in case of accidental removal.  https://review.openstack.org/36408508:16
matrohonvbel, hi08:17
*** hieulq has quit IRC08:19
*** duonghq has quit IRC08:19
*** duonghq has joined #openstack-kolla08:19
*** hieulq has joined #openstack-kolla08:19
*** tonanhngo has joined #openstack-kolla08:25
sdakeJeffrey4l_ ping08:28
*** tonanhngo has quit IRC08:28
*** salv-orl_ has joined #openstack-kolla08:29
*** kproskurin has joined #openstack-kolla08:29
wznoinskgood morning all08:30
wznoinskand evening to the asia/pacific08:31
*** salv-orlando has quit IRC08:32
*** openstackgerrit has quit IRC08:34
*** openstackgerrit has joined #openstack-kolla08:34
openstackgerritzhubingbing proposed openstack/kolla: Add cloudkitty ansible role  https://review.openstack.org/34930508:41
*** athomas has joined #openstack-kolla08:41
*** tonanhngo has joined #openstack-kolla08:42
openstackgerritSteven Dake proposed openstack/kolla: DNM test of gate with 8 threads  https://review.openstack.org/36659108:43
*** tonanhngo has quit IRC08:44
duonghqsdake: what is approximate configuration of a gate node?08:47
sdake8 gig of ram 8 cores iirc08:47
sdakethere are like 10 different clodu provides08:47
sdakeproviders08:47
sdakeso its not clear to me08:47
duonghqroger08:47
sdakethe problem with 8 threads is as follows08:47
*** prithiv has joined #openstack-kolla08:47
sdakeif an imaege is not in the regex, it tries to queue it anyway08:48
sdakeso it takes up one of the build threads08:48
sdakefor only a few seconds08:48
sdakebut that is enoug htime to be half done buildding the next ontainer08:48
vbelmatrohon, hi, how are you?08:48
sdakewhat should probably happen is that bug should be fixed ;)08:48
sdakehey folks08:48
sdakehey wznoinsk08:49
duonghqthe build order is undeterminable?08:49
matrohonvbel, hey! fine and you08:49
vbelgood morning/evening08:49
sdakeduonghq its ordered08:49
vbelmatrohon: thanks, good :)08:49
duonghqah, understand08:49
matrohonvbel : I finally figured out what was the root cause of my bug "who are you" when sudoing a cmd in a container08:50
matrohonvbel : it happens only if the container is run with the option "--volume=/run:/run:rw"08:51
matrohonvbel : we are going to report a bug for futher discussions08:52
vbelmatrohon: interesting, looks like something new, yes, it is worth reporting08:53
duonghqsdake: which is test deploy file?08:53
*** ankush has quit IRC08:53
sdakeduonghq huh?08:53
duonghqsdake: the test for kolla-ansible deploy08:53
sdaketox -e cmd08:53
sdakewhere cmd is in tox.ini08:53
duonghqroger08:54
sdakecentos gates are pokey because they are not using mirrors08:54
duonghqwhat does "pokey" mean?08:56
openstackgerritzhubingbing proposed openstack/kolla: Added grafana container  https://review.openstack.org/34644708:56
*** ankush has joined #openstack-kolla08:56
*** mbound has quit IRC08:56
vbelduonghq: I guess 'okey'08:57
vbel:)08:57
duonghqvbel: thanks08:58
wznoinsksdake: could you have a look? (nit): https://review.openstack.org/#/c/366597/08:58
sdake7 short days to go until releases09:00
*** zhubingbing_ has quit IRC09:00
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' to neccesary tasks (1)  https://review.openstack.org/35853909:01
vbeli am thinking about replacement of tgtd with targetcli (default since rh/centos7 and ubuntu 12.04). Should it be a complete replacement that eliminates tgtd as container everywhere or should we have a choice - what cinder-volume to use. E.g. new one could be called cinder-volume-lio and a user would opt. Since lvm backends are not really for massive deployments one could ask to kill tgtd container on upgrade and reattach disks if necessary09:02
*** tonanhngo has joined #openstack-kolla09:03
*** zhubingbing has joined #openstack-kolla09:03
*** tonanhngo has quit IRC09:03
zhubingbingsdake  can you see barbican role09:05
sdakevbel lvm is a new backend for us in newton09:05
sdakezhubingbing link?09:05
zhubingbinghttps://review.openstack.org/#/c/352515/09:05
vbelsdake: so it is worth to switch to targetcli now?09:06
sdakezhubingbing if gate fails, type recheck like i just did please09:06
sdakevbel totally the wrong time to make that chane09:06
sdakewe are t-7 days to release09:06
zhubingbingsure09:06
*** egonzalez90 has joined #openstack-kolla09:06
sdakeor atleat release of rc109:06
vbelsdake: yes, that's what I guessed, the same for other changes09:06
sdakebug fixes only pretty much09:06
sdakeunless already marked as a blueprint for rc109:07
*** zhiwei has quit IRC09:07
wznoinskcoolsvap_: https://review.openstack.org/#/c/366315/ whenever you have a moment pls09:07
*** b_bezak_ has joined #openstack-kolla09:07
vbelsdake: I see, thanks. So many review won't get in until new release is started09:07
vbel"O" release :)09:08
sdakevbel master will be open for business after rc109:08
sdakewe branch on rc109:08
sdakebut i'd like core team to stay focused on fixing bugs of which we have plenty :)09:09
vbelsdake: ok, great, no much wait time then. Thanks!09:09
sdakewe have roughly 45 days to fix all bugs we want to fix09:09
sdakehttps://releases.openstack.org/newton/schedule.html09:09
sdakenote we are cycle trailing09:10
*** b_bezak has quit IRC09:10
openstackgerritWaldemar Znoinski proposed openstack/kolla: Non-default database port documentation.  https://review.openstack.org/36631509:13
bjolomorning09:18
bjoloim doing daily builds and testing of kolla newton. But kolla upgrade fails constantly on mariadb09:19
bjolois it just for me or are others experiencing this as well?09:19
bjoloworkaround is to shutdown mariadb and do recovery09:20
sdakebjolo i think huikang may be working on that09:20
sdakebjolo but please file a bug09:20
bjolook09:20
*** tonanhngo has joined #openstack-kolla09:22
openstackgerritzhubingbing proposed openstack/kolla: Added grafana container  https://review.openstack.org/34644709:24
*** tonanhngo has quit IRC09:24
coolsvap_wznoinsk: thanks for the doc update.09:31
wznoinskcoolsvap_: cheers09:31
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' to neccesary tasks (1)  https://review.openstack.org/35853909:32
*** wznoinsk has quit IRC09:35
*** prithiv has quit IRC09:36
*** tonanhngo has joined #openstack-kolla09:42
*** msimonin has joined #openstack-kolla09:44
*** tonanhngo has quit IRC09:44
*** yingjun has quit IRC09:45
sdakelook 142 people in channel09:46
sdakethat is my age + 100 :)09:46
sdakeboy I hope I don't live that long09:46
sdakenight all09:46
zhubingbing --09:46
*** daneyon has joined #openstack-kolla09:47
*** sdake has quit IRC09:47
*** wuhg has joined #openstack-kolla09:49
*** daneyon has quit IRC09:52
*** tonanhngo has joined #openstack-kolla10:04
*** jmccarthy has quit IRC10:05
*** tonanhngo has quit IRC10:05
*** zhurong has quit IRC10:05
*** jmccarthy has joined #openstack-kolla10:06
*** phuongnh has quit IRC10:11
*** athomas has quit IRC10:14
*** prithiv has joined #openstack-kolla10:15
*** msimonin has quit IRC10:16
*** zhubingbing has quit IRC10:20
duonghqsean-k-mooney: ping10:20
*** athomas has joined #openstack-kolla10:23
*** duonghq has left #openstack-kolla10:25
*** tonanhngo has joined #openstack-kolla10:32
*** tonanhngo has quit IRC10:34
*** egonzalez90 has quit IRC10:35
*** dgonzalez has quit IRC10:45
*** caowei has quit IRC10:48
*** yingjun has joined #openstack-kolla10:49
*** prithiv has quit IRC10:49
*** tonanhngo has joined #openstack-kolla10:51
*** tonanhngo has quit IRC10:54
*** egonzalez90 has joined #openstack-kolla10:55
*** dgonzalez has joined #openstack-kolla10:57
*** zhubingbing has joined #openstack-kolla10:57
*** slagle has joined #openstack-kolla11:06
*** Serlex has quit IRC11:19
*** tonanhngo has joined #openstack-kolla11:22
*** tonanhngo has quit IRC11:23
*** egonzalez90 has quit IRC11:31
*** daneyon has joined #openstack-kolla11:35
*** daneyon has quit IRC11:40
*** dave-mccowan has joined #openstack-kolla11:41
*** msimonin has joined #openstack-kolla11:42
*** Serlex has joined #openstack-kolla11:43
*** tonanhngo has joined #openstack-kolla11:43
*** dave-mccowan has quit IRC11:46
*** tonanhngo has quit IRC11:46
*** salv-orl_ has quit IRC11:52
*** salv-orlando has joined #openstack-kolla11:52
*** shardy is now known as shardy_lunch11:53
*** zhurong has joined #openstack-kolla11:55
*** Marcellin__ has joined #openstack-kolla11:56
*** zeus has quit IRC12:00
*** coolsvap_ is now known as coolsvap12:01
*** tonanhngo has joined #openstack-kolla12:03
*** tonanhngo has quit IRC12:03
*** sean-k-mooney has quit IRC12:04
*** v1k0d3n has quit IRC12:07
openstackgerritJeffrey Zhang proposed openstack/kolla: Add extra methods in template when using template override  https://review.openstack.org/36671212:20
*** dwalsh has joined #openstack-kolla12:21
*** tonanhngo has joined #openstack-kolla12:23
*** tonanhngo has quit IRC12:24
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457312:27
jmccarthyHmm missing something obvious here, built images according to quickstart, but they are v2.0.2, I thought they would be something higher ?12:27
jmccarthyOh right ok I have run across 'operator workflow vs developer workflow' - my bad12:33
*** egonzalez90 has joined #openstack-kolla12:34
*** tonanhngo has joined #openstack-kolla12:42
*** tonanhngo has quit IRC12:44
*** rhallisey has joined #openstack-kolla12:45
*** mgoddard_ has joined #openstack-kolla12:48
*** zeus has joined #openstack-kolla12:49
*** zeus is now known as Guest4940812:50
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457312:50
*** wuhg has quit IRC12:51
*** Guest49408 is now known as zeus`12:51
*** mgoddard has quit IRC12:52
*** zeus` is now known as zeus12:52
*** zeus has quit IRC12:52
*** zeus has joined #openstack-kolla12:52
*** tonanhngo has joined #openstack-kolla13:04
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457313:04
*** tonanhngo has quit IRC13:05
*** shardy_lunch is now known as shardy13:08
*** sbezverk has quit IRC13:10
*** inc0 has joined #openstack-kolla13:16
inc0good morning13:16
berendthi!13:17
inc0pbourke,13:19
inc0around?13:19
pbourkeinc0: yo13:19
inc0https://review.openstack.org/#/c/366230/ <- can you validate that all works for you?13:19
jmccarthyHmm following the developer workflow from the quickstart guide, where does one get kolla-build from ?13:22
openstackgerritChristian Berendt proposed openstack/kolla: Fix keytone options in all.yml/globals.yml  https://review.openstack.org/36595013:23
inc0jmccarthy, if you pip install kolla, it will appear in your PATH13:23
jmccarthyinco: Hmm yea the guide warns about pip installing vs use from git (which is what I want methinks)13:24
inc0if you pip install -e . in git repo, same thing:)13:24
*** daneyon has joined #openstack-kolla13:24
jmccarthyinc0: Hmm yea the guide warns about pip installing vs use from git (which is what I want methinks)13:24
inc0python is really simple in these terms13:24
*** tonanhngo has joined #openstack-kolla13:24
*** tonanhngo has quit IRC13:24
jmccarthyAh ok I only installed the requirements.txt(s) from the guide ..13:24
inc0also tbh I usually just use tools/build.py13:25
inc0these are equivalent13:25
jmccarthyOk cool yea I may just do that then :) Thanks !13:25
*** daneyon has quit IRC13:28
*** caowei has joined #openstack-kolla13:29
*** mgoddard_ has quit IRC13:30
*** mgoddard has joined #openstack-kolla13:30
openstackgerritChristian Berendt proposed openstack/kolla: Remove fedora from Dockerfile templates  https://review.openstack.org/35944713:39
*** lyncos has joined #openstack-kolla13:41
zhubingbinghello guys13:42
openstackgerritMerged openstack/kolla: Turn off bindep  https://review.openstack.org/36632813:50
*** tonanhngo has joined #openstack-kolla13:51
*** michauds has joined #openstack-kolla13:52
*** tonanhngo has quit IRC13:52
*** alwaysatthenoc has joined #openstack-kolla13:54
openstackgerritMerged openstack/kolla: Correct Murano keystone_authtoken option name  https://review.openstack.org/36601913:54
*** alwaysatthenoc has quit IRC13:58
matrohonvbel, BTW, what would be the config that would run the all-in-one config for sure? (os, base os...)13:59
vbelmatrohon: centos7 / centos713:59
*** egonzalez90 has quit IRC13:59
vbelit is a default one13:59
matrohonvbel : ok, taht's the one we are testing currently14:00
vbelmatrohon: default for both building and testing :)14:00
matrohonvbel : binary images fetched by the master branch are 2.0.3?14:00
vbelthey are 3.0.0 so you need to have your own repo / built images14:01
matrohonvbel : ok thanks14:02
*** zhurong has quit IRC14:02
*** ayoung has quit IRC14:03
*** dwalsh has quit IRC14:06
inc0pbourke, so about ceph upgrade14:08
inc0issue is, with hammer ceph was running as "root"14:09
inc0in jewel it's running as "ceph"14:09
inc0so all the files in /var/lib/ceph should be rw for user ceph as well14:09
openstackgerritzhubingbing proposed openstack/kolla: Add cloudkitty ansible role  https://review.openstack.org/34930514:10
mnaserinc0, and selinux is a thing now with ceph jewel centos14:12
*** tonanhngo has joined #openstack-kolla14:12
*** tonanhngo has quit IRC14:13
mnaserfyi14:14
mnaserour upgrade is been14:14
mnaserchown -R ceph:ceph /var/lib/ceph/bootstrap-* /var/lib/ceph/{mds,mon,tmp} /var/run/ceph /var/log/ceph/14:14
mnaserrestorecon -Rv /var/lib/ceph/bootstrap-* /var/lib/ceph/{mds,mon,tmp} /var/run/ceph /var/log/ceph/14:15
pbourkeinc0: I think I understand, just the comment in your patch is a bit unclear I think14:15
mnaserso you might want to look at fixing those permissions too14:15
mnaserthe osds we do separately in multiple threads so it goes faster14:15
mnaserrestorecon might not be necessary as the rpms take care of that14:15
inc0mnaser, for now I just made this workaround https://review.openstack.org/#/c/366230/7/ansible/roles/ceph/templates/ceph.conf.j214:15
mnaseraand also the devices have to be chmod-ed under ceph:ceph14:17
mnaserjournals mostly14:17
*** diogogmt has quit IRC14:17
*** msimonin has quit IRC14:18
*** dmsimard is now known as dmsimard|afk14:19
*** caowei has quit IRC14:20
*** salv-orlando has quit IRC14:20
*** imcsk8 has quit IRC14:20
*** papacz has quit IRC14:20
*** cinerama has quit IRC14:20
*** pmisiak has quit IRC14:20
*** jidar has quit IRC14:20
*** The_Ball has quit IRC14:20
*** jascott1 has joined #openstack-kolla14:21
*** dwalsh has joined #openstack-kolla14:22
*** b_bezak_ has quit IRC14:23
*** b_bezak has joined #openstack-kolla14:24
*** msimonin has joined #openstack-kolla14:26
*** msimonin has quit IRC14:28
vbelhttps://bugs.launchpad.net/kolla/+bug/1520728  - I suggest we don't fix this. Ansible cannot use multisection - if the same section appears again older hosts have troubles with facts14:28
openstackLaunchpad bug 1520728 in kolla mitaka "fatal: [openstack002] => One or more undefined variables: 'dict object' has no attribute 'stdout'" [Critical,Triaged]14:28
*** msimonin has joined #openstack-kolla14:28
*** caowei has joined #openstack-kolla14:28
*** b_bezak has quit IRC14:28
*** salv-orlando has joined #openstack-kolla14:30
zhubingbingping inc14:30
inc0wassup?14:30
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Change ceph version to Jewel  https://review.openstack.org/36623014:31
*** msimonin has quit IRC14:31
*** egonzalez90 has joined #openstack-kolla14:32
*** dwalsh has quit IRC14:39
*** salv-orlando has quit IRC14:40
*** imcsk8 has joined #openstack-kolla14:42
*** papacz has joined #openstack-kolla14:42
*** cinerama has joined #openstack-kolla14:42
*** The_Ball has joined #openstack-kolla14:42
*** jidar has joined #openstack-kolla14:42
berendtinc0 is it possible to run upgrade of hammer to jewel or does this have an impact on existing ceph clusters?14:42
inc0berendt, it should be safe14:43
inc0however let me test this thoroughly14:43
inc0right now my infra died and can't do anything:/14:43
berendtok but change itself looks good, i was not sure if the release note is sufficient14:44
inc0what would you add?14:44
berendtshould we also do an upgrade of mariadb? at the moment we use 10.0, latest is 10.114:44
*** pmisiak has joined #openstack-kolla14:44
inc0berendt, if we can squeeze it in14:44
berendtno i think release note is fine when an upgrade of hammer to jewel is no problem14:45
inc0if it isn't we can't release it14:45
berendti will check mariadb 10.1 the next days14:45
berendtdo we have a list of the used versions of infrastructure components in the docs?14:46
inc0cool, these are critical, so we need to be sure upgrades works14:46
inc0no, we don't, we should14:46
inc0berendt, can you post bug for it?14:46
inc0wishlist bug14:46
berendtyes i think so, will open a bug14:46
inc0thank you14:47
Jeffrey4l_agreed. this need well tested.14:47
*** ayoung has joined #openstack-kolla14:48
kfox1111is there a reason tools/kolla_kubernetes ends in .py?14:48
inc0Jeffrey4l_, can you help with that? I'm strugging with my infra :S14:48
inc0it's written in python?14:48
inc0;)14:48
* inc0 being smartass14:48
Jeffrey4l_inc0, sure. I can test it.14:49
*** senk has quit IRC14:49
inc0this ownership change can break things if this workaround won't work14:49
*** duonghq has joined #openstack-kolla14:50
inc0but at the end it gives us option to drop root14:50
duonghqevening14:50
inc0good morning duonghq14:50
berendthttps://bugs.launchpad.net/kolla/+bug/162112214:51
openstackLaunchpad bug 1621122 in kolla "Document versions of used infrastructure components" [Undecided,New]14:51
berendti cannot set the importance14:51
inc0there ya go berendt14:52
inc0I made it medium because it is within my power mwhhahahaha14:52
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Add namespace and test  https://review.openstack.org/36583614:52
berendtinc0 haha14:52
*** mbound has joined #openstack-kolla14:54
kfox1111rhallisey: alive?14:55
rhalliseykfox1111, what's up14:56
rhalliseywhat do you got for me :)14:56
*** dwalsh has joined #openstack-kolla14:56
kfox1111k. so, have you seen this one yet?14:56
kfox1111https://review.openstack.org/#/c/366437/14:56
kfox1111I've got a slightly different idea to run by you once you have.14:57
openstackgerritVladislav Belogrudov proposed openstack/kolla: Cinder-backup misses client part for NFS backend  https://review.openstack.org/36603714:58
openstackgerritBartłomiej Daca proposed openstack/kolla: Correct Murano keystone_authtoken option name  https://review.openstack.org/36680114:58
kfox1111rhallisey: the alternate idea is, rather then rename the resources from openvswitch-vswitchd so that the command shrinks down from: kolla-kubernetes resource-template create pod openvswitch openvswitch-vswitchd  to kolla-kubernetes resource-template create pod openvswitch vswitchd,14:59
kfox1111we requre resource_names to be unique, and then we can skip the service name entirely.15:00
kfox1111so:15:00
*** Serlex has quit IRC15:00
kfox1111kolla-kubernetes resource-template create pod openvswitch-vswitchd15:00
kfox1111I like that one a bit better as openvswitch-vswitchd should be the container name too. so it maps up very nicely.15:01
*** tonanhngo has joined #openstack-kolla15:01
rhalliseykfox1111, I agree.  I didn't like the order either15:01
rhalliseyor the length of the commne15:01
rhalliseycommand15:01
*** matrohon has quit IRC15:03
kfox1111think I should rework it so that the cli commands take either service_name or resorce_name instead of both?15:03
*** sdake has joined #openstack-kolla15:03
kfox1111If so, I'll add a test too to ensure service_names and resource_names are all unique.15:03
*** diogogmt has joined #openstack-kolla15:04
*** prithiv has joined #openstack-kolla15:05
kfox1111gtg. bbiab.15:06
openstackgerritzhubingbing proposed openstack/kolla: Added grafana container  https://review.openstack.org/34644715:06
*** sdake has quit IRC15:08
*** caowei has quit IRC15:09
*** yingjun has quit IRC15:11
*** yingjun has joined #openstack-kolla15:12
*** hieulq_ has joined #openstack-kolla15:14
*** diogogmt has quit IRC15:15
*** yingjun has quit IRC15:16
*** diogogmt has joined #openstack-kolla15:19
openstackgerritMerged openstack/kolla: Add cloudkitty ansible role  https://review.openstack.org/34930515:21
rhalliseykfox1111, I agree. I want to revist how the CLI looks15:22
openstackgerritMd Nadeem proposed openstack/kolla: Test: make enforce_type=True in CONF.set_override  https://review.openstack.org/36681815:22
*** sdake has joined #openstack-kolla15:24
*** lrensing_ has joined #openstack-kolla15:25
sdakemorning15:26
lrensing_hello15:26
openstackgerritzhubingbing proposed openstack/kolla: Add sahara ansible role  https://review.openstack.org/35129415:29
zhubingbingmoring15:29
kfox1111back.15:30
kfox1111rhallisey: you ok with the idea of resource names being unique? I can code something up if you are.15:31
berendtcan you please review https://review.openstack.org/#/c/359447/ . i want to merge or abandon it, but i do not want to do daily rebases.15:32
openstackgerritChristian Berendt proposed openstack/kolla: Fix keytone options in all.yml/globals.yml  https://review.openstack.org/36595015:33
rhalliseykfox1111, so another example would be: kolla-kubernetes resource-template create pod nova-api15:33
rhallisey^ yes15:33
kfox1111yeah. exactly.15:33
rhalliseyyea that's way better15:34
*** jascott1_ has joined #openstack-kolla15:34
kfox1111k. I'll see what I can do. :)15:34
rhalliseyexcellent15:34
*** jascott1_ has quit IRC15:35
openstackgerritzhubingbing proposed openstack/kolla: Add Barbican ansible role  https://review.openstack.org/35251515:35
inc0berendt, why do you want to remove fedora?15:35
berendtinc0 who uses fedora?15:36
inc0it's not that I like fedora, but we need to deprecate it first15:36
zhubingbingi thank we should support15:36
zhubingbingi think15:36
berendtfrom my POV openstack should not run on top of fedora15:36
inc0I'd be ok with deprecating it and removing it next release15:36
inc0berendt, agree, but if somebody actually deployed it, we can't screw them over15:36
Jeffrey4l_i think the fedora should be remove. no one use it and no one maintain it.15:37
berendtok but than i will abandon the open review and will open another one to propose the deprecation15:37
inc0I agree, but with deprecation period of one release15:37
Jeffrey4l_this is talked in ml15:37
inc0in fact I'd take a careful look on which distros we want to support15:37
berendtubuntu/centos/oracle15:37
inc0there is also debian15:38
*** unicell1 has joined #openstack-kolla15:38
*** david-lyle_ has joined #openstack-kolla15:38
inc0but I'd be ok with these 3 for now15:38
inc0and rhel15:38
*** david-lyle_ has quit IRC15:38
inc0damn, we have lot of them15:38
berendt+rhel, yes15:38
berendtbut i think it is better to have good support for 3 distros instead of supporting a mass of distros15:38
inc0I agree15:38
berendtand for fedora and debian we do not have gate jobs15:38
inc0potentially someday we could add some lightweight distro like snappy15:39
inc0I'd say we need to create policy on which distros we support and clad it in stone15:39
inc0because we're going exponential with this15:39
*** unicell has quit IRC15:40
inc0anyway, fedora should get 1 release deprecation15:40
berendtjust abandoned the review15:40
inc0berendt, which would translate to big red warning during build15:40
berendtdeprecation warning into a release note + build warning should be sufficient..?15:40
Jeffrey4l_so let's mark it deprecate in this cycle.15:40
inc0agree15:41
berendt+ prechecks15:41
inc0and remove it in Ocata15:41
*** hrito has joined #openstack-kolla15:41
Jeffrey4l_agree.15:41
*** salv-orlando has joined #openstack-kolla15:41
inc0is there any other distro we want to get rid of15:41
inc0?15:41
berendtdebian from my POV..15:42
Jeffrey4l_add warning in config.py to to warn the users when building fedora..15:42
sdakeJeffrey4l_ inc0 i added both of you as adins of the luanchpad group15:42
berendti think nobody is working on debian, at least a lot of docker image contain ubuntu instructions but no debian instructions15:42
sdakedon't use delete please ;)15:42
Jeffrey4l_sdake, got emails. thanks.15:42
sdakeand make certain your launchpad password is *INIQUE*15:42
sdakeUNIQUE that is15:43
berendtwhat about https://bugs.launchpad.net/kolla/+bug/1616387 ?15:43
openstackLaunchpad bug 1616387 in kolla "Remove base_distro type fedora from Dockerfile templates" [Wishlist,In progress] - Assigned to Tin Lam (tl3438)15:43
berendtshould I close this? I think deprecation requires a blueprint15:43
sdakeberendt yo ushould be all set on launchpad now15:43
Jeffrey4l_berendt, no. move it to O cycle.15:43
berendtJeffrey4l_ no blueprint?15:43
berendtsdake thanks15:43
Jeffrey4l_ hmm. bug or bp should both fine( i think ) :)15:44
inc0yaay my power grows mwhahaha15:44
sdakeinc0 we have 6 dys to sort out an upgrae to jewwel15:44
sdakeandd by we, i mean you15:44
sdakeif it doesn'twork prior to rc1, i am reverting the jewel change15:44
inc0ofc15:45
sdakethanks ;)15:45
inc0well it's more about validation15:45
sdakeright15:45
*** senk has joined #openstack-kolla15:45
Jeffrey4l_sdake, i will test the upgrade ceph version tomorrow.15:45
sdakefrom what i hear upgrade is completely hosed atm15:45
inc0my infra is broken atm, but I'll work on setting new one15:45
sdakeJeffrey4l_ thanks dude15:45
inc0sdake, is it?15:45
sdakeinc0 someone forgot who reported mariadb craters on upgrade15:45
jrich523hey guys, anyone have a rst editor for windows they really like?15:46
Jeffrey4l_about the debian, i perfer to mark it deprecated too.15:46
berendtjrich523 vim? :)15:46
sdakedeprecatd is a bit strong15:46
inc0jrich523, or sublime text if you're weakling and need mouse;)15:46
sdakei think not yet ready is better15:46
jrich523i knew i would regret asking this in a heavily linux channel lol15:46
berendtwe could make a pre-deprecation warning?15:46
inc0which I dop15:46
sdakewont we ever get to debian?15:46
jrich523i do enjoy my mouse, but more so i love sublime due to its shortcuts :)15:46
jrich523mostly i guess i wanted a preview window more than anything15:47
Jeffrey4l_no one maintain it and no bug is reported about it( mean no one use it.)15:47
inc0jrich523, my vim now has most of stuff I liked in sublime15:47
berendtjrich523 maybe atom could be an option15:47
sdakeok makes sense Jeffrey4l_15:47
berendtJeffrey4l_ confirmed. i think nobody takes care of debian15:47
Jeffrey4l_editor war :)15:47
jrich523hmm atom looks neat berendt15:47
berendtjrich523 https://atom.io15:47
Jeffrey4l_OK let's do this :)15:48
inc0let's make it deprecated too and if we'll get uproar next release "but I love debian" at lest we'll have supporters15:48
*** salv-orlando has quit IRC15:48
jrich523hmm i'll give that a try... hopefully it isnt as disappointing as Brackets15:48
berendtok i will take care of both deprecations15:48
berendtblueprint or bug? not yet sure15:48
berendtfor debian we have neither15:48
*** prithiv has quit IRC15:48
Jeffrey4l_sdake, the maraidb upgrade and reconfigure should be broken15:49
Jeffrey4l_berendt, i think both of them should be OK. but remember that add a release note for that.15:49
jrich523berendt: it even has an rst preview package15:50
berendtjrich523 yes it is pretty nice15:51
openstackgerritJeffrey Zhang proposed openstack/kolla: Build process outputs each line twice  https://review.openstack.org/36556715:51
openstackgerritJeffrey Zhang proposed openstack/kolla: Build process outputs each line twice  https://review.openstack.org/36556715:55
*** salv-orlando has joined #openstack-kolla15:57
openstackgerritMerged openstack/kolla: Ensure doesn't use LOG.warn  https://review.openstack.org/36416815:57
inc0meeting guys15:57
openstackgerritJeffrey Zhang proposed openstack/kolla: Build process outputs each line twice  https://review.openstack.org/36556715:58
berendthttps://bugs.launchpad.net/kolla/+bug/162115315:59
openstackLaunchpad bug 1621153 in kolla "Deprecate Debian" [Medium,New] - Assigned to Christian Berendt (berendt)15:59
berendthttps://bugs.launchpad.net/kolla/+bug/161638715:59
openstackLaunchpad bug 1616387 in kolla "Deprecate Fedora" [Medium,In progress] - Assigned to Christian Berendt (berendt)15:59
berendtreviews will come tomorrow15:59
Jeffrey4l_cool15:59
zhubingbingbegin meeting?15:59
Jeffrey4l_yep16:00
openstackgerritMerged openstack/kolla: Update murano service name  https://review.openstack.org/36576116:00
*** vhosakot has joined #openstack-kolla16:00
*** tonanhngo has quit IRC16:01
*** hieulq_ has quit IRC16:04
*** janki has joined #openstack-kolla16:04
*** mgoddard_ has joined #openstack-kolla16:05
berendtwe merged the cloudkitty role earlier as planned, can sombody approve https://blueprints.launchpad.net/kolla/+spec/cloudkitty-ansible ?16:05
berendtor can i self-approve it?16:05
*** mdnadeem_ has joined #openstack-kolla16:05
*** mgoddard has quit IRC16:08
*** mdnadeem has quit IRC16:09
*** sean-k-mooney has joined #openstack-kolla16:14
*** banix has joined #openstack-kolla16:14
*** wznoinsk has joined #openstack-kolla16:15
sdakeberendt typicallyblueprints should not be self approved16:16
sdakeif I see someone do that, I typicallly just approve it myself16:17
sdakeberendt do you need cloudkitty for newton?16:17
sdakeI am concerned we have 6 days left and a whole lot of work to merge16:17
berendtsdake it is already merged.. :)16:17
sdakeoh16:17
sdakewell then :)16:17
*** mdnadeem_ has quit IRC16:18
zhubingbing- -16:18
*** mdnadeem_ has joined #openstack-kolla16:18
zhubingbingi have help submit16:18
zhubingbingsdake16:18
sdakesup zhubingbing16:19
sdakezhubingbing do you ever sleep ;)16:19
kfox1111rhallisey: ran into one issue...16:19
zhubingbing- -16:19
sdakezhubingbing what hep do you need fine sir16:19
kfox1111there's one case where names are ambiguous with services.16:19
zhubingbingwait to see Barbican.16:20
zhubingbing- -16:20
sdakezhubingbing link?16:20
kfox1111kolla-kubernetes resource-tempalate create svc mariadb16:21
zhubingbingwait gete16:21
zhubingbinggate16:21
sdakezhubingbing roger16:21
sdakei am going to try to get the gating extended to 90 minutes16:21
zhubingbinghttps://review.openstack.org/#/c/352515/16:21
*** mgoddard has joined #openstack-kolla16:21
kfox1111we shouldn mae the svc service template without the -service as its redundant. but then its the same name as the service.16:21
zhubingbingok-16:21
sdakeby try I mean to say I am goin to submit a patch - and pray openstack-infra accepts it :)16:21
*** mgoddard_ has quit IRC16:21
zhubingbingsdake, I submitted the cloudkitty today, and I want him to support gnocchi backend16:23
openstackgerritzhubingbing proposed openstack/kolla: Added grafana container  https://review.openstack.org/34644716:25
mnaseri gotta give credit to the kolla team...16:27
mnaserwe were just looking at how we're going to move our telegraf/influxdb/grafana setup to the kolla architecture... reviews already exist for that16:27
mnasermonitoring would be the one thing left (we use sensu, because autoregistration!).. we'll bring our stuff over hopefully soon when we can16:28
sdakeDaviey was working on sensu16:28
*** dmsimard|afk is now known as dmsimard16:28
mnaseroh cool, i'll look at the work done and cooperate, we have a ton of really cool health checks16:28
sdakei thnk he abanonded in favor of a tig stakc16:28
sdakemnaser do you think both are needed?16:28
zhubingbinghttps://review.openstack.org/#/c/351294/16:29
zhubingbingsdake, can you look it ?16:29
mnasertelegraf is good for metrics, but for us things like: are the drives healthy?  is the api responding?  is X service up?  more of the binary checks16:29
mnaserthose work better with sensu in our experience16:29
zhubingbingi will submit telegarf  role16:30
zhubingbingwait influxdb role merge16:30
sdakemnaser does colelct integrate with sensu?16:32
sdakemnaser we are open to having both from prvious conversations we have had16:32
sdakemnaser however, would help me to understand the use cases16:32
*** ayoung has quit IRC16:35
*** ayoung has joined #openstack-kolla16:36
*** mbound has quit IRC16:39
*** msimonin has joined #openstack-kolla16:39
*** irtermite is now known as irjroll16:39
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Reverse arg order on resource and resource-template  https://review.openstack.org/36643716:40
*** irjroll is now known as irtermite16:40
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP: Reverse arg order on resource and resource-template  https://review.openstack.org/36643716:41
*** fguillot has quit IRC16:43
*** msimonin has quit IRC16:45
wznoinskhi guys16:45
wznoinsk: * https://review.openstack.org/#/c/366315/2 (wznoinsk) include or not a commented out 'Database options' section in globals.yml ?16:45
berendti confirmi mnaser, i also use sensu in my environment, sensu is good fur health checks, collected is good to collect performance data16:45
inc0wznoinsk, it's always better to have it there, we'll need to have reference of all the options in the end as well16:46
Jeffrey4l_inc0, pbourke sdake cloud u review this https://review.openstack.org/34575116:46
*** diogogmt has quit IRC16:46
berendtmnaser https://blueprints.launchpad.net/kolla/+spec/sensu is the spec for sensu16:46
inc0yeah imho monitoring will need to go to Ocata too16:47
inc0as for example influxdb is kinda fubar to make HA16:47
berendti talked with a guy from evoila, they are also using sensu16:47
berendti wanted to take over the sensu blueprint after his vacation16:48
sean-k-mooneywe are hopping to extend the collectd support to work with both influxdb at a later point16:48
berendtsean-k-mooney this would be great and is trivial16:48
inc0sean-k-mooney, there is also intel's own Snap16:48
sean-k-mooneycurrentl the intiall contianer was being added to work with celiometer16:48
berendti am using collectd with grafana at the moment and this is working pretty well16:48
inc0which is actually pretty cool16:49
sean-k-mooneyso on the monitoring side ideally we should be able to swap the collector betwen telegar/collectd and snap16:49
berendtinc0 does it makes sense to add several telemetry frameworks?16:49
sean-k-mooneyideally we would be able to swap influxdb out for ceilometer or gnochii also16:50
inc0berendt, ideally I'd have one at the end of the day, just well versed16:50
inc0this is hard topic16:50
berendti think we should focus on one implementation first16:51
berendtfinish the influxdb integration and add snap later16:51
*** unicell1 has quit IRC16:51
sean-k-mooneywell we should have too implenetaion hope fully in netwon16:51
sean-k-mooneytelegraph + influxdb + graphana16:51
sean-k-mooneyand collectd + ceilometer16:52
inc0well newton is done, we have what we have16:52
sean-k-mooneyinc0: yes true :)16:52
mnaserreading buffer16:52
inc0all I'm saying is that in Ocata we should take a second look at it16:53
openstackgerritMerged openstack/kolla: Add sahara ansible role  https://review.openstack.org/35129416:53
sean-k-mooneycollectd + should be easy to add and i think snap + influxdb + graphana  would also be easy to add16:53
mnasersdake, we have two monitoring systems at the end of the day.  sensu to do more boolean checks (up or down) but telegraf+influxdb+grafana for metrics16:53
mnaserand then we havent gotten into using the alerting that is part of the tick stack16:53
sean-k-mooneys/colledtd +/ collectd +  influxdb + graphana16:53
inc0bbiab, need to move to office;) cya all in a bit16:53
*** inc0 has quit IRC16:53
mnaseri think collectd is too heavy, telegraf has a ton of really cool built-in plugins16:54
mnaserand it can fork/exec things too16:54
berendtcollectd isn't really heavy16:54
mnaserwe've had problems with collectd somehow sucking up 40gb of memory on a compute node16:54
mnaserwe didnt look into why but yeah.. not a good day16:54
sean-k-mooneymnaser: unless you had a memory leak that should not happen16:54
sdakeJeffrey4l_ ping do you know if we are using the centos and epel mirrorss yet16:54
mnaseri figured :) but it was replicated across many compute nodes16:54
mnasertelegraf has been working well for us and the fact it has built in influxdb integration worked well for us (and a ton of pre-made ready to use plugins)16:55
Jeffrey4l_sdake, no. we are only use mirror for ubuntu.16:55
sdakeJeffrey4l_ - we need to do our part on infra gating16:55
sdakeJeffrey4l_ since you understand how this stuff works, any chance you can get a patch in the queue today16:56
sdakeor I can do so16:56
sdakeI think it may be near bedtime fory ou16:56
sdakecentos base and epel need to be in our mirror list16:56
*** vhosakot has quit IRC16:57
Jeffrey4l_I have a PS to use the gate mirror, which using `sed` to change the file. we talked that. and i will move to the mirror.availabvle.d folder16:57
Jeffrey4l_I can add it.16:57
*** daneyon has joined #openstack-kolla16:57
*** daneyon has quit IRC16:58
*** tonanhngo has joined #openstack-kolla17:00
*** daneyon has joined #openstack-kolla17:00
*** egonzalez90 has quit IRC17:03
*** daneyon has quit IRC17:05
sdakeJeffrey4l_ can you add it today?17:05
sdakeall our gate jobs are timing out17:05
Jeffrey4l_sdake, yep. I wil push a new PS soon.17:05
Jeffrey4l_btw. I increased the timeout time in project-config https://review.openstack.org/36437717:06
Jeffrey4l_sdake, ^^17:06
*** tonanhngo has quit IRC17:07
sdakeJeffrey4l_ already on it17:08
*** fragatina has joined #openstack-kolla17:08
sdakehttps://review.openstack.org/#/c/366859/17:08
Jeffrey4l_sdake, mine is duplicated?17:08
sdakeyup17:08
sdakemine already has s1 +2 :)17:08
Jeffrey4l_cool . I will abandon mine.17:09
*** hrito has quit IRC17:10
*** vhosakot has joined #openstack-kolla17:11
sdakeyo vhosakot17:12
vhosakotsdake: yo17:12
berendtsdake +2 battle? :)17:12
Davieysdake: here17:14
sdakeDaviey i think we found a use case for both tig and sensu17:14
sdakeread scrollback17:14
Davieyok, will do17:14
*** kbaegis_ has joined #openstack-kolla17:15
Davieysdake: Sorry for missing the meeting, i have a clashing standing real life meeting at the time17:15
kbaegis_Hi guys17:15
kbaegis_I'm troubleshooting some issues with L2 it looks like.  My netns can't ping through to the host17:15
sdakeDaviey its ok - i missed it too:)17:16
kbaegis_Once kolla has deployed, you should be able to create a physnet1 external network and join a router to it as the default gateway, correct?17:16
openstackgerritPaul Bourke proposed openstack/kolla: Add header blocks to all Dockerfiles  https://review.openstack.org/36687817:16
openstackgerritPaul Bourke proposed openstack/kolla: Add header blocks to all Dockerfiles  https://review.openstack.org/36687817:17
sdakeDaviey unfortunately it is very difficult to find a timeslot that works for everyone17:18
sdakere standing meeting - perhaps you will just have to read the meeting logs (which I would recommend)17:18
sdakeDaviey i think changing the meeting time isn't going to operate well with all our contributors17:18
*** shardy has quit IRC17:19
kbaegis_Netns created, everything looks good.  Here's my ovs config.  Could someone spot check it for me to make sure it looks sane?17:20
kbaegis_http://hastebin.com/yavuzumona.sm17:20
kbaegis_Or ideally do a ovs-vsctl show from a test environment that I can compare to?17:20
kfox1111rhallisey: alive?17:21
*** tonanhngo has joined #openstack-kolla17:23
*** inc0 has joined #openstack-kolla17:24
inc0I'm back17:24
kbaegis_inc0: wb17:25
inc0thank you17:25
*** unicell has joined #openstack-kolla17:25
*** mrjk has quit IRC17:25
*** ayoung has quit IRC17:27
openstackgerritzhubingbing proposed openstack/kolla: Add Barbican ansible role  https://review.openstack.org/35251517:28
*** tonanhngo has quit IRC17:28
Davieysdake: right.. not asking for it to be changed.. just letting you know why i often wont be there :)17:29
zhubingbingGood night everyone.17:30
kbaegis_So I get full network connectivity from inside the netns, but I can't talk between the host and the guests. Again, you just create a flat external network with physnet1, correct?17:30
*** ssurana has joined #openstack-kolla17:31
openstackgerritJeffrey Zhang proposed openstack/kolla: Using CI mirror host  https://review.openstack.org/36572117:33
sean-k-mooneyby the way is neutron fixed on master?17:34
*** tonanhngo has joined #openstack-kolla17:35
kbaegis_Could someone please change docker_restart_policy: "always" to docker_restart_policy: "on-failure"? Docker will start to complain about this or fail outright on future releases17:35
*** egonzalez90 has joined #openstack-kolla17:36
kbaegis_# of retries and "always" are supposed to be mutually exclusive (according to docker)17:36
*** duonghq has left #openstack-kolla17:36
sean-k-mooneykbaegis_: changeing to on failure would not restart the container on a system reboot17:37
*** Marcellin__ has quit IRC17:37
*** zhubingbing has quit IRC17:37
kbaegis_sean-k-mooney: Gotcha.  I'm just telling you it will be an issue if you upgrade docker.  It' breaks the playbook17:38
*** mrjk has joined #openstack-kolla17:38
sean-k-mooneykbaegis_: so really i guess the number of retires should be removed then17:38
kbaegis_sean-k-mooney: That's probably right17:38
*** jrich523 has quit IRC17:39
*** jrich523 has joined #openstack-kolla17:39
*** tonanhngo has quit IRC17:40
openstackgerritEduardo Gonzalez proposed openstack/kolla: Add Senlin Ansible role  https://review.openstack.org/33972517:40
rhalliseykfox1111, yo17:40
rhalliseyback17:40
kfox1111since I'm in refactoring the code, I think it would be better to fix this at the same time:17:41
kfox1111https://blueprints.launchpad.net/kolla-kubernetes/+spec/resource-magic17:41
kfox1111what do you think?17:41
kfox1111(I got kolla-kubernetes resource-template create svc mariadb to work. :)17:41
*** janki has quit IRC17:41
rhalliseykfox1111, I agree completely17:42
sean-k-mooneykbaegis_: so we dont forget can you open a bug for the docker change?17:42
rhalliseyit's not nearly granular enough17:42
kfox1111k. I'll fix that too then. thanks. :)17:42
rhalliseykfox1111, question though17:42
rhalliseythe most granular of all is to just use kubelet17:42
rhalliseysomething to keep in mind17:42
kfox1111what do you mean?17:42
kfox1111like, not do the resource command at all?17:42
rhalliseywell we would still have to render templates17:43
rhalliseyit's more of a discussion topic17:43
rhalliseyrendering is a CLI specific tool17:43
rhalliseybut any orchestration is not17:43
kfox1111yeah.17:43
rhalliseyit's something to think about because ultimatly to reach full granularity we get to kubectl17:44
rhallisey+ a cli that renders17:44
kfox1111I'm wondering if we want to pull all the orchestration out to its own cli tool.17:44
rhalliseywell17:44
rhalliseydoes the orchestration become part of the cli at all is the question17:44
kfox1111yeah.17:44
kfox1111I can see a case, where, while we provide an asible based worflow engine,17:45
rhalliseybecause the way it is now, specificlly bootstrap, it has to be done by hand17:45
kfox1111others may wantl, say a mistral one.17:45
kfox1111so having them be seperate commands like kolla-ansible and kolla-kubernetes are gives them room to innovate.17:45
rhalliseykfox1111, right, cli provides tools to render where an op can take that and use it to deploy with17:45
kfox1111yeah.17:45
rhalliseyansible/wahtever can orchestrate17:46
* kfox1111 nods17:46
*** harlowja has quit IRC17:46
rhalliseykfox1111, something to think about I guess17:46
kfox1111yeah. I think we're on the same page though.17:47
kfox1111probably should file a blueprint for it.17:47
rhalliseyya for sure17:48
sean-k-mooneyby the way what is the best way to do a vote? ml, strawpool set to mailing list is there another method i should use?17:48
kbaegis_sean-k-mooney: done https://bugs.launchpad.net/kolla/+bug/162118717:48
openstackLaunchpad bug 1621187 in kolla "fix ansible/group_vars/all.yml restart/retry policy" [Undecided,New]17:48
sean-k-mooneykbaegis_: cool thanks17:48
*** harlowja has joined #openstack-kolla17:49
*** vhosakot has quit IRC17:49
*** vhosakot has joined #openstack-kolla17:50
*** banix has quit IRC17:51
sdakesean-k-mooney which kind of vote17:52
*** mbound has joined #openstack-kolla17:52
sdakesean-k-mooney only cores can trigger a vote17:52
*** fragatina has quit IRC17:52
sdakesean-k-mooney however, a core can proxy a vote for you if you obtain a proxy :)17:52
*** fragatina has joined #openstack-kolla17:53
sean-k-mooneysdake: i was asked a few days ago to create a vote on the name of the kolla-host role17:53
sdakehuh?17:53
sean-k-mooneysdake: currently the name is baremetal as originally i was calling it the baremetal playbook17:53
sdakewhy would that need a vote17:53
sean-k-mooneyit was suggested to change it to host or kolla-host role to avoid confution with ironic and bifrost17:54
sean-k-mooneysdake: so basically i just wanted to as what shoudl the role be called and have people vote17:55
*** banix has joined #openstack-kolla17:55
sdakesean-k-mooney did someone hae trouble with the baremetal name17:55
sean-k-mooneysdake: i was just going to send a mail to the list with this link http://www.strawpoll.me/1117515917:55
sdakesean-k-mooney needd more context but have dr appointment in 10 mins17:55
sdakesean-k-mooney cool - that is a poll not a vote17:56
sean-k-mooneyam yes some one taught the baremental role was installing baremetal servers17:56
sdakejust send a mail to the ailing with with [poll][kolla] Name of baremetla roel17:56
sean-k-mooneysdake: ok cool will do and i will expaine the context in the mail thanks17:56
*** mandre has quit IRC17:57
sdakesean-k-mooney a vote sets policy17:57
sdakea poll gains input into hard computer scieence problems like naming :)17:57
sean-k-mooneysdake: ah cool i didnt know they were used differently in an openstack context17:58
sdakesean-k-mooney this is a koll athing i htink ;)17:58
jrich523i voted for waffles :)17:58
*** diogogmt has joined #openstack-kolla17:59
sdakedont forget the chicken!17:59
*** inc0 has quit IRC17:59
jrich523only if its fried!18:00
jrich523me being the noob in this that i am... the two options 'baremetal' and 'pre-install' sound very different18:00
sean-k-mooneysdake: and bacon18:00
jrich523baremetal would imply only for baremetal (if thats true, id vote for that one)18:00
*** inc0 has joined #openstack-kolla18:00
sdakewe have bootstrap already jrich52318:01
sdakei dont see whatis wrong with baremetal18:01
jrich523and the pre-install just sounds like a manditory step on all hosts (which also sounds good :)18:01
sdakejrich523 pre-install is clled bootstrap18:01
sdakesean-k-mooney whatever happens, these names are locked in after 3.0.018:01
sdakeso get em right :)18:01
jrich523so then what is this for? the title isnt very helpful for someone like me :)18:01
jrich523but my ignorance to all of this might help provide the most useful name18:02
sean-k-mooneyjrich523: the beremetal role today is used by the kolla-host playbook to install the kolla dependcies18:02
sean-k-mooneyjrich523: before you do a kolla deploy18:02
*** kbaegis_ has quit IRC18:02
sean-k-mooneyjrich523: so it installs docker... on the baremetal host18:03
jrich523so then its a pre-install for baremetal only18:03
jrich523wouldnt the process be the same for all hosts?18:03
*** fragatina has quit IRC18:03
sean-k-mooneywell no it automate everyting in the quickstart e.g. the stuff you need to do on all host that you will use on your kolla deployed openstack cloud18:03
jrich523yay :D18:03
jrich523now that i have it down pat, you've automated it18:04
jrich523lol18:04
*** fragatina has joined #openstack-kolla18:04
jrich523hmm i kinda like kolla-host i think18:04
sean-k-mooneyjrich523: i havent automated the build host yet but i will do that soon i hope18:04
jrich523actually seems like it should be mildly easy18:05
*** mandre has joined #openstack-kolla18:05
sean-k-mooneyjrich523: ya the only reason i called it beremetal was i was origially calling the playbook the baremetal playbook18:05
jrich523i feel like for the most part it shouldnt matter18:05
jrich523and in the end should work on any host18:06
sean-k-mooneyjrich523: actully my plan is that for the build host i will reuse the current rould and just install the extra things need on the build host. like ansible and kolla iteslf18:06
jrich523cool :)18:07
*** vhosakot has quit IRC18:09
*** msimonin has joined #openstack-kolla18:10
jrich523i voted for kolla-host, and im winning!18:14
sean-k-mooney:) i could not make up my mind so voted for kolla-host and host18:16
jrich523host seems... dangerous18:16
sean-k-mooneyoh why18:16
jrich523maybe it just has to do with my powershell experience, but there is an alias for host (get-host) which i've seen people.... well... struggle..18:17
*** mark-casey has joined #openstack-kolla18:17
jrich523its a common name, not uncommon for a cmd to be called that... just too general i guess18:17
sean-k-mooneyoh ok well the reason i lean towrods host instead of kolla-host is that it a role in the kolla repo so haveing kolla in the role name feels a little redundant18:18
sean-k-mooneybut this is why i create the poll18:18
jrich523hmm i'll agree with that18:19
sean-k-mooneyso that people can tell me what they prefer18:19
jrich523what about something like Node? because really its prepping any host to act as a node of sorts18:20
jrich523Base, Node... hmm18:21
*** tonanhngo has joined #openstack-kolla18:21
*** akwasnie_ has quit IRC18:22
sean-k-mooneyya maybe ill ask for other suggesting in the email too.18:22
sean-k-mooneyat the end of the day i dont really mind what the role is called as long as it works18:22
*** tonanhngo has quit IRC18:22
*** tonanhngo has joined #openstack-kolla18:22
*** kproskurin has quit IRC18:22
jrich523yeah sort of unimportant, but meaningful names are always nice :)18:23
mark-caseysean-k-mooney: the second question in the poll is legitimately harder. So this is voting whether to rename ./ansible/../roles/baremetal?18:30
mark-caseysorry, not voting in that sense. heh. polling for names of that role... one of which (I think) is the current one18:31
sean-k-mooneymark-casey: ya the question is should we change the name of ./ansible/../roles/baremetal given that kolla also has baremetal as a service(ironic) and birost for baremetal provisoning at deployment time18:34
*** ayoung has joined #openstack-kolla18:39
kfox1111rhallisey: what should status look like then for resource?18:42
kfox1111kubectl get pod foo -o yaml?18:42
rhalliseykubectl describe pods nova-api-018:46
rhalliseythat would be the kubelet way18:46
kfox1111-o yaml adds the status too. and its machine parsable.18:46
rhalliseythe more verbose way is contacting the endpoint18:46
kfox1111describe I don't think is.18:46
rhalliseyoh true that drops it into yaml18:47
mark-caseysean-k-mooney: cool. I went with pre-install as I think 'kolla host' is often casually used to describe the host where kolla-ansible is run.18:47
rhalliseykfox1111, oh to describe the running resource18:47
rhalliseythat output acutallu looks preety good18:48
*** daneyon has joined #openstack-kolla18:48
rhalliseykfox1111, ya that's a way more descripive output18:49
sean-k-mooneymark-casey: ya there are pros and cons to all the options hence the poll.18:49
*** daneyon has quit IRC18:53
*** athomas has quit IRC18:56
*** b_bezak has joined #openstack-kolla18:59
*** sdake has quit IRC19:02
*** salv-orlando has quit IRC19:02
*** b_bezak has quit IRC19:02
*** senk has quit IRC19:05
*** lrensing_ has quit IRC19:07
*** vbel has quit IRC19:07
*** vbel has joined #openstack-kolla19:08
*** sdake has joined #openstack-kolla19:10
*** salv-orlando has joined #openstack-kolla19:13
berendtsean-k-mooney what about bootstrap?19:15
sean-k-mooneyberendt: that would make sense too yes :)19:15
*** fragatin_ has joined #openstack-kolla19:17
kfox1111rhallisey: ok. I'll rewrite it to use that.19:17
rhalliseykfox1111, so what will the cli do in this case?19:18
rhalliseyor are you making an iterative change19:18
kfox1111just mapping kolla-kubernetes resource create/delete/status X to equiv kubectl [create -f template]/[delete pod/job/daemonset X]/[get pod/job/daemonset X -o yaml]19:19
rhalliseyok cool19:20
*** vhosakot has joined #openstack-kolla19:20
*** fragatina has quit IRC19:21
kfox1111I'll have a revised ps up soon.19:21
kfox1111I got create hooked up. just doing delete/status now.19:26
kfox1111"string indices must be integers"..... not helpful... :/19:31
kfox1111I really wish python had a gdb equiv that was easier to use. pdb can be a pain...19:33
kfox1111ah... there it is.19:33
kfox1111ok. this seems to do the trick.19:36
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Cleanup resource and resource-template  https://review.openstack.org/36643719:37
kfox1111rhallisey: can you have a loook at ^ please and let me know what you think?19:37
kfox1111doh. pep8... will fix that19:44
*** Pavo has quit IRC19:48
*** fragatin_ has quit IRC19:53
*** fragatina has joined #openstack-kolla19:54
*** Pavo has joined #openstack-kolla19:57
*** dwalsh_ has joined #openstack-kolla19:58
inc0guys is it just me or neutron is broken?20:03
*** pbourke has quit IRC20:03
rhalliseyinc0, I see it also20:03
rhalliseydb sync error20:03
inc0rhallisey, rebuild and clenaup containerts20:04
inc0this one is fixed20:04
*** pbourke has joined #openstack-kolla20:04
inc0now dhcp is acting up20:04
*** openstackgerrit has quit IRC20:04
*** openstackgerrit has joined #openstack-kolla20:04
*** mbound has quit IRC20:04
*** salv-orlando has quit IRC20:10
*** salv-orlando has joined #openstack-kolla20:18
*** Pavo has quit IRC20:19
*** vhosakot has quit IRC20:25
*** salv-orl_ has joined #openstack-kolla20:29
*** inc0 has quit IRC20:30
*** salv-orlando has quit IRC20:33
*** imcsk8 has quit IRC20:36
*** daneyon has joined #openstack-kolla20:37
*** imcsk8 has joined #openstack-kolla20:38
*** banix has quit IRC20:39
*** daneyon has quit IRC20:42
*** Pavo has joined #openstack-kolla20:42
*** michauds has quit IRC20:43
*** vhosakot has joined #openstack-kolla20:48
*** bmace has quit IRC20:54
*** ssurana1 has joined #openstack-kolla21:03
*** Pavo has quit IRC21:03
*** mbound has joined #openstack-kolla21:05
*** ssurana has quit IRC21:06
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Cleanup resource and resource-template  https://review.openstack.org/36643721:08
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Check for service name in resource name  https://review.openstack.org/36698321:08
*** mbound has quit IRC21:10
openstackgerritEduardo Gonzalez proposed openstack/kolla: Add Senlin Ansible role  https://review.openstack.org/33972521:13
*** rhallisey has quit IRC21:15
*** msimonin has quit IRC21:20
*** banix has joined #openstack-kolla21:23
*** vhosakot has quit IRC21:24
*** egonzalez90 has joined #openstack-kolla21:25
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Cleanup resource and resource-template  https://review.openstack.org/36643721:25
*** egonzalez90 has quit IRC21:26
*** jheroux has quit IRC21:27
tonanhngosdake: ping21:33
sdaketonanhngo hello fine sir21:33
tonanhngoHi Steve, I am looking for a recommendation on installing OpenStack on a large cluster21:33
tonanhngoI guess you just went through this exercise recently, so maybe we can learn a few things from you21:34
tonanhngoWe are getting a cluster of some 300 nodes for Magnum scalability testing using Rally21:34
tonanhngoBut first we have to install OpenStack on the cluster21:35
sdakefrom osic?21:35
tonanhngoIt's from CNCF, but it's similar21:35
kfox1111iteritems went away in python 3?21:35
kfox1111grr...21:35
sdakedo they have predefined ways to install baremetal?21:35
tonanhngoThese are all baremetals, and we requested Ubuntu 14.04 with 2 NIC21:36
sdakekolla is easy21:36
sdakenot sure if it scales to that size21:36
sdakewe have implemented magnum already - but it may need love21:36
sdakehow much time edo  you have?21:36
tonanhngoSo if we want to install the Newton release, can we do this with Kolla?21:37
sdakewell not sure on 300 nodes21:37
*** banix has quit IRC21:37
sdakei think that should work21:37
sdakebut has not been tested21:37
kfox1111bleh.. stupid python 3. :/21:37
tonanhngoWe requested 2 weeks, but I think they can be flexible21:37
*** banix has joined #openstack-kolla21:37
sdake123 nodes has been tested21:38
sdakewhe nis your window21:38
sdakei'd highly recommend preparing rally prior to starting21:38
sdakewe have some work to start from21:38
tonanhngoDid you drive Rally from your own server?  or one of the server in the cluster?21:39
sdakefrom deploy node21:39
sdaketo deply targets21:39
tonanhngook21:39
tonanhngoYou use Ansible to deploy?21:39
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Cleanup resource and resource-template  https://review.openstack.org/36643721:40
*** lyncos has quit IRC21:43
sdaketonanhngo yes21:44
sdaketonanhngo deploy on 123 servers takes 20 minutes21:44
sdakeatleast in osic environmnt21:44
sdake100 compute 20 stroage 3 control with ceph21:45
sdaketonanhngo afaik no other tool can even scale to 100+ nodes21:45
tonanhngoThat's quite good21:45
sdaketonanhngo what you will be challenged with is running magnum outside containers21:45
sdakeor alternately making the magnum in the containers work properly21:46
tonanhngoSo the containerized Magnum is not quite working yet?21:46
sdaketonanhngo the problem with our implementation is it is not integrated with anything but file backend21:46
sdakeand i am pretty sure that works21:46
*** sbezverk has joined #openstack-kolla21:46
sdakesbezverk would know21:46
sdakehe implemented lbaas v2 just for the magnum use case21:47
sdakewhich reminds me, is magnum workign with lbaas v2?21:47
tonanhngoWe are working on it.21:47
sdakethe other problem you will have is  getting correct routing of heat-api and heat-api-cfn21:47
sdakebut you have that no mattere what too you use21:47
sdakethat has to do with how the network is configured21:47
tonanhngoIs there some documentation on how to work through these?21:49
sdakekolla will also setup your bare metal for you21:49
sdakethe heat api network config?21:49
tonanhngoright21:49
sdakei'd look to heat documentation for that21:49
tonanhngook21:49
sdakewe didnt test wait conditions in our environment21:49
sdakei know they work -  I use them in my home lab21:49
sdakebut my home lab is configured proerly21:49
sdakelbaasv2 - need to finih the job on magnum21:50
sdakeyou will probby be deploying master i assume21:50
sdakeprior to newton magnum was non-functional21:50
tonanhngoThat's what I am thinking21:50
tonanhngook, so if we are stuck with containerized Magnum, we can just install Magnum manually on some host?21:50
sdaketonanhngo yup you sure can21:53
sdaketonanhngo but it will be a manual process21:53
sdakethe contianers run with net=hosst21:53
sdakeso connecting to the network of the db/rabbit is straigghtforward21:53
sdakejust configure it appropriately21:54
tonanhngook21:54
sdakewith the right passwords21:54
sdakeanible itself can scale to 300 nodes no problem21:54
sdakewhether rabbitmq and mariadb work at that scale with kolla is an unknown21:54
tonanhngoYeah that's one of my concern, we may hit other bottleneck outside Magnum or the container orchestration engines21:55
sdakethe challenges in a non-containeized magnum are 1) manual config of mangum 2) manual install of magnum 3) getting heat-api or heat-api-cfn to communicate to the vms 4) getting lbaas v2 implemented21:55
sdakeeasy to configur earound21:56
sdakeyou just drop your custom config in /etc/kolla/config/nova.conf21:56
sdakeor whatever21:56
sdakeand it will override whata i already there for those values21:56
sdaketonanhngo i suspect some folks in olla would help you get going on a 300 node deploy21:56
sdaketonanhngo it would be a great proof point that kolla works a tthat scale for computekit21:57
openstackgerritPrithiv proposed openstack/kolla: Ansible roles for collectd Container  https://review.openstack.org/36608221:57
sdakehow beefy are your controller nodes?21:57
tonanhngoGood to know to watch out for these, and we would love to get help from the Kolla team.21:57
tonanhngolet me check21:57
openstackgerritPrithiv proposed openstack/kolla: Ansible roles for collectd Container  https://review.openstack.org/36608221:58
*** prithiv has joined #openstack-kolla21:58
tonanhngoHere is the server spec:  https://github.com/cncf/cluster/21:59
sdaketonanhngo pbourke and inc0 did most of our bare metal networking setup21:59
sdaketonanhngo we used vlans and whatnot21:59
prithivhi.21:59
sdakeall magic to me ;)21:59
sdakewhat we did was bond two of the networking interfaces22:00
prithivhttps://review.openstack.org/#/c/346842/ i see centos binary and deploy gate failing for this.22:00
sdakeand setup vlans on them iirc22:00
sdakeDaviey also has some understanding22:00
tonanhngoyeah we probably won't have access to those, but we will see what they give us.22:00
prithivi have added exception for binary in test_build.py . but i still face the same issue. can someone help me out in this please22:01
sdakethe lsat challenge is getting your bare metal in a shape is probably networking22:01
sdaketonanhngo with vlans, its fairly straightforward to get the api services sto communicate with the neutron network i think22:01
sdakewhich is what you need to get vms to check into heat's wait conditions22:01
tonanhngook, guess I will need to get someone with networking expertise to stand by for help.22:03
prithivis that a known issue or am missing something here..22:03
tonanhngoSo to try out Kolla on a small environment, I can just follow the documentation?22:03
sdaketonanhngo docs should get you there22:03
sdakei'd try all in one first22:03
sdakeprithiv link to problem?22:03
tonanhngoSounds good, will do that22:04
prithivsdake: https://review.openstack.org/#/c/346842/22:05
prithivthis patch22:05
prithivhas jenkins check failure.22:06
prithivhttps://github.com/openstack/kolla/blob/master/tests/test_build.py22:06
prithivsfc image has been added to exceptions also22:06
sdakeprithiv http://logs.openstack.org/42/346842/7/check/gate-kolla-dsvm-deploy-centos-binary-centos-7-nv/c004054/console.html#_2016-08-31_19_40_09_34404622:07
sdakeprithiv you hae added to exceptions here: https://github.com/openstack/kolla/blob/master/tests/test_build.py#L6922:09
sdakewhich is fine22:09
sdakeyour not bulding it in the deploy job22:09
sdakeyet your trying to deploy it22:09
*** fguillot has joined #openstack-kolla22:10
prithivoh.. how would i defer from that being executed22:10
sean-k-mooneysdake: the networking-sfc-agent should not be enabled to deploy by default.22:11
sdakeusually by enable_featurename22:11
sdakesean-k-mooney ya clearly :)22:11
sdakeprithiv our gate jobs do not deploy non-compute kit servers at this time22:11
sean-k-mooneysdake looking at the patach at first glance it should not be deploy this image in the gate https://review.openstack.org/#/c/346842/7/ansible/group_vars/all.yml22:12
*** banix has quit IRC22:13
sdakesean-k-mooney agree - I am stumped22:13
sdakemain.yml looks ok to me but not certain22:13
sean-k-mooneymaybe woudl should expcitly test enable_neutron_networking_sfc_agent | bool == true?22:14
sean-k-mooneyi dont thnink that should change anyting though22:14
*** berendt has quit IRC22:14
*** vhosakot has joined #openstack-kolla22:16
*** mark-casey has quit IRC22:17
sdakeok folks nee to  do laptop reapir shortly and ill be out22:18
sdaketonanhngo you all settled?22:18
sdakepbourke runs in the uk timezones22:18
sdakedaviey runs in uk and early us timezones22:18
sdaketonanhngo inc0 runs in us timezones22:19
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457322:20
openstackgerritPrithiv proposed openstack/kolla: Add networking guide for Neutron extensions  https://review.openstack.org/35538622:23
tonanhngoI think you give enough tips to get started22:23
sdaketonanhngo probbly too much :)22:24
tonanhngoThanks Steve, I will be back begging for more help :)22:24
*** banix has joined #openstack-kolla22:24
*** sdake has quit IRC22:24
*** vhosakot has quit IRC22:27
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457322:29
*** dwalsh has quit IRC22:30
*** dwalsh_ has quit IRC22:30
*** fragatin_ has joined #openstack-kolla22:34
*** fragatina has quit IRC22:37
*** banix has quit IRC22:39
*** Pavo has joined #openstack-kolla22:43
*** prithiv has quit IRC22:54
*** fragatin_ has quit IRC22:57
*** Pavo has quit IRC23:01
*** Pavo has joined #openstack-kolla23:02
*** harlowja has quit IRC23:03
*** Pavo has quit IRC23:03
*** Pavo has joined #openstack-kolla23:06
*** Pavo has quit IRC23:08
*** jrich523 is now known as someguy23:10
*** someguy is now known as jrich52323:10
*** salv-orl_ has quit IRC23:16
*** salv-orlando has joined #openstack-kolla23:17
*** Pavo has joined #openstack-kolla23:17
*** fguillot has quit IRC23:21
*** salv-orlando has quit IRC23:21
*** diogogmt has quit IRC23:24
*** Pavo has joined #openstack-kolla23:28
*** fguillot has joined #openstack-kolla23:35
openstackgerritKevin Fox proposed openstack/kolla: Fix tgtd config for kolla-kubernetes  https://review.openstack.org/36702423:36
sean-k-mooneyis ceph broken on master or partically cinder+ceph?23:38
sean-k-mooneyim seeing this http://paste.openstack.org/show/568394/23:38
sean-k-mooneyim also not able to upload an image to glance with the ceph backend.23:39
sean-k-mooneyim going to revert to mitaka and see if the same config works tomorow23:40
*** mtaylor22 has joined #openstack-kolla23:40
*** banix has joined #openstack-kolla23:45
*** zhurong has joined #openstack-kolla23:49
*** huikang has joined #openstack-kolla23:53
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Add cinder volume with iscsi and lvm backend to Kube  https://review.openstack.org/36457323:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!