Friday, 2016-12-02

*** Pavo has joined #openstack-kolla00:00
sbezverkany specific reason to run neutron 2.0.200:00
sbezverk?00:00
kfox1111for now, everythings 2.0.2 in the gate.00:00
kfox11113.0.1 wasn't out at the time.00:01
sbezverkI used 3.0.1 tags00:01
kfox1111we probably should get everything over with 2.0.2 just to keep it working, then upgrade the whole gate together.00:01
sbezverknot sure, if entrypoint is possible with 3.0.1 tag, do not think anybody agrees pushing with 2.0.2 tag00:02
kfox1111we can keep entrypoint with a 3.0.1 tag.00:03
sbezverkok00:03
kfox1111its just the openstack services are 2.0.2 currently.00:03
kfox1111we're using the 3.0.1 kolla-toolbox in the gate, as the 2.0.2 one doesn't have the crudini/jq tools.00:04
sbezverkwhat about "helm serve&" you are not using tiller in this case?00:04
kfox1111helm serve is the local repo.00:04
*** klindgren__ has joined #openstack-kolla00:05
kfox1111shares packages out of ~/.helm/repos/local by default.00:05
jascott1tiller is release state machine00:05
jascott1term used loosely00:05
jascott1so hardcode KOLLA_CONFIG_STRATEGY?00:06
sbezverkinteresting00:06
kfox1111jascott1: yeah. we can reevaluate atht too at some point. would be easy to fix with a sed if we decide to do otherwise.00:07
*** ayoung has quit IRC00:07
jascott1got it00:07
*** sdake_ has quit IRC00:07
kfox1111sbezverk: helm repo's are basically just http servers that share out a dir full of helm tarballs.00:07
kfox1111helm repo add just adds a named url to point to it.00:07
*** williamcaban has joined #openstack-kolla00:08
kfox1111and helm install <reponame>/package looks at the registered url for that package. fetches it and installs it.00:08
sbezverkkfox1111: since sdake is still now show I +2 and +wf00:08
*** klindgren_ has quit IRC00:08
kfox1111sbezverk: which thing?00:08
kfox1111neutron-server?00:08
sbezverkyes00:08
kfox1111yes please.00:09
*** JRobinson_ is now known as JRobinson_afk00:09
jascott1we could serve packages out of github pages. what were you guys thinking?00:09
openstackgerritMerged openstack/kolla-kubernetes: Helmize neutron-server  https://review.openstack.org/40492900:09
*** yingjun has joined #openstack-kolla00:09
sbezverkkfox1111: so for new deployments we will use common-deployment macro00:10
kfox1111jascott1: that would be interesting too. probably not in the main repo, but maybe we could do another one.00:10
kfox1111sbezverk: anything thats been using the other common-deployment lib we can do the same way.00:10
kfox1111should be able to just copy/tweak neutron-server to match the new service.00:11
*** yingjun has quit IRC00:11
*** Pavo has quit IRC00:12
*** williamcaban has quit IRC00:12
*** TxGirlGeek has quit IRC00:12
*** yingjun has joined #openstack-kolla00:13
*** Pavo has joined #openstack-kolla00:13
jascott1where is memcached_image_full set?00:13
jascott1in previous incarnations00:13
openstackgerritJoshua Harlow proposed openstack/kolla: Don't process/queue children not matched  https://review.openstack.org/40046700:14
*** lamt has quit IRC00:14
sbezverkdo you guys have an account at docker hub? so we could dump entrypoint image there until kolla cores decides to push it into official kolla repo?00:14
jascott1we dont have a kolla memcached image right?00:14
kfox1111jascott1: prehelm, in kolla 's global vars.00:14
sbezverkjascott1: we do00:14
kfox1111jascott1: with helm, we have to explicitly add image config bits in helm/all_values.yaml and put a little logic to build a sane default in the template itself.00:15
sbezverkkfox1111: docker hub question ^^00:15
jascott1should it be constructed from the pieces tho? host/repo/image:tag?00:15
jascott1instead of one liner memcached_full?00:15
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Hel-ming openvswitch-vswitchd  https://review.openstack.org/40510700:16
kfox1111sbezverk: I may, but should double check with inc.00:16
kfox1111just for testing though, we can upload it to a different namespace we personally control.00:17
kfox1111I've used my kfox1111 user account to test things at times.00:17
kfox1111do you have a personal account?00:17
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Hel-ming Rabbitmq  https://review.openstack.org/40542200:17
sbezverkkfox1111: nope I do not00:18
sbezverkif it free?00:18
sbezverkI meant is it free?00:18
openstackgerritJoshua Harlow proposed openstack/kolla: Allow for externally managed configuration  https://review.openstack.org/33259000:19
*** adrian_otto has joined #openstack-kolla00:20
jascott1ok so  should construct the image url in tpl like other examples  or leave the full memcached_image_full in  all_values.yaml? I see just the tag version for openswitch-ovsdb. follow that pattern?00:21
sbezverkjascott1: yes00:23
jascott1alrighty00:23
kfox1111sbezverk: its free.00:24
kfox1111if you make a hub account, you get a space for free.00:24
kfox1111so, like, if you sign up for user sbezverk,00:25
kfox1111then you can:00:25
kfox1111docker login00:25
kfox1111enter your login details.00:25
kfox1111docker tag foo_image:whatever sbezverk/foo_image:whatever00:26
kfox1111docker push sbezverk/foo_image:whatever00:26
kfox1111then anywhere else can use sbezverk/foo_image:whatever directly.00:26
sbezverkkfox1111: then at the gate I will just override registry info for that chart..00:26
kfox1111yeah. can set image_full var to that.00:27
kfox1111and that one container will get redirected.00:27
sbezverkI guess to pull image from that repo no authentication required00:28
kfox1111yup. its open.00:28
kfox1111authenticated repo's are where they make their money.00:28
sbezverkcool, will give it a try00:28
*** ayoung has joined #openstack-kolla00:29
*** duonghq_ is now known as duonghq00:29
sbezverkhm, I get this unauthorized: authentication required00:31
kfox1111on the push?00:33
kfox1111or login?00:33
*** srwilker has joined #openstack-kolla00:33
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Helmize openvswitch-agent and l3-agent  https://review.openstack.org/40499900:33
sbezverkon the push00:33
sbezverkI created repo there00:34
kfox1111and the login worked?00:34
kfox1111I see sbezverk/kolla-kubernetes00:35
portdirectkfox1111/sbezverk: gate q for you if you have time - what args are fed into setup_gate.sh? https://github.com/openstack/kolla-kubernetes/blob/master/tools/setup_gate.sh#L5700:35
kfox1111what tag are you trying to push?00:35
kfox1111portdirect: sec... let me dig up the code for you.00:35
portdirectcan wait00:35
sbezverkdocker push docker.io/sbezverk/kolla-kubernetes/centos-source-kubernetes-entrypoint:3.0.100:36
openstackgerritJoshua Harlow proposed openstack/kolla: Consistently use a exception vs sys.exit  https://review.openstack.org/33469000:36
kfox1111portdirect: https://github.com/openstack-infra/project-config/edit/master/jenkins/jobs/kolla-kubernetes.yaml00:37
jascott1eww got a new setup and dont see previous change id in subsequent commit -a00:37
kfox1111portdirect: and then the vars get permutated through: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/projects.yaml#L641600:39
portdirectkfox1111: awesome - cheers dude!00:40
kfox1111portdirect: no problem. the more of us that can grock the gate, the better. :)00:40
kfox1111sbezverk: oh. I see.00:40
kfox1111docker hub is ridgid in its naming.00:41
kfox1111you have your user name, your repo name, and then any tags.00:41
kfox1111no subdirs.00:41
kfox1111so would need: sbezverk/centos-source-kubernetes-entrypoint:3.0.100:42
sbezverkoh ok, let me retag it00:42
sbezverk:-( same thing00:43
kfox1111and you made the centos-source-kubernetes-entrypoint repo?00:43
sbezverkno I made kolla-kubernetes repo00:43
kfox1111need to make one called centos-source-kubernetes-entrypoint, or whatever you want to call it.00:44
kfox1111the kolla   in kolla/centos-source-foo   is an org, but basically the same thing as a user.00:44
kfox1111the centos-source-foo is a repo, and then each push is tagged with a different tag for individual pulling.00:45
kfox1111the tags the stuff after the :00:45
*** JRobinson_afk is now known as JRobinson_00:45
*** awiddersheim has joined #openstack-kolla00:46
kfox1111so each user has a list of repo's. each repo is a bucket of tagged containers (usually intended to be of the same kind of container, just diffreent releases of them)00:46
kfox1111similar to how github does things.00:46
kfox1111users have git repos. git repos have multiple tags in them.00:47
jascott1gerrit question: i dont see my change-id or commit msg from previous commit -a. if I commit -a anyway, I get a new change-id even if I paste the old in there00:47
jascott1will git review fix that up?00:47
kfox1111yeah. you should see the commit id. if not, somethings wrong and it iwll generate a new review.00:47
jascott1ya afraid of that00:47
*** tovin07 has joined #openstack-kolla00:47
kfox1111if you paste it in as the last line though, it hsould do the right thing.00:47
jascott1docs say rerun git review -s, commit and gerrit will fix it up but I dont think thats working00:48
jascott1weird00:48
*** awiddersheim has quit IRC00:50
Pavoanyone here know anything about using custom configs with kolla-ansible?00:51
duonghqmorning guys00:51
portdirectmorning duonghq00:52
duonghqkfox1111, around?00:52
kfox1111duonghq: yeah. whats up?00:53
*** unicell1 has quit IRC00:53
duonghqwhy you put test ceph_workflow in Helmize openvswitch-agent and l3-agent00:53
portdirectjust realised most of my problems are down to having a kolla-ansible running off a sshfs fuse mounts... that'll teach me for thinking I was being clever. Anyone know how to disable selinux context changing in ansible?00:56
*** unicell has joined #openstack-kolla00:56
Pavoportdirect http://docs.ansible.com/ansible/selinux_module.html00:57
kfox1111duonghq: its part of the gate jobs.00:57
kfox1111ensures the new helm stuff works.00:57
*** unicell has quit IRC00:57
kfox1111the change there removes the jinja2 template and adds the helm based one. if the 'check experimental' works after that, then the helm template's good.00:58
*** unicell has joined #openstack-kolla00:58
duonghqkfox1111, I think you should add comment to commit message or put it in separate commit and base your helmize on it?00:58
*** jtriley has joined #openstack-kolla00:59
kfox1111the commits should be atomic. we don't want to commit broken stuff. so doing it in one review proves the commit is good.00:59
kfox1111as for comment in the commit message. we could. but every commit would have the same extra message.01:00
portdirectPavo: I'm running in permissive already - ansible is doing the right thing and trying to change the coentext of files it's playing with - only you cant do that on a fuse mount... Think I'll just need to mirror my setup - where my code is on the boxes I'm running builds on and I edit the files via a remote mount - I was doing it the other wa as it let me PXE boot my build boxen and rebuild them without a 201:00
portdirectnd thought..01:00
duonghqkfox1111, if you upload an ps, and other commit is based on its ps, all commit is green01:01
duonghqagree with on you commits should be atomic01:01
duonghqbut 1 commits should do related works (in semantic,...)01:02
*** tovin07_ has joined #openstack-kolla01:02
kfox1111duonghq: most openstack projects (if not more projects then that) like each commit to have a corrisponding test case, or updat the test case to continue to work.01:03
kfox1111it also helps the review process greatly.01:04
duonghqkfox1111, ok, so can you put some comment on commit msg to reflect the reason you need ceph in your commit?01:04
kfox1111I have limited time to manually checkout a review, and test it. but if  Icee the gate check passed, I'm pretty confident its safe.01:05
kfox1111I can start doing that.01:05
kfox1111for https://review.openstack.org/#/c/404999/, if I do, then it will force a recheck and take 30 more minutes.01:05
duonghqkfox1111, nice01:06
jascott1cant seem to fix my gerrit :(01:06
kfox1111sbezverk: https://review.openstack.org/#/c/404999/ should be ready too.01:06
jascott1re cloned reinstalled got my checkout did commit ammend and still no existing change-id01:06
kfox1111jascott1: pastebin your commit message your trying to do?01:06
kfox1111and git review's installed?01:07
jascott1kfox1111 the problem is I am trying to ammend that memcached PS, but when I commit -a, the message doesnt have prev commit msg or change id like it should01:07
jascott1everything else seems to work, same system I submitted the original PS on01:08
jascott1the hook appears to be in .git/hooks idk wtf is going on01:09
duonghqjascott1, I think should be commit --amend?01:09
kfox1111duonghq: know how  to wrap a line while not making it contain spaces?01:09
kfox1111helms picky about that.01:10
*** zhubingbing has joined #openstack-kolla01:10
jascott1-a is short for ammend01:10
jascott1--ammend01:10
kfox1111how did you pull your patch?01:10
sbezverkjascott1: I usually do commit -a --amend01:10
jascott1from the download01:10
kfox1111got the link to the review handy?01:10
jascott1https://review.openstack.org/#/c/405677/01:11
jascott1checkout with git fetch git://git.openstack.org/openstack/kolla-kubernetes refs/changes/77/405677/1 && git checkout FETCH_HEAD01:11
sbezverkkfox1111: duonghq: I think we should leave that line as is, because that whole thing is an argument passed to helm.01:11
jascott1I think its just something w my local gerrit foobard01:11
jascott1thanks for the help, have to run pickup my daughter, bbiab01:12
kfox1111jascott1: that looks riht to me...01:12
sbezverkstill need to do commit -a --amend when you want to commit changes to workspace01:12
duonghqjascott1, -a is add, not amend01:14
duonghqkfox1111, sbezverk can we put in on env var?01:14
duonghqand build this var before the command?01:14
duonghqwe have repeated args here01:15
sbezverkkfox1111: your call, vars in theory should work01:15
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible: Enable tempest test in gate  https://review.openstack.org/40212201:15
kfox1111sbezverk: yeah. that could work around it.01:16
duonghqI think it make think more clear indeed, not just formating01:16
kfox1111maybe we make a common_vars env var,01:16
kfox1111then put in the stuff like the logger.01:16
kfox1111that doesn't shorten it up by much though.01:18
*** jrist has joined #openstack-kolla01:18
duonghqbut we can build it value-by-value01:18
duonghqit's also more convenient when we want to add more things to it01:18
kfox1111would have to rebuild it over and over. could work though... will take a stab.01:19
sbezverkkfox1111: on the second thought, I think tha way now it is more clear, at least to me.. but it is up tpo you01:19
kfox1111sbezverk: yeah, I'm not very much a fan of 80 char limits. I don't run anything so limited as 80 char terms anywhere in ages.01:20
kfox1111this term window we're talking in is less then half my desktop wide and its over 100.01:21
v1k0d3nsbezverk: hey guys...saw the ping01:21
v1k0d3nwhat's up?01:21
v1k0d3nportdirect: oh hey man01:21
v1k0d3nwhat's up?01:21
kfox1111this is the only one thats so long though. can break it up as an exception.01:21
sbezverkv1k0d3n: the helm issue when connection gets closed01:21
sbezverkdid you get any progress on its root cause?01:22
duonghqkfox1111,  terminal 80-char limited reasons it very out-dated. atm the reason it's make things easier for reader01:22
kfox1111actually,01:23
portdirectsbezverk/v1k0d3n: https://github.com/kubernetes/helm/issues/158901:23
kfox1111this file is riddled with 80 char issues...01:23
kfox1111so I'd say it should be fixed on a ps of its own. fix them all, and then put up a gate check to prevent regressions.01:23
kfox1111or else we're going to be fighting it over and over.01:23
duonghqsure, but more than 110-char is quite long,huh?01:24
duonghqah, ok, upcoming fix it is fine01:24
duonghqshould make thing work first01:24
duonghqsorry01:24
*** dave-mccowan has joined #openstack-kolla01:24
kfox1111duonghq: no, its good. we need some more eyes on reviews. its a good thing really. :)01:26
kfox1111thoughts on what we should put in description?01:27
kfox1111really, its a convention we should come up with.01:27
kfox1111or should we merge and have that discussion while we continue to merge other charts?01:28
duonghqkfox1111, I commented on your ps,01:29
kfox1111k01:29
duonghqI have meeting right now, so see you in about 1hr01:29
kfox1111kk01:30
sbezverkportdirect: thanks but I do not see the error message, in the paste from kfox1111, it is clearly stating "Error: transport is closing"01:30
portdirectak sorry the error message posted in that bug is ther tiller side just as it is crashing01:31
portdirectthe paste from kfox shows the client side01:31
kfox1111sbezverk: thx01:32
portdirectunless I'm getting the wrong end of the stick01:33
sbezverkkfox1111: np, are you going to be around a bit more?01:33
kfox1111portdirect: yeah. waht I was seeing was the helm install side.01:33
kfox1111sbezverk: I can for a few if you need me.01:33
kfox1111whats up?01:33
sbezverkkfox1111: no,  I need to go but Jeffrey4l_ still not up01:34
sbezverkif you see him, can you ask to push entrypoint image to docker? all my attempts to push my image failed :-(01:34
kfox1111k.01:35
sbezverkthanks, good night folks..01:36
kfox1111you tagged the file sbezverk/centos-source-kubernetes-entrypoint:3.0.1 ?01:36
kfox1111s/file/container/01:36
portdirectsbezverk: laters, have a good un01:36
kfox1111and then docker push sbezverk/centos-source-kubernetes-entrypoint:3.0.1 ?01:36
openstackgerritMerged openstack/kolla-kubernetes: Helmize openvswitch-agent and l3-agent  https://review.openstack.org/40499901:36
*** v1k0d3n has quit IRC01:38
*** v1k0d3n has joined #openstack-kolla01:39
*** unicell has quit IRC01:40
*** unicell has joined #openstack-kolla01:40
*** yingjun has quit IRC01:43
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Hel-ming openvswitch-vswitchd  https://review.openstack.org/40510701:44
*** v1k0d3n has quit IRC01:47
*** v1k0d3n has joined #openstack-kolla01:47
v1k0d3nsorry sbezverk my connection got lost01:47
v1k0d3nyeah, portdirect had the link. they're working on it. known issue (i think our responses nudged them along a bit).01:48
*** yingjun has joined #openstack-kolla01:49
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP Hel-ming Rabbitmq  https://review.openstack.org/40542201:51
Jeffrey4l_sbezverk, sup?01:53
Jeffrey4l_hmm. seem gone :(01:54
Jeffrey4l_kfox1111, sup01:54
*** gyx has joined #openstack-kolla01:58
kfox1111Jeffrey4l_: he was hoping we could get a release of kubernetes-entrypoint posted to the kolla docker hub section.01:59
Jeffrey4l_kfox1111, i do not have the account.01:59
kfox1111ah. k.01:59
kfox1111I'll ask sdake then.02:00
Jeffrey4l_ok.02:00
kfox1111thanks02:00
openstackgerritPete Birley proposed openstack/kolla-kubernetes: WIP: Add Development Setup Script for use with Kubernetes Helm  https://review.openstack.org/40572002:00
*** awiddersheim has joined #openstack-kolla02:02
*** v1k0d3n has quit IRC02:05
Pavohow are you guys tonight?02:09
*** williamcaban has joined #openstack-kolla02:09
Pavohows the kolla-k8s with helm coming along?02:10
duonghqPavo, we are moving to implement Helm microservice (upper layer of layer 3 in Ryan's spec)02:13
*** williamcaban has quit IRC02:13
duonghqhope that I can upload some ps when the week end02:14
zhubingbinghello guys02:14
*** portdirect has quit IRC02:14
*** portdirect has joined #openstack-kolla02:14
duonghqhi zhubingbing02:14
duonghqhave a nice week?02:15
Pavowell found an issue today with kolla-ansible when I did a yum -y update02:15
zhubingbingyeah02:15
Pavoand needing some help with understanding how custom configs are done with kolla-ansible02:15
duonghqPavo, just ask02:15
*** adrian_otto has quit IRC02:16
Pavoso I understand that you have to have /etc/kolla/config/<< service name >>/<< config file >>02:17
Pavoso would /etc/kolla/config/neutron/ml2_conf.ini work or does it have to be like /etc/kolla/config/neutron/neutron-server/ml2_conf.ini02:18
Pavoand inside the custom config do you have to have all the settings or can you just have the settings you want to add that aren't default?02:19
*** jmccarthy has quit IRC02:19
duonghqPavo, just your custom settings02:20
duonghqand it will be merged to default one02:20
*** dave-mccowan has quit IRC02:20
Pavothen I guess I am doing them completely wrong then02:20
*** jmccarthy has joined #openstack-kolla02:20
duonghq(you can think it's layered as Docker image)02:20
Pavobecause I tried just adding my custom settings and thats all that got put into the ocnfigs on reconfigure02:21
*** pbourke_ has quit IRC02:21
*** pbourke_ has joined #openstack-kolla02:22
Pavoso does it only have to be the parent service component or does it have to be the parent service component and the sub service component as the directory structure?02:22
Pavowhen making the config?02:22
Pavolike /etc/kolla/config/neutron/ml2_conf.ini work or does it have to be like /etc/kolla/config/neutron/neutron-server/ml2_conf.ini02:22
*** unicell has quit IRC02:26
openstackgerritjianyi proposed openstack/kolla-ansible: Enable senlin dashboard when enable_senlin is yes  https://review.openstack.org/40507802:26
awiddersheimduonghq: this doesn't make much sense to me as is02:26
*** v1k0d3n has joined #openstack-kolla02:26
awiddersheimhttps://review.openstack.org/#/c/404092/02:26
awiddersheimbut there is mention of a follow up02:26
awiddersheimis there one yet?02:27
Pavoanyone know the answer to that question?02:29
*** unicell has joined #openstack-kolla02:29
awiddersheimusing heat as an example02:29
awiddersheimhttps://github.com/openstack/kolla-ansible/blob/master/ansible/roles/heat/tasks/config.yml#L54-L5702:29
awiddersheimfeel like `with_items` shouls really be `with_first_found`02:29
*** dave-mccowan has joined #openstack-kolla02:30
awiddersheimand remove the task that checks if `policy.json` exists and the conditional on the task itself02:30
*** v1k0d3n has quit IRC02:30
duonghqawiddersheim, not any follow up yet,02:30
Pavoawiddersheim it looks like it would work to me02:30
duonghqawiddersheim,  can you fix that?02:31
awiddersheimPavo: it just doesn't make any sense as is02:31
awiddersheimchecking for this single file https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/heat/tasks/config.yml#L4702:31
awiddersheimthen later copying each of these02:32
Pavojust the with_items section?02:32
awiddersheimhttps://github.com/openstack/kolla-ansible/blob/master/ansible/roles/heat/tasks/config.yml#L54-L5702:32
awiddersheimonly if that file exists02:32
awiddersheimhttps://github.com/openstack/kolla-ansible/blob/master/ansible/roles/heat/tasks/config.yml#L54-L5702:32
awiddersheimduonghq: yes I can fix02:32
Pavoyeah that kind of seems redundant to me02:32
awiddersheimI am looking at some other problems02:32
*** v1k0d3n has joined #openstack-kolla02:32
awiddersheimwith policy files02:32
awiddersheimspecifically around horizon02:32
duonghqawiddersheim, I don't have much atm, I'm very appreciate if you can help me make more beautiful02:33
awiddersheimwill do02:33
duonghqPavo, iirc, it should be /etc/kolla/config/neutron/neutron-server.conf02:33
*** unicell has quit IRC02:33
duonghqPavo, for your question02:33
Pavohuh02:34
duonghqawiddersheim, timing is tough for me atm, sorry guy02:34
Pavohow does ml2 settings go into neutron-server.conf?02:34
Pavoguess I'll just have to try both and see which one works02:35
*** unicell has joined #openstack-kolla02:35
*** hfu has joined #openstack-kolla02:35
*** kjelly has joined #openstack-kolla02:39
*** prameswar has joined #openstack-kolla02:45
*** srwilker has quit IRC02:47
*** Jeffrey4l_ has quit IRC02:47
*** yuanying_ has quit IRC02:48
duonghqPavo, sorry, my fault02:49
duonghqPavo, around02:50
duonghqPavo, you can see it https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/neutron/tasks/config.yml#L9302:50
*** Jeffrey4l_ has joined #openstack-kolla02:50
Pavook so how does that only merge custom settings into default template?02:51
duonghqPavo, what do you mean?02:52
*** yuanying has joined #openstack-kolla02:52
Pavoseems like to me it would copy default template first, if there is a custom config it would over write the default template02:52
Pavosecond02:52
openstackgerritZeyu Zhu proposed openstack/kolla: Ansible2.0 changes: ansible_ssh_user to ansible_user  https://review.openstack.org/40575202:54
duonghqPavo, it merges02:54
*** absubram has joined #openstack-kolla02:54
duonghqPavo, your method: https://github.com/openstack/kolla-ansible/blob/master/ansible/action_plugins/merge_configs.py02:55
*** absubram_ has joined #openstack-kolla02:56
Pavook so "{{ node_custom_config }}/neutron/ml2_conf.ini" is the standard across the board and "{{ node_custom_config }}/neutron/{{ inventory_hostname }}/ml2_conf.ini" is for specific node correct?02:57
duonghqyup02:58
*** coolsvap has joined #openstack-kolla02:58
Pavook I'll try adding only a few settings in my custom config tomorrow and see how it goes02:59
*** absubram has quit IRC02:59
*** absubram_ is now known as absubram02:59
Pavothanks for explaining duonghq02:59
duonghqPavo, my pleasure03:00
*** v1k0d3n has quit IRC03:08
*** v1k0d3n has joined #openstack-kolla03:08
*** v1k0d3n has quit IRC03:10
*** williamcaban has joined #openstack-kolla03:10
*** v1k0d3n has joined #openstack-kolla03:11
*** prameswar has quit IRC03:13
*** williamcaban has quit IRC03:15
*** v1k0d3n has quit IRC03:18
*** saneax-_-|AFK is now known as saneax03:27
*** srwilker has joined #openstack-kolla03:28
*** dave-mccowan has quit IRC03:28
*** v1k0d3n has joined #openstack-kolla03:29
*** unicell has quit IRC03:30
*** elynn_ has joined #openstack-kolla03:30
openstackgerritjianyi proposed openstack/kolla: Install senlin dashboard into horizon image  https://review.openstack.org/40507003:34
*** yuanying has quit IRC03:44
*** prameswar has joined #openstack-kolla03:47
*** DungHTD has joined #openstack-kolla03:49
*** CBR09 has joined #openstack-kolla03:49
*** CBR09 has left #openstack-kolla03:50
*** v1k0d3n has quit IRC03:56
*** srwilkers_ has joined #openstack-kolla03:57
srwilkers_evening03:57
*** saneax is now known as saneax-_-|AFK03:58
*** prameswar has quit IRC03:59
openstackgerritEthan Lynn proposed openstack/kolla-kubernetes: Use curl instead of wget in setup-kubectl.sh  https://review.openstack.org/40578503:59
*** Marcellin__ has quit IRC04:08
duonghqevening srwilkers_04:11
*** williamcaban has joined #openstack-kolla04:12
*** Pavo has quit IRC04:13
*** v1k0d3n has joined #openstack-kolla04:17
*** Pavo has joined #openstack-kolla04:18
*** adrian_otto has joined #openstack-kolla04:20
srwilkers_sup v1k0d3n04:21
*** williamcaban has quit IRC04:22
openstackgerritZeyu Zhu proposed openstack/kolla: Ansible2.0 changes: ansible_ssh_user to ansible_user.  https://review.openstack.org/40575204:22
openstackgerritJustin Scott proposed openstack/kolla-kubernetes: WIP Helm-ize memcached  https://review.openstack.org/40567704:30
jascott1wow what a total fscking idjut I am04:30
jascott1PSA: git commit -a != git commit --amend04:31
*** v1k0d3n has quit IRC04:33
srwilkers_i feel your pain jascott104:33
srwilkers_jascott1: i too have made the same mistake04:33
jascott1just glad I took a break and came back and then saw the light :)04:35
jascott1was about to nuke my dev setup cause gerrit seemed irrevocably broken :|04:36
srwilkers_D:04:36
*** srwilkers_ has quit IRC04:36
jascott1pilot error04:36
*** elynn_ has quit IRC04:36
sbezverkJeffrey4l_: ping04:40
Jeffrey4l_sbezverk, pong04:41
*** mdnadeem has joined #openstack-kolla04:41
sbezverkJeffrey4l_: current kolla master has one docker image which is needed for kolla-kubernetes gates. it is kubernetes-entrypoint. Is there any chance you could push it to docker hub with tag 3.0.1?04:42
Jeffrey4l_sbezverk, i do not have the account. you may need ask sdake or inc0 for this.04:43
sbezverkJeffrey4l_: got it thank you, I will try to get in touch with sdake..04:44
Jeffrey4l_ok.04:44
*** JRobinson_ is now known as JRobinson_afk04:54
*** v1k0d3n has joined #openstack-kolla04:55
*** v1k0d3n has quit IRC05:10
*** elynn has joined #openstack-kolla05:16
*** williamcaban has joined #openstack-kolla05:18
*** elynn has quit IRC05:21
*** fragatina has joined #openstack-kolla05:21
*** elynn has joined #openstack-kolla05:21
*** williamcaban has quit IRC05:25
*** fragatina has quit IRC05:33
*** fragatina has joined #openstack-kolla05:33
*** fragatina has quit IRC05:34
*** srwilker has quit IRC05:37
*** fragatina has joined #openstack-kolla05:38
*** fragatina has joined #openstack-kolla05:38
*** fragatina has joined #openstack-kolla05:39
*** fragatina has quit IRC05:40
*** fragatina has joined #openstack-kolla05:40
*** JRobinson_afk is now known as JRobinson_05:40
*** fragatina has quit IRC05:42
*** fragatina has joined #openstack-kolla05:43
*** gyx has left #openstack-kolla05:47
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible: Use mariadb.cnf for mariadb custom file name  https://review.openstack.org/39903805:52
*** unicell has joined #openstack-kolla05:59
openstackgerritzhubingbing proposed openstack/kolla: Install designate dashboard into horizon image  https://review.openstack.org/40593306:07
*** Jeffrey4l_ has quit IRC06:12
*** Jeffrey4l has joined #openstack-kolla06:12
*** Pavo has quit IRC06:13
openstackgerritZeyu Zhu proposed openstack/kolla: Ansible2.0 changes: ansible_ssh_user to ansible_user  https://review.openstack.org/40575206:13
*** prameswar has joined #openstack-kolla06:15
*** Pavo has joined #openstack-kolla06:18
*** adrian_otto has quit IRC06:19
*** DungHTD has quit IRC06:21
openstackgerritzhubingbing proposed openstack/kolla-ansible: Enable trove dashboard when enable_trove is yes  https://review.openstack.org/40594206:32
*** openstackgerrit has quit IRC06:33
*** openstackgerrit has joined #openstack-kolla06:34
openstackgerritZeyu Zhu proposed openstack/kolla: Ansible2.0 changes: ansible_ssh_user to ansible_user  https://review.openstack.org/40575206:34
*** senk has joined #openstack-kolla06:41
*** v1k0d3n has joined #openstack-kolla06:50
*** v1k0d3n has quit IRC06:57
openstackgerritLi Yingjun proposed openstack/kolla: Install searchlight-ui to horizon  https://review.openstack.org/40595606:57
openstackgerritJeffrey Zhang proposed openstack/kolla: Add qemu-img into glance api image  https://review.openstack.org/40546807:00
openstackgerritLi Yingjun proposed openstack/kolla: Install searchlight-ui to horizon  https://review.openstack.org/40595607:02
*** msimonin has joined #openstack-kolla07:02
openstackgerritLi Yingjun proposed openstack/kolla-ansible: Enable searchlight ui when searchlight enabled  https://review.openstack.org/40595707:05
*** jrist has quit IRC07:14
*** jrist has joined #openstack-kolla07:15
*** ram__ has quit IRC07:18
openstackgerritzhubingbing proposed openstack/kolla-ansible: Enable designate dashboard when enable_designate is yes  https://review.openstack.org/40594207:21
*** williamcaban has joined #openstack-kolla07:22
*** DTadrzak has joined #openstack-kolla07:22
openstackgerritLi Yingjun proposed openstack/kolla-ansible: Enable cloudkitty dashboard when enable_cloudkitty is yes  https://review.openstack.org/40596407:23
*** williamcaban has quit IRC07:26
*** prameswar has quit IRC07:27
*** mewald has joined #openstack-kolla07:29
openstackgerritzhubingbing proposed openstack/kolla: add os_gnocchi_apache_log.lua in heka  https://review.openstack.org/38459907:29
openstackgerritzhubingbing proposed openstack/kolla: add aodh os_aodh_apache_log.lua in heka  https://review.openstack.org/38460207:31
*** saneax-_-|AFK is now known as saneax07:43
*** absubram has quit IRC07:50
openstackgerritMerged openstack/kolla: Install neutron-lbaas plugin in neutron-server container  https://review.openstack.org/32948707:51
*** mkoderer has joined #openstack-kolla07:56
*** hfu has quit IRC07:56
openstackgerritjianyi proposed openstack/kolla-ansible: Enable senlin dashboard when enable_senlin is yes  https://review.openstack.org/40507808:01
openstackgerritjianyi proposed openstack/kolla-ansible: Enable senlin dashboard when enable_senlin is yes  https://review.openstack.org/40507808:02
*** openstackgerrit has quit IRC08:03
*** magicboiz has quit IRC08:04
*** matrohon has joined #openstack-kolla08:12
*** Pavo has quit IRC08:13
*** Pavo has joined #openstack-kolla08:18
*** Narayan has joined #openstack-kolla08:22
*** williamcaban has joined #openstack-kolla08:23
NarayanI am using kolla to deploy openstack. how to restrict a package version on target machines using kolla.08:26
*** williamcaban has quit IRC08:28
*** magicboiz has joined #openstack-kolla08:30
*** Serlex has joined #openstack-kolla08:31
*** openstackgerrit has joined #openstack-kolla08:34
openstackgerritJack Ning proposed openstack/kolla-ansible: Deploy openstack with specified version  https://review.openstack.org/40599208:34
*** egonzalez90 has joined #openstack-kolla08:35
*** unicell1 has joined #openstack-kolla08:42
*** unicell has quit IRC08:42
*** jascott1_ has joined #openstack-kolla08:45
*** jascott1 has quit IRC08:46
*** JRobinson_ has quit IRC08:47
*** magicboiz has quit IRC08:49
openstackgerritjianyi proposed openstack/kolla: Install senlin dashboard into horizon image  https://review.openstack.org/40507008:51
*** shardy has joined #openstack-kolla08:58
*** shardy has quit IRC08:58
*** shardy has joined #openstack-kolla08:59
*** zhubingbing has quit IRC09:02
*** openstackgerrit has quit IRC09:03
*** openstackgerrit has joined #openstack-kolla09:05
openstackgerritjianyi proposed openstack/kolla: Install senlin dashboard into horizon image  https://review.openstack.org/40507009:05
openstackgerritJack Ning proposed openstack/kolla-ansible: Added docker image tag parameter in kolla-ansible  https://review.openstack.org/40599209:06
openstackgerritjianyi proposed openstack/kolla: Install senlin dashboard into horizon image  https://review.openstack.org/40507009:08
*** sdake has joined #openstack-kolla09:11
*** matrohon has quit IRC09:14
*** hieulq has joined #openstack-kolla09:15
*** zhugaoxiao has joined #openstack-kolla09:16
duonghqsdake, ping09:21
*** msimonin has quit IRC09:21
*** msimonin has joined #openstack-kolla09:23
*** williamcaban has joined #openstack-kolla09:24
*** Serlex has quit IRC09:25
sdakemorning peeps09:26
sdakeon crazy schedule09:27
sdakechilren wake me up at 3am daily09:27
openstackgerritJack Ning proposed openstack/kolla-ansible: Fix can't generate heka-custom.toml on multi-nodes  https://review.openstack.org/40601609:27
sdakesup duonghq09:27
sdakeyou think they would get the hint abut the closed door09:27
sdakeduonghq my brain is not warmed up so I hope your quesiton is easy09:28
jascott1_heheh09:28
sdakejascott1_ i see your on a crazy schedule too :)09:28
jascott1_bout to crash... dang physical office i have to goto in the morn09:28
*** williamcaban has quit IRC09:28
duonghqseem that everytime I ping you I ask something, :P, just a simple question, do we need mechanism to gather all customization block and put in some place? (w/ some docs)09:29
jascott1_ive going to sleep to videos about learning Rust.. I go right out :)09:29
sdakeduonghq that is a question for inc009:29
sdakeor possibly pbourke_ could answer09:29
sdakeJeffrey4l ping09:29
Jeffrey4lsdake, pong09:30
jascott1_sdake, all have a great consciousness cycle!09:30
*** jascott1_ is now known as jascott1_zZz09:31
duonghqsdake, ok I'll ask when I see them09:33
sdakejascott1_zZz groan09:33
duonghqanw, what kind of hint about the closed door which you was asked?09:33
sdakeduonghq oh my door to my bedroom, you think the kids would ge tthe hint "DND"09:34
*** elynn has quit IRC09:34
*** matrohon has joined #openstack-kolla09:34
duonghqoh09:34
*** bjolo has quit IRC09:36
zhangshuaihttp://paste.openstack.org/show/591220/ , pls have a look , 192.168.98.254 is my host, 192.68.98.79 is the docker about karbor-api service, is it right about all IP addr?09:37
openstackgerritJack Ning proposed openstack/kolla-ansible: Fix can't generate heka-custom.toml on multi-nodes  https://review.openstack.org/40601609:39
pbourke_duonghq: hi what was the question?09:49
*** zhugaoxiao has quit IRC09:54
*** jascott1_zZz has quit IRC09:54
*** tovin07 has quit IRC09:58
*** zhangshuai has quit IRC09:58
*** zhangshuai has joined #openstack-kolla10:00
duonghqpbourke_, around?10:00
pbourke_morning duonghq10:00
duonghqmorning pbourke_10:00
duonghqmy question is: do we need mechanism to gather all customization block and put in some place? (w/ some docs)10:00
openstackgerritLi Yingjun proposed openstack/kolla: Install searchlight-ui to horizon  https://review.openstack.org/40595610:01
*** mkoderer has quit IRC10:03
openstackgerritLi Yingjun proposed openstack/kolla-ansible: Enable searchlight ui when searchlight enabled  https://review.openstack.org/40595710:04
duonghqpbourke_, iirc, you live in Ireland?10:04
pbourke_duonghq: I do :)10:04
pbourke_duonghq: wrt gathering blocks, we could do that I guess10:05
*** yingjun has quit IRC10:05
pbourke_I often find if I want to customise a specific piece of functionality I just look in the Dockerfile10:05
pbourke_if there's a block there, great, if not I look at if I need to add one10:05
duonghqIt's hard for pure ops?10:06
pbourke_so personally I would check there before docs which may be out of date anyway10:06
pbourke_if you wanted to write something like that I would not say no10:06
duonghqit's better if we have some doc generation mechanism for keep it up-to-date?10:06
*** strigazi_AFK is now known as strigazi10:06
pbourke_it would be nice sure10:06
duonghqso I'll jot down a bp for note about the idea10:07
*** ram_ has joined #openstack-kolla10:07
duonghqthank you pbourke_10:07
*** Pavo has quit IRC10:13
duonghqpbourke_, FYI: https://blueprints.launchpad.net/kolla/+spec/extract-customisation-block10:15
pbourke_duonghq: thanks, marked as approved10:17
*** matrohon has quit IRC10:18
*** Pavo has joined #openstack-kolla10:18
duonghqpbourke_, thanks, I think it's suitable for o-3? with medium priority?10:19
duonghqor low for this cycle?10:20
*** portdirect is now known as portdirect_away_10:20
duonghqdo not many work here, imo10:20
*** tovin07_ has quit IRC10:21
*** williamcaban has joined #openstack-kolla10:25
*** rstarmer has joined #openstack-kolla10:25
*** slagle has quit IRC10:28
*** williamcaban has quit IRC10:29
*** slagle has joined #openstack-kolla10:29
pbourke_i see it as a nice to have10:31
*** prameswar has joined #openstack-kolla10:31
pbourke_wishlist priority10:31
duonghqpbourke_, the lowest priority is low10:32
pbourke_that's fine10:33
duonghqthanks10:33
pbourke_whatever you like :)10:33
*** pbourke_ is now known as pbourke10:33
*** Serlex has joined #openstack-kolla10:33
*** jascott1_zZz has joined #openstack-kolla10:55
*** magicboiz has joined #openstack-kolla10:57
duonghqbye guys10:57
*** duonghq has quit IRC10:57
*** jascott1_zZz has quit IRC10:59
*** hieulq has quit IRC11:04
*** mliima has joined #openstack-kolla11:09
SamYapleyea. i bet pbourke _would_ know what the lowest priority was11:20
*** matrohon has joined #openstack-kolla11:20
*** harbor has joined #openstack-kolla11:23
*** harbor is now known as pd_away11:23
*** pd_away is now known as pordirect11:24
pordirectmornin' all :)11:24
*** msimonin has quit IRC11:24
jmccarthyMorning !11:25
*** Bico_Fino has joined #openstack-kolla11:25
*** williamcaban has joined #openstack-kolla11:26
pordirectmariso: with difficulty yes - but the project is undergoing a major rework currently - we hope that by about the 20th the user experience will be getting toward *AWESOME* but currently I would describe it as anything but11:27
sdakesup jmccarthy portdirect_away_11:27
sdakehmm confused by that - wonder if my client lost messages11:28
sdakewierd, my tab completion isn't working for you portdirect11:29
*** msimonin has joined #openstack-kolla11:29
rstarmerhas anyone been testing the lbaas/fwaas functionality?  Seems that the neutron server container is getting created but is missing plugins to enable.11:29
sdakeyet my client says your connected - and it would typically highlight your name11:29
sdakeanyway if yourr there yo :)11:29
sdakerstarmer not much11:29
sdakerstarmer i see reviews going by making it happen now11:29
sdakerstarmer i haven't reviewed them11:30
mliimamorning guys11:30
rstarmerseems like the config aspect is "ok", but neutron server blows up "can't find plugin"11:30
*** Bico_Fino has quit IRC11:30
pbourkerstarmer: yes11:30
sdakerstarmer this implies to me that in whatevery ou got - it doesn't got it :)11:30
pbourkerstarmer: should work11:30
*** williamcaban has quit IRC11:30
rstarmersdake: yeah... :(11:30
sdakepbourke right works in master11:30
pbourkeyes11:30
sdakepbourke but not in anything rstarmer is using11:30
rstarmerpbourke: was using stable/newton11:30
pbourkerstarmer: probably some backports needed11:31
sdakeya definately not in newton11:31
rstarmeror rather, trying stable/newton11:31
pbourkei'll take a look11:31
sdakeand we dont backport features11:31
pbourkeactually11:31
pbourkeyes was about to say :)11:31
sdakeso we would have to evaluate if that is a feature or a defect11:31
rstarmeris it a feature, or a bug?11:31
pbourkeyou could still enable it via template-overrides in newton11:31
sdakei'm not really sure11:31
pbourkefeature11:31
sdakei could se eit has a bug too11:31
*** pordirect has quit IRC11:31
rstarmerwell, regardless, if there's a way to override, that'd be fine by me, I just need it to work...11:32
pbourkerstarmer: http://docs.openstack.org/developer/kolla/image-building.html#plugin-functionality11:32
sdakebut whoever makign the work i think makes that call :)11:32
*** harbor has joined #openstack-kolla11:32
*** harbor is now known as pordirect11:32
sdakepbourke yo uthink that iwll work for newton?11:32
*** pordirect is now known as portdirect_11:32
pbourkesdake: yes11:32
sdakeas a workaround?11:32
pbourkeall we're doing in ocata is making it easier11:33
portdirect_sup sdake11:33
sdakesweet!11:33
*** msimonin has quit IRC11:33
sdakei didn't know that11:33
sdakei am working really hard on other things paul atm - having a tough time staying on top of kolla-ansible reviews11:33
pbourkealso a nice thing Jeffrey4l has done for ocata is to make the dashboard enable/disable dynamically11:33
sdakebut trying to help where i can11:33
rstarmercool, on all accounts.11:34
pbourkesdake: cant stay on it all :)11:34
sdakepbourke right thats why we are a team :)11:34
rstarmerI'll see if I can find where the lbaas plugin comes from (though i thought it was a default part of the neutron service, clearly not any longer), and see if I can get the override to work.11:34
*** bjolo has joined #openstack-kolla11:34
rstarmerwill report back later :)11:34
rstarmerbut now, sleep is needed.11:34
rstarmerthanks for the pointer(s)11:35
sdakerstarmer dude i was there 10 hrs ago and got 10 hrs :) enjoy :)11:35
rstarmersdake: Well, 3am seems to have become my normal EOD, so this isn't too bad...11:35
*** Bico_Fino has joined #openstack-kolla11:37
*** portdirect_ is now known as portdirect11:38
sdakeya i had a weirdly long day yesterday11:38
sdakeit sort of ended at 6pm11:38
*** coolsvap has quit IRC11:39
sdakerstarmer this is actually the start of my day11:39
sdakeany night ;)11:40
sdakeanywayway night I mean ;)11:40
sdakegoodnight11:40
rstarmergn :)11:40
*** rstarmer has quit IRC11:40
portdirectsdake: hows your selinux? I'm trying to get all like super optimal and as usual this is kicking in: https://xkcd.com/1319/, I'm trying keep my source on my local workstation and run builds etc on a remote server via a mount (currently sshfs) - works fine apart from ansible wanting to get the selinux context right - so running kolla genconfig fails? Know of any way round that?11:44
*** eaguilar has joined #openstack-kolla11:44
*** Jeffrey4l has quit IRC11:44
sdakeportdirect i dont run selinux11:45
sdakeportdirect kolla works in the gate11:45
sdakewith selinux11:45
sdakecompletely enabled11:45
sdakethe difficulty is completely setting tags and whatnot on yoru system11:45
sdakeespecially if you use tools like su11:45
sdakeeverything has to go thorugh sudo i think11:45
sdakeor if you runas the root user for example11:45
sdakethat breaks the sysstem11:46
sdakei am not sure about su11:46
sdakebut definately root - breaks the system11:46
sdakeand i dont know how to fix it11:46
sdakei know it can be fixed  with tools11:46
sdakei dont totally get how its fixed on your host if it gets busted11:46
sdakeif you did a gate type install 9totally fresh) it would work - because that iswhat the gate does11:47
*** jtriley has quit IRC11:48
sdakegetting the contexts right nad keeping them that wya are not trivial things11:48
portdirectyeah - the gat type stuff has been working fine with it in enforcing (pretty impressive, otb) but it's the lack of selinux context on fuse mounts thats causing me headakes11:48
portdirectI supect the answer is as simple as, turn it off, and get back on with life :)11:49
sdakei think its probably easy for an operator that has bought into the selinux model to keep track of11:49
sdakebut if your not an operator that has bought into selinux, then - well its not really a good diea;)11:49
sdakeportdirect yup thats what I'd do :)11:49
sdakesorry last sentence poorlty worded if your an operator that has not bought into se linux11:50
sdakehas NOT bought sorry  :)11:50
portdirectlol  - I never got a copy of Dan Walshes infamous SeLinux coloring book, but I've been a convert the last few years now11:51
sdakeya - i cant run it in dev11:52
sdakeit gets in the way11:52
sdakein prod, id rpobablly ru nit11:52
sdakeso we make iit work11:52
sdakebut its hard to dev with it on11:52
portdirectok: brb, just rebooting to make my systems less secure11:55
sdakeyou can do it without a reboot11:55
sdakesudo setenforce 011:55
*** jascott1_zZz has joined #openstack-kolla11:56
portdirectstill getting errors in permissive - I thought that should fix it as well11:56
sdakemy main workstation rusn selinux tho :)11:56
sdakegov could prob get in to it11:57
sdakebut i think its unlikely anyone else could11:57
*** ccesario has quit IRC11:57
sdakeunless they were professionals11:57
*** Jeffrey4l has joined #openstack-kolla11:58
sdakei have machines I trust ,and I have machines i dont trust11:58
sdakebut the machinesi  dont trust are used by others11:58
portdirectsdake: summary at bottom of page 2: https://www.usenix.org/system/files/1401_08-12_mickens.pdf11:58
*** palexster has quit IRC11:58
*** jascott1_zZz has quit IRC12:00
sdakeportdirect reading article12:00
sdakei knwo mickens12:00
sdakefrom long ago12:00
sdakearticle looks interesting so far12:01
berendtdoes it makes sense to use something like serverspec for our CI?12:01
sdakesort of knwo of him12:01
sdakei was in a security focused area very eary in my university :)12:01
berendtCan somebody please merge https://review.openstack.org/#/c/404822/12:01
sdakei was exploring security - rather then fixing it12:01
portdirectyeah, your work at sun was interesting12:02
sdakelooking back it was the wrong appproach12:02
sdakewow how hte hell doy ou knwo  about htat port?12:02
sdakei think fixing it is better then exploring it12:03
sdakebut i didn't know nay better ;)12:03
sdakei was interested in it12:03
sdakeand nobody around to guide me :)12:03
portdirectdrinking brandy in barcelona12:03
*** palexster has joined #openstack-kolla12:03
sdakethat musthave  been some good brandy12:03
sdakei dont remember that ;)12:04
sdakeanyway reading article12:04
*** Narayan has quit IRC12:05
*** rhallisey has joined #openstack-kolla12:05
*** eaguilar has quit IRC12:09
*** ccesario has joined #openstack-kolla12:10
*** portdirect has quit IRC12:11
*** shardy is now known as shardy_lunch12:12
sdakewow just got to the MOSSAD threat model12:12
sdakehe is right on there12:12
sdakeyup i dont really work on security as a researcher12:12
*** shardy_lunch is now known as shardy12:12
sdakeits not something I do now12:12
sdakeIts something I did in the past12:13
*** Pavo has quit IRC12:13
sdakei don't know how to remember passwords12:13
sdakeits too damn hard12:13
*** eaguilar has joined #openstack-kolla12:13
sdakei agree the pssword problem needs to be solved12:13
berendtsdake: have you tried diceware?12:13
sdakei use lastpass unfortunately12:14
sdakeits a tradeoff for me12:14
berendtdiceware is pretty cool to generate passwords that a human can remember12:14
sdaketrust that lastpass can run a fortress12:14
*** shardy is now known as shardy_lunch12:14
berendthttp://world.std.com/~reinhold/diceware.html12:15
sdakethe problem is that the passwords need to be different on every ddamn website on teh planet12:15
sdakei got over 500 passwords12:15
sdakepossibly more12:15
sdakemore then i can possibly remember12:15
berendtreduce your number of accounts :)12:15
sdakei'd love to12:15
sdakeconsilidation is a solution12:15
sdakei dont know how ot really do that12:16
sdakethis guy told me his gmail got broken into12:16
sdakelastpass model is that each website needs a different SPRNGed generated password12:17
sdakeanyway finishign article :)12:17
sdakemaybe i'll learn something useful :)12:17
*** Pavo has joined #openstack-kolla12:17
*** jascott1_zZz has joined #openstack-kolla12:19
sdakei do have to say not everything is in lastpass12:20
*** portdirect has joined #openstack-kolla12:22
*** jascott1_zZz has quit IRC12:23
*** eaguilar_ has joined #openstack-kolla12:29
sdakecognitive overhead12:29
sdakecool term12:29
sdakefirst time i've seen it used12:29
*** eaguilar has quit IRC12:30
*** fragatina has quit IRC12:32
*** fragatina has joined #openstack-kolla12:32
*** duonghq has joined #openstack-kolla12:33
sdakeya there is cognitive overhead with selinux as a dev - i think ops deal with it12:35
sdakeif they want to :)12:36
*** Bico_Fino has quit IRC12:36
*** mewald has left #openstack-kolla12:36
portdirectyeah - it's not overload (just), but boy does it make you have to take a step back and think12:37
sdakethe threat he presents for gmail applies to websites quite well12:38
sdakeor any type of web service12:38
sdakepersonal machines are under another threat12:38
sdakeand thatis that they contain information you may not want others to have12:38
sdakeespecially since I let other people use my gear ;)12:39
sdakeit would be easy for "organized crime' for example to obtian information on personal machines12:41
sdakeanother problem is other websites do get password dumped12:42
sdakehappens all the time12:42
sdakeits really disruptive to my life, because my accounts get reset12:43
sdakefor web services - his article is completely fantastic12:43
sdakeit leaves unadressed other htings, but he says "the one thing I want for christmas"12:43
*** senk has quit IRC12:51
*** eaguilar has joined #openstack-kolla12:53
*** eaguilar has quit IRC12:55
*** hvlad has joined #openstack-kolla12:55
*** eaguilar_ has quit IRC12:55
*** jrist has quit IRC12:59
*** sdake has quit IRC13:05
*** eaguilar has joined #openstack-kolla13:06
ram_Hi. I just followed http://docs.openstack.org/developer/kolla/quickstart.html to deploy kolla . I opened horizon. But default what username and password will be used to login Horizon.13:08
duonghqram_, did you run init_runonce and post-deploy?13:08
ram_duonghq: I ran post-deploy . and when I ran  sudo kolla/tools/init-runonce   it was giving command not found like that.13:12
ram_duonghq: Hi. sudo: kolla/tools/init-runonce: command not found13:12
duonghqcan you cd in to kolla/tools?13:13
*** msimonin has joined #openstack-kolla13:13
openstackgerritMerged openstack/kolla-ansible: Enable cloudkitty ui when enable_cloudkitty is yes  https://review.openstack.org/40352013:15
*** mdnadeem has quit IRC13:15
openstackgerritMerged openstack/kolla-ansible: Enable trove dashboard when enable_trove is yes  https://review.openstack.org/40509013:15
ram_duonghq: Yes. Still it is giving sudo: init-runonce: command not found13:16
duonghqsudo ./init-runonce13:16
duonghqcomment not found?13:17
openstackgerritMerged openstack/kolla-ansible: Add missing pull task for neutron-vpnaas-agent  https://review.openstack.org/40124013:17
duonghq(no colon)13:17
openstackgerritMerged openstack/kolla-ansible: Fix barbican upgrade permission issue  https://review.openstack.org/40459513:17
*** lamt has joined #openstack-kolla13:17
*** DTadrzak has quit IRC13:18
ram_duonghq: I ran as vedams@kolla1:~/kolla/tools$ sudo ./init-runonce.  output:  sudo: ./init-runonce: command not found13:18
duonghqram_, moment13:20
duonghqram_,13:20
duonghqyou should run in kolla-ansible13:20
duonghqI guess that you use master?13:20
duonghqram_, document is not updated13:21
*** dave-mccowan has joined #openstack-kolla13:21
ram_duonghq: Yes. It is  master13:21
duonghqram_, it's in kolla-ansible13:22
ram_duonghq: where  koola-ansible located?13:23
*** senk has joined #openstack-kolla13:23
duonghqram_, it's in its own repository13:24
duonghqram_, http://git.openstack.org/cgit/openstack/kolla-ansible/13:24
duonghqhere13:24
ram_duonghq: Actually, I cloned git clone https://git.openstack.org/openstack/kolla13:26
*** williamcaban has joined #openstack-kolla13:27
ram_duonghq: I followed http://docs.openstack.org/developer/kolla/quickstart.html. Is there any new doc apart from this.13:30
*** krtaylor has quit IRC13:31
*** magicboiz has quit IRC13:31
*** williamcaban has quit IRC13:31
*** dave-mcc_ has joined #openstack-kolla13:32
*** portdirect is now known as portdirect_away13:34
ram_duonghq: My another concern is : I enabled magnum service in globals.yml  before running $sudo kolla-ansible deploy. But that service not deployed . why? do you know any idea?13:34
duonghqram_, the doc is outdated13:35
*** dave-mccowan has quit IRC13:35
*** portdirect_away has quit IRC13:35
duonghqram_, I haven't tested it yet, sorry13:35
*** v1k0d3n has joined #openstack-kolla13:36
ram_duonghq: So what do you suggest me now. Actually, I want to prepare a nice POC on Kolla.13:36
ram_dounghq: Could you please help me in this. I am new to kolla.13:36
*** portdirect_away has joined #openstack-kolla13:37
duonghqram_, so, just get the basic setting run first?13:38
*** portdirect_away has quit IRC13:38
*** saneax is now known as saneax-_-|AFK13:38
duonghqwe do not have much test against magnum yet, so we will find our path later?13:38
ram_duonghq: basic testing means? can you please clear me13:38
duonghqram_, I mean basic compute kit: keystone, nova, neutron, glance, cinder13:39
*** portdirect_away has joined #openstack-kolla13:39
*** dmsimard is now known as dmsimard|pto13:39
ram_duonghq: OK. Those services are automatically deployed right without enabling in global.yml?13:40
duonghqyup13:40
*** lbeliveau has quit IRC13:41
ram_duonghq: I deployed now right. Cinder service is not there. http://paste.openstack.org/show/591239/13:41
*** mgiles has joined #openstack-kolla13:42
*** goldyfruit has joined #openstack-kolla13:43
ram_duonghq: The document what I used is outdated right. Can please provide me working document for test basic kolla functionality.13:43
duonghqram_, We're writing it :)13:43
duonghqram_, wait me about 5min, I need restart my box13:43
*** duonghq has quit IRC13:44
ram_duonghq: OK. NP.  restart it.13:44
*** duonghq has joined #openstack-kolla13:45
duonghqram_, I'm back13:45
*** lbeliveau has joined #openstack-kolla13:46
ram_duonghq: Hi. My intension is to know as much about openstack container projects. Just started with Kolla first. Can you please give me a suggetion what to proceed and what not to proceed for Kolla.13:48
duonghqwe have some use case in production13:49
duonghqso, basically, it can run at least all core projects in openstack13:50
duonghqat least with projects I listed above13:50
duonghqI don't sure if I satisfied your question13:50
ram_duonghq: It has run all core openstack projects like : Keystone, glance, nova, cinder and neutron right. I want to have practical knowledge. Means I need to deploy kolla with the mentioned openstack projects. What I have to do now for that?13:52
*** zhubingbing has joined #openstack-kolla13:53
duonghqram_, you can build docker image using kolla project and deploy using kolla-ansible project13:56
duonghqother steps are same as the guide13:56
*** senk has quit IRC13:56
ram_duonghq: OK. I understood the guide. But doing deployment failed. Because that is outdated as you mentioned. When that new document will be ready for operator usage?13:58
duonghqnot sure, if I can arrange my time, it can be done in this weekend13:59
*** fguillot has joined #openstack-kolla13:59
ram_duonghq: Hmmm. I have a question . In globals.yml , I made #enable_cinder: "yes"   but that service not deploy now using kolla-ansible? Is there any specific reason?14:01
duonghqram_, you should uncomment this line14:02
ram_duonghq: Oh. Whatever we want to deploy , we will have to 1)uncomment 2)made that service value "no" to "yes" right.14:03
duonghqyup14:06
ram_duonghq:  And In globals.yml, I didn't see options like : enable_nova, enable_glance, enable_neutron, enable_keystone  options. But we have enable_cinder option. This mean nova,neutron,glance,and keystone will deploy automatically. They are default services to deploy by kolla-ansible right?14:06
duonghqram_, it get default config: enable14:07
ram_In globals.yml , default config: enable  option is not there.14:08
ram_duonghq: don't mind. Have small small questions.14:09
duonghqI do not say that, but nova, glance, neutron, keystone are core services and are enabled by default.14:09
duonghqanw, just let it rol14:10
duonghqroll14:10
*** Pavo has quit IRC14:13
*** hfu has joined #openstack-kolla14:14
ram_duonghq: OH. As you said, When I ran $./init-runonce  it will initialize an environment with a glance image and neutron networks right. What  This initialization provide us? And using what credentials  I can open horizon UI from browser?14:14
duonghqram_, you can get from /etc/kolla/admin-openrc14:15
*** eaguilar has quit IRC14:16
*** athomas has joined #openstack-kolla14:16
*** Pavo has joined #openstack-kolla14:17
*** eaguilar has joined #openstack-kolla14:19
ram_duonghq: Hi. $./init-runonce is not done correctly for me right. Then what are the consequences I will face?14:21
duonghqram_, can you give me it's output14:22
*** yingjun has joined #openstack-kolla14:22
openstackgerritLi Yingjun proposed openstack/kolla-ansible: Enable searchlight ui when searchlight enabled  https://review.openstack.org/40595714:22
*** athomas has quit IRC14:24
*** athomas has joined #openstack-kolla14:25
ram_duonghq: Actually, under kolla/tools there is not init-runonce  script. Can we generate manually? Due to that When I ran $sudo ./init-runonce   it was showing http://paste.openstack.org/show/591243/14:26
duonghqram_, it's in kolla-ansible repo, not kolla one14:27
*** williamcaban has joined #openstack-kolla14:28
*** shardy_lunch is now known as shardy14:29
duonghqram_, you can read this file, it's self explain14:29
openstackgerritMerged openstack/kolla: Corrected Punctuation in quickstart.rst  https://review.openstack.org/40490714:31
ram_duonghq: OK. Fine. That kolla-ansible repo not cloned. Giving error: http://paste.openstack.org/show/591247/14:31
duonghqram_, tried this one: https://github.com/openstack/kolla-ansible14:32
*** yingjun has quit IRC14:32
*** yingjun has joined #openstack-kolla14:32
*** williamcaban has quit IRC14:32
*** jtriley has joined #openstack-kolla14:33
ram_duonghq: Now Can I do the entire setup based on old doc?14:34
*** williamcaban has joined #openstack-kolla14:35
duonghqram_, yeah, just notice that the ansible bit is in kolla-ansible, which mean almost commands (except image building) is done in kolla-ansible repo14:35
*** jheroux has joined #openstack-kolla14:35
*** hfu has quit IRC14:36
*** yingjun has quit IRC14:36
*** yingjun has joined #openstack-kolla14:36
*** eaguilar has quit IRC14:38
ram_duonghq: instead of kolla-build what I need to run for building openstack service docker images?14:39
duonghqI mean you should build the image using kolla repo14:39
duonghqin tools/build.py14:39
duonghqor if you installed kolla using pip, you can do kolla-build14:39
*** jascott1_zZz has joined #openstack-kolla14:41
*** jtriley has quit IRC14:41
*** eaguilar has joined #openstack-kolla14:44
ram_duonghq: You mean, I installed kolla using pip. So I can run kolla-build. I have question. We need to to clone both kolla repo and kolla ansible repo right.14:44
duonghqyup14:45
duonghqI mean if you install kolla from source using pip, you'll get kolla-ansible14:45
openstackgerritLi Yingjun proposed openstack/kolla: Install searchlight-ui to horizon  https://review.openstack.org/40595614:45
*** jascott1_zZz has quit IRC14:45
ram_So here kolla-ansible repo will be used only for  initialize the environment by glance image and neutron networks only right.14:46
*** senk has joined #openstack-kolla14:47
duonghqram_, the kolla-ansible contain the ansible bit14:47
ram_duonghq; I installed kolla as $sudo pip install kolla.14:47
duonghqwhich mean all ansible playbook14:47
duonghqthe Ansible playbook take care deploy openstack (in form of docker image) to cluster14:48
duonghqthe docker image is built from kolla repo14:48
duonghqfrom dockerfile14:48
*** absubram has joined #openstack-kolla14:48
*** absubram_ has joined #openstack-kolla14:50
*** lrensing has joined #openstack-kolla14:53
*** absubram has quit IRC14:53
*** absubram_ is now known as absubram14:53
ram_duonghq: That is OK. First I ran $sudo pip install -U ansible then I ran $sudo pip install kolla and next I cloned kolla repo. Then kolla-ansible, kolla-build and kolla-genpwd utilities came.14:54
*** inc0 has joined #openstack-kolla14:55
inc0o/14:55
duonghqevening inc014:55
inc0morning duonghq ;)14:55
*** yingjun has quit IRC14:56
sbezverkinc0: morning inc0 need your helm urgently14:57
*** yingjun has joined #openstack-kolla14:57
sbezverkinc0: for kube gate we need entrypoint image14:57
*** senk has quit IRC14:58
sbezverkinc0: I know it is in the master but since we do not build images at the gate we pull them from docker hub14:58
ram_duonghq: But from kolla repo we didn't find init-runonce. So for that only we have to clone kolla-ansible repo. And then we can initilize the environment right?14:58
duonghqseem that Kollish really really need update the docs :)14:58
openstackgerritMerged openstack/kolla-ansible: Disable notifications for cinder when no consumer  https://review.openstack.org/39866914:58
*** dave-mcc_ has quit IRC14:58
sbezverkinc0: could you please push kubernetes-entrypoint image to kolla repo on docker hub with tag 3.0.114:58
*** lrensing has quit IRC14:58
sbezverk?14:58
duonghqram_, if we choose to clone kolla from git, we need to clone kolla and kolla-ansible15:00
*** lrensing has joined #openstack-kolla15:00
duonghqkolla contains dockefile and related stuff for building the Docker image15:00
duonghqkolla-ansible contains Ansible playbook and related ultilities for deploy previous images to cluster15:00
*** yingjun has quit IRC15:01
*** jtriley has joined #openstack-kolla15:02
*** krtaylor has joined #openstack-kolla15:02
ram_duonghq: Hmmm. That good to know for me. But I saw globals.yml , passwords.yml files from kolla-ansible repo also. But in kolla-ansible we can't find build.py under kolla-ansible/tools15:03
ram_But we need to edit globals.yml of kolla repo only right.15:04
*** eaguilar has quit IRC15:04
duonghqI prefer kolla-ansible one15:05
*** yingjun has joined #openstack-kolla15:07
*** eaguilar has joined #openstack-kolla15:07
*** DaveTurner has quit IRC15:09
ram_duonghq: You mean , I know need to edit globals.yml of kolla repo right. But if I run kolla-genpwd where it will edit 1)passwords.yml of kolla repo (or) passwords.yml file of kolla-ansible file.15:09
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible: Do not mount /var/lib/nova/mnt unless nfs cinder backend is enabled  https://review.openstack.org/40616815:10
duonghqram_, finally, globals.yml, passwords.yml and kolla-build.conf will go to /etc/kolla/15:11
openstackgerritLi Yingjun proposed openstack/kolla-ansible: Enable searchlight ui when searchlight enabled  https://review.openstack.org/40595715:11
*** dave-mccowan has joined #openstack-kolla15:11
duonghqkolla-genpwd knows it should find passwords.yml in /etc/kolla/15:11
duonghqsame for globals.yml15:11
ram_duonghq: OK. Thanks. For all i one kolla deployment we no need to create docker registry right?15:17
duonghqif you use AIO config and just for test, yes15:17
*** inc0 has quit IRC15:17
duonghqif not: no15:17
ram_duonghq: If we are not creating docker registry, Locally it will store docker images for AIO?15:19
duonghqjust in this node, but other nodes cannot get the images15:19
ram_duonghq: When we need to generate and edit the kolla-build.conf. Actually, for my current setup I didn't generated kolla-build.cong file?15:21
*** inc0 has joined #openstack-kolla15:23
duonghqram_, when you want to customise this15:23
duonghqfox ex: when you need  using local docker registry15:23
duonghqor customise the images15:24
inc0sbezverk, back, just got it15:24
inc0ubuntu source is pushing15:24
ram_duonghq: Thank you very much for your patience in giving answers. I got good information from you.15:27
duonghqram_, my pleasure15:27
openstackgerritprameswar proposed openstack/kolla: QSG and bifrost improved  https://review.openstack.org/40617715:28
duonghqprameswar, ping15:29
prameswarhi15:30
prameswarhttp://docs.openstack.org/developer/kolla/bifrost.html guide improved15:30
duonghqnice15:30
duonghqprameswar, can you do me a favor if you have time: update the QSG of kolla to reflect our repo split?15:31
duonghqdue to you are improving docs15:31
prameswarok15:32
prameswari am doing15:32
duonghqprameswar,  thank you very much15:32
*** openstackgerrit has quit IRC15:33
*** openstackgerrit has joined #openstack-kolla15:33
openstackgerritMerged openstack/kolla-kubernetes: Kolla-Kubernetes Vagrant development environment documentation  https://review.openstack.org/40449315:33
*** jascott1_zZz has joined #openstack-kolla15:42
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible: Do not mount /var/lib/nova/mnt unless nfs cinder backend is enabled  https://review.openstack.org/40616815:43
*** jascott1_zZz has quit IRC15:46
*** eaguilar has quit IRC15:48
*** inc0 has quit IRC15:53
*** sayantan_ has joined #openstack-kolla15:54
*** inc0 has joined #openstack-kolla15:54
*** srwilkers_ has joined #openstack-kolla15:57
srwilkers_good morning everyone15:57
duonghqsrwilkers_, nice to see you15:59
srwilkers_you too duonghq :)15:59
*** egonzalez90 has quit IRC15:59
*** sayantan_ has quit IRC16:02
*** jascott1_zZz has joined #openstack-kolla16:03
*** sayantan_ has joined #openstack-kolla16:03
*** absubram has quit IRC16:05
*** jascott1_zZz has quit IRC16:08
openstackgerritprameswar proposed openstack/kolla: QSG and bifrost improved  https://review.openstack.org/40617716:11
openstackgerritprameswar proposed openstack/kolla: QSG and bifrost improved  https://review.openstack.org/40617716:12
*** Pavo has quit IRC16:13
*** yingjun has quit IRC16:14
*** yingjun has joined #openstack-kolla16:15
prameswarHi duonghq, done . can you please review now ?16:15
duonghqprameswar, I just post a review,16:15
*** jascott1_zZz has joined #openstack-kolla16:16
openstackgerritEduardo Gonzalez proposed openstack/kolla: Fix barbican upgrade permission issue  https://review.openstack.org/40620216:16
*** david-lyle_ has joined #openstack-kolla16:17
*** Pavo has joined #openstack-kolla16:18
openstackgerritEduardo Gonzalez proposed openstack/kolla: Fix aodh role  https://review.openstack.org/40620316:18
openstackgerritprameswar proposed openstack/kolla: QSG and bifrost improved  https://review.openstack.org/40617716:18
*** david-lyle has quit IRC16:19
*** jascott1_zZz has quit IRC16:20
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible: Add custom policies in service.json  https://review.openstack.org/39971216:23
*** inc0 has quit IRC16:23
*** inc0 has joined #openstack-kolla16:23
*** adrian_otto has joined #openstack-kolla16:25
duonghqprameswar, ping16:30
duonghqactually, the repo split make documentation need more details,16:31
kfox1111morning.16:31
duonghqI'm writing some comments but we still need more opinion on it16:31
*** jistr is now known as jistr|biab16:33
duonghqsorry, just realize that this ps is about Kolla QSG16:33
srwilkers_morning kfox111116:34
duonghqprameswar, what is your tz, can I take care the docs when you sleep? I'm in tz +716:35
prameswarhi16:35
kfox1111srwilkers_: morning16:35
*** sayantan_ has quit IRC16:36
*** zhubingbing has quit IRC16:36
prameswarshall i remove split part from my patch and someone will add new patch for this16:36
*** Serlex has quit IRC16:36
*** sayantan_ has joined #openstack-kolla16:36
sbezverkkfox1111: morning, we got the entrypoint pushed to docker hib, thanks to inc0 so testing it16:37
duonghqprameswar, sure, but you should put a note in commit message16:37
prameswarduonghq my tz is IST . i am available for next 2 hour16:37
prameswarwill you add split part ?16:38
kfox1111sbezverk: morning. cool. :)16:38
duonghqprameswar, not sure, hope that I can write these things in tomorrow evening (UTC+7)16:38
*** saneax-_-|AFK is now known as saneax16:39
prameswarduonghq , ok then i am removing spit part from QSG16:39
duonghqprameswar, okay,16:40
duonghqgoodnight prameswar16:40
duonghqnight all16:40
*** vhosakot has joined #openstack-kolla16:41
kfox1111oh...16:41
kfox1111you know what...16:41
kfox1111I think there is a slight gate breakage.16:41
kfox1111kind of.16:41
kfox1111sbezverk: we're not specifying distro to helm in the gate.16:41
kfox1111so the helm stuff in the ubuntu job is running centos containers right now...16:42
*** Jeffrey4l has quit IRC16:42
openstackgerritprameswar proposed openstack/kolla: QSG and bifrost improved  https://review.openstack.org/40617716:43
prameswargoodnight duonghq16:44
*** duonghq has quit IRC16:44
*** sayantan_ has quit IRC16:45
*** bmace has quit IRC16:47
*** bmace has joined #openstack-kolla16:47
*** matrohon has quit IRC16:48
*** sdake has joined #openstack-kolla16:48
sdake2nd morning again peeps :)16:49
sbezverkkfox1111: it seems it is picking up centos/binary16:49
sbezverksdake: morning16:49
*** strigazi is now known as strigazi_AFK16:50
kfox1111sbezverk: its using the default in all_values. I'm whiping up a quick ifx.16:50
kfox1111fix16:50
srwilkers_yo sdake16:50
*** sdake_ has joined #openstack-kolla16:51
*** yingjun has quit IRC16:51
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Fix distro in gate  https://review.openstack.org/40622316:51
*** yingjun has joined #openstack-kolla16:52
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla-ansible: Add missing per service Keystone config augments  https://review.openstack.org/40622416:52
sdake_sbezverk we dont push to dockerhub until a release is tagged16:52
sdake_i dont wnat to push to dockerhu at all16:52
sdake_however several other cores want it16:52
kfox1111sdake_: it really simplifies testing and kicking the tires.16:53
sbezverksdake_: I agree with them, for some cases this flexibility is good..16:53
kfox1111no 30+ minute build step.16:53
sdake_i get the value kfox111116:53
sdake_kfox1111 have heard the arguemnts about why its a good idea16:53
sdake_kfox1111 there are also reasons why its a bad idea16:53
sbezverksdake_: when inc0's internal registry is up, then it will not be that usefull, but for now it is.16:54
kfox1111yeah. it shuldn't be relied apon without some kind of security update mechanism.16:54
*** sdake has quit IRC16:54
sdake_kfox1111 there is a whole process for that for dockerhub16:54
sdake_its long and involved16:54
kfox1111but thats generally true of the docker hub in general. its a sespool of stuff not getting updates in general.16:54
sdake_if the core team actually did that, and we used that, I'd be for it :)16:54
sdake_there are some type of certified images16:55
sdake_i looked into it16:55
kfox1111sdake_: do you have a pointer to docs to do that?16:55
kfox1111I'm curious.16:55
sdake_yup moment16:55
*** saneax is now known as saneax-_-|AFK16:55
*** yingjun has quit IRC16:56
sdake_https://docs.docker.com/docker-hub/official_repos/16:56
sdake_keep in mind the cor eteam would have to maintian 180 of those dockerfiles - probably separately16:56
sdake_and build them and get them through a docker review process16:56
sdake_the first step in my mind to getting there is through VMT16:57
sdake_we can't get VMT done16:57
sdake_i spent alot of time on it during my term as ptl16:57
sdake_I'm not sure why it didn't get done16:57
sdake_I couldnt' do it alone16:57
sdake_need the security team's help and the core team's help16:57
sdake_the think that concerns me about official images is the docker best practices16:58
sdake_for the most part we do that16:58
sdake_on our generated dockerfiles16:58
sdake_they start out in j2 format16:58
sdake_also we have a layered himage approach to building16:59
sdake_wihch is not really atypical but different16:59
sdake_most softwwre in the ofifical repo is 1 image16:59
sdake_kolla is 180...16:59
kfox1111oh... they are doing like one build repo to rule them all.17:00
sdake_you got it17:00
sdake_recommend reading link17:01
kfox1111I don't think that will scale will with our number of containers.17:01
sdake_it looks straightfoward17:01
kfox1111well.17:01
sdake_but seems challenging in practice17:01
sdake_vmt looked straightforward too :)17:02
srwilkers_yeah, can definitely see the amount of work required to get that going for kolla17:02
kfox1111I don't think we nessisarily need to go that far. we just need to ensure we have some process to watch for updates, and push updates.17:02
srwilkers_this is definitely a good read though, thanks sdake_17:02
sdake_kfox1111 there is a middleground yoru right17:03
sdake_kfox1111 we can't really maintain a distro of openstack - because that really isn't our job :)17:03
sdake_to do that job..17:04
sdake_reqiures more people then we have17:04
kfox1111yes/no. we're not maintaining a distro. rdo/ubuntu is.17:04
kfox1111we're just building containers based on those distro's.17:04
sdake_rdo is a pristine implementation of openstack17:04
sdake_it is not maintained for security updates17:04
sbezverkkfox1111: so the entrypoint worked for centos, but then on other gate jobs glance went south :-(17:05
kfox1111hmm... I guess I'm not so worried about the openstack packages itself.17:05
kfox1111more, the underlying distro packages we bundle.17:05
kfox1111ie, openssl for example.17:05
kfox1111those do get security updates.17:05
kfox1111fairly frequently.17:05
sdake_right thats part of centos17:05
sdake_i am not really sure what security updates centos gets17:06
sdake_i dont know the answer to tha tq17:06
sdake_i can look :)17:06
kfox1111thats something automatable. look at container in hub. do a docker run kolla/foo yum upgrade -y17:06
kfox1111check to see if it did anything. if so, time to build a new container and push it.17:06
kfox1111same for ubuntu, just apt.17:06
kfox1111that alone would go a long long way.17:07
sdake_hadn't thought of that approach17:07
kfox1111its something that could go in a gate periodic job I think.17:07
sdake_i haven't been supportive of docker hub model at all17:07
sdake_so i haven't been thinking how to make it happen17:08
sdake_i assume people that want that will make it hapepn :)17:08
kfox1111we wouldn't be making security updates per'se, but would just be making sure we kept up with the distro's updates.17:08
kfox1111yeah, thats me. :) might make it happen eventually, if no one else does first.17:09
sdake_wfm - i can add any core reviewer to the docker hub account17:09
sdake_coolsvap was the person pushing images most recently i think17:09
sdake_but i am not really sure17:09
sbezverksdake_: can you add kfox1111 and myself please, I could not move forward whole days yesterday because of missing image..17:10
*** tonanhngo has joined #openstack-kolla17:10
sdake_sorry about that - ha dto sleep :)17:14
sdake_ok well the real problem here is the gate is not building image17:15
sdake_s17:15
sdake_but i get you dont want to blcok on solving that problem17:15
*** sayantan_ has joined #openstack-kolla17:15
sdake_are you registered on dockerhub17:15
*** sayantan_ has quit IRC17:15
sbezverksdake_: yes17:15
sdake_let me see if i can find ya17:15
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla: Install magnum dashboard into the horizon image  https://review.openstack.org/40535017:16
*** sayantan_ has joined #openstack-kolla17:17
*** sayantan_ has quit IRC17:18
kfox1111we need a periodic gate job that builds docker images and caches them for the other gate jobs.17:18
*** sayantan_ has joined #openstack-kolla17:18
kfox1111we don't want to break kolla-kube's gates just becase something slips through in kolla's containers.17:19
kfox1111the non direct coupling there would allow us to contianue to develop on kolla-kube while kolla gets fixed.17:19
sdake_kfox1111 your already registered dude :)17:19
sbezverkkfox1111: I think inc0 is working on it17:19
sdake_kfox1111 that is what cross gating solves17:20
kfox1111I also have been testing with 2.0.x containers, and would like to continue to do so. will give us some good infrastructure to test upgrades.17:20
sbezverkkfox1111: as a part of internal registry idea17:20
sdake_kfox1111 you asked me to register you once before so you could push - i did17:20
kfox1111sdake_: ah. I couldn't remember if I had access or not. and I wanted to double check if it was ok to push entrypoint before I tried.17:20
sdake_pushing a 2.0.2 version of entrypoint is wierd17:21
sbezverksdake_ can you add me then, since kfox1111 memory sometimes suffers ;-)17:21
kfox1111we won't need a 2.0.2 version.17:21
kfox1111just mitaka containers for the actual openstack stuff.17:22
sdake_so current process is we build from tags17:22
sdake_thats what the core team sort of does17:22
openstackgerritprameswar proposed openstack/kolla: QSG and bifrost improved  https://review.openstack.org/40617717:22
sdake_so when 2.0.1 is git tagged a build is done17:22
sdake_or 3.0.117:23
sdake_or whatever17:23
sdake_if you want to really kick the idea around automating the dockerhub wfm - recommend ml discussion on the topic17:23
*** Bico_Fino has joined #openstack-kolla17:23
sdake_see who is up for actually doing the job17:23
kfox1111sdake_: yeah. will do at some point soon. wana get a little bit more through the helm stuff first.17:24
kfox1111I want to do the same for the helm packages too.17:24
sdake_ya it doesn'treally seem like a priority to me :)17:24
Bico_FinoHello, I just did a redeploy of Kolla(removed all containers and images).17:24
kfox1111prebuild all the helm packages into a helm repo so that someone can just download helm, point it at the kolla repo, and go.17:24
kfox1111nothing kolla specific to build/download.17:24
Bico_FinoBut when I logged again on Horizon interface, all stuff was there(all flavors, network, etc).17:25
Bico_FinoWasn’t suppose to be a new installation since I deleted all containers/images, or I’m missing something inside /etc/kolla?17:25
kfox1111sdake_: the way I look at it, I'm either going to have to come up with the ci infrastructure at my own site to keep the containers up to date,17:26
prameswarpbourke, done :) can you please review again ?17:26
kfox1111or contribute it back so that everyone benifits.17:26
prameswarhttps://review.openstack.org/40617717:26
kfox1111so I kind of prefer to contribute it. :)17:26
sdake_kfox1111 yup - its interesting long term - i think the issue is there is nobody to do the work of maintaining it :)17:27
sdake_but not really my problem to solve ;)17:27
sdake_the gate being blocked- my problem to solve17:27
*** jascott1 has joined #openstack-kolla17:27
sdake_so what do you guys need there17:27
sdake_sbezverk i added you17:27
sdake_just permissions in dockerhub?17:28
sbezverksdake_: thank you..17:28
sdake_i'd prefer we focus our efforts on having a generallly better ci17:29
sbezverkkfox1111: you need to push ubuntu-binary-haproxy to the hub17:29
sdake_ci of kolla kolla-ansible is suboptimal17:29
kfox1111yeah.17:29
sdake_why does that need to be pushed17:29
kfox1111sbezverk: there should be one17:29
sbezverkkfox1111: it did not find it17:29
sbezverkhttp://paste.openstack.org/show/591269/17:30
sdake_deivey was looking at doing a better job maintaining hte dockerhub securitywise17:30
sdake_kfox1111 might talk to him when he is about17:30
sbezverkneeds tag 3.0.117:31
kfox1111https://hub.docker.com/r/kolla/ubuntu-binary-haproxy/tags/17:31
kfox1111yup. someone forgot to build/push that container. :/17:31
kfox1111sdake_: k. sounds good.17:32
*** fragatina has quit IRC17:32
kfox1111sbezverk: I'll revert to 2.0.2 for now. gate previous was using that anyway.17:32
sbezverkkfox1111: sure, nothing new I suspect was added between 2.0.2 and 3.0.1 to haproxy17:33
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Fix distro in gate  https://review.openstack.org/40622317:33
*** fragatina has joined #openstack-kolla17:34
openstackgerritMerged openstack/kolla: Run docker registry in gate  https://review.openstack.org/40440517:34
*** unicell1 has quit IRC17:36
*** inc0 has quit IRC17:36
*** inc0 has joined #openstack-kolla17:36
kfox1111wow.. thats a lot of kolla patches in zuul.17:38
*** gmmaha has quit IRC17:38
kfox1111what that about?17:38
srwilkers_:x17:39
*** fragatina has quit IRC17:39
*** msimonin has quit IRC17:39
kfox1111oh. might have been merge-checks.17:39
*** jascott1 has quit IRC17:39
*** athomas has quit IRC17:39
*** jascott1 has joined #openstack-kolla17:39
kfox1111meeting time. bbiab.17:40
*** gmmaha has joined #openstack-kolla17:40
*** jascott1 has quit IRC17:40
*** jascott1 has joined #openstack-kolla17:41
*** sdake_ has quit IRC17:42
*** unicell has joined #openstack-kolla17:43
*** jascott1 has quit IRC17:44
*** javcasalc has joined #openstack-kolla17:48
*** jistr|biab is now known as jistr17:53
*** jascott1 has joined #openstack-kolla17:54
*** javcasalc has quit IRC17:54
*** jascott1 has quit IRC17:54
*** jascott1 has joined #openstack-kolla17:55
*** adrian_otto1 has joined #openstack-kolla17:56
*** adrian_otto has quit IRC17:58
*** javcasalc has joined #openstack-kolla18:02
*** fragatina has joined #openstack-kolla18:04
*** sdake has joined #openstack-kolla18:04
*** unicell has quit IRC18:07
*** david-lyle_ is now known as david-lyle18:08
*** Pavo has quit IRC18:13
*** shardy has quit IRC18:13
*** javcasalc has quit IRC18:14
*** matrohon has joined #openstack-kolla18:15
*** Pavo has joined #openstack-kolla18:18
*** prameswar has quit IRC18:20
*** senk has joined #openstack-kolla18:20
jascott1kfox1111 what sup w this version "3.0.0-1"?18:21
*** Bico_Fino has quit IRC18:21
kfox1111in the chart?18:22
*** inc0 has quit IRC18:22
jascott1ooooh18:22
jascott1just figured it out18:22
jascott1it was in the helm install wasnt thinking clearly.. must be Friday18:23
kfox1111gonna have to work through that stuff at some point in more detail. but trying to mirror best practices by other package managers. have a revision number on the package.18:23
jascott1sounds legit18:23
*** magicboiz has joined #openstack-kolla18:23
kfox1111no worries.18:23
*** Pavo_ has joined #openstack-kolla18:26
Pavo_evening everyone18:26
Pavo_question18:26
Pavo_how do you guys enable the magnum horizon plugin in the current kolla-ansible?18:27
*** fragatina has quit IRC18:27
*** fragatina has joined #openstack-kolla18:27
sbezverkkfox1111: gate fix failed again on ubuntu tool box, I just pushed 3.0.118:28
openstackgerritMerged openstack/kolla: Don't process/queue children not matched  https://review.openstack.org/40046718:29
kfox1111sbezverk: there wasn't a 3.0.1 toolbox either?18:30
kfox1111weird.18:30
kfox1111k18:30
sbezverknope :-(18:31
kfox1111been working some other things this morning, so haven't been paying too close attention yet.18:31
kfox1111thatnks for looking after it.18:31
sbezverkno worries just do check exp again, if I see something missing I will rebuilt it and push18:31
kfox1111k. cool. thx.18:32
sbezverkkfox1111: gate is not stable today :-( sometime it works sometimes it doesn't for vswitchd so I am just playing pin-pong with the gate18:32
sdakeportdirect_away - NICE JOB ON DOCS18:36
*** Bico_Fino has joined #openstack-kolla18:39
srwilkers_sdake, +118:41
sdakesrwilkers_ ya its super impressive18:42
sdakeneeds to be tested ithink18:42
sdakei'm not sure whwere the status of the docs testing is :)18:42
*** senk has quit IRC18:42
*** unicell has joined #openstack-kolla18:42
sdakei have n early dev env, based upon portdirect's fork, i'll run through the instructions and validate em18:43
srwilkers_definitey. can confirm its working though -- using it currently18:43
srwilkers_but im biased, so dont take my word for it18:43
*** jheroux has quit IRC18:44
sdakesrwilkers_ cool18:44
sdakenah that sounds good18:44
sdakei think i want to get on the standard dev env18:44
sdakerather then a fork of an earlier peice of work18:45
*** eaguilar has joined #openstack-kolla18:45
sdakeso dont need to validate it if you have18:45
openstackgerritJustin Scott proposed openstack/kolla-kubernetes: WIP Helm-ize memcached  https://review.openstack.org/40567718:45
*** jascott1_ has joined #openstack-kolla18:45
*** jascott1 has quit IRC18:46
srwilkers_sdake, question. im sure its been brought up before, but i cant recall. have you looked at the helm work in our repo?18:46
sdakei have18:46
sdakei have also looked at others18:47
kfox1111sbezverk: yeah, I htink the docker hubs been a litlte unstable the last few days. :/18:50
*** diogogmt has joined #openstack-kolla18:50
kfox1111sbezverk: 2016-12-02 18:34:12.629052 | Tag 3.0.1 not found in repository docker.io/kolla/ubuntu-binary-openvswitch-db-server18:51
sdakeyup18:51
kfox1111did any of the 3.0 stuff for ubuntu get posted?18:51
sdakeshouldn't be used for gating :)18:51
sdakeanything unreliable ideally shouldn't be used for gating - because it blocks gating18:52
*** hvlad has quit IRC18:52
kfox1111sbezverk: all the gates are improper there.18:52
kfox1111if we switch to building containers,18:52
kfox1111then we just push the external pulling to rpms/debs instead.18:53
sdakethose are also unreliable ;)18:53
kfox1111I'd rather pull a known good set of containers, rather then a unknown set of rpms.18:53
kfox1111for testing against.18:53
sdakerpms are gated in rdo18:53
kfox1111sdake: yeah, but we don't just build against pure rdo rpms.18:54
sdakenot sure about ubuntu18:54
kfox1111its all the other crap too.18:54
kfox1111openssl, glibc, etc18:54
sdakeyup there is some pulls from non repos18:54
sdakerdo is gated, openssl is gated, glibc is gated18:54
sdakewe have some things in our build from repo pulls which are not gated18:55
sdakenot sure how to fix that18:55
sdakeit needs to be fixed18:55
sdakewe do things like curl -L etc18:55
kfox1111yeah. but not gated by integration test.18:55
sdakethats gotta go18:55
sdakerdo is totally gated by an integration testing18:55
sdakedmsimard|pto does that work18:55
sdakeupstream of us18:55
*** schwicht has joined #openstack-kolla18:56
sdakethats the integration testing18:56
kfox1111we fix it by having a job build the containers from packages periodically. run against kolla-ansible trunk gates and kolla-kubernetes trunk gates.18:56
kfox1111if all tests pass, those containers are cached as the newest tested set.18:56
sdakecross repo gating is better18:56
kfox1111then the kolla-ansible/ kolla-kubernetes review gates use those cached containers. they are konwn good.18:56
kfox1111we cant cross gate against glibc/rdo/mariadb/etc.18:56
kfox1111thats what the periodic job though trys to acomplish. at least do sanity checks and prevent breakage from leaking into unrelated places.18:57
sdakei understand what your saying with caching18:57
sbezverkkfox1111: can you check what is wrong with gate? when I delploy vswitchd in my test bed it works fine, but in the gate it shows bunch of containers, not related to vswitchd getting stuck in Init state18:57
kfox1111have the link handy?18:58
*** eaguilar_ has joined #openstack-kolla18:58
sdakeits a hard problem to solve18:58
sbezverkhttp://logs.openstack.org/07/405107/6/experimental/gate-kolla-kubernetes-deploy-centos-binary-ceph-multi-nv/ff2f144/18:58
kfox1111sdake: agreed.18:58
sbezverkkfox1111: funny thing that it deployed fine once..18:59
sdakecross repo gating makes it fairly easy - since rdo is pretty well gated, and kolla containers will be gated on kolla-ansible ccross-repo gates18:59
sdakewe build a web of gating at the top18:59
sdakeand depend on gating below18:59
*** eaguilar has quit IRC18:59
sdakeor depend on our upstream gating is a better way of putting it19:00
sdakei wouldn't totally get wrapped around the axle on gating19:01
sdakeits tken kolla 2 years to even get a reasonably functional gate, and it is suboptimal19:01
*** eaguilar_ has quit IRC19:01
kfox1111sdake: yeah. we should cross repo gate kolla changes against kolla-ansible and kolla-kubernetes.19:01
sdakeand by reasonably functional, I mean reliable19:01
sdakekfox1111 jeffrey4l is working on the kolla-ansible part19:01
kfox1111I don't think it would be too hard from the kolla-kubernetes side.19:01
sdakewaiting to see wht jefrey4l comes up with before i crosss repo gate kolla-kubernetes19:02
sdakeits helpful if all our gates are similar in design19:02
kfox1111would just be checking out kolla-kubernetes trunk, then running setup_gate.sh with the right args I think.19:02
*** Bico_Fino has quit IRC19:03
sdakeya jeffrey4l last i saw was jammed up about how to get the correct version of kolla-ansible (master) into the kolla gate to do the job19:03
sdakethere is a tool zuul-cloner which doess this job perfectly19:03
sdakei dont know how to use it unfortunately :(19:03
kfox1111sdake: yeah. see the kolla-kubernetes gate. it uses it.19:03
sdakeyup i suggested jeffrey4l reach out to you19:04
kfox1111dug it out of the infra folks. :)19:04
*** adrian_otto1 has quit IRC19:04
kfox1111sbezverk: oh. one thing to consider.19:05
sdakeif you come up with some new gating technique we can roll with that :)19:05
*** eaguilar has joined #openstack-kolla19:05
sdakeinc0 also working on it19:05
sdakei'd ask that poeple work together on the gating so its consistent :)19:05
sdakethats hrad to sort out19:05
kfox1111sbezverk: in the before helm time, all the config was done in setup_config.sh, then the kollakube res create pod ... stuff used those presetup vars.19:05
kfox1111sbezverk: with helm though, the vars have to be passed at helm launch time.19:05
*** sayantan_ has quit IRC19:05
*** adrian_otto has joined #openstack-kolla19:05
kfox1111so I'm guessing for the openvswitch one, some env stuff needs overridden.19:06
kfox1111sdake: +119:06
sbezverkkfox1111: not sure becase 1: other pods. not directly related also getting stuck on Init, 2: vswitchd only comput, gets stuck the "network" mode works fine..19:07
openstackgerritJustin Scott proposed openstack/kolla-kubernetes: WIP Helm-ize memcached  https://review.openstack.org/40567719:08
*** matrohon has quit IRC19:09
sdake i always had a dream of making the gate for kolla-ansible for example super robust19:10
sdakethat never happened19:10
sdakeand also do all integration testing necessary19:11
sdakeinc0 is on it, maybe he will have more success :)19:11
*** mliima has quit IRC19:11
sdakepbourke and jeffrey4l and now inc0 and i and you know how to work on the gate19:12
sdakenot sure nayone else does19:12
sdakecoolsvap possibly19:12
kfox1111sdake: yeah. I think having a gate for our site is going to be important,19:12
kfox1111and having it upstream rather then in our infra makes sense to me, so I'm ok trying to push as much as I can into making the kolla gate test useful things.19:12
sdakenice19:12
sdakeits onerous expecting all the core reviewerst o understand exactly how the gate works19:13
sdakeor to make that a requirement for cr19:13
kfox1111semi agree.19:14
sbezverkkfox1111: do you collect kubelet's logs from the gate?19:14
kfox1111at first, I agree.19:14
kfox1111long term, lots of folks should understand it.19:14
sdakeyou remember the pain you went through to learn the gate19:14
sdakeif thats a requirement for cr, we wouldn't have any crs ;)19:14
kfox1111sdake: yeah. and the hit by a bus scenerio's real.19:14
srwilkers_:)19:14
kfox1111it literally happened in our group. :/19:14
sdakeyup agree19:15
srwilkers_ive been looking at them a bit each night19:15
sdakeairbus does happen19:15
srwilkers_has actually helped quite a bit19:15
kfox1111drunk driver and one of our team members was a bicleist. not a good mix. :(19:15
sdakebummer19:15
srwilkers_damn kfox1111, that sucks19:15
sdakethat happened to one of robyn's good friends19:15
sdakewho maintained yum19:15
sdakesame shit19:15
Pavo_how do you guys enable the magnum horizon plugin in the current kolla-ansible?19:15
sdakedrunk driver, bicyclist, etc19:15
kfox1111yeah.19:15
sdakeuber is a thing and its cheap19:15
kfox1111worst thing about it was it was a repeat offender. :/19:16
sdakesame shit repeat offender19:16
kfox1111maddening. :/19:16
sdakei dont rent cars on the road19:16
sdakewhy bother - uber gets me around19:17
srwilkers_yep19:17
sdakeat home i dont drink :)19:17
sdakealthough i take uber if i do at dinner or something19:17
sdakewhich is rare19:17
sdakePavo_ pbourke is your fella there19:18
sdakePavo_ i believe its documented but i dont recall19:18
Pavo_ok thanks sdake19:18
sdakea similar question came up yesterday19:19
sdakeor the day before19:19
sdakei dont recall teh answer19:19
kfox1111sbezverk: have alook at tests/conf/ceph-all-in-one/kolla_kubernetes_config.19:19
sdakeits in the logs (click the logs in the topic)19:19
kfox1111looks like the settings are a bit different.19:19
kfox1111ovs_add_port is false19:19
*** msimonin has joined #openstack-kolla19:19
kfox1111that could easily cause some bad things.19:20
kfox1111did on my boxes.19:20
sbezverkkfox1111: I see your point, but it was always like this19:22
sbezverkkfox1111: git blame shows, that no was original value19:22
*** kbyrne has quit IRC19:23
kfox1111the override's been in the gate since its begining.19:23
kfox1111that particular setting is very dangerious when true,19:23
*** portdirect_away has quit IRC19:23
kfox1111as any slight misconfiguration will pull the whole node off the network.19:23
kfox1111happened to me multiple times until I figured out what was going on. :/19:24
kfox1111so, for helm, I might even say we should consider defaulting it to false. just to prevent new users from shooting themselves accidently.19:24
sbezverkkfox1111: according to vswitchd pod log, it was going to add port19:25
sbezverkcheck line 20: http://logs.openstack.org/07/405107/6/experimental/gate-kolla-kubernetes-deploy-centos-binary-ceph-multi-nv/ff2f144/logs/pods/kolla-openvswitch-vswitchd-compute-g2mdw.txt19:26
kfox1111yeah. and its probably trying to add the wrong one.19:26
*** portdirect_away has joined #openstack-kolla19:26
sbezverkdo you mean wrong interface?19:26
kfox1111but the gate's designed to add the port elsewhere in the gate. so can safely be skipped in the pod.19:26
*** kbyrne has joined #openstack-kolla19:26
kfox1111yeah. wrong interface.19:26
*** portdirect_away is now known as portdirect19:26
*** adrian_otto has quit IRC19:27
*** ccesario has quit IRC19:27
srwilkers_hey portdirect, hows it going?19:27
sbezverkkfox1111: I am still not convinced, because the actual pod is not even running19:27
portdirectkfoxx1111/srwilkers_: dont think either of you are crazy (yet) :)19:27
srwilkers_:)19:27
*** msimonin has quit IRC19:27
kfox1111portdirect: hehe. then you haven't seen just how crazy I can be yet. ;)19:28
sbezverkI mean even Init pod, so it does not get to the point of adding anything, to me it looks  kube problem.. kubelet has no logs for creating the pod at all19:28
*** inc0 has joined #openstack-kolla19:29
*** Pavo_ has quit IRC19:29
inc0I'm back19:30
portdirecti thought as much kfox1111, though we should prob do this in the comments on gerrit - just wanted to run a few things past you as it would be quicker here.19:30
kfox1111sbezverk: there could be some other issues too. haven't had time to dig too deeply into it yet. but I bet thats at least one of the problems.19:31
kfox1111portdirect: sounds good19:31
portdirectre getting setup_dev.sh in a container - sounds like a great idea - I was playing around with it as well, but thought it might be too extreme as well19:31
portdirect(too many as wells..)19:31
jascott1_well well well19:31
jascott1_portdirect so you started setup_dev?19:32
kfox1111portdirect: so, https://github.com/kfox1111/kolla-kubernetes-toolbox19:32
kfox1111made that for the minikube docs origionally. its a bit bitrotten by now, but could be a good starting place.19:33
portdirectgreat - I wondered where that came from19:33
kfox1111was planning on contributing it to the kolla repo, but other things kept poping up.19:33
*** serverascode has quit IRC19:34
*** NobodyCam has quit IRC19:34
*** sayantani01_ has quit IRC19:34
*** NachoDuck has quit IRC19:34
*** berendt has quit IRC19:34
portdirectI think it would make sense in the tools dir of kolla-k8s?19:34
portdirectmy plan was to take sdakes idea of a devstack type env  - based on the gate (and kolla-toolbox)19:35
sdakeportdirect dude nice job on the docs19:35
sdakeportdirect dev env setup looks fairly straightforward now19:35
sdake;)19:35
sdakenow i wont have to walk a million people through it :)19:35
portdirectif its good enough to acheive that then it's ok :)19:36
portdirectthanks dude19:36
sbezverkkfox1111: I will change in all_values to not plug inteface19:36
sbezverkand run test again19:36
portdirectjascott1_: https://review.openstack.org/#/c/405720/19:37
kfox1111sbezverk: ok. cool.19:37
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Hel-ming openvswitch-vswitchd  https://review.openstack.org/40510719:37
kfox1111sbezverk: if it still fails, I'll dig in more then.19:37
*** sayantan_ has joined #openstack-kolla19:37
kfox1111portdirect: I think we've been putting all the containers in the kolla repo so far.19:37
*** sayantan_ has quit IRC19:37
*** sayantan_ has joined #openstack-kolla19:38
sdakebrb need to run an errand19:38
portdirectkfox1111: yeah - though I was wondering if this was a 'special' case where we shouldn't actually build it, so that bitrot never becomes an issue - as it would just be a developer tool?19:38
*** NachoDuck has joined #openstack-kolla19:40
kfox1111portdirect: I think we need to keep it up to date, and come up with infra that helps with that.19:41
*** inc0 has quit IRC19:41
kfox1111we mwant to make it as easy as possible to spin up new devs.19:41
kfox1111good docs, and easy to setup build envs really go a long way therre.19:42
kfox1111thats what I was atempting to do with the minikube stuff origionally.19:42
kfox1111then got sidetracked as I was spending too much time testing rather then having a gate do the testing. so had to stop and work on that.19:42
*** magicboiz has quit IRC19:43
portdirectyeah - your minikube stuff was great19:43
sbezverkkfox1111: I think you might be right. since first vswitchd always runs successfully, it plugs eth1, which could potentially screw up the whole cluster and could explain strange impact on a non-related pods19:43
kfox1111yeah. the openvswitch stuff, and neutron stuff can break things in really weird looking ways. once those are done, it should be muhc easier. :/19:44
portdirectthough limited by minikube itself - but that ux was pretty close to what id like us to have - the only real difference being that I'd like to keep (at least as an option) the kolla-kube code outside of the container and bind mounted in - so that a developer gets perisitance of that19:45
kfox1111portdirect: thanks. was hoping it would be useful.19:45
kfox1111portdirect: +1 for a bind mount option. would like to bundle it too though.19:46
kfox1111so if all you want to do is kick the tires, it just works. if you want to use it for further dev, then bindmounting works well.19:46
sbezverkkfox1111: need to chat with you about pv/pvc/svc/job charts since in rabbitmq I have all these. but it can wait for later if you are busy with other things19:46
kfox1111sbezverk: yeah.   k. sounds good.19:47
portdirectkfox1111: sounds good - right I'm gonna head home and then have a crack at that after dinner, will you be about in a couple of hours? (may need some assistance with multinode ceph)19:48
kfox1111portdirect: yeah. should be here.19:49
*** adrian_otto has joined #openstack-kolla19:49
*** unicell has quit IRC19:49
*** serverascode has joined #openstack-kolla19:50
portdirectkfox1111: nice, laters :)19:50
*** portdirect has quit IRC19:50
*** adrian_otto has quit IRC19:54
*** jrich523 has quit IRC19:56
*** sdake has quit IRC20:04
*** sdake has joined #openstack-kolla20:05
*** rstarmer has joined #openstack-kolla20:08
rstarmerhello20:08
*** adrian_otto has joined #openstack-kolla20:09
rstarmerI'm trying to get LBaaS and VPNaaS functions running in an ubuntu-source based deployment in 3.0.020:09
rstarmerfollowing some suggestions from last night, I've been looking at the plugin customization process, and it appears that I _should_ be able to just add plugin specific blocks to /etc/kolla/kolla-build.conf20:10
*** jrich523 has joined #openstack-kolla20:10
rstarmerone for [neutron-server-plugin-lbaas] and one for [neutron-server-plugin-vpnaas]20:11
*** ipsecguy_ has joined #openstack-kolla20:12
*** adrian_otto has quit IRC20:12
rstarmerbut this doesn't seem to work.  When I try to re-build the neutron containers, I get 'ERROR:kolla.image.build:Unhandled error when running BuildTask(neutron-server)'20:12
rstarmersource['reference'].replace('/', '-'))20:12
rstarmerAttributeError: 'NoneType' object has no attribute 'replace'20:12
*** adrian_otto has joined #openstack-kolla20:13
*** Pavo has quit IRC20:13
*** msimonin has joined #openstack-kolla20:13
*** ipsecguy has quit IRC20:15
*** NobodyCam has joined #openstack-kolla20:16
*** Pavo has joined #openstack-kolla20:18
*** msimonin has quit IRC20:20
*** msimonin has joined #openstack-kolla20:24
sbezverkkfox1111: it got better but still some other failure on glance even before any openvswitch pods get started, please check.https://review.openstack.org/#/c/405107/20:25
*** berendt has joined #openstack-kolla20:27
*** sayantani01_ has joined #openstack-kolla20:28
sdakeyo20:29
sdakeback20:29
sdakerstarmer Pavo can you share notes on the plugins ? :)20:29
sdakerstarmer i see you have an error20:30
sdakepavo was looking for a plugin for magnum20:30
sdakehow to make it work that is20:30
sdakerstarmer do you have a line number on that error?20:31
sdakerather backtrace20:31
rstarmerERROR:kolla.image.build:Unhandled error when running BuildTask(neutron-server)20:31
rstarmerTraceback (most recent call last):20:31
rstarmer  File "/usr/local/lib/python2.7/dist-packages/kolla/image/build.py", line 485, in run20:31
rstarmer    task.run()20:31
rstarmer  File "/usr/local/lib/python2.7/dist-packages/kolla/image/build.py", line 271, in run20:31
rstarmer    self.builder(self.image)20:31
rstarmer  File "/usr/local/lib/python2.7/dist-packages/kolla/image/build.py", line 396, in builder20:31
rstarmer    archive_path = self.process_source(image, plugin)20:31
rstarmer  File "/usr/local/lib/python2.7/dist-packages/kolla/image/build.py", line 317, in process_source20:31
rstarmer    source['reference'].replace('/', '-'))20:31
rstarmerAttributeError: 'NoneType' object has no attribute 'replace'20:31
sdakepaste service pls in future ;)20:31
sdakewhich version are you using, newton?20:32
sdakeor mitaka20:32
rstarmeroops, sorry20:32
sdakeits ok20:32
rstarmernewton20:32
sdakeok give me a min to read the code20:32
sdakesee if anything pops out20:32
rstarmerok20:32
sdakeno software should backtrace20:32
sdakeno matter the input20:32
rstarmerI agree, and it'd be nice if it gave you an error in a fashion that was useful for a non-developer, but hey, the tool works better than any other for this kind of thing :)20:33
sdakethe reality is if the software is backtracing, it is impossible to give a useful error20:33
sdakefor non-developers to understand20:33
sdakehence why no software should backtrace ;)20:34
sdakerstarmer while i look at the code, please file a defect20:34
sdakei'll mark it criticl20:34
sdakerstarmer did you set reference in in kolla-build.conf?20:36
sdakecan you paste your kolla-build.conf if possible?20:36
sdakeattributeerror nonetype means source.reference is unset20:37
sdakeunset20:37
sdakenonetype is the default type20:37
*** unicell has joined #openstack-kolla20:38
*** portdirect_away_ has quit IRC20:39
rstarmeryes, I set a reference20:39
rstarmerhttp://pastebin.com/hjWSCbcV20:41
*** sayantan_ has quit IRC20:44
srwilkers_reference is spelled wrong there rstarmer20:44
srwilkers_s/refernce/reference20:44
rstarmer... ugh.20:44
rstarmerok, re-trying.20:44
*** sayantan_ has joined #openstack-kolla20:45
rstarmerthanks for catching my typo...20:45
kfox1111sbezverk: thats weird.20:45
srwilkers_it happens man :)20:45
kfox1111very rare that something works on multinode but not single node.20:45
kfox1111still feels like thats a misconfiguration to me.20:45
kfox1111lets see...20:45
kfox1111oh... even weirder.20:46
kfox1111the external ovs one failed too.20:46
rstarmersdake: yep, that fixed it!20:46
rstarmernow to see if I can actually get the service to work :)20:47
srwilkers_rstarmer, awesome. glad that took care of it. cheers20:47
sdakerstarmer good to hear21:03
sdakesrwilkers_ typos for me = type fast with lots of mistakes!21:03
vhosakothe is no ordinary rstarmer... he is "QOS QOS baby" rstarmer ;)21:03
sdakecode needs better error checking21:04
sdakeall code that is ;-)21:04
rstarmervhosakot: OMG, now that's going to follow me around? :)  I just wish I'd gotten the music right to start, my backup dancers were primed and ready :)21:04
vhosakotrstarmer: the talk was great :)21:05
rstarmerbetter error responses, like "can't find 'reference' parameter in kolla-build.conf" would be much more useful than 'AttributeError: 'NoneType' object has no attribute 'replace''21:07
rstarmervhosakot: thanks :)21:08
*** fguillot has quit IRC21:13
kfox1111sbezverk: I just poked the gate fix review again just to see if there was gate funnyness. it is passing like always. so something is funny about your review. just having a hard time finding it. it seems like its an actual breakage though. or else super bad luck.21:18
*** eaguilar has quit IRC21:18
kfox1111next thing to test I think is 2.0.221:18
*** jascott1_ has quit IRC21:19
*** jascott1 has joined #openstack-kolla21:20
*** jascott1 has quit IRC21:20
openstackgerritsayantani proposed openstack/kolla: Add new guide for single-node deployment  https://review.openstack.org/40499321:21
*** jascott1 has joined #openstack-kolla21:21
*** portdirect_away_ has joined #openstack-kolla21:23
*** portdirect_away_ is now known as portdirect21:23
*** jascott1 has quit IRC21:25
rstarmerwell, I'm not out of the woods yet... Now the neutron bootstrap container fails to start.21:30
*** turvey has joined #openstack-kolla21:30
*** eaguilar has joined #openstack-kolla21:33
rstarmerhttp://pastebin.com/fNTizEKt21:33
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: Fix distro in gate  https://review.openstack.org/40622321:34
*** sayantan_ has quit IRC21:39
*** eaguilar has quit IRC21:39
*** jascott1 has joined #openstack-kolla21:40
*** sayantan_ has joined #openstack-kolla21:40
*** sdake has quit IRC21:43
*** absubram has joined #openstack-kolla21:46
*** sayantan_ has quit IRC21:47
*** sayantan_ has joined #openstack-kolla21:51
*** schwicht has quit IRC22:00
*** jtriley has quit IRC22:04
*** sdake has joined #openstack-kolla22:04
*** sdake_ has joined #openstack-kolla22:06
*** sdake__ has joined #openstack-kolla22:07
*** sdake has quit IRC22:07
*** schwicht has joined #openstack-kolla22:09
*** mgiles has quit IRC22:09
*** sdake_ has quit IRC22:10
*** sdake has joined #openstack-kolla22:10
*** sdake has quit IRC22:10
*** sdake has joined #openstack-kolla22:10
*** msimonin has quit IRC22:11
*** sdake has quit IRC22:11
kfox1111sbezverk: https://review.openstack.org/#/c/406223/ should be ready22:12
*** Pavo has quit IRC22:13
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Hel-ming openvswitch-vswitchd  https://review.openstack.org/40510722:14
*** sdake__ has quit IRC22:14
sbezverkkfox1111: done, for vswitch I changed tag for now and extra &&22:16
*** sayantan_ has quit IRC22:16
kfox1111k. am curious if that'll fix it.22:16
*** sayantan_ has joined #openstack-kolla22:16
openstackgerritMerged openstack/kolla-kubernetes: Fix distro in gate  https://review.openstack.org/40622322:17
*** Pavo has joined #openstack-kolla22:17
*** sayantan_ has quit IRC22:25
*** lrensing has quit IRC22:29
*** inc0 has joined #openstack-kolla22:31
inc0howdy22:32
*** schwicht has quit IRC22:32
wirehead_meow.22:33
kfox1111hi22:33
rhalliseymeow meow22:33
wirehead_I haven’t touched Barcelona photos yet, inc0.22:33
jascott1whatup inc0 ready for the big trip?22:33
inc0almost22:33
wirehead_inc0: You do know that this is the town you are moving to, right? http://www.kgw.com/news/local/portland-womans-stolen-car-returned-with-note-gas-money-and-a-crazy-story/34269289722:34
inc0yeah I've seen that one22:34
wirehead_OK.22:34
inc0someone makes a mistake and tries to be nice, it makes news22:34
*** inc0 has quit IRC22:36
*** inc0 has joined #openstack-kolla22:37
wirehead_Well, there’s a category of news that’s “Portland stories"22:39
wirehead_It’s either less capitalistic or less comunistic than “San Francisco stories"22:40
wirehead_And very different from “Florida stories"22:40
SamYaplewhats teh status of k8s kolla?22:42
SamYapleneutron working? instance launched?22:42
kfox1111SamYaple: we can launch a whole compute kit with it.22:42
SamYaplekfox1111: neutron as well?22:43
kfox1111including launching vm's, writing to a cinder vollume on one vm, moving it to another, and reading it back,22:43
kfox1111and neutron networkaccess, including security groups and floating ips.22:43
srwilkers_hey inc022:44
SamYaplekfox1111: how are you solving the network namespace issues with neutron?22:44
*** vhosakot_ has joined #openstack-kolla22:44
kfox1111for now? praying that l3agent doesn't die, and leaning on k8s to support shared.22:44
kfox1111:/22:44
SamYapleesh. ok22:44
SamYaplemight i suggest reverting to thick containers for a bit22:45
srwilkers_oh hey rhallisey, hows it going?22:45
SamYaplethats what i had t oswitch kolla-ansible too when shared support was flaking for kolla22:45
SamYaplethats how it was originally because i could make thin contaienrs work22:45
kfox1111I'd hand patch k8s and support a temporary fork before doing that.22:45
SamYapleno one is going to use your patched k8s :P22:45
kfox1111there's a patch already in flight.22:46
SamYapleok. well once that lands it sounds promising22:46
kfox1111yeah. I don't think its far out.22:46
*** vhosakot has quit IRC22:46
rhalliseysrwilkers, hey! good thanks :)22:46
SamYapleare you keeping l3,dhcp,metadata-agent in the same "pod"?22:46
SamYapleso they stay on the same host?22:46
kfox1111no. daemonsets.22:46
SamYaplei dont know much about k8s22:47
SamYaplethey stay on the same host though, right?22:47
kfox1111a daemonset is a object type that lands a single pod on each host that matches the appropriate label.22:47
SamYaplehmmm so they might not all land on the same host?22:48
kfox1111if you use the same selector you will get the desired outcome.22:48
SamYaplethis shouldnt be in the users control, being on the same host is a hard requirement though22:49
SamYapleis there no way t oenfore that?22:49
kfox1111for example, label your compute nodes kolla_compute=true, then make your l3 and openvswitch daemsonets target kolla_compute=true.22:49
SamYapledoesnt that make it prone to user error? from lack of knowlege or just a config mistake?22:50
kfox1111We're doing things multilevel. base building blocks like openstack does. flexible and unopinionated.22:50
wirehead_Well, consider all of the possibilities for config errors with regular OpenStack.22:50
kfox1111orchestration level can become more opinionanted, and try and save the operator from themselves.22:50
kfox1111(which I plan not to use for a while... that kind of "saving" usually bites me)22:51
SamYaplei mean thats not opinionated, it doesnt work wihtout those things in place22:51
SamYapleor worse, in the case of neutron, it _kinda_ works22:51
kfox1111openstack's built the same way. you can misconfigure it a million ways.22:52
kfox1111but thats important too, when you do crazy stuf like I do with running vxlans over ip over ib. ;)22:52
SamYaplebut... lol this is a deployment project. its here to fix that problem22:52
SamYaplethats the whole point22:52
kfox1111yes/no.22:52
kfox1111with a layered aproach, both goals can be met.22:53
SamYapleok. well just fyi, youre in a world of troubleshooting pain without enforcing some of this stuff22:53
SamYapleit does _NOT_ fail well without having the componets it expects22:53
kfox1111the upper layer provides the ease of deployment/safety net kinds of things.22:53
kfox1111the lower level provides building blocks that you can asemble however needed.22:53
*** schwicht has joined #openstack-kolla22:54
kfox1111SamYaple: its really not any different then openstack's compoennts already behave.22:54
kfox1111if you run neutron-openvswitch-agent without openvswitch, you get badness.22:54
kfox1111whether or not your running it in containers or not.22:54
SamYaplekfox1111: im aware, but thats why openstack is complicated to install and we have a bunch of deployment projects ANYWAY22:54
openstackgerritJoshua Harlow proposed openstack/kolla: Add ability to output the things built/failed/not build  https://review.openstack.org/39527322:54
SamYaplethis isnt just another openstack project, its is openstack dpeloyment22:55
*** dave-mccowan has quit IRC22:55
kfox1111SamYaple: lots of projects use kolla's containers, but not the deployment tools.22:55
kfox1111the same can be said about kolla-kubernetes going forward.22:55
kfox1111theyu can use the base k8s object building blocks, without the orchestration components.22:55
kfox1111idaelly everyone would collaborate on all parts of the stack.22:56
kfox1111but that seems impossible, at least for now.22:56
kfox1111at least with the layered aproach, folks stil have room to contribute to the parts they care about.22:56
openstackgerritJoshua Harlow proposed openstack/kolla: Add ability to output the things built/failed/not build  https://review.openstack.org/39527322:56
kfox1111and the whole project is better for it.22:56
SamYaplekfox1111: its entirely possible i dont understand kolla-k8s. but from what youre describing it sounds like youre focusing it more on the dev side of openstack than the OPS side of openstack22:56
SamYaplejust like the rest of openstack is focused on dev rather than ops22:56
kfox1111hehe. quite the oposite. :)22:56
kfox1111I'm an op wanting to use this on a production system in the very neer future,22:57
jascott1kfox1111 should helm install chart fail if name is not supplied?22:57
jascott1i would think not but idk22:57
kfox1111and am terrified of an orchestration system "deciding" my fate.22:57
jascott1im talking about our desired implementation22:57
SamYaplethere are very few people that know that l3,dhcp,metadata must run on the same host, and why22:57
kfox1111jascott1: it won't. it is like docker. it will just make up a random one.22:57
kfox1111SamYaple: yup. and by default, the settings have them co'exist due to shared default labels.22:58
kfox1111if you purposfully change the default, then its on you to debug. :)22:58
jascott1im templating in name as per comments on memcached, with name its memcached-<name> otherwise it would be memcached-22:58
kfox1111oh... hmm..22:58
sbezverkkfox1111: it looks like we hit it again: "2016-12-02 22:37:48.108753 | Error: transport is closing"22:58
jascott1can just do logic to make it memcache (without -) if name wasnt set22:59
openstackgerritJoshua Harlow proposed openstack/kolla: Don't process/queue children not matched  https://review.openstack.org/40638922:59
kfox1111jascott1: I was pretty sure there is a chart var to get taht.22:59
SamYaplekfox1111: oh. thats totally ok then. the default is to deploy them together on the same host22:59
SamYaplekfox1111: kolla-ansible does the same thing. you can seperate them22:59
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: Hel-ming openvswitch-vswitchd  https://review.openstack.org/40510722:59
SamYaplekfox1111: its just a bad idea22:59
SamYaplekfox1111: if there is a default enforment of this then thats perfectly fine22:59
jascott1kfox1111 so better to default to name of chart than hardcode memcached?23:00
SamYaplekfox1111: the way you made it sound was there was nowhere in the project that linked these things into a "working" config23:00
kfox1111jascott1: https://github.com/kubernetes/helm/blob/master/docs/charts.md23:00
kfox1111jascott1: predefined values23:00
*** srwilkers_ is now known as srwilkers_away23:01
jascott1so use memcached-<name> and if name was not set, use Charts.name23:01
SamYapleso everything should be working for kolla-k8s , except metadata and container restarts for neutron23:01
kfox1111jascott1: I think, just use the value {{ .Values.Release.Name | quote }}23:02
kfox1111should always be set I think.23:02
kfox1111SamYaple: yeah.23:02
kfox1111and that should be fixed pretty quickly I hope.23:02
SamYaplekfox1111: multinode/multiple services?23:03
kfox1111SamYaple: works. and gate tested. :)23:03
jascott1i dont see that in the other templates but if thats the way we want to go im fine23:03
SamYaplekfox1111: nice!23:03
SamYaplewait multinode is gate tested?23:03
kfox1111jascott1: yeah, I think we want to do the others at some point too. but the others largely don't need multiinstance.23:03
kfox1111memcache/rabbit/mariadb do.23:03
jascott1good point23:03
kfox1111SamYaple: yes.23:03
jascott1so if name is speciied take the whole name not just append to memcached-23:03
jascott1if thats the case, got it23:04
kfox1111SamYaple: with ceph suport, k8s spread across both nodes, one labled compute and the other controller, and pods scheduled as appropriate.23:04
kfox1111jascott1: yeah. I think that shoudl work. then thhe user can set it towhatever they want.23:05
jascott1cool23:05
kfox1111shoudl always be unique then too.23:05
openstackgerritJoshua Harlow proposed openstack/kolla: Not much need to cache good, bad, unmatched  https://review.openstack.org/40639123:07
*** vhosakot_ has quit IRC23:08
kfox1111SamYaple: http://logs.openstack.org/07/405107/8/experimental/gate-kolla-kubernetes-deploy-centos-binary-ceph-multi-nv/eff8258/ have a look if your curious. :)23:09
sbezverkkfox1111: the version of gate where you added extra barrier for helm, was it merged already? if not it seems it does not solve ever case..23:09
*** inc0 has quit IRC23:09
sbezverkever/every/23:09
kfox1111sbezverk: If  Iremember correctly, the extra barior didn't actually help and I backed it out. as there's another barior before helm's used.23:12
kfox1111they did ask me to put in some logging thougt to see if we can atch it doing something. give me a few and I'll see if  Ican see anything.23:12
kfox1111yeah... it failed at the ls.23:13
sbezverkkfox1111: intersting that I have never seen in in baremetal setup23:14
SamYaplekfox1111: nice!23:14
SamYaplekfox1111: you can actually run ceph without having host pid namespace in k8s23:15
SamYaplebecause you ahve pods23:15
SamYapleyou can share the pid namespace with the ceph-osd and no need for host23:15
kfox1111SamYaple: some tings yes, some no. if you use net=host, you need to use pid namespace too.23:15
kfox1111or else you get collection reconnect storms.23:16
kfox1111it all works, just much noisier then it should be.23:16
*** dave-mccowan has joined #openstack-kolla23:16
sbezverkSamYaple: sending ceph traffic over kube network overlay will impact seriously performace..23:16
kfox1111the servers keep track of client connection by hostname/pid that the client tells them. if it sees a connection from the same hostname/pid telling its a "new" client, it evicts the old one.23:17
SamYaplei dont think youve caught what i was saying sbezverk or kfox111123:17
kfox1111fully containerized net=host without pid namespaces ends up having multiple isolated clients contact the same servier with the same hostname/pid and they shoot eachother.23:17
SamYaplewith kolla-ansible you _must_ run pid=host to make multiple ceph-osd on the same host work23:18
kfox1111ture.23:18
SamYaplewith k8s pod support (with shared pid namespsaces) you dont have to do that23:18
SamYaplethis has nothing to do with net=host23:18
kfox1111yoru talking osd's not clients.23:18
kfox1111right.23:18
kfox1111ceph servers in kolla-k8s is for testing, not for production.23:19
kfox1111k8s doesn't yet have a very good model for dealing with ceph.23:19
kfox1111(servers)23:19
*** eaguilar has joined #openstack-kolla23:19
jascott1kfox1111 if we use release name it wont be unique but thats ok?23:19
kfox1111jascott1: release names are garanteed to be unique I believe.23:19
SamYaplekfox1111: hmm. wouldnt it be the same model as dealing with compute? this container must run here kind of thing?23:19
jascott1oh i see so calling helm install memcached twice will get you two releases. thanks23:20
kfox1111SamYaple: yeah, but how do you model a pool of nodes with multiple osd's? possibly a disjoint where some nodes have more disks then others?23:20
kfox1111jascott1: right.23:20
SamYaplekfox1111: oh no clue. i dont know k8s. in ansible i check the host for number of osds and launch the appropriate contaienrs23:21
kfox1111you could do it with a series of daemonsets. but that feels clunky.23:21
SamYaplekfox1111: so i get your point23:21
kfox1111yo ucould do it by launching individual pods bound to nodes, but that too is clunky. :/23:21
kfox1111all of the clouds I manage are external ceph managed by ceph-deploy anyway, and that's working great, so not too much pressure on making ceph servers work yet other then to test tthe gate.23:22
SamYaplehow are you handling persistent mariadb and/or rabbitmq data in k8s?23:22
kfox1111ceph rbd backed.23:22
kfox1111k8s pv/pvc pair today.23:22
kfox1111once k8s 1.5 lands, maybe just dynamic pvc.23:22
SamYapleoh. so ceph is a hard requirement right now23:22
SamYapleok23:23
*** lamt has quit IRC23:23
kfox1111well, yes/no.23:23
SamYapledoes it work without ceph?23:23
kfox1111you can create pv's with any backing driver.23:23
kfox1111so, gce backed volumes if you wanted.23:23
kfox1111I just don't think much other then ceph right now is very practical.23:23
sbezverkSamYaple: on a signle node you can use host fs23:24
kfox1111that works too, if you don't need any kind of failover.23:24
SamYapleright, but for the project ceph is a hard requirement right now?23:24
SamYapleother than AIO, which im not counting23:24
kfox1111SamYaple: we're not providing stuff other then ceph, but because we're using native k8s and building block phlosophy,23:24
kfox1111should be able to use anything k8s has a driver for.23:25
kfox1111so, say you have a gluster system or an an expensive ha nfs server. should in theory work.23:25
kfox1111we just havent tested it. but k8s has.23:25
SamYapleone thing I will say kfox1111, i started building kolla-ansible the same way. and it was, early on. look at it now23:25
kfox1111and we're just consuming the k8s api there.23:25
kfox1111yup. hoping kolla-kubernetes will have the same growth. :)23:26
SamYaplethe whole "you can drop anything into place" hasn't lasted like id have hoped in kolla-ansible23:26
SamYaplei wasnt saying it like that23:26
kfox1111ah.23:27
kfox1111well, I need a system thats more flexable then any general deployoment tool that I've run across so far.23:27
SamYapleas bugs pop up (human error), the "fix" for those bugs because removing this flexible piece23:27
kfox1111so, so far as my contribuations, they will be at the lower levels where the building blocks are.23:27
SamYaplesure i get that. this is why i wanted to seperate docker from ansible for so long23:28
kfox1111otherwise, if it becomes more opinionated, I can't continue to use it.23:28
SamYapleand YAY its finally done23:28
kfox1111yeah. :)23:28
SamYapleso should worst happen, its an easy fork23:28
kfox1111yeah.23:28
SamYaplecool. well kfox1111 thanks for the info23:29
SamYapledo you know when well know more about neutron and shared namespaces in k8s?23:29
*** goldyfruit has quit IRC23:29
kfox1111SamYaple: any time. :)23:31
kfox1111SamYaple: don't know... I really really need it for another project too.23:31
kfox1111fuse filesystems in containers with k8s daemonsets are way easier to manage then with just the host.23:32
kfox1111SamYaple: https://github.com/kubernetes/kubernetes/pull/31504 is one of the issues.23:35
kfox1111kidn of a stopgap while the issue is discussed more.23:35
kfox1111SamYaple: https://github.com/kubernetes/kubernetes/pull/20698 is another option.23:36
*** schwicht has quit IRC23:36
kfox1111I kind of prefer the latter, but whatever. I don't really care so long as its finally solved.23:36
sbezverkkfox1111: ready to go: https://review.openstack.org/40510723:37
SamYapleshould be sweet23:37
SamYaplehey sbezverk and kfox1111 , might i suggest using openvswitch dpdk? its going to save you alot of headaches here23:37
SamYapleno kernel support needed23:38
SamYapleive been using it at the house for about 6 months, worth it23:38
kfox1111SamYaple: can the kolla containers support it? we're just using whats there.23:38
SamYapleits all userspace23:38
SamYaplewell its mostly userspace23:38
kfox1111if not, we need someone to add support to the containers.23:38
SamYapleoh you mean _currently_23:38
kfox1111sbezverk: nice.23:39
SamYapleno it cant, im working on a patch and a few other openstack things23:39
SamYaplefor kolla that is23:39
sbezverkSamYaple: dpdk is on to do list.. for now the main target is compute kit..23:39
kfox1111SamYaple: awesome. once its in, it should be pretty easy to enable?23:40
kfox1111if I remember, its justly just about hardware acceleration, right?23:40
SamYapleno its about not switching contexts23:40
SamYapleall the network processign is done in userspace23:40
SamYaplefaster iteration, more testing, more stable, less..... kernel23:41
kfox1111oh. I thought thats the layer I saw some network vendors hooking in direct vxlan hardware acceleration.23:41
SamYaplewell that exists in the traditional ovs23:41
openstackgerritMerged openstack/kolla-kubernetes: Hel-ming openvswitch-vswitchd  https://review.openstack.org/40510723:41
sbezverkkfox1111: we use dpdk a lot in cisco nfvi things23:41
kfox1111hmm. ok.23:41
kfox1111does it and up just being a config option in the end?23:42
kfox1111(just wondering how much kolla-kubernetes has to care)23:42
sbezverkkfox1111: it would be a differnet image for dpdk support I think23:43
kfox1111oh. it is a build time option?23:43
kfox1111so we'd just have, say a openvswitch container built with it, and choose the alternate container?23:43
sbezverkkfox1111: pretty much23:44
kfox1111k. soulnds easy to support on our end. :)23:44
SamYapleyep23:45
sbezverkkfox1111: I think plugging and defining bridge is a little differnet but from a client perspective it looks the same just faster23:45
SamYaplethats teh whole deal23:45
sbezverkSamYaple: Have you seen or played with vpp yet?23:46
SamYaplesbezverk: neither23:46
sbezverkSamYaple: it is even faster alternative to ovs/dpdk23:47
SamYapleis it ovs/vpp? or a different thing entirely23:47
kfox1111cool.23:47
SamYaplebecause im using OVS dpdk outside of openstack and then hooking openstack onto it23:47
sbezverkhttps://fd.io/technology23:47
sbezverka month or so ago there was announcement on neutron mailer it is called networking-vpp23:48
jascott1anyone seen %!s(<nil>)-logging as logging-configmap name?23:49
SamYapleinteresting23:49
kfox1111sbezverk: interesting. seems like a tradeoff between bandwidth and latency though.23:50
kfox1111jascott1: yeah. need a var defined in all_values.23:50
SamYaplekfox1111: they do talk about that, where latency is stable because of a few mechanics23:50
SamYaplekfox1111: but it was alot of "averge latency" talk23:50
kfox1111SamYaple: there's average, and there's low. ;)23:51
SamYaple:)23:51
kfox1111same with real time operating systems.23:51
SamYaplei meant averaged*23:51
sbezverkkfox1111: why do you say that? if you have sufficient horse power it can push 40/100g23:51
kfox1111they are predictable. they become predictable by running things really slow. :)23:51
SamYaplekfox1111: i sent you a pm with a question when you get a chance23:51
kfox1111sbezverk: it functions by batching. batching incurs latency.23:51
sbezverkkfox1111: dpdk always does that23:52
*** javcasalc has joined #openstack-kolla23:52
SamYapleyea sbezverk it looks comparable but younger if im reading it right23:52
sbezverkno matter which top level software uses it.. the good thing it uses pull mode23:52
SamYapleits interesting for sure23:52
sbezverkSamYaple: there was an article comparing performance of ovs/dpdk and vpp/dpdk and vpp showed more stable results under the stress23:53
jascott1kfox1111 funny when I add that key i dont see yaml from --dry-run anymore23:54
jascott1will look into it23:54
kfox1111jascott1: weird.23:54
jascott1let me try diff chart23:55
jascott1same thing for neutron server (i didnt change it since its already set with the logging configmap )23:56
SamYaplesbezverk: its added to my list :) thanks23:56
jascott1tools/helm_prebuild.py  && tools/helm_build_microservices.py ~/.helm/repository/local && helm install kolla/neutron-server --dry-run23:56
jascott1that will seriously suck for debbuging unless its just me doing something wrong23:57
sbezverkSamYaple: if you have question, let me know I have direct access to developers working on this beast..23:58
*** klindgren_ has joined #openstack-kolla23:58
SamYaplesbezverk: awesome. good to know23:59
sbezverkjascott1: it works on my side --dry-run --debug23:59
jascott1ok thanks23:59
*** rhallisey has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!