Tuesday, 2016-05-10

*** Jeffrey4l_ has joined #openstack-kolla00:10
*** MarMat_ has joined #openstack-kolla00:12
*** weiyu_ has joined #openstack-kolla00:14
*** MarMat has quit IRC00:16
*** MarMat_ has quit IRC00:17
*** rajathagasthya has quit IRC00:18
*** mark-casey has quit IRC00:18
*** ravig has joined #openstack-kolla00:21
*** diogogmt has joined #openstack-kolla00:25
*** ccesario___ has quit IRC00:26
*** weiyu_ has quit IRC00:26
*** jtriley has joined #openstack-kolla00:40
*** salv-orlando has joined #openstack-kolla00:42
*** ravig has quit IRC00:46
*** mbound has joined #openstack-kolla00:47
*** daneyon has joined #openstack-kolla00:47
*** salv-orlando has quit IRC00:48
*** daneyon has quit IRC00:52
*** mbound has quit IRC00:52
*** unicell1 has quit IRC00:55
*** unicell has joined #openstack-kolla00:56
*** sdake has joined #openstack-kolla01:02
sdakev1k0d3n still around?01:06
sdakev1k0d3n try to hunt me down tomorrow in the afternoon01:11
*** weiyu_ has joined #openstack-kolla01:17
*** unicell1 has joined #openstack-kolla01:17
*** unicell has quit IRC01:17
openstackgerritHui Kang proposed openstack/kolla: Do not use AUFS when building centos container images on ubuntu host  https://review.openstack.org/31420501:19
*** britthouser has quit IRC01:21
*** britthouser has joined #openstack-kolla01:21
*** mummer has quit IRC01:28
v1k0d3nsdake: sounds good. dude, thanks again! i'm really excited about getting started :)01:30
sdakev1k0d3n cool - aare you on win or mac so we can ru nwebex?01:31
*** kjelly has quit IRC01:37
*** sacharya has joined #openstack-kolla01:39
*** sacharya has quit IRC01:44
*** vhosakot has joined #openstack-kolla01:44
*** diogogmt has quit IRC01:44
*** salv-orlando has joined #openstack-kolla01:44
*** rhallisey has quit IRC01:48
*** dolpher has joined #openstack-kolla01:48
*** salv-orlando has quit IRC01:51
*** kjelly has joined #openstack-kolla01:54
*** unicell1 has quit IRC01:55
*** ravig has joined #openstack-kolla01:56
*** ravig has quit IRC02:02
*** sacharya has joined #openstack-kolla02:02
*** jtriley has quit IRC02:07
*** jtriley has joined #openstack-kolla02:15
*** ayoung has quit IRC02:17
*** daneyon has joined #openstack-kolla02:36
*** sean-k-mooney has joined #openstack-kolla02:39
*** daneyon has quit IRC02:41
*** coolsvap has joined #openstack-kolla02:41
*** allen_gao has quit IRC02:44
*** allen_gao has joined #openstack-kolla02:48
*** yuanying has quit IRC02:51
v1k0d3nmac02:51
v1k0d3nsdake: ^02:52
*** salv-orlando has joined #openstack-kolla02:53
*** salv-orlando has quit IRC02:54
*** klint has joined #openstack-kolla02:56
*** allen_gao has quit IRC02:57
*** mummer has joined #openstack-kolla02:58
*** allen_gao has joined #openstack-kolla03:04
*** sdake has quit IRC03:07
openstackgerritMerged openstack/kolla: Re-order the when condition in the cinder reconfigure  https://review.openstack.org/31097303:10
*** Jeffrey4l_ has quit IRC03:18
*** ravig has joined #openstack-kolla03:19
*** Jeffrey4l_ has joined #openstack-kolla03:19
*** ravig has quit IRC03:21
*** ravig has joined #openstack-kolla03:23
*** mummer has quit IRC03:32
*** godleon has joined #openstack-kolla03:35
*** ayoung has joined #openstack-kolla03:42
*** yuanying has joined #openstack-kolla03:48
*** salv-orlando has joined #openstack-kolla03:58
*** salv-orlando has quit IRC04:02
*** sdake has joined #openstack-kolla04:13
*** unicell has joined #openstack-kolla04:26
*** jtriley has quit IRC04:43
*** salv-orlando has joined #openstack-kolla04:57
*** fragatina has quit IRC04:59
*** sdake has quit IRC05:06
*** fragatina has joined #openstack-kolla05:17
*** daneyon has joined #openstack-kolla05:18
*** fragatina has quit IRC05:22
*** daneyon has quit IRC05:23
*** coolsvap has quit IRC05:25
*** fragatina has joined #openstack-kolla05:33
*** fragatina has quit IRC05:33
*** fragatina has joined #openstack-kolla05:34
*** vhosakot has quit IRC05:57
*** rajathagasthya has joined #openstack-kolla06:08
*** rajathagasthya has quit IRC06:12
*** berendt has joined #openstack-kolla06:19
berendtHi. Is Ansible 1.9.4 still a valid requirement or is it possible to use Ansible 2.0.x?06:22
*** ravig has quit IRC06:22
*** jmccarthy has joined #openstack-kolla06:29
*** jmccarthy has left #openstack-kolla06:30
*** gumbyblake has joined #openstack-kolla06:35
*** berendt has quit IRC06:36
*** berendt has joined #openstack-kolla06:36
*** neilus has joined #openstack-kolla06:40
*** Serlex has joined #openstack-kolla06:42
*** diga has joined #openstack-kolla06:46
*** sacharya has quit IRC06:53
*** diga has quit IRC06:57
*** salv-orlando has quit IRC07:05
*** daneyon has joined #openstack-kolla07:06
*** Mr_Broken has joined #openstack-kolla07:07
*** daneyon has quit IRC07:11
*** b_bezak has joined #openstack-kolla07:19
*** mikelk has joined #openstack-kolla07:34
*** diga has joined #openstack-kolla07:35
*** gumbyblake has left #openstack-kolla07:35
*** jtriley has joined #openstack-kolla07:39
*** dolpher has quit IRC07:42
*** diga has quit IRC07:43
*** sacharya has joined #openstack-kolla07:54
*** shardy has joined #openstack-kolla07:56
*** sacharya has quit IRC07:58
*** gfidente has joined #openstack-kolla08:08
*** sbezverk_ has joined #openstack-kolla08:08
*** sbezverk has quit IRC08:09
*** athomas has joined #openstack-kolla08:14
*** vincent_vdk has quit IRC08:28
*** vincent_vdk has joined #openstack-kolla08:28
openstackgerritChristian Berendt proposed openstack/kolla: Improve logging output of kolla-build command  https://review.openstack.org/31446008:34
*** vincent_vdk has quit IRC08:34
*** vincent_vdk has joined #openstack-kolla08:37
*** sacharya has joined #openstack-kolla09:00
*** sdake has joined #openstack-kolla09:01
*** jtriley has quit IRC09:04
*** jtriley has joined #openstack-kolla09:04
*** sacharya has quit IRC09:04
*** diga has joined #openstack-kolla09:11
openstackgerritMerged openstack/kolla: Make "cleanup-containers" script works dynamically  https://review.openstack.org/31352609:13
*** pbourke has quit IRC09:24
*** pbourke has joined #openstack-kolla09:24
*** salv-orlando has joined #openstack-kolla09:27
pbourkeberendt: currently09:28
pbourkeberendt: yes09:28
pbourkeberendt: initiall 2.x support being added currently09:29
berendtpbourke: thanks for the reply. is it planned to change this?09:29
berendtpbourke: ok09:29
*** sean-k-mooney has quit IRC09:29
*** salv-orlando has quit IRC09:32
*** ccesario___ has joined #openstack-kolla09:36
*** salv-orlando has joined #openstack-kolla09:38
*** salv-orlando has joined #openstack-kolla09:38
*** gfidente has quit IRC09:40
*** diga has quit IRC09:40
*** coolsvap has joined #openstack-kolla09:58
openstackgerritPaul Bourke proposed openstack/kolla: Improve Vagrants bootstrap.sh proxy support  https://review.openstack.org/31024610:13
*** SiRiuS has joined #openstack-kolla10:13
*** ccesario___ has quit IRC10:13
openstackgerritPaul Bourke proposed openstack/kolla: Improve Vagrants bootstrap.sh proxy support  https://review.openstack.org/31024610:14
openstackgerritPaul Bourke proposed openstack/kolla: Improve Vagrants bootstrap.sh proxy support  https://review.openstack.org/31024610:15
Mr_BrokenMorning guys10:31
Mr_BrokenAre there any deployment options available for customizing topology ?for stable/mitaka ?10:31
Mr_BrokenI need a separate compute node10:31
Mr_Brokenand want to have cinder10:32
Mr_Brokenand neutron_server with ovs on this compute node10:32
Mr_Brokenis there any way , to tell kolla deployer NOT to deploy specific dockers ?10:32
Mr_Brokenfor example deploy cinder_api and cinder_scheduler on controllers, but cinder_volume on Compute node ?10:32
Mr_Brokenalso I would like to split some nova services10:40
*** sdake has quit IRC10:42
*** daneyon has joined #openstack-kolla10:43
sbezverk_Mr_Broken you can achieve it by placing your hosts in a specific groups in inventory file.. Example host in storage group and networking group will not have deployed controllers' containers10:45
Mr_Brokenok , but my config is a bit weird10:45
Mr_Brokenfor example - i would like only cinder_storage service on compute node (instead of Storage node )10:46
Mr_Brokenand I need nova_libvirt and neutron_server + OVS installed as standalone on this compute node10:46
Mr_Broken(since there is no working LVM driver for stable/mitaka dockers )10:46
sbezverk_Mr_Broken Hvae you tried to place you compute node into compute group and into storage group at the same time?10:48
*** Serlex has quit IRC10:48
*** daneyon has quit IRC10:48
Mr_Brokenyes that would work fine10:48
Mr_Brokenbut what if i dont want a specific container to be deployed at all ?10:48
Mr_Brokenfor example i dont want nova_libvirt to be deployed at all10:48
sbezverk_Mr_Broken Sorry but how then you are going to start VMs?10:49
Mr_BrokenI will install nova standalone on this Bare Metal compute10:49
Mr_Brokenand just point it in config files to the Kolla10:50
Mr_Broken(since i require LVM Iscsi driver working for example )10:50
Mr_Brokenthats why i would like to NOT deploy some containers at all10:50
Mr_Brokeninstead of deploying them - and later on removing10:50
*** Serlex has joined #openstack-kolla10:51
Mr_Brokenso basicaly - half Kolla, half self Openstack :]10:51
sbezverk_Mr_Broken I see at this point I do not believe something like that exist. You can try to use enable_nova: "no" in globals.yaml, but I have never tried it myself..10:51
*** ccesario___ has joined #openstack-kolla10:52
Mr_Brokeni think there is to many Nova dependent services for that ;]10:52
Mr_Brokeni still want nova_scheduler and API running on COntrollers ;]10:52
Mr_Brokeni like this 3 node HA setup ;]10:52
Mr_Brokenbut i guess i just want to much :>10:52
Mr_Brokenthanks for the clarificatioj10:52
Mr_Brokenclarification*10:53
sbezverk_Mr_Broken np, is it a production env or test?10:53
Mr_BrokenPoC - but soon would like to have it prod ;]10:54
sbezverk_Mr_Broken I see, so cherrypick iSCSI support patch is not an option for you then..10:56
Mr_Brokennot yet10:57
Mr_Brokenwhen it will be merged to stable10:57
Mr_Brokenthan sure10:57
Mr_Brokenat least that was my architect decision :/10:58
sbezverk_Mr_Broken it is in master now, but it will be a part of Newton stable10:59
Mr_Brokenfor some stupid reason we are bound to use Mitaka still :/11:00
Mr_Brokeni think its because we will need some integration with 3rd party software like ICO11:00
*** sacharya has joined #openstack-kolla11:01
*** b_bezak has quit IRC11:01
Mr_Brokenand they are stuck with liberty now, moving to mitaka soon11:01
*** b_bezak has joined #openstack-kolla11:02
*** ccesario___ has quit IRC11:02
openstackgerritChristian Berendt proposed openstack/kolla: Improve logging output of kolla-build command  https://review.openstack.org/31446011:04
*** sacharya has quit IRC11:05
*** weiyu_ has quit IRC11:05
*** rhallisey has joined #openstack-kolla11:06
*** sdake has joined #openstack-kolla11:07
rhalliseysdake, morning11:08
*** godleon has quit IRC11:09
sdakezug11:09
openstackgerritPaul Bourke proposed openstack/kolla: Fix build for oraclelinux base  https://review.openstack.org/31077411:13
*** dims has quit IRC11:20
*** mlima has joined #openstack-kolla11:22
*** dims has joined #openstack-kolla11:25
openstackgerritMerged openstack/kolla-kubernetes: Keystone Service and Pod  https://review.openstack.org/31294411:28
*** b_bezak has quit IRC11:30
*** b_bezak has joined #openstack-kolla11:33
*** weiyu has joined #openstack-kolla11:37
*** papacz has quit IRC11:43
*** allen_gao has quit IRC11:44
*** lukl has joined #openstack-kolla11:49
openstackgerritRyan Hallisey proposed openstack/kolla: Spec: Deploy Kolla images using Kubernetes  https://review.openstack.org/30418211:49
*** sdake has quit IRC11:56
*** weiyu has quit IRC11:57
*** gfidente has joined #openstack-kolla11:57
*** dwalsh has joined #openstack-kolla11:59
*** sdake has joined #openstack-kolla12:02
*** weiyu_ has joined #openstack-kolla12:08
*** ozialien10 has quit IRC12:08
*** sdake_ has joined #openstack-kolla12:08
*** ozialien10 has joined #openstack-kolla12:09
*** sdake has quit IRC12:11
*** Liuqing has joined #openstack-kolla12:11
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Spec: Deploy Kolla images using Kubernetes  https://review.openstack.org/30418212:15
coolsvaprhallisey, updated some minor typos in kubernetes spec12:15
rhalliseycoolsvap, thanks12:16
coolsvapnp just wanted to let you know what i updated12:17
*** jtriley has quit IRC12:17
*** weiyu_ has quit IRC12:23
*** Liuqing has quit IRC12:25
*** Liuqing has joined #openstack-kolla12:27
*** Mr_Broken has quit IRC12:28
*** Mr_Broken has joined #openstack-kolla12:29
*** weiyu_ has joined #openstack-kolla12:30
*** Mr_Broken has quit IRC12:34
*** coolsvap has quit IRC12:47
*** coolsvap has joined #openstack-kolla12:48
*** salv-orlando has quit IRC12:49
*** coolsvap has quit IRC12:50
*** coolsvap has joined #openstack-kolla12:50
*** SiRiuS has quit IRC12:55
*** jtriley has joined #openstack-kolla12:56
*** mbound has joined #openstack-kolla12:57
*** SiRiuS has joined #openstack-kolla12:59
*** klint has quit IRC13:00
*** sacharya has joined #openstack-kolla13:02
*** mbound has quit IRC13:02
*** dave-mccowan has joined #openstack-kolla13:03
*** salv-orlando has joined #openstack-kolla13:03
*** sacharya has quit IRC13:06
*** neilus1 has joined #openstack-kolla13:07
*** neilus has quit IRC13:11
*** Mr_Broken has joined #openstack-kolla13:15
ccesariomorning guys!13:22
*** daneyon has joined #openstack-kolla13:25
*** daneyon has quit IRC13:30
*** esharao has joined #openstack-kolla13:30
sbezverk_mlima ping13:40
*** berendt has quit IRC13:40
mlimasbezverk_, :)13:41
*** weiyu_ has quit IRC13:41
*** signed8bit has joined #openstack-kolla13:43
*** maestro1 has joined #openstack-kolla13:45
sbezverk_mlima I wanted to check with you if you had a chance to see my reply for your review :-)13:46
mlimasbezverk_, no, i'm sorry13:47
mlima:/13:47
openstackgerritDavanum Srinivas (dims) proposed openstack/kolla-kubernetes: Switch on warnerrors and universal wheel  https://review.openstack.org/31313713:47
mlimai'll do it now13:47
sbezverk_mlima thank you, I have not changed anything just provide the logic behind why I think it should be done this way :-)13:48
*** SiRiuS has quit IRC13:48
*** Mr_Broken has quit IRC13:49
*** Mr_Broken has joined #openstack-kolla13:50
*** sean-k-mooney has joined #openstack-kolla13:50
dimscoolsvap : any feedback on https://review.openstack.org/#/c/313958/ ? it would be great to get that in and then iterate as it's mostly just copied code from older repos13:51
patchbotdims: patch 313958 - kolla-kubernetes - Implement a command line to start/stop keystone se...13:51
*** SiRiuS has joined #openstack-kolla13:53
openstackgerritPaul Bourke proposed openstack/kolla: Debug oraclelinux deploy gates  https://review.openstack.org/30098813:53
*** coolsvap has quit IRC13:54
openstackgerritPaul Bourke proposed openstack/kolla: Debug oraclelinux/centos rabbitmq deploy issue  https://review.openstack.org/30098813:55
*** Liuqing has quit IRC13:56
*** MarMat has joined #openstack-kolla13:58
openstackgerritMerged openstack/kolla-kubernetes: Switch on warnerrors and universal wheel  https://review.openstack.org/31313714:02
*** SiRiuS has quit IRC14:06
sean-k-mooneyo/ how are everyone today14:14
rhalliseyhey sean-k-mooney14:17
*** neilus1 has quit IRC14:18
*** jtriley has quit IRC14:24
rhalliseydave-mccowan, morning14:24
dave-mccowangood morning ryan14:24
rhalliseydave-mccowan, can you try to add your custom mariabd, kibana, and elastic search repos into the base directory14:24
rhalliseyand replace the ones that are there14:25
rhalliseydave-mccowan, add those repos to rpm_config_setup is tricky because they are meant to be global14:25
rhalliseywhere as rpm_setup_config is not14:25
dave-mccowanwhat about the gpg signatures?  those are hard coded too, instead of being read from the .repos14:26
rhalliseyugh this hardcoding is not ideal...14:28
dave-mccowanrhallisey the other approach i was considering is to add config variables, that can be global, such as {{ mariadb_repo }}, {{ kibana_rep }}, etc.  but the Dockerfile.j2 would still need to be fixed to use all the params in the .repo files.14:29
*** SiRiuS has joined #openstack-kolla14:30
rhalliseydave-mccowan, I think that is better14:35
rhalliseysince these repos are exceptions14:36
dave-mccowanrhallisey what about line 85 of base/Dockerfile.j2?  epel release for rhel is also hard coded to an rpm at https://mirror.centos.org/14:39
rhalliseyI think that's also going to need to be abstracted out14:40
rhalliseythis is kinda of a mess.. oracle linux also has epel + gpg keys14:40
*** b_bezak has quit IRC14:41
*** jamie_h has joined #openstack-kolla14:42
dave-mccowanrhallisey i think we're on the same page now. :-)  it seems like each package is installed a little bit differently too.  (some with curl, some copy, some yum, some rpm)  i haven't been able to figure out the "right" way to attempt to make them consistent, so then it would be easier to make them customizable.14:44
rhalliseyya it's not completely consumable14:46
rhalliseycustomizable rather14:46
rhalliseymay need a blueprint for this one.. :)14:46
rhalliseybunch of cleanup to do14:46
dave-mccowanrhallisey it's tempting to make an install_metatype == "custom" setting, to branch out of the current template to get it to work for an all-custom build, and leave the current code as technical debt.14:47
rhalliseyya I can see how that's tempting14:48
sbezverk_rhallisey have a second for qq?14:49
rhalliseydave-mccowan, I don't think I can get to this today, but maybe later this week14:50
rhalliseysbezverk_, ya what's up14:50
rhalliseydave-mccowan, the patch I came up with last night I don't like :(14:50
sbezverk_rhallisey currently kolla stores config on target host in /etc/kolla/, in kubernetes this will not be the case right?14:50
sbezverk_otherwise we loose "mobility" of pod14:51
rhalliseysbezverk_, ya we'll plan on copying the configs to the same place14:51
dave-mccowanrhallisey is your patch a good starting point?14:51
rhalliseyon all nodes14:51
rhalliseydave-mccowan, I don't think so. I added a global_config field14:52
rhalliseydave-mccowan, it functions like rpm_config_setup14:52
LyncosYesterday someone talk about Weavescope ...14:52
rhalliseyit works, but it doesn't fix the gpg key issue14:52
rhalliseybut I could add that14:52
rhalliseydave-mccowan, here I'll just post it14:52
rhalliseydave-mccowan, so you can see for yourself14:53
sbezverk_rhallisey why do not we completely stop using host(workers) to store config and use configmap for all confiugration related activities?14:56
esharaohi guys..14:57
esharaoqq14:57
esharaois it possible to start the kolla deployment on a VM.. or do i need a physical host to start14:57
*** huikang has joined #openstack-kolla14:57
openstackgerritRyan Hallisey proposed openstack/kolla: Allow the base container to be more customizable  https://review.openstack.org/31461414:58
rhalliseydave-mccowan, ^14:58
rhalliseyesharao, you can use a vm14:59
esharaoi tried to use the vagrant stuff via a virtual box .. but dont think thats the right way14:59
rhalliseyI've never used the vagrant stuff unfortunately15:00
esharaook..let me poke around more.. thanks rhallisey15:00
rhalliseyno problem15:00
*** huikang has quit IRC15:01
rhalliseysbezverk_, I'm still thinking about the configmap thing15:01
rhalliseykfox brought up a good point about using deployments and triggering a rolling upgrade for reconfigure15:01
*** ntpttr- has joined #openstack-kolla15:03
sbezverk_rhallisey I see, I got configmap working and it looks pretty good.. it seems they would allow to store all process' config files, so no need to store anything on the worker15:04
*** Jeffrey4l_ has quit IRC15:05
*** ntpttr has quit IRC15:06
*** huikang_ has joined #openstack-kolla15:07
*** sacharya has joined #openstack-kolla15:09
*** rmart04 has joined #openstack-kolla15:11
*** ntpttr- is now known as ntpttr15:14
*** ntpttr has left #openstack-kolla15:16
*** anbehl has quit IRC15:16
rhalliseysbezverk_, where would it get stored then?15:17
rhalliseyin /var/lib/docker on the host? In other words the container?15:18
*** huikang_ has quit IRC15:18
rhalliseydave-mccowan, let me know if that patch helps at all15:18
*** anbehl has joined #openstack-kolla15:18
rhalliseyyou will still need to change the repos in that directory15:19
rhalliseyand I'll have to add gpg keys in there too15:19
rhalliseydims, I'm trying to run the cli, but I'm not having any success15:20
*** kbyrne has quit IRC15:22
*** jtriley has joined #openstack-kolla15:23
*** vhosakot has joined #openstack-kolla15:23
dave-mccowanrhallisey percona is handled differently than the other 3 in this list.  we should make them consistent.  which way do you think is right? (using yum install or COPY)15:23
rhalliseydave-mccowan, well percona is a link15:24
*** rhallisey has left #openstack-kolla15:24
*** rhallisey has joined #openstack-kolla15:25
*** ravig has joined #openstack-kolla15:25
dimsrhallisey : i bet there's some sensitivity in _load_variables_from_file, i'll add more LOG.debug(s) later today15:25
dave-mccowanthe others have links too, they are just inside the .repo file.  rhallisey do you think we should change percona to also use a .repo file?15:26
sbezverk_rhallisey I think so, what is important k8s should be taking care of config "mobility" in case pod moves15:26
rhalliseydims, awesome thanks dims.  I'll hopefully have a review up for it soon15:26
rhalliseydave-mccowan, it doesn't make a difference because I'm using the same function as rpm_setup_config, which can accept links, rpms, or .repo files15:27
sbezverk_rhallisey I am trying to bring up yuor kesytone pod and service using configmap and test, I have 2 workers..15:27
rhalliseysbezverk_, yes I agree15:28
*** sacharya_ has joined #openstack-kolla15:29
rhalliseydims, were you running this from /usr/share/kolla-kubernetes?15:30
*** sacharya has quit IRC15:31
dave-mccowanrhallisey if we support all three methods, then we need to support 3 ways of providing a gpgkey.15:31
dimsrhallisey : i pip installed kolla. then was running kolla-kubernetes from within a venv (py27)15:31
rhalliseydave-mccowan, see the comment https://review.openstack.org/#/c/314614/15:33
patchbotrhallisey: patch 314614 - kolla - Allow the base container to be more customizable15:33
rhalliseydave-mccowan, the alternative is to document document15:34
rhalliseystill does leave tech debt though15:34
*** kbyrne has joined #openstack-kolla15:36
dave-mccowanrhallisey that's an interesting approach.  just make the base/Dockerfile.j2 an operator input file.  if so, it should be passed as a parameter to kolla-build, so it doesn't need to be modified in branch.15:37
dave-mccowanrhallisey if we expect operators to modify that file, it makes addressing the inconsistencies even more important.15:38
cineramasean-k-mooney, hi are you around?15:38
*** rhallisey has quit IRC15:39
sean-k-mooneycinerama: hi yes15:40
*** kbyrne has quit IRC15:40
*** rhallisey has joined #openstack-kolla15:40
d_codebefore I create a new blueprint (I guess this is where this would go), can anyone confirm that today you cannot (directly) deploy kolla as a non-root user via ansible’s --become, right?15:40
*** kbyrne has joined #openstack-kolla15:40
dave-mccowanrhallisey i think the better approach is to let operators change the .repo files.  we just need to get the Dockerfile template to consume them properly/completely.15:40
d_codeI’m working in an environment where users are not allowed to SSH directly as root15:40
rhalliseyd_code, I think there is a way sdake_ might know15:41
d_codeI was able to do it using ansible directly, but it’s dead simple…just pass the become flag15:41
sean-k-mooneyrhallisey i belive you need to play with your sudoers file but sdake did mention that it should work at the summit15:41
rhalliseywhat's the become flag?15:42
d_codeansible-playbook --become15:42
d_codeit invokes sudo on the remote system15:42
*** Mr_Broken has quit IRC15:43
cineramasean-k-mooney: hey i've been following the kolla/bifrost thread & i just started looking at what you've done as a POC15:43
rhalliseyd_code, ok gotcha15:43
sean-k-mooneycinerama: its a horible hack but its partly working.15:43
rhalliseyd_code, I think there is as sean-k-mooney also mentioned15:43
rhalliseyI don't know personally though, sdake_ would know when he's back15:44
rhalliseyd_code, either way, there is no docs around it15:44
cineramawrt venv issues, in our install playbook we do support installation into a venv...you would need to bootstrap the install by creating a venv and installing ansible into it like we do in the env setup script15:44
rhalliseyd_code, so a blueprint would be an excellent idea15:44
d_coderight…  would something like this go as a bug or blueprint?15:44
d_codek15:44
d_codeI”ll file it15:44
rhalliseyawesome thx15:44
*** mummer has joined #openstack-kolla15:45
*** mikelk has quit IRC15:45
cineramasean-k-mooney: also, i think we should be able to split up the installation of services and starting the services into different roles15:45
rhalliseydave-mccowan, I think it will be a matter of opinion of whether operators consume by changing the dockerfile or not15:45
rhalliseyI'm not sure what is right, but what we have now is inconsistent15:46
rhalliseysince you can only do it for non source centos builds15:46
sean-k-mooneycinerama: actully i think the venv support is the problem. in source mode it uses the venv but when ansible runs i dont think its useing the system python and not finding the packages in the venv15:46
cineramasean-k-mooney: oh also just in general i've been hanging out here if folks want to ask stuff about bifrost15:46
*** kbyrne has quit IRC15:47
*** sdake_ has quit IRC15:47
sean-k-mooneycinerama: did you look at how i refactored the bifrost install playbook? https://github.com/SeanMooney/bifrost/commit/e223f4fe73871b76ce87999470a1efc43862671e15:48
cineramahuh. so you're running the ansible that lives in the venv and it's not seeing other stuff in that venv?15:48
sean-k-mooneycinerama: am ansible is installed in /opt/stack/ansible but kola has a venv in /usr/lib/kolla/venv i think15:49
*** sdake has joined #openstack-kolla15:50
*** maestro1 has quit IRC15:50
*** dwalsh has quit IRC15:51
cineramasean-k-mooney: and who/what is installing ansible? bifrost, or something else?15:51
*** sdake_ has joined #openstack-kolla15:54
*** sdake has quit IRC15:57
sean-k-mooneybifrost kolla and me are all installing ansible. at different points.15:58
sean-k-mooneycinerama: ansible is available during the the container build form kolla but seams to be missing after so i explicitly installed it form pip16:00
cineramainteresting16:00
sean-k-mooneycinerama: bifrost also installs it to /opt/stack/ansible16:00
*** Avi82 has joined #openstack-kolla16:00
cineramayup that's right. you can also do export VENV=/path/to/venv and put it in a venv16:00
cineramaand the other playbooks should pick up that environment variable, or you can do -e and specify it to ansible when you run the playbooks16:01
sdake_sup16:01
openstackgerritRyan Hallisey proposed openstack/kolla: Allow the base container to be more customizable  https://review.openstack.org/31461416:01
sean-k-mooneycinerama: ah i will try that tonight.16:01
cineramaright, -e bifrost_venv_dir16:02
cineramaand -e enable_venv=true16:02
sean-k-mooneycinerama: but will that install bifrost in a venv? that might work but i was trying to install it system wide but maybe i need to install it into the kolla venv16:03
cineramai had a quick look at the playbooks, just at a high level i think that's about what i would have done16:03
cineramasean-k-mooney: it will install it into a venv. by default that will be in /opt/stack/bifrost but you can change the location & use an existing venv if you wanted to put it in the kolla one16:03
*** mark-casey has joined #openstack-kolla16:05
sean-k-mooneycinerama: ok well that is something to try. i would like to reuse as much of bifrost as i can with as few changes as possible ideally.16:06
sean-k-mooneycinerama: i have been doing this poc with my home server so i will have to take a look at it when i leave the office.16:06
*** mlima_ has joined #openstack-kolla16:09
*** stvnoyes has joined #openstack-kolla16:12
*** sacharya_ has quit IRC16:12
*** mlima has quit IRC16:13
*** berendt has joined #openstack-kolla16:15
*** dwalsh has joined #openstack-kolla16:16
d_codesdake_: just created a blueprint proposing ansible —become support16:17
sean-k-mooneysdake_: i dont know if you saw my mail eairlier regarding the bifrost poc. im hoping to get it to the point where i can run the deploy_dynamic playbook and have it provision a server.16:18
sean-k-mooneysdake_: currently i have got as far as starting the bifrost container enroling the nodes and building the os image with disk image builder.16:19
sdake_that sound spretty far :)16:20
sdake_d_code you can run koll as nonroot currently16:20
sdake_the permissions on the directories have to be perfectly setup16:20
d_codehmm….  so the ssh user needs to be in the docker group…and there are config files that go in /etc, right?16:21
sean-k-mooneysdake_: the codes a little rough around the edges but  when the node is enroled ironic can manage the power state via ipmi  but i need to do figure out why the dynamic deploy is broken. ill try some of cinerama's tips and see if it helps tonight16:22
sdake_cool - so you broke up the playbook into 3 parts ?16:23
sdake_just so everyone is aware, I have a stomach virus or flu of some sort16:23
sdake_so today I am not at my best - i'm probably going to be in bed most of the day16:24
sean-k-mooneysdake_: yes it can probably be done a better way then how i did it but i have.16:24
sean-k-mooneysdake_: that sucks :(16:25
britthouserSorry sdake_ =(16:26
openstackgerritChristian Berendt proposed openstack/kolla: Improve logging output of kolla-build command  https://review.openstack.org/31446016:27
*** dwalsh has quit IRC16:27
*** thomasem has left #openstack-kolla16:29
mark-caseycinerama: sean-k-mooney: would you guys be up for converting the skip_* vars to tags on either the tasks or include statements? http://docs.ansible.com/ansible/playbooks_tags.html   <(specifically the section: "And you may also tag basic include statements")16:30
mark-caseyso... 'ansible-playbook -vvvv -i /bifrost/playbooks/inventory/localhost /bifrost/playbooks/install.yaml --skip-tags: bf_service_start_and_start_dependent'16:30
*** berendt has quit IRC16:31
sean-k-mooneymark-casey: ansible is not my strongest language so if there is a better(more native) way to do it i would be happy to try it.16:31
sean-k-mooneymark-casey:  i think cinerama was also suggesting splitting it into seperate roles as another option so you would have 3 roles: install,bootstrap and start16:33
sean-k-mooneymark-casey: since bifrost already had a skip_install i just copied the pattern and introduced skip_bootstrap and skip_start16:36
cineramayes we haven't been using tags16:36
sdake_hey cinerama are you a bifrost dev?16:38
*** sdake_ is now known as sdake16:38
sdakesean-k-mooney 3 roles would be the way to roll :)16:38
*** stvnoyes has left #openstack-kolla16:39
sdakethen you could run one tag at a time vs skip_tag16:39
sdakerather skip_install16:39
sdakenot sure what that is16:39
cineramasdake: i am!16:39
*** huikang has joined #openstack-kolla16:39
sdakecool have we met in person16:40
*** berendt has joined #openstack-kolla16:40
sdakehappy to have you in channel :)16:40
mark-caseycinerama: with the roles option would that be like "- { role: bootstrap, when: "skip_bootstrap" not defined  }"?16:40
sdakewe really want to do what is right by bifrost here16:41
sdakerather then ram our agenda down your throats ;)16:41
sdakeso tell us where we are going wrong, and we can adjust16:41
sdakethe vm idea - i get that - but that is pretty much not ideal for us16:41
sdakei can live with a fat container16:41
sdakei think logn term it may or may not make sense to go thin containers16:41
sdakebut lets take it one step ata time :)16:42
mark-caseycinerama: IIRC conditonal roles apply the when ANDed to all tasks in the role. So that would be similar to the current skip_install but easier to read since not written into every single when16:42
cineramamark-casey: so i think what we'd do there is have a boolean to define whether or not we run bootstrap etc16:42
cineramamark-casey: yeah we could put the conditional at the higher level where we call the role - that's why i thought splitting it up would be a good fit16:43
*** diogogmt has joined #openstack-kolla16:43
mark-caseyyea makes sense.16:43
sean-k-mooneymark-casey: i placed the skip_* on the include to avoid repeating it an split the main.yml taks into 3 files16:44
cineramawe could probably also have some kind of container related boolean and then use supervisord vs systemd etc?16:44
sean-k-mooneywell systemd does work in a container now though many still dont like the idea16:45
cineramawe would have to try it16:45
sean-k-mooneyjust to get the poc working i was using systemd as the init system in the container so i could reuse the service files provided by the OS16:46
v1k0d3nsdake: hey man. what time works for you to get together?16:46
sdakev1k0d3n vomiting today16:47
sdakeso not sure how i'll feel this afternoon16:47
sdakecan we play it by ear?16:47
*** berendt has quit IRC16:47
v1k0d3nabsolutely. sorry to hear :(16:47
sdakehazard of having children16:47
*** sacharya has joined #openstack-kolla16:47
cineramasean-k-mooney: that makes sense - also in bifrost we try to iterate towards stuff rather than having massive changes where we can16:48
*** gfidente has quit IRC16:48
*** gfidente has joined #openstack-kolla16:48
*** sacharya has quit IRC16:50
*** sacharya has joined #openstack-kolla16:50
sdakecinerama ack on iteration16:51
sdakesean-k-mooney basically make small changes that lead to big changes over time :)16:52
sdakebut it doesns't have to be big change to start16:52
cineramayep16:52
sdakesean-k-mooney if you need help decomposing your patch stream i can provide comments/review, just let me know where the review is16:52
sean-k-mooneysdake: yep i agree with that aproch too.16:52
sdakesean-k-mooney i'm glad your taking this on, I was getting ready toget started on this proect persoanlly16:53
sdakeand I'm super overloaded16:53
cineramayes i'd like to review and stuff too. and test16:53
sdakedoes bifrost have gate jobs?16:53
sdakecinerama ^^16:54
cineramayeah we do a test install & deploy16:55
*** unicell has quit IRC16:55
cineramayou can look at the test scripts in the scripts dir to see what we do16:55
sean-k-mooneysdake: well this is currently a gap in the kolla install story and i would personally like to have this so i can clean down my own servers quickly too.16:56
*** ravig has quit IRC16:56
sdakeya - huge huge gap16:56
*** huikang has quit IRC16:56
sean-k-mooneycinerama: ye use the agent_ssh driver in the gate right and test with vms?16:56
sdakecinerama what some cores have proposed is taking our ironic implementation we have today and making it a standalone since much of the stuff is already containerized16:57
*** berendt has joined #openstack-kolla16:57
sdakeand running it on the undercloud16:57
sdakebut i'd rather not duplicate all the work of bifrost16:58
sdakegod i hate undercloud/overcloud terminology16:58
sdakeso terrible16:58
cineramayes16:58
cineramayes we use agent_ssh & vms16:59
mark-caseysdake: yeeeeesss. do not want (over/under)17:00
sean-k-mooneytrippleo gets a little confusing sometimes... conatinesed trippleo evenmore so17:01
*** pbourke has quit IRC17:01
sean-k-mooneysdake: we tried(are still trying) to deploy kolla with the ironic driver a few weeks ago and hit alot of problems17:01
sean-k-mooneysdake: do you know if anyone has successfully deployed it recently?17:02
sdakedeployed kolla?17:03
sdakeor ironic?17:03
sdakekolla mitaka works fantasically for me on my 3 node gear17:03
sdakeliberty is still waiting on a workflow from any of our 12 core reviewers17:03
sean-k-mooneyironic or rather kolla with the the iroinc nova driver17:03
* sdake selling first born17:03
sdakeya kolla ironic implementation is tech preview, it probably doesn't workt he way you would want it to17:04
sdakewhich is as a way to schedule either bare metal or virtual machines via nova17:04
sdakethat is how I want it to work17:04
sdakebut jpeeler doesn't think it can be made to do that17:04
sean-k-mooneyam we were only trying to deploy barmetal17:05
sdakeyup - not sure if that even wroks17:05
sdakei haven't tested it persoanlly17:05
sdakeits a work in progress IMO17:05
sean-k-mooneythe issue we had is that pxe infoH17:05
sdakei can confirm I have *not* persoanlly tested kolla's implementation of ironic17:06
sean-k-mooneythe dhcp server was configure with the neutron port uuid instead of the chassi guid so the server never got a reply to the pxe boot form the dhcp server17:06
sdakeI know its close17:06
sdakebut devil i ndetails17:06
*** sacharya has quit IRC17:08
*** sacharya has joined #openstack-kolla17:08
openstackgerritMerged openstack/kolla: Changes needed to deploy liberty with mitaka code  https://review.openstack.org/30839017:13
*** ccesario___ has joined #openstack-kolla17:13
*** jmccarthy1 has joined #openstack-kolla17:14
*** rmart04 has quit IRC17:15
*** SiRiuS has quit IRC17:15
*** athomas has quit IRC17:17
openstackgerritRyan Hallisey proposed openstack/kolla: Doc rework for quickstart, multinode, and image-building  https://review.openstack.org/31188417:17
sdakerhallisey you up for releasing liberty now17:21
rhalliseyya17:21
sdakegit pull http://github.com/openstack/releases17:21
sdakepull/clone17:21
*** gfidente has quit IRC17:22
sdakefind the _independent directory17:22
*** ccesario___ has quit IRC17:23
openstackgerritRyan Hallisey proposed openstack/kolla: Allow the base container to be more customizable  https://review.openstack.org/31461417:23
*** ccesario___ has joined #openstack-kolla17:23
sdakefind the kolla.yml file17:23
sdakeedit it17:23
*** unicell has joined #openstack-kolla17:23
sdakeand do the right thing with it ;)17:23
rhalliseysdake, so is this 1.0.1?17:24
sdakeNO17:24
sdake1.1.017:24
rhallisey1.117:24
rhalliseyright17:24
rhalliseymeant that17:24
sdakedont forge the .0 :)17:24
sdakedo a git pull of kolla to find the git sha17:25
sdakerather git clone17:25
sdakeand checkout stable/liberty branch17:25
*** SiRiuS__ has joined #openstack-kolla17:27
rhalliseysdake, does the commit message matter?17:28
sdakesay somethign like "Release of Kolla Liberty 1.1.0"17:28
rhalliseyrather does it need to be something specific17:28
rhalliseyok17:28
rhalliseyhttps://review.openstack.org/31469017:28
*** ravig has joined #openstack-kolla17:29
*** ccesario___ has quit IRC17:36
mark-caseycinerama: sean-k-mooney: fair warning this is a little unorthodox... but if you're wanting to split the ironic tasks into roles this method prevents hundreds of skipped tasks in ansible-playbook output. Also (unless the 'when:'s are changed to tags, you'd still use -e options as you are now)17:36
mark-caseyhttps://github.com/ropsoft/bifrost/commit/148b434f81bc2aac8ac2ee7991ea67d845c7c22e17:36
mark-caseyessentially, run roles in 3 separate plays which are selected based on localhost being aliased into each of 3 targeted groups17:37
cineramainteresting idea17:38
mark-caseyI admit its a little magic-heavy but I'm pretty sure any other combination of includes or roles with whens or tags will have all tasks print with skipped, vs here it would just be [no hosts matched]17:40
*** ravig has quit IRC17:40
mark-caseyerr, maybe tags wouldn't print all skipped; would have to try it17:41
*** shardy has quit IRC17:41
*** ravig has joined #openstack-kolla17:41
*** neophy has joined #openstack-kolla17:46
*** absubram has joined #openstack-kolla17:50
*** ravig has quit IRC17:50
*** dwalsh has joined #openstack-kolla17:53
*** Serlex has quit IRC17:54
*** ravig has joined #openstack-kolla17:59
*** rmart04 has joined #openstack-kolla17:59
*** SiRiuS__ has quit IRC18:01
sean-k-mooneymark-casey: it took a couple of glances to figure our exactly what your patch does but i get it now.18:02
sean-k-mooneymark-casey: with that change you will only get a skip missage for the add to the group if the group is skipped18:02
dimsrhallisey : around?18:07
rhalliseydims, ya18:08
dimsrhallisey : didn't see a review from you yet, was wondering if you made progress18:08
rhalliseyI haven't gotten to it yet. I have to handle something internal real quick18:09
dimsrhallisey : ack thanks18:09
rhalliseydims, I haven't gotten it to work yet, still tracing the issue18:09
rhalliseybut I will come back to it in the next 30 min18:10
*** ravig has quit IRC18:12
*** ravig has joined #openstack-kolla18:13
mark-caseysean-k-mooney: yes. So mostly an output thing since we'll have to run it 2-3 times, but just trying to think of different ways to split it up in hopes of finding the best place to put the complexities18:18
*** SiRiuS__ has joined #openstack-kolla18:20
*** thumpba has joined #openstack-kolla18:25
*** haplo37 has joined #openstack-kolla18:26
*** sacharya has quit IRC18:31
*** haplo37 has quit IRC18:40
*** dwalsh has quit IRC18:42
*** dwalsh has joined #openstack-kolla18:42
*** thumpba has quit IRC18:44
*** berendt has quit IRC18:45
*** thumpba has joined #openstack-kolla18:46
*** berendt has joined #openstack-kolla18:47
*** ravig has quit IRC18:47
*** ravig has joined #openstack-kolla18:49
*** sdake has quit IRC18:52
openstackgerritHui Kang proposed openstack/kolla: Implement ceilometer ansible role  https://review.openstack.org/30057418:55
openstackgerritHui Kang proposed openstack/kolla: Implement ceilometer ansible role  https://review.openstack.org/30057418:59
*** salv-orl_ has joined #openstack-kolla19:02
*** fragatina has quit IRC19:02
openstackgerritHui Kang proposed openstack/kolla: Add Kuryr ansible role  https://review.openstack.org/29889419:03
*** rmart04 has quit IRC19:04
*** salv-orlando has quit IRC19:05
*** fragatina has joined #openstack-kolla19:09
*** mnaser has left #openstack-kolla19:10
*** ravig has quit IRC19:11
*** Avi82 has quit IRC19:13
*** Avi82 has joined #openstack-kolla19:17
*** jmccarthy1 has quit IRC19:19
*** sacharya has joined #openstack-kolla19:22
*** rmart04 has joined #openstack-kolla19:24
*** neophy has quit IRC19:24
*** neophy has joined #openstack-kolla19:30
*** ravig has joined #openstack-kolla19:30
*** godleon has joined #openstack-kolla19:31
*** rmart04 has quit IRC19:32
*** rmart04_ has joined #openstack-kolla19:32
*** dwalsh has quit IRC19:38
*** rmart04 has joined #openstack-kolla19:40
*** rmart04_ has quit IRC19:41
*** ravig has quit IRC19:45
*** ravig has joined #openstack-kolla19:46
*** esharao_ has joined #openstack-kolla19:47
*** rmart04_ has joined #openstack-kolla19:48
*** rmart04 has quit IRC19:49
*** rmart04_ is now known as rmart0419:49
*** erhudy has joined #openstack-kolla19:49
*** ravig has quit IRC19:50
*** esharao has quit IRC19:51
*** mlima_ has quit IRC19:54
*** dcwangmit01 has joined #openstack-kolla19:54
*** rmart04 has quit IRC19:55
*** ravig has joined #openstack-kolla19:56
*** ravig has quit IRC19:57
*** dcwangmit01 has quit IRC19:59
*** dcwangmit01 has joined #openstack-kolla19:59
*** rmart04 has joined #openstack-kolla19:59
mark-caseycinerama: sean-k-mooney: this is probably a prereq https://bugs.launchpad.net/bifrost/+bug/158032219:59
openstackLaunchpad bug 1580322 in bifrost "skip_install usage appears inconsistent" [Undecided,New]19:59
*** unicell has left #openstack-kolla20:04
*** rmart04 has quit IRC20:04
*** rmart04 has joined #openstack-kolla20:05
*** unicell has joined #openstack-kolla20:05
*** absubram has quit IRC20:06
*** rmart04_ has joined #openstack-kolla20:07
*** rmart04 has quit IRC20:09
*** rmart04_ is now known as rmart0420:09
*** haplo37 has joined #openstack-kolla20:12
*** sacharya_ has joined #openstack-kolla20:13
*** rmart04_ has joined #openstack-kolla20:14
*** ravig has joined #openstack-kolla20:14
*** rmart04 has quit IRC20:14
*** rmart04_ is now known as rmart0420:14
cineramamark-casey, thanks for filing the bug, i'll have a look soon20:15
*** ravig has quit IRC20:15
*** ravig has joined #openstack-kolla20:15
*** sacharya has quit IRC20:16
*** ravig has quit IRC20:21
*** rmart04 has quit IRC20:23
*** ravig has joined #openstack-kolla20:25
*** fragatina has quit IRC20:27
*** aNupoisc has joined #openstack-kolla20:27
aNupoiscHi guys I am new to deployment of openstack using kolla and following http://docs.openstack.org/developer/kolla/quickstart.html20:29
aNupoiscI am getting "Get https://172.16.2.2:4000/v1/_ping: tls: oversized record received with length 20527" while building container images20:29
aNupoischave anybody come across the same error20:30
aNupoiscI am executing ~/kolla/tools/build.py -b ubuntu -t source --registry 172.16.2.2:4000 --no-cache --push for building the container images20:30
*** absubram has joined #openstack-kolla20:33
*** daneyon has joined #openstack-kolla20:38
*** jtriley has quit IRC20:39
vhosakotaNupoisc: do you have TLS enabled ?20:40
vhosakotaNupoisc: https://github.com/openstack/kolla/blob/master/etc/kolla/globals.yml#L9320:40
aNupoiscYes TLS is enabled20:42
aNupoiscTLSv1.220:42
*** daneyon has quit IRC20:43
aNupoiscvhosakot: is is "no" in globals20:44
aNupoiscshould it be "yes"20:44
aNupoiscbut kolla_enable_tls_external: "no" is commented out20:44
vhosakotno.. default is "no", which means TLS is disbabled20:45
aNupoiscOkay shall i make it "yes"? Will that be a cause20:45
vhosakotaNupoisc: TLS is disbaled by default in kolla  https://github.com/openstack/kolla/blob/master/ansible/group_vars/all.yml#L22020:46
vhosakotaNupoisc: are you running insecure registry ?20:46
aNupoiscvhosakot: can you please tell me where shall i look for insecure registry is running20:48
aNupoiscI am not giving option --insecure_registry while running20:49
aNupoiscYes i am giving --insecure_registry in /etc/defualt/docker20:50
vhosakotaNupoisc: cool, can you paste the output of "ps -ef | grep insecure"20:51
vhosakotaNupoisc: u on Ubuntu ?20:52
aNupoiscYes20:53
aNupoiscI got root       "1927      1  3 11:32 ?        00:05:23 /usr/bin/docker daemon --dns 8.8.8.8 --dns 8.8.4.4 --insecure-registry 172.16.2.2:5000 --raw-logs20:53
aNupoiscroot      27998   2506  0 13:52 pts/0    00:00:00 grep --color=auto insecure20:53
aNupoisc"20:53
aNupoiscoops bad indentation20:54
aNupoiscroot  1927      1  3 11:32 ?        00:05:23 /usr/bin/docker daemon --dns 8.8.8.8 --dns 8.8.4.4 --insecure-registry 172.16.2.2:5000 --raw-logs20:54
aNupoiscroot      27998   2506  0 13:52 pts/0    00:00:00 grep --color=auto insecure20:54
vhosakotaNupoisc: so, yeah, you running insecure registry.. cool20:55
vhosakotaNupoisc: when do you see "Get https://172.16.2.2:4000/v1/_ping: tls: oversized record received with length 20527"  ?20:55
aNupoiscyes i remember i had made that change in docker file20:55
aNupoiscon running build.py with -b ubuntu -t source --registry 172.16.2.2:4000 --no-cache --push20:56
vhosakotaNupoisc: what change did you make in which DOckerfile ? can you pastebin it ?20:56
aNupoiscis it because here i am specifying port 4000 and in docker file i have given --insecure-registry: "172.16.2.2:5000"20:56
vhosakotaNupoisc: which Dockerfile ? I dont think --insecure-registry is needed in any Dockerfile20:57
aNupoiscvhosakot: i mean /etc/default/docker20:58
openstackgerritDaneyon Hansen proposed openstack/kolla: WIP: Adds Neutron LBaaS Support  https://review.openstack.org/31477020:58
vhosakotaNupoisc: yes, adding --insecure-registry for DOCKER_OPTS in /etc/default/docker is correct20:59
vhosakotaNupoisc: can you paste   "grep DOCKER_OPTS /etc/default/docker"20:59
aNupoiscYes.21:00
aNupoiscvhosakot: DOCKER_OPTS="--dns 8.8.8.8 --dns 8.8.4.4 --insecure-registry 172.16.2.2:5000"21:00
vhosakotaNupoisc: cool21:00
aNupoiscvhosakot: is it correct?21:01
vhosakotaNupoisc: yes..21:01
vhosakotaNupoisc: do you have DOCKER_TLS_VERIFY and DOCKER_CERT_PATH set in your environment any chance ?  can you paste the output of    "echo $DOCKER_TLS_VERIFY"   and   "echo $DOCKER_CERT_PATH"21:02
*** thumpba has quit IRC21:02
openstackgerritMerged openstack/kolla: Catch all the exception in the push thread  https://review.openstack.org/31008721:02
aNupoiscso my doubt is while executing  ./tools/build.py -b ubuntu -t source --registry 172.16.2.2:4000, i am giving 4000 as a port21:03
openstackgerritDavanum Srinivas (dims) proposed openstack/kolla-kubernetes: Add a memcached service  https://review.openstack.org/31477221:03
aNupoiscis that the correct port?21:03
aNupoiscvhosakot: yes i will post the paths21:03
vhosakotaNupoisc: yes, can you change 5000 to 4000 in DOCKER_OPTS in /etc/default/docker,  and restart docker daemon (service restart docker) ?21:04
*** ravig has quit IRC21:04
aNupoiscvhosakot: no path is given for TLS_VERIFY and DOCKER_CERT_PATH21:04
vhosakotaNupoisc: cool, can you change 5000 to 4000 in DOCKER_OPTS in /etc/default/docker,  and restart docker daemon (service restart docker) ?21:04
aNupoiscvhosakot: Yes of course just a min21:05
aNupoiscvhosakot: yes I did restart a service21:06
aNupoiscvhosakot: now executing build.py again21:07
vhosakotaNupoisc: cool21:07
aNupoiscvhosakot: is there a need to specify DOCKER_TLS_VERIFY and DOCKER_CERT_PATH?21:07
vhosakotaNupoisc: no21:07
aNupoiscalso shall i remove all the container and images?21:08
aNupoiscvhosakot: or its fine21:08
vhosakotaNupoisc: no, they are fine21:08
*** unicell has quit IRC21:14
vhosakotaNupoisc: did it work ?21:16
aNupoiscvhosakot: it is still running21:17
vhosakotaNupoisc: cool21:17
aNupoiscit takes a bit of time :)21:17
*** rhallisey has quit IRC21:17
openstackgerritHui Kang proposed openstack/kolla: Do not use AUFS when building centos/fedora/oraclelinux container images on ubuntu host  https://review.openstack.org/31420521:19
*** unicell has joined #openstack-kolla21:20
*** unicell has quit IRC21:20
*** unicell has joined #openstack-kolla21:20
aNupoiscvhosakot: so generic question, how to decide what port it should use? i mean can it be 6000 instead of 4000?21:22
openstackgerritHui Kang proposed openstack/kolla: Do not use AUFS for centos/fedora/oraclelinux container images on ubuntu host  https://review.openstack.org/31420521:22
*** ccesario___ has joined #openstack-kolla21:23
aNupoiscvhosaot: i think so it is running good as no error till now21:23
aNupoiscvhosakot: we can specify the port with docker run right? because I had used docker run -d -p 4000:500021:24
aNupoiscvhosakot: YES it successfully built all the images21:24
aNupoiscvhosakot: Thanks a lot21:25
vhosakotaNupoisc: cool, so, it was a port mis-match issue..21:25
aNupoiscvhosakot: yeah21:25
aNupoiscvhosakot: so how to select the port21:25
aNupoisci mean can i try with 6000?21:25
vhosakotaNupoisc: cool.. yes, you can specify the registry port with "docker run"21:26
vhosakotaNupoisc: yes, any unused port should be fine21:26
aNupoiscvhosakot: okay cool21:26
aNupoiscvhosakot: thank you :)21:27
vhosakotaNupoisc: cool, np.. glad it worked! :)21:29
*** mbound has joined #openstack-kolla21:30
aNupoiscvhosakot: yes!!21:30
*** ravig has joined #openstack-kolla21:32
*** neophy has quit IRC21:45
*** ccesario___ has quit IRC21:48
*** sacharya has joined #openstack-kolla21:52
*** sacharya_ has quit IRC21:54
*** fragatina has joined #openstack-kolla21:57
*** salv-orl_ has quit IRC22:07
*** kusr has joined #openstack-kolla22:07
kusrhey,22:07
*** ccesario___ has joined #openstack-kolla22:07
kusrdid you change the kolla documentation page today ?22:08
kusrhttp://docs.openstack.org/developer/kolla/quickstart.html <-- has a few bugs22:08
*** Avi82 has quit IRC22:11
*** Avi82 has joined #openstack-kolla22:12
vhosakotkusr: what bugs ? can you elaborate ?22:13
kusrkolla/tools/init-runonce <-- in the end wont run because it needs pip install python-nutreonclient22:13
*** mark-casey has left #openstack-kolla22:15
kusrhttps://github.com/openstack/kolla/commit/1c0dcd8ba83aae488e855b371707349451a4e85f <-- this commit fails if you didn't configure the globals.yml properly, but you can't understand why from it22:16
kusrthe bug report https://bugs.launchpad.net/kolla/+bug/1566571 actually explains in the description what the issue is, but if i didn't read it (while googling the error) i couldn't understand what the error is22:16
openstackLaunchpad bug 1566571 in kolla mitaka "Add prechecks to validate kolla_internal_vip_address and kolla_external_vip_address" [Medium,Fix committed] - Assigned to Vikram Hosakote (vhosakot)22:16
kusrfrom NoneType is not iterable (output of ansible)22:17
kusrnova-compute.conf file referred there in the middle does not exist in latest versions of koola22:18
vhosakotyeah, that prechecks validates validate kolla_internal_vip_address and kolla_external_vip_address22:18
kusr(and it somehow knew that it should use QEMU automatically)22:18
kusrvhosakot: indeed, but it does not give a meaningfull error, and it's easy to misintrepret that step22:18
kusrthe bug description told me my issue (that i need to put the ip in the range of the netmask)22:19
kusri'm just throwing out stuff i had trying to install today kolla for the first time with that guide22:19
vhosakotkusr: the error message is from ansible and not from kolla.. kolla prints whatever ansible returns22:20
kusrthe how to do other_args for insecure-registry would be nice to have how to do in ubuntu as well (since other steps have both OS)22:20
vhosakotkusr: goos point, I will add it22:20
vhosakotgood*22:20
*** Avi82 has quit IRC22:21
*** esharao_ has quit IRC22:21
kusrvhosakot: dont forget te pip install python-neutreonclient as well22:21
*** Avi82 has joined #openstack-kolla22:21
*** sdake has joined #openstack-kolla22:22
kusrnow for the more lame stuff :)22:22
kusrthe script doesn't explicitly say you should do everything as root22:22
kusrif you don't do them as root, it takes quite a few editing / mocking aronud to make it work22:22
kusr(or maybe the init-runonce should be moved to use the unified openstack python script)22:24
*** haplo37 has quit IRC22:24
*** berendt has quit IRC22:25
kusrvhosakot: i guess the documentation just lacks in this regard: "Please specify an unused IP address in the network to act as a VIP" isn't specific enough22:25
kusrmaybe an unused IP address in the same netmask as used by the interface configured in network_interface in the next step22:26
*** daneyon has joined #openstack-kolla22:27
kusrbecause as you can see, quite a few people mistake this step22:27
vhosakotkusr: yes, good point.. I'll update the docs22:27
kusralso... as a first time user22:27
kusri couldn't figure out which user/pass i need to put in the dashboard to use the system (nothing i tried worked)22:27
kusrto take it to the next level, i would say maybe do everything as root, or map how to make it work as non root (i think this requires some source modifications)22:29
*** Avi82 has quit IRC22:29
kusrdo you care about those stuff as well or not ?22:30
kusrwhere is the kolla-deploy file /22:31
sdakekasr agree on unified openstack python script -that would be great if someone were to do that - although its really a development tool whicfh is why we haven't bothered22:31
*** daneyon has quit IRC22:31
sdakekusr i agree the VIP thing is confusing, I dont know how to make it more clear :)22:31
kusrsdake: i've written a suggestion22:32
kusr"unused IP address in the same netmask as used by the interface configured in network_interface in the next step"22:32
vhosakotkusr: if adminrc file is soucred, it displays the horizon creds22:32
kusrsdake: also maybe get ansible to put a sane error, when it fails the check on it22:32
sdakekusr ya I was just reading scrollback22:32
sdakeI think vhosakot said he would take that into the docs22:32
vhosakotyep, I'll update the docs22:32
kusrhttps://github.com/openstack/kolla/blob/cf3e68213edba3e74e74254676085999651a4361/kolla/cmd/build.py#L399 <-- this fails if you do it as non-root22:33
kusrsince sys.prefix on ubuntu 16.04 is "/usr" but if you did pip install as non root, it goes to "~/.local"22:33
sdakebuild.py doesn't require root on my system22:33
sdakebut I don't use pip installs22:33
sdakesounds like a permissions bug22:33
kusrno22:33
sdakecould you file one?22:33
kusrit's a bug in the line i've shown22:33
kusrsys.prefix points to the wrong place22:34
kusri had to hardcode it to /home/<user>/.local/ to make it work22:34
kusri dont have a user (unless it's on github)22:34
vhosakotkusr: so, the os.path.join failed on your machine as you're not root ?22:35
kusr os.path.exists(os.path.join(image_path, 'base')): (a few lines under) because it looked in the wrong place22:35
kusrall possible_paths pointed to bad places (on ubuntu 16.04)22:35
kusrthis is a. non-root and b. not installed pip as root22:36
kusr(pip non root installs to ~/.local), but python2 atleast on 16.04 has a bug where os.path.exists doesn't work on ~ as well, so i needed to expand it to full path22:37
vhosakotpossible_paths is obtained from project's root path or /usr (if pip installed).. so, if it does not work on UBuntu 16, we need to fix it..... can you file a bug ?22:37
kusrvhosakot: on github ?22:37
vhosakotkusr: no in launchpad22:37
sdakelaunchpad.net/kolla22:37
kusri dont have a launchpad user :|22:37
vhosakothttps://bugs.launchpad.net/kolla22:37
kusri hate having too many logins i forget abot22:38
vhosakotcreate one.. takes 2 mins :)22:38
kusris it a hassle for you to file it ? :)22:38
vhosakotI can file it.. sure.. can you send exact error and distro details ?22:38
sdakei dont know what the issue is - everythign works for me as non-root22:38
kusraltough i find it hard to belive this isn't an isuse in 14.04 as well22:38
vhosakotno, I dont see the issue on 14.04.. I build and deploy everyday22:39
kusrsdake: where is your kolla share dir ?22:39
vhosakotas non-root22:39
sdakekusr not sure, I typically dont pip install22:39
kusrdo ls ~/.local/share/kolla22:39
kusrdoes that exist ?22:39
sdakeno that definately doesn't exist22:39
kusrso you did pip install root22:40
kusras root22:40
sdakeno i didn't pip install at all22:40
kusrohh22:40
kusrhmm22:40
sdakei work from tools directory22:40
kusri followed http://docs.openstack.org/developer/kolla/quickstart.html22:40
sdakebut if pip install is bustedon ubuntu we should fix it :)22:40
kusrwhere it says "pip install kolla/" in one of the stages22:40
sdakekusr ya, I think we need to modify those directions not torecommend pip install for developers22:40
vhosakot"pip install" works fine for me Ubuntu 1422:40
kusrvhosakot: pip install as non root ?22:41
kusrsdake: could be, i have no idea yet, since i only followed that :022:41
sdakeit may be that sys.perfix on ubuntu 15.z is busted22:42
kusr16.04 LTS is out officaly, yo should try it :022:42
sdakerather ubuntu 16.z22:42
sdakei run centos, others in project run ubuntu22:42
sdakeprovides good balance22:42
sdakebut nobody is running 16.04 yet22:42
sdakebut i think should be - if rhel8 were out id be on it from day 1 :)22:43
kusri wanted to try OS quickly, so i installed it on 16.0422:43
sbezverk_sdake I tried 16.04 but I always use sudo22:43
kusrthere was another file i needed to edit, le tme remember22:43
sdakekusr so it sounds like you worked around that problem22:43
kusrsdake: yeah i modified sys.prefix in that script22:43
kusrto point to /home/<dir>/.local/22:43
kusrand it worked22:43
sdakekusr i see, a local pip install22:43
kusryep22:44
sdakepip install -e ?22:44
kusrnop, just pip install as non root in 16.0422:44
kusrit auto puts it there22:44
sdakewierd, that doesn't work on centos ;/22:44
kusryeah it's new in ubuntu22:44
kusra few years i think22:44
kusrbtw, this is from my mind, from what i recall from office :)22:45
sdakeso after you put in a workaround, did that work for you?22:45
kusrhttp://askubuntu.com/questions/14535/whats-the-local-folder-for-in-my-home-directory22:45
sdakeits not actually aw orkaround, its a correct solution to the bug22:45
kusrsdake: that part yeah22:45
kusralso i think /etc/kolla doesn't have correct permissions for writing as non-root (altough i don't have a good solution for that)22:46
sdakeyour right, it doesn't22:46
sdakeI have been trhinking about handling tyhe non-root case more and more22:46
sdakeand think an ansible script that sets permissions/owners run as root can solve that22:46
kusrhttps://github.com/openstack/kolla/blob/cf3e68213edba3e74e74254676085999651a4361/tools/kolla-ansible <-- has a bug with non-root as well22:46
sdakeso atleast deployment isn't run each time as root22:46
sdakebut  only the permission setting22:47
kusrBASEDIR doesn't look for ~/.local as wlel22:47
kusrso i had to hard cod ethat as wlel22:47
*** ravig has quit IRC22:47
kusrthan everything worked besides the /tc22:47
sdakewhats /tc?22:47
kusrthe /etc22:47
sdakeoh - so you could make /etc group owned by docker22:47
kusrbut since ansible and everything was installed to ~/.local (cause 16.04 comes with ansible 2 only)22:47
sdakeand read/writeable22:48
sdakeyou were using ansible 1.9.4 correct?22:48
kusri had to a. hardcode that into BASEDIR in that script, and b. sudo env "path=$PATH:/home/<user>/.local/bin" kolla-ansible to make the deployment work :)22:48
kusrype22:48
kusryep22:48
kusrmanually installed via pip install to ~/.local22:48
sdakecool22:49
kusrafter all of this stuff, everything ran :022:49
sdakeso sounds like you outsmarted mark shuttleworth :)22:49
sdakenice job :)22:49
kusri'm using linux abit longer than him22:49
kusrsince kernel 0.722:49
vhosakotnice22:49
*** ccesario___ has quit IRC22:50
sdakeya - been since 0.99 for me, i'm a bit of a get off my lawn type ;)22:50
kusrnice22:50
kusri have a few questions (OS noob)22:50
sdakemost devs kin kolla are younger however ;)22:50
kusra. does kolla provide a high-availability solution for OS ?22:50
kusrb. whats the best way on going to a non-toy AIO installation ?22:51
sdakeit works using keepalived and haproxy22:51
sdakeso sort of22:51
kusrand c. does it support ironic for bare metal provisinoning22:51
sdakein proper HA, you 1. identify fault 2. isolate fault 3. correct fault, 4. ntoify of failure22:51
sdakeall kolla does is prevent the fault from sort of happening via redundancy22:51
sdakein other words its not perfect - that covers A22:51
kusrdoes it do auto replication of the important stuff ?22:52
sdakeB / multinode - edit the multinode inventory file and you shyould be godo to go - on each node you need docker and docker-py only22:52
sdakec. no, however sean-k-mooney is working on that in the community22:52
sdakeso just t o clarify c, do you mean can kolla bare metal provision your machines?22:53
kusri have stuff i want to run without VM, i would rather it would still live network wise, etc... in the OS eco system22:54
kusrso i would want it to PXE boot a machine, and throw an image on top of it22:55
sdakeya - we have an implementation does it work, no idea22:56
kusrk, might be looking into that22:56
vhosakotkusr: didn't know Ubuntu 16 comes with Ansible 2.. so, did you deploy kolla with Ansible 2, or you downgraded to Ansible 1.9.4 ?22:57
kusri manually pip install 1.9.4 as non-root22:57
vhosakotcool22:57
kusras the guide said :)22:57
vhosakotcool22:57
kusris there any documentation on kolla HA model compard to other ones ?22:58
kusris everything replicated between the state redunded components ?22:58
sdakethere is no coparison of kolla to other tools that has been prepared by the kolla community22:58
sdakeI suspect other proprietary software companies have produced an eval doc, but I have not seen it and it is speculatino that they have22:58
sdakeyes nway active22:59
kusrcool22:59
sdakewhere n is your number of nodes22:59
kusrso i guess next step is to read about the non AIO mode22:59
sdakenubmer of control nodes22:59
kusrohh.. .also please put more info on how to login to the dashboard in the guide22:59
sdakeya - our docs need love22:59
sdakethe problem is people don't file bugs23:00
sdakeso we lose track of all this ir c conversation23:00
kusrcan i change 'n' after first deployment and it will adeapt ?23:00
sdakeand i have stomach flu today - so pretty much i'm barely alive ;)23:00
kusrcause people only know how to use githb this days, most projects i contribute to moved their whole systems to github23:00
sdakekusr i believe the answer is yes23:01
kusrsdake: you can do active-active redundency with vhosakot :)23:01
kusrit's nice, took me about 3 hours of messing with this to get the AIO working on 16.0423:01
sdakeya - we find its 1-3 hours for most people from first build to deploy23:01
sdakecompared to other tools you would still be on the "downloading rpms step" :)23:01
kusrdevstack was faster, but23:02
*** ravig has joined #openstack-kolla23:02
kusri couldn't figure out how to make it non-toy or work after main machine is down (how to heal it)23:02
vhosakothaha... we all here in the kolla community try to do as much active-active redundancy as possible to answer/fix kolla questions/bugs :)23:02
kusrlast question for now23:02
kusrhow do i get kubernetes after i setup OS ?23:02
sdakewe haven't implemented any of the k8s underlay at moment23:03
sdakebut one way is via magnum23:03
sdakebut our magnum implementation is broken23:03
sdakeso pretty much, your on your own atm with that23:03
sdakebut magnum is in progress23:03
kusrdoes kubernetes have a hidden gem like kolla ?23:03
kusr(maybe unrelated to OS?)23:03
vhosakotkusr: magnum needs neutron-lbaas.. and there is a WIP is kolla review queue to add neutron-lbaas to kolla... you could refer/use it  https://review.openstack.org/#/c/314770/23:04
patchbotvhosakot: patch 314770 - kolla (stable/mitaka) - WIP: Adds Neutron LBaaS Support23:04
kusralso kolla needs much more visibility imho, i looked for something like this / asked in #openstack and nobody gave me this solution23:04
kusri found it by some dude in a conference who told me it's easy with this23:04
*** ravig has quit IRC23:07
kusrvhosakot: looks nice, based on your experience what is the timeframe for magnum support ?23:08
kusr(officaly)23:09
vhosakotkusr: that WIP is not functional yet but is a great first patch set... once neutron-lbaas works, magnum can be added... the magnum config files we have currently in kolla are not completely correct, and hence a magnum bay cannot be created successfully.... I'm planning to fix it if I have time... can't give a date tho :)23:10
*** ravig has joined #openstack-kolla23:11
*** weiyu has joined #openstack-kolla23:11
vhosakotkusr: here is another patch set submitted by another dev to fix some of the magnum configs  -->  https://review.openstack.org/#/c/300747/23:11
patchbotvhosakot: patch 300747 - kolla - [WIP] Fix the Magnum failed to create trustee23:11
*** ravig has quit IRC23:12
kusrthanks for the pointers23:14
vhosakotkusr: cool23:14
kusrgtg to sleep23:14
kusrsorry for being scattered with my reports23:15
vhosakotkusr: cool, np :)  I will update the docs and prechecks...23:15
*** weiyu has quit IRC23:16
sdakekusr well we are working on visibility, we went from 0 % ro 4% of deployments in the last 6 months23:16
sdakeso people inside the openstack ecosystem that fill our user surveys and stuff are aware of kolla23:16
*** salv-orlando has joined #openstack-kolla23:16
kusrsdake: i asked in #openstack for an easy solution, but nobody pointed me a few weeks ago23:16
sdakekusr but the general population looking for a cloud solution - hard for us to compete with mirantis scorched earth advertising policies :)23:16
kusri understand, but i think just like the OS model wins23:17
sdake#openstack is pretty worthless imo :)23:17
kusrso will this23:17
kusrbut most people inrested in OS will look there23:17
sdakeI agree, that is why we went from 0% to 4%23:17
kusrthe only reason i came here, is because i already knew kola existed23:17
sdakefrom nothing to 4% of deplloyments in 6 months is HUGED23:17
sdakeya we haven't figured out how to solve the problem of people not knowing how something doesn't exist - specifically in this case23:18
sdakekolla23:18
kusrvhosakot: if you try to do a non-root installation in 16.04 you'll quickly see all the issues :)23:18
sdakeI'm not sure nayone has - other then advertising23:18
kusrtry it on a VM like i did23:18
sdakewhich obviously we aren't goint do so ;)23:18
vhosakotkusr: cool, will try it... non-root on 14 is good for me23:18
kusrput it in #openstack topic :)23:18
*** godleon has quit IRC23:19
kusrvhosakot: do it on a clean machine with onthing installed as pip-root23:19
kusrthat might cover allth eissues23:19
sdakethere are like 6   deployment tools for openstack23:19
kusrsdake: free / easy / non-toy ? :)23:19
sdakewhich one gets to put their stuff in there :)23:19
sdakeeasy23:19
sdakehmm23:19
openstackgerritDaneyon Hansen proposed openstack/kolla: WIP: Updates Magnum for Mitaka  https://review.openstack.org/31480523:19
kusrdo round-robin23:19
sdakekolla wins I think on that one :)23:19
vhosakotkusr: another magnum PS in queue :)  ^^^23:20
kusrexciting !23:20
kusri have an vacation till next week23:20
kusrmaybe by than i can test it :)23:20
*** salv-orlando has quit IRC23:21
*** SiRiuS__ has quit IRC23:21
kusrohh, another Q before i'm killed23:21
kusrthe SQL DB let's say, is saved in the container23:22
kusror in an outside volume ?23:22
*** ravig has joined #openstack-kolla23:22
*** diogogmt has quit IRC23:23
kusrohh... another issue i remember.. rabbitmq didn't install until i put the hostname pointing to the interface IP in /etc/hosts (again, the error was kind obscure)23:23
erhudyepmd hostname resolution issues can be tricksy23:24
kusryeah, i'm just talking about my experience installing kolla / OS for the first time where i found the error reports to be lacking :)23:24
*** weiyu has joined #openstack-kolla23:24
*** ravig has quit IRC23:25
kusrgoogling + intuition helped allot, but maybe other people will be more stumpted23:25
kusrok, must go, night23:26
*** absubram has quit IRC23:26
*** jtriley has joined #openstack-kolla23:28
aNupoiscis there some automated script to install docker and few other stuff on target nodes when deploying kolla on multinode23:28
*** kusr has quit IRC23:30
*** sdake has quit IRC23:30
*** weiyu has quit IRC23:33
*** sacharya has quit IRC23:34
*** sacharya has joined #openstack-kolla23:35
*** vhosakot has quit IRC23:37
*** sdake has joined #openstack-kolla23:38
*** signed8bit is now known as signed8bit_Zzz23:40
*** mark-casey has joined #openstack-kolla23:47
*** vhosakot has joined #openstack-kolla23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!