Tuesday, 2016-04-05

*** jasonsb has joined #openstack-kolla00:03
*** shakamunyi has joined #openstack-kolla00:03
*** shakamunyi has quit IRC00:09
*** rhallisey has quit IRC00:14
*** Jeffrey4l__ has joined #openstack-kolla00:18
*** rajathagasthya has joined #openstack-kolla00:28
*** shakamunyi has joined #openstack-kolla00:31
*** shakamunyi has quit IRC00:47
*** diogogmt has quit IRC00:49
*** rajathagasthya has quit IRC00:49
*** sdake has joined #openstack-kolla00:59
*** iceyao has joined #openstack-kolla00:59
*** iceyao_ has joined #openstack-kolla01:01
*** inc0 has joined #openstack-kolla01:03
inc0hey...not that I want to suggest anyting, but this review is still hanging https://review.openstack.org/#/c/287969/01:03
patchbotinc0: patch 287969 - kolla - Playbook for rabbitmq upgrade01:03
*** shakamunyi has joined #openstack-kolla01:04
*** iceyao has quit IRC01:05
sdakeinc0 this needs an ack https://review.openstack.org/#/c/300904/101:19
patchbotsdake: patch 300904 - kolla - Adds migration step from nova to nova_api database01:19
dave-mccowanhas anyone seen this intermittent error when re-deploying kolla: "stderr: Error response from daemon: Container mariadb is not running".  the docker logs of the mariadb container look clean.01:20
sdakedefine rdeploing dave-mccowan01:21
inc0dave-mccowan, docker ps -a | grep mariadb01:21
*** cfarquhar has joined #openstack-kolla01:21
*** cfarquhar has quit IRC01:21
*** cfarquhar has joined #openstack-kolla01:21
dave-mccowantools/cleanup-containers followed by kolla-ansible deploy01:21
sdakehavnet seen that one01:22
sdakei do that operation all the time01:22
sdakedave-mccowan were you ablee to dpulicate hte tls issue?01:22
dave-mccowandocker ps -a shows the mariadb container as exited, but the docker logs for it have no error or reason for the exit.01:22
sdakedave-mccowan docker exec heka ls /var/log/kolla/mariadb01:23
dave-mccowansdake that's what i'm working on.  i do see some problems with tls, i've got a list of tests to run and some fixes in mind.01:23
sdakelisting that directory shouold gie you a ist of files to docker cp or docer ls01:24
sdakerthr docker exec cat01:24
sdakeinc0 this needs an ack https://review.openstack.org/#/c/300914/01:25
patchbotsdake: patch 300914 - kolla - Increase max scheduling attempts to 5001:25
dave-mccowan160405  1:17:29 [Note] /usr/sbin/mysqld: Normal shutdown01:25
dave-mccowanfrom mariadb.log, that's what initiates the shutdown01:25
sdakef ull log?01:26
sdakei think we hve a bug with a dangling mariadb.pid file01:26
dave-mccowanah... i see a cluster exists message.  do i need to cleanup some db file? http://paste.openstack.org/show/492941/01:27
dave-mccowanyea... that's it.  i'll try rm-ing that file.01:27
sdakethat mairadb.pid file should not be present in a cleanup-containers situation01:28
sdakeare you sure you cleanup-containers?01:28
dave-mccowanyes, but what's new is i've moved from a local registry to a remote registry.  maybe the cleanup is incomplete?01:29
sdakehard to say unless you try it01:30
sdakei'd ike to understnd this bug more before we implement a fix01:30
sdakerabbit holes abound01:30
dave-mccowanthe tls bug?01:30
dave-mccowanor mariadb?01:31
sdakemariadb01:31
sdakeits hard to fix it until its root caused01:31
sdakeif ou figure that out add it t othe bug01:31
sdakei'll linkin a moment hang tight01:31
sdakehttps://bugs.launchpad.net/kolla/+bug/156427801:32
openstackLaunchpad bug 1564278 in kolla mitaka "mariadb.pid causes mariadb container from starting" [Critical,Confirmed]01:32
dave-mccowanmy error message matches that exactly.  do you want to login and poke around?01:34
sdakewhat is your inventory file01:35
openstackgerritMerged openstack/kolla: Updated from global requirements  https://review.openstack.org/30139101:35
dave-mccowanusing all in one01:35
sdakei'd like a reliable reproducer ;)01:35
sdakecan you report you saw the problem on aio01:36
sdakein the bug01:36
dave-mccowani've retried 3 times now, and getting the same error each time.01:36
*** mwheckmann has joined #openstack-kolla01:36
sdakeyes i'll log in01:38
sdakeneed an ssh key?01:38
dave-mccowanaccess info PMed.01:40
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Making Mitaka deploying liberty  https://review.openstack.org/29956301:41
*** ccesario___ has quit IRC01:47
*** tfukushima has joined #openstack-kolla01:47
*** ccesario___ has joined #openstack-kolla01:48
*** salv-orlando has joined #openstack-kolla01:51
*** inc0 has quit IRC01:51
*** weiyu has joined #openstack-kolla01:52
*** diogogmt has joined #openstack-kolla01:58
*** unicell has quit IRC02:02
*** salv-orlando has quit IRC02:04
sdakehttps://bugs.launchpad.net/kolla/+bug/149178202:05
openstackLaunchpad bug 1491782 in kolla mitaka "Fail to create haproxy mysql user" [Critical,Triaged]02:05
sdakeeasy fix if somenoe wnts it^^02:05
*** salv-orlando has joined #openstack-kolla02:08
*** Marga_ has quit IRC02:11
*** salv-orlando has quit IRC02:15
*** vhosakot has joined #openstack-kolla02:19
*** achanda has joined #openstack-kolla02:21
weiyuhello sdake02:27
sdakesup weiyu what can i do for you02:28
weiyuabout this bug https://bugs.launchpad.net/kolla/+bug/154023402:28
openstackLaunchpad bug 1540234 in kolla mitaka "rabbitmq cluster does not work with dashes in the hostname" [Critical,Confirmed] - Assigned to weiyu (weiyu)02:28
weiyuI test my patch on ubuntu and centos . it it work,not break rabbitmq cluster02:30
*** tfukushima has quit IRC02:30
weiyuyou talk try escaping erlang special characters, I don't understand02:31
sdakehttps://www.ansible.com/blog/openstack-kolla02:31
sdakei guess i dont get why sam claims it breaks clusterer02:32
sdake- is an erlang special character02:32
sdakeit is being parsed by somethign02:32
sdakeyou are quoting it02:32
sdakeinsted when it is parsed it needs to be escaped02:32
sdakelie in shell you escape a special character with a \02:33
sdakeweiyu ij ust want it to work correctly02:33
sdakei trust sam was accurate in his asesment that it broke his deployment02:34
sdakebut it is unclear from the bug and he doesn't participate in kolla further so i have no way o clarifying02:34
weiyuyou mean is quoting the full address is wrong?02:38
*** ccesario___ has quit IRC02:38
*** ccesario___ has joined #openstack-kolla02:39
weiyuwhen hostname has a dash use '\' translation?02:40
*** tfukushima has joined #openstack-kolla02:40
openstackgerritJeffrey Zhang proposed openstack/kolla: Track the api_interface in the keepalived  https://review.openstack.org/30085202:44
sdakeweiyu its a suggestion02:48
sdakeweiyu i think the problem is in parsing elsewhere not in the hostname pssed to clusterer02:48
sdakebut i really dont nkwo becuase i havent debugged it02:48
sdakeinc0 might have thoughts02:49
sdakeif he weren't passsed out in bed ;)02:49
sdakewhich is where im headed02:49
weiyumaybe I can remove assignee02:50
*** klint has joined #openstack-kolla02:51
weiyuother members can debugged it02:52
coolsvapsdake: i tried deploying with a - in hostname, but I am not getting rabbitmq failed03:00
*** coolsvap has quit IRC03:01
*** Marga_ has joined #openstack-kolla03:01
*** mdnadeem has joined #openstack-kolla03:01
weiyubut cluster is not work03:01
weiyurabbitmqctl cluster_status03:02
*** sdake has quit IRC03:02
weiyucoolsvap:03:02
*** Marga_ has quit IRC03:06
weiyuhello coolsvap03:06
iceyao_hi03:12
*** mwheckmann has quit IRC03:14
*** sekrit has joined #openstack-kolla03:17
*** Marga_ has joined #openstack-kolla03:19
*** coolsvap has joined #openstack-kolla03:24
*** salv-orlando has joined #openstack-kolla03:25
*** coolsvap_ has joined #openstack-kolla03:25
*** coolsvap_ has quit IRC03:25
*** salv-orlando has quit IRC03:29
*** salv-orlando has joined #openstack-kolla03:29
*** rajathagasthya has joined #openstack-kolla03:32
*** ccesario___ has quit IRC03:33
*** salv-orlando has quit IRC03:33
*** ccesario___ has joined #openstack-kolla03:36
*** banix has quit IRC03:43
*** salv-orlando has joined #openstack-kolla03:49
*** rajathagasthya has quit IRC03:50
*** rajathagasthya has joined #openstack-kolla03:55
*** salv-orlando has quit IRC03:57
*** mdnadeem_ has joined #openstack-kolla03:59
*** rajathagasthya has quit IRC03:59
*** mdnadeem has quit IRC04:02
*** unicell has joined #openstack-kolla04:06
*** dave-mccowan has quit IRC04:07
*** weiyu has quit IRC04:10
*** vhosakot has quit IRC04:21
*** reddy has joined #openstack-kolla04:50
*** reddy has quit IRC04:53
*** salv-orlando has joined #openstack-kolla04:58
*** vhosakot has joined #openstack-kolla05:01
*** dave-mccowan has joined #openstack-kolla05:05
*** dave-mcc_ has joined #openstack-kolla05:07
*** salv-orlando has quit IRC05:08
*** salv-orlando has joined #openstack-kolla05:09
*** dave-mccowan has quit IRC05:10
*** salv-orlando has quit IRC05:11
*** salv-orlando has joined #openstack-kolla05:18
*** salv-orlando has quit IRC05:20
*** salv-orlando has joined #openstack-kolla05:24
*** salv-orlando has quit IRC05:27
*** salv-orlando has joined #openstack-kolla05:29
*** dave-mcc_ has quit IRC05:31
*** salv-orlando has quit IRC05:31
openstackgerritMerged openstack/kolla: Make Heka write Keepalived logs to dedicated directory  https://review.openstack.org/30089605:39
*** salv-orlando has joined #openstack-kolla05:41
openstackgerritVikram Hosakote proposed openstack/kolla: Check empty passwords in $CONFIG_DIR/passwords.yml  https://review.openstack.org/30145105:49
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Make Heka write Keepalived logs to dedicated directory  https://review.openstack.org/30145205:50
openstackgerritVikram Hosakote proposed openstack/kolla: Check empty passwords in $CONFIG_DIR/passwords.yml  https://review.openstack.org/30145105:52
*** vhosakot has quit IRC05:55
*** dougs has quit IRC05:57
*** weiyu has joined #openstack-kolla06:00
openstackgerritBenedikt Trefzer proposed openstack/kolla: use silent option for curl download in heka container  https://review.openstack.org/29773906:10
openstackgerritBenedikt Trefzer proposed openstack/kolla: use silent option for curl download in kolla-toolbox container  https://review.openstack.org/30145806:15
openstackgerritBenedikt Trefzer proposed openstack/kolla: use silent option for curl download in rabbitmq container  https://review.openstack.org/30146006:19
*** mikelk has joined #openstack-kolla06:24
openstackgerritBenedikt Trefzer proposed openstack/kolla: use silent option for curl download in mesos-dns container  https://review.openstack.org/30146306:24
openstackgerritBenedikt Trefzer proposed openstack/kolla: use silent option for curl download in magnum-conductor container  https://review.openstack.org/30146606:29
openstackgerritBenedikt Trefzer proposed openstack/kolla: use silent option for curl download in magnum-base container  https://review.openstack.org/30146706:32
openstackgerritBenedikt Trefzer proposed openstack/kolla: use silent option for curl download in magnum-conductor container  https://review.openstack.org/30147006:36
*** achanda has quit IRC06:40
*** cristicalin has joined #openstack-kolla06:50
*** salv-orlando has quit IRC06:53
*** weiyu has quit IRC07:00
*** weiyu_ has joined #openstack-kolla07:05
*** cristicalin has quit IRC07:19
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Add check for SELINUX in prechecks  https://review.openstack.org/30095507:23
*** Marga_ has quit IRC07:29
*** jmccarthy has joined #openstack-kolla07:40
*** achanda has joined #openstack-kolla07:40
*** achanda has quit IRC07:44
*** mgoddard has joined #openstack-kolla07:45
*** shardy has joined #openstack-kolla07:48
openstackgerritSerguei Bezverkhi proposed openstack/kolla: Adds migration step from nova to nova_api database  https://review.openstack.org/30090407:52
openstackgerritJeffrey Zhang proposed openstack/kolla: DO NOT MERGE: TEST MASTER BRANCH  https://review.openstack.org/29490607:53
*** mbound has joined #openstack-kolla07:54
*** mbound has quit IRC08:00
*** mbound has joined #openstack-kolla08:06
*** gfidente has joined #openstack-kolla08:08
*** gfidente has joined #openstack-kolla08:08
*** dougs has joined #openstack-kolla08:11
*** wmiller has joined #openstack-kolla08:28
*** Marga_ has joined #openstack-kolla08:29
sbezverkJeffrey4l__ ping08:31
*** Marga_ has quit IRC08:34
*** iceyao has joined #openstack-kolla08:41
*** iceyao_ has quit IRC08:44
*** pbourke has quit IRC08:51
*** pbourke has joined #openstack-kolla08:51
*** Liuqing has joined #openstack-kolla08:54
*** Marga_ has joined #openstack-kolla08:56
*** Marga_ has quit IRC09:12
*** achanda has joined #openstack-kolla09:13
*** achanda has quit IRC09:18
*** Liuqing has quit IRC09:21
*** salv-orlando has joined #openstack-kolla09:22
*** wmiller has quit IRC09:23
*** wmiller has joined #openstack-kolla09:23
*** salv-orlando has quit IRC09:32
*** irfat has quit IRC09:34
*** mdnadeem_ has quit IRC09:40
*** coolsvap has quit IRC09:45
*** salv-orlando has joined #openstack-kolla09:46
*** salv-orl_ has joined #openstack-kolla09:47
*** salv-orlando has quit IRC09:50
*** allen_gao has quit IRC09:55
*** Liuqing has joined #openstack-kolla09:57
*** coolsvap has joined #openstack-kolla09:57
*** allen_gao has joined #openstack-kolla10:04
*** iceyao has quit IRC10:14
*** ccesario___ has quit IRC10:21
*** ccesario___ has joined #openstack-kolla10:22
Jeffrey4l__sbezverk, pong10:32
*** Jeffrey4l__ is now known as Jeffrey4l10:32
*** ccesario___ has quit IRC10:36
*** ccesario___ has joined #openstack-kolla10:36
*** kjelly has joined #openstack-kolla10:37
*** kjejlly_ has quit IRC10:38
*** mdnadeem has joined #openstack-kolla10:39
*** ccesario___ has quit IRC10:39
*** ccesario___ has joined #openstack-kolla10:40
sbezverkJeffrey4l__ I got AIO deployment failure see this paste: http://paste.openstack.org/show/492961/10:47
sbezverkafter I removed a section of code dealing with sshd at the end os the same paste, AIO deployment worked.10:47
*** salv-orl_ has quit IRC10:52
*** sdake has joined #openstack-kolla11:00
*** tfukushima has quit IRC11:02
*** ccesario___ has quit IRC11:02
*** banix has joined #openstack-kolla11:04
*** rhallisey has joined #openstack-kolla11:04
openstackgerritRyan Hallisey proposed openstack/kolla: Add remove apparmor reminder to the quickstart  https://review.openstack.org/30018411:07
openstackgerritPaul Bourke proposed openstack/kolla: Log the SHA of the Git ref for source builds  https://review.openstack.org/30158311:08
*** weiyu_ has quit IRC11:12
*** Marga_ has joined #openstack-kolla11:12
*** achanda has joined #openstack-kolla11:13
sdakeinc0 rhallisey around?11:14
rhalliseyya11:14
sdakemorning pbourke11:14
pbourkesdake: morning11:14
sdakehey i hae a kolla webinar 9:30-11 on the 13th11:14
sdakecan you or inc0 run the irc meeting11:14
rhalliseyya sure11:14
sdakeyou might give icn0 a go at it11:14
sdakesince heaske to learn how11:14
pbourkeok I'll give it a go the next time :)11:14
*** achanda has quit IRC11:15
rhalliseyhaha11:15
sdakepbourke if you are intereted i learning i have an email for you too11:15
pbourkesure11:15
sdakepbourke i ws talking to rhallisey and inc0 :)11:15
rhalliseypbourke, you can run it if you want11:15
sdakerhallisey pretty uch knows how to ru the irc meetings at this point11:16
rhalliseyya I've done it a few time I don't mind doing it11:16
rhalliseyor whoever wants to11:16
*** Marga_ has quit IRC11:17
pbourkesee if inc0 wants to do it as I may be travelling during this wed's meeting and have to attend on my phone11:17
sdakeplatinum amex incoing11:17
* sdake excited11:17
pbourkedebt ++11:17
sdakeamex has to be paid every month in full pbourke11:17
sdakeso there is no debt increase11:18
pbourkewhat is the point in it then?11:18
*** ccesario has quit IRC11:18
sdakepoints back11:18
pbourkeah yeah11:18
pbourkei heard about them11:18
sdakebut ya its a difficult quesiont to answer11:18
sdakethere is a LOt of value in amex cards11:18
pbourkei have an amex for work but never looked into one for personal use11:18
sdakebut they are expensive - 395$ a year11:19
sdakemy amex for work is what is going to platinum11:19
pbourkeah11:19
sdakethey will only give me a green card for personal use ;)11:19
sdakeneed like 750 credit to get a amex platinum for personal use11:19
sdakemy credit rating is 72011:20
sdakeperfect bill pay record11:20
sdakei'm not sure what else to fix :)11:20
*** banix has quit IRC11:20
openstackgerritMerged openstack/kolla: Implement nova-ssh container  https://review.openstack.org/30101011:21
sdakeok folks i need soem paches possibly merged if they haven't been yet11:21
*** ccesario___ has joined #openstack-kolla11:21
sdakelet me double heck the queue11:21
*** salv-orlando has joined #openstack-kolla11:23
*** banix has joined #openstack-kolla11:24
*** mbound has quit IRC11:24
*** jmccarthy has left #openstack-kolla11:25
openstackgerritMerged openstack/kolla: Check empty passwords in /etc/kolla/passwords.yml in prechecks  https://review.openstack.org/30099111:26
*** banix has quit IRC11:27
openstackgerritMerged openstack/kolla: Adds migration step from nova to nova_api database  https://review.openstack.org/30090411:30
openstackgerritMerged openstack/kolla: Add remove apparmor reminder to the quickstart  https://review.openstack.org/30018411:30
sbezverkJeffrey4l please check the failure in nova-ssh I consistently see in my test bed: http://paste.openstack.org/show/492961/11:31
*** mbound has joined #openstack-kolla11:39
*** mbound has quit IRC11:39
*** mbound has joined #openstack-kolla11:40
*** mbound has quit IRC11:40
Jeffrey4lsbezverk, should add a nova_ssh_key configure in the password.yaml. see that file. you should update that.11:40
*** dwalsh has joined #openstack-kolla11:41
*** dwalsh has quit IRC11:42
pbourkewe should merge this rabbitmq upgrade patch11:43
*** dwalsh has joined #openstack-kolla11:43
pbourkeanyone know of a reason not to?11:43
*** dwalsh has quit IRC11:44
*** dwalsh has joined #openstack-kolla11:44
*** mlima has joined #openstack-kolla11:46
openstackgerritMerged openstack/kolla: Check empty passwords in $CONFIG_DIR/passwords.yml  https://review.openstack.org/30145111:46
*** SiRiuS has joined #openstack-kolla11:52
*** iceyao has joined #openstack-kolla11:53
*** sdake_ has joined #openstack-kolla11:54
*** sdake has quit IRC11:55
mlimahello guys, what value should i set in openstack_release to deploy mitaka?11:57
openstackgerritMerged openstack/kolla: Enable the kibana access from the external network  https://review.openstack.org/29999411:57
rhalliseymlima, 2.0.011:59
*** andrewvwebber has joined #openstack-kolla11:59
mlimanice, thank you rhallisey11:59
mlima:)11:59
rhalliseyI think. Let me check11:59
mlima-^12:00
andrewvwebberIs it normal for the "Checking empty passwords in /etc/kolla/passwords.yml" precheck to fail when checking nova_ssh_key?12:00
mlimano12:01
andrewvwebberfor me, after running kolla-genpwd, the grep for the precheck fails on nova_ssh_key12:02
rhalliseymlima, ya it's 2.0.012:02
andrewvwebberthe precheck checks for empty passwords but it looks like the nova_ssh_key has a special format (nested private and public keys)12:02
mlimaperhaps this may be a bug12:03
*** kproskurin has joined #openstack-kolla12:04
*** kproskurin has quit IRC12:04
sbezverkJeffrey4l I have nova_ssh_key in my password.yml12:04
Jeffrey4lsbezverk, could u paste the passwords.yml file12:04
Jeffrey4lout12:04
andrewvwebberhttp://pastebin.com/raw/uHzhuKiB12:05
sbezverkJeffrey4l here you go: http://paste.openstack.org/show/492967/12:06
andrewvwebbermine is not populated during kolla-genpwd12:07
Jeffrey4lsbezverk, yours is wrong. see this.12:07
Jeffrey4lsbezverk, http://paste.openstack.org/show/492969/12:07
sbezverkJeffrey41 got it, let me re-try12:08
andrewvwebberthe second paste looks consistent with mine12:10
andrewvwebberhowever it fails prechecks12:10
andrewvwebberbecause nova_ssh_key is deemed empty12:11
*** mbound has joined #openstack-kolla12:11
andrewvwebberunless the indentation was not intended12:11
sdake_hey Jeffrey4l12:15
sdake_can you read https://bugs.launchpad.net/kolla/+bug/156427812:15
openstackLaunchpad bug 1564278 in kolla mitaka "mariadb.pid causes mariadb container from starting" [High,Confirmed]12:15
sdake_i will do th work but do you know what host should be set to  there for that play in my anasysi of the bug?12:16
sdake_andrewvwebber were you the cat who asked about coreos yesterday12:17
openstackgerritMauricio Lima proposed openstack/kolla: Add nova_ssh in cleanup containers script  https://review.openstack.org/30131912:17
andrewvwebbersdake - yes12:20
Jeffrey4lsdake_, sorry a bit of busy now. I will check that latter.12:20
andrewvwebberi have a baremetal coreos farm and presure from managment to "start VMs"12:20
andrewvwebberi am looking into running kolla on baremetal coreos machines - this is completely different that running kolla in kubernetes12:20
sdake_andrewvwebber got it12:21
sdake_so core os, there is a way to bootstrap the ptyhon runtime so ansible will run in thatnevironment12:22
sdake_I dont know how to do it12:22
andrewvwebberi have already achieved that12:22
sdake_ok well then it should djust work12:22
andrewvwebberhttps://coreos.com/blog/managing-coreos-with-ansible/12:22
andrewvwebberwell i am starting with a local dev environment first for testing but i am not getting so far due to precheck and missing /etc/kolla/memcached12:23
andrewvwebberhowever i am slowy learning that all of these scripts assume sudo12:23
sdake_kolla-ansible must be run as sudo12:24
sdake_we are working on fixing that12:24
sdake_kolla-ansible can be run without sudo but it is very complex and undocumented12:24
andrewvwebberi also need to learn how to run kolla on one network interface like devstack12:24
sdake_as in "I know it can be done but not quite sure yet how"12:24
andrewvwebberas we use bonding in production with coreos seeing one interface12:25
sdake_you only have one network interface for your neutron and management network?12:25
andrewvwebberour management network in production is IBMC12:25
sdake_this is not a typical deployment model12:25
sdake_(having only one networ kinterface)12:26
andrewvwebberwe have CEPH already running in docker containers sharing the application network12:26
andrewvwebberunfortunatly we didnt know about your CEPH containers at the time :(12:26
sdake_nuke and pave not an option? :)12:27
andrewvwebbernuke without downtime is hard12:27
sdake_ok well sounds slike you hae a bunch of issues to sort out12:27
andrewvwebber:)12:27
sdake_the memcached thing12:27
sdake_coudl you go into more detial on that12:28
g3ekGood monrning all!12:28
sdake_haven't heard anything about that problem12:28
andrewvwebberi was hoping i could use brctl and neutron would be happy12:28
sdake_hey g3ek12:28
andrewvwebbermemcached problem was solved with sudo - thanks12:28
g3ekWhat a beatiful day outside :)12:28
andrewvwebbernow i just have "Hostname has to resolve to IP address of api_interface"12:28
sdake_ok thatis eay to fix12:29
sdake_ /etc/hosts  needs to be filled out12:29
sdake_correctly12:29
g3ekandrewwebber you need to add both controller into the host file12:29
sdake_or your dns needs to resolve correctly12:29
sdake_ /etc/host file should have all nodes in cluster as well as the build node12:29
sdake_and then be copied to every node12:29
andrewvwebber127.0.0.1               localhost.localdomain localhost controller ?12:29
sdake_this i unfortunately documented12:29
sdake_undocumented12:30
sdake_no 127 is no beuno12:30
*** cfarquhar has quit IRC12:30
sdake_192.168.1.101 compute-0112:30
sdake_192.168.1.102 compute-0212:30
sdake_etc12:30
g3ekandrewvwebber, each controller need to see all others to do the cluster. (with the host name or like sdake said, a DNS)12:30
sdake_put in your ips and names for the copute/controllers12:30
*** cfarquhar has joined #openstack-kolla12:30
*** cfarquhar has joined #openstack-kolla12:30
andrewvwebberi am running the all-in-one on a single dev machine12:31
g3ekNot normal then ^^12:31
sdake_http://paste.fedoraproject.org/349805/14598595/ -> http://paste.fedoraproject.org/349805/1459859512:31
sdake_that is normal12:32
sdake_here is my /etc/hosts file12:32
sdake_minime-03 in this case is an AIO deployment atm12:32
sdake_since my lab is broken because of a remodel12:32
andrewvwebberminime is used in the all-in-one setup?12:32
g3ekhe said that he is working all-in-one. host file have nothing to do in that case (I think)12:32
sdake_yup12:32
sdake_g3ek yur wrong ;)12:33
g3eksdake, we learn every day ^^12:33
andrewvwebbersome kind of hard coded magic?12:33
sdake_g3ek its ok12:33
sdake_andrewvwebber here is the deal12:33
andrewvwebberhard coded magic is ok with me12:33
sdake_mariadb usese the hostname binary to resolve hosts12:33
sdake_why it does this is beyond my limited comprehension of bad design ;)12:34
sdake_so for kolla to work we have to make sure the resolver works12:34
sdake_to make the resolver work yo ucan either put the hosts in /etc/hosts or setup dns12:34
sdake_aio or not, doesnt matter12:34
sdake_mariadb still uses hostname binary in aio12:34
sdake_which uses resolver library12:34
g3ekoh! Good to know12:35
andrewvwebbermy limited understanding is that i only have one host - localhost12:35
andrewvwebbersmells like a use case for ETCD/Confd12:36
sdake_localhost iresolves to 127.0.0.112:37
andrewvwebbersorry i've been drinking to much of the coreos kool aid12:37
*** mwheckmann has joined #openstack-kolla12:37
sdake_in your machine you have na ip address that is your eth0 related to your ystem12:37
sdake_it has an ip other hten 127.0.0.112:37
sdake_you can see it via ip link show12:37
sdake_or ifcofnig12:37
andrewvwebberens912:37
sdake_that needs to go in /etc/hosts12:37
sdake_ens9 is htei nterface name - it has an ip address associated with it12:38
andrewvwebberunderstood12:38
sdake_cool12:38
sdake_this is clunky i agree12:38
sdake_blame mariadb ;)12:39
andrewvwebberwell at least your didnt create your own database like every new project ;)12:39
*** jtriley has joined #openstack-kolla12:39
g3eksdake, I explain a problem I have to rhallisey yesterday. Kolla host's don't initialise their own variable (like the ansible_ethX) as long their is no module run on the host. So if a run a new module directly after heka (like a DNS container only on the controller) it will be impossible to get the ethX of the compute and the storage node because it's still not initialise.12:40
sdake_g3ek is there a real world problem here12:41
sdake_or a theoretical issue12:41
sdake_its 5am12:41
sdake_my brain is haing trobuel reaching :)12:41
rhalliseyg3ek, we just need to get your new module to run after the common ones12:41
g3ekyes, If I tried to do DNS for all host (to use it in kolla installation) it's impossible to make it work if I dont do something very ugly (like doing a echo on all host before starting my new dns module)12:42
g3ekit's already like that12:42
g3ekI run my module after the common but still dont work12:42
g3ekYou should speak with rhallisey, I show i'm my case yesterday and he understood12:42
rhalliseyg3ek, ya but it's not actually running it, otherwise you would see heka12:42
g3ekI see heka on the controllers, but not on the compute and the storage12:43
rhalliseythe 3 common containers, heka, kolla-toolbox, and cron, should be on all your hosts12:43
rhalliseythat's my point12:43
g3ekoh, so something break it12:43
g3ek^^12:43
rhalliseybasically your play is not running as expected12:44
*** ccesario___ has quit IRC12:44
*** ccesario___ has joined #openstack-kolla12:45
g3ekSo strange, I already have the meta/main.yml with the dependencies of common... I will try to figure it out today. Need it to continue my task ^^12:46
openstackgerritVikram Hosakote proposed openstack/kolla: Check empty passwords in $CONFIG_DIR/passwords.yml  https://review.openstack.org/30163112:47
*** andrewvwebber has quit IRC12:55
*** klint has quit IRC12:56
*** sdake_ has quit IRC12:57
*** iceyao has quit IRC13:01
*** b_bezak_ has joined #openstack-kolla13:03
*** iceyao has joined #openstack-kolla13:04
*** weiyu_ has joined #openstack-kolla13:10
*** b_bezak_ is now known as b_bezak13:15
*** b_bezak has quit IRC13:19
*** mwheckmann has quit IRC13:21
*** cfarquhar has quit IRC13:21
*** salv-orlando has quit IRC13:21
*** rhallisey has quit IRC13:21
*** gfidente has quit IRC13:21
*** ayoung has quit IRC13:21
*** asalkeld has quit IRC13:21
*** akwasnie has quit IRC13:21
*** cloudnull has quit IRC13:21
*** allen_gao has quit IRC13:21
*** nihilifer has quit IRC13:21
*** clayton has quit IRC13:21
*** iceyao has quit IRC13:21
*** shardy has quit IRC13:21
*** yuanying has quit IRC13:21
*** mkoderer has quit IRC13:21
*** The_Ball has quit IRC13:21
*** dasm has quit IRC13:21
*** mbound has quit IRC13:21
*** Liuqing has quit IRC13:21
*** ccesario___ has quit IRC13:21
*** SiRiuS has quit IRC13:21
*** coolsvap has quit IRC13:21
*** shakamunyi has quit IRC13:21
*** smekel_ has quit IRC13:21
*** peterjenkins has quit IRC13:21
*** DuncanT has quit IRC13:21
*** bradjones has quit IRC13:21
*** mandre has quit IRC13:21
*** wmiller has quit IRC13:21
*** pbourke has quit IRC13:21
*** mgoddard has quit IRC13:21
*** logan- has quit IRC13:21
*** kbyrne has quit IRC13:21
*** elmiko has quit IRC13:21
*** weiyu_ has quit IRC13:21
*** openstackgerrit has quit IRC13:21
*** sbezverk has quit IRC13:21
*** cbaesema has quit IRC13:21
*** brad[] has quit IRC13:21
*** jtriley has quit IRC13:21
*** wznoinsk has quit IRC13:21
*** dims has quit IRC13:21
*** dmsimard has quit IRC13:21
*** jpeeler has quit IRC13:21
*** daneyon has quit IRC13:21
*** patchbot has quit IRC13:21
*** mkoderer__ has quit IRC13:21
*** zigo has quit IRC13:21
*** sekrit has quit IRC13:21
*** ChanServ has quit IRC13:21
*** kjelly has quit IRC13:21
*** jeblair has quit IRC13:22
*** dgonzalez has quit IRC13:22
*** lifeless has quit IRC13:22
*** dwalsh has quit IRC13:22
*** unicell has quit IRC13:22
*** diogogmt has quit IRC13:22
*** serverascode has quit IRC13:22
*** Slower has quit IRC13:22
*** jgriffith has quit IRC13:22
*** g3ek has quit IRC13:22
*** manjeets has quit IRC13:22
*** mikelk has quit IRC13:22
*** Jeffrey4l has quit IRC13:22
*** gmmaha has quit IRC13:22
*** GonZo2000 has quit IRC13:22
*** thomasem_ has quit IRC13:22
*** m3m0 has quit IRC13:22
*** robcresswell has quit IRC13:22
*** mlima has quit IRC13:22
*** mdnadeem has quit IRC13:22
*** athomas has quit IRC13:22
*** macsz has quit IRC13:22
*** ntpttr has quit IRC13:22
*** kklimonda has quit IRC13:22
*** slagle has quit IRC13:22
*** jasonsb has quit IRC13:22
*** ajafo has quit IRC13:22
*** jrist has quit IRC13:22
*** lmiccini has quit IRC13:22
*** cfarquhar_ has joined #openstack-kolla13:24
*** iceyao has joined #openstack-kolla13:24
*** inc0 has joined #openstack-kolla13:24
*** Marga_ has joined #openstack-kolla13:24
*** asalkeld has joined #openstack-kolla13:24
*** akwasnie has joined #openstack-kolla13:24
*** salv-orl_ has joined #openstack-kolla13:24
*** mwheckma1n has joined #openstack-kolla13:24
*** banix has joined #openstack-kolla13:24
*** weiyu_ has joined #openstack-kolla13:24
*** jtriley has joined #openstack-kolla13:24
*** mbound has joined #openstack-kolla13:24
*** SiRiuS has joined #openstack-kolla13:24
*** mlima has joined #openstack-kolla13:24
*** dwalsh has joined #openstack-kolla13:24
*** mdnadeem has joined #openstack-kolla13:24
*** kjelly has joined #openstack-kolla13:24
*** allen_gao has joined #openstack-kolla13:24
*** coolsvap has joined #openstack-kolla13:24
*** Liuqing has joined #openstack-kolla13:24
*** wmiller has joined #openstack-kolla13:24
*** pbourke has joined #openstack-kolla13:24
*** shardy has joined #openstack-kolla13:24
*** mgoddard has joined #openstack-kolla13:24
*** mikelk has joined #openstack-kolla13:24
*** unicell has joined #openstack-kolla13:24
*** sekrit has joined #openstack-kolla13:24
*** diogogmt has joined #openstack-kolla13:24
*** shakamunyi has joined #openstack-kolla13:24
*** Jeffrey4l has joined #openstack-kolla13:24
*** jasonsb has joined #openstack-kolla13:24
*** daneyon has joined #openstack-kolla13:24
*** openstackgerrit has joined #openstack-kolla13:24
*** athomas has joined #openstack-kolla13:24
*** wznoinsk has joined #openstack-kolla13:24
*** ajafo has joined #openstack-kolla13:24
*** macsz has joined #openstack-kolla13:24
*** jrist has joined #openstack-kolla13:24
*** nihilifer has joined #openstack-kolla13:24
*** logan- has joined #openstack-kolla13:24
*** dims has joined #openstack-kolla13:24
*** kbyrne has joined #openstack-kolla13:24
*** mandre has joined #openstack-kolla13:24
*** yuanying has joined #openstack-kolla13:24
*** gmmaha has joined #openstack-kolla13:24
*** patchbot has joined #openstack-kolla13:24
*** sbezverk has joined #openstack-kolla13:24
*** serverascode has joined #openstack-kolla13:24
*** jeblair has joined #openstack-kolla13:24
*** GonZo2000 has joined #openstack-kolla13:24
*** Slower has joined #openstack-kolla13:24
*** robcresswell has joined #openstack-kolla13:24
*** cbaesema has joined #openstack-kolla13:24
*** g3ek has joined #openstack-kolla13:24
*** brad[] has joined #openstack-kolla13:24
*** dasm has joined #openstack-kolla13:24
*** slagle has joined #openstack-kolla13:24
*** thomasem_ has joined #openstack-kolla13:24
*** m3m0 has joined #openstack-kolla13:24
*** dgonzalez has joined #openstack-kolla13:24
*** mkoderer__ has joined #openstack-kolla13:24
*** mkoderer has joined #openstack-kolla13:24
*** bradjones has joined #openstack-kolla13:24
*** peterjenkins has joined #openstack-kolla13:24
*** The_Ball has joined #openstack-kolla13:24
*** dmsimard has joined #openstack-kolla13:24
*** kklimonda has joined #openstack-kolla13:24
*** clayton has joined #openstack-kolla13:24
*** ChanServ has joined #openstack-kolla13:24
*** lifeless has joined #openstack-kolla13:24
*** elmiko has joined #openstack-kolla13:24
*** jpeeler has joined #openstack-kolla13:24
*** ntpttr has joined #openstack-kolla13:24
*** zigo has joined #openstack-kolla13:24
*** manjeets has joined #openstack-kolla13:24
*** smekel_ has joined #openstack-kolla13:24
*** lmiccini has joined #openstack-kolla13:24
*** DuncanT has joined #openstack-kolla13:24
*** jgriffith has joined #openstack-kolla13:24
*** wolfe.freenode.net sets mode: +o ChanServ13:24
*** openstackstatus has quit IRC13:24
*** openstackstatus has joined #openstack-kolla13:25
*** ChanServ sets mode: +v openstackstatus13:25
openstackgerritMerged openstack/kolla: Add nova_ssh in cleanup containers script  https://review.openstack.org/30131913:25
sbezverkinc0 I checked containers and they are at jinja 2 2.713:26
openstackgerritMauricio Lima proposed openstack/kolla: Add nova_ssh in cleanup containers script  https://review.openstack.org/30164813:26
inc0sbezverk, https://github.com/openstack/kolla/blob/master/requirements.txt#L613:27
inc0maybe we need to bump version of jinja in containers13:27
inc0btw...why do you need it in containers?13:27
inc0this code is run in deployment host13:27
*** gfidente has joined #openstack-kolla13:28
*** gfidente has joined #openstack-kolla13:28
*** cloudnull has joined #openstack-kolla13:28
sbezverkinc0 right,sorry that is what I meant13:28
sbezverkrpm -qa | grep jinja13:28
sbezverkpython-jinja2-2.7.2-2.el7.noarch13:28
*** andrewvwebber has joined #openstack-kolla13:28
*** rhallisey has joined #openstack-kolla13:29
*** ayoung has joined #openstack-kolla13:29
sbezverkinc0 http://paste.openstack.org/show/492992/13:29
inc0sbezverk, if you installed python lib with rpm, purge it before running pip13:29
inc0it will cause all sorts of errors around13:29
inc0or use virtualenv13:30
inc0that's true for lots of cases13:30
inc0because I bet pip installed correct jinja13:30
inc0but because you already have one in your system, old one takes priorit13:31
inc0y13:31
openstackgerritPaul Bourke proposed openstack/kolla: Log the SHA of the Git ref for source builds  https://review.openstack.org/30158313:31
sbezverkinc0 I do not see jinja in pip list13:31
sbezverkinc0 which exact rpm I need to remove from my system?13:32
inc0not sure how it is called in centos13:32
inc0python-jinja2 would be ubuntu standard13:32
inc0a packaged one in any case13:33
sbezverkinc0 one sec let me try13:33
sbezverkinc0 ok so what happened, when I remove rpm for jinja 2.7.2 it also removes ansible, after that I do see jinja 2.8 in pip, but when I try to install back ansible, I am forced to install jinja 2.7.2, ideas?13:36
inc0sbezverk, you try to install ansible with rpm?13:37
inc0try pip install ansible==1.9.413:37
sbezverkinc0 ok13:39
pbourkeinc0: I'd like to merge your rabbit upgrade, you happy enough with it?13:39
inc0pbourke, was happy with it for a while;)13:40
pbourkethat's what I thought :)13:40
inc0I honestly thought it was merged already13:40
inc0then I looked at my reviews and bam13:40
sbezverkinc0 done, will start build images and deploy, let you know the result in a bit..13:40
inc0sbezverk, pip freeze | grep jinja13:41
inc0or python -c import jinja2; print(jinja2.__version__)13:41
inc0sbezverk, for the record, I strongly suggest using virtualenvs13:44
inc0makes this kind of trouble disapear13:45
*** mgoddard_ has joined #openstack-kolla13:45
sbezverkinc0 will start right after get iscsi merged ;-)13:45
inc0hehe13:46
*** salv-orlando has joined #openstack-kolla13:46
sbezverkinc0 new trouble, http://paste.openstack.org/show/492996/13:46
inc0did you manage to get it workign for buntu?13:46
inc0did you pip install -r requirements after removing it from rpm?13:46
sbezverkinc0 not yet I spent whole yesterday fighting for swift de-rooting13:47
sbezverkinc0 yes13:47
inc0soo...well13:47
inc0try virtualenv13:47
inc0something in your system got messy13:47
inc0virtualenv --no-site-packages name_of_env13:47
inc0and then name_of_env/bin/activate13:47
*** andrewvwebber has quit IRC13:48
*** mgoddard has quit IRC13:48
*** salv-orl_ has quit IRC13:49
*** ccesario___ has joined #openstack-kolla13:49
sbezverkinc0 "-bash: swift-root/bin/activate: Permission denied"13:53
sbezverkinc0 swift-root is the name of virtualenv13:53
inc0that is a strange behavior....13:54
inc0can you change name to swift_root?;)13:54
inc0of directory13:54
sbezverkinc0 sure, let me try again13:55
inc0after you do this pip install -e . in kolla dir13:55
*** mbound has quit IRC13:55
*** mgoddard_ has quit IRC13:56
*** mgoddard has joined #openstack-kolla13:57
*** b_bezak has joined #openstack-kolla13:57
sbezverkinc0 it really does not like to what was done with jinja, see this paste: http://paste.openstack.org/show/493000/ :-(14:01
*** ccesario___ has quit IRC14:02
*** andrewvwebber has joined #openstack-kolla14:02
*** mgoddard_ has joined #openstack-kolla14:02
sbezverkinc0 I will go back to the original config, commit for review change in swift root and then will work on getting jinja 2.8..14:03
inc0sbezverk, try Jinja214:04
inc0uppercase14:04
inc0and this is wrong...14:04
inc0sure, commit what you have14:05
*** mgoddard has quit IRC14:06
sbezverkinc0 ok I will ping you as soon as swift is done..14:06
andrewvwebberwhat is the workflow to make changes to the config files - for example nova.conf14:07
andrewvwebbersorry - i just found "Kolla's Solution to Customization"14:11
*** sdake has joined #openstack-kolla14:15
*** mbound has joined #openstack-kolla14:15
*** banix has quit IRC14:17
*** banix has joined #openstack-kolla14:17
sbezverksdake could you please check if you have jinja rpm installed, I am curious if jinja issue is just with my deployment server or it is cenots related..14:19
*** Marga_ has quit IRC14:20
sdakehttp://paste.fedoraproject.org/349853/45986604/ -> http://paste.fedoraproject.org/349853/4598660414:21
*** banix has quit IRC14:21
*** haplo37 has joined #openstack-kolla14:21
sbezverksdake thank you, inc0 - sdake also has jinja 2.7.2 I guess it is something centos related..14:22
sdakeyou probably have two jinja2s installed14:23
sdakels -ld /usr/lib/python2.7/site-packages/jinja2*14:23
sdakedont ask me why that happens14:23
sdakebut it happens all the time to me14:23
sdakeor *jinja2*14:23
sdakeinc0 yo need your assistance14:24
inc0sdake, pip doesnt know how to rpm14:24
inc0wassup?14:24
sdakehttps://bugs.launchpad.net/kolla/+bug/156427814:24
openstackLaunchpad bug 1564278 in kolla mitaka "mariadb.pid causes mariadb container from starting" [High,Confirmed] - Assigned to Steven Dake (sdake)14:24
sdakecan you oread that14:24
sdakewhat i need should be obvious i the last comment14:24
sdakeinc0 also i am out 4/13 from 9:30-12 for a webinar14:27
sdakeI think this is when our team meeting is14:27
sdakeso if you want to run the meeting that owuldbe grand14:27
*** weiyu_ has quit IRC14:27
sdakerhallisey is free to help as well14:27
inc0tomorrow I'm out for big all hands14:28
inc0so I guess...Ryan?:)14:28
inc0sdake, yeah...delegate magic14:28
inc0basically what it does is waiting for pidfile to appear14:29
*** achanda has joined #openstack-kolla14:29
sdakeapri 13th dude14:29
sdakeinc0 i know14:29
sdakewhat i proposed is using wait_for instead14:29
inc0ah apr 13 is ok14:29
sdakeand not using all that delgate stuff which is fragile and broken14:29
inc0I'll be here14:29
sdakewhat I need to knwo is the hostname to talk to14:30
inc0so delegate is ensuring that it runs on one host14:30
sdakewhat is the correct syntax14:30
inc0need to figure out which one14:30
sdakeit doesn't matter if you use wait_for14:30
sdakeit matters if you look a t tthe pid14:30
sdakelook at the last cmment, my proposal14:30
inc0local action is no good14:31
rhalliseyinc0, ya I got it14:31
inc0it will fail if you have external deploy host14:31
sdakeok local action no good14:31
sdakewe get rid of local action14:31
sdakewait for runs on the deployed host14:31
sdaketha tshould be fine then no?14:31
inc0another thing14:33
inc0haproxy will bind to this port14:33
sdakeno, port 330614:33
inc0but on floaring14:33
inc0yeah it will14:33
inc0however14:33
mlimasdake, about this https://review.openstack.org/#/c/299534/ . Mitaka was affected, but i need more time to do some little changes14:33
patchbotmlima: patch 299534 - kolla - Fix manila keystone v3 issues for all clients14:33
mlimavariables names, etc14:33
sdakehaproxy buind sto port 3306 on external or internal vip14:34
sdakei want to waitfor oncnect to the actual machine's ip that the job is runnning on14:34
sdakeon port 330614:34
inc0ip you want there to be is: {{ hostvars[inventory_hostname]['ansible_' + api_interface]['ipv4']['address'] }}14:35
inc0or rather14:35
sdakethe current logic is flawed anwyay, waiting for the pid doesn't tell you the sericei s up14:35
inc0{{ hostvars[item['item']]['ansible_' + hostvars[item['item']]['api_interface']]['ipv4']['address'] }}14:36
sdakeand item comes from where?14:37
inc0good catch, item is inventory_hostname14:37
inc0that was copypasta from rabbit check14:37
inc0btw we need to do the same for haproxy as well14:38
sdake will do14:38
sdakeyou mean for haproxy mysql?14:38
sdakethat is already there14:38
sdakebut it doesn't use the regex logic14:38
inc0no, hold on I'm getting bug up14:38
*** achanda has quit IRC14:39
inc0aaa no...it will be ok14:39
*** diogogmt has quit IRC14:39
sdakeso what is correct format of the syntax then14:40
inc0actually for your case {{ hostvars[inventory_hostname]['ansible_' + api_interface]['ipv4']['address'] }} wil be ok as well14:40
inc0sorry for a mixup14:40
sdakeinventory_hostname contains what?14:40
sdakethe hostname the task is running on?14:40
inc0yup14:41
sdakecool thats what i want14:41
inc0current node14:41
sdakedon think think replacing that current logic with waitfor as described is simpler and less prone to brakage?14:41
inc0I do14:41
inc0I think it's how it should be done14:41
inc0but make sure to add some sort of timeout14:42
inc0in case that mariadb actually fails14:42
inc0to start14:42
sdakeyes of couse14:42
sdakei was thinking 60 secondds14:42
sdakebut can make it less14:42
inc0I think 60 is reasonable14:43
sbezverknot sure why review request does not pops up here, but please review https://review.openstack.org/25937414:43
inc0better a bit too much than too little14:44
*** mgoddard has joined #openstack-kolla14:47
*** mgoddard_ has quit IRC14:47
*** andrewvwebber has quit IRC14:47
*** ccesario___ has joined #openstack-kolla14:48
sdakesbezverk bot must be busted14:48
*** b_bezak has quit IRC14:48
sdakesbezverk beyond all contianers are up and running14:49
sdakedoes swift stil lwork14:49
sdakecan yu create swift stuff whatevver that is14:49
sbezverksdake yes, I use swift as a backend for glance14:51
sdakeinc0 nm on meeting on 13th itss at he 2300 slot14:51
sdakemy webinar is at 1600 utc14:51
inc0kk14:51
sdakeafte rwe get through mitaka, i'll trian you on running meetings as porimised14:52
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the Neutron reconfigure  https://review.openstack.org/30173714:52
*** sdake_ has joined #openstack-kolla14:54
*** sdake has quit IRC14:57
sdake_sbezverk let chat now if your avilaable14:58
sdake_Jeffrey4l is reconfigure nearly completlly working ;)14:59
Jeffrey4lsdake_, yea. I am trying to test all the service.14:59
Jeffrey4lreconfigure is important to the end-user.14:59
sdake_Jeffrey4l fantastic15:00
sdake_Jeffrey4l i'm uper happy to hear your on the job of testing it out15:00
sdake_because we want it to work ;)15:00
Jeffrey4lsdake_, :D my pleasure.15:00
*** blahRus has joined #openstack-kolla15:00
*** ccesario___ has quit IRC15:01
*** ccesario___ has joined #openstack-kolla15:01
*** mkoderer__ has quit IRC15:02
inc0hey guys, I need proper testing on centos: https://review.openstack.org/#/c/299563/15:03
patchbotinc0: patch 299563 - kolla - Making Mitaka deploying liberty15:03
inc0also pointers how to debug this gate15:03
sdake_inc0 after mitaka you have my full atention i promise ;)15:03
sbezverkinc0 I finished with swift for now and ready to get jinja 2.8, I checked my system and I see jinja 2 in "/usr/lib/python2.7/site-packages"15:04
coolsvapinc0: i will test15:04
sdake_sbezverk you may have it pip instlaled and rpm installed15:04
coolsvapsbezverk: thanks for the help with swift15:04
sbezverkbut import still fails when jinja 2.7.2 rpm is removed..15:04
inc0sdake_, ok...we need it properly tested before summit15:04
sdake_sbezverk the wayto fix that is to remove one of them15:04
inc0all I'm saying15:04
inc0and I mean really deeply tested15:05
sdake_inc0 agreedi want the backport done before summit15:05
inc0potentially this is first code people will actually use15:05
sdake_right15:05
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Making Mitaka deploying liberty  https://review.openstack.org/29956315:07
*** ccesario___ has quit IRC15:09
*** iceyao has quit IRC15:11
openstackgerritMerged openstack/kolla: Log the SHA of the Git ref for source builds  https://review.openstack.org/30158315:12
*** banix has joined #openstack-kolla15:12
*** reddy has joined #openstack-kolla15:14
*** vhosakot has joined #openstack-kolla15:15
*** vhosakot has quit IRC15:16
*** mkoderer__ has joined #openstack-kolla15:16
sbezverkcoolsvap not a problem glad to help..15:18
*** vhosakot has joined #openstack-kolla15:22
*** vhosakot has quit IRC15:23
*** vhosakot has joined #openstack-kolla15:24
*** mikelk has quit IRC15:25
*** dave-mccowan has joined #openstack-kolla15:27
*** sdake_ has quit IRC15:27
*** sdake has joined #openstack-kolla15:27
*** daneyon has quit IRC15:28
*** daneyon has joined #openstack-kolla15:28
*** diogogmt has joined #openstack-kolla15:28
*** stvnoyes has joined #openstack-kolla15:29
sdakeinc0 that host id worked thakns ;)15:31
*** ccesario___ has joined #openstack-kolla15:34
inc0cool15:37
inc0we may want to do the same in other places15:37
inc0it's better15:37
sdakeagree15:37
*** Marga_ has joined #openstack-kolla15:38
*** Liuqing has quit IRC15:38
*** Marga_ has quit IRC15:38
*** Marga_ has joined #openstack-kolla15:38
*** Marga_ has quit IRC15:39
*** Marga_ has joined #openstack-kolla15:39
openstackgerritMauricio Lima proposed openstack/kolla: Fix manila keystone v3 issues for all clients  https://review.openstack.org/29953415:41
mlimadone sdake ^15:41
mlimathis pachset is working in master and stable/mitaka15:42
sdakemlima thanks15:42
openstackgerritPaul Bourke proposed openstack/kolla: Log the SHA of the Git ref for source builds  https://review.openstack.org/30178515:50
openstackgerritPaul Bourke proposed openstack/kolla: Log the SHA of the Git ref for source builds  https://review.openstack.org/30178715:51
*** ccesario has joined #openstack-kolla15:54
openstackgerritPaul Bourke proposed openstack/kolla: Log the SHA of the Git ref for source builds  https://review.openstack.org/30179215:55
openstackgerritPaul Bourke proposed openstack/kolla: Log the SHA of the Git ref for source builds  https://review.openstack.org/30179315:56
*** stvnoyes has left #openstack-kolla15:58
mlimasdake, you defined kolla 1.1.0 "liberty" as milestone for mitaka15:58
sdakewhere did i d othat15:59
sdakelink?15:59
mlimahttps://bugs.launchpad.net/kolla/+bug/156397215:59
openstackLaunchpad bug 1563972 in kolla mitaka "Manila keystone v3 issues for all clients" [Low,In progress] - Assigned to Mauricio José de Lima (mlima) (limamauricio)15:59
ccesariogood afternoon :)16:02
openstackgerritSteven Dake proposed openstack/kolla: Increase max scheduling attempts to 50  https://review.openstack.org/30091416:02
openstackgerritSteven Dake proposed openstack/kolla: Change waiting on mariadb.pid  https://review.openstack.org/30177216:02
ccesarioelemoine_, hi.... what is your doubt about this ps https://review.openstack.org/#/c/300888/  ?16:02
patchbotccesario: patch 300888 - kolla - Added missing haproxy log dir.16:02
sdakepbourke rhallisey inc0 please ack https://review.openstack.org/#/c/301772/216:02
patchbotsdake: patch 301772 - kolla - Change waiting on mariadb.pid16:02
sdakeneed this stuff to hit the repo so people can be running it in their daily environments16:03
openstackgerritMerged openstack/kolla: Check empty passwords in $CONFIG_DIR/passwords.yml  https://review.openstack.org/30163116:03
sdakeinc0 https://review.openstack.org/#/c/300914/316:03
patchbotsdake: patch 300914 - kolla - Increase max scheduling attempts to 5016:03
sdakemanjeets confirmed he no longer saw the rescheduling error with the patch applied16:03
sdakethe default of 3 is too low for 100 node cluster16:04
*** jpeeler has quit IRC16:06
*** diogogmt_ has joined #openstack-kolla16:06
*** diogogmt has quit IRC16:07
*** diogogmt_ is now known as diogogmt16:07
inc0hehe I was just deploying liberty and ran into mariadb bug16:08
inc0with your cherrypick sdake it works perfectly16:08
*** unicell has quit IRC16:08
sdakenice16:08
inc0duh...nova_ssh is enabled by default?16:09
dave-mccowani'm following doc/cinder-guide.rst to set up file backed block storage.  i'm using centos7 and the steps aren't working for me.  when i create a volume, it gets stuck in "creating" status.16:11
dave-mccowanany tips?16:11
inc0hmm, never used file backend tbh16:12
inc0let me try16:12
Jeffrey4lsdake, https://review.openstack.org/#/c/301772/2 i blocked this merged. I still think there are some wrone with your patch.16:14
patchbotJeffrey4l: patch 301772 - kolla - Change waiting on mariadb.pid16:14
sdakewrong how?16:15
inc0Jeffrey4l, not sure what will happen in gerrit now;) let see16:15
inc0and wrong how?16:15
dave-mccowaninc0 i'm just looking for something quick.  if there's a better solution, i'm happy to do that instead.16:15
inc0dave-mccowan, so that's the reason we have cinder disabled by default16:15
sdakedave-mccowan the bettersolution is to use ceph16:15
inc0there is not16:16
inc0ceph is our solution16:16
inc0sbezverk, is working on getting iscsi up but that is nontrivial thing in containers16:16
inc0will be there in N16:16
Jeffrey4lsdake, i am still checking the code. mariadb is really tricky. So we should be careful for this.16:16
dave-mccowanis there a ceph option for all-in-one?16:16
sdakeJeffrey4l i didn't test multinode16:16
sdakeperhaps you can do that16:16
Jeffrey4lgive me more time please.16:17
sdakemaybe mulitnode presents a different regex16:17
sdakewill do16:17
Jeffrey4lsdake, I am think remove the when clause will be fault in some case.16:17
sdakehere is what the patch is supposed to do16:18
sdakeon every node mriadb is running during bootstrap, its  supposed to check just the bootstrapped ndoe for the open mariadb service16:18
inc0dave-mccowan, indeed there is16:19
inc0sdake, I did test multinode and it worked16:19
sdakemy lab should be  operational soon16:20
inc0https://github.com/openstack/kolla/blob/master/doc/ceph-guide.rst16:20
sdakeand i'll test my own multinode patches16:20
sdakemy own patches multindoe that is ;)16:20
Jeffrey4lsdake, roger that. give me more time to consume that. very appricate that. If i found nothing, I will let that PS go.16:21
dave-mccowaninc0  line 12 or that doc says minimum 3 nodes16:22
*** jasonsb has quit IRC16:22
dave-mccowaninc0 nevermind.  i'll try again reading all the words. :-)16:22
*** jpeeler has joined #openstack-kolla16:23
*** jpeeler has joined #openstack-kolla16:23
sbezverkinc0 the change breaks nova_compute, but what is strange the volume where I suspect the issue sits is not the one I changed..16:23
sbezverkinc0 http://paste.openstack.org/show/493028/16:24
*** larsks has joined #openstack-kolla16:26
*** banix has quit IRC16:27
sdakedave-mccowan the immediate downside of our implementation of ceph is it  rquires an entre disk16:27
sdakeit wont just use a partition16:28
sbezverkdave-mccowan if you really want cinder and lvm, you can try my patch, it is has been tested with centos source and it works.. I can help you set it up if you want..16:30
*** unicell has joined #openstack-kolla16:33
dave-mccowani'm just looking for shortest path to a working cinder for a all-in-one dev setup.16:33
sdakedave-mccowan its 3 patches - pretty straight forward - might be easier then getting ceph going16:33
sdakeceph is easy16:33
sdakeif you have an extra disk16:34
sdakeit is literlaly 2 steps16:34
sdakelabel the disk16:34
sdakechange config tow ork with 1 disk16:34
sdakeif you dont have an extra disk16:34
sdakeno beuno16:34
dave-mccowanceph it is16:34
sdakemaybe 3 steps ;)16:34
sdakeenable_ceph:yes16:35
*** banix has joined #openstack-kolla16:39
*** salv-orlando has quit IRC16:40
*** unicell has quit IRC16:48
*** mbound has quit IRC16:48
sdakehey guys I got a 4:20 deploy time!16:57
sdakebut unfortunately its not firday16:58
inc0sdake, a bit more steps17:02
*** ccesario___ has quit IRC17:02
sdakeok well i am not certain17:03
inc0sdake, dave-mccowan so to enable ceph you need to do "enable_ceph" and designate few block devices for OSD17:03
sdakebut its not mission imposible17:03
inc0it's all in guide17:03
inc0nah, it's pretty easy17:03
inc0biggest thing is having more than one block device17:03
inc0you can experiment with having a loop fake device for osd, but I wont be able to help with that17:03
sdakenote i just rebuilt from centos source17:05
sdakeand cant launch nova vms17:05
rhalliseysdake, lol17:05
sdakeso beware of master ;)17:05
*** rajathagasthya has joined #openstack-kolla17:06
sdakei had to do i t because of the nova-ssh addition17:06
*** banix has quit IRC17:08
*** banix has joined #openstack-kolla17:09
*** sdake_ has joined #openstack-kolla17:10
*** sdake has quit IRC17:10
gmmahasdake_: might i ask what errors you are getting?17:12
*** ccesario___ has joined #openstack-kolla17:12
Jeffrey4lsdake_, i have removed my -1 workflow. It should works. Sorry for what i done.17:12
*** unicell has joined #openstack-kolla17:21
*** salv-orlando has joined #openstack-kolla17:21
*** Marga_ has quit IRC17:22
*** Jeffrey4l has quit IRC17:25
*** ccesario___ has quit IRC17:33
*** shardy has quit IRC17:34
*** ccesario___ has joined #openstack-kolla17:34
*** coolsvap has quit IRC17:41
*** coolsvap has joined #openstack-kolla17:42
sdake_jeffrey4l n reason to apologize17:46
sdake_you hae done nothing but imrpove the quality of the code which is a  good thing ;)17:46
ccesariohi folks, a question.... haproxy is it supported when using AIO deploy!?17:52
inc0ccesario indeed it is17:52
inc0if you set up your floating ip right17:52
ccesarioinc0, yes yes17:53
sdake_i recommend never running without haporxy17:53
sdake_it is just confusing to eveyrone ;)17:53
*** Marga_ has joined #openstack-kolla17:53
ccesariomlima, ^^17:54
ccesarioinc0, sdake_   thanks a lot by info :)17:54
*** coolsvap has quit IRC17:54
mlimaenable_haproxy = yes i have an error in TASK: [mariadb | Waiting for MariaDB service to be ready through VIP] *********17:55
mlimajust it17:55
sdake_what is your vip?17:56
inc0sdake_, I think we can remove taks mlima is talking about after your patch17:56
sdake_inc0 that task ensures haproxy is ready to rock17:56
inc0haproxy is deployed before mariadb17:57
sdake_my patch only ensures mariadb is ready to rock17:57
sdake_your correct makes sense17:57
sdake_i think we still want to wait on haproxy being operational though17:58
sdake_the issue ithink mlima has is that his vip is the same as his host ip17:58
sdake_there is a precheck in the repo or in teh queue that does this already17:58
inc0then mariadb won't even start17:58
mlimayes yes sdake17:58
mlimabut when i change it, i have the same error17:59
mlimaops, my bad, not the same error17:59
inc0it's either enable_haproxy AND different ip OR enable_haproxy=no AND same ip as host17:59
sdake_are you in a vm?17:59
mlimayes17:59
mlimavm17:59
sdake_virtualbox?17:59
mlimayes17:59
sdake_you need to setu pyour virtualbox correctly for vip to work18:00
mlimahm..18:01
SiRiuSsdake_, you said you rebuilt from source but failed to launch instances. Is that the case with stable/mitaka as well?18:01
sdake_SiRiuS i didn't try stable/mtaka18:01
SiRiuSsdake_, I'm using stable/mitaka built images for kolla-mesos, and can't launch instances18:02
sdake_nothing has mergedi nto stable/mitaka since rc3 which DId work18:03
sdake_so the upstream packages slikely got blown up in some way18:03
*** mgoddard_ has joined #openstack-kolla18:03
*** diogogmt_ has joined #openstack-kolla18:04
SiRiuSsdake_, did centos master binary builds work for you ?18:04
sdake_master works in every way but vm launching centos source was my build18:04
SiRiuSsdake_, ok, I'll very possible build, and see what I get :)18:06
SiRiuS*I'll try18:06
*** unicell1 has joined #openstack-kolla18:06
SiRiuS*every18:06
*** unicell1 has quit IRC18:06
*** unicell has quit IRC18:06
*** unicell has joined #openstack-kolla18:06
*** diogogmt has quit IRC18:06
*** diogogmt_ is now known as diogogmt18:06
*** unicell has quit IRC18:07
*** mgoddard has quit IRC18:07
*** unicell has joined #openstack-kolla18:07
vhosakotyesterday's master is fine for me on Ubuntu18:08
*** unicell has quit IRC18:08
*** unicell has joined #openstack-kolla18:08
ccesariosdake_, did you check it ? https://review.openstack.org/#/c/300888/18:09
patchbotccesario: patch 300888 - kolla - Added missing haproxy log dir.18:09
rajathagasthyaHi! I'm getting "Hostname has to resolve to IP address of api_interface" error in Rabbitmq container during deploy. I changed the /etc/hosts file to remove 127.0.0.1 localhost entries, but I still get this error. Any idea how to resolve this?18:10
rajathagasthyaI'm on AIO Virtualbox and the full error message can be found here: http://paste.openstack.org/show/492937/18:11
vhosakotrajathagasthya: can you pastebin the contents of your   /etc/hosts   and   /etc/resolv.conf18:11
rajathagasthyavhosakot: Sure, one moment.18:12
rajathagasthyavhosakot: http://paste.openstack.org/show/493045/18:14
*** diogogmt has quit IRC18:17
vhosakotrajathagasthya: can you ping your hostname ?   does      ping `hostname`    pass ?18:17
rajathagasthyavhosakot: Yep, that passes. Hostname is operator.local as you see in the /etc/hosts content.18:18
vhosakotrajathagasthya: I just have  <IP address> hostname    in my /etc/hosts and works for me ?  what is    "172.28.128.3  operator" ?  did vagrant put it ?18:20
rajathagasthyavhosakot: Yeah, I believe that's generated by the vagrant host-manager plugin.18:21
SiRiuSrajathagasthya, can you paste the contents of globals.yml ?18:22
rajathagasthyaSiRiuS: http://paste.openstack.org/show/493048/18:25
SiRiuSwell, there's your problem :)18:26
SiRiuSkolla_internal_vip_address has to be 172.28.128.3 or 172.28.128.254 if using haproxy18:26
rajathagasthyaSiRiuS: Okay, but I have enable_haproxy=no in globals.yml. Should I enable that?18:27
SiRiuSrajathagasthya, it is recommend, since most people test kolla that way18:27
vhosakotkolla_internal_vip_address must be an _unused_ IP in the 172.28.128.* network18:27
SiRiuSI deployed with haproxy18:28
vhosakotah ok18:28
rajathagasthyaSiRiuS: Cool, let me give it a shot. Thanks. :)18:28
rajathagasthyaThanks, vhosakot. :)18:28
vhosakotwait. 1 sec18:28
rajathagasthyaYeah?18:28
*** salv-orlando has quit IRC18:28
SiRiuSrajathagasthya, the 10.0.2.15 is used internally by Vagrant, and should not be used for anything related to OpenStack18:29
sbezverkanybody tried to launch VM on the latest master?18:29
vhosakot10.0.2.15 is put by vagrant... ah.. is it used on any IP ?18:29
*** diogogmt has joined #openstack-kolla18:29
vhosakotrajathagasthya: can you pastebin your output of "ip a" and "ifconfig -a"18:30
SiRiuSvhosakot, 10.0.2.15 is for internet connectivity and "vagrant ssh" command18:30
vhosakotah I see18:30
SiRiuSrajathagasthya,18:31
rajathagasthyavhosakot: http://paste.openstack.org/show/493051/ and http://paste.openstack.org/show/493052/18:31
SiRiuSrajathagasthya, not good18:32
SiRiuSyou should not use enp0s3 anywhere inside the globals.yml file18:32
SiRiuSenp0s8 should be used for network_interface18:33
SiRiuSand enp0s9 should be used for neutron_external_interface18:33
rajathagasthyaSiRiuS: Oh okay. And for neutron_external_interface?18:33
vhosakotSiRiuS: can you please submit a PS with a sample working globals.yml in vagrant env.... if you're busy, can you pastebin it, I will submit it into kolla repo and add you as co-author...18:34
rajathagasthyaSiRiuS: Got it.18:34
vhosakoti dont use vagrant... and install manually18:34
*** dwalsh has quit IRC18:34
rajathagasthyavhosakot: I was deploying Kolla for the first time, so I thought Vagrant will be quicker. :)18:34
SiRiuSvhosakot, I'm currently deploying kolla-mesos, but I'll make a sample config and paste it, sure18:35
vhosakotyep, many people use vagrant18:35
vhosakotcool.. thanks Siru18:35
vhosakotSiRiuS18:35
rajathagasthyaOkay, will try with the changes now.18:36
*** rajathagasthya has quit IRC18:45
*** rajathagasthya has joined #openstack-kolla18:45
sbezverkvhosakot have you launched VM on todays's master? I see some strange libvirt qemu failures, on the change which was working fine yesterday. here is paste with error log: http://paste.openstack.org/show/493055/18:48
vhosakotsbezverk: I will check now...18:51
*** jtriley has quit IRC18:52
*** rajathagasthya has quit IRC18:52
sbezverkvhosakot I will try again but with just master, no any changes18:53
vhosakotcool18:53
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Making Mitaka deploying liberty  https://review.openstack.org/29956319:02
*** andrewvwebber has joined #openstack-kolla19:08
*** mgoddard_ has quit IRC19:10
mlimaguys, can i have it variable_name: "value1,value2" in globals?19:12
inc0mlima, not really but there are other ways to use lists in yaml19:25
vhosakotsbezverk: yes, I am able to successfully boot a nova VM with latest master AIO without any issues....  http://paste.openstack.org/show/493061/    I can also access the console of the nova VM in horion.. here is the screenshot of horizon....  http://picpaste.com/pics/Screen_Shot_2016-04-05_at_3.20.52_PM-Q6nRWr93.1459884169.png19:25
mlimainc0, ok i just was thinking about multibackend in cinder19:26
mlima:)19:26
*** salv-orlando has joined #openstack-kolla19:31
*** sdake_ has quit IRC19:31
vhosakotmlima: for multi-backend for cinder, why variable must have multiple values ?   won't  something like "enabled_backends=lvm,ceph" in cinder.conf work ?   https://github.com/openstack/kolla/blob/master/ansible/roles/cinder/templates/cinder.conf.j2#L2119:33
mlimavhosakot, that's it19:34
vhosakotmlima: then, which varibale in globals.yml would need something like variable_name: "value1,value2" for multi-backend ?19:35
mlimacinder_backend for example19:35
vhosakotmlima: I am not able to find the variable cinder_backend19:36
*** salv-orlando has quit IRC19:39
mlimavhosakot, I thought about creating a variable as "cinder backend" in globals, where the user can escolhar which backends will want to use. Just an idea19:39
*** inc0 has quit IRC19:39
*** sdake has joined #openstack-kolla19:40
*** salv-orlando has joined #openstack-kolla19:41
vhosakotmlima: hmmmm... and how should it be used it code ?  pass the values of cinder_backend to enabled_backends of cinder.conf ?19:41
mlimavhosakot, yes, that's the idea, but i don't know if it will work19:42
mlimajust an idea, I think it needs some study on how we can do this19:44
*** sdake has quit IRC19:44
*** sdake has joined #openstack-kolla19:46
*** dwalsh has joined #openstack-kolla19:53
*** sdake_ has joined #openstack-kolla19:58
*** sdake has quit IRC20:01
*** rajathagasthya has joined #openstack-kolla20:06
*** mwheckma1n has quit IRC20:10
*** sdake_ has quit IRC20:12
*** sdake has joined #openstack-kolla20:13
gmmahahi, should the nova-ssh key folder get populated by generate-passwords or other scripts?20:15
gmmahai am using master to deploy and hitting this error. http://paste.openstack.org/show/493070/20:15
*** banix has quit IRC20:16
vhosakotgmmaha: can you do    grep nova_ssh_key /etc/kolla/passwords.yml20:17
gmmahavhosakot: nothing20:17
vhosakotgmmaha: latest master ?20:17
gmmahavhosakot: yeah 2f4a3f35c00277cc97e887ba647395a702268e8420:18
gmmahai ran generate-passwords.py20:18
gmmahaor should i be running a different one?20:18
vhosakotplease run "kolla-genpwd", then "kolla-ansible prechecks" and re-deploy20:18
gmmahavhosakot: http://paste.openstack.org/show/493071/20:19
gmmahai am tyring to keep them all as source as possible..20:19
gmmahaagainst installing packages20:19
vhosakotgmmaha: tools/generate_passwords.py20:20
gmmahavhosakot: yeah, ran that before i deployed20:20
gmmahaand still no nova_ssh_key on the tree20:20
gmmahavhosakot: ok..20:21
gmmahai cant have the old file there20:21
gmmahai had to copy the newer version of it from {source_dir}/etc/kolla/passwords.yml and then run generate20:22
gmmahaand with that now, nova_ssh_key is empty20:22
gmmahavhosakot: have a feeling its a bug.. it shoulld read the file in /etc/kolla/passwords.yml, but add/append the new key, values to the end20:22
*** mark-casey has joined #openstack-kolla20:23
vhosakotnova_ssh_key is supposed to be empty20:23
gmmahasorry its not empty20:23
gmmahai have a key there :)20:23
vhosakotyep20:23
gmmahabut then it cant expect me to copy the new template with all the keys to /etc/kolla20:24
gmmahahow about changing it to reading the keys from {soruce_dir}/etc/kolla/passwords.yml, see if that jey exusts in /etc/kolla/passwords.yml and add it if it doesnt20:24
*** reddy has quit IRC20:25
rajathagasthyaSiRiuS, vhosakot - I made changes to globals.yml like you said, but it still fails. Not sure what's going on. Could you check if my globals.yml is correct? http://paste.openstack.org/show/493072/20:25
rajathagasthyaI tried with both 172.28.128.254 and 172.28.128.3 as kolla_internal_vip_address.20:25
mark-caseyhello all. I was wondering why you can't build/run centos packages on ubuntu? I thought that was part of the whole promise of docker(?). It isn't a problem for me I'm just wanting to understand20:25
*** reddy has joined #openstack-kolla20:26
mark-caseyI was thinking maybe the privileged mode and --net=host stuff, but that was just a guess20:26
SiRiuSrajathagasthya, depends what fails20:26
SiRiuSdid it deploy ?20:27
rajathagasthyaSiRiuS: Same error as before. "Hostname has to resolve to IP address of api_interface" in rabbitmq.20:27
gmmaharajathagasthya: how does your /etc/hosts look?> Do you have all the IPs and hostnames in it20:28
SiRiuSrajathagasthya, what OS do you use for vagrant?20:28
rajathagasthyaSiRiuS: RHEL 7.220:29
rajathagasthyagmmaha: Yep, I have IPs and hostnames in /etc/hosts.20:29
SiRiuSshould be the same as centos20:29
rajathagasthyaSiRiuS: Oh! Why is that?20:30
SiRiuSrajathagasthya, can you check /usr/share/kolla/ansible/group_vars/all.yml20:31
SiRiuSand see if enable_haproxy is yes20:31
SiRiuS?20:31
SiRiuSrajathagasthya, in centos (which I deployed) my interfaces are eth0, eth1, eth220:32
gmmahavhosakot: shall i file something in launchpad for that? maybe i can explain that better there20:32
rajathagasthyaSiRiuS: enable_haproxy is "yes".20:33
SiRiuShow did you build the images ?20:33
SiRiuScentos / binary ?20:33
SiRiuSdid you just use kolla-build with no options?20:34
rajathagasthyaSiRiuS: Yep, centos. Just used kolla-build command with default base image.20:34
SiRiuSrajathagasthya, did haproxy deploy ?20:37
SiRiuSdo a docker ps -a20:37
rajathagasthyaSiRiuS: No, I don't see haproxy container running.20:38
SiRiuSare there any others running?20:38
rajathagasthyaYeah. Mariadb, cron, heka, memcached, kolla_toolbox.20:38
*** unicell has quit IRC20:39
SiRiuShmm, haproxy should have deployed before mariadb20:39
SiRiuSand before rabbitmq20:39
rajathagasthyaIs using RHEL a problem? I change eth0, eth1 in globals.yml to my interface names.20:39
SiRiuSis haproxy is not deployed the .254 IP is unreachable20:40
SiRiuSi don;t think so20:40
SiRiuSexecute docker images | grep haproxy20:41
rajathagasthyaOkay, I cleaned up and deployed again. haproxy container is now up, waiting for rabbitmq.20:41
*** unicell has joined #openstack-kolla20:42
SiRiuSyou should see something like "waiting for mariadb to appear on the virtual IP"20:42
*** unicell has quit IRC20:42
SiRiuSand it should succeed20:42
*** unicell has joined #openstack-kolla20:42
rajathagasthyaSiRiuS: Looks like it succeeded this time.20:43
SiRiuScool :)20:43
rajathagasthyaSiRiuS: Thanks for your help. :)20:44
SiRiuSwhen you clean remember to use cleanup-containers20:44
SiRiuSand cleanup-host20:44
rajathagasthyaSure.20:44
SiRiuSthere are other steps also20:44
SiRiuSare you on wifi ?20:45
rajathagasthyaNo, the server is not on wifi.20:45
SiRiuSoh, ok :)20:45
rajathagasthyaNow I'm hitting "nova_ssh_key is undefined" error. I remember someone else mentioning about this?20:45
SiRiuSyou need to generate passwords20:46
rajathagasthyaCool, will do.20:46
SiRiuSlook in ~/kolla/tools/20:47
SiRiuSthere is a generate_passwords .py20:47
rajathagasthyaOkay. Doesn't kolla-genpwd command work here?20:48
SiRiuSprobably, my last deployment had hardcoded passwords20:48
SiRiuS:)20:48
SiRiuSso I did not do this step20:48
SiRiuSwas sometime last weak20:49
SiRiuSthings changed a little20:49
*** rhallisey has quit IRC20:49
*** ccesario___ has quit IRC20:50
mark-caseycan I run kolla-build inside a container if I've bind mounted the host's docker socket into said container?20:50
SiRiuSrajathagasthya, so to be clear, you are running VirtualBox on a server that is connected to a wired network, right ?20:50
rajathagasthyaSiRiuS: That's correct.20:50
SiRiuSrajathagasthya, you still need to to another step, though20:51
SiRiuSgo to virtual box20:51
openstackgerritBenedikt Trefzer proposed openstack/kolla: add curlrc file to base image  https://review.openstack.org/30191120:51
*** rhallisey has joined #openstack-kolla20:51
SiRiuSand open the settings for the VM20:51
*** rhallisey has quit IRC20:52
gmmahahi, anyone able to run kolla with linuxbrdige..the linuxbridge container is on restart and i see this when i try to run the command http://paste.openstack.org/show/493076/20:53
gmmahaand i dont have neutron.conf file20:54
rajathagasthyaSiRiuS: Okay and?20:55
SiRiuSgo to the 3rd adapter20:56
SiRiuSand at promiscuous mode set it to ALLOW-ALL20:56
SiRiuSotherwise neutron will not work correctly20:56
rajathagasthyaOkay, cool.20:56
*** unicell1 has joined #openstack-kolla21:00
*** unicell has quit IRC21:00
SiRiuSrajathagasthya, is 10.30.118.85 an IP on your physical network21:05
SiRiuS?21:05
SiRiuSwhat is the internal ip of your sever that is running virtual box?21:06
rajathagasthyaSiRiuS: It is, but I'm not sure how that IP was assigned to one of the interfaces. It's possible that IP might already be in use by someone else.21:06
rajathagasthya172.28.128.321:07
SiRiuSrajathagasthya, that is the IP inside the VM21:07
rajathagasthyaOh, you mean the server running VB. 10.30.118.7621:07
SiRiuSyes, looks good21:07
SiRiuSif you go to the settings page where you changed the promiscuous mode setting, you will see that the adapter is attached to "bridged networking"21:08
SiRiuSthat is how you got the IP21:09
rajathagasthyaSiRiuS: So tools/generate_passwords.py logic is that it generates pwd only if nova_ssh_key is present and None. It doesn't create that key if it doesn't exist at all. This is expected?21:09
SiRiuSyou probably have a DHCP server running in the physical network21:09
rajathagasthyaOh, then it makes sense now.21:10
*** haplo37 has quit IRC21:10
SiRiuSrajathagasthya, I can't help you on that, I have not deployed the most recent version of kolla21:10
SiRiuSthe genpass stuff is recently added21:10
gmmaharajathagasthya: i saw the same issue..21:11
SiRiuSbefore that, passwords were hardcoded21:11
rajathagasthyaYeah, I saw the recent commits. Anyway, thanks. :)21:11
gmmahacopy the latest verison of passwords.yml from etc/kolla nad then it will generate it proeprly21:11
gmmahawill go and file a bug on that soon21:11
gmmahait doesnt add the key:value if it doesnt exist in the file21:12
rajathagasthyagmmaha: Exactly.21:12
gmmaharajathagasthya: right.. will file a bug and maybe submit a patch21:12
rajathagasthyagmmaha: Sounds good.21:13
sdakesbezverk ping21:17
sdakefile a bug on what gmm?21:18
sdakegmmaha ?21:18
gmmahasdake: on how generate_passwords.py works21:18
gmmahasdake: https://bugs.launchpad.net/kolla/+bug/156653821:18
openstackLaunchpad bug 1566538 in kolla "generate_password.yml does not add new keys added to deployment" [Undecided,New]21:18
gmmahalet me know what you think21:18
sdakewhat we reallly need is a config migrate21:19
sdakelike how database migrations work21:19
gmmahasdake: yes, that would be an ideal solution21:19
sdakegmmaha cloud working well these days?21:19
gmmahathougt his would be much easier to do compared to a config migrate21:20
gmmahasdake: its working until i find ways to vreak21:20
gmmahabreak it(21:20
gmmahaand ohh linuxbrdige is definitely broken with latest master on kolla..21:20
sdakehoep your filing bugs for those21:20
gmmahasdake: i am going to now21:20
gmmahahttp://paste.openstack.org/show/493076/21:20
*** smekel_ has quit IRC21:20
*** peterjenkins has quit IRC21:20
gmmahawith linux bridge (guessing its an ansible bug) the respective conf files are not getting generated..21:20
sdakebummer21:21
sdakethat is a critical issue21:21
sdakelinux bridge is half  the deployment world21:21
gmmahasdake: ohhhh21:21
gmmahaalright21:21
gmmahalet em file a bug irght away21:21
gmmaharight*21:21
*** peterjenkins has joined #openstack-kolla21:23
*** smekel_ has joined #openstack-kolla21:23
*** rhallisey has joined #openstack-kolla21:23
*** ccesario___ has joined #openstack-kolla21:23
gmmahasdake: https://bugs.launchpad.net/kolla/+bug/156654321:23
openstackLaunchpad bug 1566543 in kolla "linuxbridge deployment is broken with latest master (2f4a3f35c00277cc97e887ba647395a702268e84)" [Undecided,New]21:23
*** daneyon has quit IRC21:25
sbezverksdake pong21:26
sdakesbezverk my 3 hour meeting ended early21:26
sdakei am taking my daughter to the doctor now21:26
sdakei shoud e back around 4:30pm my time so our original tie shoud lstill be good21:26
sbezverksdake sounds good21:27
*** sdake_ has joined #openstack-kolla21:30
openstackgerritMerged openstack/kolla: Change waiting on mariadb.pid  https://review.openstack.org/30177221:30
*** ccesario___ has quit IRC21:32
*** sdake has quit IRC21:33
*** sdake_ has quit IRC21:37
*** sdake has joined #openstack-kolla21:38
*** inc0 has joined #openstack-kolla21:38
*** sdake has quit IRC21:39
inc0howdy partners?21:40
*** clayton has quit IRC21:47
*** clayton has joined #openstack-kolla21:47
*** gfidente has quit IRC21:48
*** gfidente has joined #openstack-kolla21:48
*** gfidente has quit IRC21:48
*** gfidente has joined #openstack-kolla21:48
*** ccesario___ has joined #openstack-kolla21:53
*** gfidente has quit IRC21:54
sbezverkinc0 my comment about conditional volume failure this morning was not correct, it looks like after playing with jinja and ansible I got myself this bizarre issue..21:54
inc0so you got it working?21:55
*** dave-mccowan has quit IRC21:55
sbezverkso even the lastest master wihtout any patches is failing for me to launch the instance21:55
inc0dirty env is painful21:55
sbezverkI am reverting back to jinja 2.7.2 see if just master will work21:56
sbezverkif no - reformat :-) if yes - scrathcing head :-)21:56
inc0jinja shouldnt affect spawning vms21:56
inc0like....not even close to this layer of abstraction21:57
inc0anyway, gonna prep some bbq21:57
inc0cya all tomorrow21:57
*** inc0 has quit IRC21:57
sbezverkinc0 have a good one21:58
*** dave-mccowan has joined #openstack-kolla22:02
*** daneyon has joined #openstack-kolla22:03
*** daneyon_ has joined #openstack-kolla22:03
*** daneyon has quit IRC22:07
*** dougs has quit IRC22:08
*** dougs has joined #openstack-kolla22:08
*** SiRiuS has quit IRC22:18
*** SiRiuS has joined #openstack-kolla22:19
*** SiRiuS has quit IRC22:26
*** banix has joined #openstack-kolla22:35
*** ccesario___ has quit IRC22:37
*** ccesario___ has joined #openstack-kolla22:40
*** diogogmt has quit IRC22:48
*** rajathagasthya has quit IRC22:50
*** rajathagasthya has joined #openstack-kolla22:51
*** dwalsh has quit IRC22:51
*** diogogmt has joined #openstack-kolla22:51
*** ccesario___ has quit IRC22:57
*** ccesario___ has joined #openstack-kolla23:00
*** ccesario___ has quit IRC23:02
*** ccesario___ has joined #openstack-kolla23:03
*** ccesario___ has quit IRC23:06
*** ccesario___ has joined #openstack-kolla23:07
*** salv-orlando has quit IRC23:12
manjeetssdake sdake_ still here23:14
*** Marga__ has joined #openstack-kolla23:15
*** Marga__ has quit IRC23:15
manjeetshttp://paste.openstack.org/show/493091/ finally 100% without errors23:18
*** Marga_ has quit IRC23:18
*** weiyu has joined #openstack-kolla23:18
*** andrewvwebber has quit IRC23:19
*** ccesario___ has quit IRC23:21
*** sdake has joined #openstack-kolla23:23
*** banix has quit IRC23:23
*** rajathagasthya has quit IRC23:24
*** Marga_ has joined #openstack-kolla23:25
*** vhosakot has quit IRC23:29
openstackgerritSteven Dake proposed openstack/kolla: Change waiting on mariadb.pid  https://review.openstack.org/30197423:30
openstackgerritVikram Hosakote proposed openstack/kolla: Add general_log to mariadb container and make heka collect it  https://review.openstack.org/30197523:32
*** banix has joined #openstack-kolla23:32
*** blahRus has quit IRC23:34
*** Marga_ has quit IRC23:37
*** banix has quit IRC23:37
*** daneyon has joined #openstack-kolla23:38
*** Marga_ has joined #openstack-kolla23:44
*** ccesario___ has joined #openstack-kolla23:44
*** Marga_ has quit IRC23:46
*** Marga_ has joined #openstack-kolla23:46
*** Marga_ has quit IRC23:50
*** Marga_ has joined #openstack-kolla23:51
*** sdake_ has joined #openstack-kolla23:53
*** Marga_ has quit IRC23:56
*** sdake has quit IRC23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!