Saturday, 2016-05-07

*** sacharya has quit IRC00:06
*** dwalsh has joined #openstack-kolla00:07
*** aginwala has joined #openstack-kolla00:08
*** absubram has quit IRC00:10
*** MarMat has quit IRC00:14
*** aginwala has quit IRC00:14
godleonHi all, my kolla deployment was failed bcz the timeout of "Waiting for MariaDB service to be ready through VIP" here is the log. http://pastebin.com/UeECy05F00:15
godleonI found task "haproxy" was skipped by all controllers, compute node, and storage node. Is that correct?00:16
*** allen_gao has quit IRC00:17
godleonI'd be appreciate if someone can give me some hints. Thanks in advanced. :)00:17
openstackgerritQiu Yu proposed openstack/kolla: Derecate httpd/keystone.py for Keystone 9.0.0 release  https://review.openstack.org/31381400:18
*** unicell has quit IRC00:20
*** aginwala has joined #openstack-kolla00:24
*** vhosakot has joined #openstack-kolla00:24
*** aginwala has quit IRC00:27
*** aginwala has joined #openstack-kolla00:32
*** godleon has left #openstack-kolla00:34
*** godleon has joined #openstack-kolla00:34
*** dwalsh has quit IRC00:35
*** daneyon has joined #openstack-kolla00:36
*** godleon_ has joined #openstack-kolla00:36
*** godleon_ has quit IRC00:37
*** jasonsb has joined #openstack-kolla00:37
vhosakotgodleon: ping00:37
godleonvhosakot: ping VIP ?00:38
vhosakotgodleon: I pinged you to see if were online :)00:39
vhosakotgodleon: do you have enable_haproxy:yes ?00:39
*** ravig has quit IRC00:39
godleonvhosakot: :) got it. Isn't HA in multiple nodes native configuration?00:40
vhosakotgodleon: yes, it is on by default   https://github.com/openstack/kolla/blob/master/ansible/group_vars/all.yml#L17700:41
vhosakotgodleon: why is haproxy skipping on all the nodes for you ?00:41
*** daneyon has quit IRC00:41
godleonvhosakot: I didn't change the configuration in all.yml, I tried to do the smallest change to configuration to deploy.00:42
godleonvhosakot: I don't know why it skipped.....00:42
godleonIt shouldn't skip, right?00:42
vhosakotyes...00:43
*** fragatin_ has quit IRC00:43
vhosakotit should not skip00:43
godleonvhosakot: Did you see the pastebin ?00:43
godleonhttp://pastebin.com/UeECy05F00:43
vhosakotgodleon: yep, saw that... the errors in lines 1036-1074 is  the issue I think00:44
vhosakotgodleon: the error is  "OSError: [Errno 13] Permission denied: '/etc/.ansible_m_sysctl_CuxeYm.conf'"  when the task  "haproxy | Setting sysctl values"  is run00:45
godleon vhosakot: Do you have any ideas to fix the issue?00:45
vhosakotdon't know...00:45
vhosakotgodleon: can you delete existing haproxy container, and try  "kolla-ansible deploy -t haproxy"  and run just the haproxy container...00:46
godleon vhosakot: When I saw the logs, I found "Permission denied" in it. So I asked if the root privilege is needed for deploying as the first question.00:47
godleonvhosakot: wow, what a great idea.00:47
vhosakotgodleon:  you can try sudo00:48
godleonvhosakot: What's your TZ ?00:49
vhosakotgodleon: EST00:49
vhosakotgodleon: do you see the dir /etc/kolla/haproxy ?00:49
vhosakoton the deploy node00:50
godleonno00:53
godleonshould it exist?00:53
vhosakotyes!00:55
vhosakotgodleon: that is your issue00:55
vhosakotgodleon: I think kolla is not installed properly on your deploy node00:55
vhosakotgodleon: can you uninstall kolla, clenaup everything and re-deploy ?00:56
godleonvhosakot: sure, can I just copy the haproxy folder to /etc/kolla?00:56
vhosakotgodleon: run cleanup-containers, cleanup-images and cleanup-host in https://github.com/openstack/kolla/tree/master/tools,  uninstall kolla,  pull the latest latest master, install kolla, rebuild, re-deploy00:57
vhosakotgodleon: you can't copy it from anywhere.. kolla creates it using jinja2 temaplate00:57
godleonvhosakot: ok, will do! Thanks for your suggestion.00:57
vhosakotgodleon: cool. np!00:57
godleonvhosakot: ok, got it. So I should use the kolla installation script to so that, right?00:58
vhosakotgodleon: please follow https://github.com/openstack/kolla/blob/master/doc/quickstart.rst00:58
godleonvhosakot: I just followed doc to do that. I will try to fix by the way.00:59
godleonvhosakot: I got some errands to do. Come back after few minutes. :)00:59
vhosakotgodleon: cool!00:59
*** aginwala has quit IRC01:02
*** aginwala has joined #openstack-kolla01:05
*** sacharya has joined #openstack-kolla01:07
*** aginwala has quit IRC01:08
*** aginwala has joined #openstack-kolla01:11
*** sacharya has quit IRC01:12
*** ravig has joined #openstack-kolla01:13
openstackgerritHui Kang proposed openstack/kolla: Add precheck to the gate deploy job  https://review.openstack.org/31381901:14
*** aginwala has quit IRC01:19
*** sacharya has joined #openstack-kolla01:31
*** unicell has joined #openstack-kolla01:33
*** mark-casey has quit IRC01:34
*** sacharya has quit IRC01:37
godleonvhosakot: I have seen the kolla quickstart again, may I ask which step will make hapxory folder exist in /etc/kolla?01:42
godleonvhosakot: pip install kolla/ ?01:42
vhosakotgodleon: it is created during "kolla-ansible dpeloy"01:43
godleonvhosakot: on deploy node ?01:44
vhosakotgodleon: yes01:48
*** sacharya has joined #openstack-kolla01:57
*** sdake_ has quit IRC01:58
*** ozialien10 has quit IRC01:59
*** sdake has joined #openstack-kolla02:00
*** sacharya has quit IRC02:10
*** sacharya has joined #openstack-kolla02:13
*** sacharya has quit IRC02:18
*** mummer has joined #openstack-kolla02:22
godleonvhosakot: I found the /etc/kolla/haproxy folder only exist in network01 node, not in all other remote nodes(control0[1:3], compute01, and storage01).02:24
vhosakotgodleon: yes.... that is correct... becuase haproxy is run in just the network node in the multinode inventory  -->  https://github.com/openstack/kolla/blob/master/ansible/inventory/multinode#L36-L3702:25
vhosakotgodleon: is it the same in your inventory file ?02:26
godleonvhosakot: oh..... yes.....02:27
vhosakotgodleon: cool.. it is correct then02:27
godleonso the VIP will run on the network node ?02:27
vhosakotgodleon: yes... and will be pingable form all nodes.. in an all-in-one deploy, vip will on be the same all-in-one node02:36
godleonvhosakot: Did you test the code by root or non-root user?02:41
*** signed8bit is now known as signed8bit_Zzz02:41
vhosakotgodleon: root02:41
*** sacharya has joined #openstack-kolla02:42
godleonvhosakot: ok, it does have some problems if you use non-root user.02:42
vhosakotgodleon: no.. I have successfully run kolla as non-root user with sudo access02:43
godleonvhosakot: really?02:43
vhosakotgodleon: yep.. I do it daily :) with no issues :)02:43
*** sdake has quit IRC02:43
godleonvhosakot: ok, I try to give modified privileges to my non-root user on network node. And the error message changed.02:44
godleonhttps://www.irccloud.com/pastebin/zbeNhM1d/02:45
godleonvhosakot: I got the error message above.02:45
godleonvhosakot: It seems like another permission problem.02:45
vhosakotgodleon: can you try sudo02:46
vhosakotgodleon: net.unix.max_dgram_qlen  can be changed only by privileged user in Linux02:46
godleonvhosakot: yes, but sudo means you deploy remote nodes by root, right?02:47
vhosakotgodleon: yes02:47
godleonok, will do. Let me try it.02:47
*** dave-mccowan has quit IRC02:48
vhosakotgodleon: cool02:49
*** MarMat has joined #openstack-kolla02:53
*** klint has joined #openstack-kolla02:56
*** signed8bit_Zzz is now known as signed8bit03:00
*** signed8bit has quit IRC03:01
*** allen_gao has joined #openstack-kolla03:06
*** aginwala has joined #openstack-kolla03:13
*** daneyon has joined #openstack-kolla03:18
*** daneyon has quit IRC03:23
openstackgerritQiu Yu proposed openstack/kolla: Use updated wsgi file for Keystone 9.0.0 release  https://review.openstack.org/31381403:28
*** mummer has quit IRC03:47
*** MarMat has quit IRC03:49
*** MarMat has joined #openstack-kolla03:49
*** jasonsb has quit IRC03:51
*** vhosakot has quit IRC04:06
*** unicell has quit IRC04:07
*** salv-orlando has joined #openstack-kolla04:08
*** unicell has joined #openstack-kolla04:08
*** jasonsb has joined #openstack-kolla04:14
*** banix has quit IRC04:15
*** salv-orlando has quit IRC04:18
*** coolsvap has joined #openstack-kolla04:19
*** unicell has quit IRC04:22
*** jasonsb has quit IRC04:32
*** jasonsb has joined #openstack-kolla04:34
*** unicell has joined #openstack-kolla04:34
*** jasonsb has quit IRC04:43
*** sacharya has quit IRC04:59
*** hibob has joined #openstack-kolla04:59
*** ravig has quit IRC05:21
*** ozialien10 has joined #openstack-kolla05:23
*** ozialien10 has quit IRC05:28
*** ozialien10 has joined #openstack-kolla05:29
*** coolsvap has quit IRC05:33
godleonvhosakot: I found that the VIP precheck issue was gone if I deployed with root privilege.05:50
godleonvhosakot: So it seems using normal user privilege with sudo is not enough to do precheck successfully.05:51
*** sacharya has joined #openstack-kolla05:59
*** daneyon has joined #openstack-kolla06:01
*** MarMat has quit IRC06:02
*** sacharya has quit IRC06:04
*** daneyon has quit IRC06:05
*** Jeffrey4l has quit IRC06:13
*** hibob has quit IRC06:20
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the copy docker log typo  https://review.openstack.org/31383806:22
*** Jeffrey4l has joined #openstack-kolla06:27
*** stvnoyes has joined #openstack-kolla06:28
*** sacharya has joined #openstack-kolla07:01
*** sacharya has quit IRC07:05
*** salv-orlando has joined #openstack-kolla07:23
*** ccesario___ has quit IRC07:24
*** salv-orlando has quit IRC07:33
*** mdnadeem_home has quit IRC07:36
*** salv-orlando has joined #openstack-kolla07:38
*** salv-orlando has quit IRC07:47
*** daneyon has joined #openstack-kolla07:49
*** daneyon has quit IRC07:53
*** aginwala has quit IRC07:59
*** aginwala has joined #openstack-kolla08:04
*** mbound has joined #openstack-kolla08:34
*** reddydodda has joined #openstack-kolla08:38
*** mbound has quit IRC08:42
*** ccesario___ has joined #openstack-kolla08:45
*** mbound has joined #openstack-kolla08:46
*** mbound has quit IRC08:50
*** ccesario___ has quit IRC08:52
*** aginwala has quit IRC08:53
*** mdnadeem_home has joined #openstack-kolla08:59
*** sacharya has joined #openstack-kolla09:01
*** sacharya has quit IRC09:06
*** hibob has joined #openstack-kolla09:10
hibobHi all, does this repo "git://git.openstack.org/openstack/kolla" well? I have tried for 2 days but hang at 99% everytime. Is there any work around ? Thanks.09:22
*** pbourke has quit IRC09:23
*** pbourke has joined #openstack-kolla09:23
hibobThe repo works just now! It's magic ...  :-)09:27
*** Jeffrey4l has quit IRC09:35
*** daneyon has joined #openstack-kolla09:38
*** daneyon has quit IRC09:42
*** Jeffrey4l has joined #openstack-kolla09:48
*** mdnadeem_home has quit IRC10:05
*** wanglm has joined #openstack-kolla10:08
wanglmtask path: /usr/share/kolla/ansible/roles/common/tasks/deploy.yml:4 included: /usr/share/kolla/ansible/roles/common/tasks/bootstrap.yml for localhost  TASK [common : Creating log volume] ******************************************** task path: /usr/share/kolla/ansible/roles/common/tasks/bootstrap.yml:2 ESTABLISH LOCAL CONNECTION FOR USER: root localhost EXEC /bin/sh -c '( umask 22 && mkdir -p "` echo $HOME/.ansible/tmp/ansible10:09
wanglmcan anyone have konw the problem?10:10
godleonI am also in stuck now, haproxy did not work. :(10:11
*** dwalsh has joined #openstack-kolla10:12
*** wanglm_ has joined #openstack-kolla10:13
*** wanglm has quit IRC10:15
wanglm_when exec  kolla_docker:     action: "create_volume"10:15
*** wanglm has joined #openstack-kolla10:18
*** wanglm_ has quit IRC10:19
*** wanglm has quit IRC10:24
*** wanglm has joined #openstack-kolla10:29
*** ccesario___ has joined #openstack-kolla10:39
*** salv-orlando has joined #openstack-kolla10:42
*** salv-orlando has quit IRC10:46
*** ccesario___ has quit IRC10:56
*** hibob has quit IRC10:57
*** ccesario___ has joined #openstack-kolla11:01
*** sacharya has joined #openstack-kolla11:02
*** Jeffrey4l has quit IRC11:03
*** Jeffrey4l has joined #openstack-kolla11:04
*** sacharya has quit IRC11:07
*** ccesario___ has quit IRC11:09
*** wanglm has quit IRC11:12
*** ccesario___ has joined #openstack-kolla11:17
*** ccesario___ has quit IRC11:19
*** ccesario___ has joined #openstack-kolla11:20
*** SiRiuS__ has joined #openstack-kolla11:20
*** dmk0202 has joined #openstack-kolla11:26
*** gbraad has quit IRC11:27
*** gbraad has joined #openstack-kolla11:28
*** dwalsh has quit IRC11:30
*** reddydodda has quit IRC11:41
*** mbound has joined #openstack-kolla11:41
*** hibob has joined #openstack-kolla11:46
*** reddydodda has joined #openstack-kolla11:56
*** MarMat has joined #openstack-kolla12:20
*** daneyon has joined #openstack-kolla12:20
*** reddydodda has quit IRC12:21
*** daneyon has quit IRC12:24
*** banix has joined #openstack-kolla12:26
*** reddydodda has joined #openstack-kolla12:33
*** dave-mccowan has joined #openstack-kolla12:37
*** dwalsh has joined #openstack-kolla12:51
*** klint has quit IRC12:57
*** dmk0202 has quit IRC13:00
*** sacharya has joined #openstack-kolla13:03
*** sacharya has quit IRC13:07
*** dwalsh has quit IRC13:12
*** MarMat has quit IRC13:17
*** reddydodda has quit IRC13:18
*** mbound has quit IRC13:40
*** allen_gao has quit IRC13:43
*** mbound has joined #openstack-kolla13:43
*** allen_gao has joined #openstack-kolla13:45
*** mbound has quit IRC13:45
*** dwalsh has joined #openstack-kolla13:46
*** banix has quit IRC13:48
*** salv-orlando has joined #openstack-kolla13:49
*** dwalsh has quit IRC13:54
*** salv-orlando has quit IRC13:57
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix the gate lying  https://review.openstack.org/31359113:59
*** dwalsh has joined #openstack-kolla14:04
*** daneyon has joined #openstack-kolla14:08
*** banix has joined #openstack-kolla14:12
*** daneyon has quit IRC14:13
*** dwalsh has quit IRC14:15
*** openstackstatus has quit IRC14:22
*** openstack has joined #openstack-kolla14:23
*** openstackstatus has joined #openstack-kolla14:23
*** ChanServ sets mode: +v openstackstatus14:23
*** hibob has quit IRC14:25
*** banix has quit IRC14:28
*** hibob has joined #openstack-kolla14:28
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Add docs about config overrides  https://review.openstack.org/31367214:31
*** ccesario___ has quit IRC14:36
*** banix has joined #openstack-kolla14:37
*** aginwala has joined #openstack-kolla14:42
godleonHi all, I got successful response from network node when deploying HAProxy, but I am always stuck in the task "mariadb | Waiting for MariaDB service to be ready through VIP"(actually the VIP can not pingable). Is there any one has any idea for checking what's going on? Thanks in advanced.14:47
godleonhttps://www.irccloud.com/pastebin/0p2x6njy/14:47
godleonObviously, the VIP is not up and running. But I don't know why the HAProxy task could pass.14:51
godleonhttps://www.irccloud.com/pastebin/CyIXres2/14:55
*** allen_gao has quit IRC14:56
*** allen_gao has joined #openstack-kolla14:58
*** aginwala has quit IRC15:02
*** Jeffrey4l has quit IRC15:02
*** sacharya has joined #openstack-kolla15:04
*** banix has quit IRC15:08
*** sacharya has quit IRC15:08
*** ravig has joined #openstack-kolla15:12
*** SiRiuS__ has quit IRC15:18
*** SiRiuS__ has joined #openstack-kolla15:19
*** salv-orlando has joined #openstack-kolla15:22
*** allen_gao has quit IRC15:28
*** allen_gao has joined #openstack-kolla15:29
*** salv-orlando has quit IRC15:33
*** ravig has quit IRC15:40
*** ravig has joined #openstack-kolla15:41
*** coolsvap has joined #openstack-kolla15:47
*** ccesario___ has joined #openstack-kolla15:48
*** salv-orlando has joined #openstack-kolla15:54
*** salv-orlando has quit IRC15:58
*** mdnadeem_home has joined #openstack-kolla16:01
*** mdnadeem_home has quit IRC16:10
severionhas anyone been getting this error?16:16
severionfatal: [localhost] => error while evaluating conditional: '169.254.' not in kolla_internal_vip_address and 'False' in kolla_internal_vip_address | ipaddr(ip_addr_output.stdout.split()[3])16:16
severionso, no matter what value i have for kolla_internal_vip_address, this error persists.16:16
severionand it's been happening on all hosts i've tried to build out for AIO test environments.16:16
severionand then i get "ERROR: kolla_docker is not a legal parameter in an Ansible task or handler" every time i try to build, and ignore the prechecks.16:17
severionwhat am i doing wrong?16:17
*** banix has joined #openstack-kolla16:21
*** ravig has quit IRC16:27
*** banix has quit IRC16:30
*** SiRiuS__ has quit IRC16:36
*** SiRiuS__ has joined #openstack-kolla16:37
*** SiRiuS__ has quit IRC16:49
*** SiRiuS__ has joined #openstack-kolla16:57
*** ravig has joined #openstack-kolla16:57
*** sacharya has joined #openstack-kolla17:04
*** sacharya has quit IRC17:10
*** mdnadeem_home has joined #openstack-kolla17:10
*** godleon has quit IRC17:19
*** ccesario___ has quit IRC17:24
*** severion has quit IRC17:27
*** v1k0d3n has joined #openstack-kolla17:28
*** salv-orlando has joined #openstack-kolla17:30
*** salv-orlando has quit IRC17:34
*** SiRiuS__ has quit IRC18:03
*** mdnadeem_home has quit IRC18:08
*** hibob has quit IRC18:23
*** coolsvap has quit IRC18:29
*** salv-orlando has joined #openstack-kolla18:31
*** salv-orlando has quit IRC18:36
*** absubram has joined #openstack-kolla18:36
*** absubram_ has joined #openstack-kolla18:39
*** absubram has quit IRC18:40
*** absubram_ is now known as absubram18:40
*** SiRiuS__ has joined #openstack-kolla18:43
*** ravig has quit IRC18:45
*** ravig has joined #openstack-kolla18:53
*** ravig has quit IRC18:55
*** absubram has quit IRC18:59
v1k0d3ndoes anyone know what this error is from? ERROR: kolla_docker is not a legal parameter in an Ansible task or handler19:02
*** sacharya has joined #openstack-kolla19:05
*** ravig has joined #openstack-kolla19:07
*** sacharya has quit IRC19:10
*** sacharya has joined #openstack-kolla19:12
*** ravig has quit IRC19:29
*** mdnadeem_home has joined #openstack-kolla19:41
*** fragatina has joined #openstack-kolla19:51
*** fragatina has joined #openstack-kolla19:52
*** salv-orlando has joined #openstack-kolla19:57
*** salv-orlando has quit IRC20:04
*** godleon has joined #openstack-kolla20:05
godleonseverion: Try to do it by root, the internal VIP check seems only workable for root, not for other users(even sudoer).20:10
*** ravig has joined #openstack-kolla20:21
*** fragatina has quit IRC20:24
*** fragatina has joined #openstack-kolla20:26
*** daneyon has joined #openstack-kolla20:27
*** daneyon has quit IRC20:32
*** ccesario___ has joined #openstack-kolla20:46
*** SiRiuS__ has quit IRC21:12
*** salv-orlando has joined #openstack-kolla21:30
*** salv-orlando has quit IRC21:33
*** ccesario___ has quit IRC21:40
*** ccesario___ has joined #openstack-kolla21:40
*** SiRiuS__ has joined #openstack-kolla21:59
*** salv-orlando has joined #openstack-kolla22:06
*** ccesario___ has quit IRC22:42
*** ccesario___ has joined #openstack-kolla22:49
*** sacharya has quit IRC22:54
*** sacharya has joined #openstack-kolla22:55
*** ccesario___ has quit IRC23:00
*** sacharya has quit IRC23:00
*** SiRiuS__ has quit IRC23:04
*** ccesario___ has joined #openstack-kolla23:12
*** ravig has quit IRC23:15
*** ravig has joined #openstack-kolla23:16
*** sacharya has joined #openstack-kolla23:32
*** sacharya has quit IRC23:37
*** fragatina has quit IRC23:44
*** salv-orlando has quit IRC23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!