Friday, 2016-01-15

*** hoangcx has joined #openstack-ha00:50
*** cknight1 has joined #openstack-ha01:28
*** cknight has quit IRC01:30
*** hoangcx has quit IRC01:32
*** cknight1 has quit IRC02:18
*** sigmavirus24_awa is now known as sigmavirus2402:40
*** sigmavirus24 is now known as sigmavirus24_awa02:49
*** sigmavirus24_awa is now known as sigmavirus2403:09
*** smoriya_ has quit IRC03:23
*** smoriya_ has joined #openstack-ha03:28
*** cknight has joined #openstack-ha03:47
*** sigmavirus24 is now known as sigmavirus24_awa04:35
*** hoangcx has joined #openstack-ha04:35
*** cknight has quit IRC04:38
*** mjura has joined #openstack-ha07:06
*** mobaer has joined #openstack-ha07:07
*** dgurtner has joined #openstack-ha08:20
*** dgurtner has joined #openstack-ha08:20
*** dgurtner has quit IRC08:29
*** dgurtner has joined #openstack-ha08:29
*** dgurtner has joined #openstack-ha08:29
*** hoangcx has quit IRC09:51
openstackgerritBogdan Dobrelya proposed openstack/ha-guide: Updates to Galera Cluster documentation in HA Guide.  https://review.openstack.org/26307510:03
openstackgerritBogdan Dobrelya proposed openstack/ha-guide: Updates to Galera Cluster documentation in HA Guide.  https://review.openstack.org/26307510:11
openstackgerritMaria Zlatkova proposed openstack/ha-guide: Updates to Galera Cluster documentation in HA Guide.  https://review.openstack.org/26307510:29
*** ntt has joined #openstack-ha10:33
nttHi, I'm trying to use openstack-cinder-volume in an active/passive configuration with icehouse. Is this possible? Actually I have a san (active/passive) and I want to install only openstack-cinder-volume on the san10:34
nttAt the moment I have an error: "ERROR: Cinder Volume is not connected to the AMQP server: 1"10:34
nttsomeone can help me please?10:34
*** mobaer has quit IRC10:36
*** smoriya_ has quit IRC10:39
nttdulek: I think I found the problem, but I need help to solve10:50
nttactually the resource does: su cinder -s /bin/sh -c "cinder-volume --config-file=/etc/cinder/cinder.conf" > /var/run/resource-agents/default.pid10:51
nttbut the problem is that /var/run/resource-agents/default.pid is empty (because I'm using rhel7, I think)10:52
dulekntt: I'm not an expert in OpenStack OCF agents, but maybe _gryf, ddeja or bogdando will be able to help you?10:53
*** mobaer has joined #openstack-ha10:53
*** jpena has joined #openstack-ha10:55
_gryfntt, the error message suggest the possible culprit. did you try just to run the command that resource is trying to start (so the `su cinder -s /bin/sh -c "cinder-volume --config-file=/etc/cinder/cinder.conf"') to see what happen?10:58
nttdulek:ok. More details: pid file is not empty, but has the wrong pid. example: when I launch cinder-volume, I have 2 processes (31977 and 31988). In /var/run/resource-agents/default.pid I have 31977 but the ampq is connected with the pid 31988 and the check fails in cinder_volume_monitor routine in the RA.11:00
nttcinder_volume_monitor does: netstat -punt | grep -s "$OCF_RESKEY_amqp_server_port"  and the pid is 3198811:01
ntt_gryf: the process works well if I try to launch from bash11:02
bogdandontt, dulek hm, I never tried the OCF for a cinder volume. Would be nice to have a quick set-up with vagrant for each OCF RA11:02
bogdandolike I did for the rabbit ocf11:02
bogdandoI use this repo https://github.com/bogdando/packer-atlas-example/blob/master/Vagrantfile to spawn a fast n1 n2 cluster with OCF RA running11:03
bogdandoI believe it can be easily modified to run any OCF RA one want to test/check/reproduce an issue11:04
bogdandoand here I put post-up configs for OCF RA related things https://github.com/bogdando/packer-atlas-example/tree/master/vagrant_script11:05
bogdandoso feel free to open a bug and provide details on how to reproduce, and put logs if any :)11:07
nttactually the only thing I did is:11:09
ntt#volume_amqp_check=`netstat -punt | grep -s "$OCF_RESKEY_amqp_server_port" | grep -s "$pid" | grep -qs "ESTABLISHED"`11:09
nttmodified to volume_amqp_check=`netstat -punt | grep -s "$OCF_RESKEY_amqp_server_port" | grep -qs "ESTABLISHED"`11:09
nttbut this is really ugly fix11:09
nttnow it "works"11:09
bogdandowell, there is 100% a bug with pid tracking, so you may want to open it as well11:12
bogdandohttps://bugs.launchpad.net/openstack-resource-agents11:13
aspiersyes please file a bug!11:21
aspiersntt: sounds like the OCF RA is failing to account for a cinder-volume subthread or child process being spawned?11:23
aspiersntt: what is the difference between 31977 and 31988?11:23
ntt31988 is child of 3197711:23
aspiersyes usre11:23
aspierssure11:23
nttnothing else11:23
aspiersbut what is that process?11:23
aspierswhat is the command line?11:23
aspiersif it's the same command/args as 31977 then it's a subthread11:24
ntt/usr/bin/python /usr/bin/cinder-volume --config-file /usr/share/cinder/cinder-dist.conf --config-file /etc/cinder/cinder.conf --logfile /var/log/cinder/volume.log11:24
nttno diffs11:24
aspiersok11:24
nttbut with netstat I can see that the port 5672 is used by 31988 and not by 3197711:24
aspiersso the correct way would be to examine the process tree I guess11:25
aspierse.g. pstree -p11:25
nttaspiers: my approach is completely wrong.12:16
aspiersright, I was suggesting a possible right approach :)12:16
ntt/etc/cinder/volumes should be shared from all nodes in the cluster. I known that this is unrelated to the pid rpboelm12:16
nttproblem*12:17
nttaspiers: you are welcome12:17
openstackgerritMerged openstack/ha-guide: Updates to Galera Cluster documentation in HA Guide.  https://review.openstack.org/26307512:19
nttI think that volumes_dir should be shared by the san nodes12:19
nttI can create an LV inside the cinder-volumes VG of small size and mount that LV before start cinder-volume12:19
nttI don't known if this is a good idea12:19
nttIn this way I should have high available volumes.... even though openstack-cinder-volume is not: adding "include $volumes_dir" in /etc/tgt/targets.conf on both nodes of the san, I should have targets automagically created in case of failover :)12:23
openstackgerritOpenStack Proposal Bot proposed openstack/ha-guide: Updated from openstack-manuals  https://review.openstack.org/26810712:30
openstackgerritMerged openstack/ha-guide: Updated from openstack-manuals  https://review.openstack.org/26810712:39
*** openstackgerrit has quit IRC12:50
*** openstackgerrit has joined #openstack-ha12:51
*** jpena has quit IRC13:49
*** dslev has joined #openstack-ha13:53
*** cknight has joined #openstack-ha14:27
*** kgaillot has joined #openstack-ha14:49
*** sigmavirus24_awa is now known as sigmavirus2415:24
*** dslev has quit IRC16:20
*** jpena has joined #openstack-ha17:16
*** dgurtner has quit IRC17:17
*** sigmavirus24 is now known as sigmavirus24_awa17:46
*** cknight has quit IRC17:53
*** sigmavirus24_awa is now known as sigmavirus2417:57
*** cknight has joined #openstack-ha17:57
*** dgurtner has joined #openstack-ha18:11
*** dgurtner has joined #openstack-ha18:11
*** cknight has quit IRC18:31
*** dslev has joined #openstack-ha18:34
*** cknight has joined #openstack-ha18:35
*** mobaer has quit IRC18:58
*** mobaer has joined #openstack-ha19:04
*** dgurtner has quit IRC19:05
*** hoonetorg has quit IRC19:06
*** hoonetorg has joined #openstack-ha19:19
*** dslev has quit IRC20:24
*** cknight has quit IRC21:40
*** jpena is now known as jpena|sleep22:26
*** sigmavirus24 is now known as sigmavirus24_awa22:50
*** mobaer has quit IRC22:53
*** mobaer1 has joined #openstack-ha22:53
openstackgerritKATO Tomoyuki proposed openstack/ha-guide: Indicate the rationale for running cinder in active-passive mode  https://review.openstack.org/26620023:30
openstackgerritKATO Tomoyuki proposed openstack/ha-guide: Indicate the rationale for running cinder in active-passive mode  https://review.openstack.org/26620023:31
openstackgerritKATO Tomoyuki proposed openstack/ha-guide: Document why RabbitMQ should not be used via HAProxy  https://review.openstack.org/26620223:31
openstackgerritKATO Tomoyuki proposed openstack/ha-guide: Details for configuring cinder on RHEL based systems  https://review.openstack.org/26620123:34
openstackgerritKATO Tomoyuki proposed openstack/ha-guide: Details for configuring cinder on RHEL based systems  https://review.openstack.org/26620123:37
*** kgaillot has quit IRC23:40

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!