Friday, 2016-04-01

*** salv-orlando has joined #openstack-kolla00:00
*** unicell has joined #openstack-kolla00:00
*** unicell has quit IRC00:01
*** salv-orlando has quit IRC00:06
*** jasonsb has joined #openstack-kolla00:08
*** ayoung has joined #openstack-kolla00:11
*** jasonsb has quit IRC00:12
*** vhosakot has joined #openstack-kolla00:13
*** diogogmt has quit IRC00:14
ccesario_vhosakot: did you see?00:14
vhosakotccesario_: yep, cloud #1 does not have vrrp_instance external ?00:15
ccesario_vhosakot: no ... it is only to tests .... the external interface from cloud2 it is fake ... only to check the patch :)00:16
ccesario_my env only have internal address00:16
*** weiyu has joined #openstack-kolla00:17
vhosakotccesario_: do you have   kolla_external_vip_address: "{{ kolla_internal_vip_address }}"    in    globals.yml ?00:20
ccesario_vhosakot: yep00:21
vhosakotccesario_: are you using the same globals.yml for both clouds ?00:21
ccesario_no00:21
vhosakotccesario_: are you using the same deploy node for both clouds ?00:22
ccesario_vhosakot: yes :D00:22
ccesario_due it... these changes it was needed00:23
ccesario_vhosakot: cloud2: http://sprunge.us/YPWF00:23
ccesario_vhosakot: cloud1: http://sprunge.us/gDgR00:23
ccesario_vhosakot: rhallisey is aware about the tests00:25
vhosakotccesario_: they look different... I thoguth you use the same globals.yml file both clouds00:25
*** gmmaha has quit IRC00:25
ccesario_vhosakot: are different ... two clouds ... two globals00:26
ccesario_:)00:26
vhosakotccesario_: so, do you have /etc/kolla/globals1.yml  and  /etc/kolla/globals2.yml  ?00:27
ccesario_no man....00:27
*** gmmaha has joined #openstack-kolla00:27
vhosakotccesario_: how and where the two globals saved ?00:27
ccesario_vhosakot: I have two config dirs00:28
ccesario_I have /etc/kolla_deploy/cloud1  and /etc/kolla_deploy/cloud200:28
ccesario_each one with specific configs00:28
ccesario_:D00:28
vhosakotccesario_: ah00:29
*** unicell has joined #openstack-kolla00:29
ccesario_the same from /etc/kolla ...00:29
ccesario_but I'm not usig /etc/kolla00:29
vhosakot  /etc/kolla_deploy/cloud1/globals.yml    and    /etc/kolla_deploy/cloud2/globals.yml    ?00:29
ccesario_vhosakot: nice... no!?00:29
ccesario_yes yes00:29
gmmahavhosakot: do you still want me to test my patch against tip of master?00:30
gmmahai think i am not too far away from it00:30
vhosakotyes, could you test it with latest master anf update comments in review00:30
gmmahavhosakot: sure00:31
vhosakotthanks!00:31
ccesario_vhosakot: http://pastebin.com/C9ne8QnR to you undesrtand better....00:32
ccesario_vhosakot: https://blueprints.launchpad.net/kolla/+spec/multiple-clouds   due it for while these changes are welcome :)00:32
vhosakotcool00:33
sbezverkvhosakot thank you for review, sdake mentioned these two points verbally when he helped me to split the main PS00:34
ccesario_vhosakot: now, are you agree with these changes ?00:34
vhosakotsbezverk: cool.. yes, it looks good, and easy to review as well.. great!00:34
vhosakotccesario_: I am still thinking :)00:34
*** weiyu has quit IRC00:35
ccesario_vhosakot: eheheh, sure :)00:36
vhosakotccesario_: did you change this   ?    https://github.com/openstack/kolla/blob/master/ansible/group_vars/all.yml#L1100:37
*** weiyu has joined #openstack-kolla00:39
ccesario_vhosakot: no... I did not touch in 'core' code ..... except the changes in ps00:40
ccesario_do you know how I deploy it ?00:40
ccesario_the commands set!?00:41
*** weiyu has quit IRC00:42
*** weiyu has joined #openstack-kolla00:44
*** jasonsb has joined #openstack-kolla00:45
*** jasonsb has quit IRC00:47
*** jasonsb has joined #openstack-kolla00:47
*** jasonsb has quit IRC00:48
*** weiyu has quit IRC00:48
*** diogogmt has joined #openstack-kolla00:49
*** weiyu has joined #openstack-kolla00:50
*** banix has joined #openstack-kolla00:58
*** weiyu has quit IRC00:59
*** Jeffrey4l has joined #openstack-kolla01:00
*** vhosakot has quit IRC01:05
*** jasonsb has joined #openstack-kolla01:05
*** jasonsb has quit IRC01:10
*** jasonsb has joined #openstack-kolla01:11
*** banix has quit IRC01:14
*** Jeffrey4l has quit IRC01:17
openstackgerritCarlos Cesario proposed openstack/kolla: Make keepalived virtual_router_id param configurable  https://review.openstack.org/30014301:24
*** weiyu has joined #openstack-kolla01:34
*** banix has joined #openstack-kolla01:37
*** unicell has quit IRC02:10
*** achanda has joined #openstack-kolla02:14
*** weiyu has quit IRC02:26
*** jasonsb has quit IRC02:30
*** weiyu_ has joined #openstack-kolla02:32
*** rhallisey has quit IRC02:35
*** alisonh has quit IRC02:41
*** banix has quit IRC02:45
*** allen_ga- is now known as allen_gao02:46
*** diogogmt has quit IRC02:49
*** diogogmt has joined #openstack-kolla02:50
*** yuanying has quit IRC02:51
*** alisonh has joined #openstack-kolla03:00
*** banix has joined #openstack-kolla03:01
*** alisonh has left #openstack-kolla03:01
openstackgerritSerguei Bezverkhi proposed openstack/kolla: Add  iscsid/tgtd specific parameters to Kolla infrastructure  https://review.openstack.org/30000403:03
*** jasonsb has joined #openstack-kolla03:13
*** ccesario_ has quit IRC03:15
*** weiyu_ has quit IRC03:21
*** banix_ has joined #openstack-kolla03:23
*** banix_ has quit IRC03:23
*** banix has quit IRC03:25
*** diogogmt has quit IRC03:25
*** banix has joined #openstack-kolla03:28
*** banix has quit IRC03:30
*** weiyu_ has joined #openstack-kolla03:34
*** vhosakot_ has joined #openstack-kolla03:44
*** weiyu_ has quit IRC03:48
*** yuanying has joined #openstack-kolla03:49
*** weiyu_ has joined #openstack-kolla03:54
*** achanda has quit IRC04:04
*** achanda has joined #openstack-kolla04:08
*** achanda has quit IRC04:13
*** sajauddin has joined #openstack-kolla04:24
*** sdake has joined #openstack-kolla04:29
sdakevhosakot_ around?04:29
vhosakot_hey sdake04:29
sdakehey availalable for our phone calll?04:30
*** coolsvap has joined #openstack-kolla04:33
*** weiyu_ has quit IRC04:36
*** weiyu has joined #openstack-kolla04:39
*** weiyu has quit IRC04:49
*** 7GHAANRX4 has joined #openstack-kolla04:49
*** achanda has joined #openstack-kolla05:02
*** daneyon has quit IRC05:10
*** achanda has quit IRC05:10
*** 7GHAANRX4 has quit IRC05:13
*** tpeoples is now known as tpeoples_vacatio05:23
*** tpeoples_vacatio is now known as tpeoplesvacation05:24
*** sdake_ has joined #openstack-kolla05:30
*** sdake_ has quit IRC05:31
*** sdake has quit IRC05:32
*** tfukushima has joined #openstack-kolla05:49
openstackgerritMerged openstack/kolla: Make heka collect libvirtd.log in nova_libvirt container  https://review.openstack.org/29601205:56
openstackgerritMichal Rostecki proposed openstack/kolla: Fix IP resolve check for RabbitMQ on AIO  https://review.openstack.org/30015205:57
*** weiyu_ has joined #openstack-kolla05:58
*** coolsvap has quit IRC06:00
*** coolsvap has joined #openstack-kolla06:01
*** weiyu_ has quit IRC06:03
*** SiRiuS_ has joined #openstack-kolla06:05
*** Marga_ has quit IRC06:06
*** weiyu_ has joined #openstack-kolla06:08
*** mikelk has joined #openstack-kolla06:13
*** Marga_ has joined #openstack-kolla06:25
*** Marga_ has quit IRC06:29
*** mikelk has quit IRC06:29
*** mandre has joined #openstack-kolla06:30
*** achanda has joined #openstack-kolla06:30
*** sdake has joined #openstack-kolla06:36
*** Marga_ has joined #openstack-kolla06:38
openstackgerritMerged openstack/kolla: Upgrade elasticsearch  https://review.openstack.org/29796906:40
*** Marga_ has quit IRC06:43
*** salv-orlando has joined #openstack-kolla07:05
openstackgerritMerged openstack/kolla: Add optional services option in globals.yml  https://review.openstack.org/29915007:10
openstackgerritMerged openstack/kolla: Adds genisoimage package dependency to nova-compute  https://review.openstack.org/29763707:11
*** mgoddard has joined #openstack-kolla07:14
*** Serlex has joined #openstack-kolla07:15
*** salv-orl_ has joined #openstack-kolla07:23
openstackgerritMerged openstack/kolla: Restrict the rabbitmq only start on rabbitmq group  https://review.openstack.org/29926607:23
*** salv-orlando has quit IRC07:26
*** coolsvap has quit IRC07:28
*** vhosakot_ has quit IRC07:37
*** coolsvap has joined #openstack-kolla07:37
*** jmccarthy1 has joined #openstack-kolla07:39
*** jmccarthy1 has left #openstack-kolla07:39
*** gfidente has joined #openstack-kolla08:03
*** gfidente has quit IRC08:03
*** gfidente has joined #openstack-kolla08:03
*** mikelk has joined #openstack-kolla08:08
*** mbound has quit IRC08:12
*** achanda has quit IRC08:22
*** achanda has joined #openstack-kolla08:25
*** iceyao has joined #openstack-kolla08:26
*** iceyao has left #openstack-kolla08:27
*** coolsvap has quit IRC08:29
*** achanda has quit IRC08:32
*** dwalsh has joined #openstack-kolla08:38
*** achanda has joined #openstack-kolla08:38
*** pbourke has quit IRC08:44
*** pbourke has joined #openstack-kolla08:44
*** mbound has joined #openstack-kolla08:45
*** achanda has quit IRC08:57
*** weiyu_ has quit IRC09:01
*** dwalsh has quit IRC09:03
openstackgerritMerged openstack/kolla: Fix the Ceph reconfigure  https://review.openstack.org/29926509:08
*** shardy has joined #openstack-kolla09:10
*** kbyrne has joined #openstack-kolla09:11
openstackgerritMerged openstack/kolla: Remove bootstrap_mariadb with cleanup-containers  https://review.openstack.org/29941709:12
openstackgerritMerged openstack/kolla: Increase database connections to 10000  https://review.openstack.org/29979109:12
*** sdake has quit IRC09:13
*** coolsvap has joined #openstack-kolla09:14
*** mdnadeem has joined #openstack-kolla09:19
*** mdnadeem_ has quit IRC09:21
sajauddinTrying to deploy openstack using kolla. While running kolla-ansible deploy, mysql service is not starting in mariadb container09:26
sajauddindid any one came across this issue?09:27
sajauddinError : failed: [kolla-os] => {"attempts": 6, "changed": false, "cmd": ["docker", "exec", "mariadb", "ls", "/var/lib/mysql/mariadb.pid"], "delta": "0:00:00.126951", "end": "2016-03-31 07:49:03.042896", "failed": true, "rc": 1, "start": "2016-03-31 07:49:02.915945", "stdout_lines": [], "warnings": []} stderr: Error response from daemon: Container mariadb is restarting, wait until the container is running msg: Task failed09:28
sajauddinmysql@52f78f2fda7a:/# service mysql start  * Starting MariaDB database server mysqld                                                             [fail] mysql@52f78f2fda7a:/#09:29
sajauddinthis is what I got in container09:29
sajauddinany pointers on this?09:43
openstackgerritMerged openstack/kolla: Starting heka bootstrap container failed in deployment  https://review.openstack.org/29933409:51
openstackgerritMerged openstack/kolla: Fix the wrong refer self in kolla_docker.py  https://review.openstack.org/29913109:52
*** achanda has joined #openstack-kolla09:58
*** achanda has quit IRC10:02
*** allen_gao has quit IRC10:05
*** allen_gao has joined #openstack-kolla10:10
*** rhallisey has joined #openstack-kolla10:35
*** iceyao has joined #openstack-kolla10:41
*** iceyao has quit IRC11:06
*** Marga_ has joined #openstack-kolla11:07
*** Marga_ has quit IRC11:11
*** reddy has joined #openstack-kolla11:12
*** iceyao has joined #openstack-kolla11:17
*** achanda has joined #openstack-kolla11:30
*** achanda has quit IRC11:35
*** jtriley has joined #openstack-kolla11:36
openstackgerritRyan Hallisey proposed openstack/kolla: Add remove apparmor reminder to the quickstart  https://review.openstack.org/30018411:40
pbourkesajauddin: try 'docker logs mariadb'11:51
*** jtriley has quit IRC11:53
reddyi want to run my own dhcp server on top of openstack. how i can achieve it. when i do it . my instances are not able to receive  any IP from new server11:55
*** banix has joined #openstack-kolla12:06
*** SiRiuS_ has quit IRC12:08
*** SiRiuS has joined #openstack-kolla12:09
*** tfukushima has quit IRC12:24
*** wuhg has quit IRC12:29
ccesariomorning!12:29
*** mlima has joined #openstack-kolla12:31
*** dave-mccowan has joined #openstack-kolla12:32
*** achanda has joined #openstack-kolla12:32
*** mlima_ has quit IRC12:34
*** achanda has quit IRC12:37
*** banix has quit IRC12:38
*** jtriley has joined #openstack-kolla12:48
*** dims_ has quit IRC12:49
*** dims has joined #openstack-kolla12:49
*** sajauddin has quit IRC12:52
g3ekhello is group[ 'all'] supposed to exist in kolla ? When i do that i cant use hostvars[host]['ansible_hostname'] because host dont exist (I think)12:54
*** rhallisey has quit IRC13:05
*** mbound has quit IRC13:08
*** mbound has joined #openstack-kolla13:08
*** stvnoyes has joined #openstack-kolla13:20
*** salv-orlando has joined #openstack-kolla13:23
*** tfukushima has joined #openstack-kolla13:25
*** salv-orl_ has quit IRC13:26
*** dims_ has joined #openstack-kolla13:27
openstackgerritMerged openstack/kolla: Add kibana authentication using HAproxy  https://review.openstack.org/29764913:28
*** coolsvap has quit IRC13:31
*** tfukushima has quit IRC13:31
ccesariogmmaha, ping ?13:32
*** iceyao has quit IRC13:32
*** openstackgerrit has quit IRC13:33
*** openstackgerrit has joined #openstack-kolla13:33
*** achanda has joined #openstack-kolla13:34
*** inc0 has joined #openstack-kolla13:35
*** jtriley has quit IRC13:35
inc0good morning13:35
*** salv-orlando has quit IRC13:35
*** achanda has quit IRC13:39
*** diogogmt has joined #openstack-kolla13:40
*** huikang has joined #openstack-kolla13:40
*** diogogmt has quit IRC13:46
*** Liuqing has joined #openstack-kolla13:48
*** openstack has quit IRC13:58
*** openstack has joined #openstack-kolla13:59
sbezverkinc0 if I remember right you showed some interest in lvm support for cinder, can I bother you for a review ;-) ?14:01
*** kproskurin has joined #openstack-kolla14:02
inc0sbezverk, sure, what is status of it14:02
inc0?14:02
inc0any prospect of getting this to work?14:02
sbezverkinc0 it is working, I just need to get it reviewed and that is it :-)14:03
inc0cool14:03
inc0link plz, I wonder what you did to iscsi14:03
sbezverkinc0 there are 3 PS implementing this feature, here is the link for the first one: https://review.openstack.org/#/c/291285/5214:04
patchbotsbezverk: patch 291285 - kolla - Adds iscsid and tgtd docker containers14:04
sbezverkinc0 you will see 2 other PS connected to this one..14:04
*** SiRiuS has quit IRC14:06
*** sdake has joined #openstack-kolla14:06
*** rhallisey has joined #openstack-kolla14:06
*** weiyu has quit IRC14:07
*** banix has joined #openstack-kolla14:07
*** iceyao has joined #openstack-kolla14:09
openstackgerritHui Kang proposed openstack/kolla: Add etcd Docker container  https://review.openstack.org/29845114:15
inc0sbezverk, why create different role for iscsi?14:18
inc0not make it part of role cinder?14:18
*** iceyao has quit IRC14:18
*** tfukushima has joined #openstack-kolla14:18
sbezverkinc0 there are two parts, one for cinder but there is more nova_compute14:19
inc0so what you can do is what we did with ceph14:19
sbezverkso it made more sense to treat it as independednt service iscsi14:19
g3ekIs group[ 'all'] supposed to exist in kolla ? When i do that i cant use hostvars[host]['ansible_hostname'] because the host dont exist. I have this http://pastebin.com/c48R1viJ14:19
inc0it's ok to have iscsi stuff in nova with when enable_iscsi14:19
inc0nova alone won't make use of it14:19
inc0g3ek, comic sans? really? ;)14:20
inc0also make sure all of your hosts have hostname14:20
ccesariosdake, about this https://review.openstack.org/#/c/299803/ I have tested it too.... and the deploy it works, but the neutron endpoints was not created.  Only to keep you notified :)14:21
patchbotccesario: patch 299803 - kolla - Workaround ansible bug related to delegate_to14:21
inc0and all of rabbitmq hosts can resolve eacho others hostname and it resolves to api_interface14:21
sbezverkinc0 I mean it can be redone if the community feels very strong about it..14:21
sdakemorning14:22
sbezverkinc0 about your second comment, there was an agreement since ansible not yet provides that conditional volume magic, we will leave it as is and then when this feature is avaialble, there will be a patch to fix.14:22
inc0well, so imho role should be used if it's standalone service which makes sense to be standalone14:22
openstackgerritHui Kang proposed openstack/kolla: Add etcd Docker container  https://review.openstack.org/29845114:23
inc0so what you can do14:23
inc0(not sure if it works)14:23
inc0is to make a task set: and prep variable14:23
inc0list varialbe with all the mounts14:24
inc0and use ansible/jinja magics to prep this list14:24
inc0and then use it as volume14:24
inc0problem with your current code is that it won't work14:24
inc0enable_iscsi: false and you're screwed14:24
g3ekinc0: Already have ab hostname everywhere : http://pastebin.com/T0wY0WxK14:24
sbezverkinc0 I tried that, I used example of task set from swift, it did not work :-(14:24
inc0yeah we need to get it to work14:25
sbezverkinc0 that volume does not cause any damage even if iscsi is disabled14:25
*** reddy has quit IRC14:25
inc0check if ansible 2 allows you to do this14:25
inc0well, it won't be created right?14:25
sdakemorning cans14:25
sbezverkgood morning sdake14:26
sbezverkinc0 the idea is iscsi-initiator tools gets installed anyway under all condition as it is a part of base14:27
inc0installed is one, but created volume is something more14:27
inc0having one idle binary is something I can cope with14:28
sbezverkinc0 so if iscsi info volume is created in all situations and in some situation is not used, it could be a good workaround current ansible limitation, no?14:28
inc0I don't think it's good idea14:28
inc0I'd rather refactor our kolla_docker14:29
inc0in a way it will allow conditional mounts somehow14:29
inc0let's think about if for a moment14:29
inc0also let's see if there is anything ansible can do14:29
inc0ansible 2.0 that is14:29
inc0because then we hold on with your patches and move to 2.0 early N14:29
*** SiRiuS has joined #openstack-kolla14:30
inc0which I want to do anyway14:30
sbezverkI chatted to SamYaple about it, and he told me that would require major redesign14:30
inc0ansbile 2.0?14:30
inc0it will, and we need to make it happen14:30
sbezverkhence I left it as is to get work going ahead..14:30
inc01.9 is buggy14:30
inc0and it won't be fixed14:30
inc0and since it's already work for Newton, iscsi14:31
inc0we may as well get it work properly and skip the workarounds14:31
inc0but hold on14:31
inc0let me think some more about how to do it14:31
sbezverkinc0 appreciate that, I am no ansible expert, I am still learing it..14:32
inc0I have a feeling this should be doable;)14:32
inc0yeah, me too, but I already did few more or less magical things with it14:32
inc0give me a few, once I'll try to sit over it today14:33
*** jeblair_ is now known as jeblair14:33
sbezverkinc0 sure, just one note about your 1st comment14:35
sbezverkinc0 would it not be more flexible to created too when iscsi is enabled?14:35
sbezverkinc0 if we check for ceph, but what about checking for other possible backends??14:36
sbezverkor scenario when different types of backend is enabled?14:37
inc0true14:37
inc0let's do this14:37
inc0btw people, any votes on my backport proposal14:39
inc0?14:39
inc0do? don't do? cry a lot?14:39
*** Liuqing has quit IRC14:47
*** Liuqing has joined #openstack-kolla14:48
*** iceyao has joined #openstack-kolla14:51
g3ekHey guys, Our entreprise Ormuco have create a working mongodb cluster and we are working on the ceilometer service. We should push the whole thing next week.14:53
*** Marga_ has joined #openstack-kolla14:55
inc0g3ek, well..thank you...I guess;) remember that ceilometer will require dedicated host14:56
inc0or rather mongodb14:56
*** Marga_ has quit IRC14:57
*** vhosakot has joined #openstack-kolla14:58
*** Marga_ has joined #openstack-kolla14:58
*** Marga_ has quit IRC14:59
*** Marga_ has joined #openstack-kolla15:00
g3ekinc0: when you say dedicated host, you mean to create a group ceilometer and include all children?15:00
inc0yeah15:01
inc0also make sure there is group for mongo15:01
g3ekinc0: good, we already did that ;)15:01
g3ekok we will15:01
inc0mangodb wouldn't require dedicated server tho15:01
inc0but mango has better performance all the way15:02
*** kproskurin has quit IRC15:04
*** Liuqing has quit IRC15:07
*** Liuqing has joined #openstack-kolla15:09
*** Liuqing has quit IRC15:12
openstackgerritSerguei Bezverkhi proposed openstack/kolla: Add  iscsid/tgtd specific parameters to Kolla infrastructure  https://review.openstack.org/30000415:23
*** vhosakot has quit IRC15:28
*** jtriley has joined #openstack-kolla15:32
*** vhosakot has joined #openstack-kolla15:34
*** haplo37 has joined #openstack-kolla15:35
mlimato add a new backend i need create a role for it?15:36
*** achanda has joined #openstack-kolla15:37
*** jtriley has quit IRC15:37
*** daneyon has joined #openstack-kolla15:40
*** vhosakot has quit IRC15:40
*** mikelk has quit IRC15:41
*** achanda has quit IRC15:42
*** iceyao has quit IRC15:43
inc0sdake, around?15:46
*** vhosakot has joined #openstack-kolla15:49
*** stvnoyes has left #openstack-kolla15:54
*** banix has quit IRC15:56
sdakeinc0 shoot15:57
*** haplo37 has quit IRC15:58
inc0so what about backport? should I change my patchset to deploy only liberty?15:58
inc0and then after mitaka is tagged we will copy this branch and tag is as liberty?15:59
*** haplo37 has joined #openstack-kolla15:59
inc0also, should I base it on master?15:59
inc0(that one is easy as I can always rebase to whatever was mitaka stable tag)15:59
sdakewe shuld base on stable/mitaka16:00
gmmahaccesario: good morning16:00
gmmahasdake: good morning16:00
inc0gmmaha, did you get this bug done?16:00
gmmahainc0: yeah.. there is workaround that seems to work conssitently16:00
gmmahahttps://review.openstack.org/#/c/299803/16:00
patchbotgmmaha: patch 299803 - kolla - Workaround ansible bug related to delegate_to16:00
sdakewe can copy your patset to the liberty branch after we copy stable/mitaka to liberty16:01
sdakeI'd recommend copying stable/mitaka to stable/liberty after 2.0.0 tags (soemtiem prior to april 15th)16:01
sdakeso that gives us 2 weeks to finis hthe backport before summit16:02
inc0I should be done pretty soon16:02
sdakebtw, tagging tonight16:02
inc0but I need testing testing16:02
sdakerc316:02
inc0cool16:02
inc0gmmaha, pretty neat16:02
sdakethen we are in 2.0.0 territory16:02
sdakegmmaha morning16:02
gmmahasdake: the latest patch seems to work fine over 3 cleans-ups and installs16:03
gmmahainc0: sdake's idea.. :)16:03
inc0also, did you check if it works with ips in inventory?16:03
sdakegmmaha i have a question, does a redeploy wipe out  the databasee16:03
sdakein othe rwords, is it idempotent16:04
inc0it does not it should not16:04
sdakeinc0 does ip in inventory work?16:04
inc0ofc it does16:04
gmmahainc0: we used to deploy with IPs and it used to work for us..16:04
inc0kk16:04
sdakeinc0 what about the hostname tool used by mariadb?16:04
gmmahachanged it to machine names on sdake's suggestion.. but i am most certain it worked16:04
openstackgerritDave McCowan proposed openstack/kolla: When two interfaces are used for two VIPs, tie them together  https://review.openstack.org/29970416:04
inc0sdake, isn't mariadb ip based now?16:04
sdakeinc0 no clue16:05
gmmahasdake: hmm.. good Q.. unless we clean the containers there is no reason for the db to be gone16:05
inc0afaik only place we really need hostnames is rabbitmq16:05
sdakei knwo mariadb used to use the /bin/hostname tool16:05
sdakeand this caused problems for us16:05
sdakewehn tryign to use hostnames16:05
inc0gmmaha, more to that, if you remove containers (not by tool) but keep volumes, db should be there as well16:05
* gmmaha goes to call a redeploy on his setup16:05
sdakewhat would be cool is to deploy with ips and make sure it works in ha mode by log inspection16:05
sdakegmmaha make sure you have stuff in your db16:06
inc0sdake, I never used anything but ips in my inventory16:06
inc0ever16:06
sdakeok cool16:06
sdaketheni  guess ips work ;)16:06
sdakesorry aout that gmmaha16:06
inc0you might check centos16:06
sdakei thought only dns names worked16:06
inc0I work ubuntu16:06
gmmahasdake: :) no worries.. good to have a confirmation..16:06
inc0well....you do need these ips to be resolvable16:07
inc0from hostnames16:07
sdakemy contractor ninja showe dup this morningto finish the job on my office16:07
inc0for rabbitmq sake16:07
inc0but that is only for rabbitmq hosts16:07
*** ssurana has joined #openstack-kolla16:08
sdakethe good news is my office shuld be back in action april 15thish16:08
sdakeinc0 thanks thats the peice i was missing16:08
*** wznoinsk has joined #openstack-kolla16:08
inc0sdake, we have hard fail if it's not the case16:08
wznoinskhi all16:08
wznoinskwould someone know how OS_* variables are being passed to horizon container in kolla? can't find any *openrc file or them set in any of the container 'startup' kolla files16:08
inc0wznoinsk, hey Waldek;)16:08
sdakevhosakot aroun?16:09
wznoinskhi inc016:09
inc0wznoinsk, why do you need OS_... in horizon container?16:09
*** vhosakot has quit IRC16:09
inc0<- Michal Jastrzebski fyi wznoinsk16:09
sdakehey folks, my 24 hour emergency is still in effect16:10
sdakei shoud lbe done in 3-4 hours16:10
sdakethen i'll be back in action here16:10
wznoinskinc0, wiem ;-)16:10
inc0if you want to run CLI stuff, just run kolla-ansible post-deploy16:10
wznoinskinc0, maybe I'm misunderstanding then... I have my horizon, by the looks of things not aware of auth_url, http://paste.openstack.org/show/492749/16:11
inc0it will create admin.sh rc file16:11
inc0looks like misconfiguration, I think this should be in horizon conf file16:12
inc0sdake, you debugged horizon latel16:12
inc0y16:12
sdakeinc0 i have not16:14
inc0wznoinsk, looks like a bug tbh16:14
inc0mind submitting it?16:15
sdakehorizon restart looped for me16:15
sdakewhat is wznoinsk's eact problem16:15
wznoinskinc0, nope, will do16:15
wznoinsksdake, hi, can't do much when logged in to horizon web due the above error16:16
inc0to me it's missing config in horizon16:17
inc0but will debug16:17
ccesariogmmaha, hey... good morning (for me afternooon :) )16:17
sdaketeh fix to the error is to create a _member_ role16:17
wznoinskno auth_url set which according to the error (pastebin above) should be set by Httpclient but that should I guess be set by the horizon (server) itself?16:17
sdakewe are working on it16:17
sdakeopenstack role create _member_16:17
sdakefrom the cli16:17
gmmahaccesario: good afternoon16:17
ccesariogmmaha, , about this https://review.openstack.org/#/c/299803/ had you success ?!16:17
patchbotccesario: patch 299803 - kolla - Workaround ansible bug related to delegate_to16:17
gmmahaccesario: yes16:17
sdakewznoinsk oh that may be a different problem16:17
gmmahawith that the neutron job gets run in the right server and it all works fine16:18
sdakei dont like the lack of run_once16:18
gmmahai am now testing if a redeploy will try it again to create db16:18
sdakei asume run_once causes it to break?16:18
gmmahasdake: right.. run_once tries just the first machine in its list and gives up16:18
gmmahasdake: sorry crossing conversations..16:18
*** mbound has quit IRC16:19
sdakethat explains why run_once was used16:19
sdakerather delegate_to was used16:19
sdakegmmaha can you add that ot the bug log or commit log so people understand that16:19
sdakeI am wary of changing anything in the playbooks like this atm16:19
gmmahasdake: i thought i did.. let me check16:19
sdakebit clearly we need to do something16:19
sdakemaybe a reorder is the better option at this point16:20
sdakegmmaha could you do me a solid16:20
gmmahasdake: if redeploy works, then i think the current patch might do it16:20
ccesariogmmaha, did you check if neutron endpoints they were created ?!16:20
sdakecould you try the site.yaml thingbut change the ordering around of the inventory file16:20
sdakeso compute is not last16:20
sdaketry various orders16:21
ccesariogmmaha, in my tow deploys tests .... the deploy it works... but neutron endpoints it was missing16:21
sdakeit may be an ordered list afte rini parsing so it may not matter16:21
gmmahaccesario: ha! you are right16:22
gmmahathere is no neutron endpoint16:22
gmmahaso sorry.. should have checked that16:22
gmmahasdake: so you want me to leave the site.yml as is but move things around in the inventory file?16:22
*** salv-orlando has joined #openstack-kolla16:25
gmmahaccesario: can you please -1 the patch with this16:25
gmmahasdake: compute is not the last in the inventory list.. its storage..16:27
sdakegmmaha it may be a waste of item but i'm curiosu if neutron breaks in the same way16:27
sdakeby reordering inventory file16:28
gmmahasdake: hmm let me try.. but i am not sure if it will work..16:28
sdakewhere it wont be a waste of time is if it does demonstrate it changes bheavior by reorder of the ini file16:28
sdakedon't run with any changes tosite.yaml or other files16:28
gmmahasdake: right.. just re-ordering in ansible/inventory/multinode16:29
*** Marga_ has quit IRC16:30
ccesariogmmaha, thanks by confirm it16:30
*** openstackgerrit has quit IRC16:31
gmmahaccesario: :) you are kind!!16:31
*** pbourke has quit IRC16:32
sdakegate looks broken, and also ubuntu: http://logs.openstack.org/91/299791/1/check/gate-kolla-dsvm-build-ubuntu-source/ef81582/console.html#_2016-04-01_04_25_22_17116:35
gmmahasdake: same issue.. http://paste.openstack.org/show/492752/16:36
gmmahare-ordering in the ini didnt do much16:36
*** achanda has joined #openstack-kolla16:38
*** shardy has quit IRC16:42
*** openstackgerrit has joined #openstack-kolla16:45
*** achanda has quit IRC16:45
openstackgerritSerguei Bezverkhi proposed openstack/kolla: Add  iscsid/tgtd specific parameters to Kolla infrastructure  https://review.openstack.org/30000416:47
*** ssurana has quit IRC16:54
openstackgerritHui Kang proposed openstack/kolla: Implement ceilometer ansible role  https://review.openstack.org/30057416:55
*** Serlex has quit IRC16:57
gmmahaccesario: sdake: inc0: i think the re-ordering of site.yml seems to be the one working consistently16:59
inc0yeha17:00
inc0that I found out17:00
sdakemake it so17:00
inc0but your patch should do the job too as well righT?17:00
sdakeof reodrdering the inventoy file has no effect17:00
inc0well reorder will not break anytihing for sure17:00
sdakethere is no danger in reorderng site.yml17:00
inc0so let's just reorder site.yml and be done with it17:01
sdakeinc0 it would if reorder of inventory file changed thigns around17:01
gmmahainc0: it didnt.. for some reason like ccesario found out, the neutron endpoints are not getting created17:01
sdakeinc0 i'm in agreement assuming reorder of inventory file doesn't change bheavior17:01
*** Marga_ has joined #openstack-kolla17:02
openstackgerritSerguei Bezverkhi proposed openstack/kolla: Add  iscsid/tgtd specific parameters to Kolla infrastructure  https://review.openstack.org/30000417:04
sdakegmmaha did you try reorder o the inventoy file ?17:04
gmmahasdake: did..17:04
gmmahadoesnt work17:04
sdakewhta about with site.yml change17:04
sdakedoesi it break in a different  way17:04
gmmahasdake: not that i have seen..17:05
gmmahai can pull up a patch and we can test it out?17:05
gmmahaor i think someone had already put up a patch for the bug17:05
gmmahaaah they havent.. Just mentioned that re-ordering does it17:06
*** ssurana has joined #openstack-kolla17:07
*** jmccarthy has quit IRC17:09
*** jmccarthy has joined #openstack-kolla17:10
sdakegmmaha please do17:11
openstackgerritSerguei Bezverkhi proposed openstack/kolla: Add  iscsid/tgtd specific parameters to Kolla infrastructure  https://review.openstack.org/30000417:11
sdakeif that works lets call it a day with this bug17:11
sdakeif it works meaning reodering inventory file doesnt break things in a different way17:11
sdakethe rason i care is because peplle are autogenerating inventory files17:11
nihiliferinc0: can you look at this patch? https://review.openstack.org/#/c/300152/ you woked on rabbitmq-hostname stuff, so it needs your eyes ;)17:12
patchbotnihilifer: patch 300152 - kolla - Fix IP resolve check for RabbitMQ on AIO17:12
gmmahasdake: aah it seems to work now. let me update the patch with this change17:13
*** mgoddard has quit IRC17:14
sdakeut does it work if you reorder the inventory ile?17:14
sdakespecifically the 4 main sections control compute networ and storage17:14
*** Marga_ has quit IRC17:17
*** Marga_ has joined #openstack-kolla17:17
openstackgerritMerged openstack/kolla: Fix IP resolve check for RabbitMQ on AIO  https://review.openstack.org/30015217:19
openstackgerritGanesh Maharaj Mahalingam proposed openstack/kolla: Workaround ansible bug related to delegate_to  https://review.openstack.org/29980317:19
gmmahasdake: it doesnt.. i tried re-ordering to the fact that compute is last or network being ahead of it.. nothing makes a difference17:20
gmmahaccesario: when you get a chance, can you check if the new patch works fine in your setup as well..17:20
gmmahawould be good to have additional results17:20
sdakegmmaha fantastic then17:21
sdakepull the trigger on the review and i'll ack it17:21
gmmahasdake: the new patch is up17:23
*** unicell has joined #openstack-kolla17:23
ccesariogmmaha, sure... pls give a bit time for it17:29
gmmahaccesario: ohh for sure.. take your time..17:29
gmmahathanks for checking it out17:29
*** AndroUser2 has joined #openstack-kolla17:29
*** jtriley has joined #openstack-kolla17:32
*** salv-orlando has quit IRC17:36
*** jtriley has quit IRC17:38
*** rajathagasthya has joined #openstack-kolla17:42
*** salv-orlando has joined #openstack-kolla17:45
sbezverksdake yesterday you mentioned something about already exisiting capability to add custome version of some rpms. COuld you point me to the code dealing with it?18:04
*** jmccarthy has quit IRC18:05
*** rajathagasthya has quit IRC18:05
sbezverksdake I need to add latest qemu/kvm to the base image to support numa related things..18:06
sdakesbezverk ask rhallisey he iimplemnted it18:10
sdakethe rpms need to be in a repo18:10
sdakeyo ucan use coprs to build the repo18:11
sbezverksdake what about using yum localinstall to install all custom rpms from a specific folder?18:11
sdakethats not implemented18:12
sdakethe repo mechanism is how i wantstuff done18:12
sdakei want to get rid of our curl of binaries18:12
sdakeit causes  breakage all over the place during the gate18:12
*** nihilifer has quit IRC18:12
*** nihilifer has joined #openstack-kolla18:14
sbezverksdake ok, got it..18:14
*** nihilifer has quit IRC18:14
*** nihilifer has joined #openstack-kolla18:15
sbezverkrhallisey ping18:16
wznoinsksdake, it is likely a diff problem as it happens also after adding _member_ role: would that look alike your18:17
*** rajathagasthya has joined #openstack-kolla18:17
wznoinsksdake, https://bugs.launchpad.net/kolla/+bug/156503018:17
openstackLaunchpad bug 1565030 in kolla "Call to list enabled services failed in horizon.log" [Undecided,New]18:17
rhalliseysbezverk, hey18:17
ccesariogmmaha, it seems that work... http://paste.openstack.org/show/492762/18:18
gmmahaccesario: awesome.. thanks..18:19
gmmahasdake: now thats 3 deployements.. mine, manjeets and ccesario which works with this patch..18:20
gmmahai think its fair to say its not too riskty to take it in18:20
sdakewznoinsk looks to me like yu rusing the wrong keystone client18:20
ccesariogmmaha, http://paste.openstack.org/show/492763/18:21
sdakeAuthorization Failed: The resource could not be found. (HTTP 404) (Request-ID: req-84ac1793-a5d8-4d85-8b72-64343ea1a4fe)18:21
sdakedid you run kolla-deploy post-deploy18:21
sdakefollowed by source /etc/kolla/admin-openrc* ?18:21
sdakegmmaha ok wher eis patch i'll ack18:21
rhalliseysbezverk, https://github.com/openstack/kolla/blob/master/docker/base/Dockerfile.j2#L4118:21
sbezverkrhallisey could you please point me to the place where you implemented custom repos? I need to do a PoC with VM that requires numa and it cannot be done with version of qemu/kvm we have now..18:22
sbezverkrhallisey Super, thank you..18:22
rhalliseyno problem18:23
sbezverkrhallisey that cmd, is it defined somewhere right?18:23
sbezverkI just want to undersatnd expeced format18:24
sbezverkexpected18:24
gmmahasdake: https://review.openstack.org/#/c/29980318:25
gmmahasdake: i cna test re=deploy now with source18:26
rhalliseysbezverk, what you do is set rpm_setep18:27
rhalliseysetup18:28
gmmahaduh.. post-deploy..18:28
rhalliseyrpm_setup=my_repo18:28
rhalliseythe build command will take that an apply it18:28
rhalliseyrpm_setup can be a list also18:29
sbezverkrhallisey got it, thank you18:31
sdakerhallisey docs thre would be helfpul18:31
sdakegate appears broken18:31
sdakecan anyone confirm?18:31
rhalliseyya18:31
rhalliseysdake, re gate I don't know18:31
sdakehere is my gate recheck of master18:33
sdakehttps://review.openstack.org/#/c/286409/218:33
patchbotsdake: patch 286409 - kolla - DO NOT MERGE18:33
sdakecan someone watch after that and get back to me18:33
gmmahasdake: post-deploy and source admin-rc and network is still very much active..18:37
*** tfukushima has quit IRC18:39
rhalliseysbezverk, sorry missled you. Here: https://github.com/openstack/kolla/blob/master/kolla/common/config.py#L14218:40
rhalliseyadd a custom repo or and rpm to that18:40
*** jtriley has joined #openstack-kolla18:48
sdakerhallisey ssurely its a config option to buid.py18:49
sdakerather then changing around python files18:49
rhalliseyno this patch was preferred18:49
sdakegmmaha i can't approve your change because he gate is failign18:49
sdakewhy it is failing i dont know18:50
gmmahasdake: no worries.. gate failing is more important..18:50
sdakeso I =2'ed it but didn't workflow it18:50
gmmahaJust thought i will give you the data18:50
gmmahasdake: yeah saw that18:50
sdakegmmaha ya unfortunately i dont have time today to fix the gate18:50
sdakeif someone wants to fix the gate it would be appreciated18:50
rhalliseyI can add an option I though.  This satisfied what I needed to do, which was change delorean tags18:50
sdakerhallisey yes please do the blueprint is incompletely implemented18:51
sdakethis needs to be a feature in mitaka18:51
sdakei never tested your work18:51
sdakebut if you cant add a list of repos via build.py to build with then what we have is not correct18:52
rhalliseythere were 2 patch sets, this wasn't mine18:52
sdakeoh18:52
rhalliseymine was what you were talking about18:52
sdakei thought you did it sorry18:52
rhalliseyit's ok I technially went along with it18:52
*** jtriley has quit IRC18:53
sdakedid dave's blackhole patch merge18:54
sdakei see a multicloud bug in here too18:54
*** joliver has joined #openstack-kolla18:57
rhalliseysdake, ccesario has multicloud going yesterday18:59
sdakecool18:59
sdakebut that patch needs to merge after dave's18:59
sdakeplease review https://review.openstack.org/#/c/299704/318:59
patchbotsdake: patch 299704 - kolla - When two interfaces are used for two VIPs, tie the...18:59
rhalliseyok jeeze19:00
sdakeok jeeze?  ssomethign wrong?19:01
sdakei meant no insult rhallisey19:01
inc0sdake, rhallisey I need someone to write backport for centos-binary19:03
sdakeinc0 overloaded atm19:03
sdakei think everyone else19:03
inc0as it will require pinning to repo verions and I'm not super familiar with contos repos19:03
sdakeis as well19:03
inc0centos source should work19:04
sdakeif you can wit until mfter mitaka i can do the job19:04
inc0well, I'm going to prop a patch and let's go from there19:04
sdakewtb review of https://review.openstack.org/#/c/299704/319:05
patchbotsdake: patch 299704 - kolla - When two interfaces are used for two VIPs, tie the...19:05
sdakefwiw we have see this internally19:05
rhalliseysdake, oh no worrries19:06
rhalliseyI was talking about that blackhole bug19:06
sdakethanks rhallisey19:06
rhalliseythat was a type19:06
rhalliseytypo19:06
rhalliseys/ok/oh19:06
*** salv-orlando has quit IRC19:07
*** rajathagasthya has quit IRC19:09
ccesariorhallisey, the multicloud deploy it is working fine!!! I tested with 3 "clouds"19:09
rhalliseyneat19:09
sdakeccesario sweet19:10
sdakeccesario sorry to do tis to you but I think yo uwil have to rebase your patches on master19:10
sdakeonce dave's patch hits the repo19:10
openstackgerritMerged openstack/kolla: When two interfaces are used for two VIPs, tie them together  https://review.openstack.org/29970419:11
*** mbound has joined #openstack-kolla19:11
sdake^^ thts the one19:11
openstackgerritMerged openstack/kolla: Update swift name  https://review.openstack.org/29973619:12
ccesariosdake, hmmm ....  could you give me the correct directions for this ? I don't have a lot knowledge with git :)19:13
sdakegit pull --rebase19:15
sdakegmmaha ping re your last email to me19:15
sdakegmmaha also please feel free to email openstack-dev with tag [kolla] so the entier community can benefit from the info19:15
ccesarioon my branch devel ? and after that ammend  and review!?19:16
sdakeif you onl yahve one patch yo ucan ust git pull --rebase19:16
sdakefix the merge conflcits19:16
sdakegit add the conflciting  files19:16
sdakeand git commit -a --amend19:16
ccesariook, let me try19:17
sdakeif git pull --rebase returnss no errors, in 99% of cases the rebase worked properly19:17
sdakerebase isn't perfect, because it relies on patch which lacks enough context in some rarae cases19:17
sdakeso use git show -1 to inspect your patch for correctness19:17
sdakegiht want to test it a second time19:17
sdakerebases suck19:18
sdakebut if we have o revert either of those patches i'd rather revert in the order of yours first then daves19:18
sdakerather then visa versa19:18
sdakebecause black hole is a bug multicloud is more of a feature19:18
*** gfidente has quit IRC19:18
ccesariolet me check19:19
ntpttrccesario: can't you just click a button on gerrit's web interface to rebase?19:21
sdakehttps://review.openstack.org/#/c/300143/319:21
patchbotsdake: patch 300143 - kolla - Make keepalived virtual_router_id param configurable19:21
sdakepatch in merge conflict19:22
sdakentpttr not when in conflict19:22
ntpttroh it's in conflict never mind :)19:22
ntpttrthat's always fun, time to pull out the vimdiff19:22
ccesariosdake, http://paste.openstack.org/show/492774/19:24
sdakenot sure i dont use branches in development19:25
sdakegit pull something origin/master --rebase19:26
sdakei'm not sure what the remote is19:26
sdakemy gitfu is pretty good but not fantastic :)19:26
openstackgerritMerged openstack/kolla: Workaround ansible bug related to delegate_to  https://review.openstack.org/29980319:27
ntpttrI usually make sure that my repo is up to date with master with git remote update, then git pull --ff-only, then pull down the patch with git-review -d 300143, then git rebase origin/master19:28
ntpttrafter that you probably have to run git mergetool and sort it out, unless there's a better way of doing it I don't know about19:28
sdakecore reviewers - need legitimate reviews on this patch https://review.openstack.org/#/c/297963/619:29
patchbotsdake: patch 297963 - kolla - Implement nova-ssh container19:29
sdakeor anyone else that is interested in reviewing19:29
*** barra204 has joined #openstack-kolla19:30
rhalliseysbezverk, sdake, nvm we don't need cli command unless you prefer it.  You add it to kolla-build.conf19:36
sdakejpeeler is pycrypto replaced by cryptography?19:36
inc0I thought migrate + ssh might be an issue19:36
rhalliseydoes need a doc though19:36
sdakekolla-build.conf wfm19:37
sdakeour api to our cli is overloaded anyway and needs a redux if possible19:37
inc0however I'd rather implement security on interface than go to lenghts of ssh-based enc19:37
inc0it's barely useful itself19:37
jpeelersdake: i don't know - the only thing i've heard of is some desire to perhaps move to pycryptodome19:40
*** tfukushima has joined #openstack-kolla19:40
sdakeinc0 ssh is for use with scp19:41
sdakenot for ssh19:41
sdakefrom my understanding of the issue19:42
inc0sdake, ssh is used by libvirt live migration afaik19:42
inc0unless it's different issue19:42
openstackgerritRyan Hallisey proposed openstack/kolla: Document custom-repos  https://review.openstack.org/30063219:42
inc0but only if you setup lm url to qemu+ssh...19:42
sdakerhallisey remove docimpact19:42
sdakedocimpact creates a bug19:42
sdakesicne your fixing documentation yo udont need a bug created for it19:42
rhalliseywhich one prevents the gate from triggering19:42
sdakethe original commit should have had docimpact applied19:43
inc0what was the command to generate kolla-build?19:43
openstackgerritRyan Hallisey proposed openstack/kolla: Document custom-repos  https://review.openstack.org/30063219:43
rhalliseyinc0, tox -e genconfig19:44
*** tfukushima has quit IRC19:45
openstackgerritSteven Dake proposed openstack/kolla: DONOTMERGE; Test of stable/mitaka gate  https://review.openstack.org/30063319:46
sdakeccesario your remote is called gerrit i believe19:47
ccesariosdake, I 'm doing it19:47
ccesarioI need only check somethings19:47
*** salv-orlando has joined #openstack-kolla19:48
ccesariocurrently template  ha only one vrrp_instance https://github.com/openstack/kolla/blob/master/ansible/roles/haproxy/templates/keepalived.conf.j219:49
ccesariocan I revert the variables ? using only keepalived_virtual_router_id var name !?19:50
ccesarioI meant variable name19:51
openstackgerritRyan Hallisey proposed openstack/kolla: Add remove apparmor reminder to the quickstart  https://review.openstack.org/30018419:52
mlimadone sdake :)19:55
sdakerevert which variable name19:56
sdakethe patch we juset merged joined the two networks into one keepalived instance19:56
inc0where version for pbr is specified?19:58
openstackgerritMauricio Lima proposed openstack/kolla: Add a step to clean all ceph references in fstab  https://review.openstack.org/29836320:00
ccesariosdake, testing local20:01
sdakeneed to eat some lucnh bbiaf20:01
sdakerhallisey or jpeeler or inc0 this could use an ack so it can be cherrypicked into rc3 https://review.openstack.org/#/c/298363/420:02
patchbotsdake: patch 298363 - kolla - Add a step to clean all ceph references in fstab20:02
sdakebbiaf20:02
sdakefast food ftw20:02
dimssdake : tsk tsk tsk20:06
dims:)20:06
*** mbound has quit IRC20:08
inc0wassup dims?:)20:09
dimsinc0 : fun stuff with a trivial doc review :) https://review.openstack.org/#/c/299945/20:10
patchbotdims: patch 299945 - kolla - Update Quickstart with example for distro and inst...20:10
inc0dims what to do what to do, I would +2+W it but I don't want to go against -1 of another core :(20:14
dimsinc0 : got told to add TrivialFix and then getting told to remove it too :)20:14
inc0well, I just +w it so I guess that's on me if something is wrong20:15
dimsinc0 : thanks :)20:16
openstackgerritMerged openstack/kolla: Update Quickstart with example for distro and install type  https://review.openstack.org/29994520:17
*** sdake has quit IRC20:17
*** tfukushima has joined #openstack-kolla20:21
*** salv-orl_ has joined #openstack-kolla20:23
*** salv-orlando has quit IRC20:26
*** sdake has joined #openstack-kolla20:33
inc0sdake, how do you change release with reno and pbr?20:33
sdakeyo bsck20:34
sdakeinc0 pbr changes the release on teh latet tag i believe20:34
gmmahasdake: which email are you referring to?20:34
sdakeyou can test in your local repo but dont push the tag20:34
gmmahai dont think i sent an email to you.. Is this the pupdate to the bug?20:34
sdakerneo operates from the tags in teh git repo20:34
inc0sdake, well...then we need to make sure that all.yml will math20:34
sdakemy tile guys are half way done in my office20:35
sdakeand its only 1pm20:35
openstackgerritCarlos Cesario proposed openstack/kolla: Make keepalived virtual_router_id param configurable  https://review.openstack.org/30014320:35
sdakei think they will be done monday or tuesday yay :)20:35
*** rajathagasthya has joined #openstack-kolla20:37
ccesariosdake, rhallisey ^^20:38
ccesariosdake, this ps https://review.openstack.org/#/c/297967/  need to be rebased too!?20:41
patchbotccesario: patch 297967 - kolla - Change keystone log dir20:41
openstackgerritMerged openstack/kolla: Fix the nova reconfigure in the multinode env  https://review.openstack.org/29921920:42
mlimaccesario, I'm not sdake, but i believe it does not need a rebase20:43
openstackgerritMerged openstack/kolla: Add a step to clean all ceph references in fstab  https://review.openstack.org/29836320:44
sdakeif anyone wnats n easy bug t fixx https://bugs.launchpad.net/kolla/+bug/156508120:44
openstackLaunchpad bug 1565081 in kolla "tempest not building in gate" [High,Triaged]20:44
sdakeimpacts the gate which is why its high20:44
sdakeccesario if it says merge conflict then it does o therwiese no20:45
SiRiuSnihilifer, I managed to deploy all the apps all-in-one, but rabbitmq keeps restarting20:46
sdakemlima can you use cherrypick button on 29336320:46
mlima293363 sdake?20:47
mlimahttps://review.openstack.org/#/c/293363/20:47
patchbotmlima: patch 293363 - fuel-plugin-midonet - Introduce Fuel 8 (MERGED)20:47
SiRiuSnihilifer, also koala-toolbox keeps restarting (probably because of rabbitmq not working?)20:48
sdakemlima the ceph bug20:48
mlimaoh20:48
mlima:)20:48
openstackgerritHui Kang proposed openstack/kolla: Fix missing libvirt python module in ceilometer-compute  https://review.openstack.org/30065020:48
ccesariosdake, thanks20:49
*** jtriley has joined #openstack-kolla20:49
sbezverkrhallisey it does not want to install rpm if they are not in registered repos :-( it looks lie I have two choices, 1 to find pubic repo hosting new qemu rpms or 2 build my own..20:50
mlimai have an error sdake20:50
sdakewow silver up to 15 bucks an ounce20:50
mlima"Change 299342 is closed"20:50
sdakewhat kind of error20:50
openstackgerritMauricio Lima proposed openstack/kolla: Add a step to clean all ceph references in fstab  https://review.openstack.org/29934220:51
mlimadone sdake20:52
mlimathe error was happening because i had abandoned the patch :)20:53
*** jtriley has quit IRC20:54
gmmahasdake: thanks for merging the patch20:54
gmmahasdake: i think you want me to add a comment to the piece.. let me send that patch up as well20:55
ccesariosdake, If you had any clue about the random error that I post in https://review.openstack.org/#/c/297984/  I appreciate it :)20:56
patchbotccesario: patch 297984 - kolla - Added hostname param into kolla_docker20:56
sdakemlima make a new patch using the "create cherrypick" button20:56
sdakehere let me od it20:56
openstackgerritSteven Dake proposed openstack/kolla: Add a step to clean all ceph references in fstab  https://review.openstack.org/29934220:57
mlimai had already done it sdake, but okay20:58
mlima20:58
openstackgerritGanesh Maharaj Mahalingam proposed openstack/kolla: Add comments on site.yml neutron hosts reordering  https://review.openstack.org/30065120:58
mlima:)20:58
sdakemlima20:58
sdakedont use the cherrypick button20:58
sdakemake an new patch20:58
sdakejeffrey isnt' around to remove his -220:59
sdakegit cherry-pick -x hashid20:59
mlimahmm20:59
sdakeand that patch needs to merge before i tag rc320:59
sdakeyou mya have to change the commit mesage slightly20:59
sdakeso the change id is different20:59
mlimawhy not use the button?20:59
sdakeit keeps creating the same change id21:00
rhalliseysbezverk, do you get the error from the build? or in the middle of the contianer builder?21:00
mlimahmm21:00
rhalliseybuilding21:00
mlimacan you finish it? sdake21:01
*** haplo37 has quit IRC21:01
openstackgerritSteven Dake proposed openstack/kolla: Fix IP resolve check for RabbitMQ on AIO  https://review.openstack.org/30065421:02
*** ssurana has quit IRC21:04
openstackgerritSteven Dake proposed openstack/kolla: Workaround ansible bug related to delegate_to  https://review.openstack.org/30065521:04
sdakemlima occopied atm21:04
mlimasdake, I think I would have no problem with abandoned patch :/21:04
mlimabut if you prefer a new patchset I can do it21:05
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Making Mitaka deploying liberty  https://review.openstack.org/29956321:07
*** AndroUser2 has quit IRC21:07
*** AndroUser2 has joined #openstack-kolla21:07
openstackgerritSteven Dake proposed openstack/kolla: Fix the nova reconfigure in the multinode env  https://review.openstack.org/30065721:07
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Making Mitaka deploying liberty  https://review.openstack.org/29956321:08
openstackgerritSteven Dake proposed openstack/kolla: Increase database connections to 10000  https://review.openstack.org/30065821:08
sbezverkrhallisey I get error saying that rpms are not found nothing to do21:09
rhalliseysbezverk, ok so that error was from the 'docker build'21:10
rhalliseythe container is not finding the rpms from that repo then21:11
sbezverkrhallisey here is the paste: http://paste.openstack.org/show/492784/21:11
openstackgerritSteven Dake proposed openstack/kolla: Reduce log errors from heka  https://review.openstack.org/30066221:11
rhalliseysbezverk, did you include that rpm as a url link?21:12
sbezverkright, but the problem is I cannot find any official repo for these rpms21:12
rhalliseyyou don't need the repo you just need a link to that rpm21:12
*** AndroUser2 has quit IRC21:12
sbezverkoh, so it will curl it?21:12
rhalliseyya21:13
sbezverkI see :-) let me re-do it then..21:13
rhalliseyactually it will just yum install <url>21:13
rhalliseythe docker command is different by whether its .repo url or .rpm21:13
sdakethis needs a review please https://review.openstack.org/#/c/297963/21:14
patchbotsdake: patch 297963 - kolla - Implement nova-ssh container21:14
manjeetsI think pretty much bulk instances work fine except problem of getting muliple ports for some21:14
manjeetssdake got this log from neutron when mis coummunication happened21:14
sdakeand a workflow+121:14
manjeetshttp://paste.openstack.org/show/492785/21:14
sdakemanjeets file bug plz21:14
sdakei don have time on tag day to debug issues21:15
sdakestrugglign to get the backports done21:15
manjeetsnot sure if it is kolla doing or neutron21:15
sdakemanjeets file bug and link it - i'll bring it into 2.0.0 as something to fix21:15
sdakealso helpful woud lbe the logs from each node of rabbitmq's rabbimqs logs21:16
*** ccesario_ has joined #openstack-kolla21:17
sdakewhere is mandre21:18
openstackgerritMauricio Lima proposed openstack/kolla: Add a step to clean all ceph references in fstab  https://review.openstack.org/30066421:19
mlimadone sdake  ^21:19
sdakemlima use cherry-pick -x feature21:20
sdakeyour msising the cherrypick information21:20
mlimada erro21:20
sdakegit cherrypick -x featur21:20
mlimaops, wrong chat21:20
sbezverkrhallisey it almost worked, some rpm depends on other which are not yet installed, I guess I will have to play wiht order21:20
mlimasdake,  ! [remote rejected] HEAD -> refs/publish/stable/mitaka (change https://review.openstack.org/299342 closed)21:21
rhalliseysbezverk, ya just make a list21:21
sdakemlima change the commit message before submitting, delete the change id21:21
sdakethsi should create a special new changeid for you21:21
sdakethe changeid is based upon the commit hash which is based upon the commit contents and the commit message21:22
mlimaI can not change the message commit :/ sdake21:22
sdakeafter cherrypick git commit --amend21:22
sdakethis lets you change the commit message  -deleete the change id from the commit message and add some text21:23
*** inc0 has quit IRC21:23
openstackgerritMauricio Lima proposed openstack/kolla: Add a step to clean all ceph references in fstab  https://review.openstack.org/30066421:23
sdakewhere is this bug in the review queue: https://bugs.launchpad.net/kolla/+bug/156062021:24
openstackLaunchpad bug 1560620 in kolla "Move keystone-apache-*.log files to /var/log/kolla/keystone directory in keystone container" [Critical,In progress] - Assigned to Carlos Cesario (ccesario)21:24
*** ayoung is now known as ayoung-afk21:25
sdakeccesario do you hvave that bug finished?21:25
sdakeok folks her eis what i'm after atm21:25
sdakeI want to cherrypick all the patches that are done21:25
sdakeiff patche aren't done in rc3, i want them done ;)21:25
mlimaI have added manually, sdake21:25
sdakeif patches need acks in rc3 and are done - please point them out21:25
*** mlima has quit IRC21:27
sbezverksdake this patch is missing only workflow https://review.openstack.org/#/c/298887/21:29
patchbotsbezverk: patch 298887 - kolla - Fixing permission for libvirtd.log21:29
openstackgerritSteven Dake proposed openstack/kolla: When two interfaces are used for two VIPs, tie them together  https://review.openstack.org/30066821:29
*** ayoung-afk is now known as ayoung21:30
*** ayoung is now known as ayoung_afk21:30
gmmahaccesario: have you ever seen this issue with the deployment? http://paste.openstack.org/show/492786/21:31
gmmahahave a glance image but its not reachable21:31
*** haplo37 has joined #openstack-kolla21:31
openstackgerritSteven Dake proposed openstack/kolla: Fix the nova reconfigure in the multinode env  https://review.openstack.org/30065721:36
sbezverkgmmaha what do you use as a backend for glance? file or swift or something else?21:37
gmmahasbezverk: its glance..21:38
gmmahai thnk the error is this.. Last exception: UEFI is not supported21:38
gmmahaits an UEFI image21:38
gmmaha:(21:38
openstackgerritMerged openstack/kolla: Make keepalived virtual_router_id param configurable  https://review.openstack.org/30014321:38
openstackgerritMerged openstack/kolla: Fixing permission for libvirtd.log  https://review.openstack.org/29888721:38
openstackgerritSteven Dake proposed openstack/kolla: Make keepalived virtual_router_id param configurable  https://review.openstack.org/30067121:39
sbezverkgmmaha :-) I know it is glance, but glance for image storage uses different backends. if you have not change anything thenm by default it is file.21:39
sbezverkplese check /var/lib/glance/images21:40
gmmahasbezverk: aaah.. :) sorry, yes using just file21:40
gmmahano special backends21:40
sbezverkjust to be sure it is actually there21:40
manjeetshttps://bugs.launchpad.net/kolla/+bug/156510521:41
openstackLaunchpad bug 1565105 in kolla "while spining vms on large scale some vms get multiple ips and multiple ports get created" [Undecided,New]21:41
gmmahasbezverk: where do the images get stored. in the glance_api container?21:42
ccesario_sdake I'm on road...  But about the bug.. Yes.... It fineshd https://review.openstack.org/#/c/297967/21:42
patchbotccesario_: patch 297967 - kolla - Change keystone log dir21:42
sdakerhallisey jpeeler please review https://review.openstack.org/#/c/297967/421:47
patchbotsdake: patch 297967 - kolla - Change keystone log dir21:47
sdakegmmaha in th eglance named volume21:48
sdakeif there is one21:48
sdakeif ther eisn't, we have a critical bug needs solving21:48
sdakeok core reviweers21:48
sdakeI have bakcported every bug that has a  fix in newton21:48
sdakeso please hit the queue and ack the backports21:48
*** ayoung_afk is now known as ayoung21:49
sdakethere was one bug which had a conflict which i did not backport21:49
sdakeccesario 's link above needs a workflow +121:49
sdakeand a cherrypick afterwrads21:49
sbezverkgmmaha for file backend images should be sitting at /var/lib/glance/images21:51
sbezverkrhallisey unfortunately this way did not work for me, as it seems ceph needs qemu 1.5.3 so all images with ceph base failed to build, I will try to install these rpm only to nova-base21:53
rhalliseysbezverk, do you need ceph?21:54
rhalliseythis is just for your local env21:54
*** rajathagasthya has quit IRC21:56
sdakesbezverk doe glne not hve a named volume?21:56
sbezverkrhallisey nope, but because cinder base and glance have ceph rpms, they fail21:56
rhalliseysbezverk, ok. Ya just add it to that dockerfile then21:57
sdakejpeeler rhallisey mandre asalkeld nihilifer please hit the reiew queue and review any stable/mitaka patches - tagging today21:57
rhalliseythink I already hit them all. They should just need 1 more +221:58
rhalliseymissed one..21:58
sbezverksdake glance has named volume, but still the path inside of that volume should be /var/lib/glance21:59
*** ccesario_ has quit IRC22:07
openstackgerritMerged openstack/kolla: Fix IP resolve check for RabbitMQ on AIO  https://review.openstack.org/30065422:08
openstackgerritMerged openstack/kolla: Added precheck to check kernel version 4.2 on Ubuntu 14.04.  https://review.openstack.org/29929122:09
*** ccesario__ has joined #openstack-kolla22:10
openstackgerritMerged openstack/kolla: Reduce log errors from heka  https://review.openstack.org/30066222:12
openstackgerritMerged openstack/kolla: Fix the nova reconfigure in the multinode env  https://review.openstack.org/30065722:12
*** sdake_ has joined #openstack-kolla22:13
*** sdake has quit IRC22:13
*** ccesario_ has joined #openstack-kolla22:17
*** ccesario__ has quit IRC22:17
*** sdake has joined #openstack-kolla22:19
*** sdake_ has quit IRC22:21
*** ccesario_ has quit IRC22:22
*** mbound has joined #openstack-kolla22:24
*** mbound has quit IRC22:25
*** mbound has joined #openstack-kolla22:25
*** achanda has joined #openstack-kolla22:29
*** ccesario__ has joined #openstack-kolla22:30
*** huikang has quit IRC22:35
*** ccesario_ has joined #openstack-kolla22:38
*** ccesario__ has quit IRC22:38
sdakewtb merging of patches :)22:39
*** Marga_ has quit IRC22:39
*** rajathagasthya has joined #openstack-kolla22:40
*** rajathagasthya has quit IRC22:43
SiRiuSanyone deploying kolla-mesos?22:46
SiRiuSrabbitmq just keeps crashing22:46
openstackgerritMerged openstack/kolla: Increase database connections to 10000  https://review.openstack.org/30065822:47
*** jtriley has joined #openstack-kolla22:50
*** ccesario__ has joined #openstack-kolla22:54
*** jtriley has quit IRC22:55
SiRiuSasalkeld, ping22:55
ccesario__gmmaha:  http://paste.openstack.org/show/492786 about it.... I have not ever seen .... how reproduce it ?22:59
*** Marga_ has joined #openstack-kolla23:01
*** ccesario_ has quit IRC23:01
*** mgoddard has joined #openstack-kolla23:01
*** alyson_ has quit IRC23:02
openstackgerritMerged openstack/kolla: Add a step to clean all ceph references in fstab  https://review.openstack.org/30066423:05
*** Marga_ has quit IRC23:06
*** mgoddard has quit IRC23:11
*** Marga_ has joined #openstack-kolla23:14
ccesario__sdake: any tip about this ?  https://review.openstack.org/#/c/297984/23:14
patchbotccesario__: patch 297984 - kolla - Added hostname param into kolla_docker23:14
sdakeother then you said it doesn't work23:15
sdakeno, i haven't debugged it for you :)23:15
ccesario__sdake: yes yes I told... today I get some error that happen23:17
ccesario__it is in last comment23:17
ccesario__maybe you can have any idea :)23:17
*** iceyao has joined #openstack-kolla23:19
sdakeno idea23:19
ccesario__thank you.23:21
*** haplo37 has quit IRC23:22
ccesario__the problem it seems specific in kolla_docker because using docker-py API the same set of params to deploy a container used in kolla  it works... ncluding hostname param.23:23
gmmahasdake: sbezverk: the images are saved in the glance-api container in /var/lib/glance23:32
gmmahaand the file is there..23:32
gmmahaso no issues there.. :)23:32
sbezverkgmmaha could you try to launch cirros instance just to make sure glance and nova works fine, if it works then we know it is that image problem..23:35
gmmahasbezverk: for sure..23:35
manjeetsquestion is it possible to use direct switch ovs without using ml2 plugin ?23:36
manjeetsi mean is it possible with kolla to deploy that way23:37
gmmahasbezverk: yes i am able to boot a cirros image without any issues23:41
gmmahaguessing the image i had was corrupted23:41
sbezverkgmmaha looks like it.. at least we know it is not your opensatck issue ;-)23:41
gmmahasbezverk: absolutely..23:42
gmmahaone less problem to worry about..23:42
gmmaha:)23:42
gmmahathanks for helping me with this23:42
gmmahalet me go and figure out whats happenign with my image23:42
sbezverkgmmaha sure and good luck23:42
sbezverksdake ping23:51
*** ccesario- has joined #openstack-kolla23:52
openstackgerritHui Kang proposed openstack/kolla: Fix missing libvirt python module in ceilometer-compute  https://review.openstack.org/30065023:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!