| *** inc0 has quit IRC | 00:04 | |
| *** diogogmt has quit IRC | 00:04 | |
| *** bootsha has joined #openstack-kolla | 00:06 | |
| *** sdake has joined #openstack-kolla | 00:08 | |
| *** zhiwei has joined #openstack-kolla | 00:09 | |
| *** bootsha has quit IRC | 00:11 | |
| *** zhiwei has quit IRC | 00:14 | |
| *** dmsimard|afk is now known as dmsimard | 00:18 | |
| *** zhiwei has joined #openstack-kolla | 00:26 | |
| *** banix has joined #openstack-kolla | 00:27 | |
| *** zhiwei has quit IRC | 00:31 | |
| *** godleon has quit IRC | 00:39 | |
| *** salv-orl_ has quit IRC | 00:42 | |
| *** david-lyle has quit IRC | 00:42 | |
| *** zhiwei has joined #openstack-kolla | 00:42 | |
| sdake | hey cats | 00:43 |
|---|---|---|
| *** ravig has quit IRC | 00:44 | |
| *** david-lyle__ has joined #openstack-kolla | 00:45 | |
| *** david-lyle__ has quit IRC | 00:45 | |
| *** ravig has joined #openstack-kolla | 00:46 | |
| *** zhiwei has quit IRC | 00:47 | |
| *** banix has quit IRC | 00:48 | |
| *** sdake has quit IRC | 00:49 | |
| *** zhurong has joined #openstack-kolla | 00:52 | |
| *** zhiwei has joined #openstack-kolla | 00:59 | |
| *** williamcaban has quit IRC | 01:01 | |
| *** daneyon has joined #openstack-kolla | 01:01 | |
| *** zhiwei has quit IRC | 01:04 | |
| *** daneyon has quit IRC | 01:06 | |
| *** banix has joined #openstack-kolla | 01:07 | |
| *** bootsha has joined #openstack-kolla | 01:08 | |
| *** ravig has quit IRC | 01:11 | |
| *** sogabe has joined #openstack-kolla | 01:12 | |
| *** bootsha has quit IRC | 01:13 | |
| *** beekhof has left #openstack-kolla | 01:14 | |
| *** williamcaban has joined #openstack-kolla | 01:15 | |
| *** zhiwei has joined #openstack-kolla | 01:16 | |
| *** williamcaban has quit IRC | 01:17 | |
| *** williamcaban has joined #openstack-kolla | 01:17 | |
| *** ravig has joined #openstack-kolla | 01:19 | |
| *** zhiwei has quit IRC | 01:20 | |
| *** zhurong has quit IRC | 01:32 | |
| *** zhiwei has joined #openstack-kolla | 01:33 | |
| *** pbourke has quit IRC | 01:33 | |
| *** zhurong has joined #openstack-kolla | 01:33 | |
| *** zhiwei has quit IRC | 01:37 | |
| *** zhiwei has joined #openstack-kolla | 01:41 | |
| *** zhurong has quit IRC | 01:42 | |
| *** zhurong has joined #openstack-kolla | 01:43 | |
| *** banix has quit IRC | 01:45 | |
| *** ravig has quit IRC | 01:48 | |
| *** sdake has joined #openstack-kolla | 01:50 | |
| *** ravig has joined #openstack-kolla | 01:52 | |
| *** pbourke has joined #openstack-kolla | 01:53 | |
| *** diogogmt has joined #openstack-kolla | 02:08 | |
| *** bootsha has joined #openstack-kolla | 02:10 | |
| coolsvap | sdake, hey | 02:11 |
| *** bootsha has quit IRC | 02:15 | |
| *** salv-orlando has joined #openstack-kolla | 02:19 | |
| *** dwalsh has joined #openstack-kolla | 02:20 | |
| *** unicell1 has quit IRC | 02:22 | |
| *** salv-orlando has quit IRC | 02:26 | |
| *** ravig has quit IRC | 02:27 | |
| *** bootsha has joined #openstack-kolla | 02:32 | |
| *** bootsha has quit IRC | 02:38 | |
| *** ravig has joined #openstack-kolla | 02:47 | |
| *** daneyon has joined #openstack-kolla | 02:50 | |
| *** daneyon has quit IRC | 02:54 | |
| *** salv-orlando has joined #openstack-kolla | 02:55 | |
| *** williamcaban has quit IRC | 02:57 | |
| *** salv-orlando has quit IRC | 02:59 | |
| *** williamcaban has joined #openstack-kolla | 03:01 | |
| *** williamcaban has quit IRC | 03:05 | |
| *** salv-orlando has joined #openstack-kolla | 03:29 | |
| *** bootsha has joined #openstack-kolla | 03:33 | |
| *** zhurong has quit IRC | 03:34 | |
| *** zhurong has joined #openstack-kolla | 03:35 | |
| *** salv-orlando has quit IRC | 03:36 | |
| *** bootsha has quit IRC | 03:38 | |
| *** dwalsh has quit IRC | 03:43 | |
| *** zhurong has quit IRC | 03:46 | |
| *** sdake has quit IRC | 03:48 | |
| *** unicell has joined #openstack-kolla | 04:12 | |
| *** harlowja_at_home has joined #openstack-kolla | 04:12 | |
| *** ravig has quit IRC | 04:19 | |
| *** harlowja_at_home has quit IRC | 04:22 | |
| *** sdake has joined #openstack-kolla | 04:32 | |
| *** daneyon has joined #openstack-kolla | 04:38 | |
| *** salv-orlando has joined #openstack-kolla | 04:39 | |
| *** daneyon has quit IRC | 04:43 | |
| *** pbourke has quit IRC | 04:47 | |
| *** salv-orlando has quit IRC | 04:47 | |
| *** salv-orlando has joined #openstack-kolla | 04:49 | |
| *** sdake has quit IRC | 04:51 | |
| *** Jeffrey4l_ has joined #openstack-kolla | 04:51 | |
| *** sdake has joined #openstack-kolla | 04:54 | |
| *** bootsha has joined #openstack-kolla | 04:55 | |
| *** bootsha has quit IRC | 04:59 | |
| *** bootsha has joined #openstack-kolla | 04:59 | |
| *** zhurong has joined #openstack-kolla | 05:10 | |
| *** bootsha has quit IRC | 05:14 | |
| *** pbourke has joined #openstack-kolla | 05:16 | |
| *** Mech422 has quit IRC | 05:25 | |
| *** sdake has quit IRC | 05:26 | |
| *** Mech422 has joined #openstack-kolla | 05:28 | |
| *** zhurong has quit IRC | 05:31 | |
| *** v1k0d3n has quit IRC | 05:39 | |
| *** zhurong has joined #openstack-kolla | 05:41 | |
| *** dwalsh has joined #openstack-kolla | 05:46 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix the overwrite sudoers file issue https://review.openstack.org/338701 | 05:50 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix the overwrite sudoers file issue https://review.openstack.org/338702 | 05:52 |
| *** banix has joined #openstack-kolla | 05:58 | |
| *** bootsha has joined #openstack-kolla | 06:06 | |
| *** sdake has joined #openstack-kolla | 06:10 | |
| *** fragatina has quit IRC | 06:10 | |
| *** fragatina has joined #openstack-kolla | 06:11 | |
| *** sdake has quit IRC | 06:19 | |
| *** sdake has joined #openstack-kolla | 06:19 | |
| *** banix has quit IRC | 06:22 | |
| *** sdake has quit IRC | 06:29 | |
| *** sdake has joined #openstack-kolla | 06:39 | |
| *** Serlex has joined #openstack-kolla | 06:39 | |
| *** dwalsh has quit IRC | 06:39 | |
| *** dwalsh has joined #openstack-kolla | 06:55 | |
| *** sdake has quit IRC | 06:55 | |
| *** zhiwei has quit IRC | 07:01 | |
| *** mewald1 has joined #openstack-kolla | 07:03 | |
| *** daneyon has joined #openstack-kolla | 07:20 | |
| *** daneyon has quit IRC | 07:25 | |
| *** bootsha has quit IRC | 07:25 | |
| *** bootsha has joined #openstack-kolla | 07:25 | |
| *** shardy has joined #openstack-kolla | 07:39 | |
| *** shardy has quit IRC | 07:40 | |
| *** shardy has joined #openstack-kolla | 07:41 | |
| openstackgerrit | Takeaki Matsumoto proposed openstack/kolla: Add enable_iscsi option to etc/kolla/globals.yml https://review.openstack.org/337571 | 07:44 |
| *** dwalsh has quit IRC | 07:49 | |
| *** salv-orlando has quit IRC | 07:51 | |
| *** salv-orlando has joined #openstack-kolla | 07:52 | |
| *** jrist has quit IRC | 08:07 | |
| *** tyrola has joined #openstack-kolla | 08:09 | |
| *** fragatina has quit IRC | 08:09 | |
| *** tyrola has quit IRC | 08:10 | |
| *** tyrola has joined #openstack-kolla | 08:10 | |
| *** kaushikc has joined #openstack-kolla | 08:16 | |
| *** openstackgerrit has quit IRC | 08:18 | |
| *** openstackgerrit has joined #openstack-kolla | 08:18 | |
| *** jeh has quit IRC | 08:23 | |
| *** gfidente has joined #openstack-kolla | 08:25 | |
| *** jeh has joined #openstack-kolla | 08:36 | |
| *** jeh has quit IRC | 08:36 | |
| *** jeh has joined #openstack-kolla | 08:36 | |
| *** athomas has joined #openstack-kolla | 08:40 | |
| *** tyrola has quit IRC | 08:51 | |
| *** jrist has joined #openstack-kolla | 09:00 | |
| *** jrist has quit IRC | 09:00 | |
| *** jrist has joined #openstack-kolla | 09:00 | |
| *** tyrola has joined #openstack-kolla | 09:00 | |
| *** salv-orlando has quit IRC | 09:03 | |
| *** coolsvap has quit IRC | 09:03 | |
| *** coolsvap has joined #openstack-kolla | 09:04 | |
| *** daneyon has joined #openstack-kolla | 09:09 | |
| *** daneyon has quit IRC | 09:13 | |
| *** tyrola has quit IRC | 09:18 | |
| *** tyrola has joined #openstack-kolla | 09:19 | |
| *** fragatina has joined #openstack-kolla | 09:22 | |
| openstackgerrit | Paul Bourke proposed openstack/kolla: Read GPT label using sgdisk rather than udev https://review.openstack.org/326609 | 09:27 |
| *** coolsvap has quit IRC | 09:32 | |
| *** coolsvap has joined #openstack-kolla | 09:33 | |
| Mech422 | pbourke: Hey Paul - whats new in patchset 9 ? | 09:40 |
| pbourke | Mech422: just a rebase | 09:40 |
| pbourke | there was a merge conflict | 09:40 |
| Mech422 | pbourke: ahh - I won't look then :-P | 09:40 |
| pbourke | hope the recent changes look ok to you | 09:41 |
| Mech422 | pbourke: btw - I rebuilt ubuntu source from master today and ended up with a failure due to /home/ansible being owned by root | 09:41 |
| pbourke | hmm | 09:41 |
| Mech422 | pbourke: eh - I ranted earlier about why I didn't do a regex thing to begin with | 09:42 |
| Mech422 | pbourke: but I got voted down, so cie est la vie | 09:42 |
| pbourke | Mech422: ah I got disconnected during the night | 09:42 |
| pbourke | what was the issue? | 09:42 |
| Mech422 | pbourke: I just always do scrapes by testing in bash, then pasting the working code in... | 09:42 |
| pbourke | ah | 09:43 |
| Mech422 | pbourke: makes it easy to test, fails fast/hard/loud, and removes the temptation to do 'one size fits all' regexes that end up being brittle | 09:43 |
| pbourke | yeah I dont really care either way. the regex is a bit cleaner but your method makes sense too | 09:43 |
| pbourke | I just want to see the patch go in now | 09:44 |
| Mech422 | pbourke: no biggie - I just dont want people screaming about 'scraping sucks' when someone plays with the regex | 09:44 |
| pbourke | ha | 09:44 |
| pbourke | Mech422: can you double check if there's an issue with /home/ansible | 09:44 |
| Mech422 | pbourke: though, tbh, thats not very likely with sgdisk - I don't think the output has changed in ages | 09:44 |
| Mech422 | pbourke: I agree - it'll be nice to finally get this merged | 09:45 |
| Mech422 | pbourke: I posted a bug about /home/ansible - let me get the url | 09:45 |
| Mech422 | pbourke: https://bugs.launchpad.net/kolla/+bug/1599677 | 09:45 |
| openstack | Launchpad bug 1599677 in kolla "It appears the 'ansible' user in kolla-toolbox needs the home dir permissions changed" [Undecided,New] | 09:45 |
| Mech422 | pbourke: inc0 said that it should have been fixed already, so I'm not sure whats up - I haven't had a chance to dig into it | 09:46 |
| pbourke | oh so this isn't necessarily to do with our patch | 09:46 |
| Mech422 | pbourke: oh no - nothing at all | 09:46 |
| pbourke | grand | 09:46 |
| Mech422 | pbourke: I get my new networking gear tommorrow :-) Got a ubiquiti 802.11ac AP and an 8 port TP-Link switch | 09:47 |
| Mech422 | then I get to climb around in the attic and run/re-route wires :-P | 09:47 |
| pbourke | the AC looks fancy | 09:48 |
| pbourke | *AP | 09:48 |
| Mech422 | pbourke: my friends keep telling me how good ubiquiti stuff is, so I'm excited to try | 09:48 |
| Mech422 | I don't like the java based 'controller' - but thats only needed for configuration/captive portal use | 09:49 |
| Mech422 | I'm really interested to see how good the TP Link is too - it's got a LOT of bells & whistles for $75 (8 port model) | 09:50 |
| Mech422 | google supposedly tapped TP Link for some home wireless gear, so I figure it should at least be halfway decent | 09:50 |
| Mech422 | If I can manage not to fall thru the ceiling, the AP should look pretty good up there - supposed to look like a smoke detector | 09:51 |
| pbourke | moce | 10:00 |
| pbourke | *nice | 10:00 |
| coolsvap | Jeffrey4l_, around? | 10:00 |
| coolsvap | Jeffrey4l_, patch 331420 depends on patch 338701 am I correct? | 10:01 |
| patchbot | coolsvap: https://review.openstack.org/#/c/331420/ - kolla (stable/mitaka) - Fix the ubuntu binary on mitaka branch | 10:01 |
| patchbot | coolsvap: https://review.openstack.org/#/c/338701/ - kolla (stable/mitaka) - Fix the overwrite sudoers file issue | 10:01 |
| *** zhurong has quit IRC | 10:02 | |
| *** bootsha has quit IRC | 10:03 | |
| *** fragatina has quit IRC | 10:07 | |
| *** kaushikc has quit IRC | 10:09 | |
| *** pbourke has quit IRC | 10:12 | |
| *** pbourke has joined #openstack-kolla | 10:13 | |
| *** salv-orlando has joined #openstack-kolla | 10:22 | |
| *** zhurong has joined #openstack-kolla | 10:26 | |
| *** fragatina has joined #openstack-kolla | 10:27 | |
| *** zhurong has quit IRC | 10:36 | |
| *** salv-orl_ has joined #openstack-kolla | 10:43 | |
| *** fragatina has quit IRC | 10:44 | |
| *** salv-orlando has quit IRC | 10:46 | |
| *** narasimha_SV has joined #openstack-kolla | 10:48 | |
| narasimha_SV | TASK: [rabbitmq | fail msg="Hostname has to resolve to IP address of api_interface"] *** | 10:51 |
| narasimha_SV | because of above failure rabbitmq is not getting started | 10:51 |
| narasimha_SV | did anyone face this issue ? | 10:51 |
| *** athomas has quit IRC | 10:52 | |
| *** athomas has joined #openstack-kolla | 10:58 | |
| narasimha_SV | {{ hostvars[item['item']]['ansible_' + hostvars[item['item']]['api_interface']]['ipv4']['address'] }}' not in '{{ item.stdout }} | 10:59 |
| narasimha_SV | this code is makinf rabbitmq to fail in the startup | 11:00 |
| narasimha_SV | can anyone tell me what exactly this {{ hostvars[item['item']]['ansible_' + hostvars[item['item']]['api_interface']]['ipv4']['address'] }} output will be | 11:00 |
| *** mliima has joined #openstack-kolla | 11:02 | |
| *** bootsha has joined #openstack-kolla | 11:03 | |
| *** salv-orlando has joined #openstack-kolla | 11:04 | |
| *** salv-orlando has quit IRC | 11:04 | |
| *** ccesario has joined #openstack-kolla | 11:06 | |
| *** salv-orl_ has quit IRC | 11:07 | |
| *** bootsha has quit IRC | 11:08 | |
| *** stvnoyes has quit IRC | 11:08 | |
| *** bootsha has joined #openstack-kolla | 11:13 | |
| *** m3m0 has quit IRC | 11:15 | |
| *** rhallisey has joined #openstack-kolla | 11:17 | |
| Mech422 | narasimha_SV: sounds like the hostname has to be assigned to the api_interface address in /etc/hosts or dns | 11:20 |
| Mech422 | narasimha_SV: or more crudely, the api_interface has to be the 'main' interface of the machine ? | 11:21 |
| *** pbourke has quit IRC | 11:22 | |
| *** ppowell has joined #openstack-kolla | 11:23 | |
| *** pbourke has joined #openstack-kolla | 11:23 | |
| Mech422 | it looks like its reducing to hostvars['someMachine']['ansible_someMachine']['api_interface']['ipv4']['address'] | 11:24 |
| narasimha_SV | getent ahostsv4 <hostname> | 11:24 |
| narasimha_SV | I am able to get correct ip address of the host | 11:24 |
| narasimha_SV | my hostname is able to resolved with ip | 11:25 |
| Mech422 | narasimha_SV: is that ip address assocated with the api_interface interface ? | 11:25 |
| Mech422 | narasimha_SV: or is it on another interface ? | 11:25 |
| narasimha_SV | Mech422: are you talking about the value what I have given here to use for the endpoints "kolla_internal_vip_address" | 11:26 |
| narasimha_SV | here I am deploying multinode | 11:27 |
| narasimha_SV | so the value given kolla_internal_vip_address is the VIP which I am using | 11:27 |
| *** ayoung has quit IRC | 11:27 | |
| Mech422 | err...you should specify an api_interface in globals as well, IIRC | 11:28 |
| Mech422 | maybe its optional? but I specify it in my multi-node deployment | 11:29 |
| narasimha_SV | what is the importance of specifying this api_interface specification ? | 11:30 |
| Mech422 | narasimha_SV: I guess it tells kolla what _interface_ to use for the API endpoints in openstack | 11:30 |
| Mech422 | narasimha_SV: which is where the vips will be assigned | 11:31 |
| narasimha_SV | Mech422: but even if I see the default confugution again this is pointing to network_interface value only right ? | 11:32 |
| Mech422 | narasimha_SV: beats me - I don't use the defaults... Here's a snippet of my globals file: http://paste.openstack.org/show/526879/ | 11:34 |
| narasimha_SV | Mech422: even after specifying the api_interface | 11:35 |
| narasimha_SV | I am facing the same issue | 11:35 |
| Mech422 | narasimha_SV: I'm at a loss then... sorry | 11:35 |
| openstackgerrit | Merged openstack/kolla: Fix the overwrite sudoers file issue https://review.openstack.org/338701 | 11:39 |
| openstackgerrit | Merged openstack/kolla: Fix the overwrite sudoers file issue https://review.openstack.org/338702 | 11:40 |
| *** ayoung has joined #openstack-kolla | 11:40 | |
| Mech422 | narasimha_SV: Did you build from source ? or use the binaries ? | 11:41 |
| Mech422 | (and which distro are you using ?) | 11:41 |
| narasimha_SV | rabbitmq is from binary | 11:46 |
| *** ayoung has quit IRC | 11:48 | |
| Mech422 | narasimha_SV: in globals - what is kolla_base_distro and kolla_install_type ? | 11:48 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix the ubuntu binary on mitaka branch https://review.openstack.org/331420 | 11:49 |
| *** daneyon has joined #openstack-kolla | 11:51 | |
| *** coolsvap has quit IRC | 11:52 | |
| Mech422 | blah - 5 am... I'm gonna be knackered for work | 11:53 |
| Mech422 | G'nite guys :-) | 11:54 |
| *** daneyon has quit IRC | 11:55 | |
| *** bootsha has quit IRC | 11:58 | |
| *** ravig has joined #openstack-kolla | 11:59 | |
| *** tyrola has quit IRC | 12:23 | |
| *** tyrola has joined #openstack-kolla | 12:24 | |
| *** rhallisey has quit IRC | 12:25 | |
| *** rhallisey has joined #openstack-kolla | 12:25 | |
| *** rhallisey has quit IRC | 12:27 | |
| *** williamcaban has joined #openstack-kolla | 12:28 | |
| *** banix has joined #openstack-kolla | 12:32 | |
| *** tyrola has quit IRC | 12:36 | |
| *** bootsha has joined #openstack-kolla | 12:36 | |
| *** tyrola has joined #openstack-kolla | 12:37 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: implement Ansible Tempest role https://review.openstack.org/321522 | 12:38 |
| Daviey | Hi, anyone able to help me solve an ansible task change issue i'm having? | 12:40 |
| Daviey | Having an issue that doesn't make sense to me... testing a task in isolation does the right thing.. https://gist.github.com/Daviey/75487a494d9436f1997b87b891262829 (output as a comment at the bottom)... but when part of kolla seeing a different registered var. https://gist.github.com/Daviey/6538c85625fd5f39fdc3185f3d431efa .. Any pointers? | 12:44 |
| *** lrensing has joined #openstack-kolla | 12:49 | |
| *** stvnoyes has joined #openstack-kolla | 12:55 | |
| *** rhallisey has joined #openstack-kolla | 12:58 | |
| *** jtriley has joined #openstack-kolla | 13:04 | |
| *** sdake has joined #openstack-kolla | 13:07 | |
| Daviey | (Think i solved it) | 13:16 |
| openstackgerrit | Takeaki Matsumoto proposed openstack/kolla: Add enable_iscsi option to etc/kolla/globals.yml https://review.openstack.org/337571 | 13:18 |
| Daviey | sdake: Hey. Do you think that monitoring of kolla deployed services belongs in kolla itself? | 13:20 |
| *** fragatina has joined #openstack-kolla | 13:21 | |
| *** diogogmt has quit IRC | 13:21 | |
| *** sdake_ has joined #openstack-kolla | 13:23 | |
| *** diogogmt has joined #openstack-kolla | 13:26 | |
| *** sdake has quit IRC | 13:27 | |
| sdake_ | morning | 13:29 |
| sdake_ | Daviey somewhat loaded question | 13:30 |
| sdake_ | Daviey what do you want to monitor and wahat do you want to monitor with | 13:30 |
| sdake_ | Daviey my general tke is diagnostics and monitoring belong in kolla | 13:30 |
| *** prithiv has joined #openstack-kolla | 13:38 | |
| *** daneyon has joined #openstack-kolla | 13:39 | |
| *** diogogmt has quit IRC | 13:40 | |
| openstackgerrit | Dave Walker proposed openstack/kolla: Support Keystone Domain specific files https://review.openstack.org/339004 | 13:41 |
| openstackgerrit | Steven Dake proposed openstack/kolla: Test of gate mirroring https://review.openstack.org/339006 | 13:43 |
| *** daneyon has quit IRC | 13:44 | |
| openstackgerrit | Dave Walker proposed openstack/kolla: Support Keystone Domain specific files https://review.openstack.org/339004 | 13:45 |
| sdake_ | Daviey on https://review.openstack.org/#/c/339004/1/ansible/roles/keystone/tasks/config.yml | 13:45 |
| sdake_ | is it stat.exists or state.exists? | 13:45 |
| patchbot | sdake_: patch 339004 - kolla - Support Keystone Domain specific files | 13:45 |
| *** zhurong has joined #openstack-kolla | 13:47 | |
| *** inc0 has joined #openstack-kolla | 13:50 | |
| inc0 | good morning | 13:51 |
| narasimha_SV | anyone can help me in deploying rabbitmq cluster using kolla | 13:53 |
| narasimha_SV | after building the images what are the configurations I need to add in globals.yml or any other file to get rabbitmq cluster deployed in 2 hosts | 13:54 |
| inc0 | narasimha_SV, just rabbitmq cluster? | 13:56 |
| narasimha_SV | yes | 13:57 |
| narasimha_SV | I am able to have deploy keystone glance and other services | 13:57 |
| inc0 | ok so you need to follow normal multinode guide | 13:57 |
| narasimha_SV | but facing issue with rabbitmq cluster | 13:57 |
| inc0 | what's the issue? | 13:57 |
| narasimha_SV | inc0: erlang.cookie file has different content in rach host I deploy | 13:58 |
| *** wmiller has quit IRC | 13:58 | |
| *** wmiller has joined #openstack-kolla | 13:58 | |
| inc0 | that's strange, did you redeploy this on same nodes? | 13:58 |
| narasimha_SV | http://paste.openstack.org/raw/526970/ this check is failing | 13:58 |
| inc0 | ok | 13:59 |
| inc0 | I know what is it | 13:59 |
| narasimha_SV | please tell me how to fix this | 13:59 |
| inc0 | you need to be able to communicate between nodes with hostnames | 13:59 |
| inc0 | so add all of your hosts to /etc/hosts | 13:59 |
| inc0 | on every rabbitmq node | 13:59 |
| narasimha_SV | yes I am able to but with complete fqdn | 13:59 |
| inc0 | it has to resolve to api_interface address too | 14:00 |
| narasimha_SV | resolve api_interface address too mean . I didn't undersrand | 14:00 |
| narasimha_SV | controller1 - 192.168.56.101 controller2 - 192.168.56.102 VIP - 192.168.56.200 | 14:01 |
| narasimha_SV | these are ip details which I am using | 14:01 |
| inc0 | if you do: ping controller1 on both hosts | 14:01 |
| inc0 | and ping controller2 on both hosts | 14:01 |
| narasimha_SV | yes I am able to but it is like controller1.example.com | 14:02 |
| narasimha_SV | with fqdn | 14:02 |
| inc0 | it doesn't work this way with rabbit | 14:02 |
| inc0 | it has to use controller1 | 14:02 |
| inc0 | or whatever "hostname" command will show | 14:02 |
| narasimha_SV | it should be able to ping with hostname rather than fqdn ? | 14:02 |
| inc0 | yes | 14:02 |
| inc0 | ] | 14:02 |
| narasimha_SV | is that correct | 14:02 |
| narasimha_SV | ok thanks let me check one | 14:02 |
| narasimha_SV | once | 14:02 |
| narasimha_SV | Thanks for responding sooner | 14:05 |
| *** michauds has joined #openstack-kolla | 14:05 | |
| Daviey | sdake_: 'results': [{u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, ' | 14:11 |
| Daviey | sdake_: So stat, it seems | 14:12 |
| Daviey | sdake_: I was experimenting with deploying sensu (FOSS) in docker container.. along with the monitoring agent in a client docker container... I was going to do it separately.. but it seemed like it could be a good fit | 14:13 |
| Daviey | sdake_: You can measure things like, API response time.. and even using Heat to create instances and check the infra' is working. | 14:13 |
| sdake_ | Daviey works for me | 14:17 |
| *** prithiv has quit IRC | 14:25 | |
| *** inc0 has quit IRC | 14:30 | |
| Daviey | sdake_: It can't work globally if you have multiple domains | 14:31 |
| Daviey | Ie, CompanyA and CompanyB can't use the same LDAP server | 14:31 |
| *** diogogmt has joined #openstack-kolla | 14:32 | |
| *** ravig has quit IRC | 14:36 | |
| *** ravig has joined #openstack-kolla | 14:37 | |
| *** gfidente has quit IRC | 14:39 | |
| *** gfidente has joined #openstack-kolla | 14:39 | |
| *** stvnoyes has quit IRC | 14:39 | |
| *** stvnoyes1 has joined #openstack-kolla | 14:39 | |
| *** ravig has quit IRC | 14:39 | |
| *** ravig has joined #openstack-kolla | 14:40 | |
| *** stvnoyes1 has left #openstack-kolla | 14:41 | |
| sdake_ | Daviey isn't an openstack clodu single domain? | 14:42 |
| Daviey | sdake_: No.. That is why you can put a Domain name in the Horizon dashboard | 14:42 |
| *** salv-orlando has joined #openstack-kolla | 14:44 | |
| *** salv-orl_ has joined #openstack-kolla | 14:45 | |
| *** banix has quit IRC | 14:46 | |
| *** inc0 has joined #openstack-kolla | 14:48 | |
| *** ayoung has joined #openstack-kolla | 14:48 | |
| *** salv-orlando has quit IRC | 14:49 | |
| *** stvnoyes has joined #openstack-kolla | 14:50 | |
| sdake_ | i dont quite get the use cases | 14:54 |
| sdake_ | is this where two vendors share the same cloud? | 14:54 |
| sdake_ | Daviey dont mean to give yu a har time - just trying to learn from somenoe that knows :) | 14:55 |
| Daviey | sdake_: No, it's fine.. I appreciate it. :) | 14:58 |
| *** Serlex has left #openstack-kolla | 14:58 | |
| Daviey | sdake_: So i think it's pretty common even within a single company to have multiple login domains. | 14:58 |
| *** dave-mccowan has joined #openstack-kolla | 14:59 | |
| Daviey | sdake_: Here... I have an Infra LDAP server and a User LDAP server.. Infra is for backends | 14:59 |
| Daviey | sdake_: At another organisation, I had a Windows AD and a separate domain for Unix | 14:59 |
| *** ppowell has quit IRC | 14:59 | |
| Daviey | But the way I have left things, is that the 'default' domain is still SQL... but you can add on an LDAP server if you want | 15:00 |
| Daviey | sdake_: This is pretty good guide.. https://access.redhat.com/documentation/en/red-hat-openstack-platform/8/integrate-with-identity-service/chapter-1-active-directory-integration | 15:00 |
| *** banix has joined #openstack-kolla | 15:01 | |
| sdake_ | my question is more why it needs to be per node | 15:03 |
| Daviey | sdake_: Oh.. sorry.. it isn't per node.. It is global.. | 15:03 |
| Daviey | mkdir -p /etc/kolla/configs/keystone/domains/ | 15:04 |
| Daviey | echo $ACME_LDAP > /etc/kolla/configs/keystone/domains/keystone.ACME.conf | 15:04 |
| Daviey | echo $COMPANY_LDAP > /etc/kolla/configs/keystone/domains/keystone.COMPANY.conf | 15:04 |
| Daviey | It specifically ISN't custom config per-node | 15:04 |
| Daviey | I thought about adding that ability.. but then it seemed like a pointless thing.. and there is prior art of not supporting per-node for general things (saw some in nova) | 15:05 |
| sdake_ | i would think the ldap configuration even if there were more then one, would be global | 15:05 |
| sdake_ | the current code looks per node :) | 15:05 |
| Daviey | sdake_: Why do you say that? | 15:05 |
| Daviey | I mean, it doesn't support /etc/kolla/configs/keystone/${NODE}/domains/keystone.COMPANY.conf , if that is what you mean ? | 15:06 |
| *** stvnoyes has quit IRC | 15:09 | |
| *** stvnoyes has joined #openstack-kolla | 15:09 | |
| *** stvnoyes has quit IRC | 15:09 | |
| *** banix has quit IRC | 15:13 | |
| *** sdake_ has quit IRC | 15:13 | |
| *** sdake has joined #openstack-kolla | 15:14 | |
| *** zhurong has quit IRC | 15:15 | |
| *** banix has joined #openstack-kolla | 15:16 | |
| *** ravig has quit IRC | 15:17 | |
| *** ravig has joined #openstack-kolla | 15:17 | |
| *** vhosakot has joined #openstack-kolla | 15:20 | |
| *** ppowell has joined #openstack-kolla | 15:21 | |
| *** david-lyle__ has joined #openstack-kolla | 15:21 | |
| Daviey | sdake: ah, i see what you mean | 15:23 |
| Daviey | Oh no | 15:24 |
| *** david-lyle__ is now known as david-lyle | 15:24 | |
| *** daneyon has joined #openstack-kolla | 15:27 | |
| openstackgerrit | Dave Walker proposed openstack/kolla: Support Keystone Domain specific files https://review.openstack.org/339004 | 15:31 |
| *** daneyon has quit IRC | 15:32 | |
| openstackgerrit | Steven Dake proposed openstack/kolla: Test of gate mirroring https://review.openstack.org/339006 | 15:37 |
| openstackgerrit | Steven Dake proposed openstack/kolla: Test of gate mirroring https://review.openstack.org/339006 | 15:39 |
| *** ravig has quit IRC | 15:40 | |
| *** ravig has joined #openstack-kolla | 15:40 | |
| *** fragatina has quit IRC | 15:45 | |
| *** huikang has joined #openstack-kolla | 15:48 | |
| *** sdake has quit IRC | 15:48 | |
| *** jmccarthy has joined #openstack-kolla | 15:51 | |
| *** sdake has joined #openstack-kolla | 15:51 | |
| *** jmccarthy has left #openstack-kolla | 15:53 | |
| *** prithiv has joined #openstack-kolla | 15:53 | |
| *** bootsha has quit IRC | 15:57 | |
| Mech422 | Morning | 15:59 |
| *** ppowell has quit IRC | 16:03 | |
| *** bootsha has joined #openstack-kolla | 16:04 | |
| *** bootsha has quit IRC | 16:07 | |
| *** sdake has quit IRC | 16:09 | |
| *** sdake has joined #openstack-kolla | 16:20 | |
| Mech422 | inc0: Here's the bug on the permissions of /home/ansible from yesterdays build: https://bugs.launchpad.net/kolla/+bug/1599677 | 16:20 |
| openstack | Launchpad bug 1599677 in kolla "It appears the 'ansible' user in kolla-toolbox needs the home dir permissions changed" [Undecided,New] | 16:20 |
| *** mewald1 has quit IRC | 16:23 | |
| pbourke | does anyone have any heat templates they've been using lately? | 16:23 |
| *** ravig has quit IRC | 16:23 | |
| pbourke | (for kolla) | 16:23 |
| *** prithiv has quit IRC | 16:24 | |
| *** sdake has quit IRC | 16:25 | |
| *** ssurana has joined #openstack-kolla | 16:25 | |
| *** sdake has joined #openstack-kolla | 16:27 | |
| openstackgerrit | Dave Walker proposed openstack/kolla: Support Keystone Domain specific files https://review.openstack.org/339004 | 16:29 |
| *** mkoderer has quit IRC | 16:30 | |
| *** lmiccini has quit IRC | 16:30 | |
| *** haplo37_ has joined #openstack-kolla | 16:31 | |
| *** mkoderer has joined #openstack-kolla | 16:31 | |
| *** lmiccini has joined #openstack-kolla | 16:34 | |
| *** huikang has quit IRC | 16:37 | |
| *** huikang has joined #openstack-kolla | 16:37 | |
| rhallisey | kfox1111, ping | 16:38 |
| inc0 | pbourke, my friend created fresh tpls for aio | 16:39 |
| inc0 | not sure about our official ones | 16:39 |
| pbourke | inc0: our official docs should be removed | 16:39 |
| pbourke | I see someone commented on the bug around it saying they had something they were going to submit | 16:40 |
| pbourke | https://bugs.launchpad.net/kolla/+bug/1562334 | 16:40 |
| openstack | Launchpad bug 1562334 in kolla "heat development template out of date" [High,Confirmed] - Assigned to Darek Smigiel (smigiel-dariusz) | 16:40 |
| pbourke | anyone know who Darek is? | 16:40 |
| inc0 | Mech422, I just do ls -la in ansible toolbox and .ansible has 600 and owner is ansible | 16:40 |
| inc0 | so should be ok | 16:40 |
| inc0 | pbourke, my friend;) | 16:40 |
| inc0 | he sits right next to me | 16:41 |
| inc0 | brb | 16:41 |
| pbourke | ah! | 16:41 |
| *** huikang has quit IRC | 16:41 | |
| *** ravig has joined #openstack-kolla | 16:41 | |
| pbourke | he should submit whatever he has and we can build on it | 16:41 |
| *** huikang has joined #openstack-kolla | 16:41 | |
| *** unicell has quit IRC | 16:45 | |
| *** tyrola has quit IRC | 16:47 | |
| inc0 | dasm, pbourke you. talk;) | 16:50 |
| inc0 | dasm look what Paul wrote | 16:50 |
| pbourke | dasm: hi, you mentioned on a bug you might have some kolla heat templates? | 16:51 |
| dasm | pbourke: yes, i have. | 16:52 |
| dasm | pbourke: https://github.com/dasm/kolla-heat | 16:52 |
| *** huikang has quit IRC | 16:52 | |
| pbourke | awesome! | 16:52 |
| dasm | problem is that it's just initial draft, without support for multinode. | 16:52 |
| dasm | i do not have enough time to deal with this right now | 16:52 |
| pbourke | i'll have a look, we should put something initial into kolla and others will build on it | 16:52 |
| pbourke | that's what happened with vagrant | 16:53 |
| *** huikang has joined #openstack-kolla | 16:53 | |
| dasm | pbourke: fair enough. but something is already "there". | 16:53 |
| pbourke | our current heat stuff is ancient | 16:53 |
| dasm | with fedora implementation | 16:53 |
| dasm | yeah, i've seen it :) | 16:53 |
| *** huikang has quit IRC | 16:53 | |
| inc0 | I'd be ok with removing old one alltogether and replacing it with your stuff | 16:53 |
| *** huikang has joined #openstack-kolla | 16:53 | |
| dasm | if it's not a problem, then i can submit a patch to review. | 16:54 |
| inc0 | Mech422, soo...ansible perms | 16:54 |
| dasm | inc0: pbourke: but gimme some time to verify if latest change works as expected. | 16:54 |
| inc0 | can you do docker exec -it kolla_toolbox ls -la /home/ansible? | 16:54 |
| *** dwalsh has joined #openstack-kolla | 16:59 | |
| *** bootsha has joined #openstack-kolla | 17:00 | |
| *** mark-casey has joined #openstack-kolla | 17:02 | |
| *** ravig has quit IRC | 17:05 | |
| *** ravig has joined #openstack-kolla | 17:06 | |
| *** huikang has quit IRC | 17:07 | |
| *** huikang has joined #openstack-kolla | 17:07 | |
| *** ravig has quit IRC | 17:07 | |
| *** ravig has joined #openstack-kolla | 17:09 | |
| *** mewald1 has joined #openstack-kolla | 17:10 | |
| *** sdake has quit IRC | 17:11 | |
| *** ravig has quit IRC | 17:11 | |
| *** huikang has quit IRC | 17:12 | |
| inc0 | mewald1, just the person I need;) | 17:13 |
| inc0 | I'm trying to reproduce your bug | 17:13 |
| inc0 | which branch do you use? | 17:14 |
| *** unicell has joined #openstack-kolla | 17:19 | |
| Daviey | dasm: Using heat to deploy kolla? Hah. nice. I presume you've already tried to deploy kolla within a kolla deployed cloud? | 17:21 |
| mark-casey | is kolla-toolbox intended to be able to run build.py inside it? or just kolla-ansible? or have I fully misunderstood its purpose? | 17:22 |
| dasm | Daviey: nope :D | 17:22 |
| Daviey | dasm: That is the first thing i'd have done!!! | 17:22 |
| dasm | Daviey: but i used to use tripleo, so using openstack to deploy openstack :) | 17:22 |
| inc0 | mark-casey, you fully misunderstood purpose:P | 17:22 |
| Daviey | dasm: meh. That is old. I want a kolla cloud 3 levels deep | 17:22 |
| dasm | Daviey: xD | 17:22 |
| inc0 | kolla-toolbox is our way to do stuff like bootstapping and such | 17:23 |
| inc0 | it's has a lot of modules like shade or our own modules | 17:23 |
| inc0 | to do stuff | 17:23 |
| Daviey | inc0: Someone did talk about making a container for interacting, including all the python clients etc. | 17:23 |
| inc0 | right now it could probably be removed at some point, as shade is in ansible 2.0.0 | 17:23 |
| inc0 | we created toolbox back in 1.9.4 to have ansible 2.0.0+ in it;) | 17:24 |
| inc0 | Daviey, entirely possible, reasonable, not super high priority;) | 17:24 |
| inc0 | Daviey, you want kolla on kolla on kolla? KKK? that has some connotations in history you know | 17:25 |
| rhallisey | haah | 17:25 |
| rhallisey | KoK | 17:26 |
| inc0 | we already had docker in docker - dind | 17:26 |
| rhallisey | Daviey, I've done similar to what you're talking about, but I used tripleo's undercloud | 17:27 |
| *** mewald1 has quit IRC | 17:27 | |
| nihilifer | you definitely need kubernetes somewhere in between | 17:27 |
| nihilifer | and terraform | 17:27 |
| rhallisey | used heat + ironic to setup nodes then hand off to kolla | 17:27 |
| rhallisey | https://github.com/rthallisey/kolla-heat-templates | 17:27 |
| dasm | rhallisey: pretty impressive | 17:30 |
| rhallisey | dasm, if you setup your undercloud from here: http://tripleo.org/environments/environments.html#virtual-environment | 17:31 |
| rhallisey | clone that repo and deploy | 17:31 |
| *** mewald1 has joined #openstack-kolla | 17:31 | |
| *** sdake has joined #openstack-kolla | 17:32 | |
| dasm | rhallisey: i have a bad experience with tripleo, so i prefer to avoid this. | 17:32 |
| dasm | :) | 17:32 |
| inc0 | lol I remember that | 17:33 |
| *** ravig has joined #openstack-kolla | 17:33 | |
| dasm | inc0: :) | 17:33 |
| *** unicell has quit IRC | 17:33 | |
| *** unicell1 has joined #openstack-kolla | 17:33 | |
| *** sdake_ has joined #openstack-kolla | 17:34 | |
| *** daneyon has joined #openstack-kolla | 17:35 | |
| *** ravig has quit IRC | 17:35 | |
| *** ravig has joined #openstack-kolla | 17:35 | |
| mark-casey | inc0: thanks :) | 17:36 |
| *** sdake has quit IRC | 17:37 | |
| *** bootsha has quit IRC | 17:38 | |
| *** salv-orlando has joined #openstack-kolla | 17:38 | |
| *** daneyon_ has joined #openstack-kolla | 17:39 | |
| *** salv-orl_ has quit IRC | 17:39 | |
| *** daneyon has quit IRC | 17:41 | |
| *** bootsha has joined #openstack-kolla | 17:42 | |
| rhallisey | dasm, I can help if you have any questions | 17:42 |
| nihilifer | sdake_: ping | 17:43 |
| *** ravig has quit IRC | 17:43 | |
| *** bootsha has quit IRC | 17:47 | |
| *** ravig has joined #openstack-kolla | 17:47 | |
| *** ravig has quit IRC | 17:49 | |
| *** phuongnh has joined #openstack-kolla | 17:50 | |
| *** dwalsh has quit IRC | 17:53 | |
| *** inc0 has quit IRC | 17:53 | |
| *** ppowell has joined #openstack-kolla | 17:54 | |
| *** salv-orlando has quit IRC | 17:55 | |
| *** mewald1 has left #openstack-kolla | 17:56 | |
| *** sdake_ has quit IRC | 17:57 | |
| *** salv-orlando has joined #openstack-kolla | 17:58 | |
| *** aNupoisc has joined #openstack-kolla | 17:59 | |
| *** huikang has joined #openstack-kolla | 17:59 | |
| aNupoisc | Hi guys, I am getting weird ssh error "Shared connection to x.x.x.x closed" on running kolla-ansible prechecks | 18:00 |
| aNupoisc | though i can ssh x.x.x.x from the shell | 18:01 |
| aNupoisc | can anyone please help me with this | 18:01 |
| aNupoisc | here is the error http://pastebin.com/CsSRxerA | 18:02 |
| aNupoisc | i did googled and tried setting ssh_args in ansible.cfg, StrictKeyHostOption no but still getting the same error. | 18:03 |
| *** huikang has quit IRC | 18:03 | |
| *** david-lyle has quit IRC | 18:04 | |
| *** david-lyle has joined #openstack-kolla | 18:06 | |
| *** daneyon_ has quit IRC | 18:09 | |
| *** dwalsh has joined #openstack-kolla | 18:09 | |
| *** daneyon has joined #openstack-kolla | 18:10 | |
| *** aNupoisc has quit IRC | 18:14 | |
| *** daneyon has quit IRC | 18:15 | |
| *** shardy has quit IRC | 18:17 | |
| *** ravig has joined #openstack-kolla | 18:18 | |
| *** ravig has quit IRC | 18:18 | |
| *** aNupoisc has joined #openstack-kolla | 18:20 | |
| aNupoisc | Hi cinerama | 18:22 |
| cinerama | hey aNupoisc | 18:22 |
| aNupoisc | i had one quick question | 18:23 |
| aNupoisc | I am getting weird ssh error "Shared connection to x.x.x.x closed" on running kolla-ansible prechecks | 18:24 |
| aNupoisc | though i can ssh x.x.x.x from the shell | 18:24 |
| aNupoisc | here is the error http://pastebin.com/CsSRxerA | 18:24 |
| aNupoisc | can you give a look at it please | 18:24 |
| cinerama | i see from earlier. i'm kind of missing some context | 18:24 |
| aNupoisc | wait i will post all | 18:25 |
| mark-casey | aNupoisc: what task is running when this happens? | 18:25 |
| mark-casey | oh | 18:25 |
| mark-casey | lol | 18:25 |
| aNupoisc | this might help http://pastebin.com/sZJ2UY7r | 18:26 |
| aNupoisc | hi mark-casey, i am running prechecks.yml | 18:26 |
| mark-casey | aNupoisc: cool. which precheck is running when this happens? | 18:27 |
| aNupoisc | it is failing on " Checking free port for Cinder API HAProxy" | 18:28 |
| aNupoisc | mark-casey | 18:28 |
| aNupoisc | i have added ssh_args in ansible.cfg | 18:28 |
| mark-casey | aNupoisc: how long do you have to wait after the task starts before you get the error? as soon as that precheck task starts or after several minutes? | 18:29 |
| aNupoisc | mark-casey: not immediately after the task starts but sooner | 18:30 |
| aNupoisc | after that | 18:30 |
| aNupoisc | it passes 1 precheck before failing | 18:30 |
| aNupoisc | of "Checking free port for Cinder APi" - this is getting passed | 18:31 |
| *** britthouser has quit IRC | 18:31 | |
| mark-casey | aNupoisc: a little unclear on that. So prechecks start, 1 precheck passes, then you see the output "Checking free port for Cinder APi"? If so, how long after that do you get the error? | 18:34 |
| aNupoisc | mark-casey: so first precheck is "Checking free port for Cinder API" which gets passed for all nodes immediately after that is the precheck "Checking free port for CInder API HAproxy" which is failing | 18:36 |
| *** banix has quit IRC | 18:38 | |
| *** banix has joined #openstack-kolla | 18:38 | |
| aNupoisc | here is the complete error http://pastebin.com/NRUcmXyD | 18:40 |
| aNupoisc | mark-casey: do you think i need to alter some options in ssh_config | 18:40 |
| mark-casey | aNupoisc: ok. so I'm wondering how long it tries/waits on the task that is failing? When I've seen "shared connection closed" in the past (outside of Kolla) it was an odd variant of an ssh timeout (it says the connection is shared because it is using controlpersist). It should not take several minutes to determine "Checking free port for CInder API HAproxy" | 18:41 |
| *** vhosakot has quit IRC | 18:41 | |
| aNupoisc | mark-casey: yes it fails pretty soon | 18:42 |
| *** vhosakot has joined #openstack-kolla | 18:42 | |
| *** vhosakot has quit IRC | 18:43 | |
| aNupoisc | mark-casey: i mean it gets halted on that failing task and i am pressing ctrl+c and get this error | 18:43 |
| mark-casey | aNupoisc: very strange. what version of Ansible/kolla? | 18:43 |
| *** vhosakot has joined #openstack-kolla | 18:43 | |
| mark-casey | aNupoisc: halted? | 18:43 |
| *** bootsha has joined #openstack-kolla | 18:43 | |
| mark-casey | like it is just sitting there on that task? | 18:43 |
| aNupoisc | yes | 18:44 |
| mark-casey | https://support.ansible.com/hc/en-us/articles/201957917-How-do-I-get-ansible-to-reuse-connections-enable-Kerberized-SSH-or-have-Ansible-pay-attention-to-my-local-SSH-config-file- | 18:44 |
| aNupoisc | if i don't press ctrl+c it says "Timeout when waiting for 172.16.2.203:8776 to stop" | 18:44 |
| aNupoisc | 2.203 is my kolla_internal_address | 18:45 |
| aNupoisc | mark-casey: my ansible is 1.9.4 | 18:45 |
| *** gfidente has quit IRC | 18:45 | |
| *** bootsha has quit IRC | 18:48 | |
| aNupoisc | mark-casey: so ssh will be used by default in my case as my ansible is 1.9.4 | 18:49 |
| mark-casey | aNupoisc: you'll use the newer options with ControlPersist unless you're on a platform that can't do it like early EL6. There is an option to specify in ansible.cfg. | 18:52 |
| mark-casey | aNupoisc: first though... can you ping 2.203 right now? | 18:52 |
| aNupoisc | mark-casey: yes i can ping 2.203 | 18:52 |
| aNupoisc | from those machines as well | 18:52 |
| *** huikang has joined #openstack-kolla | 18:53 | |
| mark-casey | IIRC if 2.203 responds it means some components from a past deploy are still running, like haproxy. is that possible? this would mean that the precheck is waiting for the port to be free but it doesn't get free because haproxy has it open. when you ctrl+c the precheck "shared connection closed" is just noise/not relevant error you get during ansible's teardown | 18:54 |
| mark-casey | aNupoisc: ^ | 18:54 |
| aNupoisc | mark-casey: hold on but 8776 is that port for cinder | 18:54 |
| aNupoisc | ? | 18:54 |
| aNupoisc | because i did not pinged 172.16.2.203:8776, i tried pinging just 172.16.2.203 | 18:55 |
| aNupoisc | mark-casey: ahh interesting | 18:56 |
| mark-casey | aNupoisc: you could try to nmap for that port or something but AFAIK if you can ping the internal address when you're trying to deploy part of your last deploy (keepalived/haproxy) is still running and getting in the way | 18:56 |
| aNupoisc | mark-casey: so i need to see what process is using 8776 port | 18:56 |
| aNupoisc | is that correct? | 18:56 |
| mark-casey | aNupoisc: yes. there are cleanup steps for images and containers that you'll need to run if you haven | 18:56 |
| mark-casey | *t | 18:57 |
| aNupoisc | i ran cleanup-containers and cleanup-images | 18:57 |
| aNupoisc | but yeah. let me do the cleanup again | 18:57 |
| Mech422 | aNupoisc: that leaves the VIP hanging around too | 18:57 |
| Mech422 | aNupoisc: that causes the pre-check to fail for me | 18:58 |
| *** vhosakot has quit IRC | 18:58 | |
| aNupoisc | Mech422: ahh | 18:58 |
| mark-casey | Mech422: so then is the issue that cleanup isn't working? | 18:58 |
| *** huikang has quit IRC | 18:59 | |
| aNupoisc | mark-casey: Mech422: yeah that might be the case, let me clean everything. Actually i had spun some VMs and forgot to remove that before running cleanup-containers and cleanup-images | 18:59 |
| aNupoisc | mark-casey: Mech422: is there a way to check if VIP is hanging? | 19:00 |
| mark-casey | aNupoisc: is this multinode or all-in-one? can you run docker ps' | 19:01 |
| mark-casey | *'docker ps' on all nodes? | 19:01 |
| aNupoisc | mark-casey: Mech422: yes i can see "tcp 172.16.2.203:8776 0.0.0.0:* LISTEN 5416/haproxy" | 19:02 |
| aNupoisc | on that node | 19:02 |
| aNupoisc | mark-casey: it is multinode | 19:02 |
| aNupoisc | mark-casey: Mech422: seems the node is listening on that port | 19:03 |
| aNupoisc | and also when i do docker ps i can see many containers on that node | 19:03 |
| mark-casey | aNupoisc: ah. did you run cleanup on the host that runs kolla-ansible or on the nodes themselves? | 19:05 |
| aNupoisc | i ran cleanup on the host where i was running kolla-ansible | 19:06 |
| *** bootsha has joined #openstack-kolla | 19:06 | |
| aNupoisc | but seems that did not cleaned up all the containers | 19:06 |
| *** bootsha has quit IRC | 19:06 | |
| mark-casey | aNupoisc: that is probably it. the cleanups have to be run on all nodes. For a "stock/standard-ish" multinode deploy you can use ansible's script module to push the scripts to the nodes and run them. one sec | 19:06 |
| mark-casey | ansible -i /usr/local/share/kolla/ansible/inventory/multinode -m script -a '/kolla/tools/cleanup-containers' all | 19:07 |
| mark-casey | that would be run on the deployer host where you run kolla-ansible and will push that script over and run it. the option for -a refers to the path to the script on the deployer | 19:07 |
| aNupoisc | mark-casey: ah. yeah i did not thought of this. Yes i had cleanup-containers file only on the host where i was running kolla-ansible | 19:08 |
| *** athomas has quit IRC | 19:08 | |
| aNupoisc | mark-casey: cool. i will run this | 19:08 |
| aNupoisc | mark-casey: what does -m do | 19:09 |
| Mech422 | mark-casey: the cleanup's 'work' - they just don't clean everything | 19:09 |
| mark-casey | aNupoisc: cool. -m is module. i.e.: "I want to run the script module on these hosts" | 19:09 |
| mark-casey | aNupoisc: do one for cleanup-images oo | 19:09 |
| mark-casey | (too | 19:09 |
| mark-casey | Mech422: I see | 19:09 |
| aNupoisc | mark-casey: okay great | 19:10 |
| aNupoisc | Mech422: ah gotcha | 19:10 |
| Mech422 | mark-casey: I can submit a patch when I get a minute - for now, I just ignore pre-check 'vip' failure during re-deploys | 19:10 |
| aNupoisc | mark-casey: so by pointing correct files using -i and -a i would be able to push and run the script on all target nodes | 19:11 |
| *** vhosakot has joined #openstack-kolla | 19:12 | |
| aNupoisc | mark-casey: do we need to specify the path where the scripts would be pushed on the target nodes? | 19:12 |
| *** salv-orlando has quit IRC | 19:12 | |
| mark-casey | aNupoisc: correct. and no you don't have to. there may be an option to but you can just let it run out of the default (somewhere in the target hosts tempdir) | 19:13 |
| aNupoisc | mark-casey: okay. | 19:13 |
| aNupoisc | mark-casey: thanks a ton Mech422 | 19:14 |
| mark-casey | aNupoisc: the user ansible connects to the target hosts with has to have permissions to do what is in the script. but generally if kolla-ansible is working so will this | 19:14 |
| aNupoisc | mark-casey Mech422: will try that and see | 19:14 |
| mark-casey | aNupoisc: sure thing | 19:14 |
| *** narasimha_SV has quit IRC | 19:17 | |
| *** bootsha has joined #openstack-kolla | 19:25 | |
| *** bootsha has quit IRC | 19:30 | |
| *** Jeffrey4l_ has quit IRC | 19:31 | |
| *** Jeffrey4l_ has joined #openstack-kolla | 19:31 | |
| aNupoisc | mark-casey: all containers and images are cleaned | 19:33 |
| aNupoisc | do i need to reboot those nodes | 19:33 |
| *** vhosakot has quit IRC | 19:33 | |
| *** ravig has joined #openstack-kolla | 19:37 | |
| mark-casey | aNupoisc: no | 19:41 |
| *** huikang has joined #openstack-kolla | 19:42 | |
| *** vhosakot has joined #openstack-kolla | 19:49 | |
| *** daneyon has joined #openstack-kolla | 19:58 | |
| *** godleon has joined #openstack-kolla | 20:00 | |
| *** daneyon has quit IRC | 20:03 | |
| *** huikang has quit IRC | 20:10 | |
| *** huikang has joined #openstack-kolla | 20:10 | |
| *** michauds has quit IRC | 20:11 | |
| *** michauds has joined #openstack-kolla | 20:12 | |
| *** aNupoisc has quit IRC | 20:14 | |
| *** huikang has quit IRC | 20:15 | |
| *** vhosakot has quit IRC | 20:17 | |
| *** bootsha has joined #openstack-kolla | 20:25 | |
| *** bootsha has quit IRC | 20:25 | |
| *** bootsha has joined #openstack-kolla | 20:25 | |
| *** lrensing has quit IRC | 20:26 | |
| *** dwalsh has quit IRC | 20:30 | |
| *** dwalsh has joined #openstack-kolla | 20:32 | |
| *** banix has quit IRC | 20:32 | |
| *** williamcaban has quit IRC | 20:35 | |
| *** jtriley has quit IRC | 20:36 | |
| *** huikang has joined #openstack-kolla | 20:39 | |
| *** bootsha has quit IRC | 20:40 | |
| *** ppowell has quit IRC | 20:40 | |
| *** salv-orlando has joined #openstack-kolla | 20:44 | |
| *** huikang has quit IRC | 20:44 | |
| *** salv-orlando has quit IRC | 20:46 | |
| *** salv-orlando has joined #openstack-kolla | 20:46 | |
| *** banix has joined #openstack-kolla | 20:48 | |
| *** bootsha has joined #openstack-kolla | 20:52 | |
| *** aNupoisc has joined #openstack-kolla | 20:53 | |
| *** fragatina has joined #openstack-kolla | 20:56 | |
| *** michauds has quit IRC | 21:03 | |
| *** michauds has joined #openstack-kolla | 21:06 | |
| *** ravig has quit IRC | 21:09 | |
| openstackgerrit | Dave Walker proposed openstack/kolla: Support Keystone Domain specific files https://review.openstack.org/339004 | 21:11 |
| *** ravig has joined #openstack-kolla | 21:17 | |
| *** david-lyle has quit IRC | 21:21 | |
| *** haplo37_ has quit IRC | 21:22 | |
| *** david-lyle has joined #openstack-kolla | 21:23 | |
| *** bootsha has quit IRC | 21:27 | |
| *** huikang has joined #openstack-kolla | 21:33 | |
| *** ayoung has quit IRC | 21:34 | |
| *** ozialien10 has joined #openstack-kolla | 21:35 | |
| *** huikang has quit IRC | 21:38 | |
| aNupoisc | mark-casey: yes i cleaned up all and after re-running prechecks it is failing at "Checking free port for iSCSI Target" task | 21:39 |
| *** diogogmt has quit IRC | 21:40 | |
| aNupoisc | mark-casey: i am looking at what process is using 3260, i am asumming that is the iscsi port used | 21:40 |
| *** ravig has quit IRC | 21:41 | |
| *** banix has quit IRC | 21:42 | |
| *** rhallisey has quit IRC | 21:42 | |
| *** huikang has joined #openstack-kolla | 21:46 | |
| *** diogogmt has joined #openstack-kolla | 21:47 | |
| *** williamcaban has joined #openstack-kolla | 21:52 | |
| *** michauds has quit IRC | 21:53 | |
| *** williamcaban has quit IRC | 22:02 | |
| *** banix has joined #openstack-kolla | 22:04 | |
| *** ravig has joined #openstack-kolla | 22:05 | |
| aNupoisc | mark-casey: seems no process is using iscsi port | 22:06 |
| aNupoisc | strange but it is failing on that precheck | 22:07 |
| openstackgerrit | Dave Walker proposed openstack/kolla: Support Keystone Domain specific files https://review.openstack.org/339004 | 22:07 |
| *** david-lyle has quit IRC | 22:07 | |
| *** ravig has quit IRC | 22:08 | |
| *** dwalsh has quit IRC | 22:14 | |
| *** jascott1 has joined #openstack-kolla | 22:16 | |
| *** ozialien10 has quit IRC | 22:22 | |
| *** salv-orlando has quit IRC | 22:30 | |
| *** sean-k-m1 has joined #openstack-kolla | 22:32 | |
| *** salv-orlando has joined #openstack-kolla | 22:34 | |
| *** sean-k-mooney has quit IRC | 22:34 | |
| aNupoisc | Hi Mech422: after cleaning i can see the prechecks failing at "checking free port for iscsi target" but i don't see any process using the port 3260 | 22:36 |
| aNupoisc | Mech422: also no containers or images are up on the target nodes. | 22:39 |
| *** salv-orlando has quit IRC | 22:39 | |
| *** jascott1_ has joined #openstack-kolla | 22:40 | |
| *** jascott1 has quit IRC | 22:41 | |
| *** banix has quit IRC | 22:49 | |
| *** huikang has quit IRC | 22:52 | |
| *** huikang has joined #openstack-kolla | 22:52 | |
| *** zhurong has joined #openstack-kolla | 22:53 | |
| *** huikang has quit IRC | 22:56 | |
| *** salv-orlando has joined #openstack-kolla | 23:01 | |
| *** unicell1 has quit IRC | 23:04 | |
| *** unicell has joined #openstack-kolla | 23:05 | |
| *** salv-orlando has quit IRC | 23:09 | |
| *** vhosakot has joined #openstack-kolla | 23:16 | |
| *** Mech422 has quit IRC | 23:20 | |
| openstackgerrit | Ken Wronkiewicz proposed openstack/kolla: Fix interface address for RabbitMQ and disable cluster for Kubernetes https://review.openstack.org/336751 | 23:26 |
| *** wmiller has quit IRC | 23:30 | |
| openstackgerrit | Ken Wronkiewicz proposed openstack/kolla-kubernetes: Split RabbitMQ management and service ports https://review.openstack.org/339273 | 23:31 |
| *** wmiller has joined #openstack-kolla | 23:32 | |
| *** salv-orlando has joined #openstack-kolla | 23:35 | |
| *** ayoung has joined #openstack-kolla | 23:36 | |
| openstackgerrit | David Wang proposed openstack/kolla-kubernetes: Refactored service_definition.py into service_resources.yaml https://review.openstack.org/339276 | 23:39 |
| *** fragatina has quit IRC | 23:40 | |
| *** diogogmt has quit IRC | 23:46 | |
| *** salv-orlando has quit IRC | 23:47 | |
| openstackgerrit | Merged openstack/kolla-kubernetes: Split RabbitMQ management and service ports https://review.openstack.org/339273 | 23:52 |
| *** jtriley has joined #openstack-kolla | 23:53 | |
| *** diogogmt has joined #openstack-kolla | 23:54 | |
| *** zhurong has quit IRC | 23:57 | |
| *** vhosakot has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!