| *** sacharya has quit IRC | 00:01 | |
| openstackgerrit | Kevin Carter proposed openstack/openstack-ansible: Updated the py_pkgs lookup plugin for multi source https://review.openstack.org/241483 | 00:12 |
|---|---|---|
| cloudnull | ^ sorry again for the spam, found a potential issue where a role package may not be udated in a local override case when using multi-source and would effect the pre-built venvs. I added in a small bit to take care of that too | 00:13 |
| *** BjoernT has quit IRC | 00:13 | |
| cloudnull | stevelle: odyssey4me ^ | 00:13 |
| *** mss_ has quit IRC | 00:17 | |
| *** baker has joined #openstack-ansible | 00:21 | |
| cloudnull | kysse: so the replication is not staying in sync ? | 00:26 |
| kysse | nope | 00:29 |
| openstackgerrit | Kevin Carter proposed openstack/openstack-ansible: Fix neutron issue w/ l2pop https://review.openstack.org/252100 | 00:33 |
| cloudnull | anything in the logs? | 00:33 |
| cloudnull | network partitioning ? | 00:33 |
| cloudnull | storage constraints ? | 00:33 |
| cloudnull | how many containers for galera? | 00:34 |
| cloudnull | does the issue happen on vip failover or is it more it just dies ? | 00:35 |
| *** eil397 has quit IRC | 00:36 | |
| cloudnull | im out, back online later. | 00:36 |
| *** sacharya has joined #openstack-ansible | 01:02 | |
| *** sacharya has quit IRC | 01:07 | |
| *** mss has joined #openstack-ansible | 01:12 | |
| *** markvoelker has quit IRC | 01:23 | |
| *** rebase_ has quit IRC | 01:28 | |
| openstackgerrit | Merged openstack/openstack-ansible: Use PyPi packages for ceph python bindings https://review.openstack.org/245154 | 01:35 |
| openstackgerrit | Merged openstack/openstack-ansible: Add documentation for HA ceilometer https://review.openstack.org/252651 | 01:35 |
| *** mancdaz has quit IRC | 01:39 | |
| *** mancdaz has joined #openstack-ansible | 01:40 | |
| *** tlian2 has joined #openstack-ansible | 02:02 | |
| *** tlian has quit IRC | 02:04 | |
| *** rebase_ has joined #openstack-ansible | 02:32 | |
| *** rebase_ has quit IRC | 02:35 | |
| kysse | is there some kinda hard limit vms per host? | 02:46 |
| kysse | I'm only able to launch 17. | 02:47 |
| kysse | to one host | 02:47 |
| Sam-I-Am | its based on resource limits in the scheduler rules | 02:47 |
| Sam-I-Am | not specifically a hard limit, but a combination of resources adding up | 02:47 |
| kysse | ok, thanks | 02:48 |
| *** sacharya has joined #openstack-ansible | 03:04 | |
| cloudnull | kysse: check out http://docs.openstack.org/openstack-ops/content/compute_nodes.html specifically the Overcommitting section | 03:16 |
| kysse | ah, thanks. Got2check that mysql error tomorrow, I'll provide those informations if I can not fix it myself. | 03:25 |
| *** fawadkhaliq has joined #openstack-ansible | 03:32 | |
| *** rebase_ has joined #openstack-ansible | 03:36 | |
| *** rebase_ has quit IRC | 03:37 | |
| *** baker has quit IRC | 03:38 | |
| *** shausy has joined #openstack-ansible | 03:46 | |
| *** cemmason has joined #openstack-ansible | 03:47 | |
| coolj | kysse: i missed your comments earlier, so dunno if this is what you're seeing, but if you have members not joining the cluster, check for /tmp/percona-version-check in the galera containers and delete it if present, then restart mysql and members should join the cluster and sync. | 03:54 |
| *** cemmason has quit IRC | 04:00 | |
| *** shausy has quit IRC | 04:00 | |
| *** cemmason has joined #openstack-ansible | 04:01 | |
| *** sacharya has quit IRC | 04:31 | |
| *** galstrom_zzz is now known as galstrom | 04:32 | |
| *** linggao has quit IRC | 04:36 | |
| *** sacharya has joined #openstack-ansible | 04:37 | |
| *** hybridpollo has quit IRC | 04:41 | |
| *** fawadkhaliq has quit IRC | 04:50 | |
| *** tlian2 has quit IRC | 04:56 | |
| *** markvoelker has joined #openstack-ansible | 05:25 | |
| *** fawadkhaliq has joined #openstack-ansible | 05:27 | |
| *** markvoelker_ has joined #openstack-ansible | 05:28 | |
| *** shausy has joined #openstack-ansible | 05:30 | |
| *** markvoelker has quit IRC | 05:30 | |
| *** markvoelker has joined #openstack-ansible | 05:31 | |
| *** markvoelker_ has quit IRC | 05:34 | |
| *** markvoelker_ has joined #openstack-ansible | 05:38 | |
| *** markvoelker has quit IRC | 05:38 | |
| *** markvoelker_ has quit IRC | 05:51 | |
| *** sirushti has quit IRC | 06:01 | |
| *** sirushti has joined #openstack-ansible | 06:01 | |
| *** sacharya_ has joined #openstack-ansible | 06:05 | |
| *** sacharya has quit IRC | 06:06 | |
| *** galstrom is now known as galstrom_zzz | 06:10 | |
| *** phiche has joined #openstack-ansible | 06:27 | |
| *** sacharya_ has quit IRC | 06:28 | |
| *** sdake has quit IRC | 06:28 | |
| *** targon has joined #openstack-ansible | 06:30 | |
| *** markvoelker has joined #openstack-ansible | 06:50 | |
| *** markvoelker has quit IRC | 06:55 | |
| *** mss has quit IRC | 06:57 | |
| *** javeriak has joined #openstack-ansible | 07:00 | |
| *** phiche has quit IRC | 07:06 | |
| openstackgerrit | Merged openstack/openstack-ansible: Added ceilometer-polling upstart jobs https://review.openstack.org/249881 | 07:09 |
| *** javeriak has quit IRC | 07:10 | |
| *** javeriak has joined #openstack-ansible | 07:10 | |
| *** phiche has joined #openstack-ansible | 07:15 | |
| *** javeriak_ has joined #openstack-ansible | 07:16 | |
| *** javeriak has quit IRC | 07:16 | |
| *** sdake has joined #openstack-ansible | 07:24 | |
| *** fawadkhaliq has quit IRC | 07:39 | |
| *** fawadkhaliq has joined #openstack-ansible | 07:39 | |
| *** sacharya has joined #openstack-ansible | 07:44 | |
| *** sacharya has quit IRC | 07:48 | |
| *** fawadkhaliq has quit IRC | 07:50 | |
| *** fawadkhaliq has joined #openstack-ansible | 07:53 | |
| *** fawadkhaliq has quit IRC | 07:57 | |
| *** shausy has quit IRC | 07:59 | |
| *** shausy has joined #openstack-ansible | 08:00 | |
| *** fawadkhaliq has joined #openstack-ansible | 08:05 | |
| *** fawadk has joined #openstack-ansible | 08:07 | |
| *** fawadkhaliq has quit IRC | 08:08 | |
| *** elo has quit IRC | 08:12 | |
| *** adaccada has joined #openstack-ansible | 08:24 | |
| *** markvoelker has joined #openstack-ansible | 08:25 | |
| *** javeriak_ has quit IRC | 08:27 | |
| *** fawadk has quit IRC | 08:28 | |
| *** fawadkhaliq has joined #openstack-ansible | 08:29 | |
| *** mpavone has joined #openstack-ansible | 08:29 | |
| *** markvoelker has quit IRC | 08:30 | |
| *** sdake has quit IRC | 08:36 | |
| *** egonzalez has joined #openstack-ansible | 08:37 | |
| *** javeriak has joined #openstack-ansible | 08:41 | |
| *** tiagogomes has joined #openstack-ansible | 08:47 | |
| *** mss has joined #openstack-ansible | 08:53 | |
| *** javeriak has quit IRC | 09:04 | |
| *** cemmason has quit IRC | 09:13 | |
| *** cemmason has joined #openstack-ansible | 09:13 | |
| *** sdake has joined #openstack-ansible | 09:16 | |
| *** javeriak has joined #openstack-ansible | 09:24 | |
| *** cemmason has quit IRC | 09:26 | |
| *** cemmason has joined #openstack-ansible | 09:26 | |
| *** sdake has quit IRC | 09:49 | |
| *** permalac has joined #openstack-ansible | 09:50 | |
| *** sdake has joined #openstack-ansible | 09:58 | |
| *** fawadkhaliq has quit IRC | 10:00 | |
| *** fawadkhaliq has joined #openstack-ansible | 10:00 | |
| *** javeriak has quit IRC | 10:04 | |
| *** marekd has quit IRC | 10:05 | |
| *** gparaskevas has joined #openstack-ansible | 10:05 | |
| *** sdake has quit IRC | 10:07 | |
| *** marekd has joined #openstack-ansible | 10:13 | |
| *** shausy has quit IRC | 10:15 | |
| *** shausy has joined #openstack-ansible | 10:15 | |
| *** marekd has quit IRC | 10:15 | |
| *** marekd has joined #openstack-ansible | 10:16 | |
| odyssey4me | mattt this may resolve the virt_type issue that you saw earlier this week: https://review.openstack.org/252426 | 10:20 |
| odyssey4me | mattt this may also apply if you were doing a multinode setup: https://review.openstack.org/252100 | 10:21 |
| *** mgoddard has joined #openstack-ansible | 10:22 | |
| *** markvoelker has joined #openstack-ansible | 10:26 | |
| mattt | odyssey4me: yeah i suspect so! | 10:30 |
| *** markvoelker has quit IRC | 10:31 | |
| *** andyhky` has joined #openstack-ansible | 11:02 | |
| *** andyhky has quit IRC | 11:03 | |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Added ceilometer-polling upstart jobs https://review.openstack.org/249946 | 11:27 |
| odyssey4me | o/ all | 11:35 |
| odyssey4me | kysse when you're in, can you please add review feedback to https://review.openstack.org/252100 to indicate whether this is working for you? | 11:35 |
| odyssey4me | alextricity when you're in, can you also please provide feedback in https://review.openstack.org/252100 regarding whether it resolves the issues that you were seeing | 11:36 |
| *** tlian has joined #openstack-ansible | 11:36 | |
| *** sacharya has joined #openstack-ansible | 11:47 | |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts: Added to ability to set mtu for lxcbr0 https://review.openstack.org/252489 | 11:48 |
| *** sacharya has quit IRC | 11:51 | |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Enable Neutron prevent_arp_spoofing by default https://review.openstack.org/252574 | 11:52 |
| odyssey4me | evrardjp please backport https://review.openstack.org/252489 to liberty when you get the chance | 11:54 |
| odyssey4me | hughsaunders andymccr any chance for a review on https://review.openstack.org/252426 ? | 11:55 |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Convert AIO bootstrap from bash to Ansible https://review.openstack.org/239525 | 12:06 |
| odyssey4me | mancdaz did you see alextricity's review on https://review.openstack.org/252416 ? | 12:08 |
| mancdaz | odyssey4me I did, going to update the review today | 12:08 |
| *** fawadkhaliq has quit IRC | 12:15 | |
| *** fawadkhaliq has joined #openstack-ansible | 12:16 | |
| openstackgerrit | Merged openstack/openstack-ansible: Updated the py_pkgs lookup plugin for multi source https://review.openstack.org/241483 | 12:16 |
| odyssey4me | any volunteers to backport https://review.openstack.org/241483 to liberty? | 12:17 |
| openstackgerrit | Darren Birkett proposed openstack/openstack-ansible: turn neutron notifications off by default https://review.openstack.org/252416 | 12:20 |
| *** jaypipes has joined #openstack-ansible | 12:25 | |
| *** markvoelker has joined #openstack-ansible | 12:27 | |
| *** markvoelker has quit IRC | 12:32 | |
| *** openstackgerrit has quit IRC | 12:32 | |
| *** openstackgerrit has joined #openstack-ansible | 12:33 | |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Minor corrections to documentation https://review.openstack.org/252926 | 12:38 |
| mhayden | morning | 12:58 |
| *** openstackgerrit has quit IRC | 13:17 | |
| *** openstackgerrit has joined #openstack-ansible | 13:17 | |
| *** markvoelker has joined #openstack-ansible | 13:28 | |
| openstackgerrit | Merged openstack/openstack-ansible: Fix nova_virt_type auto-detection https://review.openstack.org/252426 | 13:30 |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Fix nova_virt_type auto-detection https://review.openstack.org/252953 | 13:31 |
| *** ctina_ has joined #openstack-ansible | 13:32 | |
| *** markvoelker has quit IRC | 13:32 | |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Convert AIO bootstrap from bash to Ansible https://review.openstack.org/239525 | 13:35 |
| odyssey4me | mhayden how would you like to back port https://review.openstack.org/241483 to liberty? :) | 13:38 |
| odyssey4me | s/how// :) | 13:38 |
| mhayden | oh wow | 13:38 |
| mhayden | i was attempting to review that earlier this week | 13:38 |
| mhayden | odyssey4me: i assume this isn't a straight cherry pick | 13:40 |
| odyssey4me | sc68cal Sam-I-Am for the sake of being thorough, I did a recheck on https://review.openstack.org/252574 and boom - brokenness... see the non-voting check result | 13:40 |
| odyssey4me | mhayden it may be, haven't tried it | 13:40 |
| *** Bjoern_ has joined #openstack-ansible | 13:41 | |
| mhayden | odyssey4me: i'll take it in exchange for help on these security reviews ;) | 13:42 |
| mhayden | mattt's been kind enough to trawl through https://review.openstack.org/#/c/245813/ | 13:42 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible: Updated the py_pkgs lookup plugin for multi source https://review.openstack.org/252956 | 13:44 |
| odyssey4me | mhayden deal :) | 13:44 |
| mhayden | odyssey4me: woot | 13:44 |
| mhayden | imma try a cherry pick and then get out the scalpel if needed :P | 13:45 |
| mhayden | mattt: love you, sir -- thanks much | 13:47 |
| mattt | mhayden: hugs | 13:47 |
| mhayden | i think that puts my beer tally with mattt at about 475 | 13:47 |
| odyssey4me | mhayden added a comment for a different way to do 'when:' clauses which have multiple conditions that need a boolean and, but otherwise all good and +w | 13:49 |
| Sam-I-Am | odyssey4me: wish i could see whats actually breaking in here | 13:49 |
| odyssey4me | Sam-I-Am well, the tempest failure indicates that tempest could not ssh to the instance | 13:49 |
| odyssey4me | the rest you'd have to trawl through logs to determine why it didn't | 13:50 |
| *** markvoelker has joined #openstack-ansible | 13:50 | |
| odyssey4me | it is very possibly a race condition of some sort, which would explain why it works sometimes and not other times | 13:50 |
| mhayden | thanks, odyssey4me! :) | 13:50 |
| Sam-I-Am | not sure if its something that goes wrong with network creation or vm creation, but the logs say the vm isnt getting dhcp | 13:50 |
| mhayden | odyssey4me / mattt: this enables gating for check mode -> https://review.openstack.org/#/c/251430/ | 13:50 |
| openstackgerrit | Merged openstack/openstack-ansible-security: Check mode compatibility for security role https://review.openstack.org/245813 | 13:51 |
| *** markvoelker_ has joined #openstack-ansible | 13:52 | |
| *** markvoelker has quit IRC | 13:54 | |
| *** TravisA has joined #openstack-ansible | 13:56 | |
| * mhayden tips his hat to odyssey4me | 13:57 | |
| odyssey4me | mhayden looking good - I'm looking forward to seeing a functional gate check :) | 13:58 |
| odyssey4me | Sam-I-Am yep, not getting DHCP - when we last dug into this - was due to the arp protection being enabled... essentially the DHCP requests can't get through | 13:59 |
| Sam-I-Am | which is odd | 13:59 |
| odyssey4me | Sam-I-Am it's possible that this is peculiar to an AIO setup, but I don't have the skills to figure it out | 13:59 |
| Sam-I-Am | im trolling through the logs trying to match up some times | 14:00 |
| *** javeriak has joined #openstack-ansible | 14:01 | |
| odyssey4me | Sam-I-Am I'd be happy to setup an AIO for someone to inspec | 14:04 |
| Sam-I-Am | does it ever break if you build one manually? | 14:04 |
| Sam-I-Am | unless these clocks are all sorts of screwy, it looks like the linuxbridge agent tore down network stuffs before the VM booted | 14:05 |
| Sam-I-Am | unless stuff is just missing | 14:06 |
| Sam-I-Am | there's nothing in console.log between 12:53 and 13:06 | 14:06 |
| Sam-I-Am | so i'm guessing thats when all the tempest bits are getting built? | 14:06 |
| Sam-I-Am | sort of makes more sense that way | 14:07 |
| Sam-I-Am | plus i havent had coffee | 14:07 |
| *** shausy has quit IRC | 14:10 | |
| odyssey4me | Sam-I-Am the full tempest log is at http://logs.openstack.org/74/252574/2/check/gate-openstack-ansible-commit-nv/bc3dcee/logs/aio1_utility_container-354961d7/tempest.log | 14:11 |
| Sam-I-Am | how many vxlan networks does it make? i thought it was 1 flat and 1 vxlan | 14:12 |
| mattt | mhayden: is there much value testing this role outside of an openstack-ansible deploy ? | 14:12 |
| mhayden | mattt: yeah | 14:12 |
| mattt | well there obviously is, but it would be nice to test it on top also | 14:12 |
| mhayden | it should be fine for plain old ubuntu 14.04 systems too | 14:12 |
| mattt | that is true | 14:13 |
| mhayden | mattt: well, this is step 1 of getting that done | 14:13 |
| mhayden | my goal is to have an env variable in gate-check-commit to apply this role at the end soon | 14:13 |
| odyssey4me | Sam-I-Am one private network: https://github.com/openstack/openstack-ansible/blob/master/playbooks/roles/os_tempest/tasks/tempest_resources.yml#L145 | 14:13 |
| *** adaccada has quit IRC | 14:13 | |
| mhayden | mattt: but i gotta get the check/functional modes working separately first | 14:13 |
| mhayden | before i go and break the gate and face odyssey4me's wrath :P | 14:13 |
| mattt | mhayden: ok cool | 14:13 |
| * mhayden whistles | 14:13 | |
| odyssey4me | mattt yeah, all roles must have their own functional tests to verify that they work, and to provide quick feedback outside of the complexity of the integrated tests | 14:14 |
| mhayden | thanks mattt | 14:14 |
| Sam-I-Am | odyssey4me: which is interesting because i see references to vxlan-67 and vxlan-94 in the logs | 14:14 |
| openstackgerrit | Merged openstack/openstack-ansible-security: Updating tests for openstack-ansible-security https://review.openstack.org/251430 | 14:17 |
| *** KLevenstein has joined #openstack-ansible | 14:19 | |
| sc68cal | odyssey4me: ack. | 14:20 |
| mancdaz | alextricity you around? | 14:20 |
| *** javeriak has quit IRC | 14:20 | |
| *** fawadkhaliq has quit IRC | 14:24 | |
| *** fawadkhaliq has joined #openstack-ansible | 14:24 | |
| *** mgoddard_ has joined #openstack-ansible | 14:28 | |
| mattt | Bjoern_: hey there, do you want to cherry-pick https://review.openstack.org/#/c/248904/ to liberty/kilo ? | 14:28 |
| Bjoern_ | yes | 14:28 |
| Bjoern_ | i can | 14:28 |
| mattt | Bjoern_: cool thanks, then we can get it reviewed for you | 14:28 |
| *** Bjoern_ is now known as BjoernT | 14:28 | |
| *** mgoddard has quit IRC | 14:31 | |
| BjoernT | mattt: do you remove the change id from the message ? | 14:33 |
| BjoernT | before reviewing | 14:33 |
| mattt | BjoernT: you should be able to cherry-pick it right from the gerrit interface | 14:33 |
| mattt | BjoernT: but the change ID should remain the same if you do it via git | 14:33 |
| BjoernT | oh i see | 14:33 |
| odyssey4me | mattt BjoernT wait for it to merge first | 14:34 |
| BjoernT | ok | 14:34 |
| odyssey4me | otherwise the source commit isn't reflected properly | 14:34 |
| mattt | ok | 14:34 |
| *** mpavone has quit IRC | 14:35 | |
| mhayden | odyssey4me: did i do this infra commit right? | 14:37 |
| mhayden | https://review.openstack.org/#/c/252978/ | 14:37 |
| mattt | mhayden: i meant to ask, what runs run_tests.sh anyway ? | 14:38 |
| odyssey4me | mhayden nope :) | 14:38 |
| mhayden | mattt: it's for humans (according to odyssey4me) | 14:39 |
| mhayden | odyssey4me: darnit -- what did i miss? | 14:39 |
| odyssey4me | mhayden if you want to implement a check that uses tox, there's a whole ream of stuff to add | 14:40 |
| mhayden | oh sheesh, okay | 14:41 |
| mhayden | are there docs on this? | 14:41 |
| odyssey4me | mhayden do you absolutely want to run the check test, or are you happy to run the functional tests straight off and leave the check test for manual testing? | 14:41 |
| mhayden | well i want to be 100% sure that someone can audit a system with this | 14:41 |
| mhayden | so i do want to run check mode AND functional | 14:41 |
| odyssey4me | ok, let's get the check mode in then | 14:42 |
| odyssey4me | let me find you an example | 14:42 |
| mhayden | thanks | 14:44 |
| odyssey4me | hmm, pabelanger ping? | 14:46 |
| odyssey4me | mhayden ok, first you need to edit jenkins/jobs/openstack-ansible-jobs.yaml with a new job-template | 14:53 |
| odyssey4me | mhayden one of the builders needs to include something like this: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/infra.yaml#L33-L34 | 14:53 |
| odyssey4me | but the envlist needs to be 'ansible-check' (or whatever the tox env name is you want | 14:54 |
| odyssey4me | this edit is the thing that tells jenkins how to run the job | 14:54 |
| mhayden | ohl, i see | 14:54 |
| odyssey4me | I think the template name should be 'gate-{name}-ansible-check' | 14:55 |
| odyssey4me | actually, let's do this a different way | 14:55 |
| mhayden | https://gist.github.com/major/87130d0722f82886bb74 ? | 14:56 |
| odyssey4me | let's not add another kind of job - let's rather make the functional job first do a check, then do the functional thing | 14:56 |
| mhayden | that seems reasonable | 14:56 |
| odyssey4me | this way we're not wasting nodepool nodes, which makes -infra happy | 14:56 |
| mhayden | and easier :P | 14:56 |
| mhayden | want me to adjust tox? | 14:56 |
| *** mss has quit IRC | 14:57 | |
| odyssey4me | so yes, you're wanting to adjust tox to do the one, then the other instead of doing them individually | 14:57 |
| * mhayden is on it | 14:57 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:57 | |
| odyssey4me | I guess run_tests should change too - and I would suggest that run_tests does not execute the functional test by default - just in case someone executes it on their mac :) | 14:57 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-security: Merging check/functional jobs into one https://review.openstack.org/252991 | 14:58 |
| mhayden | like that ^^ | 14:58 |
| mhayden | ? | 14:58 |
| odyssey4me | mhayden looks good to me - does it work? | 14:59 |
| mhayden | oof, i guess i need to pull the functional bit out of the tox envlist at the top | 14:59 |
| mhayden | so it doesn't run by default when someone runs tox | 14:59 |
| odyssey4me | no, that should be fine | 15:01 |
| odyssey4me | if someone runs tox then they should know what they're doing | 15:01 |
| mhayden | about to test those tox changes right quick | 15:02 |
| *** iceyao has quit IRC | 15:04 | |
| *** cemmason1 has joined #openstack-ansible | 15:08 | |
| *** sdake has joined #openstack-ansible | 15:08 | |
| *** cemmason has quit IRC | 15:09 | |
| *** iceyao has joined #openstack-ansible | 15:09 | |
| *** spotz_zzz is now known as spotz | 15:10 | |
| mhayden | odyssey4me: tests out okay | 15:10 |
| *** linggao has joined #openstack-ansible | 15:10 | |
| *** cemmason1 has quit IRC | 15:10 | |
| odyssey4me | mhayden cool :) mattt can you help out by reviewing https://review.openstack.org/252991 ? | 15:11 |
| *** karimb has joined #openstack-ansible | 15:11 | |
| mhayden | odyssey4me: are you thinking of re-using this -> https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/ansible-role-jobs.yaml#L16-L32 ? | 15:16 |
| odyssey4me | mhayden it'll actually be https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/ansible-role-jobs.yaml#L34-L52 | 15:18 |
| mhayden | i see | 15:19 |
| odyssey4me | mhayden basically all you'll need to do is match the config in https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L6868-L6876 for the zuul layout | 15:19 |
| mhayden | i'm not sure what the job name will be -- bunch of variables there | 15:19 |
| odyssey4me | the rest is already in place | 15:19 |
| mhayden | oh wowzers | 15:20 |
| cloudnull | morning | 15:20 |
| *** mgoddard_ has quit IRC | 15:21 | |
| *** mgoddard has joined #openstack-ansible | 15:22 | |
| pabelanger | odyssey4me: pong, morning | 15:22 |
| odyssey4me | pabelanger morning, I think we've sorted ourselves out - no worries :) | 15:23 |
| pabelanger | great | 15:23 |
| *** markvoelker_ has quit IRC | 15:25 | |
| mhayden | odyssey4me: something like this? https://github.com/major/project-config/commit/a9d36471255a7553270641484d148f915f6165c5 | 15:25 |
| odyssey4me | mhayden you're missing: https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L6871 | 15:26 |
| odyssey4me | mhayden then you can also remove https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L6933-L6934 and https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L6937-L6938 | 15:26 |
| odyssey4me | (they're catered for in the ansible-role-jobs job template | 15:27 |
| mhayden | oh nice, didn't know i could remove those | 15:27 |
| mhayden | simplifies it a bit | 15:27 |
| mhayden | odyssey4me: https://github.com/major/project-config/commit/1bb894349d80b7f31b1c6716c0b0900daa1b4369 | 15:28 |
| odyssey4me | mhayden oh, sorry - gate-openstack-ansible-security-ansible-lint can come out too | 15:29 |
| odyssey4me | https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L6928-L6939 should look exactly like https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L6918-L6926 in the end, just with s/rsyslog_client/security/ | 15:30 |
| pabelanger | odyssey4me: not sure ansible-role-jobs is the best place atm. Since it will affect all ansible modules. Maybe we need to create a seperate ansible job-template for openstack-ansible team? | 15:30 |
| odyssey4me | pabelanger we're not modifying the job template - just using them :) | 15:30 |
| pabelanger | odyssey4me: another thing, you might get some push back from -infra for creating a ansible-check. One question I was asked before, could it be added into ansible-lint | 15:31 |
| odyssey4me | pabelanger initially I was considering adding another template - but we rather made the functional check pipeline two checks | 15:31 |
| *** mancdaz has quit IRC | 15:31 | |
| pabelanger | for example: https://github.com/openstack/ansible-role-nodepool/blob/master/tox.ini#L10 | 15:31 |
| pabelanger | what I do today for ansible-lint and check-syntax | 15:31 |
| *** mancdaz has joined #openstack-ansible | 15:31 | |
| odyssey4me | pabelanger yeah, I've seen pushback - they want checks pipelined where possible | 15:32 |
| odyssey4me | eg: bashate has to be pipelined into the pep8 check | 15:32 |
| pabelanger | Ya, I like the idea honestly. More checks better | 15:33 |
| pabelanger | But understand -infra too about the usage of nodes | 15:33 |
| pabelanger | I don't use --check much, since I'm using the gate to test functional tests | 15:33 |
| odyssey4me | pabelanger yes, but they're asking now to pipeline checks where possible to reduce the usage of nodepool | 15:33 |
| pabelanger | so, my question, what does --check give you over ansible-functional? | 15:34 |
| odyssey4me | pabelanger so what we've done now is combine the check test and the functional test into one | 15:34 |
| odyssey4me | --check is basically a test which checks what ansible would do (like an audit of what will happen) | 15:34 |
| odyssey4me | this is useful for change planning, or auditing in this special case | 15:34 |
| mhayden | odyssey4me: https://review.openstack.org/#/c/252978/ | 15:35 |
| pabelanger | odyssey4me: right, I assume like a --noop mode for puppet? | 15:36 |
| mhayden | now i just need love on https://review.openstack.org/#/c/252991/ | 15:36 |
| odyssey4me | mhayden I updated the commit message to indicate the cross-repo dependency | 15:36 |
| odyssey4me | pabelanger exactly | 15:37 |
| mhayden | thanks for that, odyssey4me | 15:37 |
| *** Mudpuppy has joined #openstack-ansible | 15:39 | |
| pabelanger | odyssey4me: okay, cool. Only question then, what does running --check before the actually functional test get you? Are you hoping --check will expose something the functional test doesn't? I'm wondering if I should be updating ansible-gofer to do that too | 15:40 |
| mhayden | pabelanger: the idea there is to do a check run to simulate someone running an audit against their system | 15:41 |
| *** baker has joined #openstack-ansible | 15:41 | |
| mhayden | perhaps someone who wants to see what changes need to be made before making changes | 15:41 |
| *** daneyon has joined #openstack-ansible | 15:43 | |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Creating nova-secret with safe file permissions https://review.openstack.org/248904 | 15:44 |
| pabelanger | mhayden: Ya, I agree. But what I don't follow is adding that too the ansible-functional check / gate too. Will have to read up on it and test | 15:45 |
| pabelanger | seems odd to --noop first, then run functional test | 15:45 |
| odyssey4me | pabelanger in the security role's case, the check mode is part of its function | 15:45 |
| mhayden | well, the use case is that someone may want to audit a system, review those changes, and then make changes | 15:46 |
| mhayden | yeah, what odyssey4me said, the auditing mode is a feature | 15:46 |
| odyssey4me | running the role in check mode performs an audit, running without check mode implements changes | 15:46 |
| *** Mudpuppy has quit IRC | 15:47 | |
| alextricity | odyssey4me I'll add the patch(https://review.openstack.org/252100) to my environment and spin up a VM to see if it solves the problems | 15:48 |
| alextricity | mancdaz I am around now :) | 15:48 |
| mancdaz | alextricity I was looking to standardise the notification_driver settings across projects | 15:48 |
| mancdaz | seems some of them use messagingv2, some use rpc_, some are dependent on whether ceilometer is deployed, some get dropped in anyway | 15:49 |
| *** sacharya has joined #openstack-ansible | 15:49 | |
| *** TravisA has quit IRC | 15:49 | |
| mancdaz | alextricity but my main question was why, in glance, did you only configure the backend when the notification_driver was being configured? | 15:50 |
| alextricity | I've been looking into that lately since I've been doing a multi-node ceilometer testbed. I'm still playing around with the drivers to see which ones need to go where | 15:50 |
| mancdaz | alextricity so all the projects can't just use messagingv2 ? | 15:50 |
| *** Mudpuppy has joined #openstack-ansible | 15:52 | |
| alextricity | I don't know for sure at the moment. I only know the projects that need to be using messagingv2. I don't see any reason why all projects can't use that. | 15:53 |
| alextricity | Some notification drivers probably got mixed around during the structure change | 15:53 |
| *** sacharya has quit IRC | 15:53 | |
| alextricity | I'm still playing around with it on my test environment | 15:53 |
| alextricity | e.g. configuring meters, spinning up resources, verifying measurements | 15:54 |
| * alextricity is looking at the glance role now | 15:54 | |
| alextricity | Ah I see what you mean | 15:55 |
| *** markvoelker has joined #openstack-ansible | 15:55 | |
| *** oneswig has joined #openstack-ansible | 15:56 | |
| alextricity | I didn't think there was a need for rpc_backend if notification_driver isn't messagingv2 | 15:56 |
| alextricity | But I could be missing something | 15:56 |
| alextricity | mancdaz: Which ones *are not* using messagingv2? | 15:57 |
| mancdaz | alextricity neutron, cinder, heat | 15:58 |
| *** javeriak has joined #openstack-ansible | 15:58 | |
| mancdaz | alextricity I was working through a review to just set them all to use messagingv2, only if *_ceilometer_enabled is true | 15:59 |
| mancdaz | and no notification_driver if not | 15:59 |
| alextricity | The docs say that cinder supports messagingv2 and cinder should be configured with that notification driver | 15:59 |
| mancdaz | I think they all should if using oslo messaging? | 15:59 |
| Sam-I-Am | rpc_backend is what sets the main messaging backend | 16:00 |
| alextricity | mancdaz: I definitely agree | 16:00 |
| Sam-I-Am | its needed whether or not you use notification_driver | 16:00 |
| Sam-I-Am | although it may default to rabbit now | 16:00 |
| odyssey4me | effectively we want to ensure that if ceilometer is not being installed, then nothing should notify the notification queue (otherwise we end up with a queue full of messages and nothing consuming them) | 16:01 |
| alextricity | i was looking at the neutron config documentation yesterday, and it *does* support messagingv2 as well | 16:01 |
| alextricity | So we can configure neutron that way | 16:01 |
| alextricity | As for heat...let me check on that | 16:01 |
| odyssey4me | be aware that sometimes the docs are wrong, so if it doesn't support messagingv2 according to the docs - verify in the code to be sure, then submit a patch to docs :) | 16:01 |
| Sam-I-Am | cinder supports messagingv2 last i checked | 16:02 |
| alextricity | odyssey4me: so true | 16:02 |
| *** sdake has quit IRC | 16:03 | |
| mancdaz | Sam-I-Am we don't want notifications being sent if nothing is consuming them | 16:03 |
| mancdaz | so I'm trying to have it get set only if something (ceilometer) wants to consume them | 16:03 |
| Sam-I-Am | mancdaz: yes | 16:03 |
| mancdaz | support are seeing the notifications.info queue just grow | 16:03 |
| alextricity | mancdaz: I think it's safe to change all projects to messagingv2 when ceilometer is enabled | 16:03 |
| Sam-I-Am | notification_driver = noop if not ceilometer (or anything else pulling from the notifications q) | 16:03 |
| alextricity | ^^ I like that idea | 16:04 |
| mancdaz | alextricity I'll put a review up for that shortly | 16:04 |
| mancdaz | Sam-I-Am alextricity I spoke to odyssey4me about that option | 16:04 |
| odyssey4me | what is the upstream default if it's not set? | 16:04 |
| Sam-I-Am | usually noop | 16:04 |
| alextricity | It's just a blank list | 16:04 |
| mancdaz | his preference is not to set it at all if not ceilometer, and a deployer can add it using the config template if necessary | 16:04 |
| Sam-I-Am | or empty set = noop | 16:04 |
| alextricity | empty list* | 16:04 |
| odyssey4me | if it's noop, then just skip the config entry | 16:04 |
| odyssey4me | ie ie ceilometer enabled, add config entry, else do nothing | 16:05 |
| odyssey4me | *if | 16:05 |
| Sam-I-Am | i always explicitly set it because projects lose their minds on config sometimes, and having it revert makes a queue grow unexpectedly | 16:05 |
| mancdaz | it's how glance does it right now | 16:05 |
| *** mss has joined #openstack-ansible | 16:06 | |
| mancdaz | https://github.com/openstack/openstack-ansible/blob/master/playbooks/roles/os_glance/templates/glance-api.conf.j2#L31-L38 | 16:06 |
| odyssey4me | Sam-I-Am the position we've taken is to only set settings we care about setting... we don't need to override upstream defaults unnecessarily - and the config_overrides are there for anyone to use.... | 16:06 |
| mancdaz | https://github.com/openstack/openstack-ansible/blob/master/playbooks/roles/os_glance/defaults/main.yml#L56-L57 | 16:06 |
| Sam-I-Am | odyssey4me: assuming all the upstream defaults are sane | 16:07 |
| Sam-I-Am | there was a time when glance was not, and could become again | 16:07 |
| mancdaz | for notification_driver the upstream defaults are [], or noop | 16:07 |
| odyssey4me | also, if an upstream project is changing config defaults on a stable project, then they are breaking their contracts | 16:07 |
| mancdaz | so per odyssey4me we don't need to set it | 16:07 |
| odyssey4me | mancdaz yes | 16:07 |
| *** sdake has joined #openstack-ansible | 16:07 | |
| odyssey4me | Sam-I-Am if we don't think upstream defaults are sane, then we must engage upstream to fix that | 16:07 |
| mancdaz | so I propose all projects just get a *_ceilometer_notification_driver var, which gets dropped in only when *_ceilometer_enabled = true | 16:08 |
| *** daneyon has quit IRC | 16:08 | |
| mancdaz | else no notification_driver gets set | 16:08 |
| *** tfly has joined #openstack-ansible | 16:08 | |
| *** tfly has quit IRC | 16:08 | |
| alextricity | mancdaz: I can +1 that | 16:08 |
| javeriak | hey guys, isn't there a meeting today? | 16:08 |
| odyssey4me | mancdaz what add a var at all? | 16:08 |
| *** tfly has joined #openstack-ansible | 16:08 | |
| odyssey4me | meeting in #openstack-meeting-4 cloudnull, mattt, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, Sam-I-Am, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, dolphm, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak | 16:08 |
| *** tfly has quit IRC | 16:08 | |
| mancdaz | odyssey4me yes a <project>_ceilometer_notification_driver | 16:08 |
| *** tfly has joined #openstack-ansible | 16:09 | |
| odyssey4me | mancdaz why bother? why not just have it set the appropriate driver in the template | 16:10 |
| *** fawadkhaliq has quit IRC | 16:10 | |
| mancdaz | odyssey4me I guess you could. I don't suppose anyone would need to verride the driver if using ceilometer | 16:10 |
| odyssey4me | mancdaz yep, and if they do - they can use the config_override anyway | 16:11 |
| odyssey4me | if we add a special var, then we have to document the use of the var - it just adds to the documentation workload | 16:11 |
| mancdaz | odyssey4me ok I can buy that | 16:11 |
| linggao | Hi odyssey4me, I am trying to understand how openstack ansible works. Where is the hosts file located? | 16:12 |
| hughsaunders | linggao: openstack-ansible uses a dynamic inventory script rather than the standard ansible inventory. This script reads openstack_user_config to generate the inventory | 16:14 |
| *** ysm has joined #openstack-ansible | 16:15 | |
| linggao | hughsaunders, thanks. the strange thing is that if I ran " ansible galera_all -m shell -a date", I got "ERROR: Unable to find an inventory file, specify one with -i ?" | 16:19 |
| linggao | But if I ran it under /opt/openstack-ansible/playbooks, it seemed work. | 16:19 |
| javeriak | linggao the path to inventory is relative to where you run the playbooks from | 16:20 |
| javeriak | so you have to be in that directory | 16:20 |
| javeriak | you'll see the inventory directory under /playbooks | 16:21 |
| linggao | javeriak, I see. there is an inventory directory there. | 16:21 |
| linggao | ls | 16:21 |
| linggao | hughsaunders, javeriak thanks. I will read dynamic_inventory.py and try to understand. | 16:22 |
| hughsaunders | linggao: thats some deep cloudnull magic | 16:23 |
| linggao | :) | 16:23 |
| linggao | hughsaunders, javeriak I am new to ansible. When I read the ansible doc, it seemed very easy to get started. But when I came donw to the openstack, I was confused. | 16:25 |
| openstackgerrit | Kevin Carter proposed openstack/openstack-ansible: Added in keystone reserved port https://review.openstack.org/196702 | 16:26 |
| cloudnull | whats that ? | 16:27 |
| hughsaunders | linggao: openstack-ansible uses the dynamic inventory script to generate names and ips for the containers that don't exist before the ansible run, its a convenience shortcut. It is still possible to use the standard inventory, but quite a lot of effort to write it out. | 16:27 |
| cloudnull | oh dynamic_inventory.py | 16:27 |
| cloudnull | soryr | 16:27 |
| cloudnull | *sorry | 16:27 |
| cloudnull | hughsaunders linggao: ITS A TRAP! | 16:28 |
| cloudnull | linggao: I'd love to work on making the inventory script more sane. its a bit hectic and crufty. | 16:29 |
| linggao | hughsaunders, cloudnull, I saw a file openstack_hostnames_ips.yml under /etc/openstack_deploy. I guess it is created by dynamic_inventory.py, right? | 16:29 |
| cloudnull | but if you have any questions let me know. | 16:29 |
| cloudnull | linggao: yes | 16:29 |
| hughsaunders | cloudnull: I keep meaning to add an ansible-inventory format output to the dynamic inventory script, so that script could be run to create an ansible-style static inv. | 16:31 |
| hughsaunders | but haven't got round to it.. | 16:31 |
| linggao | hughsaunders, cloudnull My stupid question is that why not create a standard host file for ansible so that it is easy for users to understand and change? | 16:31 |
| linggao | As an admin, it is hard to debug when something is wrong with openstack-ansible. | 16:33 |
| cloudnull | linggao: the standard inventory file would be massive | 16:33 |
| cloudnull | and ansible inventory in ini format does not support dictionary parameters | 16:33 |
| cloudnull | so it'd be difficult to directly translate | 16:34 |
| cloudnull | that said, in the independent role repository work we're creating individual inventories for the test on how to use the roles stand alone | 16:34 |
| cloudnull | so its moving that direction on a per role basis | 16:35 |
| cloudnull | and with some improvements in how the dynamic inventory works i think we can get mostly there | 16:35 |
| linggao | cloudnull, thanks for the insights. | 16:35 |
| cloudnull | linggao: if you have some thoughts on how you'd like to see inventory and how it would make your life easier let us know. | 16:37 |
| cloudnull | more insight on that topic would be greatly appreciated. | 16:37 |
| javeriak | oh i have one... the cleanup for stale entries from the inventory json is a pain :) | 16:38 |
| javeriak | i wonder is thats automate-able cloudnull ... | 16:39 |
| cloudnull | we have the inventory-manage script | 16:40 |
| cloudnull | which will clean things up by name | 16:40 |
| hughsaunders | javeriak: have you seen inventory-manage? https://github.com/openstack/openstack-ansible/blob/master/scripts/inventory-manage.py | 16:40 |
| hughsaunders | snap | 16:40 |
| cloudnull | ^ that one | 16:40 |
| javeriak | oh nope.... | 16:41 |
| javeriak | is there a user doc entry on it that i can read? | 16:41 |
| cloudnull | ./scripts/inventory-mange.py --help | 16:41 |
| cloudnull | which may not be helpful :) | 16:41 |
| javeriak | ofcourse :) | 16:41 |
| stevelle | I was just looking for a doc entry, not finding one | 16:42 |
| cloudnull | ./scripts/inventory-manage.py -f /etc/openstack_deploy/openstack_inventory.json <option> | 16:43 |
| cloudnull | javeriak: ^ thats the basic usage | 16:43 |
| * odyssey4me loves seeing doc entry patches :) *hint* | 16:43 | |
| linggao | cloudnull, I am just thinking cloud. For me who just learned a little bit ansible, I would like see an ansible-style files. Otherwise, I feel like I am learning yet another language with openstack-ansible when something is wroing with my system and I need to debug it. | 16:45 |
| *** sdake has quit IRC | 16:46 | |
| linggao | s/cloud/loud/ | 16:46 |
| *** mgoddard_ has joined #openstack-ansible | 16:48 | |
| linggao | I have used some of the automated tools like puppet, chef, devstack, If it is working, everyone is happy. If something is not working, no one knows how to fix. | 16:48 |
| *** KLevenstein is now known as KLev-away | 16:50 | |
| *** fawadkhaliq has joined #openstack-ansible | 16:50 | |
| *** Mudpuppy has quit IRC | 16:50 | |
| openstackgerrit | Merged openstack/openstack-ansible: turn neutron notifications off by default https://review.openstack.org/252416 | 16:51 |
| *** mgoddard has quit IRC | 16:51 | |
| *** gparaskevas has quit IRC | 16:52 | |
| cloudnull | linggao: thats fair. we should try to make debugging inventory easier | 16:52 |
| palendae | Yeah, the inventory needs work | 16:53 |
| palendae | It's something I've wanted to do but can't find time | 16:53 |
| linggao | thanks! :) | 16:53 |
| spotz | *perks up* | 16:54 |
| *** prithivm has joined #openstack-ansible | 16:54 | |
| *** targon has quit IRC | 16:56 | |
| odyssey4me | we did discuss it briefly at the summit - the general idea was to change it so that you could have a replaceable library for accessing a cmdb source (providing hosts, groups), and then augment other stuff on top of it | 16:57 |
| odyssey4me | our default library could be a standard ansible ini file | 16:57 |
| palendae | yeah, I have a patch I threw up to start very, very basic test for the inventory | 16:57 |
| palendae | So we could start pulling it apart | 16:57 |
| odyssey4me | another could be the current yml format | 16:57 |
| palendae | And yeah, I would love to get it to the point where we drop an ini file like others do | 16:58 |
| *** targon has joined #openstack-ansible | 16:58 | |
| *** prithivm has quit IRC | 16:59 | |
| *** jaypipes has quit IRC | 16:59 | |
| *** prithivm has joined #openstack-ansible | 16:59 | |
| *** targon has quit IRC | 17:00 | |
| mancdaz | mattt https://review.openstack.org/#/c/228646/ | 17:00 |
| cloudnull | i have a role to dump inventory from running ansible. the output is not pretty | 17:01 |
| *** oneswig has quit IRC | 17:01 | |
| *** baker has quit IRC | 17:02 | |
| *** greg_a has joined #openstack-ansible | 17:02 | |
| *** BjoernT has quit IRC | 17:03 | |
| mattt | mancdaz: ah nice | 17:03 |
| odyssey4me | spotz ? | 17:04 |
| *** tfly has left #openstack-ansible | 17:04 | |
| cloudnull | https://github.com/cloudnull/osa_rpc_test/blob/master/osa-server-create.yml#L37-L61 that'll recreate an INI like inventory from a running ansible environment | 17:04 |
| *** bangfrog has joined #openstack-ansible | 17:05 | |
| *** prithivm has quit IRC | 17:05 | |
| *** mgoddard_ has quit IRC | 17:07 | |
| *** mgoddard has joined #openstack-ansible | 17:08 | |
| *** notmorgan has joined #openstack-ansible | 17:09 | |
| * notmorgan waves | 17:09 | |
| *** greg_a has quit IRC | 17:09 | |
| cloudnull | o/ notmorgan | 17:09 |
| * notmorgan is going to have some questions soon | 17:09 | |
| notmorgan | trying to use OSA to deploy a PoC on top of Vexxhost. | 17:09 |
| notmorgan | [yeah i know, virtualized on top of virtualized] | 17:09 |
| notmorgan | but.. | 17:09 |
| notmorgan | anyway just wanted to say hi before firing questions around :) | 17:10 |
| notmorgan | cloudnull: also HEY! | 17:10 |
| notmorgan | :) | 17:10 |
| * notmorgan tries not to stare too closely at neutron. | 17:10 | |
| notmorgan | :P | 17:10 |
| *** tiagogomes has quit IRC | 17:10 | |
| cloudnull | its likely for the best | 17:10 |
| notmorgan | cloudnull: yeah the networking setup has been kindof a beast | 17:11 |
| notmorgan | before evne running OSA | 17:11 |
| Sam-I-Am | notmorgan: networking is good for you | 17:11 |
| notmorgan | would be easier with physical hardware. | 17:12 |
| cloudnull | notmorgan: Sam-I-Am cloud aint hard. its cloud! | 17:12 |
| cloudnull | :p | 17:12 |
| notmorgan | probably less fighting wiht "what the cloud gives me" (and what the cloud gives me is far from "insane", just requires more sideways looking) | 17:12 |
| *** iceyao has quit IRC | 17:12 | |
| notmorgan | cloudnull: HAH | 17:12 |
| notmorgan | i also have some stuff to contribute up to OSA (and other CMS modules for OpenStack) to make things better already - just need to proove they all work | 17:13 |
| notmorgan | :) | 17:13 |
| *** greg_a has joined #openstack-ansible | 17:14 | |
| cloudnull | sweet! | 17:14 |
| *** iceyao has joined #openstack-ansible | 17:14 | |
| cloudnull | working is not part of the "success criteria" for cloud. thats rhetoric of our oppressors | 17:15 |
| notmorgan | HAH | 17:15 |
| notmorgan | oh gah, that makes me laugh too much | 17:15 |
| cloudnull | notmorgan: are you doing a multi node install ? | 17:15 |
| cloudnull | or is it an AIO | 17:15 |
| notmorgan | so my PoC is focused on single API host with services sub-url mounted | 17:15 |
| notmorgan | yes multinode | 17:15 |
| cloudnull | cool | 17:15 |
| notmorgan | AIO doesn't really let me proove out what i need | 17:15 |
| notmorgan | i need multiple API hostnames | 17:16 |
| cloudnull | we can do that in an AIO if thats what you need | 17:16 |
| notmorgan | since i'm splitting Auth to "auth.<host>" and all other identity things under api..../<identity> | 17:16 |
| notmorgan | and i want to ensure there is complete isolation from the user -> service | 17:16 |
| notmorgan | which is not as easy with AIO | 17:16 |
| notmorgan | i am also building a separate route for svc -> svc communication rather than user->svc | 17:17 |
| cloudnull | we can set an "affinity" group for container+n for a service type | 17:17 |
| cloudnull | if that helps, but multi-node is the better way to go for sure | 17:17 |
| notmorgan | i've proved i can do it now, but i'm aiming for a real "this is how it should look | 17:17 |
| notmorgan | rather than "we faked it out internally" | 17:17 |
| cloudnull | nice | 17:17 |
| notmorgan | and it also will help me develop the changes for keystoneauth, occ, and the services. | 17:18 |
| cloudnull | sweet! | 17:18 |
| cloudnull | well you let us know what you need. | 17:18 |
| notmorgan | my long term goal is to have HAProxy or whateve edge to the offload of keystonetoken-validation/auth-validation | 17:18 |
| cloudnull | that'd be cool | 17:18 |
| notmorgan | evne have a mockup in Lua to do that already in HAProxy | 17:18 |
| *** oneswig has joined #openstack-ansible | 17:18 | |
| *** oneswig has quit IRC | 17:18 | |
| cloudnull | SSL termination on the LB offloading directly to auth-X would be sweet | 17:19 |
| notmorgan | cloudnull: the start of it: https://github.com/morganfainberg/HAProxyKeystoneMiddlware | 17:19 |
| * cloudnull reading | 17:19 | |
| notmorgan | and fwiw, it *seems* to generally do better than the python keystonemiddleware in a contrived environment | 17:20 |
| notmorgan | like devstack | 17:20 |
| *** baker has joined #openstack-ansible | 17:21 | |
| notmorgan | but.. i mean, thats *not* really a good "how well does this work" [nor is that code even near complete] | 17:21 |
| alextricity | cloudnull: well that was easy! installing libvirt in the venv did the trick | 17:21 |
| alextricity | Although, this looks fishy: | 17:22 |
| alextricity | Connecting to libvirt: qemu:///system _get_connection /openstack/venvs/ceilometer-master/lib/python2.7/site-packages/ceilometer/compute/virt/libvirt/inspector.py:80 | 17:22 |
| alextricity | qemu?! | 17:22 |
| alextricity | I know for sure i'm using kvm | 17:22 |
| alextricity | Taking life, one bug at a time | 17:22 |
| cloudnull | notmorgan: thats awesome ! | 17:23 |
| cloudnull | @RAX we're doing a similar thing in Bash for integration in F5 for production, but a community supported LUA option would be far superior and something that I'd imagine we can help out with. -cc Apsu, jamesdenton, rackertom | 17:24 |
| cloudnull | alextricity: sweet! | 17:24 |
| cloudnull | qemu is the interface used to talk to KVM | 17:24 |
| cloudnull | so thats normal | 17:24 |
| notmorgan | cloudnull: yeah. and then the reallllly cool part is if we get everything behind http://<host>/<service> rather than <service>.host or port-number based | 17:24 |
| palendae | cloudnull: I think Mudpuppy, who's not in this channel, was also working on F5 REST API stuff | 17:24 |
| notmorgan | cloudnull: then we can do interesting things like... 1 OAuth session covers all APIs | 17:24 |
| cloudnull | ^ that | 17:25 |
| cloudnull | awesome | 17:25 |
| notmorgan | now that LUA impl is *very* haproxy specific | 17:26 |
| cloudnull | palendae: ah thats a good point, mudpuppy too is working on those bits | 17:26 |
| notmorgan | becuase it leans on the txn and txn.HTTP objects | 17:26 |
| notmorgan | but i think that is fine | 17:26 |
| notmorgan | since HAProxy does some of the best L7 routing of the OSS projects out there [without varnish insanity] | 17:26 |
| cloudnull | thats fine for sure. | 17:26 |
| notmorgan | while i like varnish, i *dont* like the custom module bit | 17:27 |
| notmorgan | anyway. so.. once i'm back i'll prob ask for some help getting the provider_network stuff lined up in my POC | 17:28 |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Convert AIO bootstrap from bash to Ansible https://review.openstack.org/239525 | 17:28 |
| cloudnull | sweet! you let us know what you need to make it go | 17:29 |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Convert AIO bootstrap from bash to Ansible https://review.openstack.org/239525 | 17:30 |
| openstackgerrit | Merged openstack/openstack-ansible: Added ceilometer-polling upstart jobs https://review.openstack.org/249946 | 17:31 |
| openstackgerrit | Darren Birkett proposed openstack/openstack-ansible: tidy up notification_driver implementation across projects https://review.openstack.org/253098 | 17:32 |
| *** javeriak_ has joined #openstack-ansible | 17:34 | |
| mancdaz | alextricity https://review.openstack.org/#/c/253098/ | 17:35 |
| alextricity | Awesome! | 17:35 |
| *** egonzalez has quit IRC | 17:36 | |
| *** javeriak has quit IRC | 17:36 | |
| odyssey4me | mhayden the -nv check has shown that the whole process runs, but fails in tempest because of the missing metadata checksum | 17:38 |
| odyssey4me | mhayden the voting gate keeps failing due to slowness, which I suspect relates to changes in the sshd config in the role I'm using - it'd be great if we could find the setting changes needed to add as vars to the bootstrap to make it be faster :) | 17:39 |
| *** ysm has quit IRC | 17:44 | |
| odyssey4me | mancdaz with an update of the commit message, https://review.openstack.org/253098 will get my +2 | 17:45 |
| notmorgan | cloudnull: yay finally got openstack-ansible to actually run. | 17:51 |
| cloudnull | woot! | 17:52 |
| cloudnull | thats a step in the right direction | 17:52 |
| spotz | Nice notmorgan | 17:52 |
| cloudnull | :) | 17:52 |
| *** greg_a has quit IRC | 17:52 | |
| notmorgan | now need to finally go figure out the network configs on the boxes and see if i can chase down a few of the other errors. | 17:52 |
| cloudnull | master/liberty? | 17:52 |
| notmorgan | but hey. -C is good. | 17:52 |
| notmorgan | cloudnull: uhm... openstack ansible 12.0.1? | 17:52 |
| notmorgan | whatever that translates to | 17:52 |
| cloudnull | liberty | 17:52 |
| notmorgan | though i should move to master, but liberty should be sufficient | 17:53 |
| openstackgerrit | Darren Birkett proposed openstack/openstack-ansible: tidy up notification_driver implementation across projects https://review.openstack.org/253098 | 17:53 |
| * notmorgan was only running -C cause networking not setup | 17:53 | |
| cloudnull | notmorgan: you should pull in https://review.openstack.org/#/c/252100/ | 17:53 |
| notmorgan | but hey. at least it didn't error all over | 17:53 |
| notmorgan | cool. | 17:54 |
| cloudnull | neutron - l2pop == a bad time | 17:54 |
| notmorgan | done | 17:54 |
| notmorgan | yah | 17:54 |
| cloudnull | you can apply it w/ ``openstack-ansible os-neutron-instlal --tags neutron-config`` | 17:55 |
| * notmorgan nods. | 17:55 | |
| notmorgan | oh wow need to go chase why i can't reach some hosts first. | 17:55 |
| notmorgan | then errands then back to this | 17:55 |
| cloudnull | unreachable hosts is also a bad time ;) | 17:56 |
| cloudnull | have fun w/ the errands | 17:56 |
| Sam-I-Am | cloudnull: neutron should work without l2pop | 17:57 |
| odyssey4me | #success OpenStack-Ansible Kilo 11.2.6 has been released. :) | 17:57 |
| openstackstatus | odyssey4me: Added success to Success page | 17:57 |
| cloudnull | Sam-I-Am: it does not. we've estabilished this for the last two days. | 17:57 |
| *** KLev-away is now known as KLevenstein | 17:57 | |
| cloudnull | if it did we wouldnt need https://review.openstack.org/#/c/252100/ | 17:58 |
| Sam-I-Am | cloudnull: i thought this was arp spoof stuff | 17:58 |
| Sam-I-Am | or l3ha + l2pop | 17:58 |
| cloudnull | no l2pop == port binding errors | 17:58 |
| cloudnull | regardless of l3ha | 17:58 |
| Sam-I-Am | blehhhhh | 17:58 |
| cloudnull | yea... | 17:59 |
| cloudnull | because, neutron, because CLOUD! | 17:59 |
| Sam-I-Am | i'm bringing that up over in the nootron channel | 18:00 |
| Sam-I-Am | because it seems really odd | 18:00 |
| cloudnull | please do. and if you find something please learn us. because it should work. | 18:01 |
| *** karimb has quit IRC | 18:02 | |
| Sam-I-Am | i'll have to try this in my lab too | 18:02 |
| Sam-I-Am | this is just liberty? | 18:02 |
| cloudnull | master/liberty | 18:03 |
| Sam-I-Am | cloudnull: is there a neutron bug for this? | 18:03 |
| *** javeriak has joined #openstack-ansible | 18:03 | |
| cloudnull | not that i've made | 18:04 |
| cloudnull | or seen specifically. | 18:04 |
| Sam-I-Am | seems o-a hits a lot of possible neutron bugs, but doesnt open bugs | 18:04 |
| Sam-I-Am | so its hard for me to track these | 18:04 |
| Sam-I-Am | like the l2pop+l3ha problem | 18:04 |
| cloudnull | we just patched that yesterday | 18:04 |
| odyssey4me | note that this is linuxbridge... it may not be a problem for ovs or other networking backends | 18:04 |
| cloudnull | ^ that too | 18:04 |
| odyssey4me | but yes, we should be better at engaging the upstream communities | 18:04 |
| Sam-I-Am | thats also a possibility... o-a is the only deployment tool using lb | 18:04 |
| cloudnull | because we've learned the OVS lesson | 18:05 |
| cloudnull | :) | 18:05 |
| cloudnull | others are getting there. | 18:05 |
| Sam-I-Am | sc68cal: ping | 18:05 |
| notmorgan | hmm.. i cna login to the hosts that are unreachable but ansible can't... hmmm | 18:06 |
| *** javeriak_ has quit IRC | 18:06 | |
| sc68cal | Sam-I-Am: pong | 18:06 |
| cloudnull | notmorgan: host key validation issues ? | 18:07 |
| notmorgan | cloudnull: maybe... | 18:07 |
| notmorgan | but.. | 18:07 |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Tidy up notification_driver implementation across projects https://review.openstack.org/253098 | 18:07 |
| Sam-I-Am | sc68cal: scrollback, have you heard of this particular issue? | 18:07 |
| cloudnull | ansible -m ping <hostname> works ? | 18:07 |
| Sam-I-Am | sc68cal: disabling l2pop in liberty breaks things | 18:07 |
| cloudnull | + linuxbridge | 18:07 |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Tidy up notification_driver implementation across projects https://review.openstack.org/253098 | 18:07 |
| sc68cal | nope - open a bug please | 18:07 |
| notmorgan | heh no hosts matched uhg. | 18:08 |
| * cloudnull lunching | 18:08 | |
| Sam-I-Am | sc68cal: yeah, lemmie try this in my lab first | 18:08 |
| Sam-I-Am | could be something specific to o-a | 18:08 |
| Sam-I-Am | thats where this all becomes fun | 18:08 |
| odyssey4me | Sam-I-Am ref: https://review.openstack.org/252100 | 18:09 |
| Sam-I-Am | odyssey4me: bug says 'using l3ha' | 18:09 |
| odyssey4me | ie Sam-I-Am you can associate https://bugs.launchpad.net/openstack-ansible/+bug/1521793 with Neutron | 18:09 |
| openstack | Launchpad bug 1521793 in openstack-ansible trunk "Master/Liberty w/ L2pop disabled breaks neutron" [High,In progress] - Assigned to Kevin Carter (kevin-carter) | 18:09 |
| odyssey4me | there is a bug, in other words - it just needs to be added to Neutron | 18:09 |
| Sam-I-Am | yeah | 18:10 |
| Sam-I-Am | what i'm trying to glean is - does this break with or without l3ha? | 18:10 |
| Sam-I-Am | because for a while, l3ha broke with l2pop | 18:10 |
| odyssey4me | and yes, in subsequent investigation we've found that l2pop needs to be enabled regardless of whether l3ha is enabled or not | 18:10 |
| Sam-I-Am | now its... l3ha broke without l2pop | 18:10 |
| odyssey4me | yes, l3ha broke without l2pop | 18:11 |
| Sam-I-Am | iirc, we enabled l2pop in kilo | 18:13 |
| Sam-I-Am | just no l3ha | 18:13 |
| Sam-I-Am | but i seem to recall kilo working without l2pop too | 18:13 |
| odyssey4me | yes | 18:13 |
| *** mrodden has quit IRC | 18:19 | |
| *** mrodden has joined #openstack-ansible | 18:21 | |
| odyssey4me | #success OpenStack-Ansible Liberty 12.0.2 has been released. :) | 18:22 |
| openstackstatus | odyssey4me: Added success to Success page | 18:22 |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Only deploy .my.cnf file on galera/utility containers https://review.openstack.org/253122 | 18:24 |
| openstackgerrit | Byron McCollum proposed openstack/openstack-ansible: Implement OpenStack client clouds.yml configuration file https://review.openstack.org/249209 | 18:26 |
| *** permalac has quit IRC | 18:32 | |
| *** eil397 has joined #openstack-ansible | 18:36 | |
| *** javeriak_ has joined #openstack-ansible | 18:39 | |
| *** javeriak has quit IRC | 18:40 | |
| *** javeriak has joined #openstack-ansible | 18:41 | |
| *** revdr has quit IRC | 18:42 | |
| *** javeriak_ has quit IRC | 18:44 | |
| *** elo has joined #openstack-ansible | 18:47 | |
| *** ctina_ has quit IRC | 18:53 | |
| *** javeriak has quit IRC | 18:55 | |
| alextricity | Hey. I'm using the 15GB Standard Instance from rax public cloud to build an AIO and it comes with two drives | 18:55 |
| alextricity | the second drive, /dev/xvdc, has 2gb | 18:55 |
| alextricity | for some reason the bootstrap scripts are building out /var/lib/lxc on this drive | 18:55 |
| *** revdr has joined #openstack-ansible | 18:55 | |
| alextricity | does anyone know where this is set? | 18:56 |
| *** phiche1 has joined #openstack-ansible | 18:57 | |
| *** phiche has quit IRC | 19:00 | |
| *** Mudpuppy has joined #openstack-ansible | 19:00 | |
| *** phiche1 has quit IRC | 19:01 | |
| *** phiche has joined #openstack-ansible | 19:01 | |
| *** dmsimard is now known as dmsimard|afk | 19:01 | |
| *** phiche1 has joined #openstack-ansible | 19:01 | |
| *** phiche has quit IRC | 19:05 | |
| alextricity | discard my question from above. I must of been lacking in caffeine | 19:05 |
| *** phiche1 has quit IRC | 19:05 | |
| *** revdr has quit IRC | 19:06 | |
| *** revdr has joined #openstack-ansible | 19:06 | |
| openstackgerrit | Tom Cameron proposed openstack/openstack-ansible: Allow ramdisk_id, kernel_id to be null on schema https://review.openstack.org/253140 | 19:07 |
| Sam-I-Am | rackertom: finger it out? | 19:07 |
| rackertom | Sam-I-Am: Yesir. | 19:07 |
| odyssey4me | alextricity yep, it'll use the largest disk available for the AIO | 19:08 |
| odyssey4me | we're changing that behaviour in https://review.openstack.org/239525 | 19:09 |
| rackertom | odyssey4me: That review ^. Does it look right that only that template would need to be pulled in for Kilo as well as liberty, or have there been other changes which will need backporting to Kilo? | 19:09 |
| odyssey4me | in that patch it'll only use the largest disk if you tell it to, otherwise it'll assume using / | 19:09 |
| odyssey4me | rackertom I have no idea - I'd recommend asking stevelle / sigmavirus24 / evrardjp about that | 19:11 |
| *** mgoddard_ has joined #openstack-ansible | 19:11 | |
| odyssey4me | mhayden woot! https://review.openstack.org/239525 has passed the non-voting gate :) | 19:14 |
| openstackgerrit | Jesse Pretorius proposed openstack/openstack-ansible: Creating nova-secret with safe file permissions https://review.openstack.org/248904 | 19:14 |
| *** mgoddard has quit IRC | 19:14 | |
| notmorgan | hmm. getting an LVM error (ensure /etc/lvm) issue on hosts that shouldn't *need* lvm, just writing to the filesystem is fine. [not a cinder block volume host] | 19:15 |
| notmorgan | and /etc/lvm is there. | 19:15 |
| *** mgoddard_ has quit IRC | 19:17 | |
| cloudnull | notmorgan: is failing due to write permissions? | 19:17 |
| cloudnull | *is it ... | 19:18 |
| notmorgan | cloudnull: not sure. actually i'm going to go back to working on network config first then circle back on this in the case that it's just something wonky in trying to "check" vs. actually apply | 19:18 |
| notmorgan | because getting the network configs on the hosts right is the big blocker for me atm. | 19:18 |
| cloudnull | ok. | 19:18 |
| cloudnull | is it the host networks IE: bridges? | 19:18 |
| cloudnull | or the provider_networks section in config ? | 19:19 |
| notmorgan | cloudnull: the actual target hosts network (bridges) | 19:19 |
| notmorgan | first | 19:19 |
| notmorgan | provider_networks section is after i get the hosts sane | 19:19 |
| cloudnull | you see https://github.com/openstack/openstack-ansible/blob/master/etc/network/interfaces.d/openstack_interface.cfg.example ? | 19:19 |
| notmorgan | yah | 19:19 |
| cloudnull | kk | 19:20 |
| notmorgan | i have to modify it cause i'm not doing bonds | 19:20 |
| notmorgan | since these are virtualized to begin with | 19:20 |
| notmorgan | no real benefit | 19:20 |
| *** ysm has joined #openstack-ansible | 19:20 | |
| notmorgan | i mean... i guess i could do bonds anyway with a single interface but... why bother with the headache | 19:20 |
| cloudnull | yea no need | 19:21 |
| cloudnull | https://github.com/openstack/openstack-ansible/blob/master/etc/network/interfaces.d/aio_interfaces.cfg might be more relevant | 19:21 |
| cloudnull | do the nodes have mulitiple nics ? | 19:21 |
| notmorgan | yes | 19:22 |
| notmorgan | on diff networks | 19:22 |
| cloudnull | so that may be closer to what you'd want, plugging in `bridge_ports` to the various devives accordingly. | 19:23 |
| notmorgan | cloudnull: yeah | 19:23 |
| cloudnull | and if needed you can hang a veth off of a bridge to give you yet another network | 19:23 |
| cloudnull | https://github.com/openstack/openstack-ansible/blob/master/etc/network/interfaces.d/aio_interfaces.cfg#L53-L59 | 19:23 |
| odyssey4me | yeah, mattt's heat template for a multi-node deployment may be a useful reference here for the network config | 19:24 |
| sigmavirus24 | odyssey4me: rackertom I thought that glance schema thing didn't need to be backported to kilo | 19:24 |
| odyssey4me | I've got to run. | 19:24 |
| odyssey4me | sigmavirus24 personally, I have no idea | 19:24 |
| sigmavirus24 | thought that's what stevelle had said | 19:24 |
| sigmavirus24 | Could be mis-remembering | 19:24 |
| rackertom | No, stevelle made a comment about Kilo not deploying templates properly...but maybe that would be fixed some day in the future? | 19:25 |
| cloudnull | notmorgan: this is what odyssey4me was making reference to | 19:27 |
| cloudnull | https://github.com/rcbops/rpc-heat/blob/master/config_controller_other.sh | 19:27 |
| cloudnull | https://github.com/rcbops/rpc-heat/blob/master/config_compute_all.sh | 19:28 |
| notmorgan | cloudnull: looking | 19:28 |
| stevelle | rackertom: so sigmavirus24 would probably recall, but in kilo the glance package didn't include the schema files at all. The fix for that was a change in liberty cycle though I don't have the fix on hand to link. that fix wasn't being backported. | 19:28 |
| cloudnull | just more ways to skin the networking cat | 19:28 |
| sigmavirus24 | stevelle: that's correct | 19:28 |
| notmorgan | cloudnull: yeah. i think i'm gonna just hand edit the interfaces this time around. | 19:29 |
| stevelle | as such, the change to our playbooks is not an issue for kilo | 19:29 |
| notmorgan | need to be sure i am clear on what is happening. | 19:29 |
| stevelle | so no backport to kilo | 19:29 |
| openstackgerrit | Merged openstack/openstack-ansible: Add new alarm for the galera checks https://review.openstack.org/251890 | 19:29 |
| cloudnull | yea this is what i find myself doing more often than not. | 19:29 |
| * notmorgan wishes network was easier for OSA to deploy w/o needing the extra manual steps, but i get why | 19:29 | |
| cloudnull | in the ansible2 timeframe we cna use the NM module to do a lot of that for us | 19:30 |
| notmorgan | cloudnull: yeah | 19:30 |
| * cloudnull wants http://docs.ansible.com/ansible/nmcli_module.html | 19:31 | |
| rackertom | stevelle: Yeah, that particular file does exist so I backported anyway. | 19:32 |
| * rackertom shrugs | 19:32 | |
| cloudnull | notmorgan: are there things that we can do to help out w/ the ansible2 OS modules ? | 19:32 |
| rackertom | odyssey4me had actually already done the backport for Liberty on the 1st anyway | 19:32 |
| notmorgan | cloudnull: i am really not familiar with neutron stuff / networking in ansible at this point | 19:33 |
| notmorgan | so i can't answer that sanely | 19:33 |
| cloudnull | no worries . | 19:33 |
| * notmorgan tries rebooting a node and seeing if the network "works" | 19:43 | |
| notmorgan | :P | 19:44 |
| *** mgoddard has joined #openstack-ansible | 19:47 | |
| sigmavirus24 | odyssey4me: stevelle rackertom actually that backport is valid (see my vote on https://review.openstack.org/#/c/253140/) | 19:50 |
| *** phiche has joined #openstack-ansible | 19:51 | |
| stevelle | ok, I could swear the packaging didn't get fixed so that this would actually get used in kilo but w/e | 19:51 |
| stevelle | I'm probably confused again | 19:51 |
| rackertom | Wow. The first time I decide to pre-emptively ignore a comment for the betterment of a future me...and I was nearly right. This is the most confusing day of my life. | 19:52 |
| *** dmsimard|afk is now known as dmsimard | 19:52 | |
| *** jimchou has joined #openstack-ansible | 19:54 | |
| logan- | def valid, i filed that bug based on a kilo install | 19:57 |
| *** ysm has quit IRC | 19:59 | |
| *** sdake has joined #openstack-ansible | 20:04 | |
| openstackgerrit | Tom Cameron proposed openstack/openstack-ansible: Fixed haproxy backend config issue https://review.openstack.org/253180 | 20:08 |
| notmorgan | cloudnull: woo i think i got my bridge setup working | 20:12 |
| notmorgan | cloudnull: so quick question, used_ips, is there anything i need to add to used_ips if the ips are all assigned to bridge devices? | 20:13 |
| notmorgan | cloudnull: it looks like i don't | 20:13 |
| notmorgan | but just confirming | 20:13 |
| sigmavirus24 | stevelle: so, the packaging is separate from the template we carry in osa | 20:13 |
| sigmavirus24 | in Kilo we need to lay down that file because otherwise nothing lays it down and glance gets upset that it's not there (probably) and so we need to keep the templated version up-to-date for glance in OSA | 20:14 |
| cloudnull | notmorgan: no. anything defined in the openstack_user_config file is already marked as "used" | 20:15 |
| stevelle | sigmavirus24: confirming my prior state of confusion. thx | 20:15 |
| notmorgan | ok great | 20:15 |
| notmorgan | well | 20:15 |
| notmorgan | there are different IPs on the bridge interfaces | 20:15 |
| notmorgan | that aren't defined in the hosts in openstack_user_config | 20:15 |
| sigmavirus24 | stevelle: glad to confirm | 20:15 |
| notmorgan | only the ips for the container network are there | 20:15 |
| cloudnull | are the cidr's being used within the cidr_networks ? | 20:15 |
| notmorgan | yes | 20:16 |
| notmorgan | so i need to exlude them | 20:16 |
| cloudnull | then I'd add the entries or ranges | 20:16 |
| notmorgan | what is the correct syntax/depth for used_ips. cause i keep getting parse errors trying to enable it | 20:16 |
| cloudnull | yes to make sure there are no conclusions | 20:16 |
| cloudnull | wrong word... *collisions | 20:16 |
| * notmorgan just wants to block of the first ~25 ips in each cidr range | 20:16 | |
| notmorgan | and then call it good. | 20:16 |
| cloudnull | yup | 20:16 |
| cloudnull | 10.0.0.1,10.0.0.26 and you should be good | 20:17 |
| notmorgan | oh hay it worked this time.. cool must have been something else going on | 20:17 |
| notmorgan | ok now i am down to solving this LVM issue so i can run openstack-ansible for real | 20:18 |
| notmorgan | not just -C | 20:18 |
| cloudnull | it may be an issue w/ check mode and the tasks | 20:19 |
| notmorgan | ok so i should just run and see how it goes? | 20:19 |
| notmorgan | cause... i think i'm at that point | 20:19 |
| cloudnull | yolo | 20:19 |
| cloudnull | :) | 20:19 |
| notmorgan | oh man. hopefully this isn't all horked [i mean i also don't have HAProxy running yet, but don't expect OSA to set that up for me atm. | 20:20 |
| *** ysm has joined #openstack-ansible | 20:20 | |
| notmorgan | because i have a much more custom config needed. | 20:20 |
| *** ysm has quit IRC | 20:20 | |
| * notmorgan runs. | 20:20 | |
| notmorgan | wooooooo scaaaary | 20:20 |
| cloudnull | you can run the haproxy role if you need that | 20:21 |
| notmorgan | i hmmm | 20:22 |
| notmorgan | broken package install(s) | 20:22 |
| notmorgan | oh poo, lost my default route | 20:22 |
| notmorgan | ok /me goes to fix | 20:22 |
| cloudnull | was that caused by OSA ? | 20:22 |
| notmorgan | no | 20:23 |
| notmorgan | by my bridge setup | 20:23 |
| cloudnull | ok, woooo... was about to panic :) | 20:23 |
| notmorgan | lol | 20:25 |
| notmorgan | now i get to wait 6 minutes for the hosts to restart | 20:25 |
| notmorgan | (because cloud-init gets cranky and i didn't bother to disable it) | 20:26 |
| Sam-I-Am | cloud-init doesnt like bridges or vxlan interfaces | 20:31 |
| openstackgerrit | Kevin Carter proposed openstack/openstack-ansible: Functional backport for the new repo-build process https://review.openstack.org/244215 | 20:33 |
| sigmavirus24 | Sam-I-Am: let the bridges you burn light your way | 20:35 |
| Sam-I-Am | more or less | 20:35 |
| *** oneswig has joined #openstack-ansible | 20:38 | |
| openstackgerrit | Miguel Alex Cantu proposed openstack/openstack-ansible: Add libvirt-python to ceilometer hosts https://review.openstack.org/253196 | 20:39 |
| *** oneswig has quit IRC | 20:40 | |
| *** fawadkhaliq has quit IRC | 20:41 | |
| *** fawadkhaliq has joined #openstack-ansible | 20:42 | |
| *** fawadkhaliq has quit IRC | 20:44 | |
| stevelle | sigmavirus24: for best results, cross bridge before lighting | 20:47 |
| *** openstackgerrit has quit IRC | 20:47 | |
| notmorgan | cloudnull: ooooooh and it's runnnnnnnning... | 20:47 |
| notmorgan | cloudnull: [one error so far, but thats fine] | 20:47 |
| *** openstackgerrit has joined #openstack-ansible | 20:48 | |
| notmorgan | cloudnull: and it's doing things... neato | 20:48 |
| notmorgan | so it looks like i get to run ansible like i used to run puppet... keep running it until there are no errors >.< | 20:50 |
| sigmavirus24 | notmorgan: s/puppet/chef/ | 20:51 |
| sigmavirus24 | :P | 20:51 |
| notmorgan | hah | 20:51 |
| notmorgan | now if only the ubuntu mirrors weren't flakey | 20:51 |
| sigmavirus24 | "Run thrice" was our motto with the old openstack cookbooks | 20:51 |
| sigmavirus24 | notmorgan: a flakey mirror? neverrrr | 20:52 |
| notmorgan | sigmavirus24: yeah right i know... so strange | 20:52 |
| cloudnull | notmorgan: use the successerator | 20:52 |
| notmorgan | cloudnull: ?? | 20:52 |
| cloudnull | kidding, but not... https://github.com/openstack/openstack-ansible/blob/master/scripts/scripts-library.sh#L43-L71 | 20:53 |
| cloudnull | its for the gate | 20:53 |
| notmorgan | no something else is going on now... | 20:53 |
| notmorgan | getting 404s | 20:53 |
| notmorgan | lxc_hosts | Install apt packages | 20:53 |
| *** mancdaz has quit IRC | 20:58 | |
| notmorgan | ah this is an issue with the vexxhost mirrors it looks like - they don't have the packages | 21:00 |
| *** mancdaz has joined #openstack-ansible | 21:01 | |
| *** itsuugo has joined #openstack-ansible | 21:03 | |
| *** karimb has joined #openstack-ansible | 21:12 | |
| notmorgan | cloudnull: out of curosity [only cause i'm about to run off for evening fun] | 21:12 |
| notmorgan | cloudnull: does OSAD support keystone in mod_wsgi, fernet tokens, and/or other services behind nginx for SSL termination? | 21:12 |
| notmorgan | cloudnull: and if you want to tell me "go read the code" that is a fine answer too | 21:13 |
| *** ysm has joined #openstack-ansible | 21:13 | |
| sigmavirus24 | notmorgan: cloudnull is in a meeting with me | 21:16 |
| notmorgan | sigmavirus24: irc asycn communication :P | 21:17 |
| sigmavirus24 | notmorgan: we run keystone with apache+mod_wsgi and easily support fernet tokens | 21:17 |
| sigmavirus24 | we also (in our deployments) do SSL termination at an F5 | 21:17 |
| notmorgan | sigmavirus24: it was mostly a question on how much hacking am i going to need to do. | 21:17 |
| notmorgan | so... | 21:17 |
| notmorgan | because i need each endpoint to also be SSL terminated (behind the L7 router) | 21:17 |
| sigmavirus24 | notmorgan: we did find that fernet+federation does not work though | 21:17 |
| notmorgan | for my POC | 21:17 |
| notmorgan | so, it's [internet] -> [[ssl] HAProxy] -> [[ssl] service] | 21:18 |
| sigmavirus24 | So you'll probably need to do some hacking but for the endpoint URL construction in the variables, you'll have to override the URI scheme variables which I can find for you later (or cloudnull can point you to them) | 21:18 |
| sigmavirus24 | Aha, so point-to-point TLS, got it | 21:18 |
| notmorgan | yah | 21:18 |
| sigmavirus24 | That's not currently how we've deployed anything | 21:18 |
| sigmavirus24 | (that I'm aware of) | 21:18 |
| notmorgan | sorry, TLS all the things | 21:18 |
| notmorgan | i'm actually ok ripping the containers out once i have a basic working set of configs | 21:18 |
| sigmavirus24 | I'm 100% in support of that | 21:18 |
| notmorgan | so, i might just do that | 21:19 |
| notmorgan | because the containers buy me nothing for the PoC | 21:19 |
| sigmavirus24 | That shouldn't be a problem to do though | 21:19 |
| sigmavirus24 | It was just never a priority for us | 21:19 |
| notmorgan | yeah figured as much | 21:19 |
| sigmavirus24 | cloudnull: and odyssey4me can definitely confirm/deny that | 21:19 |
| notmorgan | i need it because i am aiming to show an end-to-end config | 21:19 |
| notmorgan | as part of this POC | 21:19 |
| notmorgan | and have some good nginx configs to handle SSL for each of the APIs | 21:19 |
| sigmavirus24 | :+1: | 21:19 |
| sigmavirus24 | Yeah, that's interesting to me | 21:20 |
| notmorgan | since i wont ever be "redeploying" it wont make a lick of difference | 21:20 |
| sigmavirus24 | heh | 21:20 |
| notmorgan | i'm actually going to get a couple cheap-o real certs for my public facing endpoints | 21:20 |
| notmorgan | so i can have people poke at it easily | 21:20 |
| sigmavirus24 | Let's Encrypt is in public beta | 21:20 |
| sigmavirus24 | ;) | 21:20 |
| notmorgan | yeah but "beta" meaning i'm on the wait list | 21:21 |
| *** phiche1 has joined #openstack-ansible | 21:21 | |
| notmorgan | i am ok spending $20 on SSL certs if i get to that point before i'm allowed in | 21:21 |
| notmorgan | ;) | 21:21 |
| notmorgan | ($20 total, not each) | 21:21 |
| * sigmavirus24 nods | 21:21 | |
| notmorgan | and that is if i don't look for less $$$ cert | 21:21 |
| *** phiche has quit IRC | 21:21 | |
| *** mgoddard has quit IRC | 22:03 | |
| *** linggao has quit IRC | 22:04 | |
| *** phiche1 has quit IRC | 22:08 | |
| *** sdake has quit IRC | 22:10 | |
| mrda | linggao, odyssey4me: Sorry for not responding earlier, I was out of office yesterday. | 22:17 |
| *** sdake has joined #openstack-ansible | 22:20 | |
| *** bangfrog has quit IRC | 22:23 | |
| *** ysm has quit IRC | 22:31 | |
| *** sacharya has joined #openstack-ansible | 22:36 | |
| *** Mudpuppy has quit IRC | 22:40 | |
| *** agireud has quit IRC | 22:47 | |
| *** sdake has quit IRC | 22:52 | |
| *** baker has quit IRC | 23:04 | |
| *** baker has joined #openstack-ansible | 23:04 | |
| *** mss_ has joined #openstack-ansible | 23:04 | |
| *** Tridde has quit IRC | 23:07 | |
| *** mss has quit IRC | 23:07 | |
| *** Trident has joined #openstack-ansible | 23:09 | |
| *** baker has quit IRC | 23:09 | |
| *** KLevenstein has quit IRC | 23:12 | |
| *** sacharya has quit IRC | 23:25 | |
| *** sacharya has joined #openstack-ansible | 23:25 | |
| *** spotz is now known as spotz_zzz | 23:32 | |
| *** bangfrog has joined #openstack-ansible | 23:43 | |
| *** agireud has joined #openstack-ansible | 23:52 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!