| *** skamithi14 has joined #openstack-ansible | 00:02 | |
| *** jguy_ has quit IRC | 00:02 | |
| *** johnmilton has joined #openstack-ansible | 00:03 | |
| *** jguy_ has joined #openstack-ansible | 00:03 | |
| *** skamithi13 has quit IRC | 00:04 | |
| *** johnmilton has quit IRC | 00:08 | |
| *** galstrom_zzz is now known as galstrom | 00:18 | |
| *** johnmilton has joined #openstack-ansible | 00:21 | |
| *** scarlisle has quit IRC | 00:21 | |
| *** openstackgerrit_ has quit IRC | 00:23 | |
| *** openstackgerrit_ has joined #openstack-ansible | 00:24 | |
| *** bapalm has quit IRC | 00:24 | |
| *** sdake has joined #openstack-ansible | 00:29 | |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible: Test basic structure of dynamic inventory output https://review.openstack.org/287571 | 00:39 |
|---|---|---|
| *** bapalm has joined #openstack-ansible | 00:41 | |
| *** ErwanJ has quit IRC | 00:46 | |
| stevelle | jmccrory: I think if the dependencies were listed in an order that meant the dependent is always listed below the dependency those might go away. | 00:46 |
| stevelle | didn't test it | 00:46 |
| jmccrory | stevelle: sorry, have a lot of tabs open. which review is that? | 00:47 |
| stevelle | jmccrory: you asked about http://logs.openstack.org/86/290486/2/check/gate-openstack-ansible-dsvm-commit/f120f2d/console.html#_2016-03-10_20_25_15_474 | 00:47 |
| stevelle | I'm having irc problems today | 00:47 |
| stevelle | just now seeing that msg | 00:47 |
| *** openstackgerrit_ has quit IRC | 00:48 | |
| openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server: [DOCS] Cleanup the role docs for consistency and clarity https://review.openstack.org/290602 | 00:49 |
| jmccrory | ah right, that could be it | 00:49 |
| *** openstackgerrit_ has joined #openstack-ansible | 00:49 | |
| stevelle | the alpha order is nice but I noticed that those messages are common since | 00:49 |
| stevelle | I don't remember as many before | 00:50 |
| *** galstrom is now known as galstrom_zzz | 00:52 | |
| *** johnmilton has quit IRC | 00:59 | |
| *** automagically_ has joined #openstack-ansible | 01:00 | |
| *** skamithi13 has joined #openstack-ansible | 01:03 | |
| jmccrory | stevelle: yep, that's it. no errors with pip_install and pip_lock_down at the top. probably not worth messing with the alpha order for harmless log, but interesting that errors are delayed like that | 01:04 |
| *** skamithi13 has quit IRC | 01:04 | |
| *** skamithi13 has joined #openstack-ansible | 01:05 | |
| *** skamithi14 has quit IRC | 01:07 | |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible: Removing openstack_environment.yml. It is no longer useful. https://review.openstack.org/288698 | 01:16 |
| *** furlongm has quit IRC | 01:20 | |
| *** skamithi13 has quit IRC | 01:24 | |
| *** dmsimard|pto has quit IRC | 01:31 | |
| *** galstrom_zzz is now known as galstrom | 01:35 | |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible: Enable SSL termination for all services https://review.openstack.org/277199 | 01:37 |
| *** sdake has quit IRC | 01:40 | |
| openstackgerrit | Merged openstack/openstack-ansible: Remove unused galera_address from playbook https://review.openstack.org/290773 | 01:42 |
| *** weezS has quit IRC | 01:58 | |
| *** galstrom is now known as galstrom_zzz | 02:01 | |
| *** bapalm has quit IRC | 02:11 | |
| *** asettle has quit IRC | 02:15 | |
| *** asettle has joined #openstack-ansible | 02:15 | |
| *** bapalm has joined #openstack-ansible | 02:16 | |
| *** scarlisle has joined #openstack-ansible | 02:31 | |
| *** fawadkhaliq has quit IRC | 02:32 | |
| *** Guest38484 is now known as mfisch | 02:33 | |
| *** mfisch is now known as Guest13749 | 02:34 | |
| *** raddaoui has joined #openstack-ansible | 02:35 | |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-os_horizon: Enable functional convergence testing https://review.openstack.org/290034 | 02:36 |
| *** sdake has joined #openstack-ansible | 02:51 | |
| *** sdake_ has joined #openstack-ansible | 02:55 | |
| *** sdake has quit IRC | 02:56 | |
| *** raddaoui has quit IRC | 02:56 | |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-os_horizon: Enable functional convergence testing https://review.openstack.org/290034 | 03:02 |
| *** sdake_ has quit IRC | 03:03 | |
| *** cemmason has joined #openstack-ansible | 03:07 | |
| *** izaakk has quit IRC | 03:07 | |
| *** cemmason has quit IRC | 03:15 | |
| *** cemmason has joined #openstack-ansible | 03:15 | |
| *** cemmason is now known as christy | 03:15 | |
| *** thorst__ has quit IRC | 03:20 | |
| *** thorst has joined #openstack-ansible | 03:20 | |
| *** thorst has quit IRC | 03:29 | |
| *** krotscheck has quit IRC | 03:30 | |
| *** krotscheck has joined #openstack-ansible | 03:31 | |
| *** sdake has joined #openstack-ansible | 03:42 | |
| *** automagically_ has quit IRC | 04:09 | |
| *** jguy_ has quit IRC | 04:10 | |
| *** sdake has quit IRC | 04:12 | |
| *** scarlisle has quit IRC | 04:14 | |
| openstackgerrit | Merged openstack/openstack-ansible: Fix: AODH sort rabbitmq hosts pre-task should use 'aodh_all' group https://review.openstack.org/290725 | 04:16 |
| *** sdake has joined #openstack-ansible | 04:23 | |
| *** thorst has joined #openstack-ansible | 04:26 | |
| *** sdake_ has joined #openstack-ansible | 04:27 | |
| *** sdake has quit IRC | 04:29 | |
| *** thorst has quit IRC | 04:34 | |
| *** sdake_ has quit IRC | 04:48 | |
| *** aslaen has quit IRC | 04:52 | |
| *** javeriak has joined #openstack-ansible | 04:53 | |
| *** ErwanJ has joined #openstack-ansible | 04:56 | |
| *** lihg has joined #openstack-ansible | 04:59 | |
| *** lihg_ has joined #openstack-ansible | 04:59 | |
| *** lihg has quit IRC | 04:59 | |
| *** lihg_ has quit IRC | 04:59 | |
| *** ErwanJ has quit IRC | 05:00 | |
| *** ErwanJ has joined #openstack-ansible | 05:01 | |
| *** lykinsbd has joined #openstack-ansible | 05:10 | |
| *** javeriak has quit IRC | 05:14 | |
| *** lykinsbd has quit IRC | 05:15 | |
| *** thorst has joined #openstack-ansible | 05:32 | |
| *** ErwanJ has quit IRC | 05:35 | |
| *** andrei__ has joined #openstack-ansible | 05:38 | |
| *** thorst has quit IRC | 05:39 | |
| *** javeriak has joined #openstack-ansible | 05:44 | |
| *** javeriak_ has joined #openstack-ansible | 05:47 | |
| *** javeriak has quit IRC | 05:48 | |
| *** mgoddard has quit IRC | 05:56 | |
| *** bryan_att has quit IRC | 05:56 | |
| *** cfarquhar has quit IRC | 05:56 | |
| *** krotscheck has quit IRC | 06:01 | |
| *** mgoddard has joined #openstack-ansible | 06:02 | |
| *** bryan_att has joined #openstack-ansible | 06:02 | |
| *** cfarquhar has joined #openstack-ansible | 06:02 | |
| *** krotscheck has joined #openstack-ansible | 06:09 | |
| *** javeriak_ has quit IRC | 06:12 | |
| *** openstackgerrit_ has quit IRC | 06:17 | |
| *** cloudtrainme has joined #openstack-ansible | 06:17 | |
| *** admin0 has joined #openstack-ansible | 06:17 | |
| *** cloudtrainme has quit IRC | 06:18 | |
| *** openstackgerrit_ has joined #openstack-ansible | 06:18 | |
| *** admin0 has quit IRC | 06:20 | |
| *** phiche has joined #openstack-ansible | 06:26 | |
| *** thorst has joined #openstack-ansible | 06:37 | |
| openstackgerrit | Merged openstack/openstack-ansible: Clarify run-upgrade.sh failure message https://review.openstack.org/290707 | 06:37 |
| *** thorst has quit IRC | 06:43 | |
| *** javeriak has joined #openstack-ansible | 06:45 | |
| *** andrei__ has quit IRC | 06:51 | |
| *** unlaudable has quit IRC | 06:51 | |
| openstackgerrit | Merged openstack/openstack-ansible-pip_lock_down: Remove allow-all-external from pip configuration https://review.openstack.org/291113 | 06:53 |
| *** phiche has quit IRC | 06:57 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client: Ensure apt-transport-https is present before installing from secure repos https://review.openstack.org/291377 | 07:00 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron: Check for a different version of LBaaS agent before stop https://review.openstack.org/290772 | 07:03 |
| *** phiche has joined #openstack-ansible | 07:04 | |
| *** asettle has quit IRC | 07:07 | |
| *** asettle has joined #openstack-ansible | 07:08 | |
| bsv | Mornings o/ | 07:09 |
| *** mgoddard has quit IRC | 07:10 | |
| *** bryan_att has quit IRC | 07:10 | |
| *** cfarquhar has quit IRC | 07:10 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_glance: Account for oslo_config deprecations in glance config templates https://review.openstack.org/290811 | 07:11 |
| *** asettle has quit IRC | 07:18 | |
| *** mgoddard has joined #openstack-ansible | 07:21 | |
| *** bryan_att has joined #openstack-ansible | 07:21 | |
| *** cfarquhar has joined #openstack-ansible | 07:21 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server: Ensure apt-transport-https is present before installing from secure repos https://review.openstack.org/291398 | 07:27 |
| *** javeriak_ has joined #openstack-ansible | 07:32 | |
| *** javeriak has quit IRC | 07:33 | |
| *** mikelk has joined #openstack-ansible | 07:40 | |
| odyssey4me | jmccrory stevelle nice find! perhaps we should note that as a known issue? | 07:40 |
| odyssey4me | bsv morning! did you guys manage to get beyond the network comms issues? | 07:40 |
| *** thorst has joined #openstack-ansible | 07:41 | |
| *** asettle has joined #openstack-ansible | 07:45 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client: Adding Vagrantfile for local developer testing https://review.openstack.org/287534 | 07:46 |
| *** mgoddard has quit IRC | 07:47 | |
| *** bryan_att has quit IRC | 07:47 | |
| *** cfarquhar has quit IRC | 07:47 | |
| *** thorst has quit IRC | 07:49 | |
| bsv | odyssey4me: nope, not yet | 07:49 |
| *** asettle has quit IRC | 07:50 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Removing openstack_environment.yml. It is no longer useful. https://review.openstack.org/288698 | 07:50 |
| bsv | odyssey4me: focusing on the Virtual Connect config at the moment. | 07:54 |
| *** mgoddard has joined #openstack-ansible | 07:54 | |
| *** bryan_att has joined #openstack-ansible | 07:54 | |
| *** cfarquhar has joined #openstack-ansible | 07:54 | |
| odyssey4me | bsv could you take a look through https://review.openstack.org/291256 considering that it relates to a bug you filed? :) | 07:54 |
| odyssey4me | for rendered results, you can look here: http://docs-draft.openstack.org/56/291256/2/check/gate-openstack-ansible-docs/6638b8b//doc/build/html/install-guide/overview-requirements.html | 07:55 |
| bsv | Talked with HPE yesterday, they had some ideas about what could cause this. Scheduled a tech on monday 08:30 to review the Virtual Connect configuration. | 07:55 |
| javeriak_ | odyssey4me there are 3 instances of the lbaas_agents running right? is haproxy working on top? | 07:57 |
| odyssey4me | o/ javeriak_ I'm not sure I understand the question. | 07:58 |
| bsv | odyssey4me: much better :) | 07:58 |
| bsv | it was hlkv6 who filed that bug, just asked him to look at the link you sent. | 07:59 |
| openstackgerrit | Merged openstack/openstack-ansible: Check local and upstream repo for pip before using pypi https://review.openstack.org/291127 | 07:59 |
| javeriak_ | odyssey4me o/, just trying to figure out the architecture, need to read up on it ofc, but was wondering if having those multiple instances (i assume one runs in each of the neutron-agents) containers requires haproxy to redirect any kind of info on top; as in they arent proper backends right? | 08:00 |
| hlkv6 | goodmorning | 08:00 |
| openstackgerrit | Merged openstack/openstack-ansible: Docs/Reno: Conditional nova UID/GID https://review.openstack.org/290122 | 08:00 |
| odyssey4me | o/ hlkv6 | 08:00 |
| odyssey4me | javeriak_ ok, I'm still not getting the question entirely... what instances of what exactly? haproxy (or the LB in the back-end architecture) is used to load balance access to the OpenStack API's, Horizon, MariaDB... that should be it | 08:02 |
| hlkv6 | odyssey4me: re bug/1554626 - nothing is mentioned about partitioning, but looks very good otherwise! | 08:02 |
| odyssey4me | javeriak_ the Neutron agents all talk to the Neutron server through RabbitMQ in a defined RPC protocol | 08:02 |
| odyssey4me | hlkv6 good point - I think we may need to dig some info/recommendations out for that | 08:03 |
| javeriak_ | odyssey4me sorry for the confusion, i was talking about the neuron_lbaas_agent; actually my query is that we have a lbaas feature implementation in plumgrid that requires running them on each of the compute nodes. Is that something I can do. I mean I know I can probably change around the config to go install in compute_hosts instead. But I wouldnt be messing with your reefernce architture would i? | 08:04 |
| odyssey4me | javeriak_ ah, now I understand | 08:04 |
| hlkv6 | for a PoC having a single large / is fine, but for production deployment all the usual partitioning is recommended | 08:05 |
| javeriak_ | odyssey4me oh ofcourse, the neurton agnets arent proper backends for haproxy | 08:05 |
| odyssey4me | ok, so the implementation there is now uses its own instance of haproxy for each project and runs in the agents container | 08:06 |
| odyssey4me | but where it runs should still be in its own group - if not, we should fix that | 08:06 |
| odyssey4me | because then the group can always be allocated elsewhere | 08:06 |
| javeriak_ | odyssey4me yes exactly; i think the current group is tied to he neutron_agents one atm; i need to check though, I'd like to be able to reassign that to the computes though | 08:07 |
| *** unlaudable has joined #openstack-ansible | 08:08 | |
| odyssey4me | javeriak_ I'm hunting for a patch which changed things to make them more flexible - gimme a minute | 08:10 |
| *** admin0 has joined #openstack-ansible | 08:12 | |
| odyssey4me | javeriak_ ah, it's merged already - and lbaas follows the same pattern: https://github.com/openstack/openstack-ansible-os_neutron/commit/f1b82f43c4fdc85fe465ffbd4aa1a061eabab48d / https://github.com/openstack/openstack-ansible-os_neutron/commit/24b824b15c90dd7fe032bccc869538602849b17c#diff-7eeda618087b49ae876084ab6c73fdbb | 08:13 |
| odyssey4me | javeriak_ the initial allow neutron agents to move around patch was done by logan- :) | 08:14 |
| *** admin0_ has joined #openstack-ansible | 08:15 | |
| javeriak_ | odyssey4me ofcourse I remember that patch ! | 08:16 |
| odyssey4me | I'm not sure exactly how he does the re-allocation, but as far as I recall he does run the dhcp agents on the compute nodes or something like that | 08:16 |
| *** admin0 has quit IRC | 08:16 | |
| *** admin0_ is now known as admin0 | 08:16 | |
| odyssey4me | I expect that it may be through the use of customised env.d files (this is exactly why they're in user space). :) | 08:17 |
| javeriak_ | odyssey4me perfect, i know how to move it around now. So there 's no technical objection you might have on us doing that in prod though? | 08:17 |
| odyssey4me | javeriak_ if it's an environment where plumgrid networking has been implemented, I think it makes sense to make use of the plumgrid load balancing service if there is one. | 08:18 |
| odyssey4me | I expect that it will work far better that the current base implementation using haproxy.. | 08:18 |
| odyssey4me | javeriak_ in fact, you should chat to mhayden and Apsu when they come online - they're the ones who've been doing all the leg work on LBaaS | 08:19 |
| javeriak_ | odyssey4me okay perfect, thanks a lot. let me catch them when they're online later. And i know ive been absent from the community for a while, promise i'm coming back soon :); just need to get some projects out of the way | 08:20 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Gate: Use OpenStack-CI apt mirrors https://review.openstack.org/291597 | 08:20 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Gate: Use OpenStack-CI apt mirrors https://review.openstack.org/291598 | 08:21 |
| *** winggundamth has joined #openstack-ansible | 08:22 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Allow a list of files to be copied into the container cache https://review.openstack.org/290005 | 08:23 |
| *** jamielennox is now known as jamielennox|away | 08:23 | |
| *** admin0 has quit IRC | 08:24 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Gate: Use OpenStack-CI apt mirrors https://review.openstack.org/291598 | 08:24 |
| *** admin0 has joined #openstack-ansible | 08:24 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Set apt sources to use a configured list of components https://review.openstack.org/289835 | 08:25 |
| *** unlaudable has quit IRC | 08:33 | |
| *** pcaruana has joined #openstack-ansible | 08:41 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Gate: Ensure that AIO container apt components match the host https://review.openstack.org/291601 | 08:43 |
| *** thorst has joined #openstack-ansible | 08:46 | |
| *** unlaudable has joined #openstack-ansible | 08:48 | |
| *** thorst has quit IRC | 08:54 | |
| bsv | odyssey4me: ping | 08:54 |
| * admin0 intercepted the ping .. sends a fake pong | 08:54 | |
| bsv | :p | 08:55 |
| *** javeriak_ has quit IRC | 08:55 | |
| bsv | We use 12.0.7 in the git checkout, but it tries to install MySQL-python with another version (--find-links=\"http://10.50.41.50:8181/os-r | 08:57 |
| bsv | eleases/12.0.8\" | 08:57 |
| bsv | ) | 08:57 |
| bsv | odyssey4me: hmm standby, someone might have pulled another tag ;) investigating. | 08:58 |
| odyssey4me | :) | 09:00 |
| admin0 | :D | 09:01 |
| admin0 | bsv: i do a manual install and then move on :D | 09:01 |
| bsv | admin0: yeah, that ansible stuff... so anoying ;) | 09:02 |
| hlkv6 | how often does someone run the complete OSA install? is it done in a automated system somewhere? | 09:12 |
| *** neilus has joined #openstack-ansible | 09:13 | |
| hlkv6 | bsv: nobody pulled another tag, we did git checkout 12.0.7 and started | 09:13 |
| odyssey4me | hlkv6 an install is typically done once per site/region, and is typically done by hand unless the deployer has some sort of automation | 09:14 |
| odyssey4me | once it's deployed, you may execute it again per tag - an example of what you might do is here: http://docs.openstack.org/developer/openstack-ansible/install-guide/app-minorupgrade.html | 09:14 |
| odyssey4me | then for major version upgrades you'd possibly make use of the upgrade scripts, for example from kilo to liberty: http://docs.openstack.org/developer/openstack-ansible/liberty/upgrade-guide/index.html | 09:15 |
| *** electrofelix has joined #openstack-ansible | 09:15 | |
| odyssey4me | (that section is still being edited, so it's a little thin right now) | 09:15 |
| hlkv6 | ok | 09:16 |
| *** admin0 has quit IRC | 09:18 | |
| *** cristicalin has joined #openstack-ansible | 09:19 | |
| *** admin0 has joined #openstack-ansible | 09:28 | |
| *** permalac has joined #openstack-ansible | 09:37 | |
| *** permalac has quit IRC | 09:37 | |
| *** permalac_ has joined #openstack-ansible | 09:38 | |
| *** phiche has quit IRC | 09:41 | |
| *** phiche1 has joined #openstack-ansible | 09:41 | |
| *** neilus has quit IRC | 09:44 | |
| *** neilus has joined #openstack-ansible | 09:44 | |
| *** cristicalin has quit IRC | 09:46 | |
| *** thorst has joined #openstack-ansible | 09:51 | |
| *** thorst has quit IRC | 09:59 | |
| andrei_ | Hi, can someone discuss ideas behind logging in openstack-ansible project? | 10:05 |
| *** unlaudable has quit IRC | 10:06 | |
| odyssey4me | andrei_ sure, what's up? | 10:10 |
| *** Mudpuppy has quit IRC | 10:14 | |
| admin0 | andrei_: in the most lowest level .. the idea behind it was to send logs to a central server :D | 10:24 |
| andrei_ | all containers get rsyslog-client role which is described under /etc/ansible/roles/rsyslog_client. If one wants to use TCP instead of UDP for example, he should change rsyslog_client_udp_reception from true to false and vice versa for syslog_client_tcp_reception in /etc/ansible/roles/rsyslog_client/defaults/main.yml. There is a file ansible-role-requirements.yml containing list of all repos to be downloaded and one can find https://git.openstac | 10:24 |
| andrei_ | k.org/openstack/openstack-ansible-rsyslog_client in this file. Is there any workflow how can I replace client_logging role with custom one? | 10:24 |
| odyssey4me | andrei_ any changes to the defaults can be set in the user_variables.yml file in /etc/openstack_deploy - ie if you want to change rsyslog_client_udp_reception and syslog_client_tcp_reception you can set the variables in user_variables.yml - the idea is to keep customisations to settings out of the code tree and in user space | 10:27 |
| odyssey4me | secondly do you want to have your syslog traffic go somewhere else (replace the rsyslog server role entirely), or do you want to send rsyslog traffic somewhere else in addition to the rsyslog server? | 10:28 |
| odyssey4me | my personal advice would be to keep the logging server as a low tech fallback to whatever your current logging target is | 10:28 |
| *** permalac_ has quit IRC | 10:29 | |
| *** neilus1 has joined #openstack-ansible | 10:29 | |
| odyssey4me | an example of user_variables.yml additions to send rsyslog traffic to something like splunk or loggly is explained in https://github.com/openstack/openstack-ansible-rsyslog_client/blob/master/defaults/main.yml#L56-L73 | 10:30 |
| andrei_ | If I define 3 log_hosts in openstack_user_config.yml all logs are sent to all rsyslog-servers(containers). I've changed template for rsyslog client to use rsyslog failover features instead of parallel queues. I'm not sure that openstack-ansible will use my own template and custom settings (like rsyslog_client_udp_reception) | 10:33 |
| *** neilus has quit IRC | 10:33 | |
| andrei_ | As far as I remember in ansible lower level variables has higher priority then global vars | 10:33 |
| odyssey4me | andrei_ if you can submit a patch to improve how we do these and provide the failover, that'd be great! | 10:35 |
| odyssey4me | it might need some tweaking to generalise it, but we can do that in the patch review process | 10:35 |
| odyssey4me | we may also be able to help you see how you can do this without needing to tweak things | 10:36 |
| openstackgerrit | Merged openstack/openstack-ansible: Allow a list of files to be copied into the container cache https://review.openstack.org/290005 | 10:36 |
| odyssey4me | but yes, the current paradigm is to only have one log host specified | 10:37 |
| odyssey4me | it's kinda assumed that if you want some sort of redundant log storage that you'd have something like an elasticsearch cluster with a syslog listener, then you'd point rsyslog client there as an additional target | 10:38 |
| odyssey4me | we should probably document that as a recommendation <--- mhayden spotz | 10:38 |
| bsv | odyssey4me: dont use ES for persistent storage <---- bsv points out | 10:39 |
| odyssey4me | bsv :) sure, I'm not saying that's the only solution - I'm just saying that usually if you want something persistent and redundant then you'd have something else to do it... not just a standard syslog server | 10:40 |
| bsv | yeah, stream your logs to some sort of persistent storage, then let your ES-cluster read from that. | 10:41 |
| andrei_ | I can try. Nevertheless I wrote it for 3 datacenters(3 rsyslog servers). Template should be somehow overwritten automagically if user has 10 datacenters and wants more log servers. Idea was: all containers within one datacenter send logs to primary _for_this_datacenter_ log server and only if sending fails failover to secondary, and so on datacenter(if all fails - write to buffer). Every rsyslog-server can forward logs further to splunk, logsta | 10:44 |
| andrei_ | ash or whatever. Now it's working great - all logs over all servers. But I think it can be better :) | 10:44 |
| odyssey4me | ah andrei_ - that sounds good... part of the work in the next cycle (once Mitaka is released) will be to reconsider a lot of our assumptions to cater for multiple DC's in the OpenStack concept of Regions, and also to include the concept of Cells (assuming Nova's Cells v2 is ready) | 10:45 |
| odyssey4me | for now we kinda assume that each inventory is in a single DC | 10:45 |
| -openstackstatus- NOTICE: Gerrit is going to be restarted due to bad performance | 10:51 | |
| *** ChanServ changes topic to "Gerrit is going to be restarted due to bad performance" | 10:51 | |
| *** thorst has joined #openstack-ansible | 10:56 | |
| *** ChanServ changes topic to "Mitaka Release Critical Bugs: https://goo.gl/ipD9BL || Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://goo.gl/tTmdgs" | 10:57 | |
| -openstackstatus- NOTICE: Gerrit has been restarted successfully | 10:57 | |
| *** asettle has joined #openstack-ansible | 10:57 | |
| *** asettle has quit IRC | 10:57 | |
| *** thorst has quit IRC | 11:04 | |
| *** tiagogomes has joined #openstack-ansible | 11:08 | |
| *** tiagogomes_ has quit IRC | 11:11 | |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_swift: Add functional convergence test for os-swift role https://review.openstack.org/291290 | 11:11 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_swift_sync: Add functional tests for os_swift_sync role https://review.openstack.org/291296 | 11:12 |
| *** automagically_ has joined #openstack-ansible | 11:26 | |
| *** javeriak has joined #openstack-ansible | 11:27 | |
| *** jguy_ has joined #openstack-ansible | 11:27 | |
| *** unlaudable has joined #openstack-ansible | 11:34 | |
| *** andrei__ has joined #openstack-ansible | 11:36 | |
| openstackgerrit | git-harry proposed openstack/openstack-ansible-galera_server: Use var galera_cluster_members to identify cluster https://review.openstack.org/290729 | 11:36 |
| andymccr | https://review.openstack.org/#/c/291290/ fixed | 11:39 |
| odyssey4me | andymccr it works! :D | 11:43 |
| *** thorst has joined #openstack-ansible | 11:46 | |
| andymccr | ran into some random issues (like the ip range stuff) but yeah finally | 11:49 |
| *** thorst has quit IRC | 11:55 | |
| *** thorst has joined #openstack-ansible | 11:56 | |
| *** mathlin has quit IRC | 11:56 | |
| *** tiagogomes has quit IRC | 11:58 | |
| *** johnmilton has joined #openstack-ansible | 12:00 | |
| logan- | javeriak odyssey4me: yep.. dhcp agents on the compute nodes.. this is what I'm using that patch for: https://github.com/Logan2211/openstack-ansible/commit/e79ce3e95850a1d4a4539ba56dab9b27657e93ad?diff=unified#diff-71ef2e229d19f86ad8004c73ecbc506f | 12:01 |
| *** jguy_ has quit IRC | 12:04 | |
| *** thorst has quit IRC | 12:05 | |
| *** tiagogomes has joined #openstack-ansible | 12:10 | |
| *** Mudpuppy has joined #openstack-ansible | 12:14 | |
| openstackgerrit | git-harry proposed openstack/openstack-ansible-galera_server: Use var galera_cluster_members to identify cluster https://review.openstack.org/290729 | 12:14 |
| *** sdake has joined #openstack-ansible | 12:16 | |
| *** Mudpuppy has quit IRC | 12:19 | |
| *** andrei__ has quit IRC | 12:22 | |
| *** sdake has quit IRC | 12:23 | |
| *** jguy_ has joined #openstack-ansible | 12:25 | |
| *** admin0 has quit IRC | 12:29 | |
| *** jguy_ has quit IRC | 12:31 | |
| mhayden | mornin' | 12:32 |
| openstackgerrit | git-harry proposed openstack/openstack-ansible-galera_server: Use var galera_cluster_members to identify cluster https://review.openstack.org/290729 | 12:34 |
| *** automagically_ has quit IRC | 12:35 | |
| *** admin0 has joined #openstack-ansible | 12:36 | |
| admin0 | +1 to odyssey4me for bringing up the regions :D | 12:36 |
| * admin0 waiting for ages for this :D | 12:36 | |
| *** andrei__ has joined #openstack-ansible | 12:36 | |
| *** Bofu2U has joined #openstack-ansible | 12:36 | |
| *** sdake has joined #openstack-ansible | 12:36 | |
| *** thorst has joined #openstack-ansible | 12:40 | |
| *** javeriak has quit IRC | 12:47 | |
| *** retreved has joined #openstack-ansible | 12:49 | |
| odyssey4me | lol admin0 | 12:51 |
| admin0 | i am :D | 12:51 |
| admin0 | i am even creating blogs to put all general questions out here, so that you guys can focus more on doing stuff :D | 12:51 |
| admin0 | out of here* | 12:51 |
| admin0 | and give me regions :D | 12:51 |
| admin0 | \0/ | 12:51 |
| odyssey4me | I have made some notes of what to work through for the multi-region deployment, but I doubt I'll have time before the summit to actually get down to it. I might, but I doubt it - getting the release done is more important. | 12:52 |
| admin0 | no hurry .. if its in your radar and notes, its good enough | 12:52 |
| *** spotz is now known as spotz_zzz | 12:55 | |
| *** jguy_ has joined #openstack-ansible | 13:01 | |
| *** jguy_ has quit IRC | 13:01 | |
| *** sdake has quit IRC | 13:10 | |
| *** sdake has joined #openstack-ansible | 13:11 | |
| *** saneax has joined #openstack-ansible | 13:13 | |
| *** lykinsbd has joined #openstack-ansible | 13:13 | |
| *** phiche1 has quit IRC | 13:14 | |
| *** jguy_ has joined #openstack-ansible | 13:17 | |
| *** lykinsbd has quit IRC | 13:18 | |
| *** sdake_ has joined #openstack-ansible | 13:20 | |
| *** ametts has joined #openstack-ansible | 13:22 | |
| *** sdake has quit IRC | 13:23 | |
| *** phiche has joined #openstack-ansible | 13:34 | |
| *** keedya has joined #openstack-ansible | 13:36 | |
| *** andrei__ has quit IRC | 13:52 | |
| *** adac has joined #openstack-ansible | 13:59 | |
| *** sdake_ has quit IRC | 13:59 | |
| adac | Hi there! | 13:59 |
| odyssey4me | o/ adac | 14:00 |
| admin0 | hello adac | 14:00 |
| *** Bjoern_ has joined #openstack-ansible | 14:01 | |
| *** sdake has joined #openstack-ansible | 14:05 | |
| *** andrei__ has joined #openstack-ansible | 14:17 | |
| *** scarlisle has joined #openstack-ansible | 14:18 | |
| *** sdake_ has joined #openstack-ansible | 14:19 | |
| *** sdake has quit IRC | 14:21 | |
| *** iurygregory has quit IRC | 14:26 | |
| adac | Guys, while running "scripts/bootstrap-ansible.sh" (For the AIO with standard settings) I do get this error: https://gist.github.com/anonymous/482e6929d35c827d4a6e Can this be ignored? | 14:27 |
| *** mgoddard has quit IRC | 14:29 | |
| *** iurygregory has joined #openstack-ansible | 14:29 | |
| *** andrei__ has quit IRC | 14:29 | |
| odyssey4me | adac yes | 14:30 |
| odyssey4me | it falls back to isolated mode and succeeds in the last few lines | 14:31 |
| adac | odyssey4me, kk cool! | 14:31 |
| openstackgerrit | Merged openstack/openstack-ansible-ironic: Setup tftp for all scenarios https://review.openstack.org/290206 | 14:32 |
| *** mgoddard has joined #openstack-ansible | 14:39 | |
| *** saneax is now known as saneax_AFK | 14:43 | |
| *** ShannonM has joined #openstack-ansible | 14:50 | |
| *** Mudpuppy has joined #openstack-ansible | 14:51 | |
| *** jthorne has joined #openstack-ansible | 14:54 | |
| *** Guest13749 is now known as mfisch | 14:58 | |
| *** KLevenstein has joined #openstack-ansible | 14:58 | |
| *** mfisch is now known as Guest88074 | 14:59 | |
| *** waverider has joined #openstack-ansible | 15:00 | |
| *** Guest88074 is now known as mfisch | 15:01 | |
| *** mfisch has quit IRC | 15:01 | |
| *** mfisch has joined #openstack-ansible | 15:01 | |
| *** galstrom_zzz is now known as galstrom | 15:01 | |
| *** galstrom is now known as galstrom_zzz | 15:02 | |
| *** automagically_ has joined #openstack-ansible | 15:03 | |
| *** automagically_ has left #openstack-ansible | 15:03 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 15:06 | |
| automagically | Seeing at least one check failing with some strang logging out of the Glance API: http://logs.openstack.org/98/288698/6/check/gate-openstack-ansible-dsvm-commit/39e70c3/logs/aio1_glance_container-a7d2ece4/glance-api.log | 15:06 |
| automagically | Anyone else seeing that ^ | 15:06 |
| *** christy has quit IRC | 15:08 | |
| *** cemmason has joined #openstack-ansible | 15:09 | |
| *** ErwanJ has joined #openstack-ansible | 15:09 | |
| automagically | Related to https://bugs.launchpad.net/glance/+bug/1412798 perhaps | 15:14 |
| openstack | Launchpad bug 1412798 in Glance "Typo in section header in config silently disables all config parsing" [Medium,Fix released] - Assigned to Hassaan Pasha (hassaanp) | 15:14 |
| automagically | More digging required | 15:14 |
| odyssey4me | automagically oh, that looks fun | 15:16 |
| odyssey4me | it's a little odd that it's suddenyl started happening | 15:16 |
| automagically | Well, there were config file changes in the glance role recently | 15:16 |
| automagically | I’ll track it down now | 15:16 |
| *** admin0 has quit IRC | 15:17 | |
| *** admin0 has joined #openstack-ansible | 15:21 | |
| *** spotz_zzz is now known as spotz | 15:26 | |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_glance: Prevent IP conflicts on lxcbr0 https://review.openstack.org/291764 | 15:27 |
| automagically | odyssey4me: What is the process to bump SHAs? I ask because https://review.openstack.org/#/c/277199/ won’t pass check/gate until we bump the Heat SHA | 15:27 |
| odyssey4me | we can bump the SHA's, but then we fall into a bundle of hell | 15:28 |
| odyssey4me | we already know that a keystone SHA bump will break things | 15:28 |
| automagically | Well, you really made that sound attractive ;) | 15:28 |
| automagically | So presumably, they will bump for Mitake RC1 next? | 15:28 |
| odyssey4me | the diea was to get all the functional testing in the roles done before we embark on that adventure | 15:28 |
| odyssey4me | yep | 15:28 |
| automagically | Cool | 15:28 |
| *** sdake_ has quit IRC | 15:29 | |
| automagically | Just looking to understand timing more than anything | 15:29 |
| odyssey4me | in the role tests that can already be done to identiy problem specific to the roles | 15:29 |
| odyssey4me | I would recommend starting there | 15:29 |
| automagically | Good point | 15:29 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_keystone: Prevent IP conflicts on lxcbr0 https://review.openstack.org/291767 | 15:30 |
| *** automagically_ has joined #openstack-ansible | 15:30 | |
| *** sdake has joined #openstack-ansible | 15:31 | |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_cinder: Prevent IP conflicts on lxcbr0 https://review.openstack.org/291770 | 15:35 |
| automagically_ | o/ mhayden | 15:35 |
| automagically_ | Duh, sorry, your mornin’ was a long time ago….apparently I need more coffee | 15:36 |
| odyssey4me | I'm about ready for a drink. :p | 15:36 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_aodh: Prevent IP conflicts on lxcbr0 https://review.openstack.org/291776 | 15:40 |
| *** raddaoui has joined #openstack-ansible | 15:44 | |
| *** jaypipes is now known as leakypipes | 15:45 | |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-os_cinder: Remove the messaging tasks from the role https://review.openstack.org/288103 | 15:49 |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-os_cinder: Remove the messaging tasks from the role https://review.openstack.org/288103 | 15:50 |
| *** ron___ has joined #openstack-ansible | 15:53 | |
| *** unlaudable has quit IRC | 15:57 | |
| *** admin0 has quit IRC | 15:58 | |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_swift: Expose and set a default fallocate_reserve value https://review.openstack.org/287912 | 15:58 |
| *** permalac has joined #openstack-ansible | 16:01 | |
| *** kencjohnston has joined #openstack-ansible | 16:03 | |
| *** waverider has quit IRC | 16:03 | |
| automagically_ | Found the glance issue effecting the AIO, working on a fix with functional testing now | 16:04 |
| *** thorst is now known as thorst_afk | 16:06 | |
| *** winggundamth has quit IRC | 16:06 | |
| odyssey4me | awesome, thanks automagically_ | 16:11 |
| *** ErwanJ has quit IRC | 16:12 | |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-os_glance: Fixing Glance API startup failure and adding functional tests https://review.openstack.org/291793 | 16:15 |
| automagically_ | odyssey4me: ^ the fix | 16:15 |
| odyssey4me | automagically_ so 'oslo_messaging_notifications' is not a real heading? | 16:17 |
| odyssey4me | *section? | 16:17 |
| automagically_ | I _believe_ the issue is that I misread the logging in glance-api earlier. Note the commit comment on https://github.com/openstack/openstack-ansible-os_glance/commit/d8b6871f6d5085dc9c731684a9fef4cd9e25f607 versus what was changed | 16:18 |
| automagically_ | Translation: I need to slow down and read better | 16:19 |
| *** Mudpuppy has quit IRC | 16:19 | |
| automagically_ | And have a drink once this week is over | 16:19 |
| *** ErwanJ has joined #openstack-ansible | 16:20 | |
| odyssey4me | ah, so notification_driver is still valid - but topics is not | 16:20 |
| *** markvoelker has quit IRC | 16:21 | |
| andymccr | https://github.com/openstack/glance/blob/master/etc/glance-api.conf#L1381-L1390 that seems correct though, no? | 16:21 |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-os_glance: Adding Vagrantfile for local developer testing https://review.openstack.org/291796 | 16:23 |
| automagically_ | Yes, the section is, but I ended up duplicating it | 16:24 |
| * odyssey4me is confused | 16:25 | |
| *** asettle has joined #openstack-ansible | 16:25 | |
| openstackgerrit | Ala Raddaoui proposed openstack/openstack-ansible-openstack_hosts: Add a check for hosts particular kernel modules https://review.openstack.org/291797 | 16:25 |
| *** mikelk has quit IRC | 16:28 | |
| *** Mudpuppy has joined #openstack-ansible | 16:28 | |
| *** Mudpuppy has quit IRC | 16:28 | |
| *** adac has quit IRC | 16:29 | |
| *** Mudpuppy has joined #openstack-ansible | 16:29 | |
| *** asettle has quit IRC | 16:30 | |
| *** mathlin1 has joined #openstack-ansible | 16:33 | |
| *** sdake_ has joined #openstack-ansible | 16:34 | |
| *** sdake has quit IRC | 16:36 | |
| *** Mudpuppy has quit IRC | 16:40 | |
| *** weezS has joined #openstack-ansible | 16:40 | |
| *** phiche has quit IRC | 16:40 | |
| *** phiche has joined #openstack-ansible | 16:40 | |
| openstackgerrit | Ala Raddaoui proposed openstack/openstack-ansible: Add ebtables check for network hosts https://review.openstack.org/289622 | 16:46 |
| *** phiche has quit IRC | 16:49 | |
| *** pcaruana has quit IRC | 16:50 | |
| *** woodard has joined #openstack-ansible | 16:50 | |
| *** woodard has quit IRC | 16:52 | |
| *** mathlin1 has quit IRC | 16:52 | |
| *** woodard has joined #openstack-ansible | 16:53 | |
| *** automagically_ has left #openstack-ansible | 16:54 | |
| *** shausy has joined #openstack-ansible | 16:56 | |
| *** raddaoui has quit IRC | 16:57 | |
| *** Mudpuppy has joined #openstack-ansible | 17:03 | |
| *** shausy has quit IRC | 17:04 | |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-os_glance: Fixing Glance API startup failure and adding functional tests https://review.openstack.org/291793 | 17:08 |
| *** markvoelker has joined #openstack-ansible | 17:09 | |
| ErwanJ | HI all, I am quite unfortunately behind a corproate proxy doing a lab install of ansible-openstack. I have run in a few issues, but mainly whenever a task tries to excecute and apt-key or gpg command it requires me to add the --keyserver-options http-proxy parameter to it as apt-key/gpg is not using the env proxy nor the proxy in apt.conf - I'm fairly new to Ansible, but I suspect there is a way for me to ensure that t | 17:10 |
| automagically | ErwanJ: Also behind a proxy for most of my work | 17:11 |
| automagically | Which tasks are failing for you? | 17:11 |
| ErwanJ | Any task that add keys | 17:13 |
| ErwanJ | FOr instance " TASK: [galera_client | Add galera apt-keys] *********************************** | 17:13 |
| odyssey4me | ErwanJ before building the containers, you'll need to have this set in your /etc/openstack_deploy/user_variables.yml file: https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/user_variables.yml#L172-L178 | 17:14 |
| automagically | I don’t believe that the hkp downloads use the proxy | 17:15 |
| ErwanJ | It doesn't | 17:15 |
| automagically | I know that the apt ones definitely do not | 17:15 |
| ErwanJ | nope | 17:15 |
| ErwanJ | I created a seperate playbook to add the proxy to apt.conf | 17:15 |
| ErwanJ | which works for apt-get | 17:15 |
| ErwanJ | but apt-key doesn't even use that | 17:15 |
| automagically | yep, been there, done that | 17:15 |
| ErwanJ | it actually requires the --keyserver-options added | 17:16 |
| ErwanJ | Need to edit something task or other to add the parameters whever a apt-key is excecuted | 17:16 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible: Add radvd to neutron containers https://review.openstack.org/291826 | 17:18 |
| ErwanJ | I'm fairly new to Ansible in general and specifical openstack-ansible so I'm just mudying my way through it - was hoping someone else had run into this and may be abel to guide me in the right direction haha :) I can continue installing adding keys manually to each container but it's just taking a while :P | 17:18 |
| andymccr | hmm it looks like it could be a problem in that that option isnt passible by the ansible module itself?: http://docs.ansible.com/ansible/apt_key_module.html | 17:18 |
| ErwanJ | Very possible | 17:18 |
| ErwanJ | Looks like it | 17:18 |
| ErwanJ | :( | 17:18 |
| logan- | one workaround would be to download the keys to your deployment host and pass them via user_variables | 17:18 |
| *** woodard has quit IRC | 17:19 | |
| ErwanJ | Good idea @logan will look into doing that | 17:20 |
| logan- | all of the playbooks support this via https://github.com/openstack/openstack-ansible/blob/liberty/playbooks/roles/haproxy_server/tasks/haproxy_add_ppa_repo.yml#L43 | 17:20 |
| logan- | so you could do http://cdn.pasteraw.com/rrytd6ohcy8pdy9hbqom9qwld8bibpt | 17:21 |
| logan- | er | 17:21 |
| logan- | http://cdn.pasteraw.com/evvqmniilk7lvr9f4f1phtrevtv6y27 | 17:21 |
| logan- | data: is the parameter, not item: :) | 17:22 |
| *** weezS has quit IRC | 17:22 | |
| automagically | cloudnull: You around? | 17:22 |
| ErwanJ | Thanks logan, if I do that, should I be able to just run the haproxy-install playbook and it should update what is needed? | 17:23 |
| logan- | correct. that will override the default from here https://github.com/openstack/openstack-ansible/blob/liberty/playbooks/roles/haproxy_server/defaults/main.yml#L24-L29 with local key files | 17:24 |
| automagically | I too am running into issues with the galera_server role. Would like to remove https://github.com/openstack/openstack-ansible-galera_server/blob/master/defaults/main.yml#L87:L93 as we don’t seem to be using them (and I don’t want to mirror yet another repo) | 17:24 |
| tiagogomes | :wq | 17:25 |
| logan- | automagically: i think xtrabackup is required for the clustering :( | 17:25 |
| * tiagogomes is happy using mariadb 10.1, which already includes galera | 17:26 | |
| automagically | logan-: This caught my attention: https://github.com/openstack/openstack-ansible-galera_server/blob/master/tasks/galera_install.yml#L65:L72 | 17:26 |
| logan- | yeah I think that is done to keep the version pinned to whatever deb is specified | 17:27 |
| logan- | or the ppa version rather | 17:27 |
| automagically | Gotcha, thanks | 17:28 |
| logan- | I remember some talk about it a few weeks ago and cloudnull was saying there have been issues in the past if mariadb and xtrabackup versions were out of sync | 17:28 |
| *** weezS has joined #openstack-ansible | 17:29 | |
| *** leakypipes has quit IRC | 17:30 | |
| *** admin0 has joined #openstack-ansible | 17:31 | |
| logan- | In case it helps you.. this is what I'm doing for apt key/repo mirroring: http://cdn.pasteraw.com/1sttaji741wvuc3a4v6k92e7xgy0y6m | 17:34 |
| *** jaypipes has joined #openstack-ansible | 17:34 | |
| *** krotscheck has quit IRC | 17:34 | |
| *** iurygregory has quit IRC | 17:35 | |
| logan- | with the apt-mirror role available here: https://github.com/logan2211/ansible-apt-mirror | 17:35 |
| *** pcaruana has joined #openstack-ansible | 17:35 | |
| *** b3rnard0 is now known as b3rnard0_away | 17:35 | |
| *** krotscheck has joined #openstack-ansible | 17:37 | |
| automagically | Thanks for sharing logan- | 17:37 |
| automagically | Been having issues with role check logs not being fully downloadable. Raised with #infra and they are suggesting moving away from storing logs in swift and using an alternative log collection mechanism | 17:39 |
| automagically | Any objections to that approach while #infra tries to figure out the source of the issues | 17:39 |
| odyssey4me | automagically uh, where would you like to store them? | 17:40 |
| automagically | conversation ongoing in #openstack-infra | 17:40 |
| odyssey4me | oh ok, so it's not that we change anything - it's just that we source them differently | 17:41 |
| odyssey4me | temporarily while they sort stuff out | 17:42 |
| automagically | https://review.openstack.org/#/c/291834/ | 17:42 |
| automagically | Yeppers odyssey4me | 17:42 |
| odyssey4me | yeah, if they're doing the thing then fine | 17:42 |
| automagically | Cool, didn’t want to being acting unilaterally or anything | 17:42 |
| stevelle | thx | 17:44 |
| *** wadeholler has joined #openstack-ansible | 17:44 | |
| wadeholler | hey all: I have slow client command responses (openstack user list; openstack network-list; etc), 35s-1m. Haven't found any errors, shutdown all but 1 keystone, galera, and memcache instances to help troubleshooting | 17:45 |
| wadeholler | anyone care to point me in a direction ? kind of pulling my hair out | 17:45 |
| automagically | wadeholler: You run the client in debug mode yet? | 17:47 |
| automagically | Would love to see the debug logs | 17:47 |
| wadeholler | nope, will do and advise with pastebin - just run with "--debug" ? | 17:48 |
| stevelle | correct | 17:48 |
| *** lykinsbd has joined #openstack-ansible | 17:49 | |
| *** neilus1 has quit IRC | 17:49 | |
| automagically | thx wadeholler | 17:50 |
| wadeholler | http://pastebin.com/MyKsn1tK - long steps appear to kind of be the "Making authentication request ....." | 17:51 |
| *** javeriak has joined #openstack-ansible | 17:52 | |
| wadeholler | any change my "vip"...236.147 not being resolvable could be slowing it down ? | 17:52 |
| automagically | Is that external_lb_vip or internal? | 17:53 |
| wadeholler | internal | 17:53 |
| *** lykinsbd has quit IRC | 17:53 | |
| openstackgerrit | Kevin Carter proposed openstack/openstack-ansible: Add condition to local IP for overlay net https://review.openstack.org/273793 | 17:53 |
| wadeholler | "any change" = "any chance" | 17:54 |
| *** raddaoui has joined #openstack-ansible | 17:54 | |
| automagically | Does the curl command the debug spat out take ~20 seconds too? | 17:54 |
| *** adac has joined #openstack-ansible | 17:54 | |
| wadeholler | last curl command in output is about 10 sec ( in this 30 sec overall run ) | 17:55 |
| wadeholler | by my stopwatch | 17:56 |
| cloudnull | o/ morn/afternoons | 17:56 |
| automagically | Hmm, sounds like network, though could possibly related to query times on the db side of things | 17:57 |
| automagically | You could take a peek at the keystone logs perhaps and narrow it down | 17:57 |
| automagically | But I’m guessing connection and transport time between the utility container and keystone is the culprit | 17:57 |
| automagically | hey cloudnull o/ | 17:58 |
| automagically | Had a qq for you earlier cloudnull about whether or not we still need: https://github.com/openstack/openstack-ansible-galera_server/blob/master/defaults/main.yml#L87:L93 | 17:58 |
| cloudnull | automagically: I think so. May just be my paranoia but allowing the system package to be isntalled via galera apt repo has kicked us in the teeth. | 17:59 |
| automagically | kk | 17:59 |
| cloudnull | so maybe ? | 17:59 |
| *** weezS has quit IRC | 17:59 | |
| automagically | Appreciate the explanation | 18:00 |
| cloudnull | it would be nice to remove the extra dep | 18:00 |
| automagically | Yeah, if I have time next week, maybe I can test the removal a bit | 18:00 |
| automagically | But bogged down with other stuff atm | 18:00 |
| *** asettle has joined #openstack-ansible | 18:00 | |
| wadeholler | ok. haven't found any errors yet in keystone logs, just all the OPTIONS, POST, GET, etc. will keep digging. comeback when I find something more. thanks again automagically | 18:00 |
| automagically | wadeholler: Sure thing, sorry I couldn’t be more helpful | 18:00 |
| wadeholler | no worries. problems like this a pain I know. cheers. | 18:00 |
| cloudnull | automagically odyssey4me: RE: these patches -> https://review.openstack.org/#/q/status:merged+topic:rootwrap_owned_by_root -- I think those would be worth backporting all the way to kilo. | 18:01 |
| odyssey4me | I have to ask - is there a particular reason why we don't just install using the Ubuntu provided MariaDB packages? | 18:01 |
| automagically | cloudnull: I tend to agree given they are security issues | 18:01 |
| cloudnull | I've been working on somethings and it would seem to me that we should do those. | 18:01 |
| odyssey4me | cloudnull considering that's an impact to d34dh0r53, perhaps he should make those go? :) | 18:02 |
| automagically | afk for a few | 18:02 |
| cloudnull | being that they are already patched in master and public i dont mind saying that we might even want to raise a CVE for it | 18:02 |
| odyssey4me | I'd support the backport, whoever does it | 18:02 |
| cloudnull | because as it stands if I get in , have access to the neutron user, I can change the rootwrap file and write my own sudo privs | 18:03 |
| odyssey4me | feature? | 18:03 |
| odyssey4me | :p | 18:03 |
| *** wadeholler has quit IRC | 18:05 | |
| *** asettle has quit IRC | 18:05 | |
| spotz | heheh | 18:05 |
| *** neilus has joined #openstack-ansible | 18:05 | |
| *** raddaoui has quit IRC | 18:05 | |
| automagically | K, back, I’m down to backport them | 18:07 |
| automagically | Can fit that in today | 18:07 |
| automagically | Should I open a launchpad bug first? | 18:08 |
| odyssey4me | in other news: http://releases.openstack.org/liberty/index.html#openstack-ansible :) | 18:09 |
| *** Mudpuppy has quit IRC | 18:09 | |
| odyssey4me | and http://releases.openstack.org/kilo/index.html#openstack-ansible | 18:09 |
| odyssey4me | ignore the fact that the tarball links don't work :p | 18:09 |
| cloudnull | automagically: if you can create a bug that would be great. Im going to request a public CVE for the issue and we can link the CVE-ID to the bug once we get it. | 18:12 |
| automagically | Will do | 18:12 |
| *** javeriak has quit IRC | 18:15 | |
| *** javeriak_ has joined #openstack-ansible | 18:15 | |
| automagically | cloudnull: Can you turn a quick eye to https://review.openstack.org/#/c/287571/ please | 18:15 |
| automagically | Its been percolating for about a week and seems ready ;) | 18:16 |
| cloudnull | sure thing | 18:16 |
| automagically | thank you sir | 18:16 |
| *** javeriak_ has quit IRC | 18:17 | |
| *** javeriak has joined #openstack-ansible | 18:18 | |
| *** adac has quit IRC | 18:18 | |
| *** lykinsbd has joined #openstack-ansible | 18:20 | |
| *** javeriak_ has joined #openstack-ansible | 18:22 | |
| *** javeriak has quit IRC | 18:24 | |
| automagically | Bug for rootwrap issues: https://bugs.launchpad.net/openstack-ansible/+bug/1556231 | 18:24 |
| openstack | automagically: Error: malone bug 1556231 not found | 18:24 |
| automagically | Its marked as a security issue, and thus not currently public | 18:24 |
| *** Mudpuppy has joined #openstack-ansible | 18:24 | |
| *** lykinsbd has quit IRC | 18:25 | |
| *** sdake_ has quit IRC | 18:28 | |
| cloudnull | thank you automagically: I've marked the issue as "Public Security" and included in my message to MITR . | 18:29 |
| odyssey4me | I've marked the series it affects | 18:29 |
| odyssey4me | and targeted them at the next release for each. | 18:29 |
| cloudnull | sweet. | 18:30 |
| odyssey4me | automagically will you be doing the backports? | 18:30 |
| automagically | Cool, I had no idea how to mark the series | 18:30 |
| automagically | Yep, starting the Liberty backport now | 18:30 |
| odyssey4me | ok, assigned | 18:30 |
| *** Mudpuppy has quit IRC | 18:31 | |
| *** permalac has quit IRC | 18:35 | |
| *** zhangjn has quit IRC | 18:38 | |
| *** sdake has joined #openstack-ansible | 18:39 | |
| *** b3rnard0_away is now known as b3rnard0 | 18:39 | |
| *** Mudpuppy has joined #openstack-ansible | 18:40 | |
| *** zhangjn has joined #openstack-ansible | 18:41 | |
| *** sdake_ has joined #openstack-ansible | 18:41 | |
| *** sdake has quit IRC | 18:44 | |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible: rootwrap configuration must be owned by root https://review.openstack.org/291858 | 18:44 |
| *** thorst_afk is now known as thorst | 18:44 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone: Prevent IP conflicts on lxcbr0 https://review.openstack.org/291767 | 18:48 |
| odyssey4me | automagically you're missing the edit for https://github.com/openstack/openstack-ansible/blob/liberty/playbooks/roles/os_ceilometer/tasks/ceilometer_pre_install.yml#L59 in https://review.openstack.org/#/c/291858/ | 18:55 |
| automagically | Nice catch odyssey4me | 18:56 |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible: rootwrap configuration must be owned by root https://review.openstack.org/291858 | 18:58 |
| odyssey4me | automagically hopefully you can just cherry-pick that to kilo? | 19:03 |
| automagically | That’s what I’m hoping | 19:03 |
| automagically | Waiting for gate, then I’ll give it a shot | 19:03 |
| odyssey4me | you can try now, as it's a backport already there's no need for further formalities | 19:04 |
| odyssey4me | ah, fair enough | 19:04 |
| *** Bjoern_ is now known as Bjoern_zZzZzZzZ | 19:04 | |
| odyssey4me | it may be pertinent to ensure that it actually works :p | 19:04 |
| *** sdake_ has quit IRC | 19:05 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible: Add LBaaS v2 support (OSA) https://review.openstack.org/287243 | 19:05 |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-galera_server: Allow cert validation to be toggled by deployers https://review.openstack.org/291865 | 19:08 |
| *** sdake has joined #openstack-ansible | 19:10 | |
| automagically | D’oh! Merge conflict trying to cherry-pick | 19:11 |
| automagically | Ah well | 19:11 |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible: rootwrap configuration must be owned by root https://review.openstack.org/291868 | 19:15 |
| *** McMurlock1 has joined #openstack-ansible | 19:23 | |
| *** McMurlock1 has quit IRC | 19:23 | |
| *** wadeholler has joined #openstack-ansible | 19:24 | |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-galera_server: Role should fail immediately when its preconditions are not met https://review.openstack.org/291873 | 19:24 |
| odyssey4me | For anyone interested in giving it a go - I have the convergence testing complete for the Designate role. I've tried to make the testing a little less unwieldy than we're seeing in some of the other roles. It's not perfect, and I have no idea yet whether Designate actionally is functional, but the API does come up and responds to queries. :p See: https://github.com/odyssey4me/openstack-ansible-os_designate | 19:35 |
| odyssey4me | I expect that it's in a condition that we can import the role during the course of next week and the collaborate to make it usable. | 19:35 |
| odyssey4me | jmccrory ^ seeing as you looked at the previous work done | 19:36 |
| jmccrory | odyssey4me cool, i'll give a look sometime over the next few days | 19:37 |
| odyssey4me | ok, time out for me - it's time to weekend! | 19:37 |
| automagically | Enjoy your weekend odyssey4me | 19:38 |
| cloudnull | enjoy the weekend odyssey4me | 19:39 |
| cloudnull | have lots of scotch | 19:39 |
| cloudnull | :) | 19:39 |
| openstackgerrit | Merged openstack/openstack-ansible-os_aodh: Prevent IP conflicts on lxcbr0 https://review.openstack.org/291776 | 19:42 |
| automagically | FYI, we should consider taking advantage of this: https://github.com/openstack/keystone/blob/4ebf58566ec7c3a557987c1c9cfd1e03a91272e6/releasenotes/notes/add-bootstrap-cli-192500228cc6e574.yaml | 19:42 |
| *** mgoddard has quit IRC | 19:42 | |
| automagically | Will help us dump some code out of the keystone Ansible module | 19:42 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder: Prevent IP conflicts on lxcbr0 https://review.openstack.org/291770 | 19:42 |
| stevelle | automagically: agreed, I think a light spec for Newton is appropriate | 19:45 |
| openstackgerrit | Merged openstack/openstack-ansible-os_glance: Prevent IP conflicts on lxcbr0 https://review.openstack.org/291764 | 19:46 |
| cloudnull | ah thats nice , automagically we should use that indeed. | 19:46 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-os_neutron: Enable developer mode https://review.openstack.org/291445 | 19:46 |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-os_cinder: Remove default vars from the test playbook https://review.openstack.org/290947 | 19:48 |
| *** sdake_ has joined #openstack-ansible | 19:49 | |
| palendae | Do we have config_template docs anywhere? | 19:49 |
| *** sdake has quit IRC | 19:49 | |
| automagically | http://docs.openstack.org/developer/openstack-ansible/developer-docs/extending.html#setting-overrides-in-configuration-files | 19:50 |
| automagically | Pretty light, but its something | 19:50 |
| *** Bjoern_zZzZzZzZ is now known as Bjoern_ | 19:50 | |
| *** electrofelix has quit IRC | 19:50 | |
| palendae | Thanks | 19:51 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-os_neutron: Enable functional convergence testing https://review.openstack.org/291885 | 19:53 |
| automagically | stevelle: keystone-manage blueprint added: https://blueprints.launchpad.net/openstack-ansible/+spec/adopt-keystone-manage-bootstrap | 19:55 |
| stevelle | subscribing to this product and/or service, thx | 19:55 |
| stevelle | I set a reminder for myself to look at this before summit | 19:56 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-os_neutron: Enable functional convergence testing https://review.openstack.org/291885 | 19:58 |
| *** sdake_ has quit IRC | 19:59 | |
| mhayden | if hosts have plenty of RAM/disk available, and my quota is fine, but i'm getting "no valid host -- does anyone have idea for where to look? | 20:03 |
| mhayden | i can't seem to go past 60 instances | 20:03 |
| *** miguelgrinberg has quit IRC | 20:03 | |
| automagically | mhayden: What is raising that complaint? | 20:05 |
| mhayden | i see it in my nova-conductor logs | 20:05 |
| automagically | Sounds like a scheduler issue | 20:05 |
| automagically | Like it thinks the computes cannot take anymore instances of the type you are using | 20:06 |
| mhayden | what's weird is that it lets two hypervisors have 19 and lets the other two have 11 (each | 20:07 |
| mhayden | 19x2 + 11x2 = 60 -- sounds like an oddly round number | 20:07 |
| automagically | Indeed | 20:07 |
| wadeholler | nova_cpu_allocation_ratio need tweeked ? | 20:07 |
| mhayden | wadeholler: you might be right -- two of my hosts have fewer cpu cores | 20:08 |
| admin0 | mhayden: are you using stacking ? | 20:08 |
| admin0 | or not using stacking ? | 20:08 |
| * mhayden feels badly stacked | 20:09 | |
| admin0 | :D | 20:09 |
| logan- | scheduler logging can be pretty useless until you put it in debug mode | 20:10 |
| *** raddaoui has joined #openstack-ansible | 20:11 | |
| SamYaple | mhayden: with debug on the computes themselves will all report why they failed to schedule the instance if an attempt was made. but i would start with the scheduler and see why the sceduler is rejecting the computes (it may not ever be scehduling to the computes) | 20:12 |
| SamYaple | my bet is on disk space | 20:12 |
| mhayden | alrighty, i'll check that | 20:12 |
| admin0 | nova-compute.log usually gives that | 20:12 |
| admin0 | no host found : scheduler(disk/cpu/ram), image too big for flavor, neutron slow , anti-affinity and all other hosts filled up , | 20:13 |
| SamYaple | admin0: if the scheduler checks the db and it fails the host checks based on the database information the compute wont log anything if i recall correctly | 20:15 |
| logan- | yep, if it makes it to compute usually compute will get you decent log entries if it fails to scheduler. but if it is a scheduler filter issue then usually have to put scheduler in debug i've found as it will just give you "no hosts available" one liners | 20:17 |
| logan- | fails to scheduler* | 20:17 |
| logan- | schedule*... | 20:17 |
| mhayden | well it appears that wadeholler wins an internet today -- it was the allocation ratio | 20:17 |
| *** sdake has joined #openstack-ansible | 20:17 | |
| *** weezS has joined #openstack-ansible | 20:17 | |
| mhayden | it was set to 2.0 | 20:18 |
| mhayden | horizon had a big red circle that said "48 vcpus used out of 24" | 20:18 |
| *** eil397 has joined #openstack-ansible | 20:19 | |
| *** neilus has quit IRC | 20:20 | |
| *** adac has joined #openstack-ansible | 20:21 | |
| SamYaple | cpu_allocation_ratio = -1 | 20:21 |
| *** tiagogomes has quit IRC | 20:21 | |
| SamYaple | though you can force ignore those ratios with the admin role I believe, for testing | 20:22 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-os_neutron: Enable functional convergence testing https://review.openstack.org/291885 | 20:22 |
| mhayden | cpu_allocation_ratio = slumlord_host | 20:22 |
| mhayden | :P | 20:22 |
| SamYaple | no slumload would put it at 2.0 and then drop the cpu filter from the scheduler ;) | 20:23 |
| mhayden | haha | 20:23 |
| SamYaple | gotta hide that stuff | 20:23 |
| * mhayden is now the owner of 200 VM's :P | 20:24 | |
| *** cemmason has quit IRC | 20:25 | |
| mhayden | success? http://i.imgur.com/67zkvm5.png | 20:28 |
| palendae | mhayden: Only one of those is overallocated, so no | 20:29 |
| SamYaple | im making a note here : HUGE SUCCESS | 20:29 |
| SamYaple | this is a triumph | 20:29 |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-os_glance: Fixing Glance API startup failure and adding functional tests https://review.openstack.org/291793 | 20:30 |
| *** unlaudable has joined #openstack-ansible | 20:33 | |
| mhayden | see y'all in a week :) | 20:33 |
| automagically | Later mhayden. Enjoy that time off/away | 20:34 |
| *** kencjohnston has quit IRC | 20:34 | |
| stevelle | mhayden: we should all count in base 60 | 20:35 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron: Enable developer mode https://review.openstack.org/291445 | 20:36 |
| *** kencjohnston has joined #openstack-ansible | 20:36 | |
| *** thorst has quit IRC | 20:38 | |
| *** thorst has joined #openstack-ansible | 20:39 | |
| SamYaple | stevelle: what characterset? | 20:40 |
| stevelle | SamYaple: RFP | 20:42 |
| stevelle | bonus pts for inclusion of good emoji | 20:42 |
| *** asettle has joined #openstack-ansible | 20:42 | |
| openstackgerrit | Amy Marrich (spotz) proposed openstack/openstack-ansible: Added configuration information for using Ceph with Cinder https://review.openstack.org/290873 | 20:47 |
| *** asettle has quit IRC | 20:47 | |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-os_ceilometer: POC - Fail fast when required secrets are not present https://review.openstack.org/291908 | 20:56 |
| *** sdake has quit IRC | 20:58 | |
| openstackgerrit | Travis Truman (automagically) proposed openstack/openstack-ansible-os_glance: Fixing Glance API startup failure and adding functional tests https://review.openstack.org/291793 | 21:03 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 21:05 | |
| *** raddaoui has quit IRC | 21:07 | |
| *** raddaoui has joined #openstack-ansible | 21:08 | |
| *** inc0 has joined #openstack-ansible | 21:08 | |
| *** yarkot_ has joined #openstack-ansible | 21:17 | |
| openstackgerrit | Merged openstack/openstack-ansible: rootwrap configuration must be owned by root https://review.openstack.org/291858 | 21:19 |
| *** yarkot_ has quit IRC | 21:19 | |
| openstackgerrit | Merged openstack/openstack-ansible: rootwrap configuration must be owned by root https://review.openstack.org/291868 | 21:19 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 21:22 | |
| *** inc0 has quit IRC | 21:22 | |
| *** raddaoui has quit IRC | 21:27 | |
| *** phiche has joined #openstack-ansible | 21:30 | |
| *** ErwanJ has quit IRC | 21:34 | |
| *** ErwanJ has joined #openstack-ansible | 21:35 | |
| *** thorst has quit IRC | 21:35 | |
| *** raddaoui has joined #openstack-ansible | 21:36 | |
| *** javeriak_ has quit IRC | 21:37 | |
| *** wadeholler has quit IRC | 21:42 | |
| *** kencjohnston has quit IRC | 21:48 | |
| Bjoern_ | can we link the issue 1556231 to the cve bug? | 21:52 |
| cloudnull | Bjoern_: https://bugs.launchpad.net/openstack-ansible/+bug/1556231 | 21:54 |
| openstack | Launchpad bug 1556231 in openstack-ansible trunk "Rootwrap configuration has incorrect ownership" [Critical,Fix committed] - Assigned to Travis Truman (travis-truman) | 21:54 |
| cloudnull | theres no CVE ID however we've requested one. | 21:55 |
| Bjoern_ | ok | 21:55 |
| *** thorst has joined #openstack-ansible | 21:56 | |
| *** b3rnard0 is now known as b3rnard0_away | 21:57 | |
| *** johnmilton has quit IRC | 22:02 | |
| *** jaypipes has quit IRC | 22:02 | |
| *** dmsimard has joined #openstack-ansible | 22:03 | |
| nnbrian | Newbie question: during AIO install is there a way in user variables yml to tell pip to use --extra-index-url and --trusted_host? | 22:03 |
| *** KLevenstein has quit IRC | 22:03 | |
| *** phiche has quit IRC | 22:05 | |
| *** jthorne has quit IRC | 22:05 | |
| SamYaple | hey Bjoern_ | 22:06 |
| Bjoern_ | hey | 22:06 |
| *** Bjoern_ is now known as Bjoernt | 22:06 | |
| nnbrian | Basically, we're trying to add a local PyPi mirror so that we can test the installation of our own packages. Want pip to look there... | 22:07 |
| SamYaple | cloudnull: did you see what dehaan just posted? | 22:08 |
| SamYaple | cloudnull: http://michaeldehaan.net/post/140649196217/the-phoenix-is-not-burnt-out-it-is-just-rebooting | 22:08 |
| cloudnull | mancdaz: you can use the option "pip_install_options" in your user_* files | 22:08 |
| cloudnull | SamYaple: no i've not read his blog in a bit. | 22:09 |
| * cloudnull goes to read | 22:09 | |
| SamYaple | cloudnull: its the ravings of a madman! | 22:09 |
| SamYaple | cloudnull: in the title he calls himself the pheonix | 22:10 |
| SamYaple | im a bit in its pretty funny | 22:10 |
| *** jguy_ has quit IRC | 22:10 | |
| cloudnull | "To leave ego out of it, I’m pretty darn good as a developer..." | 22:11 |
| *** retreved has quit IRC | 22:11 | |
| SamYaple | cloudnull: he is the donald trump of the computer world! | 22:11 |
| SamYaple | im serious it reads like a trump quote | 22:11 |
| cloudnull | is he just saying the things we're all thinking :\ | 22:12 |
| SamYaple | ansible 2.0 == poo | 22:12 |
| * cloudnull is not thing the things Trump is saying btw .. | 22:12 | |
| SamYaple | "When I don't care, I'm happy, and I do great work. And people like this work, and as a result I start to care. When I care, I try to fix all the broken things and people don't like being told they are wrong, I am not happy seeing all the wrongness, and as a result, I learn to not care again. Thus I'm happiest when I don't care and completely incapable of remaining in a state where I don't care." | 22:13 |
| *** ametts has quit IRC | 22:14 | |
| cloudnull | he drinks flavor aid, I have grape drink | 22:14 |
| *** dmsimard is now known as dmsimard|pto | 22:15 | |
| *** phiche has joined #openstack-ansible | 22:16 | |
| SamYaple | cloudnull: i dont know that i can finish this. im glazing over | 22:16 |
| cloudnull | weeds, malcome in the middle, Jason Isbell song, --- we;re all over the place | 22:22 |
| SamYaple | "It's one of the reasons I'm frustrated in places where the data is hidden behind different levels" --- https://github.com/ansible/ansible/blob/v1.9.4-1/lib/ansible/module_common.py#L112-120 | 22:22 |
| SamYaple | he throws in a Dune reference otoo | 22:22 |
| palendae | He's right that people don't like hearing they're wrong | 22:23 |
| palendae | Like when they assemble python modules scattered across the code base to be shipping to a remote machine | 22:23 |
| SamYaple | how dare you say im wrong palendae! | 22:23 |
| palendae | shipped* | 22:23 |
| cloudnull | you all just dont care enough... | 22:24 |
| SamYaple | im burned out man | 22:24 |
| palendae | don't not care enough | 22:24 |
| * cloudnull runs down the hall | 22:24 | |
| SamYaple | im a pheonix thats rebooting | 22:24 |
| palendae | a phoenix bios? | 22:24 |
| SamYaple | i like the UEFI bioses now | 22:25 |
| SamYaple | got the mouse clickys | 22:25 |
| SamYaple | wierd that i like a mouse for my bios but a keyboard for everything else.... | 22:25 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-repo_build: Install packages necessary to build Python wheels https://review.openstack.org/291933 | 22:25 |
| SamYaple | i think i just dont like being told no | 22:25 |
| cloudnull | https://www.youtube.com/watch?v=JpSfgusep7s | 22:26 |
| cloudnull | ^pheonix rebooting | 22:26 |
| palendae | Needs the modem dial too | 22:26 |
| SamYaple | https://www.youtube.com/watch?v=Ht96HJ01SE4 | 22:26 |
| SamYaple | youre welcome ^ | 22:26 |
| palendae | https://youtu.be/o_XaJdDqQA0 | 22:26 |
| cloudnull | thats a good one | 22:26 |
| palendae | ^ formatting hard drive | 22:26 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-repo_server: Trim apt package list https://review.openstack.org/289510 | 22:27 |
| cloudnull | burn outs real for sure. | 22:27 |
| cloudnull | i think it effects us all , and differently | 22:27 |
| cloudnull | but that post was mental vomit. | 22:28 |
| cloudnull | hows things BTW SamYaple? | 22:33 |
| *** asettle has joined #openstack-ansible | 22:33 | |
| cloudnull | I wanted to say I talked a bit RE: Ekko to a lot of folks at the OPS midcycle a few weeks back | 22:33 |
| SamYaple | cool cloudnull | 22:33 |
| cloudnull | lots of potential interest once mitaka gets out the door | 22:33 |
| SamYaple | we plan to have a working backup/restore by mitaka release, though that wont be a 1.0 | 22:34 |
| SamYaple | then theres things like scheduling and integration with nova and retention | 22:34 |
| cloudnull | nice! | 22:34 |
| SamYaple | were shooting for a 1.0 in newton | 22:34 |
| cloudnull | I'd like to see OSIC back that project too. | 22:35 |
| SamYaple | well the way i see it, we need people using it to get the drive to get the nova stuff in place | 22:35 |
| SamYaple | it took me 2 months to get a fix into place AFTER liberty released that broke ceph completely with nova | 22:36 |
| SamYaple | it was fairly simple too | 22:36 |
| cloudnull | yea. nova's a beast to break into ... | 22:36 |
| SamYaple | so its kinda a wierd situation. the way i have it now is the backup agent on the compute node talks directly to libvirt which is not ideal | 22:36 |
| SamYaple | it doesnt interfere with nova from what ive seen, but it *could* | 22:37 |
| cloudnull | so long as you can lock the state that shouldnt be all that bad . | 22:37 |
| SamYaple | i cant thats the thing | 22:37 |
| * cloudnull maybe overlooking/simplifying things | 22:37 | |
| SamYaple | i need a NOVA_DONT_TOUCH_THIS state for the instance | 22:37 |
| SamYaple | but short of tweaking the nova database directly, im not sure how to do that | 22:38 |
| *** asettle has quit IRC | 22:38 | |
| SamYaple | to be fair, i havent tought about it much, too much math going on right now | 22:38 |
| cloudnull | the math's will do that to you :) | 22:38 |
| cloudnull | yea reset-state command in nova is rather limited. | 22:39 |
| cloudnull | and you cant force state, to my knowledge . | 22:39 |
| SamYaple | i can reset it to error or active, and that might work, but it triggers other actions from nova afaik | 22:39 |
| cloudnull | yea error could result in data-loss | 22:40 |
| cloudnull | if the clean up process nukes an ephemeral disk | 22:40 |
| SamYaple | right some for now its "dont touch the instance while ekko is using it" | 22:40 |
| *** raddaoui has quit IRC | 22:41 | |
| SamYaple | talked with duncant from cinder and i might be able to generate backups that can be converted to cinder-backup copies with metadata generation only | 22:42 |
| SamYaple | assuming no compression/encryption | 22:42 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-repo_build: Install packages necessary to build Python wheels https://review.openstack.org/291933 | 22:43 |
| cloudnull | that'd be useful. | 22:43 |
| *** Bjoernt has quit IRC | 22:47 | |
| *** scarlisle has quit IRC | 22:50 | |
| *** dmsimard|pto has quit IRC | 22:52 | |
| cloudnull | SamYaple: looking at the nova code to change an instance task state, that looks kinda like a mess without direct nova integration... | 22:59 |
| cloudnull | once you have an instance object you can call instance.task_state = task_state; instance.save() but getting there looks miserable. | 23:00 |
| *** asettle has joined #openstack-ansible | 23:01 | |
| *** unlaudable has quit IRC | 23:04 | |
| *** raddaoui has joined #openstack-ansible | 23:05 | |
| *** admin0 has quit IRC | 23:07 | |
| *** asettle has quit IRC | 23:09 | |
| *** ShannonM has quit IRC | 23:18 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 23:22 | |
| SamYaple | cloudnull: thats the conclusion i came to as well | 23:26 |
| cloudnull | yea, its a bit fugly. | 23:26 |
| *** raddaoui has quit IRC | 23:26 | |
| SamYaple | i like the "dont touch the instances while using ekko" approach | 23:26 |
| SamYaple | at least for now | 23:26 |
| SamYaple | i need to tell nova to lock it down something else is goign on, that oculd be useful outside of ekko too | 23:26 |
| SamYaple | some type of lock-state state | 23:26 |
| cloudnull | when UsingEkko():\n no_stop_dont() | 23:27 |
| cloudnull | that works for now. | 23:27 |
| cloudnull | im surprised theres not a better way to munge state. | 23:27 |
| cloudnull | but in my quick look, it looks miserable | 23:27 |
| SamYaple | reset to error or active, thats all you get | 23:27 |
| SamYaple | not even shutdown! thats what bugs me | 23:28 |
| cloudnull | yea. sux | 23:28 |
| SamYaple | i rarely need to reset to ACTIVE | 23:28 |
| SamYaple | shutdown, sure | 23:28 |
| SamYaple | but active? | 23:28 |
| cloudnull | also if im reseting the state, the instance is likely not "active" | 23:28 |
| SamYaple | thats what im saying | 23:29 |
| cloudnull | pending, paused, foobar, but not active | 23:29 |
| SamYaple | or "I accidenteally reset migration state, let me tell you what state its supposed to be in dammit!" state | 23:29 |
| SamYaple | twas a many nights i was frusterated with that | 23:30 |
| *** eil397 has quit IRC | 23:30 | |
| cloudnull | but ass the Phoenix once said, "It Is Just Rebooting" | 23:31 |
| *** eil397 has joined #openstack-ansible | 23:31 | |
| cloudnull | *as | 23:31 |
| SamYaple | THE Phoenix | 23:32 |
| cloudnull | Im off, BBL. | 23:32 |
| cloudnull | have a good one all | 23:32 |
| *** phiche has quit IRC | 23:32 | |
| SamYaple | see ya man | 23:33 |
| *** bryan_att has quit IRC | 23:37 | |
| *** thorst is now known as thorst_afk | 23:42 | |
| *** adac has quit IRC | 23:42 | |
| *** asettle has joined #openstack-ansible | 23:42 | |
| *** asettle has quit IRC | 23:49 | |
| *** weezS has quit IRC | 23:54 | |
| *** spotz is now known as spotz_zzz | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
