| *** dcdamien has quit IRC | 00:21 | |
| *** dcdamien has joined #openstack-ansible | 00:24 | |
| *** macza has joined #openstack-ansible | 00:31 | |
| *** macza has joined #openstack-ansible | 00:32 | |
| *** gyee has quit IRC | 00:45 | |
| *** markvoelker has quit IRC | 00:54 | |
| *** markvoelker has joined #openstack-ansible | 00:54 | |
| *** cshen has joined #openstack-ansible | 00:56 | |
| *** lbragstad has quit IRC | 00:59 | |
| *** markvoelker has quit IRC | 00:59 | |
| *** cshen has quit IRC | 01:01 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update the embedded-ansible-setup process to be configurable https://review.openstack.org/628321 | 01:08 |
|---|---|---|
| *** lbragstad has joined #openstack-ansible | 01:08 | |
| *** lbragstad has quit IRC | 01:09 | |
| *** tosky has quit IRC | 01:17 | |
| *** mbuil_ has quit IRC | 01:22 | |
| *** flaviosr_ has quit IRC | 01:23 | |
| *** dcdamien has quit IRC | 01:23 | |
| *** sum12 has quit IRC | 01:24 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update the embedded-ansible-setup process to be configurable https://review.openstack.org/628321 | 01:25 |
| *** sum12 has joined #openstack-ansible | 01:28 | |
| *** flaviosr_ has joined #openstack-ansible | 01:29 | |
| *** dave-mccowan has quit IRC | 01:41 | |
| *** dave-mccowan has joined #openstack-ansible | 01:50 | |
| *** macza has quit IRC | 01:53 | |
| *** markvoelker has joined #openstack-ansible | 01:55 | |
| *** macza has joined #openstack-ansible | 01:56 | |
| *** markvoelker has quit IRC | 02:46 | |
| *** markvoelker has joined #openstack-ansible | 02:46 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update the embedded-ansible-setup process to be configurable https://review.openstack.org/628321 | 02:52 |
| *** cshen has joined #openstack-ansible | 02:57 | |
| *** cshen has quit IRC | 03:02 | |
| *** hwoarang has quit IRC | 03:09 | |
| *** hwoarang has joined #openstack-ansible | 03:10 | |
| *** chhagarw has quit IRC | 03:14 | |
| *** hwoarang has quit IRC | 03:18 | |
| *** hwoarang_ has joined #openstack-ansible | 03:18 | |
| *** cshen has joined #openstack-ansible | 03:47 | |
| *** cshen has quit IRC | 03:52 | |
| *** shyamb has joined #openstack-ansible | 03:59 | |
| *** macza has quit IRC | 04:05 | |
| *** shyamb has quit IRC | 04:14 | |
| *** chhagarw has joined #openstack-ansible | 04:17 | |
| *** dave-mccowan has quit IRC | 04:25 | |
| *** shardy has quit IRC | 04:33 | |
| *** shardy has joined #openstack-ansible | 04:34 | |
| *** udesale has joined #openstack-ansible | 04:52 | |
| *** chhagarw has quit IRC | 04:54 | |
| *** cshen has joined #openstack-ansible | 05:36 | |
| *** shyamb has joined #openstack-ansible | 05:37 | |
| *** cshen has quit IRC | 05:41 | |
| *** macza has joined #openstack-ansible | 05:48 | |
| *** shyamb has quit IRC | 05:56 | |
| *** shyamb has joined #openstack-ansible | 06:01 | |
| *** DanyC has joined #openstack-ansible | 06:03 | |
| *** DanyC has quit IRC | 06:08 | |
| *** macza has quit IRC | 06:18 | |
| *** hamzaachi has joined #openstack-ansible | 06:24 | |
| *** hwoarang_ has quit IRC | 06:25 | |
| *** radeks_ has joined #openstack-ansible | 06:28 | |
| *** hwoarang has joined #openstack-ansible | 06:29 | |
| *** mhayden has quit IRC | 06:37 | |
| *** hamzaachi has quit IRC | 06:39 | |
| *** mhayden has joined #openstack-ansible | 06:40 | |
| *** mbuil has joined #openstack-ansible | 07:07 | |
| *** shyamb has quit IRC | 07:08 | |
| *** cshen has joined #openstack-ansible | 07:15 | |
| *** jawad_axd has joined #openstack-ansible | 07:21 | |
| *** hamzaachi has joined #openstack-ansible | 07:26 | |
| *** mathlin_ has joined #openstack-ansible | 07:26 | |
| *** shyamb has joined #openstack-ansible | 07:50 | |
| fnpanic | good morning | 07:51 |
| fnpanic | or better hi ;-) | 07:54 |
| *** shyamb has quit IRC | 07:57 | |
| *** shardy has quit IRC | 08:05 | |
| *** shardy has joined #openstack-ansible | 08:05 | |
| *** markvoelker has quit IRC | 08:08 | |
| *** markvoelker has joined #openstack-ansible | 08:08 | |
| *** markvoelker has quit IRC | 08:13 | |
| openstackgerrit | Manuel Buil proposed openstack/openstack-ansible-os_neutron master: Use the new services names for sfc https://review.openstack.org/622216 | 08:14 |
| *** shyamb has joined #openstack-ansible | 08:16 | |
| *** cshen has quit IRC | 08:18 | |
| *** DanyC has joined #openstack-ansible | 08:24 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing python-tempestconf from git https://review.openstack.org/625904 | 08:28 |
| *** kopecmartin|off is now known as kopecmartin | 08:28 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_tempestconf_profile for handling named args https://review.openstack.org/623187 | 08:38 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_tempestconf_profile for handling named args https://review.openstack.org/623187 | 08:39 |
| *** tosky has joined #openstack-ansible | 08:47 | |
| *** DanyC has quit IRC | 08:47 | |
| *** DanyC has joined #openstack-ansible | 08:48 | |
| *** udesale has quit IRC | 08:52 | |
| *** DanyC has quit IRC | 08:53 | |
| *** udesale has joined #openstack-ansible | 08:54 | |
| *** hamzaachi has quit IRC | 08:57 | |
| chandankumar | arxcruz: hello | 09:00 |
| arxcruz | chandankumar: hello | 09:01 |
| chandankumar | arxcruz: https://review.openstack.org/#/c/628182/4 | 09:01 |
| chandankumar | arxcruz: the grep part is not working, please have a look and suggest something | 09:02 |
| chandankumar | i think it should not return error it should be handled with in condition | 09:02 |
| chandankumar | I am not sure | 09:02 |
| *** shyamb has quit IRC | 09:17 | |
| *** DanyC has joined #openstack-ansible | 09:25 | |
| *** shardy has quit IRC | 09:27 | |
| *** shardy has joined #openstack-ansible | 09:27 | |
| *** DanyC has quit IRC | 09:29 | |
| *** DanyC has joined #openstack-ansible | 09:29 | |
| *** DanyC has quit IRC | 09:30 | |
| *** DanyC has joined #openstack-ansible | 09:31 | |
| *** hamzaachi has joined #openstack-ansible | 09:35 | |
| *** udesale has quit IRC | 09:39 | |
| *** udesale has joined #openstack-ansible | 09:40 | |
| *** cshen has joined #openstack-ansible | 09:47 | |
| *** cshen has quit IRC | 09:52 | |
| *** hamzaachi has quit IRC | 09:55 | |
| *** dcdamien has joined #openstack-ansible | 10:01 | |
| *** markvoelker has joined #openstack-ansible | 10:09 | |
| *** hamzaachi has joined #openstack-ansible | 10:36 | |
| fnpanic | quick question, is it possibel to use sudo "become" and not root for OSA? | 11:11 |
| fnpanic | deployment docs state "OpenStack-Ansible deployments require the presence of a /root/.ssh/id_rsa.pub" | 11:20 |
| fnpanic | this is referring to the containers | 11:21 |
| jrosser | i would ignore that | 11:24 |
| jrosser | from https://docs.openstack.org/project-deploy-guide/openstack-ansible/rocky/targethosts.html#configure-ssh-keys | 11:24 |
| jrosser | "Copy the contents of the public key file on the deployment host to the /root/.ssh/authorized_keys file on each target host." <- that is what you must do | 11:24 |
| *** shyamb has joined #openstack-ansible | 11:29 | |
| *** xenefix has joined #openstack-ansible | 11:30 | |
| fnpanic | mhhh | 11:31 |
| fnpanic | jrosser: not sure what you are telling me :-) | 11:31 |
| fnpanic | or better trying to tell me | 11:32 |
| fnpanic | our maas deploys all hosts with a sudo user with pub key auth | 11:32 |
| shyamb | Hi | 11:32 |
| fnpanic | but th playbooks seem to require root | 11:32 |
| jrosser | correct | 11:32 |
| shyamb | How openstack containers are setting number of open files parameter? | 11:33 |
| jrosser | you need to by some means meet the OSA host setup requirements | 11:33 |
| shyamb | i.e ulimit parameter of os | 11:33 |
| fnpanic | jrosser: ok and the requirements are connect as root to the target hosts right? | 11:34 |
| xenefix | you can always trick it to use root using a sudo paswordless user | 11:35 |
| fnpanic | ? | 11:36 |
| fnpanic | this is our setup | 11:36 |
| fnpanic | we cann access the target hosts with a normal user via public key and then do a passwordless sudo | 11:36 |
| fnpanic | the question is if this is supportedt and tested | 11:37 |
| fnpanic | if not we will stick with root | 11:37 |
| xenefix | Yup, seems security best practice. I got rid of the whole bash wrapper stuff so it works with my setup not using root, but I think it's hardcoded to use root | 11:37 |
| fnpanic | mhhh ok | 11:38 |
| jrosser | shyamb: a few of the containers set ulimit stuff, like galera/rabbit/memcached - is there any one in particular? | 11:40 |
| shyamb | I want to set that limit on one of my openstack container | 11:40 |
| xenefix | fnpanic: did you get the AIO to work? | 11:41 |
| shyamb | I just wanted to check the approach on how can I do the same | 11:41 |
| fnpanic | yes | 11:41 |
| shyamb | jrosser: any document related to this configuration? | 11:41 |
| jrosser | shyamb: do you mean one of the openstack infrastructure containers created by openstack-ansible? | 11:41 |
| shyamb | jrosser: no, it's our custom plugin container related to openstack | 11:44 |
| shyamb | currently not pushed to upstream yet | 11:44 |
| *** hamzaachi has quit IRC | 11:46 | |
| jrosser | shyamb: i'm not sure if it is relevant or not but you could follow through where and how this variable is used for an example https://github.com/openstack/openstack-ansible-rabbitmq_server/blob/master/defaults/main.yml#L89-L90 | 11:47 |
| shyamb | sure | 11:48 |
| shyamb | jrosser: thank you | 11:48 |
| *** cshen has joined #openstack-ansible | 11:48 | |
| *** cshen has quit IRC | 11:53 | |
| jrosser | fnpanic: the short answer is that the tested and supported connection method is as the documentation says | 11:53 |
| fnpanic | :-) ok | 11:54 |
| fnpanic | that is fine for me | 11:54 |
| jrosser | but you are completely free to do whatever you like to the target hosts sshd config and your deploy host .ssh/config to constrcut something different | 11:54 |
| jrosser | i do x509 certificate auth for example | 11:54 |
| fnpanic | no no | 11:54 |
| fnpanic | ok.... | 11:54 |
| jrosser | but thats not tested / supported by OSA in any way | 11:55 |
| fnpanic | i guess so :-9 | 11:55 |
| xenefix | I just realised after a reboot that predictable interface naming got turned off , is this on purpose? | 12:22 |
| *** vollman has joined #openstack-ansible | 12:58 | |
| chandankumar | jrosser: Hello | 13:02 |
| chandankumar | jrosser: I have a query https://github.com/openstack/openstack-ansible-os_tempest/blob/master/tasks/tempest_resources.yml#L59 | 13:02 |
| chandankumar | jrosser: from where cloud: default is coming is it from from clouds.yaml file? | 13:03 |
| *** rawool has joined #openstack-ansible | 13:06 | |
| *** cshen has joined #openstack-ansible | 13:18 | |
| xenefix | https://docs.ansible.com/ansible/latest/modules/os_image_module.html | 13:19 |
| *** cshen has quit IRC | 13:22 | |
| jrosser | chandankumar: here i think https://github.com/openstack/openstack-ansible-openstack_openrc/blob/master/templates/clouds.yaml.j2#L3 | 13:23 |
| chandankumar | jrosser: ok, for os_tempest I think we need to make that piece configurable | 13:26 |
| chandankumar | for devstack or tripleo that might be different | 13:26 |
| jrosser | adding openrc_clouds_yml_cloud: default to defaults/main.yml and using it in the template? | 13:29 |
| *** hamzaachi has joined #openstack-ansible | 13:32 | |
| *** markvoelker has quit IRC | 13:33 | |
| *** markvoelker has joined #openstack-ansible | 13:33 | |
| *** DanyC has quit IRC | 13:50 | |
| *** DanyC has joined #openstack-ansible | 13:52 | |
| *** shyamb has quit IRC | 14:01 | |
| *** dave-mccowan has joined #openstack-ansible | 14:03 | |
| chandankumar | jrosser: no | 14:05 |
| chandankumar | jrosser: this tripleo ci os_tempest integration job failed here http://logs.openstack.org/00/627500/17/check/tripleo-ci-centos-7-standalone-os-tempest/88b343c/job-output.txt.gz#_2019-01-03_12_46_24_790994 | 14:07 |
| chandankumar | jrosser: there is no cloud named default there | 14:07 |
| chandankumar | jrosser: there we have standalone for ci purpose | 14:07 |
| chandankumar | jrosser: So I was thinking to add new var named os_cloud: <name of the cloud to use from clouds.yaml> and default to default and re-use that var in tempest_resources.yaml | 14:08 |
| chandankumar | jrosser: for devstack side we can easily change it | 14:08 |
| chandankumar | jrosser: in devstack we have devstack-admin, devstack, demo | 14:08 |
| jrosser | makes sense | 14:08 |
| *** lbragstad has joined #openstack-ansible | 14:09 | |
| chandankumar | jrosser: cool, I will propose a patch then thanks :-) | 14:09 |
| *** hamzaachi has quit IRC | 14:11 | |
| *** hamzaachi has joined #openstack-ansible | 14:11 | |
| *** hamzaachi has quit IRC | 14:16 | |
| *** shardy has quit IRC | 14:23 | |
| *** udesale has quit IRC | 14:59 | |
| *** macza has joined #openstack-ansible | 15:12 | |
| *** jawad_axd has quit IRC | 15:13 | |
| *** macza has quit IRC | 15:13 | |
| *** jawad_axd has joined #openstack-ansible | 15:14 | |
| *** jawad_axd has quit IRC | 15:16 | |
| *** hamzaachi has joined #openstack-ansible | 15:17 | |
| *** cshen has joined #openstack-ansible | 15:19 | |
| *** thuydang has joined #openstack-ansible | 15:20 | |
| *** cshen has quit IRC | 15:24 | |
| *** thuydang has quit IRC | 15:31 | |
| *** lbragstad has quit IRC | 15:36 | |
| *** vicky84 has joined #openstack-ansible | 15:36 | |
| *** lbragstad has joined #openstack-ansible | 15:40 | |
| *** redrobot has joined #openstack-ansible | 15:59 | |
| *** jwitko_ has quit IRC | 16:09 | |
| *** deployer2 has joined #openstack-ansible | 16:10 | |
| *** arxcruz is now known as arxcruz|brb | 16:11 | |
| deployer2 | Hi, anyone using install_method:distro ? Wondering how it works in long term, ubuntu as base platform. As I understand Ubuntu releases OpenStack packages along with OpenStack releases - should be possible to upgrade to new releases. Any issues with distro method? | 16:13 |
| redrobot | Ohai spotz! I got some questions for you. :D | 16:20 |
| openstackgerrit | jacky06 proposed openstack/ansible-role-systemd_mount master: Update hacking version to latest https://review.openstack.org/628547 | 16:22 |
| openstackgerrit | jacky06 proposed openstack/ansible-role-systemd_networkd master: Update hacking version to latest https://review.openstack.org/628549 | 16:22 |
| openstackgerrit | jacky06 proposed openstack/ansible-role-systemd_service master: Update hacking version to latest https://review.openstack.org/628550 | 16:22 |
| spotz | hey redrobot! | 16:25 |
| * redrobot waves at spotz! 👋👋👋 | 16:25 | |
| jrosser | deployer2: the ubuntu distro CI jobs look to be passing currently, but i'm not sure there is much confidence to be taken from that right now as they are set as non-voting | 16:26 |
| redrobot | spotz, heya! So I'm writing a couple of ansible roles for some new TripleO things and I was wondering what the process would be to create a couple of new repos under openstack-ansible. | 16:26 |
| jrosser | deployer2: and you can do upgrades today with the source installs no problem, thats fairly well battle tested | 16:26 |
| spotz | redrobot: Hrm, I would say it's a PTL thing cause I know I've seen it happen in the past. I also know there's been some work for jooint plays/roles with tripleO but can't remember where those are. mnaser? | 16:27 |
| mnaser | redrobot: o/ | 16:27 |
| jrosser | deployer2: so i wouldn't be picking distro installs today on the basis it provides an upgrade route, as an upgrade needs to be carefully orchestrated regardless of distro/source install | 16:28 |
| mnaser | we are doing some joint work on os_tempest with the tripleo team :) | 16:28 |
| mnaser | redrobot: love to hear what type of roles are you targeting and chat more about it! | 16:28 |
| redrobot | mnaser, the main goal is to be able to deploy Barbican with hardware HSM backends. We've got two roles, each for a different HSM. | 16:29 |
| *** macza has joined #openstack-ansible | 16:29 | |
| mnaser | redrobot: oh that's aweseome | 16:29 |
| spotz | redrobot: I was hoping you were back Barbicaning!:) | 16:29 |
| mnaser | we have a role that deploys barbican now, i'd love to see it integrated with HSMs too so we use one role but it configures specifically to any HSMs | 16:29 |
| redrobot | mnaser, so one role would be ansible-role-thales-hsm, which would install Thales HSM client software on a controller node. | 16:30 |
| redrobot | the other is ansible-role-atos-hsm which does the same for ATOS client software | 16:30 |
| deployer2 | jrosser, thanks for clarification | 16:33 |
| redrobot | spotz, yep, super excited about working on barbican/castellan again :D | 16:34 |
| spotz | redrobot: Once a Barbicaneer, always a Barbicaneer:) | 16:35 |
| *** cshen has joined #openstack-ansible | 16:35 | |
| mnaser | redrobot: i mean we have similar workflows in os_neutron | 16:37 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update the embedded-ansible-setup process to be configurable https://review.openstack.org/628321 | 16:38 |
| mnaser | with things like different drivers support, such as odl, etc | 16:38 |
| chandankumar | jrosser: mnaser cloudnull https://review.openstack.org/#/c/625904/ and https://review.openstack.org/#/c/623187/ please have a look when free | 16:40 |
| jenglisch | ceph-ansible supports creating crush trees from the ceph inventory directly ; is there a possibility to add host properties to the openstack-ansible defined hosts aswell ? | 16:40 |
| jenglisch | https://github.com/ceph/ceph-ansible/blob/v3.1.12/group_vars/mons.yml.sample#L65 | 16:40 |
| mnaser | jenglisch: should be possible | 16:41 |
| mnaser | we only really just call the playbooks | 16:41 |
| mnaser | so you can put whatever overrides you want in there | 16:41 |
| jenglisch | yep, i try to dig into the dynamic_inventory. since openstack-ansible generates the inventory dynamically i think it should be placed somwehere in the openstack_user_config.yml ? | 16:42 |
| *** dcdamien has quit IRC | 16:46 | |
| jenglisch | could i just add a new property like "my_prop: my_val" under "infra1:" ? https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.prod.example#L123 | 16:47 |
| jenglisch | and its treated as an host variable afterwards | 16:48 |
| *** macza has quit IRC | 16:49 | |
| *** macza has joined #openstack-ansible | 16:49 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_cloudrc for setting cloudname https://review.openstack.org/628610 | 16:50 |
| chandankumar | jrosser: ^^ | 16:50 |
| *** thuydang has joined #openstack-ansible | 16:54 | |
| openstackgerrit | Jakob Englisch proposed openstack/openstack-ansible master: Fix ceph example https://review.openstack.org/628625 | 17:03 |
| *** jbadiapa has quit IRC | 17:04 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Correct spelling mistakes https://review.openstack.org/619530 | 17:11 |
| mnaser | jenglisch: just throw it in user_variables.yml :) | 17:12 |
| jenglisch | well, /etc/openstack_deploy/host_vars i guess then | 17:17 |
| *** cshen has quit IRC | 17:19 | |
| *** thuydang has quit IRC | 17:22 | |
| mnaser | cloudnull: noticed filebeat ever eating a LOT of memory? | 17:24 |
| mnaser | i'm considering setting up systemd cgroup limits to avoid it from blowing up | 17:25 |
| mnaser | qemu-kvm oom are not fun | 17:25 |
| *** cshen has joined #openstack-ansible | 17:27 | |
| *** dcdamien has joined #openstack-ansible | 17:27 | |
| cloudnull | mnaser i've not seen filebeat chew up memory. packetbeat I've seen devour memory. | 17:28 |
| mnaser | oh yeah, i've rm'd packetbeat, it was hammering the cluster | 17:28 |
| cloudnull | we now only install it on the infra nodes. | 17:32 |
| cloudnull | well its installed everywhere but only enabled on the compute nodes. | 17:32 |
| *** cshen has quit IRC | 17:33 | |
| cloudnull | s/compute nodes/infra nodes/g | 17:34 |
| cloudnull | https://github.com/rcbops/magnanimous-turbo-chainsaw/blob/master/playbooks/templates/user_tools_variables.yml.j2#L48-L63 | 17:35 |
| *** hamzaachi has quit IRC | 17:36 | |
| *** DanyC has quit IRC | 17:44 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update the embedded-ansible-setup process to be configurable https://review.openstack.org/628321 | 17:46 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_tempest master: Fix tempest workspace path https://review.openstack.org/628182 | 17:47 |
| *** hamzaachi has joined #openstack-ansible | 17:48 | |
| *** hamzaachi has quit IRC | 17:57 | |
| *** hamzaachi has joined #openstack-ansible | 17:57 | |
| *** kopecmartin is now known as kopecmartin|off | 17:58 | |
| *** cshen has joined #openstack-ansible | 18:03 | |
| *** gyee has joined #openstack-ansible | 18:04 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_tempest master: Fix tempest workspace path https://review.openstack.org/628182 | 18:06 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_tempest master: Fix tempest workspace path https://review.openstack.org/628182 | 18:07 |
| *** cshen has quit IRC | 18:08 | |
| *** tosky has quit IRC | 18:09 | |
| *** dcdamien has quit IRC | 18:22 | |
| *** hamzaachi has quit IRC | 18:29 | |
| cloudnull | If anyone has RedHat partner portal access and would like to join the good fight it'd be appreciated: https://bugzilla.redhat.com/show_bug.cgi?id=1650342 -- we use networkd in cent7, SUSE 42/15, Ubuntu 16/18 and having to refactor things to make just cent8 would suck. | 18:35 |
| openstack | bugzilla.redhat.com bug 1650342 in systemd "systemd-networkd support in RHEL 8" [Unspecified,New] - Assigned to systemd-maint | 18:35 |
| * cloudnull will be pushing on relationship folks internally too. | 18:36 | |
| *** noonedeadpunk has quit IRC | 18:38 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Update the embedded-ansible-setup process to be configurable https://review.openstack.org/628321 | 18:39 |
| *** cshen has joined #openstack-ansible | 18:44 | |
| *** hamzaachi has joined #openstack-ansible | 18:44 | |
| *** cshen has quit IRC | 18:48 | |
| nsmeds | shot in the dark - has anyone seen `Lost connection to MySQL server during query` in Nova API container logs? It occurs once a day, everyday, at the same time. I've been searching for some Galera backup schedule, cron, and systemd timer - but no luck so far | 18:50 |
| nsmeds | curious if OSA sets up some daily-scheduled event that would cause this (or if y'all know of anything else that could cause) | 18:50 |
| *** cshen has joined #openstack-ansible | 18:57 | |
| *** dcdamien has joined #openstack-ansible | 18:59 | |
| *** cshen has quit IRC | 19:02 | |
| *** hamzaachi has quit IRC | 19:04 | |
| cloudnull | nsmeds there's no specific db backup solution we provide by default. | 19:10 |
| cloudnull | I know some folks use holland to do that | 19:10 |
| cloudnull | maybe something like that running in the environment. | 19:10 |
| cloudnull | if could just be an option connection that is finally terminated? | 19:11 |
| nsmeds | cloudnull: figured, since I wasn't able to find anything in /etc/mysql/ configs. I'll look into holland but don't believe we use. Will keep investigating | 19:12 |
| cloudnull | out of curiosity what time does it happen ? | 19:13 |
| nsmeds | noticed because have Python script that provisions+deletes an instance every few minutes as a type of health check (just calling openstack APIs), and often it either fails to provision or terminate at that time everyday | 19:14 |
| nsmeds | ~4 hours and 15 min ago | 19:14 |
| *** dcdamien has quit IRC | 19:14 | |
| nsmeds | it's... interesting | 19:15 |
| *** mmercer has joined #openstack-ansible | 19:19 | |
| *** mmercer has quit IRC | 19:20 | |
| *** mmercer has joined #openstack-ansible | 19:21 | |
| nsmeds | gonna enable more verbose logging, slow query logging, etc. and review again tomorrow | 19:22 |
| spotz | nsmeds: Also look for any network related possibilities if it's not an AIO | 19:26 |
| nsmeds | kk | 19:28 |
| cloudnull | nsmeds what release ? | 19:28 |
| nsmeds | queens | 19:28 |
| cloudnull | hum. you could setup osprofiler | 19:29 |
| cloudnull | something like https://github.com/openstack/openstack-ansible-ops/tree/master/elk_metrics_6x#optional--add-osprofiler-to-an-openstack-ansible-deployment | 19:29 |
| cloudnull | have it forward data into an elasticsearch cluster | 19:29 |
| nsmeds | specifically 17.1.3 | 19:29 |
| cloudnull | then have your script run with the --profile $HMAC flag | 19:29 |
| cloudnull | that would prfile the command, all of the API interactions, DB calls, etc. | 19:30 |
| nsmeds | ok, I'll make a note of that. Was reviewing elk_metricx_6x a few weeks ago as we plan to set it up in the next month =) | 19:30 |
| cloudnull | and give you a way to go back through the output to see what's what | 19:30 |
| cloudnull | otherwise I think increasing log verbosity is your best bet. | 19:31 |
| nsmeds | yep - I'll start there. If cannot resolve, will come back to it after ELK setup | 19:31 |
| nsmeds | thanks again as always | 19:31 |
| cloudnull | anytime, and let us know what you find out . | 19:32 |
| * cloudnull curious | 19:32 | |
| nsmeds | curiosity killed the cat | 19:32 |
| cloudnull | fact! | 19:36 |
| *** cshen has joined #openstack-ansible | 19:38 | |
| *** cshen has quit IRC | 19:43 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-role-systemd_mount master: Ensure mounts are able to be network aware https://review.openstack.org/627318 | 20:06 |
| *** cshen has joined #openstack-ansible | 20:13 | |
| *** cshen has quit IRC | 20:18 | |
| *** cshen has joined #openstack-ansible | 20:33 | |
| openstackgerrit | Merged openstack/ansible-role-systemd_networkd master: Replace Chinese punctuation with English punctuation https://review.openstack.org/613878 | 20:42 |
| openstackgerrit | Merged openstack/ansible-role-systemd_networkd master: Change openstack-dev to openstack-discuss https://review.openstack.org/621853 | 20:42 |
| openstackgerrit | Merged openstack/ansible-role-systemd_mount master: Ensure mounts are able to be network aware https://review.openstack.org/627318 | 20:42 |
| openstackgerrit | Merged openstack/ansible-role-systemd_mount master: Change openstack-dev to openstack-discuss https://review.openstack.org/621858 | 20:43 |
| openstackgerrit | Merged openstack/ansible-role-systemd_mount master: Replace Chinese punctuation with English punctuation https://review.openstack.org/613882 | 20:43 |
| openstackgerrit | Merged openstack/ansible-role-systemd_service master: Replace Chinese punctuation with English punctuation https://review.openstack.org/613879 | 20:43 |
| *** cshen has quit IRC | 20:43 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Add tasks to remove legacy files https://review.openstack.org/607462 | 20:44 |
| openstackgerrit | Merged openstack/ansible-role-systemd_service master: Change openstack-dev to openstack-discuss https://review.openstack.org/621848 | 20:46 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Add tasks to remove legacy files https://review.openstack.org/607462 | 20:53 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Change subvolume create to unmask errors https://review.openstack.org/578535 | 20:53 |
| *** macza has quit IRC | 21:04 | |
| *** macza has joined #openstack-ansible | 21:04 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_tempest master: Fix tempest workspace path https://review.openstack.org/628182 | 21:27 |
| *** dave-mccowan has quit IRC | 21:42 | |
| *** radeks_ has quit IRC | 21:47 | |
| mnaser | cloudnull: looks like elastic came up with their own journalbeat | 21:56 |
| mnaser | oh | 21:57 |
| mnaser | you already sent a patch for that :) | 21:57 |
| mnaser | idk why i was under the impression you were using that fork | 21:57 |
| *** macza has quit IRC | 22:08 | |
| *** sc has quit IRC | 22:22 | |
| *** cshen has joined #openstack-ansible | 22:40 | |
| *** cshen has quit IRC | 22:45 | |
| *** jbadiapa has joined #openstack-ansible | 22:50 | |
| *** cshen has joined #openstack-ansible | 22:52 | |
| *** cshen has quit IRC | 22:57 | |
| *** hwoarang has quit IRC | 23:03 | |
| *** hwoarang has joined #openstack-ansible | 23:04 | |
| *** Adri2000 has quit IRC | 23:22 | |
| *** Adri2000 has joined #openstack-ansible | 23:25 | |
| *** openstack has joined #openstack-ansible | 23:47 | |
| *** ChanServ sets mode: +o openstack | 23:47 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!