openstackgerrit | Merged openstack/ansible-role-ara master: Fix the apache_config_path on Debian.yml vars file https://review.openstack.org/553086 | 00:15 |
---|---|---|
*** jparrill has quit IRC | 00:57 | |
dmsimard | harlowja: hey, I wasn't able to get to the bottom of anything last night but I did come up with something to reproduce it with | 00:59 |
harlowja | woot | 01:00 |
dmsimard | harlowja: about lazy = dynamic, I have no clue | 01:00 |
harlowja | kk | 01:00 |
dmsimard | harlowja: I'm not seeing the high memory usage.. how many playbooks do you have in your database ? | 01:40 |
harlowja | 124 | 01:40 |
dmsimard | harlowja: I wanted to show you but asciinema says it's too big lol | 01:42 |
dmsimard | lemme try again and make it quicker or something .. | 01:42 |
harlowja | ya, i can do a hangout or something with u to show u if u want | 01:42 |
harlowja | just i had to purge it from our active DB | 01:42 |
harlowja | but easy to make it again, lol | 01:42 |
dmsimard | sec | 01:43 |
dmsimard | harlowja: https://asciinema.org/a/XUDG8ZK3wY6QpiHPD39D1H65y | 01:49 |
dmsimard | it's probably not the best test | 01:52 |
dmsimard | also FWIW the playbook deleted almost instantly | 01:53 |
harlowja | kk | 01:53 |
harlowja | maybe we just have to much data, ha | 01:53 |
harlowja | all the data | 01:53 |
dmsimard | it's hard to tell | 01:53 |
dmsimard | huh I got an idea | 01:54 |
dmsimard | I'll try something just out of curiosity | 01:54 |
harlowja | kk, i'll bbl | 01:54 |
dmsimard | harlowja: how much ram does your ansible node have ? | 01:58 |
*** harlowja has quit IRC | 01:59 | |
dmsimard | Out of curiosity I tried 1.0 and the ram usage is the same but it's a bit slower, there's an overhead when using the API. | 02:02 |
dmsimard | the UI loads fine as well :/ | 02:02 |
*** bcoca has quit IRC | 02:06 | |
ara-slack1 | <dmsimard> @harlowja can you share how your gunicorn is set up ? Do you have a webserver in front of that ? | 02:36 |
ara-slack1 | <dmsimard> @harlowja also, host facts loading fine on my end with both the latest stable and 1.0 https://imgur.com/a/XpQla | 02:58 |
ara-slack1 | <dmsimard> oh wait, you're using mysql right ? I should probably try that | 02:58 |
ara-slack1 | <dmsimard> Tomorrow though | 02:59 |
*** harlowja has joined #ara | 04:11 | |
*** harlowja has quit IRC | 04:50 | |
*** nicovs_be has joined #ara | 07:50 | |
*** jclaret has joined #ara | 07:54 | |
*** jparrill has joined #ara | 08:36 | |
*** DrWaluigi has quit IRC | 09:46 | |
*** DrWaluigi has joined #ara | 09:47 | |
*** DrWaluigi has quit IRC | 10:04 | |
*** DrWaluigi has joined #ara | 10:04 | |
*** gvincent_ has joined #ara | 11:18 | |
*** mnaser_ has joined #ara | 11:20 | |
*** DrWaluigi_ has joined #ara | 11:23 | |
*** DrWaluigi has quit IRC | 11:27 | |
*** gvincent has quit IRC | 11:27 | |
*** mnaser has quit IRC | 11:27 | |
*** mnaser_ is now known as mnaser | 11:27 | |
*** sshnaidm_ has joined #ara | 11:27 | |
*** sshnaidm has quit IRC | 11:28 | |
*** mnaser has quit IRC | 11:28 | |
*** mnaser has joined #ara | 11:28 | |
*** tbielawa has joined #ara | 12:12 | |
*** tbielawa has quit IRC | 12:25 | |
*** sshnaidm_ is now known as sshnaidm | 12:35 | |
*** tbielawa has joined #ara | 13:05 | |
*** myoung|afk is now known as myoung|rover | 13:09 | |
*** bcoca has joined #ara | 13:09 | |
*** bcoca has joined #ara | 13:09 | |
*** myoung|rover is now known as myoung|logdiver | 13:39 | |
*** myoung|logdiver is now known as myoung|rover | 13:39 | |
-openstackstatus- NOTICE: POST_FAILURE results on Tempest-based jobs since the most recent Zuul security fixes are being investigated; rechecking those won't help for now but we'll keep you posted once a solution is identified | 14:06 | |
*** ChanServ changes topic to "POST_FAILURE results on Tempest-based jobs since the most recent Zuul security fixes are being investigated; rechecking those won't help for now but we'll keep you posted once a solution is identified" | 14:06 | |
*** BlessJah has left #ara | 14:16 | |
*** BlessJah has joined #ara | 14:17 | |
*** tbielawa is now known as tbielawa|mtg | 14:28 | |
*** nicovs_be has quit IRC | 14:38 | |
*** nicovs_be has joined #ara | 14:39 | |
*** nicovs_be has quit IRC | 14:43 | |
*** nicovs_be has joined #ara | 14:51 | |
*** myoung|rover is now known as myoung|rover|brb | 14:56 | |
*** tbielawa|mtg is now known as tbielawa | 15:02 | |
*** tbielawa is now known as tbielawa|brb | 15:21 | |
*** tbielawa|brb has quit IRC | 15:25 | |
*** tbielawa|brb has joined #ara | 15:25 | |
*** tbielawa|brb has quit IRC | 15:31 | |
*** myoung|rover|brb is now known as myoung|rover | 15:38 | |
*** tbielawa has joined #ara | 15:50 | |
*** harlowja has joined #ara | 16:03 | |
*** myoung|rover is now known as myoung|lunch | 16:15 | |
*** myoung|lunch is now known as myoung|rover | 16:45 | |
*** tbielawa is now known as tbielawa|lunch | 16:49 | |
*** nicovs_be has quit IRC | 16:59 | |
*** nicovs_be has joined #ara | 17:00 | |
*** nicovs_be has quit IRC | 17:05 | |
*** harlowja has quit IRC | 17:09 | |
*** tbielawa|lunch is now known as tbielawa | 17:26 | |
*** harlowja has joined #ara | 17:53 | |
*** harlowja has quit IRC | 17:57 | |
*** tbielawa is now known as tbielawa|brb | 18:00 | |
*** tbielawa|brb has quit IRC | 18:05 | |
*** jclaret has quit IRC | 18:11 | |
*** nicovs_be has joined #ara | 18:16 | |
*** harlowja has joined #ara | 18:20 | |
*** nicovs_be has quit IRC | 18:20 | |
harlowja | dmsimard let me know if u want to zoom or hangout or somethin | 18:20 |
harlowja | can locally debug what's happening | 18:20 |
harlowja | (i'm weary about just giving out the whole DB file, lol) | 18:21 |
dmsimard | harlowja: did you get my messages from last night ? looks like you were on slack so I tried that | 18:21 |
harlowja | because of any things it has in it, lol | 18:21 |
harlowja | dmsimard yes mysql | 18:21 |
harlowja | also gunicorn, just regular gunicorn (worker based model, with 8 workers) | 18:21 |
harlowja | no webserver in front | 18:21 |
harlowja | (currently) | 18:21 |
harlowja | not yet worth it to go through all of that | 18:22 |
dmsimard | ok and that's running in a container you said ? | 18:22 |
harlowja | right, the whole thing running in a container | 18:22 |
dmsimard | is that in k8s with quotas or something ? | 18:22 |
harlowja | nah | 18:22 |
harlowja | just regular container on a VM | 18:22 |
dmsimard | how much ram is there that things end up being killed ? | 18:22 |
harlowja | 8GB | 18:23 |
harlowja | https://imgur.com/a/SX9OW (or little repo) | 18:23 |
harlowja | ^ ara repo | 18:23 |
harlowja | *our little | 18:23 |
dmsimard | In that asciinema I sent last night, I ran gather_facts 1024 times on localhost (with fake hosts) with ara enabled and forks=25 and even considering the fact gathering execution spam, the ram never went higher than like 1GB/1.5GB :/ | 18:24 |
harlowja | ya, i have a feeling we just have alot of data, ha | 18:24 |
dmsimard | I haven't tried on mysql yet | 18:24 |
harlowja | kk, it may just be easier to do a hangout session or something | 18:24 |
harlowja | but u let me know :-P | 18:24 |
dmsimard | sure, I have a bit, send me the info by PM ? | 18:25 |
harlowja | will do in a little | 18:25 |
*** tbielawa has joined #ara | 18:25 | |
*** jparrill has quit IRC | 18:27 | |
*** sshnaidm is now known as sshnaidm|afk | 18:58 | |
*** ChanServ changes topic to "ARA - Ansible Run Analysis: Making playbook runs easier to visualize, understand and troubleshoot | Git: https://github.com/openstack/ara - Docs: https://ara.readthedocs.io/en/latest/ - Latest version: 0.14.5: https://github.com/openstack/ara/releases/tag/0.14.5 | This channel is logged: http://eavesdrop.openstack.org/irclogs/%23ara/" | 19:21 | |
-openstackstatus- NOTICE: The regression stemming from one of yesterday's Zuul security fixes has been rectified, and Devstack/Tempest jobs which encountered POST_FAILURE results over the past 24 hours can safely be rechecked now | 19:21 | |
*** myoung|rover is now known as myoung|afk | 21:12 | |
*** bcoca has quit IRC | 22:52 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!