*** spine55 has quit IRC | 00:02 | |
*** dxiri has quit IRC | 00:07 | |
*** admin0 has quit IRC | 00:30 | |
*** admin0 has joined #openstack-ansible | 00:31 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: [WIP] Add XPACK monitoring to ELK and Beats https://review.openstack.org/564926 | 00:36 |
---|---|---|
*** admin0 has quit IRC | 00:38 | |
*** admin0 has joined #openstack-ansible | 00:39 | |
*** lbragstad has joined #openstack-ansible | 00:40 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add options for better memory management https://review.openstack.org/564955 | 00:44 |
*** admin0 has quit IRC | 00:44 | |
*** admin0 has joined #openstack-ansible | 00:45 | |
*** armaan has quit IRC | 00:51 | |
*** lbragstad has quit IRC | 00:51 | |
*** armaan has joined #openstack-ansible | 00:52 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert rsyslog to an include_task with group_vars https://review.openstack.org/556002 | 00:53 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add options for better memory management https://review.openstack.org/564955 | 01:13 |
*** admin0 has quit IRC | 01:22 | |
*** cmart has quit IRC | 01:29 | |
*** mma has joined #openstack-ansible | 01:45 | |
*** tomtom001 has quit IRC | 01:46 | |
*** tomtom001 has joined #openstack-ansible | 01:46 | |
*** mma has quit IRC | 01:49 | |
*** yifei has joined #openstack-ansible | 02:06 | |
*** dave-mccowan has joined #openstack-ansible | 02:09 | |
*** dave-mccowan has quit IRC | 02:35 | |
*** tomtom001 has quit IRC | 02:59 | |
*** qwebirc95616 has joined #openstack-ansible | 02:59 | |
*** tomtom001 has joined #openstack-ansible | 03:05 | |
*** yifei has quit IRC | 03:45 | |
*** jwitko has joined #openstack-ansible | 03:51 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add options for better memory management https://review.openstack.org/564955 | 03:58 |
*** gkadam has joined #openstack-ansible | 04:16 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add options for better memory management https://review.openstack.org/564955 | 04:29 |
*** mma has joined #openstack-ansible | 04:44 | |
*** mma has quit IRC | 04:49 | |
*** tomtom001 has quit IRC | 05:00 | |
*** tomtom001 has joined #openstack-ansible | 05:01 | |
*** gyee has quit IRC | 05:25 | |
*** yolanda has quit IRC | 05:41 | |
*** yolanda has joined #openstack-ansible | 05:42 | |
*** harryhuang_ has quit IRC | 06:59 | |
*** spsurya has joined #openstack-ansible | 07:30 | |
*** armaan has quit IRC | 08:23 | |
*** armaan has joined #openstack-ansible | 08:24 | |
*** armaan has quit IRC | 08:45 | |
*** armaan has joined #openstack-ansible | 08:45 | |
evrardjp | I am kinda stuck with no machine big enough to test patches, I didn't realize it would be so painful :p | 08:46 |
*** armaan has quit IRC | 09:03 | |
*** armaan has joined #openstack-ansible | 09:04 | |
*** l4yerffej has quit IRC | 09:34 | |
*** l4yerffej has joined #openstack-ansible | 09:35 | |
*** l4yerffej has quit IRC | 09:41 | |
*** l4yerffej has joined #openstack-ansible | 09:43 | |
*** l4yerffej has quit IRC | 09:48 | |
*** l4yerffej has joined #openstack-ansible | 09:51 | |
*** tomtom001 has quit IRC | 10:00 | |
*** tomtom001 has joined #openstack-ansible | 10:01 | |
*** l4yerffej has quit IRC | 10:10 | |
*** l4yerffej has joined #openstack-ansible | 10:12 | |
*** masuberu has joined #openstack-ansible | 10:19 | |
*** masber has quit IRC | 10:23 | |
*** l4yerffej has quit IRC | 10:30 | |
*** l4yerffej has joined #openstack-ansible | 10:47 | |
*** nicolasbock has joined #openstack-ansible | 11:06 | |
*** armaan has quit IRC | 11:06 | |
*** armaan has joined #openstack-ansible | 11:14 | |
*** tosky has joined #openstack-ansible | 11:20 | |
*** jwitko has quit IRC | 11:47 | |
*** evin has quit IRC | 11:58 | |
*** armaan has quit IRC | 12:19 | |
*** armaan has joined #openstack-ansible | 12:20 | |
openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Comment tempest_git_repo role default https://review.openstack.org/564764 | 12:22 |
openstackgerrit | Matt Thompson proposed openstack/openstack-ansible-os_tempest stable/queens: Comment tempest_git_repo role default https://review.openstack.org/565018 | 12:26 |
openstackgerrit | Matt Thompson proposed openstack/openstack-ansible-os_tempest stable/pike: Comment tempest_git_repo role default https://review.openstack.org/565019 | 12:27 |
*** spsurya has quit IRC | 12:44 | |
*** eumel8 has quit IRC | 12:58 | |
nicolasbock | I found that cache-prep-commands.sh gets stuck on leap 42.3 | 13:03 |
nicolasbock | The issue is that the zypper command in the opensuse chroot gets stuck in the refresh phase for some reason | 13:03 |
nicolasbock | When I `mout --rbind /dev /var/lib/machines/opensuse-42.3-amd64/dev` it works | 13:03 |
nicolasbock | hwoarang, what do you think? ^^ | 13:05 |
nicolasbock | I run the mount command as the zypper command in the chroot is stuck | 13:19 |
nicolasbock | This unstucks it | 13:19 |
*** armaan has quit IRC | 13:28 | |
*** armaan has joined #openstack-ansible | 13:29 | |
*** armaan has quit IRC | 13:33 | |
*** mgariepy has quit IRC | 13:50 | |
*** esberglu has joined #openstack-ansible | 14:21 | |
*** esberglu has quit IRC | 14:22 | |
*** vnogin has joined #openstack-ansible | 14:36 | |
*** armaan has joined #openstack-ansible | 14:41 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [DNM] Test integrated build https://review.openstack.org/565025 | 14:46 |
evrardjp | hey nicolasbock | 14:46 |
evrardjp | sorry for the late answer | 14:46 |
evrardjp | the lxc cache prep commands are implemented per distro, and we've seen it stuck occassionally in the past, but it seems we haven't got issues recently. | 14:47 |
evrardjp | let me double check in periodic gates real quick | 14:47 |
evrardjp | nicolasbock: do you know why you'd need the dev mountpoint ? | 14:48 |
*** vnogin has quit IRC | 15:11 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Freeze roles for Milestone 1 https://review.openstack.org/565027 | 15:17 |
*** tomtom001 has quit IRC | 15:17 | |
*** tomtom001 has joined #openstack-ansible | 15:18 | |
*** masber has joined #openstack-ansible | 15:20 | |
*** masuberu has quit IRC | 15:23 | |
nicolasbock | Hi evrardjp | 15:24 |
nicolasbock | No unfortunately I don't | 15:24 |
nicolasbock | I can try to find out why zypper might need something in /dev | 15:24 |
nicolasbock | I see that it goes into updating the repo and the [.... progress thingy gets stuck at some point eary on | 15:25 |
nicolasbock | Then I mount /dev into the chroot and it continues | 15:25 |
*** armaan has quit IRC | 15:27 | |
*** armaan has joined #openstack-ansible | 15:28 | |
evrardjp | I haven't seen that in gates though | 15:28 |
evrardjp | do you have a specific override? | 15:28 |
*** vnogin has joined #openstack-ansible | 15:29 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/queens: Update all SHAs for 17.0.4 https://review.openstack.org/565029 | 15:29 |
nicolasbock | I am running inside a kvm VM locally. | 15:33 |
nicolasbock | The OS is a basic Leap 42.3 | 15:33 |
evrardjp | nicolasbock: maybe worth checking if there is a difference between gate check commit and your proces | 15:48 |
evrardjp | s | 15:48 |
nicolasbock | True | 15:48 |
evrardjp | scripts/gate-check-commit.sh aio_lxc deploy | 15:48 |
nicolasbock | Thanks | 15:49 |
evrardjp | assuming you're deploying a standard aio with lxc :p | 15:49 |
nicolasbock | Yes, I am deploying lxc_metal | 15:49 |
evrardjp | if you don't want to run this you can simply check with our latest logs | 15:49 |
evrardjp | aio_metal I guess :) | 15:49 |
nicolasbock | True :) | 15:50 |
evrardjp | nicolasbock: let me add a aio_metal for suse | 15:50 |
nicolasbock | oh nice | 15:50 |
nicolasbock | Thanks! | 15:50 |
evrardjp | I will do that when i have finished releases :) | 15:50 |
nicolasbock | Sure, no rush :) | 15:50 |
evrardjp | nicolasbock: please note that if you're doing full aio_metal, there is no reason you should enter that code | 15:52 |
evrardjp | IIRC | 15:52 |
evrardjp | nicolasbock: you are talking about the lxc|nspawn cache prep? | 15:52 |
*** vnogin has quit IRC | 15:54 | |
nicolasbock | Hmm, I guess I am not using aio_metal. I thought that I had set SCENARIO=aio_metal in my env but checking now it seems that I haven't | 15:56 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/pike: Update all SHAs for 16.0.13 https://review.openstack.org/565034 | 16:01 |
evrardjp | nicolasbock: in any case, both issues should be solved. | 16:02 |
evrardjp | both means for me 1) the fact we don't have aio_metal tested in suse 2) your issue with aio that doesn't seem to happen in gates | 16:02 |
*** vnogin has joined #openstack-ansible | 16:03 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add beats-setup tag https://review.openstack.org/565035 | 16:04 |
*** gkadam has quit IRC | 16:08 | |
*** vnogin has quit IRC | 16:08 | |
*** vnogin has joined #openstack-ansible | 16:11 | |
*** vnogin has quit IRC | 16:12 | |
evrardjp | cloudnull: https://review.openstack.org/#/c/564070/ :) | 16:17 |
evrardjp | cloudnull: if you need anything reviewed, ping me :) | 16:18 |
cloudnull | ill trade you https://review.openstack.org/#/c/564530/ :) | 16:18 |
cloudnull | evrardjp: is grey log not compatible with elastic 6.x ? | 16:22 |
cloudnull | https://review.openstack.org/#/c/564070/2/graylog/graylog2-install.yml | 16:22 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/ocata: Update all SHAs for 15.1.21 https://review.openstack.org/565037 | 16:23 |
evrardjp | cloudnull: nope :/ | 16:23 |
cloudnull | bummer. | 16:23 |
evrardjp | not yet | 16:23 |
evrardjp | but that would be super nice | 16:24 |
evrardjp | I will wait for the other roles upstream to move to elastic 6 | 16:24 |
evrardjp | then we can converge to the same thing | 16:24 |
evrardjp | I've sadly discovered that metrics for memcached aren't great. | 16:25 |
cloudnull | the stuff we have in the ops repo is quite nice :) | 16:25 |
evrardjp | And I heard people are integrating OSA with "mirantis" monitoring tooling, which is apparently very efficient. ppetit worked on it :) | 16:26 |
evrardjp | if it's complete an efficient and upstreamable, that could also go there as another way to monitor things | 16:26 |
cloudnull | ++ | 16:27 |
evrardjp | so we would have in user stories "integrating x with OSA" | 16:27 |
evrardjp | where x is whatever you pick: monitoring with monitorstack+TIGCK stack, zabbix, whatever... | 16:27 |
evrardjp | monitoring|metrics|whatever topic | 16:28 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Add Graylog Central Logging https://review.openstack.org/564070 | 16:28 |
cloudnull | ++ i think that would be great | 16:28 |
cloudnull | in the land of Rackspace Private Cloud we're about to drop our custom elk roles and pivot to whats in the ops repo. | 16:29 |
evrardjp | sounds good. Just pivot to what's there, and contribute to keep it up to date | 16:30 |
cloudnull | ++ | 16:30 |
evrardjp | eventually include test upstream, else if possible include tests downstream with external CI | 16:30 |
evrardjp | but there is no urgency for ops tests, the most stable thing should be the integrated repo | 16:30 |
cloudnull | yea. IDK what the best thing would be for ops repo tests | 16:31 |
cloudnull | maybe we could do something like we have for docs where specific tests are run when specific directories are modified ? | 16:31 |
evrardjp | cloudnull: yeah that's what I meant | 16:33 |
* cloudnull - aside - is loving beats - https://snag.gy/eiCqb6.jpg, https://snag.gy/yD5Yfc.jpg | 16:33 | |
cloudnull | I've got all of this that running on 20+ node environment (random old servers) and it's lovely | 16:34 |
evrardjp | that looks nice, what's the beats configuration side? | 16:34 |
cloudnull | that's packet beat | 16:35 |
evrardjp | I mean it looks like you're instrumenting things, but I don't know how | 16:35 |
evrardjp | oh ok | 16:35 |
evrardjp | so that's with libpcap right? | 16:35 |
evrardjp | IIRC what you told me in the past | 16:35 |
cloudnull | I have it set to af_packet, but yes. | 16:35 |
*** mgariepy has joined #openstack-ansible | 16:36 | |
evrardjp | that's scary though :) | 16:37 |
evrardjp | well I guess as long as we don't have mysql + ssl everything will be transparent | 16:37 |
cloudnull | yup. | 16:37 |
evrardjp | same for rabbit, memcache, and others | 16:37 |
cloudnull | rabbit is all ssl so i dont see the messages, but i do see the rates | 16:38 |
evrardjp | but it's less intrusive than changing at the app level | 16:38 |
evrardjp | ok | 16:38 |
cloudnull | also https://snag.gy/bBolDq.jpg | 16:38 |
evrardjp | that's proper graphing | 16:38 |
evrardjp | how is the ES cluster? | 16:38 |
evrardjp | Not too much data? | 16:38 |
cloudnull | which is using grafana from the ops repo w/ our elk things | 16:38 |
evrardjp | I guess you want to use it for live data only? | 16:38 |
evrardjp | Or want to use it for trends later ? | 16:39 |
evrardjp | or past search | 16:39 |
cloudnull | all of the above | 16:39 |
evrardjp | haha | 16:39 |
evrardjp | then yeah, hard for the ES cluster in the long term :) | 16:39 |
evrardjp | it's gonna be interesting! | 16:39 |
cloudnull | the grafana dashboards were uploaded to https://grafana.com/dashboards so installing them and getting it all live is super simple | 16:40 |
evrardjp | that's great! That's what I wanted to do during the leapfrogs | 16:40 |
evrardjp | cloudnull: I can't seem to find them by searching openstack | 16:42 |
evrardjp | that's somethign you might want to improve :) | 16:42 |
evrardjp | SEO all the things! | 16:42 |
evrardjp | :D | 16:42 |
*** bhujay has joined #openstack-ansible | 16:43 | |
qwebirc95616 | hey guys! i have deployed openstack-ansible but i have issue with launching instance on second compute node. i use stable/pike and i have two compute node with one controller and one node as storage. the exact error is it return : " TypeError: 'NoneType' object has no attribute '__getitem__' " could anyone help me plzzz | 16:43 |
evrardjp | qwebirc95616: that's weird, what are you using to launch the instance | 16:44 |
evrardjp | qwebirc95616: and what's the SHA on your stable/pike branch? | 16:44 |
evrardjp | I have to go, else my wife won't be happy of me working the whole afternoon :p | 16:45 |
qwebirc95616 | evrardjp i've tried from terminal to launch instance. | 16:45 |
evrardjp | qwebirc95616: from the utility container? | 16:45 |
evrardjp | using our virtualenv ? | 16:46 |
qwebirc95616 | evrardjp yes | 16:46 |
evrardjp | qwebirc95616: I suggest you fill all of this in a bug: telling how you deployed (which sha, which overrides), and how you started this instance (showing the shell history for example, to help reproduce the bug) | 16:47 |
evrardjp | and a full log of the issue | 16:47 |
qwebirc95616 | evrardjp thanks :) | 16:47 |
evrardjp | qwebirc95616: it seems not normal, as Pike deployed recently just fine, so either you have an old release, or you have something unclean on the node | 16:47 |
evrardjp | like a conflicting version of python/pip | 16:47 |
evrardjp | or not using the venv | 16:48 |
evrardjp | all of that is possible, so that's why logs matter :) | 16:48 |
evrardjp | a full trace of the log is good too. | 16:48 |
evrardjp | don't hesitate to put the logs on paste.openstack.org | 16:48 |
evrardjp | that's there for that :) | 16:48 |
evrardjp | sorry I can't help you more right now, and with those details. But we'll get through it :) | 16:48 |
evrardjp | see you all laterz! | 16:49 |
qwebirc95616 | evrardjp thank you so much i will do your suggestion | 16:49 |
qwebirc95616 | here is the full log http://paste.openstack.org/show/720071/ | 16:51 |
cloudnull | evrardjp: it doesn't look like I can add an OpenStack tag to the dashboards. I added a blerb in the description though | 17:07 |
cloudnull | ok, i gotta run | 17:07 |
* cloudnull off to be bob the builder. | 17:07 | |
cloudnull | if anything need be reviewed let me know, I'll be back online later. | 17:08 |
*** bhujay has quit IRC | 17:23 | |
*** qwebirc95616 has quit IRC | 17:42 | |
*** bhujay has joined #openstack-ansible | 17:48 | |
*** nicolasbock has quit IRC | 17:51 | |
*** vnogin has joined #openstack-ansible | 17:57 | |
evrardjp[m] | the milestone 1 patch if possible, i will ping that. thanks for the offer Bob ! ;) | 18:04 |
*** vnogin has quit IRC | 18:11 | |
*** vnogin has joined #openstack-ansible | 18:16 | |
*** vnogin has quit IRC | 18:16 | |
*** mma has joined #openstack-ansible | 18:23 | |
*** bhujay has quit IRC | 18:44 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-lxc_hosts master: Avoid release note conflict https://review.openstack.org/565045 | 18:52 |
evrardjp | cloudnull: voting on https://review.openstack.org/#/c/565045/ and https://review.openstack.org/#/c/565027/1 deserve votes | 18:54 |
*** armaan has quit IRC | 18:56 | |
*** armaan has joined #openstack-ansible | 18:56 | |
*** armaan has quit IRC | 19:02 | |
*** armaan has joined #openstack-ansible | 19:02 | |
*** jbadiapa has quit IRC | 19:18 | |
*** armaan has quit IRC | 19:20 | |
*** armaan has joined #openstack-ansible | 19:20 | |
*** vnogin has joined #openstack-ansible | 20:01 | |
*** vnogin has quit IRC | 20:11 | |
*** armaan has quit IRC | 20:42 | |
*** armaan has joined #openstack-ansible | 20:58 | |
*** DanyC has joined #openstack-ansible | 21:23 | |
*** throwsb1 has joined #openstack-ansible | 21:27 | |
*** armaan has quit IRC | 21:32 | |
*** armaan has joined #openstack-ansible | 21:40 | |
*** vnogin has joined #openstack-ansible | 21:46 | |
*** DanyC has quit IRC | 21:51 | |
*** jbadiapa has joined #openstack-ansible | 21:55 | |
*** mma has quit IRC | 21:56 | |
*** mwarad has quit IRC | 22:06 | |
*** evin has joined #openstack-ansible | 22:13 | |
*** vnogin has quit IRC | 22:20 | |
*** jbadiapa has quit IRC | 23:18 | |
*** tosky has quit IRC | 23:26 | |
*** throwsb1 has quit IRC | 23:36 | |
*** evin has quit IRC | 23:54 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!