| *** harshs_ has joined #openstack-operators | 00:05 | |
| *** harshs has quit IRC | 00:05 | |
| *** harshs_ is now known as harshs | 00:05 | |
| *** VW has quit IRC | 00:24 | |
| *** VW has joined #openstack-operators | 00:35 | |
| *** VW has quit IRC | 00:36 | |
| *** VW has joined #openstack-operators | 00:36 | |
| *** VW_ has joined #openstack-operators | 00:50 | |
| *** VW has quit IRC | 00:50 | |
| *** chlong has quit IRC | 00:59 | |
| *** harshs has quit IRC | 01:06 | |
| *** chlong has joined #openstack-operators | 01:12 | |
| *** VW_ has quit IRC | 01:25 | |
| *** VW has joined #openstack-operators | 01:25 | |
| *** gfa is now known as gfa_ | 02:36 | |
| *** VW has quit IRC | 02:45 | |
| *** armax has joined #openstack-operators | 02:59 | |
| *** csoukup has joined #openstack-operators | 03:41 | |
| *** csoukup has quit IRC | 03:48 | |
| *** VW has joined #openstack-operators | 03:49 | |
| *** VW has quit IRC | 03:51 | |
| *** VW has joined #openstack-operators | 03:52 | |
| *** csoukup has joined #openstack-operators | 04:06 | |
| *** k_stev has joined #openstack-operators | 04:19 | |
| *** c_soukup has joined #openstack-operators | 04:27 | |
| *** csoukup has quit IRC | 04:27 | |
| *** k_stev has quit IRC | 04:30 | |
| *** c_soukup has quit IRC | 04:37 | |
| *** csoukup has joined #openstack-operators | 04:44 | |
| *** csoukup has quit IRC | 04:53 | |
| *** VW has quit IRC | 05:46 | |
| *** xavpaice has quit IRC | 06:25 | |
| *** xavpaice has joined #openstack-operators | 06:26 | |
| *** zerda has joined #openstack-operators | 06:32 | |
| *** sleinen-AS559 has joined #openstack-operators | 06:34 | |
| *** zhangjn has joined #openstack-operators | 06:45 | |
| clayton | xavpaice: We did uncontainerized venvs for a while | 06:45 |
|---|---|---|
| clayton | it worked fine, but building them and distributing them was a pain compared to containers | 06:45 |
| clayton | and we still had to deal with c library deps both in the build and deploy environments | 06:46 |
| xavpaice | thanks - I was discussing this with a bunch of the Python people at Catalyst | 06:47 |
| xavpaice | we had previously come to the conclusion that venv was the best way to go - but distribution is easy with dh_virtualenv and .debs | 06:48 |
| xavpaice | however, the compiled stuff is miles harder, and still means it needs containers or dedicated vm's at some stage | 06:48 |
| *** chlong has quit IRC | 06:48 | |
| xavpaice | clayton, what are you doing now? Pure containers? | 06:49 |
| clayton | you can put virtualenvs inside of packages, I played with that using giftwrap | 06:49 |
| clayton | in theory that seemed like a better way to get support w/existing puppet modules, etc | 06:49 |
| xavpaice | yeah, that was the other approach I started looking at | 06:49 |
| clayton | but in practice I had a lot of code for creating users, default config files, etc, startup scripts, etc | 06:50 |
| clayton | whereas the puppet-docker module makes at least the startup script part easy (imo) | 06:50 |
| xavpaice | like I say, dh_virtualenv makes putting a venv in a deb relatively easy too - not as clean as giftwrap though | 06:50 |
| clayton | xavpaice we're moving to docker containers | 06:50 |
| xavpaice | Kolla or custom? | 06:50 |
| clayton | just heat and designate right now, talking to the kolla guys at the summit it sounds like they didn't think we'd run into any real issues with getting services to run | 06:51 |
| clayton | custom for now, but I'd be glad to use Kolla when it handles plugins | 06:51 |
| clayton | that's why I went to a few of their design sessions | 06:51 |
| xavpaice | yeah, I was getting the same message but was at other sessions so didn't get the detail | 06:51 |
| xavpaice | it seems my big takeaway from the summit is that I've got a whole bunch of stuff I want to do differently now | 06:52 |
| clayton | one thing about kolla that might not be obvious, their ansible deployment stuff isn't required, you can just the containers it builds | 06:52 |
| xavpaice | ah, good to know | 06:52 |
| clayton | well, time for NRT -> IAD, plane is here :) | 06:52 |
| xavpaice | enjoy the flight :) | 06:53 |
| *** sleinen-AS559 has quit IRC | 07:05 | |
| *** geoffarn_ has joined #openstack-operators | 07:08 | |
| *** sleinen-AS559 has joined #openstack-operators | 07:28 | |
| *** geoffarn_ is now known as geoffarnoldX | 07:30 | |
| *** sleinen-AS5591 has joined #openstack-operators | 07:42 | |
| *** sleinen-AS559 has quit IRC | 07:44 | |
| *** geoffarnoldX is now known as geoffarn_ | 07:55 | |
| *** geoffarn_ is now known as geoffarnoldX | 07:56 | |
| *** bapalm has quit IRC | 08:19 | |
| *** bapalm has joined #openstack-operators | 08:24 | |
| *** elo has joined #openstack-operators | 08:40 | |
| *** derekh has joined #openstack-operators | 09:20 | |
| *** VW has joined #openstack-operators | 09:44 | |
| *** VW has joined #openstack-operators | 09:45 | |
| *** matrohon has joined #openstack-operators | 09:52 | |
| *** jaypipes has joined #openstack-operators | 10:15 | |
| *** Marga_ has joined #openstack-operators | 10:25 | |
| *** Marga_ has quit IRC | 10:31 | |
| *** Marga_ has joined #openstack-operators | 10:31 | |
| *** zhangjn has quit IRC | 10:42 | |
| *** subscope has joined #openstack-operators | 10:48 | |
| *** VW has quit IRC | 10:59 | |
| beddari | packer+giftwrap should be part of any docker workflow :) | 11:13 |
| beddari | xavpaice: I think the notion that "venv isnt for production" is just something distro-centric thinking people go about :) | 11:14 |
| beddari | thank you to anyone contributing to the ops track at the summit, nice atmosphere and much to learn, it was great | 11:17 |
| *** Marga_ has quit IRC | 11:28 | |
| *** VW has joined #openstack-operators | 11:31 | |
| *** Marga_ has joined #openstack-operators | 11:31 | |
| *** VW has quit IRC | 11:31 | |
| *** VW has joined #openstack-operators | 11:31 | |
| *** cdelatte has joined #openstack-operators | 11:33 | |
| *** elo has quit IRC | 11:36 | |
| *** elo1 has joined #openstack-operators | 11:36 | |
| *** zhangjn has joined #openstack-operators | 11:47 | |
| *** zhangjn has quit IRC | 11:47 | |
| *** zhangjn has joined #openstack-operators | 11:48 | |
| *** elo1 has quit IRC | 11:51 | |
| *** subscope has quit IRC | 11:59 | |
| *** subscope has joined #openstack-operators | 12:00 | |
| *** subscope has quit IRC | 12:02 | |
| *** subscope has joined #openstack-operators | 12:02 | |
| *** Marga_ has quit IRC | 12:07 | |
| *** Marga_ has joined #openstack-operators | 12:08 | |
| *** delattec has joined #openstack-operators | 12:22 | |
| *** cdelatte has quit IRC | 12:22 | |
| *** subscope has quit IRC | 12:59 | |
| *** sleinen-AS559 has joined #openstack-operators | 13:00 | |
| *** sleinen-AS5591 has quit IRC | 13:03 | |
| *** sleinen-AS559 has quit IRC | 13:05 | |
| *** elo has joined #openstack-operators | 13:13 | |
| *** zhangjn has quit IRC | 13:16 | |
| *** zhangjn has joined #openstack-operators | 13:19 | |
| *** Marga_ has quit IRC | 13:24 | |
| *** subscope has joined #openstack-operators | 13:29 | |
| *** rzerda has joined #openstack-operators | 13:36 | |
| *** zerda has quit IRC | 13:38 | |
| *** Marga_ has joined #openstack-operators | 13:38 | |
| *** elo has quit IRC | 13:43 | |
| *** elo has joined #openstack-operators | 13:45 | |
| *** Marga_ has quit IRC | 13:57 | |
| *** sleinen-AS559 has joined #openstack-operators | 14:02 | |
| *** sleinen-AS5591 has joined #openstack-operators | 14:08 | |
| *** sleinen-AS559 has quit IRC | 14:08 | |
| *** sleinen-AS5591 has quit IRC | 14:20 | |
| *** alejandrito has joined #openstack-operators | 14:22 | |
| *** sleinen-AS559 has joined #openstack-operators | 14:22 | |
| *** rzerda has quit IRC | 14:24 | |
| *** subscope has quit IRC | 14:26 | |
| *** mriedem has joined #openstack-operators | 14:29 | |
| *** B_Smith has quit IRC | 14:31 | |
| *** zerda has joined #openstack-operators | 14:37 | |
| *** markvoelker has joined #openstack-operators | 14:40 | |
| *** zerda has quit IRC | 14:41 | |
| *** signed8bit has joined #openstack-operators | 14:41 | |
| *** subscope has joined #openstack-operators | 14:41 | |
| *** Trident has joined #openstack-operators | 14:48 | |
| *** _hanhart has joined #openstack-operators | 14:53 | |
| *** subscope has quit IRC | 14:54 | |
| *** subscope has joined #openstack-operators | 14:55 | |
| *** subscope has quit IRC | 14:57 | |
| *** regXboi has joined #openstack-operators | 14:58 | |
| *** zhangjn has quit IRC | 15:08 | |
| *** subscope has joined #openstack-operators | 15:09 | |
| *** delattec has quit IRC | 15:10 | |
| *** csoukup has joined #openstack-operators | 15:10 | |
| *** delattec has joined #openstack-operators | 15:11 | |
| *** gfa_ is now known as gfa | 15:12 | |
| *** tobberydberg has joined #openstack-operators | 15:15 | |
| *** gfa is now known as gfa_ | 15:15 | |
| *** _hanhart has quit IRC | 15:17 | |
| *** tobberydberg has quit IRC | 15:22 | |
| drwahl | bleh... the tokyo jet lag is strong this morning... | 15:26 |
| *** VW_ has joined #openstack-operators | 15:26 | |
| *** cvstealt1 has joined #openstack-operators | 15:27 | |
| *** baffle_ has joined #openstack-operators | 15:31 | |
| *** ggillies_ has joined #openstack-operators | 15:31 | |
| *** jmckind has joined #openstack-operators | 15:35 | |
| *** VW has quit IRC | 15:35 | |
| *** jaypipes has quit IRC | 15:35 | |
| *** zul has quit IRC | 15:35 | |
| *** j^2 has quit IRC | 15:35 | |
| *** _nick has quit IRC | 15:35 | |
| *** jogo has quit IRC | 15:35 | |
| *** ggillies has quit IRC | 15:35 | |
| *** cvstealth has quit IRC | 15:35 | |
| *** baffle has quit IRC | 15:35 | |
| *** dmsimard|tokyo has quit IRC | 15:35 | |
| *** _nick has joined #openstack-operators | 15:36 | |
| *** dmsimard has joined #openstack-operators | 15:36 | |
| *** jaypipes has joined #openstack-operators | 15:39 | |
| *** zul has joined #openstack-operators | 15:47 | |
| *** j^2 has joined #openstack-operators | 15:48 | |
| *** ybabenko has joined #openstack-operators | 15:50 | |
| *** emagana has joined #openstack-operators | 15:53 | |
| *** k_stev has joined #openstack-operators | 15:56 | |
| *** jmckind is now known as jmckind_ | 16:03 | |
| *** delatte has joined #openstack-operators | 16:08 | |
| *** mdorman has joined #openstack-operators | 16:08 | |
| *** jmckind_ is now known as jmckind | 16:09 | |
| *** delattec has quit IRC | 16:09 | |
| *** SimonChung has quit IRC | 16:12 | |
| *** k_stev has quit IRC | 16:17 | |
| *** subscope has quit IRC | 16:20 | |
| *** rbradfor has joined #openstack-operators | 16:30 | |
| *** emagana has quit IRC | 16:33 | |
| *** ybabenko has quit IRC | 16:43 | |
| *** emagana has joined #openstack-operators | 16:50 | |
| *** mss__ has joined #openstack-operators | 16:51 | |
| *** mss__ has quit IRC | 16:51 | |
| *** kwrobert has joined #openstack-operators | 16:51 | |
| kwrobert | Hello Everybody! | 16:53 |
| kwrobert | I am experimenting with a small Openstack cloud, and I have encountered a problem on multiple occasions where the MySQL database on one of my controllers fails to purge old mysql-bin.$NUMBER binary log files. These log files (among others) end up completely filling the root OS directory, causing any writes to the database to fail. I cannot log into mysql to purge the log files due to the following error: | 16:53 |
| kwrobert | ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2) | 16:53 |
| kwrobert | I have checked, and the socket file definitely does not exist. I can remove the logs by hand, but any attempts to restart the database afterwards fail due to the above error. Has anybody encountered this problem before and could anybody point me towards a solution? | 16:53 |
| kwrobert | Thanks! | 16:53 |
| *** mss has joined #openstack-operators | 16:53 | |
| *** gyee has joined #openstack-operators | 16:55 | |
| raginbajin | Those are the binary logs for Mysql being able to do replication. | 16:55 |
| raginbajin | you'd need to do a "RESET MASTER" or do a purge logs to properly get rid of those next time. | 16:56 |
| *** dmsimard has quit IRC | 17:00 | |
| *** alop has joined #openstack-operators | 17:00 | |
| *** dmsimard has joined #openstack-operators | 17:02 | |
| *** vinsh has joined #openstack-operators | 17:03 | |
| *** matrohon has quit IRC | 17:03 | |
| kwrobert | How do I execute the | 17:09 |
| kwrobert | “RESET MASTER” command you mentioned if I cannot log into mysqkl | 17:09 |
| *** dminer has joined #openstack-operators | 17:10 | |
| *** sleinen-AS559 has quit IRC | 17:14 | |
| *** dmsimard has quit IRC | 17:21 | |
| *** jmckind is now known as jmckind_ | 17:22 | |
| *** dmsimard has joined #openstack-operators | 17:22 | |
| *** jmckind_ is now known as jmckind | 17:28 | |
| *** jmckind is now known as jmckind_ | 17:35 | |
| *** mss has quit IRC | 17:42 | |
| *** mss has joined #openstack-operators | 17:46 | |
| *** Piet has joined #openstack-operators | 17:48 | |
| *** derekh has quit IRC | 17:50 | |
| *** stanchan has joined #openstack-operators | 18:01 | |
| *** emagana has quit IRC | 18:20 | |
| *** harlowja has joined #openstack-operators | 18:22 | |
| *** emagana has joined #openstack-operators | 18:30 | |
| *** kwrobert is now known as krobzaur | 18:31 | |
| *** emagana has quit IRC | 18:34 | |
| *** SimonChung has joined #openstack-operators | 18:36 | |
| *** VW has joined #openstack-operators | 18:39 | |
| *** VW_ has quit IRC | 18:42 | |
| *** armax has quit IRC | 18:42 | |
| *** VW has quit IRC | 18:44 | |
| *** rady has joined #openstack-operators | 18:51 | |
| *** mss has quit IRC | 18:52 | |
| *** geoffarnoldX has quit IRC | 18:53 | |
| *** harshs has joined #openstack-operators | 18:57 | |
| *** ccarmack1 has quit IRC | 18:59 | |
| *** armax has joined #openstack-operators | 19:02 | |
| *** emagana has joined #openstack-operators | 19:03 | |
| *** ccarmack has joined #openstack-operators | 19:04 | |
| *** zul_ has joined #openstack-operators | 19:08 | |
| *** zul has quit IRC | 19:08 | |
| *** Piet has quit IRC | 19:17 | |
| *** VW has joined #openstack-operators | 19:24 | |
| *** VW has quit IRC | 19:28 | |
| *** prometheanfire has quit IRC | 19:35 | |
| *** Marga_ has joined #openstack-operators | 19:36 | |
| rbradfor | krobzaur, PURGE MASTER LOGS is what you use to remove old binary logs. | 20:49 |
| rbradfor | krobzaur, expire_logs_days is the variable you set to automatically have them removed by age when the binary log rotates. | 20:50 |
| rbradfor | you can remove the log files manually, but you still have to cleanup the references with PURGE. | 20:50 |
| rbradfor | regarding error 2002, first check the mysql error log to ensure the mysqld process has even started. | 20:51 |
| krobzaur | Hello all! Thanks for the advice. I managed to fix it somehow. I first deleted all the offending log files manually using a simple bash script. I then removed references to all the log files from the mysql-bin.index file. This particular database is part of a Galera Cluster monitored by Pacemaker/Corosync. After I cleaned up the logs and made space in my root OS volume Pacemaker somehow magically revived the database | 20:55 |
| krobzaur | and I have the ‘expire_logs_days’ variable set to 10 | 20:57 |
| krobzaur | Guess I should probably shorten that considering these logs keep taking up all my disk space | 20:57 |
| *** jmccrory has joined #openstack-operators | 20:58 | |
| krobzaur | I couldn’t use “PURGE MASTER LOGS”v or any of the native mysql commands because I couldn’t log into the mysql interactive terminal/prompt | 20:59 |
| krobzaur | It kept complaining about the missing .sock file | 20:59 |
| krobzaur | I think cleaning everything up and just waiting awhile let Galera restart the mysql database process because now everything is working and I can log into the database | 21:02 |
| rbradfor | krobzaur, analysis of your error log will show the problem, mysql could not start (and hence not socket file). Mysql has an angel process mysqld_safe that will attempt automatic restarting. This would explain what you are seeing. | 21:04 |
| *** geoffarnold has joined #openstack-operators | 21:09 | |
| krobzaur | Ah, I see. | 21:09 |
| krobzaur | I shortened the ‘expire_log_days’ variable, do I have to restart the database for my changes to take effect? | 21:11 |
| rbradfor | no | 21:12 |
| *** Marga_ has quit IRC | 21:12 | |
| rbradfor | https://dev.mysql.com/doc/refman/5.6/en/server-system-variables.html#sysvar_expire_logs_days | 21:12 |
| *** Lindis has joined #openstack-operators | 21:26 | |
| *** Lindis has quit IRC | 21:32 | |
| *** rady has quit IRC | 21:43 | |
| *** Piet has joined #openstack-operators | 21:48 | |
| *** rady has joined #openstack-operators | 21:56 | |
| *** harshs has quit IRC | 21:59 | |
| *** regXboi has quit IRC | 22:08 | |
| *** SimonChung1 has joined #openstack-operators | 22:11 | |
| *** SimonChung has quit IRC | 22:11 | |
| *** SimonChung has joined #openstack-operators | 22:12 | |
| *** SimonChung has quit IRC | 22:12 | |
| *** SimonChung1 has quit IRC | 22:12 | |
| *** SimonChung2 has joined #openstack-operators | 22:12 | |
| *** Marga_ has joined #openstack-operators | 22:13 | |
| *** ybabenko has joined #openstack-operators | 22:19 | |
| *** geoffarnold is now known as geoffarnoldX | 22:28 | |
| *** geoffarnoldX is now known as geoffarnold | 22:28 | |
| *** mriedem is now known as mriedem_away | 22:29 | |
| *** krobzaur has quit IRC | 22:29 | |
| *** ybabenko has quit IRC | 22:32 | |
| *** ccarmack has quit IRC | 22:36 | |
| *** ybabenko has joined #openstack-operators | 22:36 | |
| *** ccarmack has joined #openstack-operators | 22:39 | |
| *** ybabenko has quit IRC | 22:45 | |
| *** harshs has joined #openstack-operators | 22:49 | |
| *** harshs has quit IRC | 22:53 | |
| *** harshs has joined #openstack-operators | 22:57 | |
| *** geoffarnold has quit IRC | 22:58 | |
| *** harshs has quit IRC | 23:02 | |
| *** SimonChung2 has quit IRC | 23:02 | |
| *** SimonChung has joined #openstack-operators | 23:02 | |
| *** VW has joined #openstack-operators | 23:02 | |
| *** SimonChung1 has joined #openstack-operators | 23:03 | |
| *** SimonChung has quit IRC | 23:03 | |
| *** alejandrito has quit IRC | 23:04 | |
| *** chlong has joined #openstack-operators | 23:05 | |
| *** stanchan has quit IRC | 23:06 | |
| *** SimonChung has joined #openstack-operators | 23:19 | |
| *** SimonChung1 has quit IRC | 23:19 | |
| *** SimonChung1 has joined #openstack-operators | 23:20 | |
| *** SimonChung has quit IRC | 23:20 | |
| *** jmckind_ has quit IRC | 23:24 | |
| *** csoukup has quit IRC | 23:33 | |
| *** elo has quit IRC | 23:33 | |
| *** VW has quit IRC | 23:49 | |
| *** VW has joined #openstack-operators | 23:49 | |
| *** harshs has joined #openstack-operators | 23:58 | |
| *** mdorman has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!