Thursday, 2016-06-16

*** openstack has joined #openstack-ansible06:00
*** shausy has quit IRC06:14
*** shausy has joined #openstack-ansible06:15
*** javeriak has joined #openstack-ansible06:17
*** klamath has quit IRC06:19
*** neilus has joined #openstack-ansible06:19
*** klamath has joined #openstack-ansible06:19
*** neilus has quit IRC06:23
*** weezS has quit IRC06:25
*** saneax_AFK is now known as saneax06:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Remove libvirt bootstrapping from AIO  https://review.openstack.org/32727606:29
*** javeriak has quit IRC06:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Ensure that AIO extra indexes config is well formed  https://review.openstack.org/32940606:31
*** javeriak has joined #openstack-ansible06:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Auto-enable Ceilometer + Aodh integration  https://review.openstack.org/33014206:32
*** thorst_ has joined #openstack-ansible06:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Remove deleted override vars from inventory  https://review.openstack.org/32538006:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum: Relocating DB and DB user creation tasks  https://review.openstack.org/33017506:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Update lists of skipped security role tasks  https://review.openstack.org/32773206:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Add an easy way to run cmds in utility container  https://review.openstack.org/32620006:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Fix keystone DB Access variable  https://review.openstack.org/32766006:51
*** javeriak has quit IRC06:52
*** thorst_ has quit IRC06:52
openstackgerritSteve Lewis (stevelle) proposed openstack/openstack-ansible-os_ceilometer: Update Aodh integration  https://review.openstack.org/32970506:55
openstackgerritMerged openstack/openstack-ansible-os_magnum: Relocating DB and DB user creation tasks  https://review.openstack.org/33017506:58
*** neilus has joined #openstack-ansible07:00
*** markvoelker_ has quit IRC07:01
*** javeriak has joined #openstack-ansible07:01
*** javeriak has quit IRC07:01
*** javeriak has joined #openstack-ansible07:01
*** markvoelker has joined #openstack-ansible07:01
*** mikelk has joined #openstack-ansible07:05
*** neilus has quit IRC07:05
*** jamielennox is now known as jamielennox|away07:12
*** pcaruana has joined #openstack-ansible07:17
*** permalac has quit IRC07:19
*** neilus has joined #openstack-ansible07:20
*** Bofu2U has quit IRC07:22
*** neilus has quit IRC07:24
*** GMAzrael has quit IRC07:27
odyssey4mestevelle without inspecting the fact cache on a running build, it looks like https://review.openstack.org/330173 would set the fact for that group once, so it actually only helps on a re-run of playbooks within the lifetime of the fact cache07:32
odyssey4methis isn't a bad thing, I just wonder if there's something we can do which helps on the first run or perhaps specifically for the gate07:33
*** schwicht has joined #openstack-ansible07:34
stevelleodyssey4me: I'm not seeing how you get that it doesn't help the gate07:34
odyssey4mestevelle let me try it out and inspect the fact cache to confirm my suspicions07:34
stevelleI feel like it should run on keystone and be skipped thereafter07:36
odyssey4meI'm starting to think that using Ansible 2.1 without optimising for 2.1 (and thus perhaps breaking the 1.9 compatibility) is a problem. It seems that the execution time has increased significantly and our deployers will suffer for it unless we put some effort into optimising more.07:36
odyssey4mestevelle yeah, but the fact is set per host I think... I don't think it's a global fact07:37
stevelleI see what you're saying now07:38
*** schwicht has quit IRC07:38
odyssey4mewell, if it is per host then perhaps it does work the way you think it does - once set by the first play, the other plays use it...07:40
odyssey4meonly an inspection of the cache will confirm that07:40
stevelleit could be setting the fact in the container and that does us no good07:40
odyssey4meif it's per host and put under something to do with the host group then it's a problem07:40
odyssey4merelocating to the office, afk for a bit07:41
*** neilus has joined #openstack-ansible07:42
*** neilus has quit IRC07:47
*** neilus has joined #openstack-ansible07:49
*** thorst_ has joined #openstack-ansible07:49
*** neilus has quit IRC07:53
*** saneax is now known as saneax_AFK07:56
*** thorst_ has quit IRC07:56
winggundamthodyssey4me: from what I see in os_horizon role. I assume that osa still don't have POLICY_FILES feature right? any plan for that? so I can look into this08:01
*** neilus has joined #openstack-ansible08:01
winggundamthmhayden: I already created bug ticket for you08:02
*** chandanc has quit IRC08:02
*** berendt has joined #openstack-ansible08:06
evrardjpmorning everyone08:07
winggundamthmorning :)08:08
winggundamthwhat time is it for you right now?08:08
*** permalac has joined #openstack-ansible08:09
thngHi all08:12
thngAnyone can tell me why I got this error ?08:12
thngfailed: [aio1_galera_container-c42e8c43] => (item=python-memcached) => {"attempts": 5, "cmd": "/usr/local/bin/pip install python-memcached", "failed": true, "item": "python-memcached"} msg: Task failed as maximum retries was encountered08:12
thngfailed: [aio1_galera_container-c42e8c43] => (item=MySQL-python) => {"attempts": 5, "cmd": "/usr/local/bin/pip install MySQL-python", "failed": true, "item": "MySQL-python"} msg: Task failed as maximum retries was encountered08:12
thngand it is blocked here, does nothing else since yesterday :D08:12
winggundamthfrom my view it seems like can not install with pip08:18
winggundamthfrom internet connection or whatever. maybe you need to turn on debug with -vvvv to see exact error08:19
*** karimb has joined #openstack-ansible08:21
thngIgnoring indexes: https://pypi.python.org/simple\nCollecting pycrypto\n\n:stderr: Retrying (Retry(total=4, connect=None, read=None, redirect=None)) after connection broken by \'ReadTimeoutError("HTTPConnectionPool(host=\'80.78.6.10\', port=8080): Read timed out.08:28
thngIt cannot connect to the website08:28
winggundamthyep so you should check your connection on that host08:35
winggundamthtry to telnet or ping out the pypi.python.org08:35
thngthe connection is good. I suspect the proxy settings....08:36
*** chandanc has joined #openstack-ansible08:40
*** saneax_AFK is now known as saneax08:44
*** thorst_ has joined #openstack-ansible08:54
odyssey4mewinggundamth I've noted https://blueprints.launchpad.net/openstack-ansible/+spec/static-file-distribution as my thinking... if you can work on it that'd be great08:59
odyssey4methng that's most likely because you have a problem with container connectivity - go into the container and confirm that it's able to reach the LB08:59
odyssey4methng if you've been using run-playbooks to execute the playbooks more than once then your container connectivity will be broken09:00
*** tiagogomes has joined #openstack-ansible09:00
*** thorst_ has quit IRC09:01
winggundamthodyssey4me: I think that's another issue but related to my question. can I do a step at a time? by doing horizon policy first and will try to see if I can improve it to be as you noted09:02
*** M00nr41n has quit IRC09:03
odyssey4mewinggundamth well, this might be what you're wanting - evrardjp did some work on it some time ago: https://blueprints.launchpad.net/openstack-ansible/+spec/policy-files-distribution09:05
odyssey4methe review was abandoned, but perhaps it should be restored and updated09:06
winggundamthodyssey4me: that's look like it. let me push what I'm using right now. I don't think it good enough but it can open the way to improve it09:09
winggundamthodyssey4me: I'm not sure what I should put in commit text if I want to stick with this blueprint?09:13
winggundamthImplements: blueprint Policy Files Distribution of each openstack project to horizon ?09:14
*** admin0 has joined #openstack-ansible09:14
odyssey4mewinggundamth make the branch name 'bp/policy-files-distribution' and add 'Implements: blueprint policy-files-distribution' in the commit message09:14
winggundamthodyssey4me: ok09:14
openstackgerritJirayut Nimsaeng proposed openstack/openstack-ansible-os_horizon: Make horizon use the same policy as the others project  https://review.openstack.org/33039709:16
*** admin0 has quit IRC09:16
thngodyssey4me: I just ran once since yesterday :). I check connectivity from the container to outside (for ex: apt-get install), it works well09:18
*** sguduru has joined #openstack-ansible09:18
thngIn error msg, I saw this one : http://172.29.236.100:8181/os-releases/13.1.3/\nRetrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'ReadTimeoutError09:19
*** admin0 has joined #openstack-ansible09:19
thng172.29.236.100 is the deployment host address09:19
odyssey4methng ok, but can the container reach the LB and can the LB reach the repo web server?09:19
thngLB ?09:21
thngodyssey4me: LB what it is ?09:24
*** electrofelix has joined #openstack-ansible09:27
winggundamththng: LB = Load Balancer09:27
*** javeriak has quit IRC09:28
thngWhich LB ? Because Iam trying to do aio. In anycase, I can pip install mysql-python in the container galera without prob09:32
winggundamthodyssey4me: another thing I working on right now is writing a backup script following http://docs.openstack.org/ops-guide/ops_backup_recovery.html. Do you have any thought about this for OSA?09:33
*** schwicht has joined #openstack-ansible09:35
odyssey4methng the LB for an AIO is haproxy which is deployed on the host - all you need to do is verify whether the container is able to reach the LB address on that port... if not, check that haproxy is running and that it's listening on that port, if that's fine then check that haproxy is able to communicate to the repo container behind it09:38
odyssey4mewinggundamth that ops guide is very, very old... and that method of backup isn't great - we deploy the percona tooling so you can actually do a better backup method - I think it's called xtrabackup - which will backup the data in a better way09:39
*** schwicht has quit IRC09:39
winggundamthodyssey4me: so you are focusing to only backing up database?09:39
odyssey4mewinggundamth once you have it done, I'd encourage you to submit it to https://github.com/openstack/openstack-ansible-ops where we're putting any ops tooling anyone is happy to share09:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Only match full IP addresses in /etc/hosts  https://review.openstack.org/33041309:40
winggundamthodyssey4me: actually I'm using percona xtrabackup too09:40
odyssey4mewinggundamth xtrabackup as I understand it is just a method of accessing the tables - I don't really understand much about it :/09:40
winggundamthodyssey4me: from my understanding is it can online copy database without lock down any table. so it really fast and reliable09:41
*** admin0 has quit IRC09:46
odyssey4memrhillsman izaakk please ping me when you come online09:47
*** javeriak has joined #openstack-ansible09:50
thngodyssey4me: all are ok. Itis trying to do pip install mysql-python on galera container09:56
thngbut It didnt succeed :(09:56
thngI can type this command in container and it works.... understand nothing nwo09:57
thngMaybe I have to stop run-playbook and rerun utility_install alone ?09:58
thngbecause it has been retrying many times to do it since yesterday09:58
*** thorst_ has joined #openstack-ansible09:59
*** sguduru_ has joined #openstack-ansible10:01
*** sguduru has quit IRC10:01
*** admin0 has joined #openstack-ansible10:02
*** sguduru_ has quit IRC10:02
*** sguduru has joined #openstack-ansible10:02
*** pacoblox has joined #openstack-ansible10:05
*** thorst_ has quit IRC10:06
*** pacoblox has quit IRC10:08
*** admin0 has quit IRC10:08
odyssey4methng so it works when you access the container and do it manually?10:12
odyssey4methng perhaps try run the build again, but this time don't use run-playbooks... instead do this on the host: cd /opt/openstack-ansible/playbooks; openstack-ansible setup-infrastructure.yml10:13
thngyes it worked manually. Yes I intend to run each playbook separately to see. Thanks.10:14
*** admin0 has joined #openstack-ansible10:14
*** jamielennox|away is now known as jamielennox10:15
*** javeriak has quit IRC10:16
thngodyssey4me: can not run utility_install.yml alone ?10:17
*** javeriak has joined #openstack-ansible10:19
odyssey4methng sure you can, but utility-install.yml only acts against the utility container10:20
odyssey4methng you can execute any of the playbooks on their own10:20
odyssey4methng as long as their pre-requisites are implemented, it should work just fine10:20
thngok because I think it has setup others stuffs correctly before utility10:21
*** mikelk has quit IRC10:32
*** sguduru_ has joined #openstack-ansible10:34
*** sguduru__ has joined #openstack-ansible10:34
*** sgudur___ has joined #openstack-ansible10:36
*** sguduru has quit IRC10:36
*** smatzek has joined #openstack-ansible10:36
*** sguduru_ has quit IRC10:39
*** sguduru__ has quit IRC10:39
*** sdake has joined #openstack-ansible10:40
*** sdake_ has joined #openstack-ansible10:42
*** sdake has quit IRC10:45
*** schwicht has joined #openstack-ansible10:46
*** sguduru has joined #openstack-ansible10:46
*** sgudur___ has quit IRC10:46
*** admin0 has quit IRC11:01
*** thorst_ has joined #openstack-ansible11:03
*** chandanc has quit IRC11:04
*** javeriak has quit IRC11:06
*** sdake_ has quit IRC11:10
*** sguduru has quit IRC11:11
*** thorst_ has quit IRC11:11
*** sguduru has joined #openstack-ansible11:21
*** sguduru has quit IRC11:22
*** johnmilton has joined #openstack-ansible11:27
*** johnmilton has quit IRC11:31
*** weshay has joined #openstack-ansible11:37
*** McMurlock1 has joined #openstack-ansible11:43
*** johnmilton has joined #openstack-ansible11:43
*** berendt has quit IRC11:45
openstackgerritFlávio Ramalho proposed openstack/openstack-ansible-os_sahara: Implement Ubuntu 16.04 Xenial support  https://review.openstack.org/33029811:48
*** admin0 has joined #openstack-ansible11:51
*** thorst_ has joined #openstack-ansible11:53
mhaydenautomagically: thanks sir11:55
*** thorst__ has joined #openstack-ansible11:55
mhaydenwinggundamth: thanks for that -- i'll look at that bug as soon as i can11:55
*** thorst_ has quit IRC11:58
*** Oku_OS is now known as Oku_OS-away11:58
*** Oku_OS-away is now known as Oku_OS12:00
mhaydencould someone run today's meeting for me? i'm going to be stuck in one of those "your rear end had better be in that seat" kind of in person meetings :/12:02
*** sdake has joined #openstack-ansible12:05
*** zerda2 has quit IRC12:08
odyssey4memhayden perhaps jmccrory should have a turn?12:08
*** winggundamth_ has joined #openstack-ansible12:12
*** smatzek has quit IRC12:13
automagicallymorning all12:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [WIP] Improve tox config and add functional test env  https://review.openstack.org/33050012:14
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Fix shell command usage  https://review.openstack.org/33050512:19
*** GMAzrael has joined #openstack-ansible12:20
odyssey4meautomagically mhayden Can you please re-review https://review.openstack.org/327276 - it's been rebased after a merge conflict.12:22
* automagically looking12:22
*** smatzek has joined #openstack-ansible12:34
*** javeriak has joined #openstack-ansible12:34
* mhayden ganders12:35
mhaydenlooks gud12:36
automagicallyodyssey4me: By chance do you remember why this occurs? https://github.com/openstack/openstack-ansible/blob/master/playbooks/utility-install.yml#L11412:38
automagicallyIt seems a bit at odds with https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/tasks/lxc_cache_preparation.yml#L85 which is why I ask12:38
*** retreved has joined #openstack-ansible12:39
odyssey4meautomagically heh, that looks like a legacy thing12:39
odyssey4meautomagically I expect that we can remove https://github.com/openstack/openstack-ansible/blob/master/playbooks/utility-install.yml#L114-L123 now12:39
odyssey4mehmm, oh that's a different name12:40
automagicallyYep, I’m going to propose a removal, it seems unnecessary12:40
mhaydenif someone has a minute to gander at 329672 and 329673 -- those are some doc fix backports for the security role12:40
odyssey4melxc_hosts sets up a public key for access from the deployment host12:40
odyssey4methe utility container in that task is given the *private* key from the deployment host so that the utility container can also access all hosts/containers12:41
automagicallyRight, which can be overridden to not be root’s key12:41
automagicallyWhereas the utility container is demanding roots private key12:41
automagicallySo it should at least be overrideable in the same way12:41
*** kylek3h has joined #openstack-ansible12:41
automagicallyBut I’m not clear on why the utility container needs to be able to ssh to everything else12:41
automagicallyGiven that all plays should be run from the deployment host12:42
odyssey4meautomagically hmm, why would anyone want to ssh from the utility container to any other host/container?12:42
*** jamesdenton has joined #openstack-ansible12:42
*** javeriak has quit IRC12:42
odyssey4meautomagically yeah, it makes sense to make that optional and for private_ssh_key to also be settable via a var12:43
automagicallyCool, just wanted to confirm12:43
*** sguduru has joined #openstack-ansible12:44
*** kylek3h has quit IRC12:47
odyssey4meautomagically I'd go as far as to say let's default that to *not* happen.12:48
*** berendt has joined #openstack-ansible12:49
mhaydenodyssey4me: so far, ~ 2,220 twitter impressions for the whoa post and 167 sessions logged by google analytics on the post itself12:49
mhaydenthen again, tons of people block google analytics now :/12:50
odyssey4meblast we had three integrated patches in line to merge thanks to building on OSIC/RAX, then the one in the front of the queue (running on OVH) failed... so the others all reset12:50
odyssey4memhayden wow, that's awesome :)12:50
mhaydenodyssey4me: it even got a retweet from some guy from comcast12:50
mhaydenlooked familiar12:50
odyssey4methat looks more effective than the ML12:50
mhayden17 RT's and 11 likes12:51
odyssey4meit might actually be worth putting an email out to the ML as well for more coverage12:51
mhaydenseems quite decent12:51
*** winggundamth_ has quit IRC12:51
mhaydenodyssey4me: only a couple of replies -> https://twitter.com/majorhayden/status/74317093818364723212:51
*** mikelk has joined #openstack-ansible12:55
mhaydenodyssey4me: i can send something to the ML unless you'd rather12:55
*** klamath_ has joined #openstack-ansible12:57
*** klamath has quit IRC12:57
*** berendt has quit IRC12:57
*** woodard has joined #openstack-ansible12:57
*** berendt has joined #openstack-ansible12:58
*** thorst__ is now known as thorst_12:58
odyssey4memhayden go for it13:04
mhaydenokay13:05
mhaydenthe ML folks are probably getting tired of seeing my name on there :P13:05
*** winggundamth_ has joined #openstack-ansible13:05
odyssey4memeh, most people filter things out they're not interested in... you're setting a good example for our community - keep it coming13:06
evrardjpwe should never have to drop/fetch private keys13:07
evrardjpIMO13:07
evrardjpor on really seldom cases13:07
automagicallyevrardjp: I could not agree more13:08
evrardjplike the lsyncd / swift13:08
*** psilvad has joined #openstack-ansible13:08
odyssey4meyeah, those patches to convert the authorized keys task into a bash script concern me13:08
odyssey4mewhile that might be a stop-gap, I think it'd be better to rethink the whole thing13:09
evrardjpagreed13:09
evrardjpbut not overengineer this13:09
evrardjpkey distribution should be a role IMO13:09
evrardjpit could work for everything13:09
odyssey4meperhaps something simple like generating the keys on the deploy host, then pushing them out13:09
odyssey4meI'd also rather be doing that for SSL self-signed certs.13:09
evrardjpbut then, it's not really ansible-y13:09
odyssey4methat way the keys/certs are always user-provided... which cuts out a ton of code for us and makes it much simpler13:10
evrardjpodyssey4me: key store and distribute should be part of a general role13:10
evrardjpfor key distribution13:10
evrardjpwhether it's user provided or generated13:10
evrardjpyou focus on one thing, and do it right13:11
*** pacoblox has joined #openstack-ansible13:11
evrardjpbut yes, ideas, and as usual: lacking time ...13:11
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible: Disable root private key distribution by the utility playbook  https://review.openstack.org/33053513:11
*** messy has joined #openstack-ansible13:13
*** psilvad has quit IRC13:14
*** psilvad has joined #openstack-ansible13:14
*** pacoblox has quit IRC13:15
openstackgerritMerged openstack/openstack-ansible-security: Fix documentation warnings from sphinx  https://review.openstack.org/32967313:18
*** psilvad has quit IRC13:19
*** psilvad has joined #openstack-ansible13:21
*** jthorne has joined #openstack-ansible13:24
*** chandanc has joined #openstack-ansible13:25
*** v1k0d3n has joined #openstack-ansible13:25
*** psilvad has quit IRC13:25
*** v1k0d3n has quit IRC13:25
*** Guest48217 has joined #openstack-ansible13:26
mhaydenodyssey4me: sent to ML13:27
mhaydenwoot13:27
*** psilvad has joined #openstack-ansible13:27
*** Ashana has joined #openstack-ansible13:28
openstackgerritMerged openstack/openstack-ansible-os_sahara: Deprecation of verbose option from oslo.log  https://review.openstack.org/33029913:33
*** furlongm_ is now known as furlongm13:41
*** _sigmavirus24 is now known as sigmavirus2413:46
*** sigmavirus24 has joined #openstack-ansible13:46
*** pacoblox has joined #openstack-ansible13:47
*** berendt has quit IRC13:49
*** adrian_otto has joined #openstack-ansible13:52
*** adrian_otto has quit IRC13:54
odyssey4melogan- as an FYI, there have been many requests to make the plays run as non-root... so it'd be awesome if you could put together an etherpad (or just put in reviews) for things that need to happen to make that work13:55
thngodyssey4me: can you tell me if you use sudo for all commands openstack-ansible ? Because I used sudo for each command openstack-ansible. if not I cannt access to folder & files.14:01
logan-sure. I will check and push some patches if necessary. I think it is to the point now where it can mostly be achieved through configuration, will put together an etherpad14:02
odyssey4methng at this stage we assume that all commands are run as root14:02
thngNow i have just discovered that for pip_install, inside the container, if I run : python /opt/get-pip.py pip==8.1.2 setuptools==22.0.0 wheel==0.29.0 Ignoring indexes: https://pypi.python.org/simple14:02
odyssey4methng we also assume that all ansible connections to target hosts are as the root user14:02
thngit is blocked and do nothing untill timeout14:02
thngif I do with sudo before, thatis ok14:03
odyssey4melogan- that'd be great - it'd be really nice to know where the gaps are14:03
odyssey4methng well, if you're using a non-root user to execute ansible or access the containers/hosts then you're going to have a bad day at this stage14:03
thngI run sudo each time, because by default, ubuntu disable user root nope ?14:04
*** rromans_ is now known as rromans14:05
odyssey4methng ensure root based access was documented in the requirements as far as I remember... but I can't seem to find the note14:05
thngyes I have just found out that. Thats why i have good connectivity but for some operations such as pip_install, it does work and is blocked14:05
thngmaybe I missed it as usual :)14:05
odyssey4methng we tend to make use of folders which often are restricted to root14:06
*** scarlisle has joined #openstack-ansible14:06
pjm6hi all14:06
thngso what can I do at this stage ? rebuild AIO from 0 or enable root account and continue as root user14:07
thng?14:07
*** spotz_zzz is now known as spotz14:07
pjm6thng, you could elevate privileges14:07
pjm6using "sudo su -"14:07
pjm6if you want root access, i think you just need to change the password "sudo passwd root"14:08
*** sacharya has joined #openstack-ansible14:08
odyssey4methng if it's an AIO then we ensure that all containers have root available... you just need to 'sudo -i' if you're logged in as another user, then execute the commands as the root user14:08
pjm6and (if needed) change sshd_config to permit root login14:08
odyssey4mepjm6 yeah, I'd recommend only enabling ssh key-based login, otherwise you're going to have a bad day if your instance has a public IP14:08
pjm6odyssey4me, sure14:09
pjm6what i do is having an internal ip14:09
odyssey4methe first thing I do is install fail2ban on my test instances14:09
pjm6and the public ip blocking the SSH14:09
*** kstev has joined #openstack-ansible14:09
pjm6but usually i have root disabled or using public key14:09
pjm6odyssey4me, yes, fail2ban is a nice to have =D14:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ops: Pin test-requirements to match OpenStack requirements  https://review.openstack.org/33058314:10
*** kstev1 has joined #openstack-ansible14:11
openstackgerritMerged openstack/openstack-ansible: Add support for CustomLog format modification  https://review.openstack.org/32857114:11
*** KLevenstein has joined #openstack-ansible14:11
openstackgerritMerged openstack/openstack-ansible: Add Nova extensions blacklisting  https://review.openstack.org/32857914:11
openstackgerritMerged openstack/openstack-ansible: Ensure that AIO extra indexes config is well formed  https://review.openstack.org/32940614:11
*** kstev has quit IRC14:14
*** smatzek has quit IRC14:14
*** sacharya_ has joined #openstack-ansible14:18
*** winggundamth_ has quit IRC14:20
*** Guest48217 has quit IRC14:20
*** sacharya has quit IRC14:21
*** admin0 has quit IRC14:22
*** admin0 has joined #openstack-ansible14:26
openstackgerritMerged openstack/openstack-ansible: [docs] Revise upgrade guide structure  https://review.openstack.org/32805614:28
*** chandanc has quit IRC14:29
*** jorge_munoz has joined #openstack-ansible14:31
*** sacharya_ has quit IRC14:32
*** pacoblox has quit IRC14:32
*** sacharya has joined #openstack-ansible14:33
*** pacoblox has joined #openstack-ansible14:33
*** adrian_otto has joined #openstack-ansible14:34
*** zerda2 has joined #openstack-ansible14:36
*** ejoelsso has joined #openstack-ansible14:36
*** adrian_otto has quit IRC14:38
*** neilus has quit IRC14:41
*** pcaruana has quit IRC14:41
izaakkodyssey4me: ping14:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_gnocchi: Pin test-requirements to match OpenStack requirements  https://review.openstack.org/33061814:42
openstackgerritChristopher Hultin proposed openstack/openstack-ansible-os_magnum: Moving RabbitMQ setup to PreTasks  https://review.openstack.org/33062114:45
*** adrian_otto has joined #openstack-ansible14:46
zerda2Hello. Is it OK to backport another contributor's patch? I'd like to have https://review.openstack.org/#/c/290954/ in Liberty.14:51
*** kylek3h has joined #openstack-ansible14:52
*** pacoblox has quit IRC14:52
openstackgerritChristopher Hultin proposed openstack/openstack-ansible-os_magnum: Moving RabbitMQ setup to PreTasks  https://review.openstack.org/33062114:53
odyssey4mezerda2 yes of course it is14:53
zerda2odyssey4me, cool. Should I mention the original author in the commit message somehow?14:54
*** sdake has quit IRC14:54
odyssey4mezerda2 considering you won't be able to cherry-pick it would be nice if you set the original author as the author in your commit14:54
openstackgerritChristopher Hultin proposed openstack/openstack-ansible-os_magnum: Moving RabbitMQ setup to PreTasks  https://review.openstack.org/33062114:56
*** McMurlock1 has quit IRC14:56
zerda2odyssey4me, so I just --amend --author "John Doe <john@doe.com>" and that's it?14:57
odyssey4mezerda2 yeah I think so14:57
zerda2odyssey4me, got it, thank you14:57
*** sdake has joined #openstack-ansible14:59
*** alikins has joined #openstack-ansible15:04
*** v1k0d3n has joined #openstack-ansible15:06
*** weezS has joined #openstack-ansible15:07
*** cloader89 has joined #openstack-ansible15:10
*** zerda2 has quit IRC15:13
*** pacoblox has joined #openstack-ansible15:14
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_rally: Pin test-requirements to match OpenStack requirements  https://review.openstack.org/33063915:21
*** michaelgugino has joined #openstack-ansible15:24
*** chandanc has joined #openstack-ansible15:24
*** pacoblox has quit IRC15:26
*** sacharya_ has joined #openstack-ansible15:28
*** sacharya has quit IRC15:30
*** schwicht has quit IRC15:30
*** sacharya has joined #openstack-ansible15:30
*** pacoblox has joined #openstack-ansible15:31
*** sguduru has quit IRC15:31
*** sacharya_ has quit IRC15:33
*** openstackgerrit has quit IRC15:34
*** adrian_otto has quit IRC15:34
*** openstackgerrit has joined #openstack-ansible15:34
*** pacoblox has quit IRC15:35
*** mikelk has quit IRC15:35
*** pacoblox has joined #openstack-ansible15:35
*** raddaoui has joined #openstack-ansible15:36
mrhillsmanodyssey4me15:37
*** ejoelsso has quit IRC15:39
*** admin0 has quit IRC15:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_zaqar: Pin test-requirements to match OpenStack requirements  https://review.openstack.org/33064815:41
*** pacoblox has quit IRC15:42
*** pacoblox has joined #openstack-ansible15:43
palendaeodyssey4me, Is there some setting somewhere that crons reassigning of launchpad issues? Infra really wants to assign you to https://bugs.launchpad.net/openstack-ansible/+bug/158890215:43
openstackLaunchpad bug 1588902 in openstack-ansible "Variables defined in global_overrides persist after deletion" [High,In progress] - Assigned to Jesse Pretorius (jesse-pretorius)15:43
odyssey4mepalendae I think that something in jeepyb is on the fritz15:44
*** adrian_otto has joined #openstack-ansible15:44
*** sacharya has quit IRC15:44
odyssey4mepalendae ah, I think it's because I updated the patch set (rebased)15:44
*** saneax is now known as saneax_AFK15:44
palendaeHm15:45
odyssey4meanyone who updates the patch gets the bug assigned15:45
*** sacharya has joined #openstack-ansible15:45
palendaeAh15:45
palendaeThough I don't see the patch set linked in the bug other than travis's comment15:45
palendaeSince I just used his failing test as a starting point, and that didn't have a 'Closes-Bug' or similar statement15:46
*** pacoblox has quit IRC15:46
odyssey4mepalendae the topic on the review is the link15:48
palendaeAh15:48
*** pacoblox has joined #openstack-ansible15:54
*** rahuls has joined #openstack-ansible15:54
*** mummer has joined #openstack-ansible15:56
*** sacharya_ has joined #openstack-ansible15:57
*** jmccrory_ has joined #openstack-ansible15:58
*** jayc has joined #openstack-ansible15:58
odyssey4memeeting in #openstack-meeting-4 cloudnull, mattt, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, Sam-I-Am, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, automagically, spotz, vdo, jmccrory, alextricity25, jasondotstar, KLevenstein, admin0, michaelgugino,15:59
odyssey4me ametts, v1k0d3n, severion, bgmccollum, darrenc, JRobinson__, asettle, colinmcnamara, thorst, adreznec15:59
odyssey4meplease join us mrhillsman izaakk15:59
*** sacharya has quit IRC16:00
*** smatzek has joined #openstack-ansible16:00
*** shausy has quit IRC16:02
*** rueben has joined #openstack-ansible16:06
*** berendt has joined #openstack-ansible16:06
*** BjoernT has joined #openstack-ansible16:06
*** sacharya has joined #openstack-ansible16:07
*** javeriak has joined #openstack-ansible16:09
*** sacharya_ has quit IRC16:10
*** gregfaust has joined #openstack-ansible16:13
*** javeriak_ has joined #openstack-ansible16:14
*** galstrom_zzz is now known as galstrom16:14
*** javeriak has quit IRC16:15
*** permalac has quit IRC16:15
*** berendt has quit IRC16:16
*** sdake has quit IRC16:20
*** jayc has quit IRC16:23
*** jayc_ has quit IRC16:23
*** berendt has joined #openstack-ansible16:23
*** jayc has joined #openstack-ansible16:24
*** chandanc has quit IRC16:24
BjoernTtriaging still ongoing ?16:26
palendaeBjoernT, yes, the meeting's still in progress16:27
palendaein #openstack-meeting-416:28
*** sdake has joined #openstack-ansible16:28
*** berendt has quit IRC16:31
*** schwicht has joined #openstack-ansible16:34
BjoernTstrange, I don't get the channel hopping between here and openstack-meeting-4, last week it was here16:34
bgmccollumone day is bug triage in here, other day is meeting over there16:35
*** berendt has joined #openstack-ansible16:36
automagicallyBjoernT: Tuesdays are bug triage, Thursdays weekly meeting in the other channel16:36
*** schwicht has quit IRC16:38
palendaeThe end of it is open forum so it'd be a time to bring up anything not mentioned on Tuesday16:38
*** schwicht has joined #openstack-ansible16:41
BjoernTOK thanks16:49
*** mkrish004c has joined #openstack-ansible16:54
mkrish004cHi Guys, i am trying out OSA in 2 node, one controller one compute. Does the kernal version difference between 2 nodes will affect the openstack services ?16:55
openstackgerritMerged openstack/openstack-ansible-ops: Pin test-requirements to match OpenStack requirements  https://review.openstack.org/33058316:56
*** berendt has quit IRC16:57
*** M00nr14n has joined #openstack-ansible16:57
odyssey4memkrish004c not likely16:58
michaelguginomkrish004c: I recommend you start with deploying to a normalized set of hosts16:58
odyssey4memkrish004c it only affects your operations :)16:58
odyssey4memichaelgugino thanks for notifying about the lxd work, and for picking up the watcher work... looking forward to seeing both16:59
*** berendt has joined #openstack-ansible16:59
michaelguginoFor sure.  I also owe some patches and docs on the OVS stuff.  I'm starting to feel like I need a clone.17:00
*** pacoblox has quit IRC17:00
mkrish004c@odyssey4me and @michaelgugino, thanks a lot for your advice :)17:01
automagicallymichaelgugino: Docs in particular would be awesome. I’m at the point where I’m wondering what you did in terms of configuring br-vlan and br-vxlan17:01
michaelguginoautomagically: I didn't do anything with them.  Just got the provider network going.  That's the patch set that needs to be ironed out.17:03
*** pacoblox has joined #openstack-ansible17:04
odyssey4memichaelgugino automagically yeah, it makes complete sense to me that the nova role will need some tweaks based on the different networking wire-ups that would be needed.17:09
*** M00nr14n has quit IRC17:10
openstackgerritMajor Hayden proposed openstack/openstack-ansible: Update lists of skipped security role tasks  https://review.openstack.org/32773217:14
mhaydend34dh0r53: ^^ commit message should match your tastes :)17:14
openstackgerritMerged openstack/openstack-ansible-os_magnum: Moving RabbitMQ setup to PreTasks  https://review.openstack.org/33062117:14
*** cloader89 has quit IRC17:14
*** woodard has quit IRC17:16
*** woodard has joined #openstack-ansible17:17
*** woodard has quit IRC17:17
*** woodard has joined #openstack-ansible17:18
*** M00nr14n has joined #openstack-ansible17:25
openstackgerritMerged openstack/openstack-ansible-os_gnocchi: Pin test-requirements to match OpenStack requirements  https://review.openstack.org/33061817:25
*** berendt has quit IRC17:25
*** Zucan has joined #openstack-ansible17:27
*** berendt has joined #openstack-ansible17:27
*** M00nr14n has quit IRC17:33
*** M00nr14n has joined #openstack-ansible17:35
*** M00nr14n has quit IRC17:38
*** M00nr14n has joined #openstack-ansible17:38
openstackgerritAdam Reznechek proposed openstack/openstack-ansible-specs: [WIP] Add multiple CPU architecture support spec  https://review.openstack.org/32963717:39
*** berendt has quit IRC17:41
*** woodard_ has joined #openstack-ansible17:41
*** berendt has joined #openstack-ansible17:43
*** tiagogomes has quit IRC17:44
*** woodard has quit IRC17:45
*** rueben has quit IRC17:45
*** greg_faust has joined #openstack-ansible17:51
*** gregfaust has quit IRC17:53
*** greg_faust is now known as gregfaust17:53
*** berendt has quit IRC17:56
*** berendt has joined #openstack-ansible17:56
odyssey4mejmccrory automagically mhayden if you have a moment I think that https://review.openstack.org/329920 needs some attention17:58
*** electrofelix has quit IRC17:58
mpjettais there an easy way to use novnc for the console instead of spice? I see some code references to novnc but can’t find a variable for an AIO17:59
odyssey4memhayden FYI https://review.openstack.org/330154 needs some attention too - I think your vote needs to be revoked17:59
*** spotz is now known as spotz_zzz18:01
*** spotz_zzz is now known as spotz18:02
odyssey4mempjetta yeah, I think it's multiple variables and we can do better to implement some changes to make it one variable to change... if you can figure it out a patch would be awesome18:04
*** Mudpuppy has joined #openstack-ansible18:04
mpjettathanks18:05
odyssey4mempjetta I *think* it should be as simple as adding 'nova_console_type: novnc' to /etc/openstack_deploy/user_variables.yml - but I might be wrong.18:05
mpjettawill try that, ty18:06
odyssey4meok, I'm out for the night - cheers all18:06
*** jmccrory_ has quit IRC18:19
*** berendt has quit IRC18:23
*** cloader89 has joined #openstack-ansible18:26
*** rueben has joined #openstack-ansible18:27
*** admin0 has joined #openstack-ansible18:27
*** berendt has joined #openstack-ansible18:28
*** sacharya has quit IRC18:32
*** sacharya_ has joined #openstack-ansible18:32
*** sacharya has joined #openstack-ansible18:33
*** admin0 has quit IRC18:34
openstackgerritMerged openstack/openstack-ansible: Fix keystone DB Access variable  https://review.openstack.org/32766018:34
*** admin0 has joined #openstack-ansible18:35
*** sacharya_ has quit IRC18:37
*** michaelgugino has quit IRC18:38
*** admin0 has quit IRC18:39
*** admin0 has joined #openstack-ansible18:45
*** saneax_AFK is now known as saneax18:46
*** M00nr14n has quit IRC18:46
*** admin0 has quit IRC18:48
*** kstev1 has quit IRC18:50
*** berendt has quit IRC18:51
*** M00nr14n has joined #openstack-ansible18:53
*** admin0 has joined #openstack-ansible18:53
openstackgerritMerged openstack/openstack-ansible-os_rally: Pin test-requirements to match OpenStack requirements  https://review.openstack.org/33063918:54
*** berendt has joined #openstack-ansible18:54
openstackgerritMerged openstack/openstack-ansible-os_zaqar: Pin test-requirements to match OpenStack requirements  https://review.openstack.org/33064818:54
*** kstev has joined #openstack-ansible18:55
*** hybridpollo has joined #openstack-ansible18:57
*** kstev has quit IRC18:57
*** admin0 has quit IRC18:57
*** kstev has joined #openstack-ansible18:58
*** rueben has quit IRC18:58
*** admin0 has joined #openstack-ansible19:00
*** TxGirlGeek has joined #openstack-ansible19:01
*** M00nr14n has quit IRC19:02
*** admin0 has quit IRC19:02
*** schwicht has quit IRC19:07
*** saneax is now known as saneax_AFK19:08
*** admin0 has joined #openstack-ansible19:09
*** M00nr14n has joined #openstack-ansible19:10
*** TxGirlGeek has quit IRC19:11
*** admin0 has quit IRC19:12
*** TxGirlGeek has joined #openstack-ansible19:12
*** johnmilton has quit IRC19:13
*** sacharya has quit IRC19:13
*** sacharya has joined #openstack-ansible19:13
*** javeriak has joined #openstack-ansible19:14
*** TxGirlGeek has quit IRC19:14
*** TxGirlGeek has joined #openstack-ansible19:15
*** javeriak_ has quit IRC19:15
*** admin0 has joined #openstack-ansible19:23
*** berendt has quit IRC19:23
*** rueben has joined #openstack-ansible19:24
*** M00nr14n has quit IRC19:25
*** M00nr14n has joined #openstack-ansible19:26
*** admin0 has quit IRC19:28
*** admin0 has joined #openstack-ansible19:29
*** johnmilton has joined #openstack-ansible19:29
*** woodard has joined #openstack-ansible19:37
*** woodard_ has quit IRC19:40
*** woodard has quit IRC19:41
*** TxGirlGeek has quit IRC19:42
*** TxGirlGeek has joined #openstack-ansible19:43
*** admin0 has quit IRC19:43
*** TxGirlGeek has quit IRC19:46
*** admin0 has joined #openstack-ansible19:46
*** TxGirlGeek has joined #openstack-ansible19:46
openstackgerritBjoern Teipel proposed openstack/openstack-ansible: Migrate keystone v2 images to v3 during Liberty upgrade  https://review.openstack.org/31707019:50
*** TxGirlGeek has quit IRC19:52
*** TxGirlGeek has joined #openstack-ansible19:53
BjoernTCan someone please look at https://review.openstack.org/#/c/317070/19:55
BjoernTI only rebased it19:55
*** TxGirlGeek has quit IRC19:55
*** TxGirlGeek has joined #openstack-ansible19:56
mhaydenBjoernT: gandering19:56
mhaydenBjoernT: when you rebased, it removed the small change i made to fix the release note19:57
BjoernTThanks, wait for the gating first19:58
BjoernTnew gating = gambling19:58
*** cloader89 has quit IRC19:58
*** TxGirlGeek has quit IRC19:59
*** TxGirlGeek has joined #openstack-ansible19:59
*** admin0 has quit IRC19:59
*** schwicht has joined #openstack-ansible19:59
*** spotz is now known as spotz_zzz20:00
*** admin0 has joined #openstack-ansible20:01
mhaydenyou'll have to wait for gating 2x to fix it :/20:01
openstackgerritBjoern Teipel proposed openstack/openstack-ansible: Migrate keystone v2 images to v3 during Liberty upgrade  https://review.openstack.org/31707020:01
*** TxGirlGeek has quit IRC20:03
*** bsv has joined #openstack-ansible20:04
BjoernTyeah and I just saw the changes inside the upgrade handbook20:06
bsvEvenings :)20:07
openstackgerritBjoern Teipel proposed openstack/openstack-ansible: Migrate keystone v2 images to v3 during Liberty upgrade  https://review.openstack.org/31707020:13
*** admin0 has quit IRC20:15
openstackgerritBjoern Teipel proposed openstack/openstack-ansible: Migrate keystone v2 images to v3 during Liberty upgrade  https://review.openstack.org/31707020:16
openstackgerritAntony Messerli proposed openstack/openstack-ansible-os_nova: [WIP] Implement Nova Xen Virt Driver  https://review.openstack.org/33076920:17
*** openstackstatus has joined #openstack-ansible20:18
*** ChanServ sets mode: +v openstackstatus20:18
*** jayc has quit IRC20:18
mhaydenautomagically: i'm doing a little digging into your shenanigans here -> https://review.openstack.org/33015420:19
mhaydenohai bsv20:19
*** admin0 has joined #openstack-ansible20:19
*** admin0 has quit IRC20:29
jmccrorymhayden: i was just looking at that too, haven't been able to reproduce locally20:30
mhaydenme either20:30
*** admin0 has joined #openstack-ansible20:31
bsvaint that the '{{}}' thing from ansible 2+ ?20:31
*** woodard has joined #openstack-ansible20:32
bsvWe have a ton of playbooks at work, all of them slowly being fixed. The 'bare variables' warning is common ;)20:32
*** jayc has joined #openstack-ansible20:33
*** javeriak has quit IRC20:33
*** woodard has quit IRC20:33
bsvah yes, it helps to read the diff :p20:34
*** woodard has joined #openstack-ansible20:34
*** admin0 has quit IRC20:34
*** spotz_zzz is now known as spotz20:41
*** daneyon has quit IRC20:42
*** admin0 has joined #openstack-ansible20:45
*** admin0 has quit IRC20:47
*** Mudpuppy has quit IRC20:50
*** Zucan has quit IRC20:52
*** admin0 has joined #openstack-ansible20:52
*** sacharya has quit IRC20:54
*** sacharya has joined #openstack-ansible20:55
*** sacharya_ has joined #openstack-ansible20:56
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-repo_build: [WIP] build libvirt-python on xenial  https://review.openstack.org/33078220:57
*** messy has quit IRC20:59
*** sacharya has quit IRC20:59
*** TxGirlGeek has joined #openstack-ansible21:00
openstackgerritAntony Messerli proposed openstack/openstack-ansible-os_nova: [WIP] Implement Nova Xen Virt Driver  https://review.openstack.org/33076921:02
*** TxGirlGeek has quit IRC21:03
*** TxGirlGeek has joined #openstack-ansible21:05
*** sacharya has joined #openstack-ansible21:10
*** TxGirlGeek has quit IRC21:10
*** sachary__ has joined #openstack-ansible21:11
*** thorst_ has quit IRC21:11
*** thorst_ has joined #openstack-ansible21:11
*** psilvad has quit IRC21:12
*** sacharya_ has quit IRC21:13
*** smatzek has quit IRC21:14
*** sacharya has quit IRC21:14
*** kstev has quit IRC21:14
*** jayc has quit IRC21:15
*** jayc has joined #openstack-ansible21:16
*** thorst_ has quit IRC21:16
*** jayc has quit IRC21:16
*** jayc has joined #openstack-ansible21:17
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-repo_build: [WIP] build libvirt-python on xenial  https://review.openstack.org/33078221:18
*** wadeholler has quit IRC21:19
*** sachary__ has quit IRC21:20
*** sacharya has joined #openstack-ansible21:20
*** pjm6_ has joined #openstack-ansible21:21
*** sacharya_ has joined #openstack-ansible21:21
*** pjm6 has quit IRC21:22
*** galstrom is now known as galstrom_zzz21:22
*** thorst_ has joined #openstack-ansible21:23
*** karimb has quit IRC21:25
*** sacharya has quit IRC21:25
*** karimb has joined #openstack-ansible21:26
*** thorst_ has quit IRC21:28
*** Ashana has quit IRC21:31
*** thorst_ has joined #openstack-ansible21:44
*** thorst__ has joined #openstack-ansible21:46
*** pjm6 has joined #openstack-ansible21:48
*** thorst_ has quit IRC21:49
*** adrian_otto has quit IRC21:50
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-repo_build: Install pkg-config package  https://review.openstack.org/33078221:50
jmccrorymhayden automagically ^ should fix repo_build on xenial21:50
*** thorst__ has quit IRC21:50
*** pjm6_ has quit IRC21:50
mrdaMorning all21:53
*** galstrom_zzz is now known as galstrom22:01
*** rueben has quit IRC22:04
*** mkrish004c has quit IRC22:04
*** BjoernT has quit IRC22:04
*** sigmavirus24 is now known as sigmavirus24_22:05
*** karimb has quit IRC22:06
*** KLevenstein has quit IRC22:10
*** kylek3h has quit IRC22:16
*** bsv has quit IRC22:17
*** weshay has quit IRC22:18
*** jayc_ has joined #openstack-ansible22:21
*** jayc has quit IRC22:23
*** darrenc is now known as darren_afk22:34
*** jamesdenton has quit IRC22:38
*** schwicht has quit IRC22:39
openstackgerritMerged openstack/openstack-ansible: Migrate keystone v2 images to v3 during Liberty upgrade  https://review.openstack.org/31707022:41
*** admin0 has quit IRC22:46
*** saneax_AFK is now known as saneax22:49
*** darren_afk is now known as darrenc22:55
*** weezS has quit IRC22:57
*** spotz is now known as spotz_zzz23:07
*** weezS has joined #openstack-ansible23:10
*** weezS has quit IRC23:14
*** daneyon has joined #openstack-ansible23:16
*** raddaoui has quit IRC23:17
*** asselin has quit IRC23:17
*** adrian_otto has joined #openstack-ansible23:19
*** galstrom is now known as galstrom_zzz23:22
*** arafferty_ has joined #openstack-ansible23:23
*** mummer has quit IRC23:26
*** scarlisle has quit IRC23:28
*** daneyon has quit IRC23:33
*** jamesdenton has joined #openstack-ansible23:39
*** rueben has joined #openstack-ansible23:42
*** sshen_ has quit IRC23:43
*** sshen has joined #openstack-ansible23:48
*** sdake has quit IRC23:57
*** rueben has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!