| *** makowals has quit IRC | 00:01 | |
| *** dminer has quit IRC | 00:02 | |
| *** VW has quit IRC | 00:10 | |
| *** marst has quit IRC | 00:12 | |
| *** ducttape_ has joined #openstack-operators | 00:20 | |
| *** chyka has quit IRC | 00:31 | |
| *** ducttape_ has quit IRC | 00:31 | |
| *** chyka has joined #openstack-operators | 00:32 | |
| *** B_Smith has quit IRC | 00:35 | |
| *** chyka has quit IRC | 00:36 | |
| *** B_Smith has joined #openstack-operators | 00:37 | |
| *** bradjones has quit IRC | 00:55 | |
| *** mriedem has joined #openstack-operators | 00:58 | |
| *** B_Smith has quit IRC | 01:11 | |
| *** makowals has joined #openstack-operators | 01:25 | |
| *** VW has joined #openstack-operators | 01:38 | |
| *** saneax-_-|AFK is now known as saneax | 01:43 | |
| *** B_Smith has joined #openstack-operators | 01:49 | |
| *** ducttape_ has joined #openstack-operators | 01:55 | |
| *** ducttape_ has quit IRC | 01:59 | |
| *** ducttape_ has joined #openstack-operators | 02:13 | |
| *** VW has quit IRC | 02:29 | |
| *** Apoorva has quit IRC | 02:36 | |
| *** Oku_OS is now known as Oku_OS-away | 02:46 | |
| *** VW has joined #openstack-operators | 02:53 | |
| *** ducttape_ has quit IRC | 02:54 | |
| *** saneax is now known as saneax-_-|AFK | 03:24 | |
| *** sdake has joined #openstack-operators | 03:30 | |
| *** Apoorva has joined #openstack-operators | 03:32 | |
| *** armax has joined #openstack-operators | 03:40 | |
| *** saneax-_-|AFK is now known as saneax | 03:55 | |
| *** vijaykc4 has joined #openstack-operators | 04:15 | |
| *** liverpooler has quit IRC | 04:23 | |
| *** Apoorva has quit IRC | 04:32 | |
| *** sdake_ has joined #openstack-operators | 04:35 | |
| *** sdake has quit IRC | 04:39 | |
| *** vijaykc4 has quit IRC | 04:52 | |
| *** catinthe_ has quit IRC | 04:54 | |
| *** sdake_ is now known as sdake | 04:55 | |
| *** catintheroof has joined #openstack-operators | 05:02 | |
| *** VW has quit IRC | 05:02 | |
| *** catintheroof has quit IRC | 05:14 | |
| *** B_Smith has quit IRC | 05:19 | |
| *** slaweq has quit IRC | 05:24 | |
| *** slaweq has joined #openstack-operators | 05:26 | |
| *** bsilverman_ has quit IRC | 05:29 | |
| *** bsilverman_5 has joined #openstack-operators | 05:29 | |
| *** mriedem has quit IRC | 05:32 | |
| *** B_Smith has joined #openstack-operators | 05:37 | |
| *** B_Smith has quit IRC | 05:44 | |
| *** catintheroof has joined #openstack-operators | 05:46 | |
| *** B_Smith has joined #openstack-operators | 05:55 | |
| *** B_Smith has quit IRC | 06:02 | |
| *** B_Smith has joined #openstack-operators | 06:07 | |
| *** sticker has quit IRC | 06:12 | |
| *** crenguta has joined #openstack-operators | 06:14 | |
| *** armax has quit IRC | 06:19 | |
| *** armax has joined #openstack-operators | 06:20 | |
| *** armax has quit IRC | 06:20 | |
| *** mriedem has joined #openstack-operators | 06:29 | |
| *** jproulx has quit IRC | 06:35 | |
| *** furlongm_ has quit IRC | 06:51 | |
| *** B_Smith has quit IRC | 07:04 | |
| *** Oku_OS-away is now known as Oku_OS | 07:17 | |
| *** B_Smith has joined #openstack-operators | 07:29 | |
| *** pcaruana has joined #openstack-operators | 07:43 | |
| *** dewanee_ has quit IRC | 07:45 | |
| *** mj_richardson has joined #openstack-operators | 07:47 | |
| *** dewanee has joined #openstack-operators | 07:47 | |
| *** melwitt_ has joined #openstack-operators | 07:48 | |
| *** tdasilva has quit IRC | 07:51 | |
| *** melwitt has quit IRC | 07:51 | |
| *** mj_richa1dson has quit IRC | 07:51 | |
| *** tdasilva has joined #openstack-operators | 07:51 | |
| *** tesseract has joined #openstack-operators | 08:05 | |
| *** paramite has joined #openstack-operators | 08:09 | |
| *** klindgren has quit IRC | 08:27 | |
| *** klindgren has joined #openstack-operators | 08:27 | |
| *** zioproto has joined #openstack-operators | 08:50 | |
| *** bjolo has joined #openstack-operators | 08:53 | |
| *** crenguta has quit IRC | 08:56 | |
| *** Apoorva has joined #openstack-operators | 08:56 | |
| *** crenguta has joined #openstack-operators | 08:58 | |
| *** Apoorva has quit IRC | 08:58 | |
| *** vijaykc4 has joined #openstack-operators | 09:01 | |
| *** derekh has joined #openstack-operators | 09:15 | |
| *** racedo has quit IRC | 09:15 | |
| *** racedo has joined #openstack-operators | 09:18 | |
| *** timburke has quit IRC | 09:32 | |
| *** timburke has joined #openstack-operators | 09:35 | |
| *** crenguta has quit IRC | 09:37 | |
| *** crenguta has joined #openstack-operators | 09:39 | |
| *** sdake has quit IRC | 09:52 | |
| *** sdake has joined #openstack-operators | 09:53 | |
| *** vijaykc4 has quit IRC | 10:13 | |
| *** saneax is now known as saneax-_-|AFK | 10:31 | |
| *** vijaykc4 has joined #openstack-operators | 10:35 | |
| *** electrofelix has joined #openstack-operators | 10:59 | |
| *** ducttape_ has joined #openstack-operators | 11:29 | |
| *** vijaykc4 has quit IRC | 11:30 | |
| *** ducttape_ has quit IRC | 11:31 | |
| *** pcaruana has quit IRC | 11:59 | |
| *** saneax-_-|AFK is now known as saneax | 12:02 | |
| *** B_Smith has quit IRC | 12:03 | |
| *** pcaruana has joined #openstack-operators | 12:06 | |
| *** cdelatte has joined #openstack-operators | 12:08 | |
| *** bjolo has quit IRC | 12:14 | |
| *** bjolo_ has joined #openstack-operators | 12:14 | |
| *** sdake_ has joined #openstack-operators | 12:18 | |
| *** sdake has quit IRC | 12:18 | |
| *** catinthe_ has joined #openstack-operators | 12:32 | |
| *** simon-AS559 has joined #openstack-operators | 12:33 | |
| *** catintheroof has quit IRC | 12:33 | |
| *** vijaykc4 has joined #openstack-operators | 12:38 | |
| *** vijaykc4 has quit IRC | 12:55 | |
| *** liverpooler has joined #openstack-operators | 13:08 | |
| *** dminer has joined #openstack-operators | 13:08 | |
| *** ducttape_ has joined #openstack-operators | 13:11 | |
| *** vijaykc4 has joined #openstack-operators | 13:11 | |
| *** sdake has joined #openstack-operators | 13:15 | |
| *** sdake_ has quit IRC | 13:17 | |
| *** ducttape_ has quit IRC | 13:21 | |
| *** ducttape_ has joined #openstack-operators | 13:24 | |
| *** B_Smith has joined #openstack-operators | 13:29 | |
| *** ducttape_ has quit IRC | 13:34 | |
| *** bradjones has joined #openstack-operators | 13:38 | |
| *** bradjones has quit IRC | 13:38 | |
| *** bradjones has joined #openstack-operators | 13:38 | |
| shewless | Hello. Still working on getting my openstack services behind a haproxy reverse ssl proxy. I got keystone to work but using glance I'm receiving a 502 error. Just wondering if anyone could look at my config and offer some guidance? | 13:44 |
|---|---|---|
| *** paramite has quit IRC | 13:47 | |
| *** vijaykc4 has quit IRC | 13:54 | |
| mnaser | sounds like a haproxy configuration problem | 13:59 |
| *** dminer has quit IRC | 14:00 | |
| shewless | mnaser I think it just might be. Would you mind having a quick peek? | 14:02 |
| shewless | http://paste.ubuntu.com/23833422 | 14:02 |
| shewless | keystone works. Glance doesn't. The other thing i notice is that I have to stop glance, then start haproxy, then start glance, or else haproxy complains it can't bind 0.0.0.0:9292. But I specifially set the bind_host in glance-api.conf to 127.0.0.1 :s | 14:03 |
| *** sdake_ has joined #openstack-operators | 14:06 | |
| *** sdake has quit IRC | 14:09 | |
| *** electrofelix has quit IRC | 14:13 | |
| *** electrofelix has joined #openstack-operators | 14:15 | |
| erhudy | ah, i do recall some issues with glance racing to bind everything | 14:16 |
| erhudy | this is probably my biggest complaint with debian/ubuntu, that services start automatically with default configurations | 14:17 |
| *** saneax is now known as saneax-_-|AFK | 14:18 | |
| *** electrofelix has quit IRC | 14:22 | |
| shewless | erhudy: I don't think that's the problem because it's reproducible (it's not just the first time glance starts) | 14:25 |
| shewless | erhudy: any hints on my haproxy file? That 502 error is weird | 14:26 |
| *** catintheroof has joined #openstack-operators | 14:33 | |
| *** catinthe_ has quit IRC | 14:36 | |
| shewless | This looks relavent: If HTTP request is larger than (tune.bufsize - tune.maxrewrite), haproxy will return HTTP 400 (Bad Request) error. Similarly if an HTTP response is larger than this size, haproxy will return HTTP 502 (Bad Gateway). | 14:39 |
| shewless | will try and tune that | 14:39 |
| yankcrime | shewless: i'd look in the logs for glance-api and glance-registry, chances are they're throwing some kind of exception which will give you a clue as to where to look next | 14:39 |
| shewless | well.. will try and figure out how to allow big http responses | 14:39 |
| *** zeih has joined #openstack-operators | 14:40 | |
| erhudy | let me look at how we have glance configured | 14:40 |
| erhudy | though i don't think we're doing anything out of the ordinary with it | 14:41 |
| erhudy | nope, using the same config for glance-api as for all the other APIs, so maybe it's something in our global settings | 14:43 |
| *** bjolo_ has quit IRC | 14:43 | |
| shewless | yankcrime: no glance errors | 14:44 |
| shewless | erhudy: thanks for checking! | 14:44 |
| shewless | erhudy: I'm most concerned about he haproxy config. I think I'm missing something there | 14:44 |
| erhudy | https://github.com/bloomberg/chef-bcpc/blob/master/cookbooks/bcpc/templates/default/haproxy-head.cfg.erb is the template for our haproxy setup | 14:45 |
| yankcrime | shewless: haproxy's status OK for those services? | 14:45 |
| yankcrime | shewless: entries in the service catalogue all present and correct? | 14:45 |
| *** B_Smith has quit IRC | 14:49 | |
| shewless | yankcrime: I'm just using haproxy as a reverse proxy atm (no state checking) but the service is running okay and working for keystone. THe glance entries exist in the service catalog just find and dandy | 14:51 |
| shewless | erhudy: thanks for the cfg reference! I'm not doing any loadbalancing yet so I'm trying to figure out which parts are relevant for me. | 14:51 |
| *** zeih has quit IRC | 14:53 | |
| *** ducttape_ has joined #openstack-operators | 14:53 | |
| *** melwitt_ is now known as melwitt | 14:55 | |
| yankcrime | shewless: does glance-api work locally, at least for just a simple GET? | 14:56 |
| yankcrime | you should see a response with some metadata around versioning etc. | 14:57 |
| shewless | yankcrime: you may be onto something there | 14:59 |
| shewless | I can't connect to http://127.0.0.1:9292 | 14:59 |
| shewless | not sure if I should be able to or not | 15:00 |
| yankcrime | you should | 15:00 |
| yankcrime | well, depending on glance-api's configuration | 15:00 |
| yankcrime | if you've configured it correctly to bind to the loopback interface, then you should be able to | 15:00 |
| shewless | yes.. I just tried my production environment and it allows me to connect to port 9292 | 15:00 |
| shewless | damn. I wonder if glance works with bind_host = localhost | 15:01 |
| s3an2 | shewless, try `lsof -i:9292` do you see the glance-api? | 15:01 |
| shewless | or if I have to do 127.0.0.1 ? | 15:01 |
| shewless | s3an2: nope | 15:01 |
| shewless | there's the problem | 15:01 |
| shewless | but why :) | 15:01 |
| *** ducttape_ has quit IRC | 15:02 | |
| yankcrime | bind_host definitely set in the right section and in the right file? | 15:02 |
| * yankcrime mumbles something about configuration management | 15:02 | |
| shewless | oh my.. looks like "bind_host = 127.0.0.1" works better than "bind_host = localhost" in glance-api.conf | 15:02 |
| yankcrime | odd - does 'localhost' not resolve to 127.0.0.1 ? | 15:03 |
| shewless | yankcrime: it does! and I am using ansible.. just converting my "standalone" config to work behind a reverse proxy | 15:03 |
| shewless | it used to say "::" which basically means 0.0.0.0 but also IPv6.. | 15:04 |
| *** B_Smith has joined #openstack-operators | 15:04 | |
| shewless | yankcrime a3an2: I think the problem is my haproxy. I have it set to "bind 0.0.0.0:9292" | 15:06 |
| shewless | But I think that will include localhost | 15:06 |
| yankcrime | ah, yes | 15:06 |
| shewless | so I guess I need to be more specific if I want to run haproxy on the same host as my services | 15:07 |
| yankcrime | yup | 15:07 |
| *** VW has joined #openstack-operators | 15:07 | |
| shewless | for some reason apache with keystone doesn't seem to mind.. but glance is not happy | 15:07 |
| *** jproulx has joined #openstack-operators | 15:07 | |
| *** VW has quit IRC | 15:20 | |
| *** VW has joined #openstack-operators | 15:21 | |
| *** TxGirlGeek has joined #openstack-operators | 15:23 | |
| *** ducttape_ has joined #openstack-operators | 15:29 | |
| mnaser | shewless keystone bind_host is ignored | 15:30 |
| mnaser | if youre using it with apache wsgi | 15:30 |
| *** vijaykc4 has joined #openstack-operators | 15:30 | |
| shewless | mnaser... right but I have apache configured to listen on localhost.. just surprised it worked. | 15:32 |
| mnaser | because apache != glance/eventlet :) | 15:33 |
| shewless | mnaser: okay fair enough | 15:33 |
| shewless | I'm further along now but I'm receiving a 500 error now. I see this line and I wonder if haproxy doesn't know what to do with this "relative" path? "GET /v1/images/detail HTTP/1.1" 500 228 | 15:34 |
| s3an2 | shewless, haproxy will just forward that request on to the backend - Check the glance-api logs you should have a trace for that 500 | 15:47 |
| shewless | s3an2: thanks.. figured out the cause.. not sure the best way to solve it though | 15:51 |
| shewless | in glance-api.conf: registry_host = 127.0.0.1 | 15:51 |
| shewless | this works.. but if registry_host is set to my "glance endpoint IP address" | 15:51 |
| shewless | it doesn't work | 15:51 |
| shewless | I think it's probably because it's not coming in as https | 15:52 |
| shewless | I'm not sure if care... should I make the registry SSL? can I? how to? | 15:52 |
| yankcrime | shewless: looks like you have already from the config you pasted earlier, i.e what you've defined for frontend ft_glance_registry | 15:53 |
| *** crenguta has quit IRC | 15:54 | |
| shewless | yankcrime: it's not working. I think it assumes I'm coming in as https.. but whatever is hitting the glance-registry isn't https | 15:54 |
| yankcrime | shewless: you probably need to set registry_client_protocol | 15:55 |
| shewless | yankcrime: beauty! thanks!! | 15:55 |
| shewless | I wonder what other random goodies I'll hit like that | 15:55 |
| yankcrime | there's no end to openstack's "random goodies" | 15:56 |
| shewless | :D | 15:56 |
| shewless | huzzah.. glance works behind my ssl proxy (registry and all) | 15:57 |
| shewless | you guys rock | 15:57 |
| shewless | now for nova, neutron, heat! :S | 15:57 |
| yankcrime | onto the easy stuff then! ;) | 15:59 |
| *** VW_ has joined #openstack-operators | 16:01 | |
| *** vijaykc4 has quit IRC | 16:01 | |
| *** VW_ has quit IRC | 16:02 | |
| *** VW_ has joined #openstack-operators | 16:03 | |
| *** marst has joined #openstack-operators | 16:03 | |
| *** pcaruana has quit IRC | 16:03 | |
| *** VW_ has quit IRC | 16:03 | |
| *** VW has quit IRC | 16:04 | |
| *** VW has joined #openstack-operators | 16:04 | |
| *** armax has joined #openstack-operators | 16:14 | |
| *** hieulq_ has joined #openstack-operators | 16:15 | |
| *** sdake_ has quit IRC | 16:15 | |
| *** sdake has joined #openstack-operators | 16:16 | |
| *** sdake has quit IRC | 16:16 | |
| *** vijaykc4 has joined #openstack-operators | 16:16 | |
| *** sdake has joined #openstack-operators | 16:16 | |
| *** Oku_OS is now known as Oku_OS-away | 16:18 | |
| *** simon-AS559 has quit IRC | 16:19 | |
| *** zioproto has quit IRC | 16:23 | |
| *** Apoorva has joined #openstack-operators | 16:30 | |
| *** vijaykc4 has quit IRC | 16:31 | |
| *** sudipto has joined #openstack-operators | 16:32 | |
| *** sudipto_ has joined #openstack-operators | 16:32 | |
| *** hieulq_ has quit IRC | 16:32 | |
| *** chyka has joined #openstack-operators | 16:33 | |
| *** paramite has joined #openstack-operators | 16:43 | |
| *** Apoorva has quit IRC | 16:48 | |
| *** paramite has quit IRC | 16:50 | |
| *** B_Smith has quit IRC | 16:54 | |
| *** VW has quit IRC | 16:58 | |
| *** VW has joined #openstack-operators | 16:58 | |
| *** _ducttape_ has joined #openstack-operators | 16:59 | |
| *** derekh has quit IRC | 17:00 | |
| *** mriedem is now known as mriedem_afk | 17:00 | |
| *** ducttape_ has quit IRC | 17:02 | |
| *** B_Smith has joined #openstack-operators | 17:03 | |
| *** B_Smith has quit IRC | 17:09 | |
| *** _ducttape_ has quit IRC | 17:35 | |
| *** ducttape_ has joined #openstack-operators | 17:36 | |
| *** Apoorva has joined #openstack-operators | 17:50 | |
| *** B_Smith has joined #openstack-operators | 17:56 | |
| *** B_Smith has quit IRC | 18:01 | |
| *** B_Smith has joined #openstack-operators | 18:07 | |
| *** VW has quit IRC | 18:28 | |
| *** VW has joined #openstack-operators | 18:29 | |
| *** esmiurium has quit IRC | 18:40 | |
| *** sudipto has quit IRC | 18:41 | |
| *** sudipto_ has quit IRC | 18:41 | |
| *** esmiurium has joined #openstack-operators | 18:47 | |
| *** VW has quit IRC | 18:49 | |
| *** TxGirlGeek has quit IRC | 18:50 | |
| *** VW has joined #openstack-operators | 18:56 | |
| *** mriedem_afk is now known as mriedem | 19:00 | |
| *** VW has quit IRC | 19:01 | |
| *** B_Smith has quit IRC | 19:06 | |
| *** jproulx has quit IRC | 19:07 | |
| *** crenguta has joined #openstack-operators | 19:07 | |
| *** VW has joined #openstack-operators | 19:11 | |
| *** VW has quit IRC | 19:15 | |
| *** VW has joined #openstack-operators | 19:29 | |
| *** paramite has joined #openstack-operators | 19:31 | |
| *** tesseract has quit IRC | 19:32 | |
| *** jproulx has joined #openstack-operators | 19:35 | |
| *** chyka has quit IRC | 19:44 | |
| *** chyka has joined #openstack-operators | 19:45 | |
| *** chyka has quit IRC | 19:45 | |
| *** chyka has joined #openstack-operators | 19:45 | |
| *** slaweq_ has joined #openstack-operators | 19:47 | |
| *** sdake has quit IRC | 19:47 | |
| *** catinthe_ has joined #openstack-operators | 19:50 | |
| *** catintheroof has quit IRC | 19:53 | |
| *** TxGirlGeek has joined #openstack-operators | 19:59 | |
| *** TxGirlGeek has quit IRC | 19:59 | |
| *** TxGirlGeek has joined #openstack-operators | 20:00 | |
| *** jamesdenton has joined #openstack-operators | 20:01 | |
| *** jproulx has quit IRC | 20:01 | |
| *** jproulx has joined #openstack-operators | 20:05 | |
| *** TxGirlGeek has quit IRC | 20:06 | |
| *** racedo has quit IRC | 20:09 | |
| *** racedo has joined #openstack-operators | 20:10 | |
| *** crenguta has quit IRC | 20:13 | |
| *** crenguta has joined #openstack-operators | 20:15 | |
| *** esmiurium has quit IRC | 20:15 | |
| *** TxGirlGeek has joined #openstack-operators | 20:20 | |
| *** TxGirlGeek has quit IRC | 20:29 | |
| *** esmiurium has joined #openstack-operators | 20:31 | |
| *** Apoorva has quit IRC | 20:46 | |
| *** slaweq has quit IRC | 20:51 | |
| *** B_Smith has joined #openstack-operators | 20:51 | |
| *** crenguta has quit IRC | 20:51 | |
| *** slaweq_ has quit IRC | 20:51 | |
| *** slaweq_ has joined #openstack-operators | 20:52 | |
| *** slaweq has joined #openstack-operators | 20:53 | |
| *** crenguta has joined #openstack-operators | 20:53 | |
| *** B_Smith has quit IRC | 20:56 | |
| *** bsilverman_5 has quit IRC | 20:58 | |
| *** bsilverman_ has joined #openstack-operators | 20:58 | |
| *** dminer has joined #openstack-operators | 21:01 | |
| *** catinthe_ has quit IRC | 21:02 | |
| *** catintheroof has joined #openstack-operators | 21:03 | |
| *** crenguta has quit IRC | 21:03 | |
| *** crenguta has joined #openstack-operators | 21:05 | |
| *** catintheroof has quit IRC | 21:07 | |
| *** crenguta has quit IRC | 21:13 | |
| *** crenguta has joined #openstack-operators | 21:14 | |
| *** B_Smith has joined #openstack-operators | 21:23 | |
| *** Apoorva has joined #openstack-operators | 21:24 | |
| *** B_Smith has quit IRC | 21:27 | |
| *** B_Smith has joined #openstack-operators | 21:33 | |
| *** TxGirlGeek has joined #openstack-operators | 21:37 | |
| *** dminer has quit IRC | 21:38 | |
| *** crenguta has quit IRC | 21:45 | |
| *** klindgren_ has joined #openstack-operators | 21:46 | |
| *** _ducttape_ has joined #openstack-operators | 21:48 | |
| *** klindgren has quit IRC | 21:49 | |
| *** _ducttape_ has quit IRC | 21:49 | |
| *** dminer has joined #openstack-operators | 21:49 | |
| *** _ducttape_ has joined #openstack-operators | 21:50 | |
| *** ducttape_ has quit IRC | 21:51 | |
| *** dminer has quit IRC | 22:01 | |
| *** sdake has joined #openstack-operators | 22:03 | |
| *** B_Smith has quit IRC | 22:10 | |
| *** paramite has quit IRC | 22:12 | |
| *** dminer has joined #openstack-operators | 22:19 | |
| *** slaweq has quit IRC | 22:22 | |
| *** slaweq_ has quit IRC | 22:23 | |
| *** armax has quit IRC | 22:26 | |
| *** dminer has quit IRC | 22:27 | |
| *** dminer has joined #openstack-operators | 22:27 | |
| *** mistur has quit IRC | 22:34 | |
| *** jamesdenton has quit IRC | 22:35 | |
| *** VW_ has joined #openstack-operators | 22:39 | |
| *** mriedem has quit IRC | 22:39 | |
| *** VW has quit IRC | 22:42 | |
| *** armax has joined #openstack-operators | 22:42 | |
| *** VW_ has quit IRC | 22:43 | |
| *** mistur has joined #openstack-operators | 22:51 | |
| *** masber has quit IRC | 22:59 | |
| *** masber has joined #openstack-operators | 23:00 | |
| *** VW has joined #openstack-operators | 23:18 | |
| *** _ducttape_ has quit IRC | 23:22 | |
| *** VW has quit IRC | 23:24 | |
| *** TxGirlGeek has quit IRC | 23:27 | |
| *** armax has quit IRC | 23:41 | |
| *** dminer has quit IRC | 23:51 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!