*** esikachev has joined #openstack-sahara | 00:04 | |
*** esikachev has quit IRC | 00:09 | |
*** ssmith has joined #openstack-sahara | 00:10 | |
*** esikachev has joined #openstack-sahara | 01:05 | |
*** jamielennox has quit IRC | 01:08 | |
*** esikachev has quit IRC | 01:09 | |
*** jamielennox has joined #openstack-sahara | 01:15 | |
*** shuyingya has joined #openstack-sahara | 01:20 | |
*** shuyingya has quit IRC | 01:28 | |
*** shuyingy_ has joined #openstack-sahara | 01:28 | |
*** ssmith has quit IRC | 01:37 | |
*** esikachev has joined #openstack-sahara | 02:05 | |
*** esikachev has quit IRC | 02:10 | |
*** jamielennox has quit IRC | 02:17 | |
*** jamielennox has joined #openstack-sahara | 02:24 | |
*** ukaynar has quit IRC | 02:52 | |
*** ukaynar has joined #openstack-sahara | 02:53 | |
*** esikachev has joined #openstack-sahara | 03:06 | |
*** esikachev has quit IRC | 03:11 | |
*** tuanluong has joined #openstack-sahara | 03:51 | |
*** esikachev has joined #openstack-sahara | 04:07 | |
*** esikachev has quit IRC | 04:12 | |
*** hoonetorg has joined #openstack-sahara | 04:26 | |
*** links has joined #openstack-sahara | 04:33 | |
*** esikachev has joined #openstack-sahara | 05:08 | |
*** esikachev has quit IRC | 05:39 | |
*** ukaynar has quit IRC | 05:49 | |
*** ukaynar has joined #openstack-sahara | 05:50 | |
*** ukaynar has quit IRC | 05:54 | |
*** esikachev has joined #openstack-sahara | 06:03 | |
*** esikachev has quit IRC | 06:14 | |
*** anshul has joined #openstack-sahara | 06:14 | |
*** anshul has quit IRC | 06:19 | |
*** esikachev has joined #openstack-sahara | 07:02 | |
*** rcernin has joined #openstack-sahara | 07:13 | |
*** zemuvier has joined #openstack-sahara | 07:33 | |
*** esikachev has quit IRC | 09:02 | |
*** esikachev has joined #openstack-sahara | 09:06 | |
*** esikachev has quit IRC | 09:27 | |
*** masber has quit IRC | 09:55 | |
*** ukaynar has joined #openstack-sahara | 11:17 | |
*** ukaynar has quit IRC | 11:28 | |
*** tuanluong has quit IRC | 11:47 | |
openstackgerrit | Merged openstack/sahara-image-elements master: Configurable Spark version for Vanilla image https://review.openstack.org/484463 | 12:06 |
---|---|---|
*** esikachev has joined #openstack-sahara | 12:13 | |
*** shuyingy_ has quit IRC | 12:44 | |
*** shuyingya has joined #openstack-sahara | 12:44 | |
*** shuyingya has quit IRC | 12:44 | |
*** shuyingya has joined #openstack-sahara | 12:45 | |
*** shuyingya has quit IRC | 12:49 | |
*** links has quit IRC | 12:52 | |
*** jeremyfreudberg has joined #openstack-sahara | 13:01 | |
*** lucasxu has joined #openstack-sahara | 13:03 | |
*** shuyingya has joined #openstack-sahara | 13:08 | |
*** shuyingya has quit IRC | 13:12 | |
*** shuyingya has joined #openstack-sahara | 13:22 | |
jeremyfreudberg | hey tellesnobrega | 13:23 |
jeremyfreudberg | regarding cdh 5.11 | 13:23 |
*** shuyingy_ has joined #openstack-sahara | 13:23 | |
tellesnobrega | jeremyfreudberg, whats up? | 13:24 |
jeremyfreudberg | yeah, so i'm working on getting those json default configs for cdh5.11, I think you saw yingya's instruction about how to find them | 13:24 |
jeremyfreudberg | but | 13:24 |
tellesnobrega | yes | 13:25 |
jeremyfreudberg | it isn't quite working right still, so i was thinking we could use the cdh 5.10 configs, and open a bug saying "figure out the 5.11 stuff soon" | 13:25 |
jeremyfreudberg | as to get around the feature freeze | 13:25 |
tellesnobrega | can you make sure it properly works? | 13:26 |
jeremyfreudberg | yeah, i'll see if the new version works well enough with the old configs | 13:26 |
*** shuyingya has quit IRC | 13:26 | |
tellesnobrega | cool, let me know | 13:32 |
jeremyfreudberg | yep | 13:32 |
jeremyfreudberg | tellesnobrega: also, if there is a meeting today, I can't stay the whole time | 13:33 |
tellesnobrega | jeremyfreudberg, evgeny won't be able to be at the meeting today and tosky. Do you have important topics to be discussed at the meeting? | 13:33 |
jeremyfreudberg | tellesnobrega: see above, let's skip the meeting | 13:33 |
tellesnobrega | ok, I will cancel the meeting, doesn't make sense to be there by myself :) | 13:33 |
jeremyfreudberg | yep | 13:33 |
*** zemuvier has quit IRC | 13:38 | |
*** ssmith has joined #openstack-sahara | 13:50 | |
*** cpusmith has joined #openstack-sahara | 13:51 | |
*** ssmith has quit IRC | 13:55 | |
*** shuyingya has joined #openstack-sahara | 14:00 | |
*** shuyingy_ has quit IRC | 14:00 | |
*** shuyingy_ has joined #openstack-sahara | 14:02 | |
*** shuyingya has quit IRC | 14:04 | |
*** esikachev has quit IRC | 14:27 | |
*** lucasxu has quit IRC | 14:30 | |
*** lucasxu has joined #openstack-sahara | 14:32 | |
*** brad[] has quit IRC | 14:33 | |
*** jeremyfreudberg has quit IRC | 14:33 | |
*** brad[] has joined #openstack-sahara | 14:34 | |
*** lucasxu has quit IRC | 14:59 | |
*** lucasxu has joined #openstack-sahara | 15:02 | |
*** rcernin has quit IRC | 15:03 | |
*** links has joined #openstack-sahara | 15:04 | |
*** links has quit IRC | 15:07 | |
*** jeremyfreudberg has joined #openstack-sahara | 16:02 | |
*** lucasxu has quit IRC | 16:06 | |
*** jeremyfreudberg has quit IRC | 16:08 | |
*** shuyingy_ has quit IRC | 16:15 | |
*** jeremyfreudberg has joined #openstack-sahara | 16:49 | |
*** rcernin has joined #openstack-sahara | 17:16 | |
*** tellesnobrega has quit IRC | 17:22 | |
*** esikachev has joined #openstack-sahara | 17:23 | |
*** esikachev has quit IRC | 17:27 | |
tomtomtom | hello, anyone got any ideas about the following situation. I have a flavor for ephemeral storage, boot an instance with that flavor and ephemeral disk only. When the instance comes up it says "not a bootable disk", then I dumpxml from virsh on the compute node and see two disks attached (there is only supposed to be one). | 17:46 |
tomtomtom | one disk is vda @ 2.7GB which isn't supposed to be there and second is my ephermal disk @ 10GB. | 17:47 |
tomtomtom | Why would nova or libvirt attach the 2.7GB disk? In ceph rbd both disks are there however this error message is supplied by nova-compute.log: 2017-07-27 16:38:36.643 21452 WARNING nova.virt.libvirt.driver [req-63366dcb-743e-47ff-b55a-997a6bba48ca b1391381280b4279a80cd5af3165e7ec 765e45ff3feb4a21b561ac6e3e06fda8 - - -] [instance: ade5d677-9ecc-43ff-89de-e6f46eb61112] Ignoring supplied device name: /dev/vdb. Libvirt can't ho | 17:48 |
jeremyfreudberg | hi tomtomtom, is the disk of your flavor defined as root disk or ephemeral disk? | 17:48 |
tomtomtom | Could that be why it's not a bootable disk? | 17:48 |
tomtomtom | it's defined as ephemeral | 17:48 |
jeremyfreudberg | i'm not quite sure, but i know that in my deployment, sahara's idea of "ephemeral storage" corresponds to root disk on the actual flavor | 17:49 |
tomtomtom | http://imgur.com/a/FBydD that's the output I get. | 17:50 |
jeremyfreudberg | tomtomtom, looking now | 17:51 |
tomtomtom | no matter how I create the flavor I get "disk 0" which I think is ok as far as I know. | 17:52 |
jeremyfreudberg | tomtomtom, this is a flavor from my sahara: http://paste.openstack.org/raw/616767/ | 17:53 |
jeremyfreudberg | i think the disk 0 is your problem | 17:53 |
jeremyfreudberg | but i could be wrong, things could be different depending on how storage backend is deployed | 17:53 |
jeremyfreudberg | really not my forte, unfortunately | 17:53 |
tomtomtom | ok, I thought I had to use ephemeral for sahara and that disk X would mean a non-ephemeral disk? no? | 17:54 |
jeremyfreudberg | so that's what i am confused about too | 17:54 |
jeremyfreudberg | in my experience, what sahara calls ephemeral really just means "not a volume", i.e. root disk of flavor | 17:54 |
jeremyfreudberg | by the way, is this the same cloud ssmith was talking about and asking similar questions with yesterday? | 17:55 |
*** esikachev has joined #openstack-sahara | 17:55 | |
tomtomtom | yes | 17:59 |
jeremyfreudberg | cool, so it is ceph then | 17:59 |
*** esikachev has quit IRC | 18:00 | |
jeremyfreudberg | tomtomtom, so I guess try with root disk instead, if you haven't already | 18:01 |
tomtomtom | yeah and ceph appears to be working ok, "ephemeral" volumes get created in rbd, but nova can't boot them, I remember (as posted above) the issue with vdb assignment being an issue, but I can't see why this is happening, nova is booting the instance with the rbd driver correctly, and the only issue I could see is that the vm doesn't like to boot from /dev/vdb | 18:01 |
*** tellesnobrega has joined #openstack-sahara | 18:10 | |
tellesnobrega | jeremyfreudberg, ping | 18:10 |
jeremyfreudberg | hey tellesnobrega, was about to ping you too | 18:11 |
tellesnobrega | mine is faster :) | 18:11 |
jeremyfreudberg | lol | 18:11 |
jeremyfreudberg | give your news first | 18:11 |
tellesnobrega | just approved my patch on the default templates | 18:11 |
jeremyfreudberg | yes | 18:11 |
tellesnobrega | waited for some people to look at it | 18:11 |
tellesnobrega | nobody did, I got your +1 | 18:11 |
tellesnobrega | so I approved it | 18:11 |
tellesnobrega | that is it | 18:11 |
jeremyfreudberg | yep | 18:12 |
tellesnobrega | just making sure someone else agreed there | 18:12 |
tellesnobrega | your turn now | 18:12 |
jeremyfreudberg | yes, i will give my news | 18:12 |
jeremyfreudberg | so, 3 things | 18:12 |
jeremyfreudberg | all mostly related | 18:12 |
*** esikachev has joined #openstack-sahara | 18:13 | |
jeremyfreudberg | one is cdh 5.11 | 18:13 |
tellesnobrega | good news? | 18:13 |
jeremyfreudberg | meh, i'm closer than before to getting those json files for 5.11 | 18:13 |
jeremyfreudberg | but still stuck | 18:13 |
jeremyfreudberg | so i am going to fall back on the 5.9 jsons for now | 18:14 |
jeremyfreudberg | they should work afaik, and i will be doing some testing soon | 18:14 |
jeremyfreudberg | the other thing is that i still have another patch coming for s3 on SIE | 18:15 |
*** shuyingya has joined #openstack-sahara | 18:15 | |
openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara-dashboard master: Test commit do not merge https://review.openstack.org/487968 | 18:15 |
jeremyfreudberg | oh, funny, i thought django version could have been the issue too | 18:16 |
jeremyfreudberg | regarding your patch | 18:16 |
tellesnobrega | yeah, seems like the most probably cause | 18:16 |
tellesnobrega | about the S3 patch, how big is it? | 18:17 |
jeremyfreudberg | not that big, | 18:17 |
jeremyfreudberg | it's just SIE | 18:17 |
jeremyfreudberg | that's all i can fit into pike, sadly | 18:17 |
tellesnobrega | no worries | 18:17 |
jeremyfreudberg | yeah, anyway, my point is, what time are you tagging pike-3 | 18:18 |
tellesnobrega | is this a topic worth discussing at the PTG? or you have most of it down? | 18:18 |
jeremyfreudberg | we can spend a little time at ptg | 18:18 |
jeremyfreudberg | but for the most part i know what i need to do | 18:18 |
tellesnobrega | pike-3 should be at most tomorrow by EOD | 18:18 |
jeremyfreudberg | cool | 18:19 |
tellesnobrega | if you feel like we could benefit from talking about it add to the etherpad | 18:19 |
*** esikachev has quit IRC | 18:19 | |
jeremyfreudberg | there is a tiny mention of it already | 18:19 |
tellesnobrega | awesome | 18:19 |
tellesnobrega | that should be fine | 18:19 |
*** shuyingya has quit IRC | 18:20 | |
tellesnobrega | I will wait for you patch, so we can try to merge it before EOD tomorrow | 18:20 |
jeremyfreudberg | i'm trying to get everything out today | 18:20 |
jeremyfreudberg | we will see | 18:20 |
tellesnobrega | and include it in pike-3 | 18:20 |
tellesnobrega | awesome | 18:20 |
jeremyfreudberg | and your plan for python-saharaclient release? I think that one is force release tomorrow whether we want to or not | 18:20 |
jeremyfreudberg | if i understand the mailing list email | 18:20 |
jeremyfreudberg | sorry, let me rephrase that | 18:24 |
jeremyfreudberg | about the open patches that we do have on python-saharaclient | 18:25 |
jeremyfreudberg | will any of them be merged for release, or no | 18:25 |
tellesnobrega | you mean iwonka's patches? | 18:27 |
jeremyfreudberg | basically, yes | 18:27 |
*** esikachev has joined #openstack-sahara | 18:28 | |
tellesnobrega | I would like to | 18:29 |
tellesnobrega | can you review them? | 18:29 |
tellesnobrega | so I don't approve it alone | 18:29 |
jeremyfreudberg | i can review them | 18:29 |
jeremyfreudberg | i just don't want to have mismatched release | 18:29 |
jeremyfreudberg | since final release of saharaclient for pike is tomorrow | 18:30 |
jeremyfreudberg | but there is one more month for sahara itself | 18:30 |
*** esikachev has quit IRC | 18:36 | |
tellesnobrega | oh, I see what you mean | 18:36 |
tellesnobrega | that makes sense, we can wait to have them merged after the cut | 18:37 |
tellesnobrega | so it releases next cycle | 18:37 |
jeremyfreudberg | well we could merge some things before the cut | 18:37 |
jeremyfreudberg | we just have to be consistent | 18:38 |
jeremyfreudberg | now that i'm thinking about it, it's not as big of a deal as i made it sound | 18:39 |
tellesnobrega | it doesn't make sense to provide a functionality on the client that don't have an answer from the server | 18:39 |
jeremyfreudberg | that's basically what i mean | 18:40 |
tellesnobrega | we could merge but we would have to hide it | 18:40 |
jeremyfreudberg | i was also thinking the other way, on api side we shouldn't merge export cluster template unless the cli had import cluster template | 18:40 |
*** tellesnobrega has quit IRC | 18:44 | |
*** tellesnobrega has joined #openstack-sahara | 18:57 | |
*** cpusmith_ has joined #openstack-sahara | 19:02 | |
openstackgerrit | Merged openstack/sahara master: Updating default templates https://review.openstack.org/484028 | 19:05 |
*** cpusmith has quit IRC | 19:06 | |
*** cpusmith_ has quit IRC | 19:19 | |
*** cpusmith_ has joined #openstack-sahara | 19:19 | |
*** cpusmith has joined #openstack-sahara | 19:20 | |
jeremyfreudberg | tellesnobrega: i think i did actually manage to get the cdh 5.11 json after all | 19:20 |
tellesnobrega | jeremyfreudberg, awesome | 19:21 |
jeremyfreudberg | we really need to change and document the way it's done | 19:21 |
jeremyfreudberg | it's really a pain | 19:21 |
jeremyfreudberg | "add it to etherpad" | 19:21 |
*** cpusmith_ has quit IRC | 19:24 | |
tellesnobrega | sounds good :) | 19:31 |
tellesnobrega | jeremyfreudberg, trying to get to the bottom of this error | 19:35 |
tellesnobrega | looks like using django <1.10 helps but it doesn't entirely fix the issue | 19:35 |
tellesnobrega | there is something else going on | 19:36 |
jeremyfreudberg | considering requirements.txt of sahara-dashboard was updated 3 weeks ago | 19:37 |
jeremyfreudberg | i would look in upper-constraints actually | 19:37 |
jeremyfreudberg | so i guess django-compressor | 19:37 |
jeremyfreudberg | since it is not capped in our requirements.txt | 19:37 |
jeremyfreudberg | maybe | 19:38 |
jeremyfreudberg | not django compressor | 19:38 |
jeremyfreudberg | the only thing that we are not capping in our own requirements.txt | 19:39 |
jeremyfreudberg | that got bumped up | 19:39 |
jeremyfreudberg | is django-openstack-auth | 19:39 |
jeremyfreudberg | not sure | 19:40 |
tellesnobrega | upper-constraints from horizon? | 19:41 |
jeremyfreudberg | https://github.com/openstack/requirements/blob/master/upper-constraints.txt | 19:41 |
tellesnobrega | oh, ok | 19:42 |
jeremyfreudberg | in our tox.ini we reference that upper constraints file as well as our own requirements.txt | 19:42 |
jeremyfreudberg | requirements.txt has been relatively stable for us, and all of our patches are failing, not just requirements one | 19:42 |
jeremyfreudberg | so i was thinking it's upper constraints messing us up | 19:42 |
jeremyfreudberg | but i'm really not sure | 19:42 |
tellesnobrega | could be | 19:47 |
tellesnobrega | looking it it | 19:47 |
tellesnobrega | this error showed up like what? 2 days or 3 days agow | 19:47 |
tellesnobrega | ? | 19:47 |
jeremyfreudberg | some time around july 24 i think, yeah | 19:48 |
jeremyfreudberg | i don't remember exactly | 19:48 |
jeremyfreudberg | not that long ago at all | 19:48 |
jeremyfreudberg | let me try a patch which has django-openstack-auth set to old version | 19:50 |
jeremyfreudberg | just for sanity | 19:50 |
tellesnobrega | thanks | 19:50 |
openstackgerrit | Jeremy Freudberg proposed openstack/sahara-dashboard master: Test commit do not merge https://review.openstack.org/487968 | 19:50 |
jeremyfreudberg | just stealing your commit | 19:50 |
tellesnobrega | no worries | 19:51 |
tellesnobrega | you can actually see that locally | 19:51 |
jeremyfreudberg | oh right | 19:51 |
tellesnobrega | i'm running the tests here and seeing the same issu | 19:51 |
tellesnobrega | issue | 19:51 |
tellesnobrega | it is just faster :) | 19:51 |
jeremyfreudberg | i'll keep an eye on it on zuul | 19:52 |
jeremyfreudberg | but yeah | 19:52 |
jeremyfreudberg | we don't actually need to push it to gerrit to find out | 19:52 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-saharaclient master: Updated from global requirements https://review.openstack.org/488127 | 19:57 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara master: Updated from global requirements https://review.openstack.org/488136 | 19:58 |
tellesnobrega | jeremyfreudberg, how do I run tests to get pdb working? ostestr right? | 20:06 |
jeremyfreudberg | python -m testtools.run <modulename> | 20:06 |
jeremyfreudberg | depending on how it's installed (and what directory your run from) usually modulename is sahara.tests.unit.blah or tests.unit.blah | 20:07 |
tellesnobrega | i see, it doesn't run on the tox env, so I have to have all dependencies locally installed for that | 20:08 |
tellesnobrega | right? | 20:09 |
jeremyfreudberg | that's correct | 20:09 |
jeremyfreudberg | but | 20:09 |
jeremyfreudberg | you could also edit your tox.ini, maybe? | 20:09 |
tellesnobrega | true | 20:09 |
tellesnobrega | I will try that later | 20:09 |
jeremyfreudberg | basically changing this line: https://github.com/openstack/sahara/blob/master/tox.ini#L15 | 20:09 |
jeremyfreudberg | to use testtools.run | 20:10 |
tellesnobrega | makes total sense | 20:10 |
tellesnobrega | I will try that later | 20:10 |
jeremyfreudberg | cool | 20:10 |
tellesnobrega | looks like it is solving part of the problem again | 20:10 |
jeremyfreudberg | i am pushing cdh patch very soon, btw | 20:10 |
tellesnobrega | setting the django-auth | 20:10 |
tellesnobrega | great, thanks | 20:10 |
tellesnobrega | but there is one test fail | 20:11 |
jeremyfreudberg | oh, hmm | 20:11 |
tellesnobrega | sahara_dashboard/content/data_processing/clusters/clusters/tests.py | 20:12 |
tellesnobrega | sahara_dashboard.content.data_processing.clusters.clusters.tests.DataProcessingClusterTests test_launch_cluster_get_nodata | 20:13 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-saharaclient master: Updated from global requirements https://review.openstack.org/488127 | 20:15 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara master: Updated from global requirements https://review.openstack.org/488136 | 20:16 |
jeremyfreudberg | tellesnobrega: the bot did not announce my patch, but here it is https://review.openstack.org/#/c/488181 | 20:17 |
jeremyfreudberg | i'm looking at your test now | 20:17 |
tellesnobrega | it saw it :) | 20:17 |
* tellesnobrega looks | 20:17 | |
jeremyfreudberg | it's pretty substantial | 20:18 |
jeremyfreudberg | as usual most of it is just fluff, you can ignore all the jsons and xmls and trust that they are right | 20:18 |
jeremyfreudberg | remind me to deprecate 5.7 once we know that 5.11 is working | 20:20 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config master: Added basic playbook https://review.openstack.org/488189 | 20:21 |
tellesnobrega | sure | 20:22 |
tellesnobrega | jeremyfreudberg, just two nits inline from what I see | 20:23 |
tellesnobrega | otherwise looks good | 20:23 |
jeremyfreudberg | cool | 20:23 |
tellesnobrega | I have to leave now, but I will look at the new patch later | 20:23 |
jeremyfreudberg | ok cool | 20:23 |
jeremyfreudberg | thanks | 20:23 |
jeremyfreudberg | i don't know how i missed some of those v59s | 20:23 |
tellesnobrega | common on big patches | 20:23 |
tellesnobrega | don't sweat | 20:23 |
jeremyfreudberg | :) | 20:23 |
*** tellesnobrega has quit IRC | 20:29 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-saharaclient master: Updated from global requirements https://review.openstack.org/488127 | 20:33 |
openstackgerrit | Jeremy Freudberg proposed openstack/sahara master: Support of CDH 5.11.0 https://review.openstack.org/488181 | 20:33 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara master: Updated from global requirements https://review.openstack.org/488136 | 20:34 |
openstackgerrit | Jeremy Freudberg proposed openstack/sahara master: Support of CDH 5.11.0 https://review.openstack.org/488181 | 20:35 |
*** jeremyfreudberg has quit IRC | 20:41 | |
*** esikachev has joined #openstack-sahara | 20:43 | |
*** esikachev has quit IRC | 20:47 | |
*** tmckay has quit IRC | 21:16 | |
*** tmckay has joined #openstack-sahara | 21:31 | |
*** iwonka has quit IRC | 21:44 | |
*** tmckay has quit IRC | 21:56 | |
*** tmckay has joined #openstack-sahara | 22:07 | |
*** cpusmith has quit IRC | 22:18 | |
*** esikachev has joined #openstack-sahara | 22:24 | |
*** rcernin has quit IRC | 22:26 | |
*** esikachev has quit IRC | 22:29 | |
*** esikachev has joined #openstack-sahara | 22:36 | |
*** openstack has joined #openstack-sahara | 22:45 | |
*** elmiko has joined #openstack-sahara | 22:47 | |
*** tmckay has quit IRC | 22:48 | |
*** ukaynar has joined #openstack-sahara | 22:50 | |
*** tmckay has joined #openstack-sahara | 23:34 | |
*** esikachev has joined #openstack-sahara | 23:44 | |
*** esikachev has quit IRC | 23:49 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!