*** shakamunyi has joined #openstack-sahara | 00:23 | |
*** zhiyan_ is now known as zhiyan | 00:26 | |
*** shakamunyi has quit IRC | 00:48 | |
*** mojorison has quit IRC | 01:00 | |
*** shakamunyi has joined #openstack-sahara | 01:13 | |
*** IlyaE has quit IRC | 01:19 | |
*** ErikB1 has joined #openstack-sahara | 01:28 | |
*** IlyaE has joined #openstack-sahara | 01:30 | |
*** shakamunyi has quit IRC | 02:57 | |
*** ErikB1 has quit IRC | 03:02 | |
*** ErikB1 has joined #openstack-sahara | 03:07 | |
*** ErikB1 has quit IRC | 03:22 | |
*** IlyaE has quit IRC | 05:04 | |
*** Ch00k has joined #openstack-sahara | 05:07 | |
*** IlyaE has joined #openstack-sahara | 05:39 | |
*** Ch00k has quit IRC | 05:48 | |
*** Ch00k has joined #openstack-sahara | 05:49 | |
*** IlyaE has quit IRC | 05:53 | |
*** bogdando has quit IRC | 05:59 | |
*** bogdando has joined #openstack-sahara | 06:00 | |
*** IlyaE has joined #openstack-sahara | 06:13 | |
*** Ch00k has quit IRC | 06:16 | |
*** akuznets_ has quit IRC | 06:24 | |
*** akuznetsov has joined #openstack-sahara | 06:26 | |
*** skolekonov has joined #openstack-sahara | 06:35 | |
*** akuznets_ has joined #openstack-sahara | 06:48 | |
*** akuznetsov has quit IRC | 06:48 | |
openstackgerrit | Daniele Venzano proposed a change to openstack/sahara-image-elements: Update Spark element https://review.openstack.org/91340 | 06:52 |
---|---|---|
*** RockKuo_Office has joined #openstack-sahara | 07:26 | |
*** Ch00k has joined #openstack-sahara | 07:28 | |
*** IlyaE has quit IRC | 07:35 | |
*** IlyaE has joined #openstack-sahara | 07:35 | |
*** IlyaE has quit IRC | 07:38 | |
*** IlyaE has joined #openstack-sahara | 07:43 | |
*** openstackgerrit has quit IRC | 07:53 | |
*** Ch00k has quit IRC | 08:07 | |
*** Ch00k has joined #openstack-sahara | 08:07 | |
*** IlyaE has quit IRC | 08:13 | |
*** IvanBerezovskiy has joined #openstack-sahara | 09:07 | |
*** IvanBerezovskiy has left #openstack-sahara | 09:17 | |
*** tosky has joined #openstack-sahara | 09:58 | |
*** bogdando has quit IRC | 10:38 | |
*** bogdando has joined #openstack-sahara | 10:51 | |
*** RockKuo_Office has quit IRC | 11:04 | |
*** akuznets_ has quit IRC | 11:13 | |
*** akuznetsov has joined #openstack-sahara | 11:15 | |
*** _crobertsrh has quit IRC | 11:28 | |
*** IvanBerezovskiy has joined #openstack-sahara | 11:36 | |
*** crobertsrh has joined #openstack-sahara | 11:46 | |
*** Ch00k has quit IRC | 12:22 | |
*** Ch00k has joined #openstack-sahara | 12:22 | |
*** crobertsrh has quit IRC | 12:34 | |
*** sballe has joined #openstack-sahara | 12:36 | |
*** Ch00k has quit IRC | 12:37 | |
*** crobertsrh has joined #openstack-sahara | 12:39 | |
*** _mattf is now known as mattf | 12:51 | |
*** mattf has quit IRC | 12:51 | |
*** mattf has joined #openstack-sahara | 12:51 | |
*** elmiko has joined #openstack-sahara | 12:53 | |
*** Ch00k has joined #openstack-sahara | 13:02 | |
*** ErikB1 has joined #openstack-sahara | 13:08 | |
*** openstackgerrit has joined #openstack-sahara | 13:36 | |
*** openstackgerrit has quit IRC | 13:51 | |
*** tmckay has joined #openstack-sahara | 13:51 | |
*** Ch00k has quit IRC | 14:17 | |
*** Ch00k has joined #openstack-sahara | 14:19 | |
*** bradd1 has joined #openstack-sahara | 14:25 | |
*** skolekonov has quit IRC | 14:51 | |
*** IlyaE has joined #openstack-sahara | 15:01 | |
*** ErikB1 has quit IRC | 15:03 | |
*** ErikB1 has joined #openstack-sahara | 15:10 | |
*** zhiyan is now known as zhiyan_ | 15:25 | |
*** openstackgerrit has joined #openstack-sahara | 15:42 | |
*** mattf is now known as _mattf | 15:48 | |
*** Ch00k has quit IRC | 15:50 | |
*** IlyaE has quit IRC | 15:50 | |
*** Ch00k has joined #openstack-sahara | 15:54 | |
*** IlyaE has joined #openstack-sahara | 15:56 | |
*** Ch00k has quit IRC | 16:15 | |
*** _mattf is now known as mattf | 16:27 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: Extended plugin SPI with methods to communicate with EDP https://review.openstack.org/73729 | 16:32 |
*** IlyaE has quit IRC | 16:59 | |
*** IlyaE has joined #openstack-sahara | 17:01 | |
*** ylobankov_ has joined #openstack-sahara | 17:20 | |
*** openstackgerrit has quit IRC | 17:20 | |
*** ylobankov has quit IRC | 17:21 | |
*** openstackgerrit has joined #openstack-sahara | 17:24 | |
*** ErikB1 has quit IRC | 17:25 | |
*** ErikB1 has joined #openstack-sahara | 17:25 | |
tmckay | has anyone been thinking about how to use trusts with swift from Hadoop? We have a problem currently with swift credentials exposed in workflows. If I understand trusts correctly, however, the hadoop user on a cluster would need it's own keystone authentication in order to have a user id that could be matched to a trustee id for swift access (and of course the hadoop credentials would have to be guarded) | 17:28 |
tmckay | I am also wondering if trust tokens would give us a way to encode the endpoint with the token, so that we don't need ".sahara" in the data source swift url | 17:30 |
tmckay | dmitryme, do you have knowledge of this stuff? ^^ | 17:31 |
tmckay | aignatov, maybe you? ^^ Looking for Summit design fodder, and also usability improvements (tellesnobrega gave us a good run through last week from someone relatively new, and there were some pitfalls) | 17:35 |
aignatov | tmckay: not sure that trusts could solve “.sahara” problem | 17:50 |
tmckay | darn. Why not? | 17:50 |
aignatov | because that’s separate things as I understand | 17:50 |
aignatov | ah, sorry | 17:51 |
aignatov | didn’t observe your idea completely | 17:51 |
dmitryme | tmckay: I pretty sure trusts will not remove need for .sahara prefix. The endpoint is not encoded in trust in any way, as far as I know | 17:52 |
aignatov | but to solve this we could just hide ‘.sahara’ postfix in the urls | 17:52 |
aignatov | and append it only in sahara internaly | 17:52 |
tmckay | aignatov, dmitryme, what about "phase 2" with arbitrary attributes in a token? https://wiki.openstack.org/wiki/Keystone/Trusts | 17:53 |
dmitryme | tmckay: sorry, need to go, will come back later | 17:53 |
tmckay | aignatov, dimitryme, "but to solve this we could just hide ‘.sahara’ postfix in the urls", exactly, I did that this morning :) But, Java actions are the exception :( | 17:53 |
tmckay | aignatov, Java actions do not use data sources. They take only args. If you pass a swift url as an arg to a Java action, you have to "fix" it yourself | 17:54 |
tmckay | I don't like the "specialness" of that. | 17:54 |
SergeyLukjanov | tmckay, hey | 17:55 |
aignatov | tmckay: I see, yep, that’s a problem and point to discuss at the Summit :) | 17:55 |
tmckay | aigntov, the only other idea I had was to add <property>fs.swift.service</property> to the job config and have the service key specified there, instead of extracted from the url | 17:55 |
* SergeyLukjanov not sure that we could solve swift suffix issue | 17:55 | |
tmckay | aignatov, SergeyLukjanov, tellesnobrega was bitten by the suffix issue on Thurs/Friday, which is why I added the validation checks | 17:56 |
tmckay | I would love to see it disappear :) I suppose it's possible to add a warning to scan Java action args, and if we see a swift:// url we could at least generate a warning about it. Or, even make a configurable setting that applies the validation check to Java args that are swift urls, and generate an error | 17:58 |
tmckay | (default to True, because you are probably wrong) | 17:58 |
tmckay | Maybe I can add that to my CR and throw up as a draft | 17:58 |
tmckay | aignatov, ping re Summit, just want to confirm that we want to use bigpetstore for the demo. Only a few days left :) Agreed? If we have other examples we can link to them from a slide. | 18:00 |
aignatov | tmckay: agreed, +2, I’ve starting preparing our presentation sectin for EDP | 18:00 |
tmckay | great. | 18:01 |
aignatov | will share once I’ll get some | 18:01 |
aignatov | :) | 18:01 |
tmckay | aignatov, great, thank you | 18:03 |
aignatov | tmckay: we have an example, I’ve shared this pig scripts with you last week | 18:04 |
aignatov | but I’m afraid that data preparation will take too long | 18:04 |
tmckay | aignatov, ah right, my gmail account! I will have to look. | 18:05 |
tmckay | aignatov, I think we we leave attendees with a link to another example, that's okay. We can commit it to sahara-extra before Summit | 18:05 |
aignatov | yes, I think so | 18:10 |
*** IlyaE has quit IRC | 18:12 | |
*** IlyaE has joined #openstack-sahara | 18:14 | |
tmckay | crobertsrh, do you have any facility in the UI for printing a note on success? | 18:25 |
tmckay | crobertsrh, so when there are errors there is a red box, and when something works there is a green box, but can I control what's in the green box? | 18:25 |
* tmckay hasn't looked closely | 18:25 | |
*** IlyaE has quit IRC | 18:32 | |
crobertsrh | Yeah, you can do notes on success | 18:40 |
crobertsrh | green box is up for whatever you want it to do | 18:40 |
crobertsrh | sorry for the lag, tmckay | 18:41 |
*** IlyaE has joined #openstack-sahara | 18:41 | |
*** bogdando has quit IRC | 18:41 | |
tmckay | crobertsrh, that is wicked cool. I am mucking with Java args if they are swift://, I think I am obligated to say so :) | 18:42 |
crobertsrh | If the response from the api gives a hint, the UI should be able to tell the user that you did what was best for them. | 18:44 |
openstackgerrit | A change was merged to stackforge/sahara-ci-config: Change sahara-api to sahara-all https://review.openstack.org/92139 | 18:44 |
tmckay | ok, I'll give it a try. Icing on the cake | 18:44 |
openstackgerrit | Chad Roberts proposed a change to stackforge/puppet-sahara: Updating the puppet module to reference Sahara https://review.openstack.org/92111 | 18:46 |
openstackgerrit | Chad Roberts proposed a change to stackforge/puppet-sahara: Updating the puppet module to reference Sahara https://review.openstack.org/92111 | 18:50 |
*** IlyaE has quit IRC | 18:52 | |
*** IlyaE has joined #openstack-sahara | 18:55 | |
*** tosky has quit IRC | 18:59 | |
dmitryme | tmckay: review what you guys were talking about here. Indeed seems like there is no simple solution to remove .sahara prefix | 19:00 |
dmitryme | as for Hadoop user in keystone to hold trust, right, it is needed | 19:01 |
dmitryme | Heat had similar problems and they solved that by creating a users per stack (as far as I understand) in a special ‘service’ domain | 19:02 |
mattf | that's kinda scary | 19:02 |
mattf | is that something that the keystone folks endorse? | 19:03 |
tmckay | dmitryme, I am working on fixing up all the swift:// paths in jobs, even Java actions. At least we can make it transparent, that is an improvement I think. | 19:15 |
dmitryme | mattf: frankly, I don’t know | 19:15 |
dmitryme | tmckay: could you clarify what do you mean by ’transparent’? | 19:16 |
mattf | dmitryme, outlook hazy (http://en.wikipedia.org/wiki/Magic_8-Ball) | 19:16 |
dmitryme | mattf: I don’t think it is that bad, we just need to take a look on discussions around that stuff in Heat. Possibly ask Heat folks on summit | 19:19 |
tmckay | dmitryme, maybe bad word choice. I want users to be able to use "swift://container/object" for input/output paths in all places, same for data sources as for job binaries | 19:19 |
tmckay | sahara will insert ".sahara" suffix if it's not there | 19:20 |
tmckay | I've got it working in every case but one (explicit user args to Pig jobs, edge case_ | 19:20 |
tmckay | dmitryme, one of our friends was troubled by this last week, and I want to be more user friendly | 19:21 |
dmitryme | tmckay: yea, I see. Such approach still leaves an issue: these edge cases will cause the same troubles | 19:23 |
mattf | kinda begs the question, if all swift urls coming in are effectively .sahara, why do we need .sahara at all? | 19:23 |
mattf | swift plugin using a ".sahara" persona seems more like a matter of configuration instead of payload metadata | 19:24 |
dmitryme | tmckay: right now I see the only way to avoid trouble: it is to do validation instead of transparency: i.e. if user supplied url without .sahara, show him an error. That will work in those places, where we can add validation (like DataSources) and will serve as education and prepare user to work with functionality without validation (pig script input) | 19:27 |
tmckay | mattf, yes, I've been thinking about that too. dmitryme, what if the hadoop swift implementation read the service_name from the "conf" object instead of parsing it from the swift:// url? It could still be set per job, I think. | 19:27 |
mattf | entering a swift:// could prompt for credentials instead of throwing an error | 19:28 |
tmckay | dmitryme, that is a another option. I added some validation like that last week. | 19:28 |
mattf | which is what tripped my wtf alarm | 19:29 |
tmckay | mattf, the UI at least already requires credentials. The trouble is getting the credentials into the hands of hadoop when it tries to dereference the url and get some data. Here is the original jira https://issues.apache.org/jira/browse/HADOOP-8545 | 19:31 |
tmckay | be back soon | 19:31 |
tmckay | maybe we should kick this around at Summit | 19:32 |
dmitryme | tmckay: getting service name from config sounds like not a bad idea, though I am not sure how easy will it be to persuade Hadoop community | 19:33 |
dmitryme | and we will have to leave support for service name in URL at least for backward compatibility in hadoop-swift driver | 19:33 |
tmckay | dmitryme, yes. I looked at the patch this morning, looked like maybe it was viable, but it does mean diving in to hadoop again | 19:34 |
dmitryme | it has one more advantage: it allows to use different swifts for input and output | 19:34 |
mattf | dmitryme, is that the motivating use case? | 19:35 |
dmitryme | but we since we do not support the later anyway (we use only fixed .sahara suffix), we can do without it just fine | 19:35 |
*** tmckay is now known as tmckay_errand | 19:35 | |
tmckay_errand | I'll read back when I return :) Hot topic. | 19:35 |
*** IlyaE has quit IRC | 19:35 | |
dmitryme | mattf: maybe, I don’t remember discussions which occurred at that time. Besides it was another guy from Mirantis who drove the driver ( :-) ) from our side | 19:36 |
mattf | call me crazy, but since sahara controls the config for the job, it could inject a config w/ a glob. if url == xyz use creds A, if url == prq use creds B | 19:38 |
mattf | but that's kinda ugly | 19:39 |
mattf | the url should actually be swift:/// <- 3 slashes. i think we can use the first field for a tenant | 19:39 |
dmitryme | mattf: but there is a single config for input and output, so you can’t make them pointing to different swifts :-) | 19:40 |
*** crobertsrh has quit IRC | 19:40 | |
* mattf googles around for a good example | 19:41 | |
*** crobertsrh has joined #openstack-sahara | 19:41 | |
mattf | http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/FileSystemShell.html - All FS shell commands take path URIs as arguments. The URI format is scheme://authority/path. For HDFS the scheme is hdfs, and for the Local FS the scheme is file. The scheme and authority are optional. If not specified, the default scheme specified in the configuration is used. An HDFS file or directory such as /parent/child can be specified as hdfs:// | 19:42 |
mattf | namenodehost/parent/child or simply as /parent/child (given that your configuration is set to point to hdfs://namenodehost). | 19:42 |
dmitryme | mattf: there is no need for tenant_id field. It could be get from keystone using the provided token | 19:42 |
mattf | the authority part | 19:42 |
mattf | http://hadoop.apache.org/docs/r2.2.0/api/org/apache/hadoop/fs/FileContext.html too | 19:43 |
mattf | or http://hadoop.apache.org/docs/r2.4.0/api/org/apache/hadoop/fs/FileContext.html | 19:43 |
mattf | imho, that's a better place to stick the ".sahara" | 19:43 |
aignatov | dmitryme: tmckay_errand prabably we could add sahara suffix as General config over the whole cluster like “Swift Enable” and put it even to the UI page, also we could add the possibility to change it and add more suffixes if user’s swift works over external swift | 19:49 |
dmitryme | mattf, aignatov: to late for my timezone, I’d rather review it tomorrow | 19:49 |
openstackgerrit | Robert Nettleton proposed a change to openstack/sahara-image-elements: Fixes image creation script to work on CentOS https://review.openstack.org/92192 | 19:50 |
mattf | dmitryme, nite! | 19:51 |
openstackgerrit | A change was merged to openstack/sahara-image-elements: Update Spark element https://review.openstack.org/91340 | 19:57 |
* mattf feels ill wrt what it takes to run diskimage-create.sh | 20:00 | |
* mattf recommends never running it on a machine you care about | 20:00 | |
elmiko | lol | 20:00 |
elmiko | mattf: are you suggesting i should not have run it on my work laptop? | 20:01 |
* mattf hands elmiko lighter fluid and a match | 20:01 | |
mattf | bob's cr enables epel on your machine if it happens to be centos | 20:02 |
elmiko | yea, i saw that | 20:02 |
mattf | i'd like to -1, but we've kinda opened the flood gate here and i don't feel like it's good to close them just on this one review | 20:02 |
mattf | i have python-argparse because it comes w/ rhel osp and rdo | 20:03 |
elmiko | tough call, i'm not sure what the correct solution is. if we don't add epel, we need to hack around arparse, or pull just 1 rpm, or ? | 20:04 |
mattf | argparse is in dib since jan 2013, so...ship sailed there | 20:04 |
elmiko | seems like no good option | 20:05 |
mattf | yum install url to argparse rpm is fragile too | 20:05 |
openstackgerrit | Chad Roberts proposed a change to stackforge/puppet-sahara: Updating the puppet module to reference Sahara https://review.openstack.org/92111 | 20:09 |
aignatov | tmckay_errand: approved hdfs simplifications, nice patch and simple :) | 20:17 |
openstackgerrit | Chad Roberts proposed a change to stackforge/puppet-sahara: Updating the puppet module to reference Sahara https://review.openstack.org/92111 | 20:22 |
openstackgerrit | A change was merged to openstack/sahara-image-elements: Fixes image creation script to work on CentOS https://review.openstack.org/92192 | 20:23 |
mattf | aignatov, did anyone response to the retrospective? | 20:24 |
mattf | i completely forgot | 20:24 |
openstackgerrit | Chad Roberts proposed a change to stackforge/puppet-sahara: Updating the puppet module to reference Sahara https://review.openstack.org/92111 | 20:25 |
aignatov | matff, only Daniele Venzano, man who is working on Spark stuff | 20:26 |
mattf | woman | 20:27 |
mattf | aignatov, so...small sample, doh! | 20:27 |
aignatov | mattf, it’s just a sample :) | 20:36 |
elmiko | general question, if i am doing some sahara debugging is it safe to insert pdb.set_trace commands if i am running sahara-api from the cli? | 20:39 |
mattf | aignatov, hehe | 20:41 |
mattf | elmiko, i'd hope so. tmckay_errand and crobertsrh may have done that in the past. | 20:41 |
*** mattf is now known as _mattf | 20:42 | |
crobertsrh | I believe so. I usually just do my debugging in eclipse. | 20:42 |
crobertsrh | tmckay_errand would know for sure | 20:43 |
elmiko | crobertsrh: never done python work in eclipse, does it have the py stuff out of the box or did you install something? | 20:43 |
crobertsrh | There is a plugin, PyDev, that I use. I shouldn't say "eclipse" too loudly. It doesn't seem to be too popular with anyone besides me. | 20:44 |
elmiko | lol, use what you like that's my philosophy | 20:44 |
elmiko | although i have had enough eclipse, i wrote an rcp application several years ago, so yea... | 20:45 |
crobertsrh | I came from a job using Eclipse for Java, so I was familiar with it. I am just too lazy to learn something else | 20:45 |
elmiko | lol | 20:45 |
elmiko | eclipse+java seems like a total win | 20:45 |
crobertsrh | I'm liking it better without the java part involved as much :) | 20:46 |
elmiko | haha, is that more about eclipse or java though ;) | 20:46 |
*** tmckay_errand is now known as tmckay | 20:49 | |
elmiko | do i need to have sources keystone_adminrc for the term where i'm running sahara-api? | 20:50 |
tmckay | elmiko, yes, pdb.set_trace() is fine | 20:52 |
elmiko | tmckay: cool, thanks | 20:52 |
tmckay | elmiko, the only time it messes things up that I know of is when you insert it in tests, then do tox -e py27 | 20:53 |
elmiko | ok | 20:53 |
tmckay | tox can't handle it. That's why you have to run tests directly with python -m testtools blah blah blah in that case | 20:53 |
elmiko | i'm just doing some debugging and i want to inspect the output of some stuff in the hdp plugin | 20:53 |
tmckay | yeah, should be fine. I embed it and run sahara-api from the command line all the time | 20:54 |
elmiko | although, now when i hit the sahara urls i'm getting weird authentication errors :( | 20:54 |
elmiko | do i need to source the keystonerc for sahara-api? | 20:54 |
tmckay | I think so | 20:54 |
tmckay | I always do | 20:54 |
elmiko | ok | 20:55 |
*** IlyaE has joined #openstack-sahara | 20:58 | |
elmiko | tmckay: do you know if i need to have keystonerc sourced for running horizon from cli? | 20:58 |
tmckay | also yes I think | 20:59 |
elmiko | k | 20:59 |
*** bradd1 has quit IRC | 20:59 | |
*** crobertsrh has quit IRC | 21:02 | |
*** boris-42 has quit IRC | 21:15 | |
*** boris-42 has joined #openstack-sahara | 21:16 | |
tmckay | hmm, does new gerrit have a work-in-progress feature? | 21:16 |
tmckay | ah, yes | 21:16 |
elmiko | tmckay: when you run local, do you use the sahara.conf.sample ? | 21:23 |
openstackgerrit | A change was merged to openstack/sahara: Allow HDFS data source paths without the hdfs:// scheme https://review.openstack.org/91664 | 21:23 |
tmckay | elmiko, yes, I copy it and modify. The full sample | 21:24 |
elmiko | ok, i tried to get away with using devstack's sample and it's causing hell! | 21:24 |
elmiko | i keep getting crazy auth errors when hitting the sahara endpoints | 21:25 |
elmiko | tmckay: have you ever seen something like this from horizon? http://paste.openstack.org/show/79029/ | 21:28 |
tmckay | elmiko, yes, usually that means something went wrong on the Sahara side. If you look through the Sahara output you may see it | 21:30 |
openstackgerrit | Trevor McKay proposed a change to openstack/sahara: Add ".sahara" suffix automatically to swift URLs in workflows https://review.openstack.org/92210 | 21:31 |
elmiko | hrm | 21:34 |
elmiko | so many configurations... lol | 21:36 |
elmiko | theoretically it's possible that i could run an openstack on another machine and then have a local horizon/sahara pointing to that machine? | 21:37 |
tmckay | yes | 21:39 |
tmckay | dimitryme, aignatov, SergeyLukjanov, mattf, elmiko, I put up https://review.openstack.org/91664 to help start a discussion exploring what we might do to smooth the edges on Hadoop swift URLs. It would be nice if the URLs for binaries vs data were uniform. Not sure if hiding the difference this way is a good idea or not. | 21:42 |
tmckay | see you all tomorrow! | 21:42 |
elmiko | have a good one | 21:42 |
aignatov | tmckay: see you | 21:43 |
tmckay | aigantov, bye! | 21:43 |
*** ErikB1 has quit IRC | 21:45 | |
*** tmckay has quit IRC | 21:46 | |
*** IlyaE has quit IRC | 21:56 | |
*** IlyaE has joined #openstack-sahara | 22:09 | |
*** ErikB1 has joined #openstack-sahara | 22:21 | |
*** _mattf is now known as mattf | 22:21 | |
*** elmiko is now known as elmiko_ | 22:23 | |
*** bradd1 has joined #openstack-sahara | 22:31 | |
*** ErikB1 has quit IRC | 23:01 | |
*** IlyaE has quit IRC | 23:12 | |
*** IlyaE has joined #openstack-sahara | 23:16 | |
*** elmiko_ has quit IRC | 23:27 | |
*** bradd1 has quit IRC | 23:31 | |
*** IlyaE has quit IRC | 23:45 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!