*** annegent_ has joined #openstack-swift | 00:04 | |
*** Masahiro has joined #openstack-swift | 00:25 | |
*** Masahiro has quit IRC | 00:29 | |
openstackgerrit | Samuel Merritt proposed openstack/swift: Add notion of overload to swift-ring-builder https://review.openstack.org/141452 | 00:32 |
---|---|---|
openstackgerrit | Samuel Merritt proposed openstack/swift: Tiny speedup to ring builder https://review.openstack.org/142945 | 00:32 |
*** annegent_ has quit IRC | 00:33 | |
*** dmorita has joined #openstack-swift | 00:39 | |
notmyname | cschwede: zaitcev: I left comments on https://review.openstack.org/#/c/99824/. I'd appreciate confirmation or correction on my understanding | 00:55 |
notmyname | dmorita: oh! you might help there too! (and let kota know. don't see him online right now) ^ | 00:55 |
zaitcev | I'm looking | 00:58 |
*** addnull has joined #openstack-swift | 00:59 | |
*** Masahiro has joined #openstack-swift | 01:01 | |
notmyname | thanks | 01:03 |
notmyname | I'm not going to be able to look any more today. I'll check later though | 01:04 |
*** nellysmitt has joined #openstack-swift | 01:11 | |
*** annegent_ has joined #openstack-swift | 01:12 | |
*** nellysmitt has quit IRC | 01:16 | |
*** oomichi has joined #openstack-swift | 01:39 | |
*** masonhsiung has joined #openstack-swift | 01:42 | |
mattoliverau | Back in Melbourne (arrived home from Christmas party elsewhere in Oz). Now you all have to put up with me again :p | 01:42 |
*** annegent_ has quit IRC | 01:44 | |
openstackgerrit | Samuel Merritt proposed openstack/swift: Add notion of overload to swift-ring-builder https://review.openstack.org/141452 | 01:44 |
*** oomichi has quit IRC | 01:55 | |
*** haomaiwang has joined #openstack-swift | 01:57 | |
*** Nadeem has quit IRC | 01:58 | |
*** gyee has quit IRC | 02:03 | |
*** Shihta has joined #openstack-swift | 02:17 | |
*** nosnos has joined #openstack-swift | 02:18 | |
*** Shihta_ has joined #openstack-swift | 02:26 | |
*** Shihta has quit IRC | 02:30 | |
notmyname | tonight I'll be updating launchpad and sending ttx the go-ahead for the final 2.2.1 release | 02:36 |
mattoliverau | Cool :) | 02:47 |
*** Shihta_ has quit IRC | 02:55 | |
*** mahatic has quit IRC | 03:01 | |
*** nosnos has quit IRC | 03:10 | |
*** nosnos has joined #openstack-swift | 03:11 | |
*** nellysmitt has joined #openstack-swift | 03:12 | |
*** nosnos has quit IRC | 03:16 | |
*** nellysmitt has quit IRC | 03:17 | |
*** nosnos has joined #openstack-swift | 04:02 | |
*** ppai has joined #openstack-swift | 04:04 | |
*** addnull has quit IRC | 04:26 | |
*** addnull has joined #openstack-swift | 04:26 | |
*** lcurtis has quit IRC | 04:26 | |
notmyname | dinner eaten. kids down. drinks made. time for swift | 04:49 |
openstackgerrit | John Dickinson proposed openstack/swift: Added Nicolas, who was erantly left out of AUTHORS https://review.openstack.org/142983 | 05:03 |
notmyname | eikke: sorry about that. fix ^^ | 05:03 |
*** nellysmitt has joined #openstack-swift | 05:13 | |
*** nellysmitt has quit IRC | 05:18 | |
*** miurahr has joined #openstack-swift | 05:44 | |
*** miurahr has quit IRC | 05:54 | |
*** miurahr has joined #openstack-swift | 06:01 | |
*** miurahr has quit IRC | 06:09 | |
*** ahonda has quit IRC | 06:28 | |
*** ahonda has joined #openstack-swift | 06:28 | |
*** NM has joined #openstack-swift | 06:29 | |
*** k4n0 has joined #openstack-swift | 06:30 | |
*** pcaruana has joined #openstack-swift | 06:49 | |
notmyname | ok, all written up. I'll send it out tomorrow | 06:54 |
notmyname | good night | 06:54 |
*** NM has quit IRC | 06:55 | |
*** ttrumm has joined #openstack-swift | 07:05 | |
openstackgerrit | Yuan Zhou proposed openstack/swift: Fix probe tests with EC policy https://review.openstack.org/143002 | 07:07 |
*** ttrumm has quit IRC | 07:10 | |
*** zaitcev has quit IRC | 07:11 | |
*** nellysmitt has joined #openstack-swift | 07:14 | |
*** nellysmitt has quit IRC | 07:19 | |
*** SkyRocknRoll has joined #openstack-swift | 07:36 | |
*** miurahr has joined #openstack-swift | 08:02 | |
*** ttrumm has joined #openstack-swift | 08:05 | |
*** miurahr has quit IRC | 08:10 | |
*** nosnos has quit IRC | 08:16 | |
*** nosnos has joined #openstack-swift | 08:17 | |
*** geaaru has joined #openstack-swift | 08:21 | |
*** nosnos has quit IRC | 08:22 | |
*** rledisez has joined #openstack-swift | 08:39 | |
*** silor has joined #openstack-swift | 08:42 | |
*** nellysmitt has joined #openstack-swift | 08:52 | |
*** addnull has quit IRC | 09:06 | |
*** addnull has joined #openstack-swift | 09:10 | |
*** addnull has quit IRC | 09:11 | |
*** jordanP has joined #openstack-swift | 09:17 | |
*** dmorita has quit IRC | 09:17 | |
*** silor has quit IRC | 09:28 | |
*** nellysmitt has quit IRC | 09:31 | |
*** david-ly_ has quit IRC | 09:32 | |
*** aix has joined #openstack-swift | 09:33 | |
*** david-lyle has joined #openstack-swift | 09:33 | |
*** david-lyle has quit IRC | 09:38 | |
*** nellysmitt has joined #openstack-swift | 09:38 | |
*** ppai has quit IRC | 10:08 | |
openstackgerrit | Donagh McCabe proposed openstack/swift: Add multiple reseller prefixes and composite tokens https://review.openstack.org/137086 | 10:19 |
*** ppai has joined #openstack-swift | 10:23 | |
*** masonhsi_ has joined #openstack-swift | 10:29 | |
*** masonhsiung has quit IRC | 10:32 | |
*** masonhsi_ has quit IRC | 10:34 | |
openstackgerrit | Nicolas Trangez proposed openstack/swift: Add test coverage for `splice` and `tee` failure scenarios https://review.openstack.org/143031 | 10:34 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Merge "fix dlo manifest file getting versioned" https://review.openstack.org/143033 | 10:41 |
eikke | notmyname: heh, np, I only later realized my patch landed too late anyway :-) | 10:52 |
*** Masahiro has quit IRC | 10:59 | |
*** aix has quit IRC | 11:00 | |
*** nellysmitt has quit IRC | 11:13 | |
*** aix has joined #openstack-swift | 11:21 | |
*** kaliya has quit IRC | 11:22 | |
*** nellysmitt has joined #openstack-swift | 11:38 | |
*** mahatic has joined #openstack-swift | 11:39 | |
*** haomaiwang has quit IRC | 11:40 | |
*** nellysmitt has quit IRC | 11:50 | |
*** Masahiro has joined #openstack-swift | 11:59 | |
*** Masahiro has quit IRC | 12:04 | |
*** nellysmitt has joined #openstack-swift | 12:13 | |
*** jasondotstar is now known as jasondotstar|afk | 12:16 | |
*** k4n0 has quit IRC | 12:23 | |
*** nellysmitt has quit IRC | 12:35 | |
*** jordanP has quit IRC | 12:35 | |
*** jordanP has joined #openstack-swift | 12:35 | |
*** nellysmitt has joined #openstack-swift | 12:40 | |
*** NM has joined #openstack-swift | 12:43 | |
*** swifterdarrell has quit IRC | 12:44 | |
*** amandap has quit IRC | 12:45 | |
*** chrisnelson has quit IRC | 12:45 | |
*** ahonda has quit IRC | 12:46 | |
*** swifterdarrell has joined #openstack-swift | 12:46 | |
*** ChanServ sets mode: +v swifterdarrell | 12:46 | |
*** tdasilva has quit IRC | 12:46 | |
*** ahonda has joined #openstack-swift | 12:46 | |
*** tdasilva has joined #openstack-swift | 12:46 | |
*** SkyRocknRoll has quit IRC | 12:46 | |
*** chrisnelson has joined #openstack-swift | 12:47 | |
*** amandap has joined #openstack-swift | 12:48 | |
*** geaaru has quit IRC | 12:58 | |
*** Masahiro has joined #openstack-swift | 13:01 | |
*** nellysmitt has quit IRC | 13:02 | |
*** Masahiro has quit IRC | 13:06 | |
*** nellysmitt has joined #openstack-swift | 13:08 | |
*** exploreshaifali has joined #openstack-swift | 13:21 | |
*** ppai has quit IRC | 13:27 | |
remix_tj | is possible to change in a second moment the replication address used in the ring configuration? my network admins didn't defined the networks yet -_- | 13:36 |
*** miurahr has joined #openstack-swift | 13:58 | |
*** fandi has joined #openstack-swift | 13:59 | |
*** miurahr has quit IRC | 14:11 | |
*** lpabon has joined #openstack-swift | 14:32 | |
*** exploreshaifali has quit IRC | 14:39 | |
*** ttrumm has quit IRC | 14:43 | |
*** tellesnobrega_ has joined #openstack-swift | 14:49 | |
*** NM has quit IRC | 14:50 | |
*** Masahiro has joined #openstack-swift | 14:50 | |
*** tellesnobrega_ has quit IRC | 14:51 | |
*** lcurtis has joined #openstack-swift | 14:54 | |
*** Masahiro has quit IRC | 14:55 | |
*** NM has joined #openstack-swift | 14:57 | |
*** tellesnobrega_ has joined #openstack-swift | 15:10 | |
*** tellesnobrega_ has quit IRC | 15:11 | |
*** tellesnobrega_ has joined #openstack-swift | 15:14 | |
*** esmute has quit IRC | 15:14 | |
*** ferahgo has quit IRC | 15:15 | |
*** jasondotstar|afk has quit IRC | 15:16 | |
*** esmute has joined #openstack-swift | 15:18 | |
*** tellesnobrega_ has quit IRC | 15:22 | |
*** jasondotstar|afk has joined #openstack-swift | 15:24 | |
*** bill_az has joined #openstack-swift | 15:39 | |
*** bill_az has quit IRC | 15:39 | |
*** bill_az has joined #openstack-swift | 15:39 | |
*** jasondotstar|afk has quit IRC | 15:41 | |
*** geaaru has joined #openstack-swift | 15:41 | |
*** pberis has quit IRC | 15:49 | |
*** pcaruana has quit IRC | 15:59 | |
*** pberis has joined #openstack-swift | 15:59 | |
*** jasondotstar has joined #openstack-swift | 16:00 | |
*** rdaly2 has joined #openstack-swift | 16:06 | |
notmyname | good morning | 16:09 |
tdasilva | good morning! | 16:16 |
*** Nadeem has joined #openstack-swift | 16:19 | |
notmyname | http://lists.openstack.org/pipermail/openstack-dev/2014-December/053351.html <-- 2.2.1 released | 16:22 |
*** ChanServ changes topic to "Swift 2.2.1 | Priority Reviews: https://wiki.openstack.org/wiki/Swift/PriorityReviews | Ideas: https://wiki.openstack.org/wiki/Swift/ideas | Review Dashboard: http://goo.gl/r2mxbe" | 16:22 | |
*** themadcanudist has joined #openstack-swift | 16:22 | |
*** delatte has quit IRC | 16:22 | |
themadcanudist | hey guys, why would there be like 80-90 forks/s from container-server on my swift cluster? | 16:23 |
themadcanudist | is that normal behaviour? | 16:23 |
notmyname | lots of workers + lots of per-drive threads + lots of drives? | 16:23 |
* notmyname is being loose with the definition of "forks" | 16:23 | |
themadcanudist | oh, i mean OS clones/forks | 16:24 |
themadcanudist | PER second | 16:24 |
themadcanudist | my swift cluster has always been very high load, and I notice that each node spends a lot of time forkbombing itself. Trying to figure out if this is normal. the process that execs() and exits immediately is <container-server> | 16:24 |
themadcanudist | 90 times a second | 16:24 |
notmyname | maybe your server room is too cold and skynet thinks it needs to keep it warm with cpu cylces? ;-) | 16:25 |
themadcanudist | hehe | 16:25 |
themadcanudist | this is not normal, correct? | 16:25 |
notmyname | themadcanudist: seriously, though. that doesn't sound normal, nor does anything immediately spring to mind like "oh that's something that happens when...." | 16:26 |
themadcanudist | hrm, kk | 16:26 |
*** exploreshaifali has joined #openstack-swift | 16:26 | |
notmyname | themadcanudist: you've got more than one container server in your cluster right? | 16:27 |
themadcanudist | yeah | 16:27 |
* notmyname goes to check an option... | 16:27 | |
notmyname | themadcanudist: good thing I checked. my guess was way off | 16:29 |
notmyname | themadcanudist: ok, so if you want to play "mad scientist" and vivisect a live cluster, here's something to try. maybe it will give some more info about what's happening | 16:29 |
themadcanudist | I think it's container-updater | 16:30 |
notmyname | themadcanudist: on one container server, turn it off (should have little impact on your cluster). then, from the prompt run `swift-init container no-daemon`. That will start it in interactive mode (not fork to background and dump all the logs to the tty | 16:30 |
themadcanudist | i narrowed it down and stopped the proc temporarily | 16:31 |
notmyname | ah | 16:31 |
themadcanudist | load dropped as well as clones/s | 16:31 |
mahatic | good morning! | 16:31 |
notmyname | themadcanudist: the "no-daemon" will work for any of the swift processes started with swift-init | 16:32 |
themadcanudist | yeah, checking | 16:32 |
themadcanudist | container-updated can be down for a bit without impact, eh? | 16:32 |
notmyname | ya | 16:32 |
themadcanudist | it's just a consistency check after the fact, correct? | 16:32 |
notmyname | "just" ;-) | 16:33 |
notmyname | it keeps the account metadata up to date. which in a lot of clusters (not sure about yours) directly affects billing/chargeback info. but yeah, it's designed to expect failures | 16:33 |
themadcanudist | =) | 16:34 |
*** miurahr has joined #openstack-swift | 16:37 | |
*** Masahiro has joined #openstack-swift | 16:39 | |
notmyname | themadcanudist: ok, so maybe the container updater process doing a a fork bomb sounds vaguely familiar. looking... | 16:42 |
themadcanudist | interesting | 16:43 |
*** Masahiro has quit IRC | 16:43 | |
*** NM has quit IRC | 16:44 | |
notmyname | themadcanudist: this is what I was thinking about https://review.openstack.org/#/c/125197/ | 16:45 |
notmyname | themadcanudist: that was for the auditor, but perhaps there's something similar in the container updater? | 16:45 |
themadcanudist | hrm | 16:45 |
*** nellysmitt has quit IRC | 16:45 | |
*** NM has joined #openstack-swift | 16:47 | |
themadcanudist | ok, thanks for the info! | 16:47 |
notmyname | hmmm...looks like it might in fact be the same sort of issue | 16:49 |
themadcanudist | really? | 16:50 |
notmyname | themadcanudist: what are the chances you'd be able to test it out and submit a patch? | 16:50 |
themadcanudist | hrm, i'm not using the latest | 16:50 |
*** miurahr has quit IRC | 16:51 | |
notmyname | themadcanudist: I'm not 100% sure. I've only looked at the code and not run it with this in mind. but it does look similar. | 16:51 |
themadcanudist | shoudln't there be an error log of sorts? | 16:51 |
notmyname | themadcanudist: but, if it is the same, then it's the result of a mis config (eg the permissions described in the commit message of the other patch). but even with a mis config, then swift shouldn't fork bomb your system | 16:52 |
themadcanudist | yeah, the perms are good | 16:53 |
themadcanudist | so, i'm not sure what would cause it? | 16:53 |
notmyname | themadcanudist: not sure. but that's why I was curious about running it in no-daemon mode. you might see a traceback there | 16:54 |
themadcanudist | yeah | 16:54 |
themadcanudist | trying to reproduce. I really appreciate the help, just going to log my terminal and i need to step away | 16:55 |
themadcanudist | but I'll be around! | 16:55 |
*** gyee has joined #openstack-swift | 16:58 | |
*** masonhsiung has joined #openstack-swift | 17:02 | |
*** NM has quit IRC | 17:04 | |
*** nellysmitt has joined #openstack-swift | 17:05 | |
*** masonhsiung has quit IRC | 17:07 | |
*** nellysmitt has quit IRC | 17:08 | |
*** masonhsiung has joined #openstack-swift | 17:09 | |
*** rdaly2 has quit IRC | 17:10 | |
*** NM has joined #openstack-swift | 17:11 | |
*** NM has quit IRC | 17:12 | |
*** miurahr has joined #openstack-swift | 17:14 | |
themadcanudist | notmyname: quick update. it's not a fork bomb | 17:15 |
themadcanudist | it's simply how aggressive it is | 17:15 |
themadcanudist | i used slowdown 0.05 and concurrency 1 on the updater | 17:15 |
themadcanudist | and now it does it's job with some pacing | 17:15 |
notmyname | yay | 17:15 |
themadcanudist | ;) | 17:15 |
*** lpabon has quit IRC | 17:15 | |
notmyname | themadcanudist: I believe you misspelled "it's simply how awesome swift is" | 17:15 |
themadcanudist | lol | 17:15 |
themadcanudist | ;) | 17:15 |
*** NM has joined #openstack-swift | 17:17 | |
*** jordanP has quit IRC | 17:18 | |
*** geaaru has quit IRC | 17:23 | |
*** aix has quit IRC | 17:30 | |
*** masonhsiung has quit IRC | 17:37 | |
*** exploreshaifali has quit IRC | 17:45 | |
*** lcurtis has quit IRC | 18:01 | |
*** rledisez has quit IRC | 18:25 | |
mahatic | notmyname, I'll have something to work on if you take a look at this https://review.openstack.org/#/c/140103/ ;) | 18:26 |
*** Masahiro has joined #openstack-swift | 18:27 | |
notmyname | mahatic: I'm going to be unavailable for the next few hours. a quick glance looks like you're on the right track. a few minor things to work out (calling the parent class, only setting _allowed_mothods = None in the parent class) | 18:29 |
mahatic | notmyname, okay. I thought about that too. Leave your further comments/suggestions when you find time. thanks! | 18:31 |
mahatic | notmyname, thought about the _allowed_methods thing. Not sure about the "calling parent class though) | 18:32 |
*** Masahiro has quit IRC | 18:32 | |
notmyname | mahatic: google for "python super()" | 18:33 |
mahatic | notmyname, oh, that's what you mean. I read what you wrote as two diff things. sorry | 18:35 |
mahatic | got it now. will correct | 18:35 |
*** masonhsiung has joined #openstack-swift | 18:48 | |
*** masonhsiung has quit IRC | 18:53 | |
*** rdaly2 has joined #openstack-swift | 18:59 | |
*** openstack has joined #openstack-swift | 19:09 | |
*** openstackstatus has joined #openstack-swift | 19:10 | |
*** ChanServ sets mode: +v openstackstatus | 19:10 | |
*** tdasilva has quit IRC | 19:30 | |
*** lpabon has joined #openstack-swift | 19:34 | |
*** ondergetekende_ is now known as ondergetekende | 19:40 | |
*** bgmccollum has left #openstack-swift | 19:41 | |
*** panbalag has quit IRC | 19:41 | |
*** mahatic has quit IRC | 19:44 | |
*** tdasilva has joined #openstack-swift | 19:45 | |
*** dmsimard_away is now known as dmsimard | 19:47 | |
*** dmsimard is now known as dmsimard_away | 19:47 | |
*** mahatic has joined #openstack-swift | 19:59 | |
*** Masahiro has joined #openstack-swift | 20:16 | |
*** Masahiro has quit IRC | 20:20 | |
*** exploreshaifali has joined #openstack-swift | 20:27 | |
notmyname | /back | 20:34 |
*** NM has quit IRC | 20:36 | |
*** gyee has quit IRC | 20:39 | |
*** zaitcev has joined #openstack-swift | 20:41 | |
*** ChanServ sets mode: +v zaitcev | 20:41 | |
*** gyee has joined #openstack-swift | 20:55 | |
*** tongli has joined #openstack-swift | 20:56 | |
*** nellysmitt has quit IRC | 20:58 | |
*** nellysmitt has joined #openstack-swift | 21:00 | |
tdasilva | notmyname: hi, what is the purpose of this patch? https://review.openstack.org/#/c/143033/ | 21:16 |
notmyname | tdasilva: ah, interesting. hadn't seen it yet. there's a story there | 21:17 |
notmyname | tdasilva: after every release, the bot will automatically merge the tag back into master so that HEAD always has the latest release as an ancestor in the git history | 21:18 |
notmyname | tdasilva: this is really important when there are multiple RCs and stuff that lands for the release after the RC is cut | 21:18 |
notmyname | tdasilva: in this case (with 2.2.1), it's a no-op | 21:19 |
*** exploreshaifali has quit IRC | 21:19 | |
notmyname | tdasilva: thanks. I abandoned it | 21:20 |
tdasilva | notmyname: cool, i just saw it by chance... | 21:25 |
*** nellysmitt has quit IRC | 21:34 | |
openstackgerrit | Mahati proposed openstack/swift: Implement OPTIONS verb for storage nodes. https://review.openstack.org/140103 | 21:53 |
*** Masahiro has joined #openstack-swift | 22:05 | |
*** pberis has quit IRC | 22:08 | |
*** NM has joined #openstack-swift | 22:09 | |
*** NM has quit IRC | 22:09 | |
*** Masahiro has quit IRC | 22:09 | |
*** lpabon has quit IRC | 22:12 | |
*** sandywalsh has quit IRC | 22:40 | |
*** sandywalsh has joined #openstack-swift | 22:43 | |
*** IRTermite has quit IRC | 22:45 | |
openstackgerrit | Samuel Merritt proposed openstack/swift: Add notion of overload to swift-ring-builder https://review.openstack.org/141452 | 22:52 |
openstackgerrit | Samuel Merritt proposed openstack/swift: Only move too-close-together replicas when they can spread out. https://review.openstack.org/140879 | 22:52 |
torgomatic | clayg: ping | 22:56 |
clayg | torgomatic: pong | 22:59 |
clayg | torgomatic: if you're just going to tell me I should review your ring patches - I already know I *should* | 22:59 |
*** jordanP has joined #openstack-swift | 22:59 | |
clayg | ... but obvioulsy haven't yet :\ | 22:59 |
torgomatic | clayg: I was just excited that I got the overload one working | 22:59 |
torgomatic | it was lots trickier than it sounded at first glance | 23:00 |
clayg | heh | 23:02 |
clayg | sweet, I'll curl up with it and a hot coco over the weekend | 23:02 |
clayg | it's very rainy over here | 23:02 |
torgomatic | put some whiskey in the cocoa; you may need it | 23:02 |
clayg | heh | 23:02 |
peluse | mmmm... whiskey | 23:22 |
notmyname | peluse: you mis-spelled tequila | 23:25 |
peluse | man, I'm going to need to crack a beer open here in a minute, having a reaction to all this talk :) | 23:26 |
chrisnelson | torgomatic: peluse: notmyname: There are lots of IRC messages that fly across my screen in a day and get ignored, then there are those which cannot help but get my attention... :) | 23:26 |
peluse | and I take back everything I say about the recontruction part of the reconstructor being the easiest part... | 23:26 |
notmyname | cold and rainy on my side of town too. I'd be fine with some whiskey | 23:26 |
notmyname | chrisnelson: :-) | 23:26 |
notmyname | peluse: lol | 23:27 |
peluse | clayg I'm going to plumb in a quick and dirty dumb EC get function for me to use in recontruction and will wrangle in your stuff when ready | 23:27 |
notmyname | peluse: the only easy parts are the ones that have already been written and verified to work | 23:27 |
peluse | amen | 23:27 |
peluse | chrisnelson, all work and no play, something something something.... | 23:28 |
chrisnelson | peluse: ha | 23:28 |
notmyname | chrisnelson: I tried this reposado a while back (from the texas legend himself) http://www.maninblacktequila.com/Kinkyabout.html | 23:31 |
*** fandi has quit IRC | 23:32 | |
chrisnelson | notmyname: ah, I've had it. Nice! On a related topic, I picked up some Del Maguey Vida mezcal the other day and served some Mexican Last Words at a holiday party. Well received. | 23:33 |
*** nellysmitt has joined #openstack-swift | 23:34 | |
notmyname | very nice | 23:36 |
notmyname | chrisnelson: the vida is good, but little harsh for my taste. Mezcal Vago Espadin is very good and not too much more. and Del Maguey has some crazy expensive stuff too that, of course, is tastey. | 23:37 |
chrisnelson | notmyname: Good to know. That was my first taste of mezcal in many years, so I'll have to try some more. | 23:38 |
*** nellysmitt has quit IRC | 23:39 | |
*** Masahiro has joined #openstack-swift | 23:54 | |
*** bill_az has quit IRC | 23:58 | |
*** Masahiro has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!