| *** dimtruck is now known as zz_dimtruck | 00:06 | |
| *** rook has joined #openstack-tailgate | 00:08 | |
| *** rook has quit IRC | 00:27 | |
| *** fnaval has joined #openstack-tailgate | 00:27 | |
| *** fnaval has quit IRC | 00:28 | |
| *** nicholasgoracke has joined #openstack-tailgate | 03:33 | |
| *** jasonsb has joined #openstack-tailgate | 04:11 | |
| *** rook-desktop has quit IRC | 05:21 | |
| *** nicholasgoracke has quit IRC | 05:42 | |
| *** nicholasgoracke has joined #openstack-tailgate | 07:54 | |
| *** nicholasgoracke has quit IRC | 07:58 | |
| *** hogepodge has quit IRC | 09:26 | |
| *** hogepodge has joined #openstack-tailgate | 09:28 | |
| *** rook has joined #openstack-tailgate | 10:47 | |
| *** chris_hunt has joined #openstack-tailgate | 14:06 | |
| *** rook has quit IRC | 14:25 | |
| *** dkranz has joined #openstack-tailgate | 14:39 | |
| *** nicholasgoracke has joined #openstack-tailgate | 14:46 | |
| *** rook has joined #openstack-tailgate | 14:50 | |
| *** malini has joined #openstack-tailgate | 15:12 | |
| *** zz_dimtruck is now known as dimtruck | 15:22 | |
| *** Leom has joined #openstack-tailgate | 15:46 | |
| *** Leom_ has joined #openstack-tailgate | 15:46 | |
| *** Leom has quit IRC | 15:50 | |
| *** rook has quit IRC | 16:28 | |
| *** sabeen has joined #openstack-tailgate | 16:53 | |
| *** rook has joined #openstack-tailgate | 16:54 | |
| *** sabeen3 has joined #openstack-tailgate | 16:55 | |
| *** sabeen has quit IRC | 16:58 | |
| *** gema_ is now known as gema | 16:59 | |
| *** gema is now known as Guest68041 | 17:00 | |
| *** Guest68041 is now known as gema_ | 17:01 | |
| hockeynut | I will be a few mins late | 17:01 |
|---|---|---|
| gema_ | hockeynut: ack | 17:01 |
| gema_ | having problems with my nick | 17:01 |
| gema_ | whatever I will start | 17:02 |
| gema_ | #startmeeting tailgate | 17:02 |
| openstack | Meeting started Thu Dec 10 17:02:29 2015 UTC and is due to finish in 60 minutes. The chair is gema_. Information about MeetBot at http://wiki.debian.org/MeetBot. | 17:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 17:02 |
| openstack | The meeting name has been set to 'tailgate' | 17:02 |
| clee | o/ | 17:02 |
| gema_ | #topic rollcall | 17:02 |
| gema_ | clee: hello! | 17:02 |
| clee | hey gema_ :) | 17:02 |
| gema_ | hi! | 17:03 |
| gema_ | I was emailing spyderdyne, he seems to be waiting for us in a hanogut | 17:03 |
| gema_ | hangout | 17:03 |
| gema_ | malini: o/ | 17:04 |
| malini | o/ | 17:04 |
| malini | I was confused abt the time again - but tht's me :D | 17:04 |
| gema_ | don't worry | 17:04 |
| gema_ | so, I haven't prepared any particular agenda because it has been so long that I thought we should recap | 17:05 |
| gema_ | #topic where are we, where are we going | 17:05 |
| malini | is someone grabbing spyderdyne from the hangout? | 17:06 |
| gema_ | I sent him an email saying we were here | 17:06 |
| malini | cool | 17:06 |
| gema_ | he is downloading an irc client and will be here soon | 17:06 |
| gema_ | maybe we should give him and hockeynut a couple of mins | 17:07 |
| malini | yes | 17:07 |
| *** spyderdyne has joined #openstack-tailgate | 17:07 | |
| gema_ | meanwhile, how's life? | 17:07 |
| spyderdyne | in the words of the great Wu Tang CLan, life is hectic :) | 17:08 |
| gema_ | spyderdyne: lol, welcome :) | 17:08 |
| spyderdyne | thanks | 17:08 |
| gema_ | spyderdyne: we were going to do some recap and see where we are and where we are going | 17:08 |
| gema_ | since it's been so long since the last meeting | 17:08 |
| spyderdyne | i had sent out a weekly hangouts invite to at the very least have a weekly meeting reminder sent out | 17:09 |
| gema_ | spyderdyne: the reminder works great for me | 17:09 |
| spyderdyne | and had great difficulty with the simple arithmetic of setting the timezone | 17:09 |
| gema_ | but I didn't see the hangout | 17:09 |
| malini | tht is NOT simple arithmetic | 17:09 |
| gema_ | spyderdyne: I use a website for that | 17:09 |
| spyderdyne | there is a UTC trick that just almost works, but not reliably | 17:09 |
| spyderdyne | actually, i googled it | 17:09 |
| spyderdyne | lol | 17:09 |
| gema_ | haha | 17:09 |
| malini | timezones are bad enough, and then they change time every 6 months | 17:10 |
| gema_ | yep | 17:10 |
| spyderdyne | right | 17:10 |
| malini | my brain is not complex enough to handle this :/ | 17:10 |
| spyderdyne | to save whale oil reserves | 17:10 |
| spyderdyne | the problem is that we work on complex patterns all day, so somethign simple like what time it will be next thrusday is complicated all of a sudden | 17:10 |
| *** ig0r_ has joined #openstack-tailgate | 17:11 | |
| gema_ | absolutely | 17:11 |
| gema_ | so maybe I will send an email 1 hour prior to the meeting every thursday | 17:11 |
| gema_ | that way every knows it's coming | 17:11 |
| malini | now that we have figured it out, we should be ok | 17:11 |
| spyderdyne | that might help actually | 17:12 |
| gema_ | because adding the meeting to the calendar if you are not invited directly , didn't prove easy for me either | 17:12 |
| gema_ | ok, will do that | 17:12 |
| gema_ | now, regarding our purpose and what we wanted to do originally | 17:12 |
| hockeynut | done | 17:12 |
| hockeynut | this is the meeting now in this irc? | 17:13 |
| gema_ | has anyone checked what the openstack performance team are doing? | 17:13 |
| clee | hockeynut: yes | 17:13 |
| gema_ | hockeynut: we've always been on IRC except when we were trying to rush a presentation together | 17:13 |
| gema_ | I'd say irc is better in the sense that there is written log | 17:13 |
| gema_ | for the people that cannot make it | 17:13 |
| gema_ | and taking notes is not necessary :) | 17:13 |
| hockeynut | ok, just wanted to be sure I'm in the right place :-D | 17:14 |
| gema_ | and more importantly, you are at the right time ;) | 17:14 |
| malini | +1 for IRC | 17:14 |
| malini | I wud have missed this meeting otherwise | 17:14 |
| gema_ | alright | 17:14 |
| spyderdyne | i believe we are required to have IRC content just to let the rest of the community stay up to date with our meetings, but i will keep the hangout alive each week in case someone needs to present or anyone needs to discuss offline | 17:14 |
| gema_ | spyderdyne: sounds good | 17:15 |
| spyderdyne | so, i missed the last 2 or 3 meetings due to workload | 17:15 |
| spyderdyne | but i have some updates | 17:15 |
| gema_ | spyderdyne: we are all ears | 17:15 |
| gema_ | (eyes) | 17:15 |
| spyderdyne | i know some of you shied away when i presented a scale-centric project for the summit presentation, which is fine | 17:16 |
| spyderdyne | we are currently working with red hat, intel, and others to provide scale testing components and methodologies to the openstack governance board | 17:16 |
| gema_ | that sounds really good | 17:17 |
| spyderdyne | our current efforts are to kick the tires on the mythos components, which i am happy to say are working for the most part | 17:17 |
| spyderdyne | we decided to abandon the idea of scale testing instances that dont do anything | 17:17 |
| gema_ | spyderdyne: is that tied up into the new openstack performance testing group? | 17:17 |
| spyderdyne | i.e. cirros images, micro micros, etc. | 17:17 |
| spyderdyne | i have had no contact with the new openstack perf testing group, | 17:18 |
| spyderdyne | but our partners may be tied into it | 17:18 |
| gema_ | ack | 17:18 |
| spyderdyne | i am using off the shelf linuxbenchmarking.org components, and some open source projects | 17:18 |
| spyderdyne | our next phase will be to enter the arena of a 1,000 hypervisor intel openstack data center | 17:19 |
| spyderdyne | we will do testing with the other interested parties there, and after the 1st of the year it will double in size | 17:19 |
| hockeynut | spyderdyne that's the OSIC (Rackspace + Intel)? | 17:19 |
| spyderdyne | yes | 17:19 |
| hockeynut | sweet | 17:19 |
| gema_ | spyderdyne: what will double in size? | 17:20 |
| gema_ | the cloud? | 17:20 |
| spyderdyne | the goal is to find common ground, and provide some sanity to the scale testing and performance testing methodoligies | 17:20 |
| spyderdyne | the 1,000 hypervisors becomes 2,000 | 17:20 |
| spyderdyne | :) | 17:20 |
| gema_ | wow, awesome | 17:20 |
| malini | this is really cool! | 17:21 |
| spyderdyne | each group has things they are using internally, so it looks like it might be an arms race to see who has the most useful weapons for attacking a cloud and measuring the results | 17:21 |
| gema_ | spyderdyne: is rally anywhere in the mix? | 17:21 |
| spyderdyne | the mythos project is my contribution, and looks to be a nuclear device | 17:21 |
| spyderdyne | rally is being used in heavily modified forms by cisco and red hat/ibm | 17:22 |
| spyderdyne | we have the odin wrapper to chain load tests, and red hat has IBMCB which does something similar, but addresses some of rally’s shortcomings | 17:22 |
| spyderdyne | it also behaves differently in that it spins up things like a normal rally test, | 17:23 |
| spyderdyne | but leaves them there to run multiple tests against, and then tears them down as a separate step | 17:23 |
| spyderdyne | currently rally performs build, test, and teardown (not so good at the teardown part…) for every test run | 17:23 |
| spyderdyne | my team abandoned rally b/c we didnt feel like we could trust the results, and there is a magic wizard inside that does things we cant track or account for | 17:24 |
| spyderdyne | :) | 17:24 |
| gema_ | yeah, sounds sensible | 17:24 |
| spyderdyne | we are at 1,000 instances now and working out some minor bugs with our data center | 17:25 |
| gema_ | spyderdyne: and what metrics are you interested in? | 17:26 |
| gema_ | time to spin 1000 instances? | 17:26 |
| spyderdyne | then we will puch to as many instances as we have VCPUs for and see if we can shut down neutron | 17:26 |
| gema_ | spyderdyne: you don't overcommit VCPUs? | 17:26 |
| gema_ | (for the testing, I mean) | 17:26 |
| spyderdyne | 1. if neutron can be overloaded with traffic, what level of traffic breaks it, and what component breaks first | 17:27 |
| spyderdyne | (SLA) | 17:27 |
| gema_ | ack | 17:28 |
| spyderdyne | 2. what linuxbenchmaring.org measurements do we get on our platform for each flavor? | 17:28 |
| spyderdyne | 3. how many instances that are actually doing work of some kind can a hypervisor support | 17:29 |
| gema_ | spyderdyne: and you determine what instances are doing work via ceilometer? | 17:30 |
| spyderdyne | to this end we are setting instances on private subnets, having them discover all the other similar hosts on their private subnets, and having them run siege tests against each other using bombardment scale tests, pushing the result to our head node for reporting | 17:30 |
| gema_ | or on the load of the host | 17:30 |
| spyderdyne | we dont use ceilometer at all for this | 17:30 |
| gema_ | ok | 17:30 |
| spyderdyne | the head node has a web server that clients check in with every 10 minutes via cron | 17:30 |
| spyderdyne | we write a script named .dosomething.sh and place it in the monitored directory | 17:31 |
| gema_ | ok | 17:31 |
| gema_ | ack, I understand how it works, thx | 17:31 |
| spyderdyne | we then move it frmo .dosomething.sh to dosomething.sh and the clients check in over a 10 minute offset to see if there is something new for them to run. | 17:31 |
| spyderdyne | if there is they run it | 17:31 |
| spyderdyne | in our scale tests, mongodb has been unable to even keep up with more than a few thousand instances | 17:32 |
| spyderdyne | so it hasnt been useful to us | 17:33 |
| gema_ | spyderdyne: and what are you using mongo for? | 17:33 |
| spyderdyne | ceilodb | 17:33 |
| gema_ | ack | 17:33 |
| gema_ | there are scalability issues with ceilometer + mongo | 17:33 |
| gema_ | we've also been unable to use it with hundreds, not thousands | 17:33 |
| gema_ | use it as in not only storing data but also mine it later | 17:33 |
| gema_ | but that's an issue for another day, I guess | 17:34 |
| gema_ | spyderdyne: very interesting all you guys are doing | 17:34 |
| spyderdyne | i was hooping someone would put more support behind the gnocci project, but in our case with Ceph for all our storage, it may cause other issues using that as well | 17:34 |
| spyderdyne | the issue is all the writes needed | 17:35 |
| spyderdyne | it makes snese to distribute them, and swift makes sense to use, but if you are using your object as a block sotre as well it just shifts the issue from adding another db platform to scale out in the control plane to making sure the storage can keep up | 17:36 |
| gema_ | spyderdyne: are results from this testing going to be available publicly? | 17:37 |
| spyderdyne | i wanted to ask since it wasnt very well received, shoudl i remove all the mythos stuff from our team repo and just keep it in my github form now on? | 17:38 |
| spyderdyne | the results fomr the intel testing will be made public | 17:38 |
| gema_ | spyderdyne: you can do whatever you prefer | 17:38 |
| malini | spyderdyne: 'well received' where? | 17:38 |
| gema_ | spyderdyne: I don't think anyone is against your project | 17:38 |
| gema_ | spyderdyne: the only issue was making us present this when we knew nothing about it, without you there | 17:39 |
| spyderdyne | the results from our internal testing will be made public once we prove that our hardware + architecture blows the doors off of or at least provides a high water mark compared to other platforms | 17:39 |
| malini | spyderdyne: my only concern was presenting this as how everybody tests their installation of openstack, when you were the only one who knew what it is | 17:39 |
| spyderdyne | :) | 17:39 |
| malini | spyderdyne: it has nothing to do with how good mythos is - which I am sure is pretty cool | 17:40 |
| gema_ | absolutely | 17:40 |
| gema_ | spyderdyne: you scared us | 17:40 |
| malini | & I cant even handle timezones :D | 17:40 |
| spyderdyne | lol | 17:40 |
| malini | spyderdyne: but if there is anything we can do to make mythos better, I would love to help :) | 17:41 |
| gema_ | yep, agreed, unfortunately my 8 hypervisors are already overloaded x) | 17:41 |
| gema_ | and it doesn't look like they'd make much of a difference | 17:41 |
| malini | :D | 17:41 |
| gema_ | spyderdyne: I think the work you are doing is keeping this group alive | 17:42 |
| gema_ | spyderdyne: and hopefully we'll find a way to chip in | 17:42 |
| malini | +1 | 17:42 |
| gema_ | I will present what I have been working on next week | 17:43 |
| gema_ | explain it in detail like you've been doing | 17:43 |
| spyderdyne | i would ask that any of you who are able to spin up an ubuntu vm with vt support to check out the code and give it a spin | 17:43 |
| gema_ | it's a jenkins plugin + a REST api for openstack on openstack functional testing | 17:43 |
| spyderdyne | i could use the feedback and my docs definitely need improvement | 17:44 |
| gema_ | spyderdyne: vt support? | 17:44 |
| spyderdyne | vanderpool | 17:44 |
| spyderdyne | hardware virtualization | 17:44 |
| gema_ | yep, I can do that | 17:44 |
| gema_ | how many VMs do I need to install/use mythos? | 17:45 |
| gema_ | anyway, don't say anything | 17:45 |
| gema_ | I will try and ask questions | 17:45 |
| gema_ | you can improve documentation based on that | 17:45 |
| gema_ | spyderdyne: although I am not sure it'll happen before Xmas | 17:46 |
| *** Leom_ has quit IRC | 17:47 | |
| gema_ | #action gema to try mythos on ubuntu with vt support | 17:47 |
| malini | I will try to find an ubuntu with vt support | 17:47 |
| malini | If I can get hold of one, I'll do too | 17:47 |
| spyderdyne | 1 ubuntu 15.04 vm, 2048MB ram, 100GB hdd (until i get packer to work and build a smaller source image) | 17:47 |
| gema_ | spyderdyne: so you install it from an image? | 17:48 |
| spyderdyne | as long as your openstack instnaces support hardware virt in libvirt (they are supposed to) then it shoudl work | 17:48 |
| gema_ | spyderdyne: and how do we check that it works? | 17:48 |
| spyderdyne | its using virtualbox (boo) and VB needs VT to run 64 bit guests | 17:48 |
| spyderdyne | http://askubuntu.com/questions/292217/how-to-enable-intel-vt-x | 17:49 |
| gema_ | #link http://askubuntu.com/questions/292217/how-to-enable-intel-vt-x | 17:49 |
| spyderdyne | the script has a check built in and will fail gracefully if it isnt supported | 17:49 |
| gema_ | ok | 17:49 |
| spyderdyne | its getting very friendly | 17:50 |
| spyderdyne | :) | 17:50 |
| spyderdyne | i am close to 1,000 commits now | 17:50 |
| gema_ | perfect | 17:50 |
| gema_ | you've been busy! :D | 17:50 |
| gema_ | alright, thanks so much for explaining it and we'll start helping with compatibility at least | 17:51 |
| gema_ | and documentation reviews | 17:51 |
| gema_ | we are 10 mins from end of meeting | 17:51 |
| gema_ | malini: anything from you? | 17:51 |
| gema_ | clee: ? | 17:52 |
| gema_ | hockeynut: ? | 17:52 |
| hockeynut | I'm good | 17:52 |
| gema_ | alright | 17:54 |
| gema_ | spyderdyne: do you have anything else? | 17:54 |
| malini | sorry - had to step away for a call | 17:54 |
| gema_ | malini: no worries | 17:54 |
| gema_ | alright, calling it a day then | 17:55 |
| malini | thanks spyderdyne - this is really cool! | 17:55 |
| gema_ | #endmeeting | 17:55 |
| openstack | Meeting ended Thu Dec 10 17:55:29 2015 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:55 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tailgate/2015/tailgate.2015-12-10-17.02.html | 17:55 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tailgate/2015/tailgate.2015-12-10-17.02.txt | 17:55 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tailgate/2015/tailgate.2015-12-10-17.02.log.html | 17:55 |
| gema_ | thanks yoou all for coming! | 17:55 |
| gema_ | spyderdyne: awesome work, thanks! | 17:55 |
| clee | gema_: yeah, nothing new from me, sorry :/ | 17:55 |
| gema_ | clee: no worries :LD | 17:55 |
| gema_ | :D thanks for making it | 17:56 |
| clee | trying to figure out why refstack is only running 63 of the 128 tests in the defcore suite on our cluster right now :/ | 17:56 |
| gema_ | clee: look at your conf | 17:56 |
| gema_ | tempest.conf | 17:56 |
| gema_ | if there is still one xD | 17:56 |
| gema_ | (they were talking in tokyo about doing something to the conf file) | 17:56 |
| clee | I've got a tempest.conf, and it seems to be properly configured. valid image/flavor IDs, valid user accounts, etc | 17:56 |
| gema_ | clee: good luck then :D | 17:57 |
| clee | I mean, if my tempest.conf was broken, wouldn't I get 0 tests running? | 17:57 |
| clee | 63 is just weird. | 17:57 |
| gema_ | clee: are they skipped? | 17:57 |
| clee | anyway. yeah. | 17:57 |
| clee | this isn't really the place to debug that :) | 17:57 |
| clee | but thanks! | 17:57 |
| gema_ | lol, ok | 17:57 |
| gema_ | night all | 17:58 |
| *** gema_ is now known as gema | 17:58 | |
| hockeynut | have a good day/evening/morning/afternoon y'all! | 17:59 |
| *** spyderdyne has quit IRC | 18:15 | |
| *** sabeen3 has quit IRC | 18:17 | |
| *** rook has quit IRC | 18:28 | |
| *** malini has quit IRC | 18:33 | |
| *** rook has joined #openstack-tailgate | 18:55 | |
| *** malini has joined #openstack-tailgate | 18:59 | |
| *** jasonsb has quit IRC | 20:04 | |
| *** sabeen1 has joined #openstack-tailgate | 20:24 | |
| *** rook has quit IRC | 20:31 | |
| *** sabeen3 has joined #openstack-tailgate | 20:39 | |
| *** sabeen1 has quit IRC | 20:39 | |
| *** jasonsb has joined #openstack-tailgate | 20:43 | |
| *** rook has joined #openstack-tailgate | 20:58 | |
| *** chris_hu_ has joined #openstack-tailgate | 20:58 | |
| *** chris_hunt has quit IRC | 21:02 | |
| *** chris_hu_ has quit IRC | 21:03 | |
| *** malini has quit IRC | 21:12 | |
| *** dimtruck is now known as zz_dimtruck | 21:52 | |
| *** hogepodge has quit IRC | 22:10 | |
| *** hogepodge has joined #openstack-tailgate | 22:13 | |
| *** moravec has quit IRC | 22:18 | |
| *** moravec has joined #openstack-tailgate | 22:19 | |
| *** moravec has quit IRC | 22:19 | |
| *** moravec has joined #openstack-tailgate | 22:20 | |
| *** dkranz has quit IRC | 22:21 | |
| *** moravec has quit IRC | 22:24 | |
| *** rook has quit IRC | 22:33 | |
| *** rook has joined #openstack-tailgate | 22:59 | |
| *** sabeen3 has quit IRC | 23:21 | |
| *** sabeen1 has joined #openstack-tailgate | 23:47 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!