Thursday, 2015-06-11

meteorfoxboris-42: hey00:00
*** BitSmith has quit IRC00:00
boris-42meteorfox: how is going?00:00
meteorfoxboris-42: good, but extremely busy. I've been working on adding support for Rackspace to the Google project, PerfKitBenchmarker. https://github.com/meteorfox/PerfKitBenchmarker/tree/rackspace-provider-dev00:02
meteorfoxboris-42: plus other internal stuff00:02
meteorfoxboris-42: how about you00:02
meteorfox?00:02
boris-42meteorfox: that one is cloud comparator?00:03
boris-42comparator*00:03
meteorfoxboris-42: kind of, it will not compare it for, but you can run the benchmarks against different cloud providers00:04
meteorfox*it will not compare them for you00:04
boris-42meteorfox: heh someday in rally maybe=)00:05
meteorfoxboris-42: the workloads are nice00:05
boris-42meteorfox: inside VMs as I assume?00:05
boris-42meteorfox: or framework it self?00:05
meteorfoxboris-42: yeah, must of the workloads are for inside the vms, there are some cluster_boot scenarios, but its strength is the data plane00:06
meteorfoxboris-42: it's all through SSH, it provides utilities to add the benchmarks really easily00:07
meteorfoxboris-42: for example, this is the mongodb_ycsb benchmark https://github.com/meteorfox/PerfKitBenchmarker/blob/rackspace-provider-dev/perfkitbenchmarker/benchmarks/mongodb_ycsb_benchmark.py00:08
boris-42meteorfox: heh someday we will finish this in rally=(00:08
meteorfoxboris-42: the nice thing about it, is that is very easy to do benchmarks with multiple VMs00:09
boris-42meteorfox: it's our goal =)00:09
meteorfoxboris-42: I know :)00:09
boris-42meteorfox: to make such framework=)00:09
*** klindgren_ has joined #openstack-rally00:09
boris-42meteorfox: this heavy chain https://review.openstack.org/#/c/177014/ =)00:10
meteorfoxboris-42: at Rackspace, I use Rally for Control Plane (API and stuff), and PerfKitBenchmarker for Data plane00:10
*** klindgren has quit IRC00:11
boris-42meteorfox: someday I hope you will use for both rally=)00:11
meteorfoxboris-42: yeah, I don't think PerfKit, will go as deep into the control plane, as Rally does00:12
meteorfoxboris-42: I'm part of the PerfKit group, and its mostly academic. MIT and Stanford are part of it too, and they are interested on the workloads, not the API00:13
boris-42meteorfox: heh00:13
boris-42meteorfox: they have more star on their git repo=)00:14
meteorfoxboris-42: lol yeah00:14
meteorfoxboris-42: but they are Google, and they announced in their blogs00:15
meteorfoxboris-42: it was even on TechCrunch00:16
boris-42meteorfox: I should benchmark kubernates=)00:18
boris-42meteorfox: to get in their blog=)00:18
*** adiantum has joined #openstack-rally00:20
*** yingjun has joined #openstack-rally00:21
*** psd|zzz has quit IRC00:24
*** adiantum has quit IRC00:25
*** georgem1 has quit IRC00:26
openstackgerritMerged openstack/rally: Better mocking for self.[admin_]clients in Scenario tests  https://review.openstack.org/18855400:29
*** yingjun has quit IRC00:33
*** yingjun has joined #openstack-rally00:33
*** mwagner_afk has joined #openstack-rally00:43
*** kiran-r has joined #openstack-rally00:44
openstackgerritOpenStack Proposal Bot proposed openstack/rally: Updated from global requirements  https://review.openstack.org/18946300:48
*** BitSmith has joined #openstack-rally01:13
*** BitSmith has quit IRC01:16
*** BitSmith has joined #openstack-rally01:19
*** BitSmith is now known as [BitSmith]01:34
*** [BitSmith] is now known as BitSmith01:37
*** BitSmith is now known as [BitSmith]01:38
*** [BitSmith] is now known as BitSmith01:43
*** yingjun has quit IRC01:45
*** yingjun has joined #openstack-rally01:45
*** georgem1 has joined #openstack-rally01:52
*** pboldin has quit IRC01:55
*** lutostag has quit IRC01:56
*** georgem1 has left #openstack-rally02:01
*** BitSmith is now known as [BitSmith]02:07
*** [BitSmith] is now known as BitSmith02:07
*** BitSmith has quit IRC02:34
*** yingjun_ has joined #openstack-rally02:35
*** yingjun has quit IRC02:35
openstackgerritmaplelabs proposed openstack/rally: Add Neutron Loadbalancer create and list pool  https://review.openstack.org/18268502:36
*** BitSmith has joined #openstack-rally02:40
openstackgerritmaplelabs proposed openstack/rally: Add Neutron Loadbalancer create and list pool  https://review.openstack.org/18268502:42
*** BitSmith has quit IRC02:44
*** BitSmith has joined #openstack-rally02:47
*** kiran-r has quit IRC02:51
*** BitSmith has quit IRC02:54
openstackgerritLi Yingjun proposed openstack/rally: Validate tenant related scenarios when using keystone v3  https://review.openstack.org/18132103:19
*** arxcruz has joined #openstack-rally03:36
*** arxcruz has quit IRC03:41
*** kiran-r has joined #openstack-rally03:42
*** yingjun_ has quit IRC03:46
openstackgerritmaplelabs proposed openstack/rally: Add Neutron Loadbalancer create and list pool  https://review.openstack.org/18268503:52
*** kiran-r has quit IRC03:57
*** mahito has joined #openstack-rally04:20
*** tfreger has joined #openstack-rally04:23
*** mahito has quit IRC04:25
*** mahito has joined #openstack-rally04:28
*** yfried has quit IRC04:53
*** yingjun has joined #openstack-rally04:56
*** yingjun has quit IRC04:56
*** yingjun has joined #openstack-rally04:56
*** lutostag has joined #openstack-rally04:57
*** kiran-r has joined #openstack-rally05:15
*** neeti has joined #openstack-rally05:20
*** aswadr has joined #openstack-rally05:34
*** yingjun has quit IRC05:34
*** rdas has joined #openstack-rally05:37
*** nihilifer has joined #openstack-rally05:38
*** mahito has quit IRC05:40
openstackgerritmaplelabs proposed openstack/rally: Add Neutron Loadbalancer create and list pool  https://review.openstack.org/18268505:44
*** coolsvap|afk is now known as coolsvap05:50
*** mahito has joined #openstack-rally06:14
*** yingjun has joined #openstack-rally06:14
*** yfried has joined #openstack-rally06:16
*** nkhare has joined #openstack-rally06:28
yfriedyingjun: ping re https://review.openstack.org/18268506:32
yingjunyfried, lgtm :)06:33
yfriedyingjun: are you familiar with neutron LBaaS?06:34
*** aswadr has quit IRC06:35
yingjunyfried, not a expert of LBaaS, but i am using it06:40
yfriedyingjun: there's a v2 LBaaS. don't know if it's already available or not, but it uses a lot of the same object names06:40
yfriedyingjun: pools, members...06:40
yfriedyingjun: however the objects and the API are completely different. I'm concerned that we will have hard time differentiating between them, so I think we need to have this patch mark which objects/api it's targeting06:42
yfriedyingjun: like s/pool/pool-v106:42
yfriedyingjun: but I only have a rought idea of the LBaaS and the v2 differences06:42
yingjunyfried, there is a patch that adds a validator to check component API version https://review.openstack.org/#/c/181321/5/rally/benchmark/validation.py, maybe we can use it in the case?06:45
yfriedyingjun: IDK. I think we need an lbaas guy to take a look at the lbaas stuff before we merge them. I'd hate to have to build more wrappers to solve a problem that we can prevent now06:46
*** neeti has quit IRC06:48
yingjunyfried, make sense to me:), i’ll remove my +2 for now06:52
yfriedyingjun: do we have someone on the team who might know this?06:52
yfriedboris-42: ^06:53
yfriedkiran-r: ^ we are discussing your patch06:53
yingjunyfried, not sure, maybe boris-4206:53
*** neeti has joined #openstack-rally06:56
kiran-ryfried, yingjun shall I s/pool/pool-v1 and commit again??07:05
*** exploreshaifali has joined #openstack-rally07:08
*** e0ne has joined #openstack-rally07:08
yfriedkiran-r: it's not that simple. I don't know lbaas very well, just that there are 2 lbaas version and both use some shared terms but have different api.07:09
yfriedkiran-r: so I suggest that you make clear that you are writing to lbaasV107:11
kiran-ryfried, I am thinking in that front.07:11
yfriedkiran-r: so that when you will write the v2, you won't have clashing names.07:11
yfriedkiran-r: I just had an idea. boris-42 introduced something called plugin-namespace. maybe it would be useful here.07:12
*** e0ne has quit IRC07:12
kiran-ryfried: I am clueless..07:13
kiran-ryfried: What is the next step I should take??07:13
yfriedkiran-r: me too. you should ask him about that07:13
kiran-rboris-42: ping07:14
kiran-rboris-42 seems to be inactive in IRC.07:14
yfriedkiran-r: sorry for confusing you. the whole lbaas versions has me confused as well. that's why I want to be extra careful here07:14
kiran-ryfried: no problem07:14
*** anshul has joined #openstack-rally07:14
kiran-ryfried: Please help me close on this. It is taking soooo loong.07:14
yfriedkiran-r: sorry. It would help if we had a lbaas guru on this that could say if/how we should change everything07:15
*** neeti has quit IRC07:26
*** e0ne has joined #openstack-rally07:28
*** e0ne has quit IRC07:29
kiran-ryfried: ping07:30
yfriedkiran-r: ?07:30
kiran-ryfried: https://github.com/openstack/python-neutronclient/blob/master/neutronclient/v2_0/client.py#L946-L949 V2 pools https://github.com/openstack/python-neutronclient/blob/master/neutronclient/v2_0/client.py#L1065-L1067 v1 pool07:30
kiran-ryfried: v2 resources starts with lbaas_*07:31
kiran-ryfried: I think we can differentiate this way07:31
*** pbandzi has joined #openstack-rally07:31
yfriedkiran-r: ok. but you're gonna have to document this in commint messages and docstrings07:32
kiran-ryfried: https://github.com/openstack/python-neutronclient/blob/master/neutronclient/v2_0/client.py#L365-L38007:32
yfriedkiran-r: on second thought, that's too confusing07:33
yfriedkiran-r: let's go with v1 and v207:33
kiran-ryfried, v1 path is /lb/ while v2 is /lbaas/07:33
yfriedkiran-r: I see07:33
yfriedkiran-r: but rally ppl won't be diving into neutron code for that07:33
yfriedkiran-r: suffix all your terminology with _v107:34
kiran-ryfried: True. so it is better to rename s/pool/v1_pool07:34
yfriedkiran-r: or that :)07:34
kiran-ryfried: I totally understand your point.07:34
yfriedkiran-r: but make it explicit for the LoadBlancer scenario as well07:34
yfriedkiran-r: ie scenarios/neutron/loadblancer_107:35
yfriedkiran-r: ie scenarios/neutron/loadblancer_v107:35
kiran-ryfried: I get it. :)07:36
yfriedkiran-r: and in your docs and commig msgs mention the lb<->lbaas terminology of neutron07:36
yfriedkiran-r: you could also mention how crappy and annoying it is, but that is entirely up to you :)07:36
kiran-ryfried: :)07:38
kiran-ryfried: Would you +2 my code if I commit with those changes??07:38
kiran-ryfried: ;) ^07:38
yfriedkiran-r: I haven't reviewed it in details yet, because this was a big pain point for me, but yeah. in principal I would07:39
openstackgerritOleh Anufriiev proposed openstack/rally: [Fuel] add and remove nodes scenario  https://review.openstack.org/18127007:41
openstackgerritOleh Anufriiev proposed openstack/rally: [Fuel] Environments scenarios  https://review.openstack.org/18287307:41
kiran-ryfried: What if I name it lb_pool for v1 and lbaas_pool for v2?07:43
yfriedkiran-r: no!07:43
yfriedkiran-r: use v1 and v207:43
yfriedkiran-r: we can easily change that later07:43
kiran-ryfried: Reason, neutron differentiates it by lb and lbaas.. :)07:44
yfriedkiran-r: think about the scenario name: lb_loadblancer and lbaas_loadbalancer?07:44
yfriedkiran-r: and look how we are still discussing it because it's unclear07:44
kiran-ryfried: you are right, lb_loadblancer and lbaas_loadbalancer sounds ugly.07:44
*** karimb has joined #openstack-rally07:45
*** neeti has joined #openstack-rally07:48
*** arxcruz has joined #openstack-rally07:49
*** amalinow has joined #openstack-rally07:56
*** fhubik has joined #openstack-rally08:09
openstackgerritmaplelabs proposed openstack/rally: Add Neutron Loadbalancer create and list pool  https://review.openstack.org/18268508:09
*** yingjun has quit IRC08:15
*** yingjun has joined #openstack-rally08:19
*** mahito has quit IRC08:34
*** mahito has joined #openstack-rally08:35
*** neeti_ has joined #openstack-rally08:36
*** neeti has quit IRC08:39
*** cdent has joined #openstack-rally08:40
*** adiantum has joined #openstack-rally08:45
*** exploreshaifali has quit IRC08:48
openstackgerritMikhail Dubov proposed openstack/rally: Implementation of 'rally task abort' command  https://review.openstack.org/16163608:51
*** yingjun has quit IRC08:54
*** amaretskiy has joined #openstack-rally08:57
openstackgerritmaplelabs proposed openstack/rally: Add Neutron Loadbalancer (LBaaS v1) create and list pool  https://review.openstack.org/18268509:06
*** nkhare has quit IRC09:07
*** rook has quit IRC09:07
*** rook has joined #openstack-rally09:08
*** igormarnat is now known as imarnat09:08
*** tosky has joined #openstack-rally09:13
*** yfried is now known as yfried|afk09:35
*** yingjun has joined #openstack-rally09:42
*** nkhare has joined #openstack-rally09:46
*** kiran-r is now known as kiran-r|afk09:46
*** kiran-r|afk is now known as kiran-r09:46
*** e0ne has joined #openstack-rally09:47
*** tosky has quit IRC09:51
*** yingjun has quit IRC09:53
*** yingjun has joined #openstack-rally09:53
*** e0ne is now known as e0ne_09:54
*** yfried|afk is now known as yfried09:55
*** yingjun has quit IRC09:58
*** tosky has joined #openstack-rally09:58
*** e0ne_ has quit IRC10:00
*** e0ne has joined #openstack-rally10:01
*** mahito has quit IRC10:02
*** BitSmith has joined #openstack-rally10:02
openstackgerritIgor Degtiarov proposed openstack/rally: [Ceilometer] Add  scenario for events and traits  https://review.openstack.org/18051410:03
*** BitSmith has quit IRC10:13
*** yfried is now known as yfried|afk10:18
*** yfried|afk is now known as yfried10:19
*** exploreshaifali has joined #openstack-rally10:25
*** redixin has joined #openstack-rally10:27
*** yfried is now known as yfried|afk10:31
*** e0ne is now known as e0ne_10:33
*** e0ne_ is now known as e0ne10:34
*** imarnat is now known as igormarnat10:36
*** yfried|afk is now known as yfried10:36
*** igormarnat is now known as imarnat10:37
openstackgerritMikhail Dubov proposed openstack/rally: Implementation of 'rally task abort' command  https://review.openstack.org/16163610:41
openstackgerritMikhail Dubov proposed openstack/rally: Implementation of 'rally task abort' command  https://review.openstack.org/16163610:43
*** pboldin has joined #openstack-rally10:48
*** nkhare_ has joined #openstack-rally10:52
*** yfried is now known as yfried|afk10:53
*** nkhare has quit IRC10:55
*** imarnat is now known as igormarnat10:55
*** igormarnat is now known as imarnat10:56
*** nkhare_ has quit IRC10:59
openstackgerritValeriy Ponomaryov proposed openstack/rally: Add base benchmark for Manila list shares operation  https://review.openstack.org/19058010:59
openstackgerritValeriy Ponomaryov proposed openstack/rally: Add base benchmark for Manila list shares operation  https://review.openstack.org/18455311:00
openstackgerritValeriy Ponomaryov proposed openstack/rally: Add base benchmark for Manila list shares operation  https://review.openstack.org/18455311:01
*** fhubik is now known as fhubik_afk11:06
*** aix has quit IRC11:07
*** yfried|afk is now known as yfried11:07
*** rdas has quit IRC11:09
*** nkhare_ has joined #openstack-rally11:13
*** openstackgerrit has quit IRC11:13
*** openstackgerrit has joined #openstack-rally11:14
pboldinyfried: hi there11:15
yfriedpboldin: hi11:15
pboldinyfried: what do you think about the commit message here? https://review.openstack.org/182685/11:16
pboldinyfried: I really thing that we should forget about the v2 at the moment and only mention that it is implementatioon of v111:18
pboldinyfried: like Add Neutron LoadBalancer (LBaaSv1) create and list pool11:18
yfriedpboldin: reviewing it now.11:19
pboldinyfried: well, changeset was just ok before it started to mention that there is v2 and before renaming11:20
yfriedpboldin: unless you know differently, I am worried that if we don't use "v1" explicitly, we'll run into problems with the v211:20
yfriedpboldin: it was actually my request11:20
pboldinyfried: we should not, because as Alex points out, the class is named accordingly11:20
yfriedpboldin: I agree with that11:20
yfriedpboldin: if the class is "v1" then it's obvious the methods are v1 as well11:21
yfriedpboldin: but that's not true for utils11:21
openstackgerritmaplelabs proposed openstack/rally: Add Neutron Loadbalancer(v1) create and list pool  https://review.openstack.org/18268511:21
*** e0ne is now known as e0ne_11:21
pboldinyfried: yep. so, I think that '_v1_' is only confusing at the moment.11:21
yfriedpboldin: I'm commenting now. let me post it and see what you thing11:21
yfriedthink11:21
kiran-rpboldin, yfried, ameretskiy: I just pushed a new patchset with Alex suggested changes.11:24
pboldinkiran-r: please, dont rush11:24
yfriedkiran-r: I'm just reviewing the old one.11:24
kiran-rpboldin, yfried, ameretskiy: I am sorry11:24
kiran-rpboldin, yfried, ameretskiy: Pardon me.11:25
*** e0ne_ has quit IRC11:32
yfriedkiran-r: posted comments. pboldin please take a look as well.11:32
*** adiantum has quit IRC11:33
*** e0ne has joined #openstack-rally11:36
openstackgerritMikhail Dubov proposed openstack/rally: Implementation of 'rally task abort' command  https://review.openstack.org/16163611:49
*** imarnat is now known as igormarnat11:52
*** yfried is now known as yfried|afk11:53
*** pboldin has quit IRC12:00
*** redixin has quit IRC12:03
*** tfreger1 has joined #openstack-rally12:05
*** yfried|afk is now known as yfried12:05
*** tfreger has quit IRC12:07
*** aix has joined #openstack-rally12:09
*** fhubik_afk is now known as fhubik12:13
*** igormarnat is now known as imarnat12:16
*** rdas has joined #openstack-rally12:38
*** fhubik is now known as fhubik_afk12:39
*** neeti_ has quit IRC12:40
*** fhubik_afk is now known as fhubik12:40
*** nihilifer has quit IRC12:43
*** tfreger1 has quit IRC12:44
*** yfried is now known as yfried|afk12:48
*** yfried|afk is now known as yfried12:54
*** tfreger has joined #openstack-rally12:59
*** fhubik is now known as fhubik_afk13:00
*** exploreshaifali has quit IRC13:00
*** imarnat is now known as igormarnat13:01
*** fhubik_afk is now known as fhubik13:01
*** nkhare_ has quit IRC13:03
*** mahito has joined #openstack-rally13:04
*** igormarnat is now known as imarnat13:05
*** mahito has quit IRC13:09
*** yfried has quit IRC13:09
*** tfreger has quit IRC13:11
openstackgerritRoman Vasilets proposed openstack/rally: Remove deprecated code  https://review.openstack.org/18807713:15
*** fhubik is now known as fhubik_afk13:23
*** stpierre has joined #openstack-rally13:25
openstackgerritmaplelabs proposed openstack/rally: Add Neutron Loadbalancer(v1) create and list pool  https://review.openstack.org/18268513:37
openstackgerritmaplelabs proposed openstack/rally: Add Neutron Loadbalancer(v1) create and list pool  https://review.openstack.org/18268513:40
*** pbandzi has quit IRC13:53
*** arxcruz has quit IRC13:57
*** exploreshaifali has joined #openstack-rally14:04
*** imarnat is now known as igormarnat14:12
*** psd has joined #openstack-rally14:17
*** igormarnat is now known as imarnat14:19
*** imarnat is now known as igormarnat14:20
*** exploreshaifali has quit IRC14:20
*** fhubik_afk is now known as fhubik14:21
*** igormarnat is now known as imarnat14:22
*** jaypipes has quit IRC14:26
*** fhubik is now known as fhubik_afk14:34
*** e0ne is now known as e0ne_14:34
openstackgerritValeriy Ponomaryov proposed openstack/rally: Add scenario for creation and deletion of Manila shares  https://review.openstack.org/19066714:38
*** kiran-r has quit IRC14:44
*** e0ne_ has quit IRC14:45
*** imarnat is now known as igormarnat14:52
*** praveens has joined #openstack-rally14:53
*** fhubik_afk is now known as fhubik14:53
*** rdas has quit IRC14:55
*** igormarnat is now known as imarnat14:56
*** imarnat is now known as igormarnat14:57
openstackgerritValeriy Ponomaryov proposed openstack/rally: Add scenario for creation and deletion of Manila shares  https://review.openstack.org/19066714:57
openstackgerritValeriy Ponomaryov proposed openstack/rally: Add context for Manila quotas  https://review.openstack.org/18848414:57
*** exploreshaifali has joined #openstack-rally15:03
*** pboldin has joined #openstack-rally15:05
*** igormarnat is now known as imarnat15:05
*** fhubik is now known as fhubik_afk15:07
*** imarnat is now known as igormarnat15:17
*** BitSmith has joined #openstack-rally15:24
*** agarciam has joined #openstack-rally15:24
*** fhubik_afk is now known as fhubik15:24
*** igormarnat is now known as imarnat15:25
pboldinhttps://review.openstack.org/190379/ < review pls15:25
*** imarnat is now known as igormarnat15:26
*** adiantum has joined #openstack-rally15:26
*** arxcruz has joined #openstack-rally15:29
*** anshul has quit IRC15:29
*** coolsvap is now known as coolsvap|afk15:31
*** praveens1 has joined #openstack-rally15:31
*** praveens has quit IRC15:32
*** igormarnat is now known as imarnat15:33
*** coolsvap|afk is now known as coolsvap15:42
*** exploreshaifali has quit IRC15:48
*** amalinow|2 has joined #openstack-rally15:51
*** yeungp has joined #openstack-rally15:51
*** fhubik has quit IRC15:52
*** imarnat is now known as igormarnat15:53
*** amalinow has quit IRC15:54
*** igormarnat is now known as imarnat15:56
*** agarciam has quit IRC15:57
*** praveens has joined #openstack-rally15:57
*** coolsvap is now known as coolsvap|afk15:58
*** praveens1 has quit IRC15:59
*** PrashantS has joined #openstack-rally15:59
*** praveens has quit IRC16:01
*** imarnat is now known as igormarnat16:02
*** igormarnat is now known as imarnat16:05
*** praveens has joined #openstack-rally16:06
*** BitSmith has quit IRC16:10
*** kiran-r has joined #openstack-rally16:10
*** imarnat is now known as igormarnat16:15
*** anshul has joined #openstack-rally16:20
*** kiran-r has quit IRC16:22
*** amaretskiy has quit IRC16:25
*** e0ne has joined #openstack-rally16:27
*** amalinow|2 has quit IRC16:27
*** amalinow|2 has joined #openstack-rally16:27
openstackgerritChris St. Pierre proposed openstack/rally: Overhaul ceilometer utils unit tests  https://review.openstack.org/19071216:29
*** igormarnat is now known as imarnat16:30
*** imarnat is now known as igormarnat16:31
*** igormarnat is now known as imarnat16:33
*** jaypipes has joined #openstack-rally16:35
*** imarnat is now known as igormarnat16:39
*** praveens has left #openstack-rally16:41
*** anshul has quit IRC16:42
*** igormarnat is now known as imarnat16:48
*** exploreshaifali has joined #openstack-rally16:50
stpierresweet, gate looks broken16:56
*** pboldin has quit IRC16:58
openstackgerritJohn Wu proposed openstack/rally: [Swift] Add additional Swift scenarios  https://review.openstack.org/18579317:04
openstackgerritJohn Wu proposed openstack/rally: [Swift] Add objects context class  https://review.openstack.org/17957817:04
*** philibar has joined #openstack-rally17:07
philibarhey boris-42, the issue we were seeing last time was actually an error somewhere in our config, hence why it would go grab the other config file instead, thanks for the support!17:08
*** anshul has joined #openstack-rally17:08
*** e0ne has quit IRC17:09
openstackgerritValeriy Ponomaryov proposed openstack/rally: Add scenario for creation and deletion of Manila share networks  https://review.openstack.org/19072417:10
*** pboldin has joined #openstack-rally17:12
*** imarnat is now known as igormarnat17:13
*** amalinow|2 has quit IRC17:19
*** psd has quit IRC17:23
*** anshul has quit IRC17:24
*** igormarnat is now known as imarnat17:34
*** tosky has quit IRC17:34
*** anshul has joined #openstack-rally17:36
openstackgerritValeriy Ponomaryov proposed openstack/rally: Add scenario for creation and listing of Manila share networks  https://review.openstack.org/19073717:46
*** tosky has joined #openstack-rally17:56
*** imarnat is now known as igormarnat18:03
*** karimb has quit IRC18:05
*** karimb has joined #openstack-rally18:06
*** igormarnat is now known as imarnat18:10
*** imarnat is now known as igormarnat18:11
*** igormarnat is now known as imarnat18:17
*** exploreshaifali has quit IRC18:20
*** cdent has quit IRC18:20
*** gema has quit IRC18:20
*** imarnat is now known as igormarnat18:22
*** igormarnat is now known as imarnat18:24
*** imarnat is now known as igormarnat18:28
*** igormarnat is now known as imarnat18:34
boris-42philibar: you are welocme18:36
*** yeungp has quit IRC18:38
stpierreboris-42: any idea what might be awry with gate? gate-rally-dsvm-neutron-rally is reliably failing (and taking a long-ass time to do so); the only errors i can find in the logs are, e.g.: http://logs.openstack.org/85/182685/33/check/gate-rally-dsvm-neutron-rally/8925927/logs/devstack-gate-setup-workspace-new.txt18:39
boris-42stpierre: I saw it today18:40
boris-42stpierre: something got terrible broken18:40
stpierrecool18:40
stpierreis there anything i can chase down to try to fix it? or are smarter and more capable people than me already hard at work on it?18:42
boris-42stpierre: I am in process of relocation18:44
boris-42stpierre: so a bit busy=)18:44
boris-42stpierre: so at this momnet of time nobody is working18:44
boris-42stpierre: I believe that something bad was merged in devstack or neutron18:44
stpierreokay, i'll try to dig in18:45
boris-42stpierre: so you can try to install devstack with neutron18:45
boris-42stpierre: and try to run it18:45
boris-42stpierre: as well we need critical bug for this18:45
stpierrei can try, but devstack and i don't usually get along18:45
boris-42stpierre: because something is very bad=(18:45
stpierrethat i can definitely do18:45
stpierreraise the bug against rally, or...?18:45
boris-42stpierre: ya first in rally18:46
*** aix has quit IRC18:49
*** e0ne has joined #openstack-rally18:51
*** e0ne is now known as e0ne_18:51
*** jaypipes has quit IRC18:52
*** e0ne_ is now known as e0ne18:53
*** e0ne is now known as e0ne_19:00
*** exploreshaifali has joined #openstack-rally19:05
*** karimb is now known as karim|dinner19:08
*** karim|dinner is now known as karimb|dinner19:08
*** imarnat is now known as igormarnat19:09
*** pboldin has quit IRC19:20
*** anshul has quit IRC19:20
boris-42stpierre: do not reduce timeout.19:22
boris-42stpierre: let's make a patch set that removes all neutron scenarios19:22
boris-42stpierre: and try to run it in gates19:22
stpierreok19:23
boris-42stpierre: I mean you will get result in 20 minutes not in 2hrs=)19:25
stpierrethat's better19:25
openstackgerritChris St. Pierre proposed openstack/rally: DO NOT MERGE: remove neutron jobs  https://review.openstack.org/19077119:26
boris-42stpierre: just left single test19:26
stpierreoh, it needs one test?19:26
boris-42stpierre: this won't work19:26
boris-42stpierre: yep19:26
boris-42stpierre: Authenticate.keystone19:26
boris-42stpierre: 1 iteration19:26
boris-42stpierre: with 1 user and 1 tenant19:26
boris-42stpierre: that will be very fast19:26
boris-42stpierre: ya debugging in gates party hard19:27
openstackgerritChris St. Pierre proposed openstack/rally: DO NOT MERGE: remove neutron jobs  https://review.openstack.org/19077119:27
boris-42stpierre: btw this may help https://review.openstack.org/#/c/189463/619:28
boris-42stpierre: I just recheked it19:29
*** gema has joined #openstack-rally19:30
boris-42stpierre: btw after fixing gates19:33
*** e0ne_ is now known as e0ne19:35
*** anshul has joined #openstack-rally19:38
*** mwagner_afk has quit IRC19:39
*** BitSmith has joined #openstack-rally19:40
*** pboldin has joined #openstack-rally19:44
*** yeungp has joined #openstack-rally19:44
*** pboldin has quit IRC19:48
*** PrashantS has quit IRC19:53
*** PrashantS has joined #openstack-rally19:54
*** PrashantS has quit IRC19:58
*** pboldin has joined #openstack-rally20:03
boris-42stpierre: gate-rally-dsvm-neutron-rally: SUCCESS20:10
boris-42stpierre: LOL20:10
stpierre...the hell20:10
stpierregod dammit20:10
boris-42stpierre: we need to run Neutron20:10
boris-42stpierre: benchmark20:10
boris-42stpierre: that is failing20:10
boris-42stpierre: so gates are not totally broken LOL20:10
stpierreyeah20:10
stpierreactually, this might be enough, if the devstack logs exist20:11
stpierrei'll get another build going, but this may give me the info i need20:11
boris-42stpierre: just create one more patch20:11
boris-42stpierre: with another change-id20:11
boris-42stpierre: with neutron benchmark20:12
openstackgerritChris St. Pierre proposed openstack/rally: DO NOT MERGE: only one neutron task  https://review.openstack.org/19079620:14
*** philibar has quit IRC20:22
*** itzikb has joined #openstack-rally20:24
itzikbHi, When running boot-runcommand-delete with times:300 I get errors No more IP addresses available on network 23e5ed3b-1a83-4da2-bb1c-750844156a1520:29
itzikbSeems like ports are not deleted20:30
pboldinitzikb: what version do you use?20:30
itzikbpboldin: 0.0.520:31
pboldinitzikb: hm, there were a patch that made sure we remove them. nova-net or neutron?20:31
itzikbneutron20:31
pboldinitzikb: well, seems like you will have to remove them by hand. btw, were there any command script values? this could lead to unfreeed ports20:32
itzikbpboldin: I used the instance_dd_test.sh script20:34
pboldinitzikb: well, then I want you to reproduce the error while gathering a debug info. this seems like a bug20:34
*** itzikb has quit IRC20:35
openstackgerritOleh Anufriiev proposed openstack/rally: [Fuel] add and remove nodes scenario  https://review.openstack.org/18127020:35
*** itzikb has joined #openstack-rally20:39
boris-42itzikb: hey there20:40
boris-42itzikb: so this may happen20:40
itzikbboris-42: Sorry have connecion problems20:40
boris-42itzikb: because floating ip addresses are not cleaned up immediately20:40
boris-42itzikb: as far as I know..20:40
boris-42itzikb: btw are you using latest rally?20:41
itzikbboris-42: yes20:41
itzikbGot it fresh from git today20:41
itzikbboris-42: so I can run just 250 times or so ?20:42
stpierrei hacked up a context that cleans up floating IPs. i'm guessing that's the wrong solution, though.20:43
boris-42stpierre: itzikb https://github.com/openstack/rally/blob/master/rally/plugins/openstack/scenarios/vm/vmtasks.py#L103-L10520:45
boris-42stpierre: itzikb ^ they are cleaned in scenario20:45
boris-42itzikb are there some warrning/errors?20:45
itzikbboris-42: where in rally or neutron?20:46
stpierreboris-42: at least in nova-net, that doesn't actually reap the IPs for reuse by another VM.20:47
boris-42itzikb: rally20:47
*** PrashantS has joined #openstack-rally20:47
boris-42stpierre: ya because there is some kind of periodic job20:47
boris-42stpierre: that cleans them20:48
boris-42stpierre: not sure about Neutron, but I think it's the same situtation20:48
boris-42itzikb: ^20:48
boris-42itzikb: so if there is no errors you will need to do some magic to get more floating IPs20:48
itzikbboris-42: I don't know why , they have to be freed , I run 40 vms a time so it shouldn't be a problem20:49
itzikbI have >200 floating ips20:50
boris-42itzikb: I believe they are not cleaned up immediately20:52
boris-42itzikb: e.g. we send request remove floating ip from VM, but this floating IP is not immediately available for reassign20:53
openstackgerritChris St. Pierre proposed openstack/rally: DO NOT MERGE: only one neutron task  https://review.openstack.org/19079620:54
boris-42itzikb: let me ask neutron guys20:54
*** e0ne has quit IRC20:54
itzikbboris-42: I think the problem is with the internal ports and not the floating ips20:55
itzikbboris-42: While running I have ~10 floating ips used but the number of internal network ports are growing20:56
boris-42itzikb: seems quite bad20:56
boris-42itzikb: let's try to debug this stuff20:57
boris-42itzikb: could you run rally task in debug mode20:57
boris-42itzikb: like just vmtask 1 iteration20:57
boris-42itzikb: rally -vd task start ...20:57
boris-42itzikb:  so we will see all requests to neutron20:57
*** itzikb has quit IRC20:57
boris-42stpierre: oh you found it https://github.com/openstack/neutron/commit/9d649129ca762f406846190d31997397f0a0c53b ?)21:00
*** itzikb has joined #openstack-rally21:00
stpierre"found it" is probably overstating things a bit21:00
boris-42stpierre: so we have rally job in neutron21:00
boris-42stpierre: you can try to revert this and check21:00
stpierrebut that's the only commit that actually does something that was committed between the last known good build and the first known bad build21:00
stpierreoh, sweet21:00
boris-42stpierre: actually21:02
openstackgerritChris St. Pierre proposed openstack/rally: DO NOT MERGE: only one neutron task  https://review.openstack.org/19079621:02
boris-42stpierre: https://review.openstack.org/#/c/176711/21:02
boris-42stpierre: seems it works21:02
boris-42stpierre: e.g. when they merge this everything worked21:03
stpierredang21:03
boris-42itzikb: ping21:03
itzikbboris-42: hey again21:04
boris-42itzikb: so did you receive my messages?21:04
boris-42itzikb: regarding to run rally in debug mode21:04
boris-42itzikb: just one iteration of vmtask21:04
itzikbboris-42: no but I have the logs21:04
boris-42stpierre: take a look here https://review.openstack.org/#/c/189463/21:05
boris-42stpierre: seems like there is problem with requriments file21:06
stpierrei get a 503 from that, so yay gerrit21:06
stpierre[16:05:54] <fungi> #status notice Gerrit has been restarted to terminate a persistent looping third-party CI bot21:06
itzikbboris-42: ok I'm running it now21:07
stpierrei'm not sure what i'm looking at on that review21:07
-openstackstatus- NOTICE: Gerrit has been restarted to terminate a persistent looping third-party CI bot21:07
boris-42stpierre: now it's ok21:08
boris-42stpierre: https://review.openstack.org/#/c/189463/21:08
boris-42stpierre: so requirements are changed21:08
boris-42stpierre: seems like that is causing bugs21:09
stpierrewhy do you think that's causing it?21:09
boris-42stpierre: because I just recheked21:09
boris-42stpierre: that patch and it works21:09
boris-42stpierre: ah no21:09
boris-42stpierre: it's old jenkins result21:09
stpierreyeah, zuul shows that rally-gate-dvsm-neutron-rally is still going on that patchset, which is consistent with it failing21:10
boris-42stpierre: ya my fault21:13
*** anshul has quit IRC21:17
itzikbboris-42: What do you want to see in the debug mode?21:21
boris-42itzikb: whole logs21:22
boris-42itzikb: paste them please here http://paste.openstack.org/21:22
*** BitSmith has quit IRC21:23
itzikbboris-42: Isn't the paste for short ones? It doesn't have attach a file21:24
boris-42itzikb: so you can create gist21:25
boris-42https://gist.github.com/21:25
boris-42itzikb: ^ it doesn't have limitations21:25
stpierreokay, whatever's happening here is decidedly touchy. both of my attempts to induce a failure with just a single neutron task have passed gate unexpectedly, so it must have something to do with load or concurrency or something21:29
stpierrei'm taking off in ~10 minutes, but everything i know is in the ticket21:29
stpierreso hopefully someone else can look at it21:29
boris-42stpierre: thanks for working on this21:30
openstackgerritBoris Pavlovic proposed openstack/rally: DO NOT MERGE: only one neutron task  https://review.openstack.org/19079621:36
itzikbboris-42: https://drive.google.com/file/d/0B_sJ3nkK4dLEcHc1dVc2Mm4wbW8/view?usp=sharing21:37
boris-42itzikb: please next time send full log21:40
boris-42itzikb: including the line "rally task start..."21:40
itzikbboris-42: ok21:42
boris-42itzikb: something is strange21:42
boris-42itzikb: I see tons of requests to delete various ports21:42
boris-42REQ: curl -i http://10.35.160.29:9696//v2.0/ports/3dbb6aa0-25de-4ae9-b69b-30b7b0fb833e.json -X DELETE -H "User-Agent: python-neutronclient" -H "X-Auth-Token: XXXX"21:43
boris-42itzikb: doesn't seem ok ><21:43
boris-42шitzikb 2015-06-12 00:29:42.192 991 INFO rally.benchmark.runner [-] Task 6a376e0e-acce-4431-afda-ab9ea5540c02 | ITER: 296 END: Error GetResourceErrorStatus: Resource <Server: rally_volume_XRVqWIVw6Z> has ERROR status.21:45
boris-42itzikb: doesn't seem like a single iteration benchamrk log21:45
boris-42itzikb: btw seems like vms are not starting21:45
boris-42itzikb: could you send logs only of 1 single iteration benchmakr21:46
boris-42itzikb: without any other logs21:46
boris-42itzikb: that will help21:46
itzikbboris-42: WHen you say one iteration what do you mean - what values for times and concurrency?21:48
boris-42itzikb: times:1 concurrency: 121:48
boris-42itzikb: and single benchmark inside the task21:48
boris-42itzikb: and logs only of that run21:49
boris-42itzikb: I don't want logs of 300 vms ...21:49
boris-42itzikb: btw VM becomes in failure state21:49
*** mpopow has joined #openstack-rally21:49
boris-42itzikb: I am not sure that this is because of not enough floating ips21:50
boris-42itzikb: it looks more like not enough fixed ips in network21:50
*** exploreshaifali has quit IRC21:50
boris-42itzikb: but can't say antyhing more without logs of nova21:50
*** mpopow has quit IRC21:50
*** mpopow has joined #openstack-rally22:00
itzikbboris-42: Hope it's better now https://drive.google.com/file/d/0B_sJ3nkK4dLEcHc1dVc2Mm4wbW8/view?usp=sharing22:02
itzikbthe command is basically sudo rally -vd --log-file mydebug.log task start boot-runcommand-delete.yaml22:02
boris-42itzikb: hm why do you need sudo ouch??22:03
boris-42itzikb: wrong link22:04
boris-42itzikb: seems like old one debug log22:04
boris-42itzikb: 2015-06-12 00:29:11.802 992 INFO rally.benchmark.runner [-] Task 6a376e0e-acce-4431-afda-ab9ea5540c02 | ITER: 276 END: Error IpAddressGenerationFailureClient: No more IP addresses available on network 77d5f606-b463-472f-8774-c394c0842cc2.22:04
boris-4222:04
boris-42itzikb: ^ there can't be ITER 27622:04
*** mpopow has quit IRC22:04
itzikbboris-42: https://drive.google.com/file/d/0B_sJ3nkK4dLEaXJ0QVU3RTBoV0U/view?usp=sharing22:05
*** dpaterson has joined #openstack-rally22:06
*** PrashantS has quit IRC22:06
dpatersonboris-42: Mr. Boris, please review my tempest cli spec at your leasure: https://review.openstack.org/#/c/138785/22:07
*** PrashantS has joined #openstack-rally22:07
boris-42dpaterson: heh that is taking a lot of time....22:08
boris-42dpaterson: neverending spec22:08
dpatersonno shit22:08
boris-42dpaterson: =))22:09
boris-42itzikb: this one looks better22:10
dpatersonboris-42: It's key, at least imo, that the interface is in line with rally/tempest integration22:10
dpatersonWhy I am asking you take a looksee22:10
boris-42dpaterson: hm but why you are coding it if they don't want?)22:10
boris-42dpaterson: maybe it's better to improve rally verify =)22:10
boris-42dpaterson: sure looking at it22:11
dpatersonboris-42: CLI was one of the main objectives discussed at summit22:11
*** PrashantS has quit IRC22:11
dpatersonHoping to have more cycles for rally this release as well.22:11
boris-42dpaterson: +122:14
boris-42dpaterson: can't do +2 in tempest sorry=022:14
boris-42itzikb: ya this file is better22:14
boris-42itzikb: let me take a look at it22:14
dpatersonboris-42: thanks and np.22:14
boris-42itzikb: the LOG is very very strange22:25
boris-42itzikb: take a look at this part http://paste.openstack.org/show/284621/22:25
boris-42itzikb: so we are executing SSH command, after that we are removing FloatingIP22:26
boris-42itzikb: but not deleting VM..22:26
boris-42itzikb: I can't understand how that can happen according to the cod tat we have in master...22:27
boris-42itzikb: and I don22:32
boris-42itzikb: I don't see logs of VM creation=(22:32
itzikbboris-42: strange indeed..22:34
*** oanufriev has quit IRC22:37
boris-42itzikb: all logs except nova..22:40
itzikbboris-42: Did you see the errors regarding security group?22:40
boris-42itzikb: so no worries about that22:41
boris-42itzikb: it's known issue and i just keep that logs to remember to fix that part22:42
itzikbtoo late for me to worry ..22:42
boris-42itzikb: so they are cleaned during generic cleanup that affects resources of context (so it tries to delete already delete sec group)22:42
boris-42itzikb: I mean that one is not a bug that affects anything except logs22:43
itzikbmakes sense22:43
boris-42itzikb: but I am worried about why I don't see logs from nova22:43
itzikbboris-42: When you run it do you see the logs?22:44
boris-42itzikb: run boot-and-delete22:45
boris-42itzikb: and yep I see such stuff22:45
boris-42REQ: curl -g -i 'http://172.16.5.129:8774/v2/6521e53effa746b6985b784cb361b381/servers/fe170fb7-1426-4d34-8389-02750c464cf7' -X GET -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Project-Id: ctx_rally_581fa3a0-09c1-4483-871e-b2b62283a804_tenant_0" -H "X-Auth-Token: {SHA1}8f4c0da92425f7352d1dd107bf40988f804dafd0"22:45
boris-42itzikb: same with boot_runcommand_delete22:47
boris-42itzikb: I see logs from python nova client22:47
boris-42REQ: curl -g -i 'http://172.16.5.129:8774/v2/67701527f4c74d9aa2447666bcb33af5/servers/8573d911-7973-435c-9703-0f91fbd225f4' -X GET -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Project-Id: ctx_rally_d3e263eb-ffa0-4184-a80f-227a83dd3219_tenant_0" -H "X-Auth-Token: {SHA1}db89fc1cfca5d001b1fc5f06cf62f109345fa2b1"22:47
itzikbboris-42: good night22:58
itzikbboris-42: Hope we'll solve it22:58
boris-42itzikb: see you22:59
boris-42itzikb: btw what is your time zone?22:59
*** karimb|dinner has quit IRC22:59
*** itzikb has quit IRC22:59
*** adiantum has quit IRC23:41
*** adiantum has joined #openstack-rally23:42
openstackgerritBoris Pavlovic proposed openstack/rally: DO NOT MERGE: only one neutron task  https://review.openstack.org/19079623:46
*** tosky has quit IRC23:47

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!