Tuesday, 2015-04-21

*** MVenesio has joined #openstack-nova00:02
vilobhmm1jaypipies : ping00:03
vilobhmm1jaypipes : ^^00:03
*** annegentle has quit IRC00:04
*** Murali has quit IRC00:06
vilobhmm1the whole reason for introducing the start() and leave() interface was that in the tooz driver that I have introduced I use start() for start/initialization and join() for joining the group for clear speration of functionality you can see here  https://review.openstack.org/#/c/172502/4/nova/servicegroup/drivers/tz.py . In your feedback you mentioned that you dont want to introduce few more interfaces to nova/servicegroup/00:06
vilobhmm1jaypipes : ^^00:06
*** melwitt has joined #openstack-nova00:10
*** otter768 has joined #openstack-nova00:11
*** patrickeast has quit IRC00:14
*** achanda has joined #openstack-nova00:16
*** achanda_ has quit IRC00:19
*** achanda has quit IRC00:21
*** tsekiyam_ has joined #openstack-nova00:22
*** openstackgerrit has quit IRC00:22
*** openstackgerrit has joined #openstack-nova00:23
*** tsekiya__ has joined #openstack-nova00:24
*** tsekiyam_ has quit IRC00:24
openstackgerritmelanie witt proposed openstack/python-novaclient: Don't lookup service url when bypass_url is given  https://review.openstack.org/17562200:24
*** tsekiya__ has quit IRC00:24
*** tsekiyama has quit IRC00:26
*** sdake_ has joined #openstack-nova00:31
*** claudiub has quit IRC00:33
*** arif-ali has joined #openstack-nova00:33
*** openstack has joined #openstack-nova00:36
*** Administrator_ has joined #openstack-nova00:37
*** Marga_ has quit IRC00:38
*** eliqiao has joined #openstack-nova00:39
*** shihanzhang has quit IRC00:44
openstackgerritzhangtralon proposed openstack/nova: remove the CONF.allow_migrate_to_same_host  https://review.openstack.org/11860400:48
*** penick has joined #openstack-nova00:48
*** shaohe_feng1 has joined #openstack-nova00:49
*** promulo__ has joined #openstack-nova00:52
*** emagana has quit IRC00:54
*** promulo_ has quit IRC00:55
alex_xucfriesen: sorry, just wake up, I saw the patch already merged, it's fine, let's improve it later :)00:59
*** browne has quit IRC00:59
*** Marga_ has joined #openstack-nova01:00
*** zzzeek has quit IRC01:01
openstackgerritEli Qiao proposed openstack/nova: API: remove admin require from compute_node_get_all_by_* from db layer  https://review.openstack.org/17533401:02
*** shaohe_feng1 has quit IRC01:03
*** dboik has joined #openstack-nova01:05
openstackgerritEli Qiao proposed openstack/nova: API: remove admin require from compute_node_get_all_by_* from db layer  https://review.openstack.org/17533401:06
*** dboik_ has joined #openstack-nova01:06
openstackgerritEli Qiao proposed openstack/nova: Remove db layer hard-code permission checks for v2.1 cells  https://review.openstack.org/15035001:06
*** shaohe_robot has quit IRC01:07
*** dsanders has quit IRC01:07
*** igordcard has quit IRC01:08
*** joefides has joined #openstack-nova01:09
*** dboik has quit IRC01:10
*** park_heijlong has joined #openstack-nova01:10
*** joefides_ has joined #openstack-nova01:10
*** Nic1 has quit IRC01:12
*** joefides has quit IRC01:13
*** MVenesio has quit IRC01:19
*** zhenguo has joined #openstack-nova01:21
*** fawadkhaliq has joined #openstack-nova01:25
*** popw has joined #openstack-nova01:25
*** fawadkhaliq has quit IRC01:29
openstackgerritEli Qiao proposed openstack/nova: Neutron: Check port binding status  https://review.openstack.org/15611201:30
*** mwagner_lap has joined #openstack-nova01:37
*** erkules_ has joined #openstack-nova01:39
*** erkules has quit IRC01:41
*** browne has joined #openstack-nova01:42
*** mmedvede has quit IRC01:44
*** jecarey has joined #openstack-nova01:45
*** vilobhmm1 has quit IRC01:45
*** mmedvede has joined #openstack-nova01:48
*** melwitt has quit IRC01:51
*** baoli has quit IRC01:52
*** baoli has joined #openstack-nova01:52
*** thedodd has quit IRC01:53
*** bkopilov has quit IRC01:53
*** unicell has quit IRC01:59
*** hightall has joined #openstack-nova02:02
*** ijw has quit IRC02:02
*** VW_ has joined #openstack-nova02:05
eliqiao1alex_xu: hi there?02:10
alex_xueliqiao1: yea there02:10
eliqiao1alex_xu: a question about remove admin policy check from db layer.02:11
alex_xueliqiao1: yea, sure02:11
eliqiao1alex_xu: for those db api method, there is no any rest api calling, how to deal with them , directly remove them?02:12
eliqiao1alex_xu: they are all called by nova code02:12
eliqiao1alex_xu: I remember that we have seen those kinds of cases, can you recall them?02:12
alex_xueliqiao1: yea, we can remove them directly02:12
eliqiao1alex_xu: any test cases required?02:13
alex_xueliqiao1: this one https://review.openstack.org/#/c/150349/02:13
alex_xueliqiao1: not test needn't02:13
eliqiao1alex_xu: cool, thanks02:13
alex_xueliqiao1: np, :)02:14
*** liusheng has quit IRC02:16
*** rfolco has quit IRC02:31
*** achanda has joined #openstack-nova02:35
*** harlowja is now known as harlowja_away02:35
*** VW_ has quit IRC02:36
*** zhangtralon has joined #openstack-nova02:36
*** harlowja_away is now known as harlowja02:37
*** fawadkhaliq has joined #openstack-nova02:39
*** VW_ has joined #openstack-nova02:39
*** Marga_ has quit IRC02:40
*** Marga_ has joined #openstack-nova02:40
*** dsanders has joined #openstack-nova02:40
openstackgerritEli Qiao proposed openstack/nova: API: remove admin require from compute_node_get_all_by_* from db layer  https://review.openstack.org/17533402:41
openstackgerritEli Qiao proposed openstack/nova: API: remove admin require for compute_node_create/update/delete from db layer  https://review.openstack.org/17569302:41
*** Marga_ has quit IRC02:42
*** exploreshaifali has quit IRC02:46
*** exploreshaifali has joined #openstack-nova02:47
*** mmedvede has quit IRC02:56
openstackgerritLi Yingjun proposed openstack/nova: Add missing delete policies in the sample file  https://review.openstack.org/17525102:57
openstackgerritshihanzhang proposed openstack/nova: Add config option to override url for versions  https://review.openstack.org/16026602:57
*** mmedvede has joined #openstack-nova02:59
openstackgerritzhangtralon proposed openstack/nova: filter_class_names is never passed  https://review.openstack.org/14328502:59
*** xuhanp has joined #openstack-nova03:02
*** xuhanp_ has joined #openstack-nova03:02
*** tojuvone has joined #openstack-nova03:08
*** eliqiao1 has quit IRC03:09
*** park_heijlong has quit IRC03:14
*** park_heijlong has joined #openstack-nova03:15
*** artom has quit IRC03:19
*** bkopilov has joined #openstack-nova03:19
*** Marga_ has joined #openstack-nova03:22
*** jogo has quit IRC03:22
*** fawadkhaliq has quit IRC03:22
*** jyuso1 has quit IRC03:23
*** park_heijlong has quit IRC03:26
*** exploreshaifali has quit IRC03:30
openstackgerritTomi Juvonen proposed openstack/nova-specs: New nova API call to mark nova-compute down  https://review.openstack.org/16983603:31
openstackgerritheijlong proposed openstack/nova: Merge create-backup functional tests of v2 and v2.1  https://review.openstack.org/17422603:34
openstackgerritheijlong proposed openstack/nova: Merge extension-info functional tests of v2 and v2.1  https://review.openstack.org/17570103:34
*** Marga_ has quit IRC03:35
openstackgerritVincent Hou proposed openstack/nova: Correct the order of the parameters to call swap_volume  https://review.openstack.org/17430703:36
*** Marga_ has joined #openstack-nova03:36
*** zhangtralon has quit IRC03:38
*** achanda has quit IRC03:41
*** RuiChen has joined #openstack-nova03:41
*** annashen has joined #openstack-nova03:42
*** otter768 has quit IRC03:42
*** pixelbeat has quit IRC03:44
*** pixelbeat has joined #openstack-nova03:44
*** jecarey has quit IRC03:45
*** dsanders has quit IRC03:47
*** lpetrut has joined #openstack-nova03:49
*** deepthi has joined #openstack-nova03:50
*** Zxen has quit IRC03:51
*** mmedvede has quit IRC03:54
*** ajayaa has joined #openstack-nova03:54
*** harlowja is now known as harlowja_away03:56
*** mmedvede has joined #openstack-nova04:02
*** annashen has quit IRC04:05
*** annashen has joined #openstack-nova04:06
*** ajayaa has quit IRC04:08
*** annashen has quit IRC04:11
*** iamjarvo has joined #openstack-nova04:14
*** jogo has joined #openstack-nova04:15
*** jogo has quit IRC04:17
*** achanda has joined #openstack-nova04:17
*** baoli has quit IRC04:18
*** Marga_ has quit IRC04:18
*** Murali has joined #openstack-nova04:19
*** jogo has joined #openstack-nova04:20
*** pixelbeat has quit IRC04:21
*** VW_ has quit IRC04:21
openstackgerritMichael Still proposed openstack/nova-specs: console: convert consoles code to use objects framework  https://review.openstack.org/16583804:25
*** ishant has joined #openstack-nova04:26
*** dsanders has joined #openstack-nova04:26
*** otter768 has joined #openstack-nova04:28
*** fawadkhaliq has joined #openstack-nova04:30
*** dsanders has quit IRC04:30
*** unicell has joined #openstack-nova04:32
*** otter768 has quit IRC04:38
*** Murali_ has joined #openstack-nova04:38
*** Murali has quit IRC04:42
*** Murali_ is now known as Murali04:42
*** dave-mccowan has quit IRC04:44
*** Sukhdev has joined #openstack-nova04:44
*** annashen has joined #openstack-nova04:45
*** Murali has quit IRC04:49
*** vilobhmm1 has joined #openstack-nova04:50
*** Longgeek has joined #openstack-nova04:52
*** zhenguo has quit IRC04:57
*** mmedvede has quit IRC04:59
*** unicell has quit IRC05:01
*** flaper87 has quit IRC05:01
*** emagana has joined #openstack-nova05:02
*** flaper87 has joined #openstack-nova05:04
*** mmedvede has joined #openstack-nova05:13
*** emagana has quit IRC05:16
*** emagana has joined #openstack-nova05:17
*** neelashah has quit IRC05:20
*** emagana has quit IRC05:21
*** nkrinner has joined #openstack-nova05:21
*** dsanders has joined #openstack-nova05:22
*** ajayaa has joined #openstack-nova05:25
openstackgerritAlex Xu proposed openstack/nova-specs: Virt driver support custom cpu model based on flavor/image  https://review.openstack.org/17039705:28
openstackgerritAlex Xu proposed openstack/nova-specs: Virt driver to support cpu features  https://review.openstack.org/17039605:28
*** Administrator_ has quit IRC05:28
*** jcoufal has joined #openstack-nova05:31
*** iamjarvo has quit IRC05:31
*** iamjarvo has joined #openstack-nova05:37
*** arnaud___ has joined #openstack-nova05:50
*** irenab has joined #openstack-nova05:50
*** sudipto has joined #openstack-nova05:52
*** achanda has quit IRC05:52
*** iamjarvo has quit IRC05:54
openstackgerritAlex Xu proposed openstack/nova: Add rpc client side version control for conductor task API  https://review.openstack.org/17415205:54
openstackgerritAlex Xu proposed openstack/nova: Update rpc version aliases for kilo  https://review.openstack.org/17414805:54
*** ildikov has quit IRC05:57
*** achanda has joined #openstack-nova05:57
*** garyk has joined #openstack-nova06:02
*** achanda has quit IRC06:03
*** dsanders has quit IRC06:04
*** ishant has quit IRC06:05
*** Murali has joined #openstack-nova06:06
*** armax_ has quit IRC06:06
*** armax has joined #openstack-nova06:07
*** armax has quit IRC06:07
*** armax has joined #openstack-nova06:08
*** armax has left #openstack-nova06:08
*** armax has joined #openstack-nova06:08
*** Administrator_ has joined #openstack-nova06:10
*** armax has quit IRC06:10
*** zhangtralon has joined #openstack-nova06:10
*** armax has joined #openstack-nova06:10
*** armax has quit IRC06:10
openstackgerritshihanzhang proposed openstack/nova: Add config option to override url for versions  https://review.openstack.org/16026606:14
*** lpetrut has quit IRC06:18
openstackgerritOpenStack Proposal Bot proposed openstack/nova: Imported Translations from Transifex  https://review.openstack.org/17194306:18
openstackgerritAlex Xu proposed openstack/nova: Soft delete system_metadata when destroy instance  https://review.openstack.org/11087506:21
openstackgerritAlex Xu proposed openstack/nova: Let soft-deleted instance_system_metadata readable  https://review.openstack.org/10920106:21
*** afazekas_ has joined #openstack-nova06:21
*** annashen has quit IRC06:23
openstackgerritDivya K Konoor proposed openstack/nova: Control create/delete flavor api permissions using policy.json  https://review.openstack.org/17573906:28
*** salv-orlando has quit IRC06:29
openstackgerritTimofey Durakov proposed openstack/nova: Removed 'PYTHONHASHSEED=0' from tox.ini  https://review.openstack.org/16387706:33
openstackgerritTimofey Durakov proposed openstack/nova: Fixed test in test_tracker to work with random PYTHONHASHSEED  https://review.openstack.org/17435606:33
*** jamielennox is now known as jamielennox|away06:34
*** doude has joined #openstack-nova06:34
*** doron_afk has joined #openstack-nova06:34
*** otter768 has joined #openstack-nova06:39
*** dsanders has joined #openstack-nova06:39
*** doron_afk is now known as doron06:41
*** joefides_ has quit IRC06:43
*** Sukhdev has quit IRC06:44
*** dikonoor has joined #openstack-nova06:44
*** otter768 has quit IRC06:44
*** sahid has joined #openstack-nova06:45
*** vilobhmm11 has joined #openstack-nova06:50
*** vilobhmm1 has quit IRC06:51
*** joefides has joined #openstack-nova06:52
*** doron is now known as doron_afk06:53
*** kaisers has joined #openstack-nova06:54
*** cfriesen has quit IRC06:54
*** vilobhmm11 has quit IRC06:54
dikonooralex_xu: On https://review.openstack.org/#/c/175739/ , the build has failed. I am a little new to OpenStack contribution. I don't see any logs under screen-logs under the pci-test failure06:54
alex_xudikonoor: let me check06:55
dikonooralex_xu: ok..Thanks06:55
alex_xudikonoor: it's fine just a third-party ci failed06:55
alex_xudikonoor: let's waiting for more time06:56
dikonooralex_xu: ok..sure..Thanks06:56
alex_xudikonoor: np, thanks for the patch06:56
dikonooralex_xu: I noticed similar problem with view host details. But I am not able to pinpoint the recent change that has caused it.06:58
dikonoor9b0d73e660af434481a0a9b6d6a3bab7 - - -] User does not have admin privileges06:58
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hypervisors Traceback (most recent call last):06:58
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hypervisors   File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/contrib/hypervisors.py", line 147, in show06:58
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hypervisors     service = self.host_api.service_get_by_compute_host(context, hyp.host)06:58
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hypervisors   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 3451, in service_get_by_compute_host06:58
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hypervisors     return objects.Service.get_by_compute_host(context, host_name)06:58
*** zhangtralon has quit IRC06:58
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hypervisors   File "/usr/lib/python2.7/site-packages/nova/objects/base.py", line 163, in wrapper06:58
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hypervisors     result = fn(cls, context, *args, **kwargs)06:58
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hypervisors   File "/usr/lib/python2.7/site-packages/nova/objects/service.py", line 151, in get_by_compute_host06:58
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hypervisors     db_service = db.service_get_by_compute_host(context, host)06:58
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hypervisors   File "/usr/lib/python2.7/site-packages/nova/db/api.py", line 139, in service_get_by_compute_host06:58
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hypervisors     use_slave=use_slave)06:58
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hypervisors   File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 214, in wrapper06:59
dikonoor2015-04-19 21:34:22.194 23179 TRACE nova.api.openstack.compute.contrib.hyp06:59
alex_xudikonoor: that's raised from db layer, right?07:00
dikonooralex_xu : The exception comes from the require_admin_context decorator used in the nova db sqlalchemy layer but I think that decorator was always there.07:00
*** arnaud___ has quit IRC07:00
*** arnaud___ has joined #openstack-nova07:01
alex_xudikonoor: yea, we plan to clean up those decorator in the db layer. that's part of work in this bp https://blueprints.launchpad.net/nova/+spec/nova-api-policy-final-part07:01
*** arnaud___ has quit IRC07:01
alex_xudikonoor: for the compute node related db call is work by eliqiao, there is one of patch https://review.openstack.org/17533407:02
*** Nikolay_St has joined #openstack-nova07:02
*** mestery has quit IRC07:03
*** zhangtralon has joined #openstack-nova07:03
dikonooralex_xu: ok..Let me check if any of the existing gerrit reviews cover this methos07:04
*** eliqiao has quit IRC07:04
*** eliqiao has joined #openstack-nova07:04
openstackgerritGhanshyam Mann proposed openstack/nova: Merge server groups tests between v2 and v2.1  https://review.openstack.org/17418107:04
*** romainh has joined #openstack-nova07:04
StevenKzigo: I figured out the assertRaisesRegex thing. You need to update python-testtools to the latest upstream. This may require updating unittest2, and packaging up traceback2 and linecache2.07:04
alex_xudikonoor: not yet as know, I guess eliqiao is working on it07:05
*** browne has quit IRC07:06
*** dsanders has quit IRC07:09
dikonooralex_xu: ok, the exception I pointed out comes from method service_get_by_compute_host and the patch in https://review.openstack.org/#/c/175334/ from eliqiao is not covering that.07:10
*** zhenguo has joined #openstack-nova07:10
alex_xudikonoor: yea, I guess he will work out that on separated patch07:10
openstackgerritGhanshyam Mann proposed openstack/nova: Merge availability_zone tests between v2 and v2.1  https://review.openstack.org/17101707:11
*** kaisers has quit IRC07:11
alex_xudikonoor: we don't want to cleanup all the db call in the single patch, that's hard for review07:11
*** eliqiao has quit IRC07:11
*** pcaruana has quit IRC07:11
*** eliqiao has joined #openstack-nova07:12
gilliardHello, Nova!07:12
dikonooralex_xu , eliqiao : Is there a LP bug that should be opened and assigned to eligiao for this ?07:13
sahidhello gilliard07:13
sudiptobauzas, Hello !07:14
alex_xudikonoor: There already have bp https://blueprints.launchpad.net/openstack/?searchtext=nova-api-policy-final-part for it, so needn't a LP bug07:14
openstackgerritshihanzhang proposed openstack/nova: Optimize validate_networks  https://review.openstack.org/17574207:14
dikonooralex_xu ,eliqiao : oh, right.you pointed me to that. would this patch make it for Kilo?07:14
dikonooralex_xu : I mean not the bp; specifically those that eliqiao is working on07:15
alex_xudikonoor: no, it's won't.07:15
dikonooralex_xu : ok07:16
openstackgerritEli Qiao proposed openstack/nova: API: remove admin require for compute_node(get_all/search_by_hyperviso) from db  https://review.openstack.org/17574407:16
openstackgerritEli Qiao proposed openstack/nova: API: Add policy enforcement test cases for pci API  https://review.openstack.org/17574507:16
openstackgerritGhanshyam Mann proposed openstack/nova: Merge preserve_ephemeral_rebuild tests between v2 & v2.1  https://review.openstack.org/17328407:17
*** jyuso1 has joined #openstack-nova07:18
*** jichen has joined #openstack-nova07:20
*** arif-ali has quit IRC07:20
*** arif-ali has joined #openstack-nova07:21
*** kaisers has joined #openstack-nova07:21
*** dsanders has joined #openstack-nova07:23
zigoStevenK: Thanks for letting me know! I'll see what I can do for that, though probably it's going to be nothing until Jessie is out (ie: in 4 days from now).07:23
*** flaper87 has quit IRC07:23
*** flaper87 has joined #openstack-nova07:23
openstackgerritGhanshyam Mann proposed openstack/nova: Merge simple tenant usage tests between v2 and v2.1  https://review.openstack.org/17524307:23
*** xuhanp_ has quit IRC07:28
*** xuhanp has quit IRC07:28
*** afazekas_ has quit IRC07:32
alex_xudikonoor: just small pep8 problem need fix https://review.openstack.org/#/c/175739/07:32
dikonooralex_xu: thanks for pointing that out :) ..I completely forgot to run pep8..my basd..Let me fix it right away07:32
alex_xudikonoor: np07:33
*** mpaolino has joined #openstack-nova07:33
*** afazekas_ has joined #openstack-nova07:36
alex_xudikonoor: how about we change https://github.com/openstack/nova/blob/master/nova/tests/unit/api/openstack/compute/contrib/test_flavor_manage.py#L44507:37
alex_xuand https://github.com/openstack/nova/blob/master/nova/tests/unit/api/openstack/compute/contrib/test_flavor_manage.py#L46707:37
alex_xudikonoor: to return fakes.HTTPRequest.blank(url, use_admin_context=False)07:38
alex_xudikonoor: that can make sure there isn't any hard-code permission checks in the code07:38
alex_xudikonoor: It means use non-admin context in the unittest, if all the unittest passed, that means there isn't any hard-code permission checks07:39
dikonooralex_xu : Thanks for pointing those out..I will make those changes as part of the next patch07:39
alex_xudikonoor: thanks07:39
*** penick has quit IRC07:39
*** tralon_ has joined #openstack-nova07:42
*** jamielennox|away is now known as jamielennox07:43
*** zhangtralon has quit IRC07:46
*** mestery has joined #openstack-nova07:46
*** jistr has joined #openstack-nova07:47
openstackgerritHans Lindgren proposed openstack/nova: Make ComputeNode.service_id nullable to match db schema  https://review.openstack.org/16928407:50
openstackgerritHans Lindgren proposed openstack/nova: Don't query compute_node through service object in nova-manage  https://review.openstack.org/16890707:50
*** moshele has joined #openstack-nova07:51
openstackgerritHans Lindgren proposed openstack/nova: Avoid querying for Service in resource tracker  https://review.openstack.org/16928807:52
*** dsanders has quit IRC07:53
*** erkules_ is now known as erkules07:53
*** erkules has joined #openstack-nova07:53
*** apuimedo_ has joined #openstack-nova07:54
*** Marga_ has joined #openstack-nova07:56
*** foexle has joined #openstack-nova07:58
*** arnaud___ has joined #openstack-nova08:02
*** doron_afk is now known as doron08:06
*** arnaud___ has quit IRC08:06
*** zz_johnthetubagu is now known as johnthetubaguy08:08
*** Nikolay_St has quit IRC08:10
*** ildikov has joined #openstack-nova08:11
*** johnthetubaguy is now known as zz_johnthetubagu08:15
*** Administrator_ has quit IRC08:16
*** lennyb has joined #openstack-nova08:17
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: scheduler: weight nodes based on their cached images  https://review.openstack.org/17330408:17
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: Add new image cache monitor in compute nodes  https://review.openstack.org/17330308:17
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: compute monitors: set update delta from base class  https://review.openstack.org/17398708:17
*** derekh has joined #openstack-nova08:18
*** eliqiao1 has joined #openstack-nova08:19
*** eliqiao1 has quit IRC08:19
*** eliqiao1 has joined #openstack-nova08:19
*** eliqiao has quit IRC08:20
*** zz_johnthetubagu is now known as johnthetubaguy08:20
*** lucasagomes has joined #openstack-nova08:23
*** mmedvede has quit IRC08:23
*** eliqiao1 has quit IRC08:24
openstackgerritAdelina Tuvenie proposed openstack/nova: Adds Hyper-V vNic hot-plug implementation  https://review.openstack.org/13825508:31
openstackgerritBartosz Fic proposed openstack/nova: Live migration failure in API doesn't set vm_state to Error  https://review.openstack.org/16891608:33
*** matrohon has joined #openstack-nova08:35
*** mmedvede has joined #openstack-nova08:35
openstackgerritBartosz Fic proposed openstack/nova: Live migration failure in API doesn't set vm_state to Error  https://review.openstack.org/16891608:36
sahidndipanov: any chance to get a review here https://review.openstack.org/#/c/172079/ ?08:36
*** eglynn has joined #openstack-nova08:37
*** ankit_ag has joined #openstack-nova08:38
*** eliqiao has joined #openstack-nova08:39
*** otter768 has joined #openstack-nova08:40
*** Nikolay_St has joined #openstack-nova08:41
openstackgerritgaryk proposed openstack/nova: VMware: enable configuring of console delay  https://review.openstack.org/14066908:41
*** Longgeek has quit IRC08:42
*** pixelbeat has joined #openstack-nova08:42
*** mmedvede has quit IRC08:42
*** eliqiao has quit IRC08:44
*** eliqiao1 has joined #openstack-nova08:44
*** eliqiao1 has left #openstack-nova08:44
*** eliqiao has joined #openstack-nova08:44
*** otter768 has quit IRC08:44
*** coolsvap|afk is now known as coolsvap08:45
openstackgerritDivya K Konoor proposed openstack/nova: Control create/delete flavor api permissions using policy.json  https://review.openstack.org/17573908:46
ndipanovjohnthetubaguy, ah I see that ttx has started setting rc2 targets08:46
johnthetubaguyndipanov: we are doing that right now08:46
*** coolsvap is now known as coolsvap|afk08:46
*** sdake_ has quit IRC08:47
*** redbeard has joined #openstack-nova08:47
ndipanovjohnthetubaguy, was there a meeting or some such about what gets a pass?08:47
johnthetubaguyndipanov: its just the weekly release sync up meeting08:49
ndipanovjohnthetubaguy, ok well - let me know if you need any input from me on the PCI bugs08:52
ndipanovthat I targeted08:52
*** f13o has joined #openstack-nova08:54
*** tralon_ has quit IRC08:54
redbeardany hint to trigger the instance healing process manually? when I associate a floating IP in icehouse while the instance is in build or spawning state, the cache needs 10 to 20 minutes to "get" the floating IP information. the ip itself is associated + works in time08:55
*** rajesht has joined #openstack-nova08:58
openstackgerritAnkit Agrawal proposed openstack/nova: Detach volume after deleting the instance  https://review.openstack.org/14573809:01
*** arnaud___ has joined #openstack-nova09:03
johnthetubaguyndipanov: just looking at the merged ones, this is the current list for RC2 https://launchpad.net/nova/+milestone/kilo-rc2 which was basically everything09:03
johnthetubaguyall but one deprecation commit that had a string in it09:03
*** mmedvede has joined #openstack-nova09:03
*** doron is now known as doron_afk09:04
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: libvirt: make live_migration_uri flag dependant on virt_type  https://review.openstack.org/17578009:05
ndipanovjohnthetubaguy, the one we acked by garyk yesterday seems to be missing09:05
ndipanovand it seemed important09:05
ndipanovlet me try to find that09:05
johnthetubaguyndipanov: hmm, maybe its not in master yet? which one is that?09:06
ndipanovhttps://review.openstack.org/#/c/173794/09:06
ndipanovah it is targetted09:06
ndipanovok09:06
johnthetubaguyndipanov: thats in the list I think09:06
ndipanovsorry about that :(09:06
johnthetubaguynp09:06
ndipanovyeah looks like quite a list09:07
*** arnaud___ has quit IRC09:07
garykjohnthetubaguy: ndipanov: i backported that one to stable/kilo. just need some stables cores to ack it09:08
sahidaloga: i have a question about https://review.openstack.org/#/c/173987/09:09
ndipanovtbh I am a bit confused about stable/kilo and proposed/kilo right now09:09
*** fawadkhaliq has quit IRC09:11
openstackgerritgaryk proposed openstack/nova: VMware: add in folder support on VC  https://review.openstack.org/16506009:11
*** ildikov has quit IRC09:11
*** Longgeek has joined #openstack-nova09:14
openstackgerritgaryk proposed openstack/nova: VMware: improve instance names on VC  https://review.openstack.org/16660809:17
openstackgerritgaryk proposed openstack/nova: VMware: remove unused method  https://review.openstack.org/17289609:21
alogasahid: hi09:24
*** ildikov has joined #openstack-nova09:24
*** fawadkhaliq has joined #openstack-nova09:25
alogasahid: if it's according your suggestion in https://review.openstack.org/#/c/173987/09:26
alogaI do agree09:27
*** fawadkhaliq has quit IRC09:27
aloga:)09:27
sahidaloga: cool09:28
sahidthanks :)09:29
johnthetubaguyndipanov: any chance you could do some numa rc2 back ports for me please? https://launchpad.net/nova/+milestone/kilo-rc2 the ones in the new state09:30
ndipanovjohnthetubaguy, yes09:31
ndipanovneed to step out for an hour or 2 - is it ok if it's PM europe time?09:32
alogasahid: you're welcome!09:32
johnthetubaguyndipanov: thats fine, it will see if there are some easier ones I can do, some of them seemed to conflict a bit, but I probably just got the order wrong09:32
ndipanovjohnthetubaguy, also - which branch should they be posted to?09:33
ndipanovyeah order is important09:33
ndipanovlet me try09:33
johnthetubaguyndipanov: stable/kilo basically09:33
johnthetubaguyndipanov: as I understand it09:33
*** hightall has quit IRC09:33
*** lpetrut has joined #openstack-nova09:36
*** alexpilotti has quit IRC09:37
*** fawadkhaliq has joined #openstack-nova09:38
*** fawadkhaliq has quit IRC09:38
*** fawadkhaliq has joined #openstack-nova09:38
*** salv-orlando has joined #openstack-nova09:42
*** Marga_ has quit IRC09:42
openstackgerritDivya K Konoor proposed openstack/nova: Control create/delete flavor api permissions using policy.json  https://review.openstack.org/17573909:43
*** apuimedo_ has quit IRC09:45
ndipanovjohnthetubaguy, done but gerrit hates me for not putting change ids in the footer09:49
ndipanovlet me try again09:49
ndipanovok done - it starts here https://review.openstack.org/#/c/175787/209:52
ndipanovjohnthetubaguy, ^^09:52
ndipanovah I see you posted some already...09:52
ndipanovah well nvm09:52
*** lpetrut has quit IRC09:54
openstackgerritdave-mcnally proposed openstack/nova: rebuild_instance doesn't detach cinder volumes correctly  https://review.openstack.org/17295109:56
johnthetubaguyndipanov: no worries, I can drop mine if you got the full chain09:58
*** park_heijlong has joined #openstack-nova10:00
*** tojuvone has quit IRC10:00
ndipanovjohnthetubaguy, no need10:00
ndipanovthe change ids are the same10:01
*** apuimedo_ has joined #openstack-nova10:02
johnthetubaguyndipanov: ah, OK10:03
johnthetubaguycools10:03
openstackgerritRadoslav Gerganov proposed openstack/nova: Consolidate the APIs for getting consoles  https://review.openstack.org/14850910:03
johnthetubaguyndipanov: thanks for sorting those, big help10:03
*** boris-42 has quit IRC10:05
*** kaisers has quit IRC10:06
ndipanovjohnthetubaguy, np - thanks for considering them for the release10:06
*** tojuvone has joined #openstack-nova10:07
*** boris-42 has joined #openstack-nova10:08
*** oro has joined #openstack-nova10:10
*** BobBall_AWOL is now known as BobBall10:10
*** yamahata has quit IRC10:12
*** tojuvone has quit IRC10:17
*** tojuvone has joined #openstack-nova10:20
*** IanGovett has joined #openstack-nova10:22
*** mpaolino has quit IRC10:29
sudiptoPaulMurray, Hi, can you point me to any example of a RT plugin in the code?10:31
*** fawadkhaliq has quit IRC10:32
*** fawadkhaliq has joined #openstack-nova10:32
sudiptoPaulMurray, nova.compute.resources - i guess that has 210:34
sudiptorather 110:34
*** xyang1 has quit IRC10:35
PaulMurraysudipto, hi - yes, only the vcpu10:35
*** lpetrut has joined #openstack-nova10:36
PaulMurraysudipto, the extensible RT plugins are only implemented at the RT - so the values do arrive at the scheduler, but the consumer plugins are not there10:36
*** fawadk has joined #openstack-nova10:36
PaulMurraysudipto, the work was stalled because the whole area is likely to be upturned soon with resource objects10:37
PaulMurraysudipto, what do you want to use them for?10:37
*** fawadkhaliq has quit IRC10:38
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: scheduler: weight nodes based on their cached images  https://review.openstack.org/17330410:39
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: Add new image cache monitor in compute nodes  https://review.openstack.org/17330310:39
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: compute monitors: set update delta from base class  https://review.openstack.org/17398710:39
*** otter768 has joined #openstack-nova10:41
*** fawadkhaliq has joined #openstack-nova10:41
*** fawadk has quit IRC10:43
*** fawadk has joined #openstack-nova10:44
*** otter768 has quit IRC10:45
*** sahid has quit IRC10:46
*** fawadkhaliq has quit IRC10:48
*** fawadkhaliq has joined #openstack-nova10:49
*** fawadkhaliq has quit IRC10:50
*** fawadkhaliq has joined #openstack-nova10:50
*** fawadk has quit IRC10:51
*** arnaud___ has joined #openstack-nova10:52
*** Hosam has joined #openstack-nova10:52
*** fawadk has joined #openstack-nova10:53
*** sahid has joined #openstack-nova10:54
*** sahid has quit IRC10:54
*** fawadkhaliq has quit IRC10:55
*** fawadkhaliq has joined #openstack-nova10:55
*** sahid has joined #openstack-nova10:55
*** arnaud___ has quit IRC10:56
sudiptoPaulMurray, sorry had stepped out for a bit. I wanted to implement something like a memory b/w utilization as a RT plugin.10:56
sudiptoPaulMurray, I have implemented it using the monitors currently - but that would  mean that the data is populated in the metrics column and is available to the host_states on the controller.10:56
sudiptoPaulMurray, hence essentially it doesn't use the RT.10:57
sudiptoPaulMurray, would you have a suggestion on which framework fits better for this - the monitors or the RT?10:58
*** fawadk has quit IRC10:58
*** deepthi has quit IRC10:59
PaulMurraysudipto, RT deals with values that are accounted - generally they are artificial values, like disk space or memory that are added up form the number of instances and their nominal usage. These values may also translate into limits on actual usage in the hypervisor but not necessarily.11:01
sudiptoPaulMurray, I wouldn't want to tie this with the extra specs of instances.11:01
PaulMurraysudipto, metrics are used to monitor actual use of resources11:01
sudiptoPaulMurray, So metrics sounds like the right place for this....11:01
*** jistr has quit IRC11:02
*** nihilifer has quit IRC11:03
PaulMurraysudipto, so if you want to monitor the current use of memory b/w on the host, as opposed to saying "count 5 for this flavor" then metrics sounds like it11:03
*** nihilifer has joined #openstack-nova11:03
sudiptoPaulMurray, hmm yeah - and then nothing should theoretically stop us from writing a filter that would just use this right? Something on the lines of this spec: https://review.openstack.org/#/c/154423/5/specs/liberty/approved/cache-aware-weigher.rst11:04
sudiptoPaulMurray, would this just require an implementation then or a spec per your advice?11:04
*** jistr has joined #openstack-nova11:04
*** tojuvone has quit IRC11:07
PaulMurraysudipto, I think you can probably just do it. These are simple plugins, so specs seems heavy weight - the filter would be quicker and easier to write than the spec.11:08
PaulMurraysudipto, Do it and see if anyone complains11:08
sudiptoPaulMurray, Ok sounds good. Thanks Paul.11:09
*** fawadkhaliq has quit IRC11:09
sudiptoPaulMurray, Just one final thing, does it then go as a bug or still a BP? (sorry, i am new to openstack)11:09
*** f13o has quit IRC11:10
*** claudiub has joined #openstack-nova11:12
*** fawadkhaliq has joined #openstack-nova11:13
*** Hosam has quit IRC11:13
dikonooralex_xu:On the recent comments you gave for https://review.openstack.org/#/c/175739/ , I guess you are referring to the spaces there..?11:13
alex_xudikonoor: yes, those are unrelated change, we shouldn't make11:14
*** fawadkhaliq has quit IRC11:15
dikonooralex_xu: I don't see those spaces when I open in a notepad or gedit.Let me try11:15
*** fawadkhaliq has joined #openstack-nova11:16
alex_xudikonoor: thanks11:16
PaulMurraysudipto, do a BP - it can be approved without a spec if its trivial. You need to set the target and then you can put your patches up referring to that bp11:16
sudiptoPaulMurray, Ok. Thanks!11:16
PaulMurraySome of this is described here: http://docs.openstack.org/infra/manual/developers.html#working-on-specifications-and-blueprints11:18
PaulMurraybut not sure where nova specific bits are11:18
*** mleroy has quit IRC11:19
*** Hosam has joined #openstack-nova11:20
*** Hosam has quit IRC11:23
*** mleroy has joined #openstack-nova11:24
sudiptoPaulMurray, Thanks. Sorry i should have been better at reading those.11:27
*** otter768 has joined #openstack-nova11:27
openstackgerritRadoslav Gerganov proposed openstack/nova: Consolidate the APIs for getting consoles  https://review.openstack.org/14850911:27
*** lucasagomes is now known as lucas-hungry11:29
openstackgerritEli Qiao proposed openstack/nova: API: remove admin require from compute_node_get_all_by_* from db layer  https://review.openstack.org/17533411:30
openstackgerritEli Qiao proposed openstack/nova: API: Add policy enforcement test cases for pci API  https://review.openstack.org/17574511:30
openstackgerritEli Qiao proposed openstack/nova: API: remove admin require for compute_node(get_all/search_by_hyperviso) from db  https://review.openstack.org/17574411:30
openstackgerritEli Qiao proposed openstack/nova: API: remove admin require for compute_node_create/update/delete from db layer  https://review.openstack.org/17569311:30
*** fawadkhaliq has quit IRC11:30
*** fawadkhaliq has joined #openstack-nova11:32
*** Kevin_Zheng has joined #openstack-nova11:33
*** MVenesio has joined #openstack-nova11:34
*** fawadkhaliq has quit IRC11:35
openstackgerritDivya K Konoor proposed openstack/nova: Control create/delete flavor api permissions using policy.json  https://review.openstack.org/17573911:35
*** mwagner_lap has quit IRC11:38
*** alexpilotti has joined #openstack-nova11:40
openstackgerritEli Qiao proposed openstack/nova: Object: Improve Instance _save_flavor  https://review.openstack.org/16007511:43
openstackgerritEli Qiao proposed openstack/nova: Object: Merge db accesses for extra field of instance  https://review.openstack.org/16007611:43
jaypipesmorning all.11:44
claudiubmornooning. :D11:45
*** dave-mccowan has joined #openstack-nova11:46
*** jcoufal_ has joined #openstack-nova11:47
*** otter768 has quit IRC11:50
*** jcoufal has quit IRC11:50
sahidclaudiub: can i have you review here please https://review.openstack.org/#/c/155730/11:53
*** yingjun has joined #openstack-nova11:54
claudiubsahid: sure. :)11:54
*** MVenesio has quit IRC11:56
openstackgerritJay Pipes proposed openstack/nova: Fix race in server group policy validation  https://review.openstack.org/16476211:57
openstackgerritJay Pipes proposed openstack/nova: Fix race in affinity server group scheduling  https://review.openstack.org/16948911:57
*** atuvenie_ has joined #openstack-nova12:01
*** atuvenie has joined #openstack-nova12:01
*** markvoelker has joined #openstack-nova12:02
*** markvoelker_ has joined #openstack-nova12:03
*** markvoelker_ has quit IRC12:04
*** markvoelker_ has joined #openstack-nova12:05
*** raildo has joined #openstack-nova12:06
*** kaisers has joined #openstack-nova12:06
*** markvoelker has quit IRC12:07
*** thangp has joined #openstack-nova12:09
*** tojuvone has joined #openstack-nova12:11
*** bkopilov has quit IRC12:12
*** atuvenie_ has quit IRC12:12
*** jyuso1 has quit IRC12:16
*** sahid has quit IRC12:16
*** dprince has joined #openstack-nova12:17
openstackgerritBrent Eagles proposed openstack/nova: WIP: Refactor Nova VIF model  https://review.openstack.org/16728712:18
*** salv-orlando has quit IRC12:18
openstackgerritEli Qiao proposed openstack/nova: Add policy check for extension_info  https://review.openstack.org/17321012:18
*** lpetrut has quit IRC12:19
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: scheduler: weight nodes based on their cached images  https://review.openstack.org/17330412:19
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: Add new image cache monitor in compute nodes  https://review.openstack.org/17330312:19
*** mwagner_lap has joined #openstack-nova12:19
*** salv-orlando has joined #openstack-nova12:21
*** aix has joined #openstack-nova12:21
*** sudipto has quit IRC12:22
*** yingjun has quit IRC12:22
*** baoli has joined #openstack-nova12:23
openstackgerritSergey Nikitin proposed openstack/nova: Changed backporting of embedded Network object when backporting a FixedIP  https://review.openstack.org/17372312:25
*** yingjun has joined #openstack-nova12:27
*** yingjun has quit IRC12:28
*** joefides has quit IRC12:30
openstackgerritJohn Garbutt proposed openstack/nova: Fix inefficient transaction usage in floating_ip_bulk_destroy  https://review.openstack.org/14076912:32
*** MVenesio has joined #openstack-nova12:35
*** lucas-hungry is now known as lucasagomes12:35
*** neelashah has joined #openstack-nova12:37
openstackgerritgaryk proposed openstack/nova: VMware: enable a resize of instance with no root disk  https://review.openstack.org/17380212:37
*** thangp has quit IRC12:38
openstackgerritJohn Garbutt proposed openstack/nova: Cleanup unnecessary session creation in floating_ip_deallocate  https://review.openstack.org/14077012:38
*** arnaud___ has joined #openstack-nova12:40
*** zhangtralon has joined #openstack-nova12:41
*** lpetrut has joined #openstack-nova12:42
*** mpaolino has joined #openstack-nova12:42
*** jistr has quit IRC12:42
*** jistr has joined #openstack-nova12:43
*** arnaud___ has quit IRC12:44
*** lpetrut has quit IRC12:46
*** VW_ has joined #openstack-nova12:50
*** ajayaa has quit IRC12:52
openstackgerritJohn Garbutt proposed openstack/nova: Sorting and pagination params used as filters  https://review.openstack.org/14729812:52
openstackgerritshihanzhang proposed openstack/nova: Optimize validate_networks  https://review.openstack.org/17574212:55
*** irenab has quit IRC12:58
*** tdurakov has quit IRC12:58
*** baoli has quit IRC13:00
*** Marga_ has joined #openstack-nova13:01
*** jistr is now known as jistr|mtg13:01
*** rajesht has quit IRC13:01
*** baoli has joined #openstack-nova13:02
*** xyang1 has joined #openstack-nova13:04
openstackgerritRadoslav Gerganov proposed openstack/nova: Consolidate the APIs for getting consoles  https://review.openstack.org/14850913:05
*** Longgeek has quit IRC13:05
*** lpetrut has joined #openstack-nova13:06
*** salv-orlando has quit IRC13:06
*** sandywalsh has quit IRC13:11
*** kiran-r has joined #openstack-nova13:11
*** VW_ has quit IRC13:11
johnthetubaguysdague: I was looking at the DB downgrade change, https://review.openstack.org/#/c/175010/3 do we need to follow up an drop the shadow tables at some point?13:11
*** joefides has joined #openstack-nova13:12
sdaguewell, dropping the shadow tables is a whole other can of worms, right?13:12
jaypipesjohnthetubaguy, sdague, other cores: https://review.openstack.org/#/c/173913/ could use an extra review pls. thx in advance!13:12
jaypipesjohnthetubaguy: yeah, dropping the shadow stuff is a big thing... one sec, grfabbing a link to relevant spec..13:13
johnthetubaguysdague: yeah, its more data lossey, but yeah there is more to it13:13
jaypipesjohnthetubaguy: https://review.openstack.org/#/c/137669/13:13
johnthetubaguyjaypipes: yeah, but I got the impression the shadow tables were only really used for downgrades, but I probably got the wrong end of the stick, I guess folks could use them for archive13:14
sdaguejohnthetubaguy: yeh, no, the shadow tables are about archive13:14
*** changbl has quit IRC13:14
johnthetubaguysdague: my bad13:14
sdaguethey don't have any impact on downgrade as far as I know13:14
jaypipesno worries, johnthetubaguy :)13:15
jaypipesjohnthetubaguy: it's a mess..13:15
johnthetubaguyjaypipes: agreed, our internal tools that rely on them, more so13:15
sdaguejaypipes: agreed... grab your shovel13:15
*** sandywalsh has joined #openstack-nova13:15
johnthetubaguyjaypipes: I mean the soft_deleted stuff, rather than shadow13:15
jaypipessdague: Bring a Broom!13:15
johnthetubaguysdague: yeah, I thought we did something like leave old stuff in shadow tables, so you can restore from shadow instead of downgrade, but I don't see how that could ever had worked though… oops13:16
johnthetubaguyanyways, ignore my rambling13:17
*** zhenguo has quit IRC13:17
*** sdake has joined #openstack-nova13:19
*** atuvenie has quit IRC13:21
*** sdake_ has joined #openstack-nova13:22
openstackgerritSean Dague proposed openstack/python-novaclient: wip: add ips to novaclient server manager  https://review.openstack.org/17560313:23
openstackgerritSean Dague proposed openstack/python-novaclient: refactor functional test base class to no inherit from tempest_lib  https://review.openstack.org/17585413:23
*** busterswt has joined #openstack-nova13:23
sdaguejaypipes: you are going to need way more than a broom :)13:23
jaypipessdague: :)13:23
alex_xujohnthetubaguy: This is ready https://review.openstack.org/#/c/175739/13:24
*** Longgeek has joined #openstack-nova13:24
*** sdake has quit IRC13:24
*** Longgeek has quit IRC13:24
*** vladikr has joined #openstack-nova13:24
*** Longgeek has joined #openstack-nova13:25
*** sdake has joined #openstack-nova13:25
*** atuvenie has joined #openstack-nova13:25
johnthetubaguyalex_xu: hmm, but now its not backwards compatible with the old check right?13:26
*** irenab has joined #openstack-nova13:26
*** sdake_ has quit IRC13:28
alex_xujohnthetubaguy: yes, the old code always pass the admin context down to the code, so that means it always can pass the db layer admin checks.13:29
*** zhangtralon has quit IRC13:30
alex_xujohnthetubaguy: so flavor-manage's API can be configured by policy.json before. https://review.openstack.org/#/c/175739/ remove the wrong admin checks.13:30
johnthetubaguyalex_xu: but it didn't seem to read that way in the commit that removed it, do you remember where you saw that?13:31
alex_xujohnthetubaguy: REST API always call this https://github.com/openstack/nova/blob/master/nova/compute/flavors.py#L175 , it always pass the admin context13:32
alex_xujohnthetubaguy: and the REST API never pass the user's context down to the code https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/contrib/flavormanage.py#L9313:33
*** mriedem_away is now known as mriedem13:36
*** kiran-r has quit IRC13:37
*** doron_afk has quit IRC13:38
*** sudipto has joined #openstack-nova13:38
sudiptodansmith, Hi Dan, I have got the +1s now from sahid and bauzas https://review.openstack.org/#/c/173187/ could you please take a look when you can...thanks!!13:39
*** zzzeek has joined #openstack-nova13:39
dansmithsudipto: no13:40
dansmithsudipto: I have a struct "no +2s without coffee" policy13:40
dansmither, strict :)13:40
mriedemjohnthetubaguy: what in god's green earth is a doodle pool?13:40
alex_xulooks like /me's English doesn't works again13:40
dansmithdamn, messed that all up13:40
*** Nikolay_St has quit IRC13:40
sudiptodansmith, :D ok, when you can that's why :-)13:40
*** EmilienM has quit IRC13:40
*** EmilienM has joined #openstack-nova13:41
johnthetubaguyalex_xu: ah, I see, I missed that bit13:41
johnthetubaguyalex_xu: thanks13:41
*** doron has joined #openstack-nova13:41
alex_xujohnthetubaguy: np :) cool my English works13:41
johnthetubaguymriedem: http://doodle.com/13:41
mriedemoic13:42
*** dboik_ has quit IRC13:43
*** baoli has quit IRC13:44
*** fawadkhaliq has joined #openstack-nova13:44
*** ankit_ag has quit IRC13:44
*** Murali has quit IRC13:44
*** baoli_ has joined #openstack-nova13:45
*** cbits has joined #openstack-nova13:45
vladikrjohnthetubaguy, Hi, could you please remove your -2 from the libosinfo patches? https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/libvirt-hardware-policy-from-libosinfo,n,z13:45
*** burt has joined #openstack-nova13:45
sudiptobauzas, PaulMurray : Just out of curiosity, can the resource monitors be made optional?13:46
*** emagana has joined #openstack-nova13:48
*** zz_jgrimm is now known as jgrimm13:49
*** otter768 has joined #openstack-nova13:50
johnthetubaguyvladikr: the spec needs to be resubmitted for liberty, using the previously-approved: kilo git commit tag should make that quicker13:51
openstackgerritAlex Xu proposed openstack/nova: Add policy check for extension_info  https://review.openstack.org/17321013:51
*** armax_ has joined #openstack-nova13:51
johnthetubaguyvladikr: ping me once the spec is up for review, and I can speed that all up for you13:51
*** emagana_ has joined #openstack-nova13:51
*** yamahata has joined #openstack-nova13:52
vladikrjohnthetubaguy, got it , thanks13:52
*** salv-orlando has joined #openstack-nova13:52
*** emagana has quit IRC13:52
*** armax_ has quit IRC13:52
*** armax_ has joined #openstack-nova13:52
johnthetubaguyvladikr: no problem13:53
*** amotoki has joined #openstack-nova13:54
*** ildikov has quit IRC13:54
*** salv-orlando has quit IRC13:54
*** VW_ has joined #openstack-nova13:54
*** otter768 has quit IRC13:55
tojuvoneJay, John,... changed the scope for this BP to have API to mark nova-compute down as wanted in review: https://review.openstack.org/#/c/169836/13:56
tojuvoneShould I in meantime also start to write BP for CLI and perhaps for notification...13:56
*** Sukhdev has joined #openstack-nova13:57
tojuvoneand perhaps single API to mark all VMs on failing host to "error" state.. and BP for CLI to that and PB perhaps for notification13:57
*** cfriesen has joined #openstack-nova13:58
jaypipestojuvone: sure, that would be great, thank you!13:59
*** salv-orlando has joined #openstack-nova14:00
*** tonytan4ever has joined #openstack-nova14:00
*** jecarey has joined #openstack-nova14:00
*** dboik has joined #openstack-nova14:01
*** tojuvone has quit IRC14:02
*** ijw has joined #openstack-nova14:02
*** doron is now known as doron_afk14:02
*** dikonoor has quit IRC14:02
*** ijw has quit IRC14:02
*** ijw has joined #openstack-nova14:03
*** tojuvone has joined #openstack-nova14:03
*** sudipto has quit IRC14:05
*** sudipto has joined #openstack-nova14:05
*** eharney has joined #openstack-nova14:06
*** mtanino has joined #openstack-nova14:06
*** apmelton_away is now known as apmelton14:07
tojuvonelost connection for a while.. but at got the one comment from jaypipes before that. Great, so can start to work for total 6 BPs then if seen worth while to have them over the topic.14:07
*** emagana_ has quit IRC14:08
*** afazekas_ has quit IRC14:08
*** emagana has joined #openstack-nova14:08
*** jcoufal_ has quit IRC14:08
*** armax_ has quit IRC14:08
*** ildikov has joined #openstack-nova14:09
*** armax has joined #openstack-nova14:09
openstackgerritDan Smith proposed openstack/nova-specs: Add robustify-evacuate spec  https://review.openstack.org/16144414:10
tojuvone3 BPs: API to mark nova-compute down, notification to that and CLI. 3 BPs: mark VMs related to failed nova-compute (host) down with single API call, notification to that and CLI.14:10
*** annegentle has joined #openstack-nova14:10
*** cbits has left #openstack-nova14:12
*** bkopilov has joined #openstack-nova14:12
*** park_heijlong has quit IRC14:12
*** lpetrut has quit IRC14:13
*** popw has quit IRC14:13
tojuvoneSo jsut stated here if wanted some discussion. Otherwise surely discussed in those BPs :)14:14
*** atuvenie has quit IRC14:15
johnthetubaguytojuvone: it would be great if the wider picture was described in an overarching dev ref document, I was talking to VW_ about something very related to this14:15
*** garyk has quit IRC14:17
VW_ha - indeed - we were just discussing.  Let me take a look at the bluepring14:17
VW_bluprint even14:17
openstackgerritJoshua Hesketh proposed openstack/nova: Don't require max_number for migrate_flavor_data  https://review.openstack.org/17589014:17
*** iamjarvo has joined #openstack-nova14:18
*** iamjarvo has quit IRC14:18
*** iamjarvo has joined #openstack-nova14:19
*** iamjarvo has quit IRC14:19
*** iamjarvo has joined #openstack-nova14:20
tojuvoneVW_ so last version of BP is to mark service (nova-compute) down. The idea of whole is that external system can detect host failed fast and report to Nova to change all related states fast.14:21
dansmithalex_xu: are you still around?14:21
tojuvoneAlso fencinf would be guaranteed. No scheduling for that host and evacuate coudl happen immediately14:22
VW_ah, yes tojuvone - I remember this one now.  I'm fine if something changes the compute state, but I'd agree with johnthetubaguy that doesn't always mean the instances are down as well14:23
VW_so I'd be leery to automatically change all states14:23
tojuvoneAs single API for host couldn't be solution to mark nova-compute and VMs to down/error, there is currently only this one BP for nova-compute14:23
tojuvonenow it would be to make more BPs.14:23
tojuvoneYes, that is why everybody interested of HA would even currently have own monitoring...14:24
tojuvonenow it would be to have API if the monitoring can know or if it can fence (power down)14:25
VW_well, it's a little more that that.  I think nova computes should be completely expendable.  We actually run them as a VM on the host - which means the compute can die and the host and instances are just fine.14:25
*** jistr|mtg is now known as jistr14:26
tojuvoneSo not solution for all cases14:26
VW_but anyway, I like the idea of the system quickly knowing a compute (or underlying host) is down and disabling the compute14:26
*** atuvenie has joined #openstack-nova14:27
tojuvoneYes and like I am now working also with this opensource project Doctor in OPNFV, that should have Telco (NFV) capability to detect host faults and fence...14:27
tojuvoneSo when that shoudl be ready there should be infra tool for everybody to use14:28
*** annegentle has quit IRC14:28
*** annegentle has joined #openstack-nova14:28
*** arnaud___ has joined #openstack-nova14:29
*** annashen has joined #openstack-nova14:29
openstackgerritSean Dague proposed openstack/nova: remove downgrade support from our database migrations  https://review.openstack.org/17501014:29
openstackgerritVladik Romanovsky proposed openstack/nova-specs: Libvirt hardware policy from libosinfo  https://review.openstack.org/17589514:29
tojuvoneGreat. How about VMs. Would the collective API to mark host related VMs to erro be good (or what would be the state)?14:30
tojuvoneanyhow that has API to go VM by VM14:30
*** browne has joined #openstack-nova14:30
*** dboik has quit IRC14:30
*** lpetrut has joined #openstack-nova14:30
*** dboik has joined #openstack-nova14:31
*** rushil has joined #openstack-nova14:31
vladikrjohnthetubaguy, I have resubmitted the bp for Liberty: https://review.openstack.org/#/c/17589514:32
*** arnaud___ has quit IRC14:33
*** annashen has quit IRC14:34
*** Kevin_Zheng has quit IRC14:34
johnthetubaguytojuvone: I just think we need to step back a bit a look at the wider picture before approving these changes, its getting very confusing right now, I will try write something up about that all soon14:35
*** achanda has joined #openstack-nova14:35
*** iamjarvo has quit IRC14:36
bauzasjohnthetubaguy: tojuvone: sorry I was afk for the last 2 days because I had to run a meetup but I would like to review your changes again14:37
*** iamjarvo has joined #openstack-nova14:38
*** claudiub has quit IRC14:38
openstackgerritSean Dague proposed openstack/python-novaclient: refactor functional test base class to no inherit from tempest_lib  https://review.openstack.org/17585414:38
openstackgerritSean Dague proposed openstack/python-novaclient: wip: add ips to novaclient server manager  https://review.openstack.org/17560314:38
*** Marga_ has quit IRC14:40
*** pixelbeat has quit IRC14:41
tojuvoneOk. The OPNFV Doctor link is in the spec to have some Telco perspective, but really any HA interested would want all those VM and nova-compute states fast and reliably (meaning VMs are surely down if nova-compute marked down). And all this infra side monitoring HW specifically.. would be for external tool. Even configured by deployment to be perfect.14:41
tojuvoneI could look some material if you would like.14:43
*** achanda has quit IRC14:43
openstackgerritDan Smith proposed openstack/nova: Wedge DB migrations if flavor migrations are not complete  https://review.openstack.org/17448014:43
dansmithsdague: just checking in on the grenade branching progress...14:43
*** artom has joined #openstack-nova14:44
openstackgerritAndrey Kurilin proposed openstack/python-novaclient: Adds support for x509 certificates as keypairs  https://review.openstack.org/13645814:44
openstackgerritAndrey Kurilin proposed openstack/python-novaclient: Implements 'microversions' api type - Part 1  https://review.openstack.org/15256914:44
openstackgerritAndrey Kurilin proposed openstack/python-novaclient: Deprecate v1.1 and remove v3  https://review.openstack.org/16937814:44
openstackgerritAndrey Kurilin proposed openstack/python-novaclient: Implements 'microversions' api type - Part 2  https://review.openstack.org/16740814:44
*** jecarey has quit IRC14:44
sdaguedansmith: currently blocked on a potential oslo bug14:46
*** thomasem has quit IRC14:46
dansmithsdague: okay14:46
sdaguehttps://bugs.launchpad.net/oslo-incubator/+bug/144658314:46
openstackLaunchpad bug 1446583 in Keystone "services no longer reliably stop in stable/kilo" [Critical,In progress] - Assigned to Julien Danjou (jdanjou)14:46
alex_xudansmith: I'm here14:47
openstackgerritDan Smith proposed openstack/nova-specs: Add admin-query-any-keypair.rst  https://review.openstack.org/17557914:47
dansmithalex_xu: cool, could use your eyes on that ^14:47
sdaguethat actually has prevented grenade from passing on the d-g change that would enable stable/kilo upgrades14:47
sdaguebecause the services aren't stopping on the kilo side all the time14:47
alex_xudansmith: sure, will check now14:47
dansmithsdague: le suck14:47
tojuvoneThanks guys for the comments and interest :) Turning to more idle mode, evening here and home alone with 3 kids.14:47
*** iamjarvo has quit IRC14:48
johnthetubaguyvladikr: thanks, paperwork should be sorted for you now14:48
dansmithalex_xu: thanks, no rush14:48
sdaguedansmith: all the branches are there now, so that's the last patch that has to land to unblock you14:48
dansmithsdague: okay, I'm not in a rush, I just want to make sure I don't keep us blocked longer than necessary14:49
sdagueyep14:49
alex_xudansmith: np, will review asap :)14:49
sdagueI'll let you know as soon as it's ready to go14:49
sdaguehttps://review.openstack.org/175010 removes the class vars that confused everyone, even though they've been there for 2 years :)14:50
*** marun_ has joined #openstack-nova14:53
*** marun_ is now known as marun14:54
*** iamjarvo has joined #openstack-nova14:55
*** Marga_ has joined #openstack-nova14:55
*** sileht has quit IRC14:57
*** penick has joined #openstack-nova14:57
*** zhpan188 has joined #openstack-nova14:59
bauzasall, nova-scheduler meeting now in #openstack-meeting15:00
*** panbalag has joined #openstack-nova15:00
*** zhpan188 has left #openstack-nova15:01
dansmithI don't understand this RST complaint: http://logs.openstack.org/79/175579/2/check/gate-nova-specs-docs/bae69f8/console.html15:01
dansmithit's on a line with ``foo bar``15:02
dansmithwhich seems right to me15:02
*** wznoinsk has quit IRC15:03
jogolennyb: o/15:04
*** hemnafk is now known as hemna15:04
*** edleafe is now known as not_edleafe15:05
panbalagHi, I'm looking for Travis Ankrom. Could you please ping me if you are on this list?15:05
*** jecarey has joined #openstack-nova15:05
mtreinishdansmith: I think it's the space at the end of the line15:05
*** not_edleafe is now known as edleafe15:05
*** cbader has joined #openstack-nova15:05
*** dprince has quit IRC15:05
dansmithmtreinish: you mean before the closing ``?15:05
mtreinishdansmith: when I pulled it locally having the space before the trailing `` screwed up the syntax highlighting on my editor15:06
mtreinishdansmith: yeah15:06
openstackgerritSean Dague proposed openstack/python-novaclient: refactor functional test base class to no inherit from tempest_lib  https://review.openstack.org/17585415:06
openstackgerritSean Dague proposed openstack/python-novaclient: wip: add ips to novaclient server manager  https://review.openstack.org/17560315:06
dansmithmtreinish: hmm, okay I copied another example of that15:06
dansmithmtreinish: ah, yeah, that changes my highlighting too15:06
gilliard does seem to fix it, on http://rst.ninjs.org/ at least.15:06
gilliardOr you can insert a space after the first ``15:07
vladikrjohnthetubaguy, thanks a lot!15:07
*** apuimedo_ has quit IRC15:07
*** fawadkhaliq has quit IRC15:07
openstackgerritDan Smith proposed openstack/nova-specs: Add admin-query-any-keypair.rst  https://review.openstack.org/17557915:08
*** dave-mccowan has quit IRC15:08
*** xgsa has quit IRC15:11
*** jaypipes has quit IRC15:11
*** beagles is now known as beagles_brb15:11
*** mestery has quit IRC15:11
panbalagHi, has anyone configured SSL options in Nova?15:12
*** mestery has joined #openstack-nova15:12
openstackgerritJoshua Hesketh proposed openstack/nova: Fix max_number for migrate_flavor data  https://review.openstack.org/17589015:12
*** xgsa has joined #openstack-nova15:13
*** atuvenie_ has joined #openstack-nova15:13
*** lpetrut1 has joined #openstack-nova15:14
*** masayukig has quit IRC15:15
*** atuvenie has quit IRC15:15
*** baoli_ has quit IRC15:15
*** yamahata has quit IRC15:16
*** lpetrut has quit IRC15:16
*** baoli has joined #openstack-nova15:17
*** penick has quit IRC15:18
artomIs the openstack etherpad broken for anyone else? Ex: https://etherpad.openstack.org/p/nova-libvirt-meeting-agenda I get a 'Uncaught Error: Attempt to load undefined module'15:20
bauzasartom: can see it perfectly15:20
*** masayukig has joined #openstack-nova15:21
artombauzas, o_O15:21
bauzasartom: try refreshing your cache15:21
artomWhat the crap's going on with my browser then15:21
artombauzas, yep, clearing the cache fixed it, thanks!15:22
bauzasnp15:22
*** dave-mccowan has joined #openstack-nova15:22
*** MVenesio has quit IRC15:23
*** joefides has quit IRC15:23
*** tojuvone has quit IRC15:24
*** joefides has joined #openstack-nova15:24
dansmithupstream etherpad was upgraded recently,15:24
*** tojuvone has joined #openstack-nova15:24
*** MVenesio has joined #openstack-nova15:24
bauzasjohnthetubaguy: do you know if there is any BP for helping fixing the quota issues we have ?15:24
dansmithand etherpad is notorious for requiring aggressive cache flushing on the browser side15:24
*** eglynn has quit IRC15:24
*** IanGovett has quit IRC15:25
bauzasjohnthetubaguy: can only find https://blueprints.launchpad.net/nova/+spec/lock-free-quota-management15:25
*** wznoinsk has joined #openstack-nova15:26
*** dguitarbite has joined #openstack-nova15:27
*** Marga_ has quit IRC15:27
*** arnaud___ has joined #openstack-nova15:27
bauzasdansmith: I would just love a read-only mode for etherpad just giving plain HTML without using JS15:27
bauzaslike ?raw15:28
dansmiththere is that I think15:28
*** fawadkhaliq has joined #openstack-nova15:28
mriedemso i guess we're doing rc2 huh15:28
bauzasIIRC, the read-only mode still requires javascript to update the content15:28
*** doron_afk is now known as doron15:29
dansmithhttps://etherpad.openstack.org/p/nova-libvirt-meeting-agenda/export/txt15:29
bauzasdansmith: I owe you a beer15:29
dansmithbauzas: noted :)15:29
* bauzas giving free vouchers 15:29
johnthetubaguybauzas: not sure I have seen one15:29
bauzasjohnthetubaguy: ack15:30
johnthetubaguymriedem: dansmith: ttx has opened RC2 for us this morning, basically took all bugs with a tag and already committed on master at this point15:30
johnthetubaguybauzas: I think we need one though...15:30
dansmithjohnthetubaguy: okay cool15:30
bauzasjohnthetubaguy: https://etherpad.openstack.org/p/liberty-nova-summit-ideas L49 is providing some context, but not yet BPs15:30
*** Sukhdev has quit IRC15:31
*** annashen has joined #openstack-nova15:31
*** quaa has joined #openstack-nova15:31
*** pask81 has joined #openstack-nova15:31
dansmithjohnthetubaguy: oh you mean "already took" as "already +2/merged" ?15:32
johnthetubaguydansmith: stuff that is FixCommitted on master already, allowing those to be cherry picked on stable/kilo15:33
*** fawadkhaliq has quit IRC15:33
dansmithjohnthetubaguy: okay, but we can still decide what to actually apply, right?15:34
dansmiththere are several already pending against kilo, but they were proposed/kilo I think15:34
*** fawadkhaliq has joined #openstack-nova15:34
johnthetubaguydansmith: they got moved I think to stable/kilo15:34
johnthetubaguydansmith: if we don't like whats merged there, we can sure revert them, not sure who was doing the approve on stable, not checked that15:35
dansmithah, mine were all abandoned and I guess recreated15:35
johnthetubaguydansmith: mriedem: you can see it here, if that helps: https://launchpad.net/nova/+milestone/kilo-rc215:35
*** browne has quit IRC15:35
*** changbl has joined #openstack-nova15:36
*** annashen has quit IRC15:36
*** david-lyle has quit IRC15:36
dansmithso this is the list of pending ones: https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:stable/kilo,n,z15:36
dansmithall the others seem to have already merged?15:36
mriedemyeah15:36
*** thangp has joined #openstack-nova15:36
mriedemhttps://review.openstack.org/#/q/status:merged+project:openstack/nova+branch:stable/kilo,n,z15:36
*** IanGovett has joined #openstack-nova15:36
johnthetubaguyah, I guess ttx merged those: https://review.openstack.org/#/c/174078/  them seemed OK for backporting when I checked them, but happy to revert that if required15:37
mordredso that I can learn something ...15:39
dansmithsigh, well,15:39
mordredhttps://bugs.launchpad.net/nova/+bug/122334515:39
openstackLaunchpad bug 1223345 in OpenStack Compute (nova) "Soft-deleted instance files deleted by periodic cleanup task" [High,Fix released] - Assigned to Hans Lindgren (hanlind)15:39
mordredwhy is it that someone wouldn' want soft-deleted instanaces cleaned up?15:39
mordredand/or what if someone _did_ want soft-deletes to just diaf15:39
dansmithmordred: because soft-deleted instances are supposed to be undeletable15:39
mordredaroo?15:39
dansmithjohnthetubaguy: I guess the rest of the ones up there are important, and not worth reverting anything already merged15:40
mordreddansmith: can I translate that to mean "it is the intent of nova to keep soft-deleted rows in the database until the end of time" ?15:40
dansmithmordred: there is a "restore instance" call that undeletes a thing15:40
mordredah15:40
*** amotoki has quit IRC15:41
dansmithmordred: well, I think in the case of soft-deleted instances there is an interval for which they're still available, IIRC, but I don't really know15:41
*** andreykurilin__ has joined #openstack-nova15:41
dansmithmordred: but as you know, nova has a confused relationship with deleted things15:41
mordredit just seems that with a cleanup thread, having a longer undelete-available interval would be friendlier to operators15:41
mordreddansmith: well, I'm learning this15:41
*** kaisers has quit IRC15:41
mordreddansmith: I don't really think I fully grokked the extent of the confusing relationship15:41
ttxjohnthetubaguy: we shouldn't have merged that one ?15:41
ttxjohnthetubaguy: is it the bug is invalid or the fix in invalid ?15:42
dansmithmordred: we have soft delete of instances, plus soft-delete of rows, plus shadow tables, plus zero ability to define when something can be moved from soft-deleted to shadow without breaking things15:42
dansmithmordred: (AFAIK)15:42
mordreddansmith: that's so exciting15:42
clarkbmordred: dansmith is there a way as a user to indicate when deleting an instance that i neverwant to be able to restore the instance so just really delete it?15:43
johnthetubaguyttx: not sure at this point, just checking in general with other folks and if they are happy with all the ones we backported15:43
dansmithmordred: it's like russian roulette.. with your production DB :)15:43
*** amotoki has joined #openstack-nova15:43
*** amotoki has quit IRC15:43
dansmithclarkb: soft delete is different than delete from a user perspective I think15:43
johnthetubaguydansmith: thanks for checking that lift for me, they all seemed worth backporting15:43
dansmithclarkb: i.e. delete means "I don't want to maybe undelete"15:43
mriedemthere is a command to move deleted rows to shadow tables http://git.openstack.org/cgit/openstack/nova/tree/nova/cmd/manage.py#n92015:44
openstackgerritDoug Hellmann proposed openstack/python-novaclient: Update README to work with release tools  https://review.openstack.org/17594715:44
ttxjohnthetubaguy: looks like it was originally proposed for release by a "Dan Smith". Probably an alias.15:44
mriedembut that doesn't 'delete' things15:44
clarkbdansmith: I don't think that is what we are experiencing15:44
dansmithttx: some of the proposed things were good, others I think needed some discussion15:44
clarkbbut mordred has actual details15:44
dansmithttx: not worth it at this point15:44
mordredI don't suppose there is an option which says "just perform the SQL delete and don't do soft-deletes or shadowtables kthxbia" is there?15:44
dansmithmordred: nope15:45
dansmithmordred: we never actually delete anything ever15:45
dansmithmordred: the closest is moving something from real to shadow tables15:45
dansmithmordred: except for a few cases of smaller things, but nothing you have visibility to I tink15:45
ttxdansmith, johnthetubaguy: ok well, keep me posted15:45
mordreddansmith: well - I mean - infra creates and deletes 20k instances a day on our clouds15:45
dansmithmordred: clarkb: just in defense of everyone where, this has been the case since the dawn of time, in case it's not clear :)15:46
mordreddansmith: so we wind up producing HUGE amounts of data in those tables over time15:46
johnthetubaguymordred: we actually go and delete those records after a month now15:46
dansmithmordred: right, actual cleaning of the DB is left as "an exercise for the operator" :/15:46
mordreddansmith: that's so friendly15:46
johnthetubaguymordred: and yes, the tables got very large15:46
dansmithmordred: see ^ :)15:46
mordredjohnthetubaguy: but by we - you mean rackspace, not nova?15:46
dansmithyes, that's what he means15:46
dansmithmy "we" is nova, his "we" is actual people15:47
johnthetubaguymordred: yeah, sorry, I mean public cloud at rackspace in that case, different hat on there for a moment15:47
mordredjohnthetubaguy: if both of the public cloud providers are now deleting the rows on a cronjob - why not add an option to nova.conf to have the cleanup thread delete rows when it runs?15:47
*** baoli has quit IRC15:47
mriedemjohnthetubaguy talks in the royal 'we' now that he's PTL :)15:47
johnthetubaguydansmith: I just use we for both and let folks guess, my bad15:47
dansmithjohnthetubaguy: heh15:47
mordredI mean, it seems like nova is already doing that sort of thing - cleaning up after itself would be a friendly thing for the operators15:47
dansmithwe[0] == rax, w[1] == nova15:47
mordreddansmith: :)15:48
johnthetubaguylol15:48
dansmithmordred: well, part of the problem is, it's dangerous and hard to actually know when it's okay in some cases15:48
dansmithmordred: so we shift the risk to the operators15:48
mordreddansmith: that seems like a bug15:48
dansmithmordred: I don't really disagree :)15:48
mordred:)15:48
dansmithmordred: now that we have flavors separated from instances, we could get a lot closer15:49
johnthetubaguymordred: for context, turns out we updated our script so it doesn't delete so fast if it sees the read slaves lagging behind the master too log, sigh, turns out its deployment specific, but I should get that uploaded somewhere public15:49
dansmithmordred: but in the past, it has been because of linkages among data structures15:49
*** baoli has joined #openstack-nova15:49
mordreddansmith: hang on ...15:49
* dansmith waits for an incoming missile from mordred 15:49
mordreddansmith: you're telling me taht even though we do the thing that makes me unhappy and actually cause sqlalchemy to produce foreign keys in the database which is the most insane stupid thing ever for scalability15:49
mordredwe ALSO don't actually gain the data protection from doing so?15:50
mordredso all of teh production scalability cost with none of the tenuous benefits?15:50
mriedemwe don't use cascading deletes on FKeys either15:50
dansmithmordred: we do in some cases, but not all I think probably, yeah15:50
dansmithyeahg15:50
* mordred gets out the stabbing stick15:50
dansmithmordred: again, this predates many of the folks here15:50
dansmithso don't stab us :)15:50
mordreddansmith: oh - I know who to blame ...15:51
mriedemi wouldn't mind a good stabbing15:51
*** atuvenie_ has quit IRC15:51
* mordred stabs mriedem on general principle15:51
*** fawadkhaliq has quit IRC15:51
dansmithso violent!15:51
* mriedem enjoys the warm blood oozing15:51
*** matrohon has quit IRC15:51
mordredso I now have 3 things to rage-code on in nova ...15:51
bauzasmordred: there was an abandoned spec about something on trigger https://review.openstack.org/#/c/132656/15:51
*** fawadkhaliq has joined #openstack-nova15:51
*** otter768 has joined #openstack-nova15:51
* johnthetubaguy feels like I should get the use of some kind of helpline number for use by community members15:52
dansmithat least for mordred ...15:52
*** baoli has quit IRC15:52
mriedemwhat were the other 2 things?15:52
bauzaseh :)15:52
dansmithyou had to ask...15:52
mordredwell - thing one is I'm going to go absolutely postal on the assinine table locks related to quotas15:52
*** sdake is now known as sdake-afk15:52
mordredbeacuse BONGHITS15:53
mriedemyou missed 420 by a day15:53
mriedemsorry15:53
johnthetubaguymordred: best bit, it doesn't work15:53
mordredthing two is I'm going to finish that spec that was just linked because nova should clean after itself15:53
dansmiththe quota stuff is problematic, I think that's well known15:53
mordredthing three is that I'm going to delete all foreign keys with prejudice because they're stupid and not giving any value15:53
*** baoli_ has joined #openstack-nova15:53
bauzasmordred: be happy, we just removed one15:54
mriedemgiven we don't cascade anything on the FKeys i'd agree with that15:54
mordredbauzas: yay!15:54
mordredmriedem: I know of literally zero large-scale mysql sites that use them15:54
bauzasmordred: but wrt live upgrades, we are still paying debt by keeping them till the next release15:54
mordredand I know of literally no large-scale postgres sites :)15:54
sdaguemordred: they all emulate it in the application?15:54
mordredsdague: yup15:54
mordredsdague: it's too costly to do them in teh db15:55
mordredthe db is the hardest scaling point to have things centralized15:55
*** atuvenie_ has joined #openstack-nova15:55
dansmithwell,15:55
sdagueso... isn't that the whole point of the R in RDMS ?15:55
*** ijw has quit IRC15:55
mordredsame reason using stored procedures is a nono in large deployments15:55
mordredsdague: yse15:55
dansmithwith our objects facade we have a good place to do that emulation15:55
dansmithas we do for flavors now15:55
mordredsdague: but you don't need it enforced by the engine15:55
mordredyou just want the relational algebra15:55
*** ijw has joined #openstack-nova15:55
sdagueok15:55
sdaguedansmith: yeh, what's left in the stale references?15:56
*** otter768 has quit IRC15:56
dansmithsdague: parse error15:56
*** dboik has quit IRC15:56
mordredhowever - quotas and deletes are top on my list15:56
sdagueso, flavor is now delete safe, because we keep a copy of the flavor we were started with15:57
mordredwell, after I finish coding my "please give me the ssh-host-key of the instance" feature15:57
*** dboik has joined #openstack-nova15:57
*** sileht has joined #openstack-nova15:57
dansmithsdague: yeah15:57
sdaguewhat are the other problematic relationships that still exist and can explode if we just deleted stuff15:57
*** dboik has quit IRC15:58
*** dboik has joined #openstack-nova15:58
artommordred, the bit that mriedem linked though, http://git.openstack.org/cgit/openstack/nova/tree/nova/cmd/manage.py#n92015:58
dansmithsdague: probably lots. IPs, networks,15:58
dansmithsdague: I could pull up the model if you want, but there are things15:58
artomThat + something that empties out the shadow tables == a really ugly delete, no?15:58
*** armax has left #openstack-nova15:58
*** Sukhdev has joined #openstack-nova15:58
sdagueyeh, ips and networks seem a little trickier15:59
dansmithyeah15:59
*** dboik has quit IRC15:59
dansmithmetadata entries15:59
*** dboik has joined #openstack-nova15:59
dansmithactually, most everything16:00
dansmithconsoles, dns stuff16:00
*** armax has joined #openstack-nova16:00
*** ijw has quit IRC16:00
dansmithbasically you just have to run through almost all models, delete where instance_uuid=$uuid16:00
dansmiththen you can delete the real instance16:00
dansmithmost things are instance-centric16:00
dansmithso if you delete them before the instance, you're okay16:00
dansmithbut there are things the instance depends on16:01
sdaguedansmith: shouldn't it be the other way around?16:01
*** tsekiyama has joined #openstack-nova16:01
sdaguedelete the instance first16:01
bauzassdague: you can't, FK16:01
*** armax has left #openstack-nova16:01
mriedemright, everything has a fkey on instances.uuid16:01
ndipanovwhat's the problem with FKs again16:01
dansmithsdague: well, things that are discoverable from the API would hit InstanceNotFound errors if they get listed while you've got the instance deleted16:01
ndipanovI missed that class16:01
mriedemso you have to do what i did in my cleanup script for null instances.uuid16:01
*** armax has joined #openstack-nova16:02
*** vilobhmm1 has joined #openstack-nova16:02
*** david-lyle has joined #openstack-nova16:02
bauzasndipanov: the problem is at scale how to purge the DB16:02
*** Marga_ has joined #openstack-nova16:02
dansmithsdague: then there are things like the instance->info_cache dependency16:02
*** baoli_ has quit IRC16:02
bauzasndipanov: and FKs make the cleanup a little harder16:02
dansmithnot sure which way that needs to go16:02
sdagueright, gotcha16:02
ndipanovbauzas, well for the right reasons16:03
ndipanovso that you don't have to think about that sort of consistency in your app16:03
bauzasndipanov: here, the question is : should that be abstracted for operators ?16:03
*** redbeard has quit IRC16:04
*** atuvenie_ has quit IRC16:04
bauzasndipanov: atm, this is a DIY stuff16:04
*** baoli has joined #openstack-nova16:04
ndipanovbauzas, abstracted as - something like shadow-tables so taht you can clean things up but that doesn't suck?16:04
bauzasndipanov: abstracted like - I want to ask Nova to really delete my deleted instances forever16:05
*** sahid has joined #openstack-nova16:05
bauzasI'm just a little concerned about all the locks we could get on the tables, wrt all the FKs we have :)16:06
dansmithcan someone +W this please?16:06
dansmithhttps://review.openstack.org/#/c/175890/216:06
bauzasit's like "push the button and we freeze all the tables to your convenience"16:06
*** pixelb has joined #openstack-nova16:06
artomPfft, the real solution is to get Western Digital to sponsor OpenStack and ship a free disk or two to all operators.16:06
dansmithjohnthetubaguy: that's a bug, but probably not worth putting in RC2 and just backporting, but I'll let you decide16:06
*** ildikov has quit IRC16:06
mordredndipanov: anything that is for the reason "so you don't have to think about the consistency in your app" is a mistake16:07
mordredbecause the app's job is to think about the consistency16:07
mordredand there is a model class16:07
mordredthat encapsulates that16:07
ndipanovmordred, well why use relational dbs then16:07
mordredthat the logic about how to perform basic tasks is split across two places and almost nobody understands how to safely perform a task like "delete teh instance records" is a clear indication that the theory is not working16:07
mordredndipanov: because there are HUGE benefits to the data model16:08
dansmithmordred: probably worth noting that you're talking about using them at crazy scale, because the point of the constraints is defining what you want the DB to enforce for you in a normal case16:08
mordredndipanov: you don't need db level enforcement of the foreign keys to reap them16:08
*** ijw has joined #openstack-nova16:08
mordreddansmith: yes16:08
mordredthis is why defining them in the sqlalchemy model is a GREAT idea16:08
mordredactually applying them at the db level is the thing that does not scale and provides no benefit16:08
ndipanovmordred, k - in that case I'd say we should look at whether our data model is sane for how we use it vs. blanket kill FKs16:08
dansmithndipanov: thought you knew, mordred has two settings: "off" and "kill with fire"16:09
mordredndipanov: well, there are zero cases in which a production database should actually have FKs applied to it - but I agree, working on the data model is actually the important task - not fighting with  me about megascale database things :)16:09
bauzasyay, let's denormalize stuff !16:09
*** atuvenie_ has joined #openstack-nova16:10
mordredwell16:10
mordredwe having the good table and relationships == good16:10
mordredhaving some summary tables (materialized views) == performance optimization, also good16:10
ndipanovagreed16:10
*** ijw_ has joined #openstack-nova16:11
bauzas+116:11
*** moshele has quit IRC16:11
*** dsanders has joined #openstack-nova16:11
mordredquotas, for instance, should be being run on a rollup/summary table rather than directly on the underlying information tables16:11
mordredbecause you can get actual atomic update operations that way16:11
mordredand if somethign goes wrong, you can always rebuild the summary table from the base data16:12
ndipanovI don't know - I get the argument that with fk's your encoding logic into your db schema and in your app16:12
artommordred, isn't it the RDBMS's job to ensure atomicity?16:12
mordredso no need for locking _at_ _all_ and blinding fast speed and at least as semantically correct as current16:12
mordredartom: only if you want to write academic papers16:12
*** ijw has quit IRC16:12
ndipanovI just can't help but think that killing them you trade one class of bugs for another16:12
mordredndipanov: put them in teh app model - awesome16:13
artommordred, why is it bad in real life?16:13
mordredartom: because they are a scaling bottleneck16:13
artomAh, that's a different thing16:13
mordredand if your app doesn't understand the object model you're screwed anyway16:13
mordredalso - once you shard data into more than one db16:13
mordredyou can't use them anyway16:13
artommordred, if you want scale don't chose RDBMs16:13
mordredartom: wrong16:13
artomThat's the real problem16:13
mordredartom: categorically untrue16:14
bauzasartom: not really, it's about how you shard your model16:14
*** doron is now known as doron_afk16:14
mriedemmordred: are any other openstack projects using views?16:14
mordredartom: and I will happily point you at facebook adn google as my examples16:14
mordredmriedem: you don't actually want VIEWs16:14
openstackgerritDan Smith proposed openstack/nova: Adding user_id handling to keypair index api call  https://review.openstack.org/7048516:14
mordredmriedem: you want app-generated summary tables16:14
mordredviews in mysql are not materialized and are a terrible idea in production16:14
artommordred, I know Facebook uses MySQL, don't know how they scale it though.16:14
mordredartom: I do :)16:14
artommordred, didn't know Google used MySQL at any sort of scale.16:15
artommordred, well, how? :)16:15
mordredartom: the main money maker for google, adsense, runs 100% on mysql16:15
ndipanovso once you get rid of the FKs, you also say I won't use a number of feature given to me by MCC your db implements and you have to be careful about thos in your code too16:15
mordredartom: sharding16:15
mordredndipanov: yes16:15
ndipanovsometimes that's OK16:15
mordredbut you have to be careful in your code _Anyway)16:15
ndipanovbut sometimes you open yourself to ugly race conditions16:15
mordredsure16:15
ndipanovright that;s true16:15
mordredmain thing is - the db - rdbms or not, is not a magic wand16:16
mordredit's not going to design an app for yoy16:16
artommordred, and in what way sharding prevents FKs/atomicity?16:16
ndipanovyes true16:16
mordredartom: FKs don't work across servers16:16
mordredartom: when part of your model is on one server and part is on another server, you MUST handle the logic in your code16:16
artommordred, wait, model?16:16
bauzasartom: usually, you want to shard per col16:17
bauzasartom: and not per row16:17
mordredartom: yes. say you have your instances split across 10 servers - and there isa  whole other server for flavors16:17
artombauzas, ah!16:17
mordredbauzas: you might want to do both16:17
*** beagles_brb is now known as beagles16:17
mordredsharding by row is known as horizontal sharding, sharding by column as vertical16:17
bauzasmordred: yay, was just giving the reason why it doesn't work :)16:17
artomBut then haven't you basically recreated a key-value store in SQL?16:17
mordredand big places tend to use a combination of both16:17
mordredbauzas: :)16:17
mordredartom: nope16:18
artomSince all the logic is in the code anyways?16:18
*** romainh has left #openstack-nova16:18
mordredartom: because on a per-server basis you still get the benefits of indexes and joins16:18
bauzasartom: that's just trade-off16:18
mordredartom: so what you have is sharded indexing16:18
bauzas+116:18
*** fawadkhaliq has quit IRC16:18
mordredand properly design indexes and joins are super useful16:18
artomKey-value stores tend to have indeces (or equivalents), no?16:19
mordredthey're getting there16:19
bauzasartom: in general, you shard wrt your model to make joins locally16:19
*** doron_afk has quit IRC16:19
mordredand key/value stores are useful in some cases16:19
bauzasartom: that would speed up local joins while your app can still scale16:19
mordredyup16:19
mordredartom: often times people will use a key-value layer on top of the rdbms layer as a smart-cache16:20
*** fawadkhaliq has joined #openstack-nova16:20
mordredso instead of making a summary table16:20
mordredyou make a key-value entry with the summary in the blob16:20
*** iamjarvo has quit IRC16:20
mordredbut you also but the main data into the rdbms16:20
mordredso that you don't have to care about the data longevity in the key-value16:20
mordredsince most of them do not have the production usage to be at the point of knowing their failure domains well enough to trust them as the ultimate store of all of your things16:21
mordredthere isn't a single right answer for any of this - other tahn FKs being bong :)16:21
*** jistr has quit IRC16:21
*** Sukhdev has quit IRC16:22
artomOne day too late for bong ;)16:22
*** doude has quit IRC16:22
*** xgsa has quit IRC16:23
artomAnd yet after all this, we're no closer to having a clean delete in Nova :)16:23
*** fawadkhaliq has quit IRC16:23
*** greghaynes has joined #openstack-nova16:23
artomSince I don't think a patch called "DELETE ALL FKS FOREVAR" will get merged anytime soon ;)16:24
mriedemoh idk16:24
*** vilobhmm1 has quit IRC16:24
artom(Thanks for the answers though, I've learned)16:24
mriedempush a patch with the db migration that does it, run it through check to see if there are bugs16:24
bauzasmriedem: agreed, I think it's doable16:25
bauzasartom: I made the move for the service/compute FK and that was really not an issue16:25
mriedemyeah i don't really see a problem with it since the FKeys don't do anything since they don't cascade anything16:25
artomMaybe nothing currently existing will break, but I feel like that's opening up a whole slew of new bugs as ndipanov said.16:26
bauzasartom: the main problem I had was that I was providing a new column for doing the denormalization and *that* was the problem16:26
ndipanovso a quick search on google seems to imply taht innodb should not have a massive overhead on locking for FKs16:26
mriedemartom: but we can still orphan deleted stuff with fkeys today since we don't have ondelete=cascade16:26
ndipanoviow - if there is massive locking caused by FKs - your model or queries are likely wrong16:27
bauzasndipanov: I can ask some peers I know about that, but I think it's not really a black-or-white answer16:27
*** dsanders has quit IRC16:27
*** dsanders has joined #openstack-nova16:27
ndipanovwhat do you mean16:27
bauzasndipanov: that depends on your reads and writes mostly16:27
ndipanovI literally just said the exact same thing16:27
* mriedem is surprised no one has summoned zzzeek yet16:28
* zzzeek is making his lunch so will be here in 1016:28
bauzasndipanov: then I missed it :)16:28
* mriedem goes to lunch16:28
ndipanovwell I said it in a slightly inverted way16:28
*** pask81 has quit IRC16:29
*** dprince has joined #openstack-nova16:29
bauzasndipanov: well you implied that having locks means that your model is wrong IIUC16:29
*** BobBall has quit IRC16:29
bauzasndipanov: I'm not that explicit16:30
*** jaypipes has joined #openstack-nova16:30
*** jlvillal has quit IRC16:30
*** exploreshaifali has joined #openstack-nova16:30
*** jlvillal has joined #openstack-nova16:30
bauzasndipanov: like table A and table B have relationships, but both can be written for good reasons16:30
ndipanovbauzas, so as an example - if most of your modifications include something that will lock the related table16:30
ndipanovthen that field should not be a FK for sure16:30
bauzasI see16:31
artommriedem, so there's no cascade... then FKs are currently used just to... enforce relational integrity?16:31
*** tojuvone has quit IRC16:31
ndipanovotherwise - it seems to me that you get stuff for mostly free16:31
artomAnd not even that, since, well, delete16:31
ndipanoviow - you need to consider the behavior of your app16:32
*** annashen has joined #openstack-nova16:32
ndipanovI have no idea what mordred was seeing wrt quotas but I can well believe that it;s fubar16:32
zzzeeklooks like its something about FKs.  Please use adequate normalization and please use FKs.  they work great.  that is all16:32
ndipanovthanks! :)16:32
ndipanovwhat I am not sure about is "nuke FKs" as a remedy :)16:33
mordredzzzeek: he.16:33
mordredzzzeek: I do and always have disagreed with you16:33
mordredbut that's ok16:33
mordredzzzeek: FKs in sqlalchemy model == yes16:33
mordredzzzeek: FKs applied to db == silly16:34
artommordred, wait, you can separate the two? I thought it was pretty much a 1:1 mapping...16:34
zzzeekmordred: it’s nice to know that a DB will never have orphaned records that crash the app16:35
zzzeekartom: theres the notion that the schema has FK-like relationships, then there is the constraint itself16:35
*** Mike_D_laptop has joined #openstack-nova16:35
mordredzzzeek: sure. but for all the reasons listed above, if you depend on the rdbms catching taht for you, you are limiting how well you can scale your app if you need to grow past a single server16:35
artomzzzeek, oh, so pulling an example out of my ass, something like "network_id" in the instances table without actually setting the FK constraint?16:36
mordredzzzeek: which is why you should for sure design as if you had them16:36
mordredzzzeek: and in fact, in dev/test you shoudl apply them to the db16:36
zzzeekmordred: OK there’s a lot in there.  “grow past a single server”, that’s a whole ball of wax16:36
mordredso that all of your tests will catch it16:36
mordredzzzeek: yah16:36
zzzeekcan mean many things16:36
*** Marga_ has quit IRC16:36
zzzeekmordred: if tables are vertically sharded across DBs, then yes, having an FK is clearly not worth it16:36
*** annashen has quit IRC16:37
zzzeekmordred: if tables are horizontally sharded, then you are probably crazy anyway :)16:37
*** Marga_ has joined #openstack-nova16:37
mordredzzzeek: :)16:37
mordredzzzeek: what if they're both?16:37
zzzeekmordred: we are 95% in agreement. if youre just saying, “turn them off in production”, but otherwise they’re fully present both conceptially as well as physically in test environments, fine16:37
mordredzzzeek: yes. that's all I'm saying16:37
*** iamjarvo has joined #openstack-nova16:37
zzzeekmordred: sure16:38
*** mpaolino has quit IRC16:38
*** Marga_ has quit IRC16:38
ndipanovwell you can do that even now no?16:38
mordredzzzeek: in fact, thanks - I think I should be clearer when I describe my POV on this16:38
*** Marga_ has joined #openstack-nova16:38
*** arnaud___ has quit IRC16:39
zzzeekin Oracle we jsut emit some system setting to do it.  on MySQL, I dont know that there’s just a schema- or table-wise setting for it, you maybe have to emit different DDL.   our migration setups dont quite ahve that feature right now though it is doable16:39
*** derekh has quit IRC16:39
ndipanovI see16:39
*** ijw_ is now known as ijw16:40
*** exploreshaifali has quit IRC16:40
openstackgerritSean Dague proposed openstack/python-novaclient: add ips to novaclient server manager  https://review.openstack.org/17560316:41
sdaguemordred: ^^^ gives you the extra call you wanted in novaclient16:43
*** browne has joined #openstack-nova16:43
*** sdake-afk has quit IRC16:44
*** jichen has quit IRC16:45
mordredsdague: yay!16:45
*** annegentle has quit IRC16:47
*** READ10 has joined #openstack-nova16:47
ndipanovinteresting discussion - we should do more of those...16:47
mordredndipanov: I agree!16:48
*** dsanders has quit IRC16:49
*** kaisers has joined #openstack-nova16:50
bauzasdansmith: re: https://review.openstack.org/#/c/164762/9 I wonder why we couldn't put the logic outside of the object16:50
*** mpaolino has joined #openstack-nova16:50
bauzasdansmith: I saw you were not against the idea of adding a new remotable method for a specific usecase hence my wonders16:51
bauzasdansmith: I don't really like having myspecificmethodformysingleuse() being remotable16:52
bauzaswell, I'm not saying having it remotable is bad, just that it makes things worst16:52
dansmithbauzas: well, the less specific it is, the more data we send over rpc just to do the filtering on the other side16:53
bauzasdansmith: agreed, but here the payload is really slow16:53
dansmithbauzas: I agree that adding them for no reason is just debt, but if there's a good reason, it makes sense16:54
bauzass/slow/small16:54
bauzasdansmith: and like I said, it's just a matter of how many instances we have per group16:54
bauzassee the other https://review.openstack.org/#/c/169489/6/nova/objects/instance_group.py,cm16:54
bauzasdansmith: in 2 patches, we're just adding 2 new remotable methods for just a single usecase that can be done in the same loop16:55
dansmithin this case, I'm not sure doing this outside the remotable is still the same thing16:56
bauzasdansmith: iterating over the list of computes is the same16:56
dansmithyou'd have to request all the instances on all hosts that are represented in the group, which could be large for even a small group, right?16:56
bauzasdansmith: so we can do both checks in the same loop16:56
bauzasdansmith: yeah that's O(n)16:57
*** harlowja_away is now known as harlowja16:57
bauzasdansmith: but that sounds a small price to pay IMHO, in particular if 2 methods are doing that16:57
bauzasdansmith: so we can just do the loop once16:58
dansmithbut instances are really large16:58
dansmithand also,16:58
*** annashen has joined #openstack-nova16:59
bauzaswell, we're getting the list of hosts whose at least one instance is in the server group16:59
dansmithI feel like there is a certain amount of atomicity we may want to have for something like this that we can't guarantee across multiple calls16:59
dansmithgranted, the point is that ids are monotonically increasing, but that could be different with a different backend17:00
bauzasdansmith: that's also another concern I didn't raise17:00
bauzasdansmith: because I don't like checking against IDs17:00
bauzasthat's just assuming that it won't change17:00
bauzasdansmith: so before commenting saying I was disagreeing, I have to think why it's just all of that needed17:01
dansmithbauzas: right, but the semantics of the call do not imply comparison by id, which means we could change it later without the client needing to know17:01
bauzaslike saying that we add an instance in a group before even making sure that instance can be booted seems like a bit optimistic to me17:01
dansmithI don't follow17:02
bauzassorry17:02
bauzasthe problem is that the instances being booted are already part of the group, right ?17:02
dansmithwe have to put it into the group/host before we start booting it and then if it fails, we roll back17:02
dansmithno17:02
dansmithit's that the instance is assigned to the host17:02
*** vilobhmm1 has joined #openstack-nova17:04
bauzasdansmith: so the validation call is getting the host, I see17:04
*** vilobhmm11 has joined #openstack-nova17:04
*** davideagnello has joined #openstack-nova17:04
bauzasdansmith: in that case, why not filtering out get_hosts using the instance_uuid ?17:04
bauzasI mean using the exclude arg ?17:05
dansmithsorry, I'm really confused17:05
*** Sukhdev has joined #openstack-nova17:05
dansmithwe filter by the uuids in the group17:05
bauzasI think I'm confused too17:06
bauzasokay, before discussing further I need to better understand what the problem is17:06
bauzasbecause I probably misunderstood17:06
davideagnellohello, I have been trying out Tempest and Rally for integration and scenario testing for stackforge project Cue.  Nova has tests in both frameworks, I would like to get some feedback tempest vs. rally, using one or both.17:06
mriedemdavideagnello: you probably want to be in the #openstack-qa channel17:07
davideagnelloit looks like we are going to use tempest for integration tests and rally for e2e scenario testing17:07
davideagnellomriedem: ok, thanks.  Just wanted to get some feedback from Nova group on using these frameworks.  Will post there as well.17:08
mriedemnova doesn't gate on rally, only tempest right now17:08
*** david-lyle has quit IRC17:08
*** vilobhmm1 has quit IRC17:08
davideagnellomriedem: ok, any reason to not include rally as well?17:09
mriedemi'm not really sure honestly, it's come up before17:10
dansmithdavideagnello: answers to those questions are found in -qa :)17:10
*** atuvenie_ has quit IRC17:10
davideagnellodansmith: thanks, posted there as well17:10
* dansmith goes there to watch the fireworks17:11
davideagnellomriedem: ok I see17:11
openstackgerritVilobh Meshram proposed openstack/nova: WIP: Replace service groups with the tooz groups  https://review.openstack.org/17250217:11
*** ijw has quit IRC17:12
*** ijw has joined #openstack-nova17:12
*** Sukhdev has quit IRC17:12
*** ijw has quit IRC17:17
*** fawadkhaliq has joined #openstack-nova17:21
*** patrickeast has joined #openstack-nova17:22
*** asselin has quit IRC17:24
*** fawadkhaliq has quit IRC17:26
*** tonytan_brb has joined #openstack-nova17:26
*** achanda has joined #openstack-nova17:26
*** tonytan4ever has quit IRC17:27
*** sdake has joined #openstack-nova17:28
*** lucasagomes is now known as lucas-dinner17:29
*** ajayaa has joined #openstack-nova17:29
*** asselin has joined #openstack-nova17:29
*** lpetrut1 has quit IRC17:30
*** ijw has joined #openstack-nova17:31
*** kmartin has joined #openstack-nova17:31
*** VW_ has quit IRC17:32
*** annegentle has joined #openstack-nova17:32
openstackgerritBrent Eagles proposed openstack/nova: WIP: Add support for VIF plugin script to Nova  https://review.openstack.org/16247017:33
*** VW_ has joined #openstack-nova17:34
*** nkrinner has quit IRC17:34
*** VW_ has quit IRC17:34
*** VW_ has joined #openstack-nova17:35
*** rdo has quit IRC17:36
*** asselin has quit IRC17:36
*** penick has joined #openstack-nova17:36
*** aix has quit IRC17:37
*** asselin has joined #openstack-nova17:37
*** dguitarbite has quit IRC17:38
*** annegentle has quit IRC17:38
*** rdo has joined #openstack-nova17:38
*** annegentle has joined #openstack-nova17:39
*** dsanders has joined #openstack-nova17:40
*** iamjarvo has quit IRC17:44
*** fawadkhaliq has joined #openstack-nova17:48
*** mpaolino has quit IRC17:48
openstackgerritBrent Eagles proposed openstack/nova: WIP: Add support for VIF plugin script to Nova  https://review.openstack.org/16247017:49
*** otter768 has joined #openstack-nova17:52
*** samueldmq has quit IRC17:53
*** annegentle has quit IRC17:53
*** otter768 has quit IRC17:57
*** vilobhmm11 has quit IRC17:59
*** joefides has quit IRC17:59
*** tonytan_brb is now known as tonytan4ever17:59
*** vilobhmm1 has joined #openstack-nova17:59
*** vilobhmm1 has quit IRC17:59
*** tjones1 has joined #openstack-nova17:59
*** joefides has joined #openstack-nova17:59
*** vilobhmm1 has joined #openstack-nova18:00
*** melwitt has joined #openstack-nova18:00
*** vilobhmm1 has quit IRC18:00
*** vilobhmm1 has joined #openstack-nova18:00
*** vilobhmm11 has joined #openstack-nova18:02
*** vilobhmm12 has joined #openstack-nova18:02
*** dsanders has quit IRC18:03
sahidan interesting fix ready to be merged here https://review.openstack.org/#/c/173187/18:03
sahidmriedem: ^ perhaps you can check it18:03
cfriesenbauzas: dansmith: sorry, didn't see you were discussing my proposed changes.  In both cases we could move the logic to nova-compute.  Ultimately it would mean calling objects.InstanceList.get_by_filters() and getting all the instances in the group (serializing them and passing them over the wire back to compute manager).  The advantage of the new remotable methods is that the RPC response is just one or more hostnames instead18:04
cfriesenof the full object for all instances in the group.18:04
dansmithcfriesen: I'm not sure we were :)18:04
mriedemsahid: has ndipanov seen that change?18:04
*** vilobhmm1 has quit IRC18:04
cfriesendansmith: https://review.openstack.org/#/c/164762/9 and https://review.openstack.org/#/c/169489/6/nova/objects/instance_group.py,cm18:04
dansmithcfriesen: right, I said that18:05
sahidah i don't think, perhaps it was to ask him18:05
sahidi will do tomorrow morning18:05
sahidit was better18:05
*** joefides has quit IRC18:05
*** annegentle has joined #openstack-nova18:05
vilobhmm12sahid  : ping18:05
mriedemsahid: i can take a look, i just know ndipanov is more familiar with the cpu pinning/numa stuff than me18:05
sahidmriedem: yes sure it's right18:06
sahidvilobhmm12: yes ?18:06
*** dsanders has joined #openstack-nova18:06
*** vilobhmm11 has quit IRC18:07
vilobhmm12are you still working on this https://review.openstack.org/#/c/168876/ ?18:07
vilobhmm12since its related to something I have been working as part of moving servicegroup to tooz so thought will check with you18:07
vilobhmm12sahid : ^618:08
vilobhmm12sahid : ^^18:08
sahidvilobhmm12: well i got complans for Hans so i expected to get other reviews18:08
sahidcomplains18:08
*** dsanders has quit IRC18:08
*** dsanders has joined #openstack-nova18:09
dansmithsahid: "complaints" .. with a T :)18:09
vilobhmm12ok…18:09
*** sdake_ has joined #openstack-nova18:09
sahidvilobhmm12: how it is related to your work? basically it just remove the method get_all18:09
*** eglynn has joined #openstack-nova18:09
sahiddansmith: yes :/ needs to do more efforts with english18:10
sahidi need !18:10
dansmithsahid: me too :)18:10
cfriesendansmith: bauzas: we will only ever do one of the checks...for anti-affinity we need the hosts of all earlier instances, and for affinity we need the host of the earliest instance.18:10
*** annegentle has quit IRC18:10
cfriesendansmith: bauzas: I suppose one option would be a single remotable function to return the hosts of earlier instances, along with the instance ID of the lowest-id group member running on that host.  Then the affinity case could just pick the host with the lowest id number.  Seems a little hacky though.18:12
*** sdake has quit IRC18:13
sahidvilobhmm12: i need to go now, don't hesitate to let comments on the review if you feel something is wrong or whatever, i will chck tomorrow morning.18:14
*** sahid has quit IRC18:14
*** Nic has joined #openstack-nova18:14
vilobhmm12sahid : sure you can also have a look at https://review.openstack.org/#/c/138607 and https://review.openstack.org/#/c/172502/ let me know your feedback18:15
vilobhmm12good night :)18:15
*** achanda has quit IRC18:15
*** VW_ has quit IRC18:15
*** johnthetubaguy is now known as zz_johnthetubagu18:16
lennybexit18:17
*** ildikov has joined #openstack-nova18:17
*** lennyb has quit IRC18:17
*** garyk has joined #openstack-nova18:17
*** fawadkhaliq has quit IRC18:18
*** isd1 has joined #openstack-nova18:18
*** fawadkhaliq has joined #openstack-nova18:18
*** achanda has joined #openstack-nova18:20
*** VW_ has joined #openstack-nova18:21
*** doude has joined #openstack-nova18:22
*** mriedem has quit IRC18:29
*** vilobhmm1 has joined #openstack-nova18:33
*** vilobhmm12 has quit IRC18:33
*** unicell has joined #openstack-nova18:34
*** mriedem has joined #openstack-nova18:35
alaskibauzas: http://logs.openstack.org/10/175010/5/check/check-tempest-dsvm-cells/78f39a5/console.html#_2015-04-21_15_20_11_61318:36
*** openstackgerrit has quit IRC18:37
alaskimriedem: is there a way to track job success/failures over time?18:37
mriedemalaski: yeah....18:37
mriedemhttp://graphite.openstack.org/18:38
*** openstackgerrit has joined #openstack-nova18:38
alaskicool.  though I hate the graphite interface18:38
mriedemme too18:38
mriedemhttp://graphite.openstack.org/render/?width=586&height=308&_salt=1429641586.192&target=stats.zuul.pipeline.check.job.check-devstack-dsvm-cells.SUCCESS&target=stats.zuul.pipeline.check.job.check-devstack-dsvm-cells.None&target=stats.zuul.pipeline.check.job.check-devstack-dsvm-cells.FAILURE18:39
*** david-lyle has joined #openstack-nova18:39
mriedem?18:39
alaskimriedem: that works, I think.  Thanks18:41
mriedemhttp://graphite.openstack.org/render/?width=586&height=308&_salt=1429641672.456&target=stats.zuul.pipeline.check.job.check-devstack-dsvm-cells.SUCCESS&target=stats.zuul.pipeline.check.job.check-devstack-dsvm-cells.None&target=stats.zuul.pipeline.check.job.check-devstack-dsvm-cells.FAILURE&from=-7days18:41
mriedemthat's the last 7 days18:41
mriedemlooks like it's definitely trending in the right way18:41
*** davideagnello has quit IRC18:41
*** sudipto has quit IRC18:41
mriedemi see there is a havana cells job in infra somewhere, we can probably delete that now :)18:42
alaskihah, yeah18:42
mtreinishmriedem: bah, how else will you know havana cells works :)18:42
alaskiI'm suprised there are so many successes before today though18:42
mriedemwe've been treinished18:42
mriedemyeah i was going to see what logstash shows18:43
mtreinishmriedem: my name is a verb?18:43
mriedemit is now18:43
mriedemalaski: http://goo.gl/1ltSFw18:44
mriedemthat shows the job only passing in the last 24 hours18:44
mriedemless even18:44
*** davideagnello has joined #openstack-nova18:44
alaskishould be around 9:31 EDT this morning18:44
mriedemshit, let's make it voting!18:45
alaskimriedem: oh, your graph is devstack not tempest18:45
mriedemah, exercises18:45
alaskimriedem: heck yeah!18:45
alaskinot really, but I'm going to send an email asking people to pay attention18:45
mriedemhttp://graphite.openstack.org/render/?width=586&height=308&_salt=1429641955.059&from=-7days&target=stats.zuul.pipeline.check.job.check-tempest-dsvm-cells.SUCCESS&target=stats.zuul.pipeline.check.job.check-tempest-dsvm-cells.FAILURE18:46
mriedemvery little blue in that18:46
mriedemso yeah, that's right18:46
*** david-ly_ has joined #openstack-nova18:46
*** david-lyle has quit IRC18:46
mriedemnow i love the graphite ui18:46
alaskistupid question, how do you get the link?18:46
dansmithright click on the image18:46
alaskiI have a graph, but no idea how to link to it18:46
dansmithcopy image url18:46
mriedemjust right click, copy url18:46
alaskioh18:47
dansmithit's plotting server-side not client-side18:47
clarkbI approved a couple of the test skips for the cells job yesterday18:47
* dansmith runs graphite at home per clarkb 18:47
alaskidansmith: good to know, I wouldn't have expected that18:47
*** ZZelle has quit IRC18:48
*** ZZelle has joined #openstack-nova18:48
mriedemalaski: so why wouldn't we want the cells job to be voting now since it's a baseline?18:58
*** wuhg has quit IRC18:59
alaskiI thought we typically let jobs soak a bit.  But mainly I can't guarantee there's not another test that fails periodically that we haven't seen yet18:59
mriedemmaybe we circle back next week19:00
mriedemanything major would shake out in a week19:00
alaskiyeah, I would feel good after that19:00
alaskieven later this week really, just want a few good days of data19:02
mriedemworks for me19:03
*** melwitt has quit IRC19:03
*** melwitt has joined #openstack-nova19:04
*** eglynn has quit IRC19:07
*** joefides has joined #openstack-nova19:07
*** sdake has joined #openstack-nova19:07
*** ajayaa has quit IRC19:07
*** iamjarvo has joined #openstack-nova19:10
*** iamjarvo has quit IRC19:10
*** iamjarvo has joined #openstack-nova19:11
*** sdake_ has quit IRC19:11
mgagneguys, I would like someone to review the regression introduced by bug #142388519:12
openstackbug 1423885 in python-novaclient "nova flavor-show inconsistent with mixed case in names" [Low,Fix released] https://launchpad.net/bugs/1423885 - Assigned to Abhishek Talwar (abhishek-talwar)19:12
*** jichen has joined #openstack-nova19:13
melwittmgagne: looking..19:15
*** changbl has quit IRC19:16
openstackgerritgaryk proposed openstack/nova: VMware: expand support for Opaque networks  https://review.openstack.org/16575019:18
*** READ10 has quit IRC19:18
*** david-ly_ has quit IRC19:18
*** changbl has joined #openstack-nova19:19
*** quaa has quit IRC19:19
bauzasalaski: \o/19:30
bauzasalaski: saw your email, thanks for noticing me :)19:30
bauzasdansmith: cfriesen: sorry, was afk (2100CEST now), but we can discuss yup19:31
bauzascfriesen: I'm trying to take time thinking about your problem and how to solve it19:31
*** VW_ has quit IRC19:31
dansmithbauzas: can you look at mriedem's comments on this: test -d /home/ro.pi19:31
dansmithoops19:31
dansmithhttps://review.openstack.org/#/c/173187/1719:31
bauzaseh, +1 with mriedem19:31
bauzaslol19:31
dansmiththat ^19:32
*** iamjarvo has quit IRC19:32
alaskibauzas: heh19:32
*** VW_ has joined #openstack-nova19:33
*** jcoufal has joined #openstack-nova19:33
*** Hosam has joined #openstack-nova19:34
cfriesenbauzas: no worries.  the main problems are that instances can be scheduled/booted in parallel, there are multiple things that can cause an instance to be rescheduled, and the chosen host isn't reflected in the DB right away19:35
*** alexpilotti has quit IRC19:36
artomGoing back to the database delete thing from earlier, what would be the implications of adding a feature that gives operators an option to *actually* delete stuff when it's deleted, not just soft-delete?19:39
artomIn that case, the DIY would be "have proper backups" instead of "clean the DB"19:40
*** achanda has quit IRC19:41
*** Marga_ has quit IRC19:42
melwittartom: well, the way it's supposed to work is operators can run a nova-manage db archive which will delete things with deleted != 0 and move them to the shadow tables, but last I remember the archive tool is broken19:44
artommelwitt, I just tried, it is.19:44
artomAnd there are other criticisms levied against it, like complexity and slowness.19:45
mriedemi thought zzzeek and/or sdague had a fix for the archive deleted rows thing?19:45
melwittmriedem: I think the data loss bug got fixed, but archive still can't work completely because sysmeta is never deleted (soft-deleted) or something like that19:46
mriedemoh that super old bug19:46
melwittyeah :(19:46
artomIn my case it was simply FKs errors (hah)19:46
melwittartom: right. that's because of the sysmeta, that has to also be deleted for the instance row delete to go through19:47
*** lpetrut has joined #openstack-nova19:47
alaskihttps://review.openstack.org/#/c/109201/ for the system_metadata soft-delete19:47
melwittthere are some patches up about it but they're not ironed out all the way yet19:47
artomOk, so fixing archive_deleted_rows is definitely an option :)19:48
artomStill, hypothetically speaking (as a backup plan or whatever), could giving operators a config option to do real deletes instead of soft deletes be considered?19:50
*** fawadkhaliq has quit IRC19:50
mriedemartom: you can always post a spec19:51
artommriedem, ok, so no pitchforks hostility ;)19:51
artom(Though that may come later :D )19:52
mriedemi currently don't have any pitchforks19:52
artomHe said with his hands suspiciously hidden.19:52
mriedemplus, i've already bled out from this morning's shanking19:52
melwittartom: that, I don't know. I'd imagine it's been debated on the dev mailing list before but I haven't seen any recent discussion. and as mentioned you can propose a spec about it. you can post on the ML to get preliminary feedback before you go all in to the spec19:53
artommelwitt, awesome. I'll search and post, thanks!19:53
*** otter768 has joined #openstack-nova19:53
artommriedem, I kinda want to capitalize that and make it into a regular event now. The Shanking.19:54
mriedemthere is probably already a b rate movie somewhere with that title, i don't want to get into trademark disputes19:56
*** otter768 has quit IRC19:58
artomWorse than a B movie, a YouTube B-movie: https://www.youtube.com/watch?v=WIdDKNoUBxQ20:00
artom(And it's actually hilarious)20:01
*** tjones1 has quit IRC20:04
*** MVenesio has quit IRC20:04
*** MVenesio has joined #openstack-nova20:04
*** baoli has quit IRC20:05
*** Mike_D_laptop has quit IRC20:06
mriedemdansmith: https://review.openstack.org/#/c/173187/ isn't on boot request, it's on compute init_host20:06
mriedemso when that blows up, your compute service is dead20:07
mriedemwhich is why i wanted more debug info in the logs20:07
dansmithohh20:07
mriedemthe admin is setting the config options so it shouldn't be bogus20:07
*** annashen has quit IRC20:08
dansmithyeah, that's totally different20:08
dansmithI thought we were actually verifying a cpu pinning request against what was available20:09
*** andreykurilin__ has quit IRC20:09
mriedemnaw, this would be pretty low level for that :)20:11
mriedemi don't know shit about your cloud, but i know i want pcpu #5!20:12
mriedemhowever, i wouldn't be surprised if there is a blueprint in someone's head for supporting something that low level20:12
*** andreykurilin__ has joined #openstack-nova20:12
dansmiththat's the goal of our cpu pinning work, no?20:14
*** achanda has joined #openstack-nova20:14
mriedemis it?20:14
mriedemidk20:14
mriedemsounds crazy20:14
dansmithagreed, but...20:15
mriedemsoo....can we allow booting to a specific vmware datastore?20:15
mriedemis that a thing?20:15
mriedemi'm sure there are all kinds of vmware specific features people want for things like that20:15
*** jcoufal has quit IRC20:15
*** jwang_ has quit IRC20:16
*** jwang_ has joined #openstack-nova20:16
dansmithhttp://specs.openstack.org/openstack/nova-specs/specs/juno/approved/virt-driver-cpu-pinning.html20:16
dansmithI guess you only get to set policy20:16
*** ildikov has quit IRC20:17
dansmithwhen I hear "pinning" I think of the hypervisor's notion of it, which is very low-level20:17
dansmiththis is like "cpu dedication" or something :)20:17
openstackgerritTim Pownall proposed openstack/nova: Cleaning up debug messages from previous change in vmops.py  https://review.openstack.org/17524820:20
*** matrohon has joined #openstack-nova20:20
*** dboik has quit IRC20:20
*** david-lyle has joined #openstack-nova20:21
*** dboik has joined #openstack-nova20:21
*** VW_ has quit IRC20:24
*** igordcard has joined #openstack-nova20:29
*** ildikov has joined #openstack-nova20:30
*** vladikr has quit IRC20:31
*** Sukhdev has joined #openstack-nova20:31
*** iamjarvo has joined #openstack-nova20:33
*** matrohon has quit IRC20:34
*** tjones1 has joined #openstack-nova20:39
*** baoli has joined #openstack-nova20:42
*** raildo has quit IRC20:43
*** neelashah has quit IRC20:44
*** emagana has quit IRC20:46
bauzascfriesen: sorry was diverted20:47
*** Marga_ has joined #openstack-nova20:47
*** alexpilotti has joined #openstack-nova20:51
*** openstackgerrit has quit IRC20:52
*** foexle has quit IRC20:52
*** openstackgerrit has joined #openstack-nova20:52
*** changbl has quit IRC20:57
*** VW_ has joined #openstack-nova21:00
*** annashen has joined #openstack-nova21:01
*** VW_ has quit IRC21:01
cfriesendansmith: mriedem: while we're talking about low level hypervisor stuff...(okay it's a stretch)...any thoughts on https://blueprints.launchpad.net/nova/+spec/cpu-model-per-flavor-or-image or https://blueprints.launchpad.net/nova/+spec/numa-node-pinning ?21:01
*** lucas-dinner has quit IRC21:01
*** VW_ has joined #openstack-nova21:02
mriedemcfriesen: no opinion?21:03
*** iamjarvo has quit IRC21:03
*** zz_johnthetubagu is now known as johnthetubaguy21:04
cfriesenmriedem: fair enough.  so far nobody seems to have any opinions.21:05
*** annashen has quit IRC21:06
mriedemcfriesen: i guess you'd need a spec to get those21:06
cfriesenmriedem: I proposed specs for each21:06
mriedemoh21:06
openstackgerritAndrew Laski proposed openstack/nova-specs: WIP Store RequestSpec before scheduling  https://review.openstack.org/16990121:06
openstackgerritAndrew Laski proposed openstack/nova-specs: Persist the RequestSpec object  https://review.openstack.org/17607821:06
vilobhmm1jaypipes : can you please have a look at https://review.openstack.org/#/c/172502/621:06
mriedemcfriesen: well, i'd talk to danpb, ndipanov, bauzas and/or sahid on those21:06
*** jecarey has quit IRC21:07
cfriesenmriedem: okay, thanks.21:07
bauzaswazzup ?21:07
*** haomaiwang has quit IRC21:07
*** exploreshaifali has joined #openstack-nova21:07
*** haomaiwang has joined #openstack-nova21:07
mriedemhttps://www.youtube.com/watch?v=mO1NyXlnL8421:07
bauzaszactly21:07
cfriesenbauzas: I'm looking for specs reviews, mriedem suggested I should talk to a list of people including you21:07
bauzascfriesen: oh the numa stuff21:08
cfriesennuma pinning and cpu model specification21:08
*** jichen has quit IRC21:08
*** vilobhmm1 has quit IRC21:08
* bauzas reading back 21:09
*** vilobhmm11 has joined #openstack-nova21:09
cfriesenbauzas: the cpu model one seems like something that would make sense...finer grained control instead of per compute node.  the numa one I could see people wanting it to be more general (tying it more indirectly to features/devices rather than to a specific node) but I thought I'd put it out there to see what people thought.21:10
cfriesenmake that per compute service21:10
*** vilobhmm12 has joined #openstack-nova21:11
*** vilobhmm12 has quit IRC21:11
*** vilobhmm13 has joined #openstack-nova21:11
bauzasCCing both21:11
*** vilobhmm11 has quit IRC21:12
clarkbhello nova. Now that kilo is a thing it should be safe to merge https://review.openstack.org/#/c/168701/2 to master (with the string changes) then figure out how to backport that to kilo without string chagnes to fix the bug right?21:13
clarkbgetting that change in should allow us to run neutron with ipv4 and ipv6 enabled in the gate so that we can actually test that ipv6 works21:13
*** marun has quit IRC21:14
openstackgerritAndrew Laski proposed openstack/nova-specs: WIP Don't store instance in RequestSpec object  https://review.openstack.org/17608321:15
sc68calclarkb: s/actually test that ipv6 works/test IPv6 more fully/21:16
clarkbsc68cal: we do zero testing of it today iirc21:16
clarkbsc68cal: at least for things like nova floating ip attachment which that fix is for21:16
sc68calclarkb: no, tempest has tests for intra-tenant connectivity checks21:16
sc68calit just has to use v4 to ssh into the node currently ;)21:17
clarkbsc68cal: but none of that is ipv6 in the gate21:17
clarkbbecause cirros doesn't support ipv6 in dropbear iirc21:17
clarkbnor does it have ping621:17
clarkbso next step after this is to get a new cirros image that lets us do ^21:17
sc68calclarkb: true, and I have a TODO to take a look at how cirros is built, to tweak the makefiles to make that happen21:18
clarkbthat and have tempest properly assert some stuff about ipv621:18
*** dboik_ has joined #openstack-nova21:18
sc68calfor busybox21:18
clarkbya busybox can do it, I just don't think cirros is building it with the correct flag21:18
sc68caldownside is cirros uses BZR. YUCK!21:18
clarkbhopefully a simple change21:18
sc68calclarkb++21:18
*** lpetrut has quit IRC21:19
sc68caljaypipes: if you get the chance - check scrollback and possibly take a look at https://review.openstack.org/#/c/168701/ ?21:19
*** iamjarvo has joined #openstack-nova21:20
*** eharney has quit IRC21:20
*** jgrimm is now known as zz_jgrimm21:20
clarkbthe nice thing about getting the bit flipped here is we can make any subsequent changes self testing21:21
*** lpetrut has joined #openstack-nova21:21
sc68calclarkb: oh?21:21
*** dboik has quit IRC21:21
*** thangp has quit IRC21:21
clarkbsc68cal: ya if we get the devstack change in to enable ipv6 by default then the addition of new cirros image, new tempest tests, etc is all self testing21:21
sc68calclarkb: ah good point21:22
*** lpetrut has quit IRC21:22
*** dprince has quit IRC21:23
jaypipesvilobhmm13: is that ready to remove the WIP: in the commit message then? :)21:25
jaypipessc68cal: you got it.21:25
sc68caljaypipes: thanks :)21:26
*** tonytan4ever has quit IRC21:27
vilobhmm13jaypipes : jenkins gave a +1; only if you bless https://review.openstack.org/#/c/172502/6 I can remove WIP :)21:30
*** sdake_ has joined #openstack-nova21:31
*** emagana has joined #openstack-nova21:32
*** doude has quit IRC21:33
*** sdake has quit IRC21:34
*** haomaiwang has quit IRC21:35
*** haomaiwang has joined #openstack-nova21:36
mriedemvilobhmm13: -2 so you can stop asking for jaypipes to give a +1 :)21:37
mriedemvilobhmm13: wip changes for a blueprint are -2 by process until the spec is approved21:38
*** iamjarvo has quit IRC21:38
vilobhmm13mriedem : not asking ; that was in a funny way.…i get that the blueprint for this is not yet accepted and hence so i have WIP in the heading i guess21:40
mriedemvilobhmm13: sure21:40
mriedemthat's fine, i have one like that myself21:40
mriedemhttps://review.openstack.org/#/c/168966/21:40
*** zz_jgrimm is now known as jgrimm21:40
*** haomaiwang has quit IRC21:40
*** ijw has quit IRC21:41
vilobhmm13hmm21:41
*** thomasem has joined #openstack-nova21:42
*** haomaiwang has joined #openstack-nova21:42
openstackgerritMatt Riedemann proposed openstack/nova: Allow refreshing network info_cache in get_nw_info_for_instance  https://review.openstack.org/17139021:43
openstackgerritMatt Riedemann proposed openstack/nova: Force a refresh of the network info_cache if not set in os-floating-ips  https://review.openstack.org/17139121:43
*** jecarey has joined #openstack-nova21:44
*** mriedem is now known as mriedem_away21:44
*** VW_ has quit IRC21:45
*** dboik_ has quit IRC21:46
*** artom has quit IRC21:46
*** Hosam has quit IRC21:46
*** dboik has joined #openstack-nova21:47
*** mwagner_lap has quit IRC21:47
*** patrickeast has quit IRC21:51
mriedem_awaybauzas: dansmith: i have to head out but left some more comments in https://review.openstack.org/#/c/173187/21:52
mriedem_awayi'm not sure if i'm seeing something completely different or what,21:52
mriedem_awaybut we're obviously not on the same page :)21:52
*** mtanino has quit IRC21:52
*** joefides has quit IRC21:53
mriedem_awayanyway, gotta go21:53
*** busterswt has quit IRC21:53
*** emagana has quit IRC21:53
*** sdake has joined #openstack-nova21:53
*** emagana has joined #openstack-nova21:54
*** otter768 has joined #openstack-nova21:54
*** mtanino has joined #openstack-nova21:55
*** burt has quit IRC21:56
openstackgerritMatt Riedemann proposed openstack/nova: Force a refresh of the network info_cache if not set in os-floating-ips  https://review.openstack.org/17139121:57
*** sdake_ has quit IRC21:57
*** johnthetubaguy is now known as zz_johnthetubagu21:58
*** yamahata has joined #openstack-nova21:58
*** emagana has quit IRC21:59
*** otter768 has quit IRC21:59
*** harlowja is now known as harlowja_away22:00
*** gyee has joined #openstack-nova22:01
*** vilobhmm13 has quit IRC22:03
*** vilobhmm1 has joined #openstack-nova22:03
*** baoli has quit IRC22:03
*** dave-mccowan has quit IRC22:03
*** vilobhmm1 has quit IRC22:03
*** VW_ has joined #openstack-nova22:03
*** isd1 has quit IRC22:04
*** vilobhmm1 has joined #openstack-nova22:04
*** harlowja_away is now known as harlowja22:05
*** emagana has joined #openstack-nova22:10
*** vilobhmm1 has quit IRC22:12
*** vilobhmm1 has joined #openstack-nova22:12
*** yamahata has quit IRC22:13
*** andreykurilin__ has quit IRC22:14
*** vilobhmm1 has quit IRC22:14
*** vilobhmm1 has joined #openstack-nova22:15
*** patrickeast has joined #openstack-nova22:18
*** dave-mccowan has joined #openstack-nova22:19
*** patrickeast has quit IRC22:21
*** iamjarvo has joined #openstack-nova22:22
bauzasmriedem_away: no worries, I need to pause and think about your comments22:23
*** patrickeast has joined #openstack-nova22:24
openstackgerritmelanie witt proposed openstack/python-novaclient: Revert "nova flavor-show command is inconsistent"  https://review.openstack.org/17610622:24
*** VW_ has quit IRC22:24
*** marun has joined #openstack-nova22:26
*** Sukhdev has quit IRC22:31
*** mwagner_lap has joined #openstack-nova22:32
*** annegentle has joined #openstack-nova22:32
openstackgerritTracy Jones proposed openstack/nova: Cleanup of compute api reboot method  https://review.openstack.org/12742722:34
*** annegentle has quit IRC22:38
*** BadCub is now known as BadCub_Away22:38
*** joefides has joined #openstack-nova22:39
*** jecarey has quit IRC22:39
*** joefides_ has joined #openstack-nova22:41
*** irenab has quit IRC22:41
*** irenab has joined #openstack-nova22:42
*** joefides has quit IRC22:44
*** haomaiwang has quit IRC22:46
*** annegentle has joined #openstack-nova22:46
*** haomaiwang has joined #openstack-nova22:47
*** haomaiwang has quit IRC22:49
*** dboik_ has joined #openstack-nova22:50
*** haomaiwang has joined #openstack-nova22:50
*** dboik has quit IRC22:53
*** Longgeek has quit IRC22:54
*** penick has quit IRC22:58
*** dboik_ has quit IRC22:59
*** tjones1 has quit IRC22:59
*** annegentle has quit IRC23:00
*** penick has joined #openstack-nova23:02
*** tjones1 has joined #openstack-nova23:02
*** penick has quit IRC23:03
*** annashen has joined #openstack-nova23:03
*** annashen has quit IRC23:08
*** apmelton is now known as apmelton_away23:10
*** hemna is now known as hemnafk23:12
vilobhmm1dansmith, jaypipes, melwitt : nova memcache servicegroup driver internally making calls to database is that expected  https://github.com/openstack/nova/blob/master/nova/servicegroup/drivers/mc.py#L81 ? I mean shoudln't the memcache driver fetch store info from memcache ?23:14
vilobhmm1while discussing with harlowja we saw this23:15
vilobhmm1dims : ^^23:15
harlowjavilobhmm1 thats also sorta an issue for the nova disable command right?23:16
harlowja*mainly for that (i think?)23:16
*** markvoelker_ has quit IRC23:16
melwittvilobhmm1: what do you mean by store info? the code you link is pulling all services related to the group, then for each checking last heartbeat in memcache to determine up/down23:18
vilobhmm1melwitt : fetching info is the write word please disregard *store* as its just a fetch call23:19
openstackgerritEric Brown proposed openstack/nova: VMware: Don't raise exception on resize of 0 disk  https://review.openstack.org/17317023:19
vilobhmm1i mean shouldn't the fetch also be from memcache ? like for zk.py it fetches info from the znode tree stored in zookeeper23:19
melwittvilobhmm1: okay. so there it's getting the list of services from the db, but then for each of those fetching from memcache in the is_up() function23:20
melwittthat is, I think only the heartbeats are stored in memcache, not the services themselves23:21
vilobhmm1melwitt : seems like that whereas in case of zookeeper driver even the services info is stored in zookeeper; thats not the case in case of memcache driver (ideally it should be so)23:29
*** Guest53909 has quit IRC23:31
*** Guest53909 has joined #openstack-nova23:31
vilobhmm1melwitt, dansmith, jaypipes, dims : example if you see https://gist.github.com/vilobhmm/1044d2598e3fe2b4d92d here the nova.services table can be manipulated through an admin interface in the form of nova-manage disable/enable etc and programatically even the servicegroup driver(esp mc.py and db.py) uses the same table (nova.services) underlying. Say some customer tries to use zk.py in which case the zookeper itself stores23:35
*** sdake_ has joined #openstack-nova23:35
*** penick has joined #openstack-nova23:36
*** sdake has quit IRC23:38
*** iamjarvo has quit IRC23:40
melwittvilobhmm1: yeah, I see your point. if anything I would think zk driver should do similar as the others. I don't have history about why it's different, or whether it does anything to sync state with the nova db, if someone were to update disable/enable23:40
vilobhmm1melwitt : yep thats the point…the info doesn't seem in sync and which is not good :(23:42
dansmithvilobhmm1: really, no need to ping everyone on the planet with every comment23:42
dansmithvilobhmm1: also, most of nova-manage directly dabbles in the database.. that's kinda the point23:42
vilobhmm1ok23:42
dansmithvilobhmm1: if it's doing something in the DB that causes it to not work for a different technology, it probably needs to be refactored to use an abstract interface23:43
vilobhmm1dansmith : so how is the services info sync maintanied in case of zookeeper sg driver23:43
vilobhmm1sure23:44
vilobhmm1at present23:44
*** exploreshaifali has quit IRC23:44
dansmithvilobhmm1: I don't know, I don't look at that code much. It gets so little attention, that I'm skeptical that much other than the db driver gets really used23:44
vilobhmm1oh okay23:45
*** sdake_ has quit IRC23:46
*** zhenguo has joined #openstack-nova23:47
melwittvilobhmm1: at a glance, it looks like nothing is done to sync it. if true, I think that driver needs some work on it to behave like the others, pull services from the db and query zk for the up/down status23:47
vilobhmm1melwitt: True…I agree …may be https://review.openstack.org/#/c/138607 should help lets see23:51
openstackgerritmelanie witt proposed openstack/python-novaclient: Don't lookup service url when bypass_url is given  https://review.openstack.org/17562223:55
*** otter768 has joined #openstack-nova23:55
*** penick has quit IRC23:56
*** rwsu has quit IRC23:56
*** melwitt has quit IRC23:56
*** dsanders has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!