Monday, 2015-05-11

*** dsanders has quit IRC00:04
*** dimsum__ has joined #openstack-nova00:06
*** sdake_ has joined #openstack-nova00:08
*** sdake_ has quit IRC00:08
*** sdake_ has joined #openstack-nova00:09
*** sdake has quit IRC00:12
*** dimsum__ has quit IRC00:14
*** otter768 has joined #openstack-nova00:23
*** jogo has quit IRC00:25
openstackgerritEric Brown proposed openstack/nova: Minor edits to support-matrix doc  https://review.openstack.org/18143200:27
openstackgerritsajeesh cs proposed openstack/nova: Create column allocated in Quota table  https://review.openstack.org/15132700:29
*** Alexandra_ has quit IRC00:32
*** yingjun has joined #openstack-nova00:36
openstackgerritSam Morrison proposed openstack/nova: Create neutron ports with correct instance AZ value  https://review.openstack.org/18177600:36
*** dimsum__ has joined #openstack-nova00:39
openstackgerritEric Brown proposed openstack/nova: Deprecate nova ironic driver's admin_auth_token  https://review.openstack.org/17996000:40
*** yingjun has quit IRC00:50
*** yamahata has quit IRC00:55
*** lsmola_ has joined #openstack-nova01:01
*** mriedem has joined #openstack-nova01:02
*** lsmola has quit IRC01:04
*** mriedem1 has quit IRC01:04
*** lsmola_ has quit IRC01:11
*** ericksonsantos has quit IRC01:12
*** otter768 has quit IRC01:12
*** ericksonsantos has joined #openstack-nova01:16
*** takedakn has joined #openstack-nova01:20
*** yingjun has joined #openstack-nova01:20
*** lsmola_ has joined #openstack-nova01:25
*** zhangtralon has joined #openstack-nova01:27
*** liusheng has quit IRC01:27
*** liusheng has joined #openstack-nova01:31
*** vilobhmm11 has quit IRC01:31
*** takedakn has quit IRC01:31
*** coreywright has quit IRC01:34
*** markvoelker has quit IRC01:35
*** markvoelker has joined #openstack-nova01:36
openstackgerritsajeesh cs proposed openstack/nova: Create column allocated in Quota table  https://review.openstack.org/15132701:37
*** markvoelker has quit IRC01:37
*** coreywright has joined #openstack-nova01:39
*** baoli has joined #openstack-nova01:39
*** vilobhmm1 has joined #openstack-nova01:41
*** baoli has quit IRC01:44
openstackgerritEli Qiao proposed openstack/nova: Set correct power state when evaucate fails due to recreate not supported  https://review.openstack.org/17315001:45
*** vilobhmm1 has quit IRC01:46
openstackgerritMatt Riedemann proposed openstack/nova: libvirt: handle code=38 + sigkill (ebusy) in destroy()  https://review.openstack.org/18178101:49
*** yingjun has quit IRC01:52
*** mriedem has quit IRC01:53
*** yingjun has joined #openstack-nova01:54
*** achanda has joined #openstack-nova01:55
*** oomichi has joined #openstack-nova02:01
*** oomichi has quit IRC02:01
*** yingjun has quit IRC02:09
*** dsanders has joined #openstack-nova02:10
*** dimsum__ has quit IRC02:12
*** otter768 has joined #openstack-nova02:14
*** ericksonsantos has quit IRC02:19
*** mmedvede_ has quit IRC02:20
*** jogo has joined #openstack-nova02:21
*** yasu_ has joined #openstack-nova02:22
*** park_heijlong has joined #openstack-nova02:22
*** vilobhmm1 has joined #openstack-nova02:25
openstackgerritheijlong proposed openstack/nova: Merge user_data functional tests of v2 and v2.1  https://review.openstack.org/16826502:31
*** yingjun has joined #openstack-nova02:33
openstackgerritheijlong proposed openstack/nova: Merge extended-volume functional tests of v2 and v2.1  https://review.openstack.org/17321602:37
*** arnaud____ has joined #openstack-nova02:37
*** yingjun has quit IRC02:39
*** arnaud____ has quit IRC02:39
*** Alexandra_ has joined #openstack-nova02:40
*** patrickeast has quit IRC02:52
*** vilobhmm1 has quit IRC02:54
*** boris-42 has quit IRC02:58
*** vilobhmm1 has joined #openstack-nova03:00
*** dave-mccowan has quit IRC03:00
*** achanda has quit IRC03:01
*** achanda_ has joined #openstack-nova03:04
*** sdake has joined #openstack-nova03:05
*** sdake has quit IRC03:05
*** sdake has joined #openstack-nova03:05
*** sdake_ has quit IRC03:06
*** sdake has quit IRC03:08
*** sdake has joined #openstack-nova03:09
*** iamjarvo has joined #openstack-nova03:13
*** achanda_ has quit IRC03:14
*** tobe has joined #openstack-nova03:20
*** alex_xu has quit IRC03:20
*** baoli has joined #openstack-nova03:21
*** alex_xu has joined #openstack-nova03:21
*** yingjun has joined #openstack-nova03:22
openstackgerritheijlong proposed openstack/nova: Merge user_data functional tests of v2 and v2.1  https://review.openstack.org/16826503:23
*** vilobhmm1 has quit IRC03:24
*** VW_ has joined #openstack-nova03:26
*** baoli has quit IRC03:26
*** Zhengguang has joined #openstack-nova03:27
*** yingjun has quit IRC03:27
*** yingjun has joined #openstack-nova03:29
*** yingjun_ has joined #openstack-nova03:33
*** yingjun has quit IRC03:33
*** yingjun has joined #openstack-nova03:34
*** yingjun_ has quit IRC03:38
*** subscope has joined #openstack-nova03:38
*** deepthi has joined #openstack-nova03:48
*** yingjun has quit IRC03:52
*** sdake_ has joined #openstack-nova03:56
sorrisonanyone around and can help me with a failing tempest gate job https://review.openstack.org/#/c/181776/ ?03:58
*** sdake has quit IRC04:00
*** VW_ has quit IRC04:06
*** arnaud____ has joined #openstack-nova04:06
*** rushiagr_away is now known as rushiagr04:06
*** coolsvap|afk is now known as coolsvap04:23
*** iamjarvo has quit IRC04:25
*** vilobhmm1 has joined #openstack-nova04:26
*** ildikov has quit IRC04:28
*** ildikov has joined #openstack-nova04:31
*** sdake has joined #openstack-nova04:34
*** otter768 has quit IRC04:35
*** markvoelker has joined #openstack-nova04:37
*** sdake_ has quit IRC04:38
*** rushiagr is now known as rushiagr_away04:46
*** irenab has quit IRC04:46
*** pixelbeat_ has quit IRC04:49
*** yingjun has joined #openstack-nova04:53
*** afazekas has joined #openstack-nova04:55
*** rushiagr_away is now known as rushiagr04:55
openstackgerritheijlong proposed openstack/nova: Merge extension-info functional tests of v2 and v2.1  https://review.openstack.org/17570104:56
*** lpetrut has joined #openstack-nova04:59
*** tobe has quit IRC05:03
*** nihilifer has joined #openstack-nova05:04
*** rushiagr is now known as rushiagr_away05:08
*** nkrinner has joined #openstack-nova05:10
*** sdake_ has joined #openstack-nova05:13
*** emagana has joined #openstack-nova05:15
*** ericksonsantos has joined #openstack-nova05:15
*** sdake has quit IRC05:16
*** unicell1 has joined #openstack-nova05:20
*** _gryf|afk is now known as _gryf05:20
*** ericksonsantos has quit IRC05:20
*** unicell has quit IRC05:21
*** Alexandra_ has quit IRC05:24
*** oro has joined #openstack-nova05:28
*** heyongli has quit IRC05:29
*** irenab has joined #openstack-nova05:30
*** heyongli has joined #openstack-nova05:31
*** ildikov has quit IRC05:32
*** n0ano has joined #openstack-nova05:32
*** Nikolay_St has quit IRC05:32
*** yingjun has quit IRC05:35
*** Zhengguang has quit IRC05:36
*** rushiagr_away is now known as rushiagr05:36
*** rushiagr is now known as rushiagr_away05:37
*** achanda has joined #openstack-nova05:37
*** jogo has quit IRC05:39
*** jogo has joined #openstack-nova05:39
*** Jeffrey4l has joined #openstack-nova05:50
*** vilobhmm1 has quit IRC05:54
*** sdake has joined #openstack-nova05:57
*** sudipto has joined #openstack-nova05:58
*** Longgeek_ has joined #openstack-nova05:59
*** sdake_ has quit IRC06:01
*** arnaud____ has quit IRC06:02
*** yingjun has joined #openstack-nova06:03
*** Longgeek has quit IRC06:03
*** doron_afk has joined #openstack-nova06:04
*** cfriesen has quit IRC06:05
*** lpetrut has quit IRC06:06
openstackgerritQin Zhao proposed openstack/nova: Update sqlalchemy-migrate to 0.9.6  https://review.openstack.org/17005006:10
*** sdake_ has joined #openstack-nova06:15
*** sdake__ has joined #openstack-nova06:18
*** sdake has quit IRC06:18
openstackgerritOpenStack Proposal Bot proposed openstack/nova: Imported Translations from Transifex  https://review.openstack.org/17963806:19
*** ankit_ag has joined #openstack-nova06:19
openstackgerritRajesh Tailor proposed openstack/nova: Fix quota-update of instances stuck in deleting when nova-compute startup finish  https://review.openstack.org/12234706:20
*** sdake_ has quit IRC06:21
*** rushiagr_away is now known as rushiagr06:26
*** oro has quit IRC06:27
*** jcoufal has joined #openstack-nova06:31
*** otter768 has joined #openstack-nova06:36
*** lpetrut has joined #openstack-nova06:37
*** Murali has joined #openstack-nova06:38
*** sahid has joined #openstack-nova06:41
*** otter768 has quit IRC06:41
*** lpetrut has quit IRC06:42
*** park_heijlong has quit IRC06:48
*** mpaolino has joined #openstack-nova06:52
openstackgerritLan Qi Song proposed openstack/nova: Remove useless volume when boot from volume failed  https://review.openstack.org/17708406:53
*** yasu_ has quit IRC06:56
*** yasu_ has joined #openstack-nova06:56
*** destiny has joined #openstack-nova06:56
destinyhi06:56
destinyi'm looking for informations about the docker driver, is it dead ?06:56
*** ildikov has joined #openstack-nova06:57
*** park_heijlong has joined #openstack-nova07:01
*** Marga_ has joined #openstack-nova07:01
*** Ritesh has joined #openstack-nova07:01
RiteshHi07:02
RiteshCan we migrate mulitpie instances at a timei ?07:02
Riteshnova live-migration vm2  vm107:02
*** markus_z has joined #openstack-nova07:02
*** haypo has joined #openstack-nova07:03
*** Marga_ has quit IRC07:04
*** subscope has quit IRC07:05
openstackgerritQin Zhao proposed openstack/nova: Libvirt: Use tpool to invoke guestfs api  https://review.openstack.org/18180807:07
*** RuiChen has joined #openstack-nova07:12
*** achanda has quit IRC07:15
*** moshele has joined #openstack-nova07:16
*** jichen has joined #openstack-nova07:17
*** Marga_ has joined #openstack-nova07:19
*** Marga_ has quit IRC07:19
*** romainh has joined #openstack-nova07:19
*** yingjun has quit IRC07:20
*** yingjun has joined #openstack-nova07:22
*** matrohon has joined #openstack-nova07:22
*** sahid has quit IRC07:24
*** nihilifer has quit IRC07:24
*** sahid has joined #openstack-nova07:24
*** dsanders has quit IRC07:25
*** sdake__ has quit IRC07:28
*** mpavone has joined #openstack-nova07:30
*** nihilifer has joined #openstack-nova07:30
*** ildikov has quit IRC07:31
*** Jeffrey4l has quit IRC07:31
*** browne has quit IRC07:37
*** Jeffrey4l has joined #openstack-nova07:37
*** tobe has joined #openstack-nova07:42
*** apuimedo has joined #openstack-nova07:43
*** Nikolay_St has joined #openstack-nova07:44
*** achanda has joined #openstack-nova07:45
*** jlanoux has joined #openstack-nova07:46
*** ildikov has joined #openstack-nova07:47
openstackgerritVincent Hou proposed openstack/nova: Add a new parameter connector into migrate_volume_completion  https://review.openstack.org/18181807:54
*** romainh has quit IRC07:55
*** Nikolay_St has quit IRC07:56
*** fifieldt has joined #openstack-nova07:57
*** fifieldt has quit IRC07:58
*** jistr has joined #openstack-nova07:58
*** park_heijlong has quit IRC07:59
*** achanda has quit IRC08:01
*** lucasagomes has joined #openstack-nova08:04
*** Nikolay_St has joined #openstack-nova08:09
*** romainh has joined #openstack-nova08:10
*** belmoreira has joined #openstack-nova08:11
*** nithyag_ has quit IRC08:12
*** yingjun has quit IRC08:20
*** derekh has joined #openstack-nova08:22
*** redbeard has joined #openstack-nova08:22
*** yingjun has joined #openstack-nova08:23
*** lpetrut has joined #openstack-nova08:25
johnthetubaguydestiny: its not in tree any more, its in stackforge, but they are trying to merge it back08:29
johnthetubaguyRitesh: you can live-migrate multiple VMs, but its two separate API calls08:29
openstackgerritMoshe Levi proposed openstack/nova: libvirt: mlnx_direct vif type removal  https://review.openstack.org/18167108:31
*** dguitarbite has joined #openstack-nova08:32
*** marekd has left #openstack-nova08:33
*** sudipto has quit IRC08:34
*** Jeffrey4l has quit IRC08:35
*** otter768 has joined #openstack-nova08:37
*** gilliard_afk is now known as gilliard08:37
*** sudipto has joined #openstack-nova08:39
gilliardHello Nova!08:39
bauzasgilliard: aloha08:39
*** otter768 has quit IRC08:42
*** ociuhandu has joined #openstack-nova08:44
*** achanda has joined #openstack-nova08:45
alex_xugilliard: welcome back!08:45
moshelebauzas: hi08:45
bauzasmoshele: hi08:46
moshelebauzas: just for my understanding compute.filter is for nova-compute utilities  and network.filter is for nova-network utilities, right?08:47
bauzasmoshele: I don't get your point08:47
bauzasmoshele: you mean nova.filters ?08:47
moshelebauzas: yes08:47
bauzasmoshele: the module ?08:47
bauzasmoshele: that's for the scheduler filters yes08:48
bauzasmoshele: there is an handler used to manage how the filters are called08:48
moshelemoshele: no rootwrap files in etc08:48
*** Jeffrey4l has joined #openstack-nova08:48
moshelebauzas: no rootwrap files in etc08:48
bauzasmoshele: aaaah08:49
openstackgerritLingxian Kong proposed openstack/nova: Correct az property of instance when specifying force host/node  https://review.openstack.org/16384208:49
bauzasmoshele: could you please point me out the module full path ?08:50
moshelebauzas: can you look on this patch https://review.openstack.org/#/c/181670/08:50
bauzasmoshele: tbh I'm pretty busy for preparing the Summit, but I'll try08:51
bauzasmoshele: my review rate is pretty low these days08:51
destinyokay johnthetubaguy, any idea of a date which will be happen ? or something to follow it ?08:52
*** fawadkhaliq has joined #openstack-nova08:52
moshelebauzas: ok thanks08:52
johnthetubaguydestiny: totally unsure if it will ever go back into tree at this point, but you can see the spec review here: https://review.openstack.org/#/c/128753/08:52
gilliardHI alex_xu. Thanks :)08:58
*** doron_afk is now known as doron08:59
alex_xugilliard: how was your test08:59
*** Ritesh has quit IRC09:00
alex_xugilliard: thanks for the comment on https://review.openstack.org/181784 , if we use field length, it pretty similar to the format of request. Then it totally sounds like different case09:01
*** RuiChen has quit IRC09:01
*** RuiChen has joined #openstack-nova09:02
*** tojuvone has joined #openstack-nova09:02
*** ociuhandu has quit IRC09:03
*** park_heijlong has joined #openstack-nova09:04
openstackgerritVictor Stinner proposed openstack/nova: Rename _CellProxy.iteritems method to items on py3  https://review.openstack.org/17978309:06
openstackgerritVictor Stinner proposed openstack/nova: Replace dict.iteritems() with six.iteritems(dict)  https://review.openstack.org/17978409:06
*** park_heijlong has quit IRC09:09
*** oro has joined #openstack-nova09:10
destinyok thanks johnthetubaguy09:10
*** doron is now known as doron_afk09:14
openstackgerritVictor Stinner proposed openstack/nova: Drop L from literal integer numbers for Python 3  https://review.openstack.org/17982809:16
openstackgerritJohn Garbutt proposed openstack/nova: devref: add information to clarify nova scope  https://review.openstack.org/17862309:18
*** aix has joined #openstack-nova09:20
*** derekh has quit IRC09:27
*** ildikov has quit IRC09:27
*** derekh has joined #openstack-nova09:28
sahidzhangtralon: hello09:31
*** haomaiwa_ has quit IRC09:31
zhangtralonsahid:hi09:32
*** aswadr has joined #openstack-nova09:33
sahidzhangtralon: so about the review 167917 (sorry i have pb to copy/past link)09:34
sahiddo you still plan to work on it?09:34
zhangtralonlet me see09:34
zhangtralonI still work on it09:35
sahidany blockers?09:36
*** yingjun has quit IRC09:36
*** IanGovett has joined #openstack-nova09:36
sahidi was thinking about to push some changes to update the way we compute free resources from drivers (and so include hugepages)09:37
*** danpb has joined #openstack-nova09:37
sahidperhaps you can then put your changes on top of it09:37
zhangtralonbefore, I want to discuss the https://bugs.launchpad.net/nova/+bug/1444232 with you and nikola09:37
openstackLaunchpad bug 1444232 in OpenStack Compute (nova) "Only using huge page may filter the usable host" [Low,Incomplete] - Assigned to zhangtralon (zhangchunlong1)09:37
zhangtralonI think the bug 1444232 is related to the review 16791709:38
openstackbug 1444232 in OpenStack Compute (nova) "Only using huge page may filter the usable host" [Low,Incomplete] https://launchpad.net/bugs/1444232 - Assigned to zhangtralon (zhangchunlong1)09:38
sahidzhangtralon: so you want to separate numa topology and hugepages, right?09:39
*** achanda has quit IRC09:40
zhangtralonI am not sure, look the comments from nikola09:40
*** Nikolay_St has quit IRC09:41
*** Nikolay_St has joined #openstack-nova09:41
*** ZZelle has joined #openstack-nova09:42
*** ildikov has joined #openstack-nova09:43
*** subscope has joined #openstack-nova09:43
zhangtralonsahid: If separating numa topology and hugepages, maybe we can collaborate on it09:43
sudiptojohnthetubaguy, curious about an RT related observation. I see the following log message in the compute.log file: Total usable vcpus: 20, total allocated vcpus: 156 -- is this theoretically possible?09:46
johnthetubaguysudipto: yes09:46
johnthetubaguysudipto: CPU overcommit is quite a common hypervisor feature09:47
sudiptojohnthetubaguy, yeah I mean the overcommit ratio is probably 1.5x times by default?09:47
sudiptoThis seems like a huge number to me?09:47
sahidjohnthetubaguy: we have two backports here for kilo and juno, they seem to be reasonable in my point of view I would like to get your feeling 178072 please09:47
sudiptoeven if it's 2x times - this seems like a way off number doesn't it?09:48
sahidzhangtralon: i do not believe separate hugepages nad numa topology is the way we want to take09:48
johnthetubaguysudipto: it depends what your users are doing, if most folks don't use all the CPU, thats maybe a great way to go09:48
johnthetubaguysudipto: depends how you have decided to configure your system, I don't think we enforce CPU overcommit by default, its more a scheduler hint by default, I think09:48
*** pixelbeat_ has joined #openstack-nova09:49
sudiptojohnthetubaguy, ok, sorry for asking a dumb question. Is it  just controller by the quota from a user irrespective than actually being verified on the system?09:49
sudipto*controller = controlled.09:49
*** dulek has joined #openstack-nova09:51
zhangtralonsahid:oh, separating the numa and hugepages will take the more flexibility, users can using the numa or hugepages based on their cases.09:54
johnthetubaguysudipto: there are user quotas, but thats separate to what the resource tracker enforces, it all depends how you configure it, I don't remember the details of that right now09:55
sudiptojohnthetubaguy, ok...09:55
johnthetubaguysudipto: as a Xen users, I generally only care about RAM, as I don't want ballooning, and thats the only finite resource, assuming i size flavors correctly to limit overcommit of everything else, like disk/CPU09:56
*** exploreshaifali has joined #openstack-nova09:56
*** fawadkhaliq has quit IRC09:56
johnthetubaguysahid: that looks like you are backporting a feature?09:56
johnthetubaguysahid: if the original patch has a bug or blueprint attached, it would be much easier to understand the impact09:58
sudiptojohnthetubaguy, hmm ok. Maybe one of the reasons why we only have a RamFilter and not the one for CPU?09:59
sahidyes but unforntunatly it was not the case. ok so rule is rule i'm going to abandon them.09:59
johnthetubaguysudipto: I assumed we had a CPU one, but I haven't looked, feel free to add one if you want one10:00
*** exploreshaifali has quit IRC10:01
johnthetubaguysahid: you could make the case, by a bug describing the impact, etc, and how that commit fixes it, and reference that in the cherry-pick10:01
sudiptojohnthetubaguy, my bad, there's a CoreFilter.10:01
*** eglynn has joined #openstack-nova10:02
*** dimsum__ has joined #openstack-nova10:02
*** doron_afk is now known as doron10:05
johnthetubaguysudipto: ah, no worries10:11
*** NithyaG has joined #openstack-nova10:20
*** dguitarbite has quit IRC10:24
*** doron is now known as doron_afk10:25
*** dguitarbite has joined #openstack-nova10:27
*** romainh has quit IRC10:29
*** fawadkhaliq has joined #openstack-nova10:31
*** ajayaa has joined #openstack-nova10:35
*** baoli has joined #openstack-nova10:37
*** otter768 has joined #openstack-nova10:38
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: Drop explicit suds dependency  https://review.openstack.org/18155410:39
*** VW_ has joined #openstack-nova10:41
*** baoli has quit IRC10:41
*** VW_ has quit IRC10:42
*** VW_ has joined #openstack-nova10:42
*** otter768 has quit IRC10:43
*** coolsvap is now known as coolsvap|afk10:48
*** gszasz has joined #openstack-nova10:48
*** belmoreira has quit IRC10:48
*** ildikov has quit IRC10:59
openstackgerritTomi Juvonen proposed openstack/nova-specs: New nova API call to mark nova-compute down  https://review.openstack.org/16983611:07
*** exploreshaifali has joined #openstack-nova11:07
*** zhenguo has joined #openstack-nova11:10
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: Add rootwrap daemon mode support  https://review.openstack.org/18069511:12
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: [WIP] Run using rootwrap daemon as True  https://review.openstack.org/18080911:13
*** tojuvone has quit IRC11:15
*** ildikov has joined #openstack-nova11:15
*** mpaolino has quit IRC11:15
*** exploreshaifali has quit IRC11:17
openstackgerritMichal Rostecki proposed openstack/nova-specs: Dedicate aggregates for specific tenants  https://review.openstack.org/18105411:23
openstackgerritMichal Rostecki proposed openstack/nova-specs: Dedicate aggregates for specific tenants  https://review.openstack.org/18105411:26
*** EmilienM|afk is now known as EmilienM11:28
*** romainh has joined #openstack-nova11:29
*** mmedvede_ has joined #openstack-nova11:30
*** jaypipes has joined #openstack-nova11:32
*** Nikolay_St has quit IRC11:33
*** Nikolay_St has joined #openstack-nova11:34
*** ociuhandu has joined #openstack-nova11:35
openstackgerritMichal Rostecki proposed openstack/nova-specs: Dedicate aggregates for specific tenants  https://review.openstack.org/18105411:37
*** zul has quit IRC11:37
*** zul has joined #openstack-nova11:38
*** lucasagomes is now known as lucas-hungry11:41
*** subscope has quit IRC11:44
*** subscope has joined #openstack-nova11:47
openstackgerritPetrut Lucian proposed openstack/nova: Hyper-V: Nova serial console access support  https://review.openstack.org/14500411:51
*** masayukig has quit IRC11:53
*** tobe has quit IRC11:53
openstackgerritPetrut Lucian proposed openstack/nova: Hyper-V: Nova serial console access support  https://review.openstack.org/14500411:54
*** tojuvone has joined #openstack-nova11:55
*** deepthi has quit IRC11:56
*** baoli has joined #openstack-nova11:56
*** claudiub has joined #openstack-nova11:58
*** masayukig has joined #openstack-nova11:59
moshelejohnthetubaguy: hi12:01
*** dprince has joined #openstack-nova12:02
*** Nikolay_St has quit IRC12:03
*** dimsum__ has quit IRC12:03
*** boris-42 has joined #openstack-nova12:05
*** Nikolay_St has joined #openstack-nova12:05
*** kodoku has joined #openstack-nova12:05
kodokuI question about Server personality. This feature use injection file from libvirt ?12:06
*** mwagner_lap has quit IRC12:07
*** lpetrut1 has joined #openstack-nova12:09
*** lpetrut has quit IRC12:10
*** tzumainn_ has joined #openstack-nova12:10
kashyapUh, I'm always thrown off by Gerrit's formatting of comments in a way I didn't intend (no long line wrap) - https://review.openstack.org/#/c/181781/12:11
openstackgerritRadoslav Gerganov proposed openstack/nova: VMware: verify vCenter server certificate  https://review.openstack.org/17972812:12
*** dave-mccowan has joined #openstack-nova12:12
*** Marga_ has joined #openstack-nova12:12
johnthetubaguymoshele: hi12:13
*** claudiub has quit IRC12:13
johnthetubaguykodoku: depends on your configuration12:13
johnthetubaguykodoku: we are trying to remove file injection, instead make cloud-init do the heavy lifting based on config drive / metadata service12:13
kodokujohnthetubaguy ok because trove use this feature for configure the guest.12:14
*** Nikolay_St has quit IRC12:15
*** atuvenie has joined #openstack-nova12:15
kodokujohnthetubaguy and with vmware backend, you don't have this feature12:15
johnthetubaguykodoku: vmware supports config drive, that should allow something similar using cloud-init in your guest12:15
lxslikashyap: you put a space at the front so you got 'code block' mode12:15
*** claudiub has joined #openstack-nova12:16
*** rfolco has joined #openstack-nova12:16
*** nihilifer has quit IRC12:18
kashyaplxsli: Yeah, I normally provide 4 spaces, as that'd wrap lines. And, forgot this time.12:18
*** raildo has joined #openstack-nova12:19
*** htruta has joined #openstack-nova12:19
openstackgerritPetrut Lucian proposed openstack/nova-specs: Hyper-V: Add storage QoS support  https://review.openstack.org/17542212:19
lxsli:)12:19
*** tzumainn_ has left #openstack-nova12:21
*** Marga_ has quit IRC12:21
*** Marga_ has joined #openstack-nova12:22
*** nihilifer has joined #openstack-nova12:22
*** fawadkhaliq has quit IRC12:26
*** nihilifer has quit IRC12:28
*** sudipto has quit IRC12:30
*** Jeffrey4l has quit IRC12:30
*** Nikolay_St has joined #openstack-nova12:31
openstackgerritBrent Eagles proposed openstack/nova: WIP: Refactor Nova VIF model  https://review.openstack.org/16728712:32
*** VW_ has quit IRC12:32
*** VW_ has joined #openstack-nova12:33
*** aysyd has joined #openstack-nova12:34
*** VW_ has quit IRC12:35
*** VW_ has joined #openstack-nova12:36
*** artom has joined #openstack-nova12:36
*** lucas-hungry is now known as lucasagomes12:37
*** oro_ has joined #openstack-nova12:37
*** geguileo has joined #openstack-nova12:38
*** sdake has joined #openstack-nova12:38
*** otter768 has joined #openstack-nova12:39
*** sdake_ has joined #openstack-nova12:40
*** Jeffrey4l has joined #openstack-nova12:42
*** haomaiwa_ has joined #openstack-nova12:43
*** otter768 has quit IRC12:43
*** fawadkhaliq has joined #openstack-nova12:44
*** sdake has quit IRC12:44
*** kodoku has quit IRC12:46
*** Longgeek_ has quit IRC12:48
*** Longgeek has joined #openstack-nova12:49
openstackgerritjichenjc proposed openstack/nova-specs: Allow adjust ephemeral disks during resize  https://review.openstack.org/14573612:49
openstackgerritSailaja proposed openstack/nova: Project quota update should not be less than user quota.  https://review.openstack.org/18134912:49
*** fawadk has joined #openstack-nova12:50
*** mwagner_lap has joined #openstack-nova12:50
*** fawadkhaliq has quit IRC12:50
*** VW_ has quit IRC12:53
*** VW_ has joined #openstack-nova12:54
*** RuiChen has quit IRC12:55
openstackgerritPetrut Lucian proposed openstack/nova: Add Hyper-V storage QoS support  https://review.openstack.org/17547912:55
*** xyang1 has joined #openstack-nova12:55
*** RuiChen has joined #openstack-nova12:55
*** sdake_ is now known as sdake12:55
*** inara has quit IRC12:56
*** inara has joined #openstack-nova12:56
openstackgerritJoel Coffman proposed openstack/nova: libvirt: Disconnect dm-crypt on instance suspend/stop  https://review.openstack.org/14148512:59
*** VW_ has quit IRC12:59
*** VW_ has joined #openstack-nova13:00
*** VW_ has quit IRC13:00
haypojohnthetubaguy, hi. for my python 3 spec, would this change be enough to explicit that Tempest tests must pass on Python 3? http://paste.openstack.org/show/219846/13:00
*** VW_ has joined #openstack-nova13:00
johnthetubaguyhaypo: I would remove the functional tests from that list for now, tempest and unit tests are the big ones for now13:02
*** READ10 has joined #openstack-nova13:02
*** VW__ has joined #openstack-nova13:03
*** VW_ has quit IRC13:03
*** VW__ has quit IRC13:03
*** VW_ has joined #openstack-nova13:04
*** VW_ has quit IRC13:04
*** haomaiwa_ has quit IRC13:04
*** VW_ has joined #openstack-nova13:05
openstackgerritVictor Stinner proposed openstack/nova-specs: Adding Python 3.4 support to Nova  https://review.openstack.org/17686813:06
haypojohnthetubaguy, ok. here is the updated spec, don't hesitate to comment it inline if you want to suggest other changes ^^13:06
*** rushiagr is now known as rushiagr_away13:07
*** fawadkhaliq has joined #openstack-nova13:08
*** fawadk has quit IRC13:11
*** yingjun has joined #openstack-nova13:11
*** burt has joined #openstack-nova13:12
*** VW_ has quit IRC13:15
*** VW_ has joined #openstack-nova13:15
*** Longgeek has quit IRC13:15
*** Longgeek has joined #openstack-nova13:16
*** fifieldt has joined #openstack-nova13:17
*** fifieldt has quit IRC13:17
*** eharney has joined #openstack-nova13:17
openstackgerritRajesh Tailor proposed openstack/nova: Allow force-delete irrespective of VM task_state  https://review.openstack.org/16379813:18
*** VW_ has quit IRC13:18
*** VW_ has joined #openstack-nova13:19
*** VW_ has quit IRC13:19
*** VW_ has joined #openstack-nova13:20
*** josecastroleon has joined #openstack-nova13:21
*** BobBall_AWOL is now known as BobBall13:21
alex_xujohnthetubaguy: hi, just add two more questions for policy and add some detail for version bump which hope help for discussion https://etherpad.openstack.org/p/YVR-nova-api-2.1-in-liberty13:21
*** cinerama has quit IRC13:22
alex_xutwo etherpads are LGTM13:22
*** VW_ has quit IRC13:22
*** VW_ has joined #openstack-nova13:23
johnthetubaguyalex_xu: whats "user-owned permission"?13:24
alex_xujohnthetubaguy: currently all the policy enforce without target. So tenant-owner permission is done by the db. So thinking if we adding target, then we can enable user-owned permission13:25
alex_xujohnthetubaguy: it means the rule can be "user_id:%(user_id)s", the user only can see the vm belong to him13:25
alex_xujohnthetubaguy: user can't see the vm in the same tenant belong to other user.13:25
*** doron_afk is now known as doron13:26
johnthetubaguyalex_xu: hierarchical tenant stuff seemed like the way to support that13:26
*** cinerama has joined #openstack-nova13:26
alex_xujohnthetubaguy: hierarchical tenant is still enforce on tenant-owner? I guess, but let me check the detail hierarchical tenant13:27
johnthetubaguyalex_xu: it does, but users can be in multiple tenants in interesting groups, and create their own sub tenants, and add users into those13:28
*** fawadkhaliq has quit IRC13:29
johnthetubaguyalex_xu: ssh keys are the exception here, I guess13:29
alex_xujohnthetubaguy: emm... sub-tenants have resource isolation at here?13:29
*** baoli has quit IRC13:30
alex_xujohnthetubaguy: the case what I said is pretty similar, just need change authorize(context, action="detail") to authorize(context, action="detail", target=instance)13:31
alex_xus/similar/simple....13:31
*** baoli_ has joined #openstack-nova13:31
*** jgrimm is now known as zz_jgrimm13:32
johnthetubaguyalex_xu: but if a user gets a shared tenant, and an individual tenant each, you get much of what you need, without fundamentally changing things.13:33
johnthetubaguyalex_xu: hmm, bit worried that debate would go on and on, probably best to move it to the end of the session, assuming its not high priority13:34
johnthetubaguyalex_xu: I guess I just don't understand the use case13:34
alex_xujohnthetubaguy: yes, it pretty low priority, I put at here just in case there really have some one want that.13:34
*** _gryf is now known as _gryf|afk13:36
*** b3nt_pin has quit IRC13:36
*** beagles has quit IRC13:38
johnthetubaguyalex_xu: lets ignore it then please, we should only add features where there is a strong need, everything owned by a tenant is a very old assumption to suddenly change13:38
*** b3nt_pin has joined #openstack-nova13:38
*** b3nt_pin is now known as beagles13:38
johnthetubaguyat the end is cool13:38
*** VW_ has quit IRC13:38
*** mpaolino has joined #openstack-nova13:38
openstackgerritJames Page proposed openstack/nova: Handle return code 2 from blkid calls  https://review.openstack.org/15979713:39
alex_xujohnthetubaguy: ok, no problem13:39
*** dimsum__ has joined #openstack-nova13:39
*** Jeffrey4l has quit IRC13:40
*** jamespage has joined #openstack-nova13:40
johnthetubaguyalex_xu: thanks for reviewing all of those etherpads though, hopefully that helps with the sessions13:40
alex_xujohnthetubaguy: np, hope we have wonderful api session13:41
*** lpetrut1 has quit IRC13:41
*** exploreshaifali has joined #openstack-nova13:42
*** mriedem has joined #openstack-nova13:42
*** nihilifer has joined #openstack-nova13:43
*** emagana has quit IRC13:43
mriedemoh hello13:43
jamespageany chance anyone could take a look at https://review.openstack.org/#/c/159797/ ?13:44
jamespagewe're holding that as a patch in ubuntu for kilo release as launching instances without libguestfs without it is pretty broken13:44
mriedemjamespage: looking13:46
*** thangp has joined #openstack-nova13:46
gilliardHi mriedem. Thanks for fixing the live-migration tempest thing last week.13:46
jamespagemriedem, thanks13:46
*** BobH has joined #openstack-nova13:48
*** ajayaa has quit IRC13:48
bauzasjohnthetubaguy: if you agree, wanted to volunteer on https://etherpad.openstack.org/p/YVR-nova-scalling-out-scheduler-for-cells13:48
bauzasjohnthetubaguy: I already have an etherpad for that13:49
bauzashttps://etherpad.openstack.org/p/liberty-nova-scalable-scheduler13:49
ankit_ag mriedem: hi, Could you please review https://review.openstack.org/#/c/145738/. I have addressed all your review comments to make code blocks more readable.13:49
rwmjonesmriedem: yeah I was going to send you that patch, because I think it's related to the problem you were talking about on Friday13:51
mriedemrwmjones: this one? https://review.openstack.org/#/c/159797/ - i'm using guestfs though13:51
rwmjonessorry, no, NOT that one13:51
* rwmjones is confused13:52
rwmjonesmriedem: https://review.openstack.org/#/c/181808/ is the one I was going to send you13:52
johnthetubaguybauzas: can you combine your ideas into the official etherpad for me please?13:52
bauzasis it me or etherpad is just cracking ?13:52
bauzasjohnthetubaguy: yup, was about to do that until I saw that etherpad severely suffers13:52
mriedemrwmjones: oh yeah, didn't know about that but qin zhao works with me13:52
mriedemrwmjones: he was looking at the same issue13:53
*** dimsum__ has quit IRC13:53
johnthetubaguybauzas: I had issues at the weekend if I had too many etherpads open13:53
johnthetubaguybauzas: seemed OK otherwise13:53
rwmjonesmriedem: ah, that explains it .. danpb looked at the patch also and is OK with it13:53
*** apuimedo has quit IRC13:53
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: Drop explicit suds dependency  https://review.openstack.org/18155413:53
bauzasjohnthetubaguy: going to wipe the cache to see13:53
mriedemrwmjones: since i have a recreate of the issue i'll try to test this change out today13:54
mriedemthanks for pointing it out13:54
*** exploreshaifali has quit IRC13:54
danpbyeah, that bug will cause the entire of nova-compute to hang during the 30 seconds the guestfs takes to build its appliance the first time13:55
danpbso that could certainly cause general nova timeout problems13:55
dansmithouch13:55
danpbdid i mention eventlet sucks13:55
mriedemdanpb: yeah, that's the thing i was talking about last friday13:55
*** exploreshaifali has joined #openstack-nova13:55
*** artom has quit IRC13:55
danpbeventlet and native libraries are a just awful mix that should be a reason to never use eventlet13:55
mriedemwell, there is a session in vancouver on moving off eventlet13:56
*** markvoelker has quit IRC13:56
rwmjoneseven in the ordinary case, g.launch() is going to hang green threads for 2 or 3 seconds13:57
*** sahid has quit IRC13:57
*** joshw42 has joined #openstack-nova13:57
danpbrwmjones: yeah, we already have that bit running via a background native thread13:59
danpbthis function that's just been fixed was something that was put in to probe if guestfs was working properly (since ubuntu installs have it broken by default)13:59
rwmjonesyup13:59
*** vladikr has joined #openstack-nova14:00
openstackgerritjaveme proposed openstack/nova: VMware: Update to return the correct ESX iqn  https://review.openstack.org/16270014:00
*** sahid has joined #openstack-nova14:00
*** Longgeek has quit IRC14:00
*** Longgeek has joined #openstack-nova14:01
*** Jeffrey4l has joined #openstack-nova14:01
mriedemjamespage: +2 on https://review.openstack.org/#/c/159797/14:01
jamespagemriedem, thankyou - much appreciated14:01
jamespagereally hate holding a delta :-)14:01
*** smccully has quit IRC14:02
*** Longgeek_ has joined #openstack-nova14:03
*** Longgeek has quit IRC14:04
*** bkopilov has quit IRC14:05
*** VW_ has joined #openstack-nova14:05
* mriedem is getting used to the 'new' gerrit today, a bit lost14:05
*** joshw42 has quit IRC14:05
*** openstackgerrit has quit IRC14:06
*** openstackgerrit has joined #openstack-nova14:07
*** VW_ has quit IRC14:07
dansmiththere are some nice things about it14:07
dansmithdid they change the "old" interface or just the new one?14:07
kashyapWhat is the newness? I only see "Can Merge"14:07
*** VW_ has joined #openstack-nova14:08
*** mpaolino has quit IRC14:09
mriedem'new' as in whatever was 'new' for a long time now14:09
*** rook has quit IRC14:09
mriedemthe page is just very busy to me compared to the old one14:09
dansmithyeah, they call it the "new" interface in the prefs I think14:10
mriedemright, that's what i changed to14:10
mriedemand now my world is topsy turvy14:10
dansmithyeah, not sure why they feel the need to change it so drastically each time14:10
*** rook has joined #openstack-nova14:11
*** dboik has joined #openstack-nova14:11
openstackgerritDan Smith proposed openstack/nova: Drop compute RPC 3.x support  https://review.openstack.org/17995114:11
mriedemit's like, who would feed big changes to their users every 6 months or so, that's just crazy14:11
kashyapmriedem: C'mon, OpenStack _itself_ feeds its operators/users with a new release every 6 months :-)14:12
mriedemhence the joke14:12
kashyapAh, didn't read it in the right 'tone'14:12
*** dave-mccowan has quit IRC14:14
sdaguedansmith: yeh, honestly, I'm pretty close to writing client side json to swap the commit message & review columns back14:15
sdagueclient side javascript14:15
*** sdake_ has joined #openstack-nova14:16
dansmithI don't like that it wraps forcibly now14:16
*** dims has joined #openstack-nova14:16
*** ferest has joined #openstack-nova14:16
dansmithor maybe I just wish people didn't write long lines in their commit message14:16
dansmithotherwise I don't really care14:17
*** zzzeek has joined #openstack-nova14:18
*** openstack has joined #openstack-nova14:19
*** ankit_ag has quit IRC14:20
*** yasu_ has quit IRC14:20
*** ferest has quit IRC14:21
*** yingjun has quit IRC14:21
*** irenab has quit IRC14:23
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: Drop explicit suds dependency  https://review.openstack.org/18155414:24
*** lpetrut has joined #openstack-nova14:24
*** mpaolino has joined #openstack-nova14:25
*** bnemec has joined #openstack-nova14:25
*** kmartin has quit IRC14:26
openstackgerritOpenStack Proposal Bot proposed openstack/nova: Updated from global requirements  https://review.openstack.org/18191314:28
*** dave-mccowan has joined #openstack-nova14:29
*** doron is now known as doron_afk14:31
johnthetubaguydansmith: sdague: is it just me, or is adding comments a bit unreliable after the upgrade, stuff keep getting reopened and added in odd places?14:31
johnthetubaguymaybe its just me using chrome?14:31
dansmithnot that I've noticed14:31
dansmithalthough I haven't done much yet14:31
dansmithjust a few comments14:31
*** sdake has joined #openstack-nova14:32
openstackgerritjaveme proposed openstack/nova: Make vm_state consistent with power_state  https://review.openstack.org/18166114:33
openstackgerritClaudiu Belu proposed openstack/nova: Hyper-V: Fixes cold migration / resize issue  https://review.openstack.org/18191614:33
*** yingjun has joined #openstack-nova14:33
*** mtanino_away has quit IRC14:35
*** yingjun has quit IRC14:35
*** yingjun has joined #openstack-nova14:35
*** mtanino has joined #openstack-nova14:35
*** yingjun has quit IRC14:35
*** sdake_ has quit IRC14:35
*** yingjun has joined #openstack-nova14:35
*** zz_jgrimm is now known as jgrimm14:37
*** mestery has quit IRC14:38
sdaguejohnthetubaguy: seems to work fine for me14:39
*** nkrinner has quit IRC14:40
*** otter768 has joined #openstack-nova14:40
sdaguejohnthetubaguy: I'm using chrome.14:40
*** annegentle has joined #openstack-nova14:40
johnthetubaguysdague: hmm, OK, maybe its just me14:40
dansmithme too14:40
*** Murali has quit IRC14:40
openstackgerritAndrea Rosa proposed openstack/nova: WIP: Passing body for all requests but for TRACE  https://review.openstack.org/18191814:41
mikal.14:41
sdaguejohnthetubaguy: a shift+reload is always warrented after a gerrit upgrade, the javascript has a weird caching model some times14:41
mikaljohnthetubaguy: oh, you're online at the same time as me!14:41
mikalI find this very confusing14:42
johnthetubaguysdague: yeah, good point14:42
johnthetubaguymikal: :)14:42
*** emagana has joined #openstack-nova14:42
johnthetubaguymikal: you in SAT?14:42
mikaljohnthetubaguy: I just emailed you cause I thought you'd be asleep because I suck at maths14:42
johnthetubaguymikal: heh14:43
johnthetubaguymikal: timezones are just hard, duno why, its not even 4pm yet14:44
*** otter768 has quit IRC14:44
*** zsais has joined #openstack-nova14:44
*** amotoki_ has joined #openstack-nova14:45
*** anteaya has joined #openstack-nova14:46
johnthetubaguysdague: oh, so it adds the comment where I last clicked first, I think that is what was confusing me14:46
dimsjohnthetubaguy: i touched up the rootwrap as daemon spec https://review.openstack.org/#/c/105404/ (BP - https://blueprints.launchpad.net/nova/+spec/nova-rootwrap-daemon-mode). Do i add it to the nova meeting agenda? (code is almost ready as well)14:46
sdaguejohnthetubaguy: ah, yes14:46
johnthetubaguydims: only if the review is stuck at this point really14:47
*** whenry has joined #openstack-nova14:47
johnthetubaguydims: its stuff without a spec that gets approved in the meeting routinely14:47
dimsjohnthetubaguy: ok thanks. i'll ride it out :)14:47
johnthetubaguydims: I was just reviewing it, it reads like neutron hasn't done the switch yet?14:48
dimsjohnthetubaguy: they are using it. i just picked a run at random to check - http://logs.openstack.org/67/180367/9/check/check-tempest-dsvm-neutron-full/fb27ec5/logs/screen-q-dhcp.txt.gz#_2015-05-09_04_22_15_69114:49
dimscinder has not moved yet14:50
johnthetubaguydims: yeah, the blueprint was marked as implemented, was just looking at some of the patches14:50
johnthetubaguydims: its just the spec is a bit old in places, adding comments14:50
dimsjohnthetubaguy: ack thanks.14:50
*** hemnafk is now known as hemna14:51
openstackgerritjaveme proposed openstack/nova: VMware: Prefer ShutdownGuest to PowerOffVM_Task  https://review.openstack.org/18163414:52
*** cfriesen has joined #openstack-nova14:52
*** artom has joined #openstack-nova14:53
johnthetubaguydims: did we see the expected performance boost in neutron?14:54
*** BobH1 has joined #openstack-nova14:54
anteayajohnthetubaguy: for the sprint at ibm make sure they know you need to have wifi14:54
anteayajohnthetubaguy: the sprint for cinder at ibm in austin had now wifi for all 3 days, we all had to tether off of our phones14:55
*** lpetrut has quit IRC14:55
dimsdigging it up14:55
johnthetubaguyanteaya: mikal and mriedem are looking after all that for me, thats handy feedback about sorting out wifi though14:55
johnthetubaguyanteaya: oh, I remember that being mentioned now, that would suck…14:55
anteayait did14:55
mriedemway ahead of you14:55
anteayamriedem: awesome14:56
mriedemwe also have...running water!14:56
mikalHeh14:56
mriedemand lighting14:56
mikalDo you have tornadoes?14:56
dansmithmriedem: ibm is notorious for effing that up, FWIW :)14:56
mriedemsometimes14:56
mikaltexas has tornados apparently14:56
*** BobH has quit IRC14:56
mriedemi suspect there are many semi-pro wrestlers named the texas tornado14:57
mriedemwe have more thunderstorms than anything14:57
openstackgerritClaudiu Belu proposed openstack/nova: Hyper-V: Fixes cold migration / resize issue  https://review.openstack.org/18191614:57
dimsjohnthetubaguy: long thread with at least one set of numbers - http://markmail.org/message/v7f2adthal3rrgi614:57
mikalmriedem: is there a recommended hotel in Rochester?14:58
mikalmriedem: also can I get a street address?14:58
mriedemmikal: hotels? hmm, there are a ton of them14:58
mikali.e. please make https://wiki.openstack.org/wiki/Sprints/NovaLibertySprint less blank14:59
mikalmriedem: any have an IBM visitor discount?14:59
mriedemnot sure about that, will have to ask around14:59
mikalIntel had some sort of visitor rate in Oregon14:59
mikalIts not a big deal if it doesn't, but people will ask14:59
johnthetubaguydims: i was meaning, sure it helps in isolation, did it actually have an overall impact? I guess yes, but I was curious I supose15:00
mriedemi feel like anytime people are visiting they are staying downtown somewhere so there might be a discount there15:00
edleafecharge/.15:00
edleafedoh - wrong window15:01
dimsmikal: there's a cluster of hotels around this one http://www.marriott.com/hotels/travel/rstts-towneplace-suites-rochester/ - pretty decent. you can even stay in downtown and drive to the ibm office, just takes 12-15 mins15:02
dimsmikal: y, just ask for IBM rate, should have one15:03
openstackgerritdave-mcnally proposed openstack/nova: Add policy to cover snapshotting of volume backed instances  https://review.openstack.org/17680515:03
mriedemdims: mikal: let me confirm,15:03
mriedemi know ibm has a thing with marriotts but wasn't sure if that was both ways15:03
*** markvoelker has joined #openstack-nova15:03
*** wwriverrat has joined #openstack-nova15:04
*** jecarey has joined #openstack-nova15:05
*** dboik has quit IRC15:05
*** rook has quit IRC15:07
*** lpetrut has joined #openstack-nova15:07
mikalThis new gerrit UI is going to take some getting used to15:08
dimsmriedem: spent a lot of time putting racks together there. good memories :)15:09
mriedemdims: are you going to come for the midcycle?15:09
dimsmriedem: y15:09
*** nelsnelson has joined #openstack-nova15:11
*** dims has quit IRC15:12
*** aix has quit IRC15:12
*** aswadr has quit IRC15:14
*** yamahata has joined #openstack-nova15:14
*** dsanders has joined #openstack-nova15:14
*** wwriverrat has left #openstack-nova15:16
*** baoli_ has quit IRC15:16
*** unicell has joined #openstack-nova15:18
*** VW_ has quit IRC15:18
*** mtanino has quit IRC15:20
*** unicell1 has quit IRC15:20
*** rook has joined #openstack-nova15:20
*** fifieldt has joined #openstack-nova15:22
*** fifieldt has quit IRC15:23
*** VW_ has joined #openstack-nova15:23
johnthetubaguyrussellb: I think the gerrit upgrade made have broken your stats tools, looking at this: https://groups.google.com/forum/#!topic/repo-discuss/yQgRR5hlS3E15:24
mtreinishjohnthetubaguy: I was looking at the nova summit sched and noticed the nova functional testing session overlaps with a qa session15:24
mtreinishdo you think we could swap it with the session before after?15:24
russellbjohnthetubaguy: thanks for the heads up.  indeed i used resume_sortkey ...15:24
russellbjohnthetubaguy: and based on that thread, it seems there's no workaround15:25
johnthetubaguyrussellb: yeah, that was my reading of that too :(15:26
russellbjohnthetubaguy: guess i'll replace my stats files with a passive aggressive comment about gerrit15:26
johnthetubaguyrussellb: heh15:26
*** lpetrut has quit IRC15:27
dansmith:(15:27
*** bkopilov has joined #openstack-nova15:27
johnthetubaguyrussellb: I wonder if our version is new enough for this: https://gerrit-review.googlesource.com/#/c/59125/15:28
*** deepakcs has joined #openstack-nova15:28
*** atuvenie has quit IRC15:29
johnthetubaguyrussellb: looks like we have 2.10 with has this: https://gerrit-review.googlesource.com/#/c/59170/15:29
deepakcsdansmith: morning, when u get some time, pls bless https://review.openstack.org/#/c/168805/ - TIA15:29
*** rushiagr_away is now known as rushiagr15:29
openstackgerritDoug Hellmann proposed openstack/python-novaclient: Drop use of 'oslo' namespace package  https://review.openstack.org/18070115:30
russellbjohnthetubaguy: will check15:30
*** mtanino has joined #openstack-nova15:31
*** armax has joined #openstack-nova15:33
*** dboik has joined #openstack-nova15:35
russellbjohnthetubaguy: seems to work, thanks15:36
*** annegentle has quit IRC15:37
*** markus_z has quit IRC15:37
johnthetubaguyrussellb: ah, sweet, np15:37
*** dsanders has quit IRC15:37
*** annegentle has joined #openstack-nova15:38
russellbjohnthetubaguy: https://review.openstack.org/18193815:38
openstackgerritxing-yang proposed openstack/nova-specs: EMC ScaleIO Data Client Libvirt Volume Driver  https://review.openstack.org/18194115:38
*** atuvenie has joined #openstack-nova15:38
openstackgerritMichael Still proposed openstack/nova-specs: Add the description about v2.1 API validation  https://review.openstack.org/17277115:38
sdaguerussellb: apparently I have +2 on that15:39
sdaguethat's going to impact a bunch of our tools iirc15:39
russellbsdague: heh, yeah, you're stats-core15:39
russellbi usually just merge my own stuff in that repo, figure nobody really cares15:40
*** whenry has quit IRC15:40
sdagueyep, no worries15:40
openstackgerritMatt Riedemann proposed openstack/nova: Add missing runtime requirements  https://review.openstack.org/18194415:40
johnthetubaguyrussellb: does the len(changes) work correctly with the limit 5 bit?15:41
johnthetubaguyrussellb: oh wait, I see now15:41
russellbk :)15:42
russellblimit:5 only on the first request15:42
russellbjust in case our local cache is actually pretty close to up to date15:42
*** dboik_ has joined #openstack-nova15:42
johnthetubaguyrussellb: yeah, I had stuff upside down in my head, looks good15:43
russellbthe cache db is so sophistacated15:43
russellba pickled dict to local disk!15:43
russellbhacky scripts are fun.15:43
*** atuvenie has quit IRC15:43
openstackgerritMatt Riedemann proposed openstack/nova: Add missing runtime requirements  https://review.openstack.org/18194415:44
luvumm, why do i get both oslo_messaging and oslo.messaging again?15:44
*** dboik has quit IRC15:44
mriedemluv: ?15:44
*** mpaolino has quit IRC15:44
dhellmannluv: http://specs.openstack.org/openstack/oslo-specs/specs/kilo/drop-namespace-packages.html15:45
russellbRTFS15:45
russellbheh15:45
luvthanks15:45
mriedemi'm still wondering about this: http://logs.openstack.org/05/168805/8/check/gate-nova-tox-functional/e562ffe/console.html.gz#_2015-05-05_04_58_59_88215:45
mriedem/home/jenkins/workspace/gate-nova-tox-functional/.tox/functional/local/lib/python2.7/site-packages/pkg_resources/__init__.py:2351: DeprecationWarning: The oslo namespace package is deprecated. Please use oslo_middleware instead.15:45
*** markvoelker has quit IRC15:45
*** baoli has joined #openstack-nova15:46
mriedemwe use oslo_middleware everywhere from what i can tell15:46
luvinteresting - so it's because of setuptools shortcomings ... unfortunate ... it looks and feels neater with the dot15:47
dhellmannmriedem: https://review.openstack.org/178440 should fix that15:47
*** rwsu has joined #openstack-nova15:48
mriedemdhellmann: heh, ahh, i did see that last week when i was looking at this15:48
mriedemsince i synced up this morning i noticed that was changed15:48
mriedemnow i know why :)15:48
*** Nikolay_St has quit IRC15:48
*** arnaud____ has joined #openstack-nova15:48
openstackgerritAndrew Laski proposed openstack/nova-specs: Proposal for cells v2 scheduling interaction  https://review.openstack.org/14148615:49
*** tojuvone has quit IRC15:51
*** eharney_ has joined #openstack-nova15:54
*** tcammann has joined #openstack-nova15:55
*** eharney has quit IRC15:56
*** ildikov has quit IRC15:56
*** dulek has quit IRC15:56
*** ildikov has joined #openstack-nova15:56
mriedemand she's down15:56
*** mpaolino has joined #openstack-nova15:58
openstackgerritAndrew Laski proposed openstack/nova-specs: Fix pep8 violations in tests  https://review.openstack.org/17923015:59
*** baoli has quit IRC15:59
*** annegentle has quit IRC15:59
*** annegentle has joined #openstack-nova16:00
*** unicell has quit IRC16:01
*** jlanoux has quit IRC16:05
mikalDoes anyone else get 404s when they clikc on links in review dashboards? Is that a known issue?16:05
*** annegentle has quit IRC16:06
mriedemmikal: me too, was watching in -infra16:07
*** yingjun has quit IRC16:07
mikalOk, Kevin ust reported something similar on email too16:07
mriedemmikal: i'm only seeing it on WIP changes16:08
*** baoli has joined #openstack-nova16:08
*** deepthi has joined #openstack-nova16:08
*** rdo has quit IRC16:08
mriedemoh also, if your gerrit is setup for the 'old' screen then it doesn't work getting to changes16:08
*** matrohon has quit IRC16:08
mikalI thought I was using the new review screen16:09
mikalReviewing was working earlier this morning, but not now16:09
mriedemif it's -W I get a 40416:09
*** mpavone has quit IRC16:09
*** rdo has joined #openstack-nova16:10
mriedemand now my dashboard just changed and all of my -Workflow changes are gone :(16:11
*** subscope has quit IRC16:12
*** browne has joined #openstack-nova16:13
*** jecarey has quit IRC16:14
mriedemmikal: working now16:15
mriedem?16:15
*** haypo has quit IRC16:16
*** deepthi has quit IRC16:16
*** jistr has quit IRC16:17
mikalmriedem: yep16:17
mikalmriedem: the restart seems to have fixed me16:17
bauzasagain, trying to reload etherpad but fails16:17
mriedemold style still doesn't work16:17
mriedemso i'm forced to 'new'16:17
*** jcoufal has quit IRC16:18
bauzasnew is always better (c) Barney16:18
*** jcoufal has joined #openstack-nova16:18
claudiubbauzas: +116:18
edleafebauzas: because it's innovative!16:19
*** jogo has quit IRC16:19
*** rdo has quit IRC16:19
*** moshele has quit IRC16:21
*** rdo has joined #openstack-nova16:21
openstackgerritStuart McLaren proposed openstack/nova: Add explicit dependency on python-keystoneclient  https://review.openstack.org/18196616:22
bauzasso, the 1M dollar question is : why etherpad is not providing a cache buster ?16:22
*** baoli has quit IRC16:22
*** kmartin has joined #openstack-nova16:22
*** claudiub|2 has joined #openstack-nova16:22
*** jcoufal has quit IRC16:23
claudiub|2hello. If you guys have a little bit of time to take a look at a small, crucial bugfix, I would appreciate it. :) https://review.openstack.org/#/c/181916/16:23
*** jcoufal has joined #openstack-nova16:23
openstackgerritDavid Bingham proposed openstack/nova: Allow cleanup completion when serial ports already released  https://review.openstack.org/17997816:24
openstackgerritsahid proposed openstack/nova: libvirt: introduces a Guest to wrap arround virConnect  https://review.openstack.org/17431316:24
openstackgerritsahid proposed openstack/nova: libvirt: update Host to return a Guest object  https://review.openstack.org/18196916:24
*** claudiub has quit IRC16:25
*** sdake_ has joined #openstack-nova16:25
mriedemclaudiub|2: i have an axe to grind, http://lists.openstack.org/pipermail/openstack-dev/2015-May/063183.html16:27
mriedemclaudiub|2: i couldn't get a hold of alexpilotti in here to address those concerns16:27
johnthetubaguymtreinish: can you email about that session clash please, and I can try shuffle things a little16:27
johnthetubaguymtreinish: just not sure I will get chance right away16:28
johnthetubaguymtreinish: actually, did you say the session just before would work?16:28
*** baoli has joined #openstack-nova16:28
*** lpetrut has joined #openstack-nova16:29
claudiub|2mriedem: hello. Well, as it was proposed on the ML, I've resubmited the bp spec, with all the details regarding to it. https://review.openstack.org/#/c/103945/16:29
*** bkopilov has quit IRC16:29
*** alaski has quit IRC16:29
*** leifz has quit IRC16:29
*** marun has joined #openstack-nova16:29
*** sdake has quit IRC16:29
*** mmedvede_ has quit IRC16:29
claudiub|2mriedem: sorry for the inconvenience. :)16:30
mriedemclaudiub|2: thanks, did the kilo release notes get updated?16:30
*** matrohon has joined #openstack-nova16:30
claudiub|2mriedem: checking16:31
*** sahid has quit IRC16:31
mriedemi don't see anything specific about gen2 images16:31
mtreinishjohnthetubaguy: yeah the session just before would work.16:31
mtreinishjohnthetubaguy: sure I can send you an email16:31
claudiub|2mriedem: I see here ( https://wiki.openstack.org/wiki/ReleaseNotes/Kilo#Hyper-V ) that "Support for generation 2 VMs" has been added.16:32
claudiub|2mriedem: what do you mean?16:32
mriedemclaudiub|2: yeah, but the spec said there was a docs impact16:32
mriedemclaudiub|2: "The Nova driver documentation should include an entry about this topic including when to use and when not to use generation 2 VMs. A note on the relevant Glance image property should be added as well."16:32
claudiub|2mriedem: ok, I'll take care of that, although that topic was pretty much covered in the spec16:34
*** unicell has joined #openstack-nova16:34
*** alaski has joined #openstack-nova16:35
*** Sukhdev has joined #openstack-nova16:35
*** leifz has joined #openstack-nova16:35
johnthetubaguymtreinish: I just updated that now, in the hope the other way around is fine16:35
*** sdake has joined #openstack-nova16:36
mtreinishjohnthetubaguy: perfect that works fine. Thanks16:36
*** ajayaa has joined #openstack-nova16:36
*** pixelbeat has joined #openstack-nova16:37
*** Nic has joined #openstack-nova16:38
*** pixelbeat_ has quit IRC16:38
johnthetubaguymtreinish: thanks for spotting it for me, I really appreciate that :)16:39
*** browne has quit IRC16:39
*** deepakcs has quit IRC16:40
*** sdake_ has quit IRC16:40
*** otter768 has joined #openstack-nova16:40
*** arnaud____ has quit IRC16:42
*** mmedvede_ has joined #openstack-nova16:42
*** Marga_ has quit IRC16:42
*** bkopilov has joined #openstack-nova16:43
mgagnethe bug #1328546 is considered resolved in Nova but without any link to commits or changes. Can someone point me to the commit?16:44
openstackbug 1328546 in neutron "Race condition when hard rebooting instance" [Medium,Invalid] https://launchpad.net/bugs/1328546 - Assigned to Li Ma (nick-ma-z)16:44
*** derekh_ has joined #openstack-nova16:44
mgagneafter a brief glance at the code, I don't see anything that could have fixed the problem16:44
*** otter768 has quit IRC16:45
*** mpaolino has quit IRC16:46
*** ZZelle is now known as ZZelle_16:46
*** derekh has quit IRC16:47
*** exploreshaifali has quit IRC16:48
*** derekh_ has quit IRC16:51
*** pixelbeat has quit IRC16:51
*** dsanders has joined #openstack-nova16:52
*** doron_afk has quit IRC16:52
*** dguitarbite has quit IRC16:52
*** atuvenie has joined #openstack-nova16:52
*** rushiagr is now known as rushiagr_away16:53
dansmithI'm getting some 500s from gerrit loading related changes16:54
dansmithand it also seems to be improperly marking my stuff as merge conflicts16:55
*** afazekas has quit IRC16:55
bauzasjohnthetubaguy: I went through the Summit etherpads and you're providing a big TODO - we need less text16:56
johnthetubaguybauzas: yeah, quite a few say, hmm, this needs more focus16:57
mriedemdansmith: yeah it's all fubar atm16:57
mriedemdansmith: git review isn't working for me either16:57
bauzasjohnthetubaguy: mmm, just wonder how we can be both short and precise16:57
johnthetubaguybauzas: mostly to be agreed between the session leaders, or at least ensure there are concrete proposals to review for each16:57
mriedemdansmith: the infra guys are working on it16:57
dansmithmriedem: okay, wasn't sure if it was being discussed in infra or not, based on the convo16:57
dansmithokay cool16:57
mriedemsounds like it's one of many issues16:57
johnthetubaguybauzas: now if you are happy with the list, feel free to delete the TODO :)16:58
*** davideagnello has joined #openstack-nova16:58
johnthetubaguybauzas: just a few look a bit like more than 40 mins of stuff to discuss, but I could be proved wrong, maybe the key thing is putting the most important bits first16:58
*** yamahata has quit IRC16:58
bauzasjohnthetubaguy: sure thing16:58
*** yamahata has joined #openstack-nova16:58
bauzasjohnthetubaguy: jaypipes had nice ideas for the first session at least, so I don't really want to cut the wood16:59
*** eharney_ is now known as eharney16:59
bauzasjohnthetubaguy: but we can prio the bullets for sure16:59
*** amotoki_ has quit IRC16:59
*** pixelbeat has joined #openstack-nova17:00
*** davideagnello has quit IRC17:00
*** davideagnello has joined #openstack-nova17:00
*** matrohon has quit IRC17:01
*** vilobhmm1 has joined #openstack-nova17:03
openstackgerritJames Chapman proposed openstack/nova-specs: SRIOV scheduling with NIC capabilities  https://review.openstack.org/13533117:05
*** annegentle has joined #openstack-nova17:05
*** promulo_ has joined #openstack-nova17:05
*** promulo_ has quit IRC17:05
*** pixelbeat has quit IRC17:05
*** promulo_ has joined #openstack-nova17:05
*** Marga_ has joined #openstack-nova17:06
*** romainh has left #openstack-nova17:07
openstackgerritJames Chapman proposed openstack/nova-specs: SRIOV scheduling with NIC capabilities  https://review.openstack.org/13533117:08
openstackgerritxing-yang proposed openstack/nova-specs: EMC ScaleIO Data Client Libvirt Volume Driver  https://review.openstack.org/18194117:09
*** baoli has quit IRC17:10
openstackgerritxing-yang proposed openstack/nova-specs: EMC ScaleIO Data Client Libvirt Volume Driver  https://review.openstack.org/18194117:11
*** baoli has joined #openstack-nova17:12
*** claudiub has joined #openstack-nova17:12
*** danpb has quit IRC17:14
*** lucasagomes is now known as lucas-dinner17:14
*** browne has joined #openstack-nova17:14
*** jcoufal has quit IRC17:15
*** claudiub|2 has quit IRC17:15
*** dguitarbite has joined #openstack-nova17:15
*** Marga_ has quit IRC17:16
openstackgerritJames Chapman proposed openstack/nova-specs: SRIOV scheduling with NIC capabilities  https://review.openstack.org/13533117:16
*** jogo has joined #openstack-nova17:19
*** jogo has quit IRC17:19
*** jogo has joined #openstack-nova17:19
*** rushiagr_away is now known as rushiagr17:21
*** haomaiwa_ has joined #openstack-nova17:22
*** patrickeast has joined #openstack-nova17:24
*** emagana has quit IRC17:24
*** krtaylor has quit IRC17:24
*** gszasz has quit IRC17:25
*** Marga_ has joined #openstack-nova17:25
*** emagana has joined #openstack-nova17:26
*** baoli has quit IRC17:29
*** jodah has quit IRC17:30
*** moshele has joined #openstack-nova17:30
*** vipul has quit IRC17:31
*** baoli has joined #openstack-nova17:34
*** jodah- has quit IRC17:35
*** rushiagr is now known as rushiagr_away17:36
*** krtaylor has joined #openstack-nova17:36
-openstackstatus- NOTICE: We have discovered post-upgrade issues with Gerrit affecting nova (and potentially other projects). Some changes will not appear and some actions, such as queries, may return an error. We are continuing to investigate.17:39
*** ChanServ changes topic to "We have discovered post-upgrade issues with Gerrit affecting nova (and potentially other projects). Some changes will not appear and some actions, such as queries, may return an error. We are continuing to investigate."17:39
*** moshele has quit IRC17:40
*** mestery has joined #openstack-nova17:41
*** arnaud____ has joined #openstack-nova17:42
*** annegentle has quit IRC17:43
*** baoli has quit IRC17:43
*** mestery has quit IRC17:44
*** moshele has joined #openstack-nova17:45
*** mestery has joined #openstack-nova17:46
*** arnaud____ has quit IRC17:46
mriedemjohnthetubaguy: alaski: hey.... http://git.openstack.org/cgit/openstack/nova/tree/nova/virt/xenapi/image/bittorrent.py#n7517:47
mriedemdoes rax drop some custom entry points in?17:47
mriedemi don't see any entry points in nova for a torrent_url17:47
mriedemfound that by looking at what's using pkg_resources in nova, it's this and versionutils.py from oslo-incubator17:47
mriedemthis entry point loader thing should be using stevedore now, but this looks like it's not even for anything in tree17:48
alaskimriedem: let me check, though I don't believe we're actually using that class at all right now17:50
dansmithyeah,17:50
dansmithI thought it ended up not being very useful or something17:50
dansmithforget who told me that17:50
mriedemleif?17:50
dansmithno17:50
mriedemcan we just kill that bittorrent module then?17:50
dansmithdunno17:51
alaskiI wouldn't kill the module, as it could be useful for someone.  but requiring the config, and removing the entrypoints stuff would be good17:52
alaskiif someone needs it they can add it back with stevedor17:52
mriedemalaski: ok, i'm on it17:52
mriedemafter coffee17:52
mriedemi didn't see the config option stuff right above it17:53
*** achanda has joined #openstack-nova17:54
alaskidansmith: I think there was some difficulty with torrent libs during testing, like downloads would stop for some reason and a root cause wasn't found17:55
dansmithalaski: okay, I thought it was something more like it ended up saturating the wrong links, or being too unpredictable in the impacts on other resources17:56
dansmith*seems* like it should be a damn awesome solution though17:56
*** mestery has quit IRC17:56
alaskithat's possible too, I only heard bits and pieces about it and think there were a number of issues.17:57
alaskiyeah, we still discuss it occassionally17:57
*** baoli has joined #openstack-nova17:58
alaskigiven the ever elusive "time" we'd love to try it out again17:58
*** VW__ has joined #openstack-nova17:58
*** BobH has joined #openstack-nova17:58
*** VW_ has quit IRC17:59
*** BobH1 has quit IRC18:00
*** dguitarbite has quit IRC18:00
*** rushiagr_away is now known as rushiagr18:02
*** dprince has quit IRC18:03
*** redbeard has quit IRC18:04
*** jodah has joined #openstack-nova18:05
*** ijw has joined #openstack-nova18:05
*** ijw has quit IRC18:05
*** ijw has joined #openstack-nova18:05
mriedemdansmith: holy cow, there is an ibmvisitor open network already down where the meetup will be. my work is done.18:09
dansmithmriedem: does it work?18:09
dansmithmriedem: in BVR, the visitor network required a sponsor to pre-generate an access code to activate it18:10
dansmithelse you couldn't go anywhere18:10
dansmithmriedem: you might want to try with a linux laptop too18:10
dansmithbecause if we get there and only you (with your heretical windows box) can get online, you'll be in big trouble18:10
mriedemi'm going to take my laptop down there later and try vpn18:11
*** dsanders has quit IRC18:11
*** annegentle has joined #openstack-nova18:12
sdagueright, I'm pretty sure IBM visitor required preregistration codes18:12
sdagueat least it did all the times that I tried using it18:12
dansmithyeah18:13
mriedemwell way to rain on my parade18:13
lbragstadmriedem: you could probably bribe mrodden into trying on one of his linux laptops18:13
mriedemi'm not trying nothing nohow18:14
*** emagana has quit IRC18:15
mroddenmriedem, test ur crap plzkthx18:16
mroddenwifi networks included18:16
*** emagana has joined #openstack-nova18:17
*** achanda has quit IRC18:18
*** tsekiyama has joined #openstack-nova18:19
*** tonytan4ever has joined #openstack-nova18:20
*** baoli has quit IRC18:21
*** baoli has joined #openstack-nova18:21
*** artom_ has joined #openstack-nova18:22
*** tralon_ has joined #openstack-nova18:23
*** obondarev_ has joined #openstack-nova18:23
*** lennyb has joined #openstack-nova18:23
*** hemna_ has joined #openstack-nova18:24
*** unicell has quit IRC18:25
*** alaski has quit IRC18:25
*** dboik_ has quit IRC18:25
*** bnemec has quit IRC18:25
*** vladikr has quit IRC18:25
*** lsmola_ has quit IRC18:25
*** hanzhang has quit IRC18:25
*** kaisers has quit IRC18:25
*** Guest64787 has quit IRC18:25
*** morganfainberg has quit IRC18:25
*** russellb has quit IRC18:25
*** ir2ivps3 has quit IRC18:25
*** sorrison has quit IRC18:25
*** raph_ has quit IRC18:25
*** mrda has quit IRC18:25
*** strictlyb has quit IRC18:25
*** larsks|alt has joined #openstack-nova18:26
*** Vek has quit IRC18:26
*** jodah- has joined #openstack-nova18:26
*** mjg has joined #openstack-nova18:26
*** emagana has quit IRC18:26
*** leifz has quit IRC18:26
*** gilliard has quit IRC18:26
*** larsks has quit IRC18:26
*** tlbr has quit IRC18:26
*** hemna has quit IRC18:26
*** slagle has quit IRC18:26
* mriedem is sad that git review still doesn't work18:26
*** claudiub|2 has joined #openstack-nova18:26
*** claudiub has quit IRC18:26
*** jodah has quit IRC18:26
*** artom has quit IRC18:26
*** htruta has quit IRC18:26
*** zhangtralon has quit IRC18:26
*** rwmjones has quit IRC18:26
*** obondarev has quit IRC18:26
*** lan has quit IRC18:26
*** _gryf|afk has quit IRC18:26
*** mishkin_ has quit IRC18:26
*** lparth has quit IRC18:26
sdaguemriedem: ?18:26
*** _gryf|afk has joined #openstack-nova18:26
mriedem! [remote rejected] HEAD -> refs/publish/master/bug/1453857 (n/a (unpacker error))18:27
openstackmriedem: Error: "remote" is not a valid command.18:27
*** lparth has joined #openstack-nova18:27
*** mishkin__ has joined #openstack-nova18:27
*** leifz has joined #openstack-nova18:27
*** slagle has joined #openstack-nova18:27
*** alaski has joined #openstack-nova18:27
*** unicell has joined #openstack-nova18:27
*** dboik_ has joined #openstack-nova18:27
*** bnemec has joined #openstack-nova18:27
*** vladikr has joined #openstack-nova18:27
*** lsmola_ has joined #openstack-nova18:27
*** hanzhang has joined #openstack-nova18:27
*** kaisers has joined #openstack-nova18:27
*** morganfainberg has joined #openstack-nova18:27
*** russellb has joined #openstack-nova18:27
*** ir2ivps3 has joined #openstack-nova18:27
*** sorrison has joined #openstack-nova18:27
*** raph_ has joined #openstack-nova18:27
*** mrda has joined #openstack-nova18:27
*** strictlyb has joined #openstack-nova18:27
mriedemsdague: the thing infra is working on i believe18:27
*** htruta has joined #openstack-nova18:27
*** tlbr has joined #openstack-nova18:27
*** slagle has quit IRC18:27
*** slagle has joined #openstack-nova18:27
*** rwmjones has joined #openstack-nova18:28
*** emagana has joined #openstack-nova18:28
*** lan has joined #openstack-nova18:28
dansmithI still can't get to this review of mine:18:28
dansmithhttps://review.openstack.org//#/c/173995/18:28
*** larsks|alt is now known as larsks18:28
jodah-neither can i18:28
*** dsanders has joined #openstack-nova18:28
*** annegentle has quit IRC18:29
*** dan| has joined #openstack-nova18:29
dansmiththe level of discussion in #infra has me pretty concerned18:29
sdagueoh, the corruption issue18:29
dansmithlike, db corruption causing things like that ^18:29
*** annegentle has joined #openstack-nova18:29
clarkbits not db corruption18:32
clarkbits jgit inable to read packfiles18:32
clarkb(C git works fine)18:32
*** atuvenie has quit IRC18:32
dansmithclarkb: that's causing my 404 too?18:32
*** jodah- has quit IRC18:32
clarkbyes18:32
dansmithokay cool18:32
dansmiththe "schema migration XX does YY" looked concerning :)18:33
*** VW__ has quit IRC18:33
clarkbwell looking at what a downgrade will involve18:33
dansmithah18:33
*** jodah has joined #openstack-nova18:33
clarkbalso if you just need refs you can fetch from git.o.o18:33
dansmithclarkb: has jgit reached "bane of our existence" phase yet?18:33
clarkbI think for today at least :)18:33
dansmith:)18:34
*** ildikov has quit IRC18:34
sdaguedansmith: so... https://review.openstack.org/#/c/181420 is now 100% fail on bringing up the second cinder guest ... without an obvious reason for that failure18:34
*** VW_ has joined #openstack-nova18:35
*** Sukhdev has quit IRC18:35
sdaguewhat else do we need in the dumps to help sort that out18:35
dansmithnice, let me catch up18:35
dansmithso this is 10 normal nova guestsm,18:35
dansmithfollowed by 10 BFV guests?18:35
sdaguewell, 10 and 418:36
dansmithand #2 BFV fails?18:36
dansmithokay18:36
sdaguebecause I didn't want to consume the entire volume space18:36
dansmithyeah18:36
sdaguebut yes, #2 bvf fails pretty consistently from what I see in those runs18:36
*** ZZelle has joined #openstack-nova18:36
dansmithcool, this is definitely cloud-scale18:36
dansmith12 guests.. should be plenty18:36
sdaguewell, also, we don't verify the first 1018:36
sdagueso this is the second host we've tried to ping18:37
sdagueand ssh into18:37
dansmithoh18:37
sdaguewe *would* verify these later18:37
*** zhenguo has quit IRC18:37
sdaguebut never get that far because of early fail for the 2nd bfv to be sshable18:37
dansmithokay, wait,18:38
dansmithso we boot 10 nova guests and  don't check them,18:38
sdagueyep18:38
dansmithbut boot two cinder guests and check those and the second one fails?18:38
sdagueyes18:38
dansmithor rather, check each cinder one when we create18:38
dansmithwas that important to get to reliable fail? not checking the nova ones18:39
sdagueI don't know18:39
dansmithokay18:39
sdaguethe reason the cinder ones are checked as they are created is we ssh in and put content in the volume18:39
sdagueto ensure that content is persistent18:39
dansmithand nothing is shut down right now either, so this is just upgrade-unrelated right?18:39
sdagueso you have to do a ping loop, then an ssh loop18:39
sdaguecorrect18:39
dansmitheff.18:39
sdaguewe're still in the create resources stage18:40
dansmithright18:40
dansmithso, I kinda wonder about not doing the cinder ones to see if we don't hit the upgrade issue without them18:40
*** annegentle has quit IRC18:40
*** yamahata has quit IRC18:40
dansmithas in, maybe the BFV process is causing us to be more racy with secgroups in some way that we're always borking  networking somewhere in the BFV phase and noticing later?18:40
sdagueso, I can put up a patch that does that if you like18:41
*** annegentle has joined #openstack-nova18:41
dansmithis that a crazy thought?18:41
sdaguehttp://logs.openstack.org/20/181420/4/check/check-grenade-dsvm/57f64bd/logs/worlddump-2015-05-11-140416.txt.gz is the fail18:41
*** eglynn has quit IRC18:41
dansmithwe do a lot more waiting for things in the BFV case I think18:41
sdagueincludes the iptables dump18:41
sdaguedansmith: define "we"?18:41
*** otter768 has joined #openstack-nova18:41
dansmithnova18:41
dansmithnova-compute18:42
sdagueI had to put a lot of client side waiting in there to be able to progress18:42
dansmithno,18:42
*** jecarey_ has joined #openstack-nova18:42
dansmithI meant in the BFV case, nova does different things, which might cause us to be more likely to race with some networking-related thing or something18:42
openstackgerritsean mooney proposed openstack/nova: fix AggregateTypeAffinityFilter multi values support  https://review.openstack.org/14188318:43
dansmithI would think worlddump should have: "brctl show" and "ip link" and "ip addr" and a route listing18:43
dansmithalso "arp -n"18:43
sdagueok, I can add those18:43
*** ajayaa has quit IRC18:45
*** otter768 has quit IRC18:46
openstackgerritEric Brown proposed openstack/nova: VMware: update supported vsphere 6.0 os types  https://review.openstack.org/18102018:47
*** dan| has quit IRC18:49
*** arnaud____ has joined #openstack-nova18:49
openstackgerritEric Brown proposed openstack/nova: Deprecate nova ironic driver's admin_auth_token  https://review.openstack.org/17996018:49
openstackgerritMatt Riedemann proposed openstack/nova: Fix pip-missing-reqs  https://review.openstack.org/18194418:50
mriedemdansmith: welcome back cotter https://review.openstack.org//#/c/173995/18:51
mriedems/cotter/kotter/18:51
dansmithheh18:51
dansmithnice18:51
*** baoli has quit IRC18:51
openstackgerritEric Brown proposed openstack/nova: VMware: Don't raise exception on resize of 0 disk  https://review.openstack.org/17317018:51
*** harlowja has quit IRC18:52
*** harlowja has joined #openstack-nova18:52
vilobhmm1jaypipes : ping18:52
jaypipesvilobhmm1: pong18:53
vilobhmm1wanted to get more insights into the way the rpc layer and service things are tied together18:53
vilobhmm1https://github.com/openstack/nova/blob/master/nova/rpc.py#L136 -> oslo.meesaging18:54
vilobhmm1layer18:54
vilobhmm1to get the target details18:54
*** arnaud____ has quit IRC18:54
vilobhmm1but where is the target places I mean does the server refer to one of the services currently stored in the nova.services ?18:54
*** dan_ has joined #openstack-nova18:54
vilobhmm1https://github.com/vilobhmm/oslo.messaging/blob/master/oslo_messaging/rpc/server.py#L124  -> https://github.com/vilobhmm/oslo.messaging/blob/master/oslo_messaging/rpc/dispatcher.py#L79 -> https://github.com/openstack/oslo.messaging/blob/master/oslo_messaging/target.py#L7418:55
*** dan_ is now known as Guest2558018:55
vilobhmm1just to be more specific of what I am talking about18:55
vilobhmm1about the oslo.messaging layer18:55
vilobhmm1https://github.com/openstack/nova/blob/master/nova/rpc.py#L136  -> to get the rpc server details18:56
dansmithvilobhmm1: see nova/compute/rpcapi for example18:57
openstackgerritMatt Riedemann proposed openstack/nova: Fix cinder v1 warning with cinder_catalog_info option reference  https://review.openstack.org/18201518:57
dansmithvilobhmm1: the topic "compute" in there is what points it at a compute node18:57
dansmithvilobhmm1: same for network/rpcapi, scheduler, conductor, etc18:57
mriedemvilobhmm1: also https://www.youtube.com/watch?v=wVXiw09XP0418:57
dansmithoh yeah18:57
dansmithffs :)18:58
mriedemeducational recordings ftw!18:58
dansmithtoo bad we don't do those anymore18:58
mriedemi still have to watch more than the first 10 minutes of that18:58
*** ijw has quit IRC18:58
mriedemdansmith: i think sdague just needs topics and volunteers18:58
dansmithis 10m where I start talking?18:58
dansmithmriedem: I think sdague needs fewer children18:59
mriedemouch18:59
*** ijw has joined #openstack-nova18:59
dansmithwell, everyone does, IMHO18:59
mriedemi think the scheduler would be a decent topic18:59
mriedemand a rundown of the bazillion filters18:59
mriedemmentioned that to bauzas but TZ is difficult since it's late friday night his time19:00
dansmithyeah, I could use a nap19:00
sdaguemriedem: yeh, honestly, I kind of put it down for a while due to running out of time.19:00
vilobhmm1mriedem : cool thanks…but still dansmith, mridem : https://github.com/openstack/nova/blob/master/nova/service.py#L190 sets the rpcserver but again coming back to my orignal question19:00
vilobhmm1the target to which the rpcserver connects to/talks to is it related to services entry in nova.services ?19:01
dansmithvilobhmm1: are you talking about the "target" being the rabbit server?19:01
dansmithotherwise rpc servers don't connect to anything19:01
*** _gryf|afk is now known as _gryf19:01
*** rushiagr is now known as rushiagr_away19:02
vilobhmm1target : here i suppose i the end service like nova-compute or something of that sort19:02
dansmithnova compute *is* an rpc server19:02
vilobhmm1TRANSPORT : https://github.com/openstack/nova/blob/master/nova/rpc.py#L4919:02
dansmithvilobhmm1: seriously, you should watch that video19:02
vilobhmm1https://github.com/openstack/nova/blob/master/nova/rpc.py#L13619:03
vilobhmm1ok19:03
dansmithwe recorded it so we didn't have to explain it every time someone asks in here19:03
*** ijw has quit IRC19:03
*** yamahata has joined #openstack-nova19:03
openstackgerritEric Brown proposed openstack/nova: Use oslo_config choices support  https://review.openstack.org/15857319:04
*** VW__ has joined #openstack-nova19:05
*** emagana has quit IRC19:05
*** emagana has joined #openstack-nova19:05
*** dsanders has quit IRC19:05
*** VW_ has quit IRC19:07
openstackgerritDan Smith proposed openstack/nova: Move our ObjectListBase to subclass from the Oslo one  https://review.openstack.org/17399519:08
*** VW_ has joined #openstack-nova19:08
*** VW__ has quit IRC19:09
*** VW_ has quit IRC19:10
jaypipesvilobhmm1: sorry, stepped away. so, I think you are asking whether the services table in the Nova database is involved in the setup of the RPC endpoints (either consumer or producer). Is that correct?19:10
*** VW_ has joined #openstack-nova19:10
*** Marga_ has quit IRC19:11
*** eharney has quit IRC19:12
*** eglynn has joined #openstack-nova19:13
openstackgerritjichenjc proposed openstack/nova: Only set access_ip_* when instance goes ACTIVE  https://review.openstack.org/12933319:14
*** dave-mccowan has quit IRC19:17
vilobhmm1jaypipes : thats exactly i want to know19:17
*** dsanders has joined #openstack-nova19:17
jaypipesvilobhmm1: ok, I thought so :)19:17
dansmithjaypipes: are you answering or just clarifying?19:19
jaypipesdansmith: I am in process of answering :)19:20
dansmithokay19:20
*** Jeffrey4l has quit IRC19:21
bauzasthat's actually a good topic for discussing at the Summit ;)19:21
dansmithis it? I think the answer is "no" :)19:21
*** iamjarvo has joined #openstack-nova19:22
bauzasdansmith: eh, we're updating a DB table each time a new service is run, but the operator can actually use an other driver but the DB one for SG :)19:22
vilobhmm1bauzas : +119:22
dansmithright, but it doesn't have anything to do with the rpc bit19:22
bauzasdansmith: that's my point, this is confusing19:23
openstackgerritMichael Still proposed openstack/nova: Move more qemu calls into virt.images I'd like to move calls to qemu into a central place because it will make it easier to work around the vagaries of qemu in a consistent manner.  https://review.openstack.org/18203019:23
bauzasdansmith: I'm okay if we say that the table is just for knowing the RPC servers19:23
dansmithit's not though19:23
bauzasdansmith: I'm not okay if this is for knowing if a service is up19:23
dansmithit really has nothing at all to do with it19:23
jaypipesvilobhmm1: so, the services database table really isn't involved in much of that. The different RPC services (nova-compute, nova-conductor, etc) when they start up, they pass in two variables to their Service.create() constructor: topic and binary. The topic comes from a configuration variable, like here: https://github.com/openstack/nova/blob/master/nova/cmd/compute.py#L71. The binary is a hard-coded string like 'nova-compute'. In the Service.cr19:24
jaypipeseate() method, the host is picked up by default from CONF.host configuration variable, which by default comes from a gethostname() system call from the netconf module: https://github.com/openstack/nova/blob/master/nova/service.py#L24219:24
bauzasdansmith: actually, I'm even unclear myself19:24
bauzasdansmith: I mean, we need to draw a line for the services table saying why it's needed19:24
jaypipesvilobhmm1: only when the Service.start() method is called does a services database table record get created if there is none matching the host and binary: https://github.com/openstack/nova/blob/master/nova/service.py#L16519:25
jaypipesvilobhmm1: after this point, the database services table records have ZERO to do with RPC communication between a consumer and a producer.19:25
openstackgerritChris St. Pierre proposed openstack/nova: Allow blacklisting os-api extensions  https://review.openstack.org/16098619:25
dansmithyep, that ^19:25
bauzasagreed19:25
jaypipesvilobhmm1: the services database table is ONLY used for the crappy-ass-trying-to-be-zookeeper DB servicegroup API driver.19:25
jaypipesvilobhmm1: which of course you already are aware of because you submitted https://review.openstack.org/#/c/138607/19:26
jaypipesvilobhmm1: and yes, I know I owe you a review on that :)19:26
jaypipesbauzas, dansmith: anything to add or correct to what I wrote above?19:27
bauzasjaypipes: MHO is that the services table should just be for referencing the services19:28
jaypipessay what?19:28
bauzasthat's it19:28
jaypipeswhat do you mean?19:28
dansmithjaypipes: nope, I thought I was saying that already in my explanation, but not clearly I guess :)19:28
bauzasjaypipes: lemme rephrase the best I can19:28
jaypipesbauzas: that's a bit of a tautology isn't it? :)19:28
bauzasjaypipes: lol19:29
vilobhmm1jaypipes : agree..and thanks for the reply…so in case the service/process is deleted lets say nova-compute is deleted on compute node (the rpc-server is deleted) and the entry in nova.services is marked as deleted….as you mentioned the RPC server and nova.services are not related makes sense now…19:29
bauzasjaypipes: not exactly, since currently the services table is more than just a reference :)19:29
*** subscope has joined #openstack-nova19:29
vilobhmm1*nova-compute rpc-server*19:29
jaypipesvilobhmm1: yep, and if the nova-compute is restarted and the DB record has been deleted, then the Server.start() method will re-create the service database table record for that host.19:29
bauzasjaypipes: so, the best I can say is that's just mentioning that a service exists or existed19:30
bauzaslike the Schrodinger's cat, you don't know if the service is alive19:30
*** angdraug has joined #openstack-nova19:31
*** dave-mccowan has joined #openstack-nova19:31
jaypipesbauzas: if you are saying that relying on the services database table for whether the service is *actually* up or down is not really possible, then yes I agree with you. :)19:31
bauzasjaypipes: that's MHO yes19:32
jaypipesbauzas: it's MHO as well :)19:32
bauzashence the word "reference"19:32
bauzasa pointer if you prefer19:32
vilobhmm1jaypipes : seems logical…thanks19:32
jaypipesvilobhmm1: well, it's far from logical, but hey, welcome to the servicegroup API :)19:33
vilobhmm1jaypipes : haha…sure…and I agree to your point of moving the hearbeat thing or liveliness thing that the current nova.services thing is doing to something like zookeeper because of reasons mentioned in the spec  https://review.openstack.org/#/c/138607/19:35
jaypipesyup.19:35
vilobhmm1from scheduler point of view, scheduler simply relies on nova.services to make sure if the service is up or not and not whether the service is actually running right19:35
bauzasvilobhmm1: that's not exactly that :)19:36
bauzasvilobhmm1: the scheduler just makes sure that the compute is referenced to a service, dead or notr19:36
bauzasnot19:36
sdagueso, wasn't the point of this that it's an eventually consistent model on the db side, less than ideal, but sometimes good enough. The zookeeper implementation was brought in to be a stronger guaruntee, at the cost of another service yuo had to run19:36
dansmithit's often good enough, yes19:37
bauzasvilobhmm1: to know if the service is up is the job of the ComputeFilter, which is optional19:37
dansmithwhich is why I don't want to condemn it any time soon19:37
dansmithi.e. we can't _replace_ it with zk any time soon because it's really not needed19:37
sdaguethe db implementation was there first, it was only carved into a plug point when yun and ibm research people wanted to bring in zookeeper19:37
dansmithbut we do need to abstract it out so we _can_ reasonably replace it with things19:37
sdaguesure19:38
dansmithright, and it's not really done, is the problem19:38
sdaguewell, it was half assed done :)19:38
sdaguethen rotted19:38
vilobhmm1dansmith : https://blueprints.launchpad.net/nova/+spec/servicegroup-api-control-plane19:38
dansmithI dunno,19:38
dansmithmaybe half-assed done is a reasonable description19:38
vilobhmm1yep19:39
sdaguealso, it's probably worth figuring out if anyone is actually using the memcache driver, or if that can just be deprecated, because as far as I can tell it was just a half copy paste19:39
dansmithsdague: the spec calls that out pretty well I think19:40
dansmithdunno if you've read that or not19:40
vilobhmm1sdague :  https://review.openstack.org/#/c/138607/19:40
jaypipesvilobhmm1: actually, the scheduler looks at the disabled state as well as the up state: https://github.com/openstack/nova/blob/master/nova/scheduler/driver.py#L54-L5719:40
vilobhmm1has clearly depicted the problem19:41
dansmithmy point about half-assed-ness was that it seems more like quarter-ass complete :)19:41
sdagueheh19:41
vilobhmm1sdague : http://lists.openstack.org/pipermail/openstack-dev/2015-May/063602.html19:41
bauzasjaypipes: oh oh, missed that *facepalm*19:42
*** Marga_ has joined #openstack-nova19:42
bauzasjaypipes: should we then just say bye bye to the hellish ComputeFilter ?19:42
jaypipesvilobhmm1: and the "disabled thing" is hidden in the DB API :( https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L47819:42
jaypipesbauzas: what is hellish about the compute filter?19:43
bauzasjaypipes: lemme give you a thread19:43
jaypipesbauzas: never mind, I remember.19:43
jaypipesbauzas: it's not hellish. it's retarded.19:43
vilobhmm1jaypipes : and we have numerous interfaces to change the state of the service :P19:43
bauzasjaypipes: correct, it's confusing19:43
jaypipesvilobhmm1: well, yeah. :)19:43
*** tralon__ has joined #openstack-nova19:44
sdagueso... I'm not sure why ComputeFilter is so terrible in it's current state19:45
openstackgerritTomoki Sekiyama proposed openstack/nova: libvirt: Make behavior of os_require_quiesce consistent  https://review.openstack.org/16781919:45
bauzassdague: because it promises something it can stand19:46
bauzascan't even19:46
sdaguebauzas: that's why we have built in retry logic19:46
jaypipessdague: because it's never executed :)19:46
*** Marga_ has quit IRC19:46
sdaguejaypipes: it's never executed?19:46
bauzassdague: the retry design is not a reason for preventing good things to happen :)19:47
*** tralon_ has quit IRC19:47
sdaguebauzas: no, that's fair, but I also know of other systems that started from the perfect scheduling design point19:47
sdagueand the result is a system that had a pretty small max number of hosts19:47
sdagueand it took 20 minutes to schedule 1 vm19:48
dansmithsdague: and a boot request made in 2007 is still pending19:48
openstackgerritKen'ichi Ohmichi proposed openstack/nova: Add and use raise_http_not_implemented_error()  https://review.openstack.org/16369719:48
sdagueright, exactly19:48
bauzas\o/19:48
jaypipessdague: this line is the only return possible from the filter: https://github.com/openstack/nova/blob/master/nova/scheduler/filters/compute_filter.py#L5019:48
sdagueso... while I get that their is slop here, the slop was slightly intentional to prevent this from being a key scaling bottleneck19:49
sdaguejaypipes: because the data model is broken?19:49
dansmithjaypipes: how is that?19:49
jaypipessdague: because only non-disabled, non-down hosts are ever passed to the HostStateManager.19:49
sdaguejaypipes: ok, so just that the contract was satisfied further up?19:49
*** oomichi has joined #openstack-nova19:49
jaypipessdague, dansmith: because of this: https://github.com/openstack/nova/blob/master/nova/scheduler/driver.py#L51-L5719:49
*** matrohon has joined #openstack-nova19:50
dansmithyeah, that changed though, yes?19:50
jaypipeswhich runs prior to the HostStateManager getting its cache of HostState objects, each of which gets its Service object from there.19:50
openstackgerritMatt Riedemann proposed openstack/nova: xenapi: remove bittorrent entry point lookup code  https://review.openstack.org/18204819:50
jaypipesdansmith: nope.19:50
dansmithjaypipes: in 2012 with the servicegroup stuff19:50
dansmithhttps://github.com/openstack/nova/commit/64e167eb62bd3483b2947ec8de218453c116bd9319:50
*** oomichi has quit IRC19:50
jaypipesdansmith: no, not really. it still does the select all non-disabled hosts from the database call.19:51
dansmithit did at that time?19:52
jaypipesdansmith: it does it via the objects API now, instead of a direct DB call, but the strategy of doing that hasn't changed.19:52
dansmithso it's code that never ever made sense?19:52
jaypipesyup.19:52
sdagueok, so then lets clean it up, that's cool19:52
* harlowja lurks19:52
jaypipessdague: there's 3 blueprints proposed already for that :)19:52
sdaguejaypipes: ok19:52
*** jichen has quit IRC19:53
sdagueso this was just a vent session because everyone needed one? :)19:53
jaypipessdague: sorry man, I'm not yelling at ya... :) just pointing out that a number of BPs have been created already...19:53
jaypipessdague: well, no, it started as vilobhmm1 wanting answers to some questions about the services database table and its relation to the RPC communication (minimal)19:54
sdaguesure, that's fine, what can I do to help move this ball forward? Seems like deprecating ComputeFilter should be a simple patch, given that it's functionality is duplicated at the moment19:54
vilobhmm1jaypipes :exactly now uses object layer but does same db call19:55
jaypipesyup.19:55
jaypipessdague: a review on this spec first please: https://review.openstack.org/#/c/138607/19:55
bauzassdague: http://lists.openstack.org/pipermail/openstack-dev/2015-March/058438.html19:56
openstackgerritClaudiu Belu proposed openstack/nova: Hyper-V: Fixes cold migration / resize issue  https://review.openstack.org/18191619:56
bauzassdague: but the scope changed since jaypipes discovered it was doubled19:56
jaypipessdague: these are the other two blueprints involved: https://blueprints.launchpad.net/nova/+spec/make-availability-zone-real-data-model and https://blueprints.launchpad.net/nova/+spec/servicegroup-api-control-plane19:56
jaypipessdague: we're working on spec submissions for both now.19:56
jaypipessdague: I'll ping you them later.19:57
bauzassdague: so I can just respawn https://review.openstack.org/#/c/162180/19:57
*** lennyb has left #openstack-nova20:00
openstackgerritMichael Still proposed openstack/nova: Move more qemu calls into virt.images  https://review.openstack.org/18203020:03
*** dims has joined #openstack-nova20:03
vilobhmm1out for lunch..please ping me if needed20:05
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: Eventlet supports python logging directly  https://review.openstack.org/17980120:05
sdaguebauzas: so doesn't that patch say that ComputeFilter is not useless, because it's still filtering out disabled hosts?20:05
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: Use oslo-config-generator instead of generate_sample.sh  https://review.openstack.org/18001320:06
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: Add rootwrap daemon mode support  https://review.openstack.org/18069520:06
bauzassdague: that's what I said above, jaypipes just found tonight that the state check was also done elsewhere20:06
bauzassdague: my point was initially to move the logic back to the scheduler (not in a filter)20:06
_gryfdansmith, hey20:07
*** mwagner_lap has quit IRC20:07
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: Drop explicit suds dependency  https://review.openstack.org/18155420:08
dansmith_gryf: good morning, and welcome!20:08
_gryfdansmith, i would say good evening :)20:09
_gryfanyway20:09
*** pixelbeat has joined #openstack-nova20:09
*** sdake_ has joined #openstack-nova20:10
jaypipesbauzas: I didn't find this out tonight :) I've known about it for a while.20:10
_gryfdansmith, you wrote in a comment, that we will need a notify in case of forced_down service.20:10
bauzasjaypipes: while I totally missed it20:10
dansmithjaypipes: well, the rest of us did20:10
jaypipesheh :)20:10
dansmithjaypipes: I knew that line in the filter had changed, but never realized the db query was stupid20:11
*** nihilifer has quit IRC20:11
*** doude has quit IRC20:11
_gryfdansmith, why do we need this and who will be the target of such notification?20:11
dansmith_gryf: no, I said I think we shuld20:11
*** doude has joined #openstack-nova20:11
_gryfdansmith, than way should we have it? ;)20:11
dansmith_gryf: the target will be the target of all the notifications.. monitoring tools20:11
mriedem_gryf: this might help https://wiki.openstack.org/wiki/SystemUsageData20:12
*** sdake has quit IRC20:13
_gryfmriedem, thanks20:16
*** b3nt_pin has joined #openstack-nova20:16
_gryfdansmith, so i should to dig into it aswell20:17
*** _gryf is now known as _gryf|afk20:18
*** ildikov has joined #openstack-nova20:19
*** Vek has joined #openstack-nova20:21
*** b3nt_pin has quit IRC20:25
*** b3nt_pin has joined #openstack-nova20:26
*** Marga_ has joined #openstack-nova20:29
*** tsekiyam_ has joined #openstack-nova20:30
openstackgerritJay Pipes proposed openstack/nova: Fix scheduler issue when multiple-create failed  https://review.openstack.org/14704820:32
*** tsekiyam_ has quit IRC20:32
*** tsekiyam_ has joined #openstack-nova20:32
*** tsekiyama has quit IRC20:33
*** mtanino has quit IRC20:34
*** iamjarvo has quit IRC20:37
*** jichen has joined #openstack-nova20:38
*** arnaud____ has joined #openstack-nova20:38
*** MVenesio has joined #openstack-nova20:38
*** lpetrut has quit IRC20:39
jogomikal: any reason you didn't _W this? https://review.openstack.org/#/c/173995/20:39
jogo+W20:39
jogodansmith: ^^ any reason not too?20:40
*** baoli has joined #openstack-nova20:40
dansmithfigured he was waiting for jenkins20:40
mikaljogo: just cause it was too new IIRC20:40
dansmithtoo new?20:40
jogomikal: it was a trivial rebase20:40
dansmithalmost a month old :)20:40
*** IanGovett1 has joined #openstack-nova20:40
jogomikal: thanks, just checking20:40
*** tsekiyam_ has quit IRC20:41
mikaljogo: yeah, looking at it again I think you're right20:41
jogodansmith: as a role of thumb if the patch isn't old enough to crawl I don't think we should merge it :)20:41
mikalI see you fixed it though20:41
*** tsekiyama has joined #openstack-nova20:41
jogomikal: yup20:41
dansmithjogo: heh20:41
mikalYou need to remember I am very jet lagged, and not very competent to start with20:42
dansmithjogo: I have no ideas when babies start crawling, so I'd need some instruction20:42
dansmithmikal: yeah, double whammy, eh?20:42
*** IanGovett has quit IRC20:42
*** ildikov has quit IRC20:42
jogodansmith: google tells me 7-10 months20:42
*** otter768 has joined #openstack-nova20:42
dansmithhuh20:42
dansmithI was thinking five years old20:43
*** arnaud____ has quit IRC20:43
jogomikal: what country are you in?20:43
dansmithbut pretty sure they start talking at 2 months20:43
jogohaha20:43
*** iamjarvo has joined #openstack-nova20:43
*** baoli has quit IRC20:44
*** openstackgerrit_ has joined #openstack-nova20:44
*** tonytan4ever has quit IRC20:44
*** jichen has quit IRC20:44
*** baoli has joined #openstack-nova20:44
mriedemdansmith: so you're mega in love with rebuild/evacuate right?20:46
dansmithtotes20:46
mriedemso in the compute api before the cast to rebuild, we set the task_state to REBUILDING: http://git.openstack.org/cgit/openstack/nova/tree/nova/compute/api.py#n237020:46
mriedemoh nvm, just answered the question i was going to ask20:46
*** tsekiyama has quit IRC20:47
*** otter768 has quit IRC20:47
mriedemcompute manager has the @reverts_task_state decorator20:47
mriedemwas looking at this: http://git.openstack.org/cgit/openstack/nova/tree/nova/compute/manager.py#n296820:47
mriedemhmm, that's evacuate anyway, not rebuild20:48
*** achanda has joined #openstack-nova20:48
*** tonytan4ever has joined #openstack-nova20:49
*** Sukhdev has joined #openstack-nova20:52
*** thangp has quit IRC20:52
*** claudiub has joined #openstack-nova20:53
*** cbader has joined #openstack-nova20:55
*** claudiub|2 has quit IRC20:55
*** VW_ has quit IRC20:56
*** vilobhmm1 has quit IRC20:57
*** vilobhmm1 has joined #openstack-nova20:58
*** ildikov has joined #openstack-nova20:58
*** Marga_ has quit IRC20:58
*** Marga_ has joined #openstack-nova20:59
*** oro has quit IRC20:59
*** htruta has quit IRC21:00
*** oro_ has quit IRC21:00
*** setuid has quit IRC21:00
*** ociuhandu has quit IRC21:00
*** htruta has joined #openstack-nova21:01
*** haomai___ has joined #openstack-nova21:02
openstackgerritAndrew Laski proposed openstack/nova-specs: Add BuildRequest object  https://review.openstack.org/16990121:02
*** mwagner_lap has joined #openstack-nova21:02
*** VW_ has joined #openstack-nova21:03
*** eharney has joined #openstack-nova21:03
*** setuid has joined #openstack-nova21:03
*** sdake has joined #openstack-nova21:04
*** haomaiwa_ has quit IRC21:05
dansmithjogo: that force-delete patch,21:06
dansmithjogo: previously it allowed multiple deletes as long as you said "I really mean it for sure" in the request21:06
dansmithjogo: I was -1 on that because it just means everyone always force-deletes in a tight loop until their thing goes away, which is what task-state is supposed to prevent21:07
jogoright21:07
jogodansmith: AFAIK this goes back to a patch by alaski (?) to no-op extra deletes if already in a delete state21:07
jogothe question is do we still want that logic or not21:08
alaskiI vaguely recall reviewing something like that21:08
alaskiI didn't write something like that21:08
*** sdake_ has quit IRC21:08
jogoI think it was rax but may of been someone else21:08
dansmithI would like us to fubar our states less so that we don't need the client to keep deleting things that are in deleted state21:08
dansmither, deleting21:08
bauzasmmm, is there any recent merged change that then provides a conflict for most of the changes ?21:09
bauzasor is it Gerrit 2.10 having a problem ?21:09
jogobauzas: AFAIK it may be gerrit21:09
*** iamjarvo has quit IRC21:09
*** Marga_ has quit IRC21:10
*** wwriverrat has joined #openstack-nova21:10
bauzasjogo: ok good to know because my dash is just red for most of the reviews I have to do21:10
*** moshele has quit IRC21:10
jogoalaski: wow I was wayyy off I2f97f93bd714e0ea3b6d4fa3ac457ab43eed00e121:10
*** Marga_ has joined #openstack-nova21:10
mriedemjogo: it was HP21:10
*** mtanino has joined #openstack-nova21:10
mriedemjogo: i konw it well and can find it21:10
*** annegent_ has joined #openstack-nova21:10
* jogo hides21:10
mriedemyou better21:10
*** tonytan4ever has quit IRC21:11
mriedemthe commit even said, 'in a later patch we'll fix this other thing that this patch breaks'21:11
jogomriedem: https://review.openstack.org/#/c/55444/21:11
mriedemthat's the one21:11
mriedem"Dealing with delete requests that never got executed is not in scope of this change and will be submitted separately."21:11
mriedemthat never happened and left a bug in the code21:11
mriedemjogo: which you fixed later with a @reverts_task_state decorator21:11
jogoDealing with delete requests that never got executed is not in scope of21:12
mriedemyou couldn't delete an instance in error state21:12
jogothis change and will be submitted separately.21:12
jogoI remember that one21:12
jogothat was silly21:12
mriedemthe reverts_task_state thing was regressed with a later change, which we fixed in kilo21:12
mriedemfixed in kilo and backported to icehouse21:12
openstackgerritAnkit Agrawal proposed openstack/nova: Detach volume after deleting instance with no host  https://review.openstack.org/14573821:12
mriedemi still have nightmares about this as you can tell21:12
*** apuimedo has joined #openstack-nova21:13
*** eglynn has quit IRC21:13
mriedembtw, some kids never crawl, they just go straight to walking21:14
mriedemi call them freaks!21:14
jogomriedem: based on the info in https://bugs.launchpad.net/nova/+bug/1248563 can we revert the first patch?21:14
openstackLaunchpad bug 1248563 in OpenStack Compute (nova) "Instance deletion is prevented when another component locks up" [High,Fix released] - Assigned to Stanislaw Pitucha (stanislaw-pitucha)21:14
jogoand allow multiple deletes?21:15
*** annegentle has quit IRC21:15
*** baoli has quit IRC21:15
mriedemjogo: i think we're way beyond reverting https://review.openstack.org/#/c/55444/ at this point no?21:15
jogomriedem: based on https://review.openstack.org/70187 landing21:15
*** baoli has joined #openstack-nova21:15
mriedemi vaguely remember something related to https://review.openstack.org/#/c/70187/ breaking hyper-v CI21:16
jogomriedem: well do_terminate_instance uses the instance.uuid lock now21:17
mriedembasically, that was all a big mess for a long time21:17
jogoso good guess21:17
*** Marga_ has quit IRC21:17
mriedemi don't really want to revert those old changes b/c of how messy they were to begin with21:18
mriedemdo we have a new critical bug around this?21:18
*** Marga_ has joined #openstack-nova21:18
mriedemthere was another attempt at force-delete here which broke the cells api so we reverted that21:18
jogoreading http://lists.openstack.org/pipermail/openstack-dev/2013-October/017454.html this was ugly the old way too21:18
mriedemjogo: we're here now https://review.openstack.org/#/c/163798/21:19
jogomriedem: just wondering since every few months there seems to be a patch related to multiple deletes21:19
jogomriedem: right which I just nacked21:19
*** tonytan4ever has joined #openstack-nova21:19
mriedemoh21:19
openstackgerritTaylor Peoples proposed openstack/nova: libvirt: safe_decode xml for i18n logging  https://review.openstack.org/18170821:19
mriedemhard for me to see in the 'new' gerrit that i'm new to21:19
mriedemthere is just so much gd informatoin in this style21:20
jogoyeah it takes some time to adjust to21:20
jogomriedem: I think what this is really showing is we don't test nova enough around failure conditions in general21:21
bauzasmriedem: what's funny for people already using the new Gerrit UI is that the merge conflicts are at the same location than previously the series21:22
bauzasso I'm always wondering why patch #1 refers to patch #2 - but that just means both are conflicting :/21:22
* jogo slowly walks away from the mess21:23
mriedemjogo: well, we test error conditions and we have negative api testing,21:23
mriedemjogo: but yeah, we don't really test 'recovery' scenarios21:23
jogoright21:24
jogoand things like assume virt drivers  other services begin failing21:24
jogochaos monkey stuff21:24
*** tpeoples has joined #openstack-nova21:24
mriedemlike libvirt?21:25
mriedeme.g. https://review.openstack.org/#/c/181781/21:26
openstackgerritMatt Riedemann proposed openstack/nova: libvirt: handle code=38 + sigkill (ebusy) in destroy()  https://review.openstack.org/18178121:26
jogohaha21:27
*** matrohon has quit IRC21:30
mriedemyou know what i hate? api_samples tests21:31
openstackgerritFelipe Reyes proposed openstack/nova: Detach iSCSI latest path for latest disk  https://review.openstack.org/13538221:31
cfriesendoes openstack support using qemu's builtin iscsi support rather than creating a block device on the host?  if not, is anyone looking at adding it?21:33
*** emagana has quit IRC21:34
*** emagana has joined #openstack-nova21:35
*** dsanders has quit IRC21:35
*** dsanders has joined #openstack-nova21:35
openstackgerritJay Pipes proposed openstack/nova: Remove db layer hard-code permission checks for service_get_by_compute_host  https://review.openstack.org/16008921:36
dansmithcfriesen: isn't that likely to suck more?21:38
*** VW_ has quit IRC21:40
*** MVenesio has quit IRC21:41
openstackgerritMatt Riedemann proposed openstack/nova: WIP: Show 'reserved' status in os-fixed-ips  https://review.openstack.org/16896621:42
mriedemalex_xu: i've added the start of some functional api samples tests there for v2.4 ^21:42
*** VW_ has joined #openstack-nova21:42
openstackgerritJay Pipes proposed openstack/nova: Remove db layer hard-code permission checks for service_get_by_host*  https://review.openstack.org/15034921:43
mriedemthey don't work, i keep getting "TypeError: expected string or buffer" so i'm sure my samples are messed up21:43
*** achanda has quit IRC21:43
*** baoli has quit IRC21:44
*** jdurgin1 has joined #openstack-nova21:44
tpeoplesIf anyone has time to review https://review.openstack.org/#/c/181708/ (small 1 line libvirt change) that'd be great21:45
openstackgerritJay Pipes proposed openstack/nova: API: remove instance_get_all_by_host(_and_node) hard-code admin check from db  https://review.openstack.org/17767321:45
*** jdurgin has quit IRC21:46
*** jdurgin1 has quit IRC21:46
*** jdurgin has joined #openstack-nova21:46
*** VW_ has quit IRC21:47
mriedemalex_xu: nevermind,  think i just figured it out21:47
openstackgerritMatt Riedemann proposed openstack/nova: Show 'reserved' status in os-fixed-ips  https://review.openstack.org/16896621:47
tpeoplesthanks mriedem21:47
harlowjavilobhmm1 jaypipes i put some potential work items @ https://blueprints.launchpad.net/nova/+spec/servicegroup-api-control-plane (if u want to modify)21:48
harlowjafeel free to change it :-P21:48
jaypipestpeoples: approved. thank you!21:48
jaypipesharlowja: thx mate21:49
harlowjasure21:49
cfriesendansmith: I came across this: https://lists.gnu.org/archive/html/qemu-devel/2011-04/msg01977.html   the data is a few years old, but it shows qemu+libiscsi being way faster than cache=none unless you also set aio=native21:50
*** sdake has quit IRC21:50
cfriesendansmith: and that was for reading, not even writing21:50
dansmithcfriesen: I don't mean suck more == slower21:51
dansmithcfriesen: I just mean general correctness21:51
*** baoli has joined #openstack-nova21:52
dansmithbut given how much the linux iscsi initiator stuff is used, it seems odd to me that it would be slower than the qemu one, unless it's doing safer operations, you know21:52
cfriesendansmith: should be better.  I just noticed an issue with udev automounting cinder volumes on the compute host.  (which I think could potentially mean replaying the journal on both host and guest)21:52
*** VW_ has joined #openstack-nova21:52
*** annegent_ has quit IRC21:52
*** sdake has joined #openstack-nova21:52
*** annegentle has joined #openstack-nova21:53
mriedemdims: re: your earlier comment about hotels, that was because you were with ibm at the time and had the marriott discount thingy21:55
mriedemdims: that's not going to happen :)21:55
*** mriedem is now known as mriedem_away21:56
*** nickchase has joined #openstack-nova21:56
bauzasah, good point, so I guess the dates for the midcycle are set now ?21:57
*** artom_ has quit IRC21:57
dansmithcfriesen: did you read the full thread?21:58
tpeoplesjaypipes: is there anything else i need to do for that? will the nova team decide to backport or not and then cherry pick it?21:58
tpeoples(if they decide to backport)21:58
dansmithcfriesen: either way, I assume you could implement this alongside what we have21:58
dansmithI'd have to look, but it could be interesting to provide this as an option if there really are benefits21:58
cfriesendansmith: yeah, I didn't see Christoph ever addressing the fact that the testcase was read-only while the cache would only affect writing21:59
cfriesendansmith: I think it'd be interesting to redo the test, at any rate.  And yeah, I don't see any reason why it couldn't coexist.21:59
dansmithI don't really understand why this is likely to be any better than the default implementation,22:00
dansmithso any crazy speedup leads me to expect that there is some mismatch between configs that isn't apparent (i.e. caching issues)22:00
cfriesendansmith: the main difference seemed to be the aio options...when using aio=threads it's slower22:00
*** emagana has quit IRC22:00
*** annegentle has quit IRC22:00
dansmithcfriesen: I mean I don't see why it'd ever be faster22:01
dansmithcfriesen: if you do all the iscsi logic in the qemu process you get charged for it, and if you do it in the host kernel you don't22:02
*** Marga_ has quit IRC22:04
*** Marga_ has joined #openstack-nova22:04
*** burt has quit IRC22:04
cfriesendansmith: from http://www-01.ibm.com/support/knowledgecenter/linuxonibm/liaat/liaatbpkvmasynchio.htm:  "BM® lab tests show that using AIO support can improve guest I/O performance, especially when there are multiple threads performing I/O operations at the same time. You can enable AIO by specifying aio=native in the qemu-kvm command for a KVM guest."22:04
*** baoli has quit IRC22:05
*** emagana has joined #openstack-nova22:05
cfriesendansmith: I'm no expert, just been looking around for info22:05
dansmiththat means aio even for host-based devices, yes/22:05
dansmithI'm no expert either, I just can't think of any *fundamental* reason why this should be faster to do it in qemu22:07
cfriesendansmith: but there are other issues reported for aio=native with cache=none and sparse files, so I wasn't sure if it was okay to suggest switching to aio=native generally22:07
*** aysyd has quit IRC22:08
dansmiththis is probably stuff danpb has context on, I'd guess22:08
cfriesenseems likely22:08
*** ericksonsantos has joined #openstack-nova22:09
*** subscope has quit IRC22:09
*** moshele has joined #openstack-nova22:13
*** subscope has joined #openstack-nova22:18
*** claudiub has quit IRC22:20
*** jgrimm is now known as zz_jgrimm22:24
*** rwsu has quit IRC22:25
*** pixelbeat has quit IRC22:26
*** tonytan4ever has quit IRC22:26
*** arnaud____ has joined #openstack-nova22:27
openstackgerritZhenguo Niu proposed openstack/nova: Remove unused decorator on attach/detach volume  https://review.openstack.org/16583922:28
*** lucas-dinner has quit IRC22:28
*** tpeoples has quit IRC22:28
*** Nic1 has joined #openstack-nova22:29
*** Nic has quit IRC22:29
*** jecarey_ has quit IRC22:31
*** erickson has joined #openstack-nova22:31
*** arnaud____ has quit IRC22:32
*** ociuhandu has joined #openstack-nova22:32
*** ericksonsantos has quit IRC22:34
*** otter768 has joined #openstack-nova22:43
*** tpeoples has joined #openstack-nova22:44
*** achanda has joined #openstack-nova22:46
dansmithzzzeek: ping22:46
zzzeekdansmith: hi22:46
*** nelsnelson has quit IRC22:47
dansmithzzzeek: just want to make sure you're understanding one aspect of how nova is (usually) deployed, re: this database parallelism thing22:47
zzzeekdansmith: ok22:47
*** otter768 has quit IRC22:47
dansmithzzzeek: when nova-api talks to the db, it completely blocks, but we have lots of nova-api processes (real processes), so it's not *too* bad22:48
zzzeekdansmith: sure22:48
dansmithzzzeek: nova-compute does not talk to the database, but rather talks to nova-conductor,22:48
dansmithwhich also runs many (many) *processes* each of which can fall on its sword for the blocking call22:48
zzzeekdansmith: that is all fine, however, eventlet is still pointles within the database process22:48
dansmithyes22:49
zzzeekdansmith: the discussions are always about, threads are slow! the GIL !  terrible!22:49
zzzeekdansmith: which is idiotic to be honest.  we have zero concurrency within a process22:49
dansmithyour last message made it seem like maybe you thought we were even more serial than we are22:49
dansmithyep, okay, just making usre22:49
zzzeekdansmith: well fear not, robert was talking about GIL22:49
dansmithI know22:49
zzzeekdansmith: all discussions about GIL are silly.  we are in the MySQLdb-Interpreter-Lock right now22:49
*** diegows has joined #openstack-nova22:50
zzzeekdansmith: i dont know if you recall, someone wanted to replace all concurrency with asyncio, because, *faster*22:50
dansmiththey are right now, but if we were able to get to a (real) threadpool for those blocking requests, then we're contending for the GIL within a process22:50
openstackgerritVladik Romanovsky proposed openstack/nova: libvirt: configuration for interface driver options  https://review.openstack.org/12882622:50
openstackgerritVladik Romanovsky proposed openstack/nova: libvirt: enable virtio-net multiqueue  https://review.openstack.org/12882922:50
openstackgerritVladik Romanovsky proposed openstack/nova: libvirt: update NetworkRequest object to support queues  https://review.openstack.org/18210822:50
openstackgerritVladik Romanovsky proposed openstack/nova: tests: _stub_allocate_for_instance to accept port ids list  https://review.openstack.org/18210922:50
openstackgerritVladik Romanovsky proposed openstack/nova: libvirt: update VIF metadata with queues in the neutron api  https://review.openstack.org/18211022:50
zzzeekif my “we’re slow” arguemnts are tempered by “we have lots of processes”, so are all the “we can be *fast!” arguments about asyncio, if they were even true22:50
zzzeekdansmith: the contending for the GIL within a process when most of the work is DB work is not bad at all, and I spent a lot of time doing benchmarks to show this22:51
zzzeekdansmith: and it is much much less than contending for individual database conversations as we are right now22:51
*** Sukhdev has quit IRC22:52
dansmithright, I think that's what he was trying to get at, that we're good at IO-bound work, and can be threaded and not worry about th GIL if that's the case22:52
dansmithyes22:52
zzzeekdansmith: OK, I didnt exactly read it that way but I will try to see that22:52
dansmithI don't actually know how much CPU work we're doing processing the result of the database call22:52
dansmithso I don't know if we *are* cpu bound or not22:53
zzzeekdansmith: we’re not22:53
dansmithgood :)22:53
dansmithyour last point is something I'm pretty concerned about,22:54
dansmithalthough maybe in a different way than you meant22:54
dansmithI think the number of race conditions we manage to hit just in things like nova-compute because we're almost completely single threaded,22:55
dansmithhas me concerned that moving straight to real threads for some of our stuff will expose a bunch of things that only work now because we didn't need to lock across a region22:55
dansmithwhich isn't a reason not to do it, but it is something that I worry about22:55
zzzeekdansmith: well as far as that i was alittle more handwavy, but i see the most weird bugs in things once an app goes from talking to 2 or 3 db connections at once to 30 or 4022:55
dansmithyep, but I think that even not related to the db specifically, such a move would likely cause us trouble22:56
*** BadCub is now known as BadCub-Hiding22:56
dansmithmore so in nova-compute than other things, and we could easily leave nova-compute async as long as conductor performs better22:56
zzzeekdansmith: what, just using threads?   i woudl disagree with that, as long as we aren’t using shared mutable datastructures in process22:57
zzzeekdansmith: i think all the “Web request http” stuff should remain as async as it wants to be22:57
zzzeekdansmith: when you deal with HTTP connections you have to be more ready for arbitrary behavior22:57
jaypipestpeoples: I tagged the bug with both juno and kilo backport potential... that should be enough :)22:58
dansmithzzzeek: nova-compute is *full* of mutable data structures :)22:58
zzzeekdansmith: that are shared between requests22:58
zzzeekdansmith: i haven’t seen that22:58
*** tsekiyama has joined #openstack-nova22:59
dansmithzzzeek: yeah, tons of it.. hypervisor state, resource tracker stuff, all that kinda stuff is shared common bits22:59
dansmithzzzeek: so if we move nova-compute to real threads, we have a ton of locking to add22:59
zzzeekdansmith: I’m only looking specifically at:  db/sqlalchemy/api.py .  that is the part that I’d put behind the thread pool22:59
zzzeekdansmith: basically your relational database service layer23:00
tpeoplesjaypipes: yeah, but do i need to propose the patch to the other branches, is that done automatically, etc.? (sorry i'm fairly new to openstack)23:00
dansmithzzzeek: yeah, that's what I meant by keeping it collected there and leaving nova-compute async23:00
zzzeekdansmith: Ok then we agree :)23:00
dansmithzzzeek: although conductor could be fully threaded if it helped, and that would insulate us23:00
jaypipestpeoples: ah, yes, you would need to do a cherry-pick to those branches. one sec, lemme grab an explanatory wiki page.23:00
dansmithzzzeek: but I think doing it fully at the sqalchemy/api layer is fine if it gets us everything we need23:01
dansmithzzzeek: so you know what has been preventing us from doing that in the past right? I'm foggy on the actual details23:01
jaypipestpeoples: https://wiki.openstack.org/wiki/StableBranch23:01
jaypipestpeoples: that has everything you should need :)23:01
zzzeekdansmith: well thats as far as I’ve been able to understand the situation, I’m not opposed to using threads more extensively but I try to always limit the territory im staking out in order to maximize the chance of success :)23:01
tpeoplesthanks jaypipes23:02
zzzeekdansmith: what prevents us is, everytime it is brought up, the handwringing begins about the GIL23:02
dansmithzzzeek: and less code that needs to be threadsafe, yes? that seems like a good idea :)23:02
dansmithsince we clearly suck at it23:02
dansmithzzzeek: no23:02
dansmithzzzeek: we had a way to use a threadpool for mysql stuff, but under heavy load it would stall or something23:02
dansmithzzzeek: I think it was related to eventlet unthreadsafeness23:03
zzzeekdansmith: that’s a different kind of threadpool23:03
zzzeekdansmith: that’s the one dug into eventlet itself23:03
dansmithah, okay23:03
zzzeekdansmith: which yes, im sure is buggy as all get out23:03
zzzeekdansmith: it is too fine grained23:03
dansmithokay23:03
*** emagana has quit IRC23:03
zzzeekdansmith: taht’s totally where you’d see weird deadlocks happen .     b.c. your DB calls are totally concurrent but your eventlet calls are forced to wait, i rememebr seeing this early on23:04
dansmithzzzeek: okay, makes sense23:04
zzzeekdansmith: they don’t mix well at that level23:04
dansmithzzzeek: they didn't, yeah :)23:04
dansmithzzzeek: so, "zzeek's awesome thread pool" + which driver? c or pymysql?23:04
dansmithseems like pymysql in the last email, but in previous ones, it seemed like you favored the c ones23:05
zzzeekdansmith: well we should probably use the new mysqliclient thing that is a fork of python-mysql23:05
dansmiththat's the forked C one?23:05
zzzeekdansmith: yes.23:05
dansmithokay23:05
zzzeekdansmith: but in truth it hardly matters pymysql is very good also.   mysql-python etc. will blow it away in a straight drag race style test but in real world you aren’t going to notice much23:06
dansmithTBH, I thought the only way we were going to get the parallelism was with the pure python one23:06
dansmithso if not, I'm happy and don't really care after that :)23:06
dansmithparallel requests, I mean23:07
zzzeekdansmith: i re-read my response and I know why it tweaked you, becuse im going off on “openstack is so slow!”  so yes, i know things work out OK in any case23:08
dansmithwell,23:08
dansmithit didn't tweak me, I just wanted to make sure you weren't doing testing with one conductor process and getting the wrong idea :)23:08
dansmithanyway, thanks for the 'splainin23:09
*** subscope has quit IRC23:10
zzzeekdansmith: I’m super glad it helps :)23:10
*** dboik_ has quit IRC23:12
melwittdansmith: I'm looking at the last of the db.instance_update calls to get rid of update_cells=True logic and I was wondering, what is the object equivalent to doing an update with a join with system_metadata? I was thinking like creating an Instance(**updates) and then saving it, but how to give sys meta as an expected_attr? https://github.com/openstack/nova/blob/master/nova/conductor/manager.py#L127-L12923:13
dansmithmelwitt: well, save() will save the metadata if it's set (and dirty)23:15
dansmithmelwitt: create() should do it if it's set23:15
dansmithis it not?23:15
melwittI could pull the instance with expected_attrs first, put the updates to it, and then save it, but I thought that's adding a db lookup23:15
melwittdansmith: sorry, I didn't mean literally Instance.create because it already exists. making an Instance object. I think maybe I'm understanding now, I wouldn't need to do anything special with system_metadata like the current code is, it's only doing it for _from_db_object?23:18
*** hemna_ is now known as hemnafk23:19
dansmithah, yes23:19
*** Longgeek_ has quit IRC23:20
openstackgerritJoe Cropper proposed openstack/nova-specs: Proposal for Flexible Resize Scheduling  https://review.openstack.org/17511523:21
*** VW_ has quit IRC23:22
melwittdansmith: then I see Instance.save takes care of sending a notification update, in conductor it does notifications.send_update(context, old_ref, inst_obj, service) whereas Instance.save does notifications.send_update(context, old_ref, new_ref). if conductor needs to send "service" as part of the update, does that mean I can't replace this with Instance.save?23:26
*** mdbooth has quit IRC23:26
dansmithum23:27
dansmithI don't recognize that service bit23:27
*** arif-ali has quit IRC23:28
dansmithat.all.23:29
*** arif-ali has joined #openstack-nova23:29
*** vladikr has quit IRC23:30
melwittlooking... it defaults service="compute" but it looks like conductor takes a service parameter in its instance_update so it can notify with that there. I don't know much about the notifications23:30
*** tjones1 has joined #openstack-nova23:30
dimsmriedem_away: i was told that visitors to the facility could ask for it when they check in23:30
dansmithoh23:31
dansmithmelwitt: yeah, just found that23:31
dansmithmelwitt: that's weird23:31
dansmithI must've written that23:31
melwittbecause it's weird? :P23:32
dansmithoh snap!23:32
dansmithno, I just think I did all this stuff23:32
*** mdbooth has joined #openstack-nova23:32
dansmithso it defaults to compute on the send_update call too23:32
melwitthaha, okay. the statements right after each other made it sound funny23:32
dansmithheh23:33
dansmithso,23:33
dansmithI think you can go ahead and do this23:33
dansmiththe only other place I see it used as other than compute is in scheduler_utils23:33
dansmithwhich should be okay I think23:33
dansmithI assume this is used to show in the notification what entity caused the notification23:34
dansmithbut I assume that it's almost always "compute" regardless of where it's sent,23:34
dansmithsince I only see it passed explicitly in scheduler23:34
*** dims has quit IRC23:34
*** moshele has quit IRC23:36
melwittokay, yeah it looks like each service has its own notifier object23:36
*** marun has quit IRC23:37
*** dims has joined #openstack-nova23:39
melwittdansmith: and now I find it's conductor manager that's sending it as 'compute_task' for all those cases23:40
dansmithis it?23:40
dansmithI don't see that23:41
melwittdansmith: this? https://github.com/openstack/nova/blob/master/nova/conductor/manager.py#L604-L60823:41
melwittit looks like it's the only thing calling the scheduler utils thing23:42
*** dims has quit IRC23:43
dansmithoh, in task manager yeah23:43
dansmithso, anything that uses instance.save() will send "as compute" I guess,23:44
dansmithbut that's probably already the case23:44
dansmithI don't think you're making it worse,23:44
dansmithand if that's a thing we need to do properly then we need some context somewhere to make that correct23:44
*** tjones1 has quit IRC23:45
melwittgot it, yeah23:45
*** Raildo_ has joined #openstack-nova23:49
*** IanGovett1 has quit IRC23:49
*** gmann has joined #openstack-nova23:50
*** oomichi has joined #openstack-nova23:52
-openstackstatus- NOTICE: Gerrit is going offline while we perform an emergency downgrade to version 2.8.23:54
*** ChanServ changes topic to "Gerrit is going offline while we perform an emergency downgrade to version 2.8."23:54
*** pixelbeat has joined #openstack-nova23:55
*** dboik has joined #openstack-nova23:55
*** ZZelle has quit IRC23:55
*** dboik_ has joined #openstack-nova23:56
*** sdake_ has joined #openstack-nova23:57
openstackgerritJoe Cropper proposed openstack/nova-specs: Proposal for Flexible Resize Scheduling  https://review.openstack.org/17511523:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!