Friday, 2016-09-09

mtreinishmriedem: oh I didn't know about that method. That means I can fix https://github.com/openstack-infra/subunit2sql/blob/master/subunit2sql/tests/migrations/test_model_sync.py#L86 now00:00
mtreinishthanks00:00
*** Apoorva has quit IRC00:03
*** devananda is now known as devananda|dinner00:04
mriedem""00:07
mriedemoops00:07
mriedem"In addition, PostgreSQL   provides the text type, which stores   strings of any length. Although the type text is not in the SQL standard, several other SQL database   management systems have it as well."00:07
*** tjones has left #openstack-nova00:07
*** vishwanathj is now known as vishwanathj_zzz00:08
*** vishwanathj_zzz is now known as vishwanathj_00:08
*** markvoelker has joined #openstack-nova00:13
*** zul has quit IRC00:14
*** BjoernT has quit IRC00:16
mriedemdansmith: does an alter table change for a column need to be checked in the migration? i'm wondering if a 2nd alter table statement when the type is already set causes a failure00:17
mriedemor if it's just a noop00:17
dansmithmriedem: unsure.. there is a checkfirst=True option which might check and make it a noop if nothing would happen, but ... you'd have to check00:17
openstackgerritMatt Riedemann proposed openstack/nova: Increase BDM column in build_requests table  https://review.openstack.org/36695500:22
*** rama_y has quit IRC00:23
mriedemi'm too busy with this carrot cake to test it atm00:24
openstackgerritMatt Riedemann proposed openstack/nova: DNM: test to see if column alter is idempotent  https://review.openstack.org/36770300:25
*** lixiaoy1 has joined #openstack-nova00:26
*** lixiaoy11 has joined #openstack-nova00:27
*** lixiaoy1 has quit IRC00:27
*** gyee has quit IRC00:37
*** wasmum has joined #openstack-nova00:37
*** marst has joined #openstack-nova00:39
*** mlavalle has quit IRC00:39
*** kaisers has joined #openstack-nova00:40
*** kaisers1 has quit IRC00:40
*** mlavalle has joined #openstack-nova00:40
*** rloo has quit IRC00:42
*** hoangcx has joined #openstack-nova00:42
*** gongysh has quit IRC00:45
melwittmriedem: on the glance image metadata thing, from https://review.openstack.org/#/c/303658/ it looks like one could argue that nova is the source of truth for the numa feature and that glance should conform to that. I don't know that much about it00:48
*** thorst has joined #openstack-nova00:54
mriedemmelwitt: i'm totally good with glance making the change00:55
mriedemand nikhil is +1 on it00:55
*** browne has quit IRC00:56
melwittmriedem: yeah. it's a matter of who is supposed to be the source of truth, I think. initially I was thinking, glance controls image metadata properties and nova should use what they define00:57
*** artom has quit IRC00:57
nikhilmriedem: melwitt : those etc/ metadefs are placeholders and upstream defaults. glance doesn't rely on the keys or values when metadefs are concerned. so we've those k, v sourced in from other projects, in this case nova.00:57
melwittbut now I'm more confused about it00:57
melwittnikhil: I see00:58
*** mtreinish has quit IRC01:01
*** thorst has quit IRC01:02
*** artom has joined #openstack-nova01:03
*** mtreinish has joined #openstack-nova01:05
*** tonytan4ever has joined #openstack-nova01:05
*** jamesdenton has quit IRC01:07
*** jamesdenton has joined #openstack-nova01:08
mriedemmelwitt: i think you should totally jump into the glance channel and raise all hell01:09
mriedemor just ping flaper8701:09
*** thorst has joined #openstack-nova01:09
*** gongysh has joined #openstack-nova01:11
*** mlavalle has quit IRC01:11
*** ociuhandu has quit IRC01:13
*** READ10 has joined #openstack-nova01:14
*** Apoorva has joined #openstack-nova01:14
melwittmriedem: yeah ready to raise some hell! \o/01:14
melwittI'll see if I can catch him tomorrow01:16
mriedemha01:17
mriedemexcellent01:17
*** wangqun has joined #openstack-nova01:22
*** kaisers_ has joined #openstack-nova01:22
*** jamesdenton has quit IRC01:25
*** kaisers_ has quit IRC01:27
*** READ10 has quit IRC01:32
*** yamahata has joined #openstack-nova01:38
mgagneso I'm trying to debug an issue with power state sync periodic task failing with Ironic driver. I know that this might be Ironic team's "problem" but I'm now looking for more broader input. The sync fails with BadStatusLine exception. The HTTP response from Ironic API looks to be empty, like no HTP status line, no body, nada.01:38
mgagneI'm trying to reproduce the issue in a standalone script and so far, I only managed to bring the load-balancer to its knees without reproducing the BadStatusLine exception...01:39
mgagneso anyone had this issue?01:40
mgagneI also tried to bypass the load-balancer, same problem.01:41
*** gongysh has quit IRC01:41
*** artom has quit IRC01:44
*** Apoorva has quit IRC01:45
*** artom has joined #openstack-nova01:45
mgagnenow I managed to reproduce the issue! bypassing network, installed nova code on ironic api node, ran the script and got BadStatusLine01:48
openstackgerritHa Van Tu proposed openstack/nova: [api-ref] Update configuration file  https://review.openstack.org/36771201:49
melwittmgagne: that sounds bizarre. like ironic had closed the connection before responding. do you see any errors in ironic logs?01:53
mgagneno error =)01:54
mgagnemelwitt: trying to debug atm. reproduced on ironic-api box. trying to see which instance fails to power sync to see if api received (and logged) the request01:55
melwittwhat about "returning response ..." type thing in the ironic api log?01:55
melwittokay01:55
mgagneif not, will tcpdump or strace and see what happens01:55
mgagneit fails in httplib which can't parse the response01:55
melwittI haven't heard of this before01:55
mgagneyea, really curious to find what's the problem =)01:56
*** liuyulong|away is now known as liuyulong01:57
mgagneI suspect there is something running within Ironic that might sometimes fails the request. can no longer reproduce for the moment01:57
mgagneI will sure let you know if I find something01:57
*** gongysh has joined #openstack-nova02:01
openstackgerritZhenyu Zheng proposed openstack/nova: Trival fix a typo  https://review.openstack.org/36593802:01
*** akshai has joined #openstack-nova02:04
*** yamahata has quit IRC02:07
*** EinstCrazy has joined #openstack-nova02:08
gmannmriedem: oomichi alex_xu johnthetubaguy : can you review this. last one on user_id things for tests correction- https://review.openstack.org/#/c/354690/02:11
alex_xugmann: I'm a little confuse for the comment said let's go with default policy tests02:12
alex_xugmann: the default policy means admin_or_owner?02:13
*** unicell has quit IRC02:14
*** artom has quit IRC02:16
gmannalex_xu: yea, so i understand by doing the tests with same project id not needed as normal tests does the same02:20
gmannmean tests with default one02:20
*** artom has joined #openstack-nova02:21
alex_xugmann: I guess johnthetubaguy means we shouldn't override the policy rule, just use the default rule in the test.02:22
alex_xugmann: but that sounds huge works, a lot of tests need to tune02:22
gmannalex_xu: humm, in that case we have to update each tests02:23
alex_xugmann: yes, at least remove the override line02:23
gmannalex_xu: and then we need to run  with non admin context and with admin so that we cover both for applicable APIs02:24
alex_xugmann: if i understand johnthetubaguy correct, I prefer we refactor the test in next release02:24
*** tojuvone_ has joined #openstack-nova02:24
alex_xugmann: yes, we have non_admin tests(enforce the owner), no admin tests now02:25
gmannalex_xu: yea we can do that later but this patch at least fix the overridden rule.02:25
alex_xugmann: yea, that's true, so....+2 :)02:26
gmannalex_xu: Thanks :)02:26
alex_xugmann: np02:26
gmannalex_xu: but i am on side to tests the each possible way which API policy support02:26
alex_xugmann: yea02:27
gmannalex_xu: i mean like we support user_id as of now so we should tests that which we do now02:27
alex_xugmann: got it02:27
gmannalex_xu: anyways lets discuss this more in O. more policy tests coverage may find more bits we do which we should not like user_id in start server etc02:27
*** browne has joined #openstack-nova02:28
*** tojuvone has quit IRC02:28
alex_xugmann: yea02:29
*** salv-orl_ has joined #openstack-nova02:30
*** devananda|dinner has quit IRC02:32
*** clayton has quit IRC02:32
*** clayton has joined #openstack-nova02:33
*** salv-orlando has quit IRC02:33
*** kevinz has joined #openstack-nova02:33
*** browne has quit IRC02:43
*** phuongnh has joined #openstack-nova02:43
*** mriedem has quit IRC02:46
*** tonytan4ever has quit IRC02:46
*** amotoki has quit IRC02:49
*** TravT has quit IRC02:56
*** devananda|dinner has joined #openstack-nova02:59
*** code-R has joined #openstack-nova02:59
*** code-R_ has joined #openstack-nova03:01
*** fragatina has quit IRC03:03
*** code-R has quit IRC03:04
openstackgerritQiming Teng proposed openstack/nova: Fix api-ref doc for server-rebuild  https://review.openstack.org/36773003:07
*** Jeffrey4l has joined #openstack-nova03:09
*** kaisers_ has joined #openstack-nova03:11
*** kaisers_ has quit IRC03:16
*** Apoorva has joined #openstack-nova03:21
*** david-lyle_ has joined #openstack-nova03:22
*** david-lyle_ has quit IRC03:22
*** armax has quit IRC03:24
*** rfolco has quit IRC03:25
*** thomasem has quit IRC03:25
*** ociuhandu has joined #openstack-nova03:32
*** wangqun has quit IRC03:35
*** wangqun has joined #openstack-nova03:35
*** ociuhandu has quit IRC03:36
*** dikonoor has joined #openstack-nova03:41
*** tonytan4ever has joined #openstack-nova03:44
*** sudipto has joined #openstack-nova03:47
*** sudipto_ has joined #openstack-nova03:47
*** TravT has joined #openstack-nova03:48
*** amotoki has joined #openstack-nova03:49
*** tuanla_ has joined #openstack-nova03:54
*** TravT has quit IRC03:58
*** kaisers_ has joined #openstack-nova03:59
*** annp has joined #openstack-nova04:04
*** praveen has joined #openstack-nova04:05
*** ssurana has quit IRC04:09
mgagnemelwitt: still no idea about why it's failing. Maybe it's a network config within the kernel. For now, if I limit the number of GreenPool workers to 100 (down from default 1000), it works fine. I think implement a Nova config for this would be the solution. (power_sync_greenpool_size? I don't know)04:10
mgagneEven if we find the kernel config to tweak, I don't think we can increase that value forever, especially if you end up with like 1000 hypervisors on the same nova-compute service. No server or load-balancer will gladly accept that amount of connections without some form of tuning.04:11
mgagnesync_power_state_pool_size04:15
*** amotoki has quit IRC04:16
*** su_zhang has joined #openstack-nova04:17
*** hamzy has joined #openstack-nova04:19
*** woodster_ has quit IRC04:19
*** harlowja_at_home has joined #openstack-nova04:23
*** artom has quit IRC04:26
*** fragatina has joined #openstack-nova04:26
*** zul has joined #openstack-nova04:27
*** adisky has joined #openstack-nova04:27
*** artom has joined #openstack-nova04:27
*** fragatina has quit IRC04:30
*** akshai has quit IRC04:32
*** rama_y has joined #openstack-nova04:38
*** artom has quit IRC04:38
*** artom has joined #openstack-nova04:40
*** karthiks has joined #openstack-nova04:42
*** prateek has joined #openstack-nova04:43
*** coolsvap has joined #openstack-nova04:43
*** lixiaoy11 has quit IRC04:46
*** rkrum has joined #openstack-nova04:47
openstackgerritMathieu Gagné proposed openstack/nova: Add sync_power_state_pool_size option  https://review.openstack.org/36774604:47
*** lixiaoy1 has joined #openstack-nova04:52
*** thorst has quit IRC04:55
*** su_zhang has quit IRC04:55
*** su_zhang has joined #openstack-nova04:56
*** Apoorva has quit IRC04:58
*** Jeffrey4l_ has joined #openstack-nova05:00
*** su_zhang has quit IRC05:00
*** thorst has joined #openstack-nova05:03
*** thorst has quit IRC05:03
*** thorst has joined #openstack-nova05:03
*** Jeffrey4l has quit IRC05:04
*** pbandark has joined #openstack-nova05:08
*** su_zhang has joined #openstack-nova05:12
*** zul has quit IRC05:13
*** Shashi has quit IRC05:16
*** karthiks has quit IRC05:16
*** artom has quit IRC05:17
*** artom has joined #openstack-nova05:18
*** unicell has joined #openstack-nova05:18
*** claudiub|2 has joined #openstack-nova05:19
*** jaypipes has quit IRC05:21
*** jaosorior has joined #openstack-nova05:21
*** claudiub has joined #openstack-nova05:21
*** jaypipes has joined #openstack-nova05:23
*** zul has joined #openstack-nova05:23
*** jfding has joined #openstack-nova05:23
*** rama_y has quit IRC05:24
*** claudiub|2 has quit IRC05:25
*** moshele has joined #openstack-nova05:27
*** burgerk has quit IRC05:28
*** vishwanathj_ is now known as vishwanathj_zzz05:28
*** sridharg has joined #openstack-nova05:32
*** karthiks has joined #openstack-nova05:32
*** harlowja_at_home has quit IRC05:33
*** lpetrut has joined #openstack-nova05:35
*** gcb has joined #openstack-nova05:36
*** zul has quit IRC05:38
*** su_zhang has quit IRC05:40
*** su_zhang has joined #openstack-nova05:41
*** su_zhang_ has joined #openstack-nova05:42
*** amotoki has joined #openstack-nova05:43
*** su_zhang has quit IRC05:45
*** ratailor has joined #openstack-nova05:46
*** nkrinner_afk is now known as nkrinner05:55
*** adisky has quit IRC05:58
*** adisky has joined #openstack-nova05:58
*** praveen has quit IRC05:59
*** tonytan4ever has quit IRC06:00
*** mjura has joined #openstack-nova06:01
*** claudiub has quit IRC06:01
*** paul-carlton has joined #openstack-nova06:06
*** artom has quit IRC06:09
*** yamahata has joined #openstack-nova06:09
*** mjura has quit IRC06:09
*** mjura has joined #openstack-nova06:09
*** artom has joined #openstack-nova06:14
*** praveen has joined #openstack-nova06:18
*** amotoki has quit IRC06:19
*** moshele has quit IRC06:21
*** praveen has quit IRC06:23
*** pcaruana has joined #openstack-nova06:23
*** praveen has joined #openstack-nova06:24
*** amotoki has joined #openstack-nova06:28
*** harlowja_at_home has joined #openstack-nova06:29
*** avolkov` has joined #openstack-nova06:30
*** phuongnh has quit IRC06:31
*** phuongnh has joined #openstack-nova06:32
*** praveen has quit IRC06:32
*** praveen has joined #openstack-nova06:33
*** lpetrut has quit IRC06:36
*** ttrumm has joined #openstack-nova06:37
*** hferenc has joined #openstack-nova06:38
*** ttrumm has quit IRC06:39
*** ttrumm has joined #openstack-nova06:39
*** ttrumm has quit IRC06:40
*** lpetrut has joined #openstack-nova06:42
*** sridharg has quit IRC06:43
*** ttrumm has joined #openstack-nova06:44
*** su_zhang_ has quit IRC06:45
*** su_zhang has joined #openstack-nova06:46
*** andreas_s has joined #openstack-nova06:46
*** harlowja_at_home has quit IRC06:47
*** Dinesh_Bhor has joined #openstack-nova06:47
openstackgerritChangBo Guo(gcb) proposed openstack/nova: Don't pass argument sqlite_db in method set_defaults  https://review.openstack.org/35094706:47
slaweq_mdbooth: kashyap: hello, do You know who from core team I could ask to check patches https://review.openstack.org/#/c/363926/ and https://review.openstack.org/#/c/365756/ ?06:47
*** harlowja_at_home has joined #openstack-nova06:48
*** amotoki has quit IRC06:48
*** su_zhang has quit IRC06:50
*** amotoki has joined #openstack-nova06:52
openstackgerritgaryk proposed openstack/nova: Compute: ensure that InvalidDiskFormat is handled correctly  https://review.openstack.org/36777206:56
*** harlowja_at_home has quit IRC06:57
*** sridharg has joined #openstack-nova07:00
*** sahid has joined #openstack-nova07:02
*** jlanoux has joined #openstack-nova07:02
*** amotoki has quit IRC07:02
*** praveen has quit IRC07:03
*** jamielennox|away is now known as jamielennox07:03
*** ttrumm has quit IRC07:04
openstackgerritgaryk proposed openstack/nova: Compute: ensure that InvalidDiskFormat is handled correctly  https://review.openstack.org/36777207:05
openstackgerritPrateek Arora proposed openstack/nova: Delete traces of in-progress snapshot on VM being deleted  https://review.openstack.org/29451307:05
*** gcb has quit IRC07:05
*** praveen has joined #openstack-nova07:06
*** tesseract- has joined #openstack-nova07:07
*** jlanoux_ has joined #openstack-nova07:10
*** jlanoux has quit IRC07:10
*** jsheeren has joined #openstack-nova07:11
*** rkrum has quit IRC07:11
*** ttrumm has joined #openstack-nova07:11
*** matrohon has joined #openstack-nova07:12
*** ttrumm has quit IRC07:12
*** claudiub has joined #openstack-nova07:13
*** jichen has joined #openstack-nova07:13
*** EinstCrazy has quit IRC07:14
*** amotoki has joined #openstack-nova07:14
*** praveen has quit IRC07:17
*** oanson has joined #openstack-nova07:19
*** ihrachys has joined #openstack-nova07:20
*** ttrumm has joined #openstack-nova07:20
*** ttrumm has quit IRC07:20
*** lpetrut has quit IRC07:22
*** mgoddard has joined #openstack-nova07:23
*** EinstCrazy has joined #openstack-nova07:24
*** tuanla_ has quit IRC07:27
*** annp has quit IRC07:27
*** hieulq has quit IRC07:27
*** annp has joined #openstack-nova07:27
*** tuanla_ has joined #openstack-nova07:27
*** hieulq has joined #openstack-nova07:28
*** ttrumm has joined #openstack-nova07:28
*** phuongnh has quit IRC07:28
*** phuongnh has joined #openstack-nova07:29
*** ttrumm_ has joined #openstack-nova07:30
*** ttrumm has quit IRC07:33
*** code-R_ has quit IRC07:34
*** paul-carlton has quit IRC07:38
*** praveen has joined #openstack-nova07:39
*** gouthamr has quit IRC07:40
*** jlanoux_ has quit IRC07:40
*** Oku_OS-away is now known as Oku_OS07:42
*** vishwana_ has joined #openstack-nova07:42
*** vishwana_ has quit IRC07:42
*** vishwana_ has joined #openstack-nova07:43
*** vishwanathj_zzz has quit IRC07:44
*** shangxdy has joined #openstack-nova07:45
*** tonytan4ever has joined #openstack-nova07:46
*** jfding has quit IRC07:48
*** zenoway has joined #openstack-nova07:50
*** paul-carlton has joined #openstack-nova07:51
*** tonytan4ever has quit IRC07:52
*** sridharg has quit IRC07:54
*** EinstCrazy has quit IRC07:55
*** EinstCrazy has joined #openstack-nova07:55
*** twaldrop has quit IRC07:56
*** sridharg has joined #openstack-nova07:56
*** zz_dimtruck is now known as dimtruck07:57
*** thorst has quit IRC07:57
*** zzzeek has quit IRC08:00
*** sridhargaddam has joined #openstack-nova08:01
*** EinstCrazy has quit IRC08:01
*** thorst has joined #openstack-nova08:01
*** sridharg has quit IRC08:01
*** EinstCrazy has joined #openstack-nova08:02
*** zzzeek has joined #openstack-nova08:02
*** derekh has joined #openstack-nova08:05
*** yassine has joined #openstack-nova08:05
*** yassine is now known as Guest4709308:05
*** thorst has quit IRC08:06
*** Guest47093 is now known as yassou08:06
*** paul-carlton has quit IRC08:07
*** tpatzig has joined #openstack-nova08:08
*** tpatzig_ has quit IRC08:09
*** thorst has joined #openstack-nova08:09
*** mkoderer has quit IRC08:10
*** SS-SP has quit IRC08:10
*** liuyulong has quit IRC08:10
*** liuyulong has joined #openstack-nova08:10
*** mkoderer has joined #openstack-nova08:11
kashyapslaweq_: I think most core folks might be busy with some other priority stuff, let's give it a day or two.08:13
slaweq_kashyap: ok, I will wait more08:17
*** mingyu has joined #openstack-nova08:17
*** thorst has quit IRC08:17
*** mingyu has quit IRC08:20
openstackgerritMikhail Feoktistov proposed openstack/nova: Check hypervisor version while getting bus type  https://review.openstack.org/28239808:21
*** hoangcx has quit IRC08:22
*** markus_z has joined #openstack-nova08:24
*** vishwana_ has quit IRC08:25
*** vishwanathj_zzz has joined #openstack-nova08:25
*** EinstCrazy has quit IRC08:26
*** hoangcx has joined #openstack-nova08:26
*** thorst has joined #openstack-nova08:27
*** EinstCra_ has joined #openstack-nova08:29
*** EinstCra_ has quit IRC08:30
*** salv-orlando has joined #openstack-nova08:30
*** mingyu has joined #openstack-nova08:31
*** salv-orl_ has quit IRC08:32
*** EinstCrazy has joined #openstack-nova08:33
*** EinstCrazy has quit IRC08:35
*** EinstCrazy has joined #openstack-nova08:35
*** jaosorior is now known as jaosorior_lunch08:40
*** Jeffrey4l_ has quit IRC08:42
*** jlanoux has joined #openstack-nova08:45
*** zarkone has joined #openstack-nova08:53
zarkoneHello! I've faced some troubles with using 3rd party scheduler driver08:54
zarkoneseems like in Newton scheduler uses entry points mechanism to find driver module08:54
zarkonebut entry points are creating at build\setup phase08:55
zarkonethat means that I could use only built-in drivers...08:56
*** gszasz has joined #openstack-nova08:56
*** lixiaoy1 has quit IRC08:57
*** efoley has joined #openstack-nova08:57
slaweq_zarkone: can't You add own entry point for new driver?08:58
zarkoneslaweq_: thanks, I just thought that entry points could only be added at build phase.. could you please point me where to find info about adding entry point for installed module?08:59
*** avolkov` has quit IRC09:00
zarkoneI've done it by editing etry_points.txt in .egg-info09:00
*** zenoway has quit IRC09:00
zarkonehow to o that properly?09:00
zarkone*do09:00
*** bauzas is now known as bauwser09:00
*** zenoway has joined #openstack-nova09:01
*** zenoway has quit IRC09:01
*** zenoway has joined #openstack-nova09:01
*** sdake has joined #openstack-nova09:02
*** amotoki has quit IRC09:04
*** thorst has quit IRC09:04
*** danpb has joined #openstack-nova09:05
*** thorst has joined #openstack-nova09:05
*** ttrumm_ has quit IRC09:05
*** ttrumm has joined #openstack-nova09:05
*** mfedosin has joined #openstack-nova09:06
*** EinstCrazy has quit IRC09:06
*** lpetrut has joined #openstack-nova09:08
*** EinstCrazy has joined #openstack-nova09:08
*** Jeffrey4l has joined #openstack-nova09:08
*** dimtruck is now known as zz_dimtruck09:10
*** thorst has quit IRC09:10
*** cdent has joined #openstack-nova09:11
*** code-R has joined #openstack-nova09:12
*** code-R_ has joined #openstack-nova09:13
johnthetubaguygmann: alex_xu: +1 to tidying the rest of that up next cycle09:16
*** sdake_ has joined #openstack-nova09:16
alex_xujohnthetubaguy: yea09:16
*** code-R has quit IRC09:17
*** mingyu has quit IRC09:17
*** mingyu has joined #openstack-nova09:17
*** sdake has quit IRC09:18
*** mingyu_ has joined #openstack-nova09:19
*** mingyu_ has quit IRC09:19
*** mingyu has quit IRC09:19
*** aloga has quit IRC09:23
*** aloga has joined #openstack-nova09:24
*** artom has quit IRC09:25
gmannjohnthetubaguy: yup. Thanks09:25
*** mingyu has joined #openstack-nova09:26
*** thorst has joined #openstack-nova09:26
*** artom has joined #openstack-nova09:27
*** mingyu has quit IRC09:27
*** moshele has joined #openstack-nova09:27
*** kevinz has quit IRC09:29
prateekjohnthetubaguy, can you please review https://review.openstack.org/#/c/294513/, i have addressed your comments09:31
*** thorst has quit IRC09:31
*** jinquan has quit IRC09:34
*** oanson has quit IRC09:35
*** takedakn has joined #openstack-nova09:43
slaweq_zarkone: You can add it manually in entry_point.txt file where python package is installed or add to setup.cfg file in Your project before install it09:44
zarkoneyes, but I want to add entry point to scheduler09:45
*** rwmjones has quit IRC09:45
zarkonewithout rebuild09:46
*** rwmjones has joined #openstack-nova09:46
*** takedakn has quit IRC09:47
openstackgerritJianghua Wang proposed openstack/nova: XenAPI: resolve the fetch_bandwidth failure  https://review.openstack.org/36583809:49
*** artom has quit IRC09:50
*** artom has joined #openstack-nova09:51
*** PaulMurray has joined #openstack-nova09:52
PaulMurraymdbooth, hi - did you make progress with your DVR setup ?09:53
*** tojuvone_ is now known as tojuvone09:55
*** Guest52040 has joined #openstack-nova09:56
*** sdake has joined #openstack-nova09:57
*** praveen has quit IRC09:57
*** yamahata has quit IRC09:59
*** hoangcx has quit IRC09:59
*** sdake_ has quit IRC10:00
openstackgerritsahid proposed openstack/nova: libvirt: add ps2mouse in choice for pointer_model  https://review.openstack.org/36790910:02
*** annp has quit IRC10:05
*** hieulq has quit IRC10:06
*** shangxdy has quit IRC10:07
*** cdent has quit IRC10:09
*** phuongnh has quit IRC10:10
*** EinstCrazy has quit IRC10:10
*** tuanla_ has quit IRC10:11
*** thorst has joined #openstack-nova10:11
prateekalex_xu, can you please look into https://review.openstack.org/#/c/327706/10:19
*** riccardo_ has joined #openstack-nova10:20
*** moshele has quit IRC10:23
*** artom has quit IRC10:26
*** karthiks has quit IRC10:26
slaweq_zarkone: You can add entry point in Your project and scheduler should find it if it will be in same "namespace"10:29
*** artom has joined #openstack-nova10:31
*** sdake_ has joined #openstack-nova10:31
*** moshele has joined #openstack-nova10:32
*** sdake has quit IRC10:33
*** mfedosin has quit IRC10:34
*** mfedosin has joined #openstack-nova10:36
*** cdent has joined #openstack-nova10:36
*** tbachman has quit IRC10:37
*** jaosorior_lunch is now known as jaosorior10:41
*** ttrumm_ has joined #openstack-nova10:41
*** ttrumm_ has quit IRC10:42
*** mingyu has joined #openstack-nova10:43
*** ttrumm has quit IRC10:45
*** artom has quit IRC10:50
*** artom has joined #openstack-nova10:53
zarkoneslaweq_: ah! thanks for this!10:53
*** takedakn has joined #openstack-nova10:53
slaweq_zarkone: np, I hope I helped You :)10:54
zarkoneyes, for sure10:54
slaweq_:)10:54
zarkoneI had this idea, but haven't tried, thought that it shouldn't work for some reason10:54
zarkoneneed to improve my python + openstack libs knowledge, may be I don't get some basics10:55
slaweq_zarkone: I should work10:56
slaweq_I'm doing such things for my own projects10:56
slaweq_to extend mostly neutron but should be the same10:57
*** cdelatte has joined #openstack-nova10:58
*** zarkone has quit IRC11:00
*** artom has quit IRC11:01
*** artom has joined #openstack-nova11:01
*** rtheis has joined #openstack-nova11:03
*** mingyu has quit IRC11:04
*** praveen has joined #openstack-nova11:04
*** mfedosin has quit IRC11:05
PaulMurraymdbooth, you there ?11:07
mdboothPaulMurray: I am11:07
PaulMurraymdbooth, I produced the network outage you were looking for11:07
mdboothPaulMurray: Incidentally, I've found a friendly neutroner at Red Hat who's hopefully going to help with my reproducer shortly11:08
mdboothPaulMurray: Excellent! What was the setup?11:08
PaulMurrayIts a DVR setup - actually a standard install of Helion - so its not on head11:08
PaulMurraysimilar to devstack11:09
PaulMurrayrunning in vagrant vms11:09
mdboothI tried DVR in devstack briefly, but couldn't get networking working at all11:09
PaulMurray(vagrant managed - that's irrelevant I guess)11:09
mdboothPaulMurray: But crucially was your test the same as mine?11:09
PaulMurrayI did what you described in your email11:09
mdboothNamely 2 instances on the same tenant network pinging each other?11:09
PaulMurrayI put a 30 second pause in post_live_migration_at_destination11:09
mdboothCool11:10
PaulMurrayI was pinging them from the desktop11:10
mdboothCould you try again, pinging between them if you still have it running?11:10
PaulMurrayWhen the switchover happens there is a short pause and some packets lost before pings restart11:10
*** mingyu has joined #openstack-nova11:10
mdboothIt's just that it doesn't require me to get external routing working :)11:10
*** akshai has joined #openstack-nova11:11
mdboothHowever, if it's required to validate then I'll do it11:11
PaulMurraywith a 30 second sleep in the method there is a 30s pause11:11
PaulMurrayWhen running with DVR it shouldn't make any difference (I think)11:11
mdboothSo, when my friendly red hatter gets back from lunch I'm going to have a go with devstack, just because it's less activation energy for me :)11:12
mdboothHowever, if we're bogging down, could I get steps to do what you did?11:12
PaulMurrayof course - actually I have two desktops, one always has devstack running the other always has hellion, but the devstack one is not DVR, so I wanted to quickly prove that this actually happens with DVR first11:13
PaulMurrayI could have a go at doing the setup on devstack too, but I have the same problem you do - my friendly neutron people are in US11:13
mdboothMine's in spain, so we've been talking already11:14
mdboothShould be back shortly11:14
mdboothIt's ajo, in fact11:14
*** sahid has quit IRC11:15
*** stewie925 has quit IRC11:16
*** syjulian has joined #openstack-nova11:17
*** sdague has joined #openstack-nova11:18
*** stewie925 has joined #openstack-nova11:21
*** baoli has joined #openstack-nova11:24
*** baoli_ has joined #openstack-nova11:27
*** jschlueter has joined #openstack-nova11:28
*** panbalag has quit IRC11:29
*** panbalag has joined #openstack-nova11:30
*** dikonoor has quit IRC11:30
*** baoli has quit IRC11:30
*** GB21 has joined #openstack-nova11:31
*** gcb has joined #openstack-nova11:32
*** moshele has quit IRC11:33
*** takedakn has quit IRC11:33
*** baoli_ has quit IRC11:34
*** dikonoor has joined #openstack-nova11:34
openstackgerritVladik Romanovsky proposed openstack/nova: libvirt: inject files when config drive is not requested  https://review.openstack.org/33567611:35
*** baoli has joined #openstack-nova11:38
*** baoli has quit IRC11:44
cdentsdague are you a cookies or cake kind of guy?11:46
cdentI asked because I think you deserve whichever is your preference11:46
sdagueeither is good :)11:46
sdagueand thanks11:46
cdentI think, although, I'm not certain, that people weren't understanding the point of the logging you are doing, until your recent comment to say "we're trying to make sure the server is behaving"11:47
cdentinstead they were thinking of it is as confirming action (rather than _correct_ action)11:48
cdentin any case11:48
* cdent cookies sdague 11:48
*** tonytan4ever has joined #openstack-nova11:48
sdagueyeh, maybe, it feels like there is confusion in that review11:49
prateekcdent, sdague, i am feeling hungry by reading all this :), cdent, can you please review https://review.openstack.org/#/c/327706/ whenever you are free ?11:49
cdentprateek: yeah, gonna get more coffee and then will have a look at that and a couple other things11:50
*** artom has quit IRC11:50
prateekcdent, ok thanks,11:50
*** praveen has quit IRC11:51
*** artom has joined #openstack-nova11:51
sdagueprateek: what are we doing today with that?11:51
*** mgoddard has quit IRC11:52
*** wangqun has quit IRC11:52
prateeksdague, there was one method that was the an issue of discussion in that patch, alex_xu gave a suggestion to make it fine11:53
prateeksdague, i am sorry if i misunderstood that question :/11:53
*** tonytan4ever has quit IRC11:53
sdagueprateek: no, I mean what is current behavior11:53
prateekit throws a 50011:53
*** GB21 has quit IRC11:53
prateeksdague, it throws a 50011:53
*** lucasagomes is now known as lucas-hungry11:55
openstackgerritMikhail Feoktistov proposed openstack/nova: Check hypervisor version while getting bus type  https://review.openstack.org/28239811:55
sdagueI guess my concern is wrapping another thing in here - https://review.openstack.org/#/c/327706/14/nova/api/openstack/extensions.py11:55
*** jed56 has quit IRC11:55
sdagueand that Neutron Connect failure looks different than Cinder / Glance connect failure11:56
*** baoli has joined #openstack-nova11:59
*** code-R_ has quit IRC12:00
*** code-R has joined #openstack-nova12:00
*** gongysh has quit IRC12:00
prateeksdague, when i came across the bug ,i thought the solution to overcome this problem would be writing a client wrapper and then catching the exception12:01
prateeksdague, also there was already a patch to write the client wrapper and i am extending that to catch this exception,12:02
prateekfrom what i see glance also had similar mechanism12:02
sdagueprateek: so this really only has an impact on the proxy api calls that are deprecated, right?12:04
sdaguealthough it changes things for the compute -> neutron path as well?12:05
prateeksdague, in nova/volume/cinder.py, they have the similar thing which they have done as decorator12:05
*** kaisers__ has joined #openstack-nova12:06
*** code-R has quit IRC12:06
prateeksdague, i am not sure about the statement  "impact on the proxy api calls that are deprecated, right?"12:06
*** raj_singh_ has joined #openstack-nova12:06
sdaguethe only time a user is going to see the different return code is if they make a nova api call, which calls neutron on the spot12:07
sdaguebut, most nova api calls don't do that12:07
sdagueexcept the direct proxy interfaces, which are all deprecated12:07
*** cdent has quit IRC12:08
sdaguehttp://developer.openstack.org/api-ref/compute/#networks-os-networks-deprecated12:08
*** kaisers_ has quit IRC12:08
sdaguepersonally, I'd rather see this look the same as the cinder / glance approaches, because the more different ways we have to do this in the code, the harder it is to keep track of12:09
*** kaisers__ has quit IRC12:10
*** raj_singh_ has quit IRC12:11
prateeksdague, the approach to that is already there and different from glance12:11
*** artom has quit IRC12:12
*** mfedosin has joined #openstack-nova12:12
*** artom has joined #openstack-nova12:13
prateeksdague, the calls were already wrapped in a decorator and the excpetions catched http://paste.openstack.org/show/570186/12:13
sdagueprateek: right that's fine12:14
prateeksdague, the neutron wrapper is already present and is a recently and already merged patch, so i guess we would have to have different approaches12:14
prateeksdague, its just that it was missing some cases and i am handling that12:14
sdaguehere is the thing, the 504 change that you have there, will only be activated when people make API calls that we tell them not to, and that will be deleted in the medium future12:15
*** sahid has joined #openstack-nova12:15
sdagueit feels like the bulk of the patch is for getting that part correct12:15
sdaguebut that part is about to all be deleted12:15
prateeksdague, also i feel that since it connects to neutron also , the part which is not being deprecated is also hit12:16
PaulMurraymdbooth, FYI - repeated the test pinging from another VM. Same result - I only have two compute hosts so the vm doing the pings is on one of the hosts involved in the migration. Migrated both ways so one way its collated with the source, the other way with the destination. Same result both times12:16
sdagueprateek: which part?12:16
prateekfor connection to neutron also and not only nova-net12:17
sdagueprateek: ok, but there a 2 ways we talk to neutron12:17
sdaguedirectly on behalf of a user - when doing os-networks or something12:17
sdaguethat's all deprecated and slated for deletion12:17
sdagueand behind the scenes, from the nova-compute daemon as a service user12:17
sdaguewhich is not during an API call12:18
sdagueit is a behind the scenes async operation12:18
sdagueso will never return the neutron failure to the user12:18
sdagueit will instead either be quietly dropped, or put the compute instance into ERROR state12:18
*** hoangcx has joined #openstack-nova12:18
mdboothPaulMurray: Thanks12:19
sdaguewe really really really try to avoid synchronously calling another API system in the middle of complex logic for our APIs, like in server create12:19
mdboothCurrently trying to reproduce without dvr with ajo12:19
prateeksdague, maybe we can drop the code when we drop the whole, but would anyways help users using old versions of openstack , maybe in backporting a patch for a particular problem12:20
sdagueprateek: I really don't want to backport things like the 504 change12:21
prateeksdague, ok12:22
mdboothPaulMurray: Incidentally, are you testing with the recent change to setup_networks_..... ?12:22
sdagueprateek: because then we have to document that as an expection12:22
sdaguebut when it's expected, is massively vague12:22
sdaguebecause it's not tied to a microversion12:23
prateeksdague, ok12:25
*** mriedem has joined #openstack-nova12:26
*** ratailor has quit IRC12:26
ftersinsdague: hi. do you now, who can help me with live migration. i was wandering if it is possible to migrate a booted from volume instance with config drive12:27
*** pradk has joined #openstack-nova12:28
*** hoangcx2 has joined #openstack-nova12:29
prateeksdague, can you suggest a way on how i can take the patch forward ?12:30
*** mingyu has quit IRC12:31
PaulMurraymdbooth, no, mine is on mitaka12:31
*** hoangcx has quit IRC12:31
sdagueprateek: how about just remove the exception translation12:31
sdaguekeep the logging12:32
riccardo_Hi guys, I a Python file I have the following line: fairness_hosts = self.servicegroup_api.get_all("fairness")    and it makes a call to get_all of nova/servicegroup/api.py. But this method is not existent anymore. How can I get a list of all hosts that run the service "fairness"?12:32
*** rfolco has joined #openstack-nova12:33
sdagueprateek: I'm looking at the bug in detail now, so this was about security groups on list instances12:35
prateeksdague, yes12:35
sdaguewhich is one of the few places it exposes on non proxy api calls12:35
*** mfedosin has quit IRC12:36
*** sridhargaddam has quit IRC12:36
sdagueso, honestly, I think this should just get solved with the proper approach of caching the security groups, I think papering around which error response happens to the user here isn't really making things substantial better for folks12:37
prateeksdague, yes, basically , if the neutron server goes down and it tries to list instances, the API throws 50012:37
sdagueright, and in your patch it will still not work, but throw a 50412:37
prateekyes12:37
*** sridhargaddam has joined #openstack-nova12:37
prateekbut you would know what actually happened12:37
sdagueright, that seems not much better12:37
sdagueonly if you have that patch12:37
prateekrather than getting a 50012:37
sdaguewhich isn't behind a microversion, so you have no idea if you are supposed to get that error or not12:38
johnthetubaguyso the network_info object doesn't have security groups already?12:38
johnthetubaguyI say object, I mean mega blob12:38
prateekno, it doesn't cache12:39
johnthetubaguyseems like a mistake to only cache half the data12:39
johnthetubaguythe thing about report errors, is they need to be useful to the person who gets them12:40
*** wznoinsk has quit IRC12:40
johnthetubaguyif the admin can see it was clearly a neutron API availability issue, I think we are good enough for now12:40
prateekyup, i included the error message along with NeutronConnectionFailed for that12:40
johnthetubaguyi.e. +1 what I think sdague is saying12:40
johnthetubaguyso its not the API response consumer12:41
sdaguejohnthetubaguy: right, I'm fine with the more explicit log message12:41
johnthetubaguyits the person reading the API logs that can fix things12:41
*** tblakes has joined #openstack-nova12:41
johnthetubaguyyeah, +1 better logs for this case12:41
sdaguebut changing the API returns here seems to have little gain12:41
johnthetubaguy+112:41
johnthetubaguyits not a contract we want to keep long term12:41
sdagueand it seems like there has been 5 months working on just that instead of the security_group cache which would solve the problem for the user12:41
sdaguejohnthetubaguy: agreed12:41
prateekeven if we cache the security groups the neutron server is still down,12:44
prateekthe user would get an error somewhere12:44
*** mfedosin has joined #openstack-nova12:44
sdagueprateek: where?12:44
johnthetubaguywe wouldn't know or care at that point, when listing instances, sure boot instance would then fail12:44
sdaguebut boot instance fails after the API disconnects, so it doesn't return to the user12:45
prateeksdague, wherever they would need neutron server, yeah like booting a server12:45
sdagueprateek: the user wouldn't get that error12:45
mriedemsahid: i had a question in https://review.openstack.org/#/c/367909/ about making ps2mouse the default12:45
*** cdent has joined #openstack-nova12:45
openstackgerritUkesh Kumar proposed openstack/nova: Wrong description for "name" field of rebuild API  https://review.openstack.org/36798912:45
mriedemsahid: actually i wonder if we should make usbtablet the default,12:45
mriedemsince use_usb_tablet defaults to True12:45
*** salv-orlando has quit IRC12:46
prateeksdague, agreed the user might not get an error ther12:46
sdagueprateek: not might not, definitely won't12:46
prateekok :)12:47
johnthetubaguyand if we ever gave them that error, there is nothing much they could do with it12:47
*** salv-orlando has joined #openstack-nova12:47
*** wznoinsk has joined #openstack-nova12:47
*** sdake_ is now known as sdake12:47
sdaguemriedem: I responded to your comments here - https://review.openstack.org/#/c/366186/ - the expensive bits are already flagged behind being at debug log level12:47
*** salv-orlando has quit IRC12:48
mriedemsdague: ah totally missed that12:48
*** salv-orlando has joined #openstack-nova12:48
mriedemon the sec group caching thing you guys are talking about above, we've had a bug for that for awhile12:49
sdaguecdent provided that feedback in the first iterations of that patch, which was good feedback12:49
prateekjohnthetubaguy, sdague, so the better alternative here is to catch the exception that is coming here and inform the user about it (withot having a new exception) and log the error message properly12:49
prateekis it ?12:49
johnthetubaguywere saying inform the operator by some good logging12:49
prateekor a different approach altogether is needed ?12:49
sdagueprateek: yeh, just add the extra log message for the operator12:49
mriedemprateek: sdague: johnthetubaguy: this bug https://bugs.launchpad.net/nova/+bug/156765512:49
openstackLaunchpad bug 1567655 in OpenStack Compute (nova) "500 error when trying to list instances and neutron-server is down" [Medium,In progress] - Assigned to Prateek Arora (parora)12:49
sdaguemriedem: I know12:49
*** tonytan4ever has joined #openstack-nova12:49
mriedemok, there have been several duplicate bugs like this12:50
sdaguethere is a patch to just change the error reporting, which I don't think is worth it12:50
sdaguewe need to actually fix the thing12:50
mriedem^ is the one where dansmith suggested we cache secgroups12:50
sdagueand stop jumping around the edges12:50
sdaguemriedem: yep12:50
sdaguewe should do that12:50
sdaguebut there has been no work on that from what I can tell, the focus was on the suggestion to just change the error code12:50
mdboothPaulMurray: So, just had a pretty intense session with ajo trying to reproduce that with 'regular' ovs (there must be a proper name for that), and we think it just works in that case.12:51
mriedemalright, well the caching thing is ocata anyway12:51
mdboothPaulMurray: So, looks like I'm going to have to go down the DVR route.12:51
sdaguemriedem: agreed12:51
*** lucas-hungry is now known as lucasagomes12:51
prateeksdague, John341 mriedem , i can take that up12:51
sdaguemriedem: it just doesn't seem worth changing the API, having to document a new error that's not used anywhere else, when our goal is to delete all paths that need it12:52
*** jaosorior has quit IRC12:52
*** salv-orlando has quit IRC12:52
*** jaosorior has joined #openstack-nova12:52
*** gcb has quit IRC12:53
prateeksdague, mriedem , johnthetubaguy , it would be good if you can point me to something that is having any (or none) degree of similarity to the caching we are talking about here otherwise i would start from scratch12:53
*** salv-orlando has joined #openstack-nova12:53
sdaguemriedem: anyway, I'm going to be offline for a good chunk of the day. I feel like there is a lot of confusion on https://review.openstack.org/#/c/366186/. I'm going to try to update the comment message to explain where I'm coming from and why I think it's kind of critical.12:53
*** tonytan4ever has quit IRC12:54
johnthetubaguyprateek: was just looking for a link, have a peak in here: https://github.com/openstack/nova/blob/master/nova/network/neutronv2/api.py#L126712:54
mriedemsdague: i just replied in that one12:55
mriedemprateek: there is a comment in the bug report about adding a new column to the instance_info_caches table for serialized security groups12:55
mriedemwe'd basically be serializing and deserializing SecurityGroupList for a given instance.security_groups into that table12:56
mriedemon a GET if it's not there we'd have to pull the security groups from neutron, and then store it in the cache,12:56
mriedemand there is code to 'heal' that cache,12:56
mriedemand there is a 'refresh_cache' decorator in the network API code for updating that whenever we change network resources tied to an instance12:57
mriedemit's definitely not trivial12:57
mriedemespecially because the network_api and security_group_api are in different interfaces12:57
mriedemthe network api would just have a handle to the secgroup api in order to refresh that cache i suppose12:57
mriedemanyway, it's probably more than a bug, it's probably a bp/spec given the various considerations for getting this right12:58
prateekmriedem, I can try doing it if you think it's worth it , also "As a partial fix we can backport, we should gracefully handle the connection error when trying to talk to neutron API and return a more appropriate response code (503 maybe?). ," i was taking the shorter route the second part of the comment ;)12:58
mriedemprateek: sounds like that's been rejected as an idea12:58
mriedemi'm ok with not doing a hacky workaround for now since this is a latent bug12:58
prateekif the idea is rejected , then shouldn't we just go ahead with what we have right now ?12:59
prateekwe would have something rather than nothing12:59
prateekmriedem, ^13:00
*** Matias has joined #openstack-nova13:00
*** Matias has left #openstack-nova13:00
*** Matias has joined #openstack-nova13:01
sahidmriedem: ah yes.. let me look at your comment on the review13:01
*** thorst has quit IRC13:02
*** andreas_s has quit IRC13:02
mriedemprateek: i don't know what patch you're talking about13:03
prateekhttps://review.openstack.org/#/c/327706/1413:04
openstackgerritSean Dague proposed openstack/nova: Additional logging for placement API  https://review.openstack.org/36618613:04
sdaguemriedem: ok, I updated the commit message13:04
*** woodster_ has joined #openstack-nova13:04
prateekmriedem, https://review.openstack.org/#/c/327706, i was talking about this13:05
*** mingyu has joined #openstack-nova13:05
*** sdake has quit IRC13:05
*** mingyu has quit IRC13:05
mriedemsdague: can you make it TRACE logging rather than DEBUG?13:05
sdaguebasically, there is almost no other usage of the debug log level during this release, so the concern about not using DEBUG for this seems odd to me13:05
sdaguemriedem: I thought you said trace is not in newton13:05
mriedemwe can't configure it w/o those oslo.log patches13:05
mriedembut we could if we needed to debug the gate via a depends-on13:06
mriedemif needed13:06
mriedemsince i thought that was your concern13:06
sdagueI am fine making it trace in ocata13:06
mriedemhonestly we're already hurting the scheduler performance in the gate because of https://review.openstack.org/#/c/366283/13:06
sdagueI guess, that's the part I don't understand.13:06
sdaguemriedem: that's pretty different13:06
mriedemi'm suggesting TRACE since it's an audit block that queries the DB for sanity checking and debugging,13:07
mriedemyou want something in for debugging this in newton,13:07
mriedemi'd be fine with getting it in under TRACE,13:07
sdaguemriedem: right, but you said you can't configure it in newton13:07
mriedemyes we don't have a config option to toggle that in newton w/o the oslo.log patch, but we could use that if necessary via depends-on until it lands in ocata if needed13:07
mriedemi thought your main reason for getting this in was gate debugging?13:08
sdaguemriedem: it's any debugging13:08
sahidmriedem: I replied to your comment I don't really have a strong opinion on that point13:08
sdaguemriedem: can you just go through the commit message and read what I tried to write there?13:09
*** mdrabe has joined #openstack-nova13:09
mriedemsdague: so if i'm a newton operator, and the placement stuff isn't being used in the scheduler for placement decisions, why would i care to debug this?13:09
sdaguemriedem: then don't run placement under debug13:09
mriedemit seems like we want this debugging in place as devs to sort this out, but in reality it's not actually being used13:09
sdagueand problem solved13:09
sahiddanpb: can you have a look at https://review.openstack.org/#/c/367909/13:09
*** claudiub has quit IRC13:10
*** smatzek has joined #openstack-nova13:10
mriedemfair point13:10
johnthetubaguyso no one should run placement in production at this point anyways, I am assuming?13:10
sdaguethere are 3 messages at debug level in newton13:10
*** riccardo_ has quit IRC13:10
johnthetubaguyor at least, it doesn't help them yet13:10
sdague2 of which are added in this patch13:11
mriedemso one plan is land this debug patch in newton for our sake, change to trace in ocata once the oslo.log change is released,13:11
sdaguethe 3rd is the api start13:11
sdaguemriedem: yes, I would be happy with that plan13:11
openstackgerritGábor Antal proposed openstack/nova: Throw exception if numa_nodes is not set to integer greater than 0  https://review.openstack.org/33738013:11
mriedemand for newton, ops should just not run placement service in debug mode13:11
*** gongysh has joined #openstack-nova13:11
mriedemif they even run it at all in newton13:11
johnthetubaguymriedem: I thought they shouldn't run placement at all yet?13:11
sdaguemriedem: the should only run in debug if they want to debug things13:11
mriedemjohnthetubaguy: they can, but it's optional, so no idea if they will13:12
*** ptm__ has joined #openstack-nova13:12
sdaguemriedem: which means they mostly won't13:12
mriedemjohnthetubaguy: like, i don't know if i'd suggest to our cloud to run it right now13:12
johnthetubaguyso its just extra CPU usage for zero gain right now, it doesn't seem worth it yet13:12
sdaguethe whole purpose of having it was so that we would have working newton computes that could talk to it correctly13:12
sdagueand report correctly13:13
mriedemwell, the gain i see is you get a jump on tracking RPs and usage/inventory13:13
openstackgerritSylvain Bauza proposed openstack/nova: WIP: Update BuildRequest if instance currently being scheduled  https://review.openstack.org/36574013:13
sdagueso that for ocata, when we want to use it, you can with old computes13:13
sdagueand we know it works13:13
*** mjura has quit IRC13:13
*** PaulMurray has quit IRC13:13
sdaguebecause we'd have nothing to test the compute clients against otherwise13:13
*** edleafe is now known as figleaf13:14
mriedemalternatively in ocata we remove this from the placement api and move it to the RT13:15
*** su_zhang has joined #openstack-nova13:16
*** prateek has quit IRC13:16
*** lpetrut has quit IRC13:16
*** andreas_s has joined #openstack-nova13:19
mriedemi have to get my daughter on the bus and then head into the office, i'll check back in on this after morning meetings13:19
mriedemdanpb: can you check this fix and the one below https://review.openstack.org/#/c/335676/13:20
sdaguemriedem: possibly, though if it's not in the same request as the allocation changes, corolating events id going to be super hard13:20
*** mriedem has quit IRC13:20
sdaguewhich, I also have a paragraph about in the commit message13:21
*** mriedem has joined #openstack-nova13:22
alex_xucdent: sdague mriedem, one fix for placement https://review.openstack.org/367307, but probably it isn't critical one.13:23
*** andreas_s has quit IRC13:23
cdentthanks alex_xu, will have a look13:24
alex_xucdent: thanks13:24
*** hoangcx has joined #openstack-nova13:24
*** hoangcx2 has quit IRC13:25
*** xyang1 has joined #openstack-nova13:25
*** mriedem has quit IRC13:26
alex_xusdague: thanks13:27
figleafalex_xu: looks good13:28
alex_xufigleaf: thanks :)13:28
*** BjoernT has joined #openstack-nova13:28
*** BjoernT is now known as Bjoern_zZzZzZzZ13:28
*** sdake has joined #openstack-nova13:30
*** gszasz has quit IRC13:31
*** nkrinner is now known as nkrinner_afk13:31
*** pwnall1 has joined #openstack-nova13:31
*** pradk has quit IRC13:32
*** pradk has joined #openstack-nova13:32
*** smatzek has quit IRC13:34
*** jichen has quit IRC13:34
*** tonytan4ever has joined #openstack-nova13:35
*** Guest52040 has quit IRC13:40
*** sridhargaddam has quit IRC13:41
*** Bjoern_zZzZzZzZ is now known as BjoernT13:41
*** jschlueter has quit IRC13:41
*** lpetrut has joined #openstack-nova13:43
*** jed56 has joined #openstack-nova13:45
*** mingyu has joined #openstack-nova13:47
*** sdague has quit IRC13:50
*** dansmith is now known as superdan13:50
*** brian_price has quit IRC13:51
*** ociuhandu has joined #openstack-nova13:51
*** markus_z has quit IRC13:53
*** smatzek has joined #openstack-nova13:53
*** alaski is now known as lascii13:54
openstackgerritgaryk proposed openstack/nova: Compute: ensure that InvalidDiskFormat is handled correctly  https://review.openstack.org/36777213:55
*** kaisers_ has joined #openstack-nova13:56
*** AlexeyAbashkin has joined #openstack-nova13:57
*** kaisers_ has quit IRC13:57
*** marst has quit IRC13:58
*** mriedem has joined #openstack-nova13:59
*** vladikr has joined #openstack-nova13:59
*** anush has joined #openstack-nova14:00
*** fragatina has joined #openstack-nova14:01
*** thorst has joined #openstack-nova14:02
*** mfedosin has quit IRC14:02
*** mriedem1 has joined #openstack-nova14:03
*** Dinesh_Bhor has quit IRC14:03
*** mriedem has quit IRC14:04
*** mfedosin has joined #openstack-nova14:04
*** rlrossit has joined #openstack-nova14:04
*** fragatina has quit IRC14:06
mriedem1huh http://logs.openstack.org/07/367307/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/cf54759/logs/screen-n-cpu.txt.gz?level=TRACE#_2016-09-08_12_05_26_13914:06
*** mriedem1 is now known as mriedem14:06
mriedemwe shouldn't stacktrace on a port not found when unbinding ports14:06
*** thorst has quit IRC14:07
*** marst has joined #openstack-nova14:07
*** TravT has joined #openstack-nova14:07
*** akshai_ has joined #openstack-nova14:08
*** lpetrut has quit IRC14:08
mriedemhttps://bugs.launchpad.net/nova/+bug/162188314:08
openstackLaunchpad bug 1621883 in OpenStack Compute (nova) "PortNotFoundClient stacktrace in n-cpu when unbinding ports" [Undecided,New]14:08
*** TravT has quit IRC14:08
*** brian_price has joined #openstack-nova14:10
*** artom has quit IRC14:10
*** TravT has joined #openstack-nova14:10
*** mingyu has quit IRC14:11
*** akshai has quit IRC14:11
mriedemalex_xu: do you have an example of this warning in a ci run? https://bugs.launchpad.net/nova/+bug/162143714:11
openstackLaunchpad bug 1621437 in OpenStack Compute (nova) "Add Allocations record failed in the startup of compute node" [Medium,In progress] - Assigned to Alex Xu (xuhj)14:11
mriedemi'm not finding that in logstash14:11
*** Jeffrey4l has quit IRC14:11
mriedemcdent: something for ocata, we need to mark the error messages from the placement-api for translation14:12
*** thorst has joined #openstack-nova14:12
mriedemmaybe not even ocata if you can do that today14:12
*** Jeffrey4l has joined #openstack-nova14:12
*** hoangcx has quit IRC14:13
mriedemi'll open a bug14:13
*** kaisers_ has joined #openstack-nova14:13
*** lpetrut has joined #openstack-nova14:14
cdentmriedem: thanks. when you say "error" and "from the placement-api" do you mean: everything LOG.error and/or the http error responses; everything produced both in the api handlers and the object methods.14:14
*** lpetrut has quit IRC14:14
mriedemwell anything logged above debug should be marked with the _LI, _LW, _LE markers14:15
mriedemi think we have pep8 for that14:15
mriedemi'm talking about errors in the http responses14:15
*** edmondsw has joined #openstack-nova14:15
mriedemlike here https://github.com/openstack/nova/blob/master/nova/api/openstack/placement/handlers/allocation.py#L10114:15
superdanjaypipes: did you ever write the patch from yesterday morning?14:16
superdanI don't see it anywhere14:16
*** zul has joined #openstack-nova14:16
*** Jeffrey4l has quit IRC14:17
mriedemcdent: https://bugs.launchpad.net/nova/+bug/162188814:17
openstackLaunchpad bug 1621888 in OpenStack Compute (nova) "placement-api http responses are not marked for translation" [Undecided,New]14:17
*** ptm__ is now known as PaulMurray14:17
*** artom has joined #openstack-nova14:17
cdentthanks mriedem I'll look into that14:17
*** avolkov` has joined #openstack-nova14:19
*** Jeffrey4l has joined #openstack-nova14:19
*** lpetrut has joined #openstack-nova14:20
*** adisky has quit IRC14:21
*** zz_dimtruck is now known as dimtruck14:23
*** mingyu has joined #openstack-nova14:24
jaypipessuperdan: https://review.openstack.org/368035 still trying to fix one bug in functional tests.14:24
superdanjaypipes: ah, okay14:24
*** lpetrut has quit IRC14:25
*** mingyu has quit IRC14:26
*** mingyu has joined #openstack-nova14:26
*** hoangcx has joined #openstack-nova14:28
*** dikonoor has quit IRC14:29
*** pbandark has quit IRC14:30
*** andreas_s has joined #openstack-nova14:30
*** mlavalle has joined #openstack-nova14:30
*** burgerk has joined #openstack-nova14:31
*** burgerk_ has joined #openstack-nova14:33
burgerk_mriedem: Thanks for the help getting the MediumText change merged14:36
*** burgerk has quit IRC14:37
*** su_zhang has quit IRC14:38
*** su_zhang has joined #openstack-nova14:38
*** jaypipes is now known as leakypipes14:39
*** jheroux has joined #openstack-nova14:39
*** su_zhang_ has joined #openstack-nova14:40
*** hoangcx has quit IRC14:41
*** ducttape_ has joined #openstack-nova14:41
*** andymaier has joined #openstack-nova14:42
cdentsuperdan, jaypipes: I've added jay's patch to the etherpad for safe keeping14:42
superdancdent: ah thanks14:42
*** andymaier has quit IRC14:42
*** su_zhang has quit IRC14:42
*** Oku_OS is now known as Oku_OS-away14:44
*** READ10 has joined #openstack-nova14:45
*** READ10 has quit IRC14:45
*** READ10 has joined #openstack-nova14:45
mriedemburgerk_: np14:48
*** mingyu has quit IRC14:49
*** sudipto has quit IRC14:49
*** sudipto_ has quit IRC14:49
*** kaisers_ has quit IRC14:50
alex_xumriedem: I didn't see any example from the CI, I can see that from my local.14:50
*** zul has quit IRC14:51
alex_xumriedem: it happened everytime in my local after clearup the db. Very strange to why that isn't in the CI.14:53
leakypipescdent: cheers14:53
openstackgerritAndrey Volkov proposed openstack/nova: Add schedule_and_build_instances conductor method  https://review.openstack.org/36755714:54
openstackgerritAndrey Volkov proposed openstack/nova: WIP Move instance creation to conductor  https://review.openstack.org/31937914:54
*** tanvirt has joined #openstack-nova14:57
*** burt has joined #openstack-nova14:58
*** annegentle has joined #openstack-nova14:58
*** raj_singh_ has joined #openstack-nova14:59
*** matrohon has quit IRC14:59
*** mdrabe has quit IRC15:00
*** armax has joined #openstack-nova15:02
*** su_zhang_ has quit IRC15:04
*** su_zhang has joined #openstack-nova15:04
*** mdrabe has joined #openstack-nova15:05
*** siva_krishnan has left #openstack-nova15:06
*** tbachman has joined #openstack-nova15:06
openstackgerritChris Dent proposed openstack/nova: Add {get_,set_}aggregates to objects.ResourceProvider  https://review.openstack.org/35526315:07
openstackgerritChris Dent proposed openstack/nova: Implement get and set aggregates in the placement API  https://review.openstack.org/35799315:07
openstackgerritChris Dent proposed openstack/nova: [placement] add a placement_aggregates table to api_db  https://review.openstack.org/36286315:07
*** jaosorior has quit IRC15:07
*** pcaruana has quit IRC15:08
*** ihrachys has quit IRC15:08
*** su_zhang has quit IRC15:09
alex_xumriedem: I see now, in my local env, the compute node already have some instances. When node startup, RT will create Allocation record. In the CI, the node startup without any instance on it.15:10
*** wasmum has quit IRC15:10
*** mingyu has joined #openstack-nova15:11
*** rrecio_ has joined #openstack-nova15:13
*** gongysh has quit IRC15:13
mriedemalex_xu: hmm, yeah...i guess we'd have instances in a grenade job, but we don't run the placement-api in a grenade job yet15:13
mriedemsuperdan: ^ right? i can't remember if we ever got a grenade job with placement yet15:14
mriedembut i don't think so15:14
*** prateek has joined #openstack-nova15:14
*** gouthamr has joined #openstack-nova15:15
*** tjones has joined #openstack-nova15:16
*** gouthamr_ has joined #openstack-nova15:16
mriedemwe should get a grenade job in the experimental queue with the placement api, i can work on that today15:17
mriedemsingle node15:17
mriedemleakypipes: you're probably better to look at this https://review.openstack.org/#/c/367307/15:19
superdanmriedem: yeah, I don't think so15:19
superdanmriedem: and yeah, I said last week that we really need to be validating that path at some point15:19
*** pwnall2 has joined #openstack-nova15:20
mriedemi can work on a job for that today15:20
*** gouthamr has quit IRC15:20
*** pwnall1 has quit IRC15:21
openstackgerritMatt Riedemann proposed openstack/nova: neutron: don't trace on port not found when unbinding ports  https://review.openstack.org/36807915:22
superdanmriedem: okay cool15:22
bauwsermriedem: superdan: yeah, we don't have grenade testing against the placement api15:24
*** mingyu has quit IRC15:25
bauwsermriedem: superdan: but what could you guys think we should test ?15:25
mriedembauwser: just that it doesn't shit it's patns15:25
mriedem*pants15:25
*** pwnall2 has quit IRC15:25
superdannon-pants-shitting would be good15:25
bauwserI appreciate the analogy :)15:25
mriedemexperimental job is free15:25
bauwsermriedem: so, like asking grenade to run the placement api ?15:25
mriedemwell,15:26
*** pwnall1 has joined #openstack-nova15:26
mriedemwe just enable the placement-api service in the job,15:26
mriedemso when it upgrades from mitaka to neutron, devstack sets up the placement api on the neutron side15:26
mriedemand we have some instances in the db15:26
bauwseron the full grenade job or in the aio+compute ?15:26
*** jsheeren has quit IRC15:26
mriedemsingle node15:26
mriedemfull upgrade15:26
bauwserk15:26
*** vishwanathj_zzz is now known as vishwanath15:27
*** vishwanath is now known as vishwanathj15:27
*** browne has joined #openstack-nova15:27
leakypipesmriedem: reviewing now.15:27
bauwsermriedem: and I guess s/neutron/newton/ :p15:27
*** mingyu has joined #openstack-nova15:27
mriedembauwser: yeah15:27
*** amotoki has joined #openstack-nova15:27
mriedemdid i say neutron?15:27
mriedemyeah15:27
mriedembut both15:27
mriedemso i'll work on that and you guys can marvel over my beautiful neutron bug fix above15:28
bauwsermriedem: that's where IRC is unfortunate when you want to lie :p15:28
*** yassou has quit IRC15:28
*** su_zhang has joined #openstack-nova15:29
*** gongysh has joined #openstack-nova15:30
*** ZZelle has quit IRC15:34
*** mdrabe has quit IRC15:34
*** mdrabe has joined #openstack-nova15:35
*** jistr is now known as jistr|biab15:35
*** ZZelle has joined #openstack-nova15:36
*** FrankZhang has joined #openstack-nova15:37
*** pwnall1 has quit IRC15:40
*** pwnall1 has joined #openstack-nova15:40
FrankZhangHi, everyone.  This is Frank from Rackspace. Very glad to be here. Actually I need some help to review one Nova DB patch on the upstream. I'll be really grateful someone can take a look at it: https://review.openstack.org/#/c/329231/15:41
mriedembauwser: superdan: https://review.openstack.org/#/c/368087/15:41
bauwserroger.15:41
*** jdurgin has quit IRC15:42
mriedemheh, looks like rax private cloud is really hurting for that stable/liberty change15:42
FrankZhangYeah, that's true. I couldn't denny there's too much buggy things existing in Liberty15:44
*** Jeffrey4l has quit IRC15:47
*** hshiina has joined #openstack-nova15:48
*** paul-carlton2 has quit IRC15:48
*** openstackgerrit has quit IRC15:49
*** tesseract- has quit IRC15:49
*** openstackgerrit has joined #openstack-nova15:49
*** mingyu has quit IRC15:50
*** andreas_s has quit IRC15:51
*** zul has joined #openstack-nova15:52
-openstackstatus- NOTICE: New setuptools release appears to have a circular import which is breaking many jobs - check for ImportError: cannot import name monkey.15:53
*** ChanServ changes topic to "New setuptools release appears to have a circular import which is breaking many jobs - check for ImportError: cannot import name monkey."15:53
mriedemFrankZhang: is setting unlimited quota a feature for rpc?15:54
*** dimtruck is now known as zz_dimtruck15:57
FrankZhangmriedem IMO it's more like a guarantees in case user miss-set project quota15:59
*** Jeffrey4l has joined #openstack-nova15:59
*** zenoway has quit IRC16:01
*** whenry has joined #openstack-nova16:01
*** amotoki_ has joined #openstack-nova16:02
*** zz_dimtruck is now known as dimtruck16:02
*** jdurgin has joined #openstack-nova16:02
*** gongysh has quit IRC16:03
*** amotoki_ has quit IRC16:03
*** rlrossit has quit IRC16:04
FrankZhangmriedem really appreciate the help16:04
mriedemi will accept payment in ham sandwiches16:05
*** amotoki has quit IRC16:05
*** yamahata has joined #openstack-nova16:06
FrankZhangYou deserve much more than this, haha16:06
*** jdurgin has quit IRC16:06
openstackgerritOpenStack Proposal Bot proposed openstack/nova: Updated from global requirements  https://review.openstack.org/36812216:09
*** thorst has quit IRC16:11
*** raj_singh_ has quit IRC16:11
*** vladikr has quit IRC16:11
*** akshai_ has quit IRC16:12
*** thorst has joined #openstack-nova16:12
*** pbandark has joined #openstack-nova16:13
*** thorst_ has joined #openstack-nova16:15
*** thorst_ has quit IRC16:16
*** thorst has quit IRC16:16
*** thorst has joined #openstack-nova16:19
*** sudipto has joined #openstack-nova16:20
*** sudipto_ has joined #openstack-nova16:20
*** jdurgin has joined #openstack-nova16:21
*** mkoderer has quit IRC16:21
*** tpatzig has quit IRC16:21
*** pbandark has quit IRC16:21
*** jlanoux has quit IRC16:23
*** thorst_ has joined #openstack-nova16:24
*** thorst has quit IRC16:24
*** akshai has joined #openstack-nova16:25
*** jistr|biab is now known as jistr16:25
*** jdurgin has quit IRC16:27
*** sdake has quit IRC16:28
*** thorst_ has quit IRC16:29
*** vladikr has joined #openstack-nova16:29
*** jdurgin has joined #openstack-nova16:29
*** su_zhang has quit IRC16:29
*** su_zhang has joined #openstack-nova16:30
*** thorst has joined #openstack-nova16:31
*** hshiina has quit IRC16:31
*** fragatina has joined #openstack-nova16:32
*** su_zhang_ has joined #openstack-nova16:32
*** READ10 has quit IRC16:32
*** su_zhang has quit IRC16:32
*** thorst has quit IRC16:32
*** dimtruck is now known as zz_dimtruck16:33
mgagnemelwitt: today I'm getting 140k less log entries after I reduced the number of Greenpool workers for power state sync periodic task. And no failure (BadStatusLine exception) :D16:33
openstackgerritStephen Finucane proposed openstack/nova: hardware: Rework docstrings  https://review.openstack.org/36746816:34
openstackgerritStephen Finucane proposed openstack/nova: hardware: Standardize '_get_XXX_constraints' functions  https://review.openstack.org/36746916:34
openstackgerritStephen Finucane proposed openstack/nova: hardware: Flatten functions  https://review.openstack.org/36747016:34
openstackgerritStephen Finucane proposed openstack/nova: hardware: Split out 'numa' and 'compat' modules  https://review.openstack.org/36746716:34
melwittmgagne: interesting16:34
openstackgerritStephen Finucane proposed openstack/nova: hardware: Group functions by broader function  https://review.openstack.org/36814416:34
leakypipescdent: any chance you can help me diagnose the issue with the one functional test failure from http://logs.openstack.org/35/368035/1/check/gate-nova-tox-db-functional-ubuntu-xenial/98b7e2d/testr_results.html.gz? I cannot understand the output of the console in http://logs.openstack.org/35/368035/1/check/gate-nova-tox-db-functional-ubuntu-xenial/98b7e2d/console.html because something (testr?) is16:34
leakypipesmaking it all garbled :(16:34
*** zz_dimtruck is now known as dimtruck16:34
cdentleakypipes: yeah, one sec16:34
mgagnemelwitt: applied the patch at ~midnight: http://imgur.com/a/VTjSx16:35
*** sudipto has quit IRC16:35
*** sudipto_ has quit IRC16:35
mgagnelimiting to 100, instead of 100016:36
melwittwow16:36
leakypipescdent: nm. reproduced the logs locally.16:36
cdentleakypipes: yeah, was just doing that myself16:36
cdenttox -efunctional placement_api_inventory_post_inventory_bad_resource_class16:37
leakypipescdent: yeah, found it.16:37
*** su_zhang_ has quit IRC16:37
openstackgerritJay Pipes proposed openstack/nova: [placement] make PUT inventory consistent with GET  https://review.openstack.org/36803516:37
melwittmgagne: and by log entries, do you mean a log statement from inside the power state sync function?16:37
mgagnemelwitt: a line in a log file =)16:38
*** su_zhang has joined #openstack-nova16:38
mgagnemelwitt: I don't think our system supports multiline well =)16:38
cdentleakypipes: this use to be a little easier to trace because there were less lines of logs. the additional lines are great for some things.16:38
mgagneI can create a graph based on this specific log entry I guess16:38
melwittmgagne: okay. I was just curious what got logged less as a result16:38
mgagnebut the node I'm testing just doesn't have the entry anymore today, checking in file directly16:38
mgagnelet me copy paste the error16:39
mgagnehttp://paste.openstack.org/show/570274/16:39
cdentleakypipes: if it is giving key error on resource class there doesn't that mean the json schema is not validating?16:41
melwittmgagne: okay so you mean the reduction is just the lack of a bunch of error logging for the BadStatusLine16:42
*** su_zhang has quit IRC16:42
mgagnemelwitt: well, power state sync is now successful and therefore no error generated16:42
melwittright16:42
mgagnecontext is nova-compute with Ironic driver power syncing with ironic-api16:42
melwittyeah16:43
cdentleakypipes: nevermind, I see it is less complex than that16:43
*** tpatzig has joined #openstack-nova16:44
*** lucasagomes is now known as lucas-afk16:44
*** mkoderer has joined #openstack-nova16:44
*** efoley has quit IRC16:45
cdentleakypipes: I have a fix and an improved test if you've been called away16:48
*** pilgrimstack has quit IRC16:48
*** READ10 has joined #openstack-nova16:49
*** prateek has quit IRC16:50
*** prateek has joined #openstack-nova16:50
*** markd_ has quit IRC16:53
*** gouthamr_ is now known as gouthamr16:53
*** derekh has quit IRC16:54
cdentleakypipes: you have squared it away, i see16:54
* cdent goes back to sleep16:54
*** Swami has joined #openstack-nova16:55
cfriesenbauzas: leakypipes: Can you double-check something?  I think we've got a race between revert-resize and resource audit on the source that we're reverting back to.  In ComputeManger.revert_resize() we setmigration.status = 'reverted' and save the migration.  As soon as we do that, MigrationList.get_in_progress_by_host_and_node() will no longer show that migration even though we haven't actually called finish_revert_resize()16:55
cfriesenyet.16:55
*** ChanServ changes topic to "This channel is for Nova development. For support of Nova deployments, please use #openstack. Please see: https://wiki.openstack.org/wiki/Nova/Newton_Release_Schedule"16:57
cfriesenbauwser: ^16:57
-openstackstatus- NOTICE: setuptools 27.1.2 addresses the circular import16:57
melwittmgagne: based on a quick look around the code, it seems reasonable the sync power state greenpool size should be configurable too, like the wsgi one is. probably the reason it isn't is because back in the day, there were no rest api calls possible as part of the sync routine16:58
mgagneyea. I'm not sure how vmware and others handle that part16:59
melwittassuming a rest api call being more heavyweight causes some issue with the pool size16:59
mgagnebut I guess they can handle much more load? or in fact, there is no use case where there would be 1000 instances on the same "hypervisor"16:59
*** anush has quit IRC17:00
*** sahid has quit IRC17:02
melwittyeah, I'm not sure. I thought vcenter was a thing where a cluster would show up as one hypervisor to nova, but I really don't know much about how vmware et al work17:02
*** rodrigods has quit IRC17:03
*** rodrigods has joined #openstack-nova17:03
*** tongli has joined #openstack-nova17:03
*** tbachman has quit IRC17:03
leakypipescdent: hmm, I *did* rebase on master...17:05
cdentoh dear17:05
*** markd_ has joined #openstack-nova17:05
cdentsomething is wonky17:05
*** yamahata has quit IRC17:06
cdentleakypipes: I pulled down patchset 2 and it doesn't have those problematic lines17:07
*** mnestratov has quit IRC17:08
leakypipescdent: ps2 is the latest patchset, though.. and gerrit is showing those lines :(17:08
cdents/2/1/17:08
*** rlrossit has joined #openstack-nova17:08
leakypipescdent: all I did was rebase to master :(17:08
cdentleakypipes: was your master out of date?17:08
leakypipesno17:08
cdentleakypipes: weird. and your master doesn't have those lines?17:09
openstackgerritJay Pipes proposed openstack/nova: [placement] make PUT inventory consistent with GET  https://review.openstack.org/36803517:10
leakypipescdent: lol, the rebase didn't work... I needed to git prune apparently. fixed now. ^17:10
* cdent waves chicken, hopes for best17:11
*** unicell has quit IRC17:13
*** zul has quit IRC17:15
*** zul has joined #openstack-nova17:16
*** tonytan4ever has quit IRC17:16
cdentleakypipes: I'm seeing no difference between ps2 and ps317:18
cdentleakypipes: the offending lines are still there, and my vote is still there because the files haven't changed17:18
*** tbachman has joined #openstack-nova17:19
*** su_zhang has joined #openstack-nova17:24
*** rrecio_ has quit IRC17:26
*** bnemec is now known as beekneemech17:28
*** devananda|dinner is now known as devananda17:32
*** thorst_ has joined #openstack-nova17:33
*** ftersin has left #openstack-nova17:35
*** tonytan4ever has joined #openstack-nova17:37
*** thorst_ has quit IRC17:38
*** tonytan_brb has joined #openstack-nova17:38
*** fragatina has quit IRC17:39
*** tjones has left #openstack-nova17:39
*** unicell has joined #openstack-nova17:40
*** tonytan4ever has quit IRC17:42
*** marst has quit IRC17:43
*** marst has joined #openstack-nova17:43
*** fragatina has joined #openstack-nova17:43
*** yamahata has joined #openstack-nova17:44
johnthetubaguymriedem: looks like you dropped -2s on some of the config patches, I could go hit those soon if thats what you want there?17:44
mriedemjohnthetubaguy: up to you17:46
mriedemi'm not actively reviewing those17:47
superdanconfig changes need not go in before the release right?17:47
mriedemi'm trying to sort out https://review.openstack.org/#/c/355415 but because i'm not a master of how the image cache and the various image backends work, and there are no details in the commit message, i'm having a hard time with that one17:47
mriedemmikal: you should look at ^17:47
mriedemsuperdan: those are just the cleanups17:47
mriedemdocs17:47
leakypipescdent: ok, will look17:47
*** fragatina has quit IRC17:48
superdanmriedem: not moving things you mean?17:48
mriedembut a bunch of ops people have said that https://review.openstack.org/#/c/355415 fixes a bad issue for them so i want to get it in17:48
mriedemi'm not understanding the question17:48
mriedemthe centralization part?17:48
mriedemi'd say we shouldn't do those right now17:49
mriedembut the help cleanup stuff is ok i think17:49
*** salv-orlando has quit IRC17:49
superdanright, okay17:49
superdanmriedem: I reviewed that imagecache one a while ago but never voted I guess17:49
*** salv-orlando has joined #openstack-nova17:49
mriedemwith all of the image backends and callback methods in that caching code,17:50
mriedemi'm having a real hard time justifying a +1 let alone +2 from me on that fix17:51
mriedemit seems harmless, and people have said it fixes their issue17:51
mriedembut gdi i'd like some details in the commit message about why it's a bug17:51
*** mfedosin has quit IRC17:51
mriedembut when i ask i'm an immediate asshole17:51
superdanmriedem: what do you mean "why it's a bug" ?17:51
mriedemthe commit message and code says 'under certain conditions'17:52
mriedemwhat are those conditions that expose those?17:52
mriedemlike, the create_image methods in the image backends all look like they create an image to me, so is it one of those, or is it one of the fetch functions passed into the image backend create_image method?17:52
superdanmriedem: well, you can race with other things that may be culling unused base images right?17:53
mriedemno idea17:54
johnthetubaguymriedem: superdan: I feel I should spend effort on the bugs instead right now, we can land those as soon as master opens up again, just curious on intention there17:54
melwittmriedem: I agree it's weird the mysterious "under certain conditions" with no example. I'm reading the lp bug now17:55
mriedemthe image cache manager with the partial fetch function callbacks and various backends is just a thing i don't have in my brain17:55
mriedemso someone has to draw me a map to explain the bug17:56
superdanmriedem: so actually I may have found a bug in there17:57
superdantrying to explain it to you17:57
superdan*while trying17:59
superdanmriedem: but anyway, for things like flat, there is an exists check that prevents the actual creation of the image, which I assume we can race with, especially with shared imagecaches, and I assume that is the "some circumstances"18:00
*** burgerk_ has quit IRC18:01
*** burgerk has joined #openstack-nova18:02
mriedemso at t1 exists says it exists, then at t2 the image cache manager thinks it's not used and removes it, so by t3 when we need it, it no longer exists and we fail18:02
superdanyeah18:02
mriedemand create_image() would not create it if it's called between t1 and t218:03
mriedemi don't think the bug is for a race, but ok18:03
*** shz has joined #openstack-nova18:03
leakypipescdent: ok, so fuck it... not sure how those lines snuck back in there. which ones should I remove again?18:04
leakypipescdent: or maybe I should just start over and rebase on the latest changes you've put up.18:04
leakypipesthat merged just recently.18:04
leakypipesgod I am so burned out right now. :(18:05
cdentleakypipes: the comment on patchset 1 identifies them I think. basically the stuff about NewCapacityExceended I think18:05
cdentI can just fix it with another patch if you like18:05
cdentor I can push my local change which didn't have it but fixed the other problem18:05
cdents/other/original18:05
cdentin fact lemme do that18:05
*** akshai has quit IRC18:05
leakypipescdent: ok18:05
leakypipescdent: ty18:05
*** shihanzhang has quit IRC18:06
mriedemsuperdan: looking at mdbooth's test, it says "The Flat backend doesn't write to the image cache when creating a non-image backend." so i'm wondering if this is the issue https://github.com/openstack/nova/blob/master/nova/virt/libvirt/imagebackend.py#L495-L49718:07
openstackgerritChris Dent proposed openstack/nova: [placement] cleanup some incorrect comments  https://review.openstack.org/36817118:09
mriedemand you only get into ^ if ephemeral or swap18:09
*** ssurana has joined #openstack-nova18:10
*** READ10 has quit IRC18:10
* mdbooth is still here (briefly) btw18:10
mdboothmriedem: Yes, that's the code which means that flat doesn't write to the image cache when creating ephemeral or swap18:11
mdboothmriedem: Incidentally I firmly believe that *nothing* should write to the image cache when creating ephemeral or swap18:12
mdboothThat's a job for another day, though18:12
*** burgerk has quit IRC18:12
*** akshai has joined #openstack-nova18:12
*** PaulMurray has quit IRC18:12
melwittmdbooth: are you looking at the review https://review.openstack.org/#/c/355415/ there's a question from superdan there on whether that call should be self.exists()18:13
mriedemmdbooth: can you read my comment in the commit message (just posted) trying to trace this through and let me know if that's correct?18:15
mdboothmelwitt: Just replying directly.18:15
melwittcool18:15
mdboothmriedem: Done18:21
superdanI don't understand how that happens based on mdbooth's explanation above18:21
superdani.e. how create_image doesn't create a base image for those18:21
mdboothsuperdan: So, when you call cache(), it passes a bunch of kwargs down to the specific create_image() of the backend18:22
superdanah, self.exists in create and os.path.exists in cache18:22
superdanmaybe that makes more sense18:22
mdboothBoth Flat and Lvm look in those kwargs for (different) arguments, to decide whether or not they're creating an ephemeral/swap or an image18:23
mdboothIn the latter case, they write directly to target, not to base18:23
mdboothSo they don't populate the image cache18:23
superdangah18:23
mdboothIt's all fantastically convoluted :)18:23
mriedemhate this code18:23
superdanthinking they were all the same exists, I figured it had to be timing related18:24
mdboothSeriously, somebody should rewrite that stuff18:24
mriedemheh18:24
superdanwhich made sense to me, but that's what led me to the os.path.exists thing18:24
mriedemok, so i'd really appreciate a better explanantion in the commit message or comment in the code, but not sure i want to do it myself (i'd screw it up), or wait until next week for mdbooth to do it, realizing it's friday night for him18:24
mriedemand the ops guys that were on it all hate me by now already18:25
mdboothmriedem: Ah, this is the one I wrote the test for?18:25
mriedemyes18:25
mdboothOk18:25
*** pwnall1 has quit IRC18:25
mriedemwhich thank you for18:25
mdboothYeah, they seemed a bit annoyed18:25
mriedemthe annoyance is a 2 way street18:26
mdboothIndeed18:26
mriedemsuperdan: are you good with this?18:26
superdanmriedem: sure, but especially since I thought it was a different reason we should prolly fix the commit message18:26
*** hemanthm is now known as hemanthm|lunch18:26
superdanmriedem: you wanna do that since you had the right idea and I can +2?18:26
mriedemsuperdan: do you want to update the commit message?18:26
superdanI want _you_ to :P18:27
mriedemha18:27
mriedemmdbooth: you want to take 2 minutes to update the commit message?18:27
mdboothmriedem: I'm hopefully minutes away from reproducing that live-migration bug...18:27
mdboothGimme a few18:27
mriedemo18:27
mriedemok18:27
*** su_zhang has quit IRC18:28
*** jichen has joined #openstack-nova18:29
mdboothReproduced :)18:29
mdboothIt's only taken me about 3 days18:29
*** su_zhang has joined #openstack-nova18:31
openstackgerritChris Dent proposed openstack/nova: [placement] make PUT inventory consistent with GET  https://review.openstack.org/36803518:31
*** rrecio has joined #openstack-nova18:32
*** fragatina has joined #openstack-nova18:34
*** fragatina has quit IRC18:34
*** fragatina has joined #openstack-nova18:34
*** jed56 has quit IRC18:35
*** BjoernT has quit IRC18:36
mriedemmdbooth: but now you get bragging rights18:36
mdboothmriedem superdan: Is that commit message ok?18:36
cdentsuperdan: I think that ^ fixes the issues with that stuff. If you have a mo to gander18:36
mdboothIt's not up my normal essay standard.18:36
superdanmdbooth: I see no change18:38
openstackgerritMatthew Booth proposed openstack/nova: Fix resizing in imagebackend.cache()  https://review.openstack.org/35541518:38
mriedem+118:38
mriedemthere we go18:38
mriedemUK internets18:38
mdboothNow about now?18:38
*** jdurgin has quit IRC18:38
superdancdent: will try to look when I get back but have to go do a thing in a few minutes18:38
mdboothNah, I've never used the gerrit editor before18:38
mdboothI failed to publish it18:38
cdentsuperdan: I don't reckon there's a huge rush18:39
cdentsuperdan: just wanted you to be aware it was in a state of readiness18:39
mriedem+218:39
mriedemmdbooth: thanks18:39
superdancdent: thanks18:39
*** pwnall1 has joined #openstack-nova18:40
*** TravT has quit IRC18:41
*** lpetrut has joined #openstack-nova18:41
*** zul has quit IRC18:44
vladikranyone has a bandwidth to look at a numa related bug fix - been there for a while: https://review.openstack.org/#/c/342709/7 - there is a relevant functional test on top18:45
*** rlrossit has quit IRC18:46
*** pwnall1 has quit IRC18:47
openstackgerritChris Dent proposed openstack/nova: Add {get_,set_}aggregates to objects.ResourceProvider  https://review.openstack.org/35526318:47
openstackgerritChris Dent proposed openstack/nova: Implement get and set aggregates in the placement API  https://review.openstack.org/35799318:47
openstackgerritChris Dent proposed openstack/nova: [placement] add a placement_aggregates table to api_db  https://review.openstack.org/36286318:47
*** pwnall1 has joined #openstack-nova18:47
*** Sukhdev has joined #openstack-nova18:48
*** cdent has quit IRC18:49
*** leakypipes has quit IRC18:52
marstHello! Does anyone have a guide/examples how nova boot --hint flag actually works? Also, there used to be force_host option, allowing to skip schedulers completely, but not anymore?!18:55
*** jdurgin has joined #openstack-nova18:56
*** su_zhang has quit IRC18:56
*** sdague has joined #openstack-nova18:57
sdaguesuperdan: for this, the issue with TRACE is that it's not actually possible to turn on TRACE in newton18:58
sdaguehttps://review.openstack.org/#/c/366186/18:58
sdaguecan we land it as exists in newton, then downgrade to TRACE as soon as we get the ability to allow logging that in ocata?18:58
*** pwnall1 has quit IRC19:00
*** zul has joined #openstack-nova19:00
*** pwnall1 has joined #openstack-nova19:00
*** unicell has quit IRC19:03
*** vladikr has quit IRC19:03
*** pwnall1 has quit IRC19:06
*** hoangcx has joined #openstack-nova19:07
*** unicell has joined #openstack-nova19:07
*** unicell has quit IRC19:08
*** danpb has quit IRC19:08
*** unicell has joined #openstack-nova19:08
*** hoangcx has quit IRC19:14
openstackgerritianeta hutchinson proposed openstack/nova: Removed extra characters  https://review.openstack.org/36818519:16
*** pwnall1 has joined #openstack-nova19:16
*** isq has quit IRC19:17
*** tbachman has quit IRC19:21
*** tbachman has joined #openstack-nova19:22
*** mkoderer has quit IRC19:23
*** hoangcx has joined #openstack-nova19:23
*** tpatzig has quit IRC19:23
openstackgerritianeta hutchinson proposed openstack/nova: Removed extra characters  https://review.openstack.org/36818519:25
*** rlrossit has joined #openstack-nova19:26
*** jheroux has quit IRC19:26
*** lamt has joined #openstack-nova19:26
openstackgerritSean Dague proposed openstack/nova: Additional logging for placement API  https://review.openstack.org/36618619:30
openstackgerritMathieu Gagné proposed openstack/nova: Add sync_power_state_pool_size option  https://review.openstack.org/36774619:33
*** isq has joined #openstack-nova19:35
openstackgerritSean Dague proposed openstack/nova: Additional logging for placement API  https://review.openstack.org/36618619:36
*** artom has quit IRC19:36
*** artom has joined #openstack-nova19:37
*** hoangcx has quit IRC19:37
*** artom has quit IRC19:37
*** sdake has joined #openstack-nova19:38
*** artom has joined #openstack-nova19:38
*** dimtruck is now known as zz_dimtruck19:39
*** mnestratov has joined #openstack-nova19:39
*** hemanthm|lunch is now known as hemanthm19:41
*** sdake has quit IRC19:42
*** BjoernT has joined #openstack-nova19:43
*** sdake has joined #openstack-nova19:44
*** lpetrut has quit IRC19:46
*** zz_dimtruck is now known as dimtruck19:47
*** jaugustine_ has joined #openstack-nova19:50
*** jaugustine_ is now known as jaugustine19:50
*** cdelatte has quit IRC19:56
*** nic has joined #openstack-nova19:59
*** marst has quit IRC20:00
superdansdague: I really really don't think we should have it in there. it's MHO.. I just commented again and invited other people who don't agree to override me20:01
sdaguesuperdan: ok, I guess I didn't understand your previous concern on DEBUG being used by other things though20:02
*** ducttape_ has quit IRC20:03
superdansdague: and you still don't or do now?20:03
*** tanvirt has quit IRC20:03
*** tongli has quit IRC20:03
superdanthe shared config thing is another issue I hadn't thought of20:04
sdagueassuming placement api ends up with a dedicated copy of a nova.conf, given that it's configured radically differently, I'm not sure I get the concern20:04
superdanthe people that run with debug=True all the time and use unified controllers will not be able to deploy placement without doing the extra work20:04
sdaguethe shared file, sure20:04
superdanmy point however, was that if you want the actual debug output from placement, you have to turn on the extra queries in order to get that, making it painful to get that level of output from it20:05
mriedemfrom a recent example here, we just disabled debug on our controllers because of the scheduler debug logging being a terrible impact to select_destinations()20:05
mriedemwe could separate the configs on the controller but that was going to be a pain in the ass20:05
sdaguemriedem: sure20:05
mriedemwe could also run nova-scheduler with --nodebug20:05
mriedemand override the config20:05
sdaguemriedem: you could also actually use python logging to tweak that service20:06
superdanyeah, and that's just extra logs being emitted, not N extra DB queries for every allocation20:06
sdaguesuperdan: ok, so TRACE doesn't seem viable for newton, because you can't enable it20:06
sdaguean extra config flag?20:06
mriedemto be clear, i'm not sure if you can set nova=TRACE in CONF.default_log_levels and make it work20:07
mriedemi haven't tried it, but assumed that only worked for the logging from the libs that nova is using20:07
mriedemlike oslo and glanceclient20:07
superdanyeah, and as I said, if that means we can't have this in newton then I'm fine with that, since I don't think it should be there anyway.. if you want a workaround config to _enable_ it then I guess that's the same compromise20:07
superdanmriedem: based on what Iknow of normal logging it should work, but maybe there is some gotcha there20:07
mriedemi didn't think about the workaround config20:07
superdanI actually thought mriedem's trace=True patch was a nova patch,20:08
mriedemwe could do that for newton, release as deprecated, and then drop it in ocata when the CONF.trace thing comes up20:08
superdanso I figured workaround would be the same20:08
superdanbut it's not, so..20:08
sdaguesuperdan: right, I think that's where you disagree, maybe because we were debugging different issues this week20:08
mriedemCONF.workarounds.placement_trace20:08
sdagueI'm not actually convinced that the allocations logic is right20:08
mriedem*placement_audit20:08
mriedemsomething like that20:08
superdansdague: I know, and I definitely disagree20:08
superdanbut trying to be compromisey :)20:09
*** jdurgin has quit IRC20:09
sdaguesuperdan: ok, so feel pretty confident now that allocations are right?20:10
*** zul has quit IRC20:10
superdansdague: I think this audit was useful for a very narrow issue, and won't be for most other things _i've_ already debugged and fixed20:10
*** zul has joined #openstack-nova20:10
superdansdague: and I've been beating on this pretty hard for the last three weeks, so yeah, I'm pretty comfortable both with what is there now but also with how we debug things going forward if we have an issue20:11
sdagueok, except this was all wrong for the first 2 weeks you were testing it and not noticed20:12
superdansdague: another thing I haven't mentioned is that since you're not doing this in a transaction, you could very easily be emitting wrong audit information, which is worse than nothing, IMHO20:13
superdanwhich is my point about doing this the way it's being done20:13
sdaguethat's where I get concerned, allocations only were right after https://review.openstack.org/#/c/366245/ merged 48 hours ago20:13
superdansdague: yeah, good one, I should be ashamed.. anyway, this is MHO and I've invited people to override me, and offered another compromise20:14
superdannot sure what else I can do other than not have an opinion20:14
mriedemi'd be +2 on a workaround option that is deprecated in favor of the trace option that gets into oslo.log, and back this behind that option20:16
mriedemthat is the bridge to the trace option for newton20:16
mriedem*ocata20:16
mriedemdefaults to False naturally20:17
sdaguesuperdan: ok, the transaction point is a good one20:17
superdanmriedem: I'm not sure why we kept discussing after that20:17
*** tonytan_brb has quit IRC20:18
sdaguesuperdan: I guess I didn't think you said "yes, I'd support that" on the workaround approach20:18
*** pwnall1 has quit IRC20:18
superdansdague: [13:07:30]  <superdan>yeah, and as I said, if that means we can't have this in newton then I'm fine with that, since I don't think it should be there anyway.. if you want a workaround config to _enable_ it then I guess that's the same compromise20:18
superdansdague: same compromise as trace20:18
*** jdurgin has joined #openstack-nova20:19
Matiashey guys, is a core reviewer available to see if this can be merged? https://review.openstack.org/#/c/358599/20:19
sdagueok. so if folks are feeling confident on the allocations logic side, I'll drop out the usage bits. I wasn't, as I think it's still really lightly tested20:20
*** thorst_ has joined #openstack-nova20:20
sdagueI'll propose back as trace once we have that facility, as it's not like we'll be actively developing the newton code post branch20:20
superdansdague: you'll still keep the logging of the raw allocation dict through right?20:21
sdagueyeh20:21
sdagueI'll just delete the audit_usage method20:21
sdaguethat works for you, right?20:21
superdanyep, wasn't sure if it got lost that I _do_ want the actual allocation info logged20:22
mriedemMatias: i've got that starred, just needed to get back to it20:22
sdaguesuperdan: ok, one last thing20:23
sdagueprobably worth putting logging on delete as well for the allocations, just to see them in both directions20:23
sdaguecan I do that after allocations.delete_all()20:23
superdansdague: sure20:23
sdagueor will that have invalidated that20:24
sdagueand I need to do it just before20:24
Matiasmriedem: thanks20:25
superdansdague: I'm 1.5h into my "afternoon off" and not doing very well at it, so I'm going to run off now20:25
sdagueok20:25
*** smatzek has quit IRC20:26
*** pwnall1 has joined #openstack-nova20:26
sdaguesuperdan: sorry, didn't realize it was afternoon off20:27
superdansdague: not your fault20:27
*** superdan is now known as dansmith20:27
openstackgerritSean Dague proposed openstack/nova: Additional logging for placement API  https://review.openstack.org/36618620:29
*** salv-orl_ has joined #openstack-nova20:30
*** rama_y has joined #openstack-nova20:32
openstackgerritSean Dague proposed openstack/nova: Additional logging for placement API  https://review.openstack.org/36618620:32
*** salv-orlando has quit IRC20:32
*** baoli has quit IRC20:33
*** salv-orl_ has quit IRC20:33
*** baoli has joined #openstack-nova20:33
*** salv-orlando has joined #openstack-nova20:34
openstackgerritMatt Riedemann proposed openstack/nova: Additional logging for placement API  https://review.openstack.org/36618620:36
*** rama_y has quit IRC20:36
*** mkoderer has joined #openstack-nova20:38
*** tpatzig has joined #openstack-nova20:38
*** rmcall has quit IRC20:39
*** rmcall has joined #openstack-nova20:40
*** su_zhang has joined #openstack-nova20:41
*** rfolco_ has joined #openstack-nova20:45
*** lpetrut has joined #openstack-nova20:45
*** rfolco has quit IRC20:46
*** pwnall2 has joined #openstack-nova20:48
*** tonytan4ever has joined #openstack-nova20:50
*** pwnall1 has quit IRC20:52
mriedemMatias: reviewed, comments inline20:54
Matiasmriedem: thanks20:55
*** ssurana has quit IRC20:57
*** openstackstatus has quit IRC20:57
mriedemmgagne: fyi based on earlier discussions with melwitt https://review.openstack.org/#/c/242006/20:58
*** jaugustine has quit IRC20:59
*** openstackstatus has joined #openstack-nova20:59
*** ChanServ sets mode: +v openstackstatus20:59
mgagnemriedem: so get_all_power_states would be the call to implement for Ironic?20:59
mgagnemriedem: I'm not sure how Ironic will allow you to fetch nodes filtered by a LONG? list of instance UUIDs21:00
mgagnemaybe this is something that would need to be implemented in Ironic API if not already done (I didn't check)21:01
mriedemoh not sure about that, just sounded like a related thing21:01
mriedemthere is a lot of overhead with going out to vcenter for thousands of instances one by one is the point21:01
*** baoli has quit IRC21:02
mgagnelooks like it's not supported21:02
*** baoli has joined #openstack-nova21:02
mgagneyes, a coworker suggested a similar solution yesterday21:02
mgagneI'm glad that Nova will support the ability to fetch in batch21:03
*** rlrossit has quit IRC21:03
*** jichen has quit IRC21:04
*** lascii is now known as alaski21:04
mriedemnot merged yet :)21:04
mriedemneeds some love21:04
*** lpetrut has quit IRC21:07
*** baoli has quit IRC21:07
mgagne=)21:08
mgagneso for now, I'm more or less looking for a fix that *could* be easily backported21:08
mgagneand wouldn't depend on a new feature/api in Ironic21:08
openstackgerritPaulo Matias proposed openstack/nova: Fill destination check data with VNC/SPICE listen addresses  https://review.openstack.org/35859921:09
mriedemooo a fun NFS + imagecache bug https://bugs.launchpad.net/nova/+bug/162181821:10
openstackLaunchpad bug 1621818 in OpenStack Compute (nova) "nova-compute unexpected input/output errors on starting instances (NFS + image-cache)" [Undecided,Confirmed]21:10
mriedemmdbooth: your favorite21:11
mriedembrowne: need to get the vmware ci running on https://review.openstack.org/#/c/281134/21:12
mriedemit's been over a day21:12
mriedemwell, nearly a day21:12
*** haplo37__ has joined #openstack-nova21:12
*** su_zhang has quit IRC21:13
openstackgerritMatt Riedemann proposed openstack/nova: Add sync_power_state_pool_size option  https://review.openstack.org/36774621:15
openstackgerritPushkar Umaranikar proposed openstack/nova: Remove internal_id attribute from instances table  https://review.openstack.org/36066621:17
mgagnemriedem: tyvm for the review21:18
mriedemnp21:18
brownemriedem: ok will do21:20
*** lamt has quit IRC21:25
*** thorst_ has quit IRC21:28
*** thomasem has joined #openstack-nova21:29
*** thomasem has left #openstack-nova21:29
*** prateek has quit IRC21:30
*** haplo37__ has quit IRC21:32
*** akshai has quit IRC21:32
*** annegentle has quit IRC21:34
*** mdrabe has quit IRC21:35
*** mdrabe has joined #openstack-nova21:35
mriedemdo we support attaching 2 ports on different networks with the same mac to the same instance? https://bugs.launchpad.net/nova/+bug/162107621:35
openstackLaunchpad bug 1621076 in OpenStack Compute (nova) "Can't detach interface from VM (if VM has two interface with same mac addresses)" [Undecided,New]21:35
*** pwnall2 has quit IRC21:35
mriedemarmax: ^ ever heard of that?21:36
armaxmriedem: that’s not a limitation in neutron per se21:37
*** rfolco_ has quit IRC21:38
armaxin that the unique constraint for the mac is applied on a per network basis21:38
* armax looks21:38
*** yassou has joined #openstack-nova21:38
armaxlooks like the error is coming from libvirt21:38
*** wasmum has joined #openstack-nova21:39
armaxit’s impressive this went undetected for so long :)21:39
armaxmriedem: what’s weird though is that the interfaces could be attached successfully21:40
mriedemarmax: yeah i thought the same21:40
mriedemlooks like libvirt complains b/c it can't find which interface to detach21:41
mriedemsince it's looking up by mac21:41
*** pwnall1 has joined #openstack-nova21:41
armaxmriedem: yeah, makes sense21:42
armax“sense"21:42
*** rtheis has quit IRC21:43
mriedemoh well, maybe danpb can sort it out next week21:44
melwittI wondered about that bug too. I had thought mac addresses were supposed to be unique21:48
clarkbthey are, I think thats reasonable behavior by libvirt21:50
mriedemi assume there is an awesome NFV HA use case lurking here21:51
mriedemcarl_baldwin: you might have input on this https://bugs.launchpad.net/nova/+bug/161740921:53
openstackLaunchpad bug 1617409 in OpenStack Compute (nova) "fixed ip gets assigned when a port is created with no fixed ip" [Undecided,New] - Assigned to Manikantha Srinivas Tadi (manikantha-tadi)21:53
mtreinishmelwitt: not always, for example if you use bonding21:53
mtreinishit should be unique on the network though, otherwise you'll have weird issues21:53
*** dimtruck is now known as zz_dimtruck21:54
melwittI see21:54
mtreinishbut it's a weird edge case. I'm sure mriedem is right and it's something nfv why it's coming up21:54
clarkbmtreinish: in that case though you still only have one logical interface andyou can still uniquely identify the physical interfaces iirc21:55
*** tblakes has quit IRC21:55
mtreinishclarkb: right it's one logical interface. But the kernel changes the hwaddr to be the same on both of the physical interfaces21:56
mtreinishclarkb: http://paste.openstack.org/show/570327/21:56
mtreinishfrom my server21:56
mtreinishheh, I had to fight this the other day because switching to use systemd to bring it up swapped the macs21:57
clarkbha21:57
clarkbof course it did21:57
mriedemdiana_clarke: fyi https://bugs.launchpad.net/nova/+bug/161319921:57
openstackLaunchpad bug 1613199 in OpenStack Compute (nova) "nova should accept pre-pended comments in public keys" [Undecided,New]21:57
carl_baldwinmriedem: ack22:00
*** hemanthm is now known as hemanthm|away22:04
*** tonytan_brb has joined #openstack-nova22:06
*** artom has quit IRC22:06
*** gjayavelu has joined #openstack-nova22:06
*** tonytan4ever has quit IRC22:07
*** artom has joined #openstack-nova22:08
*** mriedem has quit IRC22:11
*** liangy has quit IRC22:18
*** xinliang has quit IRC22:18
*** pwnall1 has quit IRC22:22
*** yamahata has quit IRC22:22
*** mnestratov has quit IRC22:26
*** mdrabe has quit IRC22:27
*** thorst has joined #openstack-nova22:28
*** xinliang has joined #openstack-nova22:31
*** thorst has quit IRC22:33
*** xyang1 has quit IRC22:36
*** yamahata has joined #openstack-nova22:37
*** sdague has quit IRC22:38
auggythat bug was kind of weird one22:39
auggythe use case provided in the bug wasn't really valid22:40
auggybut maybe i misunderstood22:40
*** sdake has quit IRC22:40
*** raj_singh_ has joined #openstack-nova22:43
*** mingyu has joined #openstack-nova22:51
*** raj_singh_ has quit IRC22:54
*** mingyu has quit IRC22:55
*** ociuhandu has quit IRC22:56
*** figleaf is now known as edleafe22:59
*** rrecio has quit IRC23:07
*** rrecio has joined #openstack-nova23:09
*** rrecio has quit IRC23:13
mgagneis "XenProject CI" working well? it failed multiple times on what I consider a trivial change.23:15
mgagnein fact, the change is the equivalent of a noop23:16
*** armax has quit IRC23:20
*** yassou has quit IRC23:20
*** sdake has joined #openstack-nova23:22
*** pradk has quit IRC23:27
*** BjoernT has quit IRC23:30
*** artom has quit IRC23:32
*** artom has joined #openstack-nova23:33
*** zul has quit IRC23:33
*** Swami has quit IRC23:39
*** armax has joined #openstack-nova23:43
*** nic has quit IRC23:44
*** vishwanathj has quit IRC23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!