Wednesday, 2017-03-01

*** ducttape_ has joined #openstack-nova00:00
*** ociuhandu has quit IRC00:02
*** marst has joined #openstack-nova00:02
*** dtp has quit IRC00:03
*** jaypipes has quit IRC00:04
*** yingjun has joined #openstack-nova00:06
*** hoonetorg has quit IRC00:08
*** ZZelle has quit IRC00:10
*** jaypipes has joined #openstack-nova00:16
*** mlavalle has quit IRC00:21
*** hoonetorg has joined #openstack-nova00:22
*** Swami has quit IRC00:26
*** baoli has joined #openstack-nova00:26
*** adrian_otto has joined #openstack-nova00:27
*** xyang1 has quit IRC00:28
*** baoli has quit IRC00:31
*** gfhellma has quit IRC00:31
*** jamesdenton has joined #openstack-nova00:33
*** salv-orlando has quit IRC00:33
*** jamielennox is now known as jamielennox|away00:36
jaypipescburgess: yup.00:43
*** jamielennox|away is now known as jamielennox00:44
*** hongbin has quit IRC00:46
*** sacharya has joined #openstack-nova00:51
*** tovin07_ has joined #openstack-nova00:52
*** ijw has joined #openstack-nova00:56
*** ijw has quit IRC01:01
*** rfolco has quit IRC01:03
*** rfolco has joined #openstack-nova01:04
*** rfolco has quit IRC01:04
*** hoangcx has joined #openstack-nova01:06
*** sacharya has quit IRC01:06
*** sacharya has joined #openstack-nova01:06
*** kevinz has joined #openstack-nova01:13
*** alex_xu has quit IRC01:19
*** alex_xu has joined #openstack-nova01:19
openstackgerritSivasathurappan Radhakrishnan proposed openstack/nova master: Port binding based on events during live migration  https://review.openstack.org/43487001:20
*** jamesdenton has quit IRC01:22
*** tovin07_ has quit IRC01:25
*** alex_xu has quit IRC01:25
*** alex_xu has joined #openstack-nova01:25
*** alex_xu has quit IRC01:26
*** alex_xu has joined #openstack-nova01:27
*** jamesdenton has joined #openstack-nova01:28
*** jamesdenton has quit IRC01:30
*** CristinaPauna has quit IRC01:35
*** thorst has joined #openstack-nova01:41
*** thorst has quit IRC01:46
*** ducttape_ has quit IRC01:46
*** thorst has joined #openstack-nova01:46
*** ducttape_ has joined #openstack-nova01:46
*** CristinaPauna has joined #openstack-nova01:48
*** edmondsw has joined #openstack-nova01:48
*** tbachman has joined #openstack-nova01:49
*** thorst has quit IRC01:50
*** hoonetorg has quit IRC01:52
*** edmondsw has quit IRC01:53
*** jamesdenton has joined #openstack-nova01:53
*** jamesdenton has quit IRC01:57
*** ijw has joined #openstack-nova01:57
*** tovin07 has quit IRC01:59
*** hoonetorg has joined #openstack-nova02:01
*** edmondsw has joined #openstack-nova02:02
*** ijw has quit IRC02:03
*** dave-mccowan has quit IRC02:03
*** tovin07 has joined #openstack-nova02:03
*** gcb has joined #openstack-nova02:04
*** edmondsw has quit IRC02:05
*** avolkov has quit IRC02:05
*** fragatina has quit IRC02:06
*** raunak has quit IRC02:08
*** gcb has quit IRC02:09
*** avolkov has joined #openstack-nova02:10
*** ducttape_ has quit IRC02:11
*** thorst has joined #openstack-nova02:13
*** iceyao has joined #openstack-nova02:14
*** iceyao has quit IRC02:15
*** avolkov has quit IRC02:15
*** iceyao has joined #openstack-nova02:16
*** avolkov has joined #openstack-nova02:18
*** browne has quit IRC02:20
*** unicell has quit IRC02:21
*** kaisers__ has joined #openstack-nova02:24
*** ducttape_ has joined #openstack-nova02:24
*** mtanino has quit IRC02:25
*** kaisers_ has quit IRC02:27
*** gongysh has joined #openstack-nova02:33
*** thorst has quit IRC02:33
*** thorst has joined #openstack-nova02:33
*** owalsh is now known as owalsh-afk02:34
*** Apoorva_ has joined #openstack-nova02:36
*** avolkov has quit IRC02:37
*** thorst has quit IRC02:38
*** Apoorva has quit IRC02:39
*** Apoorva_ has quit IRC02:40
*** sapcc-bot1 has joined #openstack-nova02:52
*** carthaca_ has quit IRC02:52
*** sapcc-bot has quit IRC02:52
*** carthaca_ has joined #openstack-nova02:52
*** gaoyuan has joined #openstack-nova02:52
*** gaoyuan has quit IRC02:53
*** lucasxu has joined #openstack-nova02:54
*** lucasxu has quit IRC02:57
*** ijw has joined #openstack-nova02:59
*** gcb has joined #openstack-nova03:01
*** zhurong has joined #openstack-nova03:03
*** ducttape_ has quit IRC03:04
*** ijw has quit IRC03:04
*** hongbin has joined #openstack-nova03:06
*** yamahata has quit IRC03:08
*** thorst has joined #openstack-nova03:08
*** thorst has quit IRC03:08
*** jwcroppe has joined #openstack-nova03:10
*** phuongnh has joined #openstack-nova03:11
*** zhurong has quit IRC03:13
*** gaoyuan has joined #openstack-nova03:21
*** ayogi has joined #openstack-nova03:22
*** fragatina has joined #openstack-nova03:22
*** fragatina has quit IRC03:22
*** fragatina has joined #openstack-nova03:23
*** rfolco has joined #openstack-nova03:24
*** rfolco has quit IRC03:24
*** gaoyuan has quit IRC03:25
*** ayogi has quit IRC03:31
*** salv-orlando has joined #openstack-nova03:34
*** amotoki_ has joined #openstack-nova03:36
*** salv-orlando has quit IRC03:39
*** thorst has joined #openstack-nova03:39
*** amotoki has quit IRC03:39
*** thorst has quit IRC03:40
*** ducttape_ has joined #openstack-nova03:41
*** fragatina has quit IRC03:44
*** raunak has joined #openstack-nova03:44
*** fragatina has joined #openstack-nova03:45
*** armax has joined #openstack-nova03:45
*** tiendc has joined #openstack-nova03:46
*** claudiub has quit IRC03:46
*** thorst has joined #openstack-nova03:49
*** thorst has quit IRC03:50
*** mkrai_ has joined #openstack-nova03:50
*** ijw has joined #openstack-nova04:00
*** kamtamtun has joined #openstack-nova04:00
*** ducttape_ has quit IRC04:05
*** nicolasbock has quit IRC04:06
*** ijw has quit IRC04:06
*** READ10 has quit IRC04:09
*** armax has quit IRC04:11
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements  https://review.openstack.org/43932904:12
*** sudipto_ has joined #openstack-nova04:14
*** sudipto has joined #openstack-nova04:14
*** karthiks has quit IRC04:14
*** ducttape_ has joined #openstack-nova04:15
openstackgerritOpenStack Proposal Bot proposed openstack/python-novaclient master: Updated from global requirements  https://review.openstack.org/43936104:16
*** tbachman has quit IRC04:16
*** highfield has joined #openstack-nova04:18
*** sreeram_v has joined #openstack-nova04:19
*** yuntongjin has joined #openstack-nova04:20
*** unicell has joined #openstack-nova04:20
*** ducttape_ has quit IRC04:21
*** gaoyuan has joined #openstack-nova04:22
*** ducttape_ has joined #openstack-nova04:23
*** hoonetorg has quit IRC04:23
*** crushil has joined #openstack-nova04:23
*** highfield has quit IRC04:24
*** highfield has joined #openstack-nova04:25
*** yuntongjin has quit IRC04:25
*** mdnadeem has joined #openstack-nova04:26
*** psachin has joined #openstack-nova04:26
*** sreeram_v has quit IRC04:27
*** links has joined #openstack-nova04:27
*** gaoyuan has quit IRC04:28
*** diga has joined #openstack-nova04:29
*** sree has joined #openstack-nova04:29
*** unicell has quit IRC04:31
*** highfield has quit IRC04:32
*** highfield has joined #openstack-nova04:33
*** hoonetorg has joined #openstack-nova04:35
*** unicell has joined #openstack-nova04:36
*** avolkov has joined #openstack-nova04:40
*** adisky_ has joined #openstack-nova04:41
*** hongbin has quit IRC04:41
*** tiendc has quit IRC04:43
*** fragatina has quit IRC04:44
*** adrian_otto has quit IRC04:44
*** yamahata has joined #openstack-nova04:45
*** unicell has quit IRC04:47
*** fragatina has joined #openstack-nova04:47
*** yuntongjin has joined #openstack-nova04:47
*** ducttape_ has quit IRC04:47
*** highfield has quit IRC04:48
*** gaoyuan has joined #openstack-nova04:49
*** unicell has joined #openstack-nova04:50
gaoyuanwho is unicell04:50
*** thorst has joined #openstack-nova04:50
*** ratailor has joined #openstack-nova04:54
*** ayogi has joined #openstack-nova04:54
*** thorst has quit IRC04:55
*** ijw has joined #openstack-nova04:56
*** unicell has quit IRC05:00
*** amotoki has joined #openstack-nova05:07
*** prateek_ has joined #openstack-nova05:09
*** amotoki_ has quit IRC05:09
*** fragatina has quit IRC05:09
*** moshele has joined #openstack-nova05:10
*** shaner has quit IRC05:11
*** prateek has joined #openstack-nova05:12
*** carthaca_ has quit IRC05:16
*** carthaca_1 has joined #openstack-nova05:16
*** artom has quit IRC05:17
*** artom_ has joined #openstack-nova05:17
*** moshele has quit IRC05:18
*** moshele has joined #openstack-nova05:18
*** prateek__ has joined #openstack-nova05:20
*** prometheanfire has joined #openstack-nova05:20
prometheanfireso, upgrades broken due to a db rename?05:21
*** karthiks has joined #openstack-nova05:25
*** dikonoor has joined #openstack-nova05:29
prometheanfiregetting this isn't that helpful :|05:31
prometheanfireCell0 is already setup05:31
prometheanfireUnable to sync cell0 schema: (psycopg2.OperationalError) FATAL:  database "nova_cell0" does not exist05:31
*** crushil has quit IRC05:32
prometheanfireis it still calling the setup even if it's already set up?05:32
*** bhagyashris has joined #openstack-nova05:33
*** salv-orlando has joined #openstack-nova05:35
*** sandanar has joined #openstack-nova05:36
*** sacharya has quit IRC05:39
*** gouthamr has quit IRC05:40
*** sacharya has joined #openstack-nova05:40
*** salv-orlando has quit IRC05:40
*** kaisers__ has quit IRC05:41
*** mdrabe_ has quit IRC05:43
*** sridharg has joined #openstack-nova05:45
*** sacharya has quit IRC05:45
*** gaoyuan has quit IRC05:47
*** gaoyuan has joined #openstack-nova05:47
*** ducttape_ has joined #openstack-nova05:48
*** ducttape_ has quit IRC05:53
*** trinaths has joined #openstack-nova05:55
openstackgerritMarkMielke proposed openstack/nova master: DiskFilter handling for free space less than zero  https://review.openstack.org/43009106:01
*** dikonoor has quit IRC06:02
*** dikonoor has joined #openstack-nova06:03
*** adrian_otto has joined #openstack-nova06:05
*** raunak has quit IRC06:05
*** gaoyuan has quit IRC06:05
*** adrian_otto has quit IRC06:07
*** huanxie has joined #openstack-nova06:07
*** unicell has joined #openstack-nova06:08
*** adrian_otto has joined #openstack-nova06:08
*** kamtamtun has quit IRC06:10
*** gaoyuan has joined #openstack-nova06:10
*** adrian_otto has quit IRC06:13
*** nmathew has joined #openstack-nova06:15
*** hoonetorg has quit IRC06:16
*** irenab_ has quit IRC06:19
*** bhagyashris has quit IRC06:21
*** fragatina has joined #openstack-nova06:22
*** bhagyashris has joined #openstack-nova06:22
*** irenab_ has joined #openstack-nova06:23
*** lucasxu has joined #openstack-nova06:25
prometheanfirethe nova_cell0 db creation was non-obvious, might want to update the ocata release notes / install guide06:25
prometheanfireworking now at least :D06:26
*** salv-orlando has joined #openstack-nova06:26
*** yuntongjin has quit IRC06:28
*** ducnc has quit IRC06:28
*** gaoyuan has quit IRC06:29
*** hoonetorg has joined #openstack-nova06:30
*** gaoyuan has joined #openstack-nova06:30
*** fragatina has quit IRC06:31
*** lpetrut has joined #openstack-nova06:31
*** nkrinner_afk is now known as nkrinner06:32
*** kornicameister has joined #openstack-nova06:33
prometheanfiredocs don't mention placement being needed by compute hosts either06:33
*** gaoyuan_ has joined #openstack-nova06:33
*** gaoyuan__ has joined #openstack-nova06:34
*** gaoyuan_ has quit IRC06:35
*** gaoyuan__ has quit IRC06:35
*** yuntongjin has joined #openstack-nova06:37
*** gaoyuan has quit IRC06:37
*** gaoyuan has joined #openstack-nova06:37
gaoyuanwho is gorian06:41
*** kaisers_ has joined #openstack-nova06:42
*** ltomasbo|away is now known as ltomasbo06:42
*** andreas_s has joined #openstack-nova06:44
*** mjura has joined #openstack-nova06:45
prometheanfirewhat port does placement go on by default?06:48
*** prateek_ has quit IRC06:49
*** prateek has quit IRC06:49
*** prateek__ has quit IRC06:49
*** sridharg has quit IRC06:50
*** prateek has joined #openstack-nova06:50
*** rcernin has joined #openstack-nova06:51
*** thorst has joined #openstack-nova06:52
*** salv-orl_ has joined #openstack-nova06:52
*** lucasxu has quit IRC06:54
*** salv-orlando has quit IRC06:55
*** thorst has quit IRC06:56
*** Oku_OS-away is now known as Oku_OS07:00
*** sridharg has joined #openstack-nova07:02
*** namnh has joined #openstack-nova07:04
*** yamamoto has quit IRC07:07
*** jaosorior has joined #openstack-nova07:09
*** kaisers_ has quit IRC07:09
*** tesseract has joined #openstack-nova07:12
*** ducnc has joined #openstack-nova07:15
*** udesale has joined #openstack-nova07:18
*** ducttape_ has joined #openstack-nova07:19
*** amotoki has quit IRC07:20
*** ducttape_ has quit IRC07:23
*** salv-orl_ has quit IRC07:25
*** mnestratov has joined #openstack-nova07:27
*** claudiub has joined #openstack-nova07:29
*** claudiub|2 has joined #openstack-nova07:31
*** zhs has joined #openstack-nova07:33
*** amotoki has joined #openstack-nova07:34
*** claudiub has quit IRC07:34
*** yamahata has quit IRC07:38
*** yamamoto has joined #openstack-nova07:40
*** bhagyashris has quit IRC07:40
*** amotoki has quit IRC07:42
openstackgerritAndrey Volkov proposed openstack/nova master: live-mig: Add claims and proper resource tracking  https://review.openstack.org/24448907:43
openstackgerritAndrey Volkov proposed openstack/nova master: libvirt: pass libvirt reference methods to migration  https://review.openstack.org/32899707:43
openstackgerritAndrey Volkov proposed openstack/nova master: libvirt: live-migrate updates NUMA and cpus in the XML  https://review.openstack.org/28674407:43
*** edand has joined #openstack-nova07:44
Goriangaoyuan, just me - why ?07:45
Gorian374 people in this channel, and you are wondering why I am? :P07:46
*** dimtruck is now known as zz_dimtruck07:48
*** ralonsoh has joined #openstack-nova07:55
*** markus_z has joined #openstack-nova07:57
*** sree has quit IRC07:58
*** sree has joined #openstack-nova07:59
*** lpetrut has quit IRC08:02
*** kaisers_ has joined #openstack-nova08:05
openstackgerritMarkMielke proposed openstack/nova master: DiskFilter handling for free space less than zero  https://review.openstack.org/43009108:09
*** udesale has quit IRC08:10
*** udesale has joined #openstack-nova08:10
*** ducnc has quit IRC08:10
*** ducnc has joined #openstack-nova08:10
*** kaisers_ has quit IRC08:12
*** kaisers_ has joined #openstack-nova08:12
*** jschlueter has quit IRC08:20
*** salv-orlando has joined #openstack-nova08:24
openstackgerritMarkMielke proposed openstack/nova master: DiskFilter handling for free space less than zero  https://review.openstack.org/43009108:25
*** sridharg has quit IRC08:25
*** sridharg has joined #openstack-nova08:25
*** sridharg has quit IRC08:25
bauzasgood morning Nova08:27
*** sridharg has joined #openstack-nova08:27
*** unicell has quit IRC08:28
*** ijw has quit IRC08:28
*** ftersin has joined #openstack-nova08:29
*** ijw has joined #openstack-nova08:30
*** amotoki has joined #openstack-nova08:32
*** nmathew- has joined #openstack-nova08:32
*** GnomeKing has quit IRC08:34
openstackgerritMoshe Levi proposed openstack/nova master: [WIP] OVS acceleration  https://review.openstack.org/39826508:34
*** nmathew has quit IRC08:35
*** nmathew has joined #openstack-nova08:35
*** nmathew- has quit IRC08:35
*** romainh has joined #openstack-nova08:37
ftersinjohnthetubaguy: hi. could you please look at https://review.openstack.org/#/c/304715/ , i tried to address your comments, but not sure the result is what you wanted, since you didn't answer on my questions there08:39
johnthetubaguyftersin: we discussed at the PTG adding a cinder ephemeral disk driver, would that work for you?08:43
*** jpena|away is now known as jpena08:46
ftersinjohnthetubaguy: it will consume volumes which will be a bit different than running instances w/o cinder at all08:49
*** ducttape_ has joined #openstack-nova08:49
johnthetubaguyftersin: the user's Nova API calls would be identical, its just the code creating the disks would create volumes in Cinder.08:50
*** romainh has quit IRC08:51
ftersinjohnthetubaguy: moreover, that solution is just discussed, but not implemented yet. From the other side we have that solution, which is implemented for previous OS versions as well, and integrated to JuJu and Fuel via corresponding charms/plugins08:51
*** romainh1 has joined #openstack-nova08:51
*** romainh1 has quit IRC08:51
*** romainh has joined #openstack-nova08:52
*** yuntongjin has quit IRC08:52
*** ducttape_ has quit IRC08:53
johnthetubaguyftersin: the problem is if we added it, we would want to deprecate it as soon as we landed the Cinder one, and create some kind of transition system, etc, so we didn't have to keep maintaining the extra code for each and every Cinder backend twice.08:53
openstackgerritAlex Xu proposed openstack/nova-specs master: The ResourceProviderTraits API - Manage traits with ResourceProviders  https://review.openstack.org/34513808:54
ftersinjohnthetubaguy: do you want to deprecate Ceph backend as well?08:54
johnthetubaguyftersin: honestly my preference is to also deprecate the local volume support, but I totally need to talk to mdbooth about that08:55
johnthetubaguymy local volume, I mean LVM08:55
*** slaweq__ has quit IRC08:55
johnthetubaguyftersin: that way, cinder manages storage, neutron manages networking, life is simpler08:56
ftersinjohnthetubaguy: i agree with the deprecation of LVM, but what for Ceph? it's used widely08:56
johnthetubaguyftersin: I mean all ephemeral storage including ceph, transition it to cinder08:57
johnthetubaguyftersin: if thats not possible, I would like to understand why08:57
*** amoralej|off is now known as amoralej08:58
johnthetubaguyftersin: at this point, thats all totally my current preference, rather than any kind of consenus from the PTG08:58
*** jpena is now known as jpena|away08:58
*** slaweq__ has joined #openstack-nova08:59
ftersinjohnthetubaguy: well, then you'll need a transition procedure. It will affects more than one backend, so it's not a big problem if there will be 2 or 3 such backends08:59
*** zzzeek has quit IRC09:00
ftersinIt's OK for us. We'll be deprecated along with Ceph09:00
johnthetubaguyftersin: but each transition would be specific to the backend, for sure09:00
*** zzzeek has joined #openstack-nova09:00
*** hoangcx has left #openstack-nova09:00
johnthetubaguyi.e. adding more drivers now means a lot more work later09:00
*** alex_xu has quit IRC09:01
*** ralonsoh has quit IRC09:01
*** alex_xu has joined #openstack-nova09:02
johnthetubaguyftersin: now if we sit down, and getting the cinder support is cycles and cycles away, clearly thats not the right way to go, I just think we don't have enough info to make that call right now09:02
ftersinmore checks, probably. But anyway you'll have to develop a pretty common transition system (at least to commonize lvm and ceph things), so it will be not very big extra work to additionaly support another driver there09:02
johnthetubaguyftersin: in my head the hard bit is "import" volume into Cinder, which feels like its going to be specific to each platform, the common bit is just the loop to call that function for each disk on the system in init_host, but I could be missing something09:04
ftersinunder 'that call' you mean the switching to Cinder backend or adding new volume based backends?09:04
johnthetubaguyI mean working out how to "move" the volume from being managed by Nova to being managed by Cinder, I think though using this call somehow: https://developer.openstack.org/api-ref/block-storage/v2/index.html?expanded=manage-existing-volume-detail#manage-existing-volume09:05
*** zerda3 has joined #openstack-nova09:06
*** jpena|away is now known as jpena09:06
ftersinbut you'll not need to acquire all volumes, only used for local disks. At the first glance the only not common thing is to fill connection strings09:08
johnthetubaguyftersin: filling in the "ref" parameter worries me I guess, and ensuring each backend supports that cinder API in the same way09:09
johnthetubaguyftersin: I think the action here is to discuss the cost of this all in the alternatives section in the spec. Just a few sentences, thats all, to show it has been considered09:10
ftersinsure, each volume driver in Nova can compose a new connection string to attach a volume. But if they can to compose the string for attached volumes?09:11
johnthetubaguyftersin: yeah, maybe thats not as bad as I think it is. I didn't discover that cinder API till just now, which makes me worry a little bit less09:14
ftersinjohnthetubaguy: ok, i may add a consideration of Cinder backend alternative. Do you have a link to appropriate discussion or the result docs or smth else?09:14
johnthetubaguyftersin: good question, I think jgriffith was taking the action on that one, I am hoping to see a nova-spec from him around that09:15
*** tovin07 has quit IRC09:15
*** karimb has joined #openstack-nova09:16
sfinucanmriedem_away: https://review.openstack.org/#/c/412390/09:19
sfinucanmriedem_away: I /did/ deprecate firewall_driver :) (along with pretty much everything else nova-network'y - https://review.openstack.org/#/q/topic:bp/centralize-config-options-pike+owner:%22Stephen+Finucane+%253Csfinucan%2540redhat.com%253E%22+status:open)09:20
sfinucantonyb: What are we celebrating? :)09:20
*** yamamoto has quit IRC09:24
*** yuntongjin has joined #openstack-nova09:24
ftersinjohnthetubaguy: well, i'll try to monitor gerrit for that, or ask him. Right now i'm going to add that alternative to the spec and reupload it. Is it ok for you?09:24
johnthetubaguyftersin: that sounds perfect, thank you09:24
*** hshiina has joined #openstack-nova09:27
ftersinjohnthetubaguy: thank you too09:28
*** lucas-afk is now known as lucasagomes09:28
*** vishwanathj has quit IRC09:30
*** vishwanathj has joined #openstack-nova09:31
*** yingjun has quit IRC09:31
openstackgerritsahid proposed openstack/nova master: numa: add numa constraints for emulator threads policy  https://review.openstack.org/38502309:31
openstackgerritsahid proposed openstack/nova master: libvirt: return a CPU overhead if isolate emulator threads requested  https://review.openstack.org/38536409:31
openstackgerritsahid proposed openstack/nova master: numa: fit instance topology with cpus reserved onto cores  https://review.openstack.org/40087509:31
openstackgerritsahid proposed openstack/nova master: virt: update overhead to take into account vCPUs  https://review.openstack.org/38502409:31
openstackgerritsahid proposed openstack/nova master: libvirt: make emulator threads to run on the reserved pCPU  https://review.openstack.org/40087809:31
openstackgerritsahid proposed openstack/nova master: numa: take into account cpus reserved  https://review.openstack.org/40087609:31
openstackgerritsahid proposed openstack/nova master: numa: update numa usage incording the cpu reserved  https://review.openstack.org/40087709:31
*** ociuhandu has joined #openstack-nova09:32
*** ijw has quit IRC09:34
*** ociuhandu has quit IRC09:36
gmannalex_xu:  johnthetubaguy I would not be available for today meeting due to other works.09:37
alex_xugmann: got it09:38
*** derekh has joined #openstack-nova09:41
*** nmathew has quit IRC09:43
*** nmathew has joined #openstack-nova09:43
*** karimb has quit IRC09:45
openstackgerritAlfredo Moralejo proposed openstack/nova master: Remove domains *-log-* from compile_catalog  https://review.openstack.org/43950009:47
tonybsfinucan: the merge of your pbr patch ... and then it all went horribly wrong09:47
sfinucantonyb: oh, do tell09:48
openstackgerritAlfredo Moralejo proposed openstack/nova master: Remove domains *-log-* from compile_catalog  https://review.openstack.org/43950009:48
bauzastonyb: not sure I fully understood the pbr major version potential problem you raised09:49
*** ducttape_ has joined #openstack-nova09:50
*** carthaca_1 has quit IRC09:51
*** sapcc-bot1 has quit IRC09:51
tonybsfinucan: It seems a few projects (in and out of OpenStack) have defensive caps on pbr < 2.0.0 so we're stuck until they get fixed09:52
*** databus23_ has joined #openstack-nova09:52
*** carthaca_ has joined #openstack-nova09:52
*** dgonzalez_ has joined #openstack-nova09:52
*** tpatzig_ has joined #openstack-nova09:52
*** david_1 has joined #openstack-nova09:52
openstackgerritJohn Garbutt proposed openstack/nova-specs master: Backlog spec describing Nova's quota needs  https://review.openstack.org/42967809:52
tonybbauzas: it *shoudln't* affect nova but projects under Telemtry will be a little broken until we fix the pbr thing (or they land a local patch)09:52
johnthetubaguytonyb: I meant to ping you about that spec on capabilties, although sounds like you are busy with other fires09:53
prometheanfirewas there any docs made for the install guide for setting up the placement api?09:53
*** databus23_ has quit IRC09:54
*** tpatzig_ has quit IRC09:54
*** dgonzalez_ has quit IRC09:54
*** david_1 has quit IRC09:54
*** sapcc-bot has joined #openstack-nova09:54
tonybjohnthetubaguy: I hope they'll be damped by tomorrow, so I shoudl be able to focus on it tomorrow09:54
prometheanfirebecause https://docs.openstack.org/developer/nova/placement.html seems kinda lacking, for instance, doesn't say what port it's running on09:54
*** ducttape_ has quit IRC09:54
johnthetubaguyprometheanfire: yeah, I was just going to point to https://docs.openstack.org/developer/nova/placement.html#deployment09:55
johnthetubaguytonyb: coolness09:55
*** mkrai_ has quit IRC09:55
bauzastonyb: okay, thanks for the feeback09:55
tonybprometheanfire: check devstack or wit for the docs install guide09:55
johnthetubaguyprometheanfire: basically its done the same way keystone is deployed, so the port etc is defined by mod_wsgi, etc09:55
johnthetubaguyprometheanfire: and +1 tonyb, devstack shows how thats done, to some extent09:56
johnthetubaguyprometheanfire: jaypipes would know more of the doc plan when he comes online later today09:56
prometheanfiretonyb: I'm actually checking osa first :P09:57
*** carthaca_ has quit IRC09:57
*** sapcc-bot has quit IRC09:57
*** david_1 has joined #openstack-nova09:57
*** databus23_ has joined #openstack-nova09:57
*** carthaca_ has joined #openstack-nova09:57
*** sapcc-bot has joined #openstack-nova09:57
*** dgonzalez_ has joined #openstack-nova09:57
*** tpatzig_ has joined #openstack-nova09:57
tonybprometheanfire: fair enough09:57
*** andreas_s has quit IRC09:57
prometheanfirethough osa has it as optional09:57
johnthetubaguyprometheanfire: yeah, I walked through that with OSA, so it should be there now09:57
prometheanfireand it's not :P09:57
johnthetubaguyprometheanfire: I thought they had updated that for this cycle, I guess not09:58
johnthetubaguyby this I mean ocata09:58
*** iceyao has quit IRC09:58
prometheanfireright09:58
johnthetubaguyandymccr: did you make placement api required yet in OSA ^09:58
prometheanfiremaybe it's meant to only be configured on certian nodes09:58
prometheanfirejohnthetubaguy: so... what's the default port for it?09:59
*** david_1 has quit IRC09:59
*** databus23_ has quit IRC09:59
*** dgonzalez_ has quit IRC09:59
*** tpatzig_ has quit IRC09:59
prometheanfirelike nova has a default port09:59
johnthetubaguyprometheanfire: looking here https://github.com/openstack-dev/devstack/blob/55dab95237302fa371b88a2edce06de201d83f52/files/apache-placement-api.template bauzas might be able to help09:59
johnthetubaguyprometheanfire: placement doesn't have a default port, just like keystone, AFAIK09:59
prometheanfire8780, thanks :D09:59
bauzasprometheanfire: johnthetubaguy: sorry, on meeting atm09:59
johnthetubaguyoh, I guess that kinda is the default09:59
prometheanfirekeystone isn't 5000 / 35357 ?10:00
johnthetubaguywell, in theory, none of that matters, you just get the URL from the service catalog10:00
prometheanfireI know it can be discovered, but it's nice to be consistant :P10:00
*** yuntongjin has quit IRC10:01
johnthetubaguyprometheanfire: actually looks like us and keystone might be on 443, technically, https://github.com/openstack-dev/devstack/blob/55dab95237302fa371b88a2edce06de201d83f52/files/apache-keystone.template10:01
johnthetubaguyprometheanfire: but I am not sure10:01
andymccrjohnthetubaguy: it's on by default - originally i set it up with a flag but i will probably remove that flag10:01
prometheanfireandymccr: cool, was confused about that :D10:01
johnthetubaguyandymccr: ah, cool, that makes sense, just a transition thing10:01
andymccrprometheanfire: yeah i wanted to set it up prior to it being required and never got it going - and then didn't remove the flag :P10:02
andymccrbut yeah it should go now10:02
andymccreither way if you dont force it off - it gets set up10:02
prometheanfirejohnthetubaguy: I think it's also on 443 in devstack, but primarily on PUBLICPORT/ADMINPORT10:02
johnthetubaguyyeah, that makes sense10:03
*** Dinesh_Bhor has joined #openstack-nova10:03
*** lpetrut has joined #openstack-nova10:03
*** karimb has joined #openstack-nova10:05
andymccrprometheanfire: there is a discussion about the default ports on the mailing list - essentially there is no default the idea is you use port 80/443 - but we needed one for our backend since we dont have it setup to do that at this point.10:05
andymccrso we went with what the tripleo/puppet people had to keep it at least default in that regard10:05
prometheanfireya  +nova_placement_service_port: 878010:06
*** asettle has joined #openstack-nova10:06
*** diga has quit IRC10:06
*** andreas_s has joined #openstack-nova10:11
*** kevinz has quit IRC10:12
*** mvk has quit IRC10:12
*** gongysh has quit IRC10:17
openstackgerritBéla Vancsics proposed openstack/nova master: Remove unused variable  https://review.openstack.org/43951610:18
*** phuongnh has quit IRC10:18
*** iceyao has joined #openstack-nova10:18
*** ralonsoh has joined #openstack-nova10:20
*** aloga has quit IRC10:21
*** yamamoto has joined #openstack-nova10:21
*** zhs has quit IRC10:22
openstackgerritLee Yarwood proposed openstack/nova master: objects: Add attachment_id to BlockDeviceMapping  https://review.openstack.org/43766510:23
*** zhs has joined #openstack-nova10:23
openstackgerritLee Yarwood proposed openstack/nova master: db: Add attachment_id to block_device_mapping  https://review.openstack.org/43759710:23
openstackgerritLee Yarwood proposed openstack/nova master: Make BlockDeviceMapping object support uuid  https://review.openstack.org/24260310:23
openstackgerritLee Yarwood proposed openstack/nova master: Add uuid column to BlockDeviceMapping  https://review.openstack.org/24260210:23
openstackgerritLee Yarwood proposed openstack/nova master: WIP compute: Move detach logic into driver BDM  https://review.openstack.org/43952010:23
*** iceyao has quit IRC10:23
*** pcaruana has joined #openstack-nova10:24
*** yamamoto has quit IRC10:25
*** aloga has joined #openstack-nova10:27
johnthetubaguybauzas: do you know the plans around updating install docs for placement? asettle might start chasing you about that :)10:27
johnthetubaguymriedem_away might be able to co-ordinate the doc update efforts for asettle, as I guess the cells stuff probably needs adding too10:27
*** ftersin has quit IRC10:28
prometheanfirejohnthetubaguy: yep, that was missing as well10:28
*** Jeffrey4l has quit IRC10:30
*** cdent has joined #openstack-nova10:30
*** sridharg has quit IRC10:30
asettlebauzas and mriedem_away - context, the docs here: https://docs.openstack.org/ocata/install-guide-obs/nova.html are out of date and missing some key elements10:30
*** alex_xu has quit IRC10:31
asettleWe'll need to ensure that in future the docs are being updated with each release10:31
johnthetubaguyasettle: I suspect for many thinks will have to wait until the packages are updated after the release, but getting ahead of that can't halm10:33
*** alex_xu has joined #openstack-nova10:33
asettleYeah, so, in theory you shouldn't have to wait until the packages are updated. Especially if the nova changes in question have nothing ot do with distro packages10:34
*** ijw has joined #openstack-nova10:35
bauzasasettle: johnthetubaguy: sorry, was in meeting10:36
bauzashow can I help ?10:36
johnthetubaguyinstall docs are out of date10:36
johnthetubaguyfor placement-api10:36
johnthetubaguy(and cells stuff actually)10:37
asettlebauzas: documentation for the nova portion of the install guide requires updates. ARe there plans to get this updated, or is there someone we can work with to get this updated?10:37
*** slaweq_ has joined #openstack-nova10:38
*** ijw has quit IRC10:41
bauzaslooks like a huge knowledge transfer to do10:41
bauzasasettle: we have a couple of dev docs that are intended to be user-facing tho10:42
*** mvk has joined #openstack-nova10:44
asettlebauzas: if you already have the dev docs, are there any plans to move them and improve on the install guide?10:44
*** mvk has quit IRC10:45
*** alex_xu has quit IRC10:45
*** sambetts|afk is now known as sambetts10:45
*** mvk has joined #openstack-nova10:45
*** alex_xu has joined #openstack-nova10:46
bauzasasettle: well, I did contributed to some docs repo a while ago, but it's a very long story :)10:47
prometheanfireandymccr: still need that mail?10:47
prometheanfireasettle: ^10:47
asettleHhahaa bauzas I'd be interested to know how it went - if it was bad, we gotta improve, all that et etc10:47
asettleprometheanfire: mail?!10:47
prometheanfirebad tab complete10:47
prometheanfireto the list10:47
bauzasasettle: well, it was 2013, and it went well :)10:48
prometheanfirethought I was in doc channel, been a long day...10:48
asettleprometheanfire: ummm I don't think so :) thank you hahhaha go to bed dude10:48
prometheanfire:D10:48
asettlebauzas: well that's good! Okay, well. Let's get a bit of an action plan together to get these docs updated.10:48
prometheanfirenn10:48
*** Jeffrey4l has joined #openstack-nova10:49
asettleI am probably going to email out to everyone who is a docs liaison to ensure these docs are being updated continuously each release10:49
asettleSeems to be a bit of a problem10:49
johnthetubaguyasettle: we did talk about getting a new person to take that on10:49
johnthetubaguyasettle: the api stuff is all up to date now, we do that when new APIs land10:49
*** tbachman has joined #openstack-nova10:50
johnthetubaguywell, apart form the concept guide, I mean api-ref10:50
johnthetubaguyasettle: but totally need someone to own the install docs10:50
asettlejohnthetubaguy: I would agree. Who is PTL of nova? (pardon my ignorance) we need to reach out and get this organised :)10:51
*** ducttape_ has joined #openstack-nova10:51
*** zhs has quit IRC10:51
asettlejohnthetubaguy: do we have any OSIC people who would be good for the job? I know they've done that in keystone and glance.10:51
bauzasasettle: FYI, most of the user/deployer notes for placement can be found in https://docs.openstack.org/developer/nova/placement.html10:51
openstackgerritMoshe Levi proposed openstack/nova master: [WIP] OVS acceleration  https://review.openstack.org/39826510:52
asettlebauzas: okay cool :) what's good to know is that it's there, and that we're not creating something out of thin air10:52
*** markus_z has quit IRC10:52
openstackgerritTimofey Durakov proposed openstack/python-novaclient master: Deperecate cell_name cli arg for migration-list  https://review.openstack.org/43914110:52
bauzasasettle: for cells v2, deployer instructions are in https://docs.openstack.org/developer/nova/cells.html#setup-of-cells-v210:52
*** thorst has joined #openstack-nova10:53
asettlebauzas: again, good news. A knowledge transfer should be fairly straight forward from here.10:54
*** ijw has joined #openstack-nova10:54
*** ducttape_ has quit IRC10:55
johnthetubaguyasettle: lots of that evolved from the OSA feedback too, its just that last (all important) step thats needed really10:56
asettlejohnthetubaguy: even better.10:57
asettleRegardless, I think we need to have a better review process at the end of each release.10:57
*** thorst has quit IRC10:58
*** bhagyashris has joined #openstack-nova10:59
*** erlon has joined #openstack-nova10:59
*** ijw has quit IRC10:59
*** prometheanfire has left #openstack-nova11:00
*** sdague has joined #openstack-nova11:01
*** esberglu has joined #openstack-nova11:01
mdboothlyarwood johnthetubaguy: multipath11:02
mdboothIs nova ever going to model multipath as multiple attachments, or only as a single multipath attachment?11:02
* mdbooth guesses the latter, but is going to ask anyway11:03
*** nicolasbock has joined #openstack-nova11:04
*** cdent has quit IRC11:05
johnthetubaguymdbooth: I was assuming a single attachment, but its a good question11:05
*** esberglu has quit IRC11:06
lyarwoodmdbooth: I would also say single, why?11:06
sfinucantonyb: Couldn't find logs/emails about that issue :/ Anywho, we're stuck with Sphinx 1.3.6 you mean?11:07
*** amotoki has quit IRC11:07
mdboothlyarwood: Just trying to think of problems which would be hard to fix11:07
tonybsfinucan: for a little longer11:07
sfinucantonyb: Darn.11:08
tonybsfinucan: http://lists.openstack.org/pipermail/openstack-dev/2017-March/113085.html11:08
sfinucantonyb: Just for context, why can't we use pbr (and where can't we use it) if it's been capped in some projects11:10
* sfinucan is not fully up to speed on how OpenStack does global requirements11:10
tonybsfinucan: that's cool it's a little complex11:10
*** tovin07 has joined #openstack-nova11:11
*** sean-k-mooney has quit IRC11:11
tonybsfinucan: upper-constraints.txt os a list of every python library need by some part of OpenStack that we knwo works (at least installs) together11:12
tonybsfinucan: and all nice projects (such as nova) install *only taht version11:12
tonybsfinucan: sadly when we try to set the version of pbr === 2.0.0 in u-c.txt there are a small number of libraries that can't be installed11:13
*** amotoki has joined #openstack-nova11:13
tonybsfinucan: and therefore no part of OpenStack can use that version until they all agree that 2.0.0 is ok11:13
tonybsfinucan: upper-constraints.txt does a bunch of other things but it's beyond my ability to expalin on IRC late at night (for me)11:14
sfinucantonyb: ahhh, gotcha11:14
tonybsfinucan: there are reviews and PRs out to move the ball forward so we'll see how quickly they land and then we can take the next step11:15
*** udesale has quit IRC11:16
sfinucantonyb: Perfect. Any topic I can look at?11:16
sfinucanThrow a few reviews in11:16
*** romainh1 has joined #openstack-nova11:16
tonybsfinucan: https://review.openstack.org/#/q/topic:bug/166884811:16
*** owalsh-afk is now known as owalsh11:17
sfinucantonyb: fwiw, I'm pretty sure this has been said many times but you can't bump Sphinx until everything is using pbr 2.0, because 1.10 is broken with Sphinx 1.511:17
sfinucantonyb: Spot on. Thanks11:17
*** udesale has joined #openstack-nova11:18
tonybsfinucan: right.11:18
*** romainh has quit IRC11:18
sfinucantonyb: That also would suggest we should be bumping pbr to 2.0, perhaps?11:19
sfinucanor at least blacklisting 1.1011:19
tonybsfinucan: Yeah we'll set the minimum to 2.0.0 once if tested it a bit11:20
sfinucantonyb: Cool. Could we blacklist 1.10 also though? Allows us to start using Sphinx 1.511:21
sfinucan(eventually)11:21
tonybsfinucan: Yeah we could11:21
sfinucanOK. Guess that can be done later though11:22
*** tbachman has quit IRC11:22
*** namnh has quit IRC11:23
*** prateek has quit IRC11:24
*** yamamoto has joined #openstack-nova11:26
*** ratailor has quit IRC11:30
*** nmathew has quit IRC11:30
*** yamamoto has quit IRC11:32
*** mvk has quit IRC11:32
kevinbentonjohnthetubaguy: how is your metadata-fu?11:34
johnthetubaguykevinbenton: rusty, but whats up?11:35
kevinbentonjohnthetubaguy: debugging a failure i observed in the gate11:35
kevinbentonjohnthetubaguy: one of the cirros VMs is not getting an SSH key11:35
johnthetubaguyoh, interesting, almost like its fetching metadata before the ssh key is present in the metadata service11:35
johnthetubaguywas it using config drive or not?11:36
kevinbentonjohnthetubaguy: no config drive11:36
kevinbentonjohnthetubaguy: just metadata11:36
kevinbentonjohnthetubaguy: i traced the request all of the way to nova API11:36
kevinbentonjohnthetubaguy: but the debug logs there aren't very helpful11:36
johnthetubaguyah, cool, you got a link to those11:36
*** amotoki has quit IRC11:36
kevinbentonjohnthetubaguy: http://logs.openstack.org/27/436427/2/gate/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/2f3e394/logs/screen-n-api.txt.gz11:36
johnthetubaguyat least the request got there, that was my main question11:36
kevinbentonjohnthetubaguy: request-id in question is req-93182a9d-baa9-4cf5-8648-aa9c4a4950011:37
* johnthetubaguy waits for browser to load the log or die11:37
kevinbentonjohnthetubaguy: whatever it is returning there is making cirros think there is nothing further so it doesn't continue on to query the openssh url for the actual keys11:37
*** yamamoto has joined #openstack-nova11:38
kevinbentonjohnthetubaguy: a good request ID in the same tenant and behind the same router is req-ff83fad3-86cc-4097-aa6e-538c6889eae211:39
kevinbentonjohnthetubaguy: would digging up the corresponding instance IDs be helpful?11:39
johnthetubaguynot sure that helps in the logs, I guess it would let you find the create instance requests etc, int he compute logs which would have a hint11:40
johnthetubaguykevinbenton: this is one of those cases where we just get ssh didn't work errors right?11:40
kevinbentonjohnthetubaguy: well in this case it's explicit authentication failures11:40
johnthetubaguyah, right, that makes sense11:40
kevinbentonjohnthetubaguy: 2017-02-28 11:48:29,144 12602 INFO     [paramiko.transport] Authentication (publickey) failed.11:41
*** smatzek has joined #openstack-nova11:41
*** trinaths has quit IRC11:42
*** yamamoto has quit IRC11:42
*** tbachman has joined #openstack-nova11:42
*** smatzek has quit IRC11:43
*** tbachman has quit IRC11:43
kevinbentongood instance ID is 747e048111:43
*** tbachman has joined #openstack-nova11:43
*** smatzek has joined #openstack-nova11:43
johnthetubaguykevinbenton: maybe finding the server_id here will help, looks like the bad one was 31ca7a58-2a91-4893-bcb0-7c457023f6a111:43
*** romainh1 has quit IRC11:44
*** tbachman has quit IRC11:44
*** smatzek_ has joined #openstack-nova11:44
*** smatzek has quit IRC11:44
kevinbentonaye11:44
johnthetubaguykevinbenton: oh right, I see GET /2009-04-04/meta-data/public-keys/0/openssh-key11:44
*** mvk has joined #openstack-nova11:44
kevinbentonjohnthetubaguy: so in the bad case whatever that first one is returning is telling it no keys11:45
johnthetubaguyyeah, it seems it must be11:45
kevinbentonis the preparation of the metadata asynchronous?11:46
johnthetubaguyI think it should be all before the instance boots11:47
johnthetubaguybut I am wondering that now too11:47
*** yamamoto has joined #openstack-nova11:47
*** yamamoto has quit IRC11:48
johnthetubaguykevinbenton: so the ssh key is in the compute logs11:51
johnthetubaguykevinbenton: 2017-02-28 11:47:44.387 5448 DEBUG nova.virt.libvirt.vif [req-b43e28a2-6040-4273-b21f-cfe8ac5f7fb6 tempest-TestGettingAddress-1009203826 tempest-TestGettingAddress-1009203826] vif_type=bridge instance=11:52
*** ducttape_ has joined #openstack-nova11:52
johnthetubaguyincludes uuid=31ca7a58-2a91-4893-bcb0-7c457023f6a111:52
johnthetubaguyand11:52
johnthetubaguykey_name='tempest-TestGettingAddress-1661300941'11:52
johnthetubaguyit was a key_pair generated by nova, apparently11:52
johnthetubaguyso I assume temptest is correctly remembering the new key11:53
johnthetubaguyalthough clearly its not fetching it, so thats kinda irrelavant11:53
*** sandanar has quit IRC11:54
*** CristinaPauna has quit IRC11:54
kevinbentonjohnthetubaguy: it seems we may be short on some relevant debug logs in the attempted key lookup in n-api11:54
*** CristinaPauna has joined #openstack-nova11:55
johnthetubaguylooks like the good one had key_name='tempest-TestGettingAddress-1661300941'11:55
johnthetubaguystrange11:55
johnthetubaguykevinbenton: yeah, its probably worth adding that11:55
kevinbentonjohnthetubaguy: can you point me to that code and i'll push up a patch?11:55
sdaguekevinbenton: yeh, it's actually a seperate wsgi handler11:55
*** edand has quit IRC11:55
johnthetubaguykevinbenton: yeah, I think thats here: https://github.com/openstack/nova/blob/master/nova/api/metadata/base.py#L27311:56
*** ijw has joined #openstack-nova11:56
johnthetubaguysdague: seems like its handled in process in this gate job though11:56
sdaguejohnthetubaguy: ... no exactly11:56
sdaguenot exactly11:56
kevinbentonha! https://github.com/openstack/nova/blob/master/nova/api/metadata/base.py#L28411:57
sdagueour n-api has the ability to run multiple worker pools11:57
*** andreas_s has quit IRC11:57
johnthetubaguysdague: good point11:57
kevinbentonsdague: will that present an issue with logging statements?11:57
*** ducttape_ has quit IRC11:57
sdaguekevinbenton: no, it's all going through a dedicated logger. It's kind of no different than other pools11:57
kevinbentonakc11:58
kevinbentonack*11:58
kevinbentonI think very few of our jobs use metadata so the poor linux bridge job is the canary in the coal mine11:58
sdaguehonestly, it would probably be a sensible long term move to make this always stand on it's own and run on it's own11:58
sdaguebut I take it that the growth of multiple apis servered from one system came from ec2 days11:59
asettlejohnthetubaguy: so, who should I be emailing for docs stuff for now? :)11:59
johnthetubaguyasettle: unsure, mriedem_away is the best person to ask about that12:00
asettleYikes, haha, okay, we need to fix that12:00
johnthetubaguysdague: certainly worth doing when we shift to uwsgi or whatever it is12:00
*** ijw has quit IRC12:01
sdaguethere is a mode to run it dedicated today12:01
johnthetubaguyack12:01
sdagueI don't know if that would be less confusing if we defaulted that mode12:01
sdagueAlso, while this code path never seems to be hit, the caching by remote IP address in here scares me12:01
sdaguegiven that is recycled12:02
sdaguehttps://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/metadata/handler.py#L56-L7412:02
kevinbentonsdague: ouch12:03
kevinbentonsdague: oh, we shouldn't hit that though12:03
kevinbentonsdague: we should be in this branch https://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/metadata/handler.py#L101-L10512:03
sdagueright, like I said, i don't see any instances of it12:03
sdagueit just makes me nervous in looking at the code12:03
kevinbentonthis may be quite prevalent12:05
kevinbentonhttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22(Error%20reading%20SSH%20protocol%20banner).%20Number%20attempts%3A%2016%5C%2212:05
johnthetubaguykevinbenton: what job is this?12:07
johnthetubaguyoh wait, I can read12:07
kevinbenton:)12:07
johnthetubaguykevinbenton: I was checking when the keypair is added into the DB, its really early now: https://github.com/openstack/nova/blob/master/nova/compute/api.py#L98112:08
johnthetubaguys/now//12:08
johnthetubaguybasically its in the instance from the first DB save12:09
openstackgerritTimofey Durakov proposed openstack/python-novaclient master: Deperecate cell_name cli arg for migration-list  https://review.openstack.org/43914112:10
*** andreas_s has joined #openstack-nova12:10
johnthetubaguykevinbenton: I have to run to get some lunch, but hopefully there are some micro leads there12:11
johnthetubaguysdague: in case its useful, I wrote up my quota notes here: https://review.openstack.org/#/c/42967812:11
*** gszasz has joined #openstack-nova12:11
johnthetubaguysdague: did a quick post PTG refresh, but its mostly just thoughts I put together before the PTG12:11
*** romainh has joined #openstack-nova12:12
sdaguekevinbenton: if you are patching in logging, probably worth adding a dump of what InstanceMetadata looks like before it's returned, maybe we would find some missing bits in there12:13
openstackgerritKevin Benton proposed openstack/nova master: Add some metadata logging to root cause ssh failure  https://review.openstack.org/43956012:13
kevinbentonsdague: can you leave a comment on that of where i should do that? ^^12:14
sdagueyeh, let me go look12:14
*** dave-mccowan has joined #openstack-nova12:14
*** markus_z has joined #openstack-nova12:15
sdaguekevinbenton: so it's in the other file, let me send a git link12:15
sdaguehttps://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/metadata/handler.py#L30612:16
sdagueI would put a log debug of that data structure before we return it12:16
*** sridharg has joined #openstack-nova12:17
*** romainh has quit IRC12:17
*** romainh has joined #openstack-nova12:18
*** lucasagomes is now known as lucas-hungry12:18
*** kevinz has joined #openstack-nova12:18
*** aysyd has joined #openstack-nova12:18
kevinbentonsdague: ack12:18
*** kevinz has quit IRC12:18
kevinbentonsdague: i also filed an E-R query here https://review.openstack.org/43956212:18
*** alex_xu has quit IRC12:18
sdagueonce that is posted I'll +2, we can get johnthetubaguy to +2 after his lunch, and at least hopefully see some of this in the future12:19
*** sridharg has quit IRC12:19
sdaguekevinbenton: we should wait for mriedem_away / mtreinish for that banner error issue, because I have this vague recolection of things like paramiko lying to us about the real issue on thing like that12:20
sdaguebut maybe they remember the deal12:20
kevinbentonsdague: ack12:20
*** sridharg has joined #openstack-nova12:20
*** bvanhav has joined #openstack-nova12:20
openstackgerritKevin Benton proposed openstack/nova master: Add some metadata logging to root cause ssh failure  https://review.openstack.org/43956012:21
kevinbentonsdague: ^^12:21
*** amotoki has joined #openstack-nova12:21
*** karimb has quit IRC12:23
*** liverpooler has quit IRC12:24
sdaguekevinbenton: looks good, lets just wait for the test to run so we can see what this looks like in the main job12:25
kevinbentonsdague: ack12:25
sdagueI think the only thing I wonder is if InstanceMetadata has a reasonable repr :)12:25
*** alex_xu has joined #openstack-nova12:25
*** sree has quit IRC12:25
sdaguebut we'll find out12:25
kevinbenton<InstanceMetadata object at 0x38477827>12:27
kevinbentonwhat's not to love? :012:27
sdague:)12:27
kevinbentonit's just a dict isn't it?12:27
kevinbentonor is it a magical structured thing12:28
sdagueno, it's an object12:28
sdaguehttps://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/metadata/base.py#L11112:28
sdagueand, yeh, I'm not seeing a sane repr12:28
sdagueso... actually12:30
sdagueok, comment left on where we probably can dump the data and have it all12:31
kevinbentonok, so remove the one in handler.py then?12:32
kevinbentonsdague: ^^12:32
*** mdnadeem has quit IRC12:33
openstackgerritKevin Benton proposed openstack/nova master: Add some metadata logging to root cause ssh failure  https://review.openstack.org/43956012:34
*** moshele has quit IRC12:35
sdaguekevinbenton: yeh12:37
openstackgerritDao Cong Tien proposed openstack/nova master: Stop using mox int unit/virt/xenapi/image/test_utils.py  https://review.openstack.org/34262612:38
bhagyashrisalex_xu: Hi, I want to discuss regarding the backup api. Have a free time?12:38
openstackgerritTimofey Durakov proposed openstack/python-novaclient master: Deperecate cell_name cli arg for migration-list  https://review.openstack.org/43914112:43
*** yuntongjin has joined #openstack-nova12:43
*** edmondsw has joined #openstack-nova12:44
alex_xubhagyashris: hi, i'm here, actually we have api meeting after 15 mins, if that is ok for you, we can discuss it at meeting12:45
alex_xunova api meeting is in 15 mins at #openstack-meeting-412:45
*** thorst has joined #openstack-nova12:46
bhagyashrisalex_xu:  Is the backup api will be deprecate in future ?12:46
bhagyashrisalex_xu: ok.12:47
alex_xubhagyashris: I think it is useless, due to it totatlly can be impelmenet by client through the create-image api12:48
*** armax has joined #openstack-nova12:48
*** yamamoto has joined #openstack-nova12:49
*** dave-mccowan has quit IRC12:50
bhagyashrisalex_xu: ok. Is that will depcrecate in future release ? MEans just want to know about future plan.12:51
alex_xubhagyashris: no plan yet, no-one propose that yet. but maybe worth a talk in the api meeting today12:51
bhagyashrisalex_xu: ok. Thank you for information.12:52
alex_xubhagyashris: np12:53
*** ijw has joined #openstack-nova12:53
*** salv-orl_ has joined #openstack-nova12:53
*** yamamoto has quit IRC12:53
*** ducttape_ has joined #openstack-nova12:53
*** ijw_ has joined #openstack-nova12:55
*** ijw has quit IRC12:55
*** salv-orlando has quit IRC12:56
*** ijw_ has quit IRC12:56
*** prateek has joined #openstack-nova12:56
*** ijw has joined #openstack-nova12:56
bhagyashrisalex_xu: Actually I have submitted one patch https://review.openstack.org/#/c/409644/  regarding the backup rotation parameter change from 0 to 1 and got few comments , so just wanted to know about the future plan regarding backup api.12:57
*** ducttape_ has quit IRC12:58
*** ralonsoh_ has joined #openstack-nova12:58
alex_xubhagyashris: i see12:58
*** ijw_ has joined #openstack-nova12:59
*** amotoki has quit IRC13:00
*** ijw has quit IRC13:01
*** iceyao has joined #openstack-nova13:01
*** lucas-hungry is now known as lucasagomes13:01
*** ralonsoh has quit IRC13:01
bhagyashrisalex_xu: Thank you.13:01
*** jschlueter has joined #openstack-nova13:01
*** ijw_ has quit IRC13:04
openstackgerritStephen Finucane proposed openstack/nova master: tests: Validate huge pages  https://review.openstack.org/39965313:04
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: create functional test base class  https://review.openstack.org/40705513:04
*** iceyao has quit IRC13:05
*** tblakes has joined #openstack-nova13:06
*** ayogi has quit IRC13:06
*** salv-orl_ has quit IRC13:08
*** tbachman has joined #openstack-nova13:09
*** yuntongjin has quit IRC13:13
openstackgerritStephen Finucane proposed openstack/nova master: api-ref: body verification for os-hypervisors  https://review.openstack.org/39819713:13
*** yuntongjin has joined #openstack-nova13:14
*** jwcroppe has quit IRC13:19
openstackgerritTomi Juvonen proposed openstack/nova-specs master: Planned host maintenance  https://review.openstack.org/31051013:20
*** ducttape_ has joined #openstack-nova13:24
*** amoralej is now known as amoralej|lunch13:25
*** mjura has quit IRC13:26
*** mjura has joined #openstack-nova13:27
sfinucanjaypipes: Could you take a look at https://review.openstack.org/#/q/topic:sriov_numa_func_test+status:open again. Resolved a merge conflict due to the libvirt version bump13:28
sfinucanvladikr: You might be interested in ^ too. Touches code you wrote, afaict13:29
*** mvk has quit IRC13:29
*** liverpooler has joined #openstack-nova13:31
*** annegentle has joined #openstack-nova13:31
*** karimb has joined #openstack-nova13:33
*** jpena is now known as jpena|lunch13:34
*** mjura has quit IRC13:34
*** mjura has joined #openstack-nova13:35
*** hongbin has joined #openstack-nova13:36
*** bastafidli has joined #openstack-nova13:37
*** xyang1 has joined #openstack-nova13:39
*** gouthamr has joined #openstack-nova13:39
*** yingjun has joined #openstack-nova13:43
*** jschlueter has quit IRC13:44
*** yuntongjin has quit IRC13:46
*** yuntongjin has joined #openstack-nova13:46
*** GnomeKing has joined #openstack-nova13:47
*** GnomeKing is now known as BobBall13:47
*** bastafidli has quit IRC13:47
*** databus23_ has joined #openstack-nova13:49
*** tpatzig_ has joined #openstack-nova13:49
*** dgonzalez_ has joined #openstack-nova13:49
*** tommy_ has joined #openstack-nova13:49
*** tommy_ is now known as Guest8997113:49
*** zz_dimtruck is now known as dimtruck13:49
*** dgonzalez_ has quit IRC13:50
*** databus23_ has quit IRC13:50
*** Guest89971 has quit IRC13:50
*** tpatzig_ has quit IRC13:50
*** jwcroppe has joined #openstack-nova13:52
*** ijw has joined #openstack-nova13:57
*** yingjun has quit IRC13:58
*** sridharg has quit IRC13:58
*** yamamoto has joined #openstack-nova13:58
*** bvanhav_ has joined #openstack-nova13:59
*** tongli has joined #openstack-nova13:59
*** bvanhav has quit IRC13:59
*** bvanhav_ is now known as bvanhav13:59
*** amotoki has joined #openstack-nova14:00
*** zhurong has joined #openstack-nova14:00
alex_xujaypipes: dansmith, bauzas, I get a problem when implement the 'GET /traits/namespace' and 'GET /traits?namespace=*'. Those APIs leads to placement API still need to import os-traits lib. So is it ok that we create db table for namespace, and sync namespace from os-trait into db by 'placement-manage' also?14:01
*** ijw has quit IRC14:02
*** tongli has quit IRC14:03
*** tongli has joined #openstack-nova14:03
*** jschlueter has joined #openstack-nova14:03
*** yamamoto has quit IRC14:04
*** mdrabe_ has joined #openstack-nova14:05
*** yingjun has joined #openstack-nova14:06
*** ducttape_ has quit IRC14:06
johnthetubaguyalex_xu: I think we said we would sync into the DB, so we have the integer ids in the DB for more efficient storage, I think14:07
alex_xujohnthetubaguy: yea, we sync the traits from os-traits into the db https://review.openstack.org/#/c/376198/, but that didn't include the namespace14:09
*** swebster has joined #openstack-nova14:09
*** yuntongjin has quit IRC14:09
*** jamesdenton has joined #openstack-nova14:09
*** yamahata has joined #openstack-nova14:09
johnthetubaguyalex_xu: ah...14:11
alex_xujohnthetubaguy: the valid namespace is defined by os-traits also https://github.com/openstack/os-traits/blob/master/os_traits/const.py#L7014:11
alex_xuand I expect 'GET/traits/namespace' return all the valid traits. And expect validate the valid traits which input in 'GET /traits?namespace=*'14:12
*** hferenc has joined #openstack-nova14:13
rpodolyakajohnthetubaguy: dansmith: hmm, do you guys recall if we kept CONF opts for a separate placement DB in this revert https://review.openstack.org/#/c/360638/ intentionally or by mistake?14:13
*** mpaolino has joined #openstack-nova14:14
rpodolyakait's not going to work w/o cdent's https://review.openstack.org/#/c/362766/14:14
johnthetubaguyrpodolyaka: I think it was on purpose, just haven't merged the finish bits yet I guess14:14
rpodolyakabut people find these options in the sample conf file and have wrong expectations14:14
johnthetubaguyrpodolyaka: yeah, that got missed last cycle, it should have been a blocker really14:15
*** READ10 has joined #openstack-nova14:15
*** yingjun has quit IRC14:16
mtreinishsdague: so we did use real ssh with -vvv to test the banner error failure14:16
mtreinishsdague: the socket is being closed right when the ssh client expects the banner response from the server14:17
*** yingjun has joined #openstack-nova14:18
*** esberglu has joined #openstack-nova14:18
*** mriedem_away is now known as mriedem14:18
*** tbachman has quit IRC14:19
*** zhurong has quit IRC14:19
*** links has quit IRC14:19
*** felipemonteiro_ has joined #openstack-nova14:20
*** felipemonteiro__ has joined #openstack-nova14:20
jaypipesalex_xu: heading into the office. will answer your question (or we could do a hangout?) a little later. alternately, we can just discuss on the patch if you're heading to bed...14:21
*** esberglu has quit IRC14:21
*** READ10 has quit IRC14:21
*** zhurong has joined #openstack-nova14:21
*** hongbin has quit IRC14:21
*** dave-mccowan has joined #openstack-nova14:22
kevinbentonjohnthetubaguy, sdague: look how lucky we are. that very patch hit the failure :)14:22
kevinbentonjohnthetubaguy: http://logs.openstack.org/60/439560/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/569fcd0/logs/testr_results.html.gz14:22
*** READ10 has joined #openstack-nova14:23
sdaguekevinbenton: nice14:25
sdaguethe metadata server being useful at all?14:25
mriedemsfinucan: on https://review.openstack.org/#/c/412390/ can we also make that default to the noop driver like in my change?14:25
*** amoralej|lunch is now known as amoralej14:25
*** tbachman has joined #openstack-nova14:26
mriedemasettle: have you been talking to spotz about install guide docs for placement and cells v2?14:26
*** karimb has quit IRC14:27
*** eglynn has joined #openstack-nova14:27
kevinbentonsdague: well it's telling me there is indeed a public-key associated with it14:27
mriedemasettle: https://review.openstack.org/#/c/438328/14:28
mriedembauzas: johnthetubaguy: ^ fyi on the docs thing14:28
*** karimb has joined #openstack-nova14:28
*** dimtruck is now known as zz_dimtruck14:29
johnthetubaguymriedem: oh, cool14:29
*** zz_dimtruck is now known as dimtruck14:29
sdaguekevinbenton: so... rolling conversation on #openstack-qa that is related14:31
asettleHey mriedem sure have. We'd been discussing it before I went to lunch. I'd seen this patch before, but wasn't sure if it ticked all the boxes.14:31
asettleDoes this *deal* with everything?14:31
*** baoli has joined #openstack-nova14:31
mriedemi haven't read it yet in detail since it's a WIP14:31
mriedembut i also pointed out we have these docs in the nova devref14:32
mriedemhttps://docs.openstack.org/developer/nova/placement.html https://docs.openstack.org/developer/nova/cells.html14:32
*** jaypipes has quit IRC14:32
asettlemriedem: having it in nova dev ref is great, but we do need to have the docs in docs.o.o updated as its the user facing documentation. If people can't install from our site, it's a problem.14:34
*** liangy has joined #openstack-nova14:34
mriedemyeah i get that, but i also hope people trying to sort this out are reading our devref14:34
mriedemi can poke through the docs change, but i also just got into the office so it's not going to happen right now14:35
*** hshiina has quit IRC14:35
*** crushil has joined #openstack-nova14:36
asettleNo problem mriedem :) I'd like to start a bigger conversation about this too with docs liaisons for the base projects that we document but there does not appear to be a docs liaison for nova. Do you know of who would be able to fill this role? I am hoping to liaise and generate a better way for this content to be updated when necessary (to avoid running into an issue like this again :))14:36
mriedemi've added a couple of nova devs that helped write the docs that are in nova14:36
mriedemwe don't really have a docs liaison for stuff like this no14:36
asettleCool :) that will be very helpful, thank you14:36
asettlemriedem: okay - well, we have a docs liaison for every project in OpenStack (give or take). It would be more than beneficial to have a nova representative to contact to assist dealing with documentation concerns. Could you help me find someone to fill that position?14:37
asettlePreviously mikal and sdague have helped out with the api-ref and api-guides14:37
mriedemi can ask. fwiw, we've had mandatory liaisons in the past which are just a title but don't necessarily mean people are doing anything.14:37
mriedemby default i'm the liaison14:37
mriedembut i'll bring it up in our meeting14:38
*** jpena|lunch is now known as jpena14:38
asettlemriedem: yeah, so, that's kind of what I'd like to fix :) the 'not doing anything' part ;)14:38
mriedemi've love people to do things too :)14:38
mriedemi can't force it though14:38
asettleIf you're okay with it, I'll add you into my email to the liaisons to discuss a good method of communication for the install guides?14:38
mriedemsure14:38
asettleOf course, community ;)14:38
*** dimtruck is now known as zz_dimtruck14:38
asettleThanks! mriedem could you pm me your best email? :)14:38
mriedemwe could just sign up johnthetubaguy, he signs up for everything else14:38
mriedemasettle: mriedem.os@gmail.com14:38
asettleHahah plus he's in my timezone ;)14:39
johnthetubaguymriedem: heh, thats like docs, sounds hard14:39
mriedemwurdz r hrd14:39
johnthetubaguyyup14:39
*** esberglu has joined #openstack-nova14:39
*** esberglu has quit IRC14:39
*** esberglu has joined #openstack-nova14:40
*** Swami has joined #openstack-nova14:40
*** Swami_ has joined #openstack-nova14:40
asettlewoah you guys are telling me14:40
asettlePeople actually expect me to be eloquent as well14:40
asettleIt's outrageous14:40
mriedemi did hear a british guy on a show the other night say "quintessential" at least 5 times14:41
artom_That's sort of the point of "quit" ;)14:41
artom_Or "quint" event14:42
asettlemriedem: that's long. Over 2 syllables is out of my jurisdiction.14:42
*** tojuvone has quit IRC14:44
*** ducttape_ has joined #openstack-nova14:44
*** jaypipes has joined #openstack-nova14:44
*** READ10 has quit IRC14:45
*** salv-orlando has joined #openstack-nova14:48
openstackgerritKevin Benton proposed openstack/nova master: Add some metadata logging to root cause ssh failure  https://review.openstack.org/43956014:49
*** irenab_ has quit IRC14:50
*** burt has joined #openstack-nova14:51
*** bastafidli has joined #openstack-nova14:51
jaypipeskevinbenton: have you gone to sleep yet?14:52
jaypipeskevinbenton: btw, I'm in sunnyvale... are you?14:52
kevinbentonjaypipes: no, but i'm going to right now :)14:52
kevinbentonjaypipes: yes i am!14:52
kevinbentonjaypipes: catch up with you this afternoon and dinner? :)14:52
jaypipeskevinbenton: the habit later?14:52
*** ducttape_ has quit IRC14:53
jaypipeskevinbenton: yup, see ya in the office.14:53
kevinbentonjaypipes: ack14:53
*** tojuvone has joined #openstack-nova14:53
*** yingjun has quit IRC14:54
*** mvk has joined #openstack-nova14:54
*** yingjun has joined #openstack-nova14:56
*** edand has joined #openstack-nova14:57
*** Jinxing has joined #openstack-nova14:57
*** ijw has joined #openstack-nova14:58
*** ociuhandu has joined #openstack-nova14:58
*** yingjun has quit IRC14:59
*** prateek has quit IRC14:59
*** zz_dimtruck is now known as dimtruck14:59
*** tongli has quit IRC15:00
*** owalsh has quit IRC15:01
tojuvoneGuess we hit the PBR 2.0.0 thingy with pep815:03
*** mtanino has joined #openstack-nova15:03
*** ijw has quit IRC15:03
openstackgerritLee Yarwood proposed openstack/nova master: WIP compute: Move detach logic from manager into driver BDM  https://review.openstack.org/43952015:05
openstackgerritLee Yarwood proposed openstack/nova master: WIP objects: Add attachment_id to BlockDeviceMapping  https://review.openstack.org/43766515:05
*** ralonsoh__ has joined #openstack-nova15:05
*** lucasxu has joined #openstack-nova15:05
*** lucasxu has quit IRC15:07
*** ralonsoh_ has quit IRC15:07
openstackgerritTimofey Durakov proposed openstack/python-novaclient master: Deperecate cell_name cli arg for migration-list  https://review.openstack.org/43914115:07
*** irenab__ has joined #openstack-nova15:09
*** irenab__ has quit IRC15:10
*** irenab_ has joined #openstack-nova15:11
*** lucasxu has joined #openstack-nova15:11
mriedemsfinucan: nevermind, we can take your change to deprecate the firewall_driver option and i'll rebase my change on top of it to change the default to the noop driver15:12
mriedemthat will work nicely, yes very nice indeed....muwahahah15:12
*** jaosorior has quit IRC15:12
silehtHi nova devs, any idea why we get: http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/screen-n-api.txt.gz#_2017-03-01_14_07_46_13315:13
edmondswjohnthetubaguy could you take a quick look at https://review.openstack.org/#/c/389314 ? Other commenters are holding it up waiting for your feedback15:13
mriedemsileht: did nova-manage db sync run after the cell0 db was mapped?15:13
mriedemi.e. run nova-manage cell_v2 map_cell0 and then run nova-manage db sync15:13
silehtmriedem, we just setup devstack15:13
silehtmriedem, it should do it for us, no ?15:14
mriedemwell let's see15:14
silehtmriedem, here: http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/devstacklog.txt.gz#_2017-03-01_14_07_18_98315:14
mriedemnova_cell0 is created here http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/devstacklog.txt.gz#_2017-03-01_13_57_36_56315:14
mriedemmap_cell0 is called here http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/devstacklog.txt.gz#_2017-03-01_14_07_18_98315:14
mriedemnova-manage db sync is called here http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/devstacklog.txt.gz#_2017-03-01_13_57_36_58115:15
mriedemso db sync was called before map_cell015:15
mriedemso the cell0 db schema isn't migrated15:15
silehtmriedem, so it's a devstack bug ?15:15
mriedem"WARNING: cell0 mapping not found - not syncing cell0."15:15
mriedemsileht: if it were, i'd think all of the jobs would be broken15:16
silehtmriedem, our gate is mostly broken, most of the time we got the error, but sometimes it passes15:16
dimsmriedem : tools/discover_hosts.sh does not run in their case15:16
dimsmriedem : so they don't run "nova-manage cell_v2 discover_hosts --verbose"15:17
silehtdims, do we miss something in project-config ?15:17
*** kamtamtun has joined #openstack-nova15:17
dimssileht : remember this one - http://git.openstack.org/cgit/openstack-dev/devstack/commit/tools/discover_hosts.sh?id=5c6aa56e11b2dc79adc70154187d3a029e8e097615:17
mriedemdims: this isn't a multinode job so i don't think they need discover_hosts as long as simple_cell_setup is getting run15:18
silehtdims, yes, but that was for another job15:18
mriedemwhich is does here http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/devstacklog.txt.gz#_2017-03-01_14_07_22_45715:18
dansmithmissing cell0 means we're not even getting to discover hosts15:18
dimsah, ignore me then15:18
mriedemsileht: so someone else had a similar sounding issue with using a devstack plugin15:18
mriedemwhere it was getting called in the wrong order, i think it was shade15:18
mriedemmordred: remember that thing where a devstack plugin was being called from post-stack or test hooks or something?15:19
mriedemso n-api was up before cell0 was synce15:19
mriedem*synced15:19
openstackgerritEd Leafe proposed openstack/nova master: placement: ironic inventory reporting  https://review.openstack.org/43760215:19
edleafejaypipes: ^^ fixed the pep8, and took the liberty of changing the name15:19
silehtmriedem, oh maybe because each time a project that add a new wsgi vhost to apache, it is restarted15:20
asettlemriedem: you are the lucky receiver of the table update; https://wiki.openstack.org/wiki/CrossProjectLiaisons#Documentation (this is where we keep all our liaisons)15:20
mordredmriedem: yah15:21
*** shaner has joined #openstack-nova15:21
mordredmriedem: that was a lot of fun15:21
mriedemmordred: remember the details? sounds like gnocchi jobs might be doing the same15:21
*** ducttape_ has joined #openstack-nova15:21
mriedemhttp://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/devstack-gate-post_test_hook.txt.gz15:21
mordredyah ... one sec, lemme find our fix patch15:22
mordredmriedem: https://review.openstack.org/#/c/427390/15:22
mordredso for us "start_nodepool" needs to not happen until the cloud is actually, you know, up and running15:22
mordredwe do that in test-config now15:23
mordredsileht: ^^15:23
mriedemsileht: so the gnocchi test hook might be trying to hit nova-api at the wrong point in the bring up sequence15:23
mordredyah. that's what we were trying to do - nova was not happy about it15:24
mriedemalso https://review.openstack.org/#/c/427392/15:24
mriedem^ still needs to go in15:24
mriedemand i think would help here, but there is still likely a bug in the consuming plugin15:24
silehtmriedem, we start ceilometer and gnocchi during the extra step, not the the post-config15:25
*** marst has quit IRC15:25
*** sree has joined #openstack-nova15:26
mriedemi've got to run to a meeting, bbiab15:26
*** ociuhandu has quit IRC15:27
*** sacharya has joined #openstack-nova15:28
*** owalsh has joined #openstack-nova15:28
*** ociuhandu has joined #openstack-nova15:28
*** mriedem1 has joined #openstack-nova15:29
*** jistr is now known as jistr|biab15:29
*** karimb has quit IRC15:30
*** sree has quit IRC15:30
*** Sukhdev has joined #openstack-nova15:31
*** zhurong has quit IRC15:31
*** Swami_ has quit IRC15:31
*** mriedem has quit IRC15:31
*** Swami_ has joined #openstack-nova15:31
*** marst has joined #openstack-nova15:32
*** artom_ is now known as artom15:32
alex_xujaypipes: sorry, I can't make a hangout, baby is sleeping. everybody just keep quiet...15:33
*** karimb has joined #openstack-nova15:34
*** edand has quit IRC15:34
*** Swami has quit IRC15:34
*** owalsh has quit IRC15:36
dimsalex_xu : :)15:36
*** annegentle has quit IRC15:36
jaypipesalex_xu: k, no worries. let's comment on the patch, ok?15:36
*** timello has quit IRC15:36
jaypipesedleafe: cool, thanks. I'm fixing up dansmith's PS5 comments now.15:36
*** mpaolino has quit IRC15:36
*** Jinxing has left #openstack-nova15:37
alex_xujaypipes: that is ok for me, or you want to discuss on the irc, i still wake up15:37
*** timello has joined #openstack-nova15:37
*** mriedem1 is now known as mriedem15:38
jaypipesalex_xu: k.15:38
*** owalsh has joined #openstack-nova15:39
jaypipesalex_xu: so I don't actually think we should have a separate GET /traits/namespace REST API endpoint. And I think that GET /traits?namespace=* should be GET /traits?starts_with=XXX15:39
*** Sukhdev has quit IRC15:40
alex_xujaypipes: ok, i guess i remember the wrong one15:40
*** READ10 has joined #openstack-nova15:41
*** hongbin has joined #openstack-nova15:41
alex_xujaypipes: so you expect GET/traits?starts_with=CUSTOM:GPU, that is just a prefix, not really a namespace defined in the os-traits?15:41
jaypipesalex_xu: yes, exactly.15:42
alex_xujaypipes: sorry, may i ask what is the point between the choice of "namespaces=*" and "starts_with"?15:42
*** nkrinner is now known as nkrinner_afk15:43
*** ayogi has joined #openstack-nova15:45
*** Sukhdev has joined #openstack-nova15:45
*** jvgrant__ has quit IRC15:46
*** jvgrant_ has joined #openstack-nova15:46
alex_xudims: i also type the keyboard softly...15:47
dimsawwwww alex_xu15:47
*** yamahata has quit IRC15:47
*** udesale has quit IRC15:48
*** claudiub|2 has quit IRC15:48
*** kfarr has joined #openstack-nova15:49
jaypipesalex_xu: actually, I think GET /traits?name=starts_with:XXX would be more in-line with the API WG filtering guidelines? https://github.com/openstack/api-wg/blob/master/guidelines/pagination_filter_sort.rst15:50
jaypipesalex_xu: I know that there isn't a guideline specifically for prefix matching, but the other filter guidelines are similar. name=in:X,Y, start=ge:2017-01-01, etc15:51
jaypipesalex_xu: in this case, all we're doing is a prefix match. There's really nothing about namespaces that is specific to the query.15:52
*** annegentle has joined #openstack-nova15:52
mriedem+1 to /traits?name=starts_with:XXX15:52
mriedemwe have something like this today: GET /resource_providers?resources=VCPU:2,MEMORY_MB:1024,DISK_GB:5015:52
*** lpetrut has quit IRC15:53
mriedemand15:53
mriedem /resource_providers?member_of=in:{agg1_uuid},{agg2_uuid},{agg3_uuid}15:53
jaypipesalex_xu: and doing it this way would allow us, for example, to do something like GET /traits?name=contains:GPU or something similar, whereas you couldn't do that with namespace=XXX15:53
alex_xujaypipes: contains:GPU just should have bad performance even with db index?15:54
*** ijw has joined #openstack-nova15:54
*** armax has quit IRC15:54
jaypipesalex_xu: yes, absolutely, but that doesn't mean people won't find it useful ;)15:55
*** ijw has quit IRC15:55
*** ijw has joined #openstack-nova15:55
*** jistr|biab is now known as jistr15:56
jaypipesalex_xu: in any case, my point is that if we do name=starts_with:XXX, then we keep our API more in-line with the API WG recommendations and leave our options open in future to how users can query the placement API. Agree?15:56
*** gfhellma has joined #openstack-nova15:56
alex_xujaypipes: yes, i agree15:56
*** gszasz has quit IRC15:56
*** ociuhandu has quit IRC15:56
*** gfhellma has quit IRC15:57
*** gfhellma has joined #openstack-nova15:57
*** Sukhdev has quit IRC15:58
*** ZZelle has joined #openstack-nova15:58
*** ociuhandu has joined #openstack-nova15:58
*** shaner has quit IRC15:58
alex_xujaypipes: mriedem, wait, the current proposal have a API "GET /traits?tratis=a,b,c", it is ok with "GET /traits?traits=start_with:xxx"?15:58
*** _ducttape_ has joined #openstack-nova15:58
*** shaner has joined #openstack-nova15:59
*** Sukhdev_ has joined #openstack-nova15:59
*** ijw has quit IRC16:00
*** annegentle has quit IRC16:00
*** yamamoto has joined #openstack-nova16:00
*** annegentle has joined #openstack-nova16:01
*** ducttape_ has quit IRC16:01
mriedemwhat are the semantics of traits=a,b,c?16:02
*** mdrabe_ has quit IRC16:02
mriedemis that an in?16:02
mriedemtraits in (a, b, c) or an intersection?16:02
alex_xumriedem: yes16:02
mriedemor is that, give me details about traits a, b, and c?16:02
jaypipesmriedem: yup, traits?name=in:a,b,c16:03
*** tbachman has quit IRC16:03
jaypipesIN == ANY()16:03
alex_xuah...name=in:16:03
mriedemyeah we have that for resource_providers already16:03
mriedemfor finding resource providers in a given set of aggregates16:03
*** rcernin has quit IRC16:03
mriedem /resource_providers?member_of=in:{agg1_uuid},{agg2_uuid},{agg3_uuid}16:04
mriedembauzas at one point had something similar for getting resource providers by name16:04
*** breitz has quit IRC16:04
alex_xujaypipes: mriedem I think i got all that point now16:04
*** breitz has joined #openstack-nova16:05
alex_xui will update the spec and validate more, mriedem jaypipes thanks16:05
jaypipesalex_xu: cool, thanks Alex!16:05
alex_xujaypipes: np16:05
*** Oku_OS is now known as Oku_OS-away16:05
mriedemalex_xu: jaypipes: this was the change for RPs i was thinking of https://review.openstack.org/#/c/407630/16:06
*** yamamoto has quit IRC16:06
mriedemGET: /resource_providers?name=in:$ENVIRON['RP_NAME'],foobar16:06
mriedemso in that example, it's looking for RPs by name where one exists and one doesn't (foobar doesn't)16:06
*** shaner has quit IRC16:07
mriedemalex_xu: also, now that i'm looking at that change and it reminds me,16:07
mriedemthe resource provider name doesn't exclude commas16:07
alex_xumriedem: ":" is a specical for trait16:07
mriedemso when you define a schema for trait name, make sure it does not allow commas16:08
mriedembecause name=in:a,b,c would be broken parsing if the trait name has a comma in it16:08
alex_xumriedem: the trait is like HW:X86:CPU:AVX, with ":" is probably ok16:08
mriedemwell we'd have to split on the first : in the name=in:a,b,c case16:09
mriedemso you split on : and get a,b,c16:09
mriedemso we could have name=in:HW:X86:CPU:AVX,foo16:09
*** mdrabe_ has joined #openstack-nova16:09
alex_xumriedem: yea16:09
mriedemsplit on the first : and get HW:X86:CPU:AVX,foo16:09
*** mdrabe_ is now known as mdrabe16:09
mriedemand then split on , to get (HW:X86:CPU:AVX, foo)16:09
mriedembut my point is, make sure the schema for creating a trait in the API excludes commas :)16:10
mriedemalex_xu: couldn't we just do _ instead of :16:10
mriedemfor the trait name?16:10
mriedemthen it would match resource classes16:10
*** ociuhandu has quit IRC16:11
alex_xumriedem: we could, I didn't have any critical point for can't use "_"16:12
alex_xujaypipes: ^ do you have anything in mind?16:12
mriedemi tend to think we should be consistent16:13
cfriesendo the capabilities exposed in self.driver.capabilities in the ComputeManager get exposed to the scheduler filters?  (I'm wondering if we can use self.driver.capabilities['supports_migrate_to_same_host'] to avoid scheduling to the same compute node if it's not supported.16:13
mriedembecause we have the whole _ for image metadata and : for flavor extra specs today16:13
mriedemwhich is kind of a confusing mess16:13
*** bastafidli has quit IRC16:14
mriedemcfriesen: i believe so yes, the capabilities filter16:14
mriedemit's right in the name16:14
*** bastafidli has joined #openstack-nova16:14
alex_xumriedem: yes, agree with you, actually i'm trying to match the resource class, I changed the trait name from lower-case to capitals16:15
jaypipesmriedem: sure, we can use _ instead of :16:15
jaypipesalex_xu: ^16:15
*** CristinaPauna has quit IRC16:15
alex_xujaypipes: mriedem cool, thanks16:16
*** _ducttape_ has quit IRC16:16
*** Guest52040 has joined #openstack-nova16:17
*** ducttape_ has joined #openstack-nova16:17
*** moshele has joined #openstack-nova16:22
mriedemcfriesen: ComputeCapabilitiesFilter16:24
mriedemi think16:24
*** CristinaPauna has joined #openstack-nova16:25
*** adrian_otto has joined #openstack-nova16:25
*** Sukhdev_ has quit IRC16:25
andreykurilinmriedem: hi! Your patch (https://review.openstack.org/#/c/437145/) broke functional-mitaka job. At least it is the first patch with red job result.16:26
*** zioproto has joined #openstack-nova16:27
*** psachin has quit IRC16:27
zioprotodansmith, are you here ?16:27
mriedemandreykurilin: hmm, those tests must be based on microversion or something16:27
andreykurilinmriedem: two tests are "legacy"16:28
*** Sukhdev_ has joined #openstack-nova16:29
mriedemweird, how did that test even pass on master?16:29
mriedemhttps://github.com/openstack/python-novaclient/blob/master/novaclient/tests/functional/v2/legacy/test_fixedips.py#L3116:29
mriedemthat's calling a CLI that doesn't exist anymore16:29
mriedemit was skipped for master http://logs.openstack.org/45/437145/2/check/gate-novaclient-dsvm-functional-neutron-ubuntu-xenial/aad02a1/testr_results.html.gz16:29
mriedemoh i know why16:30
mriedemwe're using neutron on master, but nova-net on mitaka16:30
*** jvgrant_ has quit IRC16:30
andreykurilinoh16:30
mriedemyeah https://github.com/openstack/python-novaclient/blob/master/novaclient/tests/functional/v2/legacy/test_fixedips.py#L2616:30
mriedemi'll push a fix quick16:30
mriedemgood catch16:30
andreykurilinmriedem: thanks16:31
andreykurilinmriedem: what about making mitaka-functional job voting?16:31
*** andreas_s has quit IRC16:33
mriedemwe could...16:33
mriedemI haven't put any thought into it16:33
mriedembbiab16:34
*** mriedem has quit IRC16:34
*** tbachman has joined #openstack-nova16:34
*** dtp has joined #openstack-nova16:34
*** annegentle has quit IRC16:35
*** ralonsoh__ has quit IRC16:35
*** bkopilov has quit IRC16:35
*** annegentle has joined #openstack-nova16:36
*** browne has joined #openstack-nova16:38
dimsthorst : Anyone around to merge this PR and cut a release for pypowervm? https://github.com/powervm/pypowervm/pull/116:40
thorstdims: Yeah, we're working on getting a new rev of that.  It'd be pypowervm 1.0.0.4.1 to take in the new req.  adreznec is working on it.16:41
*** Sukhdev_ has quit IRC16:41
dimsgreat thanks thorst and adreznec16:41
adreznecdims: thorst Yep, just working on that now16:41
thorstthx for letting us know!16:41
cfriesenbauzas, you around?16:42
openstackgerritJay Pipes proposed openstack/nova master: placement: ironic inventory reporting  https://review.openstack.org/43760216:43
jaypipesdansmith: finally addressed your PS5 coments ^. thanks for your patience.16:43
*** salv-orlando has quit IRC16:44
*** Sukhdev_ has joined #openstack-nova16:44
dansmithjaypipes: will look in a bit16:44
*** mriedem has joined #openstack-nova16:44
*** cdent has joined #openstack-nova16:44
*** bvanhav has quit IRC16:45
*** shaner has joined #openstack-nova16:45
*** sacharya has quit IRC16:45
*** zioproto has quit IRC16:46
*** bvanhav has joined #openstack-nova16:46
*** owalsh_ has joined #openstack-nova16:47
*** dnalezyt has joined #openstack-nova16:47
*** markus_z has quit IRC16:50
bauzascfriesen: yup but with terrible connection16:50
bauzasSo lots of lags16:50
*** owalsh has quit IRC16:50
bauzascfriesen: Wazzup?16:51
cfriesenbauzas: I think there's a bug in the handling of ignore_hosts.  We set it on resize if CONF.allow_resize_to_same_host is False, then we save the RequestSpec and use the same RequestSpec on a subsequent rebuild/evacuate16:51
*** owalsh_ has quit IRC16:51
cfriesenwe reset force_hosts/force_nodes, but not ignore_hosts16:52
*** rcernin has joined #openstack-nova16:52
bauzasMmmm16:53
bauzasLooks like a miss indeed16:53
bauzascfriesen : patch it up in the object helper then16:54
cfriesenin reset_forced_destinations() ?16:54
*** kaisers_ has quit IRC16:55
*** owalsh_ has joined #openstack-nova16:56
*** ijw has joined #openstack-nova16:56
*** kaisers_ has joined #openstack-nova16:56
*** Sukhdev_ has quit IRC16:56
*** Swami_ has quit IRC16:56
*** raunak has joined #openstack-nova16:57
*** owalsh_ is now known as owalsh16:58
*** liverpooler has quit IRC16:59
*** salv-orlando has joined #openstack-nova17:00
dtpis there a cells meeting today?17:00
*** kaisers_ has quit IRC17:01
bauzascfriesen: yup17:01
dansmithoops17:01
bauzascfriesen: But I need to dig into code17:02
*** ijw has quit IRC17:02
bauzasBecause I remember a similar issue that I fixed17:02
*** jose-phillips has joined #openstack-nova17:02
snetijohnthetubaguy, can you please review this when you have time: https://review.openstack.org/#/c/396420/17:03
*** yamamoto has joined #openstack-nova17:03
johnthetubaguysneti: ah, yes, opened that, hopefully will get there soon17:03
snetithanks johnthetubaguy17:04
*** Sukhdev_ has joined #openstack-nova17:05
*** ltomasbo is now known as ltomasbo|away17:05
*** ayogi has quit IRC17:05
*** ijw has joined #openstack-nova17:05
*** yamamoto has quit IRC17:08
*** tovin07 has left #openstack-nova17:08
*** nic has joined #openstack-nova17:08
*** owalsh_ has joined #openstack-nova17:09
*** owalsh has quit IRC17:10
mriedemsdague: i want to reuse your FakeResponse thing https://github.com/openstack/nova/blob/master/nova/tests/unit/test_identity.py#L2517:10
mriedembut need to adjust the nonzero17:10
mriedemto be True for status_code < 40017:10
mriedemto match requests.Response https://github.com/kennethreitz/requests/blob/v2.12.5/requests/models.py#L65817:10
mriedemsdague: you ok with that?17:10
*** Apoorva has joined #openstack-nova17:11
*** Sukhdev_ has quit IRC17:12
*** Swami_ has joined #openstack-nova17:12
*** moshele has quit IRC17:12
*** aarefiev is now known as aarefiev_afk17:13
*** crushil has quit IRC17:14
*** owalsh has joined #openstack-nova17:14
*** owalsh_ has quit IRC17:14
*** felipemonteiro__ has quit IRC17:15
*** felipemonteiro_ has quit IRC17:15
cfriesenbauzas: bug 1669054 has been opened to track the issue17:15
openstackbug 1669054 in OpenStack Compute (nova) "RequestSpec.ignore_hosts from resize is reused in subsequent evacuate" [Undecided,New] https://launchpad.net/bugs/166905417:15
sdaguemriedem: sure17:16
andymccrwhat is the correct order for nova-manage (api_db/db sync & cell_v2 commands) in an upgrade? i'm running into an issue where greenfield works, but upgrades don't unless the order is slightly different17:18
andymccror rather - is there an order that works for both upgrades and greenfield? :)17:19
*** ayogi has joined #openstack-nova17:19
mriedemandymccr: https://docs.openstack.org/developer/nova/cells.html#setup-of-cells-v217:20
mriedemand https://docs.openstack.org/developer/nova/cells.html#step-by-step-for-common-use-cases17:20
*** felipemonteiro_ has joined #openstack-nova17:20
*** felipemonteiro__ has joined #openstack-nova17:20
andymccrmriedem: those docs only cover the cell setup bits - which is working fine afaict. the issue im running into is that in greenfield i have to have done an api_db sync before i can do the cell_v2 map_cell0 - otherwise it fails because certain tables are missing in the nova_api database17:21
*** lucasxu has quit IRC17:21
andymccrbut in an upgrade scenario (from a non-cell_v2 --> cell_v2 deploy, or say N->O) if i run the api_db sync before the cell exists it will bomb saying that the cell needs to exist17:22
mriedemyes you need the api db synced to get the cell mapping model17:22
andymccrwhich means that the approach for upgrades doesn't work for greenfield17:22
mriedemmap_cell0 creates a cell_mappings record in the nova_api db17:22
andymccrso then should api_db sync fail if cell0 doesn't exist yet?17:22
mriedemandymccr: tripleo?17:22
andymccrmriedem: OpenStack-Ansible17:22
andymccralthough im sure the tripleo ppl have already figured this one out :P17:22
mriedemdo you already have flavors created?17:22
*** baoli has quit IRC17:22
mriedemyes owalsh hit the same thing17:23
mriedemin tripleo17:23
*** baoli has joined #openstack-nova17:23
mriedemand we relaxed something in the api db schema migration17:23
andymccrmriedem: in testing, no - in practice yes17:23
*** bvanhav_ has joined #openstack-nova17:23
cfriesenbauzas: I don't think changing reset_forced_destinations() is sufficient by itself given how we handle ignore_hosts in ConductorManager.rebuild_instance().17:23
mriedemandymccr: assuming you have this change? https://github.com/openstack/nova/commit/f781409f366904362b36bb8047fc371c17301c5e17:24
*** gaurangt has joined #openstack-nova17:24
melwittI thought upgrade scenario meant not a greenfield?17:24
mriedemyeah i'm confused17:25
melwittlike, you're upgrading a deployment that already has a api db with a schema in it17:25
mriedemif you've synced the api db in newton, you have the cell mappings table and can run map_cell017:25
mriedemto create an entry in the cell_mappings table in the nova_api db17:25
andymccrmriedem: melwitt: sure but the issue is the process is then diff for greenfield vs upgrade, which means i need to have 2 code paths to manage 1 thing17:26
*** digvijay2016 has joined #openstack-nova17:26
mriedemif it's a completely fresh install, the api db schema migration checks for that by seeing if you have created flavors yet17:26
andymccre.g. in greenfield i do api_db sync --> cell_create --> the other things17:26
andymccrand in upgrade im going to have to do cell_create --> api_db sync --> the other things17:26
owalshandymccr: yes, we had to re-order the db sync for upgrades in tripleo17:26
andymccrowalsh: so do you do different ordering for upgrade vs greenfield?17:26
*** slaweq__ has quit IRC17:26
*** bvanhav has quit IRC17:27
digvijay2016how to restrict the nova service from changing hostname of created instance ?17:27
melwittI see. I think maybe you could have the same process for both if you have potentially an extra sync in there. I'd have to think about it more17:27
mriedemandymccr: to be clear, on the newton side the api db is already all synced up yes?17:28
mriedembefore upgrading to ocata17:28
melwittmriedem: does it hurt to do a sync twice? I guess it could17:28
andymccrmriedem: yes17:28
mriedemmelwitt: no17:28
mriedemmelwitt: db sync is idempotent17:28
mriedemif you're already at the latest version, it's a noop17:28
mriedemthere is a migrations table created in the db that tracks the version you're synced to17:28
mriedemi.e. you can do something like nova-manage db sync --version17:28
melwittokay, so maybe it could be api_db sync --> cell_create --> api_db sync --> other things for both?17:29
andymccris there anyway we could get the rc for nova-manage api db_sync to be something that isn't 1 if it fails because the cell doesnt exist?17:29
mriedemmelwitt: that's how it works for grenade https://github.com/openstack-dev/grenade/blob/stable/ocata/projects/60_nova/from-newton/upgrade-nova17:29
owalshmelwitt: no, can't run api_db sync for upgrades until the end17:29
*** slaweq_ has quit IRC17:29
andymccr^ yeah the issue is in upgrade you cant run the api_db sync unless the cell exists17:29
mriedemnewton is all done, then in grenade we create the cell0 db, map_cell0, run simple_cell_setup to create the main cell and host mappings17:30
andymccrbut in greenfield you cant run the cell unless api_db has been run17:30
owalshandymccr: this is the tripleo upgrade (ansible) tasks https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-api.yaml#L22517:30
melwittI guess I don't understand why you can't run it twice17:30
mriedemandymccr: no, the whole point of the blocker migration is to make sure you've setup cells before starting ocata services17:30
*** kamtamtun has quit IRC17:30
mriedemmelwitt: yeah i also don't see how this is working in grenade but not for anything else17:31
*** slaweq_ has joined #openstack-nova17:31
andymccrmriedem: so is there a status command we can check that could be a decider around "hey you haven't run api_db sync yet so you need to before cell create"17:32
*** crushil has joined #openstack-nova17:32
andymccrmriedem: i imagine its working in grenade because you arent using the same path for upgrade vs greenfield - to me it seems silly to have to carry a separate "upgrade" play and it also means we have to determine whether you are upgrading or not - which is tricky. ideally it will just get you to the correct state17:32
mriedemandymccr: the nova-status upgrade check command will tell you what's missing yeah17:32
andymccrmriedem: ok will try that out - im guessing its meant to be human readable and wont give an rc that i can automate on?17:34
*** kaisers has quit IRC17:35
*** lucasagomes is now known as lucas-afk17:35
*** lucasxu has joined #openstack-nova17:36
mriedemandymccr: nova-manage db sync? it's a pass/fail, we don't have logic built in based on how specific migration scripts behave17:36
mriedemand the entire point of that blocker migration is that you can't proceed w/o doing some other stuff first17:37
andymccrmriedem: i get that - but the problem here is that api_db sync is not idempotent? i can run it fine on a brand new database with no cells, and it works fine - but if i run it again straight after it fails because the cell doesnt exist17:38
andymccrend goal is that i want to (at least) be able to determine in an automated fashion where i need to run the cell create then the api_db sync or vice versa.17:39
cfriesenseparate question about the scheduler.  why does live-migration add nodes to request_spec.ignore_hosts on RescheduledException but cold migration doesn't?17:40
openstackgerritMarkMielke proposed openstack/nova master: DiskFilter handling for free space less than zero  https://review.openstack.org/43009117:41
owalshandymccr: we couldn't do that with puppet for the tripleo undercloud, resorted to using an upgrade flag17:44
*** edmondsw has quit IRC17:44
andymccrowalsh: yeah i want to avoid that if possible :)17:44
*** jpena is now known as jpena|away17:45
melwittandymccr: from what I can tell in the code, the return code for the 'cell doesn't exist' should be 2. but you said it was 1 when you did it?17:47
*** rfolco has joined #openstack-nova17:48
andymccrmelwitt: let me do another test - if that's the case then that would be perfect17:48
*** sambetts is now known as sambetts|afk17:48
*** armax has joined #openstack-nova17:49
*** liangy has quit IRC17:49
mriedemmelwitt: he's talking about nova-manage db sync right?17:50
mriedemthat's either pass or fail i believe17:50
melwittthe return code from the status check is 2, does that not pass through the db sync?17:50
owalshmriedem: api db sync I expect17:50
mriedemandymccr: you can tell if it's a fresh install by telling if there are flavors in the api db can't you? that's what the api schema migration does to tell if it's a fresh install or an upgrade17:50
mriedemmelwitt: nova-status is not the same as nova-manage17:50
mriedemthe status check is a separate thing17:51
mriedempre-upgrade17:51
melwittmriedem: nova-manage doesn't call nova-status functions to do the blocker?17:51
mriedemno17:51
melwittsigh ... okay. nevermind andymccr17:52
andymccrmriedem: do you mean by doing a db query to check if it exists?17:52
mriedemandymccr: if it's an upgrade isn't nova-api already running?17:52
*** karimb has quit IRC17:52
mriedemthis is the api db migration thats hitting you https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api_migrations/migrate_repo/versions/030_require_cell_setup.py#L2817:52
andymccrmriedem: ok so check if the service is running, if so then do the cell create before the api_db?17:52
mriedemthat migration checks the api db for flavors, if there are none it assumes fresh install and exists17:53
mriedem*exits17:53
mriedemi don't know how the osa stuff works to tell if you're upgrading or not17:53
*** romainh has quit IRC17:53
*** salv-orlando has quit IRC17:54
owalshI doubt using service status would be idempotent17:54
melwittthey just need to be able to differentiate between a regular db sync fail and a validation db sync fail. I wonder if we could do something like return 2 if we catch ValidationError17:54
*** lucasxu has quit IRC17:56
andymccrmriedem: ideally we dont tell the difference between upgrade or not - it should run through in an order that would work for both, or do some logic to ensure an appropriate state is configured17:56
andymccrmelwitt: that sounds like it would work17:56
owalshmelwitt: another nova-status command might be cleaner17:56
andymccryeah if a nova-status command could tell us before hand without failing, that would work fine too17:56
*** lucasxu has joined #openstack-nova17:57
*** salv-orlando has joined #openstack-nova17:57
melwittowalsh: how does the current nova-status command not work for you? does it return a fail on an empty api db, or?17:57
*** derekh has quit IRC17:58
*** Jeffrey4l has quit IRC17:59
*** Swami_ has quit IRC17:59
owalshmelwitt: no idea... garbage collected my brain since then18:01
*** yamamoto has joined #openstack-nova18:04
owalshmelwitt: possibly because the placement api status checks could give false negatives18:05
*** armax has quit IRC18:06
owalshmelwitt: I think we would at least need the ability to run individual checks with the current command18:07
openstackgerritDan Smith proposed openstack/nova master: WIP: Get instance availability_zone without hitting the api db  https://review.openstack.org/43975418:09
*** eglynn has quit IRC18:10
*** yamamoto has quit IRC18:10
* owalsh gotta go afk for a while18:11
*** owalsh has quit IRC18:11
*** fragatina has joined #openstack-nova18:11
jbernarddo we support booting from an encrypted volume?18:13
jbernarddocs does not say explicitly, which makes me wonder18:13
mriedemjbernard: should be able to18:13
kevinbentonsdague, johnthetubaguy: want to send https://review.openstack.org/#/c/439560/ in?18:13
jbernardmriedem: cool thanks, we have also encryptors in os-brick,18:14
kevinbentonthat last statement i added will allow us to see right what's in the http response18:14
jbernardmriedem: do we plan to make use of those at some point, or is that for something else?18:14
*** tesseract has quit IRC18:16
mriedemjbernard: i thought lyarwood added the encryptors to os-brick18:16
mriedemi'm not really familiar18:16
*** hos1 has joined #openstack-nova18:16
*** bvanhav__ has joined #openstack-nova18:16
mriedemi thought the idea was to put them in os-brick so that nova/cinder were talking the same language18:16
mriedembecause i believe the encryptor class in the volume type in cinder is just a string today18:16
mriedemso you can throw whatever in there and it's not validated18:16
mriedemuntil it doesn't work on the nova side18:17
jbernardok, that was my impression as well18:17
*** bvanhav_ has quit IRC18:17
mriedemkevinbenton: which job would be running with that on so we can see the results?18:17
smcginnismriedem: +118:17
mriedemi forget which ones run the metadata api18:17
kevinbentonmriedem: it seems quite a few more are now18:18
kevinbentonmriedem: even gate-tempest-dsvm-neutron-full-ubuntu-xenial18:18
*** Swami has joined #openstack-nova18:18
mriedemyeah i suppose that makes sense, it's just not a separate service18:19
mriedemlike in the old pg job18:19
mriedemit's running under nova-api18:19
*** shaner has quit IRC18:20
*** shaner has joined #openstack-nova18:20
*** owalsh has joined #openstack-nova18:21
*** owalsh is now known as owalsh-afk18:21
mriedemkevinbenton: comments inline18:23
mriedemmelwitt: andymccr: so on the idea of returning a different error code from nova-manage api_db sync, if we return 2 for a ValidationError or something, what would you do? basically always sync and ignore any rc=2 result, then try to map_cell0 and then sync again and if that fails you fail for real? that still seems shitty because at some point we could be raising validation error for something else you're not handling, and ignoring the va18:25
andymccrmriedem: yeah the idea would be to know what the rc means - e.g. rc 2 == the cell db needs to be mapped, run that then sync later. but you're right if there are other cases that is problematic18:26
*** unicell has joined #openstack-nova18:27
*** fragatina has quit IRC18:27
melwittmriedem: yeah, I guess it's still messy. I was thinking in general it might be nice to know if a sync failed because of a validation failure vs something else18:28
*** sudipto_ has quit IRC18:28
*** sudipto has quit IRC18:28
openstackgerritKevin Benton proposed openstack/nova master: Add some metadata logging to root cause ssh failure  https://review.openstack.org/43956018:29
kevinbentonmriedem, johnthetubaguy: ^^18:29
*** cdent has quit IRC18:29
mriedemandymccr: have you hit issues like this in any other project? or do other projects just fail at runtime?18:29
melwittmriedem: owalsh mentioned being able to run individual checks with nova-status would help. so when you're automating, you can tell which things to check and respond to. currently I think the nova-status just checks all the things at the same time and they can't tell which thing failed to know which thing to do next?18:29
mriedem+218:29
andymccrmelwitt: yeah that would work too and may be cleaner - e.g. you can do a specific check for the one thing you need18:30
mriedemmelwitt: yes it runs through a series of checks today and dumps a summary table with results and the most severe rc18:30
andymccrmriedem: we do some logic around keystone rolling upgrades and rc responses afaik18:30
*** bvanhav__ is now known as bvanhav18:31
andymccrso i think keystone-manage db_sync has rc codes for 2 3 4 with 1 being a flat out fail18:32
dansmithI'm not really in favor of making db_sync indicate levels of fail18:33
dansmithif you run db_sync, look for rc=2 and if so, do something and try to run it again, you're doing it wrong18:34
andymccrdansmith: agree - in keystone its a --check18:34
andymccrwhich basically tells you what is needed - you do those things, if they fail its a fail18:34
dansmithah, okay18:34
andymccrkeystone-manage db_sync --check - can return 2,3,4 (or 1 if it fails i guess)18:34
mriedemandymccr: that's basically the same idea with nova-status upgrade check18:34
dansmithright18:34
andymccrmriedem: with rc's included? or just a table output - if so would it be a reasonable idea to have rc's that indicate what the table says?18:35
melwittyeah, I think we should make it possible to check individual checks via subcommand or something18:35
mriedemandymccr: rc's18:35
andymccrmriedem: ahh interesting18:35
mriedem0 is good, 1 is warning, 2 is fail18:35
andymccrin that case18:35
andymccrmriedem: ok i'll play around and see if i can get a spot that basically says "if 2 on status do these, otherwise do these"18:35
mriedemmelwitt: "check" is the subcommand, i don't think it goes lower than that, but we could build in an option18:35
andymccr(for example)18:36
dansmithmriedem: if they want to be able to run single checks from nova-status, that's probably okay too, but they have to run it once without that restriction otherwise they won't notice when we add things18:36
mriedemnova-status upgrade check --cells18:36
mriedem--placement18:36
mriedemetc18:36
melwittI see18:36
mriedemdansmith: yup18:36
mriedemandymccr: v18:36
mriedemhttps://docs.openstack.org/developer/nova/man/nova-status.html18:36
mriedembefore you ask18:36
dansmithheh18:37
mriedemgod isn't it fucking awesome everything is documented18:37
andymccrah ok so status 2 is just "anything happened"18:37
andymccrand 1 is "random warning" so there is no real way to tell what that means unless you inspect the output18:37
mriedemandymccr: yeah it's not granular per check right now18:37
andymccrok18:37
*** liangy has joined #openstack-nova18:37
andymccrmaybe i can work around that somehow18:37
mriedem2 means, stop, shit won't start if you proceed18:37
melwittis the only return item a table? maybe we need a json option for parsing by automations?18:38
mriedem1 means, you should investigate, but things will start and shouldn't cause huge issues18:38
dansmithmriedem: well, to be fair "shit" will start [happening] if you proceed18:38
mriedemwell, e.g. n-cpu won't start18:38
*** annegentle has quit IRC18:38
dansmithmriedem: right.. the "shit" will start [hitting the fan]18:38
mriedemin ocata if placement isn't configured18:38
dansmithnevermind.18:38
mriedemyeah18:38
mriedemmelwitt: it's a table in stdout and a return code right now yeah18:39
mriedemwe could build in a json output option if needed18:39
dansmithif you know what to do with rich per-test output from that,18:39
dansmiththen it means you already know what to do, you should do it, and fail if the test says you fail18:40
mriedemyeah it does feel like a lot of bending over backwards to hack around something18:40
dansmithwith the exception of anything that really isn't idempotent, but the only thing i can think of that fits that is cell creation, which should be obvious when to do18:40
melwittI was thinking the problem was, if they get a fail, then they don't know which of the things placement or cells they need to set up18:41
dansmithmelwitt: they have to set up both things18:41
dansmithI'm not sure why there's a question of when or if to do those18:41
andymccrdansmith: the issue is in upgrades you have to make sure you do a cell create before a api_db sync - in greenfield you have to do the reverse order18:41
andymccrthat means the upgrade vs new install path is different18:41
andymccrso having a mechanism to determine what needs to happen is important unless we want to carry an "upgrade" flag which is really not a great way to do deploys18:42
dansmithandymccr: how is it opposite?18:42
andymccrdansmith: if you run api_db sync when cell_v2 create hasnt run it fails saying "cell doesnt exist" on an upgrade18:42
openstackgerritFeodor Tersin proposed openstack/nova-specs master: Add ScaleIO ephemeral storage backend  https://review.openstack.org/30471518:42
andymccrbut on a greenfield deploy if you run "cell_create" without api_db sync having happened it says "cant write to nova_api database"18:42
dansmithah, okay, I see18:42
dansmiththat's a very atypical example, so maybe we work around that one specifically instead of building in a lot of "check this before doing a thing" for other stuff?18:43
dansmithandymccr: how do you know if flavors need to be created?18:43
*** harlowja has quit IRC18:43
dansmith(i.e. upgrade or new install)18:44
*** gszasz has joined #openstack-nova18:44
*** fragatina has joined #openstack-nova18:44
andymccrwe don't create flavors as part of the deploy - that's up to the deployer afterwards if they want (or in testing the tempest role sets up the bits)18:44
andymccrbut the create bits are idempotent so if they exist it doesnt bomb or anything18:45
dansmithoh okay I thought you did18:45
dansmithokay, so, the migration uses flavors to determine if it should fail18:45
dansmithdepending on where this runs you could probably do the same18:45
mriedemsdague: sfinucan: i've figured out that https://review.openstack.org/#/c/434339/ introduces a bug18:45
mriedemin the 204 case18:45
dansmithandymccr: also you could sync to before the blocker, do the create, then finish the sync and that would work for both cases18:46
*** harlowja has joined #openstack-nova18:46
andymccrdansmith: how can i specify to sync to before the blocker?18:46
mriedemfixing18:46
andymccrdansmith: if i understand what you mean you do the first part of the sync, then create the cell if it doesnt exist, then finish the sync18:46
dansmithandymccr: sync --version 12318:47
dansmithandymccr: yup18:47
*** yamahata has joined #openstack-nova18:47
mriedemandymccr: there is also a nova-manage cell_v2 list_cells command18:47
dansmithandymccr: that blocker was attempting to prevent people from screwing themselves by not reading the docs, but I see how it puts you in a tight spot18:48
mriedemyou could parse that for the nova_cell0 entry18:48
dansmithmriedem: that too18:48
dansmithandymccr: with nova-status we may be able to get away from doing that as much in the future18:48
andymccrmriedem: that would tell if cells exist, so in the case of greenfield i still need an api_db sync first - in upgrades i wouldn't18:48
mriedemyeah, we did this blocker migration before we had nova-status18:48
andymccrmriedem: the key one would be a "has an api_db sync ever run successfully" command18:49
dansmithandymccr: db version18:49
mriedemyeah18:49
*** adisky_ has quit IRC18:49
mriedemnova-manage api_db version18:49
dansmithandymccr: 'nova-manage api_db version' to see if you're at 0, before the blocker, or after, then do the right thing18:49
mriedemthat will tell you if you've synced18:49
*** lpetrut has joined #openstack-nova18:50
openstackgerritSujitha proposed openstack/nova master: Remove mox from nova.tests.unit.virt.xenapi.test_vmops[2]  https://review.openstack.org/43977018:50
andymccrmriedem: dansmith thanks a bunch i'll play around with those and try see if i can get something working. that sounds like it may work18:50
dansmithandymccr: cool18:51
andymccrowalsh-afk: i'll let you know what i come up with18:51
andymccrit might be helpful for tripleo too18:51
melwittdansmith: how can you tell what version the blocker is?18:51
dansmithmelwitt: look in the tree?18:51
dansmithmelwitt: this would be a special case for this blocker18:52
melwittso 030 I guess18:52
dansmithmelwitt: yep18:52
*** salv-orl_ has joined #openstack-nova18:52
sdaguemriedem: really, because there is a unit test for that18:53
mriedemsdague: it doesn't model the requests.Response.__bool__ override18:53
mriedemsdague: i've got the fix, just opening a separate bug for it18:54
*** cdent has joined #openstack-nova18:54
sdaguehttps://review.openstack.org/#/c/434339/3/nova/tests/unit/test_metadata.py@90718:54
mriedemyeah, it's borked18:54
sdaguemriedem: ok, what's wrong with the unit test?18:54
*** gszasz has quit IRC18:54
sdagueoh, did it skip a step?18:54
mriedemyes18:55
sdaguealso... why do we believe people are going to return a 204 from this who's purpose is to fetch data?18:55
*** salv-orlando has quit IRC18:55
mriedemi thought about that too18:55
sdaguelike, I don't even understand why we would believe that's a thing18:55
mriedemand i don't know, but mikal built it into the tests18:55
sdagueright, but I think he was cantriping something else18:55
sdaguethose tests and the use of requests status codes look very much like copy paste from some other pattern18:56
sdagueanyway, it's probably fine to just make sure that the json decode exception is handled18:56
*** gouthamr has quit IRC18:56
mriedemit is, it handles a TypeError and ValueError18:56
sdagueok, then we are fine, right?18:56
mriedembut that results in a warning for a successful response18:57
mriedemno18:57
sdagueI'm not sure I buy that 204 is here intentionally18:57
mriedemwell,18:57
mriedemit doesn't work for me because it started making my tests in https://review.openstack.org/#/c/435563/ fail18:57
sdaguethe fact that the 204 unit test returned content, makes me again think this is randomly just added18:57
mriedembecause i was expecting one warning, not two18:57
mriedemthe 204 unit test doesn't return content18:57
sdaguemriedem: ... that I don't accept :)18:57
sdaguemriedem: it used to18:58
*** baoli has quit IRC18:58
sdaguehttps://review.openstack.org/#/c/434339/3/nova/tests/unit/test_metadata.py@849 that's why that had to be changed18:58
mriedemrequest_mock.return_value.status_code = response_code18:58
mriedemthe actual runtime was changed to not look at status_code18:58
mriedemand so it just looks at request_mock.return_value which is truthy i guess18:58
sdaguemriedem: but the unit test simulating the 204 was returning content previously18:59
*** baoli has joined #openstack-nova18:59
mriedemyeah true18:59
sdaguewhich makes me really really believe none of this was part of the design, it was just a cantrib18:59
sdaguecantrip18:59
sdagueso stop reading so much meaning into it :)18:59
mriedemi don't know wtf a cantrip is18:59
sdaguemagic spell18:59
mriedemduped by those aussies again!19:00
sdaguespin around 3 times, I don't get a cold, ok, just do that every day19:00
sdaguethe talisman will keep the tigers away19:00
*** gouthamr has joined #openstack-nova19:00
mriedemheadache is a demon in my head?19:00
sdagueyep, pretty much19:00
mriedemso i'm still going to handle the if res and res.text case, because we don't know how people are going to use this, there could be like a first time checkin thing that returns data, and later calls don't, idk19:02
mriedemi suspect that's maybe what mikal was thinking19:03
mriedemthat would seem pretty crappy though19:03
openstackgerritJohn Garbutt proposed openstack/nova-specs master: Add spec to use Cinder's new attachment APIs  https://review.openstack.org/37320319:03
*** nikhil|afk has quit IRC19:03
*** lpetrut has quit IRC19:04
*** dharinic is now known as dharinic|lunch19:05
*** yamamoto has joined #openstack-nova19:06
*** Guest52040 has quit IRC19:08
*** ducttape_ has quit IRC19:10
*** yamamoto has quit IRC19:12
sdaguemriedem: well, we're not handling any of the 30x stuff in real ways either, like processing the redirects19:14
sdaguemriedem: honestly, I think this is being overthought, this is a custom service that the op is writing, if they write it to do bad things, .... there is only so much protection here19:15
sdagueespecially as this is in the metadata code which is ... you know, funky :)19:16
*** dulek has quit IRC19:17
*** pkoniszewski has quit IRC19:18
openstackgerritMatt Riedemann proposed openstack/nova master: Check for 204 case in DynamicVendorData  https://review.openstack.org/43978519:19
*** lpetrut has joined #openstack-nova19:19
openstackgerritMatt Riedemann proposed openstack/nova master: Only create vendordata_dynamic ksa session if needed  https://review.openstack.org/43556319:22
*** salv-orl_ has quit IRC19:23
*** pkoniszewski has joined #openstack-nova19:24
*** dulek has joined #openstack-nova19:24
mriedemVek: andreykurilin: tdurakov: we should have had a release note with this https://review.openstack.org/#/c/439141/19:27
andreykurilinoh..19:27
andreykurilinsure19:27
*** baoli has quit IRC19:27
mriedemwe can just roll one on top19:27
Gorianhuh. I got pinged here, but it's been unusally active, so I don't have history that far back...19:28
mriedemGorian: http://eavesdrop.openstack.org/irclogs/%23openstack-nova/19:28
mriedemha http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2017-03-01.log.html#t2017-03-01T06:41:5919:28
mriedemwho are you anyway?19:28
mriedem:)19:28
Gorianawesome, thanks!19:29
*** gfhellma has quit IRC19:29
Gorianmriedem so mean :(19:29
Gorianlol, idk, just random person sitting in iRC :P19:29
mriedemworks for me19:29
*** digvijay2016 has quit IRC19:29
*** fragatina has quit IRC19:29
*** fragatina has joined #openstack-nova19:30
*** raj_singh_ has joined #openstack-nova19:30
*** baoli has joined #openstack-nova19:30
Gorianlol. Who are you?19:30
*** raj_singh_ has quit IRC19:31
*** fragatina has quit IRC19:31
mriedemi am who i am19:31
mriedemthis could get really zen like19:32
*** fragatina has joined #openstack-nova19:32
openstackgerritMatt Riedemann proposed openstack/python-novaclient master: Remove functional tests for removed commands  https://review.openstack.org/43979519:34
mriedemandreykurilin: here is that test fix ^19:34
FL1SKHas anyone ever launched an instance from an ISO format that gives you EDD information unavailable from the kernel then eventually just reboots after a minute19:35
*** baoli has quit IRC19:35
FL1SKthe same image a standard KVM Host does not show the EDD information unavailable error19:35
FL1SKwhat would be different with Nova KVM? Does anyone have any clues19:36
*** jose-phillips has quit IRC19:40
*** cdent has quit IRC19:46
*** ducttape_ has joined #openstack-nova19:48
openstackgerritmelanie witt proposed openstack/nova-specs master: Proposal to count resources to check quota in API for cells  https://review.openstack.org/43174919:55
*** dikonoor has quit IRC19:57
*** annegentle has joined #openstack-nova19:57
*** pcaruana has quit IRC19:58
*** ducttape_ has quit IRC19:59
*** armax has joined #openstack-nova19:59
*** ducttape_ has joined #openstack-nova20:01
mriedemmtreinish: i think i see the issue with that fuzzy ip filtering20:01
openstackgerritTimofey Durakov proposed openstack/python-novaclient master: Release note for cell_name deprecation  https://review.openstack.org/43982220:02
*** adrian_otto has quit IRC20:02
*** dharinic|lunch is now known as dharinic20:02
*** openstackgerrit has quit IRC20:03
mtreinishmriedem: cool, so I was right it was a nova bug?20:03
*** openstackgerrit has joined #openstack-nova20:03
openstackgerritTimofey Durakov proposed openstack/python-novaclient master: Release note for cell_name deprecation  https://review.openstack.org/43982220:03
*** amoralej is now known as amoralej|off20:03
tdurakovmriedem: hi, release note for nova-client^20:04
*** lucasxu has quit IRC20:05
mriedemtdurakov: thanks, some nits inline20:05
mriedemmtreinish: here https://github.com/openstack/nova/blob/3a2a181796664fea7f6069d49f9cd367b8cff825/nova/compute/api.py#L249620:06
mriedemwe don't filter the ip in the db query actually20:06
mriedemon the first match, we return https://github.com/openstack/nova/blob/3a2a181796664fea7f6069d49f9cd367b8cff825/nova/compute/api.py#L250820:06
openstackgerritTimofey Durakov proposed openstack/python-novaclient master: Release note for cell_name deprecation  https://review.openstack.org/43982220:07
tdurakovmriedem: done20:07
*** harlowja has quit IRC20:08
*** yamamoto has joined #openstack-nova20:08
mriedemhttp://paste.openstack.org/show/600998/20:09
mriedemmtreinish: ^20:09
mriedemthat's the bug20:09
*** dulek has quit IRC20:09
*** pkoniszewski has quit IRC20:09
*** READ10 has quit IRC20:09
mriedemmtreinish: so i'm thinking we build the list of matches, and if more than one, we have to filter the matches from most specific to least specific20:10
mtreinishmriedem: oh, so that's much easier. It would have been a bit more involved if it was in the db layer20:11
mriedemi'm not entirely sure how to do that, first thought is you throw ^<address>$ on there20:11
mtreinishmriedem: yeah that makes sense. Could do a first pass on exact match (without a regex) or would that be too big a departure from the existing api semantics20:11
mriedemthat's actually easier20:12
mriedemexact match first, if no hits, use regex20:12
mriedemif multiple hits after regex... shrug?20:12
openstackgerritTimofey Durakov proposed openstack/python-novaclient master: Release note for cell_name deprecation  https://review.openstack.org/43982220:12
mtreinishmriedem: return all?20:12
mtreinishor return error20:13
mriedemreturn all20:13
mriedemthis is a LIST operation20:13
mriedemlet the client sort it out20:13
mriedemlet me see how latent this is20:13
*** yamamoto has quit IRC20:13
mriedemi also wonder if it behaves this way because of https://github.com/openstack/nova/blob/3a2a181796664fea7f6069d49f9cd367b8cff825/nova/compute/api.py#L236220:15
mriedemif you filter on fixed_ip it uses an exact regex match20:15
*** dulek has joined #openstack-nova20:15
mriedemthe tempest test doesn't use that though20:16
*** lucasxu has joined #openstack-nova20:16
*** pkoniszewski has joined #openstack-nova20:17
openstackgerritMatt Riedemann proposed openstack/python-novaclient master: Release note for cell_name deprecation  https://review.openstack.org/43982220:18
mriedemmtreinish: i put a -1 on the tempest patch and added nova to the bug report20:19
*** avolkov has quit IRC20:19
*** jose-phillips has joined #openstack-nova20:19
mriedemmtreinish: so it looks like when vish added that long ago it returned all matches https://github.com/openstack/nova/commit/ae781ee97947c33d6d43e4c21df4f338c875bf1c20:22
mriedemhttps://github.com/openstack/nova/commit/ae781ee97947c33d6d43e4c21df4f338c875bf1c#diff-516904cc81cade24a9122ecf96707bf0R202920:22
mriedemthis made it short circuit https://github.com/openstack/nova/commit/8fc7eee58ebd929dda75e467f93c381091da7ace20:22
erhudydoes anyone have any top tips for taking a particular SQL query and walking back to the SQLAlchemy statements that are responsible for it? perhaps particular settings in default_log_levels would print something useful out?20:22
mriedemerhudy: i think there are trace options in the oslo.db section20:23
mtreinishmriedem: heh, it always comes back to vish20:24
*** baoli has joined #openstack-nova20:24
mriedemheh, it's actually kaufer's regression20:25
mriedemdon't worry, i'm harranging him internally20:26
mriedemfor someone he did 2 years ago and doesn't remember at all20:26
mriedem*something20:26
*** hurricanerix has joined #openstack-nova20:30
sdagueerhudy: the generated sql is emitted by sqla at debug level, but we turn that off because its *so* noisy. If you play with some of the oslo.log default configs you can tweak it from there20:32
erhudyyeah, i just tried connection_trace and that blew up in my face with a stack trace, connection_debug is pretty noisy but getting closer20:32
Gorianmriedem: sorry, ran away to lunch20:32
*** krtaylor has quit IRC20:32
GorianI write python, so I 'm okay with Zen :P20:32
*** nic has left #openstack-nova20:32
erhudysomebody is running some ansible playbook against a cluster with 25 forks and it is causing the database to go nuclear20:32
*** nic has joined #openstack-nova20:32
erhudyso i am on a spelunking expedition to understand why20:33
mriedemerhudy: ok so you found those, sorry i was looking them up but got distracted20:33
mriedemerhudy: zzzeek might have pointers20:33
sdagueerhudy: https://github.com/openstack/oslo.log/blob/5d1a93bc0f597768e27bd116de9d7a66b4cd1f24/oslo_log/_options.py#L2020:34
erhudythanks20:34
mriedemsdague: so i guess https://review.openstack.org/#/c/324720/ is happyish20:35
mriedemnot sure the xen or vmware failures are related20:35
mriedemoh the vmware one is from november20:35
mriedemhah20:35
sdagueerhudy: I think that exposes as default_log_levels back in any of the projects, so replace it with the list you like, then debug logs for sqla should come back20:35
sdaguemriedem: I guess it didn't like the recheck20:35
sdaguemriedem: yeh, just comment what you would like in a reno (if so), and I'll update the commit message for merge20:36
sdagueit pulls out future sec exposures as well20:36
mriedemthe vmware one isn't from a recheck20:36
sdagueright, but when I update the patch, they should revote20:36
mriedemspeaking of vmware....bueller?20:36
mriedemthey won't20:37
sdagueoh20:37
sdaguewell, it's a libvirt feature20:37
sdagueI'm pretty sure you can't get there from anywhere else20:37
mriedemis it?20:37
sdaguegit grep inject_data20:39
mriedemthe xen ci failure was a stack failure20:39
sdagueI see libvirt and xen20:39
sdaguebut xen is a different function20:39
*** edmondsw has joined #openstack-nova20:39
sdagueyeh, xen half end runs around this with their own localfs call20:40
sdaguehttps://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/virt/xenapi/vm_utils.py#L247920:40
*** liangy has quit IRC20:41
sdaguethis would take it out of the libvirt path20:41
mriedemok, i assumed you'd be removing VFSLocalFS altogether20:41
sdaguethe xen path has a fallback here when the xenagent isn't a thing20:41
sdaguewell this patch was a DNM exploring a security bug20:42
sdaguea xen person would have to get on board about what the xen path looks like here, the libvirt one is pretty straight forward20:43
*** CristinaPauna has quit IRC20:44
*** liangy has joined #openstack-nova20:44
*** edmondsw has quit IRC20:46
openstackgerritMaciej Szankin proposed openstack/nova master: conf: remove *_topic config opts  https://review.openstack.org/43392420:47
*** edmondsw has joined #openstack-nova20:47
*** adrian_otto has joined #openstack-nova20:47
*** bvanhav has quit IRC20:47
*** lucasxu has quit IRC20:48
*** swann_ has joined #openstack-nova20:48
*** jtriv has joined #openstack-nova20:49
*** kuzko_ has joined #openstack-nova20:50
*** mrodden_ has joined #openstack-nova20:51
*** mmedvede_ has joined #openstack-nova20:52
*** rhagarty_ has joined #openstack-nova20:52
*** htruta` has joined #openstack-nova20:52
*** edmondsw has quit IRC20:52
*** jotr has quit IRC20:53
*** kuzko has quit IRC20:53
*** rhagarty has quit IRC20:53
*** htruta has quit IRC20:53
*** mmedvede has quit IRC20:53
*** mrodden has quit IRC20:53
*** swann has quit IRC20:53
*** mrodden_ is now known as mrodden20:53
*** mmedvede_ is now known as mmedvede20:53
*** lucasxu has joined #openstack-nova20:55
*** Apoorva has quit IRC20:55
*** Apoorva has joined #openstack-nova20:59
*** ducttape_ has quit IRC21:00
*** jvgrant has joined #openstack-nova21:01
*** harlowja has joined #openstack-nova21:01
*** harlowja has quit IRC21:01
*** harlowja has joined #openstack-nova21:01
*** pkoniszewski has quit IRC21:02
cfriesenbauzas: it looks like we set request_spec.ignore_hosts in compute.api.API.resize(), so we can't overwrite it later when we call reset_forced_destinations() from  nova.conductor.tasks.migrate.MigrationTask.execute()21:03
*** dulek has quit IRC21:03
*** ijw has quit IRC21:05
*** mjura has quit IRC21:06
*** Nakato has quit IRC21:06
*** Nakato has joined #openstack-nova21:07
*** catintheroof has joined #openstack-nova21:08
*** pkoniszewski has joined #openstack-nova21:09
*** dulek has joined #openstack-nova21:09
*** krtaylor has joined #openstack-nova21:09
*** yamamoto has joined #openstack-nova21:10
*** catintheroof has quit IRC21:10
*** catintheroof has joined #openstack-nova21:10
*** pkoniszewski has quit IRC21:12
*** dulek has quit IRC21:12
*** yamamoto has quit IRC21:12
*** yamamoto has joined #openstack-nova21:12
*** dimtruck is now known as zz_dimtruck21:14
*** salv-orlando has joined #openstack-nova21:14
*** ayogi has quit IRC21:16
*** dulek has joined #openstack-nova21:19
*** pkoniszewski has joined #openstack-nova21:19
*** yamamoto has quit IRC21:19
dansmithdtp: still around?21:20
dtpyessir21:20
*** ducttape_ has joined #openstack-nova21:20
dansmithdtp: so I think we're failing to get a list of tests that fail because we're just timing out the job on my patch21:20
dansmithtoo many fails means too many delays21:20
dansmithI ran the whole deal locally and got a good report21:20
dansmithlooking at it, the hypervisors list api is probably a self-contained thing you could work on if you want21:20
dansmithtempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON21:21
dansmithif you run that module locally you'll get five tests that fail and then you can go from there21:21
*** dulek has quit IRC21:21
dansmithcan probably start with just poking at hypervisors with the client and then run the test once you think it's working21:21
dansmithinterested?21:21
*** pkoniszewski has quit IRC21:22
dtpsure21:22
openstackgerritKaitlin Farr proposed openstack/nova master: Remove deprecated keymgr code  https://review.openstack.org/43985521:22
dansmithcool21:23
dtpi've not done any tempest stuff before.  that's external to nova right?21:23
dansmithyeah, you only need to run it though no mods required21:24
dansmithand only after you poke with nova hypervisor-list and think you have it fixed21:24
dtpoh - nova hypervisor-list is having the issue?21:25
dansmithright, and thus tempest is breaking because it's checking that interface21:26
dansmithit's actually not the client having the problem, nor tempest.. it's the server-side api code21:26
dtpi see21:26
dansmithso, nova/api/openstack/compute/hypervisors.py or something21:26
dansmiththat api now needs to iterate over cells to gather the list21:27
dtpah, ok21:27
dtpand which patch of yours?21:28
dansmiththis set: https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:multi-cell-testing21:29
dtpthanks21:29
dansmithplus this devstack patch which creates things in multiple cells:21:29
dansmithhttps://review.openstack.org/#/c/436094/21:29
*** bastafidli has quit IRC21:30
openstackgerritMaciej Szankin proposed openstack/nova master: conf: resolved final todos in libvirt conf  https://review.openstack.org/42904221:30
*** bastafidli has joined #openstack-nova21:30
*** pcaruana has joined #openstack-nova21:30
*** kfarr has quit IRC21:31
mriedemsdague: left a comment about the reno in your localfs removal change21:33
mriedemwith thoughts anyway21:33
*** pcaruana has quit IRC21:33
mriedemi'm cool with leaving VFSLocalFS in for xenapi to sort out, BobBall should probably take a look21:33
*** gouthamr has quit IRC21:33
dansmithdtp: this is the tempest module: https://github.com/openstack/tempest/blob/master/tempest/api/compute/admin/test_hypervisor.py21:38
dtpmriedem is there a deadline for pike blueprint submissions (no spec)21:38
dansmithwith multiple cells, it fails to list all the hypervisors21:38
dtpok, thanks dansmith21:38
mriedemdtp: you probably want it done by the first milestone21:38
*** ducttape_ has quit IRC21:38
dtpok ty21:39
dansmithdtp: fail looks like this: http://pastebin.com/wyh1jEYT21:39
dtpcool, thanks dansmith21:39
mriedemdtp: https://wiki.openstack.org/wiki/Nova/Pike_Release_Schedule#Dates_Overview21:39
*** claudiub|2 has joined #openstack-nova21:40
mriedemdtp: i was going to bring up spec freeze in the nova meeting tomorrow21:40
mriedemsince we didn't talk about that at the ptg21:40
dtpi'll be there (it's the late one, right?  ;)21:40
dansmithyes21:42
*** aysyd has quit IRC21:42
*** dtp is now known as dtp-afk21:43
*** dtp-afk is now known as dtp21:48
openstackgerritMatt Riedemann proposed openstack/nova master: Handle conflicts for os-assisted-volume-snapshots  https://review.openstack.org/42947621:49
*** crushil has quit IRC21:52
*** pkholkin has quit IRC21:55
*** kaisers has joined #openstack-nova21:56
*** thorst has quit IRC22:00
*** thorst has joined #openstack-nova22:00
*** kaisers has quit IRC22:01
*** boris-42_ has quit IRC22:01
dtpwhat is searchlight?22:02
*** Apoorva_ has joined #openstack-nova22:02
*** Apoorva_ has quit IRC22:03
*** Apoorva has quit IRC22:03
*** Apoorva has joined #openstack-nova22:03
*** CristinaPauna has joined #openstack-nova22:04
*** thorst has quit IRC22:04
*** yamamoto has joined #openstack-nova22:05
dansmithdtp: http://lmgtfy.com/?q=openstack+searchlight22:05
dtpheh22:05
dtpthanks22:05
* dansmith couldn't resist22:05
jrollwow22:06
mriedemhas anyone noticed that pbr 2.0 has broken nova-specs? i don't think we use upper-constraints on nova-specs22:06
dansmithdtp: with cells we'll have this problem of not being able to efficiently query all the cells, merge the list of instances and return them sorted, without doing slow things in python22:07
dansmithdtp: since searchlight is aiming to be a superfast cache of other services with all those fancy gadgets, the plan is to just delegate to them when we have N>1 cells and lots of instances22:08
*** ijw has joined #openstack-nova22:09
*** peter-os has joined #openstack-nova22:09
*** peter-os has left #openstack-nova22:09
*** lucasxu has quit IRC22:09
dtpthanks22:10
* mriedem fixes nova-specs22:12
*** ijw has quit IRC22:15
*** dave-mccowan has quit IRC22:21
*** zz_dimtruck is now known as dimtruck22:22
openstackgerritMatt Riedemann proposed openstack/nova-specs master: Update requirements to fix pbr 2.0.0 fail  https://review.openstack.org/43987822:26
*** armax has quit IRC22:26
*** browne has quit IRC22:27
*** xinli has joined #openstack-nova22:29
xinlimnestratov: Hi22:30
*** thorst has joined #openstack-nova22:30
*** CristinaPauna has quit IRC22:30
openstackgerritEd Leafe proposed openstack/nova master: placement: ironic inventory reporting  https://review.openstack.org/43760222:31
edleafejaypipes: ^^ fixed the pep8 issue22:31
*** karimb has joined #openstack-nova22:31
*** felipemonteiro__ has quit IRC22:32
*** felipemonteiro_ has quit IRC22:32
openstackgerritSujitha proposed openstack/nova master: Remove mox from nova/tests/unit/api/openstack/compute/test_create_backup.py  https://review.openstack.org/43561022:33
dimsadreznec : thorst : ping about pypowervm :)22:33
dimsadreznec : thorst : last thing we need for unblocking a bunch of people https://review.openstack.org/#/c/439790/22:33
openstackgerritSujitha proposed openstack/nova master: Remove mox from nova.tests.unit.api.openstack.compute.test_create_backup  https://review.openstack.org/43561022:34
openstackgerritMatt Riedemann proposed openstack/nova-specs master: Treat doc build warnings as errors  https://review.openstack.org/43988322:34
mriedemdansmith: do it to it https://review.openstack.org/#/c/439878/22:34
*** thorst has quit IRC22:35
mriedemdansmith: you should just fast approve22:35
dansmithmriedem: did you want the full monty?22:35
dansmithheh22:35
mriedemspecs are blocked22:35
mriedemyeah22:35
mriedemyou can keep your pants on22:35
dansmithhehe22:35
mriedemor not, whatever22:36
dansmithhow about I do what I want and don't tell you?22:36
mriedemthat also works22:37
*** ducttape_ has joined #openstack-nova22:39
dimsLOL22:39
*** ijw has joined #openstack-nova22:40
*** CristinaPauna has joined #openstack-nova22:40
openstackgerritSujitha proposed openstack/nova master: Remove mox from nova.tests.unit.api.openstack.compute.test_create_backup  https://review.openstack.org/43561022:42
*** bastafidli has quit IRC22:42
*** ijw has quit IRC22:44
*** ducttape_ has quit IRC22:45
*** breitz_ has joined #openstack-nova22:45
*** breitz has quit IRC22:46
jaypipesedleafe: cheers, had a meeting...22:47
*** esberglu has quit IRC22:48
openstackgerritPushkar Umaranikar proposed openstack/nova-specs master: Stop using Neutron admin token  https://review.openstack.org/43989022:49
*** smatzek_ has quit IRC22:49
adreznecdims: tonyb: Updated pypowervm is up on pypi https://pypi.python.org/pypi/pypowervm/1.0.0.4.122:49
*** baoli has quit IRC22:50
dimsthanks adreznec22:50
adreznecSorry for the delay22:50
tonybadreznec: #woot!  Thanks22:50
*** salv-orlando has quit IRC22:50
tonybdims: I'll update "the" review22:50
dimsgo for it tonyb22:50
*** salv-orlando has joined #openstack-nova22:51
openstackgerritMatt Riedemann proposed openstack/nova-specs master: Proposal to count resources to check quota in API for cells  https://review.openstack.org/43174922:51
*** ducttape_ has joined #openstack-nova22:51
*** tbachman has quit IRC22:52
*** breitz has joined #openstack-nova22:52
openstackgerritDan Smith proposed openstack/nova master: WIP: Get instance availability_zone without hitting the api db  https://review.openstack.org/43975422:54
openstackgerritDan Smith proposed openstack/nova master: Make scheduler target cells to get compute node instance info  https://review.openstack.org/43989122:54
*** slaweq_ has quit IRC22:54
*** breitz_ has quit IRC22:54
*** gouthamr has joined #openstack-nova22:59
*** slaweq_ has joined #openstack-nova23:00
*** ijw has joined #openstack-nova23:02
*** esberglu has joined #openstack-nova23:02
*** marst has quit IRC23:03
*** baoli has joined #openstack-nova23:04
*** tbachman has joined #openstack-nova23:06
*** esberglu has quit IRC23:06
*** mdrabe has quit IRC23:07
*** xyang1 has quit IRC23:08
*** jamesdenton has quit IRC23:09
*** baoli has quit IRC23:14
*** browne has joined #openstack-nova23:15
*** lpetrut has quit IRC23:18
openstackgerritMatt Riedemann proposed openstack/nova master: Default firewall_driver to nova.virt.firewall.NoopFirewallDriver  https://review.openstack.org/43918723:20
*** rfolco has quit IRC23:22
*** tjones has joined #openstack-nova23:22
*** mriedem has quit IRC23:24
*** haukebruno has quit IRC23:27
*** crushil has joined #openstack-nova23:27
*** ducttape_ has quit IRC23:27
*** catintheroof has quit IRC23:29
*** jaypipes has quit IRC23:30
*** Apoorva_ has joined #openstack-nova23:32
*** salv-orlando has quit IRC23:35
*** Apoorva has quit IRC23:36
*** haukebruno has joined #openstack-nova23:38
*** jwcroppe has quit IRC23:39
*** jwcroppe has joined #openstack-nova23:40
*** tbachman has quit IRC23:42
*** jaypipes has joined #openstack-nova23:44
*** ducttape_ has joined #openstack-nova23:44
*** jwcroppe has quit IRC23:44
*** dimtruck is now known as zz_dimtruck23:45
*** dave-mccowan has joined #openstack-nova23:51
*** dave-mccowan has quit IRC23:51
*** crushil has quit IRC23:51
*** yingjun has joined #openstack-nova23:54
*** zz_dimtruck is now known as dimtruck23:56
*** Guest27057 is now known as zigo23:57
*** xinli has quit IRC23:57
*** kaisers has joined #openstack-nova23:58
*** sdague has quit IRC23:58
*** tblakes has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!