*** ducttape_ has joined #openstack-nova | 00:00 | |
*** ociuhandu has quit IRC | 00:02 | |
*** marst has joined #openstack-nova | 00:02 | |
*** dtp has quit IRC | 00:03 | |
*** jaypipes has quit IRC | 00:04 | |
*** yingjun has joined #openstack-nova | 00:06 | |
*** hoonetorg has quit IRC | 00:08 | |
*** ZZelle has quit IRC | 00:10 | |
*** jaypipes has joined #openstack-nova | 00:16 | |
*** mlavalle has quit IRC | 00:21 | |
*** hoonetorg has joined #openstack-nova | 00:22 | |
*** Swami has quit IRC | 00:26 | |
*** baoli has joined #openstack-nova | 00:26 | |
*** adrian_otto has joined #openstack-nova | 00:27 | |
*** xyang1 has quit IRC | 00:28 | |
*** baoli has quit IRC | 00:31 | |
*** gfhellma has quit IRC | 00:31 | |
*** jamesdenton has joined #openstack-nova | 00:33 | |
*** salv-orlando has quit IRC | 00:33 | |
*** jamielennox is now known as jamielennox|away | 00:36 | |
jaypipes | cburgess: yup. | 00:43 |
---|---|---|
*** jamielennox|away is now known as jamielennox | 00:44 | |
*** hongbin has quit IRC | 00:46 | |
*** sacharya has joined #openstack-nova | 00:51 | |
*** tovin07_ has joined #openstack-nova | 00:52 | |
*** ijw has joined #openstack-nova | 00:56 | |
*** ijw has quit IRC | 01:01 | |
*** rfolco has quit IRC | 01:03 | |
*** rfolco has joined #openstack-nova | 01:04 | |
*** rfolco has quit IRC | 01:04 | |
*** hoangcx has joined #openstack-nova | 01:06 | |
*** sacharya has quit IRC | 01:06 | |
*** sacharya has joined #openstack-nova | 01:06 | |
*** kevinz has joined #openstack-nova | 01:13 | |
*** alex_xu has quit IRC | 01:19 | |
*** alex_xu has joined #openstack-nova | 01:19 | |
openstackgerrit | Sivasathurappan Radhakrishnan proposed openstack/nova master: Port binding based on events during live migration https://review.openstack.org/434870 | 01:20 |
*** jamesdenton has quit IRC | 01:22 | |
*** tovin07_ has quit IRC | 01:25 | |
*** alex_xu has quit IRC | 01:25 | |
*** alex_xu has joined #openstack-nova | 01:25 | |
*** alex_xu has quit IRC | 01:26 | |
*** alex_xu has joined #openstack-nova | 01:27 | |
*** jamesdenton has joined #openstack-nova | 01:28 | |
*** jamesdenton has quit IRC | 01:30 | |
*** CristinaPauna has quit IRC | 01:35 | |
*** thorst has joined #openstack-nova | 01:41 | |
*** thorst has quit IRC | 01:46 | |
*** ducttape_ has quit IRC | 01:46 | |
*** thorst has joined #openstack-nova | 01:46 | |
*** ducttape_ has joined #openstack-nova | 01:46 | |
*** CristinaPauna has joined #openstack-nova | 01:48 | |
*** edmondsw has joined #openstack-nova | 01:48 | |
*** tbachman has joined #openstack-nova | 01:49 | |
*** thorst has quit IRC | 01:50 | |
*** hoonetorg has quit IRC | 01:52 | |
*** edmondsw has quit IRC | 01:53 | |
*** jamesdenton has joined #openstack-nova | 01:53 | |
*** jamesdenton has quit IRC | 01:57 | |
*** ijw has joined #openstack-nova | 01:57 | |
*** tovin07 has quit IRC | 01:59 | |
*** hoonetorg has joined #openstack-nova | 02:01 | |
*** edmondsw has joined #openstack-nova | 02:02 | |
*** ijw has quit IRC | 02:03 | |
*** dave-mccowan has quit IRC | 02:03 | |
*** tovin07 has joined #openstack-nova | 02:03 | |
*** gcb has joined #openstack-nova | 02:04 | |
*** edmondsw has quit IRC | 02:05 | |
*** avolkov has quit IRC | 02:05 | |
*** fragatina has quit IRC | 02:06 | |
*** raunak has quit IRC | 02:08 | |
*** gcb has quit IRC | 02:09 | |
*** avolkov has joined #openstack-nova | 02:10 | |
*** ducttape_ has quit IRC | 02:11 | |
*** thorst has joined #openstack-nova | 02:13 | |
*** iceyao has joined #openstack-nova | 02:14 | |
*** iceyao has quit IRC | 02:15 | |
*** avolkov has quit IRC | 02:15 | |
*** iceyao has joined #openstack-nova | 02:16 | |
*** avolkov has joined #openstack-nova | 02:18 | |
*** browne has quit IRC | 02:20 | |
*** unicell has quit IRC | 02:21 | |
*** kaisers__ has joined #openstack-nova | 02:24 | |
*** ducttape_ has joined #openstack-nova | 02:24 | |
*** mtanino has quit IRC | 02:25 | |
*** kaisers_ has quit IRC | 02:27 | |
*** gongysh has joined #openstack-nova | 02:33 | |
*** thorst has quit IRC | 02:33 | |
*** thorst has joined #openstack-nova | 02:33 | |
*** owalsh is now known as owalsh-afk | 02:34 | |
*** Apoorva_ has joined #openstack-nova | 02:36 | |
*** avolkov has quit IRC | 02:37 | |
*** thorst has quit IRC | 02:38 | |
*** Apoorva has quit IRC | 02:39 | |
*** Apoorva_ has quit IRC | 02:40 | |
*** sapcc-bot1 has joined #openstack-nova | 02:52 | |
*** carthaca_ has quit IRC | 02:52 | |
*** sapcc-bot has quit IRC | 02:52 | |
*** carthaca_ has joined #openstack-nova | 02:52 | |
*** gaoyuan has joined #openstack-nova | 02:52 | |
*** gaoyuan has quit IRC | 02:53 | |
*** lucasxu has joined #openstack-nova | 02:54 | |
*** lucasxu has quit IRC | 02:57 | |
*** ijw has joined #openstack-nova | 02:59 | |
*** gcb has joined #openstack-nova | 03:01 | |
*** zhurong has joined #openstack-nova | 03:03 | |
*** ducttape_ has quit IRC | 03:04 | |
*** ijw has quit IRC | 03:04 | |
*** hongbin has joined #openstack-nova | 03:06 | |
*** yamahata has quit IRC | 03:08 | |
*** thorst has joined #openstack-nova | 03:08 | |
*** thorst has quit IRC | 03:08 | |
*** jwcroppe has joined #openstack-nova | 03:10 | |
*** phuongnh has joined #openstack-nova | 03:11 | |
*** zhurong has quit IRC | 03:13 | |
*** gaoyuan has joined #openstack-nova | 03:21 | |
*** ayogi has joined #openstack-nova | 03:22 | |
*** fragatina has joined #openstack-nova | 03:22 | |
*** fragatina has quit IRC | 03:22 | |
*** fragatina has joined #openstack-nova | 03:23 | |
*** rfolco has joined #openstack-nova | 03:24 | |
*** rfolco has quit IRC | 03:24 | |
*** gaoyuan has quit IRC | 03:25 | |
*** ayogi has quit IRC | 03:31 | |
*** salv-orlando has joined #openstack-nova | 03:34 | |
*** amotoki_ has joined #openstack-nova | 03:36 | |
*** salv-orlando has quit IRC | 03:39 | |
*** thorst has joined #openstack-nova | 03:39 | |
*** amotoki has quit IRC | 03:39 | |
*** thorst has quit IRC | 03:40 | |
*** ducttape_ has joined #openstack-nova | 03:41 | |
*** fragatina has quit IRC | 03:44 | |
*** raunak has joined #openstack-nova | 03:44 | |
*** fragatina has joined #openstack-nova | 03:45 | |
*** armax has joined #openstack-nova | 03:45 | |
*** tiendc has joined #openstack-nova | 03:46 | |
*** claudiub has quit IRC | 03:46 | |
*** thorst has joined #openstack-nova | 03:49 | |
*** thorst has quit IRC | 03:50 | |
*** mkrai_ has joined #openstack-nova | 03:50 | |
*** ijw has joined #openstack-nova | 04:00 | |
*** kamtamtun has joined #openstack-nova | 04:00 | |
*** ducttape_ has quit IRC | 04:05 | |
*** nicolasbock has quit IRC | 04:06 | |
*** ijw has quit IRC | 04:06 | |
*** READ10 has quit IRC | 04:09 | |
*** armax has quit IRC | 04:11 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/439329 | 04:12 |
*** sudipto_ has joined #openstack-nova | 04:14 | |
*** sudipto has joined #openstack-nova | 04:14 | |
*** karthiks has quit IRC | 04:14 | |
*** ducttape_ has joined #openstack-nova | 04:15 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-novaclient master: Updated from global requirements https://review.openstack.org/439361 | 04:16 |
*** tbachman has quit IRC | 04:16 | |
*** highfield has joined #openstack-nova | 04:18 | |
*** sreeram_v has joined #openstack-nova | 04:19 | |
*** yuntongjin has joined #openstack-nova | 04:20 | |
*** unicell has joined #openstack-nova | 04:20 | |
*** ducttape_ has quit IRC | 04:21 | |
*** gaoyuan has joined #openstack-nova | 04:22 | |
*** ducttape_ has joined #openstack-nova | 04:23 | |
*** hoonetorg has quit IRC | 04:23 | |
*** crushil has joined #openstack-nova | 04:23 | |
*** highfield has quit IRC | 04:24 | |
*** highfield has joined #openstack-nova | 04:25 | |
*** yuntongjin has quit IRC | 04:25 | |
*** mdnadeem has joined #openstack-nova | 04:26 | |
*** psachin has joined #openstack-nova | 04:26 | |
*** sreeram_v has quit IRC | 04:27 | |
*** links has joined #openstack-nova | 04:27 | |
*** gaoyuan has quit IRC | 04:28 | |
*** diga has joined #openstack-nova | 04:29 | |
*** sree has joined #openstack-nova | 04:29 | |
*** unicell has quit IRC | 04:31 | |
*** highfield has quit IRC | 04:32 | |
*** highfield has joined #openstack-nova | 04:33 | |
*** hoonetorg has joined #openstack-nova | 04:35 | |
*** unicell has joined #openstack-nova | 04:36 | |
*** avolkov has joined #openstack-nova | 04:40 | |
*** adisky_ has joined #openstack-nova | 04:41 | |
*** hongbin has quit IRC | 04:41 | |
*** tiendc has quit IRC | 04:43 | |
*** fragatina has quit IRC | 04:44 | |
*** adrian_otto has quit IRC | 04:44 | |
*** yamahata has joined #openstack-nova | 04:45 | |
*** unicell has quit IRC | 04:47 | |
*** fragatina has joined #openstack-nova | 04:47 | |
*** yuntongjin has joined #openstack-nova | 04:47 | |
*** ducttape_ has quit IRC | 04:47 | |
*** highfield has quit IRC | 04:48 | |
*** gaoyuan has joined #openstack-nova | 04:49 | |
*** unicell has joined #openstack-nova | 04:50 | |
gaoyuan | who is unicell | 04:50 |
*** thorst has joined #openstack-nova | 04:50 | |
*** ratailor has joined #openstack-nova | 04:54 | |
*** ayogi has joined #openstack-nova | 04:54 | |
*** thorst has quit IRC | 04:55 | |
*** ijw has joined #openstack-nova | 04:56 | |
*** unicell has quit IRC | 05:00 | |
*** amotoki has joined #openstack-nova | 05:07 | |
*** prateek_ has joined #openstack-nova | 05:09 | |
*** amotoki_ has quit IRC | 05:09 | |
*** fragatina has quit IRC | 05:09 | |
*** moshele has joined #openstack-nova | 05:10 | |
*** shaner has quit IRC | 05:11 | |
*** prateek has joined #openstack-nova | 05:12 | |
*** carthaca_ has quit IRC | 05:16 | |
*** carthaca_1 has joined #openstack-nova | 05:16 | |
*** artom has quit IRC | 05:17 | |
*** artom_ has joined #openstack-nova | 05:17 | |
*** moshele has quit IRC | 05:18 | |
*** moshele has joined #openstack-nova | 05:18 | |
*** prateek__ has joined #openstack-nova | 05:20 | |
*** prometheanfire has joined #openstack-nova | 05:20 | |
prometheanfire | so, upgrades broken due to a db rename? | 05:21 |
*** karthiks has joined #openstack-nova | 05:25 | |
*** dikonoor has joined #openstack-nova | 05:29 | |
prometheanfire | getting this isn't that helpful :| | 05:31 |
prometheanfire | Cell0 is already setup | 05:31 |
prometheanfire | Unable to sync cell0 schema: (psycopg2.OperationalError) FATAL: database "nova_cell0" does not exist | 05:31 |
*** crushil has quit IRC | 05:32 | |
prometheanfire | is it still calling the setup even if it's already set up? | 05:32 |
*** bhagyashris has joined #openstack-nova | 05:33 | |
*** salv-orlando has joined #openstack-nova | 05:35 | |
*** sandanar has joined #openstack-nova | 05:36 | |
*** sacharya has quit IRC | 05:39 | |
*** gouthamr has quit IRC | 05:40 | |
*** sacharya has joined #openstack-nova | 05:40 | |
*** salv-orlando has quit IRC | 05:40 | |
*** kaisers__ has quit IRC | 05:41 | |
*** mdrabe_ has quit IRC | 05:43 | |
*** sridharg has joined #openstack-nova | 05:45 | |
*** sacharya has quit IRC | 05:45 | |
*** gaoyuan has quit IRC | 05:47 | |
*** gaoyuan has joined #openstack-nova | 05:47 | |
*** ducttape_ has joined #openstack-nova | 05:48 | |
*** ducttape_ has quit IRC | 05:53 | |
*** trinaths has joined #openstack-nova | 05:55 | |
openstackgerrit | MarkMielke proposed openstack/nova master: DiskFilter handling for free space less than zero https://review.openstack.org/430091 | 06:01 |
*** dikonoor has quit IRC | 06:02 | |
*** dikonoor has joined #openstack-nova | 06:03 | |
*** adrian_otto has joined #openstack-nova | 06:05 | |
*** raunak has quit IRC | 06:05 | |
*** gaoyuan has quit IRC | 06:05 | |
*** adrian_otto has quit IRC | 06:07 | |
*** huanxie has joined #openstack-nova | 06:07 | |
*** unicell has joined #openstack-nova | 06:08 | |
*** adrian_otto has joined #openstack-nova | 06:08 | |
*** kamtamtun has quit IRC | 06:10 | |
*** gaoyuan has joined #openstack-nova | 06:10 | |
*** adrian_otto has quit IRC | 06:13 | |
*** nmathew has joined #openstack-nova | 06:15 | |
*** hoonetorg has quit IRC | 06:16 | |
*** irenab_ has quit IRC | 06:19 | |
*** bhagyashris has quit IRC | 06:21 | |
*** fragatina has joined #openstack-nova | 06:22 | |
*** bhagyashris has joined #openstack-nova | 06:22 | |
*** irenab_ has joined #openstack-nova | 06:23 | |
*** lucasxu has joined #openstack-nova | 06:25 | |
prometheanfire | the nova_cell0 db creation was non-obvious, might want to update the ocata release notes / install guide | 06:25 |
prometheanfire | working now at least :D | 06:26 |
*** salv-orlando has joined #openstack-nova | 06:26 | |
*** yuntongjin has quit IRC | 06:28 | |
*** ducnc has quit IRC | 06:28 | |
*** gaoyuan has quit IRC | 06:29 | |
*** hoonetorg has joined #openstack-nova | 06:30 | |
*** gaoyuan has joined #openstack-nova | 06:30 | |
*** fragatina has quit IRC | 06:31 | |
*** lpetrut has joined #openstack-nova | 06:31 | |
*** nkrinner_afk is now known as nkrinner | 06:32 | |
*** kornicameister has joined #openstack-nova | 06:33 | |
prometheanfire | docs don't mention placement being needed by compute hosts either | 06:33 |
*** gaoyuan_ has joined #openstack-nova | 06:33 | |
*** gaoyuan__ has joined #openstack-nova | 06:34 | |
*** gaoyuan_ has quit IRC | 06:35 | |
*** gaoyuan__ has quit IRC | 06:35 | |
*** yuntongjin has joined #openstack-nova | 06:37 | |
*** gaoyuan has quit IRC | 06:37 | |
*** gaoyuan has joined #openstack-nova | 06:37 | |
gaoyuan | who is gorian | 06:41 |
*** kaisers_ has joined #openstack-nova | 06:42 | |
*** ltomasbo|away is now known as ltomasbo | 06:42 | |
*** andreas_s has joined #openstack-nova | 06:44 | |
*** mjura has joined #openstack-nova | 06:45 | |
prometheanfire | what port does placement go on by default? | 06:48 |
*** prateek_ has quit IRC | 06:49 | |
*** prateek has quit IRC | 06:49 | |
*** prateek__ has quit IRC | 06:49 | |
*** sridharg has quit IRC | 06:50 | |
*** prateek has joined #openstack-nova | 06:50 | |
*** rcernin has joined #openstack-nova | 06:51 | |
*** thorst has joined #openstack-nova | 06:52 | |
*** salv-orl_ has joined #openstack-nova | 06:52 | |
*** lucasxu has quit IRC | 06:54 | |
*** salv-orlando has quit IRC | 06:55 | |
*** thorst has quit IRC | 06:56 | |
*** Oku_OS-away is now known as Oku_OS | 07:00 | |
*** sridharg has joined #openstack-nova | 07:02 | |
*** namnh has joined #openstack-nova | 07:04 | |
*** yamamoto has quit IRC | 07:07 | |
*** jaosorior has joined #openstack-nova | 07:09 | |
*** kaisers_ has quit IRC | 07:09 | |
*** tesseract has joined #openstack-nova | 07:12 | |
*** ducnc has joined #openstack-nova | 07:15 | |
*** udesale has joined #openstack-nova | 07:18 | |
*** ducttape_ has joined #openstack-nova | 07:19 | |
*** amotoki has quit IRC | 07:20 | |
*** ducttape_ has quit IRC | 07:23 | |
*** salv-orl_ has quit IRC | 07:25 | |
*** mnestratov has joined #openstack-nova | 07:27 | |
*** claudiub has joined #openstack-nova | 07:29 | |
*** claudiub|2 has joined #openstack-nova | 07:31 | |
*** zhs has joined #openstack-nova | 07:33 | |
*** amotoki has joined #openstack-nova | 07:34 | |
*** claudiub has quit IRC | 07:34 | |
*** yamahata has quit IRC | 07:38 | |
*** yamamoto has joined #openstack-nova | 07:40 | |
*** bhagyashris has quit IRC | 07:40 | |
*** amotoki has quit IRC | 07:42 | |
openstackgerrit | Andrey Volkov proposed openstack/nova master: live-mig: Add claims and proper resource tracking https://review.openstack.org/244489 | 07:43 |
openstackgerrit | Andrey Volkov proposed openstack/nova master: libvirt: pass libvirt reference methods to migration https://review.openstack.org/328997 | 07:43 |
openstackgerrit | Andrey Volkov proposed openstack/nova master: libvirt: live-migrate updates NUMA and cpus in the XML https://review.openstack.org/286744 | 07:43 |
*** edand has joined #openstack-nova | 07:44 | |
Gorian | gaoyuan, just me - why ? | 07:45 |
Gorian | 374 people in this channel, and you are wondering why I am? :P | 07:46 |
*** dimtruck is now known as zz_dimtruck | 07:48 | |
*** ralonsoh has joined #openstack-nova | 07:55 | |
*** markus_z has joined #openstack-nova | 07:57 | |
*** sree has quit IRC | 07:58 | |
*** sree has joined #openstack-nova | 07:59 | |
*** lpetrut has quit IRC | 08:02 | |
*** kaisers_ has joined #openstack-nova | 08:05 | |
openstackgerrit | MarkMielke proposed openstack/nova master: DiskFilter handling for free space less than zero https://review.openstack.org/430091 | 08:09 |
*** udesale has quit IRC | 08:10 | |
*** udesale has joined #openstack-nova | 08:10 | |
*** ducnc has quit IRC | 08:10 | |
*** ducnc has joined #openstack-nova | 08:10 | |
*** kaisers_ has quit IRC | 08:12 | |
*** kaisers_ has joined #openstack-nova | 08:12 | |
*** jschlueter has quit IRC | 08:20 | |
*** salv-orlando has joined #openstack-nova | 08:24 | |
openstackgerrit | MarkMielke proposed openstack/nova master: DiskFilter handling for free space less than zero https://review.openstack.org/430091 | 08:25 |
*** sridharg has quit IRC | 08:25 | |
*** sridharg has joined #openstack-nova | 08:25 | |
*** sridharg has quit IRC | 08:25 | |
bauzas | good morning Nova | 08:27 |
*** sridharg has joined #openstack-nova | 08:27 | |
*** unicell has quit IRC | 08:28 | |
*** ijw has quit IRC | 08:28 | |
*** ftersin has joined #openstack-nova | 08:29 | |
*** ijw has joined #openstack-nova | 08:30 | |
*** amotoki has joined #openstack-nova | 08:32 | |
*** nmathew- has joined #openstack-nova | 08:32 | |
*** GnomeKing has quit IRC | 08:34 | |
openstackgerrit | Moshe Levi proposed openstack/nova master: [WIP] OVS acceleration https://review.openstack.org/398265 | 08:34 |
*** nmathew has quit IRC | 08:35 | |
*** nmathew has joined #openstack-nova | 08:35 | |
*** nmathew- has quit IRC | 08:35 | |
*** romainh has joined #openstack-nova | 08:37 | |
ftersin | johnthetubaguy: hi. could you please look at https://review.openstack.org/#/c/304715/ , i tried to address your comments, but not sure the result is what you wanted, since you didn't answer on my questions there | 08:39 |
johnthetubaguy | ftersin: we discussed at the PTG adding a cinder ephemeral disk driver, would that work for you? | 08:43 |
*** jpena|away is now known as jpena | 08:46 | |
ftersin | johnthetubaguy: it will consume volumes which will be a bit different than running instances w/o cinder at all | 08:49 |
*** ducttape_ has joined #openstack-nova | 08:49 | |
johnthetubaguy | ftersin: the user's Nova API calls would be identical, its just the code creating the disks would create volumes in Cinder. | 08:50 |
*** romainh has quit IRC | 08:51 | |
ftersin | johnthetubaguy: moreover, that solution is just discussed, but not implemented yet. From the other side we have that solution, which is implemented for previous OS versions as well, and integrated to JuJu and Fuel via corresponding charms/plugins | 08:51 |
*** romainh1 has joined #openstack-nova | 08:51 | |
*** romainh1 has quit IRC | 08:51 | |
*** romainh has joined #openstack-nova | 08:52 | |
*** yuntongjin has quit IRC | 08:52 | |
*** ducttape_ has quit IRC | 08:53 | |
johnthetubaguy | ftersin: the problem is if we added it, we would want to deprecate it as soon as we landed the Cinder one, and create some kind of transition system, etc, so we didn't have to keep maintaining the extra code for each and every Cinder backend twice. | 08:53 |
openstackgerrit | Alex Xu proposed openstack/nova-specs master: The ResourceProviderTraits API - Manage traits with ResourceProviders https://review.openstack.org/345138 | 08:54 |
ftersin | johnthetubaguy: do you want to deprecate Ceph backend as well? | 08:54 |
johnthetubaguy | ftersin: honestly my preference is to also deprecate the local volume support, but I totally need to talk to mdbooth about that | 08:55 |
johnthetubaguy | my local volume, I mean LVM | 08:55 |
*** slaweq__ has quit IRC | 08:55 | |
johnthetubaguy | ftersin: that way, cinder manages storage, neutron manages networking, life is simpler | 08:56 |
ftersin | johnthetubaguy: i agree with the deprecation of LVM, but what for Ceph? it's used widely | 08:56 |
johnthetubaguy | ftersin: I mean all ephemeral storage including ceph, transition it to cinder | 08:57 |
johnthetubaguy | ftersin: if thats not possible, I would like to understand why | 08:57 |
*** amoralej|off is now known as amoralej | 08:58 | |
johnthetubaguy | ftersin: at this point, thats all totally my current preference, rather than any kind of consenus from the PTG | 08:58 |
*** jpena is now known as jpena|away | 08:58 | |
*** slaweq__ has joined #openstack-nova | 08:59 | |
ftersin | johnthetubaguy: well, then you'll need a transition procedure. It will affects more than one backend, so it's not a big problem if there will be 2 or 3 such backends | 08:59 |
*** zzzeek has quit IRC | 09:00 | |
ftersin | It's OK for us. We'll be deprecated along with Ceph | 09:00 |
johnthetubaguy | ftersin: but each transition would be specific to the backend, for sure | 09:00 |
*** zzzeek has joined #openstack-nova | 09:00 | |
*** hoangcx has left #openstack-nova | 09:00 | |
johnthetubaguy | i.e. adding more drivers now means a lot more work later | 09:00 |
*** alex_xu has quit IRC | 09:01 | |
*** ralonsoh has quit IRC | 09:01 | |
*** alex_xu has joined #openstack-nova | 09:02 | |
johnthetubaguy | ftersin: now if we sit down, and getting the cinder support is cycles and cycles away, clearly thats not the right way to go, I just think we don't have enough info to make that call right now | 09:02 |
ftersin | more checks, probably. But anyway you'll have to develop a pretty common transition system (at least to commonize lvm and ceph things), so it will be not very big extra work to additionaly support another driver there | 09:02 |
johnthetubaguy | ftersin: in my head the hard bit is "import" volume into Cinder, which feels like its going to be specific to each platform, the common bit is just the loop to call that function for each disk on the system in init_host, but I could be missing something | 09:04 |
ftersin | under 'that call' you mean the switching to Cinder backend or adding new volume based backends? | 09:04 |
johnthetubaguy | I mean working out how to "move" the volume from being managed by Nova to being managed by Cinder, I think though using this call somehow: https://developer.openstack.org/api-ref/block-storage/v2/index.html?expanded=manage-existing-volume-detail#manage-existing-volume | 09:05 |
*** zerda3 has joined #openstack-nova | 09:06 | |
*** jpena|away is now known as jpena | 09:06 | |
ftersin | but you'll not need to acquire all volumes, only used for local disks. At the first glance the only not common thing is to fill connection strings | 09:08 |
johnthetubaguy | ftersin: filling in the "ref" parameter worries me I guess, and ensuring each backend supports that cinder API in the same way | 09:09 |
johnthetubaguy | ftersin: I think the action here is to discuss the cost of this all in the alternatives section in the spec. Just a few sentences, thats all, to show it has been considered | 09:10 |
ftersin | sure, each volume driver in Nova can compose a new connection string to attach a volume. But if they can to compose the string for attached volumes? | 09:11 |
johnthetubaguy | ftersin: yeah, maybe thats not as bad as I think it is. I didn't discover that cinder API till just now, which makes me worry a little bit less | 09:14 |
ftersin | johnthetubaguy: ok, i may add a consideration of Cinder backend alternative. Do you have a link to appropriate discussion or the result docs or smth else? | 09:14 |
johnthetubaguy | ftersin: good question, I think jgriffith was taking the action on that one, I am hoping to see a nova-spec from him around that | 09:15 |
*** tovin07 has quit IRC | 09:15 | |
*** karimb has joined #openstack-nova | 09:16 | |
sfinucan | mriedem_away: https://review.openstack.org/#/c/412390/ | 09:19 |
sfinucan | mriedem_away: I /did/ deprecate firewall_driver :) (along with pretty much everything else nova-network'y - https://review.openstack.org/#/q/topic:bp/centralize-config-options-pike+owner:%22Stephen+Finucane+%253Csfinucan%2540redhat.com%253E%22+status:open) | 09:20 |
sfinucan | tonyb: What are we celebrating? :) | 09:20 |
*** yamamoto has quit IRC | 09:24 | |
*** yuntongjin has joined #openstack-nova | 09:24 | |
ftersin | johnthetubaguy: well, i'll try to monitor gerrit for that, or ask him. Right now i'm going to add that alternative to the spec and reupload it. Is it ok for you? | 09:24 |
johnthetubaguy | ftersin: that sounds perfect, thank you | 09:24 |
*** hshiina has joined #openstack-nova | 09:27 | |
ftersin | johnthetubaguy: thank you too | 09:28 |
*** lucas-afk is now known as lucasagomes | 09:28 | |
*** vishwanathj has quit IRC | 09:30 | |
*** vishwanathj has joined #openstack-nova | 09:31 | |
*** yingjun has quit IRC | 09:31 | |
openstackgerrit | sahid proposed openstack/nova master: numa: add numa constraints for emulator threads policy https://review.openstack.org/385023 | 09:31 |
openstackgerrit | sahid proposed openstack/nova master: libvirt: return a CPU overhead if isolate emulator threads requested https://review.openstack.org/385364 | 09:31 |
openstackgerrit | sahid proposed openstack/nova master: numa: fit instance topology with cpus reserved onto cores https://review.openstack.org/400875 | 09:31 |
openstackgerrit | sahid proposed openstack/nova master: virt: update overhead to take into account vCPUs https://review.openstack.org/385024 | 09:31 |
openstackgerrit | sahid proposed openstack/nova master: libvirt: make emulator threads to run on the reserved pCPU https://review.openstack.org/400878 | 09:31 |
openstackgerrit | sahid proposed openstack/nova master: numa: take into account cpus reserved https://review.openstack.org/400876 | 09:31 |
openstackgerrit | sahid proposed openstack/nova master: numa: update numa usage incording the cpu reserved https://review.openstack.org/400877 | 09:31 |
*** ociuhandu has joined #openstack-nova | 09:32 | |
*** ijw has quit IRC | 09:34 | |
*** ociuhandu has quit IRC | 09:36 | |
gmann | alex_xu: johnthetubaguy I would not be available for today meeting due to other works. | 09:37 |
alex_xu | gmann: got it | 09:38 |
*** derekh has joined #openstack-nova | 09:41 | |
*** nmathew has quit IRC | 09:43 | |
*** nmathew has joined #openstack-nova | 09:43 | |
*** karimb has quit IRC | 09:45 | |
openstackgerrit | Alfredo Moralejo proposed openstack/nova master: Remove domains *-log-* from compile_catalog https://review.openstack.org/439500 | 09:47 |
tonyb | sfinucan: the merge of your pbr patch ... and then it all went horribly wrong | 09:47 |
sfinucan | tonyb: oh, do tell | 09:48 |
openstackgerrit | Alfredo Moralejo proposed openstack/nova master: Remove domains *-log-* from compile_catalog https://review.openstack.org/439500 | 09:48 |
bauzas | tonyb: not sure I fully understood the pbr major version potential problem you raised | 09:49 |
*** ducttape_ has joined #openstack-nova | 09:50 | |
*** carthaca_1 has quit IRC | 09:51 | |
*** sapcc-bot1 has quit IRC | 09:51 | |
tonyb | sfinucan: It seems a few projects (in and out of OpenStack) have defensive caps on pbr < 2.0.0 so we're stuck until they get fixed | 09:52 |
*** databus23_ has joined #openstack-nova | 09:52 | |
*** carthaca_ has joined #openstack-nova | 09:52 | |
*** dgonzalez_ has joined #openstack-nova | 09:52 | |
*** tpatzig_ has joined #openstack-nova | 09:52 | |
*** david_1 has joined #openstack-nova | 09:52 | |
openstackgerrit | John Garbutt proposed openstack/nova-specs master: Backlog spec describing Nova's quota needs https://review.openstack.org/429678 | 09:52 |
tonyb | bauzas: it *shoudln't* affect nova but projects under Telemtry will be a little broken until we fix the pbr thing (or they land a local patch) | 09:52 |
johnthetubaguy | tonyb: I meant to ping you about that spec on capabilties, although sounds like you are busy with other fires | 09:53 |
prometheanfire | was there any docs made for the install guide for setting up the placement api? | 09:53 |
*** databus23_ has quit IRC | 09:54 | |
*** tpatzig_ has quit IRC | 09:54 | |
*** dgonzalez_ has quit IRC | 09:54 | |
*** david_1 has quit IRC | 09:54 | |
*** sapcc-bot has joined #openstack-nova | 09:54 | |
tonyb | johnthetubaguy: I hope they'll be damped by tomorrow, so I shoudl be able to focus on it tomorrow | 09:54 |
prometheanfire | because https://docs.openstack.org/developer/nova/placement.html seems kinda lacking, for instance, doesn't say what port it's running on | 09:54 |
*** ducttape_ has quit IRC | 09:54 | |
johnthetubaguy | prometheanfire: yeah, I was just going to point to https://docs.openstack.org/developer/nova/placement.html#deployment | 09:55 |
johnthetubaguy | tonyb: coolness | 09:55 |
*** mkrai_ has quit IRC | 09:55 | |
bauzas | tonyb: okay, thanks for the feeback | 09:55 |
tonyb | prometheanfire: check devstack or wit for the docs install guide | 09:55 |
johnthetubaguy | prometheanfire: basically its done the same way keystone is deployed, so the port etc is defined by mod_wsgi, etc | 09:55 |
johnthetubaguy | prometheanfire: and +1 tonyb, devstack shows how thats done, to some extent | 09:56 |
johnthetubaguy | prometheanfire: jaypipes would know more of the doc plan when he comes online later today | 09:56 |
prometheanfire | tonyb: I'm actually checking osa first :P | 09:57 |
*** carthaca_ has quit IRC | 09:57 | |
*** sapcc-bot has quit IRC | 09:57 | |
*** david_1 has joined #openstack-nova | 09:57 | |
*** databus23_ has joined #openstack-nova | 09:57 | |
*** carthaca_ has joined #openstack-nova | 09:57 | |
*** sapcc-bot has joined #openstack-nova | 09:57 | |
*** dgonzalez_ has joined #openstack-nova | 09:57 | |
*** tpatzig_ has joined #openstack-nova | 09:57 | |
tonyb | prometheanfire: fair enough | 09:57 |
*** andreas_s has quit IRC | 09:57 | |
prometheanfire | though osa has it as optional | 09:57 |
johnthetubaguy | prometheanfire: yeah, I walked through that with OSA, so it should be there now | 09:57 |
prometheanfire | and it's not :P | 09:57 |
johnthetubaguy | prometheanfire: I thought they had updated that for this cycle, I guess not | 09:58 |
johnthetubaguy | by this I mean ocata | 09:58 |
*** iceyao has quit IRC | 09:58 | |
prometheanfire | right | 09:58 |
johnthetubaguy | andymccr: did you make placement api required yet in OSA ^ | 09:58 |
prometheanfire | maybe it's meant to only be configured on certian nodes | 09:58 |
prometheanfire | johnthetubaguy: so... what's the default port for it? | 09:59 |
*** david_1 has quit IRC | 09:59 | |
*** databus23_ has quit IRC | 09:59 | |
*** dgonzalez_ has quit IRC | 09:59 | |
*** tpatzig_ has quit IRC | 09:59 | |
prometheanfire | like nova has a default port | 09:59 |
johnthetubaguy | prometheanfire: looking here https://github.com/openstack-dev/devstack/blob/55dab95237302fa371b88a2edce06de201d83f52/files/apache-placement-api.template bauzas might be able to help | 09:59 |
johnthetubaguy | prometheanfire: placement doesn't have a default port, just like keystone, AFAIK | 09:59 |
prometheanfire | 8780, thanks :D | 09:59 |
bauzas | prometheanfire: johnthetubaguy: sorry, on meeting atm | 09:59 |
johnthetubaguy | oh, I guess that kinda is the default | 09:59 |
prometheanfire | keystone isn't 5000 / 35357 ? | 10:00 |
johnthetubaguy | well, in theory, none of that matters, you just get the URL from the service catalog | 10:00 |
prometheanfire | I know it can be discovered, but it's nice to be consistant :P | 10:00 |
*** yuntongjin has quit IRC | 10:01 | |
johnthetubaguy | prometheanfire: actually looks like us and keystone might be on 443, technically, https://github.com/openstack-dev/devstack/blob/55dab95237302fa371b88a2edce06de201d83f52/files/apache-keystone.template | 10:01 |
johnthetubaguy | prometheanfire: but I am not sure | 10:01 |
andymccr | johnthetubaguy: it's on by default - originally i set it up with a flag but i will probably remove that flag | 10:01 |
prometheanfire | andymccr: cool, was confused about that :D | 10:01 |
johnthetubaguy | andymccr: ah, cool, that makes sense, just a transition thing | 10:01 |
andymccr | prometheanfire: yeah i wanted to set it up prior to it being required and never got it going - and then didn't remove the flag :P | 10:02 |
andymccr | but yeah it should go now | 10:02 |
andymccr | either way if you dont force it off - it gets set up | 10:02 |
prometheanfire | johnthetubaguy: I think it's also on 443 in devstack, but primarily on PUBLICPORT/ADMINPORT | 10:02 |
johnthetubaguy | yeah, that makes sense | 10:03 |
*** Dinesh_Bhor has joined #openstack-nova | 10:03 | |
*** lpetrut has joined #openstack-nova | 10:03 | |
*** karimb has joined #openstack-nova | 10:05 | |
andymccr | prometheanfire: there is a discussion about the default ports on the mailing list - essentially there is no default the idea is you use port 80/443 - but we needed one for our backend since we dont have it setup to do that at this point. | 10:05 |
andymccr | so we went with what the tripleo/puppet people had to keep it at least default in that regard | 10:05 |
prometheanfire | ya +nova_placement_service_port: 8780 | 10:06 |
*** asettle has joined #openstack-nova | 10:06 | |
*** diga has quit IRC | 10:06 | |
*** andreas_s has joined #openstack-nova | 10:11 | |
*** kevinz has quit IRC | 10:12 | |
*** mvk has quit IRC | 10:12 | |
*** gongysh has quit IRC | 10:17 | |
openstackgerrit | Béla Vancsics proposed openstack/nova master: Remove unused variable https://review.openstack.org/439516 | 10:18 |
*** phuongnh has quit IRC | 10:18 | |
*** iceyao has joined #openstack-nova | 10:18 | |
*** ralonsoh has joined #openstack-nova | 10:20 | |
*** aloga has quit IRC | 10:21 | |
*** yamamoto has joined #openstack-nova | 10:21 | |
*** zhs has quit IRC | 10:22 | |
openstackgerrit | Lee Yarwood proposed openstack/nova master: objects: Add attachment_id to BlockDeviceMapping https://review.openstack.org/437665 | 10:23 |
*** zhs has joined #openstack-nova | 10:23 | |
openstackgerrit | Lee Yarwood proposed openstack/nova master: db: Add attachment_id to block_device_mapping https://review.openstack.org/437597 | 10:23 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: Make BlockDeviceMapping object support uuid https://review.openstack.org/242603 | 10:23 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: Add uuid column to BlockDeviceMapping https://review.openstack.org/242602 | 10:23 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP compute: Move detach logic into driver BDM https://review.openstack.org/439520 | 10:23 |
*** iceyao has quit IRC | 10:23 | |
*** pcaruana has joined #openstack-nova | 10:24 | |
*** yamamoto has quit IRC | 10:25 | |
*** aloga has joined #openstack-nova | 10:27 | |
johnthetubaguy | bauzas: do you know the plans around updating install docs for placement? asettle might start chasing you about that :) | 10:27 |
johnthetubaguy | mriedem_away might be able to co-ordinate the doc update efforts for asettle, as I guess the cells stuff probably needs adding too | 10:27 |
*** ftersin has quit IRC | 10:28 | |
prometheanfire | johnthetubaguy: yep, that was missing as well | 10:28 |
*** Jeffrey4l has quit IRC | 10:30 | |
*** cdent has joined #openstack-nova | 10:30 | |
*** sridharg has quit IRC | 10:30 | |
asettle | bauzas and mriedem_away - context, the docs here: https://docs.openstack.org/ocata/install-guide-obs/nova.html are out of date and missing some key elements | 10:30 |
*** alex_xu has quit IRC | 10:31 | |
asettle | We'll need to ensure that in future the docs are being updated with each release | 10:31 |
johnthetubaguy | asettle: I suspect for many thinks will have to wait until the packages are updated after the release, but getting ahead of that can't halm | 10:33 |
*** alex_xu has joined #openstack-nova | 10:33 | |
asettle | Yeah, so, in theory you shouldn't have to wait until the packages are updated. Especially if the nova changes in question have nothing ot do with distro packages | 10:34 |
*** ijw has joined #openstack-nova | 10:35 | |
bauzas | asettle: johnthetubaguy: sorry, was in meeting | 10:36 |
bauzas | how can I help ? | 10:36 |
johnthetubaguy | install docs are out of date | 10:36 |
johnthetubaguy | for placement-api | 10:36 |
johnthetubaguy | (and cells stuff actually) | 10:37 |
asettle | bauzas: documentation for the nova portion of the install guide requires updates. ARe there plans to get this updated, or is there someone we can work with to get this updated? | 10:37 |
*** slaweq_ has joined #openstack-nova | 10:38 | |
*** ijw has quit IRC | 10:41 | |
bauzas | looks like a huge knowledge transfer to do | 10:41 |
bauzas | asettle: we have a couple of dev docs that are intended to be user-facing tho | 10:42 |
*** mvk has joined #openstack-nova | 10:44 | |
asettle | bauzas: if you already have the dev docs, are there any plans to move them and improve on the install guide? | 10:44 |
*** mvk has quit IRC | 10:45 | |
*** alex_xu has quit IRC | 10:45 | |
*** sambetts|afk is now known as sambetts | 10:45 | |
*** mvk has joined #openstack-nova | 10:45 | |
*** alex_xu has joined #openstack-nova | 10:46 | |
bauzas | asettle: well, I did contributed to some docs repo a while ago, but it's a very long story :) | 10:47 |
prometheanfire | andymccr: still need that mail? | 10:47 |
prometheanfire | asettle: ^ | 10:47 |
asettle | Hhahaa bauzas I'd be interested to know how it went - if it was bad, we gotta improve, all that et etc | 10:47 |
asettle | prometheanfire: mail?! | 10:47 |
prometheanfire | bad tab complete | 10:47 |
prometheanfire | to the list | 10:47 |
bauzas | asettle: well, it was 2013, and it went well :) | 10:48 |
prometheanfire | thought I was in doc channel, been a long day... | 10:48 |
asettle | prometheanfire: ummm I don't think so :) thank you hahhaha go to bed dude | 10:48 |
prometheanfire | :D | 10:48 |
asettle | bauzas: well that's good! Okay, well. Let's get a bit of an action plan together to get these docs updated. | 10:48 |
prometheanfire | nn | 10:48 |
*** Jeffrey4l has joined #openstack-nova | 10:49 | |
asettle | I am probably going to email out to everyone who is a docs liaison to ensure these docs are being updated continuously each release | 10:49 |
asettle | Seems to be a bit of a problem | 10:49 |
johnthetubaguy | asettle: we did talk about getting a new person to take that on | 10:49 |
johnthetubaguy | asettle: the api stuff is all up to date now, we do that when new APIs land | 10:49 |
*** tbachman has joined #openstack-nova | 10:50 | |
johnthetubaguy | well, apart form the concept guide, I mean api-ref | 10:50 |
johnthetubaguy | asettle: but totally need someone to own the install docs | 10:50 |
asettle | johnthetubaguy: I would agree. Who is PTL of nova? (pardon my ignorance) we need to reach out and get this organised :) | 10:51 |
*** ducttape_ has joined #openstack-nova | 10:51 | |
*** zhs has quit IRC | 10:51 | |
asettle | johnthetubaguy: do we have any OSIC people who would be good for the job? I know they've done that in keystone and glance. | 10:51 |
bauzas | asettle: FYI, most of the user/deployer notes for placement can be found in https://docs.openstack.org/developer/nova/placement.html | 10:51 |
openstackgerrit | Moshe Levi proposed openstack/nova master: [WIP] OVS acceleration https://review.openstack.org/398265 | 10:52 |
asettle | bauzas: okay cool :) what's good to know is that it's there, and that we're not creating something out of thin air | 10:52 |
*** markus_z has quit IRC | 10:52 | |
openstackgerrit | Timofey Durakov proposed openstack/python-novaclient master: Deperecate cell_name cli arg for migration-list https://review.openstack.org/439141 | 10:52 |
bauzas | asettle: for cells v2, deployer instructions are in https://docs.openstack.org/developer/nova/cells.html#setup-of-cells-v2 | 10:52 |
*** thorst has joined #openstack-nova | 10:53 | |
asettle | bauzas: again, good news. A knowledge transfer should be fairly straight forward from here. | 10:54 |
*** ijw has joined #openstack-nova | 10:54 | |
*** ducttape_ has quit IRC | 10:55 | |
johnthetubaguy | asettle: lots of that evolved from the OSA feedback too, its just that last (all important) step thats needed really | 10:56 |
asettle | johnthetubaguy: even better. | 10:57 |
asettle | Regardless, I think we need to have a better review process at the end of each release. | 10:57 |
*** thorst has quit IRC | 10:58 | |
*** bhagyashris has joined #openstack-nova | 10:59 | |
*** erlon has joined #openstack-nova | 10:59 | |
*** ijw has quit IRC | 10:59 | |
*** prometheanfire has left #openstack-nova | 11:00 | |
*** sdague has joined #openstack-nova | 11:01 | |
*** esberglu has joined #openstack-nova | 11:01 | |
mdbooth | lyarwood johnthetubaguy: multipath | 11:02 |
mdbooth | Is nova ever going to model multipath as multiple attachments, or only as a single multipath attachment? | 11:02 |
* mdbooth guesses the latter, but is going to ask anyway | 11:03 | |
*** nicolasbock has joined #openstack-nova | 11:04 | |
*** cdent has quit IRC | 11:05 | |
johnthetubaguy | mdbooth: I was assuming a single attachment, but its a good question | 11:05 |
*** esberglu has quit IRC | 11:06 | |
lyarwood | mdbooth: I would also say single, why? | 11:06 |
sfinucan | tonyb: Couldn't find logs/emails about that issue :/ Anywho, we're stuck with Sphinx 1.3.6 you mean? | 11:07 |
*** amotoki has quit IRC | 11:07 | |
mdbooth | lyarwood: Just trying to think of problems which would be hard to fix | 11:07 |
tonyb | sfinucan: for a little longer | 11:07 |
sfinucan | tonyb: Darn. | 11:08 |
tonyb | sfinucan: http://lists.openstack.org/pipermail/openstack-dev/2017-March/113085.html | 11:08 |
sfinucan | tonyb: Just for context, why can't we use pbr (and where can't we use it) if it's been capped in some projects | 11:10 |
* sfinucan is not fully up to speed on how OpenStack does global requirements | 11:10 | |
tonyb | sfinucan: that's cool it's a little complex | 11:10 |
*** tovin07 has joined #openstack-nova | 11:11 | |
*** sean-k-mooney has quit IRC | 11:11 | |
tonyb | sfinucan: upper-constraints.txt os a list of every python library need by some part of OpenStack that we knwo works (at least installs) together | 11:12 |
tonyb | sfinucan: and all nice projects (such as nova) install *only taht version | 11:12 |
tonyb | sfinucan: sadly when we try to set the version of pbr === 2.0.0 in u-c.txt there are a small number of libraries that can't be installed | 11:13 |
*** amotoki has joined #openstack-nova | 11:13 | |
tonyb | sfinucan: and therefore no part of OpenStack can use that version until they all agree that 2.0.0 is ok | 11:13 |
tonyb | sfinucan: upper-constraints.txt does a bunch of other things but it's beyond my ability to expalin on IRC late at night (for me) | 11:14 |
sfinucan | tonyb: ahhh, gotcha | 11:14 |
tonyb | sfinucan: there are reviews and PRs out to move the ball forward so we'll see how quickly they land and then we can take the next step | 11:15 |
*** udesale has quit IRC | 11:16 | |
sfinucan | tonyb: Perfect. Any topic I can look at? | 11:16 |
sfinucan | Throw a few reviews in | 11:16 |
*** romainh1 has joined #openstack-nova | 11:16 | |
tonyb | sfinucan: https://review.openstack.org/#/q/topic:bug/1668848 | 11:16 |
*** owalsh-afk is now known as owalsh | 11:17 | |
sfinucan | tonyb: fwiw, I'm pretty sure this has been said many times but you can't bump Sphinx until everything is using pbr 2.0, because 1.10 is broken with Sphinx 1.5 | 11:17 |
sfinucan | tonyb: Spot on. Thanks | 11:17 |
*** udesale has joined #openstack-nova | 11:18 | |
tonyb | sfinucan: right. | 11:18 |
*** romainh has quit IRC | 11:18 | |
sfinucan | tonyb: That also would suggest we should be bumping pbr to 2.0, perhaps? | 11:19 |
sfinucan | or at least blacklisting 1.10 | 11:19 |
tonyb | sfinucan: Yeah we'll set the minimum to 2.0.0 once if tested it a bit | 11:20 |
sfinucan | tonyb: Cool. Could we blacklist 1.10 also though? Allows us to start using Sphinx 1.5 | 11:21 |
sfinucan | (eventually) | 11:21 |
tonyb | sfinucan: Yeah we could | 11:21 |
sfinucan | OK. Guess that can be done later though | 11:22 |
*** tbachman has quit IRC | 11:22 | |
*** namnh has quit IRC | 11:23 | |
*** prateek has quit IRC | 11:24 | |
*** yamamoto has joined #openstack-nova | 11:26 | |
*** ratailor has quit IRC | 11:30 | |
*** nmathew has quit IRC | 11:30 | |
*** yamamoto has quit IRC | 11:32 | |
*** mvk has quit IRC | 11:32 | |
kevinbenton | johnthetubaguy: how is your metadata-fu? | 11:34 |
johnthetubaguy | kevinbenton: rusty, but whats up? | 11:35 |
kevinbenton | johnthetubaguy: debugging a failure i observed in the gate | 11:35 |
kevinbenton | johnthetubaguy: one of the cirros VMs is not getting an SSH key | 11:35 |
johnthetubaguy | oh, interesting, almost like its fetching metadata before the ssh key is present in the metadata service | 11:35 |
johnthetubaguy | was it using config drive or not? | 11:36 |
kevinbenton | johnthetubaguy: no config drive | 11:36 |
kevinbenton | johnthetubaguy: just metadata | 11:36 |
kevinbenton | johnthetubaguy: i traced the request all of the way to nova API | 11:36 |
kevinbenton | johnthetubaguy: but the debug logs there aren't very helpful | 11:36 |
johnthetubaguy | ah, cool, you got a link to those | 11:36 |
*** amotoki has quit IRC | 11:36 | |
kevinbenton | johnthetubaguy: http://logs.openstack.org/27/436427/2/gate/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/2f3e394/logs/screen-n-api.txt.gz | 11:36 |
johnthetubaguy | at least the request got there, that was my main question | 11:36 |
kevinbenton | johnthetubaguy: request-id in question is req-93182a9d-baa9-4cf5-8648-aa9c4a49500 | 11:37 |
* johnthetubaguy waits for browser to load the log or die | 11:37 | |
kevinbenton | johnthetubaguy: whatever it is returning there is making cirros think there is nothing further so it doesn't continue on to query the openssh url for the actual keys | 11:37 |
*** yamamoto has joined #openstack-nova | 11:38 | |
kevinbenton | johnthetubaguy: a good request ID in the same tenant and behind the same router is req-ff83fad3-86cc-4097-aa6e-538c6889eae2 | 11:39 |
kevinbenton | johnthetubaguy: would digging up the corresponding instance IDs be helpful? | 11:39 |
johnthetubaguy | not sure that helps in the logs, I guess it would let you find the create instance requests etc, int he compute logs which would have a hint | 11:40 |
johnthetubaguy | kevinbenton: this is one of those cases where we just get ssh didn't work errors right? | 11:40 |
kevinbenton | johnthetubaguy: well in this case it's explicit authentication failures | 11:40 |
johnthetubaguy | ah, right, that makes sense | 11:40 |
kevinbenton | johnthetubaguy: 2017-02-28 11:48:29,144 12602 INFO [paramiko.transport] Authentication (publickey) failed. | 11:41 |
*** smatzek has joined #openstack-nova | 11:41 | |
*** trinaths has quit IRC | 11:42 | |
*** yamamoto has quit IRC | 11:42 | |
*** tbachman has joined #openstack-nova | 11:42 | |
*** smatzek has quit IRC | 11:43 | |
*** tbachman has quit IRC | 11:43 | |
kevinbenton | good instance ID is 747e0481 | 11:43 |
*** tbachman has joined #openstack-nova | 11:43 | |
*** smatzek has joined #openstack-nova | 11:43 | |
johnthetubaguy | kevinbenton: maybe finding the server_id here will help, looks like the bad one was 31ca7a58-2a91-4893-bcb0-7c457023f6a1 | 11:43 |
*** romainh1 has quit IRC | 11:44 | |
*** tbachman has quit IRC | 11:44 | |
*** smatzek_ has joined #openstack-nova | 11:44 | |
*** smatzek has quit IRC | 11:44 | |
kevinbenton | aye | 11:44 |
johnthetubaguy | kevinbenton: oh right, I see GET /2009-04-04/meta-data/public-keys/0/openssh-key | 11:44 |
*** mvk has joined #openstack-nova | 11:44 | |
kevinbenton | johnthetubaguy: so in the bad case whatever that first one is returning is telling it no keys | 11:45 |
johnthetubaguy | yeah, it seems it must be | 11:45 |
kevinbenton | is the preparation of the metadata asynchronous? | 11:46 |
johnthetubaguy | I think it should be all before the instance boots | 11:47 |
johnthetubaguy | but I am wondering that now too | 11:47 |
*** yamamoto has joined #openstack-nova | 11:47 | |
*** yamamoto has quit IRC | 11:48 | |
johnthetubaguy | kevinbenton: so the ssh key is in the compute logs | 11:51 |
johnthetubaguy | kevinbenton: 2017-02-28 11:47:44.387 5448 DEBUG nova.virt.libvirt.vif [req-b43e28a2-6040-4273-b21f-cfe8ac5f7fb6 tempest-TestGettingAddress-1009203826 tempest-TestGettingAddress-1009203826] vif_type=bridge instance= | 11:52 |
*** ducttape_ has joined #openstack-nova | 11:52 | |
johnthetubaguy | includes uuid=31ca7a58-2a91-4893-bcb0-7c457023f6a1 | 11:52 |
johnthetubaguy | and | 11:52 |
johnthetubaguy | key_name='tempest-TestGettingAddress-1661300941' | 11:52 |
johnthetubaguy | it was a key_pair generated by nova, apparently | 11:52 |
johnthetubaguy | so I assume temptest is correctly remembering the new key | 11:53 |
johnthetubaguy | although clearly its not fetching it, so thats kinda irrelavant | 11:53 |
*** sandanar has quit IRC | 11:54 | |
*** CristinaPauna has quit IRC | 11:54 | |
kevinbenton | johnthetubaguy: it seems we may be short on some relevant debug logs in the attempted key lookup in n-api | 11:54 |
*** CristinaPauna has joined #openstack-nova | 11:55 | |
johnthetubaguy | looks like the good one had key_name='tempest-TestGettingAddress-1661300941' | 11:55 |
johnthetubaguy | strange | 11:55 |
johnthetubaguy | kevinbenton: yeah, its probably worth adding that | 11:55 |
kevinbenton | johnthetubaguy: can you point me to that code and i'll push up a patch? | 11:55 |
sdague | kevinbenton: yeh, it's actually a seperate wsgi handler | 11:55 |
*** edand has quit IRC | 11:55 | |
johnthetubaguy | kevinbenton: yeah, I think thats here: https://github.com/openstack/nova/blob/master/nova/api/metadata/base.py#L273 | 11:56 |
*** ijw has joined #openstack-nova | 11:56 | |
johnthetubaguy | sdague: seems like its handled in process in this gate job though | 11:56 |
sdague | johnthetubaguy: ... no exactly | 11:56 |
sdague | not exactly | 11:56 |
kevinbenton | ha! https://github.com/openstack/nova/blob/master/nova/api/metadata/base.py#L284 | 11:57 |
sdague | our n-api has the ability to run multiple worker pools | 11:57 |
*** andreas_s has quit IRC | 11:57 | |
johnthetubaguy | sdague: good point | 11:57 |
kevinbenton | sdague: will that present an issue with logging statements? | 11:57 |
*** ducttape_ has quit IRC | 11:57 | |
sdague | kevinbenton: no, it's all going through a dedicated logger. It's kind of no different than other pools | 11:57 |
kevinbenton | akc | 11:58 |
kevinbenton | ack* | 11:58 |
kevinbenton | I think very few of our jobs use metadata so the poor linux bridge job is the canary in the coal mine | 11:58 |
sdague | honestly, it would probably be a sensible long term move to make this always stand on it's own and run on it's own | 11:58 |
sdague | but I take it that the growth of multiple apis servered from one system came from ec2 days | 11:59 |
asettle | johnthetubaguy: so, who should I be emailing for docs stuff for now? :) | 11:59 |
johnthetubaguy | asettle: unsure, mriedem_away is the best person to ask about that | 12:00 |
asettle | Yikes, haha, okay, we need to fix that | 12:00 |
johnthetubaguy | sdague: certainly worth doing when we shift to uwsgi or whatever it is | 12:00 |
*** ijw has quit IRC | 12:01 | |
sdague | there is a mode to run it dedicated today | 12:01 |
johnthetubaguy | ack | 12:01 |
sdague | I don't know if that would be less confusing if we defaulted that mode | 12:01 |
sdague | Also, while this code path never seems to be hit, the caching by remote IP address in here scares me | 12:01 |
sdague | given that is recycled | 12:02 |
sdague | https://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/metadata/handler.py#L56-L74 | 12:02 |
kevinbenton | sdague: ouch | 12:03 |
kevinbenton | sdague: oh, we shouldn't hit that though | 12:03 |
kevinbenton | sdague: we should be in this branch https://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/metadata/handler.py#L101-L105 | 12:03 |
sdague | right, like I said, i don't see any instances of it | 12:03 |
sdague | it just makes me nervous in looking at the code | 12:03 |
kevinbenton | this may be quite prevalent | 12:05 |
kevinbenton | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22(Error%20reading%20SSH%20protocol%20banner).%20Number%20attempts%3A%2016%5C%22 | 12:05 |
johnthetubaguy | kevinbenton: what job is this? | 12:07 |
johnthetubaguy | oh wait, I can read | 12:07 |
kevinbenton | :) | 12:07 |
johnthetubaguy | kevinbenton: I was checking when the keypair is added into the DB, its really early now: https://github.com/openstack/nova/blob/master/nova/compute/api.py#L981 | 12:08 |
johnthetubaguy | s/now// | 12:08 |
johnthetubaguy | basically its in the instance from the first DB save | 12:09 |
openstackgerrit | Timofey Durakov proposed openstack/python-novaclient master: Deperecate cell_name cli arg for migration-list https://review.openstack.org/439141 | 12:10 |
*** andreas_s has joined #openstack-nova | 12:10 | |
johnthetubaguy | kevinbenton: I have to run to get some lunch, but hopefully there are some micro leads there | 12:11 |
johnthetubaguy | sdague: in case its useful, I wrote up my quota notes here: https://review.openstack.org/#/c/429678 | 12:11 |
*** gszasz has joined #openstack-nova | 12:11 | |
johnthetubaguy | sdague: did a quick post PTG refresh, but its mostly just thoughts I put together before the PTG | 12:11 |
*** romainh has joined #openstack-nova | 12:12 | |
sdague | kevinbenton: if you are patching in logging, probably worth adding a dump of what InstanceMetadata looks like before it's returned, maybe we would find some missing bits in there | 12:13 |
openstackgerrit | Kevin Benton proposed openstack/nova master: Add some metadata logging to root cause ssh failure https://review.openstack.org/439560 | 12:13 |
kevinbenton | sdague: can you leave a comment on that of where i should do that? ^^ | 12:14 |
sdague | yeh, let me go look | 12:14 |
*** dave-mccowan has joined #openstack-nova | 12:14 | |
*** markus_z has joined #openstack-nova | 12:15 | |
sdague | kevinbenton: so it's in the other file, let me send a git link | 12:15 |
sdague | https://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/metadata/handler.py#L306 | 12:16 |
sdague | I would put a log debug of that data structure before we return it | 12:16 |
*** sridharg has joined #openstack-nova | 12:17 | |
*** romainh has quit IRC | 12:17 | |
*** romainh has joined #openstack-nova | 12:18 | |
*** lucasagomes is now known as lucas-hungry | 12:18 | |
*** kevinz has joined #openstack-nova | 12:18 | |
*** aysyd has joined #openstack-nova | 12:18 | |
kevinbenton | sdague: ack | 12:18 |
*** kevinz has quit IRC | 12:18 | |
kevinbenton | sdague: i also filed an E-R query here https://review.openstack.org/439562 | 12:18 |
*** alex_xu has quit IRC | 12:18 | |
sdague | once that is posted I'll +2, we can get johnthetubaguy to +2 after his lunch, and at least hopefully see some of this in the future | 12:19 |
*** sridharg has quit IRC | 12:19 | |
sdague | kevinbenton: we should wait for mriedem_away / mtreinish for that banner error issue, because I have this vague recolection of things like paramiko lying to us about the real issue on thing like that | 12:20 |
sdague | but maybe they remember the deal | 12:20 |
kevinbenton | sdague: ack | 12:20 |
*** sridharg has joined #openstack-nova | 12:20 | |
*** bvanhav has joined #openstack-nova | 12:20 | |
openstackgerrit | Kevin Benton proposed openstack/nova master: Add some metadata logging to root cause ssh failure https://review.openstack.org/439560 | 12:21 |
kevinbenton | sdague: ^^ | 12:21 |
*** amotoki has joined #openstack-nova | 12:21 | |
*** karimb has quit IRC | 12:23 | |
*** liverpooler has quit IRC | 12:24 | |
sdague | kevinbenton: looks good, lets just wait for the test to run so we can see what this looks like in the main job | 12:25 |
kevinbenton | sdague: ack | 12:25 |
sdague | I think the only thing I wonder is if InstanceMetadata has a reasonable repr :) | 12:25 |
*** alex_xu has joined #openstack-nova | 12:25 | |
*** sree has quit IRC | 12:25 | |
sdague | but we'll find out | 12:25 |
kevinbenton | <InstanceMetadata object at 0x38477827> | 12:27 |
kevinbenton | what's not to love? :0 | 12:27 |
sdague | :) | 12:27 |
kevinbenton | it's just a dict isn't it? | 12:27 |
kevinbenton | or is it a magical structured thing | 12:28 |
sdague | no, it's an object | 12:28 |
sdague | https://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/metadata/base.py#L111 | 12:28 |
sdague | and, yeh, I'm not seeing a sane repr | 12:28 |
sdague | so... actually | 12:30 |
sdague | ok, comment left on where we probably can dump the data and have it all | 12:31 |
kevinbenton | ok, so remove the one in handler.py then? | 12:32 |
kevinbenton | sdague: ^^ | 12:32 |
*** mdnadeem has quit IRC | 12:33 | |
openstackgerrit | Kevin Benton proposed openstack/nova master: Add some metadata logging to root cause ssh failure https://review.openstack.org/439560 | 12:34 |
*** moshele has quit IRC | 12:35 | |
sdague | kevinbenton: yeh | 12:37 |
openstackgerrit | Dao Cong Tien proposed openstack/nova master: Stop using mox int unit/virt/xenapi/image/test_utils.py https://review.openstack.org/342626 | 12:38 |
bhagyashris | alex_xu: Hi, I want to discuss regarding the backup api. Have a free time? | 12:38 |
openstackgerrit | Timofey Durakov proposed openstack/python-novaclient master: Deperecate cell_name cli arg for migration-list https://review.openstack.org/439141 | 12:43 |
*** yuntongjin has joined #openstack-nova | 12:43 | |
*** edmondsw has joined #openstack-nova | 12:44 | |
alex_xu | bhagyashris: hi, i'm here, actually we have api meeting after 15 mins, if that is ok for you, we can discuss it at meeting | 12:45 |
alex_xu | nova api meeting is in 15 mins at #openstack-meeting-4 | 12:45 |
*** thorst has joined #openstack-nova | 12:46 | |
bhagyashris | alex_xu: Is the backup api will be deprecate in future ? | 12:46 |
bhagyashris | alex_xu: ok. | 12:47 |
alex_xu | bhagyashris: I think it is useless, due to it totatlly can be impelmenet by client through the create-image api | 12:48 |
*** armax has joined #openstack-nova | 12:48 | |
*** yamamoto has joined #openstack-nova | 12:49 | |
*** dave-mccowan has quit IRC | 12:50 | |
bhagyashris | alex_xu: ok. Is that will depcrecate in future release ? MEans just want to know about future plan. | 12:51 |
alex_xu | bhagyashris: no plan yet, no-one propose that yet. but maybe worth a talk in the api meeting today | 12:51 |
bhagyashris | alex_xu: ok. Thank you for information. | 12:52 |
alex_xu | bhagyashris: np | 12:53 |
*** ijw has joined #openstack-nova | 12:53 | |
*** salv-orl_ has joined #openstack-nova | 12:53 | |
*** yamamoto has quit IRC | 12:53 | |
*** ducttape_ has joined #openstack-nova | 12:53 | |
*** ijw_ has joined #openstack-nova | 12:55 | |
*** ijw has quit IRC | 12:55 | |
*** salv-orlando has quit IRC | 12:56 | |
*** ijw_ has quit IRC | 12:56 | |
*** prateek has joined #openstack-nova | 12:56 | |
*** ijw has joined #openstack-nova | 12:56 | |
bhagyashris | alex_xu: Actually I have submitted one patch https://review.openstack.org/#/c/409644/ regarding the backup rotation parameter change from 0 to 1 and got few comments , so just wanted to know about the future plan regarding backup api. | 12:57 |
*** ducttape_ has quit IRC | 12:58 | |
*** ralonsoh_ has joined #openstack-nova | 12:58 | |
alex_xu | bhagyashris: i see | 12:58 |
*** ijw_ has joined #openstack-nova | 12:59 | |
*** amotoki has quit IRC | 13:00 | |
*** ijw has quit IRC | 13:01 | |
*** iceyao has joined #openstack-nova | 13:01 | |
*** lucas-hungry is now known as lucasagomes | 13:01 | |
*** ralonsoh has quit IRC | 13:01 | |
bhagyashris | alex_xu: Thank you. | 13:01 |
*** jschlueter has joined #openstack-nova | 13:01 | |
*** ijw_ has quit IRC | 13:04 | |
openstackgerrit | Stephen Finucane proposed openstack/nova master: tests: Validate huge pages https://review.openstack.org/399653 | 13:04 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: create functional test base class https://review.openstack.org/407055 | 13:04 |
*** iceyao has quit IRC | 13:05 | |
*** tblakes has joined #openstack-nova | 13:06 | |
*** ayogi has quit IRC | 13:06 | |
*** salv-orl_ has quit IRC | 13:08 | |
*** tbachman has joined #openstack-nova | 13:09 | |
*** yuntongjin has quit IRC | 13:13 | |
openstackgerrit | Stephen Finucane proposed openstack/nova master: api-ref: body verification for os-hypervisors https://review.openstack.org/398197 | 13:13 |
*** yuntongjin has joined #openstack-nova | 13:14 | |
*** jwcroppe has quit IRC | 13:19 | |
openstackgerrit | Tomi Juvonen proposed openstack/nova-specs master: Planned host maintenance https://review.openstack.org/310510 | 13:20 |
*** ducttape_ has joined #openstack-nova | 13:24 | |
*** amoralej is now known as amoralej|lunch | 13:25 | |
*** mjura has quit IRC | 13:26 | |
*** mjura has joined #openstack-nova | 13:27 | |
sfinucan | jaypipes: Could you take a look at https://review.openstack.org/#/q/topic:sriov_numa_func_test+status:open again. Resolved a merge conflict due to the libvirt version bump | 13:28 |
sfinucan | vladikr: You might be interested in ^ too. Touches code you wrote, afaict | 13:29 |
*** mvk has quit IRC | 13:29 | |
*** liverpooler has joined #openstack-nova | 13:31 | |
*** annegentle has joined #openstack-nova | 13:31 | |
*** karimb has joined #openstack-nova | 13:33 | |
*** jpena is now known as jpena|lunch | 13:34 | |
*** mjura has quit IRC | 13:34 | |
*** mjura has joined #openstack-nova | 13:35 | |
*** hongbin has joined #openstack-nova | 13:36 | |
*** bastafidli has joined #openstack-nova | 13:37 | |
*** xyang1 has joined #openstack-nova | 13:39 | |
*** gouthamr has joined #openstack-nova | 13:39 | |
*** yingjun has joined #openstack-nova | 13:43 | |
*** jschlueter has quit IRC | 13:44 | |
*** yuntongjin has quit IRC | 13:46 | |
*** yuntongjin has joined #openstack-nova | 13:46 | |
*** GnomeKing has joined #openstack-nova | 13:47 | |
*** GnomeKing is now known as BobBall | 13:47 | |
*** bastafidli has quit IRC | 13:47 | |
*** databus23_ has joined #openstack-nova | 13:49 | |
*** tpatzig_ has joined #openstack-nova | 13:49 | |
*** dgonzalez_ has joined #openstack-nova | 13:49 | |
*** tommy_ has joined #openstack-nova | 13:49 | |
*** tommy_ is now known as Guest89971 | 13:49 | |
*** zz_dimtruck is now known as dimtruck | 13:49 | |
*** dgonzalez_ has quit IRC | 13:50 | |
*** databus23_ has quit IRC | 13:50 | |
*** Guest89971 has quit IRC | 13:50 | |
*** tpatzig_ has quit IRC | 13:50 | |
*** jwcroppe has joined #openstack-nova | 13:52 | |
*** ijw has joined #openstack-nova | 13:57 | |
*** yingjun has quit IRC | 13:58 | |
*** sridharg has quit IRC | 13:58 | |
*** yamamoto has joined #openstack-nova | 13:58 | |
*** bvanhav_ has joined #openstack-nova | 13:59 | |
*** tongli has joined #openstack-nova | 13:59 | |
*** bvanhav has quit IRC | 13:59 | |
*** bvanhav_ is now known as bvanhav | 13:59 | |
*** amotoki has joined #openstack-nova | 14:00 | |
*** zhurong has joined #openstack-nova | 14:00 | |
alex_xu | jaypipes: dansmith, bauzas, I get a problem when implement the 'GET /traits/namespace' and 'GET /traits?namespace=*'. Those APIs leads to placement API still need to import os-traits lib. So is it ok that we create db table for namespace, and sync namespace from os-trait into db by 'placement-manage' also? | 14:01 |
*** ijw has quit IRC | 14:02 | |
*** tongli has quit IRC | 14:03 | |
*** tongli has joined #openstack-nova | 14:03 | |
*** jschlueter has joined #openstack-nova | 14:03 | |
*** yamamoto has quit IRC | 14:04 | |
*** mdrabe_ has joined #openstack-nova | 14:05 | |
*** yingjun has joined #openstack-nova | 14:06 | |
*** ducttape_ has quit IRC | 14:06 | |
johnthetubaguy | alex_xu: I think we said we would sync into the DB, so we have the integer ids in the DB for more efficient storage, I think | 14:07 |
alex_xu | johnthetubaguy: yea, we sync the traits from os-traits into the db https://review.openstack.org/#/c/376198/, but that didn't include the namespace | 14:09 |
*** swebster has joined #openstack-nova | 14:09 | |
*** yuntongjin has quit IRC | 14:09 | |
*** jamesdenton has joined #openstack-nova | 14:09 | |
*** yamahata has joined #openstack-nova | 14:09 | |
johnthetubaguy | alex_xu: ah... | 14:11 |
alex_xu | johnthetubaguy: the valid namespace is defined by os-traits also https://github.com/openstack/os-traits/blob/master/os_traits/const.py#L70 | 14:11 |
alex_xu | and I expect 'GET/traits/namespace' return all the valid traits. And expect validate the valid traits which input in 'GET /traits?namespace=*' | 14:12 |
*** hferenc has joined #openstack-nova | 14:13 | |
rpodolyaka | johnthetubaguy: dansmith: hmm, do you guys recall if we kept CONF opts for a separate placement DB in this revert https://review.openstack.org/#/c/360638/ intentionally or by mistake? | 14:13 |
*** mpaolino has joined #openstack-nova | 14:14 | |
rpodolyaka | it's not going to work w/o cdent's https://review.openstack.org/#/c/362766/ | 14:14 |
johnthetubaguy | rpodolyaka: I think it was on purpose, just haven't merged the finish bits yet I guess | 14:14 |
rpodolyaka | but people find these options in the sample conf file and have wrong expectations | 14:14 |
johnthetubaguy | rpodolyaka: yeah, that got missed last cycle, it should have been a blocker really | 14:15 |
*** READ10 has joined #openstack-nova | 14:15 | |
*** yingjun has quit IRC | 14:16 | |
mtreinish | sdague: so we did use real ssh with -vvv to test the banner error failure | 14:16 |
mtreinish | sdague: the socket is being closed right when the ssh client expects the banner response from the server | 14:17 |
*** yingjun has joined #openstack-nova | 14:18 | |
*** esberglu has joined #openstack-nova | 14:18 | |
*** mriedem_away is now known as mriedem | 14:18 | |
*** tbachman has quit IRC | 14:19 | |
*** zhurong has quit IRC | 14:19 | |
*** links has quit IRC | 14:19 | |
*** felipemonteiro_ has joined #openstack-nova | 14:20 | |
*** felipemonteiro__ has joined #openstack-nova | 14:20 | |
jaypipes | alex_xu: heading into the office. will answer your question (or we could do a hangout?) a little later. alternately, we can just discuss on the patch if you're heading to bed... | 14:21 |
*** esberglu has quit IRC | 14:21 | |
*** READ10 has quit IRC | 14:21 | |
*** zhurong has joined #openstack-nova | 14:21 | |
*** hongbin has quit IRC | 14:21 | |
*** dave-mccowan has joined #openstack-nova | 14:22 | |
kevinbenton | johnthetubaguy, sdague: look how lucky we are. that very patch hit the failure :) | 14:22 |
kevinbenton | johnthetubaguy: http://logs.openstack.org/60/439560/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/569fcd0/logs/testr_results.html.gz | 14:22 |
*** READ10 has joined #openstack-nova | 14:23 | |
sdague | kevinbenton: nice | 14:25 |
sdague | the metadata server being useful at all? | 14:25 |
mriedem | sfinucan: on https://review.openstack.org/#/c/412390/ can we also make that default to the noop driver like in my change? | 14:25 |
*** amoralej|lunch is now known as amoralej | 14:25 | |
*** tbachman has joined #openstack-nova | 14:26 | |
mriedem | asettle: have you been talking to spotz about install guide docs for placement and cells v2? | 14:26 |
*** karimb has quit IRC | 14:27 | |
*** eglynn has joined #openstack-nova | 14:27 | |
kevinbenton | sdague: well it's telling me there is indeed a public-key associated with it | 14:27 |
mriedem | asettle: https://review.openstack.org/#/c/438328/ | 14:28 |
mriedem | bauzas: johnthetubaguy: ^ fyi on the docs thing | 14:28 |
*** karimb has joined #openstack-nova | 14:28 | |
*** dimtruck is now known as zz_dimtruck | 14:29 | |
johnthetubaguy | mriedem: oh, cool | 14:29 |
*** zz_dimtruck is now known as dimtruck | 14:29 | |
sdague | kevinbenton: so... rolling conversation on #openstack-qa that is related | 14:31 |
asettle | Hey mriedem sure have. We'd been discussing it before I went to lunch. I'd seen this patch before, but wasn't sure if it ticked all the boxes. | 14:31 |
asettle | Does this *deal* with everything? | 14:31 |
*** baoli has joined #openstack-nova | 14:31 | |
mriedem | i haven't read it yet in detail since it's a WIP | 14:31 |
mriedem | but i also pointed out we have these docs in the nova devref | 14:32 |
mriedem | https://docs.openstack.org/developer/nova/placement.html https://docs.openstack.org/developer/nova/cells.html | 14:32 |
*** jaypipes has quit IRC | 14:32 | |
asettle | mriedem: having it in nova dev ref is great, but we do need to have the docs in docs.o.o updated as its the user facing documentation. If people can't install from our site, it's a problem. | 14:34 |
*** liangy has joined #openstack-nova | 14:34 | |
mriedem | yeah i get that, but i also hope people trying to sort this out are reading our devref | 14:34 |
mriedem | i can poke through the docs change, but i also just got into the office so it's not going to happen right now | 14:35 |
*** hshiina has quit IRC | 14:35 | |
*** crushil has joined #openstack-nova | 14:36 | |
asettle | No problem mriedem :) I'd like to start a bigger conversation about this too with docs liaisons for the base projects that we document but there does not appear to be a docs liaison for nova. Do you know of who would be able to fill this role? I am hoping to liaise and generate a better way for this content to be updated when necessary (to avoid running into an issue like this again :)) | 14:36 |
mriedem | i've added a couple of nova devs that helped write the docs that are in nova | 14:36 |
mriedem | we don't really have a docs liaison for stuff like this no | 14:36 |
asettle | Cool :) that will be very helpful, thank you | 14:36 |
asettle | mriedem: okay - well, we have a docs liaison for every project in OpenStack (give or take). It would be more than beneficial to have a nova representative to contact to assist dealing with documentation concerns. Could you help me find someone to fill that position? | 14:37 |
asettle | Previously mikal and sdague have helped out with the api-ref and api-guides | 14:37 |
mriedem | i can ask. fwiw, we've had mandatory liaisons in the past which are just a title but don't necessarily mean people are doing anything. | 14:37 |
mriedem | by default i'm the liaison | 14:37 |
mriedem | but i'll bring it up in our meeting | 14:38 |
*** jpena|lunch is now known as jpena | 14:38 | |
asettle | mriedem: yeah, so, that's kind of what I'd like to fix :) the 'not doing anything' part ;) | 14:38 |
mriedem | i've love people to do things too :) | 14:38 |
mriedem | i can't force it though | 14:38 |
asettle | If you're okay with it, I'll add you into my email to the liaisons to discuss a good method of communication for the install guides? | 14:38 |
mriedem | sure | 14:38 |
asettle | Of course, community ;) | 14:38 |
*** dimtruck is now known as zz_dimtruck | 14:38 | |
asettle | Thanks! mriedem could you pm me your best email? :) | 14:38 |
mriedem | we could just sign up johnthetubaguy, he signs up for everything else | 14:38 |
mriedem | asettle: mriedem.os@gmail.com | 14:38 |
asettle | Hahah plus he's in my timezone ;) | 14:39 |
johnthetubaguy | mriedem: heh, thats like docs, sounds hard | 14:39 |
mriedem | wurdz r hrd | 14:39 |
johnthetubaguy | yup | 14:39 |
*** esberglu has joined #openstack-nova | 14:39 | |
*** esberglu has quit IRC | 14:39 | |
*** esberglu has joined #openstack-nova | 14:40 | |
*** Swami has joined #openstack-nova | 14:40 | |
*** Swami_ has joined #openstack-nova | 14:40 | |
asettle | woah you guys are telling me | 14:40 |
asettle | People actually expect me to be eloquent as well | 14:40 |
asettle | It's outrageous | 14:40 |
mriedem | i did hear a british guy on a show the other night say "quintessential" at least 5 times | 14:41 |
artom_ | That's sort of the point of "quit" ;) | 14:41 |
artom_ | Or "quint" event | 14:42 |
asettle | mriedem: that's long. Over 2 syllables is out of my jurisdiction. | 14:42 |
*** tojuvone has quit IRC | 14:44 | |
*** ducttape_ has joined #openstack-nova | 14:44 | |
*** jaypipes has joined #openstack-nova | 14:44 | |
*** READ10 has quit IRC | 14:45 | |
*** salv-orlando has joined #openstack-nova | 14:48 | |
openstackgerrit | Kevin Benton proposed openstack/nova master: Add some metadata logging to root cause ssh failure https://review.openstack.org/439560 | 14:49 |
*** irenab_ has quit IRC | 14:50 | |
*** burt has joined #openstack-nova | 14:51 | |
*** bastafidli has joined #openstack-nova | 14:51 | |
jaypipes | kevinbenton: have you gone to sleep yet? | 14:52 |
jaypipes | kevinbenton: btw, I'm in sunnyvale... are you? | 14:52 |
kevinbenton | jaypipes: no, but i'm going to right now :) | 14:52 |
kevinbenton | jaypipes: yes i am! | 14:52 |
kevinbenton | jaypipes: catch up with you this afternoon and dinner? :) | 14:52 |
jaypipes | kevinbenton: the habit later? | 14:52 |
*** ducttape_ has quit IRC | 14:53 | |
jaypipes | kevinbenton: yup, see ya in the office. | 14:53 |
kevinbenton | jaypipes: ack | 14:53 |
*** tojuvone has joined #openstack-nova | 14:53 | |
*** yingjun has quit IRC | 14:54 | |
*** mvk has joined #openstack-nova | 14:54 | |
*** yingjun has joined #openstack-nova | 14:56 | |
*** edand has joined #openstack-nova | 14:57 | |
*** Jinxing has joined #openstack-nova | 14:57 | |
*** ijw has joined #openstack-nova | 14:58 | |
*** ociuhandu has joined #openstack-nova | 14:58 | |
*** yingjun has quit IRC | 14:59 | |
*** prateek has quit IRC | 14:59 | |
*** zz_dimtruck is now known as dimtruck | 14:59 | |
*** tongli has quit IRC | 15:00 | |
*** owalsh has quit IRC | 15:01 | |
tojuvone | Guess we hit the PBR 2.0.0 thingy with pep8 | 15:03 |
*** mtanino has joined #openstack-nova | 15:03 | |
*** ijw has quit IRC | 15:03 | |
openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP compute: Move detach logic from manager into driver BDM https://review.openstack.org/439520 | 15:05 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP objects: Add attachment_id to BlockDeviceMapping https://review.openstack.org/437665 | 15:05 |
*** ralonsoh__ has joined #openstack-nova | 15:05 | |
*** lucasxu has joined #openstack-nova | 15:05 | |
*** lucasxu has quit IRC | 15:07 | |
*** ralonsoh_ has quit IRC | 15:07 | |
openstackgerrit | Timofey Durakov proposed openstack/python-novaclient master: Deperecate cell_name cli arg for migration-list https://review.openstack.org/439141 | 15:07 |
*** irenab__ has joined #openstack-nova | 15:09 | |
*** irenab__ has quit IRC | 15:10 | |
*** irenab_ has joined #openstack-nova | 15:11 | |
*** lucasxu has joined #openstack-nova | 15:11 | |
mriedem | sfinucan: nevermind, we can take your change to deprecate the firewall_driver option and i'll rebase my change on top of it to change the default to the noop driver | 15:12 |
mriedem | that will work nicely, yes very nice indeed....muwahahah | 15:12 |
*** jaosorior has quit IRC | 15:12 | |
sileht | Hi nova devs, any idea why we get: http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/screen-n-api.txt.gz#_2017-03-01_14_07_46_133 | 15:13 |
edmondsw | johnthetubaguy could you take a quick look at https://review.openstack.org/#/c/389314 ? Other commenters are holding it up waiting for your feedback | 15:13 |
mriedem | sileht: did nova-manage db sync run after the cell0 db was mapped? | 15:13 |
mriedem | i.e. run nova-manage cell_v2 map_cell0 and then run nova-manage db sync | 15:13 |
sileht | mriedem, we just setup devstack | 15:13 |
sileht | mriedem, it should do it for us, no ? | 15:14 |
mriedem | well let's see | 15:14 |
sileht | mriedem, here: http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/devstacklog.txt.gz#_2017-03-01_14_07_18_983 | 15:14 |
mriedem | nova_cell0 is created here http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/devstacklog.txt.gz#_2017-03-01_13_57_36_563 | 15:14 |
mriedem | map_cell0 is called here http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/devstacklog.txt.gz#_2017-03-01_14_07_18_983 | 15:14 |
mriedem | nova-manage db sync is called here http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/devstacklog.txt.gz#_2017-03-01_13_57_36_581 | 15:15 |
mriedem | so db sync was called before map_cell0 | 15:15 |
mriedem | so the cell0 db schema isn't migrated | 15:15 |
sileht | mriedem, so it's a devstack bug ? | 15:15 |
mriedem | "WARNING: cell0 mapping not found - not syncing cell0." | 15:15 |
mriedem | sileht: if it were, i'd think all of the jobs would be broken | 15:16 |
sileht | mriedem, our gate is mostly broken, most of the time we got the error, but sometimes it passes | 15:16 |
dims | mriedem : tools/discover_hosts.sh does not run in their case | 15:16 |
dims | mriedem : so they don't run "nova-manage cell_v2 discover_hosts --verbose" | 15:17 |
sileht | dims, do we miss something in project-config ? | 15:17 |
*** kamtamtun has joined #openstack-nova | 15:17 | |
dims | sileht : remember this one - http://git.openstack.org/cgit/openstack-dev/devstack/commit/tools/discover_hosts.sh?id=5c6aa56e11b2dc79adc70154187d3a029e8e0976 | 15:17 |
mriedem | dims: this isn't a multinode job so i don't think they need discover_hosts as long as simple_cell_setup is getting run | 15:18 |
sileht | dims, yes, but that was for another job | 15:18 |
mriedem | which is does here http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/devstacklog.txt.gz#_2017-03-01_14_07_22_457 | 15:18 |
dansmith | missing cell0 means we're not even getting to discover hosts | 15:18 |
dims | ah, ignore me then | 15:18 |
mriedem | sileht: so someone else had a similar sounding issue with using a devstack plugin | 15:18 |
mriedem | where it was getting called in the wrong order, i think it was shade | 15:18 |
mriedem | mordred: remember that thing where a devstack plugin was being called from post-stack or test hooks or something? | 15:19 |
mriedem | so n-api was up before cell0 was synce | 15:19 |
mriedem | *synced | 15:19 |
openstackgerrit | Ed Leafe proposed openstack/nova master: placement: ironic inventory reporting https://review.openstack.org/437602 | 15:19 |
edleafe | jaypipes: ^^ fixed the pep8, and took the liberty of changing the name | 15:19 |
sileht | mriedem, oh maybe because each time a project that add a new wsgi vhost to apache, it is restarted | 15:20 |
asettle | mriedem: you are the lucky receiver of the table update; https://wiki.openstack.org/wiki/CrossProjectLiaisons#Documentation (this is where we keep all our liaisons) | 15:20 |
mordred | mriedem: yah | 15:21 |
*** shaner has joined #openstack-nova | 15:21 | |
mordred | mriedem: that was a lot of fun | 15:21 |
mriedem | mordred: remember the details? sounds like gnocchi jobs might be doing the same | 15:21 |
*** ducttape_ has joined #openstack-nova | 15:21 | |
mriedem | http://logs.openstack.org/10/439510/4/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/07bd989/logs/devstack-gate-post_test_hook.txt.gz | 15:21 |
mordred | yah ... one sec, lemme find our fix patch | 15:22 |
mordred | mriedem: https://review.openstack.org/#/c/427390/ | 15:22 |
mordred | so for us "start_nodepool" needs to not happen until the cloud is actually, you know, up and running | 15:22 |
mordred | we do that in test-config now | 15:23 |
mordred | sileht: ^^ | 15:23 |
mriedem | sileht: so the gnocchi test hook might be trying to hit nova-api at the wrong point in the bring up sequence | 15:23 |
mordred | yah. that's what we were trying to do - nova was not happy about it | 15:24 |
mriedem | also https://review.openstack.org/#/c/427392/ | 15:24 |
mriedem | ^ still needs to go in | 15:24 |
mriedem | and i think would help here, but there is still likely a bug in the consuming plugin | 15:24 |
sileht | mriedem, we start ceilometer and gnocchi during the extra step, not the the post-config | 15:25 |
*** marst has quit IRC | 15:25 | |
*** sree has joined #openstack-nova | 15:26 | |
mriedem | i've got to run to a meeting, bbiab | 15:26 |
*** ociuhandu has quit IRC | 15:27 | |
*** sacharya has joined #openstack-nova | 15:28 | |
*** owalsh has joined #openstack-nova | 15:28 | |
*** ociuhandu has joined #openstack-nova | 15:28 | |
*** mriedem1 has joined #openstack-nova | 15:29 | |
*** jistr is now known as jistr|biab | 15:29 | |
*** karimb has quit IRC | 15:30 | |
*** sree has quit IRC | 15:30 | |
*** Sukhdev has joined #openstack-nova | 15:31 | |
*** zhurong has quit IRC | 15:31 | |
*** Swami_ has quit IRC | 15:31 | |
*** mriedem has quit IRC | 15:31 | |
*** Swami_ has joined #openstack-nova | 15:31 | |
*** marst has joined #openstack-nova | 15:32 | |
*** artom_ is now known as artom | 15:32 | |
alex_xu | jaypipes: sorry, I can't make a hangout, baby is sleeping. everybody just keep quiet... | 15:33 |
*** karimb has joined #openstack-nova | 15:34 | |
*** edand has quit IRC | 15:34 | |
*** Swami has quit IRC | 15:34 | |
*** owalsh has quit IRC | 15:36 | |
dims | alex_xu : :) | 15:36 |
*** annegentle has quit IRC | 15:36 | |
jaypipes | alex_xu: k, no worries. let's comment on the patch, ok? | 15:36 |
*** timello has quit IRC | 15:36 | |
jaypipes | edleafe: cool, thanks. I'm fixing up dansmith's PS5 comments now. | 15:36 |
*** mpaolino has quit IRC | 15:36 | |
*** Jinxing has left #openstack-nova | 15:37 | |
alex_xu | jaypipes: that is ok for me, or you want to discuss on the irc, i still wake up | 15:37 |
*** timello has joined #openstack-nova | 15:37 | |
*** mriedem1 is now known as mriedem | 15:38 | |
jaypipes | alex_xu: k. | 15:38 |
*** owalsh has joined #openstack-nova | 15:39 | |
jaypipes | alex_xu: so I don't actually think we should have a separate GET /traits/namespace REST API endpoint. And I think that GET /traits?namespace=* should be GET /traits?starts_with=XXX | 15:39 |
*** Sukhdev has quit IRC | 15:40 | |
alex_xu | jaypipes: ok, i guess i remember the wrong one | 15:40 |
*** READ10 has joined #openstack-nova | 15:41 | |
*** hongbin has joined #openstack-nova | 15:41 | |
alex_xu | jaypipes: so you expect GET/traits?starts_with=CUSTOM:GPU, that is just a prefix, not really a namespace defined in the os-traits? | 15:41 |
jaypipes | alex_xu: yes, exactly. | 15:42 |
alex_xu | jaypipes: sorry, may i ask what is the point between the choice of "namespaces=*" and "starts_with"? | 15:42 |
*** nkrinner is now known as nkrinner_afk | 15:43 | |
*** ayogi has joined #openstack-nova | 15:45 | |
*** Sukhdev has joined #openstack-nova | 15:45 | |
*** jvgrant__ has quit IRC | 15:46 | |
*** jvgrant_ has joined #openstack-nova | 15:46 | |
alex_xu | dims: i also type the keyboard softly... | 15:47 |
dims | awwwww alex_xu | 15:47 |
*** yamahata has quit IRC | 15:47 | |
*** udesale has quit IRC | 15:48 | |
*** claudiub|2 has quit IRC | 15:48 | |
*** kfarr has joined #openstack-nova | 15:49 | |
jaypipes | alex_xu: actually, I think GET /traits?name=starts_with:XXX would be more in-line with the API WG filtering guidelines? https://github.com/openstack/api-wg/blob/master/guidelines/pagination_filter_sort.rst | 15:50 |
jaypipes | alex_xu: I know that there isn't a guideline specifically for prefix matching, but the other filter guidelines are similar. name=in:X,Y, start=ge:2017-01-01, etc | 15:51 |
jaypipes | alex_xu: in this case, all we're doing is a prefix match. There's really nothing about namespaces that is specific to the query. | 15:52 |
*** annegentle has joined #openstack-nova | 15:52 | |
mriedem | +1 to /traits?name=starts_with:XXX | 15:52 |
mriedem | we have something like this today: GET /resource_providers?resources=VCPU:2,MEMORY_MB:1024,DISK_GB:50 | 15:52 |
*** lpetrut has quit IRC | 15:53 | |
mriedem | and | 15:53 |
mriedem | /resource_providers?member_of=in:{agg1_uuid},{agg2_uuid},{agg3_uuid} | 15:53 |
jaypipes | alex_xu: and doing it this way would allow us, for example, to do something like GET /traits?name=contains:GPU or something similar, whereas you couldn't do that with namespace=XXX | 15:53 |
alex_xu | jaypipes: contains:GPU just should have bad performance even with db index? | 15:54 |
*** ijw has joined #openstack-nova | 15:54 | |
*** armax has quit IRC | 15:54 | |
jaypipes | alex_xu: yes, absolutely, but that doesn't mean people won't find it useful ;) | 15:55 |
*** ijw has quit IRC | 15:55 | |
*** ijw has joined #openstack-nova | 15:55 | |
*** jistr|biab is now known as jistr | 15:56 | |
jaypipes | alex_xu: in any case, my point is that if we do name=starts_with:XXX, then we keep our API more in-line with the API WG recommendations and leave our options open in future to how users can query the placement API. Agree? | 15:56 |
*** gfhellma has joined #openstack-nova | 15:56 | |
alex_xu | jaypipes: yes, i agree | 15:56 |
*** gszasz has quit IRC | 15:56 | |
*** ociuhandu has quit IRC | 15:56 | |
*** gfhellma has quit IRC | 15:57 | |
*** gfhellma has joined #openstack-nova | 15:57 | |
*** Sukhdev has quit IRC | 15:58 | |
*** ZZelle has joined #openstack-nova | 15:58 | |
*** ociuhandu has joined #openstack-nova | 15:58 | |
*** shaner has quit IRC | 15:58 | |
alex_xu | jaypipes: mriedem, wait, the current proposal have a API "GET /traits?tratis=a,b,c", it is ok with "GET /traits?traits=start_with:xxx"? | 15:58 |
*** _ducttape_ has joined #openstack-nova | 15:58 | |
*** shaner has joined #openstack-nova | 15:59 | |
*** Sukhdev_ has joined #openstack-nova | 15:59 | |
*** ijw has quit IRC | 16:00 | |
*** annegentle has quit IRC | 16:00 | |
*** yamamoto has joined #openstack-nova | 16:00 | |
*** annegentle has joined #openstack-nova | 16:01 | |
*** ducttape_ has quit IRC | 16:01 | |
mriedem | what are the semantics of traits=a,b,c? | 16:02 |
*** mdrabe_ has quit IRC | 16:02 | |
mriedem | is that an in? | 16:02 |
mriedem | traits in (a, b, c) or an intersection? | 16:02 |
alex_xu | mriedem: yes | 16:02 |
mriedem | or is that, give me details about traits a, b, and c? | 16:02 |
jaypipes | mriedem: yup, traits?name=in:a,b,c | 16:03 |
*** tbachman has quit IRC | 16:03 | |
jaypipes | IN == ANY() | 16:03 |
alex_xu | ah...name=in: | 16:03 |
mriedem | yeah we have that for resource_providers already | 16:03 |
mriedem | for finding resource providers in a given set of aggregates | 16:03 |
*** rcernin has quit IRC | 16:03 | |
mriedem | /resource_providers?member_of=in:{agg1_uuid},{agg2_uuid},{agg3_uuid} | 16:04 |
mriedem | bauzas at one point had something similar for getting resource providers by name | 16:04 |
*** breitz has quit IRC | 16:04 | |
alex_xu | jaypipes: mriedem I think i got all that point now | 16:04 |
*** breitz has joined #openstack-nova | 16:05 | |
alex_xu | i will update the spec and validate more, mriedem jaypipes thanks | 16:05 |
jaypipes | alex_xu: cool, thanks Alex! | 16:05 |
alex_xu | jaypipes: np | 16:05 |
*** Oku_OS is now known as Oku_OS-away | 16:05 | |
mriedem | alex_xu: jaypipes: this was the change for RPs i was thinking of https://review.openstack.org/#/c/407630/ | 16:06 |
*** yamamoto has quit IRC | 16:06 | |
mriedem | GET: /resource_providers?name=in:$ENVIRON['RP_NAME'],foobar | 16:06 |
mriedem | so in that example, it's looking for RPs by name where one exists and one doesn't (foobar doesn't) | 16:06 |
*** shaner has quit IRC | 16:07 | |
mriedem | alex_xu: also, now that i'm looking at that change and it reminds me, | 16:07 |
mriedem | the resource provider name doesn't exclude commas | 16:07 |
alex_xu | mriedem: ":" is a specical for trait | 16:07 |
mriedem | so when you define a schema for trait name, make sure it does not allow commas | 16:08 |
mriedem | because name=in:a,b,c would be broken parsing if the trait name has a comma in it | 16:08 |
alex_xu | mriedem: the trait is like HW:X86:CPU:AVX, with ":" is probably ok | 16:08 |
mriedem | well we'd have to split on the first : in the name=in:a,b,c case | 16:09 |
mriedem | so you split on : and get a,b,c | 16:09 |
mriedem | so we could have name=in:HW:X86:CPU:AVX,foo | 16:09 |
*** mdrabe_ has joined #openstack-nova | 16:09 | |
alex_xu | mriedem: yea | 16:09 |
mriedem | split on the first : and get HW:X86:CPU:AVX,foo | 16:09 |
*** mdrabe_ is now known as mdrabe | 16:09 | |
mriedem | and then split on , to get (HW:X86:CPU:AVX, foo) | 16:09 |
mriedem | but my point is, make sure the schema for creating a trait in the API excludes commas :) | 16:10 |
mriedem | alex_xu: couldn't we just do _ instead of : | 16:10 |
mriedem | for the trait name? | 16:10 |
mriedem | then it would match resource classes | 16:10 |
*** ociuhandu has quit IRC | 16:11 | |
alex_xu | mriedem: we could, I didn't have any critical point for can't use "_" | 16:12 |
alex_xu | jaypipes: ^ do you have anything in mind? | 16:12 |
mriedem | i tend to think we should be consistent | 16:13 |
cfriesen | do the capabilities exposed in self.driver.capabilities in the ComputeManager get exposed to the scheduler filters? (I'm wondering if we can use self.driver.capabilities['supports_migrate_to_same_host'] to avoid scheduling to the same compute node if it's not supported. | 16:13 |
mriedem | because we have the whole _ for image metadata and : for flavor extra specs today | 16:13 |
mriedem | which is kind of a confusing mess | 16:13 |
*** bastafidli has quit IRC | 16:14 | |
mriedem | cfriesen: i believe so yes, the capabilities filter | 16:14 |
mriedem | it's right in the name | 16:14 |
*** bastafidli has joined #openstack-nova | 16:14 | |
alex_xu | mriedem: yes, agree with you, actually i'm trying to match the resource class, I changed the trait name from lower-case to capitals | 16:15 |
jaypipes | mriedem: sure, we can use _ instead of : | 16:15 |
jaypipes | alex_xu: ^ | 16:15 |
*** CristinaPauna has quit IRC | 16:15 | |
alex_xu | jaypipes: mriedem cool, thanks | 16:16 |
*** _ducttape_ has quit IRC | 16:16 | |
*** Guest52040 has joined #openstack-nova | 16:17 | |
*** ducttape_ has joined #openstack-nova | 16:17 | |
*** moshele has joined #openstack-nova | 16:22 | |
mriedem | cfriesen: ComputeCapabilitiesFilter | 16:24 |
mriedem | i think | 16:24 |
*** CristinaPauna has joined #openstack-nova | 16:25 | |
*** adrian_otto has joined #openstack-nova | 16:25 | |
*** Sukhdev_ has quit IRC | 16:25 | |
andreykurilin | mriedem: hi! Your patch (https://review.openstack.org/#/c/437145/) broke functional-mitaka job. At least it is the first patch with red job result. | 16:26 |
*** zioproto has joined #openstack-nova | 16:27 | |
*** psachin has quit IRC | 16:27 | |
zioproto | dansmith, are you here ? | 16:27 |
mriedem | andreykurilin: hmm, those tests must be based on microversion or something | 16:27 |
andreykurilin | mriedem: two tests are "legacy" | 16:28 |
*** Sukhdev_ has joined #openstack-nova | 16:29 | |
mriedem | weird, how did that test even pass on master? | 16:29 |
mriedem | https://github.com/openstack/python-novaclient/blob/master/novaclient/tests/functional/v2/legacy/test_fixedips.py#L31 | 16:29 |
mriedem | that's calling a CLI that doesn't exist anymore | 16:29 |
mriedem | it was skipped for master http://logs.openstack.org/45/437145/2/check/gate-novaclient-dsvm-functional-neutron-ubuntu-xenial/aad02a1/testr_results.html.gz | 16:29 |
mriedem | oh i know why | 16:30 |
mriedem | we're using neutron on master, but nova-net on mitaka | 16:30 |
*** jvgrant_ has quit IRC | 16:30 | |
andreykurilin | oh | 16:30 |
mriedem | yeah https://github.com/openstack/python-novaclient/blob/master/novaclient/tests/functional/v2/legacy/test_fixedips.py#L26 | 16:30 |
mriedem | i'll push a fix quick | 16:30 |
mriedem | good catch | 16:30 |
andreykurilin | mriedem: thanks | 16:31 |
andreykurilin | mriedem: what about making mitaka-functional job voting? | 16:31 |
*** andreas_s has quit IRC | 16:33 | |
mriedem | we could... | 16:33 |
mriedem | I haven't put any thought into it | 16:33 |
mriedem | bbiab | 16:34 |
*** mriedem has quit IRC | 16:34 | |
*** tbachman has joined #openstack-nova | 16:34 | |
*** dtp has joined #openstack-nova | 16:34 | |
*** annegentle has quit IRC | 16:35 | |
*** ralonsoh__ has quit IRC | 16:35 | |
*** bkopilov has quit IRC | 16:35 | |
*** annegentle has joined #openstack-nova | 16:36 | |
*** browne has joined #openstack-nova | 16:38 | |
dims | thorst : Anyone around to merge this PR and cut a release for pypowervm? https://github.com/powervm/pypowervm/pull/1 | 16:40 |
thorst | dims: Yeah, we're working on getting a new rev of that. It'd be pypowervm 1.0.0.4.1 to take in the new req. adreznec is working on it. | 16:41 |
*** Sukhdev_ has quit IRC | 16:41 | |
dims | great thanks thorst and adreznec | 16:41 |
adreznec | dims: thorst Yep, just working on that now | 16:41 |
thorst | thx for letting us know! | 16:41 |
cfriesen | bauzas, you around? | 16:42 |
openstackgerrit | Jay Pipes proposed openstack/nova master: placement: ironic inventory reporting https://review.openstack.org/437602 | 16:43 |
jaypipes | dansmith: finally addressed your PS5 coments ^. thanks for your patience. | 16:43 |
*** salv-orlando has quit IRC | 16:44 | |
*** Sukhdev_ has joined #openstack-nova | 16:44 | |
dansmith | jaypipes: will look in a bit | 16:44 |
*** mriedem has joined #openstack-nova | 16:44 | |
*** cdent has joined #openstack-nova | 16:44 | |
*** bvanhav has quit IRC | 16:45 | |
*** shaner has joined #openstack-nova | 16:45 | |
*** sacharya has quit IRC | 16:45 | |
*** zioproto has quit IRC | 16:46 | |
*** bvanhav has joined #openstack-nova | 16:46 | |
*** owalsh_ has joined #openstack-nova | 16:47 | |
*** dnalezyt has joined #openstack-nova | 16:47 | |
*** markus_z has quit IRC | 16:50 | |
bauzas | cfriesen: yup but with terrible connection | 16:50 |
bauzas | So lots of lags | 16:50 |
*** owalsh has quit IRC | 16:50 | |
bauzas | cfriesen: Wazzup? | 16:51 |
cfriesen | bauzas: I think there's a bug in the handling of ignore_hosts. We set it on resize if CONF.allow_resize_to_same_host is False, then we save the RequestSpec and use the same RequestSpec on a subsequent rebuild/evacuate | 16:51 |
*** owalsh_ has quit IRC | 16:51 | |
cfriesen | we reset force_hosts/force_nodes, but not ignore_hosts | 16:52 |
*** rcernin has joined #openstack-nova | 16:52 | |
bauzas | Mmmm | 16:53 |
bauzas | Looks like a miss indeed | 16:53 |
bauzas | cfriesen : patch it up in the object helper then | 16:54 |
cfriesen | in reset_forced_destinations() ? | 16:54 |
*** kaisers_ has quit IRC | 16:55 | |
*** owalsh_ has joined #openstack-nova | 16:56 | |
*** ijw has joined #openstack-nova | 16:56 | |
*** kaisers_ has joined #openstack-nova | 16:56 | |
*** Sukhdev_ has quit IRC | 16:56 | |
*** Swami_ has quit IRC | 16:56 | |
*** raunak has joined #openstack-nova | 16:57 | |
*** owalsh_ is now known as owalsh | 16:58 | |
*** liverpooler has quit IRC | 16:59 | |
*** salv-orlando has joined #openstack-nova | 17:00 | |
dtp | is there a cells meeting today? | 17:00 |
*** kaisers_ has quit IRC | 17:01 | |
bauzas | cfriesen: yup | 17:01 |
dansmith | oops | 17:01 |
bauzas | cfriesen: But I need to dig into code | 17:02 |
*** ijw has quit IRC | 17:02 | |
bauzas | Because I remember a similar issue that I fixed | 17:02 |
*** jose-phillips has joined #openstack-nova | 17:02 | |
sneti | johnthetubaguy, can you please review this when you have time: https://review.openstack.org/#/c/396420/ | 17:03 |
*** yamamoto has joined #openstack-nova | 17:03 | |
johnthetubaguy | sneti: ah, yes, opened that, hopefully will get there soon | 17:03 |
sneti | thanks johnthetubaguy | 17:04 |
*** Sukhdev_ has joined #openstack-nova | 17:05 | |
*** ltomasbo is now known as ltomasbo|away | 17:05 | |
*** ayogi has quit IRC | 17:05 | |
*** ijw has joined #openstack-nova | 17:05 | |
*** yamamoto has quit IRC | 17:08 | |
*** tovin07 has left #openstack-nova | 17:08 | |
*** nic has joined #openstack-nova | 17:08 | |
*** owalsh_ has joined #openstack-nova | 17:09 | |
*** owalsh has quit IRC | 17:10 | |
mriedem | sdague: i want to reuse your FakeResponse thing https://github.com/openstack/nova/blob/master/nova/tests/unit/test_identity.py#L25 | 17:10 |
mriedem | but need to adjust the nonzero | 17:10 |
mriedem | to be True for status_code < 400 | 17:10 |
mriedem | to match requests.Response https://github.com/kennethreitz/requests/blob/v2.12.5/requests/models.py#L658 | 17:10 |
mriedem | sdague: you ok with that? | 17:10 |
*** Apoorva has joined #openstack-nova | 17:11 | |
*** Sukhdev_ has quit IRC | 17:12 | |
*** Swami_ has joined #openstack-nova | 17:12 | |
*** moshele has quit IRC | 17:12 | |
*** aarefiev is now known as aarefiev_afk | 17:13 | |
*** crushil has quit IRC | 17:14 | |
*** owalsh has joined #openstack-nova | 17:14 | |
*** owalsh_ has quit IRC | 17:14 | |
*** felipemonteiro__ has quit IRC | 17:15 | |
*** felipemonteiro_ has quit IRC | 17:15 | |
cfriesen | bauzas: bug 1669054 has been opened to track the issue | 17:15 |
openstack | bug 1669054 in OpenStack Compute (nova) "RequestSpec.ignore_hosts from resize is reused in subsequent evacuate" [Undecided,New] https://launchpad.net/bugs/1669054 | 17:15 |
sdague | mriedem: sure | 17:16 |
andymccr | what is the correct order for nova-manage (api_db/db sync & cell_v2 commands) in an upgrade? i'm running into an issue where greenfield works, but upgrades don't unless the order is slightly different | 17:18 |
andymccr | or rather - is there an order that works for both upgrades and greenfield? :) | 17:19 |
*** ayogi has joined #openstack-nova | 17:19 | |
mriedem | andymccr: https://docs.openstack.org/developer/nova/cells.html#setup-of-cells-v2 | 17:20 |
mriedem | and https://docs.openstack.org/developer/nova/cells.html#step-by-step-for-common-use-cases | 17:20 |
*** felipemonteiro_ has joined #openstack-nova | 17:20 | |
*** felipemonteiro__ has joined #openstack-nova | 17:20 | |
andymccr | mriedem: those docs only cover the cell setup bits - which is working fine afaict. the issue im running into is that in greenfield i have to have done an api_db sync before i can do the cell_v2 map_cell0 - otherwise it fails because certain tables are missing in the nova_api database | 17:21 |
*** lucasxu has quit IRC | 17:21 | |
andymccr | but in an upgrade scenario (from a non-cell_v2 --> cell_v2 deploy, or say N->O) if i run the api_db sync before the cell exists it will bomb saying that the cell needs to exist | 17:22 |
mriedem | yes you need the api db synced to get the cell mapping model | 17:22 |
andymccr | which means that the approach for upgrades doesn't work for greenfield | 17:22 |
mriedem | map_cell0 creates a cell_mappings record in the nova_api db | 17:22 |
andymccr | so then should api_db sync fail if cell0 doesn't exist yet? | 17:22 |
mriedem | andymccr: tripleo? | 17:22 |
andymccr | mriedem: OpenStack-Ansible | 17:22 |
andymccr | although im sure the tripleo ppl have already figured this one out :P | 17:22 |
mriedem | do you already have flavors created? | 17:22 |
*** baoli has quit IRC | 17:22 | |
mriedem | yes owalsh hit the same thing | 17:23 |
mriedem | in tripleo | 17:23 |
*** baoli has joined #openstack-nova | 17:23 | |
mriedem | and we relaxed something in the api db schema migration | 17:23 |
andymccr | mriedem: in testing, no - in practice yes | 17:23 |
*** bvanhav_ has joined #openstack-nova | 17:23 | |
cfriesen | bauzas: I don't think changing reset_forced_destinations() is sufficient by itself given how we handle ignore_hosts in ConductorManager.rebuild_instance(). | 17:23 |
mriedem | andymccr: assuming you have this change? https://github.com/openstack/nova/commit/f781409f366904362b36bb8047fc371c17301c5e | 17:24 |
*** gaurangt has joined #openstack-nova | 17:24 | |
melwitt | I thought upgrade scenario meant not a greenfield? | 17:24 |
mriedem | yeah i'm confused | 17:25 |
melwitt | like, you're upgrading a deployment that already has a api db with a schema in it | 17:25 |
mriedem | if you've synced the api db in newton, you have the cell mappings table and can run map_cell0 | 17:25 |
mriedem | to create an entry in the cell_mappings table in the nova_api db | 17:25 |
andymccr | mriedem: melwitt: sure but the issue is the process is then diff for greenfield vs upgrade, which means i need to have 2 code paths to manage 1 thing | 17:26 |
*** digvijay2016 has joined #openstack-nova | 17:26 | |
mriedem | if it's a completely fresh install, the api db schema migration checks for that by seeing if you have created flavors yet | 17:26 |
andymccr | e.g. in greenfield i do api_db sync --> cell_create --> the other things | 17:26 |
andymccr | and in upgrade im going to have to do cell_create --> api_db sync --> the other things | 17:26 |
owalsh | andymccr: yes, we had to re-order the db sync for upgrades in tripleo | 17:26 |
andymccr | owalsh: so do you do different ordering for upgrade vs greenfield? | 17:26 |
*** slaweq__ has quit IRC | 17:26 | |
*** bvanhav has quit IRC | 17:27 | |
digvijay2016 | how to restrict the nova service from changing hostname of created instance ? | 17:27 |
melwitt | I see. I think maybe you could have the same process for both if you have potentially an extra sync in there. I'd have to think about it more | 17:27 |
mriedem | andymccr: to be clear, on the newton side the api db is already all synced up yes? | 17:28 |
mriedem | before upgrading to ocata | 17:28 |
melwitt | mriedem: does it hurt to do a sync twice? I guess it could | 17:28 |
andymccr | mriedem: yes | 17:28 |
mriedem | melwitt: no | 17:28 |
mriedem | melwitt: db sync is idempotent | 17:28 |
mriedem | if you're already at the latest version, it's a noop | 17:28 |
mriedem | there is a migrations table created in the db that tracks the version you're synced to | 17:28 |
mriedem | i.e. you can do something like nova-manage db sync --version | 17:28 |
melwitt | okay, so maybe it could be api_db sync --> cell_create --> api_db sync --> other things for both? | 17:29 |
andymccr | is there anyway we could get the rc for nova-manage api db_sync to be something that isn't 1 if it fails because the cell doesnt exist? | 17:29 |
mriedem | melwitt: that's how it works for grenade https://github.com/openstack-dev/grenade/blob/stable/ocata/projects/60_nova/from-newton/upgrade-nova | 17:29 |
owalsh | melwitt: no, can't run api_db sync for upgrades until the end | 17:29 |
*** slaweq_ has quit IRC | 17:29 | |
andymccr | ^ yeah the issue is in upgrade you cant run the api_db sync unless the cell exists | 17:29 |
mriedem | newton is all done, then in grenade we create the cell0 db, map_cell0, run simple_cell_setup to create the main cell and host mappings | 17:30 |
andymccr | but in greenfield you cant run the cell unless api_db has been run | 17:30 |
owalsh | andymccr: this is the tripleo upgrade (ansible) tasks https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-api.yaml#L225 | 17:30 |
melwitt | I guess I don't understand why you can't run it twice | 17:30 |
mriedem | andymccr: no, the whole point of the blocker migration is to make sure you've setup cells before starting ocata services | 17:30 |
*** kamtamtun has quit IRC | 17:30 | |
mriedem | melwitt: yeah i also don't see how this is working in grenade but not for anything else | 17:31 |
*** slaweq_ has joined #openstack-nova | 17:31 | |
andymccr | mriedem: so is there a status command we can check that could be a decider around "hey you haven't run api_db sync yet so you need to before cell create" | 17:32 |
*** crushil has joined #openstack-nova | 17:32 | |
andymccr | mriedem: i imagine its working in grenade because you arent using the same path for upgrade vs greenfield - to me it seems silly to have to carry a separate "upgrade" play and it also means we have to determine whether you are upgrading or not - which is tricky. ideally it will just get you to the correct state | 17:32 |
mriedem | andymccr: the nova-status upgrade check command will tell you what's missing yeah | 17:32 |
andymccr | mriedem: ok will try that out - im guessing its meant to be human readable and wont give an rc that i can automate on? | 17:34 |
*** kaisers has quit IRC | 17:35 | |
*** lucasagomes is now known as lucas-afk | 17:35 | |
*** lucasxu has joined #openstack-nova | 17:36 | |
mriedem | andymccr: nova-manage db sync? it's a pass/fail, we don't have logic built in based on how specific migration scripts behave | 17:36 |
mriedem | and the entire point of that blocker migration is that you can't proceed w/o doing some other stuff first | 17:37 |
andymccr | mriedem: i get that - but the problem here is that api_db sync is not idempotent? i can run it fine on a brand new database with no cells, and it works fine - but if i run it again straight after it fails because the cell doesnt exist | 17:38 |
andymccr | end goal is that i want to (at least) be able to determine in an automated fashion where i need to run the cell create then the api_db sync or vice versa. | 17:39 |
cfriesen | separate question about the scheduler. why does live-migration add nodes to request_spec.ignore_hosts on RescheduledException but cold migration doesn't? | 17:40 |
openstackgerrit | MarkMielke proposed openstack/nova master: DiskFilter handling for free space less than zero https://review.openstack.org/430091 | 17:41 |
owalsh | andymccr: we couldn't do that with puppet for the tripleo undercloud, resorted to using an upgrade flag | 17:44 |
*** edmondsw has quit IRC | 17:44 | |
andymccr | owalsh: yeah i want to avoid that if possible :) | 17:44 |
*** jpena is now known as jpena|away | 17:45 | |
melwitt | andymccr: from what I can tell in the code, the return code for the 'cell doesn't exist' should be 2. but you said it was 1 when you did it? | 17:47 |
*** rfolco has joined #openstack-nova | 17:48 | |
andymccr | melwitt: let me do another test - if that's the case then that would be perfect | 17:48 |
*** sambetts is now known as sambetts|afk | 17:48 | |
*** armax has joined #openstack-nova | 17:49 | |
*** liangy has quit IRC | 17:49 | |
mriedem | melwitt: he's talking about nova-manage db sync right? | 17:50 |
mriedem | that's either pass or fail i believe | 17:50 |
melwitt | the return code from the status check is 2, does that not pass through the db sync? | 17:50 |
owalsh | mriedem: api db sync I expect | 17:50 |
mriedem | andymccr: you can tell if it's a fresh install by telling if there are flavors in the api db can't you? that's what the api schema migration does to tell if it's a fresh install or an upgrade | 17:50 |
mriedem | melwitt: nova-status is not the same as nova-manage | 17:50 |
mriedem | the status check is a separate thing | 17:51 |
mriedem | pre-upgrade | 17:51 |
melwitt | mriedem: nova-manage doesn't call nova-status functions to do the blocker? | 17:51 |
mriedem | no | 17:51 |
melwitt | sigh ... okay. nevermind andymccr | 17:52 |
andymccr | mriedem: do you mean by doing a db query to check if it exists? | 17:52 |
mriedem | andymccr: if it's an upgrade isn't nova-api already running? | 17:52 |
*** karimb has quit IRC | 17:52 | |
mriedem | this is the api db migration thats hitting you https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api_migrations/migrate_repo/versions/030_require_cell_setup.py#L28 | 17:52 |
andymccr | mriedem: ok so check if the service is running, if so then do the cell create before the api_db? | 17:52 |
mriedem | that migration checks the api db for flavors, if there are none it assumes fresh install and exists | 17:53 |
mriedem | *exits | 17:53 |
mriedem | i don't know how the osa stuff works to tell if you're upgrading or not | 17:53 |
*** romainh has quit IRC | 17:53 | |
*** salv-orlando has quit IRC | 17:54 | |
owalsh | I doubt using service status would be idempotent | 17:54 |
melwitt | they just need to be able to differentiate between a regular db sync fail and a validation db sync fail. I wonder if we could do something like return 2 if we catch ValidationError | 17:54 |
*** lucasxu has quit IRC | 17:56 | |
andymccr | mriedem: ideally we dont tell the difference between upgrade or not - it should run through in an order that would work for both, or do some logic to ensure an appropriate state is configured | 17:56 |
andymccr | melwitt: that sounds like it would work | 17:56 |
owalsh | melwitt: another nova-status command might be cleaner | 17:56 |
andymccr | yeah if a nova-status command could tell us before hand without failing, that would work fine too | 17:56 |
*** lucasxu has joined #openstack-nova | 17:57 | |
*** salv-orlando has joined #openstack-nova | 17:57 | |
melwitt | owalsh: how does the current nova-status command not work for you? does it return a fail on an empty api db, or? | 17:57 |
*** derekh has quit IRC | 17:58 | |
*** Jeffrey4l has quit IRC | 17:59 | |
*** Swami_ has quit IRC | 17:59 | |
owalsh | melwitt: no idea... garbage collected my brain since then | 18:01 |
*** yamamoto has joined #openstack-nova | 18:04 | |
owalsh | melwitt: possibly because the placement api status checks could give false negatives | 18:05 |
*** armax has quit IRC | 18:06 | |
owalsh | melwitt: I think we would at least need the ability to run individual checks with the current command | 18:07 |
openstackgerrit | Dan Smith proposed openstack/nova master: WIP: Get instance availability_zone without hitting the api db https://review.openstack.org/439754 | 18:09 |
*** eglynn has quit IRC | 18:10 | |
*** yamamoto has quit IRC | 18:10 | |
* owalsh gotta go afk for a while | 18:11 | |
*** owalsh has quit IRC | 18:11 | |
*** fragatina has joined #openstack-nova | 18:11 | |
jbernard | do we support booting from an encrypted volume? | 18:13 |
jbernard | docs does not say explicitly, which makes me wonder | 18:13 |
mriedem | jbernard: should be able to | 18:13 |
kevinbenton | sdague, johnthetubaguy: want to send https://review.openstack.org/#/c/439560/ in? | 18:13 |
jbernard | mriedem: cool thanks, we have also encryptors in os-brick, | 18:14 |
kevinbenton | that last statement i added will allow us to see right what's in the http response | 18:14 |
jbernard | mriedem: do we plan to make use of those at some point, or is that for something else? | 18:14 |
*** tesseract has quit IRC | 18:16 | |
mriedem | jbernard: i thought lyarwood added the encryptors to os-brick | 18:16 |
mriedem | i'm not really familiar | 18:16 |
*** hos1 has joined #openstack-nova | 18:16 | |
*** bvanhav__ has joined #openstack-nova | 18:16 | |
mriedem | i thought the idea was to put them in os-brick so that nova/cinder were talking the same language | 18:16 |
mriedem | because i believe the encryptor class in the volume type in cinder is just a string today | 18:16 |
mriedem | so you can throw whatever in there and it's not validated | 18:16 |
mriedem | until it doesn't work on the nova side | 18:17 |
jbernard | ok, that was my impression as well | 18:17 |
*** bvanhav_ has quit IRC | 18:17 | |
mriedem | kevinbenton: which job would be running with that on so we can see the results? | 18:17 |
smcginnis | mriedem: +1 | 18:17 |
mriedem | i forget which ones run the metadata api | 18:17 |
kevinbenton | mriedem: it seems quite a few more are now | 18:18 |
kevinbenton | mriedem: even gate-tempest-dsvm-neutron-full-ubuntu-xenial | 18:18 |
*** Swami has joined #openstack-nova | 18:18 | |
mriedem | yeah i suppose that makes sense, it's just not a separate service | 18:19 |
mriedem | like in the old pg job | 18:19 |
mriedem | it's running under nova-api | 18:19 |
*** shaner has quit IRC | 18:20 | |
*** shaner has joined #openstack-nova | 18:20 | |
*** owalsh has joined #openstack-nova | 18:21 | |
*** owalsh is now known as owalsh-afk | 18:21 | |
mriedem | kevinbenton: comments inline | 18:23 |
mriedem | melwitt: andymccr: so on the idea of returning a different error code from nova-manage api_db sync, if we return 2 for a ValidationError or something, what would you do? basically always sync and ignore any rc=2 result, then try to map_cell0 and then sync again and if that fails you fail for real? that still seems shitty because at some point we could be raising validation error for something else you're not handling, and ignoring the va | 18:25 |
andymccr | mriedem: yeah the idea would be to know what the rc means - e.g. rc 2 == the cell db needs to be mapped, run that then sync later. but you're right if there are other cases that is problematic | 18:26 |
*** unicell has joined #openstack-nova | 18:27 | |
*** fragatina has quit IRC | 18:27 | |
melwitt | mriedem: yeah, I guess it's still messy. I was thinking in general it might be nice to know if a sync failed because of a validation failure vs something else | 18:28 |
*** sudipto_ has quit IRC | 18:28 | |
*** sudipto has quit IRC | 18:28 | |
openstackgerrit | Kevin Benton proposed openstack/nova master: Add some metadata logging to root cause ssh failure https://review.openstack.org/439560 | 18:29 |
kevinbenton | mriedem, johnthetubaguy: ^^ | 18:29 |
*** cdent has quit IRC | 18:29 | |
mriedem | andymccr: have you hit issues like this in any other project? or do other projects just fail at runtime? | 18:29 |
melwitt | mriedem: owalsh mentioned being able to run individual checks with nova-status would help. so when you're automating, you can tell which things to check and respond to. currently I think the nova-status just checks all the things at the same time and they can't tell which thing failed to know which thing to do next? | 18:29 |
mriedem | +2 | 18:29 |
andymccr | melwitt: yeah that would work too and may be cleaner - e.g. you can do a specific check for the one thing you need | 18:30 |
mriedem | melwitt: yes it runs through a series of checks today and dumps a summary table with results and the most severe rc | 18:30 |
andymccr | mriedem: we do some logic around keystone rolling upgrades and rc responses afaik | 18:30 |
*** bvanhav__ is now known as bvanhav | 18:31 | |
andymccr | so i think keystone-manage db_sync has rc codes for 2 3 4 with 1 being a flat out fail | 18:32 |
dansmith | I'm not really in favor of making db_sync indicate levels of fail | 18:33 |
dansmith | if you run db_sync, look for rc=2 and if so, do something and try to run it again, you're doing it wrong | 18:34 |
andymccr | dansmith: agree - in keystone its a --check | 18:34 |
andymccr | which basically tells you what is needed - you do those things, if they fail its a fail | 18:34 |
dansmith | ah, okay | 18:34 |
andymccr | keystone-manage db_sync --check - can return 2,3,4 (or 1 if it fails i guess) | 18:34 |
mriedem | andymccr: that's basically the same idea with nova-status upgrade check | 18:34 |
dansmith | right | 18:34 |
andymccr | mriedem: with rc's included? or just a table output - if so would it be a reasonable idea to have rc's that indicate what the table says? | 18:35 |
melwitt | yeah, I think we should make it possible to check individual checks via subcommand or something | 18:35 |
mriedem | andymccr: rc's | 18:35 |
andymccr | mriedem: ahh interesting | 18:35 |
mriedem | 0 is good, 1 is warning, 2 is fail | 18:35 |
andymccr | in that case | 18:35 |
andymccr | mriedem: ok i'll play around and see if i can get a spot that basically says "if 2 on status do these, otherwise do these" | 18:35 |
mriedem | melwitt: "check" is the subcommand, i don't think it goes lower than that, but we could build in an option | 18:35 |
andymccr | (for example) | 18:36 |
dansmith | mriedem: if they want to be able to run single checks from nova-status, that's probably okay too, but they have to run it once without that restriction otherwise they won't notice when we add things | 18:36 |
mriedem | nova-status upgrade check --cells | 18:36 |
mriedem | --placement | 18:36 |
mriedem | etc | 18:36 |
melwitt | I see | 18:36 |
mriedem | dansmith: yup | 18:36 |
mriedem | andymccr: v | 18:36 |
mriedem | https://docs.openstack.org/developer/nova/man/nova-status.html | 18:36 |
mriedem | before you ask | 18:36 |
dansmith | heh | 18:37 |
mriedem | god isn't it fucking awesome everything is documented | 18:37 |
andymccr | ah ok so status 2 is just "anything happened" | 18:37 |
andymccr | and 1 is "random warning" so there is no real way to tell what that means unless you inspect the output | 18:37 |
mriedem | andymccr: yeah it's not granular per check right now | 18:37 |
andymccr | ok | 18:37 |
*** liangy has joined #openstack-nova | 18:37 | |
andymccr | maybe i can work around that somehow | 18:37 |
mriedem | 2 means, stop, shit won't start if you proceed | 18:37 |
melwitt | is the only return item a table? maybe we need a json option for parsing by automations? | 18:38 |
mriedem | 1 means, you should investigate, but things will start and shouldn't cause huge issues | 18:38 |
dansmith | mriedem: well, to be fair "shit" will start [happening] if you proceed | 18:38 |
mriedem | well, e.g. n-cpu won't start | 18:38 |
*** annegentle has quit IRC | 18:38 | |
dansmith | mriedem: right.. the "shit" will start [hitting the fan] | 18:38 |
mriedem | in ocata if placement isn't configured | 18:38 |
dansmith | nevermind. | 18:38 |
mriedem | yeah | 18:38 |
mriedem | melwitt: it's a table in stdout and a return code right now yeah | 18:39 |
mriedem | we could build in a json output option if needed | 18:39 |
dansmith | if you know what to do with rich per-test output from that, | 18:39 |
dansmith | then it means you already know what to do, you should do it, and fail if the test says you fail | 18:40 |
mriedem | yeah it does feel like a lot of bending over backwards to hack around something | 18:40 |
dansmith | with the exception of anything that really isn't idempotent, but the only thing i can think of that fits that is cell creation, which should be obvious when to do | 18:40 |
melwitt | I was thinking the problem was, if they get a fail, then they don't know which of the things placement or cells they need to set up | 18:41 |
dansmith | melwitt: they have to set up both things | 18:41 |
dansmith | I'm not sure why there's a question of when or if to do those | 18:41 |
andymccr | dansmith: the issue is in upgrades you have to make sure you do a cell create before a api_db sync - in greenfield you have to do the reverse order | 18:41 |
andymccr | that means the upgrade vs new install path is different | 18:41 |
andymccr | so having a mechanism to determine what needs to happen is important unless we want to carry an "upgrade" flag which is really not a great way to do deploys | 18:42 |
dansmith | andymccr: how is it opposite? | 18:42 |
andymccr | dansmith: if you run api_db sync when cell_v2 create hasnt run it fails saying "cell doesnt exist" on an upgrade | 18:42 |
openstackgerrit | Feodor Tersin proposed openstack/nova-specs master: Add ScaleIO ephemeral storage backend https://review.openstack.org/304715 | 18:42 |
andymccr | but on a greenfield deploy if you run "cell_create" without api_db sync having happened it says "cant write to nova_api database" | 18:42 |
dansmith | ah, okay, I see | 18:42 |
dansmith | that's a very atypical example, so maybe we work around that one specifically instead of building in a lot of "check this before doing a thing" for other stuff? | 18:43 |
dansmith | andymccr: how do you know if flavors need to be created? | 18:43 |
*** harlowja has quit IRC | 18:43 | |
dansmith | (i.e. upgrade or new install) | 18:44 |
*** gszasz has joined #openstack-nova | 18:44 | |
*** fragatina has joined #openstack-nova | 18:44 | |
andymccr | we don't create flavors as part of the deploy - that's up to the deployer afterwards if they want (or in testing the tempest role sets up the bits) | 18:44 |
andymccr | but the create bits are idempotent so if they exist it doesnt bomb or anything | 18:45 |
dansmith | oh okay I thought you did | 18:45 |
dansmith | okay, so, the migration uses flavors to determine if it should fail | 18:45 |
dansmith | depending on where this runs you could probably do the same | 18:45 |
mriedem | sdague: sfinucan: i've figured out that https://review.openstack.org/#/c/434339/ introduces a bug | 18:45 |
mriedem | in the 204 case | 18:45 |
dansmith | andymccr: also you could sync to before the blocker, do the create, then finish the sync and that would work for both cases | 18:46 |
*** harlowja has joined #openstack-nova | 18:46 | |
andymccr | dansmith: how can i specify to sync to before the blocker? | 18:46 |
mriedem | fixing | 18:46 |
andymccr | dansmith: if i understand what you mean you do the first part of the sync, then create the cell if it doesnt exist, then finish the sync | 18:46 |
dansmith | andymccr: sync --version 123 | 18:47 |
dansmith | andymccr: yup | 18:47 |
*** yamahata has joined #openstack-nova | 18:47 | |
mriedem | andymccr: there is also a nova-manage cell_v2 list_cells command | 18:47 |
dansmith | andymccr: that blocker was attempting to prevent people from screwing themselves by not reading the docs, but I see how it puts you in a tight spot | 18:48 |
mriedem | you could parse that for the nova_cell0 entry | 18:48 |
dansmith | mriedem: that too | 18:48 |
dansmith | andymccr: with nova-status we may be able to get away from doing that as much in the future | 18:48 |
andymccr | mriedem: that would tell if cells exist, so in the case of greenfield i still need an api_db sync first - in upgrades i wouldn't | 18:48 |
mriedem | yeah, we did this blocker migration before we had nova-status | 18:48 |
andymccr | mriedem: the key one would be a "has an api_db sync ever run successfully" command | 18:49 |
dansmith | andymccr: db version | 18:49 |
mriedem | yeah | 18:49 |
*** adisky_ has quit IRC | 18:49 | |
mriedem | nova-manage api_db version | 18:49 |
dansmith | andymccr: 'nova-manage api_db version' to see if you're at 0, before the blocker, or after, then do the right thing | 18:49 |
mriedem | that will tell you if you've synced | 18:49 |
*** lpetrut has joined #openstack-nova | 18:50 | |
openstackgerrit | Sujitha proposed openstack/nova master: Remove mox from nova.tests.unit.virt.xenapi.test_vmops[2] https://review.openstack.org/439770 | 18:50 |
andymccr | mriedem: dansmith thanks a bunch i'll play around with those and try see if i can get something working. that sounds like it may work | 18:50 |
dansmith | andymccr: cool | 18:51 |
andymccr | owalsh-afk: i'll let you know what i come up with | 18:51 |
andymccr | it might be helpful for tripleo too | 18:51 |
melwitt | dansmith: how can you tell what version the blocker is? | 18:51 |
dansmith | melwitt: look in the tree? | 18:51 |
dansmith | melwitt: this would be a special case for this blocker | 18:52 |
melwitt | so 030 I guess | 18:52 |
dansmith | melwitt: yep | 18:52 |
*** salv-orl_ has joined #openstack-nova | 18:52 | |
sdague | mriedem: really, because there is a unit test for that | 18:53 |
mriedem | sdague: it doesn't model the requests.Response.__bool__ override | 18:53 |
mriedem | sdague: i've got the fix, just opening a separate bug for it | 18:54 |
*** cdent has joined #openstack-nova | 18:54 | |
sdague | https://review.openstack.org/#/c/434339/3/nova/tests/unit/test_metadata.py@907 | 18:54 |
mriedem | yeah, it's borked | 18:54 |
sdague | mriedem: ok, what's wrong with the unit test? | 18:54 |
*** gszasz has quit IRC | 18:54 | |
sdague | oh, did it skip a step? | 18:54 |
mriedem | yes | 18:55 |
sdague | also... why do we believe people are going to return a 204 from this who's purpose is to fetch data? | 18:55 |
*** salv-orlando has quit IRC | 18:55 | |
mriedem | i thought about that too | 18:55 |
sdague | like, I don't even understand why we would believe that's a thing | 18:55 |
mriedem | and i don't know, but mikal built it into the tests | 18:55 |
sdague | right, but I think he was cantriping something else | 18:55 |
sdague | those tests and the use of requests status codes look very much like copy paste from some other pattern | 18:56 |
sdague | anyway, it's probably fine to just make sure that the json decode exception is handled | 18:56 |
*** gouthamr has quit IRC | 18:56 | |
mriedem | it is, it handles a TypeError and ValueError | 18:56 |
sdague | ok, then we are fine, right? | 18:56 |
mriedem | but that results in a warning for a successful response | 18:57 |
mriedem | no | 18:57 |
sdague | I'm not sure I buy that 204 is here intentionally | 18:57 |
mriedem | well, | 18:57 |
mriedem | it doesn't work for me because it started making my tests in https://review.openstack.org/#/c/435563/ fail | 18:57 |
sdague | the fact that the 204 unit test returned content, makes me again think this is randomly just added | 18:57 |
mriedem | because i was expecting one warning, not two | 18:57 |
mriedem | the 204 unit test doesn't return content | 18:57 |
sdague | mriedem: ... that I don't accept :) | 18:57 |
sdague | mriedem: it used to | 18:58 |
*** baoli has quit IRC | 18:58 | |
sdague | https://review.openstack.org/#/c/434339/3/nova/tests/unit/test_metadata.py@849 that's why that had to be changed | 18:58 |
mriedem | request_mock.return_value.status_code = response_code | 18:58 |
mriedem | the actual runtime was changed to not look at status_code | 18:58 |
mriedem | and so it just looks at request_mock.return_value which is truthy i guess | 18:58 |
sdague | mriedem: but the unit test simulating the 204 was returning content previously | 18:59 |
*** baoli has joined #openstack-nova | 18:59 | |
mriedem | yeah true | 18:59 |
sdague | which makes me really really believe none of this was part of the design, it was just a cantrib | 18:59 |
sdague | cantrip | 18:59 |
sdague | so stop reading so much meaning into it :) | 18:59 |
mriedem | i don't know wtf a cantrip is | 18:59 |
sdague | magic spell | 18:59 |
mriedem | duped by those aussies again! | 19:00 |
sdague | spin around 3 times, I don't get a cold, ok, just do that every day | 19:00 |
sdague | the talisman will keep the tigers away | 19:00 |
*** gouthamr has joined #openstack-nova | 19:00 | |
mriedem | headache is a demon in my head? | 19:00 |
sdague | yep, pretty much | 19:00 |
mriedem | so i'm still going to handle the if res and res.text case, because we don't know how people are going to use this, there could be like a first time checkin thing that returns data, and later calls don't, idk | 19:02 |
mriedem | i suspect that's maybe what mikal was thinking | 19:03 |
mriedem | that would seem pretty crappy though | 19:03 |
openstackgerrit | John Garbutt proposed openstack/nova-specs master: Add spec to use Cinder's new attachment APIs https://review.openstack.org/373203 | 19:03 |
*** nikhil|afk has quit IRC | 19:03 | |
*** lpetrut has quit IRC | 19:04 | |
*** dharinic is now known as dharinic|lunch | 19:05 | |
*** yamamoto has joined #openstack-nova | 19:06 | |
*** Guest52040 has quit IRC | 19:08 | |
*** ducttape_ has quit IRC | 19:10 | |
*** yamamoto has quit IRC | 19:12 | |
sdague | mriedem: well, we're not handling any of the 30x stuff in real ways either, like processing the redirects | 19:14 |
sdague | mriedem: honestly, I think this is being overthought, this is a custom service that the op is writing, if they write it to do bad things, .... there is only so much protection here | 19:15 |
sdague | especially as this is in the metadata code which is ... you know, funky :) | 19:16 |
*** dulek has quit IRC | 19:17 | |
*** pkoniszewski has quit IRC | 19:18 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Check for 204 case in DynamicVendorData https://review.openstack.org/439785 | 19:19 |
*** lpetrut has joined #openstack-nova | 19:19 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Only create vendordata_dynamic ksa session if needed https://review.openstack.org/435563 | 19:22 |
*** salv-orl_ has quit IRC | 19:23 | |
*** pkoniszewski has joined #openstack-nova | 19:24 | |
*** dulek has joined #openstack-nova | 19:24 | |
mriedem | Vek: andreykurilin: tdurakov: we should have had a release note with this https://review.openstack.org/#/c/439141/ | 19:27 |
andreykurilin | oh.. | 19:27 |
andreykurilin | sure | 19:27 |
*** baoli has quit IRC | 19:27 | |
mriedem | we can just roll one on top | 19:27 |
Gorian | huh. I got pinged here, but it's been unusally active, so I don't have history that far back... | 19:28 |
mriedem | Gorian: http://eavesdrop.openstack.org/irclogs/%23openstack-nova/ | 19:28 |
mriedem | ha http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2017-03-01.log.html#t2017-03-01T06:41:59 | 19:28 |
mriedem | who are you anyway? | 19:28 |
mriedem | :) | 19:28 |
Gorian | awesome, thanks! | 19:29 |
*** gfhellma has quit IRC | 19:29 | |
Gorian | mriedem so mean :( | 19:29 |
Gorian | lol, idk, just random person sitting in iRC :P | 19:29 |
mriedem | works for me | 19:29 |
*** digvijay2016 has quit IRC | 19:29 | |
*** fragatina has quit IRC | 19:29 | |
*** fragatina has joined #openstack-nova | 19:30 | |
*** raj_singh_ has joined #openstack-nova | 19:30 | |
*** baoli has joined #openstack-nova | 19:30 | |
Gorian | lol. Who are you? | 19:30 |
*** raj_singh_ has quit IRC | 19:31 | |
*** fragatina has quit IRC | 19:31 | |
mriedem | i am who i am | 19:31 |
mriedem | this could get really zen like | 19:32 |
*** fragatina has joined #openstack-nova | 19:32 | |
openstackgerrit | Matt Riedemann proposed openstack/python-novaclient master: Remove functional tests for removed commands https://review.openstack.org/439795 | 19:34 |
mriedem | andreykurilin: here is that test fix ^ | 19:34 |
FL1SK | Has anyone ever launched an instance from an ISO format that gives you EDD information unavailable from the kernel then eventually just reboots after a minute | 19:35 |
*** baoli has quit IRC | 19:35 | |
FL1SK | the same image a standard KVM Host does not show the EDD information unavailable error | 19:35 |
FL1SK | what would be different with Nova KVM? Does anyone have any clues | 19:36 |
*** jose-phillips has quit IRC | 19:40 | |
*** cdent has quit IRC | 19:46 | |
*** ducttape_ has joined #openstack-nova | 19:48 | |
openstackgerrit | melanie witt proposed openstack/nova-specs master: Proposal to count resources to check quota in API for cells https://review.openstack.org/431749 | 19:55 |
*** dikonoor has quit IRC | 19:57 | |
*** annegentle has joined #openstack-nova | 19:57 | |
*** pcaruana has quit IRC | 19:58 | |
*** ducttape_ has quit IRC | 19:59 | |
*** armax has joined #openstack-nova | 19:59 | |
*** ducttape_ has joined #openstack-nova | 20:01 | |
mriedem | mtreinish: i think i see the issue with that fuzzy ip filtering | 20:01 |
openstackgerrit | Timofey Durakov proposed openstack/python-novaclient master: Release note for cell_name deprecation https://review.openstack.org/439822 | 20:02 |
*** adrian_otto has quit IRC | 20:02 | |
*** dharinic|lunch is now known as dharinic | 20:02 | |
*** openstackgerrit has quit IRC | 20:03 | |
mtreinish | mriedem: cool, so I was right it was a nova bug? | 20:03 |
*** openstackgerrit has joined #openstack-nova | 20:03 | |
openstackgerrit | Timofey Durakov proposed openstack/python-novaclient master: Release note for cell_name deprecation https://review.openstack.org/439822 | 20:03 |
*** amoralej is now known as amoralej|off | 20:03 | |
tdurakov | mriedem: hi, release note for nova-client^ | 20:04 |
*** lucasxu has quit IRC | 20:05 | |
mriedem | tdurakov: thanks, some nits inline | 20:05 |
mriedem | mtreinish: here https://github.com/openstack/nova/blob/3a2a181796664fea7f6069d49f9cd367b8cff825/nova/compute/api.py#L2496 | 20:06 |
mriedem | we don't filter the ip in the db query actually | 20:06 |
mriedem | on the first match, we return https://github.com/openstack/nova/blob/3a2a181796664fea7f6069d49f9cd367b8cff825/nova/compute/api.py#L2508 | 20:06 |
openstackgerrit | Timofey Durakov proposed openstack/python-novaclient master: Release note for cell_name deprecation https://review.openstack.org/439822 | 20:07 |
tdurakov | mriedem: done | 20:07 |
*** harlowja has quit IRC | 20:08 | |
*** yamamoto has joined #openstack-nova | 20:08 | |
mriedem | http://paste.openstack.org/show/600998/ | 20:09 |
mriedem | mtreinish: ^ | 20:09 |
mriedem | that's the bug | 20:09 |
*** dulek has quit IRC | 20:09 | |
*** pkoniszewski has quit IRC | 20:09 | |
*** READ10 has quit IRC | 20:09 | |
mriedem | mtreinish: so i'm thinking we build the list of matches, and if more than one, we have to filter the matches from most specific to least specific | 20:10 |
mtreinish | mriedem: oh, so that's much easier. It would have been a bit more involved if it was in the db layer | 20:11 |
mriedem | i'm not entirely sure how to do that, first thought is you throw ^<address>$ on there | 20:11 |
mtreinish | mriedem: yeah that makes sense. Could do a first pass on exact match (without a regex) or would that be too big a departure from the existing api semantics | 20:11 |
mriedem | that's actually easier | 20:12 |
mriedem | exact match first, if no hits, use regex | 20:12 |
mriedem | if multiple hits after regex... shrug? | 20:12 |
openstackgerrit | Timofey Durakov proposed openstack/python-novaclient master: Release note for cell_name deprecation https://review.openstack.org/439822 | 20:12 |
mtreinish | mriedem: return all? | 20:12 |
mtreinish | or return error | 20:13 |
mriedem | return all | 20:13 |
mriedem | this is a LIST operation | 20:13 |
mriedem | let the client sort it out | 20:13 |
mriedem | let me see how latent this is | 20:13 |
*** yamamoto has quit IRC | 20:13 | |
mriedem | i also wonder if it behaves this way because of https://github.com/openstack/nova/blob/3a2a181796664fea7f6069d49f9cd367b8cff825/nova/compute/api.py#L2362 | 20:15 |
mriedem | if you filter on fixed_ip it uses an exact regex match | 20:15 |
*** dulek has joined #openstack-nova | 20:15 | |
mriedem | the tempest test doesn't use that though | 20:16 |
*** lucasxu has joined #openstack-nova | 20:16 | |
*** pkoniszewski has joined #openstack-nova | 20:17 | |
openstackgerrit | Matt Riedemann proposed openstack/python-novaclient master: Release note for cell_name deprecation https://review.openstack.org/439822 | 20:18 |
mriedem | mtreinish: i put a -1 on the tempest patch and added nova to the bug report | 20:19 |
*** avolkov has quit IRC | 20:19 | |
*** jose-phillips has joined #openstack-nova | 20:19 | |
mriedem | mtreinish: so it looks like when vish added that long ago it returned all matches https://github.com/openstack/nova/commit/ae781ee97947c33d6d43e4c21df4f338c875bf1c | 20:22 |
mriedem | https://github.com/openstack/nova/commit/ae781ee97947c33d6d43e4c21df4f338c875bf1c#diff-516904cc81cade24a9122ecf96707bf0R2029 | 20:22 |
mriedem | this made it short circuit https://github.com/openstack/nova/commit/8fc7eee58ebd929dda75e467f93c381091da7ace | 20:22 |
erhudy | does anyone have any top tips for taking a particular SQL query and walking back to the SQLAlchemy statements that are responsible for it? perhaps particular settings in default_log_levels would print something useful out? | 20:22 |
mriedem | erhudy: i think there are trace options in the oslo.db section | 20:23 |
mtreinish | mriedem: heh, it always comes back to vish | 20:24 |
*** baoli has joined #openstack-nova | 20:24 | |
mriedem | heh, it's actually kaufer's regression | 20:25 |
mriedem | don't worry, i'm harranging him internally | 20:26 |
mriedem | for someone he did 2 years ago and doesn't remember at all | 20:26 |
mriedem | *something | 20:26 |
*** hurricanerix has joined #openstack-nova | 20:30 | |
sdague | erhudy: the generated sql is emitted by sqla at debug level, but we turn that off because its *so* noisy. If you play with some of the oslo.log default configs you can tweak it from there | 20:32 |
erhudy | yeah, i just tried connection_trace and that blew up in my face with a stack trace, connection_debug is pretty noisy but getting closer | 20:32 |
Gorian | mriedem: sorry, ran away to lunch | 20:32 |
*** krtaylor has quit IRC | 20:32 | |
Gorian | I write python, so I 'm okay with Zen :P | 20:32 |
*** nic has left #openstack-nova | 20:32 | |
erhudy | somebody is running some ansible playbook against a cluster with 25 forks and it is causing the database to go nuclear | 20:32 |
*** nic has joined #openstack-nova | 20:32 | |
erhudy | so i am on a spelunking expedition to understand why | 20:33 |
mriedem | erhudy: ok so you found those, sorry i was looking them up but got distracted | 20:33 |
mriedem | erhudy: zzzeek might have pointers | 20:33 |
sdague | erhudy: https://github.com/openstack/oslo.log/blob/5d1a93bc0f597768e27bd116de9d7a66b4cd1f24/oslo_log/_options.py#L20 | 20:34 |
erhudy | thanks | 20:34 |
mriedem | sdague: so i guess https://review.openstack.org/#/c/324720/ is happyish | 20:35 |
mriedem | not sure the xen or vmware failures are related | 20:35 |
mriedem | oh the vmware one is from november | 20:35 |
mriedem | hah | 20:35 |
sdague | erhudy: I think that exposes as default_log_levels back in any of the projects, so replace it with the list you like, then debug logs for sqla should come back | 20:35 |
sdague | mriedem: I guess it didn't like the recheck | 20:35 |
sdague | mriedem: yeh, just comment what you would like in a reno (if so), and I'll update the commit message for merge | 20:36 |
sdague | it pulls out future sec exposures as well | 20:36 |
mriedem | the vmware one isn't from a recheck | 20:36 |
sdague | right, but when I update the patch, they should revote | 20:36 |
mriedem | speaking of vmware....bueller? | 20:36 |
mriedem | they won't | 20:37 |
sdague | oh | 20:37 |
sdague | well, it's a libvirt feature | 20:37 |
sdague | I'm pretty sure you can't get there from anywhere else | 20:37 |
mriedem | is it? | 20:37 |
sdague | git grep inject_data | 20:39 |
mriedem | the xen ci failure was a stack failure | 20:39 |
sdague | I see libvirt and xen | 20:39 |
sdague | but xen is a different function | 20:39 |
*** edmondsw has joined #openstack-nova | 20:39 | |
sdague | yeh, xen half end runs around this with their own localfs call | 20:40 |
sdague | https://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/virt/xenapi/vm_utils.py#L2479 | 20:40 |
*** liangy has quit IRC | 20:41 | |
sdague | this would take it out of the libvirt path | 20:41 |
mriedem | ok, i assumed you'd be removing VFSLocalFS altogether | 20:41 |
sdague | the xen path has a fallback here when the xenagent isn't a thing | 20:41 |
sdague | well this patch was a DNM exploring a security bug | 20:42 |
sdague | a xen person would have to get on board about what the xen path looks like here, the libvirt one is pretty straight forward | 20:43 |
*** CristinaPauna has quit IRC | 20:44 | |
*** liangy has joined #openstack-nova | 20:44 | |
*** edmondsw has quit IRC | 20:46 | |
openstackgerrit | Maciej Szankin proposed openstack/nova master: conf: remove *_topic config opts https://review.openstack.org/433924 | 20:47 |
*** edmondsw has joined #openstack-nova | 20:47 | |
*** adrian_otto has joined #openstack-nova | 20:47 | |
*** bvanhav has quit IRC | 20:47 | |
*** lucasxu has quit IRC | 20:48 | |
*** swann_ has joined #openstack-nova | 20:48 | |
*** jtriv has joined #openstack-nova | 20:49 | |
*** kuzko_ has joined #openstack-nova | 20:50 | |
*** mrodden_ has joined #openstack-nova | 20:51 | |
*** mmedvede_ has joined #openstack-nova | 20:52 | |
*** rhagarty_ has joined #openstack-nova | 20:52 | |
*** htruta` has joined #openstack-nova | 20:52 | |
*** edmondsw has quit IRC | 20:52 | |
*** jotr has quit IRC | 20:53 | |
*** kuzko has quit IRC | 20:53 | |
*** rhagarty has quit IRC | 20:53 | |
*** htruta has quit IRC | 20:53 | |
*** mmedvede has quit IRC | 20:53 | |
*** mrodden has quit IRC | 20:53 | |
*** swann has quit IRC | 20:53 | |
*** mrodden_ is now known as mrodden | 20:53 | |
*** mmedvede_ is now known as mmedvede | 20:53 | |
*** lucasxu has joined #openstack-nova | 20:55 | |
*** Apoorva has quit IRC | 20:55 | |
*** Apoorva has joined #openstack-nova | 20:59 | |
*** ducttape_ has quit IRC | 21:00 | |
*** jvgrant has joined #openstack-nova | 21:01 | |
*** harlowja has joined #openstack-nova | 21:01 | |
*** harlowja has quit IRC | 21:01 | |
*** harlowja has joined #openstack-nova | 21:01 | |
*** pkoniszewski has quit IRC | 21:02 | |
cfriesen | bauzas: it looks like we set request_spec.ignore_hosts in compute.api.API.resize(), so we can't overwrite it later when we call reset_forced_destinations() from nova.conductor.tasks.migrate.MigrationTask.execute() | 21:03 |
*** dulek has quit IRC | 21:03 | |
*** ijw has quit IRC | 21:05 | |
*** mjura has quit IRC | 21:06 | |
*** Nakato has quit IRC | 21:06 | |
*** Nakato has joined #openstack-nova | 21:07 | |
*** catintheroof has joined #openstack-nova | 21:08 | |
*** pkoniszewski has joined #openstack-nova | 21:09 | |
*** dulek has joined #openstack-nova | 21:09 | |
*** krtaylor has joined #openstack-nova | 21:09 | |
*** yamamoto has joined #openstack-nova | 21:10 | |
*** catintheroof has quit IRC | 21:10 | |
*** catintheroof has joined #openstack-nova | 21:10 | |
*** pkoniszewski has quit IRC | 21:12 | |
*** dulek has quit IRC | 21:12 | |
*** yamamoto has quit IRC | 21:12 | |
*** yamamoto has joined #openstack-nova | 21:12 | |
*** dimtruck is now known as zz_dimtruck | 21:14 | |
*** salv-orlando has joined #openstack-nova | 21:14 | |
*** ayogi has quit IRC | 21:16 | |
*** dulek has joined #openstack-nova | 21:19 | |
*** pkoniszewski has joined #openstack-nova | 21:19 | |
*** yamamoto has quit IRC | 21:19 | |
dansmith | dtp: still around? | 21:20 |
dtp | yessir | 21:20 |
*** ducttape_ has joined #openstack-nova | 21:20 | |
dansmith | dtp: so I think we're failing to get a list of tests that fail because we're just timing out the job on my patch | 21:20 |
dansmith | too many fails means too many delays | 21:20 |
dansmith | I ran the whole deal locally and got a good report | 21:20 |
dansmith | looking at it, the hypervisors list api is probably a self-contained thing you could work on if you want | 21:20 |
dansmith | tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON | 21:21 |
dansmith | if you run that module locally you'll get five tests that fail and then you can go from there | 21:21 |
*** dulek has quit IRC | 21:21 | |
dansmith | can probably start with just poking at hypervisors with the client and then run the test once you think it's working | 21:21 |
dansmith | interested? | 21:21 |
*** pkoniszewski has quit IRC | 21:22 | |
dtp | sure | 21:22 |
openstackgerrit | Kaitlin Farr proposed openstack/nova master: Remove deprecated keymgr code https://review.openstack.org/439855 | 21:22 |
dansmith | cool | 21:23 |
dtp | i've not done any tempest stuff before. that's external to nova right? | 21:23 |
dansmith | yeah, you only need to run it though no mods required | 21:24 |
dansmith | and only after you poke with nova hypervisor-list and think you have it fixed | 21:24 |
dtp | oh - nova hypervisor-list is having the issue? | 21:25 |
dansmith | right, and thus tempest is breaking because it's checking that interface | 21:26 |
dansmith | it's actually not the client having the problem, nor tempest.. it's the server-side api code | 21:26 |
dtp | i see | 21:26 |
dansmith | so, nova/api/openstack/compute/hypervisors.py or something | 21:26 |
dansmith | that api now needs to iterate over cells to gather the list | 21:27 |
dtp | ah, ok | 21:27 |
dtp | and which patch of yours? | 21:28 |
dansmith | this set: https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:multi-cell-testing | 21:29 |
dtp | thanks | 21:29 |
dansmith | plus this devstack patch which creates things in multiple cells: | 21:29 |
dansmith | https://review.openstack.org/#/c/436094/ | 21:29 |
*** bastafidli has quit IRC | 21:30 | |
openstackgerrit | Maciej Szankin proposed openstack/nova master: conf: resolved final todos in libvirt conf https://review.openstack.org/429042 | 21:30 |
*** bastafidli has joined #openstack-nova | 21:30 | |
*** pcaruana has joined #openstack-nova | 21:30 | |
*** kfarr has quit IRC | 21:31 | |
mriedem | sdague: left a comment about the reno in your localfs removal change | 21:33 |
mriedem | with thoughts anyway | 21:33 |
*** pcaruana has quit IRC | 21:33 | |
mriedem | i'm cool with leaving VFSLocalFS in for xenapi to sort out, BobBall should probably take a look | 21:33 |
*** gouthamr has quit IRC | 21:33 | |
dansmith | dtp: this is the tempest module: https://github.com/openstack/tempest/blob/master/tempest/api/compute/admin/test_hypervisor.py | 21:38 |
dtp | mriedem is there a deadline for pike blueprint submissions (no spec) | 21:38 |
dansmith | with multiple cells, it fails to list all the hypervisors | 21:38 |
dtp | ok, thanks dansmith | 21:38 |
mriedem | dtp: you probably want it done by the first milestone | 21:38 |
*** ducttape_ has quit IRC | 21:38 | |
dtp | ok ty | 21:39 |
dansmith | dtp: fail looks like this: http://pastebin.com/wyh1jEYT | 21:39 |
dtp | cool, thanks dansmith | 21:39 |
mriedem | dtp: https://wiki.openstack.org/wiki/Nova/Pike_Release_Schedule#Dates_Overview | 21:39 |
*** claudiub|2 has joined #openstack-nova | 21:40 | |
mriedem | dtp: i was going to bring up spec freeze in the nova meeting tomorrow | 21:40 |
mriedem | since we didn't talk about that at the ptg | 21:40 |
dtp | i'll be there (it's the late one, right? ;) | 21:40 |
dansmith | yes | 21:42 |
*** aysyd has quit IRC | 21:42 | |
*** dtp is now known as dtp-afk | 21:43 | |
*** dtp-afk is now known as dtp | 21:48 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Handle conflicts for os-assisted-volume-snapshots https://review.openstack.org/429476 | 21:49 |
*** crushil has quit IRC | 21:52 | |
*** pkholkin has quit IRC | 21:55 | |
*** kaisers has joined #openstack-nova | 21:56 | |
*** thorst has quit IRC | 22:00 | |
*** thorst has joined #openstack-nova | 22:00 | |
*** kaisers has quit IRC | 22:01 | |
*** boris-42_ has quit IRC | 22:01 | |
dtp | what is searchlight? | 22:02 |
*** Apoorva_ has joined #openstack-nova | 22:02 | |
*** Apoorva_ has quit IRC | 22:03 | |
*** Apoorva has quit IRC | 22:03 | |
*** Apoorva has joined #openstack-nova | 22:03 | |
*** CristinaPauna has joined #openstack-nova | 22:04 | |
*** thorst has quit IRC | 22:04 | |
*** yamamoto has joined #openstack-nova | 22:05 | |
dansmith | dtp: http://lmgtfy.com/?q=openstack+searchlight | 22:05 |
dtp | heh | 22:05 |
dtp | thanks | 22:05 |
* dansmith couldn't resist | 22:05 | |
jroll | wow | 22:06 |
mriedem | has anyone noticed that pbr 2.0 has broken nova-specs? i don't think we use upper-constraints on nova-specs | 22:06 |
dansmith | dtp: with cells we'll have this problem of not being able to efficiently query all the cells, merge the list of instances and return them sorted, without doing slow things in python | 22:07 |
dansmith | dtp: since searchlight is aiming to be a superfast cache of other services with all those fancy gadgets, the plan is to just delegate to them when we have N>1 cells and lots of instances | 22:08 |
*** ijw has joined #openstack-nova | 22:09 | |
*** peter-os has joined #openstack-nova | 22:09 | |
*** peter-os has left #openstack-nova | 22:09 | |
*** lucasxu has quit IRC | 22:09 | |
dtp | thanks | 22:10 |
* mriedem fixes nova-specs | 22:12 | |
*** ijw has quit IRC | 22:15 | |
*** dave-mccowan has quit IRC | 22:21 | |
*** zz_dimtruck is now known as dimtruck | 22:22 | |
openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Update requirements to fix pbr 2.0.0 fail https://review.openstack.org/439878 | 22:26 |
*** armax has quit IRC | 22:26 | |
*** browne has quit IRC | 22:27 | |
*** xinli has joined #openstack-nova | 22:29 | |
xinli | mnestratov: Hi | 22:30 |
*** thorst has joined #openstack-nova | 22:30 | |
*** CristinaPauna has quit IRC | 22:30 | |
openstackgerrit | Ed Leafe proposed openstack/nova master: placement: ironic inventory reporting https://review.openstack.org/437602 | 22:31 |
edleafe | jaypipes: ^^ fixed the pep8 issue | 22:31 |
*** karimb has joined #openstack-nova | 22:31 | |
*** felipemonteiro__ has quit IRC | 22:32 | |
*** felipemonteiro_ has quit IRC | 22:32 | |
openstackgerrit | Sujitha proposed openstack/nova master: Remove mox from nova/tests/unit/api/openstack/compute/test_create_backup.py https://review.openstack.org/435610 | 22:33 |
dims | adreznec : thorst : ping about pypowervm :) | 22:33 |
dims | adreznec : thorst : last thing we need for unblocking a bunch of people https://review.openstack.org/#/c/439790/ | 22:33 |
openstackgerrit | Sujitha proposed openstack/nova master: Remove mox from nova.tests.unit.api.openstack.compute.test_create_backup https://review.openstack.org/435610 | 22:34 |
openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Treat doc build warnings as errors https://review.openstack.org/439883 | 22:34 |
mriedem | dansmith: do it to it https://review.openstack.org/#/c/439878/ | 22:34 |
*** thorst has quit IRC | 22:35 | |
mriedem | dansmith: you should just fast approve | 22:35 |
dansmith | mriedem: did you want the full monty? | 22:35 |
dansmith | heh | 22:35 |
mriedem | specs are blocked | 22:35 |
mriedem | yeah | 22:35 |
mriedem | you can keep your pants on | 22:35 |
dansmith | hehe | 22:35 |
mriedem | or not, whatever | 22:36 |
dansmith | how about I do what I want and don't tell you? | 22:36 |
mriedem | that also works | 22:37 |
*** ducttape_ has joined #openstack-nova | 22:39 | |
dims | LOL | 22:39 |
*** ijw has joined #openstack-nova | 22:40 | |
*** CristinaPauna has joined #openstack-nova | 22:40 | |
openstackgerrit | Sujitha proposed openstack/nova master: Remove mox from nova.tests.unit.api.openstack.compute.test_create_backup https://review.openstack.org/435610 | 22:42 |
*** bastafidli has quit IRC | 22:42 | |
*** ijw has quit IRC | 22:44 | |
*** ducttape_ has quit IRC | 22:45 | |
*** breitz_ has joined #openstack-nova | 22:45 | |
*** breitz has quit IRC | 22:46 | |
jaypipes | edleafe: cheers, had a meeting... | 22:47 |
*** esberglu has quit IRC | 22:48 | |
openstackgerrit | Pushkar Umaranikar proposed openstack/nova-specs master: Stop using Neutron admin token https://review.openstack.org/439890 | 22:49 |
*** smatzek_ has quit IRC | 22:49 | |
adreznec | dims: tonyb: Updated pypowervm is up on pypi https://pypi.python.org/pypi/pypowervm/1.0.0.4.1 | 22:49 |
*** baoli has quit IRC | 22:50 | |
dims | thanks adreznec | 22:50 |
adreznec | Sorry for the delay | 22:50 |
tonyb | adreznec: #woot! Thanks | 22:50 |
*** salv-orlando has quit IRC | 22:50 | |
tonyb | dims: I'll update "the" review | 22:50 |
dims | go for it tonyb | 22:50 |
*** salv-orlando has joined #openstack-nova | 22:51 | |
openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Proposal to count resources to check quota in API for cells https://review.openstack.org/431749 | 22:51 |
*** ducttape_ has joined #openstack-nova | 22:51 | |
*** tbachman has quit IRC | 22:52 | |
*** breitz has joined #openstack-nova | 22:52 | |
openstackgerrit | Dan Smith proposed openstack/nova master: WIP: Get instance availability_zone without hitting the api db https://review.openstack.org/439754 | 22:54 |
openstackgerrit | Dan Smith proposed openstack/nova master: Make scheduler target cells to get compute node instance info https://review.openstack.org/439891 | 22:54 |
*** slaweq_ has quit IRC | 22:54 | |
*** breitz_ has quit IRC | 22:54 | |
*** gouthamr has joined #openstack-nova | 22:59 | |
*** slaweq_ has joined #openstack-nova | 23:00 | |
*** ijw has joined #openstack-nova | 23:02 | |
*** esberglu has joined #openstack-nova | 23:02 | |
*** marst has quit IRC | 23:03 | |
*** baoli has joined #openstack-nova | 23:04 | |
*** tbachman has joined #openstack-nova | 23:06 | |
*** esberglu has quit IRC | 23:06 | |
*** mdrabe has quit IRC | 23:07 | |
*** xyang1 has quit IRC | 23:08 | |
*** jamesdenton has quit IRC | 23:09 | |
*** baoli has quit IRC | 23:14 | |
*** browne has joined #openstack-nova | 23:15 | |
*** lpetrut has quit IRC | 23:18 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Default firewall_driver to nova.virt.firewall.NoopFirewallDriver https://review.openstack.org/439187 | 23:20 |
*** rfolco has quit IRC | 23:22 | |
*** tjones has joined #openstack-nova | 23:22 | |
*** mriedem has quit IRC | 23:24 | |
*** haukebruno has quit IRC | 23:27 | |
*** crushil has joined #openstack-nova | 23:27 | |
*** ducttape_ has quit IRC | 23:27 | |
*** catintheroof has quit IRC | 23:29 | |
*** jaypipes has quit IRC | 23:30 | |
*** Apoorva_ has joined #openstack-nova | 23:32 | |
*** salv-orlando has quit IRC | 23:35 | |
*** Apoorva has quit IRC | 23:36 | |
*** haukebruno has joined #openstack-nova | 23:38 | |
*** jwcroppe has quit IRC | 23:39 | |
*** jwcroppe has joined #openstack-nova | 23:40 | |
*** tbachman has quit IRC | 23:42 | |
*** jaypipes has joined #openstack-nova | 23:44 | |
*** ducttape_ has joined #openstack-nova | 23:44 | |
*** jwcroppe has quit IRC | 23:44 | |
*** dimtruck is now known as zz_dimtruck | 23:45 | |
*** dave-mccowan has joined #openstack-nova | 23:51 | |
*** dave-mccowan has quit IRC | 23:51 | |
*** crushil has quit IRC | 23:51 | |
*** yingjun has joined #openstack-nova | 23:54 | |
*** zz_dimtruck is now known as dimtruck | 23:56 | |
*** Guest27057 is now known as zigo | 23:57 | |
*** xinli has quit IRC | 23:57 | |
*** kaisers has joined #openstack-nova | 23:58 | |
*** sdague has quit IRC | 23:58 | |
*** tblakes has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!