Thursday, 2017-03-02

*** dtp has quit IRC00:00
*** liangy has quit IRC00:01
*** kaisers has quit IRC00:02
*** nic has quit IRC00:04
*** ZZelle has quit IRC00:04
*** browne has quit IRC00:05
*** ducttape_ has quit IRC00:07
*** krtaylor has quit IRC00:08
*** browne has joined #openstack-nova00:09
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata  https://review.openstack.org/43992500:11
*** rfolco has joined #openstack-nova00:13
*** claudiub|2 has quit IRC00:14
*** rfolco has quit IRC00:20
*** mriedem has joined #openstack-nova00:27
*** jwcroppe has joined #openstack-nova00:28
*** ducttape_ has joined #openstack-nova00:29
*** thorst has joined #openstack-nova00:31
*** haukebruno has quit IRC00:33
*** dimtruck is now known as zz_dimtruck00:33
*** rfolco has joined #openstack-nova00:35
*** rfolco has quit IRC00:35
*** hongbin has quit IRC00:35
*** thorst has quit IRC00:36
*** tovin07 has joined #openstack-nova00:38
*** thorst has joined #openstack-nova00:41
*** gongysh has joined #openstack-nova00:45
*** gongysh has quit IRC00:49
*** iceyao has joined #openstack-nova00:50
*** ducttape_ has quit IRC00:52
*** owalsh-afk has quit IRC00:52
*** owalsh-afk has joined #openstack-nova00:52
*** zz_dimtruck is now known as dimtruck00:53
*** krtaylor has joined #openstack-nova00:53
*** ducttape_ has joined #openstack-nova00:53
*** iceyao has quit IRC00:54
*** haukebruno has joined #openstack-nova00:54
*** Jinxing has joined #openstack-nova00:55
*** Jinxing has quit IRC00:56
*** owalsh has joined #openstack-nova00:57
*** owalsh-afk has quit IRC00:57
*** thorst has quit IRC01:01
*** crushil has joined #openstack-nova01:03
*** phuongnh has joined #openstack-nova01:04
*** catintheroof has joined #openstack-nova01:04
*** armax has joined #openstack-nova01:06
*** Swami has quit IRC01:06
*** dimtruck is now known as zz_dimtruck01:13
*** ducttape_ has quit IRC01:14
*** jamielennox is now known as jamielennox|away01:16
*** nebulite has joined #openstack-nova01:18
*** tbachman has joined #openstack-nova01:21
*** zz_dimtruck is now known as dimtruck01:22
*** karimb has quit IRC01:30
*** nebulite has left #openstack-nova01:32
*** ducttape_ has joined #openstack-nova01:34
*** browne has quit IRC01:36
*** mtanino has quit IRC01:37
*** browne has joined #openstack-nova01:40
*** iceyao has joined #openstack-nova01:43
*** adrian_otto has quit IRC01:44
*** browne has quit IRC01:49
*** ducttape_ has quit IRC01:51
*** ducttape_ has joined #openstack-nova01:52
*** ijw has quit IRC01:58
*** ducttape_ has quit IRC02:01
*** catintheroof has quit IRC02:01
*** ducttape_ has joined #openstack-nova02:02
*** dimtruck is now known as zz_dimtruck02:06
*** tbachman has quit IRC02:07
*** jamesden_ has joined #openstack-nova02:08
*** smatzek_ has joined #openstack-nova02:09
*** yuntongjin has joined #openstack-nova02:09
*** smatzek_ has quit IRC02:09
*** smatzek_ has joined #openstack-nova02:10
*** tbachman has joined #openstack-nova02:11
*** Apoorva_ has quit IRC02:15
*** jamesden_ has quit IRC02:15
*** raunak has quit IRC02:16
*** jamesden_ has joined #openstack-nova02:19
*** unicell has quit IRC02:20
*** smatzek_ has quit IRC02:22
*** kaisers has joined #openstack-nova02:24
*** kaisers has quit IRC02:29
openstackgerritLi Yingjun proposed openstack/nova-specs master: Spec for support set vgamem for video  https://review.openstack.org/43878702:29
*** nebulite has joined #openstack-nova02:33
*** namnh has joined #openstack-nova02:34
*** esberglu has joined #openstack-nova02:43
*** harry_liu has joined #openstack-nova02:43
*** harry_liu has quit IRC02:45
*** ducttape_ has quit IRC02:46
*** ducttape_ has joined #openstack-nova02:47
*** esberglu has quit IRC02:48
openstackgerritYoshihiko Atsumi proposed openstack/nova master: Add resize server functional negative tests  https://review.openstack.org/42051402:48
*** carthaca_ has quit IRC02:50
*** sapcc-bot has quit IRC02:50
*** artom has quit IRC02:50
*** carthaca_ has joined #openstack-nova02:50
*** sapcc-bot has joined #openstack-nova02:50
*** ducnc has quit IRC02:50
*** artom has joined #openstack-nova02:50
*** ducttape_ has quit IRC02:52
*** gouthamr has quit IRC02:53
*** Sukhdev has joined #openstack-nova02:54
*** Sukhdev has quit IRC02:56
openstackgerritHuan Xie proposed openstack/nova master: WIP: Make xenapi driver compatible with assert_can_migrate  https://review.openstack.org/43996002:58
*** raunak has joined #openstack-nova03:01
*** jamesden_ has quit IRC03:03
*** gongysh has joined #openstack-nova03:04
*** dave-mccowan has joined #openstack-nova03:06
*** hongbin has joined #openstack-nova03:08
*** links has joined #openstack-nova03:08
*** gongysh has quit IRC03:16
openstackgerritMatt Riedemann proposed openstack/nova master: Add functional test for ip filtering with regex  https://review.openstack.org/43996903:22
*** mriedem is now known as mriedem_afk03:26
*** erlon has quit IRC03:35
*** unicell has joined #openstack-nova03:38
*** unicell has quit IRC03:38
openstackgerritHuan Xie proposed openstack/nova master: WIP: Make xenapi driver compatible with assert_can_migrate  https://review.openstack.org/43879203:39
*** yamahata has quit IRC03:45
*** nebulite has quit IRC03:50
*** tuanluong has joined #openstack-nova03:50
*** thorst has joined #openstack-nova03:50
*** thorst has quit IRC03:50
*** rcernin has quit IRC03:50
*** raunak has quit IRC03:54
*** nmathew has joined #openstack-nova03:58
*** yuntongjin has quit IRC04:03
*** nicolasbock has quit IRC04:06
*** udesale has joined #openstack-nova04:07
*** sudipto has joined #openstack-nova04:10
*** sudipto_ has joined #openstack-nova04:10
*** fragatina has quit IRC04:13
*** sneti_ has joined #openstack-nova04:13
*** dave-mccowan has quit IRC04:16
*** mdnadeem has joined #openstack-nova04:17
*** dnalezyt has quit IRC04:23
*** psachin has joined #openstack-nova04:27
*** fragatina has joined #openstack-nova04:28
*** sudipto_ has quit IRC04:30
*** sudipto has quit IRC04:30
*** ratailor has joined #openstack-nova04:31
*** thorst has joined #openstack-nova04:32
*** thorst has quit IRC04:32
*** esberglu has joined #openstack-nova04:32
*** Jeffrey4l has joined #openstack-nova04:32
*** iceyao has quit IRC04:32
*** fragatina has quit IRC04:32
*** esberglu has quit IRC04:36
*** adrian_otto has joined #openstack-nova04:37
*** adisky_ has joined #openstack-nova04:38
*** kevinz has joined #openstack-nova04:39
*** kaisers has joined #openstack-nova04:41
*** sneti_ has quit IRC04:43
*** sree has joined #openstack-nova04:43
*** diga has joined #openstack-nova04:45
*** kaisers has quit IRC04:45
*** kaisers has joined #openstack-nova04:46
*** kaisers has quit IRC04:47
*** kaisers has joined #openstack-nova04:47
*** kaisers has quit IRC04:52
*** adrian_otto has quit IRC04:54
*** crushil has quit IRC04:57
*** tbachman has quit IRC04:59
*** thorst has joined #openstack-nova05:03
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements  https://review.openstack.org/44007605:03
*** Yingxin has joined #openstack-nova05:03
openstackgerritOpenStack Proposal Bot proposed openstack/os-vif master: Updated from global requirements  https://review.openstack.org/39534705:04
openstackgerritOpenStack Proposal Bot proposed openstack/python-novaclient master: Updated from global requirements  https://review.openstack.org/44010105:06
ratailorHi all,05:11
ratailorhttp://lists.openstack.org/pipermail/openstack-dev/2016-May/095386.html05:11
ratailorcould anyone please suggest whether its better to handle this ^^ situation in periodic task or on nova-compute service restart /05:12
ratailor?05:12
*** iceyao has joined #openstack-nova05:13
*** thorst has quit IRC05:16
*** hongbin has quit IRC05:17
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements  https://review.openstack.org/44007605:18
*** iceyao has quit IRC05:18
*** iceyao has joined #openstack-nova05:18
openstackgerritOpenStack Proposal Bot proposed openstack/os-vif master: Updated from global requirements  https://review.openstack.org/39534705:20
*** fragatina has joined #openstack-nova05:22
*** ayogi has joined #openstack-nova05:23
*** fragatina has quit IRC05:26
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements  https://review.openstack.org/44007605:32
*** Kevin_Zheng has quit IRC05:33
openstackgerritOpenStack Proposal Bot proposed openstack/os-vif master: Updated from global requirements  https://review.openstack.org/39534705:34
*** prateek has joined #openstack-nova05:39
openstackgerritGhanshyam Mann proposed openstack/nova master: Add api-ref for filter/sort whitelist  https://review.openstack.org/42176005:41
*** unicell has joined #openstack-nova05:44
*** kaisers has joined #openstack-nova05:44
gmannalex_xu: mriedem_afk johnthetubaguy : api-ref for filter/sort - https://review.openstack.org/#/c/421760/05:44
alex_xugmann: appreciate that, will try to reach that asap05:45
gmannalex_xu: thanks. mriedem_afk reminded me i was almost forgot those05:46
alex_xugmann: yea, me too05:46
*** kaisers has quit IRC05:48
*** Sukhdev has joined #openstack-nova05:51
openstackgerritChangBo Guo(gcb) proposed openstack/nova master: Skip unit tests for SSL + py3  https://review.openstack.org/42650505:56
*** dikonoor has joined #openstack-nova05:59
*** Sukhdev has quit IRC06:05
*** trinaths has joined #openstack-nova06:06
*** sridharg has joined #openstack-nova06:07
*** claudiub|2 has joined #openstack-nova06:08
*** Dinesh_Bhor has quit IRC06:09
*** armax has quit IRC06:14
*** psachin_ has joined #openstack-nova06:18
*** psachin_ has quit IRC06:19
*** esberglu has joined #openstack-nova06:21
*** esberglu has quit IRC06:26
*** markus_z has joined #openstack-nova06:28
*** edmondsw has joined #openstack-nova06:32
openstackgerritChangBo Guo(gcb) proposed openstack/nova master: Skip unit tests for SSL + py3  https://review.openstack.org/42650506:33
*** kaisers has joined #openstack-nova06:35
*** edand has joined #openstack-nova06:38
*** ekuris has joined #openstack-nova06:42
*** mjura has joined #openstack-nova06:43
*** salv-orlando has joined #openstack-nova06:45
*** Dinesh_Bhor has joined #openstack-nova06:46
*** zhurong has joined #openstack-nova06:48
*** nkrinner_afk is now known as nkrinner06:48
*** unicell has quit IRC06:51
*** unicell has joined #openstack-nova06:51
*** salv-orl_ has joined #openstack-nova06:52
*** zhurong has quit IRC06:53
openstackgerritTomi Juvonen proposed openstack/nova-specs master: Planned host maintenance  https://review.openstack.org/31051006:53
*** salv-orlando has quit IRC06:55
openstackgerritZhenyu Zheng proposed openstack/nova master: Don't delete neutron port when attach failed  https://review.openstack.org/40356806:56
*** edmondsw has quit IRC06:56
*** sudipto has joined #openstack-nova06:56
*** sudipto_ has joined #openstack-nova06:56
*** sudipto_ has quit IRC07:00
*** sudipto has quit IRC07:00
*** CristinaPauna has quit IRC07:00
*** namnh has quit IRC07:06
*** yamahata has joined #openstack-nova07:07
*** CristinaPauna has joined #openstack-nova07:12
*** trinaths has quit IRC07:17
*** rcernin has joined #openstack-nova07:18
*** tesseract has joined #openstack-nova07:18
*** bhagyashris has quit IRC07:19
*** lpetrut has joined #openstack-nova07:20
*** iceyao has quit IRC07:21
*** namnh has joined #openstack-nova07:23
*** edmondsw has joined #openstack-nova07:24
*** lpetrut has quit IRC07:24
*** kevinz has quit IRC07:28
*** hwoarang has quit IRC07:28
*** kevinz has joined #openstack-nova07:28
*** hwoarang has joined #openstack-nova07:29
*** edmondsw has quit IRC07:29
*** edmondsw has joined #openstack-nova07:29
*** vladikr has quit IRC07:30
*** raunak has joined #openstack-nova07:32
*** edmondsw has quit IRC07:34
*** yamamoto has quit IRC07:38
*** gongysh has joined #openstack-nova07:41
*** iceyao has joined #openstack-nova07:45
*** jpena|away is now known as jpena07:52
bauzasgood morning Nova07:52
bauzasp!spy07:52
*** unicell has quit IRC07:53
*** pkoniszewski has joined #openstack-nova07:53
openstackgerritAlex Xu proposed openstack/nova-specs master: The ResourceProviderTraits API - Manage traits with ResourceProviders  https://review.openstack.org/34513808:00
*** andreas_s has joined #openstack-nova08:01
*** jpena is now known as jpena|away08:05
*** yuntongjin has joined #openstack-nova08:07
*** slunkad has quit IRC08:07
*** esberglu has joined #openstack-nova08:10
*** slunkad has joined #openstack-nova08:11
*** jpena|away is now known as jpena08:12
*** pcaruana has joined #openstack-nova08:13
*** avolkov has joined #openstack-nova08:14
*** Kevin_Zheng has joined #openstack-nova08:15
*** esberglu has quit IRC08:15
*** ltomasbo|away is now known as ltomasbo08:16
*** yamamoto has joined #openstack-nova08:17
*** yamamoto_ has joined #openstack-nova08:17
*** yamamoto_ has quit IRC08:20
*** yamamoto has quit IRC08:21
*** Fdaisuke has quit IRC08:24
*** gibi_ is now known as gibi08:25
*** zioproto has joined #openstack-nova08:26
zioprotohello there08:26
zioprotostill working on the nova migration from mitaka to newton. I found out that after the database migrations all my flavors and aggregates are duplicated in the db.08:26
*** raunak has quit IRC08:26
*** dulek has joined #openstack-nova08:27
*** lpetrut has joined #openstack-nova08:29
zioprotoI checked in the API db08:29
zioprotoand in the flavor table there are not duplicates08:30
zioprotobut openstack flavor list returns duplicate flavors08:30
*** lpetrut has quit IRC08:33
openstackgerritFeodor Tersin proposed openstack/nova-specs master: Add ScaleIO ephemeral storage backend  https://review.openstack.org/30471508:33
*** CristinaPauna has quit IRC08:39
*** nmathew has quit IRC08:41
*** nmathew- has joined #openstack-nova08:41
*** trinaths has joined #openstack-nova08:41
*** mlakat has joined #openstack-nova08:42
*** gaoyuan has quit IRC08:44
*** rmart04 has joined #openstack-nova08:44
*** gaoyuan has joined #openstack-nova08:45
*** ralonsoh has joined #openstack-nova08:46
*** gszasz has joined #openstack-nova08:47
*** ducnc has joined #openstack-nova08:48
*** rmart04 has quit IRC08:48
*** CristinaPauna has joined #openstack-nova08:50
*** mlakat has quit IRC08:55
*** jaosorior has joined #openstack-nova08:56
*** rmart04 has joined #openstack-nova08:57
*** zzzeek has quit IRC09:00
*** zzzeek has joined #openstack-nova09:00
zioprotoanyone ?09:01
*** fandi has joined #openstack-nova09:04
*** fandi has quit IRC09:09
*** eglynn has joined #openstack-nova09:11
*** amoralej|off is now known as amoralej09:13
*** thorst has joined #openstack-nova09:13
*** yamamoto has joined #openstack-nova09:17
*** thorst has quit IRC09:18
*** yamamoto has quit IRC09:22
*** Jeffrey4l has quit IRC09:25
*** Jeffrey4l has joined #openstack-nova09:25
*** udesale__ has joined #openstack-nova09:26
*** Guest79770 has quit IRC09:27
*** ZZelle has joined #openstack-nova09:27
*** ZZelle is now known as Guest2041809:28
*** udesale has quit IRC09:28
*** Guest20418 is now known as ZZelle_09:28
*** Oku_OS-away is now known as Oku_OS09:30
*** zioproto has quit IRC09:30
*** Jeffrey4l has quit IRC09:31
openstackgerritSivasathurappan Radhakrishnan proposed openstack/nova-specs master: Live Migration of Rescued Instances  https://review.openstack.org/34716109:32
*** nmathew- has quit IRC09:34
*** lucas-afk is now known as lucasagomes09:35
*** zioproto has joined #openstack-nova09:37
*** yuntongjin has quit IRC09:39
*** yingjun has quit IRC09:39
*** aarefiev_afk is now known as aarefiev09:39
*** bkopilov has joined #openstack-nova09:42
*** Jeffrey4l has joined #openstack-nova09:43
*** udesale__ has quit IRC09:47
*** kaisers_ has joined #openstack-nova09:47
*** udesale has joined #openstack-nova09:48
*** kaisers_ has quit IRC09:52
*** trinaths has quit IRC09:54
*** namnh has quit IRC09:55
*** esberglu has joined #openstack-nova09:59
*** esberglu has quit IRC10:03
*** ralonsoh_ has joined #openstack-nova10:05
*** ralonsoh has quit IRC10:05
*** ralonsoh_ is now known as ralonsoh10:06
*** gszasz has quit IRC10:06
*** diga has quit IRC10:08
*** gszasz has joined #openstack-nova10:08
openstackgerritJohn Garbutt proposed openstack/nova-specs master: Add spec to use Cinder's new attachment APIs  https://review.openstack.org/37320310:10
*** gszasz has quit IRC10:10
*** gszasz has joined #openstack-nova10:12
*** tovin07 has quit IRC10:12
*** nmathew has joined #openstack-nova10:16
*** yufei has joined #openstack-nova10:17
*** lpetrut has joined #openstack-nova10:18
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata  https://review.openstack.org/43992510:18
*** yamamoto has joined #openstack-nova10:19
*** bhagyashris has joined #openstack-nova10:21
*** yamamoto has quit IRC10:22
*** kevinz has quit IRC10:23
*** romainh has joined #openstack-nova10:25
*** udesale__ has joined #openstack-nova10:26
*** gongysh has quit IRC10:27
*** udesale has quit IRC10:28
zioprotodansmith: I am still working on those database migrations. Ping me when you come online10:29
*** udesale__ has quit IRC10:30
*** yufei has quit IRC10:30
*** links has quit IRC10:31
*** cdent has joined #openstack-nova10:33
*** sree has quit IRC10:35
*** iceyao has quit IRC10:39
*** ociuhandu has joined #openstack-nova10:41
*** ducnc has quit IRC10:47
*** links has joined #openstack-nova10:47
*** ociuhandu has quit IRC10:47
*** dikonoor has quit IRC10:49
*** claudiub|2 is now known as claudiub10:49
*** yamamoto has joined #openstack-nova10:53
*** yamamoto has quit IRC10:53
*** tovin07 has joined #openstack-nova10:54
openstackgerritHuan Xie proposed openstack/nova master: WIP: Make xenapi driver compatible with assert_can_migrate  https://review.openstack.org/43996010:56
*** mvk has quit IRC10:57
openstackgerritHuan Xie proposed openstack/nova master: Make xenapi driver compatible with assert_can_migrate  https://review.openstack.org/43996010:57
*** gcb has quit IRC10:57
*** gcb has joined #openstack-nova10:58
*** sambetts|afk is now known as sambetts10:59
*** derekh has joined #openstack-nova10:59
*** ociuhandu has joined #openstack-nova10:59
*** nicolasbock has joined #openstack-nova11:01
*** bhagyashris has quit IRC11:03
*** gcb has quit IRC11:04
*** yamamoto has joined #openstack-nova11:04
*** tbachman has joined #openstack-nova11:05
*** bhagyashris has joined #openstack-nova11:05
openstackgerritBalazs Gibizer proposed openstack/nova master: handle uninited fields in notification payload  https://review.openstack.org/41585711:06
openstackgerritBalazs Gibizer proposed openstack/nova master: re-orphan flavor after rpc deserialization  https://review.openstack.org/44034711:06
*** dikonoor has joined #openstack-nova11:07
*** nmathew has quit IRC11:08
*** dikonoo has joined #openstack-nova11:08
*** dikonoor has quit IRC11:11
*** dikonoor has joined #openstack-nova11:12
*** phuongnh has quit IRC11:13
*** thorst has joined #openstack-nova11:14
*** dikonoo has quit IRC11:15
*** ociuhandu has quit IRC11:18
*** ociuhandu has joined #openstack-nova11:19
*** thorst has quit IRC11:19
*** edmondsw has joined #openstack-nova11:20
*** hshiina has joined #openstack-nova11:24
*** edmondsw has quit IRC11:25
*** tbachman has quit IRC11:26
bhagyashrisjohnthetubaguy: Hi,11:28
*** mvk has joined #openstack-nova11:28
bhagyashrisjohnthetubaguy: I want to discuss regarding patch https://review.openstack.org/#/c/409644/11:31
*** yufei has joined #openstack-nova11:31
johnthetubaguybhagyashris: yes11:32
*** tbachman has joined #openstack-nova11:32
bhagyashrisjohnthetubaguy: currently i am working on it, so my dought is what response code should i written if rotation==011:32
bhagyashriss/written/return11:33
*** romainh has quit IRC11:34
bhagyashriss/dought/doubt11:36
*** ociuhandu has quit IRC11:37
*** avolkov has quit IRC11:38
*** ociuhandu has joined #openstack-nova11:39
*** avolkov has joined #openstack-nova11:39
*** tbachman has quit IRC11:39
*** ratailor has quit IRC11:41
*** dikonoor has quit IRC11:42
*** eglynn has quit IRC11:43
*** ociuhandu has quit IRC11:43
*** sdague has joined #openstack-nova11:46
*** yufei has quit IRC11:47
*** vanch has joined #openstack-nova11:48
*** kaisers_ has joined #openstack-nova11:48
vanchHi. Is it possible to create server with several volumes attached? block-device-mapping won't help.11:49
vanchSeems like i'm affected by this bug https://bugs.launchpad.net/nova/+bug/1560965 and can't attach volumes to instances.11:49
openstackLaunchpad bug 1560965 in OpenStack Dashboard (Horizon) "libvirt selects wrong root device name" [Undecided,In progress] - Assigned to Matthew Taylor (matthew-taylor-f)11:49
*** dikonoor has joined #openstack-nova11:51
zioprotojohnthetubaguy: after running the database migrations from from mitaka to newton if I make `openstack flavor list` I get the list with all flavors two times. So far I found flavor information only in the api DB in the flavors table. But also in the main nova db in the instance_types table. I have the feeling only 1 should exist.11:51
*** links has quit IRC11:51
*** yassine has quit IRC11:52
*** lucasagomes is now known as lucas-brb11:52
johnthetubaguyzioproto: sounds wrong, the online db migration generally deletes the old ones during the move, dansmith might remember more about that flavor migration stuff11:53
johnthetubaguyzioproto: for sure the api db is where it should be now11:53
zioprotojohnthetubaguy: so I confirm that doing in the main nova db ` update instance_types set deleted=1;` it fixes the problem11:54
zioprotolooks like when the flavor where migrated to the new db, they were not deleted on the main nova db11:54
*** romainh has joined #openstack-nova11:54
zioprotonow I am looking into the host aggregates, I have quite the same problem11:54
johnthetubaguyzioproto: sounds like you have a permissions error for the connection strings being used for the online db migrations, did you get any errors?11:55
zioprotojohnthetubaguy: also `openstack aggregate list` returns everything double11:55
*** kaisers_ has quit IRC11:55
johnthetubaguyyeah, it deletes stuff in the same way11:55
zioprotook dansmith has a dump of my DB. I guess I have to wait it is morning in UTC-911:56
zioprotoI had tons of errors, because of another bug we fixed11:56
johnthetubaguyzioproto: if it helps I think these are the things we will be running with the newton online db migration: https://github.com/openstack/nova/blob/stable/newton/nova/cmd/manage.py#L78611:57
johnthetubaguyzioproto: you can see it trying to delete the old flavors: https://github.com/openstack/nova/blob/stable/newton/nova/objects/flavor.py#L70311:58
johnthetubaguyzioproto: in theory you should have seem some errors logged from this code: https://github.com/openstack/nova/blob/stable/newton/nova/objects/flavor.py#L72211:58
johnthetubaguyzioproto: did you see any of those?11:58
*** yassine has joined #openstack-nova11:58
*** yamamoto has quit IRC11:58
*** Kevin_Zheng_Home has joined #openstack-nova12:00
*** jpena is now known as jpena|lunch12:02
*** links has joined #openstack-nova12:04
*** ralonsoh_ has joined #openstack-nova12:06
openstackgerritGao Yuan proposed openstack/nova master: Stop using mox stubs in nova.tests.unit.api.openstack.compute.test_serversV21  https://review.openstack.org/43887312:06
openstackgerritGao Yuan proposed openstack/nova master: Remove mox from nova.tests.unit.api.openstack.compute.test_block_device_mapping  https://review.openstack.org/44047512:06
*** Kevin_Zheng_Home has quit IRC12:08
*** yamahata has quit IRC12:08
*** ralonsoh has quit IRC12:09
*** bkopilov has quit IRC12:10
*** aysyd has joined #openstack-nova12:12
*** romainh has quit IRC12:14
*** romainh1 has joined #openstack-nova12:14
*** annegentle has quit IRC12:16
*** JoseMello has joined #openstack-nova12:17
*** smatzek_ has joined #openstack-nova12:20
*** smatzek_ has quit IRC12:21
*** smatzek_ has joined #openstack-nova12:21
openstackgerritRico Lin proposed openstack/python-novaclient master: [Fix gate]Update test requirement  https://review.openstack.org/44050112:28
*** kevinz has joined #openstack-nova12:31
*** tovin07 has quit IRC12:34
zioprotojohnthetubaguy: no, not any of those12:36
zioprotojohnthetubaguy: http://paste.openstack.org/show/601128/12:36
zioprotois it correct to run `nova-manage db online_data_migrations` in mitaka before starting and then again in newton when the migration is completed ?12:36
*** bvanhav has joined #openstack-nova12:36
johnthetubaguyzioproto: only if you run the mitaka version of the code when you have mitaka running, and the newton ones only when you are fully schema and code updated to newton12:37
johnthetubaguyzioproto: thats looks like the error you get after it failed differently the first time12:38
*** kevinz has quit IRC12:38
* johnthetubaguy goes back to lunch, back in a bit12:38
*** kevinz has joined #openstack-nova12:39
*** tuanluong has quit IRC12:40
*** gaoyuan has quit IRC12:42
*** gszasz has quit IRC12:43
*** thorst has joined #openstack-nova12:45
*** gszasz has joined #openstack-nova12:48
*** gszasz has quit IRC12:48
zioprotojohnthetubaguy: I will update another staging cluster we have and I will give feedbacl12:50
*** gszasz has joined #openstack-nova12:51
*** salv-orlando has joined #openstack-nova12:52
*** owalsh is now known as owalsh-afk12:53
*** ayogi has quit IRC12:54
*** salv-orl_ has quit IRC12:55
*** catintheroof has joined #openstack-nova12:56
*** rfolco has joined #openstack-nova12:57
*** yamamoto has joined #openstack-nova12:59
*** mriedem_afk is now known as mriedem13:02
*** jpena|lunch is now known as jpena13:02
openstackgerritMatthew Booth proposed openstack/nova master: Improve the readability of check_instance_state  https://review.openstack.org/44053613:04
*** jwcroppe has quit IRC13:08
*** yamamoto has quit IRC13:09
*** tbachman has joined #openstack-nova13:11
johnthetubaguyzioproto: it would be great to get those logs for the first run. I am sure dansmith would be able to give you more advice on what is worth collecting once he is online13:14
*** des_consolado has joined #openstack-nova13:14
mriedemdansmith: +2 on melwitt's counting quotas spec which was amended for pike to note the allocations user/project tracking for quota when a cell is down https://review.openstack.org/#/c/431749/13:16
mriedemdansmith: also noted in there, in ocata we just required that placement existed for comptues to starrt but we didn't require a minimum microversion,13:17
mriedemi think in pike we have to require that placement 1.4 (ocata) is available otherwise the scheduler won't work since we don't fallback13:17
mriedemso something to remember to put into nova-status13:17
*** kevinz has quit IRC13:19
*** kevinz has joined #openstack-nova13:20
*** READ10 has joined #openstack-nova13:21
*** jwcroppe has joined #openstack-nova13:23
*** esberglu has joined #openstack-nova13:24
mriedemedleafe: cdent: fyi https://bugs.launchpad.net/nova/+bug/166943313:24
openstackLaunchpad bug 1669433 in OpenStack Compute (nova) "nova-status needs to check that placement 1.4 is available for pike" [High,Confirmed]13:24
cdentmriedem: noted, thanks13:24
* cdent is barely surfaced13:25
johnthetubaguymriedem: I keep meaning to hit that spec13:26
mriedemjohnthetubaguy: it's just a re-proposal with the added stuff about storing user/project in the allocations table, what we talked about at the PTG13:27
johnthetubaguymriedem: ah, cool13:27
andymccrowalsh-afk: following on from yesterday i think if you check the output of api_db version and it's 0 --> then do api_db sync first - this should work, testing it now though. Should avoid the need for an upgrade flag!13:28
*** markus_z has quit IRC13:30
*** cdent has quit IRC13:31
*** prateek has quit IRC13:36
lyarwoodjohnthetubaguy: thanks for the review on the detach patch, I'll try to get another version posted before the meeting at 5 with the cinder team13:36
mriedemmelwitt: did you see rajesh's email about the ceph monitor ip change bug again? that reminded me of talking about it at the ptg. i was wondering if you were planning on making changes there.13:37
*** tbachman has quit IRC13:39
*** tbachman has joined #openstack-nova13:40
*** diana_clarke has joined #openstack-nova13:41
*** diana_clarke has left #openstack-nova13:41
*** lucas-brb is now known as lucasagomes13:44
*** ralonsoh_ has quit IRC13:44
*** Jeffrey4l has quit IRC13:49
*** kevinz has quit IRC13:50
sdaguemriedem: when you get a mental breathing space, I actually need to talk through the options here - https://review.openstack.org/#/c/438049/6/nova/api/openstack/identity.py - because I'm torn in a few directions13:50
*** kevinz has joined #openstack-nova13:51
*** kaisers_ has joined #openstack-nova13:51
*** bvanhav_ has joined #openstack-nova13:52
*** mdnadeem has quit IRC13:52
*** eharney has joined #openstack-nova13:52
*** ducttape_ has joined #openstack-nova13:52
*** mvk has quit IRC13:52
*** bvanhav has quit IRC13:53
*** liangy has joined #openstack-nova13:53
*** liuyulong has joined #openstack-nova13:54
*** rmart04 has quit IRC13:54
*** kaisers_ has quit IRC13:56
*** eharney has quit IRC13:57
*** markus_z has joined #openstack-nova14:00
*** tblakes has joined #openstack-nova14:00
*** salv-orlando has quit IRC14:01
*** cdent has joined #openstack-nova14:03
*** vladikr has joined #openstack-nova14:05
*** ralonsoh has joined #openstack-nova14:06
*** breton has quit IRC14:07
*** xyang1 has joined #openstack-nova14:07
mdboothlyarwood johnthetubaguy: Just had a random thought. I think Nova is still going to have to track connect/disconnect for detach. Say you've got a shared connection containing N connected volumes. The user disconnects all N almost simultaneously. When the last one is disconnected, cinder can tell Nova in that disconnect call that there are none left. However, depending on the order Nova processes them, it might not be the last one. IOW14:07
mdbooth it's a race. I think only Nova can reliably know when it's no longer in use on the host.14:07
*** ducttape_ has quit IRC14:08
*** jaypipes has quit IRC14:08
mdboothAnd by Nova I mean os-brick obviously.14:08
mdboothBut still Nova.14:08
johnthetubaguymdbooth: I thought the locking method, and re-fetching the list with the lock held, and held for the duration of the disconnect, would work around that14:09
johnthetubaguymdbooth: there could be a big hole in that though14:09
*** eharney has joined #openstack-nova14:09
openstackgerritGábor Antal proposed openstack/nova-specs master: Show persisted scheduler hints in server details  https://review.openstack.org/44058014:11
*** mdrabe has joined #openstack-nova14:12
*** links has quit IRC14:12
mriedemsdague: i've got to start getting maya ready to leave in about 5 minutes, which usually takes about 10 minutes because of the constant redirecting, do you want to talk about it later? i see you're in -dev talking quotas. alternatively, dump your brain in the ML and i'll read it when i'm in the office later and have time to weigh the options.14:15
*** rmart04 has joined #openstack-nova14:15
edleafemriedem: ack on the nova-status bug14:15
openstackgerritGábor Antal proposed openstack/nova-specs master: Show persisted scheduler hints in server details  https://review.openstack.org/44058014:15
mriedemsdague: plus if it's in the list then others can weigh in14:15
*** crushil has joined #openstack-nova14:17
mriedemsileht: i feel like manila had the exact same type of issue you're talking about in the ML with the broken telemetry job14:17
mriedemand it had something to do with the order of their devstack plugin setup,14:17
mriedemsuch that it was trying to list instances before the instances were in a cell14:17
mriedemsomething like that14:17
silehtWe don't do anything special14:18
mriedemsileht: so need to know when simple_cell_setup is called relative to when the openstack server list returns nothing14:18
openstackgerritBalazs Gibizer proposed openstack/nova master: fix missing instance.delete notification  https://review.openstack.org/43722214:19
*** gouthamr has joined #openstack-nova14:19
mdboothjohnthetubaguy: Nova re-fetching the list with the lock held would work, but only if cinder also didn't update the list until Nova had confirmed the detach.14:19
silehtmriedem, we call "openstack server list" after ./stack.sh says everything is ready14:19
openstackgerritBalazs Gibizer proposed openstack/nova master: Transform missing delete notifications  https://review.openstack.org/41029714:19
silehtmriedem, and then we polls nova every second during 10 minutes14:19
mdboothjohnthetubaguy: It's starting to sound to me like a nova-side implementation is going to be simpler.14:20
mdboothAfter all, it really is an implementation detail of the driver.14:21
*** owalsh-afk is now known as owalsh14:21
johnthetubaguymdbooth: right, its assuming the attachments that are shared on the nova host are only modified by Nova (which we can enforce now, using service tokens)14:21
mriedemsileht: ok simple_cell_setup is run well before that http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/devstacklog.txt.gz#_2017-03-02_09_08_19_73814:22
johnthetubaguymdbooth: generally thats always the case anyways, but it can be enforced too14:22
silehtmriedem, yes14:22
mriedemsileht: is it listing servers with a filter?14:23
mriedemor just listing servers and checking for one result?14:23
silehtmriedem, just GET /servers/detail HTTP/1.114:23
mriedemwhen did this start failing?14:23
*** baoli has joined #openstack-nova14:24
silehtI would says some days ago14:24
*** cleong has joined #openstack-nova14:24
*** Kevin_Zheng_ has joined #openstack-nova14:25
silehtWe didn't notice the exact time because we fall into an oslo.messaging from time to time and people recheck a lot this job14:25
mriedemmarkus_z: looks like we have a novnc test failure in tempest http://logs.openstack.org/63/435563/3/check/gate-tempest-dsvm-neutron-multinode-full-ubuntu-xenial-nv/20e15f9/console.html#_2017-03-01_20_30_52_36968314:25
mriedemintermittent i mean14:25
silehtsince yesterday or the day before, we seen that the error is no more the oslo.messaging bug14:25
silehtand it's always failing14:25
openstackgerritGábor Antal proposed openstack/nova-specs master: Show persisted scheduler hints in server details  https://review.openstack.org/44058014:25
mriedemsileht: we should be able to identify when the failure started using logstash14:26
silehtmriedem, i'm suspecting a policies bug, because when ceilometer polls nova with ceilometer service account and 'all_tenants=True', it see the instances14:26
silehtinstances owner are admin/admin14:26
mriedemsileht: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22AssertionError%3A%20json%20path%20%24.servers%5B0%5D.status%20cannot%20match%20%7Bu'servers'%3A%20%5B%5D%7D%5C%22&from=7d14:26
silehtand we do the 'openstack server list' as admin/admin14:26
markus_zmriedem: I haven't seen that test before, I can take a look.14:27
*** liverpooler has joined #openstack-nova14:27
mriedemmarkus_z: pretty high failure rate14:28
mriedemhttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22in%20_validate_rfb_negotiation%5C%22&from=7d14:28
mriedemsdague: ^14:28
mriedemi don't think we're tracking that - mtreinish ^14:28
mriedemsileht: looks like it started on 2/2814:28
mriedemso should dig through related looking changes https://github.com/openstack/nova/commits/master14:29
mriedemi have to run for a bit14:29
*** Jeffrey4l has joined #openstack-nova14:29
mtreinishmriedem: I don't think we're tracking it yet14:29
*** mriedem has quit IRC14:30
*** edmondsw has joined #openstack-nova14:32
*** breton has joined #openstack-nova14:32
markus_zthe first hits start on 02/21, the tempest test merged 02/0314:34
openstackgerritBalazs Gibizer proposed openstack/nova master: fix missing instance.delete notification  https://review.openstack.org/43722214:34
openstackgerritBalazs Gibizer proposed openstack/nova master: Transform missing delete notifications  https://review.openstack.org/41029714:34
*** Jeffrey4l has quit IRC14:35
*** mlavalle has joined #openstack-nova14:35
*** JoseMello has quit IRC14:35
markus_zThat's the first one: http://logs.openstack.org/38/431038/3/check/gate-tempest-dsvm-neutron-multinode-full-ubuntu-xenial-nv/5e1d485/console.html14:36
*** yingjun has joined #openstack-nova14:37
*** jaypipes has joined #openstack-nova14:38
openstackgerritBalazs Gibizer proposed openstack/nova master: Improve assertJsonEqual error reporting  https://review.openstack.org/42819914:39
*** tblakes has quit IRC14:39
*** felipemonteiro has joined #openstack-nova14:40
*** felipemonteiro_ has joined #openstack-nova14:40
*** esberglu has quit IRC14:43
*** kevinz has quit IRC14:47
*** kevinz has joined #openstack-nova14:47
*** coreywright has quit IRC14:48
*** jaypipes has quit IRC14:48
*** coreywright has joined #openstack-nova14:48
bhagyashrisjohnthetubaguy: Hi,  i am waiting for your opinion regarding: which response code should i return if rotation==0?14:48
johnthetubaguybhagyashris: on that patch, I basically said there should be no API change, I believe?14:49
johnthetubaguybhagyashris: I suspect that wasn't very clear though, sorry.14:49
johnthetubaguybhagyashris: I would just upload what you have so far, or did you already do that?14:50
*** gabor_antal_km has joined #openstack-nova14:50
bhagyashrisjohnthetubaguy: ok.14:50
johnthetubaguybhagyashris: sorry, I seem to have missed that you reply to me earlier, for some reason14:50
*** ujjain has quit IRC14:50
*** gabor_antal_ has quit IRC14:51
johnthetubaguybhagyashris: basically I think we should allow 0, and make that just delete snapshots, rather than create one it deletes right away after having just created it14:51
*** hongbin has joined #openstack-nova14:51
bhagyashrisjohnthetubaguy: ok.14:52
johnthetubaguybhagyashris: that seems to solve the bug, and keep the API behaviour we had before, but I could be missing something14:53
*** jaypipes has joined #openstack-nova14:54
*** mvk has joined #openstack-nova14:56
*** tblakes has joined #openstack-nova14:57
*** ducttape_ has joined #openstack-nova14:57
bhagyashrisjohnthetubaguy: in that case image_meta will be empty14:57
johnthetubaguybhagyashris: sorry, I am not sure what you mean?14:58
*** baoli has quit IRC14:59
*** mriedem has joined #openstack-nova14:59
*** mriedem has quit IRC14:59
bhagyashrisjohnthetubaguy: I mean the https://github.com/openstack/nova/blob/master/nova/compute/api.py#L2697 will be empty if rotation==015:00
*** mriedem has joined #openstack-nova15:00
johnthetubaguybhagyashris: ah, very good point15:01
mriedemsileht: i'm back, any news?15:01
*** romainh1 has quit IRC15:01
*** romainh has joined #openstack-nova15:01
johnthetubaguybhagyashris: which would totally be a change in the API15:01
*** esberglu has joined #openstack-nova15:01
*** zz_dimtruck is now known as dimtruck15:03
*** rmart04 has quit IRC15:03
johnthetubaguybhagyashris: it feels like this needs more discussion / a spec15:03
*** mtanino has joined #openstack-nova15:04
mriedemoy15:05
mriedemhow do you keep calm when working with a customer for 2 weeks to apply some patches and they complain the patches don't work and you see they were patching with the --dry-run option the entire time15:06
*** dikonoor has quit IRC15:06
mriedemi.e. not actually applying any patches15:06
mriedem:(15:06
silehtmriedem, I'm seen the call returning something here: http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_16_25_64715:07
silehtmriedem, and later nothing: http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_16_43_15015:07
*** edand has quit IRC15:08
*** trinaths has joined #openstack-nova15:08
bauzasmriedem: fun story15:08
bhagyashrisjohnthetubaguy: i will think on it.15:09
mriedembauzas: not only is the customer not applying them correctly, but there are at least 4 L3 people on the email thread who couldn't figure this out15:09
*** kevinz has quit IRC15:09
bauzas:)15:09
* mriedem needs to stop venting in public15:09
mriedemsileht: hmm, and nothing was deleted right?15:10
*** baoli has joined #openstack-nova15:10
silehtmriedem, yes one of the two instances have been deleted15:10
mriedemmarkus_z: mtreinish: did a bug get created for that novnc issue?15:10
johnthetubaguybhagyashris: on a call, but just digging on the API15:10
silehtmriedem, and I see only one instance delete on n-cpu15:10
kashyapmriedem: Oh dear, not fun at all.15:10
markus_zmriedem: I didn't. Here's the only novnc related patch I found https://github.com/openstack/nova/commit/8bbc1ee but it merged a few hours after the first issue :/15:10
johnthetubaguybhagyashris: I am not sure the REST API actually changes, so an empty dict might be a fine return value from that function15:10
kashyapmriedem: But hey, on the plus side, it is (hopefully) not some gory bug with packet loss :-)15:10
mriedemkashyap: yeah if they said they did apply the fixes and the issue was still there, then that would be much worse15:11
markus_zmriedem: I'm going to check other places too.15:11
* kashyap is trying to reproduce something like that involving a RARP requests; splitting hairs apart15:11
kashyapmriedem: Yeah.  Glad you noticed it15:11
mriedemmarkus_z: if we can just get a bug reported then we can track it in e-r15:12
mriedemthat's what i'm looking for now15:12
bhagyashrisjohnthetubaguy: ok. Thank you for information15:12
markus_zmriedem: yep, I'm writing it right now15:12
*** trinaths has quit IRC15:12
johnthetubaguybhagyashris: it looks like we already don't return the header if rotation == 0: https://github.com/openstack/nova/blob/e75d5f9d531dddd6ce0ada47d64bfcdce14f93cf/nova/api/openstack/compute/create_backup.py#L8315:13
johnthetubaguybhagyashris: I quite strongly think we should keep allowing 0, but just stop creating the snapshot for that case, and only do the deletes15:15
markus_zmriedem: https://bugs.launchpad.net/nova/+bug/166946815:15
openstackLaunchpad bug 1669468 in OpenStack Compute (nova) "tempest.api.compute.servers.test_novnc.NoVNCConsoleTestJSON.test_novnc fails intermittently" [Undecided,New]15:15
*** crushil has quit IRC15:15
*** crushil has joined #openstack-nova15:15
mriedemsileht: looks like at this point we have 1 cell and it's cell0 http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_07_05_52815:16
bhagyashrisjohnthetubaguy: ok.15:16
mriedemsileht: at this point we have 2 cells http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_13_54_64215:16
mriedemcell0 and the main cell15:16
bhagyashrisjohnthetubaguy:  Thank you for information15:16
johnthetubaguybhagyashris: no problem15:16
mriedemsileht: looks like both of those are before you're listing instances15:16
mriedemmarkus_z: thanks15:17
mriedemmarkus_z: note that logstash only goes back 10 days15:18
*** sridharg has quit IRC15:18
mriedemso it might have been an issue before 2/2115:18
markus_zmriedem: ohh, ok, I didn't know that this is a hard limit. I'll check earlier changes too.15:18
*** baoli has quit IRC15:18
markus_zmriedem: I'm writing the e-r entry, takes a minute, haven't done it in a while.15:19
mriedemmarkus_z: actually we probably don't want an e-r query for this,15:19
mriedemit's mostly in the neutron multinode nv job15:19
mriedemwe don't have e-r queries for nv jobs15:19
mriedemso it's probably something that just fails in multinode15:20
markus_zmriedem: OK, got it.15:20
*** sree has joined #openstack-nova15:21
mriedemsileht: so something is weird, looking at http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_16_43_150 where we don't get anything back15:23
mriedemi see "Skipping already-collected cell0" just before that15:23
mriedemwhich is this https://github.com/openstack/nova/blob/68e808623e42442482e92f0d61a6667876f29e19/nova/compute/api.py#L253815:23
mriedembut i don't see this message after it15:23
mriedemhttps://github.com/openstack/nova/blob/68e808623e42442482e92f0d61a6667876f29e19/nova/compute/api.py#L254015:23
mriedemwhich is where it should be listing instances from the main cell15:23
mriedemsileht: do you have a bug tracking the issue? i wanted to push some debug patches15:24
silehtmriedem, I open it15:24
mriedemso at this point we should have 2 cells15:25
mriedemhttp://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_13_54_64215:25
mriedemcell0 and cell115:25
*** dave-mccowan has joined #openstack-nova15:25
mriedembut 3 minutes later, we don't process cell1 http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_16_43_15015:26
mriedemwhich is where the instance would be15:26
*** sree has quit IRC15:26
mriedemdansmith: melwitt: just thought of something, but on the CELLS cache in the api https://github.com/openstack/nova/blob/68e808623e42442482e92f0d61a6667876f29e19/nova/compute/api.py#L252415:27
mriedemonce we set that, we don't refresh it w/o restarting nova-api,15:27
mriedemso you could map_cell0, start nova-api, and then create (or add) another cell15:27
*** cdent has quit IRC15:27
mriedemi think that's a known issue15:27
dansmithyeah true15:27
dansmithI was literally just thinking about updating those things15:28
dansmithhowever, like the service catalog.. that's once per setup15:28
mriedemseems we should re-fetch if len(CELLS) == 1 and CELLS[0].uuid == cell0.uuid15:28
mriedemthis is really odd actually15:29
mriedemat this point we have cell0 http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_07_05_52815:29
mriedemat this point we have 2 cells http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_13_54_64215:29
mriedemthat could only happen if nova-api was restarted in between15:30
*** nkrinner is now known as nkrinner_afk15:30
mriedemi don't see that happening though15:31
silehtmriedem, https://bugs.launchpad.net/nova/+bug/166947315:31
openstackLaunchpad bug 1669473 in OpenStack Compute (nova) "openstack server list returns an empty list" [Undecided,New]15:31
*** lucasxu has joined #openstack-nova15:32
*** hshiina has quit IRC15:33
*** bswartz has quit IRC15:34
*** sneti_ has joined #openstack-nova15:37
*** tovin07 has joined #openstack-nova15:37
*** baoli has joined #openstack-nova15:39
*** marst has joined #openstack-nova15:40
*** tovin07 has left #openstack-nova15:40
mdboothBobBall: Are you the citrix xenserver guy?15:41
mriedemsileht: ok dumped some debug details in the bug, i'm going to work on adding some debug to nova15:41
mriedemmdbooth: he is15:41
silehtmriedem, cool thx15:41
mdboothThanks.15:41
mdboothBobBall: CI looks sad. Are you aware?15:41
*** bkopilov has joined #openstack-nova15:41
mdboothmriedem: After reviewing your patch this morning, btw, I decided to 2 a cleanup of check_instance_state and found 2 bugs: https://review.openstack.org/#/c/440536/15:43
*** avolkov has quit IRC15:43
openstackgerritMatt Riedemann proposed openstack/nova master: Log with cell.uuid if cell.name is not set  https://review.openstack.org/44064415:43
mriedemmdbooth: which patch?15:43
mriedemdansmith: ^ easy debug fix patch15:43
mdboothNothing earth shattering, but still bugs caused by readability15:43
*** baoli has quit IRC15:44
*** tbachman has quit IRC15:44
*** avolkov has joined #openstack-nova15:44
mdboothmriedem: https://review.openstack.org/#/c/429476/15:44
*** Matias has quit IRC15:44
mriedemah15:47
mriedemyeah check_instance_state is confusing15:47
mriedemi always have to look at that 5 times to figure it out15:47
silehtmriedem, , hum you are setting the global CELLS without lock that quiet dangerous15:47
silehtquiet/quite15:47
silehtmriedem, especially if get_all() does IO15:48
mdboothmriedem: I looked at it and assumed you were wrong, btw. Then looked 4 more times and worked out you were right :)15:48
mriedemmdbooth: yeah that's par for the course with that one15:48
mriedemsileht: yeah i thought the same - i don't think that's the issue here though since i'm seeing the "found 1 cells" and "found 2 cells" at different points15:51
mriedemthat aren't close together15:51
mriedemand i don't see anything that will remove anything from that cache or overwrite it again15:52
*** kaisers_ has joined #openstack-nova15:52
silehtmriedem, do you have multiple api workers ?15:52
mriedemif it went from 'found 2 cells' to 'found 1 cells' that would be a definite issue15:52
mriedemyeah15:52
mriedem2 workers15:52
dansmithit's not super efficient, but it's fine15:52
mriedemoh hmm15:52
silehtmriedem, perhaps one worker have 1 cells, the other 215:52
mriedemyeah...15:52
mriedemi bet that's it15:52
dansmithonly if we're starting api while we're setting up cells15:53
dansmithwhich shouldn't be legit15:53
mriedemyeah that's the other thing, cell0 and cell1 should exist before all of this15:53
mriedemwe start nova-api here http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/devstacklog.txt.gz#_2017-03-02_08_59_34_42815:54
mriedem2017-03-02 08:59:34.428 | + functions-common:run_process:1491        :   _run_process n-api /usr/local/bin/nova-api ''15:54
mriedemwe map cell0 here: http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/devstacklog.txt.gz#_2017-03-02_08_54_16_28815:54
mriedem2017-03-02 08:54:16.288 | + lib/nova:init_nova:711                   :   nova-manage cell_v2 map_cell0 --database_connection 'mysql+pymysql://root:secretmysql@127.0.0.1/nova_cell0?charset=utf8'15:54
mriedemhold the phone15:54
mriedemhttp://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/devstacklog.txt.gz#_2017-03-02_09_08_19_73815:54
mriedem2017-03-02 09:08:19.738 | + lib/nova:create_cell:974                 :   nova-manage cell_v2 simple_cell_setup --transport-url rabbit://stackrabbit:secretrabbit@104.130.199.12:5672/15:54
mriedemn-api is running before cell1 is created15:55
mriedemso any request before that is going to only see cell0 and cache it15:55
mriedemany request after that doesn't have the cache on that worker is going to get the 2 cells15:55
dansmithis that just with their plugin thing or upstream? I don't see how that's possible with base devstack15:55
BobBallmdbooth: Thanks - looking.15:55
silehtanyways, assuming nobody must call nova-api to not fall into that issue, looks like a serious bug15:56
*** kaisers_ has quit IRC15:56
BobBallmdbooth: ci-watch.tintri.com shows a small blip earlier today with 7 failures, but it's OK now.  Got some specific sadness that you're worried about?15:56
mdboothBobBall: This one looked pretty sad: https://review.openstack.org/#/c/440536/15:57
mriedemdansmith: i assume with their plugin15:57
mdboothIf it was just a blip I'll just resubmit. Didn't want to add to a pile if it was an ongoing problem, though.15:57
*** cdent has joined #openstack-nova15:57
silehtmriedem, it seems ceilometer poll nova just before nova-manage cell_v2 simple_cell_setup15:58
BobBallmdbooth: That is quite an unhappy test :(  Checking for other issues15:58
silehtmriedem, here: http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_07_05_55915:58
BobBallI mean other chnages with the same issue15:58
*** rcernin has quit IRC15:59
mriedemsileht: yeah15:59
mriedemok working on something here we can test with16:00
BobBallmdbooth: The blip earlier today was ansible related - but that's now resolved.  I don't see any other recent failures with your problem16:00
mdboothBobBall: Ok, then. Once more into the breach :)16:00
mdboothBobBall: Thanks for looking.16:01
*** baoli has joined #openstack-nova16:01
*** armax has joined #openstack-nova16:02
silehtmdbooth, in devstack, why create_cell is ran after 'run_phase stack extra' ?16:03
silehtmdbooth, sorry16:03
silehtmriedem, ^16:03
*** owalsh is now known as owalsh-afk16:03
*** mlavalle has quit IRC16:03
*** yingjun has quit IRC16:04
mriedemsileht: i think that's just legacy from that being where the cells v1 setup happened16:04
mriedemwhich probably no other devstack plugin based job was using cells v116:04
*** baoli has quit IRC16:05
silehtmriedem, I sent a devstack patch as workaround16:06
silehtmriedem, but using a global that way looks very dangerous from my point of view16:07
*** markvoelker has quit IRC16:07
*** Oku_OS is now known as Oku_OS-away16:07
silehtmriedem, https://review.openstack.org/44065116:08
*** ducttape_ has quit IRC16:08
silehtmriedem, I don't close the bug, since the root cause is more serious16:08
*** ducttape_ has joined #openstack-nova16:09
openstackgerritMatt Riedemann proposed openstack/nova master: Log with cell.uuid if cell.name is not set  https://review.openstack.org/44064416:09
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Update CELLS cache if we only have cell0  https://review.openstack.org/44065216:09
mriedemsileht: can you post a gnocchi patch that depends on ^ to see if it helps?16:09
*** Matias has joined #openstack-nova16:11
silehtmriedem, https://review.openstack.org/44065716:12
*** markvoelker has joined #openstack-nova16:12
openstackgerritSujitha proposed openstack/nova master: Remove mox from nova.tests.unit.api.openstack.compute.test_create_backup  https://review.openstack.org/43561016:12
jaypipesedleafe, alex_xu, bauzas, mriedem, dansmith: https://review.openstack.org/440654, https://review.openstack.org/440655, https://review.openstack.org/44065616:12
*** psachin has quit IRC16:12
*** sneti_ has quit IRC16:13
bauzasjaypipes: oh cools16:13
edleafejaypipes: will review16:13
jaypipesdanke16:13
mriedemsileht: you know, https://review.openstack.org/#/c/427392/ is probably the thing that triggered this bug16:14
mriedemsileht: because before that, cell0 wouldn't be mapped and nova-api wouldn't list any instances16:14
silehtmriedem, I think we having another behavior before, and the issue was not so often16:16
*** BobBall has quit IRC16:16
zioprotodansmith: are you online ?16:17
silehtmriedem, thanks for your help16:17
*** tbachman has joined #openstack-nova16:17
*** mjura has quit IRC16:17
*** baoli has joined #openstack-nova16:18
*** jamesden_ has joined #openstack-nova16:18
mriedemsileht: yeah i mean it's still a bug, but also, if we didn't have cell1 created yet and you tried creating a server, it would fail because we have nowhere to place it16:18
mriedembut you could list servers and get nothing back, and that would be fine if you never tried creating any servers16:18
mriedemwhich i think that's what ceilometer was doing16:18
mriedemjust listing servers16:18
mriedemon startup or something, not sure16:18
mriedembut that GET call was caching cell0 whereas before https://review.openstack.org/#/c/427392/ we didn't have cell0 mapped so nothing was cached16:19
bauzasjaypipes: you're hitting the pbr issue for os-traits lib16:23
*** raunak has joined #openstack-nova16:23
mriedemjaypipes: yeah you need to update the hacking version here https://github.com/jaypipes/os-traits/blob/master/test-requirements.txt#L516:23
mriedemhttp://git.openstack.org/cgit/openstack/requirements/tree/global-requirements.txt#n42416:23
openstackgerritBalazs Gibizer proposed openstack/nova master: handle uninited fields in notification payload  https://review.openstack.org/41585716:24
openstackgerritArnaud Morin proposed openstack/nova master: Set default value to HTTP_X_FORWARDED_PROTO  https://review.openstack.org/42337516:24
*** dikonoor has joined #openstack-nova16:25
*** karthiks has quit IRC16:25
*** baoli has quit IRC16:26
*** annegentle has joined #openstack-nova16:26
*** baoli has joined #openstack-nova16:26
*** baoli has quit IRC16:27
jaypipesmriedem: thx for the heads up, will fix up now.16:28
*** baoli has joined #openstack-nova16:28
*** tjones has quit IRC16:28
*** salv-orlando has joined #openstack-nova16:29
mriedemdansmith: before i write tests, how much do you hate this? https://review.openstack.org/#/c/440652/16:29
*** eharney has quit IRC16:29
mriedemtrying to think of ways to auto-invalidate or update that CELLS cache when a new cell mapping is created16:29
dansmithmriedem: one cell is not valid regardless of why so I think you need only check the length16:30
dansmithI still assert this is a silly workaround, but if you want it that's fine16:30
mriedemi don't know that i want it16:31
*** mdrabe has quit IRC16:31
mriedemthe devstack change would also unblock gnocchi16:31
mriedemi think16:31
*** baoli has quit IRC16:33
dansmithmriedem: what was the change in the last day or so that caused this?16:35
mriedemdansmith: https://review.openstack.org/#/c/427392/16:35
*** raunak has quit IRC16:36
dansmithah16:36
dansmiththat caused me trouble too16:36
*** mdrabe has joined #openstack-nova16:36
jaypipesedleafe, alex_xu, bauzas, mriedem, dansmith: fixed up pep8/hacking thing. https://review.openstack.org/440678 now new root of series.16:38
mriedemit does follow https://docs.openstack.org/developer/nova/cells.html#fresh-install more closely now, but simple_cell_setup and when it's called is kind of our issue now i think16:38
mriedemdansmith: if we created cell1 around the same time as cell0, before starting nova-api, then we wouldn't have the cache issue16:38
mriedemwe'd just have to run discover_hosts after starting n-cpu16:39
*** ducttape_ has quit IRC16:39
dansmithI still don't understand why we have the problem at all, since devstack is sequential16:39
bauzasjaypipes: I thought you were hit by the fact we were pulling pbr-2.0.016:39
*** ducttape_ has joined #openstack-nova16:39
mriedemdansmith: devstack is mapping cell0, starting n-api, then loading extras (ceilometer plugin) which starts querying n-api, then devstack eventually does create_cell which calls simple_cell_setup16:40
mriedemwhich creates the cell1 mapping16:40
mriedemfor the 'normal' setup there are no extras so we don't see it16:40
*** andreas_s has quit IRC16:41
dansmithmriedem: ah so we really are starting it in the wrong order we just don't hit the cache?16:41
*** pcaruana has quit IRC16:42
mriedemdansmith: yeah16:42
dansmithmriedem: okay yeah then we should change that16:42
mriedemceilometer hit the cache and stored only cell016:42
dansmithmriedem: you're going to break my fleetify patch, but..16:42
markus_zmriedem: I don't find a clue to solve the novnc issue. Tomorrow I have no time left, I'll give it another try on Monday.16:43
mriedemmarkus_z: ok thanks for looking16:43
mriedemdansmith: sileht has this https://review.openstack.org/#/c/440651/16:43
mriedembut it is a workaround yeah16:43
mriedemso the proper fix is probably what i described above, with creating cell1 at the same time as cell016:43
dansmithmriedem: yeah16:44
mriedemand then change simple_cell_setup in the post-setup to just discover_hosts16:44
mriedemor map_cell_and_hosts or whatever16:44
*** jpena is now known as jpena|away16:44
*** baoli has joined #openstack-nova16:44
dansmithnot map_cell_and_hosts16:44
mriedemi don't know if/how that messes up upgrade because we'd already have cell116:44
dansmiththat creates a cell16:44
dansmithjust discover at the end16:44
*** markus_z has quit IRC16:45
mriedemwe need to not create cell1 if it already exists, which we could maybe figure out with the list_cells command16:46
mriedemjaypipes: +2 on https://review.openstack.org/#/c/440678/16:46
*** vanch has quit IRC16:47
*** baoli has quit IRC16:47
dansmithmriedem: that point where we create cell0 we're on an empty db regardless of upgrade because we're on the old side right?16:47
*** browne has joined #openstack-nova16:48
mdboothIs this going to be a problem in general when adding a cell? If you can add a cell and have instances scheduled to it instantly, but those instances won't be visible, isn't this something you're always going to hit when adding a cell?16:49
jaypipesmriedem: cheers. the end goal here is to release os-traits lib with a git tag today so we can begin working on tests for that "sync os-traits" thing in placement-manage per bauzas and alex_xu's discussion on the traits spec.16:49
mdboothiow is it worth fixing this with something a bit more general purpose than a workaround for cell1?16:50
*** xinli has joined #openstack-nova16:50
mriedemdansmith: i think https://github.com/openstack-dev/devstack/blob/master/lib/nova#L700 is the dirty secret16:50
mriedemwe drop and recreate the nova_api db16:50
mriedemdansmith: same for cell016:50
dansmithmriedem: eh?16:50
*** cleong has quit IRC16:51
mriedemi think from newton->ocata that wasn't a problem for cell0 because in newton we didn't put anything into cell016:51
mriedembut ocata cell0 could have stuff in it16:51
dansmithinit_nova only runs on the old side right?16:51
mriedemidk16:51
mriedemi thought it ran on both but i don't have grenade memorized16:51
dansmithwe blow away all the dbs there.. nothing would work if we ran it in both places16:52
*** cleong has joined #openstack-nova16:53
mriedemok. i was thinking of this https://review.openstack.org/#/c/393441/2/projects/60_nova/from-newton/upgrade-nova@816:53
mriedemunrelated and confusing myself i suppose16:53
mriedemanyway, i can work a change to do create_cell cell1 after map_cell0 and change simple_cell_setup to be discover_hosts in devstack16:54
mriedemand if grenade hates it i guess we'll find out16:54
openstackgerritLee Yarwood proposed openstack/nova master: WIP compute: Move detach logic from manager into driver BDM  https://review.openstack.org/43952016:55
openstackgerritLee Yarwood proposed openstack/nova master: compute: Only destroy BDMs after successful detach call  https://review.openstack.org/44069316:55
*** baoli has joined #openstack-nova16:58
aunnamjohnthetubaguy, Will you be updating the poc patch https://review.openstack.org/#/c/434842/ by removing scope and access as they are not needed right now?16:58
johnthetubaguyaunnam: I was hoping you or sneti might fancy doing that :)16:59
aunnamjohnthetubaguy, Or you want us to update the patch?16:59
aunnamjohnthetubaguy, sure will do that, thanks16:59
mriedemsileht: looks like my nova workaround patch fixed the gnocchi issue17:00
*** ayogi has joined #openstack-nova17:02
mdboothmriedem: re the CELLs cache, would it be feasible to manage that with memcached via oslo_cache? Could a newly created cell poke itself into the cache before allowing anything to be scheduled there?17:02
mdboothShould mean you'd have no weirdness period after creating a new cell.17:02
mriedemmdbooth: at a minimum yes on oslo.cache to add a timer to it17:03
mriedemmdbooth: feel free to start that17:03
mriedemas for how to auto-register a new cell to invalidate the cache or put itself into it, i'm not sure how we do that right now17:03
mdboothmriedem: Well I was explicitly thinking of a distributed cache, like memcached17:03
mriedemwith oslo.cache the backing cache store is abstracted17:04
mriedemi thought anyway17:04
mdboothI think we have the infrastructure in place for that already, but I don't know what the deployment concerns would be17:04
mdboothYes, looks like it is17:04
mriedemwe already use oslo.cache in several places so it should be a common pattern17:05
mriedemeven with a timeout on the cache, we still have a timing issue between when a new cell is added and when the cache invalidates and gets updated17:05
mriedemhaving said that, we don't expect new cells to be added all the time17:06
mdboothRight. Unless you've got a distributed cache, you're always going to have a broken period there.17:06
mdboothCould you put it on the deployer? Before enabling scheduling to a new cell, all n-api need to be restarted?17:06
*** nic has joined #openstack-nova17:06
*** lucasagomes is now known as lucas-afk17:07
mdboothUgly, but deterministic.17:07
mriedemi believe that's what we've said if you update db or transport url connection info in a cell mapping17:08
*** crushil has quit IRC17:10
mriedemyeah https://docs.openstack.org/developer/nova/man/nova-manage.html#nova-cells-v217:10
mriedem"NOTE: Updating the transport_url or database_connection fields on a running system will NOT result in all nodes immediately using the new values. Use caution when changing these values."17:10
*** lpetrut has quit IRC17:12
mdboothmriedem: Is it possible to add a cell without allowing instances to be scheduled there, btw?17:12
*** dave-mcc_ has joined #openstack-nova17:12
dansmithwe are really a long way from needing to overthink this cache thing17:13
mriedemmdbooth: if the cell doesn't have hostmappings17:13
* mdbooth recalls this was a use case for cells.17:13
mriedemif it doesn't have host mappings nothing goes into it17:13
dansmithyou can't even have multiple cells today17:13
dansmithso a static list is *fine*17:13
*** dave-mccowan has quit IRC17:13
mdboothdansmith: Yeah, with the restarting things I was backing away from distributed caches :)17:13
*** dave-mccowan has joined #openstack-nova17:14
*** dave-mcc_ has quit IRC17:17
mriedemdansmith: so you want me to just change this to check for len 1 and just always re-query until we have more than 1? https://review.openstack.org/#/c/440652/1/nova/compute/api.py17:17
dansmithmriedem: it's not what I want, but I will accept it :)17:18
dansmithwe need to fix devstack anyway right?17:18
mriedemi think so17:18
mriedemi only worry about fixing devstack and others in the wild falling into the same trap17:18
*** raunak has joined #openstack-nova17:21
*** JoseMello has joined #openstack-nova17:21
dansmithmriedem: this is exactly the same as the service catalog thing to me17:21
dansmithmriedem: but, like I say, whatever you want17:21
*** corey has joined #openstack-nova17:21
*** corey is now known as Guest5369917:21
*** bvanhav_ has quit IRC17:22
*** cleong has quit IRC17:23
*** Apoorva has joined #openstack-nova17:23
*** bvanhav_ has joined #openstack-nova17:25
mriedemdansmith: service catalog re: order of steps during deploy?17:25
*** bvanhav_ is now known as bvanhav17:25
dansmithyeah17:26
mriedemok, so maybe i'll just do the devstack change first, hold off on the nova patch and keep it in the pocket17:27
mriedemwe could log a warning if there is only 1 cell cached when listing instances, saying hey dummy you started n-api before all of your cells were mapped, you need to create the cells and restart nova-api17:28
dansmithyeah, totes17:30
*** bkopilov has quit IRC17:31
*** ralonsoh has quit IRC17:34
openstackgerritEric Fried proposed openstack/nova master: PowerVM Driver: spawn/destroy #3: TaskFlow  https://review.openstack.org/43872917:34
*** leseb_ has joined #openstack-nova17:35
silehtmriedem: thx, should abandon mine ?17:36
mriedemsileht: it's probably still a good idea to not load extras/plugins until nova is setup17:36
*** lucasxu has quit IRC17:36
*** rfolco has quit IRC17:37
*** lucasxu has joined #openstack-nova17:38
*** ayogi has quit IRC17:39
mriedemdansmith: do you remember why for cellsv1 at the end we sync the db? https://github.com/openstack-dev/devstack/blob/master/lib/nova#L97817:40
mriedemafter creating cell1 and mapping the hosts to it17:40
dansmiththat line is for cellsv217:40
*** ltomasbo is now known as ltomasbo|away17:41
dansmithmriedem: I think some of this came from just doing cellsv2 stuff where we had bits for cellsv1 which isn't necessarily sensical17:41
mriedemthat's cellsv117:41
*** dtp has joined #openstack-nova17:41
mriedemif not n-cell is above17:41
mriedemn-cell is v117:41
mriedemi'm going to remove it and see what happens17:41
*** Kevin_Zheng_ has quit IRC17:43
*** ducttape_ has quit IRC17:45
*** krtaylor has quit IRC17:46
dansmithoh sorry I see I read it wrong17:46
dansmithso .. no I'm not sure17:47
*** browne has quit IRC17:49
*** fragatina has joined #openstack-nova17:49
*** fragatina has quit IRC17:50
*** adrian_otto has joined #openstack-nova17:51
*** romainh has quit IRC17:52
mriedemdansmith: let's find out https://review.openstack.org/44073917:52
*** tesseract has quit IRC17:52
mriedemi'm going to lunch17:53
*** lucasxu has quit IRC17:54
*** fragatina has joined #openstack-nova17:55
*** derekh has quit IRC17:55
*** mriedem1 has joined #openstack-nova17:56
*** mriedem has quit IRC17:57
*** fragatina has quit IRC17:57
*** fragatina has joined #openstack-nova17:58
*** fragatina has quit IRC17:58
*** fragatina has joined #openstack-nova17:59
*** fragatina has quit IRC17:59
*** sambetts is now known as sambetts|afk18:02
openstackgerritAnusha Unnam proposed openstack/nova master: POC: add descriptions to server tags  https://review.openstack.org/43484218:02
openstackgerritJay Pipes proposed openstack/nova master: placement: ironic inventory reporting  https://review.openstack.org/43760218:04
jaypipescdent: ^^ fixed your requests18:04
cdentrad18:04
*** liangy has quit IRC18:05
*** karimb has joined #openstack-nova18:05
*** tbachman has quit IRC18:05
*** tbachman has joined #openstack-nova18:06
*** erlon has joined #openstack-nova18:08
*** liangy has joined #openstack-nova18:09
*** jaypipes has quit IRC18:12
*** yamahata has joined #openstack-nova18:12
openstackgerritDan Smith proposed openstack/nova master: WIP: Get instance availability_zone without hitting the api db  https://review.openstack.org/43975418:15
openstackgerritDan Smith proposed openstack/nova master: Target cell in super conductor operations  https://review.openstack.org/43802218:15
openstackgerritDan Smith proposed openstack/nova master: Change MQ targeting to honor only what is in the context  https://review.openstack.org/43802318:15
openstackgerritDan Smith proposed openstack/nova master: Make scheduler target cells to get compute node instance info  https://review.openstack.org/43989118:15
openstackgerritDan Smith proposed openstack/nova master: Add cell field to Destination object  https://review.openstack.org/43802418:15
openstackgerritDan Smith proposed openstack/nova master: WIP: Make conductor ask scheduler to limit migrates to same cell  https://review.openstack.org/43802518:15
*** unicell has joined #openstack-nova18:15
*** edand has joined #openstack-nova18:18
openstackgerritJohn Garbutt proposed openstack/nova-specs master: Add spec to use cinder's new attachment API  https://review.openstack.org/37320318:18
*** jaosorior has quit IRC18:19
*** fragatina has joined #openstack-nova18:21
*** crushil has joined #openstack-nova18:25
*** edmondsw has quit IRC18:29
*** slaweq_ has quit IRC18:29
*** dikonoor has quit IRC18:31
*** slaweq_ has joined #openstack-nova18:32
*** edmondsw has joined #openstack-nova18:32
*** lucasxu has joined #openstack-nova18:32
*** edmondsw has quit IRC18:36
*** slaweq_ has quit IRC18:38
*** liangy has quit IRC18:39
*** slaweq_ has joined #openstack-nova18:40
*** amoralej is now known as amoralej|off18:44
*** jose-phi_ has joined #openstack-nova18:44
*** ducttape_ has joined #openstack-nova18:45
*** bvanhav_ has joined #openstack-nova18:46
*** rfolco has joined #openstack-nova18:46
*** jose-phillips has quit IRC18:46
*** bvanhav has quit IRC18:46
*** fragatina has quit IRC18:48
dansmithcdent: edleafe since jaypipes isn't around.. do you recall why he wants ironic to be special in the situation where custom resource classes are auto-created?18:48
dansmithI'm not sure I ever knew, so maybe recall is the wrong word18:49
*** fragatina has joined #openstack-nova18:49
cdentdansmith: my recollection is thin but I think it was because we already promised we would, but that we should not extend that promise to anything else. As you've asked, "why not?" is a fair question on that.18:50
dansmithhmm, okay18:50
*** ducttape_ has quit IRC18:50
dansmithif there is a sunset date on that, then maybe I'm on board, like after ironic creates and maintains these themselves or something18:51
cdentIt seems to me that if we're in the context of the compute-node then we may as well auto create because we're in charge there18:51
dansmithright, and virt drivers are in-tree18:51
cdentand if we do it for one, may as well for anything18:51
dansmithyeah18:51
dansmithand you could use the same logic,18:51
dansmithin that until operators are familiar with placement, we auto-create things for them from all virt drivers18:51
cdentthe issue with that, of course, is that whole "precedent" thing. If we start auto creating willy nilly now, then everyone will want it later or never adapt to the time when we don't18:52
dansmithalso, if your virt driver knows about VFs, PFs, and GPUs, but can't report them until you create a class for them or something.. I dunno, kinda feels too manual to me18:52
* cdent nods18:52
*** salv-orl_ has joined #openstack-nova18:52
dansmithwell, I dunno18:52
dansmithbut I also don't really know why we wouldn't auto-create anyway, so..18:52
cdentYeah, that's the crux18:53
dansmithbut, sounds like I'm not missing something major, which is good18:53
*** crushil has quit IRC18:53
*** eharney has joined #openstack-nova18:53
cdentas far as I recall, you're not, but it often feels like there are major things happening while I blink18:53
*** crushil has joined #openstack-nova18:53
dansmithwell, it's enough to justify my -1 until we get jay back to discuss at least :)18:54
*** bvanhav_ has quit IRC18:54
* cdent nods18:54
*** bvanhav_ has joined #openstack-nova18:54
*** salv-orlando has quit IRC18:55
*** kaisers_ has joined #openstack-nova18:58
edleafedansmith: there was a little bit of provincialism, in that Nova resources have standard names, whereas Ironic resources all have to be "CUSTOM_blah"18:59
dansmithedleafe: yeah, but any other driver could expose a custom one18:59
dansmithedleafe: if we merged that code, we clearly thought it was legit, so why not auto-create it in the same place?18:59
edleafedansmith: dunno. Maybe Jay remembers why19:01
*** bvanhav_ is now known as bvanhav19:01
*** romainh has joined #openstack-nova19:04
*** krtaylor has joined #openstack-nova19:05
mriedem1blarg!19:07
*** mriedem1 is now known as mriedem19:07
*** adrian_otto has quit IRC19:07
mriedeminit_nova_cells is called after init_nova19:07
*** thorst has quit IRC19:09
*** dharinic is now known as dharinic|lunch19:09
*** thorst has joined #openstack-nova19:10
*** gszasz has quit IRC19:10
mriedemsileht: i've updated the dependency for https://review.openstack.org/#/c/440657/ to be the devstack fix i pushed19:11
mriedemit already passed in the non-cells v1 case, and i just fixed it for the cells v1 case19:12
*** claudiub has quit IRC19:12
*** edmondsw has joined #openstack-nova19:14
*** thorst has quit IRC19:14
*** adrian_otto has joined #openstack-nova19:15
*** dtp has quit IRC19:17
*** lucasxu has quit IRC19:18
*** lucasxu has joined #openstack-nova19:19
*** armax has quit IRC19:20
melwittmriedem: I looked at rajesh's email earlier, he's been working on the problem too and will be proposing some changes, once we figure out which direction to go19:22
*** adrian_otto has quit IRC19:23
*** adrian_otto has joined #openstack-nova19:24
cfriesenIs anyone aware of a Mitaka bug where rows in instance_system_metadata for a given instance don't get deleted when the instance gets deleted?  I've got a system with 400K rows in "instance_system_metadata" where deleted_at is null, and only 40 rows in "instances" where deleted_at is null.19:29
mriedemyes19:30
*** xinli has quit IRC19:30
*** liangy has joined #openstack-nova19:31
*** armax has joined #openstack-nova19:31
*** mriedem1 has joined #openstack-nova19:31
mriedem1cfriesen: you should have this in mitaka https://github.com/openstack/nova/commit/2c48ff44a21083340cec35242a9fc006d3cd828d19:34
*** ijw has joined #openstack-nova19:34
mriedem1^ was fixed in liberty19:35
mriedem1that doesn't mean you don't have a ton of old orphaned stuff before that19:35
*** mriedem has quit IRC19:35
*** irenab_ has quit IRC19:35
*** cdent has quit IRC19:36
cfriesenmriedem1: my bad, this DB was actually from Kilo.  I made an incorrect assumption.  That's almost certainly the issue.  Thanks.19:36
*** sree has joined #openstack-nova19:37
*** romainh has quit IRC19:42
*** sree has quit IRC19:42
*** mriedem1 is now known as mriedem19:44
mriedemcfriesen: you can repay me by sending sdague the nickel i owe him19:44
*** adrian_otto has quit IRC19:45
*** edmondsw has quit IRC19:47
cfriesenthat'll be 6 cents Canadian.19:47
sdagueI'm going to have to play these exchange rate games and work my self up to 2 bits19:48
*** dharinic|lunch is now known as dharinic19:50
*** edmondsw has joined #openstack-nova19:50
*** huanxie has quit IRC19:51
_gryfdansmith, I may be wrong, but idea to have ironic custom-class to be auto created is be backward compatible19:55
_gryfI mean, there is no discovery mechanism for custom resources19:55
_gryfand in past releases we do support ironic resource, right?19:56
*** armax has quit IRC19:58
*** jamielennox|away is now known as jamielennox20:02
*** yassine has quit IRC20:06
openstackgerritMatt Riedemann proposed openstack/nova master: Log a warning if there is only one cell when listing instances  https://review.openstack.org/44065220:06
edleafe_gryf: there weren't resources in past releases20:08
_gryfedleafe, but it was tracked by resource tracker20:09
_gryfmaybe that was the reason20:09
melwittmriedem: I also have reproposed the spec for using the quota-related tables in the api db here https://review.openstack.org/#/c/431748 in case you didn't know20:09
edleafe_gryf: yes, but that was VCPU, RAM, disk, etc.20:09
dansmith_gryf: yeah, I don't think that's what we're talking about here20:09
edleafe_gryf: not ResourceClasses for the Placement service20:09
dansmith_gryf: this only existed in ironic in ocata, and not even directly as a placement resource class20:09
_gryfdansmith, oh20:10
openstackgerritMatt Riedemann proposed openstack/nova master: Handle conflicts for os-assisted-volume-snapshots  https://review.openstack.org/42947620:10
melwittmriedem: I didn't use the previously-approved tag because I changed it to not talk about populating the quota_usages and reservations tables20:10
mriedemoh boy20:11
mriedemnow i actually have to diff it20:11
_gryfso yeah, I'm also uncertain why ironic is treated in special way :(20:11
melwittI can put it back the way it was if you want :P20:11
*** liuyulong_ has joined #openstack-nova20:11
melwittit just wasn't accurate anymore20:11
mriedemno it's good to be accurate20:12
edleafe_gryf: because it's the only non-Nova resource provider we've considered20:12
melwittyeah, was just kidding20:13
_gryfbut wait. doesn't nova was able to provide bare metal before? I mean, if we track certain amount of resources, spinning out bare metal should take out such resources out of available one, isn't it?20:14
mriedemsileht: https://review.openstack.org/#/c/440657/ passed with https://review.openstack.org/#/c/440739/20:15
*** liuyulong has quit IRC20:15
mriedemand it looks like https://review.openstack.org/#/c/440739/ passed the cellsv1 and normal jobs20:15
mriedemdansmith: sdague: ^20:15
mriedemso we should get that devstack change in20:15
mriedemto unblock gnocchi20:15
*** ducttape_ has joined #openstack-nova20:16
*** ducttape_ has quit IRC20:21
*** JoseMello has quit IRC20:25
*** dtp has joined #openstack-nova20:26
mriedemmelwitt: +220:26
melwittthanks20:27
*** claudiub has joined #openstack-nova20:33
*** thorst has joined #openstack-nova20:35
*** Apoorva has quit IRC20:39
openstackgerritMatt Riedemann proposed openstack/nova master: Default firewall_driver to nova.virt.firewall.NoopFirewallDriver  https://review.openstack.org/43918720:46
*** vanch has joined #openstack-nova20:50
mriedemnova meeting in 10 minutes20:50
mriedemwas there a cells meeting yesterday? i spaced on that one.20:51
*** rfolco has quit IRC20:51
*** jose-phillips has joined #openstack-nova20:52
*** jose-phi_ has quit IRC20:53
*** yassine has joined #openstack-nova20:54
*** READ10 has quit IRC20:54
*** salv-orl_ has quit IRC20:54
*** takashin has joined #openstack-nova20:54
*** crushil has quit IRC20:56
*** jaypipes has joined #openstack-nova20:57
*** aysyd has quit IRC20:57
*** crushil has joined #openstack-nova20:57
*** yassine has quit IRC20:58
*** vanch has quit IRC20:59
dtpyes20:59
*** vanch has joined #openstack-nova21:05
*** smatzek_ has quit IRC21:10
*** gcb has joined #openstack-nova21:11
*** vanch has quit IRC21:14
*** tlian has joined #openstack-nova21:20
*** adrian_otto has joined #openstack-nova21:20
*** yassine has joined #openstack-nova21:21
sdaguemriedem: am I the only one that feels like we're doing genetic programming on nova manage commands to move them around until least stuff breaks :)21:21
*** Apoorva has joined #openstack-nova21:23
*** lpetrut has joined #openstack-nova21:24
*** bvanhav has quit IRC21:25
*** salv-orlando has joined #openstack-nova21:28
*** yassine has quit IRC21:28
*** tlian has quit IRC21:29
*** edmondsw has quit IRC21:31
mriedemsdague: yes you are21:31
mriedemeveryone else knows what's going on with the nova-manage commands21:31
mriedemsdague: musical chairs is the name of the game21:32
dansmithseriously21:32
mriedemsdague: the commit message explains the thing, it was wrong to begin with how we were doing it,21:32
mriedemjust didn't realize that until we moved map_cell0 earlier and the telemetry extras injected itself into the middle of the stack21:33
mriedemwe were basically getting lucky before just because we did some stuff all at the end21:33
mriedemwhich was wrong21:33
mriedemsometimes i do feel like a 16th century monk that gets off on watching peas mate with each other21:34
*** eharney has quit IRC21:34
*** irenab_ has joined #openstack-nova21:35
takashinmriedem: Would you remove -2 in https://review.openstack.org/#/c/408955/ ?21:35
*** edmondsw has joined #openstack-nova21:35
* mriedem notes there are no gregor mendel enthusiasts in the crowd21:35
* edleafe got the reference but couldn't think of a snappy genetic comeback21:35
openstackgerritSarafraj Singh proposed openstack/nova-specs master: Add live-migration-force-after-timeout spec  https://review.openstack.org/43846721:36
mriedemtakashin: done21:36
takashinmriedem: Thank you.21:37
openstackgerritSarafraj Singh proposed openstack/nova-specs master: WIP: Add live-migration-force-after-timeout spec  https://review.openstack.org/43846721:37
*** karimb has quit IRC21:37
*** takashin has left #openstack-nova21:38
*** karimb has joined #openstack-nova21:38
mriedemildikov: fyi i've started a nova/cinder review priority section here, L62 https://etherpad.openstack.org/p/pike-nova-priorities-tracking21:40
mriedemildikov: let's keep that focused on a small set of patches per week though21:40
ildikovmriedem: great, thank you!21:41
dimsmriedem : looks like stale data - https://governance.openstack.org/tc/goals/pike/python35.html#nova21:41
mriedemdims: the # of tests?21:41
ildikovmriedem: we can keep the long list on the regular etherpad and move items to the priority one when they are out of WIP for instance21:42
mriedemdims: i'm not sure how that number was calculated to begin with21:42
mriedemmaybe that's total number of py27 tests - total number of py35 tests run21:43
*** yassine has joined #openstack-nova21:43
mriedemdims: hmm i also see that gate-nova-tox-functional-py35-ubuntu-xenial is non-voting but it's passing21:43
mriedemnot sure why it's still non-voting21:43
dimsmriedem : right. http://git.openstack.org/cgit/openstack/nova/tree/tests-py3.txt also shows just a handful of things21:44
*** dave-mccowan has quit IRC21:44
*** yassine has quit IRC21:44
dims+1 to make it voting21:44
mriedemdims: want to push that change?21:44
dimsproject-config change, sure21:45
mriedemyeah it's actually down to 63 tests now21:45
mriedemi'll update the governance repo21:45
dansmithmriedem: sdague: for something like /servers/<uuid>/tags/foo, is there some glue somewhere that looks up the instance via uuid before the show/update gets called in the server_tags extension?21:47
dansmithsomething other than servers.py::show I would assume21:47
*** irenab_ has quit IRC21:47
*** ducttape_ has joined #openstack-nova21:47
sdaguedansmith: what exactly are you looking for?21:48
sdaguejust how do the routes get populated?21:48
mriedemdansmith: this is the extension code for servers https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/server_tags.py#L18221:48
mriedemhttps://github.com/openstack/nova/blob/master/nova/api/openstack/compute/server_tags.py#L6421:49
sdaguehttps://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/openstack/compute/server_tags.py#L183-L19021:49
mriedemshow is a 20421:49
mriedemwhich seems odd21:49
dansmithsdague: sdague when I PUT /servers/<uuid>/tags/foo, I never get to server_tags.py::update() before I get NotFound looking up the instance, it seems21:49
*** irenab_ has joined #openstack-nova21:49
dimsmriedem : https://review.openstack.org/44082621:49
mriedemdansmith: that would be this i think https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/server_tags.py#L13721:49
dansmithsdague: do the routes just fetch uuid out of the url for me, but completely rely on me doing the 404 if I don't find the server?21:49
dansmithmriedem: yeah I don't seem to get there21:50
dansmithmaybe I'm doing something else wrong21:50
mriedemdansmith: that's what it looks like, the tags extensions can fail with an InstanceNotFound21:51
sdaguedansmith: I'm going to have to reload this bit back into my head21:51
mriedembut it looks like the instance lookup is hidden in the tag object21:51
dansmithmriedem: right I just want to make sure that's the only one, because I don't seem to make it into that method *at all*21:51
mriedemhttps://github.com/openstack/nova/blob/master/nova/objects/tag.py#L5121:51
mriedemoh21:51
dansmithand I'm wondering if there is some other glue that is missing the cell lookup21:51
mriedemdansmith: microversoin?21:52
*** ducttape_ has quit IRC21:52
dansmithmriedem: it's tempest21:52
mriedemstill21:52
mriedemis it passing 2.1?21:52
mriedemi think you need at least 2.2621:52
dansmithI dunno, but the test seems to work without cells. I just tried from nova client and I get the same deal21:52
mriedemnovaclient CLI will request the latest microversion available that it understands21:53
mriedemtempest won't21:53
*** Guest53699 has quit IRC21:53
*** mtanino_ has joined #openstack-nova21:53
dansmithPUT http://192.168.201.194:8774/v2.1/servers/0d97611d-f1d6-4146-858d-9387baf36558/tags/tagme -H "OpenStack-API-Version: compute 2.41"21:53
mriedemi don't think anyway21:53
sdaguemriedem: the tests should be configured correctly21:53
cfriesenrelated to my earlier DB question....is there a reason why "instance_actions" rows don't get deleted when the instance does?21:53
mriedemcfriesen: have you bothered to look at the code?21:53
*** anteaya has quit IRC21:54
*** cburgess has quit IRC21:54
cfriesenmriedem: I'm looking at instance_destroy() in the DB API code21:54
*** mtanino has quit IRC21:54
*** lpetrut has quit IRC21:55
mriedemit doesn't appear that they do there21:55
mriedemi believe this came up in the ML in newton21:55
cfriesenokay, I can check the archives21:55
sdaguedansmith: I'm pretty sure nothing else is validating the server id until you get into server_tags.py21:55
cfriesenI didn't see a bug for it21:55
dansmithsdague: okay21:55
sdaguebut, it's end of day, so that's just my recollection21:55
dansmithsdague: http://pastebin.com/bicZYZVt21:56
dansmithsdague: with that, when I add a tag from the client, I get _none_ of my log lines in the log21:56
dansmithwell, when I _try_ to add a tag.. it fails with 40421:56
dansmithanyway, just want to make sure I'm not missing something obvious21:57
mriedemcfriesen: https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L646821:57
mriedemthey are handled differently for archive at least21:58
mriedembecause they aren't soft deleted21:58
mriedemcfriesen: http://lists.openstack.org/pipermail/openstack-dev/2015-November/079701.html21:59
*** dimtruck is now known as zz_dimtruck21:59
dansmithmriedem: just checking, but... api_version('2.26') means "2.26 or later" right? just making sure we don't have another single-version thing22:00
dansmiththat wouldn't explain tempest not working though22:00
*** cburgess has joined #openstack-nova22:00
cfriesenmriedem: I was just looking at the bug related to that email thread22:00
mriedemcfriesen: http://lists.openstack.org/pipermail/openstack-dev/2015-November/079778.html22:00
mriedem^ is the summary22:00
sdaguedansmith: https://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/openstack/wsgi.py#L907-L91022:01
mriedemdansmith: depends on where the code is i guess22:01
dansmithsdague: okay yeah22:01
sdaguedansmith: anyway, if this is still a thing tomorrow, I can help debug. But I'm pretty sure we end up just building the routes through route mapper and we get straight to these functions22:02
mriedemcfriesen: i also remember this coming out of that discussion https://docs.openstack.org/developer/nova/api_microversion_history.html#id1922:02
dansmithsdague: okay me too, I just don't know how else to explain what I'm seeing22:02
dansmithsdague: but yeah thanks22:02
sdaguethe only question is if there is a very early 404 in wsgi22:02
dansmithright22:03
cfriesenmriedem: right, I saw that part.22:03
sdaguehttps://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/openstack/wsgi.py#L60122:03
sdaguebut that should show up in nova-api logs as a fault22:03
openstackgerritSujitha proposed openstack/nova master: Add description to policies in admin_actions.  https://review.openstack.org/44082922:04
dansmithoooooo22:04
*** cburgess has quit IRC22:04
dansmithno, no.22:05
cfriesenmriedem: that summary is useful, thanks.  it might be nice if it was in the code as a comment or something.22:05
dansmithdammit22:05
sdagueok, you have to share before I run away22:05
dansmiththere is no instance lookup in the path of the PUT22:05
sdaguebecause I want to know :)22:05
dansmithI thought there was, but it's for the server get the client does before the put of the tag22:06
dansmithafter the get returns,22:06
sdagueah22:06
dansmithno instance get at all22:06
dansmithso......22:06
sdagueright, so you are way off in 404 land22:06
dansmithI don't like 404 land22:06
*** anteaya has joined #openstack-nova22:07
*** thorst has quit IRC22:08
openstackgerritSujitha proposed openstack/nova master: Add description to policies in admin_actions.  https://review.openstack.org/44082922:08
mriedemdims: v22:09
mriedemhttps://review.openstack.org/44083222:09
mriedemcfriesen: i have to go back and read the summary myself22:10
*** cburgess has joined #openstack-nova22:10
dansmithsdague: omg I am so awesaome22:10
dansmithsdague: RROR stevedore.extension [req-3b12728d-ad52-44bd-b79d-ba66275e1d1d None None] Could not load 'server_tags': cannot import name nova_context22:11
mriedemcfriesen: ok so we fixed the 2 things in that thread we said we would,22:12
mriedemwhich is the microversion to list instance actions for deleted instances,22:12
mriedemand hard delete instance actions when archiving an instance22:12
mriedemcfriesen: if you wanted to push a change to add a comment about why we don't soft delete instance actions when deleting an instance, in the instance_destroy db api method, i'd +2 that22:13
cfriesenmriedem: okay22:13
*** jamesden_ has quit IRC22:15
*** cburgess has quit IRC22:16
*** crushil has quit IRC22:17
*** krtaylor has quit IRC22:17
*** slaweq_ has quit IRC22:17
*** slaweq_ has joined #openstack-nova22:20
openstackgerritAnusha Unnam proposed openstack/nova master: Add description to policies to availability_zone  https://review.openstack.org/44083622:22
*** cburgess has joined #openstack-nova22:22
cfriesenone final DB question (for today, anyway).  What's the story around console_auth_tokens added in Newton?  Is something going to delete them?22:25
dansmithmy jar runneth over22:25
mriedemcfriesen: talk to melwitt about the spec for that22:28
cfriesenmriedem: I'm looking at https://blueprints.launchpad.net/nova/+spec/convert-consoles-to-objects  ... looks like it got only partially implemented?22:29
mriedemcfriesen: yes22:29
mriedemmelwitt is going to re-propose the spec for pike22:29
cfriesenokay, cool. so in Newton the table is there but unused?22:30
melwittlooks like it. you can see the patches that merged vs ones that ended up abandoned here https://review.openstack.org/#/q/topic:bp/convert-consoles-to-objects,n,z22:31
melwittso my plan is to repropose the spec and then resurrect those old patches and fix them up if needed to finish the work22:32
*** zz_dimtruck is now known as dimtruck22:32
cfriesenmelwitt: thanks.  I was looking for users of console_auth_token_create() but didn't see any.22:33
melwittyeah22:33
*** mriedem1 has joined #openstack-nova22:33
*** gouthamr has quit IRC22:33
*** mriedem has quit IRC22:34
cfriesenmelwitt: okay, looks like https://review.openstack.org/#/c/325381/ introduces a periodic task to clean up expired tokens.  seems maybe a bit odd to drive it from the compute nodes though.22:36
*** thorst has joined #openstack-nova22:36
*** swann_ has left #openstack-nova22:36
*** tblakes has quit IRC22:37
*** liuyulong_ has quit IRC22:37
melwittcfriesen: yeah, although that works out for cells, since the tokens will be kept in cell databases, and only n-cpu and n-cond run in a cell22:38
*** kaisers has quit IRC22:39
*** catintheroof has quit IRC22:40
*** thorst has quit IRC22:41
jaypipesdansmith: hey, splitting that big patch is prolly a good idea at this point, yeah. I'll do it when I get to my hotel this evening (currently sitting in SeaTac airport...)22:44
dansmithjaypipes: okay I think it'll be easy22:44
cfriesenjust noticed something odd.  at https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L1879 we soft-delete migrations when the instance is deleted, but then at https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L6474 we special-case the migrations table like we do for instance_actions.  Is that no longer needed?22:45
jaypipesdansmith: ya, shouldn't be a big deal.22:47
mriedem1cfriesen: that's for dealing with migrations that were not soft deleted22:47
mriedem1so you'd have migrations in the db that weren't soft deleted and those would break the archive22:47
mriedem1anything after we started soft deleting migrations when the instance was deleted would be fine22:48
*** mriedem1 is now known as mriedem22:48
mriedemto drop that special case code in the archive function we'd probably need a schema migration that drops those old records22:48
mriedemor an online data migration actually22:49
mriedemthen you don't have the downtime issue22:49
*** salv-orlando has quit IRC22:51
*** salv-orlando has joined #openstack-nova22:51
*** felipemonteiro has quit IRC22:52
*** felipemonteiro_ has quit IRC22:52
cfriesenis there anything stopping us from doing something similar to soft-delete instance_actions and instance_actions_events now in instance_destroy()?   (Now that we've made the other changes from the mailing list summary, I mean.)  Or is it not worth the effort?22:54
mriedemwe don't want to soft delete those because their useful for operators to find out what actions were performed on an instance, which may be deleted now22:55
mriedemthat was the reason for the microversion22:55
mriedem*they're22:55
cfriesenokay, got it22:55
*** kaisers has joined #openstack-nova22:55
mriedemi'd put that in the comment you add to instance_destroy22:55
mriedemwink wink22:55
* mriedem winks his way out of here22:55
*** mriedem has quit IRC22:55
cfriesenthat's why I asked. :)22:55
*** gouthamr has joined #openstack-nova22:57
*** breitz has quit IRC23:01
*** breitz has joined #openstack-nova23:02
*** ducttape_ has joined #openstack-nova23:04
*** baoli has quit IRC23:04
*** krtaylor has joined #openstack-nova23:05
openstackgerritDan Smith proposed openstack/nova master: WIP: Get instance availability_zone without hitting the api db  https://review.openstack.org/43975423:05
openstackgerritDan Smith proposed openstack/nova master: Target cell in super conductor operations  https://review.openstack.org/43802223:05
openstackgerritDan Smith proposed openstack/nova master: Change MQ targeting to honor only what is in the context  https://review.openstack.org/43802323:05
openstackgerritDan Smith proposed openstack/nova master: Make scheduler target cells to get compute node instance info  https://review.openstack.org/43989123:05
openstackgerritDan Smith proposed openstack/nova master: Add cell field to Destination object  https://review.openstack.org/43802423:05
openstackgerritDan Smith proposed openstack/nova master: WIP: Make conductor ask scheduler to limit migrates to same cell  https://review.openstack.org/43802523:05
openstackgerritDan Smith proposed openstack/nova master: Enlighten server tags API about cells  https://review.openstack.org/44085623:05
*** mdrabe has quit IRC23:06
*** liangy has quit IRC23:11
*** adrian_otto has quit IRC23:16
*** jaypipes has quit IRC23:16
*** thorst has joined #openstack-nova23:17
*** oomichi has quit IRC23:18
*** thorst has quit IRC23:19
*** oomichi has joined #openstack-nova23:21
*** lucasxu has quit IRC23:22
*** mriedem has joined #openstack-nova23:24
*** erlon has quit IRC23:25
*** Fdaisuke has joined #openstack-nova23:27
*** xyang1 has quit IRC23:27
openstackgerritTakashi NATSUME proposed openstack/nova master: Enable cold migration with target host(1/2)  https://review.openstack.org/40895523:27
dansmithdtp: still around?23:28
openstackgerritTakashi NATSUME proposed openstack/nova master: Enable cold migration with target host(2/2)  https://review.openstack.org/40896423:28
dtpyessir23:28
openstackgerritTakashi NATSUME proposed openstack/nova-specs master: Fix formatting errors and warnings  https://review.openstack.org/40736423:29
dansmithdtp: there are a few other tests that I think are depending on the hypervisor listing, like the aggregates one that uses hypervisors to get a list of hostnames23:29
*** vladikr has quit IRC23:29
openstackgerritTakashi NATSUME proposed openstack/nova master: Add functional tests for cold migration to same host  https://review.openstack.org/41492623:29
dansmithso fixing that might get us a fair swipe of passing tests23:29
openstackgerritTakashi NATSUME proposed openstack/nova master: api-ref: Add parameters in cold migrate action  https://review.openstack.org/41004223:29
dtpdansmith that's cool.  i haven't had a chance to start on that yet23:31
*** adrian_otto has joined #openstack-nova23:31
*** marst has quit IRC23:31
dansmith*gasp*23:32
openstackgerritSujitha proposed openstack/nova master: Add description to policies in admin_actions.  https://review.openstack.org/44082923:32
dtpyeah sorry...misjudged my week23:32
dansmithdtp: okay well, let me know if you get overly delayed23:32
dansmiths'ok23:32
dtpdon't let me slow you down - if it's better for you to do that one and me to come back again when i _really_ can focus, that's fine w/ me23:33
dansmithokay I'll ping you if I break your lock23:33
*** baoli has joined #openstack-nova23:33
dtpokey dokey23:34
*** annegentle has quit IRC23:35
*** jamielennox is now known as jamielennox|away23:37
*** yassine has joined #openstack-nova23:40
*** marst has joined #openstack-nova23:42
*** tbachman has quit IRC23:44
openstackgerritGiridhar Jayavelu proposed openstack/nova-specs master: VMware: add SR-IOV support  https://review.openstack.org/31712623:53
*** jwcroppe has quit IRC23:59
*** jwcroppe has joined #openstack-nova23:59
*** karimb has quit IRC23:59
*** yassine has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!