Wednesday, 2017-04-26

*** ijw has joined #openstack-nova00:04
*** haplo37_ has quit IRC00:05
mriedemjaypipes: you'll likely need to remind me tomorrow as well00:07
jaypipesmriedem: sure, no worries.00:07
mriedemjaypipes: btw, the summit schedulers are going to hate us00:08
mriedemshould have a presentation about how the summit scheduling is like the nova scheduler00:08
mriedemretries aplenty00:08
jaypipesheh, yeah :(00:09
*** ijw has quit IRC00:10
*** ijw has joined #openstack-nova00:10
*** dimtruck is now known as zz_dimtruck00:12
*** ijw has quit IRC00:15
*** haplo37_ has joined #openstack-nova00:16
*** zz_dimtruck is now known as dimtruck00:19
jaypipesefried: sorry for delay. finally done with review on your service cat patch.00:22
*** mtanino__ has joined #openstack-nova00:22
jaypipesefried: and now it's beer thirty I'm afraid :)00:23
jaypipesciao all.00:23
*** jaypipes has quit IRC00:23
*** nic has quit IRC00:29
*** iceyao has joined #openstack-nova00:32
*** Sukhdev has quit IRC00:33
*** iceyao has quit IRC00:36
*** owalsh_ has joined #openstack-nova00:39
*** owalsh has quit IRC00:41
*** nicolasbock has joined #openstack-nova00:41
*** ioni has quit IRC00:44
*** ioni has joined #openstack-nova00:45
*** mariusv has quit IRC00:45
*** ioni is now known as Guest3364500:45
*** mariusv has joined #openstack-nova00:47
*** mariusv has quit IRC00:47
*** mariusv has joined #openstack-nova00:47
*** tovin07_ has joined #openstack-nova00:47
*** Apoorva_ has joined #openstack-nova00:49
*** Apoorva_ has quit IRC00:49
*** Apoorva_ has joined #openstack-nova00:50
*** Apoorva_ has quit IRC00:52
*** Apoorva has quit IRC00:52
*** iceyao has joined #openstack-nova00:53
openstackgerritTakashi NATSUME proposed openstack/nova master: api-ref: Example verification for servers-actions.inc  https://review.openstack.org/45456500:55
*** MasterOfBugs has quit IRC00:59
*** Tahvok_ has joined #openstack-nova01:00
*** haukebruno has quit IRC01:00
*** keekz has quit IRC01:00
*** Tahvok has quit IRC01:00
*** dmellado has quit IRC01:00
*** ejat has quit IRC01:00
*** aunnam has quit IRC01:00
*** shaner has quit IRC01:00
*** Tahvok_ is now known as Tahvok01:00
*** keekz has joined #openstack-nova01:00
*** jlvillal has quit IRC01:01
*** ejat has joined #openstack-nova01:01
*** ejat has quit IRC01:01
*** ejat has joined #openstack-nova01:01
*** shaner has joined #openstack-nova01:01
*** vladikr has joined #openstack-nova01:01
*** haukebruno has joined #openstack-nova01:01
*** aunnam has joined #openstack-nova01:02
*** dmellado has joined #openstack-nova01:02
*** kevinz has joined #openstack-nova01:02
openstackgerritArtom Lifshitz proposed openstack/nova master: Plumbing for tagged nic attachment  https://review.openstack.org/41562201:03
openstackgerritArtom Lifshitz proposed openstack/nova master: Delete nic metadata when detaching interface  https://review.openstack.org/43538701:03
openstackgerritArtom Lifshitz proposed openstack/nova master: Libvirt support for tagged volume attachment  https://review.openstack.org/41810001:03
*** phuongnh has joined #openstack-nova01:03
openstackgerritArtom Lifshitz proposed openstack/nova master: Delete disk metadata when detaching volume  https://review.openstack.org/43508201:03
openstackgerritArtom Lifshitz proposed openstack/nova master: Plumbing for tagged volume attachment  https://review.openstack.org/39194101:04
openstackgerritArtom Lifshitz proposed openstack/nova master: API support for tagged device attachment  https://review.openstack.org/37602101:04
openstackgerritArtom Lifshitz proposed openstack/nova master: Libvirt support for tagged nic attachment  https://review.openstack.org/41552001:04
*** tbachman has quit IRC01:04
*** oomichi has quit IRC01:05
*** dixiaoli has joined #openstack-nova01:05
*** jlvillal has joined #openstack-nova01:06
*** oomichi has joined #openstack-nova01:07
*** gjayavelu has quit IRC01:07
*** cNilesh has joined #openstack-nova01:12
*** migi has quit IRC01:14
*** shaner has quit IRC01:14
*** migi has joined #openstack-nova01:14
*** migi has quit IRC01:14
*** migi has joined #openstack-nova01:14
*** tjones has joined #openstack-nova01:14
*** shaner has joined #openstack-nova01:14
*** rfolco has quit IRC01:17
*** edmondsw has joined #openstack-nova01:18
*** tjones has quit IRC01:19
*** edmondsw has quit IRC01:23
openstackgerritfengzhr proposed openstack/nova master: Modify the description of flat_injected in nova.conf  https://review.openstack.org/45878901:24
openstackgerritMatt Riedemann proposed openstack/python-novaclient master: 2.45: createImage/createBackup image_id is in response body  https://review.openstack.org/45700801:27
openstackgerritMatt Riedemann proposed openstack/python-novaclient master: 2.44: Deprecate multinic/floatingIP actions and os-virtual-interfaces  https://review.openstack.org/45985901:27
*** mriedem has quit IRC01:28
*** haukebruno has quit IRC01:29
*** thorst_afk has joined #openstack-nova01:30
*** tjones has joined #openstack-nova01:31
*** ijw has joined #openstack-nova01:32
*** haukebruno has joined #openstack-nova01:34
*** kaisers_ has quit IRC01:37
*** baoli has quit IRC01:42
*** ijw has quit IRC01:47
*** coreywright has quit IRC01:47
*** winston-d_ has joined #openstack-nova01:49
*** hongbin has joined #openstack-nova01:53
*** crushil has joined #openstack-nova01:56
*** fragatin_ has quit IRC01:57
*** fragatina has joined #openstack-nova01:58
*** browne has quit IRC02:01
*** thorst_afk has quit IRC02:05
*** MasterOfBugs has joined #openstack-nova02:05
*** coreywright has joined #openstack-nova02:06
*** gjayavelu has joined #openstack-nova02:07
*** snikitin_ has quit IRC02:10
*** snikitin_ has joined #openstack-nova02:11
*** baoli has joined #openstack-nova02:13
*** READ10 has quit IRC02:13
*** yamahata_ has quit IRC02:15
*** imacdonn has quit IRC02:16
*** imacdonn has joined #openstack-nova02:17
*** sree has joined #openstack-nova02:21
openstackgerritSteven Webster proposed openstack/nova master: Race condition between audit and migrate/resize revert  https://review.openstack.org/40099502:25
*** sree has quit IRC02:26
*** zhanghoonoh has joined #openstack-nova02:26
*** tuanluong has joined #openstack-nova02:28
*** gjayavelu has quit IRC02:29
*** mdnadeem has joined #openstack-nova02:30
*** zhurong has joined #openstack-nova02:33
*** ijw_ has joined #openstack-nova02:33
*** arunman has joined #openstack-nova02:35
*** ijw_ has quit IRC02:37
*** nicolasbock has quit IRC02:41
*** brault has joined #openstack-nova02:42
*** adrian_otto has joined #openstack-nova02:45
*** brault has quit IRC02:46
*** baoli has quit IRC02:47
*** takashin has quit IRC02:47
*** baoli has joined #openstack-nova02:47
*** takashin has joined #openstack-nova02:49
*** baoli has quit IRC02:49
*** gcb has joined #openstack-nova02:55
*** arunman has quit IRC02:57
*** bkopilov_ has quit IRC02:57
*** bkopilov has quit IRC02:57
*** ssurana has joined #openstack-nova02:58
*** Srinu has left #openstack-nova02:59
*** yamahata_ has joined #openstack-nova03:01
openstackgerritHuan Xie proposed openstack/nova master: WIP: XenAPI use os-xenapi v2 in nova  https://review.openstack.org/45349303:01
openstackgerritZhenyu Zheng proposed openstack/nova master: Send out notifications when instance tags changed  https://review.openstack.org/45992303:02
*** ssurana has quit IRC03:03
*** thorst_afk has joined #openstack-nova03:06
*** adrian_otto has quit IRC03:09
*** thorst_afk has quit IRC03:10
*** zhurong has quit IRC03:15
*** dimtruck is now known as zz_dimtruck03:17
*** psachin has joined #openstack-nova03:21
*** vks1 has joined #openstack-nova03:26
*** amotoki has joined #openstack-nova03:27
*** tjones has left #openstack-nova03:27
*** mtanino__ has quit IRC03:28
openstackgerritTakashi NATSUME proposed openstack/nova master: Enable cold migration with target host(1/2)  https://review.openstack.org/40895503:30
*** thorst_afk has joined #openstack-nova03:37
*** salv-orlando has joined #openstack-nova03:38
*** salv-orlando has quit IRC03:43
*** liverpooler has quit IRC03:43
*** kaisers has joined #openstack-nova03:46
openstackgerritZhenyu Zheng proposed openstack/nova master: Support tag instances when boot(1)  https://review.openstack.org/45952303:52
*** amotoki has quit IRC03:54
*** trinaths has joined #openstack-nova03:56
*** faizy has joined #openstack-nova03:59
*** thorst_afk has quit IRC04:00
*** faizy_ has quit IRC04:02
*** gouthamr has quit IRC04:02
*** karthiks has joined #openstack-nova04:04
*** david-lyle has quit IRC04:05
*** david-lyle_ has joined #openstack-nova04:05
*** iceyao has quit IRC04:05
*** MikeG451 has quit IRC04:09
*** syjulian has quit IRC04:10
*** amotoki has joined #openstack-nova04:10
*** david-lyle_ is now known as david-lyle04:12
*** iceyao has joined #openstack-nova04:13
*** mdnadeem has quit IRC04:13
*** amotoki has quit IRC04:15
openstackgerritTakashi NATSUME proposed openstack/nova master: Enable cold migration with target host(2/2)  https://review.openstack.org/40896404:16
*** iceyao has quit IRC04:18
*** amotoki has joined #openstack-nova04:20
*** psachin has quit IRC04:21
*** fragatin_ has joined #openstack-nova04:22
*** psachin has joined #openstack-nova04:23
*** fragatina has quit IRC04:26
*** fragatin_ has quit IRC04:27
*** tuanluong_ has joined #openstack-nova04:28
openstackgerritTakashi NATSUME proposed openstack/nova master: api-ref: Add parameters in cold migrate action  https://review.openstack.org/41004204:31
*** tuanluong has quit IRC04:32
*** bkopilov has joined #openstack-nova04:33
*** bkopilov_ has joined #openstack-nova04:33
*** tuanluong__ has joined #openstack-nova04:34
*** abhi89 has joined #openstack-nova04:38
*** tuanluong_ has quit IRC04:38
*** salv-orlando has joined #openstack-nova04:39
*** adisky_ has joined #openstack-nova04:40
*** xinliang has quit IRC04:40
*** abhi89 has quit IRC04:41
*** iceyao has joined #openstack-nova04:41
*** salv-orlando has quit IRC04:44
*** ayogi has joined #openstack-nova04:44
*** hongbin has quit IRC04:44
*** fragatina has joined #openstack-nova04:45
*** fragatina has quit IRC04:45
*** gongysh has joined #openstack-nova04:46
*** fragatina has joined #openstack-nova04:46
*** gongysh has quit IRC04:49
*** amotoki has quit IRC04:49
openstackgerritTakashi NATSUME proposed openstack/nova master: Add functional tests for cold migration to same host  https://review.openstack.org/41492604:51
*** xinliang has joined #openstack-nova04:53
*** xinliang has joined #openstack-nova04:53
*** faizy has quit IRC04:54
*** tuanluong has joined #openstack-nova04:55
*** edmondsw has joined #openstack-nova04:55
openstackgerritjichenjc proposed openstack/python-novaclient master: Remove 1.1 extension comment  https://review.openstack.org/45950304:56
*** ratailor has joined #openstack-nova04:57
*** thorst_afk has joined #openstack-nova04:57
*** sree has joined #openstack-nova04:57
*** tuanluong_ has joined #openstack-nova04:57
*** amotoki has joined #openstack-nova04:58
*** tuanluong__ has quit IRC04:58
*** jdurgin has quit IRC04:59
*** edmondsw has quit IRC04:59
*** tuanluong has quit IRC05:00
*** syjulian has joined #openstack-nova05:00
*** slaweq has joined #openstack-nova05:01
openstackgerritjichenjc proposed openstack/nova master: Use plain routes list for limits endpoint instead of stevedore  https://review.openstack.org/45880505:01
*** ratailor has quit IRC05:01
*** ratailor has joined #openstack-nova05:01
*** thorst_afk has quit IRC05:02
openstackgerritjichenjc proposed openstack/nova master: Use plain routes list for hosts endpoint instead of stevedore  https://review.openstack.org/45923105:02
*** slaweq has quit IRC05:02
openstackgerritjichenjc proposed openstack/nova master: use plain routes list for hypervisor endpoint instead of stevedore  https://review.openstack.org/45923505:02
*** ssurana has joined #openstack-nova05:02
*** dikonoor has joined #openstack-nova05:02
*** claudiub has joined #openstack-nova05:03
*** MikeG451 has joined #openstack-nova05:04
*** zhurong has joined #openstack-nova05:07
*** mdnadeem has joined #openstack-nova05:10
*** iceyao has quit IRC05:14
*** salv-orlando has joined #openstack-nova05:16
*** hshiina has joined #openstack-nova05:16
*** trinaths1 has joined #openstack-nova05:19
*** arunman has joined #openstack-nova05:20
*** trinaths has quit IRC05:21
*** udesale has joined #openstack-nova05:22
*** slaweq has joined #openstack-nova05:26
*** darrenc has quit IRC05:28
*** slaweq has quit IRC05:28
*** darrenc has joined #openstack-nova05:28
*** sree has quit IRC05:31
*** iceyao has joined #openstack-nova05:33
*** yangyape_ has joined #openstack-nova05:35
*** ekuris has joined #openstack-nova05:36
*** gouthamr has joined #openstack-nova05:36
*** nkorabli has joined #openstack-nova05:37
*** iceyao has quit IRC05:37
*** diga has joined #openstack-nova05:39
openstackgerritjichenjc proposed openstack/nova master: Remove all discoverable policy rules  https://review.openstack.org/45960805:40
*** sree has joined #openstack-nova05:40
*** prateek has joined #openstack-nova05:46
*** adrian_otto has joined #openstack-nova05:48
*** zhurong has quit IRC05:52
openstackgerritTakashi NATSUME proposed openstack/python-novaclient master: Microversion 2.46 - Enable cold migration with target host  https://review.openstack.org/40670705:55
*** karthiks has quit IRC05:56
*** thorst_afk has joined #openstack-nova05:58
*** ecelik has joined #openstack-nova05:58
*** dixiaoli_ has joined #openstack-nova05:59
*** dixiaoli_ has quit IRC06:00
*** dixiaoli has quit IRC06:00
*** ecelik has left #openstack-nova06:01
*** dixiaoli has joined #openstack-nova06:01
*** thorst_afk has quit IRC06:02
*** yingjun has joined #openstack-nova06:02
*** sridharg has joined #openstack-nova06:03
*** karthiks has joined #openstack-nova06:07
*** iceyao has joined #openstack-nova06:09
*** Oku_OS-away is now known as Oku_OS06:11
openstackgerritHuan Xie proposed openstack/nova master: WIP: XenAPI use os-xenapi v2 in nova  https://review.openstack.org/45349306:12
*** udesale__ has joined #openstack-nova06:12
*** udesale has quit IRC06:15
*** chenying_ has quit IRC06:16
*** chenying_ has joined #openstack-nova06:16
*** ratailor_ has joined #openstack-nova06:21
openstackgerritTakashi NATSUME proposed openstack/nova master: List/show all server migration types (1/2)  https://review.openstack.org/43060806:22
*** sridhargaddam has joined #openstack-nova06:24
*** sridhargaddam has quit IRC06:24
*** ltomasbo|away is now known as ltomasbo06:24
*** andreas_s has joined #openstack-nova06:24
*** ratailor has quit IRC06:24
*** zhurong has joined #openstack-nova06:25
*** sridharg has quit IRC06:25
*** moshele has joined #openstack-nova06:28
*** amotoki has quit IRC06:30
*** amotoki has joined #openstack-nova06:31
*** armax has quit IRC06:33
*** zhurong has quit IRC06:33
*** ygl has joined #openstack-nova06:36
*** ijw has joined #openstack-nova06:36
*** crushil has quit IRC06:38
*** ijw has quit IRC06:40
*** amotoki has quit IRC06:47
*** kiwi_rot has joined #openstack-nova06:52
openstackgerritAlex Xu proposed openstack/python-novaclient master: 2.44: Deprecate multinic, add/remove_floatingip, virtual_interfaces  https://review.openstack.org/45996606:55
*** udesale has joined #openstack-nova06:58
*** thorst_afk has joined #openstack-nova06:59
*** udesale__ has quit IRC06:59
*** MasterOfBugs has quit IRC07:00
openstackgerritTakashi NATSUME proposed openstack/nova master: List/show all server migration types (2/2)  https://review.openstack.org/45948307:01
*** owalsh_ is now known as owalsh07:02
*** thorst_afk has quit IRC07:03
*** tesseract has joined #openstack-nova07:04
*** udesale__ has joined #openstack-nova07:05
*** Guest33645 is now known as ioni07:06
*** ioni has quit IRC07:06
*** ioni has joined #openstack-nova07:06
*** _RuiChen has joined #openstack-nova07:08
*** udesale has quit IRC07:08
*** voelzmo has joined #openstack-nova07:13
openstackgerritTakashi NATSUME proposed openstack/python-novaclient master: Microversion 2.46 - List/Show all server migration types  https://review.openstack.org/43083907:15
*** pcaruana has joined #openstack-nova07:19
*** edmondsw has joined #openstack-nova07:20
*** Kevin_Zheng has joined #openstack-nova07:21
*** Drankis has joined #openstack-nova07:22
openstackgerritZhenyu Zheng proposed openstack/nova master: Support tag instances when boot(2/4)  https://review.openstack.org/45956907:24
*** edmondsw has quit IRC07:24
*** Shunli has joined #openstack-nova07:24
*** zhurong has joined #openstack-nova07:27
*** adrian_otto has quit IRC07:31
openstackgerritTakashi NATSUME proposed openstack/nova-specs master: Abort Cold Migration  https://review.openstack.org/33473207:34
openstackgerritTakashi NATSUME proposed openstack/nova-specs master: Specify keymap on server boot  https://review.openstack.org/44883007:34
*** ralonsoh has joined #openstack-nova07:36
*** ygl has quit IRC07:37
*** jpena|off is now known as jpena07:38
openstackgerritfalseuser proposed openstack/nova master: [BugFix] Check the instance task status to release the memory quota for vram  https://review.openstack.org/45605007:39
openstackgerritZhenyu Zheng proposed openstack/nova master: Support tag instances when boot(3/4)  https://review.openstack.org/45959307:39
*** efoley has joined #openstack-nova07:39
openstackgerritDaniel Pawlik proposed openstack/nova master: Added kvm_hidden feature  https://review.openstack.org/45975307:42
*** damien_r has joined #openstack-nova07:42
openstackgerritAlex Xu proposed openstack/nova master: Use plain routes list for os-interface endpoint instead of stevedore  https://review.openstack.org/45997907:44
*** abalutoiu_ has quit IRC07:47
*** gouthamr has quit IRC07:47
*** voelzmo has quit IRC07:47
*** voelzmo_ has joined #openstack-nova07:50
openstackgerritfengzhr proposed openstack/nova master: Modify the description of flat_injected in nova.conf  https://review.openstack.org/45878907:50
*** brault has joined #openstack-nova07:55
*** amotoki has joined #openstack-nova07:58
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-nova08:00
*** thorst_afk has joined #openstack-nova08:00
*** voelzmo_ has quit IRC08:03
*** sree has quit IRC08:03
*** abalutoiu has joined #openstack-nova08:05
*** udesale has joined #openstack-nova08:06
*** takashin has left #openstack-nova08:07
*** udesale__ has quit IRC08:08
*** voelzmo has joined #openstack-nova08:08
*** zhurong has quit IRC08:08
*** lucas-afk is now known as lucasagomes08:10
*** ekuris has quit IRC08:11
*** ekuris has joined #openstack-nova08:11
*** voelzmo has quit IRC08:17
*** tovin07 has quit IRC08:17
*** mvk has quit IRC08:18
*** thorst_afk has quit IRC08:19
*** voelzmo has joined #openstack-nova08:21
*** brault_ has joined #openstack-nova08:22
*** brault has quit IRC08:25
*** jaosorior_away is now known as jaosorior08:28
*** priteau has joined #openstack-nova08:29
*** sree has joined #openstack-nova08:33
*** ratailor__ has joined #openstack-nova08:36
*** derekh has joined #openstack-nova08:36
*** ratailor_ has quit IRC08:36
*** ssurana has quit IRC08:42
*** efoley has quit IRC08:46
lyarwoodsfinucan: morning, would you mind taking a look at https://review.openstack.org/#/c/458807/ this morning? It's the actual bugfix in the series you started reviewing yesterday.08:49
*** _RuiChen has quit IRC08:49
*** lpetrut has joined #openstack-nova08:53
*** gszasz has joined #openstack-nova08:54
*** ratailor_ has joined #openstack-nova08:57
*** ratailor__ has quit IRC09:00
*** mvk has joined #openstack-nova09:00
*** sambetts|afk is now known as sambetts09:00
asettleAh, my second home, the nova channel....09:08
asettlebauzas: we've got a fix for those placement vs. port numbers https://review.openstack.org/#/c/459903/ if you have time to look09:09
asettleI can't see cdent in yet09:09
openstackgerritJohn Garbutt proposed openstack/nova master: Remove all discoverable policy rules  https://review.openstack.org/45960809:11
johnthetubaguyasettle: he was up late with TC stuff09:11
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in floating_ip files  https://review.openstack.org/45979109:11
asettlejohnthetubaguy: ahuh! makes sense :)09:12
johnthetubaguyI followed through on my election promise of not attending the meeting... I was in a pub talking about openstack, so didn't make the best use of my time as such09:13
*** ratailor_ has quit IRC09:14
openstackgerritfalseuser proposed openstack/nova master: [BugFix] Check the instance task status to release the memory quota for vram  https://review.openstack.org/45605009:14
*** ratailor_ has joined #openstack-nova09:15
asettlejohnthetubaguy: at least you tried :P09:17
openstackgerritGábor Antal proposed openstack/nova master: Transform instance.volume_attach notification  https://review.openstack.org/40199209:17
* johnthetubaguy nods09:17
openstackgerritGábor Antal proposed openstack/nova master: Transform instance.volume_detach notification  https://review.openstack.org/40867609:19
*** dixiaoli has quit IRC09:19
openstackgerritGábor Antal proposed openstack/nova master: Transform instance.volume_attach.error notification  https://review.openstack.org/45580109:19
*** cdent has joined #openstack-nova09:20
openstackgerritRitesh proposed openstack/nova master: rbd: flatten images when unshelving  https://review.openstack.org/45788609:20
openstackgerritZhenyu Zheng proposed openstack/nova master: Support tag instances when boot(2/4)  https://review.openstack.org/45956909:20
*** yamahata_ has quit IRC09:21
*** zhurong has joined #openstack-nova09:22
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in floating_ip files  https://review.openstack.org/45979109:22
bauzasasettle: morning, sorry was in $meeting09:24
*** sree has quit IRC09:25
*** dixiaoli has joined #openstack-nova09:25
asettleHow dare you work!09:25
asettleI have patches!09:25
asettle:p09:25
bauzasasettle: you know that port 8778 clashes with some other openstack project?09:25
bauzasin devstack I mean09:25
*** sree has joined #openstack-nova09:25
asettlebauzas: I did not. Which I guess is why I'm asking you guys to review :/09:25
asettleOh no. What does it clash with?09:25
bauzasasettle: sec, giving you the ML thread09:26
*** zsli_ has joined #openstack-nova09:26
*** sree has quit IRC09:26
bauzasasettle: long thread, enjoy the read http://lists.openstack.org/pipermail/openstack-dev/2016-December/109219.html09:26
bauzasasettle: tl;dr: senlin was gating on this port09:26
asettleGosh, my morning just got so much more exciting09:26
bauzasasettle: so we changed the placement devstack module to not use a port09:26
bauzasasettle: but given some operators already looked at the previous version, they began to use this port09:27
asettleRight. Right.09:27
asettleThat's. Not great.09:27
asettle*head desk*09:27
asettleSo what port *do* you guys use now?09:27
bauzasasettle: most of them are saying it's fine because they don't use Senlin09:27
asettleYes, right.09:27
asettleBut we can't have htat in the official docs.09:27
*** zsli__ has joined #openstack-nova09:27
bauzasasettle: in devstack, we don't use a port09:27
bauzaswe use the httpd virtualhost config09:28
bauzasasettle: https://github.com/openstack-dev/devstack/blob/master/files/apache-placement-api.template09:28
*** Shunli has quit IRC09:29
bauzasasettle: unfortunately, some operators didn't changed that09:29
bauzas(yet)09:29
*** zsli_ has quit IRC09:30
* asettle watches the car crash09:30
*** Shunli has joined #openstack-nova09:30
asettleHonest to god the more i learn each morning about this the more I want to pretend I don't know :P09:30
asettleOkay.09:30
asettleThanks for hte contenxt bauzas :)09:30
asettlecontext*09:30
*** zsli_ has joined #openstack-nova09:32
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in floating_ip files  https://review.openstack.org/45979109:32
*** zsli__ has quit IRC09:32
*** ratailor_ has quit IRC09:33
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in migrations.py  https://review.openstack.org/45972709:34
*** ratailor_ has joined #openstack-nova09:34
*** hferenc has quit IRC09:34
*** ratailor_ has quit IRC09:35
*** Shunli has quit IRC09:35
*** ratailor has joined #openstack-nova09:35
*** hferenc has joined #openstack-nova09:35
bauzasasettle: so, about documentation, I don't know what to say09:36
johnthetubaguyasettle: the wider context, is we get everyone off ports as we get all the APIs onto apache, I think09:36
bauzasasettle: because some use that port09:37
bauzasasettle: some are not09:37
*** zhurong has quit IRC09:37
sfinucanlyarwood: on it09:37
johnthetubaguybauzas: its tempting to say, find URL that your placement API is hosted on, and add it in here09:37
bauzasjohnthetubaguy: yup, it's definitely a config09:37
asettleI think what we might have to do is write a very big IMPORTANT note that reminds people you can use that port, but do not use it if you intend to use Senlin. Whihc is really messy but I"m not seeing too many ways around it, to be honest. Using the placement is *not* working, we can't argue that right now.09:37
asettleWe need to have some working documentation.09:37
lyarwoodsfinucan: cheers09:37
bauzasjohnthetubaguy: but unfortunately, that depends on distros09:38
bauzasasettle: deployers don't have choices, it's untrue to tell them that09:38
johnthetubaguybauzas: right, thats what I mean by find the URL09:38
johnthetubaguywe can give its usually this or this, etc09:38
bauzasasettle: it's rather, deployers need to know the related option depending on their distro09:39
asettleOkay. So how do we communicate that in a short, concise, documented, step?09:39
bauzas(at least until all distros move to a non-port URL)09:39
bauzasasettle: the main question is, how deployers can discover that ?09:40
bauzasI'd be tempted to say all distros use httpd09:40
bauzasso we could say to deployers to look at the /etc/httpd/ path09:40
*** dixiaoli_ has joined #openstack-nova09:40
bauzas either sites.de or sites-enabled depending on the OS09:41
bauzasor grep something in /etc/{httpd|apache}09:41
*** dixiaoli_ has quit IRC09:42
*** zsli_ has quit IRC09:42
bauzaseither way, the idea is to find the placement virtualhost configuration09:42
bauzas*if they use httpd*09:42
bauzasbecause if they use nginx+uswsgi, then it's totally different09:42
johnthetubaguyso these docs are for specific packages right?09:43
johnthetubaguycan't we just find out that answer09:44
*** dixiaoli has quit IRC09:44
*** sridharg has joined #openstack-nova09:44
*** haplo37 has quit IRC09:47
bauzasjohnthetubaguy: the other problem is that it's unrelated to packages :p09:49
*** salv-orl_ has joined #openstack-nova09:49
johnthetubaguybauzas: I thought the packages installed the apache conf?09:50
bauzasjohnthetubaguy: unfortunately no, because TripleO wipes that packaged conf and provides its own09:50
openstackgerritBalazs Gibizer proposed openstack/nova master: Add BDM to InstancePayload  https://review.openstack.org/44877909:50
openstackgerritBalazs Gibizer proposed openstack/nova master: Add keypairs field to InstancePayload  https://review.openstack.org/41973009:50
johnthetubaguyit can be overriden, for sure, but I thought they general added one09:50
johnthetubaguyif not, our guide should tell them how to set that up09:51
johnthetubaguyso we just need the URL to match the guide, and its easier?09:51
bauzasjohnthetubaguy: in other words, openstack-nova in RDO uses port 8778 AFAIK but if you puppet-nova on top of it, it will use /placement09:51
johnthetubaguysure, thats fine09:51
openstackgerritGábor Antal proposed openstack/nova master: Transform instance.soft_delete notifications  https://review.openstack.org/46002909:51
johnthetubaguythis is about using RDO packages manually, so seems like 8778 is the correct answer09:51
johnthetubaguynow a warning say, there be dragons here if you change the package defaults is a good idea09:52
*** salv-orlando has quit IRC09:52
bauzasjohnthetubaguy: this is fine, you mean ? http://imgur.com/c4jt321 :D09:52
johnthetubaguyso the guide is about using the packages manaully09:52
johnthetubaguyif you don't do that, the guide will be very wrong in many ways09:53
bauzasgood point09:53
bauzasI'm not that seasoned with docs09:53
bauzasalthough I patched docs in 2013 :p09:53
bauzasbut IIRC, it was far less complicated, either you deployed with Ubuntu or Fedora09:54
*** salv-orl_ has quit IRC09:55
*** salv-orlando has joined #openstack-nova09:55
*** sdague has joined #openstack-nova09:55
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in floating_ip files  https://review.openstack.org/45979109:55
bauzasjohnthetubaguy: asettle: so I guess if it's that simple, we should just have variable doc depending on which distro they use nope?09:55
johnthetubaguyalex_xu: cool, glad we got that deprecation sorted, makes those docs much simpler ^09:56
asettlebauzas: the variables are easy. We can manage that. We already do. So. Yep?09:56
johnthetubaguybauzas: thats what we do09:56
bauzasasettle: could we then just try to have that reviewed by most of the distros ?09:56
bauzasand having endpoints different between them ?09:56
*** haplo37 has joined #openstack-nova09:56
bauzasidk, just seems to me the easiest solution09:57
*** bkopilov_ has quit IRC09:57
*** bkopilov_ has joined #openstack-nova09:57
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in migrate_server.py  https://review.openstack.org/45971109:58
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in migrate_server.py  https://review.openstack.org/45971109:58
*** lpetrut_ has joined #openstack-nova09:58
*** yingjun has quit IRC10:00
*** slunkad has quit IRC10:00
*** lpetrut has quit IRC10:01
cdentasettle, bauzas, johnthetubaguy did you resolve the above discussion satisfactorily? I tend to agree with johnthetubaguy: make the docs match the packages and leave it at that (for now)10:04
asettlecdent: uh not quite. I think bauzas lost me with his last comments.10:04
*** slunkad has joined #openstack-nova10:04
*** tbachman has joined #openstack-nova10:06
*** tovin07_ has quit IRC10:06
*** yangyape_ has quit IRC10:11
*** yangyapeng has joined #openstack-nova10:11
Dinesh_Bhorjohnthetubaguy, sfinucan: Hi, if you get time then please take a look at it: https://review.openstack.org/#/c/457890/10:11
openstackgerritZhenyu Zheng proposed openstack/nova master: Support tag instances when boot(2/4)  https://review.openstack.org/45956910:12
*** efoley has joined #openstack-nova10:12
*** nkorabli has quit IRC10:13
*** nkorabli has joined #openstack-nova10:14
*** tuanluong_ has quit IRC10:15
*** yangyapeng has quit IRC10:15
openstackgerritGábor Antal proposed openstack/nova master: Transform instance.soft_delete notifications  https://review.openstack.org/46002910:15
*** thorst_afk has joined #openstack-nova10:16
*** sree has joined #openstack-nova10:17
*** nkorabli has quit IRC10:18
*** iceyao has quit IRC10:18
*** thorst_afk has quit IRC10:21
*** sree has quit IRC10:21
*** brault_ has quit IRC10:22
sfinucanDinesh_Bhor: I'd seen that but I'm not 100% sure if we can do it. Comments now left saying as much10:22
Dinesh_Bhorsfinucan: ok, will wait for others to take a look at it. thanks you so much10:26
*** slaweq has joined #openstack-nova10:29
*** gszasz has quit IRC10:31
*** ratailor has quit IRC10:31
*** nicolasbock has joined #openstack-nova10:32
*** moshele has quit IRC10:33
*** iceyao has joined #openstack-nova10:33
*** slaweq has quit IRC10:34
*** syjulian has quit IRC10:36
*** iceyao has quit IRC10:38
*** MikeG451 has quit IRC10:38
*** hferenc has quit IRC10:38
cdentjohnthetubaguy: if you're willing and able this looks good to go: https://review.openstack.org/#/c/455710/10:41
cdentor alex_xu10:41
*** udesale has quit IRC10:42
*** ratailor has joined #openstack-nova10:44
*** salv-orl_ has joined #openstack-nova10:48
cdentthanks sdague, you're up early10:49
*** salv-orlando has quit IRC10:51
*** salv-orl_ has quit IRC10:52
sdaguecdent: not that early :)10:53
cdentanything before noon is early to me10:53
sdaguecdent: I just went through the devstack nova wsgi patch about what the transition plan needs to be10:53
cdentit's a bit messy...10:54
openstackgerritAlex Szarka proposed openstack/nova master: Transform instance-exists notification  https://review.openstack.org/40366010:56
*** lucasagomes is now known as lucas-hungry10:58
openstackgerritAlex Szarka proposed openstack/nova master: Transform instance.exists notification  https://review.openstack.org/40366010:58
cdenti'll need to digest that sdague, I was thinking it might be possible to have grenade from-ocata to switch to uwsgi hosting the api, but I guess there's stuff that's relying on the URL for the API saying the same?10:58
*** iceyao has joined #openstack-nova10:59
cdentanother way to achieve the same thing would be to run uwsgi, but on a port (when in grenade)10:59
cdent(as I've done for the metadata service)10:59
sdaguecdent: so in every transition we made here before we've left the configuration the same, we've not modeled a transition between 2 different service modes11:00
*** phuongnh has quit IRC11:00
*** gszasz has joined #openstack-nova11:00
sdaguebecause I think that's really a post upgrade decision. Get onto the new code, then transition from one run mode to the other.11:00
*** moshele has joined #openstack-nova11:02
cdentyeah, I've never understood that because that means two events that are effectively upgrades. If I were deploying I'd change both at the same time (assuming some out of band testing beforehand)11:02
*** bkopilov has quit IRC11:02
*** bkopilov_ has quit IRC11:03
*** zhanghoonoh has quit IRC11:05
sdaguecdent: I wouldn't. I would validate the same configuration path worked as before before changing that out.11:07
cdentdifferent strokes. but that's fine. I'll have to stick a lot of stuff back into lib/nova, but that's also fine.11:08
*** nkorabli has joined #openstack-nova11:10
*** gszasz has quit IRC11:10
*** brault has joined #openstack-nova11:10
*** gszasz has joined #openstack-nova11:10
*** smatzek has joined #openstack-nova11:12
*** MikeG451 has joined #openstack-nova11:13
*** smatzek_ has joined #openstack-nova11:13
*** thorst_afk has joined #openstack-nova11:17
*** smatzek has quit IRC11:18
*** Guest85363 has quit IRC11:20
*** jaypipes has joined #openstack-nova11:22
jaypipes*yawn*11:23
jaypipesmorning.11:23
ralonsohjaypipes: good morning. Flash question: https://review.openstack.org/#/c/451777/6/nova/objects/pci_device_pool.py11:24
*** trinaths1 has left #openstack-nova11:24
ralonsohjaypipes: do we need to bump the version of an object if the parent is updated?11:24
jaypipesralonsoh: no11:24
ralonsohthanks11:24
jaypipesralonsoh: flash answer :)11:25
ralonsohthat's all, enjoy your coffee11:25
jaypipeshehe11:25
*** cNilesh has quit IRC11:25
*** thorst_afk has quit IRC11:25
*** nkorabli has quit IRC11:26
*** nkorabli has joined #openstack-nova11:27
*** syjulian has joined #openstack-nova11:34
*** gszasz has quit IRC11:36
*** thorst_afk has joined #openstack-nova11:39
jaypipesmoshele: mornin. just approved the hw-tc-offload os-vif patch. excellent work on that.11:41
*** rfolco has joined #openstack-nova11:42
moshelejaypipes: thanks :)11:42
*** cdent has quit IRC11:45
*** efoley has quit IRC11:48
*** hferenc has joined #openstack-nova11:49
*** ratailor has quit IRC11:49
*** ratailor has joined #openstack-nova11:50
*** gszasz has joined #openstack-nova11:51
*** yingjun has joined #openstack-nova11:54
*** cdent has joined #openstack-nova11:58
*** vks1 has quit IRC11:59
*** vks1 has joined #openstack-nova11:59
*** karthiks has quit IRC12:03
*** sree has joined #openstack-nova12:05
*** diga has quit IRC12:07
*** sree has quit IRC12:10
*** lucas-hungry is now known as lucasagomes12:11
*** arunman has quit IRC12:14
*** efoley has joined #openstack-nova12:19
*** efoley_ has joined #openstack-nova12:21
*** crushil has joined #openstack-nova12:21
*** nkorabli has quit IRC12:21
*** sree has joined #openstack-nova12:21
*** efoley has quit IRC12:24
*** sree has quit IRC12:26
*** edmondsw has joined #openstack-nova12:26
*** ratailor has quit IRC12:28
*** iceyao has quit IRC12:29
*** iceyao has joined #openstack-nova12:30
*** ygl has joined #openstack-nova12:30
*** ygl has left #openstack-nova12:32
*** iceyao has quit IRC12:35
*** iceyao has joined #openstack-nova12:36
*** eglynn has joined #openstack-nova12:38
*** iceyao has quit IRC12:40
*** vks1 has quit IRC12:42
*** yingjun has quit IRC12:44
*** salv-orl_ has joined #openstack-nova12:45
alex_xunova api meeting is in 15 mins at #openstack-meeting-412:45
*** yingjun has joined #openstack-nova12:45
*** lyan has joined #openstack-nova12:45
*** iceyao has joined #openstack-nova12:47
*** bkopilov has joined #openstack-nova12:47
*** bkopilov_ has joined #openstack-nova12:48
*** yangyapeng has joined #openstack-nova12:50
openstackgerritsahid proposed openstack/nova master: numa: fix an uninitialized local variable  https://review.openstack.org/45884812:50
openstackgerritStephen Finucane proposed openstack/os-vif master: Require OVS 2.8 (presumed) and kernel 4.8 for offload  https://review.openstack.org/46009312:52
openstackgerritStephen Finucane proposed openstack/os-vif master: Standardize README  https://review.openstack.org/46009412:52
sfinucanjaypipes. moshele: noddy doc fixes ye should check out ^12:53
*** pchavva has joined #openstack-nova12:53
sfinucansean-k-mooney too ^12:53
johnthetubaguysfinucan: about your comments here, I am just quoting from the api-ref, which seemed the correct thing to do: https://review.openstack.org/#/c/459711/312:53
*** liverpooler has joined #openstack-nova12:54
sfinucanjohnthetubaguy: Yup, I get your reasoning. I'd rather have it "correct" in one place myself but I'm not too worried to hold it up on that12:55
sfinucanthe reno/left over vars were what the hold up was for12:55
johnthetubaguysfinucan: left over vars? I thought that was the other patch12:56
*** ekuris has quit IRC12:56
sfinucanjohnthetubaguy: I might be mixing up patches. Oops12:56
johnthetubaguysfinucan: no worries, I keep doing that too12:56
*** ayogi has quit IRC12:56
johnthetubaguysfinucan: my grammar is fairly terrible, so they all read the same to me, I just don't want to flip flop between different wordings12:57
sfinucanjohnthetubaguy: Hmm, could I be super-nitty and ask you to fix it? :/12:58
sfinucanI can do it too12:58
johnthetubaguysfinucan: I can fix it up, thats fine12:58
johnthetubaguysfinucan: just wanted to be sure thats the way you want it12:58
sfinucanjohnthetubaguy: Ideally, yes :)12:58
sfinucanI tend to write those things in imperative mood, present tense12:58
sfinucanlike a command12:58
*** gcb has quit IRC12:58
sfinucanditto for commit message, fwiw ;)12:58
*** salv-orl_ has quit IRC12:59
alex_xunova api meeting is running13:00
*** baoli has joined #openstack-nova13:00
johnthetubaguysfinucan: yeah, I don't really know the difference really, never got taught any of that, except a small amount in french and german, its kinda frustraighting they culled all that for a few years over here, I should probably go back and read up on all that at some point.13:00
kashyapjohnthetubaguy: Git itself uses the "imperative mood"13:01
openstackgerritStephen Finucane proposed openstack/nova master: Sensibly wrap policy help messages  https://review.openstack.org/46009713:02
kashyapMerge branch 'blah'13:02
sfinucanjohnthetubaguy, sdague: You were asking for this ^13:02
sfinucan?13:02
kashyap(Revert "Foo", etc)13:02
*** yassine has joined #openstack-nova13:02
sfinucanjohnthetubaguy: I don't know where I learnt it, though I'm guessing school13:02
*** yassine is now known as Guest6165613:03
kashyapSpeaking of grammar, /me _just_ gave a "level-3" exam of his 4th language, Dutch13:03
*** cdent has quit IRC13:03
*** winston-d_ has quit IRC13:03
*** awaugama has joined #openstack-nova13:03
kashyapAnd _just_ managed to pass (52% in writing; 71.% marks in speaking)13:03
johnthetubaguysfinucan: yeah, its stuff they brought back in just after I left school, I believe13:03
*** cdent has joined #openstack-nova13:03
*** mriedem has joined #openstack-nova13:03
sfinucanjohnthetubaguy: We did things like cursive writing (? the one where you join letters etc.) in England, but I don't recall them teaching any of that in Ireland :/13:04
*** yangyapeng has quit IRC13:04
mriedemalex_xu: api meeting?13:04
sfinucanMy siblings' writing is absolutely awful13:04
sfinucanmriedem: Yup, openstack-meeting-413:04
mriedemcursive is old news13:04
sfinucankashyap: Congrats, dude :) That's outrageously impressive13:04
johnthetubaguysfinucan: oh, funky, they did a slightly strange course at mine I think, missed out the useful bits!13:05
*** nkorabli has joined #openstack-nova13:05
johnthetubaguysfinucan: I don't remember its name now13:05
* sfinucan only has English to his name, so figures he best get it as damn near perfect as possible13:05
kashyapsfinucan: Duh, that 52% in writing was danglingly close!  The goddmaned thing trips me up is the "inversion" (which is same in Dutch and German)13:05
kashyapE.g: "If I am sick, I go to the doctor", it becomes: "If I am sick, go I to the doctor"13:05
sfinucanjohnthetubaguy: I blame Thatcher13:05
sfinucanAlways blame Thatcher13:06
kashyapsfinucan: But yeah, not complaining; tomorrow night (right after work) starts my level-4 -- "maintain the momentum" :P13:07
sdaguesfinucan: yeh, though is that going to destroy intentional formatting?13:07
sfinucankashyap: It's be "If I sick am", no?13:07
kashyapsfinucan: That, too!13:07
sfinucani.e. Wenn ich krank bin,13:07
sfinucan...13:07
*** mdrabe has joined #openstack-nova13:07
sfinucanyada yada random guttural words13:07
sdagueI feel like we went around in circles here before on oslo.config where force rewrapping is not always the answer13:07
sfinucansdague: It would if we're doing things like bullet points13:08
sdagueyeh13:08
sdaguewhich are often useful13:08
sfinucanbut I didn't spot any of those during my reviews so I _think_ we're good here13:08
sdagueright, yet :)13:08
sdagueyeh, we should be ok for now, but I am sure it will show up as a desire13:09
sfinucanWell, hopefully by time that happens we'll be using the oslo.policy version13:09
sfinucanthen it's their problem13:09
* sfinucan wonders how docutils does that13:09
sdagueso, out of curiosity, what was the key issue with the wrapping? was it losing 2 columns to the comment?13:09
openstackgerritArtom Lifshitz proposed openstack/nova master: Plumbing for tagged nic attachment  https://review.openstack.org/41562213:10
openstackgerritArtom Lifshitz proposed openstack/nova master: Delete nic metadata when detaching interface  https://review.openstack.org/43538713:10
openstackgerritArtom Lifshitz proposed openstack/nova master: Libvirt support for tagged volume attachment  https://review.openstack.org/41810013:10
openstackgerritArtom Lifshitz proposed openstack/nova master: Delete disk metadata when detaching volume  https://review.openstack.org/43508213:10
openstackgerritArtom Lifshitz proposed openstack/nova master: Plumbing for tagged volume attachment  https://review.openstack.org/39194113:10
openstackgerritArtom Lifshitz proposed openstack/nova master: API support for tagged device attachment  https://review.openstack.org/37602113:10
openstackgerritArtom Lifshitz proposed openstack/nova master: Libvirt support for tagged nic attachment  https://review.openstack.org/41552013:10
sfinucanPretty much, yeah13:10
sfinucanand the outputter was presumably doing a dumb, N char wrap13:11
*** ekuris has joined #openstack-nova13:11
sfinucanartom: Anything new in those or simple resolution of that merge conflict13:11
sfinucan?13:11
openstackgerritDaniel Pawlik proposed openstack/nova master: Added kvm_hidden feature  https://review.openstack.org/45975313:11
artomsfinucan, rebase and api version bump because something else took 2.43, 2.44 and 2.4513:15
*** ZZelle has quit IRC13:15
artomdansmith, mriedem, actually, since sfinucan brought it up, can you take a look at that series? Rebasing it with a new API version is a pain, I would greatly appreciate if we could merge before I have to version bump again :)13:16
openstackgerritEric Fried proposed openstack/nova master: PowerVM Driver: console  https://review.openstack.org/40940213:16
*** jamesdenton has joined #openstack-nova13:16
mriedemartom: is the tempest test passing?13:18
artommriedem, well, not right this instant, but yes, I got it to pass by waiting for the default cache expiry duration13:19
*** Drankis has quit IRC13:19
*** tongli has joined #openstack-nova13:20
*** yangyapeng has joined #openstack-nova13:20
sean-k-mooneysfinucan: ya the readme change makes sense to me13:20
sean-k-mooneyi have +2ed the review but ill hold off on the +W untill the gate jobs have run13:21
*** gouthamr has joined #openstack-nova13:22
sean-k-mooneyi want to make sure the embeeded image render corretly but the rst files look fine13:22
sfinucansean-k-mooney: There's an embedded image?13:23
sfinucanoh - the pypi badge13:23
sfinucanCool :)13:23
sean-k-mooneyyep the pypi ones13:23
openstackgerritEric Fried proposed openstack/nova master: PowerVM Driver: SSP emphemeral disk support  https://review.openstack.org/44318913:23
efriedsdague mriedem ^^ trivial (but manual) rebase FYI.13:24
sean-k-mooneysfinucan: wait https://review.openstack.org/#/c/398277/ was merged?13:25
sean-k-mooneyhas the code landed in ovs yet?13:25
sean-k-mooneyif not this should not have been merged13:25
*** yangyapeng has quit IRC13:25
artommriedem, I'll ping you again when I have the latest code passing ;)13:25
sfinucansean-k-mooney: I thought the same thing, hence https://review.openstack.org/#/c/460093/13:25
sfinucanI think we might have jumped the gun a tad bit on that one13:26
sean-k-mooneysfinucan: ya actully thats the review i just saw and was like why are you fixing something thats not merged13:26
sfinucanShould we revert or use the docs to suggest "this might not work"13:27
sean-k-mooneysfinucan: i guess jay didnt see that it was still pending in ovs13:27
sean-k-mooneyi would lean towards revert but lets ask jay and moshe13:28
sfinucanjaypipes, moshele? ^13:28
sean-k-mooneyjaypipes: moshele https://review.openstack.org/#/c/398277/ was merged before the ovs support?13:28
*** zz_dimtruck is now known as dimtruck13:28
*** baoli has quit IRC13:29
*** yingjun has quit IRC13:29
sean-k-mooneyjaypipes: moshele should we revert or merge sfinucan docs change to reflect that this wont work untill support is added to ovs 2.813:29
*** baoli has joined #openstack-nova13:30
sfinucansean-k-mooney: OVS 2.8 _tentative_13:30
*** xyang1 has joined #openstack-nova13:30
sfinucan;)13:30
sean-k-mooneysfinucan: yes im aware which is why i was a little concered that we merged support for something that may or may not be in the next release of ovs13:31
*** slunkad has quit IRC13:32
sean-k-mooneyok got to run to a meeting but ya assuming the bages render correctly the readme change looks good.13:33
openstackgerritMatt Riedemann proposed openstack/python-novaclient master: 2.45: createImage/createBackup image_id is in response body  https://review.openstack.org/45700813:33
*** slunkad has joined #openstack-nova13:34
*** thomasem has left #openstack-nova13:35
*** ratailor has joined #openstack-nova13:35
mriedemalex_xu: we don't use api_versions.wraps on shell commands in https://review.openstack.org/#/c/459496/ or the one after it13:35
*** jaosorior is now known as jaosorior_away13:36
jaypipessean-k-mooney: :( sorry guys, I missed that.13:37
*** yingjun has joined #openstack-nova13:37
jaypipessean-k-mooney: will it be a problem, though, until we cut a new os-vif release?\13:37
*** voelzmo has quit IRC13:37
jaypipessfinucan: ^^13:37
*** smatzek_ has quit IRC13:38
*** priteau has quit IRC13:38
alex_xumriedem: emm...I remember we use that before, for example https://github.com/openstack/python-novaclient/blob/master/novaclient/v2/shell.py#L227913:38
mriedemalex_xu: i think that's just to handle the behavior change, not to indicate deprecation13:39
*** ekuris has quit IRC13:39
*** fragatina has quit IRC13:40
*** fragatina has joined #openstack-nova13:41
*** ratailor_ has joined #openstack-nova13:41
jaypipesdansmith, mriedem: super-friendly reminder on https://review.openstack.org/#/c/457782/ :) others (alex_xu, sfinucan, bauzas, cdent, edleafe) feel free to peruse as well.13:42
jaypipessfinucan, sean-k-mooney: either of you seen this? https://bugs.launchpad.net/neutron/+bug/166265013:42
openstackLaunchpad bug 1662650 in neutron "[RFE] Advance configuration of SR-IOV ports- api extension" [Wishlist,Triaged] - Assigned to Trevor McCasland (twm2016)13:42
mriedemack13:42
bauzasjaypipes: count me in for reviews13:43
*** ratailor__ has joined #openstack-nova13:43
dansmithjaypipes: yep, got it open13:43
mdboothdansmith: Just reviewing your https://review.openstack.org/#/c/458634/ and noticed it's collected a merge conflict.13:44
mdboothWant me to push the fix?13:44
jaypipessfinucan, sean-k-mooney: as kevinbenton says 'it's basically just "pipe this bag of flags to the SR-IOV nic"'. it's probably worth getting familiar with what AT&T is attempting to do there and do it right in os-vif?13:44
*** ratailor has quit IRC13:44
jaypipesdansmith, mriedem, bauzas: cheers.13:45
*** nkorabli has quit IRC13:45
dansmithmdbooth: I have a change to one of the patches on top of that, so I'll do it13:45
*** Swami has joined #openstack-nova13:45
mdboothdansmith: k13:45
*** ratailor_ has quit IRC13:46
*** eharney has joined #openstack-nova13:46
*** awaugama has quit IRC13:47
*** brault_ has joined #openstack-nova13:47
openstackgerritGábor Antal proposed openstack/nova master: Transform instance.soft_delete notifications  https://review.openstack.org/46002913:47
mdboothdansmith: Incidentally, I was trying to write a tcl upvar style test which poisoned the local variable passed to target_cell in the parent stack frame, but it seems writing to locals() in cpython doesn't do anything under most circumstances.13:48
dansmithmdbooth: oh man, I haven't thought about tcl in forever13:48
mdboothdansmith: I mostly try not to :)13:49
mdboothIt was my first commercial language13:49
dansmithheh13:49
dansmithit was my advisor's favorite language, so I wrote a bunch of stuff in it in college, but.. I barely remember any of it13:49
mdboothupvar was the worst, but I thought I'd actually found a niche for it13:49
dansmithstill have a book13:49
jaypipesI could never used a programming language named "Tickle".13:50
*** brault has quit IRC13:50
mdboothjaypipes: It's as good as any reason13:50
jaypipes:)13:50
mriedemyet you watch flubber every friday night13:50
*** felipemonteiro has joined #openstack-nova13:50
mriedemreligiously13:50
*** ekuris has joined #openstack-nova13:51
jaypipeslmao13:51
jaypipesmriedem: shh, don't tell anyone that./13:51
mriedemsorry13:51
* jaypipes digs into melwitt's quotas/cells series...13:52
openstackgerritSylvain Bauza proposed openstack/nova master: Add reserved_host_cpus option  https://review.openstack.org/46011313:53
*** felipemonteiro__ has joined #openstack-nova13:53
sfinucanjaypipes: RE: "will it be a problem, though, until we cut a new os-vif release?" I guess it won't be, but do we want our next release to hinge on "has this feature landed in OVS"?13:54
sfinucanthere's also the chance that the feature won't land/will be different13:54
sfinucanunlikely, in fairness, but possible13:54
jaypipessfinucan: le sigh... sorry, didn't realize that was the case :(13:54
jaypipessfinucan: k, revert it then.13:55
*** READ10 has joined #openstack-nova13:55
mriedemkindly reminder to let me know if i should be releasing os-vif ever13:55
jaypipessfinucan: next time, should really be WIP'd :)13:55
mriedemsince i don't monitor it13:55
jaypipesmriedem: ya, we know :)13:55
sfinucanwill do13:55
jaypipesmriedem: and yes, we will.13:55
sfinucanjaypipes: Aye13:55
sfinucananother +2 too, mind13:56
sfinucan:)13:56
jaypipessfinucan: hmm?13:56
*** hshiina has quit IRC13:56
alex_xumriedem: if we have wraps for the shell, 'nova --os-compute-api-version 2.44 help' will hide the shell which isn't supported anymore. Then the user can know which commands supported in the specific version13:56
*** udesale has joined #openstack-nova13:56
*** yangyapeng has joined #openstack-nova13:56
*** catintheroof has joined #openstack-nova13:56
*** hshiina has joined #openstack-nova13:57
*** felipemonteiro has quit IRC13:57
* sfinucan goes to check out this neutron spec too13:57
sfinucan /bug13:57
*** mdnadeem has quit IRC13:57
mriedemalex_xu: does anyone do that with the CLI?13:57
openstackgerritRodolfo Alonso Hernandez proposed openstack/nova master: Read Neutron port 'binding_profile' during boot  https://review.openstack.org/44925713:58
openstackgerritRodolfo Alonso Hernandez proposed openstack/nova master: Add Neutron port capabilities to devspec in request  https://review.openstack.org/45177713:58
jaypipessfinucan: doh, apologies. for some reason I thought you or sean-k-mooney had +2'd moshele's hw-tc-offload patch :(13:58
*** armax has joined #openstack-nova13:58
alex_xumriedem: not sure :(13:58
sfinucanjaypipes: Oh, I heard something about bug 1662650 before. I think that guy, Trevor, talked about it in an SR-IOV meeting ages ago13:58
openstackbug 1662650 in neutron "[RFE] Advance configuration of SR-IOV ports- api extension" [Wishlist,Triaged] https://launchpad.net/bugs/1662650 - Assigned to Trevor McCasland (twm2016)13:58
edleafejaypipes: in meetings - added to my queue13:58
jaypipessean-k-mooney, sfinucan: I must have confused your +2's on the dependent patches for a +2 on that one. my apologies to you both.13:58
sfinucanjaypipes: It's all goooood13:59
jaypipesno, it's really not... pretty bad mistake of mine :(13:59
mriedemjbernard: i don't know what happened in https://review.openstack.org/#/c/459832/13:59
openstackgerritStephen Finucane proposed openstack/os-vif master: Revert "hardware offload support for openvswitch"  https://review.openstack.org/46012014:00
*** smatzek_ has joined #openstack-nova14:01
sfinucanjaypipes: Do we need to +2 reverts? :D14:01
*** mlavalle has joined #openstack-nova14:01
jaypipessfinucan: no, go for it.14:01
openstackgerritStephen Finucane proposed openstack/os-vif master: Standardize README  https://review.openstack.org/46009414:02
*** READ10 has quit IRC14:03
sfinucanmriedem: Thanks for the info on https://review.openstack.org/#/c/373293/ - I'd no idea what the policy around stable/* requirements bumps was14:03
mriedemsfinucan: it's a long and sordid tale of woe14:04
mriedemand coincidentally as a result of the TC meeting yesterday, is going to come back up real soon in the ML14:04
*** arunman has joined #openstack-nova14:04
*** ratailor__ has quit IRC14:04
mriedemsfinucan: https://docs.google.com/presentation/d/1k0mCHwRZ3_Z8zJw_WilsuTYYqnUDlY2PkgVJLz_xVQc/edit?usp=sharing14:05
mriedemoldy but goody14:05
bauzasmriedem: dansmith: jaypipes: do you remember the exact problem that I tried to solve when I wrote "Amend RT to filter out allocations for instances that don't have a host set14:06
bauzas  yet when it does self-heal check." ?14:06
mriedembauzas: that was a race that edleafe pointed out i think14:06
bauzasmriedem: dansmith: jaypipes: the fact that we post allocations for instances that we discover, right?14:06
dansmiththe pre-scheduling race or something?14:06
sfinucanmriedem: niiiiice14:07
bauzasI think so14:07
*** amotoki has quit IRC14:07
bauzasanyway, just writing the patch, comments welcome14:07
mriedemoh right,14:07
dansmithlike, you create an instance, don't assign the host, do create allocations, and that host deletes the allocations before building because of self-heal14:07
mriedembecause instance.host isn't set until we're in the RT14:07
dansmithyeah14:07
*** adrian_otto has joined #openstack-nova14:08
bauzasdansmith: wait14:09
* dansmith waits14:09
bauzasso we create allocations in self-heal14:09
dansmithand delete them14:10
bauzasbut if we can't track it, then we delete the allocations14:10
bauzascorrect14:10
bauzasso, we should filter out to delete the allocation, or to post it ?14:10
dansmithnot sure what you mean14:11
*** psachin has quit IRC14:11
dansmithwe should avoid deleting it if we think we should but no host is set on the instance14:11
dansmithlike instance.host==None14:11
bauzaswe delete the allocations for instances that aren't tracked14:11
dansmith...right14:12
bauzasokay, so the problem is about deleting allocations14:12
dansmithyes14:12
bauzaslemme see the code14:12
*** adrian_otto has quit IRC14:12
bauzasI mean, can't see the race14:13
dansmith1. conductor creates the instance in the db, instance.host=None14:13
*** ekuris has quit IRC14:13
dansmith2. Conductor/scheduler/whatever creates the allocations in placement14:13
dansmith3. Conductor gets ready to send the instance to compute to build14:13
dansmith4. Compute runs self heal before that happens, sees allocations it doesn't know about, deletes them14:14
dansmith5. Instance arrives at compute ready to build14:14
dansmithmake sense?14:14
bauzasah ok14:14
bauzasyup14:14
bauzasno races yet, but possible race after my changes, gotcha14:14
dansmithyes14:14
*** kfarr has joined #openstack-nova14:15
*** NightKhaos has quit IRC14:16
mriedemalthought,14:16
mriedem*although,14:16
mriedemnow that you say this, i'm not sure where in the code #4 happens14:16
dansmithhang on I'll show you14:16
bauzasunless I'm blind, the only case where we get allocations, it's per instance14:16
bauzasand we never delete them14:17
bauzasonly if when tracking, we removed the instance uuid14:17
dansmithI had to find this for jaypipes a couple weeks ago14:17
bauzaswhich is happening because we do get the list of instances per host14:17
dansmithhttps://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L873-L88514:17
bauzasand we compare to what we have in memory14:17
dansmithwe get allocations based on compute node,14:18
*** prateek has quit IRC14:18
dansmiththen any instances we don't have in the instances_dict provided get their allocations deleted14:18
bauzasoh fuck, missed that one14:18
mriedemdansmith: i saw that,14:18
mriedembut how is an instance we're about to build that doesn't have instance.host set showing up in that list?14:18
bauzasdansmith: but we should get the instance uuid to be scheduled part of the argument14:18
mriedemvia the allocations tied to the RP?14:19
mriedemoh i see14:19
mriedemyeah14:19
dansmithmriedem: it's not in instances_uuids yet, but is in get_allocations()14:19
mriedemright14:19
dansmithbauzas: no14:19
mriedeminstance_uuids could be empty14:19
dansmithright14:19
bauzasif there are no tracked instances, correct14:20
*** vks1 has joined #openstack-nova14:20
openstackgerritJohn Garbutt proposed openstack/nova master: Remove all discoverable policy rules  https://review.openstack.org/45960814:20
*** amotoki has joined #openstack-nova14:21
mriedemself.tracked_instances[uuid] = obj_base.obj_to_primitive(instance)14:21
bauzasmriedem: dansmith: oooh man, I see the problem14:21
mriedemso rather than pass instance_uuids to remove_deleted_instances, we'll have to pass the actual instances14:21
mriedemto see if host is set or not14:21
bauzassince instance.host is none, then the get_instances_per_host doesn't get it14:21
dansmithmriedem: no14:21
dansmithmriedem: because instances with no host won't be in tracked_instances14:21
bauzasyup14:21
*** READ10 has joined #openstack-nova14:21
dansmithmriedem: we have to look up instances we think we want to delete allocations for14:21
mriedemoh right14:21
bauzasI now see the potential race14:21
mriedemyuck14:21
dansmithand not delete any that don't have host set14:21
dansmithusually the list we think we need to delete will be empty, so it's not a big deal14:22
bauzasmmm14:22
dansmithonly if we're really healing from some big failure, or if we lose this race, and then it'll likely only be one instance14:22
mriedemcan we filter on host when pulling that instance list to try and narrow the results?14:23
dansmithno14:23
dansmithwe don't need to14:23
*** NightKhaos has joined #openstack-nova14:23
dansmithbut it doesn't have host set, so..14:23
dansmithwe will have a list of instance uuids we need to consider,14:23
bauzasdansmith: I see your point14:23
dansmithso we lookup _just_ those instances14:23
dansmithand they will only be instances that have allocations against our compute node14:23
bauzasdansmith: but then we need to lookup those instances in the report client code14:23
dansmithso it's not like it's all unscheduled instances or anything14:24
dansmithbauzas: or refactor how this cleanup works14:24
dansmithbauzas: I'm not sure this integrated cleaning makes sense in the report client anyway14:24
bauzasdansmith: I prefer the latter14:24
dansmithright14:24
dansmithit's code, it can change :)14:24
bauzasdansmith: yup, zactly14:24
bauzasokay, hands on14:24
*** vks1 has quit IRC14:24
bauzasthere is only one caller for remove_deleted_instances, not a big deal indeed14:25
bauzasdansmith: thanks for the explanation14:25
dansmithit should be named something less obscure too14:25
*** prateek has joined #openstack-nova14:25
dansmithand more allocationy14:25
bauzasI somehow captured that a while ago, but my brain fried in between14:25
bauzasI should have been more explicit in the spec14:25
mriedemheh this is blowing my mind https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L87814:25
mriedemapparently instance_uuids isn't a list of instance uuids14:25
mriedembecause instance['uuid']14:26
bauzasyup14:26
bauzasit's not the instance object, it's rather the instance payload we pass back14:26
mriedemthat totally threw me14:26
bauzasfrom placement14:26
mriedemit's not an instance object, it's the primitive14:26
mriedemself.tracked_instances[uuid] = obj_base.obj_to_primitive(instance)14:26
mriedemself.scheduler_client.reportclient.remove_deleted_instances(14:27
mriedem                cn, self.tracked_instances.values())14:27
bauzascorrect, sorry14:27
bauzasanyway, on it14:27
*** prateek_ has joined #openstack-nova14:27
dansmithit doesn't matter for this anyway14:27
dansmithwe don't need the instance object because those are instances we _don't_ care about14:27
*** iceyao has quit IRC14:28
mriedemright, because if instance_uuids is empty, but allocations isn't, removed_instances = set(allocations.keys()) - set(instance_dict.keys()) will make us remove all of those allocations14:28
mriedemyes?14:28
mriedemso we have to get the list of instances from the allocations we're about to remove, and filter out the ones where instance.host is None14:29
*** iceyao has joined #openstack-nova14:29
dansmithyes14:29
*** prateek has quit IRC14:29
mriedemand that's where i was saying we could filter on host when pulling the instances from the db14:30
mriedemas an optimization14:30
*** slaweq has joined #openstack-nova14:30
dansmithit's not an optimization14:30
dansmithwe can't filter by host because these instances necessarily are host=None14:30
mriedemselect * from nova.instances where uuid in (for allocation.consumer_id in allocations) and instance.host is not None;14:30
dansmithwe're already doing that effectively,14:30
*** felipemonteiro__ has quit IRC14:31
dansmithbecause we're asking placement for instances with allocations against our host14:31
bauzaslemme try something, POC should be in the next couple of minutes14:31
*** awaugama has joined #openstack-nova14:31
bauzaseasier to talk14:31
*** felipemonteiro has joined #openstack-nova14:31
*** prateek_ has quit IRC14:31
mriedemdansmith: there is going to be a conditional in the code once we pull the instance list back from the db to see if instance.host is None or not, right?14:31
openstackgerritJohn Garbutt proposed openstack/nova master: Remove all discoverable policy rules  https://review.openstack.org/45960814:31
*** prateek_ has joined #openstack-nova14:32
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in floating_ip files  https://review.openstack.org/45979114:32
*** ZZelle has joined #openstack-nova14:32
dansmithmriedem: oh I see you mean query for instances with host=None specifically? We'll want to also skip instances that match our hostname in case we're racing with our own build14:32
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in migrations.py  https://review.openstack.org/45972714:32
dansmithotherwise we'd delete things that we just owned ourselves14:32
mriedemdansmith: yes, i'm saying move the python condition into the sql query14:33
*** lpetrut_ has quit IRC14:33
*** ZZelle is now known as Guest2214114:33
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in migrate_server.py  https://review.openstack.org/45971114:33
mriedemso we're pulling less stuff we don't care about over rpc14:33
mriedemlike with a bunch of joins and shit we don't care about14:33
dansmithmriedem: but it's a specific list of instance uuids and we care about all of them because of ^14:33
mriedemthis is really just an existence check14:33
dansmithit's not14:33
dansmithbecause we need to delete allocations for instances that have been evacuated in our absence to another host14:33
*** iceyao has quit IRC14:34
dansmithor instances that were locally deleted while we were gone14:34
dansmithbut not instances that are in flight (=None) or assigned to us while we were doing this (=$host)14:34
mriedemi'll have to wait for the code change then to think about it14:34
*** slaweq has quit IRC14:34
dansmithwe have a call right now anyway14:34
mriedemsure, i just want to make sure this is as fast as possible14:35
mriedemexpected_attrs=[] ftw14:35
dansmithit will almost always be a no-op, but sure14:35
*** baoli has quit IRC14:36
*** amotoki has quit IRC14:38
*** baoli has joined #openstack-nova14:38
*** salv-orlando has joined #openstack-nova14:38
*** vks1 has joined #openstack-nova14:39
*** Guest22141 has quit IRC14:39
*** salv-orl_ has joined #openstack-nova14:39
*** dikonoor has quit IRC14:43
*** salv-orlando has quit IRC14:43
*** amotoki has joined #openstack-nova14:43
*** prateek_ has quit IRC14:44
*** iceyao has joined #openstack-nova14:44
*** felipemonteiro__ has joined #openstack-nova14:46
*** marst has quit IRC14:47
*** dave-mccowan has joined #openstack-nova14:47
bauzasmriedem: mmm, unless I misunderstood, you wanted to ask to use get_by_filters() by saying "not this host", right?14:48
*** iceyao has quit IRC14:49
bauzasmriedem: but AFAIK you can use a filter like 'host'='foo', not 'host'= NOT 'foo'14:49
mriedemhost=None14:49
mriedemwe do that elsewhere in the code14:49
bauzasmriedem: a-ha, I see14:50
*** felipemonteiro has quit IRC14:50
bauzasmriedem: but I also need to verify host=me14:50
mriedemthen i guess you can't filter in sql14:51
bauzasyup, my point14:51
bauzasI was confused14:51
bauzasanyway14:51
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in migrate_server.py  https://review.openstack.org/45971114:52
*** amotoki has quit IRC14:53
mriedembauzas: just make sure you pass expected_attrs=[] so we don't do a bunch of unnecessary joins14:54
bauzasI know14:54
*** marst has joined #openstack-nova14:54
*** kfarr has quit IRC14:55
*** marst_ has joined #openstack-nova14:55
*** marst has quit IRC14:55
dansmithyou guys are optimizing the heck out of a list of <=1 :P14:57
jaypipesdansmith, cdent: answered your questions on https://review.openstack.org/#/c/45778214:57
mriedemlyarwood: can you hit some of these when you get a chance? https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:stable/newton14:58
cdentthanks jaypipes14:58
bauzascdent: correct me if I'm wrong but...14:59
bauzascdent: is https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L871 returning a list of instance UUIDs ?14:59
*** tongli has quit IRC15:00
* bauzas is going to look at the code itself FWIW15:00
openstackgerritHuan Xie proposed openstack/nova master: WIP: XenAPI use os-xenapi v2 in nova  https://review.openstack.org/45349315:00
cdentbauzas it's more than that, but does include instance uuids15:00
bauzascdent: it's keyed by that ? https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L88015:01
mdboothcdent jaypipes: Any reason we can't return structured objects from get_inventory(): https://review.openstack.org/#/c/457782/ ?15:01
*** tjones has joined #openstack-nova15:01
mdboothdicts with grab bags of fields returned by drivers make me nervous15:01
cdentbauzas: https://github.com/openstack/nova/blob/master/nova/api/openstack/placement/handlers/allocation.py#L13815:01
lyarwoodmriedem: ack, sorry did mean to get around to that earlier in the week.15:02
jaypipesmdbooth: eventually, there will be a bit more structure there, when nested resource providers lands this patch: https://review.openstack.org/#/c/415920/15:02
bauzascdent: cool then15:02
bauzascdent: FWIW the gabbi tests for allocations are a bit long to read :)15:02
cdentmdbooth: we're trying to kill off nova-side use of placement-used ovos, especially when rcp not involved15:02
jaypipesmdbooth: but we didn't want to depend on versioned objects defined in nova/objects/resource_provider.py within the virt driver layer.15:02
jaypipesbauzas: compared to...?15:03
bauzasjaypipes: for knowing which allocations to delete15:03
bauzasanyway, patch is close to be up15:03
jaypipesbauzas: no, I mean the gabbits are hard to read, compared to what? :)15:03
cdentbauzas: see line 51 of https://etherpad.openstack.org/p/placement-newton-leftovers15:04
bauzascompared to API docs :)15:04
mriedemthere is a note in there that the get allocations gabbits can't sub the left side of the json path b/c of a bug15:04
mriedemthey are working on api-ref15:04
cdents/they/we/15:04
cdentas in, all of us15:04
mriedemus vs them15:05
mriedemduh15:05
cdentmriedem: are you the wolf or the dog today?15:05
mriedemi meant, they as in 'people that aren't me'15:05
mriedem:)15:05
mriedemb/c i'm not being helpful15:05
*** moshele has quit IRC15:06
cdentthe docs, although not yet published, are coming together nicely and look very nice and polished15:06
cdentgiven sufficient time/energy/people it would be great to decompose the gabbi files into smaller pieces, been on the looking for volunteers todo list for months15:08
*** yingjun has quit IRC15:08
*** trinaths has joined #openstack-nova15:08
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in floating_ip files  https://review.openstack.org/45979115:10
*** kiwi_rot has left #openstack-nova15:10
*** catintheroof has quit IRC15:10
*** amotoki has joined #openstack-nova15:11
*** brault_ has quit IRC15:11
*** catintheroof has joined #openstack-nova15:11
*** catintheroof has quit IRC15:11
*** swebster has joined #openstack-nova15:11
efriedmordred Just to be clear, for the endpoints-from-service-catalog stuff, you're suggesting changes in keystoneauth1 itself?15:12
sean-k-mooneyjaypipes: hi jay yes im familar with what at&t want to do we were talking about this at the PTG15:12
openstackgerritJohn Garbutt proposed openstack/nova master: Add description to policies in migrations.py  https://review.openstack.org/45972715:12
sean-k-mooneyjaypipes: its been a while since i reviewd the code changes though so i need to see how its shaping up and what the apis will look like.15:13
*** brault has joined #openstack-nova15:13
jaypipessean-k-mooney: will you be in Boston?15:16
sean-k-mooneyi was not planning to be if i had a strong reason to go i could15:16
jaypipessean-k-mooney: heh, you know it's in <2 weeks right? :)15:16
sean-k-mooneyyep i know i do have a ticket for said event but others are going form my team just not me15:17
*** brault has quit IRC15:17
sean-k-mooneyi was not sure how much design was going to happen at the fourm now with the PTG15:18
openstackgerritRafael Folco proposed openstack/nova master: Delete inventory has its own method DELETE  https://review.openstack.org/46014715:18
jaypipessean-k-mooney: certainly less than the PTG. but if you were going to be there, I would propose meeting in person.15:18
jaypipessean-k-mooney: not a big deal though. we can always do a hangout.15:18
openstackgerritIldiko Vancsa proposed openstack/nova master: WIP/POC Implement new attach Cinder flow  https://review.openstack.org/33028515:18
openstackgerritKaitlin Farr proposed openstack/nova master: Parse algorithm from cipher for ephemeral disk encryption  https://review.openstack.org/44607215:20
sean-k-mooneyyep it would have been good to sync on things but ya im always up for a hangout's chat too15:20
sean-k-mooneyjaypipes: AT&T originally were proposing this as a nova change and i redirected it to neutron at the ptg.15:21
jaypipessean-k-mooney: k15:22
mordredefried: I am - I think we should add a method to keystoneauth which registers options needed by "adapters" (which is keystoneauth term for a session mounted on a service endpoint)15:22
mordredefried: so basically the parameters you need to create an adapter are the same parameters you need to find an endpoint from the service catalog15:22
*** yingjun has joined #openstack-nova15:23
mordredand if we add them there, then we can just re-use that method ot register the right opts in all the places we want to let nova users put in all of the different filters15:23
*** iceyao has joined #openstack-nova15:23
mordred(similar to how we use register_session_opts now)15:23
efriedmordred I dig it.  Can you point me to something in the keystone source that'll give me a hint as to how an "adapter" differs from a "session" or an "auth"?15:24
mriedemswebster: see my comment in https://review.openstack.org/#/c/453938/2/nova/network/neutronv2/api.py after the fact - can you push a small change to update that code comment block for the migration = None case?15:24
mordredone could also make the argument that an load_adapter_from_opts would be a nice equivilent method ot keystoneauth that we could use in the places we want just a plain keystoneuath REST interface15:24
openstackgerritGábor Antal proposed openstack/nova master: [WIP] Transform instance.live_migration_rollback notification  https://review.openstack.org/40212415:24
mordredefried: absolutely! one sec ...15:24
*** abalutoiu has quit IRC15:24
swebstermriedem: no problem, will do15:25
mordredefried: so - if you start from here: https://github.com/openstack/keystoneauth/blob/master/keystoneauth1/loading/__init__.py#L31-L3215:25
efriedmordred And next question: Where do I propose changes?  review.openstack.org via https://git.openstack.org/openstack/keystoneauth ?15:25
*** trinaths has quit IRC15:26
efriedmordred Yuh, found that, and saw how it was being used by other groups (cinder, ironic).15:26
mordredefried: you can see this: https://github.com/openstack/keystoneauth/blob/master/keystoneauth1/loading/session.py15:26
mordredso I believe what would be wanted is a similar keystoneauth1/loading/adapter.py15:26
mordredthe actual adapter code is here: https://github.com/openstack/keystoneauth/blob/master/keystoneauth1/adapter.py - which lists the different adapter constructor params - I'm not sure all of those need to be conf options though15:27
*** iceyao has quit IRC15:28
mordredefried: I'd say for your purposes, https://github.com/openstack/keystoneauth/blob/master/keystoneauth1/adapter.py#L32-L37 are the ones that want conf options15:28
*** tonygunk has joined #openstack-nova15:28
efriedmordred Except service_name, which people thought was useless?15:28
mordredhttps://github.com/openstack/keystoneauth/blob/master/keystoneauth1/adapter.py#L38 is useful once you're actually calling get_endpoint - but I think that's a different nova-level thing not a conf option15:29
*** bswartz has quit IRC15:29
mordredefried: yes - I do wish service_name would diaf, but I think also johnthetubaguy made a good point mentioning it - just because I don't like it doesn't mean that people out there may not have used it for something15:29
*** adisky_ has quit IRC15:29
mordredefried: for instance, in the infra account for rackspace public cloud, there actually used to be 2 entries for "compute" - because of history with pre-openstack rackspace15:30
*** trinaths has joined #openstack-nova15:30
mordredand we had to use service_name to get it to pick the right one15:30
*** udesale has quit IRC15:30
*** fandi has joined #openstack-nova15:30
mordredso if we're adding the conf_options to keystoneauth, we might as well be complete :)15:30
efriedmordred Fair enough.15:30
efriedmordred At a glance here, I would need to have the union of [session opts] with these adapter opts, right?15:31
mordredefried: fwiw, I recently wrote a spec: https://review.openstack.org/#/c/459405/ - which explains this entire thing in excruciating detail15:31
openstackgerritGábor Antal proposed openstack/nova master: [WIP] Transform instance.live_migration_rollback notification  https://review.openstack.org/40212415:31
*** vks1 has quit IRC15:31
efriedooo15:31
mordredin case you've ever wanted to learn _WAY_ more about what's going on here than any human should know15:31
efriedThat'll be helpful.15:31
cdent"explains"15:32
*** slaweq has joined #openstack-nova15:32
mordredefried: yah - each service grouping needs the session opts and the adapter opts in order to fully desscribe how to connect to a service15:32
mordredefried: the sesion opts obvs go to the Session, and then the adapter opts are how the service endpoint is found15:32
mordredcdent: :)15:32
mordredcdent: ooh! you made reviews for me - I'm excited15:33
* mordred goes to read15:33
cdentmordred: i'm afraid they are disappointingly short15:33
swebstermriedem: do you recommend updating that existing review, or should I start a new branch/review for the comment change?  Since the original change already got merged15:34
efriedmordred I believe I understand.  This is just what I was looking for.  Ima have questions for you later about os-client-config (once you get out of cdent-land)15:34
cdentYay! I have a land, how do I get there?15:34
efriedcdent Take the red pill15:35
mriedemswebster: the existing review is merged15:35
mriedemso it has to be new15:35
jbernardmriedem: im not sure either15:35
swebstermriedem: thx15:35
mriedemjbernard: i pushed a rev of the d-g change with tracing15:36
jbernardmriedem: ahh, you added a recheck, thanks15:36
jbernardmriedem: something unrelated appears to have merged, the graph is not looking good this morning15:36
*** Sukhdev has joined #openstack-nova15:36
*** rmart04 has joined #openstack-nova15:37
*** salv-orl_ has quit IRC15:37
mordredefried: cool - let's definitely chat later about the occ things - I'll ping when I'm done with the next round of updates on this spec15:37
efriedmordred Roger wilco, and thanks.15:38
mordredcdent: one of your feedbacks brings up a thing that morgan had mentioned too and I came up with a good idea for making it better - so while short, they are helpful!15:38
* cdent is pleased15:38
jbernardmriedem: http://logs.openstack.org/32/459832/1/check/gate-tempest-dsvm-full-devstack-plugin-ceph-ubuntu-xenial/85d7f13/console.html#_2017-04-26_14_11_03_60999715:38
jbernardmriedem: looks like maybe it's being skipped over15:39
*** chyka has joined #openstack-nova15:39
mriedemartom: why not also setting capabilities for vmware and ironic drivers in https://review.openstack.org/#/c/415520/29 ?15:39
*** hamzy has quit IRC15:39
efriedIs it a done thing to refer to a nova blueprint from another project?  (For these keystoneauth changes, I would be referring to https://blueprints.launchpad.net/nova/+spec/use-service-catalog-for-endpoints, which is listed under project nova)15:40
efriedWould the blueprint have to be tagged to be registered under keystone as well, and approved there?15:40
mriedemjbernard: oh15:40
mriedem{plugin-repo}15:40
mriedemrather than ${plugin-repo}15:40
artommriedem, err, whoops. Not sure why that happened15:40
mriedemartom: let me just -1 you right here real quick...15:41
openstackgerritSylvain Bauza proposed openstack/nova master: WIP: Don't delete allocation if instance being scheduled  https://review.openstack.org/46017715:41
artommriedem, fair15:41
*** Sukhdev_ has joined #openstack-nova15:41
mriedemartom: although if the compute manager or whatever is checking that flag just does a .get('foo', False) that would be fine too15:41
jbernardmriedem: i thought the $ was not needed in yaml15:41
morganmordred: ++15:41
bauzasmriedem: POC above for  the discussion we had https://review.openstack.org/46017715:41
mriedemjbernard: i'm in bash15:41
mriedemjbernard: i mean this is d-g which is bash15:42
*** jpena is now known as jpena|brb15:42
artommriedem, that would be smarter, yes - though I think the precedent is to *not* do that15:42
jbernardmriedem: ooooh, in the wrapper15:42
*** prateek_ has joined #openstack-nova15:42
mriedemartom: maybe not, it's less explicit i guess, idk15:43
artomMaybe we need a has_capability in the generic virt driver, which then check the capabilities dict in the smart way15:43
artomAs opposed to overriding everything everttime15:43
openstackgerritMikhail Feoktistov proposed openstack/nova master: Add is_vz_container function  https://review.openstack.org/44594715:43
mriedemencoding a default in the compute manager does duplicate the defaults, which kind of sucks15:43
mriedembut i don't think those things ever change15:43
*** annegentle has joined #openstack-nova15:44
mriedemapparently efried and the powervm driver aren't even cool enough yet to override capabilities15:44
artomDefault in the manager? I meant manager -> driver.has_capability('foo') -> return self.capabilities.get('foo', <default>)15:44
mriedemand no that's not an invitation to tell me to review whichever powervm patch adds capabilities overrides15:45
efriedmriedem That was changed per YOUR review comment, nah?15:45
*** trinaths has quit IRC15:45
mriedemartom: meh15:45
mriedemartom: we're over thinking this i think15:45
artom*shrug* it'd be a net improvement, no matter how small ;)15:45
artomBut it can be done separately15:46
mriedemi agree with doing it separately15:46
*** mdrabe has quit IRC15:47
*** sridharg has quit IRC15:49
mriedemjohnthetubaguy: we should be good to go here https://review.openstack.org/#/c/456896/15:50
mriedemjohnthetubaguy: we're going to need to find a 3rd sucker, i mean core, to help review the new cinder api changes if i'm going to be contributing to the series15:50
*** MasterOfBugs has joined #openstack-nova15:51
johnthetubaguymriedem: cool, I will take a peak at that now15:52
cdentbauzas: left a comment on your WIP that I wanted to be sure you didn't miss since your -W15:52
*** stackempty has joined #openstack-nova15:53
*** tonygunk has quit IRC15:53
*** gcb has joined #openstack-nova15:53
stackemptyhola .. does anyone know if something like this is already available https://specs.openstack.org/openstack/nova-specs/specs/newton/approved/flavor-root-disk-none.html15:53
mriedemstackempty: you've just stepped into something15:54
* mriedem finds references15:54
*** bmace has quit IRC15:54
mriedemstackempty: see http://lists.openstack.org/pipermail/openstack-dev/2017-February/113063.html15:55
mriedemthe "Enable Cinder as an ephemeral storage backend for Nova" part15:55
*** mdrabe has joined #openstack-nova15:55
*** gcb has quit IRC15:55
mriedemstackempty: if you're going to be at the forum https://www.openstack.org/summit/boston-2017/summit-schedule/events/18738/using-cinder-for-nova-ephemeral-storage-backend?BackURL=https%3A%2F%2Fwww.openstack.org%2Fsummit%2Fboston-2017%2Fsummit-schedule%2Fglobal-search%3Ft%3DRiedemann%23eventid%3D1873815:56
sfinucanjaypipes, johnthetubaguy: I'm going to add a 'reserved_host_disk_gb' option if that makes sense?15:56
sfinucanto resolves the TODOs in https://review.openstack.org/#/c/457782/2/nova/scheduler/client/report.py15:56
*** gcb has joined #openstack-nova15:56
mriedem"It would be better to claim disk in MB, but that is hard now."15:57
*** tonygunk has joined #openstack-nova15:57
mriedemi don't see that changing anytime soon15:57
mriedemclaiming disk in mb vs gb i mean15:57
mriedemstackempty: so the answer is not yet,15:57
mriedemstackempty: that feature from that spec never landed and was abandoned,15:58
mriedemstackempty: there have been alternative proposals since then to solve the same use case,15:58
mriedemwhich is i don't have local disk on the computes, i need/want to use cinder for all storage15:58
mriedemincluding ephemeral15:58
stackemptyThanks a lot @mriedem .15:58
bauzasmriedem: FWIW, I'd love to count on bytes even :)15:58
mriedemhell, let's count in nibbles15:59
bauzasmriedem: remember the helper script I needed to write for MB vs. GB ?15:59
bauzasand why bytes are cool :)15:59
bauzasor count in bosons if you wish15:59
*** prateek_ has quit IRC16:00
bauzassmallest atomic amount FTW16:00
*** ZZelle has joined #openstack-nova16:00
sfinucanseems I also stepped into something too. Oops16:00
* sfinucan should look before he leaps16:01
*** tonygunk has quit IRC16:01
*** ZZelle is now known as Guest1494816:01
*** smatzek_ is now known as smatzek16:01
johnthetubaguysfinucan: I guess all the flavor stuff is in GiB, so having the configuration match that probably makes good sense.16:02
mriedemstackempty: there was also https://blueprints.launchpad.net/nova/+spec/create-bdm-from-flavor-extra-specs16:02
sfinucanjohnthetubaguy: and from the look of the above, it's unlikely that that'll change anytimesoon16:02
sfinucanright?16:02
mriedembut we didn't want to go the route of stuffing bdm information in flavor extra specs16:02
mriedemthe worst of both worlds16:02
johnthetubaguymriedem: the above spec is the reverse I thought, its just a flavor that says "must have boot volume"16:03
*** andreas_s has quit IRC16:03
mriedemjohnthetubaguy: the UX was bad imo,16:04
mriedemi think the idea was you mark your flavors as local_disks=False,16:04
*** yingjun has quit IRC16:04
*** iceyao has joined #openstack-nova16:04
mriedemand if the user tries to create a server with one of those flavors but without defining bdms, it fails16:04
*** slaweq has quit IRC16:04
johnthetubaguysfinucan: my head swap was in MiB in the flavor but it seems like its not, I must have got mixed up with RAM16:04
mriedemputting the burden on the user to have to sort out which flavors they can use and if they have to have volumes, etc16:05
mriedemit'd be much better UX if the operator configures the compute to use cinder as an ephemeral storage backend16:05
mriedemregardless of flavor16:05
bauzasoh fun, we already verify existing allocations before posting16:05
bauzasmriedem: jaypipes: dansmith: cdent: ^16:05
*** prateek has joined #openstack-nova16:05
cdentyes, didn't we already know that?16:06
johnthetubaguymriedem: true, but that seems years away at this point, and the other way makes diskless hypervisors upstream16:06
bauzascdent: I wrote that as a work item16:06
bauzasfor the scheduler claims stuff16:06
mriedemjohnthetubaguy: well, https://specs.openstack.org/openstack/nova-specs/specs/newton/approved/flavor-root-disk-none.html also bakes that into the API16:06
*** damien_r has quit IRC16:06
johnthetubaguymriedem: the problem is the mix of diskless and non-diskless16:06
bauzascdent: and nobody reviewed that saying "meh" :p16:06
mriedemjohnthetubaguy: so then we have to support local_disks=False in flavors in the API for years probably16:06
mriedemeven if we ever get cinder ephemeral16:07
cdentbauzas: well, I think I did when discussing the change to not use RPC, but it didn't get picked up and didn't seem a relevant detail16:07
mriedemjohnthetubaguy: there was also https://review.openstack.org/#/c/432503/ which i really didn't want since it mixes extra specs and bdms16:07
cdentbauzas: in any case, did you seem my earlier [t 3xBS]16:07
purplerbot<cdent> bauzas: left a comment on your WIP that I wanted to be sure you didn't miss since your -W [2017-04-26 15:52:17.085960] [n 3xBS]16:07
johnthetubaguymriedem: yeah, the auto create seems evil16:07
mriedemjohnthetubaguy: anyway, we talked about cinder ephemeral at the ptg, a spec was never written, but it's a forum session to discuss it or alternatives16:08
johnthetubaguymriedem: yeah16:08
mriedemif people want this, then they need to put up the dev resources to do it16:08
mriedemrather than api hacks16:08
*** iceyao has quit IRC16:09
mriedemcinder ephemeral imagebackend also allows us to deprecate lvm, rbd and scaleio (if that lands)16:09
*** awaugama has quit IRC16:09
mriedemi think anyway16:09
johnthetubaguymriedem: my problem is the whole way we do disks is truly terrible, so to get to something clean buts a lot of burden on the users to switch to something radically different16:09
mriedemhaving said this, there is probably a world of API operations that don't work for boot from volume servers, like shelve/unshelve and rebuild16:10
mriedemusers == operators?16:10
johnthetubaguymriedem: they should all work, they might be broken16:10
johnthetubaguymriedem: I was meaning API users16:10
*** tonygunk has joined #openstack-nova16:10
*** awaugama has joined #openstack-nova16:10
mriedemi don't see how a cinder ephemeral imagebackend is radically different from the API pov16:11
mriedemthe api doesn't change16:11
mriedemthe operator just says he wants to use cinder for storage on this compute host16:11
mriedemwhich is what that spec is also doing, probably with host aggregates tied to the marked flavors16:11
johnthetubaguymriedem: the problem is we create user visible cinder volumes, that we didn't before, then we talk about customizing the volume type, and mixed diskless and non-diskless, and it all gets a bit tricky.16:11
*** eglynn has quit IRC16:12
*** Guest14948 is now known as ZZelle_16:13
mriedemat the ptg we said that we could add the support for volume type via extra spec if we did cinder ephemeral imagebackend,16:13
mriedemwhich was a win for cburgess16:13
*** ociuhandu has joined #openstack-nova16:13
mriedemi agree you get a user visible cinder volume that you wouldn't have before,16:14
edleafe` /win 1416:14
mriedembut i'm not sure that's a huge issue as long as it's marked for delete_on_termination=True16:14
cburgessWhat do we mean by "wouldn't have before"?16:14
*** gcb has quit IRC16:14
mriedemwouldn't have before "automatically"16:14
mriedemtoday you opt in to bfv16:14
mriedemthis would have nova do it for you depending on which compute host you land on16:14
*** nic1 has joined #openstack-nova16:15
cburgessOK right but, presumably it would be a deployer, or at least cloud admin, option to use the new as of yet unspeced nova roots on cinder idea.16:15
mriedemyes it would be16:15
cburgessSo I don't think its a problem that users would see the cinder volumes.16:15
mriedemas would marking your flavors as local_disks=False like in https://specs.openstack.org/openstack/nova-specs/specs/newton/approved/flavor-root-disk-none.html16:15
cburgessIn pure BFV environments today they already deal with that.16:15
mriedemit's just with https://specs.openstack.org/openstack/nova-specs/specs/newton/approved/flavor-root-disk-none.html if the user picks the wrong flavor or makes the wrong server create request, it will blow up16:16
mriedemand then they have to go back and figure out how to add bdms via the nova boot cli16:16
cburgessHow so?16:16
mriedemwhich is not fun16:16
cburgessI'm not following.16:16
mriedem"The use case for End Users is to not create ephemeral (root) disks locally on the hypervisor by accident. When launching an instance from a flavor with disabled local disks, the user will be informed to create a bootable volume in order to launch the instance with that volume."16:16
mriedem"be informed" means 40016:17
mriedemholy crap, just look at the proposed change minefield16:17
mriedem"error, when flavor create request with local_disks=False and root_gb > 0 and/or emphemeral_gb > 0 and/or swap_gb > 0"16:17
mriedem"return descriptive exception, when flavor with local_disks=False and requested image larger than given blockdevice layout"16:18
mriedem"if local_disks is omitted or set to True, root_gb is mandatory again"16:18
mriedem"if jupiter is aligned with saturn and it's a leap year, the api works, else 400"16:18
*** sambetts is now known as sambetts|afk16:18
cburgessYeah this seems... sub-optimal.16:18
cdentwhat about when mercury is in retrograde?16:18
cburgessWhy can't we use the rest of the info from the boot request and craft a BFV request for them.16:18
mriedemcdent: then all bets are off16:18
mriedemcburgess: that's probably https://review.openstack.org/#/c/432503/16:19
cburgessGranted... turning off local disks is a really big deal/issue today and causes us issues.16:19
johnthetubaguyright, its not possible today, due to root_gb=0 meaning "don't resize image"16:20
cburgessmriedem Yeah but you killed that. So it seems to me that if we do local_disk=False we either need to build the BDM under the covers, or we need to allow the BDM in the flavor as well.16:20
cburgessjohnthetubaguy How does that impact this exactly?16:20
mriedemif we build the bdm under the coveres if local_disk=False, that's the same thing as https://review.openstack.org/#/c/432503/16:20
mriedemjust a different attribute on the flavor16:20
mriedem^ was doing is_bdm_flavor=True on the flavor16:20
mriedemsame idea16:20
cburgessOK16:21
cburgessWell...16:21
*** ijw has joined #openstack-nova16:21
johnthetubaguycburgess: people often assume 0 GB means no disk16:21
cburgessHonestly it seems reasonable to me. But then I thought that spec was reasonable to begin with.16:21
cburgessjohnthetubaguy Well they are wrong :P16:21
johnthetubaguycburgess: agreed16:21
mriedemcburgess: you're saying you like both ideas16:21
*** dtp has joined #openstack-nova16:21
mriedemthe abandoned spec, and the extra specs / bfv thing16:21
cburgessmriedem I'm saying disks are a total and complete mess and we have to find ways of making this easier and better to consume because right now the whole thing is a confusing mess.16:21
mriedemcburgess: you like anything that gets rid of your local patches :)16:21
*** Apoorva has joined #openstack-nova16:22
*** jaosorior_away is now known as jaosorior16:22
cburgessmriedem Yes.. but... I have those local patches because things are a mess. So I like anything that makes a cleaner, easier to use system for users.16:22
mriedemyeah i know,16:22
mriedemif a cinder ephemeral imagebackend is never going to happen, then maybe we go with https://review.openstack.org/#/c/432503/16:23
mriedemi just really dislike coupling two terrible tech debt things in nova, extra specs and bdms16:23
mriedembecause that's bound to be a maintenance nightmare16:23
cburgessWell I think a cinder ephemeral imagebackend is a long term thing. Question is what, if anything, can we do in a cycle or two.16:23
smcginnisI've been seeing more and more requests for using Cinder as ephemeral storage.16:23
mriedemcburgess: nothing is happening in pike16:23
mriedemb/c nothing was proposed before spec freeze16:24
mriedemsmcginnis: yes it has been for a long time, the question is how to best provide it w/o adding a bunch of tech debt to nova16:24
cburgessagreed16:24
mriedemas i said earlier, we already have apis that don't work with volume-backed instances16:24
mriedemlike, maybe we should fix some of that...16:25
johnthetubaguymriedem: but is that actually true? or just a bug?16:25
cburgessmriedem I know Boston isn't supposed to be a summit but... I kind of feel like we need a working session at some point to lay out what the correct roadmap for storage is.16:25
mriedemjohnthetubaguy: bugs, but big hairy bugs16:25
cdentcburgess: hasn't that sesssion happened at every summit for the last several years?16:25
cburgessmriedem Because we have been dancing around these issues for 2 cycles nw.16:25
mriedemjohnthetubaguy: cfriesen was just asking about volume-backed instance rebuild yesterday and how it doesn't work16:25
stackemptymriedem: so what would be my options for now .. to have something close to preventing local disk storage on the hypervisor ?16:26
EmilienMmriedem: hi, I was afk this morning. Please let me know how can I help wrt wsgi16:26
mgagnehehe, we used to have a similar need (default to BFV) in the past and implemented it with an ugly middleware: https://gist.github.com/mgagne/161bd7eaeb4c747fa1ae97c0bc43c09316:26
cburgesscdent Sort of. We keep doing it in terms of a feature request or two from individual parties (multi-attach, volume-type, etc).16:26
*** jpena|brb is now known as jpena16:26
* cdent nods16:26
*** gjayavelu has joined #openstack-nova16:26
cburgesscdent I'm thinking we need a more high level, ignoring all individual feature requests, what do we have now and where do we need to involve it too16:26
mriedemstackempty: it sounds like lots of providers have implemented downstream solutions16:26
*** bmace has joined #openstack-nova16:26
mriedemas cburgess and mgagne pointed out16:26
johnthetubaguymriedem: OK, I guess we have concrete examples then16:26
*** jaosorior has quit IRC16:26
*** jaosorior has joined #openstack-nova16:27
mriedemjohnthetubaguy: i had something in the ML recently about how shelve/unshelve is just totally ignorant wrt volues16:27
mriedem*volumes16:27
*** jaosorior is now known as jaosorior_away16:27
mriedemand we've had bugs open for over a year that haven't been resolved16:27
cburgessmriedem Another case for removing that feature16:27
johnthetubaguymriedem: yeah, that whole feature is un finished, so I expected that of shelve16:27
johnthetubaguycburgess: thats not a crazy plan16:28
mriedemmgagne: ok so that basically does https://review.openstack.org/#/c/432503/16:28
mriedemjust via paste middleware16:28
johnthetubaguyso is this a middle ground?16:29
johnthetubaguywe do https://specs.openstack.org/openstack/nova-specs/specs/newton/approved/flavor-root-disk-none.html16:29
cburgessjohnthetubaguy Never understood that one.16:29
cburgessjohnthetubaguy The shelve/unshevle feature I mean16:29
mgagnemriedem: yea, idea was to not be intrusive to nova code, a bit like wafflehaus from rax16:29
*** yangyapeng has quit IRC16:29
johnthetubaguycburgess: it was to do "stop" instance for local disks, where you only pay for the IP when it is shelved16:30
*** aarefiev is now known as aarefiev_afk16:30
cburgessjohnthetubaguy Creates all types of state and capacity management issues.16:30
cburgessjohnthetubaguy Don't like it, never liked it, anywho.. back to storage.16:30
johnthetubaguycburgess: allowing users to keep ports somehow, would be better16:30
johnthetubaguyyeah16:30
johnthetubaguy... so middle ground, possibly16:30
johnthetubaguywe do the 400 error if no BDMs16:31
cburgessRight..16:31
johnthetubaguyonce we have cinder backend in place16:31
johnthetubaguythe 400 becomes an auto create of that thing16:31
johnthetubaguy... actually thats messed up in a heap of other ways :(16:31
mriedemjohnthetubaguy: ^ means the api needs to know the compute is configured and capable of using cinder16:31
*** jamielennox is now known as jamielennox|away16:31
cburgessHonestly its ugly to do the 400 but it operationally better then today where you end up with instances sprinkled on hypervisor local storage and having to work iwht users to migrate the data to a volume and rebuild the instance with a volume.16:31
johnthetubaguymriedem: well, its a resource request, I think16:32
johnthetubaguycburgess: thats where I am, but I am biased, its what public cloud carries as a patch right now16:32
cburgessWhy do we need to do anything once we have the cinder backend?16:32
*** ijw has quit IRC16:32
johnthetubaguyso with cinder backend, you want to pick between local disk and cinder back end flavors16:32
johnthetubaguyso its more you get to re-use it16:33
johnthetubaguymeh, thats way too messy16:33
cburgessWell..16:33
*** ltomasbo is now known as ltomasbo|away16:33
cburgessSo today you pick a storage backend by selecting an AZ/aggregate.16:33
cburgessSince you can only have a single one today16:33
cburgessI guess once we can support different storage backends on a single node.16:34
johnthetubaguyI guess, via flavor extra specs I presume?16:34
cburgessCorrect16:34
cburgessSo here is the thing16:34
cburgessOnce we have the cinder backend we will have to be able to pass things like volume type, size ,etc.16:34
johnthetubaguyyeah16:34
cburgessSome of them exist as existing attributes on flavors (root_gb) but others don't and will be required.16:34
mriedemtype is the only one that's missing right?16:35
mgagneyou can have a default volume type in cinder16:35
cburgessmriedem I would have to look at it and think about it.16:35
mgagneunless you wish for your flavor to default to a different one16:35
cburgessmgagne Thats not sufficient16:35
cburgessmgagne Right exactly.16:35
cburgessmgagne A single default of the entire cloud is... limiting.16:35
mgagnesure, we both agree =)16:35
johnthetubaguyI think the problem here is the middle layer about the Nova API hasn't ever come into existance16:36
johnthetubaguys/about/above/16:36
mriedemstackempty: remember 40 minutes ago when i said you stepped into something? :)16:36
smcginniscburgess: +116:36
johnthetubaguyfeels like we need the use cases writing up and agreeing to move forward16:36
mriedemjohnthetubaguy: what is the middle layer about the nova api? the enamel idea?16:37
*** vks1 has joined #openstack-nova16:37
mriedem*above16:37
johnthetubaguymriedem: I think we thought heat might be that, but that turned out differently16:37
mriedemnova today, as-is, provides the APIs you need for something sitting on top to do this stuff16:37
*** ijw has joined #openstack-nova16:37
mriedemwhich is why we've always pushed back on adding volume type to the compute api16:37
cburgessmriedem johnthetubaguy I think we need to separate the flavor-root-disk-none and cinder backend idea entirely. The flavor-root-disk-none is a feature that regadless of backend disables a nova managed disk and requires BFV. It should be configured/enabled entirely independent of the cinder backend.16:38
*** fragatina has quit IRC16:38
cburgessI think we should just return the 400, as painful as that is and don't do any other magic under the hood.16:38
johnthetubaguyits basically saying, for this flavor, that optional argument is required16:38
johnthetubaguyi mean thats messy, but all the other fixes seem miles out16:39
mriedemcburgess: specifically so you can tie those types of flavors to certain host aggregates?16:39
cburgessWhat do you mean by this optional argument is required?16:39
mriedembdms are optional when creating a server16:39
cburgessOh right yes.16:39
mriedema flavor saying they are required makes them non-optional16:39
*** adrian_otto has joined #openstack-nova16:40
*** ociuhandu has quit IRC16:40
*** lucasagomes is now known as lucas-afk16:40
cburgessWhat if instead of local_disk=True/False we call it bdm_only=True/False. If false use existing logic if True, require BMD and ignore root/ephemeral/etc on flavor.16:40
*** ijw has quit IRC16:40
cburgessThat seems like it might be a bit cleaner and less confusing?16:40
cburgessor is it just symantics?16:41
johnthetubaguybut the bdm can have source=local16:41
johnthetubaguyI think16:41
cburgessWhat?16:41
cburgessReally?16:41
mriedemyes16:41
mriedemhttps://docs.openstack.org/developer/nova/block_device_mapping.html16:41
cburgessThat makes it use the hypervisor local instance path?16:41
johnthetubaguyits maybe more volume_backed_disks_only=True16:42
johnthetubaguycburgess: yup16:42
cburgessDear lord... we made a mess.16:42
mgagnewhat's the use case? Have a flavor with source=volume only? no local whatsoever?16:42
johnthetubaguycburgess: +116:42
cburgessmgagne Correct16:42
cburgessmgagne Make it impossible to ever have nova create disks of any type local to the hypervisors.16:42
mgagnelike johnthetubaguy suggested, maybe we need to define the use cases that need to be supported because I see a lot of them16:43
johnthetubaguyso some of them have API workarounds, some don't16:43
johnthetubaguyI think the no_local_disk thing is the big one with no workarounds today16:43
cburgessjohnthetubaguy mriedem The other way to do this is make it a confug option on the compute side. Not a flavor extra spec.16:43
mriedemnope16:43
mgagneyou can already restrict with max_local_block_devices but I think it's system-wide, not per aggregate or flavor16:43
johnthetubaguydon't like configs changing the API behaviour16:43
johnthetubaguycburgess: so you get it wrong, and you just get an instance in the error state, I guess?16:44
cburgessjohnthetubaguy scheduler does it16:44
cburgessThe compute node reports it can't host local disk16:44
johnthetubaguyyou still get an instance in the error sate16:44
johnthetubaguyI think16:44
mgagnethis means the request still manage to get to the scheduler, past the API16:44
mriedemnot if the scheduler can find a host that supports local disk16:45
cburgessjohnthetubaguy Thats not different then the 1000s of other things that the scheduler can barf on.16:45
johnthetubaguymgagne: I totally didn't know that existed, you are right, its API level I think16:45
mriedemwhich eventually becomes a trait on the compute resource provider16:45
*** gjayavelu has quit IRC16:45
cburgessmriedem Right which would be fine. If I want to support some local and some not that really a characteristic of the compute node directly.16:45
johnthetubaguymgagne: oh, I see your point, its system wide not per flaovr16:45
cburgessmriedem Right.. I was thinking a trait.16:45
mgagneyea so we would need something flavor scoped16:46
cburgessThis compute node can support local, this can't.16:46
cburgessBut thats a long way out again.16:46
johnthetubaguycburgess: yeah, I mean that all makes sense16:46
mriedemjohnthetubaguy: i knew about max_local_block_devices because people thought if you set it to 0 it meant nova would automagically always do bfv for you16:46
johnthetubaguymriedem: ah... right16:46
johnthetubaguymriedem: I remember that coming up now you mention it16:46
cburgessI actually don't know what that setting does.16:46
mgagnehttps://wiki.openstack.org/wiki/BlockDeviceConfig#max_local_block_devices16:46
*** derekh has quit IRC16:46
mriedemcburgess: traits are closer than everything else at this point16:46
mgagneit's only to prevent DoS16:47
johnthetubaguygives you 400 errors, I presume16:47
mgagneso people don't create an infinite amount of local disks16:47
cburgessAhh...16:47
cburgessOK..16:47
mriedemcburgess: so that's an alternative we haven't talked about before,16:47
cburgessmriedem Traits?16:47
mriedemtraits on the resource provider to say it's local_disk=False16:47
mriedemthen tag your flavor with local_disk=False16:47
mriedemscheduler / placement has to find a compute that matches those16:48
cburgessmriedem Why do we need to tag the flavr?16:48
*** Sukhdev_ has quit IRC16:48
melwittI thought BFV was supposed to get solved with placement. are you just talking about how to do it in placement?16:48
cburgessmriedem I'm not wild about having to set something in the flavor.16:48
*** usertm has joined #openstack-nova16:48
cburgessThe fact that a compute node can or can not host local disks is something the compute node is aware of.16:48
mriedemcburgess: how are you going to know where to put instances?16:48
cburgessYou shouldn't have to also set the right thing on a flavor.16:49
cburgessI flavor you should I need local disk and the compute node should be able to say "nope not me".16:49
mriedemso all of your bfv goes to the local_disk=False computes, and all non-bfv goes to the local_disk=True computes?16:49
cburgessmriedem Thinking through all the use cases...16:49
mriedemdansmith: super fun cells v2 meeting in 10 minutes i hope16:50
cburgessmriedem This is why I was suggesting a working sessions focused on this...16:50
dansmithoh yep16:50
mriedemcburgess: well, we have the forum session16:50
dansmithmriedem: didn't realize it was that late16:50
cburgessmriedem So many different use case16:50
mriedemcburgess: that's about as working as it's going to get at the summit16:50
cburgessmriedem I know...16:50
*** BobBall is now known as BobBall_AWOL16:50
cburgessmriedem How badly bike shedded would we get trying to do this on the ML?16:50
cburgessmriedem Where this = discuss different options.16:51
openstackgerritmelanie witt proposed openstack/nova master: Add get_count_by_vm_state() to Instance object  https://review.openstack.org/44624416:51
openstackgerritmelanie witt proposed openstack/nova master: Remove 'reserved' count from used limits  https://review.openstack.org/44624216:51
openstackgerritmelanie witt proposed openstack/nova master: Remove useless quota_usage_refresh from nova-manage  https://review.openstack.org/44624316:51
openstackgerritmelanie witt proposed openstack/nova master: Count instances to check quota  https://review.openstack.org/41652116:51
openstackgerritmelanie witt proposed openstack/nova master: Make Quotas object favor the API database  https://review.openstack.org/41094516:51
openstackgerritmelanie witt proposed openstack/nova master: Add online migration to move quotas to API database  https://review.openstack.org/41094616:51
*** tesseract has quit IRC16:51
mriedemcburgess: idk, it's probably worth starting to prime the pump for that session at the forum,16:51
mriedemso we don't start a 40 minute session discussing all of the history and previously discussed options16:51
mriedemand then find out we have 5 minutes left with nothing new to say16:51
*** marst_ has quit IRC16:52
cburgessmriedem What I don't like about most of the solutions we have discussed is that if you forget to flag a flavor correctly then it could get placed on a compute node that doesn't want local storage.16:52
mriedemcburgess: before starting a ML thread,16:52
mriedemmaybe i start an etherpad, which i'll need for the session anyway,16:52
cburgessmriedem I feel like we need a method that ensures a compute node can assert that it can never ever host a local disk.16:52
mriedemand we can start listing the use cases and options, and pros/cons for each option16:52
mgagnemaybe just list the use cases, we don't need to agree on the validity of the need, just list them, list associated workaround/limitations, etc. and start from there16:53
mriedem*then* put that in the ML for discussion16:53
cburgessmriedem Yeah.. lets start with an etherpad. Once we get it to an ok state we can post it to the ML.16:53
cburgessmriedem I like it.16:53
cburgessmgagne Right.. only rule out the most obviously insane ideas.16:53
mriedemmgagne: cburgess: i'll create an etherpad after the cells meeting and report back here16:53
*** udesale has joined #openstack-nova16:53
cburgessmriedem Rainbows16:53
mgagnewe can list them and explain later why we can't or don't want to support them16:53
mgagneso people don't come back later and ask why that one isn't listed16:54
mriedemlooks like the etherpads have started https://wiki.openstack.org/wiki/Forum/Boston201716:54
mriedemwhich was on my todo list anyway16:54
cburgessmgagne I'm only advocating ruling out things like "create a new top level openstack project" or other things of that level.16:54
* johnthetubaguy looks forward to reviewing the etherpad16:54
*** hieulq_ has joined #openstack-nova16:56
*** eglynn has joined #openstack-nova16:56
*** udesale has quit IRC16:58
*** mvk has quit IRC17:00
*** moshele has joined #openstack-nova17:00
*** ijw has joined #openstack-nova17:01
*** ociuhandu has joined #openstack-nova17:01
*** ijw has quit IRC17:05
*** fragatina has joined #openstack-nova17:05
mordredcdent: what does placement use in the id field of its version doc?17:06
* cdent refreshes his memroy17:08
*** claudiub|2 has joined #openstack-nova17:08
cdentmordred: the min version17:08
cdentwhich is a fudge17:08
cdentit might make sense to split on '.' and use [0]17:09
*** ijw has joined #openstack-nova17:09
*** ociuhandu has quit IRC17:10
*** claudiub|3 has joined #openstack-nova17:11
*** claudiub has quit IRC17:11
*** ericyoung has joined #openstack-nova17:11
*** Qiming has quit IRC17:12
*** claudiub|2 has quit IRC17:14
*** Qiming has joined #openstack-nova17:14
mordredcdent: ok. so it does have a value in id17:14
cdentyeah, but it puts nothing in the url that indicates version and has no plan to17:14
*** eharney has quit IRC17:15
*** brault has joined #openstack-nova17:16
*** sumedhdegaonkar has joined #openstack-nova17:16
sumedhdegaonkarHello all, this is my first review request, so please bear with me. I'd like to get your opinion/review of https://review.openstack.org/#/c/459794/   - It's just removing a restriction to use of 'sata' disk bus type for qemu and kvm. No change to default behavior or selection and hence in my opinion, no need to update test cases17:17
*** ijw has quit IRC17:17
*** Swami has quit IRC17:20
*** brault has quit IRC17:20
*** hamzy has joined #openstack-nova17:20
*** esberglu has quit IRC17:21
*** ociuhandu has joined #openstack-nova17:21
*** gjayavelu has joined #openstack-nova17:21
*** kornica has quit IRC17:23
*** ociuhandu has quit IRC17:26
*** yangyapeng has joined #openstack-nova17:30
openstackgerritRafael Folco proposed openstack/nova master: placement: Specific error for inventory in use  https://review.openstack.org/46023117:30
*** yamahata_ has joined #openstack-nova17:30
*** moshele has quit IRC17:30
*** eharney has joined #openstack-nova17:30
*** Apoorva_ has joined #openstack-nova17:30
cdentmriedem: way back in earlier conversation you mentioned a bug in gabbi with left hand side json path substitutions. I meant to link you to this: https://github.com/cdent/gabbi/issues/17017:31
cdentbut also to ask: was that germane to what were talking about at the time, or just an observation?17:31
mriedemit was related17:32
mriedemi was also looking through the gabbits for an example of a response17:32
mriedemto see the keys17:32
*** mvk has joined #openstack-nova17:32
*** vks1 has quit IRC17:32
cdentmriedem: I could fix that bug in the case you're talking about it is often easier to make the right hand side more complete (a structure instead of a string)17:33
*** Apoorva has quit IRC17:33
*** esberglu has joined #openstack-nova17:35
*** yangyapeng has quit IRC17:35
*** esberglu has quit IRC17:36
*** esberglu_ has joined #openstack-nova17:36
mriedemnot a priority for me, i just noticed the comments in the gabbits about the limitation17:37
mriedemapi-ref is the priority,17:37
*** slaweq has joined #openstack-nova17:37
mriedembecause then i don't need to look at gabbits17:37
cdenti regret slinging that name around17:38
*** slaweq has quit IRC17:40
*** pcaruana has quit IRC17:40
openstackgerritSteven Webster proposed openstack/nova master: Improve comment for PCI port binding update  https://review.openstack.org/46023317:43
*** hieulq_ has quit IRC17:44
*** gszasz has quit IRC17:44
*** Sukhdev has quit IRC17:46
*** jpena is now known as jpena|off17:47
*** adrian_otto has quit IRC17:49
mriedemmgagne: cburgess: johnthetubaguy: stackempty: here you go https://etherpad.openstack.org/p/BOS-forum-using-cinder-for-nova-ephemeral-storage17:51
*** ociuhandu has joined #openstack-nova17:51
cburgessmriedem Are we open to having a 'short term' and a 'long term' set of goals and solutions?17:51
mriedemi think you could tag things that way17:52
mriedemi'm open to eating lunch17:52
mriedemso bbiab17:52
*** dtp has quit IRC17:53
*** dtp has joined #openstack-nova17:53
*** hongbin has joined #openstack-nova17:55
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Refactor encryptor attach and detach calls  https://review.openstack.org/46024317:55
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Attach and detach encryptors during swap_volume  https://review.openstack.org/46024417:55
*** ociuhandu has quit IRC17:55
*** efoley_ has quit IRC17:56
cburgessmriedem Just doing that myself17:57
*** abalutoiu has joined #openstack-nova17:58
*** cjvolzka has joined #openstack-nova18:00
*** tonygunk has quit IRC18:02
mgagnecburgess: so there are 2 use cases? : 1) Provide a default BDM 2) Prevent/forbid source=local in BDM18:04
mgagnein fact, destination=local18:05
dansmithdoes anyone know if test_delete_server_while_in_building_state is known to be flaky at the moment? logstash doesn't seem to think it's spiking but I see plenty of failures that aren't in my patch, like even on periodic stable jobs18:06
dansmithmriedem: sdague ^18:06
*** slaweq has joined #openstack-nova18:11
*** tonygunk has joined #openstack-nova18:11
mgagnecburgess: what do you think about the idea of having a "default bdm" for flavor-root-disk-none ? If you provide no BDM, the root_gb size is used to create a volume for you for your root disk. (flavor could also provide default volume type) This means no 400 HTTP error by default as a sane behavior/default is provided. An other extra spec or flavor attribute could forbid destination=local so if BDM is provided, it still respect the no-local-dis18:12
mgagnek policy.18:12
cburgessmgagne Thats a decent idea. Pull size from root_gb and image_id from request spec.18:12
mgagneyes18:12
mgagnethat's basically what we did on our side18:13
*** baoli has quit IRC18:13
mgagnealso this could allow Horizon or dashboard to present appropriate UI (default to BFV view or something like that)18:13
mgagneI also see 2 sub use cases: 1) flavor itself *never* support local disk. 2) specific compute nodes *never* want local disk. // One can be implemented without the other.18:14
cburgessRight so #2 is my biggest concern and the biggest pain right now. Ensuring it can never happen. Because if it does happen you end up with data a user might care about living on a single local disk on a compute node, and thats very bad.18:16
mgagneok, can I take the liberty of splitting the use cases on etherpad?18:16
cburgessmgagne Sure18:17
*** slaweq has quit IRC18:17
openstackgerritOpenStack Proposal Bot proposed openstack/os-vif master: Updated from global requirements  https://review.openstack.org/45104918:17
cburgessmgagne I prefer that actually as I think there are 2 orthogonal needs 1) Making BDM/cinder integration better, 2) Making sure we can block local disk.18:17
mgagneyes18:17
*** ralonsoh has quit IRC18:17
*** slaweq has joined #openstack-nova18:18
cburgessmgagne #2 we should focus on a 1-2 cycle solution, for #1 we should take a step back and say whats need to really do this right (aka the cinder imagebackend).18:18
mgagne100% agree18:18
mgagnewhat about ephemeral disks or swap? what's your take?18:19
cburgessPersonally I love the idea of a cinder imagebackend but to do that right I think its going to require first rewritting the existing backends to have a much more modular and cleaner seperation.18:19
mgagneyes, I found the task to be near impossible without major refactor when I checked years ago, hence the middleware hack18:20
cburgessmgagne I don't understand the use case for either of those. Honestly I would vote to remove them from nova entirely but I know that wouldn't fly. The question is should we require all backends to support them or should we make those optional.18:20
mordredmgagne, cburgess: in the name of requesting absurd features from people while the local vs. remote disk discussion is taking place ...18:20
cburgessmgagne Right. We also have cases where things like instance_path are used both for the imagebackend and for non-imagebackend things like console logs, libvirt xml etc. So we have to get a clean separation there as well.18:20
*** baoli has joined #openstack-nova18:21
cburgessmordred Yes......?18:21
mordredno-local-disk is really useful in both keeping data protected and making sure live migration can happen well ...18:21
erhudyis the goal to eventually turn over all responsibility for block storage to cinder and remove it from nova entirely?18:21
cburgesserhudy Thats is not my goal.18:21
cburgesserhudy My goal is to provide an improved integration between nova and cinder.18:21
mordredbut depending on workload, the user might also know "this node is part of an application-level high availablity set, killing it and its data rather than live-migrating it is fine"18:22
mordredespecially when for those things locally attached things that behave like ephemeral disk does today is nice becaues of the lack of network latency hop between the vm and disk18:22
*** slaweq has quit IRC18:22
mgagnecburgess: So having the ability to split imagebackend/disk from "hypervisor" (logs, xml) files is something an operator should be able to do?18:22
cburgessmordred Hmm hand't thought about that. data volume on cinder, but a local ephemeral disk for "fast" scratch.18:23
mordredyah18:23
mordredbut as a user opt-in sort fo thing18:23
mordredsince it's definitely a choice witha tradeoff involved18:23
cburgessmgagne Well.. I think the only way to truely make imagebackend modular enough to support cinder we would have to have that clean seperation since cinder isn't going to provide us a way of storing that data.18:23
erhudycburgess: that can be done now18:23
cburgesserhudy Which thing?18:24
mgagnecburgess: that's the use case I can think of, like on SSD or NVMe18:24
erhudydata/root volumes on cinder with local storage ephemeral disk18:24
*** ijw has joined #openstack-nova18:24
erhudywhat i keep coming back to as part of our architecture discussions here is wanting to be able to do something like AWS instance store volumes, which afaik doesn't really have an analogue in nova18:24
cburgesserhudy Yes I'm aware. mordred was pointing out that my state of "kill ephemeral in a fire" didn't take into acount that very valid use case.18:24
mordredcburgess: the mirror.*.openstack.org farm is a good example- the only things on the local disk are cache - everything else is stored somewhere else18:25
erhudyyou can pass whatever you like to nova in the BDM but unless it matches your flavor it gets rejected18:25
mordredbut we'd be totally fine with the datain the ephemeral going away for those nodes, and could opt-in at boot to that and _maybe_ that makes something better for someone somewhere18:26
*** gyee has joined #openstack-nova18:26
mordred"hey, we actually don't find the stuff in X precious, DNR" :)18:26
erhudy"ephemeral" in nova-ese is different from "ephemeral" in AWS-ese anyway, which confused a lot of our users18:26
cburgessmordred right. Its def a valid use case. We should make it possible for a user to request a local disk as well *if* the compute node supports it.18:26
mordredcburgess: ++18:26
cburgesserhudy Its very confusing and something it would be good to clear up some as we think about what would be involved in "fixing" storage in nova.18:27
mordredthere are definitely places where we're using cinder volumes for things that are totally non-precious because it's the only way we can get our hands on the disk18:27
mgagnecburgess: isn't this use case already supported? like have a flavor with local root + 1 ephemeral + 1 attached volume for your data.18:27
erhudysounds like the sort of dilemma where you can ask 10 people and get 11 answers18:28
cburgessmordred We are seeing more and more client deploying there clouds that way. Some cinder integrated storage device and no local storage at all.18:28
*** Guest61656 has quit IRC18:28
mordredcburgess: yah. I mean, in those cases we're fine using cinder- I just mostly don't want to stress out someone's storage backplane if there's cheaper/crappier disk available too18:28
erhudywe are leaning that way in our current greenfield setup, doing it all on ceph, but we may keep nova local storage around for certain use cases18:28
mordredfor _some_ things18:28
cburgessmgagne Its is. The question is, if we are looking at designing a more modular imagebackend with a local, ceph, lvm, and now cinder plugin do we want to require all backends to support the use case or say "if you want this use case you must deploy this backend with this configuration".18:29
mordredcause if I'm doing, say, ceph _in_ the cloud - but I can only get disk via cinder which is on ceph _under_ the cloud18:29
*** ijw has quit IRC18:29
mgagneright, I have no answer to that one18:29
erhudythe downside of the local storage setup is, i can give somebody /dev/vda on local storage, if i make a special flavor with ephemeral defined i can give them /dev/vdb as well18:29
mordredthen _wow_ is that data super extra redundant18:29
cburgessmordred Oh I agree completely. Not passing judgement on good or bad, just saying its a trend we are seeing with our clients.18:29
erhudybut no way to let them provision more local volumes after that18:29
mordredcburgess: ++18:29
mgagneerhudy: sounds like a good idea18:30
erhudyit's only a good idea because nova storage doesn't get tracked in quota18:30
*** READ10 has quit IRC18:30
mgagneI mean, do you want them to get more local disks or not?18:30
erhudyi want to be able to provide them the same thing they can get on AWS with instance store volumes18:30
*** adrian_otto has joined #openstack-nova18:30
erhudyand me providing RBD via cinder is the analogue to EBS18:31
*** yangyapeng has joined #openstack-nova18:32
cburgessmgagne So the hypervisor files aren't counting toward quota today, but they do count towards the available/used storage of the backend.18:32
mgagnefor those that wonder what's instance store volumes: http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/InstanceStorage.html18:33
cburgessmgagne So *if* we split all that out we need to think about how that might impact scheduling decisions.18:33
erhudythat was why i originally asked about whether the idea was to eventually eliminate nova's block storage and just turn it all over to cinder18:33
mgagnecburgess: sure. more or less implementation details at this point.18:34
cburgesserhudy I'm not advocating removing the other backends. I'm simply advocating creating a clean separation so that a cinder backend is viable.18:34
cburgessmgagne Agreed18:34
cburgessAs mordred pointed out there are viable use cases for the pure local option that nova offers today.18:35
cburgessBut given how overload things like instance_path are today, it makes a clean separation difficult.18:35
mgagneerhudy: wow "data in the instance store is lost under the following circumstances: The instance stops"18:35
erhudymgagne: okay, not _exactly_ the same thing18:36
mgagnejust reading about the concept for now18:36
cburgessmgagne Yeah instance storage on AWS is *super* ephemeral.18:36
erhudybut fundamentally the ability to be able to provision extra volumes that will land on local storage versus going to some replicated backend18:36
jaypipesholy channel traffic... man, I need to read back a whole bunch...18:36
erhudywithout having to create new flavors where the only difference is some have ephemeral disk sizes specified and some don't18:37
mgagnehowever it's only available at creation time right?18:37
openstackgerritArtom Lifshitz proposed openstack/nova master: Plumbing for tagged nic attachment  https://review.openstack.org/41562218:37
openstackgerritArtom Lifshitz proposed openstack/nova master: Delete nic metadata when detaching interface  https://review.openstack.org/43538718:37
*** Apoorva_ has quit IRC18:37
openstackgerritArtom Lifshitz proposed openstack/nova master: Libvirt support for tagged volume attachment  https://review.openstack.org/41810018:37
cburgessjaypipes Don't worry we made it all a placement problem.18:37
openstackgerritArtom Lifshitz proposed openstack/nova master: Delete disk metadata when detaching volume  https://review.openstack.org/43508218:37
openstackgerritArtom Lifshitz proposed openstack/nova master: Plumbing for tagged volume attachment  https://review.openstack.org/39194118:37
openstackgerritArtom Lifshitz proposed openstack/nova master: API support for tagged device attachment  https://review.openstack.org/37602118:37
jaypipesthx Chet :)18:37
openstackgerritArtom Lifshitz proposed openstack/nova master: Libvirt support for tagged nic attachment  https://review.openstack.org/41552018:37
cburgessjaypipes Just felt like the right thing to do.18:37
*** Apoorva has joined #openstack-nova18:38
*** yangyapeng has quit IRC18:38
*** arunman has quit IRC18:38
erhudymgagne: yes, they have to be added at launch time18:38
erhudy"they" being instance store volumes18:38
erhudyso it's effectively letting the user specify the number and size of ephemeral disks they want instead of the operator encoding it into the flavor18:38
mgagneerhudy: right. can you explain what's the purpose of the table found on this page? Is it some kind of limitations/specs per flavor? Like you can create "up to" the limits mentioned? http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/InstanceStorage.html#instance-store-volumes18:39
*** voelzmo has joined #openstack-nova18:39
*** MasterOfBugs has quit IRC18:40
erhudyyeah, i don't know where the particular restrictions on each instance type come from, i assume it has to do with the physical characteristics of the SKUs they run on18:41
*** baoli has quit IRC18:42
mgagnefor example, the C3 instance types here: https://aws.amazon.com/ec2/instance-types/ The listed SSD storage matches the ones found in the table above. So I feel it's a bunch of instance store volume provided by default, you don't have the choice of the number or size?18:43
erhudyi will walk through instance launch for a c3.large and tell you in 3 minutes18:44
mgagneyou are a winner18:45
mgagnebecause if they are ALL provided by default, it would be the same as ephemeral disks provided by Nova (missing the fact that you lose your data if you stop the instance)18:46
*** fragatina has quit IRC18:46
*** fragatina has joined #openstack-nova18:46
mriedemdansmith: haven't heard anything about that test spiking18:47
dansmithmriedem: okay I figure it must be something in my stuff, I just don't know what.. I'm stacking now locally to try and poke at ti18:47
erhudymgagne: the way it looks on the add storage step for the default amazon linux AMI (which is on EBS) is i see root, /dev/xvda18:47
erhudythen i can add instance store 0, and then instance store 118:48
erhudythey are not there by default18:48
*** baoli has joined #openstack-nova18:48
mgagnedoes the limit match the table? Can you add 20 disks if you want?18:48
erhudyno, i can only add those 218:48
mgagnetable mentions 2 x 16 GB (32 GB)18:48
erhudyso it matches that quantity given18:48
mgagnewith no choice of size?18:48
erhudyno choice of size, it doesn't even show a size in the table18:49
mgagnelike it's 16GB or nothing18:49
*** marst_ has joined #openstack-nova18:49
mgagneok18:49
mgagneso this could be done with bdm where destination=ephemeral in Nova?18:49
*** damien_r has joined #openstack-nova18:50
erhudyit could, yeah18:50
mgagneand find a way to limit/define the number/size of ephemeral disks per flavor18:50
erhudyso expanding the existing ephemeral functionality and making it an "up to" sort of thing on the flavor?18:50
mgagneerhudy: AFAIK, the number of ephemeral disks is hardcoded no? you can't have 20 for example18:51
erhudythe max number is part of the EC2 instance type, yeah18:51
erhudyso if i back this launch request out and try another one, one sec18:52
mgagneI mean, in Nova, I think the limit is 1 ephemeral disk as per ephemeral_gb field18:52
*** usertm has quit IRC18:52
erhudyso like, if i pick f1.16xlarge, i'm now allowed to provision up to 4 instance store volumes18:52
erhudyper that table18:52
mgagnelogic/behavior looks sane so far18:53
erhudythe main thing i like about the AWS model is by default you get 0, but you can go up to however many are allowed by the instance type, and you don't need to have separate flavors for 0 versus 1+18:54
openstackgerritMoshe Levi proposed openstack/os-vif master: WIP Revert "Revert "hardware offload support for openvswitch"" Don't merge until OVS patches are upstream This reverts commit f154ef9cc8f9a14273b7c48ac29cb828cd25109a.  https://review.openstack.org/46027818:54
mgagneerhudy: well, there is a sane policy/default provided per flavor. Some just requires you to have EBS, no local disks.18:54
erhudyyes18:55
erhudywhich probably goes back to the SKUs that instance type runs on18:55
erhudythe EC2 guys probably curse local storage as much as openstack operators do18:55
*** ociuhandu has joined #openstack-nova18:55
erhudyand said "let's have some SKUs where we don't have to deal with local storage"18:56
*** eandersson has joined #openstack-nova18:57
mgagneyes + less complaints from people screaming: where did my data go?18:58
eanderssonHey - is having redundant memcached server for nova-novnc an issue in Mitaka?18:58
eanderssonEvery other request fails with two memcached servers enabled.18:58
erhudydo you have memcached binding to an external interface and not localhost?18:59
erhudymgagne: i don't necessarily advocate the AWS model of ephemeral/instance store volumes vaporizing everything on reboot18:59
erhudyi'd have to ask around to find why it works that way19:00
mgagnesure, no judgement for or against the behavior here =)19:00
*** damien_r has quit IRC19:00
mgagneerhudy: could be that after an instance is stopped, there is no guaranty you will start on the same host later?19:00
erhudymgagne: that's my guess19:01
erhudypart of why i want to retain local storage despite the inconveniences is because our distributed storage backend is ceph, which is great, but without per-client metrics and being able to provision IOPS on each client a single noisy neighbor can make the entire ceph cluster miserable19:01
erhudythat's a separate discussion we're having with red hat19:01
*** MasterOfBugs has joined #openstack-nova19:02
openstackgerritChris Dent proposed openstack/nova master: Add pbr-installed wsgi application for metadata api  https://review.openstack.org/45941319:02
mriedemdansmith: did you see this? https://review.openstack.org/#/c/433476/19:03
*** fragatina has quit IRC19:04
*** fragatina has joined #openstack-nova19:04
openstackgerritRick Bartra proposed openstack/nova master: Add policy granularity to the Flavors API  https://review.openstack.org/44928819:05
dansmithmriedem: hah no19:09
jaypipesedleafe, dansmith, cdent, mriedem: https://review.openstack.org/46028119:09
eanderssonerhudy, you mean localhost+second memcached?19:09
eanderssonor just a single memcached?19:10
dansmithmriedem: I agree, it seems silly to not allow deleting the cell0 record.. it's the one cell record you _can_ delete and recreate if needed19:10
mriedemthe bug report is pretty thin,19:10
mriedemit just says "you shouldn't be able to do this"19:10
mriedementirely opinionated19:10
*** baoli has quit IRC19:10
dansmithmriedem: yeah..19:10
mriedemdansmith: i'd +2 if you revert19:10
cdentjaypipes: that's quite the name. will look more closely soon (which might include tomorrow morning)19:11
*** lpetrut has joined #openstack-nova19:11
dansmithmriedem: cool, I think it's probably worth reverting19:11
*** baoli has joined #openstack-nova19:12
edleafejaypipes: why not build that on top of the automated import patch?19:12
openstackgerritDan Smith proposed openstack/nova master: Revert "Prevent delete cell0 in nova-manage command"  https://review.openstack.org/46028419:13
dansmithmriedem: ^19:13
mriedemjaypipes: comments / questions inline19:15
erhudyeandersson: if every other request is failing it sounds like it's trying to round-robin between the memcached instances and can hit one but not the other19:15
jaypipesedleafe: because it's not related... it's a different branch.19:15
jaypipesedleafe: if the auto-import merges first, I'll quickly rebase. no biggie.19:15
erhudyso, iptables or memcached configuration seem like possible culprits19:16
mriedemmelwitt: https://review.openstack.org/#/c/460284/19:16
eanderssonerhudy, every other nova service works fine though19:16
eanderssonit's just nova-novnc that is having issues with this configuration19:16
edleafejaypipes: just thought I'd save ya some of that ugly typing... :-P19:17
*** Kevin_Zheng has quit IRC19:17
eanderssonbut yes it looks like it is round-robin19:17
erhudymaybe strace nova-novncproxy and see what it's sad about? strace is usually what i turn to in Mysterious Situations19:18
erhudyor strace memcached, even19:19
erhudyonce upon a time i had strange issues after going kilo->liberty and strace revealed it was because liberty was using memcached more aggressively and memcached had silently run out of connections19:19
erhudywe can take this over to #openstack though instead of filling up dev chat with ops stuff19:19
*** esberglu_ has quit IRC19:21
melwittmriedem: +W19:21
*** marst_ has quit IRC19:22
*** slaweq has joined #openstack-nova19:23
*** eglynn has quit IRC19:25
melwittjaypipes: thanks for braving the quota patches. working on replies19:27
*** slaweq has quit IRC19:28
*** ijw_ has joined #openstack-nova19:31
jaypipesmriedem: answerd.19:32
*** ijw_ has quit IRC19:32
jaypipesmelwitt: sure, no prob. it's a mess in there :)19:32
*** ijw_ has joined #openstack-nova19:32
*** rmart04 has quit IRC19:33
*** baoli has quit IRC19:34
melwittjaypipes: I tried to make it make sense but I failed, so sorry about that :(19:34
*** yangyapeng has joined #openstack-nova19:35
jaypipesmelwitt: and you're not the cause of the indecipherability :)19:35
melwittmy goal was to code comment it enough to where laypersons could understand it19:35
melwittbecause learning it myself was extremely painful and wanted to make it easier for others19:36
*** ericyoung has quit IRC19:36
melwittjaypipes: the dicts returned from count() are evil and that was me, I will try to think of another way19:37
jaypipesmelwitt: yeah, I hear ya. definitely not bemoaning your code. it's just a pit of vipers in general.19:38
melwittI know. not taken that way :)19:38
jaypipesk, cool :)19:38
*** Qiming has quit IRC19:39
*** ijw_ has quit IRC19:40
*** yangyapeng has quit IRC19:40
*** ijw has joined #openstack-nova19:40
*** Qiming has joined #openstack-nova19:42
mriedemjaypipes: ok, replied in https://review.openstack.org/#/c/460281/ as well,19:43
melwittmriedem: been meaning to tell you about this, I found a bug in the BackOffLoopingCall that was causing that ironic test to timeout intermittently (160s test timeout whereas the backoff timeout should have expired well before that) https://review.openstack.org/#/c/459790/19:43
mriedemjaypipes: also mentioned at a higher level that i don't know that the plan as you describe it in there is actually written down anywhere19:43
*** ijw has quit IRC19:44
mriedemmelwitt: heh, nice, i guess that really bugged you19:44
*** eharney has quit IRC19:45
*** awaugama has quit IRC19:45
jaypipesmriedem: I got dinged for being too verbose in specs, then dinged for not having everything written down ahead of time...19:45
jaypipescan't win for losin.19:45
melwittmriedem: yup, I became obsessed with it19:46
mriedemjaypipes: i know19:46
jaypipesmriedem: I'll try to write something up tomorrow.19:46
mriedemjaypipes: i'm +2 on the change after you explained the plan, i just wouldn't have known otherwise19:46
jaypipesunderstood.19:46
*** jamielennox|away is now known as jamielennox19:52
mordredjaypipes: write down more things, but then delete hide them19:52
jaypipesheh19:52
*** tbachman has quit IRC19:55
*** baoli has joined #openstack-nova19:56
*** iceyao has joined #openstack-nova19:57
*** baoli has quit IRC19:59
*** baoli has joined #openstack-nova19:59
mriedemjaypipes: dansmith: anything off the top of your head that we already know is going to be a focus for queens? besides just anything that doesn't make pike? things that come to mind are volume multiattach, cinder ephemeral / no local disk19:59
*** Apoorva has quit IRC19:59
mriedemremoving caching scheduler isn't really a feature19:59
mriedembut claims in scheduler would be required in queens20:00
jaypipesmriedem: VGPU.20:00
*** eharney has joined #openstack-nova20:00
dansmithmriedem: full shared storage, shared network reporting and stuff20:00
jaypipesmriedem: port pair allocations with SR-IOV.20:00
dansmithmriedem: hopefully some locality/affinity in placement20:00
openstackgerritAbhishek Sharma M proposed openstack/nova master: Catching OverQuota Exception  https://review.openstack.org/45511820:00
openstackgerritAbhishek Sharma M proposed openstack/nova master: Catching OverQuota Exception  https://review.openstack.org/46029320:00
*** esberglu has joined #openstack-nova20:00
dansmithyeah, GPU and SRIOV love in placement20:00
jaypipesdansmith: yeah. ++ on affinity stuff.20:00
jaypipesheh, much love.20:01
*** pchavva has quit IRC20:01
*** iceyao has quit IRC20:01
*** adrian_otto has quit IRC20:02
*** ijw has joined #openstack-nova20:02
*** fandi has quit IRC20:04
cburgessdansmith mriedem Thinking fill shared storage and cinder ephemeral both probably depend on a re-write of the imagebackend interface and creating cleaner seperation and modularization of that area of the code.20:04
*** esberglu has quit IRC20:05
dansmiththat's at least a cycle of work probably20:05
dansmithunless it's all we do20:05
cburgessdansmith Probably right. Just trying to figure out how we could do shared storage or a cinder backend properly without fixing that dumpster fire induced miasma.20:07
dansmithTIL a new word20:07
cburgesslol20:07
*** ijw has quit IRC20:08
cburgessmiasma?20:08
dansmithno "shared"20:08
dansmithyes miasma :P20:08
cburgessI try and educate as well as provide bad ideas, and donuts, to the nova community.20:09
cburgessIts just one of my many redeeming qualities.20:09
dansmithand we thank you for it20:09
*** ijw has joined #openstack-nova20:09
* dansmith nods20:09
sean-k-mooneyjaypipes: do you think the user controlled port pair allocations will slip to queens?20:10
jaypipessean-k-mooney: considering it didn't land for Pike... yes.20:11
sean-k-mooneyjaypipes: i have been getting some question lately about doing bonding with sriov for ha and performacne which would need that20:11
sean-k-mooneyoh ya we are past spec deadline20:11
*** brault has joined #openstack-nova20:12
*** smatzek has quit IRC20:12
*** voelzmo has quit IRC20:13
openstackgerritRafael Folco proposed openstack/nova master: placement: Specific error for inventory in use  https://review.openstack.org/46023120:15
*** brault has quit IRC20:16
*** Apoorva has joined #openstack-nova20:17
*** tbachman has joined #openstack-nova20:19
*** annegentle has quit IRC20:20
mriedemjaypipes: i don't know what "port pair allocations with SR-IOV" means20:29
mriedemdansmith: isn't gpu/sriov love in placement == nested resource providers == pike?20:30
dansmithmriedem: there's virt driver work that needs to be done that I don't think is going to happen in pike20:31
dansmithcertainly for gpu20:31
mriedemanything forward looking for cells v2 in queens?20:33
mriedembesides fix all the bugs we introduce in pike? :)20:33
jaypipesmriedem: https://review.openstack.org/#/c/182242/20:33
mriedemoh i suppose integration of limits in keystone20:33
jaypipes++20:33
mriedemjaypipes: oh right, that spec...20:33
dansmithmriedem: well, yeah, all the bugs, but also presumably we'll have plenty of performance things to work out20:34
mriedemjaypipes: that's the one where the "user" is a single tenant NFV machine right?20:34
mriedemok here is the list: "VGPU support, full shared storage/network reporting and affinity support in the placement service, volume multi-attach, Cinder as ephemeral backend, integration of limits in Keystone, Cells v2 hardening."20:35
mriedem"+ delete shelve"20:35
mriedem:)20:36
dansmithyou have my vote20:36
dansmithHTTP 420: Sorry I dunno where I left that shelve feature.. please try again... uh, never.20:36
mriedemstoner apis20:36
mriedempsh20:36
dansmithheh20:36
*** yangyapeng has joined #openstack-nova20:37
jaypipesmriedem: yes.20:37
*** salv-orlando has joined #openstack-nova20:38
*** Sukhdev has joined #openstack-nova20:39
*** nkorabli has joined #openstack-nova20:40
mriedem(optional) Do you have questions for users that can help inform/guide your development teams?20:40
mriedemoh boy20:40
mriedemi can't remember what i asked about this for pike20:40
mriedem"do you use any microversion > 2.1?"20:41
mriedemthat could be a legit question20:41
openstackgerritAbhishek Sharma M proposed openstack/nova master: Catching OverQuota Exception  https://review.openstack.org/46030520:41
dansmithhah20:41
*** READ10 has joined #openstack-nova20:41
*** crushil has quit IRC20:41
mriedemb/c we're always coding 18 months ahead at least20:41
mriedemand have no idea20:41
*** yangyapeng has quit IRC20:42
*** dixiaoli has joined #openstack-nova20:43
*** nkorabli has quit IRC20:44
*** dimtruck is now known as zz_dimtruck20:46
*** iceyao has joined #openstack-nova20:46
*** dixiaoli has quit IRC20:47
*** zz_dimtruck is now known as dimtruck20:49
*** cdent has quit IRC20:50
*** iceyao has quit IRC20:51
mriedem"While the majority of users aren’t currently using Nova cells, about 146 deployments reported using cells, which is substantially more than the 67 users reporting using Nova cells one year ago. "20:51
*** smatzek has joined #openstack-nova20:52
*** abhi89 has joined #openstack-nova20:52
abhi89johnthetubaguy: Hi20:53
abhi89Hi all.. can someone please review https://review.openstack.org/#/c/460305/20:55
mordredmriedem: I fully expect to start consuming microversions in the next 6 months20:55
mriedemoh right this was the question20:55
mriedem"How important is it to be able to customize Nova in your deployment? e.g. classload your own managers/drivers, use hooks, plug in API extensions, etc."20:55
mordredI was very happy to see the low numbers of "we use this extensively"20:56
mriedem51% not important, 39% somewhat, 10% very20:56
mordreds/low/lowish/20:56
jaypipesdansmith: you're gonna love all this shared resource provider SQL...20:57
* edleafe has this image of mordred sitting at a dining table, gulping down micronversions20:57
mriedemi see that neutron asked about actual feature usage/adoption20:57
mriedemthat's something we could breakdown at some point, and have wondered about, i.e. does anyone actually use shelve?20:58
mordrededleafe: I'll try to start with an amuse bouche, but that's probably not too far off20:58
*** wxy has quit IRC20:58
mordredmriedem: I don't20:58
mriedempage 60 https://www.openstack.org/assets/survey/April2017SurveyReport.pdf20:59
mriedembreaking something down like that in nova wouldn't be trivial21:00
mordredno - but it would be worthwhile21:00
*** abhi89 has quit IRC21:01
dansmithmore than twice as many people patch in an unmaintained docker driver than use the in-tree xen support21:02
dansmithI'll remember that next time I have to fix something in there21:02
cfriesenI'm curious...are we expecting that eventually nova-api won't need a connection to the main nova db?21:02
mordreddansmith: that also highlights one of the big disconnects between what users want and what developers are funded to work on/maintain21:03
dansmithmordred: well, might've been a disconnect a couple weeks ago, but yeah21:03
*** nkorabli has joined #openstack-nova21:04
*** annegentle has joined #openstack-nova21:04
openstackgerritSteve Noyes proposed openstack/nova master: Add Cinder v3 detach to local_cleanup  https://review.openstack.org/45685121:05
mriedemdansmith: heh, and lxc more than both of those21:07
dansmithyeah21:07
mriedemwhich if people are using lxc,21:07
mriedemi'd sure like them to upstream their patch that makes the CI not completely fall over itself when deleting an instance21:07
dansmithheh yeah21:07
*** ijw has quit IRC21:08
*** haplo37 has quit IRC21:09
*** ijw has joined #openstack-nova21:10
mriedemi'd like to ask for feedback on newish things like placement and cells v2 but with a bunch of deployments on kilo, that's going to be hard to get21:12
*** annegentle has quit IRC21:12
*** abalutoiu has quit IRC21:12
*** abalutoiu has joined #openstack-nova21:13
openstackgerritRick Bartra proposed openstack/nova master: Add policy granularity to the Flavors API  https://review.openstack.org/44928821:14
mriedem1. Are you using REST API microversions > 2.1?21:14
mriedem2. Have you started evaluating or testing the Placement service?21:14
mriedem3. Have you started evaluating or testing Cells v2?21:14
mriedemis my list right now21:14
cfriesenmriedem: speaking of cells v2, the Newton release notes don't talk about the increase in the number of DB connections due to the need for services to talk to both DBs.21:14
mriedemcfriesen: sorry i saw your earlier question about the api21:15
mriedemcfriesen: i think you can disable the api from going directly to the db21:15
dansmithmriedem: you can't21:15
mriedemi was trying to answer this for someone internally last night21:15
dansmithand I have no plans to head that way21:15
mriedemdansmith: i thought you could make the api use the conductor indirection api?21:15
dansmithnot unless someone added it and I didn't know21:15
mriedemlike https://github.com/openstack/nova/blob/master/nova/cmd/compute.py#L5321:15
*** thorst_afk has quit IRC21:16
dansmithnope21:16
mriedemno it's not in tree upstream21:16
dansmithI can't imagine that not sucking balls21:16
dansmithof course, apparently we're fine with ~10s nova-list operations, so.. maybe nobody cares21:16
*** slaweq has joined #openstack-nova21:16
mriedemcfriesen: have you enabled the cells v2 stuff in newton? because it's not required there yet21:17
mriedemcfriesen: bully if you have21:17
mriedemi'm interested in feedback21:17
dansmithmriedem: well, api db was required in newton right?21:17
mriedemwe don't really get any sort of performance feedback upstream21:17
mriedemdansmith: api db has been required for several releases before newton21:18
mriedemi think liberty?21:18
mriedemfor reqspec21:18
dansmithyeah, he was asking about increased connections for api/nova db right?21:18
cfriesenmriedem: no, our clouds are small enough we don't use cells.   but we did see nova basically doubling the number of DB connections going from Mitaka to Newton.21:18
*** haplo37 has joined #openstack-nova21:18
mriedemactually i guess reqspec was mitaka https://review.openstack.org/#/c/211753/21:19
mriedemso what's hitting the api db in newton? build request right?21:20
*** thorst_afk has joined #openstack-nova21:20
cfriesenmriedem: yeah, I see the api db in mitaka21:20
clarkbdansmith: we cache the list results for that reason21:21
mriedemin newton i suppose we are using build request and looking up instance, host and cellmappings even if we're just getting NotFounds21:21
*** ijw has quit IRC21:21
dansmithclarkb: yeah, it's sad21:21
clarkb(as well as caching everyting else)21:21
cfriesenmriedem: aggregates maybe?21:21
dansmithcfriesen: no21:21
mriedemflavors are in the api db21:21
mriedemand keypairs, and aggregates, and server groups21:22
*** zhenguo has quit IRC21:22
mriedemand those are doing online data migrations21:22
*** abalutoiu_ has joined #openstack-nova21:22
cfriesenwe use aggregates and flavor extra specs a lot21:23
mriedemso we might have some overhead for checking for online data migrations which are not necessary once you've migrated everything21:23
melwittfor any target_cell, a new oslo.db _TransactionContextManager will be created to make the connection21:24
clarkbdansmith: that said we peaked booting at 30k instances a day across multiple clouds/regions so 10s isn't the end of the world21:24
clarkbdansmith: and I'm guessing more users do far less so its not a major headache21:24
dansmithclarkb: well, it still sucks, don't try to convince me :)21:24
clarkboh I agree, just trying to point out why people probably don'21:24
clarkbt scream at you21:24
melwittdansmith: is the 10s sans novaclient or is it novaclient?21:24
*** thorst_afk has quit IRC21:24
*** tbachman has quit IRC21:25
*** abalutoiu__ has joined #openstack-nova21:25
mriedemyeah doesn't novaclient look up the image for every instance to show the image name in the output?21:25
*** abalutoiu has quit IRC21:26
mriedemcfriesen: https://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L60221:26
*** smatzek has quit IRC21:26
mriedemshould give you an idea of online data migrations added in newton21:26
mriedemwhich is a lot21:26
cfriesenmriedem: thanks.   so basically most nova services would be expected to have connections open to both DBs now?21:26
mriedemcfriesen: only nova-api, conductor and scheduler21:27
cfriesenright, the heavyduty ones other than nova-compute21:27
*** esberglu has joined #openstack-nova21:27
mriedemcfriesen: have you guys done any profiling of where the worst hits are?21:28
cfriesennot yet...someone was just complaining about maybe needing to bump up the limit on overall DB connections.21:28
mriedemdansmith: we should maybe look at blocker migrations for pike so we can stop dropping these older online data migration routines21:28
mriedems/stop/start/21:28
mriedem:)21:28
dansmithhah, was confused21:28
dansmithsure, but they're not that expensive so I've been working on other stuff21:29
*** abalutoiu_ has quit IRC21:29
*** tbachman has joined #openstack-nova21:30
*** slaweq has quit IRC21:30
mriedemwonder if any of the versioned notification stuff is blowing up perf by doing lazy-loads21:30
*** iceyao has joined #openstack-nova21:31
*** eharney has quit IRC21:32
mriedemyeah i guess with like the online flavor migrations, those are all of the style where we looking in the api db first, then fallback to looking in the main cell db21:33
mriedemwe don't migrate those in the object code, we leave that for the online_data_migrations CLI21:33
mriedemcfriesen: have you guys been running the online_data_migrations CLIs in newton?21:33
*** Apoorva_ has joined #openstack-nova21:34
*** Apoorva_ has quit IRC21:36
mriedemdansmith: so say i wanted to remove all of the api->cell_db checking code in the flavor object during the lookup methods, are the steps add a blocker db migration, then drop the compat code in the flavor object, but leave https://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L604 since you need that to get through the blocker migration21:36
*** Apoorva_ has joined #openstack-nova21:36
*** Apoorva has quit IRC21:36
mriedemthis doesn't buy us anything for perf, but it would drop all of that compat code in the flavor object21:36
*** iceyao has quit IRC21:36
dansmithmriedem: historically we've done the blocker and then removed it, saying you had to use N-1 code to do the migration21:37
dansmithbut those were thigns we really wanted to drop21:37
dansmithand it was all intertwined with object code21:37
dansmithand, we always do blockers as the first migration21:37
mriedemyeah i figured we wouldn't have to here b/c the object code isn't doing a migration21:37
dansmithpotentially21:37
mriedembefore you start using multiple cells you should really have your flavors in the api db21:38
dansmithyes :)21:38
mriedemin fact....21:38
*** yangyapeng has joined #openstack-nova21:38
mriedemmulti-cell basically breaks the lookup routine since we don't know which cell db to fallback to if the flavor isn't in the api db21:38
mriedemso we kind of need to drop all of that code anyway i'd think21:39
dansmithI'm confinced21:39
dansmithconvinced even21:39
mriedemare we unable to do this if the blocker migration isn't the first migration for pike?21:40
dansmithno, we did that to avoid you being able to keep running on N-1 code21:40
dansmithlike, we tweak your db, then tell you you can't run N without migrating in N-1,21:40
dansmithbut N-1 might choke on the tweaks21:40
dansmiththat would be evil21:41
dansmithif you're not dropping the migration code, then I guess you could do it21:41
mriedemright that's why i said we still keep https://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L60421:41
mriedembut you really need to purge this stuff out of your main cell db and get it into api before you can do multiple cells21:42
mriedemmaybe a nice reminder for your summit talk :)21:42
*** dimtruck is now known as zz_dimtruck21:42
*** zz_dimtruck is now known as dimtruck21:42
*** yangyapeng has quit IRC21:43
dansmithheh21:44
mriedemso https://review.openstack.org/#/c/374307/21:45
mriedemwe already enforced this in ocata :)21:45
dansmithflavors yeah21:46
mriedemand keypairs, aggregates and server groups21:46
dansmithand those yeah21:46
* dansmith is helping21:46
*** ijw has joined #openstack-nova21:48
openstackgerritDan Smith proposed openstack/nova master: WIP: De-complicate some of the instance delete path  https://review.openstack.org/45863621:48
openstackgerritDan Smith proposed openstack/nova master: Move to proper target_cell calling convention  https://review.openstack.org/45863421:48
openstackgerritDan Smith proposed openstack/nova master: Make target_cell() yield a new context  https://review.openstack.org/45863521:48
openstackgerritDan Smith proposed openstack/nova master: DNM: Canary test against multi-cell devstack  https://review.openstack.org/45853721:48
*** salv-orl_ has joined #openstack-nova21:49
*** nkorabli_ has joined #openstack-nova21:51
*** nkorabli has quit IRC21:52
*** salv-orlando has quit IRC21:52
*** annegentle has joined #openstack-nova21:53
*** lpetrut has quit IRC21:59
*** gouthamr has quit IRC21:59
*** edmondsw has quit IRC22:00
*** Apoorva_ has quit IRC22:02
*** felipemonteiro__ has quit IRC22:03
*** Apoorva has joined #openstack-nova22:03
*** mdrabe has quit IRC22:04
*** baoli has quit IRC22:05
*** esberglu has quit IRC22:06
*** rfolco has quit IRC22:07
efriedmordred Still around?22:09
*** edmondsw has joined #openstack-nova22:10
*** ijw has quit IRC22:10
*** smatzek has joined #openstack-nova22:12
*** jamesdenton has quit IRC22:12
*** iceyao has joined #openstack-nova22:13
*** salv-orl_ has quit IRC22:14
*** ijw has joined #openstack-nova22:14
*** edmondsw has quit IRC22:15
*** burt has quit IRC22:15
*** iceyao has quit IRC22:18
*** smatzek has quit IRC22:18
*** ijw has quit IRC22:18
*** cheran has joined #openstack-nova22:19
*** claudiub|3 has quit IRC22:19
*** ijw has joined #openstack-nova22:20
*** tbachman has quit IRC22:25
*** lyan has quit IRC22:25
*** jaypipes has quit IRC22:26
*** nkorabli_ has quit IRC22:26
*** mlavalle has quit IRC22:26
*** nkorabli has joined #openstack-nova22:30
*** slaweq has joined #openstack-nova22:31
*** slaweq has quit IRC22:35
*** edmondsw has joined #openstack-nova22:39
*** edmondsw has quit IRC22:43
*** esberglu has joined #openstack-nova22:52
*** tbachman has joined #openstack-nova22:55
*** esberglu has quit IRC22:57
*** annegentle has quit IRC22:57
mordredefried: hey! not really - EODing - catch you in the morning?23:05
*** adrian_otto has joined #openstack-nova23:06
*** ijw has quit IRC23:07
*** ijw has joined #openstack-nova23:10
*** Apoorva_ has joined #openstack-nova23:10
*** Apoorva_ has quit IRC23:11
*** Apoorva has quit IRC23:11
*** Apoorva has joined #openstack-nova23:11
*** dimtruck is now known as zz_dimtruck23:14
*** nic1 has quit IRC23:20
*** nkorabli_ has joined #openstack-nova23:22
*** nkorabli has quit IRC23:24
*** nkorabli_ has quit IRC23:29
*** imacdonn has quit IRC23:29
*** smatzek has joined #openstack-nova23:29
*** nkorabli has joined #openstack-nova23:30
*** chyka has quit IRC23:32
*** zz_dimtruck is now known as dimtruck23:35
*** nkorabli_ has joined #openstack-nova23:35
*** nkorabli has quit IRC23:36
*** Fdaisuke_ has quit IRC23:36
*** Sukhdev has quit IRC23:37
*** Sukhdev has joined #openstack-nova23:42
*** nkorabli has joined #openstack-nova23:42
*** thorst_afk has joined #openstack-nova23:42
*** nkorabli_ has quit IRC23:43
*** adrian_otto has quit IRC23:46
*** thorst_afk has quit IRC23:47
*** lyan has joined #openstack-nova23:49
*** nkorabli_ has joined #openstack-nova23:50
*** nkorabli has quit IRC23:51
*** adrian_otto has joined #openstack-nova23:53
*** rfolco has joined #openstack-nova23:55
*** rfolco has quit IRC23:55
*** rfolco has joined #openstack-nova23:55
*** rfolco has quit IRC23:56
*** rfolco has joined #openstack-nova23:56
*** rfolco has quit IRC23:57
*** rfolco has joined #openstack-nova23:57
*** rfolco has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!