Thursday, 2017-09-28

openstackgerritMerged openstack/nova master: Fix policy check performance in 2.47+  https://review.openstack.org/50794800:04
*** baoli_ has quit IRC00:05
*** thorst has joined #openstack-nova00:07
*** thorst has quit IRC00:08
*** gjayavelu has joined #openstack-nova00:09
*** yangyapeng has quit IRC00:13
*** yangyapeng has joined #openstack-nova00:14
*** itlinux has quit IRC00:15
*** yangyapeng has quit IRC00:18
*** baoli has joined #openstack-nova00:20
*** tbachman has quit IRC00:23
*** tbachman_ has joined #openstack-nova00:24
*** slaweq_ has quit IRC00:27
*** slaweq_ has joined #openstack-nova00:32
*** coreywright has quit IRC00:32
*** tbachman_ has quit IRC00:34
*** tbachman has joined #openstack-nova00:34
*** sree has joined #openstack-nova00:36
*** Shunli has joined #openstack-nova00:37
*** tbachman has quit IRC00:39
*** mingyu has quit IRC00:40
*** mingyu has joined #openstack-nova00:40
*** sree has quit IRC00:41
*** sree has joined #openstack-nova00:41
*** mingyu has quit IRC00:42
*** sree has quit IRC00:42
*** sree has joined #openstack-nova00:42
*** mingyu has joined #openstack-nova00:42
*** tbachman has joined #openstack-nova00:44
*** jichen has joined #openstack-nova00:44
*** nikhil has joined #openstack-nova00:46
*** dave-mccowan has joined #openstack-nova00:46
*** zhurong has joined #openstack-nova00:47
*** coreywright has joined #openstack-nova00:49
*** litao__ has joined #openstack-nova00:49
*** Swami has quit IRC00:50
*** mriedem has quit IRC00:59
*** phuongnh has joined #openstack-nova01:02
*** liusheng has quit IRC01:04
*** slaweq_ has quit IRC01:05
*** thorst has joined #openstack-nova01:09
*** lennyb has quit IRC01:11
*** lennyb has joined #openstack-nova01:11
*** slaweq_ has joined #openstack-nova01:13
*** yikun_jiang is now known as yikun01:13
*** sree has quit IRC01:15
*** sree has joined #openstack-nova01:15
*** liusheng has joined #openstack-nova01:16
*** sree has quit IRC01:20
*** yangyapeng has joined #openstack-nova01:20
yikunhi, I submit Queue bp about pagination for migrations and instance-actions.01:20
yikunThese bps have approved previously in newton, but didn't implemented yet,01:20
yikunnow I move these to queens, could anyone have a look? thanks : )01:20
yikunhttps://review.openstack.org/#/c/506030/01:20
yikunhttps://review.openstack.org/#/c/507762/01:21
yikunthanks for your review.01:21
*** gjayavelu has quit IRC01:21
*** mikal_ has joined #openstack-nova01:22
*** hongbin has joined #openstack-nova01:22
*** Yikun__ has joined #openstack-nova01:22
*** eharney has quit IRC01:22
*** thorst has quit IRC01:23
*** thorst has joined #openstack-nova01:23
*** yangyape_ has joined #openstack-nova01:25
*** yangyapeng has quit IRC01:25
*** mikal has quit IRC01:25
*** thorst has quit IRC01:26
*** mikal_ has quit IRC01:28
*** edmondsw has joined #openstack-nova01:28
*** masayukig has quit IRC01:28
*** masayukig has joined #openstack-nova01:29
*** gcb has joined #openstack-nova01:31
*** edmondsw has quit IRC01:32
*** mingyu_ has joined #openstack-nova01:33
*** bnemec has quit IRC01:34
*** mingyu has quit IRC01:35
*** eharney has joined #openstack-nova01:36
*** bnemec has joined #openstack-nova01:39
*** dave-mccowan has quit IRC01:41
*** esberglu has quit IRC01:43
*** slaweq_ has quit IRC01:43
*** dave-mccowan has joined #openstack-nova01:45
*** tidwellr has quit IRC01:48
*** slaweq_ has joined #openstack-nova01:50
*** itlinux has joined #openstack-nova01:51
*** sree has joined #openstack-nova01:52
*** mikal has joined #openstack-nova01:56
*** mingyu_ has quit IRC01:57
*** dave-mcc_ has joined #openstack-nova02:05
*** sdague has quit IRC02:05
*** dave-mccowan has quit IRC02:07
*** itlinux has quit IRC02:07
*** sree has quit IRC02:08
*** Apoorva_ has quit IRC02:10
*** itlinux has joined #openstack-nova02:14
*** liuyulong has joined #openstack-nova02:15
*** itlinux has quit IRC02:15
*** huanxie has joined #openstack-nova02:15
*** krtaylor has joined #openstack-nova02:20
*** yamamoto has joined #openstack-nova02:22
*** yamamoto has quit IRC02:22
*** slaweq_ has quit IRC02:22
*** yamamoto has joined #openstack-nova02:22
*** baoli has quit IRC02:24
*** thorst has joined #openstack-nova02:26
*** slaweq_ has joined #openstack-nova02:27
*** esberglu has joined #openstack-nova02:32
*** itlinux has joined #openstack-nova02:33
*** baoli has joined #openstack-nova02:34
*** mingyu has joined #openstack-nova02:34
*** esberglu has quit IRC02:36
*** dave-mcc_ has quit IRC02:38
*** baoli has quit IRC02:42
*** baoli has joined #openstack-nova02:44
*** itlinux has quit IRC02:52
*** nikhil has quit IRC02:55
*** slaweq_ has quit IRC03:00
*** slaweq_ has joined #openstack-nova03:09
*** moshele has quit IRC03:14
*** Sukhdev has quit IRC03:15
*** edmondsw has joined #openstack-nova03:16
*** edmondsw has quit IRC03:21
*** baoli has quit IRC03:21
*** baoli has joined #openstack-nova03:22
*** Sukhdev has joined #openstack-nova03:25
*** bnemec has quit IRC03:26
*** crushil has joined #openstack-nova03:26
openstackgerritMerged openstack/nova master: doc: make host aggregates examples more discoverable  https://review.openstack.org/50795003:28
*** Yikun__ has quit IRC03:32
*** Tengu has quit IRC03:33
*** ujjain has quit IRC03:34
*** MasterofJOKers has quit IRC03:34
*** baoli has quit IRC03:34
*** Tengu has joined #openstack-nova03:39
*** MasterofJOKers has joined #openstack-nova03:39
*** ujjain has joined #openstack-nova03:39
*** ujjain has quit IRC03:39
*** ujjain has joined #openstack-nova03:39
*** slaweq_ has quit IRC03:41
*** udesale has joined #openstack-nova03:42
*** links has joined #openstack-nova03:44
*** slaweq_ has joined #openstack-nova03:45
*** ujjain has quit IRC03:46
*** ujjain has joined #openstack-nova03:48
*** ujjain has quit IRC03:48
*** ujjain has joined #openstack-nova03:48
*** cfriesen_ has quit IRC03:50
*** sridharg has joined #openstack-nova03:52
*** rha has quit IRC03:52
*** avolkov` has joined #openstack-nova03:57
*** avolkov has quit IRC03:59
*** rha has joined #openstack-nova03:59
*** zhurong has quit IRC04:07
*** crushil_ has joined #openstack-nova04:10
*** shaner has quit IRC04:12
*** shaner has joined #openstack-nova04:15
*** slaweq_ has quit IRC04:18
*** yangyape_ has quit IRC04:22
*** yangyapeng has joined #openstack-nova04:23
*** kornicameister has quit IRC04:24
*** slaweq_ has joined #openstack-nova04:24
*** itlinux has joined #openstack-nova04:28
*** takedakn has joined #openstack-nova04:31
*** hongbin has quit IRC04:31
*** sree has joined #openstack-nova04:38
*** huanxie has quit IRC04:40
*** ratailor has joined #openstack-nova04:45
*** lpetrut has joined #openstack-nova04:46
mikalI think I found a bug in unittest.mock04:47
*** itlinux has quit IRC04:48
*** psachin has joined #openstack-nova04:52
*** slaweq_ has quit IRC04:56
*** mdnadeem has joined #openstack-nova04:58
*** slaweq_ has joined #openstack-nova05:03
*** edmondsw has joined #openstack-nova05:04
*** huanxie has joined #openstack-nova05:07
*** gjayavelu has joined #openstack-nova05:08
*** lpetrut has quit IRC05:08
*** edmondsw has quit IRC05:09
*** vladikr has quit IRC05:15
*** takedakn has quit IRC05:18
*** avolkov` has quit IRC05:20
*** avolkov` has joined #openstack-nova05:20
*** lpetrut has joined #openstack-nova05:23
*** Sukhdev has quit IRC05:29
*** yangyape_ has joined #openstack-nova05:29
*** yangyapeng has quit IRC05:29
*** trinaths has joined #openstack-nova05:31
*** chyka has quit IRC05:31
*** yangyape_ has quit IRC05:31
*** yangyapeng has joined #openstack-nova05:32
*** manasm has joined #openstack-nova05:32
*** slaweq_ has quit IRC05:33
*** claudiub|3 has joined #openstack-nova05:37
*** slaweq_ has joined #openstack-nova05:43
*** gjayavelu has quit IRC05:45
*** lpetrut has quit IRC05:47
openstackgerritjichenjc proposed openstack/nova master: remove CONF.vendordata_driver  https://review.openstack.org/50151005:47
*** dgonzalez has joined #openstack-nova05:50
*** yangyapeng has quit IRC05:50
*** edand has joined #openstack-nova05:50
*** yangyape_ has joined #openstack-nova05:50
*** cfriesen_ has joined #openstack-nova05:55
*** trinaths2 has joined #openstack-nova05:57
*** trinaths has quit IRC05:57
*** cfriesen_ has quit IRC06:00
*** cfriesen__ has joined #openstack-nova06:00
*** Oku_OS-away is now known as Oku_OS06:08
*** crushil_ has quit IRC06:10
*** crushil has quit IRC06:11
*** josecastroleon has joined #openstack-nova06:11
*** esberglu has joined #openstack-nova06:11
*** erlon has quit IRC06:14
*** esberglu has quit IRC06:15
openstackgerritOpenStack Proposal Bot proposed openstack/os-vif stable/pike: Updated from global requirements  https://review.openstack.org/49314606:17
*** liuyulong has quit IRC06:17
*** yangyape_ has quit IRC06:18
openstackgerritOpenStack Proposal Bot proposed openstack/python-novaclient stable/pike: Updated from global requirements  https://review.openstack.org/49318706:18
*** yangyapeng has joined #openstack-nova06:19
*** pcaruana has joined #openstack-nova06:19
openstackgerritMerged openstack/nova stable/pike: Handle deleted instances when refreshing the info_cache  https://review.openstack.org/50618306:22
*** yangyapeng has quit IRC06:23
*** yangyapeng has joined #openstack-nova06:29
*** markvoelker has quit IRC06:30
openstackgerritOpenStack Proposal Bot proposed openstack/os-vif stable/pike: Updated from global requirements  https://review.openstack.org/49314606:34
*** yangyapeng has quit IRC06:34
openstackgerritOpenStack Proposal Bot proposed openstack/python-novaclient stable/pike: Updated from global requirements  https://review.openstack.org/49318706:36
*** cfriesen__ has quit IRC06:37
*** zhurong has joined #openstack-nova06:38
*** mnestratov has joined #openstack-nova06:39
openstackgerritjichenjc proposed openstack/nova master: check query param for server groups function  https://review.openstack.org/50034706:40
*** moshele has joined #openstack-nova06:46
*** slaweq_ has quit IRC06:46
*** Tom has joined #openstack-nova06:50
*** andreas_s has joined #openstack-nova06:50
*** edmondsw has joined #openstack-nova06:52
*** slaweq_ has joined #openstack-nova06:53
openstackgerritjichenjc proposed openstack/nova master: check query param for used_limits function  https://review.openstack.org/49909106:56
*** edmondsw has quit IRC06:57
openstackgerritjichenjc proposed openstack/nova master: check query param for used_limits function  https://review.openstack.org/49909106:58
*** rcernin has joined #openstack-nova07:00
*** sshwarts has joined #openstack-nova07:01
openstackgerritjichenjc proposed openstack/nova master: fix race condition of instance host  https://review.openstack.org/49445807:02
openstackgerritjichenjc proposed openstack/nova master: propagate OSError to MigrationPreCheckError  https://review.openstack.org/46977907:02
openstackgerritjichenjc proposed openstack/nova master: WIP: only allow TLS v1.2 in nova servers  https://review.openstack.org/45950407:02
*** yangyapeng has joined #openstack-nova07:03
*** andymccr has quit IRC07:07
*** yangyapeng has quit IRC07:07
*** armax has joined #openstack-nova07:08
*** asettle has quit IRC07:08
*** zsli_ has joined #openstack-nova07:09
*** andymccr has joined #openstack-nova07:09
openstackgerritjichenjc proposed openstack/nova master: WIP: conf: remove deprecated 'project_id_regex' opt  https://review.openstack.org/50105707:10
*** asettle has joined #openstack-nova07:10
*** asettle is now known as Guest382807:10
openstackgerritjichenjc proposed openstack/nova master: Check root disk size when doing resize in API  https://review.openstack.org/48466407:10
*** avolkov` has quit IRC07:10
*** Shunli has quit IRC07:12
*** armax has quit IRC07:14
*** avolkov` has joined #openstack-nova07:15
*** yangyapeng has joined #openstack-nova07:17
*** yangyapeng has quit IRC07:18
*** yangyapeng has joined #openstack-nova07:18
*** ralonsoh has joined #openstack-nova07:19
*** andreas_s_ has joined #openstack-nova07:21
*** andreas_s has quit IRC07:21
*** ragiman has joined #openstack-nova07:25
*** sahid has joined #openstack-nova07:26
*** slaweq_ has quit IRC07:27
*** yangyapeng has quit IRC07:29
*** yangyape_ has joined #openstack-nova07:29
*** burt has quit IRC07:29
*** slaweq_ has joined #openstack-nova07:30
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix inconsistency of 'NOTE:' description  https://review.openstack.org/50807407:30
*** yangyape_ has quit IRC07:30
*** yangyapeng has joined #openstack-nova07:30
openstackgerritMerged openstack/nova stable/pike: Fix 500 if list servers called with empty regex pattern  https://review.openstack.org/50675407:31
openstackgerritTakashi NATSUME proposed openstack/nova-specs master: List/show all server migration types  https://review.openstack.org/48902907:33
*** huanxie has quit IRC07:34
*** jpena|off is now known as jpena07:34
*** hferenc has joined #openstack-nova07:34
*** ragiman has quit IRC07:35
*** armax has joined #openstack-nova07:36
*** burt has joined #openstack-nova07:38
*** huanxie has joined #openstack-nova07:41
*** zhouyaguo has joined #openstack-nova07:42
*** armax has quit IRC07:42
openstackgerritMerged openstack/nova stable/pike: Fix --max-count handling for nova-manage cell_v2 map_instances  https://review.openstack.org/50755207:44
*** xinliang has quit IRC07:51
*** ragiman has joined #openstack-nova07:52
*** yamamoto has quit IRC07:56
*** manasm has quit IRC07:58
*** esberglu has joined #openstack-nova07:59
openstackgerritjichenjc proposed openstack/nova master: Add 400 as error code for resource class delete  https://review.openstack.org/50808007:59
*** slaweq_ has quit IRC08:02
*** avolkov` has quit IRC08:02
*** avolkov` has joined #openstack-nova08:03
*** yamamoto has joined #openstack-nova08:03
*** esberglu has quit IRC08:03
*** manasm has joined #openstack-nova08:04
*** avolkov` has left #openstack-nova08:04
*** xinliang has joined #openstack-nova08:05
*** avolkov has joined #openstack-nova08:05
openstackgerritjichenjc proposed openstack/nova master: Add description for reousrce class creation  https://review.openstack.org/50808308:07
*** slaweq_ has joined #openstack-nova08:09
*** takedakn has joined #openstack-nova08:11
*** moshele has quit IRC08:11
*** lpetrut has joined #openstack-nova08:16
*** alexchadin has joined #openstack-nova08:22
openstackgerritjichenjc proposed openstack/nova master: remove CONF.vendordata_driver  https://review.openstack.org/50151008:23
*** trinaths2 has quit IRC08:23
openstackgerritjichenjc proposed openstack/nova master: Add description for reousrce class creation  https://review.openstack.org/50808308:25
*** yamamoto has quit IRC08:25
*** rmart04 has joined #openstack-nova08:25
*** ragiman has quit IRC08:26
*** derekh has joined #openstack-nova08:26
johnthetubaguyalex_xu are you working with lei-zh on https://review.openstack.org/#/c/468797?08:27
*** yamamoto has joined #openstack-nova08:30
*** rmart04 has quit IRC08:30
*** markvoelker has joined #openstack-nova08:31
*** huanxie has quit IRC08:32
*** yamamoto_ has joined #openstack-nova08:32
*** rmart04 has joined #openstack-nova08:33
*** rmart04 has quit IRC08:33
*** yamamoto_ has quit IRC08:34
*** yamamoto has quit IRC08:35
*** yamahata has joined #openstack-nova08:36
*** ragiman has joined #openstack-nova08:38
*** zhouyaguo has quit IRC08:39
*** Guest3828 is now known as asettle08:39
*** zhouyaguo has joined #openstack-nova08:39
*** edmondsw has joined #openstack-nova08:41
*** slaweq_ has quit IRC08:43
*** edmondsw has quit IRC08:45
*** yamahata has quit IRC08:46
*** manasm has quit IRC08:47
*** yamahata has joined #openstack-nova08:47
*** rmart04 has joined #openstack-nova08:48
*** alexchadin has quit IRC08:50
*** alexchadin has joined #openstack-nova08:51
*** alexchadin has quit IRC08:51
*** alexchadin has joined #openstack-nova08:51
*** slaweq_ has joined #openstack-nova08:54
openstackgerritMerged openstack/nova stable/pike: Refactor ServerMovingTests for non-move tests  https://review.openstack.org/50719509:00
*** ralonsoh_ has joined #openstack-nova09:00
*** alexchadin has quit IRC09:01
*** alexchadin has joined #openstack-nova09:03
*** manasm has joined #openstack-nova09:03
*** ralonsoh has quit IRC09:03
*** yangyapeng has quit IRC09:04
*** markvoelker has quit IRC09:05
*** yangyapeng has joined #openstack-nova09:08
*** Tom has quit IRC09:09
*** rmart04 has quit IRC09:12
gmannoomichi: are you ok with create_or_update_* in this https://review.openstack.org/#/c/504439/11 ?09:14
*** yamamoto has joined #openstack-nova09:14
*** huanxie has joined #openstack-nova09:16
*** yamamoto has quit IRC09:17
openstackgerritMatthew Booth proposed openstack/nova master: Make etree.tostring() emit unicode everywhere  https://review.openstack.org/50748809:18
openstackgerritMatthew Booth proposed openstack/nova master: libvirt: Don't VIR_MIGRATE_NON_SHARED_INC without migrate_disks  https://review.openstack.org/50720209:18
bhagyashrisavolkov: Hi,09:18
avolkovbhagyashris: hi09:18
mdboothstephenfin: I wrote the test you asked for on https://review.openstack.org/#/c/507488/09:18
mdboothThen I unwrote it :)09:19
mdboothCan you have a quick look at my reply in case I misunderstood?09:19
bhagyashrisavolkov: I just want to discuss regarding the patch: https://review.openstack.org/#/c/409644/ I have respond to your comment can you please take some in sights09:20
* mdbooth is aware that the gate is being a bit glacial right now, and has plenty of time to fix it before Jenkins votes09:20
*** sambetts|afk is now known as sambetts09:24
*** artom has joined #openstack-nova09:24
*** slaweq_ has quit IRC09:26
*** zsli_ has quit IRC09:27
*** alexchad_ has joined #openstack-nova09:28
*** alexchadin has quit IRC09:30
*** alexchad_ has quit IRC09:32
*** alexchadin has joined #openstack-nova09:33
avolkovbhagyashris: left a comment there09:35
bhagyashrisavolkov: Thank you :)09:35
*** slaweq_ has joined #openstack-nova09:36
*** armax has joined #openstack-nova09:38
*** yamahata has quit IRC09:40
*** jichen has quit IRC09:40
bhagyashrisavolkov: I will fix the review comment thank you for review :)09:42
*** armax has quit IRC09:42
*** sdague has joined #openstack-nova09:44
openstackgerritGhanshyam Mann proposed openstack/nova-specs master: Spec for API extensions policy removal  https://review.openstack.org/50810109:45
*** takashin has left #openstack-nova09:46
*** ijw has quit IRC09:47
*** huanxie has quit IRC09:47
*** esberglu has joined #openstack-nova09:47
artomlyarwood, around?09:48
artomThe -W can come off https://review.openstack.org/#/c/499208/ I think, right?09:48
artomSince https://review.openstack.org/#/c/468514/ landed09:48
artomSame for https://review.openstack.org/#/c/468319/09:49
*** esberglu has quit IRC09:51
*** trinaths has joined #openstack-nova09:52
*** yassine has quit IRC09:54
*** ratailor is now known as rtailor09:56
*** sree has quit IRC09:57
*** jpena has quit IRC09:59
openstackgerritGhanshyam Mann proposed openstack/nova-specs master: Spec for API extensions policy removal  https://review.openstack.org/50810109:59
*** ltomasbo has quit IRC09:59
*** huanxie has joined #openstack-nova10:00
lyarwoodartom: hey yeah10:01
lyarwoodartom: ack looking10:01
*** artom has quit IRC10:02
*** markvoelker has joined #openstack-nova10:02
*** yangyapeng has quit IRC10:02
*** yamamoto has joined #openstack-nova10:03
*** ralonsoh__ has joined #openstack-nova10:03
*** yangyapeng has joined #openstack-nova10:03
*** ltomasbo has joined #openstack-nova10:04
*** yangyapeng has quit IRC10:04
*** jpena has joined #openstack-nova10:05
*** yamamoto has quit IRC10:05
*** ralonsoh_ has quit IRC10:06
*** masber has quit IRC10:06
*** masber has joined #openstack-nova10:07
*** slaweq_ has quit IRC10:09
*** jmlowe has quit IRC10:10
*** chyka has joined #openstack-nova10:16
*** slaweq_ has joined #openstack-nova10:17
*** cdent has joined #openstack-nova10:19
*** chyka has quit IRC10:21
*** ralonsoh__ is now known as ralonsoh10:24
*** zhurong has quit IRC10:27
*** edmondsw has joined #openstack-nova10:29
*** yamamoto has joined #openstack-nova10:29
*** yamamoto has quit IRC10:31
*** alexchadin has quit IRC10:32
*** edmondsw has quit IRC10:33
*** obre has quit IRC10:34
*** obre has joined #openstack-nova10:34
*** markvoelker has quit IRC10:35
openstackgerritZhenyu Zheng proposed openstack/nova master: nova-manage db archive_deleted_rows is not multi-cell aware  https://review.openstack.org/50748610:35
*** yamamoto has joined #openstack-nova10:37
*** yamamoto has quit IRC10:38
*** udesale has quit IRC10:39
*** yamamoto has joined #openstack-nova10:40
*** phuongnh has quit IRC10:40
*** yamamoto has quit IRC10:43
*** andreas_s has joined #openstack-nova10:45
*** yamamoto has joined #openstack-nova10:46
*** ijw has joined #openstack-nova10:47
*** zhouyaguo has quit IRC10:48
*** andreas_s_ has quit IRC10:48
*** yamamoto has quit IRC10:49
*** gcb has quit IRC10:50
*** Tom__ has joined #openstack-nova10:51
*** ijw has quit IRC10:52
*** tbachman has quit IRC10:53
*** slaweq_ has quit IRC10:53
*** Tom__ has quit IRC10:55
*** smatzek has joined #openstack-nova11:01
*** trinaths1 has joined #openstack-nova11:02
*** trinaths has quit IRC11:02
*** MVenesio has joined #openstack-nova11:03
*** takedakn has quit IRC11:05
*** gcb has joined #openstack-nova11:07
*** huanxie has quit IRC11:07
*** thorst has quit IRC11:16
*** MVenesio has quit IRC11:17
openstackgerritJohn Garbutt proposed openstack/nova master: WIP: Send traits to ironic on server boot  https://review.openstack.org/50811611:17
*** MVenesio has joined #openstack-nova11:18
*** slaweq_ has joined #openstack-nova11:23
*** yassine has joined #openstack-nova11:24
openstackgerritChris Dent proposed openstack/nova master: Do not monkey patch eventlet in unit tests  https://review.openstack.org/50792311:25
openstackgerritChris Dent proposed openstack/nova master: DNM: Don't monkey patch eventlet in functional  https://review.openstack.org/50666811:25
openstackgerritChris Dent proposed openstack/nova master: Do not setup conductor in BaseAPITestCase  https://review.openstack.org/50812011:25
*** bhagyashris has quit IRC11:28
*** yamamoto has joined #openstack-nova11:28
*** bhagyashris has joined #openstack-nova11:28
*** markvoelker has joined #openstack-nova11:32
*** MVenesio has quit IRC11:32
mdboothcdent: Remind me, were you proposing removing eventlet from tests?11:33
cdentI was yes11:33
cdentthere are monkey_patch calls at the top of the unit and functional trees11:34
cdentremoving the one at the top of unit is no problem11:34
cdentthe one at the top of functional is a problem, but limited11:34
mdboothcdent: Data point: I've used eventlet in tests explicitly a couple of times because its locking primitives can be killed with Ctrl-C, whereas the regular python ones can't.11:34
cdentused explicitly: great11:35
*** esberglu has joined #openstack-nova11:35
mdboothThis has no impact on the test usually, but is really useful when you're debugging it11:35
cdentit’s the global monkey patching that i think is bad news11:35
mdboothCool, just thought I'd bring it up11:36
cdentyeah, thanks.11:36
cdentIn my digging around it looks like there’s still a fair amount of tests under unit that ought to be under functional, but I’m pretty sure I don’t want to fall in that hole (yet)11:37
* mdbooth feels the functional boundary lies at 'starts a service'11:38
* mdbooth would like to see more functional unit tests in general11:38
*** esberglu has quit IRC11:39
cdentyeah, I grepped for ‘start_service’ as sort of an initial feel around and the boundary has been permeated11:40
*** jaosorior_sick is now known as jaosorior11:41
cdentjohnthetubaguy, stephenfin : can you guys weigh in on https://review.openstack.org/#/c/469048/ it’s some placement docs that have been languishing for a long time11:45
cdentand this is a test that’s also been languishing, adds a bit more coverage: https://review.openstack.org/#/c/485209/11:46
*** huanxie has joined #openstack-nova11:46
cdentgibi: you too on both of those11:46
*** andreas_s_ has joined #openstack-nova11:47
*** andreas_s has quit IRC11:51
openstackgerritJohn Garbutt proposed openstack/nova master: WIP: Send traits to ironic on server boot  https://review.openstack.org/50811611:51
*** slaweq_ has quit IRC11:57
*** slaweq_ has joined #openstack-nova12:01
*** yamamoto has quit IRC12:03
*** thorst has joined #openstack-nova12:03
sdagueok, the qemu >= 2.10 patch should really really be ready this time - https://review.openstack.org/#/c/505673/ - stephenfin, bauzas, johnthetubaguy if anyone wants to take a quick look12:05
*** vladikr has joined #openstack-nova12:05
*** markvoelker has quit IRC12:06
*** eharney has quit IRC12:06
*** trinaths1 has quit IRC12:09
mdboothAny chance of some eyes on this: https://review.openstack.org/#/c/507202/12:10
mdboothIt's a data corruptor with no current mitigation other than "don't do that"12:10
mdboothThe dependent patch is an annoying python 3-ism12:10
mdboothThat's unfair, it's a bug in the libvirt python bindings, and a questionable default choice in the lxml python bindings12:11
*** gcb has quit IRC12:12
*** gcb has joined #openstack-nova12:12
*** trinaths has joined #openstack-nova12:15
*** markvoelker has joined #openstack-nova12:18
*** manasm has quit IRC12:19
cdentmdbooth: that etree default stuff has bit me so many times12:20
cdent(not in an openstack context, but elsewhere)12:20
*** mvk has quit IRC12:20
cdentsdague: no one will believe you until you use a 3rd “really”12:21
mdboothcdent: It bit me, so I did my usual trick of fixing the whole problem rather than just my bit. Ironically, that decision usually bites me.12:21
*** cdent has quit IRC12:21
*** litao__ has quit IRC12:26
*** tbachman has joined #openstack-nova12:27
*** jmlowe has joined #openstack-nova12:28
*** tbachman_ has joined #openstack-nova12:29
*** pcaruana has quit IRC12:31
*** edmondsw has joined #openstack-nova12:31
*** tbachman has quit IRC12:32
*** tbachman_ is now known as tbachman12:32
*** slaweq_ has quit IRC12:34
*** slunkad has quit IRC12:37
stephenfinmdbooth: Comments left. One of us is missing something :)12:39
*** ygl has joined #openstack-nova12:39
mdboothstephenfin: Thanks. Look in a bit.12:39
*** slunkad has joined #openstack-nova12:42
*** mlakat has quit IRC12:43
*** kfarr has joined #openstack-nova12:43
*** slaweq_ has joined #openstack-nova12:44
*** liverpooler has joined #openstack-nova12:44
*** jaypipes has joined #openstack-nova12:45
*** jpena is now known as jpena|lunch12:46
*** huanxie has quit IRC12:47
openstackgerritkonstantin proposed openstack/nova master: switch from filesystem to disk for parallels containers  https://review.openstack.org/50668712:48
openstackgerritkonstantin proposed openstack/nova master: don't add device address if there is no any units  https://review.openstack.org/50668612:48
*** kenperkins has joined #openstack-nova12:49
*** takedakn has joined #openstack-nova12:50
*** cdent has joined #openstack-nova12:51
*** hemna_ has joined #openstack-nova12:51
*** erlon has joined #openstack-nova12:53
*** ygl has quit IRC12:54
*** dave-mccowan has joined #openstack-nova12:54
openstackgerritOpenStack Proposal Bot proposed openstack/os-vif stable/ocata: Updated from global requirements  https://review.openstack.org/49025612:54
*** eharney has joined #openstack-nova12:55
*** artom has joined #openstack-nova12:55
*** lyan has joined #openstack-nova12:55
*** artom has quit IRC12:56
*** artom has joined #openstack-nova12:56
cdentthanks stephenfin for the robust review12:57
*** artom has quit IRC12:57
*** artom has joined #openstack-nova12:57
*** slunkad has quit IRC12:57
*** artom has quit IRC12:58
*** gcb has quit IRC12:58
*** artom has joined #openstack-nova12:58
*** artom has quit IRC12:59
*** artom has joined #openstack-nova12:59
*** sean-k-mooney has joined #openstack-nova12:59
*** gbarros has joined #openstack-nova12:59
*** artom has quit IRC13:00
*** mlakat has joined #openstack-nova13:00
*** artom has joined #openstack-nova13:00
*** pcaruana has joined #openstack-nova13:00
*** artom has quit IRC13:01
*** belmoreira has joined #openstack-nova13:01
*** artom has joined #openstack-nova13:01
*** artom has quit IRC13:02
*** artom has joined #openstack-nova13:02
*** gcb has joined #openstack-nova13:02
*** yamamoto has joined #openstack-nova13:03
openstackgerritArtom Lifshitz proposed openstack/nova stable/ocata: Test InstanceNotFound handling in 'nova usage'  https://review.openstack.org/48221913:04
*** sree has joined #openstack-nova13:04
*** belmoreira has quit IRC13:06
*** belmorei_ has joined #openstack-nova13:06
*** belmorei_ has quit IRC13:07
*** belmoreira has joined #openstack-nova13:07
*** cleong has joined #openstack-nova13:08
*** sree has quit IRC13:09
*** yamamoto has quit IRC13:09
openstackgerritArtom Lifshitz proposed openstack/nova stable/pike: Test InstanceNotFound handling in 'nova usage'  https://review.openstack.org/49920813:09
*** huanxie has joined #openstack-nova13:11
*** esberglu has joined #openstack-nova13:11
*** pchavva has joined #openstack-nova13:11
*** ijw has joined #openstack-nova13:12
*** rtailor has quit IRC13:12
alex_xujohnthetubaguy: yea, we are work on that together13:14
*** catintheroof has joined #openstack-nova13:15
*** yangyapeng has joined #openstack-nova13:15
openstackgerritChris Dent proposed openstack/nova master: [placement] Update the placement deployment instructions  https://review.openstack.org/46904813:15
*** baoli has joined #openstack-nova13:16
*** moshele has joined #openstack-nova13:17
*** slaweq_ has quit IRC13:17
*** coreywright has quit IRC13:18
*** ijw has quit IRC13:18
*** lyan has quit IRC13:20
johnthetubaguyalex_xu: cool, I was just thinking that spec didn't use the flavor extra specs mapping dansmith was talking about at the PTG13:22
johnthetubaguyalex_xu: I added comments on the spec anyways13:22
*** sree has joined #openstack-nova13:23
*** slaweq_ has joined #openstack-nova13:24
openstackgerritOpenStack Proposal Bot proposed openstack/os-vif stable/ocata: Updated from global requirements  https://review.openstack.org/49025613:25
alex_xujohnthetubaguy: yea, I just read that, thanks13:25
*** mriedem has joined #openstack-nova13:26
*** alexchadin has joined #openstack-nova13:28
*** MVenesio has joined #openstack-nova13:28
stephenfincdent: Some more comments left on that patch from stuff I missed first go round. After those are addressed, I'm +213:29
cdentstephenfin: ✔13:29
*** coreywright has joined #openstack-nova13:32
*** yamahata has joined #openstack-nova13:32
*** trinaths1 has joined #openstack-nova13:33
*** jaosorior has quit IRC13:34
*** trinaths has quit IRC13:34
openstackgerritAlex Xu proposed openstack/nova-specs master: Add trait support in the allocation candidates API  https://review.openstack.org/49771313:35
mdboothstephenfin: https://review.openstack.org/#/c/507488/2/nova/tests/unit/virt/libvirt/test_guest.py13:35
*** gouthamr has joined #openstack-nova13:35
mdboothstephenfin: They won't be converted to byte strings?13:35
mdboothI don't understand.13:35
mdboothWe don't need to convert anything to bytestring.13:35
stephenfinmdbooth: Isn't that what this is doing? https://review.openstack.org/#/c/507488/2/nova/virt/libvirt/guest.py13:36
stephenfinif they're unicode values, convert to bytestrings (str in Python 2.7)13:36
openstackgerritBhagyashri Shewale proposed openstack/nova master: Don't create instance backup image if rotation is 0  https://review.openstack.org/40964413:36
mdboothNot bytestrings, regular strings13:36
mdboothBut only for python213:36
openstackgerritOpenStack Proposal Bot proposed openstack/os-vif stable/newton: Updated from global requirements  https://review.openstack.org/37329313:36
mdboothWe're not interested in what happens to bytestrings, because we don't expect to receive them13:37
mdboothJust a sec, lemme dig out the libvirt python bindings again...13:37
stephenfinmdbooth: I'm using the wrong terminology so13:38
*** edand has quit IRC13:38
alex_xujohnthetubaguy: ^ try to address your comment13:38
stephenfinWhatever the default string type in Python3 is13:38
stephenfin*Python 213:38
stephenfini.e. six.binary_type13:38
mdboothstephenfin: The default string type in Python3 is unicode13:39
mdboothOh, python213:39
mdboothIt's not binary type13:39
mdboothb'foo' != 'foo'13:39
* mdbooth isn't sure what the difference actually is, though13:40
stephenfinmdbooth: Yeah it is, in Python 313:40
stephenfin*Python 213:40
stephenfindammit13:40
mdboothHehe13:40
stephenfin>>> b'test' == 'test'13:40
stephenfinTrue13:40
mdboothAh, so it is13:40
mdboothIn that case, we're already testing that, no?13:40
stephenfinIn Python 2, 'str' == binary strings. In Python 3, 'str' == unicode strings13:40
mdboothBecause we're testing a bare string13:40
*** smatzek has quit IRC13:41
alex_xujohnthetubaguy: in the allocation_candidate API, we said the parameter named as 'requires', so I guess the extra spec should be "HW_CPU_X86_AVX=require", not the `required`?13:41
stephenfinmdbooth: Yeah, but you're not testing what passing a unicode string into 'migrate' does in Python 313:41
stephenfin*Python 213:41
*** gbarros has quit IRC13:41
stephenfin(I'm working on my laptop keyboard and keep missing 2)13:41
johnthetubaguyalex_xu: yeah, keeping those consistent would be a good idea13:41
mdboothstephenfin: Yes we do, because the other test already does that13:41
mdboothbecause in python 3 u'foo' == 'foo'13:41
mdboothAnd we test 'foo'13:41
openstackgerritBhagyashri Shewale proposed openstack/nova master: Don't create instance backup image if rotation is 0  https://review.openstack.org/40964413:41
alex_xujohnthetubaguy: cool, got it13:42
*** huanxie has quit IRC13:42
mdboothstephenfin: So I actually wrote the test, and I changed 'v1' to be u'v1'13:42
mdboothAnd asserted that's what we ended up with13:42
mdboothThen I realised that they're the same thing13:42
mdboothSo actually I hadn't changed anything13:43
stephenfinmdbooth: But what about the other way round13:43
stephenfinIf you called 'self.guest.migrate' with a "u'test'" param value13:43
mdboothtest_migrate_v3 already tests that13:43
stephenfinI'd expect the call to 'self.domain.migrateToURI3' to be called with "b'test'"13:44
stephenfinBut only for Python 213:44
mdboothtest_migrate_v3_unicode tests that13:44
* stephenfin celebrates his new-found ability to hit the 2 key13:44
mdboothBecause it passes u'v1' and asserts 'v1'13:44
stephenfinOh FFS13:44
stephenfinI read 'not six.PY2' as 'not six.PY3'13:44
stephenfinand thought that test was only for Python 3. Sorry!13:44
mdboothHAHA, sorry!13:44
mdbooth-ESTUPIDNEGATIONS13:45
stephenfin:D13:45
stephenfinmdbooth: OK, let me give that one more spin through so. Sorry for the confusion :)13:45
mdboothNP, thanks again13:46
*** mlakat has quit IRC13:46
*** jpena|lunch is now known as jpena13:46
mdboothFWIW I wrote it that way because I way being anal.13:47
mriedemhttps://review.openstack.org/#/c/507938/ needs final +2, regression in pike13:47
openstackgerritOpenStack Proposal Bot proposed openstack/os-vif stable/newton: Updated from global requirements  https://review.openstack.org/37329313:48
mdboothmriedem: https://review.openstack.org/#/c/507202/ libvirt data corruptor since forever13:48
* mdbooth got this as a customer bug, their migrations were being unexpectedly slow. After working it out we advised them to stop doing that...13:49
*** kfarr has quit IRC13:51
*** edand has joined #openstack-nova13:51
mriedemmdbooth: ok i'm going to put a patch on top of that to test live block migration with something like this https://review.openstack.org/#/c/481290/13:52
mdboothmriedem: kk13:53
*** bnemec has joined #openstack-nova13:53
kashyapmriedem: Oh cool.  Funnily enough, I was just checking an hour ago if we do (non-shared) live block migration in the Gate13:54
mdboothAlthough the bug itself is really confined to the calling conventions of migrateToURI3 ()13:54
*** alex_xu has quit IRC13:54
*** gcb has quit IRC13:54
*** alex_xu has joined #openstack-nova13:54
mdboothWe're going to have to backport it a long way, btw.13:54
*** slaweq_ has quit IRC13:56
openstackgerritMatt Riedemann proposed openstack/nova master: DNM: Run test_volume_backed_live_migration and iscsi test  https://review.openstack.org/50816313:56
mriedem^13:56
*** belmoreira has quit IRC13:57
kashyapHmm, as an aside, seems like Nova cgit is out of sync with GitHub:13:57
kashyaphttps://github.com/openstack/nova/blob/master/nova/tests/live_migration/hooks/run_tests.sh13:57
kashyaphttp://git.openstack.org/cgit/openstack/nova/tree/nova/tests/live_migration/hooks/run_tests.sh?id=068d85113:57
kashyapMaybe /me should check w/ -infra13:58
mriedemmdbooth: if you plan on backporting this to essex, do we really need https://review.openstack.org/#/c/507488/ in the mix for the backports?13:58
mriedemyou can't isolate that for your fix and backport, and then do ^ on top?13:58
*** nikhil has joined #openstack-nova13:58
mdboothmriedem: I'll do that during the backport. IIRC it just poked a bug in a unit test.13:58
dansmithbauzas: wanna re-+W this after fixes were applied?13:58
dansmithhttps://review.openstack.org/#/c/498947/1013:58
mriedemmdbooth: why not do it now?13:59
mriedemotherwise the stable reviewers have to figure out why there is a diff13:59
mdboothBecause it makes it messier upstream, and it's like a 1 line diff.13:59
mdboothIn a unit test.13:59
mriedemmdbooth: so when you say backport, you only mean internal backports?13:59
mdboothI'll be doing both.14:00
*** hemna_ has quit IRC14:00
mriedemok. so as a stable reviewer, why do i need to sort out this diff? just isolate the py3 thing into the fix patch for migrateToURI and do the more general thing on top14:00
*** Yingxin has quit IRC14:01
mdboothYou should read my backport commit messages :) They're immaculate.14:01
*** awaugama has joined #openstack-nova14:01
*** yamahata has quit IRC14:01
dansmith-114:02
*** alex_xu has quit IRC14:02
*** gcb has joined #openstack-nova14:02
*** links has quit IRC14:02
openstackgerritChris Dent proposed openstack/nova-specs master: Add spec for symmetric GET and PUT of allocations  https://review.openstack.org/50816414:03
*** ijw has joined #openstack-nova14:03
*** belmoreira has joined #openstack-nova14:03
*** Yingxin has joined #openstack-nova14:03
*** slaweq_ has joined #openstack-nova14:03
mdboothmriedem: Incidentally, ever seen this bash-hackery: https://github.com/mdbooth/openstack-dev-hacks/blob/master/openstack.bash#L1-L414:04
* mdbooth uses diffdiff a lot14:04
*** gbarros has joined #openstack-nova14:04
mriedembauzas: do you think you'll be able to get to https://review.openstack.org/#/c/507488/ today? if not, i can help clean it up14:05
bauzasdans14:06
bauzasdansmith: done14:06
bauzasmriedem: not sure I understand you, you mean me reviewing https://review.openstack.org/#/c/507488/ ?14:06
*** slunkad has joined #openstack-nova14:06
dansmithbauzas: thanks14:06
mriedembauzas: oops, wrong patch14:06
mriedembauzas: this one https://review.openstack.org/#/c/506093/14:07
bauzasmriedem: FWIW, I'll have to bail out in 20 mins because I have to attend a Lyon OpenStack meetup (and btw. I'll miss today's nova meeting)14:07
openstackgerritAlex Xu proposed openstack/nova-specs master: Request traits in Nova  https://review.openstack.org/46879714:07
bauzasmriedem: yeah I can fix that14:07
bauzas20 mins is enough14:07
*** artom has quit IRC14:07
*** jaosorior has joined #openstack-nova14:08
*** ijw has quit IRC14:08
*** crushil has joined #openstack-nova14:09
*** tidwellr has joined #openstack-nova14:09
mriedemdansmith: what would be the best way to go about renaming the 'recreate' parameter in the rebuild_instance method in the compute manager, given rpc14:10
*** Eran_Kuris has quit IRC14:11
mriedemadd an 'evacuate' kwarg? so we could eventually drop the recreate parameter in a major rpc versoin bump?14:11
dansmithmriedem: check the min version and send it the right way depending on what we're pinned to,14:11
*** NostawRm has quit IRC14:11
dansmithbut you have to do the "if recreate or evacuate" logic in the top of the manager function,14:11
dansmithwhich will probably not improve confusion14:11
dansmithor, reduce14:12
dansmithyou could just do this at the top of the manager:14:12
mriedemok, alternatively i was just going to do:14:12
mriedemevacuate = recreate14:12
dansmithevacuate = recreate14:12
dansmithyeah14:12
mriedemand replace all usage of the variable14:12
mriedemok14:12
openstackgerritEd Leafe proposed openstack/nova-specs master: Return Alternate Hosts  https://review.openstack.org/50427514:12
edleafejohnthetubaguy: ^^ hope this addresses your comments14:12
*** smatzek has joined #openstack-nova14:13
*** sree has quit IRC14:13
bauzasmriedem: not sure I get your comment on https://review.openstack.org/#/c/506093/4/nova/tests/functional/regressions/test_bug_1718455.py@13514:15
bauzasmriedem: if the migration isn't done yet, we should fail the test right?14:15
*** smatzek_ has joined #openstack-nova14:16
mriedembauzas: that code is waiting for the migration status to be 'running'14:16
mriedemwhich is not waiting for it to be done14:16
bauzasmriedem: so, s/running/done ?14:16
mriedemyou'd have to see whatever status we set the migration to when it's done14:16
*** alex_xu_ has joined #openstack-nova14:17
mriedemcompleted14:17
mriedemis what is in _post_live_migrate in the compute manager14:17
mriedem*_post_live_migration14:17
bauzasah, I understand14:17
bauzasso, when it's running, that means the migration is in progress14:17
bauzasmy bad14:17
mriedemcorrecto14:18
mriedemhence the race14:18
bauzasokay, uploading14:18
*** smatzek has quit IRC14:19
alex_xu_mriedem: gmann, jaypipes , next week is holiday in china, I will begin the vacation from tomorrow, so I won't active next week, probably just update spec when online since those two traits spec are very close.14:19
openstackgerritSylvain Bauza proposed openstack/nova master: Ensure instance can migrate when launched concurrently  https://review.openstack.org/50609314:20
openstackgerritChris Dent proposed openstack/nova master: [placement] Update the placement deployment instructions  https://review.openstack.org/46904814:20
mriedemalex_xu_: ok14:20
bauzasalex_xu_: I was planning a spec review week, I could help you by providing new updates if you agree14:20
cdentstephenfin: good comments, but I decided to deny you the “that” because why not14:20
alex_xu_bauzas: yea, sure, please free to update, appreciate the help!14:21
bauzask14:22
* bauzas runs off now14:22
jaypipesalex_xu_: cool. you ok with me or bauzas updating?14:25
jaypipesalex_xu_: enjoy your vacation! :)14:26
alex_xu_jaypipes: yes, sure, thanks!14:26
*** moshele has quit IRC14:26
mdboothlyarwood: Just reviewing stable rescue spec for resubmission. Given that it seems we need to touch the api anyway, if you did it again would you make 'stable' an argument to the rescue rest api?14:27
lyarwoodmdbooth: no, iirc the only api changes were a new microversion for the new behaviour right?14:27
* mdbooth is just thinking it's a better user experience to do rescue --stable with your existing rescue image, rather than uploading a new one with some different image parameters14:28
mdboothThe different image parameters would still be required if you wanted to change the bus though, I guess...14:29
lyarwoodmdbooth: yeah I was about to say that they provide more than just turning it on and off, I'd keep that as the interface tbh and just add in the microversion14:29
mdboothBut in the main, I'd expect that 'add this regular root disk at the end and boot from it' would work, so the only user change would be --stable14:29
mdboothAnd in fact, given that by default we use the original boot image as the rescue image...14:30
mdboothWe would enable the use case of no additional changes, just rescue --stable14:30
*** cfriesen__ has joined #openstack-nova14:31
lyarwoodmdbooth: yeah, I still wouldn't but it's your baby now ;)14:32
mdboothHehe. It would be slightly simpler to leave it alone, of course. I just wonder if it wouldn't be easier for users.14:33
*** rtjure has joined #openstack-nova14:35
johnthetubaguyedleafe: great updates for the alternate hosts spec, just have a question on the follow up to gibi around things other than build14:35
*** hongbin has joined #openstack-nova14:35
johnthetubaguyedleafe: there are quite a few users of select_destinations, its worth having at least a note about the approach there14:36
*** ijw has joined #openstack-nova14:36
openstackgerritsahid proposed openstack/nova master: pci: update PciDevice object field 'address' to accept NULL  https://review.openstack.org/50817514:36
openstackgerritsahid proposed openstack/nova master: pci: add for PciDevice object new field mdev  https://review.openstack.org/50817614:36
openstackgerritsahid proposed openstack/nova master: pci: generalize object unit-tests for different framework  https://review.openstack.org/50817714:36
openstackgerritsahid proposed openstack/nova master: pci: add support for mdev device type request  https://review.openstack.org/50817814:36
openstackgerritsahid proposed openstack/nova master: pci: generalize stats unit-tests for different framework  https://review.openstack.org/50817914:36
openstackgerritsahid proposed openstack/nova master: pci: add support for mdev devices type devspec  https://review.openstack.org/50818014:36
openstackgerritsahid proposed openstack/nova master: pci: add support for resource pool stats of mdev devices  https://review.openstack.org/50818114:36
openstackgerritsahid proposed openstack/nova master: pci: make manager to accept handling mdev devices  https://review.openstack.org/50818214:36
openstackgerritsahid proposed openstack/nova master: libvirt: update PCI node device to report mdev devices  https://review.openstack.org/50818314:36
openstackgerritsahid proposed openstack/nova master: libvirt: report mdev resources  https://review.openstack.org/50818414:36
openstackgerritsahid proposed openstack/nova master: libvirt: add support to start vm with using mdev (vGPU)  https://review.openstack.org/50818514:36
openstackgerritsahid proposed openstack/nova master: functional: rework fakelibvirt host pci devices  https://review.openstack.org/50818614:36
openstackgerritsahid proposed openstack/nova master: libvirt: resuse SRIOV funtional tests for MDEV devices  https://review.openstack.org/50818714:36
*** slaweq_ has quit IRC14:37
openstackgerritMatt Riedemann proposed openstack/nova master: What is the meaning of....recreate?  https://review.openstack.org/50819014:38
mriedemjohnthetubaguy: edleafe: good point - note that the only other place we do reschedules is cold migrate/resize14:39
*** dave-mccowan has quit IRC14:39
mriedemevacuate, unshelve, live migration don't do the reschedule dance between compute and conductor,14:39
mriedemlive migration does a reschedule dance of it's own, but that happens in super conductor14:39
edleafejohnthetubaguy: ok, but I'm not sure as to the depth you would like, beyond stating that the return from select_destinations will change14:39
mriedemedleafe: it's probably worth calling out (1) where we rely on reschedules and (2) that those paths will need to be aware of this change14:40
mriedemso build, resize/migrate, live migrate14:40
*** spotz_ is now known as spotz14:40
mriedemand we should probably be sure to have functional tests for hitting those reschedule flows14:40
edleafemriedem: yeah - they'll need to adapt to handle the different return value, but they don't need to change what they do with it14:40
mriedemthe good news is i think we already do have functional tests for reschedules with those 3 flows now14:41
edleafethey *can* change, but that's out of scope for this14:41
mriedemcdent: i thought you might like the philosophical tone of https://review.openstack.org/#/c/508190/14:41
cdentheh14:41
*** ijw has quit IRC14:42
cdent“The meaning is, don't ask.” is my new bumper sticker, t-shirt, tattoo14:42
-openstackstatus- NOTICE: The infra team is now taking Zuul v2 offline and bringing Zuul v3 online. Please see https://docs.openstack.org/infra/manual/zuulv3.html for more information, and ask us in #openstack-infra if you have any questions.14:42
cdentthis ^ is very exciting14:43
*** mdnadeem has quit IRC14:44
*** dave-mccowan has joined #openstack-nova14:44
*** slaweq_ has joined #openstack-nova14:45
johnthetubaguyedleafe: so saying its out of scope, and only minimal changes required to make the new interface work is OK I guess, but my concern is what mriedem said14:47
openstackgerritChris Dent proposed openstack/nova master: [placement] Update the placement deployment instructions  https://review.openstack.org/46904814:47
*** slunkad has quit IRC14:47
*** alexchadin has quit IRC14:48
mriedemi don't know what 'can change' and 'out of scope' means here14:49
mriedemalternative hosts means, reschedules should work, yes?14:50
*** vladikr has quit IRC14:50
johnthetubaguymriedem: well that way my initial take, I guess you could do builds first and other stuff second14:50
mriedemare we saying, we'll make build reschedules work, but resize reschedules won't?14:50
mriedemlive migration reschedules are ok since they happen in super conductor14:51
*** slunkad has joined #openstack-nova14:51
johnthetubaguywell I was assuming that would be some follow up spec, but that does seem a bit silly to me14:51
mriedemit's the compute<>conductor action that is the problem i think14:51
johnthetubaguyyeah, live-migrate ones seem fine14:51
edleafemriedem: I was concerned with the boiling the ocean type of spec14:52
edleafemriedem: if you think it's wise, I can expand it to cover every use of select_destinations()14:52
mriedemedleafe: ok, but we also got into a lot of hot water late in pike because the claims in the scheduler stuff didn't take into account move operations14:52
mriedemso the main issue we're trying to solve is that the cell conductor can't reach the scheduler14:53
mriedemthere are only 2 times that happens,14:53
mriedembuild and resize14:53
mriedemlive migrate reschedules happen in super condcutor which can reach the scheduler, so that's fine - you could make a note of it as something we know about and don't need to change14:53
edleafemriedem: ok, I'll dig into resize, and add some stuff about that14:53
johnthetubaguyevacuate or shelve? not sure if they retry at all?14:53
*** andreas_s_ has quit IRC14:53
*** Swami has joined #openstack-nova14:53
mriedemjohnthetubaguy: they don't14:53
johnthetubaguyOK14:53
*** smatzek_ has quit IRC14:54
mriedemprep_resize on the compute will call back to resize_instance in the conductor, which calls migrate_server, which calls the scheduler for a new destination14:54
mriedemso that is the flow, besides build, that has to also be fixed14:54
johnthetubaguyOK, so if its only two, we should do them together I think14:54
mriedemafter 5 years working in nova, i think i finally have these conductor flows memorized14:54
johnthetubaguythey changed after I last did that14:55
johnthetubaguyand I slept since then14:55
cdentyou sleep?14:55
johnthetubaguyyeah, I know, old school14:55
*** tidwellr has quit IRC14:55
edleafemriedem: I don't know conductor flows that clearly, but that sounds like a very different problem than retries14:56
johnthetubaguyits the same compute -> wrong conductor right?14:56
edleafemriedem: that sounds like the entire flow needs to change, and alternate hosts won't address that14:56
*** slunkad has quit IRC14:56
johnthetubaguyyou replace a call to select_destinations to a claim the next candidate host right?14:57
*** tbachman has quit IRC14:57
johnthetubaguy(wibble passing the data through)14:57
edleafejohnthetubaguy: the call up happens before select_destinations, at least in mriedem's flow14:57
mriedemedleafe: it's essentially the same as the build flow14:57
mriedemjust different methods14:57
mriedemcompute:build_and_run_instances calls up to conductor:build_and_run_instances14:58
mriedemcompute:prep_resize calls up to conductor:resize_instance14:58
mriedemboth of those methods in the cell conductor eventually ask the scheduler for a new dest14:58
edleafeoh, you're talking about API-level compute, not cell compute14:58
*** gyee has joined #openstack-nova14:58
dansmithwhat is api-level compute?14:58
*** hemna_ has joined #openstack-nova14:58
mriedemedleafe: there is no such thing14:58
*** MVenesio has quit IRC14:58
edleafemriedem: I didn't think so, but it sounded like you were14:59
mriedemhttps://docs.openstack.org/nova/pike/user/cellsv2_layout.html#multiple-cells14:59
edleafethe call up from compute isn't after select_destinations; it's before in a resize14:59
mriedemin ^ the compute only has access to the cell conductor14:59
*** belmorei_ has joined #openstack-nova14:59
mriedemi think we're talking about different things14:59
edleafeyes, we are - that's what I've been trying to say15:00
*** belmoreira has quit IRC15:00
edleafealternate hosts just removes the need for a retry to have to call up from the cell15:00
mriedemresize flow is, summarized: api -> superconductor -> scheduler -> superconductor -> compute (reschedule) -> cell conductor -> compute (with alternate hosts)15:00
mriedemyes, in ^ we can't upcall from the cell conductor to the scheduler15:00
edleafein your resize flow, the problem is that the call from the cell already is happening, and needs to change15:00
mriedemhence the need to pass the alternate hosts through15:00
mriedemfor both build and resize15:00
johnthetubaguy https://github.com/openstack/nova/blob/8a386b055c82df67092a1abc683e7225ef80671e/nova/compute/manager.py#L384715:01
openstackgerritDan Smith proposed openstack/nova master: Move allocation manipulation out of drop_move_claim()  https://review.openstack.org/49894715:01
openstackgerritDan Smith proposed openstack/nova master: Make allocation cleanup honor new by-migration rules  https://review.openstack.org/49894815:01
openstackgerritDan Smith proposed openstack/nova master: Pre-create migration object  https://review.openstack.org/49895015:01
openstackgerritDan Smith proposed openstack/nova master: Revert allocations by migration uuid  https://review.openstack.org/49894915:01
openstackgerritDan Smith proposed openstack/nova master: Refactor resource tracker to account for migration allocations  https://review.openstack.org/50641915:01
openstackgerritDan Smith proposed openstack/nova master: Make migration uuid hold allocations for migrating instances  https://review.openstack.org/50642015:01
openstackgerritDan Smith proposed openstack/nova master: Make live migration hold resources with a migration allocation  https://review.openstack.org/50763815:01
*** hferenc has quit IRC15:01
johnthetubaguyvs https://github.com/openstack/nova/blob/8a386b055c82df67092a1abc683e7225ef80671e/nova/compute/manager.py#L188015:02
johnthetubaguyseems the same flow15:02
johnthetubaguyi.e. +1 mriedem15:02
*** vladikr has joined #openstack-nova15:03
johnthetubaguyI guess its the second visit here that should not call the scheduler again: https://github.com/openstack/nova/blob/7cd9e3b8bb7fc0601786847f19cdf3f706ec079f/nova/conductor/tasks/migrate.py#L6715:03
mriedemcorrect15:03
mriedemjust like this one https://github.com/openstack/nova/blob/7cd9e3b8bb7fc0601786847f19cdf3f706ec079f/nova/conductor/manager.py#L55215:04
johnthetubaguy++15:04
mriedem^ is the build reschedule within the cell conductor15:04
*** hemna_ has quit IRC15:05
edleafewell, you've succeeded in completely confusing me as to what you want in the spec15:06
*** smatzek_ has joined #openstack-nova15:07
*** dave-mcc_ has joined #openstack-nova15:07
*** sdague has quit IRC15:07
edleafeWill it be enough to add that resize can also make use of the alternates? Or are there some other logical flows that need to be changed?15:08
mriedemi think that is enough15:08
mriedemand point out that live migration does reschedules, but within superconductor so we don't need to worry about those15:08
*** dave-mccowan has quit IRC15:09
johnthetubaguyedleafe: given the bits I just found out that doesn't do retries, I am +1 what mriedem just said15:09
*** xyang1 has joined #openstack-nova15:11
edleafeok, I'll push another revision soon15:11
*** MVenesio has joined #openstack-nova15:12
*** jaosorior has quit IRC15:12
*** Oku_OS is now known as Oku_OS-away15:13
*** huanxie has joined #openstack-nova15:15
*** tbachman has joined #openstack-nova15:18
*** slaweq_ has quit IRC15:18
*** gbarros has quit IRC15:19
*** gbarros has joined #openstack-nova15:21
*** psachin has quit IRC15:21
*** smatzek_ has quit IRC15:22
*** penick has joined #openstack-nova15:25
*** tbachman has quit IRC15:27
*** penick has quit IRC15:29
*** trinaths has joined #openstack-nova15:29
*** penick has joined #openstack-nova15:29
*** smatzek has joined #openstack-nova15:30
*** slaweq_ has joined #openstack-nova15:30
*** sridharg has quit IRC15:31
*** trinaths1 has quit IRC15:31
*** tbachman has joined #openstack-nova15:32
*** crushil has quit IRC15:34
*** crushil has joined #openstack-nova15:35
*** tssurya has quit IRC15:35
*** tbachman has quit IRC15:37
*** NostawRm has joined #openstack-nova15:37
*** trinaths has quit IRC15:37
*** READ10 has joined #openstack-nova15:38
*** hemna_ has joined #openstack-nova15:38
efriedjaypipes Any plan to include a "friendly name" or "description" field on resource provider?15:39
jaypipesefried: there already is.15:39
openstackgerritStephen Finucane proposed openstack/nova master: console: introduce basic framework for security proxying  https://review.openstack.org/34539615:39
openstackgerritStephen Finucane proposed openstack/nova master: console: introduce framework for RFB authentication  https://review.openstack.org/34539715:39
openstackgerritStephen Finucane proposed openstack/nova master: console: introduce the VeNCrypt RFB authentication scheme  https://review.openstack.org/34539815:39
openstackgerritStephen Finucane proposed openstack/nova master: console: provide an RFB security proxy implementation  https://review.openstack.org/34539915:39
openstackgerritStephen Finucane proposed openstack/nova master: doc: Document TLS security setup for noVNC proxy  https://review.openstack.org/50054415:39
* efried looks at the doc again...15:39
jaypipesefried: https://github.com/openstack/nova/blob/master/nova/api/openstack/placement/handlers/resource_provider.py#L3315:40
efriedwoot.15:40
efriedI see it in the API doc now.  Not sure how I missed it.15:40
efriedThanks.15:40
*** trinaths has joined #openstack-nova15:40
jaypipesefried: that's why the ProviderTree allows finding a provider by name or UUID...15:40
efriedoh yeah.  I should really get back to reviewing that series.15:40
*** gjayavelu has joined #openstack-nova15:40
cdentjaypipes, efried: we currently uniq on that name field, if I remember right, and that’s caused problems for some situations, should we change it?15:41
* cdent locates bugh15:41
jaypipesefried: hold off. pushing a new series of revisions after fixing up comments from gibi15:41
efriedjaypipes rgr wilco15:41
cdenthttps://bugs.launchpad.net/nova/+bug/171424815:41
openstackLaunchpad bug 1714248 in OpenStack Compute (nova) "Compute node HA for ironic doesn't work due to the name duplication of Resource Provider " [High,Confirmed]15:41
*** tbachman has joined #openstack-nova15:41
jaypipescdent: you mean we're *not* unique?15:41
*** ragiman has quit IRC15:42
* jaypipes doesn't see how uniqueness is a problem...15:42
* efried doesn't see how non-uniqueness would be a problem...15:42
efriedbut no skin in the game.  Reading bugh...15:42
cdentjaypipes: we enforce uniqueness on the name column15:42
*** cfriesen__ is now known as cfriesen15:42
jaypipescdent: ah, great. that's good then.15:43
cdentjaypipes: which people are saying is bad15:43
cdentbecause they want to blue green a compute node or something15:43
cdentand names get in the way15:43
efriedcdent Skimming this bug, it seems to me like the problem is that the compute service that's taking over should *not* be attempting to create a new RP.15:45
*** yangyapeng has left #openstack-nova15:45
efriedIt should be looking up and using the old one.15:45
openstackgerritMatt Riedemann proposed openstack/nova master: Ensure instance can migrate when launched concurrently  https://review.openstack.org/50609315:45
mriedembauzas: ^ is all cleaned up now15:45
cdentefried: that would be one way to solve that particular problem15:45
efriedIs the RP somehow associated with the compute process rather than the node(s) it's managing?15:45
cfriesenefried: do we ensure hypervisor host name uniqueness?15:46
*** edmondsw has quit IRC15:46
*** huanxie has quit IRC15:46
*** rcernin has quit IRC15:46
cfriesenefried: actually, I guess this is for ironic, so it's not even hypervisor, just host15:46
cfriesenor is there some other way to uniquely identify a host in ironic (I know nothing)15:46
efriedYeah, I don't know from ironic.  Is it like, compute runs on the hypervisor and that represents a single possible instance?15:47
*** crushil has quit IRC15:47
efried(johnthetubaguy this conversation may interest you)15:47
cfriesenefried: I believe nova-compute represents a bunch of baremetal machines15:48
efriedAnd that nova-compute could run on any one of several possible "hypervisors" that all "manage" that bunch of baremetal machines?15:49
cfriesenefried: so then the node where nova-compute is running crashes, and they want a different nova-compute process to take over managing those baremetal machines.15:49
efriedCool.  So my question (cdent, johnthetubaguy): Why is there a RP associated with the nova-compute at all??  Seems like there should just be a RP per baremetal machine.15:49
*** MVenesio has quit IRC15:50
*** gjayavelu has quit IRC15:50
cdentefried: you’d think so, but no15:50
cdenta node has inventory of classes of baremetal15:50
cdent(last I recall, it’s hard to remember/keep straight)15:51
cfriesenefried: I think the idea is that each baremetal machine is a resource15:51
cfriesenor is several types of resource15:51
*** belmorei_ has quit IRC15:51
cfriesensince you always claim a whole machine at a time15:51
efriedBut but but... that would mean that every baremetal node in that nova-compute's purview is "identical".15:52
*** chyka has joined #openstack-nova15:53
mriedemjohnthetubaguy: while you're awake, this is holding up the live migration new style volume attach change, and is simple https://review.openstack.org/#/c/506805/15:53
*** sahid has quit IRC15:53
cdentefried: ironic’s virtdriver’s get_inventory may explain things a bit: https://github.com/openstack/nova/blob/ae4b5d0147cb3e345bf57034221e9c8fedf3cad2/nova/virt/ironic/driver.py#L75115:56
efriedcdent Was just looking at that.15:57
efriedAnd was looking for the change jaypipes was going TODO.15:57
cdenti’m not sure, but I think you can different classes of baremental node, resprsented by multiple custom resource classes15:57
efriedAnd was going to look for where the RP is set up, but not sure where to start looking for that.15:57
openstackgerritEd Leafe proposed openstack/nova-specs master: Return Alternate Hosts  https://review.openstack.org/50427515:58
edleafemriedem: johnthetubaguy: ^^15:58
efriedcdent Yeah, sounds like that's where they're going, but haven't yet.15:58
cdentefried: edleafe did some further work on that chunk of code15:59
johnthetubaguyI am keen to help in the ironic scheduling side of things btw, trying to write up all the traits discussions15:59
cfriesencdent: why wouldn't you follow efried's suggestion and have an RP per baremetal machine that reports resources for memory/disk/cpu?  Then when you want to allocate a baremetal node you look for the smallest machine that can provide what you're looking for.16:00
*** sbezverk has quit IRC16:01
*** armax has joined #openstack-nova16:01
*** sshwarts has quit IRC16:02
cfriesenI suspect this has been discussed already, so if anyone has links to the discussion....16:02
*** slaweq_ has quit IRC16:02
efriedjohnthetubaguy Yeah, I was just poring over your https://review.openstack.org/#/c/507052/2/specs/queens/approved/ironic-traits.rst16:02
*** yassine has quit IRC16:02
efriedwhich is actually what led me down the rabbit hole and ultimately prompted this discussion :)16:03
efriedThough the name conflict bug thing is a tangent-to-a-tangent...16:03
johnthetubaguyso for ironic, resource class matching, and requesting no VCPU,MEM, etc, is the current way forward I thought?16:03
*** itlinux has joined #openstack-nova16:04
cfriesenjohnthetubaguy: this spec? https://specs.openstack.org/openstack/ironic-specs/specs/not-implemented/node-resource-class.html16:04
cfriesenor maybe this one is more accurate: https://blueprints.launchpad.net/nova/+spec/custom-resource-classes-pike16:05
johnthetubaguythe later might be closer, but yeah, that support has all merged16:05
cdentcfriesen: sorry, in yet another meeting, so lost track of the discussion, will come back soon16:05
*** slaweq_ has joined #openstack-nova16:06
cfriesencdent: no worries, just idly curious16:06
johnthetubaguycfriesen: both actually are done I think16:06
dansmithcdent: either your new job comes with lots of extra meetings, or you enjoy and announce them more often16:07
cdentdansmith: these are all upstream meetings, I guess I’m just conscious lately of the extent to which they are distracting me from chatting with you16:08
*** lyan has joined #openstack-nova16:08
dansmithcdent: ah :)16:08
*** takedakn has quit IRC16:08
efriedjohnthetubaguy iiuc, you want to get rid of tracking CPU, memory, etc.; tag each of your nodes with some identifier; and then have your flavor just use that identifier?16:08
johnthetubaguyefried: so I thought the CPU memory, etc tracking was all going in queens, regardless?16:09
efried"going into queens" or "going away in queens" ?16:09
johnthetubaguygoing away in queens16:09
johnthetubaguyoops, missed the important word there16:09
cfriesenefried: there's an interesting short email chain here: https://openstack.nimeyo.com/91493/openstack-dev-ironic-nova-indivisible-resource-providers16:09
*** trinaths has quit IRC16:10
efriedjohnthetubaguy I assume that's just an ironic statement16:10
efriedI honestly know nothing about ironic, learning as I go in the context of this chat.16:10
johnthetubaguythat's what the comment in the Nova code was saying, based on plan A for Nova I believe?16:10
* johnthetubaguy finds code...16:11
johnthetubaguyhttps://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L75816:11
johnthetubaguyironic resources are indivisable16:11
johnthetubaguycustom resource classes model that nicely16:12
efriedRight, so the point will be to have a custom resource class representing a "kind" of node, such that any node associated with that resource class is effectively "identical" to any other.16:12
johnthetubaguywell, "identical" from the point of view of the flavor16:13
johnthetubaguyyou might have several generations mapped to a single resource class, if you want16:13
efriedRight.  And you're modeling the compute process as the resource *provider* of the resources of the various classes it can see.16:13
*** gbarros has quit IRC16:13
efried(What do we call the thing the compute process runs on?  The "hypervisor"?)16:13
johnthetubaguyno, the resource provider is the ironic node uuid in Ironic16:14
efriedWhere "node" isn't the baremetal machine, it's the thing that manages 'em, right?16:14
johnthetubaguynova-compute process manages multiple ironic nodes (that list varies depending on the hash ring, hence the bug)16:14
johnthetubaguyso the host is nova-compute16:14
efriedayee16:14
efriedTerminology fail.16:15
johnthetubaguythe node is the ironic node16:15
johnthetubaguythe node is the resource provider16:15
*** itlinux has quit IRC16:15
cdentnova-compute hosts multiple ironic nodes, each of which have an inventory of customr resource class with count of 116:15
cdent(my memory is starting to refresh)16:15
johnthetubaguy+1 cdent16:15
efriedBut some of those ironic nodes can be using the same resource class, if they're functionally "identical"16:16
efried?16:16
cdentyes16:16
efriedSo it would seem like, as part of the failover process, the host that's taking over ought to delete the RP for the failed host.16:17
*** armax has quit IRC16:17
johnthetubaguyyeah, each is offering 1: CUSTOM_GOLD16:17
efriedSeems like that ought to happen regardless, otherwise the scheduler will think it's still there and may try to schedule stuff to it.16:17
*** gbarros has joined #openstack-nova16:17
johnthetubaguyso for that bug16:17
efriedyeah, for that bug16:17
*** Apoorva has joined #openstack-nova16:17
*** Apoorva has quit IRC16:17
johnthetubaguythe dead thing would normally be responsible for the delete of it16:17
efriedThat... doesn't make sense.  It's dead.  It can't call the placement API.16:17
johnthetubaguyright, that's the problem16:18
*** Apoorva has joined #openstack-nova16:18
efriedAt some level, the new guy must know he's taking over for the old guy.16:18
efriedSo why can't he delete the old guy's RP?16:18
johnthetubaguynot sure if it sees that edge16:18
johnthetubaguyit just sees a new node right now16:18
johnthetubaguybut not 100% sure on that16:19
efriedWell.16:19
*** corey_ has joined #openstack-nova16:19
efriedIs there a split-brain possibility here?16:19
cfriesenjohnthetubaguy: for virtual machines (like with a vmware backend) nova-compute runs on the "node", and the hypervisor runs on the "host", right?  why did ironic reverse the naming?16:19
*** cleong has quit IRC16:20
dansmithcfriesen: no, the reverse16:21
dansmithcfriesen: but vmware doesn't actually run like that16:21
dansmith(anymore)16:21
dansmithwell,16:21
dansmithit doesn't expose a 1:N host:node structure I mean16:22
dansmithit still runs external I think, but...16:22
dansmithcfriesen: nova-compute always runs on the "host" which is where the service record is (nova-compute being a service) and the "node" is the actual hypervisor16:23
dansmithironic runs one nova-compute for multiple "hypervisor" nodes, which can't by definition run the service on them16:23
dansmithironic is the _reason_ we have that (blasted) model so it's setting the standard, not doing something reverse of what the model was designed for16:24
cfriesendansmith: got it, thanks.  wonder where I got flipped around.16:27
dansmithcfriesen: it's unfortunately very convoluted for little gain :(16:28
*** itlinux has joined #openstack-nova16:29
*** lpetrut has quit IRC16:30
cfriesenso how does "compute_node = self._get_compute_info(context, self.host)" make any sense then, if there could be multiple compute nodes per host?16:30
dansmithcfriesen: is that in the resource tracker?16:30
cfriesennova/compute/manager.py16:31
dansmithcfriesen: oh, look at the function16:31
dansmithcfriesen: it returns the first16:31
dansmith"for old compat"16:32
dansmithand since ironic doesn't support live migration...YET16:32
*** ralonsoh has quit IRC16:33
*** manasm has joined #openstack-nova16:35
*** Swami has quit IRC16:36
*** edand has quit IRC16:37
openstackgerritJay Pipes proposed openstack/nova master: placement: set/check if inventory change in tree  https://review.openstack.org/47057516:38
openstackgerritJay Pipes proposed openstack/nova master: placement: integrate ProviderTree to report client  https://review.openstack.org/41592116:38
openstackgerritJay Pipes proposed openstack/nova master: placement: add nested resource providers  https://review.openstack.org/37713816:38
openstackgerritJay Pipes proposed openstack/nova master: placement: allow filter providers in tree  https://review.openstack.org/37721516:38
openstackgerritJay Pipes proposed openstack/nova master: placement: adds REST API for nested providers  https://review.openstack.org/38480716:38
openstackgerritJay Pipes proposed openstack/nova master: placement: update client to set parent provider  https://review.openstack.org/38569316:38
*** slunkad has joined #openstack-nova16:40
*** slaweq_ has quit IRC16:42
mriedemstvnoyes: the multinode live migration grenade job failed on your live migration new style attach patch, but it failed here http://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/logs/subnode-2/screen-n-cpu.txt.gz?level=TRACE#_Sep_26_14_28_11_63795816:43
mriedemand looking at logstash, that happens on a ton of patches, so it's probably just a 100% failure in that job right now16:43
dansmithjaypipes: I'm missing the reasoning for the complicated "compare two dicts" method in that first patch16:43
*** penick has quit IRC16:44
*** karts has joined #openstack-nova16:44
jaypipesdansmith: yeah, it's a long conversation on previous revisions... I'm going to change it to only compare the total field value and ignore the other things like reserved/min_unit/allocation_ratio, etc16:44
dansmithjaypipes: oh, sorry I can re-read.. but, is this not to be used for "know when I need to report new inventory" sort of thing?16:45
jaypipesdansmith: the reason it's like that is because we still don't have any consistency and agreement on who (virt driver or resource tracker) owns various fields about the inventory like alloc ratio etc16:45
*** alex_xu_ has quit IRC16:45
efrieddansmith The history is here: https://review.openstack.org/#/c/470575/2/nova/compute/provider_tree.py@9816:45
dansmithjaypipes: ah, to avoid us reporting new just because the virt driver thinks the allocation_ratio should be different?16:46
jaypipesyup16:46
dansmithhmm16:47
dansmiththe virt driver needs to report total and reserved16:47
*** karthiks has quit IRC16:47
dansmithbut allocation_ratio is clearly the purview of the compute manager16:47
dansmithmin_unit is probably virt driver I guess16:47
dansmithtaking the scaleio example of 8GB minimum slice or whatever16:48
*** penick has joined #openstack-nova16:48
*** cdent has quit IRC16:49
mriedemstvnoyes: yeah the grenade live migration job is just totally busted http://tinyurl.com/y9ca6zox16:51
mriedemsomething changed in august http://tinyurl.com/yby7m5p816:51
stvnoyesthat's pretty bad16:52
efriedjohnthetubaguy jaypipes Where does ironic (or ftm any virt driver) set up its resource providers today?16:53
jaypipesefried: it doesn't. the RT does.16:53
jaypipesefried: because there's only one RP.16:54
mriedemstvnoyes: looking at http://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/console.html#_2017-09-26_14_28_03_89412516:54
efriedjaypipes In ironic, only one RP per compute host?  Not one RP per ironic node?16:54
mriedemtempest.api.compute.admin.test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration [22.911966s] ... ok16:54
mriedemtempest.api.compute.admin.test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration [22.911966s] ... ok16:54
mriedemoops16:54
jaypipesefried: we want to get to where there is a sort of mediation/negotiation between the RT and the virt driver and the generic device manager as each of them "processes" the ProviderTree and sets inventory records and traits based on their own information.16:55
mriedemtempest.api.compute.admin.test_live_migration.LiveMigrationTest.test_live_block_migration [10.052345s] ... FAILED16:55
mriedemso it works with the 2.25 microversion, where we pass block_migration=auto16:55
mriedembut fails before that16:55
jaypipesefried: in ironic, each baremetal Ironic node is its own RP in placementy.16:55
mriedemso i bet something with the auto changes broke how we do live block migration between n-1 hosts16:55
*** kenperkins has quit IRC16:56
*** derekh has quit IRC16:56
stvnoyeswhat were the auto changes?16:56
efriedjaypipes Aha.  Then bug 1714248 exists because... the compute host is creating its own separate RP for some reason?16:56
openstackbug 1714248 in OpenStack Compute (nova) "Compute node HA for ironic doesn't work due to the name duplication of Resource Provider " [High,Confirmed] https://launchpad.net/bugs/171424816:56
jaypipesefried: not sure, lemme read16:56
*** crushil has joined #openstack-nova16:56
efriedoh, or because the RT is trying to create a new RP for the node it's taking over...16:57
jaypipesefried: note that nova-compute was *never* intended for "HA setups"...16:57
mriedemstvnoyes: https://docs.openstack.org/nova/pike/reference/api-microversion-history.html#maximum-in-mitaka16:57
*** vks1 has joined #openstack-nova16:57
mriedem^ predates the spike in failures though, which started around 8/1816:57
efried...And that's out of the control of ironic-specific code...16:57
efriedwhich is why my comment #5 is a non-starter16:58
efrieduntil, as you say, there's some coordination between RT and virt to manage the RPs.16:58
stvnoyesmriedem: brb- grabbing lunch16:59
*** baoli has quit IRC17:00
mriedemstvnoyes: ok. it also fails on the pike compute...17:00
*** baoli has joined #openstack-nova17:01
*** MVenesio has joined #openstack-nova17:02
johnthetubaguyefried: I have to head out now and cook my dinner, but I think this maps nicely to how we setup traits, I am leaning towards ironic doing things in placement17:04
efriedjohnthetubaguy Okay.  I've got a passel of draft comments on your spec, which should be ready for your perusal next time you're on.17:05
johnthetubaguycool, thanks17:05
dansmithjaypipes: in the db migration, why aren't we referencing the parent provider by id instead of uuid?17:06
dansmithjaypipes: and, isn't recording the root just going to limit us later when we need to restructure a tree?17:06
efriedjohnthetubaguy (Looking back over 'em, removing the ones we've talked about in here, the only things left are typos ):17:06
jaypipesdansmith: a good question on the parent provider UUID thing. not entirely sure why I did that.17:07
*** Swami has joined #openstack-nova17:09
dansmithjaypipes: I can't tell you how elated I feel -1ing a db schema change of yours for performance reasons17:09
jaypipesdansmith: recording the root is an optimization to avoid needing to do hierarchical queries. and we don't restructure the root, only potentially children within the tree (in other words, root_provider_id won't change.17:09
jaypipesdansmith: :)17:09
dansmithjaypipes: right, it won't for compute nodes, but it could for other types of resources17:10
dansmithjaypipes: like you move a disk shelf from one NAS device to another17:10
jaypipesdansmith: possibly, sure, but those kinds of moves are few and far between in comparison to the 10 or 100 times as many read requests for tree data17:11
*** claudiub|3 has quit IRC17:11
dansmithhmm17:11
dansmithjaypipes: well, I commented for later17:13
jaypipesokey dokey17:13
dansmithjaypipes: I haven't gotten to how we tell placement about our parent, but presumably we're forbidden from trying to reparent a first-level provider?17:14
jaypipesdansmith: haven't gotten to that either.17:15
dansmithjaypipes: also, in case you're wondering17:15
dansmithjaypipes: yes, it's amazingly beautiful out here on the deck... 71F and clear skies17:16
*** baoli has quit IRC17:16
jaypipesdansmith: lol17:16
*** gjayavelu has joined #openstack-nova17:17
*** sambetts is now known as sambetts|afk17:17
*** nikhil has quit IRC17:18
*** baoli has joined #openstack-nova17:24
*** karts has quit IRC17:25
openstackgerritEd Leafe proposed openstack/nova-specs master: Return Alternate Hosts  https://review.openstack.org/50427517:26
*** Guest93 has joined #openstack-nova17:27
*** Apoorva_ has joined #openstack-nova17:30
*** esberglu has quit IRC17:31
*** baoli has quit IRC17:32
*** huanxie has joined #openstack-nova17:32
*** baoli has joined #openstack-nova17:32
mriedemstvnoyes: aha17:32
mriedemit's a ci job configuration issue17:32
mriedemthe nodes are configured differently for block migration17:33
*** Apoorva has quit IRC17:33
*** manasm has quit IRC17:36
stvnoyesmriedem: that's good to hear. much better than a code/upgrade issue.17:36
mriedemi'm pretty sure i've had to fix this before...17:36
*** karts has joined #openstack-nova17:38
*** vks1 has quit IRC17:42
*** eandersson has joined #openstack-nova17:44
eanderssonIs versioned notifications properly implemented in Mitaka? We don't see any versioned notifications being sent.17:44
openstackgerritDan Smith proposed openstack/nova master: Use improved instance_list module in compute API  https://review.openstack.org/50541817:44
openstackgerritDan Smith proposed openstack/nova master: Fix CellDatabases fixture swallowing exceptions  https://review.openstack.org/50631217:44
openstackgerritDan Smith proposed openstack/nova master: Fix minor input items from previous patches  https://review.openstack.org/50641617:44
*** esberglu has joined #openstack-nova17:45
*** lpetrut has joined #openstack-nova17:46
*** jpena is now known as jpena|off17:47
*** manasm has joined #openstack-nova17:50
*** itlinux has quit IRC17:51
*** itlinux has joined #openstack-nova17:53
*** baoli has quit IRC17:56
mriedemeandersson: probably not at that point17:56
*** baoli has joined #openstack-nova17:57
mriedemintroduced in newton https://specs.openstack.org/openstack/nova-specs/specs/newton/implemented/versioned-notification-transformation-newton.html17:57
mriedemthe framework code was in mitaka17:57
eanderssonI see - thanks mriedem17:58
*** Guest93 has quit IRC18:01
*** edmondsw has joined #openstack-nova18:01
*** huanxie has quit IRC18:02
*** edmondsw has quit IRC18:04
*** edmondsw has joined #openstack-nova18:04
*** manasm has quit IRC18:04
*** baoli has quit IRC18:07
*** Apoorva_ has quit IRC18:09
*** Apoorva has joined #openstack-nova18:10
*** baoli has joined #openstack-nova18:10
*** tssurya has joined #openstack-nova18:10
mriedemmtreinish: do you know anything about how tempest is upgraded in grenade?18:11
mtreinishmriedem: it's not, the code and config should be the same between versions18:12
sean-k-mooneymriedem: i taught tempest was not upgreaed in grenade because it was not ment to be version specific18:12
mtreinisheverything should be master for tempest18:12
mriedemmtreinish: the config is different between pike and queens18:12
mtreinishmriedem: links?18:12
mriedemat least in this multinode grenade job18:12
mriedemhttp://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/logs/old/tempest_conf.txt.gz18:12
mriedem^ pike18:12
mriedemnote: block_migration_for_live_migration = True18:12
mriedemhttp://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/logs/new/tempest_conf.txt.gz18:13
mriedemqueens ^18:13
sean-k-mooneymriedem: the config is likely different yes but it should be useing the same tempest version18:13
mriedemblock_migration_for_live_migration = False18:13
mriedemthe config is supposed to be copied from old to new https://github.com/openstack-dev/grenade/blob/master/upgrade-tempest#L8218:13
mriedemlooks like that is happening here http://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/logs/grenade.sh.txt.gz#_2017-09-26_14_23_46_48918:14
mtreinishmriedem: yeah I don't know why that's being switched or where that's happening18:14
sean-k-mooneyis devstack regenerating the config on the second run and overriting it?18:15
mriedemold tempest.conf gets it set here http://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/logs/grenade.sh.txt.gz#_2017-09-26_13_58_48_78218:15
mtreinishsean-k-mooney: config should just be copied from old devstack18:16
mtreinishthat's how grenade is supposed to work18:16
mtreinishunless it's explicitly changed in the upgrade script18:16
mtreinishwhich is not something we approve lightly because that means a manual upgrade step18:16
sean-k-mooneymtreinish: yes but devstack generate a new tempest config by default when run so if grenage is reusing that logic it may be chagining it just a guess. you know more about this then i18:17
mtreinishsean-k-mooney: we don't run new devstack18:17
sean-k-mooneyah ok cool18:17
*** mnestratov has quit IRC18:18
mriedemmtreinish: note this is multinode18:18
mriedemso devstack does run on the subnode18:18
mriedembut the subnode is just18:18
mriedemENABLED_SERVICES=c-bak,c-vol,ceilometer-acompute,dstat,g-api,n-cpu,peakmem_tracker,placement-client,q-agt18:18
mtreinishmriedem: right and we don't run tempest on the subnode18:18
dansmithmriedem: is there some reason tonyb didn't +W this? https://review.openstack.org/#/c/506760/18:19
dansmithif not, I'll do it18:19
mriedemdansmith: i assume b/c the change wasn't merged yet on master18:19
mtreinishso even if it was generating a config that shouldn't be coming into play18:19
mriedemer pike18:19
dansmithmriedem: okay but it is now, so good I think?18:19
mriedemyes it's merged on pike18:19
openstackgerritJan Zerebecki proposed openstack/nova master: Fix wording of debug message for future releases  https://review.openstack.org/50826118:19
openstackgerritJan Zerebecki proposed openstack/nova master: Only log not correcting allocation once per period  https://review.openstack.org/50826218:19
*** itlinux has quit IRC18:20
mriedemmtreinish: found it18:22
mriedemshite18:22
mriedemhttp://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/logs/devstack-gate-post_test_hook.txt.gz#_2017-09-26_14_26_36_36418:23
mriedemit's the gd post-test hook for the live migration job setup in nova18:23
mtreinishmriedem: hah, ok I was looking for plugins and there weren't any. But that makes more sense18:23
mriedemhttps://github.com/openstack/nova/blob/ae4b5d0147cb3e345bf57034221e9c8fedf3cad2/nova/tests/live_migration/hooks/run_tests.sh#L3318:24
mriedemaha https://github.com/openstack/nova/blob/ae4b5d0147cb3e345bf57034221e9c8fedf3cad2/nova/tests/live_migration/hooks/run_tests.sh#L5218:24
mriedemgdi18:24
mriedemoh f me18:24
mriedem# TODO(mriedem): Remove this in Queens if we haven't fixed the bug yet.18:24
mtreinishhaha, nice18:25
mriedemwell i think that's for live migration with ceph shared storage, so probably not the actual thing i'm trying to fix, but still18:27
mtreinishmriedem: do you want that block_migration flag to be true or false?18:28
mriedemit needs to be true18:28
mriedembut hold up18:28
mriedemi'm confused as to where the post-test-hook is called18:29
mtreinishmriedem: it's called in devstack gate18:29
mtreinishthe second tempest run is done by devstack gate instead of grenade18:30
*** baoli has quit IRC18:30
mtreinishand looking at that post test hook code you're telling devstack gate to not run tempest, so the hook can modify the tempest config and run it itself18:30
mriedemthe reason the hook is setting block_migration=False is because the tests that come after that are for shared storage (nfs and ceph)18:31
*** Guest93 has joined #openstack-nova18:31
mriedemso i'm confused as to why that's configuring tempest before the tests are run18:31
mriedembecause i can see from the failed tempest log, that tempest is passing block_migration=False b/c that's what's in the config18:32
mriedemstarts running here http://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/console.html#_2017-09-26_14_25_30_59625918:32
mriedemat that point, things pass18:33
mriedemhttp://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/console.html#_2017-09-26_14_26_36_29653918:34
mriedemoh ffs18:34
*** tbachman has quit IRC18:34
mriedemit is the branch thing18:34
*** baoli has joined #openstack-nova18:34
mriedemit passes the first run with live block migration, and then fails the ceph one18:34
mriedempresumably because we just suck with ceph still18:35
*** itlinux has joined #openstack-nova18:36
sean-k-mooneymriedem: right so it failing later here http://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/console.html#_2017-09-26_14_28_50_09693718:36
mriedemwell, so bug 1691769 isn't a problem anymore18:39
openstackbug 1691769 in OpenStack Compute (nova) "gate-grenade-dsvm-neutron-multinode-live-migration-nv fails in pike: "Failed to restart <email address hidden>: Unit <email address hidden> not found."" [Medium,Triaged] https://launchpad.net/bugs/169176918:39
*** avolkov has quit IRC18:39
*** smatzek has quit IRC18:41
mtreinishemail address hidden?18:42
*** crushil_ has joined #openstack-nova18:42
mtreinishhah systemd units18:42
*** smatzek has joined #openstack-nova18:42
mriedemaha18:43
mriedemanother discovery18:43
mriedemwhich dansmith might remember18:43
mriedemgrenade runs in singleconductor more18:43
mriedem*mode18:43
mriedembut,18:43
mriedemthis live migration test hook is configuring /etc/nova/nova-cpu.conf18:44
mriedemhttp://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/logs/subnode-2/etc/nova/nova-cpu.conf.txt.gz18:44
mriedemand it's not running with that one18:44
mriedem['--config-file', '/etc/nova/nova.conf']18:44
mriedemIbc4b21089ef86ab2430874c39d63174528c9a83e18:46
*** smatzek has quit IRC18:46
sean-k-mooneyright its doing that here http://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/console.html#_2017-09-26_14_27_39_368886 and running and here its using /etc/nova/nova.conf http://logs.openstack.org/87/463987/20/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/ae8875f/console.html#_2017-09-26_14_27_56_30140918:47
mriedemyup, the issue is that https://review.openstack.org/#/c/458537/ isn't aware of grenade being singleconductor18:48
mriedembecause, jesus, live migration + grenade + superconductor...crazy18:48
*** smatzek has joined #openstack-nova18:48
sean-k-mooneyso the fix is the run nova-compute with /etc/nova/nova-cpu.conf ?18:52
mriedemno18:52
*** smatzek has quit IRC18:53
openstackgerritMatt Riedemann proposed openstack/nova master: Fix live migration grenade ceph setup  https://review.openstack.org/50827118:55
mriedemi think this is the fix ^18:55
sean-k-mooneyhum that should work however it may be better to always use a seperate config for nova compute so that it does not chage regardless of the config.18:58
mriedemi don't think zuul is running any jobs right now though so, i guess we'll find out later18:58
mriedemsean-k-mooney: oh i'm sure this is air tight and will never require changes again :)18:58
*** moshele has joined #openstack-nova18:58
sean-k-mooney:)18:58
*** MVenesio has quit IRC18:59
sean-k-mooneyby the way https://github.com/openstack/nova/search?utf8=%E2%9C%93&q=TODO%28+Queens&type= that was not the only todo with remove in queens ...18:59
*** mvk has joined #openstack-nova18:59
sean-k-mooneystephenfin: i belive this one is all yours https://github.com/openstack/nova/blob/762c89f85a4aeceb7bed5e80edc70a239872b757/nova/cmd/manage.py#L14119:00
tssuryamriedem, dansmith, melwitt : random off-topic : saw the nova cellv2 meeting logs from yesterday, so sorry I could not attend (was afk due to bad time zone timings) it and for wasting some precious seconds during the meeting; but thanks for the ping. Also from next time I will keep you posted earlier on if I am not attending.19:01
sean-k-mooneywait i just confused myself queens comes after pike...19:01
dansmithtssurya: not a problem and no need to keep us notified of your schedule, I just made a point of pinging you because we had fooled you with our hangout the week prior19:01
melwittno worries tssurya. yep, what dansmith said19:02
*** itlinux has quit IRC19:02
tssuryadansmith, melwitt : cool :) thanks!19:02
*** gbarros has quit IRC19:03
mriedemtssurya: i got to thinking,19:05
*** slaweq_ has joined #openstack-nova19:05
mriedemcern is upgrading to pike right now right?19:05
mriedemand cells v2 was required in ocata,19:05
*** huanxie has joined #openstack-nova19:05
mriedemso it would be nice if you could give us some info on how cern upgraded to ocata and rolled out cellsv2 even though they are using cells v119:05
mriedemlike, was cern in ocata just a single giant cells v2 cell?19:05
tssuryamriedem : no cern is still on newton, it is going to upgrade to ocata19:06
mriedemor, is cern actually migrating to cells v219:06
mriedemi saw something the other day saying they were upgrading glance to pike19:06
mriedemmaybe that's just glance>19:06
mriedem?19:06
tssuryamriedem : yes its just glance19:06
mriedemgah!19:06
tssuryamriedem : nova is still on newton19:06
mriedemis that because of the complications with migrating nova to ocata?19:06
sean-k-mooneytssurya: so cern is migrating to cellsv2 now also19:07
tssuryamriedem : however we will soon upgrade to cells v2 :)19:07
mriedemtssurya: ok, i hope there will be copious amounts of blog posts and such on what the plan was and how it goes19:07
tssuryamriedem , sean-k-mooney : yes belmiro is about to come up with a plan for doing this soon19:07
*** bnemec has quit IRC19:07
sean-k-mooneymriedem: we are waiting for cern to fully migrate to cellsv2 before removing cellsv1 and nova networks correct19:08
dansmithnot just cern19:08
*** moshele has quit IRC19:08
dansmithuntil pike it wasn't even a possibility for multiple cells,19:08
mriedemsean-k-mooney: at the ptg we said if we have dan's efficient instance list stuff in queens, we remove cells v1 and nova-net in rocky19:09
dansmithand many will have issues with multiple cells until queens19:09
sean-k-mooneywell yes but as the bigest user of cells they are a good litmus test that such a migration works at scale19:09
mriedemand we're on a good path to doing that19:09
sean-k-mooneymriedem: ah ok. part of my interest is there is some legacy nova network datamodels in os-vif19:10
sean-k-mooneyhttps://bugs.launchpad.net/os-vif/+bug/172017519:10
openstackLaunchpad bug 1720175 in os-vif "Move "ips" field from Subnet object to VIF object" [High,Triaged]19:10
dansmithsean-k-mooney: get in line :)19:10
sean-k-mooneycurrently nothing uses it but its from when we imported the network models for nova19:10
*** bnemec has joined #openstack-nova19:13
sean-k-mooneydansmith: gladly, i just have to keep remining people that os-vif is used with nova net too so we cant break it eventhough we dont gate on it for the os-vif repo :)19:13
dansmithsean-k-mooney: I'm just saying there's a lot of stuff we get to remove when we drop n-net, and you're late to that party :P19:14
efriedmriedem I have reason to believe that it is impossible to use anything other than the public interface for cinderclient in Nova.19:15
sean-k-mooneyhaha yes though not that late i have wanted to kill nova-net since neutron was still quantum but in fairness to nova net it proably was a better choice for large deployment back then.19:15
efried(mriedem or point me to someone else who would have the inclination to walk through this with me)19:16
*** bnemec has quit IRC19:16
mriedemefried: ok?19:17
efriedmriedem D'oh, nope, buried in the bowels, the 'interface' kwarg overrides 'endpoint_type'.19:17
efriedIt's just way non-obvious from the first four layers of calls.19:18
efriedCarry on.19:18
mriedemsean-k-mooney: dansmith: don't forget that if we wait long enough, edge will require nova-net again19:18
sean-k-mooneyedge?19:18
sean-k-mooneyas in cloud edge computing19:18
mriedemyes19:19
*** READ10 has quit IRC19:19
sean-k-mooneyah well it might actullly work well in that model in multihost mode untill a telco trys to add sfc to nova net19:20
* sean-k-mooney shudders at the taught19:20
*** Sukhdev has joined #openstack-nova19:21
*** hemna_ has quit IRC19:21
*** crushil_ has quit IRC19:23
*** gbarros has joined #openstack-nova19:24
*** itlinux has joined #openstack-nova19:25
*** smatzek has joined #openstack-nova19:26
*** nikhil has joined #openstack-nova19:27
*** penick_ has joined #openstack-nova19:31
*** pcaruana has quit IRC19:31
*** smatzek_ has joined #openstack-nova19:33
*** penick has quit IRC19:33
*** bnemec has joined #openstack-nova19:35
*** smatzek has quit IRC19:35
*** huanxie has quit IRC19:35
mriedemstvnoyes: ok comments inline https://review.openstack.org/#/c/463987/19:36
mriedemonce those test things are cleaned up i'm +219:36
*** awaugama has quit IRC19:41
*** ceryx has joined #openstack-nova19:56
*** huanxie has joined #openstack-nova19:58
*** smatzek_ has quit IRC19:59
stvnoyescool. thx20:00
*** smatzek has joined #openstack-nova20:00
*** smatzek has quit IRC20:00
*** ijw has joined #openstack-nova20:01
*** smatzek has joined #openstack-nova20:01
*** cdent has joined #openstack-nova20:03
catintheroofhi guys, quick question, when CoreFilter is enabled on the scheduler nodes, is cpu_allocation_ratio allowed per compute node ?20:05
*** liverpooler has quit IRC20:07
*** catintheroof has quit IRC20:09
mriedemcatintheroof: i believe that means you can configure the cpu_allocation_ratio per compute service or just take the default in the scheduler filter for all nodes20:09
mriedemthe help text for the config option says the same20:09
dansmithspeaking of that, did we deprecate those filters in pike such that we can remove them now?20:10
*** smatzek has quit IRC20:10
*** weshay has quit IRC20:10
*** weshay has joined #openstack-nova20:11
mriedemi think only the exact ones20:11
dansmithI thought we were going to deprecate the regular ones too20:11
mriedemcaching scheduler20:11
mriedemwe removed ram and disk filters from the default enabled_filters list,20:11
dansmithoh20:12
mriedembut didn't deprecate them b/c of caching scheduler, which doesn't use placement20:12
dansmithwe could make them only loadable if the driver is set to caching maybe?20:12
mriedemat least that's what i'm reading in the release notes20:12
mriedemanything is possible,20:12
mriedemalthough any out of tree scheduler drivers might break on that20:12
*** slaweq_ has quit IRC20:12
mriedemand we allow those20:12
dansmithan out-of-tree driver that uses our filters?20:13
mriedemsure20:13
*** slaweq_ has joined #openstack-nova20:13
mriedemlike,20:13
*** mnestratov has joined #openstack-nova20:13
mriedemmaybe i extend CachingScheduler20:13
mriedembecause i like to have fun20:13
dansmithout of tree filters and weighers I can see, but.. whole drivers?20:13
*** slaweq_ has quit IRC20:13
mriedemit's a thing i guess, and we broke it in ocata,20:13
mriedemand had to fix that in pike and backport20:14
mriedemsince we never deprecated that ability formally20:14
dansmithwith an out of tree driver you're going to end up with fubar'd placement and such20:14
*** slaweq_ has joined #openstack-nova20:14
mriedemdo we default to use placement or not...20:14
mriedemUSES_ALLOCATION_CANDIDATES = True20:14
mriedemwe default to use placement20:14
mriedembtw,20:15
dansmithI guess I'm not sure where the seam is, are you saying that we do the claim late enough that it's run for every driver?20:15
mriedemit seems a bit nutty that we join on system_metadata when listing all instances with details20:15
dansmithwe used to have to have that join for flavor info20:16
mriedemyeah, i figured,20:16
mriedembut that's long gone20:16
mriedemdo you still have your perf box env setup?20:16
dansmithI think it will come back up ready, lemme see20:16
dansmithI was also thinking of another thing I could do:20:16
mriedemfor the scheduling thing, if the driver says USES_ALLOCATION_CANDIDATES=False, we don't ask placement for anything20:16
dansmithput duplicate cell entries in for the same cell to cause us to list across more cells for free20:16
mriedemand we don't attempt to claim in the scheduler20:17
dansmithwe could make those filters refuse to load if driver is set to the filter scheduler, just flip the logic20:17
dansmithI mean log deprecation now, and fail in rocky20:17
mriedemthat seems ok20:17
dansmithwe really need to be removing the honoring of the limits provided by those filters from compute anyway I think20:18
dansmithwe've not really done any culling of stuff that is now handled by placement from compute/rt20:18
mriedemspeaking of culling20:20
mriedem_get_all_instance_metadata20:20
mriedemin compute api20:20
mriedemapparently the only things that use that, aren't used by anything else20:20
mriedemi'm going through https://review.openstack.org/#/c/505418/ btw20:22
mriedemhence asking random questions20:22
dansmiththank you20:23
dansmithmy devstack setup came back so I'll poke at sysmeta20:23
*** thorst has quit IRC20:26
mriedemok comments inline20:27
dansmithmriedem: is that one of the tests I pulled out to the cells class in an earlier patch?20:27
mriedemnope20:27
mriedemjust looked20:27
dansmithokay20:27
mriedemchecking to see if anything else covers that20:27
mriedemwe tend to duplicate a lot of our unit tests20:28
*** eharney has quit IRC20:28
*** huanxie has quit IRC20:29
*** itlinux has quit IRC20:30
mriedem_get_all_instance_metadata is only used by methods that were for the ec2 api20:30
mriedemec2api repo doesn't call them though20:31
*** itlinux has joined #openstack-nova20:33
dansmithhmm, got worried for a sec20:34
dansmithbaseline was taking 10s instead of 6s from yesterday20:34
dansmithbut after the reboot the devstack@dstat.service was consuming two cores for some reason20:34
dansmithhopefully that's why20:34
mriedemok we return metadata during GET /servers/{server_id} which makes sense, so still need to join on that20:39
mriedemand flavor for flavor, and info_cache for IPs,20:39
mriedembut system_metadata should be able to be nuked from the join in the API20:39
mriedemoh20:41
mriedemgeez20:41
mriedemwe join on security_groups...20:41
mriedemfor no good reason20:41
openstackgerritMatt Riedemann proposed openstack/nova master: Remove unused get_all_instance_*metadata methods  https://review.openstack.org/50829920:41
mriedemgmann: Kevin_Zheng: shouldn't JOINED_TABLE_QUERY_PARAMS_SERVERS include 'tags'?20:42
*** rcernin has joined #openstack-nova20:42
dansmithhrm, still running slow20:43
*** thorst has joined #openstack-nova20:43
mriedemif we removed system_metadata from the default join list in the API, if it was used somewhere, we'd see the "lazy-loading ..." message in the API logs though right?20:44
*** gregwork has joined #openstack-nova20:44
dansmithyes20:44
*** gbarros has quit IRC20:47
mriedemgmann: Kevin_Zheng: oh nvm it can't because "tags" is an actual query parameter20:50
dansmithfor a single list operation via curl I really shouldn't be hitting keystone more than once right?20:50
mriedemhmmm20:50
mriedemgoing to neutron?20:51
mriedemwe pass the token to neutron and it has to auth?20:51
dansmithfor a list?20:51
mriedemwe proxy the security group information during list to neutron20:51
dansmithI'm just trying to figure out why this is taking double what it was yesterday20:51
mriedemi think anyway, this has come up before b/c we don't cache security groups20:51
*** corey_ has quit IRC20:54
*** tbachman has joined #openstack-nova20:54
*** takashin has joined #openstack-nova20:56
mriedemnova meeting in 3 minutes20:57
*** yamahata has joined #openstack-nova20:57
mriedemjaypipes: even if the instance_security_groups table is empty, i'm assuming that listing 1000 instances and joining on that table is not insignificant?20:58
mriedemsorry the security_group_instance_association table20:59
*** tbachman has quit IRC20:59
jaypipesmriedem: well, if i_s_g is empty, it's an insignificant thing.20:59
*** thorst has quit IRC21:00
jaypipesmriedem: if there's no records, the join is optimized out by the DB. that said, as soon as it starts to get many records in it, boom.21:00
*** thorst has joined #openstack-nova21:00
mriedemif using neutron it shouldn't ever have records in it21:00
mriedemsystem_metadata totally will though21:00
mriedemanyway, meeting time21:01
dansmithmriedem: I'm restacking to make sure I'm clean and measuring what I expect, because things are taking twice what they should be21:01
*** tbachman has joined #openstack-nova21:02
mriedemok21:02
*** thorst has quit IRC21:11
jaypipesefried: care to update https://review.openstack.org/#/c/497713/ to say required= and let's ship it?21:12
tonybdansmith: I should've added a comment but I'd only just +wd the pike version so I was waiting for that to merge21:12
dansmithtonyb: okay, well I hit it anyway21:13
efriedjaypipes Sure, I can do that.21:13
jaypipesefried: ty21:13
*** lpetrut has quit IRC21:14
*** tssurya has quit IRC21:14
openstackgerritEric Fried proposed openstack/nova-specs master: Add trait support in the allocation candidates API  https://review.openstack.org/49771321:16
efriedjaypipes hecho ^21:16
jaypipesefried: danke21:16
*** smatzek has joined #openstack-nova21:17
cdenti guess I better actually read that one21:18
*** tssurya has joined #openstack-nova21:18
openstackgerritDan Smith proposed openstack/nova master: Use improved instance_list module in compute API  https://review.openstack.org/50541821:19
openstackgerritDan Smith proposed openstack/nova master: Fix CellDatabases fixture swallowing exceptions  https://review.openstack.org/50631221:19
openstackgerritDan Smith proposed openstack/nova master: Fix minor input items from previous patches  https://review.openstack.org/50641621:19
openstackgerritDan Smith proposed openstack/nova master: Move cell marker tests to Cellsv1DeprecatedTestMixIn  https://review.openstack.org/50831421:19
*** smatzek has quit IRC21:23
efriedjaypipes Oh, did you mean https://review.openstack.org/#/c/468797/ ?  I can update that one too...21:25
jaypipesefried: that would be great, too.21:25
jaypipesefried: that's the flavor changes, right?21:25
efriedThey're different, mind you: one's in flavor and the other's in API.  But with the current proposals I don't see any reason they shouldn't both be required=21:25
jaypipesefried: agreed completely. they should match.21:26
*** itlinux has quit IRC21:26
openstackgerritEric Fried proposed openstack/nova-specs master: Request traits in Nova  https://review.openstack.org/46879721:27
efriedjaypipes ^21:27
jaypipesefried: danke21:27
efriedbitte21:27
*** pchavva has quit IRC21:28
*** slaweq_ has quit IRC21:28
*** slaweq_ has joined #openstack-nova21:29
efriedjaypipes of Nederland als je wil21:30
jaypipesefried: no. I speak only English. and badly at that.21:30
*** thorst has joined #openstack-nova21:32
cdentefried: I’m sensing a good deal of polylingualism in your direction21:32
efriedjaypipes Oh, I thought you had some Dutch, or Afrikaans.21:33
efriedcdent You could say I'm a cunning linguist.21:33
* cdent sings21:33
efriedIf only I could learn python21:33
*** eharney has joined #openstack-nova21:34
takashinoomichi: Are you around?21:34
*** itlinux has joined #openstack-nova21:35
*** tbachman has quit IRC21:35
*** nikhil has quit IRC21:36
*** thorst has quit IRC21:36
efriedcdent "The traits don't belong to the children do they, they just happen to be present because the parent is present. You can't have the trait without the parent, right?"  <== talk to me21:37
*** itlinux has quit IRC21:37
*** smatzek has joined #openstack-nova21:38
* cdent thinks about a translation21:38
efriedAny RP can have traits.  The paragraph in question is talking about how traits inherit in a NRP tree and (not) in aggregates.21:38
efriedThe paragraph is saying that a parent RP's traits implicitly also belong to its descendants, but not the other way around.21:39
cdenta) how traits behave in rps is not relevant to that spec is it. That spec is merely saying “I require this trait”, so the paragraph is not required and merely confuses (it did me)21:39
*** tssurya has quit IRC21:39
*** smatzek has quit IRC21:39
efriedcdent Mm, I think it's relevant to understanding what you're expecting to get back when you specify those required traits.21:39
efriedAnd also how the implementor of the RPs should model them in order for that to be effective.21:40
cdentit means you’ll get back some resource providers, one of which will have that trait, that’s all21:40
cdents/one/at least one/21:40
efriedI believe that paragraph indicates that that is not completely true.21:40
cdentexplain?21:40
efriedBecause I could get back a leaf RP that doesn't actually have the trait explicitly itself, but got returned because its parent/ancestor had that trait.21:41
cdentand that’s my question: you’ll only see that leaf in the results if you are _also_ seeing the ancestor in the results21:41
efriedIt's unclear (but needs to be clarified) whether the API is gonna populate the leaf RP's traits with all the ancestors' traits as it returns it.21:41
efriedYeah, that's another good question: are you going to get back the parent RP in the response?  If so, it's likely not to have any inventory allocated out of it.21:42
efriedis that kosher?21:42
cdentthat’s indeed a tricky question, because we’ve where a VCPU lives in a NUMA world ambiguous in our questions21:43
cdentthe early assumptions were it would be on the compute node instance (the ultimate parent of any tree returned in allocation_candidates)21:44
cdentso there would always be inventory consumed at the top21:44
cdentbut even if inventory is not consume at the top we must have the resource provider uuid of the compute node so we know what the destination is21:45
edleafewe are always returning root RPs, right?21:45
cdentso even if the allocation part of the allocation candiate doesn’t consumer, there will be a record in the other half of the tuple which has the roots21:45
edleafeIOW, we'd never return a NIC by itself21:45
cdentedleafe: i think so, yes, at least in the resource providers half  of the tuple21:46
efriedMore recently we've talked about modeling NUMA by making the NUMA nodes child RPs and having them provide the CPU/MEM(/possibly-other-things-like-PFs) resources.21:46
cdentefried: right, but they are still a child21:46
efriedWell, okay, but if the tree is three deep, the root RP may still not have the traits the leaf is inheriting.21:46
cdentso you could alloc against them, but still _place_ on the parent21:46
*** mnestratov has quit IRC21:46
cdentI think inheritance is a very bad way of thinking of this21:46
cdentand that’s what my comment was inspired by21:46
cdent(on the review)21:47
* cdent locates something to look at21:47
*** armax has joined #openstack-nova21:47
cdentwhich spec has allocation candidates?21:48
edleafecdent: yeah, this is more like composition than inheritance21:48
cdentah, it’s got the wrong name: http://specs.openstack.org/openstack/nova-specs/specs/pike/implemented/placement-allocation-requests.html21:49
dansmithgah21:49
dansmithdoes anyone else get stopped in devstack doing this?21:49
dansmith403 Forbidden: You are not authorized to complete publicize_image action. (HTTP 403)21:49
dansmithmust be residue leftover from my previous install, but I don't know what it is21:49
*** takashin has left #openstack-nova21:50
cdentefried: in there, provider_summaries is the second half of the tuple, contains the rp info. in there will be represented the info to construct a nested provider hierarchy, I don’t know if that’s defined yet21:50
cdentefried: but in that a trait will be on the thing to which the trait was associated, not its children21:50
efriedcdent You could totally return *just* the RPs that are being claimed against, and the scheduler would have to use the root RP UUID to pull the whole tree from placement at that point.21:51
*** takashin has joined #openstack-nova21:52
efriedOr you could return the whole tree, and the scheduler would not have to do that, but there would be empty "allocations".21:52
cdentyou could, yes, but I don’t think that was the plan. I suggested at one point we should just return uuids and require the client to go back for more info if it wanted21:52
efriedOr you could return just the claimed RPs in the allocations, but return the whole RP trees in the provider summaries.21:52
cdentwhy would there be empty allocations?21:52
cdentthe structure in provider_summaries is not directly mapped to what is in allocations21:52
mriedemdansmith: making an image public?21:52
mriedembut devstack uploads the image...21:53
dansmithmriedem: that's just during stack21:53
efrieddansmith Could be perms in your configured temp dir, which glance uses to store a copy of the image while it's uploading it.21:53
dansmithefried: I dunno what would have changed from one stack run to another21:54
cdentefried: so I’m still confused about how/why you want inheritance to be a thing21:54
efriedcdent Lemme find that conversation.  It's in the same spec, same area, earlier rev...21:54
dansmithmriedem: efried: this is a centos box and my best guess is that clean.sh doesn't clean something for redhat systems like it does for ubuntu or something21:54
dansmithguess what I'm doing right now?21:54
mriedemumm21:55
efriedcdent PS621:55
* cdent looks21:55
efriedcdent There's an example there21:55
*** gouthamr has quit IRC21:56
efriedcdent And more background in PS421:56
efried...which is where jaypipes actually provided the example21:56
cdentthat’s no inherited, the trait still matched on the compute rp, we _also_ got numa node 1 because we required magic cache thingy21:57
openstackgerritMatt Riedemann proposed openstack/nova master: Remove old compat code from servers ViewBuilder._get_metadata  https://review.openstack.org/50832621:58
cdentthe compute rp is a member of the results21:58
efriedcdent But with no inventory.21:59
efriedno inventory consumed* that is21:59
cdentif it were not a member of the results, then that would be inheritance21:59
efriedBut we need to be crisp about this because when we start doing the "grouping" thing, it's going to be important to be able to say that you *don't* get results that *don't* have your traits for a given group.22:00
efriedI said that horribly.22:00
*** esberglu has quit IRC22:00
efriedIn this example, the NUMA node and the compute node are *different* RPs.22:01
cdentI agree that we need to be crisp, which is why I’m disputing the use of the term “inherited” it’s misleading22:02
efriedIf I ask for inventory on a resource class, I should only get a RP that has inventory in that resource class.  If I ask for a required trait, I should only get a RP that has that trait.22:02
efriedIn this case, I'm asking for e.g. CPU inventory, which belongs to the NUMA node (not the compute host).  And I'm asking for trait HW_CPU_MAGIC_CACHE_THINGY, which belongs to the NUMA node (not the compute host).  So far so good.22:03
efriedBut then I'm *also* asking for trait HW_CPU_X86_SSE2.22:03
efriedThat trait belongs to the compute RP but *not* the NUMA node RP.22:03
efriedSo by the rules, with no "inheritance" (or whatever you wanna call it), that request would kick out the NUMA node RP because the NUMA node RP doesn't have the HW_CPU_X86_SSE2 trait.22:04
*** gouthamr has joined #openstack-nova22:04
efriedIf we want to do it that way, it's possible, but it means the implementor who models the RPs would have to *duplicate* the HW_CPU_X86_SSE2 trait (and all those other CPUey traits) onto each NUMA node RP.22:04
*** bnemec has quit IRC22:05
efriedjaypipes put a stake in the ground and said we could inherit downward, which is why we needed to make this statement in the spec.22:05
*** baoli has quit IRC22:06
efriedBased on your confusion, though, it seems like we would have done well to include the example, as well as listing the no-inheritance-but-duplication thing in Alternatives.22:06
*** burt has quit IRC22:06
cdentI guess maybe I’m too embedded but the statement is a) obvious, b) not inheritance. It is simply that you “got” the compute node, because you asked for that trait22:07
cdentit’s not that the numa node has that trait by inheritance22:07
efriedBut I don't want the compute nod.22:07
efriednode22:07
cdentyou do22:07
cdentyou _have_ to have the compute node22:07
efriedI'm not claiming any inventory off of it.22:07
cdentit is your destination22:07
cdentit is the place where your inventory is22:08
efriedMeh, that's kind of an artifact of the root RP happening to be a compute node.22:08
efriedcdent Ah, so wait, that's where we're disagreeing I think.22:08
efriedThe compute node RP is *not* where your inventory is.22:08
efriedThe NUMA node RP is where your inventory is.22:08
efriedUnless you're saying the compute node inherits (accumulates? composes?) the inventory from its descendants.22:09
cdentwhich is “within” the copute node, by representation (even if it happens to be only logically so)22:09
cdentnested providers are nested22:10
*** tbachman has joined #openstack-nova22:10
cdentand they are generally created when a compute node does get_inventory22:10
efriedRight.  So inventory is implicitly crossing RP boundaries (you don't like the word "inheritance"; fine; pick another word).  The disputed statement is saying traits do the same.22:10
efriedAlso trying to think not totally compute-node-is-the-root-RP-centric22:11
cdentI’m saying it’s not relevant when requesting allocation_candidates to know that22:11
cdent(that being “traits compose”)22:11
*** tbachman_ has joined #openstack-nova22:12
efriedI'm coming from, "it is relevant, both from the perspective of the requestor and the perspective of the implementor of the RP models being looked at by the allocation_candidates API."  Let me think through it again...22:13
*** thorst has joined #openstack-nova22:13
cdentIf we’re trying to be crispy, then the crispiness I’m trying to go for in the example is that we shouldn’t say “the numa node is HW_CPU_X86_SSE2” when it is the parent that has that trait22:14
*** tbachman has quit IRC22:15
*** tbachman_ is now known as tbachman22:15
efriedThen we would have to duplicate the trait on each NUMA node.22:15
cdentthat’s what I’m not understanding. How are you reaching that conclusion?22:15
efriedIn this case I'm assuming the resources themselves are owned by the NUMA node RPs.  Not by the compute node RP.22:16
efriedGET /allocation_candidates?resources=VCPU:1,required=HW_CPU_X86_SSE2,HW_CPU_MAGIC_CACHE_THINGY22:16
*** slaweq_ has quit IRC22:17
*** thorst has quit IRC22:17
efriedI haven't gotten the impression that we're supposed to return allocations that satisfy any permutation of that request.  I've gotten the impression we're supposed to return allocations that satisfy *all* of those criteria.22:17
cdentwell, not to draw us off into the weeds too far, but if you’re going to put the VCPU inventory on a numa node, then presumably you put the hw traits of cpus on the numa node too?22:18
cdentignore that22:18
efriedAh, that's the point of contention.  jaypipes said (in PS4)... okay.22:18
*** gouthamr has quit IRC22:18
*** r-daneel has joined #openstack-nova22:18
cdentI agree that we should only satisfy all those criteria22:19
efriedOkay.  Then as modeled, without "inheritance", we would get nada back from that request.22:19
efriedbecause there isn't a single resource provider that satisfies all of it.22:20
cdentso perhaps you are using the term “inheritance” to mean something like “which direction in the resource provider tree should would look to see if a trait is available”?22:20
*** gouthamr has joined #openstack-nova22:20
cdentup, down, both22:20
jaypipesefried: I also said in PS4 that I disagreed with you calling it inheritance. :)22:20
cdentand you’re saying only up22:20
cdentif “only up” then cool, but don’t use the term inheritiance :)22:20
efriedbah, let's come up with a word for it that isn't "inheritance" so we can stop getting distracted by that.  What do we call it.22:20
jaypipespropagation.22:21
efriedcool.22:21
cdentis my description of “only up” what you mean?22:21
efriedTraits propagate down.22:21
efried"only down".22:21
efriedIf parents are "up" and children are "down".22:21
cdent“looking from the thing with inventory, we only look up for missing traits"22:21
efriedyes22:21
efriedor22:21
efried"traits propagate down"22:22
cdentthat means too much22:22
cdentbecause that means the same thing I was disagreeing with before: the children “get” the traits, they don’t22:22
efriedWhat about, "traits defined on a parent RP are assumed to22:22
efriedbelong to all its child (descendant) RPs. However, traits defined on a child22:22
efriedRP do not apply to the parent (ancestor) RPs."22:22
openstackgerritMatt Riedemann proposed openstack/nova master: Stop joining on system_metadata when listing instances  https://review.openstack.org/50833522:22
mriedemdansmith: when you get numbers ^22:23
*** thorst has joined #openstack-nova22:23
dansmithmriedem: sorry I'm still fighting devstack22:23
jaypipesefried: isn't that essentially what I said ++ to on the patch?22:23
cdent“required traits which are not present on child can be satisfied by a parent” is much closer to the truth, I think? jaypipes ?22:23
jaypipesefried: that wording...22:23
efriedjaypipes It's *exactly" that :)22:23
mikalSorry I missed the meeting, I was at the doctor complaining that one of my ears has stopped working.22:23
efriedCopied and pasted :)22:23
jaypipesright.22:23
*** gouthamr has quit IRC22:23
mriedemdansmith: that's fine, i'm also going to check the n-api logs to see if anything gets lazy-loaded incidentally22:23
efriedcdent I think saying "can be satisfied by a parent" implies more than what's happening.22:24
cdentjaypipes, efried : it’s the belonging thing that’s really botherin gme22:24
*** catintheroof has joined #openstack-nova22:24
*** tbachman has quit IRC22:24
cdentbut again, I’m not sure it is relevant in the immediate sense22:25
cdent(of the spec)22:25
efriedokay, so back to that.22:25
mikalmriedem: does "Michael runs with this" mean you'd like me to propose the session?22:26
efriedI assume the target audience of this spec is 1) developers who will be a) implementing the /allocation_candidates API changes, and b) coding the modeling and registration of the RPs that it'll talk to; as well as 2) (eventually, as it gets "propagated" into docs) the operator who's gonna populate the flavor with the resource classes and traits.22:27
cdentefried: If you want we can probably just revisit this later, as I’m +1. I’m conscious however that we will stumble on this stuff again later when trying to document stuff and consider implications.22:27
*** r-daneel has quit IRC22:29
efried1a definitely needs to understand it for NRP to construct the query right.  1b needs to understand it for NRP to model the RPs right.  And 2 needs to understand it because he's gonna look at the RPs as real things with meaningful traits and know that he can ask for HW_CPU_X86_SSE2.22:29
efriedcdent Okay, sure.  I don't necessarily disagree that the propagation discussion could have happened in a different spec as well (like maybe the NRP spec).  But I still can't see how it's misplaced here.22:30
efriedcdent Slightly less controversial (hopefully) response to your other comment inline :)22:32
cdentI don’t think it is misplaced, if it were clear, but it isn’t it, and clarifying it it is too hard especially when not in the context of the nrp spec/code, so as it is stands is distracting22:32
mriedemmikal: yes22:33
efriedcdent Gotcha.22:34
*** thorst has quit IRC22:35
*** thorst has joined #openstack-nova22:36
*** penick_ has quit IRC22:36
*** eharney has quit IRC22:37
*** lbragstad has quit IRC22:37
*** penick has joined #openstack-nova22:38
cdentefried: yeah, I didn’t mention the resource3,required3 thing there because of wanting to keep the immediate scope narrow, but yes, both of those could also do the repeat treatment if we wanted. not necessary or anything22:38
efriedcdent But don't we already have an API that does resources= with commas?22:39
cdentyes, but that doesn’t prevent also allowing repeats22:39
cdentthat’s what I was saying, we can do both if we like22:39
efriedMm.22:39
efriedThat's a big test matrix22:40
cdentsure, but repeats is _normal_ for web-based query parameters, and we might like that22:40
efriedI mean, I dig the idea of using the repeats.  But seems like that's something that should have been done from the start.22:40
cdentoh sure22:40
efriedYeah, normal for web-based query params ++22:40
cdentso should many things :)22:40
*** esberglu has joined #openstack-nova22:40
efriedBut given that we did the comma thing, IMO the lesser evil is consistency and KISS.22:41
*** thorst has quit IRC22:42
cdentOn 2) above, I’m less worried about people creating flavors than I am about inventory creating tooling getting the traits on the righ resource. Because in a flavor when you express a trait or quantity of resource, initially, it’s just that you require it, not the structure thereof22:42
cdentthe comma thing will remain the primary thing I expect22:43
mikalmriedem: ok, I will do that thing22:43
cdentand we may never do the repeat thing, unless the framework already supports it (which it may, which is why I mentioned it)22:43
mriedemmikal: thanks22:43
*** smatzek has joined #openstack-nova22:45
cdentis extra_specs a dict, or is it a string that looks vaguely like a dict?22:45
*** esberglu has quit IRC22:45
*** thorst has joined #openstack-nova22:45
openstackgerritEric Fried proposed openstack/nova master: WIP: Use ksa adapter for cinder client (OPTION 1)  https://review.openstack.org/50834522:48
*** xyang1 has quit IRC22:50
*** lyan has quit IRC22:51
mriedemjohnthetubaguy: if you're going to be at the forum: http://forumtopics.openstack.org/cfp/details/1222:53
*** thorst has quit IRC22:58
*** thorst has joined #openstack-nova22:58
mriedemi've seen at least 3 forum topics on here about ETSI/NFV23:00
mriedemall sound like duplicates23:00
mikalYou're welcome?23:00
mriedem"HOT topic: Heat-ing up Telco VNFs in the ETSI way"23:01
mriedemthis guy knows how to get a talk accepted23:01
*** masber has quit IRC23:02
mikalAs a man who recently learned those acronymns, isn't that just a session on how to use heat to start instances?23:02
mriedemha23:05
mriedemmaybe?23:05
mriedembut in the etsi way23:05
cdentMANO your VIM with TOSCA23:06
*** hongbin has quit IRC23:07
jaypipesdansmith: so after 4 hours fucking around with this, I remember why I made it parent_provider_uuid and root_provider_uuid instead of using internal integer fields.23:07
dansmithjaypipes: lay it on e23:07
mikalcdent: OMG, that sentence even parsed23:07
mikalWhy do these people love stupid acronyms so much?23:07
jaypipesdansmith: having to deal with all the friggin relationship stuff in the ORM results in a boatload of code and errors everywhere about lazy-loading and Sessions being inactive..23:08
cdentDon’t acronyms mean importance? I’m sure I read a white paper on that.23:08
dansmithjaypipes: that makes no sense to me23:09
* jaypipes wishes he could rip all the use of the ORM out of placement. :(23:09
dansmithum, so do it?23:09
jaypipesdansmith: the resource_provider.py module is a mess of mixed up ORM and non-ORM code. drives me nuts.23:10
dansmithmriedem: smackin' the patch now23:11
*** crushil has quit IRC23:13
*** jmlowe has quit IRC23:19
*** tbachman has joined #openstack-nova23:20
dansmithmriedem: I got bad news about your sysmeta patch23:23
*** huanxie has joined #openstack-nova23:24
*** itlinux has joined #openstack-nova23:25
cdentGoodnight you princes of Maine, you kings of New England.23:27
*** cdent has quit IRC23:27
dansmithmriedem: it _only_ makes our API about 16% faster on average: https://imgur.com/a/ovFq223:28
mriedemis that bad news?23:28
dansmithterrible23:28
mriedemdo i,23:28
mriedemor do i not,23:28
*** mingyu has quit IRC23:28
mriedemneed a special comb23:28
*** yassine has joined #openstack-nova23:29
*** mingyu has joined #openstack-nova23:29
* dansmith frantically tries to google for that reference to look cool23:30
mriedemcrabs23:30
mriedemit's a crabs joke23:30
mriedemyou know, bad news23:30
mriedemyou've got crabs23:30
dansmithhah, okay23:30
*** itlinux has quit IRC23:31
*** thorst has quit IRC23:31
gmannmriedem: yea, tags(all type of query like tag_any, not_tag etc) are in query itself23:32
openstackgerritMatt Riedemann proposed openstack/nova master: Remove system_metadata loading in Instance._load_flavor  https://review.openstack.org/50835723:32
gmannmriedem: api extension policy removal spec is ready - https://review.openstack.org/#/c/508101/223:33
gmanni listed 11 policies to remove23:33
mriedemgmann: ok, i'm not going to be able to get to that tonight23:35
mriedemwe're going to do a spec review sprint early next week23:36
gmannmriedem: sure, btw when is spec freeze date ?23:36
mriedemoct 1923:36
*** markvoelker has quit IRC23:37
gmannok. thanks.23:37
dansmithyour patch will conflict with my cutover patch, btw23:38
*** thorst has joined #openstack-nova23:39
mriedemdansmith: i know, i'll wip23:40
dansmithmriedem: don't have to, just pointing it out23:40
mriedemwas just about to go through 505418 and underneath it23:41
mriedemlaura is going to have my hide if she comes home at 7 and i don't have dinner started23:41
dansmithI didn't change the cutover one, just put a patch underneath to save the tests23:42
*** jmlowe has joined #openstack-nova23:42
*** jaypipes has quit IRC23:42
dansmithwas going to do your refactoring in the top patch but I haven't yet23:42
*** jpena|off has quit IRC23:43
*** ltomasbo has quit IRC23:44
mriedemyeah noticed23:45
mriedemthe comment i mean23:45
openstackgerritSteve Noyes proposed openstack/nova master: update live migration to use v3 cinder api  https://review.openstack.org/46398723:45
*** ltomasbo has joined #openstack-nova23:45
*** jpena|off has joined #openstack-nova23:46
dansmithmriedem: so, I was wondering if maybe doing the cells in parallel would hide this benefit some and it does: https://imgur.com/a/YMxPQ23:47
dansmiththat doesn't mean the gain isn't there, it means there's two gains and we're bumping up against just cpu performance processing the results from the DB I think23:47
mriedemthe sysmeta benefit?23:47
dansmithwhich is good23:47
dansmithyeah23:47
mriedemah23:47
dansmiththat's the instance_list patch plus the sysmeta one vs. master23:47
mriedemcool23:48
dansmithI wish we could spawn a real thread instead of a greenthread to do the cells scatter23:49
mriedemhttps://review.openstack.org/#/c/505418/1223:50
dansmithbecause we're just pegging one core when we're doing all this23:50
mriedemyou know who likes to talk threading?23:50
mriedemthat works on your team23:50
* dansmith runs23:51
mriedemme too23:51
*** mriedem is now known as mriedem_dinner23:51
dansmithmriedem_dinner: thanks for the +W23:51
dansmithmelwitt: you wanna +W the test refactor underneath that?23:51
dansmithmelwitt: it's just copying some tests to the cells deprecated morgue-of-tests so we keep running them in that path23:51
melwittsure, lemme look23:52
dansmithit would make me the happiest boy in happy valley23:52
melwittlol23:52
*** huanxie has quit IRC23:54
*** thorst has quit IRC23:54
*** thorst has joined #openstack-nova23:55
*** yamahata has quit IRC23:56
melwittdansmith: done23:57
cfriesenhas anyone else run into problems with devstack when changing branches?  I tried going from stable/newton to stable/pike and a bunch of requirements are not properly handled, requiring me to do manual pip stuff.23:57
dansmithmelwitt: tanks23:58
*** chyka has quit IRC23:58
*** baoli has joined #openstack-nova23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!