Friday, 2018-11-02

openstackgerritVladyslav Drok proposed openstack/nova master: Do not remove baremetal ports in deallocate_for_instance  https://review.openstack.org/47387300:16
*** hongbin has joined #openstack-nova00:17
*** brinzhang has joined #openstack-nova00:18
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (7)  https://review.openstack.org/57199200:38
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (8)  https://review.openstack.org/57199300:38
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in virt/test_block_device.py  https://review.openstack.org/56615300:39
openstackgerritTakashi NATSUME proposed openstack/nova master: Transform compute_task notifications  https://review.openstack.org/48262900:39
openstackgerritTakashi NATSUME proposed openstack/nova master: Use oslo_db.sqlalchemy.test_fixtures  https://review.openstack.org/60935200:40
*** phuongnh has joined #openstack-nova00:48
openstackgerritgaobin proposed openstack/nova master: Improve the properties of the api  https://review.openstack.org/61473001:14
*** wangy_ has joined #openstack-nova01:24
*** tbachman has joined #openstack-nova01:31
*** phuongnh has quit IRC01:32
*** hongbin has quit IRC01:32
*** spatel has joined #openstack-nova01:41
openstackgerritNguyen Hai Truong proposed openstack/nova master: [Trivial Fix] Correct spelling error of "should"  https://review.openstack.org/61489901:43
*** spatel has quit IRC01:46
*** Dinesh_Bhor has joined #openstack-nova01:51
*** spatel has joined #openstack-nova01:51
*** cfriesen has quit IRC01:55
*** tiendc has joined #openstack-nova01:58
*** hoangcx has joined #openstack-nova01:59
*** bhagyashris has joined #openstack-nova02:01
*** hoangcx has quit IRC02:01
gmannartom: johnthetubaguy yeah, we keep tempest config as close as with latest defaults on service side. if that cause to fail on stable branch testing then we can modify them via devstack which is branched02:03
*** Dinesh_Bhor has quit IRC02:03
*** hoangcx has joined #openstack-nova02:05
*** munimeha1 has quit IRC02:08
*** mhen has quit IRC02:11
*** hongbin has joined #openstack-nova02:12
*** mhen has joined #openstack-nova02:13
*** sapd1_ has quit IRC02:20
*** Dinesh_Bhor has joined #openstack-nova02:30
openstackgerritNguyen Hai Truong proposed openstack/nova master: [Trivial Fix] Correct spelling error of "should" and "resource"  https://review.openstack.org/61489902:32
openstackgerritMerged openstack/nova master: Modify get_by_cell_and_project() to get_not_deleted_by_cell_and_project()  https://review.openstack.org/60766302:38
openstackgerritMerged openstack/nova master: Minimal construct plumbing for nova list when a cell is down  https://review.openstack.org/56778502:38
*** k_mouza has joined #openstack-nova02:42
*** k_mouza has quit IRC02:46
*** mrsoul has joined #openstack-nova02:51
openstackgerritTao Li proposed openstack/nova master: Rollback instance vm_state to original where instance claims failed  https://review.openstack.org/59225203:06
openstackgerrithuanhongda proposed openstack/nova master: AZ operations: check host has no instances  https://review.openstack.org/61183303:06
*** spatel has quit IRC03:11
*** sapd1 has joined #openstack-nova03:24
openstackgerritZhenyu Zheng proposed openstack/nova master: WIP support attach/detach root volume 2  https://review.openstack.org/61475003:41
*** udesale has joined #openstack-nova03:56
*** brinzh has joined #openstack-nova04:07
*** david-lyle has joined #openstack-nova04:08
*** itlinux has quit IRC04:09
*** brinzhang has quit IRC04:09
*** dklyle has quit IRC04:09
*** _pewp_ has quit IRC04:11
*** _pewp_ has joined #openstack-nova04:11
*** toabctl has quit IRC04:13
*** toabctl has joined #openstack-nova04:14
*** wangy_ has quit IRC04:17
*** hongbin has quit IRC04:17
*** janki has joined #openstack-nova04:48
*** bhagyashris has quit IRC04:59
*** wangy_ has joined #openstack-nova05:00
*** brinzh has quit IRC05:01
*** bhagyashris_ has joined #openstack-nova05:08
*** ratailor has joined #openstack-nova05:18
*** threestrands has quit IRC05:40
*** ratailor_ has joined #openstack-nova05:40
*** k_mouza has joined #openstack-nova05:41
*** ratailor has quit IRC05:43
*** k_mouza has quit IRC05:46
openstackgerritTao Li proposed openstack/nova master: Rollback instance vm_state to original where instance claims failed  https://review.openstack.org/59225205:55
openstackgerritOpenStack Proposal Bot proposed openstack/nova stable/rocky: Imported Translations from Zanata  https://review.openstack.org/61475706:06
*** Dinesh_Bhor has quit IRC06:15
*** dpawlik has joined #openstack-nova06:26
*** dpawlik has quit IRC06:26
*** dpawlik has joined #openstack-nova06:27
*** bhagyashris_ has quit IRC06:34
*** tiendc has quit IRC06:37
*** tetsuro has joined #openstack-nova06:39
*** tetsuro has quit IRC06:48
*** udesale has quit IRC06:49
*** bhagyashris__ has joined #openstack-nova06:55
openstackgerritVieri proposed openstack/os-vif master: Update min tox version to 2.0  https://review.openstack.org/61504607:00
*** fghaas has joined #openstack-nova07:01
*** TuanDA has joined #openstack-nova07:03
openstackgerritZhenyu Zheng proposed openstack/nova master: Bump compute service to indicate attach/detach root volume is supported  https://review.openstack.org/61475007:08
*** fghaas has quit IRC07:11
*** erlon has joined #openstack-nova07:14
*** pcaruana has joined #openstack-nova07:20
*** Dinesh_Bhor has joined #openstack-nova07:21
*** ccamacho has joined #openstack-nova07:34
*** mgoddard has joined #openstack-nova07:38
*** lennyb has quit IRC07:39
*** lennyb has joined #openstack-nova07:40
*** fanzhang has quit IRC07:40
*** hoangcx has quit IRC07:49
*** sahid has joined #openstack-nova07:49
*** ratailor__ has joined #openstack-nova07:55
*** ratailor_ has quit IRC07:57
openstackgerritTakashi NATSUME proposed openstack/nova master: api-ref: Add descriptions for vol-backed snapshots  https://review.openstack.org/61508407:58
*** Cathyz has joined #openstack-nova08:03
openstackgerritSilvan Kaiser proposed openstack/nova master: [WIP] Added Qemu libquobyte Support to the Quobyte Driver  https://review.openstack.org/54650008:08
*** fghaas has joined #openstack-nova08:10
*** slaweq has joined #openstack-nova08:17
openstackgerritBrin Zhang proposed openstack/nova-specs master: Support delete_on_termination in volume attach api  https://review.openstack.org/61294908:23
*** ralonsoh has joined #openstack-nova08:26
*** betherly has joined #openstack-nova08:30
*** wangy_ has quit IRC08:43
*** Cathyz has quit IRC08:45
*** bauzas is now known as bauwser08:52
bauwsergood Friday nova08:52
*** lyarwood is now known as lyarpwood08:53
*** Dinesh_Bhor has quit IRC08:53
*** k_mouza has joined #openstack-nova08:59
*** cdent has joined #openstack-nova09:04
*** cdent has quit IRC09:06
*** cdent has joined #openstack-nova09:10
*** erlon has quit IRC09:13
*** ttsiouts has joined #openstack-nova09:17
*** derekh has joined #openstack-nova09:25
*** fanzhang has joined #openstack-nova09:26
openstackgerritJie Li proposed openstack/nova-specs master: Support volume-backed server rebuild  https://review.openstack.org/53240709:26
*** dpawlik has quit IRC09:28
*** Dinesh_Bhor has joined #openstack-nova09:31
*** sri_ has joined #openstack-nova09:37
sri_Hello, folks!, Does Ceph monitor IPs are still hardcoded in the database ? did anybody tried replacing ceph monitors(IP) recently ?09:38
openstackgerritYikun Jiang proposed openstack/nova master: Change the default values of XXX_allocation_ratio  https://review.openstack.org/60280309:40
openstackgerritYikun Jiang proposed openstack/nova master: Use new ``initial_xxx_allocation_ratio`` CONF  https://review.openstack.org/60280409:40
openstackgerritYikun Jiang proposed openstack/nova master: Add ratio online data migration when load compute node  https://review.openstack.org/61349909:40
openstackgerritYikun Jiang proposed openstack/nova master: Add compute_node ratio online data migration script  https://review.openstack.org/60999509:40
*** dtantsur|afk is now known as dtantsur09:48
openstackgerritNguyen Hai Truong proposed openstack/nova master: Add tox python3  https://review.openstack.org/61511809:53
*** udesale has joined #openstack-nova09:53
*** panda|off is now known as panda10:03
openstackgerritgaobin proposed openstack/nova master: Improve the properties of the api  https://review.openstack.org/61473010:09
*** TuanDA has quit IRC10:10
*** ttsiouts has quit IRC10:16
openstackgerritJie Li proposed openstack/nova-specs master: Support volume-backed server rebuild  https://review.openstack.org/53240710:20
*** bhagyashris__ has quit IRC10:21
mnaserhey -- trying to fix https://bugs.launchpad.net/nova/+bug/1789423 locally, got it working but i need to get my pep8 to pass..10:25
openstackLaunchpad bug 1789423 in OpenStack Compute (nova) "Server operations fail to complete with versioned notifications if payload contains unset is_public field" [Medium,Triaged] - Assigned to Mohammed Naser (mnaser)10:25
mnaserhttp://paste.openstack.org/show/733952/10:25
mnaserany ideas how to ideally clean that up to fit 80 chars?10:25
*** owalsh_ is now known as owalsh10:30
*** ttsiouts has joined #openstack-nova10:32
*** alexchadin has joined #openstack-nova10:36
*** alexchadin has quit IRC10:37
*** alexchadin has joined #openstack-nova10:37
*** alexchadin has quit IRC10:37
*** alexchadin has joined #openstack-nova10:38
*** alexchadin has quit IRC10:38
*** alexchadin has joined #openstack-nova10:39
*** alexchadin has quit IRC10:39
*** tbachman has quit IRC10:39
*** udesale has quit IRC10:40
*** Dinesh_Bhor has quit IRC10:41
*** stephenfin is now known as finucannot10:44
*** k_mouza has quit IRC10:46
*** k_mouza has joined #openstack-nova10:47
*** k_mouza has quit IRC10:52
*** tssurya has joined #openstack-nova10:54
*** erlon has joined #openstack-nova11:06
*** k_mouza has joined #openstack-nova11:10
*** alexchadin has joined #openstack-nova11:17
*** k_mouza has quit IRC11:17
*** k_mouza has joined #openstack-nova11:18
*** alexchadin has quit IRC11:22
openstackgerritMohammed Naser proposed openstack/nova master: Default embedded instance.flavor.is_public attribute  https://review.openstack.org/61513411:23
mnaser^ if someone can help with that briefly11:24
*** dave-mccowan has joined #openstack-nova11:31
*** lpetrut has joined #openstack-nova11:32
jrollmnaser: I'd do Flavor(\n and indent the rest by whatever looks most readable11:42
jrollmnaser: probably this if it fits, I didn't count: http://paste.openstack.org/show/734030/11:43
jrollor maybe http://paste.openstack.org/show/734031/11:44
jrollof course you could always assign those to a variable above where you define fake_flavor, too11:44
openstackgerrithuanhongda proposed openstack/nova master: AZ operations: check host has no instances  https://review.openstack.org/61183311:45
openstackgerritJose Castro Leon proposed openstack/nova master: Fixes bug on attaching volume scsi on an instance boot from iso  https://review.openstack.org/61514111:50
*** alexchadin has joined #openstack-nova11:53
*** alexchadin has quit IRC12:00
*** zul has quit IRC12:06
*** cdent has quit IRC12:06
openstackgerritMatthew Booth proposed openstack/nova master: Pass DriverBlockDevice to driver.attach_volume  https://review.openstack.org/52836312:11
*** lpetrut has quit IRC12:13
openstackgerritMatthew Booth proposed openstack/nova master: Fix libvirt volume tests passing invalid disk_info  https://review.openstack.org/52932812:13
openstackgerrithuanhongda proposed openstack/nova master: AZ operations: check host has no instances  https://review.openstack.org/61183312:14
*** tbachman has joined #openstack-nova12:23
openstackgerritMatthew Booth proposed openstack/nova master: Pass disk_info dict to libvirt_info  https://review.openstack.org/52932912:23
openstackgerritMatthew Booth proposed openstack/nova master: Expose volume host type and path independent of libvirt config  https://review.openstack.org/53078612:32
openstackgerritMatthew Booth proposed openstack/nova master: Don't generate fake disk_info in swap_volume  https://review.openstack.org/53078712:34
*** zul has joined #openstack-nova12:36
*** ttsiouts has quit IRC12:39
johnthetubaguyjaypipes: melwitt: suddenly noticed we can do per-project instance count checks from the CellMapping table. I worked this out before and keep forgetting about it.12:39
openstackgerritJohn Garbutt proposed openstack/nova master: WIP: Unified limits ideas  https://review.openstack.org/61518012:46
openstackgerritMohammed Naser proposed openstack/nova master: Default embedded instance.flavor.is_public attribute  https://review.openstack.org/61513412:49
*** ratailor__ has quit IRC12:49
mnaserthanks for the input jroll ! %12:50
jroll:)12:50
*** janki has quit IRC12:53
*** janki has joined #openstack-nova12:53
jaypipesjohnthetubaguy: yeah, that's what melwitt added the queue_for_delete column I think in the API DB's instance_mappings table, right?12:56
*** jaypipes is now known as leakypipes12:56
*** jmlowe has quit IRC13:05
openstackgerritJohn Garbutt proposed openstack/nova master: WIP: Unified limits ideas  https://review.openstack.org/61518013:06
*** jmlowe has joined #openstack-nova13:08
*** panda is now known as panda|lunch13:10
*** ccamacho has quit IRC13:14
*** ccamacho has joined #openstack-nova13:14
*** jdillaman has joined #openstack-nova13:16
*** janki has quit IRC13:27
*** mriedem has joined #openstack-nova13:28
*** ttsiouts has joined #openstack-nova13:32
sri_Hello folks, quick quastion Does Ceph monitor IPs are hardcoded in the database <block_device_mapping> ? did anybody tried replacing ceph monitors(IP) recently ?13:34
*** tbachman has quit IRC13:34
*** efried is now known as fried_rice13:35
*** mchlumsky has quit IRC13:36
*** tbachman has joined #openstack-nova13:37
*** mchlumsky has joined #openstack-nova13:37
johnthetubaguyleakypipes: yeah, mind like a sieve13:39
mriedemsri_: you might be looking for https://review.openstack.org/#/c/579004/13:40
mriedemhttps://bugs.launchpad.net/nova/+bug/145264113:40
openstackLaunchpad bug 1452641 in nova (Ubuntu) "Static Ceph mon IP addresses in connection_info can prevent VM startup" [Medium,In progress] - Assigned to Corey Bryant (corey.bryant)13:40
openstackgerritMatthew Booth proposed openstack/nova master: Local disk serial numbers for the libvirt driver  https://review.openstack.org/52938013:41
*** lpetrut has joined #openstack-nova13:42
*** jdillaman has quit IRC13:45
*** jdillaman has joined #openstack-nova13:45
*** mlavalle has joined #openstack-nova13:47
*** panda|lunch is now known as panda13:48
*** tbachman has quit IRC13:49
*** eharney has joined #openstack-nova13:50
openstackgerritMatthew Booth proposed openstack/nova master: Fix libvirt volume tests passing invalid disk_info  https://review.openstack.org/52932813:54
openstackgerritMatthew Booth proposed openstack/nova master: Pass disk_info dict to libvirt_info  https://review.openstack.org/52932913:55
openstackgerritMatthew Booth proposed openstack/nova master: Expose volume host type and path independent of libvirt config  https://review.openstack.org/53078613:59
openstackgerritMatthew Booth proposed openstack/nova master: Don't generate fake disk_info in swap_volume  https://review.openstack.org/53078713:59
openstackgerritMatthew Booth proposed openstack/nova master: Add DriverLocalImageBlockDevice  https://review.openstack.org/52634714:00
openstackgerritMatthew Booth proposed openstack/nova master: Add local_root to block_device_info  https://review.openstack.org/52902914:00
openstackgerritMatthew Booth proposed openstack/nova master: Pass DriverBlockDevice to driver.attach_volume  https://review.openstack.org/52836314:00
openstackgerritMatthew Booth proposed openstack/nova master: Local disk serial numbers for the libvirt driver  https://review.openstack.org/52938014:00
*** spatel has joined #openstack-nova14:01
*** liuyulong_ has joined #openstack-nova14:03
*** tbachman has joined #openstack-nova14:04
*** awaugama has joined #openstack-nova14:04
mnaseris there any spec that proposes merging image backend + image cache (the thing that i kept talking about but never did?)14:07
fried_ricetssurya, mriedem, leakypipes: Was the CERN workaround for refresh interval based on setting CONF.compute.resource_provider_association_refresh to a high value, or was there some component of out-of-tree hackage as well?14:08
leakypipesfried_rice: UIAM, they disabled it entirely.14:09
fried_riceleakypipes: By hacking code?14:09
dansmithyup14:09
*** ttsiouts_ has joined #openstack-nova14:09
fried_riceokay. I would like to know exactly what that patch looked like at some point soon if possible.14:10
mnaserim gonna assume14:10
mnaserhttps://github.com/openstack/nova/blob/a0563e754ce5228df73252ea9e18821781c06d80/nova/scheduler/client/report.py#L843-L85314:10
mnaserreturn True14:10
mnaser:p14:10
*** ttsiouts has quit IRC14:12
fried_riceIt would be `return False`. That's probably it, but it's going to make a difference if it was something subtly different.14:12
mriedemdansmith: so i think i have a lead on https://bugs.launchpad.net/nova/+bug/180047214:13
openstackLaunchpad bug 1800472 in OpenStack Compute (nova) "nova.tests.functional.test_server_group.ServerGroupTestV264.test_boot_servers_with_affinity_no_valid_host intermittently failing with "OpenStackApiNotFoundException: Item not found"" [Medium,Triaged]14:13
*** dansmith is now known as SteelyDan14:13
mriedemit appears that we're getting the 404 because we're looking up the nova-api service version when fetching the instance and thinking it's version is 014:13
mriedemso it goes down the old pre-cellsv2 path and tries to get the instance out of the local-to-api db14:13
mriedemwhich with the cells fixture should still default to cell114:13
mriedembut the instance is buried in cell0 which is why the lookup would fail14:13
SteelyDanorly14:14
SteelyDansurely we can remove the old paths now yeah?14:14
* SteelyDan will brb14:15
mriedemi think so,14:16
mriedemit's also weird since the api fixture does create a service record, and that should be in the default cell1 db14:16
mriedemso i'm not sure why we're failing to find it, or with the correct version14:16
*** tssurya has quit IRC14:18
SteelyDanack14:22
sean-k-mooneyfried_rice: did my reivew of https://review.openstack.org/#/c/614886/ make sense14:23
fried_ricesean-k-mooney: Hadn't gotten to it yet. Thank you for looking at it.14:24
*** ttsiouts_ has quit IRC14:25
*** artom has quit IRC14:26
sean-k-mooneyno worries. tl;dr ya i like the direction some nits inline but nothing major14:26
*** lpetrut has quit IRC14:26
sean-k-mooneyfried_rice: we proably can do more then you do in the patch but it a solid first step if we decide to go that way14:27
fried_ricesean-k-mooney: The random jitter thing is a fine idea, but would be a totally independent piece of work. (I will respond accordingly.)14:27
sean-k-mooneyfried_rice: ya it should not be in this patch and hopefully its something we can get for free form oslo with the right settings14:28
sean-k-mooneyif not it proably should be added to oslo first14:28
fried_ricesean-k-mooney: As for changing the default, I doubt that's going to fly. For a change of this magnitude, we'll probably want to let it sit in experimental-optional state (where e.g. CERN and mnaser can try it out) for a while, and then consider changing the default in a separate patch, maybe in a future release.14:29
sean-k-mooneyfried_rice: ya i was debating that too. definetly a different patch14:30
sean-k-mooneymaking it a train+ thing i could also see14:30
*** lpetrut has joined #openstack-nova14:30
sean-k-mooneydid we actully agree on Train as the T release name by the way14:31
*** artom has joined #openstack-nova14:31
fried_ricesean-k-mooney: The poll is still open afaik14:32
fried_ricetil next week14:32
*** ttsiouts has joined #openstack-nova14:35
*** ccamacho has quit IRC14:36
*** lpetrut has quit IRC14:37
sri_mriedem, yes :), I was also looking for proceees to update mon ip's in older versions of openstack, we have one of the stack running in Liberty14:42
sri_mriedem, thank you for your help :)14:45
mriedemyw14:47
*** mrjk_ has joined #openstack-nova14:48
mriedemSteelyDan: great, so removing that service version check is easy peasy. what's not is that a buttload of tests for the api rely on that code since they stub out an instance in the db w/o a related mapping, and we require the mapping now to lookup the instance. gonna be fun hunting those tests down.14:50
SteelyDanhah nice14:50
janguttersean-k-mooney: the wiki has a very special icon next to the proposal.14:50
mriedemugh, rest api controller tests stubbing out the db api14:51
mriedemfml14:51
*** cfriesen has joined #openstack-nova14:52
openstackgerritJohn Garbutt proposed openstack/nova master: WIP: Unified limits ideas  https://review.openstack.org/61518014:53
*** ccamacho has joined #openstack-nova14:53
*** tbachman has quit IRC14:54
jrollSteelyDan: I'm having trouble coming up with a solution for my comment here, other than managing it in the database or something like etcd. mind taking a look to see if you can come up with anything? https://review.openstack.org/#/c/609709/3/specs/stein/approved/ironic-conductor-groups.rst@16314:54
SteelyDanjroll: why do you need to differentiate those two?14:55
SteelyDandoes default group imply it will take over everything? or will it look for a default group that ironic has nothing in since it's expected to be partitioned?14:56
jrollSteelyDan: the latter14:56
SteelyDanso what's the problem then?14:57
SteelyDanif ironic is partitioned and you start up a compute with no config, it will look for the default group, find it empty and report no nodes (if I'm reading you correctly)14:57
jrollSteelyDan: oh, I'm thinking of some nodes are partitioned and some are in the default group14:58
jrollso we need to differentiate between "manage all nodes" and "manage only the default group"14:58
SteelyDanwhy aren't those the same? meaning,14:58
SteelyDanwhy isn't the default group inclusive of all nodes in ironic by default, and empty if you want strict partitioning?14:59
SteelyDanand if you just want one group or something, then any node not configured would manage the default group (i.e. the rest)14:59
SteelyDanI mean, I'm saying words without knowing how this works on the ironic side of course14:59
SteelyDaneven still, two config options could solve this right? manage_a_group=True|False, group_i_manage=[]15:00
*** mrjk_ has quit IRC15:00
*** jangutter has quit IRC15:00
jrollright now you could have some "ungrouped" (default group) and some grouped15:00
jrollI guess we could document that you shouldn't do this15:01
jrollanother option is a valid way to do it, I guess15:01
jrollSteelyDan: thanks, I'll think it over and do two configs in the worst case15:02
SteelyDanack15:02
openstackgerritChris Friesen proposed openstack/nova-specs master: Add support for emulated virtual TPM  https://review.openstack.org/57111115:03
*** k_mouza has quit IRC15:03
melwittjohnthetubaguy, leakypipes: queued_for_delete was added to instance_mappings by tssurya as part of the "handling of a down cell" set. and then I had talked about potentially using it for quota stuff at the dublin ptg I think15:03
*** ttsiouts has quit IRC15:04
leakypipesmelwitt: ack, ok. I half-remembered it correctly then ;)15:05
melwitt:)15:05
*** ttsiouts has joined #openstack-nova15:05
*** k_mouza has joined #openstack-nova15:06
*** liuyulong_ has quit IRC15:07
*** liuyulong has joined #openstack-nova15:07
johnthetubaguymelwitt: cool, I have uploaded my quota ideas, finally: https://review.openstack.org/#/c/61518015:07
melwittjohnthetubaguy: cool, will check it out15:09
*** munimeha1 has joined #openstack-nova15:14
*** dave-mccowan has quit IRC15:25
mnasersmall question15:25
mnaseris there some rule or architectural decision in terms of nova not clobbering up or modifying other services15:25
mnaseri'm trying to evaluate the local ceph cache thing, and i'm wonder if it would be acceptable to update the "locations" in glance if nova cached it in another cluster15:25
*** dave-mccowan has joined #openstack-nova15:26
mnaserit's interesting if it did, but also i totally get why it shouldn't, so i dunno15:26
*** gyee has joined #openstack-nova15:26
*** Swami has joined #openstack-nova15:34
*** eharney has quit IRC15:36
*** eharney has joined #openstack-nova15:51
*** jaosorior has quit IRC15:58
*** bnemec is now known as beekneemech16:00
*** mdbooth has joined #openstack-nova16:02
mdboothCould somebody please restore workflow on https://review.openstack.org/#/c/529328/ and https://review.openstack.org/529329 for me?16:02
mdboothPreviously approved, but shuffled the order to get them out of the way16:03
*** sahid has quit IRC16:03
*** tbachman has joined #openstack-nova16:06
*** artom has quit IRC16:07
*** artom has joined #openstack-nova16:08
bauwsermdbooth: ask leakypipes or finucannot16:14
bauwserthey'd be glad to help16:14
*** artom is now known as temka16:14
mdboothbauwser: I was trying to work out finucannot 's friday nick :)16:14
finucannotmdbooth: done-zo16:14
mdboothfinucannot: Cheers16:14
*** imacdonn has quit IRC16:15
*** imacdonn has joined #openstack-nova16:15
*** pcaruana has quit IRC16:17
*** Shilpa has quit IRC16:19
*** tbachman has quit IRC16:21
*** fried_rice is now known as fried_rolls16:30
*** fghaas has quit IRC16:31
*** ttsiouts has quit IRC16:38
*** ttsiouts has joined #openstack-nova16:39
*** ttsiouts has quit IRC16:43
*** jiaopengju has quit IRC16:44
*** jiaopengju has joined #openstack-nova16:45
*** k_mouza has quit IRC16:48
sean-k-mooneymnaser: with the multi backend support in glance it might be ok for nova to add another location but i would never want nova to delete it form a speficic cluster16:52
*** mdbooth has quit IRC16:53
mnasersean-k-mooney: yeah but thinking out loud i don't think its appropriate in case nova wants to do cache eviction16:53
sean-k-mooneymnaser: that said that opens up a lot of corener cases in edge deployment or when you have restiction on where data can be stored16:53
mnaseri've been hacking on it and it doesn't seem as crazy of an idea16:53
*** zul has quit IRC16:53
sean-k-mooneymnaser: do you have ases were image x is not allowed to leave datacenter y16:54
sean-k-mooneythat is where this gets messy16:54
*** sri_ has quit IRC16:54
mnasersean-k-mooney: nope, not in this scenario at least16:54
mnaserit's a deployment that spans 2 physical datacenters16:54
sean-k-mooneynova does not know that so we cant assume nova can relocate teh image to anotehr cluster in general16:54
sean-k-mooneymnaser: sure in your case it praobly fine, im just highlightin one fo the resonce nova would not do this by default16:55
mnaseryep i agree16:55
sean-k-mooneymnaser: haveing a config option on the other hand maybe16:55
sean-k-mooneymnaser: if you get this working and it usefull to you then im sure people would at least consider it but likely the responce would be have a higher level service prechase the image for you out of band of nova16:58
mnasersean-k-mooney: right but in a public cloud environment.. i cant really do that16:58
mnaserunless i setup replication which replicates *all* images across regions16:58
mnasersorry, not across region, but across ceph clusters16:59
mnaseri.e. this is the case of a single glance, single nova deployment, multiple ceph clusters16:59
sean-k-mooneyam that depends on if you confie you teantes to specific clusers16:59
sean-k-mooneyin which case you only need to replicate the images that each of the teannts the use tha cluster need17:00
mnaserright, but this is a public cloud so the answer is "everyone" .. as it presents itself as 2 independent availability zones17:00
mnaseri mean i can see value in this type of feature for those who want to avoid downloading stuff non stop17:01
*** tbachman has joined #openstack-nova17:01
sean-k-mooneythis is specifcly for the ceph image backend by the way?17:01
mnaseryes.. well.. normal backends cache images locally (even ceph)17:01
mnaserbut the problem is well.. it will be a local cache17:01
*** Swami has quit IRC17:01
sean-k-mooneymnaser: you basicaly want to tack advantage of cephs ablity to quickly clone volumes internally right17:01
mnaseryes, and avoid the download by every compute node17:02
*** k_mouza has joined #openstack-nova17:02
sean-k-mooneyya thats what i assumed17:02
mnaserotherwise the local storage would have been ok but yeah17:02
sean-k-mooneymnaser: i might be worth seeing if you could do it in os-brick and have it stage the image in the ceph cluster on the first use of that image in that cluster17:03
mnaseryou know now what i think about it17:03
mnaseri realize that like17:03
mnaserthis is more of a cinder problem because we no longer offer vms without bfv17:03
sean-k-mooneymnaser: ya kindof17:03
mnaserbefore we'd include ephemeral on storage so it was a nova issue17:03
mnaserand i think this is kinda solved in https://docs.openstack.org/cinder/latest/admin/blockstorage-image-volume-cache.html17:04
sean-k-mooney mnaser ya in the boot from volume case that should help alot17:05
sean-k-mooneymnaser: that said in the ceph case i hope they are using ceph to do the clone internllay wich i assume they are17:06
mnaseri think new cinder volumes from image do use ceph clone17:06
mnaserso it would download from glance over http (in the cases of regions without local glance)17:06
mnaserwhere the ceph cluster isnt directly accessible17:06
sean-k-mooneyprovided glance was not backed also by ceph right17:07
mnaserglance is backed by ceph, but it can do cow images in the same datacenter its hosted17:07
sean-k-mooneyif you glance is on ceph i think it can just to a direct clone pasing the ceph uri17:07
mnaseryeah but that ceph cluster won't be accessible as it'd be in another datacenter17:07
mnaserso it will fallback to just downloading over http17:07
sean-k-mooneymnaser: right and you want to update glance with the second loaction once its cache by cinder17:08
mnaseri mean, i dont have to, cinder will just know that it has it cached locally anyways17:08
mnaserso bfv, create volume, cinder checks its cache (on local ceph), sees it exists, cow and boot vm17:09
sean-k-mooneyright but if you are not doing bfv and instead used the ceph backend for nova  then you woudl want the other behavior17:10
sean-k-mooneyand in that config the caching and glance update would be nova problem17:10
sean-k-mooneybut ya if your using bfv then it sound like it should be good17:10
*** dtantsur is now known as dtantsur|afk17:19
openstackgerritStephen Finucane proposed openstack/nova master: Fail to live migration if instance has a NUMA topology  https://review.openstack.org/61108817:21
*** ccamacho has quit IRC17:27
*** cdent has joined #openstack-nova17:29
*** mriedem has quit IRC17:30
openstackgerritMerged openstack/nova master: Fix libvirt volume tests passing invalid disk_info  https://review.openstack.org/52932817:31
*** mriedem has joined #openstack-nova17:35
*** ralonsoh has quit IRC17:35
*** panda is now known as panda|off17:36
*** k_mouza_ has joined #openstack-nova17:36
*** k_mouza has quit IRC17:40
openstackgerritJim Rollenhagen proposed openstack/nova-specs master: Use conductor groups to partition nova-compute services for Ironic  https://review.openstack.org/60970917:43
leakypipesfried_rolls, SteelyDan, melwitt: if you have a moment: https://review.openstack.org/#/c/614351/17:45
*** itlinux has joined #openstack-nova17:58
*** fanzhang has quit IRC18:01
*** derekh has quit IRC18:02
openstackgerritJohn Garbutt proposed openstack/nova master: WIP: Integrating with unified limits  https://review.openstack.org/61518018:04
*** itlinux has quit IRC18:06
*** betherly has quit IRC18:08
-openstackstatus- NOTICE: OpenStack infra's mirror nodes stopped accepting connections on ports 8080, 8081, and 8082. We will notify when this is fixed and jobs can be rechecked if they failed to communicate with a mirror on these ports.18:09
openstackgerritMerged openstack/nova master: Pass disk_info dict to libvirt_info  https://review.openstack.org/52932918:15
*** cdent has quit IRC18:24
*** pcaruana has joined #openstack-nova18:27
mriedemSteelyDan: besides the RequestSpec.is_bfv resource tracking/filtering fix in rocky, can you think of any other major volume-related features/bug fixes we had?18:41
mriedemin rocky specifically18:41
*** zul has joined #openstack-nova18:41
SteelyDanI'd have to look.. I suck at remembering time intervals like that18:42
SteelyDanbut nothing jumps out at me as recent, no18:42
*** fried_rolls is now known as fried_rice18:46
-openstackstatus- NOTICE: The firewall situation with ports 8080, 8081, and 8082 on mirror nodes has been resolved. You can recheck jobs that have failed to communicate to the mirrors on those ports now.18:54
*** pcaruana has quit IRC19:08
*** betherly has joined #openstack-nova19:16
fried_riceleakypipes: https://review.openstack.org/#/c/614351/ back atcha. I'm not a full -1 here, but would like the alternative considered. Also weirdness noted inline - I'm sure I'm just blind.19:19
*** betherly has quit IRC19:21
*** eharney has quit IRC19:24
*** fghaas has joined #openstack-nova19:29
*** lpetrut has joined #openstack-nova19:34
*** finucannot is now known as stephenfin19:35
*** jistr has quit IRC19:35
*** jistr has joined #openstack-nova19:37
leakypipesfried_rice: that's a good idea. I'll adapt.19:37
fried_riceleakypipes: cool beans.19:37
fried_ricesean-k-mooney, cfriesen, mriedem: I didn't dig too deep, but the tempest-full-py3 placement log on that trust-the-cache change is 154K, vs random other change where it's 305K.19:38
fried_riceleakypipes: --^ (see also ML)19:38
mriedemmeaning we just hit the placement API less19:38
fried_riceexactly, which was the point.19:38
mriedemfunny how removing a cache means we hit the API *less*19:39
fried_riceNo, we didn't remove the cache19:39
fried_ricewe removed *refreshing* the cache19:39
fried_riceoh19:39
fried_riceActually the part that we removed by default was just the updating of the compute rp every minute.19:39
mriedemthose sound like married cousins19:39
fried_riceto get the full effect of this thing, I would need to set that config var.19:40
fried_ricedoes that happen in the devstack project?19:40
fried_ricecause yeah, I totally want to do that.19:40
mriedemit doesn't19:40
mriedemyou could post-config that in the nova-next job or something if you wanted19:40
mriedemto see a run with it19:40
mriedem[[post-config|$NOVA_CPU_CONF]] something like that19:41
mriedemthere are examples19:41
mriedemyou want to blast it up to 1000000 or something?19:41
fried_ricemriedem: No, zero19:41
mriedemi thought the min was 1?19:41
mriedemor are you changing that?19:41
fried_ricethe patch lets you do that now.19:41
mriedemok19:41
fried_ricezero => float('inf') kind of thing19:41
mriedemthen you could just put a patch on top that makes the nova-next job disable the refresh19:42
fried_riceOkay, I have the bat and the blindfold. Can you spin me around three times and point me in the right direction?19:42
fried_rice(I don't know where to find that config for the nova-next job)19:42
mriedemit would go in here https://github.com/openstack/nova/blob/master/playbooks/legacy/nova-next/run.yaml#L3619:43
fried_riceack, thx. I'm going to make a couple of edits per review comments from sean-k-mooney and then I'll sling that on top.19:43
mriedembut in a [[post-config|$NOVA_CPU_CONF]] section19:43
mriedemi think that will do the trick but it's been awhile since i've dug into my bag of tricks19:44
mriedem2 days to be exact19:44
openstackgerritJim Rollenhagen proposed openstack/nova-specs master: Use conductor groups to partition nova-compute services for Ironic  https://review.openstack.org/60970919:45
*** betherly has joined #openstack-nova19:46
*** betherly has quit IRC19:50
nicolasbockHi. I keep getting `nova-spicehtml5proxy: 2018-11-02 20:00:53.205 29786 ERROR nova.console.websocketproxy error: [Errno 32] Broken pipe` errors20:04
nicolasbockDid I misconfigure something?20:05
melwittnicolasbock: what release are you on? did you upgrade recently? do you have multiple cells?20:05
mgagneDo you still need to define [database]/connection in API cell or is [api_database]/connection enough?20:06
nicolasbockmelwitt (IRC): sorry I should have had this information ready before I asked...20:09
* nicolasbock digging....20:09
mriedemmgagne: our CI points [database]/connection at the cell0 database for controller services and such20:13
mriedemit won't have instances or hosts or anything, but we do register the services20:13
mgagnemriedem: ok, how does it relate to the database_connection used by nova-manage cell_v2 map_cell0 ? isn't the config read once and never used after?20:14
*** tbachman has quit IRC20:14
mriedemthat goes into the cell_mappings record in the api db,20:15
*** eharney has joined #openstack-nova20:15
mriedemthat's not what is used to create the services table entry though for the controller services like nova-osapi_compute, nova-conductor, and nova-scheduler20:15
mriedemthose go into the [database]/connection20:15
mgagnemriedem: hooo, you mean when the service starts up and register itself20:16
mgagneok, it makes a lot of sense20:16
mriedemyeah20:18
mriedemnova.service.Service.start() or whatever20:18
mriedemdoes an update-or-create dance with itself20:18
mriedemlike billy idol20:18
mgagne:D20:19
nicolasbockmelwitt (IRC): nova-18.0.0.0b4.dev134, no upgrade, fresh install (OpenStack Ansible / master), cell0 and cell120:22
*** cdent has joined #openstack-nova20:24
melwittnicolasbock: ok, thanks. and when do you get that error? when starting the proxy or when trying to get a new console or?20:24
melwittdo you have a traceback you could paste?20:24
nicolasbockit seems to show up after I create a server20:24
nicolasbockYes20:25
cdentfried_rice: sanity check me on some mental meanderings please20:25
cdent"generation" can act as a cache invalidator for a resource provider. you can compare generations in various ways, and if it is different from what you think it should be be, then you know to do differently20:26
nicolasbockmelwitt (IRC): http://paste.openstack.org/show/734053/20:26
cdentwhat if: when the generation on an rp changes, it caused a generation bump on its parent20:26
cdentthus: whenever a compute node needing to validate it's tree, it just needed to compare stored generation with the generation of just the root20:27
cdents/needing/needed/ s/it's/its/20:27
cdentI'm thinking perhaps that's how nested generations should always have worked20:27
*** Swami has joined #openstack-nova20:27
mriedemfried_rice: thanks for the ML post, i dumped my brain20:31
melwittnicolasbock: hm, I haven't seen that before. where have you deployed the console proxy? is it on a host that has a nova.conf with [database]connection set to the cell1 database?20:32
melwittthe traceback looks unrelated to database access issues, but asking just in case20:33
nicolasbockmelwitt (IRC): The console proxy is deployed in an LXC container that runs the Nova API20:35
*** lpetrut has quit IRC20:35
nicolasbockI haven't noticed database acces issues from that container to the Galera container20:35
*** betherly has joined #openstack-nova20:35
melwittnicolasbock: ok. it sounds like it's possible the [spice] config options have been misconfigured, like the address configs. seeing if I can find docs. have you been able to set this up properly before in the past and now it is broken?20:38
nicolasbockNo, this is the first time I am setting this up.20:39
nicolasbockI could try an older branch20:39
melwittno, that's ok, just checking whether this is a regression in behavior you have seen before20:40
*** betherly has quit IRC20:40
nicolasbockI have set `novncproxy_base_url = https://44.81.0.110:6080/vnc_lite.html` in the nova-api container20:42
nicolasbockHowever, that IP is the IP of the OSA host20:43
nicolasbockIs that possible the issue?20:43
melwittyeah, I was about to suggest something like that based on what I'm reading in https://docs.openstack.org/nova/latest/admin/remote-console-access.html#spice-console20:43
*** tbachman has joined #openstack-nova20:44
fried_ricecdent: So far the philosophy has been that the client isn't supposed to "compare" generations at all.20:44
fried_riceThey're supposed to be opaque, introspected only by placement itself.20:45
cdentfried_rice: they are supposed to be meaningless, but comparing mine to yours doesn't imply meaning20:45
nicolasbockmelwitt (IRC): The "controller" node is the one that runs the API?20:45
melwittnicolasbock: I notice you are using novnc config options but are running the spice proxy?20:46
fried_ricecdent: It's a subtle distinction - testing for (in)equality versus gt/lt - but it's still treating it as non-opaque on the client.20:46
cdentfried_rice: if we had done etags instead of generations, the way to accomplish the thing I'm describing is with a conditional GET.20:46
*** eharney has quit IRC20:46
fried_ricecdent: but putting that aside for the moment, what you're talking about is overloading the generation to do more than we're doing now.20:46
melwittnicolasbock: I think there it means the "controller" is where you are running the proxy. and the config options in the [spice] section are on the compute host (compute host is referring to where the proxy is running)20:46
nicolasbockmelwitt (IRC): the initial installation was configured to use the spice proxy, but as I was getting these error messages I reconfigured it20:46
cdentfried_rice: I seem to recall seeing generation comparison in report client code, but I may be out of date20:47
cdentno it is doing exactly how a generation is defined20:47
nicolasbockmelwitt (IRC): Thanks that clarifies this20:47
nicolasbockmelwitt (IRC): I should stop the spicehtml5proxy service20:48
*** spatel has quit IRC20:49
melwittnicolasbock: I'm not sure. it doesn't look like the spice options are related to the proxy service20:50
melwittmeaning, I think they are consumed by nova-compute, not the proxy20:50
melwittso I'd fix the options on the host running nova-compute first and then see what happens20:52
nicolasbockOk, thanks melwitt (IRC) I'll try that20:54
*** fghaas has quit IRC20:57
*** tbachman has quit IRC20:58
*** cdent has quit IRC21:13
*** awaugama has quit IRC21:16
*** fghaas has joined #openstack-nova21:29
*** dave-mccowan has quit IRC21:35
*** betherly has joined #openstack-nova21:37
mgagnemriedem: does it *need* to be cell0 database or could it be a different dedicated database?21:37
*** ttsiouts has joined #openstack-nova21:38
*** fghaas has quit IRC21:39
mriedemmgagne: doesn't need to be cell0,21:40
mriedemthat's just what we use in devstack21:40
mriedemb/c we have the api db, cell0 and cell121:40
mgagnemriedem: does it mean there are 2 schemas/migration in the same database?21:40
mriedemand we want to make sure cell1 is just for instances and compute hosts and such21:40
mriedemno21:40
mriedemcell0 and cell1 have the same schema21:40
mriedemeverything used for a [database]/connection config uses the 'nova' schema21:41
*** betherly has quit IRC21:41
mriedem[api_database]/connection uses the 'nova_api' schema21:41
mriedemiow, former is 'nova-manage db sync', latter is 'nova-manage api_db sync'21:41
mgagneok so it just happens to have the same schema but might not be used for the same purpose from a pure semantic perspective21:42
mgagnebecause if I put nova_cell0 in database/connection and run map_cell0, I might just end up with nova_cell0_cell021:42
*** ttsiouts has quit IRC21:43
*** ttsiouts has joined #openstack-nova21:53
openstackgerritMatt Riedemann proposed openstack/nova master: Update compute API.get() mocks in test_server_metadata  https://review.openstack.org/61534121:57
openstackgerritMatt Riedemann proposed openstack/nova master: Update compute API.get() stubs in test_serversV21  https://review.openstack.org/61534221:57
openstackgerritMatt Riedemann proposed openstack/nova master: Update compute API.get() stubs in test_server_actions  https://review.openstack.org/61534321:57
openstackgerritMatt Riedemann proposed openstack/nova master: Update compute API.get() stubs for test_*security_groups  https://review.openstack.org/61534421:57
openstackgerritMatt Riedemann proposed openstack/nova master: Update compute API.get() stubs for test_disk_config  https://review.openstack.org/61534521:57
openstackgerritMatt Riedemann proposed openstack/nova master: Update compute API.get() stubs in test_access_ips  https://review.openstack.org/61534621:57
openstackgerritMatt Riedemann proposed openstack/nova master: Drop pre-cellsv2 compat in compute API.get()  https://review.openstack.org/61534721:57
openstackgerritMatt Riedemann proposed openstack/nova master: Remove "API Service Version" upgrade check  https://review.openstack.org/61534821:57
mriedemSteelyDan: ^ only took me all f'ing day21:57
openstackgerritMatt Riedemann proposed openstack/nova master: Drop pre-cellsv2 compat in compute API.get()  https://review.openstack.org/61534721:59
openstackgerritMatt Riedemann proposed openstack/nova master: Remove "API Service Version" upgrade check  https://review.openstack.org/61534821:59
openstackgerritMatt Riedemann proposed openstack/nova master: Drop pre-cellsv2 compat in compute API.get()  https://review.openstack.org/61534722:06
openstackgerritMatt Riedemann proposed openstack/nova master: Remove "API Service Version" upgrade check  https://review.openstack.org/61534822:06
*** munimeha1 has quit IRC22:06
*** erlon has quit IRC22:43
*** spatel has joined #openstack-nova22:46
*** spatel has quit IRC22:50
*** owalsh has quit IRC23:16
*** owalsh has joined #openstack-nova23:17
*** ttsiouts has quit IRC23:17
*** mriedem has quit IRC23:18
*** tbachman has joined #openstack-nova23:37
*** betherly has joined #openstack-nova23:39
*** markvoelker has joined #openstack-nova23:41
*** tbachman has quit IRC23:41
*** betherly has quit IRC23:43
*** Swami has quit IRC23:44
*** markvoelker has quit IRC23:46
*** gyee has quit IRC23:48
*** mchlumsky has quit IRC23:50
*** mchlumsky has joined #openstack-nova23:51
*** tbachman has joined #openstack-nova23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!