Monday, 2018-06-11

openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (2)  https://review.openstack.org/57348100:00
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (3)  https://review.openstack.org/57410400:26
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (4)  https://review.openstack.org/57410600:49
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (5)  https://review.openstack.org/57411001:15
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (6)  https://review.openstack.org/57411301:46
*** edmondsw has quit IRC01:47
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi(N-R-P):Get vgpu info from `allocations`  https://review.openstack.org/52171701:55
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi(N-R-P): Add API to support vgpu resource provider create  https://review.openstack.org/52031301:56
openstackgerritjiang wei proposed openstack/nova master: Add action initiator attribute to the instance info  https://review.openstack.org/53624302:07
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi(N-R-P):Get vgpu info from `allocations`  https://review.openstack.org/52171702:11
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Add InstanceGroupPolicy object  https://review.openstack.org/57362802:42
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Add policy to InstanceGroup object and api models.  https://review.openstack.org/56337502:42
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Add policy field to ServerGroup notification object  https://review.openstack.org/56340102:42
*** edmondsw has joined #openstack-placement02:54
*** edmondsw has quit IRC02:59
openstackgerritZhenyu Zheng proposed openstack/nova master: WIP  https://review.openstack.org/56409203:43
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Change the anti-affinity Filter to adapt to new policy  https://review.openstack.org/57116603:57
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Adapt _validate_instance_group_policy to new policy model  https://review.openstack.org/57146503:57
openstackgerritMerged openstack/nova master: Remove support for /os-virtual-interfaces REST API  https://review.openstack.org/56992304:19
openstackgerritTakashi NATSUME proposed openstack/nova master: api-ref: Example verification for servers.inc  https://review.openstack.org/52952004:36
openstackgerritTakashi NATSUME proposed openstack/nova master: api-ref: Example verification for servers.inc  https://review.openstack.org/52952004:36
*** e0ne has joined #openstack-placement05:28
*** tetsuro has joined #openstack-placement05:29
*** e0ne has quit IRC05:33
openstackgerritMerged openstack/nova master: Remove unused _disk_qcow2_to_raw  https://review.openstack.org/57202506:08
*** ttsiouts has joined #openstack-placement06:23
*** belmoreira has joined #openstack-placement06:27
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Microversion 2.63 - Use new format policy in server group  https://review.openstack.org/56753407:05
openstackgerritjichenjc proposed openstack/nova master: doc follow https://review.openstack.org/#/c/572195  https://review.openstack.org/57309107:08
openstackgerritZhenyu Zheng proposed openstack/nova master: WIP Add full traceback to ExceptionPayload in versioned notifications  https://review.openstack.org/56409207:14
*** ttsiouts has quit IRC07:15
*** rubasov has joined #openstack-placement07:18
*** ttsiouts has joined #openstack-placement07:25
*** ttsiouts has quit IRC07:27
*** ttsiouts has joined #openstack-placement07:28
openstackgerrithuanhongda proposed openstack/nova stable/ocata: Remove soft-deleted instances from quota_usages  https://review.openstack.org/57065307:30
openstackgerritBalazs Gibizer proposed openstack/nova master: Remove network info stubbing in functional test  https://review.openstack.org/57001807:31
openstackgerritBalazs Gibizer proposed openstack/nova master: Add request_spec.RequestGroup versioned object  https://review.openstack.org/56884007:31
openstackgerritBalazs Gibizer proposed openstack/nova master: Add requested_resources field to RequestSpec  https://review.openstack.org/56726707:31
openstackgerritBalazs Gibizer proposed openstack/nova master: Add bandwidth related standard resource classes  https://review.openstack.org/57084707:31
openstackgerritBalazs Gibizer proposed openstack/nova master: Transfer port.resource_request to the scheduler  https://review.openstack.org/56726807:31
openstackgerritBalazs Gibizer proposed openstack/nova master: Send resource allocations in the port binding  https://review.openstack.org/56945907:31
openstackgerritBalazs Gibizer proposed openstack/nova master: Test boot with more ports with bandwidth request  https://review.openstack.org/57331707:31
*** ttsiouts has quit IRC07:32
openstackgerritjiang wei proposed openstack/nova master: Add action initiator attribute to the instance info  https://review.openstack.org/53624307:33
*** belmoreira has quit IRC07:36
*** bauzas has joined #openstack-placement07:39
*** belmoreira has joined #openstack-placement07:48
*** belmoreira has quit IRC07:53
*** ttsiouts has joined #openstack-placement07:53
openstackgerritMerged openstack/nova master: Pushing image traits to ironic node  https://review.openstack.org/56562008:05
openstackgerrithuanhongda proposed openstack/nova master: Return "deleted" time of instance when vm_state is DELETED or SOFT-DELETED  https://review.openstack.org/57415908:10
*** belmoreira has joined #openstack-placement08:33
openstackgerritTetsuro Nakamura proposed openstack/nova master: Test alloc_cands with indirectly sharing RPs  https://review.openstack.org/51960108:39
openstackgerritTakashi NATSUME proposed openstack/nova stable/queens: Fix the file name of development-environment.rst  https://review.openstack.org/57417509:00
*** ttsiouts has quit IRC09:12
*** e0ne has joined #openstack-placement09:12
*** ttsiouts has joined #openstack-placement09:13
*** giblet is now known as gibi09:31
openstackgerritZhenyu Zheng proposed openstack/nova master: WIP Add full traceback to ExceptionPayload in versioned notifications  https://review.openstack.org/56409209:33
*** takashin has left #openstack-placement09:37
*** ttsiouts has quit IRC09:38
openstackgerritsahid proposed openstack/nova master: libvirt: remove unused get_ovs_interfaceid()  https://review.openstack.org/57269909:39
*** ttsiouts has joined #openstack-placement09:40
*** finucannot is now known as stephenfin09:45
*** nicolasbock has joined #openstack-placement10:39
*** ttsiouts has quit IRC10:43
*** jrollen is now known as jroll10:44
openstackgerritjichenjc proposed openstack/nova master: z/VM Driver: Initial change set of z/VM driver  https://review.openstack.org/52338710:55
openstackgerritjichenjc proposed openstack/nova master: z/VM Driver: Spawn and destroy function of z/VM driver  https://review.openstack.org/52765810:55
openstackgerritjichenjc proposed openstack/nova master: z/VM Driver: add snapshot function  https://review.openstack.org/53424010:55
openstackgerritjichenjc proposed openstack/nova master: z/VM Driver: add power actions  https://review.openstack.org/54334010:55
openstackgerritjichenjc proposed openstack/nova master: z/VM Driver: add get console output  https://review.openstack.org/54334410:55
*** cdent has joined #openstack-placement11:00
*** ttsiouts has joined #openstack-placement11:06
*** ttsiouts has quit IRC11:07
openstackgerritLee Yarwood proposed openstack/nova master: Rename parameters in call() of nova/image/glance.py  https://review.openstack.org/50853311:09
*** tetsuro has quit IRC11:12
*** ttsiouts has joined #openstack-placement11:13
*** jroll has quit IRC11:18
*** jroll has joined #openstack-placement11:18
*** e0ne has quit IRC11:38
gibicdent, efried bhagyashris_: I think I found the reason why the test in https://review.openstack.org/#/c/560459 fails sometimes11:44
gibicdent, efried bhagyashris_: left some comment within11:45
cdentgibi: presumably some other test may create that path first, and that's why sometimes it passes?11:45
gibicdent: exactly11:46
gibicdent: I found such tests11:46
openstackgerritAlexandre arents proposed openstack/nova master: Preserve images_type of instance during live migration  https://review.openstack.org/57052811:46
*** e0ne has joined #openstack-placement11:48
cdentgibi: nice sleuthing11:56
gibicdent: thanks, it was fun to do the investigation12:02
cdentLast night, after saying it was too late to do the investigation I lay in bed trying to sleep for about 5 hours (jetlag). Maybe I should have stayed up.12:03
gibicdent: you did not know beforehand that it will take 5 hours to fall asleep12:07
cdentindeed12:08
gibiso I think you made a good decision to try to sleep12:08
*** ttsiouts has quit IRC12:09
*** edmondsw has joined #openstack-placement12:12
*** ttsiouts has joined #openstack-placement12:14
bhagyashris_gibi: Hi, I gone through the comment on https://review.openstack.org/#/c/560459 but i am not totally clear about it12:16
gibibhagyashris_: what part is unclear for your?12:21
bhagyashris_gibi: In that code path there is an ensure_tree call [2]that (I assume) creates the necessary directories recursively [2] https://github.com/openstack/nova/blob/3693caa54132ef3ec278d846dc50943a8d52509b/nova/virt/libvirt/imagebackend.py#L37112:23
gibibhagyashris_: some of the functional tests ends up executing that code path and therefore creating the directory tree12:23
gibibhagyashris_: the new functional test case in https://review.openstack.org/#/c/560459 also needs that directory tree to exists12:24
gibibhagyashris_: but it does not create it.12:24
gibibhagyashris_: so the new functional test only passes if one of the other tests that hit the directory creation code path runs before the new funtional test12:25
*** takashin has joined #openstack-placement12:26
bhagyashris_gibi: ok12:32
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Fix all invalid obj_make_compatible test case  https://review.openstack.org/57424012:33
*** e0ne has quit IRC12:42
*** e0ne has joined #openstack-placement12:47
efriedgibi: Thanks for that.  Is there something we can mock to simply bypass that issue?13:18
gibiefried: I'm not sure that mocking the  os.statvfs(path) call but I don't know what else will need the directory structure later13:19
efriedgibi: We're already mocking spawn, aren't we?13:20
gibiefried: we already have 10(ish) test cases that creates the path13:20
efriedyeah, I guess if it's like that, might as well do what the other tests do...13:20
gibiefried: some test case doesn't mock spawn13:20
gibiefried: doing exactly what other tests do is not that simple. Other tests passes because our image backend implementation creates the dir structure if it does not exists13:21
gibiefried: the cleanest would be to have a fixture that created the dir for both the new test and the old test depending on this dir to exists13:22
gibiOR mock out all the file system usage in the test13:22
efriedYup.13:22
*** ttsiouts has quit IRC13:22
gibiefried, bhagyashris_: I'm pretty busy with other thing right now so I haven't started fixing this test issue yet. Feel free to give it a try13:26
*** ttsiouts has joined #openstack-placement13:28
openstackgerritymadhavi@in.ibm.com proposed openstack/nova stable/queens: mock utils.execute() in qemu-img unit test  https://review.openstack.org/57425513:31
*** belmorei_ has joined #openstack-placement13:32
*** belmoreira has quit IRC13:34
efriedcdent: https://review.openstack.org/#/c/362766/102..103/nova/conf/database.py@13613:41
efriedI still think that `deprecated_name` shouldn't be there.13:41
cdentOh, I ignored that commet originally because I had no idea what you mean.13:42
cdentt13:42
cdentefried: also it's at line 59 too13:42
efriedcdent: But on L59 it's replacing a deprecated opt that previously existed in that conf group.13:44
cdentand it's also listed as deprecated on the originating oslo_db settings13:44
efriedThis is a new conf group.  There has never been a [placement]idle_timeout to replace.13:44
*** mriedem has joined #openstack-placement13:44
efriedsorry, [placement_database]idle_timeout13:44
mriedemleakypipes: efried: dansmith: correct me if i'm wrong about the result of the online data migration method in https://review.openstack.org/#/c/567678/13:45
mriedemotherwise i'm +2 on that change13:45
efriedcdent: If it's deprecated in [database], then the deprecation in [api_database] is either because the copyover happened before the deprecation, or it's also wrong.13:46
efriedcdent: But this copyover is definitely happening after the deprecation.  There has never been a [placement_database]idle_timeout.  So there's nothing to deprecate there.13:46
dansmithmriedem: if the code does what you say then it's wrong13:46
cdentefried: yeah, that's a good point. I'm not sure why either line is the way it is, but roman wrote that bit of the code, and he was active in oslo_db, so I just took it for granted, but I think you're right so I'll remove it (just the second one)13:46
dansmithmriedem: otherwise we'll never signal success to the CLI user13:46
mriedemright there is no indication of what's lft13:46
mriedem*left13:46
efriedcdent: I could be wrong about how that stuff works; may be worth verifying with someone who knows conf better.13:47
dansmithmriedem: although, it will be big,big first and then 0,0 after right?13:47
mriedemthe way this is written, it will be by default at most 5013:48
mriedembut i could do: nova-manage db online_data_migration --max-count 113:48
mriedemand if there are 20 of these, i'd expect to see 1 was migrated and 9 are left13:48
mriedemhttps://github.com/openstack/nova/blob/ef6b4f43f467dfad2fd0fe99d9dec3fc93a9ffed/nova/cmd/manage.py#L65513:48
cdentefried: if you haven't done so already please leave (another) comment and I'll get to it later today13:48
efriedack13:49
dansmithmriedem: it's legit to return limit, limit if it costs a lot to count the higher one I think13:49
dansmithmriedem: we have others that have that, AFAIK13:49
dansmithmriedem: it just has to be nonzero until it's zero and then be stably zero13:49
dansmithI thought your comment was asserting that it's always nonzero return, which won't work13:50
mriedemno, my comment was that it's supposed to return (total number of unmigrated records left, total migrated)13:50
mriedemif that's not true, ok, but we should really have a comment in the online data migration code since i always have to look this up13:50
dansmithwell, it's technically found,done13:50
mriedemok, but i assume that the limit isn't applied to "found"13:51
mriedemin this case, it is13:51
dansmithfound may not be all of them, but some subset if it's expensive to find them all..13:51
dansmithwe could do two queries, one to count them all and one to fix the limit amount, but I'm not sure it's worth it13:51
mriedemwe've done that in other places i'm sure13:51
dansmithI'm quite sure I've written one where we process through batches without counting the whole first, but I can go look if you want to knwo13:52
efriedcdent: What about the comments in https://review.openstack.org/#/c/362766/101/nova/tests/unit/cmd/test_status.py@366 ?13:52
mriedemanyway, this is why it's inconsistent and confusing and we should at least have a code comment13:52
efriedcdent: Reasoning on L831 (the test cases don't hit placement, and doesn't make sense to future-proof)?13:52
dansmithmriedem: yeah, even the flavor one doesn't count them all, only up to limit13:53
cdentlooks like there's an undelivered draft response to that that I never sent. sending now13:53
mriedemmigrate_keypairs_to_api_db is the way i'm describing13:53
cdentalso, you could help me a lot if you were less terse when commenting13:53
dansmithmriedem: https://github.com/openstack/nova/blob/stable/ocata/nova/objects/flavor.py#L73413:54
efriedcdent: Okay.  I was trying a new thing there.  Guess it failed :)13:54
dansmithmriedem: yeah, keypairs counts them all first13:54
cdentefried: what was the goal of the new thing? agree it failed. I had to struggle to decode you and it didn't make me...receptive13:55
efriedcdent: I sometimes feel like I say way too much, explaining stuff that is obvious to the reader once I've brought attention to the piece in question.13:55
dansmithmriedem: actually it counts unmigrated instances and bails if nonzero, it then only gets limit main_keypairs and processes those, so it'll never be more than limit right?13:55
efriedcdent: Composing the full explanation takes time and effort, so if it's not needed, it'd be a savings to omit it.  But clearly I went too far in this case.13:55
cdentefried I think that's useful, especially for other reviews who are trying to learn by reviewing13:55
dansmithhttps://github.com/openstack/nova/blob/master/nova/objects/keypair.py#L26513:55
dansmithmriedem: passes count to get_main_keypairs ^13:56
efriedcdent: ack.  Thanks for the feedback13:56
cdentefried: for those other people (especially) it is not at all waste time and effort. I think it is the main job of a core reviewer.13:56
efriednoted13:56
mriedemdansmith: but _count_unmigrated_instances could return 1000 right?13:56
mriedemand then _get_main_keypairs could return 50 (default max count)13:56
dansmithmriedem: yes but that's not part of what is returned there13:57
dansmithmriedem: we return main_keypairs,done not bad_instances,done13:57
mriedemyes true13:57
mriedemok, anyway, i've +2ed jay's change,13:57
dansmithbad_instances is just used to determine if we can do anything13:57
mriedemi still think we should have some clarification in the online data migrations code to explain what's ok here13:57
mriedembut it's not something that goes in jay's change obviously13:57
dansmithack, I'13:57
dansmithll write one13:58
mriedemthanks13:58
openstackgerritDan Smith proposed openstack/nova master: Document the internal online_migrations function behaviors  https://review.openstack.org/57426814:05
openstackgerritMerged openstack/nova stable/queens: Ensure resource class cache when listing usages  https://review.openstack.org/57381114:13
openstackgerritBalazs Gibizer proposed openstack/nova master: Remove network info stubbing in functional test  https://review.openstack.org/57001814:27
openstackgerritBalazs Gibizer proposed openstack/nova master: Add request_spec.RequestGroup versioned object  https://review.openstack.org/56884014:28
openstackgerritBalazs Gibizer proposed openstack/nova master: Add requested_resources field to RequestSpec  https://review.openstack.org/56726714:28
openstackgerritBalazs Gibizer proposed openstack/nova master: Add bandwidth related standard resource classes  https://review.openstack.org/57084714:28
openstackgerritBalazs Gibizer proposed openstack/nova master: Transfer port.resource_request to the scheduler  https://review.openstack.org/56726814:28
openstackgerritBalazs Gibizer proposed openstack/nova master: Send resource allocations in the port binding  https://review.openstack.org/56945914:28
openstackgerritBalazs Gibizer proposed openstack/nova master: Test boot with more ports with bandwidth request  https://review.openstack.org/57331714:28
openstackgerritStephen Finucane proposed openstack/nova master: objects: Add NUMANetworkInfo object  https://review.openstack.org/56443914:30
openstackgerritStephen Finucane proposed openstack/nova master: conf: Add '[neutron] physnets' and related options  https://review.openstack.org/56444014:30
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Start populating NUMACell.network_info field  https://review.openstack.org/56444114:30
openstackgerritStephen Finucane proposed openstack/nova master: objects: Add InstanceNUMANetworkInfo object  https://review.openstack.org/56444214:30
openstackgerritStephen Finucane proposed openstack/nova master: network: Unchain _get_phynet_info from _get_port_vnic_info  https://review.openstack.org/56444314:30
openstackgerritStephen Finucane proposed openstack/nova master: network: Add 'create_resource_requests' to network API  https://review.openstack.org/56444414:30
openstackgerritStephen Finucane proposed openstack/nova master: network: Retrieve tunneled status in '_get_network_info'  https://review.openstack.org/56444514:30
openstackgerritStephen Finucane proposed openstack/nova master: hardware: Start accounting for network requests  https://review.openstack.org/56444814:30
openstackgerritChris Dent proposed openstack/nova stable/ocata: Ensure resource class cache when listing usages  https://review.openstack.org/57427914:31
*** tssurya has joined #openstack-placement14:43
openstackgerritChris Dent proposed openstack/nova master: Optional separate database for placement API  https://review.openstack.org/36276614:53
openstackgerritChris Dent proposed openstack/nova master: Isolate placement database config  https://review.openstack.org/54143514:53
openstackgerritChris Dent proposed openstack/nova master: Ensure that os-traits sync is attempted only at start of process  https://review.openstack.org/55385714:53
cdentefried: fixed the conf setting on that stack ^14:53
efriedcdent: ack14:54
efriedcdent: +214:55
cdentthanks14:56
openstackgerritDan Smith proposed openstack/nova master: Document the internal online_migrations function behaviors  https://review.openstack.org/57426814:59
*** takashin has left #openstack-placement14:59
openstackgerritDan Smith proposed openstack/nova master: Document the internal online_migrations function behaviors  https://review.openstack.org/57426815:12
openstackgerritCurt Moore proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD  https://review.openstack.org/57430115:20
*** belmorei_ has quit IRC15:42
openstackgerritDan Smith proposed openstack/nova master: Document the internal online_migrations function behaviors  https://review.openstack.org/57426815:50
openstackgerritZack Cornelius proposed openstack/nova master: Refactor libvirt get_memory_used_mb()  https://review.openstack.org/57103015:56
openstackgerritZack Cornelius proposed openstack/nova master: Implement file backed memory for instances in libvirt  https://review.openstack.org/56787615:56
*** ttsiouts has quit IRC15:58
openstackgerritMatt Riedemann proposed openstack/nova master: XenAPI: define a new image handler to use vdi streaming  https://review.openstack.org/48647516:01
openstackgerritMatt Riedemann proposed openstack/nova master: XenAPI: update the document related to vdi streaming  https://review.openstack.org/56844416:01
openstackgerritMatt Riedemann proposed openstack/nova master: DNM: default [xenserver]/image_handler to vdi_remote_stream  https://review.openstack.org/57431816:01
*** e0ne has quit IRC16:09
openstackgerritCurt Moore proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD  https://review.openstack.org/57430116:14
cdentmriedem: in case it didn't otherwise cross your radar, I sent that resource class cache and Usage patch back to ocata: https://review.openstack.org/#/c/574279/ . needed some tweaks.16:15
openstackgerritCurt Moore proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD  https://review.openstack.org/57430116:15
openstackgerritMatt Riedemann proposed openstack/nova master: Fix nits from change Id609789ef6b4a4c745550cde80dd49cabe03869a  https://review.openstack.org/57432416:17
mriedemocata16:17
mriedemhells bells16:17
mriedemyou forgot pike?16:17
cdentooops, yeah. It turns out the reason I can't spell is because I don't know the alphabet. Will redo16:18
openstackgerritChris Dent proposed openstack/nova stable/pike: Ensure resource class cache when listing usages  https://review.openstack.org/57432716:20
mriedemdansmith: efried: why is the server_default=text("0") needed here? https://review.openstack.org/#/c/557958/2716:28
mriedemi remember this coming up some other time16:28
cdentthere was discussion about it very early in the process of consumer generations, so perhaps in on of ed's abandoned reviews?16:30
efriedcdent, mriedem: No, it's on this one.  See zzzeek's comments on PS4 and 416:31
efried516:31
efriednot sure why it wouldn't still apply.16:31
efriedI didn't really understand it to begin with.16:31
mriedemwell, that sounds like server_default="0" is wrong and server_default=text("0") is right, but (1) why is server_default needed to begin with and (2) why isn't text() used in the model definition also?16:33
mriedemthe "default" value is a Python-interpreted value, so we use the integer  zero.  It's applied to the insert() construct in Python before it is  sent to the driver.   The "server_default" OTOH is a SQL expression that  needs to be rendered in a CREATE TABLE or ALTER TABLE statement just  once on the server, then the server uses that value from then on.   This  value is emitted directly to the server at DDL time.     Backg16:33
mriedemd on  defaults is at http://docs.sqlalchemy.org/en/latest/core/defaults.html16:33
mriedemfrom PS516:33
mriedemso it sounds like it should at least be mirroring server_default=text("0") in the model definition16:34
mriedemit also doesn't explain why we didn't need server_default on the resource_providers CREATE TABLE in migration 01616:35
efriedcdent: Reviewed https://review.openstack.org/#/c/572576/16:35
cdentthanks16:36
jrollmriedem: this is adding a column to an existing table, so the server_default bit will make existing rows 0 for that column16:36
jrollrather than NULL16:36
efriedmriedem: I think to get satisfaction on this you're going to need to involve Jay and Mike.16:36
efriedor, apparently, jroll knows about this stuff :)16:37
jrollonly because I hate the difference between default and server_default :)16:37
mriedemjroll: ok i figured maybe that was it,16:38
jrollalso just kinda making assumptions about it based on the nullable=False16:38
mriedembut then why not mirror the server_default=text("0") usage in the model definition - is it even needed in the model definition?16:38
mriedemnote that text() is used in the script but not the model def16:38
mriedemand apparently that was a problem: https://review.openstack.org/#/c/557958/4/nova/db/sqlalchemy/api_migrations/migrate_repo/versions/059_add_consumer_generation.py@2616:38
mriedemto not use text()16:38
* jroll doesn't know that but would also make it the same in both16:38
mriedemok, now i need to decide if i rebase the entire series, which needs a mv bump, or just this one patch...or the 4 that don't have a merge conflict...16:40
efriedmriedem: How long is Jay out?16:42
mriedemno idea, but i'm assuming he's busy16:42
mriedemso i'll just rebase this16:42
mriedemwanna keep the train rolling16:43
cdenttwitter suggests that jay is in $some_other_city today for $job orientation, but it is only 4 hours long, but requires lots of transit time16:56
*** tssurya has quit IRC17:11
*** e0ne has joined #openstack-placement17:21
*** e0ne has quit IRC17:25
openstackgerritArtom Lifshitz proposed openstack/nova master: Add InstanceNUMATopology to LibvirtLiveMigrateData  https://review.openstack.org/56639817:29
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: LM: re-fit topology and claim resources on dest  https://review.openstack.org/56724217:29
openstackgerritArtom Lifshitz proposed openstack/nova master: Service version check for NUMA live migration  https://review.openstack.org/56672317:29
openstackgerritMatt Riedemann proposed openstack/nova master: placement: always create consumer records  https://review.openstack.org/56767817:38
openstackgerritMatt Riedemann proposed openstack/nova master: add consumers generation field  https://review.openstack.org/55795817:38
openstackgerritMatt Riedemann proposed openstack/nova master: placement: Allocation.consumer field  https://review.openstack.org/56540517:38
openstackgerritMatt Riedemann proposed openstack/nova master: rework allocation handler _allocations_dict()  https://review.openstack.org/56540717:38
openstackgerritMatt Riedemann proposed openstack/nova master: Add a microversion for consumer generation support  https://review.openstack.org/56560417:38
openstackgerritMatt Riedemann proposed openstack/nova master: Fix nits from change Id609789ef6b4a4c745550cde80dd49cabe03869a  https://review.openstack.org/57432417:38
*** e0ne has joined #openstack-placement17:43
openstackgerritDan Smith proposed openstack/nova stable/pike: Change consecutive build failure limit to a weigher  https://review.openstack.org/57324818:10
openstackgerritCurt Moore proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD  https://review.openstack.org/57430118:12
openstackgerritBrianna Poulos proposed openstack/nova master: Implement certificate_utils  https://review.openstack.org/47994918:14
openstackgerritBrianna Poulos proposed openstack/nova master: Plumb trusted_certs through libvirt driver image paths  https://review.openstack.org/56126218:14
openstackgerritBrianna Poulos proposed openstack/nova master: Add trusted_image_certificates to REST API  https://review.openstack.org/48620418:14
openstackgerritBrianna Poulos proposed openstack/nova master: Add notification support for trusted_certs  https://review.openstack.org/56326918:14
openstackgerritBrianna Poulos proposed openstack/nova master: Add certificate validation docs  https://review.openstack.org/56015818:14
openstackgerritMatt Riedemann proposed openstack/nova master: xenapi: drop deprecated vif_driver config option  https://review.openstack.org/56787718:30
*** e0ne has quit IRC18:33
openstackgerritCurt Moore proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD  https://review.openstack.org/57430118:35
openstackgerritMerged openstack/nova stable/queens: Fix interpretation of max_attempts for scheduling alternates  https://review.openstack.org/57325418:49
efriedcdent: I'm going to download the PlacementDirect patch and play around with it to see if I can "explain" the Adapter thing via code, k?19:05
cdentroger that, wfm, thanks19:05
efriedI can post my findings in a subsequent change so as not to muddy the waters, and if you (and others) likey, we can squash.  Or whatever.19:05
efriedcdent: If, once I've twiddled things around, I can successfully run the test files that patch touches, will that be sufficient evidence that it "works"?19:06
*** e0ne has joined #openstack-placement19:07
cdenti should think so, yes19:07
cdentif you're sufficiently happy with the changes, just commit them back, add yourself as a co-author and we'll move things along yeah?19:07
efriedcdent: Except only you and I have weighed in on that as being a desired direction.19:08
efriedcdent: Was thinking having separate changes could give folks the ability to compare/contrast and "vote".19:08
efriedand it's easy to squash later.19:08
efriedBut horse<-cart, lemme see if I can even do it first.19:08
cdentif you like but it's also just as easy to resumit older versios of the same gerrit review. whatever works best for you19:09
efriedack19:10
*** e0ne has quit IRC19:11
*** mriedem1 has joined #openstack-placement19:26
*** mriedem has quit IRC19:28
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.test_util  https://review.openstack.org/57440319:31
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.handlers.test_aggregate  https://review.openstack.org/57440419:31
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.test_requestlog  https://review.openstack.org/57440519:31
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.test_fault_wrap  https://review.openstack.org/57440619:31
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.test_handler  https://review.openstack.org/57440719:31
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.test_microversion  https://review.openstack.org/57440819:31
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.test_deploy  https://review.openstack.org/57440919:31
openstackgerritZack Cornelius proposed openstack/nova master: Refactor libvirt get_memory_used_mb()  https://review.openstack.org/57103019:33
openstackgerritZack Cornelius proposed openstack/nova master: Implement file backed memory for instances in libvirt  https://review.openstack.org/56787619:33
mriedem1edleafe: i assume https://review.openstack.org/#/c/564641/ and https://review.openstack.org/#/c/562000/ are superseded and can be abandoned now?19:37
*** mriedem1 is now known as mriedem19:37
mriedemi've added the consumer generation bp to the runways queue for completeness19:38
edleafemriedem: yeah, that ship sailed a long time ago.19:40
mriedemack, thanks19:41
openstackgerritMatt Riedemann proposed openstack/nova master: Keep attach_mode as top-level field in _translate_attachment_ref  https://review.openstack.org/57441319:45
*** e0ne has joined #openstack-placement19:49
-openstackstatus- NOTICE: Zuul was restarted for a software upgrade; changes uploaded or approved between 19:30 and 19:50 will need to be rechecked19:57
openstackgerritDan Smith proposed openstack/nova master: Use oslo.messaging per-call monitoring  https://review.openstack.org/56669620:17
openstackgerritDan Smith proposed openstack/nova master: Use oslo.messaging per-call monitoring  https://review.openstack.org/56669621:09
openstackgerritJulia Kreger proposed openstack/nova master: ironic: bugfix: ensure a host is set for volume connectors  https://review.openstack.org/57198221:16
openstackgerritEric Fried proposed openstack/nova master: Direct Placement API: ksa Adapter  https://review.openstack.org/57447021:27
efriedcdent: ^ !21:27
* cdent looks21:28
openstackgerritEric Fried proposed openstack/nova master: Direct Placement API: ksa Adapter  https://review.openstack.org/57447021:31
efriedcdent: Sorry, forgot to commit the last leetle delta, which removed a TODO of yours :)21:31
cdentyou really can't resist nested methods and classes, can you? :)21:32
* cdent sees why21:33
openstackgerritMerged openstack/nova master: Document the internal online_migrations function behaviors  https://review.openstack.org/57426821:35
efriedcdent: You mean the ReportClientInterceptor?21:36
cdentyes21:37
efriedcdent: Yeah, I had it outside at first, but then I had to pass the TestCase (i.e. `self`) from the _interceptor method in order to invoke _set_client, which was icky.21:37
efriedThis isn't non-icky, but I find it *less* icky.21:37
efriedAnd it only needs to be done once, in this place.21:38
cdentyeah, seems good21:39
cdentand overall it seems good21:39
efriedOf course, I could avoid it altogether by doing21:39
efried  with self._interceptor() as client:21:39
efried      self.rt.report_client = client21:39
efried      etc.21:39
efriedeverywhere.  Or refactoring the world to avoid repeating.21:39
* cdent nods21:39
efriedcdent: I figured the biggest selling point for you would be the hard line between placement and nova.  The placement parts of this can live totally in placement post-extract.21:40
cdentyeah, totes21:40
cdentfor reasons unclear the diff is chunked up in a weird ass way21:40
efriedexample?21:40
cdenthttps://review.openstack.org/#/c/574470/2/nova/api/openstack/placement/direct.py21:41
cdentinit is split in half21:42
cdenti can read it just fine, is just annoying21:43
cdentnice work, in any case21:43
cdentcol lab or a tion21:43
efriedcdent: Yeah, it's because previously you were doing the Adapter setup in NoAuthReportClient and the mocking in PlacementDirect; now they're both done in that one init21:44
openstackgerritDan Smith proposed openstack/nova master: Use oslo.messaging per-call monitoring  https://review.openstack.org/56669621:44
openstackgerritEric Fried proposed openstack/nova master: Direct Placement API: ksa Adapter  https://review.openstack.org/57447021:44
efriedcdent: Removed that mock, and another one I missed ^21:44
efriedcdent: If you feel squashing is appropriate and are willing to do that legwork (which I guess is mainly merging the commit messages), I'd be on board.21:46
efriedcdent: I prefer the Adapter-based way, but of course I'm biased.21:46
efriedperhaps it would be prudent to let tests finish up first.  I only ran those three suites.21:47
efriedcdent: btw, I didn't look at all yet, but would it be possible to swap the guts of the gabbi fixture for this?21:47
cdentI'm done for today and will be otherwise engaged into your morning tomorrow so you might be able to beat me to it, but if you don't, I can21:47
efriedack21:48
cdentno, the intercept part of the gabbi fixture is effectively built into gabbi (you give it a wsgi app and that's fine). The meat of those fixtures are setting up database and conf (stuff the nova test bases do, but those fixtures are not based on them) and then doing all the object creation21:49
cdentthose fixtures are also special in that they are per test file, not per test21:49
efriedokay21:49
efriedcdent: btw, I fixed that set_override you noted in the preceding.21:49
efriedseems to work fine21:49
cdentyeah, saw that, good21:50
efriedcdent: I assume that means that, if you want keystone, you can provide a real [api] setup?21:50
efriedoh, nm21:50
efriedset_override, not set_default21:50
cdentefried: simple set of test cleanups, if you're feeling it: https://review.openstack.org/#/c/574403/21:55
efriedcdent: saw those go by, will have a swing at 'em.21:55
cdentthank21:57
cdents21:57
efriedcdent: wanna fix the bp name in the commit messages before I go any further?21:57
efriedcdent: The clickythrough still works to find your blueprint, but I'm sure there's some other accounting that's broken.21:58
efriedLike probably it's not putting these on your whiteboard.21:58
cdentoh noes. yeah. one mo. sigh21:58
*** e0ne has quit IRC21:59
efriedcdent: You can squash all but the last one together too if you like.  I'm gonna fast-approve them.22:00
cdentDid you see my comment (on the first one) for why I didn't squash. There are a lot of conflicting messages on whether to go big or small.22:01
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.test_util  https://review.openstack.org/57440322:01
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.handlers.test_aggregate  https://review.openstack.org/57440422:01
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.test_requestlog  https://review.openstack.org/57440522:01
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.test_fault_wrap  https://review.openstack.org/57440622:01
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.test_handler  https://review.openstack.org/57440722:01
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.test_microversion  https://review.openstack.org/57440822:01
openstackgerritChris Dent proposed openstack/nova master: Do not use nova.test in placement.test_deploy  https://review.openstack.org/57440922:01
efriedcdent: I did see that, but they're all the same except that last one.22:03
efriedcdent: You noted uuidsentinel, but didn't change it.22:03
cdentthat's not true they are more different than that22:03
cdentthere are at least three different styles22:04
efriedwell eff me, maybe I should take another look.22:05
*** nicolasbock has quit IRC22:05
efriedcdent: Guess I'm not seeing it.22:06
cdentdeploy mentions self.flags22:07
efriedRight, I said except the last one.22:07
cdenttest_fault_wrap mentions stderr capture and logging22:07
cdentand then the two other styles are "those that mention uuidsentinel" and "those that don't"22:08
efriedRoger that.22:10
efriedIf anyone's super pissed about the stderr fixture, we can always revert.  I don't think it's worth haggling about rn.22:10
cdentthis has died in test after +W (with real failures) but it's too late for me: https://review.openstack.org/#/c/557958/22:17
cdentgoodight efried, thanks for doing that adapter stuff. onward we go.22:18
efriedcdent: g'night22:18
*** cdent has quit IRC22:19
*** mriedem has quit IRC22:21
*** edmondsw has quit IRC22:47
openstackgerritMatt Riedemann proposed openstack/nova master: Time how long pre_live_migration() takes  https://review.openstack.org/57448123:15
openstackgerritMatt Riedemann proposed openstack/nova master: DNM: test heartbeat code in pre_live_migration  https://review.openstack.org/57448223:15
openstackgerritEric Fried proposed openstack/nova-specs master: Spec: Handling Reshaped Provider Trees  https://review.openstack.org/57258323:19
*** mriedem has joined #openstack-placement23:31
mriedemso, GET /placement/allocations/8fb32554-5bdf-4f3b-979e-8221447f0678" status: 200 len: 19 microversion: 1.12 - if that returns something, it should always include project_id/user_id keys, even if the values are None, right?23:32
mriedemaha23:39
mriedemKeyError: "Missing project_id/user_id in: {u'allocations': {}}"23:39
mriedemWhen listing allocations for a consumer uuid that has no allocations a dict with an empty value is returned {"allocations": {}}."23:39
mriedem^ is confusing23:45
mriedemi.e. if i don't have allocatoins, just return {}?23:46
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Heal allocations with missing/incomplete consumer information  https://review.openstack.org/57448823:48
openstackgerritMerged openstack/nova master: placement: always create consumer records  https://review.openstack.org/56767823:49
*** mriedem has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!