Tuesday, 2018-07-31

*** Kevin_Zheng has joined #openstack-placement00:20
*** edmondsw has joined #openstack-placement00:42
*** edmondsw has quit IRC00:48
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in test_compute_api.py (4)  https://review.openstack.org/56846201:03
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (5)  https://review.openstack.org/57084201:04
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (6)  https://review.openstack.org/57133001:04
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (7)  https://review.openstack.org/57199201:05
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (8)  https://review.openstack.org/57199301:05
openstackgerritMerged openstack/nova master: Retry decorator fix for instances which go into ERROR state during bulk delete  https://review.openstack.org/56341801:20
openstackgerritMerged openstack/nova master: Set default of oslo.privsep.daemon logging to INFO level  https://review.openstack.org/58664302:01
*** diga has joined #openstack-placement03:57
*** mriedem has quit IRC04:49
openstackgerritTetsuro Nakamura proposed openstack/nova master: Enable nested allocation candidates in scheduler  https://review.openstack.org/58567205:02
openstackgerritTetsuro Nakamura proposed openstack/nova master: Functional test for booting with nested resources  https://review.openstack.org/52772805:02
openstackgerritTakashi NATSUME proposed openstack/nova master: Add the guideline to write API reference  https://review.openstack.org/56905805:24
*** tetsuro has quit IRC05:38
openstackgerritTakashi NATSUME proposed openstack/nova master: [placement] api-ref: add traits parameter  https://review.openstack.org/57804805:38
*** tetsuro has joined #openstack-placement05:43
*** e0ne has joined #openstack-placement05:59
openstackgerritChen proposed openstack/nova master: Fix bad links for admin-guide  https://review.openstack.org/58025906:27
*** takashin has left #openstack-placement06:33
*** e0ne has quit IRC06:51
*** peereb has joined #openstack-placement07:10
openstackgerrithuanhongda proposed openstack/nova master: NIT: Delete duplicated word in comments  https://review.openstack.org/58730207:10
*** ttsiouts has joined #openstack-placement07:48
*** cdent has joined #openstack-placement07:55
*** ttsiouts has quit IRC07:59
openstackgerritjichenjc proposed openstack/nova master: remove ec2 object definitions  https://review.openstack.org/55715008:14
openstackgerritjichenjc proposed openstack/nova master: remove ec2 db functions  https://review.openstack.org/55757208:14
*** avolkov has joined #openstack-placement08:22
*** ttsiouts has joined #openstack-placement08:26
*** tssurya has joined #openstack-placement08:26
openstackgerritjichenjc proposed openstack/nova master: add zvm into support matrix  https://review.openstack.org/53272008:28
openstackgerritjichenjc proposed openstack/nova master: Add zvm admin intro and hypervisor information  https://review.openstack.org/53312508:28
openstackgerritjichenjc proposed openstack/nova master: Add zvm CI information  https://review.openstack.org/53351208:28
cdentweird: https://bugs.launchpad.net/nova/+bug/178457708:33
openstackLaunchpad bug 1784577 in OpenStack Compute (nova) "Some allocation candidate tests for sharing providers fail in python 3.6 (and work in python 3.5)" [Medium,Confirmed]08:33
openstackgerritTetsuro Nakamura proposed openstack/nova master: Functional test for booting with nested resources  https://review.openstack.org/52772808:59
openstackgerritTetsuro Nakamura proposed openstack/nova master: Functional test for moving with nested resources  https://review.openstack.org/58735008:59
*** diga has quit IRC09:07
*** e0ne has joined #openstack-placement09:13
gibicdent: could that behavior change caused by that python 3.6+ makes the insertion ordered?09:15
gibis/makes the/makes the dict/09:16
cdentI haven't look closely enough to really know09:16
gibime neither09:17
gibijust guessing09:17
cdentit's a good guess09:21
tetsuroInteresting. Not happy to hear that, though. I'll look into that!09:30
cdenttetsuro: thank you!09:32
*** tetsuro has quit IRC09:57
openstackgerritChris Dent proposed openstack/nova master: [placement] Retry allocation writes server side  https://review.openstack.org/58604809:57
*** ttsiouts has quit IRC10:14
*** ttsiouts has joined #openstack-placement10:19
*** ttsiouts has quit IRC10:24
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Remove redundant join in _anchors_for_sharing_providers  https://review.openstack.org/58737710:31
openstackgerritMerged openstack/nova master: Fix being able to hard reboot a pausing instance  https://review.openstack.org/56614310:32
openstackgerritMerged openstack/nova master: Update install guide for placement database configuration  https://review.openstack.org/57801310:32
openstackgerritLee Yarwood proposed openstack/nova master: fixtures: Track attachments within CinderFixtureNewAttachFlow  https://review.openstack.org/58701310:51
openstackgerritLee Yarwood proposed openstack/nova master: Add regression test for bug#1784353  https://review.openstack.org/58701410:51
openstackgerritLee Yarwood proposed openstack/nova master: WIP compute: Recreate attachments during a reschedule  https://review.openstack.org/58707110:51
*** tetsuro has joined #openstack-placement10:54
*** ttsiouts has joined #openstack-placement10:59
openstackgerritVishakha Agarwal proposed openstack/nova master: 'Updated_at' is NULL when show aggregate info  https://review.openstack.org/58027111:12
cdenttetsuro: you learning anything about that py36 situation?11:44
tetsuroNo, I just reproduced the bug locally just now11:45
tetsurocdent:Did you already get any ideas?11:46
cdentno, I haven't had a chance to look closely. gibi mentioned above about maybe changes in how dicts are handled in 3.6, but not sure.11:46
tetsuroSeems that duplication check I added before is not working.11:48
* cdent nods11:48
cdentwhich is very odd. that it is fragile in the face of version changes suggests there might be something more fundamental wrong :(11:49
tetsuroYou're right the code may be kind of slippy slope... Look into this again to see what I can do to improve.11:50
tetsuroHope this bug is a good bug that lead us to better way to go11:51
cdentwould be great if that's the case11:51
tetsuroAnyway it's time to get out of the office. I'll look into this more closely tomorrow.11:53
cdentthanks very tetsuro11:53
tetsuroThank you, too. Have a good day and night!11:54
openstackgerritLee Yarwood proposed openstack/nova master: fixtures: Track attachments within CinderFixtureNewAttachFlow  https://review.openstack.org/58701312:12
openstackgerritLee Yarwood proposed openstack/nova master: Add regression test for bug#1784353  https://review.openstack.org/58701412:12
openstackgerritLee Yarwood proposed openstack/nova master: WIP compute: Recreate attachments during a reschedule  https://review.openstack.org/58707112:12
openstackgerritMatthew Booth proposed openstack/nova master: Don't poison Host._init_events if it's already mocked  https://review.openstack.org/58574812:17
*** edmondsw has joined #openstack-placement12:24
*** rubasov has quit IRC12:25
*** rubasov has joined #openstack-placement12:25
openstackgerritLajos Katona proposed openstack/osc-placement master: Random names for functional tests  https://review.openstack.org/54274512:47
openstackgerritLenny Verkhovsky proposed openstack/nova master: WIP workaround for RHEL7.5 qemu 2.0  https://review.openstack.org/58740912:56
*** ttsiouts has quit IRC13:01
*** ttsiouts has joined #openstack-placement13:01
*** ttsiouts has quit IRC13:04
*** ttsiouts has joined #openstack-placement13:04
*** mriedem has joined #openstack-placement13:05
openstackgerritBalazs Gibizer proposed openstack/nova master: Improve NeutronFixture and remove unncessary stubbing  https://review.openstack.org/58741213:10
openstackgerritsahid proposed openstack/nova master: hardware: fix memory check usage for small/large pages  https://review.openstack.org/53216813:25
openstackgerritMatthew Booth proposed openstack/nova master: Ensure attachment cleanup on failure in driver.pre_live_migration  https://review.openstack.org/58743913:45
mriedemcdent: re the 'RT hits placement a lot' thread, we still have https://bugs.launchpad.net/nova/+bug/1742467 and i think it still applies since compute isn't shared provider aware,14:07
openstackLaunchpad bug 1742467 in OpenStack Compute (nova) "Compute unnecessarily gets resource provider aggregates during every update_available_resource run" [Medium,Triaged]14:07
mriedemalthough UPT will still pull all aggregates on each call right?14:07
cdentyeah, but if we could get down to once a periodic that would be nice14:07
cdentthis https://review.openstack.org/#/c/587050/ didn't blow up spectactularly14:08
cdentI was hoping it might, so as to learn something14:08
* efried not terribly surprised ^14:09
openstackgerritBalazs Gibizer proposed openstack/nova master: Improve NeutronFixture and remove unncessary stubbing  https://review.openstack.org/58741214:16
openstackgerritBalazs Gibizer proposed openstack/nova master: Remove unnecessary PlacementFixture setups  https://review.openstack.org/58749014:34
openstackgerritsean mooney proposed openstack/nova master: libvirt: fix disk_bus handling for root disk  https://review.openstack.org/58499914:52
openstackgerritMerged openstack/nova master: Remove superfluous network stubbing in func test  https://review.openstack.org/58713414:54
*** peereb has quit IRC15:06
openstackgerritMerged openstack/nova master: Fix formatting for vcpu_pin_set and reserved_huge_pages  https://review.openstack.org/58720615:13
openstackgerritMerged openstack/nova master: [placement] api-ref: add traits parameter  https://review.openstack.org/57804815:13
*** e0ne has quit IRC15:23
openstackgerritMatt Riedemann proposed openstack/nova master: Handle binding_failed vif plug errors on compute restart  https://review.openstack.org/58749815:24
openstackgerritMerged openstack/nova stable/queens: Disable limits if force_hosts or force_nodes is set  https://review.openstack.org/58461615:29
openstackgerritMerged openstack/nova stable/queens: Add functional regressions tests for server_group_members OverQuota  https://review.openstack.org/58184515:29
openstackgerritSurya Seetharaman proposed openstack/nova master: Cleanup comp_node, res_prov, services, aggregate_hosts during cell deletion  https://review.openstack.org/54666015:43
openstackgerritSurya Seetharaman proposed openstack/nova master: Cleanup comp_node, res_prov, services, aggregate_hosts during cell deletion  https://review.openstack.org/54666015:45
openstackgerritJay Pipes proposed openstack/nova master: track down why inventory placement calls multiply  https://review.openstack.org/58751016:01
openstackgerritJay Pipes proposed openstack/nova master: track down why inventory placement calls multiply  https://review.openstack.org/58751016:02
cdentjaypipes: that looks like it is duplicating the analysis that I did in my blog post. I list out the order of the method calls on what is getting inventory. all four in one periodic job are explained16:08
cdentoh, wait, this is better16:08
cdentcarry on16:08
cdentno, I don't know. I'm confused.16:09
cdentjaypipes: is there an issue with PUTs multiplying?16:12
*** rubasov has quit IRC16:13
jaypipescdent: it's totally just an exploratory thing... I'm curious where all the calls are coming from and just added that log message because I'm looking into it.16:18
cdentjaypipes: I'm curious to know what you find out. I've not seen much duplication on write ops, just read16:18
efriedcdent: Ought we to duplicate nova's cors gabbits into placement with https://review.openstack.org/#/c/587183/ ?16:22
efriedcdent: Disregard.16:23
cdentefried: I'm confused, nova doesn't use gabbits, those are placements gabbits, but they don't exercise that code16:23
efriedyeah, forget I said anything.16:23
cdentrogher16:23
*** tssurya has quit IRC16:32
*** yikun has quit IRC16:47
*** ttsiouts has quit IRC16:48
*** ttsiouts has joined #openstack-placement16:48
openstackgerritBalazs Gibizer proposed openstack/nova master: Use placement 1.28 in scheduler report client  https://review.openstack.org/58366716:52
*** ttsiouts has quit IRC16:53
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Remove usage of migrateToURI{2} APIs  https://review.openstack.org/56725816:58
openstackgerritmelanie witt proposed openstack/nova master: Don't overwrite greenthread-local context in host manager  https://review.openstack.org/58233217:14
*** e0ne has joined #openstack-placement17:52
openstackgerritMerged openstack/nova stable/queens: Fix TypeError in prep_resize allocation cleanup  https://review.openstack.org/58174118:28
openstackgerritMerged openstack/nova master: [placement] Retry allocation writes server side  https://review.openstack.org/58604818:28
openstackgerritMerged openstack/nova master: Remove redundant join in _anchors_for_sharing_providers  https://review.openstack.org/58737718:28
openstackgerritMerged openstack/nova stable/queens: Handle HostMappingNotFound when deleting a compute service  https://review.openstack.org/58356618:28
openstackgerritMerged openstack/nova master: Don't poison Host._init_events if it's already mocked  https://review.openstack.org/58574818:28
efriedcdent: As I'm working the tests for the last reshaper patch, I'm discovering more about the repetition of placement-ish stuff.18:47
cdentoh aye?18:47
efriedI'm sure this was already clear in your head, but _init_compute_host does all the same shit that _update does.18:47
efriedin fact the former calls the latter.18:47
cdentyes18:47
cdentthat's what I said in my email/blog post18:47
efriedI'm certain it is :)18:47
efriedso18:48
efriedtake a look at this:18:48
efriedhttps://review.openstack.org/#/c/576236/18/nova/compute/resource_tracker.py@71018:48
efriedWhat if we wrapped _init_compute_node in `if startup:` ?18:49
efriedCause assuming the method name and the comment are at all accurate/complete, it should only be necessary on startup, nah?18:49
cdentyou'd think so, but when I did this analysis the first time around febish 2017, it was not at all clear that the method name was true at all and I couldn't figure it out on my lonesome18:50
cdentwe talked about digging deeper and then got distracted18:50
efriedyeah, looking at _init_compute_node, it does a lot of stuffs that don't look init-ish.18:51
efriedokay, _setup_pci_tracker is already a singleton, so that can go.18:52
efriedso the only thing left is this _copy_resources thing.18:52
openstackgerritMerged openstack/nova stable/queens: unquiesce instance after quiesce failure  https://review.openstack.org/58145118:53
cdentefried: have you already had a gander at https://review.openstack.org/#/c/587050/ ? I assume based on your early "not surprised" comment18:53
efriedand that comes from the virt driver's get_available_resource; so it needs to be done on periodic.18:53
efriedcdent: Yes, I checked that before I pinged you.18:53
cdent18:54
efriedI had looked at it before and understood what it was doing, but hadn't put it fully into context until I got into the aforementioned testing.18:54
efriedcdent: I'm gonna put this out there as an idea:18:55
efriedWe pull copy_resources out of _init_compute_node and instead do it in _update_available_resource; *and* we condition _init_compute_node with `if startup:`.18:55
* cdent holds breath18:55
efriedThe latter has been nonobvious outside the context of the reshaper patch because percolating the `startup` param down the call stack was nontrivial. But with that in place, ^ might make sense.18:56
cdentI agree that it feels right. Hard to say if it is actualy right.18:56
efriedOnce I'm at a stopping point with the tests I'm writing, I'll propose a patch on top that does this and see if the world blows to smithereens.18:57
cdentcool sounds great18:57
efriedor as my friend's kid says, to submarines.18:57
*** tssurya has joined #openstack-placement18:58
cdentit would be great if not blowing to smithereens inspired huge confidence18:58
cdentwe need some Marko Ramius18:59
cdentmelwitt, mriedem : cool to backport https://review.openstack.org/#/c/586048/ (server-side allocation rewrites) to queens?19:02
cdentIt will conflict, but mostly because of moved files.19:02
*** e0ne has quit IRC19:06
mriedemcdent: without looking at the details of the change, it seems ok, i know it's a problem19:08
melwittcdent: problem only goes back to queens, right?19:08
mriedemi'd probably want some burn in time before we start merging it in stable though19:08
mriedemit goes all the way back i think19:08
melwittoh ok19:09
mriedemwell, pike19:09
mriedemwhen the scheduler starting doing claims19:09
mriedem*started19:09
cdentI'll keep tabs on it19:11
* cdent retires19:14
cdentgood night all19:14
*** cdent has quit IRC19:14
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Add functional scale test for Stats.__deepcopy__ time  https://review.openstack.org/58760619:19
*** e0ne has joined #openstack-placement19:48
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Add recreate test for bug 1784705  https://review.openstack.org/58761420:04
openstackbug 1784705 in OpenStack Compute (nova) "ResourceTracker.stats can leak across multiple ironic nodes" [High,Triaged] https://launchpad.net/bugs/178470520:04
*** avolkov has quit IRC20:10
openstackgerritsean mooney proposed openstack/nova master: libvirt: fix disk_bus handling for root disk  https://review.openstack.org/58499920:41
openstackgerritsean mooney proposed openstack/nova master: add regression test for bug 1759420  https://review.openstack.org/58761520:41
openstackbug 1759420 in OpenStack Compute (nova) "nova does not correctly support HW_DISK_BUS=sata or usb for kvm/qemu" [Medium,In progress] https://launchpad.net/bugs/1759420 - Assigned to sean mooney (sean-k-mooney)20:41
*** e0ne has quit IRC20:51
*** edmondsw has quit IRC21:00
*** edmondsw has joined #openstack-placement21:01
*** edmondsw has quit IRC21:01
*** edmondsw has joined #openstack-placement21:01
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Add recreate test for bug 1784705  https://review.openstack.org/58761421:31
openstackgerritMatt Riedemann proposed openstack/nova master: Make ResourceTracker.stats node-specific  https://review.openstack.org/58763621:31
openstackbug 1784705 in OpenStack Compute (nova) queens "ResourceTracker.stats can leak across multiple ironic nodes" [High,Triaged] https://launchpad.net/bugs/178470521:31
openstackgerritMatt Riedemann proposed openstack/nova master: Add recreate test for RT.stats bug 1784705  https://review.openstack.org/58761422:10
openstackgerritMatt Riedemann proposed openstack/nova master: Make ResourceTracker.stats node-specific  https://review.openstack.org/58763622:10
openstackbug 1784705 in OpenStack Compute (nova) "ResourceTracker.stats can leak across multiple ironic nodes" [High,In progress] https://launchpad.net/bugs/1784705 - Assigned to Matt Riedemann (mriedem)22:10
*** mriedem has quit IRC22:14
*** edmondsw has quit IRC22:23
*** edmondsw has joined #openstack-placement22:23
*** edmondsw has quit IRC22:30
*** edmondsw has joined #openstack-placement22:31
openstackgerritEric Fried proposed openstack/nova master: WIP: Compute: Handle reshaped provider trees  https://review.openstack.org/57623622:34
*** tssurya has quit IRC22:46
openstackgerritMerged openstack/nova master: Remove unnecessary PlacementFixture setups  https://review.openstack.org/58749023:00
*** edmondsw has quit IRC23:11

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!