Wednesday, 2019-05-22

*** rchurch has joined #openstack-nova00:01
*** gyee has quit IRC00:10
*** hamzy has joined #openstack-nova00:10
*** altlogbot_2 has quit IRC00:10
*** altlogbot_0 has joined #openstack-nova00:12
*** frankwang has quit IRC00:14
*** frankwang has joined #openstack-nova00:17
*** rcernin has quit IRC00:21
*** rcernin has joined #openstack-nova00:21
*** tbachman has joined #openstack-nova00:22
*** ttsiouts has quit IRC00:28
*** frankwang is now known as frank00:32
*** frank is now known as frank_100:32
*** igordc has quit IRC00:36
*** _alastor_ has quit IRC00:37
*** brinzhang has joined #openstack-nova00:43
*** ttsiouts has joined #openstack-nova00:44
*** jamesdenton has joined #openstack-nova00:44
*** ttsiouts has quit IRC00:49
openstackgerritGuo Jingyu proposed openstack/nova master: Skip existing VMs when hosts apply force_config_drive  https://review.opendev.org/65970301:09
*** _alastor_ has joined #openstack-nova01:17
*** betherly has quit IRC01:17
*** ttsiouts has joined #openstack-nova01:17
*** rcernin has quit IRC01:22
*** ttsiouts has quit IRC01:22
*** rcernin has joined #openstack-nova01:22
*** _alastor_ has quit IRC01:23
*** _alastor_ has joined #openstack-nova01:31
*** _alastor_ has quit IRC01:45
*** ttsiouts has joined #openstack-nova01:48
*** tbachman has quit IRC02:06
*** awalende has joined #openstack-nova02:09
*** awalende has quit IRC02:13
*** bbowen_ has quit IRC02:16
*** bbowen_ has joined #openstack-nova02:16
*** ttsiouts has quit IRC02:22
*** ykarel|away has joined #openstack-nova02:24
*** tbachman has joined #openstack-nova02:26
*** tbachman has quit IRC02:30
*** cfriesen has quit IRC02:34
*** ricolin has joined #openstack-nova02:44
*** nicolasbock has quit IRC02:45
*** bbowen_ has quit IRC02:53
*** boxiang has joined #openstack-nova03:02
*** tbachman has joined #openstack-nova03:04
openstackgerritMerged openstack/nova-specs master: Support server power state update through external event  https://review.opendev.org/63613203:05
*** frank_1 has quit IRC03:11
*** frank_1 has joined #openstack-nova03:12
*** boxiang has quit IRC03:15
*** _alastor_ has joined #openstack-nova03:19
*** whoami-rajat has joined #openstack-nova03:20
*** _alastor_ has quit IRC03:28
*** _alastor_ has joined #openstack-nova03:28
openstackgerritMerged openstack/nova stable/stein: Fix assert methods in unit tests  https://review.opendev.org/65770803:31
*** ttsiouts has joined #openstack-nova03:31
*** _alastor_ has quit IRC03:37
*** _alastor_ has joined #openstack-nova03:37
*** psachin has joined #openstack-nova03:38
*** _alastor_ has quit IRC03:46
*** tbachman_ has joined #openstack-nova03:53
*** tbachman has quit IRC03:53
*** tbachman has joined #openstack-nova03:55
*** itlinux has joined #openstack-nova03:55
*** tbachman_ has quit IRC03:57
*** ykarel|away is now known as ykarel03:58
*** ttsiouts has quit IRC04:05
*** tbachman has quit IRC04:11
*** udesale has joined #openstack-nova04:11
*** markvoelker has joined #openstack-nova04:14
*** markvoelker has quit IRC04:18
*** ivve has quit IRC04:26
*** slaweq has joined #openstack-nova04:40
*** _alastor_ has joined #openstack-nova04:49
*** ykarel has quit IRC04:53
*** _alastor_ has quit IRC04:57
*** _alastor_ has joined #openstack-nova04:58
*** itlinux has quit IRC05:06
*** _alastor_ has quit IRC05:07
*** ykarel has joined #openstack-nova05:11
*** ttsiouts has joined #openstack-nova05:11
openstackgerritAbhishek Kekane proposed openstack/nova-specs master: Support multiple store of Glance  https://review.opendev.org/64121005:18
*** dpawlik has joined #openstack-nova05:18
*** ratailor has joined #openstack-nova05:20
openstackgerritBoxiang Zhu proposed openstack/nova-specs master: Update "add host and hypervisor_hostname flag to create server" spec  https://review.opendev.org/66056005:21
*** ajo has quit IRC05:27
*** jrosser has quit IRC05:29
*** rm_work has quit IRC05:31
*** dustinc has quit IRC05:31
*** ajo has joined #openstack-nova05:33
*** jrosser has joined #openstack-nova05:34
*** dustinc has joined #openstack-nova05:34
*** rm_work has joined #openstack-nova05:34
*** ivve has joined #openstack-nova05:39
*** lpetrut has joined #openstack-nova05:40
*** imacdonn has quit IRC05:41
*** imacdonn has joined #openstack-nova05:41
*** boxiang has joined #openstack-nova05:43
*** guozijn has joined #openstack-nova05:44
*** ttsiouts has quit IRC05:45
boxiangalex_xu: hi alex, if it's convenient of you, please take a look at this updated spec https://review.opendev.org/#/c/660560/105:47
boxiangyou can find some comments here https://review.opendev.org/#/c/645520/19/nova/compute/api.py@98105:47
boxiangthank you :)05:47
boxiangif others here, welcome :)05:48
*** ivve has quit IRC05:54
*** Luzi has joined #openstack-nova06:00
*** guozijn_ has joined #openstack-nova06:05
*** guozijn has quit IRC06:07
*** guozijn_ is now known as guozijn06:08
*** ttsiouts has joined #openstack-nova06:14
*** markvoelker has joined #openstack-nova06:15
*** ttsiouts has quit IRC06:18
*** tetsuro has joined #openstack-nova06:18
*** dpawlik has quit IRC06:27
*** janki has joined #openstack-nova06:27
*** dtantsur|afk is now known as dtantsur06:28
*** Luzi_ has joined #openstack-nova06:33
*** liuyulong has quit IRC06:38
*** Luzi_ has quit IRC06:41
*** liuyulong has joined #openstack-nova06:47
*** markvoelker has quit IRC06:49
*** ttsiouts has joined #openstack-nova06:53
*** maciejjozefczyk has joined #openstack-nova06:55
*** frank_wang has joined #openstack-nova06:56
*** frank_1 has quit IRC07:00
*** ralonsoh has joined #openstack-nova07:02
*** ralonsoh has quit IRC07:03
*** ralonsoh has joined #openstack-nova07:03
*** _alastor_ has joined #openstack-nova07:04
*** tssurya has joined #openstack-nova07:12
*** _alastor_ has quit IRC07:12
*** _alastor_ has joined #openstack-nova07:13
*** boxiang has quit IRC07:16
*** awalende has joined #openstack-nova07:17
*** pcaruana has joined #openstack-nova07:17
*** tesseract has joined #openstack-nova07:18
openstackgerritYongli He proposed openstack/nova-specs master: add spec "show-server-numa-topology"  https://review.opendev.org/65871607:19
*** rpittau|afk is now known as rpittau07:19
*** _alastor_ has quit IRC07:21
openstackgerritzhaixiaojun proposed openstack/nova master: Update description of valid whitelist for non-admin user  https://review.opendev.org/64240307:24
*** ttsiouts has quit IRC07:26
*** guozijn_ has joined #openstack-nova07:27
*** guozijn has quit IRC07:27
*** guozijn_ is now known as guozijn07:27
*** luksky has joined #openstack-nova07:29
*** helenafm has joined #openstack-nova07:32
*** guozijn has quit IRC07:32
*** boxiang_ has joined #openstack-nova07:32
*** guozijn has joined #openstack-nova07:42
*** luksky has quit IRC07:42
*** markvoelker has joined #openstack-nova07:46
*** ttsiouts has joined #openstack-nova07:46
*** ykarel is now known as ykarel|lunch07:52
*** jangutter has joined #openstack-nova07:56
*** luksky has joined #openstack-nova07:57
*** ociuhandu has quit IRC08:00
*** ociuhandu has joined #openstack-nova08:02
*** jangutter has quit IRC08:03
*** dpawlik has joined #openstack-nova08:08
*** jangutter has joined #openstack-nova08:08
*** guozijn_ has joined #openstack-nova08:11
*** jangutter has quit IRC08:13
*** guozijn has quit IRC08:14
*** guozijn_ is now known as guozijn08:14
*** mdbooth has quit IRC08:18
*** markvoelker has quit IRC08:18
*** jangutter has joined #openstack-nova08:20
*** tkajinam has quit IRC08:21
*** ccamacho has joined #openstack-nova08:23
*** ykarel|lunch is now known as ykarel08:38
*** mdbooth has joined #openstack-nova08:44
openstackgerritLee Yarwood proposed openstack/nova master: Block swap volume on volumes with >1 rw attachment  https://review.opendev.org/57279008:47
lyarwoodstephenfin: ^ updated the releasenote, can't seem to build it locally but that appears to be an issue with f2908:47
*** luksky has quit IRC08:48
*** tetsuro has quit IRC08:49
*** sapd1_x has joined #openstack-nova08:50
*** panda is now known as panda|rover08:50
*** derekh has joined #openstack-nova08:51
*** priteau has joined #openstack-nova08:55
*** ttsiouts has quit IRC08:57
stephenfinlyarwood: Ta. It reads rather oddly though. Can you take one more swing at it (comments left)?09:02
*** davidsha has joined #openstack-nova09:02
lyarwoodstephenfin: yeah of course09:04
openstackgerritLee Yarwood proposed openstack/nova master: Block swap volume on volumes with >1 rw attachment  https://review.opendev.org/57279009:07
lyarwoodstephenfin: words-- ^ there you go.09:07
openstackgerritStephen Finucane proposed openstack/nova master: Block swap volume on volumes with >1 rw attachment  https://review.opendev.org/57279009:09
stephenfinThanks09:09
openstackgerritStephen Finucane proposed openstack/nova master: Keep attach_mode as top-level field in _translate_attachment_ref  https://review.opendev.org/57441309:09
lyarwoodhaha fs, sorry09:10
*** rcernin has quit IRC09:10
*** markvoelker has joined #openstack-nova09:15
*** _alastor_ has joined #openstack-nova09:18
*** luksky has joined #openstack-nova09:22
*** _alastor_ has quit IRC09:27
*** bhagyashris has joined #openstack-nova09:28
*** bhagyashris has quit IRC09:29
*** cdent has joined #openstack-nova09:39
*** ricolin has quit IRC09:40
*** lifeless_ is now known as lifeless09:46
*** markvoelker has quit IRC09:49
openstackgerritBoxiang Zhu proposed openstack/nova-specs master: Update "add host and hypervisor_hostname flag to create server" spec  https://review.opendev.org/66056009:50
stephenfinbauzas: Wanna help remove nearly 13,000 lines of dead code? :) https://review.opendev.org/#/q/topic:bp/remove-cells-v1+status:open (ignore the ones in merge conflict, obviously)09:50
openstackgerritStephen Finucane proposed openstack/nova master: Stop handling 'InstanceUnknownCell' exception  https://review.opendev.org/65130710:01
openstackgerritStephen Finucane proposed openstack/nova master: Remove unnecessary wrapper  https://review.opendev.org/65130810:01
openstackgerritStephen Finucane proposed openstack/nova master: db: Remove cell APIs  https://review.opendev.org/65130910:01
openstackgerritStephen Finucane proposed openstack/nova master: conf: Remove cells v1 options, group  https://review.opendev.org/65131010:01
*** ttsiouts has joined #openstack-nova10:05
openstackgerritMerged openstack/nova stable/stein: Add regression test for bug 1825034  https://review.opendev.org/65742010:08
openstackbug 1825034 in OpenStack Compute (nova) stein "listing deleted servers from the API fails after running fill_virtual_interface_list online data migration" [High,In progress] https://launchpad.net/bugs/1825034 - Assigned to Matt Riedemann (mriedem)10:08
openstackgerritStephen Finucane proposed openstack/nova master: Remove cells v1 parameter from 'ComputeTaskAPI.resize_instance'  https://review.opendev.org/65131110:09
*** boxiang_ has quit IRC10:11
*** guozijn has quit IRC10:29
*** gibi_off is now known as gibi10:32
*** ttsiouts has quit IRC10:34
*** sridharg has joined #openstack-nova10:37
*** markvoelker has joined #openstack-nova10:46
*** luksky has quit IRC10:47
*** _alastor_ has joined #openstack-nova10:47
* gibi is back from pto10:52
*** _alastor_ has quit IRC10:55
*** _alastor_ has joined #openstack-nova10:56
*** toabctl has joined #openstack-nova10:58
*** nicolasbock has joined #openstack-nova11:06
*** _alastor_ has quit IRC11:09
*** _alastor_ has joined #openstack-nova11:10
*** ykarel is now known as ykarel|afk11:12
cdentwelcome back gibi11:13
gibicdent: thanks11:13
*** panda|rover is now known as panda|rover|eat11:16
*** guozijn has joined #openstack-nova11:17
*** luksky has joined #openstack-nova11:18
*** _alastor_ has quit IRC11:18
*** markvoelker has quit IRC11:18
*** udesale has quit IRC11:30
*** udesale has joined #openstack-nova11:31
*** ttsiouts has joined #openstack-nova11:41
*** _erlon_ has joined #openstack-nova11:45
*** maciejjozefczyk has quit IRC11:51
openstackgerritHamdy Khader proposed openstack/os-vif master: OVS DPDK port representors support  https://review.opendev.org/65878612:01
*** panda|rover|eat is now known as panda|rover12:06
*** johnthetubaguy has joined #openstack-nova12:06
*** eharney has quit IRC12:10
*** ttsiouts has quit IRC12:11
*** itlinux has joined #openstack-nova12:12
*** itlinux has quit IRC12:12
openstackgerritJean-Philippe Evrard proposed openstack/nova master: [Docs] Fix minor typo  https://review.opendev.org/66069612:12
*** markvoelker has joined #openstack-nova12:16
*** ykarel|afk is now known as ykarel12:18
*** bbowen has joined #openstack-nova12:22
sean-k-mooneystephenfin: bauzas can ye add https://review.opendev.org/#/c/653506/ to your review queue12:25
bauzasmmm ok12:25
*** psachin has quit IRC12:27
*** markvoelker has quit IRC12:29
sean-k-mooneyalex_xu: not sure if you usually review networking/libvirt livemigrtaion stuff but https://review.opendev.org/#/c/653506/ might be in your area too.12:31
*** yonglihe has quit IRC12:32
* sean-k-mooney misses jaypipes12:32
*** janki has quit IRC12:35
*** abhi89 has joined #openstack-nova12:45
abhi89HI.. i am getting this error in my logs..12:46
abhi89The [cinder] section of your nova configuration file must be configured for authentication with the block-storage service endpoint.: InstanceNotFound: Instance 50C28C76-6E6B-4BF0-8291-FBD8C176B9B2 could not be found.12:46
abhi89it is coming from12:46
abhi89File "/usr/lib/python2.7/dist-packages/nova/volume/cinder.py", line 78, in _load_auth_plugin12:46
abhi892019-05-06 08:58:32.792 123932 ERROR nova.compute.manager [instance: 50c28c76-6e6b-4bf0-8291-fbd8c176b9b2]     raise cinder_exception.Unauthorized(401, message=err_msg)12:46
openstackgerritSilvan Kaiser proposed openstack/nova stable/stein: Exec systemd-run without --user flag in Quobyte driver  https://review.opendev.org/66070512:47
*** itlinux has joined #openstack-nova12:47
openstackgerritSilvan Kaiser proposed openstack/nova stable/stein: Added mount fstype based validation of Quobyte mounts  https://review.opendev.org/66070612:48
abhi89this is very rare.. can anyone help me here to understand do we really need to add 'auth' in [cinder] section of nova.conf..? because without this also deploys work fine12:48
efriedabhi89: What release are you on?12:54
abhi89efried: stein12:54
*** ricolin has joined #openstack-nova12:55
efriedabhi89: Do you have a message about "Unknown auth type"?12:55
efried(from line 77)12:56
alex_xusean-k-mooney: not too much, but have involve lm for the lm with numa patche, anyway I will put that to my review list, give a try12:56
abhi89efried: yes..  Unauthorized: Unknown auth type: None (HTTP 401)12:56
sean-k-mooneyalex_xu: no worries12:56
efriedabhi89: Do you have service_auth set up?12:57
*** itlinux has quit IRC12:57
abhi89efried: service_auth? where?12:58
efriedabhi89: https://docs.openstack.org/nova/stein/configuration/config.html#service-user13:00
*** mlavalle has joined #openstack-nova13:00
efriedYou're saying the symptom is rare, which leads me to suspect it's happening over long-running operations when your user token is expiring. That's what service auth was designed for. If you configure this, it wraps your user token in a service token so that when your user token expires, subsequent operations in that thread will still succeed (using the service token).13:01
efriedThe way it's manifesting is odd, though. That code path should only be happening under admin context.13:02
*** tbachman has joined #openstack-nova13:03
abhi89efried: hmm.. let me try adding service_auth section to nova.conf.. thanks for the info..13:05
*** tbachman_ has joined #openstack-nova13:05
efriedabhi89: That's probably not it.13:05
efriedit's probably I3c35bba43fee81baebe8261f546c1424ce3a338313:05
*** brinzhang has quit IRC13:06
efriedabhi89: https://review.opendev.org/#/c/522112/13:06
efriedread the commit message and the bugs tagged there...13:06
*** igordc has joined #openstack-nova13:06
efriedif you've got a situation similar to what's described, then you *do* need to set up admin auth for cinder to resolve it.13:06
*** tbachman has quit IRC13:08
*** tbachman_ is now known as tbachman13:08
efriedstephenfin, cdent: What's the thing that has to be in place for Depends-On to work? Something tox something sibling? Specifically, is that currently set up to work from nova to os-traits?13:09
cdentit is not set up for os-traits unless add a required-project of openstack/os-traits13:09
*** priteau has quit IRC13:09
cdent(to the zuul job config)13:09
openstackgerritEric Fried proposed openstack/nova master: Support old & new versions of svm and avx traits  https://review.opendev.org/66051513:10
efriedo13:10
abhi89efried: ok.. let me check on that..13:10
efriedcdent: for the base job?13:11
sean-k-mooneycadding os-traits to the required projects will add it to LIB_FROM_GIT and cause the zuul clone to prepar it in the workspace13:11
sean-k-mooneybut that will result in the job running with master of os-tratis13:11
sean-k-mooneynot the releaded version13:11
sean-k-mooneyso we normally dont want that to be the case13:11
efriedmm13:11
cdentsean-k-mooney: why not?13:11
efriedbecause we would get false positives13:11
cdentmeh13:12
sean-k-mooneycdent: because we wont be testing with the released version or the version listed in upperconstriats13:12
*** mlavalle has quit IRC13:12
sean-k-mooneyso we wont be testing with what people actullly will be deploying13:12
efriedright13:12
efriedand that would be bad.13:12
sean-k-mooneywe could do it in nova-next or a specific job13:12
* cdent does not like/agree/something upperconstraints13:12
sean-k-mooneywe just dont wnat to do that in all jobs13:13
cdentor constraints in general13:13
sean-k-mooneycdent: do you use arch13:13
cdenthell, I'm going the whole way: I don't like13:13
*** itlinux has joined #openstack-nova13:13
* cdent avoids this trap13:13
aarentsefried: Hi, about https://review.opendev.org/#/c/659054 I had to rebase, it is ok now, can you have a look on it please?13:14
sean-k-mooneyhehe look im fine with deploying with os-traits from master as long as we have at least one job that is testing the released version13:14
*** mriedem has joined #openstack-nova13:14
sean-k-mooneymaybe there is a feature request here to zuul for a way to add peoject dynamiclaly  per patch13:15
*** _alastor_ has joined #openstack-nova13:15
efriedsean-k-mooney: ^ this13:15
sean-k-mooneye.g. Depends-on: xyw  Require: openstack/os-traits13:15
efriedooo13:15
sean-k-mooneythat said we still would not want to merge the patch without the release so not sure how useful that is13:16
efriedAs it stands, I have to hand-edit .zuul.yaml. And for inherited jobs/templates, I would have to write whole derived jobs for them.13:16
efriedsean-k-mooney: It's useful for me to validate that my patch is correct.13:16
efriedBecause as always I don't want to run all of the nova unit test and functional suites locally.13:16
sean-k-mooneyefried: right but outside of that not sure.13:17
sean-k-mooneyefried: i recently set up rtox to run my unit tests over ssh on my desktop. they now take ~ 2 mins to run13:17
efriedSure, outside of that it's not very helpful, and needs to be negated once the dep merges, so I can't accidentally merge that patch.13:17
efriedaarents: looking...13:18
sean-k-mooneyefried: it woudl be useful for test only patch on top of the actul change13:18
sean-k-mooney*test only -> DNM13:18
*** ttsiouts has joined #openstack-nova13:19
cdentefried: clone yourself and fix the core problem: tests are too slow13:19
*** itlinux has quit IRC13:20
mriedemthis contributes to ^ https://bugs.launchpad.net/nova/+bug/182989613:20
openstackLaunchpad bug 1829896 in OpenStack Compute (nova) "libvirt: "Instance failed to shutdown in 60 seconds." in the gate" [Undecided,New]13:20
sean-k-mooneycdent: not if you throw 48 cores at them13:20
cdent48!? luxury13:21
sean-k-mooneycdent: the full nova py37 tox env takes 72 seconds to run on my desktop or about 2 minutes totoal when you account for the tox startup time and report generation13:21
cdenttry the placement tests, I suspect you will go backwards in time13:22
sean-k-mooneycdent: i decomisined the tower server i baught do some ci13:22
*** dave-mccowan has joined #openstack-nova13:23
*** _alastor_ has quit IRC13:24
sean-k-mooney======13:24
sean-k-mooneyTotals13:24
sean-k-mooney======13:24
sean-k-mooneyRan: 152 tests in 0.7772 sec.13:24
sean-k-mooney - Passed: 15213:24
sean-k-mooney - Skipped: 013:24
sean-k-mooney - Expected Fail: 013:24
sean-k-mooney - Unexpected Success: 013:24
sean-k-mooney - Failed: 013:24
sean-k-mooneySum of execute time for each test: 0.4916 sec.13:24
sean-k-mooneynot quite13:24
sean-k-mooneyand the time output13:25
sean-k-mooneyreal 0m5.681s13:25
sean-k-mooneyuser 1m33.494s13:25
sean-k-mooneysys 0m9.505s13:25
sean-k-mooneythat said before i got that working yesterday i would agree way to slow13:26
gibihehe this rtox python package implements what I have in bash for years. I independently named that bash script 'rtox'13:28
openstackgerritEric Fried proposed openstack/nova master: WIP: Support old & new versions of svm and avx traits  https://review.opendev.org/66051513:29
*** dtantsur is now known as dtantsur|brb13:29
efriediiuc, ^ stands a chance of passing functional and tempest, but will still fail unit.13:29
*** READ10 has joined #openstack-nova13:30
efriedwhich does kind of defeat the purpose, as it's unit tests I've changed.13:30
sean-k-mooneygibi: ya im proably goign to stop using it. the python version takes way to long to actully output to stdout13:30
efriedThe tests I changed succeed locally though. shrug.13:31
sean-k-mooneyefried: wait why are we reported avx and svm in a vendor speficic way13:31
sean-k-mooneyoh we are not at least for AVX13:32
efriedbecause they're vendor-specific flags13:32
sean-k-mooneyefried: you ment VMX not AVX13:33
efriedpoint is, we weren't, but we should have been, so now we are.13:33
efriedoh, did I misspell something?  :P13:33
sean-k-mooney:)13:33
openstackgerritEric Fried proposed openstack/nova master: WIP: Support old & new versions of svm and vmx traits  https://review.opendev.org/66051513:34
efriedthanks sean-k-mooney, nice catch13:34
sean-k-mooneyare the only spelling mistakes i can spot instruction sets?13:34
efriedI'll take it.13:34
efriedwe have plenty of other anal-retentive people to catch the rest.13:34
efriedcommunity development ftw13:35
sean-k-mooneythat was more a self commentry on how deep the intel brainwashing must have penetrated :P13:35
*** tbachman has quit IRC13:35
sean-k-mooneyit bypassed my in ability to spell and inserted an instruction set filter into my brain lol13:36
*** eharney has joined #openstack-nova13:36
efriedaarents: I feel like I must be forgetting some background on https://review.opendev.org/#/c/659054/13:39
efriedpieces of this look vaguely familiar. Have we talked about this before?13:39
efriedI can see I've not been on the review itself...13:39
*** dave-mccowan has quit IRC13:40
stephenfinefried: I assume you got sorted? I'm knee deep in crappy unit tests atm :)13:40
efriedstephenfin: Yes thanks.13:40
efriedgot an answer anyway, if not sorted how I would like.13:41
*** ratailor has quit IRC13:41
*** awalende has quit IRC13:43
*** awalende has joined #openstack-nova13:43
*** liuyulong has quit IRC13:46
*** liuyulong has joined #openstack-nova13:46
*** abhi89 has quit IRC13:47
*** awalende has quit IRC13:48
*** boxiang has joined #openstack-nova13:49
*** hemna has joined #openstack-nova13:51
*** igordc has quit IRC13:51
*** hemna has quit IRC13:52
*** ttsiouts has quit IRC13:53
*** boxiang has quit IRC13:53
dansmithmriedem: do we still have a job that does a full archive after tempest?13:54
dansmithI see mention in nova-next, but not sure where it's called13:56
sean-k-mooneyas in one that runs https://github.com/openstack/nova/blob/master/gate/post_test_hook.sh13:56
dansmithah yep13:57
dansmiththanks13:57
sean-k-mooneyit looks like 3 https://github.com/openstack/nova/search?q=post_test_hook.sh&unscoped_q=post_test_hook.sh13:57
mriedemnova-next is the one you're looking for13:58
sean-k-mooneyits done the live migration job too and the grenade version13:59
mriedemnot the same scripts dan is looking for13:59
sean-k-mooneyoh right they run a different post test hook14:00
dansmithmriedem: okay the --before patch is too stale to have test output, but wanted to see what that run looks like14:00
sean-k-mooneyso ya nova-nextg14:00
*** tbachman has joined #openstack-nova14:06
*** lpetrut has quit IRC14:12
*** _alastor_ has joined #openstack-nova14:18
openstackgerritSurya Seetharaman proposed openstack/python-novaclient master: Allow passing negative values for the locked search_opt in cs.servers.list  https://review.opendev.org/65978314:18
*** Luzi has quit IRC14:19
aarentsefried: I think you where about to read this 2 days ago, but you saw that it was no more mergeable. never mind I need a core having a look on this since Matthew has "+1" do you know who can help me on this ? ( https://review.opendev.org/#/c/659054/ )14:25
efriedaarents: I'm reviewing it. I have some issues with the test. Working on formulating a solution...14:27
aarentsok14:28
aarentsthanks14:28
*** itlinux has joined #openstack-nova14:29
*** dpawlik has quit IRC14:29
*** dtantsur|brb is now known as dtantsur14:29
*** itlinux has quit IRC14:30
*** sridharg has quit IRC14:31
*** ykarel is now known as ykarel|afk14:31
*** itlinux has joined #openstack-nova14:31
*** boxiang has joined #openstack-nova14:32
*** cmart has joined #openstack-nova14:35
*** IvensZambrano has joined #openstack-nova14:38
*** cmart has quit IRC14:40
*** lorenjan has joined #openstack-nova14:41
*** _alastor_ has quit IRC14:41
mriedemhttps://www.youtube.com/watch?v=SGZqDzb__bw14:43
*** luksky has quit IRC14:43
openstackgerritMatt Riedemann proposed openstack/nova master: Add prep_snapshot_based_resize_at_source compute method  https://review.opendev.org/63483214:43
openstackgerritMatt Riedemann proposed openstack/nova master: Add nova.compute.utils.delete_image  https://review.opendev.org/63760514:43
openstackgerritMatt Riedemann proposed openstack/nova master: Add PrepResizeAtSourceTask  https://review.opendev.org/62789114:43
openstackgerritMatt Riedemann proposed openstack/nova master: Refactor ComputeManager.remove_volume_connection  https://review.opendev.org/64218314:43
openstackgerritMatt Riedemann proposed openstack/nova master: Add power_on kwarg to ComputeDriver.spawn() method  https://review.opendev.org/64259014:43
openstackgerritMatt Riedemann proposed openstack/nova master: Add finish_snapshot_based_resize_at_dest compute method  https://review.opendev.org/63508014:43
openstackgerritMatt Riedemann proposed openstack/nova master: Add FinishResizeAtDestTask  https://review.opendev.org/63564614:43
openstackgerritMatt Riedemann proposed openstack/nova master: Add Destination.allow_cross_cell_move field  https://review.opendev.org/61403514:43
openstackgerritMatt Riedemann proposed openstack/nova master: Execute CrossCellMigrationTask from MigrationTask  https://review.opendev.org/63566814:43
openstackgerritMatt Riedemann proposed openstack/nova master: Plumb allow_cross_cell_resize into compute API resize()  https://review.opendev.org/63568414:43
openstackgerritMatt Riedemann proposed openstack/nova master: Filter duplicates from compute API get_migrations_sorted()  https://review.opendev.org/63622414:43
openstackgerritMatt Riedemann proposed openstack/nova master: Change HostManager to allow scheduling to other cells  https://review.opendev.org/61403714:43
openstackgerritMatt Riedemann proposed openstack/nova master: Start functional testing for cross-cell resize  https://review.opendev.org/63625314:43
openstackgerritMatt Riedemann proposed openstack/nova master: Handle target host cross-cell cold migration in conductor  https://review.opendev.org/64259114:43
openstackgerritMatt Riedemann proposed openstack/nova master: Validate image/create during cross-cell resize functional testing  https://review.opendev.org/64259214:43
openstackgerritMatt Riedemann proposed openstack/nova master: Add zones wrinkle to TestMultiCellMigrate  https://review.opendev.org/64345014:43
openstackgerritMatt Riedemann proposed openstack/nova master: Add negative test for cross-cell finish_resize failing  https://review.opendev.org/64345114:43
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Add confirm_snapshot_based_resize_at_source  https://review.opendev.org/63705814:43
edleafemriedem: oh, are you out of /dev/jail?14:44
*** udesale has quit IRC14:44
mriedemlet's say yes14:44
*** itlinux has quit IRC14:44
* edleafe posts bail for mriedem 14:44
*** udesale has joined #openstack-nova14:44
* mriedem puts on disguise14:44
*** mriedem is now known as hansmoleman14:44
prometheanfirefailures for the new fasteners fasteners===0.15 http://logs.openstack.org/54/660254/2/check/cross-nova-functional/a0617a9/testr_results.html.gz14:45
openstackgerritMerged openstack/nova stable/stein: Exclude fake marker instance when listing servers  https://review.opendev.org/65742114:45
hansmolemanwth is fasteners and what's using it?14:47
openstackgerritBoxiang Zhu proposed openstack/nova-specs master: Update "add host and hypervisor_hostname flag to create server" spec  https://review.opendev.org/66056014:47
*** boxiang has quit IRC14:49
hansmolemanbah oslo.concurrency http://codesearch.openstack.org/?q=import%20fasteners&i=nope&files=&repos=14:49
hansmolemanprometheanfire: open a bug please14:50
*** hemna has joined #openstack-nova14:50
hansmolemantssurya: i can address the small issues in https://review.opendev.org/#/c/659783/ if you're busy and then +2 it14:52
prometheanfirehansmoleman: ok, so far only nova has had issue with it14:53
*** ttsiouts has joined #openstack-nova14:54
*** itlinux has joined #openstack-nova14:54
*** itlinux has quit IRC14:56
*** lpetrut has joined #openstack-nova14:57
*** hansmoleman is now known as mriedem15:00
*** cfriesen has joined #openstack-nova15:01
*** ykarel|afk is now known as ykarel15:06
openstackgerritMatt Riedemann proposed openstack/python-novaclient master: Allow passing negative values for the locked search_opt in cs.servers.list  https://review.opendev.org/65978315:07
*** itlinux has joined #openstack-nova15:11
*** mlavalle has joined #openstack-nova15:12
tssuryahansmoleman: thanks! yea I am snowflake15:15
*** guozijn has quit IRC15:19
openstackgerritStephen Finucane proposed openstack/nova master: Remove cells v1 parameter from 'ComputeTaskAPI.resize_instance'  https://review.opendev.org/65131115:22
openstackgerritStephen Finucane proposed openstack/nova master: Stop passing 'kwargs' to 'rebuild_instance'  https://review.opendev.org/65131215:22
openstackgerritStephen Finucane proposed openstack/nova master: Stop passing 'delete_type' to 'terminate_instance'  https://review.opendev.org/65131315:22
openstackgerritStephen Finucane proposed openstack/nova master: filters: Stop handling cells v1  https://review.opendev.org/65131415:23
efriedstephenfin: I was considering reworking https://review.opendev.org/#/c/660527/ (get rid of nova.compute.*API()) to just change most of the imports from15:24
efriedfrom nova import compute15:24
efriedto15:24
efriedfrom nova.compute import api as compute15:24
efriedso that the code itself wouldn't change at all.15:24
efriedAgain "most of" - some other minor tweaks will be necessary, like where there was already an import of nova.compute.api as compute_api15:25
efriedanyway, what do you think of that idea?15:25
stephenfinI must admit I kind of like it how it is atm, with the few exceptions noted15:25
efriedThe code lines would stay kind of intuitive: compute.API() is nice and clean, clearer than api.API() and less redundant than compute_api.API()15:26
efriedokay.15:26
stephenfinYeah, fair point15:26
efriedIt's less work to leave it like it is, so I'm not going to fight for this :)15:26
stephenfinI'd be happy with either in that case, actually15:26
stephenfinThat's a good point15:26
efriedalas, I sense I have sold you on this idea15:27
efriedokay, I'll go make it so.15:27
*** ttsiouts has quit IRC15:27
stephenfinThink I've fixed up the issues with the one non-WIP patch that was failing [1] too, so they should all be good to go now [1] https://review.opendev.org/#/c/651311/15:27
stephenfinIt took me too long but it should make mriedem happy (it resolves one of his todo's in the process)15:28
*** eharney has quit IRC15:28
*** itlinux has quit IRC15:28
*** itlinux has joined #openstack-nova15:30
mriedemstephenfin: hmm, you're talking about https://review.opendev.org/#/c/651311/3/nova/compute/manager.py right? would it be possible for us to do that refactor outside of the cells v1 removal series?15:31
mriedemor just separately in the series?15:31
*** gyee has joined #openstack-nova15:32
*** macza has joined #openstack-nova15:32
stephenfinI was afraid you'd say that15:33
* stephenfin pulls it back down15:33
openstackgerritJohn Garbutt proposed openstack/nova-specs master: Add Unified Limits Spec  https://review.opendev.org/60220115:33
stephenfinbauzas: https://redhat.bluejeans.com/2519408175/15:34
bauzaswrong chan, dude15:34
*** helenafm has quit IRC15:35
openstackgerritArnaud Morin proposed openstack/nova master: Force refresh instance network info on deletion  https://review.opendev.org/66076115:38
*** lpetrut has quit IRC15:38
*** david-lyle has joined #openstack-nova15:39
*** dklyle has quit IRC15:40
*** david-lyle is now known as dklyle15:41
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: libvirt: dump console log if _clean_shutdown fails  https://review.opendev.org/66076615:42
*** itlinux has quit IRC15:47
*** francoisp has quit IRC15:53
*** dklyle has quit IRC15:55
*** david-lyle has joined #openstack-nova15:55
*** itlinux has joined #openstack-nova15:55
*** itlinux has quit IRC15:59
*** derekh has quit IRC15:59
*** itlinux has joined #openstack-nova16:00
*** IvensZambrano has quit IRC16:01
*** ykarel is now known as ykarel|away16:01
*** jangutter has quit IRC16:05
*** wwriverrat has joined #openstack-nova16:06
*** tesseract has quit IRC16:10
*** igordc has joined #openstack-nova16:12
*** tesseract has joined #openstack-nova16:14
*** tesseract has quit IRC16:14
*** ykarel|away has quit IRC16:15
*** dklyle has joined #openstack-nova16:15
*** david-lyle has quit IRC16:15
*** rpittau is now known as rpittau|afk16:18
*** itlinux has quit IRC16:20
*** itlinux has joined #openstack-nova16:21
openstackgerritStephen Finucane proposed openstack/nova master: Remove cells v1 parameter from 'ComputeTaskAPI.resize_instance'  https://review.opendev.org/65131116:22
openstackgerritStephen Finucane proposed openstack/nova master: Stop passing 'kwargs' to 'rebuild_instance'  https://review.opendev.org/65131216:22
openstackgerritStephen Finucane proposed openstack/nova master: Stop passing 'delete_type' to 'terminate_instance'  https://review.opendev.org/65131316:22
openstackgerritStephen Finucane proposed openstack/nova master: filters: Stop handling cells v1  https://review.opendev.org/65131416:22
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'ComputeManager._reschedule'  https://review.opendev.org/66077416:22
*** david-lyle has joined #openstack-nova16:24
*** sapd1_x has quit IRC16:25
*** dklyle has quit IRC16:25
mriedemkaisers: would it be possible to remove the feature parts of this backport? https://review.opendev.org/#/c/660706/16:28
*** cdent has quit IRC16:30
mriedemkaisers: https://review.opendev.org/#/c/660705/ also mixes in stuff that should have just been master-only IMO, i.e. the privsep conversion16:31
*** ttsiouts has joined #openstack-nova16:38
*** udesale has quit IRC16:38
*** david-lyle has quit IRC16:40
*** itlinux has quit IRC16:42
*** udesale has joined #openstack-nova16:43
openstackgerritsean mooney proposed openstack/nova master: Run revert resize tests in nova-live-migration  https://review.opendev.org/65349816:47
openstackgerritsean mooney proposed openstack/nova master: [DNM] use iptables in nova-multinode  https://review.opendev.org/66078216:47
*** prometheanfire has left #openstack-nova16:47
*** dklyle has joined #openstack-nova16:48
sean-k-mooney^ is just a repoducer so you can ignore it16:48
*** itlinux has joined #openstack-nova16:48
*** davidsha has quit IRC16:50
stephenfinmriedem: Split out that patch too, fwiw https://review.opendev.org/#/c/660774/16:51
* stephenfin -> 🏡16:51
mriedemthanks16:51
*** Swami has joined #openstack-nova16:53
*** tssurya has quit IRC16:58
mriedembauzas: dansmith: melwitt: can one of you hit this stein backport? https://review.opendev.org/#/c/660370/16:59
dansmithjes16:59
dansmithI'm probably due to go through backports16:59
*** francoisp has joined #openstack-nova17:00
melwittsame17:01
dansmithlet me also say.. I really hate the use of partial in here, which seems to be a growing cancer lately17:03
*** ttsiouts has quit IRC17:08
*** udesale has quit IRC17:12
melwittlooks like it's mirroring what we were already doing with post_live_migration17:12
*** ricolin has quit IRC17:13
*** itlinux has quit IRC17:13
dansmiththe partials you mean? that's what I'm talking about yeah17:14
melwittyeah, the partial thing17:14
dansmithoopsie, I approved that xen ssl thing for rocky before stein17:19
dansmithmriedem: this seems like a bug of omission to me that affects support-ability and thus pretty reasonable for stable: https://review.opendev.org/#/c/657125/117:22
dansmithmriedem: do you really disagree?17:22
*** luksky has joined #openstack-nova17:23
*** eharney has joined #openstack-nova17:33
*** Swami has quit IRC17:35
*** itlinux has joined #openstack-nova17:48
*** ttsiouts has joined #openstack-nova17:48
*** samueldmq has joined #openstack-nova17:50
mriedemi haven't dug into it much yet, it's big,18:03
mriedemit's also an admin api so i'm less concerned about that18:03
mriedemdansmith: ok +2 on that one now18:22
*** frank_wang has quit IRC18:24
*** frank_wang has joined #openstack-nova18:25
openstackgerritMatt Riedemann proposed openstack/nova stable/stein: Disable limit if affinity(anti)/same(different)host is requested  https://review.opendev.org/65923918:32
mriedem^ should also be ready to go18:34
*** READ10 has quit IRC18:34
mriedemonce https://review.opendev.org/#/q/status:open+project:openstack/nova+branch:stable/stein+label:Code-Review=2 is merged i think we should do a stein release18:35
*** dpawlik has joined #openstack-nova18:36
*** ttsiouts has quit IRC18:37
*** itlinux has quit IRC18:39
*** itlinux has joined #openstack-nova18:40
*** itlinux has quit IRC18:40
*** itlinux has joined #openstack-nova18:44
*** slaweq has quit IRC18:44
*** ttsiouts has joined #openstack-nova18:45
dansmithmriedem: thanks18:49
*** itlinux has quit IRC18:51
*** cmart has joined #openstack-nova19:08
*** cmart has quit IRC19:23
*** slaweq has joined #openstack-nova19:27
*** cmart has joined #openstack-nova19:28
*** cmart has quit IRC19:33
*** READ10 has joined #openstack-nova19:36
*** mmethot_ has quit IRC19:44
*** mmethot has joined #openstack-nova19:46
sean-k-mooneydansmith: for what its worth that bug only happens in a specifci edge casse.19:54
sean-k-mooneydansmith: basically it only happens if the kernel/nic diriver is configred such that it does not bind the VF to the network driver after its detached from the gues or when you pre bind the vfs to vvfio19:55
sean-k-mooneyso in some case it would work by acident because libvirt would auto add the missing element and in other cases it would fail which was a crapy operator experience19:56
*** tbachman has quit IRC19:58
*** tbachman has joined #openstack-nova20:00
*** ralonsoh has quit IRC20:07
*** liuyulong has quit IRC20:11
*** itlinux has joined #openstack-nova20:11
mriedemganso: melwitt: replied in https://review.opendev.org/#/c/659338/20:12
melwittthanks20:14
*** ttsiouts has quit IRC20:19
*** pcaruana has quit IRC20:20
*** itlinux has quit IRC20:21
openstackgerritMerged openstack/nova stable/stein: Reproduce bug #1819460 in functional test  https://review.opendev.org/65760020:27
openstackbug 1819460 in OpenStack Compute (nova) stein "instance stuck in BUILD state due to unhandled exceptions in conductor" [Medium,In progress] https://launchpad.net/bugs/1819460 - Assigned to Balazs Gibizer (balazs-gibizer)20:27
openstackgerritMerged openstack/nova stable/stein: Fix exception type in test_boot_reschedule_fill_provider_mapping_raises  https://review.opendev.org/65760120:30
*** READ10 has quit IRC20:30
mriedemmelwitt: thanks but https://review.opendev.org/#/c/659338/ isn't a backport so you might want to drop the +W20:31
*** whoami-rajat has quit IRC20:34
*** ttsiouts has joined #openstack-nova20:35
melwittmriedem: oh :( ok20:35
melwittmriedem: I think I need to change the commit message or something to stop it from going to the gate. I can add [stable-only] to it20:38
*** ttsiouts has quit IRC20:39
*** tuxjohnson has joined #openstack-nova20:41
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: [stable-only] Delete allocations even if _confirm_resize raises (part 2)  https://review.opendev.org/65933820:46
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: Add functional confirm_migration_error test  https://review.opendev.org/65883420:46
mriedemdone20:46
melwittthank you20:47
gansomriedem: thank you =D20:51
*** dpawlik has quit IRC20:51
openstackgerritMatt Riedemann proposed openstack/nova master: Update description of valid whitelist for non-admin user  https://review.opendev.org/64240320:56
sean-k-mooneyhaving ssh exposed on a static ip is always fun21:01
openstackgerritMatt Riedemann proposed openstack/nova master: Skip existing VMs when hosts apply force_config_drive  https://review.opendev.org/65970321:02
sean-k-mooneyi have 4 ip currently trying to brute force my root password. which will be hard since i dont allow password loggin as root21:02
mriedemefried: on the virtual persistent memory spec https://review.opendev.org/#/c/601596/ and cyborg integration spec https://review.opendev.org/#/c/603955/ i'm waiting to see those settle down from the people that have been most involved, but is there light at the end of the tunnel at some point?21:04
efriedmriedem: I hope so. What do you mean?21:04
mriedemevery time i look at these there are multiple -1s21:04
mriedemfor like, months21:04
mriedemi guess i'm saying feel free to ping me to review those when they settle down21:05
efriedmriedem: ah, cool, thanks.21:05
mriedembut until them i'm not wanting to jump into reviewing them21:05
mriedem*then21:05
efriedyeah, understood.21:05
efriedfor my part, I'm waiting until you're done tearing the host/hypervisor_hostname spec apart before I re-engage :)21:06
*** ttsiouts has joined #openstack-nova21:07
*** IvensZambrano has joined #openstack-nova21:08
sean-k-mooneymriedem: efried i dont think there is much curn on the cyborg one at this point but sundar also has not updated it in two weeks so that is why most of the -1s are still there21:09
efriedRight, I think that one is pretty close, updates still trickling down from PTG discussions.21:10
mriedemefried: this? https://review.opendev.org/#/c/660560/21:10
efriedmriedem: no, https://review.opendev.org/#/c/660560/321:11
mriedemi'm just adding it to the nova meeting agenda for a stuck review, i see boxiang is getting some back and forth21:11
mriedemthat's the same change :)21:11
mriedemseems the debate is if we should validate the requested host/node in the api and fail fast or fail late in the scheduler with novalidhost21:11
efriedthought the whole point of the exercise was to fail early.21:11
mriedemi think unless it's egregious we generally want to validate and fail fast in the api if possible21:11
*** ttsiouts has quit IRC21:11
mriedemthe whole point of the spec is to request a host and/or node and have the scheduler filters validate it21:12
mriedemrather than force it through21:12
mriedemwhich is what we have today (unless you're using the little known query hint)21:12
mriedemanyway, i've said on the code change to take it to the ML or meeting agenda to sort it out with more than 2 people invovled21:13
mriedemif we could throw a generic RequestGroup with the in_tree attribute set in the request spec from the api then the redundancy in the scheduler would be avoided21:14
mriedembut that gets complicated21:14
sean-k-mooneyi have not read that one but if we are specifying the host or hypervior host name i assume we would be passing intree to placement and failing in teh scudler if we get no allocation candiates or the filters eliminate the host?21:14
efriedRight, I thought we wanted the scheduler filter validation so we would know earlier whether the guest was viable for the host. Rather than "forcing" it to a host it couldn't work on so it would fail late (or worse, pretend to succeed but really be borked)21:14
mriedemefried: that is true21:15
mriedemthe debate is if that is good enough or if we should also validate that the requested host/node exist in the API so we can return a 400 if they don't21:15
efrieddahhh21:15
mriedemb/c if you don't validate in the api, and they don't exist, you'll get a 202 and then NoValidHost later21:15
mriedemwhich everyone loves21:15
sean-k-mooneyefried: well the current way to force the host is via the AZ  e.g. --availability-zone nova:my_host21:16
efriedoh, "in the API" meaning before we get to the scheduler21:16
efriedf, I don't see why not. How expensive is that check?21:16
sean-k-mooneyis it just checkign the api db to see if there is a host mapping for the requested host?21:17
sean-k-mooneyif so then cheap21:17
*** _alastor_ has joined #openstack-nova21:18
sean-k-mooneyhonestly i dont think there is any issue with it failing when it gets to the schduler either21:19
mriedemno it's not doing that,21:19
mriedemjust commented on that in the api validatoin code, it won't work as written21:19
sean-k-mooneyhttps://review.opendev.org/#/c/645520/20 is the code change ?21:20
mriedemsurya already pointed out the same thing i just did21:20
mriedemsean-k-mooney: yes21:20
mriedemif you request a host, we can look up the host mapping21:20
mriedemif you request only a node, then we have to iterate the cells looking for it21:20
mriedemor let the scheduler do that21:20
mriedemsince it already is21:21
sean-k-mooneyi would let the schduler do it personally21:21
sean-k-mooneyis there a reason not to use in_tree in the placement request as well?21:21
mriedemthe scheduler code will use in_tree already21:22
mriedembut it will do the same compute node lookup to find the node uuid21:23
mriedemthe RequestSpec.requested_destination currently only has the host and nodename, not the uuid21:23
sean-k-mooneywell it could look it up via placmenet i nthe hypervior_host name case21:23
sean-k-mooneythe compute node RP name is the hypervior host name i think21:24
sean-k-mooneyand in the host case its in the instance mappings in the api db21:24
sean-k-mooneysorry host mappings21:24
mriedems/instance/host/21:24
sean-k-mooneyso we should not need to iterate over teh cell dbs21:24
mriedemi'm not sure how much i want to rely on the rp name matching the hypervisor_hostname forever21:26
mriedemor always being correct21:26
mriedemespecially since you can change the name https://developer.openstack.org/api-ref/placement/?expanded=update-resource-provider-detail#update-resource-provider21:26
sean-k-mooneyim just checking that it is infact set to that. but i think we need to for other services to be able to identigy the host21:26
sean-k-mooneye.g. we need a way for neutron to be abel to create nested RPs under the compute node RP21:27
mriedemyes we set the rp name to the compute node hypervisor_hostname in the RT21:27
mriedemhttps://github.com/openstack/nova/blob/2e85453879533af0b4d0e1178797d26f026a9423/nova/compute/resource_tracker.py#L95421:27
sean-k-mooneyi think its effectivly part of the contract nova has with cyborg and  neutron at this point21:28
mriedemheh, well, it's mutable in the placement api21:28
*** tuxjohnson has left #openstack-nova21:28
sean-k-mooneyits technically mutable in our config file too21:28
mriedemhttps://docs.openstack.org/osc-placement/latest/cli/index.html#resource-provider-set21:28
sean-k-mooneywell not that but the host paramater21:29
mriedemhow so? if you're talking about CONF.host, that's something else21:29
sean-k-mooneyya i was21:29
mriedemhypervisor_hostname comes from the driver21:29
mriedemnot the config21:29
mriedemhttps://github.com/openstack/nova/blob/2e85453879533af0b4d0e1178797d26f026a9423/nova/virt/driver.py#L162221:29
sean-k-mooneyyep you are right21:30
* mriedem screen captures that21:30
mriedemanyway, i threw it in the stuck review section for the meeting https://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting21:32
mriedemenumerating options in the ML ahead of the meeting would probably be useful21:32
*** IvensZambrano has quit IRC21:35
*** slaweq has quit IRC21:35
*** ttsiouts has joined #openstack-nova21:45
*** mriedem has quit IRC21:48
*** mriedem has joined #openstack-nova21:52
aspiersefried: around?22:02
*** ttsiouts has quit IRC22:02
aspiersjust had another idea for how to provide patch_exists()22:02
efriedaspiers: yeaux22:02
*** ttsiouts has joined #openstack-nova22:02
aspiersclass patch_exists(contextlib.ContextDecorator)22:03
aspiersthen it can be used both as a @patch_exists decorator, and via: with patch_exists(...)22:03
aspiersI think there's also a case to be made for providing patch_open in a similar way22:04
aspierscurrently there's tons of stuff which does:22:05
aspiersmock_open = mock.mock_open()22:05
aspierswith mock.patch.object(six.moves.builtins, 'open', new=mock_open):22:05
aspiers    ... do stuff22:05
aspiersthat could be replaced with22:05
aspierswith patch_open():22:06
aspiers    ... do stuff22:06
aspiersand it could support selective patching22:06
efriedand custom side effects22:06
aspiersright22:06
aspierswith patch_open() as mock_open:22:06
aspiers    mock_open.side_effect = ...22:06
efriedwhereupon you might as well just say22:07
efriedwith mock.patch.object(six.moves.builtins, 'open', new=mock.mock_open()) as mock_open:22:07
efriedbut sure, patch_open would be a neat little helper.22:07
aspiershrm22:08
aspiersin two minds about this22:08
aspiersthere's a danger of trying to reinvent a bunch of the mock API22:08
aspierswith patch_open(side_effect=...) as mock_open:22:08
aspiersetc.22:08
aspiersthe bit I'm really missing easy selective patching22:09
aspiersas in "patch opening path X, but pass anything else through to builtins.open"22:09
*** slaweq has joined #openstack-nova22:11
aspiersefried: I can't find any existing implementing of selective patching of open(), although I thought you said you had done that in the past. Maybe outside nova?22:11
*** mlavalle has quit IRC22:13
sean-k-mooneyi think we have an example of this in os-vif22:14
sean-k-mooneyby selectivly patching you mean mock right22:14
sean-k-mooneyyou do it like this https://github.com/openstack/os-vif/blob/6f08a3b4f8be77b2b5eae653c05db6e5770b562d/vif_plug_ovs/tests/unit/test_linux_net.py#L6522:14
sean-k-mooney @mock.patch('six.moves.builtins.open')22:14
sean-k-mooneyor this @mock.patch.object(builtins, 'open')22:15
*** slaweq has quit IRC22:15
sean-k-mooneyaspiers: oh you were sugging addign a wrapper to make it simpler22:17
sean-k-mooneyya that soudn like a good idea becuse tis a bit of a pain to get right22:18
*** itlinux has joined #openstack-nova22:21
openstackgerritEric Fried proposed openstack/nova master: Remove nova.compute.*API() shims  https://review.opendev.org/66052722:24
aspierssean-k-mooney: yeah exactly22:26
efriedaspiers: Sorry, hold on, lemme find22:26
efriedaspiers: I just reviewed one this morning in fact.22:26
aspierssean-k-mooney: except the approach you linked there doesn't work if the code path under test makes additional calls to open or exists22:26
aspierssean-k-mooney: sometimes that can happen (Especially in functional tests) and then you don't want to hardcode assumptions that those calls happen in a particular order22:27
aspiersyou just want to patch when it is called with a certain param, otherwise pass through transparently22:27
sean-k-mooneyaspiers: you can pass an iterable of callable as the return value and have it return differnet things but yes that is really just for mocking things in unit tests22:28
efriedaspiers: nova/tests/unit/test_versions.py:4522:29
sean-k-mooneyaspiers: in unit test you actully do generally want to encode the order. or rather we generall do in openstack22:30
sean-k-mooneyefried: that is not really generic either22:31
aspiersefried: thanks22:32
efriedsean-k-mooney: that's the point. aspiers is wanting to write a thing to do that pattern, so it could be used in places like that in a more readable and generic way.22:32
aspiersright22:32
sean-k-mooneywell in the unit test we never want it to call real_open22:32
sean-k-mooneyand in the functional test im not sure that is vaild either22:33
aspiersin the functional test I'm writing, placement needs to read placement-policy.yaml from the testenv22:33
aspiersthere's no way I'm hardcoding that path into my test22:33
aspiersnor any assumption about *when* it needs to read that file22:34
efriedmriedem: Do you have a take on whether nova should talk to cyborg with an admin auth or with the user's auth?22:34
sean-k-mooneywhy does it need to read a file instead of embeding it in a sting22:34
aspiersbecause it's not mocking or stubbing placement22:34
efriedsean-k-mooney: It was just an example. Point is that there are valid and viable reasons unit tests should invoke real open().22:34
aspiersit's not even testing placement22:34
aspiersexactly22:35
efriedso we want to be able to mock it conditionally.22:35
efriedI was just dorking with one this morning where libvirt tests set up a TempDir fixture to read and write fake images22:35
aspiersthis makes sense when checking files outside the testenv22:35
efriedsucker used open()s and other os.path stuff all over the place.22:35
sean-k-mooneywell the only valid case would be if they created the file they are opening in which case they would not mock it22:35
aspierslike /etc/nova/release, or /sys/module/kvm_amd/parameters/sev22:35
sean-k-mooneyaspiers: well that is the thing we shoudl not be checking files outside the test env22:36
sean-k-mooneythe unit test and function test shoudl work on a host without install nova22:36
aspierssean-k-mooney: ... and that's exactly why I need to selectively patch22:36
openstackgerritMatt Riedemann proposed openstack/nova master: Remove PlacementAPIConnectFailure handling from AggregateAPI  https://review.opendev.org/66085222:36
sean-k-mooneye.g. you shoudl be able to git clone and then run it22:36
sean-k-mooney*run tox -e py3622:36
mriedemefried: dansmith: ^ for tomorrow, could use some thoughts on how to handle failures in the latter case noted in there22:36
aspierssean-k-mooney: yes, that is what I am aiming for22:36
mriedemefried: re admin auth it depends on what we're doing i guess and what the cyborg api policy is22:37
aspierssean-k-mooney: I need to mock the presence and contents of /sys/module/kvm_amd/parameters/sev22:37
sean-k-mooneyright so im not seeing why you would ever fall back to real_open22:37
aspiersbecause of other things like placement-policy.yaml which live inside the testenv22:37
efriedmriedem: It sounds like Sundar has thought it through and has been assuming the operations should be done on behalf of the user so that proper policy and quota can be taken into account. Do you see any problem with that approach?22:37
aspiersor temp files created by the test framework like efried said22:37
efriedmriedem: johnthetubaguy and I have advised him on enabling service_user, but otherwise, should be okay yes?22:38
sean-k-mooneyif they are withing the tox venv i gues its fine22:38
mriedemefried: i think for most things with external-to-nova resources we try to use the user auth, for things with volumes/images/ports22:38
sean-k-mooneyjust so long as the files are not form the host system22:38
mriedembut there are certain APIs on those resources that we use admin creds, like port binding is admin-only since it's host-level info22:38
efriedmriedem: k, so ironic is the outlier. And then there's a little bit of neutron that does admin, not sure what that's about. And then there's a little edge case in cinder that uses admin as well.22:39
efriedyeah22:39
mriedemnova didn't even have config to do admin level stuff with cinder until a few releases ago22:40
mriedemto forcefully detach a volume when we didn't have a token22:40
mriedemso if there is host-level stuff we need to do i'd expect those apis to be admin-only by policy in cyborg22:41
mriedemi don't know enough about their api though22:41
mriedemlike, you as a user can create an fpga resource and provide that to nova on server create to wire it up right?22:41
sean-k-mooneymriedem: that was one of the thing in the spec we called out22:42
sean-k-mooneye.g. that cyborgs api whoudl be admin by default22:42
mriedemso ironic22:42
sean-k-mooneysince its manaing host level resouces that are potentially damaging if used incorrectly22:43
mriedemthere are also nova/cinder interactions we probably should have done differently from the start, because some cinder apis that nova uses leak host level connection information and aren't admin apis22:43
*** itlinux has quit IRC22:43
mriedemweee https://bugs.launchpad.net/cinder/+bug/174095022:43
openstackLaunchpad bug 1740950 in Cinder "Volume details shows attached compute host for non-admins" [Undecided,New]22:43
sean-k-mooneylick the conection context or whatever its called that has the iscsi info22:44
sean-k-mooneyattachment?22:44
mriedemheh "If it lingers past Queens release day, we can revisit the advisory task."22:44
mriedemyes the attachment has the connection_info dict22:44
sean-k-mooneyya that has come up a few times22:44
sean-k-mooneyin the cyborg case that is one of the open items in the spec here https://review.opendev.org/#/c/603955/12/specs/train/approved/nova-cyborg-interaction.rst@30122:46
sean-k-mooney:( https://github.com/openstack/cyborg/blob/master/cyborg/common/policy.py#L76-L12222:49
sean-k-mooneywhy is the program endpoint using allow ...22:50
*** itlinux has joined #openstack-nova22:50
*** mmethot has quit IRC22:51
efriedsean-k-mooney: That (cyborg APIs being admin only) was something you brought up, but it sounds like that's not how they're planning on doing it.22:53
mriedemsomeone call lbragstad22:54
sean-k-mooneyyes well currently anyway can update any fpga recored with there default policy so how they were planning on doing it and what they proably should do are likely not the same thing22:54
efriedmriedem: Just this morning someone was asking about a rare failure in the logs where cinder complained of not having admin creds.22:55
mriedemadmin-only by default seems smartest and makes the nova interaction strict from the get-go22:55
efriedhttp://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2019-05-22.log.html#t2019-05-22T12:46:1922:55
mriedembut idk, that might make it hard to allow non-admin stuff later22:55
sean-k-mooneythe deployable create/update/delete are adming only22:55
efriedmriedem: seems to me like that's worse, because it means we *require* admin creds in the conf, and all operations would be allowable.22:56
sean-k-mooneyupdate and delete on acclertors are admin or own so for those it proably fine22:56
efriedcyborg sounds like they have a plan for granular policy (is that the right use of that term?) and if so it makes sense to do user auth from nova.22:57
mriedemefried: without knowing where that users was getting the error i can't really say on that cinder thing,22:57
*** macza has quit IRC22:57
mriedemit was added b/c there is a periodic in the compute which will shelve offload instances after a period of time, and cleanup soft-deleted instances after a period of time, which means doing things on volumes w/o a user token22:58
sean-k-mooneyefried: for some things that makes sense but i think there fpga update should ast least be admin_or_owner22:58
efriedmriedem: Well, I wound up concluding that it was probably the thing you just mentioned, the parts of cinder where we need the admin creds for those weird periodic edge cases.22:58
*** artom has joined #openstack-nova22:59
efriedthey didn't have any admin creds in their conf22:59
mriedemok on the cyborg policy thing, idk, if only we had like a technical committee in openstack or something with security guidelines22:59
mriedemor an auth/identity team...22:59
mriedembut it's 6pm and i'm not sean-k-mooney so i need to drop off22:59
efriedo/22:59
sean-k-mooneyo/22:59
*** mriedem has quit IRC22:59
sean-k-mooneyhay look its thursday ...23:00
sean-k-mooneyi should proably go to sleep soon.23:00
sean-k-mooneyefried: i didnt get to rework the vidoe-model stuff but i shoudl get that done tomorrow23:01
efriedno worries23:01
*** Sundar has joined #openstack-nova23:01
*** igordc has quit IRC23:01
sean-k-mooneySundar: is there a reason that anyone can update any fpga recored even if they dont own it or are not admins https://github.com/openstack/cyborg/blob/master/cyborg/common/policy.py#L119-L12123:03
sean-k-mooneybecaue ^ seams like a bug23:03
Sundarsean-k-mooney: We got some holdovers from previous releases. We need to scrub all these policies for sure.23:04
sean-k-mooneythe same issue is there for the deployable program endpoint.23:04
sean-k-mooneySundar: ok as long as you are aware but that is something that shoudl be backported23:05
sean-k-mooneynormally you would not backport that kind of change but in this case i think its needed23:05
SundarBackport to v1 API?23:05
sean-k-mooneySundar: yes that would almost qualify for a revert in my book if you had not already released it23:06
SundarI need to get my head around how these rules interact with API versions23:06
*** tkajinam has joined #openstack-nova23:06
sean-k-mooneynormally it would be a microverion bump23:07
openstackgerritEric Fried proposed openstack/nova master: WIP: Support old & new versions of svm and vmx traits  https://review.opendev.org/66051523:08
*** slaweq has joined #openstack-nova23:11
*** baderbuddy has joined #openstack-nova23:15
*** slaweq has quit IRC23:15
*** rcernin has joined #openstack-nova23:20
*** itlinux has quit IRC23:28
Sundarmriedem, sean-k-mooney: Re. earlier discussion today on https://review.opendev.org/#/c/603955/ , yes, I haven't updated the spec, mainly because I have been trying to understand the implications of moving the bind to compute, etc.23:32
*** itlinux has joined #openstack-nova23:32
SundarI will shortly update the spec.23:32
*** ttsiouts has quit IRC23:33
*** itlinux has quit IRC23:46
*** baderbuddy has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!