Thursday, 2016-09-01

alaskithese are not using that fixture apparently, they're starting up compute services00:00
*** baoli has quit IRC00:00
melwittyeah, was just looking at that. I saw only two tests use the fixture and they're about BuildRequest00:01
*** ducttape_ has quit IRC00:07
*** rrecio has quit IRC00:08
alaskioh, I may have it00:10
alaskion a scheduling failure we bail early at http://git.openstack.org/cgit/openstack/nova/tree/nova/conductor/manager.py#n493 so the BuildRequest isn't cleaned up00:11
alaskiand instance shows then come from the buildrequest rather than the instance00:11
melwittalaski: nice find. and then it wants to look at the instance fault message00:12
melwitt(the test does)00:12
melwittand the status00:13
*** hieulq has joined #openstack-nova00:14
*** raunak has quit IRC00:15
*** avolkov`` has joined #openstack-nova00:17
alaskithat fixed half the tests00:20
*** Sukhdev has joined #openstack-nova00:20
*** baoli has joined #openstack-nova00:21
*** avolkov` has quit IRC00:22
*** marst has joined #openstack-nova00:22
melwittyey00:23
*** trisq has joined #openstack-nova00:25
*** ducttape_ has joined #openstack-nova00:28
*** baoli has quit IRC00:30
*** ducttape_ has quit IRC00:31
*** browne has quit IRC00:32
*** baoli has joined #openstack-nova00:35
*** thorst has joined #openstack-nova00:35
alaskiugh. So the other half failed because of a timing issue in the tests which should be fixed regardless. But a relatively simple change seems to fix everything00:40
openstackgerritAndrew Laski proposed openstack/nova: Fix service version lookups  https://review.openstack.org/36388800:45
openstackgerritAndrew Laski proposed openstack/nova: Pull from cell0 and build_requests for instance list  https://review.openstack.org/35613800:45
openstackgerritAndrew Laski proposed openstack/nova: Delete BuildRequest regardless of service_version  https://review.openstack.org/36391100:45
openstackgerritAndrew Laski proposed openstack/nova: Remove BuildRequest when scheduling fails  https://review.openstack.org/36400500:45
alaskiI'll add tests tomorrow, but that should address it00:46
melwittalaski: awesome. is the bottom change one that you want to add tests to or is that one good to go?00:47
alaskimelwitt: yeah, that's the one that I need to test00:48
melwittalaski: okay, cool00:48
*** xinliang has quit IRC00:48
*** mtanino has quit IRC00:49
*** ducttape_ has joined #openstack-nova00:49
*** ociuhandu has joined #openstack-nova00:49
openstackgerritAndrew Laski proposed openstack/nova: Pull from cell0 and build_requests for instance list  https://review.openstack.org/35613800:50
openstackgerritAndrew Laski proposed openstack/nova: Delete BuildRequest regardless of service_version  https://review.openstack.org/36391100:50
*** chrichip has quit IRC00:52
*** vishwanathj has quit IRC00:53
*** chrichip has joined #openstack-nova00:53
*** Sukhdev has quit IRC00:55
*** cheneydc has joined #openstack-nova00:56
openstackgerritLi Yingjun proposed openstack/nova: Adds view builders for hypervisors controller  https://review.openstack.org/33528201:00
*** xinliang has joined #openstack-nova01:01
*** trisq has quit IRC01:03
*** ociuhandu has quit IRC01:08
mriedemalaski: new fun failures http://logs.openstack.org/56/363956/3/check/gate-grenade-dsvm-neutron-ubuntu-trusty/09a989d/logs/grenade.sh.txt.gz#_2016-09-01_00_11_34_07201:11
mriedemInstance ac03c9a7-3546-41ef-bba2-018c3542e41b is not mapped to a cell (upgrade is incomplete)01:11
*** priteau has joined #openstack-nova01:11
*** Sukhdev has joined #openstack-nova01:12
*** Sukhdev has quit IRC01:13
mriedemi think we might be getting into some kind of weird setup/upgrade loop here01:14
*** hoangcx has joined #openstack-nova01:14
*** ducttape_ has quit IRC01:15
*** priteau has quit IRC01:16
openstackgerritEd Leafe proposed openstack/nova: WIP create_all and delete_all for AllocationList  https://review.openstack.org/36320901:18
edleafecdent: jaypipes: bauzas: ^^ update on the allocations code01:18
*** mingyu has joined #openstack-nova01:18
edleafeAll the tests are passing, and I changed the _create back to _set01:18
*** ducttape_ has joined #openstack-nova01:18
mriedemalaski: oh wait a minute, the grenade change probably can't be calling cells_v2 verify_instance if we didn't run simple_cell_setup01:22
mriedemto do the instance mapping01:22
mriedemyeah that's the ticket01:24
mriedemi'll update that quick01:24
*** cheneydc has quit IRC01:25
openstackgerritmelanie witt proposed openstack/nova: Make req spec and RT aware of volume-backed instances  https://review.openstack.org/35509101:26
*** wangqun has joined #openstack-nova01:27
*** baoli_ has joined #openstack-nova01:28
*** kevinz has joined #openstack-nova01:28
*** baoli has quit IRC01:28
*** baoli has joined #openstack-nova01:30
*** hoangcx has quit IRC01:31
mriedemalaski: ok updated that grenade change, rechecked the other changes that depend on it, still watching https://review.openstack.org/#/c/363971/ to see if that's going to pass01:31
*** trisq has joined #openstack-nova01:32
dansmithneed me to look at anything?01:33
*** baoli_ has quit IRC01:33
*** salv-orlando has joined #openstack-nova01:34
mriedemdansmith: i don't think so, unless you want to sanity check,01:37
mriedembut i'm just watching zuul results01:37
dansmithokay01:37
dansmithI've been drinking so I probably shouldn't be making judgment calls01:37
dansmith(and for the logs, I mean literally a single beer)01:38
mriedemall calls to nova-manage cell_v2 stuff in grenade is now conditional01:38
*** chrichip has quit IRC01:38
mriedem"i've been drinking...literally ounces of beer here"01:38
dansmithhah, yeah01:38
mriedemas for the other side of the fun, https://review.openstack.org/#/c/363209/ was updated but i'm guessing we're still waiting on jaypipes to review that01:39
*** EinstCrazy has joined #openstack-nova01:39
dansmithmriedem: I'm waiting for the client side so I can poke at it locally01:39
*** EinstCrazy has quit IRC01:39
*** EinstCrazy has joined #openstack-nova01:39
*** chrichip has joined #openstack-nova01:39
dansmithmriedem: I told him I'd pick that up tomorrow where he leaves off01:39
mriedemyeah i guess the client side will be the test01:39
mriedemif the whole stack01:40
dansmithyar01:40
mriedem*of01:40
mriedemlooking at some of the other approved things from https://etherpad.openstack.org/p/placement-next and they are still in zuul01:41
dansmithyeah01:41
*** ducttape_ has quit IRC01:42
*** diablo_rojo has quit IRC01:43
*** ayoung has joined #openstack-nova01:43
*** salv-orlando has quit IRC01:44
*** ducttape_ has joined #openstack-nova01:46
tonybmriedem: Is it your intent that novaclient 6.0.0 should be used for newton deploys (as opposed to ocata)?01:46
melwittmriedem: alaski said he's going to add tests to https://review.openstack.org/#/c/363888/ tomorrow too01:47
mriedemmelwitt: ok i missed the convo before but it sounds like someting was still failing01:47
tonybmriedem: the removal of the newtorking stuff has broken horizon and therefore can't land in u-c01:47
mriedemtonyb: i'm not sure it matters01:47
tonybmriedem: I don't mind fixing it01:47
mriedemtonyb: is horizon using the API or CLI?01:48
mriedemtonyb: the CLI should cap the networking stuff at 2.3501:48
tonybmriedem: API i'd guess01:48
mriedemtonyb: are they specifying 2.latest?01:48
mriedemfor the microversion?01:48
melwittmriedem: something was failing and he fixed it but said he needs to add some tests to it01:48
tonybmriedem: haven't looked but I assume so01:48
mriedemtonyb: 2.latest is only for testing01:49
mriedemand crazy people01:49
mriedemtonyb: do you have a link to a failure?01:49
tonybmriedem: http://logs.openstack.org/16/363516/1/check/gate-cross-horizon-python27-ubuntu-xenial/2644145/console.html#_2016-08-31_09_34_07_15183801:49
tonybmriedem: so should we cap @ 2.35 for simplicity in horizon for newton?01:50
mriedemtonyb: let me look at this test code first01:51
mriedemnice https://github.com/openstack/horizon/blob/master/openstack_dashboard/test/helpers.py#L44201:53
*** ducttape_ has quit IRC01:54
edleafedansmith: so if you're not too drunk, want to give me a sanity check on https://review.openstack.org/#/c/363209/ ?01:54
mriedemtonyb: so with something like this: http://logs.openstack.org/16/363516/1/check/gate-cross-horizon-python27-ubuntu-xenial/2644145/console.html#_2016-08-31_09_34_07_18939501:55
mriedemthe horizon unit tests are stubbing (with mox) the novaclient.Client impl01:55
mriedemwhich is kind of terrible01:55
tonyb:/01:56
mriedemlooking at this: https://github.com/openstack/horizon/blob/master/openstack_dashboard/api/nova.py#L5001:57
mriedemthe API code in horizon should at most be using 2.901:57
mriedemthe client is created here https://github.com/openstack/horizon/blob/master/openstack_dashboard/api/nova.py#L47601:58
mriedemthe tests are doing this stub_novaclient thing though01:58
mriedemmy guess would be, the stubbed client in https://github.com/openstack/horizon/blob/master/openstack_dashboard/test/helpers.py#L442 needs to set a fake api_version attr or sometihng01:59
mriedemand maybe default that to 2.101:59
*** woodster_ has quit IRC01:59
mriedemi'm not really sure, but they have to do something like that for keystoneclient https://github.com/openstack/horizon/blob/master/openstack_dashboard/test/helpers.py#L45702:00
mriedemtonyb: here is a bug anyway https://bugs.launchpad.net/horizon/+bug/161909302:01
openstackLaunchpad bug 1619093 in OpenStack Dashboard (Horizon) "unit tests fail with novaclient 6.0.0" [Undecided,New]02:01
tonybmriedem: Thanks.02:01
*** ijw has quit IRC02:01
mriedemi can try setting a fake api_version locally and see how many tests that fixes02:02
mriedemwow it takes a long time to clone horizon02:03
*** Apoorva has quit IRC02:03
*** EinstCra_ has joined #openstack-nova02:04
tonybmriedem: ok.  I'll try to chip away at it also02:05
*** ljxiash has joined #openstack-nova02:05
dansmithedleafe: did you change anything?02:06
dansmithI looked at the version jay pushed02:06
*** sdake has quit IRC02:06
dansmithedleafe: ah I see02:07
edleafedansmith: fixed a few loose ends and added the logic back to update02:07
dansmithedleafe: those are things I'd hope to find while playing with it locally, but yeah  changed look sane02:07
dansmith*changes02:07
*** hoangcx has joined #openstack-nova02:07
edleafedansmith: cool. Have another beer :)02:07
*** EinstCrazy has quit IRC02:08
*** phuongnh has joined #openstack-nova02:11
mriedemstill cloning horizon...they must store a bunch of binaries in git02:13
mriedemtonyb: while i wait, do me a solid https://review.openstack.org/#/c/352884/02:14
mriedemand https://review.openstack.org/#/c/355210/02:14
melwittI cloned nova earlier and it took forever too. thought maybe there was something afoot with github02:14
*** hemanthm|afk is now known as hemanthm02:14
tonybmriedem: Sure np02:16
*** unicell has quit IRC02:16
*** chrichip has quit IRC02:16
*** chrichip has joined #openstack-nova02:17
*** thorst has quit IRC02:18
*** thorst has joined #openstack-nova02:19
*** ducttape_ has joined #openstack-nova02:19
mriedemok running horizon unit tests02:22
mriedemi might be able to fix 44 of the failures02:22
mriedemand leave the other 10 for someone else02:22
mriedemwtf, do they use nosetests?02:25
tonybmriedem: Adding "nova_client.Client.api_version = "2.9"" works for me with novaclient 5.1.0 and 6.0.002:25
mriedemso i tried to be cute and use the 'preferred' version from their api.nova.VERSIONS thing02:26
mriedembut the novaclient api version stuff doesn't like '2', it needs '2.0'02:26
mriedemso i'm going to just hardcode to 2.1 since that's sane02:26
mriedemand is the minimum you'd use02:26
mriedemi'll push this up in a sec02:27
*** ducttape_ has quit IRC02:27
mriedemnova_client.Client.api_version needs to be an APIVersion object02:27
mriedemnot a string02:27
*** thorst has quit IRC02:28
tonybmriedem: picky ;P02:28
mriedemwell, i think using a string probably just gets lucky with the lazy compare functions we have in APIVersion02:28
mriedemi've thought about fixing that before02:28
mriedembut you know. lazy.02:28
tonybmriedem: Yeah I'll do it properly this was a quick hack to see if we're onthe right track02:29
mriedemi'll have the patch up here in a sec, just need nose to finish02:29
*** dimtruck is now known as zz_dimtruck02:30
tonybmriedem: ok02:31
mriedemtonyb: https://review.openstack.org/#/c/364029/02:32
mriedemupdated your reqs change with the depends-on02:33
mriedemdansmith: alaski: woot http://logs.openstack.org/71/363971/1/check/gate-grenade-dsvm-ubuntu-trusty/0c1458c/logs/new/localrc.txt.gz NOVA_CONFIGURE_CELLSV2=True02:34
mriedemand that passed02:34
mriedemthat is from https://review.openstack.org/#/c/363971/02:34
mriedemas did http://logs.openstack.org/71/363971/1/check/gate-tempest-dsvm-full-ubuntu-xenial/4d3b342/logs/localrc.txt.gz02:35
*** ducttape_ has joined #openstack-nova02:35
*** EinstCra_ has quit IRC02:36
*** EinstCrazy has joined #openstack-nova02:37
openstackgerritzhufl proposed openstack/nova: Remove unused oslo_config  https://review.openstack.org/36403102:37
*** TravT has joined #openstack-nova02:38
mriedemok i think i'm going to call it a day02:38
mriedemi expect sean diggity dague to hit a bunch of these things in the morning02:39
*** mriedem has quit IRC02:39
*** jamielennox|away is now known as jamielennox02:41
*** ducttape_ has quit IRC02:43
*** salv-orlando has joined #openstack-nova02:43
*** armax has quit IRC02:45
*** zz_dimtruck is now known as dimtruck02:47
*** ssurana has quit IRC02:47
*** sudipto has joined #openstack-nova02:47
*** Sukhdev has joined #openstack-nova02:48
*** gouthamr has quit IRC02:49
*** salv-orlando has quit IRC02:50
*** amotoki has joined #openstack-nova02:51
*** salv-orlando has joined #openstack-nova02:52
*** su_zhang has joined #openstack-nova02:53
*** chrichip has quit IRC02:54
*** chrichip has joined #openstack-nova02:55
*** salv-orlando has quit IRC02:57
*** hoangcx has quit IRC02:58
*** dimtruck is now known as zz_dimtruck03:02
*** armax has joined #openstack-nova03:03
*** amotoki has quit IRC03:08
*** armax has quit IRC03:08
*** raunak has joined #openstack-nova03:17
*** yamahata has quit IRC03:17
*** amotoki has joined #openstack-nova03:21
auggyis that a friday nick suggestion?03:21
*** zz_dimtruck is now known as dimtruck03:23
*** thorst has joined #openstack-nova03:26
openstackgerritzhufl proposed openstack/nova: Remove unused oslo_config  https://review.openstack.org/36403103:29
*** amotoki has quit IRC03:30
*** thorst has quit IRC03:33
*** amotoki has joined #openstack-nova03:35
*** sudipto has quit IRC03:37
*** ducttape_ has joined #openstack-nova03:43
*** ayoung has quit IRC03:47
*** dikonoor has joined #openstack-nova03:48
*** akshai_ has quit IRC03:48
*** raunak has quit IRC03:48
*** su_zhang has quit IRC03:48
*** chrichip has quit IRC03:48
*** raunak has joined #openstack-nova03:48
*** su_zhang has joined #openstack-nova03:48
*** ducttape_ has quit IRC03:49
*** su_zhang has quit IRC03:53
*** salv-orlando has joined #openstack-nova03:53
*** salv-orlando has quit IRC03:56
*** ljxiash has quit IRC03:56
*** ljxiash has joined #openstack-nova03:56
*** ljxiash has quit IRC04:00
*** amotoki has quit IRC04:01
*** ljxiash has joined #openstack-nova04:03
*** jamielennox is now known as jamielennox|away04:05
*** su_zhang has joined #openstack-nova04:07
*** hemanthm is now known as hemanthm|away04:08
*** ljxiash has quit IRC04:08
*** Sukhdev has quit IRC04:09
*** yamahata has joined #openstack-nova04:11
*** fragatina has quit IRC04:14
*** amotoki has joined #openstack-nova04:16
*** ekuris has joined #openstack-nova04:19
*** dimtruck is now known as zz_dimtruck04:22
*** unicell has joined #openstack-nova04:22
*** baoli has quit IRC04:24
*** su_zhang has quit IRC04:24
*** su_zhang has joined #openstack-nova04:24
*** unicell has quit IRC04:27
*** unicell has joined #openstack-nova04:27
*** su_zhang has quit IRC04:28
*** thorst has joined #openstack-nova04:30
*** prateek has quit IRC04:30
*** ssurana has joined #openstack-nova04:30
*** links has joined #openstack-nova04:32
*** fragatina has joined #openstack-nova04:34
*** krtaylor has quit IRC04:34
*** thorst has quit IRC04:37
*** NobodyCam has quit IRC04:38
*** scottda has quit IRC04:38
*** zhiyan has quit IRC04:38
*** nikhil has quit IRC04:38
*** betherly has quit IRC04:38
*** sballe_ has quit IRC04:38
*** junjie has quit IRC04:38
*** fmccrthy has quit IRC04:38
*** vdrok has quit IRC04:38
*** pbandark has joined #openstack-nova04:39
*** scottda has joined #openstack-nova04:40
*** Cassowary has quit IRC04:40
*** junjie has joined #openstack-nova04:40
*** nikhil has joined #openstack-nova04:40
*** zhiyan has joined #openstack-nova04:40
*** vdrok has joined #openstack-nova04:40
*** sballe_ has joined #openstack-nova04:40
*** betherly has joined #openstack-nova04:40
*** fmccrthy has joined #openstack-nova04:41
*** NobodyCam has joined #openstack-nova04:41
*** zz_dimtruck is now known as dimtruck04:42
*** yamahata has quit IRC04:42
*** ducttape_ has joined #openstack-nova04:45
*** McNinja has quit IRC04:46
*** ManishD has joined #openstack-nova04:48
*** ratailor has joined #openstack-nova04:49
*** ducttape_ has quit IRC04:50
*** McNinja has joined #openstack-nova04:52
*** Cassowary has joined #openstack-nova04:52
*** yamahata has joined #openstack-nova04:54
*** mamandle has joined #openstack-nova04:55
ratailorCan anybody pl review https://review.openstack.org/#/c/312887/04:56
*** moshele has joined #openstack-nova04:57
*** pcaruana has quit IRC04:57
*** wangqun_ has joined #openstack-nova04:59
*** wangqun has quit IRC05:00
*** prateek has joined #openstack-nova05:00
openstackgerritOpenStack Proposal Bot proposed openstack/nova: Updated from global requirements  https://review.openstack.org/36387105:00
*** ecelik has joined #openstack-nova05:02
*** salv-orlando has joined #openstack-nova05:03
*** carl_baldwin has quit IRC05:03
*** dougwig has quit IRC05:03
*** ediardo has quit IRC05:03
*** cargonza has quit IRC05:04
*** jamielennox|away is now known as jamielennox05:04
*** ediardo has joined #openstack-nova05:04
*** carl_baldwin has joined #openstack-nova05:04
*** rama_y has joined #openstack-nova05:05
*** cargonza has joined #openstack-nova05:06
*** dimtruck is now known as zz_dimtruck05:06
*** harlowja_at_home has joined #openstack-nova05:06
*** rama_y has quit IRC05:06
*** dougwig has joined #openstack-nova05:07
*** rama_y has joined #openstack-nova05:07
*** salv-orlando has quit IRC05:10
*** macsz has quit IRC05:13
*** fyxim has quit IRC05:13
*** rmcadams has quit IRC05:13
*** andrewbogott has quit IRC05:13
*** rstarmer has joined #openstack-nova05:13
*** salv-orlando has joined #openstack-nova05:14
*** rmcadams has joined #openstack-nova05:14
*** macsz has joined #openstack-nova05:14
*** fyxim has joined #openstack-nova05:14
*** andrewbogott has joined #openstack-nova05:15
*** rstarmer has quit IRC05:15
openstackgerritSlawek Kaplonski proposed openstack/nova: Fix race condition bug during live_snapshot  https://review.openstack.org/36392605:20
*** fragatin_ has joined #openstack-nova05:22
*** sdake has joined #openstack-nova05:23
*** fragatina has quit IRC05:25
*** raunak has quit IRC05:27
*** maestropandy has joined #openstack-nova05:28
*** zerda2 has joined #openstack-nova05:31
*** nkrinner_afk is now known as nkrinner05:32
*** ljxiash has joined #openstack-nova05:32
openstackgerritviswesuwara nathan proposed openstack/python-novaclient: Fix incorrect output of "nova show" for long user data  https://review.openstack.org/36230305:34
*** thorst has joined #openstack-nova05:35
*** prateek has quit IRC05:35
*** prateek has joined #openstack-nova05:36
*** ihrachys has joined #openstack-nova05:42
*** thorst has quit IRC05:42
*** mjura has joined #openstack-nova05:42
*** zz_dimtruck is now known as dimtruck05:42
*** Hosam_ has joined #openstack-nova05:43
*** wanghao_ has joined #openstack-nova05:43
*** ducttape_ has joined #openstack-nova05:46
*** ducttape_ has quit IRC05:50
*** harlowja_at_home has quit IRC05:51
*** mjura has quit IRC05:51
*** mjura has joined #openstack-nova05:51
*** TravT_ has joined #openstack-nova05:52
*** yamahata has quit IRC05:52
*** TravT has quit IRC05:55
*** hoangcx has joined #openstack-nova05:56
*** mingyu has quit IRC05:57
*** edmondsw has joined #openstack-nova05:59
*** edmondsw has quit IRC06:00
*** Sukhdev has joined #openstack-nova06:01
*** maestropandy has left #openstack-nova06:01
*** coolsvap has joined #openstack-nova06:05
*** paul-carlton2 has joined #openstack-nova06:06
*** BharatK_ has joined #openstack-nova06:06
*** kylek3h has quit IRC06:07
*** kylek3h has joined #openstack-nova06:08
*** rcernin has quit IRC06:08
*** dakhmetov has quit IRC06:08
*** salv-orl_ has joined #openstack-nova06:08
*** avolkov`` has quit IRC06:09
*** salv-orlando has quit IRC06:11
*** kylek3h has quit IRC06:12
*** dinobot_ has joined #openstack-nova06:13
*** mamandle has quit IRC06:14
*** divyakkonoor has joined #openstack-nova06:18
*** oanson has joined #openstack-nova06:18
*** Jeffrey4l__ is now known as Jeffrey4l06:19
*** dulek_ has joined #openstack-nova06:20
*** ljjjustin has quit IRC06:21
*** dulek has quit IRC06:21
*** dulek_ is now known as dulek06:21
*** ljjjustin has joined #openstack-nova06:21
*** dikonoor has quit IRC06:21
*** gszasz has joined #openstack-nova06:25
*** paul-carlton2 has quit IRC06:25
*** pcaruana has joined #openstack-nova06:30
*** ihrachys has quit IRC06:33
*** lpetrut has joined #openstack-nova06:35
*** paul-carlton2 has joined #openstack-nova06:36
*** sahid has joined #openstack-nova06:37
*** thorst has joined #openstack-nova06:40
*** zenoway has joined #openstack-nova06:40
*** ljxiash has quit IRC06:41
*** rcernin has joined #openstack-nova06:41
*** ljxiash has joined #openstack-nova06:41
*** dinobot_ has quit IRC06:41
*** sridharg has joined #openstack-nova06:42
*** Sukhdev has quit IRC06:42
*** rcernin has quit IRC06:45
*** rcernin has joined #openstack-nova06:45
*** TravT has joined #openstack-nova06:45
*** ljxiash has quit IRC06:46
*** kaisers_ has joined #openstack-nova06:46
*** ducttape_ has joined #openstack-nova06:47
*** thorst has quit IRC06:47
*** TravT_ has quit IRC06:48
*** salv-orl_ has quit IRC06:50
*** hoangcx has quit IRC06:52
*** hoangcx_ has joined #openstack-nova06:52
*** ducttape_ has quit IRC06:52
*** Hosam has joined #openstack-nova06:52
*** hferenc has quit IRC06:55
*** Hosam_ has quit IRC06:56
*** ljxiash has joined #openstack-nova06:57
*** dinobot_ has joined #openstack-nova06:57
*** oanson has quit IRC07:00
*** claudiub has joined #openstack-nova07:01
*** tesseract- has joined #openstack-nova07:03
*** mingyu has joined #openstack-nova07:03
*** mingyu has quit IRC07:04
*** andreas_s has joined #openstack-nova07:05
*** mingyu has joined #openstack-nova07:05
*** rama_y has quit IRC07:06
*** rama_y has joined #openstack-nova07:06
*** sudipto has joined #openstack-nova07:08
*** rama_y has quit IRC07:08
*** kylek3h has joined #openstack-nova07:08
*** rama_y has joined #openstack-nova07:08
*** kylek3h has quit IRC07:14
*** sudipto has quit IRC07:15
*** lpetrut has quit IRC07:17
*** jamielennox is now known as jamielennox|away07:17
*** ssurana has quit IRC07:18
*** BharatK_ has quit IRC07:18
*** sridharg has quit IRC07:19
*** markus_z has joined #openstack-nova07:20
*** dimtruck is now known as zz_dimtruck07:22
*** jlvillal has quit IRC07:22
*** rama_y has quit IRC07:23
*** jlvillal has joined #openstack-nova07:23
*** rama_y has joined #openstack-nova07:24
*** praneshp has quit IRC07:26
*** unicell has quit IRC07:26
*** lpetrut has joined #openstack-nova07:26
*** unicell has joined #openstack-nova07:27
*** rama_y has quit IRC07:29
*** bkopilov has quit IRC07:30
*** phuongnh has quit IRC07:30
*** phuongnh has joined #openstack-nova07:31
*** roeyc has joined #openstack-nova07:33
*** hoangcx_ has quit IRC07:35
*** ljxiash has quit IRC07:39
*** hoangcx has joined #openstack-nova07:40
*** apuimedo has joined #openstack-nova07:40
*** bkopilov has joined #openstack-nova07:40
*** ihrachys has joined #openstack-nova07:41
apuimedohieulq: ping07:41
*** ljxiash has joined #openstack-nova07:42
apuimedoI saw you worked on nova/conf/neutron.py and I wanted to ask about it07:43
*** mgoddard has joined #openstack-nova07:43
apuimedosince when I run the tox -egenconfig I do not see the neutron section get generated in the sample config file07:43
*** sdake has quit IRC07:43
*** ljxiash has quit IRC07:43
*** sdake has joined #openstack-nova07:44
*** sameo has joined #openstack-nova07:44
*** thorst has joined #openstack-nova07:45
*** lpetrut has quit IRC07:47
*** sridharg has joined #openstack-nova07:47
*** ljxiash has joined #openstack-nova07:47
*** ducttape_ has joined #openstack-nova07:49
*** phuongnh has quit IRC07:50
openstackgerritAugustina Ragwitz proposed openstack/nova: Assume neutron port_binding extensions enabled  https://review.openstack.org/35772607:51
openstackgerritAugustina Ragwitz proposed openstack/nova: Use admin context to create neutron ports  https://review.openstack.org/35754007:51
* auggy passes out07:51
*** salv-orlando has joined #openstack-nova07:51
*** paul-carlton2 has quit IRC07:52
*** thorst has quit IRC07:52
*** paul-carlton2 has joined #openstack-nova07:52
*** ducttape_ has quit IRC07:53
openstackgerritedan david proposed openstack/nova: WIP: Assign mac address to vf interface  https://review.openstack.org/36412107:53
openstackgerritJiWei proposed openstack/nova: 'unmap' is written without considering the configuration  https://review.openstack.org/36412207:53
*** liverpooler has joined #openstack-nova07:54
*** ihrachys has quit IRC07:55
*** edand has joined #openstack-nova07:55
*** zzzeek has quit IRC08:00
*** salv-orlando has quit IRC08:00
*** ljjjustin has quit IRC08:00
*** zehua has quit IRC08:00
*** zzzeek has joined #openstack-nova08:00
*** paul-carlton2 has quit IRC08:00
*** jaosorior has joined #openstack-nova08:04
*** hoangcx has quit IRC08:05
*** avolkov has joined #openstack-nova08:05
*** mamandle has joined #openstack-nova08:07
*** oanson has joined #openstack-nova08:11
*** matrohon has joined #openstack-nova08:12
*** mingyu has quit IRC08:14
*** BharatK has joined #openstack-nova08:15
*** BharatK has quit IRC08:16
*** BharatK has joined #openstack-nova08:17
*** diga has joined #openstack-nova08:18
*** paul-carlton2 has joined #openstack-nova08:18
*** BharatK has quit IRC08:24
*** sudipto has joined #openstack-nova08:24
*** Hosam_ has joined #openstack-nova08:25
*** sudipto has quit IRC08:27
*** BharatK has joined #openstack-nova08:28
*** Hosam has quit IRC08:29
*** sudipto has joined #openstack-nova08:30
*** rkmrhj has joined #openstack-nova08:33
*** Hosam has joined #openstack-nova08:35
*** priteau has joined #openstack-nova08:37
*** lucas-dinner is now known as lucasagomes08:38
johnthetubaguysdague: yeah, that made me ask the question, didn't catch the debate on that... I thought it was odd that could be None.08:38
*** Hosam_ has quit IRC08:39
rkmrhjSorry to write so late at night. I uploaded 2 bug-fixes to gerrit about 3 weeks ago. But the reviewer who reviewed my patches is only one person.08:44
rkmrhjIs there someone who can review my patches? My patches are https://review.openstack.org/#/c/354617/ and https://review.openstack.org/#/c/327001/ .08:45
*** bkopilov has quit IRC08:45
*** houming has joined #openstack-nova08:46
*** sridharg has quit IRC08:48
*** ducttape_ has joined #openstack-nova08:49
*** thorst has joined #openstack-nova08:50
*** hwoarang_ has joined #openstack-nova08:54
*** derekh has joined #openstack-nova08:54
*** jhesketh_ has joined #openstack-nova08:54
*** HenryG_ has joined #openstack-nova08:54
*** ducttape_ has quit IRC08:54
*** amotoki_ has joined #openstack-nova08:55
*** jeblair_ has joined #openstack-nova08:55
*** kevinz has quit IRC08:56
*** jlvillal_ has joined #openstack-nova08:57
*** toabctl_ has joined #openstack-nova08:57
*** kevinz has joined #openstack-nova08:57
*** thorst has quit IRC08:57
*** sudipto has quit IRC08:58
*** jlvillal has quit IRC08:58
*** dulek has quit IRC08:58
*** amotoki has quit IRC08:58
*** cmartin has quit IRC08:58
*** Fdaisuke has quit IRC08:58
*** lennyb has quit IRC08:58
*** cfriesen has quit IRC08:58
*** kswiatek has quit IRC08:58
*** jhesketh has quit IRC08:58
*** darrenc has quit IRC08:58
*** tpatzig_ has quit IRC08:58
*** gstepanov__ has quit IRC08:58
*** lamt has quit IRC08:58
*** raj_singh has quit IRC08:58
*** mat128 has quit IRC08:58
*** bapalm has quit IRC08:58
*** HenryG has quit IRC08:58
*** anteaya has quit IRC08:58
*** brad[] has quit IRC08:58
*** aloga has quit IRC08:58
*** jeblair has quit IRC08:58
*** niedbalski has quit IRC08:58
*** Anticimex has quit IRC08:58
*** eliqiao has quit IRC08:58
*** ejat has quit IRC08:58
*** hwoarang has quit IRC08:58
*** toabctl has quit IRC08:58
*** jgrassler has quit IRC08:58
*** toabctl_ is now known as toabctl08:58
*** salv-orlando has joined #openstack-nova08:58
*** bapalm has joined #openstack-nova08:59
*** mat128 has joined #openstack-nova08:59
*** toabctl has quit IRC08:59
*** Anticimex has joined #openstack-nova09:00
*** aloga has joined #openstack-nova09:00
*** Fdaisuke has joined #openstack-nova09:00
*** toabctl has joined #openstack-nova09:00
*** jlvillal_ is now known as jlvillal09:00
*** sridharg has joined #openstack-nova09:00
*** jlvillal is now known as Guest7795609:01
*** salv-orlando has quit IRC09:01
*** sudipto has joined #openstack-nova09:03
*** dulek has joined #openstack-nova09:03
*** lennyb has joined #openstack-nova09:03
*** cfriesen has joined #openstack-nova09:03
*** kswiatek has joined #openstack-nova09:03
*** darrenc has joined #openstack-nova09:03
*** tpatzig_ has joined #openstack-nova09:03
*** gstepanov__ has joined #openstack-nova09:03
*** lamt has joined #openstack-nova09:03
*** raj_singh has joined #openstack-nova09:03
*** anteaya has joined #openstack-nova09:03
*** brad[] has joined #openstack-nova09:03
*** niedbalski has joined #openstack-nova09:03
*** eliqiao has joined #openstack-nova09:03
*** ejat has joined #openstack-nova09:03
*** jgrassler has joined #openstack-nova09:05
*** salv-orlando has joined #openstack-nova09:05
*** cdent has joined #openstack-nova09:05
*** zenoway has quit IRC09:07
*** kylek3h has joined #openstack-nova09:09
*** salv-orlando has quit IRC09:10
*** zenoway has joined #openstack-nova09:12
*** ecelik has quit IRC09:12
*** mvk has joined #openstack-nova09:13
bauzasp!spy09:14
*** kylek3h has quit IRC09:14
*** sridharg has quit IRC09:14
*** sudipto has quit IRC09:15
*** sridharg has joined #openstack-nova09:15
openstackgerritRong Han proposed openstack/nova-specs: iAdd a parameter of availability zone for live-migration  https://review.openstack.org/36417909:16
*** HenryG_ is now known as HenryG09:17
openstackgerritRong Han proposed openstack/nova-specs: Add a parameter of availability zone for live-migration  https://review.openstack.org/36417909:17
kashyapslaweq: Hey, oh, so that was the wrong log?  Did you follow my analysis in comment#13?09:18
*** BharatK has quit IRC09:20
*** zenoway has quit IRC09:21
kashyapI'll let you upload another log that exhibits the issue, as you said in comment#14.09:21
*** lpetrut has joined #openstack-nova09:22
*** ihrachys has joined #openstack-nova09:25
*** Hosam_ has joined #openstack-nova09:27
*** HenryG has quit IRC09:29
*** HenryG has joined #openstack-nova09:29
*** mingyu has joined #openstack-nova09:30
*** zenoway has joined #openstack-nova09:30
*** Hosam has quit IRC09:31
*** hwoarang_ is now known as hwoarang09:31
*** Hosam has joined #openstack-nova09:33
*** mingyu has quit IRC09:34
*** roeyc has quit IRC09:34
*** wangqun_ has quit IRC09:35
*** Hosam_ has quit IRC09:37
*** abhishekk has quit IRC09:38
*** mingyu has joined #openstack-nova09:39
*** zenoway has quit IRC09:39
*** TravT_ has joined #openstack-nova09:40
*** TravT has quit IRC09:43
*** salv-orlando has joined #openstack-nova09:45
*** daemontool has joined #openstack-nova09:45
*** sdague has joined #openstack-nova09:46
*** diga has quit IRC09:49
openstackgerritPawel Koniszewski proposed openstack/nova: Remove block_migration argument from live migration operations  https://review.openstack.org/29531609:50
openstackgerritPawel Koniszewski proposed openstack/nova: Remove block_migration from LM post operations  https://review.openstack.org/29531509:50
openstackgerritPawel Koniszewski proposed openstack/nova: Remove block_migration from LM rollback  https://review.openstack.org/29282609:50
*** ducttape_ has joined #openstack-nova09:50
cdentsdague, dansmith, johnthetubaguy : When you guys surface and/or have a moment there are some pending questions on desired behavior on https://review.openstack.org/#/c/363209/ (writing allocations) that need some shared brain to resolve. Thanks.09:52
*** ducttape_ has quit IRC09:54
*** thorst has joined #openstack-nova09:55
sdaguecdent: ok, just landing on my terminal, I need to finish this cup of coffee before that sql is going to even start to make sense to me09:57
*** mingyu has quit IRC09:57
openstackgerritPawel Koniszewski proposed openstack/nova: DO NOT MERGE - try to run LM tests with grenade  https://review.openstack.org/36420609:57
sdaguedid any client code appear yesterday?09:57
cdentsdague: no rush from my side, I assumed you weren't even here yet and was just leaving a message for the future09:58
sdaguecdent: no worries. :)09:58
*** mingyu has joined #openstack-nova09:58
cdentmy understanding is that jay crashed out around midnight last night after pushing the mass of sql, so I don't know about client code09:58
sdagueok09:59
*** code-R has joined #openstack-nova09:59
cdentfor reasons unclear to me, I was up then, and did a first review on the sql stuff, edleafe fixed most of those things, and there are a few bits remaining, discovered just now, before it is soup10:01
sdagueok cool10:01
*** sdake has quit IRC10:01
*** zenoway has joined #openstack-nova10:02
sdaguecdent: question... about the wsgi stack10:02
* cdent listens10:02
sdagueI was looking at stuff in keystone to cross reference10:02
*** thorst has quit IRC10:03
sdagueis there a reason that you didn't @webob.dec.wsgify the __call__ in handler?10:03
* cdent tries to remember10:03
sdaguebecause that seems to be the common pattern so that you are dealing with requests earlier10:03
openstackgerritChris Dent proposed openstack/nova: Add {get_,set_}aggregates to objects.ResourceProvider  https://review.openstack.org/35526310:03
sdagueit seems like every dispatch function is decorated that way10:03
sdagueand it explains why I felt a little lost on some stuff yesterday10:04
sdagueif there is a reason, that's cool. But if not, it might be better to pull that up one layer.10:04
*** Hosam_ has joined #openstack-nova10:06
*** zenoway has quit IRC10:07
cdentIt's because of the way dispatch is called to handle the 405-maintaining of the routing and then goes on to call the dispatched-to-handlers. That preserve the wsgi interface down into the whatever gets dispatched-to, so that it is possible to have "apps" which are just regular wsgi things that we didn't right ourselves (not that that's expected, but I thought it worthwhile to preserve WSGI at the dispatching layer).10:07
cdentsigh10:07
cdents/right/write/10:07
openstackgerritOpenStack Proposal Bot proposed openstack/nova: Updated from global requirements  https://review.openstack.org/36387110:08
*** rmart04 has joined #openstack-nova10:09
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: [WIP] Testing latest u-c  https://review.openstack.org/30334510:10
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: [WIP] Testing latest u-c  https://review.openstack.org/30334510:10
*** Hosam has quit IRC10:10
cdentthe hope was that for most people doing maintenance of existing handlers or creation of new ones the only thing they need to worry about is updating the DECLARATIONS and go change/create their handler that does their thing10:10
cdentsdague: the mental model is that each method on each url is its own indepdendent application10:10
cdent(that happens to reuse stuff by way of middleware and things in the environ)10:11
openstackgerritChris Dent proposed openstack/nova: Implement get and set aggregates in the placement API  https://review.openstack.org/35799310:11
sdagueright, so everywhere else I've seen in openstack, we wsgify early10:12
sdagueso you are typically working with a req directly10:12
sdagueyou can always get environ back from the req10:12
*** code-R_ has joined #openstack-nova10:13
*** rkmrhj has quit IRC10:13
sdagueI think that if you want to inject something new that's wsgi raw, that's kind of what the middleware pipeline is for10:13
*** zenoway has joined #openstack-nova10:14
*** code-R has quit IRC10:16
cdentthat doesn't work if what you want to inject is a raw wsgi endpoint10:16
cdentit could certainly change, but I think it would be step in the wrong direction10:17
cdentit takes things away from being generic and standard-following to being implementation specific, which means that changing things later becomes more complex. A thing we want to preserve is the ability to make structural changes with low cost when we realize that something is not what we want.10:18
cdentConsider, for example, the ways in which a breadth and depth commitment to WSME (instead of a tool-oriented) approach has made things a lot harder for some of the projects.10:18
sdaguesure, but converting to req early isn't wsme10:19
sdagueand in 6 years of practice, it's never gotten in the way10:19
*** riccardo has joined #openstack-nova10:19
*** jhesketh_ is now known as jhesketh10:20
cdentCan you explain again what problem or issue doing so would solve?10:20
cdent(btw, i'm making food so I'm back and forth)10:22
sdagueit would remove a gratuitous difference here from the rest of openstack. I get there are times to be different when you get a huge gain out of it. But I don't see the gain here.10:23
sdagueand things like request logging would be a lot less silly if we'd already wsgified. Doing that was the first time I realized some of the implications here of pushing the wsgify down a layer10:23
*** pilgrimstack has quit IRC10:24
*** maestropandy1 has joined #openstack-nova10:25
*** tbachman has quit IRC10:26
*** pilgrimstack has joined #openstack-nova10:27
*** scsnow has joined #openstack-nova10:27
riccardohi community, I have a Nova extension that I wanted to port from Juno to Mitaka. Now, I got informed that extensions are not anymore the right way. Therefore I would like to ask if there is a tutorial to build a new service and where i can get support. The idea (may be in a second step) is also to publish the service in oder that other OpenStack user can use and benefit from it.10:28
*** murali__ has joined #openstack-nova10:28
murali__Someone please have a look at this and let me know ur thoughts10:28
murali__https://ask.openstack.org/en/question/96376/nova-docker-setup-in-devstack/10:28
murali__I am trying for fixing this, Bt nothing of any help10:29
cdentsdague: is there a version of your logging bits already in gerrit somewhere?10:30
sdagueyes, it's already approved, in a recheck10:31
sdaguehttps://review.openstack.org/#/c/363130/10:31
*** pilgrimstack has quit IRC10:31
* cdent looks10:31
sdagueanyway, when I backed the decision on not using a framework like flask, I did not actually expect this to go so far from the norms. But the further this is away from norms, the slower the reviews will be, because people have to switch up thinking about the world10:33
cdents/norms/local norms/10:34
sdaguecdent: sure, but that's the point10:34
sdaguewe've got a community, being different without huge gains means mostly not caring about people's review bw, because you just made them all do extra work10:35
cdentSo on that logging, can you explain to me why we want the wsgi application to do request logging when that is usually the job of the wsgi server? I'm not being snarky, I'm genuinely trying to understand.10:35
sdagueand at a certain point, they just don't10:35
sdaguebecause the wsgi doesn't log really important things10:35
sdaguelike request-id10:35
sdagueand project/tenant10:36
sdagueuser10:36
cdentlet's not go down that pathway, sdague, this code has been under review for six months. If you wanted it to be different you could have said a lot more then instead of now on the day of ff.10:36
cdentI want it to be good and correct and make people happy. I'll try to make it so, and hopefully other people will too.10:37
sdaguesure, which is why I'm asking for a change (post ff) to realign this10:38
cdentsecond question on the logging: why isn't done as middleware?10:38
ratailorcan anyone review, https://review.openstack.org/#/c/312887/ , its hanging since log.10:38
cdentor what I mean is: is there a reason why?10:38
sdaguecdent: maybe it could be, but it's in the main path in the rest of the projects10:38
*** EinstCrazy has quit IRC10:40
*** Qiming has quit IRC10:40
*** ljxiash has quit IRC10:40
*** hehx has quit IRC10:40
*** chenfei has quit IRC10:40
sdaguewhich means it's a pattern we know kind of works for real in the field, and don't have to guess about when things are skipped past in the chain, or translated in a way we don't anticipate10:41
cdentsdague: You know, I've been trying really hard to make openstack, especially bits of nova, _better_ in ways that are commonly recognized as better and it is a constant fight against them needing to be the same as things are already done. I understand the perceived benefits of that, but it is active friction against  a culture of improvement. 10:41
*** pilgrimstack has joined #openstack-nova10:41
*** FL1SK has quit IRC10:41
cdentAnd I know you do too10:41
cdent(try really hard to make things better)10:41
cdentbut I'm fucking burnt10:41
*** hehx has joined #openstack-nova10:41
*** ljxiash has joined #openstack-nova10:42
cdentThere has been zero about nova experience which makes me want to recommend working on it to anyone.10:42
cdentBut I keep soldiering on. I'm not sure why.10:42
*** trisq has quit IRC10:45
*** Qiming has joined #openstack-nova10:45
*** chenfei has joined #openstack-nova10:46
*** sudipto has joined #openstack-nova10:47
*** Hosam has joined #openstack-nova10:47
*** gongysh has quit IRC10:49
*** Hosam_ has quit IRC10:50
*** maestropandy1 has quit IRC10:50
*** ducttape_ has joined #openstack-nova10:51
*** roeyc has joined #openstack-nova10:52
*** sridharg has quit IRC10:55
*** ducttape_ has quit IRC10:55
*** salv-orlando has quit IRC10:58
*** thorst has joined #openstack-nova11:00
cdentsdague: I've put looking at refactoring the logging on my todo for some near future time11:04
riccardohi, I have a Nova extension that I want to port from Juno to Mitaka. Now, I got informed that extensions are not anymore the right way to add new functionalities. Therefore I would like to ask if there is a tutorial to build a new service. The idea (may be in a second step) is also to publish the service in oder that other OpenStack user can use and benefit from it. Basically it is a "fairness service" that reallocates virtual resources during11:05
riccardoruntime to enforce fairness among cloud users.11:05
sdagueok11:05
*** paul-carlton2 has quit IRC11:06
sdaguericcardo: there isn't as of yet. It would be a good thing to exist.11:06
sdaguethe tutorial that is11:06
*** thorst has quit IRC11:08
*** kylek3h has joined #openstack-nova11:10
riccardosdague: ok, thx11:10
riccardoA former student did an extension to the Nova service for Juno: https://github.com/savf/novafairness (see the nova/fairness folder). Now I want to take away from Nova and have it as a separate service. Is there some framework that I can utilize and put my own code in order to build this new service?11:14
*** gcb has joined #openstack-nova11:14
riccardothe fairness service11:15
slaweqkashyap: hello11:15
kashyapslaweq: Yes?11:16
slaweqI just uploaded new libvirt log in https://bugs.launchpad.net/nova/+bug/1530275 - this one is from failed attempt to create live_snapshot11:16
openstackLaunchpad bug 1530275 in OpenStack Compute (nova) "Live snapshot is corrupted (possibly race condition?)" [Undecided,In progress] - Assigned to Slawek Kaplonski (slaweq)11:16
slaweqkashyap: and also I propose some fix for that: https://review.openstack.org/#/c/363926/11:16
slaweqmaybe You could take a look on it?11:17
kashyapslaweq: Let me look.  So, this is the log from a corrupted snapshot?11:17
slaweqyes11:17
slaweqsnapshot image got different size (smaller) then image created properly (with my patch)11:18
slaweqand I can't boot vm from this broken snapshot (I have info that filesystem is corrupted there)11:18
*** rtheis has joined #openstack-nova11:18
kashyapslaweq: Ah-ha, indeed, in this case, as you can see the 'block-job-cancel' was issued too soon11:19
slaweqkashyap: I was trying to make thi log as small as possible but I have many instance on host and there is a lot of logged messages there11:20
kashyapslaweq: No worries, I found what I was looking for11:20
*** paul-carlton2 has joined #openstack-nova11:20
sdaguericcardo: ok, sure. The reality is we should have something like an openstack-service-cookiecutter under openstack-dev, however no one has gotten there yet11:20
kashyapslaweq: If you see the request id "libvirt-14" from the failed log, where QEMU is queried to check the block operation status, it reports as "ready": false11:21
*** bvanhav has joined #openstack-nova11:21
kashyapslaweq: Following that, with ID "libvirt-15", libvirt aborts the snapshot operation  with 'block-job-cancel'11:22
slaweqyes, I see11:22
kashyapWithout waiting for "ready": true11:22
kashyapHence, it seems to be corrupted11:22
slaweqyes, and in nova it is "visible" as status.end = 011:22
slaweqand status.cur = 011:22
slaweqso nova finish waiting for job completed and starts extracts snapshot11:23
slaweqwhich is wrong11:23
slaweqif nova would wait littlebit more, snapshot is created fine then11:23
*** ljxiash has quit IRC11:23
kashyapslaweq: Exactly11:24
slaweqgreat that You can confirm this issue :)11:24
riccardosdague: I am not sure if I understand. Do you mean that it is just not common to build a new service, so there is no documentation?11:24
sdaguericcardo: that there is no documentation11:24
sdagueit it quite common, seeing how many projects exist in openstack11:25
sdaguebut, there is no easy guide for building a new one right now. That mostly just comes from reading whats out there.11:25
tdurakovhi folks11:25
*** thorst has joined #openstack-nova11:26
sdaguetdurakov: is it always the live migration test that's falling over?11:26
riccardosdague: I see. I am very new to the OpenStack community and have very little idea on how to do it. Any hint is highly appreciate.11:26
*** zerda2 has quit IRC11:26
sdaguericcardo: ok, well today is feature freeze, so this is a bad week to ask those questions11:26
tdurakovsdague: for nfs?11:26
tdurakovor for no-shared storage case?11:26
sdaguetdurakov: just subnode connecting11:27
sdaguetdurakov: something is up with subnodes not being accessible - http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22Killed%20timeout%20-s%209%5C%22%20AND%20build_name:*multinode*11:27
sdaguewhich is causing multinode jobs to time out at 3 hours11:27
riccardosdague: OK, I understand. then I will first investigate more by myself. Do you have any suggestion of a small service where i can study the structure?11:28
tdurakovsdague: haven't seen that before11:28
*** roeyc has quit IRC11:29
tdurakovsdague: it's for gate-tempest-dsvm-neutron-multinode-full job right?11:29
tdurakovare there any specific options for that?11:29
*** maestropandy has joined #openstack-nova11:30
*** roeyc has joined #openstack-nova11:30
tdurakovfrom logstash I see that valid for multinode-full and neutron multinode, and it doesn't affect live-migration job11:31
*** maestropandy has left #openstack-nova11:31
*** sudipto has quit IRC11:32
sdaguetdurakov: ok, just starting to investigate, over in #openstack-infra to figure this out11:32
*** lucasagomes is now known as lucas-hungry11:33
riccardoHi guys, I know you are all very busy with the today's feature freeze. So, I don't wanna bother you anymore for today. But maybe anybody has suggestion where I can find a small OpenStack example service where I can study the structure. I would like to build a new service.11:34
mdboothsdague: Have you come across the issue with python-cryptography in liberty's upper constraints?11:34
mdboothsdague: It's this: https://github.com/pyca/cryptography/issues/275011:35
mdboothEssentially, it means that python-cryptography < 1.2.3 is no longer buildable against patched openssl11:35
sdaguemdbooth: I have not11:35
mdboothBut we're pinning it at 1.1.2 iirc11:36
sdaguemdbooth: well, you could look at bumping the upper constraints. By policy we don't do that automatically because it breaks things. But doing so for good reason (like this one) is probably fine11:37
mdboothI've confirmed locally that upping that pin to 1.2.3 builds, but wondering what the process would be.11:37
sdaguemdbooth: just propose the patch to upper-constraints.txt on the appropriate branch11:37
kashyapmdbooth: IIRC, in the past I just submitted it to stable, and let the comments roll on the review11:37
sdaguewith a detailed commit message on why11:37
mdboothsdague kashyap: Will do, thanks11:37
sdaguemdbooth: np11:37
*** moshele has quit IRC11:38
*** sudipto has joined #openstack-nova11:38
*** baoli has joined #openstack-nova11:41
*** rfolco has joined #openstack-nova11:41
*** baoli_ has joined #openstack-nova11:42
*** Kevin_Zheng has quit IRC11:42
*** baoli has quit IRC11:46
*** ManishD has quit IRC11:47
*** gongysh has joined #openstack-nova11:49
*** ljxiash has joined #openstack-nova11:49
mdboothsdague: https://review.openstack.org/36424911:50
mdboothWhat tests will run against that, out of curiosity?11:50
sdaguea bunch of full stack tests11:51
sdagueso devstack + tempest in a set of different configs11:52
*** ducttape_ has joined #openstack-nova11:52
mdboothIf anybody is familiar with python ffi, I'm also really curious to know why python-cryptography embeds function signatures from an external library. I assume there's a really good reason for it, but at first glance it looks pretty evil.11:54
mdboothThey're passed to ffi.cdef(). I'm guessing that doesn't something magical which means a #include doesn't work.11:55
mdbooths/doesn't/does/11:55
*** Kevin_Zheng has joined #openstack-nova11:56
*** ducttape_ has quit IRC11:56
sdaguemdbooth: dstuft probably understands all the cffi stuff better than anyone else11:58
sdagueiirc cryptopgraphy was one of the early users, and yes, a lot of thinks are a bit funky with it11:59
*** rfolco has quit IRC11:59
*** edand has quit IRC12:00
jrollmdbooth: #cryptography-dev is usually pretty friendly, too, if you want to bug them12:00
mdboothjroll: Nah, just scratching an itch :)12:00
*** rfolco has joined #openstack-nova12:00
jrollheh, right on12:00
alex_xuquestion: we freeze at 9/2 morning or the end of 9/212:01
sdaguealex_xu: good question, we'll see what mriedem says when he gets up12:02
alex_xusdague: ok, cool12:02
alex_xusdague: johnthetubaguy, so just reminder, don't forget the last few API patches, https://review.openstack.org/356963 https://review.openstack.org/360943 https://review.openstack.org/32294412:03
sdagueright now, we're not landing any more code for the release, because of a multinode issue12:03
alex_xu:(12:03
sdagueso unless that gets sorted, it doesn't really matter12:03
*** zengine has joined #openstack-nova12:04
*** jaosorior has quit IRC12:06
*** jaosorior has joined #openstack-nova12:06
*** pradk has joined #openstack-nova12:09
*** mingyu has quit IRC12:09
tdurakovhas anyone seen PaulMurray today?12:11
*** ducttape_ has joined #openstack-nova12:11
tdurakovjroll: hello, could you please review these series https://review.openstack.org/#/c/347948/ ?12:12
*** ducttape_ has quit IRC12:13
jrolltdurakov: it's on my todo list for this week, it's been a busy one, sorry12:13
tdurakovjroll: no worries, thanks in advance12:13
*** mingyu has joined #openstack-nova12:13
jrollsdague: fwiw, matt said his plan was to submit the release by the end of today12:13
jrollidk if that's changed in the last 24h or so12:13
tdurakovpkoniszewski: hi12:13
*** riccardo has quit IRC12:14
*** trisq has joined #openstack-nova12:14
*** BharatK has joined #openstack-nova12:16
*** ducttape_ has joined #openstack-nova12:17
*** rfolco has quit IRC12:17
*** rfolco has joined #openstack-nova12:18
*** Hosam_ has joined #openstack-nova12:19
*** sridharg has joined #openstack-nova12:20
*** oanson has quit IRC12:20
*** lucas-hungry is now known as lucasagomes12:21
*** BharatK has quit IRC12:21
*** Hosam has quit IRC12:22
*** mamandle has quit IRC12:22
*** moshele has joined #openstack-nova12:24
*** kolesovdv has joined #openstack-nova12:29
*** ratailor has quit IRC12:29
*** mvk has quit IRC12:30
*** mdrabe has joined #openstack-nova12:31
bauzassdague: johnthetubaguy: so I think we need to have https://review.openstack.org/#/c/362766/5 merged before our N-3 cyt12:35
bauzascut12:35
bauzasif not, it would be sad for operatords12:35
bauzasand us needing to think about data migrations in Ocata12:35
*** ducttape_ has quit IRC12:35
bauzasso, I asked for a recheck (because I want to be sure our placement job is happy) but I'd ideally want to see how we could make sure we have that for Newton12:36
*** gongysh has quit IRC12:36
sdaguebauzas: no, we said that was off the table yesterday12:37
bauzasorly?12:37
*** mingyu has quit IRC12:38
bauzasI missed that, apologies12:38
cdentGiven the concerns raised on the same call about data correctness, I still think it is worth merging if people think it is acceptable code. Nobody _has_ to use it.12:38
*** prateek has quit IRC12:38
bauzascdent: tbh, I want to make sure our devstack job runs it12:39
sdaguebauzas: I don't want to stop and do the qa analysis to figure out if we're testing common case correctly12:39
sdagueand another branch here means that's even hard12:39
sdagueharder12:40
bauzassdague: I do understand12:40
sdaguewe were really trying to scope back to minimal needed for newton12:40
bauzasyeah, gotcha12:40
sdaguewhich still takes us past freeze, because we need the allocations reporting12:40
openstackgerritClaudiu Belu proposed openstack/nova: libvirt: fixes python 3 related unit tests  https://review.openstack.org/27883412:40
openstackgerritClaudiu Belu proposed openstack/nova: Fixes python 3 unit tests  https://review.openstack.org/27881012:40
bauzassdague: so, if we say the above is out for Newton, then I could write a devstack patch for using it12:40
sdaguealso, don't recheck anything right now, it will fail, because of osc. A work around is in the gate12:41
bauzassdague: oh my bad12:41
sdaguewhich was my last 1.5 hours12:41
*** FL1SK has joined #openstack-nova12:41
bauzasoops, haven't seen that :(12:41
cdentbauzas: the lib/placement code already has a variable that allows one to state "I want to use the placement db"12:41
sdagueyeh, sorry, didn't raise the issue as it was in the middle of debug12:42
cdent"PLACEMENT_DB_ENABLED"12:42
bauzascdent: okay, I need to look again the devstack code12:42
bauzasnice12:42
bauzasso just a job modification then12:42
openstackgerritClaudiu Belu proposed openstack/nova: numa: Fixes NUMA topology related unit tests  https://review.openstack.org/27883512:43
bauzassdague: yeah, and I apologize, I didn't paid tribute to the IRC conversations like as usual, today's my old daughter first day at 1st grade :)12:43
openstackgerritClaudiu Belu proposed openstack/nova: compute: fixes python 3 related unit tests  https://review.openstack.org/30026212:43
sdaguebauzas: no worries12:43
sdaguealso, congrats12:43
bauzaswell, I tried to ask our French ministry to delay that day because of the FeatureFreeze, but no luck... :)12:44
*** Kimmo___ is now known as Kimmo_12:44
bauzassdague: then, something else urgent to review before we cut ?12:46
sdaguebauzas: there are some api policy patches that alex_xu's got12:47
sdaguethe db part of the placement work from cdent12:47
sdagueI can't remember where the cell cut line currently is12:48
*** gcb has quit IRC12:48
bauzascdent: https://review.openstack.org/#/c/362863/ is the one ?12:48
edleafecdent: good point on checking for inventory on all RPs, not just that some records are found12:49
edleafeI can fix that, and add a test case for it12:49
cdentbauzas, sdague I thougt we punted on aggregates too (https://review.openstack.org/#/c/362863/) but if not, then yes, that needs review12:50
cdentedleafe: awesome thanks12:50
cdentedleafe: any ideas on the semantics riddle?12:50
*** sudipto has quit IRC12:50
*** markvoelker has joined #openstack-nova12:50
edleafecdent: yes - 'set' is more correct12:50
*** links has quit IRC12:51
edleafecdent: 'create' is simply 'create', wherease 'set' can also be 'update'12:51
*** efried has joined #openstack-nova12:51
*** gouthamr has joined #openstack-nova12:51
cdentedleafe: yeah, agree on that, but I meant the ordering of deleting compared to checking inventory12:51
edleafecdent: oh, that12:52
edleafecdent: I suppose it is better to delete first, then check for capacity, but I didn't want to refactor too much12:52
*** vladikr has joined #openstack-nova12:53
*** tbachman has joined #openstack-nova12:53
edleafecdent: I can do that, too, and re-jigger the flow so it doesn't seem so hacky12:53
cdentis it right though? what's your justification for that ordering?12:53
*** ducttape_ has joined #openstack-nova12:53
edleafecdent: the healing case12:54
cdentwhen we change an allocation do we need more space to accomodate both, or is it actually an atomic replace12:54
cdentbut what about the resize case?12:54
edleaferesize to the same RP?12:54
cdentyeah12:54
cdentthis is something that alaski had concerns about12:54
* alaski peeks in12:55
edleafeah, since both the old and new would have the same consumer_id12:55
sdaguecdent: yeh, I think we did punt on that12:55
cdentalaski your help would be appreciated on deciding something on : https://review.openstack.org/#/c/363209/12:56
pkoniszewskitdurakov: hello12:56
alaskiI'd go with blue12:56
*** houming has quit IRC12:56
cdentblue's such a conservative choice though. I was thinking either a matte black or an opalescent pearl12:56
edleafecdent: wouldn't that also be a problem when deleting the old, smaller vm? Calling delete_all with that consumer_id would wipe the bigger vm's allocations out, too12:57
alaskihmm, change it to glossy black and we have a deal12:57
edleafecdent: would we even have a way to distinguish the two?12:57
cdentedleafe: I don't know enough about the use case so I'm hoping when alaski gets done choosing his dress he can have a look12:57
mdboothsdague: So, that cryptography bump fails in the gate: http://logs.openstack.org/49/364249/1/check/gate-tempest-dsvm-neutron-full-ubuntu-trusty/1c4b8f0/logs/devstacklog.txt.gz12:57
tdurakovpkoniszewski: I will be on vacation next 2 weeks till Sept, 16, so just in case PaulMurray be away too, could you please chair live-migration meeting?12:57
cdentbecause it was his comments a few weeks ago that make me even think of it12:57
pkoniszewskitdurakov: sure12:58
alaskiI'm trying to find the relevant info. comments on PS 4?12:58
cdentlet me pinpint alask12:58
cdenti12:58
tdurakovpkoniszewski: thanks a lot:)12:58
edleafecdent: hmmm... well, I've only had my first pot of coffee, so I'll make some more and think about it12:58
mdboothThat's kinda awkward, though, because now we've got a situation where you need a different constraint depending on whether you patched openssl12:58
sdaguemdbooth: right, agreed. Is there a cffi bump you need as well?12:58
cdentalaski: patchset 5, line 79112:59
cdenthttps://review.openstack.org/#/c/363209/5/nova/objects/resource_provider.py@79112:59
cdentedleafe: sound advice, me too12:59
sdaguemdbooth: or are you saying that the fix in cryptography now makes it only work with new openssl?12:59
tdurakovsdague: have you figured out root cause for multinode?12:59
sdaguetdurakov: yes12:59
sdaguetdurakov: osc bug13:00
*** cdelatte has joined #openstack-nova13:00
tdurakovosc?13:00
mdboothActually, the error looks decidedly different.13:00
sdaguewhere it hangs forever on a password prompt13:00
mdboothAttributeError: 'CompiledFFI' object has no attribute 'def_extern'13:00
* mdbooth would have expected another error about differing function signatures13:00
tdurakovsdague: is it fixed already?13:01
sdagueit's in the gate13:01
mdboothPerhaps it's something else as you suggest. Will investigate more.13:01
*** mamandle has joined #openstack-nova13:01
tdurakovok13:01
sdaguedon't recheck yet13:01
sdaguemdbooth: yeh, I don't know, maybe stand up a liberty devstack and play with it to figure out if there is a requirements shuffle to get us past that13:01
*** efried has quit IRC13:02
alaskicdent: so in a resize scenario, which is the main trigger for an update afaik, there is a period where both allocations are needed. I'll have to check the data model but if it's a single entry then a resize will need to update to a size that accomadates old and new, then update down to just new after the resize is confirmed13:02
openstackgerritJiWei proposed openstack/nova: 'unmap' is written without considering the configuration  https://review.openstack.org/36412213:02
*** andreykurilin has left #openstack-nova13:02
alaskicdent: so I think what's there is correct13:03
*** efried has joined #openstack-nova13:03
*** andreykurilin has joined #openstack-nova13:03
*** rlrossit has joined #openstack-nova13:03
*** ekuris has quit IRC13:05
*** salv-orlando has joined #openstack-nova13:07
*** markvoelker has quit IRC13:07
*** ducttape_ has quit IRC13:07
bauzasalaski: so, AFAIK, we claim differently from a resize13:09
bauzasfor*13:09
bauzasalaski: that's what the scheduler gets13:09
cdentthanks alaski13:11
*** johnthetubaguy_w has joined #openstack-nova13:11
* johnthetubaguy_w shakes fist at laptop that will not charge up any more13:12
* johnthetubaguy_w shakes fist at big purple windows laptop13:12
tdurakovpkoniszewski: I'm not sure it's the right way to test upgrades https://review.openstack.org/#/c/364162/2/jenkins/jobs/devstack-gate.yaml13:13
edleafejohnthetubaguy: shake something heavier, like a bat, at it :)13:13
*** salv-orlando has quit IRC13:13
*** prateek has joined #openstack-nova13:13
bauzasalaski: cdent: yeah, so we double-count the resources indeed https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L277-L27913:13
johnthetubaguy_wedleafe: yeah, after I try harder to fix it13:13
edleafealaski: thanks, that makes things clearer. A resize will claim the sum of old and new.13:14
tdurakovpkoniszewski: from what I see upgrades should be verified by separate job, and covering them in dsvm is not good idea13:14
pkoniszewskitdurakov: at this point i only wanted to turn on grenade13:14
pkoniszewskitdurakov: but it did not work13:14
bauzasedleafe: context for the review ?13:14
*** akshai has joined #openstack-nova13:14
alaskiedleafe: cdent: so digesting further, now I'm second guessing. What's in the patch doesn't double count, it just updates. there's a period where double counting is needed.13:14
edleafeSo the steps should be:13:14
bauzasedleafe: see my link above13:14
edleafe1) delete allocs for the rp/consumer13:14
edleafe2) check space for the new allocs13:14
edleafe3) write those new allocs13:14
*** amotoki_ has quit IRC13:14
edleafe4) check generation13:15
cdentalaski: I was awash in a see of second guessing when i left that comment, and gave up for people who had some read context.13:15
*** su_zhang has joined #openstack-nova13:15
edleafe5) roll it all back if anything isn't good13:15
*** tanvirt has joined #openstack-nova13:16
alaskiedleafe: cdent I think the confusion here is that this only operates on one consumer. The simplification would be to have the second copy of the instance that exists during the resize be a new consumer13:16
alaskibecause really it's a second allocation, and then a deallocation13:16
*** paul-carlton2 has quit IRC13:16
cdentso maybe the issue is this:13:16
*** gongysh has joined #openstack-nova13:16
edleafealaski: but conceptually, it's the same consumer; it's just temporarily taking up twice the space13:17
cdentwe're trying to cover the resize and heal use cases in the same way, but they are different and the calling code needs to be more clear about what it is doing13:17
alaskiedleafe: yeah. really depends on how you define the consumer. disk space usage, or instance using it13:17
bauzascdent: edleafe: alaski: so here I think we're mixing RT concepts and Resource Providers13:18
bauzascdent: edleafe: alaski: as step #1, I was thinking we would only provide to to RPs the exact semantics of what we update in DB13:18
bauzaswithout changing how the RT tracks13:18
edleafealaski: the consumer is the vm13:19
alaskicdent: yeah. the calling code needs to handle heal and resize differently13:19
edleafealaski: the usage is the allocation13:19
bauzasmid-term, I see a possible improvement of us getting rid of the RT and providing a better interface for allocations13:19
cdentbauzas: sure, but the question still remains in the current code: does it, and if so how and in what ordering, remove a pre-existing allocation that matches rp_uuid, consumer_id?13:19
edleafecdent: we could have an 'add' and an 'update' call13:19
*** yamahata has joined #openstack-nova13:20
cdentthe original data model was that we would only ever create and delete13:20
cdentbut then discussion made it clear that would make it hard to heal13:20
bauzascdent: the current code does a full update13:20
alaskiedleafe: sure. I could see changing the model so the consumer is a disk that needs to be written, detached from the instance. But that's a distraction here. Just might simplify things13:20
cdentbauzas: yes, it does, I wrote the original version, but is it doing it correctly?13:21
edleafeI see the complicating issue as the eventual delete of the resized instance.13:21
bauzascdent: meaning https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L68713:21
*** Hosam_ has quit IRC13:21
* cdent has too many threads, will pause13:21
edleafeHow do you tell which of the allocations to delete if they are the same RP and the same consumer_id?13:21
*** paul-carlton2 has joined #openstack-nova13:21
alaskiedleafe: that can still be an update. but whomever is doing the update will need to update to old + new instance during the resize, then update to new instance after confirmation13:22
* cdent draws S Q L on the ground and summons jaypipes13:23
*** markvoelker has joined #openstack-nova13:23
edleafealaski: as long as the resize/mig always reports the full amount that is being used, we should be goog13:24
edleafegood, even13:24
alaskiedleafe: remove the allocation that matches the resources you no longer consume13:24
alaskiif it's a separate entry13:24
edleafealaski: that would be difficult and not always possible13:24
edleafesince it's keyed by RP and consumer_id13:25
edleafeand the amounts could be identical13:25
alaskiright, but in that case does it matter which is removed?13:25
johnthetubaguy_wisn't there normally a source and destination resource provider, so we know which one?13:26
johnthetubaguy_wI guess you can resize to the same host13:26
alaskijohnthetubaguy_w: this is in the case where source/dest are the same13:26
alaskiyeah13:26
johnthetubaguy_win which case, meh, as long as the values are all good at the end, so +1 alaski I think13:26
edleafealaski: but a 'delete where rpid=x and consumer_id=y and used=N' will delete both13:27
alaskiedleafe: limit 1? :)13:27
edleafealaski: heh13:27
alaskiit is an odd model13:28
*** markvoelker has quit IRC13:28
johnthetubaguy_wdo we not have a constraint to stop that kind of duplicate?13:28
alaskiif only we had some sort of unique id to use :)13:28
alaskiI'm also not in the trenches like y'all are, so I may be missing something here13:28
*** eharney has joined #openstack-nova13:29
edleafealaski: we have several. Looks like that's not enough :)13:29
johnthetubaguy_wthe migration object could store the allocation id, if we hand that out?13:29
tdurakovpkoniszewski: there was an issues with multinode jobs, so I think you could recheck once it's fixed13:30
alaskijohnthetubaguy_w: if there were a uuid, that would be a good way to handle it13:30
alaskiedleafe: my experience with the Nova db is wherever we don't have a uuid we eventually regret it, or I just get frustrated by it13:30
edleafealaski: it's an int13:31
edleafealaski: because speed13:31
pkoniszewskitdurakov: yeah, i see, will give it some more time and it should work, thanks for information13:31
*** amotoki has joined #openstack-nova13:31
edleafealaski: I'm with ya, brother. I proposed converting all int IDs to uuid back in Bexar13:32
alaskiedleafe: yeah. I wouldn't want to use the id. That's burned me in the past as well, and I think jaypipes would explode13:32
tdurakovpkoniszewski: no worries, but still consider to test live-migration in separate job, it would be clearer.13:32
tdurakovp.s. good idea)13:32
*** ducttape_ has joined #openstack-nova13:32
edleafealaski: exploding pipes is never good13:32
*** pwnall has joined #openstack-nova13:33
cdentthe permissions argument on using ints is pretty bogus for a database as small as anything nova will ever have13:34
pkoniszewskitdurakov: yeah, you are right, i just want to learn how all this stuff work13:34
pkoniszewskitdurakov: as i have no idea right now :)13:34
cdentespecially if you tune your database setting approrpirately. but that ship has sailed13:34
cdentjohnthetubaguy_w: I do wonder if there is a missing constraint on the table13:35
cdentI commented elsewhere that it seemed like there should a unique constraint on rp_uuid, consumer_id13:35
cdentwhich would make duplicates (the problem that led to this weird when to delete issue) not allowed13:35
cdentedleafe: Were you able to extract an action out of all that? I think I got lost.13:36
alaskithat would avoid much of this messiness. and then it's an issue of figuring out what to update to during a point when the consumer has duplicate allocations13:36
*** mamandle has quit IRC13:37
edleafecdent: I thought it was still up in the air, depending on whether resize/migration always reports the full usage of both original and target13:37
edleafecdent: of course, that's only important in the same-host situation13:38
*** diogogmt has quit IRC13:39
cdentRight now the thing that matters is avoiding a situation where reality is reflected in the artifact world in a way that will break future attempts to allocate13:39
johnthetubaguy_wcdent: yeah, same feeling13:39
johnthetubaguy_wedleafe: the better approach appears to be int id and uuid, but maybe thats what you meant13:39
*** pwnall has quit IRC13:39
edleafejohnthetubaguy_w: no, I really don't see the benefit of int except that it's smaller and faster13:40
edleafejohnthetubaguy_w: neither of which is critical on our scale13:40
edleafejohnthetubaguy_w: and both negates the 'smaller' argument13:40
openstackgerritPaulo Matias proposed openstack/nova: Fill destination check data with VNC/SPICE listen addresses  https://review.openstack.org/35859913:42
edleafecdent: so unless we come up with a reason it won't work in the next few minutes, I'll start changing the code to match my numbered steps from about 30 min ago13:43
*** amotoki has quit IRC13:43
*** ayoung has joined #openstack-nova13:43
cdentedleafe: seems sane13:43
*** ducttape_ has quit IRC13:44
cdentWe need some kind of poster we can share around that has a flowchart on it that says "how to reason about <various hard stuff>"13:45
*** diogogmt has joined #openstack-nova13:45
alaskiedleafe: assuming "new allocs" handles the double accounting when necessary that seems fine13:46
johnthetubaguy_wedleafe: both is a referece to the smaller index, apparently giving better performance than having relationishps that use long utf8 strings13:46
*** mriedem has joined #openstack-nova13:46
mriedemwhat's the good news?13:47
mriedemcellsv2 and placement stuff is all merged?13:47
* cdent gives mriedem a comfortable chair13:47
dansmithmriedem: I don't see anything from jay on the client bit13:47
alaskicells stuff all passed. just writing some tests for my fix from yesterday13:48
mriedemok, looks like at least the cells v2 devstack and grenade changes are passing ci13:48
mriedemhttps://review.openstack.org/#/c/363971/ is clean13:48
sdaguemriedem: a bunch of stuff bounced off the gate because of a multinode osc issue13:48
*** cleong has joined #openstack-nova13:48
*** efried has quit IRC13:48
sdaguethe fix for that is in the gate, but check queue for nova is going to be bonkers until that is in13:48
*** openstackgerrit has quit IRC13:49
mriedemok13:49
mriedemsdague: dansmith: we should get this in when we can https://review.openstack.org/#/c/361436/13:49
mriedemthat's holding up a nova and devstack change for cellsv213:49
*** openstackgerrit has joined #openstack-nova13:49
dansmithmriedem: don't we not need the reordering now because alaski fixed the setup command to sync?13:50
dansmithwe still need the config guard but not the reorder I think13:50
*** amotoki has joined #openstack-nova13:50
*** diogogmt has quit IRC13:50
mriedemfewer double negatives please13:50
alaskidansmith: right13:50
dansmithalaski: I will fix13:50
dansmithmriedem: sorry13:50
mriedemhttps://review.openstack.org/#/c/363956/ is dependent on that grenade reordering change13:51
alaskithe reorder won't hurt anything though13:51
mriedemit's really dependent on the conditional13:51
dansmithalaski: yeah, just seems wrong13:51
*** prateek_ has joined #openstack-nova13:51
sdaguemriedem: you are going to need to draw me a map for the devstack / grenade /nova cells changes, because I understood the order yesterday, and now I'm not sure that I do13:51
dansmithI'll leave it to sdague as to whether we undo the reorder13:51
mriedemi don't care if we undo the re-order, but we'd probably want to run that through check again if we do13:51
*** efried has joined #openstack-nova13:51
alaskidansmith: agreed. not doing the reordering is probably better13:51
*** prateek has quit IRC13:52
mriedemsdague: the treasure hunt starts here https://review.openstack.org/#/c/355602/13:52
mriedemthat's devstack13:52
mriedemdepends on nova, which depends on grenade13:52
mriedemand then X marks the cellsv2 treasure13:52
sdaguemriedem: ok, I need to go make breakfast, can you just write the map in an etherpad and I'll look when I come back13:52
*** tblakes has joined #openstack-nova13:52
mriedemyeah, thought about starting an etherpad for the cells things anyway13:52
mriedemhttps://etherpad.openstack.org/p/nova-cellsv2-newton-ff13:53
dansmithmriedem: I just pushed an edit to the grenade patch and rechecked 95613:54
*** Guest77956 is now known as jlvillal13:55
*** rodrigods has quit IRC13:55
*** rodrigods has joined #openstack-nova13:55
*** pwnall has joined #openstack-nova13:56
*** xyang1 has joined #openstack-nova13:56
mriedemok i'll run the d-g test change again13:56
*** ducttape_ has joined #openstack-nova13:57
mriedemhas anyone talked to jaypipes?13:57
*** eharney has quit IRC13:58
dansmithnot I13:58
*** salv-orlando has joined #openstack-nova13:59
edleafemriedem: jay was around late last night. He said he would work on the client stuff in the (his) morning.13:59
edleafemriedem: but so far nothing today13:59
*** amotoki has quit IRC13:59
*** eharney has joined #openstack-nova14:00
*** mgoddard_ has joined #openstack-nova14:00
*** zz_dimtruck is now known as dimtruck14:00
*** kevinz has quit IRC14:00
*** anush__ has joined #openstack-nova14:00
*** su_zhang has quit IRC14:01
*** su_zhang has joined #openstack-nova14:01
*** hemanthm|away is now known as hemanthm14:01
*** jheroux has joined #openstack-nova14:02
openstackgerritSergey Nikitin proposed openstack/nova-specs: Enable to share PCI devices between numa nodes  https://review.openstack.org/36114014:02
*** parora has joined #openstack-nova14:02
dansmithalaski: you're doing tests for this? https://review.openstack.org/#/c/364005/1/nova/conductor/manager.py14:03
*** mgoddard has quit IRC14:03
mriedemalaski: adding tests for this? https://review.openstack.org/#/c/364005/114:03
*** oanson has joined #openstack-nova14:03
mriedemha14:03
alaskiyep14:03
mriedem*all eyes are now on laski*14:03
* alaski moves to the back of the classroom14:03
*** jaosorior has quit IRC14:04
johnthetubaguy_wmriedem: I just added a -1 for that14:05
*** prateek_ has quit IRC14:05
alaskidansmith: I know you have concerns about how to handle object equivalence, but it would make testing easier at times to get that sorted14:05
dansmithalaski: we have a helper to compare two objects by primitive-izing them14:06
*** prateek_ has joined #openstack-nova14:06
dansmithdoes that help?14:06
*** vishwanathj has joined #openstack-nova14:06
mriedemunrelated, novaclient 6.0.0 is now in upper-constraints for newton \o/14:06
alaskinot in this case, it's the assert_called_with case14:06
*** su_zhang has quit IRC14:06
alaskiso I just end up with MatchType()14:06
dansmithalaski: yeah, well, sorry14:06
openstackgerritAndrew Laski proposed openstack/nova: Fix service version lookups  https://review.openstack.org/36388814:06
openstackgerritAndrew Laski proposed openstack/nova: Pull from cell0 and build_requests for instance list  https://review.openstack.org/35613814:06
openstackgerritAndrew Laski proposed openstack/nova: Delete BuildRequest regardless of service_version  https://review.openstack.org/36391114:06
openstackgerritAndrew Laski proposed openstack/nova: Remove BuildRequest when scheduling fails  https://review.openstack.org/36400514:06
*** pilgrimstack has quit IRC14:07
alaskidansmith: I mean, I don't blame you. just mentioning that it would help to figure something out14:07
dansmithyeah14:07
alaskiokay, basic testing added14:07
*** parora has quit IRC14:09
*** ducttape_ has quit IRC14:09
*** claudiub has quit IRC14:10
mriedemdansmith: https://review.openstack.org/#/c/361436/11/projects/60_nova/upgrade.sh14:12
openstackgerritChristopher Martin proposed openstack/nova: Fix Boot From Volume size error  https://review.openstack.org/36433714:12
mriedemlet's remove the additional comment14:12
dansmithgah14:12
mriedemthe commit message too14:12
mriedemthis basically just becomes, make cellv2 setup conditional14:13
sdaguemriedem: so you -1ed the bottom of that whole stack14:13
*** parora has joined #openstack-nova14:13
sdaguealso, the recheck will fail14:13
mriedemyes i know14:13
*** efried has quit IRC14:13
dansmithmriedem: done14:13
mriedemit's like 10 minutes old14:14
sdaguemriedem: ok14:14
avolkovalaski: hi, what do you think about https://review.openstack.org/#/c/301864/? It's, possibly, last thing in https://review.openstack.org/#/q/topic:bp/cells-cell0 now.14:14
*** efried has joined #openstack-nova14:14
*** amotoki has joined #openstack-nova14:14
sdaguewell, I'm hard stop in 5.75 hours, and them I'm not back online until tuesday14:14
sdagueto be clear what the merge window is here is for anything that needs my feedback14:15
dansmithsdague: you should give me temporary provisional devstack core status in case of emergency14:15
mriedemdansmith: alaski: on this grenade change, just so we're clear, running simple_cell_setup after db sync as it is today, just won't have the cell0 migrations run right?14:15
*** pilgrimstack has joined #openstack-nova14:15
*** tongli has joined #openstack-nova14:15
mriedembecause alaski's change to run the migrations on cell0 in simple_cell_setup are dependent on this grenade change, so it's backward14:15
dansmithmriedem: no, it will because he aded it in the nova code14:15
mriedemdansmith: not in this order14:15
alaskiavolkov: that would be nice to have, but given the pressure on merging other things right now may need to wait. However since it's only test changes I think we can look at that after FF14:15
dansmithmriedem: right, but we don't configure this to be on until after we merge the nova one14:15
dansmithmriedem: or.. shouldn't14:16
mriedemdon't configure this to be on? as in flip that flag to run it? that's going into a job change14:16
mriedemi thought simple_cell_setup will just create the cell0 mapping, so cell0 db has to exist14:16
mriedemyou should have run db sync before that to run the migrations, but not required, as in won't fail14:16
*** prateek_ has quit IRC14:16
mriedemwon't fail simple_cell_setup i mean, but the actual code that needs to use cell0 might fail14:17
*** prateek has joined #openstack-nova14:17
mriedemuntil the nova change lands14:17
dansmithmriedem: I'm confused about what you're saying14:17
mriedemis it hangout time already?14:17
alaskiyeah, I'm trying to parse all of that14:17
dansmithmriedem: we won't actually run cell_setup until after we land the job change to enable it14:17
*** mingyu has joined #openstack-nova14:17
dansmithwe do that after we land the nova change that makes it work in this order14:17
mriedemtrue that is dependent on the devstack > nova > grenade order14:18
*** cmartin has joined #openstack-nova14:18
*** parora has quit IRC14:19
bauzasmriedem: dansmith: alaski: given what I've heard so far, it seems we've reached to a point where we're done with the placement bits for Newton, right?14:19
alaskimriedem: you're correct that without the reordering we need the nova patch to db sync14:19
alaskibut the conditional will save us as dansmith says14:19
dansmithbauzas: eh?14:19
bauzasdansmith: mriedem: alaski: now, the last bits are about the cell0 stuff, right?14:19
mriedemdansmith: alaski: sdague: ok +1 on https://review.openstack.org/#/c/361436/14:20
dansmithbauzas: no, we still have to land the allocation server and client bits14:20
bauzasdansmith: I'm a bit confused about what you folks agreed last night14:20
alaskibauzas: I believe people are typing as we speak14:20
bauzasdansmith: mmm, links ?14:20
bauzasdansmith: that sounds an hard task :/14:20
*** marst has quit IRC14:20
dansmithbauzas: unfortunately we don't have a link for the client bit yet :(14:21
bauzashttps://review.openstack.org/#/c/357993/ is the server side, right?14:21
*** pwnall has quit IRC14:21
dansmithbauzas: server side: https://review.openstack.org/#/c/339874/3414:21
bauzasoops, bad copy/paste14:21
*** coolsvap has quit IRC14:22
*** pwnall has joined #openstack-nova14:22
dansmithbauzas: I don't understand your comment on alaski's bottom cells patch14:22
bauzasdansmith: you mean https://review.openstack.org/#/c/364005/2/nova/conductor/manager.py ?14:23
dansmithy14:23
dansmitheah14:23
*** prateek_ has joined #openstack-nova14:23
*** rlrossit has quit IRC14:23
cdentyeah, I struggled with that too14:23
mriedembauzas: we're tracking things for cellsv2 in https://etherpad.openstack.org/p/nova-cellsv2-newton-ff fyi14:23
*** liverpooler has quit IRC14:23
bauzasdansmith: so, the logic is that we delete the BuildRequest once the instance found a place14:23
dansmithoh I think I misread the line number reference14:24
bauzasdansmith: the problem in that logic is that we're catching a global exception that prevents us to read that section14:24
bauzasbecause we return14:24
*** mtanino has joined #openstack-nova14:24
bauzaslogically, I'd prefer to have a simplier workflow that would run that section anyway14:24
*** praneshp has joined #openstack-nova14:24
openstackgerritEd Leafe proposed openstack/nova: WIP create_all and delete_all for AllocationList  https://review.openstack.org/36320914:24
alaskiright, but it has to return because the rest of that method shouldn't run14:24
bauzasI knoxw14:25
edleafecdent: ^^ fixes the issue with only some RPs with inventory.14:25
edleafecdent: working on the re-jiggering now14:25
dansmithyeah, I'm not sure how it could be different14:25
cdentawesome edleafe14:25
alaskibauzas: the buildrequest cleanup also can't be done after the method is run because it does a different thing for BuildRequestNotFound down below14:25
bauzasalaski: but I was thinking of deleting the object earlier, possibly in a finally statement of a contextmanager wrapping _schedule_instance()14:25
alaskinotably the return before compute_rpcapi14:25
bauzaswe 'd just reraise if NoValidHost14:26
bauzasbut anyway, I'm nitpicking14:26
alaskiIt' can't be deleted until the instance mapping on line 516 if scheduling succeeds14:26
*** prateek has quit IRC14:26
dansmithI +2d14:27
openstackgerritSean Dague proposed openstack/nova: Report compute node inventories through placement  https://review.openstack.org/36306114:27
dansmithoptimization aside, gotta get that in14:27
sdaguethat rebase was just to reset it in check14:27
sdaguebecause it was in a recheck that was going to take another hour to timeout/fail14:28
bauzasalaski: well, that's because you wanted to detect that an API delete call was here14:28
dansmithsdague: thanks14:28
bauzasbut okay, that becomes overcomplicated to think about an alternative and again, I don't want to nitpick14:28
bauzasalaski: I just held my +2 because I needed to think of any possible alternative but I struggled founding those14:29
bauzasalaski: so...14:29
alaskibauzas: okay. we can certainly look to clean it up in O if there's a better way14:29
bauzasalaski: it's not really about a matter of duplicating code, it's rather about taking a pause and seeing the workflow14:29
bauzasalaski: but I agree, that's Ocata14:30
*** raj_singh_ has joined #openstack-nova14:31
sdaguejohnthetubaguy_w: do you know where the demonstration patch for - https://review.openstack.org/#/c/356963/ is?14:32
mriedemcdent: i replied in https://review.openstack.org/#/c/364005/2//COMMIT_MSG14:33
*** marst has joined #openstack-nova14:33
sdagueok, check queue is hopefully good again14:33
*** gongysh has quit IRC14:33
johnthetubaguy_wsdague: ah... sorry, I am not sure :( he did say that was panned14:33
*** rama_y has joined #openstack-nova14:33
*** dimtruck is now known as zz_dimtruck14:33
johnthetubaguy_wplanned14:33
*** zz_dimtruck is now known as dimtruck14:33
cdentthanks mriedem I figured it was something like that14:33
*** jiwei has joined #openstack-nova14:34
*** eharney has quit IRC14:36
*** jheroux has quit IRC14:37
*** parora has joined #openstack-nova14:38
dansmithbauzas: cdent: so on the placement stuff, we're waiting for jaypipes to hopefully pop up today with a working client-side allocation patch14:38
bauzask14:38
dansmiththat may not happen though, so I think maybe we should start throwing noodles at the wall14:38
cdentdansmith: that's my understanding, yeah14:38
bauzasdansmith: I appreciate the analogism14:38
dansmiththe only reason I haven't started is that I'm not sure how and where to report these things from RT14:39
dansmithspecifically:14:39
dansmithI think we can probably report from somewhere in/around the claim process that an instance is using a thing14:39
bauzasdansmith: well, the main problem I see with implementating that is that we do full updates every time14:39
dansmithhowever that will fail for single-node migrate,14:39
dansmithand will be wrong or have to be updated for resize14:39
*** ducttape_ has joined #openstack-nova14:40
bauzasdansmith: which is kinda different from the idea of putting a specific allocation against a specific resource14:40
dansmithbauzas: I'm not sure what you mean by full updates14:40
mriedembauzas: i see what you were saying in https://review.openstack.org/#/c/364005/ i left some comments too14:40
mriedemi think pulling some of the chunks out of that method into smaller private methods might help with the confusion and maintaintability/readability - in ocata14:40
alaskidansmith: I'm +2 on https://review.openstack.org/#/c/32690614:40
dansmithalaski: cool I'll look over again in a few14:41
*** prateek_ has quit IRC14:41
bauzasmriedem: yeah, I was more thinking of a contextmanager wrapping _schedule_instances() but whatever :)14:41
*** oanson has quit IRC14:41
mriedembauzas: that too sure14:41
mriedemi just get lost in the returns in the middle of the function14:41
bauzasdansmith: sorry, I mean https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L16814:42
*** jheroux has joined #openstack-nova14:42
bauzasdansmith: which is just us asking to update the whole ComputeNode object with all its fields14:42
cdentdansmith: my understanding of the resource tracker is very weak, I keep defering my "grok resource tracker" to do item, so I can't be much help. Did you see the earlier conversation between edleafe, alaski etc about dealing with single-node resize?14:42
*** dimtruck is now known as zz_dimtruck14:43
bauzascdent: so RT is mapped to a ComputeNode14:43
dansmithcdent: no14:43
dansmithbauzas: that's where you think we need to report the per-instance stuff?14:43
bauzasdansmith: so, that's where the call is made to the scheduler client14:44
bauzasdansmith: I mean in _update()14:44
dansmithbauzas: for compute node stuff (i.e. inventory)14:44
mriedemalaski: was there additional testing needed in https://review.openstack.org/#/c/363888/ based on what melwitt and you were talking about last night?14:44
bauzasdansmith: that private helper method can be called either from any claim method (for a boot or a move) or periodically14:45
*** prateek_ has joined #openstack-nova14:45
mriedemcompared to PS3?14:45
cdentdansmith: near here in the logs http://p.anticdent.org/2lOO14:45
bauzasdansmith: so, say we'd have self.compute containing the values, we would need to capture what actually changed14:45
dansmithbauzas: right, but we could put the actual per-instance reporting closer to the claim and not bundle it in the bulk update_all_the_things() method14:45
alaskimriedem: the additional testing was for the patch I slipped in below that one14:45
mriedemalaski: ah ok, cool14:45
mriedemsneaky sis14:45
bauzasdansmith: right, but that's a pure mess of shit14:45
bauzasdansmith: like, we have a specific helper for migration that does call it14:46
dansmithbauzas: it's kinda the design of the thing right? since we can14:46
bauzasplus, we have an update_usage() that does the calculation and call it14:46
dansmithbauzas: since we can't update allocations [ :~( ] we kinda have to only do it when we have a new instance or something14:46
bauzasdansmith: yeah, so just to explain my worries, it's just the fact that we have a couple of helpers that do calculate the new amounts and modify the object, but you only have one single helper for updating the Computenode object14:47
alaskidansmith: updaing allocations was what we were discussing earlier14:47
bauzasdansmith: so, it would mean that we would need to hook up the allocation call *before* the call to _update()14:47
*** tonytan4ever has joined #openstack-nova14:47
dansmithbauzas: but we don't have to do any calculations to write an instance allocation14:47
alaskiI lost the link but I think there was a patch up for that14:47
dansmithalaski: we definitely need that long-term, I'm just not sure it's something we're going to be able to merge and I'm trying to think of the minimum possible code to make something work14:48
bauzasdansmith: ie. not using the existing scheduler client Facade for transforming our Computenode object into a list of allocations14:48
bauzasdansmith: ie. we can't use*14:48
bauzasnot sure I'm clear :/14:48
*** parora has quit IRC14:49
bauzasgosh I hate me14:49
*** erhudy has joined #openstack-nova14:49
dansmithI don't think we have any existing facade for doing anything like this right now so I'm not sure what your point is14:49
mriedemdo we need a hangout?14:49
bauzasdansmith: that's my point14:49
edleafebauzas: allocations are for the instances on the compute node.14:50
bauzasdansmith: the fact that we can't just modify the scheduler client code to transform a request into a list of allocations14:50
bauzasedleafe: I know14:50
bauzasmriedem: well, your call14:50
dansmithbauzas: there is nothing in scheduler client to transform, AFAIK14:50
alaskidansmith: for resize we could delete/create for now. it sucks but would keep us closer to reality than ignoring it completely14:51
bauzasthat's my point14:51
bauzasdansmith: ^14:51
edleafebauzas: so transforming a compute node to a list of allocations is iterating over its instances14:51
*** diogogmt has joined #openstack-nova14:51
dansmithalaski: that's really dangerous14:51
dansmithalaski: we race with some new schedule and then we can't re-create our allocation14:51
bauzasedleafe: I'd rather prefer to not do that14:51
bauzasedleafe: but rather create allocations in claims14:51
*** haplo37__ has joined #openstack-nova14:52
dansmithedleafe: one option I see is to just go over all the instances, check their allocations and update/delete/create as needed14:52
edleafebauzas: sure, that's for new instances14:52
edleafewe were considering the "healing" case14:52
dansmithedleafe: the other is to just create on claim and delete on unclaim (or whatever)14:52
*** kevinz has joined #openstack-nova14:52
alaskidansmith: true. so only doing it on claim means we may have more allocated than the db indicates, but compute node resource tracking will deal with that14:52
bauzasdansmith: edleafe: keep in mind we don't claim for live migrations14:52
dansmithedleafe: well, I'm considering both14:52
edleafewhere a compute node just wants to make sure everything is correct14:52
dansmithalaski: but the server side will not let us double allocate14:52
bauzasdansmith: edleafe: so the only way for the scheduler to notice some migration change is by getting the periodic update14:52
dansmithbauzas: we don't care about the scheduler14:53
dansmithat all14:53
edleafedansmith: the new stuff already worked. It was the healing case that we needed to accomodate14:53
dansmithall we're trying to do is get the allocations written to the db14:53
dansmithedleafe: eh?14:53
bauzasdansmith: we care about providing new allocations when a new move or boot operation is claimed, right?14:53
edleafedansmith: jay's sql stuff worked for new allocations only14:53
dansmithyeah14:53
dansmithedleafe: you mean the server side14:53
dansmithedleafe: we have nothing for the RT/client side yet14:53
bauzasdansmith: so, here is the thing, if we don't claim when live-migrating, then you can't write allocations for that specific move operation14:54
edleafedansmith: ah, I didn't realize you were talking client14:54
*** Sukhdev has joined #openstack-nova14:54
dansmithedleafe: I'm trying to figure out what we can get done from the client with just what we have on the server side right now14:54
dansmithedleafe: yep14:54
bauzasmriedem: I retain your idea of an hangout14:54
dansmithedleafe: trying to figure out what we can get done in case jay doesn't show up with the client patch14:54
*** rrecio has joined #openstack-nova14:55
edleafedansmith: as long as we always pass the full resource usage for each consumer, it should work14:55
mriedemhttps://hangouts.google.com/call/lsmbe6rtofbrhm6cixsh7h4smye14:55
edleafedansmith: things like migrations sound icky though14:55
dansmithmigrations are the hard part14:55
dansmithbecause they will fail on single node14:55
mriedemi can't hear anything14:56
mriedemoh there we go14:57
*** krtaylor has joined #openstack-nova14:58
*** kevinz has quit IRC14:58
*** kevinz has joined #openstack-nova14:58
*** TravT_ is now known as TravT14:58
*** mjura has quit IRC15:01
mriedemat some point today i need to re-read this http://specs.openstack.org/openstack/nova-specs/specs/newton/approved/resource-providers-allocations.html15:01
cdentdansmith: https://review.openstack.org/36320915:02
*** pcaruana has quit IRC15:03
*** eharney has joined #openstack-nova15:03
openstackgerritAndrew Laski proposed openstack/nova: WIP Move instance creation to conductor  https://review.openstack.org/31937915:03
*** annegentle has joined #openstack-nova15:04
*** hshiina has joined #openstack-nova15:05
*** irenab has quit IRC15:06
*** kolesovdv has quit IRC15:06
*** roeyc has quit IRC15:06
*** rcernin has quit IRC15:06
*** bvanhav has quit IRC15:08
*** parora has joined #openstack-nova15:08
*** mgoddard_ has quit IRC15:08
*** mgoddard has joined #openstack-nova15:09
*** jiwei has quit IRC15:09
*** zz_dimtruck is now known as dimtruck15:11
*** prateek_ has quit IRC15:11
*** nkrinner is now known as nkrinner_afk15:11
openstackgerritAndrew Laski proposed openstack/nova: WIP Move instance creation to conductor  https://review.openstack.org/31937915:12
*** hemnafk is now known as hemna15:15
*** bvanhav has joined #openstack-nova15:17
*** ljxiash has quit IRC15:17
*** moshele has quit IRC15:17
*** rmart04 has quit IRC15:19
*** mvk has joined #openstack-nova15:19
mdboothsdague: It needed a cffi bump too, as you guessed: https://review.openstack.org/#/c/364249/15:20
*** browne has joined #openstack-nova15:20
sdaguemdbooth: cool, that seems to work?15:20
mdboothThe tests pass15:21
sdaguegreat15:21
sdaguewhat are the mitaka values?15:21
sdagueis there a similar issue there?15:21
* mdbooth checks15:21
sdagueso, on mitaka we have that level of cryptograpy, but cffi===1.5.215:22
sdagueit's probably better if we mirror that in liberty15:22
sdagueinstead of 1.6.0 for cffi15:22
mdboothMitaka, cryptograph 1.2.315:22
mdboothsdague: Yeah, my hg-fu wasn't strong enough to determine when def_extern was introduced in cffi15:22
sdaguemdbooth: no worries15:23
mdboothHowever, 1.6.0 was the first release which mentioned it, and that it had been 'fixed'15:23
*** sdake has joined #openstack-nova15:23
sdaguelocally what are you using with the new openssl?15:23
sdaguejust want to make sure that liberty -> mitaka doesn't dictate a downgrade15:23
mdboothFor sure15:24
*** Sukhdev has quit IRC15:24
mdboothLocally I'm pulling it from pypi, so exactly as constrained15:24
mdboothSo, bump cffi in mitaka, or downgrade in liberty?15:24
* mdbooth finds the cffi release note15:24
bhagyashrirpodolyaka: Hi, I have addressed the review comments. could you please review https://review.openstack.org/#/c/345191/?15:24
*** praneshp has quit IRC15:25
sdaguemdbooth: well, ideally, we'd change as little as possible15:25
mdboothsdague: http://cffi.readthedocs.io/en/latest/whatsnew.html#v1-615:25
sdagueso 1.5.2 in liberty would be that15:25
mdboothsdague: Yeah, I'll bump it down15:26
sdagueif you can get 1.5.2 to work in liberty in gate, and locally, that would be the best case scenario15:26
sdaguemdbooth: great15:26
mdboothIn the absence of being able to work it out in mercurial, I literally just went from that release note about 'robustness'15:26
sdagueand as long as that works with your patched openssl, we should be able to shephard that all through15:26
*** armax has joined #openstack-nova15:26
sdaguemdbooth: no worries :)15:26
mriedemsdague: https://review.openstack.org/#/c/363971/ is still running jobs, but it's passed grenade and single-node dsvm jobs, so the devstack/nova/grenade series it's dependent on should be good to go15:30
mriedemsdague: starting here https://review.openstack.org/#/c/355602/15:30
*** rcernin has joined #openstack-nova15:31
bauzasdansmith: so, I looked at who calls update_usage_from_instance() so that it would call out the placement API15:32
*** annegentle has quit IRC15:32
*** tbachman has quit IRC15:32
bauzasdansmith: that would work pretty well for new instances and for the heal operation15:32
sdaguemriedem: ok, will go look15:33
bauzasdansmith: but IMHO, we would miss all the move operation updates until we reconcile with the heal15:33
dansmithbauzas: okay15:33
dansmithbauzas: let me do that place then and we can figure out after if we can do it elsewhere to cover all the bases15:33
sdaguemriedem: ok, that patch is going to fail tests, because of the osc bug15:33
bauzasdansmith: I think it's reasonable enough to assess that would be sufficient for Newton15:34
mriedemhmm, the RT is going to need an instance of the report client15:34
*** BharatK has joined #openstack-nova15:34
dansmithmriedem: it has one15:34
bauzasdansmith: given the heal15:34
*** pbandark has quit IRC15:34
cfriesenbauzas: dansmith:  if we have the cpu thread policy set to "isolate", and we boot an instance with 1 vcpu, essentially it also reserves N sibling CPUs.  should the hypervisor "vcpus_used" count be incremented by 1 or by 1+N?15:34
bauzasdansmith: because we'd get a reasonable but a bit unaccurate list of allocations15:34
*** zengine has quit IRC15:34
dansmithcdent: your allocation patches aren't on top of my inventory reporting one apparently, and seem to be out of date.. right?15:34
mriedemdansmith: do you mean this? self.scheduler_client = scheduler_client.SchedulerClient()15:35
mriedemi guess the RT would have to call self.scheduler_client.reportclient.foo()15:35
dansmithmriedem: yeah, which merges in the reportclient15:35
cdentdansmith: jay and ed were last in there and I think edleafe has something pending15:35
cdenti can move them now if need be?15:35
edleafecdent: should be ready in a few minutes.15:35
dansmithcdent: okay I need these all lined up in order to do this15:35
*** andreas_s has quit IRC15:35
dansmithedleafe: okay push and then ping me when done and I will rebase on top of my inventory thing and then should be good15:36
cdentedleafe: can you do that then. we mean this one yeah: https://review.openstack.org/#/c/363061/15:36
dansmithor that15:36
dansmithprolly easier for edleafe to do it15:36
cdentafter edleafe does that I will fix the api side of things so they reflect the correct methods and are happy (they may already be okay)15:36
edleafecdent: I'm working on https://review.openstack.org/#/c/36320915:37
sdaguedansmith: ok, you want to +A - https://review.openstack.org/#/c/36143615:37
cdentedleafe: right, and the link i pointed to is what to base that one on15:37
sdaguethat should flush out the nova change15:38
edleafecdent: ah, I didn't get the order for the patches15:38
sdagueand the devstack change is rebase15:38
sdagueso that will probably pass tests this time15:38
dansmithsdague: yep15:39
rpodolyakabhagyashri: done, lgtm!15:41
*** jheroux has quit IRC15:42
*** Swami has joined #openstack-nova15:42
bhagyashrirpodolyaka: Thank you.15:43
rpodolyakanp!15:43
*** salv-orlando has quit IRC15:43
cdentoh hey, edleafe, while you're in there, probably time to remove the "WIP"?15:44
sdaguejohnthetubaguy_w: still about?15:45
edleafecdent: will do15:45
sfinucansnikitin: Hey - got a moment?15:45
sdaguealaski - https://review.openstack.org/#/c/322944 is the policy tool15:46
sdaguewhich is still not approved15:46
sdagueand I think is kind of needed to help people understand15:46
*** BharatK_ has joined #openstack-nova15:47
*** kaisers_ has quit IRC15:47
*** BharatK has quit IRC15:47
*** BjoernT has joined #openstack-nova15:49
*** raj_singh_ has quit IRC15:49
*** paul-carlton2 has quit IRC15:50
*** matrohon has quit IRC15:50
openstackgerritAlberto Planas proposed openstack/nova: Add migrate_uri for invoking the migration  https://review.openstack.org/35655815:51
*** markvoelker has joined #openstack-nova15:51
openstackgerritEd Leafe proposed openstack/nova: Add create_all and delete_all for AllocationList  https://review.openstack.org/36320915:52
edleafecdent: dansmith: ^^15:52
dansmithedleafe: did you orphan the api bit?15:53
mriedemsdague: also before you're gone https://review.openstack.org/#/c/363937/15:53
edleafedansmith: huh?15:53
dansmithedleafe: you just pushed the db patch but not the api one that was on top right?15:53
dansmithI need both stacked.. I can rebase, just checking15:53
cdentdansmith: i'll get that15:53
dansmithcdent: okay15:53
cdentbecause I need to test it first to reflect the current state of affairs15:54
edleafedansmith: I rebased on 36306115:54
dansmithedleafe: I know, nevermind, cdent is doing it15:54
openstackgerritSam Betts proposed openstack/nova: [WIP] Support Ironic interface attach/detach in nova virt  https://review.openstack.org/36441315:54
openstackgerritChris Dent proposed openstack/nova: WIP Add support for allocations in placement API  https://review.openstack.org/33987415:54
cdentthat's _not_ it ^15:54
dansmiththanks15:55
cdentneed one test to fix an alex_xu point, and then it should be good to go15:55
sdaguemriedem: I occured to me, we should probably rename the placement job to -next15:56
sdagueand use it for all the forward looking changes15:56
sdagueso standing up placement api, standing up cells v2 new things, etc etc. It's kind of the bleeding edge of our code.15:56
mriedemsdague: i did think about renaming it to add cellsv2 in the name15:57
mriedem-next would also work15:57
mriedemdoes renaming a job while changes are in flight hurt anything?15:57
sdaguemriedem: comment left, for later consideration15:57
sdague+215:57
mriedemok15:57
sdagueno, it just picks things up later15:57
sdaguerename won't hurt any inflight thigns15:58
mriedemi'll try testing this policy discovery cli change locally15:58
*** zengine has joined #openstack-nova16:01
*** claudiub has joined #openstack-nova16:04
*** andrewbogott has quit IRC16:05
*** andrewbogott has joined #openstack-nova16:05
*** bvanhav has quit IRC16:05
openstackgerritSam Betts proposed openstack/nova: [WIP] Support Ironic interface attach/detach in nova virt  https://review.openstack.org/36441316:06
* bauzas goes AWOL for a couple of hours, be back around 7pm UTC 16:06
*** raunak has joined #openstack-nova16:06
alaskisdague: got it16:10
*** ijw has joined #openstack-nova16:11
*** GB21 has joined #openstack-nova16:11
mriedemalaski: claudiub: why are the user/tenant/roles config options for that CLI? why wouldn't they just be options for the CLI?16:11
*** salv-orlando has joined #openstack-nova16:12
alaskithey are only CLI opts from what I see16:12
alaskionly CONF.register_cli_opts was used16:13
*** johnthetubaguy_w has quit IRC16:14
alaskioh. yeah they could have been done with @cmd_common.args as well16:14
*** annegentle has joined #openstack-nova16:17
*** bvanhav has joined #openstack-nova16:17
openstackgerritMathieu Gagné proposed openstack/nova: Make scheduler less greedy when loading instances for tracking  https://review.openstack.org/36394416:18
*** johnthetubaguy_w has joined #openstack-nova16:18
johnthetubaguy_wsdague: just about still around, having crazy problems doing anything today :(16:19
edleafejohnthetubaguy_w: need to borrow my sledgehammer?16:19
*** kevinz has quit IRC16:20
*** prometheanfire has joined #openstack-nova16:20
johnthetubaguy_wedleafe: I have one, but otherwise, yes16:20
prometheanfirethe new os-brick release (1.6.1) caused a fail http://logs.openstack.org/55/364255/1/check/gate-cross-nova-python27-db-ubuntu-xenial/26598da/testr_results.html.gz16:20
prometheanfireI think this is the release people wanted to use in newton16:20
mriedemalaski: yeah, the thing that trips me up is they aren't listed in the --help16:20
prometheanfiremriedem: ^16:21
*** BharatK_ has quit IRC16:21
*** lucasagomes is now known as lucas-dinner16:21
prometheanfirecinder is failing too though16:21
prometheanfirehttps://review.openstack.org/36425516:21
openstackgerritChris Dent proposed openstack/nova: WIP Add support for allocations in placement API  https://review.openstack.org/33987416:22
openstackgerritChris Dent proposed openstack/nova: Add create_all and delete_all for AllocationList  https://review.openstack.org/36320916:22
cdentokay dansmith that's good to go16:22
cdentthe change on 363209 was just a typo fix in an exception16:22
dansmithcdent: I already pulled, what did you change?16:22
dansmithokay16:22
prometheanfireI bugged -cinder as well16:23
mriedemprometheanfire: jesus https://github.com/openstack/os-brick/compare/1.5.0...1.6.116:23
*** hshiina has quit IRC16:23
*** zenoway has quit IRC16:23
*** BharatK has joined #openstack-nova16:23
cdentdansmith:heh, above I said "that's _not_ it ^"16:23
mriedemprometheanfire: well this is the thing that breaks the test https://github.com/openstack/os-brick/commit/f8e4f3cdbef614367c5b3cfcb32e1584475946f816:23
prometheanfiremriedem: yep16:23
cdentthe new version actually works, the other one did not (was calling the wrong method)16:23
dansmithcdent: heh, so you did16:23
cdent(as we kept changing it back and forth)16:23
alaskimriedem: I need to run out for a bit, but I'll post a followup to change the CLI args16:24
mriedemalaski: ok, we can bug fix it16:24
mriedemso no rush16:24
cdentbut what's there now is passing tests and also addresses the problem that alex_xu found (with bad resource class strings)16:24
*** coolsvap has joined #openstack-nova16:24
*** ManishD has joined #openstack-nova16:25
*** krtaylor has quit IRC16:25
sdaguecdent: did we figure out if the db query is what people want?16:28
*** markus_z has quit IRC16:28
cdentwe had two conversation here that both seemed to reach the same conclusion and edleafe made some tweaks accordingly. we're still not 100% positive that everything is perfect, but we're pretty sure it is not damaging. In our usual way these past couple of days we are hoping jaypipes will show up to confirm or deny.16:29
sdagueok, looking at the most current patch16:29
dansmithsdague: IMHO we can't merge that until we have something that really uses it, which is what I'm furiously typing on right now16:30
sdagueit changed the thing I was wondering about putting the _check_capacity inside the transaction16:30
dansmithI'm at the "swear at devstack" phase16:30
sdaguedansmith: sure16:30
ManishDdansmith: Thanks for review of https://review.openstack.org/#/c/357131/16:30
*** jeblair_ is now known as jeblair16:30
dansmithsdague: we already got from jay the word on making sure we fail the transaction if we would otherwise overcommit capacity, so that's answered16:30
*** BharatK has quit IRC16:31
ManishDdansmith: Problem is: Nova instance is shut down without any detaching/disconnection operations hence during startup it fails with scsi_id cmd which it runs against the block storage which are encrypted16:31
dansmithManishD: no time to talk about this right now.. today is FF and we're working on priority stuff16:32
*** johnthetubaguy_w has quit IRC16:32
*** zul has quit IRC16:32
jrollis "swear at devstack" not the default phase?16:33
sdaguezomg jay evil twin is freaking me out - https://twitter.com/jaypipes/status/77138432618548838416:33
jrolllol16:33
edleafesdague: _check_capacity is in the transaction only because we have to first delete existing allocations before we can see if the new will fit, and we need to be able to roll that back16:34
sdagueedleafe: no, I'm glad it's in the transaction16:34
*** tbachman has joined #openstack-nova16:34
sdagueit seemed weird before to check it outside the transaction then move forward16:34
*** jaypipes has joined #openstack-nova16:34
edleafesdague: ah, I misread your comment16:34
ManishDdansmith: ok sure, pls have a look whenever you have some free time. Appreciate your help.16:35
*** tanvirt has quit IRC16:35
edleafesdague: and who knew there was a jay clone?16:35
dansmithI did16:35
dansmithnever seem him before now though16:35
dansmithit's fairly amusing16:35
*** ssurana has joined #openstack-nova16:36
*** su_zhang has joined #openstack-nova16:36
cdentfreaky16:37
*** karlamrhein has joined #openstack-nova16:37
sdagueok, the inventory client and logging patches are now in the gate 28 mins from merge if all goes well16:38
dansmitheff yeah16:39
jaypipesdansmith, edleafe: he's the better pipes.16:39
dansmithOMG16:39
dansmithlook who is here16:39
*** Oku_OS is now known as Oku_OS-away16:39
dansmithjaypipes: enough bw for a hangout?16:39
*** Apoorva has joined #openstack-nova16:40
*** yamahata has quit IRC16:40
*** ijw has quit IRC16:40
*** daemontool has quit IRC16:40
*** su_zhang has quit IRC16:41
*** su_zhang has joined #openstack-nova16:41
* dansmith guesses not16:41
jaypipesdansmith: I can try. one minute... lemme get to a quiet place16:41
dansmithcool16:41
cdentdansmith: I fixed the commit message on https://review.openstack.org/#/c/339874/ to remove the WIP, just FYI16:41
*** woodster_ has joined #openstack-nova16:42
dansmithcdent: okay, don't push yet though.. too many balls in the air :)16:42
cdentsorry, did it on gerrit, it pushed itself, but feel free to clobber it16:42
dansmithokay16:42
openstackgerritMatt Riedemann proposed openstack/nova: Remove hacked test that fails with latest os-brick  https://review.openstack.org/36445416:44
*** sahid has quit IRC16:45
*** akshai has quit IRC16:45
*** zul has joined #openstack-nova16:45
*** ljxiash has joined #openstack-nova16:47
*** akshai has joined #openstack-nova16:47
*** tbachman_ has joined #openstack-nova16:48
dansmithhttps://hangouts.google.com/call/3uopugv745a5ndzzpuhvrh6rmie16:48
openstackgerritChris Dent proposed openstack/nova: Add {get_,set_}aggregates to objects.ResourceProvider  https://review.openstack.org/35526316:49
openstackgerritChris Dent proposed openstack/nova: Implement get and set aggregates in the placement API  https://review.openstack.org/35799316:49
openstackgerritChris Dent proposed openstack/nova: [placement] add a placement_aggregates table to api_db  https://review.openstack.org/36286316:49
*** timello has quit IRC16:49
*** tbachman has quit IRC16:49
*** tbachman_ is now known as tbachman16:49
*** timello has joined #openstack-nova16:50
*** pradk has quit IRC16:51
*** amotoki has quit IRC16:51
*** trisq has quit IRC16:52
*** ljxiash has quit IRC16:53
*** unicell has quit IRC16:55
*** derekh has quit IRC16:56
*** sridharg has quit IRC16:57
*** su_zhang has quit IRC16:57
*** markvoelker has quit IRC16:58
*** su_zhang has joined #openstack-nova16:58
*** su_zhang has quit IRC16:58
* cdent finds dinner16:59
*** wanghao_ has quit IRC17:00
*** tesseract- has quit IRC17:01
*** yamahata has joined #openstack-nova17:01
mdboothkashyap: WRT https://review.openstack.org/#/c/290510/ bugfixes aren't subject to any of the various release freezes, are they?17:02
kashyapmdbooth: Good question, I think the answer is "it depends".  This does strictly fall under a bug fix17:02
kashyapdansmith: When you have a minute, maybe you have a comment? ^17:03
*** ducttape_ has quit IRC17:03
*** cmartin has quit IRC17:04
*** ducttape_ has joined #openstack-nova17:04
openstackgerritStephen Finucane proposed openstack/nova-specs: Reserve NUMA nodes with PCI devices attached  https://review.openstack.org/36446817:07
*** mvk has quit IRC17:07
dansmithkashyap: no freeze for bugs of course17:08
kashyapCool17:08
*** krtaylor has joined #openstack-nova17:08
*** jaypipes has quit IRC17:10
*** lpetrut has quit IRC17:12
*** dinobot_ has quit IRC17:13
*** ducttape_ has quit IRC17:15
*** tonytan4ever has quit IRC17:16
*** code-R_ has quit IRC17:17
*** pradk has joined #openstack-nova17:22
*** ducttape_ has joined #openstack-nova17:23
*** unicell has joined #openstack-nova17:24
*** inara has quit IRC17:26
*** avolkov` has joined #openstack-nova17:30
openstackgerritVladik Romanovsky proposed openstack/nova: tests: verify cpu pinning with prefer policy  https://review.openstack.org/35547517:30
openstackgerritVladik Romanovsky proposed openstack/nova: Allow linear packing of cores  https://review.openstack.org/34270917:30
mriedemalaski: so far https://review.openstack.org/#/c/356138/ looks good, just need to review the tests17:31
*** avolkov has quit IRC17:31
openstackgerritAndrew Laski proposed openstack/nova: Pull from cell0 and build_requests for instance list  https://review.openstack.org/35613817:31
mriedemkashyap: mdbooth: there is a freeze when we start building release candidates17:31
alaskimriedem: cool. just added the comment you mentioned17:31
mriedemafter rc1 bugs can be fixed on master17:31
mriedemand backported17:32
mriedembut only stop ship stuff gets into the release candidates17:32
*** akshai has quit IRC17:33
openstackgerritVladik Romanovsky proposed openstack/nova: tests: verify cpu pinning with prefer policy  https://review.openstack.org/35547517:34
openstackgerritAlberto Planas proposed openstack/nova: Add migrate_uri for invoking the migration  https://review.openstack.org/35655817:35
*** ManishD has quit IRC17:35
*** ijw_ has joined #openstack-nova17:35
*** kaisers_ has joined #openstack-nova17:35
*** moshele has joined #openstack-nova17:40
*** kaisers_ has quit IRC17:40
mriedemalaski: what difference does the services current vs not make in this https://review.openstack.org/#/c/356138/23/nova/tests/functional/wsgi/test_servers.py ?17:41
mriedemfor listing instances with build requests?17:41
alaskifunctionally it makes no difference. The test is there to ensure that17:42
*** unicell has quit IRC17:43
alaskiI guess you're wondering because there's no conditional using it?17:43
*** unicell has joined #openstack-nova17:43
alaskiit's because there is a conditional in the build path, so this ensures the different build paths still end up with the same list response17:43
mriedemok17:44
mriedemwhat about a test where an instance fails a build before it's scheduled to a cell and we list it out, and it's coming from the build request rather than the cell?17:44
*** nic has joined #openstack-nova17:45
alaskimriedem: fails in scheduling and goes to error?17:45
melwittalaski: something I just thought of is, with the service version get minimum fix, does that mean everything acts like AllServicesCurrent now?17:45
mriedemalaski: something like that17:46
mriedembasically to make sure we get the instance from the build request17:46
alaskimriedem: right now any failures wipe out the buildrequest and rely on the instance record17:47
alaskiwe basically only use the buildrequest while booting and before scheduling17:47
mriedemoh right b/c of your new change under this one17:47
alaskiany drift from the happy path relies on cell0, or an instance record, or the instance is deleted17:47
mriedemso what about the case of booting before scheduling, where there is no host for the instance?17:47
*** dstepanenko_ has left #openstack-nova17:48
mriedemin other words, is it possible to functionally test the build request part of this17:49
mriedemi see the unit test17:49
dansmithbauzas: FWIW, I don't get called with sign=-1 for a delete ever, so we'll have to find somewhere else to put that17:51
*** ijw_ has quit IRC17:51
alaskimriedem: this does functionally test the buildrequest because the buildrequest is deleted after scheduling during the boot process. These functional tests noop the conductor call so it gets to the end of compute/api where we have a buildrequest17:52
*** unicell has quit IRC17:53
alaskithis stops the build process at a point where we have a buildrequest and then lists17:53
mriedemah ok17:53
*** mvk has joined #openstack-nova17:53
mriedemheh, maybe i should have looked at the test name closer17:53
*** inara has joined #openstack-nova17:53
alaskiheh17:53
*** prometheanfire has left #openstack-nova17:54
mriedem+W good buddy17:54
alaskimelwitt: get_minimum_version defaults to 0 in the tests regardless of the lookup. except for certain functional tests that actually start a service17:55
alaskimriedem: \o/17:55
mriedemso in ocata we start early on cell0 stuff i suppose17:55
mriedemand then multi-cell support17:55
melwittalaski: okay, cool17:55
*** lpetrut has joined #openstack-nova17:55
edleafedansmith: I only found sign=-1 from an aborted migration17:55
edleafebut I didn't look that deeply17:55
mriedemand then migrating quotas to the api db17:55
alaskiugh17:56
alaskibut yeah17:56
*** avolkov` has quit IRC17:57
*** harlowja_ has joined #openstack-nova17:58
*** harlowja has quit IRC18:00
*** ihrachys has quit IRC18:00
*** TravT_ has joined #openstack-nova18:04
*** TravT has quit IRC18:04
*** TravT_ has quit IRC18:05
*** claudiub has quit IRC18:05
*** salv-orl_ has joined #openstack-nova18:08
*** salv-orlando has quit IRC18:11
*** hoonetorg has quit IRC18:11
dansmithedleafe: yeah seems like that's the case18:11
* edleafe steps away from the computer for a couple of hours18:13
*** su_zhang has joined #openstack-nova18:13
sdagueok, inventory client and logging are in18:14
melwittalaski: I didn't find how get_minimum_version defaults to 0 anywhere so I just tried querying the min version in each test and it's 15 in both cases. I wonder if something changed18:14
alaskimelwitt: hmm. perhaps I misunderstood something then18:15
*** Jeffrey4l has quit IRC18:15
*** ijw has joined #openstack-nova18:16
*** hoonetorg has joined #openstack-nova18:16
*** tonytan4ever has joined #openstack-nova18:16
*** sudipto has joined #openstack-nova18:16
alaskiit may have been unit tests where I saw that behavior, since no services are started there18:17
alaskiand assumed it carried over to functional18:17
bauzasdansmith: so, AFAIR, sign=-1 is when the claim is wrong18:17
*** tonytan4ever has quit IRC18:17
*** sudipto has quit IRC18:17
*** sudipto has joined #openstack-nova18:17
*** sudipto_ has joined #openstack-nova18:17
*** openstackgerrit has quit IRC18:18
melwittalaski: yeah, the existence of AllServicesCurrent implies that normally things wouldn't be last version18:18
*** cdent has quit IRC18:18
*** openstackgerrit has joined #openstack-nova18:19
bauzasdansmith: like when the instance_claim_abort, it calls _update_usage_from_instance with is_removed which transforms to sign=-1 for _update_usage()18:19
bauzasdansmith: or when we migrate, the move abort calls directly _update_usage() with sign=-118:20
bauzasdansmith: that why I said to you that _update_usage_from_instance() is only called for boot requests, not for move operations, but fine by us18:20
bauzasgiven the heal will also call it18:21
dansmithbauzas: well, delete is the thing I really need18:21
*** GB21 has quit IRC18:21
bauzasdansmith: you mean when we delete an instance?18:21
*** unicell has joined #openstack-nova18:22
dansmithbauzas: yeah18:22
bauzasdansmith: that's because it calls another method, sec.18:22
melwittalaski: you're right that it returns 0 for services that have not been started. the trouble with the test_servers.py is that they use the OSAPIFixture which starts the WSGIService which is what nova-osapi_compute queries18:22
bauzasdansmith: AFAIR, that's the compute_manager directly calling the RT for updating the instance18:23
melwittalaski: if I query nova-compute, that returns 0 in the wsgi test_servers.py18:23
bauzasdansmith: trying to find the right LOC18:23
dansmithokay18:23
dansmithapparently there is no GET on allocations :(18:23
sdagueok, checking in, is there a thing I can help with over the next 30 minutes?18:24
alaskimelwitt: okay. so I guess my fix did change the behavior here. I'm working on an inline service_version monkeypatch to return 018:24
mriedemsdague: don't think so18:24
mriedembauzas: yeah the compute manager calls it from _complete_deletion18:25
mriedemand then the RT checks the instance.vm_state to set the is_removed_instance flag to True18:25
melwittalaski: I think we can follow patch to fix it, I was just thinking about it18:25
bauzasmriedem: right18:25
bauzasmriedem: I was trying to look at code18:25
melwittalaski: *follow up18:25
bauzasdansmith: as mriedem said https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L73018:26
*** sudipto has quit IRC18:26
*** sudipto_ has quit IRC18:26
*** mtanino__ has joined #openstack-nova18:26
alaskimelwitt: so it turns out there's nothing conditional in the path anyways, mriedem was right all along. The conditional in the boot path is in the conductor, and for instance show or delete. But not list18:27
alaskiso I'll remove that test as a followup18:27
melwittalaski: oh. heh18:27
melwitteven better!18:27
*** mtanino has quit IRC18:27
alaskiyep. my mistake18:28
dansmithbauzas: that still gets me to _update_usage_from_instance() in the RT, which doesn't seem to be calling me for deleted instances18:28
dansmithbauzas: oh nevermind, it does18:29
bauzasdansmith: cool then, I would have been surprised if it doesn't :)18:29
bauzasdansmith: with the right sign=-1, right?18:30
dansmithbauzas: yes18:30
bauzasbecause of mriedem said again, the fact that we check vm_state in _update_usage_from_instance18:30
dansmithbauzas: it was failing before because I did something else wrong I think18:30
bauzas(gosh, that method name is super boring to write)18:30
dansmithI will have a WIP to look at in a sec18:30
bauzasdansmith: probably not yet going to the compute due to some delay?18:31
bauzasdansmith: I mean the instance deletion call18:31
bauzasanyway, that works now :)18:31
bauzasdansmith: FWIW, I'll have to sweat for a 5K run in the next 15 mins, but I'll look at that when I'm back18:31
*** mtanino has joined #openstack-nova18:31
*** harlowja_ has quit IRC18:31
*** harlowja has joined #openstack-nova18:32
dansmithwoot, it works18:32
dansmithbauzas: sure18:32
*** mtanino__ has quit IRC18:33
bauzasdansmith: so, like I said, make a very clear comment in the commit msg that we won't yet provide allocations for migrations, but that it will be reconciliated by the periodic call and I'll +1 it18:34
*** ijw has quit IRC18:35
dansmithbauzas: eventually yeah18:35
dansmithincoming18:35
openstackgerritDan Smith proposed openstack/nova: Add support for allocations in placement API  https://review.openstack.org/33987418:35
openstackgerritDan Smith proposed openstack/nova: Add create_all and delete_all for AllocationList  https://review.openstack.org/36320918:35
openstackgerritDan Smith proposed openstack/nova: WIP Simple instance allocations  https://review.openstack.org/36449818:35
dansmithstill has debug ^18:35
dansmithbut creates and deletes allocations for instance boot/delete18:35
dansmithmriedem: alaski sdague ^18:35
bauzasdansmith: I think we could very easily add migrations by adding a call before https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L78718:36
*** unicell has quit IRC18:36
dansmithokay, we can do that after this works18:36
dansmithwe need this for FF I think18:36
bauzasagreed18:36
bauzasI could write a follow-up18:37
bauzasand maybe ask for a FFE :p18:37
openstackgerritOpenStack Proposal Bot proposed openstack/nova: Updated from global requirements  https://review.openstack.org/36387118:37
*** akshai has joined #openstack-nova18:37
dansmithor call it a bug which it is :)18:37
sdaguedansmith: I love your DAN logs18:38
*** irenab has joined #openstack-nova18:38
dansmithsdague: easy grepping18:38
dansmithsdague: don't make fun18:38
bauzasheh18:39
*** annegentle has quit IRC18:39
* bauzas goes away for (hopefully) 45 mins18:39
sdaguedansmith: :)18:39
dansmitha holdover from my printk("DAN:  ..."); days18:39
sdaguedansmith: I'm building a local version of that18:39
bauzasdansmith: first glance looks good :)18:39
dansmithcool18:39
*** cdent has joined #openstack-nova18:39
*** xavvior has joined #openstack-nova18:40
*** unicell has joined #openstack-nova18:40
*** unicell has quit IRC18:41
dansmithsdague: also, noted that your safe_connect *can* still return None if we're already disabled18:41
dansmithsdague: so need to handle that in places18:41
sdaguedansmith: right, it can18:42
sdaguewe're never using it's value though, right?18:42
*** salv-orl_ has quit IRC18:42
sdaguethe can't return None part is the .get/.post/.put/.delete calls18:43
dansmithsdague: sure, we expect a response and just do response.status_code or response.text etc18:43
sdagueno, we don't18:43
dansmithoh duh right18:43
dansmithsorry sorry18:43
sdaguethey are 2 different levels18:43
dansmithconfusing my sheet18:43
sdagueyep, now worries18:43
dansmithyeah, ignore me18:43
sdagueyep, no worries, lots in flight18:43
*** annegentle has joined #openstack-nova18:43
*** prateek has joined #openstack-nova18:46
*** parora has quit IRC18:46
alaskidansmith: looks sane, commented on a couple of things. The volume handling could happen later since we don't handle it properly today either18:47
dansmithalaski: right18:47
*** fragatin_ has quit IRC18:48
*** annegent_ has joined #openstack-nova18:49
*** david-lyle has quit IRC18:49
cdentdansmith: are things ready to browse? I guess this is it: https://review.openstack.org/#/c/364498/18:49
*** ijw has joined #openstack-nova18:49
dansmithcdent: cleaning up now18:49
dansmithcdent: but works yeah18:49
*** su_zhang has quit IRC18:50
*** david-lyle has joined #openstack-nova18:50
*** tbachman has quit IRC18:50
mriedemcool, nice work18:51
mriedemi have to run my car over to the shop to get the starter checked, just had to jump it. can't be w/o a car in case i've got jury duty tomorrow and laura is at work. i'll pick up from wifi there.18:51
*** annegentle has quit IRC18:52
cdentdansmith: looks sane. are you happy with how it is choosing when to delete, that part seems a bit vague18:54
dansmithcdent: why vague? it's already calculated in existing code18:54
cdentdansmith: the irc log made it sound like 'sign' was itself not a clear vague18:55
*** mriedem has quit IRC18:56
cdents/vague/signal/18:56
*** divyakkonoor has quit IRC18:56
dansmithcdent: I think it is, I was just unsure why I wasn't ever getting -1, but that was because I was failing on the initial allocation18:56
*** dikonoor has joined #openstack-nova18:57
*** akshai has quit IRC18:57
*** yassou has quit IRC18:57
*** dikonoo has joined #openstack-nova18:57
cdentah, okay18:57
dansmiththe way I tested this was devstack,19:00
dansmithbefore boot validate that nova_api.allocations is empty,19:00
dansmithboot an instance,19:00
dansmithvalidate that allocations has three for the instance, one of each type,19:01
dansmiththen delete the instance and verify that the table is empty again19:01
*** tbachman has joined #openstack-nova19:03
*** irenab has quit IRC19:03
*** irenab has joined #openstack-nova19:07
*** fragatina has joined #openstack-nova19:10
cdentdansmith: that seems legit for a sanity check19:12
openstackgerritPushkar Umaranikar proposed openstack/nova: Removing duplicates from columns_to_join list  https://review.openstack.org/34229919:12
*** harlowja_ has joined #openstack-nova19:13
*** prateek_ has joined #openstack-nova19:14
*** raunak has quit IRC19:14
* cdent starts swearing19:16
*** tonytan4ever has joined #openstack-nova19:16
sdaguedansmith: when are allocations supposed to be written?19:16
*** tonytan4ever has quit IRC19:16
*** prateek has quit IRC19:16
dansmithsdague: same as claims for the time being19:17
dansmithsdague: which is why putting it in the same path makes it easy19:17
*** harlowja has quit IRC19:17
dansmithcdent: does that mean you're starting devstack?19:17
cdentyes19:17
dansmithhah19:17
sdagueoh, there I see it going now19:18
*** mingyu has quit IRC19:18
openstackgerritDan Smith proposed openstack/nova: Simple instance allocations from resource tracker  https://review.openstack.org/36449819:18
dansmithcleaned up with unit tests ^19:18
sdagueI'm running tempest against it, placement api seems to be doing all the rights things19:18
dansmithsweet19:18
sdaguethe fact that you used ERROR for dan logs threw me :)19:19
sdaguered in the console and all19:19
*** lyarwood_ is now known as lyarwood19:20
*** su_zhang has joined #openstack-nova19:20
dansmithheh19:20
dansmithfixed in the latest version19:20
*** tbachman has quit IRC19:21
sdagueso, from the metric of "this does not horribly explode" it gets a +119:22
dansmiththat is the only metric that matters on the afternoon of FF19:23
*** salv-orlando has joined #openstack-nova19:23
cdentanybody tried a resize or anything like that yet?19:23
cdentI guess tempest will do that at some point during sdague's run?19:23
dansmithI was going to in a sec19:23
dansmithpushing this back to my devstack machine19:24
sdaguecdent: it will19:24
dansmithit will fail gracefully anyway, so some checking would be good19:24
* cdent is still waiting on devstack19:24
sdagueyeh, it's mostly about just looking at the state of the logs after the successful runs19:24
*** raunak has joined #openstack-nova19:24
*** raunak has quit IRC19:25
*** dikonoo has quit IRC19:25
*** dikonoor has quit IRC19:25
*** chrichip has joined #openstack-nova19:25
*** su_zhang has quit IRC19:25
sdagueit's a weird pattern that I'm seeing though where we put allocations, then we put inventories really quickly 3 times after19:26
*** ssurana has quit IRC19:27
matiasshould I ask for a recheck for the gate-tempest-dsvm-multinode-live-migration failure here? https://review.openstack.org/#/c/358599/ I'm still not familiar enough with the recheck procedure19:27
*** ssurana has joined #openstack-nova19:27
sdaguematias: yeh, that was an overnight bug19:27
sdaguethat is now fixed19:27
matiassdague: thanks19:27
dansmithcdent: just tried it19:27
dansmithcdent: we basically have no new allocation during the resize, but when we confirm we allocate the new value19:28
dansmithcdent: so still some work to do there, but not *too* far off19:28
dansmithcdent: so there is no GET on allocations huh?19:28
cdentno, jay didn't want that info exposed19:29
dansmithI kinda need that in order to determine if we're doing allocations too often19:29
dansmithhrm19:29
cdentyou can get usages on a resource_provider19:29
dansmithyeah, but that... doesn't make a lot of sense I don't think19:29
dansmithto determine if we need to update our allocation from that usage info19:29
*** gabor_antal_ has joined #openstack-nova19:29
cdentbut why do you need/want to do that?19:30
dansmithcdent: right now I'm just updating the allocations for every instance every minute19:30
dansmithin addition to the inventory...every minute19:30
* cdent nods19:31
cdentbut wouldn't you want to check a local cache not a remote cache (in the ideal world)?19:31
*** ijw has quit IRC19:31
dansmithsure19:32
dansmithalthough it seems like we *should* know that actually19:32
*** ijw has joined #openstack-nova19:32
*** unicell has joined #openstack-nova19:32
*** annegent_ has quit IRC19:32
sdagueok, taking off for the holiday weekend. Enjoy folks. Talk to you all on Tuesday.19:33
dansmithbecause we only call this if is_new_instance or is_removed_instance, yet we're clearly hitting it every minute19:33
dansmithsdague: o/19:33
cdentthe only person that can change the allocation is the same thing that set the allocation, right, because it is the consumer (in the compute node context)19:33
cdents/person/entity/19:34
*** bvanhav has quit IRC19:34
cdentdansmith: I'm guess that once an instance is 'is_new_instance' it never stops being so19:34
cdentuntil it is removed19:35
dansmithcdent: does the allocation process in the api retry if it fails due to a race?19:35
dansmithor is the client supposed to try to reallocate?19:35
cdentit doesn't, yet, but there's a todo (from jay) saying that it should19:36
cdenti thought perhaps it was better for the client to do it but alex responded that it would more efficient (since allocations happen alot) for the server to at least try19:36
cdent(which is probably right)19:36
dansmithah, I see why19:36
dansmithcdent: okay I think it should try a few times19:36
dansmithcdent: the server I mean19:37
dansmithso we clear our tracked instances every  once in a while and regenerate, because of theheal I guess19:37
*** ijw has quit IRC19:37
*** sdague has quit IRC19:37
dansmithcdent: which is why we shoud be able to GET the allocation.. so we can heal if it's wrong when we periodically check19:37
melwittyeah, they are cleared out each call to update_available_resource19:38
dansmithso we can fix that later, but it's going to generate a lot of http and db traffic in its current form19:38
dansmithyeah19:38
cdentdansmith: I'm sorry, I'm still confused. Probably because there's a nearby tv making pretty nature tv pictures, but:19:39
dansmithalaski: sorry didn't do your things yet19:39
cdentyou want to GET the allocation to compare with what you've got currently to decide if you want to send it again?19:39
alaskijust that one comment should be removed19:40
* cdent has done indepdent confirmation of allocation create and delete when server boot and delete.19:42
cdentfun to see it real19:42
dansmithcdent: right19:42
cdentand there's no local record (yet) of what we did last time...19:43
* cdent thinks19:43
*** FL1SK has quit IRC19:43
dansmithcdent: it's distributed, so we always have to be able to reconcile and heal19:44
*** tongli has quit IRC19:44
dansmithalaski: thanks for that utils pointer, I just added that.. need to see how many thousands of unit tests it breaks :D19:44
*** mnestratov has quit IRC19:45
alaskithat's always fun. I only have 145 broken tests on my latest cells patch19:46
*** rmart04 has joined #openstack-nova19:46
cdentthe unique id of a single allocation (not the uri) is the rp_uuid and the consumer_uuid so how does the distributed nature of things apply?19:46
cdent(sorry if my questions are stupid, trying to unwind things in my head)19:46
*** hemanthm is now known as hemanthm|bbl19:46
dansmithcdent: if the compute node doesn't know if the placement db has the stuff it needs, and can't tell, it has no way to do anything other than push it again19:47
*** trisq has joined #openstack-nova19:47
dansmithcdent: and even if we could record that it happened last time we tried, that could get out of sync, databases can get rolled back, etc.. we always have to be able to heal ourselves19:47
cdentright, what I'm getting at is that a local cache is easy to do (if it is true that there can only be one resource tracker per compute node)19:48
dansmithcdent: we have a local cache now, we just periodically invalidate it so that we will notice if/when we need to heal19:48
cdentand every 10th heal or whatever, you flush the cache19:48
dansmithwhich is what I'm seeing19:48
dansmithright, it's doing that now19:48
*** mriedem has joined #openstack-nova19:49
cdentokay19:49
mriedemhow's it looking?19:49
dansmitheven still, pushing all our instances up to the placement db every ten minutes for no reason sucks19:49
dansmithmriedem: I have a patch up that seems to work for the simple cases we were shooting for19:49
cdentso the goal is to do an http request that needs to look in the database to avoid something doing an http requests that needs to write in the database?19:49
dansmithmriedem: making some edits, but cdent sdague and myself have tested locally19:49
mriedemok19:50
cdent(I confirm that resize updates don't happen immediately but do happen eventually)19:50
dansmithcdent: sure, because the query doesn't cause other people to fail to update their rows with real business19:50
mriedemoh i see a major issue19:50
cdentyeah, just stating it all out explicitly19:50
dansmithcdent: if we're all writing all the time for no reason, we're just going to clash and have to retry a lot19:50
cdentI'm assuming that jay had some kind of idea on this. probably vast (and possibly misplaced) faith in the datastore.19:51
dansmithcdent: well, the server could just not do the actual write if it looks like the data is unchanged19:51
dansmithcdent: that simplifies the client,19:51
*** raunak has joined #openstack-nova19:51
dansmithand lets the future be different, since the client will always lag the server19:52
openstackgerritDan Smith proposed openstack/nova: Simple instance allocations from resource tracker  https://review.openstack.org/36449819:52
dansmithdoes the bfv check ^19:52
*** prateek_ has quit IRC19:52
dansmithhaven't tested that locally, but about to19:52
dansmithworks for me locally19:54
*** su_zhang has joined #openstack-nova19:54
dansmithmriedem: fixed the bp link locally, let me know when you're done19:55
dansmithwe need to let this sit long enough to get an actual tempest run on it19:55
mriedemyeah. i was going to check the spec against the allocation thing too.19:56
dansmithbecause that matters? :D19:56
mriedemit's deadly serious.19:57
* dansmith quakes in his boots19:58
mriedemthe spec does point out some things we lose by not handling cleaning up in update_available_resource20:00
mriedemlike local delete20:00
dansmithyeah, that's true20:01
dansmithwe can try to do that in local_delete in a followup20:01
dansmithcan't really test that for reals though20:01
*** rmart04 has quit IRC20:02
mriedemduring the spec review i mentioned if we'd just try and do the allocation delete from the API and jay said the update_available_resource periodic in the compute would just clean those up - which it could, if we patch that in later.20:03
cdentI had some weirdness with usage when trying to resize down to a smaller size but I think maybe I have no idea what I'm doing.20:03
mriedemyou can't resize down20:03
cdentwell that would explain that then20:04
mriedemor shouldn't be able to i don't think20:04
mriedemi thought we caught that in the api though20:04
cdentit let me do it20:04
cdentbut didn't actually change anything20:04
*** ijw has joined #openstack-nova20:04
*** TravT has joined #openstack-nova20:04
dansmithyou can't resize disk down20:04
* bauzas is back20:04
*** annegentle has joined #openstack-nova20:05
alaskixenapi lets you do it, which is why the API doesn't check it20:05
cdenti chose a smaller flavor (m1.small to m1.tiny)20:05
dansmithmriedem: anything else on there or should I push with the updated link to start the clock?20:05
dansmithalaski: right20:05
mriedemdansmith: still working through20:05
cdenti have learned many things today20:05
dansmithokay20:06
*** derekh has joined #openstack-nova20:06
cdentI think rather than getting too far over quota I'm going to give myself an opportunity to sleep so I can play with this stuff in more earnest tomorrow. Are there particular needs?20:06
*** prateek has joined #openstack-nova20:07
mriedemnot that i know of, but i just got back20:07
*** ducttape_ has quit IRC20:07
dansmithno20:07
*** ducttape_ has joined #openstack-nova20:08
cdentcool, I'll just mess with it20:08
*** TravT has quit IRC20:08
cdentthanks for the stalwart effort  dansmith20:08
cdent'night20:09
dansmitho/20:09
*** cdent has quit IRC20:09
openstackgerritAugustina Ragwitz proposed openstack/nova: Assume neutron port_binding extensions enabled  https://review.openstack.org/35772620:09
bauzasdansmith: mriedem: so what should we do with the N-3 tag ?20:09
bauzasgiven we have our meeting in less than 1h20:09
*** rama_y has quit IRC20:09
*** ijw has quit IRC20:09
bauzasmriedem: dansmith: should we try to merge https://review.openstack.org/#/c/363209/9 and the upper ones before cutting the milestone, or should we FFE that ?20:10
dansmithbauzas: he has until EOD to do it I think20:10
bauzasdansmith: looking at the gate20:10
dansmithgate looks healthy, should be fine20:11
dansmith48/13 == fast20:11
mriedemdansmith: i'm a bit confused about what the spec says for calculating the disk20:11
bauzasyeah20:11
dansmithmriedem: link?20:11
bauzasmriedem: the spec says we should use the aggregate for that20:11
*** tonytan4ever has joined #openstack-nova20:11
mriedemhttp://specs.openstack.org/openstack/nova-specs/specs/newton/approved/resource-providers-allocations.html20:11
bauzasmriedem: which is something not yet done20:11
mriedemhttp://specs.openstack.org/openstack/nova-specs/specs/newton/approved/resource-providers-allocations.html#implementation20:11
bauzasmriedem: so here we feature parity20:11
*** coolsvap has quit IRC20:12
mriedemit doesn't say anything about aggregates20:12
bauzasmriedem: it says that for a shared storage, the disk resource would be shared20:12
bauzaswith only one resource provider20:12
mriedemwell, it's not the only confusing thing, because it's talking about needing a compute node uuid in the URL for the request20:13
*** gyee has joined #openstack-nova20:13
mriedemi.e. the consume (instance uuid) is scoped to the resource provider (compute node uuid) in the request20:13
mriedembut that doesn't appear to be how the API actually works20:13
dansmithmriedem: I don't think I agree with the spec20:13
bauzasmriedem: in order to do that, we need to map an aggregate that would get all the hosts sharing the disk with a resource provider where the inventory should be set by Cinder20:13
dansmithmriedem: it says volume space should be counted against the compute node, which is wrong20:13
bauzasI agree with dansmith20:14
dansmiththe whole point of this work is to NOT do that :P20:14
*** rmart04 has joined #openstack-nova20:14
*** rmart04 has quit IRC20:14
bauzasyeah, that's the exact purpose of having a shared resource provider with DISK resource class for a list of computes20:15
mriedemgah laura is vacuuming and it's throwing me off, just like julie20:15
dansmithheh20:16
*** tonytan_brb has joined #openstack-nova20:16
bauzasheh, that's why I love working after 9pm20:16
mriedemwhitespace issue in https://review.openstack.org/#/c/339874/38/nova/tests/functional/api/openstack/placement/gabbits/allocations.yaml not sure if that matters20:16
bauzasgnomes are sleeping and TV is working20:16
*** TravT has joined #openstack-nova20:16
*** gabor_antal__ has joined #openstack-nova20:17
*** tonytan4ever has quit IRC20:17
dansmithmriedem: I don't think we have any validation of that..I think we're fine and it's passing jenkins, so I think we should not reset it20:17
*** mingyu has joined #openstack-nova20:18
openstackgerritDan Smith proposed openstack/nova: Simple instance allocations from resource tracker  https://review.openstack.org/36449820:19
mriedemgah20:19
mriedemsome comments in ps320:19
*** rmart04 has joined #openstack-nova20:19
dansmithit's fine, just trying to get the clock going if there was nothing else20:19
mriedemnothing blocking20:19
*** antal has joined #openstack-nova20:20
*** gabor_antal_ has quit IRC20:20
dansmithmriedem: okay, so good to patch after the fact?20:21
dansmithmriedem: I can follow up with "fixes" for local delete I think.. my brain is about goo20:21
openstackgerritMathieu Gagné proposed openstack/nova: Make scheduler less greedy when loading instances for tracking  https://review.openstack.org/36394420:21
*** gabor_antal_ has joined #openstack-nova20:21
*** tblakes has quit IRC20:22
mriedemwe could have a unit test for the RT actually calling the method in the reportclient...20:22
mriedemor stack that on top20:22
*** gabor_antal__ has quit IRC20:23
mriedemwe don't have unit tests for the put and delete calls failing20:23
dansmithmriedem: I didn't add those because I need to figure out how to make a mock look falsey20:23
*** mingyu has quit IRC20:23
*** rmart04 has quit IRC20:23
bauzasmriedem: FWIW, the whitespace issue seems not a problem http://logs.openstack.org/74/339874/38/check/gate-nova-tox-db-functional/43297d5/console.html#_2016-09-01_18_46_13_85194620:24
mriedemmaybe you can create a MagicMock and override __bool__20:24
*** antal has quit IRC20:25
dansmithit's nonzero I think20:25
mriedemMagicMock.__bool__.return_value = False20:25
mriedemsomething like that20:25
*** gabor_antal__ has joined #openstack-nova20:25
*** tbachman has joined #openstack-nova20:26
dansmithit's __nonzero__20:26
dansmithI got it20:26
*** ijw has joined #openstack-nova20:26
dansmithmriedem: the resource tracker client call will take me longer20:26
mriedemah yeah http://stackoverflow.com/questions/2233786/overriding-bool-for-custom-class20:26
dansmithmriedem: you want me to update this now or stack on top?20:27
mriedemdansmith: just stack on top20:27
dansmithyou are the one that has to stay up late for the tag...20:27
dansmithokay :)20:27
*** _ducttape_ has joined #openstack-nova20:28
mriedem+2 on https://review.openstack.org/#/c/364498/20:28
mriedemwith todos marked inline20:28
*** gabor_antal_ has quit IRC20:29
dansmithmriedem: we do want a 404 to be a warning on delete20:29
dansmithmriedem: we won't have gotten here if placement is not running, and 404 means we leaked something somewhere20:30
mriedemi was going on the spec, which also assumed we had update_available_resource doing things, which would introduce a race20:30
mriedemand possible duplicate deletion and a 40420:30
dansmithhmm I don't think we can get a double delete this way20:31
dansmithexcept for after a local delete maybe20:31
mriedemso yeah we can ignore that and just lump in with a general todo for update_available_resource20:31
*** ijw has quit IRC20:31
dansmithbut that is probably fine20:31
dansmithokay20:31
*** ducttape_ has quit IRC20:31
bauzasmriedem: well, we share the same semaphore between claims and update_avail_res AFAIR20:32
bauzasmriedem: so, not sure where the race could be20:32
* bauzas looking20:32
*** gouthamr has quit IRC20:34
bauzasyeah we share COMPUTE_RESOURCE_SEMAPHORE20:34
*** _ducttape_ has quit IRC20:34
mriedemthe pci device will all have to wait for another time too....maybe by pike20:35
bauzasbut I'm rereading the spec20:35
bauzasmriedem: PCI devices were way off the bag for Newton20:35
mriedembauzas: i think the 404 on delete came up when we were talking about local delete in the spec review20:35
*** ducttape_ has joined #openstack-nova20:35
mriedemso that's probably where it came from and we do'nt have to worry about it right now20:35
mriedemalaski: https://review.openstack.org/#/c/355602/ \o/20:35
bauzasmriedem: but a local delete doesn't touch the ComputeNode table20:36
bauzasmriedem: that's only when the periodic task is run on the compute side that we reconcile that20:36
bauzas(for local deletes)20:36
mriedemthe jobs change for cellsv2 is also approved https://review.openstack.org/#/c/363937/20:36
*** prometheanfire has joined #openstack-nova20:36
bauzasso there would only be one call to the placement API for deletion20:37
prometheanfiremriedem: you know about the new neutronclient release?20:37
mriedemprometheanfire: gdi20:37
mriedemplease20:37
mriedemno20:37
prometheanfirelololol20:37
mriedemprometheanfire: you know you're becoming like a bot of bad news for me right?20:37
alaskimriedem: woo20:37
mriedembauzas: idk, maybe we just chalk these up to unanswered questions in the etherpad to discuss with jaypipes next week20:37
mriedembauzas: let's start an unanswered questions thing in https://etherpad.openstack.org/p/placement-next20:38
mriedemwe have a todo section at the bottom20:38
mriedemlet's start a subsection for allocation things20:38
prometheanfiremriedem: I'm sorry, I'm the only one manning the requirements team during the day, so it's my job to be that guy :(20:38
*** _ducttape_ has joined #openstack-nova20:38
prometheanfiremriedem: if it helps they broke neutron and horizon gates too20:38
prometheanfirehttps://review.openstack.org/36450420:39
*** annegentle has quit IRC20:39
bauzasmriedem: over, over.20:39
mriedembauzas: i've added some notes in there at the bottom20:39
mriedemprometheanfire: yeah tonyb had me on horizon breaking last night for novaclient20:39
mriedemprometheanfire: http://logs.openstack.org/04/364504/1/check/gate-cross-nova-python27-db-ubuntu-xenial/76cdad7/console.html looks like a timing issue20:40
prometheanfiremriedem: it's that time of the release cycle20:40
mriedemas in the package isn't in the mirror yet20:40
prometheanfireoh, that's better20:40
mriedemNo matching distribution found for python-neutronclient===6.0.0 (from -c /home/jenkins/workspace/gate-cross-nova-python27-db-ubuntu-xenial/upper-constraints.txt (line 298))20:40
smcginnismriedem: Did a patch go through for that os-brick logging failing test?20:40
prometheanfireI wonder if the bot needs a wait before it submits to our gate20:40
openstackgerritDan Smith proposed openstack/nova: Cleanup allocation todo items  https://review.openstack.org/36454720:40
mriedemsmcginnis: no https://review.openstack.org/#/c/364454/20:41
mriedemhas a +@20:41
mriedem+220:41
*** ijw has joined #openstack-nova20:41
mriedemdansmith: alaski: maybe one of you wants to hit https://review.openstack.org/#/c/364454/20:41
smcginnismriedem: Can we get some help to push that through? The Cinder test update is almost through gate.20:41
mriedemi've put out the nova-core signal20:41
alaskilooking20:42
*** ducttape_ has quit IRC20:42
mriedembasically we have an old test that mocks internals of os-brick and unsurprisingly that hurt us20:42
* smcginnis imagines a batman symbol in the sky with a big N20:42
prometheanfiremriedem: ya, sorry, false alarm (for now)20:42
mriedemsmcginnis: no it would have to be the mascot20:42
smcginnismriedem: What did you guys end up with for a mascot?20:42
mriedempile of poo20:43
smcginnisLOL20:43
mriedemor a star/supernova20:43
mriedemwhichever comes first20:43
smcginnis;O)20:43
*** tblakes has joined #openstack-nova20:43
alaskidansmith: you've seen https://review.openstack.org/#/c/339874/38 working locally while testing?20:45
*** _ducttape_ has quit IRC20:45
dansmithalaski: extensively, as has cdent and sdague20:45
alaskidansmith: great20:45
dansmithI just +2d20:45
*** ducttape_ has joined #openstack-nova20:45
*** ayoung has quit IRC20:46
*** ijw has quit IRC20:46
*** derekh has quit IRC20:47
*** annegentle has joined #openstack-nova20:47
*** gabor_antal__ is now known as antal20:48
alaskidansmith: I'm sure you're fried, but https://review.openstack.org/#/c/326906/ could use a quick review20:48
alaskiheh, nvm20:48
dansmithmriedem: hmm, I put a bug in the happy path to test those __nonzero__ things, but .. hrm20:48
mriedemdansmith: i also thought the mock needed to be mock.__nonzero__.return_value = False20:49
mriedemyou have it the other way around20:49
dansmithah yeah20:50
*** ljxiash has joined #openstack-nova20:50
mriedemso status check, https://review.openstack.org/#/c/356138/ is #6 in the gate queue20:50
dansmithactually, I need more20:51
dansmithreturn_value.__nonzero__.return_value20:51
dansmiththat's why20:51
mriedemdiscoverable policy cli is merged20:51
*** ijw has joined #openstack-nova20:52
*** takashin has joined #openstack-nova20:52
*** xavvior has quit IRC20:52
*** baoli_ has quit IRC20:53
*** chrichip has quit IRC20:53
openstackgerritTakashi NATSUME proposed openstack/nova: Treat 'body_map' as a mapping of HTTP request bodies  https://review.openstack.org/36345720:54
*** ljxiash has quit IRC20:54
*** chrichip has joined #openstack-nova20:55
mriedemalaski: for https://blueprints.launchpad.net/nova/+spec/cells-cell0 i think we just mark it as partially complete and defer the rest to ocata right?20:55
alaskiyes20:56
alaskiand scheduling-interaction20:56
alaskibut the buildrequest_obj one I would consider done20:56
openstackgerritDan Smith proposed openstack/nova: Cleanup allocation todo items  https://review.openstack.org/36454720:57
*** Hosam has joined #openstack-nova20:57
bauzas3 mins before meeting?20:57
dansmithquick one I hope?20:58
mriedemyup20:58
mriedemyes20:58
*** xavvior has joined #openstack-nova20:59
*** browne has quit IRC20:59
*** Gibi is now known as gibi21:00
*** rama_y has joined #openstack-nova21:01
*** moshele has quit IRC21:02
dansmithalaski: cells failed on the allocations one: http://logs.openstack.org/98/364498/4/check/gate-tempest-dsvm-cells/85c557e/console.html#_2016-09-01_20_57_14_49781521:02
dansmithlook familiar? don't think it's related21:02
dansmithif it's clean I'll bump it to restart so we don't have to wait21:03
*** prateek_ has joined #openstack-nova21:03
alaskinot familiar. And I agree it doesn't seem related21:03
*** vladikr has quit IRC21:04
alaskinothing stands out in the logs21:04
openstackgerritDan Smith proposed openstack/nova: Simple instance allocations from resource tracker  https://review.openstack.org/36449821:05
dansmithkicked ^21:05
*** prateek has quit IRC21:06
*** eharney has quit IRC21:10
*** kaisers_ has joined #openstack-nova21:14
tonybanyone know what sdqgue is doing with: https://review.openstack.org/#/c/364262/1 ?21:17
alaskidansmith: I looked through logs for a few more minutes, seems like a random timing thing with snapshot21:17
dansmithalaski: same21:17
*** kaisers_ has quit IRC21:18
mriedemi think i've seen that before21:19
mriedemmelwitt's 326906 is #2 in the gate21:20
*** burt has quit IRC21:21
*** gszasz has quit IRC21:22
dansmithaye21:22
* bauzas calls it a day \o21:23
*** xavvior has quit IRC21:24
dansmithmriedem: the __nonzero__ thing doesn't work on py321:24
*** rcernin has quit IRC21:24
mriedemdansmith: i know21:25
mriedemyou have to use __bool__21:26
dansmithbut will that work on py2?21:26
mriedemi guess i didn't think about that when i +2d21:26
mriedemyeah21:26
*** thorst has quit IRC21:26
dansmithokay I'll change21:26
dansmithhave to rebase it anyway21:26
mriedemyou can assign __bool__ = __nonzero__ in the mock to do both21:26
openstackgerritDan Smith proposed openstack/nova: Cleanup allocation todo items  https://review.openstack.org/36454721:26
*** thorst has joined #openstack-nova21:27
dansmithbut bool works on both so why?21:27
mriedemit does?21:27
dansmithyou said it does21:27
bauzasmriedem: dansmith: so you want to check if r is None, right?21:27
dansmithbauzas: no21:27
mriedemi thought nonzero was py2 and bool was py321:27
mriedemso idk21:27
*** takashin has left #openstack-nova21:28
*** antal has quit IRC21:28
dansmithmriedem: mock refuses __bool__ on py2 :D21:28
mriedemman21:28
mriedemwell, we can six.py2 case that shit, or blacklist the test for py321:29
mriedemthis isn't blocking the release anyway21:29
mriedemso no rush21:29
*** lpetrut has quit IRC21:29
alaskiaccording to http://stackoverflow.com/questions/2233786/overriding-bool-for-custom-class it's __nonzero__ on py2 and __bool_ on py321:29
*** takashin has joined #openstack-nova21:29
dansmithI know21:29
dansmithalaski: right21:29
*** rtheis has quit IRC21:29
*** cleong has quit IRC21:30
openstackgerritDan Smith proposed openstack/nova: Cleanup allocation todo items  https://review.openstack.org/36454721:30
dansmithI think this will work ^21:30
dansmithif not, punt21:30
*** thorst has quit IRC21:31
*** claudiub has joined #openstack-nova21:31
*** rama_y has quit IRC21:32
alaskiwhy does mock_put.return_value = False not work?21:32
*** gouthamr has joined #openstack-nova21:32
dansmithalaski: because we always get a response, but it's falsey if it's an HTTP failure21:33
dansmithwhich i what we want21:33
dansmith*is21:33
bauzasdansmith: not sure I got your problem but mock.patch('something'', new=None) could make the deal21:34
dansmithno21:34
dansmithreally21:34
alaskiahh, I see. you need r.status_code to work21:34
dansmithalaski: right21:34
bauzasooooh I see21:34
dansmith:)21:35
alaskiyou could create an inner class in the test with __bool__/__nonzero__/other attrs and return that. but if you can shorthand it that's certainly cleaner21:35
dansmithsure but it's just silly21:36
alaskiyeah21:36
alaskiwell I'll check back later to see if anything needs a kick but I'm going to get some food in the meantime21:39
* dansmith wishes he had food21:39
auggydansmith: http://www.coopscookies.com/21:40
*** mingyu has joined #openstack-nova21:40
alaskidansmith: you're one internet order and some quick personal interaction away from that being a reality21:40
* auggy just literally lol'ed21:41
*** priteau has quit IRC21:42
*** FL1SK has joined #openstack-nova21:43
mriedemhmm https://review.openstack.org/#/c/356963/21:43
mriedemso sean +2ed that, and it's the last thing in that series21:44
*** ducttape_ has quit IRC21:44
*** gouthamr_ has joined #openstack-nova21:44
*** ijw has quit IRC21:44
edleafemriedem: yeah, I thought that was odd21:44
*** mingyu has quit IRC21:45
mriedemwell i'm not sure if it has to get in today or can come later21:45
*** ducttape_ has joined #openstack-nova21:45
edleafemriedem: with all those -2s on the earlier patches, it isn't getting in today :)21:45
edleafemriedem: oh, nm21:46
edleafeI thought it was dependent on them21:46
mriedemno21:46
dansmithalaski: hah21:47
mriedemthose were some other confusion that we cleared up a few weeks ago21:47
*** gouthamr has quit IRC21:47
mriedemhttps://review.openstack.org/#/c/326906 is merged21:49
melwitt\o/21:50
*** yamahata has quit IRC21:50
*** su_zhang has quit IRC21:51
*** su_zhang has joined #openstack-nova21:53
mriedemalaski: you said https://blueprints.launchpad.net/nova/+spec/cells-scheduling-interaction gets moved to ocata right?21:54
*** thorst has joined #openstack-nova21:57
openstackgerritOpenStack Proposal Bot proposed openstack/nova: Updated from global requirements  https://review.openstack.org/36387121:57
*** haplo37__ has quit IRC21:59
*** thorst has quit IRC22:01
*** yamahata has joined #openstack-nova22:02
mriedemi think because of https://review.openstack.org/#/c/319379/22:02
*** ijw has joined #openstack-nova22:04
*** Swami has quit IRC22:11
*** sameo has quit IRC22:11
*** john51 has joined #openstack-nova22:13
*** xyang1 has quit IRC22:14
*** john51_ has quit IRC22:15
openstackgerritAugustina Ragwitz proposed openstack/nova: Remove deprecated cinder options  https://review.openstack.org/36380322:16
*** browne has joined #openstack-nova22:20
mriedemdansmith: hmm, why don't i see any of the logging from your allocations change here? http://logs.openstack.org/98/364498/5/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/eb1cdb8/logs/screen-n-cpu.txt.gz22:20
dansmithallocations 2/3 in the gate22:20
mriedemlike Submitted allocation for instance22:20
dansmithmriedem: does that have placement enabled?22:21
mriedemno22:21
mriedemgood call22:21
dansmithso...22:21
dansmithheh22:21
mriedemyeah the placement job is still running22:21
*** erhudy has quit IRC22:22
*** mdrabe has quit IRC22:24
mriedemi have to get out and mow this damn yard at some point22:24
*** mingyu has joined #openstack-nova22:25
alaskimriedem: correct22:26
*** ducttape_ has quit IRC22:27
alaskiit should be relatively easy to get that done early in O22:27
*** sameo has joined #openstack-nova22:28
auggyi wonder if there's a roomba version of a lawnmower22:28
dansmiththere is22:28
auggyomg22:28
dansmithhttp://www.husqvarna.com/us/products/robotic-lawn-mowers/22:28
mriedemplacement job passed check22:28
dansmithmriedem: of course it did22:28
mriedemhave you noticed the disk allocation is always 0?22:29
mriedemhttp://logs.openstack.org/98/364498/5/check/gate-tempest-dsvm-neutron-placement-full-ubuntu-xenial-nv/acb2458/logs/screen-n-cpu.txt.gz#_2016-09-01_21_40_41_10422:29
mriedemoh, micro flavors?22:29
mriedemwe don't use swap or ephemeral flavors in tempest22:29
*** ayoung has joined #openstack-nova22:30
dansmithright22:31
mriedemyeah disk is 0 on both of those22:31
mriedemok22:31
mriedemwhew22:31
dansmithstop trying to find reasons not to let this succeed matt22:31
dansmithbe a team player22:31
mriedemhttp://logs.openstack.org/98/364498/5/check/gate-tempest-dsvm-neutron-placement-full-ubuntu-xenial-nv/acb2458/logs/screen-n-cpu.txt.gz#_2016-09-01_21_43_19_61822:31
mriedemthere is the 40422:31
mriedemother failures on allocate:22:32
mriedemhttp://logs.openstack.org/98/364498/5/check/gate-tempest-dsvm-neutron-placement-full-ubuntu-xenial-nv/acb2458/logs/screen-n-cpu.txt.gz#_2016-09-01_22_08_53_41222:32
mriedemUnable to allocate inventory: Unable to create allocation for 'VCPU' on resource provider 'b10cec9e-84fd-4417-a83d-27b709d65a0c'. The requested amount would exceed the capacity.  )22:32
* dansmith waits an eternity for load22:33
dansmithmriedem: yeah, so that over capacity thing means we have overcommitted resources legitimately22:33
dansmithand might be a config thing on our tests22:33
dansmithwe can let jay and chris look at that next week22:34
dansmithlike, we might not have our allocation ratios right22:34
dansmithand the current scheduler might not be doing the right thing22:34
mriedemalright22:34
dansmithmriedem: the 404 is a negative test, so maybe something that was intended not to start?22:34
mriedemi'll throw that into the etherpad22:34
dansmithyeah22:35
mriedemthere are some tests in tempest where it deletes the instance before it's active22:35
dansmithah22:35
dansmithgiven that it seems to always be vcpu, I think it's actually doing well22:35
dansmiththe over-cap one22:35
*** jaypipes has joined #openstack-nova22:36
mriedemthat's where melwitt's favorite local delete patch alwasy breaks the gate22:36
dansmithI'd bet we're just not gracious enough22:36
dansmithjaypipes: we're overcommiting VCPU in the gate: http://logs.openstack.org/98/364498/5/check/gate-tempest-dsvm-neutron-placement-full-ubuntu-xenial-nv/acb2458/logs/screen-n-cpu.txt.gz#_2016-09-01_22_16_35_93622:36
melwitt:D22:36
melwittlocal delete <322:36
dansmithjaypipes: next week we should look at that.. I'm guessing current scheduler does different math or something22:36
mriedemoh crap my family is home, i'd better get outside and start working. i'll check back on this in an hour or so.22:37
dansmithvool22:37
dansmithcool even22:37
mriedembtw we're also watching 35696322:37
dansmithyeah, isn't corefilter disabled by default?22:38
auggyi feel like there's an "eat local" pun in there... "delete local!"22:38
dansmithif so, the scheduler is overcommitting us22:38
dansmithyu[22:38
*** zengine has quit IRC22:38
dansmithno corefilter in the gate22:38
dansmithso we probably just need to up the allocation ratio to squelch that change22:38
dansmither, message22:38
dansmithI will try a devstack change22:39
*** tonytan_brb has quit IRC22:43
openstackgerritRyan Rossiter proposed openstack/nova: WIP: Shared state host manager  https://review.openstack.org/33246322:44
dansmithhttps://review.openstack.org/36458122:44
dansmithshould quiet those warnings I think ^22:44
openstackgerritRyan Rossiter proposed openstack/nova: Add configurable fake driver  https://review.openstack.org/34488722:45
*** ducttape_ has joined #openstack-nova22:48
openstackgerritDan Smith proposed openstack/nova: Cleanup allocation todo items  https://review.openstack.org/36454722:48
dansmith^ depends on that devstack change to run it with placement22:48
*** marst has quit IRC22:49
*** BjoernT has quit IRC22:50
*** su_zhang has quit IRC22:50
*** tblakes has quit IRC22:51
dansmithgah22:51
*** Swami has joined #openstack-nova22:52
*** su_zhang has joined #openstack-nova22:52
*** Swami_ has joined #openstack-nova22:52
*** gouthamr_ has quit IRC22:53
*** ijw has quit IRC22:56
openstackgerritAugustina Ragwitz proposed openstack/nova: Use admin context to create neutron ports  https://review.openstack.org/35754022:58
*** annegentle has quit IRC23:01
*** TravT has quit IRC23:01
*** TravT has joined #openstack-nova23:02
*** kaisers_ has joined #openstack-nova23:02
*** rrecio has quit IRC23:04
*** ijw has joined #openstack-nova23:04
*** marst has joined #openstack-nova23:04
*** ayoung has quit IRC23:05
*** dimtruck is now known as zz_dimtruck23:05
*** zz_dimtruck is now known as dimtruck23:05
*** kaisers_ has quit IRC23:07
*** hemna is now known as hemnafk23:07
*** TravT has quit IRC23:08
*** pwnall has quit IRC23:08
*** ijw has quit IRC23:09
*** gouthamr has joined #openstack-nova23:10
*** salv-orlando has quit IRC23:10
*** markvoelker has joined #openstack-nova23:10
alex_xu\o/ everything merged before freeze23:13
*** trisq has quit IRC23:13
*** gouthamr_ has joined #openstack-nova23:14
*** gouthamr has quit IRC23:14
*** dimtruck is now known as zz_dimtruck23:15
*** su_zhang has quit IRC23:16
*** sameo has quit IRC23:24
*** anush__ has quit IRC23:24
*** annegentle has joined #openstack-nova23:27
dansmithhmm, I assume we don't have anything running grenade with placement...23:27
*** vishwanathj has quit IRC23:30
*** gongysh has joined #openstack-nova23:35
*** nic has quit IRC23:35
*** Guest99973 has quit IRC23:43
*** markvoelker has quit IRC23:51
*** prometheanfire has left #openstack-nova23:52
*** markvoelker has joined #openstack-nova23:56
*** diogogmt has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!