Monday, 2017-08-21

*** sbezverk has joined #openstack-nova00:01
*** yamamoto has joined #openstack-nova00:03
*** yamamoto has quit IRC00:08
*** thorst has joined #openstack-nova00:09
*** thorst has quit IRC00:13
*** markvoelker has joined #openstack-nova00:19
*** yingjun has joined #openstack-nova00:20
*** Shunli has joined #openstack-nova00:24
*** catintheroof has quit IRC00:33
*** hieulq has joined #openstack-nova00:35
*** iceyao has joined #openstack-nova00:36
*** iceyao has quit IRC00:38
*** iceyao has joined #openstack-nova00:39
*** tuanluong has joined #openstack-nova00:42
*** iceyao has quit IRC00:43
*** thorst has joined #openstack-nova00:44
*** kiennt has joined #openstack-nova00:44
*** thorst has quit IRC00:45
*** yangyapeng has joined #openstack-nova00:57
*** iceyao has joined #openstack-nova01:00
*** liusheng has quit IRC01:04
*** trungnv has joined #openstack-nova01:06
*** hongbin has joined #openstack-nova01:11
*** edmondsw has joined #openstack-nova01:13
*** edmondsw has quit IRC01:18
*** zsli_ has joined #openstack-nova01:25
*** gouthamr has quit IRC01:26
*** Shunli has quit IRC01:27
*** liusheng has joined #openstack-nova01:27
*** masber has joined #openstack-nova01:28
*** gcb has joined #openstack-nova01:30
*** zhurong has joined #openstack-nova01:35
*** armax has joined #openstack-nova01:38
*** sree has joined #openstack-nova01:46
*** thorst has joined #openstack-nova01:46
*** sree has quit IRC01:50
*** thorst has quit IRC01:51
*** itlinux has joined #openstack-nova01:56
*** yamamoto has joined #openstack-nova02:06
*** yamamoto has quit IRC02:11
*** armax has quit IRC02:19
*** yangyapeng has quit IRC02:24
*** yangyapeng has joined #openstack-nova02:24
*** yuchenghui has joined #openstack-nova02:27
*** yangyap__ has joined #openstack-nova02:31
*** yangyap__ has quit IRC02:31
*** yangyap__ has joined #openstack-nova02:32
*** yangyapeng has quit IRC02:32
*** zhurong has quit IRC02:34
*** yangyap__ has quit IRC02:35
*** yangyapeng has joined #openstack-nova02:36
*** dave-mccowan has quit IRC02:36
*** yamamoto has joined #openstack-nova02:45
*** thorst has joined #openstack-nova02:47
*** thorst has quit IRC02:51
*** edmondsw has joined #openstack-nova03:02
*** edmondsw has quit IRC03:06
*** armax has joined #openstack-nova03:17
*** artom has quit IRC03:19
*** hongbin has quit IRC03:33
openstackgerritSpencer Yu proposed openstack/nova master: Correct statement in api-ref  https://review.openstack.org/49572403:34
*** Dinesh_Bhor has joined #openstack-nova03:45
*** felipemonteiro_ has joined #openstack-nova03:48
*** thorst has joined #openstack-nova03:48
*** felipemonteiro__ has joined #openstack-nova03:50
*** thorst has quit IRC03:52
*** felipemonteiro_ has quit IRC03:53
*** tonyb has quit IRC03:53
*** links has joined #openstack-nova03:54
*** felipemonteiro__ has quit IRC03:55
*** iceyao has quit IRC03:57
*** tonyb has joined #openstack-nova04:00
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi: Live migration failed in xapi pool  https://review.openstack.org/48945104:01
*** zsli_ has quit IRC04:13
*** iceyao has joined #openstack-nova04:13
*** zsli_ has joined #openstack-nova04:13
*** iceyao has quit IRC04:18
*** udesale has joined #openstack-nova04:21
*** zsli_ has quit IRC04:21
*** zsli__ has joined #openstack-nova04:24
*** sree has joined #openstack-nova04:27
*** sree has quit IRC04:28
*** sree has joined #openstack-nova04:28
*** baoli has joined #openstack-nova04:28
*** mvk has joined #openstack-nova04:33
*** itlinux has quit IRC04:35
*** ying_zuo has joined #openstack-nova04:37
*** hoonetorg has quit IRC04:38
*** zsli__ has quit IRC04:39
*** iceyao has joined #openstack-nova04:39
*** slaweq has joined #openstack-nova04:41
*** slaweq has quit IRC04:45
*** edmondsw has joined #openstack-nova04:50
*** Atom1234 has joined #openstack-nova04:51
*** hoonetorg has joined #openstack-nova04:54
*** edmondsw has quit IRC04:54
*** chyka has joined #openstack-nova05:00
*** sridharg has joined #openstack-nova05:09
*** chyka has quit IRC05:09
*** mvk_ has joined #openstack-nova05:10
*** tetsuro has joined #openstack-nova05:12
*** baoli has quit IRC05:12
*** mvk has quit IRC05:12
*** shan has joined #openstack-nova05:21
*** mvk_ has quit IRC05:21
*** Shunli has joined #openstack-nova05:31
*** Shunli has quit IRC05:33
*** mvk_ has joined #openstack-nova05:34
*** Shunli has joined #openstack-nova05:34
*** Shunli has quit IRC05:35
*** Shunli has joined #openstack-nova05:36
*** baoli has joined #openstack-nova05:40
*** kiennt has quit IRC05:40
*** udesale__ has joined #openstack-nova05:42
*** shan has quit IRC05:43
*** shan has joined #openstack-nova05:44
*** baoli has quit IRC05:44
*** Atom1234 has quit IRC05:45
*** udesale has quit IRC05:45
*** yuchenghui has quit IRC05:46
*** brault has joined #openstack-nova05:47
*** thorst has joined #openstack-nova05:49
*** Shunli has quit IRC05:51
*** Shunli has joined #openstack-nova05:51
*** thorst has quit IRC05:54
*** diga has joined #openstack-nova05:56
*** rmcadams has quit IRC05:56
*** ekuris has joined #openstack-nova05:58
*** ratailor has joined #openstack-nova05:59
*** zsli_ has joined #openstack-nova06:01
*** trinaths has joined #openstack-nova06:02
*** Shunli has quit IRC06:03
*** rcernin has joined #openstack-nova06:04
*** gbarros has joined #openstack-nova06:06
*** kiennt has joined #openstack-nova06:06
*** mdnadeem has joined #openstack-nova06:07
*** zsli__ has joined #openstack-nova06:08
*** zsli_ has quit IRC06:11
*** _pewp_ has quit IRC06:11
*** _pewp_ has joined #openstack-nova06:12
*** diga has quit IRC06:14
*** gbarros has quit IRC06:16
*** diga has joined #openstack-nova06:16
*** jaosorior has joined #openstack-nova06:16
*** mlakat has joined #openstack-nova06:19
*** kiennt has quit IRC06:20
*** kiennt has joined #openstack-nova06:21
*** ubuntu_ has joined #openstack-nova06:21
*** yingjun has quit IRC06:22
openstackgerritLei Zhang proposed openstack/nova master: placement: add traits support in the AllocationCandidates object  https://review.openstack.org/47976606:23
*** zsli__ has quit IRC06:26
*** zsli__ has joined #openstack-nova06:26
*** sahid has joined #openstack-nova06:28
*** mkrcmari__ has joined #openstack-nova06:29
*** pcaruana has joined #openstack-nova06:30
*** mvk_ has quit IRC06:32
*** mvk has joined #openstack-nova06:32
*** iceyao has quit IRC06:33
*** iceyao has joined #openstack-nova06:34
*** mkrcmari__ has quit IRC06:35
*** iceyao has quit IRC06:38
*** hshiina has joined #openstack-nova06:39
*** claudiub|3 has joined #openstack-nova06:44
*** ubuntu_ has quit IRC06:46
*** hferenc has quit IRC06:50
*** thorst has joined #openstack-nova06:51
*** thorst has quit IRC06:55
*** diga has quit IRC07:02
*** ubuntu_ has joined #openstack-nova07:07
*** chyka has joined #openstack-nova07:09
*** chyka has quit IRC07:13
*** jaypipes has joined #openstack-nova07:14
*** sridharg has quit IRC07:16
*** vvargaszte has joined #openstack-nova07:17
*** sridharg has joined #openstack-nova07:18
jaypipessean-k-mooney: hey, thanks for reviewing the nested resource providers code series. I need to rebase all that and get it touched up before denver.07:19
jaypipessean-k-mooney: a higher priority (IMHO at least) is the shared storage provider coverage. I believe cdent has been working on that07:20
jaypipessean-k-mooney: and I'll be reviewing his patches today07:20
jaypipessean-k-mooney: just FYI, I'm in Prague today and flying out to Ukraine tomorrow for ten days. So, will be in your timezone for the rest of the month07:21
*** jpena|off is now known as jpena07:26
*** gaurangt has joined #openstack-nova07:31
*** damien_r has joined #openstack-nova07:33
openstackgerritAlex Xu proposed openstack/nova master: placement: ensure RP maps to those RPs that share with it  https://review.openstack.org/48037907:43
*** xinliang has joined #openstack-nova07:45
*** xinliang has quit IRC07:45
*** xinliang has joined #openstack-nova07:45
*** aarefiev_afk is now known as aarefiev07:46
openstackgerritLajos Katona proposed openstack/nova master: WIP: Add functional livemigrate test  https://review.openstack.org/49517007:47
*** thorst has joined #openstack-nova07:51
*** mdnadeem has quit IRC07:56
*** thorst has quit IRC07:56
*** mdnadeem has joined #openstack-nova07:56
*** ubuntu_ has quit IRC07:57
*** Atom1234 has joined #openstack-nova08:05
openstackgerritJay Pipes proposed openstack/nova-specs master: Return alternate allocation requests to scheduler  https://review.openstack.org/47192708:07
*** udesale has joined #openstack-nova08:11
*** udesale__ has quit IRC08:12
*** moshele has joined #openstack-nova08:17
*** larainema has quit IRC08:18
openstackgerritEvgeny Antyshev proposed openstack/nova master: No scsi unit information in instance XML  https://review.openstack.org/49575608:18
*** markus_z has joined #openstack-nova08:18
*** larainema has joined #openstack-nova08:21
*** derekh has joined #openstack-nova08:23
*** gaurangt_ has joined #openstack-nova08:23
*** lucas-afk is now known as lucasagomes08:25
*** gaurangt- has joined #openstack-nova08:26
*** edmondsw has joined #openstack-nova08:26
*** gaurangt has quit IRC08:26
*** kukacz has quit IRC08:27
*** gaurangt_ has quit IRC08:28
*** edmondsw has quit IRC08:30
*** lpetrut has joined #openstack-nova08:32
*** diga has joined #openstack-nova08:36
*** cdent has joined #openstack-nova08:38
jaypipescdent: mornin.08:49
cdentjaypipes: hola, you still in prague?08:50
jaypipescdent: ya, for today. leaving for Kharkiv tomorrow morning.08:50
jaypipescdent: will be there through end of Aug.08:50
cdentdid you manage to see prague or did you stay with your me-coding time?08:50
jaypipescdent: yeah, went for a long walk to the Charles Bridge, Old Jewish cemetery, old town, palladium, and river front08:51
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi: Live migration failed in xapi pool  https://review.openstack.org/48945108:51
jaypipescdent: still got my me-coding in though :)08:52
cdentgood and good08:52
*** thorst has joined #openstack-nova08:52
*** pcaruana has quit IRC08:53
*** baoli has joined #openstack-nova08:55
*** pcaruana has joined #openstack-nova08:55
*** thorst has quit IRC08:56
*** baoli has quit IRC08:59
openstackgerritMaciej Kucia proposed openstack/nova master: SR-IOV passthrough: Check PF only if VF is enabled  https://review.openstack.org/47664209:05
*** zhouyaguo has joined #openstack-nova09:17
*** dtantsur has quit IRC09:18
*** pcaruana has quit IRC09:19
*** lyarwood_ has joined #openstack-nova09:19
*** dtantsur has joined #openstack-nova09:24
*** dtantsur has quit IRC09:24
*** dtantsur has joined #openstack-nova09:24
*** dtantsur has quit IRC09:24
*** dtantsur has joined #openstack-nova09:24
*** dtantsur has quit IRC09:24
*** tetsuro has quit IRC09:25
openstackgerritLajos Katona proposed openstack/nova master: Add functional force live migrate test  https://review.openstack.org/49517009:25
*** dtantsur has joined #openstack-nova09:29
gibicdent, jaypipes: hi! Here is the force live migrate bugreport we talked about on Friday https://bugs.launchpad.net/nova/+bug/171200809:30
openstackLaunchpad bug 1712008 in OpenStack Compute (nova) "Force live migrate doesn't claim resources on the target host" [Undecided,New]09:30
cdentthanks gibi09:30
*** zsli__ has quit IRC09:31
*** artom has joined #openstack-nova09:31
*** lajoskatona has joined #openstack-nova09:32
*** pcaruana has joined #openstack-nova09:32
gibicdent: thanks to lajoskatona09:32
cdentthank lajoskatona !09:32
gibicdent: I just the middle man in this case :)09:32
lajoskatonaHi,09:33
lajoskatonaNice to learn nova:-)09:33
*** kukacz has joined #openstack-nova09:34
maciejjozefczykjaypipes: Hi Jay, could you check this one? https://review.openstack.org/#/c/494974/ Is it possible to merge to Ocata?09:42
*** nicolasbock_ has joined #openstack-nova09:42
*** dtantsur has quit IRC09:44
*** pcaruana has quit IRC09:45
jaypipesmaciejjozefczyk: I have no merge permissions on stable branches (not on stable team)09:45
cdentjaypipes is a dangerous radical09:45
*** nicolasbock_ has quit IRC09:47
maciejjozefczykjaypipes: Oh, I see :)09:48
*** dtantsur has joined #openstack-nova09:50
*** dims has quit IRC09:50
openstackgerritBéla Vancsics proposed openstack/nova master: Transform instance.resize.error notifications  https://review.openstack.org/41788209:54
*** sambetts|afk is now known as sambetts09:57
*** pcaruana has joined #openstack-nova09:58
*** sree has quit IRC09:58
*** kukacz has quit IRC09:58
*** kiennt has quit IRC09:58
*** sree has joined #openstack-nova09:58
*** kukacz has joined #openstack-nova09:59
*** nicolasbock_ has joined #openstack-nova09:59
*** sree_ has joined #openstack-nova10:00
*** sree_ is now known as Guest8286010:00
openstackgerritLajos Katona proposed openstack/nova master: Add functional force live migrate test  https://review.openstack.org/49517010:02
*** sree has quit IRC10:03
*** Guest82860 has quit IRC10:04
*** Qiming has quit IRC10:04
*** baoli has joined #openstack-nova10:05
*** efoley has joined #openstack-nova10:07
*** Qiming has joined #openstack-nova10:09
*** baoli has quit IRC10:09
*** cdent has quit IRC10:09
*** edmondsw has joined #openstack-nova10:14
*** haypo has joined #openstack-nova10:14
*** haypo has left #openstack-nova10:14
openstackgerritMerged openstack/python-novaclient master: Allow boot server with multiple nics  https://review.openstack.org/49200310:16
*** edmondsw has quit IRC10:19
*** yangyapeng has quit IRC10:28
openstackgerritLajos Katona proposed openstack/nova master: Add functional live migrate test  https://review.openstack.org/49581110:29
*** Atom1234 has quit IRC10:29
*** zhouyaguo has quit IRC10:31
*** zhouyaguo has joined #openstack-nova10:31
*** hferenc has joined #openstack-nova10:36
*** sahid has quit IRC10:36
*** udesale has quit IRC10:36
*** Atom1234 has joined #openstack-nova10:37
*** udesale has joined #openstack-nova10:38
*** rmart04 has joined #openstack-nova10:43
*** gixxer1k has joined #openstack-nova10:45
*** cdent has joined #openstack-nova10:49
*** tuanluong has quit IRC10:50
*** thorst has joined #openstack-nova10:54
*** zhuzeyu has joined #openstack-nova10:56
*** zhuzeyu has left #openstack-nova10:57
*** thorst has quit IRC10:58
*** zhuzeyu has joined #openstack-nova11:01
*** zhuzeyu has left #openstack-nova11:02
*** eharney has joined #openstack-nova11:11
*** gcb has quit IRC11:11
*** bnemec has joined #openstack-nova11:17
*** openstackgerrit has quit IRC11:17
*** bnemec has left #openstack-nova11:20
*** baoli has joined #openstack-nova11:26
gibicdent: lajoskatona also found out that the non force live migration is also buggy but in a different way https://bugs.launchpad.net/nova/+bug/171204511:29
openstackLaunchpad bug 1712045 in OpenStack Compute (nova) "nova doesn't clean up the resources after live migrate" [Undecided,New]11:29
* cdent falls down11:29
gibicdent: here the doubling happens during the live migration but the source host is not cleaned up when the live migration finishes11:29
cdentpresumably because it doesn’t count as a “resize” and resize_confirm doesn’t get called?11:30
gibipresumably, yes11:30
*** baoli has quit IRC11:31
gibiI had no time to look at this code parts and I will leave for a vacation this evening11:31
gibiso I let you guys to figure this out11:31
cdentIf we don’t use all this stuff to completely gut the complexity of the resource tracker I am going to be very sad11:31
gibicdent: the last two fixes both added a new function on the resource_tracker to handle the resource allocation11:32
cdentgreat!11:32
cdent:(11:32
cdent:)11:32
gibicdent: but at least those are two small separate functions so those are easy to move around11:32
cdentyeah. The complexity is an inevitable result of organic growth.11:33
cdentgibi: going anywhere interesting for holiday?11:34
*** tbachman has joined #openstack-nova11:35
gibicdent: just couple of days in Maribor and Rijeka11:36
*** udesale has quit IRC11:36
gibicdent: but there is a honeymoon we have to plan for spring11:37
cdent\o/11:37
*** udesale has joined #openstack-nova11:38
*** eharney has quit IRC11:38
gibicdent: it will be someting that involves a big cruise ship11:38
cdentnice11:38
*** yangyapeng has joined #openstack-nova11:40
*** bkopilov has quit IRC11:43
*** lucasagomes is now known as lucas-hungry11:44
*** yangyapeng has quit IRC11:45
*** belmoreira has joined #openstack-nova11:45
*** takedakn has joined #openstack-nova11:46
*** yufei has joined #openstack-nova11:48
*** sahid has joined #openstack-nova11:49
*** mvk_ has joined #openstack-nova11:50
*** david-lyle has joined #openstack-nova11:50
*** yangyapeng has joined #openstack-nova11:50
*** dklyle has quit IRC11:51
*** bkopilov has joined #openstack-nova11:51
*** Atom1234 has quit IRC11:52
*** dave-mccowan has joined #openstack-nova11:52
*** mvk has quit IRC11:53
*** edmondsw has joined #openstack-nova11:55
*** thorst has joined #openstack-nova11:57
*** yufei has quit IRC12:02
*** vvargaszte has quit IRC12:07
*** ratailor has quit IRC12:09
*** mpaolino has joined #openstack-nova12:11
*** jpena is now known as jpena|lunch12:12
cdentWe got any cores around yet today, besides jaypipes ? This would be good to kick home: https://review.openstack.org/#/c/491529/12:13
*** diga has quit IRC12:24
*** takedakn has quit IRC12:25
*** lucas-hungry is now known as lucasagomes12:28
*** cdent has quit IRC12:29
*** edmondsw has quit IRC12:29
*** udesale has quit IRC12:29
*** sahid has quit IRC12:30
*** udesale has joined #openstack-nova12:31
*** baoli has joined #openstack-nova12:35
*** baoli has quit IRC12:39
*** sahid has joined #openstack-nova12:50
*** mkrcmari__ has joined #openstack-nova12:56
*** lyan has joined #openstack-nova12:58
*** sahid has quit IRC12:58
*** mvk_ has quit IRC13:00
*** mriedem has joined #openstack-nova13:00
*** moshele has quit IRC13:04
*** aarefiev has quit IRC13:08
*** aarefiev_ has joined #openstack-nova13:08
*** aarefiev_ is now known as aarefiev13:08
*** udesale has quit IRC13:10
*** heroux has joined #openstack-nova13:11
*** esberglu has joined #openstack-nova13:15
sean-k-mooneyjaypipes: got a link to cdent's shared storage provider patches? ill try to take a look at them if i get a chance. by the way is the master brance still locked down for pike or has it repoend for queens13:20
*** dims has joined #openstack-nova13:21
*** jpena|lunch is now known as jpena13:23
edleafejaypipes: jsut saw https://review.openstack.org/#/c/471927/13:27
*** ociuhandu has joined #openstack-nova13:27
*** pchavva has joined #openstack-nova13:27
*** Jeffrey4l has quit IRC13:27
edleafejaypipes: I have series to do similar that I was just about to push :(13:27
*** shan is now known as shan|AFK13:27
*** Jeffrey4l has joined #openstack-nova13:28
edleafeI took the series that I had already done before the switch to alloc candidates and updated it13:28
*** damien_r has quit IRC13:28
edleafeoh geez - this is just the spec13:28
edleafenvm13:28
*** damien_r has joined #openstack-nova13:28
*** belmoreira has quit IRC13:29
*** edmondsw has joined #openstack-nova13:29
*** armax has quit IRC13:31
*** yamamoto has quit IRC13:31
*** cleong has joined #openstack-nova13:32
*** belmoreira has joined #openstack-nova13:32
sean-k-mooneyedleafe: sould like an easy win then if you add implementes(with the correct spelling): placement-allocation-requests13:33
*** dpawlik_ is now known as danpawlik13:33
*** alexchadin has joined #openstack-nova13:33
*** chyka has joined #openstack-nova13:34
alex_xugibi: a question about https://review.openstack.org/#/c/491529/14//COMMIT_MSG@17, is it a bug?13:34
*** lucasxu has joined #openstack-nova13:34
*** openstackgerrit has joined #openstack-nova13:36
openstackgerritEd Leafe proposed openstack/nova master: WIP - add alternate hosts  https://review.openstack.org/48621513:36
openstackgerritEd Leafe proposed openstack/nova master: WIP - return alternates along with their allocations  https://review.openstack.org/48625313:36
openstackgerritEd Leafe proposed openstack/nova master: WIP - Add allocations to the values returned from the scheduler  https://review.openstack.org/49585413:36
*** gcb has joined #openstack-nova13:36
*** cdent has joined #openstack-nova13:37
*** chyka has quit IRC13:38
*** awaugama has joined #openstack-nova13:39
gibialex_xu: no, it is not a bug.  It is the way how the resouce claiming was implemented in the scheduler for the move operations13:39
gibialex_xu: there was couple of irc discussion about it in the past13:39
gibialex_xu: here is some irc history http://p.anticdent.org/logs/openstack-nova?dated=2017-08-08%2012:29:21.129291#15Hv13:40
stephenfincdent: Done13:40
stephenfinhttps://review.openstack.org/#/c/491529/, that is13:40
cdentthanks stephenfin welcome back13:41
stephenfincdent: Cheers :)13:41
* stephenfin is working through (extensive) email backlogs today and missing sunshine13:41
*** mtanino has joined #openstack-nova13:42
cdentI’m trying to sit outside in the sun but it may be too squinty13:42
*** moshele has joined #openstack-nova13:43
stephenfinThe rain is bouncing off the pavement outside. I'm not at all jealous :D13:43
edleafecdent: I gotta make my eclipse viewing box this morning13:43
gibialex_xu, stephenfin: as you are already looking at functional tests and scheduling, there are two additional test patch that needs core eyes13:43
gibialex_xu, stephenfin https://review.openstack.org/#/c/495159/13:43
gibialex_xu, stephenfin: https://review.openstack.org/#/c/493865/13:43
cdentedleafe: are you in the path? I thought you were too far south13:43
edleafePartial13:44
*** yufei has joined #openstack-nova13:44
cdentlike your soul13:45
dansmithI'm at 99.6%13:45
dansmithdon't expect me around much until after :)13:45
cdentdansmith: are you overrun nearby by tourists and such?13:46
dansmithcdent: no, I live in a heavily fortified mountaintop stronghold remember?13:46
* gibi is jealous for the eclipse 13:46
cdentdansmith: understood, but I wondered if there might be people at the walls13:46
edleafecdent: this is as good as it will get for me: http://imgur.com/a/z6FfF13:46
dansmithbut in reality, so far the traffic apocolypse hasn't been a thing13:47
dansmithcdent: heh, not yet :)13:47
*** gcb has quit IRC13:47
edleafedansmith: my sister-in-law lives in Albany. She says traffic has been hell there for the past week13:47
*** gcb has joined #openstack-nova13:47
*** felipemonteiro_ has joined #openstack-nova13:48
*** iceyao has joined #openstack-nova13:48
dansmithedleafe: yeah, I think the places without road capacity are feeling it, but the bigger places haven't had the troubles they expected13:48
dansmithwe were over in eastern/central this weekend and it was a ghost town13:48
dansmithgas stations have been stockpiling toilet paper and bullets for weeks and it was all for naught13:48
*** baoli has joined #openstack-nova13:49
edleafeheh13:49
*** felipemonteiro__ has joined #openstack-nova13:49
edleafeWell, for once Albany has something to attract tourists13:49
dansmithheh13:49
*** markvoelker has quit IRC13:52
*** felipemonteiro_ has quit IRC13:52
*** baoli has quit IRC13:53
edleafeScheduler subteam meeting in 5 minutes in #openstack-meeting-alt13:55
*** crushil has joined #openstack-nova13:56
*** yamamoto has joined #openstack-nova13:57
*** yamamoto has quit IRC13:58
*** yamamoto has joined #openstack-nova13:59
*** yamamoto has quit IRC13:59
*** yufei has quit IRC14:00
*** stvnoyes has quit IRC14:00
*** trinaths has quit IRC14:00
*** cfriesen_ has joined #openstack-nova14:01
*** mvk has joined #openstack-nova14:04
*** mkrcmari__ has quit IRC14:05
*** hshiina has quit IRC14:06
mriedemhmm, so i heard stable gate sucked last week14:07
mriedemand continues to suck14:07
mriedemlooking at a failure, the ComputeFilter kicked something out because the single-node host job has 4 VMs on it already14:07
mriedemvcpus=8,vcpus_used=414:08
*** armax has joined #openstack-nova14:08
mriedem^ is the compute node stats before the NoValidHost14:08
*** alexchadin has quit IRC14:12
mriedemseems odd given there is capacity left on that node and it's also weird that we have CoreFilter enabled in devstack since it was disabled by default in code14:12
*** Jeffrey4l has quit IRC14:12
*** lajoskatona has left #openstack-nova14:13
*** Jeffrey4l has joined #openstack-nova14:13
*** liverpooler has joined #openstack-nova14:13
alex_xugibi: thanks, i will read the irc log14:14
mriedemhttps://goo.gl/g7LGmM14:14
cdentwhat manner of malware are you sending us to with that link mriedem ?14:15
mriedemlogstash14:15
cdentmriedem: you’re being semi-ignored becasue I think anyone who cares is over in the scheduler meeting at the mo14:16
*** Jeffrey4l has quit IRC14:16
mriedemi know14:16
*** Jeffrey4l has joined #openstack-nova14:17
*** sahid has joined #openstack-nova14:17
alex_xumriedem: fyi, a regression in python-novaclient https://review.openstack.org/#/c/492003/, not sure whether it is worth a release14:18
*** Jeffrey4l has quit IRC14:18
*** sree has joined #openstack-nova14:18
*** mpaolino has quit IRC14:19
mriedemalex_xu: so it's been broken since 9.0.014:19
mriedemif https://review.openstack.org/#/c/429512/ caused it14:19
alex_xuyea, probably for a while14:20
mriedemthen we'll probably just fix in a patch release once stable/pike is ok for python-novaclient releases14:20
sean-k-mooneymriedem: it is requsting 8 vcpus it should fit but it would be oversubscribing though not against itself14:20
mriedemsean-k-mooney: it's requesting 1 vcpu14:21
sean-k-mooneymriedem: i assume that the 4 cores already in use are not dedicated?14:21
*** Jeffrey4l has joined #openstack-nova14:21
alex_xuok14:21
mriedemsean-k-mooney: we don't have cpu pinning in the upstream infra gate jobs no14:21
sean-k-mooneymriedem: ah sorry missread http://logs.openstack.org/28/468528/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/337af98/logs/screen-n-sch.txt#_2017-08-21_04_15_14_76514:21
sean-k-mooney{"cores": 1, "cells": 1, "threads": 1, "sockets": 8}14:22
sean-k-mooneythat is for the host14:22
sean-k-mooneynot the vm right14:22
mriedemcorrect14:22
*** Jeffrey4l has quit IRC14:22
*** Jeffrey4l has joined #openstack-nova14:24
mriedemlooking at the CoreFilter code this doesn't make any sense14:25
*** slaweq has joined #openstack-nova14:25
mriedemwe have 8 total, and cpu_allocation_ratio is 16.0, so we end up with vcpus_total = 24, 24-vcpus_used (4) = 20, so we have 20 free vcpus and we're requesting 114:26
cdentmriedem: is that a new vm or move/migration/whatever?14:27
mriedemnew vm14:27
sean-k-mooneymriedem: well you should be able to use 128 vcps with 8 cpus and an allocation ratios of 16. anyway did you notice this error 'disabled_reason': u'AUTO: Connection to libvirt lost:14:28
sean-k-mooneyat http://logs.openstack.org/28/468528/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/337af98/logs/screen-n-sch.txt#_2017-08-21_04_15_14_76614:28
mriedemhmm seeing that now yeah14:29
mriedemoh duh,14:30
mriedemit's not the CoreFilter, it's the ComputeFilter14:30
mriedemgod14:30
sean-k-mooneythere are a load of tracebacks in the n-cpu log14:31
sean-k-mooneyNeutronAdminCredentialConfigurationInvalid: Networking client is experiencing an unauthorized exception.14:31
openstackgerritBalazs Gibizer proposed openstack/nova master: WIP: test allocation handling during scheduler retry  https://review.openstack.org/49589114:31
mriedemsean-k-mooney: that one is a known issue,14:32
mriedemthe real problem is libvirt crashed14:32
mriedemso the libvirt driver auto-disables the compute service14:32
*** danpawlik is now known as danpawlik_14:33
*** danpawlik_ is now known as dpawlik_14:33
*** guimaluf has joined #openstack-nova14:35
sean-k-mooneymriedem: there does not seam to be any usfull info in the libvirtd log other then a bunch of virNetlinkEventCallback spam14:35
*** iceyao has quit IRC14:35
*** mnestratov|2 has joined #openstack-nova14:35
guimalufCould you guys help me to debug this error? http://paste.openstack.org/show/618918/ I'm trying to launch an instance within my testing environment, which consist of 4 vms, keystone/api-controllers, mysql/ceph/rabbitmq, neutron and nova.14:35
guimalufmy concern is mainly focused on HTTPMultipleChoices: HTTPMultipleChoices (HTTP 300) Requested version of OpenStack Images API is not available. I expect nova to contact glance v2 api, but it is trying to reach v1 even with only v2 available14:36
*** hongbin has joined #openstack-nova14:36
mriedemsean-k-mooney: i won't pursue any further - libvirt crashing is not a new thing in the gate14:37
*** crushil has quit IRC14:38
*** moshele has quit IRC14:39
*** tbachman has quit IRC14:39
*** sterdnotshaken has joined #openstack-nova14:40
*** chyka has joined #openstack-nova14:40
sean-k-mooneymriedem: well strangly the libvirtd log seams to still be active when the connection drops on the nova side but ya this does not really look like it s novas problem14:41
sean-k-mooneymriedem: the compute agent will reconnect and reactivate itself anyway correct14:41
mriedemyes14:41
*** jaypipes has quit IRC14:41
mriedemin a prod cloud with hundreds/thousands of nodes, that's probably good enough14:42
mriedemfor single node gate jobs it's a killer14:42
sean-k-mooneyya tempest could maybe retry the failed jobs automatically to a certenlimit at the end fo the run in the future but honestly that will likey just slow down the gate when code is actully broken14:43
*** shan|AFK has quit IRC14:44
*** iceyao has joined #openstack-nova14:44
*** ltomasbo has joined #openstack-nova14:45
*** ltomasbo has quit IRC14:46
*** efoley has quit IRC14:48
*** tbachman has joined #openstack-nova14:49
maciejjozefczykguimaluf: check nova-scheduler and rabbitmq14:49
maciejjozefczykguimaluf: s/nova-scheduler/nova-conductor/14:50
*** ltomasbo has joined #openstack-nova14:50
*** nicolasbock_ has quit IRC14:51
mriedemmaciejjozefczyk: anything glance related is likely blowing up in the api14:51
mriedemsounds like misconfiguration14:51
mriedem[glance]api_servers is where i'd look14:51
*** nicolasbock has joined #openstack-nova14:51
mriedemin nova.conf14:51
mriedemand make sure that matches what's in the service catalog for the image service14:51
*** gcb has quit IRC14:53
*** ratailor has joined #openstack-nova14:55
*** links has quit IRC14:56
*** ltomasbo has quit IRC14:56
*** jmlowe has joined #openstack-nova14:57
maciejjozefczykmriedem: Could you check this cherry-pick https://review.openstack.org/#/c/494974/ please :) ?14:57
*** mvk_ has joined #openstack-nova14:58
mriedemmaciejjozefczyk: has to go through pike first,14:59
mriedemand i see the cherry pick for pike, but this isn't a regression in pike, so i'm not sure we should include it in the rc2 for pike14:59
*** yamamoto has joined #openstack-nova14:59
*** yamahata has joined #openstack-nova15:00
maciejjozefczykmriedem: So it should wait for stable pike?15:01
mriedemmaciejjozefczyk: it has to be in stable/pike before we can merge it in stable/ocata, yes15:01
mriedemi'm not sure yet if it should be in rc2 for pike15:01
*** mdnadeem has quit IRC15:02
*** mvk has quit IRC15:02
*** ltomasbo has joined #openstack-nova15:02
maciejjozefczykmriedem: ok15:03
*** saphi has joined #openstack-nova15:04
*** yamamoto has quit IRC15:05
mriedemman i guess you guys were busy last week https://review.openstack.org/#/q/status:merged+project:openstack/nova+branch:stable/pike15:05
*** ltomasbo has quit IRC15:05
dansmithmriedem: anything you see in there that wasn't legit?15:06
dtantsurfolks, do you by chance know who is leading https://etherpad.openstack.org/p/queens-PTG-vmbm ? I should have been aware of it, but I'm not :)15:06
cdentdtantsur: probably johnthetubaguy ?15:07
dansmithmriedem: some of the work required some test backports for cleanliness15:07
mriedemdansmith: yeah that looks like the evacuate/shelve offload tests from givi15:07
mriedem*gib15:07
mriedemgdi15:07
mriedemgibi15:07
dansmithyeah15:07
*** ltomasbo has joined #openstack-nova15:07
* mriedem hasn't used a computer in a week15:07
dtantsurjohnthetubaguy: is it you? :)15:07
mriedemdansmith: i found one major issue here https://review.openstack.org/#/c/493037/4/nova/compute/resource_tracker.py@122515:09
*** yufei has joined #openstack-nova15:09
dansmithmriedem: oh the humanity15:09
gibimriedem: welcome back. :)15:10
*** mkrcmari__ has joined #openstack-nova15:11
mriedemthanks15:13
*** mvk_ has quit IRC15:14
*** rcernin has quit IRC15:15
*** ltomasbo has quit IRC15:15
mriedemit's going to be a rough couple of days so give me softballs if you have them15:16
gibiI'm going for vacation this week so I can promise that I will not file yet another resource allocation bugs. :)15:17
mriedemq15:19
mriedemoops15:19
*** ltomasbo has joined #openstack-nova15:19
*** crushil has joined #openstack-nova15:21
mriedemocata 15.0.7 release request https://review.openstack.org/49590315:22
*** pcaruana has quit IRC15:22
*** nicolasbock has quit IRC15:23
*** belmoreira has quit IRC15:24
*** sree has quit IRC15:25
guimalufmaciejjozefczyk, the error I mentioned is happening on nova-compute node, no errs on conductor logs. I'll enable debug to see if there is something meaningful15:26
*** slaweq has quit IRC15:28
dansmithmriedem: I left this for you to make a call on: https://review.openstack.org/#/c/494973/15:28
openstackgerritMerged openstack/nova master: replace chance with filter scheduler in func tests  https://review.openstack.org/49152915:29
openstackgerritMerged openstack/nova master: Clarify that vlan feature means nova-network support  https://review.openstack.org/47855115:29
mriedemdansmith: yeah saw that, wasn't sure since it's not a regression in pike15:33
*** jmlowe has quit IRC15:34
dansmithmriedem: yeah thought that was the right call, but figured I'd leave it to you.. can wait until after pike releases and then push the backport like normal15:34
*** yufei has quit IRC15:38
*** gyee has joined #openstack-nova15:40
*** dtp has joined #openstack-nova15:45
openstackgerritStephen Finucane proposed openstack/nova master: Remove plug_ovs_hybrid, unplug_ovs_hybrid  https://review.openstack.org/48303015:45
*** baoli has joined #openstack-nova15:46
*** lvdombrkr has joined #openstack-nova15:47
*** rmart04 has quit IRC15:48
lvdombrkrhello guys, im trieng deploy tripleO , and after trying deploy overcloud get error: http://paste.openstack.org/raw/618917/ , in nova scheduler logs i see that tha node is filtred out http://paste.openstack.org/raw/618930/15:48
lvdombrkrbut i dont uderstand why15:48
lvdombrkrany ideas?15:49
*** owalsh has quit IRC15:49
openstackgerritStephen Finucane proposed openstack/nova master: tests: Remove useless test  https://review.openstack.org/48303115:50
*** crushil has quit IRC15:50
*** baoli has quit IRC15:51
*** yufei has joined #openstack-nova15:52
*** slaweq has joined #openstack-nova15:53
*** sterdnotshaken1 has joined #openstack-nova15:54
*** sterdnotshaken has quit IRC15:54
openstackgerritStephen Finucane proposed openstack/nova master: console: introduce basic framework for security proxying  https://review.openstack.org/34539615:55
openstackgerritStephen Finucane proposed openstack/nova master: console: introduce framework for RFB authentication  https://review.openstack.org/34539715:55
openstackgerritStephen Finucane proposed openstack/nova master: console: introduce the VeNCrypt RFB authentication scheme  https://review.openstack.org/34539815:55
openstackgerritStephen Finucane proposed openstack/nova master: console: provide an RFB security proxy implementation  https://review.openstack.org/34539915:55
*** guimaluf has quit IRC15:55
*** guimaluf has joined #openstack-nova15:56
*** gixxer1k has quit IRC15:56
mriedemdisabling RamFilter by default hits it's first victim https://bugs.launchpad.net/nova/+bug/171205715:57
openstackLaunchpad bug 1712057 in OpenStack Compute (nova) "When the specified destination host deploys the virtual machine, the allocation ratio is not valid" [Undecided,Invalid] - Assigned to wangyicheng (wang-yicheng)15:57
*** slaweq has quit IRC15:57
*** Apoorva has joined #openstack-nova15:57
mriedemdansmith: did anyone mention this https://review.openstack.org/#/c/495811/ ?15:58
cfriesen_mriedem: whee!  do we want to fill in the limits filter somewhere else?15:58
cfriesen_make that just limits, not filter15:58
mriedemcfriesen_: the intent is to remove all of that stuff eventually, so i don't think so15:58
*** vishwanathj has joined #openstack-nova15:58
mriedemthe limits are used in the claims code in the compute15:58
mriedemi suspect the reporter of that bug has out of tree code that's relying on the limits15:59
*** yangyapeng has quit IRC16:02
*** nicolasbock has joined #openstack-nova16:02
*** markvoelker has joined #openstack-nova16:03
cdentmriedem: what do you mean by “mention this”? gibi posted about it this morning, the author of the new live migration tests is his colleague. gibi’s going on vacation, so “left it to us”16:03
*** yangyapeng has joined #openstack-nova16:03
mriedemmention as in, this could be an rc2 blocker16:03
mriedemsince it wasn't tagged16:03
mriedemor in the etherpad16:03
cdentI think it’s new since the weekend16:05
*** edmondsw has quit IRC16:05
*** itlinux has joined #openstack-nova16:07
*** yufei has quit IRC16:07
*** edmondsw has joined #openstack-nova16:07
*** rajathagasthya has joined #openstack-nova16:08
*** itlinux has quit IRC16:08
openstackgerritStephen Finucane proposed openstack/nova master: trivial: Remove dead function, variable  https://review.openstack.org/49151216:09
*** yangyapeng has quit IRC16:11
*** edmondsw has quit IRC16:11
*** rajathagasthya has quit IRC16:12
*** owalsh has joined #openstack-nova16:13
*** moshele has joined #openstack-nova16:14
*** rajathagasthya has joined #openstack-nova16:14
dansmithmriedem: mention what?16:15
dansmithmriedem: oh no16:15
openstackgerritStephen Finucane proposed openstack/nova master: conf: Convert 'live_migration_inbound_addr' to HostAddressOpt  https://review.openstack.org/45657316:17
*** moshele has quit IRC16:17
*** itlinux has joined #openstack-nova16:18
*** david-lyle has quit IRC16:18
*** david-lyle has joined #openstack-nova16:19
*** FL1SK has quit IRC16:20
lvdombrkr hello guys, im trieng deploy tripleO , and after trying deploy overcloud get error: http://paste.openstack.org/raw/618917/ , in nova scheduler logs i see that tha node is filtred out http://paste.openstack.org/raw/618930/16:23
lvdombrkrbut i dont uderstand why16:23
*** iceyao has quit IRC16:23
lvdombrkrany ideas?16:23
stephenfinlvdombrkr: Looks like you'd be better asking #openstack or #tripleo16:24
*** sterdnotshaken has joined #openstack-nova16:26
*** sterdnotshaken1 has quit IRC16:26
*** lucasagomes is now known as lucas-afk16:27
*** lpetrut has quit IRC16:28
mriedemmnestratov|2: fyi https://bugs.launchpad.net/nova/+bug/171154716:28
openstackLaunchpad bug 1711547 in OpenStack Compute (nova) "Nova service restart disconnects vzstorage volumes" [Undecided,New]16:28
*** sterdnotshaken has quit IRC16:28
*** sterdnotshaken has joined #openstack-nova16:29
mnestratov|2thanks16:29
mnestratov|2we will take care of it16:32
openstackgerritStephen Finucane proposed openstack/nova master: doc: Address review comments for main index  https://review.openstack.org/49264516:32
*** sahid has quit IRC16:32
mriedemhere is that fun ip filtering known issue rearing it's head https://bugs.launchpad.net/nova/+bug/171130316:33
openstackLaunchpad bug 1711303 in OpenStack Compute (nova) "Filter instances by IP when listing is not efficient enough" [Undecided,Confirmed]16:33
*** chyka has quit IRC16:36
*** chyka has joined #openstack-nova16:37
*** ratailor has quit IRC16:38
*** sterdnotshaken1 has joined #openstack-nova16:44
*** baoli has joined #openstack-nova16:46
*** sterdnotshaken2 has joined #openstack-nova16:46
*** sterdnotshaken has quit IRC16:46
*** crushil has joined #openstack-nova16:47
*** sterdnotshaken1 has quit IRC16:47
cfriesen_is anyone aware of a spec around enabling L3 cache in the guests in libvirt?16:47
cfriesen_or even a blueprint16:48
*** iceyao has joined #openstack-nova16:49
openstackgerritEric Young proposed openstack/nova-specs master: Add ScaleIO ephemeral storage backend  https://review.openstack.org/49592216:49
*** baoli has quit IRC16:50
*** sridharg has quit IRC16:51
*** gixxer1k has joined #openstack-nova16:52
*** links has joined #openstack-nova16:52
*** saphi has quit IRC16:53
*** iceyao has quit IRC16:53
*** yufei has joined #openstack-nova16:57
*** derekh has quit IRC17:00
*** pchavva has quit IRC17:01
*** yamamoto has joined #openstack-nova17:03
*** igordc has joined #openstack-nova17:04
*** rcernin has joined #openstack-nova17:05
*** igordc has quit IRC17:05
*** igordc has joined #openstack-nova17:06
*** igordc has quit IRC17:06
*** igordc has joined #openstack-nova17:06
*** igordc has quit IRC17:06
*** links has quit IRC17:06
*** igordc has joined #openstack-nova17:06
*** igordc has quit IRC17:07
*** yangyapeng has joined #openstack-nova17:07
*** igordc has joined #openstack-nova17:08
*** yamamoto has quit IRC17:09
openstackgerritSumedh Degaonkar proposed openstack/nova master: Adds 'sata' as a valid disk bus for qemu and kvm hypervisors  https://review.openstack.org/45979417:11
*** yangyapeng has quit IRC17:11
*** yufei has quit IRC17:13
*** baoli has joined #openstack-nova17:14
*** saphi has joined #openstack-nova17:14
*** markvoelker has quit IRC17:18
*** baoli has quit IRC17:18
*** sterdnotshaken has joined #openstack-nova17:20
*** sterdnotshaken2 has quit IRC17:20
openstackgerritChris Dent proposed openstack/nova master: WIP: [placement] manage cache headers  https://review.openstack.org/49538017:21
*** saphi has quit IRC17:22
*** igordc has quit IRC17:23
*** igordc has joined #openstack-nova17:24
*** igordc has quit IRC17:25
*** sterdnotshaken has quit IRC17:25
*** sambetts is now known as sambetts|afk17:26
*** yamahata has quit IRC17:28
*** jpena is now known as jpena|off17:28
*** tbachman has quit IRC17:28
*** harlowja has joined #openstack-nova17:29
*** tbachman has joined #openstack-nova17:31
*** ociuhandu has quit IRC17:35
*** mvk_ has joined #openstack-nova17:36
*** pchavva has joined #openstack-nova17:37
*** cdent has quit IRC17:38
*** moshele has joined #openstack-nova17:38
*** Swami has joined #openstack-nova17:38
*** edmondsw has joined #openstack-nova17:39
*** mkrcmari__ has quit IRC17:39
*** moshele has quit IRC17:41
*** lpetrut has joined #openstack-nova17:42
*** sterdnotshaken has joined #openstack-nova17:42
*** edmondsw has quit IRC17:43
*** sterdnotshaken has quit IRC17:46
*** mkrcmari__ has joined #openstack-nova17:47
*** mvk_ has quit IRC17:50
*** markvoelker has joined #openstack-nova17:50
*** lpetrut has quit IRC17:51
*** mvk has joined #openstack-nova17:51
*** edmondsw has joined #openstack-nova17:52
*** mvk_ has joined #openstack-nova17:53
*** mkrcmari__ has quit IRC17:53
*** egonzalez has joined #openstack-nova17:53
*** mvk has quit IRC17:55
*** ragasthya has joined #openstack-nova17:56
*** rajathagasthya has quit IRC17:56
*** lpetrut has joined #openstack-nova17:58
*** yamahata has joined #openstack-nova17:58
*** dtantsur is now known as dtantsur|afk18:01
*** ociuhandu has joined #openstack-nova18:01
*** claudiub|3 has quit IRC18:03
*** slaweq has joined #openstack-nova18:04
*** yamamoto has joined #openstack-nova18:05
*** lyan has quit IRC18:05
*** yangyapeng has joined #openstack-nova18:08
*** slaweq has quit IRC18:08
*** yamamoto has quit IRC18:11
*** moshele has joined #openstack-nova18:11
*** yangyapeng has quit IRC18:12
*** crushil has quit IRC18:12
*** sterdnotshaken has joined #openstack-nova18:22
*** sterdnotshaken has joined #openstack-nova18:24
*** yangyapeng has joined #openstack-nova18:29
*** dave-mccowan has quit IRC18:30
*** FL1SK has joined #openstack-nova18:32
*** xyang1 has joined #openstack-nova18:32
*** catintheroof has joined #openstack-nova18:32
*** yangyapeng has quit IRC18:33
*** sterdnotshaken has joined #openstack-nova18:34
*** sterdnotshaken has joined #openstack-nova18:36
mriedemhttps://review.openstack.org/#/c/495170/ looks legit, just needs some small things cleaned up18:37
*** mnestratov|2 has quit IRC18:43
dansmithis anyone working on the actual fix for that?18:47
mriedemi'm investigating18:47
mriedemfound some more fun18:47
mriedemwhen you're force live migrating to a specific destination host, conductor checks that there is enough ram https://github.com/openstack/nova/blob/16.0.0.0rc1/nova/conductor/tasks/live_migrate.py#L10318:48
mriedemvia the compute node info, not placement18:48
dansmithah interesting18:49
mriedemnot an immediate problem,18:49
mriedembut will be once we don't track that anymore in the RT/claim18:49
dansmithyeah18:49
mriedemi'll report a bug to track that18:49
sean-k-mooneyis there an equivelent to nova reset-state in the openstack client?18:49
*** dave-mccowan has joined #openstack-nova18:53
mriedemdansmith: i think this existing bug will suffice to track that https://bugs.launchpad.net/nova/+bug/142777218:54
openstackLaunchpad bug 1427772 in OpenStack Compute (nova) "Instance that uses force-host still needs to run some filters" [Low,Confirmed]18:54
mriedemi just left a new comment for the new state of the world wrt scheduler and compute and RT18:55
mriedemand tagged with placement so it shows up in cdent's weekly email18:55
*** patriciadomin has quit IRC18:55
*** ekhugen_alt has quit IRC18:55
dansmithI guess.. the link between the two is a little vague18:56
mriedemit could be a separate bug18:56
mriedemdansmith: so the bug is that when forcing the live migration to a specific host, we don't call scheduler_client.select_destinations18:59
*** slaweq has joined #openstack-nova18:59
mriedemwhich is eventually the thing that does the double claim on source and dest18:59
*** sterdnotshaken has joined #openstack-nova19:00
mriedemand we don't 'heal' the allocations since everything, at least in this scenario, is pike, so the RT isn't healing19:00
mriedembecause of https://review.openstack.org/#/c/491012/19:00
mriedemin both cases, conductor calls def check_can_live_migrate_destination on the dest host19:01
mriedemso we could create the allocation for the instance and that compute there, or just do it in conductor if we're bypassing the scheduler19:01
*** sterdnotshaken1 has joined #openstack-nova19:01
mriedemprobably simpler to just do it in from conductor, plus then we don't have to worry about check_can_live_migrate_destination trampling over allocations that the scheduler already created19:02
*** claudiub|3 has joined #openstack-nova19:02
*** slaweq has quit IRC19:03
*** sterdnotshaken has quit IRC19:04
*** lyan has joined #openstack-nova19:04
dansmithmriedem: right19:06
*** crushil has joined #openstack-nova19:06
dansmithmriedem: I guess I was thinking we should do select_destinations with a force_host of where we're expecting to go so that it creates the allocations properly19:07
dansmiththe whole point of the mess we made in pike was to stop managing allocations from separate places (i.e. the compute nodes) so adding another one is not ideal19:08
mriedemyeah it wouldn't be fun doing a new thing from conductor just to mimic what the scheduler is doing19:08
mriedemalso because takashi wants to do this same thing for cold migrations19:08
mriedemwell, takashi and others...19:09
dansmithaye19:09
mriedemso now i'm looking at what conductor does when there isn't a forced destination host https://github.com/openstack/nova/blob/16.0.0.0rc1/nova/conductor/tasks/live_migrate.py#L15319:10
mriedemthe request spec stuff gets pretty confusing in here19:10
mriedemfor compat things19:10
mriedemwe wouldn't call _find_destination i realize,19:11
mriedemi'm just not sure how much we need to pass in the existing request spec with some "use this host, seriously" field set19:11
mriedemwould the scheduler also run the filters on the forced host in this case?19:13
*** gixxer1k has quit IRC19:14
*** gixxer1k has joined #openstack-nova19:14
mriedemthat might take the 'force-ness' out of it a bit if you fail to force because of a scheduler filter - but would allow us to remove this code https://github.com/openstack/nova/blob/16.0.0.0rc1/nova/conductor/tasks/live_migrate.py#L10319:14
dansmithmriedem: the scheduler won't know why you're running it19:14
dansmiththe point is,19:15
dansmiththe select_destinations() call should eliminate the need to manually check for memory space on the destination,19:15
mriedemfrom conductor19:15
mriedemi agree19:15
dansmithbecause if it doesn't return the host you asked for then you fail with "sorry this peg doesn't fit in that hole"19:15
dansmithyeah19:15
mriedemyeah which is nice19:16
mriedemremoves my issue with that code not using placement19:16
*** catintheroof has quit IRC19:17
mriedemso it seems all we need to do then is have conductor set force_hosts/nodes on the request spec and call select_destinations - if that raises NoValidHost, we know what to do19:17
*** ragasthya has quit IRC19:17
mriedemi seriously feel like if i try to monkey with the request spec there is some landmine that will blow off at least 2 fingers19:17
*** gixxer1k has quit IRC19:17
*** gixxer1k has joined #openstack-nova19:18
dansmithhah19:18
mriedemthis could also go away assuming you have the ComputeFilter enabled https://github.com/openstack/nova/blob/16.0.0.0rc1/nova/conductor/tasks/live_migrate.py#L8519:18
*** marst has joined #openstack-nova19:19
*** gixxer1k has quit IRC19:21
*** gixxer1k has joined #openstack-nova19:21
mriedemi think it's basically this that we need https://github.com/openstack/nova/blob/16.0.0.0rc1/nova/compute/api.py#L3880-L388419:22
*** crushil has quit IRC19:22
*** lucasxu has quit IRC19:23
*** gixxer1k has quit IRC19:24
*** gixxer1k has joined #openstack-nova19:25
*** lucasxu has joined #openstack-nova19:25
*** chyka_ has joined #openstack-nova19:26
mriedemgod, why doesn't this check if self.requested_destination is set when converting down to a legacy filter_properties dict? https://github.com/openstack/nova/blob/16.0.0.0rc1/nova/objects/request_spec.py#L34719:26
mriedemrequested_destination essentially supersedes force_hosts/nodes doesn't it?19:27
*** sapcc-bot has quit IRC19:27
*** sapcc-bot has joined #openstack-nova19:28
*** gixxer1k has quit IRC19:28
*** gixxer1k has joined #openstack-nova19:28
*** chyka has quit IRC19:29
*** yangyapeng has joined #openstack-nova19:29
dansmithmriedem: afaik yeah19:30
*** chyka_ has quit IRC19:30
mriedemweird, ok, because it's not consulted at all, from what i can tell, when converting a request spec to an older version19:31
*** gixxer1k has quit IRC19:31
*** lpetrut has quit IRC19:31
mriedemoh you know what else, this bypasses our same-cell check19:32
*** gixxer1k has joined #openstack-nova19:32
mriedemso you could force a host for live migration in another cell19:32
*** chyka has joined #openstack-nova19:32
*** moshele has quit IRC19:33
*** guimaluf has quit IRC19:33
mriedemthis force live migration thing is all sorts of f'ed19:33
*** guimaluf has joined #openstack-nova19:33
*** yangyapeng has quit IRC19:34
dansmithyeah, so all the more reason to let it do the cell and memory check in one go of select_destinations right?19:35
mriedemyeah, although i don't see where in the scheduler we check that the requested destination is in the same cell...19:35
*** vishwanathj has quit IRC19:35
mriedemget_host_states_by_uuids ?19:35
mriedemhttps://github.com/openstack/nova/blob/16.0.0.0rc1/nova/scheduler/host_manager.py#L63519:36
dansmithyeah19:36
mriedemcool, ok, so i think this narrows things a bit19:36
mriedemi think we are missing some stuff in the request spec backport to legacy format stuff, but i'm not messing with that19:37
mriedemthose are all bauzas questions19:37
*** chyka has quit IRC19:37
mriedemsince it seems there are 4 ways to construct a request spec for the scheduler19:37
dansmithyeah that whole mess is still...a mess19:39
mriedemwell it's 2:40pm on my first day back and i'm already knee deep in a mess that has to be fixed for rc219:39
mriedemyay!19:39
*** moshele has joined #openstack-nova19:39
*** vishwanathj has joined #openstack-nova19:39
dansmithwell,19:40
*** slaweq has joined #openstack-nova19:40
dansmithpresumably we _could_ just document and fix post release if needed19:40
dansmithif it helps19:40
mriedemyeah i thought about that19:40
mriedemknown issue and all19:40
mriedem"known regression"19:41
mriedem"at least we let you know about it beforehand, you're welcome"19:41
dansmithwe wouldn't want to wait long, of course, but..19:41
dansmiththings could be worse19:41
mriedemyeah19:41
mriedemi.e. optional api19:41
*** moshele has quit IRC19:41
mriedemok i'll wip something together and put it on top of https://review.openstack.org/#/c/495170/ and see what happens19:42
dansmithokay19:43
*** mrhillsman has quit IRC19:43
openstackgerritMerged openstack/nova master: Correct statement in api-ref  https://review.openstack.org/49572419:43
*** stvnoyes has joined #openstack-nova19:43
*** wxy has quit IRC19:44
*** lpetrut has joined #openstack-nova19:44
*** claudiub has joined #openstack-nova19:44
*** zhenguo has quit IRC19:44
*** wxy has joined #openstack-nova19:46
*** claudiub|3 has quit IRC19:46
*** ircuser-1 has quit IRC19:47
*** zhenguo has joined #openstack-nova19:47
*** mrhillsman has joined #openstack-nova19:47
*** pchavva has quit IRC19:51
mriedemthis was the other bug, I haven't triaged it yet https://bugs.launchpad.net/nova/+bug/171204519:54
openstackLaunchpad bug 1712045 in OpenStack Compute (nova) "nova doesn't clean up the resources after live migrate" [Undecided,New]19:54
mriedemlooks similar to what was needed with evacuate though https://review.openstack.org/#/c/494625/1/nova/compute/manager.py19:55
mriedemremove the allocations for the instance and the source node19:55
*** simondodsley has joined #openstack-nova19:56
dansmithyeah19:56
dansmithmriedem: that test for the bug you're working on has the post assertion for the destination's allocations commented out,19:58
dansmithso fixing 1712045 will be required for that one too I think19:58
*** cleong has quit IRC20:03
*** gouthamr has joined #openstack-nova20:03
*** lpetrut has quit IRC20:03
*** yamamoto has joined #openstack-nova20:04
openstackgerritMerged openstack/nova master: doc: Address review comments for contributor index  https://review.openstack.org/49151720:06
*** chyka has joined #openstack-nova20:06
mriedemwtf, is local docs build blowing up a known issue?20:07
mriedemhttps://gist.github.com/mriedem/4a6dcb52ed867af14f16989d7b83739a20:07
*** chyka has quit IRC20:10
*** yamamoto has quit IRC20:11
*** awaugama has quit IRC20:14
*** awaugama has joined #openstack-nova20:14
*** slaweq has quit IRC20:15
*** slaweq has joined #openstack-nova20:15
openstackgerritMatt Riedemann proposed openstack/nova master: doc: Address review comments for main index  https://review.openstack.org/49264520:18
mriedemdansmith: i think we should probably get ^ to rc2 to fix the "OpenSack" thing in the first section you read in nova's docs20:19
dansmithlol20:19
*** slaweq_ has joined #openstack-nova20:21
*** slaweq has quit IRC20:21
*** jdurgin has joined #openstack-nova20:23
*** armax has quit IRC20:25
*** gyee has quit IRC20:26
openstackgerritIlya Popov proposed openstack/nova master: Tests: Add cleanup of 'instances' directory  https://review.openstack.org/49158920:26
*** slaweq has joined #openstack-nova20:28
*** yangyapeng has joined #openstack-nova20:30
*** awaugama has quit IRC20:31
*** chyka has joined #openstack-nova20:31
mriedemas for that live migration test, yeah it's a mix of both bugs, and the comments are wrong for some of the existing test20:32
mriedemi'll update that test also20:32
dansmithmriedem: well, I have the change made for the post-migration update I think, but I can't really use it until I have your patch to create the doubled allocation in the scheduler20:32
*** slaweq has quit IRC20:33
mriedemcleaning up the test atm20:33
dansmithotherwise I'm trying to push empty allocations to placement20:33
dansmithno problem, just FYI20:33
*** mnestratov|2 has joined #openstack-nova20:33
*** yangyapeng has quit IRC20:35
openstackgerritMatt Riedemann proposed openstack/nova master: Add functional live migrate test  https://review.openstack.org/49581120:38
openstackgerritMatt Riedemann proposed openstack/nova master: Add functional force live migrate test  https://review.openstack.org/49517020:38
*** rajathagasthya has joined #openstack-nova20:40
*** claudiub has quit IRC20:42
mriedemok +2 on both of the live migration functional tests20:45
*** edmondsw_ has joined #openstack-nova20:47
*** rcernin has quit IRC20:47
*** edmondsw has quit IRC20:49
*** sterdnotshaken1 has quit IRC20:54
*** sterdnotshaken has joined #openstack-nova20:54
*** lucasxu has quit IRC20:55
*** sterdnotshaken has quit IRC20:55
*** sterdnotshaken has joined #openstack-nova20:55
*** gyee has joined #openstack-nova20:56
*** gouthamr has quit IRC21:01
*** thorst has quit IRC21:04
*** edmondsw_ has quit IRC21:04
*** gixxer1k has quit IRC21:04
*** ragasthya has joined #openstack-nova21:06
*** rajathagasthya has quit IRC21:08
*** chyka has quit IRC21:09
*** chyka has joined #openstack-nova21:10
*** sterdnotshaken1 has joined #openstack-nova21:12
*** sterdnotshaken has quit IRC21:12
*** yamamoto_ has joined #openstack-nova21:12
*** yufei has joined #openstack-nova21:14
mriedemi was thinking that with setting RequestSpec.requested_destination we might end up bypassing the filtering for MEMORY_MB in placement, but looks like we do that first regardless of the requested/forced host21:14
mriedemso we always call to placement to get the candidates, and then wittle that down based on forced hosts, and then further filter that using the filters21:14
*** chyka has quit IRC21:14
mriedemso we should be ok with removing that ram check in the live migration task in conductor21:14
*** yamamoto_ has quit IRC21:18
cfriesen_mriedem: looking at your comments for https://bugs.launchpad.net/nova/+bug/1712008 I guess that actually calling the scheduler will end up filtering for cells as well?21:23
openstackLaunchpad bug 1712008 in OpenStack Compute (nova) pike "Force live migrate doesn't claim resources on the target host" [Critical,Triaged]21:23
mriedemnope21:24
mriedembecause conductor doesn't set request_spec.requested_destination.cell21:24
mriedemin the LiveMigrateTask21:24
*** yufei has quit IRC21:29
*** yangyapeng has joined #openstack-nova21:31
*** slaweq_ has quit IRC21:31
*** yangyapeng has quit IRC21:35
cfriesen_mriedem: that bug is in the context of forcing a host...how is it even valid to claim resources when forcing a host?  It could end up consuming resources that aren't available.21:38
cfriesen_mriedem: (when factoring in overcommit etc)21:39
*** Apoorva_ has joined #openstack-nova21:39
mriedemcfriesen_: pre-placement you'd end up claiming resources in the compute anyway21:39
mriedemvia the resource tracker21:39
mriedemyo'ud just fail much later21:39
mriedembut let me verify that first21:40
*** heroux has quit IRC21:42
*** Apoorva has quit IRC21:42
mriedemhmm, yeah we don't call the resource tracker to make a claim during live migration...21:42
cfriesen_mriedem: that's part of the patch series that's been under review forever21:43
mriedemso, we don't want to build more on claims in the computes, yes?21:44
mriedembecause the RT is a mess21:44
*** slaweq has joined #openstack-nova21:44
mriedemand we are moving things to the scheduler so we can make more accurate decisions when building instances up front, rather than rely on reschedules21:44
mriedemyes?21:44
*** slaweq has quit IRC21:45
cfriesen_As I understand it we want to do the claims from the scheduler.  I'm not sure what meaning "force" has when it comes to things like cpu pinning, hugepages, PCI devices, etc.21:45
mriedemforce from the api just meant use this host i'm giving you21:48
mriedemrather than leave it up to the scheduler to pick one randomly21:48
mriedemnow reading https://docs.openstack.org/nova/latest/reference/api-microversion-history.html#id27 this could be considered an API change21:49
cfriesen_mriedem: you can specify which host you want without using "force"...."force" just means "not verifying the provided destination host by the scheduler".21:49
mriedem"Also changes the live-migrate action behaviour when providing a host string field by calling the nova scheduler to verify the provided host unless the force attribute is set."21:49
mriedemyeah point taken21:49
mriedemso if the point of the force flag is to not call the scheduler, because you don't care about filters or anything,21:50
cfriesen_so if we passed the force option to the scheduler, and if set we skip all the filters/weighters but still do the claim21:50
mriedembut we want to call the scheduler to do the allocation on the dest host, then we have a conflict21:50
mriedemand we don't want to do the allocation on the dest host from conductor, since that triplicates that behavior between nova-compute, nova-scheduler and nova-conductor21:51
cfriesen_I think we could get the spirit of the "force" option by still calling the scheduler but skipping the filters/weighers21:51
cfriesen_that would allow us to avoid additional duplication21:52
mriedemthat probably involves passing yet another ignore/force type thing to the scheduler21:52
cfriesen_yea21:52
mriedemrequest spec already has ignore_hosts and force_hosts21:52
mriedemand requested_destination21:52
mriedemthis would be, ignore source host, force dest host, but seriously, really ignore and force everything wink wink21:52
cfriesen_hmm...what's the difference between force_hosts and requested_destination?21:52
mriedemcfriesen_: see the email i just send to the ML :)21:52
cfriesen_lol21:53
*** xyang1 has quit IRC21:53
cfriesen_right.  maybe we can reuse force_hosts to tell it to skip the filters/weighers but still do claims21:54
mriedemno that gets really confusing21:54
mriedemadds more confusion to an already really confusing thing i mean21:54
cfriesen_I think "ignore_hosts" is more than just ignore source...it's also used to keep track of hosts we've already tried (when doing a reschedule)21:54
mriedemlike, i think force_hosts is used today in the scheduler hint for picking a specific host using scheduler hints21:55
mriedemand that goes through the filters/weighers21:55
mriedemyes it is21:55
cfriesen_the joys of an organically grown API. :)21:55
mriedemso if we pass something to the scheduler, i'd say it's an explicit new flag, called skip_filters or something21:55
cfriesen_yeah, that's probably cleanest21:55
cfriesen_I can probably take on the limit-live-mig-dest-to-same-cell thing if you haven't already started it.21:56
mriedemi'm sort of doing that as part of this other fix for the allocations thing, but it's going to require a separate bug and patch for the non-force case21:57
mriedemi'm opening that bug now21:57
mikal.22:02
mriedemcfriesen_: https://bugs.launchpad.net/nova/+bug/171221022:02
openstackLaunchpad bug 1712210 in OpenStack Compute (nova) "Live migration does not restrict to the original cell" [Medium,New]22:02
mriedemdansmith: you're working on https://bugs.launchpad.net/nova/+bug/1712045 right? if so, i'll assign it to you22:03
openstackLaunchpad bug 1712045 in OpenStack Compute (nova) pike "nova doesn't clean up the resources after live migrate" [Critical,Triaged]22:03
dansmithmriedem: I have some code for it yeah, waiting for your change to the conductor task22:11
mriedemi'm code is a turd at this point - likely need to pass a flag to select_destinations as was just talking about with cfriesen_ ^22:12
mriedembut, i've got something, running the functional test to update it, and then will push up the wip for discussion22:12
openstackgerritMerged openstack/nova master: doc: Address review comments for main index  https://review.openstack.org/49264522:13
*** egonzalez has quit IRC22:13
*** itlinux has quit IRC22:14
*** yamamoto_ has joined #openstack-nova22:14
*** sterdnotshaken has joined #openstack-nova22:15
*** sterdnotshaken1 has quit IRC22:15
*** sterdnotshaken1 has joined #openstack-nova22:17
*** sterdnotshaken has quit IRC22:17
mriedemhere is that docs backport https://review.openstack.org/#/c/495977/22:17
*** yamamoto_ has quit IRC22:19
dansmithmriedem: +2+W I assume?22:21
mriedemof course22:21
mriedemunless we put mikal back on the nova-release team for 1 week only :)22:22
mriedemthrowback week22:22
*** yangyapeng has joined #openstack-nova22:32
*** thorst has joined #openstack-nova22:35
*** mnestratov|2 has quit IRC22:35
*** sterdnotshaken has joined #openstack-nova22:36
*** sterdnotshaken1 has quit IRC22:36
*** yangyapeng has quit IRC22:36
*** lyan has quit IRC22:38
*** sbezverk has quit IRC22:39
*** sterdnotshaken has quit IRC22:39
*** sterdnotshaken has joined #openstack-nova22:39
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Allocate resources on forced dest host during live migration  https://review.openstack.org/49603122:39
mriedemdansmith: cfriesen_: ok here is my wip for the bug where we don't create allocations for the dest node during forced live migration ^ lots of TODOs for things i need to consider still, plus as cfriesen_ pointed out it's probably wrong anyway since it's breaking the api contracton how that force flag is supposed to work22:40
*** felipemonteiro__ has quit IRC22:43
mriedemthese force flags are a bad idea22:45
*** guimaluf has quit IRC22:48
*** guimaluf has joined #openstack-nova22:49
openstackgerritDan Smith proposed openstack/nova master: Remove source node allocation after live migration completes  https://review.openstack.org/49603222:50
dansmithmriedem: ^22:50
*** thorst has quit IRC22:53
mriedemhawt22:54
mriedemwith that, i'm going to gymnastics!22:54
*** armax has joined #openstack-nova22:54
cburgesslol22:56
*** marst has quit IRC22:59
*** wasmum has joined #openstack-nova23:03
*** Apoorva_ has quit IRC23:11
*** Apoorva has joined #openstack-nova23:11
*** tbachman has quit IRC23:14
*** yamamoto_ has joined #openstack-nova23:16
*** yamamoto_ has quit IRC23:21
*** hongbin has quit IRC23:26
*** catintheroof has joined #openstack-nova23:29
*** yangyapeng has joined #openstack-nova23:32
*** thorst has joined #openstack-nova23:33
*** thorst has quit IRC23:33
*** yangyapeng has quit IRC23:37
*** ragasthya has quit IRC23:43
*** rajathagasthya has joined #openstack-nova23:44
*** gyee has quit IRC23:47
*** thorst has joined #openstack-nova23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!