| *** slaweq has quit IRC | 00:05 | |
| *** hongbin has quit IRC | 00:12 | |
| *** mriedem has quit IRC | 00:13 | |
| *** artom has quit IRC | 00:36 | |
| *** artom has joined #openstack-meeting | 00:45 | |
| *** tetsuro has joined #openstack-meeting | 00:58 | |
| *** zaneb has quit IRC | 01:10 | |
| *** markvoelker has joined #openstack-meeting | 01:23 | |
| *** markvoelker has quit IRC | 01:28 | |
| *** mjturek has quit IRC | 01:28 | |
| *** dklyle has joined #openstack-meeting | 01:32 | |
| *** trident has quit IRC | 01:50 | |
| *** gyee has quit IRC | 01:54 | |
| *** trident has joined #openstack-meeting | 01:55 | |
| *** cloudrancher has quit IRC | 02:08 | |
| *** cloudrancher has joined #openstack-meeting | 02:10 | |
| *** erlon has quit IRC | 02:16 | |
| *** hongbin has joined #openstack-meeting | 02:28 | |
| *** markvoelker has joined #openstack-meeting | 02:30 | |
| *** mhen has quit IRC | 02:43 | |
| *** seongsoocho has joined #openstack-meeting | 02:43 | |
| *** mhen has joined #openstack-meeting | 02:44 | |
| *** radeks has joined #openstack-meeting | 02:55 | |
| *** rcernin has quit IRC | 02:58 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:00 | |
| *** Fdaisuke_ has joined #openstack-meeting | 03:01 | |
| *** jamesmcarthur has quit IRC | 03:04 | |
| *** diablo_rojo has quit IRC | 03:11 | |
| *** iyamahat_ has quit IRC | 03:11 | |
| *** yamahata has quit IRC | 03:12 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:14 | |
| *** apetrich has quit IRC | 03:16 | |
| *** jamesmcarthur has quit IRC | 03:30 | |
| *** bobh has joined #openstack-meeting | 03:35 | |
| *** rcernin has joined #openstack-meeting | 03:38 | |
| *** bobh has quit IRC | 03:41 | |
| *** EmLOveAnh has joined #openstack-meeting | 03:43 | |
| *** EmLOveAnh has quit IRC | 03:54 | |
| *** dklyle has quit IRC | 03:58 | |
| *** tetsuro has quit IRC | 04:05 | |
| *** diablo_rojo has joined #openstack-meeting | 04:17 | |
| *** jamesmcarthur has joined #openstack-meeting | 04:20 | |
| *** armax has quit IRC | 04:24 | |
| *** jamesmcarthur has quit IRC | 04:25 | |
| *** hongbin has quit IRC | 04:34 | |
| *** whoami-rajat has joined #openstack-meeting | 04:47 | |
| *** yamahata has joined #openstack-meeting | 05:03 | |
| *** janki has joined #openstack-meeting | 05:09 | |
| *** sridharg has joined #openstack-meeting | 05:35 | |
| *** imacdonn has quit IRC | 05:38 | |
| *** imacdonn has joined #openstack-meeting | 05:39 | |
| *** tetsuro has joined #openstack-meeting | 05:55 | |
| *** radeks has quit IRC | 06:20 | |
| *** radeks has joined #openstack-meeting | 06:26 | |
| *** tetsuro has quit IRC | 06:40 | |
| *** armax has joined #openstack-meeting | 06:44 | |
| *** Luzi has joined #openstack-meeting | 06:59 | |
| *** slaweq has joined #openstack-meeting | 07:03 | |
| *** e0ne has joined #openstack-meeting | 07:10 | |
| *** shrasool has quit IRC | 07:18 | |
| *** apetrich has joined #openstack-meeting | 07:26 | |
| *** armax has quit IRC | 07:27 | |
| *** aojea has joined #openstack-meeting | 07:32 | |
| *** rcernin has quit IRC | 07:35 | |
| *** kopecmartin|off is now known as kopecmartin | 07:39 | |
| *** tetsuro has joined #openstack-meeting | 07:54 | |
| *** ralonsoh has joined #openstack-meeting | 07:58 | |
| *** tetsuro has quit IRC | 08:14 | |
| *** tetsuro has joined #openstack-meeting | 08:16 | |
| *** diablo_rojo has quit IRC | 08:29 | |
| *** takamatsu has quit IRC | 08:31 | |
| *** arne_wiebalck_ has joined #openstack-meeting | 08:32 | |
| *** dims has quit IRC | 08:32 | |
| *** arne_wiebalck_ has quit IRC | 08:33 | |
| *** dims has joined #openstack-meeting | 08:33 | |
| *** arne_wiebalck_ has joined #openstack-meeting | 08:34 | |
| *** ttsiouts has joined #openstack-meeting | 08:34 | |
| *** ttsiouts has quit IRC | 08:36 | |
| *** ttsiouts has joined #openstack-meeting | 08:37 | |
| *** ttsiouts has quit IRC | 08:41 | |
| *** arne_wiebalck_ has quit IRC | 08:47 | |
| *** pcaruana has joined #openstack-meeting | 08:48 | |
| *** markvoelker has quit IRC | 08:50 | |
| *** apetrich has quit IRC | 08:52 | |
| *** rossella_s has joined #openstack-meeting | 08:54 | |
| *** tetsuro has quit IRC | 09:08 | |
| *** ttsiouts has joined #openstack-meeting | 09:09 | |
| *** takamatsu has joined #openstack-meeting | 09:13 | |
| *** dmacpher has joined #openstack-meeting | 09:14 | |
| *** tssurya has joined #openstack-meeting | 09:27 | |
| *** diman has joined #openstack-meeting | 09:39 | |
| *** diman has left #openstack-meeting | 09:39 | |
| *** diman has joined #openstack-meeting | 09:39 | |
| *** apetrich has joined #openstack-meeting | 09:43 | |
| *** shrasool has joined #openstack-meeting | 09:44 | |
| *** ssbarnea has quit IRC | 09:45 | |
| *** ssbarnea|rover has joined #openstack-meeting | 09:45 | |
| *** erlon has joined #openstack-meeting | 09:46 | |
| *** markvoelker has joined #openstack-meeting | 09:51 | |
| *** rossella_s has quit IRC | 09:52 | |
| *** walshh_ has quit IRC | 09:58 | |
| *** jchhatbar has joined #openstack-meeting | 10:02 | |
| *** janki has quit IRC | 10:05 | |
| *** ttsiouts has quit IRC | 10:05 | |
| *** ttsiouts has joined #openstack-meeting | 10:05 | |
| *** ttsiouts has quit IRC | 10:08 | |
| *** ttsiouts has joined #openstack-meeting | 10:08 | |
| *** shrasool has quit IRC | 10:24 | |
| *** markvoelker has quit IRC | 10:24 | |
| *** rossella_s has joined #openstack-meeting | 10:36 | |
| *** jchhatba_ has joined #openstack-meeting | 10:37 | |
| *** lpetrut has joined #openstack-meeting | 10:38 | |
| *** jchhatbar has quit IRC | 10:39 | |
| *** yamamoto has quit IRC | 10:43 | |
| *** rossella_s has quit IRC | 10:49 | |
| *** rossella_s has joined #openstack-meeting | 10:53 | |
| *** electrofelix has joined #openstack-meeting | 11:04 | |
| *** markvoelker has joined #openstack-meeting | 11:21 | |
| *** ttsiouts has quit IRC | 11:24 | |
| *** ttsiouts has joined #openstack-meeting | 11:24 | |
| *** takamatsu has quit IRC | 11:25 | |
| *** jchhatbar has joined #openstack-meeting | 11:30 | |
| *** takamatsu has joined #openstack-meeting | 11:31 | |
| *** ttsiouts has quit IRC | 11:32 | |
| *** jchhatba_ has quit IRC | 11:33 | |
| *** aloga has quit IRC | 11:33 | |
| *** aloga has joined #openstack-meeting | 11:33 | |
| *** rossella_s has quit IRC | 11:39 | |
| *** artom has quit IRC | 11:42 | |
| *** jchhatbar has quit IRC | 11:43 | |
| *** raildo has joined #openstack-meeting | 11:45 | |
| *** markvoelker has quit IRC | 11:55 | |
| *** ttsiouts has joined #openstack-meeting | 11:58 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:00 | |
| *** jamesmcarthur has quit IRC | 12:04 | |
| *** takamatsu has quit IRC | 12:06 | |
| *** yamamoto has joined #openstack-meeting | 12:08 | |
| *** tpsilva has joined #openstack-meeting | 12:15 | |
| *** yamahata has quit IRC | 12:17 | |
| *** ShilpaSD has quit IRC | 12:26 | |
| *** ttsiouts has quit IRC | 12:30 | |
| *** ttsiouts has joined #openstack-meeting | 12:31 | |
| *** ttsiouts has quit IRC | 12:32 | |
| *** ttsiouts has joined #openstack-meeting | 12:32 | |
| *** Nel1x has joined #openstack-meeting | 12:38 | |
| *** vishalmanchanda has joined #openstack-meeting | 12:49 | |
| *** markvoelker has joined #openstack-meeting | 12:52 | |
| *** e0ne has quit IRC | 12:53 | |
| *** cschwede has joined #openstack-meeting | 12:58 | |
| *** arne_wiebalck_ has joined #openstack-meeting | 12:59 | |
| *** artom has joined #openstack-meeting | 13:02 | |
| *** rossella_s has joined #openstack-meeting | 13:12 | |
| *** yamamoto has quit IRC | 13:19 | |
| *** whoami-rajat has quit IRC | 13:19 | |
| *** yamamoto has joined #openstack-meeting | 13:19 | |
| *** markvoelker has quit IRC | 13:24 | |
| *** e0ne has joined #openstack-meeting | 13:31 | |
| *** longkb has joined #openstack-meeting | 13:33 | |
| *** shrasool has joined #openstack-meeting | 13:34 | |
| *** janki has joined #openstack-meeting | 13:35 | |
| *** ttsiouts has quit IRC | 13:37 | |
| *** shrasool has quit IRC | 13:38 | |
| *** Liang__ has joined #openstack-meeting | 13:39 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:48 | |
| *** Liang__ is now known as LiangFang | 13:49 | |
| *** jangutter has joined #openstack-meeting | 13:50 | |
| *** shrasool has joined #openstack-meeting | 13:50 | |
| *** mdbooth has joined #openstack-meeting | 13:52 | |
| *** takamatsu has joined #openstack-meeting | 13:56 | |
| *** abhishekk has joined #openstack-meeting | 13:58 | |
| *** helenafm has joined #openstack-meeting | 13:58 | |
| *** takashin has joined #openstack-meeting | 13:58 | |
| *** cdent has joined #openstack-meeting | 13:59 | |
| gibi | #startmeeting nova | 14:00 |
|---|---|---|
| openstack | Meeting started Thu Nov 29 14:00:04 2018 UTC and is due to finish in 60 minutes. The chair is gibi. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| *** openstack changes topic to " (Meeting topic: nova)" | 14:00 | |
| openstack | The meeting name has been set to 'nova' | 14:00 |
| takashin | o/ | 14:00 |
| gibi | hi | 14:00 |
| gmann | o/ | 14:00 |
| edleafe | \o | 14:00 |
| *** abhishekk has left #openstack-meeting | 14:00 | |
| *** georgh has joined #openstack-meeting | 14:01 | |
| mdbooth | o/ | 14:01 |
| *** longkb has quit IRC | 14:01 | |
| gibi | let's get started | 14:01 |
| gibi | #topic Release News | 14:01 |
| *** openstack changes topic to "Release News (Meeting topic: nova)" | 14:01 | |
| * bauzas waves late | 14:01 | |
| efried | o/ | 14:01 |
| gibi | #link Stein release schedule: https://wiki.openstack.org/wiki/Nova/Stein_Release_Schedule | 14:01 |
| gibi | next milestone is 10th of January | 14:02 |
| gibi | #link Stein runway etherpad: https://etherpad.openstack.org/p/nova-runways-stein | 14:02 |
| gibi | #link runway #1: https://blueprints.launchpad.net/nova/+spec/io-semaphore-for-concurrent-disk-ops (jackding) [END 2018-12-04] https://review.openstack.org/#/c/609180/ (approved Nov 27, currently in the gate queue) | 14:02 |
| gibi | #link runway #2: https://blueprints.launchpad.net/nova/+spec/reshape-provider-tree (bauzas/naichuan) [END 2018-12-04] | 14:02 |
| gibi | https://review.openstack.org/#/c/599208/ libvirt: implement reshaper for vgpu (bauzas) | 14:02 |
| gibi | https://review.openstack.org/#/c/521041/ xenapi(N-R-P): support compute node resource provider update (naichuan) | 14:02 |
| gibi | #link runway #3 https://blueprints.launchpad.net/nova/+spec/initial-allocation-ratios (yikun) [END 2018-12-10] starts here https://review.openstack.org/#/c/602803 | 14:02 |
| gibi | hopefully the io semaphore item goes through CI soon and then one slot can be freed | 14:03 |
| gibi | any comments about release or runways? | 14:03 |
| gibi | #topic Bugs | 14:04 |
| *** openstack changes topic to "Bugs (Meeting topic: nova)" | 14:04 | |
| gibi | No critical bugs | 14:04 |
| gibi | #link 54 new untriaged bugs (down 4 since the last meeting): https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New | 14:04 |
| gibi | #link 9 untagged untriaged bugs (up 2 since the last meeting): https://bugs.launchpad.net/nova/+bugs?field.tag=-*&field.status%3Alist=NEW | 14:04 |
| *** jamesmcarthur has quit IRC | 14:04 | |
| gibi | #link bug triage how-to: https://wiki.openstack.org/wiki/Nova/BugTriage#Tags | 14:04 |
| gibi | #help need help with bug triage | 14:04 |
| gibi | any comments on the bug situation? | 14:05 |
| *** arne_wiebalck_ has quit IRC | 14:05 | |
| cdent | I'm trying to stir some bug triage help internally, but everyone is busy :(\ | 14:05 |
| gibi | thanks cdent | 14:05 |
| cdent | seems same story everywhere | 14:06 |
| gibi | seems so | 14:06 |
| gibi | #topic Gate status | 14:06 |
| *** openstack changes topic to "Gate status (Meeting topic: nova)" | 14:06 | |
| gibi | #link check queue gate status http://status.openstack.org/elastic-recheck/index.html | 14:06 |
| gibi | there are some mirror issues as far as I see | 14:06 |
| gibi | it seems http://status.openstack.org/elastic-recheck/index.html#1449136 is a heavy hitter | 14:07 |
| gibi | #link 3rd party CI status http://ci-watch.tintri.com/project?project=nova&time=7+days | 14:07 |
| gibi | the link ^^ does not open for me | 14:07 |
| gibi | any comments about the gate or 3rd party CI? | 14:08 |
| bauzas | that depens | 14:08 |
| bauzas | it can be long to open | 14:08 |
| gibi | bauzas: it times out for me today | 14:08 |
| bauzas | hmm, right | 14:09 |
| efried | yeah, I heard whoever was maintaining it, wasn't anymore. | 14:09 |
| efried | I (or someone) started a conversation in -infra, possibly with the thought of getting someone to take over / replace that with something equivalent | 14:09 |
| *** bobh has joined #openstack-meeting | 14:09 | |
| efried | but I'm not sure if that panned out. | 14:09 |
| efried | That was several weeks ago, before chaos. | 14:09 |
| bauzas | I have a very bad DSL connection at home, so I'm not really the right guy to tell whether it's a problem or not | 14:10 |
| gibi | efried: thanks for the info | 14:10 |
| *** mjturek has joined #openstack-meeting | 14:10 | |
| gibi | #topic Reminders | 14:10 |
| *** openstack changes topic to "Reminders (Meeting topic: nova)" | 14:10 | |
| gibi | #link Stein Subteam Patches n Bugs: https://etherpad.openstack.org/p/stein-nova-subteam-tracking | 14:10 |
| gibi | any other reminders? | 14:10 |
| gibi | #topic Stable branch status | 14:11 |
| *** openstack changes topic to "Stable branch status (Meeting topic: nova)" | 14:11 | |
| gibi | #link stable/rocky: https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:stable/rocky,n,z | 14:11 |
| gibi | #link stable/queens: https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:stable/queens,n,z | 14:11 |
| gibi | #link stable/pike: https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:stable/pike,n,z | 14:11 |
| gibi | there is a list of patches waiting for a second stable core | 14:11 |
| *** sean-k-mooney has joined #openstack-meeting | 14:11 | |
| gibi | any comment on stable? | 14:12 |
| sean-k-mooney | has there been any progress on teh oslo.service issue | 14:13 |
| gmann | FYI, nova-next does not run on queens. i have pushed the backport | 14:13 |
| gmann | #link https://review.openstack.org/#/q/topic:nova-next-queens+(status:open+OR+status:merged) | 14:13 |
| gmann | and matt backported the devstack patch | 14:13 |
| gibi | sean-k-mooney: this is the last mail in the ML http://lists.openstack.org/pipermail/openstack-discuss/2018-November/000350.html | 14:15 |
| gibi | sean-k-mooney: I did not follow the issue closely | 14:15 |
| efried | I'm happy with any of the proposed solutions, so I'm sitting back and letting others sort it out. | 14:16 |
| gibi | gmann: thanks | 14:16 |
| sean-k-mooney | it looklike a new version is proposed for oslo.servce to fix it https://review.openstack.org/#/c/620913/ | 14:16 |
| efried | but I do feel kinda guilty for causing the whole debacle. | 14:16 |
| sean-k-mooney | ok i think we can assume that it is progressing | 14:18 |
| gibi | OK, moving on | 14:18 |
| gibi | #topic Subteam Highlights | 14:18 |
| *** openstack changes topic to "Subteam Highlights (Meeting topic: nova)" | 14:18 | |
| gibi | Scheduler (efried) | 14:18 |
| efried | #link n-sch meeting minutes http://eavesdrop.openstack.org/meetings/nova_scheduler/2018/nova_scheduler.2018-11-26-14.00.html | 14:18 |
| efried | Lots of specs need TLC from authors | 14:18 |
| efried | Extraction is proceeding well. The | 14:18 |
| efried | #link devstack change https://review.openstack.org/#/c/600162/ | 14:18 |
| efried | has merged since the meeting | 14:18 |
| efried | #link data migrations fix from tetsuro #link https://review.openstack.org/#/c/619126/ | 14:19 |
| efried | Lots of small/easy placement changes that could use a look to clean things up. | 14:19 |
| efried | #link placement open patches https://review.openstack.org/#/q/project:openstack/placement+status:open | 14:19 |
| efried | Especially | 14:19 |
| efried | #link integrated template https://review.openstack.org/#/c/617565/ | 14:19 |
| efried | which has since merged | 14:19 |
| efried | Reshaper patches still need review | 14:19 |
| efried | #link libvirt reshaper https://review.openstack.org/#/c/599208/ | 14:19 |
| efried | #link xen reshaper (middle of series) https://review.openstack.org/#/c/521041 | 14:19 |
| efried | FFU framework for reshaper: we will consciously continue kicking this can down the road. | 14:19 |
| efried | Educated tetsuro on flamethrowers | 14:19 |
| efried | END | 14:19 |
| gibi | efried: thanks | 14:19 |
| edleafe | Important education | 14:19 |
| gibi | API (gmann) | 14:20 |
| *** longkb has joined #openstack-meeting | 14:20 | |
| gmann | No office hour this week | 14:20 |
| gmann | Triaged 5 bugs during that time. | 14:20 |
| gmann | Updated the subteam tracking etherpad #link https://etherpad.openstack.org/p/stein-nova-subteam-tracking | 14:20 |
| gmann | Detail status of this week #link http://lists.openstack.org/pipermail/openstack-discuss/2018-November/000281.html | 14:20 |
| gmann | END | 14:20 |
| gibi | gmann: thanks | 14:20 |
| gibi | any other subteam report? | 14:20 |
| gibi | #topic Stuck Reviews | 14:21 |
| *** openstack changes topic to "Stuck Reviews (Meeting topic: nova)" | 14:21 | |
| gibi | we have one on the agenda | 14:21 |
| gibi | (mriedem): Need to figure out what to do about the fix for gate bug 1798688: https://review.openstack.org/#/c/617040/ - do we whack the mole in the compute code or detect and retry in the scheduler? | 14:21 |
| openstack | bug 1798688 in OpenStack Compute (nova) "AllocationUpdateFailed_Remote: Failed to update allocations for consumer. Error: another process changed the consumer after the report client read the consumer state during the claim" [High,In progress] https://launchpad.net/bugs/1798688 - Assigned to Matt Riedemann (mriedem) | 14:21 |
| gibi | This is basically a race condition between shelve offload and unshelve | 14:22 |
| gibi | detected by the consumer generation | 14:23 |
| gibi | in placement | 14:23 |
| gibi | efried: had -1 on the code and I also left an alternative proposal this morning there | 14:23 |
| gibi | s/:// | 14:23 |
| gibi | the currently proposed solution is a retry in the report client | 14:23 |
| cdent | I think I prefer option 2 as well. Without matt or dan here, it's hard to move along | 14:23 |
| bauzas | I don't have context | 14:24 |
| gibi | cdent: yeah, without dansmith and mriedem it is not easy to discuss this item | 14:24 |
| bauzas | hah, reading the commit msg | 14:24 |
| georgh | i need a final approve for this change: https://review.openstack.org/#/c/575735/ | 14:25 |
| gibi | georgh: we can get back to that in Open Discussion | 14:25 |
| gibi | so I think I will leave this review in the agenda in the stuck reviews | 14:26 |
| gibi | and if nothing changes til next week then we can try to dicuss it again | 14:26 |
| bauzas | I thought we said retries are fine when we have a generation issue ? | 14:26 |
| bauzas | if so, why not for an unshelve ? | 14:27 |
| edleafe | bauzas: I was wondering the same thing | 14:27 |
| efried | bauzas: that's too broad a statement. | 14:27 |
| gibi | bauzas: blind retry felt like ignoring the consumer generation feature itself | 14:27 |
| efried | yes, exactly. | 14:27 |
| bauzas | so we should check the generation bit, that's your concern ? | 14:27 |
| gibi | to be correct the proposed solution is not totally blind | 14:27 |
| gibi | bauzas: I personally would like to avoid the unshelve race if possible | 14:28 |
| edleafe | Retry with a GET to update the current state of the allocations | 14:28 |
| edleafe | that's what the idea of consumer gens was for | 14:28 |
| *** rambo_li_ has joined #openstack-meeting | 14:28 | |
| efried | The statement needs to be more like, "When you get a generation conflict, you need to re-GET the relevant pieces and re-execute the relevant logic, which may or may not amount to an exact retry." | 14:28 |
| efried | Yeah, what edleafe said. | 14:28 |
| edleafe | So why is this case different? | 14:29 |
| efried | edleafe: I think it's the scope of the retry | 14:29 |
| efried | edleafe: I think the point is that some of the logic from the caller of this method would need to be included in the retry. | 14:29 |
| *** njohnston has left #openstack-meeting | 14:29 | |
| *** mriedem has joined #openstack-meeting | 14:29 | |
| efried | I don't know that for sure in this case btw | 14:30 |
| edleafe | The retry would be better in the code itself, not the reportclient, which whould be generic | 14:30 |
| cdent | Is there anything wrong with gibi's proposal? because fixing a race is much nicer than handling a race | 14:30 |
| *** ttsiouts has joined #openstack-meeting | 14:30 | |
| sean-k-mooney | this is the basese fo the compare and swap idiom for concurrent modifcatoin of a shared datastructure. the unshlve action would need to read the state but it shoudl be able to retry | 14:30 |
| edleafe | cdent: I'm not familiar enough with unshelve to know whether that would break other assumptions | 14:31 |
| mdbooth | Is there any reason why you wouldn't make both changes? | 14:31 |
| bauzas | edleafe: unshelve is just a crazy scheduling call which literrally recreates the instance | 14:32 |
| sean-k-mooney | mdbooth: it might hide if we reintoduce the race after fixing it if we have a retry mechaniums too | 14:32 |
| edleafe | bauzas: yeah, I get that. It's the 'crazy' part that I'm nervous about | 14:32 |
| efried | mriedem: are you following / catching up? | 14:32 |
| mriedem | did dst mess me up? | 14:33 |
| bauzas | indeed | 14:33 |
| *** eharney has joined #openstack-meeting | 14:33 | |
| mriedem | then no | 14:33 |
| mriedem | you're talking about my stuck patch | 14:34 |
| efried | mriedem: we're discussing the delete-consumer-race-on-shelving | 14:34 |
| efried | yeah | 14:34 |
| bauzas | edleafe: for more details https://developer.openstack.org/api-guide/compute/server_concepts.html#server-actions | 14:34 |
| mriedem | as i said in the change, i could do the spot fix in the shelve code or the more generic fix in the scheduler, i opted for the latter | 14:34 |
| mriedem | it seems to me the scheduler code, before consumer aggregates, was already retrying on conflict | 14:34 |
| mriedem | so i followed that | 14:34 |
| mriedem | fixing where shelve removes the allocatoins will fix *this* race but i worry about others | 14:35 |
| gibi | mriedem: I would fix the race in the shelve code as that would be a specific fix. the current proposal is a generic fix for more than just shelve - unshelve race | 14:35 |
| efried | Agree with ^ | 14:35 |
| mriedem | so people want both? | 14:36 |
| gibi | mriedem: I'm affraid the retry would hide things we eventually want to fix | 14:36 |
| mriedem | ok, i guess if there is majority agreement on at least the shelve fix i can do that and leave the generic fix to rot | 14:36 |
| gibi | anybody against ^^ ? | 14:37 |
| edleafe | not I | 14:37 |
| efried | Don't know about "rot". But it should be evaluated separately whether we can identify a proper scope for "always retry". | 14:37 |
| efried | I'm just not convinced that that scope == this method. | 14:37 |
| mriedem | i just likely won't have the energy to do that evaluation | 14:37 |
| efried | That's fine. | 14:38 |
| mriedem | i already spent the better part of a day identifying this race | 14:38 |
| gibi | yeah, fix the known race | 14:38 |
| efried | Seems like something gibi would have the energy for, nudge nudge :P | 14:38 |
| mriedem | gibi has bigger fish to fry | 14:38 |
| gibi | efried: :) I don't feel that way | 14:38 |
| gibi | OK so we agreed that mriedem propose a fix for the shelve race | 14:39 |
| gibi | moving forward | 14:39 |
| gibi | #topic Open discussion | 14:39 |
| *** openstack changes topic to "Open discussion (Meeting topic: nova)" | 14:39 | |
| gibi | (mriedem): Looking for approval on this specless blueprint: https://blueprints.launchpad.net/nova/+spec/run-meta-api-per-cell - this was discussed in the Oct 25 meeting and there was agreement for no spec, but efried wanted to know the name of the config option which is in the blueprint now. So are we good to go? | 14:39 |
| gibi | efried: ^^ ? | 14:39 |
| efried | ... | 14:40 |
| rambo_li_ | Hi,all ,I have some questions,one is The actual operator is different from the operator was record in panko. Such as the delete action, we create the VM as user1, and we delete the VM as user2， but the operator is user1 who delete the VM in panko event, not the actual operator user2. | 14:40 |
| gibi | rambo_li_: lets take that after georgh | 14:40 |
| efried | gibi, mriedem: Yup, good to go, thanks for the update. | 14:40 |
| rambo_li_ | o | 14:40 |
| gibi | efried: cool | 14:41 |
| mriedem | ok so should i approve my own blueprint then? | 14:41 |
| gibi | mriedem: I agree to approve it | 14:41 |
| mriedem | seems...dubious | 14:41 |
| mriedem | ok | 14:41 |
| mriedem | it's on the record | 14:41 |
| gibi | :) | 14:41 |
| gibi | next | 14:41 |
| gibi | (gmann): Regarding migrating the gate jobs to Bionic- http://lists.openstack.org/pipermail/openstack-discuss/2018-November/000168.html . I have tested existing zuulv3 nova jobs on bionic and all working fine. I have marked OK for nova in https://etherpad.openstack.org/p/devstack-bionic | 14:41 |
| gibi | gmann: thanks for the effort | 14:41 |
| gibi | is there anything we have to discuss about the bionic jobs? | 14:42 |
| gmann | note- legacy jobs are not planned to migrate to bionic so they keep running on xenial until move to zuulv3 native | 14:42 |
| mriedem | ouch... | 14:42 |
| mriedem | when will infra drop xenial? | 14:42 |
| mriedem | we have a lot of legacy jobs | 14:42 |
| gmann | it will not be dropped as few job still have dependency like keystone federation job etc | 14:43 |
| gmann | mriedem: i am planning to start the migration to zuulv3 one by one next week. | 14:43 |
| mriedem | ok, i guess it can be a community wide goal in the future when it's a real problem | 14:43 |
| mriedem | or that | 14:43 |
| gmann | +1 | 14:43 |
| gibi | +1 | 14:43 |
| gibi | OK. georgh it is your turn | 14:44 |
| georgh | thx, I'm looking for a final approval of https://review.openstack.org/#/c/575735/ | 14:44 |
| georgh | melwitt asked Kashyap Chamarthy for help but his review didn't bring the issue ahead | 14:45 |
| mriedem | and sahid is gone from red hat, | 14:46 |
| sean-k-mooney | yes i rember this patch for what its worth i still think it good | 14:46 |
| georgh | It's been stuck since then and from my point of view the change its finished. | 14:46 |
| mriedem | there just aren't that many people familiar with this code | 14:46 |
| efried | I pinged kashyap to have another look. | 14:46 |
| georgh | I know that interactive serial consoles are an exotic topic | 14:46 |
| sean-k-mooney | mriedem: sahid is now at canonical but im not sure if he is working on openstack anymore | 14:46 |
| *** kashyap has joined #openstack-meeting | 14:47 | |
| *** ttsiouts has quit IRC | 14:47 | |
| *** ttsiouts has joined #openstack-meeting | 14:48 | |
| efried | kashyap is looking | 14:48 |
| gibi | efried: thanks | 14:48 |
| gibi | I hope kashyap reply will unblock this patch | 14:48 |
| kashyap | efried: Oh, this one. Yes, need to load all the "console-related context", can do it tomm or early next week | 14:48 |
| kashyap | Thanks for the ping | 14:48 |
| georgh | ok, thank you | 14:48 |
| kashyap | My bad, the reply has been sitting since 02-Nov | 14:48 |
| gibi | moving forward | 14:48 |
| *** ttsiouts has quit IRC | 14:48 | |
| efried | We'll need a couple of cores once that happens. I'm afraid I have zero background in this area. Anyone? | 14:48 |
| *** ttsiouts has joined #openstack-meeting | 14:49 | |
| sean-k-mooney | efried: stephenfin: should be black monday | 14:49 |
| gibi | I happy to read the patch and learn some of it | 14:49 |
| mriedem | mine is very thin | 14:49 |
| efried | If not, I wouldn't feel *too* bad about leaning on the expertise of sean-k-mooney and kashyap | 14:49 |
| mriedem | someone get markus zoeller out of retirement | 14:49 |
| efried | if stephenfin is familiar, that would be good. | 14:49 |
| gibi | really moving forward | 14:49 |
| gibi | rambo_li_: your turn | 14:50 |
| efried | I wonder if rambo_li_'s issue is better for the main channel, outside of the meeting. | 14:50 |
| efried | or even the ML | 14:51 |
| gibi | rambo_li_: would it be OK to you to bring this up on #openstack-nova or on the mailing list? | 14:51 |
| rambo_li_ | ok,thank you,let's go to the next one | 14:52 |
| gibi | rambo_li_: thanks | 14:52 |
| rambo_li_ | Another one,When we resize/migrate instance, if error occurs on source compute node, the instance state can rollback to active currently.But if error occurs in "finish_resize" function on destination compute node, the instance state would not rollback to active. Is there a bug, or if anyone plans to change this? | 14:52 |
| bauzas | reset-state ? | 14:53 |
| mriedem | likely because there isn't cleanup on finish_resize if an error occurs | 14:53 |
| gibi | rambo_li_: if finish resize already destroyed someting on the source then it is hard to roll back | 14:53 |
| *** awaugama has joined #openstack-meeting | 14:53 | |
| mriedem | depending on where it happens, by the time you're in finish_resize there is a guest on the dest | 14:53 |
| mriedem | so putting the instance as ACTIVE isn't really valid in that case | 14:53 |
| gibi | mriedem: agree | 14:53 |
| efried | TL;DR: working as designed | 14:53 |
| mriedem | if not designed, | 14:54 |
| mriedem | not a bug really, | 14:54 |
| mriedem | it would really be an RFE i think to make it more robust for rolling back | 14:54 |
| mriedem | if we cared to do that | 14:54 |
| mriedem | b/c rollback is hard | 14:54 |
| gibi | yeah it would be good to know why finish resize failed at the first place | 14:54 |
| gibi | maybe we can avoid that failure | 14:54 |
| bauzas | what exactly does finish_resize ? | 14:55 |
| bauzas | sorry for the dumb question, I can read code but I'm old and laz | 14:55 |
| bauzas | lazy* | 14:55 |
| mriedem | i finishes the resize | 14:55 |
| bauzas | \o/ | 14:55 |
| gibi | rambo_li_: could you provide information about the failure during finish resize? | 14:56 |
| mriedem | sets up the disk and starts the guest | 14:56 |
| mriedem | on the dest host | 14:56 |
| sean-k-mooney | bauzas: it cleans up networks on the source node a a few other things | 14:56 |
| rambo_li_ | oh,thank you,I will reconsider it | 14:56 |
| bauzas | ok, I was asking this, because if that's just clean-up, you can still resurrect your instance ? | 14:56 |
| *** longkb has quit IRC | 14:56 | |
| mriedem | it's not cleanup | 14:57 |
| rambo_li_ | when we finish resize ,the instance can't start in dest node | 14:57 |
| mriedem | it's the thing right before the status goes to VERIFY_RESIZE | 14:57 |
| bauzas | ok, nevermind, I'll look | 14:57 |
| mriedem | prep_resize (claim on dest) -> resize_instance (source, transfer disk to dest) -> finish_resize (setup disk on dest, start guest, do db magic) | 14:57 |
| sean-k-mooney | oh ok my bad i tought it was the confirm step after that | 14:57 |
| mriedem | by the time you get to the finish_resize and it fails, you're in trouble | 14:58 |
| efried | Someone should do a flow diagram for that. | 14:58 |
| *** lpetrut has quit IRC | 14:58 | |
| *** vishalmanchanda has quit IRC | 14:58 | |
| mriedem | efried: i've got a dime with your name on it | 14:58 |
| efried | I require a napkin sketch, like last time. | 14:58 |
| mriedem | oh and don't forget about reschedules in the flow diagram :) | 14:58 |
| gibi | we have less than 2 minutes. I think robustifying finish_resize could be a valid feature request | 14:58 |
| mriedem | heh | 14:58 |
| bauzas | mriedem: oh shit, I also confused myself with confirm resize | 14:58 |
| efried | Update on ci-watch: | 14:59 |
| efried | The maintainer of ci-watch.tintri.com is gone and unreachable. | 14:59 |
| efried | But mmedvede has redeployed the code to: http://ciwatch.mmedvede.net/ | 14:59 |
| efried | I have updated the Nova meeting agenda accordingly. | 14:59 |
| mriedem | see i don't know shit about tcp consoles, but i know how the resize flow works | 14:59 |
| gibi | efried: thanks | 14:59 |
| gibi | we have to close the meeting in seconds. | 14:59 |
| rambo_li_ | ok,last one, I find it is important that live-resize the instance in production environment. We have talked it many years and we agreed this in Rocky PTG, then the author remove the spec to Stein, but there is no information about this spec, is there anyone to push the spec and achieve it? The link:https://review.openstack.org/#/c/141219/ | 14:59 |
| gibi | let's continue on #openstack-nova | 14:59 |
| gibi | #endmeeting | 15:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:00 | |
| openstack | Meeting ended Thu Nov 29 15:00:05 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/nova/2018/nova.2018-11-29-14.00.html | 15:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/nova/2018/nova.2018-11-29-14.00.txt | 15:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/nova/2018/nova.2018-11-29-14.00.log.html | 15:00 |
| gmann | thanks gibi | 15:00 |
| *** redrobot has joined #openstack-meeting | 15:00 | |
| mriedem | rambo_li_: please ask in #openstack-nova | 15:00 |
| rambo_li_ | ok | 15:00 |
| mriedem | rambo_li_: btw, are you ji lie from unitedstack? | 15:01 |
| cdent | thanks gibi | 15:01 |
| mriedem | *li jie | 15:01 |
| rambo_li_ | yeah | 15:01 |
| rambo_li_ | thank you for the rebuild spec | 15:02 |
| mriedem | yw | 15:02 |
| rambo_li_ | matt | 15:02 |
| mriedem | i was looking for you on wechat but didn't know your nickname | 15:02 |
| rambo_li_ | rambo_li | 15:02 |
| rambo_li_ | or you can send email to lijie@unitedstack.com | 15:03 |
| mriedem | ok | 15:03 |
| *** takashin has left #openstack-meeting | 15:03 | |
| * fungi is around for the security sig meeting (are we holding one this week?) but also in tc office hour right now as usual | 15:03 | |
| *** Luzi has quit IRC | 15:04 | |
| *** cdent has left #openstack-meeting | 15:04 | |
| *** hongbin has joined #openstack-meeting | 15:05 | |
| *** rambo_li_ has quit IRC | 15:07 | |
| *** LiangFang has quit IRC | 15:08 | |
| *** georgh has quit IRC | 15:08 | |
| *** mjturek has quit IRC | 15:10 | |
| *** sean-k-mooney has left #openstack-meeting | 15:11 | |
| *** mjturek has joined #openstack-meeting | 15:11 | |
| *** yamahata has joined #openstack-meeting | 15:19 | |
| *** whoami-rajat has joined #openstack-meeting | 15:21 | |
| *** jangutter has left #openstack-meeting | 15:23 | |
| *** yamahata has quit IRC | 15:26 | |
| *** cloudrancher has quit IRC | 15:27 | |
| *** cloudrancher has joined #openstack-meeting | 15:27 | |
| *** mriedem is now known as mriedem_afk | 15:29 | |
| *** kopecmartin is now known as kopecmartin|afk | 15:32 | |
| *** ttsiouts has quit IRC | 15:32 | |
| *** ttsiouts has joined #openstack-meeting | 15:33 | |
| *** shrasool has quit IRC | 15:36 | |
| *** ttsiouts has quit IRC | 15:37 | |
| *** erlon has quit IRC | 15:46 | |
| *** ttsiouts has joined #openstack-meeting | 15:52 | |
| *** munimeha1 has joined #openstack-meeting | 15:53 | |
| *** gagehugo has joined #openstack-meeting | 15:56 | |
| *** aojea has quit IRC | 15:59 | |
| *** gagehugo has left #openstack-meeting | 16:00 | |
| *** dklyle has joined #openstack-meeting | 16:01 | |
| *** jamesmcarthur has joined #openstack-meeting | 16:05 | |
| *** jamesmcarthur has quit IRC | 16:10 | |
| *** mriedem_afk is now known as mriedem | 16:22 | |
| *** janki has quit IRC | 16:24 | |
| *** e0ne has quit IRC | 16:26 | |
| *** armax has joined #openstack-meeting | 16:37 | |
| *** e0ne has joined #openstack-meeting | 16:38 | |
| *** e0ne has quit IRC | 16:48 | |
| *** ttsiouts has quit IRC | 16:51 | |
| *** ttsiouts has joined #openstack-meeting | 16:52 | |
| *** ttsiouts has quit IRC | 16:56 | |
| *** mjturek has quit IRC | 16:56 | |
| *** mjturek has joined #openstack-meeting | 17:00 | |
| *** cloudrancher has quit IRC | 17:01 | |
| *** mjturek has quit IRC | 17:01 | |
| *** cloudrancher has joined #openstack-meeting | 17:02 | |
| *** david-lyle has joined #openstack-meeting | 17:04 | |
| *** dklyle has quit IRC | 17:05 | |
| *** helenafm has quit IRC | 17:06 | |
| *** gyee has joined #openstack-meeting | 17:09 | |
| *** jamesmcarthur has joined #openstack-meeting | 17:24 | |
| *** mdbooth_ has joined #openstack-meeting | 17:28 | |
| *** dmacpher has quit IRC | 17:30 | |
| *** mjturek has joined #openstack-meeting | 17:31 | |
| *** mdbooth has quit IRC | 17:31 | |
| *** mdbooth_ has quit IRC | 17:32 | |
| *** mjturek has quit IRC | 17:38 | |
| *** mjturek has joined #openstack-meeting | 17:39 | |
| *** iyamahat_ has joined #openstack-meeting | 18:04 | |
| *** yamahata has joined #openstack-meeting | 18:05 | |
| *** bobh has quit IRC | 18:12 | |
| *** david-lyle has quit IRC | 18:15 | |
| *** iyamahat__ has joined #openstack-meeting | 18:15 | |
| *** iyamahat_ has quit IRC | 18:18 | |
| *** jamesmcarthur has quit IRC | 18:24 | |
| *** diablo_rojo has joined #openstack-meeting | 18:31 | |
| *** bdperkin has quit IRC | 18:32 | |
| *** kopecmartin|afk is now known as mkopec|off | 18:45 | |
| *** mkopec|off is now known as kopecmartin|off | 18:45 | |
| *** dklyle has joined #openstack-meeting | 18:45 | |
| *** lpetrut has joined #openstack-meeting | 18:58 | |
| *** iyamahat__ has quit IRC | 19:07 | |
| *** dklyle has quit IRC | 19:07 | |
| *** iyamahat__ has joined #openstack-meeting | 19:10 | |
| *** electrofelix has quit IRC | 19:12 | |
| *** iyamahat_ has joined #openstack-meeting | 19:13 | |
| *** iyamahat__ has quit IRC | 19:17 | |
| *** cloudrancher has quit IRC | 19:19 | |
| *** francois has quit IRC | 19:19 | |
| *** cloudrancher has joined #openstack-meeting | 19:19 | |
| *** francois has joined #openstack-meeting | 19:20 | |
| *** sridharg has quit IRC | 19:25 | |
| *** shrasool has joined #openstack-meeting | 19:26 | |
| *** _pewp_ has quit IRC | 19:33 | |
| *** bdperkin has joined #openstack-meeting | 19:33 | |
| *** _hemna has quit IRC | 19:33 | |
| *** markvoelker has joined #openstack-meeting | 19:36 | |
| *** jamesmcarthur has joined #openstack-meeting | 19:37 | |
| *** markvoelker has quit IRC | 19:40 | |
| *** dtrainor has quit IRC | 19:41 | |
| *** mjturek has quit IRC | 19:44 | |
| *** mjturek has joined #openstack-meeting | 19:45 | |
| *** dtrainor has joined #openstack-meeting | 19:48 | |
| *** shrasool has quit IRC | 19:48 | |
| *** shrasool has joined #openstack-meeting | 19:49 | |
| *** jamesmcarthur has quit IRC | 19:50 | |
| *** shrasool has quit IRC | 19:51 | |
| *** jamesmcarthur has joined #openstack-meeting | 19:52 | |
| *** mjturek has quit IRC | 19:54 | |
| *** mjturek has joined #openstack-meeting | 19:55 | |
| *** mjturek has quit IRC | 19:56 | |
| *** whoami-rajat has quit IRC | 19:56 | |
| *** markvoelker has joined #openstack-meeting | 20:00 | |
| *** jamesmcarthur has quit IRC | 20:00 | |
| *** mjturek has joined #openstack-meeting | 20:01 | |
| *** mjturek has quit IRC | 20:07 | |
| *** slaweq has quit IRC | 20:11 | |
| *** mjturek has joined #openstack-meeting | 20:14 | |
| *** ralonsoh has quit IRC | 20:16 | |
| *** shrasool has joined #openstack-meeting | 20:18 | |
| *** shrasool has quit IRC | 20:19 | |
| *** e0ne has joined #openstack-meeting | 20:20 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:25 | |
| *** jamesmcarthur has quit IRC | 20:29 | |
| *** e0ne has quit IRC | 20:30 | |
| *** slaweq has joined #openstack-meeting | 20:32 | |
| *** radeks has quit IRC | 20:34 | |
| *** radeks has joined #openstack-meeting | 20:34 | |
| *** _pewp_ has joined #openstack-meeting | 20:43 | |
| *** _hemna has joined #openstack-meeting | 20:43 | |
| *** mjturek has quit IRC | 20:49 | |
| *** raildo has quit IRC | 20:50 | |
| *** raildo has joined #openstack-meeting | 20:51 | |
| *** raildo has quit IRC | 20:51 | |
| *** mjturek has joined #openstack-meeting | 20:52 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:53 | |
| *** hongbin_ has joined #openstack-meeting | 21:09 | |
| *** hongbin_ has quit IRC | 21:09 | |
| *** hongbin has quit IRC | 21:10 | |
| *** hongbin has joined #openstack-meeting | 21:10 | |
| *** dklyle has joined #openstack-meeting | 21:10 | |
| *** mjturek has quit IRC | 21:15 | |
| *** diman has quit IRC | 21:24 | |
| *** yamamoto has quit IRC | 21:26 | |
| *** cloudrancher has quit IRC | 21:34 | |
| *** cloudrancher has joined #openstack-meeting | 21:35 | |
| *** markvoelker has quit IRC | 21:38 | |
| *** markvoelker has joined #openstack-meeting | 21:38 | |
| *** dklyle has quit IRC | 21:39 | |
| *** markvoelker has quit IRC | 21:43 | |
| *** jamesmcarthur has quit IRC | 21:48 | |
| *** jamesmcarthur has joined #openstack-meeting | 21:48 | |
| *** awaugama has quit IRC | 21:49 | |
| *** radeks has quit IRC | 21:52 | |
| *** rcernin has joined #openstack-meeting | 21:57 | |
| *** markvoelker has joined #openstack-meeting | 22:01 | |
| *** jamesmcarthur has quit IRC | 22:03 | |
| *** yamamoto has joined #openstack-meeting | 22:06 | |
| *** manjeets has quit IRC | 22:15 | |
| *** yamamoto has quit IRC | 22:18 | |
| *** dklyle has joined #openstack-meeting | 22:19 | |
| *** dklyle has quit IRC | 22:24 | |
| *** manjeets has joined #openstack-meeting | 22:28 | |
| *** manjeets has quit IRC | 22:29 | |
| *** manjeets has joined #openstack-meeting | 22:29 | |
| *** dklyle has joined #openstack-meeting | 22:32 | |
| *** mriedem is now known as mriedem_afk | 22:33 | |
| *** slaweq has quit IRC | 22:41 | |
| *** tpsilva has quit IRC | 22:43 | |
| *** dklyle has quit IRC | 22:44 | |
| *** slaweq has joined #openstack-meeting | 22:53 | |
| *** slaweq has quit IRC | 22:57 | |
| *** lpetrut has quit IRC | 23:07 | |
| *** artom has quit IRC | 23:08 | |
| *** artom has joined #openstack-meeting | 23:09 | |
| *** artom has quit IRC | 23:09 | |
| *** artom has joined #openstack-meeting | 23:09 | |
| *** artom has quit IRC | 23:10 | |
| *** artom has joined #openstack-meeting | 23:10 | |
| *** dhellmann_ has joined #openstack-meeting | 23:26 | |
| *** dhellmann has quit IRC | 23:26 | |
| *** number80 has quit IRC | 23:27 | |
| *** dhellmann_ is now known as dhellmann | 23:30 | |
| *** erlon has joined #openstack-meeting | 23:45 | |
| *** manjeets has quit IRC | 23:46 | |
| *** manjeets has joined #openstack-meeting | 23:46 | |
| *** munimeha1 has quit IRC | 23:50 | |
| *** number80 has joined #openstack-meeting | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!