Monday, 2018-04-30

*** dpawlik has joined #openstack-nova00:06
*** dpawlik has quit IRC00:10
*** dpawlik has joined #openstack-nova00:11
*** dpawlik has quit IRC00:21
*** salv-orlando has joined #openstack-nova00:23
*** dpawlik has joined #openstack-nova00:26
*** salv-orlando has quit IRC00:27
*** edmondsw has joined #openstack-nova00:28
*** edmondsw has quit IRC00:33
*** vic-wu has quit IRC00:50
*** dpawlik has quit IRC00:50
*** dpawlik has joined #openstack-nova00:51
*** yamamoto has joined #openstack-nova00:59
*** yamamoto has quit IRC01:04
*** dtantsur|afk has quit IRC01:08
*** dtantsur has joined #openstack-nova01:08
*** dpawlik has quit IRC01:10
*** dpawlik has joined #openstack-nova01:11
*** dpawlik has quit IRC01:15
*** liverpooler has joined #openstack-nova01:16
*** dpawlik has joined #openstack-nova01:21
*** salv-orlando has joined #openstack-nova01:23
*** dpawlik has quit IRC01:25
*** yamahata has joined #openstack-nova01:26
*** dpawlik has joined #openstack-nova01:26
*** salv-orlando has quit IRC01:28
*** krtaylor has quit IRC01:32
*** hongbin has joined #openstack-nova01:41
*** dpawlik has quit IRC01:50
*** dpawlik has joined #openstack-nova01:56
*** dpawlik has quit IRC02:00
*** yamamoto has joined #openstack-nova02:00
*** dpawlik has joined #openstack-nova02:01
*** yamamoto has quit IRC02:05
*** liverpooler has quit IRC02:05
*** dpawlik has quit IRC02:10
*** dpawlik has joined #openstack-nova02:11
*** edmondsw has joined #openstack-nova02:16
*** edmondsw has quit IRC02:21
*** dougshelley66 has quit IRC02:23
*** salv-orlando has joined #openstack-nova02:24
*** dpawlik has quit IRC02:25
*** dpawlik has joined #openstack-nova02:26
*** hongbin_ has joined #openstack-nova02:28
*** salv-orlando has quit IRC02:28
*** dpawlik has quit IRC02:30
*** hongbin has quit IRC02:31
*** dpawlik has joined #openstack-nova02:31
*** spsurya has joined #openstack-nova02:38
*** dpawlik has quit IRC02:40
*** dpawlik has joined #openstack-nova02:41
*** vivsoni__ has quit IRC02:47
*** namnh has joined #openstack-nova02:55
*** armaan has joined #openstack-nova03:00
*** dpawlik has quit IRC03:00
*** dpawlik has joined #openstack-nova03:01
*** yamamoto has joined #openstack-nova03:01
*** namnh has quit IRC03:02
*** yamamoto has quit IRC03:06
*** slaweq has joined #openstack-nova03:08
*** slaweq has quit IRC03:12
*** vivsoni has joined #openstack-nova03:15
*** salv-orlando has joined #openstack-nova03:25
*** sree has joined #openstack-nova03:26
*** dpawlik has quit IRC03:30
*** salv-orlando has quit IRC03:30
*** dpawlik has joined #openstack-nova03:31
*** dpawlik has quit IRC03:41
*** dpawlik has joined #openstack-nova03:41
*** udesale has joined #openstack-nova03:41
*** vivsoni has quit IRC03:46
*** dpawlik has quit IRC03:50
*** dikonoor has joined #openstack-nova03:51
*** dpawlik has joined #openstack-nova03:56
*** dpawlik has quit IRC04:00
*** dpawlik has joined #openstack-nova04:01
*** yamamoto has joined #openstack-nova04:02
*** dpawlik has quit IRC04:05
*** armaan has quit IRC04:05
*** dpawlik has joined #openstack-nova04:06
*** vivsoni has joined #openstack-nova04:07
*** yamamoto has quit IRC04:08
*** yamahata has quit IRC04:18
*** hongbin_ has quit IRC04:22
*** sridharg has joined #openstack-nova04:23
*** ratailor has joined #openstack-nova04:23
*** dpawlik has quit IRC04:25
*** salv-orlando has joined #openstack-nova04:26
*** dpawlik has joined #openstack-nova04:26
*** FoXMaN has quit IRC04:27
*** pooja_jadhav has joined #openstack-nova04:30
*** salv-orlando has quit IRC04:30
*** FoXMaN has joined #openstack-nova04:33
*** dpawlik has quit IRC04:35
*** dpawlik has joined #openstack-nova04:36
*** namnh has joined #openstack-nova04:36
*** namnh has quit IRC04:36
*** namnh has joined #openstack-nova04:37
*** links has joined #openstack-nova04:39
*** dpawlik has quit IRC04:40
*** dpawlik has joined #openstack-nova04:41
*** namnh has quit IRC04:41
*** dpawlik has quit IRC04:45
*** dpawlik has joined #openstack-nova04:46
*** dpawlik has quit IRC04:50
*** dpawlik has joined #openstack-nova04:51
*** namnh has joined #openstack-nova04:52
*** namnh has quit IRC04:56
*** dpawlik has quit IRC05:00
*** dpawlik has joined #openstack-nova05:01
*** Eran_Kuris has joined #openstack-nova05:04
*** yamamoto has joined #openstack-nova05:04
*** yamamoto has quit IRC05:08
*** cfriesen has joined #openstack-nova05:09
*** _pewp_ has quit IRC05:10
*** dpawlik has quit IRC05:10
*** _pewp_ has joined #openstack-nova05:11
*** jaosorior has joined #openstack-nova05:12
*** Eran_Kuris has quit IRC05:13
*** dpawlik has joined #openstack-nova05:16
*** Eran_Kuris has joined #openstack-nova05:17
*** dpawlik has quit IRC05:20
*** dpawlik has joined #openstack-nova05:21
*** dpawlik has quit IRC05:25
*** dpawlik has joined #openstack-nova05:26
*** salv-orlando has joined #openstack-nova05:26
*** cfriesen has quit IRC05:30
*** salv-orlando has quit IRC05:31
*** namnh has joined #openstack-nova05:33
*** belmoreira has joined #openstack-nova05:36
*** namnh has quit IRC05:38
*** masber has joined #openstack-nova05:41
*** dpawlik has quit IRC05:45
*** janki has joined #openstack-nova05:51
*** evin has quit IRC05:51
*** masuberu has joined #openstack-nova05:51
*** edmondsw has joined #openstack-nova05:53
*** masber has quit IRC05:55
*** cfriesen has joined #openstack-nova05:56
*** edmondsw has quit IRC05:58
*** masuberu has quit IRC06:02
*** yamamoto has joined #openstack-nova06:05
*** moshele has joined #openstack-nova06:06
*** slaweq has joined #openstack-nova06:08
*** yamamoto has quit IRC06:11
*** dpawlik has joined #openstack-nova06:11
*** cfriesen has quit IRC06:14
*** cfriesen has joined #openstack-nova06:14
*** cfriesen_ has joined #openstack-nova06:15
*** cfriesen has quit IRC06:15
*** cfriesen__ has joined #openstack-nova06:15
*** cfriesen_ has quit IRC06:20
*** evin has joined #openstack-nova06:20
*** cfriesen has joined #openstack-nova06:22
*** cfriesen__ has quit IRC06:22
*** salv-orlando has joined #openstack-nova06:27
*** cfriesen has quit IRC06:30
*** salv-orlando has quit IRC06:32
*** namnh has joined #openstack-nova06:35
*** dpawlik has quit IRC06:36
*** namnh has quit IRC06:41
*** dpawlik has joined #openstack-nova06:41
*** dpawlik has quit IRC06:45
*** dpawlik has joined #openstack-nova06:46
*** do3meli has joined #openstack-nova06:48
*** dpawlik has quit IRC06:50
*** dpawlik has joined #openstack-nova06:51
*** namnh has joined #openstack-nova06:57
*** armaan has joined #openstack-nova06:59
*** bkopilov_ has joined #openstack-nova07:01
*** namnh has quit IRC07:02
*** yamamoto has joined #openstack-nova07:06
*** Guest1988 has joined #openstack-nova07:11
*** ccamacho has joined #openstack-nova07:11
*** yamamoto has quit IRC07:13
*** spsurya has quit IRC07:14
*** Guest1988 has quit IRC07:17
*** namnh has joined #openstack-nova07:17
*** namnh has quit IRC07:21
*** bkopilov_ has quit IRC07:26
*** salv-orlando has joined #openstack-nova07:28
*** ragiman_ has joined #openstack-nova07:32
*** salv-orlando has quit IRC07:33
*** amoralej|off is now known as amoralej07:38
*** hoonetorg has quit IRC07:41
*** sree has quit IRC07:41
*** edmondsw has joined #openstack-nova07:42
*** sree has joined #openstack-nova07:42
*** sree has quit IRC07:47
*** edmondsw has quit IRC07:47
*** lucas-afk is now known as lucasagomes07:54
*** hoonetorg has joined #openstack-nova07:55
*** moshele has quit IRC08:00
*** moshele has joined #openstack-nova08:02
*** namnh has joined #openstack-nova08:05
*** moshele has quit IRC08:06
*** yamamoto has joined #openstack-nova08:08
*** namnh has quit IRC08:09
*** sree has joined #openstack-nova08:12
*** yamamoto has quit IRC08:14
*** mdbooth has joined #openstack-nova08:14
*** sree has quit IRC08:17
*** mdnadeem has joined #openstack-nova08:24
*** sree has joined #openstack-nova08:27
*** derekh has joined #openstack-nova08:29
*** salv-orlando has joined #openstack-nova08:29
*** sree has quit IRC08:31
*** salv-orlando has quit IRC08:33
*** namnh has joined #openstack-nova08:35
*** jogo has quit IRC08:35
*** namnh has quit IRC08:39
*** nmathew has joined #openstack-nova08:41
*** sree has joined #openstack-nova08:48
*** salv-orlando has joined #openstack-nova08:51
*** sree has quit IRC08:52
*** moshele has joined #openstack-nova08:55
*** moshele has quit IRC08:56
*** namnh has joined #openstack-nova08:56
*** moshele has joined #openstack-nova08:56
*** sree has joined #openstack-nova08:58
*** jogo has joined #openstack-nova09:00
*** namnh has quit IRC09:01
*** spsurya has joined #openstack-nova09:01
*** sree has quit IRC09:02
*** ratailor has quit IRC09:07
*** sree has joined #openstack-nova09:08
*** yamamoto has joined #openstack-nova09:10
*** namnh has joined #openstack-nova09:10
*** ratailor has joined #openstack-nova09:12
*** tssurya has joined #openstack-nova09:12
*** sree has quit IRC09:13
*** namnh has quit IRC09:15
*** ratailor_ has joined #openstack-nova09:15
*** yamamoto has quit IRC09:16
*** ratailor has quit IRC09:17
*** sree has joined #openstack-nova09:19
*** namnh has joined #openstack-nova09:25
*** sree has quit IRC09:28
*** tianhui has quit IRC09:28
*** tianhui has joined #openstack-nova09:28
*** nmathew has quit IRC09:29
*** owalsh_ is now known as owalsh09:33
*** sree has joined #openstack-nova09:37
*** sdague has joined #openstack-nova09:39
*** sree has quit IRC09:41
*** sree has joined #openstack-nova09:48
*** sree has quit IRC09:52
*** sridharg has quit IRC09:55
*** sridharg has joined #openstack-nova09:57
*** tobasco is now known as tobasco-afk10:11
*** armaan has quit IRC10:12
*** yamamoto has joined #openstack-nova10:12
*** armaan has joined #openstack-nova10:12
*** armaan has quit IRC10:12
*** moshele has quit IRC10:13
openstackgerritfupingxie proposed openstack/nova master: Update the parameter explain when update a volume attachment  https://review.openstack.org/56518110:14
*** salv-orlando has quit IRC10:17
*** salv-orlando has joined #openstack-nova10:17
*** yamamoto has quit IRC10:17
openstackgerritRadoslav Gerganov proposed openstack/nova master: Handle PortNotFoundClient exception when getting ports  https://review.openstack.org/56518310:20
*** salv-orlando has quit IRC10:22
*** wolverineav has joined #openstack-nova10:27
*** nicolasbock has joined #openstack-nova10:30
kashyaplyarwood: Et al, we also need this to be backported (all the way to Ocata) -- https://review.openstack.org/#/c/565043/10:30
kashyap(The upstream change is not merged yet; but it's straightfoward)10:30
*** mdbooth has quit IRC10:32
openstackgerritMerged openstack/nova master: Make service all-cells min version helper use scatter-gather  https://review.openstack.org/53959010:36
lyarwoodkashyap: kk, why are you using the bp/ topic for these bug fixes and a bug/ topic for the original change?10:36
openstackgerritMerged openstack/nova master: Make host_manager use scatter-gather and ignore down cells  https://review.openstack.org/53961710:36
kashyaplyarwood: Right, I'll rename it; so that it's all under the same topic10:36
kashyaplyarwood: Do you have a minute more?10:36
kashyaplyarwood: I think I messed up something (unrelated to branch naming) :-(10:37
kashyapSee here: https://review.openstack.org/#/q/topic:bp/libvirt-cpu-model-extra-flags+(status:open+OR+status:merged)10:37
lyarwoodkashyap: https://review.openstack.org/#/c/563926/ & https://review.openstack.org/#/c/565044/ are duplicates right?10:37
lyarwoodkashyap: yeah10:37
kashyaplyarwood: Allow me to explain how I arrived there:10:37
openstackgerritStephen Finucane proposed openstack/nova-specs master: Add 'numa-aware-vswitches' spec  https://review.openstack.org/54129010:38
kashyaplyarwood: I made the casing patch, and on *top* of it, applied the "lift restrictions" patch.10:38
kashyaplyarwood: Could I have done anything cleaner?10:38
kashyaplyarwood: The first variant https://review.openstack.org/#/c/563926/ had 8 revisions.  Now I will "lose" them (or I'll simply link to it from the other)10:39
lyarwoodkashyap: AFAICT you changed the change-id causing gerrit to create a new review10:39
lyarwoodkashyap: you can close out the new review and just rebase the case-insensitive change on top of the old one10:40
kashyaplyarwood: Right10:40
kashyapI'm doing to do that now10:40
kashyapThanks!10:40
*** namnh has quit IRC10:44
*** dougshelley66 has joined #openstack-nova10:52
kashyaplyarwood: Pease remind me again, I think it's okay to include "Closes-Bug" tag on two Gerrit patches, right?10:52
kashyap(I often see "Related-Bug" on several patches, though10:52
kashyap)10:52
lyarwoodkashyap: I *think* that's okay yeah10:53
lyarwoodkashyap: maybe Related-Bug on the first?10:53
*** tbachman has quit IRC10:53
kashyaplyarwood: You mean, add the Related-Bug on the casing patch?10:53
kashyap(Which is the "first" patch in this 2-patch series)10:54
lyarwoodkashyap: yeah10:54
*** ratailor__ has joined #openstack-nova10:54
kashyaplyarwood: Okido; I'll do that.  Gracias10:54
*** ratailor__ has quit IRC10:54
*** ratailor has joined #openstack-nova10:55
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Make `cpu_model_extra_flags` case-insensitive for real  https://review.openstack.org/56504310:55
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Lift the restriction of choices for `cpu_model_extra_flags`  https://review.openstack.org/56392610:55
*** ratailor_ has quit IRC10:56
*** ratailor_ has joined #openstack-nova10:58
*** tobasco-afk is now known as tobasco10:58
*** ratailor has quit IRC11:00
kashyaplyarwood: Done.  Mind ACKing this, since you have context too: https://review.openstack.org/#/c/565043/11:01
*** mdbooth has joined #openstack-nova11:03
*** lucasagomes is now known as lucas-hungry11:04
*** namnh has joined #openstack-nova11:05
*** armaan has joined #openstack-nova11:09
*** namnh has quit IRC11:09
*** moshele has joined #openstack-nova11:10
*** Eran_Kuris has quit IRC11:10
*** mdbooth has quit IRC11:11
*** yamamoto has joined #openstack-nova11:14
*** aloga has quit IRC11:14
*** yamamoto has quit IRC11:19
*** namnh has joined #openstack-nova11:26
*** dave-mccowan has joined #openstack-nova11:27
*** namnh has quit IRC11:30
*** dave-mccowan has quit IRC11:31
*** dave-mcc_ has joined #openstack-nova11:31
*** mvk has quit IRC11:32
*** dougshelley66 has quit IRC11:35
*** yamamoto has joined #openstack-nova11:39
*** sridharg has quit IRC11:40
*** namnh has joined #openstack-nova11:42
*** ratailor__ has joined #openstack-nova11:43
*** ratailor_ has quit IRC11:46
*** artom has quit IRC11:51
*** amoralej is now known as amoralej|lunch11:55
*** lucas-hungry is now known as lucasagomes11:57
*** Eran_Kuris has joined #openstack-nova11:58
*** sridharg has joined #openstack-nova11:59
*** sdeath has quit IRC12:02
*** Eran_Kuris has quit IRC12:03
*** bhujay has joined #openstack-nova12:04
*** edmondsw has joined #openstack-nova12:07
*** dougshelley66 has joined #openstack-nova12:10
*** liverpooler has joined #openstack-nova12:16
*** liverpooler has quit IRC12:16
*** liverpooler has joined #openstack-nova12:16
*** mdbooth has joined #openstack-nova12:21
*** Eran_Kuris has joined #openstack-nova12:21
*** namnh has quit IRC12:22
*** namnh has joined #openstack-nova12:24
efriedō/12:24
*** yamamoto has quit IRC12:25
*** yamamoto has joined #openstack-nova12:26
*** mvk has joined #openstack-nova12:28
*** namnh has quit IRC12:28
*** sdeath has joined #openstack-nova12:31
*** pchavva has joined #openstack-nova12:31
*** tbachman has joined #openstack-nova12:34
*** amoralej|lunch is now known as amoralej12:36
bauzasefried: you can remove your hat12:38
efriedbauzas: It's my crew cut12:38
bauzaswell, I'm 37 and my hairs become to leave me, so should I do something like °o/ ?12:39
*** jaosorior has quit IRC12:43
*** mchlumsky has joined #openstack-nova12:44
*** vladikr has joined #openstack-nova12:49
*** finucannot is now known as stephenfin12:54
zzzeek_jaypipes: mysql question.   does SELECT * FROM (SELECT x, y FROM a) AS a_alias JOIN b ON a_alias.x=b.y FOR UPDATE    , lock both "a", and "b" ?12:55
jaypipeszzzeek_: it will lock all the rows in a and b that join on x = y, yes12:58
zzzeek_jaypipes: that's great news got a user claims it is not12:58
jaypipeszzzeek_: what version of MySQL?12:59
zzzeek_jaypipes: hmm12:59
*** gouthamr has quit IRC12:59
zzzeek_jaypipes: would have to ask12:59
jaypipeszzzeek_: not that that should matter... I think that is the behaviour for at least since 4.012:59
zzzeek_jaypipes: OK he says "I noticed a different issue when using joinedload and with_for_update in Mysql with a REPEATABLE READ isolation level. In my case, it seems that the with_for_update only locked the joinedtable because the FOR UPDATE statement is only applied to the joinedtable - the root table is not locked because it is queried via the subselect. " but I'm going to ask him to further define how he knows this is the case13:00
zzzeek_jaypipes: if i had to move the FOR UPDATE around in the query it would really ruin my day :)13:00
jaypipeszzzeek_: ask if both sides of the join condition are indexed.13:01
zzzeek_jaypipes: ok13:01
zzzeek_jaypipes: does it only lock indexed rows ?13:01
jaypipes"For index records the search encounters, locks the rows and any associated index entries, the same as if you issued an UPDATE statement for those rows. Other transactions are blocked from updating those rows"13:02
jaypipeszzzeek_: seems so, yes.13:02
*** gouthamr has joined #openstack-nova13:02
jaypipeszzzeek_: though that wording is a tad vague, would you agree?13:03
zzzeek_jaypipes: yes, what is an "index record"?  does that mean the WHERE clause has to refer to an indexed column ?13:03
zzzeek_jaypipes: seems like it means, for any row that is part of an index.  which is every row if you have a primary key13:03
jaypipeszzzeek_: sounds to me like it means that the columns referenced in the JOIN condition (ON clause or WHERE <join table references>) need to be indexed.13:04
zzzeek_jaypipes: hmmmmm13:05
jaypipeszzzeek_: but it's vague. it almost sounds like it's just saying that reads of both data (clustered index) and index pages (secondary indexes) are locked13:05
zzzeek_jaypipes: otherwise you think we are getting rows back where not all tables are locked?  that seems so unintuitive b.c. you would think it locks everthing thats in the row13:05
*** READ10 has joined #openstack-nova13:05
zzzeek_guess we'd have to test it.  blah13:05
jaypipes:)13:06
zzzeek_how you do even test locking on MySQL :)   it has such wierd behavior13:06
*** eharney has joined #openstack-nova13:06
kashyapzzzeek_: I think jaypipes just tries it on production users ;-)13:06
* kashyap ducks13:06
zzzeek_well, repeatable read.   guess i can try a concurrent update against "a" selecvted alone, vs "a" selected in the subquery13:06
kashyapBut more seriously, /me is glad with all these *SQL experts, self can't do beyond 101 stuff13:06
zzzeek_can't beat a job that pays me to just sit around and know things13:07
*** mchlumsky has quit IRC13:07
jaypipeszzzeek_: for the record, postgresql's select for update docs are virtually identical.13:07
zzzeek_jaypipes: yes, but w/ pg we dont get shenanigans like this13:07
jaypipeszzzeek_: how do you know? :)13:07
zzzeek_jaypipes: its postgresql!   it's a crystalline structure of timeless perfection!13:08
jaypipeshehe13:08
zzzeek_when you find an ingenious feature of postgresql, and ask, "when was this developed?", the answer is: never.   all PGs features exist outside of time-space13:08
*** mchlumsky has joined #openstack-nova13:09
*** salv-orlando has joined #openstack-nova13:09
jaypipeslol :)13:09
zzzeek_like in "Interstellar"13:09
jaypipesit does actually seem like PG has a similar behaviour with regards to indexing.13:09
zzzeek_jaypipes: meaning, you can't lock a row that doesnt refer to index columns?13:10
*** salv-orlando has quit IRC13:10
*** salv-orlando has joined #openstack-nova13:10
jaypipeszzzeek_: "FOR UPDATE and FOR SHARE cannot be used in contexts where returned rows cannot be clearly identified with individual table rows;"13:10
jaypipeszzzeek_: which makes sense, kinda.13:10
jaypipeszzzeek_: if you can't identify a particular record with a condition, then you shouldn't be able to lock it.13:10
zzzeek_jaypipes: oh.   that may be it then, is mysql making a virtual table out of the subquery?13:11
jaypipeszzzeek_: could be? really would need to chat with this guy and find out what data is in the two tables13:11
jaypipeszzzeek_: could be a weird edge case of some sort.13:11
zzzeek_jaypipes: https://bugs.mysql.com/bug.php?id=3418213:12
zzzeek_jaypipes: oh this is falcon storage engine13:12
jaypipesoh ffs13:12
zzzeek_jaypipes: that bug. let me ask user13:12
jaypipeszzzeek_: note that that bug is describing a different behaviour. that bug is describing when the FOR UPDATE clause appears within the subquery.13:15
zzzeek_jaypipes: ah13:15
jaypipeszzzeek_: and it's also 10 years old :) and the (now irrelevant) falcon storage engine13:15
zzzeek_jaypipes: yep13:15
jaypipeszzzeek_: what's the bug link for SA?13:16
*** mriedem has joined #openstack-nova13:17
zzzeek_jaypipes: https://bitbucket.org/zzzeek/sqlalchemy/issues/4246/compound-query-select-apply-for-update-to13:17
*** awaugama has joined #openstack-nova13:20
*** rmart04 has joined #openstack-nova13:20
*** links has quit IRC13:22
*** ratailor__ has quit IRC13:22
*** jmccarthy has joined #openstack-nova13:23
jaypipeszzzeek_: I wholeheartedly disagree with the Diggsey user in the original 4100 bug.13:24
zzzeek_jaypipes: :) so did I !13:24
zzzeek_jaypipes: this is my life.   non DB folks just complaining all day13:25
jaypipeszzzeek_: heh. yeah, but you're used to it by now.13:26
jmccarthyHi folks ! I believe I'm hitting this here .. but not at all sure where to go with it .. https://bugs.launchpad.net/nova/+bug/159201513:27
openstackLaunchpad bug 1592015 in OpenStack Compute (nova) "libvirt: cleanup of a volume backed instance resize leaves behind the instance directory" [Medium,In progress] - Assigned to Feodor Tersin (ftersin)13:27
jmccarthyBe nice ;)13:28
*** superdan is now known as dansmith13:29
*** evin has quit IRC13:29
jmccarthyIn my case, after cold migration, a disk.info is left behind in old instance dir which doesn't get cleaned up (after verify resize)13:29
jaypipeszzzeek_: aha!13:30
jaypipeszzzeek_: I think I might have found a reason why Julien's particular query is doing what it's doing.13:30
zzzeek_jaypipes: oh yeah13:30
*** armaan has quit IRC13:31
*** esberglu has joined #openstack-nova13:31
*** armaan has joined #openstack-nova13:31
*** belmorei_ has joined #openstack-nova13:31
*** sree has joined #openstack-nova13:31
*** belmoreira has quit IRC13:34
jaypipeszzzeek_: added a comment on the bug above.13:35
mriedemjmccarthy: if you want to take over https://review.openstack.org/#/c/414710/ i could restore it and you could rebase it13:35
mriedemif it fixes the bug13:35
zzzeek_jaypipes: see that's some mysql guru shit right there13:35
*** jroll has quit IRC13:36
mriedemjmccarthy: although it looks like a series https://review.openstack.org/#/q/status:abandoned+topic:disk_snapshots13:36
jaypipeszzzeek_: I believe postgresql will return an error when it sees an expression like that which it knows it cannot determine an effective join condition that can be applied in the read view protection.13:36
mriedemjmccarthy: comment 8 also says this was fixed with an alternative bug https://bugs.launchpad.net/nova/+bug/1666831 in ocata13:37
openstackLaunchpad bug 1666831 in OpenStack Compute (nova) ocata "Nova recreates instance directory after migration/resize" [Low,Fix committed] - Assigned to Lee Yarwood (lyarwood)13:37
mriedemjmccarthy: which release are you on?13:37
zzzeek_jaypipes: not sure about that. that's a standard SQLAlhcemy query13:37
*** lbragstad has joined #openstack-nova13:37
jaypipeszzzeek_: note that the way InnoDB works, the ORDER BY clause is required to generate the gap locks that would act as the read view protection for other transactions.13:38
*** jroll has joined #openstack-nova13:38
zzzeek_jaypipes: ok....well if true this means we'd still need to change the query, but im doing some local testing and not sure if im replicating yet13:38
jaypipeszzzeek_: we should change channel, though :) mriedem will surely be getting antsy :)13:39
zzzeek_jaypipes: sure.13:39
*** armaan has quit IRC13:39
*** armaan has joined #openstack-nova13:39
*** armaan has joined #openstack-nova13:40
jmccarthymriedem: I'm using kolla images built off master13:41
zzzeek_jaypipes: the test script I'm running so far is confirming what he is seeing13:41
*** gouthamr has quit IRC13:42
mriedemjmccarthy: then that sounds like a regression and would be a new bug where you'd have to provide your details, and probably refer to that other bug for context13:42
jmccarthymriedem: Ok, I can look into raising a new bug, I'll check out that alternate - thanks !13:43
jaypipeszzzeek_: moved to #sqlalchemy13:44
jmccarthyOhh ok missed the # in comment 813:45
*** gouthamr has joined #openstack-nova13:45
*** jmlowe_ has quit IRC13:45
*** r-daneel has joined #openstack-nova13:47
*** evin has joined #openstack-nova13:48
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Implement granular policy rules for placement  https://review.openstack.org/52442513:51
openstackgerritMatt Riedemann proposed openstack/nova master: Cleanup placement policy generator docs  https://review.openstack.org/56522513:51
kashyapmriedem: Morning; when you can, want to put this through? -- https://review.openstack.org/#/c/565043/ (libvirt: Make `cpu_model_extra_flags` case-insensitive for real)13:53
jaypipesmriedem: mornin. you ready for a proper review on ^^ or are you still WIP'ing?13:53
kashyap(It needs to be backported all the way back to Ocata)13:53
edleafeScheduler subteam meeting in 5 minutes in #openstack-meeting-alt13:55
*** armaan has quit IRC13:55
*** armaan has joined #openstack-nova13:56
*** burt has joined #openstack-nova13:56
mriedemjaypipes: i need to split it up and add tests yet13:58
*** tomtom001 has quit IRC13:58
*** tomtom001 has joined #openstack-nova13:59
*** ragiman_ has quit IRC14:03
jaypipesmriedem: k. so hold off?14:04
*** ttsiouts_ has joined #openstack-nova14:04
*** hongbin has joined #openstack-nova14:05
mriedemjaypipes: yeah, unless you want to skim, it's mostly mechanical14:05
*** felipemonteiro has joined #openstack-nova14:05
jaypipesmriedem: ack14:06
bauzasefried: jaypipes: hola14:06
*** aloga has joined #openstack-nova14:06
efriedbauzas: yeaux14:06
bauzasefried: jaypipes: looks like we have some transition problem for Pike https://bugs.launchpad.net/tripleo/+bug/176707614:06
openstackLaunchpad bug 1767076 in tripleo "Creating pingtest_sack fails: Failed to schedule instances: NoValidHost_Remote: No valid host was found" [High,Triaged] - Assigned to Quique Llorente (quiquell)14:06
*** sree has quit IRC14:06
bauzastransitive*14:06
bauzasefried: jaypipes: see https://logs.rdoproject.org/openstack-periodic-24hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-pike-upload/7dadafb/overcloud-novacompute-0/var/log/nova/nova-compute.log.txt.gz#_2018-04-25_06_00_40_80914:07
*** felipemonteiro_ has joined #openstack-nova14:07
bauzasefried: jaypipes: I wonder if that's related to https://review.openstack.org/#/c/524263/14:07
*** namnh has joined #openstack-nova14:09
openstackgerritRadoslav Gerganov proposed openstack/nova master: Handle PortNotFoundClient exception when getting ports  https://review.openstack.org/56518314:10
*** felipemonteiro has quit IRC14:11
openstackgerritTakashi NATSUME proposed openstack/nova-specs master: Abort Cold Migration  https://review.openstack.org/33473214:11
*** namnh has quit IRC14:13
*** moshele has quit IRC14:13
jaypipesbauzas: looks like triple-o isn't upgrading placement first.14:15
bauzashow do you know that ?14:15
bauzasI mean, I understand you, I just want to know how to check that14:15
*** cfriesen has joined #openstack-nova14:16
*** janki has quit IRC14:16
*** jchhatbar has joined #openstack-nova14:16
*** jchhatbar has quit IRC14:17
*** jchhatbar has joined #openstack-nova14:17
bauzasjaypipes: mmm, when comparing pike and master, we make now the fact to not see correct aggregates and RPs a blocking stuff https://github.com/openstack/nova/commit/b214dfc41928d9e05199263301f8e5b23555c17014:18
bauzasowalsh: ^14:18
bauzasshit, I need to go find my daughters14:19
*** ragiman_ has joined #openstack-nova14:19
owalshbauzas, jaypipes: don't believe that's an upgrade job14:20
*** sridharg has quit IRC14:20
*** jmlowe has joined #openstack-nova14:21
openstackgerritVladyslav Drok proposed openstack/nova master: ironic: Report resources as reserved when needed  https://review.openstack.org/51792114:21
jaypipesbauzas: having trouble understanding you... I don't see what that patch has to do with a KeyError14:21
*** eharney has quit IRC14:22
bauzasjaypipes: nevermind https://review.openstack.org/#/c/524263/14:22
jaypipesowalsh, bauzas: the reportclient is bombing because it has been upgraded to expect the generation field in the return from placement API. but placement hasn't been upgraded first and so isn't returning the generation field.14:23
bauzasanyway, /me needs to leave14:23
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Drop MIN_LIBVIRT_BLOCK_LM_WITH_VOLUMES_VERSION  https://review.openstack.org/56398414:23
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Drop MIN_LIBVIRT_NUMA_VERSION_PPC  https://review.openstack.org/56401014:23
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Drop BAD_LIBVIRT_NUMA_VERSIONS  https://review.openstack.org/56401114:23
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Drop BAD_LIBVIRT_CPU_POLICY_VERSIONS  https://review.openstack.org/56401214:23
*** dougshelley66 has quit IRC14:28
*** rajinir has joined #openstack-nova14:28
*** mlavalle has joined #openstack-nova14:28
kashyapstephenfin: Since you asked, ^^^ if you want to queue them up.  Two patches already have +2 from MattR; and just addrressed two minor things in the other two patches.14:29
*** armaan has quit IRC14:30
*** armaan has joined #openstack-nova14:31
*** dougshelley66 has joined #openstack-nova14:31
*** hemna_ has joined #openstack-nova14:31
stephenfinkashyap: Can do14:32
kashyapGracias.  I've got 3 more in that same vein, will post them soon.14:33
owalshjaypipes: not sure how that could be, there is no upgrade...14:33
*** Spazmotic has joined #openstack-nova14:34
*** ragiman_ has quit IRC14:35
*** dpawlik has quit IRC14:35
owalshjaypipes: also wouldn't that result in a KeyError?14:35
*** armaan has quit IRC14:35
jaypipesowalsh: sec, on standup14:36
jaypipesowalsh: this is occurring:14:38
jaypipes2018-04-25 05:40:18.617 21167 WARNING nova.scheduler.client.report [req-6b36b888-fa33-4301-aedf-3389020fe8d8 - - - - -] Discovering suitable URL for placement API failed.: DiscoveryFailure: Could not determine a suitable URL for the plugin14:38
jaypipesowalsh: that is the root of the issue, I believe.14:39
jaypipesowalsh: something up with the service catalog discovery of placement maybe?14:39
owalshjaypipes: not up yet...14:39
owalshjaypipes: returning 404s later https://logs.rdoproject.org/openstack-periodic-24hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-pike-upload/7dadafb/overcloud-controller-0/var/log/nova/nova-placement-api.log.txt.gz#_2018-04-25_05_48_32_95614:39
* jaypipes wonders if this is just @safe_connect hiding problems.14:40
*** Spazmotic has quit IRC14:41
jaypipesowalsh: just realized something...14:43
jaypipesowalsh: there is no self._resource_providers object any more. That has been replaced by self._provider_tree.14:43
jaypipesowalsh: lemme look further into this. This is Pike, yeah?14:44
owalshjaypipes: yea, pike14:44
owalshjaypipes: thanks!14:44
jaypipesowalsh: k, thx. gimme a few to track down.14:44
*** jchhatbar has quit IRC14:45
jaypipesowalsh: no, that's not it... we switched to provider_tree in Queens. must be something else. :(14:45
*** ragiman_ has joined #openstack-nova14:47
bauzasjaypipes: owalsh: sorry, I'm back14:50
*** namnh has joined #openstack-nova14:50
bauzasowalsh: jaypipes: I wonder if the root cause is https://logs.rdoproject.org/openstack-periodic-24hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-pike-upload/7dadafb/overcloud-novacompute-0/var/log/nova/nova-compute.log.txt.gz#_2018-04-25_05_40_03_80114:53
bauzasif so, we're not registering the root RP14:53
jaypipesbauzas: https://github.com/openstack/nova/blob/stable/pike/nova/scheduler/client/report.py#L514-L52314:54
jaypipesbauzas: for some reason, we're either not creating or not getting the rp record for the compute node.14:55
*** namnh has quit IRC14:55
jaypipesbauzas: maybe a check for whether rp is None is needed before line 518.14:55
jaypipesbauzas: and raise some exception.14:55
openstackgerritAditya Vaja proposed openstack/nova master: remove IVS plug/unplug as they're moved to separate plugin  https://review.openstack.org/53437114:55
openstackgerritMatthew Booth proposed openstack/nova master: libvirt: Fix misleading debug msg "Instance is running"  https://review.openstack.org/56523414:57
bauzasjaypipes: tbh, I think that if https://github.com/openstack/nova/blob/stable/pike/nova/scheduler/client/report.py#L516 is not working, it's an operator issue14:58
*** zz9pzza has quit IRC14:58
bauzasowalsh: ^14:58
owalshbauzas: ack, yea... don't see any POST requests getting through to placement14:59
bauzasowalsh: see also https://logs.rdoproject.org/openstack-periodic-24hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-pike-upload/7dadafb/overcloud-novacompute-0/var/log/nova/nova-compute.log.txt.gz#_2018-04-25_05_40_03_85415:00
bauzasowalsh: looks like it's a keystone issue15:00
*** beekneemech is now known as bnemec15:00
jaypipesbauzas: @safe_connect is hiding the connection issue.15:00
bauzasowalsh: jaypipes: so, IMHO, when we try to register the root RP (by creating it using the Placement API), we have a keystone problem15:01
bauzasat least a connection problem15:01
bauzasthat's why the root RP is None15:01
jaypipesbauzas: right. and @safe_connect's "only do something if X number of warnings happened" is hiding issues with connectivity. that's what I think at l;east.15:02
bauzasyup15:02
bauzasjaypipes: anyway, thanks for the help15:02
bauzasowalsh: like I said, I think it's not a nova problem15:02
jaypipesnot sure I helped much :)15:02
bauzasowalsh: rather a configuration issue because of the HTTP50315:03
bauzasjaypipes: you did, dude ,)15:03
bauzasjaypipes: I'm a bit said to no longer be a Placement expert15:03
bauzasjaypipes: so having you telling me if I'm right is definitely helping me :)15:04
*** namnh has joined #openstack-nova15:04
*** tbachman has quit IRC15:04
owalshjaypipes, bauzas: thanks guys, helps me a lot if we can rule out placement as the root cause :-)15:05
bauzasowalsh: I think Placement is a canary15:05
*** artom has joined #openstack-nova15:05
bauzaslike we had NoValidHost for something else15:06
owalshbauzas: yea, was just about to say... NoValidHost is the canary15:06
bauzasfortunately, we now have a separate exception15:06
bauzasefried: jaypipes: stephenfin: oh btw. thanks for having reviewed my vGPU series. FWIW, https://twitter.com/sylvainbauza/status/990884997010685953 :)15:07
*** ttsiouts_ has quit IRC15:08
melwittmriedem: I noticed the novaclient change on "Add host/hostId to instance action events API" https://review.openstack.org/#/c/564667 has merged. is everything done for that bp now and time to remove from runway?15:10
mriedemmelwitt: yeah, i marked the bp complete on friday i think, but forgot to remove it from runways15:11
*** zz9pzza has joined #openstack-nova15:11
melwittmriedem: k, cool15:11
*** moshele has joined #openstack-nova15:13
*** tbachman has joined #openstack-nova15:13
*** rmart04 has quit IRC15:15
*** zz9pzza has quit IRC15:15
*** xinliang has quit IRC15:17
*** xinliang has joined #openstack-nova15:17
stephenfinbauzas: :)15:19
*** felipemonteiro_ has quit IRC15:19
*** dpawlik has joined #openstack-nova15:20
*** janki has joined #openstack-nova15:22
*** armaan has joined #openstack-nova15:23
dansmithjaypipes: why are we not migrating the records for allocations that were created before user/project were required?15:23
*** armaan has quit IRC15:24
melwittdansmith: those should be auto-healed right, by compute updates15:24
*** armaan has joined #openstack-nova15:24
dansmithmelwitt: I don't think so15:24
*** dpawlik has quit IRC15:24
melwittdansmith: that was the thinking as to why no migration was added when user/project were added15:25
dansmithmaking them auto-heal is what I mean by migrating15:25
melwittany update to allocations should add user/project if not already existing15:25
dansmithright, but does the reportclient re-write the allocation if just project/user is missing/15:25
dansmithI thought it just counted resources15:25
*** dpawlik has joined #openstack-nova15:26
dansmithreportclient has become too complicated for me to be able to reasonably look I think15:26
jaypipesdansmith: cdent doesn't think user and project should be NOT NULL...15:26
*** dpawlik has quit IRC15:26
dansmithjaypipes: because why?15:26
melwittI'm gonna look again15:27
dansmithjaypipes: I was asking because we're making things nullable to add the consumer generation,15:27
jaypipesdansmith: I'm not sure. he thinks that consumers in placement shouldn't need a project or user. so that placement can be used "for more things than just nova" was his answer.15:27
*** dpawlik has joined #openstack-nova15:27
dansmithjaypipes: but I guess unless we bump the minimum microversion we have to support those continuing to be created15:27
*** dpawlik has quit IRC15:27
jaypipesdansmith: yes, I would like to see those be NOT NULL, but there was stiff resistance from both cdent and edleafe15:27
dansmithjaypipes: user/project is required in later microversions right?15:28
dansmithif clients use older microversions just to get themselves an allocation without user/project, things are going to fall apart pretty quick15:28
jaypipesdansmith: 1.8 added them. 1.12 made them required for allocations.15:29
*** salv-orlando has quit IRC15:29
jaypipesdansmith: yes, I've argued this with both cdent and edleafe.15:29
*** salv-orlando has joined #openstack-nova15:29
dansmithjaypipes: yeah, so not enforcing them in schema because people could be using older microversions is valid, but expecting people to use 1.5 going forward just because the want to create non-multitenant allocations is crazypants15:30
*** fishbone_ has joined #openstack-nova15:32
*** ragiman_ has quit IRC15:33
*** tbachman has quit IRC15:33
jaypipesdansmith: I agree with you.15:33
*** salv-orlando has quit IRC15:34
openstackgerritVladyslav Drok proposed openstack/nova master: ironic: Report resources as reserved when needed  https://review.openstack.org/51792115:34
fishbone_hello all, I receive an error in the instance log when loading windows instances: pywintypes.com_error: (-2147352567, 'Exception occurred.', (0, 'Session', 'Access is denied. ', None, 0, -2147024891), None)15:35
fishbone_My first assumption is updating the cloudbase-init package on the images but would anyone know another possible cause?15:36
*** tbachman has joined #openstack-nova15:37
melwittdansmith: looks like any update of allocations will delete the already existing allocations, so because user/project is required >= 1.8, compute updates should result in ensuring user/project exist for allocations https://github.com/openstack/nova/blob/master/nova/api/openstack/placement/objects/resource_provider.py#L206515:37
dansmithmelwitt: right, but computes don't just update allocations all the time15:38
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Remove support for Intel CMT `perf` events  https://review.openstack.org/56524215:38
melwittokay, I had thought there was a periodic update, but that was temporary right? I think that was happening back when microversion 1.8 was added15:38
*** janki has quit IRC15:39
dansmithmelwitt: we don't heal active instances since ocata15:39
melwittdansmith: okay, I think 1.8 was added in pike. so it sounds like we are missing a migration of already existing instances15:41
*** janki has joined #openstack-nova15:41
dansmithmelwitt: well, it doesn't matter if we're not going to do the needful on the placement side15:41
dansmithI mean, doesn't matter for my question above15:41
dansmithmatters for us using that data for quotas later, but not what I was asking about15:41
* melwitt nods15:42
dansmithhmm, I have op for some reason.. do we need a topic update before I drop it?15:42
*** tbachman has quit IRC15:42
melwittyeah, need to swap a runway15:42
melwittone of them has merged as of friday15:42
dansmithit would help if you could make sure the actual blueprint tag is in the runway description somewhere15:43
dansmithso I can just copy that in and not have to look it up15:43
melwittokay, can do15:43
dansmiths/you/whoever is doing the runway jostling/15:43
*** burt has quit IRC15:43
*** Eran_Kuris has quit IRC15:43
*** janki has quit IRC15:44
*** eharney has joined #openstack-nova15:44
*** janki has joined #openstack-nova15:45
*** dansmith changes topic to "Current runways: xenapi-image-handler-option-improvement / convert-consoles-to-objects / add-zvm-driver-rocky -- This channel is for Nova development. For support of Nova deployments, please use #openstack."15:46
*** ChanServ sets mode: -o dansmith15:46
melwittthanks15:46
dansmithaye15:47
*** ircuser-1 has joined #openstack-nova15:48
*** tbachman has joined #openstack-nova15:48
melwittyikun: fyi, your blueprint add-host-to-instance-action-events has been removed from the review runway as all the related code has merged. please feel free to add feedback about your experience with review runways at L186 https://etherpad.openstack.org/p/nova-runways-rocky15:50
*** tssurya has quit IRC15:52
*** janki has quit IRC15:52
*** sdague has quit IRC15:53
*** janki has joined #openstack-nova15:59
*** moshele has quit IRC16:02
*** dtantsur is now known as dtantsur|afk16:02
*** belmorei_ has quit IRC16:03
*** namnh has quit IRC16:04
*** do3meli has quit IRC16:05
*** namnh has joined #openstack-nova16:06
*** namnh_ has joined #openstack-nova16:07
*** lucasagomes is now known as lucas-hungry16:08
*** namnh has quit IRC16:11
*** felipemonteiro has joined #openstack-nova16:12
*** sree has joined #openstack-nova16:18
*** udesale has quit IRC16:18
*** namnh_ has quit IRC16:22
*** armaan has quit IRC16:22
*** felipemonteiro_ has joined #openstack-nova16:26
*** felipemonteiro has quit IRC16:29
*** itlinux has joined #openstack-nova16:34
openstackgerritAditya Vaja proposed openstack/nova master: remove IVS plug/unplug as they're moved to separate plugin  https://review.openstack.org/53437116:38
*** sree_ has joined #openstack-nova16:41
*** sree_ is now known as Guest4303416:41
*** bhujay has quit IRC16:42
*** sree has quit IRC16:44
*** sree has joined #openstack-nova16:45
*** sdeath has quit IRC16:46
*** felipemonteiro_ has quit IRC16:46
*** Guest43034 has quit IRC16:46
*** felipemonteiro_ has joined #openstack-nova16:46
*** burt has joined #openstack-nova16:54
*** mdnadeem has quit IRC16:55
*** evin has quit IRC16:55
*** mchlumsky has quit IRC16:56
*** armaan has joined #openstack-nova16:57
*** mchlumsky has joined #openstack-nova16:58
openstackgerritJay Pipes proposed openstack/nova-specs master: Standardize CPU resource tracking  https://review.openstack.org/55508117:00
*** derekh has quit IRC17:02
*** mchlumsky_ has joined #openstack-nova17:02
*** mchlumsky has quit IRC17:03
*** spsurya has quit IRC17:04
*** mchlumsky has joined #openstack-nova17:07
*** mchlumsky_ has quit IRC17:07
*** salv-orlando has joined #openstack-nova17:08
jaypipesstephenfin: you there? do you see "(provider network" clipped to "rovider network)" on the graphics in http://logs.openstack.org/90/541290/9/check/build-openstack-sphinx-docs/0278227/html/specs/rocky/approved/numa-aware-vswitches.html?17:11
jaypipesnot sure if I'm the only one that sees it because of my browser or something17:12
artomjaypipes, FWIW, I see it too17:15
artomBoth FF and Chrome17:15
* artom tries links ;)17:15
*** jmccarthy has left #openstack-nova17:18
*** dikonoor has quit IRC17:18
*** mdbooth has quit IRC17:22
jaypipesmriedem, dansmith: mgagne mentioned on the ML that the latest Nova no longer includes user_id in the request spec. Is that true? Did we remove user_id from the request spec somehow? I don't see user_id in the request spec object, but I also don't see a major object version bump so I'm unsure if user_id was ever there?17:27
*** sree has quit IRC17:27
mgagnejaypipes: could be that when RequestSpec was created/used, user_id was dropped without mention17:27
*** sree has joined #openstack-nova17:27
dansmithjaypipes: pretty sure it wasn't dropped17:28
mgagneI think there are no filter using it so maybe people saw no need to still support it17:29
*** itlinux has quit IRC17:29
mgagneI know it used to be available in filter_properties['instance_properties']['user_id']17:30
mgagnein fact17:30
mgagnefilter_properties['request_spec']['instance_properties']['user_id']17:30
jaypipeshmm..17:31
dansmithoh in filter_properties17:31
dansmiththat wouldn't require a bump17:31
dansmithmgagne: this is an internal nova object, what are you concerned about it being missing for?17:31
dansmithbecause of scheduling?17:31
mgagnedropped -> forgot to reimplement it17:31
*** sree has quit IRC17:32
mgagnedansmith: for a custom filter http://lists.openstack.org/pipermail/openstack-dev/2018-April/130022.html17:32
dansmithokay so you care that it's not coming to your filter17:33
mgagneyes17:33
dansmithis this where I say it's bad that we say we have a plugin interface we know is not stable because we don't test it and pass internal data structures to it? :)17:33
mgagne¯\_(ツ)_/¯ don't care much, it fits my need ;)17:34
*** gjayavelu has joined #openstack-nova17:37
*** sambetts is now known as sambetts|afk17:37
*** yamahata has joined #openstack-nova17:39
*** salv-orlando has quit IRC17:39
*** amoralej is now known as amoralej|off17:40
*** salv-orlando has joined #openstack-nova17:40
*** fragatin_ has quit IRC17:41
mgagneIf there is a defined object/interface, I will use it. Otherwise I will find a way to make it work. No much I can do to avoid that when the business I work for needs it.17:44
mgagneIf I can contribute something back (and don't forget about it), I will. If it's too much work/time, it's gonna go in the backlog and will try to contribute when time is available.17:44
*** salv-orlando has quit IRC17:44
mriedemi don't see anything specific to instance_properties['user_id'], the request spec 'instance_properties' looks like it's getting built from build_request_spec in certain flows, but that's using the instance object, which should have user_id on it17:47
mriedembuild_request_spec is also used when a really old instance is moved and doesn't have a request spec17:48
mriedemmgagne: i think i know what you're probably hitting17:48
mriedemmnaser hit it too17:49
mriedemand reported it17:49
mriedemhttps://review.openstack.org/#/c/529185/17:49
mgagneI already have an internal patch I can contribute: https://gist.github.com/mgagne/ed1fd3251997b2e60564fed43f47d96f17:49
mgagnejust need to port it for master, currently against mitaka17:50
mriedemmgagne: my guess is you are hitting a symptom of the same bug that ^ is working around17:51
mriedemin that data migrations for instances that didn't have request specs used an admin context, which doesn't have project_id or user_id set17:51
mgagneproject_id is available for me17:51
mgagnebut the object just doesn't have the user_id attribute17:51
mriedembecause that workaround puts it into the request spec17:51
mriedemare you hitting this on a move operation?17:52
mgagneno, new instances17:52
mriedemand you're going from which release (working) to which release (broken)?17:52
mgagneuser_id is not available because it's not in the RequestSpec class17:52
mriedemmgagne: yeah, that's because you should be using reqspec.instance.user_id no?17:53
mgagnekilo -> mitaka. I lost the user_id when moving from filter_properties to spec_obj17:53
mriedemok mitaka is definitely not "latest" nova17:53
mgagne=)17:53
mriedemwhy can't you use reqspec.instance.user_id?17:53
mriedemoh nvm17:53
mgagnespec_obj.project_id is available, not spec_obj.user_id17:53
mriedemRequestSpec.from_primitives uses filter_properties to build the RequestSpec from the instance, and doesn't save off the user_id17:54
mgagneI didn't look much into it, I saw that spec_obj.project_id was available and used elsewhere and tried spec_obj.user_id17:54
mriedemso https://review.openstack.org/#/c/197912/ was the regression for you in mitaka17:56
mgagneyes17:57
mgagneI'm just gonna contribute my patch and see where it goes from there17:57
*** tbachman has quit IRC17:57
*** liverpooler has quit IRC17:57
*** armaan has quit IRC17:58
mriedemwfm, should probably report a bug as well17:59
*** fragatina has joined #openstack-nova17:59
mgagnebug is enough? will open then17:59
mriedemregardless of the custom out of tree scheduler filter dependency, it makes sense to have user_id to know the user that originally requested to create the instance vs another user (in the same project) to move an instance17:59
mriedemespecially if we already have project_id in RequestSpec17:59
melwittfwiw, I agree. we have the same mismatch (project_id but no user_id) in InstanceMapping too18:00
mriedemmaybe others feel differently, but this seems ok to me as a regression fix, albeit for out of tree things18:00
mriedeminstance mappings are pretty special purpose though,18:00
mriedemand not tied to any pluggable interfaces as far as i know18:01
melwittno, but it was weird to see part of the owner info there and not the other when I looked at it for counting instances. I don't know what it uses project_id for currently18:03
*** liverpooler has joined #openstack-nova18:03
mriedemallocation claims in placement at least18:03
mriedemAggregateMultiTenancyIsolation also uses it18:04
mgagnehttps://github.com/openstack/nova/blob/master/nova/scheduler/filters/aggregate_multitenancy_isolation.py#L4118:04
mgagneyes18:04
mgagnethat's where I found spec_obj.project_id was available18:04
melwittI mean I don't know what the InstanceMapping.project_id is used for currently18:04
melwitti.e. why it needed project_id but not user_id18:05
dansmithmelwitt: so you can list instances :)18:05
*** r-daneel has quit IRC18:06
*** r-daneel has joined #openstack-nova18:06
dansmithmelwitt: for this: https://review.openstack.org/#/c/509003/818:08
melwittoh okay, so it doesn't just do a scatter-gather query instances by project_id and instead does separate queries per InstanceMapping? I didn't realize that18:08
dansmithwell, it was to avoid hitting cells you don't need during list.. I don't remember if we ever implemented that before my list thing,18:09
dansmithbut we never merged that bit of my newer thing either18:09
dansmithbecause of the BR thing I never finished18:09
*** moshele has joined #openstack-nova18:09
melwittoh, I see18:09
melwittso it could pre-check if there are any cells that do not contain that project_id18:10
dansmithit just got a unique list of cells that you have mappings for18:11
dansmithhttps://review.openstack.org/#/c/509002/8/nova/objects/cell_mapping.py18:11
dansmithwe never implemented that before (I just checked) with the old stuff because we were just using the global cell mapping list18:12
dansmithit's a perf tradeoff18:12
dansmithfor two cells and even distribution, it's faster to just use the global list,18:12
dansmithif you're cern, it makes sense to figure out which cells we should even ask during list18:13
dansmithmight should have a perf tunable in that last patch18:13
*** mvk has quit IRC18:14
mgagneI opened the bug, I'm currently working on it https://bugs.launchpad.net/nova/+bug/176810718:14
openstackLaunchpad bug 1768107 in OpenStack Compute (nova) "The user_id field is missing from RequestSpec" [Undecided,In progress] - Assigned to Mathieu Gagné (mgagne)18:14
melwittyeah, understood18:15
*** itlinux has joined #openstack-nova18:18
*** tbachman has joined #openstack-nova18:18
*** dave-mcc_ has quit IRC18:21
*** felipemonteiro__ has joined #openstack-nova18:29
*** dave-mccowan has joined #openstack-nova18:29
*** evin has joined #openstack-nova18:31
*** felipemonteiro_ has quit IRC18:32
openstackgerritMatt Riedemann proposed openstack/nova master: Implement granular policy rules for placement  https://review.openstack.org/52442518:37
openstackgerritMatt Riedemann proposed openstack/nova master: Cleanup placement policy generator docs  https://review.openstack.org/56522518:37
*** salv-orlando has joined #openstack-nova18:40
*** xinliang has quit IRC18:45
*** salv-orlando has quit IRC18:45
*** eharney has quit IRC18:46
*** mvk has joined #openstack-nova18:47
*** janki has quit IRC18:52
openstackgerritEric Fried proposed openstack/nova master: placement: Object changes for granular  https://review.openstack.org/56435118:55
openstackgerritEric Fried proposed openstack/nova master: WIP: placement: Granular GET /allocation_candidates  https://review.openstack.org/51775718:55
openstackgerritEric Fried proposed openstack/nova master: Get anchors for sharing providers  https://review.openstack.org/56527918:55
*** xinliang has joined #openstack-nova18:57
*** eharney has joined #openstack-nova18:59
*** moshele has quit IRC19:02
*** jmlowe has quit IRC19:07
*** itlinux has quit IRC19:07
*** bpoulos has joined #openstack-nova19:14
openstackgerritMatt Riedemann proposed openstack/nova-specs master: Return resources of entire trees in Placement  https://review.openstack.org/55946619:17
*** hemna_ has quit IRC19:22
*** jmlowe has joined #openstack-nova19:23
*** wolverineav has quit IRC19:31
*** wolverineav has joined #openstack-nova19:31
*** eharney has quit IRC19:34
*** wolverineav has quit IRC19:35
*** READ10 has quit IRC19:37
*** randomhack has joined #openstack-nova19:38
openstackgerritBrianna Poulos proposed openstack/nova stable/pike: conf: Do not inherit image signature props with snapshots  https://review.openstack.org/56528819:39
*** tlb has quit IRC19:40
*** salv-orlando has joined #openstack-nova19:41
*** moshele has joined #openstack-nova19:41
openstackgerritBrianna Poulos proposed openstack/nova stable/pike: conf: Do not inherit image signature props with snapshots  https://review.openstack.org/56528819:42
*** moshele has quit IRC19:44
*** salv-orlando has quit IRC19:46
*** armaan has joined #openstack-nova19:48
*** fragatina has quit IRC19:51
openstackgerritBrianna Poulos proposed openstack/nova master: Add notification support for trusted_certs  https://review.openstack.org/56326919:52
openstackgerritEric Fried proposed openstack/nova master: Get anchors for sharing providers  https://review.openstack.org/56527919:58
openstackgerritEric Fried proposed openstack/nova master: placement: Object changes for granular  https://review.openstack.org/56435119:58
openstackgerritEric Fried proposed openstack/nova master: WIP: placement: Granular GET /allocation_candidates  https://review.openstack.org/51775719:58
*** dave-mccowan has quit IRC20:02
*** sree has joined #openstack-nova20:03
*** itlinux has joined #openstack-nova20:06
*** rmart04 has joined #openstack-nova20:06
*** sree has quit IRC20:08
*** liverpooler has quit IRC20:10
*** felipemonteiro__ has quit IRC20:12
*** dave-mccowan has joined #openstack-nova20:17
*** itlinux has quit IRC20:17
*** hemna_ has joined #openstack-nova20:18
*** rmart04 has quit IRC20:18
*** itlinux has joined #openstack-nova20:19
*** fragatina has joined #openstack-nova20:19
*** fragatina has quit IRC20:20
*** jmlowe has quit IRC20:21
*** fragatina has joined #openstack-nova20:22
*** rmart04 has joined #openstack-nova20:23
*** slaweq_ has joined #openstack-nova20:27
*** rmart04 has quit IRC20:28
*** artom has quit IRC20:34
*** itlinux has quit IRC20:36
*** eharney has joined #openstack-nova20:37
*** salv-orlando has joined #openstack-nova20:42
*** salv-orlando has quit IRC20:46
*** slaweq has quit IRC20:50
*** slaweq_ is now known as slaweq20:54
*** dave-mccowan has quit IRC20:55
*** awaugama has quit IRC20:57
*** pchavva has quit IRC20:57
mriedemdansmith: i think https://review.openstack.org/#/c/325414/ (bottom patch in the console auth token series) is ready to go, comments up the stack on the other changes though20:59
mriedemdansmith: this is also likely a question for you https://review.openstack.org/#/c/333990/32/nova/console/websocketproxy.py@4320:59
*** vladikr has quit IRC21:01
*** vladikr has joined #openstack-nova21:03
dansmithmriedem: answered that question.. not sure I'll get to much more before EOD21:03
mriedemmelwitt: fyi, comments in your console auth token series21:05
mriedemi see the runway slot ends tomorrow21:05
mriedemsorry for being late on those21:05
melwittmriedem: replies in progress21:06
melwittno worries21:06
mriedemfwiw i think it's mostly easy stuff21:06
openstackgerritMathieu Gagné proposed openstack/nova master: Add user_id to RequestSpec  https://review.openstack.org/56534021:06
melwittthanks for the reviews21:06
*** tbachman has quit IRC21:06
*** dougshelley66 has quit IRC21:07
*** edmondsw has quit IRC21:07
*** bpoulos has quit IRC21:08
*** tbachman has joined #openstack-nova21:10
*** armaan has quit IRC21:10
*** tbachman has quit IRC21:10
*** edmondsw_ has joined #openstack-nova21:11
*** armaan has joined #openstack-nova21:11
*** armaan_ has joined #openstack-nova21:12
*** armaan has quit IRC21:12
*** edmondsw_ has quit IRC21:15
*** fishbone_ has quit IRC21:15
*** armaan_ has quit IRC21:22
*** esberglu has quit IRC21:22
melwittmriedem: do you happen to know what's the process for moving methods into os-vif plugins for plug/unplug? does there have to be a deprecation period or requirement for how the plugin has to be able to be installed? this is a change for moving bigswitch methods to a plugin: https://review.openstack.org/53437121:29
mriedemlast time i looked at that patch i asked some questions https://review.openstack.org/#/c/534371/4//COMMIT_MSG@1221:30
openstackgerritMathieu Gagné proposed openstack/nova master: Add user_id to RequestSpec  https://review.openstack.org/56534021:30
melwittoh, I'm blind21:31
mriedemas for what the process is, i don't think we really have one, but if we have some vif type impl in tree and then it moves to an out of tree neutron plugin, operators would obviously need to make sure the neutron agent is using that new package to provide that vif type support before they upgrade nova-compute21:32
mgagnemriedem: just to make sure, I'm looking at above test for user_id and they don't cover use case you are suggesting. so I'm a bit confused about why in that case, I should test for it.21:32
mriedemmgagne: see my latest reply?21:32
mgagnemriedem: yes, hence my question21:33
mriedemmgagne: because we have unit tests with false positives i think for some object compat tests21:33
mriedemso asserting that something is still in the primitive after the compat conversion is just good practice to make sure the test is not asserting a false positive21:33
mgagneok so it's a new use case we should add that doesn't exist currently21:34
mriedemmgagne: here is one example https://github.com/openstack/nova/blob/master/nova/tests/unit/objects/test_migrate_data.py#L7421:34
mgagnebecause there is no way I could have guess that this kind of test was a good idea by looking at previous tests above.21:34
melwittmriedem: okay, makes sense21:35
mgagneyes, I know the principle just wondering why now it's important and not before21:35
mriedemi think this test might be broken https://github.com/openstack/nova/blob/master/nova/tests/unit/objects/test_migrate_data.py#L22621:35
mriedemmgagne: because reviewers might not have thought about it before when reviewing these types of tests,21:35
mriedemand dansmith busted me on making the same mistake once in something i was adding that did the same thing, so now i'm conscious of it21:36
mgagnemriedem: ok, will add those tests. In that case, I suggest we retrofit the other tests too21:36
mriedemmgagne: i don't think that needs to happen in your change - retrofitting the existing tests i mean21:36
mgagneok21:36
openstackgerritMathieu Gagné proposed openstack/nova master: Add user_id to RequestSpec  https://review.openstack.org/56534021:38
*** felipemonteiro has joined #openstack-nova21:42
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Make `cpu_model_extra_flags` case-insensitive for real  https://review.openstack.org/56504321:43
*** salv-orlando has joined #openstack-nova21:43
*** dougshelley66 has joined #openstack-nova21:44
*** felipemonteiro_ has joined #openstack-nova21:46
*** tbachman has joined #openstack-nova21:47
arvindn05i need to add a patch method to the client under tests.functional.api.client.TestOpenStackClient21:47
*** salv-orlando has quit IRC21:48
arvindn05methods like tests.functional.api.client.TestOpenStackClient#post_image invoke tests.unit.image.fake._FakeImageService21:48
arvindn05how is this mapping made?21:48
*** felipemonteiro has quit IRC21:50
*** tbachman_ has joined #openstack-nova21:51
*** tbachman has quit IRC21:51
*** tbachman_ is now known as tbachman21:51
arvindn05in other words, how can i ensure a specific method is called when PATCH is called on the FakeImageService?21:51
mriedemwhy do you need to add a patch method?21:52
mriedemto update an existing fake image with required traits?21:53
arvindn05yup21:53
mriedemjust add a new fake image in the 'registry' with the required traits, hard-code the uuid and refer to that image id in your tests21:53
mriedemdone!21:53
arvindn05mriedem: glad you said that...i did exactly that i think....alex didnt want adding the image with required traits to the registry21:54
arvindn05https://review.openstack.org/#/c/560596/21:54
arvindn05:(21:54
arvindn05it kindof makes sense....we dont want the registry to grow big with each of these changes21:54
arvindn05so wanted to do the same as how you guys handled flavor in the same tests....basically update a fake image with required traits21:55
mriedemwe don't need a fake service for flavors21:55
mriedem_FakeImageService implements update() so why can't you just rely on that?21:56
mriedemyou should be able to just use this https://developer.openstack.org/api-ref/compute/#update-image-metadata21:56
mriedemhowever, you have to make sure to use microversion < 2.3921:56
mriedemwhich is pretty easy though21:57
mriedemwith nova.utils.temporary_mutation(self.api.microversion, '2.1'):21:57
mriedem   ... update image metadata21:57
arvindn05you mean >2.39 right?21:58
*** slaweq has quit IRC21:58
mriedemno21:58
mriedemsee the warning https://developer.openstack.org/api-ref/compute/#images-deprecated21:58
mriedemalso, i don't see where alex says to not create a new fake image in https://review.openstack.org/#/c/560596/21:59
arvindn05oh...how d21:59
arvindn05he said not to update the registry21:59
mriedemwhere?21:59
mriedemlink please21:59
arvindn05looking at this one of the alternatives21:59
arvindn05The API sample tests are for verify the API change, not sure we should use API sample test for other function/feature test.22:00
arvindn05on PS922:01
mriedemleft a comment in the patch22:02
arvindn05also is it a good idea to use deprecated api?22:03
arvindn05will check the comment22:03
*** jmlowe has joined #openstack-nova22:05
arvindn05patch seems to be a more longer term fix IMO22:06
arvindn05i will attempt to use the API mentioned for now....thanks mriedem22:06
arvindn05might be harder to implement the patch api i guess, to parse the operation, the path and value etc...22:07
arvindn05mriedem: from where does  tests.unit.image.fake._FakeImageService#update get called in case of the fake image service22:11
mriedemPATCH is if you're calling the image service API directly, which you wouldn't be within nova functional tests22:11
mriedemyou're calling the compute image API proxy, which doesn't use PATCH22:11
mriedemit's a stub for the nova.image.glance api code22:12
openstackgerritEd Leafe proposed openstack/nova master: Add columns for generation to consumers  https://review.openstack.org/55795822:12
openstackgerritEd Leafe proposed openstack/nova master: Add consumer generation checking logic  https://review.openstack.org/56464122:12
openstackgerritEd Leafe proposed openstack/nova master: Add a microversion for consumer generation  https://review.openstack.org/56200022:12
mriedemanyway, i have to run22:12
*** mriedem is now known as mriedem_away22:12
arvindn05thanks...will dig deeper22:12
*** dklyle has joined #openstack-nova22:13
*** rcernin has joined #openstack-nova22:13
mriedem_awaystephenfin: for your morrow, are you good with https://review.openstack.org/#/c/534371/ now? it's holding up mikal's https://review.openstack.org/#/c/557552/22:14
*** tbachman has quit IRC22:14
*** slaweq has joined #openstack-nova22:26
*** slaweq_ has joined #openstack-nova22:26
*** moshele has joined #openstack-nova22:27
*** slaweq_ has quit IRC22:28
openstackgerritMathieu Gagné proposed openstack/nova master: Add user_id to RequestSpec  https://review.openstack.org/56534022:29
*** moshele has quit IRC22:33
*** salv-orlando has joined #openstack-nova22:36
*** jmlowe has quit IRC22:37
*** abalutoiu_ has joined #openstack-nova22:51
openstackgerritEric Fried proposed openstack/nova master: WIP: placement: Granular GET /allocation_candidates  https://review.openstack.org/51775722:51
*** jmlowe has joined #openstack-nova22:53
*** abalutoiu__ has quit IRC22:54
openstackgerritEric Fried proposed openstack/nova master: WIP: placement: Granular GET /allocation_candidates  https://review.openstack.org/51775722:56
*** felipemonteiro_ has quit IRC22:56
*** slaweq has quit IRC22:56
*** slaweq has joined #openstack-nova22:56
*** hongbin has quit IRC22:59
*** slaweq has quit IRC23:01
*** felipemonteiro has joined #openstack-nova23:02
*** felipemonteiro_ has joined #openstack-nova23:02
*** purplerbot has quit IRC23:03
*** lbragstad has quit IRC23:05
*** felipemonteiro has quit IRC23:06
*** rajinir has quit IRC23:08
*** r-daneel has quit IRC23:09
*** purplerbot has joined #openstack-nova23:11
*** jmlowe has quit IRC23:13
*** sree has joined #openstack-nova23:14
*** jmlowe has joined #openstack-nova23:15
*** sree has quit IRC23:19
*** felipemonteiro__ has joined #openstack-nova23:23
*** felipemonteiro_ has quit IRC23:23
*** slaweq has joined #openstack-nova23:26
*** salv-orlando has quit IRC23:28
*** salv-orlando has joined #openstack-nova23:29
*** salv-orlando has quit IRC23:33
*** sree has joined #openstack-nova23:35
*** slaweq has quit IRC23:36
*** slaweq has joined #openstack-nova23:37
*** sree has quit IRC23:40
*** slaweq has quit IRC23:41
*** Lingwu has quit IRC23:47
*** hemna_ has quit IRC23:48
*** liverpooler has joined #openstack-nova23:48
*** cfriesen has quit IRC23:57
*** cfriesen has joined #openstack-nova23:57
openstackgerritmelanie witt proposed openstack/nova master: Convert websocketproxy to use db for token validation  https://review.openstack.org/33399023:59
openstackgerritmelanie witt proposed openstack/nova master: Update layout docs for running console proxies  https://review.openstack.org/55748923:59
openstackgerritmelanie witt proposed openstack/nova master: Deprecate the nova-consoleauth service  https://review.openstack.org/56536723:59
*** imacdonn has joined #openstack-nova23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!